-- Logs begin at Sun 2022-10-23 00:10:36 UTC, end at Sun 2022-10-23 03:00:11 UTC. -- Oct 23 00:59:42.284189 n-d-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Oct 23 00:59:42.292959 n-d-master-1 devstack@n-api.service[105088]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 23 00:59:42.294988 n-d-master-1 devstack@n-api.service[105088]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Oct 23 00:59:42 2022] *** Oct 23 00:59:42.294988 n-d-master-1 devstack@n-api.service[105088]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 23 00:59:42.294988 n-d-master-1 devstack@n-api.service[105088]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 23 00:59:42.294988 n-d-master-1 devstack@n-api.service[105088]: nodename: n-d-master-1 Oct 23 00:59:42.294988 n-d-master-1 devstack@n-api.service[105088]: machine: x86_64 Oct 23 00:59:42.294988 n-d-master-1 devstack@n-api.service[105088]: clock source: unix Oct 23 00:59:42.294988 n-d-master-1 devstack@n-api.service[105088]: pcre jit disabled Oct 23 00:59:42.294988 n-d-master-1 devstack@n-api.service[105088]: detected number of CPU cores: 4 Oct 23 00:59:42.294988 n-d-master-1 devstack@n-api.service[105088]: current working directory: / Oct 23 00:59:42.296123 n-d-master-1 devstack@n-api.service[105088]: detected binary path: /usr/bin/uwsgi-core Oct 23 00:59:42.296123 n-d-master-1 devstack@n-api.service[105088]: your processes number limit is 47680 Oct 23 00:59:42.296123 n-d-master-1 devstack@n-api.service[105088]: your memory page size is 4096 bytes Oct 23 00:59:42.296123 n-d-master-1 devstack@n-api.service[105088]: detected max file descriptor number: 2048 Oct 23 00:59:42.296123 n-d-master-1 devstack@n-api.service[105088]: lock engine: pthread robust mutexes Oct 23 00:59:42.296123 n-d-master-1 devstack@n-api.service[105088]: thunder lock: enabled Oct 23 00:59:42.296123 n-d-master-1 devstack@n-api.service[105088]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 23 00:59:42.296123 n-d-master-1 devstack@n-api.service[105088]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 23 00:59:42.334938 n-d-master-1 devstack@n-api.service[105088]: Python main interpreter initialized at 0x557b79ec89c0 Oct 23 00:59:42.334938 n-d-master-1 devstack@n-api.service[105088]: python threads support enabled Oct 23 00:59:42.334938 n-d-master-1 devstack@n-api.service[105088]: your server socket listen backlog is limited to 100 connections Oct 23 00:59:42.334938 n-d-master-1 devstack@n-api.service[105088]: your mercy for graceful operations on workers is 90 seconds Oct 23 00:59:42.335267 n-d-master-1 devstack@n-api.service[105088]: mapped 403077 bytes (393 KB) for 2 cores Oct 23 00:59:42.335354 n-d-master-1 devstack@n-api.service[105088]: *** Operational MODE: preforking *** Oct 23 00:59:42.335591 n-d-master-1 devstack@n-api.service[105088]: *** uWSGI is running in multiple interpreter mode *** Oct 23 00:59:42.335591 n-d-master-1 devstack@n-api.service[105088]: spawned uWSGI master process (pid: 105088) Oct 23 00:59:42.335770 n-d-master-1 systemd[1]: Started Devstack devstack@n-api.service. Oct 23 00:59:42.336794 n-d-master-1 devstack@n-api.service[105088]: spawned uWSGI worker 1 (pid: 105089, cores: 1) Oct 23 00:59:42.336794 n-d-master-1 devstack@n-api.service[105088]: spawned uWSGI worker 2 (pid: 105090, cores: 1) Oct 23 00:59:42.336794 n-d-master-1 devstack@n-api.service[105088]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 23 00:59:42.988608 n-d-master-1 devstack@n-api.service[105089]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 23 00:59:42.989618 n-d-master-1 devstack@n-api.service[105090]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 23 00:59:44.064187 n-d-master-1 devstack@n-api.service[105089]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 23 00:59:44.064187 n-d-master-1 devstack@n-api.service[105089]: from cryptography.utils import int_from_bytes Oct 23 00:59:44.064815 n-d-master-1 devstack@n-api.service[105089]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 23 00:59:44.064815 n-d-master-1 devstack@n-api.service[105089]: from cryptography.utils import int_from_bytes Oct 23 00:59:44.069471 n-d-master-1 devstack@n-api.service[105090]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 23 00:59:44.069471 n-d-master-1 devstack@n-api.service[105090]: from cryptography.utils import int_from_bytes Oct 23 00:59:44.069896 n-d-master-1 devstack@n-api.service[105090]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 23 00:59:44.069896 n-d-master-1 devstack@n-api.service[105090]: from cryptography.utils import int_from_bytes Oct 23 00:59:46.541753 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 23 00:59:46.542331 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 23 00:59:46.542550 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 23 00:59:46.542909 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 23 00:59:46.543071 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 23 00:59:46.543430 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 23 00:59:46.543526 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 23 00:59:46.543608 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.543839 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.543927 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 23 00:59:46.544158 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.544244 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 23 00:59:46.544442 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 23 00:59:46.544530 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.544789 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.544877 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.545150 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.545243 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.545470 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.545569 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.545785 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.545872 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.546134 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.546224 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.546396 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.546494 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.546708 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.546792 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.547035 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.547167 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.547355 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.547448 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.547655 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.547753 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.547960 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.548049 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.548274 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.548377 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.548576 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.548675 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.548892 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.548992 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.549192 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.549286 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.549507 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.549681 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.549843 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.550127 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.550219 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.550681 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.550790 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.550995 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.551193 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.551353 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.551497 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.551643 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.551799 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.551961 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.552123 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.552267 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.552443 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.552537 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.552755 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.552854 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.553064 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.553153 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.553382 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.553540 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.553684 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.553843 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.554029 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.554200 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.554343 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.554483 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.554735 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.554895 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.555051 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.555197 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.555364 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.555538 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.555696 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.555845 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.556085 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.556179 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.556398 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.556506 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.556707 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.556797 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.557027 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.557117 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.557342 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.557444 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.557648 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.557738 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.557947 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.558072 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.558282 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.558374 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.558589 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.558735 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.558903 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.559045 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.559190 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.559324 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.559500 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.559641 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.559789 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.559925 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.560068 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.560220 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.560361 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.560498 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.561196 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.561355 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.561492 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.561626 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.561765 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.561913 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.562084 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.562235 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.562388 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.562533 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.562669 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.562827 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.562982 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.563124 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.563261 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.563394 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.563542 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.563679 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.563827 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.563969 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.564119 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.564254 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.564388 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.564530 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.564668 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.564802 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.564936 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.565069 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.565203 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.565349 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.565491 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.565634 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.565803 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.565946 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.566129 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.566281 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.566443 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.566585 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.566758 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.566901 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.567070 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.567234 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.567372 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.567506 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.567683 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.567837 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.567981 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.568115 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.568290 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.568467 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.568607 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.568749 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.568895 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.569030 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.569198 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.569340 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.569503 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.569645 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.569799 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.569943 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.570137 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.570291 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.570465 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.570605 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.570750 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.570892 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.571028 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.571162 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.571295 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.571428 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.571581 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.571729 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.571864 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.572000 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.572165 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.572317 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.572453 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.572587 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.572757 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.572912 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.573050 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.573224 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.573367 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.573536 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.573678 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.573844 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.574017 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.574176 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.574314 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.574449 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.574582 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.574759 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.574901 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.575072 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.575216 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.575379 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.575532 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.575676 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.575894 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.576037 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.576263 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.576947 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.577098 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.577235 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.577382 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.577518 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.577661 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.577805 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.577941 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.578129 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.578276 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.578412 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.578546 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.578680 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.578813 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.578954 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.579097 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.579249 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.579387 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.579531 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.579675 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.579812 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.579967 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.580111 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.580245 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.580388 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.580522 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.580664 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.580808 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.580944 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.581079 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.581255 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.581397 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.581556 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.581708 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.581858 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.582014 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.582202 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.582342 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.582504 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.582657 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.582799 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.582935 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.583093 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.583249 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.583395 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.583532 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.583683 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.583819 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.583954 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.584088 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.584246 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.584383 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.584540 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.584682 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.584838 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.584988 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.585153 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.585296 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.585456 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.585608 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.585744 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.585879 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.586078 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.586234 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.586377 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.586512 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.586647 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.586782 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.586967 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.587110 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.587282 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.587441 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.587599 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.587745 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.587887 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.588030 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.588188 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:59:46.588338 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.588506 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.588651 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.588843 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.588985 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.589161 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.589316 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.589480 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.589627 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.589784 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.589927 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.590123 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.590267 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.590433 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.590584 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.590743 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.590892 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.591061 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.591201 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.591372 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.591524 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.591691 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.591894 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.592069 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.592218 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.592364 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.592500 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.592635 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.592769 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.592934 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.593087 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.593239 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.593397 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.593559 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.593709 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.593878 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.594041 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.594198 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.594335 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.594518 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.594661 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.594839 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.594983 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.595158 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.595299 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.595477 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.595618 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.595790 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.595946 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.596090 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.596232 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.596390 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.596533 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.596698 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.596927 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.597075 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.597213 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.597348 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.597494 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.597639 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.597784 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.597926 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.598122 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.598261 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.598407 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.598550 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.598699 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.598858 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.599011 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.599169 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.599313 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.599469 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.599606 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.599773 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.599916 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.600082 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.600224 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.600416 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.600560 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.600725 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.600867 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.601040 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.601182 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.601336 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.601481 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.601649 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.601792 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.601962 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.602127 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.602298 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.602443 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.602608 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.602750 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.602917 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.603060 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.603205 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.603352 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.603514 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.603657 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.603800 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.603945 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.604109 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.604259 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.604403 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.604548 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.604718 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.604870 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.605043 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.605193 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.605339 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.605475 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.605665 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.605820 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.605964 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.606157 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.606293 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.606428 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.606572 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.606719 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.606885 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.607028 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.607171 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.607317 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.607498 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.607643 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.607801 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.607953 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.608091 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.608233 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.608414 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.608558 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.608722 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.608865 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.609024 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.609168 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.609344 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.609488 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.609648 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.609792 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.609954 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.610138 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.610287 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.610432 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.610569 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.610704 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.610876 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.611027 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.611174 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.611309 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.611477 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.611621 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.611797 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.611950 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.612111 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.612253 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.612419 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.612562 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.612749 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.612900 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.613064 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.613232 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.613377 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.613520 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.613657 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.613801 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.614020 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.614183 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.614328 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.614472 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.614616 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.614752 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.614887 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.615022 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.615166 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.615302 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.615473 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.615617 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.615774 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.615917 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.616081 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.616224 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.616367 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.616503 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.616671 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.616814 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.616971 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.617124 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.617274 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.617419 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.617556 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.617691 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.617864 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.618040 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.618205 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.618347 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.618507 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.618650 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.618808 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.618970 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.619108 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.619244 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.619432 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.619584 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.619721 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.619872 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.620016 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.620151 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.620320 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.620466 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.620629 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.620781 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.620973 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.621117 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.621281 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.621442 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.621589 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.621733 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.621875 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.622060 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.622202 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.622339 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.622510 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.622662 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.622820 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.622974 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.623648 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.623789 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.623939 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.624075 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.624248 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.624404 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.624543 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.624677 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.624869 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.625013 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.625177 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.625320 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.625493 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.625723 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.625861 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.626023 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.626165 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.626301 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.626447 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.626592 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.626728 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.626875 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.627048 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.627190 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.627358 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.627520 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.627659 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.627793 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.627962 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.628105 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.628270 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.628422 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.628580 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.628731 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.628890 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.629040 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.629184 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.629338 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.629501 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.629645 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.629808 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.629958 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.630162 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.630299 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.630434 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.630569 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.630749 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.630890 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.631038 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.631179 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.631354 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.631496 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.631656 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.631808 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.631954 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.632098 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.632273 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.632416 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.632602 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.632753 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.632900 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.633036 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.633205 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.633366 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.633509 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.633652 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.633819 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.633961 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.634153 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.634306 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.634451 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.634595 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.634739 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.634874 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.635045 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.635188 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.635341 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.635487 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.635654 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.635797 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.635966 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.636110 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.636253 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.636396 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.636561 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.636704 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.636868 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.637010 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.637175 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.637329 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.637466 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.637600 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.637767 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.637917 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.638119 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.638255 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.638401 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.638545 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.638762 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.639389 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.639542 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.639691 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.639828 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.639971 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.640137 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.640281 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.640426 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.640563 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.640749 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.640901 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.641060 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.641203 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.641347 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.641488 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.641647 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.641792 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.641935 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.642160 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.642300 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.642436 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.642570 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.642705 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.642878 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.643029 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.643195 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.643340 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.643500 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.643660 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.643805 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.643948 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.644106 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.644249 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.644416 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.644560 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.644725 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.644880 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.645046 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.645188 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.645355 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.645496 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.645650 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.645787 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.645956 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.646140 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.646290 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.646425 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.646570 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.646705 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.646879 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.647023 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.647189 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.647337 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.647493 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.647637 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.647773 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.647909 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.648079 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.648229 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.648375 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.648518 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.648663 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.648798 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.648977 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.649129 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.649267 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.649544 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.649688 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.649872 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.650055 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.650207 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.650344 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.650511 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.650654 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.650849 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.651069 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.651232 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.651402 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.651546 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.651717 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.651859 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.652034 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.652176 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.652392 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.652528 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.652678 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.652823 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.652959 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.653094 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.653229 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.653411 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.653565 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.653701 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.653837 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.654011 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.654156 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.654337 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.654490 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.654635 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.654771 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.654908 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.655042 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.655186 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.655335 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.655481 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.655617 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.655751 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.655907 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.656051 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.656187 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.656322 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.656457 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.656604 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.656749 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.656894 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.657056 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.657207 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.657370 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.657507 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.657652 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.657788 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.657955 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.658136 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.658273 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.658418 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.658563 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.658698 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.658889 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.659034 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.659178 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.659341 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.659515 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.659667 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.659841 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.659984 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.660180 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.660332 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.660469 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.660605 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.660774 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.660916 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.661095 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.661257 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.661395 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.661531 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.661688 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.661831 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.662034 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.662179 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.662325 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.662461 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.662596 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.662759 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.662919 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.663057 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.663208 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.663343 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.663479 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.663649 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.663802 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.663946 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.664082 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.664255 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.664398 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.664546 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.664691 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.664857 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.664999 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.665153 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.665289 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.665461 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.665605 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.665772 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.665915 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.666089 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.666227 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.666397 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.666540 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.666699 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.666841 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.667000 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.667153 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.667299 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.667436 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.667579 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.667714 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.667887 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.668037 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.668183 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.668318 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.668454 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.668597 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.668757 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.668924 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.669062 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.669205 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.669341 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.669476 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.669641 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.669793 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.670475 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.670623 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.670796 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.670938 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.671085 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.671238 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.671386 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.671522 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.671685 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.671835 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.671973 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.672118 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.672277 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.672420 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.672590 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.672733 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.672895 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.673050 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.673189 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.673342 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.673485 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.673622 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.673766 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.673903 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.674096 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.674241 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.674398 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.674552 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.674697 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.674842 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.674978 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.675114 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.675280 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.675708 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.675859 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.675996 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.676131 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.676266 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.676437 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.676589 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.676726 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.676862 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.677046 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.677189 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.677348 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.677515 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.677653 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.677795 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.677932 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.678112 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.678250 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.678463 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.678609 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.678752 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.678888 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.679033 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.679169 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.679328 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.679465 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.679600 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.679743 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.679888 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.680039 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.680181 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.680354 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.680505 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.680654 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.680797 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.680973 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.681124 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.681277 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.681420 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.681561 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.681702 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.681852 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.682024 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.682174 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.682316 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.682485 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.682646 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.682798 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.682941 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.683094 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.683253 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.683395 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.683544 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.683694 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.683844 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.683986 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.684128 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.684282 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.684435 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.684577 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.684725 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.684867 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.685007 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.685157 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.685309 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.685452 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.685675 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.686409 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.686554 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.686694 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.686853 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.686996 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.687136 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.687285 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.687428 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.687569 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.687734 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.687877 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.688018 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.688160 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.688301 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.688457 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.688601 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.688742 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.688884 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.689025 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.689166 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.689316 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.689480 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.689630 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.689773 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.689921 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.690110 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.690265 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.690416 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.690559 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.690707 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.690851 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.690992 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.691142 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.691285 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.691437 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.691580 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.691721 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.691875 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.692019 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.692168 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.692309 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.692457 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.692600 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.692750 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.692893 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.693034 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.693181 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.693344 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.693495 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.693649 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.693800 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.693943 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.694109 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.694280 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.694417 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.694582 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.694833 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.694984 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.695126 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.695268 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.695432 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.695576 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.695719 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.695874 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.696016 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.696158 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.696311 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.696454 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.696596 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.696780 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.696930 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.697094 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.697263 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.697407 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.697548 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.697690 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.697842 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.698061 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.698225 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.698369 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.698511 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.698652 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.698793 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.698944 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.699087 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.699239 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.699380 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.699522 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.699663 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.699817 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.700054 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.700212 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.700361 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.700503 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.700645 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.700795 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.700944 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.701087 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.701353 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.701505 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.701680 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.701856 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.702045 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.702205 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.702349 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.702491 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.702633 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.702782 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.702925 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.703086 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.703241 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.703384 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.703526 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.703668 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.703832 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.703988 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.704132 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.704274 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.704416 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.704560 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.704710 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.704854 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.704995 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.705148 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.705291 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.705441 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.705694 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.705847 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.706039 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.706191 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.706334 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.706475 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.706633 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.706783 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.706933 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.707077 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.707229 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.707381 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.707524 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.707666 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.707808 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.707983 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.708133 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.708285 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.708436 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.708601 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.708751 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.708927 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.709087 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.709242 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.709388 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.709538 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.709682 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.709823 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.710009 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.710178 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.710322 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.710473 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.710617 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.710767 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.710922 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.711075 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.711217 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.711359 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.711501 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.711643 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.711793 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.711936 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.712087 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.712230 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.712372 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.712514 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.712665 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.712809 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.712961 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.713103 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.713245 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.713387 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.713538 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.713681 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.713830 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.714006 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.714156 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.714311 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.714455 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.714599 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.714742 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.714894 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.715037 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.715192 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.715336 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.715546 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.715697 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.715847 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.715989 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.716168 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.716328 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.716493 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.716643 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.716832 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.716984 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.717175 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.717320 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.717461 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.717603 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.717746 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.717897 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.718098 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.718250 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.718394 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.718547 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.718690 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.718853 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.718996 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.719138 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.719288 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.719440 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.719582 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.719733 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.719878 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.720020 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.720161 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.720311 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.720455 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.720605 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.720758 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.720901 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.721057 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.721200 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.721350 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.721493 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.721635 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.721818 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.722015 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.722167 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.722325 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.722468 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.722611 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.722770 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.722914 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.723064 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.723215 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.723359 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.723501 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.723642 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.723784 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.723968 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.724199 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.724344 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.724486 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.724638 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.724780 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.724930 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.725081 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.725224 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.725374 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.725523 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.725666 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.725816 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.725960 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.726145 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.726296 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.726447 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.726600 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.726756 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.726899 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.727040 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.727182 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.727324 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.727465 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.727616 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.727759 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.727977 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.728125 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.728293 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.728452 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.728606 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.728749 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.728891 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.729032 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.729204 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.729364 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.729515 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.729657 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.729807 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.729949 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.730155 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.730312 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.730505 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.730673 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.730818 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.730960 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.731101 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.731326 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.731472 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.731614 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.731755 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.731897 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.732051 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.732194 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.732358 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.733050 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.733196 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.733339 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.733496 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.733640 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.733782 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.733923 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.734119 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.734282 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.734473 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.734629 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.734792 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.734935 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.735078 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.735230 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.735374 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.735516 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.735729 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.735895 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.736038 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.736190 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.736333 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.736476 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.736629 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.736788 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.736941 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.737093 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.737239 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.737390 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.737533 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.737676 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.737826 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.738024 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.738179 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.738333 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.738478 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.738639 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.738784 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.738926 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.739068 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.739210 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.739360 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.739517 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.739660 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.739803 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.739944 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.740085 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.740228 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.740388 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.740660 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.740812 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.740977 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.741127 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.741303 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.741454 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.741640 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.741788 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.741963 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.742137 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.742296 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.742450 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.742592 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.742734 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.742903 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.743051 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.743203 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.743424 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.743574 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.743744 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.743929 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.744077 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.744230 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.744373 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.744524 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.744667 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.744809 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.744965 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.745113 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.745256 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.745397 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.745539 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.745687 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.745839 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.746016 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.746228 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.746387 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.746541 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.746716 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.746875 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.747019 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.747162 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.747339 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.747489 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.747664 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.747823 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.747967 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.748691 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.748849 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.749001 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.749163 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.749307 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.749449 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.749693 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.749843 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.750026 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.750191 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.750336 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.750478 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.750619 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.750760 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.750910 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.751073 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.751223 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.751368 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.751509 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.751650 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.751792 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.751946 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.752089 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.752254 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.752405 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.752548 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.752699 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.752868 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.753028 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.753170 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.753312 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.753487 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.753644 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.753789 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.753931 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.754117 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.754262 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.754403 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.754558 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.754702 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.754852 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.755005 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.755155 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.755307 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.755459 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.755610 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.755753 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.755894 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.756036 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.756186 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.756329 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.756477 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.756628 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.756770 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.756928 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.757085 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.757229 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.757370 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.757512 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.757653 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.757794 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.757944 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.758111 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.758255 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.758396 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.758538 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.758691 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.758845 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.758997 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.759140 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.759281 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.759422 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.759572 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.759717 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.759867 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.760019 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.760169 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.760312 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.760533 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.760688 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.760900 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.761060 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.761211 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.761353 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.761504 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.761648 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.761790 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.761932 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.762133 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.762277 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.762431 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.762575 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.762730 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.762874 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.763057 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.763226 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.763371 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.763513 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.763656 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.763946 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.764097 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.764286 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.764437 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.764612 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.764773 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.764950 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.765101 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.765268 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.765371 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.765576 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.765667 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.765882 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.766030 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.766215 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.766305 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.766523 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.766615 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.766828 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.766932 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.767138 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.767227 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.767445 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.767532 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.767752 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.767849 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.768066 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.768176 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.768382 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.768477 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.768696 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.768786 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.769009 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.769109 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.769316 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.769402 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.769627 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.769730 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.769934 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.770039 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.770267 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.770353 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.770577 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.770667 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.770885 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.770971 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.771198 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.771285 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.771531 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.771620 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.771844 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.771931 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.772149 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.772250 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.772510 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.772805 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.772905 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.773124 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.773220 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.773435 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.773523 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.773750 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.773837 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.774084 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.774175 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.774403 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.774502 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.774725 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.774815 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.775035 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.775133 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.775342 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.775442 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.775652 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.775982 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.776069 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.776305 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.776400 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.776630 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.776727 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.776953 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.777040 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.777259 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.777354 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.777563 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.777650 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.777881 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.778106 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.778285 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.778432 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.778576 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.778717 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.778879 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.779032 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.779175 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.779358 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.779510 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.779691 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.779843 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.779994 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.780146 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.780290 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.780432 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.780583 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.780735 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.780898 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.781041 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.781190 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.781333 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.781474 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.781624 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.781769 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.781920 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.782106 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.782250 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.782402 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.782554 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.782698 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.782864 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.783009 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.783150 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.783291 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.783444 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.783588 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.783729 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.783883 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.784024 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.784174 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.784317 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.784466 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.784619 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.784770 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.784921 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.785073 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.785216 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.785357 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.785498 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.785647 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.785790 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.785941 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.786109 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.786273 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.786420 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.786588 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.786742 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.786894 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.787037 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.787178 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.787326 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.787469 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.787619 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.787780 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.788009 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.788173 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.788319 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.788461 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.788622 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.788765 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.788915 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.789066 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.789208 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.789349 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.789568 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.789713 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.789854 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.790014 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.790164 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.790316 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.790469 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.790623 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.790764 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.790906 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.791047 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.791198 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.791342 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.791484 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.791625 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.791766 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.791908 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.792062 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.792207 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.792366 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.792517 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.792660 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.792811 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.792963 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.793106 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.793249 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.793391 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.793539 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.793690 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.793843 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.794011 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.794170 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.794314 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.794456 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.794610 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.794753 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.794895 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.795570 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.795721 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.795863 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.796013 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.796157 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.796299 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.796441 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.796592 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.796747 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.796890 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.797031 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.797173 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.797314 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.797456 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.797606 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.797749 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.797891 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.798052 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.798198 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.798350 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.798505 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.798649 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.798815 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.798966 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.799155 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.799314 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.799483 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.799641 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.799784 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.799926 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.800076 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.800227 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.800380 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.800811 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.800955 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 23 00:59:46.801104 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.801334 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.801681 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.802013 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.802361 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.802690 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.803009 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.803322 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.803647 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:59:46.803909 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 23 00:59:46.953611 n-d-master-1 devstack@n-api.service[105089]: INFO dbcounter [None req-25d50f83-1a5b-4087-acc9-22ff5cb0edeb None None] Registered counter for database nova_api Oct 23 00:59:46.956959 n-d-master-1 devstack@n-api.service[105090]: INFO dbcounter [None req-0f503bac-8cb9-402a-ae76-b664d97d988c None None] Registered counter for database nova_api Oct 23 00:59:46.974777 n-d-master-1 devstack@n-api.service[105089]: DEBUG oslo_db.sqlalchemy.engines [None req-25d50f83-1a5b-4087-acc9-22ff5cb0edeb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105089) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 00:59:46.978895 n-d-master-1 devstack@n-api.service[105090]: DEBUG oslo_db.sqlalchemy.engines [None req-0f503bac-8cb9-402a-ae76-b664d97d988c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105090) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 00:59:46.981275 n-d-master-1 devstack@n-api.service[105089]: DEBUG dbcounter [-] [105089] Writer thread running {{(pid=105089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 00:59:46.985562 n-d-master-1 devstack@n-api.service[105090]: DEBUG dbcounter [-] [105090] Writer thread running {{(pid=105090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 00:59:47.037779 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.context [None req-25d50f83-1a5b-4087-acc9-22ff5cb0edeb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8efa99f7-1ff1-40c2-a97e-acbc153fb79d(cell1) {{(pid=105089) load_cells /opt/stack/nova/nova/context.py:464}} Oct 23 00:59:47.041601 n-d-master-1 devstack@n-api.service[105089]: DEBUG oslo_concurrency.lockutils [None req-25d50f83-1a5b-4087-acc9-22ff5cb0edeb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:59:47.055252 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.context [None req-0f503bac-8cb9-402a-ae76-b664d97d988c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8efa99f7-1ff1-40c2-a97e-acbc153fb79d(cell1) {{(pid=105090) load_cells /opt/stack/nova/nova/context.py:464}} Oct 23 00:59:47.055370 n-d-master-1 devstack@n-api.service[105089]: DEBUG oslo_concurrency.lockutils [None req-25d50f83-1a5b-4087-acc9-22ff5cb0edeb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:59:47.055370 n-d-master-1 devstack@n-api.service[105089]: DEBUG oslo_concurrency.lockutils [None req-25d50f83-1a5b-4087-acc9-22ff5cb0edeb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:59:47.055370 n-d-master-1 devstack@n-api.service[105089]: DEBUG oslo_concurrency.lockutils [None req-25d50f83-1a5b-4087-acc9-22ff5cb0edeb None None] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:59:47.055370 n-d-master-1 devstack@n-api.service[105089]: DEBUG oslo_concurrency.lockutils [None req-25d50f83-1a5b-4087-acc9-22ff5cb0edeb None None] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:59:47.055651 n-d-master-1 devstack@n-api.service[105090]: DEBUG oslo_concurrency.lockutils [None req-0f503bac-8cb9-402a-ae76-b664d97d988c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:59:47.055651 n-d-master-1 devstack@n-api.service[105090]: DEBUG oslo_concurrency.lockutils [None req-0f503bac-8cb9-402a-ae76-b664d97d988c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:59:47.055870 n-d-master-1 devstack@n-api.service[105089]: DEBUG oslo_concurrency.lockutils [None req-25d50f83-1a5b-4087-acc9-22ff5cb0edeb None None] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:59:47.055969 n-d-master-1 devstack@n-api.service[105090]: DEBUG oslo_concurrency.lockutils [None req-0f503bac-8cb9-402a-ae76-b664d97d988c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:59:47.055969 n-d-master-1 devstack@n-api.service[105090]: DEBUG oslo_concurrency.lockutils [None req-0f503bac-8cb9-402a-ae76-b664d97d988c None None] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:59:47.056131 n-d-master-1 devstack@n-api.service[105089]: INFO dbcounter [None req-25d50f83-1a5b-4087-acc9-22ff5cb0edeb None None] Registered counter for database nova_cell0 Oct 23 00:59:47.056201 n-d-master-1 devstack@n-api.service[105090]: DEBUG oslo_concurrency.lockutils [None req-0f503bac-8cb9-402a-ae76-b664d97d988c None None] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:59:47.056201 n-d-master-1 devstack@n-api.service[105090]: DEBUG oslo_concurrency.lockutils [None req-0f503bac-8cb9-402a-ae76-b664d97d988c None None] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:59:47.056330 n-d-master-1 devstack@n-api.service[105089]: INFO dbcounter [None req-25d50f83-1a5b-4087-acc9-22ff5cb0edeb None None] Registered counter for database nova_cell1 Oct 23 00:59:47.056395 n-d-master-1 devstack@n-api.service[105090]: INFO dbcounter [None req-0f503bac-8cb9-402a-ae76-b664d97d988c None None] Registered counter for database nova_cell0 Oct 23 00:59:47.057869 n-d-master-1 devstack@n-api.service[105090]: INFO dbcounter [None req-0f503bac-8cb9-402a-ae76-b664d97d988c None None] Registered counter for database nova_cell1 Oct 23 00:59:47.061089 n-d-master-1 devstack@n-api.service[105089]: DEBUG oslo_db.sqlalchemy.engines [None req-25d50f83-1a5b-4087-acc9-22ff5cb0edeb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105089) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 00:59:47.063484 n-d-master-1 devstack@n-api.service[105089]: DEBUG oslo_db.sqlalchemy.engines [None req-25d50f83-1a5b-4087-acc9-22ff5cb0edeb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105089) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 00:59:47.065855 n-d-master-1 devstack@n-api.service[105090]: DEBUG oslo_db.sqlalchemy.engines [None req-0f503bac-8cb9-402a-ae76-b664d97d988c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105090) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 00:59:47.067203 n-d-master-1 devstack@n-api.service[105090]: DEBUG oslo_db.sqlalchemy.engines [None req-0f503bac-8cb9-402a-ae76-b664d97d988c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105090) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 00:59:47.068735 n-d-master-1 devstack@n-api.service[105089]: DEBUG dbcounter [-] [105089] Writer thread running {{(pid=105089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 00:59:47.073675 n-d-master-1 devstack@n-api.service[105090]: DEBUG dbcounter [-] [105090] Writer thread running {{(pid=105090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 00:59:47.074238 n-d-master-1 devstack@n-api.service[105089]: DEBUG dbcounter [-] [105089] Writer thread running {{(pid=105089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 00:59:47.075996 n-d-master-1 devstack@n-api.service[105090]: DEBUG dbcounter [-] [105090] Writer thread running {{(pid=105090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 00:59:47.215107 n-d-master-1 devstack@n-api.service[105089]: INFO dbcounter [None req-25d50f83-1a5b-4087-acc9-22ff5cb0edeb None None] Registered counter for database nova_cell0 Oct 23 00:59:47.219675 n-d-master-1 devstack@n-api.service[105090]: INFO dbcounter [None req-0f503bac-8cb9-402a-ae76-b664d97d988c None None] Registered counter for database nova_cell0 Oct 23 00:59:47.222196 n-d-master-1 devstack@n-api.service[105089]: DEBUG oslo_db.sqlalchemy.engines [None req-25d50f83-1a5b-4087-acc9-22ff5cb0edeb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105089) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 00:59:47.227089 n-d-master-1 devstack@n-api.service[105089]: DEBUG dbcounter [-] [105089] Writer thread running {{(pid=105089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 00:59:47.228559 n-d-master-1 devstack@n-api.service[105090]: DEBUG oslo_db.sqlalchemy.engines [None req-0f503bac-8cb9-402a-ae76-b664d97d988c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105090) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 00:59:47.232817 n-d-master-1 devstack@n-api.service[105090]: DEBUG dbcounter [-] [105090] Writer thread running {{(pid=105090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 00:59:47.592694 n-d-master-1 devstack@n-api.service[105089]: WARNING keystonemiddleware.auth_token [None req-25d50f83-1a5b-4087-acc9-22ff5cb0edeb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 23 00:59:47.600034 n-d-master-1 devstack@n-api.service[105089]: WARNING keystonemiddleware.auth_token [None req-25d50f83-1a5b-4087-acc9-22ff5cb0edeb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 23 00:59:47.613100 n-d-master-1 devstack@n-api.service[105090]: WARNING keystonemiddleware.auth_token [None req-0f503bac-8cb9-402a-ae76-b664d97d988c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 23 00:59:47.620322 n-d-master-1 devstack@n-api.service[105090]: WARNING keystonemiddleware.auth_token [None req-0f503bac-8cb9-402a-ae76-b664d97d988c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 23 00:59:47.940692 n-d-master-1 devstack@n-api.service[105089]: WARNING keystonemiddleware.auth_token [None req-25d50f83-1a5b-4087-acc9-22ff5cb0edeb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 23 00:59:47.946614 n-d-master-1 devstack@n-api.service[105089]: WARNING keystonemiddleware.auth_token [None req-25d50f83-1a5b-4087-acc9-22ff5cb0edeb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 23 00:59:47.951928 n-d-master-1 devstack@n-api.service[105089]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557b79ec89c0 pid: 105089 (default app) Oct 23 00:59:47.953984 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi [None req-25d50f83-1a5b-4087-acc9-22ff5cb0edeb None None] Calling method '>' {{(pid=105089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 00:59:47.955157 n-d-master-1 devstack@n-api.service[105089]: INFO nova.api.openstack.requestlog [None req-25d50f83-1a5b-4087-acc9-22ff5cb0edeb None None] 10.222.0.42 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001713 Oct 23 00:59:47.955561 n-d-master-1 devstack@n-api.service[105089]: [pid: 105089|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 788 bytes} [Sun Oct 23 00:59:47 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 00:59:47.959753 n-d-master-1 devstack@n-api.service[105090]: WARNING keystonemiddleware.auth_token [None req-0f503bac-8cb9-402a-ae76-b664d97d988c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 23 00:59:47.965667 n-d-master-1 devstack@n-api.service[105090]: WARNING keystonemiddleware.auth_token [None req-0f503bac-8cb9-402a-ae76-b664d97d988c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 23 00:59:47.971535 n-d-master-1 devstack@n-api.service[105090]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557b79ec89c0 pid: 105090 (default app) Oct 23 01:01:11.508658 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi [None req-25d50f83-1a5b-4087-acc9-22ff5cb0edeb None None] Calling method '>' {{(pid=105089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:01:11.509668 n-d-master-1 devstack@n-api.service[105089]: INFO nova.api.openstack.requestlog [None req-25d50f83-1a5b-4087-acc9-22ff5cb0edeb None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Oct 23 01:01:11.510101 n-d-master-1 devstack@n-api.service[105089]: [pid: 105089|app: 0|req: 2/2] 10.222.0.42 () {54 vars in 931 bytes} [Sun Oct 23 01:01:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:01:11.527068 n-d-master-1 devstack@n-api.service[105090]: DEBUG dbcounter [-] [105090] Writing DB stats nova_api:SELECT=3 {{(pid=105090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:01:11.527892 n-d-master-1 devstack@n-api.service[105090]: DEBUG dbcounter [-] [105090] Writing DB stats nova_cell1:SELECT=3 {{(pid=105090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:01:11.528773 n-d-master-1 devstack@n-api.service[105090]: DEBUG dbcounter [-] [105090] Writing DB stats nova_cell0:SELECT=3 {{(pid=105090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:01:11.529628 n-d-master-1 devstack@n-api.service[105090]: DEBUG dbcounter [-] [105090] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:01:12.382574 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi [None req-8eea0b92-0e8c-487a-95a4-a78f1a267e11 admin admin] Calling method '>' {{(pid=105090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:01:12.416938 n-d-master-1 devstack@n-api.service[105090]: INFO nova.api.openstack.requestlog [None req-8eea0b92-0e8c-487a-95a4-a78f1a267e11 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.899946 Oct 23 01:01:12.417765 n-d-master-1 devstack@n-api.service[105090]: [pid: 105090|app: 0|req: 1/3] 10.222.0.42 () {60 vars in 1292 bytes} [Sun Oct 23 01:01:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:01:15.071325 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi [None req-25d50f83-1a5b-4087-acc9-22ff5cb0edeb None None] Calling method '>' {{(pid=105089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:01:15.072311 n-d-master-1 devstack@n-api.service[105089]: INFO nova.api.openstack.requestlog [None req-25d50f83-1a5b-4087-acc9-22ff5cb0edeb None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Oct 23 01:01:15.072924 n-d-master-1 devstack@n-api.service[105089]: [pid: 105089|app: 0|req: 3/4] 10.222.0.42 () {54 vars in 931 bytes} [Sun Oct 23 01:01:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:01:15.506236 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi [None req-bc26b04a-7d7c-4e78-927f-f4e270fed4bc admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "id": "c1", "ram": 256, "name": "cirros256", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=105090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:01:15.636091 n-d-master-1 devstack@n-api.service[105090]: INFO nova.api.openstack.requestlog [None req-bc26b04a-7d7c-4e78-927f-f4e270fed4bc admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.556476 Oct 23 01:01:15.636658 n-d-master-1 devstack@n-api.service[105090]: [pid: 105090|app: 0|req: 2/5] 10.222.0.42 () {64 vars in 1283 bytes} [Sun Oct 23 01:01:15 2022] POST /compute/v2.1/flavors => generated 407 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 23 01:01:15.650491 n-d-master-1 devstack@n-api.service[105089]: DEBUG dbcounter [-] [105089] Writing DB stats nova_api:SELECT=3 {{(pid=105089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:01:15.651330 n-d-master-1 devstack@n-api.service[105089]: DEBUG dbcounter [-] [105089] Writing DB stats nova_cell0:SELECT=3 {{(pid=105089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:01:15.653286 n-d-master-1 devstack@n-api.service[105089]: DEBUG dbcounter [-] [105089] Writing DB stats nova_cell1:SELECT=3 {{(pid=105089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:01:15.654090 n-d-master-1 devstack@n-api.service[105089]: DEBUG dbcounter [-] [105089] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:01:15.858768 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi [None req-4b92ac68-b8e9-44e5-8c18-781446227a9a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:01:15.969847 n-d-master-1 devstack@n-api.service[105089]: INFO nova.api.openstack.requestlog [None req-4b92ac68-b8e9-44e5-8c18-781446227a9a admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.324507 Oct 23 01:01:15.970835 n-d-master-1 devstack@n-api.service[105089]: [pid: 105089|app: 0|req: 4/6] 10.222.0.42 () {64 vars in 1336 bytes} [Sun Oct 23 01:01:15 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:01:18.620841 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi [None req-bc26b04a-7d7c-4e78-927f-f4e270fed4bc admin admin] Calling method '>' {{(pid=105090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:01:18.621864 n-d-master-1 devstack@n-api.service[105090]: INFO nova.api.openstack.requestlog [None req-bc26b04a-7d7c-4e78-927f-f4e270fed4bc admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Oct 23 01:01:18.624269 n-d-master-1 devstack@n-api.service[105090]: [pid: 105090|app: 0|req: 3/7] 10.222.0.42 () {54 vars in 931 bytes} [Sun Oct 23 01:01:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:01:19.396674 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi [None req-03261dbd-48f1-4339-a0d9-3cb7a6e70dba admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "d1", "rxtx_factor": 1.0, "name": "ds512M", "disk": 5, "os-flavor-access:is_public": true, "ram": 512, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:01:19.555174 n-d-master-1 devstack@n-api.service[105089]: INFO nova.api.openstack.requestlog [None req-03261dbd-48f1-4339-a0d9-3cb7a6e70dba admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.916982 Oct 23 01:01:19.555174 n-d-master-1 devstack@n-api.service[105089]: [pid: 105089|app: 0|req: 5/8] 10.222.0.42 () {64 vars in 1283 bytes} [Sun Oct 23 01:01:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:01:19.566185 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi [None req-6e6e1b15-c867-46c6-848a-30f41c418a6c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:01:19.705872 n-d-master-1 devstack@n-api.service[105090]: INFO nova.api.openstack.requestlog [None req-6e6e1b15-c867-46c6-848a-30f41c418a6c admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.146518 Oct 23 01:01:19.707973 n-d-master-1 devstack@n-api.service[105090]: [pid: 105090|app: 0|req: 4/9] 10.222.0.42 () {64 vars in 1336 bytes} [Sun Oct 23 01:01:19 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:01:22.593081 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi [None req-03261dbd-48f1-4339-a0d9-3cb7a6e70dba admin admin] Calling method '>' {{(pid=105089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:01:22.594535 n-d-master-1 devstack@n-api.service[105089]: INFO nova.api.openstack.requestlog [None req-03261dbd-48f1-4339-a0d9-3cb7a6e70dba admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001605 Oct 23 01:01:22.596165 n-d-master-1 devstack@n-api.service[105089]: [pid: 105089|app: 0|req: 6/10] 10.222.0.42 () {54 vars in 931 bytes} [Sun Oct 23 01:01:22 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:01:23.143527 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi [None req-f40224db-8624-4a23-bdf2-8294a7661a4a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "os-flavor-access:is_public": true, "id": "d2", "rxtx_factor": 1.0, "vcpus": 1, "disk": 10, "swap": 0, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:01:23.203375 n-d-master-1 devstack@n-api.service[105090]: INFO nova.api.openstack.requestlog [None req-f40224db-8624-4a23-bdf2-8294a7661a4a admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.597298 Oct 23 01:01:23.204444 n-d-master-1 devstack@n-api.service[105090]: [pid: 105090|app: 0|req: 5/11] 10.222.0.42 () {64 vars in 1283 bytes} [Sun Oct 23 01:01:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:01:23.216843 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi [None req-a4368177-4738-4704-a08c-707fa8ba9df3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:01:23.295332 n-d-master-1 devstack@n-api.service[105089]: INFO nova.api.openstack.requestlog [None req-a4368177-4738-4704-a08c-707fa8ba9df3 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.082635 Oct 23 01:01:23.298170 n-d-master-1 devstack@n-api.service[105089]: [pid: 105089|app: 0|req: 7/12] 10.222.0.42 () {64 vars in 1336 bytes} [Sun Oct 23 01:01:23 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:01:25.917478 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi [None req-f40224db-8624-4a23-bdf2-8294a7661a4a admin admin] Calling method '>' {{(pid=105090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:01:25.918481 n-d-master-1 devstack@n-api.service[105090]: INFO nova.api.openstack.requestlog [None req-f40224db-8624-4a23-bdf2-8294a7661a4a admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001556 Oct 23 01:01:25.918892 n-d-master-1 devstack@n-api.service[105090]: [pid: 105090|app: 0|req: 6/13] 10.222.0.42 () {54 vars in 931 bytes} [Sun Oct 23 01:01:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:01:26.368303 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi [None req-4dd332bb-7616-413c-8c5b-f2b702dc62df admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 2, "ram": 2048, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "disk": 10, "id": "d3"}} {{(pid=105089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:01:26.471985 n-d-master-1 devstack@n-api.service[105089]: INFO nova.api.openstack.requestlog [None req-4dd332bb-7616-413c-8c5b-f2b702dc62df admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.546158 Oct 23 01:01:26.472758 n-d-master-1 devstack@n-api.service[105089]: [pid: 105089|app: 0|req: 8/14] 10.222.0.42 () {64 vars in 1283 bytes} [Sun Oct 23 01:01:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:01:26.484886 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi [None req-b03de58b-2b7c-4ad9-9b8b-c77633eb2168 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:01:26.585312 n-d-master-1 devstack@n-api.service[105090]: INFO nova.api.openstack.requestlog [None req-b03de58b-2b7c-4ad9-9b8b-c77633eb2168 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.104093 Oct 23 01:01:26.586446 n-d-master-1 devstack@n-api.service[105090]: [pid: 105090|app: 0|req: 7/15] 10.222.0.42 () {64 vars in 1336 bytes} [Sun Oct 23 01:01:26 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:01:29.307880 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi [None req-4dd332bb-7616-413c-8c5b-f2b702dc62df admin admin] Calling method '>' {{(pid=105089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:01:29.308874 n-d-master-1 devstack@n-api.service[105089]: INFO nova.api.openstack.requestlog [None req-4dd332bb-7616-413c-8c5b-f2b702dc62df admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Oct 23 01:01:29.309264 n-d-master-1 devstack@n-api.service[105089]: [pid: 105089|app: 0|req: 9/16] 10.222.0.42 () {54 vars in 931 bytes} [Sun Oct 23 01:01:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:01:29.814171 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi [None req-a9573bcb-5c38-49b2-a462-6ea22d23e76a admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "vcpus": 4, "ram": 4096, "disk": 20, "name": "ds4G"}} {{(pid=105090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:01:29.890543 n-d-master-1 devstack@n-api.service[105090]: INFO nova.api.openstack.requestlog [None req-a9573bcb-5c38-49b2-a462-6ea22d23e76a admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.575326 Oct 23 01:01:29.892301 n-d-master-1 devstack@n-api.service[105090]: [pid: 105090|app: 0|req: 8/17] 10.222.0.42 () {64 vars in 1283 bytes} [Sun Oct 23 01:01:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 23 01:01:29.903762 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi [None req-09e22be0-6e7e-4df8-b1f5-a6462abdde62 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:01:30.007869 n-d-master-1 devstack@n-api.service[105089]: INFO nova.api.openstack.requestlog [None req-09e22be0-6e7e-4df8-b1f5-a6462abdde62 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.107939 Oct 23 01:01:30.012600 n-d-master-1 devstack@n-api.service[105089]: [pid: 105089|app: 0|req: 10/18] 10.222.0.42 () {64 vars in 1336 bytes} [Sun Oct 23 01:01:29 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:01:32.658190 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi [None req-a9573bcb-5c38-49b2-a462-6ea22d23e76a admin admin] Calling method '>' {{(pid=105090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:01:32.659656 n-d-master-1 devstack@n-api.service[105090]: INFO nova.api.openstack.requestlog [None req-a9573bcb-5c38-49b2-a462-6ea22d23e76a admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002132 Oct 23 01:01:32.660319 n-d-master-1 devstack@n-api.service[105090]: [pid: 105090|app: 0|req: 9/19] 10.222.0.42 () {54 vars in 931 bytes} [Sun Oct 23 01:01:32 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:01:33.082116 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi [None req-b5a3f034-567d-422e-8117-c32d92fa7aaf admin admin] Calling method '>' {{(pid=105089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:01:33.107200 n-d-master-1 devstack@n-api.service[105089]: INFO nova.api.openstack.requestlog [None req-b5a3f034-567d-422e-8117-c32d92fa7aaf admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.441009 Oct 23 01:01:33.107738 n-d-master-1 devstack@n-api.service[105089]: [pid: 105089|app: 0|req: 11/20] 10.222.0.42 () {60 vars in 1292 bytes} [Sun Oct 23 01:01:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:01:36.287972 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi [None req-a9573bcb-5c38-49b2-a462-6ea22d23e76a admin admin] Calling method '>' {{(pid=105090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:01:36.288991 n-d-master-1 devstack@n-api.service[105090]: INFO nova.api.openstack.requestlog [None req-a9573bcb-5c38-49b2-a462-6ea22d23e76a admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Oct 23 01:01:36.289393 n-d-master-1 devstack@n-api.service[105090]: [pid: 105090|app: 0|req: 10/21] 10.222.0.42 () {54 vars in 931 bytes} [Sun Oct 23 01:01:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:01:36.727193 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi [None req-a1e2b15f-5070-4276-9c28-17d3e7e29d09 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "disk": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.tiny", "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=105089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:01:36.847935 n-d-master-1 devstack@n-api.service[105089]: INFO nova.api.openstack.requestlog [None req-a1e2b15f-5070-4276-9c28-17d3e7e29d09 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.552116 Oct 23 01:01:36.848481 n-d-master-1 devstack@n-api.service[105089]: [pid: 105089|app: 0|req: 12/22] 10.222.0.42 () {64 vars in 1283 bytes} [Sun Oct 23 01:01:36 2022] POST /compute/v2.1/flavors => generated 402 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:01:36.862579 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi [None req-70605344-ca0e-4c9e-8162-5694098dff5c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:01:36.942603 n-d-master-1 devstack@n-api.service[105090]: INFO nova.api.openstack.requestlog [None req-70605344-ca0e-4c9e-8162-5694098dff5c admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.083671 Oct 23 01:01:36.943193 n-d-master-1 devstack@n-api.service[105090]: [pid: 105090|app: 0|req: 11/23] 10.222.0.42 () {64 vars in 1333 bytes} [Sun Oct 23 01:01:36 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:01:39.623487 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi [None req-a1e2b15f-5070-4276-9c28-17d3e7e29d09 admin admin] Calling method '>' {{(pid=105089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:01:39.625243 n-d-master-1 devstack@n-api.service[105089]: INFO nova.api.openstack.requestlog [None req-a1e2b15f-5070-4276-9c28-17d3e7e29d09 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002230 Oct 23 01:01:39.626146 n-d-master-1 devstack@n-api.service[105089]: [pid: 105089|app: 0|req: 13/24] 10.222.0.42 () {54 vars in 931 bytes} [Sun Oct 23 01:01:39 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:01:40.028217 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi [None req-fafe27ac-3550-4e08-981d-06d2f181a3d7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "vcpus": 1, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "os-flavor-access:is_public": true, "ram": 2048, "swap": 0, "rxtx_factor": 1.0}} {{(pid=105090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:01:40.087337 n-d-master-1 devstack@n-api.service[105090]: INFO nova.api.openstack.requestlog [None req-fafe27ac-3550-4e08-981d-06d2f181a3d7 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.454741 Oct 23 01:01:40.087807 n-d-master-1 devstack@n-api.service[105090]: [pid: 105090|app: 0|req: 12/25] 10.222.0.42 () {64 vars in 1283 bytes} [Sun Oct 23 01:01:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:01:40.099989 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi [None req-ac634b99-3db2-48ba-869e-b17e1ae01a05 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:01:40.159853 n-d-master-1 devstack@n-api.service[105089]: INFO nova.api.openstack.requestlog [None req-ac634b99-3db2-48ba-869e-b17e1ae01a05 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.063499 Oct 23 01:01:40.160430 n-d-master-1 devstack@n-api.service[105089]: [pid: 105089|app: 0|req: 14/26] 10.222.0.42 () {64 vars in 1333 bytes} [Sun Oct 23 01:01:40 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:01:42.760465 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi [None req-fafe27ac-3550-4e08-981d-06d2f181a3d7 admin admin] Calling method '>' {{(pid=105090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:01:42.761395 n-d-master-1 devstack@n-api.service[105090]: INFO nova.api.openstack.requestlog [None req-fafe27ac-3550-4e08-981d-06d2f181a3d7 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002096 Oct 23 01:01:42.761792 n-d-master-1 devstack@n-api.service[105090]: [pid: 105090|app: 0|req: 13/27] 10.222.0.42 () {54 vars in 931 bytes} [Sun Oct 23 01:01:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:01:43.181644 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi [None req-ffea6c80-93cf-4f7a-b87b-aa1e73c31fae admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "disk": 40, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 2, "name": "m1.medium", "id": "3"}} {{(pid=105089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:01:43.928409 n-d-master-1 devstack@n-api.service[105089]: INFO nova.api.openstack.requestlog [None req-ffea6c80-93cf-4f7a-b87b-aa1e73c31fae admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 1.160422 Oct 23 01:01:43.929184 n-d-master-1 devstack@n-api.service[105089]: [pid: 105089|app: 0|req: 15/28] 10.222.0.42 () {64 vars in 1283 bytes} [Sun Oct 23 01:01:42 2022] POST /compute/v2.1/flavors => generated 406 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:01:43.940897 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi [None req-8cf3439e-2c39-4414-be6d-cd56a8febe7a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:01:43.945786 n-d-master-1 devstack@n-api.service[105090]: DEBUG dbcounter [-] [105090] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:01:44.039733 n-d-master-1 devstack@n-api.service[105090]: INFO nova.api.openstack.requestlog [None req-8cf3439e-2c39-4414-be6d-cd56a8febe7a admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102459 Oct 23 01:01:44.041047 n-d-master-1 devstack@n-api.service[105090]: [pid: 105090|app: 0|req: 14/29] 10.222.0.42 () {64 vars in 1333 bytes} [Sun Oct 23 01:01:43 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:01:46.635181 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi [None req-ffea6c80-93cf-4f7a-b87b-aa1e73c31fae admin admin] Calling method '>' {{(pid=105089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:01:46.636818 n-d-master-1 devstack@n-api.service[105089]: INFO nova.api.openstack.requestlog [None req-ffea6c80-93cf-4f7a-b87b-aa1e73c31fae admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002150 Oct 23 01:01:46.637215 n-d-master-1 devstack@n-api.service[105089]: [pid: 105089|app: 0|req: 16/30] 10.222.0.42 () {54 vars in 931 bytes} [Sun Oct 23 01:01:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:01:47.087676 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi [None req-c8fee5ff-72d1-4703-99dc-00a2fa4f73a7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 4, "name": "m1.large", "rxtx_factor": 1.0, "disk": 80}} {{(pid=105090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:01:47.156458 n-d-master-1 devstack@n-api.service[105090]: INFO nova.api.openstack.requestlog [None req-c8fee5ff-72d1-4703-99dc-00a2fa4f73a7 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.512799 Oct 23 01:01:47.158944 n-d-master-1 devstack@n-api.service[105090]: [pid: 105090|app: 0|req: 15/31] 10.222.0.42 () {64 vars in 1283 bytes} [Sun Oct 23 01:01:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 23 01:01:47.171250 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi [None req-1de6892a-7bc8-4575-8006-0e5ca565d48d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:01:47.181860 n-d-master-1 devstack@n-api.service[105089]: DEBUG dbcounter [-] [105089] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=105089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:01:47.252132 n-d-master-1 devstack@n-api.service[105089]: INFO nova.api.openstack.requestlog [None req-1de6892a-7bc8-4575-8006-0e5ca565d48d admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084487 Oct 23 01:01:47.253047 n-d-master-1 devstack@n-api.service[105089]: [pid: 105089|app: 0|req: 17/32] 10.222.0.42 () {64 vars in 1333 bytes} [Sun Oct 23 01:01:47 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:01:49.926577 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi [None req-c8fee5ff-72d1-4703-99dc-00a2fa4f73a7 admin admin] Calling method '>' {{(pid=105090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:01:49.928183 n-d-master-1 devstack@n-api.service[105090]: INFO nova.api.openstack.requestlog [None req-c8fee5ff-72d1-4703-99dc-00a2fa4f73a7 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002328 Oct 23 01:01:49.928578 n-d-master-1 devstack@n-api.service[105090]: [pid: 105090|app: 0|req: 16/33] 10.222.0.42 () {54 vars in 931 bytes} [Sun Oct 23 01:01:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:01:50.357777 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi [None req-a44b81b4-ae3e-48f8-a864-3d32e0936420 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "id": "5", "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 160, "swap": 0, "name": "m1.xlarge", "rxtx_factor": 1.0}} {{(pid=105089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:01:50.431497 n-d-master-1 devstack@n-api.service[105089]: INFO nova.api.openstack.requestlog [None req-a44b81b4-ae3e-48f8-a864-3d32e0936420 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.496253 Oct 23 01:01:50.432667 n-d-master-1 devstack@n-api.service[105089]: [pid: 105089|app: 0|req: 18/34] 10.222.0.42 () {64 vars in 1283 bytes} [Sun Oct 23 01:01:49 2022] POST /compute/v2.1/flavors => generated 408 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:01:50.444626 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi [None req-89b0a743-e18b-46c9-b017-fa631dfae064 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:01:50.508272 n-d-master-1 devstack@n-api.service[105090]: INFO nova.api.openstack.requestlog [None req-89b0a743-e18b-46c9-b017-fa631dfae064 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.067377 Oct 23 01:01:50.509357 n-d-master-1 devstack@n-api.service[105090]: [pid: 105090|app: 0|req: 17/35] 10.222.0.42 () {64 vars in 1333 bytes} [Sun Oct 23 01:01:50 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:02:09.916331 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi [None req-a44b81b4-ae3e-48f8-a864-3d32e0936420 admin admin] Calling method '>' {{(pid=105089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:02:09.917325 n-d-master-1 devstack@n-api.service[105089]: INFO nova.api.openstack.requestlog [None req-a44b81b4-ae3e-48f8-a864-3d32e0936420 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Oct 23 01:02:09.917712 n-d-master-1 devstack@n-api.service[105089]: [pid: 105089|app: 0|req: 19/36] 10.222.0.42 () {54 vars in 931 bytes} [Sun Oct 23 01:02:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:02:09.928617 n-d-master-1 devstack@n-api.service[105090]: DEBUG dbcounter [-] [105090] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=105090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:02:10.301543 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi [None req-d60b0bd4-54d1-4f43-ba6a-9001241ec943 admin admin] Calling method '>' {{(pid=105090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:02:10.320112 n-d-master-1 devstack@n-api.service[105090]: INFO nova.api.openstack.requestlog [None req-d60b0bd4-54d1-4f43-ba6a-9001241ec943 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.396142 Oct 23 01:02:10.320645 n-d-master-1 devstack@n-api.service[105090]: [pid: 105090|app: 0|req: 18/37] 10.222.0.42 () {60 vars in 1292 bytes} [Sun Oct 23 01:02:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:02:11.612628 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi [None req-a44b81b4-ae3e-48f8-a864-3d32e0936420 admin admin] Calling method '>' {{(pid=105089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:02:11.613621 n-d-master-1 devstack@n-api.service[105089]: INFO nova.api.openstack.requestlog [None req-a44b81b4-ae3e-48f8-a864-3d32e0936420 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Oct 23 01:02:11.614030 n-d-master-1 devstack@n-api.service[105089]: [pid: 105089|app: 0|req: 20/38] 10.222.0.42 () {56 vars in 1074 bytes} [Sun Oct 23 01:02:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:02:12.131822 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi [None req-5a813c8b-eb84-4a8d-bbbb-7bf8ce246425 admin admin] Calling method '>' {{(pid=105090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:02:12.137190 n-d-master-1 devstack@n-api.service[105090]: INFO nova.api.openstack.wsgi [None req-5a813c8b-eb84-4a8d-bbbb-7bf8ce246425 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 23 01:02:12.140409 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi [None req-5a813c8b-eb84-4a8d-bbbb-7bf8ce246425 admin admin] Request method failure captured: Oct 23 01:02:12.140409 n-d-master-1 devstack@n-api.service[105090]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 23 01:02:12.140409 n-d-master-1 devstack@n-api.service[105090]: Accept: application/json Oct 23 01:02:12.140409 n-d-master-1 devstack@n-api.service[105090]: Accept-Encoding: gzip, deflate Oct 23 01:02:12.140409 n-d-master-1 devstack@n-api.service[105090]: Connection: keep-alive Oct 23 01:02:12.140409 n-d-master-1 devstack@n-api.service[105090]: Content-Length: 0 Oct 23 01:02:12.140409 n-d-master-1 devstack@n-api.service[105090]: Host: 10.222.0.42 Oct 23 01:02:12.140409 n-d-master-1 devstack@n-api.service[105090]: Openstack-Api-Version: compute 2.92 Oct 23 01:02:12.140409 n-d-master-1 devstack@n-api.service[105090]: Openstack-System-Scope: None Oct 23 01:02:12.140409 n-d-master-1 devstack@n-api.service[105090]: User-Agent: python-novaclient Oct 23 01:02:12.140409 n-d-master-1 devstack@n-api.service[105090]: X-Auth-Token: gAAAAABjVJKThlxjHq7KMAbOAm0Ub1pG1XSNB4Xnst-J-a2GJhAvhgtzJOYUGj89aa0VahmWU4w_SqLnrneUPyArkcEQVxcXe4BY2_wur0Nm_XLbkgjboqatEbp-DcoDF2Utm1Qjrk0ASAy5Uqt-Z1hUg9k6R7ePdrg-qAYPaW775OHe0CAV014 Oct 23 01:02:12.140409 n-d-master-1 devstack@n-api.service[105090]: X-Domain-Id: None Oct 23 01:02:12.140409 n-d-master-1 devstack@n-api.service[105090]: X-Domain-Name: None Oct 23 01:02:12.140409 n-d-master-1 devstack@n-api.service[105090]: X-Identity-Status: Confirmed Oct 23 01:02:12.140409 n-d-master-1 devstack@n-api.service[105090]: X-Is-Admin-Project: True Oct 23 01:02:12.140409 n-d-master-1 devstack@n-api.service[105090]: X-Openstack-Nova-Api-Version: 2.92 Oct 23 01:02:12.140409 n-d-master-1 devstack@n-api.service[105090]: X-Project-Domain-Id: default Oct 23 01:02:12.140409 n-d-master-1 devstack@n-api.service[105090]: X-Project-Domain-Name: Default Oct 23 01:02:12.140409 n-d-master-1 devstack@n-api.service[105090]: X-Project-Id: 598c49694334495883fc0f61f918bb99 Oct 23 01:02:12.140409 n-d-master-1 devstack@n-api.service[105090]: X-Project-Name: admin Oct 23 01:02:12.140409 n-d-master-1 devstack@n-api.service[105090]: X-Role: member,admin,reader Oct 23 01:02:12.140409 n-d-master-1 devstack@n-api.service[105090]: X-Roles: member,admin,reader Oct 23 01:02:12.142110 n-d-master-1 devstack@n-api.service[105090]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/598c49694334495883fc0f61f918bb99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_598c49694334495883fc0f61f918bb99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/598c49694334495883fc0f61f918bb99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/598c49694334495883fc0f61f918bb99"}]}] Oct 23 01:02:12.142110 n-d-master-1 devstack@n-api.service[105090]: X-Tenant: admin Oct 23 01:02:12.142110 n-d-master-1 devstack@n-api.service[105090]: X-Tenant-Id: 598c49694334495883fc0f61f918bb99 Oct 23 01:02:12.142110 n-d-master-1 devstack@n-api.service[105090]: X-Tenant-Name: admin Oct 23 01:02:12.142110 n-d-master-1 devstack@n-api.service[105090]: X-User: admin Oct 23 01:02:12.142110 n-d-master-1 devstack@n-api.service[105090]: X-User-Domain-Id: default Oct 23 01:02:12.142110 n-d-master-1 devstack@n-api.service[105090]: X-User-Domain-Name: Default Oct 23 01:02:12.142110 n-d-master-1 devstack@n-api.service[105090]: X-User-Id: aff16e16e402486ab43ace4b1e3cc4c1 Oct 23 01:02:12.142110 n-d-master-1 devstack@n-api.service[105090]: X-User-Name: admin Oct 23 01:02:12.142110 n-d-master-1 devstack@n-api.service[105090]: method: > Oct 23 01:02:12.142110 n-d-master-1 devstack@n-api.service[105090]: exception: Flavor 42 could not be found. Oct 23 01:02:12.142110 n-d-master-1 devstack@n-api.service[105090]: action_args: {'id': '42'} Oct 23 01:02:12.142110 n-d-master-1 devstack@n-api.service[105090]: {{(pid=105090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:02:12.142110 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:02:12.143354 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 23 01:02:12.143354 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 23 01:02:12.143354 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 23 01:02:12.143354 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 23 01:02:12.143354 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 01:02:12.143354 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 01:02:12.143354 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 23 01:02:12.143354 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 23 01:02:12.143354 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 23 01:02:12.143354 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:02:12.143354 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 23 01:02:12.143354 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 23 01:02:12.143354 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 23 01:02:12.143354 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi Oct 23 01:02:12.143354 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:02:12.143354 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi Oct 23 01:02:12.143354 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:02:12.143354 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:02:12.143354 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:02:12.144847 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:02:12.144847 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:02:12.144847 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:02:12.144847 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:02:12.144847 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 23 01:02:12.144847 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:02:12.144847 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 23 01:02:12.144847 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi Oct 23 01:02:12.144847 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:02:12.144847 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi Oct 23 01:02:12.144847 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:02:12.144847 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:02:12.144847 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:02:12.144847 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:02:12.144847 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:02:12.144847 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 23 01:02:12.144847 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi Oct 23 01:02:12.144847 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi [None req-5a813c8b-eb84-4a8d-bbbb-7bf8ce246425 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:02:12.146221 n-d-master-1 devstack@n-api.service[105090]: INFO nova.api.openstack.requestlog [None req-5a813c8b-eb84-4a8d-bbbb-7bf8ce246425 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.384649 Oct 23 01:02:12.146221 n-d-master-1 devstack@n-api.service[105090]: [pid: 105090|app: 0|req: 19/39] 10.222.0.42 () {60 vars in 1190 bytes} [Sun Oct 23 01:02:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 386 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 23 01:02:12.151895 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi [None req-64ef08a2-3460-451e-8b5d-1bd74337d9fa admin admin] Calling method '>' {{(pid=105089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:02:12.155943 n-d-master-1 devstack@n-api.service[105089]: DEBUG dbcounter [-] [105089] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=105089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:02:12.176231 n-d-master-1 devstack@n-api.service[105089]: INFO nova.api.openstack.requestlog [None req-64ef08a2-3460-451e-8b5d-1bd74337d9fa admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028083 Oct 23 01:02:12.176795 n-d-master-1 devstack@n-api.service[105089]: [pid: 105089|app: 0|req: 21/40] 10.222.0.42 () {60 vars in 1210 bytes} [Sun Oct 23 01:02:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:02:12.187446 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi [None req-0ba3f324-69ba-4036-ab47-ef8908c0858e admin admin] Calling method '>' {{(pid=105090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:02:12.209190 n-d-master-1 devstack@n-api.service[105090]: INFO nova.api.openstack.requestlog [None req-0ba3f324-69ba-4036-ab47-ef8908c0858e admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026139 Oct 23 01:02:12.209728 n-d-master-1 devstack@n-api.service[105090]: [pid: 105090|app: 0|req: 20/41] 10.222.0.42 () {60 vars in 1210 bytes} [Sun Oct 23 01:02:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:02:12.220298 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi [None req-9e7e6079-185a-4aae-a807-8c3922305a88 admin admin] Calling method '>' {{(pid=105089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:02:12.225833 n-d-master-1 devstack@n-api.service[105089]: INFO nova.api.openstack.wsgi [None req-9e7e6079-185a-4aae-a807-8c3922305a88 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 23 01:02:12.229099 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi [None req-9e7e6079-185a-4aae-a807-8c3922305a88 admin admin] Request method failure captured: Oct 23 01:02:12.229099 n-d-master-1 devstack@n-api.service[105089]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 23 01:02:12.229099 n-d-master-1 devstack@n-api.service[105089]: Accept: application/json Oct 23 01:02:12.229099 n-d-master-1 devstack@n-api.service[105089]: Accept-Encoding: gzip, deflate Oct 23 01:02:12.229099 n-d-master-1 devstack@n-api.service[105089]: Connection: keep-alive Oct 23 01:02:12.229099 n-d-master-1 devstack@n-api.service[105089]: Content-Length: 0 Oct 23 01:02:12.229099 n-d-master-1 devstack@n-api.service[105089]: Host: 10.222.0.42 Oct 23 01:02:12.229099 n-d-master-1 devstack@n-api.service[105089]: Openstack-Api-Version: compute 2.92 Oct 23 01:02:12.229099 n-d-master-1 devstack@n-api.service[105089]: Openstack-System-Scope: None Oct 23 01:02:12.229099 n-d-master-1 devstack@n-api.service[105089]: User-Agent: python-novaclient Oct 23 01:02:12.229099 n-d-master-1 devstack@n-api.service[105089]: X-Auth-Token: gAAAAABjVJKThlxjHq7KMAbOAm0Ub1pG1XSNB4Xnst-J-a2GJhAvhgtzJOYUGj89aa0VahmWU4w_SqLnrneUPyArkcEQVxcXe4BY2_wur0Nm_XLbkgjboqatEbp-DcoDF2Utm1Qjrk0ASAy5Uqt-Z1hUg9k6R7ePdrg-qAYPaW775OHe0CAV014 Oct 23 01:02:12.229099 n-d-master-1 devstack@n-api.service[105089]: X-Domain-Id: None Oct 23 01:02:12.229099 n-d-master-1 devstack@n-api.service[105089]: X-Domain-Name: None Oct 23 01:02:12.229099 n-d-master-1 devstack@n-api.service[105089]: X-Identity-Status: Confirmed Oct 23 01:02:12.229099 n-d-master-1 devstack@n-api.service[105089]: X-Is-Admin-Project: True Oct 23 01:02:12.229099 n-d-master-1 devstack@n-api.service[105089]: X-Openstack-Nova-Api-Version: 2.92 Oct 23 01:02:12.229099 n-d-master-1 devstack@n-api.service[105089]: X-Project-Domain-Id: default Oct 23 01:02:12.229099 n-d-master-1 devstack@n-api.service[105089]: X-Project-Domain-Name: Default Oct 23 01:02:12.229099 n-d-master-1 devstack@n-api.service[105089]: X-Project-Id: 598c49694334495883fc0f61f918bb99 Oct 23 01:02:12.229099 n-d-master-1 devstack@n-api.service[105089]: X-Project-Name: admin Oct 23 01:02:12.229099 n-d-master-1 devstack@n-api.service[105089]: X-Role: member,admin,reader Oct 23 01:02:12.229099 n-d-master-1 devstack@n-api.service[105089]: X-Roles: member,admin,reader Oct 23 01:02:12.230651 n-d-master-1 devstack@n-api.service[105089]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/598c49694334495883fc0f61f918bb99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_598c49694334495883fc0f61f918bb99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/598c49694334495883fc0f61f918bb99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/598c49694334495883fc0f61f918bb99"}]}] Oct 23 01:02:12.230651 n-d-master-1 devstack@n-api.service[105089]: X-Tenant: admin Oct 23 01:02:12.230651 n-d-master-1 devstack@n-api.service[105089]: X-Tenant-Id: 598c49694334495883fc0f61f918bb99 Oct 23 01:02:12.230651 n-d-master-1 devstack@n-api.service[105089]: X-Tenant-Name: admin Oct 23 01:02:12.230651 n-d-master-1 devstack@n-api.service[105089]: X-User: admin Oct 23 01:02:12.230651 n-d-master-1 devstack@n-api.service[105089]: X-User-Domain-Id: default Oct 23 01:02:12.230651 n-d-master-1 devstack@n-api.service[105089]: X-User-Domain-Name: Default Oct 23 01:02:12.230651 n-d-master-1 devstack@n-api.service[105089]: X-User-Id: aff16e16e402486ab43ace4b1e3cc4c1 Oct 23 01:02:12.230651 n-d-master-1 devstack@n-api.service[105089]: X-User-Name: admin Oct 23 01:02:12.230651 n-d-master-1 devstack@n-api.service[105089]: method: > Oct 23 01:02:12.230651 n-d-master-1 devstack@n-api.service[105089]: exception: Flavor 42 could not be found. Oct 23 01:02:12.230651 n-d-master-1 devstack@n-api.service[105089]: action_args: {'id': '42'} Oct 23 01:02:12.230651 n-d-master-1 devstack@n-api.service[105089]: {{(pid=105089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:02:12.230651 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:02:12.231696 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 23 01:02:12.231696 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 23 01:02:12.231696 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 23 01:02:12.231696 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 23 01:02:12.231696 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 01:02:12.231696 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 01:02:12.231696 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 23 01:02:12.231696 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 23 01:02:12.231696 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 23 01:02:12.231696 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:02:12.231696 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 23 01:02:12.231696 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 23 01:02:12.231696 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 23 01:02:12.231696 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi Oct 23 01:02:12.231696 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:02:12.231696 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi Oct 23 01:02:12.231696 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:02:12.231696 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:02:12.231696 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:02:12.232949 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:02:12.232949 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:02:12.232949 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:02:12.232949 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:02:12.232949 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 23 01:02:12.232949 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:02:12.232949 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 23 01:02:12.232949 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi Oct 23 01:02:12.232949 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:02:12.232949 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi Oct 23 01:02:12.232949 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:02:12.232949 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:02:12.232949 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:02:12.232949 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:02:12.232949 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:02:12.232949 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 23 01:02:12.232949 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi Oct 23 01:02:12.232949 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi [None req-9e7e6079-185a-4aae-a807-8c3922305a88 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:02:12.234217 n-d-master-1 devstack@n-api.service[105089]: INFO nova.api.openstack.requestlog [None req-9e7e6079-185a-4aae-a807-8c3922305a88 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014153 Oct 23 01:02:12.234217 n-d-master-1 devstack@n-api.service[105089]: [pid: 105089|app: 0|req: 22/42] 10.222.0.42 () {60 vars in 1190 bytes} [Sun Oct 23 01:02:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 23 01:02:13.419195 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi [None req-0ba3f324-69ba-4036-ab47-ef8908c0858e admin admin] Calling method '>' {{(pid=105090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:02:13.420272 n-d-master-1 devstack@n-api.service[105090]: INFO nova.api.openstack.requestlog [None req-0ba3f324-69ba-4036-ab47-ef8908c0858e admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Oct 23 01:02:13.420673 n-d-master-1 devstack@n-api.service[105090]: [pid: 105090|app: 0|req: 21/43] 10.222.0.42 () {56 vars in 1074 bytes} [Sun Oct 23 01:02:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:02:13.934764 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi [None req-dea33510-4ef0-4b27-bb4d-39701bd7d10d admin admin] Calling method '>' {{(pid=105089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:02:13.939682 n-d-master-1 devstack@n-api.service[105089]: INFO nova.api.openstack.wsgi [None req-dea33510-4ef0-4b27-bb4d-39701bd7d10d admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 23 01:02:13.941171 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi [None req-dea33510-4ef0-4b27-bb4d-39701bd7d10d admin admin] Request method failure captured: Oct 23 01:02:13.941171 n-d-master-1 devstack@n-api.service[105089]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 23 01:02:13.941171 n-d-master-1 devstack@n-api.service[105089]: Accept: application/json Oct 23 01:02:13.941171 n-d-master-1 devstack@n-api.service[105089]: Accept-Encoding: gzip, deflate Oct 23 01:02:13.941171 n-d-master-1 devstack@n-api.service[105089]: Connection: keep-alive Oct 23 01:02:13.941171 n-d-master-1 devstack@n-api.service[105089]: Content-Length: 0 Oct 23 01:02:13.941171 n-d-master-1 devstack@n-api.service[105089]: Host: 10.222.0.42 Oct 23 01:02:13.941171 n-d-master-1 devstack@n-api.service[105089]: Openstack-Api-Version: compute 2.92 Oct 23 01:02:13.941171 n-d-master-1 devstack@n-api.service[105089]: Openstack-System-Scope: None Oct 23 01:02:13.941171 n-d-master-1 devstack@n-api.service[105089]: User-Agent: python-novaclient Oct 23 01:02:13.941171 n-d-master-1 devstack@n-api.service[105089]: X-Auth-Token: gAAAAABjVJKVPBXgFGOJi9kW77e9VTgCQIWY_qViAZbYjjd8JjC1DFx4GaRI9HkMzQlzgCt7qBZi-2w-gllWRHZrn2j1n70ooDGucfCEwD-8tKSxsCOw2jVSrgDn01qjU8smjndj-zftxVSPzqonmIGjejN3oL-BdzMEi7pqcA5kdJG5SUWq9_4 Oct 23 01:02:13.941171 n-d-master-1 devstack@n-api.service[105089]: X-Domain-Id: None Oct 23 01:02:13.941171 n-d-master-1 devstack@n-api.service[105089]: X-Domain-Name: None Oct 23 01:02:13.941171 n-d-master-1 devstack@n-api.service[105089]: X-Identity-Status: Confirmed Oct 23 01:02:13.941171 n-d-master-1 devstack@n-api.service[105089]: X-Is-Admin-Project: True Oct 23 01:02:13.941171 n-d-master-1 devstack@n-api.service[105089]: X-Openstack-Nova-Api-Version: 2.92 Oct 23 01:02:13.941171 n-d-master-1 devstack@n-api.service[105089]: X-Project-Domain-Id: default Oct 23 01:02:13.941171 n-d-master-1 devstack@n-api.service[105089]: X-Project-Domain-Name: Default Oct 23 01:02:13.941171 n-d-master-1 devstack@n-api.service[105089]: X-Project-Id: 598c49694334495883fc0f61f918bb99 Oct 23 01:02:13.941171 n-d-master-1 devstack@n-api.service[105089]: X-Project-Name: admin Oct 23 01:02:13.941171 n-d-master-1 devstack@n-api.service[105089]: X-Role: member,admin,reader Oct 23 01:02:13.941171 n-d-master-1 devstack@n-api.service[105089]: X-Roles: member,admin,reader Oct 23 01:02:13.942695 n-d-master-1 devstack@n-api.service[105089]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/598c49694334495883fc0f61f918bb99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_598c49694334495883fc0f61f918bb99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/598c49694334495883fc0f61f918bb99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/598c49694334495883fc0f61f918bb99"}]}] Oct 23 01:02:13.942695 n-d-master-1 devstack@n-api.service[105089]: X-Tenant: admin Oct 23 01:02:13.942695 n-d-master-1 devstack@n-api.service[105089]: X-Tenant-Id: 598c49694334495883fc0f61f918bb99 Oct 23 01:02:13.942695 n-d-master-1 devstack@n-api.service[105089]: X-Tenant-Name: admin Oct 23 01:02:13.942695 n-d-master-1 devstack@n-api.service[105089]: X-User: admin Oct 23 01:02:13.942695 n-d-master-1 devstack@n-api.service[105089]: X-User-Domain-Id: default Oct 23 01:02:13.942695 n-d-master-1 devstack@n-api.service[105089]: X-User-Domain-Name: Default Oct 23 01:02:13.942695 n-d-master-1 devstack@n-api.service[105089]: X-User-Id: aff16e16e402486ab43ace4b1e3cc4c1 Oct 23 01:02:13.942695 n-d-master-1 devstack@n-api.service[105089]: X-User-Name: admin Oct 23 01:02:13.942695 n-d-master-1 devstack@n-api.service[105089]: method: > Oct 23 01:02:13.942695 n-d-master-1 devstack@n-api.service[105089]: exception: Flavor 84 could not be found. Oct 23 01:02:13.942695 n-d-master-1 devstack@n-api.service[105089]: action_args: {'id': '84'} Oct 23 01:02:13.942695 n-d-master-1 devstack@n-api.service[105089]: {{(pid=105089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:02:13.942695 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:02:13.943674 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 23 01:02:13.943674 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 23 01:02:13.943674 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 23 01:02:13.943674 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 23 01:02:13.943674 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 01:02:13.943674 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 01:02:13.943674 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 23 01:02:13.943674 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 23 01:02:13.943674 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 23 01:02:13.943674 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:02:13.943674 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 23 01:02:13.943674 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 23 01:02:13.943674 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 23 01:02:13.943674 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi Oct 23 01:02:13.943674 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:02:13.943674 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi Oct 23 01:02:13.943674 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:02:13.943674 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:02:13.943674 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:02:13.945517 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:02:13.945517 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:02:13.945517 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:02:13.945517 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:02:13.945517 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 23 01:02:13.945517 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:02:13.945517 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 23 01:02:13.945517 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi Oct 23 01:02:13.945517 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:02:13.945517 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi Oct 23 01:02:13.945517 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:02:13.945517 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:02:13.945517 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:02:13.945517 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:02:13.945517 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:02:13.945517 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 23 01:02:13.945517 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi Oct 23 01:02:13.945517 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi [None req-dea33510-4ef0-4b27-bb4d-39701bd7d10d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:02:13.946906 n-d-master-1 devstack@n-api.service[105089]: INFO nova.api.openstack.requestlog [None req-dea33510-4ef0-4b27-bb4d-39701bd7d10d admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.384616 Oct 23 01:02:13.946906 n-d-master-1 devstack@n-api.service[105089]: [pid: 105089|app: 0|req: 23/44] 10.222.0.42 () {60 vars in 1190 bytes} [Sun Oct 23 01:02:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 386 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 23 01:02:13.952553 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi [None req-78b5fb5d-ab5b-4916-82d6-bedb20f0f0c4 admin admin] Calling method '>' {{(pid=105090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:02:13.967847 n-d-master-1 devstack@n-api.service[105090]: INFO nova.api.openstack.requestlog [None req-78b5fb5d-ab5b-4916-82d6-bedb20f0f0c4 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018822 Oct 23 01:02:13.968360 n-d-master-1 devstack@n-api.service[105090]: [pid: 105090|app: 0|req: 22/45] 10.222.0.42 () {60 vars in 1210 bytes} [Sun Oct 23 01:02:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:02:13.977484 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi [None req-da6c46d2-6a23-437a-b07d-2c130996ba65 admin admin] Calling method '>' {{(pid=105089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:02:13.992383 n-d-master-1 devstack@n-api.service[105089]: INFO nova.api.openstack.requestlog [None req-da6c46d2-6a23-437a-b07d-2c130996ba65 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018503 Oct 23 01:02:13.992920 n-d-master-1 devstack@n-api.service[105089]: [pid: 105089|app: 0|req: 24/46] 10.222.0.42 () {60 vars in 1210 bytes} [Sun Oct 23 01:02:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:02:14.001814 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi [None req-8442aeec-8e16-4d6c-a401-046f3cd05d66 admin admin] Calling method '>' {{(pid=105090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:02:14.006627 n-d-master-1 devstack@n-api.service[105090]: INFO nova.api.openstack.wsgi [None req-8442aeec-8e16-4d6c-a401-046f3cd05d66 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 23 01:02:14.008680 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi [None req-8442aeec-8e16-4d6c-a401-046f3cd05d66 admin admin] Request method failure captured: Oct 23 01:02:14.008680 n-d-master-1 devstack@n-api.service[105090]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 23 01:02:14.008680 n-d-master-1 devstack@n-api.service[105090]: Accept: application/json Oct 23 01:02:14.008680 n-d-master-1 devstack@n-api.service[105090]: Accept-Encoding: gzip, deflate Oct 23 01:02:14.008680 n-d-master-1 devstack@n-api.service[105090]: Connection: keep-alive Oct 23 01:02:14.008680 n-d-master-1 devstack@n-api.service[105090]: Content-Length: 0 Oct 23 01:02:14.008680 n-d-master-1 devstack@n-api.service[105090]: Host: 10.222.0.42 Oct 23 01:02:14.008680 n-d-master-1 devstack@n-api.service[105090]: Openstack-Api-Version: compute 2.92 Oct 23 01:02:14.008680 n-d-master-1 devstack@n-api.service[105090]: Openstack-System-Scope: None Oct 23 01:02:14.008680 n-d-master-1 devstack@n-api.service[105090]: User-Agent: python-novaclient Oct 23 01:02:14.008680 n-d-master-1 devstack@n-api.service[105090]: X-Auth-Token: gAAAAABjVJKVPBXgFGOJi9kW77e9VTgCQIWY_qViAZbYjjd8JjC1DFx4GaRI9HkMzQlzgCt7qBZi-2w-gllWRHZrn2j1n70ooDGucfCEwD-8tKSxsCOw2jVSrgDn01qjU8smjndj-zftxVSPzqonmIGjejN3oL-BdzMEi7pqcA5kdJG5SUWq9_4 Oct 23 01:02:14.008680 n-d-master-1 devstack@n-api.service[105090]: X-Domain-Id: None Oct 23 01:02:14.008680 n-d-master-1 devstack@n-api.service[105090]: X-Domain-Name: None Oct 23 01:02:14.008680 n-d-master-1 devstack@n-api.service[105090]: X-Identity-Status: Confirmed Oct 23 01:02:14.008680 n-d-master-1 devstack@n-api.service[105090]: X-Is-Admin-Project: True Oct 23 01:02:14.008680 n-d-master-1 devstack@n-api.service[105090]: X-Openstack-Nova-Api-Version: 2.92 Oct 23 01:02:14.008680 n-d-master-1 devstack@n-api.service[105090]: X-Project-Domain-Id: default Oct 23 01:02:14.008680 n-d-master-1 devstack@n-api.service[105090]: X-Project-Domain-Name: Default Oct 23 01:02:14.008680 n-d-master-1 devstack@n-api.service[105090]: X-Project-Id: 598c49694334495883fc0f61f918bb99 Oct 23 01:02:14.008680 n-d-master-1 devstack@n-api.service[105090]: X-Project-Name: admin Oct 23 01:02:14.008680 n-d-master-1 devstack@n-api.service[105090]: X-Role: member,admin,reader Oct 23 01:02:14.008680 n-d-master-1 devstack@n-api.service[105090]: X-Roles: member,admin,reader Oct 23 01:02:14.010220 n-d-master-1 devstack@n-api.service[105090]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/598c49694334495883fc0f61f918bb99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_598c49694334495883fc0f61f918bb99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/598c49694334495883fc0f61f918bb99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/598c49694334495883fc0f61f918bb99"}]}] Oct 23 01:02:14.010220 n-d-master-1 devstack@n-api.service[105090]: X-Tenant: admin Oct 23 01:02:14.010220 n-d-master-1 devstack@n-api.service[105090]: X-Tenant-Id: 598c49694334495883fc0f61f918bb99 Oct 23 01:02:14.010220 n-d-master-1 devstack@n-api.service[105090]: X-Tenant-Name: admin Oct 23 01:02:14.010220 n-d-master-1 devstack@n-api.service[105090]: X-User: admin Oct 23 01:02:14.010220 n-d-master-1 devstack@n-api.service[105090]: X-User-Domain-Id: default Oct 23 01:02:14.010220 n-d-master-1 devstack@n-api.service[105090]: X-User-Domain-Name: Default Oct 23 01:02:14.010220 n-d-master-1 devstack@n-api.service[105090]: X-User-Id: aff16e16e402486ab43ace4b1e3cc4c1 Oct 23 01:02:14.010220 n-d-master-1 devstack@n-api.service[105090]: X-User-Name: admin Oct 23 01:02:14.010220 n-d-master-1 devstack@n-api.service[105090]: method: > Oct 23 01:02:14.010220 n-d-master-1 devstack@n-api.service[105090]: exception: Flavor 84 could not be found. Oct 23 01:02:14.010220 n-d-master-1 devstack@n-api.service[105090]: action_args: {'id': '84'} Oct 23 01:02:14.010220 n-d-master-1 devstack@n-api.service[105090]: {{(pid=105090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:02:14.010220 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:02:14.011189 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 23 01:02:14.011189 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 23 01:02:14.011189 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 23 01:02:14.011189 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 23 01:02:14.011189 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 01:02:14.011189 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 01:02:14.011189 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 23 01:02:14.011189 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 23 01:02:14.011189 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 23 01:02:14.011189 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:02:14.011189 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 23 01:02:14.011189 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 23 01:02:14.011189 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 23 01:02:14.011189 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi Oct 23 01:02:14.011189 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:02:14.011189 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi Oct 23 01:02:14.011189 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:02:14.011189 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:02:14.011189 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:02:14.012498 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:02:14.012498 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:02:14.012498 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:02:14.012498 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:02:14.012498 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 23 01:02:14.012498 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:02:14.012498 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 23 01:02:14.012498 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi Oct 23 01:02:14.012498 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:02:14.012498 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi Oct 23 01:02:14.012498 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:02:14.012498 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:02:14.012498 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:02:14.012498 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:02:14.012498 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:02:14.012498 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 23 01:02:14.012498 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi Oct 23 01:02:14.012498 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi [None req-8442aeec-8e16-4d6c-a401-046f3cd05d66 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:02:14.013806 n-d-master-1 devstack@n-api.service[105090]: INFO nova.api.openstack.requestlog [None req-8442aeec-8e16-4d6c-a401-046f3cd05d66 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011619 Oct 23 01:02:14.013806 n-d-master-1 devstack@n-api.service[105090]: [pid: 105090|app: 0|req: 23/47] 10.222.0.42 () {60 vars in 1190 bytes} [Sun Oct 23 01:02:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 23 01:02:15.203289 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi [None req-da6c46d2-6a23-437a-b07d-2c130996ba65 admin admin] Calling method '>' {{(pid=105089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:02:15.204288 n-d-master-1 devstack@n-api.service[105089]: INFO nova.api.openstack.requestlog [None req-da6c46d2-6a23-437a-b07d-2c130996ba65 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Oct 23 01:02:15.204675 n-d-master-1 devstack@n-api.service[105089]: [pid: 105089|app: 0|req: 25/48] 10.222.0.42 () {56 vars in 1074 bytes} [Sun Oct 23 01:02:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:02:15.716973 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi [None req-bc0fc1b9-748d-4e94-8837-8be4d89e921e admin admin] Calling method '>' {{(pid=105090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:02:15.722619 n-d-master-1 devstack@n-api.service[105090]: INFO nova.api.openstack.wsgi [None req-bc0fc1b9-748d-4e94-8837-8be4d89e921e admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 23 01:02:15.724135 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi [None req-bc0fc1b9-748d-4e94-8837-8be4d89e921e admin admin] Request method failure captured: Oct 23 01:02:15.724135 n-d-master-1 devstack@n-api.service[105090]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 23 01:02:15.724135 n-d-master-1 devstack@n-api.service[105090]: Accept: application/json Oct 23 01:02:15.724135 n-d-master-1 devstack@n-api.service[105090]: Accept-Encoding: gzip, deflate Oct 23 01:02:15.724135 n-d-master-1 devstack@n-api.service[105090]: Connection: keep-alive Oct 23 01:02:15.724135 n-d-master-1 devstack@n-api.service[105090]: Content-Length: 0 Oct 23 01:02:15.724135 n-d-master-1 devstack@n-api.service[105090]: Host: 10.222.0.42 Oct 23 01:02:15.724135 n-d-master-1 devstack@n-api.service[105090]: Openstack-Api-Version: compute 2.92 Oct 23 01:02:15.724135 n-d-master-1 devstack@n-api.service[105090]: Openstack-System-Scope: None Oct 23 01:02:15.724135 n-d-master-1 devstack@n-api.service[105090]: User-Agent: python-novaclient Oct 23 01:02:15.724135 n-d-master-1 devstack@n-api.service[105090]: X-Auth-Token: gAAAAABjVJKXdhVrBEcdGWsnqHUkD8cjyffgIZGxYhYFCXMAUb5YqJb_Y9NovL5kvnNDsm49iOv6FC-g6S8pw66KVyLit0oAxdbEa3_L8EbExfDTbZe-bKOmN1VHGEr2526v75lxSjdSqy2CTQXQet1dUupcXJUakNwu6X5JpSw8S5OaobDSqOE Oct 23 01:02:15.724135 n-d-master-1 devstack@n-api.service[105090]: X-Domain-Id: None Oct 23 01:02:15.724135 n-d-master-1 devstack@n-api.service[105090]: X-Domain-Name: None Oct 23 01:02:15.724135 n-d-master-1 devstack@n-api.service[105090]: X-Identity-Status: Confirmed Oct 23 01:02:15.724135 n-d-master-1 devstack@n-api.service[105090]: X-Is-Admin-Project: True Oct 23 01:02:15.724135 n-d-master-1 devstack@n-api.service[105090]: X-Openstack-Nova-Api-Version: 2.92 Oct 23 01:02:15.724135 n-d-master-1 devstack@n-api.service[105090]: X-Project-Domain-Id: default Oct 23 01:02:15.724135 n-d-master-1 devstack@n-api.service[105090]: X-Project-Domain-Name: Default Oct 23 01:02:15.724135 n-d-master-1 devstack@n-api.service[105090]: X-Project-Id: 598c49694334495883fc0f61f918bb99 Oct 23 01:02:15.724135 n-d-master-1 devstack@n-api.service[105090]: X-Project-Name: admin Oct 23 01:02:15.724135 n-d-master-1 devstack@n-api.service[105090]: X-Role: member,admin,reader Oct 23 01:02:15.724135 n-d-master-1 devstack@n-api.service[105090]: X-Roles: member,admin,reader Oct 23 01:02:15.725695 n-d-master-1 devstack@n-api.service[105090]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/598c49694334495883fc0f61f918bb99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_598c49694334495883fc0f61f918bb99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/598c49694334495883fc0f61f918bb99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/598c49694334495883fc0f61f918bb99"}]}] Oct 23 01:02:15.725695 n-d-master-1 devstack@n-api.service[105090]: X-Tenant: admin Oct 23 01:02:15.725695 n-d-master-1 devstack@n-api.service[105090]: X-Tenant-Id: 598c49694334495883fc0f61f918bb99 Oct 23 01:02:15.725695 n-d-master-1 devstack@n-api.service[105090]: X-Tenant-Name: admin Oct 23 01:02:15.725695 n-d-master-1 devstack@n-api.service[105090]: X-User: admin Oct 23 01:02:15.725695 n-d-master-1 devstack@n-api.service[105090]: X-User-Domain-Id: default Oct 23 01:02:15.725695 n-d-master-1 devstack@n-api.service[105090]: X-User-Domain-Name: Default Oct 23 01:02:15.725695 n-d-master-1 devstack@n-api.service[105090]: X-User-Id: aff16e16e402486ab43ace4b1e3cc4c1 Oct 23 01:02:15.725695 n-d-master-1 devstack@n-api.service[105090]: X-User-Name: admin Oct 23 01:02:15.725695 n-d-master-1 devstack@n-api.service[105090]: method: > Oct 23 01:02:15.725695 n-d-master-1 devstack@n-api.service[105090]: exception: Flavor 451 could not be found. Oct 23 01:02:15.725695 n-d-master-1 devstack@n-api.service[105090]: action_args: {'id': '451'} Oct 23 01:02:15.725695 n-d-master-1 devstack@n-api.service[105090]: {{(pid=105090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:02:15.725695 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:02:15.726687 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 23 01:02:15.726687 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 23 01:02:15.726687 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 23 01:02:15.726687 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 23 01:02:15.726687 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 01:02:15.726687 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 01:02:15.726687 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 23 01:02:15.726687 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 23 01:02:15.726687 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 23 01:02:15.726687 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:02:15.726687 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 23 01:02:15.726687 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 23 01:02:15.726687 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 23 01:02:15.726687 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi Oct 23 01:02:15.726687 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:02:15.726687 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi Oct 23 01:02:15.726687 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:02:15.726687 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:02:15.726687 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:02:15.728014 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:02:15.728014 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:02:15.728014 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:02:15.728014 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:02:15.728014 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 23 01:02:15.728014 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:02:15.728014 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 23 01:02:15.728014 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi Oct 23 01:02:15.728014 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:02:15.728014 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi Oct 23 01:02:15.728014 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:02:15.728014 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:02:15.728014 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:02:15.728014 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:02:15.728014 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:02:15.728014 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 23 01:02:15.728014 n-d-master-1 devstack@n-api.service[105090]: ERROR nova.api.openstack.wsgi Oct 23 01:02:15.728014 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi [None req-bc0fc1b9-748d-4e94-8837-8be4d89e921e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:02:15.729351 n-d-master-1 devstack@n-api.service[105090]: INFO nova.api.openstack.requestlog [None req-bc0fc1b9-748d-4e94-8837-8be4d89e921e admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.384379 Oct 23 01:02:15.729351 n-d-master-1 devstack@n-api.service[105090]: [pid: 105090|app: 0|req: 24/49] 10.222.0.42 () {60 vars in 1193 bytes} [Sun Oct 23 01:02:15 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 385 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 23 01:02:15.735966 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi [None req-fc42ce5a-b9f3-45c7-9930-3ca4d987c0e3 admin admin] Calling method '>' {{(pid=105089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:02:15.751170 n-d-master-1 devstack@n-api.service[105089]: INFO nova.api.openstack.requestlog [None req-fc42ce5a-b9f3-45c7-9930-3ca4d987c0e3 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018793 Oct 23 01:02:15.751684 n-d-master-1 devstack@n-api.service[105089]: [pid: 105089|app: 0|req: 26/50] 10.222.0.42 () {60 vars in 1210 bytes} [Sun Oct 23 01:02:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:02:15.761322 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi [None req-d18ed1a2-46f0-4fd5-9d10-d8383c75e177 admin admin] Calling method '>' {{(pid=105090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:02:15.775877 n-d-master-1 devstack@n-api.service[105090]: INFO nova.api.openstack.requestlog [None req-d18ed1a2-46f0-4fd5-9d10-d8383c75e177 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018554 Oct 23 01:02:15.776386 n-d-master-1 devstack@n-api.service[105090]: [pid: 105090|app: 0|req: 25/51] 10.222.0.42 () {60 vars in 1210 bytes} [Sun Oct 23 01:02:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:02:15.785321 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi [None req-5fefa83a-139a-46bb-ab29-88bf9c11b1e9 admin admin] Calling method '>' {{(pid=105089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:02:15.790172 n-d-master-1 devstack@n-api.service[105089]: INFO nova.api.openstack.wsgi [None req-5fefa83a-139a-46bb-ab29-88bf9c11b1e9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 23 01:02:15.791668 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi [None req-5fefa83a-139a-46bb-ab29-88bf9c11b1e9 admin admin] Request method failure captured: Oct 23 01:02:15.791668 n-d-master-1 devstack@n-api.service[105089]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 23 01:02:15.791668 n-d-master-1 devstack@n-api.service[105089]: Accept: application/json Oct 23 01:02:15.791668 n-d-master-1 devstack@n-api.service[105089]: Accept-Encoding: gzip, deflate Oct 23 01:02:15.791668 n-d-master-1 devstack@n-api.service[105089]: Connection: keep-alive Oct 23 01:02:15.791668 n-d-master-1 devstack@n-api.service[105089]: Content-Length: 0 Oct 23 01:02:15.791668 n-d-master-1 devstack@n-api.service[105089]: Host: 10.222.0.42 Oct 23 01:02:15.791668 n-d-master-1 devstack@n-api.service[105089]: Openstack-Api-Version: compute 2.92 Oct 23 01:02:15.791668 n-d-master-1 devstack@n-api.service[105089]: Openstack-System-Scope: None Oct 23 01:02:15.791668 n-d-master-1 devstack@n-api.service[105089]: User-Agent: python-novaclient Oct 23 01:02:15.791668 n-d-master-1 devstack@n-api.service[105089]: X-Auth-Token: gAAAAABjVJKXdhVrBEcdGWsnqHUkD8cjyffgIZGxYhYFCXMAUb5YqJb_Y9NovL5kvnNDsm49iOv6FC-g6S8pw66KVyLit0oAxdbEa3_L8EbExfDTbZe-bKOmN1VHGEr2526v75lxSjdSqy2CTQXQet1dUupcXJUakNwu6X5JpSw8S5OaobDSqOE Oct 23 01:02:15.791668 n-d-master-1 devstack@n-api.service[105089]: X-Domain-Id: None Oct 23 01:02:15.791668 n-d-master-1 devstack@n-api.service[105089]: X-Domain-Name: None Oct 23 01:02:15.791668 n-d-master-1 devstack@n-api.service[105089]: X-Identity-Status: Confirmed Oct 23 01:02:15.791668 n-d-master-1 devstack@n-api.service[105089]: X-Is-Admin-Project: True Oct 23 01:02:15.791668 n-d-master-1 devstack@n-api.service[105089]: X-Openstack-Nova-Api-Version: 2.92 Oct 23 01:02:15.791668 n-d-master-1 devstack@n-api.service[105089]: X-Project-Domain-Id: default Oct 23 01:02:15.791668 n-d-master-1 devstack@n-api.service[105089]: X-Project-Domain-Name: Default Oct 23 01:02:15.791668 n-d-master-1 devstack@n-api.service[105089]: X-Project-Id: 598c49694334495883fc0f61f918bb99 Oct 23 01:02:15.791668 n-d-master-1 devstack@n-api.service[105089]: X-Project-Name: admin Oct 23 01:02:15.791668 n-d-master-1 devstack@n-api.service[105089]: X-Role: member,admin,reader Oct 23 01:02:15.791668 n-d-master-1 devstack@n-api.service[105089]: X-Roles: member,admin,reader Oct 23 01:02:15.793078 n-d-master-1 devstack@n-api.service[105089]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/598c49694334495883fc0f61f918bb99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_598c49694334495883fc0f61f918bb99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/598c49694334495883fc0f61f918bb99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/598c49694334495883fc0f61f918bb99"}]}] Oct 23 01:02:15.793078 n-d-master-1 devstack@n-api.service[105089]: X-Tenant: admin Oct 23 01:02:15.793078 n-d-master-1 devstack@n-api.service[105089]: X-Tenant-Id: 598c49694334495883fc0f61f918bb99 Oct 23 01:02:15.793078 n-d-master-1 devstack@n-api.service[105089]: X-Tenant-Name: admin Oct 23 01:02:15.793078 n-d-master-1 devstack@n-api.service[105089]: X-User: admin Oct 23 01:02:15.793078 n-d-master-1 devstack@n-api.service[105089]: X-User-Domain-Id: default Oct 23 01:02:15.793078 n-d-master-1 devstack@n-api.service[105089]: X-User-Domain-Name: Default Oct 23 01:02:15.793078 n-d-master-1 devstack@n-api.service[105089]: X-User-Id: aff16e16e402486ab43ace4b1e3cc4c1 Oct 23 01:02:15.793078 n-d-master-1 devstack@n-api.service[105089]: X-User-Name: admin Oct 23 01:02:15.793078 n-d-master-1 devstack@n-api.service[105089]: method: > Oct 23 01:02:15.793078 n-d-master-1 devstack@n-api.service[105089]: exception: Flavor 451 could not be found. Oct 23 01:02:15.793078 n-d-master-1 devstack@n-api.service[105089]: action_args: {'id': '451'} Oct 23 01:02:15.793078 n-d-master-1 devstack@n-api.service[105089]: {{(pid=105089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:02:15.793078 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:02:15.794619 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 23 01:02:15.794619 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 23 01:02:15.794619 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 23 01:02:15.794619 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 23 01:02:15.794619 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 01:02:15.794619 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 01:02:15.794619 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 23 01:02:15.794619 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 23 01:02:15.794619 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 23 01:02:15.794619 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:02:15.794619 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 23 01:02:15.794619 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 23 01:02:15.794619 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 23 01:02:15.794619 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi Oct 23 01:02:15.794619 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:02:15.794619 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi Oct 23 01:02:15.794619 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:02:15.794619 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:02:15.794619 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:02:15.795676 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:02:15.795676 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:02:15.795676 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:02:15.795676 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:02:15.795676 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 23 01:02:15.795676 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:02:15.795676 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 23 01:02:15.795676 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi Oct 23 01:02:15.795676 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:02:15.795676 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi Oct 23 01:02:15.795676 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:02:15.795676 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:02:15.795676 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:02:15.795676 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:02:15.795676 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:02:15.795676 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 23 01:02:15.795676 n-d-master-1 devstack@n-api.service[105089]: ERROR nova.api.openstack.wsgi Oct 23 01:02:15.795676 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi [None req-5fefa83a-139a-46bb-ab29-88bf9c11b1e9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:02:15.796666 n-d-master-1 devstack@n-api.service[105089]: INFO nova.api.openstack.requestlog [None req-5fefa83a-139a-46bb-ab29-88bf9c11b1e9 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011139 Oct 23 01:02:15.796666 n-d-master-1 devstack@n-api.service[105089]: [pid: 105089|app: 0|req: 27/52] 10.222.0.42 () {60 vars in 1193 bytes} [Sun Oct 23 01:02:15 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 23 01:02:16.982711 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi [None req-d18ed1a2-46f0-4fd5-9d10-d8383c75e177 admin admin] Calling method '>' {{(pid=105090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:02:16.983721 n-d-master-1 devstack@n-api.service[105090]: INFO nova.api.openstack.requestlog [None req-d18ed1a2-46f0-4fd5-9d10-d8383c75e177 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Oct 23 01:02:16.984114 n-d-master-1 devstack@n-api.service[105090]: [pid: 105090|app: 0|req: 26/53] 10.222.0.42 () {56 vars in 1074 bytes} [Sun Oct 23 01:02:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:02:17.499232 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi [None req-2b93f297-eb86-4fd7-bd82-d412adc3cb18 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:02:17.571594 n-d-master-1 devstack@n-api.service[105089]: INFO nova.api.openstack.requestlog [None req-2b93f297-eb86-4fd7-bd82-d412adc3cb18 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.450405 Oct 23 01:02:17.572124 n-d-master-1 devstack@n-api.service[105089]: [pid: 105089|app: 0|req: 28/54] 10.222.0.42 () {64 vars in 1235 bytes} [Sun Oct 23 01:02:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 23 01:02:18.767714 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi [None req-d18ed1a2-46f0-4fd5-9d10-d8383c75e177 admin admin] Calling method '>' {{(pid=105090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:02:18.768726 n-d-master-1 devstack@n-api.service[105090]: INFO nova.api.openstack.requestlog [None req-d18ed1a2-46f0-4fd5-9d10-d8383c75e177 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Oct 23 01:02:18.769121 n-d-master-1 devstack@n-api.service[105090]: [pid: 105090|app: 0|req: 27/55] 10.222.0.42 () {56 vars in 1074 bytes} [Sun Oct 23 01:02:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:02:19.276015 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi [None req-9df1b953-b454-4e7c-899d-63174182655b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:02:19.355472 n-d-master-1 devstack@n-api.service[105089]: INFO nova.api.openstack.requestlog [None req-9df1b953-b454-4e7c-899d-63174182655b admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.450317 Oct 23 01:02:19.356051 n-d-master-1 devstack@n-api.service[105089]: [pid: 105089|app: 0|req: 29/56] 10.222.0.42 () {64 vars in 1235 bytes} [Sun Oct 23 01:02:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:02:20.549504 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi [None req-d18ed1a2-46f0-4fd5-9d10-d8383c75e177 admin admin] Calling method '>' {{(pid=105090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:02:20.550550 n-d-master-1 devstack@n-api.service[105090]: INFO nova.api.openstack.requestlog [None req-d18ed1a2-46f0-4fd5-9d10-d8383c75e177 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Oct 23 01:02:20.551193 n-d-master-1 devstack@n-api.service[105090]: [pid: 105090|app: 0|req: 28/57] 10.222.0.42 () {56 vars in 1074 bytes} [Sun Oct 23 01:02:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:02:21.060038 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi [None req-09ee0239-d953-42fc-b6ac-6c6a1e371a47 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:02:21.121089 n-d-master-1 devstack@n-api.service[105089]: INFO nova.api.openstack.requestlog [None req-09ee0239-d953-42fc-b6ac-6c6a1e371a47 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.433441 Oct 23 01:02:21.121634 n-d-master-1 devstack@n-api.service[105089]: [pid: 105089|app: 0|req: 30/58] 10.222.0.42 () {64 vars in 1235 bytes} [Sun Oct 23 01:02:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 23 01:02:22.315028 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi [None req-d18ed1a2-46f0-4fd5-9d10-d8383c75e177 admin admin] Calling method '>' {{(pid=105090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:02:22.316058 n-d-master-1 devstack@n-api.service[105090]: INFO nova.api.openstack.requestlog [None req-d18ed1a2-46f0-4fd5-9d10-d8383c75e177 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Oct 23 01:02:22.316450 n-d-master-1 devstack@n-api.service[105090]: [pid: 105090|app: 0|req: 29/59] 10.222.0.42 () {56 vars in 1074 bytes} [Sun Oct 23 01:02:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:02:22.828260 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi [None req-ffa00996-6d73-4914-9255-95a99876b821 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:02:22.902996 n-d-master-1 devstack@n-api.service[105089]: INFO nova.api.openstack.requestlog [None req-ffa00996-6d73-4914-9255-95a99876b821 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.448633 Oct 23 01:02:22.903507 n-d-master-1 devstack@n-api.service[105089]: [pid: 105089|app: 0|req: 31/60] 10.222.0.42 () {64 vars in 1235 bytes} [Sun Oct 23 01:02:22 2022] POST /compute/v2.1/flavors => generated 409 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:02:24.099083 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi [None req-d18ed1a2-46f0-4fd5-9d10-d8383c75e177 admin admin] Calling method '>' {{(pid=105090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:02:24.100119 n-d-master-1 devstack@n-api.service[105090]: INFO nova.api.openstack.requestlog [None req-d18ed1a2-46f0-4fd5-9d10-d8383c75e177 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Oct 23 01:02:24.100512 n-d-master-1 devstack@n-api.service[105090]: [pid: 105090|app: 0|req: 30/61] 10.222.0.42 () {56 vars in 1074 bytes} [Sun Oct 23 01:02:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:02:24.611997 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi [None req-d55d9924-5647-4439-997e-4de267cb1df5 admin admin] Calling method '>' {{(pid=105089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:02:24.632894 n-d-master-1 devstack@n-api.service[105089]: INFO nova.api.openstack.requestlog [None req-d55d9924-5647-4439-997e-4de267cb1df5 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.396652 Oct 23 01:02:24.633735 n-d-master-1 devstack@n-api.service[105089]: [pid: 105089|app: 0|req: 32/62] 10.222.0.42 () {60 vars in 1202 bytes} [Sun Oct 23 01:02:24 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:03:20.611506 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi [None req-d18ed1a2-46f0-4fd5-9d10-d8383c75e177 admin admin] Calling method '>' {{(pid=105090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:03:20.612451 n-d-master-1 devstack@n-api.service[105090]: INFO nova.api.openstack.requestlog [None req-d18ed1a2-46f0-4fd5-9d10-d8383c75e177 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Oct 23 01:03:20.612849 n-d-master-1 devstack@n-api.service[105090]: [pid: 105090|app: 0|req: 31/63] 10.222.0.42 () {54 vars in 931 bytes} [Sun Oct 23 01:03:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:03:20.623385 n-d-master-1 devstack@n-api.service[105089]: DEBUG dbcounter [-] [105089] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:03:20.993453 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi [None req-26f3a7be-cdcf-40ae-aa4e-041deb2ec288 admin admin] Calling method '>' {{(pid=105089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:03:21.014066 n-d-master-1 devstack@n-api.service[105089]: INFO nova.api.openstack.requestlog [None req-26f3a7be-cdcf-40ae-aa4e-041deb2ec288 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.395062 Oct 23 01:03:21.014593 n-d-master-1 devstack@n-api.service[105089]: [pid: 105089|app: 0|req: 33/64] 10.222.0.42 () {60 vars in 1292 bytes} [Sun Oct 23 01:03:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:03:21.035438 n-d-master-1 devstack@n-api.service[105090]: DEBUG dbcounter [-] [105090] Writing DB stats nova_api:SELECT=14 {{(pid=105090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:03:21.039311 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi [None req-8f152780-d8d0-4521-800e-d79b75f1422f admin admin] Calling method '>' {{(pid=105090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:03:21.046495 n-d-master-1 devstack@n-api.service[105090]: INFO nova.api.openstack.requestlog [None req-8f152780-d8d0-4521-800e-d79b75f1422f admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012530 Oct 23 01:03:21.050904 n-d-master-1 devstack@n-api.service[105090]: [pid: 105090|app: 0|req: 32/65] 10.222.0.42 () {60 vars in 1283 bytes} [Sun Oct 23 01:03:21 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:03:21.059268 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi [None req-231a6a21-fa9e-4ca9-8b45-2f77556d8ed8 admin admin] Calling method '>' {{(pid=105089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:03:21.066602 n-d-master-1 devstack@n-api.service[105089]: INFO nova.api.openstack.requestlog [None req-231a6a21-fa9e-4ca9-8b45-2f77556d8ed8 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010943 Oct 23 01:03:21.067125 n-d-master-1 devstack@n-api.service[105089]: [pid: 105089|app: 0|req: 34/66] 10.222.0.42 () {60 vars in 1286 bytes} [Sun Oct 23 01:03:21 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:03:21.079611 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi [None req-5115224e-b535-4c39-b696-cd2ae504ee5e admin admin] Calling method '>' {{(pid=105090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:03:21.087241 n-d-master-1 devstack@n-api.service[105090]: INFO nova.api.openstack.requestlog [None req-5115224e-b535-4c39-b696-cd2ae504ee5e admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011560 Oct 23 01:03:21.087759 n-d-master-1 devstack@n-api.service[105090]: [pid: 105090|app: 0|req: 33/67] 10.222.0.42 () {60 vars in 1286 bytes} [Sun Oct 23 01:03:21 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:03:21.099332 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi [None req-0690c9cf-1912-47e7-a1f1-6018922025f4 admin admin] Calling method '>' {{(pid=105089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:03:21.106448 n-d-master-1 devstack@n-api.service[105089]: INFO nova.api.openstack.requestlog [None req-0690c9cf-1912-47e7-a1f1-6018922025f4 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010597 Oct 23 01:03:21.106951 n-d-master-1 devstack@n-api.service[105089]: [pid: 105089|app: 0|req: 35/68] 10.222.0.42 () {60 vars in 1283 bytes} [Sun Oct 23 01:03:21 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:08:43.135374 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi [None req-5115224e-b535-4c39-b696-cd2ae504ee5e admin admin] Calling method '>' {{(pid=105090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:08:43.136376 n-d-master-1 devstack@n-api.service[105090]: INFO nova.api.openstack.requestlog [None req-5115224e-b535-4c39-b696-cd2ae504ee5e admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Oct 23 01:08:43.136770 n-d-master-1 devstack@n-api.service[105090]: [pid: 105090|app: 0|req: 34/69] 10.222.0.42 () {56 vars in 1074 bytes} [Sun Oct 23 01:08:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:08:43.277651 n-d-master-1 devstack@n-api.service[105089]: DEBUG dbcounter [-] [105089] Writing DB stats nova_api:SELECT=6 {{(pid=105089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:08:43.416361 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi [None req-39bed98d-192e-42d7-941e-5c6cc7a3deed admin admin] Calling method '>' {{(pid=105089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:08:43.421488 n-d-master-1 devstack@n-api.service[105089]: DEBUG oslo_concurrency.lockutils [None req-39bed98d-192e-42d7-941e-5c6cc7a3deed admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:08:43.421955 n-d-master-1 devstack@n-api.service[105089]: DEBUG oslo_concurrency.lockutils [None req-39bed98d-192e-42d7-941e-5c6cc7a3deed admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:08:43.422404 n-d-master-1 devstack@n-api.service[105089]: DEBUG oslo_concurrency.lockutils [None req-39bed98d-192e-42d7-941e-5c6cc7a3deed admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:08:43.423108 n-d-master-1 devstack@n-api.service[105089]: DEBUG oslo_concurrency.lockutils [None req-39bed98d-192e-42d7-941e-5c6cc7a3deed admin admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:08:43.423549 n-d-master-1 devstack@n-api.service[105089]: DEBUG oslo_concurrency.lockutils [None req-39bed98d-192e-42d7-941e-5c6cc7a3deed admin admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:08:43.423959 n-d-master-1 devstack@n-api.service[105089]: DEBUG oslo_concurrency.lockutils [None req-39bed98d-192e-42d7-941e-5c6cc7a3deed admin admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:08:43.461900 n-d-master-1 devstack@n-api.service[105089]: INFO nova.api.openstack.requestlog [None req-39bed98d-192e-42d7-941e-5c6cc7a3deed admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.185083 Oct 23 01:08:43.462473 n-d-master-1 devstack@n-api.service[105089]: [pid: 105089|app: 0|req: 36/70] 10.222.0.42 () {60 vars in 1193 bytes} [Sun Oct 23 01:08:43 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:08:44.532274 n-d-master-1 devstack@n-api.service[105090]: DEBUG nova.api.openstack.wsgi [None req-5115224e-b535-4c39-b696-cd2ae504ee5e admin admin] Calling method '>' {{(pid=105090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:08:44.533262 n-d-master-1 devstack@n-api.service[105090]: INFO nova.api.openstack.requestlog [None req-5115224e-b535-4c39-b696-cd2ae504ee5e admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 Oct 23 01:08:44.533683 n-d-master-1 devstack@n-api.service[105090]: [pid: 105090|app: 0|req: 35/71] 10.222.0.42 () {56 vars in 1074 bytes} [Sun Oct 23 01:08:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:08:44.721685 n-d-master-1 devstack@n-api.service[105089]: DEBUG nova.api.openstack.wsgi [None req-5d184c5b-6daa-4f29-bc52-110524a03f2c admin admin] Calling method '>' {{(pid=105089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:08:44.725127 n-d-master-1 devstack@n-api.service[105089]: DEBUG oslo_concurrency.lockutils [None req-5d184c5b-6daa-4f29-bc52-110524a03f2c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:08:44.725594 n-d-master-1 devstack@n-api.service[105089]: DEBUG oslo_concurrency.lockutils [None req-5d184c5b-6daa-4f29-bc52-110524a03f2c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:08:44.726042 n-d-master-1 devstack@n-api.service[105089]: DEBUG oslo_concurrency.lockutils [None req-5d184c5b-6daa-4f29-bc52-110524a03f2c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:08:44.726806 n-d-master-1 devstack@n-api.service[105089]: DEBUG oslo_concurrency.lockutils [None req-5d184c5b-6daa-4f29-bc52-110524a03f2c admin admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:08:44.727731 n-d-master-1 devstack@n-api.service[105089]: DEBUG oslo_concurrency.lockutils [None req-5d184c5b-6daa-4f29-bc52-110524a03f2c admin admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:08:44.728143 n-d-master-1 devstack@n-api.service[105089]: DEBUG oslo_concurrency.lockutils [None req-5d184c5b-6daa-4f29-bc52-110524a03f2c admin admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:08:44.750945 n-d-master-1 devstack@n-api.service[105089]: INFO nova.api.openstack.requestlog [None req-5d184c5b-6daa-4f29-bc52-110524a03f2c admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.080022 Oct 23 01:08:44.751411 n-d-master-1 devstack@n-api.service[105089]: [pid: 105089|app: 0|req: 37/72] 10.222.0.42 () {60 vars in 1193 bytes} [Sun Oct 23 01:08:44 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:09:29.128549 n-d-master-1 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 23 01:09:29.129077 n-d-master-1 devstack@n-api.service[105088]: Sun Oct 23 01:09:29 2022 - graceful shutdown triggered... Oct 23 01:09:29.129525 n-d-master-1 devstack@n-api.service[105089]: Gracefully killing worker 1 (pid: 105089)... Oct 23 01:09:29.130009 n-d-master-1 devstack@n-api.service[105090]: Gracefully killing worker 2 (pid: 105090)... Oct 23 01:09:29.257750 n-d-master-1 devstack@n-api.service[105090]: DEBUG dbcounter [-] [105090] Writing DB stats nova_api:SELECT=4 {{(pid=105090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:09:30.129992 n-d-master-1 devstack@n-api.service[105088]: worker 1 buried after 1 seconds Oct 23 01:09:30.130538 n-d-master-1 devstack@n-api.service[105088]: worker 2 buried after 1 seconds Oct 23 01:09:30.130538 n-d-master-1 devstack@n-api.service[105088]: goodbye to uWSGI. Oct 23 01:09:30.131603 n-d-master-1 systemd[1]: devstack@n-api.service: Succeeded. Oct 23 01:09:30.132188 n-d-master-1 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 23 01:09:30.134965 n-d-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Oct 23 01:09:30.152186 n-d-master-1 devstack@n-api.service[120937]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 23 01:09:30.172504 n-d-master-1 devstack@n-api.service[120937]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Oct 23 01:09:30 2022] *** Oct 23 01:09:30.172667 n-d-master-1 devstack@n-api.service[120937]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 23 01:09:30.172796 n-d-master-1 devstack@n-api.service[120937]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 23 01:09:30.172896 n-d-master-1 devstack@n-api.service[120937]: nodename: n-d-master-1 Oct 23 01:09:30.173099 n-d-master-1 devstack@n-api.service[120937]: machine: x86_64 Oct 23 01:09:30.173224 n-d-master-1 devstack@n-api.service[120937]: clock source: unix Oct 23 01:09:30.173451 n-d-master-1 devstack@n-api.service[120937]: pcre jit disabled Oct 23 01:09:30.173451 n-d-master-1 devstack@n-api.service[120937]: detected number of CPU cores: 4 Oct 23 01:09:30.173451 n-d-master-1 devstack@n-api.service[120937]: current working directory: / Oct 23 01:09:30.173451 n-d-master-1 devstack@n-api.service[120937]: detected binary path: /usr/bin/uwsgi-core Oct 23 01:09:30.173451 n-d-master-1 devstack@n-api.service[120937]: your processes number limit is 47680 Oct 23 01:09:30.173451 n-d-master-1 devstack@n-api.service[120937]: your memory page size is 4096 bytes Oct 23 01:09:30.173451 n-d-master-1 devstack@n-api.service[120937]: detected max file descriptor number: 2048 Oct 23 01:09:30.173451 n-d-master-1 devstack@n-api.service[120937]: lock engine: pthread robust mutexes Oct 23 01:09:30.174024 n-d-master-1 devstack@n-api.service[120937]: thunder lock: enabled Oct 23 01:09:30.174024 n-d-master-1 devstack@n-api.service[120937]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 23 01:09:30.174024 n-d-master-1 devstack@n-api.service[120937]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 23 01:09:30.213256 n-d-master-1 devstack@n-api.service[120937]: Python main interpreter initialized at 0x556860aaa9c0 Oct 23 01:09:30.213256 n-d-master-1 devstack@n-api.service[120937]: python threads support enabled Oct 23 01:09:30.213256 n-d-master-1 devstack@n-api.service[120937]: your server socket listen backlog is limited to 100 connections Oct 23 01:09:30.213256 n-d-master-1 devstack@n-api.service[120937]: your mercy for graceful operations on workers is 90 seconds Oct 23 01:09:30.213668 n-d-master-1 devstack@n-api.service[120937]: mapped 403077 bytes (393 KB) for 2 cores Oct 23 01:09:30.213668 n-d-master-1 devstack@n-api.service[120937]: *** Operational MODE: preforking *** Oct 23 01:09:30.213944 n-d-master-1 devstack@n-api.service[120937]: *** uWSGI is running in multiple interpreter mode *** Oct 23 01:09:30.213944 n-d-master-1 devstack@n-api.service[120937]: spawned uWSGI master process (pid: 120937) Oct 23 01:09:30.214168 n-d-master-1 systemd[1]: Started Devstack devstack@n-api.service. Oct 23 01:09:30.214742 n-d-master-1 devstack@n-api.service[120937]: spawned uWSGI worker 1 (pid: 120944, cores: 1) Oct 23 01:09:30.215102 n-d-master-1 devstack@n-api.service[120937]: spawned uWSGI worker 2 (pid: 120945, cores: 1) Oct 23 01:09:30.215265 n-d-master-1 devstack@n-api.service[120937]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 23 01:09:30.873609 n-d-master-1 devstack@n-api.service[120944]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 23 01:09:30.874687 n-d-master-1 devstack@n-api.service[120945]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 23 01:09:32.124119 n-d-master-1 devstack@n-api.service[120944]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 23 01:09:32.124119 n-d-master-1 devstack@n-api.service[120944]: from cryptography.utils import int_from_bytes Oct 23 01:09:32.124786 n-d-master-1 devstack@n-api.service[120944]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 23 01:09:32.124786 n-d-master-1 devstack@n-api.service[120944]: from cryptography.utils import int_from_bytes Oct 23 01:09:32.125360 n-d-master-1 devstack@n-api.service[120945]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 23 01:09:32.125360 n-d-master-1 devstack@n-api.service[120945]: from cryptography.utils import int_from_bytes Oct 23 01:09:32.125809 n-d-master-1 devstack@n-api.service[120945]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 23 01:09:32.125809 n-d-master-1 devstack@n-api.service[120945]: from cryptography.utils import int_from_bytes Oct 23 01:09:34.542517 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 23 01:09:34.543158 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 23 01:09:34.543264 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 23 01:09:34.543617 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 23 01:09:34.543722 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 23 01:09:34.543806 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 23 01:09:34.543880 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 23 01:09:34.543964 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 23 01:09:34.544244 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 23 01:09:34.544350 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.544523 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 23 01:09:34.544612 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.545131 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.545279 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.545459 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.545574 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.545780 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.545906 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.546115 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.546237 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.546439 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.546557 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.546753 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.546845 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.547075 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.547175 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.547336 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.547430 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.547651 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.547750 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.547959 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.548058 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.548276 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.548369 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.548584 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.548675 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.548899 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.549013 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.549203 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.549352 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.549507 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.549640 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.549822 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.549954 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.550159 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.550304 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.550483 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.550660 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.550786 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.551113 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.551285 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.551408 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.551599 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.551907 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.552017 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.552232 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.552381 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.552621 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.552779 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.552956 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.553098 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.553243 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.553420 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.553565 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.553734 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.553874 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.554085 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.554226 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.554400 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.554539 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.554805 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.554940 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.555127 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.555242 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.555448 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.555563 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.555762 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.555926 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.556178 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.556334 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.556492 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.556587 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.556809 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.556911 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.557130 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.557221 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.557451 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.557556 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.557763 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.557865 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.558111 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.558222 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.558431 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.558533 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.558749 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.558856 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.559070 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.559174 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.559388 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.559536 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.559677 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.559827 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.559986 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.560085 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.560287 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.560397 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.560591 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.560684 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.560896 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.561002 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.561125 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.561273 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.561434 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.561578 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.561754 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.561894 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.562107 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.562227 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.562417 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.562511 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.562666 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.562774 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.562917 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.563010 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.563234 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.563336 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.563553 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.563656 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.563860 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.563962 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.564168 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.564268 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.564472 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.564564 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.564778 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.564870 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.565083 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.565173 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.565389 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.565496 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.565697 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.565860 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.566034 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.566138 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.566329 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.566443 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.566643 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.566744 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.566963 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.567062 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.567270 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.567362 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.567588 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.567678 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.568008 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.568112 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.568269 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.568362 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.568576 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.568667 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.568917 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.569024 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.569236 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.569340 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.569543 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.569642 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.569860 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.570067 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.570206 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.570299 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.570513 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.570604 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.570820 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.570940 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.571125 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.571226 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.571442 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.571534 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.571773 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.571872 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.572076 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.572191 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.572331 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.572463 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.572644 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.572753 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.572924 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.573028 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.573239 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.573347 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.573546 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.573668 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.573849 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.573951 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.574178 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.574286 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.574480 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.574629 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.574783 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.574876 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.575087 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.575199 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.575391 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.575491 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.575696 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.575833 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.576000 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.576111 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.576306 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.576406 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.576609 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.576711 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.576914 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.577023 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.577218 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.577308 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.577520 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.577658 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.577992 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.578130 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.578229 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.578323 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.578467 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.578569 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.578778 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.578893 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.579085 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.579192 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.579390 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.579504 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.579708 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.579823 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.580015 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.580130 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.580319 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.580409 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.580636 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.580784 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.580942 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.581082 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.581243 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.581337 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.581558 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.581659 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.581863 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.581956 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.582192 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.582283 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.582508 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.582610 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.582807 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.582966 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.583111 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.583211 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.583424 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.583525 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.584252 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.584366 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.584560 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.584653 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.584866 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.584963 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.585172 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.585275 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.585476 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.585584 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.585781 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.585918 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.586109 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.586218 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.586416 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.586516 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.586716 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.586860 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.587034 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.587126 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.587353 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.587461 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.587659 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.587758 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.587965 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.588064 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.588271 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.588373 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.588586 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.588676 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:09:34.588921 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.589011 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.589252 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.589346 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.589594 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.589699 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.589907 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.590063 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.590268 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.590374 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.590599 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.590701 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.590919 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.591011 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.591236 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.591337 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.591554 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.591646 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.591882 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.592181 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.592286 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.592384 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.592511 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.592653 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.592800 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.592954 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.593122 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.593267 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.593439 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.593568 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.593765 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.593896 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.594109 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.594250 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.594440 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.594565 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.594732 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.594863 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.595042 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.595163 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.595360 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.595487 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.595685 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.595804 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.596003 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.596123 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.596313 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.596432 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.596656 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.596785 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.596999 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.597120 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.597313 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.597431 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.598602 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.598793 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.598793 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.599034 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.599148 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.599254 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.600095 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.600279 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.600376 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.600464 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.600557 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.600643 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.600734 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.600830 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.600924 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.601010 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.601093 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.601184 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.601269 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.601418 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.601510 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.601643 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.601732 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.601824 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.601925 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.602060 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.602227 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.602329 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.602540 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.602640 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.602857 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.602960 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.603193 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.603292 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.603512 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.603604 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.603836 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.603935 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.604151 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.604243 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.604468 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.604594 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.604788 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.604897 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.605099 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.605205 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.605409 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.605520 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.605719 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.605822 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.606043 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.606139 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.606352 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.606464 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.606658 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.606753 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.606967 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.607069 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.607274 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.607383 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.607594 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.607689 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.607933 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.608055 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.608232 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.608397 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.608564 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.608659 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.608870 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.608960 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.609182 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.609328 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.609493 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.609642 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.609803 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.609895 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.610134 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.610228 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.610449 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.610539 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.610760 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.610861 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.611067 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.611160 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.611390 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.611535 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.611701 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.611801 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.612006 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.612099 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.612329 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.612421 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.612654 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.612802 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.612935 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.613072 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.613240 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.613374 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.613550 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.613660 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.613860 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.613960 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.614197 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.614292 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.614508 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.614677 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.614847 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.614950 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.615166 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.615258 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.615480 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.615582 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.615814 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.615913 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.616142 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.616234 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.616446 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.616547 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.616767 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.616866 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.617091 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.617183 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.617405 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.617505 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.617707 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.617908 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.618026 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.618259 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.618372 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.618520 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.618662 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.618794 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.618912 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.619014 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.619219 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.619313 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.619519 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.619770 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.619865 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.619960 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.620128 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.620255 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.620415 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.620557 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.621015 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.621394 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.621581 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.621748 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.621921 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.622148 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.622311 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.622479 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.622627 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.622772 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.622919 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.623063 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.623208 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.623367 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.623514 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.623666 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.623812 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.623976 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.624134 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.624292 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.624434 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.624572 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.624752 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.624893 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.625051 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.625203 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.625370 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.625527 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.625668 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.625809 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.626010 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.626170 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.626302 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.626438 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.626624 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.626761 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.626938 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.627077 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.627263 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.627400 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.627577 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.627714 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.627925 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.628020 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.628231 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.628374 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.628537 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.628755 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.628899 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.628998 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.629149 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.629253 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.629489 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.629601 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.629823 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.629925 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.630171 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.630351 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.630540 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.630673 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.630827 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.631004 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.631334 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.631437 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.631658 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.631839 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.631974 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.632079 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.632288 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.632383 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.632605 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.632711 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.632919 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.633020 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.633234 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.633337 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.633556 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.633655 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.633871 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.634007 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.634336 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.634485 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.634641 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.634735 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.634899 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.635058 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.635152 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.635376 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.635483 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.635698 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.635800 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.636010 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.636102 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.636327 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.636434 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.636666 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.636758 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.636998 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.637088 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.637310 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.637402 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.637621 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.637713 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.637935 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.638067 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.639064 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.639193 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.639298 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.639393 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.639478 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.639605 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.639708 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.639796 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.639879 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.639963 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.640047 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.640129 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.640232 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.640319 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.640403 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.640485 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.640661 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.640792 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.640973 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.641122 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.641289 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.641397 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.641603 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.641706 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.641912 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.642064 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.642245 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.642347 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.642560 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.642664 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.642882 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.643015 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.643197 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.643293 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.643502 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.643609 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.643827 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.643928 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.644134 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.644262 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.644439 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.644532 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.644749 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.644842 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.645058 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.645162 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.645360 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.645453 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.645669 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.645773 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.645998 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.646597 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.646839 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.646942 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.647167 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.647258 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.647474 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.647566 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.647794 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.647894 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.648109 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.648201 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.648421 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.648565 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.648741 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.648832 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.649055 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.649151 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.649365 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.649473 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.649680 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.649781 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.650008 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.650117 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.650325 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.650432 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.650638 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.650739 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.650949 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.651047 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.651262 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.651367 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.651573 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.651665 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.651886 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.651977 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.652194 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.652289 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.652506 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.652607 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.652822 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.652915 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.653130 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.653403 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.653505 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.653743 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.653843 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.654087 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.654413 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.654510 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.654750 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.654852 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.655070 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.655171 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.655393 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.655496 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.655723 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.655829 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.656042 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.656149 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.656354 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.656457 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.656668 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.656762 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.656977 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.657070 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.657285 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.657387 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.657596 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.657699 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.657902 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.658061 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.658235 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.658330 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.658541 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.658689 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.658846 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.658938 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.659138 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.659279 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.659440 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.659534 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.659761 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.659905 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.660038 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.660151 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.660343 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.660456 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.660646 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.660755 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.660949 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.661040 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.661251 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.661341 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.661553 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.661654 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.662436 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.662540 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.662747 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.662851 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.663054 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.663157 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.663361 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.663454 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.663673 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.663773 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.663982 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.664085 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.664289 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.664385 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.664631 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.664727 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.664936 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.665030 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.665265 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.665359 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.665574 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.665676 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.665898 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.666027 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.666228 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.666322 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.666535 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.666628 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.666841 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.666937 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.667151 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.667244 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.667454 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.667558 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.667757 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.667863 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.668065 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.668165 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.668371 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.668472 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.668674 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.668773 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.668984 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.669124 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.669290 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.670387 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.670387 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.670711 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.670711 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.673067 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.673067 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.673390 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.673544 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.673700 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.673869 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.674050 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.674050 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.674350 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.674496 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.674642 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.674642 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.674931 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.675085 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.675239 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.675386 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.675531 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.675676 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.675829 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.675986 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.676140 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.676293 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.676461 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.676613 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.676761 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.676915 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.677065 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.677250 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.677430 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.677531 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.677618 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.677716 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.677810 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.678006 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.678142 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.678256 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.678354 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.678491 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.678630 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.678760 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.678873 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.678991 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.679142 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.679249 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.679344 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.679440 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.679583 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.679715 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.679819 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.679905 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.679989 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.680079 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.680213 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.680343 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.680447 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.680535 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.680619 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.680710 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.680795 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.680890 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.680975 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.681067 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.681232 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.681332 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.681426 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.681661 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.681789 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.681938 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.682134 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.682238 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.682333 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.682435 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.682522 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.682614 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.682821 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.682916 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.683001 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.683127 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.683269 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.683384 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.683522 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.683643 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.683767 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.683866 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.683952 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.684037 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.684120 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.684203 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.684301 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.684396 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.684482 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.684573 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.684667 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.684761 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.684860 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.684946 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.685042 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.685128 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.685212 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.685304 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.685403 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.685489 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.685573 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.685657 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.685794 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.685935 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.686073 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.686233 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.686367 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.686528 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.686721 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.686884 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.687018 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.687144 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.687239 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.687458 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.687599 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.687772 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.687896 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.688060 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.688214 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.688377 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.688507 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.688690 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.688849 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.689007 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.689145 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.689285 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.689420 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.689597 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.689733 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.689916 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.690186 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.690319 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.690441 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.690530 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.690613 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.690843 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.690936 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.691157 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.691252 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.691468 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.691559 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.691779 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.691873 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.692090 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.692229 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.692399 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.692493 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.692709 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.692801 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.693043 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.693149 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.693355 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.693467 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.693659 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.693835 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.694072 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.694173 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.694301 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.694446 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.694608 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.694738 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.694921 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.695016 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.695232 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.695330 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.695539 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.695643 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.695843 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.695944 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.696147 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.696533 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.696681 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.696788 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.696883 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.697140 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.697449 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.697543 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.697765 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.697866 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.698104 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.698202 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.698417 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.698508 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.698730 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.698825 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.699041 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.699181 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.699358 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.699452 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.699674 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.699779 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.699984 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.700115 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.700357 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.700462 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.700665 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.700760 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.700971 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.701073 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.701285 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.701453 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.701592 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.701685 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.701898 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.702045 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.702227 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.702376 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.702536 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.702631 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.702840 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.702933 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.703147 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.703250 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.703453 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.703547 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.703776 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.703869 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.704082 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.704186 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.704406 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.704498 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.704821 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.704913 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.705137 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.705240 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.705450 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.705543 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.705771 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.705862 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.706117 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.706228 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.706447 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.706605 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.706773 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.706890 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.707067 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.707172 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.707379 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.707475 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.707710 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.707806 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.708027 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.708128 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.708337 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.708428 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.709176 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.709281 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.709485 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.709578 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.709798 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.709900 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.710139 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.710248 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.710448 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.710557 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.710769 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.710861 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.711090 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.711192 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.711404 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.711519 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.711726 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.711865 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.712103 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.712234 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.712431 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.712561 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.712750 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.712884 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.713048 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.713170 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.713362 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.713486 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.713670 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.713800 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.714027 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.714153 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.714313 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.714435 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.714618 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.714748 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.714926 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.715054 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.715236 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.715357 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.715544 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.715674 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.716903 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.717064 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.717165 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.717252 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.717353 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.717442 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.717535 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.717622 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.717707 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.717791 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.717885 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.717995 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.718178 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.718276 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.718362 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.718362 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.718604 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.718916 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.719043 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.719223 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.719522 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.719660 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.719824 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.719920 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.720168 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.720366 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.720477 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.720620 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.720799 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.720902 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.721131 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.721224 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.721446 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.721553 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.721761 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.721862 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.722099 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.722198 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.722437 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.722541 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.722753 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.722848 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.723063 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.723163 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.723383 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.723479 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.723709 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.723802 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.724015 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.724116 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.724851 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.725010 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.725174 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.725268 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.725480 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.725575 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.725788 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.725884 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.726140 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.726249 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.726454 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.726559 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.726758 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.726904 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.727052 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.727165 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.727356 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.727465 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.727679 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.727772 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.727989 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.728082 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.728312 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.728420 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.728623 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.728715 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.728926 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.729019 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.729230 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.729336 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.729531 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.729625 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.729852 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.729947 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.730185 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.730291 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.730510 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.730607 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.730822 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.730917 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.731131 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.731233 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.731440 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.731542 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.731746 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.731848 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.732061 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.732156 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.732378 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.732471 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.732695 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.732797 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.733006 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.733100 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.733318 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.733426 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.733629 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.733731 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.733946 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.734116 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.734295 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.734397 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.734610 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.734719 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.734931 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.735161 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.735254 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.735491 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.735592 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.735810 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.735910 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.736125 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.736220 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.736439 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.736541 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.736755 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.736850 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.737070 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.737343 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.737545 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.737654 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.737748 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.737944 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.738160 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.738307 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.738409 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.738622 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.738726 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.738939 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.739034 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.739259 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.739352 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.739578 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.739702 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.739920 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.740021 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.740234 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.740345 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.740547 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.740641 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.740862 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.740984 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.741185 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.741318 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.741514 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.741637 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.741819 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.742160 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.742486 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.742639 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.742803 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.742971 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.743122 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.743296 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.743433 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.743619 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.743753 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.743935 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.744071 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.744387 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.744699 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.745015 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.745118 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.745467 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.745787 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.746141 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.746370 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.746478 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.746757 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.746855 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.747095 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.747214 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.747417 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.747520 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.747741 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.747836 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.748060 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.748162 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.748372 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.748467 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.748698 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.749024 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.749131 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.749345 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.749443 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.749676 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.749773 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.750114 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.750237 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.750448 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.750559 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.750775 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.750871 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.751100 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.751209 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.751422 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.751518 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.751743 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.751952 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.752064 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.752331 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.752468 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.752606 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.752746 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.752939 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.753068 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.753268 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.753404 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.753588 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.753732 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.753914 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.754139 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.754274 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.754478 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.754581 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.754800 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.754910 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.755191 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.755348 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.755535 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.755737 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.755833 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.756069 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.756160 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.756428 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.756529 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.756734 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.756831 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.757187 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.757297 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.757374 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.757472 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.757960 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.758089 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.758177 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.758398 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.758493 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.758672 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.758764 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.758970 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.759078 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.759262 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.759355 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.759577 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.759676 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.759976 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.760095 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.760372 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.760476 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.760551 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.760910 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.761031 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.761116 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.761196 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.761447 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.761542 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.761722 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.761829 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.762046 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.762144 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.762330 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.762446 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.762611 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.762719 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.762972 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.763066 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.763249 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.763349 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.763541 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.763633 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.763836 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.763943 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.764151 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.764249 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.764467 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.764572 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.764782 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.764879 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.765089 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.765184 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.765395 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.765491 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.765703 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.766036 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.766155 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.766354 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.766475 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.766717 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.766824 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.766999 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.767099 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.767442 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.767551 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.767627 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.767719 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.768196 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.768299 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.768384 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.768458 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.768536 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.768616 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.768926 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.769121 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.769221 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.769297 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.769499 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.769591 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.769777 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.769878 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.770117 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.770523 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.770743 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.770840 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.771575 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.771824 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.771930 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.772173 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.772270 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.772506 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.772611 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.772935 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.773024 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.773201 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.773365 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.773522 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.773684 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.773847 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.774045 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.774143 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.774379 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.774490 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.774692 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.774798 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.775004 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.775110 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.775310 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.775408 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.775639 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.775758 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.776015 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.776122 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.776300 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.776399 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.776591 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.776701 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.776965 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.777074 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.777252 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.777528 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.777628 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.777703 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.778090 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.778209 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.778550 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.778646 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.778722 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.778792 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.778870 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.778942 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.779313 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.779477 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.779635 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.779791 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.779950 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.780098 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.780254 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.780434 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.780785 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.780937 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.781092 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.781339 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.781505 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.781654 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.781802 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.781949 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.782291 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.782454 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.782613 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.782613 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.782613 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.783135 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.783135 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.783437 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.789219 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.789219 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.789219 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.789785 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.789944 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.790179 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.790354 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.790506 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.790698 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.790852 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.791008 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.791183 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.791354 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.791507 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.791665 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.791665 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.791959 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.792117 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.792275 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.792424 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.792571 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.792770 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.792770 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.792770 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.792770 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.792770 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.792770 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.792770 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.792770 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.794043 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.794043 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.794043 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.794043 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.794043 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.794043 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.794043 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.798152 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.798332 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.798504 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.798673 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.798836 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.798988 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.798988 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.799325 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.799482 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.799640 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.799797 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.799947 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.800104 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.800275 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.800426 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.800426 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.800717 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.800865 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.801021 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.801178 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.801335 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.801506 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.801656 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.801803 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.801952 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.802124 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.802286 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.802484 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.802645 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.802802 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.802951 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.803099 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.803257 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.803406 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.803561 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.803718 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.803875 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.804024 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.804191 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.804342 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.804490 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.804638 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.804785 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.804958 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.804958 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.804958 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.804958 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.804958 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.804958 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.804958 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.804958 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.806188 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.806188 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.806469 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.806628 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.806791 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.806940 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.807088 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.807235 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.807385 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.807541 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.807700 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.807857 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.807857 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.808157 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.808306 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.808464 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.808635 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.808793 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.808949 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.809098 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.809246 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.809449 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.809604 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.809760 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.809908 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.810140 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.810293 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.810456 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.810608 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.810757 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.810904 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.812677 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.812850 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.812850 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.813158 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.813316 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.813476 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.813635 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.813816 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.813994 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.814164 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.814324 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.814473 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.814622 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.814789 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.814940 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.815097 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.815254 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.815410 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.815560 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.815734 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.815897 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.816054 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.816212 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.816361 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.816516 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.816679 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.816829 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.816984 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.817133 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.817281 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.817438 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.817595 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.817755 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.817905 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.818606 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.818606 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 23 01:09:34.818913 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.818913 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.818913 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.818913 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.818913 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.818913 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.818913 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.818913 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.820110 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.820110 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.820110 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.820110 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.820110 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.820110 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.820110 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.820110 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.821249 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.821249 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.821249 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.821249 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.821249 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.821249 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.821249 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.821249 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.823057 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.823057 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.823057 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.823057 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.823057 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.823057 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.823057 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.824056 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.824056 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:09:34.824056 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 23 01:09:34.875306 n-d-master-1 devstack@n-api.service[120944]: INFO dbcounter [None req-8691664d-1376-4c98-87fa-cf4f3001a16d None None] Registered counter for database nova_api Oct 23 01:09:34.886980 n-d-master-1 devstack@n-api.service[120945]: INFO dbcounter [None req-cbd738e5-30f6-487a-861e-6e8110ed9ba6 None None] Registered counter for database nova_api Oct 23 01:09:34.897574 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_db.sqlalchemy.engines [None req-8691664d-1376-4c98-87fa-cf4f3001a16d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120944) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 01:09:34.904730 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writer thread running {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 01:09:34.907517 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_db.sqlalchemy.engines [None req-cbd738e5-30f6-487a-861e-6e8110ed9ba6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120945) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 01:09:34.914592 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writer thread running {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 01:09:34.964586 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.context [None req-8691664d-1376-4c98-87fa-cf4f3001a16d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8efa99f7-1ff1-40c2-a97e-acbc153fb79d(cell1) {{(pid=120944) load_cells /opt/stack/nova/nova/context.py:464}} Oct 23 01:09:34.968709 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8691664d-1376-4c98-87fa-cf4f3001a16d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:09:34.969186 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8691664d-1376-4c98-87fa-cf4f3001a16d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:09:34.970795 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8691664d-1376-4c98-87fa-cf4f3001a16d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:09:34.971511 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8691664d-1376-4c98-87fa-cf4f3001a16d None None] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:09:34.971961 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8691664d-1376-4c98-87fa-cf4f3001a16d None None] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:09:34.974073 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8691664d-1376-4c98-87fa-cf4f3001a16d None None] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:09:34.974505 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.context [None req-cbd738e5-30f6-487a-861e-6e8110ed9ba6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8efa99f7-1ff1-40c2-a97e-acbc153fb79d(cell1) {{(pid=120945) load_cells /opt/stack/nova/nova/context.py:464}} Oct 23 01:09:34.976151 n-d-master-1 devstack@n-api.service[120944]: INFO dbcounter [None req-8691664d-1376-4c98-87fa-cf4f3001a16d None None] Registered counter for database nova_cell0 Oct 23 01:09:34.978714 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cbd738e5-30f6-487a-861e-6e8110ed9ba6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:09:34.979140 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cbd738e5-30f6-487a-861e-6e8110ed9ba6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:09:34.980532 n-d-master-1 devstack@n-api.service[120944]: INFO dbcounter [None req-8691664d-1376-4c98-87fa-cf4f3001a16d None None] Registered counter for database nova_cell1 Oct 23 01:09:34.980831 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cbd738e5-30f6-487a-861e-6e8110ed9ba6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:09:34.981757 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cbd738e5-30f6-487a-861e-6e8110ed9ba6 None None] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:09:34.982251 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cbd738e5-30f6-487a-861e-6e8110ed9ba6 None None] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:09:34.984545 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cbd738e5-30f6-487a-861e-6e8110ed9ba6 None None] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:09:34.986798 n-d-master-1 devstack@n-api.service[120945]: INFO dbcounter [None req-cbd738e5-30f6-487a-861e-6e8110ed9ba6 None None] Registered counter for database nova_cell0 Oct 23 01:09:34.988092 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_db.sqlalchemy.engines [None req-8691664d-1376-4c98-87fa-cf4f3001a16d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120944) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 01:09:34.989879 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_db.sqlalchemy.engines [None req-8691664d-1376-4c98-87fa-cf4f3001a16d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120944) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 01:09:34.991282 n-d-master-1 devstack@n-api.service[120945]: INFO dbcounter [None req-cbd738e5-30f6-487a-861e-6e8110ed9ba6 None None] Registered counter for database nova_cell1 Oct 23 01:09:34.995905 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writer thread running {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 01:09:34.998004 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writer thread running {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 01:09:34.999484 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_db.sqlalchemy.engines [None req-cbd738e5-30f6-487a-861e-6e8110ed9ba6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120945) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 01:09:35.000779 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_db.sqlalchemy.engines [None req-cbd738e5-30f6-487a-861e-6e8110ed9ba6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120945) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 01:09:35.009034 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writer thread running {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 01:09:35.009382 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writer thread running {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 01:09:35.153786 n-d-master-1 devstack@n-api.service[120944]: INFO dbcounter [None req-8691664d-1376-4c98-87fa-cf4f3001a16d None None] Registered counter for database nova_cell0 Oct 23 01:09:35.160811 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_db.sqlalchemy.engines [None req-8691664d-1376-4c98-87fa-cf4f3001a16d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120944) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 01:09:35.165528 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writer thread running {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 01:09:35.189313 n-d-master-1 devstack@n-api.service[120945]: INFO dbcounter [None req-cbd738e5-30f6-487a-861e-6e8110ed9ba6 None None] Registered counter for database nova_cell0 Oct 23 01:09:35.197041 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_db.sqlalchemy.engines [None req-cbd738e5-30f6-487a-861e-6e8110ed9ba6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120945) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 01:09:35.201732 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writer thread running {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 01:09:35.492618 n-d-master-1 devstack@n-api.service[120944]: WARNING keystonemiddleware.auth_token [None req-8691664d-1376-4c98-87fa-cf4f3001a16d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 23 01:09:35.499842 n-d-master-1 devstack@n-api.service[120944]: WARNING keystonemiddleware.auth_token [None req-8691664d-1376-4c98-87fa-cf4f3001a16d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 23 01:09:35.525334 n-d-master-1 devstack@n-api.service[120945]: WARNING keystonemiddleware.auth_token [None req-cbd738e5-30f6-487a-861e-6e8110ed9ba6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 23 01:09:35.532643 n-d-master-1 devstack@n-api.service[120945]: WARNING keystonemiddleware.auth_token [None req-cbd738e5-30f6-487a-861e-6e8110ed9ba6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 23 01:09:35.842298 n-d-master-1 devstack@n-api.service[120944]: WARNING keystonemiddleware.auth_token [None req-8691664d-1376-4c98-87fa-cf4f3001a16d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 23 01:09:35.848327 n-d-master-1 devstack@n-api.service[120944]: WARNING keystonemiddleware.auth_token [None req-8691664d-1376-4c98-87fa-cf4f3001a16d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 23 01:09:35.854114 n-d-master-1 devstack@n-api.service[120944]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556860aaa9c0 pid: 120944 (default app) Oct 23 01:09:35.878848 n-d-master-1 devstack@n-api.service[120945]: WARNING keystonemiddleware.auth_token [None req-cbd738e5-30f6-487a-861e-6e8110ed9ba6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 23 01:09:35.884928 n-d-master-1 devstack@n-api.service[120945]: WARNING keystonemiddleware.auth_token [None req-cbd738e5-30f6-487a-861e-6e8110ed9ba6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 23 01:09:35.890250 n-d-master-1 devstack@n-api.service[120945]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556860aaa9c0 pid: 120945 (default app) Oct 23 01:10:16.711337 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=3 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:16.712260 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=3 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:16.713191 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=3 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:16.713926 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=3 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:18.006368 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-67d1a9d2-47e2-4a90-bed2-9a98f08869d3 tempest-FlavorsExtraSpecsTestJSON-719717567 tempest-FlavorsExtraSpecsTestJSON-719717567-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1427036441", "ram": 512, "vcpus": 1, "disk": 10, "id": 1269829048, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:18.040957 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=3 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:18.042650 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=3 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:18.043548 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=3 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:18.044932 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=3 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:18.127324 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-67d1a9d2-47e2-4a90-bed2-9a98f08869d3 tempest-FlavorsExtraSpecsTestJSON-719717567 tempest-FlavorsExtraSpecsTestJSON-719717567-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 1.421921 Oct 23 01:10:18.128492 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1/1] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:10:16 2022] POST /compute/v2.1/flavors => generated 416 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:10:18.143978 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-51e72ac3-1db1-463f-97e8-b2cb9b047f7f tempest-FlavorsExtraSpecsTestJSON-719717567 tempest-FlavorsExtraSpecsTestJSON-719717567-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:18.371566 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-51e72ac3-1db1-463f-97e8-b2cb9b047f7f tempest-FlavorsExtraSpecsTestJSON-719717567 tempest-FlavorsExtraSpecsTestJSON-719717567-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors/1269829048/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.120261 Oct 23 01:10:18.371566 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2/2] 10.222.0.42 () {60 vars in 1224 bytes} [Sun Oct 23 01:10:18 2022] POST /compute/v2.1/flavors/1269829048/os-extra_specs => generated 66 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:10:18.700174 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c5ec7972-9ec6-4fa0-835b-a997afec2332 tempest-FlavorsExtraSpecsTestJSON-1953165681 tempest-FlavorsExtraSpecsTestJSON-1953165681-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:18.724207 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c5ec7972-9ec6-4fa0-835b-a997afec2332 tempest-FlavorsExtraSpecsTestJSON-1953165681 tempest-FlavorsExtraSpecsTestJSON-1953165681-project] 10.222.0.42 "GET /compute/v2.1/flavors/1269829048/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.457561 Oct 23 01:10:18.730886 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3/3] 10.222.0.42 () {58 vars in 1203 bytes} [Sun Oct 23 01:10:18 2022] GET /compute/v2.1/flavors/1269829048/os-extra_specs => generated 66 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 23 01:10:18.915381 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4f0206a6-6a22-4bf8-8551-3e6df3e24785 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:18.919345 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f0206a6-6a22-4bf8-8551-3e6df3e24785 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:18.919864 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f0206a6-6a22-4bf8-8551-3e6df3e24785 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:18.920299 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f0206a6-6a22-4bf8-8551-3e6df3e24785 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:18.921018 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f0206a6-6a22-4bf8-8551-3e6df3e24785 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:18.921471 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f0206a6-6a22-4bf8-8551-3e6df3e24785 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:18.921892 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f0206a6-6a22-4bf8-8551-3e6df3e24785 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:18.981546 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4f0206a6-6a22-4bf8-8551-3e6df3e24785 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.249398 Oct 23 01:10:18.982146 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4/4] 10.222.0.42 () {58 vars in 1176 bytes} [Sun Oct 23 01:10:18 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:10:19.090439 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-792021f7-08ca-45a2-a837-255dd5dc4900 tempest-FlavorMetadataValidation-662625272 tempest-FlavorMetadataValidation-662625272-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1043836448", "id": 1576329284, "os-flavor-access:is_public": "True"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:19.131870 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-213ad33f-eba8-42d3-bd18-a27e27983f0f tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Calling method '.version_select at 0x7f5cc3a02f70>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:19.138634 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-213ad33f-eba8-42d3-bd18-a27e27983f0f tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8efa99f7-1ff1-40c2-a97e-acbc153fb79d(cell1) {{(pid=120945) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 23 01:10:19.139388 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-213ad33f-eba8-42d3-bd18-a27e27983f0f tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:19.139998 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-213ad33f-eba8-42d3-bd18-a27e27983f0f tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:19.140397 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-213ad33f-eba8-42d3-bd18-a27e27983f0f tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:19.166101 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-213ad33f-eba8-42d3-bd18-a27e27983f0f tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:19.166572 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-213ad33f-eba8-42d3-bd18-a27e27983f0f tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:19.167004 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-213ad33f-eba8-42d3-bd18-a27e27983f0f tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:19.179362 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-213ad33f-eba8-42d3-bd18-a27e27983f0f tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:19.179827 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-213ad33f-eba8-42d3-bd18-a27e27983f0f tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:19.180925 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-213ad33f-eba8-42d3-bd18-a27e27983f0f tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:19.186338 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-792021f7-08ca-45a2-a837-255dd5dc4900 tempest-FlavorMetadataValidation-662625272 tempest-FlavorMetadataValidation-662625272-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.203007 Oct 23 01:10:19.186562 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-213ad33f-eba8-42d3-bd18-a27e27983f0f tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 1.155174 Oct 23 01:10:19.197083 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 5/5] 10.222.0.42 () {62 vars in 1188 bytes} [Sun Oct 23 01:10:18 2022] POST /compute/v2.1/flavors => generated 471 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:10:19.197205 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1/6] 10.222.0.42 () {58 vars in 1167 bytes} [Sun Oct 23 01:10:18 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:10:19.353508 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bbd67e8f-d55c-4dd1-8dba-7a4ae0688be6 tempest-AggregatesAdminTestV241-117911304 tempest-AggregatesAdminTestV241-117911304-project-admin] Calling method '.version_select at 0x7f5cc385de50>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:19.365824 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bbd67e8f-d55c-4dd1-8dba-7a4ae0688be6 tempest-AggregatesAdminTestV241-117911304 tempest-AggregatesAdminTestV241-117911304-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8efa99f7-1ff1-40c2-a97e-acbc153fb79d(cell1) {{(pid=120944) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 23 01:10:19.366735 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bbd67e8f-d55c-4dd1-8dba-7a4ae0688be6 tempest-AggregatesAdminTestV241-117911304 tempest-AggregatesAdminTestV241-117911304-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:19.367214 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bbd67e8f-d55c-4dd1-8dba-7a4ae0688be6 tempest-AggregatesAdminTestV241-117911304 tempest-AggregatesAdminTestV241-117911304-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:19.367642 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bbd67e8f-d55c-4dd1-8dba-7a4ae0688be6 tempest-AggregatesAdminTestV241-117911304 tempest-AggregatesAdminTestV241-117911304-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:19.394260 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bbd67e8f-d55c-4dd1-8dba-7a4ae0688be6 tempest-AggregatesAdminTestV241-117911304 tempest-AggregatesAdminTestV241-117911304-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:19.394752 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bbd67e8f-d55c-4dd1-8dba-7a4ae0688be6 tempest-AggregatesAdminTestV241-117911304 tempest-AggregatesAdminTestV241-117911304-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:19.395339 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bbd67e8f-d55c-4dd1-8dba-7a4ae0688be6 tempest-AggregatesAdminTestV241-117911304 tempest-AggregatesAdminTestV241-117911304-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:19.407086 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-75c203d1-5a9b-4551-8558-00967332e42b tempest-HostsAdminNegativeTestJSON-2064242850 tempest-HostsAdminNegativeTestJSON-2064242850-project-admin] Calling method '.version_select at 0x7f5cc3a26430>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:19.408393 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bbd67e8f-d55c-4dd1-8dba-7a4ae0688be6 tempest-AggregatesAdminTestV241-117911304 tempest-AggregatesAdminTestV241-117911304-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:19.408919 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bbd67e8f-d55c-4dd1-8dba-7a4ae0688be6 tempest-AggregatesAdminTestV241-117911304 tempest-AggregatesAdminTestV241-117911304-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:19.409354 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bbd67e8f-d55c-4dd1-8dba-7a4ae0688be6 tempest-AggregatesAdminTestV241-117911304 tempest-AggregatesAdminTestV241-117911304-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:19.412142 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-75c203d1-5a9b-4551-8558-00967332e42b tempest-HostsAdminNegativeTestJSON-2064242850 tempest-HostsAdminNegativeTestJSON-2064242850-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:19.412631 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-75c203d1-5a9b-4551-8558-00967332e42b tempest-HostsAdminNegativeTestJSON-2064242850 tempest-HostsAdminNegativeTestJSON-2064242850-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:19.413065 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-75c203d1-5a9b-4551-8558-00967332e42b tempest-HostsAdminNegativeTestJSON-2064242850 tempest-HostsAdminNegativeTestJSON-2064242850-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:19.413789 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-75c203d1-5a9b-4551-8558-00967332e42b tempest-HostsAdminNegativeTestJSON-2064242850 tempest-HostsAdminNegativeTestJSON-2064242850-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:19.414259 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-75c203d1-5a9b-4551-8558-00967332e42b tempest-HostsAdminNegativeTestJSON-2064242850 tempest-HostsAdminNegativeTestJSON-2064242850-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:19.414839 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-75c203d1-5a9b-4551-8558-00967332e42b tempest-HostsAdminNegativeTestJSON-2064242850 tempest-HostsAdminNegativeTestJSON-2064242850-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:19.415881 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bbd67e8f-d55c-4dd1-8dba-7a4ae0688be6 tempest-AggregatesAdminTestV241-117911304 tempest-AggregatesAdminTestV241-117911304-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.227855 Oct 23 01:10:19.416443 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 6/7] 10.222.0.42 () {60 vars in 1208 bytes} [Sun Oct 23 01:10:19 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:10:19.423092 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-de7d0f38-f51d-4a69-a774-1930ffc220e8 tempest-FlavorsExtraSpecsTestJSON-719717567 tempest-FlavorsExtraSpecsTestJSON-719717567-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:19.447481 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-de7d0f38-f51d-4a69-a774-1930ffc220e8 tempest-FlavorsExtraSpecsTestJSON-719717567 tempest-FlavorsExtraSpecsTestJSON-719717567-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors/1269829048/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.028534 Oct 23 01:10:19.448447 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 7/8] 10.222.0.42 () {60 vars in 1224 bytes} [Sun Oct 23 01:10:19 2022] POST /compute/v2.1/flavors/1269829048/os-extra_specs => generated 66 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:10:19.463519 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-75c203d1-5a9b-4551-8558-00967332e42b tempest-HostsAdminNegativeTestJSON-2064242850 tempest-HostsAdminNegativeTestJSON-2064242850-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.275197 Oct 23 01:10:19.464320 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2/9] 10.222.0.42 () {58 vars in 1128 bytes} [Sun Oct 23 01:10:19 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:10:19.468799 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9f51d016-cefb-46d2-8156-e8ef9d18f072 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1630022566"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:19.489131 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.aggregate [None req-9f51d016-cefb-46d2-8156-e8ef9d18f072 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Generated uuid 8dc4e145-be2f-4733-8b9f-317b6cf48595 for aggregate {{(pid=120945) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 23 01:10:19.565325 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b89be87f-fc44-4f82-9b2e-18f7be30ad78 tempest-AZAdminV2TestJSON-1438004053 tempest-AZAdminV2TestJSON-1438004053-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:19.567086 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b89be87f-fc44-4f82-9b2e-18f7be30ad78 tempest-AZAdminV2TestJSON-1438004053 tempest-AZAdminV2TestJSON-1438004053-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:19.567866 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b89be87f-fc44-4f82-9b2e-18f7be30ad78 tempest-AZAdminV2TestJSON-1438004053 tempest-AZAdminV2TestJSON-1438004053-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:19.568300 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b89be87f-fc44-4f82-9b2e-18f7be30ad78 tempest-AZAdminV2TestJSON-1438004053 tempest-AZAdminV2TestJSON-1438004053-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:19.569026 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b89be87f-fc44-4f82-9b2e-18f7be30ad78 tempest-AZAdminV2TestJSON-1438004053 tempest-AZAdminV2TestJSON-1438004053-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:19.569482 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b89be87f-fc44-4f82-9b2e-18f7be30ad78 tempest-AZAdminV2TestJSON-1438004053 tempest-AZAdminV2TestJSON-1438004053-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:19.569906 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b89be87f-fc44-4f82-9b2e-18f7be30ad78 tempest-AZAdminV2TestJSON-1438004053 tempest-AZAdminV2TestJSON-1438004053-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:19.593319 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b89be87f-fc44-4f82-9b2e-18f7be30ad78 tempest-AZAdminV2TestJSON-1438004053 tempest-AZAdminV2TestJSON-1438004053-project-admin] 10.222.0.42 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.143501 Oct 23 01:10:19.593894 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 8/10] 10.222.0.42 () {58 vars in 1164 bytes} [Sun Oct 23 01:10:19 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:10:19.598938 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2698eb50-1a74-441e-b3b5-58aafa44aaf0 tempest-FlavorMetadataValidation-662625272 tempest-FlavorMetadataValidation-662625272-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:19.628548 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9f51d016-cefb-46d2-8156-e8ef9d18f072 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.163064 Oct 23 01:10:19.629263 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3/11] 10.222.0.42 () {60 vars in 1164 bytes} [Sun Oct 23 01:10:19 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:10:19.636302 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4fb443f3-b1f5-42d3-ab5f-6c0310a8f20d tempest-FlavorsExtraSpecsTestJSON-1953165681 tempest-FlavorsExtraSpecsTestJSON-1953165681-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:19.669921 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4fb443f3-b1f5-42d3-ab5f-6c0310a8f20d tempest-FlavorsExtraSpecsTestJSON-1953165681 tempest-FlavorsExtraSpecsTestJSON-1953165681-project] 10.222.0.42 "GET /compute/v2.1/flavors/1269829048/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.038570 Oct 23 01:10:19.670691 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4/12] 10.222.0.42 () {58 vars in 1245 bytes} [Sun Oct 23 01:10:19 2022] GET /compute/v2.1/flavors/1269829048/os-extra_specs/hw:numa_nodes => generated 22 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:10:19.830212 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7e9858e7-ac51-45bd-b34f-0508315ece2b tempest-HostsAdminNegativeTestJSON-975942463 tempest-HostsAdminNegativeTestJSON-975942463-project] Calling method '.version_select at 0x7f5cc381c550>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:19.834528 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7e9858e7-ac51-45bd-b34f-0508315ece2b tempest-HostsAdminNegativeTestJSON-975942463 tempest-HostsAdminNegativeTestJSON-975942463-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '49264f1d1b5d40269c7a6853c702917f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b095d4940ef84515aaa3c6e0e4a07538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:10:19.838360 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7e9858e7-ac51-45bd-b34f-0508315ece2b tempest-HostsAdminNegativeTestJSON-975942463 tempest-HostsAdminNegativeTestJSON-975942463-project] Request method failure captured: Oct 23 01:10:19.838360 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 23 01:10:19.838360 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:10:19.838360 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:10:19.838360 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:10:19.838360 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:10:19.838360 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:10:19.838360 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:10:19.838360 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:10:19.838360 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:10:19.838360 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJR33WNzHitCGWLeZUuYvoVCyAJAPGMASGp5pZhBZUSUP0xcCIfjAdGjrbPKqBpSoDMw9AiBj2Ttk45sbosyagjn-nsi59PaISh3I5UxS_bo2f0Xn0jXOYBGTVe1D7ziB0qKF8fXdIEsJ0kJr3K8i9mbIHeaCbHznvAAbAZ-LeX6g74 Oct 23 01:10:19.838360 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:10:19.838360 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:10:19.838360 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:10:19.838360 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:10:19.838360 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:10:19.838360 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:10:19.838360 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: b095d4940ef84515aaa3c6e0e4a07538 Oct 23 01:10:19.838360 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-975942463 Oct 23 01:10:19.838360 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:10:19.838360 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:10:19.839465 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b095d4940ef84515aaa3c6e0e4a07538"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b095d4940ef84515aaa3c6e0e4a07538"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b095d4940ef84515aaa3c6e0e4a07538"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b095d4940ef84515aaa3c6e0e4a07538"}]}] Oct 23 01:10:19.839465 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-HostsAdminNegativeTestJSON-975942463 Oct 23 01:10:19.839465 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: b095d4940ef84515aaa3c6e0e4a07538 Oct 23 01:10:19.839465 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-975942463 Oct 23 01:10:19.839465 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-HostsAdminNegativeTestJSON-975942463-project Oct 23 01:10:19.839465 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:10:19.839465 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:10:19.839465 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 49264f1d1b5d40269c7a6853c702917f Oct 23 01:10:19.839465 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-HostsAdminNegativeTestJSON-975942463-project Oct 23 01:10:19.839465 n-d-master-1 devstack@n-api.service[120945]: method: Oct 23 01:10:19.839465 n-d-master-1 devstack@n-api.service[120945]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 23 01:10:19.839465 n-d-master-1 devstack@n-api.service[120945]: action_args: {} Oct 23 01:10:19.839465 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:10:19.840120 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:19.840120 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:19.840120 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:19.840120 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:10:19.840120 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:10:19.840120 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:10:19.840120 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:10:19.840120 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 23 01:10:19.840120 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:10:19.840120 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:10:19.840120 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:10:19.840120 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 23 01:10:19.840120 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 23 01:10:19.840120 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 23 01:10:19.840120 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 23 01:10:19.840120 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 23 01:10:19.840120 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 23 01:10:19.840120 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:10:19.840120 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 23 01:10:19.841331 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:10:19.841331 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise self.value Oct 23 01:10:19.841331 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 23 01:10:19.841331 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 23 01:10:19.841331 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 23 01:10:19.841331 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 23 01:10:19.841331 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 23 01:10:19.841331 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 23 01:10:19.841331 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 23 01:10:19.841331 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:19.841331 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:19.841331 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:19.841331 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:19.841331 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:19.841331 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:19.841331 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 23 01:10:19.841331 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 23 01:10:19.841331 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 23 01:10:19.841331 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:19.842327 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7e9858e7-ac51-45bd-b34f-0508315ece2b tempest-HostsAdminNegativeTestJSON-975942463 tempest-HostsAdminNegativeTestJSON-975942463-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:10:19.842327 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7e9858e7-ac51-45bd-b34f-0508315ece2b tempest-HostsAdminNegativeTestJSON-975942463 tempest-HostsAdminNegativeTestJSON-975942463-project] 10.222.0.42 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.167902 Oct 23 01:10:19.842327 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 5/13] 10.222.0.42 () {58 vars in 1128 bytes} [Sun Oct 23 01:10:19 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 169 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:10:19.844344 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2fd97764-f837-442f-973a-9bb3af8ae694 tempest-AZAdminV2TestJSON-1438004053 tempest-AZAdminV2TestJSON-1438004053-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:19.846544 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2fd97764-f837-442f-973a-9bb3af8ae694 tempest-AZAdminV2TestJSON-1438004053 tempest-AZAdminV2TestJSON-1438004053-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:19.847026 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2fd97764-f837-442f-973a-9bb3af8ae694 tempest-AZAdminV2TestJSON-1438004053 tempest-AZAdminV2TestJSON-1438004053-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:19.847458 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2fd97764-f837-442f-973a-9bb3af8ae694 tempest-AZAdminV2TestJSON-1438004053 tempest-AZAdminV2TestJSON-1438004053-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:19.848175 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2fd97764-f837-442f-973a-9bb3af8ae694 tempest-AZAdminV2TestJSON-1438004053 tempest-AZAdminV2TestJSON-1438004053-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:19.848625 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2fd97764-f837-442f-973a-9bb3af8ae694 tempest-AZAdminV2TestJSON-1438004053 tempest-AZAdminV2TestJSON-1438004053-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:19.849043 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2fd97764-f837-442f-973a-9bb3af8ae694 tempest-AZAdminV2TestJSON-1438004053 tempest-AZAdminV2TestJSON-1438004053-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:19.858095 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2698eb50-1a74-441e-b3b5-58aafa44aaf0 tempest-FlavorMetadataValidation-662625272 tempest-FlavorMetadataValidation-662625272-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors/1576329284/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.263113 Oct 23 01:10:19.858707 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 9/14] 10.222.0.42 () {62 vars in 1265 bytes} [Sun Oct 23 01:10:19 2022] POST /compute/v2.1/flavors/1576329284/os-extra_specs => generated 62 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:10:19.864183 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-478b980f-a8bd-4d9f-a857-06593a0efb4e tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:19.879559 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2fd97764-f837-442f-973a-9bb3af8ae694 tempest-AZAdminV2TestJSON-1438004053 tempest-AZAdminV2TestJSON-1438004053-project-admin] 10.222.0.42 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.038233 Oct 23 01:10:19.880368 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 6/15] 10.222.0.42 () {58 vars in 1185 bytes} [Sun Oct 23 01:10:19 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:10:19.884700 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6bd4f902-0863-480c-9656-70f348dcd727 tempest-FlavorsExtraSpecsTestJSON-719717567 tempest-FlavorsExtraSpecsTestJSON-719717567-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:19.894908 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-478b980f-a8bd-4d9f-a857-06593a0efb4e tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:19.895398 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-478b980f-a8bd-4d9f-a857-06593a0efb4e tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:19.895830 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-478b980f-a8bd-4d9f-a857-06593a0efb4e tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:19.928089 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6bd4f902-0863-480c-9656-70f348dcd727 tempest-FlavorsExtraSpecsTestJSON-719717567 tempest-FlavorsExtraSpecsTestJSON-719717567-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors/1269829048/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.046656 Oct 23 01:10:19.928677 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 7/16] 10.222.0.42 () {60 vars in 1224 bytes} [Sun Oct 23 01:10:19 2022] POST /compute/v2.1/flavors/1269829048/os-extra_specs => generated 66 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:10:20.040224 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-357524f9-1b41-4e31-8f55-b6760e74f167 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-525900238", "id": 1001100326, "os-flavor-access:is_public": "False"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:20.167320 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-357524f9-1b41-4e31-8f55-b6760e74f167 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.235756 Oct 23 01:10:20.167320 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 8/17] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:10:19 2022] POST /compute/v2.1/flavors => generated 438 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:10:20.170867 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1465b6a1-469f-4050-b7b0-aff8a7c27efa tempest-HostsAdminNegativeTestJSON-975942463 tempest-HostsAdminNegativeTestJSON-975942463-project] Calling method '.version_select at 0x7f5cc2f88ca0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:20.172729 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1465b6a1-469f-4050-b7b0-aff8a7c27efa tempest-HostsAdminNegativeTestJSON-975942463 tempest-HostsAdminNegativeTestJSON-975942463-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '49264f1d1b5d40269c7a6853c702917f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b095d4940ef84515aaa3c6e0e4a07538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:10:20.174873 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1465b6a1-469f-4050-b7b0-aff8a7c27efa tempest-HostsAdminNegativeTestJSON-975942463 tempest-HostsAdminNegativeTestJSON-975942463-project] Request method failure captured: Oct 23 01:10:20.174873 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/os-hosts/n-d-master-1/reboot HTTP/1.1 Oct 23 01:10:20.174873 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:10:20.174873 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:10:20.174873 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:10:20.174873 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:10:20.174873 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:10:20.174873 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:10:20.174873 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:10:20.174873 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:10:20.174873 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJR33WNzHitCGWLeZUuYvoVCyAJAPGMASGp5pZhBZUSUP0xcCIfjAdGjrbPKqBpSoDMw9AiBj2Ttk45sbosyagjn-nsi59PaISh3I5UxS_bo2f0Xn0jXOYBGTVe1D7ziB0qKF8fXdIEsJ0kJr3K8i9mbIHeaCbHznvAAbAZ-LeX6g74 Oct 23 01:10:20.174873 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:10:20.174873 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:10:20.174873 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:10:20.174873 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:10:20.174873 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:10:20.174873 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:10:20.174873 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: b095d4940ef84515aaa3c6e0e4a07538 Oct 23 01:10:20.174873 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-975942463 Oct 23 01:10:20.174873 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:10:20.174873 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:10:20.176017 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b095d4940ef84515aaa3c6e0e4a07538"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b095d4940ef84515aaa3c6e0e4a07538"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b095d4940ef84515aaa3c6e0e4a07538"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b095d4940ef84515aaa3c6e0e4a07538"}]}] Oct 23 01:10:20.176017 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-HostsAdminNegativeTestJSON-975942463 Oct 23 01:10:20.176017 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: b095d4940ef84515aaa3c6e0e4a07538 Oct 23 01:10:20.176017 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-975942463 Oct 23 01:10:20.176017 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-HostsAdminNegativeTestJSON-975942463-project Oct 23 01:10:20.176017 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:10:20.176017 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:10:20.176017 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 49264f1d1b5d40269c7a6853c702917f Oct 23 01:10:20.176017 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-HostsAdminNegativeTestJSON-975942463-project Oct 23 01:10:20.176017 n-d-master-1 devstack@n-api.service[120945]: method: Oct 23 01:10:20.176017 n-d-master-1 devstack@n-api.service[120945]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 23 01:10:20.176017 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'n-d-master-1'} Oct 23 01:10:20.176017 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:10:20.176724 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:20.176724 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:20.176724 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:20.176724 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:10:20.176724 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:10:20.176724 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:10:20.176724 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:10:20.176724 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:10:20.176724 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:10:20.176724 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 23 01:10:20.176724 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 23 01:10:20.176724 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 23 01:10:20.176724 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 23 01:10:20.176724 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 23 01:10:20.176724 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 23 01:10:20.176724 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:10:20.176724 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 23 01:10:20.176724 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:10:20.176724 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise self.value Oct 23 01:10:20.177715 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 23 01:10:20.177715 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 23 01:10:20.177715 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 23 01:10:20.177715 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 23 01:10:20.177715 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 23 01:10:20.177715 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 23 01:10:20.177715 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 23 01:10:20.177715 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:20.177715 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:20.177715 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:20.177715 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:20.177715 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:20.177715 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:20.177715 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 23 01:10:20.177715 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 23 01:10:20.177715 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 23 01:10:20.177715 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:20.178657 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1465b6a1-469f-4050-b7b0-aff8a7c27efa tempest-HostsAdminNegativeTestJSON-975942463 tempest-HostsAdminNegativeTestJSON-975942463-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:10:20.178657 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1465b6a1-469f-4050-b7b0-aff8a7c27efa tempest-HostsAdminNegativeTestJSON-975942463 tempest-HostsAdminNegativeTestJSON-975942463-project] 10.222.0.42 "GET /compute/v2.1/os-hosts/n-d-master-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.009215 Oct 23 01:10:20.178657 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 9/18] 10.222.0.42 () {58 vars in 1188 bytes} [Sun Oct 23 01:10:20 2022] GET /compute/v2.1/os-hosts/n-d-master-1/reboot => generated 111 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:10:20.181441 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0455ae08-75f2-4432-9ad7-7e3e88e00bad tempest-FlavorMetadataValidation-662625272 tempest-FlavorMetadataValidation-662625272-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:20.264682 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0455ae08-75f2-4432-9ad7-7e3e88e00bad tempest-FlavorMetadataValidation-662625272 tempest-FlavorMetadataValidation-662625272-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/1576329284" status: 202 len: 0 microversion: 2.86 time: 0.086766 Oct 23 01:10:20.265260 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 10/19] 10.222.0.42 () {60 vars in 1202 bytes} [Sun Oct 23 01:10:20 2022] DELETE /compute/v2.1/flavors/1576329284 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:10:20.269949 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0c401a9e-2003-45b2-b91d-b6750dfc65a4 tempest-FlavorsExtraSpecsTestJSON-719717567 tempest-FlavorsExtraSpecsTestJSON-719717567-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:20.278028 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0c401a9e-2003-45b2-b91d-b6750dfc65a4 tempest-FlavorsExtraSpecsTestJSON-719717567 tempest-FlavorsExtraSpecsTestJSON-719717567-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/1269829048/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.011746 Oct 23 01:10:20.278565 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 11/20] 10.222.0.42 () {58 vars in 1203 bytes} [Sun Oct 23 01:10:20 2022] GET /compute/v2.1/flavors/1269829048/os-extra_specs => generated 66 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:10:20.282759 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4fe01652-b7fc-4c6c-a4c4-8cc3b5c81ce2 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "cb2839bbedf643289a251019d9e79fc8"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:20.349872 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-478b980f-a8bd-4d9f-a857-06593a0efb4e tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 242 microversion: 2.1 time: 0.489227 Oct 23 01:10:20.350557 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 10/21] 10.222.0.42 () {60 vars in 1191 bytes} [Sun Oct 23 01:10:19 2022] POST /compute/v2.1/os-aggregates/1/action => generated 242 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:10:20.362768 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4792b853-f624-4dd3-807b-4d6fe879e7da tempest-HostsAdminNegativeTestJSON-2064242850 tempest-HostsAdminNegativeTestJSON-2064242850-project-admin] Calling method '.version_select at 0x7f5cc37a9a60>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:20.381389 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-4792b853-f624-4dd3-807b-4d6fe879e7da tempest-HostsAdminNegativeTestJSON-2064242850 tempest-HostsAdminNegativeTestJSON-2064242850-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 23 01:10:20.388781 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4792b853-f624-4dd3-807b-4d6fe879e7da tempest-HostsAdminNegativeTestJSON-2064242850 tempest-HostsAdminNegativeTestJSON-2064242850-project-admin] Request method failure captured: Oct 23 01:10:20.388781 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 23 01:10:20.388781 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:10:20.388781 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:10:20.388781 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:10:20.388781 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:10:20.388781 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:10:20.388781 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:10:20.388781 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:10:20.388781 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:10:20.388781 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJR6rCO4RAQtmAaMYg5W_BMbxElf_L8ZdjHlaY6BSuALiR62TdDQervkGoWWiemTVz2KZEYiMnbbIT2i-fnCJlSbeOlZ-tLbqbX4Q3xK0K_e25xn276wsKPaHVbKu022KNmjEEC20r0l3ZB7lIJ0SyOK0YRtr89I4_GzvD7bu0_0qM8 Oct 23 01:10:20.388781 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:10:20.388781 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:10:20.388781 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:10:20.388781 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:10:20.388781 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:10:20.388781 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:10:20.388781 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 9dec106b1fee4cbaaf8052b1374d8192 Oct 23 01:10:20.388781 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2064242850 Oct 23 01:10:20.388781 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,admin,reader Oct 23 01:10:20.388781 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,admin,reader Oct 23 01:10:20.390188 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9dec106b1fee4cbaaf8052b1374d8192"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9dec106b1fee4cbaaf8052b1374d8192"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9dec106b1fee4cbaaf8052b1374d8192"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9dec106b1fee4cbaaf8052b1374d8192"}]}] Oct 23 01:10:20.390188 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2064242850 Oct 23 01:10:20.390188 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 9dec106b1fee4cbaaf8052b1374d8192 Oct 23 01:10:20.390188 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2064242850 Oct 23 01:10:20.390188 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-HostsAdminNegativeTestJSON-2064242850-project-admin Oct 23 01:10:20.390188 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:10:20.390188 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:10:20.390188 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: f0a177c2d5b747fa889814116e3050df Oct 23 01:10:20.390188 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2064242850-project-admin Oct 23 01:10:20.390188 n-d-master-1 devstack@n-api.service[120944]: method: Oct 23 01:10:20.390188 n-d-master-1 devstack@n-api.service[120944]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 23 01:10:20.390188 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'nonexistent_hostname'} Oct 23 01:10:20.390188 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:10:20.390811 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:20.390811 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 23 01:10:20.390811 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 23 01:10:20.390811 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 23 01:10:20.390811 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 23 01:10:20.390811 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:10:20.390811 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 23 01:10:20.390811 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:10:20.390811 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise self.value Oct 23 01:10:20.390811 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 23 01:10:20.390811 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 23 01:10:20.390811 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 23 01:10:20.390811 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 23 01:10:20.390811 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 01:10:20.390811 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 01:10:20.390811 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 23 01:10:20.390811 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 23 01:10:20.390811 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 23 01:10:20.390811 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 23 01:10:20.391668 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 23 01:10:20.391668 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 23 01:10:20.391668 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 23 01:10:20.391668 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:20.391668 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:20.391668 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:20.391668 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:20.391668 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:20.391668 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:20.391668 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:10:20.391668 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:10:20.391668 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:10:20.391668 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:10:20.391668 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:10:20.391668 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:10:20.391668 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 23 01:10:20.391668 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 23 01:10:20.391668 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 23 01:10:20.391668 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:10:20.393730 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 23 01:10:20.393730 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:20.393730 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:20.393730 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:20.393730 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:20.393730 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:20.393730 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:20.393730 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:10:20.393730 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:10:20.393730 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 23 01:10:20.393730 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:20.393730 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4792b853-f624-4dd3-807b-4d6fe879e7da tempest-HostsAdminNegativeTestJSON-2064242850 tempest-HostsAdminNegativeTestJSON-2064242850-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:10:20.393730 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4792b853-f624-4dd3-807b-4d6fe879e7da tempest-HostsAdminNegativeTestJSON-2064242850 tempest-HostsAdminNegativeTestJSON-2064242850-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.032657 Oct 23 01:10:20.393730 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 11/22] 10.222.0.42 () {58 vars in 1212 bytes} [Sun Oct 23 01:10:20 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:10:20.396889 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3ed69e5f-0637-4e39-bbf4-b238b46f2596 tempest-FlavorMetadataValidation-662625272 tempest-FlavorMetadataValidation-662625272-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:20.429722 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3ed69e5f-0637-4e39-bbf4-b238b46f2596 tempest-FlavorMetadataValidation-662625272 tempest-FlavorMetadataValidation-662625272-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 6270 microversion: 2.86 time: 0.036891 Oct 23 01:10:20.440787 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 12/23] 10.222.0.42 () {60 vars in 1187 bytes} [Sun Oct 23 01:10:20 2022] GET /compute/v2.1/flavors/detail => generated 6270 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:10:20.440787 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-25ddd2dc-5d79-4b1d-87d7-4ef0acffa78e tempest-FlavorsExtraSpecsTestJSON-719717567 tempest-FlavorsExtraSpecsTestJSON-719717567-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:20.519625 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4fe01652-b7fc-4c6c-a4c4-8cc3b5c81ce2 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors/1001100326/action" status: 200 len: 97 microversion: 2.1 time: 0.240034 Oct 23 01:10:20.520479 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 12/24] 10.222.0.42 () {60 vars in 1200 bytes} [Sun Oct 23 01:10:20 2022] POST /compute/v2.1/flavors/1001100326/action => generated 97 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:10:20.525166 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-eba42e8c-7991-43ff-9b09-9d7d23c2da4d tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:20.536750 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eba42e8c-7991-43ff-9b09-9d7d23c2da4d tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:20.537242 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eba42e8c-7991-43ff-9b09-9d7d23c2da4d tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:20.537674 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eba42e8c-7991-43ff-9b09-9d7d23c2da4d tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:20.549067 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-25ddd2dc-5d79-4b1d-87d7-4ef0acffa78e tempest-FlavorsExtraSpecsTestJSON-719717567 tempest-FlavorsExtraSpecsTestJSON-719717567-project-admin] 10.222.0.42 "PUT /compute/v2.1/flavors/1269829048/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.117707 Oct 23 01:10:20.550600 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 13/25] 10.222.0.42 () {60 vars in 1265 bytes} [Sun Oct 23 01:10:20 2022] PUT /compute/v2.1/flavors/1269829048/os-extra_specs/hw:numa_nodes => generated 22 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:10:20.561316 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2deae482-1fb5-4a8b-97e8-477ac4f4c992 tempest-HostsAdminNegativeTestJSON-975942463 tempest-HostsAdminNegativeTestJSON-975942463-project] Calling method '.version_select at 0x7f5cc2e528b0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:20.563298 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2deae482-1fb5-4a8b-97e8-477ac4f4c992 tempest-HostsAdminNegativeTestJSON-975942463 tempest-HostsAdminNegativeTestJSON-975942463-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '49264f1d1b5d40269c7a6853c702917f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b095d4940ef84515aaa3c6e0e4a07538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:10:20.566136 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2deae482-1fb5-4a8b-97e8-477ac4f4c992 tempest-HostsAdminNegativeTestJSON-975942463 tempest-HostsAdminNegativeTestJSON-975942463-project] Request method failure captured: Oct 23 01:10:20.566136 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Oct 23 01:10:20.566136 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:10:20.566136 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:10:20.566136 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:10:20.566136 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:10:20.566136 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:10:20.566136 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:10:20.566136 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:10:20.566136 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:10:20.566136 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJR33WNzHitCGWLeZUuYvoVCyAJAPGMASGp5pZhBZUSUP0xcCIfjAdGjrbPKqBpSoDMw9AiBj2Ttk45sbosyagjn-nsi59PaISh3I5UxS_bo2f0Xn0jXOYBGTVe1D7ziB0qKF8fXdIEsJ0kJr3K8i9mbIHeaCbHznvAAbAZ-LeX6g74 Oct 23 01:10:20.566136 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:10:20.566136 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:10:20.566136 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:10:20.566136 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:10:20.566136 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:10:20.566136 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:10:20.566136 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: b095d4940ef84515aaa3c6e0e4a07538 Oct 23 01:10:20.566136 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-975942463 Oct 23 01:10:20.566136 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:10:20.566136 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:10:20.567176 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b095d4940ef84515aaa3c6e0e4a07538"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b095d4940ef84515aaa3c6e0e4a07538"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b095d4940ef84515aaa3c6e0e4a07538"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b095d4940ef84515aaa3c6e0e4a07538"}]}] Oct 23 01:10:20.567176 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-HostsAdminNegativeTestJSON-975942463 Oct 23 01:10:20.567176 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: b095d4940ef84515aaa3c6e0e4a07538 Oct 23 01:10:20.567176 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-975942463 Oct 23 01:10:20.567176 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-HostsAdminNegativeTestJSON-975942463-project Oct 23 01:10:20.567176 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:10:20.567176 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:10:20.567176 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 49264f1d1b5d40269c7a6853c702917f Oct 23 01:10:20.567176 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-HostsAdminNegativeTestJSON-975942463-project Oct 23 01:10:20.567176 n-d-master-1 devstack@n-api.service[120944]: method: Oct 23 01:10:20.567176 n-d-master-1 devstack@n-api.service[120944]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 23 01:10:20.567176 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'n-d-master-1'} Oct 23 01:10:20.567176 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:10:20.567772 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:20.567772 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:20.567772 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:20.567772 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:10:20.567772 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:10:20.567772 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:10:20.567772 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:10:20.567772 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:10:20.567772 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:10:20.567772 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 23 01:10:20.567772 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 23 01:10:20.567772 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 23 01:10:20.567772 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 23 01:10:20.567772 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 23 01:10:20.567772 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 23 01:10:20.567772 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:10:20.567772 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 23 01:10:20.567772 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:10:20.567772 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise self.value Oct 23 01:10:20.568591 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 23 01:10:20.568591 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 23 01:10:20.568591 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 23 01:10:20.568591 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 23 01:10:20.568591 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 23 01:10:20.568591 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 23 01:10:20.568591 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 23 01:10:20.568591 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:20.568591 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:20.568591 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:20.568591 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:20.568591 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:20.568591 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:20.568591 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 23 01:10:20.568591 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 23 01:10:20.568591 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 23 01:10:20.568591 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:20.569375 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2deae482-1fb5-4a8b-97e8-477ac4f4c992 tempest-HostsAdminNegativeTestJSON-975942463 tempest-HostsAdminNegativeTestJSON-975942463-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:10:20.569375 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2deae482-1fb5-4a8b-97e8-477ac4f4c992 tempest-HostsAdminNegativeTestJSON-975942463 tempest-HostsAdminNegativeTestJSON-975942463-project] 10.222.0.42 "GET /compute/v2.1/os-hosts/n-d-master-1" status: 403 len: 109 microversion: 2.1 time: 0.015771 Oct 23 01:10:20.569375 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 14/26] 10.222.0.42 () {58 vars in 1167 bytes} [Sun Oct 23 01:10:20 2022] GET /compute/v2.1/os-hosts/n-d-master-1 => generated 109 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:10:20.577739 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-62cb8cca-639d-4c7e-b5f7-eff8a9d6398f tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "cb2839bbedf643289a251019d9e79fc8"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:20.638026 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-eba42e8c-7991-43ff-9b09-9d7d23c2da4d tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] HTTP exception thrown: Aggregate 1 already has host n-h1-master-1. Oct 23 01:10:20.651628 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-eba42e8c-7991-43ff-9b09-9d7d23c2da4d tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Request method failure captured: Oct 23 01:10:20.651628 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/os-aggregates/1/action HTTP/1.1 Oct 23 01:10:20.651628 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:10:20.651628 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:10:20.651628 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:10:20.651628 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 39 Oct 23 01:10:20.651628 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:10:20.651628 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:10:20.651628 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:10:20.651628 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:10:20.651628 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJR6uWpBWdYCU3FR3UdoEx-fMaz2UGR5pio_u8SLfmmO-xfXencIRstHwi_Dw1PfAe0x1eMlxmZ6THsATqCgMSh9GyYyHR4KIJavXyOEvOQW15VbBizjWDSEpnZfpOpsyayKQQRznHbCGxQs1k0NC8h-UgwtBKrA40pVUR9jzpGlGvk Oct 23 01:10:20.651628 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:10:20.651628 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:10:20.651628 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:10:20.651628 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:10:20.651628 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:10:20.651628 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:10:20.651628 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 24682a566a714ef586033a6e2992e4e4 Oct 23 01:10:20.651628 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-223261651 Oct 23 01:10:20.651628 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,admin,reader Oct 23 01:10:20.651628 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,admin,reader Oct 23 01:10:20.652896 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/24682a566a714ef586033a6e2992e4e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_24682a566a714ef586033a6e2992e4e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/24682a566a714ef586033a6e2992e4e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/24682a566a714ef586033a6e2992e4e4"}]}] Oct 23 01:10:20.652896 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-223261651 Oct 23 01:10:20.652896 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 24682a566a714ef586033a6e2992e4e4 Oct 23 01:10:20.652896 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-223261651 Oct 23 01:10:20.652896 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin Oct 23 01:10:20.652896 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:10:20.652896 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:10:20.652896 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: a997cd84907845e2a0df8ae40a0fd4bf Oct 23 01:10:20.652896 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin Oct 23 01:10:20.652896 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:10:20.652896 n-d-master-1 devstack@n-api.service[120945]: {"add_host": {"host": "n-h1-master-1"}} Oct 23 01:10:20.652896 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:10:20.652896 n-d-master-1 devstack@n-api.service[120945]: exception: Aggregate 1 already has host n-h1-master-1. Oct 23 01:10:20.653642 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '1', 'body': {'add_host': {'host': 'n-h1-master-1'}}} Oct 23 01:10:20.653642 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:10:20.653642 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:20.653642 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 23 01:10:20.653642 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 23 01:10:20.653642 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 23 01:10:20.653642 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 23 01:10:20.653642 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 23 01:10:20.653642 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 23 01:10:20.653642 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 23 01:10:20.653642 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 23 01:10:20.653642 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 23 01:10:20.653642 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 23 01:10:20.653642 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 23 01:10:20.653642 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result.read() Oct 23 01:10:20.653642 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 23 01:10:20.653642 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 23 01:10:20.653642 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 23 01:10:20.653642 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 23 01:10:20.655105 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 23 01:10:20.655105 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 23 01:10:20.655105 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 23 01:10:20.655105 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 23 01:10:20.655105 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-master-1-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 23 01:10:20.655105 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:20.655105 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 23 01:10:20.655105 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:20.655105 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:20.655105 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 23 01:10:20.655105 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 23 01:10:20.655105 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 23 01:10:20.655105 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi session.flush() Oct 23 01:10:20.655105 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 23 01:10:20.655105 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 23 01:10:20.655105 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 23 01:10:20.655105 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 23 01:10:20.655105 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 23 01:10:20.655105 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 23 01:10:20.656204 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 23 01:10:20.656204 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception Oct 23 01:10:20.656204 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 23 01:10:20.656204 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 23 01:10:20.656204 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 23 01:10:20.656204 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 23 01:10:20.656204 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 23 01:10:20.656204 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 23 01:10:20.656204 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 23 01:10:20.656204 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 23 01:10:20.656204 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 23 01:10:20.656204 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 23 01:10:20.656204 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 23 01:10:20.656204 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 23 01:10:20.656204 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 23 01:10:20.656204 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 23 01:10:20.656204 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 23 01:10:20.656204 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 23 01:10:20.657765 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 23 01:10:20.657765 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 23 01:10:20.657765 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 23 01:10:20.657765 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 23 01:10:20.657765 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 23 01:10:20.657765 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception Oct 23 01:10:20.657765 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 23 01:10:20.657765 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 23 01:10:20.657765 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 23 01:10:20.657765 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 23 01:10:20.657765 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 23 01:10:20.657765 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 23 01:10:20.657765 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 23 01:10:20.657765 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 23 01:10:20.657765 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 23 01:10:20.657765 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 23 01:10:20.657765 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 23 01:10:20.657765 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result.read() Oct 23 01:10:20.659336 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 23 01:10:20.659336 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 23 01:10:20.659336 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 23 01:10:20.659336 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 23 01:10:20.659336 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 23 01:10:20.659336 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 23 01:10:20.659336 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 23 01:10:20.659336 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 23 01:10:20.659336 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-master-1-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 23 01:10:20.659336 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 23 01:10:20.659336 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 23, 1, 10, 20, 576426), 'updated_at': None, 'host': 'n-h1-master-1', 'aggregate_id': 1}] Oct 23 01:10:20.659336 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 23 01:10:20.659336 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:20.659336 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:20.659336 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:20.659336 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:20.659336 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 23 01:10:20.660354 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 23 01:10:20.660354 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 23 01:10:20.660354 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 23 01:10:20.660354 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:10:20.660354 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 23 01:10:20.660354 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:10:20.660354 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise self.value Oct 23 01:10:20.660354 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 23 01:10:20.660354 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 23 01:10:20.660354 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 23 01:10:20.660354 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 23 01:10:20.660354 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 23 01:10:20.660354 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 23 01:10:20.660354 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 23 01:10:20.660354 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 23 01:10:20.660354 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 23 01:10:20.660354 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 23 01:10:20.660354 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 1 already has host n-h1-master-1. Oct 23 01:10:20.660354 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:20.660354 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:20.661623 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:20.661623 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:20.661623 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:20.661623 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:20.661623 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:10:20.661623 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:10:20.661623 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:10:20.661623 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:10:20.661623 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:10:20.661623 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:10:20.661623 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 23 01:10:20.661623 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 23 01:10:20.661623 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 1 already has host n-h1-master-1. Oct 23 01:10:20.661623 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:20.661623 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:20.661623 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:20.661623 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:20.661623 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:20.661623 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:20.661623 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:10:20.661623 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:10:20.662815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 1 already has host n-h1-master-1. Oct 23 01:10:20.662815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:20.662815 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-eba42e8c-7991-43ff-9b09-9d7d23c2da4d tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Returning 409 to user: Aggregate 1 already has host n-h1-master-1. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:10:20.662815 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-eba42e8c-7991-43ff-9b09-9d7d23c2da4d tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 95 microversion: 2.1 time: 0.131592 Oct 23 01:10:20.662815 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 13/27] 10.222.0.42 () {60 vars in 1191 bytes} [Sun Oct 23 01:10:20 2022] POST /compute/v2.1/os-aggregates/1/action => generated 95 bytes in 133 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 23 01:10:20.662815 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-09d0adda-61e5-4cef-9e2b-d41ad24a78b3 tempest-FlavorsExtraSpecsTestJSON-719717567 tempest-FlavorsExtraSpecsTestJSON-719717567-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:20.667759 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-09d0adda-61e5-4cef-9e2b-d41ad24a78b3 tempest-FlavorsExtraSpecsTestJSON-719717567 tempest-FlavorsExtraSpecsTestJSON-719717567-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/1269829048/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.013008 Oct 23 01:10:20.668329 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 14/28] 10.222.0.42 () {58 vars in 1203 bytes} [Sun Oct 23 01:10:20 2022] GET /compute/v2.1/flavors/1269829048/os-extra_specs => generated 66 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:10:20.673001 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-50ab79aa-c7da-4f3c-95b8-3800ebd05ec6 tempest-HostsAdminNegativeTestJSON-2064242850 tempest-HostsAdminNegativeTestJSON-2064242850-project-admin] Calling method '.version_select at 0x7f5cc2c83ee0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:20.680080 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-50ab79aa-c7da-4f3c-95b8-3800ebd05ec6 tempest-HostsAdminNegativeTestJSON-2064242850 tempest-HostsAdminNegativeTestJSON-2064242850-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 23 01:10:20.682533 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-50ab79aa-c7da-4f3c-95b8-3800ebd05ec6 tempest-HostsAdminNegativeTestJSON-2064242850 tempest-HostsAdminNegativeTestJSON-2064242850-project-admin] Request method failure captured: Oct 23 01:10:20.682533 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 23 01:10:20.682533 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:10:20.682533 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:10:20.682533 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:10:20.682533 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:10:20.682533 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:10:20.682533 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:10:20.682533 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:10:20.682533 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:10:20.682533 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJR6rCO4RAQtmAaMYg5W_BMbxElf_L8ZdjHlaY6BSuALiR62TdDQervkGoWWiemTVz2KZEYiMnbbIT2i-fnCJlSbeOlZ-tLbqbX4Q3xK0K_e25xn276wsKPaHVbKu022KNmjEEC20r0l3ZB7lIJ0SyOK0YRtr89I4_GzvD7bu0_0qM8 Oct 23 01:10:20.682533 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:10:20.682533 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:10:20.682533 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:10:20.682533 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:10:20.682533 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:10:20.682533 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:10:20.682533 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 9dec106b1fee4cbaaf8052b1374d8192 Oct 23 01:10:20.682533 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2064242850 Oct 23 01:10:20.682533 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,admin,reader Oct 23 01:10:20.682533 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,admin,reader Oct 23 01:10:20.689051 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9dec106b1fee4cbaaf8052b1374d8192"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9dec106b1fee4cbaaf8052b1374d8192"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9dec106b1fee4cbaaf8052b1374d8192"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9dec106b1fee4cbaaf8052b1374d8192"}]}] Oct 23 01:10:20.689051 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2064242850 Oct 23 01:10:20.689051 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 9dec106b1fee4cbaaf8052b1374d8192 Oct 23 01:10:20.689051 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2064242850 Oct 23 01:10:20.689051 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-HostsAdminNegativeTestJSON-2064242850-project-admin Oct 23 01:10:20.689051 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:10:20.689051 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:10:20.689051 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: f0a177c2d5b747fa889814116e3050df Oct 23 01:10:20.689051 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2064242850-project-admin Oct 23 01:10:20.689051 n-d-master-1 devstack@n-api.service[120945]: method: Oct 23 01:10:20.689051 n-d-master-1 devstack@n-api.service[120945]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 23 01:10:20.689051 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'nonexistent_hostname'} Oct 23 01:10:20.689051 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:10:20.689778 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:20.689778 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 23 01:10:20.689778 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 23 01:10:20.689778 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 01:10:20.689778 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 01:10:20.689778 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 23 01:10:20.689778 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 23 01:10:20.689778 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 23 01:10:20.689778 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 23 01:10:20.689778 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 23 01:10:20.689778 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 23 01:10:20.689778 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 23 01:10:20.689778 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:20.689778 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:20.689778 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:20.689778 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:20.689778 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:20.689778 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:20.689778 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:10:20.691399 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:10:20.691399 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:10:20.691399 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:10:20.691399 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:10:20.691399 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:10:20.691399 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 23 01:10:20.691399 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:10:20.691399 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 23 01:10:20.691399 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:20.691399 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:20.691399 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:20.691399 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:20.691399 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:20.691399 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:20.691399 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:10:20.691399 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:10:20.691399 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 23 01:10:20.691399 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:20.692560 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-50ab79aa-c7da-4f3c-95b8-3800ebd05ec6 tempest-HostsAdminNegativeTestJSON-2064242850 tempest-HostsAdminNegativeTestJSON-2064242850-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:10:20.692560 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-50ab79aa-c7da-4f3c-95b8-3800ebd05ec6 tempest-HostsAdminNegativeTestJSON-2064242850 tempest-HostsAdminNegativeTestJSON-2064242850-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.014388 Oct 23 01:10:20.692560 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 15/29] 10.222.0.42 () {58 vars in 1191 bytes} [Sun Oct 23 01:10:20 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:10:20.692560 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bc9db672-5004-4256-a6af-1b3ad7331e36 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:20.699423 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bc9db672-5004-4256-a6af-1b3ad7331e36 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:20.699912 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bc9db672-5004-4256-a6af-1b3ad7331e36 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:20.700346 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bc9db672-5004-4256-a6af-1b3ad7331e36 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:20.812019 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-62cb8cca-639d-4c7e-b5f7-eff8a9d6398f tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] HTTP exception thrown: Flavor access already exists for flavor 17 and project cb2839bbedf643289a251019d9e79fc8 combination. Oct 23 01:10:20.825163 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-62cb8cca-639d-4c7e-b5f7-eff8a9d6398f tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] Request method failure captured: Oct 23 01:10:20.825163 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/flavors/1001100326/action HTTP/1.1 Oct 23 01:10:20.825163 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:10:20.825163 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:10:20.825163 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:10:20.825163 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 67 Oct 23 01:10:20.825163 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:10:20.825163 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:10:20.825163 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:10:20.825163 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:10:20.825163 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJR6a50YwKecWoSVwMAfRA1tIpp71KKynfExNF51lqleY-g0Yg5MaTBTEvLCpp0eohrs_nkyaMNGrlXFTfvplULV_EwgumTMxcZ1nElYhdtheNwxtU9dnUC-o0Qyha_GrFxpvXGXW3DOg9NGSSftnGCR2EFWZaEfcBHRB_cRYpLDrns Oct 23 01:10:20.825163 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:10:20.825163 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:10:20.825163 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:10:20.825163 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:10:20.825163 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:10:20.825163 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:10:20.825163 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: f6c73949b77f4bc1a11502d092ace444 Oct 23 01:10:20.825163 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-299257373 Oct 23 01:10:20.825163 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,admin,reader Oct 23 01:10:20.825163 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,admin,reader Oct 23 01:10:20.826694 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f6c73949b77f4bc1a11502d092ace444"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f6c73949b77f4bc1a11502d092ace444"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f6c73949b77f4bc1a11502d092ace444"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f6c73949b77f4bc1a11502d092ace444"}]}] Oct 23 01:10:20.826694 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-299257373 Oct 23 01:10:20.826694 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: f6c73949b77f4bc1a11502d092ace444 Oct 23 01:10:20.826694 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-299257373 Oct 23 01:10:20.826694 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin Oct 23 01:10:20.826694 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:10:20.826694 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:10:20.826694 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 41bbdf429a464a5bbaf79131085193cb Oct 23 01:10:20.826694 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin Oct 23 01:10:20.826694 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:10:20.826694 n-d-master-1 devstack@n-api.service[120944]: {"addTenantAccess": {"tenant": "cb2839bbedf643289a251019d9e79fc8"}} Oct 23 01:10:20.826694 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:10:20.827461 n-d-master-1 devstack@n-api.service[120944]: exception: Flavor access already exists for flavor 17 and project cb2839bbedf643289a251019d9e79fc8 combination. Oct 23 01:10:20.827461 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '1001100326', 'body': {'addTenantAccess': {'tenant': 'cb2839bbedf643289a251019d9e79fc8'}}} Oct 23 01:10:20.827461 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:10:20.827461 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:20.827461 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 23 01:10:20.827461 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 23 01:10:20.827461 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 23 01:10:20.827461 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 23 01:10:20.827461 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 23 01:10:20.827461 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 23 01:10:20.827461 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 23 01:10:20.827461 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 23 01:10:20.827461 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 23 01:10:20.827461 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 23 01:10:20.827461 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 23 01:10:20.827461 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result.read() Oct 23 01:10:20.827461 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 23 01:10:20.827461 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 23 01:10:20.828519 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 23 01:10:20.828519 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 23 01:10:20.828519 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 23 01:10:20.828519 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 23 01:10:20.828519 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 23 01:10:20.828519 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 23 01:10:20.828519 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '17-cb2839bbedf643289a251019d9e79fc8' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 23 01:10:20.828519 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:20.828519 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 23 01:10:20.828519 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:20.828519 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:20.828519 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 23 01:10:20.828519 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 23 01:10:20.828519 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 23 01:10:20.828519 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi session.flush() Oct 23 01:10:20.828519 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 23 01:10:20.828519 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 23 01:10:20.828519 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 23 01:10:20.828519 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 23 01:10:20.829653 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 23 01:10:20.829653 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 23 01:10:20.829653 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 23 01:10:20.829653 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception Oct 23 01:10:20.829653 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 23 01:10:20.829653 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 23 01:10:20.829653 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 23 01:10:20.829653 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 23 01:10:20.829653 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 23 01:10:20.829653 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 23 01:10:20.829653 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 23 01:10:20.829653 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 23 01:10:20.829653 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 23 01:10:20.829653 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 23 01:10:20.829653 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 23 01:10:20.829653 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 23 01:10:20.829653 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 23 01:10:20.829653 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 23 01:10:20.830951 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 23 01:10:20.830951 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 23 01:10:20.830951 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 23 01:10:20.830951 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 23 01:10:20.830951 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 23 01:10:20.830951 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 23 01:10:20.830951 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 23 01:10:20.830951 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception Oct 23 01:10:20.830951 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 23 01:10:20.830951 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 23 01:10:20.830951 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 23 01:10:20.830951 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 23 01:10:20.830951 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 23 01:10:20.830951 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 23 01:10:20.830951 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 23 01:10:20.830951 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 23 01:10:20.830951 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 23 01:10:20.830951 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 23 01:10:20.831923 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 23 01:10:20.831923 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result.read() Oct 23 01:10:20.831923 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 23 01:10:20.831923 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 23 01:10:20.831923 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 23 01:10:20.831923 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 23 01:10:20.831923 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 23 01:10:20.831923 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 23 01:10:20.831923 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 23 01:10:20.831923 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 23 01:10:20.831923 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '17-cb2839bbedf643289a251019d9e79fc8' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 23 01:10:20.831923 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 23 01:10:20.831923 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 23, 1, 10, 20, 743969), 'updated_at': None, 'flavor_id': 17, 'project_id': 'cb2839bbedf643289a251019d9e79fc8'}] Oct 23 01:10:20.831923 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 23 01:10:20.831923 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:20.831923 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:20.831923 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:20.833055 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:20.833055 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 23 01:10:20.833055 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 23 01:10:20.833055 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 23 01:10:20.833055 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 23 01:10:20.833055 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 23 01:10:20.833055 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 23 01:10:20.833055 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 23 01:10:20.833055 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 23 01:10:20.833055 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 23 01:10:20.833055 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 23 01:10:20.833055 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 23 01:10:20.833055 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 23 01:10:20.833055 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 23 01:10:20.833055 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 23 01:10:20.833055 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 17 and project cb2839bbedf643289a251019d9e79fc8 combination. Oct 23 01:10:20.833055 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:20.833055 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:20.833055 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:20.835660 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:20.835660 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:20.835660 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:20.835660 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:10:20.835660 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:10:20.835660 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:10:20.835660 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:10:20.835660 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:10:20.835660 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:10:20.835660 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 23 01:10:20.835660 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 23 01:10:20.835660 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 17 and project cb2839bbedf643289a251019d9e79fc8 combination. Oct 23 01:10:20.835660 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:20.835660 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:20.835660 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:20.835660 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:20.835660 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:20.835660 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:20.835660 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:10:20.835660 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:10:20.837061 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 17 and project cb2839bbedf643289a251019d9e79fc8 combination. Oct 23 01:10:20.837061 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:20.837061 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-62cb8cca-639d-4c7e-b5f7-eff8a9d6398f tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] Returning 409 to user: Flavor access already exists for flavor 17 and project cb2839bbedf643289a251019d9e79fc8 combination. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:10:20.837061 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-62cb8cca-639d-4c7e-b5f7-eff8a9d6398f tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors/1001100326/action" status: 409 len: 152 microversion: 2.1 time: 0.253216 Oct 23 01:10:20.837061 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 15/30] 10.222.0.42 () {60 vars in 1200 bytes} [Sun Oct 23 01:10:20 2022] POST /compute/v2.1/flavors/1001100326/action => generated 152 bytes in 259 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:10:20.837061 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0599db42-6636-4368-80b3-f21f1dbc4acc tempest-FlavorsExtraSpecsTestJSON-719717567 tempest-FlavorsExtraSpecsTestJSON-719717567-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:20.910373 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0599db42-6636-4368-80b3-f21f1dbc4acc tempest-FlavorsExtraSpecsTestJSON-719717567 tempest-FlavorsExtraSpecsTestJSON-719717567-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/1269829048/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.081713 Oct 23 01:10:20.910959 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 16/31] 10.222.0.42 () {58 vars in 1248 bytes} [Sun Oct 23 01:10:20 2022] DELETE /compute/v2.1/flavors/1269829048/os-extra_specs/hw:numa_nodes => generated 0 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 23 01:10:20.915795 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-04a08648-6298-4829-9f4e-6a2568b83cb4 tempest-HostsAdminNegativeTestJSON-975942463 tempest-HostsAdminNegativeTestJSON-975942463-project] Calling method '.version_select at 0x7f5cc2e52700>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:20.918336 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-04a08648-6298-4829-9f4e-6a2568b83cb4 tempest-HostsAdminNegativeTestJSON-975942463 tempest-HostsAdminNegativeTestJSON-975942463-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '49264f1d1b5d40269c7a6853c702917f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b095d4940ef84515aaa3c6e0e4a07538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:10:20.920149 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-04a08648-6298-4829-9f4e-6a2568b83cb4 tempest-HostsAdminNegativeTestJSON-975942463 tempest-HostsAdminNegativeTestJSON-975942463-project] Request method failure captured: Oct 23 01:10:20.920149 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/os-hosts/n-d-master-1/shutdown HTTP/1.1 Oct 23 01:10:20.920149 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:10:20.920149 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:10:20.920149 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:10:20.920149 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:10:20.920149 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:10:20.920149 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:10:20.920149 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:10:20.920149 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:10:20.920149 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJR33WNzHitCGWLeZUuYvoVCyAJAPGMASGp5pZhBZUSUP0xcCIfjAdGjrbPKqBpSoDMw9AiBj2Ttk45sbosyagjn-nsi59PaISh3I5UxS_bo2f0Xn0jXOYBGTVe1D7ziB0qKF8fXdIEsJ0kJr3K8i9mbIHeaCbHznvAAbAZ-LeX6g74 Oct 23 01:10:20.920149 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:10:20.920149 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:10:20.920149 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:10:20.920149 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:10:20.920149 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:10:20.920149 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:10:20.920149 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: b095d4940ef84515aaa3c6e0e4a07538 Oct 23 01:10:20.920149 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-975942463 Oct 23 01:10:20.920149 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:10:20.920149 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:10:20.921171 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b095d4940ef84515aaa3c6e0e4a07538"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b095d4940ef84515aaa3c6e0e4a07538"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b095d4940ef84515aaa3c6e0e4a07538"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b095d4940ef84515aaa3c6e0e4a07538"}]}] Oct 23 01:10:20.921171 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-HostsAdminNegativeTestJSON-975942463 Oct 23 01:10:20.921171 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: b095d4940ef84515aaa3c6e0e4a07538 Oct 23 01:10:20.921171 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-975942463 Oct 23 01:10:20.921171 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-HostsAdminNegativeTestJSON-975942463-project Oct 23 01:10:20.921171 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:10:20.921171 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:10:20.921171 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 49264f1d1b5d40269c7a6853c702917f Oct 23 01:10:20.921171 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-HostsAdminNegativeTestJSON-975942463-project Oct 23 01:10:20.921171 n-d-master-1 devstack@n-api.service[120944]: method: Oct 23 01:10:20.921171 n-d-master-1 devstack@n-api.service[120944]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 23 01:10:20.921171 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'n-d-master-1'} Oct 23 01:10:20.921171 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:10:20.921789 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:20.921789 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:20.921789 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:20.921789 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:10:20.921789 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:10:20.921789 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:10:20.921789 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:10:20.921789 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:10:20.921789 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:10:20.921789 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 23 01:10:20.921789 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 23 01:10:20.921789 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 23 01:10:20.921789 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 23 01:10:20.921789 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 23 01:10:20.921789 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 23 01:10:20.921789 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:10:20.921789 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 23 01:10:20.921789 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:10:20.921789 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise self.value Oct 23 01:10:20.922721 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 23 01:10:20.922721 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 23 01:10:20.922721 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 23 01:10:20.922721 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 23 01:10:20.922721 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 23 01:10:20.922721 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 23 01:10:20.922721 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 23 01:10:20.922721 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:20.922721 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:20.922721 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:20.922721 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:20.922721 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:20.922721 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:20.922721 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 23 01:10:20.922721 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 23 01:10:20.922721 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 23 01:10:20.922721 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:20.923498 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-04a08648-6298-4829-9f4e-6a2568b83cb4 tempest-HostsAdminNegativeTestJSON-975942463 tempest-HostsAdminNegativeTestJSON-975942463-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:10:20.923498 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-04a08648-6298-4829-9f4e-6a2568b83cb4 tempest-HostsAdminNegativeTestJSON-975942463 tempest-HostsAdminNegativeTestJSON-975942463-project] 10.222.0.42 "GET /compute/v2.1/os-hosts/n-d-master-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.009619 Oct 23 01:10:20.923498 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 17/32] 10.222.0.42 () {58 vars in 1194 bytes} [Sun Oct 23 01:10:20 2022] GET /compute/v2.1/os-hosts/n-d-master-1/shutdown => generated 113 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:10:20.926649 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2c378af2-2abb-498f-88f2-794fb31009a6 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "cb2839bbedf643289a251019d9e79fc8"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:21.278393 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=8,nova_api:SAVEPOINT=9,nova_api:RELEASE=9,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:21.282185 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2c378af2-2abb-498f-88f2-794fb31009a6 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors/1001100326/action" status: 200 len: 21 microversion: 2.1 time: 0.359132 Oct 23 01:10:21.282894 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 18/33] 10.222.0.42 () {60 vars in 1200 bytes} [Sun Oct 23 01:10:20 2022] POST /compute/v2.1/flavors/1001100326/action => generated 21 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:10:21.287758 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5b5eb284-f34a-47b6-9e30-98028c47363f tempest-FlavorsExtraSpecsTestJSON-719717567 tempest-FlavorsExtraSpecsTestJSON-719717567-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:21.329329 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bc9db672-5004-4256-a6af-1b3ad7331e36 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 227 microversion: 2.1 time: 0.643757 Oct 23 01:10:21.329969 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 16/34] 10.222.0.42 () {60 vars in 1191 bytes} [Sun Oct 23 01:10:20 2022] POST /compute/v2.1/os-aggregates/1/action => generated 227 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:10:21.341924 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-047e0b17-c047-4f3b-a5c7-4284eae46741 tempest-HostsAdminNegativeTestJSON-2064242850 tempest-HostsAdminNegativeTestJSON-2064242850-project-admin] Calling method '.version_select at 0x7f5cc2c3c790>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:21.351209 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-047e0b17-c047-4f3b-a5c7-4284eae46741 tempest-HostsAdminNegativeTestJSON-2064242850 tempest-HostsAdminNegativeTestJSON-2064242850-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 23 01:10:21.352979 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-047e0b17-c047-4f3b-a5c7-4284eae46741 tempest-HostsAdminNegativeTestJSON-2064242850 tempest-HostsAdminNegativeTestJSON-2064242850-project-admin] Request method failure captured: Oct 23 01:10:21.352979 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 23 01:10:21.352979 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:10:21.352979 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:10:21.352979 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:10:21.352979 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:10:21.352979 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:10:21.352979 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:10:21.352979 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:10:21.352979 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:10:21.352979 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJR6rCO4RAQtmAaMYg5W_BMbxElf_L8ZdjHlaY6BSuALiR62TdDQervkGoWWiemTVz2KZEYiMnbbIT2i-fnCJlSbeOlZ-tLbqbX4Q3xK0K_e25xn276wsKPaHVbKu022KNmjEEC20r0l3ZB7lIJ0SyOK0YRtr89I4_GzvD7bu0_0qM8 Oct 23 01:10:21.352979 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:10:21.352979 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:10:21.352979 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:10:21.352979 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:10:21.352979 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:10:21.352979 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:10:21.352979 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 9dec106b1fee4cbaaf8052b1374d8192 Oct 23 01:10:21.352979 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2064242850 Oct 23 01:10:21.352979 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,admin,reader Oct 23 01:10:21.352979 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,admin,reader Oct 23 01:10:21.354362 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9dec106b1fee4cbaaf8052b1374d8192"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9dec106b1fee4cbaaf8052b1374d8192"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9dec106b1fee4cbaaf8052b1374d8192"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9dec106b1fee4cbaaf8052b1374d8192"}]}] Oct 23 01:10:21.354362 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2064242850 Oct 23 01:10:21.354362 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 9dec106b1fee4cbaaf8052b1374d8192 Oct 23 01:10:21.354362 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2064242850 Oct 23 01:10:21.354362 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-HostsAdminNegativeTestJSON-2064242850-project-admin Oct 23 01:10:21.354362 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:10:21.354362 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:10:21.354362 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: f0a177c2d5b747fa889814116e3050df Oct 23 01:10:21.354362 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2064242850-project-admin Oct 23 01:10:21.354362 n-d-master-1 devstack@n-api.service[120945]: method: Oct 23 01:10:21.354362 n-d-master-1 devstack@n-api.service[120945]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 23 01:10:21.354362 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'nonexistent_hostname'} Oct 23 01:10:21.354362 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:10:21.355016 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:21.355016 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 23 01:10:21.355016 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 23 01:10:21.355016 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 23 01:10:21.355016 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 23 01:10:21.355016 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:10:21.355016 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 23 01:10:21.355016 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:10:21.355016 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise self.value Oct 23 01:10:21.355016 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 23 01:10:21.355016 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 23 01:10:21.355016 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 23 01:10:21.355016 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 23 01:10:21.355016 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 01:10:21.355016 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 01:10:21.355016 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 23 01:10:21.355016 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 23 01:10:21.355016 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 23 01:10:21.355016 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 23 01:10:21.356289 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 23 01:10:21.356289 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 23 01:10:21.356289 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 23 01:10:21.356289 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:21.356289 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:21.356289 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:21.356289 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:21.356289 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:21.356289 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:21.356289 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:10:21.356289 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:10:21.356289 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:10:21.356289 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:10:21.356289 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:10:21.356289 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:10:21.356289 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 23 01:10:21.356289 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 23 01:10:21.356289 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 23 01:10:21.356289 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:10:21.357580 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 23 01:10:21.357580 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:21.357580 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:21.357580 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:21.357580 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:21.357580 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:21.357580 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:21.357580 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:10:21.357580 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:10:21.357580 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 23 01:10:21.357580 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:21.357580 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-047e0b17-c047-4f3b-a5c7-4284eae46741 tempest-HostsAdminNegativeTestJSON-2064242850 tempest-HostsAdminNegativeTestJSON-2064242850-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:10:21.357580 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-047e0b17-c047-4f3b-a5c7-4284eae46741 tempest-HostsAdminNegativeTestJSON-2064242850 tempest-HostsAdminNegativeTestJSON-2064242850-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.016511 Oct 23 01:10:21.357580 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 17/35] 10.222.0.42 () {58 vars in 1218 bytes} [Sun Oct 23 01:10:21 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:10:21.360573 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e2b7f491-58ef-411d-bccb-4dacc6ec8316 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:21.398922 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5b5eb284-f34a-47b6-9e30-98028c47363f tempest-FlavorsExtraSpecsTestJSON-719717567 tempest-FlavorsExtraSpecsTestJSON-719717567-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/1269829048/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.110118 Oct 23 01:10:21.398922 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 19/36] 10.222.0.42 () {58 vars in 1248 bytes} [Sun Oct 23 01:10:21 2022] DELETE /compute/v2.1/flavors/1269829048/os-extra_specs/hw:cpu_policy => generated 0 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 23 01:10:21.400077 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7791fef3-1bf5-4d91-86f3-a7325978ef4a tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:21.447869 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e2b7f491-58ef-411d-bccb-4dacc6ec8316 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/1001100326" status: 202 len: 0 microversion: 2.1 time: 0.091890 Oct 23 01:10:21.448454 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 18/37] 10.222.0.42 () {58 vars in 1161 bytes} [Sun Oct 23 01:10:21 2022] DELETE /compute/v2.1/flavors/1001100326 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:10:21.455134 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ef53143d-afec-47bc-bcc7-5294d816ef36 tempest-HostsAdminNegativeTestJSON-975942463 tempest-HostsAdminNegativeTestJSON-975942463-project] Calling method '.version_select at 0x7f5cc2c3cca0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:21.457055 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ef53143d-afec-47bc-bcc7-5294d816ef36 tempest-HostsAdminNegativeTestJSON-975942463 tempest-HostsAdminNegativeTestJSON-975942463-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '49264f1d1b5d40269c7a6853c702917f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b095d4940ef84515aaa3c6e0e4a07538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:10:21.458808 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ef53143d-afec-47bc-bcc7-5294d816ef36 tempest-HostsAdminNegativeTestJSON-975942463 tempest-HostsAdminNegativeTestJSON-975942463-project] Request method failure captured: Oct 23 01:10:21.458808 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/os-hosts/n-d-master-1/startup HTTP/1.1 Oct 23 01:10:21.458808 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:10:21.458808 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:10:21.458808 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:10:21.458808 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:10:21.458808 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:10:21.458808 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:10:21.458808 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:10:21.458808 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:10:21.458808 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJR33WNzHitCGWLeZUuYvoVCyAJAPGMASGp5pZhBZUSUP0xcCIfjAdGjrbPKqBpSoDMw9AiBj2Ttk45sbosyagjn-nsi59PaISh3I5UxS_bo2f0Xn0jXOYBGTVe1D7ziB0qKF8fXdIEsJ0kJr3K8i9mbIHeaCbHznvAAbAZ-LeX6g74 Oct 23 01:10:21.458808 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:10:21.458808 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:10:21.458808 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:10:21.458808 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:10:21.458808 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:10:21.458808 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:10:21.458808 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: b095d4940ef84515aaa3c6e0e4a07538 Oct 23 01:10:21.458808 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-975942463 Oct 23 01:10:21.458808 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:10:21.458808 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:10:21.460168 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b095d4940ef84515aaa3c6e0e4a07538"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b095d4940ef84515aaa3c6e0e4a07538"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b095d4940ef84515aaa3c6e0e4a07538"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b095d4940ef84515aaa3c6e0e4a07538"}]}] Oct 23 01:10:21.460168 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-HostsAdminNegativeTestJSON-975942463 Oct 23 01:10:21.460168 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: b095d4940ef84515aaa3c6e0e4a07538 Oct 23 01:10:21.460168 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-975942463 Oct 23 01:10:21.460168 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-HostsAdminNegativeTestJSON-975942463-project Oct 23 01:10:21.460168 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:10:21.460168 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:10:21.460168 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 49264f1d1b5d40269c7a6853c702917f Oct 23 01:10:21.460168 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-HostsAdminNegativeTestJSON-975942463-project Oct 23 01:10:21.460168 n-d-master-1 devstack@n-api.service[120945]: method: Oct 23 01:10:21.460168 n-d-master-1 devstack@n-api.service[120945]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 23 01:10:21.460168 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'n-d-master-1'} Oct 23 01:10:21.460168 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:10:21.460929 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:21.460929 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:21.460929 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:21.460929 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:10:21.460929 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:10:21.460929 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:10:21.460929 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:10:21.460929 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:10:21.460929 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:10:21.460929 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 23 01:10:21.460929 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 23 01:10:21.460929 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 23 01:10:21.460929 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 23 01:10:21.460929 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 23 01:10:21.460929 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 23 01:10:21.460929 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:10:21.460929 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 23 01:10:21.460929 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:10:21.460929 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise self.value Oct 23 01:10:21.462491 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 23 01:10:21.462491 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 23 01:10:21.462491 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 23 01:10:21.462491 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 23 01:10:21.462491 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 23 01:10:21.462491 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 23 01:10:21.462491 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 23 01:10:21.462491 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:21.462491 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:21.462491 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:21.462491 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:21.462491 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:21.462491 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:21.462491 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 23 01:10:21.462491 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 23 01:10:21.462491 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 23 01:10:21.462491 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:21.463293 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ef53143d-afec-47bc-bcc7-5294d816ef36 tempest-HostsAdminNegativeTestJSON-975942463 tempest-HostsAdminNegativeTestJSON-975942463-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:10:21.463293 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ef53143d-afec-47bc-bcc7-5294d816ef36 tempest-HostsAdminNegativeTestJSON-975942463 tempest-HostsAdminNegativeTestJSON-975942463-project] 10.222.0.42 "GET /compute/v2.1/os-hosts/n-d-master-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.010612 Oct 23 01:10:21.463293 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 19/38] 10.222.0.42 () {58 vars in 1191 bytes} [Sun Oct 23 01:10:21 2022] GET /compute/v2.1/os-hosts/n-d-master-1/startup => generated 110 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:10:21.468039 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-90222d51-f762-42c0-ae55-c1f628c1267a tempest-FlavorsExtraSpecsTestJSON-719717567 tempest-FlavorsExtraSpecsTestJSON-719717567-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:21.477194 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-90222d51-f762-42c0-ae55-c1f628c1267a tempest-FlavorsExtraSpecsTestJSON-719717567 tempest-FlavorsExtraSpecsTestJSON-719717567-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/1269829048/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.014421 Oct 23 01:10:21.478160 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 20/39] 10.222.0.42 () {58 vars in 1203 bytes} [Sun Oct 23 01:10:21 2022] GET /compute/v2.1/flavors/1269829048/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:10:21.483491 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e90920e0-5ab1-4f0e-a6de-57c9fa82f147 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:21.516112 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e90920e0-5ab1-4f0e-a6de-57c9fa82f147 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.036523 Oct 23 01:10:21.516702 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 21/40] 10.222.0.42 () {58 vars in 1146 bytes} [Sun Oct 23 01:10:21 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:10:21.537270 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-46ce67ef-e99c-47b1-8346-b4ce88946397 tempest-HostsAdminNegativeTestJSON-2064242850 tempest-HostsAdminNegativeTestJSON-2064242850-project-admin] Calling method '.version_select at 0x7f5cc2c658b0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:21.547161 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-46ce67ef-e99c-47b1-8346-b4ce88946397 tempest-HostsAdminNegativeTestJSON-2064242850 tempest-HostsAdminNegativeTestJSON-2064242850-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 23 01:10:21.549097 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-46ce67ef-e99c-47b1-8346-b4ce88946397 tempest-HostsAdminNegativeTestJSON-2064242850 tempest-HostsAdminNegativeTestJSON-2064242850-project-admin] Request method failure captured: Oct 23 01:10:21.549097 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 23 01:10:21.549097 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:10:21.549097 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:10:21.549097 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:10:21.549097 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:10:21.549097 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:10:21.549097 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:10:21.549097 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:10:21.549097 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:10:21.549097 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJR6rCO4RAQtmAaMYg5W_BMbxElf_L8ZdjHlaY6BSuALiR62TdDQervkGoWWiemTVz2KZEYiMnbbIT2i-fnCJlSbeOlZ-tLbqbX4Q3xK0K_e25xn276wsKPaHVbKu022KNmjEEC20r0l3ZB7lIJ0SyOK0YRtr89I4_GzvD7bu0_0qM8 Oct 23 01:10:21.549097 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:10:21.549097 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:10:21.549097 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:10:21.549097 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:10:21.549097 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:10:21.549097 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:10:21.549097 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 9dec106b1fee4cbaaf8052b1374d8192 Oct 23 01:10:21.549097 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2064242850 Oct 23 01:10:21.549097 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,admin,reader Oct 23 01:10:21.549097 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,admin,reader Oct 23 01:10:21.550834 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9dec106b1fee4cbaaf8052b1374d8192"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9dec106b1fee4cbaaf8052b1374d8192"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9dec106b1fee4cbaaf8052b1374d8192"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9dec106b1fee4cbaaf8052b1374d8192"}]}] Oct 23 01:10:21.550834 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2064242850 Oct 23 01:10:21.550834 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 9dec106b1fee4cbaaf8052b1374d8192 Oct 23 01:10:21.550834 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2064242850 Oct 23 01:10:21.550834 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-HostsAdminNegativeTestJSON-2064242850-project-admin Oct 23 01:10:21.550834 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:10:21.550834 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:10:21.550834 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: f0a177c2d5b747fa889814116e3050df Oct 23 01:10:21.550834 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2064242850-project-admin Oct 23 01:10:21.550834 n-d-master-1 devstack@n-api.service[120945]: method: Oct 23 01:10:21.550834 n-d-master-1 devstack@n-api.service[120945]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 23 01:10:21.550834 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'nonexistent_hostname'} Oct 23 01:10:21.550834 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:10:21.551453 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:21.551453 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 23 01:10:21.551453 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 23 01:10:21.551453 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 23 01:10:21.551453 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 23 01:10:21.551453 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:10:21.551453 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 23 01:10:21.551453 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:10:21.551453 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise self.value Oct 23 01:10:21.551453 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 23 01:10:21.551453 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 23 01:10:21.551453 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 23 01:10:21.551453 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 23 01:10:21.551453 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 01:10:21.551453 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 01:10:21.551453 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 23 01:10:21.551453 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 23 01:10:21.551453 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 23 01:10:21.551453 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 23 01:10:21.557521 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 23 01:10:21.557521 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 23 01:10:21.557521 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 23 01:10:21.557521 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:21.557521 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:21.557521 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:21.557521 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:21.557521 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:21.557521 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:21.557521 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:10:21.557521 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:10:21.557521 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:10:21.557521 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:10:21.557521 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:10:21.557521 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:10:21.557521 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 23 01:10:21.557521 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 23 01:10:21.557521 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 23 01:10:21.557521 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:10:21.558497 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 23 01:10:21.558497 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:21.558497 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:21.558497 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:21.558497 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:21.558497 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:21.558497 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:21.558497 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:10:21.558497 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:10:21.558497 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 23 01:10:21.558497 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:21.558497 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-46ce67ef-e99c-47b1-8346-b4ce88946397 tempest-HostsAdminNegativeTestJSON-2064242850 tempest-HostsAdminNegativeTestJSON-2064242850-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:10:21.558497 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-46ce67ef-e99c-47b1-8346-b4ce88946397 tempest-HostsAdminNegativeTestJSON-2064242850 tempest-HostsAdminNegativeTestJSON-2064242850-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.033083 Oct 23 01:10:21.558497 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 22/41] 10.222.0.42 () {58 vars in 1215 bytes} [Sun Oct 23 01:10:21 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:10:21.559173 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-827731f3-793e-4786-921a-4cba90f17710 tempest-FlavorsExtraSpecsTestJSON-719717567 tempest-FlavorsExtraSpecsTestJSON-719717567-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:21.565739 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7791fef3-1bf5-4d91-86f3-a7325978ef4a tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.168921 Oct 23 01:10:21.575107 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 20/42] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Oct 23 01:10:21 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 23 01:10:21.578154 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-be1e7db3-100c-4d6e-add4-e29887c46060 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-572131584", "id": 1900078191, "os-flavor-access:is_public": "True"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:21.653496 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-827731f3-793e-4786-921a-4cba90f17710 tempest-FlavorsExtraSpecsTestJSON-719717567 tempest-FlavorsExtraSpecsTestJSON-719717567-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/1269829048" status: 202 len: 0 microversion: 2.1 time: 0.100541 Oct 23 01:10:21.654241 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 23/43] 10.222.0.42 () {58 vars in 1161 bytes} [Sun Oct 23 01:10:21 2022] DELETE /compute/v2.1/flavors/1269829048 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:10:21.659981 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-be1e7db3-100c-4d6e-add4-e29887c46060 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.090822 Oct 23 01:10:21.660126 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-83b75a90-f32d-45ac-8811-3a2c73a59c8f tempest-HostsAdminNegativeTestJSON-2064242850 tempest-HostsAdminNegativeTestJSON-2064242850-project-admin] Action: 'update', calling method: .version_select at 0x7f5cc2c3cdc0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:21.660569 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 21/44] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:10:21 2022] POST /compute/v2.1/flavors => generated 437 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:10:21.664438 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-83b75a90-f32d-45ac-8811-3a2c73a59c8f tempest-HostsAdminNegativeTestJSON-2064242850 tempest-HostsAdminNegativeTestJSON-2064242850-project-admin] Request method failure captured: Oct 23 01:10:21.664438 n-d-master-1 devstack@n-api.service[120945]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Oct 23 01:10:21.664438 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:10:21.664438 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:10:21.664438 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:10:21.664438 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 51 Oct 23 01:10:21.664438 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:10:21.664438 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:10:21.664438 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:10:21.664438 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:10:21.664438 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJR6rCO4RAQtmAaMYg5W_BMbxElf_L8ZdjHlaY6BSuALiR62TdDQervkGoWWiemTVz2KZEYiMnbbIT2i-fnCJlSbeOlZ-tLbqbX4Q3xK0K_e25xn276wsKPaHVbKu022KNmjEEC20r0l3ZB7lIJ0SyOK0YRtr89I4_GzvD7bu0_0qM8 Oct 23 01:10:21.664438 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:10:21.664438 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:10:21.664438 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:10:21.664438 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:10:21.664438 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:10:21.664438 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:10:21.664438 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 9dec106b1fee4cbaaf8052b1374d8192 Oct 23 01:10:21.664438 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2064242850 Oct 23 01:10:21.664438 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,admin,reader Oct 23 01:10:21.664438 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,admin,reader Oct 23 01:10:21.665531 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9dec106b1fee4cbaaf8052b1374d8192"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9dec106b1fee4cbaaf8052b1374d8192"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9dec106b1fee4cbaaf8052b1374d8192"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9dec106b1fee4cbaaf8052b1374d8192"}]}] Oct 23 01:10:21.665531 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2064242850 Oct 23 01:10:21.665531 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 9dec106b1fee4cbaaf8052b1374d8192 Oct 23 01:10:21.665531 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2064242850 Oct 23 01:10:21.665531 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-HostsAdminNegativeTestJSON-2064242850-project-admin Oct 23 01:10:21.665531 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:10:21.665531 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:10:21.665531 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: f0a177c2d5b747fa889814116e3050df Oct 23 01:10:21.665531 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2064242850-project-admin Oct 23 01:10:21.665531 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:10:21.665531 n-d-master-1 devstack@n-api.service[120945]: {"status": "enable", "maintenance_mode": "invalid"} Oct 23 01:10:21.665531 n-d-master-1 devstack@n-api.service[120945]: method: Oct 23 01:10:21.665531 n-d-master-1 devstack@n-api.service[120945]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 23 01:10:21.666286 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'n-d-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 23 01:10:21.666286 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:10:21.666286 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:21.666286 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 23 01:10:21.666286 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 23 01:10:21.666286 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 01:10:21.666286 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise error Oct 23 01:10:21.666286 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 23 01:10:21.666286 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:21.666286 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 23 01:10:21.666286 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 23 01:10:21.666286 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 'disable', Oct 23 01:10:21.666286 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 'Enable', Oct 23 01:10:21.666286 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 'Disable', Oct 23 01:10:21.666286 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 23 01:10:21.666286 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 23 01:10:21.666286 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 23 01:10:21.666286 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:21.666286 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi On instance: Oct 23 01:10:21.666286 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 'invalid' Oct 23 01:10:21.666286 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:21.666286 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:21.666286 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:21.666286 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:21.666286 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:21.667450 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:21.667450 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:10:21.667450 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:10:21.667450 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:10:21.667450 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:10:21.667450 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:10:21.667450 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:10:21.667450 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 23 01:10:21.667450 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 23 01:10:21.667450 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 23 01:10:21.667450 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 23 01:10:21.667450 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 23 01:10:21.667450 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 23 01:10:21.667450 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 23 01:10:21.667450 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:21.667450 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:21.667450 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:21.667450 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:21.667450 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:21.668554 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:21.668554 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 23 01:10:21.668554 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 23 01:10:21.668554 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 23 01:10:21.668554 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:21.668554 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-83b75a90-f32d-45ac-8811-3a2c73a59c8f tempest-HostsAdminNegativeTestJSON-2064242850 tempest-HostsAdminNegativeTestJSON-2064242850-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:10:21.669195 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e8882966-ce8f-406c-99cc-a441603f1781 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1319821281"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:21.669280 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-83b75a90-f32d-45ac-8811-3a2c73a59c8f tempest-HostsAdminNegativeTestJSON-2064242850 tempest-HostsAdminNegativeTestJSON-2064242850-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 400 len: 199 microversion: 2.1 time: 0.010731 Oct 23 01:10:21.670861 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 24/45] 10.222.0.42 () {60 vars in 1187 bytes} [Sun Oct 23 01:10:21 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 199 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:10:21.671053 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.aggregate [None req-e8882966-ce8f-406c-99cc-a441603f1781 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Generated uuid e58009f1-62c7-491d-bbbc-59dfa830eb0b for aggregate {{(pid=120944) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 23 01:10:21.676011 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a8ede669-137d-4031-937b-392f9d0e1d4a tempest-AggregatesAdminTestV241-117911304 tempest-AggregatesAdminTestV241-117911304-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1063930493"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:21.679523 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.aggregate [None req-a8ede669-137d-4031-937b-392f9d0e1d4a tempest-AggregatesAdminTestV241-117911304 tempest-AggregatesAdminTestV241-117911304-project-admin] Generated uuid 2c3d41c3-5af7-4bc7-9adf-7311817d76ce for aggregate {{(pid=120945) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 23 01:10:21.799964 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a8ede669-137d-4031-937b-392f9d0e1d4a tempest-AggregatesAdminTestV241-117911304 tempest-AggregatesAdminTestV241-117911304-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.122241 Oct 23 01:10:21.800121 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e8882966-ce8f-406c-99cc-a441603f1781 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.132928 Oct 23 01:10:21.800197 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 25/46] 10.222.0.42 () {62 vars in 1205 bytes} [Sun Oct 23 01:10:21 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:10:21.800260 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 22/47] 10.222.0.42 () {60 vars in 1164 bytes} [Sun Oct 23 01:10:21 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:10:21.800343 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d787c3bb-e28b-4a64-a403-3c93d860ab22 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:21.808174 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bd8be27a-3be9-49b9-b464-e142187cf194 tempest-FlavorsExtraSpecsTestJSON-719717567 tempest-FlavorsExtraSpecsTestJSON-719717567-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:21.808338 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-d787c3bb-e28b-4a64-a403-3c93d860ab22 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 23 01:10:21.809580 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d787c3bb-e28b-4a64-a403-3c93d860ab22 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] Request method failure captured: Oct 23 01:10:21.809580 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/flavors/1900078191/os-flavor-access HTTP/1.1 Oct 23 01:10:21.809580 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:10:21.809580 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:10:21.809580 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:10:21.809580 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:10:21.809580 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:10:21.809580 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:10:21.809580 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:10:21.809580 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:10:21.809580 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJR6a50YwKecWoSVwMAfRA1tIpp71KKynfExNF51lqleY-g0Yg5MaTBTEvLCpp0eohrs_nkyaMNGrlXFTfvplULV_EwgumTMxcZ1nElYhdtheNwxtU9dnUC-o0Qyha_GrFxpvXGXW3DOg9NGSSftnGCR2EFWZaEfcBHRB_cRYpLDrns Oct 23 01:10:21.809580 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:10:21.809580 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:10:21.809580 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:10:21.809580 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:10:21.809580 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:10:21.809580 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:10:21.809580 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: f6c73949b77f4bc1a11502d092ace444 Oct 23 01:10:21.809580 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-299257373 Oct 23 01:10:21.809580 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,admin,reader Oct 23 01:10:21.809580 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,admin,reader Oct 23 01:10:21.810882 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f6c73949b77f4bc1a11502d092ace444"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f6c73949b77f4bc1a11502d092ace444"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f6c73949b77f4bc1a11502d092ace444"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f6c73949b77f4bc1a11502d092ace444"}]}] Oct 23 01:10:21.810882 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-299257373 Oct 23 01:10:21.810882 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: f6c73949b77f4bc1a11502d092ace444 Oct 23 01:10:21.810882 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-299257373 Oct 23 01:10:21.810882 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin Oct 23 01:10:21.810882 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:10:21.810882 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:10:21.810882 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 41bbdf429a464a5bbaf79131085193cb Oct 23 01:10:21.810882 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin Oct 23 01:10:21.810882 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:10:21.810882 n-d-master-1 devstack@n-api.service[120944]: exception: Access list not available for public flavors. Oct 23 01:10:21.810882 n-d-master-1 devstack@n-api.service[120944]: action_args: {'flavor_id': '1900078191'} Oct 23 01:10:21.811675 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:10:21.811675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:21.811675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:21.811675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:21.811675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:10:21.811675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:10:21.811675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:10:21.811675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:10:21.811675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 23 01:10:21.811675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 23 01:10:21.811675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 23 01:10:21.811675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:21.811675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:21.811675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:21.811675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:21.811675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:21.811675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:21.811675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:10:21.811675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:10:21.811675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 23 01:10:21.811675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:21.812945 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d787c3bb-e28b-4a64-a403-3c93d860ab22 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:10:21.812945 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d787c3bb-e28b-4a64-a403-3c93d860ab22 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/1900078191/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.014255 Oct 23 01:10:21.812945 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 23/48] 10.222.0.42 () {58 vars in 1209 bytes} [Sun Oct 23 01:10:21 2022] GET /compute/v2.1/flavors/1900078191/os-flavor-access => generated 91 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:10:21.815845 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e7fbcfe1-eb71-4b87-a3c1-1fdb222279b9 tempest-HostsAdminNegativeTestJSON-2064242850 tempest-HostsAdminNegativeTestJSON-2064242850-project-admin] Action: 'update', calling method: .version_select at 0x7f5cc2c165e0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:21.823621 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e7fbcfe1-eb71-4b87-a3c1-1fdb222279b9 tempest-HostsAdminNegativeTestJSON-2064242850 tempest-HostsAdminNegativeTestJSON-2064242850-project-admin] Request method failure captured: Oct 23 01:10:21.823621 n-d-master-1 devstack@n-api.service[120944]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Oct 23 01:10:21.823621 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:10:21.823621 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:10:21.823621 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:10:21.823621 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 51 Oct 23 01:10:21.823621 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:10:21.823621 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:10:21.823621 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:10:21.823621 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:10:21.823621 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJR6rCO4RAQtmAaMYg5W_BMbxElf_L8ZdjHlaY6BSuALiR62TdDQervkGoWWiemTVz2KZEYiMnbbIT2i-fnCJlSbeOlZ-tLbqbX4Q3xK0K_e25xn276wsKPaHVbKu022KNmjEEC20r0l3ZB7lIJ0SyOK0YRtr89I4_GzvD7bu0_0qM8 Oct 23 01:10:21.823621 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:10:21.823621 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:10:21.823621 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:10:21.823621 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:10:21.823621 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:10:21.823621 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:10:21.823621 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 9dec106b1fee4cbaaf8052b1374d8192 Oct 23 01:10:21.823621 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2064242850 Oct 23 01:10:21.823621 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,admin,reader Oct 23 01:10:21.823621 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,admin,reader Oct 23 01:10:21.824958 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9dec106b1fee4cbaaf8052b1374d8192"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9dec106b1fee4cbaaf8052b1374d8192"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9dec106b1fee4cbaaf8052b1374d8192"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9dec106b1fee4cbaaf8052b1374d8192"}]}] Oct 23 01:10:21.824958 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2064242850 Oct 23 01:10:21.824958 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 9dec106b1fee4cbaaf8052b1374d8192 Oct 23 01:10:21.824958 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2064242850 Oct 23 01:10:21.824958 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-HostsAdminNegativeTestJSON-2064242850-project-admin Oct 23 01:10:21.824958 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:10:21.824958 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:10:21.824958 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: f0a177c2d5b747fa889814116e3050df Oct 23 01:10:21.824958 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2064242850-project-admin Oct 23 01:10:21.824958 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:10:21.824958 n-d-master-1 devstack@n-api.service[120944]: {"status": "invalid", "maintenance_mode": "enable"} Oct 23 01:10:21.824958 n-d-master-1 devstack@n-api.service[120944]: method: Oct 23 01:10:21.824958 n-d-master-1 devstack@n-api.service[120944]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 23 01:10:21.825735 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'n-d-master-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 23 01:10:21.825735 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:10:21.825735 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:21.825735 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 23 01:10:21.825735 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 23 01:10:21.825735 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 01:10:21.825735 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise error Oct 23 01:10:21.825735 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 23 01:10:21.825735 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:21.825735 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 23 01:10:21.825735 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 23 01:10:21.825735 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi 'disable', Oct 23 01:10:21.825735 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi 'Enable', Oct 23 01:10:21.825735 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi 'Disable', Oct 23 01:10:21.825735 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 23 01:10:21.825735 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 23 01:10:21.825735 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 23 01:10:21.825735 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:21.825735 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi On instance: Oct 23 01:10:21.825735 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi 'invalid' Oct 23 01:10:21.825735 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:21.825735 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:21.825735 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:21.825735 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:21.825735 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:21.827178 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:21.827178 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:10:21.827178 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:10:21.827178 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:10:21.827178 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:10:21.827178 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:10:21.827178 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:10:21.827178 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 23 01:10:21.827178 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 23 01:10:21.827178 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 23 01:10:21.827178 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 23 01:10:21.827178 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 23 01:10:21.827178 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 23 01:10:21.827178 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 23 01:10:21.827178 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:21.827178 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:21.827178 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:21.827178 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:21.827178 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:21.828243 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:21.828243 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 23 01:10:21.828243 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 23 01:10:21.828243 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 23 01:10:21.828243 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:21.828243 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e7fbcfe1-eb71-4b87-a3c1-1fdb222279b9 tempest-HostsAdminNegativeTestJSON-2064242850 tempest-HostsAdminNegativeTestJSON-2064242850-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:10:21.828243 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e7fbcfe1-eb71-4b87-a3c1-1fdb222279b9 tempest-HostsAdminNegativeTestJSON-2064242850 tempest-HostsAdminNegativeTestJSON-2064242850-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 400 len: 189 microversion: 2.1 time: 0.012547 Oct 23 01:10:21.828243 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 24/49] 10.222.0.42 () {60 vars in 1187 bytes} [Sun Oct 23 01:10:21 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 189 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:10:21.834572 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bd8be27a-3be9-49b9-b464-e142187cf194 tempest-FlavorsExtraSpecsTestJSON-719717567 tempest-FlavorsExtraSpecsTestJSON-719717567-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5418 microversion: 2.1 time: 0.038143 Oct 23 01:10:21.834863 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f27cd245-b02c-4ab8-a070-b33ab96b865e tempest-AggregatesAdminTestV241-117911304 tempest-AggregatesAdminTestV241-117911304-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1490525895"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:21.836397 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 26/50] 10.222.0.42 () {58 vars in 1146 bytes} [Sun Oct 23 01:10:21 2022] GET /compute/v2.1/flavors/detail => generated 5418 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:10:22.075064 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-095aa1f6-ec1c-4663-98a5-88c96affd49d tempest-AggregatesAdminNegativeTestJSON-1610882433 tempest-AggregatesAdminNegativeTestJSON-1610882433-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:22.076365 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f27cd245-b02c-4ab8-a070-b33ab96b865e tempest-AggregatesAdminTestV241-117911304 tempest-AggregatesAdminTestV241-117911304-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-aggregates/3" status: 200 len: 299 microversion: 2.41 time: 0.244131 Oct 23 01:10:22.078939 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 25/51] 10.222.0.42 () {62 vars in 1210 bytes} [Sun Oct 23 01:10:21 2022] PUT /compute/v2.1/os-aggregates/3 => generated 299 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:10:22.084277 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-095aa1f6-ec1c-4663-98a5-88c96affd49d tempest-AggregatesAdminNegativeTestJSON-1610882433 tempest-AggregatesAdminNegativeTestJSON-1610882433-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '34675ffa7f9f4e76bad646189402680c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8c9aca8184f35a7b6f80eea34b649', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:10:22.088148 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-095aa1f6-ec1c-4663-98a5-88c96affd49d tempest-AggregatesAdminNegativeTestJSON-1610882433 tempest-AggregatesAdminNegativeTestJSON-1610882433-project] Request method failure captured: Oct 23 01:10:22.088148 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Oct 23 01:10:22.088148 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:10:22.088148 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:10:22.088148 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:10:22.088148 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 39 Oct 23 01:10:22.088148 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:10:22.088148 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:10:22.088148 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:10:22.088148 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:10:22.088148 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJR3Zl2BtzKGwwhxnKOkL3SBwPh6K1bBDXmmD4Fw2D9__OVip2GwIqaGm1CTez-CDx9B-NJLhLu9q1X0SBx0ha3VvkDzyf4xbFkysFI0EGNOfN9iTe-b4dZ-0yhw5LeWMcz3MBCuq6EDlExMyx8DTw1tSX2ydpTVLNYqnZkJ7ORgKCM Oct 23 01:10:22.088148 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:10:22.088148 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:10:22.088148 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:10:22.088148 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:10:22.088148 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:10:22.088148 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:10:22.088148 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: f5e8c9aca8184f35a7b6f80eea34b649 Oct 23 01:10:22.088148 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1610882433 Oct 23 01:10:22.088148 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:10:22.088148 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:10:22.089514 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f5e8c9aca8184f35a7b6f80eea34b649"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f5e8c9aca8184f35a7b6f80eea34b649"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f5e8c9aca8184f35a7b6f80eea34b649"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f5e8c9aca8184f35a7b6f80eea34b649"}]}] Oct 23 01:10:22.089514 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1610882433 Oct 23 01:10:22.089514 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: f5e8c9aca8184f35a7b6f80eea34b649 Oct 23 01:10:22.089514 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1610882433 Oct 23 01:10:22.089514 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-AggregatesAdminNegativeTestJSON-1610882433-project Oct 23 01:10:22.089514 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:10:22.089514 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:10:22.089514 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 34675ffa7f9f4e76bad646189402680c Oct 23 01:10:22.089514 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1610882433-project Oct 23 01:10:22.089514 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:10:22.089514 n-d-master-1 devstack@n-api.service[120945]: {"add_host": {"host": "n-h1-master-1"}} Oct 23 01:10:22.089514 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:10:22.089514 n-d-master-1 devstack@n-api.service[120945]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 23 01:10:22.090370 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h1-master-1'}}} Oct 23 01:10:22.090370 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:10:22.090370 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:22.090370 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:22.090370 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:22.090370 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:10:22.090370 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:10:22.090370 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:10:22.090370 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:10:22.090370 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:10:22.090370 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:10:22.090370 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 23 01:10:22.090370 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 23 01:10:22.090370 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 23 01:10:22.090370 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 23 01:10:22.090370 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 23 01:10:22.090370 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 23 01:10:22.090370 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:10:22.090370 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 23 01:10:22.091460 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:10:22.091460 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise self.value Oct 23 01:10:22.091460 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 23 01:10:22.091460 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 23 01:10:22.091460 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 23 01:10:22.091460 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 23 01:10:22.091460 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 23 01:10:22.091460 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 23 01:10:22.091460 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 23 01:10:22.091460 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:22.091460 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:22.091460 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:22.091460 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:22.091460 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:22.091460 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:22.091460 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 23 01:10:22.091460 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 23 01:10:22.091460 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 23 01:10:22.091460 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:22.092711 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-095aa1f6-ec1c-4663-98a5-88c96affd49d tempest-AggregatesAdminNegativeTestJSON-1610882433 tempest-AggregatesAdminNegativeTestJSON-1610882433-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:10:22.092789 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cf744685-3e97-4e2e-b541-0078ec019761 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:22.092869 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-095aa1f6-ec1c-4663-98a5-88c96affd49d tempest-AggregatesAdminNegativeTestJSON-1610882433 tempest-AggregatesAdminNegativeTestJSON-1610882433-project] 10.222.0.42 "POST /compute/v2.1/os-aggregates/2/action" status: 403 len: 118 microversion: 2.1 time: 0.253312 Oct 23 01:10:22.093330 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 27/52] 10.222.0.42 () {60 vars in 1191 bytes} [Sun Oct 23 01:10:21 2022] POST /compute/v2.1/os-aggregates/2/action => generated 118 bytes in 257 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:10:22.104500 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-badeaca1-7566-44ba-969e-304d01f125c1 tempest-HostsAdminNegativeTestJSON-975942463 tempest-HostsAdminNegativeTestJSON-975942463-project] Action: 'update', calling method: .version_select at 0x7f5cc2c2f8b0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:22.108211 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-badeaca1-7566-44ba-969e-304d01f125c1 tempest-HostsAdminNegativeTestJSON-975942463 tempest-HostsAdminNegativeTestJSON-975942463-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '49264f1d1b5d40269c7a6853c702917f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b095d4940ef84515aaa3c6e0e4a07538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:10:22.110182 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-badeaca1-7566-44ba-969e-304d01f125c1 tempest-HostsAdminNegativeTestJSON-975942463 tempest-HostsAdminNegativeTestJSON-975942463-project] Request method failure captured: Oct 23 01:10:22.110182 n-d-master-1 devstack@n-api.service[120945]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Oct 23 01:10:22.110182 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:10:22.110182 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:10:22.110182 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:10:22.110182 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 50 Oct 23 01:10:22.110182 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:10:22.110182 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:10:22.110182 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:10:22.110182 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:10:22.110182 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJR33WNzHitCGWLeZUuYvoVCyAJAPGMASGp5pZhBZUSUP0xcCIfjAdGjrbPKqBpSoDMw9AiBj2Ttk45sbosyagjn-nsi59PaISh3I5UxS_bo2f0Xn0jXOYBGTVe1D7ziB0qKF8fXdIEsJ0kJr3K8i9mbIHeaCbHznvAAbAZ-LeX6g74 Oct 23 01:10:22.110182 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:10:22.110182 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:10:22.110182 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:10:22.110182 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:10:22.110182 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:10:22.110182 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:10:22.110182 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: b095d4940ef84515aaa3c6e0e4a07538 Oct 23 01:10:22.110182 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-975942463 Oct 23 01:10:22.110182 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:10:22.110182 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:10:22.111468 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b095d4940ef84515aaa3c6e0e4a07538"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b095d4940ef84515aaa3c6e0e4a07538"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b095d4940ef84515aaa3c6e0e4a07538"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b095d4940ef84515aaa3c6e0e4a07538"}]}] Oct 23 01:10:22.111468 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-HostsAdminNegativeTestJSON-975942463 Oct 23 01:10:22.111468 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: b095d4940ef84515aaa3c6e0e4a07538 Oct 23 01:10:22.111468 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-975942463 Oct 23 01:10:22.111468 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-HostsAdminNegativeTestJSON-975942463-project Oct 23 01:10:22.111468 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:10:22.111468 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:10:22.111468 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 49264f1d1b5d40269c7a6853c702917f Oct 23 01:10:22.111468 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-HostsAdminNegativeTestJSON-975942463-project Oct 23 01:10:22.111468 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:10:22.111468 n-d-master-1 devstack@n-api.service[120945]: {"status": "enable", "maintenance_mode": "enable"} Oct 23 01:10:22.111468 n-d-master-1 devstack@n-api.service[120945]: method: Oct 23 01:10:22.111468 n-d-master-1 devstack@n-api.service[120945]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 23 01:10:22.111468 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'n-d-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 23 01:10:22.112349 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:10:22.112349 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:22.112349 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:22.112349 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:22.112349 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:10:22.112349 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:10:22.112349 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:10:22.112349 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:10:22.112349 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:10:22.112349 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:10:22.112349 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:10:22.112349 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:10:22.112349 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 23 01:10:22.112349 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 23 01:10:22.112349 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 23 01:10:22.112349 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 23 01:10:22.112349 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 23 01:10:22.112349 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 23 01:10:22.112349 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:10:22.112349 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 23 01:10:22.113507 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:10:22.113507 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise self.value Oct 23 01:10:22.113507 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 23 01:10:22.113507 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 23 01:10:22.113507 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 23 01:10:22.113507 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 23 01:10:22.113507 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 23 01:10:22.113507 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 23 01:10:22.113507 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 23 01:10:22.113507 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:22.113507 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:22.113507 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:22.113507 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:22.113507 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:22.113507 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:22.113507 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 23 01:10:22.113507 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 23 01:10:22.113507 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 23 01:10:22.113507 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:22.115848 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-badeaca1-7566-44ba-969e-304d01f125c1 tempest-HostsAdminNegativeTestJSON-975942463 tempest-HostsAdminNegativeTestJSON-975942463-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:10:22.117225 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-badeaca1-7566-44ba-969e-304d01f125c1 tempest-HostsAdminNegativeTestJSON-975942463 tempest-HostsAdminNegativeTestJSON-975942463-project] 10.222.0.42 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 403 len: 111 microversion: 2.1 time: 0.021301 Oct 23 01:10:22.117936 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 28/53] 10.222.0.42 () {60 vars in 1187 bytes} [Sun Oct 23 01:10:22 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 111 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:10:22.129145 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-dcfa9bfa-59c0-441a-840e-921edad8dc42 tempest-AggregatesAdminTestV241-117911304 tempest-AggregatesAdminTestV241-117911304-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:22.146608 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-dcfa9bfa-59c0-441a-840e-921edad8dc42 tempest-AggregatesAdminTestV241-117911304 tempest-AggregatesAdminTestV241-117911304-project-admin] 10.222.0.42 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 299 microversion: 2.41 time: 0.023579 Oct 23 01:10:22.148756 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 29/54] 10.222.0.42 () {60 vars in 1190 bytes} [Sun Oct 23 01:10:22 2022] GET /compute/v2.1/os-aggregates/3 => generated 299 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:10:22.153126 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b8446528-6df1-42a3-9cda-109e77f993df tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:22.164961 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=5,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=10 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:22.202491 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cf744685-3e97-4e2e-b541-0078ec019761 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/1900078191" status: 202 len: 0 microversion: 2.1 time: 0.121529 Oct 23 01:10:22.203087 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 26/55] 10.222.0.42 () {58 vars in 1161 bytes} [Sun Oct 23 01:10:22 2022] DELETE /compute/v2.1/flavors/1900078191 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:10:22.209415 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-267c1073-c8c5-467a-b6c8-2d6015e0a7a7 tempest-HostsAdminNegativeTestJSON-2064242850 tempest-HostsAdminNegativeTestJSON-2064242850-project-admin] Action: 'update', calling method: .version_select at 0x7f5cc2c1f550>, body: {"status": null, "maintenance_mode": null} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:22.213507 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-267c1073-c8c5-467a-b6c8-2d6015e0a7a7 tempest-HostsAdminNegativeTestJSON-2064242850 tempest-HostsAdminNegativeTestJSON-2064242850-project-admin] Request method failure captured: Oct 23 01:10:22.213507 n-d-master-1 devstack@n-api.service[120944]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Oct 23 01:10:22.213507 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:10:22.213507 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:10:22.213507 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:10:22.213507 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 42 Oct 23 01:10:22.213507 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:10:22.213507 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:10:22.213507 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:10:22.213507 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:10:22.213507 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJR6rCO4RAQtmAaMYg5W_BMbxElf_L8ZdjHlaY6BSuALiR62TdDQervkGoWWiemTVz2KZEYiMnbbIT2i-fnCJlSbeOlZ-tLbqbX4Q3xK0K_e25xn276wsKPaHVbKu022KNmjEEC20r0l3ZB7lIJ0SyOK0YRtr89I4_GzvD7bu0_0qM8 Oct 23 01:10:22.213507 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:10:22.213507 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:10:22.213507 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:10:22.213507 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:10:22.213507 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:10:22.213507 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:10:22.213507 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 9dec106b1fee4cbaaf8052b1374d8192 Oct 23 01:10:22.213507 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2064242850 Oct 23 01:10:22.213507 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,admin,reader Oct 23 01:10:22.213507 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,admin,reader Oct 23 01:10:22.214737 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9dec106b1fee4cbaaf8052b1374d8192"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9dec106b1fee4cbaaf8052b1374d8192"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9dec106b1fee4cbaaf8052b1374d8192"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9dec106b1fee4cbaaf8052b1374d8192"}]}] Oct 23 01:10:22.214737 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2064242850 Oct 23 01:10:22.214737 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 9dec106b1fee4cbaaf8052b1374d8192 Oct 23 01:10:22.214737 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2064242850 Oct 23 01:10:22.214737 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-HostsAdminNegativeTestJSON-2064242850-project-admin Oct 23 01:10:22.214737 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:10:22.214737 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:10:22.214737 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: f0a177c2d5b747fa889814116e3050df Oct 23 01:10:22.214737 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2064242850-project-admin Oct 23 01:10:22.214737 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:10:22.214737 n-d-master-1 devstack@n-api.service[120944]: {"status": null, "maintenance_mode": null} Oct 23 01:10:22.214737 n-d-master-1 devstack@n-api.service[120944]: method: Oct 23 01:10:22.214737 n-d-master-1 devstack@n-api.service[120944]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 23 01:10:22.214737 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'n-d-master-1', 'body': {'status': None, 'maintenance_mode': None}} Oct 23 01:10:22.215594 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:10:22.215594 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:22.215594 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 23 01:10:22.215594 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 23 01:10:22.215594 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 01:10:22.215594 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise error Oct 23 01:10:22.215594 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 23 01:10:22.215594 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:22.215594 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 23 01:10:22.215594 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 23 01:10:22.215594 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi 'disable', Oct 23 01:10:22.215594 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi 'Enable', Oct 23 01:10:22.215594 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi 'Disable', Oct 23 01:10:22.215594 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 23 01:10:22.215594 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 23 01:10:22.215594 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 23 01:10:22.215594 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:22.215594 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi On instance: Oct 23 01:10:22.215594 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi None Oct 23 01:10:22.215594 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:22.215594 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:22.215594 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:22.215594 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:22.215594 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:22.215594 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:22.217109 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:10:22.217109 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:10:22.217109 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:10:22.217109 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:10:22.217109 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:10:22.217109 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:10:22.217109 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 23 01:10:22.217109 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 23 01:10:22.217109 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 23 01:10:22.217109 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 23 01:10:22.217109 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 23 01:10:22.217109 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 23 01:10:22.217109 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 23 01:10:22.217109 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:22.217109 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:22.217109 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:22.217109 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:22.217109 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:22.217109 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:22.219841 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 23 01:10:22.219841 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 23 01:10:22.219841 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 23 01:10:22.219841 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:22.219841 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-267c1073-c8c5-467a-b6c8-2d6015e0a7a7 tempest-HostsAdminNegativeTestJSON-2064242850 tempest-HostsAdminNegativeTestJSON-2064242850-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:10:22.219841 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-267c1073-c8c5-467a-b6c8-2d6015e0a7a7 tempest-HostsAdminNegativeTestJSON-2064242850 tempest-HostsAdminNegativeTestJSON-2064242850-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 400 len: 127 microversion: 2.1 time: 0.010860 Oct 23 01:10:22.219841 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 27/56] 10.222.0.42 () {60 vars in 1187 bytes} [Sun Oct 23 01:10:22 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 127 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:10:22.222191 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-26cc6219-c50f-4fe9-8802-8f1e83803bb6 tempest-AggregatesAdminTestV241-117911304 tempest-AggregatesAdminTestV241-117911304-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:22.234313 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-26cc6219-c50f-4fe9-8802-8f1e83803bb6 tempest-AggregatesAdminTestV241-117911304 tempest-AggregatesAdminTestV241-117911304-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:22.234822 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-26cc6219-c50f-4fe9-8802-8f1e83803bb6 tempest-AggregatesAdminTestV241-117911304 tempest-AggregatesAdminTestV241-117911304-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:22.239746 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-26cc6219-c50f-4fe9-8802-8f1e83803bb6 tempest-AggregatesAdminTestV241-117911304 tempest-AggregatesAdminTestV241-117911304-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:22.240400 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b8446528-6df1-42a3-9cda-109e77f993df tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.090065 Oct 23 01:10:22.242428 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 30/57] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Oct 23 01:10:22 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 23 01:10:22.247244 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ab736bfe-f12f-4d7d-a6f6-4a881e661309 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:22.270830 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ab736bfe-f12f-4d7d-a6f6-4a881e661309 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027111 Oct 23 01:10:22.271457 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 31/58] 10.222.0.42 () {58 vars in 1146 bytes} [Sun Oct 23 01:10:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:10:22.275990 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b2165453-71ee-4bc2-8b46-d0026abe6f05 tempest-HostsAdminNegativeTestJSON-2064242850 tempest-HostsAdminNegativeTestJSON-2064242850-project-admin] Action: 'update', calling method: .version_select at 0x7f5cc2c2f160>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:22.279453 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.hosts [None req-b2165453-71ee-4bc2-8b46-d0026abe6f05 tempest-HostsAdminNegativeTestJSON-2064242850 tempest-HostsAdminNegativeTestJSON-2064242850-project-admin] Enabling host nonexistent_hostname. Oct 23 01:10:22.290122 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-b2165453-71ee-4bc2-8b46-d0026abe6f05 tempest-HostsAdminNegativeTestJSON-2064242850 tempest-HostsAdminNegativeTestJSON-2064242850-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 23 01:10:22.292344 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b2165453-71ee-4bc2-8b46-d0026abe6f05 tempest-HostsAdminNegativeTestJSON-2064242850 tempest-HostsAdminNegativeTestJSON-2064242850-project-admin] Request method failure captured: Oct 23 01:10:22.292344 n-d-master-1 devstack@n-api.service[120945]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 23 01:10:22.292344 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:10:22.292344 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:10:22.292344 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:10:22.292344 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 50 Oct 23 01:10:22.292344 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:10:22.292344 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:10:22.292344 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:10:22.292344 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:10:22.292344 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJR6rCO4RAQtmAaMYg5W_BMbxElf_L8ZdjHlaY6BSuALiR62TdDQervkGoWWiemTVz2KZEYiMnbbIT2i-fnCJlSbeOlZ-tLbqbX4Q3xK0K_e25xn276wsKPaHVbKu022KNmjEEC20r0l3ZB7lIJ0SyOK0YRtr89I4_GzvD7bu0_0qM8 Oct 23 01:10:22.292344 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:10:22.292344 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:10:22.292344 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:10:22.292344 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:10:22.292344 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:10:22.292344 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:10:22.292344 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 9dec106b1fee4cbaaf8052b1374d8192 Oct 23 01:10:22.292344 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2064242850 Oct 23 01:10:22.292344 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,admin,reader Oct 23 01:10:22.292344 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,admin,reader Oct 23 01:10:22.293995 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9dec106b1fee4cbaaf8052b1374d8192"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9dec106b1fee4cbaaf8052b1374d8192"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9dec106b1fee4cbaaf8052b1374d8192"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9dec106b1fee4cbaaf8052b1374d8192"}]}] Oct 23 01:10:22.293995 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2064242850 Oct 23 01:10:22.293995 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 9dec106b1fee4cbaaf8052b1374d8192 Oct 23 01:10:22.293995 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2064242850 Oct 23 01:10:22.293995 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-HostsAdminNegativeTestJSON-2064242850-project-admin Oct 23 01:10:22.293995 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:10:22.293995 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:10:22.293995 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: f0a177c2d5b747fa889814116e3050df Oct 23 01:10:22.293995 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2064242850-project-admin Oct 23 01:10:22.293995 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:10:22.293995 n-d-master-1 devstack@n-api.service[120945]: {"status": "enable", "maintenance_mode": "enable"} Oct 23 01:10:22.293995 n-d-master-1 devstack@n-api.service[120945]: method: Oct 23 01:10:22.293995 n-d-master-1 devstack@n-api.service[120945]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 23 01:10:22.293995 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 23 01:10:22.300699 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:10:22.300699 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:22.300699 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 23 01:10:22.300699 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 23 01:10:22.300699 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 23 01:10:22.300699 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 23 01:10:22.300699 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:10:22.300699 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 23 01:10:22.300699 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:10:22.300699 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise self.value Oct 23 01:10:22.300699 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 23 01:10:22.300699 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 23 01:10:22.300699 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 23 01:10:22.300699 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 23 01:10:22.300699 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 01:10:22.300699 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 01:10:22.300699 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 23 01:10:22.300699 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 23 01:10:22.301729 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 23 01:10:22.301729 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 23 01:10:22.301729 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 23 01:10:22.301729 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 23 01:10:22.301729 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 23 01:10:22.301729 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:22.301729 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:22.301729 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:22.301729 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:22.301729 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:22.301729 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:22.301729 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:10:22.301729 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:10:22.301729 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:10:22.301729 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:10:22.301729 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:10:22.301729 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:10:22.301729 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:10:22.301729 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:10:22.301729 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 23 01:10:22.303575 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 23 01:10:22.303575 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 23 01:10:22.303575 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:10:22.303575 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 23 01:10:22.303575 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:22.303575 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:22.303575 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:22.303575 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:22.303575 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:22.303575 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:22.303575 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:10:22.303575 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:10:22.303575 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 23 01:10:22.303575 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:22.303575 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b2165453-71ee-4bc2-8b46-d0026abe6f05 tempest-HostsAdminNegativeTestJSON-2064242850 tempest-HostsAdminNegativeTestJSON-2064242850-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:10:22.304336 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b2165453-71ee-4bc2-8b46-d0026abe6f05 tempest-HostsAdminNegativeTestJSON-2064242850 tempest-HostsAdminNegativeTestJSON-2064242850-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.023448 Oct 23 01:10:22.304336 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 32/59] 10.222.0.42 () {60 vars in 1211 bytes} [Sun Oct 23 01:10:22 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:10:22.305838 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-67e778bc-51e6-4484-8aae-036d9bd0a6b1 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1947439398"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:22.309369 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.aggregate [None req-67e778bc-51e6-4484-8aae-036d9bd0a6b1 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Generated uuid b3df5dc6-971d-4185-83d2-3a181bd01c86 for aggregate {{(pid=120945) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 23 01:10:22.400679 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-67e778bc-51e6-4484-8aae-036d9bd0a6b1 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.103123 Oct 23 01:10:22.406019 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 33/60] 10.222.0.42 () {60 vars in 1164 bytes} [Sun Oct 23 01:10:22 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:10:22.425371 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-46ce296b-4e0a-4b46-b608-a8fad369bc59 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1168908419", "id": 1692872942, "os-flavor-access:is_public": "False"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:22.583214 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-26cc6219-c50f-4fe9-8802-8f1e83803bb6 tempest-AggregatesAdminTestV241-117911304 tempest-AggregatesAdminTestV241-117911304-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 314 microversion: 2.41 time: 0.365969 Oct 23 01:10:22.584024 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 28/61] 10.222.0.42 () {62 vars in 1232 bytes} [Sun Oct 23 01:10:22 2022] POST /compute/v2.1/os-aggregates/3/action => generated 314 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:10:22.586501 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-46ce296b-4e0a-4b46-b608-a8fad369bc59 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.183989 Oct 23 01:10:22.587083 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 34/62] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:10:22 2022] POST /compute/v2.1/flavors => generated 439 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:10:22.589117 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3bf2e2b5-9e63-4575-84d9-6839e7313609 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1951765411"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:22.596621 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ca983626-a04e-421a-bf20-8ac9009f18fb tempest-AggregatesAdminTestV241-117911304 tempest-AggregatesAdminTestV241-117911304-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:22.600428 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3bf2e2b5-9e63-4575-84d9-6839e7313609 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:22.601153 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3bf2e2b5-9e63-4575-84d9-6839e7313609 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:22.602392 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3bf2e2b5-9e63-4575-84d9-6839e7313609 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:22.609177 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca983626-a04e-421a-bf20-8ac9009f18fb tempest-AggregatesAdminTestV241-117911304 tempest-AggregatesAdminTestV241-117911304-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:22.609673 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca983626-a04e-421a-bf20-8ac9009f18fb tempest-AggregatesAdminTestV241-117911304 tempest-AggregatesAdminTestV241-117911304-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:22.610399 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca983626-a04e-421a-bf20-8ac9009f18fb tempest-AggregatesAdminTestV241-117911304 tempest-AggregatesAdminTestV241-117911304-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:22.629020 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3bf2e2b5-9e63-4575-84d9-6839e7313609 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:22.629523 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3bf2e2b5-9e63-4575-84d9-6839e7313609 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:22.629963 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3bf2e2b5-9e63-4575-84d9-6839e7313609 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:22.639104 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-3bf2e2b5-9e63-4575-84d9-6839e7313609 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1951765411 could not be found. Oct 23 01:10:22.641363 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3bf2e2b5-9e63-4575-84d9-6839e7313609 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Request method failure captured: Oct 23 01:10:22.641363 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Oct 23 01:10:22.641363 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:10:22.641363 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:10:22.641363 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:10:22.641363 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 58 Oct 23 01:10:22.641363 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:10:22.641363 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:10:22.641363 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:10:22.641363 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:10:22.641363 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJR6uWpBWdYCU3FR3UdoEx-fMaz2UGR5pio_u8SLfmmO-xfXencIRstHwi_Dw1PfAe0x1eMlxmZ6THsATqCgMSh9GyYyHR4KIJavXyOEvOQW15VbBizjWDSEpnZfpOpsyayKQQRznHbCGxQs1k0NC8h-UgwtBKrA40pVUR9jzpGlGvk Oct 23 01:10:22.641363 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:10:22.641363 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:10:22.641363 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:10:22.641363 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:10:22.641363 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:10:22.641363 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:10:22.641363 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 24682a566a714ef586033a6e2992e4e4 Oct 23 01:10:22.641363 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-223261651 Oct 23 01:10:22.641363 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,admin,reader Oct 23 01:10:22.641363 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,admin,reader Oct 23 01:10:22.642651 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/24682a566a714ef586033a6e2992e4e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_24682a566a714ef586033a6e2992e4e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/24682a566a714ef586033a6e2992e4e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/24682a566a714ef586033a6e2992e4e4"}]}] Oct 23 01:10:22.642651 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-223261651 Oct 23 01:10:22.642651 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 24682a566a714ef586033a6e2992e4e4 Oct 23 01:10:22.642651 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-223261651 Oct 23 01:10:22.642651 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin Oct 23 01:10:22.642651 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:10:22.642651 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:10:22.642651 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: a997cd84907845e2a0df8ae40a0fd4bf Oct 23 01:10:22.642651 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin Oct 23 01:10:22.642651 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:10:22.642651 n-d-master-1 devstack@n-api.service[120944]: {"add_host": {"host": "tempest-nonexist_host-1951765411"}} Oct 23 01:10:22.642651 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:10:22.642651 n-d-master-1 devstack@n-api.service[120944]: exception: Compute host tempest-nonexist_host-1951765411 could not be found. Oct 23 01:10:22.643550 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '4', 'body': {'add_host': {'host': 'tempest-nonexist_host-1951765411'}}} Oct 23 01:10:22.643550 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:10:22.643550 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:22.643550 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 23 01:10:22.643550 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 23 01:10:22.643550 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 01:10:22.643550 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 01:10:22.643550 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 23 01:10:22.643550 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 23 01:10:22.643550 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 23 01:10:22.643550 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 23 01:10:22.643550 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 23 01:10:22.643550 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 23 01:10:22.643550 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1951765411' is not mapped to any cell Oct 23 01:10:22.643550 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:22.643550 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:22.643550 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:22.643550 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:22.643550 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 23 01:10:22.644656 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 23 01:10:22.644656 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 23 01:10:22.644656 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 23 01:10:22.644656 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 23 01:10:22.644656 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:22.644656 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:22.644656 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:22.644656 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:22.644656 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 23 01:10:22.644656 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 23 01:10:22.644656 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 23 01:10:22.644656 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 23 01:10:22.644656 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:10:22.644656 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 23 01:10:22.644656 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:10:22.644656 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise self.value Oct 23 01:10:22.644656 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 23 01:10:22.644656 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 23 01:10:22.644656 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 23 01:10:22.644656 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 23 01:10:22.645776 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 23 01:10:22.645776 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 23 01:10:22.645776 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1951765411 could not be found. Oct 23 01:10:22.645776 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:22.645776 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:22.645776 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:22.645776 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:22.645776 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:22.645776 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:22.645776 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:10:22.645776 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:10:22.645776 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:10:22.645776 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:10:22.645776 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:10:22.645776 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:10:22.645776 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 23 01:10:22.645776 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:10:22.645776 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1951765411 could not be found. Oct 23 01:10:22.645776 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:22.645776 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:22.645776 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:22.647485 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:22.647485 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:22.647485 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:22.647485 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:10:22.647485 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:10:22.647485 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1951765411 could not be found. Oct 23 01:10:22.647485 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:22.647485 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3bf2e2b5-9e63-4575-84d9-6839e7313609 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1951765411 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:10:22.647485 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3bf2e2b5-9e63-4575-84d9-6839e7313609 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 111 microversion: 2.1 time: 0.057722 Oct 23 01:10:22.647485 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 29/63] 10.222.0.42 () {60 vars in 1191 bytes} [Sun Oct 23 01:10:22 2022] POST /compute/v2.1/os-aggregates/4/action => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:10:22.926987 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ca983626-a04e-421a-bf20-8ac9009f18fb tempest-AggregatesAdminTestV241-117911304 tempest-AggregatesAdminTestV241-117911304-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 299 microversion: 2.41 time: 0.334056 Oct 23 01:10:22.927678 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 35/64] 10.222.0.42 () {62 vars in 1232 bytes} [Sun Oct 23 01:10:22 2022] POST /compute/v2.1/os-aggregates/3/action => generated 299 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:10:22.939153 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bc16ae27-31f8-4da8-8c2e-646fa4f1da96 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:23.064184 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bc16ae27-31f8-4da8-8c2e-646fa4f1da96 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.134907 Oct 23 01:10:23.065066 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 36/65] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Oct 23 01:10:22 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 23 01:10:23.069659 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-138da0e8-73b6-45c5-94b2-c988991ce0d5 tempest-AggregatesAdminTestV241-117911304 tempest-AggregatesAdminTestV241-117911304-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:23.156018 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-138da0e8-73b6-45c5-94b2-c988991ce0d5 tempest-AggregatesAdminTestV241-117911304 tempest-AggregatesAdminTestV241-117911304-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.41 time: 0.089689 Oct 23 01:10:23.157834 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 37/66] 10.222.0.42 () {60 vars in 1193 bytes} [Sun Oct 23 01:10:23 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:10:23.165094 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4b1ff681-b013-42c5-ace7-bf080ea551de tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:23.169569 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4b1ff681-b013-42c5-ace7-bf080ea551de tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Request method failure captured: Oct 23 01:10:23.169569 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 23 01:10:23.169569 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:10:23.169569 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:10:23.169569 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:10:23.169569 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 283 Oct 23 01:10:23.169569 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:10:23.169569 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:10:23.169569 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:10:23.169569 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:10:23.169569 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJR6uWpBWdYCU3FR3UdoEx-fMaz2UGR5pio_u8SLfmmO-xfXencIRstHwi_Dw1PfAe0x1eMlxmZ6THsATqCgMSh9GyYyHR4KIJavXyOEvOQW15VbBizjWDSEpnZfpOpsyayKQQRznHbCGxQs1k0NC8h-UgwtBKrA40pVUR9jzpGlGvk Oct 23 01:10:23.169569 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:10:23.169569 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:10:23.169569 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:10:23.169569 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:10:23.169569 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:10:23.169569 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:10:23.169569 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 24682a566a714ef586033a6e2992e4e4 Oct 23 01:10:23.169569 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-223261651 Oct 23 01:10:23.169569 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,admin,reader Oct 23 01:10:23.169569 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,admin,reader Oct 23 01:10:23.170787 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/24682a566a714ef586033a6e2992e4e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_24682a566a714ef586033a6e2992e4e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/24682a566a714ef586033a6e2992e4e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/24682a566a714ef586033a6e2992e4e4"}]}] Oct 23 01:10:23.170787 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-223261651 Oct 23 01:10:23.170787 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 24682a566a714ef586033a6e2992e4e4 Oct 23 01:10:23.170787 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-223261651 Oct 23 01:10:23.170787 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin Oct 23 01:10:23.170787 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:10:23.170787 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:10:23.170787 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: a997cd84907845e2a0df8ae40a0fd4bf Oct 23 01:10:23.170787 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin Oct 23 01:10:23.170787 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:10:23.171370 n-d-master-1 devstack@n-api.service[120945]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 23 01:10:23.171370 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:10:23.171370 n-d-master-1 devstack@n-api.service[120945]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 23 01:10:23.171370 n-d-master-1 devstack@n-api.service[120945]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 23 01:10:23.171370 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:10:23.171370 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:23.171370 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 23 01:10:23.171370 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 23 01:10:23.171370 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 01:10:23.171370 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise error Oct 23 01:10:23.171987 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 23 01:10:23.171987 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:23.171987 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 23 01:10:23.171987 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 23 01:10:23.171987 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:23.171987 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 23 01:10:23.171987 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 23 01:10:23.171987 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:23.171987 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:23.171987 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:23.171987 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:23.171987 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:23.171987 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:23.171987 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:10:23.171987 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:10:23.171987 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:10:23.171987 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:10:23.172892 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:10:23.172892 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:10:23.172892 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 23 01:10:23.172892 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 23 01:10:23.172892 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 23 01:10:23.172892 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 23 01:10:23.172892 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 23 01:10:23.172892 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 23 01:10:23.172892 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 23 01:10:23.172892 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:23.172892 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:23.172892 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:23.172892 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:23.172892 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:23.172892 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:23.173756 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 23 01:10:23.173756 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 23 01:10:23.173756 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 23 01:10:23.173756 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:23.173756 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4b1ff681-b013-42c5-ace7-bf080ea551de tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:10:23.174138 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4b1ff681-b013-42c5-ace7-bf080ea551de tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.014162 Oct 23 01:10:23.179613 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 38/67] 10.222.0.42 () {60 vars in 1165 bytes} [Sun Oct 23 01:10:23 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:10:23.195679 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d9e552c1-8101-4e13-8ba5-29fbcef12b15 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:23.200577 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d9e552c1-8101-4e13-8ba5-29fbcef12b15 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Request method failure captured: Oct 23 01:10:23.200577 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 23 01:10:23.200577 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:10:23.200577 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:10:23.200577 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:10:23.200577 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 27 Oct 23 01:10:23.200577 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:10:23.200577 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:10:23.200577 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:10:23.200577 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:10:23.200577 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJR6uWpBWdYCU3FR3UdoEx-fMaz2UGR5pio_u8SLfmmO-xfXencIRstHwi_Dw1PfAe0x1eMlxmZ6THsATqCgMSh9GyYyHR4KIJavXyOEvOQW15VbBizjWDSEpnZfpOpsyayKQQRznHbCGxQs1k0NC8h-UgwtBKrA40pVUR9jzpGlGvk Oct 23 01:10:23.200577 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:10:23.200577 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:10:23.200577 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:10:23.200577 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:10:23.200577 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:10:23.200577 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:10:23.200577 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 24682a566a714ef586033a6e2992e4e4 Oct 23 01:10:23.200577 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-223261651 Oct 23 01:10:23.200577 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,admin,reader Oct 23 01:10:23.200577 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,admin,reader Oct 23 01:10:23.201855 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/24682a566a714ef586033a6e2992e4e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_24682a566a714ef586033a6e2992e4e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/24682a566a714ef586033a6e2992e4e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/24682a566a714ef586033a6e2992e4e4"}]}] Oct 23 01:10:23.201855 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-223261651 Oct 23 01:10:23.201855 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 24682a566a714ef586033a6e2992e4e4 Oct 23 01:10:23.201855 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-223261651 Oct 23 01:10:23.201855 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin Oct 23 01:10:23.201855 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:10:23.201855 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:10:23.201855 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: a997cd84907845e2a0df8ae40a0fd4bf Oct 23 01:10:23.201855 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin Oct 23 01:10:23.201855 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:10:23.201855 n-d-master-1 devstack@n-api.service[120945]: {"aggregate": {"name": ""}} Oct 23 01:10:23.201855 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:10:23.201855 n-d-master-1 devstack@n-api.service[120945]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 23 01:10:23.203071 n-d-master-1 devstack@n-api.service[120945]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 23 01:10:23.203071 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:10:23.203071 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:23.203071 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 23 01:10:23.203071 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 23 01:10:23.203071 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 01:10:23.203071 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise error Oct 23 01:10:23.203071 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 23 01:10:23.203071 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:23.203071 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 23 01:10:23.203071 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 23 01:10:23.203071 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:23.203071 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 23 01:10:23.203071 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi '' Oct 23 01:10:23.203071 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:23.203071 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:23.203071 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:23.203071 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:23.203071 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:23.203071 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:23.203071 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:10:23.203071 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:10:23.203071 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:10:23.204533 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:10:23.204533 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:10:23.204533 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:10:23.204533 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 23 01:10:23.204533 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 23 01:10:23.204533 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 23 01:10:23.204533 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 23 01:10:23.204533 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 23 01:10:23.204533 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 23 01:10:23.204533 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 23 01:10:23.204533 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:23.204533 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:23.204533 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:23.204533 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:23.204533 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:23.204533 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:23.204533 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 23 01:10:23.204533 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 23 01:10:23.204533 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 23 01:10:23.204533 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:23.205947 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d9e552c1-8101-4e13-8ba5-29fbcef12b15 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:10:23.206046 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d9e552c1-8101-4e13-8ba5-29fbcef12b15 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.024730 Oct 23 01:10:23.210981 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 39/68] 10.222.0.42 () {60 vars in 1164 bytes} [Sun Oct 23 01:10:23 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 23 01:10:23.215787 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-771c37e4-4166-4e20-a357-8f4abcb180c9 tempest-AggregatesAdminNegativeTestJSON-1610882433 tempest-AggregatesAdminNegativeTestJSON-1610882433-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-885212698"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:23.219100 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-771c37e4-4166-4e20-a357-8f4abcb180c9 tempest-AggregatesAdminNegativeTestJSON-1610882433 tempest-AggregatesAdminNegativeTestJSON-1610882433-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '34675ffa7f9f4e76bad646189402680c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8c9aca8184f35a7b6f80eea34b649', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:10:23.220711 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-771c37e4-4166-4e20-a357-8f4abcb180c9 tempest-AggregatesAdminNegativeTestJSON-1610882433 tempest-AggregatesAdminNegativeTestJSON-1610882433-project] Request method failure captured: Oct 23 01:10:23.220711 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 23 01:10:23.220711 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:10:23.220711 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:10:23.220711 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:10:23.220711 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 59 Oct 23 01:10:23.220711 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:10:23.220711 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:10:23.220711 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:10:23.220711 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:10:23.220711 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJR3Zl2BtzKGwwhxnKOkL3SBwPh6K1bBDXmmD4Fw2D9__OVip2GwIqaGm1CTez-CDx9B-NJLhLu9q1X0SBx0ha3VvkDzyf4xbFkysFI0EGNOfN9iTe-b4dZ-0yhw5LeWMcz3MBCuq6EDlExMyx8DTw1tSX2ydpTVLNYqnZkJ7ORgKCM Oct 23 01:10:23.220711 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:10:23.220711 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:10:23.220711 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:10:23.220711 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:10:23.220711 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:10:23.220711 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:10:23.220711 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: f5e8c9aca8184f35a7b6f80eea34b649 Oct 23 01:10:23.220711 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1610882433 Oct 23 01:10:23.220711 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:10:23.220711 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:10:23.222541 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f5e8c9aca8184f35a7b6f80eea34b649"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f5e8c9aca8184f35a7b6f80eea34b649"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f5e8c9aca8184f35a7b6f80eea34b649"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f5e8c9aca8184f35a7b6f80eea34b649"}]}] Oct 23 01:10:23.222541 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1610882433 Oct 23 01:10:23.222541 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: f5e8c9aca8184f35a7b6f80eea34b649 Oct 23 01:10:23.222541 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1610882433 Oct 23 01:10:23.222541 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-AggregatesAdminNegativeTestJSON-1610882433-project Oct 23 01:10:23.222541 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:10:23.222541 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:10:23.222541 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 34675ffa7f9f4e76bad646189402680c Oct 23 01:10:23.222541 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1610882433-project Oct 23 01:10:23.222541 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:10:23.222541 n-d-master-1 devstack@n-api.service[120945]: {"aggregate": {"name": "tempest-test_aggregate-885212698"}} Oct 23 01:10:23.222541 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:10:23.222541 n-d-master-1 devstack@n-api.service[120945]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 23 01:10:23.223219 n-d-master-1 devstack@n-api.service[120945]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-885212698'}}} Oct 23 01:10:23.223219 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:10:23.223219 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:23.223219 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:23.223219 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:23.223219 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:10:23.223219 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:10:23.223219 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:10:23.223219 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:10:23.223219 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:10:23.223219 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:10:23.223219 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:10:23.223219 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:10:23.223219 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 23 01:10:23.223219 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 23 01:10:23.223219 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 23 01:10:23.223219 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 23 01:10:23.223219 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 23 01:10:23.223219 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 23 01:10:23.224107 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:10:23.224107 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 23 01:10:23.224107 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:10:23.224107 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise self.value Oct 23 01:10:23.224107 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 23 01:10:23.224107 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 23 01:10:23.224107 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 23 01:10:23.224107 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 23 01:10:23.224107 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 23 01:10:23.224107 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 23 01:10:23.224107 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 23 01:10:23.224107 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:23.224107 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:23.224107 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:23.224107 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:23.224107 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:23.224107 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:23.224107 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 23 01:10:23.224107 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 23 01:10:23.224107 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 23 01:10:23.225118 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:23.225118 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-771c37e4-4166-4e20-a357-8f4abcb180c9 tempest-AggregatesAdminNegativeTestJSON-1610882433 tempest-AggregatesAdminNegativeTestJSON-1610882433-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:10:23.225118 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-771c37e4-4166-4e20-a357-8f4abcb180c9 tempest-AggregatesAdminNegativeTestJSON-1610882433 tempest-AggregatesAdminNegativeTestJSON-1610882433-project] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.010813 Oct 23 01:10:23.225118 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 40/69] 10.222.0.42 () {60 vars in 1164 bytes} [Sun Oct 23 01:10:23 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:10:23.236959 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2bb1d875-a769-4386-b749-53cbd36b6d47 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1160295915"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:23.241369 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.aggregate [None req-2bb1d875-a769-4386-b749-53cbd36b6d47 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Generated uuid d056ee3c-f05d-47d9-ad60-51a62d2de5d9 for aggregate {{(pid=120945) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 23 01:10:23.338995 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-66cd7030-ec94-4254-86eb-cffef7113eaa tempest-FlavorsAccessNegativeTestJSON-1748246209 tempest-FlavorsAccessNegativeTestJSON-1748246209-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "cb2839bbedf643289a251019d9e79fc8"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:23.338995 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-66cd7030-ec94-4254-86eb-cffef7113eaa tempest-FlavorsAccessNegativeTestJSON-1748246209 tempest-FlavorsAccessNegativeTestJSON-1748246209-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'c7b5ba38c66d4d4a88b22337e70e56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2839bbedf643289a251019d9e79fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:10:23.338995 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-66cd7030-ec94-4254-86eb-cffef7113eaa tempest-FlavorsAccessNegativeTestJSON-1748246209 tempest-FlavorsAccessNegativeTestJSON-1748246209-project] Request method failure captured: Oct 23 01:10:23.338995 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/flavors/1692872942/action HTTP/1.1 Oct 23 01:10:23.338995 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:10:23.338995 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:10:23.338995 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:10:23.338995 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 67 Oct 23 01:10:23.338995 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:10:23.338995 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:10:23.338995 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:10:23.338995 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:10:23.339786 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJR3nJhD6vacRCuUKgTA1NyzLpFle7PjpARwexrgJl0j28fbvuIbmcxtSUjVikDTMBOILZB4yPBs3btru9OyRFvOkN28WHuJqPJbScchhs6yKMmm58IyXtyDXTEcSGBs754iPV_SmltiW5bQIqiuH5JR5wyIcJ6N4OvSdAUSqvVpTYU Oct 23 01:10:23.339786 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:10:23.339786 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:10:23.339786 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:10:23.339786 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:10:23.339786 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:10:23.339786 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:10:23.339786 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: cb2839bbedf643289a251019d9e79fc8 Oct 23 01:10:23.339786 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1748246209 Oct 23 01:10:23.339786 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:10:23.339786 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:10:23.339786 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/cb2839bbedf643289a251019d9e79fc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_cb2839bbedf643289a251019d9e79fc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cb2839bbedf643289a251019d9e79fc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cb2839bbedf643289a251019d9e79fc8"}]}] Oct 23 01:10:23.339786 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1748246209 Oct 23 01:10:23.339786 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: cb2839bbedf643289a251019d9e79fc8 Oct 23 01:10:23.339786 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1748246209 Oct 23 01:10:23.340679 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-FlavorsAccessNegativeTestJSON-1748246209-project Oct 23 01:10:23.340679 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:10:23.340679 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:10:23.340679 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: c7b5ba38c66d4d4a88b22337e70e56df Oct 23 01:10:23.340679 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1748246209-project Oct 23 01:10:23.340679 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:10:23.340679 n-d-master-1 devstack@n-api.service[120944]: {"addTenantAccess": {"tenant": "cb2839bbedf643289a251019d9e79fc8"}} Oct 23 01:10:23.340679 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:10:23.340679 n-d-master-1 devstack@n-api.service[120944]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 23 01:10:23.340679 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '1692872942', 'body': {'addTenantAccess': {'tenant': 'cb2839bbedf643289a251019d9e79fc8'}}} Oct 23 01:10:23.340679 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:10:23.340679 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:23.340679 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:23.340679 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:23.340679 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:10:23.340679 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:10:23.340679 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:10:23.340679 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:10:23.340679 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:10:23.340679 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:10:23.340679 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 23 01:10:23.340679 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 23 01:10:23.340679 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 23 01:10:23.342153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 23 01:10:23.342153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 23 01:10:23.342153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 23 01:10:23.342153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:10:23.342153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 23 01:10:23.342153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:10:23.342153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise self.value Oct 23 01:10:23.342153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 23 01:10:23.342153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 23 01:10:23.342153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 23 01:10:23.342153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 23 01:10:23.342153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 23 01:10:23.342153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 23 01:10:23.342153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 23 01:10:23.342153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:23.342153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:23.342153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:23.342153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:23.342153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:23.342153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:23.343628 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 23 01:10:23.343628 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 23 01:10:23.343628 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 23 01:10:23.343628 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:23.343628 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-66cd7030-ec94-4254-86eb-cffef7113eaa tempest-FlavorsAccessNegativeTestJSON-1748246209 tempest-FlavorsAccessNegativeTestJSON-1748246209-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:10:23.345141 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-66cd7030-ec94-4254-86eb-cffef7113eaa tempest-FlavorsAccessNegativeTestJSON-1748246209 tempest-FlavorsAccessNegativeTestJSON-1748246209-project] 10.222.0.42 "POST /compute/v2.1/flavors/1692872942/action" status: 403 len: 130 microversion: 2.1 time: 0.697039 Oct 23 01:10:23.347221 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 30/70] 10.222.0.42 () {60 vars in 1200 bytes} [Sun Oct 23 01:10:22 2022] POST /compute/v2.1/flavors/1692872942/action => generated 130 bytes in 700 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:10:23.354673 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-385adc31-4a1c-4964-8fae-b542cf577929 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1798113616", "name": "tempest-test_aggregate-1724105223"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:23.374948 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.aggregate [None req-385adc31-4a1c-4964-8fae-b542cf577929 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Generated uuid 095e8c11-3ab4-439e-a297-d44f633d930f for aggregate {{(pid=120944) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 23 01:10:23.408048 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2bb1d875-a769-4386-b749-53cbd36b6d47 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.175016 Oct 23 01:10:23.411409 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 41/71] 10.222.0.42 () {60 vars in 1164 bytes} [Sun Oct 23 01:10:23 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:10:23.416109 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-767243ea-8644-490c-830f-3ff7828c460d tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:23.528720 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-385adc31-4a1c-4964-8fae-b542cf577929 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.179343 Oct 23 01:10:23.529021 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-767243ea-8644-490c-830f-3ff7828c460d tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/1692872942" status: 202 len: 0 microversion: 2.1 time: 0.115623 Oct 23 01:10:23.529621 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 42/72] 10.222.0.42 () {58 vars in 1161 bytes} [Sun Oct 23 01:10:23 2022] DELETE /compute/v2.1/flavors/1692872942 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:10:23.530103 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 31/73] 10.222.0.42 () {60 vars in 1165 bytes} [Sun Oct 23 01:10:23 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:10:23.538701 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-12cdc8c2-e265-4e45-900e-64b9daf641ee tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:23.545705 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-433374e0-ffc9-428e-bfde-ba4c530fed58 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1160295915"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:23.549027 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.aggregate [None req-433374e0-ffc9-428e-bfde-ba4c530fed58 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Generated uuid 87681580-b4ac-4216-bb06-ce402bd4eefa for aggregate {{(pid=120945) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 23 01:10:23.557367 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-433374e0-ffc9-428e-bfde-ba4c530fed58 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1160295915 already exists. Oct 23 01:10:23.558564 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-12cdc8c2-e265-4e45-900e-64b9daf641ee tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023769 Oct 23 01:10:23.559127 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-433374e0-ffc9-428e-bfde-ba4c530fed58 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Request method failure captured: Oct 23 01:10:23.559127 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 23 01:10:23.559127 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:10:23.559127 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:10:23.559127 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:10:23.559127 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 60 Oct 23 01:10:23.559127 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:10:23.559127 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:10:23.559127 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:10:23.559127 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:10:23.559127 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJR6uWpBWdYCU3FR3UdoEx-fMaz2UGR5pio_u8SLfmmO-xfXencIRstHwi_Dw1PfAe0x1eMlxmZ6THsATqCgMSh9GyYyHR4KIJavXyOEvOQW15VbBizjWDSEpnZfpOpsyayKQQRznHbCGxQs1k0NC8h-UgwtBKrA40pVUR9jzpGlGvk Oct 23 01:10:23.559127 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:10:23.559127 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:10:23.559127 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:10:23.559127 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:10:23.559127 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:10:23.559127 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:10:23.559127 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 24682a566a714ef586033a6e2992e4e4 Oct 23 01:10:23.559127 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-223261651 Oct 23 01:10:23.559127 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,admin,reader Oct 23 01:10:23.559127 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,admin,reader Oct 23 01:10:23.560169 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/24682a566a714ef586033a6e2992e4e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_24682a566a714ef586033a6e2992e4e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/24682a566a714ef586033a6e2992e4e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/24682a566a714ef586033a6e2992e4e4"}]}] Oct 23 01:10:23.560169 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-223261651 Oct 23 01:10:23.560169 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 24682a566a714ef586033a6e2992e4e4 Oct 23 01:10:23.560169 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-223261651 Oct 23 01:10:23.560169 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin Oct 23 01:10:23.560169 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:10:23.560169 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:10:23.560169 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: a997cd84907845e2a0df8ae40a0fd4bf Oct 23 01:10:23.560169 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin Oct 23 01:10:23.560169 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:10:23.560169 n-d-master-1 devstack@n-api.service[120945]: {"aggregate": {"name": "tempest-test_aggregate-1160295915"}} Oct 23 01:10:23.560169 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:10:23.560169 n-d-master-1 devstack@n-api.service[120945]: exception: Aggregate tempest-test_aggregate-1160295915 already exists. Oct 23 01:10:23.560888 n-d-master-1 devstack@n-api.service[120945]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1160295915'}}} Oct 23 01:10:23.560888 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:10:23.560888 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:23.560888 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 23 01:10:23.560888 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 23 01:10:23.560888 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 23 01:10:23.560888 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 23 01:10:23.560888 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:10:23.560888 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 23 01:10:23.560888 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:10:23.560888 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise self.value Oct 23 01:10:23.560888 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 23 01:10:23.560888 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 23 01:10:23.560888 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 23 01:10:23.560888 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 23 01:10:23.560888 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 23 01:10:23.560888 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 23 01:10:23.560888 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 23 01:10:23.560888 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 23 01:10:23.561817 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 23 01:10:23.561817 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 23 01:10:23.561817 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 23 01:10:23.561817 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 23 01:10:23.561817 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1160295915 already exists. Oct 23 01:10:23.561817 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:23.561817 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:23.561817 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:23.561817 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:23.561817 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:23.561817 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:23.561817 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:10:23.561817 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:10:23.561817 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:10:23.561817 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:10:23.561817 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:10:23.561817 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:10:23.561817 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:10:23.561817 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:10:23.561817 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 23 01:10:23.562855 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 23 01:10:23.562855 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1160295915 already exists. Oct 23 01:10:23.562855 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:23.562855 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:23.562855 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:23.562855 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:23.562855 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:23.562855 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:23.562855 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:10:23.562855 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:10:23.562855 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1160295915 already exists. Oct 23 01:10:23.562855 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:23.563463 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 32/74] 10.222.0.42 () {58 vars in 1146 bytes} [Sun Oct 23 01:10:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:10:23.563528 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-433374e0-ffc9-428e-bfde-ba4c530fed58 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1160295915 already exists. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:10:23.563528 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-433374e0-ffc9-428e-bfde-ba4c530fed58 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.019871 Oct 23 01:10:23.563528 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 43/75] 10.222.0.42 () {60 vars in 1164 bytes} [Sun Oct 23 01:10:23 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 31 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:10:23.566942 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-67a73d60-0379-4992-aa4c-86a44f62c2bf tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:23.569914 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fdba6f1e-0575-480e-bdb9-4ecce7ba16c0 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:23.580053 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-67a73d60-0379-4992-aa4c-86a44f62c2bf tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] 10.222.0.42 "GET /compute/v2.1/os-aggregates" status: 200 len: 517 microversion: 2.1 time: 0.019823 Oct 23 01:10:23.581483 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 33/76] 10.222.0.42 () {58 vars in 1143 bytes} [Sun Oct 23 01:10:23 2022] GET /compute/v2.1/os-aggregates => generated 517 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:10:23.585617 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-23c8c927-e27f-464e-8f23-5abed82ff1d2 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-716673517", "id": 786409672, "os-flavor-access:is_public": "False"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:23.687855 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-23c8c927-e27f-464e-8f23-5abed82ff1d2 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.105485 Oct 23 01:10:23.688450 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 34/77] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:10:23 2022] POST /compute/v2.1/flavors => generated 435 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:10:23.693814 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f0ce911a-272e-40f8-bc0e-1e9ffa4b4aff tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:23.694945 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fdba6f1e-0575-480e-bdb9-4ecce7ba16c0 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.129784 Oct 23 01:10:23.695863 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 44/78] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Oct 23 01:10:23 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 23 01:10:23.702747 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3254abe1-dccb-4eef-802e-c1ccce60a000 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "cb2839bbedf643289a251019d9e79fc8"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:23.707509 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f0ce911a-272e-40f8-bc0e-1e9ffa4b4aff tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:23.708265 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f0ce911a-272e-40f8-bc0e-1e9ffa4b4aff tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:23.708816 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f0ce911a-272e-40f8-bc0e-1e9ffa4b4aff tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:24.017083 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f0ce911a-272e-40f8-bc0e-1e9ffa4b4aff tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 315 microversion: 2.1 time: 0.326621 Oct 23 01:10:24.018844 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 35/79] 10.222.0.42 () {60 vars in 1191 bytes} [Sun Oct 23 01:10:23 2022] POST /compute/v2.1/os-aggregates/6/action => generated 315 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:10:24.046017 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-148628af-b068-41b0-b35a-624c399b0051 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1379074982"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:24.051654 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.aggregate [None req-148628af-b068-41b0-b35a-624c399b0051 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Generated uuid d7b2afd9-41ca-4fcc-bd47-4002e7f2a37c for aggregate {{(pid=120944) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 23 01:10:24.146127 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-148628af-b068-41b0-b35a-624c399b0051 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.111821 Oct 23 01:10:24.147394 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 36/80] 10.222.0.42 () {60 vars in 1164 bytes} [Sun Oct 23 01:10:24 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:10:24.158885 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-220d6c71-9df4-42d8-8a4d-0c82ed0310ad tempest-AggregatesAdminNegativeTestJSON-1610882433 tempest-AggregatesAdminNegativeTestJSON-1610882433-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:24.160765 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-220d6c71-9df4-42d8-8a4d-0c82ed0310ad tempest-AggregatesAdminNegativeTestJSON-1610882433 tempest-AggregatesAdminNegativeTestJSON-1610882433-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '34675ffa7f9f4e76bad646189402680c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8c9aca8184f35a7b6f80eea34b649', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:10:24.162366 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-220d6c71-9df4-42d8-8a4d-0c82ed0310ad tempest-AggregatesAdminNegativeTestJSON-1610882433 tempest-AggregatesAdminNegativeTestJSON-1610882433-project] Request method failure captured: Oct 23 01:10:24.162366 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 23 01:10:24.162366 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:10:24.162366 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:10:24.162366 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:10:24.162366 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:10:24.162366 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:10:24.162366 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:10:24.162366 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:10:24.162366 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:10:24.162366 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJR3Zl2BtzKGwwhxnKOkL3SBwPh6K1bBDXmmD4Fw2D9__OVip2GwIqaGm1CTez-CDx9B-NJLhLu9q1X0SBx0ha3VvkDzyf4xbFkysFI0EGNOfN9iTe-b4dZ-0yhw5LeWMcz3MBCuq6EDlExMyx8DTw1tSX2ydpTVLNYqnZkJ7ORgKCM Oct 23 01:10:24.162366 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:10:24.162366 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:10:24.162366 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:10:24.162366 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:10:24.162366 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:10:24.162366 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:10:24.162366 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: f5e8c9aca8184f35a7b6f80eea34b649 Oct 23 01:10:24.162366 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1610882433 Oct 23 01:10:24.162366 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:10:24.162366 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:10:24.163578 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f5e8c9aca8184f35a7b6f80eea34b649"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f5e8c9aca8184f35a7b6f80eea34b649"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f5e8c9aca8184f35a7b6f80eea34b649"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f5e8c9aca8184f35a7b6f80eea34b649"}]}] Oct 23 01:10:24.163578 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1610882433 Oct 23 01:10:24.163578 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: f5e8c9aca8184f35a7b6f80eea34b649 Oct 23 01:10:24.163578 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1610882433 Oct 23 01:10:24.163578 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-AggregatesAdminNegativeTestJSON-1610882433-project Oct 23 01:10:24.163578 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:10:24.163578 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:10:24.163578 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 34675ffa7f9f4e76bad646189402680c Oct 23 01:10:24.163578 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1610882433-project Oct 23 01:10:24.163578 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:10:24.163578 n-d-master-1 devstack@n-api.service[120944]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 23 01:10:24.163578 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '7'} Oct 23 01:10:24.164414 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:10:24.164414 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:24.164414 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:24.164414 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:24.164414 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:10:24.164414 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:10:24.164414 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:10:24.164414 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:10:24.164414 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 23 01:10:24.164414 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 23 01:10:24.164414 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 23 01:10:24.164414 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 23 01:10:24.164414 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 23 01:10:24.164414 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 23 01:10:24.164414 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:10:24.164414 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 23 01:10:24.164414 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:10:24.164414 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise self.value Oct 23 01:10:24.164414 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 23 01:10:24.165567 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 23 01:10:24.165567 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 23 01:10:24.165567 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 23 01:10:24.165567 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 23 01:10:24.165567 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 23 01:10:24.165567 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 23 01:10:24.165567 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:24.165567 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:24.165567 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:24.165567 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:24.165567 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:24.165567 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:24.165567 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 23 01:10:24.165567 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 23 01:10:24.165567 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 23 01:10:24.165567 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:24.165567 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-220d6c71-9df4-42d8-8a4d-0c82ed0310ad tempest-AggregatesAdminNegativeTestJSON-1610882433 tempest-AggregatesAdminNegativeTestJSON-1610882433-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:10:24.166594 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-220d6c71-9df4-42d8-8a4d-0c82ed0310ad tempest-AggregatesAdminNegativeTestJSON-1610882433 tempest-AggregatesAdminNegativeTestJSON-1610882433-project] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/7" status: 403 len: 116 microversion: 2.1 time: 0.009084 Oct 23 01:10:24.167567 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 37/81] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Oct 23 01:10:24 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 116 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:10:24.182975 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-760d8d47-9ca1-4d1c-9aac-6bea85a73858 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:24.329353 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-760d8d47-9ca1-4d1c-9aac-6bea85a73858 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.160536 Oct 23 01:10:24.331713 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 38/82] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Oct 23 01:10:24 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 23 01:10:24.338568 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3254abe1-dccb-4eef-802e-c1ccce60a000 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors/786409672/action" status: 200 len: 96 microversion: 2.1 time: 0.639203 Oct 23 01:10:24.339924 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 45/83] 10.222.0.42 () {60 vars in 1197 bytes} [Sun Oct 23 01:10:23 2022] POST /compute/v2.1/flavors/786409672/action => generated 96 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:10:24.349711 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f9e335fc-149c-465a-b802-7df5bd5fd3d3 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:24.369056 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-f9e335fc-149c-465a-b802-7df5bd5fd3d3 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 23 01:10:24.372934 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f9e335fc-149c-465a-b802-7df5bd5fd3d3 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Request method failure captured: Oct 23 01:10:24.372934 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 23 01:10:24.372934 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:10:24.372934 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:10:24.372934 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:10:24.372934 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:10:24.372934 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:10:24.372934 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:10:24.372934 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:10:24.372934 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:10:24.372934 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJR6uWpBWdYCU3FR3UdoEx-fMaz2UGR5pio_u8SLfmmO-xfXencIRstHwi_Dw1PfAe0x1eMlxmZ6THsATqCgMSh9GyYyHR4KIJavXyOEvOQW15VbBizjWDSEpnZfpOpsyayKQQRznHbCGxQs1k0NC8h-UgwtBKrA40pVUR9jzpGlGvk Oct 23 01:10:24.372934 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:10:24.372934 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:10:24.372934 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:10:24.372934 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:10:24.372934 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:10:24.372934 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:10:24.372934 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 24682a566a714ef586033a6e2992e4e4 Oct 23 01:10:24.372934 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-223261651 Oct 23 01:10:24.372934 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,admin,reader Oct 23 01:10:24.372934 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,admin,reader Oct 23 01:10:24.374075 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/24682a566a714ef586033a6e2992e4e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_24682a566a714ef586033a6e2992e4e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/24682a566a714ef586033a6e2992e4e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/24682a566a714ef586033a6e2992e4e4"}]}] Oct 23 01:10:24.374075 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-223261651 Oct 23 01:10:24.374075 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 24682a566a714ef586033a6e2992e4e4 Oct 23 01:10:24.374075 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-223261651 Oct 23 01:10:24.374075 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin Oct 23 01:10:24.374075 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:10:24.374075 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:10:24.374075 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: a997cd84907845e2a0df8ae40a0fd4bf Oct 23 01:10:24.374075 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin Oct 23 01:10:24.374075 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:10:24.374075 n-d-master-1 devstack@n-api.service[120945]: exception: Aggregate -1 could not be found. Oct 23 01:10:24.374075 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '-1'} Oct 23 01:10:24.374717 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:10:24.374717 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:24.374717 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 23 01:10:24.374717 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 23 01:10:24.374717 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 23 01:10:24.374717 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 23 01:10:24.374717 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:10:24.374717 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 23 01:10:24.374717 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:10:24.374717 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise self.value Oct 23 01:10:24.374717 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 23 01:10:24.374717 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 23 01:10:24.374717 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 23 01:10:24.374717 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 23 01:10:24.374717 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 01:10:24.374717 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 01:10:24.374717 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 23 01:10:24.374717 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 23 01:10:24.374717 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 23 01:10:24.375629 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 23 01:10:24.375629 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 23 01:10:24.375629 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 23 01:10:24.375629 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 23 01:10:24.375629 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:24.375629 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:24.375629 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:24.375629 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:24.375629 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:24.375629 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:24.375629 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:10:24.375629 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:10:24.375629 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:10:24.375629 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:10:24.375629 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 23 01:10:24.375629 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:10:24.375629 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 23 01:10:24.375629 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:24.375629 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:24.375629 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:24.375629 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:24.376623 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:24.376623 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:24.376623 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:10:24.376623 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:10:24.376623 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 23 01:10:24.376623 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:24.389808 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f9e335fc-149c-465a-b802-7df5bd5fd3d3 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:10:24.393337 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f9e335fc-149c-465a-b802-7df5bd5fd3d3 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.051832 Oct 23 01:10:24.395603 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 46/84] 10.222.0.42 () {58 vars in 1155 bytes} [Sun Oct 23 01:10:24 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:10:24.406832 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bd1b8c57-26d9-4695-8126-0b1101da589c tempest-FlavorsAccessNegativeTestJSON-1748246209 tempest-FlavorsAccessNegativeTestJSON-1748246209-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "cb2839bbedf643289a251019d9e79fc8"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:24.411985 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bd1b8c57-26d9-4695-8126-0b1101da589c tempest-FlavorsAccessNegativeTestJSON-1748246209 tempest-FlavorsAccessNegativeTestJSON-1748246209-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'c7b5ba38c66d4d4a88b22337e70e56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2839bbedf643289a251019d9e79fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:10:24.419530 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bd1b8c57-26d9-4695-8126-0b1101da589c tempest-FlavorsAccessNegativeTestJSON-1748246209 tempest-FlavorsAccessNegativeTestJSON-1748246209-project] Request method failure captured: Oct 23 01:10:24.419530 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/flavors/786409672/action HTTP/1.1 Oct 23 01:10:24.419530 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:10:24.419530 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:10:24.419530 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:10:24.419530 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 70 Oct 23 01:10:24.419530 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:10:24.419530 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:10:24.419530 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:10:24.419530 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:10:24.419530 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJR3nJhD6vacRCuUKgTA1NyzLpFle7PjpARwexrgJl0j28fbvuIbmcxtSUjVikDTMBOILZB4yPBs3btru9OyRFvOkN28WHuJqPJbScchhs6yKMmm58IyXtyDXTEcSGBs754iPV_SmltiW5bQIqiuH5JR5wyIcJ6N4OvSdAUSqvVpTYU Oct 23 01:10:24.419530 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:10:24.419530 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:10:24.419530 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:10:24.419530 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:10:24.419530 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:10:24.419530 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:10:24.419530 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: cb2839bbedf643289a251019d9e79fc8 Oct 23 01:10:24.419530 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1748246209 Oct 23 01:10:24.419530 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:10:24.419530 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:10:24.420798 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/cb2839bbedf643289a251019d9e79fc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_cb2839bbedf643289a251019d9e79fc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cb2839bbedf643289a251019d9e79fc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cb2839bbedf643289a251019d9e79fc8"}]}] Oct 23 01:10:24.420798 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1748246209 Oct 23 01:10:24.420798 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: cb2839bbedf643289a251019d9e79fc8 Oct 23 01:10:24.420798 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1748246209 Oct 23 01:10:24.420798 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-FlavorsAccessNegativeTestJSON-1748246209-project Oct 23 01:10:24.420798 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:10:24.420798 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:10:24.420798 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: c7b5ba38c66d4d4a88b22337e70e56df Oct 23 01:10:24.420798 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1748246209-project Oct 23 01:10:24.420798 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:10:24.420798 n-d-master-1 devstack@n-api.service[120945]: {"removeTenantAccess": {"tenant": "cb2839bbedf643289a251019d9e79fc8"}} Oct 23 01:10:24.420798 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:10:24.421412 n-d-master-1 devstack@n-api.service[120945]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 23 01:10:24.421412 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '786409672', 'body': {'removeTenantAccess': {'tenant': 'cb2839bbedf643289a251019d9e79fc8'}}} Oct 23 01:10:24.421412 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:10:24.421412 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:24.421412 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:24.421412 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:24.421412 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:10:24.421412 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:10:24.421412 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:10:24.421412 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:10:24.421412 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:10:24.421412 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:10:24.421412 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 23 01:10:24.421412 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi context.can( Oct 23 01:10:24.421412 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 23 01:10:24.421412 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 23 01:10:24.421412 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 23 01:10:24.421412 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 23 01:10:24.421412 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:10:24.421412 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 23 01:10:24.422409 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:10:24.422409 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise self.value Oct 23 01:10:24.422409 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 23 01:10:24.422409 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 23 01:10:24.422409 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 23 01:10:24.422409 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 23 01:10:24.422409 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 23 01:10:24.422409 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 23 01:10:24.422409 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 23 01:10:24.422409 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:24.422409 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:24.422409 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:24.422409 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:24.422409 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:24.422409 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:24.422409 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 23 01:10:24.422409 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 23 01:10:24.422409 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 23 01:10:24.422409 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:24.423921 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bd1b8c57-26d9-4695-8126-0b1101da589c tempest-FlavorsAccessNegativeTestJSON-1748246209 tempest-FlavorsAccessNegativeTestJSON-1748246209-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:10:24.423921 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bd1b8c57-26d9-4695-8126-0b1101da589c tempest-FlavorsAccessNegativeTestJSON-1748246209 tempest-FlavorsAccessNegativeTestJSON-1748246209-project] 10.222.0.42 "POST /compute/v2.1/flavors/786409672/action" status: 403 len: 133 microversion: 2.1 time: 0.025277 Oct 23 01:10:24.429397 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 47/85] 10.222.0.42 () {60 vars in 1197 bytes} [Sun Oct 23 01:10:24 2022] POST /compute/v2.1/flavors/786409672/action => generated 133 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:10:24.435147 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-626e740e-8b62-4ff6-bc8d-a41686554524 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1622517774"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:24.443796 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.aggregate [None req-626e740e-8b62-4ff6-bc8d-a41686554524 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Generated uuid 840c1d21-a296-4352-a095-d735f5d6217d for aggregate {{(pid=120945) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 23 01:10:24.572857 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-626e740e-8b62-4ff6-bc8d-a41686554524 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.141245 Oct 23 01:10:24.574128 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 48/86] 10.222.0.42 () {60 vars in 1164 bytes} [Sun Oct 23 01:10:24 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:10:24.579443 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bc5ce026-d6bc-4eaa-ae08-a19e975d9a62 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "cb2839bbedf643289a251019d9e79fc8"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:24.692872 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7a917593-0c37-4607-b256-cd021a962b1c tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1601619020", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "availability_zone": "tempest-test_az-1798113616"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:24.705097 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7a917593-0c37-4607-b256-cd021a962b1c tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:24.706307 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7a917593-0c37-4607-b256-cd021a962b1c tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:24.706755 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7a917593-0c37-4607-b256-cd021a962b1c tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:24.707487 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7a917593-0c37-4607-b256-cd021a962b1c tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:24.707954 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7a917593-0c37-4607-b256-cd021a962b1c tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:24.708385 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7a917593-0c37-4607-b256-cd021a962b1c tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:25.497939 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bc5ce026-d6bc-4eaa-ae08-a19e975d9a62 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors/786409672/action" status: 200 len: 21 microversion: 2.1 time: 0.914466 Oct 23 01:10:25.497939 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 49/87] 10.222.0.42 () {60 vars in 1197 bytes} [Sun Oct 23 01:10:24 2022] POST /compute/v2.1/flavors/786409672/action => generated 21 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:10:25.497939 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6b9d557b-ea7a-47ae-a26e-43d2e969bd48 tempest-AggregatesAdminNegativeTestJSON-1610882433 tempest-AggregatesAdminNegativeTestJSON-1610882433-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:25.497939 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6b9d557b-ea7a-47ae-a26e-43d2e969bd48 tempest-AggregatesAdminNegativeTestJSON-1610882433 tempest-AggregatesAdminNegativeTestJSON-1610882433-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '34675ffa7f9f4e76bad646189402680c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8c9aca8184f35a7b6f80eea34b649', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:10:25.498607 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6b9d557b-ea7a-47ae-a26e-43d2e969bd48 tempest-AggregatesAdminNegativeTestJSON-1610882433 tempest-AggregatesAdminNegativeTestJSON-1610882433-project] Request method failure captured: Oct 23 01:10:25.498607 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Oct 23 01:10:25.498607 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:10:25.498607 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:10:25.498607 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:10:25.498607 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:10:25.498607 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:10:25.498607 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:10:25.498607 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:10:25.498607 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:10:25.498607 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJR3Zl2BtzKGwwhxnKOkL3SBwPh6K1bBDXmmD4Fw2D9__OVip2GwIqaGm1CTez-CDx9B-NJLhLu9q1X0SBx0ha3VvkDzyf4xbFkysFI0EGNOfN9iTe-b4dZ-0yhw5LeWMcz3MBCuq6EDlExMyx8DTw1tSX2ydpTVLNYqnZkJ7ORgKCM Oct 23 01:10:25.498607 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:10:25.498607 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:10:25.498607 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:10:25.498607 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:10:25.498607 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:10:25.498607 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:10:25.498607 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: f5e8c9aca8184f35a7b6f80eea34b649 Oct 23 01:10:25.498607 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1610882433 Oct 23 01:10:25.498607 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:10:25.498607 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:10:25.499635 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f5e8c9aca8184f35a7b6f80eea34b649"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f5e8c9aca8184f35a7b6f80eea34b649"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f5e8c9aca8184f35a7b6f80eea34b649"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f5e8c9aca8184f35a7b6f80eea34b649"}]}] Oct 23 01:10:25.499635 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1610882433 Oct 23 01:10:25.499635 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: f5e8c9aca8184f35a7b6f80eea34b649 Oct 23 01:10:25.499635 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1610882433 Oct 23 01:10:25.499635 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-AggregatesAdminNegativeTestJSON-1610882433-project Oct 23 01:10:25.499635 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:10:25.499635 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:10:25.499635 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 34675ffa7f9f4e76bad646189402680c Oct 23 01:10:25.499635 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1610882433-project Oct 23 01:10:25.499635 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:10:25.499635 n-d-master-1 devstack@n-api.service[120945]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 23 01:10:25.499635 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '8'} Oct 23 01:10:25.500215 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:10:25.500215 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:25.500215 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:25.500215 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:25.500215 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:10:25.500215 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:10:25.500215 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:10:25.500215 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:10:25.500215 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 23 01:10:25.500215 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 23 01:10:25.500215 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 23 01:10:25.500215 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 23 01:10:25.500215 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 23 01:10:25.500215 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 23 01:10:25.500215 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:10:25.500215 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 23 01:10:25.500215 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:10:25.500215 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise self.value Oct 23 01:10:25.500215 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 23 01:10:25.501808 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 23 01:10:25.501808 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 23 01:10:25.501808 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 23 01:10:25.501808 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 23 01:10:25.501808 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 23 01:10:25.501808 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 23 01:10:25.501808 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:25.501808 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:25.501808 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:25.501808 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:25.501808 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:25.501808 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:25.501808 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 23 01:10:25.501808 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 23 01:10:25.501808 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 23 01:10:25.501808 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:25.501808 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6b9d557b-ea7a-47ae-a26e-43d2e969bd48 tempest-AggregatesAdminNegativeTestJSON-1610882433 tempest-AggregatesAdminNegativeTestJSON-1610882433-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:10:25.503955 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6b9d557b-ea7a-47ae-a26e-43d2e969bd48 tempest-AggregatesAdminNegativeTestJSON-1610882433 tempest-AggregatesAdminNegativeTestJSON-1610882433-project] 10.222.0.42 "GET /compute/v2.1/os-aggregates/8" status: 403 len: 114 microversion: 2.1 time: 0.007786 Oct 23 01:10:25.503955 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 50/88] 10.222.0.42 () {58 vars in 1149 bytes} [Sun Oct 23 01:10:25 2022] GET /compute/v2.1/os-aggregates/8 => generated 114 bytes in 9 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:10:25.507319 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d730b6b9-7a20-4cd1-8167-91c651d9b309 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:25.582337 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d730b6b9-7a20-4cd1-8167-91c651d9b309 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/786409672" status: 202 len: 0 microversion: 2.1 time: 0.079561 Oct 23 01:10:25.583174 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 51/89] 10.222.0.42 () {58 vars in 1158 bytes} [Sun Oct 23 01:10:25 2022] DELETE /compute/v2.1/flavors/786409672 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 23 01:10:25.587847 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-99f0603f-7566-4eeb-9e78-0d30e18f92a0 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:25.677735 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-99f0603f-7566-4eeb-9e78-0d30e18f92a0 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.093415 Oct 23 01:10:25.679054 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 52/90] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Oct 23 01:10:25 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 23 01:10:25.685675 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e5c72460-9632-438e-b4a4-74b778976aba tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:25.705238 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e5c72460-9632-438e-b4a4-74b778976aba tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024909 Oct 23 01:10:25.705804 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 53/91] 10.222.0.42 () {58 vars in 1146 bytes} [Sun Oct 23 01:10:25 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:10:25.710169 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0cf5fca7-ede1-4792-bf83-d9ba77bbffca tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:25.716377 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-0cf5fca7-ede1-4792-bf83-d9ba77bbffca tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 23 01:10:25.718086 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0cf5fca7-ede1-4792-bf83-d9ba77bbffca tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Request method failure captured: Oct 23 01:10:25.718086 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 23 01:10:25.718086 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:10:25.718086 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:10:25.718086 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:10:25.718086 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:10:25.718086 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:10:25.718086 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:10:25.718086 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:10:25.718086 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:10:25.718086 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJR6uWpBWdYCU3FR3UdoEx-fMaz2UGR5pio_u8SLfmmO-xfXencIRstHwi_Dw1PfAe0x1eMlxmZ6THsATqCgMSh9GyYyHR4KIJavXyOEvOQW15VbBizjWDSEpnZfpOpsyayKQQRznHbCGxQs1k0NC8h-UgwtBKrA40pVUR9jzpGlGvk Oct 23 01:10:25.718086 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:10:25.718086 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:10:25.718086 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:10:25.718086 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:10:25.718086 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:10:25.718086 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:10:25.718086 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 24682a566a714ef586033a6e2992e4e4 Oct 23 01:10:25.718086 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-223261651 Oct 23 01:10:25.718086 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,admin,reader Oct 23 01:10:25.718086 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,admin,reader Oct 23 01:10:25.719207 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/24682a566a714ef586033a6e2992e4e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_24682a566a714ef586033a6e2992e4e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/24682a566a714ef586033a6e2992e4e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/24682a566a714ef586033a6e2992e4e4"}]}] Oct 23 01:10:25.719207 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-223261651 Oct 23 01:10:25.719207 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 24682a566a714ef586033a6e2992e4e4 Oct 23 01:10:25.719207 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-223261651 Oct 23 01:10:25.719207 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin Oct 23 01:10:25.719207 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:10:25.719207 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:10:25.719207 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: a997cd84907845e2a0df8ae40a0fd4bf Oct 23 01:10:25.719207 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin Oct 23 01:10:25.719207 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:10:25.719207 n-d-master-1 devstack@n-api.service[120945]: exception: Aggregate -1 could not be found. Oct 23 01:10:25.719207 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '-1'} Oct 23 01:10:25.719810 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:10:25.719810 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:25.719810 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 23 01:10:25.719810 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 23 01:10:25.719810 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 23 01:10:25.719810 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 23 01:10:25.719810 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 01:10:25.719810 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 01:10:25.719810 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 23 01:10:25.719810 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 23 01:10:25.719810 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 23 01:10:25.719810 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 23 01:10:25.719810 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 23 01:10:25.719810 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 23 01:10:25.719810 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 23 01:10:25.719810 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:25.719810 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:25.719810 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:25.719810 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:25.719810 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:25.720896 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:25.720896 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:10:25.720896 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:10:25.720896 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:10:25.720896 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:10:25.720896 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 23 01:10:25.720896 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:10:25.720896 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 23 01:10:25.720896 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:25.720896 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:25.720896 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:25.720896 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:25.720896 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:25.720896 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:25.720896 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:10:25.720896 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:10:25.720896 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 23 01:10:25.720896 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:25.721775 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0cf5fca7-ede1-4792-bf83-d9ba77bbffca tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:10:25.721775 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0cf5fca7-ede1-4792-bf83-d9ba77bbffca tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] 10.222.0.42 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.012646 Oct 23 01:10:25.721775 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 54/92] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Oct 23 01:10:25 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:10:25.724872 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9fc6f4bd-2270-48a4-af30-440fac4b0276 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-433236509", "id": 229724924, "os-flavor-access:is_public": "False"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:25.839476 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9fc6f4bd-2270-48a4-af30-440fac4b0276 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.117980 Oct 23 01:10:25.840579 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 55/93] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:10:25 2022] POST /compute/v2.1/flavors => generated 435 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:10:25.850688 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ba28e0a4-10fb-4a94-be19-7136641abadd tempest-AggregatesAdminNegativeTestJSON-1610882433 tempest-AggregatesAdminNegativeTestJSON-1610882433-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:25.857164 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ba28e0a4-10fb-4a94-be19-7136641abadd tempest-AggregatesAdminNegativeTestJSON-1610882433 tempest-AggregatesAdminNegativeTestJSON-1610882433-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '34675ffa7f9f4e76bad646189402680c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8c9aca8184f35a7b6f80eea34b649', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:10:25.858857 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ba28e0a4-10fb-4a94-be19-7136641abadd tempest-AggregatesAdminNegativeTestJSON-1610882433 tempest-AggregatesAdminNegativeTestJSON-1610882433-project] Request method failure captured: Oct 23 01:10:25.858857 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 23 01:10:25.858857 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:10:25.858857 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:10:25.858857 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:10:25.858857 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:10:25.858857 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:10:25.858857 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:10:25.858857 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:10:25.858857 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:10:25.858857 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJR3Zl2BtzKGwwhxnKOkL3SBwPh6K1bBDXmmD4Fw2D9__OVip2GwIqaGm1CTez-CDx9B-NJLhLu9q1X0SBx0ha3VvkDzyf4xbFkysFI0EGNOfN9iTe-b4dZ-0yhw5LeWMcz3MBCuq6EDlExMyx8DTw1tSX2ydpTVLNYqnZkJ7ORgKCM Oct 23 01:10:25.858857 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:10:25.858857 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:10:25.858857 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:10:25.858857 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:10:25.858857 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:10:25.858857 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:10:25.858857 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: f5e8c9aca8184f35a7b6f80eea34b649 Oct 23 01:10:25.858857 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1610882433 Oct 23 01:10:25.858857 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:10:25.858857 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:10:25.860168 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f5e8c9aca8184f35a7b6f80eea34b649"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f5e8c9aca8184f35a7b6f80eea34b649"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f5e8c9aca8184f35a7b6f80eea34b649"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f5e8c9aca8184f35a7b6f80eea34b649"}]}] Oct 23 01:10:25.860168 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1610882433 Oct 23 01:10:25.860168 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: f5e8c9aca8184f35a7b6f80eea34b649 Oct 23 01:10:25.860168 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1610882433 Oct 23 01:10:25.860168 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-AggregatesAdminNegativeTestJSON-1610882433-project Oct 23 01:10:25.860168 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:10:25.860168 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:10:25.860168 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 34675ffa7f9f4e76bad646189402680c Oct 23 01:10:25.860168 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1610882433-project Oct 23 01:10:25.860168 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:10:25.860168 n-d-master-1 devstack@n-api.service[120945]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 23 01:10:25.860168 n-d-master-1 devstack@n-api.service[120945]: action_args: {} Oct 23 01:10:25.860911 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:10:25.860911 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:25.860911 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:25.860911 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:25.860911 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:10:25.860911 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:10:25.860911 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:10:25.860911 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:10:25.860911 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 23 01:10:25.860911 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 23 01:10:25.860911 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 23 01:10:25.860911 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 23 01:10:25.860911 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 23 01:10:25.860911 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 23 01:10:25.860911 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:10:25.860911 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 23 01:10:25.860911 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:10:25.860911 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise self.value Oct 23 01:10:25.860911 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 23 01:10:25.863093 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 23 01:10:25.863093 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 23 01:10:25.863093 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 23 01:10:25.863093 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 23 01:10:25.863093 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 23 01:10:25.863093 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 23 01:10:25.863093 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:25.863093 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:25.863093 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:25.863093 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:25.863093 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:25.863093 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:25.863093 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 23 01:10:25.863093 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 23 01:10:25.863093 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 23 01:10:25.863093 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:25.864125 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ba28e0a4-10fb-4a94-be19-7136641abadd tempest-AggregatesAdminNegativeTestJSON-1610882433 tempest-AggregatesAdminNegativeTestJSON-1610882433-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:10:25.864876 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ba28e0a4-10fb-4a94-be19-7136641abadd tempest-AggregatesAdminNegativeTestJSON-1610882433 tempest-AggregatesAdminNegativeTestJSON-1610882433-project] 10.222.0.42 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.023164 Oct 23 01:10:25.866502 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 56/94] 10.222.0.42 () {58 vars in 1143 bytes} [Sun Oct 23 01:10:25 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:10:25.874149 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b88d961f-982f-44d9-8700-d7e1ea54850c tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "54d7ef46716d4cc1b7d197d0049492ed"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:26.292915 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-7a917593-0c37-4607-b256-cd021a962b1c tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] validate_networks() for None {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:10:26.650870 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-7a917593-0c37-4607-b256-cd021a962b1c tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:10:26.651751 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-7a917593-0c37-4607-b256-cd021a962b1c tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:10:26.652316 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-7a917593-0c37-4607-b256-cd021a962b1c tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:10:26.652805 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-7a917593-0c37-4607-b256-cd021a962b1c tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:10:26.653297 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-7a917593-0c37-4607-b256-cd021a962b1c tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:10:26.667830 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7a917593-0c37-4607-b256-cd021a962b1c tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:26.668890 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7a917593-0c37-4607-b256-cd021a962b1c tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:26.669577 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7a917593-0c37-4607-b256-cd021a962b1c tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:26.670539 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7a917593-0c37-4607-b256-cd021a962b1c tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:26.671197 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7a917593-0c37-4607-b256-cd021a962b1c tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:26.671824 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7a917593-0c37-4607-b256-cd021a962b1c tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:26.705655 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-7a917593-0c37-4607-b256-cd021a962b1c tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Getting quotas for project f3a80a158b5c4e3baf87e83a284970c3. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:10:26.712619 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-7a917593-0c37-4607-b256-cd021a962b1c tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Getting quotas for user d61093911783470a94d53354c15df815 and project f3a80a158b5c4e3baf87e83a284970c3. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:10:26.733935 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7a917593-0c37-4607-b256-cd021a962b1c tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:10:26.737795 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7a917593-0c37-4607-b256-cd021a962b1c tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] [instance: e41aeb69-eb54-4844-9b0a-2efa50a230c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:10:26.762294 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=8,nova_api:INSERT=10,nova_api:UPDATE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:26.791716 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-b88d961f-982f-44d9-8700-d7e1ea54850c tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] HTTP exception thrown: Flavor access not found for 21 / 54d7ef46716d4cc1b7d197d0049492ed combination. Oct 23 01:10:26.793938 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b88d961f-982f-44d9-8700-d7e1ea54850c tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] Request method failure captured: Oct 23 01:10:26.793938 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/flavors/229724924/action HTTP/1.1 Oct 23 01:10:26.793938 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:10:26.793938 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:10:26.793938 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:10:26.793938 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 70 Oct 23 01:10:26.793938 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:10:26.793938 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:10:26.793938 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:10:26.793938 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:10:26.793938 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJR6a50YwKecWoSVwMAfRA1tIpp71KKynfExNF51lqleY-g0Yg5MaTBTEvLCpp0eohrs_nkyaMNGrlXFTfvplULV_EwgumTMxcZ1nElYhdtheNwxtU9dnUC-o0Qyha_GrFxpvXGXW3DOg9NGSSftnGCR2EFWZaEfcBHRB_cRYpLDrns Oct 23 01:10:26.793938 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:10:26.793938 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:10:26.793938 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:10:26.793938 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:10:26.793938 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:10:26.793938 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:10:26.793938 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: f6c73949b77f4bc1a11502d092ace444 Oct 23 01:10:26.793938 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-299257373 Oct 23 01:10:26.793938 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,admin,reader Oct 23 01:10:26.793938 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,admin,reader Oct 23 01:10:26.795285 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f6c73949b77f4bc1a11502d092ace444"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f6c73949b77f4bc1a11502d092ace444"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f6c73949b77f4bc1a11502d092ace444"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f6c73949b77f4bc1a11502d092ace444"}]}] Oct 23 01:10:26.795285 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-299257373 Oct 23 01:10:26.795285 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: f6c73949b77f4bc1a11502d092ace444 Oct 23 01:10:26.795285 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-299257373 Oct 23 01:10:26.795285 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin Oct 23 01:10:26.795285 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:10:26.795285 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:10:26.795285 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 41bbdf429a464a5bbaf79131085193cb Oct 23 01:10:26.795285 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin Oct 23 01:10:26.795285 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:10:26.795285 n-d-master-1 devstack@n-api.service[120945]: {"removeTenantAccess": {"tenant": "54d7ef46716d4cc1b7d197d0049492ed"}} Oct 23 01:10:26.795285 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:10:26.796056 n-d-master-1 devstack@n-api.service[120945]: exception: Flavor access not found for 21 / 54d7ef46716d4cc1b7d197d0049492ed combination. Oct 23 01:10:26.796056 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '229724924', 'body': {'removeTenantAccess': {'tenant': '54d7ef46716d4cc1b7d197d0049492ed'}}} Oct 23 01:10:26.796056 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:10:26.796056 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:26.796056 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 23 01:10:26.796056 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 23 01:10:26.796056 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 23 01:10:26.796056 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 23 01:10:26.796056 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 23 01:10:26.796056 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 23 01:10:26.796056 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 23 01:10:26.796056 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 23 01:10:26.796056 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 23 01:10:26.796056 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 23 01:10:26.796056 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 23 01:10:26.796056 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 23 01:10:26.796056 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 23 01:10:26.796056 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 23 01:10:26.797125 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 21 / 54d7ef46716d4cc1b7d197d0049492ed combination. Oct 23 01:10:26.797125 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:26.797125 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:26.797125 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:26.797125 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:26.797125 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:26.797125 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:26.797125 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:10:26.797125 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:10:26.797125 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:10:26.797125 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:10:26.797125 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:10:26.797125 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:10:26.797125 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 23 01:10:26.797125 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:10:26.797125 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 21 / 54d7ef46716d4cc1b7d197d0049492ed combination. Oct 23 01:10:26.797125 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:26.797125 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:26.797125 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:26.797125 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:26.798338 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:26.798338 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:26.798338 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:10:26.798338 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:10:26.798338 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 21 / 54d7ef46716d4cc1b7d197d0049492ed combination. Oct 23 01:10:26.798338 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:26.799916 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b88d961f-982f-44d9-8700-d7e1ea54850c tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] Returning 404 to user: Flavor access not found for 21 / 54d7ef46716d4cc1b7d197d0049492ed combination. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:10:26.800756 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b88d961f-982f-44d9-8700-d7e1ea54850c tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors/229724924/action" status: 404 len: 124 microversion: 2.1 time: 0.932599 Oct 23 01:10:26.801321 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 57/95] 10.222.0.42 () {60 vars in 1197 bytes} [Sun Oct 23 01:10:25 2022] POST /compute/v2.1/flavors/229724924/action => generated 124 bytes in 934 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:10:26.813908 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-de025417-c31d-4d0b-ab98-34957dac5db7 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:26.825900 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=21,nova_api:INSERT=6 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:26.853604 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7a917593-0c37-4607-b256-cd021a962b1c tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.515039 Oct 23 01:10:26.854555 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 39/96] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:10:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:10:26.868487 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-49fe040e-f5af-4378-ad45-15fe4cb1663c tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:26.869221 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-49fe040e-f5af-4378-ad45-15fe4cb1663c tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] [instance: e41aeb69-eb54-4844-9b0a-2efa50a230c5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:10:26.913955 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-de025417-c31d-4d0b-ab98-34957dac5db7 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/229724924" status: 202 len: 0 microversion: 2.1 time: 0.104350 Oct 23 01:10:26.914687 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 58/97] 10.222.0.42 () {58 vars in 1158 bytes} [Sun Oct 23 01:10:26 2022] DELETE /compute/v2.1/flavors/229724924 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:10:26.924034 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2edf0d0c-2b97-46d4-8c48-c6c110b43c91 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:26.944249 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2edf0d0c-2b97-46d4-8c48-c6c110b43c91 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023919 Oct 23 01:10:26.945291 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 59/98] 10.222.0.42 () {58 vars in 1146 bytes} [Sun Oct 23 01:10:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:10:26.990318 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-49fe040e-f5af-4378-ad45-15fe4cb1663c tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61093911783470a94d53354c15df815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a80a158b5c4e3baf87e83a284970c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:10:27.011598 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-49fe040e-f5af-4378-ad45-15fe4cb1663c tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] 10.222.0.42 "GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5" status: 200 len: 1243 microversion: 2.1 time: 0.148744 Oct 23 01:10:27.022901 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 40/99] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:10:26 2022] GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5 => generated 1243 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:10:28.037319 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7ba2d613-9839-4d17-a406-a4e11d869cfd tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:28.038685 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7ba2d613-9839-4d17-a406-a4e11d869cfd tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] [instance: e41aeb69-eb54-4844-9b0a-2efa50a230c5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:10:29.319327 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7ba2d613-9839-4d17-a406-a4e11d869cfd tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61093911783470a94d53354c15df815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a80a158b5c4e3baf87e83a284970c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:10:29.337137 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7ba2d613-9839-4d17-a406-a4e11d869cfd tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] 10.222.0.42 "GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5" status: 200 len: 1243 microversion: 2.1 time: 1.304111 Oct 23 01:10:29.338066 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 60/100] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:10:28 2022] GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5 => generated 1243 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:10:30.363477 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1bf5fdce-aa67-4502-8f08-c5ae15da6550 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:30.364102 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1bf5fdce-aa67-4502-8f08-c5ae15da6550 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] [instance: e41aeb69-eb54-4844-9b0a-2efa50a230c5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:10:30.377517 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1bf5fdce-aa67-4502-8f08-c5ae15da6550 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:30.378153 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1bf5fdce-aa67-4502-8f08-c5ae15da6550 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:30.379067 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1bf5fdce-aa67-4502-8f08-c5ae15da6550 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:30.380395 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1bf5fdce-aa67-4502-8f08-c5ae15da6550 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:30.381063 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1bf5fdce-aa67-4502-8f08-c5ae15da6550 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:30.382101 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1bf5fdce-aa67-4502-8f08-c5ae15da6550 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:30.650135 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1bf5fdce-aa67-4502-8f08-c5ae15da6550 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61093911783470a94d53354c15df815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a80a158b5c4e3baf87e83a284970c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:10:30.676014 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1bf5fdce-aa67-4502-8f08-c5ae15da6550 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] 10.222.0.42 "GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5" status: 200 len: 1291 microversion: 2.1 time: 0.319415 Oct 23 01:10:30.678426 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 41/101] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:10:30 2022] GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5 => generated 1291 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:10:30.924109 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=4 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:31.649481 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-23de7a4c-c4c1-42d5-bc6f-420af2da7395 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Action: 'update', calling method: .version_select at 0x7f5cc2c838b0>, body: {"quota_set": {"ram": "5120"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:31.707912 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-47d8f90c-d818-42c6-9af5-f6aecf380489 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:31.709250 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-47d8f90c-d818-42c6-9af5-f6aecf380489 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] [instance: e41aeb69-eb54-4844-9b0a-2efa50a230c5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:10:31.718398 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-47d8f90c-d818-42c6-9af5-f6aecf380489 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:31.719775 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-47d8f90c-d818-42c6-9af5-f6aecf380489 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:31.720455 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-47d8f90c-d818-42c6-9af5-f6aecf380489 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:31.721389 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-47d8f90c-d818-42c6-9af5-f6aecf380489 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:31.722213 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-47d8f90c-d818-42c6-9af5-f6aecf380489 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:31.723472 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-47d8f90c-d818-42c6-9af5-f6aecf380489 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:31.980664 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-47d8f90c-d818-42c6-9af5-f6aecf380489 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61093911783470a94d53354c15df815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a80a158b5c4e3baf87e83a284970c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:10:31.994038 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-47d8f90c-d818-42c6-9af5-f6aecf380489 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] 10.222.0.42 "GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5" status: 200 len: 1309 microversion: 2.1 time: 0.290800 Oct 23 01:10:32.014153 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 42/102] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:10:31 2022] GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5 => generated 1309 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:10:32.477082 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-23de7a4c-c4c1-42d5-bc6f-420af2da7395 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:32.477663 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-23de7a4c-c4c1-42d5-bc6f-420af2da7395 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:32.478126 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-23de7a4c-c4c1-42d5-bc6f-420af2da7395 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:32.479107 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-23de7a4c-c4c1-42d5-bc6f-420af2da7395 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:32.479760 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-23de7a4c-c4c1-42d5-bc6f-420af2da7395 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:32.480192 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-23de7a4c-c4c1-42d5-bc6f-420af2da7395 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:32.677392 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-23de7a4c-c4c1-42d5-bc6f-420af2da7395 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-sets/9e4c71074ecd4892a79a283ed8cd3a51" status: 200 len: 148 microversion: 2.57 time: 1.758579 Oct 23 01:10:32.678555 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 61/103] 10.222.0.42 () {62 vars in 1303 bytes} [Sun Oct 23 01:10:30 2022] PUT /compute/v2.1/os-quota-sets/9e4c71074ecd4892a79a283ed8cd3a51 => generated 148 bytes in 1761 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:10:32.696502 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6a4f4344-b1e4-46d4-9db9-a6455bdb111f tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Calling method '.version_select at 0x7f5cc2a6b940>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:33.024804 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bd8c1ecd-b12e-4fda-8456-2618b197387c tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:33.025721 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-bd8c1ecd-b12e-4fda-8456-2618b197387c tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] [instance: e41aeb69-eb54-4844-9b0a-2efa50a230c5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:10:33.037024 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd8c1ecd-b12e-4fda-8456-2618b197387c tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:33.042473 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd8c1ecd-b12e-4fda-8456-2618b197387c tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:33.044452 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd8c1ecd-b12e-4fda-8456-2618b197387c tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:33.045397 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd8c1ecd-b12e-4fda-8456-2618b197387c tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:33.049048 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd8c1ecd-b12e-4fda-8456-2618b197387c tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:33.050902 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd8c1ecd-b12e-4fda-8456-2618b197387c tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:33.349770 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bd8c1ecd-b12e-4fda-8456-2618b197387c tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61093911783470a94d53354c15df815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a80a158b5c4e3baf87e83a284970c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:10:33.383690 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bd8c1ecd-b12e-4fda-8456-2618b197387c tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] 10.222.0.42 "GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5" status: 200 len: 1297 microversion: 2.1 time: 0.363418 Oct 23 01:10:33.388736 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 62/104] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:10:33 2022] GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5 => generated 1297 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:10:33.468278 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6a4f4344-b1e4-46d4-9db9-a6455bdb111f tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:33.469352 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6a4f4344-b1e4-46d4-9db9-a6455bdb111f tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:33.470127 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6a4f4344-b1e4-46d4-9db9-a6455bdb111f tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:33.472762 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6a4f4344-b1e4-46d4-9db9-a6455bdb111f tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:33.475361 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6a4f4344-b1e4-46d4-9db9-a6455bdb111f tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:33.476135 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6a4f4344-b1e4-46d4-9db9-a6455bdb111f tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:33.534347 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6a4f4344-b1e4-46d4-9db9-a6455bdb111f tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/9e4c71074ecd4892a79a283ed8cd3a51/detail" status: 200 len: 463 microversion: 2.57 time: 0.842526 Oct 23 01:10:33.540581 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 43/105] 10.222.0.42 () {60 vars in 1304 bytes} [Sun Oct 23 01:10:32 2022] GET /compute/v2.1/os-quota-sets/9e4c71074ecd4892a79a283ed8cd3a51/detail => generated 463 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:10:34.504528 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-924667dd-b176-492d-8214-fe99067de7b5 tempest-FlavorsV261TestJSON-1036008239 tempest-FlavorsV261TestJSON-1036008239-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1114435349", "id": 1796410563, "os-flavor-access:is_public": "True"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:34.607210 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-385ba389-1802-4f88-9ca3-1178cb656412 tempest-HypervisorAdminNegativeTestJSON-587517076 tempest-HypervisorAdminNegativeTestJSON-587517076-project] Calling method '.version_select at 0x7f5cc2a2e5e0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:34.615372 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-385ba389-1802-4f88-9ca3-1178cb656412 tempest-HypervisorAdminNegativeTestJSON-587517076 tempest-HypervisorAdminNegativeTestJSON-587517076-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '055e1e9d12f8451a913462903fd60551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ebeb5bd09a489f81c7534e43b1ca44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:10:34.617534 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-385ba389-1802-4f88-9ca3-1178cb656412 tempest-HypervisorAdminNegativeTestJSON-587517076 tempest-HypervisorAdminNegativeTestJSON-587517076-project] Request method failure captured: Oct 23 01:10:34.617534 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 23 01:10:34.617534 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:10:34.617534 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:10:34.617534 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:10:34.617534 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:10:34.617534 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:10:34.617534 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:10:34.617534 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:10:34.617534 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:10:34.617534 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJSGPtbYb-EXnJqZrPxfhnvFB_5jqxBh-9syLzrfkbdvlZ8kMila7rUUg5YVxd7j1lojanC5STy9xcilVR_OLb2hTZb6tXzWybfIjGNDVfeAUwSXj_x394dvDhCDHoiF782fT1EURsK5C3HT5Jb_UgERlXZ_PTO8jKhmt4q0hK-ArUg Oct 23 01:10:34.617534 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:10:34.617534 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:10:34.617534 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:10:34.617534 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:10:34.617534 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:10:34.617534 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:10:34.617534 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 33ebeb5bd09a489f81c7534e43b1ca44 Oct 23 01:10:34.617534 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-587517076 Oct 23 01:10:34.617534 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:10:34.617534 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:10:34.618707 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/33ebeb5bd09a489f81c7534e43b1ca44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_33ebeb5bd09a489f81c7534e43b1ca44"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/33ebeb5bd09a489f81c7534e43b1ca44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/33ebeb5bd09a489f81c7534e43b1ca44"}]}] Oct 23 01:10:34.618707 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-587517076 Oct 23 01:10:34.618707 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 33ebeb5bd09a489f81c7534e43b1ca44 Oct 23 01:10:34.618707 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-587517076 Oct 23 01:10:34.618707 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-HypervisorAdminNegativeTestJSON-587517076-project Oct 23 01:10:34.618707 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:10:34.618707 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:10:34.618707 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 055e1e9d12f8451a913462903fd60551 Oct 23 01:10:34.618707 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-587517076-project Oct 23 01:10:34.618707 n-d-master-1 devstack@n-api.service[120944]: method: Oct 23 01:10:34.618707 n-d-master-1 devstack@n-api.service[120944]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 23 01:10:34.618707 n-d-master-1 devstack@n-api.service[120944]: action_args: {} Oct 23 01:10:34.618707 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:10:34.619439 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:34.619439 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:34.619439 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:34.619439 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:10:34.619439 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:10:34.619439 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:10:34.619439 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:10:34.619439 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:10:34.619439 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:10:34.619439 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 23 01:10:34.619439 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 23 01:10:34.619439 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 23 01:10:34.619439 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 23 01:10:34.619439 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 23 01:10:34.619439 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 23 01:10:34.619439 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 23 01:10:34.619439 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 23 01:10:34.619439 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:10:34.619439 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 23 01:10:34.620391 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:10:34.620391 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise self.value Oct 23 01:10:34.620391 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 23 01:10:34.620391 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 23 01:10:34.620391 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 23 01:10:34.620391 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 23 01:10:34.620391 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 23 01:10:34.620391 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 23 01:10:34.620391 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 23 01:10:34.620391 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:34.620391 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:34.620391 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:34.620391 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:34.620391 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:34.620391 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:34.620391 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 23 01:10:34.620391 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 23 01:10:34.620391 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 23 01:10:34.620391 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:34.623019 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-924667dd-b176-492d-8214-fe99067de7b5 tempest-FlavorsV261TestJSON-1036008239 tempest-FlavorsV261TestJSON-1036008239-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 1.113135 Oct 23 01:10:34.625629 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 63/106] 10.222.0.42 () {62 vars in 1188 bytes} [Sun Oct 23 01:10:33 2022] POST /compute/v2.1/flavors => generated 468 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:10:34.635409 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-385ba389-1802-4f88-9ca3-1178cb656412 tempest-HypervisorAdminNegativeTestJSON-587517076 tempest-HypervisorAdminNegativeTestJSON-587517076-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:10:34.636423 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-385ba389-1802-4f88-9ca3-1178cb656412 tempest-HypervisorAdminNegativeTestJSON-587517076 tempest-HypervisorAdminNegativeTestJSON-587517076-project] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.922116 Oct 23 01:10:34.638581 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-924667dd-b176-492d-8214-fe99067de7b5 tempest-FlavorsV261TestJSON-1036008239 tempest-FlavorsV261TestJSON-1036008239-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:34.643875 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-924667dd-b176-492d-8214-fe99067de7b5 tempest-FlavorsV261TestJSON-1036008239 tempest-FlavorsV261TestJSON-1036008239-project-admin] 10.222.0.42 "GET /compute//" status: 200 len: 377 microversion: - time: 0.005553 Oct 23 01:10:34.646367 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 44/107] 10.222.0.42 () {58 vars in 1167 bytes} [Sun Oct 23 01:10:33 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 933 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:10:34.647017 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 64/108] 10.222.0.42 () {56 vars in 886 bytes} [Sun Oct 23 01:10:34 2022] GET /compute/ => generated 377 bytes in 21 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 23 01:10:34.670993 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-90bd84cf-f433-4edd-840e-01ca3e6679c0 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:34.672074 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-90bd84cf-f433-4edd-840e-01ca3e6679c0 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] [instance: e41aeb69-eb54-4844-9b0a-2efa50a230c5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:10:34.692417 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-90bd84cf-f433-4edd-840e-01ca3e6679c0 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:34.696776 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-90bd84cf-f433-4edd-840e-01ca3e6679c0 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:34.697236 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-90bd84cf-f433-4edd-840e-01ca3e6679c0 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:34.698008 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-90bd84cf-f433-4edd-840e-01ca3e6679c0 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:34.699701 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-90bd84cf-f433-4edd-840e-01ca3e6679c0 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:34.699701 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-90bd84cf-f433-4edd-840e-01ca3e6679c0 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:35.014569 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-90bd84cf-f433-4edd-840e-01ca3e6679c0 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61093911783470a94d53354c15df815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a80a158b5c4e3baf87e83a284970c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:10:35.029681 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-90bd84cf-f433-4edd-840e-01ca3e6679c0 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] 10.222.0.42 "GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5" status: 200 len: 1339 microversion: 2.1 time: 0.376360 Oct 23 01:10:35.031146 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 45/109] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:10:34 2022] GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5 => generated 1339 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:10:35.053079 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e4835a18-f958-492d-921c-a959b57b3257 tempest-HypervisorAdminNegativeTestJSON-587517076 tempest-HypervisorAdminNegativeTestJSON-587517076-project] Calling method '.version_select at 0x7f5cc2a2e5e0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:35.055242 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e4835a18-f958-492d-921c-a959b57b3257 tempest-HypervisorAdminNegativeTestJSON-587517076 tempest-HypervisorAdminNegativeTestJSON-587517076-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '055e1e9d12f8451a913462903fd60551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ebeb5bd09a489f81c7534e43b1ca44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:10:35.058299 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e4835a18-f958-492d-921c-a959b57b3257 tempest-HypervisorAdminNegativeTestJSON-587517076 tempest-HypervisorAdminNegativeTestJSON-587517076-project] Request method failure captured: Oct 23 01:10:35.058299 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 23 01:10:35.058299 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:10:35.058299 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:10:35.058299 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:10:35.058299 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:10:35.058299 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:10:35.058299 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:10:35.058299 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:10:35.058299 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:10:35.058299 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJSGPtbYb-EXnJqZrPxfhnvFB_5jqxBh-9syLzrfkbdvlZ8kMila7rUUg5YVxd7j1lojanC5STy9xcilVR_OLb2hTZb6tXzWybfIjGNDVfeAUwSXj_x394dvDhCDHoiF782fT1EURsK5C3HT5Jb_UgERlXZ_PTO8jKhmt4q0hK-ArUg Oct 23 01:10:35.058299 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:10:35.058299 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:10:35.058299 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:10:35.058299 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:10:35.058299 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:10:35.058299 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:10:35.058299 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 33ebeb5bd09a489f81c7534e43b1ca44 Oct 23 01:10:35.058299 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-587517076 Oct 23 01:10:35.058299 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:10:35.058299 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:10:35.059467 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/33ebeb5bd09a489f81c7534e43b1ca44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_33ebeb5bd09a489f81c7534e43b1ca44"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/33ebeb5bd09a489f81c7534e43b1ca44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/33ebeb5bd09a489f81c7534e43b1ca44"}]}] Oct 23 01:10:35.059467 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-587517076 Oct 23 01:10:35.059467 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 33ebeb5bd09a489f81c7534e43b1ca44 Oct 23 01:10:35.059467 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-587517076 Oct 23 01:10:35.059467 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-HypervisorAdminNegativeTestJSON-587517076-project Oct 23 01:10:35.059467 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:10:35.059467 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:10:35.059467 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 055e1e9d12f8451a913462903fd60551 Oct 23 01:10:35.059467 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-587517076-project Oct 23 01:10:35.059467 n-d-master-1 devstack@n-api.service[120944]: method: Oct 23 01:10:35.059467 n-d-master-1 devstack@n-api.service[120944]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 23 01:10:35.059467 n-d-master-1 devstack@n-api.service[120944]: action_args: {} Oct 23 01:10:35.059467 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:10:35.060306 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:35.060306 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:35.060306 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:35.060306 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:10:35.060306 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:10:35.060306 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:10:35.060306 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:10:35.060306 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:10:35.060306 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:10:35.060306 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 23 01:10:35.060306 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 23 01:10:35.060306 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 23 01:10:35.060306 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 23 01:10:35.060306 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 23 01:10:35.060306 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 23 01:10:35.060306 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 23 01:10:35.060306 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 23 01:10:35.060306 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:10:35.060306 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 23 01:10:35.061499 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:10:35.061499 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise self.value Oct 23 01:10:35.061499 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 23 01:10:35.061499 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 23 01:10:35.061499 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 23 01:10:35.061499 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 23 01:10:35.061499 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 23 01:10:35.061499 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 23 01:10:35.061499 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 23 01:10:35.061499 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:35.061499 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:35.061499 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:35.061499 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:35.061499 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:35.061499 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:35.061499 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 23 01:10:35.061499 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 23 01:10:35.061499 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 23 01:10:35.061499 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:35.064892 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e4835a18-f958-492d-921c-a959b57b3257 tempest-HypervisorAdminNegativeTestJSON-587517076 tempest-HypervisorAdminNegativeTestJSON-587517076-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:10:35.066247 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e4835a18-f958-492d-921c-a959b57b3257 tempest-HypervisorAdminNegativeTestJSON-587517076 tempest-HypervisorAdminNegativeTestJSON-587517076-project] 10.222.0.42 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.017272 Oct 23 01:10:35.067651 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 46/110] 10.222.0.42 () {58 vars in 1146 bytes} [Sun Oct 23 01:10:35 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:10:35.092958 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f7127e6a-f14d-4fd2-80e5-47aa5b0f7df8 tempest-HypervisorAdminNegativeTestJSON-587517076 tempest-HypervisorAdminNegativeTestJSON-587517076-project] Calling method '.version_select at 0x7f5cc29fe820>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:35.099235 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f7127e6a-f14d-4fd2-80e5-47aa5b0f7df8 tempest-HypervisorAdminNegativeTestJSON-587517076 tempest-HypervisorAdminNegativeTestJSON-587517076-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '055e1e9d12f8451a913462903fd60551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ebeb5bd09a489f81c7534e43b1ca44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:10:35.102867 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f7127e6a-f14d-4fd2-80e5-47aa5b0f7df8 tempest-HypervisorAdminNegativeTestJSON-587517076 tempest-HypervisorAdminNegativeTestJSON-587517076-project] Request method failure captured: Oct 23 01:10:35.102867 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 23 01:10:35.102867 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:10:35.102867 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:10:35.102867 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:10:35.102867 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:10:35.102867 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:10:35.102867 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:10:35.102867 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:10:35.102867 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:10:35.102867 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJSGPtbYb-EXnJqZrPxfhnvFB_5jqxBh-9syLzrfkbdvlZ8kMila7rUUg5YVxd7j1lojanC5STy9xcilVR_OLb2hTZb6tXzWybfIjGNDVfeAUwSXj_x394dvDhCDHoiF782fT1EURsK5C3HT5Jb_UgERlXZ_PTO8jKhmt4q0hK-ArUg Oct 23 01:10:35.102867 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:10:35.102867 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:10:35.102867 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:10:35.102867 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:10:35.102867 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:10:35.102867 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:10:35.102867 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 33ebeb5bd09a489f81c7534e43b1ca44 Oct 23 01:10:35.102867 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-587517076 Oct 23 01:10:35.102867 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:10:35.102867 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:10:35.110903 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/33ebeb5bd09a489f81c7534e43b1ca44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_33ebeb5bd09a489f81c7534e43b1ca44"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/33ebeb5bd09a489f81c7534e43b1ca44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/33ebeb5bd09a489f81c7534e43b1ca44"}]}] Oct 23 01:10:35.110903 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-587517076 Oct 23 01:10:35.110903 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 33ebeb5bd09a489f81c7534e43b1ca44 Oct 23 01:10:35.110903 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-587517076 Oct 23 01:10:35.110903 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-HypervisorAdminNegativeTestJSON-587517076-project Oct 23 01:10:35.110903 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:10:35.110903 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:10:35.110903 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 055e1e9d12f8451a913462903fd60551 Oct 23 01:10:35.110903 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-587517076-project Oct 23 01:10:35.110903 n-d-master-1 devstack@n-api.service[120944]: method: Oct 23 01:10:35.110903 n-d-master-1 devstack@n-api.service[120944]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 23 01:10:35.110903 n-d-master-1 devstack@n-api.service[120944]: action_args: {} Oct 23 01:10:35.110903 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:10:35.111985 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:35.111985 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:35.111985 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:35.111985 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:10:35.111985 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:10:35.111985 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:10:35.111985 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:10:35.111985 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:10:35.111985 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:10:35.111985 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 23 01:10:35.111985 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 23 01:10:35.111985 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 23 01:10:35.111985 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 23 01:10:35.111985 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 23 01:10:35.111985 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 23 01:10:35.111985 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:10:35.111985 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 23 01:10:35.111985 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:10:35.111985 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise self.value Oct 23 01:10:35.113358 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 23 01:10:35.113358 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 23 01:10:35.113358 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 23 01:10:35.113358 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 23 01:10:35.113358 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 23 01:10:35.113358 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 23 01:10:35.113358 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 23 01:10:35.113358 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:35.113358 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:35.113358 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:35.113358 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:35.113358 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:35.113358 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:35.113358 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 23 01:10:35.113358 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 23 01:10:35.113358 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 23 01:10:35.113358 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:10:35.114634 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f7127e6a-f14d-4fd2-80e5-47aa5b0f7df8 tempest-HypervisorAdminNegativeTestJSON-587517076 tempest-HypervisorAdminNegativeTestJSON-587517076-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:10:35.114634 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f7127e6a-f14d-4fd2-80e5-47aa5b0f7df8 tempest-HypervisorAdminNegativeTestJSON-587517076 tempest-HypervisorAdminNegativeTestJSON-587517076-project] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.031598 Oct 23 01:10:35.114634 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 47/111] 10.222.0.42 () {58 vars in 1179 bytes} [Sun Oct 23 01:10:35 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:10:35.156014 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-83d5bdb1-795a-4686-a324-0e9f6692d61d tempest-FlavorsV261TestJSON-67722736 tempest-FlavorsV261TestJSON-67722736-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:35.172418 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-83d5bdb1-795a-4686-a324-0e9f6692d61d tempest-FlavorsV261TestJSON-67722736 tempest-FlavorsV261TestJSON-67722736-project] 10.222.0.42 "GET /compute/v2.1/flavors/1796410563" status: 200 len: 468 microversion: 2.61 time: 0.519685 Oct 23 01:10:35.237074 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 65/112] 10.222.0.42 () {60 vars in 1199 bytes} [Sun Oct 23 01:10:34 2022] GET /compute/v2.1/flavors/1796410563 => generated 468 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:10:35.237074 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1efba771-953c-4df6-9fa3-bb9ba8ef9a65 tempest-FlavorsV261TestJSON-1036008239 tempest-FlavorsV261TestJSON-1036008239-project-admin] Action: 'update', calling method: .version_select at 0x7f5cc3dd4b80>, body: {"flavor": {"description": "new"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:35.567094 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1efba771-953c-4df6-9fa3-bb9ba8ef9a65 tempest-FlavorsV261TestJSON-1036008239 tempest-FlavorsV261TestJSON-1036008239-project-admin] 10.222.0.42 "PUT /compute/v2.1/flavors/1796410563" status: 200 len: 469 microversion: 2.61 time: 0.376318 Oct 23 01:10:35.567800 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 66/113] 10.222.0.42 () {62 vars in 1219 bytes} [Sun Oct 23 01:10:35 2022] PUT /compute/v2.1/flavors/1796410563 => generated 469 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 23 01:10:35.583061 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d23445e4-8129-4b01-9aa2-5c61b9f8cdd5 tempest-FlavorsV261TestJSON-67722736 tempest-FlavorsV261TestJSON-67722736-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:35.662937 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d23445e4-8129-4b01-9aa2-5c61b9f8cdd5 tempest-FlavorsV261TestJSON-67722736 tempest-FlavorsV261TestJSON-67722736-project] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 6250 microversion: 2.61 time: 0.085431 Oct 23 01:10:35.664020 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 67/114] 10.222.0.42 () {60 vars in 1187 bytes} [Sun Oct 23 01:10:35 2022] GET /compute/v2.1/flavors/detail => generated 6250 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:10:35.691550 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-56a49774-204b-47c6-8a00-a5f9f420473f tempest-FlavorsV261TestJSON-67722736 tempest-FlavorsV261TestJSON-67722736-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:35.725610 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-56a49774-204b-47c6-8a00-a5f9f420473f tempest-FlavorsV261TestJSON-67722736 tempest-FlavorsV261TestJSON-67722736-project] 10.222.0.42 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.61 time: 0.037942 Oct 23 01:10:35.726887 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 68/115] 10.222.0.42 () {60 vars in 1166 bytes} [Sun Oct 23 01:10:35 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:10:35.749631 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7d2f5960-7000-48d6-9a41-f6709c22feaa tempest-FlavorsV261TestJSON-1036008239 tempest-FlavorsV261TestJSON-1036008239-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:35.854335 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7d2f5960-7000-48d6-9a41-f6709c22feaa tempest-FlavorsV261TestJSON-1036008239 tempest-FlavorsV261TestJSON-1036008239-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/1796410563" status: 202 len: 0 microversion: 2.61 time: 0.113035 Oct 23 01:10:35.855596 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 69/116] 10.222.0.42 () {60 vars in 1202 bytes} [Sun Oct 23 01:10:35 2022] DELETE /compute/v2.1/flavors/1796410563 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 23 01:10:35.865050 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f43bc705-ae79-4578-a41b-b2c9c52599e1 tempest-FlavorsV261TestJSON-1036008239 tempest-FlavorsV261TestJSON-1036008239-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:35.908785 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f43bc705-ae79-4578-a41b-b2c9c52599e1 tempest-FlavorsV261TestJSON-1036008239 tempest-FlavorsV261TestJSON-1036008239-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.040910 Oct 23 01:10:35.910362 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 70/117] 10.222.0.42 () {60 vars in 1187 bytes} [Sun Oct 23 01:10:35 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:10:36.066986 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6c76aa8d-41c7-469b-8819-5dbdcc43f845 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:36.069713 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6c76aa8d-41c7-469b-8819-5dbdcc43f845 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] [instance: e41aeb69-eb54-4844-9b0a-2efa50a230c5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:10:36.084331 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6c76aa8d-41c7-469b-8819-5dbdcc43f845 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:36.085088 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6c76aa8d-41c7-469b-8819-5dbdcc43f845 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:36.085917 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6c76aa8d-41c7-469b-8819-5dbdcc43f845 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:36.087441 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6c76aa8d-41c7-469b-8819-5dbdcc43f845 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:36.088890 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6c76aa8d-41c7-469b-8819-5dbdcc43f845 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:36.090014 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6c76aa8d-41c7-469b-8819-5dbdcc43f845 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:36.261237 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-870dfc0b-2cc2-4390-88e7-aa2141957f3b tempest-HypervisorAdminNegativeTestJSON-355322717 tempest-HypervisorAdminNegativeTestJSON-355322717-project-admin] Calling method '.version_select at 0x7f5cc2a57b80>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:36.269771 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-870dfc0b-2cc2-4390-88e7-aa2141957f3b tempest-HypervisorAdminNegativeTestJSON-355322717 tempest-HypervisorAdminNegativeTestJSON-355322717-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:36.270419 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-870dfc0b-2cc2-4390-88e7-aa2141957f3b tempest-HypervisorAdminNegativeTestJSON-355322717 tempest-HypervisorAdminNegativeTestJSON-355322717-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:36.271101 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-870dfc0b-2cc2-4390-88e7-aa2141957f3b tempest-HypervisorAdminNegativeTestJSON-355322717 tempest-HypervisorAdminNegativeTestJSON-355322717-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:36.328031 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-870dfc0b-2cc2-4390-88e7-aa2141957f3b tempest-HypervisorAdminNegativeTestJSON-355322717 tempest-HypervisorAdminNegativeTestJSON-355322717-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:36.335331 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-870dfc0b-2cc2-4390-88e7-aa2141957f3b tempest-HypervisorAdminNegativeTestJSON-355322717 tempest-HypervisorAdminNegativeTestJSON-355322717-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:36.336123 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-870dfc0b-2cc2-4390-88e7-aa2141957f3b tempest-HypervisorAdminNegativeTestJSON-355322717 tempest-HypervisorAdminNegativeTestJSON-355322717-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:36.384216 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-870dfc0b-2cc2-4390-88e7-aa2141957f3b tempest-HypervisorAdminNegativeTestJSON-355322717 tempest-HypervisorAdminNegativeTestJSON-355322717-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:36.386655 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-870dfc0b-2cc2-4390-88e7-aa2141957f3b tempest-HypervisorAdminNegativeTestJSON-355322717 tempest-HypervisorAdminNegativeTestJSON-355322717-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:36.386655 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-870dfc0b-2cc2-4390-88e7-aa2141957f3b tempest-HypervisorAdminNegativeTestJSON-355322717 tempest-HypervisorAdminNegativeTestJSON-355322717-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:36.410583 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-870dfc0b-2cc2-4390-88e7-aa2141957f3b tempest-HypervisorAdminNegativeTestJSON-355322717 tempest-HypervisorAdminNegativeTestJSON-355322717-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 1.292858 Oct 23 01:10:36.418307 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 48/118] 10.222.0.42 () {58 vars in 1146 bytes} [Sun Oct 23 01:10:35 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:10:36.430197 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d147a79b-fb1e-4fa4-a55c-1bdb50787410 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Action: 'update', calling method: .version_select at 0x7f5cc2ae9790>, body: {"quota_set": {"ram": "2048"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:36.550589 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6c76aa8d-41c7-469b-8819-5dbdcc43f845 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61093911783470a94d53354c15df815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a80a158b5c4e3baf87e83a284970c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:10:36.561894 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6c76aa8d-41c7-469b-8819-5dbdcc43f845 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] 10.222.0.42 "GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5" status: 200 len: 1339 microversion: 2.1 time: 0.510818 Oct 23 01:10:36.578081 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 71/119] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:10:36 2022] GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5 => generated 1339 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:10:36.586577 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-90723097-cce5-4b03-b80a-7731acf37ea1 tempest-HypervisorAdminNegativeTestJSON-587517076 tempest-HypervisorAdminNegativeTestJSON-587517076-project] Calling method '.version_select at 0x7f5cc2b580d0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:36.588988 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-90723097-cce5-4b03-b80a-7731acf37ea1 tempest-HypervisorAdminNegativeTestJSON-587517076 tempest-HypervisorAdminNegativeTestJSON-587517076-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '055e1e9d12f8451a913462903fd60551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ebeb5bd09a489f81c7534e43b1ca44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:10:36.591248 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-90723097-cce5-4b03-b80a-7731acf37ea1 tempest-HypervisorAdminNegativeTestJSON-587517076 tempest-HypervisorAdminNegativeTestJSON-587517076-project] Request method failure captured: Oct 23 01:10:36.591248 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 23 01:10:36.591248 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:10:36.591248 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:10:36.591248 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:10:36.591248 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:10:36.591248 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:10:36.591248 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:10:36.591248 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:10:36.591248 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:10:36.591248 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJSGPtbYb-EXnJqZrPxfhnvFB_5jqxBh-9syLzrfkbdvlZ8kMila7rUUg5YVxd7j1lojanC5STy9xcilVR_OLb2hTZb6tXzWybfIjGNDVfeAUwSXj_x394dvDhCDHoiF782fT1EURsK5C3HT5Jb_UgERlXZ_PTO8jKhmt4q0hK-ArUg Oct 23 01:10:36.591248 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:10:36.591248 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:10:36.591248 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:10:36.591248 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:10:36.591248 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:10:36.591248 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:10:36.591248 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 33ebeb5bd09a489f81c7534e43b1ca44 Oct 23 01:10:36.591248 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-587517076 Oct 23 01:10:36.591248 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:10:36.591248 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:10:36.592803 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/33ebeb5bd09a489f81c7534e43b1ca44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_33ebeb5bd09a489f81c7534e43b1ca44"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/33ebeb5bd09a489f81c7534e43b1ca44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/33ebeb5bd09a489f81c7534e43b1ca44"}]}] Oct 23 01:10:36.592803 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-587517076 Oct 23 01:10:36.592803 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 33ebeb5bd09a489f81c7534e43b1ca44 Oct 23 01:10:36.592803 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-587517076 Oct 23 01:10:36.592803 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-HypervisorAdminNegativeTestJSON-587517076-project Oct 23 01:10:36.592803 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:10:36.592803 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:10:36.592803 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 055e1e9d12f8451a913462903fd60551 Oct 23 01:10:36.592803 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-587517076-project Oct 23 01:10:36.592803 n-d-master-1 devstack@n-api.service[120945]: method: Oct 23 01:10:36.592803 n-d-master-1 devstack@n-api.service[120945]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 23 01:10:36.592803 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '1'} Oct 23 01:10:36.592803 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:10:36.593732 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:36.593732 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:36.593732 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:36.593732 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:10:36.593732 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:10:36.593732 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:10:36.593732 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:10:36.593732 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:10:36.593732 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:10:36.593732 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 23 01:10:36.593732 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 23 01:10:36.593732 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 23 01:10:36.593732 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 23 01:10:36.593732 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 23 01:10:36.593732 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 23 01:10:36.593732 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:10:36.593732 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 23 01:10:36.593732 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:10:36.593732 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise self.value Oct 23 01:10:36.595271 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 23 01:10:36.595271 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 23 01:10:36.595271 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 23 01:10:36.595271 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 23 01:10:36.595271 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 23 01:10:36.595271 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 23 01:10:36.595271 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 23 01:10:36.595271 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:36.595271 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:36.595271 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:36.595271 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:36.595271 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:36.595271 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:36.595271 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 23 01:10:36.595271 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 23 01:10:36.595271 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 23 01:10:36.595271 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:36.598231 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-90723097-cce5-4b03-b80a-7731acf37ea1 tempest-HypervisorAdminNegativeTestJSON-587517076 tempest-HypervisorAdminNegativeTestJSON-587517076-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:10:36.604239 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-90723097-cce5-4b03-b80a-7731acf37ea1 tempest-HypervisorAdminNegativeTestJSON-587517076 tempest-HypervisorAdminNegativeTestJSON-587517076-project] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.019944 Oct 23 01:10:36.604239 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 72/120] 10.222.0.42 () {58 vars in 1173 bytes} [Sun Oct 23 01:10:36 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:10:36.610250 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ead11781-e9b2-4186-94a5-ebcfb54e24b7 tempest-HypervisorAdminNegativeTestJSON-355322717 tempest-HypervisorAdminNegativeTestJSON-355322717-project-admin] Calling method '.version_select at 0x7f5cc2a809d0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:36.613305 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-ead11781-e9b2-4186-94a5-ebcfb54e24b7 tempest-HypervisorAdminNegativeTestJSON-355322717 tempest-HypervisorAdminNegativeTestJSON-355322717-project-admin] HTTP exception thrown: Hypervisor with ID '53f56da8-1c34-4a5a-98af-60d72214b520' could not be found. Oct 23 01:10:36.616570 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ead11781-e9b2-4186-94a5-ebcfb54e24b7 tempest-HypervisorAdminNegativeTestJSON-355322717 tempest-HypervisorAdminNegativeTestJSON-355322717-project-admin] Request method failure captured: Oct 23 01:10:36.616570 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/os-hypervisors/53f56da8-1c34-4a5a-98af-60d72214b520/uptime HTTP/1.1 Oct 23 01:10:36.616570 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:10:36.616570 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:10:36.616570 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:10:36.616570 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:10:36.616570 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:10:36.616570 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:10:36.616570 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:10:36.616570 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:10:36.616570 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJSJWlAgz5zodK-m7mK7ijM-xiIALXc-vNiho26iEyw12xkaBUA4780KmVygObSWFdo0UjzGC8RcXE-mLnCf8aUAhGLqPm_cQa_XnqPzD-AN8w2RkGh002IXGVer8Ul0lD0jugIYF5QPyZssPIG-M8tpeIV3T8o74yzmuiPOGo-rfdU Oct 23 01:10:36.616570 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:10:36.616570 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:10:36.616570 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:10:36.616570 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:10:36.616570 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:10:36.616570 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:10:36.616570 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 3895245eee0c4eeda3f70424e0ae710f Oct 23 01:10:36.616570 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-355322717 Oct 23 01:10:36.616570 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,admin,reader Oct 23 01:10:36.616570 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,admin,reader Oct 23 01:10:36.618300 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3895245eee0c4eeda3f70424e0ae710f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3895245eee0c4eeda3f70424e0ae710f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3895245eee0c4eeda3f70424e0ae710f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3895245eee0c4eeda3f70424e0ae710f"}]}] Oct 23 01:10:36.618300 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-355322717 Oct 23 01:10:36.618300 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 3895245eee0c4eeda3f70424e0ae710f Oct 23 01:10:36.618300 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-355322717 Oct 23 01:10:36.618300 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-HypervisorAdminNegativeTestJSON-355322717-project-admin Oct 23 01:10:36.618300 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:10:36.618300 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:10:36.618300 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 55621f878c964a21aedc9ed9a9cb2fe1 Oct 23 01:10:36.618300 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-355322717-project-admin Oct 23 01:10:36.618300 n-d-master-1 devstack@n-api.service[120945]: method: Oct 23 01:10:36.618300 n-d-master-1 devstack@n-api.service[120945]: exception: Hypervisor with ID '53f56da8-1c34-4a5a-98af-60d72214b520' could not be found. Oct 23 01:10:36.618300 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '53f56da8-1c34-4a5a-98af-60d72214b520'} Oct 23 01:10:36.619119 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:10:36.619119 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:36.619119 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 23 01:10:36.619119 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 23 01:10:36.619119 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '53f56da8-1c34-4a5a-98af-60d72214b520' Oct 23 01:10:36.619119 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:36.619119 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:36.619119 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:36.619119 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:36.619119 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 23 01:10:36.619119 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 23 01:10:36.619119 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 23 01:10:36.619119 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 23 01:10:36.619119 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 23 01:10:36.619119 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:36.619119 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:36.619119 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:36.619119 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:36.619119 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 23 01:10:36.619119 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 23 01:10:36.619119 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 23 01:10:36.619119 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 23 01:10:36.620432 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 23 01:10:36.620432 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:36.620432 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:36.620432 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:36.620432 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:36.620432 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:36.620432 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:36.620432 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:10:36.620432 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:10:36.620432 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:10:36.620432 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:10:36.620432 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:10:36.620432 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:10:36.620432 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 23 01:10:36.620432 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 23 01:10:36.620432 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 23 01:10:36.620432 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 23 01:10:36.620432 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '53f56da8-1c34-4a5a-98af-60d72214b520' could not be found. Oct 23 01:10:36.620432 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:36.620432 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:36.620432 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:36.621731 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:36.621731 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:36.621731 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:36.621731 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:10:36.621731 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:10:36.621731 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '53f56da8-1c34-4a5a-98af-60d72214b520' could not be found. Oct 23 01:10:36.621731 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:36.623202 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ead11781-e9b2-4186-94a5-ebcfb54e24b7 tempest-HypervisorAdminNegativeTestJSON-355322717 tempest-HypervisorAdminNegativeTestJSON-355322717-project-admin] Returning 404 to user: Hypervisor with ID '53f56da8-1c34-4a5a-98af-60d72214b520' could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:10:36.624459 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ead11781-e9b2-4186-94a5-ebcfb54e24b7 tempest-HypervisorAdminNegativeTestJSON-355322717 tempest-HypervisorAdminNegativeTestJSON-355322717-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/53f56da8-1c34-4a5a-98af-60d72214b520/uptime" status: 404 len: 123 microversion: 2.1 time: 0.018891 Oct 23 01:10:36.625582 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 73/121] 10.222.0.42 () {58 vars in 1278 bytes} [Sun Oct 23 01:10:36 2022] GET /compute/v2.1/os-hypervisors/53f56da8-1c34-4a5a-98af-60d72214b520/uptime => generated 123 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:10:36.646427 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-233337e3-ef1c-4e9e-a4c9-cfcd66c7a4b4 tempest-HypervisorAdminNegativeTestJSON-355322717 tempest-HypervisorAdminNegativeTestJSON-355322717-project-admin] Calling method '.version_select at 0x7f5cc381cd30>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:36.649280 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-233337e3-ef1c-4e9e-a4c9-cfcd66c7a4b4 tempest-HypervisorAdminNegativeTestJSON-355322717 tempest-HypervisorAdminNegativeTestJSON-355322717-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:36.649844 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-233337e3-ef1c-4e9e-a4c9-cfcd66c7a4b4 tempest-HypervisorAdminNegativeTestJSON-355322717 tempest-HypervisorAdminNegativeTestJSON-355322717-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:36.652852 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-233337e3-ef1c-4e9e-a4c9-cfcd66c7a4b4 tempest-HypervisorAdminNegativeTestJSON-355322717 tempest-HypervisorAdminNegativeTestJSON-355322717-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:36.692133 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-233337e3-ef1c-4e9e-a4c9-cfcd66c7a4b4 tempest-HypervisorAdminNegativeTestJSON-355322717 tempest-HypervisorAdminNegativeTestJSON-355322717-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:36.693148 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-233337e3-ef1c-4e9e-a4c9-cfcd66c7a4b4 tempest-HypervisorAdminNegativeTestJSON-355322717 tempest-HypervisorAdminNegativeTestJSON-355322717-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:36.695868 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-233337e3-ef1c-4e9e-a4c9-cfcd66c7a4b4 tempest-HypervisorAdminNegativeTestJSON-355322717 tempest-HypervisorAdminNegativeTestJSON-355322717-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:36.708651 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-233337e3-ef1c-4e9e-a4c9-cfcd66c7a4b4 tempest-HypervisorAdminNegativeTestJSON-355322717 tempest-HypervisorAdminNegativeTestJSON-355322717-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:36.709252 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-233337e3-ef1c-4e9e-a4c9-cfcd66c7a4b4 tempest-HypervisorAdminNegativeTestJSON-355322717 tempest-HypervisorAdminNegativeTestJSON-355322717-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:36.709820 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-233337e3-ef1c-4e9e-a4c9-cfcd66c7a4b4 tempest-HypervisorAdminNegativeTestJSON-355322717 tempest-HypervisorAdminNegativeTestJSON-355322717-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:36.716547 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-233337e3-ef1c-4e9e-a4c9-cfcd66c7a4b4 tempest-HypervisorAdminNegativeTestJSON-355322717 tempest-HypervisorAdminNegativeTestJSON-355322717-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.078041 Oct 23 01:10:36.717279 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 74/122] 10.222.0.42 () {58 vars in 1146 bytes} [Sun Oct 23 01:10:36 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:10:36.729178 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cbbdc917-2ba0-4738-8fef-38b733038e3d tempest-HypervisorAdminNegativeTestJSON-587517076 tempest-HypervisorAdminNegativeTestJSON-587517076-project] Calling method '.version_select at 0x7f5cc2a80940>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:36.736826 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cbbdc917-2ba0-4738-8fef-38b733038e3d tempest-HypervisorAdminNegativeTestJSON-587517076 tempest-HypervisorAdminNegativeTestJSON-587517076-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '055e1e9d12f8451a913462903fd60551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ebeb5bd09a489f81c7534e43b1ca44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:10:36.738650 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cbbdc917-2ba0-4738-8fef-38b733038e3d tempest-HypervisorAdminNegativeTestJSON-587517076 tempest-HypervisorAdminNegativeTestJSON-587517076-project] Request method failure captured: Oct 23 01:10:36.738650 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 23 01:10:36.738650 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:10:36.738650 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:10:36.738650 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:10:36.738650 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:10:36.738650 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:10:36.738650 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:10:36.738650 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:10:36.738650 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:10:36.738650 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJSGPtbYb-EXnJqZrPxfhnvFB_5jqxBh-9syLzrfkbdvlZ8kMila7rUUg5YVxd7j1lojanC5STy9xcilVR_OLb2hTZb6tXzWybfIjGNDVfeAUwSXj_x394dvDhCDHoiF782fT1EURsK5C3HT5Jb_UgERlXZ_PTO8jKhmt4q0hK-ArUg Oct 23 01:10:36.738650 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:10:36.738650 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:10:36.738650 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:10:36.738650 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:10:36.738650 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:10:36.738650 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:10:36.738650 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 33ebeb5bd09a489f81c7534e43b1ca44 Oct 23 01:10:36.738650 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-587517076 Oct 23 01:10:36.738650 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:10:36.738650 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:10:36.740012 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/33ebeb5bd09a489f81c7534e43b1ca44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_33ebeb5bd09a489f81c7534e43b1ca44"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/33ebeb5bd09a489f81c7534e43b1ca44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/33ebeb5bd09a489f81c7534e43b1ca44"}]}] Oct 23 01:10:36.740012 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-587517076 Oct 23 01:10:36.740012 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 33ebeb5bd09a489f81c7534e43b1ca44 Oct 23 01:10:36.740012 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-587517076 Oct 23 01:10:36.740012 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-HypervisorAdminNegativeTestJSON-587517076-project Oct 23 01:10:36.740012 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:10:36.740012 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:10:36.740012 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 055e1e9d12f8451a913462903fd60551 Oct 23 01:10:36.740012 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-587517076-project Oct 23 01:10:36.740012 n-d-master-1 devstack@n-api.service[120945]: method: Oct 23 01:10:36.740012 n-d-master-1 devstack@n-api.service[120945]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 23 01:10:36.740012 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '1'} Oct 23 01:10:36.740012 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:10:36.740843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:36.740843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:36.740843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:36.740843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:10:36.740843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:10:36.740843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:10:36.740843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:10:36.740843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:10:36.740843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:10:36.740843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 23 01:10:36.740843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 23 01:10:36.740843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 23 01:10:36.740843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 23 01:10:36.740843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 23 01:10:36.740843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 23 01:10:36.740843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 23 01:10:36.740843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 23 01:10:36.740843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:10:36.740843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 23 01:10:36.742663 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:10:36.742663 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise self.value Oct 23 01:10:36.742663 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 23 01:10:36.742663 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 23 01:10:36.742663 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 23 01:10:36.742663 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 23 01:10:36.742663 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 23 01:10:36.742663 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 23 01:10:36.742663 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 23 01:10:36.742663 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:36.742663 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:36.742663 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:36.742663 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:36.742663 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:36.742663 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:36.742663 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 23 01:10:36.742663 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 23 01:10:36.742663 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 23 01:10:36.742663 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:36.743873 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cbbdc917-2ba0-4738-8fef-38b733038e3d tempest-HypervisorAdminNegativeTestJSON-587517076 tempest-HypervisorAdminNegativeTestJSON-587517076-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:10:36.746246 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cbbdc917-2ba0-4738-8fef-38b733038e3d tempest-HypervisorAdminNegativeTestJSON-587517076 tempest-HypervisorAdminNegativeTestJSON-587517076-project] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.020887 Oct 23 01:10:36.746949 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 75/123] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Oct 23 01:10:36 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 23 01:10:36.757621 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-91b8fac7-7929-47b0-b715-58519f1a69b0 tempest-HypervisorAdminNegativeTestJSON-355322717 tempest-HypervisorAdminNegativeTestJSON-355322717-project-admin] Calling method '.version_select at 0x7f5cc2b58040>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:36.759669 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-91b8fac7-7929-47b0-b715-58519f1a69b0 tempest-HypervisorAdminNegativeTestJSON-355322717 tempest-HypervisorAdminNegativeTestJSON-355322717-project-admin] HTTP exception thrown: Hypervisor with ID 'd6857c1e-2105-4d7b-ae23-82e4dc11fae8' could not be found. Oct 23 01:10:36.762970 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-91b8fac7-7929-47b0-b715-58519f1a69b0 tempest-HypervisorAdminNegativeTestJSON-355322717 tempest-HypervisorAdminNegativeTestJSON-355322717-project-admin] Request method failure captured: Oct 23 01:10:36.762970 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/os-hypervisors/d6857c1e-2105-4d7b-ae23-82e4dc11fae8 HTTP/1.1 Oct 23 01:10:36.762970 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:10:36.762970 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:10:36.762970 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:10:36.762970 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:10:36.762970 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:10:36.762970 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:10:36.762970 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:10:36.762970 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:10:36.762970 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJSJWlAgz5zodK-m7mK7ijM-xiIALXc-vNiho26iEyw12xkaBUA4780KmVygObSWFdo0UjzGC8RcXE-mLnCf8aUAhGLqPm_cQa_XnqPzD-AN8w2RkGh002IXGVer8Ul0lD0jugIYF5QPyZssPIG-M8tpeIV3T8o74yzmuiPOGo-rfdU Oct 23 01:10:36.762970 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:10:36.762970 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:10:36.762970 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:10:36.762970 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:10:36.762970 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:10:36.762970 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:10:36.762970 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 3895245eee0c4eeda3f70424e0ae710f Oct 23 01:10:36.762970 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-355322717 Oct 23 01:10:36.762970 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,admin,reader Oct 23 01:10:36.762970 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,admin,reader Oct 23 01:10:36.764212 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3895245eee0c4eeda3f70424e0ae710f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3895245eee0c4eeda3f70424e0ae710f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3895245eee0c4eeda3f70424e0ae710f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3895245eee0c4eeda3f70424e0ae710f"}]}] Oct 23 01:10:36.764212 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-355322717 Oct 23 01:10:36.764212 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 3895245eee0c4eeda3f70424e0ae710f Oct 23 01:10:36.764212 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-355322717 Oct 23 01:10:36.764212 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-HypervisorAdminNegativeTestJSON-355322717-project-admin Oct 23 01:10:36.764212 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:10:36.764212 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:10:36.764212 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 55621f878c964a21aedc9ed9a9cb2fe1 Oct 23 01:10:36.764212 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-355322717-project-admin Oct 23 01:10:36.764212 n-d-master-1 devstack@n-api.service[120945]: method: Oct 23 01:10:36.764212 n-d-master-1 devstack@n-api.service[120945]: exception: Hypervisor with ID 'd6857c1e-2105-4d7b-ae23-82e4dc11fae8' could not be found. Oct 23 01:10:36.764212 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'd6857c1e-2105-4d7b-ae23-82e4dc11fae8'} Oct 23 01:10:36.764890 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:10:36.764890 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:36.764890 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 23 01:10:36.764890 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 23 01:10:36.764890 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'd6857c1e-2105-4d7b-ae23-82e4dc11fae8' Oct 23 01:10:36.764890 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:36.764890 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:36.764890 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:36.764890 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:36.764890 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 23 01:10:36.764890 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 23 01:10:36.764890 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 23 01:10:36.764890 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 23 01:10:36.764890 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 23 01:10:36.764890 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:36.764890 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:36.764890 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:36.764890 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:36.764890 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 23 01:10:36.764890 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 23 01:10:36.764890 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 23 01:10:36.764890 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 23 01:10:36.765987 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 23 01:10:36.765987 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:36.765987 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:36.765987 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:36.765987 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:36.765987 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:36.765987 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:36.765987 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:10:36.765987 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:10:36.765987 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:10:36.765987 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:10:36.765987 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:10:36.765987 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:10:36.765987 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 23 01:10:36.765987 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 23 01:10:36.765987 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 23 01:10:36.765987 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 23 01:10:36.765987 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 23 01:10:36.765987 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 23 01:10:36.765987 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'd6857c1e-2105-4d7b-ae23-82e4dc11fae8' could not be found. Oct 23 01:10:36.767072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:36.767072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:10:36.767072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:36.767072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:10:36.767072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:10:36.767072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:10:36.767072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:10:36.767072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:10:36.767072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'd6857c1e-2105-4d7b-ae23-82e4dc11fae8' could not be found. Oct 23 01:10:36.767072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:10:36.767072 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-91b8fac7-7929-47b0-b715-58519f1a69b0 tempest-HypervisorAdminNegativeTestJSON-355322717 tempest-HypervisorAdminNegativeTestJSON-355322717-project-admin] Returning 404 to user: Hypervisor with ID 'd6857c1e-2105-4d7b-ae23-82e4dc11fae8' could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:10:36.768918 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-91b8fac7-7929-47b0-b715-58519f1a69b0 tempest-HypervisorAdminNegativeTestJSON-355322717 tempest-HypervisorAdminNegativeTestJSON-355322717-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/d6857c1e-2105-4d7b-ae23-82e4dc11fae8" status: 404 len: 123 microversion: 2.1 time: 0.010001 Oct 23 01:10:36.769718 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 76/124] 10.222.0.42 () {58 vars in 1257 bytes} [Sun Oct 23 01:10:36 2022] GET /compute/v2.1/os-hypervisors/d6857c1e-2105-4d7b-ae23-82e4dc11fae8 => generated 123 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 01:10:37.533988 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d147a79b-fb1e-4fa4-a55c-1bdb50787410 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:37.537616 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d147a79b-fb1e-4fa4-a55c-1bdb50787410 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:37.538370 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d147a79b-fb1e-4fa4-a55c-1bdb50787410 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:37.543750 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d147a79b-fb1e-4fa4-a55c-1bdb50787410 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:37.543750 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d147a79b-fb1e-4fa4-a55c-1bdb50787410 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:37.543750 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d147a79b-fb1e-4fa4-a55c-1bdb50787410 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:37.593346 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f781b5b5-addd-42f3-962f-b6a745fb8718 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:37.595770 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f781b5b5-addd-42f3-962f-b6a745fb8718 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] [instance: e41aeb69-eb54-4844-9b0a-2efa50a230c5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:10:37.607686 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f781b5b5-addd-42f3-962f-b6a745fb8718 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:37.609546 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f781b5b5-addd-42f3-962f-b6a745fb8718 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:37.611241 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f781b5b5-addd-42f3-962f-b6a745fb8718 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:37.612964 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f781b5b5-addd-42f3-962f-b6a745fb8718 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:37.614824 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f781b5b5-addd-42f3-962f-b6a745fb8718 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:37.616313 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f781b5b5-addd-42f3-962f-b6a745fb8718 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:37.624225 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d147a79b-fb1e-4fa4-a55c-1bdb50787410 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:37.625992 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d147a79b-fb1e-4fa4-a55c-1bdb50787410 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:37.626782 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d147a79b-fb1e-4fa4-a55c-1bdb50787410 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:37.628782 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d147a79b-fb1e-4fa4-a55c-1bdb50787410 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:37.631389 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d147a79b-fb1e-4fa4-a55c-1bdb50787410 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:37.632912 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d147a79b-fb1e-4fa4-a55c-1bdb50787410 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:37.907434 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d147a79b-fb1e-4fa4-a55c-1bdb50787410 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-sets/9e4c71074ecd4892a79a283ed8cd3a51?user_id=6a01f30a0402423194d515eecb1deddd" status: 200 len: 148 microversion: 2.57 time: 1.493242 Oct 23 01:10:37.919828 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 49/125] 10.222.0.42 () {62 vars in 1384 bytes} [Sun Oct 23 01:10:36 2022] PUT /compute/v2.1/os-quota-sets/9e4c71074ecd4892a79a283ed8cd3a51?user_id=6a01f30a0402423194d515eecb1deddd => generated 148 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:10:37.935645 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-262a59ae-ff0a-4f91-8545-fe6b84eec058 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Calling method '.version_select at 0x7f5cc29fe5e0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:37.973634 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f781b5b5-addd-42f3-962f-b6a745fb8718 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61093911783470a94d53354c15df815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a80a158b5c4e3baf87e83a284970c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:10:37.988894 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f781b5b5-addd-42f3-962f-b6a745fb8718 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] 10.222.0.42 "GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5" status: 200 len: 1339 microversion: 2.1 time: 0.397859 Oct 23 01:10:38.005925 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 77/126] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:10:37 2022] GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5 => generated 1339 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:10:38.584709 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-90a30325-6ae4-42ab-b662-bfb979eff170 req-8efb85c2-ea0d-471a-9ce1-f881374729f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e41aeb69-eb54-4844-9b0a-2efa50a230c5", "tag": "37548e89-8eec-43eb-875f-6848bc39d3bf"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:38.616037 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-90a30325-6ae4-42ab-b662-bfb979eff170 req-8efb85c2-ea0d-471a-9ce1-f881374729f2 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:38.617470 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-90a30325-6ae4-42ab-b662-bfb979eff170 req-8efb85c2-ea0d-471a-9ce1-f881374729f2 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:38.619268 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-90a30325-6ae4-42ab-b662-bfb979eff170 req-8efb85c2-ea0d-471a-9ce1-f881374729f2 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:38.687703 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-90a30325-6ae4-42ab-b662-bfb979eff170 req-8efb85c2-ea0d-471a-9ce1-f881374729f2 service nova] Creating event network-changed:37548e89-8eec-43eb-875f-6848bc39d3bf for instance e41aeb69-eb54-4844-9b0a-2efa50a230c5 on n-h1-master-1 Oct 23 01:10:38.693687 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-90a30325-6ae4-42ab-b662-bfb979eff170 req-8efb85c2-ea0d-471a-9ce1-f881374729f2 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120945) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 23 01:10:38.693687 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-90a30325-6ae4-42ab-b662-bfb979eff170 req-8efb85c2-ea0d-471a-9ce1-f881374729f2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120945) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 23 01:10:38.693687 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64ae83c6-d6bb-4188-9137-34d4150c4f43 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:38.694947 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64ae83c6-d6bb-4188-9137-34d4150c4f43 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:38.698445 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64ae83c6-d6bb-4188-9137-34d4150c4f43 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:38.701252 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64ae83c6-d6bb-4188-9137-34d4150c4f43 None None] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:38.703372 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64ae83c6-d6bb-4188-9137-34d4150c4f43 None None] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:38.705257 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64ae83c6-d6bb-4188-9137-34d4150c4f43 None None] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:38.724798 n-d-master-1 devstack@n-api.service[120945]: INFO nova.compute.rpcapi [None req-64ae83c6-d6bb-4188-9137-34d4150c4f43 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 23 01:10:38.729015 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64ae83c6-d6bb-4188-9137-34d4150c4f43 None None] Releasing lock "compute-rpcapi-router" {{(pid=120945) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 23 01:10:38.770282 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-64ae83c6-d6bb-4188-9137-34d4150c4f43 None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.748998 Oct 23 01:10:38.774069 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 78/127] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:10:39.014091 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bbf60296-f197-4f1b-8ae5-94acb8a0c8cf tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:39.014799 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-bbf60296-f197-4f1b-8ae5-94acb8a0c8cf tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] [instance: e41aeb69-eb54-4844-9b0a-2efa50a230c5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:10:39.027069 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bbf60296-f197-4f1b-8ae5-94acb8a0c8cf tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:39.027802 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bbf60296-f197-4f1b-8ae5-94acb8a0c8cf tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:39.030899 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bbf60296-f197-4f1b-8ae5-94acb8a0c8cf tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:39.031952 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bbf60296-f197-4f1b-8ae5-94acb8a0c8cf tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:39.033133 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bbf60296-f197-4f1b-8ae5-94acb8a0c8cf tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:39.036263 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bbf60296-f197-4f1b-8ae5-94acb8a0c8cf tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:39.225385 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-262a59ae-ff0a-4f91-8545-fe6b84eec058 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/9e4c71074ecd4892a79a283ed8cd3a51?user_id=6a01f30a0402423194d515eecb1deddd" status: 200 len: 190 microversion: 2.57 time: 1.303623 Oct 23 01:10:39.234746 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 50/128] 10.222.0.42 () {60 vars in 1364 bytes} [Sun Oct 23 01:10:37 2022] GET /compute/v2.1/os-quota-sets/9e4c71074ecd4892a79a283ed8cd3a51?user_id=6a01f30a0402423194d515eecb1deddd => generated 190 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:10:39.439037 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bbf60296-f197-4f1b-8ae5-94acb8a0c8cf tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61093911783470a94d53354c15df815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a80a158b5c4e3baf87e83a284970c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:10:39.450827 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bbf60296-f197-4f1b-8ae5-94acb8a0c8cf tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] 10.222.0.42 "GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5" status: 200 len: 1339 microversion: 2.1 time: 0.438897 Oct 23 01:10:39.451637 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 79/129] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:10:39 2022] GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5 => generated 1339 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:10:40.481036 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-44eb2276-7eb8-4c10-8054-72c0546ad52a tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:40.492204 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-44eb2276-7eb8-4c10-8054-72c0546ad52a tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] [instance: e41aeb69-eb54-4844-9b0a-2efa50a230c5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:10:40.512867 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-44eb2276-7eb8-4c10-8054-72c0546ad52a tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:40.516623 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-44eb2276-7eb8-4c10-8054-72c0546ad52a tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:40.518522 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-44eb2276-7eb8-4c10-8054-72c0546ad52a tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:40.520406 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-44eb2276-7eb8-4c10-8054-72c0546ad52a tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:40.523971 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-44eb2276-7eb8-4c10-8054-72c0546ad52a tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:40.525642 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-44eb2276-7eb8-4c10-8054-72c0546ad52a tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:40.953439 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-44eb2276-7eb8-4c10-8054-72c0546ad52a tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61093911783470a94d53354c15df815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a80a158b5c4e3baf87e83a284970c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:10:40.965936 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-44eb2276-7eb8-4c10-8054-72c0546ad52a tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] 10.222.0.42 "GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5" status: 200 len: 1339 microversion: 2.1 time: 0.487808 Oct 23 01:10:40.970309 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 51/130] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:10:40 2022] GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5 => generated 1339 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:10:41.999958 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-63ce33eb-8209-4755-9eee-9ce6e16a7ad2 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:41.999958 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-63ce33eb-8209-4755-9eee-9ce6e16a7ad2 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] [instance: e41aeb69-eb54-4844-9b0a-2efa50a230c5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:10:42.018923 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-63ce33eb-8209-4755-9eee-9ce6e16a7ad2 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:42.021725 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-63ce33eb-8209-4755-9eee-9ce6e16a7ad2 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:42.022997 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-63ce33eb-8209-4755-9eee-9ce6e16a7ad2 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:42.028334 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-63ce33eb-8209-4755-9eee-9ce6e16a7ad2 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:42.030975 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-63ce33eb-8209-4755-9eee-9ce6e16a7ad2 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:42.031856 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-63ce33eb-8209-4755-9eee-9ce6e16a7ad2 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:42.339457 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-63ce33eb-8209-4755-9eee-9ce6e16a7ad2 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61093911783470a94d53354c15df815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a80a158b5c4e3baf87e83a284970c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:10:42.354743 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-63ce33eb-8209-4755-9eee-9ce6e16a7ad2 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] 10.222.0.42 "GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5" status: 200 len: 1339 microversion: 2.1 time: 0.367149 Oct 23 01:10:42.355962 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 80/131] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:10:41 2022] GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5 => generated 1339 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:10:43.403018 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-05ba49e8-ce92-4f9b-95d9-ff7b656a9efd tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:43.403798 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-05ba49e8-ce92-4f9b-95d9-ff7b656a9efd tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] [instance: e41aeb69-eb54-4844-9b0a-2efa50a230c5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:10:43.417054 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-05ba49e8-ce92-4f9b-95d9-ff7b656a9efd tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:43.419352 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-05ba49e8-ce92-4f9b-95d9-ff7b656a9efd tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:43.420182 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-05ba49e8-ce92-4f9b-95d9-ff7b656a9efd tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:43.421266 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-05ba49e8-ce92-4f9b-95d9-ff7b656a9efd tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:43.424175 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-05ba49e8-ce92-4f9b-95d9-ff7b656a9efd tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:43.426131 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-05ba49e8-ce92-4f9b-95d9-ff7b656a9efd tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:43.692494 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-05ba49e8-ce92-4f9b-95d9-ff7b656a9efd tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61093911783470a94d53354c15df815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a80a158b5c4e3baf87e83a284970c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:10:43.700673 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-05ba49e8-ce92-4f9b-95d9-ff7b656a9efd tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] 10.222.0.42 "GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5" status: 200 len: 1339 microversion: 2.1 time: 0.319133 Oct 23 01:10:43.701247 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 52/132] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:10:43 2022] GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5 => generated 1339 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:10:44.158450 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=10 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:44.730498 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-21187b0c-6fdc-4f7c-bbf2-bd4875266693 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:44.732015 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-21187b0c-6fdc-4f7c-bbf2-bd4875266693 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] [instance: e41aeb69-eb54-4844-9b0a-2efa50a230c5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:10:44.750517 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-21187b0c-6fdc-4f7c-bbf2-bd4875266693 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:44.759190 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-21187b0c-6fdc-4f7c-bbf2-bd4875266693 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:44.759190 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-21187b0c-6fdc-4f7c-bbf2-bd4875266693 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:44.759190 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-21187b0c-6fdc-4f7c-bbf2-bd4875266693 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:44.759190 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-21187b0c-6fdc-4f7c-bbf2-bd4875266693 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:44.766062 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-21187b0c-6fdc-4f7c-bbf2-bd4875266693 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:44.876574 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-59a277c7-0427-4810-962b-d3144e796e1d tempest-HypervisorAdminUnderV252Test-1046060420 tempest-HypervisorAdminUnderV252Test-1046060420-project-admin] Calling method '.version_select at 0x7f5cc2a193a0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:44.877543 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-59a277c7-0427-4810-962b-d3144e796e1d tempest-HypervisorAdminUnderV252Test-1046060420 tempest-HypervisorAdminUnderV252Test-1046060420-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:44.878288 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-59a277c7-0427-4810-962b-d3144e796e1d tempest-HypervisorAdminUnderV252Test-1046060420 tempest-HypervisorAdminUnderV252Test-1046060420-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:44.878995 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-59a277c7-0427-4810-962b-d3144e796e1d tempest-HypervisorAdminUnderV252Test-1046060420 tempest-HypervisorAdminUnderV252Test-1046060420-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:44.905260 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-59a277c7-0427-4810-962b-d3144e796e1d tempest-HypervisorAdminUnderV252Test-1046060420 tempest-HypervisorAdminUnderV252Test-1046060420-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:44.906229 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-59a277c7-0427-4810-962b-d3144e796e1d tempest-HypervisorAdminUnderV252Test-1046060420 tempest-HypervisorAdminUnderV252Test-1046060420-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:44.907736 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-59a277c7-0427-4810-962b-d3144e796e1d tempest-HypervisorAdminUnderV252Test-1046060420 tempest-HypervisorAdminUnderV252Test-1046060420-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:44.922340 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-59a277c7-0427-4810-962b-d3144e796e1d tempest-HypervisorAdminUnderV252Test-1046060420 tempest-HypervisorAdminUnderV252Test-1046060420-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:44.924630 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-59a277c7-0427-4810-962b-d3144e796e1d tempest-HypervisorAdminUnderV252Test-1046060420 tempest-HypervisorAdminUnderV252Test-1046060420-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:44.925391 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-59a277c7-0427-4810-962b-d3144e796e1d tempest-HypervisorAdminUnderV252Test-1046060420 tempest-HypervisorAdminUnderV252Test-1046060420-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:44.934751 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-59a277c7-0427-4810-962b-d3144e796e1d tempest-HypervisorAdminUnderV252Test-1046060420 tempest-HypervisorAdminUnderV252Test-1046060420-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.793691 Oct 23 01:10:44.936157 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 81/133] 10.222.0.42 () {58 vars in 1146 bytes} [Sun Oct 23 01:10:44 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:10:44.960779 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-02e5e1e2-5e50-4e97-968e-316b49949040 tempest-HypervisorAdminUnderV252Test-1046060420 tempest-HypervisorAdminUnderV252Test-1046060420-project-admin] Calling method '.version_select at 0x7f5cc2a4c430>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:44.966686 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-02e5e1e2-5e50-4e97-968e-316b49949040 tempest-HypervisorAdminUnderV252Test-1046060420 tempest-HypervisorAdminUnderV252Test-1046060420-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:44.970299 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-02e5e1e2-5e50-4e97-968e-316b49949040 tempest-HypervisorAdminUnderV252Test-1046060420 tempest-HypervisorAdminUnderV252Test-1046060420-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:44.976286 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-02e5e1e2-5e50-4e97-968e-316b49949040 tempest-HypervisorAdminUnderV252Test-1046060420 tempest-HypervisorAdminUnderV252Test-1046060420-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:45.010559 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-02e5e1e2-5e50-4e97-968e-316b49949040 tempest-HypervisorAdminUnderV252Test-1046060420 tempest-HypervisorAdminUnderV252Test-1046060420-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:45.011372 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-02e5e1e2-5e50-4e97-968e-316b49949040 tempest-HypervisorAdminUnderV252Test-1046060420 tempest-HypervisorAdminUnderV252Test-1046060420-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:45.014116 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-02e5e1e2-5e50-4e97-968e-316b49949040 tempest-HypervisorAdminUnderV252Test-1046060420 tempest-HypervisorAdminUnderV252Test-1046060420-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:45.076447 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-02e5e1e2-5e50-4e97-968e-316b49949040 tempest-HypervisorAdminUnderV252Test-1046060420 tempest-HypervisorAdminUnderV252Test-1046060420-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:45.078179 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-02e5e1e2-5e50-4e97-968e-316b49949040 tempest-HypervisorAdminUnderV252Test-1046060420 tempest-HypervisorAdminUnderV252Test-1046060420-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:45.079597 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-02e5e1e2-5e50-4e97-968e-316b49949040 tempest-HypervisorAdminUnderV252Test-1046060420 tempest-HypervisorAdminUnderV252Test-1046060420-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:45.089107 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-02e5e1e2-5e50-4e97-968e-316b49949040 tempest-HypervisorAdminUnderV252Test-1046060420 tempest-HypervisorAdminUnderV252Test-1046060420-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/n-h1-master-1/servers" status: 200 len: 196 microversion: 2.1 time: 0.145567 Oct 23 01:10:45.099070 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 82/134] 10.222.0.42 () {58 vars in 1212 bytes} [Sun Oct 23 01:10:44 2022] GET /compute/v2.1/os-hypervisors/n-h1-master-1/servers => generated 196 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:10:45.104243 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f998398f-7846-43ed-80e5-4c6671d44867 tempest-HypervisorAdminUnderV252Test-1046060420 tempest-HypervisorAdminUnderV252Test-1046060420-project-admin] Calling method '.version_select at 0x7f5cc2a19700>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:45.106496 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f998398f-7846-43ed-80e5-4c6671d44867 tempest-HypervisorAdminUnderV252Test-1046060420 tempest-HypervisorAdminUnderV252Test-1046060420-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:45.107186 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f998398f-7846-43ed-80e5-4c6671d44867 tempest-HypervisorAdminUnderV252Test-1046060420 tempest-HypervisorAdminUnderV252Test-1046060420-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:45.107836 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f998398f-7846-43ed-80e5-4c6671d44867 tempest-HypervisorAdminUnderV252Test-1046060420 tempest-HypervisorAdminUnderV252Test-1046060420-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:45.126460 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f998398f-7846-43ed-80e5-4c6671d44867 tempest-HypervisorAdminUnderV252Test-1046060420 tempest-HypervisorAdminUnderV252Test-1046060420-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:45.127255 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f998398f-7846-43ed-80e5-4c6671d44867 tempest-HypervisorAdminUnderV252Test-1046060420 tempest-HypervisorAdminUnderV252Test-1046060420-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:45.127918 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f998398f-7846-43ed-80e5-4c6671d44867 tempest-HypervisorAdminUnderV252Test-1046060420 tempest-HypervisorAdminUnderV252Test-1046060420-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:45.140096 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f998398f-7846-43ed-80e5-4c6671d44867 tempest-HypervisorAdminUnderV252Test-1046060420 tempest-HypervisorAdminUnderV252Test-1046060420-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:45.140947 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f998398f-7846-43ed-80e5-4c6671d44867 tempest-HypervisorAdminUnderV252Test-1046060420 tempest-HypervisorAdminUnderV252Test-1046060420-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:45.141770 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f998398f-7846-43ed-80e5-4c6671d44867 tempest-HypervisorAdminUnderV252Test-1046060420 tempest-HypervisorAdminUnderV252Test-1046060420-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:45.149281 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f998398f-7846-43ed-80e5-4c6671d44867 tempest-HypervisorAdminUnderV252Test-1046060420 tempest-HypervisorAdminUnderV252Test-1046060420-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.048759 Oct 23 01:10:45.156175 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 83/135] 10.222.0.42 () {58 vars in 1146 bytes} [Sun Oct 23 01:10:45 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:10:45.162231 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e49dbc24-40b4-472b-a03e-0a356c542077 tempest-HypervisorAdminUnderV252Test-1046060420 tempest-HypervisorAdminUnderV252Test-1046060420-project-admin] Calling method '.version_select at 0x7f5cc29d88b0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:45.167206 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e49dbc24-40b4-472b-a03e-0a356c542077 tempest-HypervisorAdminUnderV252Test-1046060420 tempest-HypervisorAdminUnderV252Test-1046060420-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:45.167206 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e49dbc24-40b4-472b-a03e-0a356c542077 tempest-HypervisorAdminUnderV252Test-1046060420 tempest-HypervisorAdminUnderV252Test-1046060420-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:45.167206 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e49dbc24-40b4-472b-a03e-0a356c542077 tempest-HypervisorAdminUnderV252Test-1046060420 tempest-HypervisorAdminUnderV252Test-1046060420-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:45.170704 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-21187b0c-6fdc-4f7c-bbf2-bd4875266693 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61093911783470a94d53354c15df815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a80a158b5c4e3baf87e83a284970c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:10:45.183473 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-21187b0c-6fdc-4f7c-bbf2-bd4875266693 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] 10.222.0.42 "GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5" status: 200 len: 1339 microversion: 2.1 time: 0.457007 Oct 23 01:10:45.190650 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 53/136] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:10:44 2022] GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5 => generated 1339 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:10:45.195962 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e49dbc24-40b4-472b-a03e-0a356c542077 tempest-HypervisorAdminUnderV252Test-1046060420 tempest-HypervisorAdminUnderV252Test-1046060420-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:45.196740 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e49dbc24-40b4-472b-a03e-0a356c542077 tempest-HypervisorAdminUnderV252Test-1046060420 tempest-HypervisorAdminUnderV252Test-1046060420-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:45.197385 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e49dbc24-40b4-472b-a03e-0a356c542077 tempest-HypervisorAdminUnderV252Test-1046060420 tempest-HypervisorAdminUnderV252Test-1046060420-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:45.210478 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e49dbc24-40b4-472b-a03e-0a356c542077 tempest-HypervisorAdminUnderV252Test-1046060420 tempest-HypervisorAdminUnderV252Test-1046060420-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/n-h1-master-1/search" status: 200 len: 104 microversion: 2.1 time: 0.051205 Oct 23 01:10:45.221222 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 84/137] 10.222.0.42 () {58 vars in 1209 bytes} [Sun Oct 23 01:10:45 2022] GET /compute/v2.1/os-hypervisors/n-h1-master-1/search => generated 104 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:10:46.213049 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-344388f1-316a-4ddd-afb1-ce6ad4abd92d tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:46.215222 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-344388f1-316a-4ddd-afb1-ce6ad4abd92d tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] [instance: e41aeb69-eb54-4844-9b0a-2efa50a230c5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:10:46.223458 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-344388f1-316a-4ddd-afb1-ce6ad4abd92d tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:46.224194 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-344388f1-316a-4ddd-afb1-ce6ad4abd92d tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:46.224851 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-344388f1-316a-4ddd-afb1-ce6ad4abd92d tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:46.226447 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-344388f1-316a-4ddd-afb1-ce6ad4abd92d tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:46.227115 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-344388f1-316a-4ddd-afb1-ce6ad4abd92d tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:46.227764 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-344388f1-316a-4ddd-afb1-ce6ad4abd92d tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:46.387513 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-344388f1-316a-4ddd-afb1-ce6ad4abd92d tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61093911783470a94d53354c15df815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a80a158b5c4e3baf87e83a284970c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:10:46.399093 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-344388f1-316a-4ddd-afb1-ce6ad4abd92d tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] 10.222.0.42 "GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5" status: 200 len: 1339 microversion: 2.1 time: 0.188585 Oct 23 01:10:46.410822 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 54/138] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:10:46 2022] GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5 => generated 1339 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:10:47.426421 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-33fe3eb9-8790-4ab3-a4c6-3106a3ae3acf tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:47.428210 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-33fe3eb9-8790-4ab3-a4c6-3106a3ae3acf tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] [instance: e41aeb69-eb54-4844-9b0a-2efa50a230c5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:10:47.440738 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-33fe3eb9-8790-4ab3-a4c6-3106a3ae3acf tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:47.441236 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-33fe3eb9-8790-4ab3-a4c6-3106a3ae3acf tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:47.441669 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-33fe3eb9-8790-4ab3-a4c6-3106a3ae3acf tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:47.442399 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-33fe3eb9-8790-4ab3-a4c6-3106a3ae3acf tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:47.447940 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-33fe3eb9-8790-4ab3-a4c6-3106a3ae3acf tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:47.448394 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-33fe3eb9-8790-4ab3-a4c6-3106a3ae3acf tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:47.717668 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-33fe3eb9-8790-4ab3-a4c6-3106a3ae3acf tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61093911783470a94d53354c15df815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a80a158b5c4e3baf87e83a284970c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:10:47.727671 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-33fe3eb9-8790-4ab3-a4c6-3106a3ae3acf tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] 10.222.0.42 "GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5" status: 200 len: 1339 microversion: 2.1 time: 0.306963 Oct 23 01:10:47.739121 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 85/139] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:10:47 2022] GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5 => generated 1339 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:10:48.552741 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=17 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:48.763354 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a7bd3c3f-64ce-4e42-886f-0d9d5253ef7b tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:48.764782 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a7bd3c3f-64ce-4e42-886f-0d9d5253ef7b tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] [instance: e41aeb69-eb54-4844-9b0a-2efa50a230c5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:10:48.768425 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=4 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:48.772026 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a7bd3c3f-64ce-4e42-886f-0d9d5253ef7b tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:48.772703 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a7bd3c3f-64ce-4e42-886f-0d9d5253ef7b tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:48.773324 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a7bd3c3f-64ce-4e42-886f-0d9d5253ef7b tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:48.774217 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a7bd3c3f-64ce-4e42-886f-0d9d5253ef7b tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:48.774812 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a7bd3c3f-64ce-4e42-886f-0d9d5253ef7b tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:48.775304 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a7bd3c3f-64ce-4e42-886f-0d9d5253ef7b tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:48.779725 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=93 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:48.919241 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a7bd3c3f-64ce-4e42-886f-0d9d5253ef7b tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61093911783470a94d53354c15df815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a80a158b5c4e3baf87e83a284970c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:10:48.927883 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a7bd3c3f-64ce-4e42-886f-0d9d5253ef7b tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] 10.222.0.42 "GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5" status: 200 len: 1339 microversion: 2.1 time: 0.169065 Oct 23 01:10:48.928453 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 86/140] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:10:48 2022] GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5 => generated 1339 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:10:49.055033 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-976c540a-24da-4ac0-bb5e-f70d446f526d tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:49.069609 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-976c540a-24da-4ac0-bb5e-f70d446f526d tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.521452 Oct 23 01:10:49.080349 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 55/141] 10.222.0.42 () {58 vars in 1137 bytes} [Sun Oct 23 01:10:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:10:49.217615 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=26 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:49.318972 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cfab0832-cd10-415a-bf2b-04ed455c4afd tempest-KeyPairsV210TestJSON-635533276 tempest-KeyPairsV210TestJSON-635533276-project-admin] Action: 'create', calling method: .version_select at 0x7f5cc295ef70>, body: {"keypair": {"name": "tempest-keypair-1751512718", "type": "ssh", "user_id": "49c497e36a214f749f621c6e111a8a49", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBIH0ZX25/xnu4VpqpWQbysmUvabxZk5EMGZehT1piyb+KemyP5CBP39RLDM22dQZ8n7nDBXypAhnBozv8VcS0I0mY3dafe5/LwOz2LsEYxaTuSiNd0uMkKBOhhBD0s6Q=="}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:49.353502 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-cfab0832-cd10-415a-bf2b-04ed455c4afd tempest-KeyPairsV210TestJSON-635533276 tempest-KeyPairsV210TestJSON-635533276-project-admin] Getting quotas for project 5a9908580d244fbca799c549b2f3fabc. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:10:49.359499 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-cfab0832-cd10-415a-bf2b-04ed455c4afd tempest-KeyPairsV210TestJSON-635533276 tempest-KeyPairsV210TestJSON-635533276-project-admin] Getting quotas for user 7d0e89026b5c4cd39defdf99e54f2da1 and project 5a9908580d244fbca799c549b2f3fabc. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:10:49.478960 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cfab0832-cd10-415a-bf2b-04ed455c4afd tempest-KeyPairsV210TestJSON-635533276 tempest-KeyPairsV210TestJSON-635533276-project-admin] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.549288 Oct 23 01:10:49.479852 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 87/142] 10.222.0.42 () {62 vars in 1200 bytes} [Sun Oct 23 01:10:48 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 551 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 23 01:10:49.554980 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-30a3def4-56d9-499e-8375-c718888fcf85 tempest-ServersWithSpecificFlavorTestJSON-1629713408 tempest-ServersWithSpecificFlavorTestJSON-1629713408-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1418594117", "id": 988015540, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:49.644199 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-30a3def4-56d9-499e-8375-c718888fcf85 tempest-ServersWithSpecificFlavorTestJSON-1629713408 tempest-ServersWithSpecificFlavorTestJSON-1629713408-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.562265 Oct 23 01:10:49.645385 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 56/143] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:10:49 2022] POST /compute/v2.1/flavors => generated 422 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:10:49.651756 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2370112f-079a-448a-bca2-7abd3d2746aa tempest-KeyPairsV210TestJSON-635533276 tempest-KeyPairsV210TestJSON-635533276-project-admin] Action: 'create', calling method: .version_select at 0x7f5cc29dbd30>, body: {"keypair": {"name": "tempest-keypair-1781128053", "type": "ssh", "user_id": "49c497e36a214f749f621c6e111a8a49", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTDY6UBdJ4YuspAF9D11gYqswFaYQVoxLu5clKrOLRv2EDnz1F2gnXYxUNgsUn23XQGa/qzdnQ95JdsBRywDG46IZ9BByhX46b9pMcPgp0e165iEqSj49yzGDJQd3y82A=="}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:49.654433 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-32677336-a010-456b-995c-5a36648adc89 tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Calling method '.version_select at 0x7f5cc295ed30>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:49.657953 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-32677336-a010-456b-995c-5a36648adc89 tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:49.658466 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-32677336-a010-456b-995c-5a36648adc89 tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:49.658895 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-32677336-a010-456b-995c-5a36648adc89 tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:49.662018 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-32677336-a010-456b-995c-5a36648adc89 tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:49.664257 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-32677336-a010-456b-995c-5a36648adc89 tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:49.665024 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-32677336-a010-456b-995c-5a36648adc89 tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:49.682970 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-2370112f-079a-448a-bca2-7abd3d2746aa tempest-KeyPairsV210TestJSON-635533276 tempest-KeyPairsV210TestJSON-635533276-project-admin] Getting quotas for project 5a9908580d244fbca799c549b2f3fabc. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:10:49.685082 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-2370112f-079a-448a-bca2-7abd3d2746aa tempest-KeyPairsV210TestJSON-635533276 tempest-KeyPairsV210TestJSON-635533276-project-admin] Getting quotas for user 7d0e89026b5c4cd39defdf99e54f2da1 and project 5a9908580d244fbca799c549b2f3fabc. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:10:49.720756 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-32677336-a010-456b-995c-5a36648adc89 tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hosts" status: 200 len: 398 microversion: 2.1 time: 0.239566 Oct 23 01:10:49.721349 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 88/144] 10.222.0.42 () {58 vars in 1128 bytes} [Sun Oct 23 01:10:49 2022] GET /compute/v2.1/os-hosts => generated 398 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:10:49.732179 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-04f6991f-836f-49b6-a265-1ac220de6358 tempest-ServersWithSpecificFlavorTestJSON-1629713408 tempest-ServersWithSpecificFlavorTestJSON-1629713408-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:49.736272 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=4,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:49.740867 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-04f6991f-836f-49b6-a265-1ac220de6358 tempest-ServersWithSpecificFlavorTestJSON-1629713408 tempest-ServersWithSpecificFlavorTestJSON-1629713408-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.012226 Oct 23 01:10:49.741457 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 89/145] 10.222.0.42 () {58 vars in 1182 bytes} [Sun Oct 23 01:10:49 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:10:49.745406 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-50b6c5bb-4c2d-4170-8c3e-a472cb902e40 tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Calling method '.version_select at 0x7f5cc295eca0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:49.748826 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-50b6c5bb-4c2d-4170-8c3e-a472cb902e40 tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:49.749298 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-50b6c5bb-4c2d-4170-8c3e-a472cb902e40 tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:49.749726 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-50b6c5bb-4c2d-4170-8c3e-a472cb902e40 tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:49.751442 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-50b6c5bb-4c2d-4170-8c3e-a472cb902e40 tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:49.751895 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-50b6c5bb-4c2d-4170-8c3e-a472cb902e40 tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:49.752355 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-50b6c5bb-4c2d-4170-8c3e-a472cb902e40 tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:49.775067 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-50b6c5bb-4c2d-4170-8c3e-a472cb902e40 tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 398 microversion: 2.1 time: 0.032685 Oct 23 01:10:49.775668 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 90/146] 10.222.0.42 () {58 vars in 1139 bytes} [Sun Oct 23 01:10:49 2022] GET /compute/v2.1/os-hosts?zone= => generated 398 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:10:49.779812 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-95051e59-45a1-4ed0-8572-9183a994fdf7 tempest-ServersWithSpecificFlavorTestJSON-1629713408 tempest-ServersWithSpecificFlavorTestJSON-1629713408-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-2109753082", "id": 1893252275, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:49.813377 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2370112f-079a-448a-bca2-7abd3d2746aa tempest-KeyPairsV210TestJSON-635533276 tempest-KeyPairsV210TestJSON-635533276-project-admin] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.166704 Oct 23 01:10:49.814000 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 57/147] 10.222.0.42 () {62 vars in 1200 bytes} [Sun Oct 23 01:10:49 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 168 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 23 01:10:49.818471 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-13640fc7-8994-4737-bdd3-5223171719ee tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Calling method '.version_select at 0x7f5cc294bca0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:49.821873 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13640fc7-8994-4737-bdd3-5223171719ee tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:49.822452 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13640fc7-8994-4737-bdd3-5223171719ee tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:49.822892 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13640fc7-8994-4737-bdd3-5223171719ee tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:49.823614 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13640fc7-8994-4737-bdd3-5223171719ee tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:49.824106 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13640fc7-8994-4737-bdd3-5223171719ee tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:49.824554 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13640fc7-8994-4737-bdd3-5223171719ee tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:49.832738 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=84 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:49.851758 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-13640fc7-8994-4737-bdd3-5223171719ee tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.036730 Oct 23 01:10:49.852350 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 58/148] 10.222.0.42 () {58 vars in 1145 bytes} [Sun Oct 23 01:10:49 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:10:49.857177 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4028f751-c35d-4c96-a7ac-32cbfc680423 tempest-KeyPairsV210TestJSON-635533276 tempest-KeyPairsV210TestJSON-635533276-project-admin] Calling method '.version_select at 0x7f5cc2963820>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:49.869572 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4028f751-c35d-4c96-a7ac-32cbfc680423 tempest-KeyPairsV210TestJSON-635533276 tempest-KeyPairsV210TestJSON-635533276-project-admin] 10.222.0.42 "GET /compute/v2.1/os-keypairs/tempest-keypair-1751512718?user_id=49c497e36a214f749f621c6e111a8a49" status: 200 len: 512 microversion: 2.10 time: 0.016120 Oct 23 01:10:49.870455 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 59/149] 10.222.0.42 () {60 vars in 1340 bytes} [Sun Oct 23 01:10:49 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1751512718?user_id=49c497e36a214f749f621c6e111a8a49 => generated 512 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:10:49.889326 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d32831b5-239a-48f7-bc00-e393b25b986d tempest-KeyPairsV210TestJSON-635533276 tempest-KeyPairsV210TestJSON-635533276-project-admin] Action: 'create', calling method: .version_select at 0x7f5cc29631f0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1500708080", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7sq1VQMBNDvBG8+3q7Mab/w0XigBYvjO3GJi34d4kNzTMKI/Lmar+Dg+DLKl/Nij78uICqfXYCMOWn3qYteA55EiGaq40317KofBvdikqHSGzQDVhnQAfdkgNtROgoBg=="}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:49.907447 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-d32831b5-239a-48f7-bc00-e393b25b986d tempest-KeyPairsV210TestJSON-635533276 tempest-KeyPairsV210TestJSON-635533276-project-admin] Getting quotas for project 5a9908580d244fbca799c549b2f3fabc. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:10:49.911788 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-95051e59-45a1-4ed0-8572-9183a994fdf7 tempest-ServersWithSpecificFlavorTestJSON-1629713408 tempest-ServersWithSpecificFlavorTestJSON-1629713408-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.135069 Oct 23 01:10:49.912234 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-d32831b5-239a-48f7-bc00-e393b25b986d tempest-KeyPairsV210TestJSON-635533276 tempest-KeyPairsV210TestJSON-635533276-project-admin] Getting quotas for user 7d0e89026b5c4cd39defdf99e54f2da1 and project 5a9908580d244fbca799c549b2f3fabc. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:10:49.913925 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 91/150] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:10:49 2022] POST /compute/v2.1/flavors => generated 425 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:10:49.928766 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6297d51e-cc11-47bb-bb8b-8a9faf9ae9ef tempest-ServersWithSpecificFlavorTestJSON-1629713408 tempest-ServersWithSpecificFlavorTestJSON-1629713408-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:49.937001 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6297d51e-cc11-47bb-bb8b-8a9faf9ae9ef tempest-ServersWithSpecificFlavorTestJSON-1629713408 tempest-ServersWithSpecificFlavorTestJSON-1629713408-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.014376 Oct 23 01:10:49.937756 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 92/151] 10.222.0.42 () {58 vars in 1182 bytes} [Sun Oct 23 01:10:49 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 23 01:10:49.951881 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9cdb093c-fca2-4984-b205-e35f638464ba tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Action: 'create', calling method: .version_select at 0x7f5cc295edc0>, body: {"keypair": {"name": "tempest-keypair-229724827", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL63meVdi25zepz1twy5Z7IqddlGK2SdBhiKqevLPgHYrLUKBnzgsyiYheFRefRCUvGldTsNnR+NER6Fsny1N+VLei6KnzqK8HKJI+NBEzJ3Kr2Z67Vx20X/7kT4UYA0+A=="}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:49.970694 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-9cdb093c-fca2-4984-b205-e35f638464ba tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Getting quotas for project 08b8e89ba0a14188bac8e28b66b5a197. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:10:49.975739 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-9cdb093c-fca2-4984-b205-e35f638464ba tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Getting quotas for user 9e535f9274b24a9f800ea0c3d8faba5a and project 08b8e89ba0a14188bac8e28b66b5a197. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:10:50.018985 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d32831b5-239a-48f7-bc00-e393b25b986d tempest-KeyPairsV210TestJSON-635533276 tempest-KeyPairsV210TestJSON-635533276-project-admin] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.133421 Oct 23 01:10:50.021177 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 60/152] 10.222.0.42 () {62 vars in 1200 bytes} [Sun Oct 23 01:10:49 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 136 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 23 01:10:50.032420 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-68638731-a46b-4e08-8976-3fdb68a7c8e9 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:50.033533 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-68638731-a46b-4e08-8976-3fdb68a7c8e9 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] [instance: e41aeb69-eb54-4844-9b0a-2efa50a230c5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:10:50.040314 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68638731-a46b-4e08-8976-3fdb68a7c8e9 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:50.040813 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68638731-a46b-4e08-8976-3fdb68a7c8e9 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:50.041517 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68638731-a46b-4e08-8976-3fdb68a7c8e9 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:50.042267 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68638731-a46b-4e08-8976-3fdb68a7c8e9 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:50.042770 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68638731-a46b-4e08-8976-3fdb68a7c8e9 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:50.043767 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68638731-a46b-4e08-8976-3fdb68a7c8e9 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:50.074246 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9cdb093c-fca2-4984-b205-e35f638464ba tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.126373 Oct 23 01:10:50.074854 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 93/153] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 01:10:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:10:50.080156 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-29935e5f-e691-4cfe-9a86-4709b95cf8c8 tempest-KeyPairsV210TestJSON-635533276 tempest-KeyPairsV210TestJSON-635533276-project-admin] Calling method '.version_select at 0x7f5cc28f7d30>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:50.086879 n-d-master-1 devstack@n-api.service[120945]: WARNING oslo_db.sqlalchemy.utils [None req-29935e5f-e691-4cfe-9a86-4709b95cf8c8 tempest-KeyPairsV210TestJSON-635533276 tempest-KeyPairsV210TestJSON-635533276-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 23 01:10:50.105626 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-29935e5f-e691-4cfe-9a86-4709b95cf8c8 tempest-KeyPairsV210TestJSON-635533276 tempest-KeyPairsV210TestJSON-635533276-project-admin] 10.222.0.42 "GET /compute/v2.1/os-keypairs?user_id=49c497e36a214f749f621c6e111a8a49" status: 200 len: 726 microversion: 2.10 time: 0.029559 Oct 23 01:10:50.106239 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 94/154] 10.222.0.42 () {60 vars in 1259 bytes} [Sun Oct 23 01:10:50 2022] GET /compute/v2.1/os-keypairs?user_id=49c497e36a214f749f621c6e111a8a49 => generated 726 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:10:50.121070 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3f1d18be-ae8f-47d9-8828-8c6be23e5771 tempest-KeyPairsV210TestJSON-635533276 tempest-KeyPairsV210TestJSON-635533276-project-admin] Calling method '.version_select at 0x7f5cc29458b0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:50.245922 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-68638731-a46b-4e08-8976-3fdb68a7c8e9 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61093911783470a94d53354c15df815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a80a158b5c4e3baf87e83a284970c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:10:50.256608 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-68638731-a46b-4e08-8976-3fdb68a7c8e9 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] 10.222.0.42 "GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5" status: 200 len: 1339 microversion: 2.1 time: 0.234141 Oct 23 01:10:50.258823 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 61/155] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:10:50 2022] GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5 => generated 1339 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:10:50.259468 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3f1d18be-ae8f-47d9-8828-8c6be23e5771 tempest-KeyPairsV210TestJSON-635533276 tempest-KeyPairsV210TestJSON-635533276-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1500708080" status: 204 len: 0 microversion: 2.10 time: 0.145875 Oct 23 01:10:50.263322 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 95/156] 10.222.0.42 () {60 vars in 1325 bytes} [Sun Oct 23 01:10:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1500708080 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 23 01:10:50.275678 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-eff03181-6647-477d-a8b2-fdf04bd95215 tempest-KeyPairsV210TestJSON-635533276 tempest-KeyPairsV210TestJSON-635533276-project-admin] Calling method '.version_select at 0x7f5cc28f3820>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:50.290428 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=94,nova_api:DELETE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:50.381998 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-eff03181-6647-477d-a8b2-fdf04bd95215 tempest-KeyPairsV210TestJSON-635533276 tempest-KeyPairsV210TestJSON-635533276-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1781128053?user_id=49c497e36a214f749f621c6e111a8a49" status: 204 len: 0 microversion: 2.10 time: 0.116421 Oct 23 01:10:50.382604 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 62/157] 10.222.0.42 () {60 vars in 1343 bytes} [Sun Oct 23 01:10:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1781128053?user_id=49c497e36a214f749f621c6e111a8a49 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 23 01:10:50.404818 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bee902e6-c9e4-4f11-a168-6f5cfaa86aca tempest-KeyPairsV210TestJSON-635533276 tempest-KeyPairsV210TestJSON-635533276-project-admin] Calling method '.version_select at 0x7f5cc29a8670>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:50.522814 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bee902e6-c9e4-4f11-a168-6f5cfaa86aca tempest-KeyPairsV210TestJSON-635533276 tempest-KeyPairsV210TestJSON-635533276-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1751512718?user_id=49c497e36a214f749f621c6e111a8a49" status: 204 len: 0 microversion: 2.10 time: 0.130871 Oct 23 01:10:50.528633 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 63/158] 10.222.0.42 () {60 vars in 1343 bytes} [Sun Oct 23 01:10:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1751512718?user_id=49c497e36a214f749f621c6e111a8a49 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 23 01:10:50.639616 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5b636dfd-6f33-40db-8642-d6d68c045afa tempest-InstanceUsageAuditLogTestJSON-291647659 tempest-InstanceUsageAuditLogTestJSON-291647659-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:50.662437 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5b636dfd-6f33-40db-8642-d6d68c045afa tempest-InstanceUsageAuditLogTestJSON-291647659 tempest-InstanceUsageAuditLogTestJSON-291647659-project-admin] 10.222.0.42 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-23 01:10:50" status: 200 len: 318 microversion: 2.1 time: 0.356576 Oct 23 01:10:50.665739 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 96/159] 10.222.0.42 () {58 vars in 1251 bytes} [Sun Oct 23 01:10:50 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-23%2001%3A10%3A50 => generated 318 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:10:50.682650 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b9648457-5876-4299-8478-7a7f00d78797 tempest-InstanceUsageAuditLogTestJSON-291647659 tempest-InstanceUsageAuditLogTestJSON-291647659-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:50.702663 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b9648457-5876-4299-8478-7a7f00d78797 tempest-InstanceUsageAuditLogTestJSON-291647659 tempest-InstanceUsageAuditLogTestJSON-291647659-project-admin] 10.222.0.42 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.024192 Oct 23 01:10:50.703244 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 64/160] 10.222.0.42 () {58 vars in 1185 bytes} [Sun Oct 23 01:10:50 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:10:51.297216 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b693de4c-9d36-445e-8bfb-2f410c5d589e tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:51.297216 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b693de4c-9d36-445e-8bfb-2f410c5d589e tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] [instance: e41aeb69-eb54-4844-9b0a-2efa50a230c5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:10:51.297216 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b693de4c-9d36-445e-8bfb-2f410c5d589e tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:51.297216 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b693de4c-9d36-445e-8bfb-2f410c5d589e tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:51.298068 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b693de4c-9d36-445e-8bfb-2f410c5d589e tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:51.298068 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b693de4c-9d36-445e-8bfb-2f410c5d589e tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:51.307838 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b693de4c-9d36-445e-8bfb-2f410c5d589e tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:51.308890 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b693de4c-9d36-445e-8bfb-2f410c5d589e tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:51.460084 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b693de4c-9d36-445e-8bfb-2f410c5d589e tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61093911783470a94d53354c15df815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a80a158b5c4e3baf87e83a284970c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:10:51.468810 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b693de4c-9d36-445e-8bfb-2f410c5d589e tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] 10.222.0.42 "GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5" status: 200 len: 1339 microversion: 2.1 time: 0.190866 Oct 23 01:10:51.478167 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 97/161] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:10:51 2022] GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5 => generated 1339 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:10:52.493383 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-74047a5a-865e-4e67-a2b0-ab368ffb3038 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:52.494538 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-74047a5a-865e-4e67-a2b0-ab368ffb3038 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] [instance: e41aeb69-eb54-4844-9b0a-2efa50a230c5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:10:52.501539 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-74047a5a-865e-4e67-a2b0-ab368ffb3038 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:52.506602 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-74047a5a-865e-4e67-a2b0-ab368ffb3038 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:52.506602 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-74047a5a-865e-4e67-a2b0-ab368ffb3038 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:52.506602 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-74047a5a-865e-4e67-a2b0-ab368ffb3038 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:52.506602 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-74047a5a-865e-4e67-a2b0-ab368ffb3038 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:52.506963 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-74047a5a-865e-4e67-a2b0-ab368ffb3038 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:52.840315 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-74047a5a-865e-4e67-a2b0-ab368ffb3038 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61093911783470a94d53354c15df815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a80a158b5c4e3baf87e83a284970c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:10:52.861360 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-74047a5a-865e-4e67-a2b0-ab368ffb3038 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] 10.222.0.42 "GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5" status: 200 len: 1339 microversion: 2.1 time: 0.359759 Oct 23 01:10:52.861360 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 65/162] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:10:52 2022] GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5 => generated 1339 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:10:53.870987 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d95be73b-37c2-4e30-9150-a145cc828357 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:53.871618 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d95be73b-37c2-4e30-9150-a145cc828357 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] [instance: e41aeb69-eb54-4844-9b0a-2efa50a230c5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:10:53.886255 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d95be73b-37c2-4e30-9150-a145cc828357 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:53.887047 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d95be73b-37c2-4e30-9150-a145cc828357 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:53.888067 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d95be73b-37c2-4e30-9150-a145cc828357 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:53.889335 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d95be73b-37c2-4e30-9150-a145cc828357 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:53.889924 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d95be73b-37c2-4e30-9150-a145cc828357 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:53.891242 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d95be73b-37c2-4e30-9150-a145cc828357 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:54.132219 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d95be73b-37c2-4e30-9150-a145cc828357 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61093911783470a94d53354c15df815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a80a158b5c4e3baf87e83a284970c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:10:54.149186 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d95be73b-37c2-4e30-9150-a145cc828357 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] 10.222.0.42 "GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5" status: 200 len: 1339 microversion: 2.1 time: 0.281964 Oct 23 01:10:54.151984 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 98/163] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:10:53 2022] GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5 => generated 1339 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:10:54.177384 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f03877e9-db0a-48a2-9b55-b6925fc13ef0 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1897745025", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "1893252275", "adminPass": "***", "networks": [{"uuid": "f799b58c-da87-431a-a1dd-0fa03ade5202"}], "security_groups": [{"name": "tempest-securitygroup--1654787865"}], "key_name": "tempest-keypair-229724827", "user_data": "}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:54.307174 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-f03877e9-db0a-48a2-9b55-b6925fc13ef0 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] validate_networks() for [('f799b58c-da87-431a-a1dd-0fa03ade5202', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:10:54.511018 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-515985b8-5908-4535-9f02-21463247cd22 req-e70c4555-efd0-4d24-b665-d8a721e5bdab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e41aeb69-eb54-4844-9b0a-2efa50a230c5", "name": "network-vif-plugged", "status": "completed", "tag": "37548e89-8eec-43eb-875f-6848bc39d3bf"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:54.525629 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-515985b8-5908-4535-9f02-21463247cd22 req-e70c4555-efd0-4d24-b665-d8a721e5bdab service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:54.526412 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-515985b8-5908-4535-9f02-21463247cd22 req-e70c4555-efd0-4d24-b665-d8a721e5bdab service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:54.527031 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-515985b8-5908-4535-9f02-21463247cd22 req-e70c4555-efd0-4d24-b665-d8a721e5bdab service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:54.857941 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-515985b8-5908-4535-9f02-21463247cd22 req-e70c4555-efd0-4d24-b665-d8a721e5bdab service nova] Creating event network-vif-plugged:37548e89-8eec-43eb-875f-6848bc39d3bf for instance e41aeb69-eb54-4844-9b0a-2efa50a230c5 on n-h1-master-1 Oct 23 01:10:54.858930 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-515985b8-5908-4535-9f02-21463247cd22 req-e70c4555-efd0-4d24-b665-d8a721e5bdab service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120944) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 23 01:10:54.858930 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-515985b8-5908-4535-9f02-21463247cd22 req-e70c4555-efd0-4d24-b665-d8a721e5bdab service nova] Acquired lock "compute-rpcapi-router" {{(pid=120944) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 23 01:10:54.859964 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-807eef4f-56dd-429e-b577-48aafd30088c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:54.860427 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-807eef4f-56dd-429e-b577-48aafd30088c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:54.860859 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-807eef4f-56dd-429e-b577-48aafd30088c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:54.861581 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-807eef4f-56dd-429e-b577-48aafd30088c None None] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:54.862058 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-807eef4f-56dd-429e-b577-48aafd30088c None None] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:54.862476 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-807eef4f-56dd-429e-b577-48aafd30088c None None] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:54.871979 n-d-master-1 devstack@n-api.service[120944]: INFO nova.compute.rpcapi [None req-807eef4f-56dd-429e-b577-48aafd30088c None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 23 01:10:54.873700 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-807eef4f-56dd-429e-b577-48aafd30088c None None] Releasing lock "compute-rpcapi-router" {{(pid=120944) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 23 01:10:54.892476 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-807eef4f-56dd-429e-b577-48aafd30088c None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.838870 Oct 23 01:10:54.893175 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 66/164] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:10:55.174068 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3b29b008-0bee-4f2b-b551-9ac8a9a90c96 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:55.174771 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3b29b008-0bee-4f2b-b551-9ac8a9a90c96 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] [instance: e41aeb69-eb54-4844-9b0a-2efa50a230c5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:10:55.196495 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3b29b008-0bee-4f2b-b551-9ac8a9a90c96 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:55.197429 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3b29b008-0bee-4f2b-b551-9ac8a9a90c96 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:55.199470 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3b29b008-0bee-4f2b-b551-9ac8a9a90c96 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:55.202174 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3b29b008-0bee-4f2b-b551-9ac8a9a90c96 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:55.202912 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3b29b008-0bee-4f2b-b551-9ac8a9a90c96 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:55.206204 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3b29b008-0bee-4f2b-b551-9ac8a9a90c96 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:55.480589 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-f03877e9-db0a-48a2-9b55-b6925fc13ef0 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:10:55.492166 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-f03877e9-db0a-48a2-9b55-b6925fc13ef0 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:10:55.492921 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-f03877e9-db0a-48a2-9b55-b6925fc13ef0 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:10:55.493464 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-f03877e9-db0a-48a2-9b55-b6925fc13ef0 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:10:55.494056 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-f03877e9-db0a-48a2-9b55-b6925fc13ef0 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:10:55.510038 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f03877e9-db0a-48a2-9b55-b6925fc13ef0 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:55.511086 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f03877e9-db0a-48a2-9b55-b6925fc13ef0 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:55.512215 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f03877e9-db0a-48a2-9b55-b6925fc13ef0 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:55.513328 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f03877e9-db0a-48a2-9b55-b6925fc13ef0 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:55.513932 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f03877e9-db0a-48a2-9b55-b6925fc13ef0 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:55.514535 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f03877e9-db0a-48a2-9b55-b6925fc13ef0 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:55.516733 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3b29b008-0bee-4f2b-b551-9ac8a9a90c96 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61093911783470a94d53354c15df815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a80a158b5c4e3baf87e83a284970c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:10:55.541421 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-f03877e9-db0a-48a2-9b55-b6925fc13ef0 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Getting quotas for project 08b8e89ba0a14188bac8e28b66b5a197. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:10:55.547690 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-f03877e9-db0a-48a2-9b55-b6925fc13ef0 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Getting quotas for user 9e535f9274b24a9f800ea0c3d8faba5a and project 08b8e89ba0a14188bac8e28b66b5a197. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:10:55.552986 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3b29b008-0bee-4f2b-b551-9ac8a9a90c96 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] 10.222.0.42 "GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5" status: 200 len: 1339 microversion: 2.1 time: 0.380092 Oct 23 01:10:55.556489 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 67/165] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:10:55 2022] GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5 => generated 1339 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:10:55.577665 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f03877e9-db0a-48a2-9b55-b6925fc13ef0 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:10:55.582227 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f03877e9-db0a-48a2-9b55-b6925fc13ef0 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:10:55.734878 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f03877e9-db0a-48a2-9b55-b6925fc13ef0 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.567565 Oct 23 01:10:55.742675 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 99/166] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:10:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 1590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:10:55.747208 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-324273e8-cdcf-49e1-800d-337810026705 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:55.747835 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-324273e8-cdcf-49e1-800d-337810026705 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:10:55.868312 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-324273e8-cdcf-49e1-800d-337810026705 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e535f9274b24a9f800ea0c3d8faba5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b8e89ba0a14188bac8e28b66b5a197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:10:55.874624 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-324273e8-cdcf-49e1-800d-337810026705 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "GET /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb" status: 200 len: 1264 microversion: 2.1 time: 0.131235 Oct 23 01:10:55.876464 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 68/167] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:10:55 2022] GET /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb => generated 1264 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:10:56.582426 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9f37bef1-3caa-416c-8705-233aa33b8033 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:56.583041 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9f37bef1-3caa-416c-8705-233aa33b8033 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] [instance: e41aeb69-eb54-4844-9b0a-2efa50a230c5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:10:56.600008 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f37bef1-3caa-416c-8705-233aa33b8033 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:56.600620 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f37bef1-3caa-416c-8705-233aa33b8033 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:56.601173 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f37bef1-3caa-416c-8705-233aa33b8033 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:56.602127 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f37bef1-3caa-416c-8705-233aa33b8033 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:56.602694 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f37bef1-3caa-416c-8705-233aa33b8033 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:56.603431 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f37bef1-3caa-416c-8705-233aa33b8033 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:56.899347 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-672537a9-99b4-41d0-9889-135fcc214130 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:56.899971 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-672537a9-99b4-41d0-9889-135fcc214130 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:10:56.978551 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9f37bef1-3caa-416c-8705-233aa33b8033 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61093911783470a94d53354c15df815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a80a158b5c4e3baf87e83a284970c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:10:56.981096 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-672537a9-99b4-41d0-9889-135fcc214130 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e535f9274b24a9f800ea0c3d8faba5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b8e89ba0a14188bac8e28b66b5a197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:10:56.990613 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-672537a9-99b4-41d0-9889-135fcc214130 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "GET /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb" status: 200 len: 1264 microversion: 2.1 time: 0.095618 Oct 23 01:10:56.991895 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 69/168] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:10:56 2022] GET /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb => generated 1264 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:10:56.994630 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9f37bef1-3caa-416c-8705-233aa33b8033 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] 10.222.0.42 "GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5" status: 200 len: 1339 microversion: 2.1 time: 0.416736 Oct 23 01:10:56.998615 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 100/169] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:10:56 2022] GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5 => generated 1339 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:10:58.018387 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-84a60bb1-70ca-420e-be93-4c2ecdf19b0f tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:58.018994 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-84a60bb1-70ca-420e-be93-4c2ecdf19b0f tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:10:58.020414 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a3d1a0bd-15f8-4ae4-8896-d29e5f4b5ef6 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:58.021390 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a3d1a0bd-15f8-4ae4-8896-d29e5f4b5ef6 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] [instance: e41aeb69-eb54-4844-9b0a-2efa50a230c5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:10:58.029128 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a3d1a0bd-15f8-4ae4-8896-d29e5f4b5ef6 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:58.031917 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a3d1a0bd-15f8-4ae4-8896-d29e5f4b5ef6 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:58.033334 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a3d1a0bd-15f8-4ae4-8896-d29e5f4b5ef6 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:58.034165 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a3d1a0bd-15f8-4ae4-8896-d29e5f4b5ef6 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:58.038313 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-84a60bb1-70ca-420e-be93-4c2ecdf19b0f tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:58.039395 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a3d1a0bd-15f8-4ae4-8896-d29e5f4b5ef6 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:58.039524 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-84a60bb1-70ca-420e-be93-4c2ecdf19b0f tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:58.039938 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-84a60bb1-70ca-420e-be93-4c2ecdf19b0f tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:58.040338 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a3d1a0bd-15f8-4ae4-8896-d29e5f4b5ef6 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:58.040666 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-84a60bb1-70ca-420e-be93-4c2ecdf19b0f tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:58.041302 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-84a60bb1-70ca-420e-be93-4c2ecdf19b0f tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:58.041884 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-84a60bb1-70ca-420e-be93-4c2ecdf19b0f tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:58.148902 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-84a60bb1-70ca-420e-be93-4c2ecdf19b0f tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e535f9274b24a9f800ea0c3d8faba5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b8e89ba0a14188bac8e28b66b5a197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:10:58.162900 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-84a60bb1-70ca-420e-be93-4c2ecdf19b0f tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "GET /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb" status: 200 len: 1268 microversion: 2.1 time: 0.151634 Oct 23 01:10:58.163995 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 70/170] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:10:58 2022] GET /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb => generated 1268 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:10:58.260350 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a3d1a0bd-15f8-4ae4-8896-d29e5f4b5ef6 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61093911783470a94d53354c15df815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a80a158b5c4e3baf87e83a284970c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:10:58.277140 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a3d1a0bd-15f8-4ae4-8896-d29e5f4b5ef6 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] 10.222.0.42 "GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5" status: 200 len: 1339 microversion: 2.1 time: 0.255582 Oct 23 01:10:58.291085 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 101/171] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:10:58 2022] GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5 => generated 1339 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:10:59.190261 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-36567f84-2c71-4708-9828-e8179a1d2e76 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:59.190869 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-36567f84-2c71-4708-9828-e8179a1d2e76 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:10:59.219943 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36567f84-2c71-4708-9828-e8179a1d2e76 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:59.222095 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36567f84-2c71-4708-9828-e8179a1d2e76 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:59.237905 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36567f84-2c71-4708-9828-e8179a1d2e76 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:59.237905 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36567f84-2c71-4708-9828-e8179a1d2e76 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:59.237905 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36567f84-2c71-4708-9828-e8179a1d2e76 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:59.237905 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36567f84-2c71-4708-9828-e8179a1d2e76 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:59.302895 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3369e498-a813-4067-9c8c-fa95562eb984 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:59.303583 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3369e498-a813-4067-9c8c-fa95562eb984 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] [instance: e41aeb69-eb54-4844-9b0a-2efa50a230c5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:10:59.312765 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3369e498-a813-4067-9c8c-fa95562eb984 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:59.313554 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3369e498-a813-4067-9c8c-fa95562eb984 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:59.314078 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3369e498-a813-4067-9c8c-fa95562eb984 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:59.317944 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3369e498-a813-4067-9c8c-fa95562eb984 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:59.317944 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3369e498-a813-4067-9c8c-fa95562eb984 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:59.317944 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3369e498-a813-4067-9c8c-fa95562eb984 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:59.340409 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-36567f84-2c71-4708-9828-e8179a1d2e76 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e535f9274b24a9f800ea0c3d8faba5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b8e89ba0a14188bac8e28b66b5a197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:10:59.350345 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-36567f84-2c71-4708-9828-e8179a1d2e76 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "GET /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb" status: 200 len: 1316 microversion: 2.1 time: 0.164347 Oct 23 01:10:59.362664 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 71/172] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:10:59 2022] GET /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb => generated 1316 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:10:59.528873 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3369e498-a813-4067-9c8c-fa95562eb984 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61093911783470a94d53354c15df815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a80a158b5c4e3baf87e83a284970c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:10:59.540628 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3369e498-a813-4067-9c8c-fa95562eb984 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] 10.222.0.42 "GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5" status: 200 len: 1488 microversion: 2.1 time: 0.242327 Oct 23 01:10:59.543429 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 102/173] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:10:59 2022] GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5 => generated 1488 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:10:59.593612 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-da5d107e-5713-43a4-a5ef-cb2d3dd78e67 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1306074828", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:10:59.678049 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7f304113-9936-4e57-a561-9ad0d6a29024 tempest-NetworksTest-603794669 tempest-NetworksTest-603794669-project-admin] Calling method '.version_select at 0x7f5cc28f75e0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:59.685188 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-da5d107e-5713-43a4-a5ef-cb2d3dd78e67 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] validate_networks() for None {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:10:59.955492 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7f304113-9936-4e57-a561-9ad0d6a29024 tempest-NetworksTest-603794669 tempest-NetworksTest-603794669-project-admin] 10.222.0.42 "GET /compute/v2.1/os-networks" status: 200 len: 4007 microversion: 2.1 time: 0.410708 Oct 23 01:10:59.956743 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 103/174] 10.222.0.42 () {58 vars in 1137 bytes} [Sun Oct 23 01:10:59 2022] GET /compute/v2.1/os-networks => generated 4007 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:10:59.961339 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-83525be7-c6b3-499d-9a34-2a07c8fd580c tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:10:59.962213 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-83525be7-c6b3-499d-9a34-2a07c8fd580c tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] [instance: e41aeb69-eb54-4844-9b0a-2efa50a230c5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:10:59.973356 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83525be7-c6b3-499d-9a34-2a07c8fd580c tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:59.978596 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83525be7-c6b3-499d-9a34-2a07c8fd580c tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:59.979362 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83525be7-c6b3-499d-9a34-2a07c8fd580c tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:10:59.980295 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83525be7-c6b3-499d-9a34-2a07c8fd580c tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:10:59.980950 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83525be7-c6b3-499d-9a34-2a07c8fd580c tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:10:59.981574 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83525be7-c6b3-499d-9a34-2a07c8fd580c tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:00.658256 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-da5d107e-5713-43a4-a5ef-cb2d3dd78e67 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:11:00.659188 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-da5d107e-5713-43a4-a5ef-cb2d3dd78e67 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:11:00.659842 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-da5d107e-5713-43a4-a5ef-cb2d3dd78e67 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:11:00.660396 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-da5d107e-5713-43a4-a5ef-cb2d3dd78e67 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:11:00.660971 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-da5d107e-5713-43a4-a5ef-cb2d3dd78e67 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:11:00.682809 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-da5d107e-5713-43a4-a5ef-cb2d3dd78e67 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:00.683610 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-da5d107e-5713-43a4-a5ef-cb2d3dd78e67 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:00.684228 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-da5d107e-5713-43a4-a5ef-cb2d3dd78e67 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:00.685226 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-da5d107e-5713-43a4-a5ef-cb2d3dd78e67 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:00.689556 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-da5d107e-5713-43a4-a5ef-cb2d3dd78e67 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:00.690283 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-da5d107e-5713-43a4-a5ef-cb2d3dd78e67 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:00.765873 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-da5d107e-5713-43a4-a5ef-cb2d3dd78e67 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Getting quotas for project efa16b9c333c42ff8860639c213453c6. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:11:00.776947 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-da5d107e-5713-43a4-a5ef-cb2d3dd78e67 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Getting quotas for user ec43833fb4d646ab9f26d425cdb0b694 and project efa16b9c333c42ff8860639c213453c6. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:11:00.805257 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-da5d107e-5713-43a4-a5ef-cb2d3dd78e67 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:11:00.811064 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-da5d107e-5713-43a4-a5ef-cb2d3dd78e67 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] [instance: ce463295-4ce8-4df9-b8a2-f9388229a3c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:11:01.019325 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-da5d107e-5713-43a4-a5ef-cb2d3dd78e67 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.645715 Oct 23 01:11:01.030178 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 72/175] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:10:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 23 01:11:01.052574 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-944ab518-f459-4167-844d-7e3ffb9d5262 tempest-NetworksTest-603794669 tempest-NetworksTest-603794669-project-admin] Calling method '.version_select at 0x7f5cc3ee25e0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:01.258474 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-944ab518-f459-4167-844d-7e3ffb9d5262 tempest-NetworksTest-603794669 tempest-NetworksTest-603794669-project-admin] 10.222.0.42 "GET /compute/v2.1/os-networks/e33e8d81-9a30-4a90-a2ad-d9c074d3dc77" status: 200 len: 652 microversion: 2.1 time: 0.226189 Oct 23 01:11:01.263129 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 73/176] 10.222.0.42 () {58 vars in 1248 bytes} [Sun Oct 23 01:11:01 2022] GET /compute/v2.1/os-networks/e33e8d81-9a30-4a90-a2ad-d9c074d3dc77 => generated 652 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:01.268691 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-98060a75-62ef-4ba2-8965-3ea2ccba07b0 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:01.269317 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-98060a75-62ef-4ba2-8965-3ea2ccba07b0 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:01.286488 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-98060a75-62ef-4ba2-8965-3ea2ccba07b0 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:01.287576 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-98060a75-62ef-4ba2-8965-3ea2ccba07b0 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:01.288041 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-98060a75-62ef-4ba2-8965-3ea2ccba07b0 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:01.288959 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-98060a75-62ef-4ba2-8965-3ea2ccba07b0 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:01.297358 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-98060a75-62ef-4ba2-8965-3ea2ccba07b0 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:01.298508 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-98060a75-62ef-4ba2-8965-3ea2ccba07b0 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:01.315396 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-83525be7-c6b3-499d-9a34-2a07c8fd580c tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5" status: 200 len: 1639 microversion: 2.1 time: 1.357198 Oct 23 01:11:01.317905 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 104/177] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:10:59 2022] GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5 => generated 1639 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:01.463020 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-98060a75-62ef-4ba2-8965-3ea2ccba07b0 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e535f9274b24a9f800ea0c3d8faba5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b8e89ba0a14188bac8e28b66b5a197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:01.471622 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-98060a75-62ef-4ba2-8965-3ea2ccba07b0 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "GET /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb" status: 200 len: 1322 microversion: 2.1 time: 0.207365 Oct 23 01:11:01.472576 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 74/178] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:01 2022] GET /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:01.483082 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f1e11b79-c478-4567-8514-750c54517c88 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:01.485205 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f1e11b79-c478-4567-8514-750c54517c88 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] [instance: ce463295-4ce8-4df9-b8a2-f9388229a3c3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:01.543491 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c6aa20f5-12de-4921-a92b-ae5c43ac89bc tempest-ServicesAdminTestJSON-591164680 tempest-ServicesAdminTestJSON-591164680-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:01.548549 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6aa20f5-12de-4921-a92b-ae5c43ac89bc tempest-ServicesAdminTestJSON-591164680 tempest-ServicesAdminTestJSON-591164680-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:01.549195 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6aa20f5-12de-4921-a92b-ae5c43ac89bc tempest-ServicesAdminTestJSON-591164680 tempest-ServicesAdminTestJSON-591164680-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:01.549629 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6aa20f5-12de-4921-a92b-ae5c43ac89bc tempest-ServicesAdminTestJSON-591164680 tempest-ServicesAdminTestJSON-591164680-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:01.550399 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6aa20f5-12de-4921-a92b-ae5c43ac89bc tempest-ServicesAdminTestJSON-591164680 tempest-ServicesAdminTestJSON-591164680-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:01.550965 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6aa20f5-12de-4921-a92b-ae5c43ac89bc tempest-ServicesAdminTestJSON-591164680 tempest-ServicesAdminTestJSON-591164680-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:01.551547 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6aa20f5-12de-4921-a92b-ae5c43ac89bc tempest-ServicesAdminTestJSON-591164680 tempest-ServicesAdminTestJSON-591164680-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:01.579961 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c6aa20f5-12de-4921-a92b-ae5c43ac89bc tempest-ServicesAdminTestJSON-591164680 tempest-ServicesAdminTestJSON-591164680-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 966 microversion: 2.1 time: 0.254311 Oct 23 01:11:01.582222 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 105/179] 10.222.0.42 () {58 vars in 1137 bytes} [Sun Oct 23 01:11:01 2022] GET /compute/v2.1/os-services => generated 966 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:01.586759 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6ff88b39-c6f6-476e-9847-79536653d1e4 tempest-NetworksTest-603794669 tempest-NetworksTest-603794669-project-admin] Calling method '.version_select at 0x7f5cc2a19790>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:01.598944 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f1e11b79-c478-4567-8514-750c54517c88 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec43833fb4d646ab9f26d425cdb0b694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa16b9c333c42ff8860639c213453c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:01.613629 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f1e11b79-c478-4567-8514-750c54517c88 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] 10.222.0.42 "GET /compute/v2.1/servers/ce463295-4ce8-4df9-b8a2-f9388229a3c3" status: 200 len: 1223 microversion: 2.1 time: 0.140074 Oct 23 01:11:01.614489 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 75/180] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:01 2022] GET /compute/v2.1/servers/ce463295-4ce8-4df9-b8a2-f9388229a3c3 => generated 1223 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:01.627793 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3630add2-cf36-4011-a5d1-fa84cedf14bd tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:01.628526 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3630add2-cf36-4011-a5d1-fa84cedf14bd tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] [instance: e41aeb69-eb54-4844-9b0a-2efa50a230c5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:01.647623 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3630add2-cf36-4011-a5d1-fa84cedf14bd tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:01.648513 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3630add2-cf36-4011-a5d1-fa84cedf14bd tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:01.649229 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3630add2-cf36-4011-a5d1-fa84cedf14bd tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:01.650133 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3630add2-cf36-4011-a5d1-fa84cedf14bd tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:01.650762 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3630add2-cf36-4011-a5d1-fa84cedf14bd tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:01.651185 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3630add2-cf36-4011-a5d1-fa84cedf14bd tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:01.686242 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3630add2-cf36-4011-a5d1-fa84cedf14bd tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] [instance: e41aeb69-eb54-4844-9b0a-2efa50a230c5] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:11:01.814252 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6ff88b39-c6f6-476e-9847-79536653d1e4 tempest-NetworksTest-603794669 tempest-NetworksTest-603794669-project-admin] 10.222.0.42 "GET /compute/v2.1/os-networks" status: 200 len: 4007 microversion: 2.1 time: 0.230766 Oct 23 01:11:01.815093 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 106/181] 10.222.0.42 () {58 vars in 1137 bytes} [Sun Oct 23 01:11:01 2022] GET /compute/v2.1/os-networks => generated 4007 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:01.820459 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-890e7a85-5754-453d-b193-131460c99730 tempest-ServicesAdminTestJSON-591164680 tempest-ServicesAdminTestJSON-591164680-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:01.824431 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-890e7a85-5754-453d-b193-131460c99730 tempest-ServicesAdminTestJSON-591164680 tempest-ServicesAdminTestJSON-591164680-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:01.824911 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-890e7a85-5754-453d-b193-131460c99730 tempest-ServicesAdminTestJSON-591164680 tempest-ServicesAdminTestJSON-591164680-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:01.825263 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-890e7a85-5754-453d-b193-131460c99730 tempest-ServicesAdminTestJSON-591164680 tempest-ServicesAdminTestJSON-591164680-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:01.826378 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-890e7a85-5754-453d-b193-131460c99730 tempest-ServicesAdminTestJSON-591164680 tempest-ServicesAdminTestJSON-591164680-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:01.827048 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-890e7a85-5754-453d-b193-131460c99730 tempest-ServicesAdminTestJSON-591164680 tempest-ServicesAdminTestJSON-591164680-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:01.827664 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-890e7a85-5754-453d-b193-131460c99730 tempest-ServicesAdminTestJSON-591164680 tempest-ServicesAdminTestJSON-591164680-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:01.882210 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-890e7a85-5754-453d-b193-131460c99730 tempest-ServicesAdminTestJSON-591164680 tempest-ServicesAdminTestJSON-591164680-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services?host=n-d-master-1" status: 200 len: 578 microversion: 2.1 time: 0.066032 Oct 23 01:11:01.892860 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 107/182] 10.222.0.42 () {58 vars in 1172 bytes} [Sun Oct 23 01:11:01 2022] GET /compute/v2.1/os-services?host=n-d-master-1 => generated 578 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:01.897118 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c18209aa-9ab0-4d7d-9df0-90152cf082b6 tempest-ServicesAdminTestJSON-591164680 tempest-ServicesAdminTestJSON-591164680-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:01.919460 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c18209aa-9ab0-4d7d-9df0-90152cf082b6 tempest-ServicesAdminTestJSON-591164680 tempest-ServicesAdminTestJSON-591164680-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:01.919954 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c18209aa-9ab0-4d7d-9df0-90152cf082b6 tempest-ServicesAdminTestJSON-591164680 tempest-ServicesAdminTestJSON-591164680-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:01.920402 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c18209aa-9ab0-4d7d-9df0-90152cf082b6 tempest-ServicesAdminTestJSON-591164680 tempest-ServicesAdminTestJSON-591164680-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:01.921246 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c18209aa-9ab0-4d7d-9df0-90152cf082b6 tempest-ServicesAdminTestJSON-591164680 tempest-ServicesAdminTestJSON-591164680-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:01.922303 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c18209aa-9ab0-4d7d-9df0-90152cf082b6 tempest-ServicesAdminTestJSON-591164680 tempest-ServicesAdminTestJSON-591164680-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:01.922811 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c18209aa-9ab0-4d7d-9df0-90152cf082b6 tempest-ServicesAdminTestJSON-591164680 tempest-ServicesAdminTestJSON-591164680-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:01.965023 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c18209aa-9ab0-4d7d-9df0-90152cf082b6 tempest-ServicesAdminTestJSON-591164680 tempest-ServicesAdminTestJSON-591164680-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 402 microversion: 2.1 time: 0.072657 Oct 23 01:11:01.970580 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 108/183] 10.222.0.42 () {58 vars in 1176 bytes} [Sun Oct 23 01:11:01 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 402 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:01.983828 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-921285a1-577f-423b-ba00-48ed0749ac7f tempest-ServicesAdminTestJSON-591164680 tempest-ServicesAdminTestJSON-591164680-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:01.988629 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-921285a1-577f-423b-ba00-48ed0749ac7f tempest-ServicesAdminTestJSON-591164680 tempest-ServicesAdminTestJSON-591164680-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:01.989201 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-921285a1-577f-423b-ba00-48ed0749ac7f tempest-ServicesAdminTestJSON-591164680 tempest-ServicesAdminTestJSON-591164680-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:01.990842 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-921285a1-577f-423b-ba00-48ed0749ac7f tempest-ServicesAdminTestJSON-591164680 tempest-ServicesAdminTestJSON-591164680-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:01.994578 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-921285a1-577f-423b-ba00-48ed0749ac7f tempest-ServicesAdminTestJSON-591164680 tempest-ServicesAdminTestJSON-591164680-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:01.995251 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-921285a1-577f-423b-ba00-48ed0749ac7f tempest-ServicesAdminTestJSON-591164680 tempest-ServicesAdminTestJSON-591164680-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:01.998232 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-921285a1-577f-423b-ba00-48ed0749ac7f tempest-ServicesAdminTestJSON-591164680 tempest-ServicesAdminTestJSON-591164680-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:02.023438 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-921285a1-577f-423b-ba00-48ed0749ac7f tempest-ServicesAdminTestJSON-591164680 tempest-ServicesAdminTestJSON-591164680-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 966 microversion: 2.1 time: 0.045669 Oct 23 01:11:02.024075 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 109/184] 10.222.0.42 () {58 vars in 1137 bytes} [Sun Oct 23 01:11:01 2022] GET /compute/v2.1/os-services => generated 966 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:11:02.081394 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3630add2-cf36-4011-a5d1-fa84cedf14bd tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5" status: 204 len: 0 microversion: 2.1 time: 0.464976 Oct 23 01:11:02.082310 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 76/185] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:11:01 2022] DELETE /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:11:02.092180 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7286e559-ee24-40cc-8ff5-0edd09a8ca49 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:02.093201 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7286e559-ee24-40cc-8ff5-0edd09a8ca49 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] [instance: e41aeb69-eb54-4844-9b0a-2efa50a230c5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:02.103670 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7286e559-ee24-40cc-8ff5-0edd09a8ca49 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:02.104360 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7286e559-ee24-40cc-8ff5-0edd09a8ca49 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:02.104996 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7286e559-ee24-40cc-8ff5-0edd09a8ca49 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:02.106234 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7286e559-ee24-40cc-8ff5-0edd09a8ca49 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:02.106833 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7286e559-ee24-40cc-8ff5-0edd09a8ca49 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:02.107391 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7286e559-ee24-40cc-8ff5-0edd09a8ca49 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:02.324721 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7286e559-ee24-40cc-8ff5-0edd09a8ca49 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61093911783470a94d53354c15df815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a80a158b5c4e3baf87e83a284970c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:02.358658 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7286e559-ee24-40cc-8ff5-0edd09a8ca49 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] 10.222.0.42 "GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5" status: 200 len: 1494 microversion: 2.1 time: 0.265126 Oct 23 01:11:02.360619 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 110/186] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:02 2022] GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5 => generated 1494 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:02.498455 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a28799d8-bb5f-42cb-9621-1780bc38eec6 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:02.499273 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a28799d8-bb5f-42cb-9621-1780bc38eec6 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:02.517245 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a28799d8-bb5f-42cb-9621-1780bc38eec6 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:02.517741 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a28799d8-bb5f-42cb-9621-1780bc38eec6 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:02.518230 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a28799d8-bb5f-42cb-9621-1780bc38eec6 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:02.518967 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a28799d8-bb5f-42cb-9621-1780bc38eec6 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:02.519570 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a28799d8-bb5f-42cb-9621-1780bc38eec6 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:02.520010 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a28799d8-bb5f-42cb-9621-1780bc38eec6 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:02.642237 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-62203f77-2a29-4525-9b41-c1adae20faa0 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:02.644000 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-62203f77-2a29-4525-9b41-c1adae20faa0 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] [instance: ce463295-4ce8-4df9-b8a2-f9388229a3c3] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:02.651822 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-62203f77-2a29-4525-9b41-c1adae20faa0 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:02.652667 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-62203f77-2a29-4525-9b41-c1adae20faa0 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:02.653213 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-62203f77-2a29-4525-9b41-c1adae20faa0 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:02.654147 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-62203f77-2a29-4525-9b41-c1adae20faa0 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:02.655353 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-62203f77-2a29-4525-9b41-c1adae20faa0 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:02.656460 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-62203f77-2a29-4525-9b41-c1adae20faa0 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:02.768468 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-62203f77-2a29-4525-9b41-c1adae20faa0 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec43833fb4d646ab9f26d425cdb0b694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa16b9c333c42ff8860639c213453c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:02.782145 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-62203f77-2a29-4525-9b41-c1adae20faa0 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] 10.222.0.42 "GET /compute/v2.1/servers/ce463295-4ce8-4df9-b8a2-f9388229a3c3" status: 200 len: 1249 microversion: 2.1 time: 0.148497 Oct 23 01:11:02.783030 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 111/187] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:02 2022] GET /compute/v2.1/servers/ce463295-4ce8-4df9-b8a2-f9388229a3c3 => generated 1249 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:02.788276 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a28799d8-bb5f-42cb-9621-1780bc38eec6 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e535f9274b24a9f800ea0c3d8faba5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b8e89ba0a14188bac8e28b66b5a197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:02.799821 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a28799d8-bb5f-42cb-9621-1780bc38eec6 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "GET /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb" status: 200 len: 1390 microversion: 2.1 time: 0.307514 Oct 23 01:11:02.800744 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 77/188] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:02 2022] GET /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb => generated 1390 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:03.389935 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-737a1d03-09a9-434a-87b0-8d08efe2cea9 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:03.390772 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-737a1d03-09a9-434a-87b0-8d08efe2cea9 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] [instance: e41aeb69-eb54-4844-9b0a-2efa50a230c5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:03.405374 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-737a1d03-09a9-434a-87b0-8d08efe2cea9 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:03.406750 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-737a1d03-09a9-434a-87b0-8d08efe2cea9 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:03.407410 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-737a1d03-09a9-434a-87b0-8d08efe2cea9 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:03.408271 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-737a1d03-09a9-434a-87b0-8d08efe2cea9 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:03.409021 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-737a1d03-09a9-434a-87b0-8d08efe2cea9 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:03.410274 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-737a1d03-09a9-434a-87b0-8d08efe2cea9 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:03.667477 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-737a1d03-09a9-434a-87b0-8d08efe2cea9 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61093911783470a94d53354c15df815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a80a158b5c4e3baf87e83a284970c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:03.672296 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-737a1d03-09a9-434a-87b0-8d08efe2cea9 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] 10.222.0.42 "GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5" status: 200 len: 1494 microversion: 2.1 time: 0.286346 Oct 23 01:11:03.672871 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 112/189] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:03 2022] GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5 => generated 1494 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:03.806561 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-551f09cf-de64-4f1d-945d-e0b6b0ca2151 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:03.807287 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-551f09cf-de64-4f1d-945d-e0b6b0ca2151 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] [instance: ce463295-4ce8-4df9-b8a2-f9388229a3c3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:03.825101 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-551f09cf-de64-4f1d-945d-e0b6b0ca2151 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:03.825340 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-eb28228c-0757-488d-a5de-d2f37a00925e tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:03.827797 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-eb28228c-0757-488d-a5de-d2f37a00925e tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:03.827908 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-551f09cf-de64-4f1d-945d-e0b6b0ca2151 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:03.828312 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-551f09cf-de64-4f1d-945d-e0b6b0ca2151 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:03.830144 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-551f09cf-de64-4f1d-945d-e0b6b0ca2151 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:03.832592 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-551f09cf-de64-4f1d-945d-e0b6b0ca2151 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:03.833482 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-551f09cf-de64-4f1d-945d-e0b6b0ca2151 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:03.834629 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eb28228c-0757-488d-a5de-d2f37a00925e tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:03.836813 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eb28228c-0757-488d-a5de-d2f37a00925e tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:03.837848 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eb28228c-0757-488d-a5de-d2f37a00925e tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:03.839048 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eb28228c-0757-488d-a5de-d2f37a00925e tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:03.843687 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eb28228c-0757-488d-a5de-d2f37a00925e tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:03.844248 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eb28228c-0757-488d-a5de-d2f37a00925e tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:04.102305 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-551f09cf-de64-4f1d-945d-e0b6b0ca2151 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec43833fb4d646ab9f26d425cdb0b694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa16b9c333c42ff8860639c213453c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:04.111496 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-551f09cf-de64-4f1d-945d-e0b6b0ca2151 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] 10.222.0.42 "GET /compute/v2.1/servers/ce463295-4ce8-4df9-b8a2-f9388229a3c3" status: 200 len: 1241 microversion: 2.1 time: 0.309365 Oct 23 01:11:04.115032 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 78/190] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:03 2022] GET /compute/v2.1/servers/ce463295-4ce8-4df9-b8a2-f9388229a3c3 => generated 1241 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:11:04.144226 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-eb28228c-0757-488d-a5de-d2f37a00925e tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e535f9274b24a9f800ea0c3d8faba5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b8e89ba0a14188bac8e28b66b5a197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:04.157005 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-eb28228c-0757-488d-a5de-d2f37a00925e tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "GET /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb" status: 200 len: 1390 microversion: 2.1 time: 0.335924 Oct 23 01:11:04.158342 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 113/191] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:03 2022] GET /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb => generated 1390 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:04.701967 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c1d0d5f9-a8e9-40bd-b063-57cc5dfe58e7 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:04.704845 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c1d0d5f9-a8e9-40bd-b063-57cc5dfe58e7 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] [instance: e41aeb69-eb54-4844-9b0a-2efa50a230c5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:04.715674 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c1d0d5f9-a8e9-40bd-b063-57cc5dfe58e7 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:04.716383 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c1d0d5f9-a8e9-40bd-b063-57cc5dfe58e7 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:04.717115 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c1d0d5f9-a8e9-40bd-b063-57cc5dfe58e7 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:04.726655 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c1d0d5f9-a8e9-40bd-b063-57cc5dfe58e7 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:04.772894 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c1d0d5f9-a8e9-40bd-b063-57cc5dfe58e7 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:04.779847 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c1d0d5f9-a8e9-40bd-b063-57cc5dfe58e7 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.049s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:05.020304 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c1d0d5f9-a8e9-40bd-b063-57cc5dfe58e7 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61093911783470a94d53354c15df815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a80a158b5c4e3baf87e83a284970c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:05.034878 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c1d0d5f9-a8e9-40bd-b063-57cc5dfe58e7 tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] 10.222.0.42 "GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5" status: 200 len: 1452 microversion: 2.1 time: 0.337865 Oct 23 01:11:05.038486 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 79/192] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:04 2022] GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5 => generated 1452 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:05.130072 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-ae156b34-eda0-4a94-801f-daae6d6b65bc req-96c8fa82-c689-4eda-88d7-bef9b61c842c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e41aeb69-eb54-4844-9b0a-2efa50a230c5", "name": "network-vif-deleted", "tag": "37548e89-8eec-43eb-875f-6848bc39d3bf"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:05.138891 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2be2435b-38b8-4182-85cb-b2b82dfc6b01 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:05.139759 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2be2435b-38b8-4182-85cb-b2b82dfc6b01 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] [instance: ce463295-4ce8-4df9-b8a2-f9388229a3c3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:05.151565 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ae156b34-eda0-4a94-801f-daae6d6b65bc req-96c8fa82-c689-4eda-88d7-bef9b61c842c service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:05.152167 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ae156b34-eda0-4a94-801f-daae6d6b65bc req-96c8fa82-c689-4eda-88d7-bef9b61c842c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:05.156363 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ae156b34-eda0-4a94-801f-daae6d6b65bc req-96c8fa82-c689-4eda-88d7-bef9b61c842c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:05.157131 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2be2435b-38b8-4182-85cb-b2b82dfc6b01 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:05.157714 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2be2435b-38b8-4182-85cb-b2b82dfc6b01 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:05.158198 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2be2435b-38b8-4182-85cb-b2b82dfc6b01 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:05.172783 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-ae156b34-eda0-4a94-801f-daae6d6b65bc req-96c8fa82-c689-4eda-88d7-bef9b61c842c service nova] Creating event network-vif-deleted:37548e89-8eec-43eb-875f-6848bc39d3bf for instance e41aeb69-eb54-4844-9b0a-2efa50a230c5 on n-h1-master-1 Oct 23 01:11:05.180808 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-ae156b34-eda0-4a94-801f-daae6d6b65bc req-96c8fa82-c689-4eda-88d7-bef9b61c842c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060263 Oct 23 01:11:05.183204 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 114/193] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:05.190791 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2be2435b-38b8-4182-85cb-b2b82dfc6b01 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:05.192332 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2be2435b-38b8-4182-85cb-b2b82dfc6b01 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:05.193201 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2be2435b-38b8-4182-85cb-b2b82dfc6b01 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:05.199465 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ece1ae25-42f6-4797-9c9e-b7ccf936e39d tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:05.202228 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ece1ae25-42f6-4797-9c9e-b7ccf936e39d tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:05.233772 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ece1ae25-42f6-4797-9c9e-b7ccf936e39d tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:05.233772 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ece1ae25-42f6-4797-9c9e-b7ccf936e39d tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:05.233772 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ece1ae25-42f6-4797-9c9e-b7ccf936e39d tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:05.239892 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ece1ae25-42f6-4797-9c9e-b7ccf936e39d tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:05.240382 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ece1ae25-42f6-4797-9c9e-b7ccf936e39d tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:05.245102 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ece1ae25-42f6-4797-9c9e-b7ccf936e39d tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:05.832205 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=18 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:05.833370 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2be2435b-38b8-4182-85cb-b2b82dfc6b01 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec43833fb4d646ab9f26d425cdb0b694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa16b9c333c42ff8860639c213453c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:05.833370 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2be2435b-38b8-4182-85cb-b2b82dfc6b01 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] 10.222.0.42 "GET /compute/v2.1/servers/ce463295-4ce8-4df9-b8a2-f9388229a3c3" status: 200 len: 1305 microversion: 2.1 time: 0.563747 Oct 23 01:11:05.833370 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 80/194] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:05 2022] GET /compute/v2.1/servers/ce463295-4ce8-4df9-b8a2-f9388229a3c3 => generated 1305 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:11:06.068013 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-727e03d1-4f81-464f-a3b6-104cb419412d tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:06.068694 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-727e03d1-4f81-464f-a3b6-104cb419412d tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] [instance: e41aeb69-eb54-4844-9b0a-2efa50a230c5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:06.078645 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-727e03d1-4f81-464f-a3b6-104cb419412d tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:06.079174 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-727e03d1-4f81-464f-a3b6-104cb419412d tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:06.079611 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-727e03d1-4f81-464f-a3b6-104cb419412d tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:06.080314 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-727e03d1-4f81-464f-a3b6-104cb419412d tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:06.081489 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-727e03d1-4f81-464f-a3b6-104cb419412d tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:06.081868 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-727e03d1-4f81-464f-a3b6-104cb419412d tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:06.093033 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ece1ae25-42f6-4797-9c9e-b7ccf936e39d tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e535f9274b24a9f800ea0c3d8faba5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b8e89ba0a14188bac8e28b66b5a197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:06.111072 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ece1ae25-42f6-4797-9c9e-b7ccf936e39d tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "GET /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb" status: 200 len: 1390 microversion: 2.1 time: 0.925263 Oct 23 01:11:06.111679 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 115/195] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:05 2022] GET /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb => generated 1390 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:06.190385 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-727e03d1-4f81-464f-a3b6-104cb419412d tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:06.191026 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-727e03d1-4f81-464f-a3b6-104cb419412d tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:06.191565 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-727e03d1-4f81-464f-a3b6-104cb419412d tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:06.192487 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-727e03d1-4f81-464f-a3b6-104cb419412d tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lazy-loading 'fault' on Instance uuid e41aeb69-eb54-4844-9b0a-2efa50a230c5 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:11:06.306268 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-727e03d1-4f81-464f-a3b6-104cb419412d tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61093911783470a94d53354c15df815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a80a158b5c4e3baf87e83a284970c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:06.322336 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-727e03d1-4f81-464f-a3b6-104cb419412d tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] 10.222.0.42 "GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5" status: 200 len: 1329 microversion: 2.1 time: 0.258017 Oct 23 01:11:06.325321 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 81/196] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:06 2022] GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5 => generated 1329 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:11:06.721819 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9ba2825a-60c2-4cf0-9621-15549799be99 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:06.723099 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9ba2825a-60c2-4cf0-9621-15549799be99 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] [instance: ce463295-4ce8-4df9-b8a2-f9388229a3c3] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:06.735126 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9ba2825a-60c2-4cf0-9621-15549799be99 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:06.738035 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9ba2825a-60c2-4cf0-9621-15549799be99 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:06.738612 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9ba2825a-60c2-4cf0-9621-15549799be99 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:06.740835 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9ba2825a-60c2-4cf0-9621-15549799be99 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:06.752364 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9ba2825a-60c2-4cf0-9621-15549799be99 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:06.752364 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9ba2825a-60c2-4cf0-9621-15549799be99 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:06.868431 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9ba2825a-60c2-4cf0-9621-15549799be99 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec43833fb4d646ab9f26d425cdb0b694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa16b9c333c42ff8860639c213453c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:06.887202 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9ba2825a-60c2-4cf0-9621-15549799be99 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] 10.222.0.42 "GET /compute/v2.1/servers/ce463295-4ce8-4df9-b8a2-f9388229a3c3" status: 200 len: 1303 microversion: 2.1 time: 0.170272 Oct 23 01:11:06.892223 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 116/197] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:06 2022] GET /compute/v2.1/servers/ce463295-4ce8-4df9-b8a2-f9388229a3c3 => generated 1303 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:07.143777 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7ca422c5-0721-402c-a918-56b4c7829818 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:07.150149 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7ca422c5-0721-402c-a918-56b4c7829818 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:07.163097 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ca422c5-0721-402c-a918-56b4c7829818 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:07.165526 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ca422c5-0721-402c-a918-56b4c7829818 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:07.166672 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ca422c5-0721-402c-a918-56b4c7829818 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:07.168715 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ca422c5-0721-402c-a918-56b4c7829818 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:07.169408 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ca422c5-0721-402c-a918-56b4c7829818 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:07.172160 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ca422c5-0721-402c-a918-56b4c7829818 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:07.361966 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-09a82890-aeca-495c-99b2-2b7562fece4b tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:07.361966 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-09a82890-aeca-495c-99b2-2b7562fece4b tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] [instance: e41aeb69-eb54-4844-9b0a-2efa50a230c5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:07.366795 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09a82890-aeca-495c-99b2-2b7562fece4b tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:07.367563 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09a82890-aeca-495c-99b2-2b7562fece4b tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:07.368147 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09a82890-aeca-495c-99b2-2b7562fece4b tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:07.369081 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09a82890-aeca-495c-99b2-2b7562fece4b tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:07.369904 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09a82890-aeca-495c-99b2-2b7562fece4b tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:07.370499 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09a82890-aeca-495c-99b2-2b7562fece4b tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:07.385921 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-09a82890-aeca-495c-99b2-2b7562fece4b tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] HTTP exception thrown: Instance e41aeb69-eb54-4844-9b0a-2efa50a230c5 could not be found. Oct 23 01:11:07.390441 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-09a82890-aeca-495c-99b2-2b7562fece4b tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Request method failure captured: Oct 23 01:11:07.390441 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5 HTTP/1.1 Oct 23 01:11:07.390441 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:11:07.390441 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:11:07.390441 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:11:07.390441 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:11:07.390441 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:11:07.390441 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:11:07.390441 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:11:07.390441 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:11:07.390441 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJR28W1AyuqQJ-30fgS3HuH8-9wNc8TNH4r1av1j4VMJKYW1dsNdey5FU63qAG5cWM1B4HVoGXayzMN0bYK07ItwJPR8qAUPEv1q5CwhzS8q9vuOsD28602JElKhJ0d9idMfyBOSAwbgUTRQNPgL5PiZXTN9lFH0iTZ_bQ5ELu62UcM Oct 23 01:11:07.390441 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:11:07.390441 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:11:07.390441 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:11:07.390441 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:11:07.390441 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:11:07.390441 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:11:07.390441 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: f3a80a158b5c4e3baf87e83a284970c3 Oct 23 01:11:07.390441 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-AggregatesAdminTestJSON-1732355780 Oct 23 01:11:07.390441 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:11:07.390441 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:11:07.392285 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f3a80a158b5c4e3baf87e83a284970c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f3a80a158b5c4e3baf87e83a284970c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f3a80a158b5c4e3baf87e83a284970c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f3a80a158b5c4e3baf87e83a284970c3"}]}] Oct 23 01:11:07.392285 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-AggregatesAdminTestJSON-1732355780 Oct 23 01:11:07.392285 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: f3a80a158b5c4e3baf87e83a284970c3 Oct 23 01:11:07.392285 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1732355780 Oct 23 01:11:07.392285 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-AggregatesAdminTestJSON-1732355780-project Oct 23 01:11:07.392285 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:11:07.392285 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:11:07.392285 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: d61093911783470a94d53354c15df815 Oct 23 01:11:07.392285 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-AggregatesAdminTestJSON-1732355780-project Oct 23 01:11:07.392285 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:11:07.392285 n-d-master-1 devstack@n-api.service[120945]: exception: Instance e41aeb69-eb54-4844-9b0a-2efa50a230c5 could not be found. Oct 23 01:11:07.392285 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'e41aeb69-eb54-4844-9b0a-2efa50a230c5'} Oct 23 01:11:07.393141 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:11:07.393141 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:07.393141 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:11:07.393141 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:11:07.393141 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:11:07.393141 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:11:07.393141 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:11:07.393141 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:11:07.393141 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:11:07.393141 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:11:07.393141 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e41aeb69-eb54-4844-9b0a-2efa50a230c5 could not be found. Oct 23 01:11:07.393141 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:07.393141 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:11:07.393141 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:07.393141 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:07.393141 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:07.393141 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:07.393141 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:11:07.393141 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:11:07.393141 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:11:07.394574 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:11:07.394574 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:11:07.394574 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:11:07.394574 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:11:07.394574 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:11:07.394574 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:11:07.394574 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:11:07.394574 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e41aeb69-eb54-4844-9b0a-2efa50a230c5 could not be found. Oct 23 01:11:07.394574 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:07.394574 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:11:07.394574 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:07.394574 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:07.394574 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:07.394574 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:07.394574 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:11:07.394574 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:11:07.394574 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e41aeb69-eb54-4844-9b0a-2efa50a230c5 could not be found. Oct 23 01:11:07.394574 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:07.395807 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-09a82890-aeca-495c-99b2-2b7562fece4b tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Returning 404 to user: Instance e41aeb69-eb54-4844-9b0a-2efa50a230c5 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:11:07.396581 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-09a82890-aeca-495c-99b2-2b7562fece4b tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] 10.222.0.42 "GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5" status: 404 len: 111 microversion: 2.1 time: 0.043972 Oct 23 01:11:07.400989 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 117/198] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:07 2022] GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:11:07.408707 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-63948b57-9b2e-4437-9e1d-a81f11bf1b54 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:07.426195 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-63948b57-9b2e-4437-9e1d-a81f11bf1b54 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:07.426976 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-63948b57-9b2e-4437-9e1d-a81f11bf1b54 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:07.427570 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-63948b57-9b2e-4437-9e1d-a81f11bf1b54 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:07.495513 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7ca422c5-0721-402c-a918-56b4c7829818 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e535f9274b24a9f800ea0c3d8faba5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b8e89ba0a14188bac8e28b66b5a197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:07.521436 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7ca422c5-0721-402c-a918-56b4c7829818 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "GET /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb" status: 200 len: 1390 microversion: 2.1 time: 0.383420 Oct 23 01:11:07.524793 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 82/199] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:07 2022] GET /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb => generated 1390 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:07.789126 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:07.796797 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-63948b57-9b2e-4437-9e1d-a81f11bf1b54 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 300 microversion: 2.1 time: 0.393747 Oct 23 01:11:07.804719 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 118/200] 10.222.0.42 () {60 vars in 1191 bytes} [Sun Oct 23 01:11:07 2022] POST /compute/v2.1/os-aggregates/6/action => generated 300 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:07.812767 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e7523ab2-c70a-498b-89e4-3aeb90dbd2a3 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:07.921064 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4fa4fb75-0247-4d5c-8343-355a374bdfab tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:07.921692 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4fa4fb75-0247-4d5c-8343-355a374bdfab tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] [instance: ce463295-4ce8-4df9-b8a2-f9388229a3c3] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:07.931413 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4fa4fb75-0247-4d5c-8343-355a374bdfab tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:07.931915 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4fa4fb75-0247-4d5c-8343-355a374bdfab tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:07.932347 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4fa4fb75-0247-4d5c-8343-355a374bdfab tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:07.933051 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4fa4fb75-0247-4d5c-8343-355a374bdfab tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:07.933501 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4fa4fb75-0247-4d5c-8343-355a374bdfab tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:07.939173 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4fa4fb75-0247-4d5c-8343-355a374bdfab tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:07.984980 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e7523ab2-c70a-498b-89e4-3aeb90dbd2a3 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.177930 Oct 23 01:11:07.986213 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 83/201] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Oct 23 01:11:07 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 23 01:11:08.004261 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f9cb8add-d26f-4691-bad0-e10cfcd7e17f tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-64709372"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:08.010949 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.aggregate [None req-f9cb8add-d26f-4691-bad0-e10cfcd7e17f tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Generated uuid 64ba2605-b73f-4bf1-94fa-53f3e5b24849 for aggregate {{(pid=120944) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 23 01:11:08.013026 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=100 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:08.150246 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f9cb8add-d26f-4691-bad0-e10cfcd7e17f tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.151107 Oct 23 01:11:08.154885 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 84/202] 10.222.0.42 () {60 vars in 1164 bytes} [Sun Oct 23 01:11:07 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:11:08.172183 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f89398ee-1372-456d-ae5c-b0a3b4de64cd tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:08.204985 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f89398ee-1372-456d-ae5c-b0a3b4de64cd tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:08.205490 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f89398ee-1372-456d-ae5c-b0a3b4de64cd tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:08.205925 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f89398ee-1372-456d-ae5c-b0a3b4de64cd tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:08.396203 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:08.674918 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4fa4fb75-0247-4d5c-8343-355a374bdfab tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec43833fb4d646ab9f26d425cdb0b694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa16b9c333c42ff8860639c213453c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:08.682677 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4fa4fb75-0247-4d5c-8343-355a374bdfab tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] 10.222.0.42 "GET /compute/v2.1/servers/ce463295-4ce8-4df9-b8a2-f9388229a3c3" status: 200 len: 1323 microversion: 2.1 time: 0.767389 Oct 23 01:11:08.701337 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 119/203] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:07 2022] GET /compute/v2.1/servers/ce463295-4ce8-4df9-b8a2-f9388229a3c3 => generated 1323 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:11:08.707570 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-118979e2-2a34-42d2-9c44-78ac82d740d2 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:08.714861 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-118979e2-2a34-42d2-9c44-78ac82d740d2 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:08.724763 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f89398ee-1372-456d-ae5c-b0a3b4de64cd tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 240 microversion: 2.1 time: 0.564892 Oct 23 01:11:08.725670 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 85/204] 10.222.0.42 () {60 vars in 1191 bytes} [Sun Oct 23 01:11:08 2022] POST /compute/v2.1/os-aggregates/9/action => generated 240 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:08.734362 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-118979e2-2a34-42d2-9c44-78ac82d740d2 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:08.735074 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-118979e2-2a34-42d2-9c44-78ac82d740d2 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:08.735660 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-118979e2-2a34-42d2-9c44-78ac82d740d2 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:08.736546 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-118979e2-2a34-42d2-9c44-78ac82d740d2 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:08.737143 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-118979e2-2a34-42d2-9c44-78ac82d740d2 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:08.737732 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-118979e2-2a34-42d2-9c44-78ac82d740d2 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:08.738622 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-16874817-adbf-436c-b18e-197d70bdbf9e tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:08.754417 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-16874817-adbf-436c-b18e-197d70bdbf9e tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] 10.222.0.42 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 240 microversion: 2.1 time: 0.018858 Oct 23 01:11:08.755408 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 86/205] 10.222.0.42 () {58 vars in 1149 bytes} [Sun Oct 23 01:11:08 2022] GET /compute/v2.1/os-aggregates/9 => generated 240 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:11:08.767772 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9f0bd875-eb67-4ca9-b036-c1564c7bc013 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:08.789571 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f0bd875-eb67-4ca9-b036-c1564c7bc013 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:08.795051 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f0bd875-eb67-4ca9-b036-c1564c7bc013 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:08.795589 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f0bd875-eb67-4ca9-b036-c1564c7bc013 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:09.200742 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9f0bd875-eb67-4ca9-b036-c1564c7bc013 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 225 microversion: 2.1 time: 0.437311 Oct 23 01:11:09.216560 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 87/206] 10.222.0.42 () {60 vars in 1191 bytes} [Sun Oct 23 01:11:08 2022] POST /compute/v2.1/os-aggregates/9/action => generated 225 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:11:09.228212 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-233d2a42-297d-4e2a-8d90-8cf88fc972af tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:09.286568 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-118979e2-2a34-42d2-9c44-78ac82d740d2 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e535f9274b24a9f800ea0c3d8faba5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b8e89ba0a14188bac8e28b66b5a197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:09.298268 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-118979e2-2a34-42d2-9c44-78ac82d740d2 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "GET /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb" status: 200 len: 1390 microversion: 2.1 time: 0.594333 Oct 23 01:11:09.313943 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 120/207] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:08 2022] GET /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb => generated 1390 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:09.557374 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-233d2a42-297d-4e2a-8d90-8cf88fc972af tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.333289 Oct 23 01:11:09.558614 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 88/208] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Oct 23 01:11:09 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 23 01:11:09.571065 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f6594d0b-ab0f-4894-aa9f-b7ad2c897a2d tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1217879969"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:09.577265 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.aggregate [None req-f6594d0b-ab0f-4894-aa9f-b7ad2c897a2d tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Generated uuid 808d7233-0feb-402e-86ad-489340bf2d77 for aggregate {{(pid=120945) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 23 01:11:09.701844 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f6594d0b-ab0f-4894-aa9f-b7ad2c897a2d tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.136353 Oct 23 01:11:09.703269 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 121/209] 10.222.0.42 () {60 vars in 1164 bytes} [Sun Oct 23 01:11:09 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:09.715875 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d83024a6-a34e-406f-a8ce-e499fcf83641 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:09.716347 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b5db65df-a4b9-43eb-9b22-e92d4c6b3610 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:09.716976 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b5db65df-a4b9-43eb-9b22-e92d4c6b3610 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] [instance: ce463295-4ce8-4df9-b8a2-f9388229a3c3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:09.731572 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5db65df-a4b9-43eb-9b22-e92d4c6b3610 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:09.732055 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5db65df-a4b9-43eb-9b22-e92d4c6b3610 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:09.735955 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5db65df-a4b9-43eb-9b22-e92d4c6b3610 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:09.741300 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5db65df-a4b9-43eb-9b22-e92d4c6b3610 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:09.742030 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5db65df-a4b9-43eb-9b22-e92d4c6b3610 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:09.742627 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5db65df-a4b9-43eb-9b22-e92d4c6b3610 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:09.752376 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d83024a6-a34e-406f-a8ce-e499fcf83641 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:09.752918 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d83024a6-a34e-406f-a8ce-e499fcf83641 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:09.753365 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d83024a6-a34e-406f-a8ce-e499fcf83641 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:09.817361 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=6,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:10.136213 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d83024a6-a34e-406f-a8ce-e499fcf83641 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 243 microversion: 2.1 time: 0.424139 Oct 23 01:11:10.138450 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 122/210] 10.222.0.42 () {60 vars in 1194 bytes} [Sun Oct 23 01:11:09 2022] POST /compute/v2.1/os-aggregates/10/action => generated 243 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:11:10.149234 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-02534faf-06c7-451f-a267-8a881f73f56d req-01148cbd-0f1b-427e-8332-94293e22b1f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb", "tag": "a79fbfc6-98c3-46eb-9803-c40ceb7ed7bd"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:10.182571 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-02534faf-06c7-451f-a267-8a881f73f56d req-01148cbd-0f1b-427e-8332-94293e22b1f3 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:10.184162 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-02534faf-06c7-451f-a267-8a881f73f56d req-01148cbd-0f1b-427e-8332-94293e22b1f3 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:10.186345 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-02534faf-06c7-451f-a267-8a881f73f56d req-01148cbd-0f1b-427e-8332-94293e22b1f3 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:10.220015 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-02534faf-06c7-451f-a267-8a881f73f56d req-01148cbd-0f1b-427e-8332-94293e22b1f3 service nova] Creating event network-changed:a79fbfc6-98c3-46eb-9803-c40ceb7ed7bd for instance 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb on n-h2-master-1 Oct 23 01:11:10.233194 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-02534faf-06c7-451f-a267-8a881f73f56d req-01148cbd-0f1b-427e-8332-94293e22b1f3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093010 Oct 23 01:11:10.236944 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 123/211] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:10.443660 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8f1e47b9-cccf-42d3-bf78-7ab6313ee777 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Calling method '.version_select at 0x7f5cc288af70>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:10.567562 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8f1e47b9-cccf-42d3-bf78-7ab6313ee777 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/e2efc362bbe34b99804cf5b7f1c0951f" status: 200 len: 371 microversion: 2.1 time: 0.328923 Oct 23 01:11:10.575020 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 124/212] 10.222.0.42 () {58 vars in 1242 bytes} [Sun Oct 23 01:11:10 2022] GET /compute/v2.1/os-quota-sets/e2efc362bbe34b99804cf5b7f1c0951f => generated 371 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:10.581027 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-54dbb01d-3db1-43a9-884b-e6585b014108 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:10.595471 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-54dbb01d-3db1-43a9-884b-e6585b014108 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] 10.222.0.42 "GET /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.1 time: 0.025571 Oct 23 01:11:10.596062 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 125/213] 10.222.0.42 () {58 vars in 1143 bytes} [Sun Oct 23 01:11:10 2022] GET /compute/v2.1/os-aggregates => generated 246 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:10.611595 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f68ea29b-9506-4cf1-8611-784683070275 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:10.612503 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f68ea29b-9506-4cf1-8611-784683070275 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:10.620443 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f68ea29b-9506-4cf1-8611-784683070275 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:10.621172 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f68ea29b-9506-4cf1-8611-784683070275 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:10.621719 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f68ea29b-9506-4cf1-8611-784683070275 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:10.623497 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f68ea29b-9506-4cf1-8611-784683070275 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:10.624293 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f68ea29b-9506-4cf1-8611-784683070275 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:10.624836 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f68ea29b-9506-4cf1-8611-784683070275 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:10.661499 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b5db65df-a4b9-43eb-9b22-e92d4c6b3610 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec43833fb4d646ab9f26d425cdb0b694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa16b9c333c42ff8860639c213453c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:10.690357 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b5db65df-a4b9-43eb-9b22-e92d4c6b3610 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] 10.222.0.42 "GET /compute/v2.1/servers/ce463295-4ce8-4df9-b8a2-f9388229a3c3" status: 200 len: 1323 microversion: 2.1 time: 0.978665 Oct 23 01:11:10.693530 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 89/214] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:09 2022] GET /compute/v2.1/servers/ce463295-4ce8-4df9-b8a2-f9388229a3c3 => generated 1323 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:10.713127 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-64dc449a-a953-4df2-ad5e-b21e84cf73c5 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Action: 'update', calling method: .version_select at 0x7f5cc294baf0>, body: {"quota_set": {"ram": "5120"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:10.732153 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=6 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:10.897138 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-64dc449a-a953-4df2-ad5e-b21e84cf73c5 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:10.897725 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-64dc449a-a953-4df2-ad5e-b21e84cf73c5 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:10.898238 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-64dc449a-a953-4df2-ad5e-b21e84cf73c5 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:10.902121 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-64dc449a-a953-4df2-ad5e-b21e84cf73c5 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:10.902121 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-64dc449a-a953-4df2-ad5e-b21e84cf73c5 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:10.902121 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-64dc449a-a953-4df2-ad5e-b21e84cf73c5 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:11.063191 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f68ea29b-9506-4cf1-8611-784683070275 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e535f9274b24a9f800ea0c3d8faba5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b8e89ba0a14188bac8e28b66b5a197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:11.071559 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f68ea29b-9506-4cf1-8611-784683070275 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "GET /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb" status: 200 len: 1390 microversion: 2.1 time: 0.473038 Oct 23 01:11:11.072169 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 126/215] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:10 2022] GET /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb => generated 1390 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:11.084242 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5d92edd3-583a-4a55-8a20-fa63b291d209 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:11.105563 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-64dc449a-a953-4df2-ad5e-b21e84cf73c5 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-sets/e2efc362bbe34b99804cf5b7f1c0951f" status: 200 len: 328 microversion: 2.1 time: 0.409678 Oct 23 01:11:11.106556 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 90/216] 10.222.0.42 () {60 vars in 1262 bytes} [Sun Oct 23 01:11:10 2022] PUT /compute/v2.1/os-quota-sets/e2efc362bbe34b99804cf5b7f1c0951f => generated 328 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:11.111895 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5d92edd3-583a-4a55-8a20-fa63b291d209 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:11.117867 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5d92edd3-583a-4a55-8a20-fa63b291d209 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:11.118532 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5d92edd3-583a-4a55-8a20-fa63b291d209 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:11.126924 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-15e9a117-dc7c-4530-b8ef-065675f21527 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:11.269043 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-15e9a117-dc7c-4530-b8ef-065675f21527 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-quota-sets/e2efc362bbe34b99804cf5b7f1c0951f" status: 202 len: 0 microversion: 2.1 time: 0.154546 Oct 23 01:11:11.269633 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 91/217] 10.222.0.42 () {58 vars in 1245 bytes} [Sun Oct 23 01:11:11 2022] DELETE /compute/v2.1/os-quota-sets/e2efc362bbe34b99804cf5b7f1c0951f => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:11:11.278152 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b8077d07-f00d-4dd8-a39c-86651c4ef8d9 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Calling method '.version_select at 0x7f5cc29a8f70>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:11.437059 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b8077d07-f00d-4dd8-a39c-86651c4ef8d9 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/e2efc362bbe34b99804cf5b7f1c0951f" status: 200 len: 371 microversion: 2.1 time: 0.163243 Oct 23 01:11:11.438048 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 92/218] 10.222.0.42 () {58 vars in 1242 bytes} [Sun Oct 23 01:11:11 2022] GET /compute/v2.1/os-quota-sets/e2efc362bbe34b99804cf5b7f1c0951f => generated 371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:11.577939 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5d92edd3-583a-4a55-8a20-fa63b291d209 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 228 microversion: 2.1 time: 0.501641 Oct 23 01:11:11.585382 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 127/219] 10.222.0.42 () {60 vars in 1194 bytes} [Sun Oct 23 01:11:11 2022] POST /compute/v2.1/os-aggregates/10/action => generated 228 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:11.592215 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0f08f626-2d33-4f94-85b1-b240083e82ad tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:11.718262 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-dbb146cb-a308-4f58-8017-a813e3a8b13c tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:11.723639 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-dbb146cb-a308-4f58-8017-a813e3a8b13c tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] [instance: ce463295-4ce8-4df9-b8a2-f9388229a3c3] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:11.728025 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dbb146cb-a308-4f58-8017-a813e3a8b13c tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:11.728821 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dbb146cb-a308-4f58-8017-a813e3a8b13c tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:11.729626 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dbb146cb-a308-4f58-8017-a813e3a8b13c tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:11.730698 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dbb146cb-a308-4f58-8017-a813e3a8b13c tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:11.731365 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dbb146cb-a308-4f58-8017-a813e3a8b13c tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:11.731623 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0f08f626-2d33-4f94-85b1-b240083e82ad tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.144020 Oct 23 01:11:11.732749 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 93/220] 10.222.0.42 () {58 vars in 1155 bytes} [Sun Oct 23 01:11:11 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 23 01:11:11.735025 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dbb146cb-a308-4f58-8017-a813e3a8b13c tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:11.746572 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0722bd8d-4047-4768-b131-468b12c6e3f0 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-265965095"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:11.760178 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.aggregate [None req-0722bd8d-4047-4768-b131-468b12c6e3f0 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Generated uuid e341e562-580a-4134-9c5f-a88e7fcdd719 for aggregate {{(pid=120944) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 23 01:11:11.868969 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0722bd8d-4047-4768-b131-468b12c6e3f0 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.120666 Oct 23 01:11:11.877624 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 94/221] 10.222.0.42 () {60 vars in 1164 bytes} [Sun Oct 23 01:11:11 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:11.883930 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-87c35270-85e4-488d-be28-18b6f755e867 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:11.898463 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-87c35270-85e4-488d-be28-18b6f755e867 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:11.899290 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-87c35270-85e4-488d-be28-18b6f755e867 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:11.899919 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-87c35270-85e4-488d-be28-18b6f755e867 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:12.005035 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=14 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:12.183826 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-dbb146cb-a308-4f58-8017-a813e3a8b13c tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec43833fb4d646ab9f26d425cdb0b694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa16b9c333c42ff8860639c213453c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:12.194014 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-dbb146cb-a308-4f58-8017-a813e3a8b13c tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] 10.222.0.42 "GET /compute/v2.1/servers/ce463295-4ce8-4df9-b8a2-f9388229a3c3" status: 200 len: 1323 microversion: 2.1 time: 0.482861 Oct 23 01:11:12.195146 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 128/222] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:11 2022] GET /compute/v2.1/servers/ce463295-4ce8-4df9-b8a2-f9388229a3c3 => generated 1323 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:11:12.205542 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4ccebdcd-0bdd-4962-8024-4dec67ee4c67 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Calling method '.version_select at 0x7f5cc29133a0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:12.314631 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-87c35270-85e4-488d-be28-18b6f755e867 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 242 microversion: 2.1 time: 0.434974 Oct 23 01:11:12.316165 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 95/223] 10.222.0.42 () {60 vars in 1194 bytes} [Sun Oct 23 01:11:11 2022] POST /compute/v2.1/os-aggregates/11/action => generated 242 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:12.458351 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4ccebdcd-0bdd-4962-8024-4dec67ee4c67 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/c7cff3fb8aab4d0eb2b247cae880ba27/defaults" status: 200 len: 371 microversion: 2.1 time: 0.260748 Oct 23 01:11:12.458602 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ec556a73-4143-49be-aace-71cf8a0aa8d7 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-924209153", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "3be3e39f-fbeb-4ed9-a69b-dfb7241289c0"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:12.468894 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 129/224] 10.222.0.42 () {58 vars in 1269 bytes} [Sun Oct 23 01:11:12 2022] GET /compute/v2.1/os-quota-sets/c7cff3fb8aab4d0eb2b247cae880ba27/defaults => generated 371 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:12.476099 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f471bbba-b3d8-493c-8b86-d20d699b4463 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:12.477274 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f471bbba-b3d8-493c-8b86-d20d699b4463 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:12.488478 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f471bbba-b3d8-493c-8b86-d20d699b4463 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:12.489201 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f471bbba-b3d8-493c-8b86-d20d699b4463 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:12.490055 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f471bbba-b3d8-493c-8b86-d20d699b4463 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:12.491696 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f471bbba-b3d8-493c-8b86-d20d699b4463 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:12.493222 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f471bbba-b3d8-493c-8b86-d20d699b4463 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:12.496256 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f471bbba-b3d8-493c-8b86-d20d699b4463 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:12.576360 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-ec556a73-4143-49be-aace-71cf8a0aa8d7 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] validate_networks() for [('3be3e39f-fbeb-4ed9-a69b-dfb7241289c0', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:11:12.850951 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f471bbba-b3d8-493c-8b86-d20d699b4463 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e535f9274b24a9f800ea0c3d8faba5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b8e89ba0a14188bac8e28b66b5a197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:12.859063 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f471bbba-b3d8-493c-8b86-d20d699b4463 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "GET /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb" status: 200 len: 1390 microversion: 2.1 time: 0.389078 Oct 23 01:11:12.859808 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 130/225] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:12 2022] GET /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb => generated 1390 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:12.868481 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-7a4d8f1e-c3c7-4d13-aed9-49a69249d77d req-d4517653-4a89-46a6-8bba-74e97ce60ad7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce463295-4ce8-4df9-b8a2-f9388229a3c3", "tag": "83d2ae7a-86a5-49fc-a7a2-a8e5188de127"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:12.885535 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-7a4d8f1e-c3c7-4d13-aed9-49a69249d77d req-d4517653-4a89-46a6-8bba-74e97ce60ad7 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:12.887102 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-7a4d8f1e-c3c7-4d13-aed9-49a69249d77d req-d4517653-4a89-46a6-8bba-74e97ce60ad7 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:12.892287 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-7a4d8f1e-c3c7-4d13-aed9-49a69249d77d req-d4517653-4a89-46a6-8bba-74e97ce60ad7 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:12.909948 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-7a4d8f1e-c3c7-4d13-aed9-49a69249d77d req-d4517653-4a89-46a6-8bba-74e97ce60ad7 service nova] Creating event network-changed:83d2ae7a-86a5-49fc-a7a2-a8e5188de127 for instance ce463295-4ce8-4df9-b8a2-f9388229a3c3 on n-h1-master-1 Oct 23 01:11:12.916817 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-7a4d8f1e-c3c7-4d13-aed9-49a69249d77d req-d4517653-4a89-46a6-8bba-74e97ce60ad7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055373 Oct 23 01:11:12.918215 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 131/226] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:12.936007 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-496a686d-c60c-4470-a238-d2faa5928739 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:12.961496 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-496a686d-c60c-4470-a238-d2faa5928739 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:12.962124 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-496a686d-c60c-4470-a238-d2faa5928739 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:12.963334 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-496a686d-c60c-4470-a238-d2faa5928739 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:13.291065 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-496a686d-c60c-4470-a238-d2faa5928739 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 227 microversion: 2.1 time: 0.371591 Oct 23 01:11:13.300065 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 132/227] 10.222.0.42 () {60 vars in 1194 bytes} [Sun Oct 23 01:11:12 2022] POST /compute/v2.1/os-aggregates/11/action => generated 227 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:13.306069 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d413a434-ed78-4211-9b53-893f7680fd26 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Action: 'update', calling method: .version_select at 0x7f5cc286b280>, body: {"quota_set": {"ram": "5120"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:13.472749 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d413a434-ed78-4211-9b53-893f7680fd26 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:13.473816 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d413a434-ed78-4211-9b53-893f7680fd26 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:13.474448 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d413a434-ed78-4211-9b53-893f7680fd26 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:13.475338 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d413a434-ed78-4211-9b53-893f7680fd26 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:13.475946 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d413a434-ed78-4211-9b53-893f7680fd26 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:13.476522 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d413a434-ed78-4211-9b53-893f7680fd26 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:13.605688 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d413a434-ed78-4211-9b53-893f7680fd26 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-sets/5cbb8702ad114778af2cf17ac8f6f9e0" status: 200 len: 328 microversion: 2.1 time: 0.304056 Oct 23 01:11:13.613441 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 133/228] 10.222.0.42 () {60 vars in 1262 bytes} [Sun Oct 23 01:11:13 2022] PUT /compute/v2.1/os-quota-sets/5cbb8702ad114778af2cf17ac8f6f9e0 => generated 328 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:13.625423 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a10bddb0-5ef0-453d-88d1-cb2bf5b3aaa1 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:13.627444 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a10bddb0-5ef0-453d-88d1-cb2bf5b3aaa1 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] [instance: ce463295-4ce8-4df9-b8a2-f9388229a3c3] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:13.640371 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a10bddb0-5ef0-453d-88d1-cb2bf5b3aaa1 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:13.641094 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a10bddb0-5ef0-453d-88d1-cb2bf5b3aaa1 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:13.641686 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a10bddb0-5ef0-453d-88d1-cb2bf5b3aaa1 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:13.642636 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a10bddb0-5ef0-453d-88d1-cb2bf5b3aaa1 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:13.643233 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a10bddb0-5ef0-453d-88d1-cb2bf5b3aaa1 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:13.643900 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a10bddb0-5ef0-453d-88d1-cb2bf5b3aaa1 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:13.851388 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-ec556a73-4143-49be-aace-71cf8a0aa8d7 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:11:13.852870 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-ec556a73-4143-49be-aace-71cf8a0aa8d7 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:11:13.854851 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-ec556a73-4143-49be-aace-71cf8a0aa8d7 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:11:13.855844 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-ec556a73-4143-49be-aace-71cf8a0aa8d7 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:11:13.857823 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-ec556a73-4143-49be-aace-71cf8a0aa8d7 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:11:13.870607 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ec556a73-4143-49be-aace-71cf8a0aa8d7 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:13.871605 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ec556a73-4143-49be-aace-71cf8a0aa8d7 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:13.872295 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ec556a73-4143-49be-aace-71cf8a0aa8d7 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:13.873524 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ec556a73-4143-49be-aace-71cf8a0aa8d7 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:13.875032 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ec556a73-4143-49be-aace-71cf8a0aa8d7 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:13.878535 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ec556a73-4143-49be-aace-71cf8a0aa8d7 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:13.910928 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-ec556a73-4143-49be-aace-71cf8a0aa8d7 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Getting quotas for project d46a7166e4144f55a102ea6335c5f820. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:11:13.922900 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-ec556a73-4143-49be-aace-71cf8a0aa8d7 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Getting quotas for user 1c2310cbc3574eb29a6ca6291ba7808e and project d46a7166e4144f55a102ea6335c5f820. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:11:13.950394 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ec556a73-4143-49be-aace-71cf8a0aa8d7 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:11:13.954195 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ec556a73-4143-49be-aace-71cf8a0aa8d7 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 26043446-8442-4d38-98d8-6ff9a1432d1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:11:14.039557 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a10bddb0-5ef0-453d-88d1-cb2bf5b3aaa1 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec43833fb4d646ab9f26d425cdb0b694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa16b9c333c42ff8860639c213453c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:14.050773 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a10bddb0-5ef0-453d-88d1-cb2bf5b3aaa1 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] 10.222.0.42 "GET /compute/v2.1/servers/ce463295-4ce8-4df9-b8a2-f9388229a3c3" status: 200 len: 1323 microversion: 2.1 time: 0.431441 Oct 23 01:11:14.062025 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 134/229] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:13 2022] GET /compute/v2.1/servers/ce463295-4ce8-4df9-b8a2-f9388229a3c3 => generated 1323 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:14.062025 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9f1989bf-05e4-4028-90b3-ec1dba962fdc tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:14.162819 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9f1989bf-05e4-4028-90b3-ec1dba962fdc tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.108944 Oct 23 01:11:14.163554 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 135/230] 10.222.0.42 () {58 vars in 1155 bytes} [Sun Oct 23 01:11:14 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 23 01:11:14.214156 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ec556a73-4143-49be-aace-71cf8a0aa8d7 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.895880 Oct 23 01:11:14.214351 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f529b306-a77d-4f37-91e3-d9953da80ba1 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Calling method '.version_select at 0x7f5cc9589b80>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:14.224176 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 96/231] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:11:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:11:14.235752 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6f629a2c-e339-41e2-9f1e-35cdb06c6550 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:14.237128 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6f629a2c-e339-41e2-9f1e-35cdb06c6550 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:14.245791 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6f629a2c-e339-41e2-9f1e-35cdb06c6550 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:14.246888 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6f629a2c-e339-41e2-9f1e-35cdb06c6550 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:14.255138 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6f629a2c-e339-41e2-9f1e-35cdb06c6550 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:14.255138 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6f629a2c-e339-41e2-9f1e-35cdb06c6550 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:14.255138 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6f629a2c-e339-41e2-9f1e-35cdb06c6550 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:14.263333 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6f629a2c-e339-41e2-9f1e-35cdb06c6550 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:14.342578 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f529b306-a77d-4f37-91e3-d9953da80ba1 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:14.344015 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f529b306-a77d-4f37-91e3-d9953da80ba1 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:14.345557 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f529b306-a77d-4f37-91e3-d9953da80ba1 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:14.348123 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f529b306-a77d-4f37-91e3-d9953da80ba1 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:14.348828 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f529b306-a77d-4f37-91e3-d9953da80ba1 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:14.350446 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f529b306-a77d-4f37-91e3-d9953da80ba1 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:14.403941 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f529b306-a77d-4f37-91e3-d9953da80ba1 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/5cbb8702ad114778af2cf17ac8f6f9e0/detail" status: 200 len: 916 microversion: 2.1 time: 0.226169 Oct 23 01:11:14.404890 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 136/232] 10.222.0.42 () {58 vars in 1263 bytes} [Sun Oct 23 01:11:14 2022] GET /compute/v2.1/os-quota-sets/5cbb8702ad114778af2cf17ac8f6f9e0/detail => generated 916 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:14.417063 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-00f35d85-7142-41f8-b967-1a891988c064 tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Calling method '.version_select at 0x7f5cc29d84c0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:14.455774 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-00f35d85-7142-41f8-b967-1a891988c064 tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:14.456326 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-00f35d85-7142-41f8-b967-1a891988c064 tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:14.456775 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-00f35d85-7142-41f8-b967-1a891988c064 tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:14.462122 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-00f35d85-7142-41f8-b967-1a891988c064 tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:14.464994 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-00f35d85-7142-41f8-b967-1a891988c064 tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:14.465528 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-00f35d85-7142-41f8-b967-1a891988c064 tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:14.566101 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-00f35d85-7142-41f8-b967-1a891988c064 tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.156641 Oct 23 01:11:14.575036 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 137/233] 10.222.0.42 () {58 vars in 1128 bytes} [Sun Oct 23 01:11:14 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:14.581956 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8ceca444-a6b0-4c7b-a611-8b720c29abf7 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-975241053"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:14.602646 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.aggregate [None req-8ceca444-a6b0-4c7b-a611-8b720c29abf7 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Generated uuid b9da60bb-bfd1-4d26-935c-90ba3cc17069 for aggregate {{(pid=120945) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 23 01:11:14.745399 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8ceca444-a6b0-4c7b-a611-8b720c29abf7 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.168280 Oct 23 01:11:14.745830 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 138/234] 10.222.0.42 () {60 vars in 1164 bytes} [Sun Oct 23 01:11:14 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:14.752195 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ef981739-cb36-46e1-aac8-c8ed0442330d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:14.755400 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ef981739-cb36-46e1-aac8-c8ed0442330d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 26043446-8442-4d38-98d8-6ff9a1432d1b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:14.975491 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ef981739-cb36-46e1-aac8-c8ed0442330d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:14.981813 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ef981739-cb36-46e1-aac8-c8ed0442330d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b" status: 200 len: 1210 microversion: 2.1 time: 0.234727 Oct 23 01:11:14.982515 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 139/235] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:14 2022] GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b => generated 1210 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:14.992713 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6f629a2c-e339-41e2-9f1e-35cdb06c6550 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e535f9274b24a9f800ea0c3d8faba5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b8e89ba0a14188bac8e28b66b5a197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:14.999231 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-db283afc-f062-43a3-abb0-303b1714d901 tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Calling method '.version_select at 0x7f5cc288a280>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:15.002781 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-db283afc-f062-43a3-abb0-303b1714d901 tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:15.003272 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-db283afc-f062-43a3-abb0-303b1714d901 tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:15.003704 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-db283afc-f062-43a3-abb0-303b1714d901 tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:15.005448 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-db283afc-f062-43a3-abb0-303b1714d901 tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:15.006345 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-db283afc-f062-43a3-abb0-303b1714d901 tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:15.006797 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-db283afc-f062-43a3-abb0-303b1714d901 tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:15.009655 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6f629a2c-e339-41e2-9f1e-35cdb06c6550 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "GET /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb" status: 200 len: 1390 microversion: 2.1 time: 0.783344 Oct 23 01:11:15.011579 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 97/236] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:14 2022] GET /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb => generated 1390 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:15.021210 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a28f58e9-c36e-4646-a573-ee3ee719abe7 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:15.072410 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-db283afc-f062-43a3-abb0-303b1714d901 tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.086594 Oct 23 01:11:15.089567 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 140/237] 10.222.0.42 () {58 vars in 1155 bytes} [Sun Oct 23 01:11:14 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:15.092960 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-71227532-c4a7-4b37-90b2-eafe69de4752 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Action: 'update', calling method: .version_select at 0x7f5cc29d8670>, body: {"quota_set": {"ram": "2048"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:15.177283 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a28f58e9-c36e-4646-a573-ee3ee719abe7 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.164135 Oct 23 01:11:15.178357 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 98/238] 10.222.0.42 () {58 vars in 1155 bytes} [Sun Oct 23 01:11:15 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 23 01:11:15.184296 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-43f07995-38ba-4dd6-8de6-efa6209a261e tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:15.190438 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-43f07995-38ba-4dd6-8de6-efa6209a261e tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] [instance: ce463295-4ce8-4df9-b8a2-f9388229a3c3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:15.195471 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-43f07995-38ba-4dd6-8de6-efa6209a261e tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:15.196303 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-43f07995-38ba-4dd6-8de6-efa6209a261e tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:15.197053 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-43f07995-38ba-4dd6-8de6-efa6209a261e tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:15.197963 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-43f07995-38ba-4dd6-8de6-efa6209a261e tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:15.199666 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-43f07995-38ba-4dd6-8de6-efa6209a261e tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:15.200768 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-43f07995-38ba-4dd6-8de6-efa6209a261e tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:15.203761 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:DELETE=4 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:15.214239 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-71227532-c4a7-4b37-90b2-eafe69de4752 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:15.217189 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-71227532-c4a7-4b37-90b2-eafe69de4752 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:15.217825 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-71227532-c4a7-4b37-90b2-eafe69de4752 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:15.224300 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-71227532-c4a7-4b37-90b2-eafe69de4752 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:15.225035 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-71227532-c4a7-4b37-90b2-eafe69de4752 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:15.225686 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-71227532-c4a7-4b37-90b2-eafe69de4752 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:15.265615 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-71227532-c4a7-4b37-90b2-eafe69de4752 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:15.266429 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-71227532-c4a7-4b37-90b2-eafe69de4752 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:15.267225 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-71227532-c4a7-4b37-90b2-eafe69de4752 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:15.268125 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-71227532-c4a7-4b37-90b2-eafe69de4752 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:15.269265 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-71227532-c4a7-4b37-90b2-eafe69de4752 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:15.278104 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-71227532-c4a7-4b37-90b2-eafe69de4752 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:15.455496 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-43f07995-38ba-4dd6-8de6-efa6209a261e tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec43833fb4d646ab9f26d425cdb0b694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa16b9c333c42ff8860639c213453c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:15.465181 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-43f07995-38ba-4dd6-8de6-efa6209a261e tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] 10.222.0.42 "GET /compute/v2.1/servers/ce463295-4ce8-4df9-b8a2-f9388229a3c3" status: 200 len: 1323 microversion: 2.1 time: 0.285535 Oct 23 01:11:15.468457 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-71227532-c4a7-4b37-90b2-eafe69de4752 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-sets/5cbb8702ad114778af2cf17ac8f6f9e0?user_id=2dfad1a0fddd43689b44f69b25036342" status: 200 len: 328 microversion: 2.1 time: 0.385494 Oct 23 01:11:15.473089 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 99/240] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:15 2022] GET /compute/v2.1/servers/ce463295-4ce8-4df9-b8a2-f9388229a3c3 => generated 1323 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:15.478657 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 141/240] 10.222.0.42 () {60 vars in 1343 bytes} [Sun Oct 23 01:11:15 2022] PUT /compute/v2.1/os-quota-sets/5cbb8702ad114778af2cf17ac8f6f9e0?user_id=2dfad1a0fddd43689b44f69b25036342 => generated 328 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:15.489380 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0a4670f6-f326-48da-8d83-1174ccbb7e39 tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Calling method '.version_select at 0x7f5cc28ac160>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:15.489380 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0a4670f6-f326-48da-8d83-1174ccbb7e39 tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:15.489926 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0a4670f6-f326-48da-8d83-1174ccbb7e39 tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:15.490963 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0a4670f6-f326-48da-8d83-1174ccbb7e39 tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:15.491095 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e7121da8-43df-4fb8-a645-fc0af80362f9 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1372339094"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:15.491618 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0a4670f6-f326-48da-8d83-1174ccbb7e39 tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:15.492513 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0a4670f6-f326-48da-8d83-1174ccbb7e39 tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:15.493158 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0a4670f6-f326-48da-8d83-1174ccbb7e39 tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:15.494962 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.aggregate [None req-e7121da8-43df-4fb8-a645-fc0af80362f9 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Generated uuid 03652912-0c57-4b6c-8e4a-9df3b9d60579 for aggregate {{(pid=120945) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 23 01:11:15.521598 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0a4670f6-f326-48da-8d83-1174ccbb7e39 tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.047172 Oct 23 01:11:15.522241 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 100/241] 10.222.0.42 () {58 vars in 1128 bytes} [Sun Oct 23 01:11:15 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:15.529784 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bcb92130-f192-4a11-9068-5d32f999e546 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:15.536941 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-bcb92130-f192-4a11-9068-5d32f999e546 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Oct 23 01:11:15.539079 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bcb92130-f192-4a11-9068-5d32f999e546 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Request method failure captured: Oct 23 01:11:15.539079 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/os-aggregates/12 HTTP/1.1 Oct 23 01:11:15.539079 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:11:15.539079 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:11:15.539079 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:11:15.539079 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:11:15.539079 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:11:15.539079 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:11:15.539079 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:11:15.539079 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:11:15.539079 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJR5PKn71nEQisVO1mvf2IKxRF8M0Sjcv1licXQqFhPYTAK1zUVS6TGJ0Jl64lK9SVSxgKSRbgQKQP19Q0sm5tCmtwEHAWkuTAJsK9OuDqvCkANxGmSw0nOjIMUYQWzfl1mXgHXuuTCDSeo4XUeNDC2ERvLq44JWgQMDdA5RWynqkRk Oct 23 01:11:15.539079 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:11:15.539079 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:11:15.539079 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:11:15.539079 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:11:15.539079 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:11:15.539079 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:11:15.539079 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: f7c3e6bcb228428aaf1ddbb2dda3af25 Oct 23 01:11:15.539079 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-AggregatesAdminTestJSON-507603983 Oct 23 01:11:15.539079 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,admin,reader Oct 23 01:11:15.539079 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,admin,reader Oct 23 01:11:15.540560 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f7c3e6bcb228428aaf1ddbb2dda3af25"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f7c3e6bcb228428aaf1ddbb2dda3af25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f7c3e6bcb228428aaf1ddbb2dda3af25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f7c3e6bcb228428aaf1ddbb2dda3af25"}]}] Oct 23 01:11:15.540560 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-AggregatesAdminTestJSON-507603983 Oct 23 01:11:15.540560 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: f7c3e6bcb228428aaf1ddbb2dda3af25 Oct 23 01:11:15.540560 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-507603983 Oct 23 01:11:15.540560 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-AggregatesAdminTestJSON-507603983-project-admin Oct 23 01:11:15.540560 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:11:15.540560 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:11:15.540560 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 15cf44b2cdc345a883125e0522ccf08f Oct 23 01:11:15.540560 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-AggregatesAdminTestJSON-507603983-project-admin Oct 23 01:11:15.540560 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:11:15.540560 n-d-master-1 devstack@n-api.service[120944]: exception: Aggregate 12 could not be found. Oct 23 01:11:15.540560 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '12'} Oct 23 01:11:15.540560 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:11:15.541466 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:15.541466 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 23 01:11:15.541466 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 23 01:11:15.541466 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 23 01:11:15.541466 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 23 01:11:15.541466 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 01:11:15.541466 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 01:11:15.541466 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 23 01:11:15.541466 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 23 01:11:15.541466 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 23 01:11:15.541466 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 23 01:11:15.541466 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 23 01:11:15.541466 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 23 01:11:15.541466 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Oct 23 01:11:15.541466 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:15.541466 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:11:15.541466 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:15.541466 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:15.541466 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:15.542990 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:15.542990 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:11:15.542990 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:11:15.542990 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:11:15.542990 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:11:15.542990 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 23 01:11:15.542990 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:11:15.542990 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Oct 23 01:11:15.542990 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:15.542990 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:11:15.542990 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:15.542990 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:15.542990 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:15.542990 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:15.542990 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:11:15.542990 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:11:15.542990 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Oct 23 01:11:15.542990 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:15.544131 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bcb92130-f192-4a11-9068-5d32f999e546 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:11:15.544131 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bcb92130-f192-4a11-9068-5d32f999e546 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] 10.222.0.42 "GET /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.017341 Oct 23 01:11:15.544131 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 101/242] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Oct 23 01:11:15 2022] GET /compute/v2.1/os-aggregates/12 => generated 78 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:11:15.547416 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d44054d9-f8a2-4562-94c5-4e679cf38c9c tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Calling method '.version_select at 0x7f5cc28f3670>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:15.575527 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e7121da8-43df-4fb8-a645-fc0af80362f9 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.095292 Oct 23 01:11:15.578699 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 142/243] 10.222.0.42 () {60 vars in 1164 bytes} [Sun Oct 23 01:11:15 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:15.585819 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-653f7b53-13c8-418d-9723-75f3005fbf0d tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Calling method '.version_select at 0x7f5cc286b670>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:15.601797 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-653f7b53-13c8-418d-9723-75f3005fbf0d tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:15.606967 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-653f7b53-13c8-418d-9723-75f3005fbf0d tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:15.606967 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-653f7b53-13c8-418d-9723-75f3005fbf0d tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:15.640012 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-653f7b53-13c8-418d-9723-75f3005fbf0d tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:15.640678 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-653f7b53-13c8-418d-9723-75f3005fbf0d tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:15.641413 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-653f7b53-13c8-418d-9723-75f3005fbf0d tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:15.679448 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-653f7b53-13c8-418d-9723-75f3005fbf0d tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hosts/n-h1-master-1" status: 200 len: 467 microversion: 2.1 time: 0.099221 Oct 23 01:11:15.682195 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d44054d9-f8a2-4562-94c5-4e679cf38c9c tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/5cbb8702ad114778af2cf17ac8f6f9e0?user_id=2dfad1a0fddd43689b44f69b25036342" status: 200 len: 370 microversion: 2.1 time: 0.139252 Oct 23 01:11:15.682331 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 143/244] 10.222.0.42 () {58 vars in 1170 bytes} [Sun Oct 23 01:11:15 2022] GET /compute/v2.1/os-hosts/n-h1-master-1 => generated 467 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:15.686996 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 102/245] 10.222.0.42 () {58 vars in 1323 bytes} [Sun Oct 23 01:11:15 2022] GET /compute/v2.1/os-quota-sets/5cbb8702ad114778af2cf17ac8f6f9e0?user_id=2dfad1a0fddd43689b44f69b25036342 => generated 370 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:15.692999 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-563edf6a-b893-4fb2-ae34-6e525e6d44df tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:15.694911 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7e65117e-dbd7-4b33-acc7-849e329cb771 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:15.710733 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-563edf6a-b893-4fb2-ae34-6e525e6d44df tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Oct 23 01:11:15.713759 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-563edf6a-b893-4fb2-ae34-6e525e6d44df tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Request method failure captured: Oct 23 01:11:15.713759 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/os-aggregates/12 HTTP/1.1 Oct 23 01:11:15.713759 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:11:15.713759 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:11:15.713759 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:11:15.713759 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:11:15.713759 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:11:15.713759 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:11:15.713759 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:11:15.713759 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:11:15.713759 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJR5PKn71nEQisVO1mvf2IKxRF8M0Sjcv1licXQqFhPYTAK1zUVS6TGJ0Jl64lK9SVSxgKSRbgQKQP19Q0sm5tCmtwEHAWkuTAJsK9OuDqvCkANxGmSw0nOjIMUYQWzfl1mXgHXuuTCDSeo4XUeNDC2ERvLq44JWgQMDdA5RWynqkRk Oct 23 01:11:15.713759 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:11:15.713759 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:11:15.713759 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:11:15.713759 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:11:15.713759 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:11:15.713759 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:11:15.713759 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: f7c3e6bcb228428aaf1ddbb2dda3af25 Oct 23 01:11:15.713759 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-AggregatesAdminTestJSON-507603983 Oct 23 01:11:15.713759 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,admin,reader Oct 23 01:11:15.713759 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,admin,reader Oct 23 01:11:15.715278 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f7c3e6bcb228428aaf1ddbb2dda3af25"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f7c3e6bcb228428aaf1ddbb2dda3af25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f7c3e6bcb228428aaf1ddbb2dda3af25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f7c3e6bcb228428aaf1ddbb2dda3af25"}]}] Oct 23 01:11:15.715278 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-AggregatesAdminTestJSON-507603983 Oct 23 01:11:15.715278 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: f7c3e6bcb228428aaf1ddbb2dda3af25 Oct 23 01:11:15.715278 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-507603983 Oct 23 01:11:15.715278 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-AggregatesAdminTestJSON-507603983-project-admin Oct 23 01:11:15.715278 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:11:15.715278 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:11:15.715278 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 15cf44b2cdc345a883125e0522ccf08f Oct 23 01:11:15.715278 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-AggregatesAdminTestJSON-507603983-project-admin Oct 23 01:11:15.715278 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:11:15.715278 n-d-master-1 devstack@n-api.service[120945]: exception: Aggregate 12 could not be found. Oct 23 01:11:15.715278 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '12'} Oct 23 01:11:15.715278 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:11:15.716134 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:15.716134 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 23 01:11:15.716134 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 23 01:11:15.716134 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 23 01:11:15.716134 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 23 01:11:15.716134 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:11:15.716134 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 23 01:11:15.716134 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:11:15.716134 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise self.value Oct 23 01:11:15.716134 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 23 01:11:15.716134 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 23 01:11:15.716134 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 23 01:11:15.716134 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 23 01:11:15.716134 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 01:11:15.716134 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 01:11:15.716134 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 23 01:11:15.716134 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 23 01:11:15.716134 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 23 01:11:15.716134 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 23 01:11:15.732369 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 23 01:11:15.732369 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 23 01:11:15.732369 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Oct 23 01:11:15.732369 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:15.732369 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:11:15.732369 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:15.732369 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:15.732369 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:15.732369 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:15.732369 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:11:15.732369 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:11:15.732369 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:11:15.732369 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:11:15.732369 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 23 01:11:15.732369 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:11:15.732369 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Oct 23 01:11:15.732369 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:15.732369 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:11:15.732369 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:15.732369 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:15.732369 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:15.733872 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:15.733872 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:11:15.733872 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:11:15.733872 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Oct 23 01:11:15.733872 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:15.733872 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-563edf6a-b893-4fb2-ae34-6e525e6d44df tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:11:15.733872 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-563edf6a-b893-4fb2-ae34-6e525e6d44df tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.030362 Oct 23 01:11:15.733872 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 144/246] 10.222.0.42 () {58 vars in 1155 bytes} [Sun Oct 23 01:11:15 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 78 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:11:15.733872 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f325a385-5a5e-421d-b2c6-615a10a8c741 tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Calling method '.version_select at 0x7f5cc286bd30>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:15.734543 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e65117e-dbd7-4b33-acc7-849e329cb771 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:15.734543 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e65117e-dbd7-4b33-acc7-849e329cb771 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:15.734543 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e65117e-dbd7-4b33-acc7-849e329cb771 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:15.734788 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f325a385-5a5e-421d-b2c6-615a10a8c741 tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:15.734788 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f325a385-5a5e-421d-b2c6-615a10a8c741 tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:15.734949 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f325a385-5a5e-421d-b2c6-615a10a8c741 tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:15.769216 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f325a385-5a5e-421d-b2c6-615a10a8c741 tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:15.770091 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f325a385-5a5e-421d-b2c6-615a10a8c741 tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:15.771132 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f325a385-5a5e-421d-b2c6-615a10a8c741 tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:15.794208 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f325a385-5a5e-421d-b2c6-615a10a8c741 tempest-HostsAdminTestJSON-582324189 tempest-HostsAdminTestJSON-582324189-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hosts/n-h2-master-1" status: 200 len: 467 microversion: 2.1 time: 0.074541 Oct 23 01:11:15.801624 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 145/247] 10.222.0.42 () {58 vars in 1170 bytes} [Sun Oct 23 01:11:15 2022] GET /compute/v2.1/os-hosts/n-h2-master-1 => generated 467 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:15.809197 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-57130270-2d6e-40a2-a019-4cc8e7509239 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-124453900", "name": "tempest-test_aggregate-1368857273"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:15.833404 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.aggregate [None req-57130270-2d6e-40a2-a019-4cc8e7509239 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Generated uuid 94eae7c0-a0c2-427f-affc-1a44064b63c0 for aggregate {{(pid=120945) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 23 01:11:15.959009 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-57130270-2d6e-40a2-a019-4cc8e7509239 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.154251 Oct 23 01:11:15.964993 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 146/248] 10.222.0.42 () {60 vars in 1165 bytes} [Sun Oct 23 01:11:15 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:15.977868 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-20e6a26e-e2b2-4125-bfa6-b0ebede9c283 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:16.161799 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-20e6a26e-e2b2-4125-bfa6-b0ebede9c283 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.188400 Oct 23 01:11:16.164227 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 147/249] 10.222.0.42 () {58 vars in 1155 bytes} [Sun Oct 23 01:11:15 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 23 01:11:16.170732 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-216764e8-4d6d-4eca-b7bd-a845d17078be tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:16.171365 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-216764e8-4d6d-4eca-b7bd-a845d17078be tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 26043446-8442-4d38-98d8-6ff9a1432d1b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:16.193780 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-216764e8-4d6d-4eca-b7bd-a845d17078be tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:16.194458 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-216764e8-4d6d-4eca-b7bd-a845d17078be tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:16.196145 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-216764e8-4d6d-4eca-b7bd-a845d17078be tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:16.196818 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-216764e8-4d6d-4eca-b7bd-a845d17078be tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:16.197280 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-216764e8-4d6d-4eca-b7bd-a845d17078be tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:16.198802 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-216764e8-4d6d-4eca-b7bd-a845d17078be tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:16.215529 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7e65117e-dbd7-4b33-acc7-849e329cb771 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 243 microversion: 2.1 time: 0.525954 Oct 23 01:11:16.225141 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 103/250] 10.222.0.42 () {60 vars in 1194 bytes} [Sun Oct 23 01:11:15 2022] POST /compute/v2.1/os-aggregates/13/action => generated 243 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:16.232964 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2ee9b266-6927-4769-8009-d4d002a3abe9 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:16.234618 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2ee9b266-6927-4769-8009-d4d002a3abe9 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:16.243548 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2ee9b266-6927-4769-8009-d4d002a3abe9 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:16.244424 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2ee9b266-6927-4769-8009-d4d002a3abe9 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:16.262693 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2ee9b266-6927-4769-8009-d4d002a3abe9 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:16.263690 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2ee9b266-6927-4769-8009-d4d002a3abe9 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:16.264355 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2ee9b266-6927-4769-8009-d4d002a3abe9 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:16.264966 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2ee9b266-6927-4769-8009-d4d002a3abe9 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:16.344925 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-216764e8-4d6d-4eca-b7bd-a845d17078be tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:16.359023 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-216764e8-4d6d-4eca-b7bd-a845d17078be tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b" status: 200 len: 1214 microversion: 2.1 time: 0.191919 Oct 23 01:11:16.364207 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 148/251] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:16 2022] GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b => generated 1214 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:16.377481 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a5fc0e44-68da-4493-935e-ea87acbaf672 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:16.411216 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-a5fc0e44-68da-4493-935e-ea87acbaf672 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Oct 23 01:11:16.417964 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a5fc0e44-68da-4493-935e-ea87acbaf672 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Request method failure captured: Oct 23 01:11:16.417964 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 Oct 23 01:11:16.417964 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:11:16.417964 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:11:16.417964 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:11:16.417964 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:11:16.417964 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:11:16.417964 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:11:16.417964 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:11:16.417964 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:11:16.417964 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJR5PKn71nEQisVO1mvf2IKxRF8M0Sjcv1licXQqFhPYTAK1zUVS6TGJ0Jl64lK9SVSxgKSRbgQKQP19Q0sm5tCmtwEHAWkuTAJsK9OuDqvCkANxGmSw0nOjIMUYQWzfl1mXgHXuuTCDSeo4XUeNDC2ERvLq44JWgQMDdA5RWynqkRk Oct 23 01:11:16.417964 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:11:16.417964 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:11:16.417964 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:11:16.417964 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:11:16.417964 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:11:16.417964 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:11:16.417964 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: f7c3e6bcb228428aaf1ddbb2dda3af25 Oct 23 01:11:16.417964 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-AggregatesAdminTestJSON-507603983 Oct 23 01:11:16.417964 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,admin,reader Oct 23 01:11:16.417964 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,admin,reader Oct 23 01:11:16.419685 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f7c3e6bcb228428aaf1ddbb2dda3af25"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f7c3e6bcb228428aaf1ddbb2dda3af25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f7c3e6bcb228428aaf1ddbb2dda3af25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f7c3e6bcb228428aaf1ddbb2dda3af25"}]}] Oct 23 01:11:16.419685 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-AggregatesAdminTestJSON-507603983 Oct 23 01:11:16.419685 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: f7c3e6bcb228428aaf1ddbb2dda3af25 Oct 23 01:11:16.419685 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-507603983 Oct 23 01:11:16.419685 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-AggregatesAdminTestJSON-507603983-project-admin Oct 23 01:11:16.419685 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:11:16.419685 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:11:16.419685 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 15cf44b2cdc345a883125e0522ccf08f Oct 23 01:11:16.419685 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-AggregatesAdminTestJSON-507603983-project-admin Oct 23 01:11:16.419685 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:11:16.419685 n-d-master-1 devstack@n-api.service[120945]: exception: Aggregate 14 could not be found. Oct 23 01:11:16.419685 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '14'} Oct 23 01:11:16.419685 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:11:16.420634 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:16.420634 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 23 01:11:16.420634 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 23 01:11:16.420634 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 23 01:11:16.420634 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 23 01:11:16.420634 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 01:11:16.420634 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 01:11:16.420634 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 23 01:11:16.420634 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 23 01:11:16.420634 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 23 01:11:16.420634 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 23 01:11:16.420634 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 23 01:11:16.420634 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 23 01:11:16.420634 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Oct 23 01:11:16.420634 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:16.420634 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:11:16.420634 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:16.420634 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:16.420634 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:16.421936 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:16.421936 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:11:16.421936 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:11:16.421936 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:11:16.421936 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:11:16.421936 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 23 01:11:16.421936 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:11:16.421936 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Oct 23 01:11:16.421936 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:16.421936 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:11:16.421936 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:16.421936 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:16.421936 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:16.421936 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:16.421936 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:11:16.421936 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:11:16.421936 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Oct 23 01:11:16.421936 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:16.425786 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a5fc0e44-68da-4493-935e-ea87acbaf672 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:11:16.428195 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a5fc0e44-68da-4493-935e-ea87acbaf672 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] 10.222.0.42 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.062990 Oct 23 01:11:16.433722 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 149/252] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Oct 23 01:11:16 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:11:16.448482 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6250c73f-ebd0-4c91-97d6-f83e324f8c2c tempest-AggregatesAdminNegativeTestJSON-1610882433 tempest-AggregatesAdminNegativeTestJSON-1610882433-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:16.468504 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6250c73f-ebd0-4c91-97d6-f83e324f8c2c tempest-AggregatesAdminNegativeTestJSON-1610882433 tempest-AggregatesAdminNegativeTestJSON-1610882433-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '34675ffa7f9f4e76bad646189402680c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8c9aca8184f35a7b6f80eea34b649', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:16.470772 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6250c73f-ebd0-4c91-97d6-f83e324f8c2c tempest-AggregatesAdminNegativeTestJSON-1610882433 tempest-AggregatesAdminNegativeTestJSON-1610882433-project] Request method failure captured: Oct 23 01:11:16.470772 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Oct 23 01:11:16.470772 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:11:16.470772 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:11:16.470772 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:11:16.470772 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 42 Oct 23 01:11:16.470772 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:11:16.470772 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:11:16.470772 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:11:16.470772 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:11:16.470772 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJR3Zl2BtzKGwwhxnKOkL3SBwPh6K1bBDXmmD4Fw2D9__OVip2GwIqaGm1CTez-CDx9B-NJLhLu9q1X0SBx0ha3VvkDzyf4xbFkysFI0EGNOfN9iTe-b4dZ-0yhw5LeWMcz3MBCuq6EDlExMyx8DTw1tSX2ydpTVLNYqnZkJ7ORgKCM Oct 23 01:11:16.470772 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:11:16.470772 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:11:16.470772 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:11:16.470772 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:11:16.470772 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:11:16.470772 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:11:16.470772 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: f5e8c9aca8184f35a7b6f80eea34b649 Oct 23 01:11:16.470772 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1610882433 Oct 23 01:11:16.470772 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:11:16.470772 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:11:16.472273 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f5e8c9aca8184f35a7b6f80eea34b649"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f5e8c9aca8184f35a7b6f80eea34b649"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f5e8c9aca8184f35a7b6f80eea34b649"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f5e8c9aca8184f35a7b6f80eea34b649"}]}] Oct 23 01:11:16.472273 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1610882433 Oct 23 01:11:16.472273 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: f5e8c9aca8184f35a7b6f80eea34b649 Oct 23 01:11:16.472273 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1610882433 Oct 23 01:11:16.472273 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-AggregatesAdminNegativeTestJSON-1610882433-project Oct 23 01:11:16.472273 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:11:16.472273 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:11:16.472273 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 34675ffa7f9f4e76bad646189402680c Oct 23 01:11:16.472273 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1610882433-project Oct 23 01:11:16.472273 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:11:16.472273 n-d-master-1 devstack@n-api.service[120945]: {"remove_host": {"host": "n-h1-master-1"}} Oct 23 01:11:16.472273 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:11:16.472273 n-d-master-1 devstack@n-api.service[120945]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 23 01:11:16.473165 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '13', 'body': {'remove_host': {'host': 'n-h1-master-1'}}} Oct 23 01:11:16.473165 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:11:16.473165 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:16.473165 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:16.473165 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:16.473165 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:11:16.473165 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:11:16.473165 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:11:16.473165 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:11:16.473165 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:11:16.473165 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:11:16.473165 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 23 01:11:16.473165 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 23 01:11:16.473165 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 23 01:11:16.473165 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 23 01:11:16.473165 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 23 01:11:16.473165 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 23 01:11:16.473165 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:11:16.473165 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 23 01:11:16.475302 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:11:16.475302 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise self.value Oct 23 01:11:16.475302 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 23 01:11:16.475302 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 23 01:11:16.475302 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 23 01:11:16.475302 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 23 01:11:16.475302 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 23 01:11:16.475302 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 23 01:11:16.475302 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 23 01:11:16.475302 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:16.475302 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:11:16.475302 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:16.475302 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:16.475302 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:16.475302 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:16.475302 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 23 01:11:16.475302 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 23 01:11:16.475302 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 23 01:11:16.475302 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:16.478764 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6250c73f-ebd0-4c91-97d6-f83e324f8c2c tempest-AggregatesAdminNegativeTestJSON-1610882433 tempest-AggregatesAdminNegativeTestJSON-1610882433-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:11:16.481905 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6250c73f-ebd0-4c91-97d6-f83e324f8c2c tempest-AggregatesAdminNegativeTestJSON-1610882433 tempest-AggregatesAdminNegativeTestJSON-1610882433-project] 10.222.0.42 "POST /compute/v2.1/os-aggregates/13/action" status: 403 len: 121 microversion: 2.1 time: 0.046960 Oct 23 01:11:16.483783 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 150/253] 10.222.0.42 () {60 vars in 1194 bytes} [Sun Oct 23 01:11:16 2022] POST /compute/v2.1/os-aggregates/13/action => generated 121 bytes in 49 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:11:16.502438 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-766e2b76-1a34-495b-839b-ba44e260a1b2 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:16.539017 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-766e2b76-1a34-495b-839b-ba44e260a1b2 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Oct 23 01:11:16.540705 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-766e2b76-1a34-495b-839b-ba44e260a1b2 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Request method failure captured: Oct 23 01:11:16.540705 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Oct 23 01:11:16.540705 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:11:16.540705 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:11:16.540705 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:11:16.540705 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:11:16.540705 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:11:16.540705 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:11:16.540705 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:11:16.540705 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:11:16.540705 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJR5PKn71nEQisVO1mvf2IKxRF8M0Sjcv1licXQqFhPYTAK1zUVS6TGJ0Jl64lK9SVSxgKSRbgQKQP19Q0sm5tCmtwEHAWkuTAJsK9OuDqvCkANxGmSw0nOjIMUYQWzfl1mXgHXuuTCDSeo4XUeNDC2ERvLq44JWgQMDdA5RWynqkRk Oct 23 01:11:16.540705 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:11:16.540705 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:11:16.540705 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:11:16.540705 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:11:16.540705 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:11:16.540705 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:11:16.540705 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: f7c3e6bcb228428aaf1ddbb2dda3af25 Oct 23 01:11:16.540705 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-AggregatesAdminTestJSON-507603983 Oct 23 01:11:16.540705 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,admin,reader Oct 23 01:11:16.540705 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,admin,reader Oct 23 01:11:16.542981 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f7c3e6bcb228428aaf1ddbb2dda3af25"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f7c3e6bcb228428aaf1ddbb2dda3af25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f7c3e6bcb228428aaf1ddbb2dda3af25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f7c3e6bcb228428aaf1ddbb2dda3af25"}]}] Oct 23 01:11:16.542981 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-AggregatesAdminTestJSON-507603983 Oct 23 01:11:16.542981 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: f7c3e6bcb228428aaf1ddbb2dda3af25 Oct 23 01:11:16.542981 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-507603983 Oct 23 01:11:16.542981 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-AggregatesAdminTestJSON-507603983-project-admin Oct 23 01:11:16.542981 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:11:16.542981 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:11:16.542981 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 15cf44b2cdc345a883125e0522ccf08f Oct 23 01:11:16.542981 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-AggregatesAdminTestJSON-507603983-project-admin Oct 23 01:11:16.542981 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:11:16.542981 n-d-master-1 devstack@n-api.service[120945]: exception: Aggregate 14 could not be found. Oct 23 01:11:16.542981 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '14'} Oct 23 01:11:16.542981 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:11:16.543940 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:16.543940 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 23 01:11:16.543940 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 23 01:11:16.543940 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 23 01:11:16.543940 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 23 01:11:16.543940 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:11:16.543940 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 23 01:11:16.543940 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:11:16.543940 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise self.value Oct 23 01:11:16.543940 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 23 01:11:16.543940 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 23 01:11:16.543940 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 23 01:11:16.543940 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 23 01:11:16.543940 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 01:11:16.543940 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 01:11:16.543940 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 23 01:11:16.543940 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 23 01:11:16.543940 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 23 01:11:16.543940 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 23 01:11:16.545315 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 23 01:11:16.545315 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 23 01:11:16.545315 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Oct 23 01:11:16.545315 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:16.545315 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:11:16.545315 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:16.545315 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:16.545315 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:16.545315 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:16.545315 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:11:16.545315 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:11:16.545315 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:11:16.545315 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:11:16.545315 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 23 01:11:16.545315 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:11:16.545315 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Oct 23 01:11:16.545315 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:16.545315 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:11:16.545315 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:16.545315 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:16.545315 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:16.548045 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:16.548045 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:11:16.548045 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:11:16.548045 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Oct 23 01:11:16.548045 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:16.548045 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-766e2b76-1a34-495b-839b-ba44e260a1b2 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:11:16.550622 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-766e2b76-1a34-495b-839b-ba44e260a1b2 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.061509 Oct 23 01:11:16.551826 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 151/254] 10.222.0.42 () {58 vars in 1155 bytes} [Sun Oct 23 01:11:16 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:11:16.560566 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fc25b83e-8194-46a9-af72-2b9b2f333ed1 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:16.563179 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-fc25b83e-8194-46a9-af72-2b9b2f333ed1 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] [instance: ce463295-4ce8-4df9-b8a2-f9388229a3c3] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:16.573584 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc25b83e-8194-46a9-af72-2b9b2f333ed1 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:16.574339 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc25b83e-8194-46a9-af72-2b9b2f333ed1 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:16.574925 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc25b83e-8194-46a9-af72-2b9b2f333ed1 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:16.575882 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc25b83e-8194-46a9-af72-2b9b2f333ed1 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:16.577343 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc25b83e-8194-46a9-af72-2b9b2f333ed1 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:16.577801 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc25b83e-8194-46a9-af72-2b9b2f333ed1 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:16.644667 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2ee9b266-6927-4769-8009-d4d002a3abe9 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e535f9274b24a9f800ea0c3d8faba5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b8e89ba0a14188bac8e28b66b5a197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:16.657541 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2ee9b266-6927-4769-8009-d4d002a3abe9 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "GET /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb" status: 200 len: 1390 microversion: 2.1 time: 0.430561 Oct 23 01:11:16.670029 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 104/255] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:16 2022] GET /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb => generated 1390 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:16.674639 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-124d28ad-53ac-4971-95b7-12bd94648fa9 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:16.698293 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-124d28ad-53ac-4971-95b7-12bd94648fa9 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:16.698818 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-124d28ad-53ac-4971-95b7-12bd94648fa9 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:16.699263 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-124d28ad-53ac-4971-95b7-12bd94648fa9 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:16.829255 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-fc25b83e-8194-46a9-af72-2b9b2f333ed1 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec43833fb4d646ab9f26d425cdb0b694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa16b9c333c42ff8860639c213453c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:16.840392 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fc25b83e-8194-46a9-af72-2b9b2f333ed1 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] 10.222.0.42 "GET /compute/v2.1/servers/ce463295-4ce8-4df9-b8a2-f9388229a3c3" status: 200 len: 1323 microversion: 2.1 time: 0.286973 Oct 23 01:11:16.841472 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 152/256] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:16 2022] GET /compute/v2.1/servers/ce463295-4ce8-4df9-b8a2-f9388229a3c3 => generated 1323 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:16.861599 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3776a17e-3a77-4b3f-b9df-44f65fd25ddf tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-200626290"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:16.868307 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.aggregate [None req-3776a17e-3a77-4b3f-b9df-44f65fd25ddf tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Generated uuid 5096c424-aea3-4c4a-bae0-7a6d2f4614f4 for aggregate {{(pid=120945) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 23 01:11:17.067164 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3776a17e-3a77-4b3f-b9df-44f65fd25ddf tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.224367 Oct 23 01:11:17.077670 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 153/257] 10.222.0.42 () {60 vars in 1164 bytes} [Sun Oct 23 01:11:16 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:17.077670 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d016c408-4bce-4a63-9560-120cfda12eb1 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Calling method '.version_select at 0x7f5cc2829f70>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:17.232458 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-124d28ad-53ac-4971-95b7-12bd94648fa9 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 228 microversion: 2.1 time: 0.569137 Oct 23 01:11:17.240677 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 105/258] 10.222.0.42 () {60 vars in 1194 bytes} [Sun Oct 23 01:11:16 2022] POST /compute/v2.1/os-aggregates/13/action => generated 228 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:17.244845 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a99ab805-f1f0-4506-bd78-0412f63cadb5 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:17.272646 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a99ab805-f1f0-4506-bd78-0412f63cadb5 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] 10.222.0.42 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 227 microversion: 2.1 time: 0.036826 Oct 23 01:11:17.273226 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 106/259] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Oct 23 01:11:17 2022] GET /compute/v2.1/os-aggregates/15 => generated 227 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:17.282566 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ac2d9231-79d1-4c72-9140-fb0be422c176 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:17.328700 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=7,nova_api:DELETE=8 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:17.439559 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ac2d9231-79d1-4c72-9140-fb0be422c176 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.161941 Oct 23 01:11:17.445899 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 107/260] 10.222.0.42 () {58 vars in 1155 bytes} [Sun Oct 23 01:11:17 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 23 01:11:17.453452 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8f7831a7-5215-4654-a1b2-374043c76249 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:17.501349 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d016c408-4bce-4a63-9560-120cfda12eb1 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/c7cff3fb8aab4d0eb2b247cae880ba27/defaults" status: 200 len: 371 microversion: 2.1 time: 0.428174 Oct 23 01:11:17.502063 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 154/261] 10.222.0.42 () {58 vars in 1269 bytes} [Sun Oct 23 01:11:17 2022] GET /compute/v2.1/os-quota-sets/c7cff3fb8aab4d0eb2b247cae880ba27/defaults => generated 371 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:17.513252 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-841a970f-12b1-4a2b-8a5c-6cb8719aa10a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:17.513949 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-841a970f-12b1-4a2b-8a5c-6cb8719aa10a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 26043446-8442-4d38-98d8-6ff9a1432d1b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:17.528906 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-841a970f-12b1-4a2b-8a5c-6cb8719aa10a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:17.529409 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-841a970f-12b1-4a2b-8a5c-6cb8719aa10a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:17.535037 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-841a970f-12b1-4a2b-8a5c-6cb8719aa10a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:17.535941 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-841a970f-12b1-4a2b-8a5c-6cb8719aa10a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:17.536433 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-841a970f-12b1-4a2b-8a5c-6cb8719aa10a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:17.536877 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-841a970f-12b1-4a2b-8a5c-6cb8719aa10a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:17.604287 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8f7831a7-5215-4654-a1b2-374043c76249 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/15/action" status: 200 len: 265 microversion: 2.1 time: 0.161065 Oct 23 01:11:17.605140 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 108/262] 10.222.0.42 () {60 vars in 1194 bytes} [Sun Oct 23 01:11:17 2022] POST /compute/v2.1/os-aggregates/15/action => generated 265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:17.613830 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a4105627-7d7e-4d38-a0aa-1ddc12c7a7c7 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2137606294"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:17.622794 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-841a970f-12b1-4a2b-8a5c-6cb8719aa10a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:17.628167 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.aggregate [None req-a4105627-7d7e-4d38-a0aa-1ddc12c7a7c7 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Generated uuid 73cfda55-a8ac-4249-a004-b5acf94bfb48 for aggregate {{(pid=120944) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 23 01:11:17.634532 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-841a970f-12b1-4a2b-8a5c-6cb8719aa10a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b" status: 200 len: 1262 microversion: 2.1 time: 0.131169 Oct 23 01:11:17.635120 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 155/263] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:17 2022] GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b => generated 1262 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:17.644913 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5eddb25f-3cd0-4efd-8fca-81fcfb9d286d tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Action: 'update', calling method: .version_select at 0x7f5cc29d8670>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:17.721700 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a4105627-7d7e-4d38-a0aa-1ddc12c7a7c7 tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.115212 Oct 23 01:11:17.732891 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 109/264] 10.222.0.42 () {60 vars in 1164 bytes} [Sun Oct 23 01:11:17 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:17.737842 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-abab958d-9225-445c-b67e-539de4f4e675 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:17.752938 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-abab958d-9225-445c-b67e-539de4f4e675 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] 10.222.0.42 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 241 microversion: 2.1 time: 0.025317 Oct 23 01:11:17.754115 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 110/265] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Oct 23 01:11:17 2022] GET /compute/v2.1/os-aggregates/15 => generated 241 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:17.759543 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-db91000a-3d1d-41ab-a641-dc68f64eaa31 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:17.762559 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-db91000a-3d1d-41ab-a641-dc68f64eaa31 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:17.787948 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-db91000a-3d1d-41ab-a641-dc68f64eaa31 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:17.788737 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-db91000a-3d1d-41ab-a641-dc68f64eaa31 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:17.789564 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-db91000a-3d1d-41ab-a641-dc68f64eaa31 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:17.791107 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-db91000a-3d1d-41ab-a641-dc68f64eaa31 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:17.791948 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-db91000a-3d1d-41ab-a641-dc68f64eaa31 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:17.793080 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-db91000a-3d1d-41ab-a641-dc68f64eaa31 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:17.800230 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5eddb25f-3cd0-4efd-8fca-81fcfb9d286d tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:17.800230 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5eddb25f-3cd0-4efd-8fca-81fcfb9d286d tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:17.800230 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5eddb25f-3cd0-4efd-8fca-81fcfb9d286d tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:17.800230 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5eddb25f-3cd0-4efd-8fca-81fcfb9d286d tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:17.800565 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5eddb25f-3cd0-4efd-8fca-81fcfb9d286d tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:17.800565 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5eddb25f-3cd0-4efd-8fca-81fcfb9d286d tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:18.092026 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-db91000a-3d1d-41ab-a641-dc68f64eaa31 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e535f9274b24a9f800ea0c3d8faba5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b8e89ba0a14188bac8e28b66b5a197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:18.108516 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-db91000a-3d1d-41ab-a641-dc68f64eaa31 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "GET /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb" status: 200 len: 1390 microversion: 2.1 time: 0.350520 Oct 23 01:11:18.108516 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 111/266] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:17 2022] GET /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb => generated 1390 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:18.508260 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ea03d947-5648-474d-a93a-6098fc325cfe tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1569498145", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "8713ad73-3551-4e4e-a4b5-06c9d1b5b4bf"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:18.591034 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-ea03d947-5648-474d-a93a-6098fc325cfe tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] validate_networks() for [('8713ad73-3551-4e4e-a4b5-06c9d1b5b4bf', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:11:19.082078 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=17,nova_api:DELETE=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:19.256216 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-ea03d947-5648-474d-a93a-6098fc325cfe tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:11:19.256745 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-ea03d947-5648-474d-a93a-6098fc325cfe tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:11:19.260289 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-ea03d947-5648-474d-a93a-6098fc325cfe tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:11:19.260289 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-ea03d947-5648-474d-a93a-6098fc325cfe tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:11:19.260289 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-ea03d947-5648-474d-a93a-6098fc325cfe tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:11:19.272474 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ea03d947-5648-474d-a93a-6098fc325cfe tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:19.273445 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ea03d947-5648-474d-a93a-6098fc325cfe tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:19.273880 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ea03d947-5648-474d-a93a-6098fc325cfe tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:19.275014 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ea03d947-5648-474d-a93a-6098fc325cfe tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:19.275464 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ea03d947-5648-474d-a93a-6098fc325cfe tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:19.280448 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ea03d947-5648-474d-a93a-6098fc325cfe tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:19.314494 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-ea03d947-5648-474d-a93a-6098fc325cfe tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Getting quotas for project b7864a40d26e402d815d39ef0c0f91a1. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:11:19.328895 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-ea03d947-5648-474d-a93a-6098fc325cfe tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Getting quotas for user 74c84b03f3f8431e9d3c0cbb792aeaf9 and project b7864a40d26e402d815d39ef0c0f91a1. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:11:19.343863 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ea03d947-5648-474d-a93a-6098fc325cfe tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:11:19.345828 n-d-master-1 devstack@n-api.service[120944]: WARNING nova.utils [None req-ea03d947-5648-474d-a93a-6098fc325cfe tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1569498145 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-156949814 Oct 23 01:11:19.346677 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ea03d947-5648-474d-a93a-6098fc325cfe tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] [instance: 9bb5ab44-057e-4115-a477-602ef6feece3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:11:19.402464 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5eddb25f-3cd0-4efd-8fca-81fcfb9d286d tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-sets/c7cff3fb8aab4d0eb2b247cae880ba27" status: 200 len: 329 microversion: 2.1 time: 1.763652 Oct 23 01:11:19.403110 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 156/267] 10.222.0.42 () {60 vars in 1263 bytes} [Sun Oct 23 01:11:17 2022] PUT /compute/v2.1/os-quota-sets/c7cff3fb8aab4d0eb2b247cae880ba27 => generated 329 bytes in 1765 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:19.411121 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-09efafcf-9b6e-4a60-bd54-3385f7cc7e7d tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:19.426563 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09efafcf-9b6e-4a60-bd54-3385f7cc7e7d tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:19.427180 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09efafcf-9b6e-4a60-bd54-3385f7cc7e7d tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:19.427644 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09efafcf-9b6e-4a60-bd54-3385f7cc7e7d tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:19.438720 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09efafcf-9b6e-4a60-bd54-3385f7cc7e7d tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:19.441481 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09efafcf-9b6e-4a60-bd54-3385f7cc7e7d tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:19.441481 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09efafcf-9b6e-4a60-bd54-3385f7cc7e7d tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:19.451308 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.compute.aggregates [None req-09efafcf-9b6e-4a60-bd54-3385f7cc7e7d tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Failed to remove host nonexist_host from aggregate 16. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 23 01:11:19.452115 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-09efafcf-9b6e-4a60-bd54-3385f7cc7e7d tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 16 Oct 23 01:11:19.454524 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-09efafcf-9b6e-4a60-bd54-3385f7cc7e7d tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Request method failure captured: Oct 23 01:11:19.454524 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/os-aggregates/16/action HTTP/1.1 Oct 23 01:11:19.454524 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:11:19.454524 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:11:19.454524 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:11:19.454524 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 42 Oct 23 01:11:19.454524 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:11:19.454524 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:11:19.454524 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:11:19.454524 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:11:19.454524 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJR6uWpBWdYCU3FR3UdoEx-fMaz2UGR5pio_u8SLfmmO-xfXencIRstHwi_Dw1PfAe0x1eMlxmZ6THsATqCgMSh9GyYyHR4KIJavXyOEvOQW15VbBizjWDSEpnZfpOpsyayKQQRznHbCGxQs1k0NC8h-UgwtBKrA40pVUR9jzpGlGvk Oct 23 01:11:19.454524 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:11:19.454524 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:11:19.454524 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:11:19.454524 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:11:19.454524 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:11:19.454524 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:11:19.454524 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 24682a566a714ef586033a6e2992e4e4 Oct 23 01:11:19.454524 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-223261651 Oct 23 01:11:19.454524 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,admin,reader Oct 23 01:11:19.454524 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,admin,reader Oct 23 01:11:19.456045 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/24682a566a714ef586033a6e2992e4e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_24682a566a714ef586033a6e2992e4e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/24682a566a714ef586033a6e2992e4e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/24682a566a714ef586033a6e2992e4e4"}]}] Oct 23 01:11:19.456045 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-223261651 Oct 23 01:11:19.456045 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 24682a566a714ef586033a6e2992e4e4 Oct 23 01:11:19.456045 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-223261651 Oct 23 01:11:19.456045 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin Oct 23 01:11:19.456045 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:11:19.456045 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:11:19.456045 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: a997cd84907845e2a0df8ae40a0fd4bf Oct 23 01:11:19.456045 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin Oct 23 01:11:19.456045 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:11:19.456045 n-d-master-1 devstack@n-api.service[120945]: {"remove_host": {"host": "nonexist_host"}} Oct 23 01:11:19.456045 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:11:19.456045 n-d-master-1 devstack@n-api.service[120945]: exception: Cannot remove host nonexist_host in aggregate 16 Oct 23 01:11:19.456961 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '16', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 23 01:11:19.456961 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:11:19.456961 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:19.456961 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 23 01:11:19.456961 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 23 01:11:19.456961 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 01:11:19.456961 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 01:11:19.456961 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 23 01:11:19.456961 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 23 01:11:19.456961 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 23 01:11:19.456961 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 23 01:11:19.456961 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 23 01:11:19.456961 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 23 01:11:19.456961 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 23 01:11:19.456961 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:19.456961 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:11:19.456961 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:19.456961 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:19.456961 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 23 01:11:19.456961 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 23 01:11:19.458459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 23 01:11:19.458459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 23 01:11:19.458459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 23 01:11:19.458459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:19.458459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:11:19.458459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:19.458459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:19.458459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 23 01:11:19.458459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 23 01:11:19.458459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 23 01:11:19.458459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 23 01:11:19.458459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:11:19.458459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 23 01:11:19.458459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:11:19.458459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise self.value Oct 23 01:11:19.458459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 23 01:11:19.458459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 23 01:11:19.458459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 23 01:11:19.458459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 23 01:11:19.458459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 23 01:11:19.461366 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 23 01:11:19.461366 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 23 01:11:19.461366 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:19.461366 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:11:19.461366 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:19.461366 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:19.461366 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:19.461366 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:19.461366 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:11:19.461366 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:11:19.461366 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:11:19.461366 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:11:19.461366 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:11:19.461366 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:11:19.461366 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 23 01:11:19.461366 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 23 01:11:19.461366 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 16 Oct 23 01:11:19.461366 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:19.461366 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:11:19.461366 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:19.461366 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:19.465796 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:19.465796 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:19.465796 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:11:19.465796 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:11:19.465796 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 16 Oct 23 01:11:19.465796 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:19.465796 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-09efafcf-9b6e-4a60-bd54-3385f7cc7e7d tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 16 {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:11:19.467740 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-09efafcf-9b6e-4a60-bd54-3385f7cc7e7d tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/16/action" status: 404 len: 94 microversion: 2.1 time: 0.059685 Oct 23 01:11:19.469326 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 157/268] 10.222.0.42 () {60 vars in 1194 bytes} [Sun Oct 23 01:11:19 2022] POST /compute/v2.1/os-aggregates/16/action => generated 94 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:11:19.476069 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-246b77a2-5af7-472d-90d4-d6a64c4d062b tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:19.543561 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ea03d947-5648-474d-a93a-6098fc325cfe tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.420009 Oct 23 01:11:19.550155 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 112/269] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:11:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1437 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:11:19.550728 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2ec0a51d-fe25-46b4-8f4f-bac6a2e1d2db tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:19.556317 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2ec0a51d-fe25-46b4-8f4f-bac6a2e1d2db tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] [instance: ce463295-4ce8-4df9-b8a2-f9388229a3c3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:19.564538 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2ec0a51d-fe25-46b4-8f4f-bac6a2e1d2db tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:19.565039 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2ec0a51d-fe25-46b4-8f4f-bac6a2e1d2db tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:19.576125 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2ec0a51d-fe25-46b4-8f4f-bac6a2e1d2db tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:19.577485 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2ec0a51d-fe25-46b4-8f4f-bac6a2e1d2db tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:19.578210 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2ec0a51d-fe25-46b4-8f4f-bac6a2e1d2db tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:19.578414 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2ec0a51d-fe25-46b4-8f4f-bac6a2e1d2db tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:19.601488 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-246b77a2-5af7-472d-90d4-d6a64c4d062b tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.130797 Oct 23 01:11:19.606438 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 158/270] 10.222.0.42 () {58 vars in 1155 bytes} [Sun Oct 23 01:11:19 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 23 01:11:19.614515 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-db4272d5-3d71-4ebd-8cbf-917ce02b3119 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:19.615344 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-db4272d5-3d71-4ebd-8cbf-917ce02b3119 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 26043446-8442-4d38-98d8-6ff9a1432d1b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:19.624307 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-db4272d5-3d71-4ebd-8cbf-917ce02b3119 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:19.625076 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-db4272d5-3d71-4ebd-8cbf-917ce02b3119 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:19.626278 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-db4272d5-3d71-4ebd-8cbf-917ce02b3119 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:19.628711 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-db4272d5-3d71-4ebd-8cbf-917ce02b3119 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:19.631349 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-db4272d5-3d71-4ebd-8cbf-917ce02b3119 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:19.631965 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-db4272d5-3d71-4ebd-8cbf-917ce02b3119 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:19.637509 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=100 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:20.164988 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-db4272d5-3d71-4ebd-8cbf-917ce02b3119 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:20.174337 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-db4272d5-3d71-4ebd-8cbf-917ce02b3119 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b" status: 200 len: 1310 microversion: 2.1 time: 0.569495 Oct 23 01:11:20.182217 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2ec0a51d-fe25-46b4-8f4f-bac6a2e1d2db tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec43833fb4d646ab9f26d425cdb0b694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa16b9c333c42ff8860639c213453c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:20.185873 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 159/271] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:19 2022] GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b => generated 1310 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:20.195703 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-007b5ffc-5758-4633-872f-ae2f0832b393 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:20.196546 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-007b5ffc-5758-4633-872f-ae2f0832b393 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:20.202719 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2ec0a51d-fe25-46b4-8f4f-bac6a2e1d2db tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] 10.222.0.42 "GET /compute/v2.1/servers/ce463295-4ce8-4df9-b8a2-f9388229a3c3" status: 200 len: 1323 microversion: 2.1 time: 0.655712 Oct 23 01:11:20.203702 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 113/272] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:19 2022] GET /compute/v2.1/servers/ce463295-4ce8-4df9-b8a2-f9388229a3c3 => generated 1323 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:20.206126 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-007b5ffc-5758-4633-872f-ae2f0832b393 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:20.206623 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-007b5ffc-5758-4633-872f-ae2f0832b393 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:20.207094 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-007b5ffc-5758-4633-872f-ae2f0832b393 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:20.207790 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-007b5ffc-5758-4633-872f-ae2f0832b393 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:20.208244 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-007b5ffc-5758-4633-872f-ae2f0832b393 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:20.208663 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-007b5ffc-5758-4633-872f-ae2f0832b393 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:20.211928 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9d374eb0-ee8b-4225-850f-1e0d1b66e02d tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Action: 'update', calling method: .version_select at 0x7f5cc29a8f70>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:20.418149 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-007b5ffc-5758-4633-872f-ae2f0832b393 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e535f9274b24a9f800ea0c3d8faba5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b8e89ba0a14188bac8e28b66b5a197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:20.427909 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-007b5ffc-5758-4633-872f-ae2f0832b393 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "GET /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb" status: 200 len: 1390 microversion: 2.1 time: 0.238687 Oct 23 01:11:20.430026 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 160/273] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:20 2022] GET /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb => generated 1390 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:20.439048 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-496e352a-bdc1-4823-af52-8e3a97f882fc tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:20.622408 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-496e352a-bdc1-4823-af52-8e3a97f882fc tempest-AggregatesAdminNegativeTestJSON-223261651 tempest-AggregatesAdminNegativeTestJSON-223261651-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.191274 Oct 23 01:11:20.631271 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 161/274] 10.222.0.42 () {58 vars in 1155 bytes} [Sun Oct 23 01:11:20 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 23 01:11:20.645919 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-44085e80-caf8-46d6-84ab-8c87feddf2ef tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:20.649084 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=51 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:20.653189 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-44085e80-caf8-46d6-84ab-8c87feddf2ef tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] [instance: 9bb5ab44-057e-4115-a477-602ef6feece3] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:20.671768 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9d374eb0-ee8b-4225-850f-1e0d1b66e02d tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:20.671768 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9d374eb0-ee8b-4225-850f-1e0d1b66e02d tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:20.671768 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9d374eb0-ee8b-4225-850f-1e0d1b66e02d tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:20.674621 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9d374eb0-ee8b-4225-850f-1e0d1b66e02d tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:20.679262 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9d374eb0-ee8b-4225-850f-1e0d1b66e02d tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:20.681707 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9d374eb0-ee8b-4225-850f-1e0d1b66e02d tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:20.828116 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-44085e80-caf8-46d6-84ab-8c87feddf2ef tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c84b03f3f8431e9d3c0cbb792aeaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7864a40d26e402d815d39ef0c0f91a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:20.836857 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-44085e80-caf8-46d6-84ab-8c87feddf2ef tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] 10.222.0.42 "GET /compute/v2.1/servers/9bb5ab44-057e-4115-a477-602ef6feece3" status: 200 len: 1232 microversion: 2.1 time: 0.204233 Oct 23 01:11:20.838736 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 162/275] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:20 2022] GET /compute/v2.1/servers/9bb5ab44-057e-4115-a477-602ef6feece3 => generated 1232 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:20.859352 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-de9a7134-f404-4f02-862a-63d60fa9e2f8 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1939356046", "availability_zone": "tempest-test_az-1577126014"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:20.863197 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.aggregate [None req-de9a7134-f404-4f02-862a-63d60fa9e2f8 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Generated uuid aae58dd5-3639-4fb7-a271-487ede79f8a5 for aggregate {{(pid=120945) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 23 01:11:21.036295 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-de9a7134-f404-4f02-862a-63d60fa9e2f8 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.192198 Oct 23 01:11:21.043543 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 163/276] 10.222.0.42 () {60 vars in 1165 bytes} [Sun Oct 23 01:11:20 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:21.043543 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-ea77ff50-991b-47d6-9107-b06c7d3ba49d req-377e3e34-94cc-4b1e-8b56-b2697151d910 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce463295-4ce8-4df9-b8a2-f9388229a3c3", "name": "network-vif-plugged", "status": "completed", "tag": "83d2ae7a-86a5-49fc-a7a2-a8e5188de127"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:21.054803 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ea77ff50-991b-47d6-9107-b06c7d3ba49d req-377e3e34-94cc-4b1e-8b56-b2697151d910 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:21.055504 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ea77ff50-991b-47d6-9107-b06c7d3ba49d req-377e3e34-94cc-4b1e-8b56-b2697151d910 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:21.055945 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ea77ff50-991b-47d6-9107-b06c7d3ba49d req-377e3e34-94cc-4b1e-8b56-b2697151d910 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:21.068380 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-ea77ff50-991b-47d6-9107-b06c7d3ba49d req-377e3e34-94cc-4b1e-8b56-b2697151d910 service nova] Creating event network-vif-plugged:83d2ae7a-86a5-49fc-a7a2-a8e5188de127 for instance ce463295-4ce8-4df9-b8a2-f9388229a3c3 on n-h1-master-1 Oct 23 01:11:21.075075 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-ea77ff50-991b-47d6-9107-b06c7d3ba49d req-377e3e34-94cc-4b1e-8b56-b2697151d910 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036405 Oct 23 01:11:21.076128 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 164/277] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:21.081965 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-19ff1d86-3bda-4086-a302-b649b6c411cf tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1939356046_new", "availability_zone": "tempest-test_az-1577126014_new"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:21.352804 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-19ff1d86-3bda-4086-a302-b649b6c411cf tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:21.354946 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-19ff1d86-3bda-4086-a302-b649b6c411cf tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:21.356236 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-19ff1d86-3bda-4086-a302-b649b6c411cf tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:21.578911 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-19ff1d86-3bda-4086-a302-b649b6c411cf tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 337 microversion: 2.1 time: 0.501146 Oct 23 01:11:21.579811 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 165/278] 10.222.0.42 () {60 vars in 1173 bytes} [Sun Oct 23 01:11:21 2022] PUT /compute/v2.1/os-aggregates/17 => generated 337 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:21.595381 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-bcb4bb74-db89-40f6-bde7-8178cfd8415e req-68579bc7-2ca9-425c-bbe4-fe8db8c7d7f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26043446-8442-4d38-98d8-6ff9a1432d1b", "tag": "4a1925fc-3024-45ea-be46-b952667a8883"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:21.616914 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-bcb4bb74-db89-40f6-bde7-8178cfd8415e req-68579bc7-2ca9-425c-bbe4-fe8db8c7d7f2 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:21.617711 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-bcb4bb74-db89-40f6-bde7-8178cfd8415e req-68579bc7-2ca9-425c-bbe4-fe8db8c7d7f2 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:21.618412 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-bcb4bb74-db89-40f6-bde7-8178cfd8415e req-68579bc7-2ca9-425c-bbe4-fe8db8c7d7f2 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:21.629660 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-bcb4bb74-db89-40f6-bde7-8178cfd8415e req-68579bc7-2ca9-425c-bbe4-fe8db8c7d7f2 service nova] Creating event network-changed:4a1925fc-3024-45ea-be46-b952667a8883 for instance 26043446-8442-4d38-98d8-6ff9a1432d1b on n-h1-master-1 Oct 23 01:11:21.636320 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-bcb4bb74-db89-40f6-bde7-8178cfd8415e req-68579bc7-2ca9-425c-bbe4-fe8db8c7d7f2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054794 Oct 23 01:11:21.637119 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 166/279] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:21.647023 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-df6489b0-2987-4363-a493-c930b7542e49 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:21.647847 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-df6489b0-2987-4363-a493-c930b7542e49 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 26043446-8442-4d38-98d8-6ff9a1432d1b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:21.655517 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-df6489b0-2987-4363-a493-c930b7542e49 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:21.656306 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-df6489b0-2987-4363-a493-c930b7542e49 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:21.657015 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-df6489b0-2987-4363-a493-c930b7542e49 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:21.658007 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-df6489b0-2987-4363-a493-c930b7542e49 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:21.658655 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-df6489b0-2987-4363-a493-c930b7542e49 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:21.659082 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-df6489b0-2987-4363-a493-c930b7542e49 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:21.832331 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-df6489b0-2987-4363-a493-c930b7542e49 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:21.841616 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-df6489b0-2987-4363-a493-c930b7542e49 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b" status: 200 len: 1310 microversion: 2.1 time: 0.198739 Oct 23 01:11:21.843873 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 167/280] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:21 2022] GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b => generated 1310 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:21.849091 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a956001e-8a83-4c36-826f-8f4362d61af5 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:21.849707 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a956001e-8a83-4c36-826f-8f4362d61af5 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] [instance: ce463295-4ce8-4df9-b8a2-f9388229a3c3] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:21.856066 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a956001e-8a83-4c36-826f-8f4362d61af5 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:21.856558 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a956001e-8a83-4c36-826f-8f4362d61af5 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:21.857342 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a956001e-8a83-4c36-826f-8f4362d61af5 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:21.858588 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a956001e-8a83-4c36-826f-8f4362d61af5 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:21.859238 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a956001e-8a83-4c36-826f-8f4362d61af5 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:21.859851 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a956001e-8a83-4c36-826f-8f4362d61af5 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:22.073425 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a956001e-8a83-4c36-826f-8f4362d61af5 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec43833fb4d646ab9f26d425cdb0b694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa16b9c333c42ff8860639c213453c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:22.082102 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a956001e-8a83-4c36-826f-8f4362d61af5 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] 10.222.0.42 "GET /compute/v2.1/servers/ce463295-4ce8-4df9-b8a2-f9388229a3c3" status: 200 len: 1323 microversion: 2.1 time: 0.237060 Oct 23 01:11:22.094397 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 168/281] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:21 2022] GET /compute/v2.1/servers/ce463295-4ce8-4df9-b8a2-f9388229a3c3 => generated 1323 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:22.103892 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b129165d-ff5a-40bc-af48-64f47340ee16 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:22.104654 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b129165d-ff5a-40bc-af48-64f47340ee16 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:22.111707 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b129165d-ff5a-40bc-af48-64f47340ee16 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:22.112260 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b129165d-ff5a-40bc-af48-64f47340ee16 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:22.112748 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b129165d-ff5a-40bc-af48-64f47340ee16 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:22.113647 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b129165d-ff5a-40bc-af48-64f47340ee16 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:22.114218 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b129165d-ff5a-40bc-af48-64f47340ee16 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:22.114705 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b129165d-ff5a-40bc-af48-64f47340ee16 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:22.300983 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b129165d-ff5a-40bc-af48-64f47340ee16 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e535f9274b24a9f800ea0c3d8faba5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b8e89ba0a14188bac8e28b66b5a197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:22.319378 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b129165d-ff5a-40bc-af48-64f47340ee16 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "GET /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb" status: 200 len: 1390 microversion: 2.1 time: 0.223713 Oct 23 01:11:22.320488 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 169/282] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:22 2022] GET /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb => generated 1390 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:22.325468 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4d71ed56-9fa4-4edb-888f-fc775d1c9324 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:22.333775 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4d71ed56-9fa4-4edb-888f-fc775d1c9324 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] 10.222.0.42 "GET /compute/v2.1/os-aggregates" status: 200 len: 340 microversion: 2.1 time: 0.012082 Oct 23 01:11:22.334437 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 170/283] 10.222.0.42 () {58 vars in 1143 bytes} [Sun Oct 23 01:11:22 2022] GET /compute/v2.1/os-aggregates => generated 340 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:22.344123 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3221f58c-76e1-4744-bfd9-cd527db2f046 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:22.344972 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3221f58c-76e1-4744-bfd9-cd527db2f046 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] [instance: 9bb5ab44-057e-4115-a477-602ef6feece3] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:22.359781 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3221f58c-76e1-4744-bfd9-cd527db2f046 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:22.360306 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3221f58c-76e1-4744-bfd9-cd527db2f046 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:22.360695 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3221f58c-76e1-4744-bfd9-cd527db2f046 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:22.361392 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3221f58c-76e1-4744-bfd9-cd527db2f046 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:22.361840 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3221f58c-76e1-4744-bfd9-cd527db2f046 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:22.362606 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3221f58c-76e1-4744-bfd9-cd527db2f046 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:22.438163 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3221f58c-76e1-4744-bfd9-cd527db2f046 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c84b03f3f8431e9d3c0cbb792aeaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7864a40d26e402d815d39ef0c0f91a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:22.449376 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3221f58c-76e1-4744-bfd9-cd527db2f046 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] 10.222.0.42 "GET /compute/v2.1/servers/9bb5ab44-057e-4115-a477-602ef6feece3" status: 200 len: 1284 microversion: 2.1 time: 0.110725 Oct 23 01:11:22.450830 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 171/284] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:22 2022] GET /compute/v2.1/servers/9bb5ab44-057e-4115-a477-602ef6feece3 => generated 1284 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:22.468964 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e291893a-6286-4422-9361-d76c190c4291 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:22.568728 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e291893a-6286-4422-9361-d76c190c4291 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.115977 Oct 23 01:11:22.569432 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 172/285] 10.222.0.42 () {58 vars in 1155 bytes} [Sun Oct 23 01:11:22 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 23 01:11:22.857276 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5075c539-6cf1-4a2b-87a7-173a1b17ce97 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Calling method '.version_select at 0x7f5cc27c68b0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:22.860011 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5075c539-6cf1-4a2b-87a7-173a1b17ce97 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:22.860752 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5075c539-6cf1-4a2b-87a7-173a1b17ce97 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:22.861538 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5075c539-6cf1-4a2b-87a7-173a1b17ce97 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:22.884790 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5075c539-6cf1-4a2b-87a7-173a1b17ce97 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:22.885295 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5075c539-6cf1-4a2b-87a7-173a1b17ce97 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:22.885724 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5075c539-6cf1-4a2b-87a7-173a1b17ce97 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:22.905608 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5075c539-6cf1-4a2b-87a7-173a1b17ce97 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:22.906147 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5075c539-6cf1-4a2b-87a7-173a1b17ce97 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:22.906575 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5075c539-6cf1-4a2b-87a7-173a1b17ce97 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:22.916616 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5075c539-6cf1-4a2b-87a7-173a1b17ce97 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.346076 Oct 23 01:11:22.918066 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 173/286] 10.222.0.42 () {58 vars in 1146 bytes} [Sun Oct 23 01:11:22 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:22.933840 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cd665aff-16ee-42a6-88cd-bc5b856fc7b2 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1643513242"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:22.938820 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.aggregate [None req-cd665aff-16ee-42a6-88cd-bc5b856fc7b2 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Generated uuid 027efd73-559f-4011-a589-a4b64ee645ed for aggregate {{(pid=120945) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 23 01:11:22.957767 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=66,nova_api:INSERT=19,nova_api:UPDATE=14 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:22.970485 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9d374eb0-ee8b-4225-850f-1e0d1b66e02d tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-sets/c7cff3fb8aab4d0eb2b247cae880ba27" status: 200 len: 329 microversion: 2.1 time: 2.763396 Oct 23 01:11:22.971081 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 114/287] 10.222.0.42 () {60 vars in 1263 bytes} [Sun Oct 23 01:11:20 2022] PUT /compute/v2.1/os-quota-sets/c7cff3fb8aab4d0eb2b247cae880ba27 => generated 329 bytes in 2767 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:22.987159 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2dad26a8-e3bb-48a8-a1df-ecdc41ed8236 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:22.988012 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2dad26a8-e3bb-48a8-a1df-ecdc41ed8236 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 26043446-8442-4d38-98d8-6ff9a1432d1b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:22.994820 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2dad26a8-e3bb-48a8-a1df-ecdc41ed8236 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:22.995317 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2dad26a8-e3bb-48a8-a1df-ecdc41ed8236 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:22.995750 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2dad26a8-e3bb-48a8-a1df-ecdc41ed8236 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:22.996506 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2dad26a8-e3bb-48a8-a1df-ecdc41ed8236 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:22.996941 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2dad26a8-e3bb-48a8-a1df-ecdc41ed8236 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:22.997371 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2dad26a8-e3bb-48a8-a1df-ecdc41ed8236 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:23.083006 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cd665aff-16ee-42a6-88cd-bc5b856fc7b2 tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.163031 Oct 23 01:11:23.092637 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 174/288] 10.222.0.42 () {60 vars in 1164 bytes} [Sun Oct 23 01:11:22 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:23.102699 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-823d5e69-057c-4e67-807c-1789e3941cd4 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Calling method '.version_select at 0x7f5cc2829c10>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:23.105618 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-823d5e69-057c-4e67-807c-1789e3941cd4 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:23.107772 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-823d5e69-057c-4e67-807c-1789e3941cd4 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:23.107772 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-823d5e69-057c-4e67-807c-1789e3941cd4 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:23.122278 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-823d5e69-057c-4e67-807c-1789e3941cd4 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:23.123003 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-823d5e69-057c-4e67-807c-1789e3941cd4 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:23.124086 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-823d5e69-057c-4e67-807c-1789e3941cd4 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:23.136304 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-823d5e69-057c-4e67-807c-1789e3941cd4 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:23.137070 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-823d5e69-057c-4e67-807c-1789e3941cd4 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:23.137502 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-823d5e69-057c-4e67-807c-1789e3941cd4 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:23.144844 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-823d5e69-057c-4e67-807c-1789e3941cd4 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.051090 Oct 23 01:11:23.145672 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 175/289] 10.222.0.42 () {58 vars in 1167 bytes} [Sun Oct 23 01:11:23 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:23.150189 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2aec8a6d-6474-426a-98d0-35b7a62c011f tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:23.161033 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2aec8a6d-6474-426a-98d0-35b7a62c011f tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] 10.222.0.42 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.014174 Oct 23 01:11:23.168374 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 176/290] 10.222.0.42 () {58 vars in 1143 bytes} [Sun Oct 23 01:11:23 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:23.172567 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-bfc017a8-c6d9-4e31-aaab-ab9f96177cfc req-d5752190-f599-40ed-a010-ce05e424a148 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb", "name": "network-vif-plugged", "status": "completed", "tag": "a79fbfc6-98c3-46eb-9803-c40ceb7ed7bd"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:23.182495 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-bfc017a8-c6d9-4e31-aaab-ab9f96177cfc req-d5752190-f599-40ed-a010-ce05e424a148 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:23.183266 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-bfc017a8-c6d9-4e31-aaab-ab9f96177cfc req-d5752190-f599-40ed-a010-ce05e424a148 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:23.183905 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-bfc017a8-c6d9-4e31-aaab-ab9f96177cfc req-d5752190-f599-40ed-a010-ce05e424a148 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:23.197273 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-bfc017a8-c6d9-4e31-aaab-ab9f96177cfc req-d5752190-f599-40ed-a010-ce05e424a148 service nova] Creating event network-vif-plugged:a79fbfc6-98c3-46eb-9803-c40ceb7ed7bd for instance 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb on n-h2-master-1 Oct 23 01:11:23.203598 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-bfc017a8-c6d9-4e31-aaab-ab9f96177cfc req-d5752190-f599-40ed-a010-ce05e424a148 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035965 Oct 23 01:11:23.212998 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 177/291] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:23.226314 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8fba02cb-416b-4711-8655-ddfcaaf6adac tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:23.227027 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8fba02cb-416b-4711-8655-ddfcaaf6adac tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] [instance: ce463295-4ce8-4df9-b8a2-f9388229a3c3] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:23.241533 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8fba02cb-416b-4711-8655-ddfcaaf6adac tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:23.242273 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8fba02cb-416b-4711-8655-ddfcaaf6adac tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:23.245551 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2dad26a8-e3bb-48a8-a1df-ecdc41ed8236 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:23.250946 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8fba02cb-416b-4711-8655-ddfcaaf6adac tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:23.255605 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2dad26a8-e3bb-48a8-a1df-ecdc41ed8236 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b" status: 200 len: 1310 microversion: 2.1 time: 0.283270 Oct 23 01:11:23.256218 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 115/292] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:22 2022] GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b => generated 1310 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:23.257243 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8fba02cb-416b-4711-8655-ddfcaaf6adac tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:23.257960 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8fba02cb-416b-4711-8655-ddfcaaf6adac tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:23.258566 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8fba02cb-416b-4711-8655-ddfcaaf6adac tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:23.282228 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c5e52d09-a49f-4aa1-aed2-64a56b0aff58 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Calling method '.version_select at 0x7f5cc2bde820>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:23.290622 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c5e52d09-a49f-4aa1-aed2-64a56b0aff58 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:23.291216 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c5e52d09-a49f-4aa1-aed2-64a56b0aff58 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:23.291722 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c5e52d09-a49f-4aa1-aed2-64a56b0aff58 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:23.322291 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c5e52d09-a49f-4aa1-aed2-64a56b0aff58 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:23.323102 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c5e52d09-a49f-4aa1-aed2-64a56b0aff58 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:23.324178 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c5e52d09-a49f-4aa1-aed2-64a56b0aff58 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:23.340008 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c5e52d09-a49f-4aa1-aed2-64a56b0aff58 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:23.340635 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c5e52d09-a49f-4aa1-aed2-64a56b0aff58 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:23.341125 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c5e52d09-a49f-4aa1-aed2-64a56b0aff58 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:23.349689 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c5e52d09-a49f-4aa1-aed2-64a56b0aff58 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.086674 Oct 23 01:11:23.351049 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 116/293] 10.222.0.42 () {58 vars in 1146 bytes} [Sun Oct 23 01:11:23 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:23.356196 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c316881d-fb39-41c9-91e6-773b0121f48c tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:23.487168 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c316881d-fb39-41c9-91e6-773b0121f48c tempest-AggregatesAdminTestJSON-507603983 tempest-AggregatesAdminTestJSON-507603983-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.134306 Oct 23 01:11:23.500632 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 117/294] 10.222.0.42 () {58 vars in 1155 bytes} [Sun Oct 23 01:11:23 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 23 01:11:23.510745 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-699dfecc-49e3-4218-97d2-d8ed2c49c531 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:23.511793 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-699dfecc-49e3-4218-97d2-d8ed2c49c531 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:23.524407 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-699dfecc-49e3-4218-97d2-d8ed2c49c531 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:23.525725 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-699dfecc-49e3-4218-97d2-d8ed2c49c531 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:23.527184 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-699dfecc-49e3-4218-97d2-d8ed2c49c531 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:23.530565 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-699dfecc-49e3-4218-97d2-d8ed2c49c531 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:23.531530 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-699dfecc-49e3-4218-97d2-d8ed2c49c531 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:23.532216 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-699dfecc-49e3-4218-97d2-d8ed2c49c531 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:23.850802 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8fba02cb-416b-4711-8655-ddfcaaf6adac tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec43833fb4d646ab9f26d425cdb0b694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa16b9c333c42ff8860639c213453c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:23.862237 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8fba02cb-416b-4711-8655-ddfcaaf6adac tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] 10.222.0.42 "GET /compute/v2.1/servers/ce463295-4ce8-4df9-b8a2-f9388229a3c3" status: 200 len: 1471 microversion: 2.1 time: 0.642756 Oct 23 01:11:23.863299 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 178/295] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:23 2022] GET /compute/v2.1/servers/ce463295-4ce8-4df9-b8a2-f9388229a3c3 => generated 1471 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:23.874616 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4fdb7ba2-d458-4cec-a346-f04934f0b37d tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Calling method '.version_select at 0x7f5cc27c6160>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:23.880885 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4fdb7ba2-d458-4cec-a346-f04934f0b37d tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:23.881654 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4fdb7ba2-d458-4cec-a346-f04934f0b37d tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:23.882612 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4fdb7ba2-d458-4cec-a346-f04934f0b37d tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:23.903533 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4fdb7ba2-d458-4cec-a346-f04934f0b37d tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:23.904963 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4fdb7ba2-d458-4cec-a346-f04934f0b37d tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:23.905576 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4fdb7ba2-d458-4cec-a346-f04934f0b37d tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:23.913172 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4fdb7ba2-d458-4cec-a346-f04934f0b37d tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.048510 Oct 23 01:11:23.913567 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-699dfecc-49e3-4218-97d2-d8ed2c49c531 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e535f9274b24a9f800ea0c3d8faba5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b8e89ba0a14188bac8e28b66b5a197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:23.913997 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 179/296] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Oct 23 01:11:23 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:23.919347 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-005f8c99-a0cf-47c8-ac46-75746c09eb88 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:23.920273 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-005f8c99-a0cf-47c8-ac46-75746c09eb88 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] [instance: 9bb5ab44-057e-4115-a477-602ef6feece3] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:23.928093 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-005f8c99-a0cf-47c8-ac46-75746c09eb88 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:23.928879 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-005f8c99-a0cf-47c8-ac46-75746c09eb88 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:23.929479 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-005f8c99-a0cf-47c8-ac46-75746c09eb88 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:23.930460 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-005f8c99-a0cf-47c8-ac46-75746c09eb88 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:23.931132 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-005f8c99-a0cf-47c8-ac46-75746c09eb88 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:23.931719 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-005f8c99-a0cf-47c8-ac46-75746c09eb88 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:23.934062 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-699dfecc-49e3-4218-97d2-d8ed2c49c531 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "GET /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb" status: 200 len: 1390 microversion: 2.1 time: 0.430477 Oct 23 01:11:23.942129 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 118/297] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:23 2022] GET /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb => generated 1390 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:23.950034 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3187aa3c-b40a-47d0-b4fe-e708b88883be tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:23.952444 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3187aa3c-b40a-47d0-b4fe-e708b88883be tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] [instance: e41aeb69-eb54-4844-9b0a-2efa50a230c5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:23.959997 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3187aa3c-b40a-47d0-b4fe-e708b88883be tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:23.971571 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3187aa3c-b40a-47d0-b4fe-e708b88883be tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:23.972041 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3187aa3c-b40a-47d0-b4fe-e708b88883be tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:23.978050 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3187aa3c-b40a-47d0-b4fe-e708b88883be tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:23.978602 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3187aa3c-b40a-47d0-b4fe-e708b88883be tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:23.980421 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3187aa3c-b40a-47d0-b4fe-e708b88883be tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:23.997517 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-3187aa3c-b40a-47d0-b4fe-e708b88883be tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] HTTP exception thrown: Instance e41aeb69-eb54-4844-9b0a-2efa50a230c5 could not be found. Oct 23 01:11:24.001145 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3187aa3c-b40a-47d0-b4fe-e708b88883be tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Request method failure captured: Oct 23 01:11:24.001145 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5 HTTP/1.1 Oct 23 01:11:24.001145 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:11:24.001145 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:11:24.001145 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:11:24.001145 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:11:24.001145 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:11:24.001145 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:11:24.001145 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:11:24.001145 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:11:24.001145 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJR28W1AyuqQJ-30fgS3HuH8-9wNc8TNH4r1av1j4VMJKYW1dsNdey5FU63qAG5cWM1B4HVoGXayzMN0bYK07ItwJPR8qAUPEv1q5CwhzS8q9vuOsD28602JElKhJ0d9idMfyBOSAwbgUTRQNPgL5PiZXTN9lFH0iTZ_bQ5ELu62UcM Oct 23 01:11:24.001145 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:11:24.001145 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:11:24.001145 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:11:24.001145 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:11:24.001145 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:11:24.001145 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:11:24.001145 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: f3a80a158b5c4e3baf87e83a284970c3 Oct 23 01:11:24.001145 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-AggregatesAdminTestJSON-1732355780 Oct 23 01:11:24.001145 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:11:24.001145 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:11:24.002463 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f3a80a158b5c4e3baf87e83a284970c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f3a80a158b5c4e3baf87e83a284970c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f3a80a158b5c4e3baf87e83a284970c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f3a80a158b5c4e3baf87e83a284970c3"}]}] Oct 23 01:11:24.002463 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-AggregatesAdminTestJSON-1732355780 Oct 23 01:11:24.002463 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: f3a80a158b5c4e3baf87e83a284970c3 Oct 23 01:11:24.002463 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1732355780 Oct 23 01:11:24.002463 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-AggregatesAdminTestJSON-1732355780-project Oct 23 01:11:24.002463 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:11:24.002463 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:11:24.002463 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: d61093911783470a94d53354c15df815 Oct 23 01:11:24.002463 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-AggregatesAdminTestJSON-1732355780-project Oct 23 01:11:24.002463 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:11:24.002463 n-d-master-1 devstack@n-api.service[120944]: exception: Instance e41aeb69-eb54-4844-9b0a-2efa50a230c5 could not be found. Oct 23 01:11:24.002463 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'e41aeb69-eb54-4844-9b0a-2efa50a230c5'} Oct 23 01:11:24.003215 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:11:24.003215 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:24.003215 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:11:24.003215 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:11:24.003215 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:11:24.003215 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:11:24.003215 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:11:24.003215 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:11:24.003215 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:11:24.003215 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:11:24.003215 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e41aeb69-eb54-4844-9b0a-2efa50a230c5 could not be found. Oct 23 01:11:24.003215 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:24.003215 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:11:24.003215 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:24.003215 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:24.003215 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:24.003215 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:24.003215 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:11:24.003215 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:11:24.003215 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:11:24.005158 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:11:24.005158 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:11:24.005158 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:11:24.005158 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:11:24.005158 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:11:24.005158 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:11:24.005158 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:11:24.005158 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:11:24.005158 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:11:24.005158 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e41aeb69-eb54-4844-9b0a-2efa50a230c5 could not be found. Oct 23 01:11:24.005158 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:24.005158 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:11:24.005158 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:24.005158 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:24.005158 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:24.005158 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:24.005158 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:11:24.005158 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:11:24.005158 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e41aeb69-eb54-4844-9b0a-2efa50a230c5 could not be found. Oct 23 01:11:24.005158 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:24.006650 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3187aa3c-b40a-47d0-b4fe-e708b88883be tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Returning 404 to user: Instance e41aeb69-eb54-4844-9b0a-2efa50a230c5 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:11:24.006650 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3187aa3c-b40a-47d0-b4fe-e708b88883be tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5" status: 404 len: 111 microversion: 2.1 time: 0.066190 Oct 23 01:11:24.006650 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 119/298] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:11:23 2022] DELETE /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:11:24.010552 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5f5f9e74-2e89-4510-b712-ce8ff32948b8 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:24.011458 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5f5f9e74-2e89-4510-b712-ce8ff32948b8 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] [instance: ce463295-4ce8-4df9-b8a2-f9388229a3c3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:24.018397 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f5f9e74-2e89-4510-b712-ce8ff32948b8 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:24.018981 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f5f9e74-2e89-4510-b712-ce8ff32948b8 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:24.019497 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f5f9e74-2e89-4510-b712-ce8ff32948b8 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:24.020363 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f5f9e74-2e89-4510-b712-ce8ff32948b8 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:24.020820 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f5f9e74-2e89-4510-b712-ce8ff32948b8 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:24.021430 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f5f9e74-2e89-4510-b712-ce8ff32948b8 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:24.046952 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-005f8c99-a0cf-47c8-ac46-75746c09eb88 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c84b03f3f8431e9d3c0cbb792aeaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7864a40d26e402d815d39ef0c0f91a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:24.053632 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5f5f9e74-2e89-4510-b712-ce8ff32948b8 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'ec43833fb4d646ab9f26d425cdb0b694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa16b9c333c42ff8860639c213453c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:24.055466 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5f5f9e74-2e89-4510-b712-ce8ff32948b8 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Request method failure captured: Oct 23 01:11:24.055466 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/ce463295-4ce8-4df9-b8a2-f9388229a3c3/diagnostics HTTP/1.1 Oct 23 01:11:24.055466 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:11:24.055466 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:11:24.055466 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:11:24.055466 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:11:24.055466 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:11:24.055466 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:11:24.055466 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:11:24.055466 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:11:24.055466 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJSh4vTU_meRrQ6n9sTrUdfty-ak2xYzmL1cBNbjO9ai882ErF2u37oCrtHzl03ISgFaClBgLCYqx-WsxnJBRtGIuTQDS9IjbKFvr2o4ZB45XRn8HPFUb-jdVX0fYJDV_bJvaGDXjERVA4e4GHnKvX_m0uJb20PyzAHZzGafUHJP0Ms Oct 23 01:11:24.055466 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:11:24.055466 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:11:24.055466 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:11:24.055466 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:11:24.055466 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:11:24.055466 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:11:24.055466 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: efa16b9c333c42ff8860639c213453c6 Oct 23 01:11:24.055466 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-345954977 Oct 23 01:11:24.055466 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:11:24.055466 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:11:24.059244 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/efa16b9c333c42ff8860639c213453c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_efa16b9c333c42ff8860639c213453c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/efa16b9c333c42ff8860639c213453c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/efa16b9c333c42ff8860639c213453c6"}]}] Oct 23 01:11:24.059244 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-345954977 Oct 23 01:11:24.059244 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: efa16b9c333c42ff8860639c213453c6 Oct 23 01:11:24.059244 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-345954977 Oct 23 01:11:24.059244 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServerDiagnosticsNegativeTest-345954977-project Oct 23 01:11:24.059244 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:11:24.059244 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:11:24.059244 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: ec43833fb4d646ab9f26d425cdb0b694 Oct 23 01:11:24.059244 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-345954977-project Oct 23 01:11:24.059244 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:11:24.059244 n-d-master-1 devstack@n-api.service[120944]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 23 01:11:24.059875 n-d-master-1 devstack@n-api.service[120944]: action_args: {'server_id': 'ce463295-4ce8-4df9-b8a2-f9388229a3c3'} Oct 23 01:11:24.059875 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:11:24.059875 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:24.059875 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:24.059875 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:24.059875 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:11:24.059875 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:11:24.059875 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:11:24.059875 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:11:24.059875 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 23 01:11:24.059875 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 23 01:11:24.059875 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 23 01:11:24.059875 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 23 01:11:24.059875 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 23 01:11:24.059875 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 23 01:11:24.059875 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:11:24.059875 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 23 01:11:24.059875 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:11:24.059875 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise self.value Oct 23 01:11:24.059875 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 23 01:11:24.061610 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 23 01:11:24.061610 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 23 01:11:24.061610 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 23 01:11:24.061610 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 23 01:11:24.061610 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 23 01:11:24.061610 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 23 01:11:24.061610 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:24.061610 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:11:24.061610 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:24.061610 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:24.061610 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:24.061610 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:24.061610 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 23 01:11:24.061610 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 23 01:11:24.061610 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 23 01:11:24.061610 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:24.061610 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5f5f9e74-2e89-4510-b712-ce8ff32948b8 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:11:24.062985 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5f5f9e74-2e89-4510-b712-ce8ff32948b8 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] 10.222.0.42 "GET /compute/v2.1/servers/ce463295-4ce8-4df9-b8a2-f9388229a3c3/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.052356 Oct 23 01:11:24.062985 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 120/299] 10.222.0.42 () {58 vars in 1272 bytes} [Sun Oct 23 01:11:24 2022] GET /compute/v2.1/servers/ce463295-4ce8-4df9-b8a2-f9388229a3c3/diagnostics => generated 117 bytes in 53 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:11:24.067414 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-005f8c99-a0cf-47c8-ac46-75746c09eb88 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] 10.222.0.42 "GET /compute/v2.1/servers/9bb5ab44-057e-4115-a477-602ef6feece3" status: 200 len: 1290 microversion: 2.1 time: 0.152020 Oct 23 01:11:24.068006 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 180/300] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:23 2022] GET /compute/v2.1/servers/9bb5ab44-057e-4115-a477-602ef6feece3 => generated 1290 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:24.073950 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-019d7529-df04-4f40-8cc7-2ad21ae205f6 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Calling method '.version_select at 0x7f5cc28ac310>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:24.077719 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0aafbed6-aa4d-424c-81c9-67465cd143ee tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:24.079771 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-019d7529-df04-4f40-8cc7-2ad21ae205f6 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:24.080583 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0aafbed6-aa4d-424c-81c9-67465cd143ee tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] [instance: e41aeb69-eb54-4844-9b0a-2efa50a230c5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:24.081219 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-019d7529-df04-4f40-8cc7-2ad21ae205f6 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:24.082470 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-019d7529-df04-4f40-8cc7-2ad21ae205f6 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:24.096492 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0aafbed6-aa4d-424c-81c9-67465cd143ee tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:24.096958 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0aafbed6-aa4d-424c-81c9-67465cd143ee tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:24.097399 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0aafbed6-aa4d-424c-81c9-67465cd143ee tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:24.101270 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0aafbed6-aa4d-424c-81c9-67465cd143ee tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:24.101764 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0aafbed6-aa4d-424c-81c9-67465cd143ee tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:24.102346 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0aafbed6-aa4d-424c-81c9-67465cd143ee tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:24.118401 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-0aafbed6-aa4d-424c-81c9-67465cd143ee tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] HTTP exception thrown: Instance e41aeb69-eb54-4844-9b0a-2efa50a230c5 could not be found. Oct 23 01:11:24.120534 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0aafbed6-aa4d-424c-81c9-67465cd143ee tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Request method failure captured: Oct 23 01:11:24.120534 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5 HTTP/1.1 Oct 23 01:11:24.120534 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:11:24.120534 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:11:24.120534 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:11:24.120534 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:11:24.120534 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:11:24.120534 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:11:24.120534 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:11:24.120534 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:11:24.120534 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJR28W1AyuqQJ-30fgS3HuH8-9wNc8TNH4r1av1j4VMJKYW1dsNdey5FU63qAG5cWM1B4HVoGXayzMN0bYK07ItwJPR8qAUPEv1q5CwhzS8q9vuOsD28602JElKhJ0d9idMfyBOSAwbgUTRQNPgL5PiZXTN9lFH0iTZ_bQ5ELu62UcM Oct 23 01:11:24.120534 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:11:24.120534 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:11:24.120534 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:11:24.120534 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:11:24.120534 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:11:24.120534 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:11:24.120534 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: f3a80a158b5c4e3baf87e83a284970c3 Oct 23 01:11:24.120534 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-AggregatesAdminTestJSON-1732355780 Oct 23 01:11:24.120534 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:11:24.120534 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:11:24.122338 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f3a80a158b5c4e3baf87e83a284970c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f3a80a158b5c4e3baf87e83a284970c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f3a80a158b5c4e3baf87e83a284970c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f3a80a158b5c4e3baf87e83a284970c3"}]}] Oct 23 01:11:24.122338 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-AggregatesAdminTestJSON-1732355780 Oct 23 01:11:24.122338 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: f3a80a158b5c4e3baf87e83a284970c3 Oct 23 01:11:24.122338 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1732355780 Oct 23 01:11:24.122338 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-AggregatesAdminTestJSON-1732355780-project Oct 23 01:11:24.122338 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:11:24.122338 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:11:24.122338 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: d61093911783470a94d53354c15df815 Oct 23 01:11:24.122338 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-AggregatesAdminTestJSON-1732355780-project Oct 23 01:11:24.122338 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:11:24.122338 n-d-master-1 devstack@n-api.service[120945]: exception: Instance e41aeb69-eb54-4844-9b0a-2efa50a230c5 could not be found. Oct 23 01:11:24.122338 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'e41aeb69-eb54-4844-9b0a-2efa50a230c5'} Oct 23 01:11:24.123735 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:11:24.123735 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:24.123735 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:11:24.123735 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:11:24.123735 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:11:24.123735 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:11:24.123735 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:11:24.123735 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:11:24.123735 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:11:24.123735 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:11:24.123735 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e41aeb69-eb54-4844-9b0a-2efa50a230c5 could not be found. Oct 23 01:11:24.123735 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:24.123735 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:11:24.123735 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:24.123735 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:24.123735 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:24.123735 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:24.123735 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:11:24.123735 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:11:24.123735 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:11:24.125805 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:11:24.125805 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:11:24.125805 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:11:24.125805 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:11:24.125805 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:11:24.125805 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:11:24.125805 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:11:24.125805 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e41aeb69-eb54-4844-9b0a-2efa50a230c5 could not be found. Oct 23 01:11:24.125805 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:24.125805 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:11:24.125805 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:24.125805 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:24.125805 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:24.125805 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:24.125805 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:11:24.125805 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:11:24.125805 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e41aeb69-eb54-4844-9b0a-2efa50a230c5 could not be found. Oct 23 01:11:24.125805 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:24.129400 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0aafbed6-aa4d-424c-81c9-67465cd143ee tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] Returning 404 to user: Instance e41aeb69-eb54-4844-9b0a-2efa50a230c5 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:11:24.130483 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0aafbed6-aa4d-424c-81c9-67465cd143ee tempest-AggregatesAdminTestJSON-1732355780 tempest-AggregatesAdminTestJSON-1732355780-project] 10.222.0.42 "GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5" status: 404 len: 111 microversion: 2.1 time: 0.059996 Oct 23 01:11:24.131450 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 181/301] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:24 2022] GET /compute/v2.1/servers/e41aeb69-eb54-4844-9b0a-2efa50a230c5 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:11:24.136991 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2065bd53-7679-4e4d-b1bf-26f0cd634857 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:24.137697 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2065bd53-7679-4e4d-b1bf-26f0cd634857 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] [instance: ce463295-4ce8-4df9-b8a2-f9388229a3c3] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:24.139990 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-019d7529-df04-4f40-8cc7-2ad21ae205f6 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.069103 Oct 23 01:11:24.145391 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 121/302] 10.222.0.42 () {58 vars in 1179 bytes} [Sun Oct 23 01:11:24 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:24.145685 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2065bd53-7679-4e4d-b1bf-26f0cd634857 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:24.145940 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2065bd53-7679-4e4d-b1bf-26f0cd634857 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:24.146726 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2065bd53-7679-4e4d-b1bf-26f0cd634857 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:24.147630 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2065bd53-7679-4e4d-b1bf-26f0cd634857 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:24.148263 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2065bd53-7679-4e4d-b1bf-26f0cd634857 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:24.148870 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2065bd53-7679-4e4d-b1bf-26f0cd634857 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:24.161348 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1f4cad3f-34e2-4c25-93d6-379ddf62ccfc tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Calling method '.version_select at 0x7f5cc28b7ee0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:24.163719 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f4cad3f-34e2-4c25-93d6-379ddf62ccfc tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:24.165098 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f4cad3f-34e2-4c25-93d6-379ddf62ccfc tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:24.166609 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f4cad3f-34e2-4c25-93d6-379ddf62ccfc tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:24.189258 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f4cad3f-34e2-4c25-93d6-379ddf62ccfc tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:24.190432 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f4cad3f-34e2-4c25-93d6-379ddf62ccfc tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:24.191364 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f4cad3f-34e2-4c25-93d6-379ddf62ccfc tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:24.200201 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2065bd53-7679-4e4d-b1bf-26f0cd634857 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] [instance: ce463295-4ce8-4df9-b8a2-f9388229a3c3] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:11:24.207314 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f4cad3f-34e2-4c25-93d6-379ddf62ccfc tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:24.208866 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f4cad3f-34e2-4c25-93d6-379ddf62ccfc tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:24.209704 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f4cad3f-34e2-4c25-93d6-379ddf62ccfc tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:24.226322 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1f4cad3f-34e2-4c25-93d6-379ddf62ccfc tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.065246 Oct 23 01:11:24.227667 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 122/303] 10.222.0.42 () {58 vars in 1146 bytes} [Sun Oct 23 01:11:24 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:11:24.239293 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a40962e6-55e2-4ee2-ae1e-1c6e80b5d56c tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Calling method '.version_select at 0x7f5cc28f34c0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:24.244766 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a40962e6-55e2-4ee2-ae1e-1c6e80b5d56c tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:24.245616 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a40962e6-55e2-4ee2-ae1e-1c6e80b5d56c tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:24.246786 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a40962e6-55e2-4ee2-ae1e-1c6e80b5d56c tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:24.268362 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a40962e6-55e2-4ee2-ae1e-1c6e80b5d56c tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:24.268958 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a40962e6-55e2-4ee2-ae1e-1c6e80b5d56c tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:24.269491 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a40962e6-55e2-4ee2-ae1e-1c6e80b5d56c tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:24.278749 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a40962e6-55e2-4ee2-ae1e-1c6e80b5d56c tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.044626 Oct 23 01:11:24.280415 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 123/304] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Oct 23 01:11:24 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:11:24.285883 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b4634ccb-e782-42ab-99d1-4df543d00e15 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:24.287109 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b4634ccb-e782-42ab-99d1-4df543d00e15 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 26043446-8442-4d38-98d8-6ff9a1432d1b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:24.294271 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b4634ccb-e782-42ab-99d1-4df543d00e15 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:24.295023 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b4634ccb-e782-42ab-99d1-4df543d00e15 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:24.295607 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b4634ccb-e782-42ab-99d1-4df543d00e15 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:24.296869 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b4634ccb-e782-42ab-99d1-4df543d00e15 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:24.297469 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b4634ccb-e782-42ab-99d1-4df543d00e15 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:24.298076 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b4634ccb-e782-42ab-99d1-4df543d00e15 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:24.328774 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=100 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:24.578135 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b4634ccb-e782-42ab-99d1-4df543d00e15 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:24.595137 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b4634ccb-e782-42ab-99d1-4df543d00e15 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b" status: 200 len: 1310 microversion: 2.1 time: 0.313315 Oct 23 01:11:24.617776 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 124/305] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:24 2022] GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b => generated 1310 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:24.625969 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f2e14878-a4ba-4c0c-9b21-0ffc3239d075 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Calling method '.version_select at 0x7f5cc278b9d0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:24.627795 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2e14878-a4ba-4c0c-9b21-0ffc3239d075 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:24.630363 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2e14878-a4ba-4c0c-9b21-0ffc3239d075 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:24.630875 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2e14878-a4ba-4c0c-9b21-0ffc3239d075 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:24.645754 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2e14878-a4ba-4c0c-9b21-0ffc3239d075 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:24.646283 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2e14878-a4ba-4c0c-9b21-0ffc3239d075 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:24.646725 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2e14878-a4ba-4c0c-9b21-0ffc3239d075 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:24.653200 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f2e14878-a4ba-4c0c-9b21-0ffc3239d075 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.040370 Oct 23 01:11:24.654152 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 125/306] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Oct 23 01:11:24 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:24.668288 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fe09d0a7-4866-4dfc-ab71-65e6fedda8d7 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Calling method '.version_select at 0x7f5cc278b5e0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:24.672515 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe09d0a7-4866-4dfc-ab71-65e6fedda8d7 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:24.672515 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe09d0a7-4866-4dfc-ab71-65e6fedda8d7 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:24.672653 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=5,nova_api:DELETE=6,nova_api:UPDATE=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:24.672729 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe09d0a7-4866-4dfc-ab71-65e6fedda8d7 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:24.693701 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe09d0a7-4866-4dfc-ab71-65e6fedda8d7 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:24.694536 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe09d0a7-4866-4dfc-ab71-65e6fedda8d7 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:24.695158 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe09d0a7-4866-4dfc-ab71-65e6fedda8d7 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:24.706349 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe09d0a7-4866-4dfc-ab71-65e6fedda8d7 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:24.706837 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe09d0a7-4866-4dfc-ab71-65e6fedda8d7 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:24.707275 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe09d0a7-4866-4dfc-ab71-65e6fedda8d7 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:24.734989 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fe09d0a7-4866-4dfc-ab71-65e6fedda8d7 tempest-HypervisorAdminTestJSON-905964010 tempest-HypervisorAdminTestJSON-905964010-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.070295 Oct 23 01:11:24.741675 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 126/307] 10.222.0.42 () {58 vars in 1173 bytes} [Sun Oct 23 01:11:24 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:11:24.762590 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2065bd53-7679-4e4d-b1bf-26f0cd634857 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ce463295-4ce8-4df9-b8a2-f9388229a3c3" status: 204 len: 0 microversion: 2.1 time: 0.629633 Oct 23 01:11:24.766809 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 182/308] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:11:24 2022] DELETE /compute/v2.1/servers/ce463295-4ce8-4df9-b8a2-f9388229a3c3 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:11:24.787086 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f27eb01d-eebf-4ade-a99a-d63488493a95 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:24.790101 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f27eb01d-eebf-4ade-a99a-d63488493a95 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] [instance: ce463295-4ce8-4df9-b8a2-f9388229a3c3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:24.802522 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f27eb01d-eebf-4ade-a99a-d63488493a95 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:24.803315 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f27eb01d-eebf-4ade-a99a-d63488493a95 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:24.804009 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f27eb01d-eebf-4ade-a99a-d63488493a95 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:24.805595 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f27eb01d-eebf-4ade-a99a-d63488493a95 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:24.806083 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f27eb01d-eebf-4ade-a99a-d63488493a95 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:24.806568 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f27eb01d-eebf-4ade-a99a-d63488493a95 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:24.957535 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-384b5892-c454-43eb-b67a-c1830b0f18b5 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:24.958376 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-384b5892-c454-43eb-b67a-c1830b0f18b5 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:24.972349 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-384b5892-c454-43eb-b67a-c1830b0f18b5 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:24.973141 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-384b5892-c454-43eb-b67a-c1830b0f18b5 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:24.975205 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-384b5892-c454-43eb-b67a-c1830b0f18b5 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:24.976198 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-384b5892-c454-43eb-b67a-c1830b0f18b5 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:24.976741 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-384b5892-c454-43eb-b67a-c1830b0f18b5 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:24.977232 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-384b5892-c454-43eb-b67a-c1830b0f18b5 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:25.086585 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f27eb01d-eebf-4ade-a99a-d63488493a95 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec43833fb4d646ab9f26d425cdb0b694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa16b9c333c42ff8860639c213453c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:25.108597 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f27eb01d-eebf-4ade-a99a-d63488493a95 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] 10.222.0.42 "GET /compute/v2.1/servers/ce463295-4ce8-4df9-b8a2-f9388229a3c3" status: 200 len: 1477 microversion: 2.1 time: 0.330646 Oct 23 01:11:25.122289 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 127/309] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:24 2022] GET /compute/v2.1/servers/ce463295-4ce8-4df9-b8a2-f9388229a3c3 => generated 1477 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:25.122289 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-44e35f5f-d08f-493f-b7a8-01d2b663b495 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:25.122289 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-44e35f5f-d08f-493f-b7a8-01d2b663b495 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] [instance: 9bb5ab44-057e-4115-a477-602ef6feece3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:25.122289 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-44e35f5f-d08f-493f-b7a8-01d2b663b495 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:25.130198 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-44e35f5f-d08f-493f-b7a8-01d2b663b495 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:25.130198 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-44e35f5f-d08f-493f-b7a8-01d2b663b495 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:25.130198 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-44e35f5f-d08f-493f-b7a8-01d2b663b495 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:25.130437 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-44e35f5f-d08f-493f-b7a8-01d2b663b495 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:25.130437 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-44e35f5f-d08f-493f-b7a8-01d2b663b495 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:25.251302 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-384b5892-c454-43eb-b67a-c1830b0f18b5 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e535f9274b24a9f800ea0c3d8faba5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b8e89ba0a14188bac8e28b66b5a197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:25.267219 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-384b5892-c454-43eb-b67a-c1830b0f18b5 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "GET /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb" status: 200 len: 1390 microversion: 2.1 time: 0.313855 Oct 23 01:11:25.270396 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 183/310] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:24 2022] GET /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb => generated 1390 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:25.423985 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-44e35f5f-d08f-493f-b7a8-01d2b663b495 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c84b03f3f8431e9d3c0cbb792aeaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7864a40d26e402d815d39ef0c0f91a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:25.434388 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-44e35f5f-d08f-493f-b7a8-01d2b663b495 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] 10.222.0.42 "GET /compute/v2.1/servers/9bb5ab44-057e-4115-a477-602ef6feece3" status: 200 len: 1332 microversion: 2.1 time: 0.323860 Oct 23 01:11:25.435117 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 128/311] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:25 2022] GET /compute/v2.1/servers/9bb5ab44-057e-4115-a477-602ef6feece3 => generated 1332 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:25.624465 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3b386ec1-1214-4db4-aa74-1d4f4b530174 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:25.625508 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3b386ec1-1214-4db4-aa74-1d4f4b530174 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 26043446-8442-4d38-98d8-6ff9a1432d1b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:25.634807 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b386ec1-1214-4db4-aa74-1d4f4b530174 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:25.635526 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b386ec1-1214-4db4-aa74-1d4f4b530174 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:25.636026 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b386ec1-1214-4db4-aa74-1d4f4b530174 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:25.636788 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b386ec1-1214-4db4-aa74-1d4f4b530174 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:25.637319 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b386ec1-1214-4db4-aa74-1d4f4b530174 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:25.637800 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b386ec1-1214-4db4-aa74-1d4f4b530174 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:25.933887 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3b386ec1-1214-4db4-aa74-1d4f4b530174 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:25.941314 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:25.943987 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3b386ec1-1214-4db4-aa74-1d4f4b530174 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b" status: 200 len: 1310 microversion: 2.1 time: 0.323720 Oct 23 01:11:25.949397 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 184/312] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:25 2022] GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b => generated 1310 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:26.147717 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-96a40185-558a-4c63-b0bf-672be08569ed tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:26.150310 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-96a40185-558a-4c63-b0bf-672be08569ed tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] [instance: ce463295-4ce8-4df9-b8a2-f9388229a3c3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:26.171994 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-96a40185-558a-4c63-b0bf-672be08569ed tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:26.175084 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-96a40185-558a-4c63-b0bf-672be08569ed tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:26.175603 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-96a40185-558a-4c63-b0bf-672be08569ed tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:26.177346 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-96a40185-558a-4c63-b0bf-672be08569ed tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:26.178848 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-96a40185-558a-4c63-b0bf-672be08569ed tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:26.179549 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-96a40185-558a-4c63-b0bf-672be08569ed tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:26.269785 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-e9c840ef-b9b0-4612-9c7b-7e934ad49bfb req-c1ed7b19-2a2c-4607-b669-a51c4f54ffaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bb5ab44-057e-4115-a477-602ef6feece3", "tag": "f52b7234-1d59-4c35-8b9d-e94552c618c2"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:26.288374 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-e9c840ef-b9b0-4612-9c7b-7e934ad49bfb req-c1ed7b19-2a2c-4607-b669-a51c4f54ffaa service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:26.288815 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-e9c840ef-b9b0-4612-9c7b-7e934ad49bfb req-c1ed7b19-2a2c-4607-b669-a51c4f54ffaa service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:26.289273 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-e9c840ef-b9b0-4612-9c7b-7e934ad49bfb req-c1ed7b19-2a2c-4607-b669-a51c4f54ffaa service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:26.307437 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-e9c840ef-b9b0-4612-9c7b-7e934ad49bfb req-c1ed7b19-2a2c-4607-b669-a51c4f54ffaa service nova] Creating event network-changed:f52b7234-1d59-4c35-8b9d-e94552c618c2 for instance 9bb5ab44-057e-4115-a477-602ef6feece3 on n-h2-master-1 Oct 23 01:11:26.314752 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-e9c840ef-b9b0-4612-9c7b-7e934ad49bfb req-c1ed7b19-2a2c-4607-b669-a51c4f54ffaa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057286 Oct 23 01:11:26.319227 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 185/313] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:26.322561 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7624a8be-332e-48aa-9c2b-a8475da0bba0 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:26.324337 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7624a8be-332e-48aa-9c2b-a8475da0bba0 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:26.332237 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7624a8be-332e-48aa-9c2b-a8475da0bba0 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:26.332839 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7624a8be-332e-48aa-9c2b-a8475da0bba0 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:26.333273 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7624a8be-332e-48aa-9c2b-a8475da0bba0 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:26.334309 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7624a8be-332e-48aa-9c2b-a8475da0bba0 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:26.334769 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7624a8be-332e-48aa-9c2b-a8475da0bba0 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:26.335191 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7624a8be-332e-48aa-9c2b-a8475da0bba0 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:26.655638 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-96a40185-558a-4c63-b0bf-672be08569ed tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec43833fb4d646ab9f26d425cdb0b694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa16b9c333c42ff8860639c213453c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:26.665512 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-96a40185-558a-4c63-b0bf-672be08569ed tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] 10.222.0.42 "GET /compute/v2.1/servers/ce463295-4ce8-4df9-b8a2-f9388229a3c3" status: 200 len: 1477 microversion: 2.1 time: 0.536130 Oct 23 01:11:26.666414 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 129/314] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:26 2022] GET /compute/v2.1/servers/ce463295-4ce8-4df9-b8a2-f9388229a3c3 => generated 1477 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:26.671436 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-278da21f-0446-468d-8cc5-f96992cb0405 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:26.672124 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-278da21f-0446-468d-8cc5-f96992cb0405 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] [instance: 9bb5ab44-057e-4115-a477-602ef6feece3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:26.678114 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-278da21f-0446-468d-8cc5-f96992cb0405 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:26.678687 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-278da21f-0446-468d-8cc5-f96992cb0405 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:26.679233 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-278da21f-0446-468d-8cc5-f96992cb0405 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:26.680341 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-278da21f-0446-468d-8cc5-f96992cb0405 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:26.680966 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-278da21f-0446-468d-8cc5-f96992cb0405 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:26.681565 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-278da21f-0446-468d-8cc5-f96992cb0405 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:26.896874 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7624a8be-332e-48aa-9c2b-a8475da0bba0 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e535f9274b24a9f800ea0c3d8faba5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b8e89ba0a14188bac8e28b66b5a197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:26.905479 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7624a8be-332e-48aa-9c2b-a8475da0bba0 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "GET /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb" status: 200 len: 1589 microversion: 2.1 time: 0.587385 Oct 23 01:11:26.918684 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 186/315] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:26 2022] GET /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb => generated 1589 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:26.931857 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-46168f52-36c5-4e3b-8615-4cfd16a39b60 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:26.932708 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-46168f52-36c5-4e3b-8615-4cfd16a39b60 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:26.947082 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46168f52-36c5-4e3b-8615-4cfd16a39b60 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:26.947874 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46168f52-36c5-4e3b-8615-4cfd16a39b60 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:26.948505 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46168f52-36c5-4e3b-8615-4cfd16a39b60 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:26.949417 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46168f52-36c5-4e3b-8615-4cfd16a39b60 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:26.949872 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46168f52-36c5-4e3b-8615-4cfd16a39b60 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:26.950365 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46168f52-36c5-4e3b-8615-4cfd16a39b60 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:27.247330 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-46168f52-36c5-4e3b-8615-4cfd16a39b60 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "GET /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.318735 Oct 23 01:11:27.250842 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 187/316] 10.222.0.42 () {58 vars in 1275 bytes} [Sun Oct 23 01:11:26 2022] GET /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb/os-interface => generated 284 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:27.257383 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-03d2d123-c5d6-49fd-9ede-73bec96f7de9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:27.258057 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-03d2d123-c5d6-49fd-9ede-73bec96f7de9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 26043446-8442-4d38-98d8-6ff9a1432d1b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:27.266294 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-03d2d123-c5d6-49fd-9ede-73bec96f7de9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:27.267875 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-03d2d123-c5d6-49fd-9ede-73bec96f7de9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:27.268574 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-03d2d123-c5d6-49fd-9ede-73bec96f7de9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:27.270033 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-03d2d123-c5d6-49fd-9ede-73bec96f7de9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:27.271266 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-03d2d123-c5d6-49fd-9ede-73bec96f7de9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:27.271914 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-03d2d123-c5d6-49fd-9ede-73bec96f7de9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:27.308605 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-278da21f-0446-468d-8cc5-f96992cb0405 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c84b03f3f8431e9d3c0cbb792aeaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7864a40d26e402d815d39ef0c0f91a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:27.316847 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-278da21f-0446-468d-8cc5-f96992cb0405 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] 10.222.0.42 "GET /compute/v2.1/servers/9bb5ab44-057e-4115-a477-602ef6feece3" status: 200 len: 1332 microversion: 2.1 time: 0.649208 Oct 23 01:11:27.317425 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 130/317] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:26 2022] GET /compute/v2.1/servers/9bb5ab44-057e-4115-a477-602ef6feece3 => generated 1332 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:27.697533 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c95045e4-d058-42fb-bee9-7d308e9fd887 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:27.704835 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c95045e4-d058-42fb-bee9-7d308e9fd887 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] [instance: ce463295-4ce8-4df9-b8a2-f9388229a3c3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:27.736755 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c95045e4-d058-42fb-bee9-7d308e9fd887 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:27.739070 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c95045e4-d058-42fb-bee9-7d308e9fd887 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:27.743466 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c95045e4-d058-42fb-bee9-7d308e9fd887 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:27.745603 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c95045e4-d058-42fb-bee9-7d308e9fd887 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:27.746464 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c95045e4-d058-42fb-bee9-7d308e9fd887 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:27.747140 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c95045e4-d058-42fb-bee9-7d308e9fd887 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:27.778422 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-03d2d123-c5d6-49fd-9ede-73bec96f7de9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:27.791959 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-03d2d123-c5d6-49fd-9ede-73bec96f7de9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b" status: 200 len: 1310 microversion: 2.1 time: 0.539398 Oct 23 01:11:27.792802 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 188/318] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:27 2022] GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b => generated 1310 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:28.143598 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c95045e4-d058-42fb-bee9-7d308e9fd887 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec43833fb4d646ab9f26d425cdb0b694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa16b9c333c42ff8860639c213453c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:28.156356 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c95045e4-d058-42fb-bee9-7d308e9fd887 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] 10.222.0.42 "GET /compute/v2.1/servers/ce463295-4ce8-4df9-b8a2-f9388229a3c3" status: 200 len: 1477 microversion: 2.1 time: 0.465490 Oct 23 01:11:28.157586 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 131/319] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:27 2022] GET /compute/v2.1/servers/ce463295-4ce8-4df9-b8a2-f9388229a3c3 => generated 1477 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:28.345534 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4c431f93-27d9-4d91-b42d-20a92a293bc4 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:28.347014 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4c431f93-27d9-4d91-b42d-20a92a293bc4 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] [instance: 9bb5ab44-057e-4115-a477-602ef6feece3] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:28.356331 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4c431f93-27d9-4d91-b42d-20a92a293bc4 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:28.357197 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4c431f93-27d9-4d91-b42d-20a92a293bc4 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:28.358366 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4c431f93-27d9-4d91-b42d-20a92a293bc4 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:28.359683 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4c431f93-27d9-4d91-b42d-20a92a293bc4 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:28.360572 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4c431f93-27d9-4d91-b42d-20a92a293bc4 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:28.361784 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4c431f93-27d9-4d91-b42d-20a92a293bc4 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:28.405632 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-ba28c63e-e4c3-4d03-b640-5bcd437a43f2 req-69df2275-a0e5-4fa3-a90b-b20c327c0d1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce463295-4ce8-4df9-b8a2-f9388229a3c3", "name": "network-vif-deleted", "tag": "83d2ae7a-86a5-49fc-a7a2-a8e5188de127"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:28.441182 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-ba28c63e-e4c3-4d03-b640-5bcd437a43f2 req-69df2275-a0e5-4fa3-a90b-b20c327c0d1c service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:28.441919 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-ba28c63e-e4c3-4d03-b640-5bcd437a43f2 req-69df2275-a0e5-4fa3-a90b-b20c327c0d1c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:28.442657 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-ba28c63e-e4c3-4d03-b640-5bcd437a43f2 req-69df2275-a0e5-4fa3-a90b-b20c327c0d1c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:28.473126 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-ba28c63e-e4c3-4d03-b640-5bcd437a43f2 req-69df2275-a0e5-4fa3-a90b-b20c327c0d1c service nova] Creating event network-vif-deleted:83d2ae7a-86a5-49fc-a7a2-a8e5188de127 for instance ce463295-4ce8-4df9-b8a2-f9388229a3c3 on n-h1-master-1 Oct 23 01:11:28.489644 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-ba28c63e-e4c3-4d03-b640-5bcd437a43f2 req-69df2275-a0e5-4fa3-a90b-b20c327c0d1c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088738 Oct 23 01:11:28.490916 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 132/320] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:11:28.659718 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4c431f93-27d9-4d91-b42d-20a92a293bc4 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c84b03f3f8431e9d3c0cbb792aeaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7864a40d26e402d815d39ef0c0f91a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:28.667550 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4c431f93-27d9-4d91-b42d-20a92a293bc4 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] 10.222.0.42 "GET /compute/v2.1/servers/9bb5ab44-057e-4115-a477-602ef6feece3" status: 200 len: 1332 microversion: 2.1 time: 0.330643 Oct 23 01:11:28.668439 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 189/321] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:28 2022] GET /compute/v2.1/servers/9bb5ab44-057e-4115-a477-602ef6feece3 => generated 1332 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:11:28.833381 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b5aab6f6-c700-4a0a-8649-a7edcf362b21 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:28.834755 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b5aab6f6-c700-4a0a-8649-a7edcf362b21 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 26043446-8442-4d38-98d8-6ff9a1432d1b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:28.853063 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5aab6f6-c700-4a0a-8649-a7edcf362b21 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:28.854461 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5aab6f6-c700-4a0a-8649-a7edcf362b21 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:28.855426 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5aab6f6-c700-4a0a-8649-a7edcf362b21 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:28.856339 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5aab6f6-c700-4a0a-8649-a7edcf362b21 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:28.857880 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5aab6f6-c700-4a0a-8649-a7edcf362b21 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:28.859286 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5aab6f6-c700-4a0a-8649-a7edcf362b21 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:29.017358 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b5aab6f6-c700-4a0a-8649-a7edcf362b21 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:29.026055 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b5aab6f6-c700-4a0a-8649-a7edcf362b21 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b" status: 200 len: 1310 microversion: 2.1 time: 0.209197 Oct 23 01:11:29.027176 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 133/322] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:28 2022] GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b => generated 1310 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:29.182467 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8f41377a-c06f-4d4c-88e7-0b2abc5997f4 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:29.184064 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8f41377a-c06f-4d4c-88e7-0b2abc5997f4 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] [instance: ce463295-4ce8-4df9-b8a2-f9388229a3c3] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:29.192225 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f41377a-c06f-4d4c-88e7-0b2abc5997f4 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:29.193145 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f41377a-c06f-4d4c-88e7-0b2abc5997f4 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:29.193933 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f41377a-c06f-4d4c-88e7-0b2abc5997f4 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:29.194863 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f41377a-c06f-4d4c-88e7-0b2abc5997f4 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:29.195401 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f41377a-c06f-4d4c-88e7-0b2abc5997f4 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:29.195828 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f41377a-c06f-4d4c-88e7-0b2abc5997f4 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:29.234848 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f41377a-c06f-4d4c-88e7-0b2abc5997f4 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:29.235334 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f41377a-c06f-4d4c-88e7-0b2abc5997f4 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:29.235940 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f41377a-c06f-4d4c-88e7-0b2abc5997f4 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:29.236620 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-8f41377a-c06f-4d4c-88e7-0b2abc5997f4 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lazy-loading 'fault' on Instance uuid ce463295-4ce8-4df9-b8a2-f9388229a3c3 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:11:29.306297 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8f41377a-c06f-4d4c-88e7-0b2abc5997f4 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec43833fb4d646ab9f26d425cdb0b694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa16b9c333c42ff8860639c213453c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:29.321480 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8f41377a-c06f-4d4c-88e7-0b2abc5997f4 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] 10.222.0.42 "GET /compute/v2.1/servers/ce463295-4ce8-4df9-b8a2-f9388229a3c3" status: 200 len: 1313 microversion: 2.1 time: 0.144529 Oct 23 01:11:29.322114 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 190/323] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:29 2022] GET /compute/v2.1/servers/ce463295-4ce8-4df9-b8a2-f9388229a3c3 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:11:29.696793 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c261d2e8-8a63-44e0-a6e2-af7909ea93f6 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:29.697816 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c261d2e8-8a63-44e0-a6e2-af7909ea93f6 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] [instance: 9bb5ab44-057e-4115-a477-602ef6feece3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:29.725963 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c261d2e8-8a63-44e0-a6e2-af7909ea93f6 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:29.729384 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c261d2e8-8a63-44e0-a6e2-af7909ea93f6 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:29.731853 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c261d2e8-8a63-44e0-a6e2-af7909ea93f6 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:29.740139 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c261d2e8-8a63-44e0-a6e2-af7909ea93f6 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:29.740139 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c261d2e8-8a63-44e0-a6e2-af7909ea93f6 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:29.740927 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c261d2e8-8a63-44e0-a6e2-af7909ea93f6 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:29.887596 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3665fb83-43ab-4b28-8a23-7eba270f6b45 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:29.888794 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3665fb83-43ab-4b28-8a23-7eba270f6b45 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:29.898279 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=17 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:29.924521 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3665fb83-43ab-4b28-8a23-7eba270f6b45 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:29.925215 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3665fb83-43ab-4b28-8a23-7eba270f6b45 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:29.930408 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3665fb83-43ab-4b28-8a23-7eba270f6b45 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:29.933673 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3665fb83-43ab-4b28-8a23-7eba270f6b45 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:29.934479 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3665fb83-43ab-4b28-8a23-7eba270f6b45 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:29.935581 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3665fb83-43ab-4b28-8a23-7eba270f6b45 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:30.164592 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c261d2e8-8a63-44e0-a6e2-af7909ea93f6 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c84b03f3f8431e9d3c0cbb792aeaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7864a40d26e402d815d39ef0c0f91a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:30.174389 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c261d2e8-8a63-44e0-a6e2-af7909ea93f6 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] 10.222.0.42 "GET /compute/v2.1/servers/9bb5ab44-057e-4115-a477-602ef6feece3" status: 200 len: 1332 microversion: 2.1 time: 0.486799 Oct 23 01:11:30.191617 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 134/324] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:29 2022] GET /compute/v2.1/servers/9bb5ab44-057e-4115-a477-602ef6feece3 => generated 1332 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:30.191617 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0ceec9aa-516e-439a-8d40-d5ea6848cb62 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:30.191617 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0ceec9aa-516e-439a-8d40-d5ea6848cb62 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 26043446-8442-4d38-98d8-6ff9a1432d1b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:30.196971 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0ceec9aa-516e-439a-8d40-d5ea6848cb62 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:30.197466 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0ceec9aa-516e-439a-8d40-d5ea6848cb62 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:30.197909 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0ceec9aa-516e-439a-8d40-d5ea6848cb62 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:30.199408 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0ceec9aa-516e-439a-8d40-d5ea6848cb62 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:30.199961 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0ceec9aa-516e-439a-8d40-d5ea6848cb62 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:30.200378 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0ceec9aa-516e-439a-8d40-d5ea6848cb62 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:30.398815 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3665fb83-43ab-4b28-8a23-7eba270f6b45 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e535f9274b24a9f800ea0c3d8faba5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b8e89ba0a14188bac8e28b66b5a197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:30.422942 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0ceec9aa-516e-439a-8d40-d5ea6848cb62 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:30.430062 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3665fb83-43ab-4b28-8a23-7eba270f6b45 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "GET /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb" status: 200 len: 1589 microversion: 2.1 time: 0.549797 Oct 23 01:11:30.439252 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0ceec9aa-516e-439a-8d40-d5ea6848cb62 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b" status: 200 len: 1310 microversion: 2.1 time: 0.255373 Oct 23 01:11:30.440801 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 135/325] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:30 2022] GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b => generated 1310 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:30.446840 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-bbea2645-8c8a-4924-a4cc-f95152836de0 req-51db0bd1-4ab8-4ab5-81ee-5fb66766cbe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26043446-8442-4d38-98d8-6ff9a1432d1b", "name": "network-vif-plugged", "status": "completed", "tag": "4a1925fc-3024-45ea-be46-b952667a8883"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:30.452926 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 191/326] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:29 2022] GET /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb => generated 1589 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:30.458758 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-bbea2645-8c8a-4924-a4cc-f95152836de0 req-51db0bd1-4ab8-4ab5-81ee-5fb66766cbe8 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:30.459121 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7545f2fa-ce11-42ff-b8a6-726cb0b171d4 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:30.459723 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7545f2fa-ce11-42ff-b8a6-726cb0b171d4 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] [instance: ce463295-4ce8-4df9-b8a2-f9388229a3c3] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:30.460549 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-bbea2645-8c8a-4924-a4cc-f95152836de0 req-51db0bd1-4ab8-4ab5-81ee-5fb66766cbe8 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:30.461203 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-bbea2645-8c8a-4924-a4cc-f95152836de0 req-51db0bd1-4ab8-4ab5-81ee-5fb66766cbe8 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:30.478676 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-bbea2645-8c8a-4924-a4cc-f95152836de0 req-51db0bd1-4ab8-4ab5-81ee-5fb66766cbe8 service nova] Creating event network-vif-plugged:4a1925fc-3024-45ea-be46-b952667a8883 for instance 26043446-8442-4d38-98d8-6ff9a1432d1b on n-h1-master-1 Oct 23 01:11:30.479060 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7545f2fa-ce11-42ff-b8a6-726cb0b171d4 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:30.479554 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7545f2fa-ce11-42ff-b8a6-726cb0b171d4 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:30.479984 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7545f2fa-ce11-42ff-b8a6-726cb0b171d4 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:30.480684 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7545f2fa-ce11-42ff-b8a6-726cb0b171d4 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:30.481132 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7545f2fa-ce11-42ff-b8a6-726cb0b171d4 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:30.481549 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7545f2fa-ce11-42ff-b8a6-726cb0b171d4 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:30.486314 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-bbea2645-8c8a-4924-a4cc-f95152836de0 req-51db0bd1-4ab8-4ab5-81ee-5fb66766cbe8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044163 Oct 23 01:11:30.487448 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 136/327] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:30.499453 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-7545f2fa-ce11-42ff-b8a6-726cb0b171d4 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] HTTP exception thrown: Instance ce463295-4ce8-4df9-b8a2-f9388229a3c3 could not be found. Oct 23 01:11:30.501627 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7545f2fa-ce11-42ff-b8a6-726cb0b171d4 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Request method failure captured: Oct 23 01:11:30.501627 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/ce463295-4ce8-4df9-b8a2-f9388229a3c3 HTTP/1.1 Oct 23 01:11:30.501627 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:11:30.501627 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:11:30.501627 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:11:30.501627 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:11:30.501627 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:11:30.501627 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:11:30.501627 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:11:30.501627 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:11:30.501627 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJSh4vTU_meRrQ6n9sTrUdfty-ak2xYzmL1cBNbjO9ai882ErF2u37oCrtHzl03ISgFaClBgLCYqx-WsxnJBRtGIuTQDS9IjbKFvr2o4ZB45XRn8HPFUb-jdVX0fYJDV_bJvaGDXjERVA4e4GHnKvX_m0uJb20PyzAHZzGafUHJP0Ms Oct 23 01:11:30.501627 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:11:30.501627 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:11:30.501627 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:11:30.501627 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:11:30.501627 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:11:30.501627 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:11:30.501627 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: efa16b9c333c42ff8860639c213453c6 Oct 23 01:11:30.501627 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-345954977 Oct 23 01:11:30.501627 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:11:30.501627 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:11:30.506461 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/efa16b9c333c42ff8860639c213453c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_efa16b9c333c42ff8860639c213453c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/efa16b9c333c42ff8860639c213453c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/efa16b9c333c42ff8860639c213453c6"}]}] Oct 23 01:11:30.506461 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-345954977 Oct 23 01:11:30.506461 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: efa16b9c333c42ff8860639c213453c6 Oct 23 01:11:30.506461 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-345954977 Oct 23 01:11:30.506461 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServerDiagnosticsNegativeTest-345954977-project Oct 23 01:11:30.506461 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:11:30.506461 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:11:30.506461 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: ec43833fb4d646ab9f26d425cdb0b694 Oct 23 01:11:30.506461 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-345954977-project Oct 23 01:11:30.506461 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:11:30.506461 n-d-master-1 devstack@n-api.service[120945]: exception: Instance ce463295-4ce8-4df9-b8a2-f9388229a3c3 could not be found. Oct 23 01:11:30.506461 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'ce463295-4ce8-4df9-b8a2-f9388229a3c3'} Oct 23 01:11:30.507334 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:11:30.507334 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:30.507334 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:11:30.507334 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:11:30.507334 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:11:30.507334 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:11:30.507334 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:11:30.507334 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:11:30.507334 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:11:30.507334 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:11:30.507334 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce463295-4ce8-4df9-b8a2-f9388229a3c3 could not be found. Oct 23 01:11:30.507334 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:30.507334 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:11:30.507334 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:30.507334 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:30.507334 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:30.507334 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:30.507334 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:11:30.507334 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:11:30.507334 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:11:30.508640 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:11:30.508640 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:11:30.508640 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:11:30.508640 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:11:30.508640 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:11:30.508640 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:11:30.508640 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:11:30.508640 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce463295-4ce8-4df9-b8a2-f9388229a3c3 could not be found. Oct 23 01:11:30.508640 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:30.508640 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:11:30.508640 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:30.508640 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:30.508640 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:30.508640 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:30.508640 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:11:30.508640 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:11:30.508640 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce463295-4ce8-4df9-b8a2-f9388229a3c3 could not be found. Oct 23 01:11:30.508640 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:30.509870 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7545f2fa-ce11-42ff-b8a6-726cb0b171d4 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] Returning 404 to user: Instance ce463295-4ce8-4df9-b8a2-f9388229a3c3 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:11:30.509870 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7545f2fa-ce11-42ff-b8a6-726cb0b171d4 tempest-ServerDiagnosticsNegativeTest-345954977 tempest-ServerDiagnosticsNegativeTest-345954977-project] 10.222.0.42 "GET /compute/v2.1/servers/ce463295-4ce8-4df9-b8a2-f9388229a3c3" status: 404 len: 111 microversion: 2.1 time: 0.048977 Oct 23 01:11:30.509870 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 192/328] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:30 2022] GET /compute/v2.1/servers/ce463295-4ce8-4df9-b8a2-f9388229a3c3 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:11:30.713156 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=10 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:30.999053 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-4a3f9af2-e986-4fa9-a7ae-2cad04bba8e4 req-862fd57f-3713-4073-afb1-3aedfe6c14ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb", "tag": "a79fbfc6-98c3-46eb-9803-c40ceb7ed7bd"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:31.009866 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-4a3f9af2-e986-4fa9-a7ae-2cad04bba8e4 req-862fd57f-3713-4073-afb1-3aedfe6c14ec service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:31.013894 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-4a3f9af2-e986-4fa9-a7ae-2cad04bba8e4 req-862fd57f-3713-4073-afb1-3aedfe6c14ec service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:31.013894 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-4a3f9af2-e986-4fa9-a7ae-2cad04bba8e4 req-862fd57f-3713-4073-afb1-3aedfe6c14ec service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:31.030625 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-4a3f9af2-e986-4fa9-a7ae-2cad04bba8e4 req-862fd57f-3713-4073-afb1-3aedfe6c14ec service nova] Creating event network-changed:a79fbfc6-98c3-46eb-9803-c40ceb7ed7bd for instance 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb on n-h2-master-1 Oct 23 01:11:31.036300 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-4a3f9af2-e986-4fa9-a7ae-2cad04bba8e4 req-862fd57f-3713-4073-afb1-3aedfe6c14ec service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.417734 Oct 23 01:11:31.037324 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 137/329] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:31.199373 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1e5968ff-cada-4a63-ba8e-229ad3774a0b tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:31.200031 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1e5968ff-cada-4a63-ba8e-229ad3774a0b tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] [instance: 9bb5ab44-057e-4115-a477-602ef6feece3] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:31.206462 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=62 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:31.215158 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1e5968ff-cada-4a63-ba8e-229ad3774a0b tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:31.215670 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1e5968ff-cada-4a63-ba8e-229ad3774a0b tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:31.220002 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1e5968ff-cada-4a63-ba8e-229ad3774a0b tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:31.220002 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1e5968ff-cada-4a63-ba8e-229ad3774a0b tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:31.220002 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1e5968ff-cada-4a63-ba8e-229ad3774a0b tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:31.220312 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1e5968ff-cada-4a63-ba8e-229ad3774a0b tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:31.470849 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-60765927-0747-4791-a0a8-dd1a0a6b0918 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:31.471850 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-60765927-0747-4791-a0a8-dd1a0a6b0918 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 26043446-8442-4d38-98d8-6ff9a1432d1b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:31.491053 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-60765927-0747-4791-a0a8-dd1a0a6b0918 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:31.491466 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-60765927-0747-4791-a0a8-dd1a0a6b0918 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:31.491903 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-60765927-0747-4791-a0a8-dd1a0a6b0918 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:31.492611 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-60765927-0747-4791-a0a8-dd1a0a6b0918 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:31.493165 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-60765927-0747-4791-a0a8-dd1a0a6b0918 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:31.497869 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-60765927-0747-4791-a0a8-dd1a0a6b0918 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:31.580274 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1e5968ff-cada-4a63-ba8e-229ad3774a0b tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c84b03f3f8431e9d3c0cbb792aeaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7864a40d26e402d815d39ef0c0f91a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:31.588388 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1e5968ff-cada-4a63-ba8e-229ad3774a0b tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] 10.222.0.42 "GET /compute/v2.1/servers/9bb5ab44-057e-4115-a477-602ef6feece3" status: 200 len: 1332 microversion: 2.1 time: 0.393725 Oct 23 01:11:31.604092 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 193/330] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:31 2022] GET /compute/v2.1/servers/9bb5ab44-057e-4115-a477-602ef6feece3 => generated 1332 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:31.758569 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-60765927-0747-4791-a0a8-dd1a0a6b0918 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:31.790002 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-60765927-0747-4791-a0a8-dd1a0a6b0918 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b" status: 200 len: 1310 microversion: 2.1 time: 0.324231 Oct 23 01:11:31.792490 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 138/331] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:31 2022] GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b => generated 1310 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:11:32.256487 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-afc2c4ec-8e29-4a93-ae34-b2dc1edc303a tempest-SecurityGroupsTestAdminJSON-1373789967 tempest-SecurityGroupsTestAdminJSON-1373789967-project] Action: 'create', calling method: .version_select at 0x7f5cc26fbc10>, body: {"security_group": {"name": "tempest-securitygroup-981357059", "description": "tempest-description-38735414"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:32.612465 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3587e160-11cb-417f-89aa-0307a7eceaa8 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:32.613152 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3587e160-11cb-417f-89aa-0307a7eceaa8 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] [instance: 9bb5ab44-057e-4115-a477-602ef6feece3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:32.627341 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3587e160-11cb-417f-89aa-0307a7eceaa8 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:32.628092 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3587e160-11cb-417f-89aa-0307a7eceaa8 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:32.628263 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3587e160-11cb-417f-89aa-0307a7eceaa8 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:32.628958 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3587e160-11cb-417f-89aa-0307a7eceaa8 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:32.629417 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3587e160-11cb-417f-89aa-0307a7eceaa8 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:32.629838 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3587e160-11cb-417f-89aa-0307a7eceaa8 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:32.916370 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3587e160-11cb-417f-89aa-0307a7eceaa8 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c84b03f3f8431e9d3c0cbb792aeaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7864a40d26e402d815d39ef0c0f91a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:32.924376 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3587e160-11cb-417f-89aa-0307a7eceaa8 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] 10.222.0.42 "GET /compute/v2.1/servers/9bb5ab44-057e-4115-a477-602ef6feece3" status: 200 len: 1332 microversion: 2.1 time: 0.315822 Oct 23 01:11:32.925012 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 139/332] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:32 2022] GET /compute/v2.1/servers/9bb5ab44-057e-4115-a477-602ef6feece3 => generated 1332 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:32.966099 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=33 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:33.140611 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-afc2c4ec-8e29-4a93-ae34-b2dc1edc303a tempest-SecurityGroupsTestAdminJSON-1373789967 tempest-SecurityGroupsTestAdminJSON-1373789967-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 218 microversion: 2.1 time: 1.256815 Oct 23 01:11:33.150162 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 194/333] 10.222.0.42 () {60 vars in 1180 bytes} [Sun Oct 23 01:11:31 2022] POST /compute/v2.1/os-security-groups => generated 218 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:33.155999 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bfdf74d9-b824-4326-aabc-98134a26d494 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:33.156936 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-bfdf74d9-b824-4326-aabc-98134a26d494 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 26043446-8442-4d38-98d8-6ff9a1432d1b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:33.165828 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bfdf74d9-b824-4326-aabc-98134a26d494 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:33.165828 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bfdf74d9-b824-4326-aabc-98134a26d494 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:33.166235 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bfdf74d9-b824-4326-aabc-98134a26d494 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:33.167357 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bfdf74d9-b824-4326-aabc-98134a26d494 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:33.168280 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bfdf74d9-b824-4326-aabc-98134a26d494 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:33.168858 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bfdf74d9-b824-4326-aabc-98134a26d494 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:33.329586 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bfdf74d9-b824-4326-aabc-98134a26d494 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:33.337625 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bfdf74d9-b824-4326-aabc-98134a26d494 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b" status: 200 len: 1494 microversion: 2.1 time: 0.186384 Oct 23 01:11:33.338474 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 195/334] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:33 2022] GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b => generated 1494 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:33.343540 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1876b47b-0086-47f6-a3be-f6d4bdbcbbb8 tempest-SecurityGroupsTestAdminJSON-1373789967 tempest-SecurityGroupsTestAdminJSON-1373789967-project] Action: 'create', calling method: .version_select at 0x7f5cc286b3a0>, body: {"security_group": {"name": "tempest-securitygroup-828133851", "description": "tempest-description-819501267"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:33.384908 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-306d5777-9189-4bc0-8c87-6385d0eec039 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-56232455", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:33.444462 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-306d5777-9189-4bc0-8c87-6385d0eec039 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] validate_networks() for None {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:11:33.686890 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-306d5777-9189-4bc0-8c87-6385d0eec039 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:11:33.687392 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-306d5777-9189-4bc0-8c87-6385d0eec039 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:11:33.687918 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-306d5777-9189-4bc0-8c87-6385d0eec039 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:11:33.688346 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-306d5777-9189-4bc0-8c87-6385d0eec039 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:11:33.688733 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-306d5777-9189-4bc0-8c87-6385d0eec039 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:11:33.699898 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-306d5777-9189-4bc0-8c87-6385d0eec039 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:33.699898 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-306d5777-9189-4bc0-8c87-6385d0eec039 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:33.710348 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-306d5777-9189-4bc0-8c87-6385d0eec039 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:33.711591 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-306d5777-9189-4bc0-8c87-6385d0eec039 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:33.712356 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-306d5777-9189-4bc0-8c87-6385d0eec039 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:33.713027 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-306d5777-9189-4bc0-8c87-6385d0eec039 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:33.734082 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-306d5777-9189-4bc0-8c87-6385d0eec039 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Getting quotas for project 23f22fb0ca7346c4ab225ce82d69118c. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:11:33.738980 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-306d5777-9189-4bc0-8c87-6385d0eec039 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Getting quotas for user 76739eabf8804ec2af41abc4c1e6fd4b and project 23f22fb0ca7346c4ab225ce82d69118c. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:11:33.753754 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-306d5777-9189-4bc0-8c87-6385d0eec039 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:11:33.756095 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-306d5777-9189-4bc0-8c87-6385d0eec039 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] [instance: 56fab46b-b733-4279-8e6b-dd6b11013fb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:11:33.867214 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1876b47b-0086-47f6-a3be-f6d4bdbcbbb8 tempest-SecurityGroupsTestAdminJSON-1373789967 tempest-SecurityGroupsTestAdminJSON-1373789967-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.524924 Oct 23 01:11:33.867214 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 196/335] 10.222.0.42 () {60 vars in 1180 bytes} [Sun Oct 23 01:11:33 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:33.901545 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-306d5777-9189-4bc0-8c87-6385d0eec039 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.974963 Oct 23 01:11:33.902881 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 140/336] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:11:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 977 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:11:34.241364 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fffa9e4c-03ad-4502-9af5-ce363b6ebf71 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:34.242203 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-fffa9e4c-03ad-4502-9af5-ce363b6ebf71 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] [instance: 26043446-8442-4d38-98d8-6ff9a1432d1b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:34.249370 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fffa9e4c-03ad-4502-9af5-ce363b6ebf71 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:34.249370 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fffa9e4c-03ad-4502-9af5-ce363b6ebf71 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:34.249370 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fffa9e4c-03ad-4502-9af5-ce363b6ebf71 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:34.250151 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fffa9e4c-03ad-4502-9af5-ce363b6ebf71 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:34.250620 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fffa9e4c-03ad-4502-9af5-ce363b6ebf71 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:34.251044 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fffa9e4c-03ad-4502-9af5-ce363b6ebf71 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:34.273899 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-98fefe5c-b08d-446e-9a43-b2c59ad254e2 tempest-SecurityGroupsTestAdminJSON-1493241795 tempest-SecurityGroupsTestAdminJSON-1493241795-project-admin] Action: 'create', calling method: .version_select at 0x7f5cc28ac1f0>, body: {"security_group": {"name": "tempest-securitygroup-478372746", "description": "tempest-description-147456705"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:34.404733 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fffa9e4c-03ad-4502-9af5-ce363b6ebf71 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b" status: 200 len: 1645 microversion: 2.1 time: 0.538510 Oct 23 01:11:34.413601 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 197/337] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:33 2022] GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b => generated 1645 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:34.416316 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6c1e1e59-4b7f-452a-ad58-28fefc12357e tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:34.416968 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6c1e1e59-4b7f-452a-ad58-28fefc12357e tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] [instance: 56fab46b-b733-4279-8e6b-dd6b11013fb2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:34.473156 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6c1e1e59-4b7f-452a-ad58-28fefc12357e tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76739eabf8804ec2af41abc4c1e6fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f22fb0ca7346c4ab225ce82d69118c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:34.481758 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6c1e1e59-4b7f-452a-ad58-28fefc12357e tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] 10.222.0.42 "GET /compute/v2.1/servers/56fab46b-b733-4279-8e6b-dd6b11013fb2" status: 200 len: 1218 microversion: 2.1 time: 0.074924 Oct 23 01:11:34.484184 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 198/338] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:34 2022] GET /compute/v2.1/servers/56fab46b-b733-4279-8e6b-dd6b11013fb2 => generated 1218 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:34.505272 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-50664812-cee6-4e0e-96f3-b117595924dd tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:34.506107 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-50664812-cee6-4e0e-96f3-b117595924dd tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] [instance: 9bb5ab44-057e-4115-a477-602ef6feece3] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:34.512611 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-50664812-cee6-4e0e-96f3-b117595924dd tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:34.513638 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-50664812-cee6-4e0e-96f3-b117595924dd tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:34.519559 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-50664812-cee6-4e0e-96f3-b117595924dd tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:34.519559 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-50664812-cee6-4e0e-96f3-b117595924dd tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:34.519559 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-50664812-cee6-4e0e-96f3-b117595924dd tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:34.520006 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-50664812-cee6-4e0e-96f3-b117595924dd tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:34.714059 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-50664812-cee6-4e0e-96f3-b117595924dd tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c84b03f3f8431e9d3c0cbb792aeaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7864a40d26e402d815d39ef0c0f91a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:34.722877 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-50664812-cee6-4e0e-96f3-b117595924dd tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] 10.222.0.42 "GET /compute/v2.1/servers/9bb5ab44-057e-4115-a477-602ef6feece3" status: 200 len: 1332 microversion: 2.1 time: 0.237426 Oct 23 01:11:34.723436 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 199/339] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:34 2022] GET /compute/v2.1/servers/9bb5ab44-057e-4115-a477-602ef6feece3 => generated 1332 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:34.728070 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-972ab0b9-43e4-474d-9493-e68e75e036c8 req-613bf1fd-6623-4c4f-a5a9-50d761f8c8f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bb5ab44-057e-4115-a477-602ef6feece3", "name": "network-vif-plugged", "status": "completed", "tag": "f52b7234-1d59-4c35-8b9d-e94552c618c2"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:34.737570 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-972ab0b9-43e4-474d-9493-e68e75e036c8 req-613bf1fd-6623-4c4f-a5a9-50d761f8c8f4 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:34.738202 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-972ab0b9-43e4-474d-9493-e68e75e036c8 req-613bf1fd-6623-4c4f-a5a9-50d761f8c8f4 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:34.738735 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-972ab0b9-43e4-474d-9493-e68e75e036c8 req-613bf1fd-6623-4c4f-a5a9-50d761f8c8f4 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:34.750945 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-972ab0b9-43e4-474d-9493-e68e75e036c8 req-613bf1fd-6623-4c4f-a5a9-50d761f8c8f4 service nova] Creating event network-vif-plugged:f52b7234-1d59-4c35-8b9d-e94552c618c2 for instance 9bb5ab44-057e-4115-a477-602ef6feece3 on n-h2-master-1 Oct 23 01:11:34.756271 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-972ab0b9-43e4-474d-9493-e68e75e036c8 req-613bf1fd-6623-4c4f-a5a9-50d761f8c8f4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031722 Oct 23 01:11:34.757423 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 200/340] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:34.763523 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-531d857c-d67d-4d15-8262-af10c08c2186 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:34.767717 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-531d857c-d67d-4d15-8262-af10c08c2186 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] [instance: 26043446-8442-4d38-98d8-6ff9a1432d1b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:34.775891 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-531d857c-d67d-4d15-8262-af10c08c2186 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:34.776388 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-531d857c-d67d-4d15-8262-af10c08c2186 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:34.776829 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-531d857c-d67d-4d15-8262-af10c08c2186 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:34.777586 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-531d857c-d67d-4d15-8262-af10c08c2186 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:34.778103 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-531d857c-d67d-4d15-8262-af10c08c2186 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:34.779285 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-531d857c-d67d-4d15-8262-af10c08c2186 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:35.250427 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-531d857c-d67d-4d15-8262-af10c08c2186 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b" status: 200 len: 1645 microversion: 2.1 time: 0.491533 Oct 23 01:11:35.251325 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 201/341] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:34 2022] GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b => generated 1645 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:35.356378 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-98fefe5c-b08d-446e-9a43-b2c59ad254e2 tempest-SecurityGroupsTestAdminJSON-1493241795 tempest-SecurityGroupsTestAdminJSON-1493241795-project-admin] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.452138 Oct 23 01:11:35.358347 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 141/342] 10.222.0.42 () {60 vars in 1180 bytes} [Sun Oct 23 01:11:33 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:35.452977 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-eefc9ff2-1176-475d-840d-736d68a7da11 tempest-HypervisorAdminV228Test-765181382 tempest-HypervisorAdminV228Test-765181382-project-admin] Calling method '.version_select at 0x7f5cc271b160>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:35.454867 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eefc9ff2-1176-475d-840d-736d68a7da11 tempest-HypervisorAdminV228Test-765181382 tempest-HypervisorAdminV228Test-765181382-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:35.455438 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eefc9ff2-1176-475d-840d-736d68a7da11 tempest-HypervisorAdminV228Test-765181382 tempest-HypervisorAdminV228Test-765181382-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:35.455932 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eefc9ff2-1176-475d-840d-736d68a7da11 tempest-HypervisorAdminV228Test-765181382 tempest-HypervisorAdminV228Test-765181382-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:35.469758 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eefc9ff2-1176-475d-840d-736d68a7da11 tempest-HypervisorAdminV228Test-765181382 tempest-HypervisorAdminV228Test-765181382-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:35.470262 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eefc9ff2-1176-475d-840d-736d68a7da11 tempest-HypervisorAdminV228Test-765181382 tempest-HypervisorAdminV228Test-765181382-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:35.470861 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eefc9ff2-1176-475d-840d-736d68a7da11 tempest-HypervisorAdminV228Test-765181382 tempest-HypervisorAdminV228Test-765181382-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:35.481280 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eefc9ff2-1176-475d-840d-736d68a7da11 tempest-HypervisorAdminV228Test-765181382 tempest-HypervisorAdminV228Test-765181382-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:35.482244 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eefc9ff2-1176-475d-840d-736d68a7da11 tempest-HypervisorAdminV228Test-765181382 tempest-HypervisorAdminV228Test-765181382-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:35.482683 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eefc9ff2-1176-475d-840d-736d68a7da11 tempest-HypervisorAdminV228Test-765181382 tempest-HypervisorAdminV228Test-765181382-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:35.488663 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-eefc9ff2-1176-475d-840d-736d68a7da11 tempest-HypervisorAdminV228Test-765181382 tempest-HypervisorAdminV228Test-765181382-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.236238 Oct 23 01:11:35.489236 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 202/343] 10.222.0.42 () {60 vars in 1187 bytes} [Sun Oct 23 01:11:35 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:11:35.493612 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-69d1c377-d375-4f6e-bd8f-bc480b635331 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:35.497994 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-69d1c377-d375-4f6e-bd8f-bc480b635331 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:35.498505 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-69d1c377-d375-4f6e-bd8f-bc480b635331 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:35.498935 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-69d1c377-d375-4f6e-bd8f-bc480b635331 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:35.499649 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-69d1c377-d375-4f6e-bd8f-bc480b635331 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:35.500096 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-69d1c377-d375-4f6e-bd8f-bc480b635331 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:35.500509 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-69d1c377-d375-4f6e-bd8f-bc480b635331 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:35.523743 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-69d1c377-d375-4f6e-bd8f-bc480b635331 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.033342 Oct 23 01:11:35.524338 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 203/344] 10.222.0.42 () {58 vars in 1176 bytes} [Sun Oct 23 01:11:35 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:35.529164 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7ba5734e-1c3b-4bde-b1c1-c3d54f1c1159 tempest-SecurityGroupsTestAdminJSON-1493241795 tempest-SecurityGroupsTestAdminJSON-1493241795-project-admin] Action: 'create', calling method: .version_select at 0x7f5cc272f700>, body: {"security_group": {"name": "tempest-securitygroup-2085755682", "description": "tempest-description-2047934197"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:35.575953 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a2617e3d-0df3-43d4-a02f-4b5771030dcb tempest-AZAdminNegativeTestJSON-631582901 tempest-AZAdminNegativeTestJSON-631582901-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:35.578604 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a2617e3d-0df3-43d4-a02f-4b5771030dcb tempest-AZAdminNegativeTestJSON-631582901 tempest-AZAdminNegativeTestJSON-631582901-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '269ef25716954fa2b7b80cfcda99cb6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37875974503449409bf580c2c46365eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:35.579790 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a2617e3d-0df3-43d4-a02f-4b5771030dcb tempest-AZAdminNegativeTestJSON-631582901 tempest-AZAdminNegativeTestJSON-631582901-project] Request method failure captured: Oct 23 01:11:35.579790 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 23 01:11:35.579790 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:11:35.579790 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:11:35.579790 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:11:35.579790 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:11:35.579790 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:11:35.579790 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:11:35.579790 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:11:35.579790 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:11:35.579790 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJTFbfeHidXZ4B2_WqXWavYaVxPx8K8h0uey-D52PYb-c0QYFCmT3akRIAlSSlyCVkYzVPzQYwD6YcxgxpVy0_YCK_H6pWQxhB8VMwEtI4mnKko0-iEQkvyMSkwxn5TTM7cN5xZ0kDAaJeocd7cYVGjReW3B9rf2kCwzhFfP-rQn80w Oct 23 01:11:35.579790 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:11:35.579790 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:11:35.579790 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:11:35.579790 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:11:35.579790 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:11:35.579790 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:11:35.579790 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 37875974503449409bf580c2c46365eb Oct 23 01:11:35.579790 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-AZAdminNegativeTestJSON-631582901 Oct 23 01:11:35.579790 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:11:35.579790 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:11:35.581263 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/37875974503449409bf580c2c46365eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_37875974503449409bf580c2c46365eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/37875974503449409bf580c2c46365eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/37875974503449409bf580c2c46365eb"}]}] Oct 23 01:11:35.581263 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-AZAdminNegativeTestJSON-631582901 Oct 23 01:11:35.581263 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 37875974503449409bf580c2c46365eb Oct 23 01:11:35.581263 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-631582901 Oct 23 01:11:35.581263 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-AZAdminNegativeTestJSON-631582901-project Oct 23 01:11:35.581263 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:11:35.581263 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:11:35.581263 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 269ef25716954fa2b7b80cfcda99cb6e Oct 23 01:11:35.581263 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-AZAdminNegativeTestJSON-631582901-project Oct 23 01:11:35.581263 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:11:35.581263 n-d-master-1 devstack@n-api.service[120944]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 23 01:11:35.581263 n-d-master-1 devstack@n-api.service[120944]: action_args: {} Oct 23 01:11:35.582033 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:11:35.582033 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:35.582033 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:35.582033 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:35.582033 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:11:35.582033 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:11:35.582033 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:11:35.582033 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:11:35.582033 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 23 01:11:35.582033 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 23 01:11:35.582033 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 23 01:11:35.582033 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 23 01:11:35.582033 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 23 01:11:35.582033 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 23 01:11:35.582033 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:11:35.582033 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 23 01:11:35.582033 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:11:35.582033 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise self.value Oct 23 01:11:35.582033 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 23 01:11:35.583432 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 23 01:11:35.583432 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 23 01:11:35.583432 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 23 01:11:35.583432 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 23 01:11:35.583432 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 23 01:11:35.583432 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 23 01:11:35.583432 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:35.583432 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:11:35.583432 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:35.583432 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:35.583432 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:35.583432 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:35.583432 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 23 01:11:35.583432 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 23 01:11:35.583432 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 23 01:11:35.583432 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:35.583432 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a2617e3d-0df3-43d4-a02f-4b5771030dcb tempest-AZAdminNegativeTestJSON-631582901 tempest-AZAdminNegativeTestJSON-631582901-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:11:35.585072 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a2617e3d-0df3-43d4-a02f-4b5771030dcb tempest-AZAdminNegativeTestJSON-631582901 tempest-AZAdminNegativeTestJSON-631582901-project] 10.222.0.42 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.222705 Oct 23 01:11:35.585072 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 142/345] 10.222.0.42 () {58 vars in 1185 bytes} [Sun Oct 23 01:11:35 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 225 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:11:35.589253 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d65ee569-5cd3-4ac0-9579-e7104fc923e7 tempest-HypervisorAdminV228Test-765181382 tempest-HypervisorAdminV228Test-765181382-project-admin] Calling method '.version_select at 0x7f5cc29fe310>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:35.591612 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d65ee569-5cd3-4ac0-9579-e7104fc923e7 tempest-HypervisorAdminV228Test-765181382 tempest-HypervisorAdminV228Test-765181382-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:35.592127 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d65ee569-5cd3-4ac0-9579-e7104fc923e7 tempest-HypervisorAdminV228Test-765181382 tempest-HypervisorAdminV228Test-765181382-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:35.592606 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d65ee569-5cd3-4ac0-9579-e7104fc923e7 tempest-HypervisorAdminV228Test-765181382 tempest-HypervisorAdminV228Test-765181382-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:35.605211 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d65ee569-5cd3-4ac0-9579-e7104fc923e7 tempest-HypervisorAdminV228Test-765181382 tempest-HypervisorAdminV228Test-765181382-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:35.605952 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d65ee569-5cd3-4ac0-9579-e7104fc923e7 tempest-HypervisorAdminV228Test-765181382 tempest-HypervisorAdminV228Test-765181382-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:35.607182 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d65ee569-5cd3-4ac0-9579-e7104fc923e7 tempest-HypervisorAdminV228Test-765181382 tempest-HypervisorAdminV228Test-765181382-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:35.613643 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d65ee569-5cd3-4ac0-9579-e7104fc923e7 tempest-HypervisorAdminV228Test-765181382 tempest-HypervisorAdminV228Test-765181382-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.028683 Oct 23 01:11:35.614471 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 143/346] 10.222.0.42 () {60 vars in 1193 bytes} [Sun Oct 23 01:11:35 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:11:35.619259 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-19bd96ad-1ac1-4735-82be-7474cb7c491b tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:35.619867 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-19bd96ad-1ac1-4735-82be-7474cb7c491b tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] [instance: 56fab46b-b733-4279-8e6b-dd6b11013fb2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:35.625899 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-19bd96ad-1ac1-4735-82be-7474cb7c491b tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:35.626435 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-19bd96ad-1ac1-4735-82be-7474cb7c491b tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:35.626966 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-19bd96ad-1ac1-4735-82be-7474cb7c491b tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:35.627661 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-19bd96ad-1ac1-4735-82be-7474cb7c491b tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:35.628282 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-19bd96ad-1ac1-4735-82be-7474cb7c491b tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:35.628707 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-19bd96ad-1ac1-4735-82be-7474cb7c491b tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:35.701649 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-19bd96ad-1ac1-4735-82be-7474cb7c491b tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76739eabf8804ec2af41abc4c1e6fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f22fb0ca7346c4ab225ce82d69118c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:35.710817 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-19bd96ad-1ac1-4735-82be-7474cb7c491b tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] 10.222.0.42 "GET /compute/v2.1/servers/56fab46b-b733-4279-8e6b-dd6b11013fb2" status: 200 len: 1222 microversion: 2.1 time: 0.095064 Oct 23 01:11:35.711729 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 144/347] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:35 2022] GET /compute/v2.1/servers/56fab46b-b733-4279-8e6b-dd6b11013fb2 => generated 1222 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:35.718631 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6cad0986-4fbd-4275-b9c3-36b520fea04a tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:35.722892 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6cad0986-4fbd-4275-b9c3-36b520fea04a tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] [instance: 26043446-8442-4d38-98d8-6ff9a1432d1b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:35.729250 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6cad0986-4fbd-4275-b9c3-36b520fea04a tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:35.730072 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6cad0986-4fbd-4275-b9c3-36b520fea04a tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:35.730761 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6cad0986-4fbd-4275-b9c3-36b520fea04a tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:35.739093 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6cad0986-4fbd-4275-b9c3-36b520fea04a tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:35.739093 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6cad0986-4fbd-4275-b9c3-36b520fea04a tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:35.739093 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6cad0986-4fbd-4275-b9c3-36b520fea04a tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:35.824133 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-6cad0986-4fbd-4275-b9c3-36b520fea04a tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lazy-loading 'flavor' on Instance uuid 26043446-8442-4d38-98d8-6ff9a1432d1b {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:11:35.877157 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6cad0986-4fbd-4275-b9c3-36b520fea04a tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] [instance: 26043446-8442-4d38-98d8-6ff9a1432d1b] Going to try to live migrate instance to n-h2-master-1 {{(pid=120944) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 23 01:11:35.881951 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=100 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:35.933693 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7ba5734e-1c3b-4bde-b1c1-c3d54f1c1159 tempest-SecurityGroupsTestAdminJSON-1493241795 tempest-SecurityGroupsTestAdminJSON-1493241795-project-admin] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.408328 Oct 23 01:11:35.934318 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 204/348] 10.222.0.42 () {60 vars in 1180 bytes} [Sun Oct 23 01:11:35 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:35.938840 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3e717f9d-5d85-4e64-9ee8-0bc11dd5d1bd tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:35.939434 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3e717f9d-5d85-4e64-9ee8-0bc11dd5d1bd tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] [instance: 9bb5ab44-057e-4115-a477-602ef6feece3] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:35.945243 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3e717f9d-5d85-4e64-9ee8-0bc11dd5d1bd tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:35.945714 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3e717f9d-5d85-4e64-9ee8-0bc11dd5d1bd tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:35.946206 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3e717f9d-5d85-4e64-9ee8-0bc11dd5d1bd tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:35.946880 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3e717f9d-5d85-4e64-9ee8-0bc11dd5d1bd tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:35.947326 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3e717f9d-5d85-4e64-9ee8-0bc11dd5d1bd tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:35.947739 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3e717f9d-5d85-4e64-9ee8-0bc11dd5d1bd tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:36.083147 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3e717f9d-5d85-4e64-9ee8-0bc11dd5d1bd tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c84b03f3f8431e9d3c0cbb792aeaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7864a40d26e402d815d39ef0c0f91a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:36.096931 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3e717f9d-5d85-4e64-9ee8-0bc11dd5d1bd tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] 10.222.0.42 "GET /compute/v2.1/servers/9bb5ab44-057e-4115-a477-602ef6feece3" status: 200 len: 1332 microversion: 2.1 time: 0.161530 Oct 23 01:11:36.097840 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 205/349] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:35 2022] GET /compute/v2.1/servers/9bb5ab44-057e-4115-a477-602ef6feece3 => generated 1332 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:36.102522 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-79a09f59-b5a2-4ed4-b599-49e2a82f4f02 tempest-SecurityGroupsTestAdminJSON-1493241795 tempest-SecurityGroupsTestAdminJSON-1493241795-project-admin] Calling method '.version_select at 0x7f5cc286b430>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:38.134810 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-79a09f59-b5a2-4ed4-b599-49e2a82f4f02 tempest-SecurityGroupsTestAdminJSON-1493241795 tempest-SecurityGroupsTestAdminJSON-1493241795-project-admin] 10.222.0.42 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 8307 microversion: 2.1 time: 2.035583 Oct 23 01:11:38.151625 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 206/350] 10.222.0.42 () {58 vars in 1191 bytes} [Sun Oct 23 01:11:36 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 8307 bytes in 2053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:38.158987 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1fa187e4-8f94-4126-8f1d-e6137bc92f24 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:38.159606 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1fa187e4-8f94-4126-8f1d-e6137bc92f24 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] [instance: 56fab46b-b733-4279-8e6b-dd6b11013fb2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:38.168129 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1fa187e4-8f94-4126-8f1d-e6137bc92f24 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:38.168529 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1fa187e4-8f94-4126-8f1d-e6137bc92f24 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:38.169478 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1fa187e4-8f94-4126-8f1d-e6137bc92f24 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:38.170205 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1fa187e4-8f94-4126-8f1d-e6137bc92f24 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:38.170654 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1fa187e4-8f94-4126-8f1d-e6137bc92f24 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:38.171244 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1fa187e4-8f94-4126-8f1d-e6137bc92f24 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:38.241315 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1fa187e4-8f94-4126-8f1d-e6137bc92f24 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76739eabf8804ec2af41abc4c1e6fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f22fb0ca7346c4ab225ce82d69118c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:38.250867 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1fa187e4-8f94-4126-8f1d-e6137bc92f24 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] 10.222.0.42 "GET /compute/v2.1/servers/56fab46b-b733-4279-8e6b-dd6b11013fb2" status: 200 len: 1276 microversion: 2.1 time: 0.097410 Oct 23 01:11:38.251592 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 207/351] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:38 2022] GET /compute/v2.1/servers/56fab46b-b733-4279-8e6b-dd6b11013fb2 => generated 1276 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:38.524596 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-540c6240-0b32-495b-aac3-445efbf9e4ba tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-110942062", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": "none"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:38.604347 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-540c6240-0b32-495b-aac3-445efbf9e4ba tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:11:38.605649 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-540c6240-0b32-495b-aac3-445efbf9e4ba tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:11:38.606379 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-540c6240-0b32-495b-aac3-445efbf9e4ba tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:11:38.607503 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-540c6240-0b32-495b-aac3-445efbf9e4ba tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:11:38.608546 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-540c6240-0b32-495b-aac3-445efbf9e4ba tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:11:38.621075 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-540c6240-0b32-495b-aac3-445efbf9e4ba tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:38.621568 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-540c6240-0b32-495b-aac3-445efbf9e4ba tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:38.622790 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-540c6240-0b32-495b-aac3-445efbf9e4ba tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:38.622946 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-540c6240-0b32-495b-aac3-445efbf9e4ba tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:38.627044 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-540c6240-0b32-495b-aac3-445efbf9e4ba tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:38.627044 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-540c6240-0b32-495b-aac3-445efbf9e4ba tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:38.643035 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-540c6240-0b32-495b-aac3-445efbf9e4ba tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Getting quotas for project 936723f56dc549bd9b8e73c97297edf1. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:11:38.648079 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-540c6240-0b32-495b-aac3-445efbf9e4ba tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Getting quotas for user 7b22ae04637942879cfd29edc41a5483 and project 936723f56dc549bd9b8e73c97297edf1. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:11:38.685731 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-540c6240-0b32-495b-aac3-445efbf9e4ba tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:11:38.688610 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-540c6240-0b32-495b-aac3-445efbf9e4ba tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:11:38.860039 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-540c6240-0b32-495b-aac3-445efbf9e4ba tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.591359 Oct 23 01:11:38.867605 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 208/352] 10.222.0.42 () {62 vars in 1188 bytes} [Sun Oct 23 01:11:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 23 01:11:38.872867 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d890aba9-b95a-4e9d-a513-442291570f46 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:38.873489 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d890aba9-b95a-4e9d-a513-442291570f46 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] [instance: 9bb5ab44-057e-4115-a477-602ef6feece3] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:38.881788 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d890aba9-b95a-4e9d-a513-442291570f46 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:38.881788 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d890aba9-b95a-4e9d-a513-442291570f46 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:38.881788 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d890aba9-b95a-4e9d-a513-442291570f46 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:38.882138 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d890aba9-b95a-4e9d-a513-442291570f46 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:38.882138 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d890aba9-b95a-4e9d-a513-442291570f46 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:38.882353 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d890aba9-b95a-4e9d-a513-442291570f46 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:39.114702 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d890aba9-b95a-4e9d-a513-442291570f46 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c84b03f3f8431e9d3c0cbb792aeaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7864a40d26e402d815d39ef0c0f91a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:39.119282 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=100 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:39.125598 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d890aba9-b95a-4e9d-a513-442291570f46 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] 10.222.0.42 "GET /compute/v2.1/servers/9bb5ab44-057e-4115-a477-602ef6feece3" status: 200 len: 1536 microversion: 2.1 time: 0.256700 Oct 23 01:11:39.126383 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 209/353] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:38 2022] GET /compute/v2.1/servers/9bb5ab44-057e-4115-a477-602ef6feece3 => generated 1536 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:39.131341 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b355025f-e34b-4b22-97a9-c9196234b697 tempest-SecurityGroupsTestAdminJSON-1373789967 tempest-SecurityGroupsTestAdminJSON-1373789967-project] Calling method '.version_select at 0x7f5cc286baf0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:39.607595 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b355025f-e34b-4b22-97a9-c9196234b697 tempest-SecurityGroupsTestAdminJSON-1373789967 tempest-SecurityGroupsTestAdminJSON-1373789967-project] 10.222.0.42 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1108 microversion: 2.1 time: 0.479908 Oct 23 01:11:39.608507 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 210/354] 10.222.0.42 () {58 vars in 1191 bytes} [Sun Oct 23 01:11:39 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1108 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:39.614495 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-38b63743-8a72-4dd9-b275-299ad2d95216 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:39.616819 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-38b63743-8a72-4dd9-b275-299ad2d95216 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:39.695127 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-38b63743-8a72-4dd9-b275-299ad2d95216 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:39.718055 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-38b63743-8a72-4dd9-b275-299ad2d95216 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:39.718055 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-38b63743-8a72-4dd9-b275-299ad2d95216 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:39.728459 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-38b63743-8a72-4dd9-b275-299ad2d95216 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1452 microversion: 2.91 time: 0.118484 Oct 23 01:11:39.729530 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 211/355] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:11:39 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1452 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:11:39.740797 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3bc12141-51b2-49c4-bd00-dc7a14257997 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Action: 'create', calling method: .version_select at 0x7f5cc26d9670>, body: {"pool": "e33e8d81-9a30-4a90-a2ad-d9c074d3dc77"} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:40.440559 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6cad0986-4fbd-4275-b9c3-36b520fea04a tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b/action" status: 202 len: 0 microversion: 2.1 time: 4.727401 Oct 23 01:11:40.442266 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 145/356] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:11:35 2022] POST /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b/action => generated 0 bytes in 4730 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:11:40.449392 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-151f4c9d-a757-499d-828b-5ab55ce8a715 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:40.451134 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-151f4c9d-a757-499d-828b-5ab55ce8a715 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] [instance: 56fab46b-b733-4279-8e6b-dd6b11013fb2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:40.460730 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-151f4c9d-a757-499d-828b-5ab55ce8a715 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:40.462312 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-151f4c9d-a757-499d-828b-5ab55ce8a715 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:40.462913 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-151f4c9d-a757-499d-828b-5ab55ce8a715 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:40.463811 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-151f4c9d-a757-499d-828b-5ab55ce8a715 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:40.464888 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-151f4c9d-a757-499d-828b-5ab55ce8a715 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:40.466251 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-151f4c9d-a757-499d-828b-5ab55ce8a715 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:40.812981 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-151f4c9d-a757-499d-828b-5ab55ce8a715 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76739eabf8804ec2af41abc4c1e6fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f22fb0ca7346c4ab225ce82d69118c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:40.825779 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-151f4c9d-a757-499d-828b-5ab55ce8a715 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] 10.222.0.42 "GET /compute/v2.1/servers/56fab46b-b733-4279-8e6b-dd6b11013fb2" status: 200 len: 1318 microversion: 2.1 time: 0.381425 Oct 23 01:11:40.826433 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 146/357] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:40 2022] GET /compute/v2.1/servers/56fab46b-b733-4279-8e6b-dd6b11013fb2 => generated 1318 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:40.832103 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3e82d834-0e84-41af-a22b-540814a4e053 tempest-SecurityGroupsTestAdminJSON-1493241795 tempest-SecurityGroupsTestAdminJSON-1493241795-project-admin] Calling method '.version_select at 0x7f5cc28f3670>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:41.551640 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3e82d834-0e84-41af-a22b-540814a4e053 tempest-SecurityGroupsTestAdminJSON-1493241795 tempest-SecurityGroupsTestAdminJSON-1493241795-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/af427e9d-d30d-46dc-850c-dfc931cd2d69" status: 202 len: 0 microversion: 2.1 time: 0.723902 Oct 23 01:11:41.552521 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 147/358] 10.222.0.42 () {58 vars in 1272 bytes} [Sun Oct 23 01:11:40 2022] DELETE /compute/v2.1/os-security-groups/af427e9d-d30d-46dc-850c-dfc931cd2d69 => generated 0 bytes in 725 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:11:41.557311 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-3775616d-1111-4e67-9950-8d6fcab85edd req-e7cedb92-1549-4e35-9f22-86caeea9f0f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56fab46b-b733-4279-8e6b-dd6b11013fb2", "tag": "cae2b753-bc1e-4126-9fef-5c92c0eac33d"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:41.567725 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-3775616d-1111-4e67-9950-8d6fcab85edd req-e7cedb92-1549-4e35-9f22-86caeea9f0f8 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:41.568409 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-3775616d-1111-4e67-9950-8d6fcab85edd req-e7cedb92-1549-4e35-9f22-86caeea9f0f8 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:41.568839 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-3775616d-1111-4e67-9950-8d6fcab85edd req-e7cedb92-1549-4e35-9f22-86caeea9f0f8 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:41.579870 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-3775616d-1111-4e67-9950-8d6fcab85edd req-e7cedb92-1549-4e35-9f22-86caeea9f0f8 service nova] Creating event network-changed:cae2b753-bc1e-4126-9fef-5c92c0eac33d for instance 56fab46b-b733-4279-8e6b-dd6b11013fb2 on n-h1-master-1 Oct 23 01:11:41.584664 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-3775616d-1111-4e67-9950-8d6fcab85edd req-e7cedb92-1549-4e35-9f22-86caeea9f0f8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030767 Oct 23 01:11:41.585253 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 148/359] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:41.591440 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-48de13e3-ad2a-4eff-b50e-1a1567192b98 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:41.592331 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-48de13e3-ad2a-4eff-b50e-1a1567192b98 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 26043446-8442-4d38-98d8-6ff9a1432d1b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:41.598834 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-48de13e3-ad2a-4eff-b50e-1a1567192b98 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:41.599328 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-48de13e3-ad2a-4eff-b50e-1a1567192b98 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:41.599757 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-48de13e3-ad2a-4eff-b50e-1a1567192b98 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:41.600446 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-48de13e3-ad2a-4eff-b50e-1a1567192b98 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:41.600896 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-48de13e3-ad2a-4eff-b50e-1a1567192b98 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:41.601317 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-48de13e3-ad2a-4eff-b50e-1a1567192b98 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:41.889805 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-48de13e3-ad2a-4eff-b50e-1a1567192b98 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:41.898694 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-48de13e3-ad2a-4eff-b50e-1a1567192b98 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b" status: 200 len: 1504 microversion: 2.1 time: 0.312078 Oct 23 01:11:41.899273 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 149/360] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:41 2022] GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b => generated 1504 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:41.907821 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6a96c939-9736-4191-8501-601d0029e0da tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:41.908482 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6a96c939-9736-4191-8501-601d0029e0da tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:41.914684 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6a96c939-9736-4191-8501-601d0029e0da tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:41.915350 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6a96c939-9736-4191-8501-601d0029e0da tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:41.915781 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6a96c939-9736-4191-8501-601d0029e0da tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:41.916473 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6a96c939-9736-4191-8501-601d0029e0da tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:41.917162 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6a96c939-9736-4191-8501-601d0029e0da tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:41.917598 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6a96c939-9736-4191-8501-601d0029e0da tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:42.048188 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6a96c939-9736-4191-8501-601d0029e0da tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:42.056953 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6a96c939-9736-4191-8501-601d0029e0da tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:42.058517 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6a96c939-9736-4191-8501-601d0029e0da tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:42.063573 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:42.067562 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6a96c939-9736-4191-8501-601d0029e0da tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1512 microversion: 2.91 time: 0.166261 Oct 23 01:11:42.068388 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 150/361] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:11:41 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1512 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:11:42.308380 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b43b5e3b-1e5f-43e0-b12b-9d78edb048f2 tempest-HypervisorAdminV253TestBase-1734336234 tempest-HypervisorAdminV253TestBase-1734336234-project-admin] Calling method '.version_select at 0x7f5cc28f3670>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:42.312892 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b43b5e3b-1e5f-43e0-b12b-9d78edb048f2 tempest-HypervisorAdminV253TestBase-1734336234 tempest-HypervisorAdminV253TestBase-1734336234-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:42.313405 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b43b5e3b-1e5f-43e0-b12b-9d78edb048f2 tempest-HypervisorAdminV253TestBase-1734336234 tempest-HypervisorAdminV253TestBase-1734336234-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:42.313961 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b43b5e3b-1e5f-43e0-b12b-9d78edb048f2 tempest-HypervisorAdminV253TestBase-1734336234 tempest-HypervisorAdminV253TestBase-1734336234-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:42.328772 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b43b5e3b-1e5f-43e0-b12b-9d78edb048f2 tempest-HypervisorAdminV253TestBase-1734336234 tempest-HypervisorAdminV253TestBase-1734336234-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:42.329248 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b43b5e3b-1e5f-43e0-b12b-9d78edb048f2 tempest-HypervisorAdminV253TestBase-1734336234 tempest-HypervisorAdminV253TestBase-1734336234-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:42.329678 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b43b5e3b-1e5f-43e0-b12b-9d78edb048f2 tempest-HypervisorAdminV253TestBase-1734336234 tempest-HypervisorAdminV253TestBase-1734336234-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:42.366919 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b43b5e3b-1e5f-43e0-b12b-9d78edb048f2 tempest-HypervisorAdminV253TestBase-1734336234 tempest-HypervisorAdminV253TestBase-1734336234-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:42.367411 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b43b5e3b-1e5f-43e0-b12b-9d78edb048f2 tempest-HypervisorAdminV253TestBase-1734336234 tempest-HypervisorAdminV253TestBase-1734336234-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:42.367854 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b43b5e3b-1e5f-43e0-b12b-9d78edb048f2 tempest-HypervisorAdminV253TestBase-1734336234 tempest-HypervisorAdminV253TestBase-1734336234-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:42.378511 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b43b5e3b-1e5f-43e0-b12b-9d78edb048f2 tempest-HypervisorAdminV253TestBase-1734336234 tempest-HypervisorAdminV253TestBase-1734336234-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:42.378988 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b43b5e3b-1e5f-43e0-b12b-9d78edb048f2 tempest-HypervisorAdminV253TestBase-1734336234 tempest-HypervisorAdminV253TestBase-1734336234-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:42.379424 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b43b5e3b-1e5f-43e0-b12b-9d78edb048f2 tempest-HypervisorAdminV253TestBase-1734336234 tempest-HypervisorAdminV253TestBase-1734336234-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:42.402928 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b43b5e3b-1e5f-43e0-b12b-9d78edb048f2 tempest-HypervisorAdminV253TestBase-1734336234 tempest-HypervisorAdminV253TestBase-1734336234-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:42.403578 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b43b5e3b-1e5f-43e0-b12b-9d78edb048f2 tempest-HypervisorAdminV253TestBase-1734336234 tempest-HypervisorAdminV253TestBase-1734336234-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:42.403871 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b43b5e3b-1e5f-43e0-b12b-9d78edb048f2 tempest-HypervisorAdminV253TestBase-1734336234 tempest-HypervisorAdminV253TestBase-1734336234-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:42.410313 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b43b5e3b-1e5f-43e0-b12b-9d78edb048f2 tempest-HypervisorAdminV253TestBase-1734336234 tempest-HypervisorAdminV253TestBase-1734336234-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1994 microversion: 2.53 time: 0.340860 Oct 23 01:11:42.410824 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 151/362] 10.222.0.42 () {60 vars in 1243 bytes} [Sun Oct 23 01:11:42 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1994 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:11:42.416863 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3bc12141-51b2-49c4-bd00-dc7a14257997 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] 10.222.0.42 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.686228 Oct 23 01:11:42.417762 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 212/363] 10.222.0.42 () {60 vars in 1170 bytes} [Sun Oct 23 01:11:39 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2688 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:42.422634 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f5f2c837-8143-475d-b673-13c7867bcea2 tempest-SecurityGroupsTestAdminJSON-1493241795 tempest-SecurityGroupsTestAdminJSON-1493241795-project-admin] Calling method '.version_select at 0x7f5cc272fdc0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:42.473871 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8edd8896-af28-44df-b9e9-c3237ed2ff58 tempest-FlavorsExtraSpecsNegativeTestJSON-493559463 tempest-FlavorsExtraSpecsNegativeTestJSON-493559463-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1785449595", "ram": 512, "vcpus": 1, "disk": 10, "id": 1906332412, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:42.573327 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8edd8896-af28-44df-b9e9-c3237ed2ff58 tempest-FlavorsExtraSpecsNegativeTestJSON-493559463 tempest-FlavorsExtraSpecsNegativeTestJSON-493559463-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.161419 Oct 23 01:11:42.582916 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 152/364] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:11:42 2022] POST /compute/v2.1/flavors => generated 416 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:42.587996 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8cce7ef4-9c64-41f6-bab3-5c0adaf52c2f tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:42.588604 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8cce7ef4-9c64-41f6-bab3-5c0adaf52c2f tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] [instance: 56fab46b-b733-4279-8e6b-dd6b11013fb2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:42.594487 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8cce7ef4-9c64-41f6-bab3-5c0adaf52c2f tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:42.594975 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8cce7ef4-9c64-41f6-bab3-5c0adaf52c2f tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:42.595410 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8cce7ef4-9c64-41f6-bab3-5c0adaf52c2f tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:42.596131 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8cce7ef4-9c64-41f6-bab3-5c0adaf52c2f tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:42.596593 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8cce7ef4-9c64-41f6-bab3-5c0adaf52c2f tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:42.597016 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8cce7ef4-9c64-41f6-bab3-5c0adaf52c2f tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:42.702162 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f5f2c837-8143-475d-b673-13c7867bcea2 tempest-SecurityGroupsTestAdminJSON-1493241795 tempest-SecurityGroupsTestAdminJSON-1493241795-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/ff90089c-5578-4c8b-9914-e5090be96265" status: 202 len: 0 microversion: 2.1 time: 0.283300 Oct 23 01:11:42.702751 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 213/365] 10.222.0.42 () {58 vars in 1272 bytes} [Sun Oct 23 01:11:42 2022] DELETE /compute/v2.1/os-security-groups/ff90089c-5578-4c8b-9914-e5090be96265 => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:11:42.707239 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ee00e687-4504-4902-8181-59d254048375 tempest-HypervisorAdminV253TestBase-1734336234 tempest-HypervisorAdminV253TestBase-1734336234-project-admin] Calling method '.version_select at 0x7f5cc26fbca0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:42.711214 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee00e687-4504-4902-8181-59d254048375 tempest-HypervisorAdminV253TestBase-1734336234 tempest-HypervisorAdminV253TestBase-1734336234-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:42.711702 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee00e687-4504-4902-8181-59d254048375 tempest-HypervisorAdminV253TestBase-1734336234 tempest-HypervisorAdminV253TestBase-1734336234-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:42.712131 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee00e687-4504-4902-8181-59d254048375 tempest-HypervisorAdminV253TestBase-1734336234 tempest-HypervisorAdminV253TestBase-1734336234-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:42.729636 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee00e687-4504-4902-8181-59d254048375 tempest-HypervisorAdminV253TestBase-1734336234 tempest-HypervisorAdminV253TestBase-1734336234-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:42.730972 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee00e687-4504-4902-8181-59d254048375 tempest-HypervisorAdminV253TestBase-1734336234 tempest-HypervisorAdminV253TestBase-1734336234-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:42.731831 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee00e687-4504-4902-8181-59d254048375 tempest-HypervisorAdminV253TestBase-1734336234 tempest-HypervisorAdminV253TestBase-1734336234-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:42.754729 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee00e687-4504-4902-8181-59d254048375 tempest-HypervisorAdminV253TestBase-1734336234 tempest-HypervisorAdminV253TestBase-1734336234-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:42.755213 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee00e687-4504-4902-8181-59d254048375 tempest-HypervisorAdminV253TestBase-1734336234 tempest-HypervisorAdminV253TestBase-1734336234-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:42.755680 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee00e687-4504-4902-8181-59d254048375 tempest-HypervisorAdminV253TestBase-1734336234 tempest-HypervisorAdminV253TestBase-1734336234-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:42.765645 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee00e687-4504-4902-8181-59d254048375 tempest-HypervisorAdminV253TestBase-1734336234 tempest-HypervisorAdminV253TestBase-1734336234-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:42.766156 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee00e687-4504-4902-8181-59d254048375 tempest-HypervisorAdminV253TestBase-1734336234 tempest-HypervisorAdminV253TestBase-1734336234-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:42.766583 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee00e687-4504-4902-8181-59d254048375 tempest-HypervisorAdminV253TestBase-1734336234 tempest-HypervisorAdminV253TestBase-1734336234-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:42.789906 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee00e687-4504-4902-8181-59d254048375 tempest-HypervisorAdminV253TestBase-1734336234 tempest-HypervisorAdminV253TestBase-1734336234-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:42.790471 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee00e687-4504-4902-8181-59d254048375 tempest-HypervisorAdminV253TestBase-1734336234 tempest-HypervisorAdminV253TestBase-1734336234-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:42.790927 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee00e687-4504-4902-8181-59d254048375 tempest-HypervisorAdminV253TestBase-1734336234 tempest-HypervisorAdminV253TestBase-1734336234-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:42.798172 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ee00e687-4504-4902-8181-59d254048375 tempest-HypervisorAdminV253TestBase-1734336234 tempest-HypervisorAdminV253TestBase-1734336234-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 686 microversion: 2.53 time: 0.094404 Oct 23 01:11:42.806090 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 214/366] 10.222.0.42 () {60 vars in 1222 bytes} [Sun Oct 23 01:11:42 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 686 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:11:42.806090 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-46551def-e22e-4044-a210-73a5d1a02e27 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Action: 'action', calling method: .version_select at 0x7f5cc3c8daf0>, body: {"addFloatingIp": {"address": "172.35.6.168"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:42.811719 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-46551def-e22e-4044-a210-73a5d1a02e27 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] [instance: 9bb5ab44-057e-4115-a477-602ef6feece3] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:42.812278 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8cce7ef4-9c64-41f6-bab3-5c0adaf52c2f tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76739eabf8804ec2af41abc4c1e6fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f22fb0ca7346c4ab225ce82d69118c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:42.813043 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46551def-e22e-4044-a210-73a5d1a02e27 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:42.813532 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46551def-e22e-4044-a210-73a5d1a02e27 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:42.813960 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46551def-e22e-4044-a210-73a5d1a02e27 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:42.814751 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46551def-e22e-4044-a210-73a5d1a02e27 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:42.815236 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46551def-e22e-4044-a210-73a5d1a02e27 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:42.815658 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46551def-e22e-4044-a210-73a5d1a02e27 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:42.822261 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8cce7ef4-9c64-41f6-bab3-5c0adaf52c2f tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] 10.222.0.42 "GET /compute/v2.1/servers/56fab46b-b733-4279-8e6b-dd6b11013fb2" status: 200 len: 1318 microversion: 2.1 time: 0.237803 Oct 23 01:11:42.826835 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 153/367] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:42 2022] GET /compute/v2.1/servers/56fab46b-b733-4279-8e6b-dd6b11013fb2 => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:42.886504 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46551def-e22e-4044-a210-73a5d1a02e27 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Acquiring lock "refresh_cache-9bb5ab44-057e-4115-a477-602ef6feece3" {{(pid=120945) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 23 01:11:42.887004 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46551def-e22e-4044-a210-73a5d1a02e27 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Acquired lock "refresh_cache-9bb5ab44-057e-4115-a477-602ef6feece3" {{(pid=120945) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 23 01:11:42.932546 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5611f8b2-39f3-4d81-9fe9-e57071997376 tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072 tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:42.941646 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-5611f8b2-39f3-4d81-9fe9-e57071997376 tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072 tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072-project] HTTP exception thrown: Flavor 1906332412 has no extra specs with key hw:cpu_thread_policy. Oct 23 01:11:42.944542 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5611f8b2-39f3-4d81-9fe9-e57071997376 tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072 tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072-project] Request method failure captured: Oct 23 01:11:42.944542 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/flavors/1906332412/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 23 01:11:42.944542 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:11:42.944542 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:11:42.944542 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:11:42.944542 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:11:42.944542 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:11:42.944542 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:11:42.944542 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:11:42.944542 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:11:42.944542 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJTLflNke95DbW5J-QOIbHtvEepKMu0PKcegZeoyRJ83GBHFN8BPvzcCbLeQajsNrMx4_t0V6TLJy_k8AiAMnKzQyhQMWSNXebJ2DwN_ahf-YJ4EjUIBGOq07KZFSvOEpFM_b5pLjekuG1wWEPQbddNGQktzvgIlO2bmay1zWAnC6_U Oct 23 01:11:42.944542 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:11:42.944542 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:11:42.944542 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:11:42.944542 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:11:42.944542 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:11:42.944542 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:11:42.944542 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: f78b3e125cf549dbbce0f49864e9e91d Oct 23 01:11:42.944542 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072 Oct 23 01:11:42.944542 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:11:42.944542 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:11:42.946013 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f78b3e125cf549dbbce0f49864e9e91d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f78b3e125cf549dbbce0f49864e9e91d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f78b3e125cf549dbbce0f49864e9e91d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f78b3e125cf549dbbce0f49864e9e91d"}]}] Oct 23 01:11:42.946013 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072 Oct 23 01:11:42.946013 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: f78b3e125cf549dbbce0f49864e9e91d Oct 23 01:11:42.946013 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072 Oct 23 01:11:42.946013 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072-project Oct 23 01:11:42.946013 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:11:42.946013 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:11:42.946013 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 765c706a2ca846ebb377f808517f36a0 Oct 23 01:11:42.946013 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072-project Oct 23 01:11:42.946013 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:11:42.946013 n-d-master-1 devstack@n-api.service[120944]: exception: Flavor 1906332412 has no extra specs with key hw:cpu_thread_policy. Oct 23 01:11:42.946820 n-d-master-1 devstack@n-api.service[120944]: action_args: {'flavor_id': '1906332412', 'id': 'hw:cpu_thread_policy'} Oct 23 01:11:42.946820 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:11:42.946820 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:42.946820 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 23 01:11:42.946820 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 23 01:11:42.946820 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 23 01:11:42.946820 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:42.946820 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:11:42.946820 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:42.946820 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:42.946820 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:42.946820 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:42.946820 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:11:42.946820 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:11:42.946820 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:11:42.946820 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:11:42.946820 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 23 01:11:42.946820 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 23 01:11:42.946820 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1906332412 has no extra specs with key hw:cpu_thread_policy. Oct 23 01:11:42.946820 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:42.946820 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:11:42.946820 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:42.948281 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:42.948281 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:42.948281 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:42.948281 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:11:42.948281 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:11:42.948281 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1906332412 has no extra specs with key hw:cpu_thread_policy. Oct 23 01:11:42.948281 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:42.948281 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5611f8b2-39f3-4d81-9fe9-e57071997376 tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072 tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072-project] Returning 404 to user: Flavor 1906332412 has no extra specs with key hw:cpu_thread_policy. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:11:42.948807 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5611f8b2-39f3-4d81-9fe9-e57071997376 tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072 tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072-project] 10.222.0.42 "GET /compute/v2.1/flavors/1906332412/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.119871 Oct 23 01:11:42.949381 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 154/368] 10.222.0.42 () {58 vars in 1266 bytes} [Sun Oct 23 01:11:42 2022] GET /compute/v2.1/flavors/1906332412/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:11:42.957338 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b5974eb8-9414-4624-87a2-db9dca0c08ca tempest-SecurityGroupsTestAdminJSON-1373789967 tempest-SecurityGroupsTestAdminJSON-1373789967-project] Calling method '.version_select at 0x7f5cc276d670>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:43.724452 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:43.749774 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=6 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:44.128509 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b5974eb8-9414-4624-87a2-db9dca0c08ca tempest-SecurityGroupsTestAdminJSON-1373789967 tempest-SecurityGroupsTestAdminJSON-1373789967-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/dcfd9017-1506-48e2-b263-408bfbaf00a4" status: 202 len: 0 microversion: 2.1 time: 1.176423 Oct 23 01:11:44.131305 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 155/369] 10.222.0.42 () {58 vars in 1272 bytes} [Sun Oct 23 01:11:42 2022] DELETE /compute/v2.1/os-security-groups/dcfd9017-1506-48e2-b263-408bfbaf00a4 => generated 0 bytes in 1179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:11:44.133796 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a2ceaba2-5012-49e7-aea7-3d0ce88cc209 tempest-HypervisorAdminV253TestBase-1734336234 tempest-HypervisorAdminV253TestBase-1734336234-project-admin] Calling method '.version_select at 0x7f5cc2638ee0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:44.137932 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a2ceaba2-5012-49e7-aea7-3d0ce88cc209 tempest-HypervisorAdminV253TestBase-1734336234 tempest-HypervisorAdminV253TestBase-1734336234-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:44.138482 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a2ceaba2-5012-49e7-aea7-3d0ce88cc209 tempest-HypervisorAdminV253TestBase-1734336234 tempest-HypervisorAdminV253TestBase-1734336234-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:44.138930 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a2ceaba2-5012-49e7-aea7-3d0ce88cc209 tempest-HypervisorAdminV253TestBase-1734336234 tempest-HypervisorAdminV253TestBase-1734336234-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:44.157314 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a2ceaba2-5012-49e7-aea7-3d0ce88cc209 tempest-HypervisorAdminV253TestBase-1734336234 tempest-HypervisorAdminV253TestBase-1734336234-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:44.157789 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a2ceaba2-5012-49e7-aea7-3d0ce88cc209 tempest-HypervisorAdminV253TestBase-1734336234 tempest-HypervisorAdminV253TestBase-1734336234-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:44.158263 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a2ceaba2-5012-49e7-aea7-3d0ce88cc209 tempest-HypervisorAdminV253TestBase-1734336234 tempest-HypervisorAdminV253TestBase-1734336234-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:44.165174 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a2ceaba2-5012-49e7-aea7-3d0ce88cc209 tempest-HypervisorAdminV253TestBase-1734336234 tempest-HypervisorAdminV253TestBase-1734336234-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/ba5ae510-485d-4cea-80eb-4f6af4b48498" status: 200 len: 792 microversion: 2.53 time: 0.035120 Oct 23 01:11:44.177731 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 156/370] 10.222.0.42 () {60 vars in 1298 bytes} [Sun Oct 23 01:11:44 2022] GET /compute/v2.1/os-hypervisors/ba5ae510-485d-4cea-80eb-4f6af4b48498 => generated 792 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:11:44.177731 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e0165157-267a-42b4-9371-6c9e54e8b0cb tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:44.177731 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e0165157-267a-42b4-9371-6c9e54e8b0cb tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 26043446-8442-4d38-98d8-6ff9a1432d1b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:44.184908 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0165157-267a-42b4-9371-6c9e54e8b0cb tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:44.188433 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0165157-267a-42b4-9371-6c9e54e8b0cb tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:44.188433 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0165157-267a-42b4-9371-6c9e54e8b0cb tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:44.188433 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0165157-267a-42b4-9371-6c9e54e8b0cb tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:44.188433 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0165157-267a-42b4-9371-6c9e54e8b0cb tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:44.188758 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0165157-267a-42b4-9371-6c9e54e8b0cb tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:44.549655 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e0165157-267a-42b4-9371-6c9e54e8b0cb tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:44.557803 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e0165157-267a-42b4-9371-6c9e54e8b0cb tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b" status: 200 len: 1504 microversion: 2.1 time: 0.391000 Oct 23 01:11:44.558843 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 157/371] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:44 2022] GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b => generated 1504 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:44.576161 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3841617c-3ea4-4625-a523-0cac84c90bb0 tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072 tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:44.583408 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3841617c-3ea4-4625-a523-0cac84c90bb0 tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072 tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '765c706a2ca846ebb377f808517f36a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78b3e125cf549dbbce0f49864e9e91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:44.583408 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3841617c-3ea4-4625-a523-0cac84c90bb0 tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072 tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072-project] Request method failure captured: Oct 23 01:11:44.583408 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/flavors/1906332412/os-extra_specs HTTP/1.1 Oct 23 01:11:44.583408 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:11:44.583408 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:11:44.583408 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:11:44.583408 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 66 Oct 23 01:11:44.583408 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:11:44.583408 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:11:44.583408 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:11:44.583408 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:11:44.583408 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJTLflNke95DbW5J-QOIbHtvEepKMu0PKcegZeoyRJ83GBHFN8BPvzcCbLeQajsNrMx4_t0V6TLJy_k8AiAMnKzQyhQMWSNXebJ2DwN_ahf-YJ4EjUIBGOq07KZFSvOEpFM_b5pLjekuG1wWEPQbddNGQktzvgIlO2bmay1zWAnC6_U Oct 23 01:11:44.583408 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:11:44.583408 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:11:44.583408 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:11:44.583408 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:11:44.583408 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:11:44.583408 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:11:44.583408 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: f78b3e125cf549dbbce0f49864e9e91d Oct 23 01:11:44.583408 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072 Oct 23 01:11:44.583408 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:11:44.583408 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:11:44.584615 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f78b3e125cf549dbbce0f49864e9e91d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f78b3e125cf549dbbce0f49864e9e91d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f78b3e125cf549dbbce0f49864e9e91d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f78b3e125cf549dbbce0f49864e9e91d"}]}] Oct 23 01:11:44.584615 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072 Oct 23 01:11:44.584615 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: f78b3e125cf549dbbce0f49864e9e91d Oct 23 01:11:44.584615 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072 Oct 23 01:11:44.584615 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072-project Oct 23 01:11:44.584615 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:11:44.584615 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:11:44.584615 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 765c706a2ca846ebb377f808517f36a0 Oct 23 01:11:44.584615 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072-project Oct 23 01:11:44.584615 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:11:44.584615 n-d-master-1 devstack@n-api.service[120944]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 23 01:11:44.584615 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:11:44.585821 n-d-master-1 devstack@n-api.service[120944]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 23 01:11:44.585821 n-d-master-1 devstack@n-api.service[120944]: action_args: {'flavor_id': '1906332412', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 23 01:11:44.585821 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:11:44.585821 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:44.585821 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:44.585821 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:44.585821 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:11:44.585821 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:11:44.585821 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:11:44.585821 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:11:44.585821 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:11:44.585821 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:11:44.585821 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 23 01:11:44.585821 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 23 01:11:44.585821 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 23 01:11:44.585821 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 23 01:11:44.585821 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 23 01:11:44.585821 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 23 01:11:44.585821 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:11:44.586850 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 23 01:11:44.586850 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:11:44.586850 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise self.value Oct 23 01:11:44.586850 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 23 01:11:44.586850 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 23 01:11:44.586850 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 23 01:11:44.586850 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 23 01:11:44.586850 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 23 01:11:44.586850 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 23 01:11:44.586850 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 23 01:11:44.586850 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:44.586850 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:11:44.586850 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:44.586850 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:44.586850 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:44.586850 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:44.586850 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 23 01:11:44.586850 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 23 01:11:44.586850 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 23 01:11:44.586850 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:44.589269 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3841617c-3ea4-4625-a523-0cac84c90bb0 tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072 tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:11:44.589269 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3841617c-3ea4-4625-a523-0cac84c90bb0 tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072 tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072-project] 10.222.0.42 "POST /compute/v2.1/flavors/1906332412/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.016883 Oct 23 01:11:44.589269 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 158/372] 10.222.0.42 () {60 vars in 1224 bytes} [Sun Oct 23 01:11:44 2022] POST /compute/v2.1/flavors/1906332412/os-extra_specs => generated 124 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:11:44.593967 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ace873d7-e375-4d6f-a27e-0bf76d89c739 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:44.594745 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ace873d7-e375-4d6f-a27e-0bf76d89c739 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:44.605001 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ace873d7-e375-4d6f-a27e-0bf76d89c739 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:44.605671 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ace873d7-e375-4d6f-a27e-0bf76d89c739 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:44.606879 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ace873d7-e375-4d6f-a27e-0bf76d89c739 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:44.613834 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ace873d7-e375-4d6f-a27e-0bf76d89c739 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:44.613834 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ace873d7-e375-4d6f-a27e-0bf76d89c739 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:44.613834 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ace873d7-e375-4d6f-a27e-0bf76d89c739 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:44.709165 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ace873d7-e375-4d6f-a27e-0bf76d89c739 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:44.719317 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ace873d7-e375-4d6f-a27e-0bf76d89c739 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:44.720776 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ace873d7-e375-4d6f-a27e-0bf76d89c739 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:44.726431 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ace873d7-e375-4d6f-a27e-0bf76d89c739 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1510 microversion: 2.91 time: 0.140499 Oct 23 01:11:44.727587 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 159/373] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:11:44 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1510 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:11:44.732434 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-917cafdf-d1a0-4325-84ab-b65e78c353a3 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:44.733043 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-917cafdf-d1a0-4325-84ab-b65e78c353a3 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] [instance: 56fab46b-b733-4279-8e6b-dd6b11013fb2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:44.748826 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-917cafdf-d1a0-4325-84ab-b65e78c353a3 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:44.750438 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-917cafdf-d1a0-4325-84ab-b65e78c353a3 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:44.750896 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-917cafdf-d1a0-4325-84ab-b65e78c353a3 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:44.751611 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-917cafdf-d1a0-4325-84ab-b65e78c353a3 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:44.752070 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-917cafdf-d1a0-4325-84ab-b65e78c353a3 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:44.752499 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-917cafdf-d1a0-4325-84ab-b65e78c353a3 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:45.305374 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-917cafdf-d1a0-4325-84ab-b65e78c353a3 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76739eabf8804ec2af41abc4c1e6fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f22fb0ca7346c4ab225ce82d69118c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:45.310944 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-917cafdf-d1a0-4325-84ab-b65e78c353a3 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] 10.222.0.42 "GET /compute/v2.1/servers/56fab46b-b733-4279-8e6b-dd6b11013fb2" status: 200 len: 1318 microversion: 2.1 time: 0.582159 Oct 23 01:11:45.311529 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 160/374] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:44 2022] GET /compute/v2.1/servers/56fab46b-b733-4279-8e6b-dd6b11013fb2 => generated 1318 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:45.326819 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e629a688-97be-40ab-a3e2-881470fc5c74 tempest-SecurityGroupsTestAdminJSON-1373789967 tempest-SecurityGroupsTestAdminJSON-1373789967-project] Calling method '.version_select at 0x7f5cc25b0b80>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:45.840868 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-46551def-e22e-4044-a210-73a5d1a02e27 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] [instance: 9bb5ab44-057e-4115-a477-602ef6feece3] Building network info cache for instance {{(pid=120945) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 23 01:11:45.931157 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e629a688-97be-40ab-a3e2-881470fc5c74 tempest-SecurityGroupsTestAdminJSON-1373789967 tempest-SecurityGroupsTestAdminJSON-1373789967-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/5b2df2c5-ad01-471a-9e3b-44777daba580" status: 202 len: 0 microversion: 2.1 time: 0.617105 Oct 23 01:11:45.936530 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 161/375] 10.222.0.42 () {58 vars in 1272 bytes} [Sun Oct 23 01:11:45 2022] DELETE /compute/v2.1/os-security-groups/5b2df2c5-ad01-471a-9e3b-44777daba580 => generated 0 bytes in 619 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:11:45.946350 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6604971c-2981-469b-a901-ab6f8f3dc09a tempest-FlavorsExtraSpecsNegativeTestJSON-493559463 tempest-FlavorsExtraSpecsNegativeTestJSON-493559463-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:46.115489 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6604971c-2981-469b-a901-ab6f8f3dc09a tempest-FlavorsExtraSpecsNegativeTestJSON-493559463 tempest-FlavorsExtraSpecsNegativeTestJSON-493559463-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors/1906332412/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.181299 Oct 23 01:11:46.115489 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 162/376] 10.222.0.42 () {60 vars in 1224 bytes} [Sun Oct 23 01:11:45 2022] POST /compute/v2.1/flavors/1906332412/os-extra_specs => generated 66 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:11:46.126341 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-3d9f1f28-f5e8-4863-b529-f45fc6e60a84 req-8e9e454b-ff77-49f4-ac6f-ae45b3060393 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26043446-8442-4d38-98d8-6ff9a1432d1b", "name": "network-vif-unplugged", "status": "completed", "tag": "4a1925fc-3024-45ea-be46-b952667a8883"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:46.151546 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-3d9f1f28-f5e8-4863-b529-f45fc6e60a84 req-8e9e454b-ff77-49f4-ac6f-ae45b3060393 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:46.152165 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-3d9f1f28-f5e8-4863-b529-f45fc6e60a84 req-8e9e454b-ff77-49f4-ac6f-ae45b3060393 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:46.152935 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-3d9f1f28-f5e8-4863-b529-f45fc6e60a84 req-8e9e454b-ff77-49f4-ac6f-ae45b3060393 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:46.167354 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-3d9f1f28-f5e8-4863-b529-f45fc6e60a84 req-8e9e454b-ff77-49f4-ac6f-ae45b3060393 service nova] Creating event network-vif-unplugged:4a1925fc-3024-45ea-be46-b952667a8883 for instance 26043446-8442-4d38-98d8-6ff9a1432d1b on n-h1-master-1 Oct 23 01:11:46.172706 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-3d9f1f28-f5e8-4863-b529-f45fc6e60a84 req-8e9e454b-ff77-49f4-ac6f-ae45b3060393 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055921 Oct 23 01:11:46.173466 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 163/377] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:46.178821 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d4f14592-6825-4d2a-84f5-4e19939710f6 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:46.179567 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d4f14592-6825-4d2a-84f5-4e19939710f6 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 26043446-8442-4d38-98d8-6ff9a1432d1b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:46.186505 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d4f14592-6825-4d2a-84f5-4e19939710f6 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:46.186996 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d4f14592-6825-4d2a-84f5-4e19939710f6 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:46.187452 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d4f14592-6825-4d2a-84f5-4e19939710f6 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:46.188299 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d4f14592-6825-4d2a-84f5-4e19939710f6 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:46.188763 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d4f14592-6825-4d2a-84f5-4e19939710f6 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:46.189188 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d4f14592-6825-4d2a-84f5-4e19939710f6 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:46.498472 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d4f14592-6825-4d2a-84f5-4e19939710f6 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:46.507901 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d4f14592-6825-4d2a-84f5-4e19939710f6 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b" status: 200 len: 1504 microversion: 2.1 time: 0.333059 Oct 23 01:11:46.528719 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 164/378] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:46 2022] GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b => generated 1504 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:46.536167 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-38a563aa-5b93-4a32-aaf8-2d0e8f27f82d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:46.543328 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-38a563aa-5b93-4a32-aaf8-2d0e8f27f82d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:46.557432 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-38a563aa-5b93-4a32-aaf8-2d0e8f27f82d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:46.558156 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-38a563aa-5b93-4a32-aaf8-2d0e8f27f82d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:46.560438 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-38a563aa-5b93-4a32-aaf8-2d0e8f27f82d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:46.562788 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-38a563aa-5b93-4a32-aaf8-2d0e8f27f82d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:46.563743 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-38a563aa-5b93-4a32-aaf8-2d0e8f27f82d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:46.564338 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-38a563aa-5b93-4a32-aaf8-2d0e8f27f82d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:46.685477 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-38a563aa-5b93-4a32-aaf8-2d0e8f27f82d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:46.699988 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-38a563aa-5b93-4a32-aaf8-2d0e8f27f82d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:46.701935 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-38a563aa-5b93-4a32-aaf8-2d0e8f27f82d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:46.710706 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-38a563aa-5b93-4a32-aaf8-2d0e8f27f82d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1531 microversion: 2.91 time: 0.180545 Oct 23 01:11:46.726638 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 165/379] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:11:46 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1531 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:11:46.732139 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7f2d93c9-c5f1-4e94-b386-76cf9e8d1015 tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072 tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:46.735488 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7f2d93c9-c5f1-4e94-b386-76cf9e8d1015 tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072 tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '765c706a2ca846ebb377f808517f36a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78b3e125cf549dbbce0f49864e9e91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:46.737527 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7f2d93c9-c5f1-4e94-b386-76cf9e8d1015 tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072 tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072-project] Request method failure captured: Oct 23 01:11:46.737527 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/flavors/1906332412/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 23 01:11:46.737527 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:11:46.737527 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:11:46.737527 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:11:46.737527 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:11:46.737527 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:11:46.737527 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:11:46.737527 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:11:46.737527 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:11:46.737527 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJTLflNke95DbW5J-QOIbHtvEepKMu0PKcegZeoyRJ83GBHFN8BPvzcCbLeQajsNrMx4_t0V6TLJy_k8AiAMnKzQyhQMWSNXebJ2DwN_ahf-YJ4EjUIBGOq07KZFSvOEpFM_b5pLjekuG1wWEPQbddNGQktzvgIlO2bmay1zWAnC6_U Oct 23 01:11:46.737527 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:11:46.737527 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:11:46.737527 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:11:46.737527 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:11:46.737527 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:11:46.737527 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:11:46.737527 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: f78b3e125cf549dbbce0f49864e9e91d Oct 23 01:11:46.737527 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072 Oct 23 01:11:46.737527 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:11:46.737527 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:11:46.755133 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f78b3e125cf549dbbce0f49864e9e91d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f78b3e125cf549dbbce0f49864e9e91d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f78b3e125cf549dbbce0f49864e9e91d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f78b3e125cf549dbbce0f49864e9e91d"}]}] Oct 23 01:11:46.755133 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072 Oct 23 01:11:46.755133 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: f78b3e125cf549dbbce0f49864e9e91d Oct 23 01:11:46.755133 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072 Oct 23 01:11:46.755133 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072-project Oct 23 01:11:46.755133 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:11:46.755133 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:11:46.755133 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 765c706a2ca846ebb377f808517f36a0 Oct 23 01:11:46.755133 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072-project Oct 23 01:11:46.755133 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:11:46.755133 n-d-master-1 devstack@n-api.service[120944]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 23 01:11:46.755744 n-d-master-1 devstack@n-api.service[120944]: action_args: {'flavor_id': '1906332412', 'id': 'hw:numa_nodes'} Oct 23 01:11:46.755744 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:11:46.755744 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:46.755744 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:46.755744 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:46.755744 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:11:46.755744 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:11:46.755744 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:11:46.755744 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:11:46.755744 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 23 01:11:46.755744 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 23 01:11:46.755744 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 23 01:11:46.755744 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 23 01:11:46.755744 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 23 01:11:46.755744 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 23 01:11:46.755744 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:11:46.755744 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 23 01:11:46.755744 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:11:46.755744 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise self.value Oct 23 01:11:46.755744 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 23 01:11:46.757005 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 23 01:11:46.757005 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 23 01:11:46.757005 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 23 01:11:46.757005 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 23 01:11:46.757005 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 23 01:11:46.757005 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 23 01:11:46.757005 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:46.757005 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:11:46.757005 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:46.757005 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:46.757005 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:46.757005 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:46.757005 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 23 01:11:46.757005 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 23 01:11:46.757005 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 23 01:11:46.757005 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:46.757005 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7f2d93c9-c5f1-4e94-b386-76cf9e8d1015 tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072 tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:11:46.757930 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7f2d93c9-c5f1-4e94-b386-76cf9e8d1015 tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072 tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072-project] 10.222.0.42 "DELETE /compute/v2.1/flavors/1906332412/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.018457 Oct 23 01:11:46.757930 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 166/380] 10.222.0.42 () {58 vars in 1248 bytes} [Sun Oct 23 01:11:46 2022] DELETE /compute/v2.1/flavors/1906332412/os-extra_specs/hw:numa_nodes => generated 124 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:11:46.757930 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-baf59115-2cd4-4273-8c78-9b94128bdc8a tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:46.757930 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-baf59115-2cd4-4273-8c78-9b94128bdc8a tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] [instance: 56fab46b-b733-4279-8e6b-dd6b11013fb2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:46.762280 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-baf59115-2cd4-4273-8c78-9b94128bdc8a tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:46.766136 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-baf59115-2cd4-4273-8c78-9b94128bdc8a tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:46.766754 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-baf59115-2cd4-4273-8c78-9b94128bdc8a tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:46.767475 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-baf59115-2cd4-4273-8c78-9b94128bdc8a tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:46.767964 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-baf59115-2cd4-4273-8c78-9b94128bdc8a tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:46.768384 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-baf59115-2cd4-4273-8c78-9b94128bdc8a tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:46.768491 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-46551def-e22e-4044-a210-73a5d1a02e27 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] [instance: 9bb5ab44-057e-4115-a477-602ef6feece3] Updating instance_info_cache with network_info: [{"id": "f52b7234-1d59-4c35-8b9d-e94552c618c2", "address": "fa:16:3e:a5:56:41", "network": {"id": "8713ad73-3551-4e4e-a4b5-06c9d1b5b4bf", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1343545346-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.6.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b7864a40d26e402d815d39ef0c0f91a1", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf52b7234-1d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120945) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 23 01:11:46.860158 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46551def-e22e-4044-a210-73a5d1a02e27 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Releasing lock "refresh_cache-9bb5ab44-057e-4115-a477-602ef6feece3" {{(pid=120945) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 23 01:11:46.861161 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-46551def-e22e-4044-a210-73a5d1a02e27 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] 10.222.0.42 "POST /compute/v2.1/servers/9bb5ab44-057e-4115-a477-602ef6feece3/action" status: 202 len: 0 microversion: 2.1 time: 4.061261 Oct 23 01:11:46.861843 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 215/381] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:11:42 2022] POST /compute/v2.1/servers/9bb5ab44-057e-4115-a477-602ef6feece3/action => generated 0 bytes in 4062 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 23 01:11:46.966018 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-baf59115-2cd4-4273-8c78-9b94128bdc8a tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76739eabf8804ec2af41abc4c1e6fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f22fb0ca7346c4ab225ce82d69118c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:46.973510 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-baf59115-2cd4-4273-8c78-9b94128bdc8a tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] 10.222.0.42 "GET /compute/v2.1/servers/56fab46b-b733-4279-8e6b-dd6b11013fb2" status: 200 len: 1318 microversion: 2.1 time: 0.229881 Oct 23 01:11:46.986802 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 167/382] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:46 2022] GET /compute/v2.1/servers/56fab46b-b733-4279-8e6b-dd6b11013fb2 => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:46.997466 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a97bb266-0b89-426d-b3dc-ca06e1dd3bc7 tempest-FlavorsExtraSpecsNegativeTestJSON-493559463 tempest-FlavorsExtraSpecsNegativeTestJSON-493559463-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:47.023810 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a97bb266-0b89-426d-b3dc-ca06e1dd3bc7 tempest-FlavorsExtraSpecsNegativeTestJSON-493559463 tempest-FlavorsExtraSpecsNegativeTestJSON-493559463-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors/1906332412/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.035810 Oct 23 01:11:47.029893 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 168/383] 10.222.0.42 () {60 vars in 1224 bytes} [Sun Oct 23 01:11:46 2022] POST /compute/v2.1/flavors/1906332412/os-extra_specs => generated 66 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:11:47.037208 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ce046e50-5d69-4df0-b08d-3bda7bc4fccd tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Action: 'create', calling method: .version_select at 0x7f5cc2640430>, body: {"pool": "e33e8d81-9a30-4a90-a2ad-d9c074d3dc77"} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:47.116889 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-93466360-132b-4736-8ec6-9bba19318b55 tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:47.117772 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-93466360-132b-4736-8ec6-9bba19318b55 tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:47.128250 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-93466360-132b-4736-8ec6-9bba19318b55 tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:47.128841 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-93466360-132b-4736-8ec6-9bba19318b55 tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:47.129411 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-93466360-132b-4736-8ec6-9bba19318b55 tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:47.131021 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-93466360-132b-4736-8ec6-9bba19318b55 tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:47.131710 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-93466360-132b-4736-8ec6-9bba19318b55 tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:47.132355 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-93466360-132b-4736-8ec6-9bba19318b55 tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:47.289783 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-93466360-132b-4736-8ec6-9bba19318b55 tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] Lazy-loading 'services' on Instance uuid 12bc6f90-1421-4c4f-b651-ee7d941c725b {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:11:47.358187 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-93466360-132b-4736-8ec6-9bba19318b55 tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1936 microversion: 2.91 time: 0.494763 Oct 23 01:11:47.363760 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 216/384] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:11:46 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1936 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:11:47.369935 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-69581696-104b-4496-a3e3-f4368727cb41 tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072 tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:47.373844 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-69581696-104b-4496-a3e3-f4368727cb41 tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072 tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '765c706a2ca846ebb377f808517f36a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78b3e125cf549dbbce0f49864e9e91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:47.375916 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-69581696-104b-4496-a3e3-f4368727cb41 tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072 tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072-project] Request method failure captured: Oct 23 01:11:47.375916 n-d-master-1 devstack@n-api.service[120945]: request: PUT /compute/v2.1/flavors/1906332412/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 23 01:11:47.375916 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:11:47.375916 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:11:47.375916 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:11:47.375916 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 22 Oct 23 01:11:47.375916 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:11:47.375916 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:11:47.375916 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:11:47.375916 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:11:47.375916 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJTLflNke95DbW5J-QOIbHtvEepKMu0PKcegZeoyRJ83GBHFN8BPvzcCbLeQajsNrMx4_t0V6TLJy_k8AiAMnKzQyhQMWSNXebJ2DwN_ahf-YJ4EjUIBGOq07KZFSvOEpFM_b5pLjekuG1wWEPQbddNGQktzvgIlO2bmay1zWAnC6_U Oct 23 01:11:47.375916 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:11:47.375916 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:11:47.375916 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:11:47.375916 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:11:47.375916 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:11:47.375916 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:11:47.375916 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: f78b3e125cf549dbbce0f49864e9e91d Oct 23 01:11:47.375916 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072 Oct 23 01:11:47.375916 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:11:47.375916 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:11:47.377104 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f78b3e125cf549dbbce0f49864e9e91d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f78b3e125cf549dbbce0f49864e9e91d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f78b3e125cf549dbbce0f49864e9e91d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f78b3e125cf549dbbce0f49864e9e91d"}]}] Oct 23 01:11:47.377104 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072 Oct 23 01:11:47.377104 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: f78b3e125cf549dbbce0f49864e9e91d Oct 23 01:11:47.377104 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072 Oct 23 01:11:47.377104 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072-project Oct 23 01:11:47.377104 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:11:47.377104 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:11:47.377104 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 765c706a2ca846ebb377f808517f36a0 Oct 23 01:11:47.377104 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072-project Oct 23 01:11:47.377104 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:11:47.377104 n-d-master-1 devstack@n-api.service[120945]: {"hw:numa_nodes": "1"} Oct 23 01:11:47.377104 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:11:47.377104 n-d-master-1 devstack@n-api.service[120945]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 23 01:11:47.377813 n-d-master-1 devstack@n-api.service[120945]: action_args: {'flavor_id': '1906332412', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 23 01:11:47.377813 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:11:47.377813 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:47.377813 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:47.377813 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:47.377813 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:11:47.377813 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:11:47.377813 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:11:47.377813 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:11:47.377813 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:11:47.377813 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:11:47.377813 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 23 01:11:47.377813 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 23 01:11:47.377813 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 23 01:11:47.377813 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 23 01:11:47.377813 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 23 01:11:47.377813 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 23 01:11:47.377813 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:11:47.377813 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 23 01:11:47.378880 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:11:47.378880 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise self.value Oct 23 01:11:47.378880 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 23 01:11:47.378880 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 23 01:11:47.378880 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 23 01:11:47.378880 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 23 01:11:47.378880 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 23 01:11:47.378880 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 23 01:11:47.378880 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 23 01:11:47.378880 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:47.378880 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:11:47.378880 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:47.378880 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:47.378880 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:47.378880 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:47.378880 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 23 01:11:47.378880 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 23 01:11:47.378880 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 23 01:11:47.378880 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:47.381517 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-69581696-104b-4496-a3e3-f4368727cb41 tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072 tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:11:47.381517 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-69581696-104b-4496-a3e3-f4368727cb41 tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072 tempest-FlavorsExtraSpecsNegativeTestJSON-1749795072-project] 10.222.0.42 "PUT /compute/v2.1/flavors/1906332412/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.017180 Oct 23 01:11:47.386350 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 217/385] 10.222.0.42 () {60 vars in 1265 bytes} [Sun Oct 23 01:11:47 2022] PUT /compute/v2.1/flavors/1906332412/os-extra_specs/hw:numa_nodes => generated 124 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:11:47.394473 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e4ed008c-efb9-4139-80e7-7183e2fc62b0 tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:47.395080 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e4ed008c-efb9-4139-80e7-7183e2fc62b0 tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:47.401953 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e4ed008c-efb9-4139-80e7-7183e2fc62b0 tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:47.402807 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e4ed008c-efb9-4139-80e7-7183e2fc62b0 tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:47.403309 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e4ed008c-efb9-4139-80e7-7183e2fc62b0 tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:47.404017 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e4ed008c-efb9-4139-80e7-7183e2fc62b0 tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:47.404475 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e4ed008c-efb9-4139-80e7-7183e2fc62b0 tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:47.404894 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e4ed008c-efb9-4139-80e7-7183e2fc62b0 tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:47.506835 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-e4ed008c-efb9-4139-80e7-7183e2fc62b0 tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] Lazy-loading 'services' on Instance uuid 12bc6f90-1421-4c4f-b651-ee7d941c725b {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:11:47.524938 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e4ed008c-efb9-4139-80e7-7183e2fc62b0 tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1936 microversion: 2.91 time: 0.134607 Oct 23 01:11:47.525529 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 218/386] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:11:47 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1936 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:11:47.531703 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-38a4a4a0-7c07-4432-bc57-d80b34f582fa tempest-FlavorsExtraSpecsNegativeTestJSON-493559463 tempest-FlavorsExtraSpecsNegativeTestJSON-493559463-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:47.540149 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-38a4a4a0-7c07-4432-bc57-d80b34f582fa tempest-FlavorsExtraSpecsNegativeTestJSON-493559463 tempest-FlavorsExtraSpecsNegativeTestJSON-493559463-project-admin] HTTP exception thrown: Flavor 1906332412 has no extra specs with key hw:cpu_thread_policy. Oct 23 01:11:47.541623 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-38a4a4a0-7c07-4432-bc57-d80b34f582fa tempest-FlavorsExtraSpecsNegativeTestJSON-493559463 tempest-FlavorsExtraSpecsNegativeTestJSON-493559463-project-admin] Request method failure captured: Oct 23 01:11:47.541623 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/flavors/1906332412/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 23 01:11:47.541623 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:11:47.541623 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:11:47.541623 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:11:47.541623 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:11:47.541623 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:11:47.541623 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:11:47.541623 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:11:47.541623 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:11:47.541623 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJTNO8IwioeoG_psgLLq04Fq3ohjFaw0Gtw3yJ0gYcHNLgZecQE3UqBuTLlDxPqBbbRcnxW9JTGdgXubhf3jEIShPGalgaifg5Tjzkr-cmb6ZTfL7WnBtjcarXzsbRdvHP6R1v6vQMBxTGRkKRm98FJrSsSEzPapajFeElR4gIdiPOI Oct 23 01:11:47.541623 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:11:47.541623 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:11:47.541623 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:11:47.541623 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:11:47.541623 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:11:47.541623 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:11:47.541623 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: d2f2a869e13b4fd781ddd560f8825a35 Oct 23 01:11:47.541623 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-493559463 Oct 23 01:11:47.541623 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,admin,reader Oct 23 01:11:47.541623 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,admin,reader Oct 23 01:11:47.543090 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d2f2a869e13b4fd781ddd560f8825a35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d2f2a869e13b4fd781ddd560f8825a35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d2f2a869e13b4fd781ddd560f8825a35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d2f2a869e13b4fd781ddd560f8825a35"}]}] Oct 23 01:11:47.543090 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-493559463 Oct 23 01:11:47.543090 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: d2f2a869e13b4fd781ddd560f8825a35 Oct 23 01:11:47.543090 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-493559463 Oct 23 01:11:47.543090 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-493559463-project-admin Oct 23 01:11:47.543090 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:11:47.543090 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:11:47.543090 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 78f922ba52134aafb488fd15a12522d2 Oct 23 01:11:47.543090 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-493559463-project-admin Oct 23 01:11:47.543090 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:11:47.543090 n-d-master-1 devstack@n-api.service[120945]: exception: Flavor 1906332412 has no extra specs with key hw:cpu_thread_policy. Oct 23 01:11:47.543802 n-d-master-1 devstack@n-api.service[120945]: action_args: {'flavor_id': '1906332412', 'id': 'hw:cpu_thread_policy'} Oct 23 01:11:47.543802 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:11:47.543802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:47.543802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 23 01:11:47.543802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 23 01:11:47.543802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 23 01:11:47.543802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:47.543802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:11:47.543802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:47.543802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:47.543802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:47.543802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:47.543802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:11:47.543802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:11:47.543802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:11:47.543802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:11:47.543802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 23 01:11:47.543802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 23 01:11:47.543802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1906332412 has no extra specs with key hw:cpu_thread_policy. Oct 23 01:11:47.543802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:47.543802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:11:47.543802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:47.544962 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:47.544962 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:47.544962 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:47.544962 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:11:47.544962 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:11:47.544962 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1906332412 has no extra specs with key hw:cpu_thread_policy. Oct 23 01:11:47.544962 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:47.545346 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-38a4a4a0-7c07-4432-bc57-d80b34f582fa tempest-FlavorsExtraSpecsNegativeTestJSON-493559463 tempest-FlavorsExtraSpecsNegativeTestJSON-493559463-project-admin] Returning 404 to user: Flavor 1906332412 has no extra specs with key hw:cpu_thread_policy. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:11:47.550849 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-38a4a4a0-7c07-4432-bc57-d80b34f582fa tempest-FlavorsExtraSpecsNegativeTestJSON-493559463 tempest-FlavorsExtraSpecsNegativeTestJSON-493559463-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/1906332412/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.024270 Oct 23 01:11:47.551721 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 219/387] 10.222.0.42 () {58 vars in 1269 bytes} [Sun Oct 23 01:11:47 2022] DELETE /compute/v2.1/flavors/1906332412/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:11:47.558664 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a57dd1fc-fc3e-4be5-bf21-b4c9e286907a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:47.558777 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a57dd1fc-fc3e-4be5-bf21-b4c9e286907a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 26043446-8442-4d38-98d8-6ff9a1432d1b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:47.562365 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:47.566600 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a57dd1fc-fc3e-4be5-bf21-b4c9e286907a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:47.567096 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a57dd1fc-fc3e-4be5-bf21-b4c9e286907a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:47.567536 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a57dd1fc-fc3e-4be5-bf21-b4c9e286907a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:47.568382 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a57dd1fc-fc3e-4be5-bf21-b4c9e286907a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:47.569026 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a57dd1fc-fc3e-4be5-bf21-b4c9e286907a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:47.569460 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a57dd1fc-fc3e-4be5-bf21-b4c9e286907a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:47.760968 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a57dd1fc-fc3e-4be5-bf21-b4c9e286907a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:47.769462 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a57dd1fc-fc3e-4be5-bf21-b4c9e286907a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b" status: 200 len: 1504 microversion: 2.1 time: 0.216152 Oct 23 01:11:47.770073 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 220/388] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:47 2022] GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b => generated 1504 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:47.774425 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-759eadb7-e891-4f7c-b625-3ef5c584f0b9 tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:47.778725 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-759eadb7-e891-4f7c-b625-3ef5c584f0b9 tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:47.779224 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-759eadb7-e891-4f7c-b625-3ef5c584f0b9 tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:47.779663 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-759eadb7-e891-4f7c-b625-3ef5c584f0b9 tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:47.780393 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-759eadb7-e891-4f7c-b625-3ef5c584f0b9 tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:47.780847 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-759eadb7-e891-4f7c-b625-3ef5c584f0b9 tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:47.781264 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-759eadb7-e891-4f7c-b625-3ef5c584f0b9 tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:47.805482 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-759eadb7-e891-4f7c-b625-3ef5c584f0b9 tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.034378 Oct 23 01:11:47.806113 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 221/389] 10.222.0.42 () {60 vars in 1217 bytes} [Sun Oct 23 01:11:47 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:11:47.811318 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4ad4bf78-4d45-4d00-8156-14955cfeb48c tempest-FlavorsExtraSpecsNegativeTestJSON-493559463 tempest-FlavorsExtraSpecsNegativeTestJSON-493559463-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:47.814813 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-4ad4bf78-4d45-4d00-8156-14955cfeb48c tempest-FlavorsExtraSpecsNegativeTestJSON-493559463 tempest-FlavorsExtraSpecsNegativeTestJSON-493559463-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 23 01:11:47.816196 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4ad4bf78-4d45-4d00-8156-14955cfeb48c tempest-FlavorsExtraSpecsNegativeTestJSON-493559463 tempest-FlavorsExtraSpecsNegativeTestJSON-493559463-project-admin] Request method failure captured: Oct 23 01:11:47.816196 n-d-master-1 devstack@n-api.service[120945]: request: PUT /compute/v2.1/flavors/1906332412/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 23 01:11:47.816196 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:11:47.816196 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:11:47.816196 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:11:47.816196 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 27 Oct 23 01:11:47.816196 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:11:47.816196 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:11:47.816196 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:11:47.816196 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:11:47.816196 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJTNO8IwioeoG_psgLLq04Fq3ohjFaw0Gtw3yJ0gYcHNLgZecQE3UqBuTLlDxPqBbbRcnxW9JTGdgXubhf3jEIShPGalgaifg5Tjzkr-cmb6ZTfL7WnBtjcarXzsbRdvHP6R1v6vQMBxTGRkKRm98FJrSsSEzPapajFeElR4gIdiPOI Oct 23 01:11:47.816196 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:11:47.816196 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:11:47.816196 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:11:47.816196 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:11:47.816196 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:11:47.816196 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:11:47.816196 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: d2f2a869e13b4fd781ddd560f8825a35 Oct 23 01:11:47.816196 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-493559463 Oct 23 01:11:47.816196 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,admin,reader Oct 23 01:11:47.816196 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,admin,reader Oct 23 01:11:47.818586 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d2f2a869e13b4fd781ddd560f8825a35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d2f2a869e13b4fd781ddd560f8825a35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d2f2a869e13b4fd781ddd560f8825a35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d2f2a869e13b4fd781ddd560f8825a35"}]}] Oct 23 01:11:47.818586 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-493559463 Oct 23 01:11:47.818586 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: d2f2a869e13b4fd781ddd560f8825a35 Oct 23 01:11:47.818586 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-493559463 Oct 23 01:11:47.818586 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-493559463-project-admin Oct 23 01:11:47.818586 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:11:47.818586 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:11:47.818586 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 78f922ba52134aafb488fd15a12522d2 Oct 23 01:11:47.818586 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-493559463-project-admin Oct 23 01:11:47.818586 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:11:47.818586 n-d-master-1 devstack@n-api.service[120945]: {"hw:cpu_policy": "shared"} Oct 23 01:11:47.818586 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:11:47.818586 n-d-master-1 devstack@n-api.service[120945]: exception: Request body and URI mismatch Oct 23 01:11:47.819757 n-d-master-1 devstack@n-api.service[120945]: action_args: {'flavor_id': '1906332412', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 23 01:11:47.819757 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:11:47.819757 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:47.819757 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:47.819757 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:47.819757 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:11:47.819757 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:11:47.819757 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:11:47.819757 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:11:47.819757 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:11:47.819757 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:11:47.819757 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 23 01:11:47.819757 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 23 01:11:47.819757 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 23 01:11:47.819757 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:47.819757 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:11:47.819757 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:47.819757 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:47.819757 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:47.819757 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:47.821394 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:11:47.821394 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:11:47.821394 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 23 01:11:47.821394 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:47.821394 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4ad4bf78-4d45-4d00-8156-14955cfeb48c tempest-FlavorsExtraSpecsNegativeTestJSON-493559463 tempest-FlavorsExtraSpecsNegativeTestJSON-493559463-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:11:47.821394 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4ad4bf78-4d45-4d00-8156-14955cfeb48c tempest-FlavorsExtraSpecsNegativeTestJSON-493559463 tempest-FlavorsExtraSpecsNegativeTestJSON-493559463-project-admin] 10.222.0.42 "PUT /compute/v2.1/flavors/1906332412/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.010368 Oct 23 01:11:47.821394 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 222/390] 10.222.0.42 () {60 vars in 1265 bytes} [Sun Oct 23 01:11:47 2022] PUT /compute/v2.1/flavors/1906332412/os-extra_specs/hw:numa_nodes => generated 73 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 23 01:11:47.827909 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3c2782a0-356c-4ee4-8a0c-2d4574149648 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:47.837368 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3c2782a0-356c-4ee4-8a0c-2d4574149648 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:47.837368 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c2782a0-356c-4ee4-8a0c-2d4574149648 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:47.837368 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c2782a0-356c-4ee4-8a0c-2d4574149648 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:47.837368 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c2782a0-356c-4ee4-8a0c-2d4574149648 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:47.838004 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c2782a0-356c-4ee4-8a0c-2d4574149648 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:47.838004 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c2782a0-356c-4ee4-8a0c-2d4574149648 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:47.838004 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c2782a0-356c-4ee4-8a0c-2d4574149648 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:47.861263 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-3c2782a0-356c-4ee4-8a0c-2d4574149648 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lazy-loading 'flavor' on Instance uuid 12bc6f90-1421-4c4f-b651-ee7d941c725b {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:11:48.635593 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3c2782a0-356c-4ee4-8a0c-2d4574149648 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "POST /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b/action" status: 202 len: 0 microversion: 2.91 time: 0.812105 Oct 23 01:11:48.636244 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 223/391] 10.222.0.42 () {62 vars in 1319 bytes} [Sun Oct 23 01:11:47 2022] POST /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b/action => generated 0 bytes in 818 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:11:48.644757 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d87bb93b-4d77-43d8-b3b9-711a32040a1a tempest-FlavorsExtraSpecsNegativeTestJSON-493559463 tempest-FlavorsExtraSpecsNegativeTestJSON-493559463-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:48.648793 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d87bb93b-4d77-43d8-b3b9-711a32040a1a tempest-FlavorsExtraSpecsNegativeTestJSON-493559463 tempest-FlavorsExtraSpecsNegativeTestJSON-493559463-project-admin] Request method failure captured: Oct 23 01:11:48.648793 n-d-master-1 devstack@n-api.service[120945]: request: PUT /compute/v2.1/flavors/1906332412/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 23 01:11:48.648793 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:11:48.648793 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:11:48.648793 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:11:48.648793 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 49 Oct 23 01:11:48.648793 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:11:48.648793 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:11:48.648793 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:11:48.648793 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:11:48.648793 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJTNO8IwioeoG_psgLLq04Fq3ohjFaw0Gtw3yJ0gYcHNLgZecQE3UqBuTLlDxPqBbbRcnxW9JTGdgXubhf3jEIShPGalgaifg5Tjzkr-cmb6ZTfL7WnBtjcarXzsbRdvHP6R1v6vQMBxTGRkKRm98FJrSsSEzPapajFeElR4gIdiPOI Oct 23 01:11:48.648793 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:11:48.648793 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:11:48.648793 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:11:48.648793 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:11:48.648793 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:11:48.648793 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:11:48.648793 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: d2f2a869e13b4fd781ddd560f8825a35 Oct 23 01:11:48.648793 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-493559463 Oct 23 01:11:48.648793 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,admin,reader Oct 23 01:11:48.648793 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,admin,reader Oct 23 01:11:48.650247 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d2f2a869e13b4fd781ddd560f8825a35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d2f2a869e13b4fd781ddd560f8825a35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d2f2a869e13b4fd781ddd560f8825a35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d2f2a869e13b4fd781ddd560f8825a35"}]}] Oct 23 01:11:48.650247 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-493559463 Oct 23 01:11:48.650247 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: d2f2a869e13b4fd781ddd560f8825a35 Oct 23 01:11:48.650247 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-493559463 Oct 23 01:11:48.650247 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-493559463-project-admin Oct 23 01:11:48.650247 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:11:48.650247 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:11:48.650247 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 78f922ba52134aafb488fd15a12522d2 Oct 23 01:11:48.650247 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-493559463-project-admin Oct 23 01:11:48.650247 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:11:48.650247 n-d-master-1 devstack@n-api.service[120945]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 23 01:11:48.650247 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:11:48.651123 n-d-master-1 devstack@n-api.service[120945]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 23 01:11:48.651123 n-d-master-1 devstack@n-api.service[120945]: action_args: {'flavor_id': '1906332412', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 23 01:11:48.651123 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:11:48.651123 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:48.651123 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 23 01:11:48.651123 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 23 01:11:48.651123 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 01:11:48.651123 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise error Oct 23 01:11:48.651123 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 23 01:11:48.651123 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:48.651123 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 23 01:11:48.651123 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 23 01:11:48.651123 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 23 01:11:48.651123 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 23 01:11:48.651123 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 23 01:11:48.651123 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 23 01:11:48.651123 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 23 01:11:48.651123 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 23 01:11:48.651123 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:48.651123 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi On instance: Oct 23 01:11:48.651123 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 23 01:11:48.651123 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:48.653397 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:11:48.653397 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:48.653397 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:48.653397 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:48.653397 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:48.653397 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:11:48.653397 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:11:48.653397 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:11:48.653397 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:11:48.653397 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 23 01:11:48.653397 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 23 01:11:48.653397 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 23 01:11:48.653397 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 23 01:11:48.653397 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 23 01:11:48.653397 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 23 01:11:48.653397 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 23 01:11:48.653397 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:48.653397 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:11:48.653397 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:48.653397 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:48.659001 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:48.659001 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:48.659001 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 23 01:11:48.659001 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 23 01:11:48.659001 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 23 01:11:48.659001 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:48.659001 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d87bb93b-4d77-43d8-b3b9-711a32040a1a tempest-FlavorsExtraSpecsNegativeTestJSON-493559463 tempest-FlavorsExtraSpecsNegativeTestJSON-493559463-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:11:48.659001 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d87bb93b-4d77-43d8-b3b9-711a32040a1a tempest-FlavorsExtraSpecsNegativeTestJSON-493559463 tempest-FlavorsExtraSpecsNegativeTestJSON-493559463-project-admin] 10.222.0.42 "PUT /compute/v2.1/flavors/1906332412/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.009265 Oct 23 01:11:48.659001 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 224/392] 10.222.0.42 () {60 vars in 1265 bytes} [Sun Oct 23 01:11:48 2022] PUT /compute/v2.1/flavors/1906332412/os-extra_specs/hw:numa_nodes => generated 117 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:11:48.659655 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6ceaf8c8-bdea-498c-8f62-5d041f42b7bf tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:48.659655 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6ceaf8c8-bdea-498c-8f62-5d041f42b7bf tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] [instance: 56fab46b-b733-4279-8e6b-dd6b11013fb2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:48.664757 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6ceaf8c8-bdea-498c-8f62-5d041f42b7bf tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:48.665240 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6ceaf8c8-bdea-498c-8f62-5d041f42b7bf tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:48.665678 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6ceaf8c8-bdea-498c-8f62-5d041f42b7bf tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:48.666391 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6ceaf8c8-bdea-498c-8f62-5d041f42b7bf tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:48.667083 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6ceaf8c8-bdea-498c-8f62-5d041f42b7bf tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:48.667500 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6ceaf8c8-bdea-498c-8f62-5d041f42b7bf tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:48.845152 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6ceaf8c8-bdea-498c-8f62-5d041f42b7bf tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76739eabf8804ec2af41abc4c1e6fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f22fb0ca7346c4ab225ce82d69118c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:48.853671 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6ceaf8c8-bdea-498c-8f62-5d041f42b7bf tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] 10.222.0.42 "GET /compute/v2.1/servers/56fab46b-b733-4279-8e6b-dd6b11013fb2" status: 200 len: 1318 microversion: 2.1 time: 0.201797 Oct 23 01:11:48.854596 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 225/393] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:48 2022] GET /compute/v2.1/servers/56fab46b-b733-4279-8e6b-dd6b11013fb2 => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:48.859137 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-b30193cf-9937-4f9b-949e-c24a2cb561b6 req-e0d2c5c4-1065-4fef-b985-f6895876cd59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bb5ab44-057e-4115-a477-602ef6feece3", "tag": "f52b7234-1d59-4c35-8b9d-e94552c618c2"}, {"name": "network-changed", "server_uuid": "26043446-8442-4d38-98d8-6ff9a1432d1b", "tag": "4a1925fc-3024-45ea-be46-b952667a8883"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:48.869512 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-b30193cf-9937-4f9b-949e-c24a2cb561b6 req-e0d2c5c4-1065-4fef-b985-f6895876cd59 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:48.870685 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-b30193cf-9937-4f9b-949e-c24a2cb561b6 req-e0d2c5c4-1065-4fef-b985-f6895876cd59 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:48.871116 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-b30193cf-9937-4f9b-949e-c24a2cb561b6 req-e0d2c5c4-1065-4fef-b985-f6895876cd59 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:48.883796 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-b30193cf-9937-4f9b-949e-c24a2cb561b6 req-e0d2c5c4-1065-4fef-b985-f6895876cd59 service nova] Creating event network-changed:f52b7234-1d59-4c35-8b9d-e94552c618c2 for instance 9bb5ab44-057e-4115-a477-602ef6feece3 on n-h2-master-1 Oct 23 01:11:48.884298 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-b30193cf-9937-4f9b-949e-c24a2cb561b6 req-e0d2c5c4-1065-4fef-b985-f6895876cd59 service nova] Creating event network-changed:4a1925fc-3024-45ea-be46-b952667a8883 for instance 26043446-8442-4d38-98d8-6ff9a1432d1b on n-h1-master-1 Oct 23 01:11:48.893108 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-b30193cf-9937-4f9b-949e-c24a2cb561b6 req-e0d2c5c4-1065-4fef-b985-f6895876cd59 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.037364 Oct 23 01:11:48.893882 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 226/394] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:48.898658 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-79948f77-a52e-4ff6-a5f7-2992e0d33fb2 req-8911cbf8-0d4c-4e4c-9212-67cf109eb7b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56fab46b-b733-4279-8e6b-dd6b11013fb2", "name": "network-vif-plugged", "status": "completed", "tag": "cae2b753-bc1e-4126-9fef-5c92c0eac33d"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:48.908853 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-79948f77-a52e-4ff6-a5f7-2992e0d33fb2 req-8911cbf8-0d4c-4e4c-9212-67cf109eb7b3 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:48.909436 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-79948f77-a52e-4ff6-a5f7-2992e0d33fb2 req-8911cbf8-0d4c-4e4c-9212-67cf109eb7b3 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:48.909806 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-79948f77-a52e-4ff6-a5f7-2992e0d33fb2 req-8911cbf8-0d4c-4e4c-9212-67cf109eb7b3 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:48.922611 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-79948f77-a52e-4ff6-a5f7-2992e0d33fb2 req-8911cbf8-0d4c-4e4c-9212-67cf109eb7b3 service nova] Creating event network-vif-plugged:cae2b753-bc1e-4126-9fef-5c92c0eac33d for instance 56fab46b-b733-4279-8e6b-dd6b11013fb2 on n-h1-master-1 Oct 23 01:11:48.928045 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-79948f77-a52e-4ff6-a5f7-2992e0d33fb2 req-8911cbf8-0d4c-4e4c-9212-67cf109eb7b3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033045 Oct 23 01:11:48.928852 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 227/395] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:48.934626 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-746ed39f-2e8e-4535-9f40-8e60109d0496 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:48.937156 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-746ed39f-2e8e-4535-9f40-8e60109d0496 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:48.942836 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-746ed39f-2e8e-4535-9f40-8e60109d0496 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:48.943661 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-746ed39f-2e8e-4535-9f40-8e60109d0496 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:48.944348 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-746ed39f-2e8e-4535-9f40-8e60109d0496 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:48.945920 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-746ed39f-2e8e-4535-9f40-8e60109d0496 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:48.946583 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-746ed39f-2e8e-4535-9f40-8e60109d0496 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:48.947161 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-746ed39f-2e8e-4535-9f40-8e60109d0496 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:49.155868 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ce046e50-5d69-4df0-b08d-3bda7bc4fccd tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] 10.222.0.42 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.117927 Oct 23 01:11:49.155868 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 169/396] 10.222.0.42 () {60 vars in 1170 bytes} [Sun Oct 23 01:11:47 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:49.155868 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-27fd4cb9-05b0-4b35-82ed-70cc9e3c1cba tempest-FlavorsExtraSpecsNegativeTestJSON-493559463 tempest-FlavorsExtraSpecsNegativeTestJSON-493559463-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:49.156576 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-746ed39f-2e8e-4535-9f40-8e60109d0496 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:49.165595 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-746ed39f-2e8e-4535-9f40-8e60109d0496 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:49.168363 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-746ed39f-2e8e-4535-9f40-8e60109d0496 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:49.175299 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-746ed39f-2e8e-4535-9f40-8e60109d0496 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1537 microversion: 2.91 time: 0.244941 Oct 23 01:11:49.176058 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 228/397] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:11:48 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1537 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:11:49.181760 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5bc24352-9877-41be-9c8b-1aeb62a68865 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:49.182682 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5bc24352-9877-41be-9c8b-1aeb62a68865 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 26043446-8442-4d38-98d8-6ff9a1432d1b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:49.191200 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5bc24352-9877-41be-9c8b-1aeb62a68865 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:49.191888 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5bc24352-9877-41be-9c8b-1aeb62a68865 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:49.192503 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5bc24352-9877-41be-9c8b-1aeb62a68865 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:49.193366 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5bc24352-9877-41be-9c8b-1aeb62a68865 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:49.194001 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5bc24352-9877-41be-9c8b-1aeb62a68865 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:49.194573 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5bc24352-9877-41be-9c8b-1aeb62a68865 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:49.266290 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-27fd4cb9-05b0-4b35-82ed-70cc9e3c1cba tempest-FlavorsExtraSpecsNegativeTestJSON-493559463 tempest-FlavorsExtraSpecsNegativeTestJSON-493559463-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/1906332412" status: 202 len: 0 microversion: 2.1 time: 0.115046 Oct 23 01:11:49.267222 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 170/398] 10.222.0.42 () {58 vars in 1161 bytes} [Sun Oct 23 01:11:49 2022] DELETE /compute/v2.1/flavors/1906332412 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:11:49.273041 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bf26729a-9d18-44cd-bea9-c1d305a319ff tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Action: 'action', calling method: .version_select at 0x7f5cc3c8faf0>, body: {"addFloatingIp": {"address": "172.35.6.99"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:49.276012 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bf26729a-9d18-44cd-bea9-c1d305a319ff tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] [instance: 9bb5ab44-057e-4115-a477-602ef6feece3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:49.282933 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf26729a-9d18-44cd-bea9-c1d305a319ff tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:49.283706 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf26729a-9d18-44cd-bea9-c1d305a319ff tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:49.284346 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf26729a-9d18-44cd-bea9-c1d305a319ff tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:49.285258 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf26729a-9d18-44cd-bea9-c1d305a319ff tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:49.285899 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf26729a-9d18-44cd-bea9-c1d305a319ff tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:49.286769 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf26729a-9d18-44cd-bea9-c1d305a319ff tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:49.363248 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf26729a-9d18-44cd-bea9-c1d305a319ff tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Acquiring lock "refresh_cache-9bb5ab44-057e-4115-a477-602ef6feece3" {{(pid=120944) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 23 01:11:49.363786 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf26729a-9d18-44cd-bea9-c1d305a319ff tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Acquired lock "refresh_cache-9bb5ab44-057e-4115-a477-602ef6feece3" {{(pid=120944) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 23 01:11:49.705872 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=10 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:49.849142 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5bc24352-9877-41be-9c8b-1aeb62a68865 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:49.857713 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5bc24352-9877-41be-9c8b-1aeb62a68865 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b" status: 200 len: 1504 microversion: 2.1 time: 0.680151 Oct 23 01:11:49.858572 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 229/399] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:49 2022] GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b => generated 1504 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:49.862958 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-00977ffc-c01e-410d-aa5c-a1cc17cd6ec0 tempest-FlavorsExtraSpecsNegativeTestJSON-493559463 tempest-FlavorsExtraSpecsNegativeTestJSON-493559463-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:49.887386 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-00977ffc-c01e-410d-aa5c-a1cc17cd6ec0 tempest-FlavorsExtraSpecsNegativeTestJSON-493559463 tempest-FlavorsExtraSpecsNegativeTestJSON-493559463-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.026332 Oct 23 01:11:49.900203 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 230/400] 10.222.0.42 () {58 vars in 1146 bytes} [Sun Oct 23 01:11:49 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:50.113013 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-247c89ff-38af-471b-9500-7c42359b3903 tempest-HypervisorAdminNegativeUnderV252Test-1770089774 tempest-HypervisorAdminNegativeUnderV252Test-1770089774-project-admin] Calling method '.version_select at 0x7f5cc26fb3a0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:50.116115 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-247c89ff-38af-471b-9500-7c42359b3903 tempest-HypervisorAdminNegativeUnderV252Test-1770089774 tempest-HypervisorAdminNegativeUnderV252Test-1770089774-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:50.116115 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-247c89ff-38af-471b-9500-7c42359b3903 tempest-HypervisorAdminNegativeUnderV252Test-1770089774 tempest-HypervisorAdminNegativeUnderV252Test-1770089774-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:50.116668 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-247c89ff-38af-471b-9500-7c42359b3903 tempest-HypervisorAdminNegativeUnderV252Test-1770089774 tempest-HypervisorAdminNegativeUnderV252Test-1770089774-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:50.140913 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-247c89ff-38af-471b-9500-7c42359b3903 tempest-HypervisorAdminNegativeUnderV252Test-1770089774 tempest-HypervisorAdminNegativeUnderV252Test-1770089774-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:50.141370 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-247c89ff-38af-471b-9500-7c42359b3903 tempest-HypervisorAdminNegativeUnderV252Test-1770089774 tempest-HypervisorAdminNegativeUnderV252Test-1770089774-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:50.141813 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-247c89ff-38af-471b-9500-7c42359b3903 tempest-HypervisorAdminNegativeUnderV252Test-1770089774 tempest-HypervisorAdminNegativeUnderV252Test-1770089774-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:50.160003 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-247c89ff-38af-471b-9500-7c42359b3903 tempest-HypervisorAdminNegativeUnderV252Test-1770089774 tempest-HypervisorAdminNegativeUnderV252Test-1770089774-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:50.160764 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-247c89ff-38af-471b-9500-7c42359b3903 tempest-HypervisorAdminNegativeUnderV252Test-1770089774 tempest-HypervisorAdminNegativeUnderV252Test-1770089774-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:50.161613 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-247c89ff-38af-471b-9500-7c42359b3903 tempest-HypervisorAdminNegativeUnderV252Test-1770089774 tempest-HypervisorAdminNegativeUnderV252Test-1770089774-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:50.171438 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-247c89ff-38af-471b-9500-7c42359b3903 tempest-HypervisorAdminNegativeUnderV252Test-1770089774 tempest-HypervisorAdminNegativeUnderV252Test-1770089774-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.269981 Oct 23 01:11:50.172228 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 231/401] 10.222.0.42 () {58 vars in 1146 bytes} [Sun Oct 23 01:11:49 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:50.178348 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f6be1c28-8b3b-4118-b0e9-5e0c3a00fb69 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:50.179883 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f6be1c28-8b3b-4118-b0e9-5e0c3a00fb69 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] [instance: 56fab46b-b733-4279-8e6b-dd6b11013fb2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:50.187182 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f6be1c28-8b3b-4118-b0e9-5e0c3a00fb69 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:50.187666 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f6be1c28-8b3b-4118-b0e9-5e0c3a00fb69 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:50.188416 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f6be1c28-8b3b-4118-b0e9-5e0c3a00fb69 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:50.189286 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f6be1c28-8b3b-4118-b0e9-5e0c3a00fb69 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:50.189779 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f6be1c28-8b3b-4118-b0e9-5e0c3a00fb69 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:50.190315 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f6be1c28-8b3b-4118-b0e9-5e0c3a00fb69 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:50.392464 n-d-master-1 devstack@n-api.service[120944]: DEBUG neutronclient.v2_0.client [None req-bf26729a-9d18-44cd-bea9-c1d305a319ff tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.35.6.99 (04f1535f-6325-4a3f-a478-79d51242de32) with port f52b7234-1d59-4c35-8b9d-e94552c618c2 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network e33e8d81-9a30-4a90-a2ad-d9c074d3dc77.", "detail": ""}} {{(pid=120944) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 23 01:11:50.394797 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf26729a-9d18-44cd-bea9-c1d305a319ff tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Releasing lock "refresh_cache-9bb5ab44-057e-4115-a477-602ef6feece3" {{(pid=120944) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 23 01:11:50.397247 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-bf26729a-9d18-44cd-bea9-c1d305a319ff tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] HTTP exception thrown: Cannot associate floating IP 172.35.6.99 (04f1535f-6325-4a3f-a478-79d51242de32) with port f52b7234-1d59-4c35-8b9d-e94552c618c2 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network e33e8d81-9a30-4a90-a2ad-d9c074d3dc77. Oct 23 01:11:50.397247 n-d-master-1 devstack@n-api.service[120944]: Neutron server returns request_ids: ['req-758c2cec-bd1b-4074-a5c7-65897abd57bb'] Oct 23 01:11:50.416639 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bf26729a-9d18-44cd-bea9-c1d305a319ff tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Request method failure captured: Oct 23 01:11:50.416639 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/servers/9bb5ab44-057e-4115-a477-602ef6feece3/action HTTP/1.1 Oct 23 01:11:50.416639 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:11:50.416639 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:11:50.416639 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:11:50.416639 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 45 Oct 23 01:11:50.416639 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:11:50.416639 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:11:50.416639 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:11:50.416639 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:11:50.416639 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJS1fYy_rmFnFNEcRI54qAmDFzEjFZqRJFQPCRzXdt_XqD7y1fGbU90inPCCyf9eKyuyhSmw7i3KZCr9D1o8YeH3GgiieXpGJFerc_ocxwN3z6lo2EGuwtdEvpzujbeALsLwwt5MSJ2MyK8Ek9E6JDByuL9D9VdDEDVWzrVO-MwxCdg Oct 23 01:11:50.416639 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:11:50.416639 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:11:50.416639 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:11:50.416639 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:11:50.416639 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:11:50.416639 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:11:50.416639 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: b7864a40d26e402d815d39ef0c0f91a1 Oct 23 01:11:50.416639 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-434430825 Oct 23 01:11:50.416639 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:11:50.416639 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:11:50.418717 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b7864a40d26e402d815d39ef0c0f91a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b7864a40d26e402d815d39ef0c0f91a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b7864a40d26e402d815d39ef0c0f91a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b7864a40d26e402d815d39ef0c0f91a1"}]}] Oct 23 01:11:50.418717 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-434430825 Oct 23 01:11:50.418717 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: b7864a40d26e402d815d39ef0c0f91a1 Oct 23 01:11:50.418717 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-434430825 Oct 23 01:11:50.418717 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project Oct 23 01:11:50.418717 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:11:50.418717 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:11:50.418717 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 74c84b03f3f8431e9d3c0cbb792aeaf9 Oct 23 01:11:50.418717 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project Oct 23 01:11:50.418717 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:11:50.418717 n-d-master-1 devstack@n-api.service[120944]: {"addFloatingIp": {"address": "172.35.6.99"}} Oct 23 01:11:50.418717 n-d-master-1 devstack@n-api.service[120944]: method: Oct 23 01:11:50.419425 n-d-master-1 devstack@n-api.service[120944]: exception: Cannot associate floating IP 172.35.6.99 (04f1535f-6325-4a3f-a478-79d51242de32) with port f52b7234-1d59-4c35-8b9d-e94552c618c2 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network e33e8d81-9a30-4a90-a2ad-d9c074d3dc77. Oct 23 01:11:50.419425 n-d-master-1 devstack@n-api.service[120944]: Neutron server returns request_ids: ['req-758c2cec-bd1b-4074-a5c7-65897abd57bb'] Oct 23 01:11:50.419425 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '9bb5ab44-057e-4115-a477-602ef6feece3', 'body': {'addFloatingIp': {'address': '172.35.6.99'}}} Oct 23 01:11:50.419425 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:11:50.419425 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:50.419425 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 23 01:11:50.419425 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 23 01:11:50.419425 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:11:50.419425 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:11:50.419425 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 23 01:11:50.419425 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 23 01:11:50.419425 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:11:50.419425 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:11:50.419425 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 23 01:11:50.419425 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 23 01:11:50.419425 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:11:50.419425 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:11:50.420419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 23 01:11:50.420419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 23 01:11:50.420419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:11:50.420419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:11:50.420419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 23 01:11:50.420419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 23 01:11:50.420419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:11:50.420419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:11:50.420419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 23 01:11:50.420419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 23 01:11:50.420419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:11:50.420419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:11:50.420419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 23 01:11:50.420419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 23 01:11:50.420419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 23 01:11:50.420419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 23 01:11:50.421645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.35.6.99 (04f1535f-6325-4a3f-a478-79d51242de32) with port f52b7234-1d59-4c35-8b9d-e94552c618c2 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network e33e8d81-9a30-4a90-a2ad-d9c074d3dc77. Oct 23 01:11:50.421645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-758c2cec-bd1b-4074-a5c7-65897abd57bb'] Oct 23 01:11:50.421645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:50.421645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:11:50.421645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:50.421645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:50.421645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 23 01:11:50.421645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 23 01:11:50.421645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 23 01:11:50.421645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 23 01:11:50.421645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 23 01:11:50.421645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 23 01:11:50.421645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.35.6.99 (04f1535f-6325-4a3f-a478-79d51242de32) with port f52b7234-1d59-4c35-8b9d-e94552c618c2 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network e33e8d81-9a30-4a90-a2ad-d9c074d3dc77. Oct 23 01:11:50.421645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-758c2cec-bd1b-4074-a5c7-65897abd57bb'] Oct 23 01:11:50.421645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:50.421645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:11:50.422640 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:50.422640 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:50.422640 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:50.422640 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:50.422640 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:11:50.422640 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:11:50.422640 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:11:50.422640 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:11:50.422640 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:11:50.422640 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:11:50.422640 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:11:50.422640 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:11:50.422640 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 23 01:11:50.422640 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 23 01:11:50.422640 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.35.6.99 (04f1535f-6325-4a3f-a478-79d51242de32) with port f52b7234-1d59-4c35-8b9d-e94552c618c2 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network e33e8d81-9a30-4a90-a2ad-d9c074d3dc77. Oct 23 01:11:50.422640 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-758c2cec-bd1b-4074-a5c7-65897abd57bb'] Oct 23 01:11:50.422640 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:50.422640 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:11:50.423865 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:50.423865 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:50.423865 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:50.423865 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:50.423865 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:11:50.423865 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:11:50.423865 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.35.6.99 (04f1535f-6325-4a3f-a478-79d51242de32) with port f52b7234-1d59-4c35-8b9d-e94552c618c2 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network e33e8d81-9a30-4a90-a2ad-d9c074d3dc77. Oct 23 01:11:50.423865 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-758c2cec-bd1b-4074-a5c7-65897abd57bb'] Oct 23 01:11:50.423865 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:50.423865 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bf26729a-9d18-44cd-bea9-c1d305a319ff tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Returning 400 to user: Cannot associate floating IP 172.35.6.99 (04f1535f-6325-4a3f-a478-79d51242de32) with port f52b7234-1d59-4c35-8b9d-e94552c618c2 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network e33e8d81-9a30-4a90-a2ad-d9c074d3dc77. Oct 23 01:11:50.423865 n-d-master-1 devstack@n-api.service[120944]: Neutron server returns request_ids: ['req-758c2cec-bd1b-4074-a5c7-65897abd57bb'] {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:11:50.424503 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bf26729a-9d18-44cd-bea9-c1d305a319ff tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] 10.222.0.42 "POST /compute/v2.1/servers/9bb5ab44-057e-4115-a477-602ef6feece3/action" status: 400 len: 380 microversion: 2.1 time: 1.149141 Oct 23 01:11:50.424503 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 171/402] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:11:49 2022] POST /compute/v2.1/servers/9bb5ab44-057e-4115-a477-602ef6feece3/action => generated 380 bytes in 1152 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:11:50.493063 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f6be1c28-8b3b-4118-b0e9-5e0c3a00fb69 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76739eabf8804ec2af41abc4c1e6fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f22fb0ca7346c4ab225ce82d69118c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:50.493214 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:50.499858 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f6be1c28-8b3b-4118-b0e9-5e0c3a00fb69 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] 10.222.0.42 "GET /compute/v2.1/servers/56fab46b-b733-4279-8e6b-dd6b11013fb2" status: 200 len: 1318 microversion: 2.1 time: 0.326462 Oct 23 01:11:50.514747 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 232/403] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:50 2022] GET /compute/v2.1/servers/56fab46b-b733-4279-8e6b-dd6b11013fb2 => generated 1318 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:50.514747 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-63789c8e-54fb-4dac-b417-1ee892b6c624 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:50.514747 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-63789c8e-54fb-4dac-b417-1ee892b6c624 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:50.514747 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-63789c8e-54fb-4dac-b417-1ee892b6c624 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:50.515179 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-63789c8e-54fb-4dac-b417-1ee892b6c624 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:50.515179 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-63789c8e-54fb-4dac-b417-1ee892b6c624 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:50.515179 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-63789c8e-54fb-4dac-b417-1ee892b6c624 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:50.515179 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-63789c8e-54fb-4dac-b417-1ee892b6c624 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:50.515520 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-63789c8e-54fb-4dac-b417-1ee892b6c624 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:50.611016 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-63789c8e-54fb-4dac-b417-1ee892b6c624 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:50.637283 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-63789c8e-54fb-4dac-b417-1ee892b6c624 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:50.642103 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-63789c8e-54fb-4dac-b417-1ee892b6c624 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:50.648861 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-63789c8e-54fb-4dac-b417-1ee892b6c624 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1537 microversion: 2.91 time: 0.147297 Oct 23 01:11:50.660391 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 233/404] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:11:50 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1537 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:11:50.679894 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2956e600-dedb-40c4-8949-fb4bc1e075ce tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Calling method '.version_select at 0x7f5cc26aeb80>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:50.728227 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9ce9374c-9b3d-4dba-badf-9a741d967599 tempest-HypervisorAdminNegativeUnderV252Test-1430499149 tempest-HypervisorAdminNegativeUnderV252Test-1430499149-project] Calling method '.version_select at 0x7f5cc2638f70>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:50.730350 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9ce9374c-9b3d-4dba-badf-9a741d967599 tempest-HypervisorAdminNegativeUnderV252Test-1430499149 tempest-HypervisorAdminNegativeUnderV252Test-1430499149-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '4366c04cd148419cac2a79c4ba1f7170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42cd18675c45498bb2b0e5938e4b95ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:50.738973 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9ce9374c-9b3d-4dba-badf-9a741d967599 tempest-HypervisorAdminNegativeUnderV252Test-1430499149 tempest-HypervisorAdminNegativeUnderV252Test-1430499149-project] Request method failure captured: Oct 23 01:11:50.738973 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/os-hypervisors/n-h1-master-1/search HTTP/1.1 Oct 23 01:11:50.738973 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:11:50.738973 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:11:50.738973 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:11:50.738973 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:11:50.738973 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:11:50.738973 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:11:50.738973 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:11:50.738973 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:11:50.738973 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJTUg_9oSumVHuHsFTzvREB50BYz0kmF3yj9Y7zqo54ZJ93aBMKGIRNLOdNyinyfaRXq_33li_mCe5As0VKpWM_VzGRHZx5EASz6hXysLS7Po--bdQ2La_dxyE5Rhqw-K-d4TlQmj755V7DNHt6gF_oFzGJoHIKd916NFXN3jQC2UVk Oct 23 01:11:50.738973 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:11:50.738973 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:11:50.738973 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:11:50.738973 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:11:50.738973 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:11:50.738973 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:11:50.738973 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 42cd18675c45498bb2b0e5938e4b95ad Oct 23 01:11:50.738973 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1430499149 Oct 23 01:11:50.738973 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:11:50.738973 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:11:50.740430 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/42cd18675c45498bb2b0e5938e4b95ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_42cd18675c45498bb2b0e5938e4b95ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/42cd18675c45498bb2b0e5938e4b95ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/42cd18675c45498bb2b0e5938e4b95ad"}]}] Oct 23 01:11:50.740430 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1430499149 Oct 23 01:11:50.740430 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 42cd18675c45498bb2b0e5938e4b95ad Oct 23 01:11:50.740430 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1430499149 Oct 23 01:11:50.740430 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1430499149-project Oct 23 01:11:50.740430 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:11:50.740430 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:11:50.740430 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 4366c04cd148419cac2a79c4ba1f7170 Oct 23 01:11:50.740430 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1430499149-project Oct 23 01:11:50.740430 n-d-master-1 devstack@n-api.service[120944]: method: Oct 23 01:11:50.740430 n-d-master-1 devstack@n-api.service[120944]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 23 01:11:50.740430 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'n-h1-master-1'} Oct 23 01:11:50.741281 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:11:50.741281 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:50.741281 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:50.741281 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:50.741281 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:11:50.741281 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:11:50.741281 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:11:50.741281 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:11:50.741281 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:11:50.741281 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:11:50.741281 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 23 01:11:50.741281 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 23 01:11:50.741281 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 23 01:11:50.741281 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 23 01:11:50.741281 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 23 01:11:50.741281 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 23 01:11:50.741281 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:11:50.741281 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 23 01:11:50.741281 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:11:50.742599 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise self.value Oct 23 01:11:50.742599 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 23 01:11:50.742599 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 23 01:11:50.742599 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 23 01:11:50.742599 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 23 01:11:50.742599 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 23 01:11:50.742599 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 23 01:11:50.742599 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 23 01:11:50.742599 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:50.742599 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:11:50.742599 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:50.742599 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:50.742599 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:50.742599 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:50.742599 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 23 01:11:50.742599 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 23 01:11:50.742599 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 23 01:11:50.742599 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:50.744452 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9ce9374c-9b3d-4dba-badf-9a741d967599 tempest-HypervisorAdminNegativeUnderV252Test-1430499149 tempest-HypervisorAdminNegativeUnderV252Test-1430499149-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:11:50.744452 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9ce9374c-9b3d-4dba-badf-9a741d967599 tempest-HypervisorAdminNegativeUnderV252Test-1430499149 tempest-HypervisorAdminNegativeUnderV252Test-1430499149-project] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/n-h1-master-1/search" status: 403 len: 117 microversion: 2.1 time: 0.312952 Oct 23 01:11:50.744452 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 172/405] 10.222.0.42 () {58 vars in 1209 bytes} [Sun Oct 23 01:11:50 2022] GET /compute/v2.1/os-hypervisors/n-h1-master-1/search => generated 117 bytes in 314 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:11:50.750380 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1f17a2a7-c144-45d6-b105-a9cab05cbd58 tempest-HypervisorAdminNegativeUnderV252Test-1770089774 tempest-HypervisorAdminNegativeUnderV252Test-1770089774-project-admin] Calling method '.version_select at 0x7f5cc26433a0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:50.752504 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f17a2a7-c144-45d6-b105-a9cab05cbd58 tempest-HypervisorAdminNegativeUnderV252Test-1770089774 tempest-HypervisorAdminNegativeUnderV252Test-1770089774-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:50.763280 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f17a2a7-c144-45d6-b105-a9cab05cbd58 tempest-HypervisorAdminNegativeUnderV252Test-1770089774 tempest-HypervisorAdminNegativeUnderV252Test-1770089774-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:50.764564 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f17a2a7-c144-45d6-b105-a9cab05cbd58 tempest-HypervisorAdminNegativeUnderV252Test-1770089774 tempest-HypervisorAdminNegativeUnderV252Test-1770089774-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:50.776467 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-1f17a2a7-c144-45d6-b105-a9cab05cbd58 tempest-HypervisorAdminNegativeUnderV252Test-1770089774 tempest-HypervisorAdminNegativeUnderV252Test-1770089774-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 23 01:11:50.779068 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1f17a2a7-c144-45d6-b105-a9cab05cbd58 tempest-HypervisorAdminNegativeUnderV252Test-1770089774 tempest-HypervisorAdminNegativeUnderV252Test-1770089774-project-admin] Request method failure captured: Oct 23 01:11:50.779068 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 23 01:11:50.779068 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:11:50.779068 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:11:50.779068 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:11:50.779068 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:11:50.779068 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:11:50.779068 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:11:50.779068 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:11:50.779068 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:11:50.779068 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJTVJhxeRM1opNzFPkDwWAQguy-TXE684mLSSghoQHYMetXECNmCypsTTmKTo1oGAm0p2sdKwt4ELp-eYSJi1kGwbcZsZUwXLVmRkL_woU6Mj3183m_sszM5HSa5Mth4LJFQOwgT1dESlwvhBPd7EcxjM6MoaPwfbdo4IR-9Q08vpFo Oct 23 01:11:50.779068 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:11:50.779068 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:11:50.779068 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:11:50.779068 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:11:50.779068 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:11:50.779068 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:11:50.779068 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 9c6cb02a58204c49af8c4c53ef8a12c6 Oct 23 01:11:50.779068 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1770089774 Oct 23 01:11:50.779068 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,admin,reader Oct 23 01:11:50.779068 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,admin,reader Oct 23 01:11:50.780553 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9c6cb02a58204c49af8c4c53ef8a12c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9c6cb02a58204c49af8c4c53ef8a12c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9c6cb02a58204c49af8c4c53ef8a12c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9c6cb02a58204c49af8c4c53ef8a12c6"}]}] Oct 23 01:11:50.780553 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1770089774 Oct 23 01:11:50.780553 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 9c6cb02a58204c49af8c4c53ef8a12c6 Oct 23 01:11:50.780553 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1770089774 Oct 23 01:11:50.780553 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1770089774-project-admin Oct 23 01:11:50.780553 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:11:50.780553 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:11:50.780553 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 1c871a4f1ef84451906b10cbc32051b3 Oct 23 01:11:50.780553 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1770089774-project-admin Oct 23 01:11:50.780553 n-d-master-1 devstack@n-api.service[120944]: method: Oct 23 01:11:50.780553 n-d-master-1 devstack@n-api.service[120944]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 23 01:11:50.780553 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 23 01:11:50.781768 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:11:50.781768 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:50.781768 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:50.781768 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:50.781768 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:11:50.781768 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:11:50.781768 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:11:50.781768 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:11:50.781768 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:11:50.781768 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:11:50.781768 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 23 01:11:50.781768 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 23 01:11:50.781768 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 23 01:11:50.781768 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 23 01:11:50.781768 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 23 01:11:50.781768 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:50.781768 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:11:50.781768 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:50.781768 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:50.781768 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:50.784129 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:50.784129 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:11:50.784129 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:11:50.784129 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 23 01:11:50.784129 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:50.784558 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1f17a2a7-c144-45d6-b105-a9cab05cbd58 tempest-HypervisorAdminNegativeUnderV252Test-1770089774 tempest-HypervisorAdminNegativeUnderV252Test-1770089774-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:11:50.785733 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1f17a2a7-c144-45d6-b105-a9cab05cbd58 tempest-HypervisorAdminNegativeUnderV252Test-1770089774 tempest-HypervisorAdminNegativeUnderV252Test-1770089774-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.038966 Oct 23 01:11:50.790349 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 173/406] 10.222.0.42 () {58 vars in 1251 bytes} [Sun Oct 23 01:11:50 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:11:50.799822 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e08ddd6c-b9a1-4a24-ab17-3b6157f9f5f0 tempest-HypervisorAdminNegativeUnderV252Test-1770089774 tempest-HypervisorAdminNegativeUnderV252Test-1770089774-project-admin] Calling method '.version_select at 0x7f5cc2439670>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:50.802089 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e08ddd6c-b9a1-4a24-ab17-3b6157f9f5f0 tempest-HypervisorAdminNegativeUnderV252Test-1770089774 tempest-HypervisorAdminNegativeUnderV252Test-1770089774-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:50.802845 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e08ddd6c-b9a1-4a24-ab17-3b6157f9f5f0 tempest-HypervisorAdminNegativeUnderV252Test-1770089774 tempest-HypervisorAdminNegativeUnderV252Test-1770089774-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:50.803613 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e08ddd6c-b9a1-4a24-ab17-3b6157f9f5f0 tempest-HypervisorAdminNegativeUnderV252Test-1770089774 tempest-HypervisorAdminNegativeUnderV252Test-1770089774-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:50.807476 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:50.821805 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e08ddd6c-b9a1-4a24-ab17-3b6157f9f5f0 tempest-HypervisorAdminNegativeUnderV252Test-1770089774 tempest-HypervisorAdminNegativeUnderV252Test-1770089774-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:50.822677 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e08ddd6c-b9a1-4a24-ab17-3b6157f9f5f0 tempest-HypervisorAdminNegativeUnderV252Test-1770089774 tempest-HypervisorAdminNegativeUnderV252Test-1770089774-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:50.823435 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e08ddd6c-b9a1-4a24-ab17-3b6157f9f5f0 tempest-HypervisorAdminNegativeUnderV252Test-1770089774 tempest-HypervisorAdminNegativeUnderV252Test-1770089774-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:50.836659 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e08ddd6c-b9a1-4a24-ab17-3b6157f9f5f0 tempest-HypervisorAdminNegativeUnderV252Test-1770089774 tempest-HypervisorAdminNegativeUnderV252Test-1770089774-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:50.837292 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e08ddd6c-b9a1-4a24-ab17-3b6157f9f5f0 tempest-HypervisorAdminNegativeUnderV252Test-1770089774 tempest-HypervisorAdminNegativeUnderV252Test-1770089774-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:50.837795 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e08ddd6c-b9a1-4a24-ab17-3b6157f9f5f0 tempest-HypervisorAdminNegativeUnderV252Test-1770089774 tempest-HypervisorAdminNegativeUnderV252Test-1770089774-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:50.848628 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e08ddd6c-b9a1-4a24-ab17-3b6157f9f5f0 tempest-HypervisorAdminNegativeUnderV252Test-1770089774 tempest-HypervisorAdminNegativeUnderV252Test-1770089774-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.055183 Oct 23 01:11:50.849794 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 174/407] 10.222.0.42 () {58 vars in 1146 bytes} [Sun Oct 23 01:11:50 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:50.864000 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7d2d7fd0-cb6e-424e-85ac-ec8bf1de80d7 tempest-HypervisorAdminNegativeUnderV252Test-1430499149 tempest-HypervisorAdminNegativeUnderV252Test-1430499149-project] Calling method '.version_select at 0x7f5cc25a2430>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:50.866899 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7d2d7fd0-cb6e-424e-85ac-ec8bf1de80d7 tempest-HypervisorAdminNegativeUnderV252Test-1430499149 tempest-HypervisorAdminNegativeUnderV252Test-1430499149-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '4366c04cd148419cac2a79c4ba1f7170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42cd18675c45498bb2b0e5938e4b95ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:50.869155 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7d2d7fd0-cb6e-424e-85ac-ec8bf1de80d7 tempest-HypervisorAdminNegativeUnderV252Test-1430499149 tempest-HypervisorAdminNegativeUnderV252Test-1430499149-project] Request method failure captured: Oct 23 01:11:50.869155 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 23 01:11:50.869155 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:11:50.869155 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:11:50.869155 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:11:50.869155 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:11:50.869155 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:11:50.869155 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:11:50.869155 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:11:50.869155 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:11:50.869155 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJTUg_9oSumVHuHsFTzvREB50BYz0kmF3yj9Y7zqo54ZJ93aBMKGIRNLOdNyinyfaRXq_33li_mCe5As0VKpWM_VzGRHZx5EASz6hXysLS7Po--bdQ2La_dxyE5Rhqw-K-d4TlQmj755V7DNHt6gF_oFzGJoHIKd916NFXN3jQC2UVk Oct 23 01:11:50.869155 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:11:50.869155 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:11:50.869155 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:11:50.869155 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:11:50.869155 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:11:50.869155 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:11:50.869155 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 42cd18675c45498bb2b0e5938e4b95ad Oct 23 01:11:50.869155 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1430499149 Oct 23 01:11:50.869155 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:11:50.869155 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:11:50.870698 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/42cd18675c45498bb2b0e5938e4b95ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_42cd18675c45498bb2b0e5938e4b95ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/42cd18675c45498bb2b0e5938e4b95ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/42cd18675c45498bb2b0e5938e4b95ad"}]}] Oct 23 01:11:50.870698 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1430499149 Oct 23 01:11:50.870698 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 42cd18675c45498bb2b0e5938e4b95ad Oct 23 01:11:50.870698 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1430499149 Oct 23 01:11:50.870698 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1430499149-project Oct 23 01:11:50.870698 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:11:50.870698 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:11:50.870698 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 4366c04cd148419cac2a79c4ba1f7170 Oct 23 01:11:50.870698 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1430499149-project Oct 23 01:11:50.870698 n-d-master-1 devstack@n-api.service[120944]: method: Oct 23 01:11:50.870698 n-d-master-1 devstack@n-api.service[120944]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 23 01:11:50.870698 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '1'} Oct 23 01:11:50.877178 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:11:50.877178 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:50.877178 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:50.877178 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:50.877178 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:11:50.877178 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:11:50.877178 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:11:50.877178 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:11:50.877178 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:11:50.877178 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:11:50.877178 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 23 01:11:50.877178 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 23 01:11:50.877178 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 23 01:11:50.877178 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 23 01:11:50.877178 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 23 01:11:50.877178 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 23 01:11:50.877178 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:11:50.877178 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 23 01:11:50.877178 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:11:50.878383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise self.value Oct 23 01:11:50.878383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 23 01:11:50.878383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 23 01:11:50.878383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 23 01:11:50.878383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 23 01:11:50.878383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 23 01:11:50.878383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 23 01:11:50.878383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 23 01:11:50.878383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:50.878383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:11:50.878383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:50.878383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:50.878383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:50.878383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:50.878383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 23 01:11:50.878383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 23 01:11:50.878383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 23 01:11:50.878383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:50.879544 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7d2d7fd0-cb6e-424e-85ac-ec8bf1de80d7 tempest-HypervisorAdminNegativeUnderV252Test-1430499149 tempest-HypervisorAdminNegativeUnderV252Test-1430499149-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:11:50.879544 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7d2d7fd0-cb6e-424e-85ac-ec8bf1de80d7 tempest-HypervisorAdminNegativeUnderV252Test-1430499149 tempest-HypervisorAdminNegativeUnderV252Test-1430499149-project] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.012164 Oct 23 01:11:50.879544 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 175/408] 10.222.0.42 () {58 vars in 1176 bytes} [Sun Oct 23 01:11:50 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:11:50.884578 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5960e856-4fde-4918-8264-0df149a3ad04 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:50.885398 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5960e856-4fde-4918-8264-0df149a3ad04 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 26043446-8442-4d38-98d8-6ff9a1432d1b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:50.895979 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5960e856-4fde-4918-8264-0df149a3ad04 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:50.896833 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5960e856-4fde-4918-8264-0df149a3ad04 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:50.897426 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5960e856-4fde-4918-8264-0df149a3ad04 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:50.898511 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5960e856-4fde-4918-8264-0df149a3ad04 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:50.899251 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5960e856-4fde-4918-8264-0df149a3ad04 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:50.899812 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5960e856-4fde-4918-8264-0df149a3ad04 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:51.299795 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5960e856-4fde-4918-8264-0df149a3ad04 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:51.301252 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5960e856-4fde-4918-8264-0df149a3ad04 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b" status: 200 len: 1504 microversion: 2.1 time: 0.424431 Oct 23 01:11:51.301833 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 176/409] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:50 2022] GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b => generated 1504 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:11:51.306188 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c0133640-15fa-4232-a780-dc291624b77c tempest-HypervisorAdminNegativeUnderV252Test-1770089774 tempest-HypervisorAdminNegativeUnderV252Test-1770089774-project-admin] Calling method '.version_select at 0x7f5cc24395e0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:51.308095 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c0133640-15fa-4232-a780-dc291624b77c tempest-HypervisorAdminNegativeUnderV252Test-1770089774 tempest-HypervisorAdminNegativeUnderV252Test-1770089774-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:51.308586 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c0133640-15fa-4232-a780-dc291624b77c tempest-HypervisorAdminNegativeUnderV252Test-1770089774 tempest-HypervisorAdminNegativeUnderV252Test-1770089774-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:51.309743 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c0133640-15fa-4232-a780-dc291624b77c tempest-HypervisorAdminNegativeUnderV252Test-1770089774 tempest-HypervisorAdminNegativeUnderV252Test-1770089774-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:51.316252 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-c0133640-15fa-4232-a780-dc291624b77c tempest-HypervisorAdminNegativeUnderV252Test-1770089774 tempest-HypervisorAdminNegativeUnderV252Test-1770089774-project-admin] HTTP exception thrown: No hypervisor matching '4b34295f-6542-40dc-acfa-26573e0d3493' could be found. Oct 23 01:11:51.317599 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c0133640-15fa-4232-a780-dc291624b77c tempest-HypervisorAdminNegativeUnderV252Test-1770089774 tempest-HypervisorAdminNegativeUnderV252Test-1770089774-project-admin] Request method failure captured: Oct 23 01:11:51.317599 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/os-hypervisors/4b34295f-6542-40dc-acfa-26573e0d3493/servers HTTP/1.1 Oct 23 01:11:51.317599 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:11:51.317599 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:11:51.317599 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:11:51.317599 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:11:51.317599 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:11:51.317599 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:11:51.317599 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:11:51.317599 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:11:51.317599 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJTVJhxeRM1opNzFPkDwWAQguy-TXE684mLSSghoQHYMetXECNmCypsTTmKTo1oGAm0p2sdKwt4ELp-eYSJi1kGwbcZsZUwXLVmRkL_woU6Mj3183m_sszM5HSa5Mth4LJFQOwgT1dESlwvhBPd7EcxjM6MoaPwfbdo4IR-9Q08vpFo Oct 23 01:11:51.317599 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:11:51.317599 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:11:51.317599 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:11:51.317599 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:11:51.317599 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:11:51.317599 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:11:51.317599 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 9c6cb02a58204c49af8c4c53ef8a12c6 Oct 23 01:11:51.317599 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1770089774 Oct 23 01:11:51.317599 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,admin,reader Oct 23 01:11:51.317599 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,admin,reader Oct 23 01:11:51.319077 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9c6cb02a58204c49af8c4c53ef8a12c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9c6cb02a58204c49af8c4c53ef8a12c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9c6cb02a58204c49af8c4c53ef8a12c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9c6cb02a58204c49af8c4c53ef8a12c6"}]}] Oct 23 01:11:51.319077 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1770089774 Oct 23 01:11:51.319077 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 9c6cb02a58204c49af8c4c53ef8a12c6 Oct 23 01:11:51.319077 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1770089774 Oct 23 01:11:51.319077 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1770089774-project-admin Oct 23 01:11:51.319077 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:11:51.319077 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:11:51.319077 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 1c871a4f1ef84451906b10cbc32051b3 Oct 23 01:11:51.319077 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1770089774-project-admin Oct 23 01:11:51.319077 n-d-master-1 devstack@n-api.service[120944]: method: Oct 23 01:11:51.319077 n-d-master-1 devstack@n-api.service[120944]: exception: No hypervisor matching '4b34295f-6542-40dc-acfa-26573e0d3493' could be found. Oct 23 01:11:51.319077 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '4b34295f-6542-40dc-acfa-26573e0d3493'} Oct 23 01:11:51.319830 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:11:51.319830 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:51.319830 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:51.319830 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:51.319830 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:11:51.319830 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:11:51.319830 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:11:51.319830 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:11:51.319830 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:11:51.319830 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:11:51.319830 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 23 01:11:51.319830 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 23 01:11:51.319830 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 23 01:11:51.319830 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 23 01:11:51.319830 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '4b34295f-6542-40dc-acfa-26573e0d3493' could be found. Oct 23 01:11:51.319830 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:51.319830 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:11:51.319830 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:51.319830 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:51.321323 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:51.321323 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:51.321323 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:11:51.321323 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:11:51.321323 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '4b34295f-6542-40dc-acfa-26573e0d3493' could be found. Oct 23 01:11:51.321323 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:51.321323 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c0133640-15fa-4232-a780-dc291624b77c tempest-HypervisorAdminNegativeUnderV252Test-1770089774 tempest-HypervisorAdminNegativeUnderV252Test-1770089774-project-admin] Returning 404 to user: No hypervisor matching '4b34295f-6542-40dc-acfa-26573e0d3493' could be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:11:51.321323 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c0133640-15fa-4232-a780-dc291624b77c tempest-HypervisorAdminNegativeUnderV252Test-1770089774 tempest-HypervisorAdminNegativeUnderV252Test-1770089774-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/4b34295f-6542-40dc-acfa-26573e0d3493/servers" status: 404 len: 123 microversion: 2.1 time: 0.016227 Oct 23 01:11:51.321323 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 177/410] 10.222.0.42 () {58 vars in 1281 bytes} [Sun Oct 23 01:11:51 2022] GET /compute/v2.1/os-hypervisors/4b34295f-6542-40dc-acfa-26573e0d3493/servers => generated 123 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:11:51.646159 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d5c21226-2de2-4a59-9fff-92f6f2a96d0b tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-303337428", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:51.707700 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2956e600-dedb-40c4-8949-fb4bc1e075ce tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] 10.222.0.42 "DELETE /compute/v2.1/os-floating-ips/04f1535f-6325-4a3f-a478-79d51242de32" status: 202 len: 0 microversion: 2.1 time: 1.045955 Oct 23 01:11:51.708546 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 234/411] 10.222.0.42 () {58 vars in 1263 bytes} [Sun Oct 23 01:11:50 2022] DELETE /compute/v2.1/os-floating-ips/04f1535f-6325-4a3f-a478-79d51242de32 => generated 0 bytes in 1047 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:11:51.708936 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-d5c21226-2de2-4a59-9fff-92f6f2a96d0b tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] validate_networks() for None {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:11:51.713678 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1a4fec87-abf1-488c-9a29-049f4709c203 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:51.714326 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1a4fec87-abf1-488c-9a29-049f4709c203 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] [instance: 56fab46b-b733-4279-8e6b-dd6b11013fb2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:51.721021 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1a4fec87-abf1-488c-9a29-049f4709c203 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:51.721517 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1a4fec87-abf1-488c-9a29-049f4709c203 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:51.721943 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1a4fec87-abf1-488c-9a29-049f4709c203 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:51.722660 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1a4fec87-abf1-488c-9a29-049f4709c203 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:51.723107 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1a4fec87-abf1-488c-9a29-049f4709c203 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:51.723530 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1a4fec87-abf1-488c-9a29-049f4709c203 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:51.950762 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1a4fec87-abf1-488c-9a29-049f4709c203 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76739eabf8804ec2af41abc4c1e6fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f22fb0ca7346c4ab225ce82d69118c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:51.958725 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1a4fec87-abf1-488c-9a29-049f4709c203 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] 10.222.0.42 "GET /compute/v2.1/servers/56fab46b-b733-4279-8e6b-dd6b11013fb2" status: 200 len: 1467 microversion: 2.1 time: 0.248743 Oct 23 01:11:51.959454 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 235/412] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:51 2022] GET /compute/v2.1/servers/56fab46b-b733-4279-8e6b-dd6b11013fb2 => generated 1467 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:51.964370 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0856159f-65fb-49f5-8234-6e0e222c9191 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:51.965195 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0856159f-65fb-49f5-8234-6e0e222c9191 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:51.974624 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0856159f-65fb-49f5-8234-6e0e222c9191 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:51.975335 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0856159f-65fb-49f5-8234-6e0e222c9191 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:51.975957 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0856159f-65fb-49f5-8234-6e0e222c9191 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:51.977724 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0856159f-65fb-49f5-8234-6e0e222c9191 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:51.978353 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0856159f-65fb-49f5-8234-6e0e222c9191 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:51.978818 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0856159f-65fb-49f5-8234-6e0e222c9191 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:51.998189 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-d5c21226-2de2-4a59-9fff-92f6f2a96d0b tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:11:52.006092 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-d5c21226-2de2-4a59-9fff-92f6f2a96d0b tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:11:52.007416 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-d5c21226-2de2-4a59-9fff-92f6f2a96d0b tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:11:52.008128 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-d5c21226-2de2-4a59-9fff-92f6f2a96d0b tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:11:52.008962 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-d5c21226-2de2-4a59-9fff-92f6f2a96d0b tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:11:52.032719 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d5c21226-2de2-4a59-9fff-92f6f2a96d0b tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:52.033320 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d5c21226-2de2-4a59-9fff-92f6f2a96d0b tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:52.033865 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d5c21226-2de2-4a59-9fff-92f6f2a96d0b tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:52.034766 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d5c21226-2de2-4a59-9fff-92f6f2a96d0b tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:52.035364 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d5c21226-2de2-4a59-9fff-92f6f2a96d0b tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:52.036173 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d5c21226-2de2-4a59-9fff-92f6f2a96d0b tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:52.059947 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-d5c21226-2de2-4a59-9fff-92f6f2a96d0b tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Getting quotas for project e6bf637f9ea9423cb3e4e2c74d0382a7. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:11:52.064350 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-d5c21226-2de2-4a59-9fff-92f6f2a96d0b tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Getting quotas for user 275cdb98ca7a48f68441d6c934740df0 and project e6bf637f9ea9423cb3e4e2c74d0382a7. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:11:52.073559 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0856159f-65fb-49f5-8234-6e0e222c9191 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:52.078706 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d5c21226-2de2-4a59-9fff-92f6f2a96d0b tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:11:52.086110 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d5c21226-2de2-4a59-9fff-92f6f2a96d0b tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f277484-b3ae-465e-90b7-8febafef9329] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:11:52.087409 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0856159f-65fb-49f5-8234-6e0e222c9191 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:52.089475 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0856159f-65fb-49f5-8234-6e0e222c9191 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:52.095771 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0856159f-65fb-49f5-8234-6e0e222c9191 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1537 microversion: 2.91 time: 0.134979 Oct 23 01:11:52.096549 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 236/413] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:11:51 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1537 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:11:52.102712 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0d09022f-81cb-4dde-b023-42b3d36e27c5 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Action: 'action', calling method: .version_select at 0x7f5cc3c8dc10>, body: {"removeFloatingIp": {"address": "172.35.6.168"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:52.223743 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d5c21226-2de2-4a59-9fff-92f6f2a96d0b tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.903095 Oct 23 01:11:52.224922 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 178/414] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:11:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 905 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:11:52.367756 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0d09022f-81cb-4dde-b023-42b3d36e27c5 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] [instance: 9bb5ab44-057e-4115-a477-602ef6feece3] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:52.376513 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d09022f-81cb-4dde-b023-42b3d36e27c5 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:52.377406 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d09022f-81cb-4dde-b023-42b3d36e27c5 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:52.378120 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d09022f-81cb-4dde-b023-42b3d36e27c5 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:52.379009 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d09022f-81cb-4dde-b023-42b3d36e27c5 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:52.379630 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d09022f-81cb-4dde-b023-42b3d36e27c5 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:52.380320 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d09022f-81cb-4dde-b023-42b3d36e27c5 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:52.521826 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0ca4a7f8-9b51-4842-8349-152adad05adc tempest-DeleteServersAdminTestJSON-411260349 tempest-DeleteServersAdminTestJSON-411260349-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:52.522365 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0ca4a7f8-9b51-4842-8349-152adad05adc tempest-DeleteServersAdminTestJSON-411260349 tempest-DeleteServersAdminTestJSON-411260349-project-admin] [instance: 56fab46b-b733-4279-8e6b-dd6b11013fb2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:52.528724 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0ca4a7f8-9b51-4842-8349-152adad05adc tempest-DeleteServersAdminTestJSON-411260349 tempest-DeleteServersAdminTestJSON-411260349-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:52.529213 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0ca4a7f8-9b51-4842-8349-152adad05adc tempest-DeleteServersAdminTestJSON-411260349 tempest-DeleteServersAdminTestJSON-411260349-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:52.529863 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0ca4a7f8-9b51-4842-8349-152adad05adc tempest-DeleteServersAdminTestJSON-411260349 tempest-DeleteServersAdminTestJSON-411260349-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:52.530843 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0ca4a7f8-9b51-4842-8349-152adad05adc tempest-DeleteServersAdminTestJSON-411260349 tempest-DeleteServersAdminTestJSON-411260349-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:52.540199 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0ca4a7f8-9b51-4842-8349-152adad05adc tempest-DeleteServersAdminTestJSON-411260349 tempest-DeleteServersAdminTestJSON-411260349-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:52.540199 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0ca4a7f8-9b51-4842-8349-152adad05adc tempest-DeleteServersAdminTestJSON-411260349 tempest-DeleteServersAdminTestJSON-411260349-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:52.602940 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0ca4a7f8-9b51-4842-8349-152adad05adc tempest-DeleteServersAdminTestJSON-411260349 tempest-DeleteServersAdminTestJSON-411260349-project-admin] [instance: 56fab46b-b733-4279-8e6b-dd6b11013fb2] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:11:52.955475 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0ca4a7f8-9b51-4842-8349-152adad05adc tempest-DeleteServersAdminTestJSON-411260349 tempest-DeleteServersAdminTestJSON-411260349-project-admin] 10.222.0.42 "DELETE /compute/v2.1/servers/56fab46b-b733-4279-8e6b-dd6b11013fb2" status: 204 len: 0 microversion: 2.1 time: 0.729113 Oct 23 01:11:52.956206 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 179/415] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:11:52 2022] DELETE /compute/v2.1/servers/56fab46b-b733-4279-8e6b-dd6b11013fb2 => generated 0 bytes in 730 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:11:52.961838 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a5d31a0a-9121-4826-9657-88c7b041992e tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:52.962714 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a5d31a0a-9121-4826-9657-88c7b041992e tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 26043446-8442-4d38-98d8-6ff9a1432d1b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:52.969351 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5d31a0a-9121-4826-9657-88c7b041992e tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:52.969839 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5d31a0a-9121-4826-9657-88c7b041992e tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:52.970303 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5d31a0a-9121-4826-9657-88c7b041992e tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:52.970994 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5d31a0a-9121-4826-9657-88c7b041992e tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:52.971445 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5d31a0a-9121-4826-9657-88c7b041992e tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:52.971865 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5d31a0a-9121-4826-9657-88c7b041992e tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:53.099451 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d09022f-81cb-4dde-b023-42b3d36e27c5 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Acquiring lock "refresh_cache-9bb5ab44-057e-4115-a477-602ef6feece3" {{(pid=120945) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 23 01:11:53.099952 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d09022f-81cb-4dde-b023-42b3d36e27c5 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Acquired lock "refresh_cache-9bb5ab44-057e-4115-a477-602ef6feece3" {{(pid=120945) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 23 01:11:53.232911 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a5d31a0a-9121-4826-9657-88c7b041992e tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:53.247036 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a5d31a0a-9121-4826-9657-88c7b041992e tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b" status: 200 len: 1504 microversion: 2.1 time: 0.289487 Oct 23 01:11:53.248711 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 180/416] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:52 2022] GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b => generated 1504 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:53.255159 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-14ff3f8c-a235-43bc-b099-6908da596421 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-446920945", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:53.277267 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:53.328295 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-14ff3f8c-a235-43bc-b099-6908da596421 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] validate_networks() for None {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:11:53.784022 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-14ff3f8c-a235-43bc-b099-6908da596421 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:11:53.786601 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-14ff3f8c-a235-43bc-b099-6908da596421 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:11:53.787633 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-14ff3f8c-a235-43bc-b099-6908da596421 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:11:53.788125 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-14ff3f8c-a235-43bc-b099-6908da596421 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:11:53.788893 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-14ff3f8c-a235-43bc-b099-6908da596421 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:11:53.802400 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-14ff3f8c-a235-43bc-b099-6908da596421 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:53.803157 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-14ff3f8c-a235-43bc-b099-6908da596421 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:53.803798 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-14ff3f8c-a235-43bc-b099-6908da596421 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:53.804880 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-14ff3f8c-a235-43bc-b099-6908da596421 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:53.805468 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-14ff3f8c-a235-43bc-b099-6908da596421 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:53.806131 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-14ff3f8c-a235-43bc-b099-6908da596421 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:53.827816 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-14ff3f8c-a235-43bc-b099-6908da596421 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Getting quotas for project e6bf637f9ea9423cb3e4e2c74d0382a7. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:11:53.832623 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-14ff3f8c-a235-43bc-b099-6908da596421 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Getting quotas for user 275cdb98ca7a48f68441d6c934740df0 and project e6bf637f9ea9423cb3e4e2c74d0382a7. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:11:53.846645 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-14ff3f8c-a235-43bc-b099-6908da596421 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:11:53.848962 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-14ff3f8c-a235-43bc-b099-6908da596421 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 46694c40-e6a6-48c1-a105-390bd0133d62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:11:53.999743 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-14ff3f8c-a235-43bc-b099-6908da596421 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.749227 Oct 23 01:11:54.003265 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 181/417] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:11:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:11:54.007295 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3199d506-8305-4467-b43f-23aa3bc4e7f7 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:54.007928 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3199d506-8305-4467-b43f-23aa3bc4e7f7 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] [instance: 56fab46b-b733-4279-8e6b-dd6b11013fb2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:54.019955 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3199d506-8305-4467-b43f-23aa3bc4e7f7 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:54.020568 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3199d506-8305-4467-b43f-23aa3bc4e7f7 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:54.021092 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3199d506-8305-4467-b43f-23aa3bc4e7f7 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:54.022096 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3199d506-8305-4467-b43f-23aa3bc4e7f7 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:54.022680 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3199d506-8305-4467-b43f-23aa3bc4e7f7 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:54.023208 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3199d506-8305-4467-b43f-23aa3bc4e7f7 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:54.186967 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-0d09022f-81cb-4dde-b023-42b3d36e27c5 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] [instance: 9bb5ab44-057e-4115-a477-602ef6feece3] Building network info cache for instance {{(pid=120945) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 23 01:11:54.342160 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3199d506-8305-4467-b43f-23aa3bc4e7f7 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76739eabf8804ec2af41abc4c1e6fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f22fb0ca7346c4ab225ce82d69118c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:54.350040 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3199d506-8305-4467-b43f-23aa3bc4e7f7 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] 10.222.0.42 "GET /compute/v2.1/servers/56fab46b-b733-4279-8e6b-dd6b11013fb2" status: 200 len: 1473 microversion: 2.1 time: 0.346464 Oct 23 01:11:54.350627 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 182/418] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:54 2022] GET /compute/v2.1/servers/56fab46b-b733-4279-8e6b-dd6b11013fb2 => generated 1473 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:54.364949 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cdb4eed9-0bb6-4fa9-a5d7-d7d3bb7c8539 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:54.365874 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-cdb4eed9-0bb6-4fa9-a5d7-d7d3bb7c8539 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:54.373761 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cdb4eed9-0bb6-4fa9-a5d7-d7d3bb7c8539 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:54.383672 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cdb4eed9-0bb6-4fa9-a5d7-d7d3bb7c8539 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:54.383672 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cdb4eed9-0bb6-4fa9-a5d7-d7d3bb7c8539 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:54.383672 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cdb4eed9-0bb6-4fa9-a5d7-d7d3bb7c8539 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:54.383672 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cdb4eed9-0bb6-4fa9-a5d7-d7d3bb7c8539 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:54.384065 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cdb4eed9-0bb6-4fa9-a5d7-d7d3bb7c8539 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:54.486117 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cdb4eed9-0bb6-4fa9-a5d7-d7d3bb7c8539 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:54.522821 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cdb4eed9-0bb6-4fa9-a5d7-d7d3bb7c8539 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:54.530670 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cdb4eed9-0bb6-4fa9-a5d7-d7d3bb7c8539 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:54.551285 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cdb4eed9-0bb6-4fa9-a5d7-d7d3bb7c8539 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1537 microversion: 2.91 time: 0.191566 Oct 23 01:11:54.555034 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 183/419] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:11:54 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1537 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:11:54.571679 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e2f25cfc-09e5-42d9-8473-264d60315ce9 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:54.572559 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e2f25cfc-09e5-42d9-8473-264d60315ce9 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 46694c40-e6a6-48c1-a105-390bd0133d62] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:54.721346 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e2f25cfc-09e5-42d9-8473-264d60315ce9 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:54.738355 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e2f25cfc-09e5-42d9-8473-264d60315ce9 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/46694c40-e6a6-48c1-a105-390bd0133d62" status: 200 len: 1213 microversion: 2.1 time: 0.182156 Oct 23 01:11:54.742195 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 184/420] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:54 2022] GET /compute/v2.1/servers/46694c40-e6a6-48c1-a105-390bd0133d62 => generated 1213 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:54.743943 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-b53e2316-7ed1-4530-9f8c-d3100bf6839d req-1292f952-caab-4be5-baba-5c755040fb2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bb5ab44-057e-4115-a477-602ef6feece3", "tag": "f52b7234-1d59-4c35-8b9d-e94552c618c2"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:54.771901 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-b53e2316-7ed1-4530-9f8c-d3100bf6839d req-1292f952-caab-4be5-baba-5c755040fb2d service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:54.772909 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-b53e2316-7ed1-4530-9f8c-d3100bf6839d req-1292f952-caab-4be5-baba-5c755040fb2d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:54.776210 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-b53e2316-7ed1-4530-9f8c-d3100bf6839d req-1292f952-caab-4be5-baba-5c755040fb2d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:54.813490 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-b53e2316-7ed1-4530-9f8c-d3100bf6839d req-1292f952-caab-4be5-baba-5c755040fb2d service nova] Creating event network-changed:f52b7234-1d59-4c35-8b9d-e94552c618c2 for instance 9bb5ab44-057e-4115-a477-602ef6feece3 on n-h2-master-1 Oct 23 01:11:54.828135 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-b53e2316-7ed1-4530-9f8c-d3100bf6839d req-1292f952-caab-4be5-baba-5c755040fb2d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086245 Oct 23 01:11:54.828135 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 185/421] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:54.839217 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-68b148ee-e60e-40bd-a702-46f09203abf8 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:54.841216 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-68b148ee-e60e-40bd-a702-46f09203abf8 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 26043446-8442-4d38-98d8-6ff9a1432d1b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:54.847727 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68b148ee-e60e-40bd-a702-46f09203abf8 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:54.848318 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68b148ee-e60e-40bd-a702-46f09203abf8 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:54.848824 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68b148ee-e60e-40bd-a702-46f09203abf8 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:54.849607 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68b148ee-e60e-40bd-a702-46f09203abf8 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:54.851065 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68b148ee-e60e-40bd-a702-46f09203abf8 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:54.851065 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68b148ee-e60e-40bd-a702-46f09203abf8 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:55.260572 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-68b148ee-e60e-40bd-a702-46f09203abf8 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:55.273130 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-68b148ee-e60e-40bd-a702-46f09203abf8 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b" status: 200 len: 1504 microversion: 2.1 time: 0.442057 Oct 23 01:11:55.279934 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 186/422] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:54 2022] GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b => generated 1504 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:55.375434 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-aab58255-372a-4f8d-aecc-31412459a26a tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:55.376377 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-aab58255-372a-4f8d-aecc-31412459a26a tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] [instance: 56fab46b-b733-4279-8e6b-dd6b11013fb2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:55.388370 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aab58255-372a-4f8d-aecc-31412459a26a tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:55.388804 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aab58255-372a-4f8d-aecc-31412459a26a tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:55.402349 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aab58255-372a-4f8d-aecc-31412459a26a tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:55.403782 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aab58255-372a-4f8d-aecc-31412459a26a tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:55.405391 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aab58255-372a-4f8d-aecc-31412459a26a tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:55.407897 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aab58255-372a-4f8d-aecc-31412459a26a tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:55.897339 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-0d09022f-81cb-4dde-b023-42b3d36e27c5 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] [instance: 9bb5ab44-057e-4115-a477-602ef6feece3] Updating instance_info_cache with network_info: [{"id": "f52b7234-1d59-4c35-8b9d-e94552c618c2", "address": "fa:16:3e:a5:56:41", "network": {"id": "8713ad73-3551-4e4e-a4b5-06c9d1b5b4bf", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1343545346-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b7864a40d26e402d815d39ef0c0f91a1", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf52b7234-1d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120945) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 23 01:11:55.923122 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-aab58255-372a-4f8d-aecc-31412459a26a tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76739eabf8804ec2af41abc4c1e6fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f22fb0ca7346c4ab225ce82d69118c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:55.938799 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-aab58255-372a-4f8d-aecc-31412459a26a tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] 10.222.0.42 "GET /compute/v2.1/servers/56fab46b-b733-4279-8e6b-dd6b11013fb2" status: 200 len: 1473 microversion: 2.1 time: 0.569943 Oct 23 01:11:55.954444 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 187/423] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:55 2022] GET /compute/v2.1/servers/56fab46b-b733-4279-8e6b-dd6b11013fb2 => generated 1473 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:11:55.958779 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5e6ae259-75cd-4c55-a3b7-bc0c4a7374d8 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:55.960678 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5e6ae259-75cd-4c55-a3b7-bc0c4a7374d8 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:55.970098 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5e6ae259-75cd-4c55-a3b7-bc0c4a7374d8 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:55.970617 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5e6ae259-75cd-4c55-a3b7-bc0c4a7374d8 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:55.971218 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5e6ae259-75cd-4c55-a3b7-bc0c4a7374d8 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:55.972013 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5e6ae259-75cd-4c55-a3b7-bc0c4a7374d8 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:55.972481 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5e6ae259-75cd-4c55-a3b7-bc0c4a7374d8 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:55.972917 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5e6ae259-75cd-4c55-a3b7-bc0c4a7374d8 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:56.014282 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d09022f-81cb-4dde-b023-42b3d36e27c5 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Releasing lock "refresh_cache-9bb5ab44-057e-4115-a477-602ef6feece3" {{(pid=120945) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 23 01:11:56.015177 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0d09022f-81cb-4dde-b023-42b3d36e27c5 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] 10.222.0.42 "POST /compute/v2.1/servers/9bb5ab44-057e-4115-a477-602ef6feece3/action" status: 202 len: 0 microversion: 2.1 time: 3.916911 Oct 23 01:11:56.019678 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 237/424] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:11:52 2022] POST /compute/v2.1/servers/9bb5ab44-057e-4115-a477-602ef6feece3/action => generated 0 bytes in 3922 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 23 01:11:56.024782 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3eea401a-69dd-41a7-877d-e6f4c2dac056 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:56.025707 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3eea401a-69dd-41a7-877d-e6f4c2dac056 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 46694c40-e6a6-48c1-a105-390bd0133d62] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:56.041276 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3eea401a-69dd-41a7-877d-e6f4c2dac056 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:56.042088 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3eea401a-69dd-41a7-877d-e6f4c2dac056 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:56.042533 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3eea401a-69dd-41a7-877d-e6f4c2dac056 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:56.043838 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3eea401a-69dd-41a7-877d-e6f4c2dac056 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:56.044505 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3eea401a-69dd-41a7-877d-e6f4c2dac056 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:56.044937 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3eea401a-69dd-41a7-877d-e6f4c2dac056 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:56.391524 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5e6ae259-75cd-4c55-a3b7-bc0c4a7374d8 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:56.403098 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5e6ae259-75cd-4c55-a3b7-bc0c4a7374d8 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:56.415880 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5e6ae259-75cd-4c55-a3b7-bc0c4a7374d8 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:56.421613 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5e6ae259-75cd-4c55-a3b7-bc0c4a7374d8 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1537 microversion: 2.91 time: 0.480599 Oct 23 01:11:56.438426 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3eea401a-69dd-41a7-877d-e6f4c2dac056 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:56.440066 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 188/425] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:11:55 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1537 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:11:56.449671 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bd553f28-6e8a-4612-9162-4707ec218e73 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Calling method '.version_select at 0x7f5cc2466a60>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:56.450789 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3eea401a-69dd-41a7-877d-e6f4c2dac056 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/46694c40-e6a6-48c1-a105-390bd0133d62" status: 200 len: 1217 microversion: 2.1 time: 0.429968 Oct 23 01:11:56.456126 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 238/426] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:56 2022] GET /compute/v2.1/servers/46694c40-e6a6-48c1-a105-390bd0133d62 => generated 1217 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:56.804590 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c7b092f8-9147-4eb9-ae17-20384e5730d5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1318425233", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:56.883262 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-c7b092f8-9147-4eb9-ae17-20384e5730d5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] validate_networks() for None {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:11:57.350903 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-c7b092f8-9147-4eb9-ae17-20384e5730d5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:11:57.351499 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-c7b092f8-9147-4eb9-ae17-20384e5730d5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:11:57.351770 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-c7b092f8-9147-4eb9-ae17-20384e5730d5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:11:57.352202 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-c7b092f8-9147-4eb9-ae17-20384e5730d5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:11:57.352755 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-c7b092f8-9147-4eb9-ae17-20384e5730d5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:11:57.362081 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c7b092f8-9147-4eb9-ae17-20384e5730d5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:57.362964 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c7b092f8-9147-4eb9-ae17-20384e5730d5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:57.363596 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c7b092f8-9147-4eb9-ae17-20384e5730d5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:57.369311 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c7b092f8-9147-4eb9-ae17-20384e5730d5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:57.378678 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c7b092f8-9147-4eb9-ae17-20384e5730d5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:57.379129 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c7b092f8-9147-4eb9-ae17-20384e5730d5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:57.401875 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-c7b092f8-9147-4eb9-ae17-20384e5730d5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Getting quotas for project eb058785345d4e58a5820445efe09bee. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:11:57.406728 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-c7b092f8-9147-4eb9-ae17-20384e5730d5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Getting quotas for user 547aed83a7e44becb9c89dc6bae62255 and project eb058785345d4e58a5820445efe09bee. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:11:57.419582 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c7b092f8-9147-4eb9-ae17-20384e5730d5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:11:57.422242 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c7b092f8-9147-4eb9-ae17-20384e5730d5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:11:57.559933 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c7b092f8-9147-4eb9-ae17-20384e5730d5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.106753 Oct 23 01:11:57.561218 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 239/427] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:11:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1109 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:11:57.572280 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-87118f92-dc89-4f04-abff-b90d62f4f188 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:57.573256 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-87118f92-dc89-4f04-abff-b90d62f4f188 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 26043446-8442-4d38-98d8-6ff9a1432d1b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:57.588257 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-87118f92-dc89-4f04-abff-b90d62f4f188 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:57.588786 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-87118f92-dc89-4f04-abff-b90d62f4f188 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:57.589315 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-87118f92-dc89-4f04-abff-b90d62f4f188 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:57.590102 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-87118f92-dc89-4f04-abff-b90d62f4f188 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:57.594580 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-87118f92-dc89-4f04-abff-b90d62f4f188 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:57.594580 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-87118f92-dc89-4f04-abff-b90d62f4f188 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:57.995540 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-87118f92-dc89-4f04-abff-b90d62f4f188 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:58.005438 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-87118f92-dc89-4f04-abff-b90d62f4f188 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b" status: 200 len: 1494 microversion: 2.1 time: 0.442872 Oct 23 01:11:58.026178 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 240/428] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:57 2022] GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b => generated 1494 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:58.033209 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-06e11308-ad20-4ee0-9962-621538a20d7e req-f2f70cb3-c20d-4551-b1a9-6d801994c367 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56fab46b-b733-4279-8e6b-dd6b11013fb2", "name": "network-vif-deleted", "tag": "cae2b753-bc1e-4126-9fef-5c92c0eac33d"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:58.046495 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-06e11308-ad20-4ee0-9962-621538a20d7e req-f2f70cb3-c20d-4551-b1a9-6d801994c367 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:58.047556 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-06e11308-ad20-4ee0-9962-621538a20d7e req-f2f70cb3-c20d-4551-b1a9-6d801994c367 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:58.048129 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-06e11308-ad20-4ee0-9962-621538a20d7e req-f2f70cb3-c20d-4551-b1a9-6d801994c367 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:58.061864 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-06e11308-ad20-4ee0-9962-621538a20d7e req-f2f70cb3-c20d-4551-b1a9-6d801994c367 service nova] Creating event network-vif-deleted:cae2b753-bc1e-4126-9fef-5c92c0eac33d for instance 56fab46b-b733-4279-8e6b-dd6b11013fb2 on n-h1-master-1 Oct 23 01:11:58.067136 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-06e11308-ad20-4ee0-9962-621538a20d7e req-f2f70cb3-c20d-4551-b1a9-6d801994c367 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039572 Oct 23 01:11:58.069865 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 241/429] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:58.073605 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f7761d8b-902c-4c5e-af11-25fb0e6c54dc tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:58.075211 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f7761d8b-902c-4c5e-af11-25fb0e6c54dc tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] [instance: 56fab46b-b733-4279-8e6b-dd6b11013fb2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:58.083419 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f7761d8b-902c-4c5e-af11-25fb0e6c54dc tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:58.084353 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f7761d8b-902c-4c5e-af11-25fb0e6c54dc tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:58.084988 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f7761d8b-902c-4c5e-af11-25fb0e6c54dc tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:58.085919 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f7761d8b-902c-4c5e-af11-25fb0e6c54dc tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:58.086581 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f7761d8b-902c-4c5e-af11-25fb0e6c54dc tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:58.093213 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f7761d8b-902c-4c5e-af11-25fb0e6c54dc tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:58.125698 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f7761d8b-902c-4c5e-af11-25fb0e6c54dc tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:58.126308 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f7761d8b-902c-4c5e-af11-25fb0e6c54dc tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:58.126676 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f7761d8b-902c-4c5e-af11-25fb0e6c54dc tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:58.127170 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-f7761d8b-902c-4c5e-af11-25fb0e6c54dc tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lazy-loading 'fault' on Instance uuid 56fab46b-b733-4279-8e6b-dd6b11013fb2 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:11:58.186994 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bd553f28-6e8a-4612-9162-4707ec218e73 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] 10.222.0.42 "DELETE /compute/v2.1/os-floating-ips/b039fa4e-9db1-4227-8fac-dde5c0bcb84c" status: 202 len: 0 microversion: 2.1 time: 1.746198 Oct 23 01:11:58.188208 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 189/430] 10.222.0.42 () {58 vars in 1263 bytes} [Sun Oct 23 01:11:56 2022] DELETE /compute/v2.1/os-floating-ips/b039fa4e-9db1-4227-8fac-dde5c0bcb84c => generated 0 bytes in 1748 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:11:58.214908 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f7761d8b-902c-4c5e-af11-25fb0e6c54dc tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76739eabf8804ec2af41abc4c1e6fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f22fb0ca7346c4ab225ce82d69118c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:58.227702 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f7761d8b-902c-4c5e-af11-25fb0e6c54dc tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] 10.222.0.42 "GET /compute/v2.1/servers/56fab46b-b733-4279-8e6b-dd6b11013fb2" status: 200 len: 1308 microversion: 2.1 time: 0.156808 Oct 23 01:11:58.228353 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 242/431] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:58 2022] GET /compute/v2.1/servers/56fab46b-b733-4279-8e6b-dd6b11013fb2 => generated 1308 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:58.251627 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c81ad44c-a9e1-46c1-8d20-bd128dcbcaed tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:58.253776 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c81ad44c-a9e1-46c1-8d20-bd128dcbcaed tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:58.260256 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c81ad44c-a9e1-46c1-8d20-bd128dcbcaed tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:58.260746 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c81ad44c-a9e1-46c1-8d20-bd128dcbcaed tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:58.261181 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c81ad44c-a9e1-46c1-8d20-bd128dcbcaed tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:58.262489 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c81ad44c-a9e1-46c1-8d20-bd128dcbcaed tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:58.262941 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c81ad44c-a9e1-46c1-8d20-bd128dcbcaed tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:58.263359 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c81ad44c-a9e1-46c1-8d20-bd128dcbcaed tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:58.366483 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c81ad44c-a9e1-46c1-8d20-bd128dcbcaed tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:58.375780 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c81ad44c-a9e1-46c1-8d20-bd128dcbcaed tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:58.377273 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c81ad44c-a9e1-46c1-8d20-bd128dcbcaed tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:58.382328 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c81ad44c-a9e1-46c1-8d20-bd128dcbcaed tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1537 microversion: 2.91 time: 0.138027 Oct 23 01:11:58.383223 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 243/432] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:11:58 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1537 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:11:58.409435 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b0f9a2b5-cc8e-4c33-9003-f4502df96223 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:58.410084 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b0f9a2b5-cc8e-4c33-9003-f4502df96223 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 46694c40-e6a6-48c1-a105-390bd0133d62] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:58.416142 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b0f9a2b5-cc8e-4c33-9003-f4502df96223 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:58.416925 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b0f9a2b5-cc8e-4c33-9003-f4502df96223 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:58.417365 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b0f9a2b5-cc8e-4c33-9003-f4502df96223 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:58.418307 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b0f9a2b5-cc8e-4c33-9003-f4502df96223 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:58.419094 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b0f9a2b5-cc8e-4c33-9003-f4502df96223 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:58.419664 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b0f9a2b5-cc8e-4c33-9003-f4502df96223 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:58.419781 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e4d9ff47-c8db-4b76-962a-f1d68d605219 tempest-InstanceUsageAuditLogNegativeTestJSON-1116130435 tempest-InstanceUsageAuditLogNegativeTestJSON-1116130435-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:58.426040 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-e4d9ff47-c8db-4b76-962a-f1d68d605219 tempest-InstanceUsageAuditLogNegativeTestJSON-1116130435 tempest-InstanceUsageAuditLogNegativeTestJSON-1116130435-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 23 01:11:58.437257 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e4d9ff47-c8db-4b76-962a-f1d68d605219 tempest-InstanceUsageAuditLogNegativeTestJSON-1116130435 tempest-InstanceUsageAuditLogNegativeTestJSON-1116130435-project-admin] Request method failure captured: Oct 23 01:11:58.437257 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 23 01:11:58.437257 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:11:58.437257 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:11:58.437257 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:11:58.437257 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:11:58.437257 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:11:58.437257 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:11:58.437257 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:11:58.437257 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:11:58.437257 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJTddArfydEjjKv-joznmOLUyc1IW-lGGwSfgG9UXTBs5xXMLsXKKftozBwPtSgcG03g2StB5TJlIXfjDEPuGNLFz5XzNurIwwndHkaTePx_xz1JAdAmywqTG0AoMKrRfO8bGsdQw5fUqoWwX0spvwc_gqjtXyXXd0PAcoogj1hYt5k Oct 23 01:11:58.437257 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:11:58.437257 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:11:58.437257 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:11:58.437257 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:11:58.437257 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:11:58.437257 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:11:58.437257 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: c8e27bec0ea44871a1c86a185ed7f47c Oct 23 01:11:58.437257 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1116130435 Oct 23 01:11:58.437257 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,admin,reader Oct 23 01:11:58.437257 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,admin,reader Oct 23 01:11:58.438629 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c8e27bec0ea44871a1c86a185ed7f47c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c8e27bec0ea44871a1c86a185ed7f47c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c8e27bec0ea44871a1c86a185ed7f47c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c8e27bec0ea44871a1c86a185ed7f47c"}]}] Oct 23 01:11:58.438629 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1116130435 Oct 23 01:11:58.438629 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: c8e27bec0ea44871a1c86a185ed7f47c Oct 23 01:11:58.438629 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1116130435 Oct 23 01:11:58.438629 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1116130435-project-admin Oct 23 01:11:58.438629 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:11:58.438629 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:11:58.438629 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: cf75a43b594f43a7b38760992401c266 Oct 23 01:11:58.438629 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1116130435-project-admin Oct 23 01:11:58.438629 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:11:58.438629 n-d-master-1 devstack@n-api.service[120944]: exception: Invalid timestamp for date invalid_time Oct 23 01:11:58.439253 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'invalid_time'} Oct 23 01:11:58.439253 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:11:58.439253 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:58.439253 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 23 01:11:58.439253 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 23 01:11:58.439253 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 23 01:11:58.439253 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 23 01:11:58.439253 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 23 01:11:58.439253 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 23 01:11:58.439253 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 23 01:11:58.439253 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:58.439253 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:11:58.439253 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:58.439253 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:58.439253 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:58.439253 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:58.439253 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:11:58.439253 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:11:58.439253 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:11:58.439253 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:11:58.440294 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 23 01:11:58.440294 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 23 01:11:58.440294 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 23 01:11:58.440294 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:58.440294 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:11:58.440294 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:58.440294 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:58.440294 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:58.440294 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:58.440294 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:11:58.440294 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:11:58.440294 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 23 01:11:58.440294 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:58.440294 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e4d9ff47-c8db-4b76-962a-f1d68d605219 tempest-InstanceUsageAuditLogNegativeTestJSON-1116130435 tempest-InstanceUsageAuditLogNegativeTestJSON-1116130435-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:11:58.441111 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e4d9ff47-c8db-4b76-962a-f1d68d605219 tempest-InstanceUsageAuditLogNegativeTestJSON-1116130435 tempest-InstanceUsageAuditLogNegativeTestJSON-1116130435-project-admin] 10.222.0.42 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.251068 Oct 23 01:11:58.441654 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 190/433] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:11:58 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 253 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 23 01:11:58.448450 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4ea8a10d-7eff-4785-9294-467a0e5cbd07 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:58.450193 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4ea8a10d-7eff-4785-9294-467a0e5cbd07 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:58.526049 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b0f9a2b5-cc8e-4c33-9003-f4502df96223 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:58.534126 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b0f9a2b5-cc8e-4c33-9003-f4502df96223 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/46694c40-e6a6-48c1-a105-390bd0133d62" status: 200 len: 1271 microversion: 2.1 time: 0.134514 Oct 23 01:11:58.540047 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 244/434] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:58 2022] GET /compute/v2.1/servers/46694c40-e6a6-48c1-a105-390bd0133d62 => generated 1271 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:58.540047 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b57cb392-51e8-49d8-88cc-30f180bd43e7 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Calling method '.version_select at 0x7f5cc258e940>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:58.543436 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b57cb392-51e8-49d8-88cc-30f180bd43e7 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:58.543436 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b57cb392-51e8-49d8-88cc-30f180bd43e7 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:58.543436 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b57cb392-51e8-49d8-88cc-30f180bd43e7 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:58.550556 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4ea8a10d-7eff-4785-9294-467a0e5cbd07 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:58.557487 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b57cb392-51e8-49d8-88cc-30f180bd43e7 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] 10.222.0.42 "GET /compute/v2.1/os-migrations" status: 200 len: 398 microversion: 2.1 time: 0.021789 Oct 23 01:11:58.557744 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4ea8a10d-7eff-4785-9294-467a0e5cbd07 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2" status: 200 len: 1213 microversion: 2.1 time: 0.115035 Oct 23 01:11:58.558151 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 245/435] 10.222.0.42 () {58 vars in 1143 bytes} [Sun Oct 23 01:11:58 2022] GET /compute/v2.1/os-migrations => generated 398 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:58.558474 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 191/436] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:58 2022] GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2 => generated 1213 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:58.575215 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dc988c78-38b6-4ce8-a4ca-7d5567e28531 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:58.580165 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dc988c78-38b6-4ce8-a4ca-7d5567e28531 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Request method failure captured: Oct 23 01:11:58.580165 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/servers/9bb5ab44-057e-4115-a477-602ef6feece3/action HTTP/1.1 Oct 23 01:11:58.580165 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:11:58.580165 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:11:58.580165 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:11:58.580165 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 34 Oct 23 01:11:58.580165 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:11:58.580165 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:11:58.580165 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:11:58.580165 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:11:58.580165 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJS1fYy_rmFnFNEcRI54qAmDFzEjFZqRJFQPCRzXdt_XqD7y1fGbU90inPCCyf9eKyuyhSmw7i3KZCr9D1o8YeH3GgiieXpGJFerc_ocxwN3z6lo2EGuwtdEvpzujbeALsLwwt5MSJ2MyK8Ek9E6JDByuL9D9VdDEDVWzrVO-MwxCdg Oct 23 01:11:58.580165 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:11:58.580165 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:11:58.580165 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:11:58.580165 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:11:58.580165 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:11:58.580165 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:11:58.580165 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: b7864a40d26e402d815d39ef0c0f91a1 Oct 23 01:11:58.580165 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-434430825 Oct 23 01:11:58.580165 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:11:58.580165 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:11:58.581729 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b7864a40d26e402d815d39ef0c0f91a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b7864a40d26e402d815d39ef0c0f91a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b7864a40d26e402d815d39ef0c0f91a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b7864a40d26e402d815d39ef0c0f91a1"}]}] Oct 23 01:11:58.581729 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-434430825 Oct 23 01:11:58.581729 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: b7864a40d26e402d815d39ef0c0f91a1 Oct 23 01:11:58.581729 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-434430825 Oct 23 01:11:58.581729 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project Oct 23 01:11:58.581729 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:11:58.581729 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:11:58.581729 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 74c84b03f3f8431e9d3c0cbb792aeaf9 Oct 23 01:11:58.581729 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project Oct 23 01:11:58.581729 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:11:58.581729 n-d-master-1 devstack@n-api.service[120944]: {"addFloatingIp": {"address": ""}} Oct 23 01:11:58.581729 n-d-master-1 devstack@n-api.service[120944]: method: Oct 23 01:11:58.581729 n-d-master-1 devstack@n-api.service[120944]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 23 01:11:58.582628 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '9bb5ab44-057e-4115-a477-602ef6feece3', 'body': {'addFloatingIp': {'address': ''}}} Oct 23 01:11:58.582628 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:11:58.582628 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:58.582628 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 23 01:11:58.582628 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 23 01:11:58.582628 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 01:11:58.582628 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise error Oct 23 01:11:58.582628 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 23 01:11:58.582628 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:58.582628 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 23 01:11:58.582628 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 23 01:11:58.582628 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:58.582628 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 23 01:11:58.582628 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi '' Oct 23 01:11:58.582628 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:58.582628 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:11:58.582628 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:58.582628 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:58.582628 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:58.582628 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:58.582628 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:11:58.582628 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:11:58.584528 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:11:58.584528 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:11:58.584528 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:11:58.584528 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:11:58.584528 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 23 01:11:58.584528 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 23 01:11:58.584528 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 23 01:11:58.584528 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 23 01:11:58.584528 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 23 01:11:58.584528 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 23 01:11:58.584528 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 23 01:11:58.584528 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:58.584528 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:11:58.584528 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:58.584528 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:58.584528 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:58.584528 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:58.584528 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 23 01:11:58.584528 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 23 01:11:58.586955 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 23 01:11:58.586955 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:58.586955 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dc988c78-38b6-4ce8-a4ca-7d5567e28531 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:11:58.586955 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-dc988c78-38b6-4ce8-a4ca-7d5567e28531 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] 10.222.0.42 "POST /compute/v2.1/servers/9bb5ab44-057e-4115-a477-602ef6feece3/action" status: 400 len: 142 microversion: 2.1 time: 0.010706 Oct 23 01:11:58.586955 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 192/437] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:11:58 2022] POST /compute/v2.1/servers/9bb5ab44-057e-4115-a477-602ef6feece3/action => generated 142 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:11:58.588023 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9619d2c9-1fb0-4894-8817-01ee232c1b8c tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:58.588853 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9619d2c9-1fb0-4894-8817-01ee232c1b8c tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] [instance: 26043446-8442-4d38-98d8-6ff9a1432d1b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:58.596001 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9619d2c9-1fb0-4894-8817-01ee232c1b8c tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:58.596490 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9619d2c9-1fb0-4894-8817-01ee232c1b8c tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:58.596925 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9619d2c9-1fb0-4894-8817-01ee232c1b8c tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:58.597615 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9619d2c9-1fb0-4894-8817-01ee232c1b8c tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:58.598142 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9619d2c9-1fb0-4894-8817-01ee232c1b8c tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:58.598528 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9619d2c9-1fb0-4894-8817-01ee232c1b8c tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:58.706566 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9e81788d-728d-4f74-8d67-b4ade360e069 tempest-InstanceUsageAuditLogNegativeTestJSON-659961516 tempest-InstanceUsageAuditLogNegativeTestJSON-659961516-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:58.708422 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9e81788d-728d-4f74-8d67-b4ade360e069 tempest-InstanceUsageAuditLogNegativeTestJSON-659961516 tempest-InstanceUsageAuditLogNegativeTestJSON-659961516-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'a659d51e02d8443c942e3ff164eb9683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8cc5b7223b4cb3ba8c1763c44fa5b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:58.710337 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9e81788d-728d-4f74-8d67-b4ade360e069 tempest-InstanceUsageAuditLogNegativeTestJSON-659961516 tempest-InstanceUsageAuditLogNegativeTestJSON-659961516-project] Request method failure captured: Oct 23 01:11:58.710337 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 23 01:11:58.710337 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:11:58.710337 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:11:58.710337 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:11:58.710337 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:11:58.710337 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:11:58.710337 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:11:58.710337 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:11:58.710337 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:11:58.710337 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJTc4E7RyJXxbrm7wh4JH3j9liAyKGbi0EgL-ZzutRAN_iSMyjSxyxwQ_Z8cCKzaxnsDMRZBCH13tHl5N4hOmSal1UOEiuCfdp829aruJVmnyWxkH6BW94aMm58ggUble1ojD9QoGUSzB8QUukfYkIqk0CJDYtFa8CiUTMyJt2tu1O0 Oct 23 01:11:58.710337 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:11:58.710337 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:11:58.710337 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:11:58.710337 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:11:58.710337 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:11:58.710337 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:11:58.710337 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 9c8cc5b7223b4cb3ba8c1763c44fa5b0 Oct 23 01:11:58.710337 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-659961516 Oct 23 01:11:58.710337 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:11:58.710337 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:11:58.711682 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9c8cc5b7223b4cb3ba8c1763c44fa5b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9c8cc5b7223b4cb3ba8c1763c44fa5b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9c8cc5b7223b4cb3ba8c1763c44fa5b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9c8cc5b7223b4cb3ba8c1763c44fa5b0"}]}] Oct 23 01:11:58.711682 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-659961516 Oct 23 01:11:58.711682 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 9c8cc5b7223b4cb3ba8c1763c44fa5b0 Oct 23 01:11:58.711682 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-659961516 Oct 23 01:11:58.711682 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-659961516-project Oct 23 01:11:58.711682 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:11:58.711682 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:11:58.711682 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: a659d51e02d8443c942e3ff164eb9683 Oct 23 01:11:58.711682 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-659961516-project Oct 23 01:11:58.711682 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:11:58.712254 n-d-master-1 devstack@n-api.service[120945]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 23 01:11:58.712254 n-d-master-1 devstack@n-api.service[120945]: action_args: {} Oct 23 01:11:58.712254 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:11:58.712254 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:58.712254 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:58.712254 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:58.712254 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:11:58.712254 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:11:58.712254 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:11:58.712254 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:11:58.712254 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 23 01:11:58.712254 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 23 01:11:58.712254 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 23 01:11:58.712254 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 23 01:11:58.712254 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 23 01:11:58.712254 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 23 01:11:58.712254 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:11:58.712254 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 23 01:11:58.712254 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:11:58.712254 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise self.value Oct 23 01:11:58.715863 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 23 01:11:58.715863 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 23 01:11:58.715863 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 23 01:11:58.715863 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 23 01:11:58.715863 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 23 01:11:58.715863 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 23 01:11:58.715863 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 23 01:11:58.715863 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:58.715863 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:11:58.715863 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:58.715863 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:58.715863 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:58.715863 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:58.715863 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 23 01:11:58.715863 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 23 01:11:58.715863 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 23 01:11:58.715863 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:58.716890 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9e81788d-728d-4f74-8d67-b4ade360e069 tempest-InstanceUsageAuditLogNegativeTestJSON-659961516 tempest-InstanceUsageAuditLogNegativeTestJSON-659961516-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:11:58.716890 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9e81788d-728d-4f74-8d67-b4ade360e069 tempest-InstanceUsageAuditLogNegativeTestJSON-659961516 tempest-InstanceUsageAuditLogNegativeTestJSON-659961516-project] 10.222.0.42 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.148563 Oct 23 01:11:58.716890 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 246/438] 10.222.0.42 () {58 vars in 1185 bytes} [Sun Oct 23 01:11:58 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 154 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:11:58.721349 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9bbab36e-c7ac-4d08-a288-071266abddce tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:58.726500 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9bbab36e-c7ac-4d08-a288-071266abddce tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] [instance: 9bb5ab44-057e-4115-a477-602ef6feece3] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:58.749634 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9bbab36e-c7ac-4d08-a288-071266abddce tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:58.753625 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9bbab36e-c7ac-4d08-a288-071266abddce tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:58.753625 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9bbab36e-c7ac-4d08-a288-071266abddce tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:58.753625 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9bbab36e-c7ac-4d08-a288-071266abddce tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:58.754025 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9bbab36e-c7ac-4d08-a288-071266abddce tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:58.754025 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9bbab36e-c7ac-4d08-a288-071266abddce tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:58.782794 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9bbab36e-c7ac-4d08-a288-071266abddce tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Acquiring lock "refresh_cache-9bb5ab44-057e-4115-a477-602ef6feece3" {{(pid=120945) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 23 01:11:58.783424 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9bbab36e-c7ac-4d08-a288-071266abddce tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Acquired lock "refresh_cache-9bb5ab44-057e-4115-a477-602ef6feece3" {{(pid=120945) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 23 01:11:58.857934 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9619d2c9-1fb0-4894-8817-01ee232c1b8c tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b" status: 200 len: 1645 microversion: 2.1 time: 0.274343 Oct 23 01:11:58.858811 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 193/439] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:58 2022] GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b => generated 1645 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:11:58.863501 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-14bcb402-7766-475a-b112-f6e77aa15362 tempest-InstanceUsageAuditLogNegativeTestJSON-659961516 tempest-InstanceUsageAuditLogNegativeTestJSON-659961516-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:58.865421 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-14bcb402-7766-475a-b112-f6e77aa15362 tempest-InstanceUsageAuditLogNegativeTestJSON-659961516 tempest-InstanceUsageAuditLogNegativeTestJSON-659961516-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'a659d51e02d8443c942e3ff164eb9683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8cc5b7223b4cb3ba8c1763c44fa5b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:58.867184 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-14bcb402-7766-475a-b112-f6e77aa15362 tempest-InstanceUsageAuditLogNegativeTestJSON-659961516 tempest-InstanceUsageAuditLogNegativeTestJSON-659961516-project] Request method failure captured: Oct 23 01:11:58.867184 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-23%2001:11:58 HTTP/1.1 Oct 23 01:11:58.867184 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:11:58.867184 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:11:58.867184 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:11:58.867184 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:11:58.867184 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:11:58.867184 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:11:58.867184 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:11:58.867184 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:11:58.867184 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJTc4E7RyJXxbrm7wh4JH3j9liAyKGbi0EgL-ZzutRAN_iSMyjSxyxwQ_Z8cCKzaxnsDMRZBCH13tHl5N4hOmSal1UOEiuCfdp829aruJVmnyWxkH6BW94aMm58ggUble1ojD9QoGUSzB8QUukfYkIqk0CJDYtFa8CiUTMyJt2tu1O0 Oct 23 01:11:58.867184 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:11:58.867184 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:11:58.867184 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:11:58.867184 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:11:58.867184 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:11:58.867184 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:11:58.867184 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 9c8cc5b7223b4cb3ba8c1763c44fa5b0 Oct 23 01:11:58.867184 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-659961516 Oct 23 01:11:58.867184 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:11:58.867184 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:11:58.868561 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9c8cc5b7223b4cb3ba8c1763c44fa5b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9c8cc5b7223b4cb3ba8c1763c44fa5b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9c8cc5b7223b4cb3ba8c1763c44fa5b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9c8cc5b7223b4cb3ba8c1763c44fa5b0"}]}] Oct 23 01:11:58.868561 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-659961516 Oct 23 01:11:58.868561 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 9c8cc5b7223b4cb3ba8c1763c44fa5b0 Oct 23 01:11:58.868561 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-659961516 Oct 23 01:11:58.868561 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-659961516-project Oct 23 01:11:58.868561 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:11:58.868561 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:11:58.868561 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: a659d51e02d8443c942e3ff164eb9683 Oct 23 01:11:58.868561 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-659961516-project Oct 23 01:11:58.868561 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:11:58.869239 n-d-master-1 devstack@n-api.service[120944]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 23 01:11:58.869239 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '2022-10-23 01:11:58'} Oct 23 01:11:58.869239 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:11:58.869239 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:58.869239 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:58.869239 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:58.869239 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:11:58.869239 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:11:58.869239 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:11:58.869239 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:11:58.869239 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 23 01:11:58.869239 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 23 01:11:58.869239 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 23 01:11:58.869239 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 23 01:11:58.869239 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 23 01:11:58.869239 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 23 01:11:58.869239 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:11:58.869239 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 23 01:11:58.869239 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:11:58.869239 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise self.value Oct 23 01:11:58.870560 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 23 01:11:58.870560 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 23 01:11:58.870560 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 23 01:11:58.870560 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 23 01:11:58.870560 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 23 01:11:58.870560 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 23 01:11:58.870560 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 23 01:11:58.870560 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:58.870560 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:11:58.870560 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:58.870560 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:58.870560 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:58.870560 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:58.870560 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 23 01:11:58.870560 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 23 01:11:58.870560 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 23 01:11:58.870560 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:11:58.872309 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-14bcb402-7766-475a-b112-f6e77aa15362 tempest-InstanceUsageAuditLogNegativeTestJSON-659961516 tempest-InstanceUsageAuditLogNegativeTestJSON-659961516-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:11:58.873287 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-14bcb402-7766-475a-b112-f6e77aa15362 tempest-InstanceUsageAuditLogNegativeTestJSON-659961516 tempest-InstanceUsageAuditLogNegativeTestJSON-659961516-project] 10.222.0.42 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-23 01:11:58" status: 403 len: 128 microversion: 2.1 time: 0.013387 Oct 23 01:11:58.875445 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 194/440] 10.222.0.42 () {58 vars in 1251 bytes} [Sun Oct 23 01:11:58 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-23%2001%3A11%3A58 => generated 128 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:11:59.010366 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9bbab36e-c7ac-4d08-a288-071266abddce tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Releasing lock "refresh_cache-9bb5ab44-057e-4115-a477-602ef6feece3" {{(pid=120945) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 23 01:11:59.012763 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-9bbab36e-c7ac-4d08-a288-071266abddce tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] HTTP exception thrown: floating IP not found Oct 23 01:11:59.018475 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9bbab36e-c7ac-4d08-a288-071266abddce tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Request method failure captured: Oct 23 01:11:59.018475 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/servers/9bb5ab44-057e-4115-a477-602ef6feece3/action HTTP/1.1 Oct 23 01:11:59.018475 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:11:59.018475 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:11:59.018475 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:11:59.018475 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 41 Oct 23 01:11:59.018475 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:11:59.018475 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:11:59.018475 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:11:59.018475 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:11:59.018475 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJS1fYy_rmFnFNEcRI54qAmDFzEjFZqRJFQPCRzXdt_XqD7y1fGbU90inPCCyf9eKyuyhSmw7i3KZCr9D1o8YeH3GgiieXpGJFerc_ocxwN3z6lo2EGuwtdEvpzujbeALsLwwt5MSJ2MyK8Ek9E6JDByuL9D9VdDEDVWzrVO-MwxCdg Oct 23 01:11:59.018475 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:11:59.018475 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:11:59.018475 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:11:59.018475 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:11:59.018475 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:11:59.018475 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:11:59.018475 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: b7864a40d26e402d815d39ef0c0f91a1 Oct 23 01:11:59.018475 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-434430825 Oct 23 01:11:59.018475 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:11:59.018475 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:11:59.019993 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b7864a40d26e402d815d39ef0c0f91a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b7864a40d26e402d815d39ef0c0f91a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b7864a40d26e402d815d39ef0c0f91a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b7864a40d26e402d815d39ef0c0f91a1"}]}] Oct 23 01:11:59.019993 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-434430825 Oct 23 01:11:59.019993 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: b7864a40d26e402d815d39ef0c0f91a1 Oct 23 01:11:59.019993 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-434430825 Oct 23 01:11:59.019993 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project Oct 23 01:11:59.019993 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:11:59.019993 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:11:59.019993 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 74c84b03f3f8431e9d3c0cbb792aeaf9 Oct 23 01:11:59.019993 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project Oct 23 01:11:59.019993 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:11:59.019993 n-d-master-1 devstack@n-api.service[120945]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 23 01:11:59.019993 n-d-master-1 devstack@n-api.service[120945]: method: Oct 23 01:11:59.019993 n-d-master-1 devstack@n-api.service[120945]: exception: floating IP not found Oct 23 01:11:59.020873 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '9bb5ab44-057e-4115-a477-602ef6feece3', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 23 01:11:59.020873 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:11:59.020873 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:59.020873 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 23 01:11:59.020873 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 23 01:11:59.020873 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 23 01:11:59.020873 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 23 01:11:59.020873 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 23 01:11:59.020873 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 23 01:11:59.020873 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 23 01:11:59.020873 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 23 01:11:59.020873 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 23 01:11:59.020873 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:59.020873 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:11:59.020873 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:59.020873 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:59.020873 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:59.020873 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:59.020873 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:11:59.022310 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:11:59.022310 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:11:59.022310 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:11:59.022310 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:11:59.022310 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:11:59.022310 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:11:59.022310 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:11:59.022310 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 23 01:11:59.022310 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 23 01:11:59.022310 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 23 01:11:59.022310 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:59.022310 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:11:59.022310 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:59.022310 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:59.022310 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:59.022310 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:59.022310 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:11:59.022310 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:11:59.022310 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 23 01:11:59.022310 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:59.025289 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d4809594-a1b8-45c6-8a6a-2146c8a9036d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-713757767", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "3be3e39f-fbeb-4ed9-a69b-dfb7241289c0"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:59.027730 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9bbab36e-c7ac-4d08-a288-071266abddce tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Returning 404 to user: floating IP not found {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:11:59.028809 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9bbab36e-c7ac-4d08-a288-071266abddce tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] 10.222.0.42 "POST /compute/v2.1/servers/9bb5ab44-057e-4115-a477-602ef6feece3/action" status: 404 len: 67 microversion: 2.1 time: 0.311486 Oct 23 01:11:59.029904 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 247/441] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:11:58 2022] POST /compute/v2.1/servers/9bb5ab44-057e-4115-a477-602ef6feece3/action => generated 67 bytes in 313 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:11:59.044091 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d484d918-8c66-408f-813c-b85327b68c1e tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:59.074727 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-d4809594-a1b8-45c6-8a6a-2146c8a9036d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] validate_networks() for [('3be3e39f-fbeb-4ed9-a69b-dfb7241289c0', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:11:59.100917 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-d484d918-8c66-408f-813c-b85327b68c1e tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 23 01:11:59.102892 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d484d918-8c66-408f-813c-b85327b68c1e tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Request method failure captured: Oct 23 01:11:59.102892 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/servers/9bb5ab44-057e-4115-a477-602ef6feece3/action HTTP/1.1 Oct 23 01:11:59.102892 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:11:59.102892 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:11:59.102892 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:11:59.102892 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 44 Oct 23 01:11:59.102892 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:11:59.102892 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:11:59.102892 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:11:59.102892 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:11:59.102892 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJS1fYy_rmFnFNEcRI54qAmDFzEjFZqRJFQPCRzXdt_XqD7y1fGbU90inPCCyf9eKyuyhSmw7i3KZCr9D1o8YeH3GgiieXpGJFerc_ocxwN3z6lo2EGuwtdEvpzujbeALsLwwt5MSJ2MyK8Ek9E6JDByuL9D9VdDEDVWzrVO-MwxCdg Oct 23 01:11:59.102892 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:11:59.102892 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:11:59.102892 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:11:59.102892 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:11:59.102892 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:11:59.102892 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:11:59.102892 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: b7864a40d26e402d815d39ef0c0f91a1 Oct 23 01:11:59.102892 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-434430825 Oct 23 01:11:59.102892 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:11:59.102892 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:11:59.104153 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b7864a40d26e402d815d39ef0c0f91a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b7864a40d26e402d815d39ef0c0f91a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b7864a40d26e402d815d39ef0c0f91a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b7864a40d26e402d815d39ef0c0f91a1"}]}] Oct 23 01:11:59.104153 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-434430825 Oct 23 01:11:59.104153 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: b7864a40d26e402d815d39ef0c0f91a1 Oct 23 01:11:59.104153 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-434430825 Oct 23 01:11:59.104153 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project Oct 23 01:11:59.104153 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:11:59.104153 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:11:59.104153 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 74c84b03f3f8431e9d3c0cbb792aeaf9 Oct 23 01:11:59.104153 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project Oct 23 01:11:59.104153 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:11:59.104153 n-d-master-1 devstack@n-api.service[120945]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 23 01:11:59.104153 n-d-master-1 devstack@n-api.service[120945]: method: Oct 23 01:11:59.104153 n-d-master-1 devstack@n-api.service[120945]: exception: Floating IP not found for address 0.0.0.0. Oct 23 01:11:59.106054 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '9bb5ab44-057e-4115-a477-602ef6feece3', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 23 01:11:59.106054 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:11:59.106054 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:59.106054 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 23 01:11:59.106054 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 23 01:11:59.106054 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 23 01:11:59.106054 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 23 01:11:59.106054 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 23 01:11:59.106054 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 23 01:11:59.106054 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 23 01:11:59.106054 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:59.106054 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:11:59.106054 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:59.106054 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:59.106054 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:59.106054 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:59.106054 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:11:59.106054 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:11:59.106054 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:11:59.107506 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:11:59.107506 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:11:59.107506 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:11:59.107506 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:11:59.107506 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:11:59.107506 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 23 01:11:59.107506 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 23 01:11:59.107506 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 23 01:11:59.107506 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 23 01:11:59.107506 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 23 01:11:59.107506 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:59.107506 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:11:59.107506 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:59.107506 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:59.107506 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:59.107506 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:59.107506 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:11:59.107506 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:11:59.107506 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 23 01:11:59.107506 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:59.113117 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d484d918-8c66-408f-813c-b85327b68c1e tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:11:59.114247 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d484d918-8c66-408f-813c-b85327b68c1e tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] 10.222.0.42 "POST /compute/v2.1/servers/9bb5ab44-057e-4115-a477-602ef6feece3/action" status: 404 len: 88 microversion: 2.1 time: 0.078462 Oct 23 01:11:59.119629 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 248/442] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:11:59 2022] POST /compute/v2.1/servers/9bb5ab44-057e-4115-a477-602ef6feece3/action => generated 88 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:11:59.127576 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-e833c5b1-b797-4dc7-840f-06e50eb12123 req-5d7fce0e-ec74-4b2e-8463-75b45660b54f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f277484-b3ae-465e-90b7-8febafef9329", "tag": "4af1b3a5-4e5f-45a7-ab54-f98595e2f6f7"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:11:59.146051 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-e833c5b1-b797-4dc7-840f-06e50eb12123 req-5d7fce0e-ec74-4b2e-8463-75b45660b54f service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:59.146051 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-e833c5b1-b797-4dc7-840f-06e50eb12123 req-5d7fce0e-ec74-4b2e-8463-75b45660b54f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:59.146051 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-e833c5b1-b797-4dc7-840f-06e50eb12123 req-5d7fce0e-ec74-4b2e-8463-75b45660b54f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:59.157230 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-e833c5b1-b797-4dc7-840f-06e50eb12123 req-5d7fce0e-ec74-4b2e-8463-75b45660b54f service nova] Creating event network-changed:4af1b3a5-4e5f-45a7-ab54-f98595e2f6f7 for instance 8f277484-b3ae-465e-90b7-8febafef9329 on n-h1-master-1 Oct 23 01:11:59.164203 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-e833c5b1-b797-4dc7-840f-06e50eb12123 req-5d7fce0e-ec74-4b2e-8463-75b45660b54f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041274 Oct 23 01:11:59.165259 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 249/443] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:11:59.174626 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-44f89699-cad7-4469-ace9-549e28b5e9b6 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:59.175927 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-44f89699-cad7-4469-ace9-549e28b5e9b6 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] [instance: 9bb5ab44-057e-4115-a477-602ef6feece3] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:59.182490 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44f89699-cad7-4469-ace9-549e28b5e9b6 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:59.183739 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44f89699-cad7-4469-ace9-549e28b5e9b6 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:59.184231 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44f89699-cad7-4469-ace9-549e28b5e9b6 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:59.184966 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44f89699-cad7-4469-ace9-549e28b5e9b6 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:59.185419 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44f89699-cad7-4469-ace9-549e28b5e9b6 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:59.185837 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44f89699-cad7-4469-ace9-549e28b5e9b6 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:59.211751 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-44f89699-cad7-4469-ace9-549e28b5e9b6 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] [instance: 9bb5ab44-057e-4115-a477-602ef6feece3] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:11:59.586725 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-44f89699-cad7-4469-ace9-549e28b5e9b6 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9bb5ab44-057e-4115-a477-602ef6feece3" status: 204 len: 0 microversion: 2.1 time: 0.419259 Oct 23 01:11:59.588046 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 250/444] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:11:59 2022] DELETE /compute/v2.1/servers/9bb5ab44-057e-4115-a477-602ef6feece3 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:11:59.598937 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-36732243-8db8-41ca-8db4-ca303eac3e44 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:59.600214 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-36732243-8db8-41ca-8db4-ca303eac3e44 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] [instance: 56fab46b-b733-4279-8e6b-dd6b11013fb2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:59.610122 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36732243-8db8-41ca-8db4-ca303eac3e44 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:59.610934 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36732243-8db8-41ca-8db4-ca303eac3e44 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:59.611581 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36732243-8db8-41ca-8db4-ca303eac3e44 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:59.612829 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36732243-8db8-41ca-8db4-ca303eac3e44 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:59.613497 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36732243-8db8-41ca-8db4-ca303eac3e44 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:59.614424 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36732243-8db8-41ca-8db4-ca303eac3e44 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:59.649594 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-36732243-8db8-41ca-8db4-ca303eac3e44 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] HTTP exception thrown: Instance 56fab46b-b733-4279-8e6b-dd6b11013fb2 could not be found. Oct 23 01:11:59.653683 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-36732243-8db8-41ca-8db4-ca303eac3e44 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Request method failure captured: Oct 23 01:11:59.653683 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/56fab46b-b733-4279-8e6b-dd6b11013fb2 HTTP/1.1 Oct 23 01:11:59.653683 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:11:59.653683 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:11:59.653683 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:11:59.653683 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:11:59.653683 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:11:59.653683 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:11:59.653683 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:11:59.653683 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:11:59.653683 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJTBuHLeuYgEsSbq3xAo7m-Y0q2It5nquHtCX4jtIVbN1hoKYoU16-Aar23u9doUsrER6jVxPw8ltFa3e9C1Q3gcBJaNW-16mD5W9lCukLb-mgqkjbEdW37NzUw62U0_1VOAQZ8gfwbkoDmh6NrVMglqDO3xkR8zcEfO25__12UjCCg Oct 23 01:11:59.653683 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:11:59.653683 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:11:59.653683 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:11:59.653683 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:11:59.653683 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:11:59.653683 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:11:59.653683 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 23f22fb0ca7346c4ab225ce82d69118c Oct 23 01:11:59.653683 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1672751015 Oct 23 01:11:59.653683 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:11:59.653683 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:11:59.657007 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/23f22fb0ca7346c4ab225ce82d69118c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_23f22fb0ca7346c4ab225ce82d69118c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/23f22fb0ca7346c4ab225ce82d69118c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/23f22fb0ca7346c4ab225ce82d69118c"}]}] Oct 23 01:11:59.657007 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-DeleteServersAdminTestJSON-1672751015 Oct 23 01:11:59.657007 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 23f22fb0ca7346c4ab225ce82d69118c Oct 23 01:11:59.657007 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1672751015 Oct 23 01:11:59.657007 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-DeleteServersAdminTestJSON-1672751015-project Oct 23 01:11:59.657007 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:11:59.657007 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:11:59.657007 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 76739eabf8804ec2af41abc4c1e6fd4b Oct 23 01:11:59.657007 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-DeleteServersAdminTestJSON-1672751015-project Oct 23 01:11:59.657007 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:11:59.657007 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 56fab46b-b733-4279-8e6b-dd6b11013fb2 could not be found. Oct 23 01:11:59.657007 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '56fab46b-b733-4279-8e6b-dd6b11013fb2'} Oct 23 01:11:59.657822 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:11:59.657822 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:59.657822 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:11:59.657822 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:11:59.657822 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:11:59.657822 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:11:59.657822 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:11:59.657822 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:11:59.657822 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:11:59.657822 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:11:59.657822 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56fab46b-b733-4279-8e6b-dd6b11013fb2 could not be found. Oct 23 01:11:59.657822 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:59.657822 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:11:59.657822 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:59.657822 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:59.657822 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:59.657822 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:59.657822 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:11:59.657822 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:11:59.657822 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:11:59.658966 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:11:59.658966 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:11:59.658966 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:11:59.658966 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:11:59.658966 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:11:59.658966 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:11:59.658966 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:11:59.658966 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56fab46b-b733-4279-8e6b-dd6b11013fb2 could not be found. Oct 23 01:11:59.658966 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:59.658966 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:11:59.658966 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:59.658966 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:11:59.658966 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:11:59.658966 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:11:59.658966 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:11:59.658966 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:11:59.658966 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56fab46b-b733-4279-8e6b-dd6b11013fb2 could not be found. Oct 23 01:11:59.658966 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:11:59.659966 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-36732243-8db8-41ca-8db4-ca303eac3e44 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Returning 404 to user: Instance 56fab46b-b733-4279-8e6b-dd6b11013fb2 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:11:59.662221 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-36732243-8db8-41ca-8db4-ca303eac3e44 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] 10.222.0.42 "GET /compute/v2.1/servers/56fab46b-b733-4279-8e6b-dd6b11013fb2" status: 404 len: 111 microversion: 2.1 time: 0.062773 Oct 23 01:11:59.664349 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 251/445] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:59 2022] GET /compute/v2.1/servers/56fab46b-b733-4279-8e6b-dd6b11013fb2 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:11:59.675992 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9ac298d0-41a1-4c3c-8223-d3251e989b92 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:59.687609 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9ac298d0-41a1-4c3c-8223-d3251e989b92 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:59.705910 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9ac298d0-41a1-4c3c-8223-d3251e989b92 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:59.706449 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9ac298d0-41a1-4c3c-8223-d3251e989b92 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:59.706890 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9ac298d0-41a1-4c3c-8223-d3251e989b92 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:59.707604 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9ac298d0-41a1-4c3c-8223-d3251e989b92 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:59.708085 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9ac298d0-41a1-4c3c-8223-d3251e989b92 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:59.712034 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9ac298d0-41a1-4c3c-8223-d3251e989b92 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:59.960551 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9ac298d0-41a1-4c3c-8223-d3251e989b92 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:59.964384 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-d4809594-a1b8-45c6-8a6a-2146c8a9036d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:11:59.966161 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-d4809594-a1b8-45c6-8a6a-2146c8a9036d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:11:59.967908 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-d4809594-a1b8-45c6-8a6a-2146c8a9036d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:11:59.968673 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-d4809594-a1b8-45c6-8a6a-2146c8a9036d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:11:59.969410 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-d4809594-a1b8-45c6-8a6a-2146c8a9036d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:11:59.970664 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9ac298d0-41a1-4c3c-8223-d3251e989b92 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:59.972459 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9ac298d0-41a1-4c3c-8223-d3251e989b92 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:11:59.979568 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9ac298d0-41a1-4c3c-8223-d3251e989b92 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1537 microversion: 2.91 time: 0.313475 Oct 23 01:11:59.980476 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 252/446] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:11:59 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1537 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:11:59.985936 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-17f510af-f166-42c4-8e81-a5d1d1b47991 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:11:59.993581 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-17f510af-f166-42c4-8e81-a5d1d1b47991 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 46694c40-e6a6-48c1-a105-390bd0133d62] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:11:59.993581 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-17f510af-f166-42c4-8e81-a5d1d1b47991 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:59.993581 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-17f510af-f166-42c4-8e81-a5d1d1b47991 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:59.994029 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-17f510af-f166-42c4-8e81-a5d1d1b47991 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:11:59.995113 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-17f510af-f166-42c4-8e81-a5d1d1b47991 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:11:59.995837 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-17f510af-f166-42c4-8e81-a5d1d1b47991 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:11:59.996425 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-17f510af-f166-42c4-8e81-a5d1d1b47991 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:00.001182 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:00.004418 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d4809594-a1b8-45c6-8a6a-2146c8a9036d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:00.004924 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d4809594-a1b8-45c6-8a6a-2146c8a9036d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:00.005366 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d4809594-a1b8-45c6-8a6a-2146c8a9036d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:00.006542 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d4809594-a1b8-45c6-8a6a-2146c8a9036d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:00.007009 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d4809594-a1b8-45c6-8a6a-2146c8a9036d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:00.007508 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d4809594-a1b8-45c6-8a6a-2146c8a9036d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:00.034181 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-d4809594-a1b8-45c6-8a6a-2146c8a9036d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Getting quotas for project d46a7166e4144f55a102ea6335c5f820. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:12:00.038631 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-d4809594-a1b8-45c6-8a6a-2146c8a9036d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Getting quotas for user 1c2310cbc3574eb29a6ca6291ba7808e and project d46a7166e4144f55a102ea6335c5f820. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:12:00.051389 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d4809594-a1b8-45c6-8a6a-2146c8a9036d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:12:00.053755 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d4809594-a1b8-45c6-8a6a-2146c8a9036d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: bc304d93-5c47-4830-af2c-bca071542590] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:12:00.213110 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-17f510af-f166-42c4-8e81-a5d1d1b47991 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:00.228137 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-17f510af-f166-42c4-8e81-a5d1d1b47991 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/46694c40-e6a6-48c1-a105-390bd0133d62" status: 200 len: 1313 microversion: 2.1 time: 0.246339 Oct 23 01:12:00.230642 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 253/447] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:11:59 2022] GET /compute/v2.1/servers/46694c40-e6a6-48c1-a105-390bd0133d62 => generated 1313 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:00.238565 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-aa5fa4bf-7fdb-401e-9643-fd8f5e38b123 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:00.239971 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-aa5fa4bf-7fdb-401e-9643-fd8f5e38b123 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:00.250575 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa5fa4bf-7fdb-401e-9643-fd8f5e38b123 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:00.250890 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d4809594-a1b8-45c6-8a6a-2146c8a9036d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.231280 Oct 23 01:12:00.251607 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 195/448] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:11:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1237 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:12:00.254346 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa5fa4bf-7fdb-401e-9643-fd8f5e38b123 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:00.255026 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa5fa4bf-7fdb-401e-9643-fd8f5e38b123 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:00.258089 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa5fa4bf-7fdb-401e-9643-fd8f5e38b123 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:00.258213 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-44ee0d85-9946-441c-8577-3d8f2fc4be46 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:00.258299 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa5fa4bf-7fdb-401e-9643-fd8f5e38b123 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:00.258299 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa5fa4bf-7fdb-401e-9643-fd8f5e38b123 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:00.258432 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-44ee0d85-9946-441c-8577-3d8f2fc4be46 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] [instance: 9bb5ab44-057e-4115-a477-602ef6feece3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:00.264289 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-44ee0d85-9946-441c-8577-3d8f2fc4be46 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:00.265070 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-44ee0d85-9946-441c-8577-3d8f2fc4be46 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:00.265712 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-44ee0d85-9946-441c-8577-3d8f2fc4be46 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:00.266455 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-44ee0d85-9946-441c-8577-3d8f2fc4be46 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:00.267070 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-44ee0d85-9946-441c-8577-3d8f2fc4be46 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:00.267833 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-44ee0d85-9946-441c-8577-3d8f2fc4be46 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:00.358699 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-aa5fa4bf-7fdb-401e-9643-fd8f5e38b123 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:00.374247 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-aa5fa4bf-7fdb-401e-9643-fd8f5e38b123 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2" status: 200 len: 1209 microversion: 2.1 time: 0.141599 Oct 23 01:12:00.375435 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 254/449] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:00 2022] GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2 => generated 1209 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:00.402382 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a2cd827d-22c1-4667-b8e3-5b9704c8edca tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1844661712", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:12:00.484683 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-a2cd827d-22c1-4667-b8e3-5b9704c8edca tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] validate_networks() for None {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:12:00.644078 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-44ee0d85-9946-441c-8577-3d8f2fc4be46 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c84b03f3f8431e9d3c0cbb792aeaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7864a40d26e402d815d39ef0c0f91a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:00.655549 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-44ee0d85-9946-441c-8577-3d8f2fc4be46 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] 10.222.0.42 "GET /compute/v2.1/servers/9bb5ab44-057e-4115-a477-602ef6feece3" status: 200 len: 1542 microversion: 2.1 time: 0.402684 Oct 23 01:12:00.656477 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 196/450] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:00 2022] GET /compute/v2.1/servers/9bb5ab44-057e-4115-a477-602ef6feece3 => generated 1542 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:00.661705 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9c0d794d-a5d1-402c-84fb-744ef448fa1d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:00.662571 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9c0d794d-a5d1-402c-84fb-744ef448fa1d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: bc304d93-5c47-4830-af2c-bca071542590] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:00.991831 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9c0d794d-a5d1-402c-84fb-744ef448fa1d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:00.999819 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9c0d794d-a5d1-402c-84fb-744ef448fa1d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590" status: 200 len: 1210 microversion: 2.1 time: 0.342043 Oct 23 01:12:01.000393 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 197/451] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:00 2022] GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590 => generated 1210 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:01.019001 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b9767b16-a403-45a8-9b52-3e97f6de86da tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:01.019735 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b9767b16-a403-45a8-9b52-3e97f6de86da tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:01.026458 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b9767b16-a403-45a8-9b52-3e97f6de86da tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:01.027525 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b9767b16-a403-45a8-9b52-3e97f6de86da tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:01.028033 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b9767b16-a403-45a8-9b52-3e97f6de86da tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:01.028811 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b9767b16-a403-45a8-9b52-3e97f6de86da tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:01.029335 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b9767b16-a403-45a8-9b52-3e97f6de86da tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:01.029830 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b9767b16-a403-45a8-9b52-3e97f6de86da tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:01.129563 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b9767b16-a403-45a8-9b52-3e97f6de86da tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:01.138540 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b9767b16-a403-45a8-9b52-3e97f6de86da tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:01.139981 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b9767b16-a403-45a8-9b52-3e97f6de86da tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:01.145708 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b9767b16-a403-45a8-9b52-3e97f6de86da tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1537 microversion: 2.91 time: 0.130508 Oct 23 01:12:01.146336 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 198/452] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:12:01 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1537 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:12:01.196440 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-a2cd827d-22c1-4667-b8e3-5b9704c8edca tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:12:01.196901 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-a2cd827d-22c1-4667-b8e3-5b9704c8edca tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:12:01.197342 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-a2cd827d-22c1-4667-b8e3-5b9704c8edca tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:12:01.197744 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-a2cd827d-22c1-4667-b8e3-5b9704c8edca tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:12:01.198176 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-a2cd827d-22c1-4667-b8e3-5b9704c8edca tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:12:01.207294 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a2cd827d-22c1-4667-b8e3-5b9704c8edca tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:01.207701 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a2cd827d-22c1-4667-b8e3-5b9704c8edca tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:01.208239 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a2cd827d-22c1-4667-b8e3-5b9704c8edca tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:01.208967 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a2cd827d-22c1-4667-b8e3-5b9704c8edca tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:01.209421 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a2cd827d-22c1-4667-b8e3-5b9704c8edca tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:01.209833 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a2cd827d-22c1-4667-b8e3-5b9704c8edca tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:01.217734 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=9 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:01.229186 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-a2cd827d-22c1-4667-b8e3-5b9704c8edca tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Getting quotas for project 23f22fb0ca7346c4ab225ce82d69118c. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:12:01.231172 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:01.234493 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-a2cd827d-22c1-4667-b8e3-5b9704c8edca tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Getting quotas for user 76739eabf8804ec2af41abc4c1e6fd4b and project 23f22fb0ca7346c4ab225ce82d69118c. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:12:01.245709 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a2cd827d-22c1-4667-b8e3-5b9704c8edca tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:12:01.249599 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a2cd827d-22c1-4667-b8e3-5b9704c8edca tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] [instance: 534a7a12-774e-47ce-86d2-10b277d50c8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:12:01.255754 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b2a91711-1fbf-454a-9be8-cd6f58c99939 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:01.256807 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b2a91711-1fbf-454a-9be8-cd6f58c99939 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 46694c40-e6a6-48c1-a105-390bd0133d62] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:01.264208 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b2a91711-1fbf-454a-9be8-cd6f58c99939 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:01.265868 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b2a91711-1fbf-454a-9be8-cd6f58c99939 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:01.265868 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b2a91711-1fbf-454a-9be8-cd6f58c99939 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:01.265868 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b2a91711-1fbf-454a-9be8-cd6f58c99939 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:01.266397 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b2a91711-1fbf-454a-9be8-cd6f58c99939 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:01.267113 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b2a91711-1fbf-454a-9be8-cd6f58c99939 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:01.459542 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b2a91711-1fbf-454a-9be8-cd6f58c99939 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:01.468430 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b2a91711-1fbf-454a-9be8-cd6f58c99939 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/46694c40-e6a6-48c1-a105-390bd0133d62" status: 200 len: 1313 microversion: 2.1 time: 0.217486 Oct 23 01:12:01.473464 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 199/453] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:01 2022] GET /compute/v2.1/servers/46694c40-e6a6-48c1-a105-390bd0133d62 => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:12:01.473613 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-632a547f-e5b8-4b06-963a-2bcbf79a20b6 req-2993df2d-8c7d-4125-a410-1232a6998f39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46694c40-e6a6-48c1-a105-390bd0133d62", "tag": "650e2f7b-3221-4215-9990-463fd0ecbef4"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:12:01.477900 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a2cd827d-22c1-4667-b8e3-5b9704c8edca tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.100694 Oct 23 01:12:01.478754 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 255/454] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:12:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1103 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:12:01.483439 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-632a547f-e5b8-4b06-963a-2bcbf79a20b6 req-2993df2d-8c7d-4125-a410-1232a6998f39 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:01.483932 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-632a547f-e5b8-4b06-963a-2bcbf79a20b6 req-2993df2d-8c7d-4125-a410-1232a6998f39 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:01.484369 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-632a547f-e5b8-4b06-963a-2bcbf79a20b6 req-2993df2d-8c7d-4125-a410-1232a6998f39 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:01.485696 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9077e11d-4513-43f0-983f-6743d2df2cf1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:01.486586 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9077e11d-4513-43f0-983f-6743d2df2cf1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:01.502742 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-632a547f-e5b8-4b06-963a-2bcbf79a20b6 req-2993df2d-8c7d-4125-a410-1232a6998f39 service nova] Creating event network-changed:650e2f7b-3221-4215-9990-463fd0ecbef4 for instance 46694c40-e6a6-48c1-a105-390bd0133d62 on n-h1-master-1 Oct 23 01:12:01.507852 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-632a547f-e5b8-4b06-963a-2bcbf79a20b6 req-2993df2d-8c7d-4125-a410-1232a6998f39 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037627 Oct 23 01:12:01.508804 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 200/455] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:12:01.510731 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9077e11d-4513-43f0-983f-6743d2df2cf1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:01.513206 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9077e11d-4513-43f0-983f-6743d2df2cf1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:01.514664 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9077e11d-4513-43f0-983f-6743d2df2cf1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:01.515423 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9077e11d-4513-43f0-983f-6743d2df2cf1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:01.515790 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fcfab20d-d6ba-47f2-8064-104f7c6c04b0 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:01.532485 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9077e11d-4513-43f0-983f-6743d2df2cf1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:01.533226 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fcfab20d-d6ba-47f2-8064-104f7c6c04b0 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] [instance: 534a7a12-774e-47ce-86d2-10b277d50c8f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:01.533325 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9077e11d-4513-43f0-983f-6743d2df2cf1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:01.594780 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fcfab20d-d6ba-47f2-8064-104f7c6c04b0 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76739eabf8804ec2af41abc4c1e6fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f22fb0ca7346c4ab225ce82d69118c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:01.603080 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fcfab20d-d6ba-47f2-8064-104f7c6c04b0 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] 10.222.0.42 "GET /compute/v2.1/servers/534a7a12-774e-47ce-86d2-10b277d50c8f" status: 200 len: 1220 microversion: 2.1 time: 0.093086 Oct 23 01:12:01.603843 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 201/456] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:01 2022] GET /compute/v2.1/servers/534a7a12-774e-47ce-86d2-10b277d50c8f => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:01.647989 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9077e11d-4513-43f0-983f-6743d2df2cf1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:01.658373 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9077e11d-4513-43f0-983f-6743d2df2cf1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2" status: 200 len: 1265 microversion: 2.1 time: 0.178381 Oct 23 01:12:01.658950 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 256/457] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:01 2022] GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:01.686813 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6d2bb155-d55b-4f8a-83dc-e9023430803e tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:01.687455 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6d2bb155-d55b-4f8a-83dc-e9023430803e tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] [instance: 9bb5ab44-057e-4115-a477-602ef6feece3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:01.695866 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6d2bb155-d55b-4f8a-83dc-e9023430803e tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:01.695866 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6d2bb155-d55b-4f8a-83dc-e9023430803e tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:01.696153 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6d2bb155-d55b-4f8a-83dc-e9023430803e tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:01.696749 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6d2bb155-d55b-4f8a-83dc-e9023430803e tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:01.697187 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6d2bb155-d55b-4f8a-83dc-e9023430803e tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:01.697681 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6d2bb155-d55b-4f8a-83dc-e9023430803e tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:01.703652 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:01.985944 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6d2bb155-d55b-4f8a-83dc-e9023430803e tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c84b03f3f8431e9d3c0cbb792aeaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7864a40d26e402d815d39ef0c0f91a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:01.999228 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6d2bb155-d55b-4f8a-83dc-e9023430803e tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] 10.222.0.42 "GET /compute/v2.1/servers/9bb5ab44-057e-4115-a477-602ef6feece3" status: 200 len: 1542 microversion: 2.1 time: 0.323348 Oct 23 01:12:02.011908 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 202/458] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:01 2022] GET /compute/v2.1/servers/9bb5ab44-057e-4115-a477-602ef6feece3 => generated 1542 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:02.027378 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0315f418-0c5d-487e-8d6d-6073f5a592af tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:02.027992 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0315f418-0c5d-487e-8d6d-6073f5a592af tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: bc304d93-5c47-4830-af2c-bca071542590] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:02.034747 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0315f418-0c5d-487e-8d6d-6073f5a592af tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:02.040409 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0315f418-0c5d-487e-8d6d-6073f5a592af tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:02.040908 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0315f418-0c5d-487e-8d6d-6073f5a592af tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:02.041907 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0315f418-0c5d-487e-8d6d-6073f5a592af tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:02.046526 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0315f418-0c5d-487e-8d6d-6073f5a592af tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:02.048045 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0315f418-0c5d-487e-8d6d-6073f5a592af tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:02.145706 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0315f418-0c5d-487e-8d6d-6073f5a592af tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:02.154202 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0315f418-0c5d-487e-8d6d-6073f5a592af tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590" status: 200 len: 1214 microversion: 2.1 time: 0.130587 Oct 23 01:12:02.166435 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 257/459] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:02 2022] GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590 => generated 1214 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:02.176915 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e20f3be1-5e1c-404e-80de-e9c04bc78e12 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:02.177867 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e20f3be1-5e1c-404e-80de-e9c04bc78e12 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:02.184832 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e20f3be1-5e1c-404e-80de-e9c04bc78e12 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:02.185567 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e20f3be1-5e1c-404e-80de-e9c04bc78e12 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:02.186245 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e20f3be1-5e1c-404e-80de-e9c04bc78e12 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:02.187253 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e20f3be1-5e1c-404e-80de-e9c04bc78e12 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:02.187949 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e20f3be1-5e1c-404e-80de-e9c04bc78e12 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:02.188616 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e20f3be1-5e1c-404e-80de-e9c04bc78e12 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:02.275343 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e20f3be1-5e1c-404e-80de-e9c04bc78e12 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:02.283728 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e20f3be1-5e1c-404e-80de-e9c04bc78e12 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:02.285171 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e20f3be1-5e1c-404e-80de-e9c04bc78e12 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:02.290510 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e20f3be1-5e1c-404e-80de-e9c04bc78e12 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1537 microversion: 2.91 time: 0.117654 Oct 23 01:12:02.291096 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 203/460] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:12:02 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1537 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:12:02.497612 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f5078dee-1985-4e5d-a61c-2b760aa065f9 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:02.498325 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f5078dee-1985-4e5d-a61c-2b760aa065f9 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 46694c40-e6a6-48c1-a105-390bd0133d62] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:02.516815 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f5078dee-1985-4e5d-a61c-2b760aa065f9 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:02.520759 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f5078dee-1985-4e5d-a61c-2b760aa065f9 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:02.522655 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f5078dee-1985-4e5d-a61c-2b760aa065f9 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:02.524891 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f5078dee-1985-4e5d-a61c-2b760aa065f9 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:02.525415 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f5078dee-1985-4e5d-a61c-2b760aa065f9 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:02.526194 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f5078dee-1985-4e5d-a61c-2b760aa065f9 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:02.631215 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d7438705-c452-4c4b-b10a-8ae76e732e09 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:02.631742 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d7438705-c452-4c4b-b10a-8ae76e732e09 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] [instance: 534a7a12-774e-47ce-86d2-10b277d50c8f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:02.748969 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d7438705-c452-4c4b-b10a-8ae76e732e09 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76739eabf8804ec2af41abc4c1e6fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f22fb0ca7346c4ab225ce82d69118c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:02.758010 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d7438705-c452-4c4b-b10a-8ae76e732e09 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] 10.222.0.42 "GET /compute/v2.1/servers/534a7a12-774e-47ce-86d2-10b277d50c8f" status: 200 len: 1220 microversion: 2.1 time: 0.131704 Oct 23 01:12:02.758962 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 204/461] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:02 2022] GET /compute/v2.1/servers/534a7a12-774e-47ce-86d2-10b277d50c8f => generated 1220 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:12:02.763881 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-91c6f1fb-ac9e-460e-9fcc-786900c481e5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:02.765631 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-91c6f1fb-ac9e-460e-9fcc-786900c481e5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:02.772620 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-91c6f1fb-ac9e-460e-9fcc-786900c481e5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:02.773113 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-91c6f1fb-ac9e-460e-9fcc-786900c481e5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:02.773545 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-91c6f1fb-ac9e-460e-9fcc-786900c481e5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:02.774481 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-91c6f1fb-ac9e-460e-9fcc-786900c481e5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:02.775096 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-91c6f1fb-ac9e-460e-9fcc-786900c481e5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:02.775528 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-91c6f1fb-ac9e-460e-9fcc-786900c481e5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:02.887513 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-91c6f1fb-ac9e-460e-9fcc-786900c481e5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:02.896832 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-91c6f1fb-ac9e-460e-9fcc-786900c481e5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2" status: 200 len: 1283 microversion: 2.1 time: 0.136531 Oct 23 01:12:02.897878 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 205/462] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:02 2022] GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2 => generated 1283 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:02.938684 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f5078dee-1985-4e5d-a61c-2b760aa065f9 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:02.947665 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f5078dee-1985-4e5d-a61c-2b760aa065f9 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/46694c40-e6a6-48c1-a105-390bd0133d62" status: 200 len: 1313 microversion: 2.1 time: 0.456707 Oct 23 01:12:02.948335 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 258/463] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:02 2022] GET /compute/v2.1/servers/46694c40-e6a6-48c1-a105-390bd0133d62 => generated 1313 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:03.025436 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a6cc49bd-124f-4931-b837-3f0071f6a473 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:03.026166 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a6cc49bd-124f-4931-b837-3f0071f6a473 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] [instance: 9bb5ab44-057e-4115-a477-602ef6feece3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:03.033082 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6cc49bd-124f-4931-b837-3f0071f6a473 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:03.033655 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6cc49bd-124f-4931-b837-3f0071f6a473 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:03.035787 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6cc49bd-124f-4931-b837-3f0071f6a473 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:03.035787 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6cc49bd-124f-4931-b837-3f0071f6a473 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:03.036498 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6cc49bd-124f-4931-b837-3f0071f6a473 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:03.037081 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6cc49bd-124f-4931-b837-3f0071f6a473 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:03.071716 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6cc49bd-124f-4931-b837-3f0071f6a473 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:03.072458 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6cc49bd-124f-4931-b837-3f0071f6a473 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:03.073045 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6cc49bd-124f-4931-b837-3f0071f6a473 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:03.074214 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-a6cc49bd-124f-4931-b837-3f0071f6a473 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lazy-loading 'fault' on Instance uuid 9bb5ab44-057e-4115-a477-602ef6feece3 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:12:03.120295 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a6cc49bd-124f-4931-b837-3f0071f6a473 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c84b03f3f8431e9d3c0cbb792aeaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7864a40d26e402d815d39ef0c0f91a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:03.128028 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a6cc49bd-124f-4931-b837-3f0071f6a473 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] 10.222.0.42 "GET /compute/v2.1/servers/9bb5ab44-057e-4115-a477-602ef6feece3" status: 200 len: 1322 microversion: 2.1 time: 0.106967 Oct 23 01:12:03.142147 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 206/464] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:03 2022] GET /compute/v2.1/servers/9bb5ab44-057e-4115-a477-602ef6feece3 => generated 1322 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:03.178725 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4a28acac-d67d-46c4-846b-2dacab4237ab tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:03.179327 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4a28acac-d67d-46c4-846b-2dacab4237ab tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: bc304d93-5c47-4830-af2c-bca071542590] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:03.185708 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4a28acac-d67d-46c4-846b-2dacab4237ab tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:03.186249 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4a28acac-d67d-46c4-846b-2dacab4237ab tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:03.186686 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4a28acac-d67d-46c4-846b-2dacab4237ab tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:03.187371 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4a28acac-d67d-46c4-846b-2dacab4237ab tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:03.187822 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4a28acac-d67d-46c4-846b-2dacab4237ab tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:03.188243 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4a28acac-d67d-46c4-846b-2dacab4237ab tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:03.318658 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ac692862-2a61-46da-a008-75a23bda0c78 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:03.319496 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ac692862-2a61-46da-a008-75a23bda0c78 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:03.326636 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac692862-2a61-46da-a008-75a23bda0c78 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:03.327391 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac692862-2a61-46da-a008-75a23bda0c78 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:03.328021 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac692862-2a61-46da-a008-75a23bda0c78 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:03.328890 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac692862-2a61-46da-a008-75a23bda0c78 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:03.329946 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac692862-2a61-46da-a008-75a23bda0c78 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:03.330554 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac692862-2a61-46da-a008-75a23bda0c78 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:03.330676 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4a28acac-d67d-46c4-846b-2dacab4237ab tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:03.341257 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4a28acac-d67d-46c4-846b-2dacab4237ab tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590" status: 200 len: 1262 microversion: 2.1 time: 0.164140 Oct 23 01:12:03.341901 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 259/465] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:03 2022] GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590 => generated 1262 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:03.440515 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ac692862-2a61-46da-a008-75a23bda0c78 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:03.450911 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ac692862-2a61-46da-a008-75a23bda0c78 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:03.452411 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ac692862-2a61-46da-a008-75a23bda0c78 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:03.458438 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ac692862-2a61-46da-a008-75a23bda0c78 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1537 microversion: 2.91 time: 0.143820 Oct 23 01:12:03.459007 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 207/466] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:12:03 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1537 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:12:03.525699 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-ba0c6b35-6c46-4980-833d-acb4d39d19fb req-c114bdb2-e4af-4f76-b426-53fec02401b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bb5ab44-057e-4115-a477-602ef6feece3", "name": "network-vif-deleted", "tag": "f52b7234-1d59-4c35-8b9d-e94552c618c2"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:12:03.535743 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ba0c6b35-6c46-4980-833d-acb4d39d19fb req-c114bdb2-e4af-4f76-b426-53fec02401b2 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:03.537100 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ba0c6b35-6c46-4980-833d-acb4d39d19fb req-c114bdb2-e4af-4f76-b426-53fec02401b2 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:03.537536 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ba0c6b35-6c46-4980-833d-acb4d39d19fb req-c114bdb2-e4af-4f76-b426-53fec02401b2 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:03.550256 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-ba0c6b35-6c46-4980-833d-acb4d39d19fb req-c114bdb2-e4af-4f76-b426-53fec02401b2 service nova] Creating event network-vif-deleted:f52b7234-1d59-4c35-8b9d-e94552c618c2 for instance 9bb5ab44-057e-4115-a477-602ef6feece3 on n-h2-master-1 Oct 23 01:12:03.555878 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-ba0c6b35-6c46-4980-833d-acb4d39d19fb req-c114bdb2-e4af-4f76-b426-53fec02401b2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034398 Oct 23 01:12:03.556795 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 260/467] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:12:03.780725 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-89baa4c6-adc0-46b8-9895-5858ad3eacb3 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:03.781361 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-89baa4c6-adc0-46b8-9895-5858ad3eacb3 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] [instance: 534a7a12-774e-47ce-86d2-10b277d50c8f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:03.790150 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-89baa4c6-adc0-46b8-9895-5858ad3eacb3 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:03.791055 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-89baa4c6-adc0-46b8-9895-5858ad3eacb3 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:03.792633 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-89baa4c6-adc0-46b8-9895-5858ad3eacb3 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:03.794900 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-89baa4c6-adc0-46b8-9895-5858ad3eacb3 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:03.795658 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-89baa4c6-adc0-46b8-9895-5858ad3eacb3 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:03.796278 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-89baa4c6-adc0-46b8-9895-5858ad3eacb3 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:03.896360 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-89baa4c6-adc0-46b8-9895-5858ad3eacb3 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76739eabf8804ec2af41abc4c1e6fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f22fb0ca7346c4ab225ce82d69118c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:03.905502 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-89baa4c6-adc0-46b8-9895-5858ad3eacb3 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] 10.222.0.42 "GET /compute/v2.1/servers/534a7a12-774e-47ce-86d2-10b277d50c8f" status: 200 len: 1216 microversion: 2.1 time: 0.128603 Oct 23 01:12:03.909838 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 208/468] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:03 2022] GET /compute/v2.1/servers/534a7a12-774e-47ce-86d2-10b277d50c8f => generated 1216 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:03.929038 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-29cd5a75-3a7f-4cff-9be1-db8eafae24eb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:03.930055 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-29cd5a75-3a7f-4cff-9be1-db8eafae24eb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:03.943776 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-29cd5a75-3a7f-4cff-9be1-db8eafae24eb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:03.944595 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-29cd5a75-3a7f-4cff-9be1-db8eafae24eb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:03.945181 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-29cd5a75-3a7f-4cff-9be1-db8eafae24eb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:03.946259 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-29cd5a75-3a7f-4cff-9be1-db8eafae24eb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:03.946868 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-29cd5a75-3a7f-4cff-9be1-db8eafae24eb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:03.947447 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-29cd5a75-3a7f-4cff-9be1-db8eafae24eb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:03.972361 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c04ff745-5823-433c-8ae1-5ef10569f7bd tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:03.973072 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c04ff745-5823-433c-8ae1-5ef10569f7bd tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 46694c40-e6a6-48c1-a105-390bd0133d62] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:03.983288 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c04ff745-5823-433c-8ae1-5ef10569f7bd tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:03.986073 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c04ff745-5823-433c-8ae1-5ef10569f7bd tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:03.989593 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c04ff745-5823-433c-8ae1-5ef10569f7bd tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:03.990517 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c04ff745-5823-433c-8ae1-5ef10569f7bd tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:03.991072 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c04ff745-5823-433c-8ae1-5ef10569f7bd tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:03.991582 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c04ff745-5823-433c-8ae1-5ef10569f7bd tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:04.185193 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-29cd5a75-3a7f-4cff-9be1-db8eafae24eb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:04.199654 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-29cd5a75-3a7f-4cff-9be1-db8eafae24eb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2" status: 200 len: 1313 microversion: 2.1 time: 0.273597 Oct 23 01:12:04.200585 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 261/469] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:03 2022] GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2 => generated 1313 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:04.219544 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7fa7e9f9-4e8a-4e5c-ba01-6daffda38d01 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:04.220570 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7fa7e9f9-4e8a-4e5c-ba01-6daffda38d01 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] [instance: 9bb5ab44-057e-4115-a477-602ef6feece3] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:04.229183 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7fa7e9f9-4e8a-4e5c-ba01-6daffda38d01 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:04.230069 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7fa7e9f9-4e8a-4e5c-ba01-6daffda38d01 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:04.230693 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7fa7e9f9-4e8a-4e5c-ba01-6daffda38d01 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:04.232116 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7fa7e9f9-4e8a-4e5c-ba01-6daffda38d01 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:04.232748 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7fa7e9f9-4e8a-4e5c-ba01-6daffda38d01 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:04.233772 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7fa7e9f9-4e8a-4e5c-ba01-6daffda38d01 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:04.253919 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c04ff745-5823-433c-8ae1-5ef10569f7bd tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:04.255434 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-7fa7e9f9-4e8a-4e5c-ba01-6daffda38d01 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] HTTP exception thrown: Instance 9bb5ab44-057e-4115-a477-602ef6feece3 could not be found. Oct 23 01:12:04.257856 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7fa7e9f9-4e8a-4e5c-ba01-6daffda38d01 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Request method failure captured: Oct 23 01:12:04.257856 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/9bb5ab44-057e-4115-a477-602ef6feece3 HTTP/1.1 Oct 23 01:12:04.257856 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:12:04.257856 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:12:04.257856 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:12:04.257856 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:12:04.257856 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:12:04.257856 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:12:04.257856 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:12:04.257856 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:12:04.257856 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJS1fYy_rmFnFNEcRI54qAmDFzEjFZqRJFQPCRzXdt_XqD7y1fGbU90inPCCyf9eKyuyhSmw7i3KZCr9D1o8YeH3GgiieXpGJFerc_ocxwN3z6lo2EGuwtdEvpzujbeALsLwwt5MSJ2MyK8Ek9E6JDByuL9D9VdDEDVWzrVO-MwxCdg Oct 23 01:12:04.257856 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:12:04.257856 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:12:04.257856 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:12:04.257856 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:12:04.257856 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:12:04.257856 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:12:04.257856 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: b7864a40d26e402d815d39ef0c0f91a1 Oct 23 01:12:04.257856 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-434430825 Oct 23 01:12:04.257856 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:12:04.257856 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:12:04.259895 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b7864a40d26e402d815d39ef0c0f91a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b7864a40d26e402d815d39ef0c0f91a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b7864a40d26e402d815d39ef0c0f91a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b7864a40d26e402d815d39ef0c0f91a1"}]}] Oct 23 01:12:04.259895 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-434430825 Oct 23 01:12:04.259895 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: b7864a40d26e402d815d39ef0c0f91a1 Oct 23 01:12:04.259895 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-434430825 Oct 23 01:12:04.259895 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project Oct 23 01:12:04.259895 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:12:04.259895 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:12:04.259895 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 74c84b03f3f8431e9d3c0cbb792aeaf9 Oct 23 01:12:04.259895 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project Oct 23 01:12:04.259895 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:12:04.259895 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 9bb5ab44-057e-4115-a477-602ef6feece3 could not be found. Oct 23 01:12:04.260648 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '9bb5ab44-057e-4115-a477-602ef6feece3'} Oct 23 01:12:04.260648 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:12:04.260648 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:12:04.260648 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:12:04.260648 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:12:04.260648 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:12:04.260648 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:12:04.260648 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:12:04.260648 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:12:04.260648 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:12:04.260648 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:12:04.260648 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bb5ab44-057e-4115-a477-602ef6feece3 could not be found. Oct 23 01:12:04.260648 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:12:04.260648 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:12:04.260648 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:12:04.260648 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:12:04.260648 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:12:04.260648 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:12:04.260648 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:12:04.260648 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:12:04.262792 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:12:04.262792 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:12:04.262792 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:12:04.262792 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:12:04.262792 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:12:04.262792 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:12:04.262792 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:12:04.262792 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:12:04.262792 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bb5ab44-057e-4115-a477-602ef6feece3 could not be found. Oct 23 01:12:04.262792 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:12:04.262792 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:12:04.262792 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:12:04.262792 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:12:04.262792 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:12:04.262792 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:12:04.262792 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:12:04.262792 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:12:04.262792 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bb5ab44-057e-4115-a477-602ef6feece3 could not be found. Oct 23 01:12:04.262792 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:12:04.264046 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7fa7e9f9-4e8a-4e5c-ba01-6daffda38d01 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] Returning 404 to user: Instance 9bb5ab44-057e-4115-a477-602ef6feece3 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:12:04.264046 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7fa7e9f9-4e8a-4e5c-ba01-6daffda38d01 tempest-FloatingIPsAssociationNegativeTestJSON-434430825 tempest-FloatingIPsAssociationNegativeTestJSON-434430825-project] 10.222.0.42 "GET /compute/v2.1/servers/9bb5ab44-057e-4115-a477-602ef6feece3" status: 404 len: 111 microversion: 2.1 time: 0.059130 Oct 23 01:12:04.264046 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 262/470] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:04 2022] GET /compute/v2.1/servers/9bb5ab44-057e-4115-a477-602ef6feece3 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:12:04.268007 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c04ff745-5823-433c-8ae1-5ef10569f7bd tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/46694c40-e6a6-48c1-a105-390bd0133d62" status: 200 len: 1313 microversion: 2.1 time: 0.300482 Oct 23 01:12:04.268862 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 209/471] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:03 2022] GET /compute/v2.1/servers/46694c40-e6a6-48c1-a105-390bd0133d62 => generated 1313 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:04.366006 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-314d3aed-3b6a-4646-8518-8a951e0219b2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:04.367247 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-314d3aed-3b6a-4646-8518-8a951e0219b2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: bc304d93-5c47-4830-af2c-bca071542590] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:04.378685 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-314d3aed-3b6a-4646-8518-8a951e0219b2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:04.379591 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-314d3aed-3b6a-4646-8518-8a951e0219b2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:04.380269 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-314d3aed-3b6a-4646-8518-8a951e0219b2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:04.381221 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-314d3aed-3b6a-4646-8518-8a951e0219b2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:04.382030 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-314d3aed-3b6a-4646-8518-8a951e0219b2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:04.382642 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-314d3aed-3b6a-4646-8518-8a951e0219b2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:04.482832 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-314d3aed-3b6a-4646-8518-8a951e0219b2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:04.491712 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9267b369-1c7c-49f5-8d97-f094c30a7458 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:04.492957 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9267b369-1c7c-49f5-8d97-f094c30a7458 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:04.496114 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:04.496877 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-314d3aed-3b6a-4646-8518-8a951e0219b2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590" status: 200 len: 1270 microversion: 2.1 time: 0.134753 Oct 23 01:12:04.499551 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 263/472] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:04 2022] GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590 => generated 1270 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:04.505037 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9267b369-1c7c-49f5-8d97-f094c30a7458 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:04.505729 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9267b369-1c7c-49f5-8d97-f094c30a7458 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:04.511509 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9267b369-1c7c-49f5-8d97-f094c30a7458 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:04.511509 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9267b369-1c7c-49f5-8d97-f094c30a7458 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:04.511509 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9267b369-1c7c-49f5-8d97-f094c30a7458 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:04.511509 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9267b369-1c7c-49f5-8d97-f094c30a7458 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:04.613925 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9267b369-1c7c-49f5-8d97-f094c30a7458 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:04.622934 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9267b369-1c7c-49f5-8d97-f094c30a7458 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:04.624390 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9267b369-1c7c-49f5-8d97-f094c30a7458 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:04.630385 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9267b369-1c7c-49f5-8d97-f094c30a7458 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1537 microversion: 2.91 time: 0.142600 Oct 23 01:12:04.630962 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 210/473] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:12:04 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1537 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:12:04.892166 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-1fada021-0dfd-4b2d-8efb-1cff819504f0 req-cace9a4d-3c98-48e5-8573-71dd6239648e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ae2878c-23a6-4e78-bd92-69fb03fc27b2", "tag": "9915372e-5565-43b8-b511-9fbf12974675"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:12:04.910781 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-1fada021-0dfd-4b2d-8efb-1cff819504f0 req-cace9a4d-3c98-48e5-8573-71dd6239648e service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:04.911262 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-1fada021-0dfd-4b2d-8efb-1cff819504f0 req-cace9a4d-3c98-48e5-8573-71dd6239648e service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:04.911687 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-1fada021-0dfd-4b2d-8efb-1cff819504f0 req-cace9a4d-3c98-48e5-8573-71dd6239648e service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:04.936522 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-084693ec-0483-448b-87c3-bc04701e44d2 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:04.937027 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-084693ec-0483-448b-87c3-bc04701e44d2 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] [instance: 534a7a12-774e-47ce-86d2-10b277d50c8f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:04.938753 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-1fada021-0dfd-4b2d-8efb-1cff819504f0 req-cace9a4d-3c98-48e5-8573-71dd6239648e service nova] Creating event network-changed:9915372e-5565-43b8-b511-9fbf12974675 for instance 4ae2878c-23a6-4e78-bd92-69fb03fc27b2 on n-h2-master-1 Oct 23 01:12:04.945546 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-084693ec-0483-448b-87c3-bc04701e44d2 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:04.949197 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-084693ec-0483-448b-87c3-bc04701e44d2 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:04.949197 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-084693ec-0483-448b-87c3-bc04701e44d2 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:04.949197 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-084693ec-0483-448b-87c3-bc04701e44d2 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:04.949197 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-084693ec-0483-448b-87c3-bc04701e44d2 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:04.949535 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-084693ec-0483-448b-87c3-bc04701e44d2 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:04.954893 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-1fada021-0dfd-4b2d-8efb-1cff819504f0 req-cace9a4d-3c98-48e5-8573-71dd6239648e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060025 Oct 23 01:12:04.955794 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 264/474] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:12:05.074358 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-084693ec-0483-448b-87c3-bc04701e44d2 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76739eabf8804ec2af41abc4c1e6fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f22fb0ca7346c4ab225ce82d69118c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:05.083368 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-084693ec-0483-448b-87c3-bc04701e44d2 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] 10.222.0.42 "GET /compute/v2.1/servers/534a7a12-774e-47ce-86d2-10b277d50c8f" status: 200 len: 1272 microversion: 2.1 time: 0.152643 Oct 23 01:12:05.084413 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 211/475] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:04 2022] GET /compute/v2.1/servers/534a7a12-774e-47ce-86d2-10b277d50c8f => generated 1272 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:05.228211 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e0aa02dd-e7ba-457c-b2a7-77178f6317ec tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:05.230083 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e0aa02dd-e7ba-457c-b2a7-77178f6317ec tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:05.242553 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e0aa02dd-e7ba-457c-b2a7-77178f6317ec tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:05.244034 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e0aa02dd-e7ba-457c-b2a7-77178f6317ec tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:05.244763 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e0aa02dd-e7ba-457c-b2a7-77178f6317ec tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:05.246340 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e0aa02dd-e7ba-457c-b2a7-77178f6317ec tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:05.247000 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e0aa02dd-e7ba-457c-b2a7-77178f6317ec tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:05.247494 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e0aa02dd-e7ba-457c-b2a7-77178f6317ec tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:05.291240 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b01acd06-73a9-4f9c-b917-9f303f5ad4a7 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:05.292995 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b01acd06-73a9-4f9c-b917-9f303f5ad4a7 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 46694c40-e6a6-48c1-a105-390bd0133d62] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:05.303106 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b01acd06-73a9-4f9c-b917-9f303f5ad4a7 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:05.303849 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b01acd06-73a9-4f9c-b917-9f303f5ad4a7 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:05.304291 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b01acd06-73a9-4f9c-b917-9f303f5ad4a7 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:05.305176 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b01acd06-73a9-4f9c-b917-9f303f5ad4a7 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:05.305628 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b01acd06-73a9-4f9c-b917-9f303f5ad4a7 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:05.306248 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b01acd06-73a9-4f9c-b917-9f303f5ad4a7 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:05.974020 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e0aa02dd-e7ba-457c-b2a7-77178f6317ec tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:05.990542 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e0aa02dd-e7ba-457c-b2a7-77178f6317ec tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2" status: 200 len: 1313 microversion: 2.1 time: 0.769345 Oct 23 01:12:05.993465 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 265/476] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:05 2022] GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2 => generated 1313 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:06.000200 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e6535b4c-ddd2-4ff6-8cf3-b57fee88584a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:06.002500 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e6535b4c-ddd2-4ff6-8cf3-b57fee88584a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: bc304d93-5c47-4830-af2c-bca071542590] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:06.014781 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6535b4c-ddd2-4ff6-8cf3-b57fee88584a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:06.015742 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6535b4c-ddd2-4ff6-8cf3-b57fee88584a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:06.017084 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6535b4c-ddd2-4ff6-8cf3-b57fee88584a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:06.018631 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6535b4c-ddd2-4ff6-8cf3-b57fee88584a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:06.019524 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6535b4c-ddd2-4ff6-8cf3-b57fee88584a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:06.020290 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6535b4c-ddd2-4ff6-8cf3-b57fee88584a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:06.096767 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b01acd06-73a9-4f9c-b917-9f303f5ad4a7 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:06.108969 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b01acd06-73a9-4f9c-b917-9f303f5ad4a7 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/46694c40-e6a6-48c1-a105-390bd0133d62" status: 200 len: 1313 microversion: 2.1 time: 0.821619 Oct 23 01:12:06.114534 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 212/477] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:05 2022] GET /compute/v2.1/servers/46694c40-e6a6-48c1-a105-390bd0133d62 => generated 1313 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:12:06.128904 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7e85df10-824d-40ef-af5e-03fa233d1ab3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:06.129848 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7e85df10-824d-40ef-af5e-03fa233d1ab3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:06.138717 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e85df10-824d-40ef-af5e-03fa233d1ab3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:06.139581 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e85df10-824d-40ef-af5e-03fa233d1ab3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:06.140505 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e85df10-824d-40ef-af5e-03fa233d1ab3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:06.141547 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e85df10-824d-40ef-af5e-03fa233d1ab3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:06.142287 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e85df10-824d-40ef-af5e-03fa233d1ab3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:06.143504 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e85df10-824d-40ef-af5e-03fa233d1ab3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:06.156537 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e6535b4c-ddd2-4ff6-8cf3-b57fee88584a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:06.170683 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e6535b4c-ddd2-4ff6-8cf3-b57fee88584a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590" status: 200 len: 1268 microversion: 2.1 time: 0.175494 Oct 23 01:12:06.182092 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 266/478] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:05 2022] GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590 => generated 1268 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:06.182092 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-34e3a4d2-b866-4e94-bc04-cb8d7c1178ab req-b5251409-c741-45a6-9e81-74e882e4fe35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f277484-b3ae-465e-90b7-8febafef9329", "name": "network-vif-plugged", "status": "completed", "tag": "4af1b3a5-4e5f-45a7-ab54-f98595e2f6f7"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:12:06.193363 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-34e3a4d2-b866-4e94-bc04-cb8d7c1178ab req-b5251409-c741-45a6-9e81-74e882e4fe35 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:06.193925 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-34e3a4d2-b866-4e94-bc04-cb8d7c1178ab req-b5251409-c741-45a6-9e81-74e882e4fe35 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:06.194387 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-34e3a4d2-b866-4e94-bc04-cb8d7c1178ab req-b5251409-c741-45a6-9e81-74e882e4fe35 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:06.207953 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-34e3a4d2-b866-4e94-bc04-cb8d7c1178ab req-b5251409-c741-45a6-9e81-74e882e4fe35 service nova] Creating event network-vif-plugged:4af1b3a5-4e5f-45a7-ab54-f98595e2f6f7 for instance 8f277484-b3ae-465e-90b7-8febafef9329 on n-h1-master-1 Oct 23 01:12:06.215246 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-34e3a4d2-b866-4e94-bc04-cb8d7c1178ab req-b5251409-c741-45a6-9e81-74e882e4fe35 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042056 Oct 23 01:12:06.216338 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 267/479] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:12:06.222239 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2255ca5c-a5f6-4d52-aebc-15fdf25b6563 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:06.223246 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2255ca5c-a5f6-4d52-aebc-15fdf25b6563 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] [instance: 534a7a12-774e-47ce-86d2-10b277d50c8f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:06.230914 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2255ca5c-a5f6-4d52-aebc-15fdf25b6563 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:06.231534 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2255ca5c-a5f6-4d52-aebc-15fdf25b6563 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:06.232324 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2255ca5c-a5f6-4d52-aebc-15fdf25b6563 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:06.233241 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2255ca5c-a5f6-4d52-aebc-15fdf25b6563 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:06.233937 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2255ca5c-a5f6-4d52-aebc-15fdf25b6563 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:06.234540 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2255ca5c-a5f6-4d52-aebc-15fdf25b6563 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:06.321186 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7e85df10-824d-40ef-af5e-03fa233d1ab3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:06.337788 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7e85df10-824d-40ef-af5e-03fa233d1ab3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:06.343602 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7e85df10-824d-40ef-af5e-03fa233d1ab3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:06.353586 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7e85df10-824d-40ef-af5e-03fa233d1ab3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1537 microversion: 2.91 time: 0.237799 Oct 23 01:12:06.355593 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 213/480] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:12:06 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1537 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:12:06.362769 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2255ca5c-a5f6-4d52-aebc-15fdf25b6563 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76739eabf8804ec2af41abc4c1e6fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f22fb0ca7346c4ab225ce82d69118c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:06.370802 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2255ca5c-a5f6-4d52-aebc-15fdf25b6563 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] 10.222.0.42 "GET /compute/v2.1/servers/534a7a12-774e-47ce-86d2-10b277d50c8f" status: 200 len: 1278 microversion: 2.1 time: 0.153286 Oct 23 01:12:06.371489 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 268/481] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:06 2022] GET /compute/v2.1/servers/534a7a12-774e-47ce-86d2-10b277d50c8f => generated 1278 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:07.016693 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-de0fd394-22ee-4d0f-b04e-8812a6163cbf tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:07.017536 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-de0fd394-22ee-4d0f-b04e-8812a6163cbf tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:07.025339 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-de0fd394-22ee-4d0f-b04e-8812a6163cbf tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:07.026868 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-de0fd394-22ee-4d0f-b04e-8812a6163cbf tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:07.027717 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-de0fd394-22ee-4d0f-b04e-8812a6163cbf tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:07.028798 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-de0fd394-22ee-4d0f-b04e-8812a6163cbf tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:07.029253 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-de0fd394-22ee-4d0f-b04e-8812a6163cbf tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:07.029757 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-de0fd394-22ee-4d0f-b04e-8812a6163cbf tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:07.147149 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c6dba98d-bf26-4429-a0d2-c3f6c1983e56 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:07.153786 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c6dba98d-bf26-4429-a0d2-c3f6c1983e56 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 46694c40-e6a6-48c1-a105-390bd0133d62] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:07.161201 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6dba98d-bf26-4429-a0d2-c3f6c1983e56 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:07.164314 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6dba98d-bf26-4429-a0d2-c3f6c1983e56 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:07.164314 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6dba98d-bf26-4429-a0d2-c3f6c1983e56 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:07.164314 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6dba98d-bf26-4429-a0d2-c3f6c1983e56 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:07.164314 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6dba98d-bf26-4429-a0d2-c3f6c1983e56 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:07.164933 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6dba98d-bf26-4429-a0d2-c3f6c1983e56 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:07.483851 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-de0fd394-22ee-4d0f-b04e-8812a6163cbf tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:07.499018 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-de0fd394-22ee-4d0f-b04e-8812a6163cbf tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2" status: 200 len: 1313 microversion: 2.1 time: 0.486212 Oct 23 01:12:07.502325 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 214/482] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:07 2022] GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2 => generated 1313 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:07.518567 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8e3bae4d-4f4c-4738-9278-a058565c6b24 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:07.519596 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8e3bae4d-4f4c-4738-9278-a058565c6b24 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: bc304d93-5c47-4830-af2c-bca071542590] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:07.538619 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8e3bae4d-4f4c-4738-9278-a058565c6b24 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:07.541134 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8e3bae4d-4f4c-4738-9278-a058565c6b24 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:07.543034 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8e3bae4d-4f4c-4738-9278-a058565c6b24 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:07.545790 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8e3bae4d-4f4c-4738-9278-a058565c6b24 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:07.550237 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8e3bae4d-4f4c-4738-9278-a058565c6b24 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:07.550950 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8e3bae4d-4f4c-4738-9278-a058565c6b24 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:07.565553 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c6dba98d-bf26-4429-a0d2-c3f6c1983e56 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:07.579099 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c6dba98d-bf26-4429-a0d2-c3f6c1983e56 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/46694c40-e6a6-48c1-a105-390bd0133d62" status: 200 len: 1313 microversion: 2.1 time: 0.437004 Oct 23 01:12:07.580046 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 269/483] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:07 2022] GET /compute/v2.1/servers/46694c40-e6a6-48c1-a105-390bd0133d62 => generated 1313 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:07.584908 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2152e78d-fe50-4cb9-a453-b73b450109a2 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:07.590775 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2152e78d-fe50-4cb9-a453-b73b450109a2 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:07.601634 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2152e78d-fe50-4cb9-a453-b73b450109a2 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:07.605579 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2152e78d-fe50-4cb9-a453-b73b450109a2 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:07.606290 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2152e78d-fe50-4cb9-a453-b73b450109a2 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:07.607373 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2152e78d-fe50-4cb9-a453-b73b450109a2 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:07.608493 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2152e78d-fe50-4cb9-a453-b73b450109a2 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:07.618689 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2152e78d-fe50-4cb9-a453-b73b450109a2 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:07.744252 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2152e78d-fe50-4cb9-a453-b73b450109a2 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:07.761607 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2152e78d-fe50-4cb9-a453-b73b450109a2 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:07.764355 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2152e78d-fe50-4cb9-a453-b73b450109a2 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:07.771256 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2152e78d-fe50-4cb9-a453-b73b450109a2 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1537 microversion: 2.91 time: 0.189924 Oct 23 01:12:07.782417 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 270/484] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:12:07 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1537 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:12:07.798372 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e981d207-9b40-47fb-8bfd-8b1ff141ee0d tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:07.806322 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e981d207-9b40-47fb-8bfd-8b1ff141ee0d tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] [instance: 534a7a12-774e-47ce-86d2-10b277d50c8f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:07.830354 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e981d207-9b40-47fb-8bfd-8b1ff141ee0d tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:07.833688 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e981d207-9b40-47fb-8bfd-8b1ff141ee0d tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:07.836025 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e981d207-9b40-47fb-8bfd-8b1ff141ee0d tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:07.836900 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e981d207-9b40-47fb-8bfd-8b1ff141ee0d tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:07.839022 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e981d207-9b40-47fb-8bfd-8b1ff141ee0d tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:07.839626 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e981d207-9b40-47fb-8bfd-8b1ff141ee0d tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:08.017623 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8e3bae4d-4f4c-4738-9278-a058565c6b24 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:08.029618 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8e3bae4d-4f4c-4738-9278-a058565c6b24 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590" status: 200 len: 1310 microversion: 2.1 time: 0.526118 Oct 23 01:12:08.036541 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 215/485] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:07 2022] GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590 => generated 1310 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:08.238536 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e981d207-9b40-47fb-8bfd-8b1ff141ee0d tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76739eabf8804ec2af41abc4c1e6fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f22fb0ca7346c4ab225ce82d69118c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:08.260773 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e981d207-9b40-47fb-8bfd-8b1ff141ee0d tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] 10.222.0.42 "GET /compute/v2.1/servers/534a7a12-774e-47ce-86d2-10b277d50c8f" status: 200 len: 1320 microversion: 2.1 time: 0.475757 Oct 23 01:12:08.261291 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 271/486] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:07 2022] GET /compute/v2.1/servers/534a7a12-774e-47ce-86d2-10b277d50c8f => generated 1320 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:08.298758 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3fdc93ad-ab05-4937-a08c-e18421ee4934 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:08.299415 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3fdc93ad-ab05-4937-a08c-e18421ee4934 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:08.305902 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3fdc93ad-ab05-4937-a08c-e18421ee4934 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:08.316485 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3fdc93ad-ab05-4937-a08c-e18421ee4934 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:08.317127 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3fdc93ad-ab05-4937-a08c-e18421ee4934 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:08.318147 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3fdc93ad-ab05-4937-a08c-e18421ee4934 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:08.318885 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3fdc93ad-ab05-4937-a08c-e18421ee4934 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:08.319508 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3fdc93ad-ab05-4937-a08c-e18421ee4934 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:08.376562 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3fdc93ad-ab05-4937-a08c-e18421ee4934 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:12:08.479688 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-0eeba121-0aed-41f9-87a2-ff11e2f2cca2 req-e3275610-f6ff-4c34-8ac1-4f8511395502 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "534a7a12-774e-47ce-86d2-10b277d50c8f", "tag": "b7663a27-79ce-4333-a4c4-dd22f8184032"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:12:08.489565 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-0eeba121-0aed-41f9-87a2-ff11e2f2cca2 req-e3275610-f6ff-4c34-8ac1-4f8511395502 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:08.490947 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-0eeba121-0aed-41f9-87a2-ff11e2f2cca2 req-e3275610-f6ff-4c34-8ac1-4f8511395502 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:08.491527 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-0eeba121-0aed-41f9-87a2-ff11e2f2cca2 req-e3275610-f6ff-4c34-8ac1-4f8511395502 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:08.508927 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-0eeba121-0aed-41f9-87a2-ff11e2f2cca2 req-e3275610-f6ff-4c34-8ac1-4f8511395502 service nova] Creating event network-changed:b7663a27-79ce-4333-a4c4-dd22f8184032 for instance 534a7a12-774e-47ce-86d2-10b277d50c8f on n-h1-master-1 Oct 23 01:12:08.514639 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-0eeba121-0aed-41f9-87a2-ff11e2f2cca2 req-e3275610-f6ff-4c34-8ac1-4f8511395502 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038420 Oct 23 01:12:08.515167 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 272/487] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:12:08.535053 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fed4f865-db8e-4943-8131-580f0eaf921b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:08.535761 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-fed4f865-db8e-4943-8131-580f0eaf921b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:08.555622 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fed4f865-db8e-4943-8131-580f0eaf921b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:08.556479 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fed4f865-db8e-4943-8131-580f0eaf921b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:08.557172 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fed4f865-db8e-4943-8131-580f0eaf921b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:08.558955 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fed4f865-db8e-4943-8131-580f0eaf921b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:08.559418 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fed4f865-db8e-4943-8131-580f0eaf921b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:08.560006 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fed4f865-db8e-4943-8131-580f0eaf921b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:08.721340 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3fdc93ad-ab05-4937-a08c-e18421ee4934 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb" status: 204 len: 0 microversion: 2.1 time: 0.426080 Oct 23 01:12:08.722931 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 216/488] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:12:08 2022] DELETE /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:12:08.728628 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b2680611-b097-4272-bbfa-739e6a4b1576 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:08.733545 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b2680611-b097-4272-bbfa-739e6a4b1576 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 46694c40-e6a6-48c1-a105-390bd0133d62] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:08.741362 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b2680611-b097-4272-bbfa-739e6a4b1576 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:08.750569 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b2680611-b097-4272-bbfa-739e6a4b1576 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:08.751130 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b2680611-b097-4272-bbfa-739e6a4b1576 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:08.751894 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b2680611-b097-4272-bbfa-739e6a4b1576 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:08.753189 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b2680611-b097-4272-bbfa-739e6a4b1576 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:08.753652 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b2680611-b097-4272-bbfa-739e6a4b1576 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:09.140699 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b2680611-b097-4272-bbfa-739e6a4b1576 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:09.152529 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-fed4f865-db8e-4943-8131-580f0eaf921b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:09.153218 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:09.158233 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=100 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:09.160803 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b2680611-b097-4272-bbfa-739e6a4b1576 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/46694c40-e6a6-48c1-a105-390bd0133d62" status: 200 len: 1313 microversion: 2.1 time: 0.434436 Oct 23 01:12:09.163928 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 217/489] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:08 2022] GET /compute/v2.1/servers/46694c40-e6a6-48c1-a105-390bd0133d62 => generated 1313 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:09.178726 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fed4f865-db8e-4943-8131-580f0eaf921b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2" status: 200 len: 1313 microversion: 2.1 time: 0.648588 Oct 23 01:12:09.179515 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7e9a167a-0c31-4268-a34f-7fe79b742807 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:09.179918 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 273/490] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:08 2022] GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2 => generated 1313 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:09.180482 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7e9a167a-0c31-4268-a34f-7fe79b742807 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:09.185598 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3dc0c223-1ac9-46a5-9549-60ef51d572bf tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1450765601", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "988015540", "adminPass": "***", "networks": [{"uuid": "f799b58c-da87-431a-a1dd-0fa03ade5202"}], "security_groups": [{"name": "tempest-securitygroup--1654787865"}], "key_name": "tempest-keypair-229724827", "user_data": "}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:12:09.198942 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e9a167a-0c31-4268-a34f-7fe79b742807 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:09.201123 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e9a167a-0c31-4268-a34f-7fe79b742807 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:09.202488 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e9a167a-0c31-4268-a34f-7fe79b742807 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:09.203806 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e9a167a-0c31-4268-a34f-7fe79b742807 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:09.207346 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e9a167a-0c31-4268-a34f-7fe79b742807 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:09.207949 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e9a167a-0c31-4268-a34f-7fe79b742807 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:09.407506 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7e9a167a-0c31-4268-a34f-7fe79b742807 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:09.421792 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7e9a167a-0c31-4268-a34f-7fe79b742807 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:09.422052 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-3dc0c223-1ac9-46a5-9549-60ef51d572bf tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] validate_networks() for [('f799b58c-da87-431a-a1dd-0fa03ade5202', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:12:09.424296 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7e9a167a-0c31-4268-a34f-7fe79b742807 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:09.437806 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7e9a167a-0c31-4268-a34f-7fe79b742807 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1537 microversion: 2.91 time: 0.269489 Oct 23 01:12:09.438793 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 218/491] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:12:09 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1537 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:12:09.457829 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7af9e913-fd0e-4001-9234-5e35e4898bdc tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:09.458921 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7af9e913-fd0e-4001-9234-5e35e4898bdc tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: bc304d93-5c47-4830-af2c-bca071542590] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:09.465155 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7af9e913-fd0e-4001-9234-5e35e4898bdc tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:09.465646 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7af9e913-fd0e-4001-9234-5e35e4898bdc tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:09.466113 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7af9e913-fd0e-4001-9234-5e35e4898bdc tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:09.466817 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7af9e913-fd0e-4001-9234-5e35e4898bdc tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:09.467274 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7af9e913-fd0e-4001-9234-5e35e4898bdc tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:09.467707 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7af9e913-fd0e-4001-9234-5e35e4898bdc tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:09.795696 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7af9e913-fd0e-4001-9234-5e35e4898bdc tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:09.814454 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7af9e913-fd0e-4001-9234-5e35e4898bdc tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590" status: 200 len: 1310 microversion: 2.1 time: 0.373161 Oct 23 01:12:09.816575 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 219/492] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:09 2022] GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590 => generated 1310 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:09.828873 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-48bc53f9-57ee-430b-9c33-4ef0a0ac0979 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:09.830762 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-48bc53f9-57ee-430b-9c33-4ef0a0ac0979 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] [instance: 534a7a12-774e-47ce-86d2-10b277d50c8f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:09.850650 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-48bc53f9-57ee-430b-9c33-4ef0a0ac0979 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:09.854856 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-48bc53f9-57ee-430b-9c33-4ef0a0ac0979 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:09.854856 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-48bc53f9-57ee-430b-9c33-4ef0a0ac0979 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:09.865204 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-48bc53f9-57ee-430b-9c33-4ef0a0ac0979 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:09.867384 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-48bc53f9-57ee-430b-9c33-4ef0a0ac0979 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:09.869318 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-48bc53f9-57ee-430b-9c33-4ef0a0ac0979 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:10.021004 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=6 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:10.395493 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-3dc0c223-1ac9-46a5-9549-60ef51d572bf tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:12:10.396400 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-3dc0c223-1ac9-46a5-9549-60ef51d572bf tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:12:10.397168 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-3dc0c223-1ac9-46a5-9549-60ef51d572bf tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:12:10.398480 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-3dc0c223-1ac9-46a5-9549-60ef51d572bf tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:12:10.399086 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-3dc0c223-1ac9-46a5-9549-60ef51d572bf tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:12:10.418789 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3dc0c223-1ac9-46a5-9549-60ef51d572bf tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:10.419619 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3dc0c223-1ac9-46a5-9549-60ef51d572bf tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:10.422639 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3dc0c223-1ac9-46a5-9549-60ef51d572bf tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:10.426557 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3dc0c223-1ac9-46a5-9549-60ef51d572bf tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:10.428371 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3dc0c223-1ac9-46a5-9549-60ef51d572bf tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:10.429821 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3dc0c223-1ac9-46a5-9549-60ef51d572bf tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:10.496422 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-3dc0c223-1ac9-46a5-9549-60ef51d572bf tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Getting quotas for project 08b8e89ba0a14188bac8e28b66b5a197. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:12:10.509163 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-48bc53f9-57ee-430b-9c33-4ef0a0ac0979 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76739eabf8804ec2af41abc4c1e6fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f22fb0ca7346c4ab225ce82d69118c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:10.522626 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-3dc0c223-1ac9-46a5-9549-60ef51d572bf tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Getting quotas for user 9e535f9274b24a9f800ea0c3d8faba5a and project 08b8e89ba0a14188bac8e28b66b5a197. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:12:10.526669 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-48bc53f9-57ee-430b-9c33-4ef0a0ac0979 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] 10.222.0.42 "GET /compute/v2.1/servers/534a7a12-774e-47ce-86d2-10b277d50c8f" status: 200 len: 1320 microversion: 2.1 time: 0.700997 Oct 23 01:12:10.528789 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 220/493] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:09 2022] GET /compute/v2.1/servers/534a7a12-774e-47ce-86d2-10b277d50c8f => generated 1320 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:10.550818 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-33db4478-a245-41c3-bb33-00834b929e9c tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:10.553737 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-33db4478-a245-41c3-bb33-00834b929e9c tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 46694c40-e6a6-48c1-a105-390bd0133d62] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:10.570684 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3dc0c223-1ac9-46a5-9549-60ef51d572bf tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:12:10.576646 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-33db4478-a245-41c3-bb33-00834b929e9c tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:10.578543 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-33db4478-a245-41c3-bb33-00834b929e9c tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:10.580669 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-33db4478-a245-41c3-bb33-00834b929e9c tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:10.582037 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3dc0c223-1ac9-46a5-9549-60ef51d572bf tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: f5fe429a-88b7-4d3d-975b-a10c725c4e2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:12:10.586224 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-33db4478-a245-41c3-bb33-00834b929e9c tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:10.588448 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-33db4478-a245-41c3-bb33-00834b929e9c tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:10.588448 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-33db4478-a245-41c3-bb33-00834b929e9c tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:10.766045 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3dc0c223-1ac9-46a5-9549-60ef51d572bf tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.584405 Oct 23 01:12:10.767790 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 274/494] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:12:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 1587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:12:10.774214 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-0bd41c36-2288-4682-a454-982cda51a5e4 req-b51dafa6-5440-4d4f-b5f7-e69a2f56f35f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc304d93-5c47-4830-af2c-bca071542590", "tag": "baef31c1-b065-44f5-818e-dbc3bbdd5ce4"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:12:10.791038 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-0bd41c36-2288-4682-a454-982cda51a5e4 req-b51dafa6-5440-4d4f-b5f7-e69a2f56f35f service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:10.792282 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-0bd41c36-2288-4682-a454-982cda51a5e4 req-b51dafa6-5440-4d4f-b5f7-e69a2f56f35f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:10.792956 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-0bd41c36-2288-4682-a454-982cda51a5e4 req-b51dafa6-5440-4d4f-b5f7-e69a2f56f35f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:10.816508 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-0bd41c36-2288-4682-a454-982cda51a5e4 req-b51dafa6-5440-4d4f-b5f7-e69a2f56f35f service nova] Creating event network-changed:baef31c1-b065-44f5-818e-dbc3bbdd5ce4 for instance bc304d93-5c47-4830-af2c-bca071542590 on n-h1-master-1 Oct 23 01:12:10.825854 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-0bd41c36-2288-4682-a454-982cda51a5e4 req-b51dafa6-5440-4d4f-b5f7-e69a2f56f35f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056109 Oct 23 01:12:10.827060 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 275/495] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:12:10.837795 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-941526e4-ea30-46f2-a849-81bda3b9a417 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:10.840815 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-941526e4-ea30-46f2-a849-81bda3b9a417 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:10.859537 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-941526e4-ea30-46f2-a849-81bda3b9a417 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:10.860034 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-941526e4-ea30-46f2-a849-81bda3b9a417 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:10.860477 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-941526e4-ea30-46f2-a849-81bda3b9a417 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:10.861188 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-941526e4-ea30-46f2-a849-81bda3b9a417 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:10.861643 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-941526e4-ea30-46f2-a849-81bda3b9a417 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:10.862098 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-941526e4-ea30-46f2-a849-81bda3b9a417 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:11.124698 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-33db4478-a245-41c3-bb33-00834b929e9c tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:11.157588 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-33db4478-a245-41c3-bb33-00834b929e9c tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/46694c40-e6a6-48c1-a105-390bd0133d62" status: 200 len: 1313 microversion: 2.1 time: 0.613261 Oct 23 01:12:11.166746 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 221/496] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:10 2022] GET /compute/v2.1/servers/46694c40-e6a6-48c1-a105-390bd0133d62 => generated 1313 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:11.172178 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e426405b-e71d-4dba-91ce-54069083696e tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:11.173451 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e426405b-e71d-4dba-91ce-54069083696e tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:11.180302 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e426405b-e71d-4dba-91ce-54069083696e tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:11.186392 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e426405b-e71d-4dba-91ce-54069083696e tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:11.186392 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e426405b-e71d-4dba-91ce-54069083696e tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:11.186392 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e426405b-e71d-4dba-91ce-54069083696e tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:11.186392 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e426405b-e71d-4dba-91ce-54069083696e tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:11.186725 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e426405b-e71d-4dba-91ce-54069083696e tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:11.312519 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-941526e4-ea30-46f2-a849-81bda3b9a417 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:11.315199 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e426405b-e71d-4dba-91ce-54069083696e tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:11.325410 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e426405b-e71d-4dba-91ce-54069083696e tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:11.326827 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-941526e4-ea30-46f2-a849-81bda3b9a417 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2" status: 200 len: 1313 microversion: 2.1 time: 0.495842 Oct 23 01:12:11.327749 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e426405b-e71d-4dba-91ce-54069083696e tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:11.342881 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e426405b-e71d-4dba-91ce-54069083696e tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1537 microversion: 2.91 time: 0.174124 Oct 23 01:12:11.343724 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 222/497] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:12:11 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1537 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:12:11.347997 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 276/498] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:10 2022] GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2 => generated 1313 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:11.352116 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-c1e3b504-0a6b-4c51-95c0-af8d63049e20 req-8a6b5f6a-da4e-4416-8cc9-062e2e8ec899 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46694c40-e6a6-48c1-a105-390bd0133d62", "name": "network-vif-plugged", "status": "completed", "tag": "650e2f7b-3221-4215-9990-463fd0ecbef4"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:12:11.364924 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-c1e3b504-0a6b-4c51-95c0-af8d63049e20 req-8a6b5f6a-da4e-4416-8cc9-062e2e8ec899 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:11.365885 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-c1e3b504-0a6b-4c51-95c0-af8d63049e20 req-8a6b5f6a-da4e-4416-8cc9-062e2e8ec899 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:11.366418 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-c1e3b504-0a6b-4c51-95c0-af8d63049e20 req-8a6b5f6a-da4e-4416-8cc9-062e2e8ec899 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:11.369610 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f91d1dcd-5565-4f2d-b895-c82702cb57ee tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:11.370359 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f91d1dcd-5565-4f2d-b895-c82702cb57ee tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: f5fe429a-88b7-4d3d-975b-a10c725c4e2f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:11.378668 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-c1e3b504-0a6b-4c51-95c0-af8d63049e20 req-8a6b5f6a-da4e-4416-8cc9-062e2e8ec899 service nova] Creating event network-vif-plugged:650e2f7b-3221-4215-9990-463fd0ecbef4 for instance 46694c40-e6a6-48c1-a105-390bd0133d62 on n-h1-master-1 Oct 23 01:12:11.388410 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-c1e3b504-0a6b-4c51-95c0-af8d63049e20 req-8a6b5f6a-da4e-4416-8cc9-062e2e8ec899 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040072 Oct 23 01:12:11.389598 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 223/499] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:12:11.395156 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e166313f-a8b4-4a15-9b49-6ed9d34f8ead tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:11.396146 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e166313f-a8b4-4a15-9b49-6ed9d34f8ead tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: bc304d93-5c47-4830-af2c-bca071542590] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:11.404932 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e166313f-a8b4-4a15-9b49-6ed9d34f8ead tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:11.405955 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e166313f-a8b4-4a15-9b49-6ed9d34f8ead tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:11.406899 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e166313f-a8b4-4a15-9b49-6ed9d34f8ead tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:11.407884 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e166313f-a8b4-4a15-9b49-6ed9d34f8ead tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:11.415663 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e166313f-a8b4-4a15-9b49-6ed9d34f8ead tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:11.416791 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e166313f-a8b4-4a15-9b49-6ed9d34f8ead tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:11.472749 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f91d1dcd-5565-4f2d-b895-c82702cb57ee tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e535f9274b24a9f800ea0c3d8faba5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b8e89ba0a14188bac8e28b66b5a197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:11.490662 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f91d1dcd-5565-4f2d-b895-c82702cb57ee tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "GET /compute/v2.1/servers/f5fe429a-88b7-4d3d-975b-a10c725c4e2f" status: 200 len: 1262 microversion: 2.1 time: 0.137047 Oct 23 01:12:11.492107 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 277/500] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:11 2022] GET /compute/v2.1/servers/f5fe429a-88b7-4d3d-975b-a10c725c4e2f => generated 1262 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:11.553412 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-281541d6-fcf9-4b99-8624-608332633d01 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:11.559672 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-281541d6-fcf9-4b99-8624-608332633d01 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] [instance: 534a7a12-774e-47ce-86d2-10b277d50c8f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:11.567648 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-281541d6-fcf9-4b99-8624-608332633d01 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:11.568392 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-281541d6-fcf9-4b99-8624-608332633d01 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:11.568984 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-281541d6-fcf9-4b99-8624-608332633d01 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:11.569881 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-281541d6-fcf9-4b99-8624-608332633d01 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:11.570540 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-281541d6-fcf9-4b99-8624-608332633d01 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:11.571253 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-281541d6-fcf9-4b99-8624-608332633d01 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:11.668675 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e166313f-a8b4-4a15-9b49-6ed9d34f8ead tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:11.679774 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e166313f-a8b4-4a15-9b49-6ed9d34f8ead tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590" status: 200 len: 1310 microversion: 2.1 time: 0.288704 Oct 23 01:12:11.681341 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 224/501] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:11 2022] GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590 => generated 1310 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:11.761771 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-281541d6-fcf9-4b99-8624-608332633d01 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76739eabf8804ec2af41abc4c1e6fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f22fb0ca7346c4ab225ce82d69118c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:11.770509 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-281541d6-fcf9-4b99-8624-608332633d01 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] 10.222.0.42 "GET /compute/v2.1/servers/534a7a12-774e-47ce-86d2-10b277d50c8f" status: 200 len: 1320 microversion: 2.1 time: 0.220787 Oct 23 01:12:11.788100 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 278/502] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:11 2022] GET /compute/v2.1/servers/534a7a12-774e-47ce-86d2-10b277d50c8f => generated 1320 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:12.191371 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9494ce4c-275f-48ff-b434-c4028ceb0a18 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:12.191371 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9494ce4c-275f-48ff-b434-c4028ceb0a18 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 46694c40-e6a6-48c1-a105-390bd0133d62] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:12.198930 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9494ce4c-275f-48ff-b434-c4028ceb0a18 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:12.199375 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9494ce4c-275f-48ff-b434-c4028ceb0a18 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:12.199872 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9494ce4c-275f-48ff-b434-c4028ceb0a18 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:12.201060 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9494ce4c-275f-48ff-b434-c4028ceb0a18 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:12.201929 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9494ce4c-275f-48ff-b434-c4028ceb0a18 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:12.202617 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9494ce4c-275f-48ff-b434-c4028ceb0a18 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:12.352590 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-249d7801-5beb-4b8b-9720-99c30396d269 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:12.353838 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-249d7801-5beb-4b8b-9720-99c30396d269 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:12.368116 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-249d7801-5beb-4b8b-9720-99c30396d269 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:12.370640 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-249d7801-5beb-4b8b-9720-99c30396d269 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:12.371490 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-249d7801-5beb-4b8b-9720-99c30396d269 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:12.372523 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-249d7801-5beb-4b8b-9720-99c30396d269 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:12.374442 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-249d7801-5beb-4b8b-9720-99c30396d269 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:12.375719 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-249d7801-5beb-4b8b-9720-99c30396d269 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:12.491470 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9494ce4c-275f-48ff-b434-c4028ceb0a18 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:12.502818 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9494ce4c-275f-48ff-b434-c4028ceb0a18 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/46694c40-e6a6-48c1-a105-390bd0133d62" status: 200 len: 1313 microversion: 2.1 time: 0.323676 Oct 23 01:12:12.504482 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 225/503] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:12 2022] GET /compute/v2.1/servers/46694c40-e6a6-48c1-a105-390bd0133d62 => generated 1313 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:12.514925 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-adca76d0-ec11-4133-954a-5aa2217286b6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:12.515779 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-adca76d0-ec11-4133-954a-5aa2217286b6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:12.523009 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-adca76d0-ec11-4133-954a-5aa2217286b6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:12.524236 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-adca76d0-ec11-4133-954a-5aa2217286b6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:12.526519 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-adca76d0-ec11-4133-954a-5aa2217286b6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:12.527561 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-adca76d0-ec11-4133-954a-5aa2217286b6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:12.528309 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-adca76d0-ec11-4133-954a-5aa2217286b6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:12.528986 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-adca76d0-ec11-4133-954a-5aa2217286b6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:12.627042 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-249d7801-5beb-4b8b-9720-99c30396d269 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:12.637897 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-249d7801-5beb-4b8b-9720-99c30396d269 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2" status: 200 len: 1313 microversion: 2.1 time: 0.290395 Oct 23 01:12:12.639289 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 279/504] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:12 2022] GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2 => generated 1313 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:12.644796 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3da43be1-f3ed-46de-a71c-b81ccce63f45 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:12.645641 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3da43be1-f3ed-46de-a71c-b81ccce63f45 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: f5fe429a-88b7-4d3d-975b-a10c725c4e2f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:12.652301 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3da43be1-f3ed-46de-a71c-b81ccce63f45 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:12.653046 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3da43be1-f3ed-46de-a71c-b81ccce63f45 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:12.653630 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3da43be1-f3ed-46de-a71c-b81ccce63f45 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:12.654524 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3da43be1-f3ed-46de-a71c-b81ccce63f45 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:12.655388 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3da43be1-f3ed-46de-a71c-b81ccce63f45 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:12.656061 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3da43be1-f3ed-46de-a71c-b81ccce63f45 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:12.678455 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-adca76d0-ec11-4133-954a-5aa2217286b6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:12.693456 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-adca76d0-ec11-4133-954a-5aa2217286b6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:12.695232 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-adca76d0-ec11-4133-954a-5aa2217286b6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:12.701424 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-adca76d0-ec11-4133-954a-5aa2217286b6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1537 microversion: 2.91 time: 0.195692 Oct 23 01:12:12.702719 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 226/505] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:12:12 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1537 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:12:12.707497 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9a7f5159-5a53-43fc-8165-70470dacfafe tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:12.708318 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9a7f5159-5a53-43fc-8165-70470dacfafe tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: bc304d93-5c47-4830-af2c-bca071542590] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:12.748567 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9a7f5159-5a53-43fc-8165-70470dacfafe tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:12.749481 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9a7f5159-5a53-43fc-8165-70470dacfafe tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:12.750398 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9a7f5159-5a53-43fc-8165-70470dacfafe tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:12.751392 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9a7f5159-5a53-43fc-8165-70470dacfafe tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:12.752088 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9a7f5159-5a53-43fc-8165-70470dacfafe tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:12.753648 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9a7f5159-5a53-43fc-8165-70470dacfafe tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:12.755216 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=28 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:12.770029 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3da43be1-f3ed-46de-a71c-b81ccce63f45 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e535f9274b24a9f800ea0c3d8faba5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b8e89ba0a14188bac8e28b66b5a197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:12.782366 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3da43be1-f3ed-46de-a71c-b81ccce63f45 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "GET /compute/v2.1/servers/f5fe429a-88b7-4d3d-975b-a10c725c4e2f" status: 200 len: 1258 microversion: 2.1 time: 0.140448 Oct 23 01:12:12.786324 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 280/506] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:12 2022] GET /compute/v2.1/servers/f5fe429a-88b7-4d3d-975b-a10c725c4e2f => generated 1258 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:12.805433 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-10fdc985-7cb7-48fd-b66e-38cd0758aba8 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:12.806474 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-10fdc985-7cb7-48fd-b66e-38cd0758aba8 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] [instance: 534a7a12-774e-47ce-86d2-10b277d50c8f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:12.813800 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10fdc985-7cb7-48fd-b66e-38cd0758aba8 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:12.814874 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10fdc985-7cb7-48fd-b66e-38cd0758aba8 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:12.815533 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10fdc985-7cb7-48fd-b66e-38cd0758aba8 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:12.816329 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10fdc985-7cb7-48fd-b66e-38cd0758aba8 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:12.817131 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10fdc985-7cb7-48fd-b66e-38cd0758aba8 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:12.817545 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10fdc985-7cb7-48fd-b66e-38cd0758aba8 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:13.010911 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9a7f5159-5a53-43fc-8165-70470dacfafe tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:13.021048 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9a7f5159-5a53-43fc-8165-70470dacfafe tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590" status: 200 len: 1310 microversion: 2.1 time: 0.316992 Oct 23 01:12:13.023816 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 227/507] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:12 2022] GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590 => generated 1310 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:13.036415 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-10fdc985-7cb7-48fd-b66e-38cd0758aba8 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76739eabf8804ec2af41abc4c1e6fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f22fb0ca7346c4ab225ce82d69118c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:13.055327 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-10fdc985-7cb7-48fd-b66e-38cd0758aba8 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] 10.222.0.42 "GET /compute/v2.1/servers/534a7a12-774e-47ce-86d2-10b277d50c8f" status: 200 len: 1320 microversion: 2.1 time: 0.254840 Oct 23 01:12:13.056482 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 281/508] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:12 2022] GET /compute/v2.1/servers/534a7a12-774e-47ce-86d2-10b277d50c8f => generated 1320 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:12:13.427969 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-cec3a5e7-b9fe-46bd-866c-e8586a294188 req-05da2260-b485-4921-b460-6f448a4a2863 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb", "name": "network-vif-unplugged", "status": "completed", "tag": "a79fbfc6-98c3-46eb-9803-c40ceb7ed7bd"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:12:13.453381 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-cec3a5e7-b9fe-46bd-866c-e8586a294188 req-05da2260-b485-4921-b460-6f448a4a2863 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:13.454519 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-cec3a5e7-b9fe-46bd-866c-e8586a294188 req-05da2260-b485-4921-b460-6f448a4a2863 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:13.455778 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-cec3a5e7-b9fe-46bd-866c-e8586a294188 req-05da2260-b485-4921-b460-6f448a4a2863 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:13.500241 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-cec3a5e7-b9fe-46bd-866c-e8586a294188 req-05da2260-b485-4921-b460-6f448a4a2863 service nova] Creating event network-vif-unplugged:a79fbfc6-98c3-46eb-9803-c40ceb7ed7bd for instance 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb on n-h2-master-1 Oct 23 01:12:13.521444 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-cec3a5e7-b9fe-46bd-866c-e8586a294188 req-05da2260-b485-4921-b460-6f448a4a2863 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096599 Oct 23 01:12:13.524526 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 228/509] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:12:13.527693 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e6aa7dc9-3c89-4f69-950d-954d85e2b5b9 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:13.528306 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e6aa7dc9-3c89-4f69-950d-954d85e2b5b9 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 46694c40-e6a6-48c1-a105-390bd0133d62] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:13.541126 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6aa7dc9-3c89-4f69-950d-954d85e2b5b9 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:13.541126 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6aa7dc9-3c89-4f69-950d-954d85e2b5b9 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:13.542215 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6aa7dc9-3c89-4f69-950d-954d85e2b5b9 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:13.548116 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6aa7dc9-3c89-4f69-950d-954d85e2b5b9 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:13.549567 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6aa7dc9-3c89-4f69-950d-954d85e2b5b9 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:13.550010 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6aa7dc9-3c89-4f69-950d-954d85e2b5b9 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:13.597253 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-8f560971-d055-4e53-bb4c-3d03c4d66e51 req-fecb5af1-3225-4645-96c0-658a41d0cc72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb", "name": "network-vif-deleted", "tag": "a79fbfc6-98c3-46eb-9803-c40ceb7ed7bd"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:12:13.620670 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-8f560971-d055-4e53-bb4c-3d03c4d66e51 req-fecb5af1-3225-4645-96c0-658a41d0cc72 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:13.622275 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-8f560971-d055-4e53-bb4c-3d03c4d66e51 req-fecb5af1-3225-4645-96c0-658a41d0cc72 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:13.624860 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-8f560971-d055-4e53-bb4c-3d03c4d66e51 req-fecb5af1-3225-4645-96c0-658a41d0cc72 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:13.652189 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-8f560971-d055-4e53-bb4c-3d03c4d66e51 req-fecb5af1-3225-4645-96c0-658a41d0cc72 service nova] Creating event network-vif-deleted:a79fbfc6-98c3-46eb-9803-c40ceb7ed7bd for instance 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb on n-h2-master-1 Oct 23 01:12:13.667747 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-8f560971-d055-4e53-bb4c-3d03c4d66e51 req-fecb5af1-3225-4645-96c0-658a41d0cc72 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074482 Oct 23 01:12:13.671416 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 229/510] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:12:13.703812 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-eafba3b5-93d7-4f88-959a-1f1e3a03a1f1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:13.705570 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-eafba3b5-93d7-4f88-959a-1f1e3a03a1f1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:13.725099 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eafba3b5-93d7-4f88-959a-1f1e3a03a1f1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:13.725843 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eafba3b5-93d7-4f88-959a-1f1e3a03a1f1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:13.727315 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eafba3b5-93d7-4f88-959a-1f1e3a03a1f1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:13.730666 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eafba3b5-93d7-4f88-959a-1f1e3a03a1f1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:13.733204 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eafba3b5-93d7-4f88-959a-1f1e3a03a1f1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:13.733750 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eafba3b5-93d7-4f88-959a-1f1e3a03a1f1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:14.109635 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-eafba3b5-93d7-4f88-959a-1f1e3a03a1f1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:14.130366 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-eafba3b5-93d7-4f88-959a-1f1e3a03a1f1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2" status: 200 len: 1313 microversion: 2.1 time: 0.453138 Oct 23 01:12:14.151155 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 230/511] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:13 2022] GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2 => generated 1313 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:14.167572 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0b4eac99-3ecc-4500-9016-09b325b9c10f tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:14.168507 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0b4eac99-3ecc-4500-9016-09b325b9c10f tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:14.201907 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b4eac99-3ecc-4500-9016-09b325b9c10f tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:14.203556 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b4eac99-3ecc-4500-9016-09b325b9c10f tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:14.206006 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b4eac99-3ecc-4500-9016-09b325b9c10f tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:14.211010 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b4eac99-3ecc-4500-9016-09b325b9c10f tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:14.214192 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b4eac99-3ecc-4500-9016-09b325b9c10f tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:14.216955 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b4eac99-3ecc-4500-9016-09b325b9c10f tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:14.294382 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e6aa7dc9-3c89-4f69-950d-954d85e2b5b9 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:14.307091 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e6aa7dc9-3c89-4f69-950d-954d85e2b5b9 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/46694c40-e6a6-48c1-a105-390bd0133d62" status: 200 len: 1313 microversion: 2.1 time: 0.783095 Oct 23 01:12:14.310621 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 282/512] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:13 2022] GET /compute/v2.1/servers/46694c40-e6a6-48c1-a105-390bd0133d62 => generated 1313 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:12:14.326473 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a449b710-5dbe-4590-8443-ee03207df89e tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:14.331057 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a449b710-5dbe-4590-8443-ee03207df89e tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: f5fe429a-88b7-4d3d-975b-a10c725c4e2f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:14.346879 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a449b710-5dbe-4590-8443-ee03207df89e tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:14.348729 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a449b710-5dbe-4590-8443-ee03207df89e tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:14.349648 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a449b710-5dbe-4590-8443-ee03207df89e tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:14.352079 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a449b710-5dbe-4590-8443-ee03207df89e tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:14.353654 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a449b710-5dbe-4590-8443-ee03207df89e tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:14.354885 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a449b710-5dbe-4590-8443-ee03207df89e tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:14.711645 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0b4eac99-3ecc-4500-9016-09b325b9c10f tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:14.727897 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0b4eac99-3ecc-4500-9016-09b325b9c10f tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:14.731569 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0b4eac99-3ecc-4500-9016-09b325b9c10f tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:14.737851 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a449b710-5dbe-4590-8443-ee03207df89e tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e535f9274b24a9f800ea0c3d8faba5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b8e89ba0a14188bac8e28b66b5a197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:14.745427 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0b4eac99-3ecc-4500-9016-09b325b9c10f tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1537 microversion: 2.91 time: 0.589512 Oct 23 01:12:14.747088 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a449b710-5dbe-4590-8443-ee03207df89e tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "GET /compute/v2.1/servers/f5fe429a-88b7-4d3d-975b-a10c725c4e2f" status: 200 len: 1322 microversion: 2.1 time: 0.435152 Oct 23 01:12:14.747690 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 283/513] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:14 2022] GET /compute/v2.1/servers/f5fe429a-88b7-4d3d-975b-a10c725c4e2f => generated 1322 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:14.748160 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 231/514] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:12:14 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1537 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:12:14.756092 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1307c536-a2de-45e1-a4ee-64775177e041 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:14.756811 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1307c536-a2de-45e1-a4ee-64775177e041 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] [instance: 534a7a12-774e-47ce-86d2-10b277d50c8f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:14.772481 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-dac19948-702e-45fa-a496-1837b6d069be tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:14.773361 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-dac19948-702e-45fa-a496-1837b6d069be tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: bc304d93-5c47-4830-af2c-bca071542590] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:14.774881 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1307c536-a2de-45e1-a4ee-64775177e041 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:14.782587 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1307c536-a2de-45e1-a4ee-64775177e041 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:14.783448 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1307c536-a2de-45e1-a4ee-64775177e041 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:14.784268 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1307c536-a2de-45e1-a4ee-64775177e041 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:14.784809 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1307c536-a2de-45e1-a4ee-64775177e041 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:14.785325 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1307c536-a2de-45e1-a4ee-64775177e041 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:14.794053 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dac19948-702e-45fa-a496-1837b6d069be tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:14.794825 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dac19948-702e-45fa-a496-1837b6d069be tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:14.798380 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dac19948-702e-45fa-a496-1837b6d069be tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:14.799360 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dac19948-702e-45fa-a496-1837b6d069be tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:14.800040 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dac19948-702e-45fa-a496-1837b6d069be tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:14.801664 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dac19948-702e-45fa-a496-1837b6d069be tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:15.286454 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1307c536-a2de-45e1-a4ee-64775177e041 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76739eabf8804ec2af41abc4c1e6fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f22fb0ca7346c4ab225ce82d69118c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:15.298790 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1307c536-a2de-45e1-a4ee-64775177e041 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] 10.222.0.42 "GET /compute/v2.1/servers/534a7a12-774e-47ce-86d2-10b277d50c8f" status: 200 len: 1320 microversion: 2.1 time: 0.549198 Oct 23 01:12:15.314055 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 232/515] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:14 2022] GET /compute/v2.1/servers/534a7a12-774e-47ce-86d2-10b277d50c8f => generated 1320 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:15.314055 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-77a13882-6da9-474a-8f1b-dd2390800dd7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:15.314055 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-77a13882-6da9-474a-8f1b-dd2390800dd7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:15.328206 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-77a13882-6da9-474a-8f1b-dd2390800dd7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:15.328716 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-77a13882-6da9-474a-8f1b-dd2390800dd7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:15.331159 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-77a13882-6da9-474a-8f1b-dd2390800dd7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:15.331917 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-77a13882-6da9-474a-8f1b-dd2390800dd7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:15.332462 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-77a13882-6da9-474a-8f1b-dd2390800dd7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:15.332802 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-77a13882-6da9-474a-8f1b-dd2390800dd7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:15.369622 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-dac19948-702e-45fa-a496-1837b6d069be tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:15.382405 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-dac19948-702e-45fa-a496-1837b6d069be tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590" status: 200 len: 1310 microversion: 2.1 time: 0.633636 Oct 23 01:12:15.382988 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 284/516] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:14 2022] GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590 => generated 1310 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:15.410448 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-61ebb654-bf91-4ec3-a0eb-65eea5d5f08d tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:15.411076 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-61ebb654-bf91-4ec3-a0eb-65eea5d5f08d tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 46694c40-e6a6-48c1-a105-390bd0133d62] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:15.418115 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61ebb654-bf91-4ec3-a0eb-65eea5d5f08d tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:15.418885 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61ebb654-bf91-4ec3-a0eb-65eea5d5f08d tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:15.423464 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61ebb654-bf91-4ec3-a0eb-65eea5d5f08d tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:15.423464 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61ebb654-bf91-4ec3-a0eb-65eea5d5f08d tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:15.423464 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61ebb654-bf91-4ec3-a0eb-65eea5d5f08d tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:15.423464 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61ebb654-bf91-4ec3-a0eb-65eea5d5f08d tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:16.231816 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-77a13882-6da9-474a-8f1b-dd2390800dd7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:16.249089 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-77a13882-6da9-474a-8f1b-dd2390800dd7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2" status: 200 len: 1313 microversion: 2.1 time: 0.948159 Oct 23 01:12:16.263823 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 233/517] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:15 2022] GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2 => generated 1313 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:16.263823 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8c2e21e3-25d3-4bd1-a685-1336cef3338d tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:16.263823 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8c2e21e3-25d3-4bd1-a685-1336cef3338d tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: f5fe429a-88b7-4d3d-975b-a10c725c4e2f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:16.277666 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c2e21e3-25d3-4bd1-a685-1336cef3338d tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:16.278218 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c2e21e3-25d3-4bd1-a685-1336cef3338d tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:16.278664 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c2e21e3-25d3-4bd1-a685-1336cef3338d tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:16.279396 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c2e21e3-25d3-4bd1-a685-1336cef3338d tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:16.282096 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c2e21e3-25d3-4bd1-a685-1336cef3338d tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:16.285796 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c2e21e3-25d3-4bd1-a685-1336cef3338d tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:16.429240 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8c2e21e3-25d3-4bd1-a685-1336cef3338d tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e535f9274b24a9f800ea0c3d8faba5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b8e89ba0a14188bac8e28b66b5a197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:16.440511 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8c2e21e3-25d3-4bd1-a685-1336cef3338d tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "GET /compute/v2.1/servers/f5fe429a-88b7-4d3d-975b-a10c725c4e2f" status: 200 len: 1320 microversion: 2.1 time: 0.189265 Oct 23 01:12:16.441316 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 234/518] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:16 2022] GET /compute/v2.1/servers/f5fe429a-88b7-4d3d-975b-a10c725c4e2f => generated 1320 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:16.449217 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b13ed8ab-9921-4e63-ab6b-42ce8f23524c tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:16.449462 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-61ebb654-bf91-4ec3-a0eb-65eea5d5f08d tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:16.450705 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b13ed8ab-9921-4e63-ab6b-42ce8f23524c tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:16.458672 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b13ed8ab-9921-4e63-ab6b-42ce8f23524c tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:16.459410 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b13ed8ab-9921-4e63-ab6b-42ce8f23524c tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:16.460266 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b13ed8ab-9921-4e63-ab6b-42ce8f23524c tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:16.461231 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b13ed8ab-9921-4e63-ab6b-42ce8f23524c tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:16.461512 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-61ebb654-bf91-4ec3-a0eb-65eea5d5f08d tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/46694c40-e6a6-48c1-a105-390bd0133d62" status: 200 len: 1462 microversion: 2.1 time: 1.070350 Oct 23 01:12:16.462049 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b13ed8ab-9921-4e63-ab6b-42ce8f23524c tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:16.462642 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b13ed8ab-9921-4e63-ab6b-42ce8f23524c tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:16.482125 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 285/519] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:15 2022] GET /compute/v2.1/servers/46694c40-e6a6-48c1-a105-390bd0133d62 => generated 1462 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:16.491053 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-a0f35b8a-68b2-4689-9439-1fc1373a2c86 req-dc0694e2-6bf2-406f-be2f-f6ea004ed5c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ae2878c-23a6-4e78-bd92-69fb03fc27b2", "name": "network-vif-plugged", "status": "completed", "tag": "9915372e-5565-43b8-b511-9fbf12974675"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:12:16.519722 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-a0f35b8a-68b2-4689-9439-1fc1373a2c86 req-dc0694e2-6bf2-406f-be2f-f6ea004ed5c7 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:16.520555 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-a0f35b8a-68b2-4689-9439-1fc1373a2c86 req-dc0694e2-6bf2-406f-be2f-f6ea004ed5c7 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:16.521762 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-a0f35b8a-68b2-4689-9439-1fc1373a2c86 req-dc0694e2-6bf2-406f-be2f-f6ea004ed5c7 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:16.559716 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-a0f35b8a-68b2-4689-9439-1fc1373a2c86 req-dc0694e2-6bf2-406f-be2f-f6ea004ed5c7 service nova] Creating event network-vif-plugged:9915372e-5565-43b8-b511-9fbf12974675 for instance 4ae2878c-23a6-4e78-bd92-69fb03fc27b2 on n-h2-master-1 Oct 23 01:12:16.574073 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-a0f35b8a-68b2-4689-9439-1fc1373a2c86 req-dc0694e2-6bf2-406f-be2f-f6ea004ed5c7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105372 Oct 23 01:12:16.575055 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 286/520] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:12:16.583269 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7a3c5121-b321-4fef-8260-4cbf886824c4 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:16.584162 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7a3c5121-b321-4fef-8260-4cbf886824c4 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] [instance: 534a7a12-774e-47ce-86d2-10b277d50c8f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:16.594184 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a3c5121-b321-4fef-8260-4cbf886824c4 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:16.594688 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a3c5121-b321-4fef-8260-4cbf886824c4 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:16.595122 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a3c5121-b321-4fef-8260-4cbf886824c4 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:16.595832 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a3c5121-b321-4fef-8260-4cbf886824c4 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:16.596286 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a3c5121-b321-4fef-8260-4cbf886824c4 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:16.596857 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a3c5121-b321-4fef-8260-4cbf886824c4 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:16.621275 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b13ed8ab-9921-4e63-ab6b-42ce8f23524c tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:16.643701 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b13ed8ab-9921-4e63-ab6b-42ce8f23524c tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:16.645524 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b13ed8ab-9921-4e63-ab6b-42ce8f23524c tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:16.685850 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b13ed8ab-9921-4e63-ab6b-42ce8f23524c tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1537 microversion: 2.91 time: 0.243123 Oct 23 01:12:16.690015 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 235/521] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:12:16 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1537 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:12:16.702516 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-eb60fdfc-5b14-4362-a656-a9be529ecc7e tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:16.705439 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-eb60fdfc-5b14-4362-a656-a9be529ecc7e tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: bc304d93-5c47-4830-af2c-bca071542590] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:16.720401 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb60fdfc-5b14-4362-a656-a9be529ecc7e tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:16.720911 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb60fdfc-5b14-4362-a656-a9be529ecc7e tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:16.721359 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb60fdfc-5b14-4362-a656-a9be529ecc7e tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:16.722687 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb60fdfc-5b14-4362-a656-a9be529ecc7e tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:16.723162 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb60fdfc-5b14-4362-a656-a9be529ecc7e tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:16.723594 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb60fdfc-5b14-4362-a656-a9be529ecc7e tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:16.785681 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=100 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:17.099832 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7a3c5121-b321-4fef-8260-4cbf886824c4 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76739eabf8804ec2af41abc4c1e6fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f22fb0ca7346c4ab225ce82d69118c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:17.110273 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7a3c5121-b321-4fef-8260-4cbf886824c4 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] 10.222.0.42 "GET /compute/v2.1/servers/534a7a12-774e-47ce-86d2-10b277d50c8f" status: 200 len: 1320 microversion: 2.1 time: 0.533265 Oct 23 01:12:17.130027 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 287/522] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:16 2022] GET /compute/v2.1/servers/534a7a12-774e-47ce-86d2-10b277d50c8f => generated 1320 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:17.136099 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-807929bf-75e9-44f5-8c93-72c24f2e0b45 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:17.137112 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-807929bf-75e9-44f5-8c93-72c24f2e0b45 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f277484-b3ae-465e-90b7-8febafef9329] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:17.144569 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-807929bf-75e9-44f5-8c93-72c24f2e0b45 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:17.145276 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-807929bf-75e9-44f5-8c93-72c24f2e0b45 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:17.145867 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-807929bf-75e9-44f5-8c93-72c24f2e0b45 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:17.150990 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-807929bf-75e9-44f5-8c93-72c24f2e0b45 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:17.150990 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-807929bf-75e9-44f5-8c93-72c24f2e0b45 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:17.150990 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-807929bf-75e9-44f5-8c93-72c24f2e0b45 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:17.180684 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-eb60fdfc-5b14-4362-a656-a9be529ecc7e tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:17.194305 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-eb60fdfc-5b14-4362-a656-a9be529ecc7e tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590" status: 200 len: 1310 microversion: 2.1 time: 0.497092 Oct 23 01:12:17.205406 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 236/523] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:16 2022] GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590 => generated 1310 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:17.280446 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8b3b3282-9bec-4463-944a-c951e4b6bcd3 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:17.281884 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8b3b3282-9bec-4463-944a-c951e4b6bcd3 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:17.289660 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8b3b3282-9bec-4463-944a-c951e4b6bcd3 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:17.290578 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8b3b3282-9bec-4463-944a-c951e4b6bcd3 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:17.292172 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8b3b3282-9bec-4463-944a-c951e4b6bcd3 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:17.293366 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8b3b3282-9bec-4463-944a-c951e4b6bcd3 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:17.294097 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8b3b3282-9bec-4463-944a-c951e4b6bcd3 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:17.294808 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8b3b3282-9bec-4463-944a-c951e4b6bcd3 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:17.420867 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-807929bf-75e9-44f5-8c93-72c24f2e0b45 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:17.450066 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-807929bf-75e9-44f5-8c93-72c24f2e0b45 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329" status: 200 len: 1463 microversion: 2.1 time: 0.299147 Oct 23 01:12:17.450066 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 288/524] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:17 2022] GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329 => generated 1463 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:17.472097 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-665431b5-4da4-49be-b1d9-d8391566d951 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:17.473469 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-665431b5-4da4-49be-b1d9-d8391566d951 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: f5fe429a-88b7-4d3d-975b-a10c725c4e2f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:17.487794 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-665431b5-4da4-49be-b1d9-d8391566d951 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:17.488865 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-665431b5-4da4-49be-b1d9-d8391566d951 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:17.495882 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-665431b5-4da4-49be-b1d9-d8391566d951 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:17.495882 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-665431b5-4da4-49be-b1d9-d8391566d951 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:17.495882 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-665431b5-4da4-49be-b1d9-d8391566d951 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:17.495882 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-665431b5-4da4-49be-b1d9-d8391566d951 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:17.498821 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8b3b3282-9bec-4463-944a-c951e4b6bcd3 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:17.508228 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8b3b3282-9bec-4463-944a-c951e4b6bcd3 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2" status: 200 len: 1313 microversion: 2.1 time: 0.231403 Oct 23 01:12:17.509298 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 237/525] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:17 2022] GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2 => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:12:17.617903 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e388ed3c-f842-4425-a965-29994ceb94a1 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1326028963", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "8f277484-b3ae-465e-90b7-8febafef9329"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:12:17.700387 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-e388ed3c-f842-4425-a965-29994ceb94a1 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] validate_networks() for None {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:12:17.839470 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-665431b5-4da4-49be-b1d9-d8391566d951 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e535f9274b24a9f800ea0c3d8faba5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b8e89ba0a14188bac8e28b66b5a197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:17.850958 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-665431b5-4da4-49be-b1d9-d8391566d951 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "GET /compute/v2.1/servers/f5fe429a-88b7-4d3d-975b-a10c725c4e2f" status: 200 len: 1388 microversion: 2.1 time: 0.385324 Oct 23 01:12:17.854877 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 289/526] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:17 2022] GET /compute/v2.1/servers/f5fe429a-88b7-4d3d-975b-a10c725c4e2f => generated 1388 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:17.861301 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-41df604b-1fca-4a8d-a9ff-e0ab6769da99 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:17.862411 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-41df604b-1fca-4a8d-a9ff-e0ab6769da99 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:17.876058 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-41df604b-1fca-4a8d-a9ff-e0ab6769da99 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:17.880632 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-41df604b-1fca-4a8d-a9ff-e0ab6769da99 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:17.881297 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-41df604b-1fca-4a8d-a9ff-e0ab6769da99 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:17.884212 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-41df604b-1fca-4a8d-a9ff-e0ab6769da99 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:17.884212 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-41df604b-1fca-4a8d-a9ff-e0ab6769da99 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:17.884212 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-41df604b-1fca-4a8d-a9ff-e0ab6769da99 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:18.053495 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-41df604b-1fca-4a8d-a9ff-e0ab6769da99 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:18.065185 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-41df604b-1fca-4a8d-a9ff-e0ab6769da99 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:18.070629 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-41df604b-1fca-4a8d-a9ff-e0ab6769da99 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:18.096630 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:18.105114 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-41df604b-1fca-4a8d-a9ff-e0ab6769da99 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1537 microversion: 2.91 time: 0.248827 Oct 23 01:12:18.106220 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 290/527] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:12:17 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1537 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:12:18.137606 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fc85aa1c-bb1e-45cf-a1bf-044d0cc73cb7 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:18.138367 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-fc85aa1c-bb1e-45cf-a1bf-044d0cc73cb7 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] [instance: 534a7a12-774e-47ce-86d2-10b277d50c8f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:18.151981 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc85aa1c-bb1e-45cf-a1bf-044d0cc73cb7 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:18.152343 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc85aa1c-bb1e-45cf-a1bf-044d0cc73cb7 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:18.152978 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc85aa1c-bb1e-45cf-a1bf-044d0cc73cb7 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:18.158025 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc85aa1c-bb1e-45cf-a1bf-044d0cc73cb7 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:18.158507 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc85aa1c-bb1e-45cf-a1bf-044d0cc73cb7 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:18.158939 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc85aa1c-bb1e-45cf-a1bf-044d0cc73cb7 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:18.388978 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-e388ed3c-f842-4425-a965-29994ceb94a1 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:12:18.389491 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-e388ed3c-f842-4425-a965-29994ceb94a1 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:12:18.389859 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-e388ed3c-f842-4425-a965-29994ceb94a1 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:12:18.390374 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-e388ed3c-f842-4425-a965-29994ceb94a1 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:12:18.390783 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-e388ed3c-f842-4425-a965-29994ceb94a1 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:12:18.405138 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e388ed3c-f842-4425-a965-29994ceb94a1 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:18.405832 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e388ed3c-f842-4425-a965-29994ceb94a1 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:18.407094 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e388ed3c-f842-4425-a965-29994ceb94a1 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:18.408165 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e388ed3c-f842-4425-a965-29994ceb94a1 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:18.409537 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e388ed3c-f842-4425-a965-29994ceb94a1 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:18.410154 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e388ed3c-f842-4425-a965-29994ceb94a1 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:18.452360 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-fc85aa1c-bb1e-45cf-a1bf-044d0cc73cb7 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76739eabf8804ec2af41abc4c1e6fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f22fb0ca7346c4ab225ce82d69118c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:18.467891 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fc85aa1c-bb1e-45cf-a1bf-044d0cc73cb7 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] 10.222.0.42 "GET /compute/v2.1/servers/534a7a12-774e-47ce-86d2-10b277d50c8f" status: 200 len: 1320 microversion: 2.1 time: 0.331451 Oct 23 01:12:18.468755 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 291/528] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:18 2022] GET /compute/v2.1/servers/534a7a12-774e-47ce-86d2-10b277d50c8f => generated 1320 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:12:18.479914 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-e388ed3c-f842-4425-a965-29994ceb94a1 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Getting quotas for project e6bf637f9ea9423cb3e4e2c74d0382a7. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:12:18.482367 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ad3a19e0-9c6b-48f7-929b-b5dfd809287d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:18.488006 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ad3a19e0-9c6b-48f7-929b-b5dfd809287d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: bc304d93-5c47-4830-af2c-bca071542590] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:18.496010 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-e388ed3c-f842-4425-a965-29994ceb94a1 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Getting quotas for user 275cdb98ca7a48f68441d6c934740df0 and project e6bf637f9ea9423cb3e4e2c74d0382a7. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:12:18.501738 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ad3a19e0-9c6b-48f7-929b-b5dfd809287d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:18.502258 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ad3a19e0-9c6b-48f7-929b-b5dfd809287d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:18.502783 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ad3a19e0-9c6b-48f7-929b-b5dfd809287d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:18.503370 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ad3a19e0-9c6b-48f7-929b-b5dfd809287d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:18.503821 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ad3a19e0-9c6b-48f7-929b-b5dfd809287d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:18.504233 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ad3a19e0-9c6b-48f7-929b-b5dfd809287d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:18.532269 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e388ed3c-f842-4425-a965-29994ceb94a1 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:12:18.536934 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e388ed3c-f842-4425-a965-29994ceb94a1 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f2a1666-1481-4519-9e9a-41909cd03da6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:12:18.932568 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ad3a19e0-9c6b-48f7-929b-b5dfd809287d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:18.932568 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ad3a19e0-9c6b-48f7-929b-b5dfd809287d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590" status: 200 len: 1310 microversion: 2.1 time: 0.272220 Oct 23 01:12:18.932568 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 292/529] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:18 2022] GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590 => generated 1310 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:18.932568 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-800fbf6a-ad57-4df0-8583-2060e9f002ab req-a7cea1b9-a94b-4a8d-9214-22d9ee16380d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5fe429a-88b7-4d3d-975b-a10c725c4e2f", "tag": "ddf48485-558f-40c5-9932-d78ea427f0f3"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:12:18.934779 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e388ed3c-f842-4425-a965-29994ceb94a1 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.153006 Oct 23 01:12:18.934779 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 238/530] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:12:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1155 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 23 01:12:18.934779 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0f94cb7c-8758-43bf-915c-5e9e4b688376 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:18.934779 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0f94cb7c-8758-43bf-915c-5e9e4b688376 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:18.935755 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-800fbf6a-ad57-4df0-8583-2060e9f002ab req-a7cea1b9-a94b-4a8d-9214-22d9ee16380d service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:18.935755 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-800fbf6a-ad57-4df0-8583-2060e9f002ab req-a7cea1b9-a94b-4a8d-9214-22d9ee16380d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:18.935755 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-800fbf6a-ad57-4df0-8583-2060e9f002ab req-a7cea1b9-a94b-4a8d-9214-22d9ee16380d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:18.938095 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0f94cb7c-8758-43bf-915c-5e9e4b688376 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:18.938095 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0f94cb7c-8758-43bf-915c-5e9e4b688376 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:18.938095 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0f94cb7c-8758-43bf-915c-5e9e4b688376 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:18.938095 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0f94cb7c-8758-43bf-915c-5e9e4b688376 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:18.939632 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0f94cb7c-8758-43bf-915c-5e9e4b688376 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:18.939632 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0f94cb7c-8758-43bf-915c-5e9e4b688376 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:18.939884 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-800fbf6a-ad57-4df0-8583-2060e9f002ab req-a7cea1b9-a94b-4a8d-9214-22d9ee16380d service nova] Creating event network-changed:ddf48485-558f-40c5-9932-d78ea427f0f3 for instance f5fe429a-88b7-4d3d-975b-a10c725c4e2f on n-h2-master-1 Oct 23 01:12:18.939884 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-800fbf6a-ad57-4df0-8583-2060e9f002ab req-a7cea1b9-a94b-4a8d-9214-22d9ee16380d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034250 Oct 23 01:12:18.939884 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 293/531] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:12:18.939884 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-ee0a4d47-880f-45b8-a332-49462312704a req-4e14e96b-b1bb-4fdc-97ff-08cb1493fdc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "534a7a12-774e-47ce-86d2-10b277d50c8f", "name": "network-vif-plugged", "status": "completed", "tag": "b7663a27-79ce-4333-a4c4-dd22f8184032"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:12:18.939884 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ee0a4d47-880f-45b8-a332-49462312704a req-4e14e96b-b1bb-4fdc-97ff-08cb1493fdc9 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:18.940526 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ee0a4d47-880f-45b8-a332-49462312704a req-4e14e96b-b1bb-4fdc-97ff-08cb1493fdc9 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:18.940526 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ee0a4d47-880f-45b8-a332-49462312704a req-4e14e96b-b1bb-4fdc-97ff-08cb1493fdc9 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:18.940526 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=100 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:18.940526 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-ee0a4d47-880f-45b8-a332-49462312704a req-4e14e96b-b1bb-4fdc-97ff-08cb1493fdc9 service nova] Creating event network-vif-plugged:b7663a27-79ce-4333-a4c4-dd22f8184032 for instance 534a7a12-774e-47ce-86d2-10b277d50c8f on n-h1-master-1 Oct 23 01:12:18.940526 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-ee0a4d47-880f-45b8-a332-49462312704a req-4e14e96b-b1bb-4fdc-97ff-08cb1493fdc9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034669 Oct 23 01:12:18.940526 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 294/532] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:12:18.941165 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2dd69eed-bfeb-4cfb-b6da-e362433f8223 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:18.941165 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2dd69eed-bfeb-4cfb-b6da-e362433f8223 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: f5fe429a-88b7-4d3d-975b-a10c725c4e2f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:18.941165 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2dd69eed-bfeb-4cfb-b6da-e362433f8223 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:18.941165 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2dd69eed-bfeb-4cfb-b6da-e362433f8223 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:18.941478 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2dd69eed-bfeb-4cfb-b6da-e362433f8223 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:18.941478 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2dd69eed-bfeb-4cfb-b6da-e362433f8223 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:18.941478 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2dd69eed-bfeb-4cfb-b6da-e362433f8223 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:18.941478 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2dd69eed-bfeb-4cfb-b6da-e362433f8223 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:19.052149 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0f94cb7c-8758-43bf-915c-5e9e4b688376 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:19.064033 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0f94cb7c-8758-43bf-915c-5e9e4b688376 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2" status: 200 len: 1313 microversion: 2.1 time: 0.307945 Oct 23 01:12:19.065198 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 239/533] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:18 2022] GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2 => generated 1313 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:19.070934 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6b2d5103-a6f1-4f7d-b337-0a0f825b243b tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:19.071701 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6b2d5103-a6f1-4f7d-b337-0a0f825b243b tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f2a1666-1481-4519-9e9a-41909cd03da6] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:19.150193 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6b2d5103-a6f1-4f7d-b337-0a0f825b243b tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:19.154810 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2dd69eed-bfeb-4cfb-b6da-e362433f8223 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e535f9274b24a9f800ea0c3d8faba5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b8e89ba0a14188bac8e28b66b5a197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:19.160125 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6b2d5103-a6f1-4f7d-b337-0a0f825b243b tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2a1666-1481-4519-9e9a-41909cd03da6" status: 200 len: 1214 microversion: 2.1 time: 0.093319 Oct 23 01:12:19.160826 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 240/534] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:19 2022] GET /compute/v2.1/servers/8f2a1666-1481-4519-9e9a-41909cd03da6 => generated 1214 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:19.165566 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-456fd10a-5566-4241-932b-d5a5e2c5bf9f tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:19.166667 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-456fd10a-5566-4241-932b-d5a5e2c5bf9f tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:19.173076 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2dd69eed-bfeb-4cfb-b6da-e362433f8223 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "GET /compute/v2.1/servers/f5fe429a-88b7-4d3d-975b-a10c725c4e2f" status: 200 len: 1388 microversion: 2.1 time: 0.297012 Oct 23 01:12:19.173650 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-456fd10a-5566-4241-932b-d5a5e2c5bf9f tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:19.174269 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-456fd10a-5566-4241-932b-d5a5e2c5bf9f tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:19.174783 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-456fd10a-5566-4241-932b-d5a5e2c5bf9f tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:19.175570 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-456fd10a-5566-4241-932b-d5a5e2c5bf9f tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:19.176099 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-456fd10a-5566-4241-932b-d5a5e2c5bf9f tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:19.176617 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-456fd10a-5566-4241-932b-d5a5e2c5bf9f tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:19.180015 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 295/535] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:18 2022] GET /compute/v2.1/servers/f5fe429a-88b7-4d3d-975b-a10c725c4e2f => generated 1388 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:19.246288 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-456fd10a-5566-4241-932b-d5a5e2c5bf9f tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:19.254388 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-456fd10a-5566-4241-932b-d5a5e2c5bf9f tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:19.255837 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-456fd10a-5566-4241-932b-d5a5e2c5bf9f tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:19.258385 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:19.261661 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-456fd10a-5566-4241-932b-d5a5e2c5bf9f tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1537 microversion: 2.91 time: 0.099803 Oct 23 01:12:19.262320 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 241/536] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:12:19 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1537 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:12:19.495562 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a9a179a2-70c3-4c6e-a932-90edafe2e58d tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:19.496730 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a9a179a2-70c3-4c6e-a932-90edafe2e58d tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] [instance: 534a7a12-774e-47ce-86d2-10b277d50c8f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:19.504829 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9a179a2-70c3-4c6e-a932-90edafe2e58d tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:19.505585 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9a179a2-70c3-4c6e-a932-90edafe2e58d tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:19.506071 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9a179a2-70c3-4c6e-a932-90edafe2e58d tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:19.506938 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9a179a2-70c3-4c6e-a932-90edafe2e58d tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:19.507685 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9a179a2-70c3-4c6e-a932-90edafe2e58d tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:19.508615 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9a179a2-70c3-4c6e-a932-90edafe2e58d tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:19.743295 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a9a179a2-70c3-4c6e-a932-90edafe2e58d tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76739eabf8804ec2af41abc4c1e6fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f22fb0ca7346c4ab225ce82d69118c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:19.769300 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a9a179a2-70c3-4c6e-a932-90edafe2e58d tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] 10.222.0.42 "GET /compute/v2.1/servers/534a7a12-774e-47ce-86d2-10b277d50c8f" status: 200 len: 1320 microversion: 2.1 time: 0.275511 Oct 23 01:12:19.785743 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 296/537] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:19 2022] GET /compute/v2.1/servers/534a7a12-774e-47ce-86d2-10b277d50c8f => generated 1320 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:19.944842 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e3f0bb51-c72a-4392-86f8-1cbe4727a54d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:19.945411 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e3f0bb51-c72a-4392-86f8-1cbe4727a54d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: bc304d93-5c47-4830-af2c-bca071542590] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:19.953506 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e3f0bb51-c72a-4392-86f8-1cbe4727a54d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:19.954028 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e3f0bb51-c72a-4392-86f8-1cbe4727a54d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:19.956903 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e3f0bb51-c72a-4392-86f8-1cbe4727a54d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:19.956903 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e3f0bb51-c72a-4392-86f8-1cbe4727a54d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:19.957437 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e3f0bb51-c72a-4392-86f8-1cbe4727a54d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:19.958096 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e3f0bb51-c72a-4392-86f8-1cbe4727a54d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:20.089349 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9cdea44f-7dcd-4681-b2ad-adb4342cd413 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:20.090315 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9cdea44f-7dcd-4681-b2ad-adb4342cd413 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:20.100330 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9cdea44f-7dcd-4681-b2ad-adb4342cd413 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:20.102236 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9cdea44f-7dcd-4681-b2ad-adb4342cd413 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:20.103244 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9cdea44f-7dcd-4681-b2ad-adb4342cd413 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:20.105625 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9cdea44f-7dcd-4681-b2ad-adb4342cd413 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:20.106310 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9cdea44f-7dcd-4681-b2ad-adb4342cd413 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:20.107451 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9cdea44f-7dcd-4681-b2ad-adb4342cd413 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:20.158012 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e3f0bb51-c72a-4392-86f8-1cbe4727a54d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:20.169638 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e3f0bb51-c72a-4392-86f8-1cbe4727a54d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590" status: 200 len: 1310 microversion: 2.1 time: 0.229518 Oct 23 01:12:20.172233 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 242/538] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:19 2022] GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590 => generated 1310 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:20.192110 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2b07aaad-9284-4f3f-a816-9a3529352f59 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:20.193014 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2b07aaad-9284-4f3f-a816-9a3529352f59 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f2a1666-1481-4519-9e9a-41909cd03da6] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:20.204067 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2b07aaad-9284-4f3f-a816-9a3529352f59 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:20.204912 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2b07aaad-9284-4f3f-a816-9a3529352f59 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:20.205415 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2b07aaad-9284-4f3f-a816-9a3529352f59 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:20.206363 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2b07aaad-9284-4f3f-a816-9a3529352f59 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:20.207077 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2b07aaad-9284-4f3f-a816-9a3529352f59 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:20.207736 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2b07aaad-9284-4f3f-a816-9a3529352f59 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:20.298558 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2b07aaad-9284-4f3f-a816-9a3529352f59 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:20.309804 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2b07aaad-9284-4f3f-a816-9a3529352f59 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2a1666-1481-4519-9e9a-41909cd03da6" status: 200 len: 1218 microversion: 2.1 time: 0.125562 Oct 23 01:12:20.311075 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 243/539] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:20 2022] GET /compute/v2.1/servers/8f2a1666-1481-4519-9e9a-41909cd03da6 => generated 1218 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:20.315778 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4243574c-bee0-4e14-b1b0-f2f4b653c2b6 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:20.316789 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4243574c-bee0-4e14-b1b0-f2f4b653c2b6 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: f5fe429a-88b7-4d3d-975b-a10c725c4e2f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:20.322768 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4243574c-bee0-4e14-b1b0-f2f4b653c2b6 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:20.323548 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4243574c-bee0-4e14-b1b0-f2f4b653c2b6 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:20.329556 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4243574c-bee0-4e14-b1b0-f2f4b653c2b6 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:20.329556 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4243574c-bee0-4e14-b1b0-f2f4b653c2b6 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:20.329556 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4243574c-bee0-4e14-b1b0-f2f4b653c2b6 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:20.329556 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4243574c-bee0-4e14-b1b0-f2f4b653c2b6 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:20.360980 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9cdea44f-7dcd-4681-b2ad-adb4342cd413 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:20.368960 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9cdea44f-7dcd-4681-b2ad-adb4342cd413 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2" status: 200 len: 1463 microversion: 2.1 time: 0.283909 Oct 23 01:12:20.374351 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 297/540] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:20 2022] GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2 => generated 1463 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:12:20.379304 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4d68a7c1-92ca-4f0c-b560-2d4432bacac3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:20.384526 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4d68a7c1-92ca-4f0c-b560-2d4432bacac3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:20.397800 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4d68a7c1-92ca-4f0c-b560-2d4432bacac3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:20.398322 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4d68a7c1-92ca-4f0c-b560-2d4432bacac3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:20.398757 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4d68a7c1-92ca-4f0c-b560-2d4432bacac3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:20.406676 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4d68a7c1-92ca-4f0c-b560-2d4432bacac3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:20.407156 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4d68a7c1-92ca-4f0c-b560-2d4432bacac3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:20.407933 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4d68a7c1-92ca-4f0c-b560-2d4432bacac3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:20.474343 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=3 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:20.537135 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4d68a7c1-92ca-4f0c-b560-2d4432bacac3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:20.548449 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4d68a7c1-92ca-4f0c-b560-2d4432bacac3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:20.550770 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4d68a7c1-92ca-4f0c-b560-2d4432bacac3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:20.557604 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4d68a7c1-92ca-4f0c-b560-2d4432bacac3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1537 microversion: 2.91 time: 0.181376 Oct 23 01:12:20.566802 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 298/541] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:12:20 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1537 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:12:20.607918 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4243574c-bee0-4e14-b1b0-f2f4b653c2b6 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e535f9274b24a9f800ea0c3d8faba5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b8e89ba0a14188bac8e28b66b5a197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:20.616076 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4243574c-bee0-4e14-b1b0-f2f4b653c2b6 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "GET /compute/v2.1/servers/f5fe429a-88b7-4d3d-975b-a10c725c4e2f" status: 200 len: 1388 microversion: 2.1 time: 0.303785 Oct 23 01:12:20.640550 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 244/542] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:20 2022] GET /compute/v2.1/servers/f5fe429a-88b7-4d3d-975b-a10c725c4e2f => generated 1388 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:20.799104 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9c9a8dc5-0695-4af9-8288-ef4dabb5c45e tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:20.799920 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9c9a8dc5-0695-4af9-8288-ef4dabb5c45e tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] [instance: 534a7a12-774e-47ce-86d2-10b277d50c8f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:20.809876 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9c9a8dc5-0695-4af9-8288-ef4dabb5c45e tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:20.809876 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9c9a8dc5-0695-4af9-8288-ef4dabb5c45e tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:20.809876 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9c9a8dc5-0695-4af9-8288-ef4dabb5c45e tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:20.809876 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9c9a8dc5-0695-4af9-8288-ef4dabb5c45e tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:20.810736 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9c9a8dc5-0695-4af9-8288-ef4dabb5c45e tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:20.811780 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9c9a8dc5-0695-4af9-8288-ef4dabb5c45e tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:20.903310 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-aea51f26-2239-4d06-9efb-a0befa9b1c80 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:20.904007 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-aea51f26-2239-4d06-9efb-a0befa9b1c80 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:20.910974 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aea51f26-2239-4d06-9efb-a0befa9b1c80 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:20.911550 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aea51f26-2239-4d06-9efb-a0befa9b1c80 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:20.912068 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aea51f26-2239-4d06-9efb-a0befa9b1c80 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:20.912988 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aea51f26-2239-4d06-9efb-a0befa9b1c80 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:20.914162 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aea51f26-2239-4d06-9efb-a0befa9b1c80 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:20.914660 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aea51f26-2239-4d06-9efb-a0befa9b1c80 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:21.147763 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9c9a8dc5-0695-4af9-8288-ef4dabb5c45e tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76739eabf8804ec2af41abc4c1e6fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f22fb0ca7346c4ab225ce82d69118c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:21.161110 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9c9a8dc5-0695-4af9-8288-ef4dabb5c45e tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] 10.222.0.42 "GET /compute/v2.1/servers/534a7a12-774e-47ce-86d2-10b277d50c8f" status: 200 len: 1468 microversion: 2.1 time: 0.368362 Oct 23 01:12:21.167325 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 245/543] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:20 2022] GET /compute/v2.1/servers/534a7a12-774e-47ce-86d2-10b277d50c8f => generated 1468 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:21.183901 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-aaf0808a-a57e-4bf8-bc58-b5c9dc6ff69b req-5249d914-429a-4dbe-993a-3c76c96c5c4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc304d93-5c47-4830-af2c-bca071542590", "name": "network-vif-plugged", "status": "completed", "tag": "baef31c1-b065-44f5-818e-dbc3bbdd5ce4"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:12:21.200228 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-aaf0808a-a57e-4bf8-bc58-b5c9dc6ff69b req-5249d914-429a-4dbe-993a-3c76c96c5c4f service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:21.201240 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-aaf0808a-a57e-4bf8-bc58-b5c9dc6ff69b req-5249d914-429a-4dbe-993a-3c76c96c5c4f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:21.201839 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-aaf0808a-a57e-4bf8-bc58-b5c9dc6ff69b req-5249d914-429a-4dbe-993a-3c76c96c5c4f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:21.222612 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-aaf0808a-a57e-4bf8-bc58-b5c9dc6ff69b req-5249d914-429a-4dbe-993a-3c76c96c5c4f service nova] Creating event network-vif-plugged:baef31c1-b065-44f5-818e-dbc3bbdd5ce4 for instance bc304d93-5c47-4830-af2c-bca071542590 on n-h1-master-1 Oct 23 01:12:21.230813 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-aaf0808a-a57e-4bf8-bc58-b5c9dc6ff69b req-5249d914-429a-4dbe-993a-3c76c96c5c4f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061128 Oct 23 01:12:21.232155 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 246/544] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:12:21.242780 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5ebbbfcb-99e9-447f-99a5-ed4a0098cbac tempest-DeleteServersAdminTestJSON-411260349 tempest-DeleteServersAdminTestJSON-411260349-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:12:21.250186 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5ebbbfcb-99e9-447f-99a5-ed4a0098cbac tempest-DeleteServersAdminTestJSON-411260349 tempest-DeleteServersAdminTestJSON-411260349-project-admin] [instance: 534a7a12-774e-47ce-86d2-10b277d50c8f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:21.256688 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5ebbbfcb-99e9-447f-99a5-ed4a0098cbac tempest-DeleteServersAdminTestJSON-411260349 tempest-DeleteServersAdminTestJSON-411260349-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:21.257462 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5ebbbfcb-99e9-447f-99a5-ed4a0098cbac tempest-DeleteServersAdminTestJSON-411260349 tempest-DeleteServersAdminTestJSON-411260349-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:21.257609 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5ebbbfcb-99e9-447f-99a5-ed4a0098cbac tempest-DeleteServersAdminTestJSON-411260349 tempest-DeleteServersAdminTestJSON-411260349-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:21.258324 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5ebbbfcb-99e9-447f-99a5-ed4a0098cbac tempest-DeleteServersAdminTestJSON-411260349 tempest-DeleteServersAdminTestJSON-411260349-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:21.258775 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5ebbbfcb-99e9-447f-99a5-ed4a0098cbac tempest-DeleteServersAdminTestJSON-411260349 tempest-DeleteServersAdminTestJSON-411260349-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:21.259197 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5ebbbfcb-99e9-447f-99a5-ed4a0098cbac tempest-DeleteServersAdminTestJSON-411260349 tempest-DeleteServersAdminTestJSON-411260349-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:21.491100 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=20 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:21.622953 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5ebbbfcb-99e9-447f-99a5-ed4a0098cbac tempest-DeleteServersAdminTestJSON-411260349 tempest-DeleteServersAdminTestJSON-411260349-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/534a7a12-774e-47ce-86d2-10b277d50c8f/action" status: 202 len: 0 microversion: 2.1 time: 0.387376 Oct 23 01:12:21.628038 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 247/545] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:12:21 2022] POST /compute/v2.1/servers/534a7a12-774e-47ce-86d2-10b277d50c8f/action => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:12:21.642703 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5acddb96-8e7b-46c4-a479-602d6907a2d6 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:21.643871 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5acddb96-8e7b-46c4-a479-602d6907a2d6 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: bc304d93-5c47-4830-af2c-bca071542590] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:21.652717 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5acddb96-8e7b-46c4-a479-602d6907a2d6 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:21.656688 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5acddb96-8e7b-46c4-a479-602d6907a2d6 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:21.656688 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5acddb96-8e7b-46c4-a479-602d6907a2d6 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:21.656688 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5acddb96-8e7b-46c4-a479-602d6907a2d6 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:21.656688 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5acddb96-8e7b-46c4-a479-602d6907a2d6 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:21.657477 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5acddb96-8e7b-46c4-a479-602d6907a2d6 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:21.674016 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-aea51f26-2239-4d06-9efb-a0befa9b1c80 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2" status: 200 len: 1614 microversion: 2.1 time: 1.105067 Oct 23 01:12:21.675475 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 299/546] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:20 2022] GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2 => generated 1614 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:21.682676 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6fa6b4ab-8fa0-434e-af6d-c47bae32a60e tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:21.683656 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6fa6b4ab-8fa0-434e-af6d-c47bae32a60e tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f2a1666-1481-4519-9e9a-41909cd03da6] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:21.691095 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6fa6b4ab-8fa0-434e-af6d-c47bae32a60e tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:21.692017 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6fa6b4ab-8fa0-434e-af6d-c47bae32a60e tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:21.692831 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6fa6b4ab-8fa0-434e-af6d-c47bae32a60e tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:21.694706 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6fa6b4ab-8fa0-434e-af6d-c47bae32a60e tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:21.695532 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6fa6b4ab-8fa0-434e-af6d-c47bae32a60e tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:21.696829 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6fa6b4ab-8fa0-434e-af6d-c47bae32a60e tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:21.819498 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6fa6b4ab-8fa0-434e-af6d-c47bae32a60e tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:21.828307 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6fa6b4ab-8fa0-434e-af6d-c47bae32a60e tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2a1666-1481-4519-9e9a-41909cd03da6" status: 200 len: 1266 microversion: 2.1 time: 0.151544 Oct 23 01:12:21.842001 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 300/547] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:21 2022] GET /compute/v2.1/servers/8f2a1666-1481-4519-9e9a-41909cd03da6 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:21.863797 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9fb948bb-2090-481b-acba-075eba0a257a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:21.870661 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9fb948bb-2090-481b-acba-075eba0a257a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:21.883454 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9fb948bb-2090-481b-acba-075eba0a257a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:21.883864 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9fb948bb-2090-481b-acba-075eba0a257a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:21.884294 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9fb948bb-2090-481b-acba-075eba0a257a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:21.885347 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9fb948bb-2090-481b-acba-075eba0a257a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:21.886077 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9fb948bb-2090-481b-acba-075eba0a257a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:21.886568 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9fb948bb-2090-481b-acba-075eba0a257a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:22.316709 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9fb948bb-2090-481b-acba-075eba0a257a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:22.328197 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9fb948bb-2090-481b-acba-075eba0a257a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:22.329643 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9fb948bb-2090-481b-acba-075eba0a257a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:22.349203 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9fb948bb-2090-481b-acba-075eba0a257a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1558 microversion: 2.91 time: 0.513960 Oct 23 01:12:22.349203 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 301/548] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:12:21 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1558 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:12:22.358022 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-da3cf8da-161b-4b7b-9292-2aeae97c6550 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:22.358906 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-da3cf8da-161b-4b7b-9292-2aeae97c6550 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] [instance: 534a7a12-774e-47ce-86d2-10b277d50c8f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:22.370336 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da3cf8da-161b-4b7b-9292-2aeae97c6550 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:22.371081 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da3cf8da-161b-4b7b-9292-2aeae97c6550 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:22.371730 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da3cf8da-161b-4b7b-9292-2aeae97c6550 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:22.372646 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da3cf8da-161b-4b7b-9292-2aeae97c6550 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:22.373302 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da3cf8da-161b-4b7b-9292-2aeae97c6550 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:22.373913 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da3cf8da-161b-4b7b-9292-2aeae97c6550 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:22.376007 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5acddb96-8e7b-46c4-a479-602d6907a2d6 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:22.388090 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5acddb96-8e7b-46c4-a479-602d6907a2d6 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590" status: 200 len: 1310 microversion: 2.1 time: 0.759884 Oct 23 01:12:22.398999 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 248/549] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:21 2022] GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590 => generated 1310 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:22.409399 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f1b01bc8-70dd-416c-a602-00649096d15b tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:22.410580 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f1b01bc8-70dd-416c-a602-00649096d15b tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: f5fe429a-88b7-4d3d-975b-a10c725c4e2f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:22.417929 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1b01bc8-70dd-416c-a602-00649096d15b tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:22.419102 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1b01bc8-70dd-416c-a602-00649096d15b tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:22.419778 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1b01bc8-70dd-416c-a602-00649096d15b tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:22.420705 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1b01bc8-70dd-416c-a602-00649096d15b tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:22.421361 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1b01bc8-70dd-416c-a602-00649096d15b tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:22.421785 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1b01bc8-70dd-416c-a602-00649096d15b tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:22.432905 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da3cf8da-161b-4b7b-9292-2aeae97c6550 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:22.433343 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da3cf8da-161b-4b7b-9292-2aeae97c6550 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:22.433763 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da3cf8da-161b-4b7b-9292-2aeae97c6550 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:22.434230 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-da3cf8da-161b-4b7b-9292-2aeae97c6550 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lazy-loading 'fault' on Instance uuid 534a7a12-774e-47ce-86d2-10b277d50c8f {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:12:22.736810 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f1b01bc8-70dd-416c-a602-00649096d15b tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e535f9274b24a9f800ea0c3d8faba5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b8e89ba0a14188bac8e28b66b5a197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:22.746580 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f1b01bc8-70dd-416c-a602-00649096d15b tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "GET /compute/v2.1/servers/f5fe429a-88b7-4d3d-975b-a10c725c4e2f" status: 200 len: 1388 microversion: 2.1 time: 0.345887 Oct 23 01:12:22.750977 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 249/550] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:22 2022] GET /compute/v2.1/servers/f5fe429a-88b7-4d3d-975b-a10c725c4e2f => generated 1388 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:22.758790 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b13c31e5-ad21-429b-9cad-3c35ff5da7ac tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:12:22.760830 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b13c31e5-ad21-429b-9cad-3c35ff5da7ac tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:22.764045 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-da3cf8da-161b-4b7b-9292-2aeae97c6550 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76739eabf8804ec2af41abc4c1e6fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f22fb0ca7346c4ab225ce82d69118c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:22.768593 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b13c31e5-ad21-429b-9cad-3c35ff5da7ac tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:22.769361 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b13c31e5-ad21-429b-9cad-3c35ff5da7ac tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:22.769963 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b13c31e5-ad21-429b-9cad-3c35ff5da7ac tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:22.771202 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b13c31e5-ad21-429b-9cad-3c35ff5da7ac tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:22.772147 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b13c31e5-ad21-429b-9cad-3c35ff5da7ac tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:22.772589 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b13c31e5-ad21-429b-9cad-3c35ff5da7ac tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:22.774179 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-da3cf8da-161b-4b7b-9292-2aeae97c6550 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] 10.222.0.42 "GET /compute/v2.1/servers/534a7a12-774e-47ce-86d2-10b277d50c8f" status: 200 len: 1451 microversion: 2.1 time: 0.426779 Oct 23 01:12:22.786362 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 302/551] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:22 2022] GET /compute/v2.1/servers/534a7a12-774e-47ce-86d2-10b277d50c8f => generated 1451 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:22.804518 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cc863920-b1aa-4a3f-8870-73d1ddbe9f0d tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:22.805134 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cc863920-b1aa-4a3f-8870-73d1ddbe9f0d tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] [instance: 534a7a12-774e-47ce-86d2-10b277d50c8f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:22.817145 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cc863920-b1aa-4a3f-8870-73d1ddbe9f0d tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:22.823358 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cc863920-b1aa-4a3f-8870-73d1ddbe9f0d tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:22.833064 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cc863920-b1aa-4a3f-8870-73d1ddbe9f0d tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:22.834799 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cc863920-b1aa-4a3f-8870-73d1ddbe9f0d tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:22.835516 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cc863920-b1aa-4a3f-8870-73d1ddbe9f0d tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:22.836163 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cc863920-b1aa-4a3f-8870-73d1ddbe9f0d tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:22.882778 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b13c31e5-ad21-429b-9cad-3c35ff5da7ac tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'dce640e690324a588f758650bf3c4f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264d2f683757471183644d46da75d365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:22.883652 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b13c31e5-ad21-429b-9cad-3c35ff5da7ac tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] flavor_id is None. Assuming migration. {{(pid=120944) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 23 01:12:22.884283 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b13c31e5-ad21-429b-9cad-3c35ff5da7ac tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120944) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 23 01:12:22.902196 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cc863920-b1aa-4a3f-8870-73d1ddbe9f0d tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] [instance: 534a7a12-774e-47ce-86d2-10b277d50c8f] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:12:23.258481 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b13c31e5-ad21-429b-9cad-3c35ff5da7ac tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2/action" status: 202 len: 0 microversion: 2.1 time: 0.506083 Oct 23 01:12:23.259561 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 250/552] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:12:22 2022] POST /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2/action => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:12:23.268010 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-15e70071-4d7a-49a0-8564-094aabcd469a tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:23.268685 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-15e70071-4d7a-49a0-8564-094aabcd469a tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f2a1666-1481-4519-9e9a-41909cd03da6] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:23.277270 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15e70071-4d7a-49a0-8564-094aabcd469a tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:23.278977 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15e70071-4d7a-49a0-8564-094aabcd469a tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:23.279528 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15e70071-4d7a-49a0-8564-094aabcd469a tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:23.280339 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15e70071-4d7a-49a0-8564-094aabcd469a tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:23.280880 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15e70071-4d7a-49a0-8564-094aabcd469a tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:23.281395 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15e70071-4d7a-49a0-8564-094aabcd469a tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:23.327567 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cc863920-b1aa-4a3f-8870-73d1ddbe9f0d tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] 10.222.0.42 "DELETE /compute/v2.1/servers/534a7a12-774e-47ce-86d2-10b277d50c8f" status: 204 len: 0 microversion: 2.1 time: 0.527465 Oct 23 01:12:23.328806 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 303/553] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:12:22 2022] DELETE /compute/v2.1/servers/534a7a12-774e-47ce-86d2-10b277d50c8f => generated 0 bytes in 529 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:12:23.335392 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b1727fcd-4c57-4594-91fd-721c6c2cbaa5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:23.339905 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b1727fcd-4c57-4594-91fd-721c6c2cbaa5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:23.350576 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1727fcd-4c57-4594-91fd-721c6c2cbaa5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:23.351079 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1727fcd-4c57-4594-91fd-721c6c2cbaa5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:23.351519 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1727fcd-4c57-4594-91fd-721c6c2cbaa5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:23.359829 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1727fcd-4c57-4594-91fd-721c6c2cbaa5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:23.360421 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1727fcd-4c57-4594-91fd-721c6c2cbaa5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:23.363833 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1727fcd-4c57-4594-91fd-721c6c2cbaa5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:23.392969 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-15e70071-4d7a-49a0-8564-094aabcd469a tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:23.405326 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-15e70071-4d7a-49a0-8564-094aabcd469a tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2a1666-1481-4519-9e9a-41909cd03da6" status: 200 len: 1272 microversion: 2.1 time: 0.143803 Oct 23 01:12:23.414174 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 251/554] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:23 2022] GET /compute/v2.1/servers/8f2a1666-1481-4519-9e9a-41909cd03da6 => generated 1272 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:23.425775 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4f7ae4e4-0841-427c-ad93-c7c98832e86f tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:23.426429 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4f7ae4e4-0841-427c-ad93-c7c98832e86f tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] [instance: 534a7a12-774e-47ce-86d2-10b277d50c8f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:23.436555 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f7ae4e4-0841-427c-ad93-c7c98832e86f tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:23.437048 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f7ae4e4-0841-427c-ad93-c7c98832e86f tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:23.437487 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f7ae4e4-0841-427c-ad93-c7c98832e86f tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:23.438284 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f7ae4e4-0841-427c-ad93-c7c98832e86f tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:23.438670 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f7ae4e4-0841-427c-ad93-c7c98832e86f tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:23.439091 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f7ae4e4-0841-427c-ad93-c7c98832e86f tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:23.481335 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:23.535044 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f7ae4e4-0841-427c-ad93-c7c98832e86f tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:23.535714 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f7ae4e4-0841-427c-ad93-c7c98832e86f tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:23.536301 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f7ae4e4-0841-427c-ad93-c7c98832e86f tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:23.536930 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-4f7ae4e4-0841-427c-ad93-c7c98832e86f tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lazy-loading 'fault' on Instance uuid 534a7a12-774e-47ce-86d2-10b277d50c8f {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:12:23.786615 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4f7ae4e4-0841-427c-ad93-c7c98832e86f tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76739eabf8804ec2af41abc4c1e6fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f22fb0ca7346c4ab225ce82d69118c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:23.800144 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4f7ae4e4-0841-427c-ad93-c7c98832e86f tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] 10.222.0.42 "GET /compute/v2.1/servers/534a7a12-774e-47ce-86d2-10b277d50c8f" status: 200 len: 1457 microversion: 2.1 time: 0.384419 Oct 23 01:12:23.804718 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 252/555] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:23 2022] GET /compute/v2.1/servers/534a7a12-774e-47ce-86d2-10b277d50c8f => generated 1457 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:23.814064 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7fc1c777-9259-42bb-889b-c91270aec657 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:23.817694 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7fc1c777-9259-42bb-889b-c91270aec657 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:23.830982 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7fc1c777-9259-42bb-889b-c91270aec657 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:23.833026 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7fc1c777-9259-42bb-889b-c91270aec657 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:23.834085 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7fc1c777-9259-42bb-889b-c91270aec657 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:23.837573 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7fc1c777-9259-42bb-889b-c91270aec657 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:23.842028 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7fc1c777-9259-42bb-889b-c91270aec657 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:23.842028 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7fc1c777-9259-42bb-889b-c91270aec657 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:23.926422 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b1727fcd-4c57-4594-91fd-721c6c2cbaa5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:23.939781 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b1727fcd-4c57-4594-91fd-721c6c2cbaa5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2" status: 200 len: 1472 microversion: 2.1 time: 0.609573 Oct 23 01:12:23.944071 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 304/556] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:23 2022] GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2 => generated 1472 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:23.948733 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-89ab6c2e-dc04-4e21-bcc1-d650b7ff6e35 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:23.949631 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-89ab6c2e-dc04-4e21-bcc1-d650b7ff6e35 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: bc304d93-5c47-4830-af2c-bca071542590] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:23.957388 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-89ab6c2e-dc04-4e21-bcc1-d650b7ff6e35 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:23.958793 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-89ab6c2e-dc04-4e21-bcc1-d650b7ff6e35 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:23.959462 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-89ab6c2e-dc04-4e21-bcc1-d650b7ff6e35 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:23.960390 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-89ab6c2e-dc04-4e21-bcc1-d650b7ff6e35 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:23.961174 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-89ab6c2e-dc04-4e21-bcc1-d650b7ff6e35 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:23.961796 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-89ab6c2e-dc04-4e21-bcc1-d650b7ff6e35 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:23.975849 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7fc1c777-9259-42bb-889b-c91270aec657 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:23.985217 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7fc1c777-9259-42bb-889b-c91270aec657 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:23.987097 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7fc1c777-9259-42bb-889b-c91270aec657 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:23.992994 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7fc1c777-9259-42bb-889b-c91270aec657 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1553 microversion: 2.91 time: 0.186863 Oct 23 01:12:23.994526 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 253/557] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:12:23 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1553 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:12:23.999570 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9210b6cc-bdf7-4ae6-ba40-80389180d734 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:24.000265 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9210b6cc-bdf7-4ae6-ba40-80389180d734 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: f5fe429a-88b7-4d3d-975b-a10c725c4e2f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:24.019337 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9210b6cc-bdf7-4ae6-ba40-80389180d734 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:24.020864 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9210b6cc-bdf7-4ae6-ba40-80389180d734 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:24.020864 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9210b6cc-bdf7-4ae6-ba40-80389180d734 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:24.023580 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9210b6cc-bdf7-4ae6-ba40-80389180d734 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:24.025807 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9210b6cc-bdf7-4ae6-ba40-80389180d734 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:24.028903 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9210b6cc-bdf7-4ae6-ba40-80389180d734 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:24.306143 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-89ab6c2e-dc04-4e21-bcc1-d650b7ff6e35 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:24.321534 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-89ab6c2e-dc04-4e21-bcc1-d650b7ff6e35 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590" status: 200 len: 1493 microversion: 2.1 time: 0.375821 Oct 23 01:12:24.325018 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 305/558] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:23 2022] GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590 => generated 1493 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:24.334426 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9210b6cc-bdf7-4ae6-ba40-80389180d734 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e535f9274b24a9f800ea0c3d8faba5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b8e89ba0a14188bac8e28b66b5a197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:24.347169 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9210b6cc-bdf7-4ae6-ba40-80389180d734 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "GET /compute/v2.1/servers/f5fe429a-88b7-4d3d-975b-a10c725c4e2f" status: 200 len: 1388 microversion: 2.1 time: 0.350160 Oct 23 01:12:24.359008 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a965c133-3c16-4198-99e0-acd7fdc197ad tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:24.360331 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 254/559] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:23 2022] GET /compute/v2.1/servers/f5fe429a-88b7-4d3d-975b-a10c725c4e2f => generated 1388 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:24.361527 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a965c133-3c16-4198-99e0-acd7fdc197ad tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] [instance: bc304d93-5c47-4830-af2c-bca071542590] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:24.388918 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a965c133-3c16-4198-99e0-acd7fdc197ad tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:24.391338 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a965c133-3c16-4198-99e0-acd7fdc197ad tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:24.393741 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a965c133-3c16-4198-99e0-acd7fdc197ad tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:24.393741 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a965c133-3c16-4198-99e0-acd7fdc197ad tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:24.393741 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a965c133-3c16-4198-99e0-acd7fdc197ad tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:24.393741 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a965c133-3c16-4198-99e0-acd7fdc197ad tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:24.437274 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a9ffaf87-1d27-4dae-be92-6d4edd44896f tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:24.438442 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a9ffaf87-1d27-4dae-be92-6d4edd44896f tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f2a1666-1481-4519-9e9a-41909cd03da6] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:24.451330 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a9ffaf87-1d27-4dae-be92-6d4edd44896f tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:24.451330 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a9ffaf87-1d27-4dae-be92-6d4edd44896f tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:24.454209 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a9ffaf87-1d27-4dae-be92-6d4edd44896f tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:24.454978 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a9ffaf87-1d27-4dae-be92-6d4edd44896f tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:24.455459 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a9ffaf87-1d27-4dae-be92-6d4edd44896f tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:24.463189 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a9ffaf87-1d27-4dae-be92-6d4edd44896f tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:24.980230 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a965c133-3c16-4198-99e0-acd7fdc197ad tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590" status: 200 len: 1644 microversion: 2.1 time: 0.628458 Oct 23 01:12:25.005363 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a9ffaf87-1d27-4dae-be92-6d4edd44896f tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:25.006295 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 306/560] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:24 2022] GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590 => generated 1644 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:25.024914 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a9ffaf87-1d27-4dae-be92-6d4edd44896f tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2a1666-1481-4519-9e9a-41909cd03da6" status: 200 len: 1314 microversion: 2.1 time: 0.589656 Oct 23 01:12:25.026799 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 255/561] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:24 2022] GET /compute/v2.1/servers/8f2a1666-1481-4519-9e9a-41909cd03da6 => generated 1314 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:25.038893 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c0f2bf61-b667-4474-83f7-5942e0dd5a25 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:25.042452 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-eac4661a-b8c6-4f05-86ee-121438cf19eb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:25.043137 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-eac4661a-b8c6-4f05-86ee-121438cf19eb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:25.054083 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eac4661a-b8c6-4f05-86ee-121438cf19eb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:25.054900 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eac4661a-b8c6-4f05-86ee-121438cf19eb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:25.056893 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eac4661a-b8c6-4f05-86ee-121438cf19eb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:25.058331 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eac4661a-b8c6-4f05-86ee-121438cf19eb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:25.059104 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eac4661a-b8c6-4f05-86ee-121438cf19eb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:25.059753 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eac4661a-b8c6-4f05-86ee-121438cf19eb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:25.078673 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c0f2bf61-b667-4474-83f7-5942e0dd5a25 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] [instance: 534a7a12-774e-47ce-86d2-10b277d50c8f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:25.130739 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c0f2bf61-b667-4474-83f7-5942e0dd5a25 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:25.135771 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c0f2bf61-b667-4474-83f7-5942e0dd5a25 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:25.144133 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c0f2bf61-b667-4474-83f7-5942e0dd5a25 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:25.145009 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c0f2bf61-b667-4474-83f7-5942e0dd5a25 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:25.153116 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c0f2bf61-b667-4474-83f7-5942e0dd5a25 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:25.153116 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c0f2bf61-b667-4474-83f7-5942e0dd5a25 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:25.283428 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c0f2bf61-b667-4474-83f7-5942e0dd5a25 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:25.284902 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c0f2bf61-b667-4474-83f7-5942e0dd5a25 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:25.286567 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c0f2bf61-b667-4474-83f7-5942e0dd5a25 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:25.287297 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-c0f2bf61-b667-4474-83f7-5942e0dd5a25 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lazy-loading 'fault' on Instance uuid 534a7a12-774e-47ce-86d2-10b277d50c8f {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:12:25.683235 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-eac4661a-b8c6-4f05-86ee-121438cf19eb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:25.692029 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-eac4661a-b8c6-4f05-86ee-121438cf19eb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2" status: 200 len: 1472 microversion: 2.1 time: 0.663921 Oct 23 01:12:25.692613 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 256/562] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:25 2022] GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2 => generated 1472 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:25.702383 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-46b1354c-fac2-4cf0-ac13-4bb2b7a650ce tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:25.707039 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-46b1354c-fac2-4cf0-ac13-4bb2b7a650ce tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] [instance: bc304d93-5c47-4830-af2c-bca071542590] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:25.719929 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46b1354c-fac2-4cf0-ac13-4bb2b7a650ce tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:25.723052 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46b1354c-fac2-4cf0-ac13-4bb2b7a650ce tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:25.723708 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46b1354c-fac2-4cf0-ac13-4bb2b7a650ce tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:25.726808 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46b1354c-fac2-4cf0-ac13-4bb2b7a650ce tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:25.727446 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46b1354c-fac2-4cf0-ac13-4bb2b7a650ce tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:25.728855 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46b1354c-fac2-4cf0-ac13-4bb2b7a650ce tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:25.870733 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c0f2bf61-b667-4474-83f7-5942e0dd5a25 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76739eabf8804ec2af41abc4c1e6fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f22fb0ca7346c4ab225ce82d69118c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:25.882126 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c0f2bf61-b667-4474-83f7-5942e0dd5a25 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] 10.222.0.42 "GET /compute/v2.1/servers/534a7a12-774e-47ce-86d2-10b277d50c8f" status: 200 len: 1457 microversion: 2.1 time: 0.862946 Oct 23 01:12:25.882962 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 307/563] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:25 2022] GET /compute/v2.1/servers/534a7a12-774e-47ce-86d2-10b277d50c8f => generated 1457 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:25.926143 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-49f6a07f-9a1e-43ec-869a-04ef3eb5b6a9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:25.926760 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-49f6a07f-9a1e-43ec-869a-04ef3eb5b6a9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:25.975867 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-49f6a07f-9a1e-43ec-869a-04ef3eb5b6a9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:25.975867 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-49f6a07f-9a1e-43ec-869a-04ef3eb5b6a9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:25.975867 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-49f6a07f-9a1e-43ec-869a-04ef3eb5b6a9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:25.976487 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-49f6a07f-9a1e-43ec-869a-04ef3eb5b6a9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:25.996207 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-49f6a07f-9a1e-43ec-869a-04ef3eb5b6a9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:26.041622 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-49f6a07f-9a1e-43ec-869a-04ef3eb5b6a9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:26.264474 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-49f6a07f-9a1e-43ec-869a-04ef3eb5b6a9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:26.277394 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-49f6a07f-9a1e-43ec-869a-04ef3eb5b6a9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:26.282118 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-49f6a07f-9a1e-43ec-869a-04ef3eb5b6a9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:26.319977 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-49f6a07f-9a1e-43ec-869a-04ef3eb5b6a9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1553 microversion: 2.91 time: 0.385291 Oct 23 01:12:26.340893 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 308/564] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:12:25 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1553 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:12:26.368073 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-210436dd-ca39-4d61-b156-aca2644fa998 req-ee324c7d-af6d-45c2-8603-11cf6717dac6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5fe429a-88b7-4d3d-975b-a10c725c4e2f", "name": "network-vif-plugged", "status": "completed", "tag": "ddf48485-558f-40c5-9932-d78ea427f0f3"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:12:26.411557 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-210436dd-ca39-4d61-b156-aca2644fa998 req-ee324c7d-af6d-45c2-8603-11cf6717dac6 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:26.412352 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-210436dd-ca39-4d61-b156-aca2644fa998 req-ee324c7d-af6d-45c2-8603-11cf6717dac6 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:26.414288 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-210436dd-ca39-4d61-b156-aca2644fa998 req-ee324c7d-af6d-45c2-8603-11cf6717dac6 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:26.425621 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:26.435570 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-210436dd-ca39-4d61-b156-aca2644fa998 req-ee324c7d-af6d-45c2-8603-11cf6717dac6 service nova] Creating event network-vif-plugged:ddf48485-558f-40c5-9932-d78ea427f0f3 for instance f5fe429a-88b7-4d3d-975b-a10c725c4e2f on n-h2-master-1 Oct 23 01:12:26.443273 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-210436dd-ca39-4d61-b156-aca2644fa998 req-ee324c7d-af6d-45c2-8603-11cf6717dac6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085679 Oct 23 01:12:26.453014 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 309/565] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:12:26.453014 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-260c5bca-3e9a-48c8-bf40-97be7544cf23 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:26.453014 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-260c5bca-3e9a-48c8-bf40-97be7544cf23 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: f5fe429a-88b7-4d3d-975b-a10c725c4e2f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:26.459612 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-260c5bca-3e9a-48c8-bf40-97be7544cf23 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:26.460723 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-260c5bca-3e9a-48c8-bf40-97be7544cf23 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:26.461724 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-260c5bca-3e9a-48c8-bf40-97be7544cf23 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:26.463491 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-260c5bca-3e9a-48c8-bf40-97be7544cf23 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:26.464647 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-260c5bca-3e9a-48c8-bf40-97be7544cf23 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:26.465356 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-260c5bca-3e9a-48c8-bf40-97be7544cf23 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:26.957070 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-46b1354c-fac2-4cf0-ac13-4bb2b7a650ce tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590" status: 200 len: 1644 microversion: 2.1 time: 1.258420 Oct 23 01:12:26.958646 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 257/566] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:25 2022] GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590 => generated 1644 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:26.998779 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8a5c109c-7a75-4a1d-b8c1-36e488ef2773 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:26.999439 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8a5c109c-7a75-4a1d-b8c1-36e488ef2773 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f2a1666-1481-4519-9e9a-41909cd03da6] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:27.015444 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8a5c109c-7a75-4a1d-b8c1-36e488ef2773 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:27.026127 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8a5c109c-7a75-4a1d-b8c1-36e488ef2773 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:27.030483 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8a5c109c-7a75-4a1d-b8c1-36e488ef2773 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:27.030483 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8a5c109c-7a75-4a1d-b8c1-36e488ef2773 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:27.030483 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8a5c109c-7a75-4a1d-b8c1-36e488ef2773 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:27.030483 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8a5c109c-7a75-4a1d-b8c1-36e488ef2773 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:27.369486 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-260c5bca-3e9a-48c8-bf40-97be7544cf23 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e535f9274b24a9f800ea0c3d8faba5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b8e89ba0a14188bac8e28b66b5a197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:27.383232 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-260c5bca-3e9a-48c8-bf40-97be7544cf23 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "GET /compute/v2.1/servers/f5fe429a-88b7-4d3d-975b-a10c725c4e2f" status: 200 len: 1388 microversion: 2.1 time: 0.932085 Oct 23 01:12:27.383898 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 310/567] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:26 2022] GET /compute/v2.1/servers/f5fe429a-88b7-4d3d-975b-a10c725c4e2f => generated 1388 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:27.395372 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cb01e17a-f3c2-497a-b832-aa2f786bef96 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:27.403378 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cb01e17a-f3c2-497a-b832-aa2f786bef96 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:27.435955 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb01e17a-f3c2-497a-b832-aa2f786bef96 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:27.436620 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb01e17a-f3c2-497a-b832-aa2f786bef96 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:27.437329 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb01e17a-f3c2-497a-b832-aa2f786bef96 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:27.438361 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb01e17a-f3c2-497a-b832-aa2f786bef96 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:27.438988 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb01e17a-f3c2-497a-b832-aa2f786bef96 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:27.440527 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb01e17a-f3c2-497a-b832-aa2f786bef96 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:27.959400 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8a5c109c-7a75-4a1d-b8c1-36e488ef2773 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:27.976313 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8a5c109c-7a75-4a1d-b8c1-36e488ef2773 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2a1666-1481-4519-9e9a-41909cd03da6" status: 200 len: 1314 microversion: 2.1 time: 1.013758 Oct 23 01:12:27.994983 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 258/568] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:26 2022] GET /compute/v2.1/servers/8f2a1666-1481-4519-9e9a-41909cd03da6 => generated 1314 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:28.010430 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7e5d9fc6-2a7a-4092-b65b-9a443866a5f7 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:28.020333 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7e5d9fc6-2a7a-4092-b65b-9a443866a5f7 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] [instance: 534a7a12-774e-47ce-86d2-10b277d50c8f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:28.035534 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e5d9fc6-2a7a-4092-b65b-9a443866a5f7 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:28.036491 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e5d9fc6-2a7a-4092-b65b-9a443866a5f7 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:28.039008 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e5d9fc6-2a7a-4092-b65b-9a443866a5f7 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:28.041449 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e5d9fc6-2a7a-4092-b65b-9a443866a5f7 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:28.042363 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e5d9fc6-2a7a-4092-b65b-9a443866a5f7 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:28.043104 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e5d9fc6-2a7a-4092-b65b-9a443866a5f7 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:28.192264 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e5d9fc6-2a7a-4092-b65b-9a443866a5f7 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:28.192765 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e5d9fc6-2a7a-4092-b65b-9a443866a5f7 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:28.193468 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e5d9fc6-2a7a-4092-b65b-9a443866a5f7 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:28.193647 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-7e5d9fc6-2a7a-4092-b65b-9a443866a5f7 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lazy-loading 'fault' on Instance uuid 534a7a12-774e-47ce-86d2-10b277d50c8f {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:12:28.414180 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cb01e17a-f3c2-497a-b832-aa2f786bef96 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:28.417160 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7e5d9fc6-2a7a-4092-b65b-9a443866a5f7 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76739eabf8804ec2af41abc4c1e6fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f22fb0ca7346c4ab225ce82d69118c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:28.424075 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:28.428827 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7e5d9fc6-2a7a-4092-b65b-9a443866a5f7 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] 10.222.0.42 "GET /compute/v2.1/servers/534a7a12-774e-47ce-86d2-10b277d50c8f" status: 200 len: 1415 microversion: 2.1 time: 0.432343 Oct 23 01:12:28.432247 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 259/569] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:27 2022] GET /compute/v2.1/servers/534a7a12-774e-47ce-86d2-10b277d50c8f => generated 1415 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:28.447034 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bb954e2a-13f9-4a30-b839-86716586b98f tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:28.455711 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bb954e2a-13f9-4a30-b839-86716586b98f tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:28.458647 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bb954e2a-13f9-4a30-b839-86716586b98f tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:28.465731 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bb954e2a-13f9-4a30-b839-86716586b98f tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:28.470212 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bb954e2a-13f9-4a30-b839-86716586b98f tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:28.470921 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bb954e2a-13f9-4a30-b839-86716586b98f tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:28.473310 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bb954e2a-13f9-4a30-b839-86716586b98f tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:28.477506 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cb01e17a-f3c2-497a-b832-aa2f786bef96 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2" status: 200 len: 1472 microversion: 2.1 time: 1.085999 Oct 23 01:12:28.482660 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 311/570] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:27 2022] GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2 => generated 1472 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:28.502765 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c3077962-9da4-4f67-8e3f-e137ba47d533 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:28.506042 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c3077962-9da4-4f67-8e3f-e137ba47d533 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:28.518144 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c3077962-9da4-4f67-8e3f-e137ba47d533 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:28.525337 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c3077962-9da4-4f67-8e3f-e137ba47d533 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:28.528212 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c3077962-9da4-4f67-8e3f-e137ba47d533 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:28.528212 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c3077962-9da4-4f67-8e3f-e137ba47d533 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:28.528212 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c3077962-9da4-4f67-8e3f-e137ba47d533 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:28.528212 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c3077962-9da4-4f67-8e3f-e137ba47d533 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:28.593282 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bb954e2a-13f9-4a30-b839-86716586b98f tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.159725 Oct 23 01:12:28.593907 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 260/571] 10.222.0.42 () {58 vars in 1176 bytes} [Sun Oct 23 01:12:28 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:12:28.629461 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-b00932e0-726b-48b4-a8c6-04ec69be6329 req-b42c6f7b-f6f3-4aee-a4b2-0546534433e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "534a7a12-774e-47ce-86d2-10b277d50c8f", "name": "network-vif-deleted", "tag": "b7663a27-79ce-4333-a4c4-dd22f8184032"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:12:28.659037 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-b00932e0-726b-48b4-a8c6-04ec69be6329 req-b42c6f7b-f6f3-4aee-a4b2-0546534433e4 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:28.659523 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-b00932e0-726b-48b4-a8c6-04ec69be6329 req-b42c6f7b-f6f3-4aee-a4b2-0546534433e4 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:28.659954 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-b00932e0-726b-48b4-a8c6-04ec69be6329 req-b42c6f7b-f6f3-4aee-a4b2-0546534433e4 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:28.706268 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-b00932e0-726b-48b4-a8c6-04ec69be6329 req-b42c6f7b-f6f3-4aee-a4b2-0546534433e4 service nova] Creating event network-vif-deleted:b7663a27-79ce-4333-a4c4-dd22f8184032 for instance 534a7a12-774e-47ce-86d2-10b277d50c8f on n-h1-master-1 Oct 23 01:12:28.715535 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-b00932e0-726b-48b4-a8c6-04ec69be6329 req-b42c6f7b-f6f3-4aee-a4b2-0546534433e4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098612 Oct 23 01:12:28.716559 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 261/572] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:12:28.738886 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d804237b-001c-45bd-b23a-096dc908f281 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:28.739762 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d804237b-001c-45bd-b23a-096dc908f281 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: f5fe429a-88b7-4d3d-975b-a10c725c4e2f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:28.748084 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c3077962-9da4-4f67-8e3f-e137ba47d533 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:28.763114 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c3077962-9da4-4f67-8e3f-e137ba47d533 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:28.767799 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d804237b-001c-45bd-b23a-096dc908f281 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:28.767799 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d804237b-001c-45bd-b23a-096dc908f281 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:28.767799 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d804237b-001c-45bd-b23a-096dc908f281 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:28.767799 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d804237b-001c-45bd-b23a-096dc908f281 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:28.768433 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d804237b-001c-45bd-b23a-096dc908f281 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:28.768433 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d804237b-001c-45bd-b23a-096dc908f281 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:28.768626 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c3077962-9da4-4f67-8e3f-e137ba47d533 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:28.788473 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c3077962-9da4-4f67-8e3f-e137ba47d533 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1553 microversion: 2.91 time: 0.297759 Oct 23 01:12:28.791672 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 312/573] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:12:28 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1553 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:12:28.807873 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a10c759f-1cbd-4259-bc2f-5b0ecf4128cd tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:12:28.810372 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a10c759f-1cbd-4259-bc2f-5b0ecf4128cd tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] [instance: bc304d93-5c47-4830-af2c-bca071542590] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:28.826208 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a10c759f-1cbd-4259-bc2f-5b0ecf4128cd tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:28.827286 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a10c759f-1cbd-4259-bc2f-5b0ecf4128cd tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:28.827998 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a10c759f-1cbd-4259-bc2f-5b0ecf4128cd tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:28.830511 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a10c759f-1cbd-4259-bc2f-5b0ecf4128cd tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:28.831454 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a10c759f-1cbd-4259-bc2f-5b0ecf4128cd tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:28.832574 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a10c759f-1cbd-4259-bc2f-5b0ecf4128cd tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:29.149425 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a10c759f-1cbd-4259-bc2f-5b0ecf4128cd tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590/action" status: 202 len: 0 microversion: 2.1 time: 0.352887 Oct 23 01:12:29.150433 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 313/574] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:12:28 2022] POST /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590/action => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:12:29.157417 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=8 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:29.181625 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d1765adf-d832-46d6-bdcf-e9b3bd20c014 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:29.183220 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d1765adf-d832-46d6-bdcf-e9b3bd20c014 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f2a1666-1481-4519-9e9a-41909cd03da6] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:29.216059 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d1765adf-d832-46d6-bdcf-e9b3bd20c014 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:29.219036 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d1765adf-d832-46d6-bdcf-e9b3bd20c014 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:29.219351 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d1765adf-d832-46d6-bdcf-e9b3bd20c014 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:29.223268 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d1765adf-d832-46d6-bdcf-e9b3bd20c014 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:29.223759 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d1765adf-d832-46d6-bdcf-e9b3bd20c014 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:29.228704 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d1765adf-d832-46d6-bdcf-e9b3bd20c014 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:29.338849 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d804237b-001c-45bd-b23a-096dc908f281 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e535f9274b24a9f800ea0c3d8faba5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b8e89ba0a14188bac8e28b66b5a197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:29.355933 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d804237b-001c-45bd-b23a-096dc908f281 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "GET /compute/v2.1/servers/f5fe429a-88b7-4d3d-975b-a10c725c4e2f" status: 200 len: 1388 microversion: 2.1 time: 0.637851 Oct 23 01:12:29.374768 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 262/575] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:28 2022] GET /compute/v2.1/servers/f5fe429a-88b7-4d3d-975b-a10c725c4e2f => generated 1388 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:29.384585 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e06eeb15-8fcc-4017-98b8-bc6e09e986bf tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:29.385189 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e06eeb15-8fcc-4017-98b8-bc6e09e986bf tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] [instance: bc304d93-5c47-4830-af2c-bca071542590] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:29.401171 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e06eeb15-8fcc-4017-98b8-bc6e09e986bf tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:29.405769 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e06eeb15-8fcc-4017-98b8-bc6e09e986bf tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:29.408819 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e06eeb15-8fcc-4017-98b8-bc6e09e986bf tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:29.408819 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e06eeb15-8fcc-4017-98b8-bc6e09e986bf tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:29.408819 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e06eeb15-8fcc-4017-98b8-bc6e09e986bf tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:29.408819 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e06eeb15-8fcc-4017-98b8-bc6e09e986bf tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:29.710841 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e06eeb15-8fcc-4017-98b8-bc6e09e986bf tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590" status: 200 len: 1649 microversion: 2.1 time: 0.333602 Oct 23 01:12:29.712764 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 263/576] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:29 2022] GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590 => generated 1649 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:29.717820 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a6ad451d-9773-455a-8203-1f949f30d28e tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:29.724568 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a6ad451d-9773-455a-8203-1f949f30d28e tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] [instance: 534a7a12-774e-47ce-86d2-10b277d50c8f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:29.736059 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6ad451d-9773-455a-8203-1f949f30d28e tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:29.738487 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6ad451d-9773-455a-8203-1f949f30d28e tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:29.738945 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6ad451d-9773-455a-8203-1f949f30d28e tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:29.739673 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6ad451d-9773-455a-8203-1f949f30d28e tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:29.740127 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6ad451d-9773-455a-8203-1f949f30d28e tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:29.743708 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6ad451d-9773-455a-8203-1f949f30d28e tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:29.770370 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d1765adf-d832-46d6-bdcf-e9b3bd20c014 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:29.779893 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d1765adf-d832-46d6-bdcf-e9b3bd20c014 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2a1666-1481-4519-9e9a-41909cd03da6" status: 200 len: 1314 microversion: 2.1 time: 0.628266 Oct 23 01:12:29.783680 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 314/577] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:29 2022] GET /compute/v2.1/servers/8f2a1666-1481-4519-9e9a-41909cd03da6 => generated 1314 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:29.788597 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c9e2d892-4eb1-4ffc-b394-09a4d3cc648b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:29.793555 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c9e2d892-4eb1-4ffc-b394-09a4d3cc648b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:29.810679 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c9e2d892-4eb1-4ffc-b394-09a4d3cc648b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:29.811264 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c9e2d892-4eb1-4ffc-b394-09a4d3cc648b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:29.811702 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c9e2d892-4eb1-4ffc-b394-09a4d3cc648b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:29.812401 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c9e2d892-4eb1-4ffc-b394-09a4d3cc648b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:29.812858 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c9e2d892-4eb1-4ffc-b394-09a4d3cc648b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:29.813280 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c9e2d892-4eb1-4ffc-b394-09a4d3cc648b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:29.823996 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6ad451d-9773-455a-8203-1f949f30d28e tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:29.824917 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6ad451d-9773-455a-8203-1f949f30d28e tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:29.825634 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6ad451d-9773-455a-8203-1f949f30d28e tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:29.826292 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-a6ad451d-9773-455a-8203-1f949f30d28e tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lazy-loading 'fault' on Instance uuid 534a7a12-774e-47ce-86d2-10b277d50c8f {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:12:29.892941 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a6ad451d-9773-455a-8203-1f949f30d28e tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76739eabf8804ec2af41abc4c1e6fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f22fb0ca7346c4ab225ce82d69118c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:29.905967 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a6ad451d-9773-455a-8203-1f949f30d28e tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] 10.222.0.42 "GET /compute/v2.1/servers/534a7a12-774e-47ce-86d2-10b277d50c8f" status: 200 len: 1310 microversion: 2.1 time: 0.191687 Oct 23 01:12:29.907978 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 264/578] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:29 2022] GET /compute/v2.1/servers/534a7a12-774e-47ce-86d2-10b277d50c8f => generated 1310 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:29.914077 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-200c62c9-c679-406f-b5e3-9467fa4771fa tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:29.914759 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-200c62c9-c679-406f-b5e3-9467fa4771fa tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:29.942698 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-200c62c9-c679-406f-b5e3-9467fa4771fa tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:29.948436 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-200c62c9-c679-406f-b5e3-9467fa4771fa tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:29.948436 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-200c62c9-c679-406f-b5e3-9467fa4771fa tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:29.948436 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-200c62c9-c679-406f-b5e3-9467fa4771fa tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:29.948436 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-200c62c9-c679-406f-b5e3-9467fa4771fa tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:29.948932 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-200c62c9-c679-406f-b5e3-9467fa4771fa tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:30.068508 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-200c62c9-c679-406f-b5e3-9467fa4771fa tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:30.080219 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-200c62c9-c679-406f-b5e3-9467fa4771fa tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:30.085736 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-200c62c9-c679-406f-b5e3-9467fa4771fa tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:30.096235 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-200c62c9-c679-406f-b5e3-9467fa4771fa tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1553 microversion: 2.91 time: 0.187090 Oct 23 01:12:30.110395 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 265/579] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:12:29 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1553 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:12:30.163276 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c9e2d892-4eb1-4ffc-b394-09a4d3cc648b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:30.181654 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c9e2d892-4eb1-4ffc-b394-09a4d3cc648b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2" status: 200 len: 1472 microversion: 2.1 time: 0.392177 Oct 23 01:12:30.181654 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 315/580] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:29 2022] GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2 => generated 1472 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:30.197213 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-2f1bdff9-56dc-4842-beba-99734eca1b6b req-1f91991a-16b4-4ebb-9f53-79e5cc874407 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f2a1666-1481-4519-9e9a-41909cd03da6", "tag": "6d9ab6ca-c241-42af-84f0-72ddc77e3a24"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:12:30.214091 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-2f1bdff9-56dc-4842-beba-99734eca1b6b req-1f91991a-16b4-4ebb-9f53-79e5cc874407 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:30.215831 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-2f1bdff9-56dc-4842-beba-99734eca1b6b req-1f91991a-16b4-4ebb-9f53-79e5cc874407 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:30.216553 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-2f1bdff9-56dc-4842-beba-99734eca1b6b req-1f91991a-16b4-4ebb-9f53-79e5cc874407 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:30.229410 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-2f1bdff9-56dc-4842-beba-99734eca1b6b req-1f91991a-16b4-4ebb-9f53-79e5cc874407 service nova] Creating event network-changed:6d9ab6ca-c241-42af-84f0-72ddc77e3a24 for instance 8f2a1666-1481-4519-9e9a-41909cd03da6 on n-h1-master-1 Oct 23 01:12:30.242181 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-2f1bdff9-56dc-4842-beba-99734eca1b6b req-1f91991a-16b4-4ebb-9f53-79e5cc874407 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042065 Oct 23 01:12:30.246289 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 266/581] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:12:30.383364 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7bf3bcea-4679-493d-9f1b-cbe5939f8a6a tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:30.383974 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7bf3bcea-4679-493d-9f1b-cbe5939f8a6a tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: f5fe429a-88b7-4d3d-975b-a10c725c4e2f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:30.405992 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7bf3bcea-4679-493d-9f1b-cbe5939f8a6a tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:30.406885 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7bf3bcea-4679-493d-9f1b-cbe5939f8a6a tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:30.407518 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7bf3bcea-4679-493d-9f1b-cbe5939f8a6a tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:30.408410 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7bf3bcea-4679-493d-9f1b-cbe5939f8a6a tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:30.409021 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7bf3bcea-4679-493d-9f1b-cbe5939f8a6a tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:30.409621 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7bf3bcea-4679-493d-9f1b-cbe5939f8a6a tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:30.735648 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7bf3bcea-4679-493d-9f1b-cbe5939f8a6a tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e535f9274b24a9f800ea0c3d8faba5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b8e89ba0a14188bac8e28b66b5a197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:30.742666 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-68e5ad52-42a5-405a-b2c1-71311f9a3938 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:30.743414 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-68e5ad52-42a5-405a-b2c1-71311f9a3938 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] [instance: bc304d93-5c47-4830-af2c-bca071542590] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:30.746010 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7bf3bcea-4679-493d-9f1b-cbe5939f8a6a tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "GET /compute/v2.1/servers/f5fe429a-88b7-4d3d-975b-a10c725c4e2f" status: 200 len: 1587 microversion: 2.1 time: 0.368798 Oct 23 01:12:30.751077 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 316/582] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:30 2022] GET /compute/v2.1/servers/f5fe429a-88b7-4d3d-975b-a10c725c4e2f => generated 1587 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:30.775145 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c051d0e4-eb00-4708-9071-84aef0198892 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:30.776422 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c051d0e4-eb00-4708-9071-84aef0198892 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: f5fe429a-88b7-4d3d-975b-a10c725c4e2f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:30.784644 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c051d0e4-eb00-4708-9071-84aef0198892 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:30.786558 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c051d0e4-eb00-4708-9071-84aef0198892 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:30.787190 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c051d0e4-eb00-4708-9071-84aef0198892 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:30.787943 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68e5ad52-42a5-405a-b2c1-71311f9a3938 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:30.788842 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c051d0e4-eb00-4708-9071-84aef0198892 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:30.792107 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68e5ad52-42a5-405a-b2c1-71311f9a3938 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:30.795152 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c051d0e4-eb00-4708-9071-84aef0198892 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:30.795287 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68e5ad52-42a5-405a-b2c1-71311f9a3938 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:30.795410 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c051d0e4-eb00-4708-9071-84aef0198892 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:30.795596 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68e5ad52-42a5-405a-b2c1-71311f9a3938 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:30.796105 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68e5ad52-42a5-405a-b2c1-71311f9a3938 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:30.796536 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68e5ad52-42a5-405a-b2c1-71311f9a3938 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:31.106695 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c051d0e4-eb00-4708-9071-84aef0198892 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "GET /compute/v2.1/servers/f5fe429a-88b7-4d3d-975b-a10c725c4e2f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.335522 Oct 23 01:12:31.114329 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 317/583] 10.222.0.42 () {58 vars in 1275 bytes} [Sun Oct 23 01:12:30 2022] GET /compute/v2.1/servers/f5fe429a-88b7-4d3d-975b-a10c725c4e2f/os-interface => generated 284 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:12:31.122924 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-15824661-1106-4748-b534-dee8e958b358 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:31.122924 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-15824661-1106-4748-b534-dee8e958b358 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f2a1666-1481-4519-9e9a-41909cd03da6] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:31.129164 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-15824661-1106-4748-b534-dee8e958b358 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:31.131273 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-15824661-1106-4748-b534-dee8e958b358 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:31.131273 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-15824661-1106-4748-b534-dee8e958b358 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:31.131273 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-15824661-1106-4748-b534-dee8e958b358 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:31.131273 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-15824661-1106-4748-b534-dee8e958b358 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:31.131698 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-15824661-1106-4748-b534-dee8e958b358 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:31.276036 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-68e5ad52-42a5-405a-b2c1-71311f9a3938 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590" status: 200 len: 1629 microversion: 2.1 time: 0.542650 Oct 23 01:12:31.280330 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 267/584] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:30 2022] GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590 => generated 1629 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:31.285518 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2855bab5-6ee3-44b6-b62a-74bfac123b85 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:31.287173 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2855bab5-6ee3-44b6-b62a-74bfac123b85 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] [instance: 534a7a12-774e-47ce-86d2-10b277d50c8f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:31.297617 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2855bab5-6ee3-44b6-b62a-74bfac123b85 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:31.298552 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2855bab5-6ee3-44b6-b62a-74bfac123b85 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:31.299230 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2855bab5-6ee3-44b6-b62a-74bfac123b85 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:31.300219 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2855bab5-6ee3-44b6-b62a-74bfac123b85 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:31.300898 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2855bab5-6ee3-44b6-b62a-74bfac123b85 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:31.301587 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2855bab5-6ee3-44b6-b62a-74bfac123b85 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:31.332154 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-2855bab5-6ee3-44b6-b62a-74bfac123b85 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] HTTP exception thrown: Instance 534a7a12-774e-47ce-86d2-10b277d50c8f could not be found. Oct 23 01:12:31.333820 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2855bab5-6ee3-44b6-b62a-74bfac123b85 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Request method failure captured: Oct 23 01:12:31.333820 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/534a7a12-774e-47ce-86d2-10b277d50c8f HTTP/1.1 Oct 23 01:12:31.333820 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:12:31.333820 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:12:31.333820 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:12:31.333820 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:12:31.333820 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:12:31.333820 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:12:31.333820 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:12:31.333820 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:12:31.333820 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJTBuHLeuYgEsSbq3xAo7m-Y0q2It5nquHtCX4jtIVbN1hoKYoU16-Aar23u9doUsrER6jVxPw8ltFa3e9C1Q3gcBJaNW-16mD5W9lCukLb-mgqkjbEdW37NzUw62U0_1VOAQZ8gfwbkoDmh6NrVMglqDO3xkR8zcEfO25__12UjCCg Oct 23 01:12:31.333820 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:12:31.333820 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:12:31.333820 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:12:31.333820 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:12:31.333820 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:12:31.333820 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:12:31.333820 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 23f22fb0ca7346c4ab225ce82d69118c Oct 23 01:12:31.333820 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1672751015 Oct 23 01:12:31.333820 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:12:31.333820 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:12:31.335260 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/23f22fb0ca7346c4ab225ce82d69118c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_23f22fb0ca7346c4ab225ce82d69118c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/23f22fb0ca7346c4ab225ce82d69118c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/23f22fb0ca7346c4ab225ce82d69118c"}]}] Oct 23 01:12:31.335260 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-DeleteServersAdminTestJSON-1672751015 Oct 23 01:12:31.335260 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 23f22fb0ca7346c4ab225ce82d69118c Oct 23 01:12:31.335260 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1672751015 Oct 23 01:12:31.335260 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-DeleteServersAdminTestJSON-1672751015-project Oct 23 01:12:31.335260 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:12:31.335260 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:12:31.335260 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 76739eabf8804ec2af41abc4c1e6fd4b Oct 23 01:12:31.335260 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-DeleteServersAdminTestJSON-1672751015-project Oct 23 01:12:31.335260 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:12:31.335260 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 534a7a12-774e-47ce-86d2-10b277d50c8f could not be found. Oct 23 01:12:31.335260 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '534a7a12-774e-47ce-86d2-10b277d50c8f'} Oct 23 01:12:31.336519 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:12:31.336519 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:12:31.336519 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:12:31.336519 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:12:31.336519 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:12:31.336519 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:12:31.336519 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:12:31.336519 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:12:31.336519 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:12:31.336519 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:12:31.336519 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 534a7a12-774e-47ce-86d2-10b277d50c8f could not be found. Oct 23 01:12:31.336519 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:12:31.336519 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:12:31.336519 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:12:31.336519 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:12:31.336519 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:12:31.336519 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:12:31.336519 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:12:31.336519 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:12:31.336519 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:12:31.340035 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:12:31.340035 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:12:31.340035 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:12:31.340035 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:12:31.340035 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:12:31.340035 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:12:31.340035 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:12:31.340035 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 534a7a12-774e-47ce-86d2-10b277d50c8f could not be found. Oct 23 01:12:31.340035 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:12:31.340035 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:12:31.340035 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:12:31.340035 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:12:31.340035 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:12:31.340035 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:12:31.340035 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:12:31.340035 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:12:31.340035 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 534a7a12-774e-47ce-86d2-10b277d50c8f could not be found. Oct 23 01:12:31.340035 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:12:31.341410 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2855bab5-6ee3-44b6-b62a-74bfac123b85 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Returning 404 to user: Instance 534a7a12-774e-47ce-86d2-10b277d50c8f could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:12:31.341410 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2855bab5-6ee3-44b6-b62a-74bfac123b85 tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] 10.222.0.42 "GET /compute/v2.1/servers/534a7a12-774e-47ce-86d2-10b277d50c8f" status: 404 len: 111 microversion: 2.1 time: 0.055603 Oct 23 01:12:31.341410 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 268/585] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:31 2022] GET /compute/v2.1/servers/534a7a12-774e-47ce-86d2-10b277d50c8f => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:12:31.350166 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0be98cad-12ca-4a0a-9cf5-48d31b37f55b tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:31.357517 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0be98cad-12ca-4a0a-9cf5-48d31b37f55b tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:31.366687 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0be98cad-12ca-4a0a-9cf5-48d31b37f55b tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:31.367181 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0be98cad-12ca-4a0a-9cf5-48d31b37f55b tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:31.367634 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0be98cad-12ca-4a0a-9cf5-48d31b37f55b tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:31.368368 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0be98cad-12ca-4a0a-9cf5-48d31b37f55b tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:31.368871 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0be98cad-12ca-4a0a-9cf5-48d31b37f55b tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:31.369298 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0be98cad-12ca-4a0a-9cf5-48d31b37f55b tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:31.578952 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0be98cad-12ca-4a0a-9cf5-48d31b37f55b tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:31.592820 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0be98cad-12ca-4a0a-9cf5-48d31b37f55b tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:31.597311 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0be98cad-12ca-4a0a-9cf5-48d31b37f55b tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:31.612782 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0be98cad-12ca-4a0a-9cf5-48d31b37f55b tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1553 microversion: 2.91 time: 0.272238 Oct 23 01:12:31.614646 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 269/586] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:12:31 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1553 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:12:31.629174 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-66545bb4-6fab-41bc-8567-4d0920ef9771 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:31.630736 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-66545bb4-6fab-41bc-8567-4d0920ef9771 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:31.643547 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-66545bb4-6fab-41bc-8567-4d0920ef9771 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:31.646746 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-66545bb4-6fab-41bc-8567-4d0920ef9771 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:31.647462 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-66545bb4-6fab-41bc-8567-4d0920ef9771 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:31.651994 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-66545bb4-6fab-41bc-8567-4d0920ef9771 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:31.652824 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-66545bb4-6fab-41bc-8567-4d0920ef9771 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:31.654743 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-66545bb4-6fab-41bc-8567-4d0920ef9771 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:31.704013 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=100 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:31.719735 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-15824661-1106-4748-b534-dee8e958b358 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:31.730803 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-15824661-1106-4748-b534-dee8e958b358 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2a1666-1481-4519-9e9a-41909cd03da6" status: 200 len: 1314 microversion: 2.1 time: 0.621978 Oct 23 01:12:31.732389 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 318/587] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:31 2022] GET /compute/v2.1/servers/8f2a1666-1481-4519-9e9a-41909cd03da6 => generated 1314 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:31.750167 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4befc6bb-056e-46e6-9af7-1ba6d48b9dd0 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:12:31.753856 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4befc6bb-056e-46e6-9af7-1ba6d48b9dd0 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] [instance: bc304d93-5c47-4830-af2c-bca071542590] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:31.773488 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4befc6bb-056e-46e6-9af7-1ba6d48b9dd0 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:31.776377 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4befc6bb-056e-46e6-9af7-1ba6d48b9dd0 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:31.776377 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4befc6bb-056e-46e6-9af7-1ba6d48b9dd0 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:31.776377 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4befc6bb-056e-46e6-9af7-1ba6d48b9dd0 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:31.783337 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4befc6bb-056e-46e6-9af7-1ba6d48b9dd0 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:31.784122 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4befc6bb-056e-46e6-9af7-1ba6d48b9dd0 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:31.914058 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-4befc6bb-056e-46e6-9af7-1ba6d48b9dd0 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lazy-loading 'flavor' on Instance uuid bc304d93-5c47-4830-af2c-bca071542590 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:12:32.002339 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-66545bb4-6fab-41bc-8567-4d0920ef9771 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:32.013671 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-66545bb4-6fab-41bc-8567-4d0920ef9771 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2" status: 200 len: 1472 microversion: 2.1 time: 0.397646 Oct 23 01:12:32.032134 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 270/588] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:31 2022] GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2 => generated 1472 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:32.042752 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4fb365e6-8a6d-4e8e-9fe3-2a5f282092ba tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:32.045539 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4fb365e6-8a6d-4e8e-9fe3-2a5f282092ba tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] [instance: 534a7a12-774e-47ce-86d2-10b277d50c8f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:32.054925 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4befc6bb-056e-46e6-9af7-1ba6d48b9dd0 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] [instance: bc304d93-5c47-4830-af2c-bca071542590] Going to try to live migrate instance to n-h2-master-1 {{(pid=120945) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 23 01:12:32.062830 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4fb365e6-8a6d-4e8e-9fe3-2a5f282092ba tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:32.067202 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4fb365e6-8a6d-4e8e-9fe3-2a5f282092ba tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:32.067972 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4fb365e6-8a6d-4e8e-9fe3-2a5f282092ba tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:32.068921 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4fb365e6-8a6d-4e8e-9fe3-2a5f282092ba tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:32.069603 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4fb365e6-8a6d-4e8e-9fe3-2a5f282092ba tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:32.070280 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4fb365e6-8a6d-4e8e-9fe3-2a5f282092ba tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:32.097282 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-4fb365e6-8a6d-4e8e-9fe3-2a5f282092ba tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] HTTP exception thrown: Instance 534a7a12-774e-47ce-86d2-10b277d50c8f could not be found. Oct 23 01:12:32.120210 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4fb365e6-8a6d-4e8e-9fe3-2a5f282092ba tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Request method failure captured: Oct 23 01:12:32.120210 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/servers/534a7a12-774e-47ce-86d2-10b277d50c8f HTTP/1.1 Oct 23 01:12:32.120210 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:12:32.120210 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:12:32.120210 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:12:32.120210 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:12:32.120210 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:12:32.120210 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:12:32.120210 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:12:32.120210 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:12:32.120210 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJTBuHLeuYgEsSbq3xAo7m-Y0q2It5nquHtCX4jtIVbN1hoKYoU16-Aar23u9doUsrER6jVxPw8ltFa3e9C1Q3gcBJaNW-16mD5W9lCukLb-mgqkjbEdW37NzUw62U0_1VOAQZ8gfwbkoDmh6NrVMglqDO3xkR8zcEfO25__12UjCCg Oct 23 01:12:32.120210 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:12:32.120210 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:12:32.120210 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:12:32.120210 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:12:32.120210 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:12:32.120210 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:12:32.120210 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 23f22fb0ca7346c4ab225ce82d69118c Oct 23 01:12:32.120210 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1672751015 Oct 23 01:12:32.120210 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:12:32.120210 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:12:32.121508 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/23f22fb0ca7346c4ab225ce82d69118c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_23f22fb0ca7346c4ab225ce82d69118c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/23f22fb0ca7346c4ab225ce82d69118c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/23f22fb0ca7346c4ab225ce82d69118c"}]}] Oct 23 01:12:32.121508 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-DeleteServersAdminTestJSON-1672751015 Oct 23 01:12:32.121508 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 23f22fb0ca7346c4ab225ce82d69118c Oct 23 01:12:32.121508 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1672751015 Oct 23 01:12:32.121508 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-DeleteServersAdminTestJSON-1672751015-project Oct 23 01:12:32.121508 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:12:32.121508 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:12:32.121508 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 76739eabf8804ec2af41abc4c1e6fd4b Oct 23 01:12:32.121508 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-DeleteServersAdminTestJSON-1672751015-project Oct 23 01:12:32.121508 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:12:32.121508 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 534a7a12-774e-47ce-86d2-10b277d50c8f could not be found. Oct 23 01:12:32.121508 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '534a7a12-774e-47ce-86d2-10b277d50c8f'} Oct 23 01:12:32.122774 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:12:32.122774 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:12:32.122774 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:12:32.122774 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:12:32.122774 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:12:32.122774 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:12:32.122774 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:12:32.122774 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:12:32.122774 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:12:32.122774 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:12:32.122774 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 534a7a12-774e-47ce-86d2-10b277d50c8f could not be found. Oct 23 01:12:32.122774 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:12:32.122774 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:12:32.122774 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:12:32.122774 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:12:32.122774 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:12:32.122774 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:12:32.122774 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:12:32.122774 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:12:32.122774 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:12:32.124104 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:12:32.124104 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:12:32.124104 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:12:32.124104 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:12:32.124104 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:12:32.124104 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:12:32.124104 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:12:32.124104 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:12:32.124104 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:12:32.124104 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 534a7a12-774e-47ce-86d2-10b277d50c8f could not be found. Oct 23 01:12:32.124104 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:12:32.124104 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:12:32.124104 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:12:32.124104 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:12:32.124104 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:12:32.124104 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:12:32.124104 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:12:32.124104 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:12:32.124104 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 534a7a12-774e-47ce-86d2-10b277d50c8f could not be found. Oct 23 01:12:32.124104 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:12:32.126405 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4fb365e6-8a6d-4e8e-9fe3-2a5f282092ba tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Returning 404 to user: Instance 534a7a12-774e-47ce-86d2-10b277d50c8f could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:12:32.126405 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4fb365e6-8a6d-4e8e-9fe3-2a5f282092ba tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] 10.222.0.42 "DELETE /compute/v2.1/servers/534a7a12-774e-47ce-86d2-10b277d50c8f" status: 404 len: 111 microversion: 2.1 time: 0.083054 Oct 23 01:12:32.130012 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 271/589] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:12:32 2022] DELETE /compute/v2.1/servers/534a7a12-774e-47ce-86d2-10b277d50c8f => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:12:32.134792 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-95c7547c-eb1b-4568-8ce3-1881208e961a tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:32.135414 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-95c7547c-eb1b-4568-8ce3-1881208e961a tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] [instance: 534a7a12-774e-47ce-86d2-10b277d50c8f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:32.151904 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-95c7547c-eb1b-4568-8ce3-1881208e961a tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:32.152409 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-95c7547c-eb1b-4568-8ce3-1881208e961a tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:32.154747 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-95c7547c-eb1b-4568-8ce3-1881208e961a tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:32.154747 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-95c7547c-eb1b-4568-8ce3-1881208e961a tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:32.155537 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-95c7547c-eb1b-4568-8ce3-1881208e961a tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:32.157304 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-95c7547c-eb1b-4568-8ce3-1881208e961a tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:32.183833 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-95c7547c-eb1b-4568-8ce3-1881208e961a tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] HTTP exception thrown: Instance 534a7a12-774e-47ce-86d2-10b277d50c8f could not be found. Oct 23 01:12:32.185382 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-95c7547c-eb1b-4568-8ce3-1881208e961a tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Request method failure captured: Oct 23 01:12:32.185382 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/534a7a12-774e-47ce-86d2-10b277d50c8f HTTP/1.1 Oct 23 01:12:32.185382 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:12:32.185382 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:12:32.185382 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:12:32.185382 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:12:32.185382 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:12:32.185382 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:12:32.185382 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:12:32.185382 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:12:32.185382 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJTBuHLeuYgEsSbq3xAo7m-Y0q2It5nquHtCX4jtIVbN1hoKYoU16-Aar23u9doUsrER6jVxPw8ltFa3e9C1Q3gcBJaNW-16mD5W9lCukLb-mgqkjbEdW37NzUw62U0_1VOAQZ8gfwbkoDmh6NrVMglqDO3xkR8zcEfO25__12UjCCg Oct 23 01:12:32.185382 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:12:32.185382 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:12:32.185382 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:12:32.185382 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:12:32.185382 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:12:32.185382 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:12:32.185382 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 23f22fb0ca7346c4ab225ce82d69118c Oct 23 01:12:32.185382 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1672751015 Oct 23 01:12:32.185382 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:12:32.185382 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:12:32.186677 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/23f22fb0ca7346c4ab225ce82d69118c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_23f22fb0ca7346c4ab225ce82d69118c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/23f22fb0ca7346c4ab225ce82d69118c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/23f22fb0ca7346c4ab225ce82d69118c"}]}] Oct 23 01:12:32.186677 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-DeleteServersAdminTestJSON-1672751015 Oct 23 01:12:32.186677 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 23f22fb0ca7346c4ab225ce82d69118c Oct 23 01:12:32.186677 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1672751015 Oct 23 01:12:32.186677 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-DeleteServersAdminTestJSON-1672751015-project Oct 23 01:12:32.186677 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:12:32.186677 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:12:32.186677 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 76739eabf8804ec2af41abc4c1e6fd4b Oct 23 01:12:32.186677 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-DeleteServersAdminTestJSON-1672751015-project Oct 23 01:12:32.186677 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:12:32.186677 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 534a7a12-774e-47ce-86d2-10b277d50c8f could not be found. Oct 23 01:12:32.186677 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '534a7a12-774e-47ce-86d2-10b277d50c8f'} Oct 23 01:12:32.187375 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:12:32.187375 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:12:32.187375 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:12:32.187375 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:12:32.187375 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:12:32.187375 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:12:32.187375 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:12:32.187375 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:12:32.187375 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:12:32.187375 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:12:32.187375 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 534a7a12-774e-47ce-86d2-10b277d50c8f could not be found. Oct 23 01:12:32.187375 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:12:32.187375 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:12:32.187375 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:12:32.187375 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:12:32.187375 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:12:32.187375 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:12:32.187375 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:12:32.187375 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:12:32.187375 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:12:32.189131 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:12:32.189131 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:12:32.189131 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:12:32.189131 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:12:32.189131 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:12:32.189131 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:12:32.189131 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:12:32.189131 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 534a7a12-774e-47ce-86d2-10b277d50c8f could not be found. Oct 23 01:12:32.189131 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:12:32.189131 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:12:32.189131 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:12:32.189131 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:12:32.189131 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:12:32.189131 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:12:32.189131 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:12:32.189131 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:12:32.189131 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 534a7a12-774e-47ce-86d2-10b277d50c8f could not be found. Oct 23 01:12:32.189131 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:12:32.196614 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-95c7547c-eb1b-4568-8ce3-1881208e961a tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Returning 404 to user: Instance 534a7a12-774e-47ce-86d2-10b277d50c8f could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:12:32.196614 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-95c7547c-eb1b-4568-8ce3-1881208e961a tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] 10.222.0.42 "GET /compute/v2.1/servers/534a7a12-774e-47ce-86d2-10b277d50c8f" status: 404 len: 111 microversion: 2.1 time: 0.055861 Oct 23 01:12:32.196787 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 272/590] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:32 2022] GET /compute/v2.1/servers/534a7a12-774e-47ce-86d2-10b277d50c8f => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:12:32.205089 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f4addd7b-4059-43ef-a299-ec5f0d59b7aa tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:32.205661 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f4addd7b-4059-43ef-a299-ec5f0d59b7aa tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] [instance: 56fab46b-b733-4279-8e6b-dd6b11013fb2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:32.215964 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4addd7b-4059-43ef-a299-ec5f0d59b7aa tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:32.216282 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4addd7b-4059-43ef-a299-ec5f0d59b7aa tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:32.216733 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4addd7b-4059-43ef-a299-ec5f0d59b7aa tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:32.217632 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4addd7b-4059-43ef-a299-ec5f0d59b7aa tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:32.217912 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4addd7b-4059-43ef-a299-ec5f0d59b7aa tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:32.218370 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4addd7b-4059-43ef-a299-ec5f0d59b7aa tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:32.263183 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-f4addd7b-4059-43ef-a299-ec5f0d59b7aa tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] HTTP exception thrown: Instance 56fab46b-b733-4279-8e6b-dd6b11013fb2 could not be found. Oct 23 01:12:32.265052 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f4addd7b-4059-43ef-a299-ec5f0d59b7aa tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Request method failure captured: Oct 23 01:12:32.265052 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/servers/56fab46b-b733-4279-8e6b-dd6b11013fb2 HTTP/1.1 Oct 23 01:12:32.265052 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:12:32.265052 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:12:32.265052 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:12:32.265052 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:12:32.265052 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:12:32.265052 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:12:32.265052 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:12:32.265052 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:12:32.265052 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJTBuHLeuYgEsSbq3xAo7m-Y0q2It5nquHtCX4jtIVbN1hoKYoU16-Aar23u9doUsrER6jVxPw8ltFa3e9C1Q3gcBJaNW-16mD5W9lCukLb-mgqkjbEdW37NzUw62U0_1VOAQZ8gfwbkoDmh6NrVMglqDO3xkR8zcEfO25__12UjCCg Oct 23 01:12:32.265052 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:12:32.265052 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:12:32.265052 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:12:32.265052 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:12:32.265052 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:12:32.265052 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:12:32.265052 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 23f22fb0ca7346c4ab225ce82d69118c Oct 23 01:12:32.265052 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1672751015 Oct 23 01:12:32.265052 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:12:32.265052 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:12:32.266714 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/23f22fb0ca7346c4ab225ce82d69118c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_23f22fb0ca7346c4ab225ce82d69118c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/23f22fb0ca7346c4ab225ce82d69118c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/23f22fb0ca7346c4ab225ce82d69118c"}]}] Oct 23 01:12:32.266714 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-DeleteServersAdminTestJSON-1672751015 Oct 23 01:12:32.266714 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 23f22fb0ca7346c4ab225ce82d69118c Oct 23 01:12:32.266714 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1672751015 Oct 23 01:12:32.266714 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-DeleteServersAdminTestJSON-1672751015-project Oct 23 01:12:32.266714 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:12:32.266714 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:12:32.266714 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 76739eabf8804ec2af41abc4c1e6fd4b Oct 23 01:12:32.266714 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-DeleteServersAdminTestJSON-1672751015-project Oct 23 01:12:32.266714 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:12:32.266714 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 56fab46b-b733-4279-8e6b-dd6b11013fb2 could not be found. Oct 23 01:12:32.266714 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '56fab46b-b733-4279-8e6b-dd6b11013fb2'} Oct 23 01:12:32.267594 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:12:32.267594 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:12:32.267594 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:12:32.267594 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:12:32.267594 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:12:32.267594 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:12:32.267594 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:12:32.267594 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:12:32.267594 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:12:32.267594 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:12:32.267594 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56fab46b-b733-4279-8e6b-dd6b11013fb2 could not be found. Oct 23 01:12:32.267594 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:12:32.267594 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:12:32.267594 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:12:32.267594 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:12:32.267594 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:12:32.267594 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:12:32.267594 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:12:32.267594 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:12:32.267594 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:12:32.269017 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:12:32.269017 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:12:32.269017 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:12:32.269017 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:12:32.269017 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:12:32.269017 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:12:32.269017 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:12:32.269017 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:12:32.269017 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:12:32.269017 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56fab46b-b733-4279-8e6b-dd6b11013fb2 could not be found. Oct 23 01:12:32.269017 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:12:32.269017 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:12:32.269017 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:12:32.269017 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:12:32.269017 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:12:32.269017 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:12:32.269017 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:12:32.269017 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:12:32.269017 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56fab46b-b733-4279-8e6b-dd6b11013fb2 could not be found. Oct 23 01:12:32.269017 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:12:32.283560 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f4addd7b-4059-43ef-a299-ec5f0d59b7aa tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Returning 404 to user: Instance 56fab46b-b733-4279-8e6b-dd6b11013fb2 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:12:32.283560 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f4addd7b-4059-43ef-a299-ec5f0d59b7aa tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] 10.222.0.42 "DELETE /compute/v2.1/servers/56fab46b-b733-4279-8e6b-dd6b11013fb2" status: 404 len: 111 microversion: 2.1 time: 0.072520 Oct 23 01:12:32.283560 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 273/591] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:12:32 2022] DELETE /compute/v2.1/servers/56fab46b-b733-4279-8e6b-dd6b11013fb2 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:12:32.283560 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c26c041a-5ac1-4655-bbcd-75f35599d46e tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:32.283560 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c26c041a-5ac1-4655-bbcd-75f35599d46e tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] [instance: 56fab46b-b733-4279-8e6b-dd6b11013fb2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:32.288164 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c26c041a-5ac1-4655-bbcd-75f35599d46e tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:32.288786 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c26c041a-5ac1-4655-bbcd-75f35599d46e tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:32.289425 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c26c041a-5ac1-4655-bbcd-75f35599d46e tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:32.290684 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c26c041a-5ac1-4655-bbcd-75f35599d46e tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:32.291483 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c26c041a-5ac1-4655-bbcd-75f35599d46e tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:32.292003 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c26c041a-5ac1-4655-bbcd-75f35599d46e tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:32.311060 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-c26c041a-5ac1-4655-bbcd-75f35599d46e tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] HTTP exception thrown: Instance 56fab46b-b733-4279-8e6b-dd6b11013fb2 could not be found. Oct 23 01:12:32.312806 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c26c041a-5ac1-4655-bbcd-75f35599d46e tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Request method failure captured: Oct 23 01:12:32.312806 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/56fab46b-b733-4279-8e6b-dd6b11013fb2 HTTP/1.1 Oct 23 01:12:32.312806 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:12:32.312806 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:12:32.312806 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:12:32.312806 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:12:32.312806 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:12:32.312806 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:12:32.312806 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:12:32.312806 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:12:32.312806 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJTBuHLeuYgEsSbq3xAo7m-Y0q2It5nquHtCX4jtIVbN1hoKYoU16-Aar23u9doUsrER6jVxPw8ltFa3e9C1Q3gcBJaNW-16mD5W9lCukLb-mgqkjbEdW37NzUw62U0_1VOAQZ8gfwbkoDmh6NrVMglqDO3xkR8zcEfO25__12UjCCg Oct 23 01:12:32.312806 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:12:32.312806 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:12:32.312806 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:12:32.312806 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:12:32.312806 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:12:32.312806 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:12:32.312806 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 23f22fb0ca7346c4ab225ce82d69118c Oct 23 01:12:32.312806 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1672751015 Oct 23 01:12:32.312806 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:12:32.312806 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:12:32.314106 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/23f22fb0ca7346c4ab225ce82d69118c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_23f22fb0ca7346c4ab225ce82d69118c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/23f22fb0ca7346c4ab225ce82d69118c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/23f22fb0ca7346c4ab225ce82d69118c"}]}] Oct 23 01:12:32.314106 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-DeleteServersAdminTestJSON-1672751015 Oct 23 01:12:32.314106 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 23f22fb0ca7346c4ab225ce82d69118c Oct 23 01:12:32.314106 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1672751015 Oct 23 01:12:32.314106 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-DeleteServersAdminTestJSON-1672751015-project Oct 23 01:12:32.314106 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:12:32.314106 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:12:32.314106 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 76739eabf8804ec2af41abc4c1e6fd4b Oct 23 01:12:32.314106 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-DeleteServersAdminTestJSON-1672751015-project Oct 23 01:12:32.314106 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:12:32.314106 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 56fab46b-b733-4279-8e6b-dd6b11013fb2 could not be found. Oct 23 01:12:32.314106 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '56fab46b-b733-4279-8e6b-dd6b11013fb2'} Oct 23 01:12:32.314819 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:12:32.314819 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:12:32.314819 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:12:32.314819 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:12:32.314819 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:12:32.314819 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:12:32.314819 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:12:32.314819 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:12:32.314819 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:12:32.314819 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:12:32.314819 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56fab46b-b733-4279-8e6b-dd6b11013fb2 could not be found. Oct 23 01:12:32.314819 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:12:32.314819 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:12:32.314819 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:12:32.314819 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:12:32.314819 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:12:32.314819 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:12:32.314819 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:12:32.314819 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:12:32.314819 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:12:32.315919 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:12:32.315919 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:12:32.315919 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:12:32.315919 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:12:32.315919 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:12:32.315919 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:12:32.315919 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:12:32.315919 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56fab46b-b733-4279-8e6b-dd6b11013fb2 could not be found. Oct 23 01:12:32.315919 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:12:32.315919 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:12:32.315919 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:12:32.315919 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:12:32.315919 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:12:32.315919 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:12:32.315919 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:12:32.315919 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:12:32.315919 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56fab46b-b733-4279-8e6b-dd6b11013fb2 could not be found. Oct 23 01:12:32.315919 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:12:32.327304 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c26c041a-5ac1-4655-bbcd-75f35599d46e tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] Returning 404 to user: Instance 56fab46b-b733-4279-8e6b-dd6b11013fb2 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:12:32.329596 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c26c041a-5ac1-4655-bbcd-75f35599d46e tempest-DeleteServersAdminTestJSON-1672751015 tempest-DeleteServersAdminTestJSON-1672751015-project] 10.222.0.42 "GET /compute/v2.1/servers/56fab46b-b733-4279-8e6b-dd6b11013fb2" status: 404 len: 111 microversion: 2.1 time: 0.054484 Oct 23 01:12:32.332109 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 274/592] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:32 2022] GET /compute/v2.1/servers/56fab46b-b733-4279-8e6b-dd6b11013fb2 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:12:32.652625 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-afc08492-868e-4892-8fae-71ee80ccb6f9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:32.653434 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-afc08492-868e-4892-8fae-71ee80ccb6f9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:32.682862 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-afc08492-868e-4892-8fae-71ee80ccb6f9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:32.686829 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-afc08492-868e-4892-8fae-71ee80ccb6f9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:32.688183 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-afc08492-868e-4892-8fae-71ee80ccb6f9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:32.696024 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-afc08492-868e-4892-8fae-71ee80ccb6f9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:32.697966 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-afc08492-868e-4892-8fae-71ee80ccb6f9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:32.701093 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-afc08492-868e-4892-8fae-71ee80ccb6f9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:33.409020 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-afc08492-868e-4892-8fae-71ee80ccb6f9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:33.434062 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-afc08492-868e-4892-8fae-71ee80ccb6f9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:33.434062 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-afc08492-868e-4892-8fae-71ee80ccb6f9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:33.457903 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-afc08492-868e-4892-8fae-71ee80ccb6f9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1553 microversion: 2.91 time: 0.811693 Oct 23 01:12:33.459278 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 275/593] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:12:32 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1553 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:12:33.478087 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a5982eec-87b0-4bc0-aaea-672f7c57b4fc tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:33.482622 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a5982eec-87b0-4bc0-aaea-672f7c57b4fc tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f2a1666-1481-4519-9e9a-41909cd03da6] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:33.507980 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5982eec-87b0-4bc0-aaea-672f7c57b4fc tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:33.510046 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5982eec-87b0-4bc0-aaea-672f7c57b4fc tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:33.512720 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5982eec-87b0-4bc0-aaea-672f7c57b4fc tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:33.515843 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5982eec-87b0-4bc0-aaea-672f7c57b4fc tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:33.516539 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5982eec-87b0-4bc0-aaea-672f7c57b4fc tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:33.516997 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5982eec-87b0-4bc0-aaea-672f7c57b4fc tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:33.696009 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a5982eec-87b0-4bc0-aaea-672f7c57b4fc tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:33.704620 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a5982eec-87b0-4bc0-aaea-672f7c57b4fc tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2a1666-1481-4519-9e9a-41909cd03da6" status: 200 len: 1314 microversion: 2.1 time: 0.244021 Oct 23 01:12:33.705203 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 276/594] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:33 2022] GET /compute/v2.1/servers/8f2a1666-1481-4519-9e9a-41909cd03da6 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:33.711221 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-98469685-6066-4a28-8c1f-6ec98b4d3d32 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:33.712302 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-98469685-6066-4a28-8c1f-6ec98b4d3d32 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:33.724380 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-98469685-6066-4a28-8c1f-6ec98b4d3d32 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:33.724870 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-98469685-6066-4a28-8c1f-6ec98b4d3d32 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:33.725477 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-98469685-6066-4a28-8c1f-6ec98b4d3d32 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:33.726469 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-98469685-6066-4a28-8c1f-6ec98b4d3d32 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:33.726929 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-98469685-6066-4a28-8c1f-6ec98b4d3d32 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:33.728019 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-98469685-6066-4a28-8c1f-6ec98b4d3d32 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:33.885934 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-98469685-6066-4a28-8c1f-6ec98b4d3d32 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:33.893854 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-98469685-6066-4a28-8c1f-6ec98b4d3d32 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2" status: 200 len: 1477 microversion: 2.1 time: 0.187439 Oct 23 01:12:33.894444 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 277/595] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:33 2022] GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2 => generated 1477 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:34.496604 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f523393e-ded1-47e0-bc73-e19b708cd605 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:34.497998 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f523393e-ded1-47e0-bc73-e19b708cd605 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:34.516179 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f523393e-ded1-47e0-bc73-e19b708cd605 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:34.524223 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f523393e-ded1-47e0-bc73-e19b708cd605 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:34.524223 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f523393e-ded1-47e0-bc73-e19b708cd605 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:34.530215 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f523393e-ded1-47e0-bc73-e19b708cd605 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:34.532123 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f523393e-ded1-47e0-bc73-e19b708cd605 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:34.532590 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f523393e-ded1-47e0-bc73-e19b708cd605 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:35.120617 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f523393e-ded1-47e0-bc73-e19b708cd605 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:35.130072 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f523393e-ded1-47e0-bc73-e19b708cd605 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:35.135815 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f523393e-ded1-47e0-bc73-e19b708cd605 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:35.150907 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f523393e-ded1-47e0-bc73-e19b708cd605 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1553 microversion: 2.91 time: 0.659616 Oct 23 01:12:35.155414 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 278/596] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:12:34 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1553 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:12:35.164738 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e9bbd78b-2342-4882-96c8-488395920b19 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:35.167622 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e9bbd78b-2342-4882-96c8-488395920b19 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f2a1666-1481-4519-9e9a-41909cd03da6] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:35.197869 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9bbd78b-2342-4882-96c8-488395920b19 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:35.198449 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9bbd78b-2342-4882-96c8-488395920b19 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:35.199232 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9bbd78b-2342-4882-96c8-488395920b19 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:35.200405 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9bbd78b-2342-4882-96c8-488395920b19 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:35.200876 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9bbd78b-2342-4882-96c8-488395920b19 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:35.202476 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9bbd78b-2342-4882-96c8-488395920b19 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:35.519712 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e9bbd78b-2342-4882-96c8-488395920b19 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:35.538602 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e9bbd78b-2342-4882-96c8-488395920b19 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2a1666-1481-4519-9e9a-41909cd03da6" status: 200 len: 1314 microversion: 2.1 time: 0.380171 Oct 23 01:12:35.550090 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 279/597] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:35 2022] GET /compute/v2.1/servers/8f2a1666-1481-4519-9e9a-41909cd03da6 => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:35.550090 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d185c946-86cf-46e5-bc74-2e84b5246620 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:35.556568 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d185c946-86cf-46e5-bc74-2e84b5246620 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:35.582074 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d185c946-86cf-46e5-bc74-2e84b5246620 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:35.584188 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d185c946-86cf-46e5-bc74-2e84b5246620 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:35.584884 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d185c946-86cf-46e5-bc74-2e84b5246620 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:35.585948 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d185c946-86cf-46e5-bc74-2e84b5246620 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:35.586599 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d185c946-86cf-46e5-bc74-2e84b5246620 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:35.596908 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d185c946-86cf-46e5-bc74-2e84b5246620 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:36.106701 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d185c946-86cf-46e5-bc74-2e84b5246620 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:36.118793 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d185c946-86cf-46e5-bc74-2e84b5246620 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2" status: 200 len: 1477 microversion: 2.1 time: 0.575459 Oct 23 01:12:36.136352 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 280/598] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:35 2022] GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2 => generated 1477 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:36.898660 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5c3c0467-175c-40ad-80fd-af546040ccb5 tempest-FloatingIPDetailsNegativeTestJSON-1957253476 tempest-FloatingIPDetailsNegativeTestJSON-1957253476-project] Calling method '.version_select at 0x7f5cc2201040>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:36.995785 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4befc6bb-056e-46e6-9af7-1ba6d48b9dd0 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590/action" status: 202 len: 0 microversion: 2.1 time: 5.261440 Oct 23 01:12:37.000322 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 319/599] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:12:31 2022] POST /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590/action => generated 0 bytes in 5267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:12:37.007532 n-d-master-1 devstack@n-api.service[120944]: DEBUG neutronclient.v2_0.client [None req-5c3c0467-175c-40ad-80fd-af546040ccb5 tempest-FloatingIPDetailsNegativeTestJSON-1957253476 tempest-FloatingIPDetailsNegativeTestJSON-1957253476-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 65064f31-2ba9-4b8a-b32a-3f0900045472 could not be found", "detail": ""}} {{(pid=120944) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 23 01:12:37.008447 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-5c3c0467-175c-40ad-80fd-af546040ccb5 tempest-FloatingIPDetailsNegativeTestJSON-1957253476 tempest-FloatingIPDetailsNegativeTestJSON-1957253476-project] HTTP exception thrown: Floating IP not found for ID 65064f31-2ba9-4b8a-b32a-3f0900045472 Oct 23 01:12:37.010514 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5c3c0467-175c-40ad-80fd-af546040ccb5 tempest-FloatingIPDetailsNegativeTestJSON-1957253476 tempest-FloatingIPDetailsNegativeTestJSON-1957253476-project] Request method failure captured: Oct 23 01:12:37.010514 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/os-floating-ips/65064f31-2ba9-4b8a-b32a-3f0900045472 HTTP/1.1 Oct 23 01:12:37.010514 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:12:37.010514 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:12:37.010514 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:12:37.010514 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:12:37.010514 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:12:37.010514 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:12:37.010514 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:12:37.010514 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:12:37.010514 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJUDEPfFJ8dGfIVi0MpagFMYfuu22GekoTYD1hJCdFi9OMHvWCUsa4kcRPV9ZyTNCevbQ_aYSghit8VFHkrM3Lf0GbFERSo_o1-iOEaxjuDS5RAMqiiSlYyGe0wue2C-PVI36_qEhqUisj3NNIixEf4u6ZH9UOeHetHBGQIESkiaJLI Oct 23 01:12:37.010514 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:12:37.010514 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:12:37.010514 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:12:37.010514 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:12:37.010514 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:12:37.010514 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:12:37.010514 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 2f0500fdc4b14e1e89b5577611c223ce Oct 23 01:12:37.010514 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1957253476 Oct 23 01:12:37.010514 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:12:37.010514 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:12:37.012051 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2f0500fdc4b14e1e89b5577611c223ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2f0500fdc4b14e1e89b5577611c223ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2f0500fdc4b14e1e89b5577611c223ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2f0500fdc4b14e1e89b5577611c223ce"}]}] Oct 23 01:12:37.012051 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1957253476 Oct 23 01:12:37.012051 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 2f0500fdc4b14e1e89b5577611c223ce Oct 23 01:12:37.012051 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1957253476 Oct 23 01:12:37.012051 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1957253476-project Oct 23 01:12:37.012051 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:12:37.012051 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:12:37.012051 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 8a33786fd18d48b489bc393242e455f3 Oct 23 01:12:37.012051 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1957253476-project Oct 23 01:12:37.012051 n-d-master-1 devstack@n-api.service[120944]: method: Oct 23 01:12:37.012051 n-d-master-1 devstack@n-api.service[120944]: exception: Floating IP not found for ID 65064f31-2ba9-4b8a-b32a-3f0900045472 Oct 23 01:12:37.012051 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '65064f31-2ba9-4b8a-b32a-3f0900045472'} Oct 23 01:12:37.012958 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:12:37.012958 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:12:37.012958 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 23 01:12:37.012958 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 23 01:12:37.012958 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:12:37.012958 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:12:37.012958 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 23 01:12:37.012958 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 23 01:12:37.012958 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:12:37.012958 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:12:37.012958 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 23 01:12:37.012958 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 23 01:12:37.012958 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:12:37.012958 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:12:37.012958 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 23 01:12:37.012958 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 23 01:12:37.012958 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:12:37.012958 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:12:37.012958 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 23 01:12:37.014424 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 23 01:12:37.014424 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:12:37.014424 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:12:37.014424 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 23 01:12:37.014424 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 23 01:12:37.014424 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 23 01:12:37.014424 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 23 01:12:37.014424 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 65064f31-2ba9-4b8a-b32a-3f0900045472 could not be found Oct 23 01:12:37.014424 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c85e2794-bb6f-48d3-ab58-ebef0f177a3d'] Oct 23 01:12:37.014424 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:12:37.014424 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:12:37.014424 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:12:37.014424 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:12:37.014424 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 23 01:12:37.014424 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 23 01:12:37.014424 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 23 01:12:37.014424 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 23 01:12:37.014424 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 65064f31-2ba9-4b8a-b32a-3f0900045472. Oct 23 01:12:37.014424 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:12:37.016854 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:12:37.016854 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:12:37.016854 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:12:37.016854 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:12:37.016854 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:12:37.016854 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:12:37.016854 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:12:37.016854 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:12:37.016854 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:12:37.016854 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:12:37.016854 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:12:37.016854 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 23 01:12:37.016854 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 23 01:12:37.016854 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 65064f31-2ba9-4b8a-b32a-3f0900045472 Oct 23 01:12:37.016854 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:12:37.016854 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:12:37.016854 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:12:37.016854 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:12:37.016854 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:12:37.016854 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:12:37.016854 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:12:37.019454 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:12:37.019454 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 65064f31-2ba9-4b8a-b32a-3f0900045472 Oct 23 01:12:37.019454 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:12:37.019806 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-358ea65a-516b-466e-aec5-5c820ac00087 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:37.019806 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-358ea65a-516b-466e-aec5-5c820ac00087 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: f5fe429a-88b7-4d3d-975b-a10c725c4e2f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:37.025898 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5c3c0467-175c-40ad-80fd-af546040ccb5 tempest-FloatingIPDetailsNegativeTestJSON-1957253476 tempest-FloatingIPDetailsNegativeTestJSON-1957253476-project] Returning 404 to user: Floating IP not found for ID 65064f31-2ba9-4b8a-b32a-3f0900045472 {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:12:37.027862 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5c3c0467-175c-40ad-80fd-af546040ccb5 tempest-FloatingIPDetailsNegativeTestJSON-1957253476 tempest-FloatingIPDetailsNegativeTestJSON-1957253476-project] 10.222.0.42 "GET /compute/v2.1/os-floating-ips/65064f31-2ba9-4b8a-b32a-3f0900045472" status: 404 len: 111 microversion: 2.1 time: 0.903388 Oct 23 01:12:37.033935 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 281/600] 10.222.0.42 () {58 vars in 1260 bytes} [Sun Oct 23 01:12:36 2022] GET /compute/v2.1/os-floating-ips/65064f31-2ba9-4b8a-b32a-3f0900045472 => generated 111 bytes in 905 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:12:37.034092 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-358ea65a-516b-466e-aec5-5c820ac00087 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:37.034092 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-358ea65a-516b-466e-aec5-5c820ac00087 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:37.034092 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-358ea65a-516b-466e-aec5-5c820ac00087 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:37.035956 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-358ea65a-516b-466e-aec5-5c820ac00087 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:37.036557 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-358ea65a-516b-466e-aec5-5c820ac00087 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:37.037006 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-358ea65a-516b-466e-aec5-5c820ac00087 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:37.049512 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-c21af925-33cb-4bb1-94b5-90ff4bc06aa7 req-6a05ef74-bfd5-417b-a2fc-f051baa45582 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5fe429a-88b7-4d3d-975b-a10c725c4e2f", "tag": "ddf48485-558f-40c5-9932-d78ea427f0f3"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:12:37.074744 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=100 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:37.085677 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-c21af925-33cb-4bb1-94b5-90ff4bc06aa7 req-6a05ef74-bfd5-417b-a2fc-f051baa45582 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:37.086427 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-c21af925-33cb-4bb1-94b5-90ff4bc06aa7 req-6a05ef74-bfd5-417b-a2fc-f051baa45582 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:37.087024 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-c21af925-33cb-4bb1-94b5-90ff4bc06aa7 req-6a05ef74-bfd5-417b-a2fc-f051baa45582 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:37.109753 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-c21af925-33cb-4bb1-94b5-90ff4bc06aa7 req-6a05ef74-bfd5-417b-a2fc-f051baa45582 service nova] Creating event network-changed:ddf48485-558f-40c5-9932-d78ea427f0f3 for instance f5fe429a-88b7-4d3d-975b-a10c725c4e2f on n-h2-master-1 Oct 23 01:12:37.124659 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-c21af925-33cb-4bb1-94b5-90ff4bc06aa7 req-6a05ef74-bfd5-417b-a2fc-f051baa45582 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085500 Oct 23 01:12:37.127216 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 282/601] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:12:37.140138 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-59b0fe4b-7c72-4525-abe2-23c45638ac2e tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:37.146521 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-59b0fe4b-7c72-4525-abe2-23c45638ac2e tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:37.162139 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-59b0fe4b-7c72-4525-abe2-23c45638ac2e tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:37.163073 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-59b0fe4b-7c72-4525-abe2-23c45638ac2e tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:37.168939 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-59b0fe4b-7c72-4525-abe2-23c45638ac2e tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:37.171610 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-59b0fe4b-7c72-4525-abe2-23c45638ac2e tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:37.186084 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-59b0fe4b-7c72-4525-abe2-23c45638ac2e tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:37.187119 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-59b0fe4b-7c72-4525-abe2-23c45638ac2e tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:37.384960 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-59b0fe4b-7c72-4525-abe2-23c45638ac2e tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:37.402331 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-59b0fe4b-7c72-4525-abe2-23c45638ac2e tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:37.403825 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-59b0fe4b-7c72-4525-abe2-23c45638ac2e tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:37.422563 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-59b0fe4b-7c72-4525-abe2-23c45638ac2e tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1553 microversion: 2.91 time: 0.293597 Oct 23 01:12:37.449039 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 283/602] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:12:37 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1553 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:12:37.491895 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0d054a9a-8a65-4b74-a9f0-faa584973df6 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:37.498179 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0d054a9a-8a65-4b74-a9f0-faa584973df6 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f2a1666-1481-4519-9e9a-41909cd03da6] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:37.514924 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0d054a9a-8a65-4b74-a9f0-faa584973df6 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:37.515432 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0d054a9a-8a65-4b74-a9f0-faa584973df6 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:37.523309 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0d054a9a-8a65-4b74-a9f0-faa584973df6 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:37.524792 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0d054a9a-8a65-4b74-a9f0-faa584973df6 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:37.525289 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0d054a9a-8a65-4b74-a9f0-faa584973df6 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:37.525740 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0d054a9a-8a65-4b74-a9f0-faa584973df6 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:37.755887 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0d054a9a-8a65-4b74-a9f0-faa584973df6 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:37.765464 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0d054a9a-8a65-4b74-a9f0-faa584973df6 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2a1666-1481-4519-9e9a-41909cd03da6" status: 200 len: 1314 microversion: 2.1 time: 0.313500 Oct 23 01:12:37.786589 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 284/603] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:37 2022] GET /compute/v2.1/servers/8f2a1666-1481-4519-9e9a-41909cd03da6 => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:37.792311 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-063b752f-6aaa-417f-865a-64e791f629e9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:37.793220 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-063b752f-6aaa-417f-865a-64e791f629e9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: bc304d93-5c47-4830-af2c-bca071542590] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:37.799915 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-063b752f-6aaa-417f-865a-64e791f629e9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:37.800597 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-063b752f-6aaa-417f-865a-64e791f629e9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:37.801187 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-063b752f-6aaa-417f-865a-64e791f629e9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:37.802121 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-063b752f-6aaa-417f-865a-64e791f629e9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:37.802731 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-063b752f-6aaa-417f-865a-64e791f629e9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:37.803305 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-063b752f-6aaa-417f-865a-64e791f629e9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:37.885294 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-358ea65a-516b-466e-aec5-5c820ac00087 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e535f9274b24a9f800ea0c3d8faba5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b8e89ba0a14188bac8e28b66b5a197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:37.906520 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-358ea65a-516b-466e-aec5-5c820ac00087 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "GET /compute/v2.1/servers/f5fe429a-88b7-4d3d-975b-a10c725c4e2f" status: 200 len: 1587 microversion: 2.1 time: 0.903189 Oct 23 01:12:37.935813 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 320/604] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:37 2022] GET /compute/v2.1/servers/f5fe429a-88b7-4d3d-975b-a10c725c4e2f => generated 1587 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:37.938286 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-35f591ae-e64c-4fc8-8780-68aa518f4364 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:37.939736 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-35f591ae-e64c-4fc8-8780-68aa518f4364 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:37.955622 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-35f591ae-e64c-4fc8-8780-68aa518f4364 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:37.959429 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-35f591ae-e64c-4fc8-8780-68aa518f4364 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:37.960388 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-35f591ae-e64c-4fc8-8780-68aa518f4364 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:37.961343 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-35f591ae-e64c-4fc8-8780-68aa518f4364 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:37.968559 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-35f591ae-e64c-4fc8-8780-68aa518f4364 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:37.972023 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-35f591ae-e64c-4fc8-8780-68aa518f4364 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:38.516876 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-35f591ae-e64c-4fc8-8780-68aa518f4364 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:38.526570 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-35f591ae-e64c-4fc8-8780-68aa518f4364 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2" status: 200 len: 1477 microversion: 2.1 time: 0.597581 Oct 23 01:12:38.532824 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 321/605] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:37 2022] GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2 => generated 1477 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:38.537910 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-84929f63-bc1b-4e7a-8c49-c8ada895a656 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:38.546948 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-84929f63-bc1b-4e7a-8c49-c8ada895a656 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:38.553341 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-84929f63-bc1b-4e7a-8c49-c8ada895a656 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:38.558136 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-84929f63-bc1b-4e7a-8c49-c8ada895a656 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:38.558745 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-84929f63-bc1b-4e7a-8c49-c8ada895a656 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:38.559579 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-84929f63-bc1b-4e7a-8c49-c8ada895a656 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:38.560112 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-84929f63-bc1b-4e7a-8c49-c8ada895a656 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:38.561126 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-84929f63-bc1b-4e7a-8c49-c8ada895a656 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:38.678044 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-063b752f-6aaa-417f-865a-64e791f629e9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:38.690312 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-063b752f-6aaa-417f-865a-64e791f629e9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590" status: 200 len: 1503 microversion: 2.1 time: 0.902187 Oct 23 01:12:38.694742 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 285/606] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:37 2022] GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590 => generated 1503 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:38.792903 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8aff7417-07d3-434d-83a8-e0957f31dc4d tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:38.793838 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8aff7417-07d3-434d-83a8-e0957f31dc4d tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f2a1666-1481-4519-9e9a-41909cd03da6] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:38.803874 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8aff7417-07d3-434d-83a8-e0957f31dc4d tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:38.822993 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8aff7417-07d3-434d-83a8-e0957f31dc4d tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:38.822993 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8aff7417-07d3-434d-83a8-e0957f31dc4d tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:38.822993 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8aff7417-07d3-434d-83a8-e0957f31dc4d tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:38.822993 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8aff7417-07d3-434d-83a8-e0957f31dc4d tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:38.823434 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8aff7417-07d3-434d-83a8-e0957f31dc4d tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:38.830972 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-84929f63-bc1b-4e7a-8c49-c8ada895a656 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:38.841545 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-84929f63-bc1b-4e7a-8c49-c8ada895a656 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:38.852736 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-84929f63-bc1b-4e7a-8c49-c8ada895a656 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:38.872844 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-84929f63-bc1b-4e7a-8c49-c8ada895a656 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1553 microversion: 2.91 time: 0.338654 Oct 23 01:12:38.874716 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 322/607] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:12:38 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1553 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:12:39.102950 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:39.558738 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-beb151a7-f9b2-4af7-b415-36093477a281 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:39.559341 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-beb151a7-f9b2-4af7-b415-36093477a281 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:39.577637 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-beb151a7-f9b2-4af7-b415-36093477a281 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:39.578484 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-beb151a7-f9b2-4af7-b415-36093477a281 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:39.579132 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-beb151a7-f9b2-4af7-b415-36093477a281 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:39.580020 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-beb151a7-f9b2-4af7-b415-36093477a281 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:39.580661 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-beb151a7-f9b2-4af7-b415-36093477a281 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:39.581367 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-beb151a7-f9b2-4af7-b415-36093477a281 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:39.643270 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8aff7417-07d3-434d-83a8-e0957f31dc4d tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:39.651978 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8aff7417-07d3-434d-83a8-e0957f31dc4d tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2a1666-1481-4519-9e9a-41909cd03da6" status: 200 len: 1314 microversion: 2.1 time: 0.863101 Oct 23 01:12:39.669685 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 286/608] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:38 2022] GET /compute/v2.1/servers/8f2a1666-1481-4519-9e9a-41909cd03da6 => generated 1314 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:39.724040 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-73f87e90-fd8a-4a8c-9ce9-3b0b2b409ab3 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:39.724040 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-73f87e90-fd8a-4a8c-9ce9-3b0b2b409ab3 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: bc304d93-5c47-4830-af2c-bca071542590] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:39.736036 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-73f87e90-fd8a-4a8c-9ce9-3b0b2b409ab3 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:39.736758 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-73f87e90-fd8a-4a8c-9ce9-3b0b2b409ab3 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:39.737295 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-73f87e90-fd8a-4a8c-9ce9-3b0b2b409ab3 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:39.738291 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-73f87e90-fd8a-4a8c-9ce9-3b0b2b409ab3 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:39.738989 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-73f87e90-fd8a-4a8c-9ce9-3b0b2b409ab3 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:39.739879 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-73f87e90-fd8a-4a8c-9ce9-3b0b2b409ab3 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:40.607663 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-beb151a7-f9b2-4af7-b415-36093477a281 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:40.611244 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:40.624394 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-beb151a7-f9b2-4af7-b415-36093477a281 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2" status: 200 len: 1477 microversion: 2.1 time: 1.070081 Oct 23 01:12:40.625597 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 323/609] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:39 2022] GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2 => generated 1477 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:40.638395 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d73e22e7-238c-4220-98b4-4b24f74107cd tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:40.644097 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d73e22e7-238c-4220-98b4-4b24f74107cd tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:40.663858 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d73e22e7-238c-4220-98b4-4b24f74107cd tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:40.664748 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d73e22e7-238c-4220-98b4-4b24f74107cd tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:40.665400 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d73e22e7-238c-4220-98b4-4b24f74107cd tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:40.666661 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d73e22e7-238c-4220-98b4-4b24f74107cd tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:40.670694 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d73e22e7-238c-4220-98b4-4b24f74107cd tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:40.671422 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d73e22e7-238c-4220-98b4-4b24f74107cd tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:40.773148 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-73f87e90-fd8a-4a8c-9ce9-3b0b2b409ab3 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:40.796415 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-73f87e90-fd8a-4a8c-9ce9-3b0b2b409ab3 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590" status: 200 len: 1503 microversion: 2.1 time: 1.082035 Oct 23 01:12:40.806752 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 287/610] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:39 2022] GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590 => generated 1503 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:12:40.811886 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7ec9418b-d797-4467-aac1-20593594be48 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:40.819154 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7ec9418b-d797-4467-aac1-20593594be48 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f2a1666-1481-4519-9e9a-41909cd03da6] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:40.839566 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ec9418b-d797-4467-aac1-20593594be48 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:40.850802 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ec9418b-d797-4467-aac1-20593594be48 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:40.852931 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ec9418b-d797-4467-aac1-20593594be48 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:40.856433 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ec9418b-d797-4467-aac1-20593594be48 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:40.858175 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ec9418b-d797-4467-aac1-20593594be48 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:40.860950 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ec9418b-d797-4467-aac1-20593594be48 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:41.002467 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d73e22e7-238c-4220-98b4-4b24f74107cd tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:41.019083 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d73e22e7-238c-4220-98b4-4b24f74107cd tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:41.020950 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d73e22e7-238c-4220-98b4-4b24f74107cd tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:41.028168 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d73e22e7-238c-4220-98b4-4b24f74107cd tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1553 microversion: 2.91 time: 0.400491 Oct 23 01:12:41.029308 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 324/611] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:12:40 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1553 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:12:41.287199 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7ec9418b-d797-4467-aac1-20593594be48 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:41.303436 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7ec9418b-d797-4467-aac1-20593594be48 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2a1666-1481-4519-9e9a-41909cd03da6" status: 200 len: 1314 microversion: 2.1 time: 0.489541 Oct 23 01:12:41.306407 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 288/612] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:40 2022] GET /compute/v2.1/servers/8f2a1666-1481-4519-9e9a-41909cd03da6 => generated 1314 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:41.673682 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1873ee6b-cede-4e56-93aa-ce7406f22bcc tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:41.674414 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1873ee6b-cede-4e56-93aa-ce7406f22bcc tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:41.686587 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1873ee6b-cede-4e56-93aa-ce7406f22bcc tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:41.687089 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1873ee6b-cede-4e56-93aa-ce7406f22bcc tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:41.687525 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1873ee6b-cede-4e56-93aa-ce7406f22bcc tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:41.699988 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1873ee6b-cede-4e56-93aa-ce7406f22bcc tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:41.700746 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1873ee6b-cede-4e56-93aa-ce7406f22bcc tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:41.706454 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1873ee6b-cede-4e56-93aa-ce7406f22bcc tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:41.839275 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d3b51328-2b6f-4cf4-ba89-ee5f79d6b5aa tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:41.839907 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d3b51328-2b6f-4cf4-ba89-ee5f79d6b5aa tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: bc304d93-5c47-4830-af2c-bca071542590] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:41.855387 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d3b51328-2b6f-4cf4-ba89-ee5f79d6b5aa tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:41.855892 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d3b51328-2b6f-4cf4-ba89-ee5f79d6b5aa tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:41.856330 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d3b51328-2b6f-4cf4-ba89-ee5f79d6b5aa tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:41.857038 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d3b51328-2b6f-4cf4-ba89-ee5f79d6b5aa tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:41.857497 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d3b51328-2b6f-4cf4-ba89-ee5f79d6b5aa tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:41.863309 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d3b51328-2b6f-4cf4-ba89-ee5f79d6b5aa tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:42.330148 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1873ee6b-cede-4e56-93aa-ce7406f22bcc tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:42.344340 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1873ee6b-cede-4e56-93aa-ce7406f22bcc tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2" status: 200 len: 1477 microversion: 2.1 time: 0.675365 Oct 23 01:12:42.349384 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 325/613] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:41 2022] GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2 => generated 1477 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:42.375972 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0078e85f-b623-4ad8-bcf2-4f0db19623bb tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:42.376903 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0078e85f-b623-4ad8-bcf2-4f0db19623bb tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:42.386067 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0078e85f-b623-4ad8-bcf2-4f0db19623bb tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:42.386939 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0078e85f-b623-4ad8-bcf2-4f0db19623bb tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:42.387996 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0078e85f-b623-4ad8-bcf2-4f0db19623bb tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:42.388881 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0078e85f-b623-4ad8-bcf2-4f0db19623bb tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:42.389489 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0078e85f-b623-4ad8-bcf2-4f0db19623bb tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:42.390138 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0078e85f-b623-4ad8-bcf2-4f0db19623bb tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:42.537697 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d3b51328-2b6f-4cf4-ba89-ee5f79d6b5aa tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:42.547989 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d3b51328-2b6f-4cf4-ba89-ee5f79d6b5aa tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590" status: 200 len: 1503 microversion: 2.1 time: 0.714711 Oct 23 01:12:42.551715 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 289/614] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:41 2022] GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590 => generated 1503 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:42.568985 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0078e85f-b623-4ad8-bcf2-4f0db19623bb tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:42.570233 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-6ca13d77-93fa-4dfe-9240-a57507ed7a32 req-d0be1041-5ad4-4cb5-bd85-14e9b04ca9f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc304d93-5c47-4830-af2c-bca071542590", "name": "network-vif-unplugged", "status": "completed", "tag": "baef31c1-b065-44f5-818e-dbc3bbdd5ce4"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:12:42.593813 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-6ca13d77-93fa-4dfe-9240-a57507ed7a32 req-d0be1041-5ad4-4cb5-bd85-14e9b04ca9f8 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:42.594339 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-6ca13d77-93fa-4dfe-9240-a57507ed7a32 req-d0be1041-5ad4-4cb5-bd85-14e9b04ca9f8 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:42.596102 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0078e85f-b623-4ad8-bcf2-4f0db19623bb tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:42.605240 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0078e85f-b623-4ad8-bcf2-4f0db19623bb tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:42.609045 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-6ca13d77-93fa-4dfe-9240-a57507ed7a32 req-d0be1041-5ad4-4cb5-bd85-14e9b04ca9f8 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:42.621717 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0078e85f-b623-4ad8-bcf2-4f0db19623bb tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1553 microversion: 2.91 time: 0.258203 Oct 23 01:12:42.626932 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 326/615] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:12:42 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1553 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:12:42.655104 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-6ca13d77-93fa-4dfe-9240-a57507ed7a32 req-d0be1041-5ad4-4cb5-bd85-14e9b04ca9f8 service nova] Creating event network-vif-unplugged:baef31c1-b065-44f5-818e-dbc3bbdd5ce4 for instance bc304d93-5c47-4830-af2c-bca071542590 on n-h1-master-1 Oct 23 01:12:42.655416 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ef8ff253-e62d-4b2f-8147-9f4a4bc8b585 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:42.658662 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ef8ff253-e62d-4b2f-8147-9f4a4bc8b585 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f2a1666-1481-4519-9e9a-41909cd03da6] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:42.666666 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-6ca13d77-93fa-4dfe-9240-a57507ed7a32 req-d0be1041-5ad4-4cb5-bd85-14e9b04ca9f8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113580 Oct 23 01:12:42.674622 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:42.677800 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 290/616] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:12:42.679844 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef8ff253-e62d-4b2f-8147-9f4a4bc8b585 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:42.685403 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef8ff253-e62d-4b2f-8147-9f4a4bc8b585 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:42.685403 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef8ff253-e62d-4b2f-8147-9f4a4bc8b585 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:42.687193 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef8ff253-e62d-4b2f-8147-9f4a4bc8b585 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:42.687830 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef8ff253-e62d-4b2f-8147-9f4a4bc8b585 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:42.688422 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef8ff253-e62d-4b2f-8147-9f4a4bc8b585 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:42.689122 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-bafcdbdf-1d02-4bf9-ae3b-ebe1c500011b req-727fc7bf-5311-4d0d-864f-a491fdd62f84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f2a1666-1481-4519-9e9a-41909cd03da6", "name": "network-vif-plugged", "status": "completed", "tag": "6d9ab6ca-c241-42af-84f0-72ddc77e3a24"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:12:42.736564 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-bafcdbdf-1d02-4bf9-ae3b-ebe1c500011b req-727fc7bf-5311-4d0d-864f-a491fdd62f84 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:42.737274 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-bafcdbdf-1d02-4bf9-ae3b-ebe1c500011b req-727fc7bf-5311-4d0d-864f-a491fdd62f84 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:42.739420 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-bafcdbdf-1d02-4bf9-ae3b-ebe1c500011b req-727fc7bf-5311-4d0d-864f-a491fdd62f84 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:42.787515 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-bafcdbdf-1d02-4bf9-ae3b-ebe1c500011b req-727fc7bf-5311-4d0d-864f-a491fdd62f84 service nova] Creating event network-vif-plugged:6d9ab6ca-c241-42af-84f0-72ddc77e3a24 for instance 8f2a1666-1481-4519-9e9a-41909cd03da6 on n-h1-master-1 Oct 23 01:12:42.796811 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-bafcdbdf-1d02-4bf9-ae3b-ebe1c500011b req-727fc7bf-5311-4d0d-864f-a491fdd62f84 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116075 Oct 23 01:12:42.806813 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 291/617] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:12:43.118494 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-eed3f92d-a277-4cbe-a6c2-81bb695ea680 tempest-FlavorsV255TestJSON-1695885864 tempest-FlavorsV255TestJSON-1695885864-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-537640389", "id": 2016361884, "os-flavor-access:is_public": "True"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:12:43.160438 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ef8ff253-e62d-4b2f-8147-9f4a4bc8b585 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:43.173005 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ef8ff253-e62d-4b2f-8147-9f4a4bc8b585 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2a1666-1481-4519-9e9a-41909cd03da6" status: 200 len: 1314 microversion: 2.1 time: 0.533915 Oct 23 01:12:43.184290 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-eed3f92d-a277-4cbe-a6c2-81bb695ea680 tempest-FlavorsV255TestJSON-1695885864 tempest-FlavorsV255TestJSON-1695885864-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 448 microversion: 2.55 time: 0.375873 Oct 23 01:12:43.185359 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 292/618] 10.222.0.42 () {62 vars in 1188 bytes} [Sun Oct 23 01:12:42 2022] POST /compute/v2.1/flavors => generated 448 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:12:43.197084 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 327/619] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:42 2022] GET /compute/v2.1/servers/8f2a1666-1481-4519-9e9a-41909cd03da6 => generated 1314 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:43.380942 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c5f9c0f3-54d7-4a47-8e0e-85842a6a059e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:43.385308 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c5f9c0f3-54d7-4a47-8e0e-85842a6a059e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:43.397873 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-55c511f5-e77f-4568-ba9c-f9de1d533e8b tempest-FlavorsV255TestJSON-360067377 tempest-FlavorsV255TestJSON-360067377-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:43.398923 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c5f9c0f3-54d7-4a47-8e0e-85842a6a059e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:43.399585 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c5f9c0f3-54d7-4a47-8e0e-85842a6a059e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:43.400195 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c5f9c0f3-54d7-4a47-8e0e-85842a6a059e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:43.401060 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c5f9c0f3-54d7-4a47-8e0e-85842a6a059e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:43.401661 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c5f9c0f3-54d7-4a47-8e0e-85842a6a059e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:43.402270 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c5f9c0f3-54d7-4a47-8e0e-85842a6a059e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:43.412719 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-55c511f5-e77f-4568-ba9c-f9de1d533e8b tempest-FlavorsV255TestJSON-360067377 tempest-FlavorsV255TestJSON-360067377-project] 10.222.0.42 "GET /compute/v2.1/flavors/2016361884" status: 200 len: 448 microversion: 2.55 time: 0.201029 Oct 23 01:12:43.413869 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 293/620] 10.222.0.42 () {60 vars in 1199 bytes} [Sun Oct 23 01:12:43 2022] GET /compute/v2.1/flavors/2016361884 => generated 448 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:12:43.448188 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-75a4cd88-7d96-45db-b95a-ac4864f20154 tempest-FlavorsV255TestJSON-1695885864 tempest-FlavorsV255TestJSON-1695885864-project-admin] Action: 'update', calling method: .version_select at 0x7f5cc3dd6b80>, body: {"flavor": {"description": "new"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:12:43.626906 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-75a4cd88-7d96-45db-b95a-ac4864f20154 tempest-FlavorsV255TestJSON-1695885864 tempest-FlavorsV255TestJSON-1695885864-project-admin] 10.222.0.42 "PUT /compute/v2.1/flavors/2016361884" status: 200 len: 449 microversion: 2.55 time: 0.199447 Oct 23 01:12:43.630565 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 294/621] 10.222.0.42 () {62 vars in 1219 bytes} [Sun Oct 23 01:12:43 2022] PUT /compute/v2.1/flavors/2016361884 => generated 449 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:12:43.641598 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-87e45317-4982-4625-b196-69f7dd8b5626 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:43.642477 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-87e45317-4982-4625-b196-69f7dd8b5626 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: bc304d93-5c47-4830-af2c-bca071542590] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:43.654990 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-87e45317-4982-4625-b196-69f7dd8b5626 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:43.659683 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-87e45317-4982-4625-b196-69f7dd8b5626 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:43.661944 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-87e45317-4982-4625-b196-69f7dd8b5626 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:43.662792 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-87e45317-4982-4625-b196-69f7dd8b5626 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:43.664705 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-87e45317-4982-4625-b196-69f7dd8b5626 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:43.666969 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-87e45317-4982-4625-b196-69f7dd8b5626 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:44.410242 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c5f9c0f3-54d7-4a47-8e0e-85842a6a059e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:44.424677 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c5f9c0f3-54d7-4a47-8e0e-85842a6a059e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2" status: 200 len: 1477 microversion: 2.1 time: 1.047229 Oct 23 01:12:44.426326 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 328/622] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:43 2022] GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2 => generated 1477 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:12:44.452305 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2e7d0767-a53f-4cac-971c-499513d3ad7d tempest-FlavorsV255TestJSON-360067377 tempest-FlavorsV255TestJSON-360067377-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:44.525897 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2e7d0767-a53f-4cac-971c-499513d3ad7d tempest-FlavorsV255TestJSON-360067377 tempest-FlavorsV255TestJSON-360067377-project] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 6593 microversion: 2.55 time: 0.085638 Oct 23 01:12:44.527466 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 329/623] 10.222.0.42 () {60 vars in 1187 bytes} [Sun Oct 23 01:12:44 2022] GET /compute/v2.1/flavors/detail => generated 6593 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:12:44.537358 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a604db1a-0d56-4255-8648-1e9db72b22b3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:44.542881 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a604db1a-0d56-4255-8648-1e9db72b22b3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:44.554349 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a604db1a-0d56-4255-8648-1e9db72b22b3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:44.554891 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a604db1a-0d56-4255-8648-1e9db72b22b3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:44.555356 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a604db1a-0d56-4255-8648-1e9db72b22b3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:44.556297 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a604db1a-0d56-4255-8648-1e9db72b22b3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:44.557031 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a604db1a-0d56-4255-8648-1e9db72b22b3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:44.557742 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a604db1a-0d56-4255-8648-1e9db72b22b3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:44.781189 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a604db1a-0d56-4255-8648-1e9db72b22b3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:44.793761 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-87e45317-4982-4625-b196-69f7dd8b5626 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:44.796859 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a604db1a-0d56-4255-8648-1e9db72b22b3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:44.798375 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=100 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:44.799285 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a604db1a-0d56-4255-8648-1e9db72b22b3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:44.806565 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-87e45317-4982-4625-b196-69f7dd8b5626 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590" status: 200 len: 1503 microversion: 2.1 time: 1.175159 Oct 23 01:12:44.809147 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 295/624] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:43 2022] GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590 => generated 1503 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:44.826133 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a604db1a-0d56-4255-8648-1e9db72b22b3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1553 microversion: 2.91 time: 0.296963 Oct 23 01:12:44.827941 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d93c77d7-04a9-4a38-9c36-1df91c497ed3 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:44.828927 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 330/625] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:12:44 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1553 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:12:44.829085 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d93c77d7-04a9-4a38-9c36-1df91c497ed3 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f2a1666-1481-4519-9e9a-41909cd03da6] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:44.845341 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d93c77d7-04a9-4a38-9c36-1df91c497ed3 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:44.845541 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-eb069cc8-1336-4bc8-a9ee-0eeed585cec9 tempest-FlavorsV255TestJSON-360067377 tempest-FlavorsV255TestJSON-360067377-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:44.846035 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d93c77d7-04a9-4a38-9c36-1df91c497ed3 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:44.847196 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d93c77d7-04a9-4a38-9c36-1df91c497ed3 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:44.849744 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d93c77d7-04a9-4a38-9c36-1df91c497ed3 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:44.851657 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d93c77d7-04a9-4a38-9c36-1df91c497ed3 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:44.852799 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d93c77d7-04a9-4a38-9c36-1df91c497ed3 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:44.901343 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-eb069cc8-1336-4bc8-a9ee-0eeed585cec9 tempest-FlavorsV255TestJSON-360067377 tempest-FlavorsV255TestJSON-360067377-project] 10.222.0.42 "GET /compute/v2.1/flavors" status: 200 len: 3683 microversion: 2.55 time: 0.068683 Oct 23 01:12:44.903633 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 331/626] 10.222.0.42 () {60 vars in 1166 bytes} [Sun Oct 23 01:12:44 2022] GET /compute/v2.1/flavors => generated 3683 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:12:44.921524 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-3869375e-39f4-4516-8947-4276dc427562 req-6c6081fb-6f15-4351-86d3-e848928b54ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc304d93-5c47-4830-af2c-bca071542590", "tag": "baef31c1-b065-44f5-818e-dbc3bbdd5ce4"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:12:44.955712 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-3869375e-39f4-4516-8947-4276dc427562 req-6c6081fb-6f15-4351-86d3-e848928b54ef service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:44.973533 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-3869375e-39f4-4516-8947-4276dc427562 req-6c6081fb-6f15-4351-86d3-e848928b54ef service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:44.974174 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-3869375e-39f4-4516-8947-4276dc427562 req-6c6081fb-6f15-4351-86d3-e848928b54ef service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:45.018687 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-3869375e-39f4-4516-8947-4276dc427562 req-6c6081fb-6f15-4351-86d3-e848928b54ef service nova] Creating event network-changed:baef31c1-b065-44f5-818e-dbc3bbdd5ce4 for instance bc304d93-5c47-4830-af2c-bca071542590 on n-h1-master-1 Oct 23 01:12:45.038405 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-3869375e-39f4-4516-8947-4276dc427562 req-6c6081fb-6f15-4351-86d3-e848928b54ef service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133175 Oct 23 01:12:45.042474 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 332/627] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:12:45.051663 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-75e1e3aa-e955-4a7e-bd32-6885cb1727de tempest-FlavorsV255TestJSON-1695885864 tempest-FlavorsV255TestJSON-1695885864-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:45.165774 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-75e1e3aa-e955-4a7e-bd32-6885cb1727de tempest-FlavorsV255TestJSON-1695885864 tempest-FlavorsV255TestJSON-1695885864-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/2016361884" status: 202 len: 0 microversion: 2.55 time: 0.121433 Oct 23 01:12:45.167593 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 333/628] 10.222.0.42 () {60 vars in 1202 bytes} [Sun Oct 23 01:12:45 2022] DELETE /compute/v2.1/flavors/2016361884 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:12:45.176119 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-24fad721-6875-4816-993f-d59a6720ea01 tempest-FlavorsV255TestJSON-1695885864 tempest-FlavorsV255TestJSON-1695885864-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:45.214216 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-24fad721-6875-4816-993f-d59a6720ea01 tempest-FlavorsV255TestJSON-1695885864 tempest-FlavorsV255TestJSON-1695885864-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 6154 microversion: 2.55 time: 0.042245 Oct 23 01:12:45.215520 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 334/629] 10.222.0.42 () {60 vars in 1187 bytes} [Sun Oct 23 01:12:45 2022] GET /compute/v2.1/flavors/detail => generated 6154 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:12:45.466121 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2071fa37-05dc-4dcd-8131-5161be3d5bcc tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:45.471103 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2071fa37-05dc-4dcd-8131-5161be3d5bcc tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:45.485317 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2071fa37-05dc-4dcd-8131-5161be3d5bcc tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:45.488773 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2071fa37-05dc-4dcd-8131-5161be3d5bcc tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:45.490644 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2071fa37-05dc-4dcd-8131-5161be3d5bcc tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:45.493792 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2071fa37-05dc-4dcd-8131-5161be3d5bcc tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:45.495971 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2071fa37-05dc-4dcd-8131-5161be3d5bcc tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:45.501944 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2071fa37-05dc-4dcd-8131-5161be3d5bcc tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:45.535110 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d93c77d7-04a9-4a38-9c36-1df91c497ed3 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:45.548171 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d93c77d7-04a9-4a38-9c36-1df91c497ed3 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2a1666-1481-4519-9e9a-41909cd03da6" status: 200 len: 1463 microversion: 2.1 time: 0.737402 Oct 23 01:12:45.573554 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 296/630] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:44 2022] GET /compute/v2.1/servers/8f2a1666-1481-4519-9e9a-41909cd03da6 => generated 1463 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:45.941044 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1c086e12-1a35-4fd1-a718-4b3fa4dd45a4 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:45.948073 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1c086e12-1a35-4fd1-a718-4b3fa4dd45a4 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Searching by: {'deleted': False, 'project_id': '9998de26f7ea47e781c1d05c2da2685f'} {{(pid=120944) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 23 01:12:45.962188 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1c086e12-1a35-4fd1-a718-4b3fa4dd45a4 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:45.963077 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1c086e12-1a35-4fd1-a718-4b3fa4dd45a4 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:45.963731 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1c086e12-1a35-4fd1-a718-4b3fa4dd45a4 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:45.964750 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1c086e12-1a35-4fd1-a718-4b3fa4dd45a4 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:45.965433 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1c086e12-1a35-4fd1-a718-4b3fa4dd45a4 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:45.966223 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1c086e12-1a35-4fd1-a718-4b3fa4dd45a4 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:46.104983 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1c086e12-1a35-4fd1-a718-4b3fa4dd45a4 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.521969 Oct 23 01:12:46.109702 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 297/631] 10.222.0.42 () {58 vars in 1146 bytes} [Sun Oct 23 01:12:45 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:12:46.128583 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1ed3a5c0-85df-4b1a-9cbe-139e6e9ead95 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:46.129571 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1ed3a5c0-85df-4b1a-9cbe-139e6e9ead95 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: bc304d93-5c47-4830-af2c-bca071542590] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:46.137660 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1ed3a5c0-85df-4b1a-9cbe-139e6e9ead95 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:46.142121 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1ed3a5c0-85df-4b1a-9cbe-139e6e9ead95 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:46.145370 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1ed3a5c0-85df-4b1a-9cbe-139e6e9ead95 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:46.146441 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1ed3a5c0-85df-4b1a-9cbe-139e6e9ead95 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:46.149088 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1ed3a5c0-85df-4b1a-9cbe-139e6e9ead95 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:46.152721 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1ed3a5c0-85df-4b1a-9cbe-139e6e9ead95 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:47.076278 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2071fa37-05dc-4dcd-8131-5161be3d5bcc tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:47.092392 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2071fa37-05dc-4dcd-8131-5161be3d5bcc tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2" status: 200 len: 1477 microversion: 2.1 time: 1.641779 Oct 23 01:12:47.106259 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 335/632] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:45 2022] GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2 => generated 1477 bytes in 1657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:47.117935 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0ae27a79-e6bc-441c-ab44-a27b7980a112 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:47.118704 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0ae27a79-e6bc-441c-ab44-a27b7980a112 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:47.125840 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0ae27a79-e6bc-441c-ab44-a27b7980a112 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:47.126975 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0ae27a79-e6bc-441c-ab44-a27b7980a112 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:47.127643 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0ae27a79-e6bc-441c-ab44-a27b7980a112 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:47.128638 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0ae27a79-e6bc-441c-ab44-a27b7980a112 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:47.129571 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0ae27a79-e6bc-441c-ab44-a27b7980a112 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:47.130456 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0ae27a79-e6bc-441c-ab44-a27b7980a112 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:47.143699 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1ed3a5c0-85df-4b1a-9cbe-139e6e9ead95 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:47.155124 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1ed3a5c0-85df-4b1a-9cbe-139e6e9ead95 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590" status: 200 len: 1503 microversion: 2.1 time: 1.044033 Oct 23 01:12:47.155721 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 298/633] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:46 2022] GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590 => generated 1503 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:47.171143 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a4ba9315-c261-4ccb-944f-3e591c80e682 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:47.182243 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a4ba9315-c261-4ccb-944f-3e591c80e682 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Searching by: {'deleted': False} {{(pid=120944) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 23 01:12:47.196181 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a4ba9315-c261-4ccb-944f-3e591c80e682 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:47.198346 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a4ba9315-c261-4ccb-944f-3e591c80e682 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:47.198952 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a4ba9315-c261-4ccb-944f-3e591c80e682 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:47.201643 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a4ba9315-c261-4ccb-944f-3e591c80e682 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:47.203546 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a4ba9315-c261-4ccb-944f-3e591c80e682 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:47.204616 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a4ba9315-c261-4ccb-944f-3e591c80e682 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:47.328158 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0ae27a79-e6bc-441c-ab44-a27b7980a112 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:47.344075 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0ae27a79-e6bc-441c-ab44-a27b7980a112 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:47.349200 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0ae27a79-e6bc-441c-ab44-a27b7980a112 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:47.363832 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0ae27a79-e6bc-441c-ab44-a27b7980a112 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1553 microversion: 2.91 time: 0.256136 Oct 23 01:12:47.365013 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 336/634] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:12:47 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1553 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:12:47.393886 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.multi_cell_list [None req-a4ba9315-c261-4ccb-944f-3e591c80e682 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Listed batch of 8 results from cell out of 1000 limit. Returned 8 total so far. {{(pid=120944) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 23 01:12:47.566037 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a4ba9315-c261-4ccb-944f-3e591c80e682 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:47.566564 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a4ba9315-c261-4ccb-944f-3e591c80e682 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:47.567087 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a4ba9315-c261-4ccb-944f-3e591c80e682 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:48.120660 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-aa2b5161-4bf1-4691-b24e-935e39b884c7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:48.121212 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-aa2b5161-4bf1-4691-b24e-935e39b884c7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:48.129362 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa2b5161-4bf1-4691-b24e-935e39b884c7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:48.143500 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa2b5161-4bf1-4691-b24e-935e39b884c7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:48.147895 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa2b5161-4bf1-4691-b24e-935e39b884c7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:48.148962 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa2b5161-4bf1-4691-b24e-935e39b884c7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:48.149516 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa2b5161-4bf1-4691-b24e-935e39b884c7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:48.150068 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa2b5161-4bf1-4691-b24e-935e39b884c7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:48.706328 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-aa2b5161-4bf1-4691-b24e-935e39b884c7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:48.722885 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-aa2b5161-4bf1-4691-b24e-935e39b884c7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2" status: 200 len: 1477 microversion: 2.1 time: 0.606871 Oct 23 01:12:48.723475 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 337/635] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:48 2022] GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2 => generated 1477 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:48.753696 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7f4797ba-990a-49a1-98cb-7b5371040109 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:48.757033 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7f4797ba-990a-49a1-98cb-7b5371040109 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: bc304d93-5c47-4830-af2c-bca071542590] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:48.775795 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f4797ba-990a-49a1-98cb-7b5371040109 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:48.776278 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f4797ba-990a-49a1-98cb-7b5371040109 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:48.779299 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f4797ba-990a-49a1-98cb-7b5371040109 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:48.780040 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f4797ba-990a-49a1-98cb-7b5371040109 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:48.785655 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f4797ba-990a-49a1-98cb-7b5371040109 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:48.786195 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f4797ba-990a-49a1-98cb-7b5371040109 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:48.802531 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a4ba9315-c261-4ccb-944f-3e591c80e682 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 13031 microversion: 2.1 time: 1.634004 Oct 23 01:12:48.803928 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 299/636] 10.222.0.42 () {58 vars in 1171 bytes} [Sun Oct 23 01:12:47 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 13031 bytes in 1646 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:12:48.820011 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-140eb168-60bc-47ce-8317-2e5bd674320d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:48.821387 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-140eb168-60bc-47ce-8317-2e5bd674320d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:48.829885 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-140eb168-60bc-47ce-8317-2e5bd674320d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:48.831940 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-140eb168-60bc-47ce-8317-2e5bd674320d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:48.833097 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-140eb168-60bc-47ce-8317-2e5bd674320d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:48.835514 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-140eb168-60bc-47ce-8317-2e5bd674320d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:48.836217 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-140eb168-60bc-47ce-8317-2e5bd674320d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:48.837242 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-140eb168-60bc-47ce-8317-2e5bd674320d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:49.047667 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-140eb168-60bc-47ce-8317-2e5bd674320d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:49.064660 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-140eb168-60bc-47ce-8317-2e5bd674320d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:49.066242 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-140eb168-60bc-47ce-8317-2e5bd674320d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:49.093923 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-140eb168-60bc-47ce-8317-2e5bd674320d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1553 microversion: 2.91 time: 0.288742 Oct 23 01:12:49.094573 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 300/637] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:12:48 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1553 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:12:49.125784 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-082565db-d9a4-4919-b3e9-91ef6bb2b10d tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:49.131524 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-082565db-d9a4-4919-b3e9-91ef6bb2b10d tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Searching by: {'deleted': False, 'project_id': '9998de26f7ea47e781c1d05c2da2685f'} {{(pid=120944) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 23 01:12:49.163858 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-082565db-d9a4-4919-b3e9-91ef6bb2b10d tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:49.164395 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-082565db-d9a4-4919-b3e9-91ef6bb2b10d tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:49.164842 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-082565db-d9a4-4919-b3e9-91ef6bb2b10d tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:49.165836 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-082565db-d9a4-4919-b3e9-91ef6bb2b10d tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:49.166328 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-082565db-d9a4-4919-b3e9-91ef6bb2b10d tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:49.166757 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-082565db-d9a4-4919-b3e9-91ef6bb2b10d tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:49.277176 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-082565db-d9a4-4919-b3e9-91ef6bb2b10d tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/detail?tenant_id=e6bf637f9ea9423cb3e4e2c74d0382a7" status: 200 len: 15 microversion: 2.1 time: 0.181456 Oct 23 01:12:49.294511 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 301/638] 10.222.0.42 () {58 vars in 1231 bytes} [Sun Oct 23 01:12:49 2022] GET /compute/v2.1/servers/detail?tenant_id=e6bf637f9ea9423cb3e4e2c74d0382a7 => generated 15 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:12:49.313301 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7b13fd21-75e9-4662-b645-1007410dacdf tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:49.339788 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7b13fd21-75e9-4662-b645-1007410dacdf tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Searching by: {'tenant_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'deleted': False} {{(pid=120944) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 23 01:12:49.353458 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b13fd21-75e9-4662-b645-1007410dacdf tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:49.358964 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b13fd21-75e9-4662-b645-1007410dacdf tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:49.359616 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b13fd21-75e9-4662-b645-1007410dacdf tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:49.360739 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b13fd21-75e9-4662-b645-1007410dacdf tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:49.361381 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b13fd21-75e9-4662-b645-1007410dacdf tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:49.362202 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b13fd21-75e9-4662-b645-1007410dacdf tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:49.427540 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.multi_cell_list [None req-7b13fd21-75e9-4662-b645-1007410dacdf tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120944) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 23 01:12:49.546201 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7f4797ba-990a-49a1-98cb-7b5371040109 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:49.555885 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7f4797ba-990a-49a1-98cb-7b5371040109 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590" status: 200 len: 1503 microversion: 2.1 time: 0.819798 Oct 23 01:12:49.563400 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 338/639] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:48 2022] GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590 => generated 1503 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:49.596571 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b13fd21-75e9-4662-b645-1007410dacdf tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:49.597056 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b13fd21-75e9-4662-b645-1007410dacdf tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:49.602461 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b13fd21-75e9-4662-b645-1007410dacdf tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:49.746027 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d6e000a8-431b-4424-9eb3-446f85c83b2b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:49.746840 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d6e000a8-431b-4424-9eb3-446f85c83b2b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:49.765210 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d6e000a8-431b-4424-9eb3-446f85c83b2b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:49.768250 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d6e000a8-431b-4424-9eb3-446f85c83b2b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:49.776070 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d6e000a8-431b-4424-9eb3-446f85c83b2b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:49.776070 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d6e000a8-431b-4424-9eb3-446f85c83b2b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:49.776070 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d6e000a8-431b-4424-9eb3-446f85c83b2b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:49.776070 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d6e000a8-431b-4424-9eb3-446f85c83b2b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:50.086121 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7b13fd21-75e9-4662-b645-1007410dacdf tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=e6bf637f9ea9423cb3e4e2c74d0382a7" status: 200 len: 4824 microversion: 2.1 time: 0.778020 Oct 23 01:12:50.087837 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 302/640] 10.222.0.42 () {58 vars in 1257 bytes} [Sun Oct 23 01:12:49 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=e6bf637f9ea9423cb3e4e2c74d0382a7 => generated 4824 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:50.157568 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a5afcaf9-0987-479f-b7f5-5e4b785ba2e2 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:50.157779 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d6e000a8-431b-4424-9eb3-446f85c83b2b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:50.157884 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a5afcaf9-0987-479f-b7f5-5e4b785ba2e2 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Searching by: {'tenant_id': '9998de26f7ea47e781c1d05c2da2685f', 'deleted': False} {{(pid=120944) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 23 01:12:50.157999 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d6e000a8-431b-4424-9eb3-446f85c83b2b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2" status: 200 len: 1477 microversion: 2.1 time: 0.404016 Oct 23 01:12:50.157999 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 339/641] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:49 2022] GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2 => generated 1477 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:12:50.158168 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5afcaf9-0987-479f-b7f5-5e4b785ba2e2 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:50.158168 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5afcaf9-0987-479f-b7f5-5e4b785ba2e2 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:50.158168 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5afcaf9-0987-479f-b7f5-5e4b785ba2e2 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:50.158168 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5afcaf9-0987-479f-b7f5-5e4b785ba2e2 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:50.158518 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5afcaf9-0987-479f-b7f5-5e4b785ba2e2 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:50.158518 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5afcaf9-0987-479f-b7f5-5e4b785ba2e2 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:50.158692 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-508e4b43-0c55-4f9d-9a01-726f56d7f97d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:50.158692 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-508e4b43-0c55-4f9d-9a01-726f56d7f97d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:50.161958 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-508e4b43-0c55-4f9d-9a01-726f56d7f97d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:50.162775 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-508e4b43-0c55-4f9d-9a01-726f56d7f97d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:50.163488 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-508e4b43-0c55-4f9d-9a01-726f56d7f97d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:50.165174 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-508e4b43-0c55-4f9d-9a01-726f56d7f97d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:50.166144 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-508e4b43-0c55-4f9d-9a01-726f56d7f97d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:50.166882 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-508e4b43-0c55-4f9d-9a01-726f56d7f97d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:50.191294 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a5afcaf9-0987-479f-b7f5-5e4b785ba2e2 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=9998de26f7ea47e781c1d05c2da2685f" status: 200 len: 15 microversion: 2.1 time: 0.077267 Oct 23 01:12:50.192288 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 303/642] 10.222.0.42 () {58 vars in 1257 bytes} [Sun Oct 23 01:12:50 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=9998de26f7ea47e781c1d05c2da2685f => generated 15 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:12:50.215581 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a797c92f-517f-4538-9bbf-c3b1cffa21b7 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:50.220724 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a797c92f-517f-4538-9bbf-c3b1cffa21b7 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.009743 Oct 23 01:12:50.221605 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 304/643] 10.222.0.42 () {58 vars in 1189 bytes} [Sun Oct 23 01:12:50 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:12:50.250939 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-be14d31b-e15c-4cdc-8c58-93e44f1414d6 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:12:50.253246 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-be14d31b-e15c-4cdc-8c58-93e44f1414d6 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] [instance: 8f277484-b3ae-465e-90b7-8febafef9329] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:50.259558 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-be14d31b-e15c-4cdc-8c58-93e44f1414d6 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:50.260146 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-be14d31b-e15c-4cdc-8c58-93e44f1414d6 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:50.260661 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-be14d31b-e15c-4cdc-8c58-93e44f1414d6 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:50.261499 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-be14d31b-e15c-4cdc-8c58-93e44f1414d6 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:50.262102 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-be14d31b-e15c-4cdc-8c58-93e44f1414d6 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:50.262631 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-be14d31b-e15c-4cdc-8c58-93e44f1414d6 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:50.273248 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-508e4b43-0c55-4f9d-9a01-726f56d7f97d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:50.283041 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-508e4b43-0c55-4f9d-9a01-726f56d7f97d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:50.284483 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-508e4b43-0c55-4f9d-9a01-726f56d7f97d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:50.290272 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-508e4b43-0c55-4f9d-9a01-726f56d7f97d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1553 microversion: 2.91 time: 0.141624 Oct 23 01:12:50.291127 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 340/644] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:12:50 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1553 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:12:50.587348 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8afb7a0c-40ca-4134-b74b-ffe6bd9d2bd2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:50.588024 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8afb7a0c-40ca-4134-b74b-ffe6bd9d2bd2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: bc304d93-5c47-4830-af2c-bca071542590] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:50.594153 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8afb7a0c-40ca-4134-b74b-ffe6bd9d2bd2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:50.599680 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8afb7a0c-40ca-4134-b74b-ffe6bd9d2bd2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:50.599680 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8afb7a0c-40ca-4134-b74b-ffe6bd9d2bd2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:50.599680 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8afb7a0c-40ca-4134-b74b-ffe6bd9d2bd2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:50.599680 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8afb7a0c-40ca-4134-b74b-ffe6bd9d2bd2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:50.600064 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8afb7a0c-40ca-4134-b74b-ffe6bd9d2bd2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:50.964182 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-be14d31b-e15c-4cdc-8c58-93e44f1414d6 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329/action" status: 202 len: 0 microversion: 2.1 time: 0.724130 Oct 23 01:12:50.965011 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 305/645] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:12:50 2022] POST /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329/action => generated 0 bytes in 726 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 23 01:12:50.973383 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6454eb22-4925-48b9-8d60-61205245cf03 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:50.983712 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6454eb22-4925-48b9-8d60-61205245cf03 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:50.989445 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6454eb22-4925-48b9-8d60-61205245cf03 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7'} {{(pid=120944) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 23 01:12:51.012073 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6454eb22-4925-48b9-8d60-61205245cf03 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:51.012667 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6454eb22-4925-48b9-8d60-61205245cf03 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:51.016807 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6454eb22-4925-48b9-8d60-61205245cf03 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:51.018071 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6454eb22-4925-48b9-8d60-61205245cf03 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:51.018880 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6454eb22-4925-48b9-8d60-61205245cf03 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:51.019502 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6454eb22-4925-48b9-8d60-61205245cf03 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:51.236094 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8afb7a0c-40ca-4134-b74b-ffe6bd9d2bd2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:51.247357 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.multi_cell_list [None req-6454eb22-4925-48b9-8d60-61205245cf03 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120944) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 23 01:12:51.252070 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8afb7a0c-40ca-4134-b74b-ffe6bd9d2bd2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590" status: 200 len: 1503 microversion: 2.1 time: 0.667583 Oct 23 01:12:51.255066 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 341/646] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:50 2022] GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590 => generated 1503 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:12:51.277409 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c13fff61-46cf-46a8-878f-3ce39c7328a4 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:51.278903 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c13fff61-46cf-46a8-878f-3ce39c7328a4 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:51.289613 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c13fff61-46cf-46a8-878f-3ce39c7328a4 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:51.290950 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c13fff61-46cf-46a8-878f-3ce39c7328a4 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:51.291752 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c13fff61-46cf-46a8-878f-3ce39c7328a4 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:51.292616 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c13fff61-46cf-46a8-878f-3ce39c7328a4 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:51.293407 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c13fff61-46cf-46a8-878f-3ce39c7328a4 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:51.294008 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c13fff61-46cf-46a8-878f-3ce39c7328a4 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:51.378421 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6454eb22-4925-48b9-8d60-61205245cf03 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.408998 Oct 23 01:12:51.379178 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 306/647] 10.222.0.42 () {58 vars in 1150 bytes} [Sun Oct 23 01:12:50 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:12:51.384444 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5514d280-4fe5-4be9-94d3-51b0ef02c4a5 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:51.387113 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5514d280-4fe5-4be9-94d3-51b0ef02c4a5 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:51.398427 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5514d280-4fe5-4be9-94d3-51b0ef02c4a5 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:51.399147 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5514d280-4fe5-4be9-94d3-51b0ef02c4a5 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:51.399592 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5514d280-4fe5-4be9-94d3-51b0ef02c4a5 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:51.401677 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5514d280-4fe5-4be9-94d3-51b0ef02c4a5 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:51.401677 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5514d280-4fe5-4be9-94d3-51b0ef02c4a5 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:51.401677 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5514d280-4fe5-4be9-94d3-51b0ef02c4a5 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:51.690482 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5514d280-4fe5-4be9-94d3-51b0ef02c4a5 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:51.699862 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5514d280-4fe5-4be9-94d3-51b0ef02c4a5 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:51.701444 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5514d280-4fe5-4be9-94d3-51b0ef02c4a5 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:51.706727 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5514d280-4fe5-4be9-94d3-51b0ef02c4a5 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1553 microversion: 2.91 time: 0.326396 Oct 23 01:12:51.707433 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 307/648] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:12:51 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1553 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:12:51.719035 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2a9c9c21-aa08-4e63-9b78-39d00b6345eb tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:12:51.721404 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2a9c9c21-aa08-4e63-9b78-39d00b6345eb tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] [instance: 8f277484-b3ae-465e-90b7-8febafef9329] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:51.728693 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a9c9c21-aa08-4e63-9b78-39d00b6345eb tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:51.729188 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a9c9c21-aa08-4e63-9b78-39d00b6345eb tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:51.729626 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a9c9c21-aa08-4e63-9b78-39d00b6345eb tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:51.730365 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a9c9c21-aa08-4e63-9b78-39d00b6345eb tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:51.730827 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a9c9c21-aa08-4e63-9b78-39d00b6345eb tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:51.731247 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a9c9c21-aa08-4e63-9b78-39d00b6345eb tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:51.919739 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c13fff61-46cf-46a8-878f-3ce39c7328a4 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:51.930868 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c13fff61-46cf-46a8-878f-3ce39c7328a4 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2" status: 200 len: 1477 microversion: 2.1 time: 0.672656 Oct 23 01:12:51.933775 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 342/649] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:51 2022] GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2 => generated 1477 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:52.149082 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2a9c9c21-aa08-4e63-9b78-39d00b6345eb tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329/action" status: 202 len: 0 microversion: 2.1 time: 0.433304 Oct 23 01:12:52.149717 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 308/650] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:12:51 2022] POST /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329/action => generated 0 bytes in 442 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:12:52.157934 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a6635622-57f5-41c3-8013-437fd00c1953 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:52.159666 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a6635622-57f5-41c3-8013-437fd00c1953 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] [instance: 8f277484-b3ae-465e-90b7-8febafef9329] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:52.166489 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a6635622-57f5-41c3-8013-437fd00c1953 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:52.167046 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a6635622-57f5-41c3-8013-437fd00c1953 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:52.167545 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a6635622-57f5-41c3-8013-437fd00c1953 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:52.168323 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a6635622-57f5-41c3-8013-437fd00c1953 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:52.168947 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a6635622-57f5-41c3-8013-437fd00c1953 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:52.169482 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a6635622-57f5-41c3-8013-437fd00c1953 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:52.280570 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-eb5b296c-d29e-4e46-b48a-5390d074367f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:52.281865 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-eb5b296c-d29e-4e46-b48a-5390d074367f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: bc304d93-5c47-4830-af2c-bca071542590] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:52.290392 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb5b296c-d29e-4e46-b48a-5390d074367f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:52.294668 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb5b296c-d29e-4e46-b48a-5390d074367f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:52.294668 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb5b296c-d29e-4e46-b48a-5390d074367f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:52.294668 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb5b296c-d29e-4e46-b48a-5390d074367f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:52.294668 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb5b296c-d29e-4e46-b48a-5390d074367f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:52.295036 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb5b296c-d29e-4e46-b48a-5390d074367f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:52.916609 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a6635622-57f5-41c3-8013-437fd00c1953 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329" status: 200 len: 1614 microversion: 2.1 time: 0.762484 Oct 23 01:12:52.917777 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 343/651] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:52 2022] GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329 => generated 1614 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:52.918729 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-eb5b296c-d29e-4e46-b48a-5390d074367f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:52.922922 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a599f32b-a1e0-48be-bbe1-2c2a3374add8 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:52.923648 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a599f32b-a1e0-48be-bbe1-2c2a3374add8 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:52.932919 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a599f32b-a1e0-48be-bbe1-2c2a3374add8 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:52.934251 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a599f32b-a1e0-48be-bbe1-2c2a3374add8 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:52.939645 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a599f32b-a1e0-48be-bbe1-2c2a3374add8 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:52.939645 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a599f32b-a1e0-48be-bbe1-2c2a3374add8 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:52.939645 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a599f32b-a1e0-48be-bbe1-2c2a3374add8 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:52.939645 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a599f32b-a1e0-48be-bbe1-2c2a3374add8 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:52.954966 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-eb5b296c-d29e-4e46-b48a-5390d074367f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590" status: 200 len: 1503 microversion: 2.1 time: 0.676849 Oct 23 01:12:52.959242 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 309/652] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:52 2022] GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590 => generated 1503 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:52.991518 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f4426ca6-f572-4389-a052-0aaa2ee01a6a tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:52.994223 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f4426ca6-f572-4389-a052-0aaa2ee01a6a tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] [instance: 8f277484-b3ae-465e-90b7-8febafef9329] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:53.026944 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4426ca6-f572-4389-a052-0aaa2ee01a6a tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:53.028355 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4426ca6-f572-4389-a052-0aaa2ee01a6a tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:53.029415 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4426ca6-f572-4389-a052-0aaa2ee01a6a tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:53.031122 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4426ca6-f572-4389-a052-0aaa2ee01a6a tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:53.034264 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4426ca6-f572-4389-a052-0aaa2ee01a6a tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:53.040091 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4426ca6-f572-4389-a052-0aaa2ee01a6a tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:53.060557 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a599f32b-a1e0-48be-bbe1-2c2a3374add8 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:53.071279 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a599f32b-a1e0-48be-bbe1-2c2a3374add8 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:53.073116 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a599f32b-a1e0-48be-bbe1-2c2a3374add8 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:53.080652 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a599f32b-a1e0-48be-bbe1-2c2a3374add8 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1553 microversion: 2.91 time: 0.161504 Oct 23 01:12:53.081450 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 344/653] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:12:52 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:12:53.086359 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1892cd2c-6a2b-469f-9da7-c69c5956ef71 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:53.087279 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1892cd2c-6a2b-469f-9da7-c69c5956ef71 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:53.093492 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1892cd2c-6a2b-469f-9da7-c69c5956ef71 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:53.094013 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1892cd2c-6a2b-469f-9da7-c69c5956ef71 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:53.094627 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1892cd2c-6a2b-469f-9da7-c69c5956ef71 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:53.095325 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1892cd2c-6a2b-469f-9da7-c69c5956ef71 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:53.095784 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1892cd2c-6a2b-469f-9da7-c69c5956ef71 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:53.096212 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1892cd2c-6a2b-469f-9da7-c69c5956ef71 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:53.100316 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=100 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:53.373763 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:53.378610 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f4426ca6-f572-4389-a052-0aaa2ee01a6a tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329" status: 200 len: 1614 microversion: 2.1 time: 0.400897 Oct 23 01:12:53.379389 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 310/654] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:52 2022] GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329 => generated 1614 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:53.401947 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1892cd2c-6a2b-469f-9da7-c69c5956ef71 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:53.407109 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d86249c0-586c-4b25-926d-eac45e086dc0 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:53.411760 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1892cd2c-6a2b-469f-9da7-c69c5956ef71 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2" status: 200 len: 1477 microversion: 2.1 time: 0.328941 Oct 23 01:12:53.412812 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 345/655] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:53 2022] GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2 => generated 1477 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:53.416155 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d86249c0-586c-4b25-926d-eac45e086dc0 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Searching by: {'host': 'n-h1-master-1', 'deleted': False} {{(pid=120944) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 23 01:12:53.423397 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d86249c0-586c-4b25-926d-eac45e086dc0 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:53.424170 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d86249c0-586c-4b25-926d-eac45e086dc0 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:53.424840 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d86249c0-586c-4b25-926d-eac45e086dc0 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:53.425941 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d86249c0-586c-4b25-926d-eac45e086dc0 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:53.426825 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d86249c0-586c-4b25-926d-eac45e086dc0 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:53.431716 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d86249c0-586c-4b25-926d-eac45e086dc0 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:53.526801 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.multi_cell_list [None req-d86249c0-586c-4b25-926d-eac45e086dc0 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Listed batch of 4 results from cell out of 1000 limit. Returned 4 total so far. {{(pid=120944) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 23 01:12:53.591023 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d86249c0-586c-4b25-926d-eac45e086dc0 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] 10.222.0.42 "GET /compute/v2.1/servers?host=n-h1-master-1&all_tenants=1" status: 200 len: 1311 microversion: 2.1 time: 0.189401 Oct 23 01:12:53.592097 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 311/656] 10.222.0.42 () {58 vars in 1190 bytes} [Sun Oct 23 01:12:53 2022] GET /compute/v2.1/servers?host=n-h1-master-1&all_tenants=1 => generated 1311 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:12:53.605729 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8ab13095-52c4-405a-acd0-f16679de4d44 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:53.612298 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8ab13095-52c4-405a-acd0-f16679de4d44 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=120945) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 23 01:12:53.619246 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8ab13095-52c4-405a-acd0-f16679de4d44 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:53.619831 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8ab13095-52c4-405a-acd0-f16679de4d44 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:53.620404 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8ab13095-52c4-405a-acd0-f16679de4d44 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:53.621195 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8ab13095-52c4-405a-acd0-f16679de4d44 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:53.621934 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8ab13095-52c4-405a-acd0-f16679de4d44 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:53.622634 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8ab13095-52c4-405a-acd0-f16679de4d44 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:53.710576 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8ab13095-52c4-405a-acd0-f16679de4d44 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] 10.222.0.42 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.109683 Oct 23 01:12:53.711699 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 346/657] 10.222.0.42 () {58 vars in 1196 bytes} [Sun Oct 23 01:12:53 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:12:53.735121 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-33b4c926-f568-45c6-9903-48890b3820d1 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:12:53.739910 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-33b4c926-f568-45c6-9903-48890b3820d1 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] [instance: 8f277484-b3ae-465e-90b7-8febafef9329] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:53.747070 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-33b4c926-f568-45c6-9903-48890b3820d1 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:53.748072 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-33b4c926-f568-45c6-9903-48890b3820d1 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:53.748705 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-33b4c926-f568-45c6-9903-48890b3820d1 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:53.749578 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-33b4c926-f568-45c6-9903-48890b3820d1 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:53.750342 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-33b4c926-f568-45c6-9903-48890b3820d1 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:53.751505 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-33b4c926-f568-45c6-9903-48890b3820d1 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:53.982059 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0d619390-3126-4cd7-b0f5-d082055abb3f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:53.982902 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0d619390-3126-4cd7-b0f5-d082055abb3f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: bc304d93-5c47-4830-af2c-bca071542590] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:53.994388 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d619390-3126-4cd7-b0f5-d082055abb3f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:54.000460 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d619390-3126-4cd7-b0f5-d082055abb3f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:54.002980 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d619390-3126-4cd7-b0f5-d082055abb3f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:54.006700 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d619390-3126-4cd7-b0f5-d082055abb3f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:54.007404 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d619390-3126-4cd7-b0f5-d082055abb3f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:54.008717 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d619390-3126-4cd7-b0f5-d082055abb3f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:54.097992 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-33b4c926-f568-45c6-9903-48890b3820d1 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329/action" status: 202 len: 0 microversion: 2.1 time: 0.377299 Oct 23 01:12:54.099032 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 312/658] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:12:53 2022] POST /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329/action => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:12:54.108853 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3c76af79-a7de-463b-be79-f28f345570f6 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:12:54.118224 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3c76af79-a7de-463b-be79-f28f345570f6 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f277484-b3ae-465e-90b7-8febafef9329] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:54.127413 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3c76af79-a7de-463b-be79-f28f345570f6 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:54.128245 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3c76af79-a7de-463b-be79-f28f345570f6 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:54.142640 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3c76af79-a7de-463b-be79-f28f345570f6 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:54.148158 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3c76af79-a7de-463b-be79-f28f345570f6 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:54.149302 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3c76af79-a7de-463b-be79-f28f345570f6 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:54.152617 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3c76af79-a7de-463b-be79-f28f345570f6 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:54.327273 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-3c76af79-a7de-463b-be79-f28f345570f6 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:12:54.329839 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-3c76af79-a7de-463b-be79-f28f345570f6 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:12:54.330604 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-3c76af79-a7de-463b-be79-f28f345570f6 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:12:54.332033 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-3c76af79-a7de-463b-be79-f28f345570f6 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:12:54.332033 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-3c76af79-a7de-463b-be79-f28f345570f6 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:12:54.419984 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0d619390-3126-4cd7-b0f5-d082055abb3f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:54.436317 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0d619390-3126-4cd7-b0f5-d082055abb3f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590" status: 200 len: 1503 microversion: 2.1 time: 0.452570 Oct 23 01:12:54.437529 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 347/659] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:53 2022] GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590 => generated 1503 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:12:54.462354 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cf48bcf4-6752-4504-a6fe-8e7e5840b2a4 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:54.463663 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cf48bcf4-6752-4504-a6fe-8e7e5840b2a4 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:54.479894 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf48bcf4-6752-4504-a6fe-8e7e5840b2a4 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:54.480399 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf48bcf4-6752-4504-a6fe-8e7e5840b2a4 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:54.480838 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf48bcf4-6752-4504-a6fe-8e7e5840b2a4 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:54.481548 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf48bcf4-6752-4504-a6fe-8e7e5840b2a4 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:54.482091 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf48bcf4-6752-4504-a6fe-8e7e5840b2a4 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:54.482748 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf48bcf4-6752-4504-a6fe-8e7e5840b2a4 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:54.611238 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3c76af79-a7de-463b-be79-f28f345570f6 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f277484-b3ae-465e-90b7-8febafef9329] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:54.627816 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3c76af79-a7de-463b-be79-f28f345570f6 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:54.635060 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3c76af79-a7de-463b-be79-f28f345570f6 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:54.636727 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3c76af79-a7de-463b-be79-f28f345570f6 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:54.638770 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3c76af79-a7de-463b-be79-f28f345570f6 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:54.641554 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3c76af79-a7de-463b-be79-f28f345570f6 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:54.643752 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3c76af79-a7de-463b-be79-f28f345570f6 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:54.690208 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3c76af79-a7de-463b-be79-f28f345570f6 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "POST /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329/action" status: 202 len: 1067 microversion: 2.1 time: 0.584993 Oct 23 01:12:54.691615 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 313/660] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:12:54 2022] POST /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329/action => generated 1067 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 23 01:12:54.698436 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9863ac2d-399f-40b9-aaec-9990e7163d09 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:54.699638 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9863ac2d-399f-40b9-aaec-9990e7163d09 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:54.704652 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cf48bcf4-6752-4504-a6fe-8e7e5840b2a4 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:54.708962 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9863ac2d-399f-40b9-aaec-9990e7163d09 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:54.710389 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9863ac2d-399f-40b9-aaec-9990e7163d09 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:54.711718 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9863ac2d-399f-40b9-aaec-9990e7163d09 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:54.713354 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9863ac2d-399f-40b9-aaec-9990e7163d09 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:54.714310 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9863ac2d-399f-40b9-aaec-9990e7163d09 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:54.715556 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9863ac2d-399f-40b9-aaec-9990e7163d09 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:54.724180 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cf48bcf4-6752-4504-a6fe-8e7e5840b2a4 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:54.729019 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cf48bcf4-6752-4504-a6fe-8e7e5840b2a4 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:54.738068 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cf48bcf4-6752-4504-a6fe-8e7e5840b2a4 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1535 microversion: 2.91 time: 0.298972 Oct 23 01:12:54.739520 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 348/661] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:12:54 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1535 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:12:54.746696 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f736fe5f-2eb0-4441-8f7e-92ad86f7a63c tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:54.746696 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f736fe5f-2eb0-4441-8f7e-92ad86f7a63c tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f277484-b3ae-465e-90b7-8febafef9329] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:54.753431 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f736fe5f-2eb0-4441-8f7e-92ad86f7a63c tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:54.754205 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f736fe5f-2eb0-4441-8f7e-92ad86f7a63c tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:54.755210 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f736fe5f-2eb0-4441-8f7e-92ad86f7a63c tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:54.756556 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f736fe5f-2eb0-4441-8f7e-92ad86f7a63c tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:54.757182 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f736fe5f-2eb0-4441-8f7e-92ad86f7a63c tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:54.757767 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f736fe5f-2eb0-4441-8f7e-92ad86f7a63c tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:55.220137 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9863ac2d-399f-40b9-aaec-9990e7163d09 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:55.267091 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9863ac2d-399f-40b9-aaec-9990e7163d09 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2" status: 200 len: 1477 microversion: 2.1 time: 0.564790 Oct 23 01:12:55.270142 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 314/662] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:54 2022] GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2 => generated 1477 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:55.393380 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f736fe5f-2eb0-4441-8f7e-92ad86f7a63c tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:55.403105 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f736fe5f-2eb0-4441-8f7e-92ad86f7a63c tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329" status: 200 len: 1471 microversion: 2.1 time: 0.662349 Oct 23 01:12:55.409060 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 349/663] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:54 2022] GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329 => generated 1471 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:55.460367 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bc2ab5d9-1494-45d1-a9b3-cb9c940c895c tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:55.461841 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bc2ab5d9-1494-45d1-a9b3-cb9c940c895c tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: bc304d93-5c47-4830-af2c-bca071542590] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:55.482334 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc2ab5d9-1494-45d1-a9b3-cb9c940c895c tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:55.484148 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc2ab5d9-1494-45d1-a9b3-cb9c940c895c tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:55.484743 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc2ab5d9-1494-45d1-a9b3-cb9c940c895c tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:55.485719 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc2ab5d9-1494-45d1-a9b3-cb9c940c895c tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:55.488827 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc2ab5d9-1494-45d1-a9b3-cb9c940c895c tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:55.490605 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc2ab5d9-1494-45d1-a9b3-cb9c940c895c tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:55.733461 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bc2ab5d9-1494-45d1-a9b3-cb9c940c895c tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:55.741810 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bc2ab5d9-1494-45d1-a9b3-cb9c940c895c tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590" status: 200 len: 1503 microversion: 2.1 time: 0.285961 Oct 23 01:12:55.742418 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 315/664] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:55 2022] GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590 => generated 1503 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:55.781837 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-04584883-406e-41bd-8ed5-0ea11c23a495 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:55.782479 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-04584883-406e-41bd-8ed5-0ea11c23a495 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:55.788629 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-04584883-406e-41bd-8ed5-0ea11c23a495 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:55.789121 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-04584883-406e-41bd-8ed5-0ea11c23a495 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:55.789558 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-04584883-406e-41bd-8ed5-0ea11c23a495 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:55.790289 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-04584883-406e-41bd-8ed5-0ea11c23a495 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:55.790752 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-04584883-406e-41bd-8ed5-0ea11c23a495 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:55.791429 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-04584883-406e-41bd-8ed5-0ea11c23a495 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:55.861966 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-04584883-406e-41bd-8ed5-0ea11c23a495 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:55.873045 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-04584883-406e-41bd-8ed5-0ea11c23a495 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:55.875068 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-04584883-406e-41bd-8ed5-0ea11c23a495 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:55.882714 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-04584883-406e-41bd-8ed5-0ea11c23a495 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1535 microversion: 2.91 time: 0.105656 Oct 23 01:12:55.884703 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 350/665] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:12:55 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1535 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:12:56.295804 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-d64d72c8-8f85-485d-8fbe-8fedba67f772 req-64450842-7519-45ce-aeef-9b0dc3987afa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ae2878c-23a6-4e78-bd92-69fb03fc27b2", "name": "network-vif-unplugged", "status": "completed", "tag": "9915372e-5565-43b8-b511-9fbf12974675"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:12:56.296191 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-563ec19e-a9a7-4f6e-a41f-33b970a09238 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:56.296823 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-563ec19e-a9a7-4f6e-a41f-33b970a09238 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:56.309452 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-563ec19e-a9a7-4f6e-a41f-33b970a09238 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:56.309963 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-563ec19e-a9a7-4f6e-a41f-33b970a09238 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:56.311534 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-d64d72c8-8f85-485d-8fbe-8fedba67f772 req-64450842-7519-45ce-aeef-9b0dc3987afa service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:56.312373 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-563ec19e-a9a7-4f6e-a41f-33b970a09238 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:56.312518 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-d64d72c8-8f85-485d-8fbe-8fedba67f772 req-64450842-7519-45ce-aeef-9b0dc3987afa service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:56.314435 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-d64d72c8-8f85-485d-8fbe-8fedba67f772 req-64450842-7519-45ce-aeef-9b0dc3987afa service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:56.315753 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-563ec19e-a9a7-4f6e-a41f-33b970a09238 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:56.316248 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-563ec19e-a9a7-4f6e-a41f-33b970a09238 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:56.319314 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-563ec19e-a9a7-4f6e-a41f-33b970a09238 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:56.335781 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-d64d72c8-8f85-485d-8fbe-8fedba67f772 req-64450842-7519-45ce-aeef-9b0dc3987afa service nova] Creating event network-vif-unplugged:9915372e-5565-43b8-b511-9fbf12974675 for instance 4ae2878c-23a6-4e78-bd92-69fb03fc27b2 on n-h1-master-1 Oct 23 01:12:56.361560 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [req-d64d72c8-8f85-485d-8fbe-8fedba67f772 req-64450842-7519-45ce-aeef-9b0dc3987afa service nova] Instance 4ae2878c-23a6-4e78-bd92-69fb03fc27b2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120944) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 23 01:12:56.382443 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-d64d72c8-8f85-485d-8fbe-8fedba67f772 req-64450842-7519-45ce-aeef-9b0dc3987afa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090979 Oct 23 01:12:56.384765 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 316/666] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:12:56.499855 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b65a4105-556f-4b05-8ba7-cb1d54a058ab tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:56.501603 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b65a4105-556f-4b05-8ba7-cb1d54a058ab tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f277484-b3ae-465e-90b7-8febafef9329] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:56.510994 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b65a4105-556f-4b05-8ba7-cb1d54a058ab tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:56.512760 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b65a4105-556f-4b05-8ba7-cb1d54a058ab tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:56.513430 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b65a4105-556f-4b05-8ba7-cb1d54a058ab tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:56.514520 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b65a4105-556f-4b05-8ba7-cb1d54a058ab tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:56.515571 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b65a4105-556f-4b05-8ba7-cb1d54a058ab tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:56.516503 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b65a4105-556f-4b05-8ba7-cb1d54a058ab tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:56.526247 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-563ec19e-a9a7-4f6e-a41f-33b970a09238 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:56.538480 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-563ec19e-a9a7-4f6e-a41f-33b970a09238 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2" status: 200 len: 1476 microversion: 2.1 time: 0.247406 Oct 23 01:12:56.539374 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 351/667] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:56 2022] GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2 => generated 1476 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:12:56.687411 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b65a4105-556f-4b05-8ba7-cb1d54a058ab tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:56.700833 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b65a4105-556f-4b05-8ba7-cb1d54a058ab tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329" status: 200 len: 1471 microversion: 2.1 time: 0.206469 Oct 23 01:12:56.701442 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 317/668] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:56 2022] GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329 => generated 1471 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:12:56.771003 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e7dab133-7e65-43af-89ae-6341aebcdfe2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:56.771003 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e7dab133-7e65-43af-89ae-6341aebcdfe2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: bc304d93-5c47-4830-af2c-bca071542590] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:56.774012 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e7dab133-7e65-43af-89ae-6341aebcdfe2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:56.774587 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e7dab133-7e65-43af-89ae-6341aebcdfe2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:56.775098 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e7dab133-7e65-43af-89ae-6341aebcdfe2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:56.775939 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e7dab133-7e65-43af-89ae-6341aebcdfe2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:56.776461 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e7dab133-7e65-43af-89ae-6341aebcdfe2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:56.777165 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e7dab133-7e65-43af-89ae-6341aebcdfe2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:56.911836 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-82375d57-a6d1-4ff2-80e0-8774b42ba4a2 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:56.921441 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-82375d57-a6d1-4ff2-80e0-8774b42ba4a2 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:56.938691 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e7dab133-7e65-43af-89ae-6341aebcdfe2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:56.940895 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-82375d57-a6d1-4ff2-80e0-8774b42ba4a2 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:56.945894 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-82375d57-a6d1-4ff2-80e0-8774b42ba4a2 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:56.946578 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-82375d57-a6d1-4ff2-80e0-8774b42ba4a2 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:56.947624 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-82375d57-a6d1-4ff2-80e0-8774b42ba4a2 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:56.949609 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-82375d57-a6d1-4ff2-80e0-8774b42ba4a2 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:56.950435 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-82375d57-a6d1-4ff2-80e0-8774b42ba4a2 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:56.956775 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e7dab133-7e65-43af-89ae-6341aebcdfe2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590" status: 200 len: 1503 microversion: 2.1 time: 0.194502 Oct 23 01:12:56.959210 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 352/669] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:56 2022] GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590 => generated 1503 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:57.046941 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-82375d57-a6d1-4ff2-80e0-8774b42ba4a2 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:57.056798 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-82375d57-a6d1-4ff2-80e0-8774b42ba4a2 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:57.060187 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-82375d57-a6d1-4ff2-80e0-8774b42ba4a2 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:57.067061 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:57.073734 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-82375d57-a6d1-4ff2-80e0-8774b42ba4a2 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1535 microversion: 2.91 time: 0.162634 Oct 23 01:12:57.078772 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 318/670] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:12:56 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1535 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:12:57.564226 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-452dd000-a892-4bf5-bf7d-1f7c27866f4e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:57.565058 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-452dd000-a892-4bf5-bf7d-1f7c27866f4e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:57.577045 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-452dd000-a892-4bf5-bf7d-1f7c27866f4e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:57.579969 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-452dd000-a892-4bf5-bf7d-1f7c27866f4e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:57.580479 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-452dd000-a892-4bf5-bf7d-1f7c27866f4e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:57.581226 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-452dd000-a892-4bf5-bf7d-1f7c27866f4e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:57.581690 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-452dd000-a892-4bf5-bf7d-1f7c27866f4e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:57.582148 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-452dd000-a892-4bf5-bf7d-1f7c27866f4e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:57.738472 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c000f9b0-a26a-498d-9583-d941a3cd1e42 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:57.740932 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c000f9b0-a26a-498d-9583-d941a3cd1e42 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f277484-b3ae-465e-90b7-8febafef9329] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:57.753200 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c000f9b0-a26a-498d-9583-d941a3cd1e42 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:57.754299 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c000f9b0-a26a-498d-9583-d941a3cd1e42 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:57.756125 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c000f9b0-a26a-498d-9583-d941a3cd1e42 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:57.757218 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c000f9b0-a26a-498d-9583-d941a3cd1e42 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:57.758449 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c000f9b0-a26a-498d-9583-d941a3cd1e42 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:57.759250 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c000f9b0-a26a-498d-9583-d941a3cd1e42 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:57.832653 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-452dd000-a892-4bf5-bf7d-1f7c27866f4e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:57.842729 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-452dd000-a892-4bf5-bf7d-1f7c27866f4e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2" status: 200 len: 1476 microversion: 2.1 time: 0.282436 Oct 23 01:12:57.859252 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 353/671] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:57 2022] GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2 => generated 1476 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:57.981285 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-73fdc434-2f27-4257-a909-e00b3f894ec0 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:57.982297 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-73fdc434-2f27-4257-a909-e00b3f894ec0 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: bc304d93-5c47-4830-af2c-bca071542590] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:57.990395 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-73fdc434-2f27-4257-a909-e00b3f894ec0 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:57.991160 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-73fdc434-2f27-4257-a909-e00b3f894ec0 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:57.991794 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-73fdc434-2f27-4257-a909-e00b3f894ec0 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:57.992829 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-73fdc434-2f27-4257-a909-e00b3f894ec0 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:57.993291 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-73fdc434-2f27-4257-a909-e00b3f894ec0 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:57.993723 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-73fdc434-2f27-4257-a909-e00b3f894ec0 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:58.018081 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c000f9b0-a26a-498d-9583-d941a3cd1e42 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:58.028078 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c000f9b0-a26a-498d-9583-d941a3cd1e42 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329" status: 200 len: 1471 microversion: 2.1 time: 0.305830 Oct 23 01:12:58.029602 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 319/672] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:57 2022] GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329 => generated 1471 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:58.099644 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4b22fda9-9d34-4c25-923b-aad2a027fa34 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:58.100265 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4b22fda9-9d34-4c25-923b-aad2a027fa34 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:58.112315 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4b22fda9-9d34-4c25-923b-aad2a027fa34 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:58.113262 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4b22fda9-9d34-4c25-923b-aad2a027fa34 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:58.113966 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4b22fda9-9d34-4c25-923b-aad2a027fa34 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:58.114944 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4b22fda9-9d34-4c25-923b-aad2a027fa34 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:58.115626 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4b22fda9-9d34-4c25-923b-aad2a027fa34 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:58.116280 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4b22fda9-9d34-4c25-923b-aad2a027fa34 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:58.250548 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-73fdc434-2f27-4257-a909-e00b3f894ec0 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:58.251043 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4b22fda9-9d34-4c25-923b-aad2a027fa34 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:58.268590 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4b22fda9-9d34-4c25-923b-aad2a027fa34 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:58.270571 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4b22fda9-9d34-4c25-923b-aad2a027fa34 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:58.277049 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4b22fda9-9d34-4c25-923b-aad2a027fa34 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1478 microversion: 2.91 time: 0.181350 Oct 23 01:12:58.279014 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 320/673] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:12:58 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1478 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:12:58.284900 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-73fdc434-2f27-4257-a909-e00b3f894ec0 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590" status: 200 len: 1478 microversion: 2.1 time: 0.307592 Oct 23 01:12:58.291745 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 354/674] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:57 2022] GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590 => generated 1478 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:58.326874 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7e25519b-9345-49f2-bbec-4ef782caa06f tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Calling method '.version_select at 0x7f5cc254d310>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:58.327125 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9d7f22d3-7056-4268-80d5-5f59f4cddfc3 tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-master-1"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:12:58.330096 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9d7f22d3-7056-4268-80d5-5f59f4cddfc3 tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:58.331062 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e25519b-9345-49f2-bbec-4ef782caa06f tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:58.331559 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e25519b-9345-49f2-bbec-4ef782caa06f tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:58.332057 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e25519b-9345-49f2-bbec-4ef782caa06f tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:58.341795 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d7f22d3-7056-4268-80d5-5f59f4cddfc3 tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:58.343803 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d7f22d3-7056-4268-80d5-5f59f4cddfc3 tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:58.344341 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d7f22d3-7056-4268-80d5-5f59f4cddfc3 tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:58.345138 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d7f22d3-7056-4268-80d5-5f59f4cddfc3 tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:58.345712 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d7f22d3-7056-4268-80d5-5f59f4cddfc3 tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:58.346269 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d7f22d3-7056-4268-80d5-5f59f4cddfc3 tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:58.347081 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7e25519b-9345-49f2-bbec-4ef782caa06f tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] 10.222.0.42 "GET /compute/v2.1/os-migrations" status: 200 len: 1180 microversion: 2.1 time: 0.028624 Oct 23 01:12:58.347872 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 321/675] 10.222.0.42 () {58 vars in 1143 bytes} [Sun Oct 23 01:12:58 2022] GET /compute/v2.1/os-migrations => generated 1180 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:12:58.364717 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9633cdf6-2be4-437c-b9ad-091ccf910b21 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:58.365676 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9633cdf6-2be4-437c-b9ad-091ccf910b21 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] [instance: bc304d93-5c47-4830-af2c-bca071542590] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:58.372838 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9633cdf6-2be4-437c-b9ad-091ccf910b21 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:58.373565 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9633cdf6-2be4-437c-b9ad-091ccf910b21 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:58.374256 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9633cdf6-2be4-437c-b9ad-091ccf910b21 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:58.375121 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9633cdf6-2be4-437c-b9ad-091ccf910b21 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:58.376036 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9633cdf6-2be4-437c-b9ad-091ccf910b21 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:58.376630 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9633cdf6-2be4-437c-b9ad-091ccf910b21 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:58.439204 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9d7f22d3-7056-4268-80d5-5f59f4cddfc3 tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-master-1". {{(pid=120945) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 23 01:12:58.544974 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9633cdf6-2be4-437c-b9ad-091ccf910b21 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590" status: 200 len: 1629 microversion: 2.1 time: 0.186194 Oct 23 01:12:58.558454 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 322/676] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:58 2022] GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590 => generated 1629 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:12:58.579972 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dccf3ba5-c55b-4cbd-a40a-f7685eff684f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Action: 'create', calling method: .version_select at 0x7f5cc22c10d0>, body: {"keypair": {"name": "tempest-keypair-224498026", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1NfFOJBV1RPxDouhgH3Y0VIurFotgb0bFqVVvV67LMaIitf4TKagoPjSGTVPZM4Lxv+t6tLkbxFaA8BrJTpukpCpuAJlf+zr7HUfBy/IRGX4leqoSoBiZbRww/DyUNhw=="}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:12:58.597750 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-dccf3ba5-c55b-4cbd-a40a-f7685eff684f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Getting quotas for project d46a7166e4144f55a102ea6335c5f820. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:12:58.603494 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-dccf3ba5-c55b-4cbd-a40a-f7685eff684f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Getting quotas for user 1c2310cbc3574eb29a6ca6291ba7808e and project d46a7166e4144f55a102ea6335c5f820. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:12:58.753430 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-dccf3ba5-c55b-4cbd-a40a-f7685eff684f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.180848 Oct 23 01:12:58.768636 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 323/677] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 01:12:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:12:58.803301 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-afff752c-050c-4175-97fa-aeac96c921f7 req-88c9ff4b-9cfe-47dd-bf00-cb960c6ced74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ae2878c-23a6-4e78-bd92-69fb03fc27b2", "tag": "9915372e-5565-43b8-b511-9fbf12974675"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:12:58.810387 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9d7f22d3-7056-4268-80d5-5f59f4cddfc3 tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b/action" status: 202 len: 0 microversion: 2.91 time: 0.488304 Oct 23 01:12:58.813927 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 355/678] 10.222.0.42 () {62 vars in 1319 bytes} [Sun Oct 23 01:12:58 2022] POST /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b/action => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:12:58.832369 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7999e44f-1004-4ed9-8555-4818c0d2c73b tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:58.844157 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7999e44f-1004-4ed9-8555-4818c0d2c73b tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:58.849593 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-afff752c-050c-4175-97fa-aeac96c921f7 req-88c9ff4b-9cfe-47dd-bf00-cb960c6ced74 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:58.854666 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-afff752c-050c-4175-97fa-aeac96c921f7 req-88c9ff4b-9cfe-47dd-bf00-cb960c6ced74 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:58.870555 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-afff752c-050c-4175-97fa-aeac96c921f7 req-88c9ff4b-9cfe-47dd-bf00-cb960c6ced74 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:58.887189 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7999e44f-1004-4ed9-8555-4818c0d2c73b tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:58.887681 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7999e44f-1004-4ed9-8555-4818c0d2c73b tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:58.888113 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7999e44f-1004-4ed9-8555-4818c0d2c73b tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:58.888854 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7999e44f-1004-4ed9-8555-4818c0d2c73b tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:58.899889 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7999e44f-1004-4ed9-8555-4818c0d2c73b tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:58.900435 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7999e44f-1004-4ed9-8555-4818c0d2c73b tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:58.930696 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-afff752c-050c-4175-97fa-aeac96c921f7 req-88c9ff4b-9cfe-47dd-bf00-cb960c6ced74 service nova] Creating event network-changed:9915372e-5565-43b8-b511-9fbf12974675 for instance 4ae2878c-23a6-4e78-bd92-69fb03fc27b2 on n-h1-master-1 Oct 23 01:12:58.972602 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [req-afff752c-050c-4175-97fa-aeac96c921f7 req-88c9ff4b-9cfe-47dd-bf00-cb960c6ced74 service nova] Instance 4ae2878c-23a6-4e78-bd92-69fb03fc27b2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120944) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 23 01:12:59.025488 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-afff752c-050c-4175-97fa-aeac96c921f7 req-88c9ff4b-9cfe-47dd-bf00-cb960c6ced74 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.254099 Oct 23 01:12:59.028149 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 324/679] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:12:59.045249 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c0d89d0e-3a82-4ca2-a948-4c90293d0703 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:59.045249 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c0d89d0e-3a82-4ca2-a948-4c90293d0703 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:59.070967 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c0d89d0e-3a82-4ca2-a948-4c90293d0703 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:59.071646 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c0d89d0e-3a82-4ca2-a948-4c90293d0703 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:59.074570 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c0d89d0e-3a82-4ca2-a948-4c90293d0703 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:59.075681 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c0d89d0e-3a82-4ca2-a948-4c90293d0703 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:59.079556 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c0d89d0e-3a82-4ca2-a948-4c90293d0703 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:59.079556 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c0d89d0e-3a82-4ca2-a948-4c90293d0703 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:59.252410 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7999e44f-1004-4ed9-8555-4818c0d2c73b tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:59.265684 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7999e44f-1004-4ed9-8555-4818c0d2c73b tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:59.267609 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7999e44f-1004-4ed9-8555-4818c0d2c73b tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:12:59.274330 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7999e44f-1004-4ed9-8555-4818c0d2c73b tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1486 microversion: 2.91 time: 0.454957 Oct 23 01:12:59.284572 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 356/680] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:12:58 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1486 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:12:59.292329 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0bbe3961-a832-407f-8be9-e15e0b837ff4 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:12:59.292949 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0bbe3961-a832-407f-8be9-e15e0b837ff4 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f277484-b3ae-465e-90b7-8febafef9329] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:12:59.311466 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0bbe3961-a832-407f-8be9-e15e0b837ff4 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:59.311970 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0bbe3961-a832-407f-8be9-e15e0b837ff4 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:59.312409 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0bbe3961-a832-407f-8be9-e15e0b837ff4 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:12:59.313175 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0bbe3961-a832-407f-8be9-e15e0b837ff4 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:12:59.313626 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0bbe3961-a832-407f-8be9-e15e0b837ff4 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:12:59.314080 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0bbe3961-a832-407f-8be9-e15e0b837ff4 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:00.973782 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c0d89d0e-3a82-4ca2-a948-4c90293d0703 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:00.986715 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c0d89d0e-3a82-4ca2-a948-4c90293d0703 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2" status: 200 len: 1476 microversion: 2.1 time: 1.954693 Oct 23 01:13:00.987530 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 325/681] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:59 2022] GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2 => generated 1476 bytes in 1959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:01.005744 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e748532d-807f-490c-b6ea-e4e4c5cae760 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:01.007547 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e748532d-807f-490c-b6ea-e4e4c5cae760 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:01.018212 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e748532d-807f-490c-b6ea-e4e4c5cae760 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:01.019282 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e748532d-807f-490c-b6ea-e4e4c5cae760 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:01.019897 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e748532d-807f-490c-b6ea-e4e4c5cae760 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:01.024892 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e748532d-807f-490c-b6ea-e4e4c5cae760 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:01.025385 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e748532d-807f-490c-b6ea-e4e4c5cae760 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:01.025888 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e748532d-807f-490c-b6ea-e4e4c5cae760 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:01.033714 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:01.155272 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0bbe3961-a832-407f-8be9-e15e0b837ff4 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:01.172839 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0bbe3961-a832-407f-8be9-e15e0b837ff4 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329" status: 200 len: 1471 microversion: 2.1 time: 1.887030 Oct 23 01:13:01.178076 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 357/682] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:12:59 2022] GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329 => generated 1471 bytes in 1893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:01.235601 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e748532d-807f-490c-b6ea-e4e4c5cae760 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:01.254047 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e748532d-807f-490c-b6ea-e4e4c5cae760 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:01.259808 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e748532d-807f-490c-b6ea-e4e4c5cae760 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:01.268254 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e748532d-807f-490c-b6ea-e4e4c5cae760 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1486 microversion: 2.91 time: 0.279517 Oct 23 01:13:01.271125 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 326/683] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:00 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1486 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:13:02.014391 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a67cd70b-0842-45f2-b10c-b9df390898a3 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:02.015666 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a67cd70b-0842-45f2-b10c-b9df390898a3 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:02.025001 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a67cd70b-0842-45f2-b10c-b9df390898a3 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:02.029099 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a67cd70b-0842-45f2-b10c-b9df390898a3 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:02.029775 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a67cd70b-0842-45f2-b10c-b9df390898a3 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:02.033532 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a67cd70b-0842-45f2-b10c-b9df390898a3 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:02.036452 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a67cd70b-0842-45f2-b10c-b9df390898a3 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:02.036452 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a67cd70b-0842-45f2-b10c-b9df390898a3 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:02.207599 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cf1df8a5-ed92-4cb6-bbbc-733b6ef01db5 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:02.208355 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-cf1df8a5-ed92-4cb6-bbbc-733b6ef01db5 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f277484-b3ae-465e-90b7-8febafef9329] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:02.222918 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf1df8a5-ed92-4cb6-bbbc-733b6ef01db5 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:02.223846 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf1df8a5-ed92-4cb6-bbbc-733b6ef01db5 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:02.225920 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf1df8a5-ed92-4cb6-bbbc-733b6ef01db5 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:02.227577 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf1df8a5-ed92-4cb6-bbbc-733b6ef01db5 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:02.227707 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf1df8a5-ed92-4cb6-bbbc-733b6ef01db5 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:02.228099 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf1df8a5-ed92-4cb6-bbbc-733b6ef01db5 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:02.369882 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a67cd70b-0842-45f2-b10c-b9df390898a3 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:02.391646 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a67cd70b-0842-45f2-b10c-b9df390898a3 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2" status: 200 len: 1474 microversion: 2.1 time: 0.380685 Oct 23 01:13:02.392251 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 358/684] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:02 2022] GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2 => generated 1474 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:02.404012 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c0fd1aad-99cf-4ab9-9455-b4eac5ea93c6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:02.405009 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c0fd1aad-99cf-4ab9-9455-b4eac5ea93c6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:02.414931 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c0fd1aad-99cf-4ab9-9455-b4eac5ea93c6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:02.415712 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c0fd1aad-99cf-4ab9-9455-b4eac5ea93c6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:02.423388 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c0fd1aad-99cf-4ab9-9455-b4eac5ea93c6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:02.423388 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c0fd1aad-99cf-4ab9-9455-b4eac5ea93c6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:02.423388 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c0fd1aad-99cf-4ab9-9455-b4eac5ea93c6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:02.423388 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c0fd1aad-99cf-4ab9-9455-b4eac5ea93c6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:02.558676 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cf1df8a5-ed92-4cb6-bbbc-733b6ef01db5 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:02.569164 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cf1df8a5-ed92-4cb6-bbbc-733b6ef01db5 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329" status: 200 len: 1471 microversion: 2.1 time: 0.366083 Oct 23 01:13:02.584567 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 327/685] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:02 2022] GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329 => generated 1471 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:02.591793 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c0fd1aad-99cf-4ab9-9455-b4eac5ea93c6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:02.600598 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c0fd1aad-99cf-4ab9-9455-b4eac5ea93c6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:02.602116 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c0fd1aad-99cf-4ab9-9455-b4eac5ea93c6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:02.617000 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c0fd1aad-99cf-4ab9-9455-b4eac5ea93c6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1544 microversion: 2.91 time: 0.217995 Oct 23 01:13:02.618715 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 359/686] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:02 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1544 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:13:03.417452 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f48e10e4-c8d9-4fc8-91bd-e6efe0e2e994 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:03.418093 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f48e10e4-c8d9-4fc8-91bd-e6efe0e2e994 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:03.434904 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f48e10e4-c8d9-4fc8-91bd-e6efe0e2e994 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:03.435647 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f48e10e4-c8d9-4fc8-91bd-e6efe0e2e994 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:03.436692 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f48e10e4-c8d9-4fc8-91bd-e6efe0e2e994 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:03.437638 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f48e10e4-c8d9-4fc8-91bd-e6efe0e2e994 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:03.438309 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f48e10e4-c8d9-4fc8-91bd-e6efe0e2e994 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:03.438912 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f48e10e4-c8d9-4fc8-91bd-e6efe0e2e994 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:03.475800 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=14 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:03.594422 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-534c350e-fa4b-4872-a205-1894cf8e6372 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:03.595033 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-534c350e-fa4b-4872-a205-1894cf8e6372 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f277484-b3ae-465e-90b7-8febafef9329] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:03.608255 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-534c350e-fa4b-4872-a205-1894cf8e6372 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:03.609058 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-534c350e-fa4b-4872-a205-1894cf8e6372 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:03.610015 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-534c350e-fa4b-4872-a205-1894cf8e6372 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:03.612978 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-534c350e-fa4b-4872-a205-1894cf8e6372 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:03.613683 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-534c350e-fa4b-4872-a205-1894cf8e6372 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:03.614349 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-534c350e-fa4b-4872-a205-1894cf8e6372 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:03.711760 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:03.812606 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f48e10e4-c8d9-4fc8-91bd-e6efe0e2e994 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:03.828421 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f48e10e4-c8d9-4fc8-91bd-e6efe0e2e994 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2" status: 200 len: 1471 microversion: 2.1 time: 0.415418 Oct 23 01:13:03.831266 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 328/687] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:03 2022] GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2 => generated 1471 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:03.850180 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8269cbbf-c279-474f-9d0c-7b415ff8e1af tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:03.850180 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8269cbbf-c279-474f-9d0c-7b415ff8e1af tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:03.890789 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8269cbbf-c279-474f-9d0c-7b415ff8e1af tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:03.892980 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8269cbbf-c279-474f-9d0c-7b415ff8e1af tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:03.895240 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8269cbbf-c279-474f-9d0c-7b415ff8e1af tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:03.899485 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8269cbbf-c279-474f-9d0c-7b415ff8e1af tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:03.904232 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8269cbbf-c279-474f-9d0c-7b415ff8e1af tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:03.910883 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8269cbbf-c279-474f-9d0c-7b415ff8e1af tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:04.086385 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-534c350e-fa4b-4872-a205-1894cf8e6372 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:04.098511 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-534c350e-fa4b-4872-a205-1894cf8e6372 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329" status: 200 len: 1471 microversion: 2.1 time: 0.508578 Oct 23 01:13:04.112148 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 360/688] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:03 2022] GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329 => generated 1471 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:04.118428 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f83d0a89-228b-4818-a2ae-8cb5eb8ccb13 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:13:04.119380 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f83d0a89-228b-4818-a2ae-8cb5eb8ccb13 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:04.127733 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f83d0a89-228b-4818-a2ae-8cb5eb8ccb13 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:04.134297 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f83d0a89-228b-4818-a2ae-8cb5eb8ccb13 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:04.135247 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f83d0a89-228b-4818-a2ae-8cb5eb8ccb13 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:04.136279 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f83d0a89-228b-4818-a2ae-8cb5eb8ccb13 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:04.137163 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f83d0a89-228b-4818-a2ae-8cb5eb8ccb13 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:04.137897 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f83d0a89-228b-4818-a2ae-8cb5eb8ccb13 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:04.148459 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:04.159711 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8269cbbf-c279-474f-9d0c-7b415ff8e1af tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:04.174067 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8269cbbf-c279-474f-9d0c-7b415ff8e1af tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:04.182088 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8269cbbf-c279-474f-9d0c-7b415ff8e1af tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:04.198747 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8269cbbf-c279-474f-9d0c-7b415ff8e1af tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1544 microversion: 2.91 time: 0.364610 Oct 23 01:13:04.202321 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 329/689] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:03 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1544 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:13:04.475681 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f83d0a89-228b-4818-a2ae-8cb5eb8ccb13 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "POST /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2/action" status: 204 len: 0 microversion: 2.1 time: 0.354057 Oct 23 01:13:04.477727 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 361/690] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:13:04 2022] POST /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2/action => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:13:04.494632 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cdd28975-495b-4503-bd42-532a37bccf62 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:04.495320 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-cdd28975-495b-4503-bd42-532a37bccf62 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:04.506056 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cdd28975-495b-4503-bd42-532a37bccf62 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:04.506616 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cdd28975-495b-4503-bd42-532a37bccf62 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:04.507136 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cdd28975-495b-4503-bd42-532a37bccf62 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:04.507819 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cdd28975-495b-4503-bd42-532a37bccf62 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:04.508307 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cdd28975-495b-4503-bd42-532a37bccf62 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:04.508737 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cdd28975-495b-4503-bd42-532a37bccf62 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:04.792304 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cdd28975-495b-4503-bd42-532a37bccf62 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:04.807285 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cdd28975-495b-4503-bd42-532a37bccf62 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2" status: 200 len: 1471 microversion: 2.1 time: 0.324971 Oct 23 01:13:04.823510 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 330/691] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:04 2022] GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2 => generated 1471 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:13:05.133465 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6262414d-8df6-4e6d-84c3-dd9efee5b6c1 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:05.137706 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6262414d-8df6-4e6d-84c3-dd9efee5b6c1 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f277484-b3ae-465e-90b7-8febafef9329] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:05.160529 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6262414d-8df6-4e6d-84c3-dd9efee5b6c1 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:05.161283 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6262414d-8df6-4e6d-84c3-dd9efee5b6c1 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:05.162371 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6262414d-8df6-4e6d-84c3-dd9efee5b6c1 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:05.165087 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6262414d-8df6-4e6d-84c3-dd9efee5b6c1 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:05.166952 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6262414d-8df6-4e6d-84c3-dd9efee5b6c1 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:05.168369 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6262414d-8df6-4e6d-84c3-dd9efee5b6c1 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:05.236581 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-39807485-bd33-4852-8163-063349f84309 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:05.237878 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-39807485-bd33-4852-8163-063349f84309 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:05.244498 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-39807485-bd33-4852-8163-063349f84309 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:05.245238 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-39807485-bd33-4852-8163-063349f84309 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:05.245853 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-39807485-bd33-4852-8163-063349f84309 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:05.246739 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-39807485-bd33-4852-8163-063349f84309 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:05.247776 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-39807485-bd33-4852-8163-063349f84309 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:05.248352 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-39807485-bd33-4852-8163-063349f84309 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:05.958395 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-39807485-bd33-4852-8163-063349f84309 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:05.973579 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-39807485-bd33-4852-8163-063349f84309 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:05.975463 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-39807485-bd33-4852-8163-063349f84309 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:05.982272 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6262414d-8df6-4e6d-84c3-dd9efee5b6c1 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:05.987452 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-39807485-bd33-4852-8163-063349f84309 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1544 microversion: 2.91 time: 0.753436 Oct 23 01:13:05.998451 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 331/692] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:05 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1544 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:13:05.999425 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6262414d-8df6-4e6d-84c3-dd9efee5b6c1 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329" status: 200 len: 1471 microversion: 2.1 time: 0.875299 Oct 23 01:13:06.009666 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 362/693] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:05 2022] GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329 => generated 1471 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:06.009798 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-16433a9a-28e4-4eb5-b390-d96625498abd tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:06.009798 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-16433a9a-28e4-4eb5-b390-d96625498abd tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:06.009942 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7b0c2f60-66ae-4d23-ba44-25e64bb2e512 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-806171989", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "3be3e39f-fbeb-4ed9-a69b-dfb7241289c0"}], "security_groups": [{"name": "tempest-securitygroup--1544353387"}], "key_name": "tempest-keypair-224498026", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:13:06.014254 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-16433a9a-28e4-4eb5-b390-d96625498abd tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:06.014909 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-16433a9a-28e4-4eb5-b390-d96625498abd tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:06.015558 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-16433a9a-28e4-4eb5-b390-d96625498abd tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:06.016570 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-16433a9a-28e4-4eb5-b390-d96625498abd tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:06.017230 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-16433a9a-28e4-4eb5-b390-d96625498abd tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:06.017831 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-16433a9a-28e4-4eb5-b390-d96625498abd tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:06.635352 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-7b0c2f60-66ae-4d23-ba44-25e64bb2e512 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] validate_networks() for [('3be3e39f-fbeb-4ed9-a69b-dfb7241289c0', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:13:06.661362 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-16433a9a-28e4-4eb5-b390-d96625498abd tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:06.677237 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-16433a9a-28e4-4eb5-b390-d96625498abd tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2" status: 200 len: 1471 microversion: 2.1 time: 0.677352 Oct 23 01:13:06.678669 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 332/694] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:05 2022] GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2 => generated 1471 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:07.015998 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b7d115ed-2b7a-48e9-a8cc-73518ac8560d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:07.020713 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b7d115ed-2b7a-48e9-a8cc-73518ac8560d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:07.044445 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b7d115ed-2b7a-48e9-a8cc-73518ac8560d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:07.047597 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b7d115ed-2b7a-48e9-a8cc-73518ac8560d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:07.048197 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b7d115ed-2b7a-48e9-a8cc-73518ac8560d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:07.049218 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b7d115ed-2b7a-48e9-a8cc-73518ac8560d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:07.051173 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b7d115ed-2b7a-48e9-a8cc-73518ac8560d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:07.052738 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b7d115ed-2b7a-48e9-a8cc-73518ac8560d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:07.284089 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b7d115ed-2b7a-48e9-a8cc-73518ac8560d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:07.319187 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b7d115ed-2b7a-48e9-a8cc-73518ac8560d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:07.324304 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b7d115ed-2b7a-48e9-a8cc-73518ac8560d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:07.347250 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b7d115ed-2b7a-48e9-a8cc-73518ac8560d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1544 microversion: 2.91 time: 0.335232 Oct 23 01:13:07.351035 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 333/695] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:07 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1544 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:13:07.360341 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-76cfd609-8624-4e51-be8e-e768dd2bb06d tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:07.361617 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-76cfd609-8624-4e51-be8e-e768dd2bb06d tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f277484-b3ae-465e-90b7-8febafef9329] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:07.371676 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-76cfd609-8624-4e51-be8e-e768dd2bb06d tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:07.372454 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-76cfd609-8624-4e51-be8e-e768dd2bb06d tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:07.372889 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-76cfd609-8624-4e51-be8e-e768dd2bb06d tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:07.373586 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-76cfd609-8624-4e51-be8e-e768dd2bb06d tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:07.374410 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-76cfd609-8624-4e51-be8e-e768dd2bb06d tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:07.375040 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-76cfd609-8624-4e51-be8e-e768dd2bb06d tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:07.459901 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:08.042493 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-76cfd609-8624-4e51-be8e-e768dd2bb06d tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:08.042493 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-76cfd609-8624-4e51-be8e-e768dd2bb06d tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329" status: 200 len: 1471 microversion: 2.1 time: 0.659746 Oct 23 01:13:08.042493 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 334/696] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:07 2022] GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329 => generated 1471 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:08.057086 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5e7097a5-d7fe-4da5-98b3-b868fc6e6615 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:08.057959 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5e7097a5-d7fe-4da5-98b3-b868fc6e6615 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:08.093838 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5e7097a5-d7fe-4da5-98b3-b868fc6e6615 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:08.094703 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5e7097a5-d7fe-4da5-98b3-b868fc6e6615 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:08.099120 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5e7097a5-d7fe-4da5-98b3-b868fc6e6615 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:08.100326 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5e7097a5-d7fe-4da5-98b3-b868fc6e6615 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:08.106029 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5e7097a5-d7fe-4da5-98b3-b868fc6e6615 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:08.108015 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5e7097a5-d7fe-4da5-98b3-b868fc6e6615 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:08.611755 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=8 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:08.784613 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5e7097a5-d7fe-4da5-98b3-b868fc6e6615 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:08.796104 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5e7097a5-d7fe-4da5-98b3-b868fc6e6615 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2" status: 200 len: 1471 microversion: 2.1 time: 0.757773 Oct 23 01:13:08.797065 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 335/697] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:08 2022] GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2 => generated 1471 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:08.804706 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3283af49-dfb4-4c58-bc37-9f3c92c317e7 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:08.806658 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3283af49-dfb4-4c58-bc37-9f3c92c317e7 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:08.819101 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3283af49-dfb4-4c58-bc37-9f3c92c317e7 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:08.820160 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3283af49-dfb4-4c58-bc37-9f3c92c317e7 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:08.821773 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3283af49-dfb4-4c58-bc37-9f3c92c317e7 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:08.827769 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3283af49-dfb4-4c58-bc37-9f3c92c317e7 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:08.827769 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3283af49-dfb4-4c58-bc37-9f3c92c317e7 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:08.827769 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3283af49-dfb4-4c58-bc37-9f3c92c317e7 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:08.931922 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-7b0c2f60-66ae-4d23-ba44-25e64bb2e512 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:13:08.932957 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-7b0c2f60-66ae-4d23-ba44-25e64bb2e512 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:13:08.933614 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-7b0c2f60-66ae-4d23-ba44-25e64bb2e512 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:13:08.934059 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-7b0c2f60-66ae-4d23-ba44-25e64bb2e512 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:13:08.934474 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-7b0c2f60-66ae-4d23-ba44-25e64bb2e512 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:13:08.980153 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b0c2f60-66ae-4d23-ba44-25e64bb2e512 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:08.983454 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b0c2f60-66ae-4d23-ba44-25e64bb2e512 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:08.983960 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b0c2f60-66ae-4d23-ba44-25e64bb2e512 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:08.987800 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b0c2f60-66ae-4d23-ba44-25e64bb2e512 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:08.988325 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b0c2f60-66ae-4d23-ba44-25e64bb2e512 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:08.990157 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b0c2f60-66ae-4d23-ba44-25e64bb2e512 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:09.089342 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3283af49-dfb4-4c58-bc37-9f3c92c317e7 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:09.115205 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3283af49-dfb4-4c58-bc37-9f3c92c317e7 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:09.116715 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3283af49-dfb4-4c58-bc37-9f3c92c317e7 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:09.119177 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-7b0c2f60-66ae-4d23-ba44-25e64bb2e512 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Getting quotas for project d46a7166e4144f55a102ea6335c5f820. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:13:09.141129 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3283af49-dfb4-4c58-bc37-9f3c92c317e7 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1544 microversion: 2.91 time: 0.342712 Oct 23 01:13:09.145346 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 336/698] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:08 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1544 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:13:09.171881 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-7b0c2f60-66ae-4d23-ba44-25e64bb2e512 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Getting quotas for user 1c2310cbc3574eb29a6ca6291ba7808e and project d46a7166e4144f55a102ea6335c5f820. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:13:09.194147 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-777c14e6-b4d2-4f5f-b455-f643d379e67e tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:09.195086 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-777c14e6-b4d2-4f5f-b455-f643d379e67e tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f277484-b3ae-465e-90b7-8febafef9329] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:09.199485 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7b0c2f60-66ae-4d23-ba44-25e64bb2e512 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:13:09.204258 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7b0c2f60-66ae-4d23-ba44-25e64bb2e512 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:13:09.204587 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-777c14e6-b4d2-4f5f-b455-f643d379e67e tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:09.205118 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-777c14e6-b4d2-4f5f-b455-f643d379e67e tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:09.205565 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-777c14e6-b4d2-4f5f-b455-f643d379e67e tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:09.222538 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-777c14e6-b4d2-4f5f-b455-f643d379e67e tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:09.223469 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-777c14e6-b4d2-4f5f-b455-f643d379e67e tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:09.223762 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-777c14e6-b4d2-4f5f-b455-f643d379e67e tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:09.446073 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7b0c2f60-66ae-4d23-ba44-25e64bb2e512 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.434488 Oct 23 01:13:09.450134 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 363/699] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:13:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 3447 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:13:09.472687 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-906aee9d-6b55-4086-bede-8332a86ea769 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:09.490433 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-906aee9d-6b55-4086-bede-8332a86ea769 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:09.755738 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-906aee9d-6b55-4086-bede-8332a86ea769 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:09.769102 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-906aee9d-6b55-4086-bede-8332a86ea769 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 200 len: 1233 microversion: 2.1 time: 0.309802 Oct 23 01:13:09.772569 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 364/700] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:09 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 1233 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:09.814985 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-777c14e6-b4d2-4f5f-b455-f643d379e67e tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:09.828066 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a3c7f28a-acf6-4fb3-87b0-09ada9350353 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:09.828950 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a3c7f28a-acf6-4fb3-87b0-09ada9350353 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:09.831671 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-777c14e6-b4d2-4f5f-b455-f643d379e67e tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329" status: 200 len: 1477 microversion: 2.1 time: 0.687669 Oct 23 01:13:09.835553 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 337/701] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:09 2022] GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329 => generated 1477 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:09.844595 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a3c7f28a-acf6-4fb3-87b0-09ada9350353 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:09.847452 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a3c7f28a-acf6-4fb3-87b0-09ada9350353 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:09.848348 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a3c7f28a-acf6-4fb3-87b0-09ada9350353 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:09.849657 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a3c7f28a-acf6-4fb3-87b0-09ada9350353 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:09.850510 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a3c7f28a-acf6-4fb3-87b0-09ada9350353 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:09.851165 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a3c7f28a-acf6-4fb3-87b0-09ada9350353 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:10.007436 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-432c5272-b071-44dd-8f1f-a5acedc6e18f req-d9f58436-9610-40d4-ac86-e15244b9dedd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ae2878c-23a6-4e78-bd92-69fb03fc27b2", "name": "network-vif-plugged", "status": "completed", "tag": "9915372e-5565-43b8-b511-9fbf12974675"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:13:10.079703 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-432c5272-b071-44dd-8f1f-a5acedc6e18f req-d9f58436-9610-40d4-ac86-e15244b9dedd service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:10.092736 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-432c5272-b071-44dd-8f1f-a5acedc6e18f req-d9f58436-9610-40d4-ac86-e15244b9dedd service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:10.094565 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-432c5272-b071-44dd-8f1f-a5acedc6e18f req-d9f58436-9610-40d4-ac86-e15244b9dedd service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:10.134789 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-432c5272-b071-44dd-8f1f-a5acedc6e18f req-d9f58436-9610-40d4-ac86-e15244b9dedd service nova] Creating event network-vif-plugged:9915372e-5565-43b8-b511-9fbf12974675 for instance 4ae2878c-23a6-4e78-bd92-69fb03fc27b2 on n-h1-master-1 Oct 23 01:13:10.166847 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-432c5272-b071-44dd-8f1f-a5acedc6e18f req-d9f58436-9610-40d4-ac86-e15244b9dedd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171770 Oct 23 01:13:10.174081 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 338/702] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:13:10.197585 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a3c7f28a-acf6-4fb3-87b0-09ada9350353 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:10.210331 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a3c7f28a-acf6-4fb3-87b0-09ada9350353 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2" status: 200 len: 1471 microversion: 2.1 time: 0.385763 Oct 23 01:13:10.215453 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1eec2b82-3129-45ac-afc1-b5f15847f588 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:10.215923 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 365/703] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:09 2022] GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2 => generated 1471 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:10.218164 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1eec2b82-3129-45ac-afc1-b5f15847f588 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:10.233738 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1eec2b82-3129-45ac-afc1-b5f15847f588 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:10.237703 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1eec2b82-3129-45ac-afc1-b5f15847f588 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:10.238425 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1eec2b82-3129-45ac-afc1-b5f15847f588 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:10.240676 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1eec2b82-3129-45ac-afc1-b5f15847f588 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:10.242616 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1eec2b82-3129-45ac-afc1-b5f15847f588 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:10.244075 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1eec2b82-3129-45ac-afc1-b5f15847f588 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:10.418050 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1eec2b82-3129-45ac-afc1-b5f15847f588 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:10.442994 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1eec2b82-3129-45ac-afc1-b5f15847f588 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:10.447459 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1eec2b82-3129-45ac-afc1-b5f15847f588 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:10.460970 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1eec2b82-3129-45ac-afc1-b5f15847f588 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1544 microversion: 2.91 time: 0.284517 Oct 23 01:13:10.465265 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 339/704] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:10 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1544 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:13:10.819736 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3fef0f7f-1d25-4eed-bd8a-8a81a573b050 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:10.820473 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3fef0f7f-1d25-4eed-bd8a-8a81a573b050 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:10.863266 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c9208021-1fdc-4c0c-9e48-b730d09ae65a tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:10.863957 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c9208021-1fdc-4c0c-9e48-b730d09ae65a tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f277484-b3ae-465e-90b7-8febafef9329] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:10.889108 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c9208021-1fdc-4c0c-9e48-b730d09ae65a tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:10.889700 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c9208021-1fdc-4c0c-9e48-b730d09ae65a tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:10.890223 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c9208021-1fdc-4c0c-9e48-b730d09ae65a tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:10.891051 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c9208021-1fdc-4c0c-9e48-b730d09ae65a tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:10.891506 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c9208021-1fdc-4c0c-9e48-b730d09ae65a tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:10.891932 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c9208021-1fdc-4c0c-9e48-b730d09ae65a tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:11.155888 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3fef0f7f-1d25-4eed-bd8a-8a81a573b050 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:11.169252 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3fef0f7f-1d25-4eed-bd8a-8a81a573b050 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 200 len: 1233 microversion: 2.1 time: 0.371515 Oct 23 01:13:11.171827 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 366/705] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:10 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 1233 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:13:11.240531 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e8842c5d-ebf6-4530-ae24-852f1355a861 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:11.241370 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e8842c5d-ebf6-4530-ae24-852f1355a861 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:11.268477 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8842c5d-ebf6-4530-ae24-852f1355a861 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:11.283051 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8842c5d-ebf6-4530-ae24-852f1355a861 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:11.284512 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8842c5d-ebf6-4530-ae24-852f1355a861 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:11.290017 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8842c5d-ebf6-4530-ae24-852f1355a861 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:11.290628 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8842c5d-ebf6-4530-ae24-852f1355a861 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:11.291041 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8842c5d-ebf6-4530-ae24-852f1355a861 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:11.609914 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c9208021-1fdc-4c0c-9e48-b730d09ae65a tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:11.632556 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c9208021-1fdc-4c0c-9e48-b730d09ae65a tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329" status: 200 len: 1477 microversion: 2.1 time: 0.773519 Oct 23 01:13:11.633658 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 340/706] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:10 2022] GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329 => generated 1477 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:13:11.955317 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e8842c5d-ebf6-4530-ae24-852f1355a861 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:11.973780 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e8842c5d-ebf6-4530-ae24-852f1355a861 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2" status: 200 len: 1463 microversion: 2.1 time: 0.738327 Oct 23 01:13:11.974440 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 367/707] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:11 2022] GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2 => generated 1463 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:13:12.015369 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b1b7d813-e00a-43cf-80b7-a908d594faee tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:12.018728 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b1b7d813-e00a-43cf-80b7-a908d594faee tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:12.030937 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1b7d813-e00a-43cf-80b7-a908d594faee tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:12.033408 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1b7d813-e00a-43cf-80b7-a908d594faee tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:12.035370 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1b7d813-e00a-43cf-80b7-a908d594faee tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:12.046956 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1b7d813-e00a-43cf-80b7-a908d594faee tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:12.050089 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1b7d813-e00a-43cf-80b7-a908d594faee tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:12.050499 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1b7d813-e00a-43cf-80b7-a908d594faee tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:12.063670 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2cbbfc8a-6181-4c78-8cc7-616ef588037b tempest-QuotaClassesAdminTestJSON-106257683 tempest-QuotaClassesAdminTestJSON-106257683-project-admin] Calling method '.version_select at 0x7f5cc22cac10>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:12.108943 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2cbbfc8a-6181-4c78-8cc7-616ef588037b tempest-QuotaClassesAdminTestJSON-106257683 tempest-QuotaClassesAdminTestJSON-106257683-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.455423 Oct 23 01:13:12.111160 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 341/708] 10.222.0.42 () {58 vars in 1185 bytes} [Sun Oct 23 01:13:11 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:13:12.132196 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-58ef3037-e87d-4b92-b01f-588e4f94bb46 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:12.133420 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-58ef3037-e87d-4b92-b01f-588e4f94bb46 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: f5fe429a-88b7-4d3d-975b-a10c725c4e2f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:12.145301 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-58ef3037-e87d-4b92-b01f-588e4f94bb46 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:12.146172 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-58ef3037-e87d-4b92-b01f-588e4f94bb46 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:12.146838 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-58ef3037-e87d-4b92-b01f-588e4f94bb46 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:12.147732 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-58ef3037-e87d-4b92-b01f-588e4f94bb46 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:12.148462 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-58ef3037-e87d-4b92-b01f-588e4f94bb46 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:12.149138 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-58ef3037-e87d-4b92-b01f-588e4f94bb46 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:12.227494 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-58ef3037-e87d-4b92-b01f-588e4f94bb46 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: f5fe429a-88b7-4d3d-975b-a10c725c4e2f] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:13:12.270585 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b1b7d813-e00a-43cf-80b7-a908d594faee tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:12.283069 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b1b7d813-e00a-43cf-80b7-a908d594faee tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:12.284982 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b1b7d813-e00a-43cf-80b7-a908d594faee tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:12.291217 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b1b7d813-e00a-43cf-80b7-a908d594faee tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1544 microversion: 2.91 time: 0.305750 Oct 23 01:13:12.293731 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 368/709] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:11 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1544 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:13:12.307298 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d0ecea09-5a8e-4a88-8068-9eda39ad66bf tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:12.307914 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d0ecea09-5a8e-4a88-8068-9eda39ad66bf tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:12.321470 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0ecea09-5a8e-4a88-8068-9eda39ad66bf tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:12.321959 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0ecea09-5a8e-4a88-8068-9eda39ad66bf tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:12.322571 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0ecea09-5a8e-4a88-8068-9eda39ad66bf tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:12.324101 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0ecea09-5a8e-4a88-8068-9eda39ad66bf tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:12.324714 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0ecea09-5a8e-4a88-8068-9eda39ad66bf tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:12.325292 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0ecea09-5a8e-4a88-8068-9eda39ad66bf tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:12.404622 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:12.690073 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d0ecea09-5a8e-4a88-8068-9eda39ad66bf tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2" status: 200 len: 1614 microversion: 2.1 time: 0.386948 Oct 23 01:13:12.695966 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 369/710] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:12 2022] GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2 => generated 1614 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:12.703612 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6c2d6805-5f84-4448-85ca-850931c8d781 tempest-QuotaClassesAdminTestJSON-106257683 tempest-QuotaClassesAdminTestJSON-106257683-project-admin] Action: 'update', calling method: .version_select at 0x7f5cc2266940>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:13:12.710291 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-58ef3037-e87d-4b92-b01f-588e4f94bb46 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f5fe429a-88b7-4d3d-975b-a10c725c4e2f" status: 204 len: 0 microversion: 2.1 time: 0.597453 Oct 23 01:13:12.712925 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 342/711] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:13:12 2022] DELETE /compute/v2.1/servers/f5fe429a-88b7-4d3d-975b-a10c725c4e2f => generated 0 bytes in 601 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:13:12.720982 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9cede69d-b3e9-49b8-9218-61c17a72c559 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:12.725316 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9cede69d-b3e9-49b8-9218-61c17a72c559 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:12.746339 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9cede69d-b3e9-49b8-9218-61c17a72c559 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:12.748834 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9cede69d-b3e9-49b8-9218-61c17a72c559 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:12.749594 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9cede69d-b3e9-49b8-9218-61c17a72c559 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:12.750520 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9cede69d-b3e9-49b8-9218-61c17a72c559 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:12.753360 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9cede69d-b3e9-49b8-9218-61c17a72c559 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:12.755027 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9cede69d-b3e9-49b8-9218-61c17a72c559 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:12.958627 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9cede69d-b3e9-49b8-9218-61c17a72c559 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:12.977166 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9cede69d-b3e9-49b8-9218-61c17a72c559 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 200 len: 1285 microversion: 2.1 time: 0.254431 Oct 23 01:13:12.980341 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 343/712] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:12 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 1285 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:12.988219 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-47240567-6f11-43f9-a39b-ae6f765a2db9 req-25dfdbea-4878-4604-8a35-3eb72c0bfce2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f277484-b3ae-465e-90b7-8febafef9329", "name": "network-vif-unplugged", "status": "completed", "tag": "4af1b3a5-4e5f-45a7-ab54-f98595e2f6f7"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:13:13.007367 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-47240567-6f11-43f9-a39b-ae6f765a2db9 req-25dfdbea-4878-4604-8a35-3eb72c0bfce2 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:13.008378 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-47240567-6f11-43f9-a39b-ae6f765a2db9 req-25dfdbea-4878-4604-8a35-3eb72c0bfce2 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:13.008914 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-47240567-6f11-43f9-a39b-ae6f765a2db9 req-25dfdbea-4878-4604-8a35-3eb72c0bfce2 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:13.022876 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-47240567-6f11-43f9-a39b-ae6f765a2db9 req-25dfdbea-4878-4604-8a35-3eb72c0bfce2 service nova] Creating event network-vif-unplugged:4af1b3a5-4e5f-45a7-ab54-f98595e2f6f7 for instance 8f277484-b3ae-465e-90b7-8febafef9329 on n-h1-master-1 Oct 23 01:13:13.028870 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-47240567-6f11-43f9-a39b-ae6f765a2db9 req-25dfdbea-4878-4604-8a35-3eb72c0bfce2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046969 Oct 23 01:13:13.034079 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 344/713] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:13:13.040799 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-844331eb-2f99-44d7-98b4-3ad47890ade9 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:13.042236 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-844331eb-2f99-44d7-98b4-3ad47890ade9 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f277484-b3ae-465e-90b7-8febafef9329] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:13.050394 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-844331eb-2f99-44d7-98b4-3ad47890ade9 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:13.055785 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-844331eb-2f99-44d7-98b4-3ad47890ade9 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:13.055785 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-844331eb-2f99-44d7-98b4-3ad47890ade9 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:13.055785 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-844331eb-2f99-44d7-98b4-3ad47890ade9 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:13.055785 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-844331eb-2f99-44d7-98b4-3ad47890ade9 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:13.056219 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-844331eb-2f99-44d7-98b4-3ad47890ade9 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:13.337228 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-844331eb-2f99-44d7-98b4-3ad47890ade9 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:13.350470 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-844331eb-2f99-44d7-98b4-3ad47890ade9 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329" status: 200 len: 1463 microversion: 2.1 time: 0.314540 Oct 23 01:13:13.351748 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 345/714] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:13 2022] GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329 => generated 1463 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:13.377880 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9f679093-4b4d-4bda-b468-0b0f91463694 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:13.378539 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9f679093-4b4d-4bda-b468-0b0f91463694 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: f5fe429a-88b7-4d3d-975b-a10c725c4e2f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:13.386017 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f679093-4b4d-4bda-b468-0b0f91463694 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:13.386508 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f679093-4b4d-4bda-b468-0b0f91463694 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:13.386967 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f679093-4b4d-4bda-b468-0b0f91463694 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:13.387659 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f679093-4b4d-4bda-b468-0b0f91463694 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:13.388112 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f679093-4b4d-4bda-b468-0b0f91463694 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:13.388532 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f679093-4b4d-4bda-b468-0b0f91463694 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:13.590642 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9f679093-4b4d-4bda-b468-0b0f91463694 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e535f9274b24a9f800ea0c3d8faba5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b8e89ba0a14188bac8e28b66b5a197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:13.615195 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9f679093-4b4d-4bda-b468-0b0f91463694 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "GET /compute/v2.1/servers/f5fe429a-88b7-4d3d-975b-a10c725c4e2f" status: 200 len: 1712 microversion: 2.1 time: 0.260416 Oct 23 01:13:13.616436 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 346/715] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:13 2022] GET /compute/v2.1/servers/f5fe429a-88b7-4d3d-975b-a10c725c4e2f => generated 1712 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:13.622512 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8c52e541-b76c-4810-bb6b-562efabc68f7 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Calling method '.version_select at 0x7f5cc1e7ae50>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:13.626568 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c52e541-b76c-4810-bb6b-562efabc68f7 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:13.627232 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c52e541-b76c-4810-bb6b-562efabc68f7 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:13.629304 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c52e541-b76c-4810-bb6b-562efabc68f7 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:13.646094 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8c52e541-b76c-4810-bb6b-562efabc68f7 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] 10.222.0.42 "GET /compute/v2.1/os-migrations" status: 200 len: 1177 microversion: 2.1 time: 0.027358 Oct 23 01:13:13.647119 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 347/716] 10.222.0.42 () {58 vars in 1143 bytes} [Sun Oct 23 01:13:13 2022] GET /compute/v2.1/os-migrations => generated 1177 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:13.655092 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d282e8bd-b070-490a-a9b4-852a43f64b66 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:13.671443 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d282e8bd-b070-490a-a9b4-852a43f64b66 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:13.692840 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d282e8bd-b070-490a-a9b4-852a43f64b66 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:13.693640 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d282e8bd-b070-490a-a9b4-852a43f64b66 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:13.694277 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d282e8bd-b070-490a-a9b4-852a43f64b66 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:13.697216 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d282e8bd-b070-490a-a9b4-852a43f64b66 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:13.700378 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d282e8bd-b070-490a-a9b4-852a43f64b66 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:13.701090 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d282e8bd-b070-490a-a9b4-852a43f64b66 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:13.831716 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d282e8bd-b070-490a-a9b4-852a43f64b66 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:13.843239 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d282e8bd-b070-490a-a9b4-852a43f64b66 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:13.845620 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d282e8bd-b070-490a-a9b4-852a43f64b66 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:13.859850 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d282e8bd-b070-490a-a9b4-852a43f64b66 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1544 microversion: 2.91 time: 0.210738 Oct 23 01:13:13.860870 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 348/717] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:13 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1544 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:13:13.869153 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b1b38b0f-829b-4344-b1c2-dd92fdc930fc tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:13.869865 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b1b38b0f-829b-4344-b1c2-dd92fdc930fc tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f277484-b3ae-465e-90b7-8febafef9329] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:13.880840 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b1b38b0f-829b-4344-b1c2-dd92fdc930fc tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:13.881478 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b1b38b0f-829b-4344-b1c2-dd92fdc930fc tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:13.884769 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b1b38b0f-829b-4344-b1c2-dd92fdc930fc tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:13.884769 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b1b38b0f-829b-4344-b1c2-dd92fdc930fc tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:13.884769 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b1b38b0f-829b-4344-b1c2-dd92fdc930fc tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:13.884769 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b1b38b0f-829b-4344-b1c2-dd92fdc930fc tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:14.059121 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b1b38b0f-829b-4344-b1c2-dd92fdc930fc tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:14.068431 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b1b38b0f-829b-4344-b1c2-dd92fdc930fc tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329" status: 200 len: 1463 microversion: 2.1 time: 0.204607 Oct 23 01:13:14.069417 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 349/718] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:13 2022] GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329 => generated 1463 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:14.075595 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2b3630f6-e1a2-4837-95b3-fdaa258da806 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-231592606", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:13:14.140536 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-2b3630f6-e1a2-4837-95b3-fdaa258da806 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] validate_networks() for None {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:13:14.486821 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-2b3630f6-e1a2-4837-95b3-fdaa258da806 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:13:14.486821 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-2b3630f6-e1a2-4837-95b3-fdaa258da806 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:13:14.486821 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-2b3630f6-e1a2-4837-95b3-fdaa258da806 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:13:14.486821 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-2b3630f6-e1a2-4837-95b3-fdaa258da806 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:13:14.486821 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-2b3630f6-e1a2-4837-95b3-fdaa258da806 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:13:14.489724 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6c2d6805-5f84-4448-85ca-850931c8d781 tempest-QuotaClassesAdminTestJSON-106257683 tempest-QuotaClassesAdminTestJSON-106257683-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 1.796671 Oct 23 01:13:14.497953 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 370/719] 10.222.0.42 () {60 vars in 1206 bytes} [Sun Oct 23 01:13:12 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 1806 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:13:14.514433 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2b3630f6-e1a2-4837-95b3-fdaa258da806 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:14.514433 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2b3630f6-e1a2-4837-95b3-fdaa258da806 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:14.514433 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2b3630f6-e1a2-4837-95b3-fdaa258da806 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:14.514743 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-08f86f67-9450-4b25-8fa8-3cb431e65800 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:14.514743 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-08f86f67-9450-4b25-8fa8-3cb431e65800 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:14.514913 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2b3630f6-e1a2-4837-95b3-fdaa258da806 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:14.514913 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2b3630f6-e1a2-4837-95b3-fdaa258da806 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:14.514913 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2b3630f6-e1a2-4837-95b3-fdaa258da806 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:14.534007 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-2b3630f6-e1a2-4837-95b3-fdaa258da806 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Getting quotas for project eb058785345d4e58a5820445efe09bee. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:13:14.541055 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-2b3630f6-e1a2-4837-95b3-fdaa258da806 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Getting quotas for user 547aed83a7e44becb9c89dc6bae62255 and project eb058785345d4e58a5820445efe09bee. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:13:14.544802 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-08f86f67-9450-4b25-8fa8-3cb431e65800 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:14.546159 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-08f86f67-9450-4b25-8fa8-3cb431e65800 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:14.547460 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:14.552300 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-08f86f67-9450-4b25-8fa8-3cb431e65800 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:14.553312 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-08f86f67-9450-4b25-8fa8-3cb431e65800 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:14.555848 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-08f86f67-9450-4b25-8fa8-3cb431e65800 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:14.557648 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-08f86f67-9450-4b25-8fa8-3cb431e65800 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:14.562173 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2b3630f6-e1a2-4837-95b3-fdaa258da806 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:13:14.565463 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2b3630f6-e1a2-4837-95b3-fdaa258da806 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: edb35c7d-9adc-4b53-9bef-147aadbeae5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:13:14.690545 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2b3630f6-e1a2-4837-95b3-fdaa258da806 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.619574 Oct 23 01:13:14.698143 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 350/720] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:13:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:13:14.698143 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ac203766-c3a7-46cc-a1ec-a84933dac032 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:13:14.700756 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ac203766-c3a7-46cc-a1ec-a84933dac032 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f277484-b3ae-465e-90b7-8febafef9329] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:14.713950 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac203766-c3a7-46cc-a1ec-a84933dac032 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:14.713950 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac203766-c3a7-46cc-a1ec-a84933dac032 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:14.713950 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac203766-c3a7-46cc-a1ec-a84933dac032 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:14.713950 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac203766-c3a7-46cc-a1ec-a84933dac032 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:14.714391 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac203766-c3a7-46cc-a1ec-a84933dac032 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:14.714391 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac203766-c3a7-46cc-a1ec-a84933dac032 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:14.764944 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-08f86f67-9450-4b25-8fa8-3cb431e65800 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:14.776425 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-08f86f67-9450-4b25-8fa8-3cb431e65800 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 200 len: 1285 microversion: 2.1 time: 0.276816 Oct 23 01:13:14.783623 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 371/721] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:14 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 1285 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:14.788578 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3d6de49c-b32d-4ff6-89f8-eef88eee6764 tempest-QuotaClassesAdminTestJSON-106257683 tempest-QuotaClassesAdminTestJSON-106257683-project-admin] Calling method '.version_select at 0x7f5cc29d84c0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:14.819654 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3d6de49c-b32d-4ff6-89f8-eef88eee6764 tempest-QuotaClassesAdminTestJSON-106257683 tempest-QuotaClassesAdminTestJSON-106257683-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.037993 Oct 23 01:13:14.823808 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 372/722] 10.222.0.42 () {58 vars in 1185 bytes} [Sun Oct 23 01:13:14 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:13:14.829623 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1b527b41-60d3-46c2-92ff-7d6dd1aa60fb tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:14.835608 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1b527b41-60d3-46c2-92ff-7d6dd1aa60fb tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: f5fe429a-88b7-4d3d-975b-a10c725c4e2f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:14.849266 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=15,nova_api:UPDATE=12 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:14.855144 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b527b41-60d3-46c2-92ff-7d6dd1aa60fb tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:14.866041 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b527b41-60d3-46c2-92ff-7d6dd1aa60fb tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:14.866041 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b527b41-60d3-46c2-92ff-7d6dd1aa60fb tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:14.866041 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b527b41-60d3-46c2-92ff-7d6dd1aa60fb tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:14.866041 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b527b41-60d3-46c2-92ff-7d6dd1aa60fb tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:14.867052 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b527b41-60d3-46c2-92ff-7d6dd1aa60fb tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:14.950135 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-ac203766-c3a7-46cc-a1ec-a84933dac032 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:13:14.950705 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-ac203766-c3a7-46cc-a1ec-a84933dac032 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:13:14.951202 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-ac203766-c3a7-46cc-a1ec-a84933dac032 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:13:14.951626 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-ac203766-c3a7-46cc-a1ec-a84933dac032 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:13:14.995329 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-ac203766-c3a7-46cc-a1ec-a84933dac032 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:13:15.134320 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1b527b41-60d3-46c2-92ff-7d6dd1aa60fb tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e535f9274b24a9f800ea0c3d8faba5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b8e89ba0a14188bac8e28b66b5a197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:15.152913 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1b527b41-60d3-46c2-92ff-7d6dd1aa60fb tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "GET /compute/v2.1/servers/f5fe429a-88b7-4d3d-975b-a10c725c4e2f" status: 200 len: 1712 microversion: 2.1 time: 0.326889 Oct 23 01:13:15.162547 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 373/723] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:14 2022] GET /compute/v2.1/servers/f5fe429a-88b7-4d3d-975b-a10c725c4e2f => generated 1712 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:15.186425 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ba480241-b92e-4ea8-9a56-738718e6cd0c tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:15.186425 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ba480241-b92e-4ea8-9a56-738718e6cd0c tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: edb35c7d-9adc-4b53-9bef-147aadbeae5d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:15.394428 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ac203766-c3a7-46cc-a1ec-a84933dac032 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f277484-b3ae-465e-90b7-8febafef9329] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:15.413285 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac203766-c3a7-46cc-a1ec-a84933dac032 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:15.414757 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac203766-c3a7-46cc-a1ec-a84933dac032 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:15.415106 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac203766-c3a7-46cc-a1ec-a84933dac032 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:15.415885 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac203766-c3a7-46cc-a1ec-a84933dac032 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:15.416258 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac203766-c3a7-46cc-a1ec-a84933dac032 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:15.416980 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac203766-c3a7-46cc-a1ec-a84933dac032 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:15.466784 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ba480241-b92e-4ea8-9a56-738718e6cd0c tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:15.476600 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ba480241-b92e-4ea8-9a56-738718e6cd0c tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d" status: 200 len: 1212 microversion: 2.1 time: 0.311505 Oct 23 01:13:15.491459 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 374/724] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:15 2022] GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d => generated 1212 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:15.496869 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c76387ac-0a41-477d-9091-e4d133dc75c0 tempest-QuotaClassesAdminTestJSON-106257683 tempest-QuotaClassesAdminTestJSON-106257683-project-admin] Action: 'update', calling method: .version_select at 0x7f5cc2430940>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:13:15.541614 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ac203766-c3a7-46cc-a1ec-a84933dac032 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "POST /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329/action" status: 202 len: 1067 microversion: 2.1 time: 0.845961 Oct 23 01:13:15.556522 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 351/725] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:13:14 2022] POST /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329/action => generated 1067 bytes in 850 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 23 01:13:15.556522 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c1b2169e-8c5d-49ba-9764-6e4e562ec768 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:15.556522 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c1b2169e-8c5d-49ba-9764-6e4e562ec768 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:15.579051 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c1b2169e-8c5d-49ba-9764-6e4e562ec768 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:15.585629 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c1b2169e-8c5d-49ba-9764-6e4e562ec768 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:15.586566 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c1b2169e-8c5d-49ba-9764-6e4e562ec768 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:15.587547 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c1b2169e-8c5d-49ba-9764-6e4e562ec768 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:15.588237 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c1b2169e-8c5d-49ba-9764-6e4e562ec768 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:15.588885 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c1b2169e-8c5d-49ba-9764-6e4e562ec768 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:15.749462 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c1b2169e-8c5d-49ba-9764-6e4e562ec768 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:15.762034 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c1b2169e-8c5d-49ba-9764-6e4e562ec768 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:15.769909 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c1b2169e-8c5d-49ba-9764-6e4e562ec768 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:15.780513 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c1b2169e-8c5d-49ba-9764-6e4e562ec768 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1544 microversion: 2.91 time: 0.236120 Oct 23 01:13:15.781128 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 352/726] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:15 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1544 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:13:15.806679 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-549d8192-53ba-4504-8a4f-870f9e4f1a37 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:15.806679 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-549d8192-53ba-4504-8a4f-870f9e4f1a37 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f277484-b3ae-465e-90b7-8febafef9329] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:15.818007 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-549d8192-53ba-4504-8a4f-870f9e4f1a37 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:15.818763 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-549d8192-53ba-4504-8a4f-870f9e4f1a37 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:15.824635 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-549d8192-53ba-4504-8a4f-870f9e4f1a37 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:15.828386 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-549d8192-53ba-4504-8a4f-870f9e4f1a37 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:15.829576 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-549d8192-53ba-4504-8a4f-870f9e4f1a37 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:15.829576 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-549d8192-53ba-4504-8a4f-870f9e4f1a37 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:16.406501 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-549d8192-53ba-4504-8a4f-870f9e4f1a37 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:16.425332 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-549d8192-53ba-4504-8a4f-870f9e4f1a37 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329" status: 200 len: 1472 microversion: 2.1 time: 0.643013 Oct 23 01:13:16.459024 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 353/727] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:15 2022] GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329 => generated 1472 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:16.481474 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f8b62c0d-814f-43de-9840-7101f8700046 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:16.482218 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f8b62c0d-814f-43de-9840-7101f8700046 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:16.514669 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8b62c0d-814f-43de-9840-7101f8700046 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:16.515356 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8b62c0d-814f-43de-9840-7101f8700046 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:16.516040 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8b62c0d-814f-43de-9840-7101f8700046 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:16.516985 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8b62c0d-814f-43de-9840-7101f8700046 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:16.517595 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8b62c0d-814f-43de-9840-7101f8700046 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:16.518216 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8b62c0d-814f-43de-9840-7101f8700046 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:16.698271 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c76387ac-0a41-477d-9091-e4d133dc75c0 tempest-QuotaClassesAdminTestJSON-106257683 tempest-QuotaClassesAdminTestJSON-106257683-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 1.216636 Oct 23 01:13:16.700547 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 375/728] 10.222.0.42 () {60 vars in 1206 bytes} [Sun Oct 23 01:13:15 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:13:16.717873 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-77dbdaff-3e3a-45d2-a44f-404c903769d2 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:16.719169 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-77dbdaff-3e3a-45d2-a44f-404c903769d2 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: f5fe429a-88b7-4d3d-975b-a10c725c4e2f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:16.753032 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-77dbdaff-3e3a-45d2-a44f-404c903769d2 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:16.756450 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-77dbdaff-3e3a-45d2-a44f-404c903769d2 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:16.757220 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-77dbdaff-3e3a-45d2-a44f-404c903769d2 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:16.758594 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-77dbdaff-3e3a-45d2-a44f-404c903769d2 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:16.759704 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-77dbdaff-3e3a-45d2-a44f-404c903769d2 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:16.760817 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-77dbdaff-3e3a-45d2-a44f-404c903769d2 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:17.354514 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f8b62c0d-814f-43de-9840-7101f8700046 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:17.366274 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f8b62c0d-814f-43de-9840-7101f8700046 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 200 len: 1285 microversion: 2.1 time: 0.901287 Oct 23 01:13:17.370917 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 354/729] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:16 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 1285 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:17.388467 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6c883245-9780-4f0d-af07-ba7317437ddc tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:17.389769 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6c883245-9780-4f0d-af07-ba7317437ddc tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: edb35c7d-9adc-4b53-9bef-147aadbeae5d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:17.397462 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6c883245-9780-4f0d-af07-ba7317437ddc tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:17.399585 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6c883245-9780-4f0d-af07-ba7317437ddc tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:17.403449 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6c883245-9780-4f0d-af07-ba7317437ddc tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:17.405397 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6c883245-9780-4f0d-af07-ba7317437ddc tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:17.406765 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6c883245-9780-4f0d-af07-ba7317437ddc tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:17.407994 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6c883245-9780-4f0d-af07-ba7317437ddc tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:17.907233 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6c883245-9780-4f0d-af07-ba7317437ddc tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:17.920022 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6c883245-9780-4f0d-af07-ba7317437ddc tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d" status: 200 len: 1208 microversion: 2.1 time: 0.547390 Oct 23 01:13:17.929494 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 355/730] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:17 2022] GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d => generated 1208 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:17.950633 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-79f42824-3939-42b7-b9eb-44065278f18b tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:17.952925 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-79f42824-3939-42b7-b9eb-44065278f18b tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:17.962518 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-79f42824-3939-42b7-b9eb-44065278f18b tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:17.963319 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-79f42824-3939-42b7-b9eb-44065278f18b tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:17.963975 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-79f42824-3939-42b7-b9eb-44065278f18b tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:17.964814 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-79f42824-3939-42b7-b9eb-44065278f18b tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:17.965276 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-79f42824-3939-42b7-b9eb-44065278f18b tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:17.965705 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-79f42824-3939-42b7-b9eb-44065278f18b tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:17.974955 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-77dbdaff-3e3a-45d2-a44f-404c903769d2 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e535f9274b24a9f800ea0c3d8faba5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b8e89ba0a14188bac8e28b66b5a197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:17.992266 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-77dbdaff-3e3a-45d2-a44f-404c903769d2 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "GET /compute/v2.1/servers/f5fe429a-88b7-4d3d-975b-a10c725c4e2f" status: 200 len: 1712 microversion: 2.1 time: 1.289937 Oct 23 01:13:17.996869 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 376/731] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:16 2022] GET /compute/v2.1/servers/f5fe429a-88b7-4d3d-975b-a10c725c4e2f => generated 1712 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:18.020932 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-59d3177f-29d4-49dc-8735-910cb5645597 req-877c44e8-634a-45ff-99ed-207d9cfde19f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f277484-b3ae-465e-90b7-8febafef9329", "name": "network-vif-plugged", "status": "completed", "tag": "4af1b3a5-4e5f-45a7-ab54-f98595e2f6f7"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:13:18.063744 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-59d3177f-29d4-49dc-8735-910cb5645597 req-877c44e8-634a-45ff-99ed-207d9cfde19f service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:18.063744 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-59d3177f-29d4-49dc-8735-910cb5645597 req-877c44e8-634a-45ff-99ed-207d9cfde19f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:18.063744 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-59d3177f-29d4-49dc-8735-910cb5645597 req-877c44e8-634a-45ff-99ed-207d9cfde19f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:18.082063 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-59d3177f-29d4-49dc-8735-910cb5645597 req-877c44e8-634a-45ff-99ed-207d9cfde19f service nova] Creating event network-vif-plugged:4af1b3a5-4e5f-45a7-ab54-f98595e2f6f7 for instance 8f277484-b3ae-465e-90b7-8febafef9329 on n-h1-master-1 Oct 23 01:13:18.098161 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-59d3177f-29d4-49dc-8735-910cb5645597 req-877c44e8-634a-45ff-99ed-207d9cfde19f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086543 Oct 23 01:13:18.099295 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 377/732] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:13:18.111023 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bb54b04f-0c98-4dfc-be88-b995b296fae5 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:18.113373 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-bb54b04f-0c98-4dfc-be88-b995b296fae5 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f277484-b3ae-465e-90b7-8febafef9329] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:18.130855 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bb54b04f-0c98-4dfc-be88-b995b296fae5 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:18.131815 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bb54b04f-0c98-4dfc-be88-b995b296fae5 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:18.132717 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bb54b04f-0c98-4dfc-be88-b995b296fae5 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:18.139210 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bb54b04f-0c98-4dfc-be88-b995b296fae5 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:18.140092 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bb54b04f-0c98-4dfc-be88-b995b296fae5 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:18.141215 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bb54b04f-0c98-4dfc-be88-b995b296fae5 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:18.155844 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-79f42824-3939-42b7-b9eb-44065278f18b tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:18.191855 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-79f42824-3939-42b7-b9eb-44065278f18b tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:18.196225 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-79f42824-3939-42b7-b9eb-44065278f18b tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:18.208973 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-79f42824-3939-42b7-b9eb-44065278f18b tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1544 microversion: 2.91 time: 0.276486 Oct 23 01:13:18.212516 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 356/733] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:17 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1544 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:13:18.396088 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6df29bb4-b3b1-4b03-979e-7267f5bbd3b9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:18.397075 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6df29bb4-b3b1-4b03-979e-7267f5bbd3b9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:18.412820 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6df29bb4-b3b1-4b03-979e-7267f5bbd3b9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:18.414237 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6df29bb4-b3b1-4b03-979e-7267f5bbd3b9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:18.415524 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6df29bb4-b3b1-4b03-979e-7267f5bbd3b9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:18.416430 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6df29bb4-b3b1-4b03-979e-7267f5bbd3b9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:18.418582 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6df29bb4-b3b1-4b03-979e-7267f5bbd3b9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:18.420898 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6df29bb4-b3b1-4b03-979e-7267f5bbd3b9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:18.801166 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bb54b04f-0c98-4dfc-be88-b995b296fae5 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:18.822499 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bb54b04f-0c98-4dfc-be88-b995b296fae5 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329" status: 200 len: 1472 microversion: 2.1 time: 0.721767 Oct 23 01:13:18.823119 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 378/734] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:18 2022] GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329 => generated 1472 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:18.921857 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6df29bb4-b3b1-4b03-979e-7267f5bbd3b9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:18.931053 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6df29bb4-b3b1-4b03-979e-7267f5bbd3b9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 200 len: 1291 microversion: 2.1 time: 0.539525 Oct 23 01:13:18.931961 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 357/735] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:18 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 1291 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:18.952802 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-aa6f875e-7881-463f-b401-5dea4aa17edf tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:18.953484 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-aa6f875e-7881-463f-b401-5dea4aa17edf tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: edb35c7d-9adc-4b53-9bef-147aadbeae5d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:18.969487 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa6f875e-7881-463f-b401-5dea4aa17edf tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:18.985830 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa6f875e-7881-463f-b401-5dea4aa17edf tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:18.986554 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa6f875e-7881-463f-b401-5dea4aa17edf tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:18.987725 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa6f875e-7881-463f-b401-5dea4aa17edf tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:18.991216 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa6f875e-7881-463f-b401-5dea4aa17edf tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:18.991871 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa6f875e-7881-463f-b401-5dea4aa17edf tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:19.030191 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e324e82e-532d-4eaf-abdb-30bab4d4a1be tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:19.030811 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e324e82e-532d-4eaf-abdb-30bab4d4a1be tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: f5fe429a-88b7-4d3d-975b-a10c725c4e2f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:19.043391 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e324e82e-532d-4eaf-abdb-30bab4d4a1be tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:19.043915 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e324e82e-532d-4eaf-abdb-30bab4d4a1be tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:19.050666 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e324e82e-532d-4eaf-abdb-30bab4d4a1be tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:19.051479 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e324e82e-532d-4eaf-abdb-30bab4d4a1be tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:19.051958 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e324e82e-532d-4eaf-abdb-30bab4d4a1be tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:19.052402 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e324e82e-532d-4eaf-abdb-30bab4d4a1be tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:19.076262 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:19.386495 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e324e82e-532d-4eaf-abdb-30bab4d4a1be tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e535f9274b24a9f800ea0c3d8faba5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b8e89ba0a14188bac8e28b66b5a197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:19.389288 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-aa6f875e-7881-463f-b401-5dea4aa17edf tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:19.403804 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-aa6f875e-7881-463f-b401-5dea4aa17edf tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d" status: 200 len: 1272 microversion: 2.1 time: 0.449972 Oct 23 01:13:19.404996 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 379/736] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:18 2022] GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d => generated 1272 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:19.407619 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e324e82e-532d-4eaf-abdb-30bab4d4a1be tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "GET /compute/v2.1/servers/f5fe429a-88b7-4d3d-975b-a10c725c4e2f" status: 200 len: 1644 microversion: 2.1 time: 0.381326 Oct 23 01:13:19.424744 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-958ccfc8-57c8-4cb7-b822-ab47b69280e8 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:19.427046 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 358/737] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:19 2022] GET /compute/v2.1/servers/f5fe429a-88b7-4d3d-975b-a10c725c4e2f => generated 1644 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:19.427650 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-958ccfc8-57c8-4cb7-b822-ab47b69280e8 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:19.441887 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-958ccfc8-57c8-4cb7-b822-ab47b69280e8 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:19.442501 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-958ccfc8-57c8-4cb7-b822-ab47b69280e8 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:19.442950 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-958ccfc8-57c8-4cb7-b822-ab47b69280e8 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:19.443769 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-958ccfc8-57c8-4cb7-b822-ab47b69280e8 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:19.446271 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-958ccfc8-57c8-4cb7-b822-ab47b69280e8 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:19.446777 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-958ccfc8-57c8-4cb7-b822-ab47b69280e8 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:19.858337 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6dfdae5f-5c7a-43ce-964f-ea2df1d908e0 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:19.859042 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6dfdae5f-5c7a-43ce-964f-ea2df1d908e0 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f277484-b3ae-465e-90b7-8febafef9329] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:19.885678 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6dfdae5f-5c7a-43ce-964f-ea2df1d908e0 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:19.890372 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6dfdae5f-5c7a-43ce-964f-ea2df1d908e0 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:19.892085 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6dfdae5f-5c7a-43ce-964f-ea2df1d908e0 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:19.893637 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6dfdae5f-5c7a-43ce-964f-ea2df1d908e0 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:19.895521 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6dfdae5f-5c7a-43ce-964f-ea2df1d908e0 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:19.896080 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6dfdae5f-5c7a-43ce-964f-ea2df1d908e0 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:19.987175 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:20.210319 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-958ccfc8-57c8-4cb7-b822-ab47b69280e8 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:20.220972 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-958ccfc8-57c8-4cb7-b822-ab47b69280e8 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:20.222614 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-958ccfc8-57c8-4cb7-b822-ab47b69280e8 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:20.245572 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-958ccfc8-57c8-4cb7-b822-ab47b69280e8 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1544 microversion: 2.91 time: 0.827155 Oct 23 01:13:20.246555 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 380/738] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:19 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1544 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:13:20.308870 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4b08ac1a-115a-4fc0-bc2b-66023aed355b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:20.311490 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4b08ac1a-115a-4fc0-bc2b-66023aed355b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:20.347867 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b08ac1a-115a-4fc0-bc2b-66023aed355b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:20.349175 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b08ac1a-115a-4fc0-bc2b-66023aed355b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:20.349825 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b08ac1a-115a-4fc0-bc2b-66023aed355b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:20.350779 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b08ac1a-115a-4fc0-bc2b-66023aed355b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:20.351431 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b08ac1a-115a-4fc0-bc2b-66023aed355b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:20.352100 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b08ac1a-115a-4fc0-bc2b-66023aed355b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:20.513474 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4b08ac1a-115a-4fc0-bc2b-66023aed355b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:20.524208 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4b08ac1a-115a-4fc0-bc2b-66023aed355b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 200 len: 1291 microversion: 2.1 time: 0.236495 Oct 23 01:13:20.526144 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 381/739] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:20 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 1291 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:20.540550 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-60bec5f8-48fb-4b0d-9f29-5a989911178d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:20.540550 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-60bec5f8-48fb-4b0d-9f29-5a989911178d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: edb35c7d-9adc-4b53-9bef-147aadbeae5d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:20.548925 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-60bec5f8-48fb-4b0d-9f29-5a989911178d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:20.548925 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-60bec5f8-48fb-4b0d-9f29-5a989911178d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:20.549268 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-60bec5f8-48fb-4b0d-9f29-5a989911178d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:20.550598 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-60bec5f8-48fb-4b0d-9f29-5a989911178d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:20.551196 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-60bec5f8-48fb-4b0d-9f29-5a989911178d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:20.551534 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-60bec5f8-48fb-4b0d-9f29-5a989911178d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:20.729685 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-60bec5f8-48fb-4b0d-9f29-5a989911178d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:20.736204 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6dfdae5f-5c7a-43ce-964f-ea2df1d908e0 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:20.747338 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-60bec5f8-48fb-4b0d-9f29-5a989911178d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d" status: 200 len: 1270 microversion: 2.1 time: 0.219428 Oct 23 01:13:20.747940 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 382/740] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:20 2022] GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d => generated 1270 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:20.752958 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6dfdae5f-5c7a-43ce-964f-ea2df1d908e0 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329" status: 200 len: 1472 microversion: 2.1 time: 0.902966 Oct 23 01:13:20.753719 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 359/741] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:19 2022] GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329 => generated 1472 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:20.782414 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-90431f5e-8f31-43c3-9e7f-957f6da09258 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:20.783194 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-90431f5e-8f31-43c3-9e7f-957f6da09258 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: f5fe429a-88b7-4d3d-975b-a10c725c4e2f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:20.790319 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-90431f5e-8f31-43c3-9e7f-957f6da09258 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:20.790815 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-90431f5e-8f31-43c3-9e7f-957f6da09258 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:20.791245 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-90431f5e-8f31-43c3-9e7f-957f6da09258 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:20.792192 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-90431f5e-8f31-43c3-9e7f-957f6da09258 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:20.792648 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-90431f5e-8f31-43c3-9e7f-957f6da09258 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:20.797799 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-90431f5e-8f31-43c3-9e7f-957f6da09258 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:21.039181 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-90431f5e-8f31-43c3-9e7f-957f6da09258 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e535f9274b24a9f800ea0c3d8faba5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b8e89ba0a14188bac8e28b66b5a197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:21.068765 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-90431f5e-8f31-43c3-9e7f-957f6da09258 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "GET /compute/v2.1/servers/f5fe429a-88b7-4d3d-975b-a10c725c4e2f" status: 200 len: 1644 microversion: 2.1 time: 0.296442 Oct 23 01:13:21.072270 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 383/742] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:20 2022] GET /compute/v2.1/servers/f5fe429a-88b7-4d3d-975b-a10c725c4e2f => generated 1644 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:21.175450 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-6f3ec4a0-3d45-4ac8-995c-1e1084d5d19e req-efe3c96a-9359-4852-940b-bffd035e23fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5fe429a-88b7-4d3d-975b-a10c725c4e2f", "name": "network-vif-deleted", "tag": "ddf48485-558f-40c5-9932-d78ea427f0f3"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:13:21.226990 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-6f3ec4a0-3d45-4ac8-995c-1e1084d5d19e req-efe3c96a-9359-4852-940b-bffd035e23fa service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:21.227611 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-6f3ec4a0-3d45-4ac8-995c-1e1084d5d19e req-efe3c96a-9359-4852-940b-bffd035e23fa service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:21.229560 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-6f3ec4a0-3d45-4ac8-995c-1e1084d5d19e req-efe3c96a-9359-4852-940b-bffd035e23fa service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:21.279561 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8150839e-ff67-4330-bebe-3d86a4348a65 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:21.280178 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8150839e-ff67-4330-bebe-3d86a4348a65 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:21.280958 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-6f3ec4a0-3d45-4ac8-995c-1e1084d5d19e req-efe3c96a-9359-4852-940b-bffd035e23fa service nova] Creating event network-vif-deleted:ddf48485-558f-40c5-9932-d78ea427f0f3 for instance f5fe429a-88b7-4d3d-975b-a10c725c4e2f on n-h2-master-1 Oct 23 01:13:21.299830 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-6f3ec4a0-3d45-4ac8-995c-1e1084d5d19e req-efe3c96a-9359-4852-940b-bffd035e23fa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128374 Oct 23 01:13:21.300817 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 360/743] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:13:21.308411 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8150839e-ff67-4330-bebe-3d86a4348a65 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:21.309217 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8150839e-ff67-4330-bebe-3d86a4348a65 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:21.309783 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8150839e-ff67-4330-bebe-3d86a4348a65 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:21.310995 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8150839e-ff67-4330-bebe-3d86a4348a65 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:21.324213 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8150839e-ff67-4330-bebe-3d86a4348a65 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:21.326999 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8150839e-ff67-4330-bebe-3d86a4348a65 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:21.393445 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:21.494017 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8150839e-ff67-4330-bebe-3d86a4348a65 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:21.503651 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8150839e-ff67-4330-bebe-3d86a4348a65 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:21.508694 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8150839e-ff67-4330-bebe-3d86a4348a65 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:21.516987 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8150839e-ff67-4330-bebe-3d86a4348a65 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1544 microversion: 2.91 time: 0.243680 Oct 23 01:13:21.530656 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 384/744] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:21 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1544 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:13:21.550440 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a12fdcad-443f-447d-9bfb-10cd53c3dbf6 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:21.551473 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a12fdcad-443f-447d-9bfb-10cd53c3dbf6 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:21.564880 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a12fdcad-443f-447d-9bfb-10cd53c3dbf6 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:21.565383 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a12fdcad-443f-447d-9bfb-10cd53c3dbf6 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:21.565819 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a12fdcad-443f-447d-9bfb-10cd53c3dbf6 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:21.566560 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a12fdcad-443f-447d-9bfb-10cd53c3dbf6 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:21.568798 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a12fdcad-443f-447d-9bfb-10cd53c3dbf6 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:21.569391 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a12fdcad-443f-447d-9bfb-10cd53c3dbf6 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:21.775585 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-df1941fd-9356-4e12-a978-fd908d57567e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:21.776211 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-df1941fd-9356-4e12-a978-fd908d57567e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: edb35c7d-9adc-4b53-9bef-147aadbeae5d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:21.800931 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-df1941fd-9356-4e12-a978-fd908d57567e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:21.803407 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-df1941fd-9356-4e12-a978-fd908d57567e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:21.807227 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-df1941fd-9356-4e12-a978-fd908d57567e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:21.811497 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-df1941fd-9356-4e12-a978-fd908d57567e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:21.814091 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-df1941fd-9356-4e12-a978-fd908d57567e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:21.814806 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-df1941fd-9356-4e12-a978-fd908d57567e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:21.838728 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a12fdcad-443f-447d-9bfb-10cd53c3dbf6 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:21.855573 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a12fdcad-443f-447d-9bfb-10cd53c3dbf6 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 200 len: 1359 microversion: 2.1 time: 0.309186 Oct 23 01:13:21.859600 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 361/745] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:21 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 1359 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:21.879870 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d716d2d3-9af2-4ad5-9d4a-dea9506b8e13 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:21.884556 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d716d2d3-9af2-4ad5-9d4a-dea9506b8e13 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f277484-b3ae-465e-90b7-8febafef9329] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:21.912711 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d716d2d3-9af2-4ad5-9d4a-dea9506b8e13 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:21.915435 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d716d2d3-9af2-4ad5-9d4a-dea9506b8e13 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:21.916849 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d716d2d3-9af2-4ad5-9d4a-dea9506b8e13 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:21.921058 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d716d2d3-9af2-4ad5-9d4a-dea9506b8e13 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:21.921747 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d716d2d3-9af2-4ad5-9d4a-dea9506b8e13 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:21.922426 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d716d2d3-9af2-4ad5-9d4a-dea9506b8e13 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:22.022162 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-df1941fd-9356-4e12-a978-fd908d57567e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:22.050195 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-df1941fd-9356-4e12-a978-fd908d57567e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d" status: 200 len: 1270 microversion: 2.1 time: 0.278730 Oct 23 01:13:22.050786 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 385/746] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:21 2022] GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d => generated 1270 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:13:22.096389 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a7c63d84-d03b-4b73-967d-a533eb686078 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:22.097417 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a7c63d84-d03b-4b73-967d-a533eb686078 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: f5fe429a-88b7-4d3d-975b-a10c725c4e2f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:22.109050 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a7c63d84-d03b-4b73-967d-a533eb686078 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:22.112345 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a7c63d84-d03b-4b73-967d-a533eb686078 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:22.114647 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a7c63d84-d03b-4b73-967d-a533eb686078 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:22.115713 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a7c63d84-d03b-4b73-967d-a533eb686078 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:22.116889 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a7c63d84-d03b-4b73-967d-a533eb686078 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:22.121499 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a7c63d84-d03b-4b73-967d-a533eb686078 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:22.295715 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a7c63d84-d03b-4b73-967d-a533eb686078 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e535f9274b24a9f800ea0c3d8faba5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b8e89ba0a14188bac8e28b66b5a197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:22.310299 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a7c63d84-d03b-4b73-967d-a533eb686078 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "GET /compute/v2.1/servers/f5fe429a-88b7-4d3d-975b-a10c725c4e2f" status: 200 len: 1347 microversion: 2.1 time: 0.218200 Oct 23 01:13:22.323373 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 386/747] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:22 2022] GET /compute/v2.1/servers/f5fe429a-88b7-4d3d-975b-a10c725c4e2f => generated 1347 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:13:22.343518 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d716d2d3-9af2-4ad5-9d4a-dea9506b8e13 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:22.354878 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d716d2d3-9af2-4ad5-9d4a-dea9506b8e13 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329" status: 200 len: 1472 microversion: 2.1 time: 0.493959 Oct 23 01:13:22.367641 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 362/748] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:21 2022] GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329 => generated 1472 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:22.548570 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ffa75728-d90f-4168-9ac4-7d462f04afb6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:22.549212 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ffa75728-d90f-4168-9ac4-7d462f04afb6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:22.566319 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ffa75728-d90f-4168-9ac4-7d462f04afb6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:22.566821 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ffa75728-d90f-4168-9ac4-7d462f04afb6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:22.567259 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ffa75728-d90f-4168-9ac4-7d462f04afb6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:22.567964 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ffa75728-d90f-4168-9ac4-7d462f04afb6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:22.568419 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ffa75728-d90f-4168-9ac4-7d462f04afb6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:22.568844 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ffa75728-d90f-4168-9ac4-7d462f04afb6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:22.685329 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ffa75728-d90f-4168-9ac4-7d462f04afb6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:22.708741 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ffa75728-d90f-4168-9ac4-7d462f04afb6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:22.712620 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ffa75728-d90f-4168-9ac4-7d462f04afb6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:22.745728 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ffa75728-d90f-4168-9ac4-7d462f04afb6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1544 microversion: 2.91 time: 0.203180 Oct 23 01:13:22.771117 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 387/749] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:22 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1544 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:13:22.884827 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-697552ea-7c24-483f-8f2d-25ac3fdceb9b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:22.885439 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-697552ea-7c24-483f-8f2d-25ac3fdceb9b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:22.903394 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-697552ea-7c24-483f-8f2d-25ac3fdceb9b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:22.903865 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-697552ea-7c24-483f-8f2d-25ac3fdceb9b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:22.904312 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-697552ea-7c24-483f-8f2d-25ac3fdceb9b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:22.905013 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-697552ea-7c24-483f-8f2d-25ac3fdceb9b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:22.905472 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-697552ea-7c24-483f-8f2d-25ac3fdceb9b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:22.905895 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-697552ea-7c24-483f-8f2d-25ac3fdceb9b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:23.075199 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-77811297-2031-4757-b4a5-973712dbdff4 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:23.076135 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-77811297-2031-4757-b4a5-973712dbdff4 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: edb35c7d-9adc-4b53-9bef-147aadbeae5d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:23.085225 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-77811297-2031-4757-b4a5-973712dbdff4 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:23.086528 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-77811297-2031-4757-b4a5-973712dbdff4 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:23.090277 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-77811297-2031-4757-b4a5-973712dbdff4 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:23.090277 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-77811297-2031-4757-b4a5-973712dbdff4 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:23.090277 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-77811297-2031-4757-b4a5-973712dbdff4 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:23.090277 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-77811297-2031-4757-b4a5-973712dbdff4 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:23.271768 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-697552ea-7c24-483f-8f2d-25ac3fdceb9b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:23.288110 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-697552ea-7c24-483f-8f2d-25ac3fdceb9b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 200 len: 1359 microversion: 2.1 time: 0.402805 Oct 23 01:13:23.289728 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 363/750] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:22 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 1359 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:23.338021 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3d772a19-e365-49c3-a6dc-db5049fd5b8a tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:23.346954 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3d772a19-e365-49c3-a6dc-db5049fd5b8a tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: f5fe429a-88b7-4d3d-975b-a10c725c4e2f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:23.349527 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d772a19-e365-49c3-a6dc-db5049fd5b8a tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:23.350233 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d772a19-e365-49c3-a6dc-db5049fd5b8a tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:23.353109 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d772a19-e365-49c3-a6dc-db5049fd5b8a tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:23.354393 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d772a19-e365-49c3-a6dc-db5049fd5b8a tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:23.378506 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d772a19-e365-49c3-a6dc-db5049fd5b8a tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:23.385030 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d772a19-e365-49c3-a6dc-db5049fd5b8a tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:23.420715 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-77811297-2031-4757-b4a5-973712dbdff4 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:23.431430 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-77811297-2031-4757-b4a5-973712dbdff4 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d" status: 200 len: 1312 microversion: 2.1 time: 0.359006 Oct 23 01:13:23.437263 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 388/751] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:23 2022] GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d => generated 1312 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:13:23.460645 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cc53ba16-35ea-4264-8af9-4bcccc1d28ff tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:23.470644 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cc53ba16-35ea-4264-8af9-4bcccc1d28ff tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f277484-b3ae-465e-90b7-8febafef9329] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:23.477259 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cc53ba16-35ea-4264-8af9-4bcccc1d28ff tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:23.482063 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cc53ba16-35ea-4264-8af9-4bcccc1d28ff tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:23.482803 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cc53ba16-35ea-4264-8af9-4bcccc1d28ff tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:23.483923 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cc53ba16-35ea-4264-8af9-4bcccc1d28ff tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:23.484668 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cc53ba16-35ea-4264-8af9-4bcccc1d28ff tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:23.486027 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cc53ba16-35ea-4264-8af9-4bcccc1d28ff tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:23.530110 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d772a19-e365-49c3-a6dc-db5049fd5b8a tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:23.531031 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d772a19-e365-49c3-a6dc-db5049fd5b8a tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:23.535089 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d772a19-e365-49c3-a6dc-db5049fd5b8a tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:23.541120 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-3d772a19-e365-49c3-a6dc-db5049fd5b8a tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lazy-loading 'fault' on Instance uuid f5fe429a-88b7-4d3d-975b-a10c725c4e2f {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:13:23.635568 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3d772a19-e365-49c3-a6dc-db5049fd5b8a tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e535f9274b24a9f800ea0c3d8faba5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b8e89ba0a14188bac8e28b66b5a197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:23.645238 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3d772a19-e365-49c3-a6dc-db5049fd5b8a tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "GET /compute/v2.1/servers/f5fe429a-88b7-4d3d-975b-a10c725c4e2f" status: 200 len: 1352 microversion: 2.1 time: 0.312123 Oct 23 01:13:23.651194 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 364/752] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:23 2022] GET /compute/v2.1/servers/f5fe429a-88b7-4d3d-975b-a10c725c4e2f => generated 1352 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:23.776715 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-585265e9-230c-4a05-916a-8576f3250540 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:23.777250 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-585265e9-230c-4a05-916a-8576f3250540 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:23.793462 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-585265e9-230c-4a05-916a-8576f3250540 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:23.794362 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-585265e9-230c-4a05-916a-8576f3250540 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:23.795043 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-585265e9-230c-4a05-916a-8576f3250540 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:23.795988 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-585265e9-230c-4a05-916a-8576f3250540 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:23.796671 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-585265e9-230c-4a05-916a-8576f3250540 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:23.797897 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-585265e9-230c-4a05-916a-8576f3250540 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:23.875157 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cc53ba16-35ea-4264-8af9-4bcccc1d28ff tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:23.887114 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cc53ba16-35ea-4264-8af9-4bcccc1d28ff tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329" status: 200 len: 1472 microversion: 2.1 time: 0.448490 Oct 23 01:13:23.889576 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 389/753] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:23 2022] GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329 => generated 1472 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:23.980396 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-585265e9-230c-4a05-916a-8576f3250540 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:23.989692 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-585265e9-230c-4a05-916a-8576f3250540 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:23.992082 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-585265e9-230c-4a05-916a-8576f3250540 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:23.999669 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-585265e9-230c-4a05-916a-8576f3250540 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1544 microversion: 2.91 time: 0.226620 Oct 23 01:13:24.000705 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 365/754] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:23 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1544 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:13:24.323053 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-64a89553-7c02-46f2-a0ad-71d58e460c9d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:24.324141 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-64a89553-7c02-46f2-a0ad-71d58e460c9d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:24.352319 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64a89553-7c02-46f2-a0ad-71d58e460c9d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:24.356298 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64a89553-7c02-46f2-a0ad-71d58e460c9d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:24.357152 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64a89553-7c02-46f2-a0ad-71d58e460c9d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:24.361224 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64a89553-7c02-46f2-a0ad-71d58e460c9d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:24.366591 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64a89553-7c02-46f2-a0ad-71d58e460c9d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:24.368625 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64a89553-7c02-46f2-a0ad-71d58e460c9d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:24.465547 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2df5e89c-5538-4a6a-9128-8af3ab794960 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:24.466891 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2df5e89c-5538-4a6a-9128-8af3ab794960 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: edb35c7d-9adc-4b53-9bef-147aadbeae5d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:24.483324 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2df5e89c-5538-4a6a-9128-8af3ab794960 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:24.483832 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2df5e89c-5538-4a6a-9128-8af3ab794960 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:24.484283 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2df5e89c-5538-4a6a-9128-8af3ab794960 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:24.486036 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2df5e89c-5538-4a6a-9128-8af3ab794960 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:24.486036 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2df5e89c-5538-4a6a-9128-8af3ab794960 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:24.486036 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2df5e89c-5538-4a6a-9128-8af3ab794960 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:24.526426 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:24.567649 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=8 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:24.933621 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-64a89553-7c02-46f2-a0ad-71d58e460c9d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:24.942766 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-64a89553-7c02-46f2-a0ad-71d58e460c9d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 200 len: 1359 microversion: 2.1 time: 0.634196 Oct 23 01:13:24.959013 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 390/755] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:24 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 1359 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:24.959013 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4c5ceb8d-df6e-46d5-8c18-fa7991183c86 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:24.959013 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4c5ceb8d-df6e-46d5-8c18-fa7991183c86 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: f5fe429a-88b7-4d3d-975b-a10c725c4e2f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:24.981511 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4c5ceb8d-df6e-46d5-8c18-fa7991183c86 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:24.989608 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4c5ceb8d-df6e-46d5-8c18-fa7991183c86 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:24.992734 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4c5ceb8d-df6e-46d5-8c18-fa7991183c86 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:24.992734 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4c5ceb8d-df6e-46d5-8c18-fa7991183c86 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:24.992734 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4c5ceb8d-df6e-46d5-8c18-fa7991183c86 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:24.992734 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4c5ceb8d-df6e-46d5-8c18-fa7991183c86 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:25.012133 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2df5e89c-5538-4a6a-9128-8af3ab794960 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:25.020063 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-4c5ceb8d-df6e-46d5-8c18-fa7991183c86 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] HTTP exception thrown: Instance f5fe429a-88b7-4d3d-975b-a10c725c4e2f could not be found. Oct 23 01:13:25.021942 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4c5ceb8d-df6e-46d5-8c18-fa7991183c86 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Request method failure captured: Oct 23 01:13:25.021942 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/f5fe429a-88b7-4d3d-975b-a10c725c4e2f HTTP/1.1 Oct 23 01:13:25.021942 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:13:25.021942 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:13:25.021942 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:13:25.021942 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:13:25.021942 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:13:25.021942 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:13:25.021942 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:13:25.021942 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:13:25.021942 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJSKUts-hH4fEVlEDsBHqznM6LUUsjPi-zy0UkF8eV1QHvSWnclMhCWXIO2CJ9AJB7cSKQ5abcvA_ARJtyx9pTC6puAAr4yXUWRtOwb5rMn0Rr5Xue8qiFrpADzkZ0DnJRNEYp4tqHFOuGhpYxwrBPQDC5XpHy-ksuckLiye5A9c7uI Oct 23 01:13:25.021942 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:13:25.021942 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:13:25.021942 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:13:25.021942 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:13:25.021942 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:13:25.021942 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:13:25.021942 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 08b8e89ba0a14188bac8e28b66b5a197 Oct 23 01:13:25.021942 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-395145993 Oct 23 01:13:25.021942 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:13:25.021942 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:13:25.024165 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/08b8e89ba0a14188bac8e28b66b5a197"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_08b8e89ba0a14188bac8e28b66b5a197"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/08b8e89ba0a14188bac8e28b66b5a197"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/08b8e89ba0a14188bac8e28b66b5a197"}]}] Oct 23 01:13:25.024165 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-395145993 Oct 23 01:13:25.024165 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 08b8e89ba0a14188bac8e28b66b5a197 Oct 23 01:13:25.024165 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-395145993 Oct 23 01:13:25.024165 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServersWithSpecificFlavorTestJSON-395145993-project Oct 23 01:13:25.024165 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:13:25.024165 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:13:25.024165 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 9e535f9274b24a9f800ea0c3d8faba5a Oct 23 01:13:25.024165 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-395145993-project Oct 23 01:13:25.024165 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:13:25.024165 n-d-master-1 devstack@n-api.service[120945]: exception: Instance f5fe429a-88b7-4d3d-975b-a10c725c4e2f could not be found. Oct 23 01:13:25.024165 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'f5fe429a-88b7-4d3d-975b-a10c725c4e2f'} Oct 23 01:13:25.025086 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:13:25.025086 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:13:25.025086 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:13:25.025086 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:13:25.025086 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:13:25.025086 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:13:25.025086 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:13:25.025086 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:13:25.025086 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:13:25.025086 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:13:25.025086 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5fe429a-88b7-4d3d-975b-a10c725c4e2f could not be found. Oct 23 01:13:25.025086 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:13:25.025086 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:13:25.025086 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:13:25.025086 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:13:25.025086 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:13:25.025086 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:13:25.025086 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:13:25.025086 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:13:25.025086 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:13:25.026473 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:13:25.026473 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:13:25.026473 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:13:25.026473 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:13:25.026473 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:13:25.026473 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:13:25.026473 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:13:25.026473 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5fe429a-88b7-4d3d-975b-a10c725c4e2f could not be found. Oct 23 01:13:25.026473 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:13:25.026473 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:13:25.026473 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:13:25.026473 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:13:25.026473 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:13:25.026473 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:13:25.026473 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:13:25.026473 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:13:25.026473 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5fe429a-88b7-4d3d-975b-a10c725c4e2f could not be found. Oct 23 01:13:25.026473 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:13:25.027609 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2df5e89c-5538-4a6a-9128-8af3ab794960 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d" status: 200 len: 1312 microversion: 2.1 time: 0.565897 Oct 23 01:13:25.028703 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 366/756] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:24 2022] GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d => generated 1312 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:13:25.028823 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4c5ceb8d-df6e-46d5-8c18-fa7991183c86 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Returning 404 to user: Instance f5fe429a-88b7-4d3d-975b-a10c725c4e2f could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:13:25.029735 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4c5ceb8d-df6e-46d5-8c18-fa7991183c86 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "GET /compute/v2.1/servers/f5fe429a-88b7-4d3d-975b-a10c725c4e2f" status: 404 len: 111 microversion: 2.1 time: 0.083231 Oct 23 01:13:25.030772 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 391/757] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:24 2022] GET /compute/v2.1/servers/f5fe429a-88b7-4d3d-975b-a10c725c4e2f => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:13:25.038141 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ac0ca0c5-6ebd-4289-afb5-f915d85dac75 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-268967320", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "31f0b364-b5fc-45d5-a0bc-c8d0c8a70961"}, {"uuid": "ba2b0d97-e839-43c5-90e4-31c96d6b2bbe"}, {"uuid": "31f0b364-b5fc-45d5-a0bc-c8d0c8a70961"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:13:25.123428 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-ac0ca0c5-6ebd-4289-afb5-f915d85dac75 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] validate_networks() for [('31f0b364-b5fc-45d5-a0bc-c8d0c8a70961', None, None, None, None, None), ('ba2b0d97-e839-43c5-90e4-31c96d6b2bbe', None, None, None, None, None), ('31f0b364-b5fc-45d5-a0bc-c8d0c8a70961', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:13:25.613411 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-94cfd01f-b9c5-4cd2-a2ed-4db826c145da tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1464819784", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "f12f5541-6400-4914-829d-7bf5434dae5d"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:13:25.730675 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-94cfd01f-b9c5-4cd2-a2ed-4db826c145da tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] validate_networks() for [('f12f5541-6400-4914-829d-7bf5434dae5d', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:13:26.694095 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=54,nova_cell0:UPDATE=12 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:26.895919 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-94cfd01f-b9c5-4cd2-a2ed-4db826c145da tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:13:26.896578 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-94cfd01f-b9c5-4cd2-a2ed-4db826c145da tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:13:26.897203 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-94cfd01f-b9c5-4cd2-a2ed-4db826c145da tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:13:26.897749 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-94cfd01f-b9c5-4cd2-a2ed-4db826c145da tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:13:26.898391 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-94cfd01f-b9c5-4cd2-a2ed-4db826c145da tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:13:26.912574 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94cfd01f-b9c5-4cd2-a2ed-4db826c145da tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:26.913074 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94cfd01f-b9c5-4cd2-a2ed-4db826c145da tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:26.913513 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94cfd01f-b9c5-4cd2-a2ed-4db826c145da tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:26.914331 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94cfd01f-b9c5-4cd2-a2ed-4db826c145da tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:26.914752 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94cfd01f-b9c5-4cd2-a2ed-4db826c145da tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:26.916317 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94cfd01f-b9c5-4cd2-a2ed-4db826c145da tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:26.939717 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-94cfd01f-b9c5-4cd2-a2ed-4db826c145da tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Getting quotas for project ccc52d9ecfdf43f58b665d06e1008b52. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:13:26.947974 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-94cfd01f-b9c5-4cd2-a2ed-4db826c145da tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Getting quotas for user 8a246c84d8f444d59c9d5becae78f75a and project ccc52d9ecfdf43f58b665d06e1008b52. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:13:26.965379 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-94cfd01f-b9c5-4cd2-a2ed-4db826c145da tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:13:26.997031 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-94cfd01f-b9c5-4cd2-a2ed-4db826c145da tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 283de315-fdcb-4c89-91e3-96aa3e822b21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:13:27.140604 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-94cfd01f-b9c5-4cd2-a2ed-4db826c145da tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.108520 Oct 23 01:13:27.141417 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 392/758] 10.222.0.42 () {62 vars in 1188 bytes} [Sun Oct 23 01:13:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2110 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 23 01:13:27.149870 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-806cca41-0aa5-4fc2-a6a2-60a4a37a6d55 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:27.150620 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-806cca41-0aa5-4fc2-a6a2-60a4a37a6d55 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f277484-b3ae-465e-90b7-8febafef9329] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:27.161011 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-806cca41-0aa5-4fc2-a6a2-60a4a37a6d55 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:27.177339 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-806cca41-0aa5-4fc2-a6a2-60a4a37a6d55 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:27.198378 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-806cca41-0aa5-4fc2-a6a2-60a4a37a6d55 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:27.201949 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-806cca41-0aa5-4fc2-a6a2-60a4a37a6d55 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:27.206035 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-806cca41-0aa5-4fc2-a6a2-60a4a37a6d55 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:27.207157 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-806cca41-0aa5-4fc2-a6a2-60a4a37a6d55 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:27.281887 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-ac0ca0c5-6ebd-4289-afb5-f915d85dac75 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:13:27.282448 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-ac0ca0c5-6ebd-4289-afb5-f915d85dac75 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:13:27.283988 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-ac0ca0c5-6ebd-4289-afb5-f915d85dac75 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:13:27.285836 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-ac0ca0c5-6ebd-4289-afb5-f915d85dac75 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:13:27.286482 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-ac0ca0c5-6ebd-4289-afb5-f915d85dac75 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:13:27.305936 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac0ca0c5-6ebd-4289-afb5-f915d85dac75 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:27.308247 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac0ca0c5-6ebd-4289-afb5-f915d85dac75 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:27.311241 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac0ca0c5-6ebd-4289-afb5-f915d85dac75 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:27.312651 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac0ca0c5-6ebd-4289-afb5-f915d85dac75 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:27.313304 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac0ca0c5-6ebd-4289-afb5-f915d85dac75 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:27.313936 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac0ca0c5-6ebd-4289-afb5-f915d85dac75 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:27.350571 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-ac0ca0c5-6ebd-4289-afb5-f915d85dac75 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Getting quotas for project abc8f8cefbf441c98d6bda76e99e3173. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:13:27.369089 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-ac0ca0c5-6ebd-4289-afb5-f915d85dac75 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Getting quotas for user 7262d5984b8c4775b86fae1c0d314718 and project abc8f8cefbf441c98d6bda76e99e3173. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:13:27.403130 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ac0ca0c5-6ebd-4289-afb5-f915d85dac75 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:13:27.416136 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ac0ca0c5-6ebd-4289-afb5-f915d85dac75 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 93d46a54-c775-4fc6-ad62-edf53bee2d07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:13:27.495775 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-806cca41-0aa5-4fc2-a6a2-60a4a37a6d55 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:27.510299 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-806cca41-0aa5-4fc2-a6a2-60a4a37a6d55 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329" status: 200 len: 1472 microversion: 2.1 time: 0.366402 Oct 23 01:13:27.511482 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 393/759] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:27 2022] GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329 => generated 1472 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:27.520011 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4ebb2a82-4c5d-4532-b675-2f2a5cc8705e tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:27.520862 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4ebb2a82-4c5d-4532-b675-2f2a5cc8705e tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:27.529497 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4ebb2a82-4c5d-4532-b675-2f2a5cc8705e tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:27.533417 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4ebb2a82-4c5d-4532-b675-2f2a5cc8705e tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:27.534136 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4ebb2a82-4c5d-4532-b675-2f2a5cc8705e tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:27.535071 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4ebb2a82-4c5d-4532-b675-2f2a5cc8705e tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:27.535529 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4ebb2a82-4c5d-4532-b675-2f2a5cc8705e tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:27.536125 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4ebb2a82-4c5d-4532-b675-2f2a5cc8705e tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:27.552211 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ac0ca0c5-6ebd-4289-afb5-f915d85dac75 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.522464 Oct 23 01:13:27.553103 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 367/760] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:13:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:13:27.558112 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2740bd38-67e7-4f4a-a729-aaddb65a3ba9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:27.558831 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2740bd38-67e7-4f4a-a729-aaddb65a3ba9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:27.567111 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2740bd38-67e7-4f4a-a729-aaddb65a3ba9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:27.567849 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2740bd38-67e7-4f4a-a729-aaddb65a3ba9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:27.568508 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2740bd38-67e7-4f4a-a729-aaddb65a3ba9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:27.569380 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2740bd38-67e7-4f4a-a729-aaddb65a3ba9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:27.570015 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2740bd38-67e7-4f4a-a729-aaddb65a3ba9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:27.570794 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2740bd38-67e7-4f4a-a729-aaddb65a3ba9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:27.597443 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-4ebb2a82-4c5d-4532-b675-2f2a5cc8705e tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] HTTP exception thrown: Instance 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb could not be found. Oct 23 01:13:27.607031 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4ebb2a82-4c5d-4532-b675-2f2a5cc8705e tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Request method failure captured: Oct 23 01:13:27.607031 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb HTTP/1.1 Oct 23 01:13:27.607031 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:13:27.607031 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:13:27.607031 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:13:27.607031 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:13:27.607031 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:13:27.607031 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:13:27.607031 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:13:27.607031 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:13:27.607031 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJSKUts-hH4fEVlEDsBHqznM6LUUsjPi-zy0UkF8eV1QHvSWnclMhCWXIO2CJ9AJB7cSKQ5abcvA_ARJtyx9pTC6puAAr4yXUWRtOwb5rMn0Rr5Xue8qiFrpADzkZ0DnJRNEYp4tqHFOuGhpYxwrBPQDC5XpHy-ksuckLiye5A9c7uI Oct 23 01:13:27.607031 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:13:27.607031 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:13:27.607031 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:13:27.607031 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:13:27.607031 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:13:27.607031 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:13:27.607031 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 08b8e89ba0a14188bac8e28b66b5a197 Oct 23 01:13:27.607031 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-395145993 Oct 23 01:13:27.607031 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:13:27.607031 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:13:27.608632 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/08b8e89ba0a14188bac8e28b66b5a197"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_08b8e89ba0a14188bac8e28b66b5a197"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/08b8e89ba0a14188bac8e28b66b5a197"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/08b8e89ba0a14188bac8e28b66b5a197"}]}] Oct 23 01:13:27.608632 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-395145993 Oct 23 01:13:27.608632 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 08b8e89ba0a14188bac8e28b66b5a197 Oct 23 01:13:27.608632 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-395145993 Oct 23 01:13:27.608632 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServersWithSpecificFlavorTestJSON-395145993-project Oct 23 01:13:27.608632 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:13:27.608632 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:13:27.608632 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 9e535f9274b24a9f800ea0c3d8faba5a Oct 23 01:13:27.608632 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-395145993-project Oct 23 01:13:27.608632 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:13:27.608632 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb could not be found. Oct 23 01:13:27.608632 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb'} Oct 23 01:13:27.609474 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:13:27.609474 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:13:27.609474 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:13:27.609474 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:13:27.609474 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:13:27.609474 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:13:27.609474 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:13:27.609474 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:13:27.609474 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:13:27.609474 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:13:27.609474 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb could not be found. Oct 23 01:13:27.609474 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:13:27.609474 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:13:27.609474 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:13:27.609474 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:13:27.609474 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:13:27.609474 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:13:27.609474 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:13:27.609474 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:13:27.609474 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:13:27.610934 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:13:27.610934 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:13:27.610934 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:13:27.610934 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:13:27.610934 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:13:27.610934 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:13:27.610934 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:13:27.610934 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:13:27.610934 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:13:27.610934 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb could not be found. Oct 23 01:13:27.610934 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:13:27.610934 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:13:27.610934 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:13:27.610934 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:13:27.610934 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:13:27.610934 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:13:27.610934 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:13:27.610934 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:13:27.610934 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb could not be found. Oct 23 01:13:27.610934 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:13:27.621343 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4ebb2a82-4c5d-4532-b675-2f2a5cc8705e tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Returning 404 to user: Instance 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:13:27.621343 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4ebb2a82-4c5d-4532-b675-2f2a5cc8705e tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb" status: 404 len: 111 microversion: 2.1 time: 0.107151 Oct 23 01:13:27.623639 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 394/761] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:13:27 2022] DELETE /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:13:27.628554 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-5d9e9b63-83d5-47af-9402-129cccd9bf7f req-32e719fb-72bb-41b6-ad40-ecc43686fa80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "510a3540-031d-4fab-bf7c-0a3bbc8c4d4d", "tag": "baff0168-301d-414b-99b1-bb1e62f9bfcd"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:13:27.644490 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-5d9e9b63-83d5-47af-9402-129cccd9bf7f req-32e719fb-72bb-41b6-ad40-ecc43686fa80 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:27.646580 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-5d9e9b63-83d5-47af-9402-129cccd9bf7f req-32e719fb-72bb-41b6-ad40-ecc43686fa80 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:27.647177 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-5d9e9b63-83d5-47af-9402-129cccd9bf7f req-32e719fb-72bb-41b6-ad40-ecc43686fa80 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:27.661298 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-5d9e9b63-83d5-47af-9402-129cccd9bf7f req-32e719fb-72bb-41b6-ad40-ecc43686fa80 service nova] Creating event network-changed:baff0168-301d-414b-99b1-bb1e62f9bfcd for instance 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d on n-h2-master-1 Oct 23 01:13:27.669939 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-5d9e9b63-83d5-47af-9402-129cccd9bf7f req-32e719fb-72bb-41b6-ad40-ecc43686fa80 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044747 Oct 23 01:13:27.673102 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 395/762] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:13:27.677362 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-460d7ac7-5926-42f3-97ff-9423debb4a2f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:27.678293 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-460d7ac7-5926-42f3-97ff-9423debb4a2f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:27.681629 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2740bd38-67e7-4f4a-a729-aaddb65a3ba9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:27.687447 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-460d7ac7-5926-42f3-97ff-9423debb4a2f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:27.688222 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-460d7ac7-5926-42f3-97ff-9423debb4a2f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:27.688885 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-460d7ac7-5926-42f3-97ff-9423debb4a2f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:27.689819 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-460d7ac7-5926-42f3-97ff-9423debb4a2f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:27.690542 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-460d7ac7-5926-42f3-97ff-9423debb4a2f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:27.691372 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-460d7ac7-5926-42f3-97ff-9423debb4a2f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:27.692542 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2740bd38-67e7-4f4a-a729-aaddb65a3ba9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:27.694172 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2740bd38-67e7-4f4a-a729-aaddb65a3ba9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:27.700818 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2740bd38-67e7-4f4a-a729-aaddb65a3ba9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1531 microversion: 2.91 time: 0.146504 Oct 23 01:13:27.702077 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 368/763] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:27 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1531 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:13:27.707667 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4efd842b-2eaf-4165-a632-441f55042779 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:27.708838 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4efd842b-2eaf-4165-a632-441f55042779 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: edb35c7d-9adc-4b53-9bef-147aadbeae5d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:27.718307 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4efd842b-2eaf-4165-a632-441f55042779 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:27.719530 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4efd842b-2eaf-4165-a632-441f55042779 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:27.719990 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4efd842b-2eaf-4165-a632-441f55042779 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:27.720820 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4efd842b-2eaf-4165-a632-441f55042779 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:27.721453 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4efd842b-2eaf-4165-a632-441f55042779 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:27.722049 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4efd842b-2eaf-4165-a632-441f55042779 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:27.962118 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4efd842b-2eaf-4165-a632-441f55042779 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:27.973237 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4efd842b-2eaf-4165-a632-441f55042779 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d" status: 200 len: 1312 microversion: 2.1 time: 0.269555 Oct 23 01:13:27.996137 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 369/764] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:27 2022] GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d => generated 1312 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:28.080134 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-460d7ac7-5926-42f3-97ff-9423debb4a2f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:28.092971 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-460d7ac7-5926-42f3-97ff-9423debb4a2f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 200 len: 1359 microversion: 2.1 time: 0.420623 Oct 23 01:13:28.094873 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 396/765] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:27 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 1359 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:28.124715 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0e75379a-6e1a-4788-a7a9-a59a8b3a0b2a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:28.125343 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0e75379a-6e1a-4788-a7a9-a59a8b3a0b2a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 283de315-fdcb-4c89-91e3-96aa3e822b21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:28.215030 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0e75379a-6e1a-4788-a7a9-a59a8b3a0b2a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:28.224481 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0e75379a-6e1a-4788-a7a9-a59a8b3a0b2a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:28.227360 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0e75379a-6e1a-4788-a7a9-a59a8b3a0b2a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:28.233649 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0e75379a-6e1a-4788-a7a9-a59a8b3a0b2a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21" status: 200 len: 1262 microversion: 2.25 time: 0.117836 Oct 23 01:13:28.245999 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 397/766] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:28 2022] GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21 => generated 1262 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:13:28.250312 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-71003e66-e1c5-4158-a9f6-30c9088cfc3d tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:28.251207 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-71003e66-e1c5-4158-a9f6-30c9088cfc3d tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 93d46a54-c775-4fc6-ad62-edf53bee2d07] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:28.270903 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e5d98c3b-1dc0-4053-9c05-578aa7f630b1 tempest-FlavorsV2NegativeTest-1291638862 tempest-FlavorsV2NegativeTest-1291638862-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:28.279063 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=12,nova_api:INSERT=3 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:28.288948 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e5d98c3b-1dc0-4053-9c05-578aa7f630b1 tempest-FlavorsV2NegativeTest-1291638862 tempest-FlavorsV2NegativeTest-1291638862-project] 10.222.0.42 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.306029 Oct 23 01:13:28.289581 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 370/767] 10.222.0.42 () {58 vars in 1137 bytes} [Sun Oct 23 01:13:27 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:13:28.303760 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-128192e3-c981-453b-9bda-b85693462ee1 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:28.316227 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-128192e3-c981-453b-9bda-b85693462ee1 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:28.339968 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-128192e3-c981-453b-9bda-b85693462ee1 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:28.340769 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-128192e3-c981-453b-9bda-b85693462ee1 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:28.341433 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-128192e3-c981-453b-9bda-b85693462ee1 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:28.342380 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-128192e3-c981-453b-9bda-b85693462ee1 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:28.343195 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-128192e3-c981-453b-9bda-b85693462ee1 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:28.343973 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-128192e3-c981-453b-9bda-b85693462ee1 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:28.370542 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-128192e3-c981-453b-9bda-b85693462ee1 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] HTTP exception thrown: Instance 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb could not be found. Oct 23 01:13:28.372630 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-128192e3-c981-453b-9bda-b85693462ee1 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Request method failure captured: Oct 23 01:13:28.372630 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb HTTP/1.1 Oct 23 01:13:28.372630 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:13:28.372630 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:13:28.372630 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:13:28.372630 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:13:28.372630 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:13:28.372630 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:13:28.372630 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:13:28.372630 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:13:28.372630 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJSKUts-hH4fEVlEDsBHqznM6LUUsjPi-zy0UkF8eV1QHvSWnclMhCWXIO2CJ9AJB7cSKQ5abcvA_ARJtyx9pTC6puAAr4yXUWRtOwb5rMn0Rr5Xue8qiFrpADzkZ0DnJRNEYp4tqHFOuGhpYxwrBPQDC5XpHy-ksuckLiye5A9c7uI Oct 23 01:13:28.372630 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:13:28.372630 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:13:28.372630 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:13:28.372630 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:13:28.372630 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:13:28.372630 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:13:28.372630 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 08b8e89ba0a14188bac8e28b66b5a197 Oct 23 01:13:28.372630 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-395145993 Oct 23 01:13:28.372630 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:13:28.372630 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:13:28.373882 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/08b8e89ba0a14188bac8e28b66b5a197"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_08b8e89ba0a14188bac8e28b66b5a197"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/08b8e89ba0a14188bac8e28b66b5a197"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/08b8e89ba0a14188bac8e28b66b5a197"}]}] Oct 23 01:13:28.373882 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-395145993 Oct 23 01:13:28.373882 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 08b8e89ba0a14188bac8e28b66b5a197 Oct 23 01:13:28.373882 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-395145993 Oct 23 01:13:28.373882 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersWithSpecificFlavorTestJSON-395145993-project Oct 23 01:13:28.373882 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:13:28.373882 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:13:28.373882 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 9e535f9274b24a9f800ea0c3d8faba5a Oct 23 01:13:28.373882 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-395145993-project Oct 23 01:13:28.373882 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:13:28.373882 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb could not be found. Oct 23 01:13:28.373882 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb'} Oct 23 01:13:28.374672 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:13:28.374672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:13:28.374672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:13:28.374672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:13:28.374672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:13:28.374672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:13:28.374672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:13:28.374672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:13:28.374672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:13:28.374672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:13:28.374672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb could not be found. Oct 23 01:13:28.374672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:13:28.374672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:13:28.374672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:13:28.374672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:13:28.374672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:13:28.374672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:13:28.374672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:13:28.374672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:13:28.374672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:13:28.375816 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:13:28.375816 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:13:28.375816 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:13:28.375816 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:13:28.375816 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:13:28.375816 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:13:28.375816 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:13:28.375816 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb could not be found. Oct 23 01:13:28.375816 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:13:28.375816 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:13:28.375816 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:13:28.375816 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:13:28.375816 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:13:28.375816 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:13:28.375816 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:13:28.375816 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:13:28.375816 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb could not be found. Oct 23 01:13:28.375816 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:13:28.379016 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-128192e3-c981-453b-9bda-b85693462ee1 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Returning 404 to user: Instance 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:13:28.380014 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-128192e3-c981-453b-9bda-b85693462ee1 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "GET /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb" status: 404 len: 111 microversion: 2.1 time: 0.084598 Oct 23 01:13:28.387294 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 371/768] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:28 2022] GET /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:13:28.399913 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ea445474-484f-4e4c-ba6b-30849d7f42fb tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:28.402267 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ea445474-484f-4e4c-ba6b-30849d7f42fb tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:28.404736 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-71003e66-e1c5-4158-a9f6-30c9088cfc3d tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262d5984b8c4775b86fae1c0d314718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc8f8cefbf441c98d6bda76e99e3173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:28.418192 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ea445474-484f-4e4c-ba6b-30849d7f42fb tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:28.418331 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-71003e66-e1c5-4158-a9f6-30c9088cfc3d tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07" status: 200 len: 1212 microversion: 2.1 time: 0.181048 Oct 23 01:13:28.419250 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ea445474-484f-4e4c-ba6b-30849d7f42fb tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:28.419375 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 398/769] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:28 2022] GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07 => generated 1212 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:28.420064 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ea445474-484f-4e4c-ba6b-30849d7f42fb tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:28.421950 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ea445474-484f-4e4c-ba6b-30849d7f42fb tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:28.422665 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ea445474-484f-4e4c-ba6b-30849d7f42fb tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:28.423280 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ea445474-484f-4e4c-ba6b-30849d7f42fb tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:28.442293 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a2f671be-5b62-40c7-bb99-05128fcd7866 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Calling method '.version_select at 0x7f5cc27c6040>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:28.565508 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a2f671be-5b62-40c7-bb99-05128fcd7866 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-229724827" status: 202 len: 0 microversion: 2.1 time: 0.143919 Oct 23 01:13:28.568894 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 399/770] 10.222.0.42 () {58 vars in 1218 bytes} [Sun Oct 23 01:13:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-229724827 => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:13:28.599841 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-92db44e6-001f-4a95-a917-d8e617361ecc tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:28.600905 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-92db44e6-001f-4a95-a917-d8e617361ecc tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f277484-b3ae-465e-90b7-8febafef9329] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:28.618860 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-92db44e6-001f-4a95-a917-d8e617361ecc tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:28.619816 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-92db44e6-001f-4a95-a917-d8e617361ecc tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:28.620417 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-92db44e6-001f-4a95-a917-d8e617361ecc tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:28.621328 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-92db44e6-001f-4a95-a917-d8e617361ecc tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:28.622245 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-92db44e6-001f-4a95-a917-d8e617361ecc tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:28.622931 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-92db44e6-001f-4a95-a917-d8e617361ecc tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:28.712310 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-ea445474-484f-4e4c-ba6b-30849d7f42fb tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] Lazy-loading 'services' on Instance uuid 12bc6f90-1421-4c4f-b651-ee7d941c725b {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:13:28.953357 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ea445474-484f-4e4c-ba6b-30849d7f42fb tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1936 microversion: 2.91 time: 0.564446 Oct 23 01:13:28.953874 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 372/771] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:28 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1936 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:13:28.983601 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4b82d9cc-aec3-4078-9917-b67456fa3b9a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:13:28.986829 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4b82d9cc-aec3-4078-9917-b67456fa3b9a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:29.011031 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4b82d9cc-aec3-4078-9917-b67456fa3b9a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:29.011529 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4b82d9cc-aec3-4078-9917-b67456fa3b9a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:29.012622 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4b82d9cc-aec3-4078-9917-b67456fa3b9a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:29.013498 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4b82d9cc-aec3-4078-9917-b67456fa3b9a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:29.016380 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4b82d9cc-aec3-4078-9917-b67456fa3b9a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:29.018808 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4b82d9cc-aec3-4078-9917-b67456fa3b9a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:29.049725 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-92db44e6-001f-4a95-a917-d8e617361ecc tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:29.075525 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-4b82d9cc-aec3-4078-9917-b67456fa3b9a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lazy-loading 'flavor' on Instance uuid 12bc6f90-1421-4c4f-b651-ee7d941c725b {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:13:29.076408 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-92db44e6-001f-4a95-a917-d8e617361ecc tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329" status: 200 len: 1472 microversion: 2.1 time: 0.500898 Oct 23 01:13:29.103624 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 400/772] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:28 2022] GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329 => generated 1472 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:29.111048 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e3927935-5a91-4d1a-93b3-ac020518cff7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:29.115826 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e3927935-5a91-4d1a-93b3-ac020518cff7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: edb35c7d-9adc-4b53-9bef-147aadbeae5d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:29.125040 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e3927935-5a91-4d1a-93b3-ac020518cff7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:29.125843 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e3927935-5a91-4d1a-93b3-ac020518cff7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:29.126587 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e3927935-5a91-4d1a-93b3-ac020518cff7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:29.127738 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e3927935-5a91-4d1a-93b3-ac020518cff7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:29.129368 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e3927935-5a91-4d1a-93b3-ac020518cff7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:29.130505 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e3927935-5a91-4d1a-93b3-ac020518cff7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:29.375716 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e3927935-5a91-4d1a-93b3-ac020518cff7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:29.385935 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e3927935-5a91-4d1a-93b3-ac020518cff7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d" status: 200 len: 1312 microversion: 2.1 time: 0.280253 Oct 23 01:13:29.386741 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 401/773] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:29 2022] GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d => generated 1312 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:29.404709 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e53b4e20-875b-49b5-97b2-48ba316d0874 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:29.405580 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e53b4e20-875b-49b5-97b2-48ba316d0874 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:29.417212 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e53b4e20-875b-49b5-97b2-48ba316d0874 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:29.419371 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e53b4e20-875b-49b5-97b2-48ba316d0874 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:29.419371 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e53b4e20-875b-49b5-97b2-48ba316d0874 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:29.419371 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e53b4e20-875b-49b5-97b2-48ba316d0874 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:29.419890 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e53b4e20-875b-49b5-97b2-48ba316d0874 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:29.420616 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e53b4e20-875b-49b5-97b2-48ba316d0874 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:29.619762 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e53b4e20-875b-49b5-97b2-48ba316d0874 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:29.628706 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e53b4e20-875b-49b5-97b2-48ba316d0874 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 200 len: 1359 microversion: 2.1 time: 0.233289 Oct 23 01:13:29.629606 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 402/774] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:29 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 1359 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:29.650124 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a29fda00-42b7-4143-8c91-aae6fbb0f09f tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:29.652731 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a29fda00-42b7-4143-8c91-aae6fbb0f09f tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 283de315-fdcb-4c89-91e3-96aa3e822b21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:29.661308 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a29fda00-42b7-4143-8c91-aae6fbb0f09f tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:29.661800 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a29fda00-42b7-4143-8c91-aae6fbb0f09f tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:29.662477 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a29fda00-42b7-4143-8c91-aae6fbb0f09f tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:29.663344 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a29fda00-42b7-4143-8c91-aae6fbb0f09f tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:29.665017 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a29fda00-42b7-4143-8c91-aae6fbb0f09f tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:29.665611 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a29fda00-42b7-4143-8c91-aae6fbb0f09f tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:29.825306 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a29fda00-42b7-4143-8c91-aae6fbb0f09f tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:29.853197 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a29fda00-42b7-4143-8c91-aae6fbb0f09f tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:29.861022 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a29fda00-42b7-4143-8c91-aae6fbb0f09f tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:29.863943 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a29fda00-42b7-4143-8c91-aae6fbb0f09f tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21" status: 200 len: 1258 microversion: 2.25 time: 0.231339 Oct 23 01:13:29.864551 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 403/775] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:29 2022] GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21 => generated 1258 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:13:29.871393 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5875ec65-177d-4f19-9d28-51e260514c50 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:29.872272 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5875ec65-177d-4f19-9d28-51e260514c50 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 93d46a54-c775-4fc6-ad62-edf53bee2d07] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:29.892251 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5875ec65-177d-4f19-9d28-51e260514c50 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:29.896605 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5875ec65-177d-4f19-9d28-51e260514c50 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:29.896605 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5875ec65-177d-4f19-9d28-51e260514c50 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:29.896605 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5875ec65-177d-4f19-9d28-51e260514c50 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:29.896605 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5875ec65-177d-4f19-9d28-51e260514c50 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:29.896965 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5875ec65-177d-4f19-9d28-51e260514c50 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:29.973917 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5875ec65-177d-4f19-9d28-51e260514c50 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262d5984b8c4775b86fae1c0d314718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc8f8cefbf441c98d6bda76e99e3173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:30.006615 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5875ec65-177d-4f19-9d28-51e260514c50 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07" status: 200 len: 1208 microversion: 2.1 time: 0.136954 Oct 23 01:13:30.014656 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4b82d9cc-aec3-4078-9917-b67456fa3b9a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "POST /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b/action" status: 202 len: 0 microversion: 2.91 time: 1.034889 Oct 23 01:13:30.015314 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 373/776] 10.222.0.42 () {62 vars in 1319 bytes} [Sun Oct 23 01:13:28 2022] POST /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b/action => generated 0 bytes in 1037 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 23 01:13:30.022599 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 404/777] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:29 2022] GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07 => generated 1208 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:30.031847 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-6a3f636d-df71-4b4c-9bbb-b6f7dfe40e47 req-7801d603-9d75-4a02-b242-bf5d78d115cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edb35c7d-9adc-4b53-9bef-147aadbeae5d", "tag": "13993c6b-8acd-482a-a3cf-1db8731b8846"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:13:30.034284 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9521891a-cbc7-4129-bdde-b0d7e93eb0e0 tempest-FlavorsV2NegativeTest-1291638862 tempest-FlavorsV2NegativeTest-1291638862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-167649423", "imageRef": "64222b67-6476-49be-add9-ab496dc3fb32", "flavorRef": "452"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:13:30.062888 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-6a3f636d-df71-4b4c-9bbb-b6f7dfe40e47 req-7801d603-9d75-4a02-b242-bf5d78d115cc service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:30.063555 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-6a3f636d-df71-4b4c-9bbb-b6f7dfe40e47 req-7801d603-9d75-4a02-b242-bf5d78d115cc service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:30.064162 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-6a3f636d-df71-4b4c-9bbb-b6f7dfe40e47 req-7801d603-9d75-4a02-b242-bf5d78d115cc service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:30.077751 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-6a3f636d-df71-4b4c-9bbb-b6f7dfe40e47 req-7801d603-9d75-4a02-b242-bf5d78d115cc service nova] Creating event network-changed:13993c6b-8acd-482a-a3cf-1db8731b8846 for instance edb35c7d-9adc-4b53-9bef-147aadbeae5d on n-h1-master-1 Oct 23 01:13:30.087674 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-6a3f636d-df71-4b4c-9bbb-b6f7dfe40e47 req-7801d603-9d75-4a02-b242-bf5d78d115cc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067054 Oct 23 01:13:30.088709 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 374/778] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:13:30.096736 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-622df8a9-c1ed-4aa2-bd16-812dd9be1b8c tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:30.097726 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-622df8a9-c1ed-4aa2-bd16-812dd9be1b8c tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:30.106538 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-622df8a9-c1ed-4aa2-bd16-812dd9be1b8c tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:30.107139 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-622df8a9-c1ed-4aa2-bd16-812dd9be1b8c tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:30.107853 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-622df8a9-c1ed-4aa2-bd16-812dd9be1b8c tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:30.108934 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-622df8a9-c1ed-4aa2-bd16-812dd9be1b8c tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:30.109614 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-622df8a9-c1ed-4aa2-bd16-812dd9be1b8c tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:30.110554 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-622df8a9-c1ed-4aa2-bd16-812dd9be1b8c tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:30.144381 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-9521891a-cbc7-4129-bdde-b0d7e93eb0e0 tempest-FlavorsV2NegativeTest-1291638862 tempest-FlavorsV2NegativeTest-1291638862-project] validate_networks() for None {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:13:30.257100 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-622df8a9-c1ed-4aa2-bd16-812dd9be1b8c tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:30.266138 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-622df8a9-c1ed-4aa2-bd16-812dd9be1b8c tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:30.268626 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-622df8a9-c1ed-4aa2-bd16-812dd9be1b8c tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:30.276137 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-622df8a9-c1ed-4aa2-bd16-812dd9be1b8c tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1537 microversion: 2.91 time: 0.186091 Oct 23 01:13:30.280167 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 375/779] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:30 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1537 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:13:30.282871 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-07d98b6a-ce57-49d4-ac7b-652ab5c665dd tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:30.283703 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-07d98b6a-ce57-49d4-ac7b-652ab5c665dd tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f277484-b3ae-465e-90b7-8febafef9329] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:30.291194 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07d98b6a-ce57-49d4-ac7b-652ab5c665dd tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:30.291976 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07d98b6a-ce57-49d4-ac7b-652ab5c665dd tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:30.292910 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07d98b6a-ce57-49d4-ac7b-652ab5c665dd tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:30.293888 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07d98b6a-ce57-49d4-ac7b-652ab5c665dd tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:30.294616 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07d98b6a-ce57-49d4-ac7b-652ab5c665dd tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:30.295255 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07d98b6a-ce57-49d4-ac7b-652ab5c665dd tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:30.561039 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-07d98b6a-ce57-49d4-ac7b-652ab5c665dd tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:30.563689 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-9521891a-cbc7-4129-bdde-b0d7e93eb0e0 tempest-FlavorsV2NegativeTest-1291638862 tempest-FlavorsV2NegativeTest-1291638862-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 23 01:13:30.565628 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9521891a-cbc7-4129-bdde-b0d7e93eb0e0 tempest-FlavorsV2NegativeTest-1291638862 tempest-FlavorsV2NegativeTest-1291638862-project] Request method failure captured: Oct 23 01:13:30.565628 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 23 01:13:30.565628 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:13:30.565628 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:13:30.565628 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:13:30.565628 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 142 Oct 23 01:13:30.565628 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:13:30.565628 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:13:30.565628 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:13:30.565628 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:13:30.565628 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJU1aHqcpS75aE6qUf0iEhxBpBIGV_ENdjIbeWmOB9cdzHUu75B4RSWk1cYYJLrZz4y87akRZrBl5Z46zaAQKO0sSiqJQulu4t5BaXTYktgBXxGlQ7kvKswqwrSiTlQAzC3-bINhC3y9uhWy3cTKQd1ZiE6p6ovjazwN34hI2b6Lf_g Oct 23 01:13:30.565628 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:13:30.565628 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:13:30.565628 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:13:30.565628 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:13:30.565628 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:13:30.565628 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:13:30.565628 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: f93208696d0e4e889faa9d77b1d23cf5 Oct 23 01:13:30.565628 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-FlavorsV2NegativeTest-1291638862 Oct 23 01:13:30.565628 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:13:30.565628 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:13:30.567334 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f93208696d0e4e889faa9d77b1d23cf5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f93208696d0e4e889faa9d77b1d23cf5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f93208696d0e4e889faa9d77b1d23cf5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f93208696d0e4e889faa9d77b1d23cf5"}]}] Oct 23 01:13:30.567334 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-FlavorsV2NegativeTest-1291638862 Oct 23 01:13:30.567334 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: f93208696d0e4e889faa9d77b1d23cf5 Oct 23 01:13:30.567334 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1291638862 Oct 23 01:13:30.567334 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-FlavorsV2NegativeTest-1291638862-project Oct 23 01:13:30.567334 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:13:30.567334 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:13:30.567334 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 772564f5e45247069e691521cb96a868 Oct 23 01:13:30.567334 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-FlavorsV2NegativeTest-1291638862-project Oct 23 01:13:30.567334 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:13:30.567334 n-d-master-1 devstack@n-api.service[120945]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-167649423", "imageRef": "64222b67-6476-49be-add9-ab496dc3fb32", "flavorRef": "452"}} Oct 23 01:13:30.567334 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:13:30.568128 n-d-master-1 devstack@n-api.service[120945]: exception: Flavor's memory is too small for requested image. Oct 23 01:13:30.568128 n-d-master-1 devstack@n-api.service[120945]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-167649423', 'imageRef': '64222b67-6476-49be-add9-ab496dc3fb32', 'flavorRef': '452'}}} Oct 23 01:13:30.568128 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:13:30.568128 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:13:30.568128 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 23 01:13:30.568128 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 23 01:13:30.568128 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 23 01:13:30.568128 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 23 01:13:30.568128 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 23 01:13:30.568128 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 23 01:13:30.568128 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 23 01:13:30.568128 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 23 01:13:30.568128 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 23 01:13:30.568128 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 23 01:13:30.568128 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 23 01:13:30.568128 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 23 01:13:30.568128 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 23 01:13:30.568128 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:13:30.568128 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:13:30.568128 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:13:30.569686 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:13:30.569686 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:13:30.569686 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:13:30.569686 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:13:30.569686 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:13:30.569686 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:13:30.569686 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:13:30.569686 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:13:30.569686 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:13:30.569686 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:13:30.569686 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:13:30.569686 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:13:30.569686 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:13:30.569686 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 23 01:13:30.569686 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 23 01:13:30.569686 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 23 01:13:30.569686 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 23 01:13:30.569686 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:13:30.569686 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:13:30.569686 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:13:30.569686 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:13:30.571604 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:13:30.571604 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:13:30.571604 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:13:30.571604 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:13:30.571604 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 23 01:13:30.571604 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:13:30.571604 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9521891a-cbc7-4129-bdde-b0d7e93eb0e0 tempest-FlavorsV2NegativeTest-1291638862 tempest-FlavorsV2NegativeTest-1291638862-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:13:30.571604 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9521891a-cbc7-4129-bdde-b0d7e93eb0e0 tempest-FlavorsV2NegativeTest-1291638862 tempest-FlavorsV2NegativeTest-1291638862-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.544363 Oct 23 01:13:30.572967 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 405/780] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:13:30 2022] POST /compute/v2.1/servers => generated 93 bytes in 550 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 23 01:13:30.579697 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-63e056ab-cd98-4ed3-b716-1e87c39c77d0 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:30.583617 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-63e056ab-cd98-4ed3-b716-1e87c39c77d0 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: edb35c7d-9adc-4b53-9bef-147aadbeae5d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:30.588484 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-63e056ab-cd98-4ed3-b716-1e87c39c77d0 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:30.589130 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-63e056ab-cd98-4ed3-b716-1e87c39c77d0 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:30.589941 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-63e056ab-cd98-4ed3-b716-1e87c39c77d0 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:30.591154 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-63e056ab-cd98-4ed3-b716-1e87c39c77d0 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:30.591686 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-63e056ab-cd98-4ed3-b716-1e87c39c77d0 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:30.592218 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-63e056ab-cd98-4ed3-b716-1e87c39c77d0 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:30.596857 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-07d98b6a-ce57-49d4-ac7b-652ab5c665dd tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329" status: 200 len: 1472 microversion: 2.1 time: 0.317940 Oct 23 01:13:30.619596 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 376/781] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:30 2022] GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329 => generated 1472 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:30.654648 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a46417b4-6c07-4311-84a5-9380b6af09f9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:30.655268 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a46417b4-6c07-4311-84a5-9380b6af09f9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:30.666143 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a46417b4-6c07-4311-84a5-9380b6af09f9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:30.668772 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a46417b4-6c07-4311-84a5-9380b6af09f9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:30.669425 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a46417b4-6c07-4311-84a5-9380b6af09f9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:30.672735 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a46417b4-6c07-4311-84a5-9380b6af09f9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:30.673489 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a46417b4-6c07-4311-84a5-9380b6af09f9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:30.675014 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a46417b4-6c07-4311-84a5-9380b6af09f9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:30.686160 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:30.916479 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-63e056ab-cd98-4ed3-b716-1e87c39c77d0 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:30.928814 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-63e056ab-cd98-4ed3-b716-1e87c39c77d0 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d" status: 200 len: 1312 microversion: 2.1 time: 0.354490 Oct 23 01:13:30.930155 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 406/782] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:30 2022] GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d => generated 1312 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:30.935358 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f3732f10-823d-451b-9af0-7bc5b8953918 tempest-ServersWithSpecificFlavorTestJSON-1629713408 tempest-ServersWithSpecificFlavorTestJSON-1629713408-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:30.985014 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a46417b4-6c07-4311-84a5-9380b6af09f9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:30.995699 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a46417b4-6c07-4311-84a5-9380b6af09f9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 200 len: 1359 microversion: 2.1 time: 0.344683 Oct 23 01:13:30.996923 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 377/783] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:30 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 1359 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:13:31.005344 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f6f6fbda-3995-4808-8f43-267af2fd2667 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:31.006715 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f6f6fbda-3995-4808-8f43-267af2fd2667 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 283de315-fdcb-4c89-91e3-96aa3e822b21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:31.014988 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f6f6fbda-3995-4808-8f43-267af2fd2667 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:31.016224 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f6f6fbda-3995-4808-8f43-267af2fd2667 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:31.016857 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f6f6fbda-3995-4808-8f43-267af2fd2667 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:31.017752 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f6f6fbda-3995-4808-8f43-267af2fd2667 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:31.018599 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f6f6fbda-3995-4808-8f43-267af2fd2667 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:31.019536 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f6f6fbda-3995-4808-8f43-267af2fd2667 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:31.088449 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f6f6fbda-3995-4808-8f43-267af2fd2667 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:31.096644 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f6f6fbda-3995-4808-8f43-267af2fd2667 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:31.098118 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f6f6fbda-3995-4808-8f43-267af2fd2667 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:31.099240 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f6f6fbda-3995-4808-8f43-267af2fd2667 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21" status: 200 len: 1322 microversion: 2.25 time: 0.100480 Oct 23 01:13:31.099800 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 378/784] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:30 2022] GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21 => generated 1322 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:13:31.105246 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4db7d4d2-4006-462f-b7d7-faff11ddfccb tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:31.105855 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4db7d4d2-4006-462f-b7d7-faff11ddfccb tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 93d46a54-c775-4fc6-ad62-edf53bee2d07] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:31.113490 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4db7d4d2-4006-462f-b7d7-faff11ddfccb tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:31.115787 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4db7d4d2-4006-462f-b7d7-faff11ddfccb tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:31.116913 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4db7d4d2-4006-462f-b7d7-faff11ddfccb tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:31.119038 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4db7d4d2-4006-462f-b7d7-faff11ddfccb tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:31.119734 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4db7d4d2-4006-462f-b7d7-faff11ddfccb tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:31.121032 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f3732f10-823d-451b-9af0-7bc5b8953918 tempest-ServersWithSpecificFlavorTestJSON-1629713408 tempest-ServersWithSpecificFlavorTestJSON-1629713408-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/1893252275" status: 202 len: 0 microversion: 2.1 time: 0.185452 Oct 23 01:13:31.127038 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 407/785] 10.222.0.42 () {58 vars in 1161 bytes} [Sun Oct 23 01:13:30 2022] DELETE /compute/v2.1/flavors/1893252275 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:13:31.129719 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4db7d4d2-4006-462f-b7d7-faff11ddfccb tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:31.139874 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-aa780337-26e3-41ad-956b-ffb559e57a07 tempest-ServersWithSpecificFlavorTestJSON-1629713408 tempest-ServersWithSpecificFlavorTestJSON-1629713408-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:31.188605 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-aa780337-26e3-41ad-956b-ffb559e57a07 tempest-ServersWithSpecificFlavorTestJSON-1629713408 tempest-ServersWithSpecificFlavorTestJSON-1629713408-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5403 microversion: 2.1 time: 0.060206 Oct 23 01:13:31.214416 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 408/786] 10.222.0.42 () {58 vars in 1146 bytes} [Sun Oct 23 01:13:31 2022] GET /compute/v2.1/flavors/detail => generated 5403 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:31.220219 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1e249403-2955-4235-931a-c1e849ef60b1 tempest-ServersWithSpecificFlavorTestJSON-1629713408 tempest-ServersWithSpecificFlavorTestJSON-1629713408-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:31.263785 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4db7d4d2-4006-462f-b7d7-faff11ddfccb tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262d5984b8c4775b86fae1c0d314718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc8f8cefbf441c98d6bda76e99e3173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:31.271320 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4db7d4d2-4006-462f-b7d7-faff11ddfccb tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07" status: 200 len: 1264 microversion: 2.1 time: 0.170131 Oct 23 01:13:31.271892 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 379/787] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:31 2022] GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:31.308478 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1e249403-2955-4235-931a-c1e849ef60b1 tempest-ServersWithSpecificFlavorTestJSON-1629713408 tempest-ServersWithSpecificFlavorTestJSON-1629713408-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/988015540" status: 202 len: 0 microversion: 2.1 time: 0.092576 Oct 23 01:13:31.309175 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 409/788] 10.222.0.42 () {58 vars in 1158 bytes} [Sun Oct 23 01:13:31 2022] DELETE /compute/v2.1/flavors/988015540 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:13:31.312054 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c99c33a4-60bb-411a-a86f-998394833b69 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:31.313257 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c99c33a4-60bb-411a-a86f-998394833b69 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:31.320275 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c99c33a4-60bb-411a-a86f-998394833b69 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:31.320782 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c99c33a4-60bb-411a-a86f-998394833b69 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:31.321323 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c99c33a4-60bb-411a-a86f-998394833b69 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:31.321630 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-33de7643-cab3-4afc-93e3-f15c256635e0 tempest-ServersWithSpecificFlavorTestJSON-1629713408 tempest-ServersWithSpecificFlavorTestJSON-1629713408-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:31.321887 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c99c33a4-60bb-411a-a86f-998394833b69 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:31.322362 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c99c33a4-60bb-411a-a86f-998394833b69 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:31.322860 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c99c33a4-60bb-411a-a86f-998394833b69 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:31.359865 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-33de7643-cab3-4afc-93e3-f15c256635e0 tempest-ServersWithSpecificFlavorTestJSON-1629713408 tempest-ServersWithSpecificFlavorTestJSON-1629713408-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.045191 Oct 23 01:13:31.363410 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 410/789] 10.222.0.42 () {58 vars in 1146 bytes} [Sun Oct 23 01:13:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:13:31.394153 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-55a4e8fc-6dd3-4f38-b526-6964284e0aac tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:31.394153 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-55a4e8fc-6dd3-4f38-b526-6964284e0aac tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: f5fe429a-88b7-4d3d-975b-a10c725c4e2f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:31.400471 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-55a4e8fc-6dd3-4f38-b526-6964284e0aac tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:31.400985 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-55a4e8fc-6dd3-4f38-b526-6964284e0aac tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:31.401618 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-55a4e8fc-6dd3-4f38-b526-6964284e0aac tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:31.404121 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-55a4e8fc-6dd3-4f38-b526-6964284e0aac tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:31.405229 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-55a4e8fc-6dd3-4f38-b526-6964284e0aac tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:31.405909 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-55a4e8fc-6dd3-4f38-b526-6964284e0aac tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:31.425645 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-55a4e8fc-6dd3-4f38-b526-6964284e0aac tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] HTTP exception thrown: Instance f5fe429a-88b7-4d3d-975b-a10c725c4e2f could not be found. Oct 23 01:13:31.427666 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-55a4e8fc-6dd3-4f38-b526-6964284e0aac tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Request method failure captured: Oct 23 01:13:31.427666 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/servers/f5fe429a-88b7-4d3d-975b-a10c725c4e2f HTTP/1.1 Oct 23 01:13:31.427666 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:13:31.427666 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:13:31.427666 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:13:31.427666 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:13:31.427666 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:13:31.427666 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:13:31.427666 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:13:31.427666 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:13:31.427666 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJSKUts-hH4fEVlEDsBHqznM6LUUsjPi-zy0UkF8eV1QHvSWnclMhCWXIO2CJ9AJB7cSKQ5abcvA_ARJtyx9pTC6puAAr4yXUWRtOwb5rMn0Rr5Xue8qiFrpADzkZ0DnJRNEYp4tqHFOuGhpYxwrBPQDC5XpHy-ksuckLiye5A9c7uI Oct 23 01:13:31.427666 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:13:31.427666 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:13:31.427666 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:13:31.427666 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:13:31.427666 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:13:31.427666 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:13:31.427666 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 08b8e89ba0a14188bac8e28b66b5a197 Oct 23 01:13:31.427666 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-395145993 Oct 23 01:13:31.427666 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:13:31.427666 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:13:31.429416 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/08b8e89ba0a14188bac8e28b66b5a197"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_08b8e89ba0a14188bac8e28b66b5a197"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/08b8e89ba0a14188bac8e28b66b5a197"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/08b8e89ba0a14188bac8e28b66b5a197"}]}] Oct 23 01:13:31.429416 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-395145993 Oct 23 01:13:31.429416 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 08b8e89ba0a14188bac8e28b66b5a197 Oct 23 01:13:31.429416 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-395145993 Oct 23 01:13:31.429416 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServersWithSpecificFlavorTestJSON-395145993-project Oct 23 01:13:31.429416 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:13:31.429416 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:13:31.429416 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 9e535f9274b24a9f800ea0c3d8faba5a Oct 23 01:13:31.429416 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-395145993-project Oct 23 01:13:31.429416 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:13:31.429416 n-d-master-1 devstack@n-api.service[120945]: exception: Instance f5fe429a-88b7-4d3d-975b-a10c725c4e2f could not be found. Oct 23 01:13:31.429416 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'f5fe429a-88b7-4d3d-975b-a10c725c4e2f'} Oct 23 01:13:31.431595 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:13:31.431595 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:13:31.431595 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:13:31.431595 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:13:31.431595 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:13:31.431595 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:13:31.431595 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:13:31.431595 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:13:31.431595 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:13:31.431595 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:13:31.431595 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5fe429a-88b7-4d3d-975b-a10c725c4e2f could not be found. Oct 23 01:13:31.431595 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:13:31.431595 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:13:31.431595 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:13:31.431595 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:13:31.431595 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:13:31.431595 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:13:31.431595 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:13:31.431595 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:13:31.431595 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:13:31.433179 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:13:31.433179 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:13:31.433179 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:13:31.433179 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:13:31.433179 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:13:31.433179 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:13:31.433179 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:13:31.433179 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:13:31.433179 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:13:31.433179 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5fe429a-88b7-4d3d-975b-a10c725c4e2f could not be found. Oct 23 01:13:31.433179 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:13:31.433179 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:13:31.433179 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:13:31.433179 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:13:31.433179 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:13:31.433179 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:13:31.433179 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:13:31.433179 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:13:31.433179 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5fe429a-88b7-4d3d-975b-a10c725c4e2f could not be found. Oct 23 01:13:31.433179 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:13:31.435725 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-55a4e8fc-6dd3-4f38-b526-6964284e0aac tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Returning 404 to user: Instance f5fe429a-88b7-4d3d-975b-a10c725c4e2f could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:13:31.436762 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-55a4e8fc-6dd3-4f38-b526-6964284e0aac tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f5fe429a-88b7-4d3d-975b-a10c725c4e2f" status: 404 len: 111 microversion: 2.1 time: 0.050105 Oct 23 01:13:31.442103 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 411/790] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:13:31 2022] DELETE /compute/v2.1/servers/f5fe429a-88b7-4d3d-975b-a10c725c4e2f => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 01:13:31.448020 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e9c7cdcd-61e3-48c9-8ada-4fe9e9e7d72a tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:31.448946 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e9c7cdcd-61e3-48c9-8ada-4fe9e9e7d72a tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: f5fe429a-88b7-4d3d-975b-a10c725c4e2f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:31.455851 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e9c7cdcd-61e3-48c9-8ada-4fe9e9e7d72a tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:31.457285 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e9c7cdcd-61e3-48c9-8ada-4fe9e9e7d72a tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:31.457777 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e9c7cdcd-61e3-48c9-8ada-4fe9e9e7d72a tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:31.458593 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e9c7cdcd-61e3-48c9-8ada-4fe9e9e7d72a tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:31.459232 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e9c7cdcd-61e3-48c9-8ada-4fe9e9e7d72a tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:31.459820 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e9c7cdcd-61e3-48c9-8ada-4fe9e9e7d72a tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:31.465579 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=100 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:31.477206 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-e9c7cdcd-61e3-48c9-8ada-4fe9e9e7d72a tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] HTTP exception thrown: Instance f5fe429a-88b7-4d3d-975b-a10c725c4e2f could not be found. Oct 23 01:13:31.479085 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e9c7cdcd-61e3-48c9-8ada-4fe9e9e7d72a tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Request method failure captured: Oct 23 01:13:31.479085 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/f5fe429a-88b7-4d3d-975b-a10c725c4e2f HTTP/1.1 Oct 23 01:13:31.479085 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:13:31.479085 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:13:31.479085 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:13:31.479085 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:13:31.479085 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:13:31.479085 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:13:31.479085 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:13:31.479085 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:13:31.479085 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJSKUts-hH4fEVlEDsBHqznM6LUUsjPi-zy0UkF8eV1QHvSWnclMhCWXIO2CJ9AJB7cSKQ5abcvA_ARJtyx9pTC6puAAr4yXUWRtOwb5rMn0Rr5Xue8qiFrpADzkZ0DnJRNEYp4tqHFOuGhpYxwrBPQDC5XpHy-ksuckLiye5A9c7uI Oct 23 01:13:31.479085 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:13:31.479085 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:13:31.479085 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:13:31.479085 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:13:31.479085 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:13:31.479085 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:13:31.479085 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 08b8e89ba0a14188bac8e28b66b5a197 Oct 23 01:13:31.479085 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-395145993 Oct 23 01:13:31.479085 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:13:31.479085 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:13:31.480749 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/08b8e89ba0a14188bac8e28b66b5a197"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_08b8e89ba0a14188bac8e28b66b5a197"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/08b8e89ba0a14188bac8e28b66b5a197"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/08b8e89ba0a14188bac8e28b66b5a197"}]}] Oct 23 01:13:31.480749 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-395145993 Oct 23 01:13:31.480749 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 08b8e89ba0a14188bac8e28b66b5a197 Oct 23 01:13:31.480749 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-395145993 Oct 23 01:13:31.480749 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServersWithSpecificFlavorTestJSON-395145993-project Oct 23 01:13:31.480749 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:13:31.480749 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:13:31.480749 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 9e535f9274b24a9f800ea0c3d8faba5a Oct 23 01:13:31.480749 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-395145993-project Oct 23 01:13:31.480749 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:13:31.480749 n-d-master-1 devstack@n-api.service[120945]: exception: Instance f5fe429a-88b7-4d3d-975b-a10c725c4e2f could not be found. Oct 23 01:13:31.480749 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'f5fe429a-88b7-4d3d-975b-a10c725c4e2f'} Oct 23 01:13:31.481738 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:13:31.481738 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:13:31.481738 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:13:31.481738 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:13:31.481738 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:13:31.481738 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:13:31.481738 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:13:31.481738 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:13:31.481738 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:13:31.481738 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:13:31.481738 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5fe429a-88b7-4d3d-975b-a10c725c4e2f could not be found. Oct 23 01:13:31.481738 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:13:31.481738 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:13:31.481738 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:13:31.481738 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:13:31.481738 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:13:31.481738 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:13:31.481738 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:13:31.481738 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:13:31.481738 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:13:31.483232 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:13:31.483232 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:13:31.483232 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:13:31.483232 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:13:31.483232 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:13:31.483232 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:13:31.483232 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:13:31.483232 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5fe429a-88b7-4d3d-975b-a10c725c4e2f could not be found. Oct 23 01:13:31.483232 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:13:31.483232 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:13:31.483232 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:13:31.483232 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:13:31.483232 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:13:31.483232 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:13:31.483232 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:13:31.483232 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:13:31.483232 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5fe429a-88b7-4d3d-975b-a10c725c4e2f could not be found. Oct 23 01:13:31.483232 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:13:31.486828 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c99c33a4-60bb-411a-a86f-998394833b69 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:31.494020 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e9c7cdcd-61e3-48c9-8ada-4fe9e9e7d72a tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Returning 404 to user: Instance f5fe429a-88b7-4d3d-975b-a10c725c4e2f could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:13:31.494884 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e9c7cdcd-61e3-48c9-8ada-4fe9e9e7d72a tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "GET /compute/v2.1/servers/f5fe429a-88b7-4d3d-975b-a10c725c4e2f" status: 404 len: 111 microversion: 2.1 time: 0.051603 Oct 23 01:13:31.501244 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 412/791] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:31 2022] GET /compute/v2.1/servers/f5fe429a-88b7-4d3d-975b-a10c725c4e2f => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:13:31.505289 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c99c33a4-60bb-411a-a86f-998394833b69 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:31.512234 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-862fec9b-89a2-47f1-b6bf-cf791555cae5 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:31.513084 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c99c33a4-60bb-411a-a86f-998394833b69 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:31.513900 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-862fec9b-89a2-47f1-b6bf-cf791555cae5 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:31.527328 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:31.528037 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-862fec9b-89a2-47f1-b6bf-cf791555cae5 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:31.528547 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-862fec9b-89a2-47f1-b6bf-cf791555cae5 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:31.531166 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-862fec9b-89a2-47f1-b6bf-cf791555cae5 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:31.531923 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-862fec9b-89a2-47f1-b6bf-cf791555cae5 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:31.532734 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-862fec9b-89a2-47f1-b6bf-cf791555cae5 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:31.532870 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-862fec9b-89a2-47f1-b6bf-cf791555cae5 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:31.536771 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c99c33a4-60bb-411a-a86f-998394833b69 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1537 microversion: 2.91 time: 0.229900 Oct 23 01:13:31.543511 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 380/792] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:31 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1537 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:13:31.562028 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-862fec9b-89a2-47f1-b6bf-cf791555cae5 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] HTTP exception thrown: Instance 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb could not be found. Oct 23 01:13:31.567979 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-862fec9b-89a2-47f1-b6bf-cf791555cae5 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Request method failure captured: Oct 23 01:13:31.567979 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb HTTP/1.1 Oct 23 01:13:31.567979 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:13:31.567979 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:13:31.567979 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:13:31.567979 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:13:31.567979 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:13:31.567979 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:13:31.567979 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:13:31.567979 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:13:31.567979 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJSKUts-hH4fEVlEDsBHqznM6LUUsjPi-zy0UkF8eV1QHvSWnclMhCWXIO2CJ9AJB7cSKQ5abcvA_ARJtyx9pTC6puAAr4yXUWRtOwb5rMn0Rr5Xue8qiFrpADzkZ0DnJRNEYp4tqHFOuGhpYxwrBPQDC5XpHy-ksuckLiye5A9c7uI Oct 23 01:13:31.567979 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:13:31.567979 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:13:31.567979 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:13:31.567979 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:13:31.567979 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:13:31.567979 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:13:31.567979 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 08b8e89ba0a14188bac8e28b66b5a197 Oct 23 01:13:31.567979 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-395145993 Oct 23 01:13:31.567979 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:13:31.567979 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:13:31.569538 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/08b8e89ba0a14188bac8e28b66b5a197"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_08b8e89ba0a14188bac8e28b66b5a197"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/08b8e89ba0a14188bac8e28b66b5a197"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/08b8e89ba0a14188bac8e28b66b5a197"}]}] Oct 23 01:13:31.569538 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-395145993 Oct 23 01:13:31.569538 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 08b8e89ba0a14188bac8e28b66b5a197 Oct 23 01:13:31.569538 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-395145993 Oct 23 01:13:31.569538 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServersWithSpecificFlavorTestJSON-395145993-project Oct 23 01:13:31.569538 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:13:31.569538 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:13:31.569538 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 9e535f9274b24a9f800ea0c3d8faba5a Oct 23 01:13:31.569538 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-395145993-project Oct 23 01:13:31.569538 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:13:31.569538 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb could not be found. Oct 23 01:13:31.569538 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb'} Oct 23 01:13:31.570546 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:13:31.570546 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:13:31.570546 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:13:31.570546 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:13:31.570546 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:13:31.570546 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:13:31.570546 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:13:31.570546 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:13:31.570546 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:13:31.570546 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:13:31.570546 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb could not be found. Oct 23 01:13:31.570546 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:13:31.570546 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:13:31.570546 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:13:31.570546 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:13:31.570546 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:13:31.570546 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:13:31.570546 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:13:31.570546 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:13:31.570546 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:13:31.571961 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:13:31.571961 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:13:31.571961 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:13:31.571961 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:13:31.571961 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:13:31.571961 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:13:31.571961 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:13:31.571961 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:13:31.571961 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:13:31.571961 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb could not be found. Oct 23 01:13:31.571961 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:13:31.571961 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:13:31.571961 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:13:31.571961 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:13:31.571961 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:13:31.571961 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:13:31.571961 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:13:31.571961 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:13:31.571961 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb could not be found. Oct 23 01:13:31.571961 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:13:31.573458 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-862fec9b-89a2-47f1-b6bf-cf791555cae5 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Returning 404 to user: Instance 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:13:31.573458 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-862fec9b-89a2-47f1-b6bf-cf791555cae5 tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb" status: 404 len: 111 microversion: 2.1 time: 0.066935 Oct 23 01:13:31.573458 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 413/793] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:13:31 2022] DELETE /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 01:13:31.579621 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b95d5244-be4e-4880-8f2c-dcc513c7e9da tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:31.583942 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b95d5244-be4e-4880-8f2c-dcc513c7e9da tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] [instance: 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:31.586310 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b95d5244-be4e-4880-8f2c-dcc513c7e9da tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:31.586806 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b95d5244-be4e-4880-8f2c-dcc513c7e9da tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:31.587377 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b95d5244-be4e-4880-8f2c-dcc513c7e9da tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:31.588851 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b95d5244-be4e-4880-8f2c-dcc513c7e9da tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:31.588851 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b95d5244-be4e-4880-8f2c-dcc513c7e9da tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:31.589124 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b95d5244-be4e-4880-8f2c-dcc513c7e9da tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:31.603393 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-b95d5244-be4e-4880-8f2c-dcc513c7e9da tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] HTTP exception thrown: Instance 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb could not be found. Oct 23 01:13:31.605075 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b95d5244-be4e-4880-8f2c-dcc513c7e9da tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Request method failure captured: Oct 23 01:13:31.605075 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb HTTP/1.1 Oct 23 01:13:31.605075 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:13:31.605075 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:13:31.605075 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:13:31.605075 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:13:31.605075 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:13:31.605075 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:13:31.605075 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:13:31.605075 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:13:31.605075 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJSKUts-hH4fEVlEDsBHqznM6LUUsjPi-zy0UkF8eV1QHvSWnclMhCWXIO2CJ9AJB7cSKQ5abcvA_ARJtyx9pTC6puAAr4yXUWRtOwb5rMn0Rr5Xue8qiFrpADzkZ0DnJRNEYp4tqHFOuGhpYxwrBPQDC5XpHy-ksuckLiye5A9c7uI Oct 23 01:13:31.605075 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:13:31.605075 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:13:31.605075 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:13:31.605075 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:13:31.605075 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:13:31.605075 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:13:31.605075 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 08b8e89ba0a14188bac8e28b66b5a197 Oct 23 01:13:31.605075 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-395145993 Oct 23 01:13:31.605075 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:13:31.605075 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:13:31.606783 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/08b8e89ba0a14188bac8e28b66b5a197"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_08b8e89ba0a14188bac8e28b66b5a197"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/08b8e89ba0a14188bac8e28b66b5a197"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/08b8e89ba0a14188bac8e28b66b5a197"}]}] Oct 23 01:13:31.606783 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-395145993 Oct 23 01:13:31.606783 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 08b8e89ba0a14188bac8e28b66b5a197 Oct 23 01:13:31.606783 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-395145993 Oct 23 01:13:31.606783 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersWithSpecificFlavorTestJSON-395145993-project Oct 23 01:13:31.606783 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:13:31.606783 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:13:31.606783 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 9e535f9274b24a9f800ea0c3d8faba5a Oct 23 01:13:31.606783 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-395145993-project Oct 23 01:13:31.606783 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:13:31.606783 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb could not be found. Oct 23 01:13:31.606783 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb'} Oct 23 01:13:31.607629 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:13:31.607629 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:13:31.607629 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:13:31.607629 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:13:31.607629 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:13:31.607629 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:13:31.607629 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:13:31.607629 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:13:31.607629 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:13:31.607629 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:13:31.607629 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb could not be found. Oct 23 01:13:31.607629 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:13:31.607629 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:13:31.607629 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:13:31.607629 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:13:31.607629 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:13:31.607629 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:13:31.607629 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:13:31.607629 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:13:31.607629 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:13:31.609178 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:13:31.609178 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:13:31.609178 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:13:31.609178 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:13:31.609178 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:13:31.609178 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:13:31.609178 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:13:31.609178 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb could not be found. Oct 23 01:13:31.609178 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:13:31.609178 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:13:31.609178 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:13:31.609178 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:13:31.609178 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:13:31.609178 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:13:31.609178 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:13:31.609178 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:13:31.609178 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb could not be found. Oct 23 01:13:31.609178 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:13:31.610724 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b95d5244-be4e-4880-8f2c-dcc513c7e9da tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] Returning 404 to user: Instance 2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:13:31.610724 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b95d5244-be4e-4880-8f2c-dcc513c7e9da tempest-ServersWithSpecificFlavorTestJSON-395145993 tempest-ServersWithSpecificFlavorTestJSON-395145993-project] 10.222.0.42 "GET /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb" status: 404 len: 111 microversion: 2.1 time: 0.030774 Oct 23 01:13:31.610724 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 381/794] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:31 2022] GET /compute/v2.1/servers/2ef41e2c-5f08-4c7d-8ad3-6104fac1e7cb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:13:31.623875 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fc378874-f42c-4416-838f-9eabc52bd4da tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:31.624492 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-fc378874-f42c-4416-838f-9eabc52bd4da tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f277484-b3ae-465e-90b7-8febafef9329] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:31.631829 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc378874-f42c-4416-838f-9eabc52bd4da tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:31.632566 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc378874-f42c-4416-838f-9eabc52bd4da tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:31.633291 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc378874-f42c-4416-838f-9eabc52bd4da tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:31.634022 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc378874-f42c-4416-838f-9eabc52bd4da tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:31.634486 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc378874-f42c-4416-838f-9eabc52bd4da tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:31.634933 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc378874-f42c-4416-838f-9eabc52bd4da tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:31.802036 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-fc378874-f42c-4416-838f-9eabc52bd4da tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:31.810644 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fc378874-f42c-4416-838f-9eabc52bd4da tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329" status: 200 len: 1472 microversion: 2.1 time: 0.190177 Oct 23 01:13:31.811863 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 414/795] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:31 2022] GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329 => generated 1472 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:31.955076 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-927f1585-689a-4740-bf51-d373521d6787 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:31.956249 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-927f1585-689a-4740-bf51-d373521d6787 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: edb35c7d-9adc-4b53-9bef-147aadbeae5d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:31.964364 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-927f1585-689a-4740-bf51-d373521d6787 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:31.965148 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-927f1585-689a-4740-bf51-d373521d6787 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:31.965925 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-927f1585-689a-4740-bf51-d373521d6787 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:31.967693 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-927f1585-689a-4740-bf51-d373521d6787 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:31.968342 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-927f1585-689a-4740-bf51-d373521d6787 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:31.969041 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-927f1585-689a-4740-bf51-d373521d6787 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:32.019924 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-27d0b1bf-e95c-48b5-8f53-9321beecc95b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:32.020576 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-27d0b1bf-e95c-48b5-8f53-9321beecc95b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:32.030423 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-27d0b1bf-e95c-48b5-8f53-9321beecc95b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:32.031167 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-27d0b1bf-e95c-48b5-8f53-9321beecc95b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:32.031773 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-27d0b1bf-e95c-48b5-8f53-9321beecc95b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:32.032642 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-27d0b1bf-e95c-48b5-8f53-9321beecc95b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:32.033256 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-27d0b1bf-e95c-48b5-8f53-9321beecc95b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:32.033832 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-27d0b1bf-e95c-48b5-8f53-9321beecc95b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:32.216676 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-927f1585-689a-4740-bf51-d373521d6787 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:32.230410 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-927f1585-689a-4740-bf51-d373521d6787 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d" status: 200 len: 1312 microversion: 2.1 time: 0.279501 Oct 23 01:13:32.231006 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 382/796] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:31 2022] GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d => generated 1312 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:13:32.254505 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-168cbf0e-2a87-4242-8380-6c2afec3e40d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:32.255948 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-168cbf0e-2a87-4242-8380-6c2afec3e40d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 283de315-fdcb-4c89-91e3-96aa3e822b21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:32.268704 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-168cbf0e-2a87-4242-8380-6c2afec3e40d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:32.269194 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-168cbf0e-2a87-4242-8380-6c2afec3e40d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:32.273961 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-168cbf0e-2a87-4242-8380-6c2afec3e40d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:32.273961 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-168cbf0e-2a87-4242-8380-6c2afec3e40d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:32.273961 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-168cbf0e-2a87-4242-8380-6c2afec3e40d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:32.273961 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-168cbf0e-2a87-4242-8380-6c2afec3e40d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:32.935338 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-27d0b1bf-e95c-48b5-8f53-9321beecc95b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:32.944746 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-27d0b1bf-e95c-48b5-8f53-9321beecc95b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 200 len: 1359 microversion: 2.1 time: 0.928489 Oct 23 01:13:32.946275 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 415/797] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:32 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 1359 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:13:32.952464 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b43557eb-0eaa-4cc9-87f2-3b7786a67ede tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:32.953163 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b43557eb-0eaa-4cc9-87f2-3b7786a67ede tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 93d46a54-c775-4fc6-ad62-edf53bee2d07] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:32.963107 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b43557eb-0eaa-4cc9-87f2-3b7786a67ede tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:32.968043 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b43557eb-0eaa-4cc9-87f2-3b7786a67ede tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:32.968043 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b43557eb-0eaa-4cc9-87f2-3b7786a67ede tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:32.968043 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b43557eb-0eaa-4cc9-87f2-3b7786a67ede tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:32.968043 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b43557eb-0eaa-4cc9-87f2-3b7786a67ede tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:32.968939 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b43557eb-0eaa-4cc9-87f2-3b7786a67ede tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:33.074701 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b43557eb-0eaa-4cc9-87f2-3b7786a67ede tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262d5984b8c4775b86fae1c0d314718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc8f8cefbf441c98d6bda76e99e3173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:33.076724 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-168cbf0e-2a87-4242-8380-6c2afec3e40d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:33.085194 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-168cbf0e-2a87-4242-8380-6c2afec3e40d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:33.087290 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-168cbf0e-2a87-4242-8380-6c2afec3e40d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:33.088490 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-168cbf0e-2a87-4242-8380-6c2afec3e40d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21" status: 200 len: 1362 microversion: 2.25 time: 0.856204 Oct 23 01:13:33.098191 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 383/798] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:32 2022] GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21 => generated 1362 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:13:33.098423 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b43557eb-0eaa-4cc9-87f2-3b7786a67ede tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07" status: 200 len: 1270 microversion: 2.1 time: 0.141945 Oct 23 01:13:33.098423 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 416/799] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:32 2022] GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07 => generated 1270 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:33.104775 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-87d06536-838e-439f-a857-d579e19dfae5 req-50cedfcc-0e91-472d-936e-0f145d8f4165 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "510a3540-031d-4fab-bf7c-0a3bbc8c4d4d", "name": "network-vif-plugged", "status": "completed", "tag": "baff0168-301d-414b-99b1-bb1e62f9bfcd"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:13:33.105832 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1fe8af7b-ecf8-4f95-81c6-2f9a280c8eb4 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:33.106473 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1fe8af7b-ecf8-4f95-81c6-2f9a280c8eb4 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:33.115678 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1fe8af7b-ecf8-4f95-81c6-2f9a280c8eb4 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:33.116180 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-87d06536-838e-439f-a857-d579e19dfae5 req-50cedfcc-0e91-472d-936e-0f145d8f4165 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:33.116331 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1fe8af7b-ecf8-4f95-81c6-2f9a280c8eb4 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:33.116747 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1fe8af7b-ecf8-4f95-81c6-2f9a280c8eb4 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:33.116963 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-87d06536-838e-439f-a857-d579e19dfae5 req-50cedfcc-0e91-472d-936e-0f145d8f4165 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:33.118162 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1fe8af7b-ecf8-4f95-81c6-2f9a280c8eb4 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:33.118283 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-87d06536-838e-439f-a857-d579e19dfae5 req-50cedfcc-0e91-472d-936e-0f145d8f4165 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:33.118632 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1fe8af7b-ecf8-4f95-81c6-2f9a280c8eb4 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:33.119065 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1fe8af7b-ecf8-4f95-81c6-2f9a280c8eb4 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:33.131242 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-87d06536-838e-439f-a857-d579e19dfae5 req-50cedfcc-0e91-472d-936e-0f145d8f4165 service nova] Creating event network-vif-plugged:baff0168-301d-414b-99b1-bb1e62f9bfcd for instance 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d on n-h2-master-1 Oct 23 01:13:33.136294 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-87d06536-838e-439f-a857-d579e19dfae5 req-50cedfcc-0e91-472d-936e-0f145d8f4165 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043091 Oct 23 01:13:33.138109 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 417/800] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:13:33.143298 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4d317cd0-2965-4718-8396-4ec029682468 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:33.143998 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4d317cd0-2965-4718-8396-4ec029682468 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f277484-b3ae-465e-90b7-8febafef9329] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:33.151358 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4d317cd0-2965-4718-8396-4ec029682468 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:33.152053 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4d317cd0-2965-4718-8396-4ec029682468 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:33.152658 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4d317cd0-2965-4718-8396-4ec029682468 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:33.153779 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4d317cd0-2965-4718-8396-4ec029682468 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:33.154471 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4d317cd0-2965-4718-8396-4ec029682468 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:33.155067 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4d317cd0-2965-4718-8396-4ec029682468 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:33.216181 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1fe8af7b-ecf8-4f95-81c6-2f9a280c8eb4 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:33.227999 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1fe8af7b-ecf8-4f95-81c6-2f9a280c8eb4 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:33.230329 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1fe8af7b-ecf8-4f95-81c6-2f9a280c8eb4 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:33.236859 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1fe8af7b-ecf8-4f95-81c6-2f9a280c8eb4 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1537 microversion: 2.91 time: 0.146250 Oct 23 01:13:33.237434 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 384/801] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:33 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1537 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:13:33.260974 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2f3e023d-2909-4d3d-aa94-e70a75a04b67 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:33.261807 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2f3e023d-2909-4d3d-aa94-e70a75a04b67 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: edb35c7d-9adc-4b53-9bef-147aadbeae5d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:33.268124 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f3e023d-2909-4d3d-aa94-e70a75a04b67 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:33.268899 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f3e023d-2909-4d3d-aa94-e70a75a04b67 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:33.269817 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f3e023d-2909-4d3d-aa94-e70a75a04b67 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:33.270722 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f3e023d-2909-4d3d-aa94-e70a75a04b67 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:33.271580 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f3e023d-2909-4d3d-aa94-e70a75a04b67 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:33.272239 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f3e023d-2909-4d3d-aa94-e70a75a04b67 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:33.423822 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4d317cd0-2965-4718-8396-4ec029682468 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:33.444560 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4d317cd0-2965-4718-8396-4ec029682468 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329" status: 200 len: 1472 microversion: 2.1 time: 0.305077 Oct 23 01:13:33.445734 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 418/802] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:33 2022] GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329 => generated 1472 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:33.559932 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2f3e023d-2909-4d3d-aa94-e70a75a04b67 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:33.570322 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2f3e023d-2909-4d3d-aa94-e70a75a04b67 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d" status: 200 len: 1312 microversion: 2.1 time: 0.315748 Oct 23 01:13:33.587889 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 385/803] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:33 2022] GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d => generated 1312 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:33.970927 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b24bc76f-8c07-4dd2-b009-88616513efcc tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:33.971366 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b24bc76f-8c07-4dd2-b009-88616513efcc tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:33.981379 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b24bc76f-8c07-4dd2-b009-88616513efcc tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:33.981912 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b24bc76f-8c07-4dd2-b009-88616513efcc tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:33.982328 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b24bc76f-8c07-4dd2-b009-88616513efcc tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:33.983066 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b24bc76f-8c07-4dd2-b009-88616513efcc tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:33.983527 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b24bc76f-8c07-4dd2-b009-88616513efcc tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:33.983953 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b24bc76f-8c07-4dd2-b009-88616513efcc tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:34.113876 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-297caa71-ec9d-4ea3-8942-c42bf652f2da tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:34.114546 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-297caa71-ec9d-4ea3-8942-c42bf652f2da tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 93d46a54-c775-4fc6-ad62-edf53bee2d07] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:34.127440 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-297caa71-ec9d-4ea3-8942-c42bf652f2da tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:34.128002 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-297caa71-ec9d-4ea3-8942-c42bf652f2da tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:34.128479 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-297caa71-ec9d-4ea3-8942-c42bf652f2da tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:34.146532 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-297caa71-ec9d-4ea3-8942-c42bf652f2da tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:34.147300 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-297caa71-ec9d-4ea3-8942-c42bf652f2da tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:34.147461 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-297caa71-ec9d-4ea3-8942-c42bf652f2da tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:34.401647 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b24bc76f-8c07-4dd2-b009-88616513efcc tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:34.412363 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b24bc76f-8c07-4dd2-b009-88616513efcc tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 200 len: 1359 microversion: 2.1 time: 0.446105 Oct 23 01:13:34.424519 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 419/804] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:33 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 1359 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:34.432019 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-247f4be7-3256-43f4-ba4a-7e2bd2f8b93b tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:34.432884 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-247f4be7-3256-43f4-ba4a-7e2bd2f8b93b tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 283de315-fdcb-4c89-91e3-96aa3e822b21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:34.433891 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-297caa71-ec9d-4ea3-8942-c42bf652f2da tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262d5984b8c4775b86fae1c0d314718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc8f8cefbf441c98d6bda76e99e3173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:34.440895 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-247f4be7-3256-43f4-ba4a-7e2bd2f8b93b tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:34.441399 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-247f4be7-3256-43f4-ba4a-7e2bd2f8b93b tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:34.441841 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-247f4be7-3256-43f4-ba4a-7e2bd2f8b93b tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:34.442062 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-297caa71-ec9d-4ea3-8942-c42bf652f2da tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07" status: 200 len: 1312 microversion: 2.1 time: 0.333029 Oct 23 01:13:34.442583 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-247f4be7-3256-43f4-ba4a-7e2bd2f8b93b tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:34.443045 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-247f4be7-3256-43f4-ba4a-7e2bd2f8b93b tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:34.443476 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-247f4be7-3256-43f4-ba4a-7e2bd2f8b93b tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:34.450630 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 386/805] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:34 2022] GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07 => generated 1312 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:34.470866 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6eaf913c-b316-44fb-b472-043b8bd3fb10 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:34.473615 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6eaf913c-b316-44fb-b472-043b8bd3fb10 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:34.491983 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6eaf913c-b316-44fb-b472-043b8bd3fb10 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:34.492823 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6eaf913c-b316-44fb-b472-043b8bd3fb10 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:34.493276 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6eaf913c-b316-44fb-b472-043b8bd3fb10 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:34.494042 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6eaf913c-b316-44fb-b472-043b8bd3fb10 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:34.494484 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6eaf913c-b316-44fb-b472-043b8bd3fb10 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:34.499379 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6eaf913c-b316-44fb-b472-043b8bd3fb10 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:34.712600 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6eaf913c-b316-44fb-b472-043b8bd3fb10 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:34.730845 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6eaf913c-b316-44fb-b472-043b8bd3fb10 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:34.733023 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6eaf913c-b316-44fb-b472-043b8bd3fb10 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:34.745285 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6eaf913c-b316-44fb-b472-043b8bd3fb10 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1537 microversion: 2.91 time: 0.287183 Oct 23 01:13:34.745285 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 387/806] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:34 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1537 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:13:34.750491 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-55600c34-0821-44d4-b2e4-7fb608f6ed9f tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:34.751129 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-55600c34-0821-44d4-b2e4-7fb608f6ed9f tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f277484-b3ae-465e-90b7-8febafef9329] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:34.769966 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55600c34-0821-44d4-b2e4-7fb608f6ed9f tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:34.774152 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55600c34-0821-44d4-b2e4-7fb608f6ed9f tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:34.774152 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55600c34-0821-44d4-b2e4-7fb608f6ed9f tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:34.774152 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55600c34-0821-44d4-b2e4-7fb608f6ed9f tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:34.774152 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55600c34-0821-44d4-b2e4-7fb608f6ed9f tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:34.774590 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55600c34-0821-44d4-b2e4-7fb608f6ed9f tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:34.972261 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-247f4be7-3256-43f4-ba4a-7e2bd2f8b93b tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:34.992696 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-247f4be7-3256-43f4-ba4a-7e2bd2f8b93b tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:34.995836 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-247f4be7-3256-43f4-ba4a-7e2bd2f8b93b tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:35.005475 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-247f4be7-3256-43f4-ba4a-7e2bd2f8b93b tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21" status: 200 len: 1362 microversion: 2.25 time: 0.579184 Oct 23 01:13:35.006646 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 420/807] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:34 2022] GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21 => generated 1362 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:13:35.012149 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-461fc009-1d98-4b92-bb45-af162af5ee2e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:35.015306 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-461fc009-1d98-4b92-bb45-af162af5ee2e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: edb35c7d-9adc-4b53-9bef-147aadbeae5d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:35.030367 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-461fc009-1d98-4b92-bb45-af162af5ee2e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:35.031040 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-461fc009-1d98-4b92-bb45-af162af5ee2e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:35.031649 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-461fc009-1d98-4b92-bb45-af162af5ee2e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:35.036267 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-461fc009-1d98-4b92-bb45-af162af5ee2e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:35.037336 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-461fc009-1d98-4b92-bb45-af162af5ee2e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:35.037925 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-461fc009-1d98-4b92-bb45-af162af5ee2e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:35.392479 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-55600c34-0821-44d4-b2e4-7fb608f6ed9f tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:35.433966 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-55600c34-0821-44d4-b2e4-7fb608f6ed9f tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329" status: 200 len: 1472 microversion: 2.1 time: 0.690093 Oct 23 01:13:35.434782 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 388/808] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:34 2022] GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329 => generated 1472 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:35.472005 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-e2c9aaa6-a644-4cff-bf97-e7b6f60c0431 req-07fc60aa-27c5-4306-ae74-92a34f64feb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "283de315-fdcb-4c89-91e3-96aa3e822b21", "tag": "6fcf53a8-2a64-4797-8cda-509dc4504f75"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:13:35.483289 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-e2c9aaa6-a644-4cff-bf97-e7b6f60c0431 req-07fc60aa-27c5-4306-ae74-92a34f64feb5 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:35.490582 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-e2c9aaa6-a644-4cff-bf97-e7b6f60c0431 req-07fc60aa-27c5-4306-ae74-92a34f64feb5 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:35.491217 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-e2c9aaa6-a644-4cff-bf97-e7b6f60c0431 req-07fc60aa-27c5-4306-ae74-92a34f64feb5 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:35.499199 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-461fc009-1d98-4b92-bb45-af162af5ee2e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:35.510886 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-461fc009-1d98-4b92-bb45-af162af5ee2e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d" status: 200 len: 1312 microversion: 2.1 time: 0.502931 Oct 23 01:13:35.512317 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 421/809] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:35 2022] GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d => generated 1312 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:35.522290 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-e2c9aaa6-a644-4cff-bf97-e7b6f60c0431 req-07fc60aa-27c5-4306-ae74-92a34f64feb5 service nova] Creating event network-changed:6fcf53a8-2a64-4797-8cda-509dc4504f75 for instance 283de315-fdcb-4c89-91e3-96aa3e822b21 on n-h2-master-1 Oct 23 01:13:35.532803 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-e2c9aaa6-a644-4cff-bf97-e7b6f60c0431 req-07fc60aa-27c5-4306-ae74-92a34f64feb5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076680 Oct 23 01:13:35.534116 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 389/810] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:13:35.537226 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-4a725c21-bee1-403f-9008-ecd4caed1b18 req-e9269500-d7a5-4905-abe0-f55f2eba283f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edb35c7d-9adc-4b53-9bef-147aadbeae5d", "name": "network-vif-plugged", "status": "completed", "tag": "13993c6b-8acd-482a-a3cf-1db8731b8846"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:13:35.539811 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dad63fa9-ce35-4a73-b956-beebccd28e0c tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:35.540806 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-dad63fa9-ce35-4a73-b956-beebccd28e0c tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:35.549841 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-4a725c21-bee1-403f-9008-ecd4caed1b18 req-e9269500-d7a5-4905-abe0-f55f2eba283f service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:35.550637 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-4a725c21-bee1-403f-9008-ecd4caed1b18 req-e9269500-d7a5-4905-abe0-f55f2eba283f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:35.551259 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-4a725c21-bee1-403f-9008-ecd4caed1b18 req-e9269500-d7a5-4905-abe0-f55f2eba283f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:35.553804 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dad63fa9-ce35-4a73-b956-beebccd28e0c tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:35.556135 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dad63fa9-ce35-4a73-b956-beebccd28e0c tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:35.566469 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dad63fa9-ce35-4a73-b956-beebccd28e0c tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:35.567422 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dad63fa9-ce35-4a73-b956-beebccd28e0c tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:35.567539 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-4a725c21-bee1-403f-9008-ecd4caed1b18 req-e9269500-d7a5-4905-abe0-f55f2eba283f service nova] Creating event network-vif-plugged:13993c6b-8acd-482a-a3cf-1db8731b8846 for instance edb35c7d-9adc-4b53-9bef-147aadbeae5d on n-h1-master-1 Oct 23 01:13:35.568004 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dad63fa9-ce35-4a73-b956-beebccd28e0c tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:35.568512 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dad63fa9-ce35-4a73-b956-beebccd28e0c tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:35.576088 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-4a725c21-bee1-403f-9008-ecd4caed1b18 req-e9269500-d7a5-4905-abe0-f55f2eba283f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050864 Oct 23 01:13:35.577529 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 422/811] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:13:35.585352 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f2245edf-d2f4-4a34-99a4-7f65a1d400a5 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:35.586422 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f2245edf-d2f4-4a34-99a4-7f65a1d400a5 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 93d46a54-c775-4fc6-ad62-edf53bee2d07] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:35.595534 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f2245edf-d2f4-4a34-99a4-7f65a1d400a5 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:35.596249 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f2245edf-d2f4-4a34-99a4-7f65a1d400a5 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:35.597102 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f2245edf-d2f4-4a34-99a4-7f65a1d400a5 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:35.598113 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f2245edf-d2f4-4a34-99a4-7f65a1d400a5 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:35.598572 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f2245edf-d2f4-4a34-99a4-7f65a1d400a5 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:35.598988 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f2245edf-d2f4-4a34-99a4-7f65a1d400a5 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:36.005485 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f2245edf-d2f4-4a34-99a4-7f65a1d400a5 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262d5984b8c4775b86fae1c0d314718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc8f8cefbf441c98d6bda76e99e3173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:36.014556 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f2245edf-d2f4-4a34-99a4-7f65a1d400a5 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07" status: 200 len: 1312 microversion: 2.1 time: 0.435540 Oct 23 01:13:36.015369 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 423/812] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:35 2022] GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07 => generated 1312 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:36.019784 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8a1a5e50-436f-4830-83af-089e0bd7bcf9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:36.020290 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8a1a5e50-436f-4830-83af-089e0bd7bcf9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:36.026802 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a1a5e50-436f-4830-83af-089e0bd7bcf9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:36.027275 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a1a5e50-436f-4830-83af-089e0bd7bcf9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:36.027704 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a1a5e50-436f-4830-83af-089e0bd7bcf9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:36.028396 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a1a5e50-436f-4830-83af-089e0bd7bcf9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:36.028849 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a1a5e50-436f-4830-83af-089e0bd7bcf9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:36.029271 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a1a5e50-436f-4830-83af-089e0bd7bcf9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:36.052553 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-dad63fa9-ce35-4a73-b956-beebccd28e0c tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:36.062676 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-dad63fa9-ce35-4a73-b956-beebccd28e0c tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 200 len: 1543 microversion: 2.1 time: 0.527133 Oct 23 01:13:36.066383 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 390/813] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:35 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 1543 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:36.069619 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1c022bb0-7584-4b93-b583-2aeaf4a12146 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:36.070933 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1c022bb0-7584-4b93-b583-2aeaf4a12146 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 283de315-fdcb-4c89-91e3-96aa3e822b21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:36.078980 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1c022bb0-7584-4b93-b583-2aeaf4a12146 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:36.079638 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1c022bb0-7584-4b93-b583-2aeaf4a12146 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:36.080266 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1c022bb0-7584-4b93-b583-2aeaf4a12146 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:36.081150 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1c022bb0-7584-4b93-b583-2aeaf4a12146 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:36.081669 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1c022bb0-7584-4b93-b583-2aeaf4a12146 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:36.082329 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1c022bb0-7584-4b93-b583-2aeaf4a12146 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:36.141025 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8a1a5e50-436f-4830-83af-089e0bd7bcf9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:36.152565 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8a1a5e50-436f-4830-83af-089e0bd7bcf9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:36.155358 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8a1a5e50-436f-4830-83af-089e0bd7bcf9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:36.162021 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8a1a5e50-436f-4830-83af-089e0bd7bcf9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1537 microversion: 2.91 time: 0.145782 Oct 23 01:13:36.162670 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 424/814] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:36 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1537 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:13:36.179852 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-111094be-4154-482b-b0bc-ef58edbde4f9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:36.181020 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-111094be-4154-482b-b0bc-ef58edbde4f9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:36.196025 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-111094be-4154-482b-b0bc-ef58edbde4f9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:36.197137 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-111094be-4154-482b-b0bc-ef58edbde4f9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:36.197832 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-111094be-4154-482b-b0bc-ef58edbde4f9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:36.198507 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-111094be-4154-482b-b0bc-ef58edbde4f9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:36.215741 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-111094be-4154-482b-b0bc-ef58edbde4f9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:36.216397 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-111094be-4154-482b-b0bc-ef58edbde4f9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:36.410761 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-111094be-4154-482b-b0bc-ef58edbde4f9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.246377 Oct 23 01:13:36.410906 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 425/815] 10.222.0.42 () {58 vars in 1275 bytes} [Sun Oct 23 01:13:36 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d/os-interface => generated 285 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:13:36.418466 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1c022bb0-7584-4b93-b583-2aeaf4a12146 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:36.435559 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1c022bb0-7584-4b93-b583-2aeaf4a12146 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:36.437019 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1c022bb0-7584-4b93-b583-2aeaf4a12146 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:36.438244 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1c022bb0-7584-4b93-b583-2aeaf4a12146 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21" status: 200 len: 1362 microversion: 2.25 time: 0.373559 Oct 23 01:13:36.438785 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 391/816] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:36 2022] GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21 => generated 1362 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:13:36.462579 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2c027726-24d2-4efa-a034-722f78c20a67 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:36.463209 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2c027726-24d2-4efa-a034-722f78c20a67 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f277484-b3ae-465e-90b7-8febafef9329] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:36.481537 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2c027726-24d2-4efa-a034-722f78c20a67 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:36.482372 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2c027726-24d2-4efa-a034-722f78c20a67 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:36.482971 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2c027726-24d2-4efa-a034-722f78c20a67 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:36.483844 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2c027726-24d2-4efa-a034-722f78c20a67 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:36.484469 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2c027726-24d2-4efa-a034-722f78c20a67 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:36.484902 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2c027726-24d2-4efa-a034-722f78c20a67 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:36.537514 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9489c5b1-67dc-44b8-80c6-c73b5ceae080 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:36.538321 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9489c5b1-67dc-44b8-80c6-c73b5ceae080 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: edb35c7d-9adc-4b53-9bef-147aadbeae5d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:36.547617 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9489c5b1-67dc-44b8-80c6-c73b5ceae080 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:36.548179 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9489c5b1-67dc-44b8-80c6-c73b5ceae080 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:36.548664 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9489c5b1-67dc-44b8-80c6-c73b5ceae080 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:36.549403 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9489c5b1-67dc-44b8-80c6-c73b5ceae080 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:36.550062 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9489c5b1-67dc-44b8-80c6-c73b5ceae080 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:36.550543 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9489c5b1-67dc-44b8-80c6-c73b5ceae080 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:36.891030 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2c027726-24d2-4efa-a034-722f78c20a67 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:36.895509 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9489c5b1-67dc-44b8-80c6-c73b5ceae080 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:36.908580 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2c027726-24d2-4efa-a034-722f78c20a67 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329" status: 200 len: 1472 microversion: 2.1 time: 0.450253 Oct 23 01:13:36.909181 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 426/817] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:36 2022] GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329 => generated 1472 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:36.911779 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9489c5b1-67dc-44b8-80c6-c73b5ceae080 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d" status: 200 len: 1312 microversion: 2.1 time: 0.378395 Oct 23 01:13:36.926595 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 392/818] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:36 2022] GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d => generated 1312 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:13:37.036945 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-673b966a-9c78-4a74-bee5-f6d38d3f57c2 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:37.038370 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-673b966a-9c78-4a74-bee5-f6d38d3f57c2 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 93d46a54-c775-4fc6-ad62-edf53bee2d07] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:37.040569 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:37.050887 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-673b966a-9c78-4a74-bee5-f6d38d3f57c2 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:37.051651 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-673b966a-9c78-4a74-bee5-f6d38d3f57c2 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:37.052241 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-673b966a-9c78-4a74-bee5-f6d38d3f57c2 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:37.056097 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-673b966a-9c78-4a74-bee5-f6d38d3f57c2 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:37.056782 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-673b966a-9c78-4a74-bee5-f6d38d3f57c2 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:37.057372 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-673b966a-9c78-4a74-bee5-f6d38d3f57c2 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:37.196242 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4eca46f6-dc07-4bcd-be00-7ecaf8ccba71 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:37.196858 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4eca46f6-dc07-4bcd-be00-7ecaf8ccba71 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:37.203561 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4eca46f6-dc07-4bcd-be00-7ecaf8ccba71 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:37.204048 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4eca46f6-dc07-4bcd-be00-7ecaf8ccba71 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:37.204768 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4eca46f6-dc07-4bcd-be00-7ecaf8ccba71 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:37.205162 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4eca46f6-dc07-4bcd-be00-7ecaf8ccba71 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:37.211634 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4eca46f6-dc07-4bcd-be00-7ecaf8ccba71 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:37.213267 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4eca46f6-dc07-4bcd-be00-7ecaf8ccba71 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:37.326122 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:37.385075 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=6 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:37.390267 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-673b966a-9c78-4a74-bee5-f6d38d3f57c2 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262d5984b8c4775b86fae1c0d314718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc8f8cefbf441c98d6bda76e99e3173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:37.398814 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4eca46f6-dc07-4bcd-be00-7ecaf8ccba71 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:37.411424 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-673b966a-9c78-4a74-bee5-f6d38d3f57c2 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07" status: 200 len: 1333 microversion: 2.1 time: 0.378371 Oct 23 01:13:37.414975 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 427/819] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:37 2022] GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07 => generated 1333 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:37.417008 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4eca46f6-dc07-4bcd-be00-7ecaf8ccba71 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:37.419973 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4eca46f6-dc07-4bcd-be00-7ecaf8ccba71 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:37.426705 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4eca46f6-dc07-4bcd-be00-7ecaf8ccba71 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1537 microversion: 2.91 time: 0.234464 Oct 23 01:13:37.427566 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 393/820] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:37 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1537 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:13:37.478556 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9da39696-9e0b-409c-b9ff-d4486adc625e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:37.479511 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9da39696-9e0b-409c-b9ff-d4486adc625e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 283de315-fdcb-4c89-91e3-96aa3e822b21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:37.496899 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9da39696-9e0b-409c-b9ff-d4486adc625e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:37.498691 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9da39696-9e0b-409c-b9ff-d4486adc625e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:37.500025 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9da39696-9e0b-409c-b9ff-d4486adc625e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:37.500975 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9da39696-9e0b-409c-b9ff-d4486adc625e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:37.501734 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9da39696-9e0b-409c-b9ff-d4486adc625e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:37.502401 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9da39696-9e0b-409c-b9ff-d4486adc625e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:37.933185 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7739b586-a165-4a07-ae9f-ed5beb3d7b20 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:37.933801 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7739b586-a165-4a07-ae9f-ed5beb3d7b20 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f277484-b3ae-465e-90b7-8febafef9329] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:37.940688 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7739b586-a165-4a07-ae9f-ed5beb3d7b20 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:37.941182 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7739b586-a165-4a07-ae9f-ed5beb3d7b20 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:37.941758 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7739b586-a165-4a07-ae9f-ed5beb3d7b20 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:37.942516 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7739b586-a165-4a07-ae9f-ed5beb3d7b20 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:37.942968 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7739b586-a165-4a07-ae9f-ed5beb3d7b20 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:37.943598 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7739b586-a165-4a07-ae9f-ed5beb3d7b20 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:38.143995 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9da39696-9e0b-409c-b9ff-d4486adc625e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:38.153607 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9da39696-9e0b-409c-b9ff-d4486adc625e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:38.165100 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9da39696-9e0b-409c-b9ff-d4486adc625e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:38.166791 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9da39696-9e0b-409c-b9ff-d4486adc625e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21" status: 200 len: 1362 microversion: 2.25 time: 0.705588 Oct 23 01:13:38.168372 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 428/821] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:37 2022] GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21 => generated 1362 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:13:38.186764 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ede2b590-b28f-4593-9c62-540cfe8d7b15 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:38.189498 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ede2b590-b28f-4593-9c62-540cfe8d7b15 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: edb35c7d-9adc-4b53-9bef-147aadbeae5d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:38.200932 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ede2b590-b28f-4593-9c62-540cfe8d7b15 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:38.201737 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ede2b590-b28f-4593-9c62-540cfe8d7b15 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:38.202922 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ede2b590-b28f-4593-9c62-540cfe8d7b15 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:38.207557 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ede2b590-b28f-4593-9c62-540cfe8d7b15 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:38.207557 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ede2b590-b28f-4593-9c62-540cfe8d7b15 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:38.207557 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ede2b590-b28f-4593-9c62-540cfe8d7b15 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:38.512071 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7739b586-a165-4a07-ae9f-ed5beb3d7b20 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:38.522813 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7739b586-a165-4a07-ae9f-ed5beb3d7b20 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329" status: 200 len: 1472 microversion: 2.1 time: 0.594413 Oct 23 01:13:38.543455 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 394/822] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:37 2022] GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329 => generated 1472 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:13:38.548730 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6a5e0772-dad4-40a6-99cc-579f76e9b74f tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:38.549537 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6a5e0772-dad4-40a6-99cc-579f76e9b74f tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 93d46a54-c775-4fc6-ad62-edf53bee2d07] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:38.557531 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6a5e0772-dad4-40a6-99cc-579f76e9b74f tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:38.558287 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6a5e0772-dad4-40a6-99cc-579f76e9b74f tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:38.558901 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6a5e0772-dad4-40a6-99cc-579f76e9b74f tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:38.559828 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6a5e0772-dad4-40a6-99cc-579f76e9b74f tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:38.560581 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6a5e0772-dad4-40a6-99cc-579f76e9b74f tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:38.561415 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6a5e0772-dad4-40a6-99cc-579f76e9b74f tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:38.565250 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=100 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:38.746482 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ede2b590-b28f-4593-9c62-540cfe8d7b15 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:38.754606 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ede2b590-b28f-4593-9c62-540cfe8d7b15 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d" status: 200 len: 1461 microversion: 2.1 time: 0.584161 Oct 23 01:13:38.755499 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 429/823] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:38 2022] GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d => generated 1461 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:38.760571 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-291f7610-8912-4e91-81b8-a7fc3d5d3a6c tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:38.761340 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-291f7610-8912-4e91-81b8-a7fc3d5d3a6c tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:38.767939 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-291f7610-8912-4e91-81b8-a7fc3d5d3a6c tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:38.768595 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-291f7610-8912-4e91-81b8-a7fc3d5d3a6c tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:38.769178 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-291f7610-8912-4e91-81b8-a7fc3d5d3a6c tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:38.770090 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-291f7610-8912-4e91-81b8-a7fc3d5d3a6c tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:38.770939 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-291f7610-8912-4e91-81b8-a7fc3d5d3a6c tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:38.771640 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-291f7610-8912-4e91-81b8-a7fc3d5d3a6c tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:38.772249 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=10 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:39.133124 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-291f7610-8912-4e91-81b8-a7fc3d5d3a6c tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:39.133124 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-291f7610-8912-4e91-81b8-a7fc3d5d3a6c tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:39.133764 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-291f7610-8912-4e91-81b8-a7fc3d5d3a6c tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:39.133764 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-291f7610-8912-4e91-81b8-a7fc3d5d3a6c tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1537 microversion: 2.91 time: 0.224983 Oct 23 01:13:39.133764 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 430/824] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:38 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1537 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:13:39.139357 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-b6eeb290-184d-45d6-811d-d885748165bc req-3f43f953-f69e-4c48-b49b-10dc88c49a08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "510a3540-031d-4fab-bf7c-0a3bbc8c4d4d", "tag": "baff0168-301d-414b-99b1-bb1e62f9bfcd"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:13:39.139357 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-b6eeb290-184d-45d6-811d-d885748165bc req-3f43f953-f69e-4c48-b49b-10dc88c49a08 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:39.139357 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-b6eeb290-184d-45d6-811d-d885748165bc req-3f43f953-f69e-4c48-b49b-10dc88c49a08 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:39.139357 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-b6eeb290-184d-45d6-811d-d885748165bc req-3f43f953-f69e-4c48-b49b-10dc88c49a08 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:39.139980 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-b6eeb290-184d-45d6-811d-d885748165bc req-3f43f953-f69e-4c48-b49b-10dc88c49a08 service nova] Creating event network-changed:baff0168-301d-414b-99b1-bb1e62f9bfcd for instance 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d on n-h2-master-1 Oct 23 01:13:39.139980 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-b6eeb290-184d-45d6-811d-d885748165bc req-3f43f953-f69e-4c48-b49b-10dc88c49a08 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031808 Oct 23 01:13:39.139980 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 431/825] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:13:39.139980 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5496772d-2619-42ed-9ee3-00518f381687 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:13:39.139980 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5496772d-2619-42ed-9ee3-00518f381687 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: edb35c7d-9adc-4b53-9bef-147aadbeae5d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:39.141083 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6a5e0772-dad4-40a6-99cc-579f76e9b74f tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262d5984b8c4775b86fae1c0d314718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc8f8cefbf441c98d6bda76e99e3173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:39.153643 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5496772d-2619-42ed-9ee3-00518f381687 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:39.153643 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5496772d-2619-42ed-9ee3-00518f381687 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:39.153643 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5496772d-2619-42ed-9ee3-00518f381687 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:39.153643 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5496772d-2619-42ed-9ee3-00518f381687 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:39.155567 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5496772d-2619-42ed-9ee3-00518f381687 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:39.155567 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5496772d-2619-42ed-9ee3-00518f381687 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:39.155857 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6a5e0772-dad4-40a6-99cc-579f76e9b74f tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07" status: 200 len: 1333 microversion: 2.1 time: 0.494270 Oct 23 01:13:39.155857 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 395/826] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:38 2022] GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07 => generated 1333 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:39.156051 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=100 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:39.197232 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d09de0d9-1546-496b-a757-03a201237855 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:39.197909 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d09de0d9-1546-496b-a757-03a201237855 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 283de315-fdcb-4c89-91e3-96aa3e822b21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:39.205702 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d09de0d9-1546-496b-a757-03a201237855 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:39.209151 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d09de0d9-1546-496b-a757-03a201237855 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:39.209964 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d09de0d9-1546-496b-a757-03a201237855 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:39.211044 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d09de0d9-1546-496b-a757-03a201237855 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:39.211867 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d09de0d9-1546-496b-a757-03a201237855 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:39.212466 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d09de0d9-1546-496b-a757-03a201237855 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:39.308958 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5496772d-2619-42ed-9ee3-00518f381687 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:39.316522 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5496772d-2619-42ed-9ee3-00518f381687 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: edb35c7d-9adc-4b53-9bef-147aadbeae5d] Old instance type m1.heat2, new instance type m1.heat {{(pid=120945) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 23 01:13:39.328737 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-5496772d-2619-42ed-9ee3-00518f381687 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:13:39.329164 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-5496772d-2619-42ed-9ee3-00518f381687 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:13:39.334218 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-5496772d-2619-42ed-9ee3-00518f381687 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:13:39.334793 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-5496772d-2619-42ed-9ee3-00518f381687 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:13:39.337655 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-5496772d-2619-42ed-9ee3-00518f381687 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:13:39.690226 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5496772d-2619-42ed-9ee3-00518f381687 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "POST /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d/action" status: 202 len: 0 microversion: 2.1 time: 0.671759 Oct 23 01:13:39.694170 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 432/827] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:13:39 2022] POST /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d/action => generated 0 bytes in 676 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:13:39.720767 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d7dbb20e-e506-4851-b505-30b49dce9f28 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:39.721844 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d7dbb20e-e506-4851-b505-30b49dce9f28 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f277484-b3ae-465e-90b7-8febafef9329] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:39.735094 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d09de0d9-1546-496b-a757-03a201237855 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:39.753564 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d09de0d9-1546-496b-a757-03a201237855 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:39.757474 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d09de0d9-1546-496b-a757-03a201237855 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:39.760218 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d7dbb20e-e506-4851-b505-30b49dce9f28 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:39.760881 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d7dbb20e-e506-4851-b505-30b49dce9f28 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:39.761890 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d7dbb20e-e506-4851-b505-30b49dce9f28 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:39.762110 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d09de0d9-1546-496b-a757-03a201237855 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21" status: 200 len: 1362 microversion: 2.25 time: 0.566400 Oct 23 01:13:39.763558 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 396/828] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:39 2022] GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21 => generated 1362 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:13:39.765128 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d7dbb20e-e506-4851-b505-30b49dce9f28 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:39.767215 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d7dbb20e-e506-4851-b505-30b49dce9f28 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:39.767894 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d7dbb20e-e506-4851-b505-30b49dce9f28 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:39.777327 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-87240742-867d-4b9b-b17c-63394e079442 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:39.783521 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-87240742-867d-4b9b-b17c-63394e079442 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: edb35c7d-9adc-4b53-9bef-147aadbeae5d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:39.809002 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-87240742-867d-4b9b-b17c-63394e079442 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:39.813312 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-87240742-867d-4b9b-b17c-63394e079442 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:39.813908 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-87240742-867d-4b9b-b17c-63394e079442 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:39.827376 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-87240742-867d-4b9b-b17c-63394e079442 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:39.827376 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-87240742-867d-4b9b-b17c-63394e079442 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:39.827376 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-87240742-867d-4b9b-b17c-63394e079442 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:40.459899 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-87240742-867d-4b9b-b17c-63394e079442 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:40.480550 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-87240742-867d-4b9b-b17c-63394e079442 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d" status: 200 len: 1470 microversion: 2.1 time: 0.713661 Oct 23 01:13:40.483012 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 397/829] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:39 2022] GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d => generated 1470 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:40.492695 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d7dbb20e-e506-4851-b505-30b49dce9f28 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:40.498118 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b6326968-4319-4cc1-bf61-0e3ad549ddff tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:40.499841 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b6326968-4319-4cc1-bf61-0e3ad549ddff tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 93d46a54-c775-4fc6-ad62-edf53bee2d07] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:40.510864 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d7dbb20e-e506-4851-b505-30b49dce9f28 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329" status: 200 len: 1472 microversion: 2.1 time: 0.806533 Oct 23 01:13:40.510864 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 433/830] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:39 2022] GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329 => generated 1472 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:40.515388 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b6326968-4319-4cc1-bf61-0e3ad549ddff tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:40.516705 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b6326968-4319-4cc1-bf61-0e3ad549ddff tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:40.518711 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b6326968-4319-4cc1-bf61-0e3ad549ddff tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:40.520428 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b6326968-4319-4cc1-bf61-0e3ad549ddff tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:40.521759 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b6326968-4319-4cc1-bf61-0e3ad549ddff tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:40.522500 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b6326968-4319-4cc1-bf61-0e3ad549ddff tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:40.556500 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0072433f-da2f-43ad-b7cc-37058d2812a3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:40.559561 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0072433f-da2f-43ad-b7cc-37058d2812a3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:40.574156 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0072433f-da2f-43ad-b7cc-37058d2812a3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:40.576359 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0072433f-da2f-43ad-b7cc-37058d2812a3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:40.578293 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0072433f-da2f-43ad-b7cc-37058d2812a3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:40.580871 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0072433f-da2f-43ad-b7cc-37058d2812a3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:40.582231 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0072433f-da2f-43ad-b7cc-37058d2812a3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:40.583828 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0072433f-da2f-43ad-b7cc-37058d2812a3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:40.747016 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0072433f-da2f-43ad-b7cc-37058d2812a3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:40.756478 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0072433f-da2f-43ad-b7cc-37058d2812a3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:40.758349 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0072433f-da2f-43ad-b7cc-37058d2812a3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:40.775094 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0072433f-da2f-43ad-b7cc-37058d2812a3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1537 microversion: 2.91 time: 0.235540 Oct 23 01:13:40.776830 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 434/831] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:40 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1537 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:13:40.797842 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9b6b7933-4daf-4ddd-81a0-43c4233c11d8 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:40.828202 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9b6b7933-4daf-4ddd-81a0-43c4233c11d8 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 283de315-fdcb-4c89-91e3-96aa3e822b21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:40.840184 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b6b7933-4daf-4ddd-81a0-43c4233c11d8 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:40.841228 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b6b7933-4daf-4ddd-81a0-43c4233c11d8 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:40.842061 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b6b7933-4daf-4ddd-81a0-43c4233c11d8 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:40.843532 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b6b7933-4daf-4ddd-81a0-43c4233c11d8 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:40.844300 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b6b7933-4daf-4ddd-81a0-43c4233c11d8 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:40.844958 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b6b7933-4daf-4ddd-81a0-43c4233c11d8 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:40.958105 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b6326968-4319-4cc1-bf61-0e3ad549ddff tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262d5984b8c4775b86fae1c0d314718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc8f8cefbf441c98d6bda76e99e3173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:40.995944 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b6326968-4319-4cc1-bf61-0e3ad549ddff tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07" status: 200 len: 1354 microversion: 2.1 time: 0.511416 Oct 23 01:13:40.999683 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 398/832] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:40 2022] GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07 => generated 1354 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:41.443337 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9b6b7933-4daf-4ddd-81a0-43c4233c11d8 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:41.452122 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9b6b7933-4daf-4ddd-81a0-43c4233c11d8 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:41.454213 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9b6b7933-4daf-4ddd-81a0-43c4233c11d8 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:41.465488 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9b6b7933-4daf-4ddd-81a0-43c4233c11d8 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21" status: 200 len: 1362 microversion: 2.25 time: 0.676039 Oct 23 01:13:41.466923 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 435/833] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:40 2022] GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21 => generated 1362 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:13:41.510337 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3fc7ce0f-6065-4ad5-90b2-804746a6866b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:41.511634 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3fc7ce0f-6065-4ad5-90b2-804746a6866b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: edb35c7d-9adc-4b53-9bef-147aadbeae5d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:41.520872 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3fc7ce0f-6065-4ad5-90b2-804746a6866b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:41.521382 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3fc7ce0f-6065-4ad5-90b2-804746a6866b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:41.522558 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3fc7ce0f-6065-4ad5-90b2-804746a6866b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:41.523820 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3fc7ce0f-6065-4ad5-90b2-804746a6866b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:41.524282 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3fc7ce0f-6065-4ad5-90b2-804746a6866b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:41.524895 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3fc7ce0f-6065-4ad5-90b2-804746a6866b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:41.539912 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-96ce238d-8c0d-44c2-ab81-6bcd097e4452 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:41.539912 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-96ce238d-8c0d-44c2-ab81-6bcd097e4452 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f277484-b3ae-465e-90b7-8febafef9329] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:41.558227 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-96ce238d-8c0d-44c2-ab81-6bcd097e4452 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:41.558779 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-96ce238d-8c0d-44c2-ab81-6bcd097e4452 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:41.559497 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-96ce238d-8c0d-44c2-ab81-6bcd097e4452 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:41.560526 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-96ce238d-8c0d-44c2-ab81-6bcd097e4452 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:41.561263 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-96ce238d-8c0d-44c2-ab81-6bcd097e4452 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:41.561906 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-96ce238d-8c0d-44c2-ab81-6bcd097e4452 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:42.217165 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3fc7ce0f-6065-4ad5-90b2-804746a6866b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:42.236997 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3fc7ce0f-6065-4ad5-90b2-804746a6866b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d" status: 200 len: 1470 microversion: 2.1 time: 0.724635 Oct 23 01:13:42.239535 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 399/834] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:41 2022] GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d => generated 1470 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:13:42.245593 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-31c6dd70-4dfc-49a2-ae98-5280b619319d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:42.246584 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-31c6dd70-4dfc-49a2-ae98-5280b619319d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:42.266359 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-31c6dd70-4dfc-49a2-ae98-5280b619319d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:42.266359 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-31c6dd70-4dfc-49a2-ae98-5280b619319d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:42.266359 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-31c6dd70-4dfc-49a2-ae98-5280b619319d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:42.266359 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-31c6dd70-4dfc-49a2-ae98-5280b619319d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:42.266828 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-31c6dd70-4dfc-49a2-ae98-5280b619319d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:42.268251 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-31c6dd70-4dfc-49a2-ae98-5280b619319d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:42.288564 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-96ce238d-8c0d-44c2-ab81-6bcd097e4452 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:42.303547 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-96ce238d-8c0d-44c2-ab81-6bcd097e4452 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329" status: 200 len: 1472 microversion: 2.1 time: 0.766585 Oct 23 01:13:42.304483 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 436/835] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:41 2022] GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329 => generated 1472 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:42.316742 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a7ec0f20-fb79-4dce-816a-2833ace2197e tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:42.318697 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a7ec0f20-fb79-4dce-816a-2833ace2197e tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 93d46a54-c775-4fc6-ad62-edf53bee2d07] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:42.327170 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=7 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:42.338407 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a7ec0f20-fb79-4dce-816a-2833ace2197e tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:42.339776 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a7ec0f20-fb79-4dce-816a-2833ace2197e tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:42.340523 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a7ec0f20-fb79-4dce-816a-2833ace2197e tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:42.341262 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a7ec0f20-fb79-4dce-816a-2833ace2197e tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:42.345147 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a7ec0f20-fb79-4dce-816a-2833ace2197e tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:42.345598 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a7ec0f20-fb79-4dce-816a-2833ace2197e tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:42.457052 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-31c6dd70-4dfc-49a2-ae98-5280b619319d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:42.468050 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-31c6dd70-4dfc-49a2-ae98-5280b619319d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:42.469966 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-31c6dd70-4dfc-49a2-ae98-5280b619319d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:42.475731 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-31c6dd70-4dfc-49a2-ae98-5280b619319d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1537 microversion: 2.91 time: 0.234335 Oct 23 01:13:42.508580 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 400/836] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:42 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1537 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:13:42.514470 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ebb041ca-3e5e-414e-bbb3-03010ae292da tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:42.515798 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ebb041ca-3e5e-414e-bbb3-03010ae292da tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 283de315-fdcb-4c89-91e3-96aa3e822b21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:42.524052 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ebb041ca-3e5e-414e-bbb3-03010ae292da tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:42.524885 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ebb041ca-3e5e-414e-bbb3-03010ae292da tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:42.525543 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ebb041ca-3e5e-414e-bbb3-03010ae292da tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:42.526515 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ebb041ca-3e5e-414e-bbb3-03010ae292da tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:42.527280 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ebb041ca-3e5e-414e-bbb3-03010ae292da tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:42.527932 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ebb041ca-3e5e-414e-bbb3-03010ae292da tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:42.980162 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a7ec0f20-fb79-4dce-816a-2833ace2197e tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262d5984b8c4775b86fae1c0d314718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc8f8cefbf441c98d6bda76e99e3173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:42.989449 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a7ec0f20-fb79-4dce-816a-2833ace2197e tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07" status: 200 len: 1354 microversion: 2.1 time: 0.681376 Oct 23 01:13:43.002127 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 437/837] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:42 2022] GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07 => generated 1354 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:43.002127 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-ddfadc86-9971-48b5-9c18-3b57978acf9f req-e9463bf9-1491-4006-95a7-c1dd6bcabcc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "283de315-fdcb-4c89-91e3-96aa3e822b21", "name": "network-vif-plugged", "status": "completed", "tag": "6fcf53a8-2a64-4797-8cda-509dc4504f75"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:13:43.023970 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ddfadc86-9971-48b5-9c18-3b57978acf9f req-e9463bf9-1491-4006-95a7-c1dd6bcabcc3 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:43.024465 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ddfadc86-9971-48b5-9c18-3b57978acf9f req-e9463bf9-1491-4006-95a7-c1dd6bcabcc3 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:43.024904 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ddfadc86-9971-48b5-9c18-3b57978acf9f req-e9463bf9-1491-4006-95a7-c1dd6bcabcc3 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:43.045430 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-ddfadc86-9971-48b5-9c18-3b57978acf9f req-e9463bf9-1491-4006-95a7-c1dd6bcabcc3 service nova] Creating event network-vif-plugged:6fcf53a8-2a64-4797-8cda-509dc4504f75 for instance 283de315-fdcb-4c89-91e3-96aa3e822b21 on n-h2-master-1 Oct 23 01:13:43.051802 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-ddfadc86-9971-48b5-9c18-3b57978acf9f req-e9463bf9-1491-4006-95a7-c1dd6bcabcc3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052824 Oct 23 01:13:43.053802 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 438/838] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:13:43.056388 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ebb041ca-3e5e-414e-bbb3-03010ae292da tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:43.068927 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ebb041ca-3e5e-414e-bbb3-03010ae292da tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:43.072841 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ebb041ca-3e5e-414e-bbb3-03010ae292da tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:43.076604 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ebb041ca-3e5e-414e-bbb3-03010ae292da tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21" status: 200 len: 1362 microversion: 2.25 time: 0.566620 Oct 23 01:13:43.077418 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 401/839] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:42 2022] GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21 => generated 1362 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:13:43.274601 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-20d383f3-8be6-4955-841f-381794db7195 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:43.282248 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-20d383f3-8be6-4955-841f-381794db7195 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: edb35c7d-9adc-4b53-9bef-147aadbeae5d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:43.299651 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-20d383f3-8be6-4955-841f-381794db7195 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:43.299651 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-20d383f3-8be6-4955-841f-381794db7195 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:43.299651 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-20d383f3-8be6-4955-841f-381794db7195 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:43.299651 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-20d383f3-8be6-4955-841f-381794db7195 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:43.300082 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-20d383f3-8be6-4955-841f-381794db7195 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:43.301734 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-20d383f3-8be6-4955-841f-381794db7195 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:43.329933 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3b193b09-1bdd-4c25-ae1e-0f0f03dc2341 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:43.330622 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3b193b09-1bdd-4c25-ae1e-0f0f03dc2341 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f277484-b3ae-465e-90b7-8febafef9329] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:43.347362 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3b193b09-1bdd-4c25-ae1e-0f0f03dc2341 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:43.347981 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3b193b09-1bdd-4c25-ae1e-0f0f03dc2341 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:43.357067 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3b193b09-1bdd-4c25-ae1e-0f0f03dc2341 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:43.357067 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3b193b09-1bdd-4c25-ae1e-0f0f03dc2341 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:43.366389 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3b193b09-1bdd-4c25-ae1e-0f0f03dc2341 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:43.366870 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3b193b09-1bdd-4c25-ae1e-0f0f03dc2341 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:43.725025 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-20d383f3-8be6-4955-841f-381794db7195 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:43.735567 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-20d383f3-8be6-4955-841f-381794db7195 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d" status: 200 len: 1470 microversion: 2.1 time: 0.472384 Oct 23 01:13:43.741504 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 439/840] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:43 2022] GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d => generated 1470 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:43.755695 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-95aed0af-e62d-45d3-831a-2246c55fae6a req-d9587d1f-c5df-4e06-83ad-2b55a7ffe671 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93d46a54-c775-4fc6-ad62-edf53bee2d07", "tag": "5eb643b1-6a02-464c-baa5-53c3a3e51506"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:13:43.776994 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-95aed0af-e62d-45d3-831a-2246c55fae6a req-d9587d1f-c5df-4e06-83ad-2b55a7ffe671 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:43.777521 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-95aed0af-e62d-45d3-831a-2246c55fae6a req-d9587d1f-c5df-4e06-83ad-2b55a7ffe671 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:43.778133 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-95aed0af-e62d-45d3-831a-2246c55fae6a req-d9587d1f-c5df-4e06-83ad-2b55a7ffe671 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:43.792345 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-95aed0af-e62d-45d3-831a-2246c55fae6a req-d9587d1f-c5df-4e06-83ad-2b55a7ffe671 service nova] Creating event network-changed:5eb643b1-6a02-464c-baa5-53c3a3e51506 for instance 93d46a54-c775-4fc6-ad62-edf53bee2d07 on n-h2-master-1 Oct 23 01:13:43.797760 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-95aed0af-e62d-45d3-831a-2246c55fae6a req-d9587d1f-c5df-4e06-83ad-2b55a7ffe671 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053139 Oct 23 01:13:43.803497 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 440/841] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:13:43.804038 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3b193b09-1bdd-4c25-ae1e-0f0f03dc2341 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:43.805419 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-501906f7-c992-4583-b6f5-7d2312e87feb tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:43.806468 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-501906f7-c992-4583-b6f5-7d2312e87feb tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:43.813200 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3b193b09-1bdd-4c25-ae1e-0f0f03dc2341 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329" status: 200 len: 1472 microversion: 2.1 time: 0.489185 Oct 23 01:13:43.813789 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 402/842] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:43 2022] GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329 => generated 1472 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:43.830529 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-501906f7-c992-4583-b6f5-7d2312e87feb tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:43.831057 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-501906f7-c992-4583-b6f5-7d2312e87feb tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:43.831562 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-501906f7-c992-4583-b6f5-7d2312e87feb tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:43.832333 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-501906f7-c992-4583-b6f5-7d2312e87feb tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:43.833123 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-501906f7-c992-4583-b6f5-7d2312e87feb tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:43.833410 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-501906f7-c992-4583-b6f5-7d2312e87feb tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:43.908763 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-501906f7-c992-4583-b6f5-7d2312e87feb tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:43.921246 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-501906f7-c992-4583-b6f5-7d2312e87feb tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:43.930792 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-501906f7-c992-4583-b6f5-7d2312e87feb tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:43.939008 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-501906f7-c992-4583-b6f5-7d2312e87feb tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1537 microversion: 2.91 time: 0.139147 Oct 23 01:13:43.959487 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 441/843] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:43 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1537 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:13:44.017786 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dccff281-3730-45a0-b05e-eadd8baa14bb tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:44.021844 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-dccff281-3730-45a0-b05e-eadd8baa14bb tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 93d46a54-c775-4fc6-ad62-edf53bee2d07] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:44.027818 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dccff281-3730-45a0-b05e-eadd8baa14bb tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:44.028313 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dccff281-3730-45a0-b05e-eadd8baa14bb tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:44.028755 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dccff281-3730-45a0-b05e-eadd8baa14bb tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:44.029459 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dccff281-3730-45a0-b05e-eadd8baa14bb tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:44.034944 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dccff281-3730-45a0-b05e-eadd8baa14bb tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:44.035469 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dccff281-3730-45a0-b05e-eadd8baa14bb tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:44.106877 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c5143436-3b53-4caf-a156-0c1497b54aac tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:44.107505 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c5143436-3b53-4caf-a156-0c1497b54aac tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 283de315-fdcb-4c89-91e3-96aa3e822b21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:44.115541 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c5143436-3b53-4caf-a156-0c1497b54aac tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:44.116802 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c5143436-3b53-4caf-a156-0c1497b54aac tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:44.119469 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c5143436-3b53-4caf-a156-0c1497b54aac tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:44.120376 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c5143436-3b53-4caf-a156-0c1497b54aac tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:44.120999 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c5143436-3b53-4caf-a156-0c1497b54aac tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:44.121750 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c5143436-3b53-4caf-a156-0c1497b54aac tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:44.573459 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-dccff281-3730-45a0-b05e-eadd8baa14bb tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262d5984b8c4775b86fae1c0d314718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc8f8cefbf441c98d6bda76e99e3173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:44.583795 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-dccff281-3730-45a0-b05e-eadd8baa14bb tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07" status: 200 len: 1354 microversion: 2.1 time: 0.569651 Oct 23 01:13:44.584743 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 403/844] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:44 2022] GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07 => generated 1354 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:44.694719 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c5143436-3b53-4caf-a156-0c1497b54aac tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:44.719070 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c5143436-3b53-4caf-a156-0c1497b54aac tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:44.726666 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c5143436-3b53-4caf-a156-0c1497b54aac tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:44.727963 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c5143436-3b53-4caf-a156-0c1497b54aac tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21" status: 200 len: 1362 microversion: 2.25 time: 0.626674 Oct 23 01:13:44.730263 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 442/845] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:44 2022] GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21 => generated 1362 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:13:44.767741 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-beb92183-67c6-4255-b828-9555b48ea014 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:44.768864 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-beb92183-67c6-4255-b828-9555b48ea014 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: edb35c7d-9adc-4b53-9bef-147aadbeae5d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:44.778341 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-beb92183-67c6-4255-b828-9555b48ea014 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:44.779235 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-beb92183-67c6-4255-b828-9555b48ea014 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:44.780077 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-beb92183-67c6-4255-b828-9555b48ea014 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:44.781095 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-beb92183-67c6-4255-b828-9555b48ea014 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:44.781941 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-beb92183-67c6-4255-b828-9555b48ea014 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:44.782604 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-beb92183-67c6-4255-b828-9555b48ea014 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:44.839738 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-91350eb6-7e6e-4556-81ed-858cdb162cff tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:44.842197 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-91350eb6-7e6e-4556-81ed-858cdb162cff tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f277484-b3ae-465e-90b7-8febafef9329] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:44.850316 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-91350eb6-7e6e-4556-81ed-858cdb162cff tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:44.851192 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-91350eb6-7e6e-4556-81ed-858cdb162cff tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:44.851899 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-91350eb6-7e6e-4556-81ed-858cdb162cff tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:44.852826 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-91350eb6-7e6e-4556-81ed-858cdb162cff tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:44.853551 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-91350eb6-7e6e-4556-81ed-858cdb162cff tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:44.854230 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-91350eb6-7e6e-4556-81ed-858cdb162cff tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:45.646821 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-beb92183-67c6-4255-b828-9555b48ea014 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:45.659964 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-beb92183-67c6-4255-b828-9555b48ea014 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d" status: 200 len: 1470 microversion: 2.1 time: 0.898090 Oct 23 01:13:45.660859 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 404/846] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:44 2022] GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d => generated 1470 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:45.666860 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c8dc65e4-5f83-4fdc-b3f8-1c2b1064b311 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:45.667638 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c8dc65e4-5f83-4fdc-b3f8-1c2b1064b311 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:45.674236 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c8dc65e4-5f83-4fdc-b3f8-1c2b1064b311 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:45.674946 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c8dc65e4-5f83-4fdc-b3f8-1c2b1064b311 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:45.675537 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c8dc65e4-5f83-4fdc-b3f8-1c2b1064b311 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:45.676563 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c8dc65e4-5f83-4fdc-b3f8-1c2b1064b311 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:45.677174 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c8dc65e4-5f83-4fdc-b3f8-1c2b1064b311 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:45.677755 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c8dc65e4-5f83-4fdc-b3f8-1c2b1064b311 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:45.684323 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-91350eb6-7e6e-4556-81ed-858cdb162cff tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:45.693382 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-91350eb6-7e6e-4556-81ed-858cdb162cff tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329" status: 200 len: 1472 microversion: 2.1 time: 0.858212 Oct 23 01:13:45.694720 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 443/847] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:44 2022] GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329 => generated 1472 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:45.700797 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1f2e14e8-4696-4f00-8ebf-2d6d2b854886 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:45.703198 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1f2e14e8-4696-4f00-8ebf-2d6d2b854886 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 93d46a54-c775-4fc6-ad62-edf53bee2d07] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:45.708584 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1f2e14e8-4696-4f00-8ebf-2d6d2b854886 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:45.709374 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1f2e14e8-4696-4f00-8ebf-2d6d2b854886 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:45.710061 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1f2e14e8-4696-4f00-8ebf-2d6d2b854886 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:45.711763 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1f2e14e8-4696-4f00-8ebf-2d6d2b854886 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:45.712456 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1f2e14e8-4696-4f00-8ebf-2d6d2b854886 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:45.713113 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1f2e14e8-4696-4f00-8ebf-2d6d2b854886 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:45.899264 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c8dc65e4-5f83-4fdc-b3f8-1c2b1064b311 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:45.909277 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c8dc65e4-5f83-4fdc-b3f8-1c2b1064b311 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:45.910957 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c8dc65e4-5f83-4fdc-b3f8-1c2b1064b311 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:45.916652 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c8dc65e4-5f83-4fdc-b3f8-1c2b1064b311 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1537 microversion: 2.91 time: 0.254513 Oct 23 01:13:45.918827 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 405/848] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:45 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1537 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:13:45.924420 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a8e0dd6f-2ff5-46d0-bad9-63a5de479991 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:45.925320 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a8e0dd6f-2ff5-46d0-bad9-63a5de479991 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 283de315-fdcb-4c89-91e3-96aa3e822b21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:45.939217 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a8e0dd6f-2ff5-46d0-bad9-63a5de479991 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:45.939217 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a8e0dd6f-2ff5-46d0-bad9-63a5de479991 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:45.939217 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a8e0dd6f-2ff5-46d0-bad9-63a5de479991 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:45.940461 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a8e0dd6f-2ff5-46d0-bad9-63a5de479991 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:45.942093 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a8e0dd6f-2ff5-46d0-bad9-63a5de479991 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:45.942942 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a8e0dd6f-2ff5-46d0-bad9-63a5de479991 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:46.241204 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1f2e14e8-4696-4f00-8ebf-2d6d2b854886 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262d5984b8c4775b86fae1c0d314718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc8f8cefbf441c98d6bda76e99e3173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:46.252739 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1f2e14e8-4696-4f00-8ebf-2d6d2b854886 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07" status: 200 len: 1354 microversion: 2.1 time: 0.555937 Oct 23 01:13:46.254608 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 444/849] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:45 2022] GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07 => generated 1354 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:46.342967 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a8e0dd6f-2ff5-46d0-bad9-63a5de479991 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:46.352231 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a8e0dd6f-2ff5-46d0-bad9-63a5de479991 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:46.353816 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a8e0dd6f-2ff5-46d0-bad9-63a5de479991 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:46.354919 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a8e0dd6f-2ff5-46d0-bad9-63a5de479991 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21" status: 200 len: 1559 microversion: 2.25 time: 0.434802 Oct 23 01:13:46.356068 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 406/850] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:45 2022] GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21 => generated 1559 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:13:46.685893 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b5393ec3-cc31-4944-acb7-f77324c0826c tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:46.686873 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b5393ec3-cc31-4944-acb7-f77324c0826c tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: edb35c7d-9adc-4b53-9bef-147aadbeae5d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:46.689274 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-09b73b2c-a250-4275-9544-b308f8521507 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:46.692910 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-09b73b2c-a250-4275-9544-b308f8521507 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] [instance: 283de315-fdcb-4c89-91e3-96aa3e822b21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:46.694445 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5393ec3-cc31-4944-acb7-f77324c0826c tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:46.695422 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5393ec3-cc31-4944-acb7-f77324c0826c tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:46.696067 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5393ec3-cc31-4944-acb7-f77324c0826c tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:46.696786 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5393ec3-cc31-4944-acb7-f77324c0826c tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:46.697250 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5393ec3-cc31-4944-acb7-f77324c0826c tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:46.697683 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5393ec3-cc31-4944-acb7-f77324c0826c tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:46.710874 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09b73b2c-a250-4275-9544-b308f8521507 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:46.712245 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09b73b2c-a250-4275-9544-b308f8521507 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:46.713062 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09b73b2c-a250-4275-9544-b308f8521507 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:46.714589 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09b73b2c-a250-4275-9544-b308f8521507 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:46.715949 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09b73b2c-a250-4275-9544-b308f8521507 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:46.718465 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09b73b2c-a250-4275-9544-b308f8521507 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:47.045249 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b5393ec3-cc31-4944-acb7-f77324c0826c tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:47.074007 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b5393ec3-cc31-4944-acb7-f77324c0826c tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d" status: 200 len: 1475 microversion: 2.1 time: 0.389171 Oct 23 01:13:47.086980 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 407/851] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:46 2022] GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d => generated 1475 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:47.095411 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9cf07e10-667e-43bb-9263-b3bca6db512e tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:47.096322 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9cf07e10-667e-43bb-9263-b3bca6db512e tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f277484-b3ae-465e-90b7-8febafef9329] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:47.104086 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9cf07e10-667e-43bb-9263-b3bca6db512e tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:47.104798 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9cf07e10-667e-43bb-9263-b3bca6db512e tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:47.106074 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9cf07e10-667e-43bb-9263-b3bca6db512e tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:47.106982 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9cf07e10-667e-43bb-9263-b3bca6db512e tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:47.107621 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9cf07e10-667e-43bb-9263-b3bca6db512e tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:47.108212 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9cf07e10-667e-43bb-9263-b3bca6db512e tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:47.153279 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-09b73b2c-a250-4275-9544-b308f8521507 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lazy-loading 'services' on Instance uuid 283de315-fdcb-4c89-91e3-96aa3e822b21 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:13:47.177306 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-09b73b2c-a250-4275-9544-b308f8521507 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21" status: 200 len: 2052 microversion: 2.25 time: 0.800292 Oct 23 01:13:47.179121 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 445/852] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:46 2022] GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21 => generated 2052 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:13:47.185123 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-1b9b181b-f9db-4b00-aeb2-a76a4292d366 req-7e4cddf3-d798-4a08-8ef2-5fc48aeb220b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93d46a54-c775-4fc6-ad62-edf53bee2d07", "tag": "ee7f635a-8006-4ea3-ba81-b986f1e60bfa"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:13:47.205772 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-1b9b181b-f9db-4b00-aeb2-a76a4292d366 req-7e4cddf3-d798-4a08-8ef2-5fc48aeb220b service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:47.210465 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-1b9b181b-f9db-4b00-aeb2-a76a4292d366 req-7e4cddf3-d798-4a08-8ef2-5fc48aeb220b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:47.210465 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-1b9b181b-f9db-4b00-aeb2-a76a4292d366 req-7e4cddf3-d798-4a08-8ef2-5fc48aeb220b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:47.231029 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-1b9b181b-f9db-4b00-aeb2-a76a4292d366 req-7e4cddf3-d798-4a08-8ef2-5fc48aeb220b service nova] Creating event network-changed:ee7f635a-8006-4ea3-ba81-b986f1e60bfa for instance 93d46a54-c775-4fc6-ad62-edf53bee2d07 on n-h2-master-1 Oct 23 01:13:47.236874 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-1b9b181b-f9db-4b00-aeb2-a76a4292d366 req-7e4cddf3-d798-4a08-8ef2-5fc48aeb220b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055349 Oct 23 01:13:47.237625 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 446/853] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:13:47.243849 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ff1b709e-cb33-42b1-88ae-4725c79e4147 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:47.244806 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ff1b709e-cb33-42b1-88ae-4725c79e4147 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:47.253396 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ff1b709e-cb33-42b1-88ae-4725c79e4147 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:47.254049 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ff1b709e-cb33-42b1-88ae-4725c79e4147 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:47.256199 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ff1b709e-cb33-42b1-88ae-4725c79e4147 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:47.256199 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ff1b709e-cb33-42b1-88ae-4725c79e4147 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:47.256199 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ff1b709e-cb33-42b1-88ae-4725c79e4147 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:47.256495 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ff1b709e-cb33-42b1-88ae-4725c79e4147 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:47.405718 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ff1b709e-cb33-42b1-88ae-4725c79e4147 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:47.421644 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ff1b709e-cb33-42b1-88ae-4725c79e4147 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:47.427650 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ff1b709e-cb33-42b1-88ae-4725c79e4147 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:47.461591 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ff1b709e-cb33-42b1-88ae-4725c79e4147 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1537 microversion: 2.91 time: 0.220902 Oct 23 01:13:47.467251 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 447/854] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:47 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1537 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:13:47.484860 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e44b5bb1-82a0-4021-a40d-0254c0f7032a tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:47.485868 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e44b5bb1-82a0-4021-a40d-0254c0f7032a tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] [instance: 283de315-fdcb-4c89-91e3-96aa3e822b21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:47.503567 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e44b5bb1-82a0-4021-a40d-0254c0f7032a tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:47.503567 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e44b5bb1-82a0-4021-a40d-0254c0f7032a tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:47.504656 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e44b5bb1-82a0-4021-a40d-0254c0f7032a tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:47.506933 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e44b5bb1-82a0-4021-a40d-0254c0f7032a tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:47.507354 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e44b5bb1-82a0-4021-a40d-0254c0f7032a tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:47.508341 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e44b5bb1-82a0-4021-a40d-0254c0f7032a tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:47.515663 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9cf07e10-667e-43bb-9263-b3bca6db512e tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:47.529720 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9cf07e10-667e-43bb-9263-b3bca6db512e tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329" status: 200 len: 1472 microversion: 2.1 time: 0.441586 Oct 23 01:13:47.532921 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 408/855] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:47 2022] GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329 => generated 1472 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:47.546029 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8ad3ddc5-a122-4f28-86ff-45f3ea275f5d tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:47.548452 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8ad3ddc5-a122-4f28-86ff-45f3ea275f5d tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 93d46a54-c775-4fc6-ad62-edf53bee2d07] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:47.557730 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ad3ddc5-a122-4f28-86ff-45f3ea275f5d tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:47.560611 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ad3ddc5-a122-4f28-86ff-45f3ea275f5d tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:47.560611 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ad3ddc5-a122-4f28-86ff-45f3ea275f5d tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:47.560611 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ad3ddc5-a122-4f28-86ff-45f3ea275f5d tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:47.560611 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ad3ddc5-a122-4f28-86ff-45f3ea275f5d tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:47.560977 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ad3ddc5-a122-4f28-86ff-45f3ea275f5d tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:47.967015 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8ad3ddc5-a122-4f28-86ff-45f3ea275f5d tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262d5984b8c4775b86fae1c0d314718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc8f8cefbf441c98d6bda76e99e3173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:47.974941 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8ad3ddc5-a122-4f28-86ff-45f3ea275f5d tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07" status: 200 len: 1354 microversion: 2.1 time: 0.440761 Oct 23 01:13:47.989461 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-e44b5bb1-82a0-4021-a40d-0254c0f7032a tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lazy-loading 'services' on Instance uuid 283de315-fdcb-4c89-91e3-96aa3e822b21 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:13:47.990934 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 409/856] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:47 2022] GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07 => generated 1354 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:48.007863 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e44b5bb1-82a0-4021-a40d-0254c0f7032a tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21" status: 200 len: 2052 microversion: 2.25 time: 0.538004 Oct 23 01:13:48.008990 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 448/857] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:47 2022] GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21 => generated 2052 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:13:48.038694 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-25351cc0-e954-403d-93fa-790afa5b1930 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:48.044013 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25351cc0-e954-403d-93fa-790afa5b1930 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:48.051458 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25351cc0-e954-403d-93fa-790afa5b1930 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:48.051908 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25351cc0-e954-403d-93fa-790afa5b1930 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:48.052695 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25351cc0-e954-403d-93fa-790afa5b1930 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:48.053152 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25351cc0-e954-403d-93fa-790afa5b1930 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:48.053757 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25351cc0-e954-403d-93fa-790afa5b1930 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:48.097587 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-25351cc0-e954-403d-93fa-790afa5b1930 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.064165 Oct 23 01:13:48.098713 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 410/858] 10.222.0.42 () {60 vars in 1217 bytes} [Sun Oct 23 01:13:48 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 23 01:13:48.100941 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ad66be94-8ce1-4163-aae7-4e4351fee51f tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:48.103199 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ad66be94-8ce1-4163-aae7-4e4351fee51f tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: edb35c7d-9adc-4b53-9bef-147aadbeae5d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:48.113073 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d6331082-1b94-439f-9816-99f8ffd9cc43 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": "auto"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:13:48.116214 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d6331082-1b94-439f-9816-99f8ffd9cc43 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] [instance: 283de315-fdcb-4c89-91e3-96aa3e822b21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:48.119508 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ad66be94-8ce1-4163-aae7-4e4351fee51f tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:48.123431 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ad66be94-8ce1-4163-aae7-4e4351fee51f tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:48.124121 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ad66be94-8ce1-4163-aae7-4e4351fee51f tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:48.126006 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ad66be94-8ce1-4163-aae7-4e4351fee51f tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:48.127966 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ad66be94-8ce1-4163-aae7-4e4351fee51f tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:48.139173 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d6331082-1b94-439f-9816-99f8ffd9cc43 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:48.139684 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d6331082-1b94-439f-9816-99f8ffd9cc43 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:48.140123 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d6331082-1b94-439f-9816-99f8ffd9cc43 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:48.142798 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d6331082-1b94-439f-9816-99f8ffd9cc43 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:48.143290 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d6331082-1b94-439f-9816-99f8ffd9cc43 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:48.143735 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d6331082-1b94-439f-9816-99f8ffd9cc43 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:48.149279 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ad66be94-8ce1-4163-aae7-4e4351fee51f tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:48.161912 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:48.189947 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-d6331082-1b94-439f-9816-99f8ffd9cc43 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lazy-loading 'flavor' on Instance uuid 283de315-fdcb-4c89-91e3-96aa3e822b21 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:13:48.203888 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d6331082-1b94-439f-9816-99f8ffd9cc43 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] [instance: 283de315-fdcb-4c89-91e3-96aa3e822b21] Going to try to live migrate instance to n-h1-master-1 {{(pid=120944) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 23 01:13:48.224797 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=100 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:48.562341 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ad66be94-8ce1-4163-aae7-4e4351fee51f tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:48.570227 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ad66be94-8ce1-4163-aae7-4e4351fee51f tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d" status: 200 len: 1475 microversion: 2.1 time: 0.474348 Oct 23 01:13:48.570835 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 449/859] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:48 2022] GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d => generated 1475 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:13:48.575714 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e0398d90-383b-49c1-b221-197d65fa7885 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:48.577841 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e0398d90-383b-49c1-b221-197d65fa7885 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:48.584264 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e0398d90-383b-49c1-b221-197d65fa7885 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:48.584763 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e0398d90-383b-49c1-b221-197d65fa7885 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:48.585308 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e0398d90-383b-49c1-b221-197d65fa7885 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:48.586555 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e0398d90-383b-49c1-b221-197d65fa7885 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:48.587017 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e0398d90-383b-49c1-b221-197d65fa7885 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:48.587445 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e0398d90-383b-49c1-b221-197d65fa7885 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:48.673854 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e0398d90-383b-49c1-b221-197d65fa7885 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:48.682034 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e0398d90-383b-49c1-b221-197d65fa7885 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:48.683517 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e0398d90-383b-49c1-b221-197d65fa7885 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:48.688652 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e0398d90-383b-49c1-b221-197d65fa7885 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1537 microversion: 2.91 time: 0.116642 Oct 23 01:13:48.689230 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 450/860] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:48 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1537 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:13:48.693763 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-439da88f-6f21-4c05-86ed-9afd37f6ce52 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:48.694403 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-439da88f-6f21-4c05-86ed-9afd37f6ce52 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f277484-b3ae-465e-90b7-8febafef9329] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:48.722386 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-439da88f-6f21-4c05-86ed-9afd37f6ce52 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:48.723221 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-439da88f-6f21-4c05-86ed-9afd37f6ce52 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:48.723960 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-439da88f-6f21-4c05-86ed-9afd37f6ce52 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:48.725091 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-439da88f-6f21-4c05-86ed-9afd37f6ce52 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:48.725746 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-439da88f-6f21-4c05-86ed-9afd37f6ce52 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:48.726656 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-439da88f-6f21-4c05-86ed-9afd37f6ce52 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:49.069552 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-439da88f-6f21-4c05-86ed-9afd37f6ce52 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:49.079070 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-439da88f-6f21-4c05-86ed-9afd37f6ce52 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329" status: 200 len: 1478 microversion: 2.1 time: 0.388754 Oct 23 01:13:49.079881 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 451/861] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:48 2022] GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329 => generated 1478 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:49.084800 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2fa6a1b1-4855-426e-9b27-8802f596f066 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:49.085641 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2fa6a1b1-4855-426e-9b27-8802f596f066 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 93d46a54-c775-4fc6-ad62-edf53bee2d07] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:49.092160 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2fa6a1b1-4855-426e-9b27-8802f596f066 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:49.092898 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2fa6a1b1-4855-426e-9b27-8802f596f066 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:49.093518 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2fa6a1b1-4855-426e-9b27-8802f596f066 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:49.094498 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2fa6a1b1-4855-426e-9b27-8802f596f066 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:49.095138 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2fa6a1b1-4855-426e-9b27-8802f596f066 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:49.095774 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2fa6a1b1-4855-426e-9b27-8802f596f066 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:49.360976 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2fa6a1b1-4855-426e-9b27-8802f596f066 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262d5984b8c4775b86fae1c0d314718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc8f8cefbf441c98d6bda76e99e3173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:49.378444 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2fa6a1b1-4855-426e-9b27-8802f596f066 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07" status: 200 len: 1354 microversion: 2.1 time: 0.296371 Oct 23 01:13:49.379058 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 452/862] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:49 2022] GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07 => generated 1354 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:49.684646 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-729aade8-c08f-49c2-a88e-674241cc54b5 tempest-FloatingIPsNegativeTestJSON-420792309 tempest-FloatingIPsNegativeTestJSON-420792309-project] Calling method '.version_select at 0x7f5cc21205e0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:50.032315 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-729aade8-c08f-49c2-a88e-674241cc54b5 tempest-FloatingIPsNegativeTestJSON-420792309 tempest-FloatingIPsNegativeTestJSON-420792309-project] 10.222.0.42 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.652177 Oct 23 01:13:50.032895 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 453/863] 10.222.0.42 () {58 vars in 1149 bytes} [Sun Oct 23 01:13:49 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:13:50.037649 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-ec9dc0ef-d862-483b-af75-ee240c4246bb req-a56d246b-dcb3-496e-ba0b-6f56d59b8532 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93d46a54-c775-4fc6-ad62-edf53bee2d07", "tag": "f15809ec-ef23-47b5-8334-7596b75bba15"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:13:50.054319 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ec9dc0ef-d862-483b-af75-ee240c4246bb req-a56d246b-dcb3-496e-ba0b-6f56d59b8532 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:50.061107 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ec9dc0ef-d862-483b-af75-ee240c4246bb req-a56d246b-dcb3-496e-ba0b-6f56d59b8532 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:50.061596 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ec9dc0ef-d862-483b-af75-ee240c4246bb req-a56d246b-dcb3-496e-ba0b-6f56d59b8532 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:50.074350 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-ec9dc0ef-d862-483b-af75-ee240c4246bb req-a56d246b-dcb3-496e-ba0b-6f56d59b8532 service nova] Creating event network-changed:f15809ec-ef23-47b5-8334-7596b75bba15 for instance 93d46a54-c775-4fc6-ad62-edf53bee2d07 on n-h2-master-1 Oct 23 01:13:50.079494 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-ec9dc0ef-d862-483b-af75-ee240c4246bb req-a56d246b-dcb3-496e-ba0b-6f56d59b8532 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045229 Oct 23 01:13:50.080598 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 454/864] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:13:50.085886 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-098c2dcc-e817-4e75-bd65-abe4ec02952d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:50.086926 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-098c2dcc-e817-4e75-bd65-abe4ec02952d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: edb35c7d-9adc-4b53-9bef-147aadbeae5d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:50.093155 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-098c2dcc-e817-4e75-bd65-abe4ec02952d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:50.093651 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-098c2dcc-e817-4e75-bd65-abe4ec02952d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:50.094177 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-098c2dcc-e817-4e75-bd65-abe4ec02952d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:50.095801 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-098c2dcc-e817-4e75-bd65-abe4ec02952d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:50.096621 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-098c2dcc-e817-4e75-bd65-abe4ec02952d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:50.097265 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-098c2dcc-e817-4e75-bd65-abe4ec02952d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:50.319963 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-098c2dcc-e817-4e75-bd65-abe4ec02952d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:50.327949 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-098c2dcc-e817-4e75-bd65-abe4ec02952d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d" status: 200 len: 1475 microversion: 2.1 time: 0.246186 Oct 23 01:13:50.328464 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 455/865] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:50 2022] GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d => generated 1475 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:50.333056 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cefef9c7-fc46-4271-8a00-604d9acdbe0f tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:50.333926 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cefef9c7-fc46-4271-8a00-604d9acdbe0f tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:50.339688 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cefef9c7-fc46-4271-8a00-604d9acdbe0f tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:50.340168 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cefef9c7-fc46-4271-8a00-604d9acdbe0f tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:50.340701 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cefef9c7-fc46-4271-8a00-604d9acdbe0f tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:50.341392 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cefef9c7-fc46-4271-8a00-604d9acdbe0f tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:50.341845 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cefef9c7-fc46-4271-8a00-604d9acdbe0f tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:50.342355 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cefef9c7-fc46-4271-8a00-604d9acdbe0f tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:50.416575 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cefef9c7-fc46-4271-8a00-604d9acdbe0f tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:50.427514 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cefef9c7-fc46-4271-8a00-604d9acdbe0f tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:50.429409 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cefef9c7-fc46-4271-8a00-604d9acdbe0f tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:50.435745 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cefef9c7-fc46-4271-8a00-604d9acdbe0f tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1537 microversion: 2.91 time: 0.106295 Oct 23 01:13:50.436638 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 456/866] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:50 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1537 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:13:50.441615 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-88bc9436-883c-4374-83a7-ab615cf78140 tempest-FloatingIPsNegativeTestJSON-420792309 tempest-FloatingIPsNegativeTestJSON-420792309-project] Action: 'create', calling method: .version_select at 0x7f5cc210a4c0>, body: {"pool": "non_exist_pool"} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:13:50.503682 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-88bc9436-883c-4374-83a7-ab615cf78140 tempest-FloatingIPsNegativeTestJSON-420792309 tempest-FloatingIPsNegativeTestJSON-420792309-project] HTTP exception thrown: Floating IP pool not found. Oct 23 01:13:50.507899 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-88bc9436-883c-4374-83a7-ab615cf78140 tempest-FloatingIPsNegativeTestJSON-420792309 tempest-FloatingIPsNegativeTestJSON-420792309-project] Request method failure captured: Oct 23 01:13:50.507899 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 23 01:13:50.507899 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:13:50.507899 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:13:50.507899 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:13:50.507899 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 26 Oct 23 01:13:50.507899 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:13:50.507899 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:13:50.507899 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:13:50.507899 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:13:50.507899 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJVNKKuEQOZdLzza0agABsUWeR80UHhE3c8xTtUQAsZ2AasSMxiUl9xjKHZhCuWtbCMl0lssFCfdkcwCiGhCxx-asrb79PT212LOpHOgt9KayJk-k50RfAEJGdWUmSgPjfl5DLMLbyGvBy1XpjjZbN_4XQCTB6nVbBtAkYY5eQUfI5M Oct 23 01:13:50.507899 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:13:50.507899 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:13:50.507899 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:13:50.507899 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:13:50.507899 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:13:50.507899 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:13:50.507899 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 2ad6b5ca34db4733aad82c3b2c1daed2 Oct 23 01:13:50.507899 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-420792309 Oct 23 01:13:50.507899 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:13:50.507899 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:13:50.509637 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2ad6b5ca34db4733aad82c3b2c1daed2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2ad6b5ca34db4733aad82c3b2c1daed2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2ad6b5ca34db4733aad82c3b2c1daed2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2ad6b5ca34db4733aad82c3b2c1daed2"}]}] Oct 23 01:13:50.509637 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-420792309 Oct 23 01:13:50.509637 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 2ad6b5ca34db4733aad82c3b2c1daed2 Oct 23 01:13:50.509637 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-420792309 Oct 23 01:13:50.509637 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-FloatingIPsNegativeTestJSON-420792309-project Oct 23 01:13:50.509637 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:13:50.509637 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:13:50.509637 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 571f9656cbdd469896bdf80dc87fb54c Oct 23 01:13:50.509637 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-420792309-project Oct 23 01:13:50.509637 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:13:50.509637 n-d-master-1 devstack@n-api.service[120945]: {"pool": "non_exist_pool"} Oct 23 01:13:50.509637 n-d-master-1 devstack@n-api.service[120945]: method: Oct 23 01:13:50.509637 n-d-master-1 devstack@n-api.service[120945]: exception: Floating IP pool not found. Oct 23 01:13:50.509637 n-d-master-1 devstack@n-api.service[120945]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 23 01:13:50.509637 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:13:50.510864 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:13:50.510864 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 23 01:13:50.510864 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 23 01:13:50.510864 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 23 01:13:50.510864 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 23 01:13:50.510864 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 23 01:13:50.510864 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 23 01:13:50.510864 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 23 01:13:50.510864 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:13:50.510864 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:13:50.510864 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:13:50.510864 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:13:50.510864 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:13:50.510864 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:13:50.510864 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:13:50.510864 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:13:50.510864 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:13:50.510864 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:13:50.510864 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:13:50.510864 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:13:50.512375 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 23 01:13:50.512375 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:13:50.512375 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 23 01:13:50.512375 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:13:50.512375 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:13:50.512375 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:13:50.512375 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:13:50.512375 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:13:50.512375 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:13:50.512375 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:13:50.512375 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:13:50.512375 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 23 01:13:50.512375 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:13:50.512375 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-88bc9436-883c-4374-83a7-ab615cf78140 tempest-FloatingIPsNegativeTestJSON-420792309 tempest-FloatingIPsNegativeTestJSON-420792309-project] Returning 404 to user: Floating IP pool not found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:13:50.512375 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-88bc9436-883c-4374-83a7-ab615cf78140 tempest-FloatingIPsNegativeTestJSON-420792309 tempest-FloatingIPsNegativeTestJSON-420792309-project] 10.222.0.42 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.069461 Oct 23 01:13:50.521687 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 457/867] 10.222.0.42 () {60 vars in 1170 bytes} [Sun Oct 23 01:13:50 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:13:50.533562 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-73a12311-3949-4a49-b300-a16c1bb1a22a tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:50.536941 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-73a12311-3949-4a49-b300-a16c1bb1a22a tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f277484-b3ae-465e-90b7-8febafef9329] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:50.546040 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-73a12311-3949-4a49-b300-a16c1bb1a22a tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:50.546785 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-73a12311-3949-4a49-b300-a16c1bb1a22a tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:50.547389 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-73a12311-3949-4a49-b300-a16c1bb1a22a tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:50.548532 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-73a12311-3949-4a49-b300-a16c1bb1a22a tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:50.550191 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-73a12311-3949-4a49-b300-a16c1bb1a22a tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:50.550804 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-73a12311-3949-4a49-b300-a16c1bb1a22a tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:50.737961 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-73a12311-3949-4a49-b300-a16c1bb1a22a tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:50.751337 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-73a12311-3949-4a49-b300-a16c1bb1a22a tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329" status: 200 len: 1478 microversion: 2.1 time: 0.225483 Oct 23 01:13:50.752836 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 458/868] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:50 2022] GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329 => generated 1478 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:50.762363 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a9549bde-1fd1-4cbf-b199-0cb5deac6033 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:50.764160 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a9549bde-1fd1-4cbf-b199-0cb5deac6033 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 93d46a54-c775-4fc6-ad62-edf53bee2d07] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:50.774186 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9549bde-1fd1-4cbf-b199-0cb5deac6033 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:50.774985 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9549bde-1fd1-4cbf-b199-0cb5deac6033 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:50.775710 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9549bde-1fd1-4cbf-b199-0cb5deac6033 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:50.776445 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9549bde-1fd1-4cbf-b199-0cb5deac6033 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:50.777071 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9549bde-1fd1-4cbf-b199-0cb5deac6033 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:50.777519 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9549bde-1fd1-4cbf-b199-0cb5deac6033 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:51.094850 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a9549bde-1fd1-4cbf-b199-0cb5deac6033 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262d5984b8c4775b86fae1c0d314718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc8f8cefbf441c98d6bda76e99e3173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:51.104997 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a9549bde-1fd1-4cbf-b199-0cb5deac6033 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07" status: 200 len: 1354 microversion: 2.1 time: 0.350275 Oct 23 01:13:51.105664 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 459/869] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:50 2022] GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07 => generated 1354 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:51.114787 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9e0f3865-9f0b-4877-a4ff-28244256b704 tempest-FloatingIPsNegativeTestJSON-420792309 tempest-FloatingIPsNegativeTestJSON-420792309-project] Calling method '.version_select at 0x7f5cc210ac10>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:51.212057 n-d-master-1 devstack@n-api.service[120945]: DEBUG neutronclient.v2_0.client [None req-9e0f3865-9f0b-4877-a4ff-28244256b704 tempest-FloatingIPsNegativeTestJSON-420792309 tempest-FloatingIPsNegativeTestJSON-420792309-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 735ba434-ca9d-4484-87cc-588f8dd2d29c could not be found", "detail": ""}} {{(pid=120945) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 23 01:13:51.212879 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-9e0f3865-9f0b-4877-a4ff-28244256b704 tempest-FloatingIPsNegativeTestJSON-420792309 tempest-FloatingIPsNegativeTestJSON-420792309-project] HTTP exception thrown: Floating IP not found for ID 735ba434-ca9d-4484-87cc-588f8dd2d29c Oct 23 01:13:51.215808 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9e0f3865-9f0b-4877-a4ff-28244256b704 tempest-FloatingIPsNegativeTestJSON-420792309 tempest-FloatingIPsNegativeTestJSON-420792309-project] Request method failure captured: Oct 23 01:13:51.215808 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/os-floating-ips/735ba434-ca9d-4484-87cc-588f8dd2d29c HTTP/1.1 Oct 23 01:13:51.215808 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:13:51.215808 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:13:51.215808 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:13:51.215808 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:13:51.215808 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:13:51.215808 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:13:51.215808 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:13:51.215808 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:13:51.215808 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJVNKKuEQOZdLzza0agABsUWeR80UHhE3c8xTtUQAsZ2AasSMxiUl9xjKHZhCuWtbCMl0lssFCfdkcwCiGhCxx-asrb79PT212LOpHOgt9KayJk-k50RfAEJGdWUmSgPjfl5DLMLbyGvBy1XpjjZbN_4XQCTB6nVbBtAkYY5eQUfI5M Oct 23 01:13:51.215808 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:13:51.215808 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:13:51.215808 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:13:51.215808 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:13:51.215808 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:13:51.215808 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:13:51.215808 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 2ad6b5ca34db4733aad82c3b2c1daed2 Oct 23 01:13:51.215808 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-420792309 Oct 23 01:13:51.215808 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:13:51.215808 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:13:51.217571 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2ad6b5ca34db4733aad82c3b2c1daed2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2ad6b5ca34db4733aad82c3b2c1daed2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2ad6b5ca34db4733aad82c3b2c1daed2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2ad6b5ca34db4733aad82c3b2c1daed2"}]}] Oct 23 01:13:51.217571 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-420792309 Oct 23 01:13:51.217571 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 2ad6b5ca34db4733aad82c3b2c1daed2 Oct 23 01:13:51.217571 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-420792309 Oct 23 01:13:51.217571 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-FloatingIPsNegativeTestJSON-420792309-project Oct 23 01:13:51.217571 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:13:51.217571 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:13:51.217571 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 571f9656cbdd469896bdf80dc87fb54c Oct 23 01:13:51.217571 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-420792309-project Oct 23 01:13:51.217571 n-d-master-1 devstack@n-api.service[120945]: method: Oct 23 01:13:51.217571 n-d-master-1 devstack@n-api.service[120945]: exception: Floating IP not found for ID 735ba434-ca9d-4484-87cc-588f8dd2d29c Oct 23 01:13:51.217571 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '735ba434-ca9d-4484-87cc-588f8dd2d29c'} Oct 23 01:13:51.217571 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:13:51.218791 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:13:51.218791 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 23 01:13:51.218791 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 23 01:13:51.218791 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:13:51.218791 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:13:51.218791 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 23 01:13:51.218791 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 23 01:13:51.218791 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:13:51.218791 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:13:51.218791 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 23 01:13:51.218791 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 23 01:13:51.218791 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:13:51.218791 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:13:51.218791 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 23 01:13:51.218791 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 23 01:13:51.218791 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:13:51.218791 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:13:51.218791 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 23 01:13:51.218791 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 23 01:13:51.220062 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:13:51.220062 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:13:51.220062 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 23 01:13:51.220062 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 23 01:13:51.220062 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 23 01:13:51.220062 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 23 01:13:51.220062 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 735ba434-ca9d-4484-87cc-588f8dd2d29c could not be found Oct 23 01:13:51.220062 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c699423-9d3b-4255-9d8f-818f4b408757'] Oct 23 01:13:51.220062 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:13:51.220062 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:13:51.220062 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:13:51.220062 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:13:51.220062 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 23 01:13:51.220062 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 23 01:13:51.220062 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 23 01:13:51.220062 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 23 01:13:51.220062 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 735ba434-ca9d-4484-87cc-588f8dd2d29c. Oct 23 01:13:51.220062 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:13:51.220062 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:13:51.220062 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:13:51.221247 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:13:51.221247 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:13:51.221247 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:13:51.221247 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:13:51.221247 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:13:51.221247 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:13:51.221247 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:13:51.221247 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:13:51.221247 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:13:51.221247 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 23 01:13:51.221247 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 23 01:13:51.221247 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 735ba434-ca9d-4484-87cc-588f8dd2d29c Oct 23 01:13:51.221247 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:13:51.221247 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:13:51.221247 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:13:51.221247 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:13:51.221247 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:13:51.221247 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:13:51.221247 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:13:51.221247 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:13:51.222611 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 735ba434-ca9d-4484-87cc-588f8dd2d29c Oct 23 01:13:51.222611 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:13:51.222611 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9e0f3865-9f0b-4877-a4ff-28244256b704 tempest-FloatingIPsNegativeTestJSON-420792309 tempest-FloatingIPsNegativeTestJSON-420792309-project] Returning 404 to user: Floating IP not found for ID 735ba434-ca9d-4484-87cc-588f8dd2d29c {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:13:51.222611 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9e0f3865-9f0b-4877-a4ff-28244256b704 tempest-FloatingIPsNegativeTestJSON-420792309 tempest-FloatingIPsNegativeTestJSON-420792309-project] 10.222.0.42 "DELETE /compute/v2.1/os-floating-ips/735ba434-ca9d-4484-87cc-588f8dd2d29c" status: 404 len: 111 microversion: 2.1 time: 0.111709 Oct 23 01:13:51.222611 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 460/870] 10.222.0.42 () {58 vars in 1263 bytes} [Sun Oct 23 01:13:51 2022] DELETE /compute/v2.1/os-floating-ips/735ba434-ca9d-4484-87cc-588f8dd2d29c => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:13:51.357227 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-057d2964-9614-4f8e-9544-fb93319f7601 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:51.358338 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-057d2964-9614-4f8e-9544-fb93319f7601 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: edb35c7d-9adc-4b53-9bef-147aadbeae5d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:51.376118 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-057d2964-9614-4f8e-9544-fb93319f7601 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:51.376613 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-057d2964-9614-4f8e-9544-fb93319f7601 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:51.383284 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-057d2964-9614-4f8e-9544-fb93319f7601 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:51.384142 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-057d2964-9614-4f8e-9544-fb93319f7601 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:51.384754 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-057d2964-9614-4f8e-9544-fb93319f7601 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:51.385193 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-057d2964-9614-4f8e-9544-fb93319f7601 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:51.792329 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-057d2964-9614-4f8e-9544-fb93319f7601 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:51.801919 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-057d2964-9614-4f8e-9544-fb93319f7601 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d" status: 200 len: 1475 microversion: 2.1 time: 0.453621 Oct 23 01:13:51.803672 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 461/871] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:51 2022] GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d => generated 1475 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:13:51.809113 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-114d1564-5fe4-45e0-9add-4adf3a1348e3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:51.809946 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-114d1564-5fe4-45e0-9add-4adf3a1348e3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:51.817767 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-114d1564-5fe4-45e0-9add-4adf3a1348e3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:51.819381 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-114d1564-5fe4-45e0-9add-4adf3a1348e3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:51.819381 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-114d1564-5fe4-45e0-9add-4adf3a1348e3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:51.821026 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-114d1564-5fe4-45e0-9add-4adf3a1348e3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:51.821632 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-114d1564-5fe4-45e0-9add-4adf3a1348e3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:51.822294 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-114d1564-5fe4-45e0-9add-4adf3a1348e3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:51.932352 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-114d1564-5fe4-45e0-9add-4adf3a1348e3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:51.941524 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-114d1564-5fe4-45e0-9add-4adf3a1348e3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:51.943918 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-114d1564-5fe4-45e0-9add-4adf3a1348e3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:51.950823 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-114d1564-5fe4-45e0-9add-4adf3a1348e3 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1558 microversion: 2.91 time: 0.145748 Oct 23 01:13:51.951763 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 462/872] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:51 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:13:52.148549 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2d0d0249-c4f4-4ecb-98ba-e69539ae542d tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-46743656", "id": 123034751, "os-flavor-access:is_public": "True"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:13:52.225079 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2d0d0249-c4f4-4ecb-98ba-e69539ae542d tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.271369 Oct 23 01:13:52.234070 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 463/873] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:13:51 2022] POST /compute/v2.1/flavors => generated 425 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:13:52.237033 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-77dbfd8b-86cf-47e2-b057-70bb441930db tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:52.237660 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-77dbfd8b-86cf-47e2-b057-70bb441930db tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f277484-b3ae-465e-90b7-8febafef9329] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:52.244965 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-77dbfd8b-86cf-47e2-b057-70bb441930db tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:52.245699 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-77dbfd8b-86cf-47e2-b057-70bb441930db tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:52.246177 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-77dbfd8b-86cf-47e2-b057-70bb441930db tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:52.258645 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-77dbfd8b-86cf-47e2-b057-70bb441930db tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:52.258645 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-77dbfd8b-86cf-47e2-b057-70bb441930db tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:52.258645 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-77dbfd8b-86cf-47e2-b057-70bb441930db tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:52.425460 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-77dbfd8b-86cf-47e2-b057-70bb441930db tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:52.434560 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-77dbfd8b-86cf-47e2-b057-70bb441930db tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329" status: 200 len: 1463 microversion: 2.1 time: 0.206352 Oct 23 01:13:52.435070 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 464/874] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:52 2022] GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329 => generated 1463 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:52.439606 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a2ccffa2-aa60-4578-9a36-037470523fe7 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:52.440207 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a2ccffa2-aa60-4578-9a36-037470523fe7 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 93d46a54-c775-4fc6-ad62-edf53bee2d07] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:52.446197 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a2ccffa2-aa60-4578-9a36-037470523fe7 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:52.446680 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a2ccffa2-aa60-4578-9a36-037470523fe7 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:52.447111 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a2ccffa2-aa60-4578-9a36-037470523fe7 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:52.447857 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a2ccffa2-aa60-4578-9a36-037470523fe7 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:52.448321 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a2ccffa2-aa60-4578-9a36-037470523fe7 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:52.448737 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a2ccffa2-aa60-4578-9a36-037470523fe7 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:52.451284 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d6331082-1b94-439f-9816-99f8ffd9cc43 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21/action" status: 202 len: 0 microversion: 2.25 time: 4.343280 Oct 23 01:13:52.451888 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 411/875] 10.222.0.42 () {62 vars in 1319 bytes} [Sun Oct 23 01:13:48 2022] POST /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21/action => generated 0 bytes in 4345 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:13:52.456360 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b5f2e70a-15f1-4051-8543-3ec9434f42dd tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:52.537806 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b5f2e70a-15f1-4051-8543-3ec9434f42dd tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/123034751" status: 202 len: 0 microversion: 2.1 time: 0.084825 Oct 23 01:13:52.539512 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 412/876] 10.222.0.42 () {58 vars in 1158 bytes} [Sun Oct 23 01:13:52 2022] DELETE /compute/v2.1/flavors/123034751 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:13:52.547577 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fc18ccaf-3873-45b0-ab48-9bbde697c05e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:52.548455 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fc18ccaf-3873-45b0-ab48-9bbde697c05e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 283de315-fdcb-4c89-91e3-96aa3e822b21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:52.561727 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fc18ccaf-3873-45b0-ab48-9bbde697c05e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:52.562400 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fc18ccaf-3873-45b0-ab48-9bbde697c05e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:52.562941 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fc18ccaf-3873-45b0-ab48-9bbde697c05e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:52.564023 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fc18ccaf-3873-45b0-ab48-9bbde697c05e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:52.564652 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fc18ccaf-3873-45b0-ab48-9bbde697c05e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:52.566803 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fc18ccaf-3873-45b0-ab48-9bbde697c05e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:52.667325 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a2ccffa2-aa60-4578-9a36-037470523fe7 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262d5984b8c4775b86fae1c0d314718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc8f8cefbf441c98d6bda76e99e3173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:52.676715 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a2ccffa2-aa60-4578-9a36-037470523fe7 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07" status: 200 len: 1354 microversion: 2.1 time: 0.240592 Oct 23 01:13:52.677312 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 465/877] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:52 2022] GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07 => generated 1354 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:52.698405 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d4d47d06-a040-469b-bc4f-e36344b8735b tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:13:52.701302 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d4d47d06-a040-469b-bc4f-e36344b8735b tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] [instance: 8f277484-b3ae-465e-90b7-8febafef9329] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:52.707765 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4d47d06-a040-469b-bc4f-e36344b8735b tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:52.709870 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4d47d06-a040-469b-bc4f-e36344b8735b tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:52.710519 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4d47d06-a040-469b-bc4f-e36344b8735b tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:52.712789 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4d47d06-a040-469b-bc4f-e36344b8735b tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:52.713456 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4d47d06-a040-469b-bc4f-e36344b8735b tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:52.714722 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4d47d06-a040-469b-bc4f-e36344b8735b tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:52.774708 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fc18ccaf-3873-45b0-ab48-9bbde697c05e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:52.790073 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fc18ccaf-3873-45b0-ab48-9bbde697c05e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:52.792593 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fc18ccaf-3873-45b0-ab48-9bbde697c05e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:52.794836 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fc18ccaf-3873-45b0-ab48-9bbde697c05e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21" status: 200 len: 1569 microversion: 2.25 time: 0.253474 Oct 23 01:13:52.795882 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 413/878] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:52 2022] GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21 => generated 1569 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:13:52.802693 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4f35ea1d-9338-4b13-a357-f5873a84077c tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:52.833379 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4f35ea1d-9338-4b13-a357-f5873a84077c tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035726 Oct 23 01:13:52.847470 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 414/879] 10.222.0.42 () {58 vars in 1146 bytes} [Sun Oct 23 01:13:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:52.855491 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f8a6b543-2e6d-48b6-8f21-64d7d7f6d98d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:52.856121 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f8a6b543-2e6d-48b6-8f21-64d7d7f6d98d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: edb35c7d-9adc-4b53-9bef-147aadbeae5d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:52.863778 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8a6b543-2e6d-48b6-8f21-64d7d7f6d98d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:52.864568 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8a6b543-2e6d-48b6-8f21-64d7d7f6d98d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:52.865173 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8a6b543-2e6d-48b6-8f21-64d7d7f6d98d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:52.866105 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8a6b543-2e6d-48b6-8f21-64d7d7f6d98d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:52.866729 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8a6b543-2e6d-48b6-8f21-64d7d7f6d98d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:52.868080 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8a6b543-2e6d-48b6-8f21-64d7d7f6d98d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:53.075612 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f8a6b543-2e6d-48b6-8f21-64d7d7f6d98d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:53.083752 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f8a6b543-2e6d-48b6-8f21-64d7d7f6d98d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d" status: 200 len: 1475 microversion: 2.1 time: 0.234892 Oct 23 01:13:53.087014 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d4d47d06-a040-469b-bc4f-e36344b8735b tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329/action" status: 202 len: 0 microversion: 2.1 time: 0.395038 Oct 23 01:13:53.091430 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 466/880] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:13:52 2022] POST /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329/action => generated 0 bytes in 413 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:13:53.096674 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1eee1c0d-d401-4a7a-b1e4-a063b52f9691 tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-398102033", "id": 1373215219, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:13:53.099168 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 415/881] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:52 2022] GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d => generated 1475 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:53.108850 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-9da830c9-7571-48e9-9ba5-41a29a156b47 req-0911c2b5-bf4b-4e02-ae02-375b227b867a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f277484-b3ae-465e-90b7-8febafef9329", "name": "network-vif-unplugged", "status": "completed", "tag": "4af1b3a5-4e5f-45a7-ab54-f98595e2f6f7"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:13:53.125128 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-9da830c9-7571-48e9-9ba5-41a29a156b47 req-0911c2b5-bf4b-4e02-ae02-375b227b867a service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:53.125615 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-9da830c9-7571-48e9-9ba5-41a29a156b47 req-0911c2b5-bf4b-4e02-ae02-375b227b867a service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:53.126080 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-9da830c9-7571-48e9-9ba5-41a29a156b47 req-0911c2b5-bf4b-4e02-ae02-375b227b867a service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:53.139184 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-9da830c9-7571-48e9-9ba5-41a29a156b47 req-0911c2b5-bf4b-4e02-ae02-375b227b867a service nova] Creating event network-vif-unplugged:4af1b3a5-4e5f-45a7-ab54-f98595e2f6f7 for instance 8f277484-b3ae-465e-90b7-8febafef9329 on n-h1-master-1 Oct 23 01:13:53.144399 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-9da830c9-7571-48e9-9ba5-41a29a156b47 req-0911c2b5-bf4b-4e02-ae02-375b227b867a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043942 Oct 23 01:13:53.145279 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 416/882] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:13:53.151138 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c9c253c8-1587-4fc7-b50a-4db4f8db3c5d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:53.151824 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c9c253c8-1587-4fc7-b50a-4db4f8db3c5d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:53.157957 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c9c253c8-1587-4fc7-b50a-4db4f8db3c5d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:53.158482 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c9c253c8-1587-4fc7-b50a-4db4f8db3c5d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:53.158925 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c9c253c8-1587-4fc7-b50a-4db4f8db3c5d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:53.159870 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c9c253c8-1587-4fc7-b50a-4db4f8db3c5d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:53.160501 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c9c253c8-1587-4fc7-b50a-4db4f8db3c5d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:53.160934 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c9c253c8-1587-4fc7-b50a-4db4f8db3c5d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:53.201762 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1eee1c0d-d401-4a7a-b1e4-a063b52f9691 tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.109009 Oct 23 01:13:53.211345 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 467/883] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:13:53 2022] POST /compute/v2.1/flavors => generated 416 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:13:53.217389 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-720d1a3d-dfe3-4545-9a4b-7c137fcf2d09 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:53.218290 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-720d1a3d-dfe3-4545-9a4b-7c137fcf2d09 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] [instance: 8f277484-b3ae-465e-90b7-8febafef9329] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:53.225508 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-720d1a3d-dfe3-4545-9a4b-7c137fcf2d09 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:53.228874 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-720d1a3d-dfe3-4545-9a4b-7c137fcf2d09 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:53.229291 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-720d1a3d-dfe3-4545-9a4b-7c137fcf2d09 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:53.230076 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-720d1a3d-dfe3-4545-9a4b-7c137fcf2d09 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:53.230547 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-720d1a3d-dfe3-4545-9a4b-7c137fcf2d09 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:53.231148 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-720d1a3d-dfe3-4545-9a4b-7c137fcf2d09 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:53.255147 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c9c253c8-1587-4fc7-b50a-4db4f8db3c5d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:53.262401 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c9c253c8-1587-4fc7-b50a-4db4f8db3c5d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:53.263878 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c9c253c8-1587-4fc7-b50a-4db4f8db3c5d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:53.269428 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c9c253c8-1587-4fc7-b50a-4db4f8db3c5d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1553 microversion: 2.91 time: 0.122798 Oct 23 01:13:53.270610 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 417/884] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:53 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1553 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:13:53.277527 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-720d1a3d-dfe3-4545-9a4b-7c137fcf2d09 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:53.278275 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-720d1a3d-dfe3-4545-9a4b-7c137fcf2d09 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:53.278723 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-720d1a3d-dfe3-4545-9a4b-7c137fcf2d09 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:53.279177 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-720d1a3d-dfe3-4545-9a4b-7c137fcf2d09 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lazy-loading 'fault' on Instance uuid 8f277484-b3ae-465e-90b7-8febafef9329 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:13:53.286459 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-91bee220-169e-418a-beba-ae7372364d84 tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:53.312195 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-91bee220-169e-418a-beba-ae7372364d84 tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.040128 Oct 23 01:13:53.326871 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 418/885] 10.222.0.42 () {58 vars in 1146 bytes} [Sun Oct 23 01:13:53 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:53.334572 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8066693d-3851-48de-ab1c-a727f025cc8b tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:53.342437 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=4 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:53.426729 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-720d1a3d-dfe3-4545-9a4b-7c137fcf2d09 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329" status: 200 len: 1597 microversion: 2.1 time: 0.212734 Oct 23 01:13:53.442009 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 468/886] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:53 2022] GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329 => generated 1597 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:53.452838 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7accf615-27c2-41cf-9f15-9586e175ea24 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:13:53.455657 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7accf615-27c2-41cf-9f15-9586e175ea24 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] [instance: 8f277484-b3ae-465e-90b7-8febafef9329] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:53.465836 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7accf615-27c2-41cf-9f15-9586e175ea24 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:53.466623 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7accf615-27c2-41cf-9f15-9586e175ea24 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:53.470730 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7accf615-27c2-41cf-9f15-9586e175ea24 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:53.471902 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7accf615-27c2-41cf-9f15-9586e175ea24 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:53.472631 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7accf615-27c2-41cf-9f15-9586e175ea24 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:53.476100 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7accf615-27c2-41cf-9f15-9586e175ea24 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:53.491875 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8066693d-3851-48de-ab1c-a727f025cc8b tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/1373215219" status: 202 len: 0 microversion: 2.1 time: 0.161234 Oct 23 01:13:53.492668 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 419/887] 10.222.0.42 () {58 vars in 1161 bytes} [Sun Oct 23 01:13:53 2022] DELETE /compute/v2.1/flavors/1373215219 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 23 01:13:53.501432 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:53.504807 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-040a8fc7-5017-4f08-87c2-b563e0728062 tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:53.541340 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-040a8fc7-5017-4f08-87c2-b563e0728062 tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041017 Oct 23 01:13:53.557441 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 420/888] 10.222.0.42 () {58 vars in 1146 bytes} [Sun Oct 23 01:13:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:53.562962 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b3436046-01af-45a5-a875-ca092e510030 tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1679876666", "id": 1602737229, "os-flavor-access:is_public": "True"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:13:53.671467 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b3436046-01af-45a5-a875-ca092e510030 tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.112320 Oct 23 01:13:53.672097 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 421/889] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:13:53 2022] POST /compute/v2.1/flavors => generated 429 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:13:53.685725 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-651133b6-9393-483c-9d86-9ae56d0ed703 tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:53.782726 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-651133b6-9393-483c-9d86-9ae56d0ed703 tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/1602737229" status: 202 len: 0 microversion: 2.1 time: 0.097743 Oct 23 01:13:53.789561 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 422/890] 10.222.0.42 () {58 vars in 1161 bytes} [Sun Oct 23 01:13:53 2022] DELETE /compute/v2.1/flavors/1602737229 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:13:53.802281 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-24276087-dd70-4fb9-ae3e-4e914b6ce55c tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:53.806488 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-24276087-dd70-4fb9-ae3e-4e914b6ce55c tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 93d46a54-c775-4fc6-ad62-edf53bee2d07] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:53.832932 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-24276087-dd70-4fb9-ae3e-4e914b6ce55c tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:53.836198 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-24276087-dd70-4fb9-ae3e-4e914b6ce55c tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:53.836694 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-24276087-dd70-4fb9-ae3e-4e914b6ce55c tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:53.839851 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-24276087-dd70-4fb9-ae3e-4e914b6ce55c tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:53.843667 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-24276087-dd70-4fb9-ae3e-4e914b6ce55c tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:53.844799 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-24276087-dd70-4fb9-ae3e-4e914b6ce55c tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:53.897808 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7accf615-27c2-41cf-9f15-9586e175ea24 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329/action" status: 202 len: 0 microversion: 2.1 time: 0.449384 Oct 23 01:13:53.899057 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 469/891] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:13:53 2022] POST /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329/action => generated 0 bytes in 452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 23 01:13:53.905401 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8e5ce965-979c-4999-a37f-66e615c57133 tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:53.947993 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8e5ce965-979c-4999-a37f-66e615c57133 tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046700 Oct 23 01:13:53.966154 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 470/892] 10.222.0.42 () {58 vars in 1146 bytes} [Sun Oct 23 01:13:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:53.972078 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3bf5298b-575b-4a06-be21-58a4a9156396 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:53.972875 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3bf5298b-575b-4a06-be21-58a4a9156396 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 283de315-fdcb-4c89-91e3-96aa3e822b21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:53.984408 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3bf5298b-575b-4a06-be21-58a4a9156396 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:54.004067 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3bf5298b-575b-4a06-be21-58a4a9156396 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:54.004067 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3bf5298b-575b-4a06-be21-58a4a9156396 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:54.005238 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3bf5298b-575b-4a06-be21-58a4a9156396 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:54.006047 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3bf5298b-575b-4a06-be21-58a4a9156396 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:54.006727 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3bf5298b-575b-4a06-be21-58a4a9156396 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:54.381756 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3bf5298b-575b-4a06-be21-58a4a9156396 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:54.396466 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3bf5298b-575b-4a06-be21-58a4a9156396 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:54.399670 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3bf5298b-575b-4a06-be21-58a4a9156396 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:54.400937 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3bf5298b-575b-4a06-be21-58a4a9156396 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21" status: 200 len: 1569 microversion: 2.25 time: 0.433276 Oct 23 01:13:54.414174 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-24276087-dd70-4fb9-ae3e-4e914b6ce55c tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262d5984b8c4775b86fae1c0d314718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc8f8cefbf441c98d6bda76e99e3173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:54.417952 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 471/893] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:53 2022] GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21 => generated 1569 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:13:54.427279 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-24276087-dd70-4fb9-ae3e-4e914b6ce55c tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07" status: 200 len: 1354 microversion: 2.1 time: 0.632518 Oct 23 01:13:54.428222 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 423/894] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:53 2022] GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07 => generated 1354 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:54.431254 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-af8cff42-a464-42e6-9c56-d55f1de3bd23 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:54.431882 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-af8cff42-a464-42e6-9c56-d55f1de3bd23 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] [instance: 8f277484-b3ae-465e-90b7-8febafef9329] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:54.437668 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1fd709ea-4aee-4b9c-9656-fa6be02bc7b5 tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-200868865", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:13:54.449267 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-af8cff42-a464-42e6-9c56-d55f1de3bd23 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:54.449769 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-af8cff42-a464-42e6-9c56-d55f1de3bd23 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:54.450247 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-af8cff42-a464-42e6-9c56-d55f1de3bd23 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:54.450959 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-af8cff42-a464-42e6-9c56-d55f1de3bd23 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:54.451417 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-af8cff42-a464-42e6-9c56-d55f1de3bd23 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:54.451841 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-af8cff42-a464-42e6-9c56-d55f1de3bd23 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:54.532971 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1fd709ea-4aee-4b9c-9656-fa6be02bc7b5 tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.102945 Oct 23 01:13:54.533611 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 424/895] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:13:54 2022] POST /compute/v2.1/flavors => generated 506 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:13:54.539023 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-800e324b-a917-4f5b-b5d9-b8bac807fb1e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:54.539643 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-800e324b-a917-4f5b-b5d9-b8bac807fb1e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: edb35c7d-9adc-4b53-9bef-147aadbeae5d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:54.562886 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-800e324b-a917-4f5b-b5d9-b8bac807fb1e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:54.564338 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-800e324b-a917-4f5b-b5d9-b8bac807fb1e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:54.564798 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-800e324b-a917-4f5b-b5d9-b8bac807fb1e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:54.569447 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-800e324b-a917-4f5b-b5d9-b8bac807fb1e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:54.571779 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-800e324b-a917-4f5b-b5d9-b8bac807fb1e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:54.573337 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-800e324b-a917-4f5b-b5d9-b8bac807fb1e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:54.886997 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-800e324b-a917-4f5b-b5d9-b8bac807fb1e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:54.909585 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-800e324b-a917-4f5b-b5d9-b8bac807fb1e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d" status: 200 len: 1475 microversion: 2.1 time: 0.374819 Oct 23 01:13:54.911980 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 425/896] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:54 2022] GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d => generated 1475 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:54.917785 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6bbfd6db-312d-47ad-bde1-104c62d9ce10 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:54.919313 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6bbfd6db-312d-47ad-bde1-104c62d9ce10 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:54.925912 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6bbfd6db-312d-47ad-bde1-104c62d9ce10 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:54.926750 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6bbfd6db-312d-47ad-bde1-104c62d9ce10 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:54.940142 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6bbfd6db-312d-47ad-bde1-104c62d9ce10 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:54.945155 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6bbfd6db-312d-47ad-bde1-104c62d9ce10 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:54.948712 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-af8cff42-a464-42e6-9c56-d55f1de3bd23 tempest-ServersAdminTestJSON-502085790 tempest-ServersAdminTestJSON-502085790-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329" status: 200 len: 1614 microversion: 2.1 time: 0.525507 Oct 23 01:13:54.948901 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6bbfd6db-312d-47ad-bde1-104c62d9ce10 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:54.949194 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6bbfd6db-312d-47ad-bde1-104c62d9ce10 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:54.950948 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 472/897] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:54 2022] GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329 => generated 1614 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:54.957597 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ce68d4e4-3352-4154-b2ac-907d7223a8bc tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:55.057922 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ce68d4e4-3352-4154-b2ac-907d7223a8bc tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/5da63afa-2f3b-41df-9dae-9feae30f7f51" status: 202 len: 0 microversion: 2.1 time: 0.104029 Oct 23 01:13:55.063100 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 473/898] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:13:54 2022] DELETE /compute/v2.1/flavors/5da63afa-2f3b-41df-9dae-9feae30f7f51 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:13:55.068726 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e6f4495f-67d8-4aec-bedb-07b37095b5b5 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:55.069466 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e6f4495f-67d8-4aec-bedb-07b37095b5b5 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f2a1666-1481-4519-9e9a-41909cd03da6] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:55.074550 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6bbfd6db-312d-47ad-bde1-104c62d9ce10 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:55.080180 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6f4495f-67d8-4aec-bedb-07b37095b5b5 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:55.082556 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6f4495f-67d8-4aec-bedb-07b37095b5b5 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:55.086170 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6f4495f-67d8-4aec-bedb-07b37095b5b5 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:55.087212 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6f4495f-67d8-4aec-bedb-07b37095b5b5 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:55.087906 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6f4495f-67d8-4aec-bedb-07b37095b5b5 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:55.088576 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6f4495f-67d8-4aec-bedb-07b37095b5b5 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:55.091586 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6bbfd6db-312d-47ad-bde1-104c62d9ce10 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:55.093191 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6bbfd6db-312d-47ad-bde1-104c62d9ce10 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:55.116380 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6bbfd6db-312d-47ad-bde1-104c62d9ce10 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1553 microversion: 2.91 time: 0.202982 Oct 23 01:13:55.120093 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 426/899] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:54 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1553 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:13:55.141999 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a6573640-9058-44bd-bf74-38d2cfaa8a35 tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:55.147581 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e6f4495f-67d8-4aec-bedb-07b37095b5b5 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f2a1666-1481-4519-9e9a-41909cd03da6] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:13:55.188764 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a6573640-9058-44bd-bf74-38d2cfaa8a35 tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.064678 Oct 23 01:13:55.209215 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 427/900] 10.222.0.42 () {58 vars in 1146 bytes} [Sun Oct 23 01:13:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:55.217736 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-90fa4061-e449-492b-873d-0a8551748822 tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1503453294", "id": "325fd746-32d9-47da-b869-c70f4a635ca3", "os-flavor-access:is_public": "True"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:13:55.337846 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-90fa4061-e449-492b-873d-0a8551748822 tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.127360 Oct 23 01:13:55.342683 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 428/901] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:13:55 2022] POST /compute/v2.1/flavors => generated 507 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:13:55.355327 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-747ef544-7fb8-4a54-8858-66e63a9d88a9 tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:55.458746 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-747ef544-7fb8-4a54-8858-66e63a9d88a9 tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/325fd746-32d9-47da-b869-c70f4a635ca3" status: 202 len: 0 microversion: 2.1 time: 0.107200 Oct 23 01:13:55.462796 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 429/902] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:13:55 2022] DELETE /compute/v2.1/flavors/325fd746-32d9-47da-b869-c70f4a635ca3 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 23 01:13:55.473446 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cbfd5cf8-c563-436a-85db-afd94bb74b1d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:55.474119 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-cbfd5cf8-c563-436a-85db-afd94bb74b1d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 283de315-fdcb-4c89-91e3-96aa3e822b21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:55.494159 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cbfd5cf8-c563-436a-85db-afd94bb74b1d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:55.496859 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cbfd5cf8-c563-436a-85db-afd94bb74b1d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:55.497495 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cbfd5cf8-c563-436a-85db-afd94bb74b1d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:55.505380 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cbfd5cf8-c563-436a-85db-afd94bb74b1d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:55.505892 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cbfd5cf8-c563-436a-85db-afd94bb74b1d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:55.512704 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cbfd5cf8-c563-436a-85db-afd94bb74b1d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:55.546087 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e6f4495f-67d8-4aec-bedb-07b37095b5b5 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8f2a1666-1481-4519-9e9a-41909cd03da6" status: 204 len: 0 microversion: 2.1 time: 0.479967 Oct 23 01:13:55.546087 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 474/903] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:13:55 2022] DELETE /compute/v2.1/servers/8f2a1666-1481-4519-9e9a-41909cd03da6 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:13:55.557299 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-33a58f34-f8ee-466e-a2fd-c60516eea1cc tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:55.561337 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-33a58f34-f8ee-466e-a2fd-c60516eea1cc tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 93d46a54-c775-4fc6-ad62-edf53bee2d07] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:55.572230 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-33a58f34-f8ee-466e-a2fd-c60516eea1cc tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:55.572729 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-33a58f34-f8ee-466e-a2fd-c60516eea1cc tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:55.573164 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-33a58f34-f8ee-466e-a2fd-c60516eea1cc tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:55.573867 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-33a58f34-f8ee-466e-a2fd-c60516eea1cc tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:55.576944 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-33a58f34-f8ee-466e-a2fd-c60516eea1cc tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:55.578376 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-33a58f34-f8ee-466e-a2fd-c60516eea1cc tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:55.823893 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cbfd5cf8-c563-436a-85db-afd94bb74b1d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:55.837757 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cbfd5cf8-c563-436a-85db-afd94bb74b1d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:55.839256 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cbfd5cf8-c563-436a-85db-afd94bb74b1d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:55.843357 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cbfd5cf8-c563-436a-85db-afd94bb74b1d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21" status: 200 len: 1569 microversion: 2.25 time: 0.379472 Oct 23 01:13:55.843926 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 430/904] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:55 2022] GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21 => generated 1569 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:13:55.849833 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8df3232d-dffb-428e-b2f1-b17e8a40ae4d tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:55.888250 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8df3232d-dffb-428e-b2f1-b17e8a40ae4d tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043062 Oct 23 01:13:55.898377 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 431/905] 10.222.0.42 () {58 vars in 1146 bytes} [Sun Oct 23 01:13:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:55.909884 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-33a58f34-f8ee-466e-a2fd-c60516eea1cc tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262d5984b8c4775b86fae1c0d314718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc8f8cefbf441c98d6bda76e99e3173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:55.910845 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-29762985-5da5-44dc-b99f-4373f84c10d3 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:55.911684 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-29762985-5da5-44dc-b99f-4373f84c10d3 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f2a1666-1481-4519-9e9a-41909cd03da6] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:55.919054 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-29762985-5da5-44dc-b99f-4373f84c10d3 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:55.919829 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-29762985-5da5-44dc-b99f-4373f84c10d3 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:55.920466 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-29762985-5da5-44dc-b99f-4373f84c10d3 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:55.921704 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-29762985-5da5-44dc-b99f-4373f84c10d3 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:55.922160 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-33a58f34-f8ee-466e-a2fd-c60516eea1cc tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07" status: 200 len: 1354 microversion: 2.1 time: 0.372956 Oct 23 01:13:55.922560 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-29762985-5da5-44dc-b99f-4373f84c10d3 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:55.923172 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-29762985-5da5-44dc-b99f-4373f84c10d3 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:55.942146 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 475/906] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:55 2022] GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07 => generated 1354 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:55.949779 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a2846d44-2a28-4fe5-bee8-c63e11487c6f tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1235816285", "id": 1884210410, "os-flavor-access:is_public": "True"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:13:55.959019 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:56.029611 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a2846d44-2a28-4fe5-bee8-c63e11487c6f tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.086040 Oct 23 01:13:56.030562 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 476/907] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:13:55 2022] POST /compute/v2.1/flavors => generated 414 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:13:56.040296 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-45720794-f968-4bf7-ad9f-3df7ef3bb4af tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:56.045511 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-45720794-f968-4bf7-ad9f-3df7ef3bb4af tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: edb35c7d-9adc-4b53-9bef-147aadbeae5d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:56.060588 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-45720794-f968-4bf7-ad9f-3df7ef3bb4af tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:56.061959 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-45720794-f968-4bf7-ad9f-3df7ef3bb4af tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:56.063200 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-45720794-f968-4bf7-ad9f-3df7ef3bb4af tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:56.063857 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-45720794-f968-4bf7-ad9f-3df7ef3bb4af tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:56.065905 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-45720794-f968-4bf7-ad9f-3df7ef3bb4af tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:56.067344 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-45720794-f968-4bf7-ad9f-3df7ef3bb4af tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:56.172072 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-29762985-5da5-44dc-b99f-4373f84c10d3 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:56.186193 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-29762985-5da5-44dc-b99f-4373f84c10d3 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2a1666-1481-4519-9e9a-41909cd03da6" status: 200 len: 1469 microversion: 2.1 time: 0.286382 Oct 23 01:13:56.187154 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 432/908] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:55 2022] GET /compute/v2.1/servers/8f2a1666-1481-4519-9e9a-41909cd03da6 => generated 1469 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:56.202214 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-17d421c9-9cfa-463c-9ef0-21429ef45029 tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:56.222687 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-17d421c9-9cfa-463c-9ef0-21429ef45029 tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/1884210410" status: 200 len: 414 microversion: 2.1 time: 0.034258 Oct 23 01:13:56.223686 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 433/909] 10.222.0.42 () {58 vars in 1158 bytes} [Sun Oct 23 01:13:56 2022] GET /compute/v2.1/flavors/1884210410 => generated 414 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:13:56.232532 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6c15e9e2-a2c7-49e3-a010-6c6df68cc1d0 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:56.233148 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6c15e9e2-a2c7-49e3-a010-6c6df68cc1d0 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:56.248281 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6c15e9e2-a2c7-49e3-a010-6c6df68cc1d0 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:56.251017 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6c15e9e2-a2c7-49e3-a010-6c6df68cc1d0 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:56.251779 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6c15e9e2-a2c7-49e3-a010-6c6df68cc1d0 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:56.252715 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6c15e9e2-a2c7-49e3-a010-6c6df68cc1d0 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:56.254648 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6c15e9e2-a2c7-49e3-a010-6c6df68cc1d0 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:56.255293 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6c15e9e2-a2c7-49e3-a010-6c6df68cc1d0 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:56.389092 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6c15e9e2-a2c7-49e3-a010-6c6df68cc1d0 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:56.402121 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6c15e9e2-a2c7-49e3-a010-6c6df68cc1d0 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:56.404857 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6c15e9e2-a2c7-49e3-a010-6c6df68cc1d0 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:56.414486 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6c15e9e2-a2c7-49e3-a010-6c6df68cc1d0 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1553 microversion: 2.91 time: 0.189647 Oct 23 01:13:56.415088 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 434/910] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:56 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1553 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:13:56.432113 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-45720794-f968-4bf7-ad9f-3df7ef3bb4af tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:56.465180 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-45720794-f968-4bf7-ad9f-3df7ef3bb4af tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d" status: 200 len: 1475 microversion: 2.1 time: 0.430818 Oct 23 01:13:56.466263 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 477/911] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:56 2022] GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d => generated 1475 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:56.561144 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-0c8096d3-681c-45a1-9cca-379922f107ff req-d8055fa7-884f-4bb2-bf99-2a58089f4b7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "283de315-fdcb-4c89-91e3-96aa3e822b21", "name": "network-vif-unplugged", "status": "completed", "tag": "6fcf53a8-2a64-4797-8cda-509dc4504f75"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:13:56.593056 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-0c8096d3-681c-45a1-9cca-379922f107ff req-d8055fa7-884f-4bb2-bf99-2a58089f4b7b service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:56.598313 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-0c8096d3-681c-45a1-9cca-379922f107ff req-d8055fa7-884f-4bb2-bf99-2a58089f4b7b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:56.599939 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-0c8096d3-681c-45a1-9cca-379922f107ff req-d8055fa7-884f-4bb2-bf99-2a58089f4b7b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:56.646436 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-0c8096d3-681c-45a1-9cca-379922f107ff req-d8055fa7-884f-4bb2-bf99-2a58089f4b7b service nova] Creating event network-vif-unplugged:6fcf53a8-2a64-4797-8cda-509dc4504f75 for instance 283de315-fdcb-4c89-91e3-96aa3e822b21 on n-h2-master-1 Oct 23 01:13:56.653577 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c24c731a-0811-4621-8356-e65fa18990e4 tempest-FlavorsAdminTestJSON-683952069 tempest-FlavorsAdminTestJSON-683952069-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:56.662066 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-0c8096d3-681c-45a1-9cca-379922f107ff req-d8055fa7-884f-4bb2-bf99-2a58089f4b7b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105062 Oct 23 01:13:56.673477 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 478/912] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:13:56.721723 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c24c731a-0811-4621-8356-e65fa18990e4 tempest-FlavorsAdminTestJSON-683952069 tempest-FlavorsAdminTestJSON-683952069-project] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.304029 Oct 23 01:13:56.722572 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 435/913] 10.222.0.42 () {58 vars in 1146 bytes} [Sun Oct 23 01:13:56 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:56.746475 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-31cb57c9-c07e-46e2-94e3-60cffab93bff tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:56.842712 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-31cb57c9-c07e-46e2-94e3-60cffab93bff tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/1884210410" status: 202 len: 0 microversion: 2.1 time: 0.102182 Oct 23 01:13:56.843979 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 479/914] 10.222.0.42 () {58 vars in 1161 bytes} [Sun Oct 23 01:13:56 2022] DELETE /compute/v2.1/flavors/1884210410 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:13:56.853283 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e8b0fa1b-2d0d-400a-ac3c-f640ddf4351a tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:56.872671 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-967d9c41-3ee9-4b00-a95e-ac4adcd1d767 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:56.874103 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-967d9c41-3ee9-4b00-a95e-ac4adcd1d767 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 283de315-fdcb-4c89-91e3-96aa3e822b21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:56.887124 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-967d9c41-3ee9-4b00-a95e-ac4adcd1d767 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:56.887808 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-967d9c41-3ee9-4b00-a95e-ac4adcd1d767 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:56.889313 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-967d9c41-3ee9-4b00-a95e-ac4adcd1d767 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:56.892432 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-967d9c41-3ee9-4b00-a95e-ac4adcd1d767 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:56.893151 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-967d9c41-3ee9-4b00-a95e-ac4adcd1d767 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:56.896499 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-967d9c41-3ee9-4b00-a95e-ac4adcd1d767 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:56.919570 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e8b0fa1b-2d0d-400a-ac3c-f640ddf4351a tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.069059 Oct 23 01:13:56.948027 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 436/915] 10.222.0.42 () {58 vars in 1146 bytes} [Sun Oct 23 01:13:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:13:56.964369 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-64c6727b-e629-4371-809a-04d92add6944 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:56.976939 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-64c6727b-e629-4371-809a-04d92add6944 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 93d46a54-c775-4fc6-ad62-edf53bee2d07] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:56.996996 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-64c6727b-e629-4371-809a-04d92add6944 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:57.002400 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-64c6727b-e629-4371-809a-04d92add6944 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:57.002858 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-64c6727b-e629-4371-809a-04d92add6944 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:57.004808 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-64c6727b-e629-4371-809a-04d92add6944 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:57.008169 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-64c6727b-e629-4371-809a-04d92add6944 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:57.010968 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-64c6727b-e629-4371-809a-04d92add6944 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:57.465339 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-64c6727b-e629-4371-809a-04d92add6944 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262d5984b8c4775b86fae1c0d314718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc8f8cefbf441c98d6bda76e99e3173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:57.473160 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-64c6727b-e629-4371-809a-04d92add6944 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07" status: 200 len: 1354 microversion: 2.1 time: 0.523942 Oct 23 01:13:57.495436 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 437/916] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:56 2022] GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07 => generated 1354 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:57.496408 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-967d9c41-3ee9-4b00-a95e-ac4adcd1d767 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:57.502808 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-21e685c7-1217-4bff-ab5e-dce0bd750441 tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1051259386", "id": 255384055, "os-flavor-access:is_public": "False"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:13:57.505799 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-967d9c41-3ee9-4b00-a95e-ac4adcd1d767 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:57.511428 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-967d9c41-3ee9-4b00-a95e-ac4adcd1d767 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:57.517241 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-967d9c41-3ee9-4b00-a95e-ac4adcd1d767 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21" status: 200 len: 1569 microversion: 2.25 time: 0.650128 Oct 23 01:13:57.518870 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 480/917] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:56 2022] GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21 => generated 1569 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:13:57.535563 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-82783907-5fdf-4ea4-916c-9cecfa249b34 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:57.535563 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-82783907-5fdf-4ea4-916c-9cecfa249b34 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f2a1666-1481-4519-9e9a-41909cd03da6] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:57.546547 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-82783907-5fdf-4ea4-916c-9cecfa249b34 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:57.547270 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-82783907-5fdf-4ea4-916c-9cecfa249b34 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:57.551112 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-82783907-5fdf-4ea4-916c-9cecfa249b34 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:57.552832 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-82783907-5fdf-4ea4-916c-9cecfa249b34 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:57.553320 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-82783907-5fdf-4ea4-916c-9cecfa249b34 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:57.553760 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-82783907-5fdf-4ea4-916c-9cecfa249b34 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:57.652495 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-21e685c7-1217-4bff-ab5e-dce0bd750441 tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.155966 Oct 23 01:13:57.656936 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 438/918] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:13:57 2022] POST /compute/v2.1/flavors => generated 427 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:13:57.672571 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-8eb59972-50c1-49ee-830e-3ad2f6cc4e7c req-83cf3093-423b-4e4a-b33c-9fc46aa2e866 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f277484-b3ae-465e-90b7-8febafef9329", "name": "network-vif-plugged", "status": "completed", "tag": "4af1b3a5-4e5f-45a7-ab54-f98595e2f6f7"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:13:57.693633 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-8eb59972-50c1-49ee-830e-3ad2f6cc4e7c req-83cf3093-423b-4e4a-b33c-9fc46aa2e866 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:57.694995 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-8eb59972-50c1-49ee-830e-3ad2f6cc4e7c req-83cf3093-423b-4e4a-b33c-9fc46aa2e866 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:57.698221 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-8eb59972-50c1-49ee-830e-3ad2f6cc4e7c req-83cf3093-423b-4e4a-b33c-9fc46aa2e866 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:57.716080 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-8eb59972-50c1-49ee-830e-3ad2f6cc4e7c req-83cf3093-423b-4e4a-b33c-9fc46aa2e866 service nova] Creating event network-vif-plugged:4af1b3a5-4e5f-45a7-ab54-f98595e2f6f7 for instance 8f277484-b3ae-465e-90b7-8febafef9329 on n-h1-master-1 Oct 23 01:13:57.721478 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-8eb59972-50c1-49ee-830e-3ad2f6cc4e7c req-83cf3093-423b-4e4a-b33c-9fc46aa2e866 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063149 Oct 23 01:13:57.722654 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 439/919] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:13:57.730034 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-274d5ea7-d2d8-4ff0-8cb8-79b6d33c1d17 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:57.731034 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-274d5ea7-d2d8-4ff0-8cb8-79b6d33c1d17 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:57.739531 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-274d5ea7-d2d8-4ff0-8cb8-79b6d33c1d17 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:57.742141 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-274d5ea7-d2d8-4ff0-8cb8-79b6d33c1d17 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:57.742141 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-274d5ea7-d2d8-4ff0-8cb8-79b6d33c1d17 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:57.742141 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-274d5ea7-d2d8-4ff0-8cb8-79b6d33c1d17 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:57.743198 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-274d5ea7-d2d8-4ff0-8cb8-79b6d33c1d17 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:57.743806 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-274d5ea7-d2d8-4ff0-8cb8-79b6d33c1d17 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:57.897304 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-274d5ea7-d2d8-4ff0-8cb8-79b6d33c1d17 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:57.913059 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-274d5ea7-d2d8-4ff0-8cb8-79b6d33c1d17 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:57.918059 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-274d5ea7-d2d8-4ff0-8cb8-79b6d33c1d17 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:57.925272 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-274d5ea7-d2d8-4ff0-8cb8-79b6d33c1d17 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1553 microversion: 2.91 time: 0.201190 Oct 23 01:13:57.943064 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 440/920] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:57 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1553 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:13:57.954775 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d3306e9d-d09a-426a-9797-5ad4c5ac5977 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:57.959103 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d3306e9d-d09a-426a-9797-5ad4c5ac5977 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: edb35c7d-9adc-4b53-9bef-147aadbeae5d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:57.963614 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d3306e9d-d09a-426a-9797-5ad4c5ac5977 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:57.964367 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d3306e9d-d09a-426a-9797-5ad4c5ac5977 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:57.965043 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d3306e9d-d09a-426a-9797-5ad4c5ac5977 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:57.966176 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d3306e9d-d09a-426a-9797-5ad4c5ac5977 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:57.966753 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d3306e9d-d09a-426a-9797-5ad4c5ac5977 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:57.967290 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d3306e9d-d09a-426a-9797-5ad4c5ac5977 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:58.039767 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-82783907-5fdf-4ea4-916c-9cecfa249b34 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:58.051764 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-82783907-5fdf-4ea4-916c-9cecfa249b34 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2a1666-1481-4519-9e9a-41909cd03da6" status: 200 len: 1469 microversion: 2.1 time: 0.531491 Oct 23 01:13:58.065237 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 481/921] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:57 2022] GET /compute/v2.1/servers/8f2a1666-1481-4519-9e9a-41909cd03da6 => generated 1469 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:58.065237 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a02dbcce-866e-4e4c-a5ee-6b98ef746cf8 tempest-FlavorsAdminTestJSON-683952069 tempest-FlavorsAdminTestJSON-683952069-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "255384055"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:13:58.065544 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:58.075881 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-a02dbcce-866e-4e4c-a5ee-6b98ef746cf8 tempest-FlavorsAdminTestJSON-683952069 tempest-FlavorsAdminTestJSON-683952069-project] HTTP exception thrown: Flavor 255384055 could not be found. Oct 23 01:13:58.079632 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a02dbcce-866e-4e4c-a5ee-6b98ef746cf8 tempest-FlavorsAdminTestJSON-683952069 tempest-FlavorsAdminTestJSON-683952069-project] Request method failure captured: Oct 23 01:13:58.079632 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 23 01:13:58.079632 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:13:58.079632 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:13:58.079632 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:13:58.079632 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 106 Oct 23 01:13:58.079632 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:13:58.079632 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:13:58.079632 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:13:58.079632 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:13:58.079632 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJVOt6JfExyc9XyGZ1704hXmwuMiMZ6omhvH8BpTqD8o4C91u_BM-I6Mdvv8YvArIYgRXSQofnfGZfiUNdwcA4DT-0aMXdUvGCEUGcyodyasI9sRTzVvUsFLKUi-rpzNDp-30L3V7Qb0QxU6yc1MkMOzY0QZCYI0guAVbRIDISZDLhM Oct 23 01:13:58.079632 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:13:58.079632 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:13:58.079632 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:13:58.079632 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:13:58.079632 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:13:58.079632 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:13:58.079632 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 8056b64dc6424bd59f98f0aad9c5e45c Oct 23 01:13:58.079632 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-FlavorsAdminTestJSON-683952069 Oct 23 01:13:58.079632 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:13:58.079632 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:13:58.080988 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8056b64dc6424bd59f98f0aad9c5e45c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8056b64dc6424bd59f98f0aad9c5e45c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8056b64dc6424bd59f98f0aad9c5e45c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8056b64dc6424bd59f98f0aad9c5e45c"}]}] Oct 23 01:13:58.080988 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-FlavorsAdminTestJSON-683952069 Oct 23 01:13:58.080988 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 8056b64dc6424bd59f98f0aad9c5e45c Oct 23 01:13:58.080988 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-683952069 Oct 23 01:13:58.080988 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-FlavorsAdminTestJSON-683952069-project Oct 23 01:13:58.080988 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:13:58.080988 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:13:58.080988 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 70e24625e3a548278b932597fc1d0e16 Oct 23 01:13:58.080988 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-FlavorsAdminTestJSON-683952069-project Oct 23 01:13:58.080988 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:13:58.080988 n-d-master-1 devstack@n-api.service[120945]: {"server": {"name": "test", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "255384055"}} Oct 23 01:13:58.080988 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:13:58.080988 n-d-master-1 devstack@n-api.service[120945]: exception: Flavor 255384055 could not be found. Oct 23 01:13:58.081943 n-d-master-1 devstack@n-api.service[120945]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '446b40bc-db5b-4123-9278-997bd6d04a0d', 'flavorRef': '255384055'}}} Oct 23 01:13:58.081943 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:13:58.081943 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:13:58.081943 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 23 01:13:58.081943 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 23 01:13:58.081943 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 23 01:13:58.081943 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 23 01:13:58.081943 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 01:13:58.081943 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 01:13:58.081943 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 23 01:13:58.081943 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 23 01:13:58.081943 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 23 01:13:58.081943 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:13:58.081943 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 23 01:13:58.081943 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 23 01:13:58.081943 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 255384055 could not be found. Oct 23 01:13:58.081943 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:13:58.081943 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:13:58.081943 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:13:58.081943 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:13:58.092040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:13:58.092040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:13:58.092040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:13:58.092040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:13:58.092040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:13:58.092040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:13:58.092040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:13:58.092040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:13:58.092040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:13:58.092040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:13:58.092040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:13:58.092040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:13:58.092040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 23 01:13:58.092040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 23 01:13:58.092040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 23 01:13:58.092040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 255384055 could not be found. Oct 23 01:13:58.092040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:13:58.092040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:13:58.092040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:13:58.092040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:13:58.092040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:13:58.093383 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:13:58.093383 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:13:58.093383 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:13:58.093383 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 255384055 could not be found. Oct 23 01:13:58.093383 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:13:58.093383 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a02dbcce-866e-4e4c-a5ee-6b98ef746cf8 tempest-FlavorsAdminTestJSON-683952069 tempest-FlavorsAdminTestJSON-683952069-project] Returning 400 to user: Flavor 255384055 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:13:58.093383 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a02dbcce-866e-4e4c-a5ee-6b98ef746cf8 tempest-FlavorsAdminTestJSON-683952069 tempest-FlavorsAdminTestJSON-683952069-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.030364 Oct 23 01:13:58.093383 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 482/922] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:13:58 2022] POST /compute/v2.1/servers => generated 80 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 23 01:13:58.103477 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-876c686b-3dc6-4c71-9051-a113d19cf2a8 tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:58.206354 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-876c686b-3dc6-4c71-9051-a113d19cf2a8 tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/255384055" status: 202 len: 0 microversion: 2.1 time: 0.111921 Oct 23 01:13:58.206943 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 483/923] 10.222.0.42 () {58 vars in 1158 bytes} [Sun Oct 23 01:13:58 2022] DELETE /compute/v2.1/flavors/255384055 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:13:58.216402 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9380e03d-89c5-4ab8-99c2-411a303c6e6a tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:58.244294 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9380e03d-89c5-4ab8-99c2-411a303c6e6a tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032248 Oct 23 01:13:58.245273 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 484/924] 10.222.0.42 () {58 vars in 1146 bytes} [Sun Oct 23 01:13:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:13:58.269148 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c4dad754-073e-4b9a-948c-0992b89f20a7 tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1861907211", "id": 593192681, "os-flavor-access:is_public": "False"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:13:58.349768 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c4dad754-073e-4b9a-948c-0992b89f20a7 tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.084283 Oct 23 01:13:58.350666 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 485/925] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:13:58 2022] POST /compute/v2.1/flavors => generated 412 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:13:58.370857 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5e60dd76-e233-4eb9-9bb8-4d933605b830 tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1209486670", "id": 487990964, "os-flavor-access:is_public": "True"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:13:58.455117 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5e60dd76-e233-4eb9-9bb8-4d933605b830 tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.095016 Oct 23 01:13:58.455640 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 486/926] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:13:58 2022] POST /compute/v2.1/flavors => generated 411 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:13:58.477421 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-26d1629e-b52f-4b6d-a44c-803af3cdf42d tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:58.506158 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-26d1629e-b52f-4b6d-a44c-803af3cdf42d tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 415 microversion: 2.1 time: 0.040977 Oct 23 01:13:58.515275 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 487/927] 10.222.0.42 () {58 vars in 1169 bytes} [Sun Oct 23 01:13:58 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 415 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:13:58.522625 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3f8ed74b-a4fc-4c15-8ff9-25d39a977bc6 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:58.524418 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3f8ed74b-a4fc-4c15-8ff9-25d39a977bc6 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 93d46a54-c775-4fc6-ad62-edf53bee2d07] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:58.533381 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3f8ed74b-a4fc-4c15-8ff9-25d39a977bc6 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:58.534150 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3f8ed74b-a4fc-4c15-8ff9-25d39a977bc6 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:58.534766 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3f8ed74b-a4fc-4c15-8ff9-25d39a977bc6 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:58.535657 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3f8ed74b-a4fc-4c15-8ff9-25d39a977bc6 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:58.536296 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3f8ed74b-a4fc-4c15-8ff9-25d39a977bc6 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:58.536890 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3f8ed74b-a4fc-4c15-8ff9-25d39a977bc6 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:58.767154 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d3306e9d-d09a-426a-9797-5ad4c5ac5977 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:58.775141 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d3306e9d-d09a-426a-9797-5ad4c5ac5977 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d" status: 200 len: 1475 microversion: 2.1 time: 0.830649 Oct 23 01:13:58.775967 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 441/928] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:57 2022] GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d => generated 1475 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:58.780422 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ba577aeb-e051-4703-b324-d1b7fadfab74 tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:58.801577 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ba577aeb-e051-4703-b324-d1b7fadfab74 tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 415 microversion: 2.1 time: 0.024375 Oct 23 01:13:58.802194 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 442/929] 10.222.0.42 () {58 vars in 1177 bytes} [Sun Oct 23 01:13:58 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 415 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:13:58.815938 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f960398c-578a-40fa-8af7-de02484f85d4 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:58.816700 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f960398c-578a-40fa-8af7-de02484f85d4 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 283de315-fdcb-4c89-91e3-96aa3e822b21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:58.825464 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f960398c-578a-40fa-8af7-de02484f85d4 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:58.825949 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f960398c-578a-40fa-8af7-de02484f85d4 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:58.826422 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f960398c-578a-40fa-8af7-de02484f85d4 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:58.827127 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f960398c-578a-40fa-8af7-de02484f85d4 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:58.827862 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f960398c-578a-40fa-8af7-de02484f85d4 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:58.828420 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f960398c-578a-40fa-8af7-de02484f85d4 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:58.957749 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3f8ed74b-a4fc-4c15-8ff9-25d39a977bc6 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262d5984b8c4775b86fae1c0d314718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc8f8cefbf441c98d6bda76e99e3173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:58.981756 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3f8ed74b-a4fc-4c15-8ff9-25d39a977bc6 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07" status: 200 len: 1354 microversion: 2.1 time: 0.462835 Oct 23 01:13:58.984170 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 488/930] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:58 2022] GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07 => generated 1354 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:58.995929 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-dc902416-21e0-43d3-b018-653dd03f74a0 req-eda08257-39b4-4149-927f-ec8cd063a78a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "283de315-fdcb-4c89-91e3-96aa3e822b21", "tag": "6fcf53a8-2a64-4797-8cda-509dc4504f75"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:13:59.019803 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-dc902416-21e0-43d3-b018-653dd03f74a0 req-eda08257-39b4-4149-927f-ec8cd063a78a service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:59.021223 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-dc902416-21e0-43d3-b018-653dd03f74a0 req-eda08257-39b4-4149-927f-ec8cd063a78a service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:59.026586 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-dc902416-21e0-43d3-b018-653dd03f74a0 req-eda08257-39b4-4149-927f-ec8cd063a78a service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:59.040785 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-dc902416-21e0-43d3-b018-653dd03f74a0 req-eda08257-39b4-4149-927f-ec8cd063a78a service nova] Creating event network-changed:6fcf53a8-2a64-4797-8cda-509dc4504f75 for instance 283de315-fdcb-4c89-91e3-96aa3e822b21 on n-h2-master-1 Oct 23 01:13:59.047727 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-dc902416-21e0-43d3-b018-653dd03f74a0 req-eda08257-39b4-4149-927f-ec8cd063a78a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060786 Oct 23 01:13:59.048717 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 489/931] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:13:59.056988 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c8936a0d-e266-446c-a85a-bc968b32d134 tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:59.078851 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c8936a0d-e266-446c-a85a-bc968b32d134 tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 415 microversion: 2.1 time: 0.028665 Oct 23 01:13:59.080670 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 490/932] 10.222.0.42 () {58 vars in 1171 bytes} [Sun Oct 23 01:13:59 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 415 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:13:59.097011 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7032502d-1c34-4b4b-b255-2d3f74d4de27 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:59.098853 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7032502d-1c34-4b4b-b255-2d3f74d4de27 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:59.115353 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7032502d-1c34-4b4b-b255-2d3f74d4de27 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:59.116575 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7032502d-1c34-4b4b-b255-2d3f74d4de27 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:59.117116 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7032502d-1c34-4b4b-b255-2d3f74d4de27 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:59.119881 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7032502d-1c34-4b4b-b255-2d3f74d4de27 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:59.122431 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7032502d-1c34-4b4b-b255-2d3f74d4de27 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:59.122888 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7032502d-1c34-4b4b-b255-2d3f74d4de27 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:59.214374 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f960398c-578a-40fa-8af7-de02484f85d4 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:59.224993 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f960398c-578a-40fa-8af7-de02484f85d4 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:59.226417 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f960398c-578a-40fa-8af7-de02484f85d4 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:59.239308 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f960398c-578a-40fa-8af7-de02484f85d4 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21" status: 200 len: 1569 microversion: 2.25 time: 0.423150 Oct 23 01:13:59.239308 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 443/933] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:58 2022] GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21 => generated 1569 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:13:59.246017 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4e72e986-ca15-44cc-8048-0625b0104743 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:59.246892 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4e72e986-ca15-44cc-8048-0625b0104743 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f2a1666-1481-4519-9e9a-41909cd03da6] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:59.265467 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4e72e986-ca15-44cc-8048-0625b0104743 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:59.265964 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4e72e986-ca15-44cc-8048-0625b0104743 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:59.266442 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4e72e986-ca15-44cc-8048-0625b0104743 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:59.267138 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4e72e986-ca15-44cc-8048-0625b0104743 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:59.267768 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4e72e986-ca15-44cc-8048-0625b0104743 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:59.268334 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4e72e986-ca15-44cc-8048-0625b0104743 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:59.314767 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7032502d-1c34-4b4b-b255-2d3f74d4de27 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:59.324250 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7032502d-1c34-4b4b-b255-2d3f74d4de27 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:59.326199 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7032502d-1c34-4b4b-b255-2d3f74d4de27 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:59.332804 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7032502d-1c34-4b4b-b255-2d3f74d4de27 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1553 microversion: 2.91 time: 0.250308 Oct 23 01:13:59.347518 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 491/934] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:13:59 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1553 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:13:59.362847 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-528c55c6-43e5-405b-8c06-d7aebed4c878 tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:59.395229 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-528c55c6-43e5-405b-8c06-d7aebed4c878 tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 415 microversion: 2.1 time: 0.046225 Oct 23 01:13:59.405485 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 492/935] 10.222.0.42 () {58 vars in 1169 bytes} [Sun Oct 23 01:13:59 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 415 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:13:59.410426 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-553cc396-306f-4d48-9891-fada2421e3a4 tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:59.450046 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-553cc396-306f-4d48-9891-fada2421e3a4 tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5392 microversion: 2.1 time: 0.042939 Oct 23 01:13:59.453525 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 493/936] 10.222.0.42 () {58 vars in 1169 bytes} [Sun Oct 23 01:13:59 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5392 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:59.460232 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-3524f599-9309-4ee7-9c2b-4c851bddb441 req-aa59c48d-d74b-4851-8448-4dc93d7b4144 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f2a1666-1481-4519-9e9a-41909cd03da6", "name": "network-vif-deleted", "tag": "6d9ab6ca-c241-42af-84f0-72ddc77e3a24"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:13:59.490107 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-3524f599-9309-4ee7-9c2b-4c851bddb441 req-aa59c48d-d74b-4851-8448-4dc93d7b4144 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:59.490589 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-3524f599-9309-4ee7-9c2b-4c851bddb441 req-aa59c48d-d74b-4851-8448-4dc93d7b4144 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:59.491019 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-3524f599-9309-4ee7-9c2b-4c851bddb441 req-aa59c48d-d74b-4851-8448-4dc93d7b4144 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:59.514357 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-3524f599-9309-4ee7-9c2b-4c851bddb441 req-aa59c48d-d74b-4851-8448-4dc93d7b4144 service nova] Creating event network-vif-deleted:6d9ab6ca-c241-42af-84f0-72ddc77e3a24 for instance 8f2a1666-1481-4519-9e9a-41909cd03da6 on n-h1-master-1 Oct 23 01:13:59.518709 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4e72e986-ca15-44cc-8048-0625b0104743 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:13:59.532776 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4e72e986-ca15-44cc-8048-0625b0104743 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2a1666-1481-4519-9e9a-41909cd03da6" status: 200 len: 1427 microversion: 2.1 time: 0.303529 Oct 23 01:13:59.545490 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 444/937] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:59 2022] GET /compute/v2.1/servers/8f2a1666-1481-4519-9e9a-41909cd03da6 => generated 1427 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:59.545704 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-3524f599-9309-4ee7-9c2b-4c851bddb441 req-aa59c48d-d74b-4851-8448-4dc93d7b4144 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083223 Oct 23 01:13:59.545704 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 494/938] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:13:59.548230 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ac83b719-b4ec-4696-8433-6553c71fdfcd tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:59.594425 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ac83b719-b4ec-4696-8433-6553c71fdfcd tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5392 microversion: 2.1 time: 0.059911 Oct 23 01:13:59.595632 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 445/939] 10.222.0.42 () {58 vars in 1175 bytes} [Sun Oct 23 01:13:59 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5392 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:59.618174 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d4c17cb5-6a2b-40a8-bdd3-d9e900f50e35 tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:59.646827 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d4c17cb5-6a2b-40a8-bdd3-d9e900f50e35 tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5392 microversion: 2.1 time: 0.034057 Oct 23 01:13:59.663072 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 495/940] 10.222.0.42 () {58 vars in 1173 bytes} [Sun Oct 23 01:13:59 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5392 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:59.671908 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bf26edf9-554e-4e30-9170-14a5bfa8a55c tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:59.697010 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bf26edf9-554e-4e30-9170-14a5bfa8a55c tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5392 microversion: 2.1 time: 0.029621 Oct 23 01:13:59.710125 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 446/941] 10.222.0.42 () {58 vars in 1169 bytes} [Sun Oct 23 01:13:59 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5392 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:13:59.720040 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-087df1f2-66fc-45f0-a76e-e8ec4665e181 tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:59.802176 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d4e6760e-b1fa-4079-b73f-218bd57b4b6a tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:59.802938 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d4e6760e-b1fa-4079-b73f-218bd57b4b6a tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: edb35c7d-9adc-4b53-9bef-147aadbeae5d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:13:59.809614 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d4e6760e-b1fa-4079-b73f-218bd57b4b6a tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:59.810269 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d4e6760e-b1fa-4079-b73f-218bd57b4b6a tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:59.810787 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d4e6760e-b1fa-4079-b73f-218bd57b4b6a tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:59.811645 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d4e6760e-b1fa-4079-b73f-218bd57b4b6a tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:13:59.812171 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d4e6760e-b1fa-4079-b73f-218bd57b4b6a tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:13:59.812807 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d4e6760e-b1fa-4079-b73f-218bd57b4b6a tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:13:59.830840 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:59.867054 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-087df1f2-66fc-45f0-a76e-e8ec4665e181 tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/487990964" status: 202 len: 0 microversion: 2.1 time: 0.143287 Oct 23 01:13:59.867508 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 496/942] 10.222.0.42 () {58 vars in 1158 bytes} [Sun Oct 23 01:13:59 2022] DELETE /compute/v2.1/flavors/487990964 => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:13:59.876028 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-42358d36-67b8-4a17-b241-aa047ef2f2ec tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:13:59.905072 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-42358d36-67b8-4a17-b241-aa047ef2f2ec tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032744 Oct 23 01:13:59.905902 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 497/943] 10.222.0.42 () {58 vars in 1146 bytes} [Sun Oct 23 01:13:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:13:59.931324 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1f6b1046-9561-4b32-a82c-14596ea238b4 tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:00.040475 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1f6b1046-9561-4b32-a82c-14596ea238b4 tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/593192681" status: 202 len: 0 microversion: 2.1 time: 0.112818 Oct 23 01:14:00.041545 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 498/944] 10.222.0.42 () {58 vars in 1158 bytes} [Sun Oct 23 01:13:59 2022] DELETE /compute/v2.1/flavors/593192681 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 23 01:14:00.047895 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b2f07eb3-5ffa-4c57-8e85-9904267230d3 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:00.048806 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b2f07eb3-5ffa-4c57-8e85-9904267230d3 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 93d46a54-c775-4fc6-ad62-edf53bee2d07] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:00.067295 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b2f07eb3-5ffa-4c57-8e85-9904267230d3 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:00.067790 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b2f07eb3-5ffa-4c57-8e85-9904267230d3 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:00.069439 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b2f07eb3-5ffa-4c57-8e85-9904267230d3 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:00.082220 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b2f07eb3-5ffa-4c57-8e85-9904267230d3 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:00.082718 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b2f07eb3-5ffa-4c57-8e85-9904267230d3 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:00.084319 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b2f07eb3-5ffa-4c57-8e85-9904267230d3 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:00.114672 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d4e6760e-b1fa-4079-b73f-218bd57b4b6a tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:00.123104 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d4e6760e-b1fa-4079-b73f-218bd57b4b6a tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d" status: 200 len: 1475 microversion: 2.1 time: 0.324828 Oct 23 01:14:00.128958 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 447/945] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:13:59 2022] GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d => generated 1475 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:14:00.137538 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0dfd0422-fcc3-4ea7-9479-bb2095f52bcf tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:00.181134 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0dfd0422-fcc3-4ea7-9479-bb2095f52bcf tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050112 Oct 23 01:14:00.200318 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 448/946] 10.222.0.42 () {58 vars in 1146 bytes} [Sun Oct 23 01:14:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:00.206327 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-ca4de57d-a494-435c-99b0-b6cfb7275fb5 req-cf93d70f-189e-4eec-9b2b-e3119a8d29d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93d46a54-c775-4fc6-ad62-edf53bee2d07", "name": "network-vif-plugged", "status": "completed", "tag": "5eb643b1-6a02-464c-baa5-53c3a3e51506"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:14:00.216413 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-ca4de57d-a494-435c-99b0-b6cfb7275fb5 req-cf93d70f-189e-4eec-9b2b-e3119a8d29d4 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:00.217601 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-ca4de57d-a494-435c-99b0-b6cfb7275fb5 req-cf93d70f-189e-4eec-9b2b-e3119a8d29d4 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:00.218230 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-ca4de57d-a494-435c-99b0-b6cfb7275fb5 req-cf93d70f-189e-4eec-9b2b-e3119a8d29d4 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:00.231968 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-ca4de57d-a494-435c-99b0-b6cfb7275fb5 req-cf93d70f-189e-4eec-9b2b-e3119a8d29d4 service nova] Creating event network-vif-plugged:5eb643b1-6a02-464c-baa5-53c3a3e51506 for instance 93d46a54-c775-4fc6-ad62-edf53bee2d07 on n-h2-master-1 Oct 23 01:14:00.239527 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-ca4de57d-a494-435c-99b0-b6cfb7275fb5 req-cf93d70f-189e-4eec-9b2b-e3119a8d29d4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036972 Oct 23 01:14:00.240745 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 449/947] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:14:00.250361 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2e2319dc-3eb3-48b3-86e7-ebeada1bad60 tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-87595979", "id": 1395072843, "os-flavor-access:is_public": "False"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:14:00.350148 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2e2319dc-3eb3-48b3-86e7-ebeada1bad60 tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.104438 Oct 23 01:14:00.359058 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 450/948] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:14:00 2022] POST /compute/v2.1/flavors => generated 413 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:14:00.377796 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0dd04ba9-45e5-4734-9bdc-e817ef7e6c63 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:00.378688 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0dd04ba9-45e5-4734-9bdc-e817ef7e6c63 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 283de315-fdcb-4c89-91e3-96aa3e822b21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:00.401896 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0dd04ba9-45e5-4734-9bdc-e817ef7e6c63 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:00.408234 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0dd04ba9-45e5-4734-9bdc-e817ef7e6c63 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:00.408702 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0dd04ba9-45e5-4734-9bdc-e817ef7e6c63 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:00.409446 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0dd04ba9-45e5-4734-9bdc-e817ef7e6c63 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:00.410641 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0dd04ba9-45e5-4734-9bdc-e817ef7e6c63 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:00.411082 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0dd04ba9-45e5-4734-9bdc-e817ef7e6c63 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:00.565624 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b2f07eb3-5ffa-4c57-8e85-9904267230d3 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262d5984b8c4775b86fae1c0d314718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc8f8cefbf441c98d6bda76e99e3173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:00.586569 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b2f07eb3-5ffa-4c57-8e85-9904267230d3 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07" status: 200 len: 1354 microversion: 2.1 time: 0.535035 Oct 23 01:14:00.603129 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 499/949] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:00 2022] GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07 => generated 1354 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:00.608280 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-25ea59d0-ec53-4e9b-b110-153764f5404f tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:00.638151 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-25ea59d0-ec53-4e9b-b110-153764f5404f tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033581 Oct 23 01:14:00.638827 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 500/950] 10.222.0.42 () {58 vars in 1146 bytes} [Sun Oct 23 01:14:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:00.643721 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5790cf0b-6345-4e32-a9cf-e3b3c76de6b0 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:00.644342 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5790cf0b-6345-4e32-a9cf-e3b3c76de6b0 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:00.651021 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5790cf0b-6345-4e32-a9cf-e3b3c76de6b0 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:00.651595 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5790cf0b-6345-4e32-a9cf-e3b3c76de6b0 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:00.652238 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5790cf0b-6345-4e32-a9cf-e3b3c76de6b0 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:00.653143 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5790cf0b-6345-4e32-a9cf-e3b3c76de6b0 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:00.653866 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5790cf0b-6345-4e32-a9cf-e3b3c76de6b0 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:00.654622 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5790cf0b-6345-4e32-a9cf-e3b3c76de6b0 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:00.708532 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0dd04ba9-45e5-4734-9bdc-e817ef7e6c63 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:00.716830 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0dd04ba9-45e5-4734-9bdc-e817ef7e6c63 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:00.718324 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0dd04ba9-45e5-4734-9bdc-e817ef7e6c63 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:00.719517 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0dd04ba9-45e5-4734-9bdc-e817ef7e6c63 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21" status: 200 len: 1569 microversion: 2.25 time: 0.359421 Oct 23 01:14:00.746958 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 451/951] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:00 2022] GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21 => generated 1569 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:00.754132 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a6d0589a-f417-4347-b82b-949f4b9f6cee tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:00.764837 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a6d0589a-f417-4347-b82b-949f4b9f6cee tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f2a1666-1481-4519-9e9a-41909cd03da6] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:00.771363 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6d0589a-f417-4347-b82b-949f4b9f6cee tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:00.771868 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6d0589a-f417-4347-b82b-949f4b9f6cee tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:00.772317 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6d0589a-f417-4347-b82b-949f4b9f6cee tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:00.773031 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6d0589a-f417-4347-b82b-949f4b9f6cee tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:00.773561 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6d0589a-f417-4347-b82b-949f4b9f6cee tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:00.774006 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6d0589a-f417-4347-b82b-949f4b9f6cee tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:00.834669 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5790cf0b-6345-4e32-a9cf-e3b3c76de6b0 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:00.851461 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5790cf0b-6345-4e32-a9cf-e3b3c76de6b0 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:00.853467 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5790cf0b-6345-4e32-a9cf-e3b3c76de6b0 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:00.856953 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6d0589a-f417-4347-b82b-949f4b9f6cee tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:00.860195 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6d0589a-f417-4347-b82b-949f4b9f6cee tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:00.861156 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6d0589a-f417-4347-b82b-949f4b9f6cee tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:00.862585 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-a6d0589a-f417-4347-b82b-949f4b9f6cee tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lazy-loading 'fault' on Instance uuid 8f2a1666-1481-4519-9e9a-41909cd03da6 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:14:00.871334 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5790cf0b-6345-4e32-a9cf-e3b3c76de6b0 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1553 microversion: 2.91 time: 0.231440 Oct 23 01:14:00.876199 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 501/952] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:00 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1553 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:00.881698 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-09adeb45-4d82-4ebe-b60d-3844a15e579d tempest-FlavorsAdminTestJSON-683952069 tempest-FlavorsAdminTestJSON-683952069-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:00.935596 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a6d0589a-f417-4347-b82b-949f4b9f6cee tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:00.938102 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-09adeb45-4d82-4ebe-b60d-3844a15e579d tempest-FlavorsAdminTestJSON-683952069 tempest-FlavorsAdminTestJSON-683952069-project] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.060391 Oct 23 01:14:00.944679 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a6d0589a-f417-4347-b82b-949f4b9f6cee tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2a1666-1481-4519-9e9a-41909cd03da6" status: 200 len: 1304 microversion: 2.1 time: 0.196550 Oct 23 01:14:00.946149 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 452/953] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:00 2022] GET /compute/v2.1/servers/8f2a1666-1481-4519-9e9a-41909cd03da6 => generated 1304 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:00.947585 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 502/954] 10.222.0.42 () {58 vars in 1146 bytes} [Sun Oct 23 01:14:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:00.957757 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5e05d245-c7cd-4b21-b719-e1c3afca3195 tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:00.962246 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:DELETE=8,nova_api:SELECT=87,nova_api:INSERT=5 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:01.030543 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5e05d245-c7cd-4b21-b719-e1c3afca3195 tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/1395072843" status: 202 len: 0 microversion: 2.1 time: 0.076208 Oct 23 01:14:01.034720 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 453/955] 10.222.0.42 () {58 vars in 1161 bytes} [Sun Oct 23 01:14:00 2022] DELETE /compute/v2.1/flavors/1395072843 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:14:01.043304 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4c9fcd4d-b225-4d55-b8d8-670086ab89d0 tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:01.070621 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4c9fcd4d-b225-4d55-b8d8-670086ab89d0 tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034398 Oct 23 01:14:01.072038 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 503/956] 10.222.0.42 () {58 vars in 1146 bytes} [Sun Oct 23 01:14:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:14:01.097225 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fce2cf5c-29af-4759-9359-235528f5dc0c tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1010661871", "id": 1719619107, "os-flavor-access:is_public": "True"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:14:01.163365 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-27b0a8eb-21c8-42e0-a56e-96c51d36f48f tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:01.165616 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-27b0a8eb-21c8-42e0-a56e-96c51d36f48f tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: edb35c7d-9adc-4b53-9bef-147aadbeae5d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:01.175963 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-27b0a8eb-21c8-42e0-a56e-96c51d36f48f tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:01.176999 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-27b0a8eb-21c8-42e0-a56e-96c51d36f48f tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:01.178775 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-27b0a8eb-21c8-42e0-a56e-96c51d36f48f tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:01.180971 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-27b0a8eb-21c8-42e0-a56e-96c51d36f48f tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:01.181728 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-27b0a8eb-21c8-42e0-a56e-96c51d36f48f tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:01.182637 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-27b0a8eb-21c8-42e0-a56e-96c51d36f48f tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:01.227450 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fce2cf5c-29af-4759-9359-235528f5dc0c tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.135360 Oct 23 01:14:01.228905 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 454/957] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:14:01 2022] POST /compute/v2.1/flavors => generated 414 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:14:01.245639 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d270e7f0-eb18-40df-887e-d0a681d2f365 tempest-FlavorsAdminTestJSON-683952069 tempest-FlavorsAdminTestJSON-683952069-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:01.273097 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d270e7f0-eb18-40df-887e-d0a681d2f365 tempest-FlavorsAdminTestJSON-683952069 tempest-FlavorsAdminTestJSON-683952069-project] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.032783 Oct 23 01:14:01.287414 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 455/958] 10.222.0.42 () {58 vars in 1146 bytes} [Sun Oct 23 01:14:01 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:14:01.293368 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-06e6fc6f-ad8b-4397-83d5-28c7d27d4f92 tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:01.409787 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-27b0a8eb-21c8-42e0-a56e-96c51d36f48f tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:01.415065 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-06e6fc6f-ad8b-4397-83d5-28c7d27d4f92 tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/1719619107" status: 202 len: 0 microversion: 2.1 time: 0.124521 Oct 23 01:14:01.420220 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 456/959] 10.222.0.42 () {58 vars in 1161 bytes} [Sun Oct 23 01:14:01 2022] DELETE /compute/v2.1/flavors/1719619107 => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 23 01:14:01.425945 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-27b0a8eb-21c8-42e0-a56e-96c51d36f48f tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d" status: 200 len: 1475 microversion: 2.1 time: 0.270723 Oct 23 01:14:01.426222 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-43989533-87b7-40ae-beea-44133784285f tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:01.428910 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 504/960] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:01 2022] GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d => generated 1475 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:01.480798 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-43989533-87b7-40ae-beea-44133784285f tempest-FlavorsAdminTestJSON-1868594080 tempest-FlavorsAdminTestJSON-1868594080-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050349 Oct 23 01:14:01.482053 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 457/961] 10.222.0.42 () {58 vars in 1146 bytes} [Sun Oct 23 01:14:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:01.612300 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6025186a-3451-4a49-937a-0992a35583ee tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:01.613214 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6025186a-3451-4a49-937a-0992a35583ee tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 93d46a54-c775-4fc6-ad62-edf53bee2d07] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:01.622876 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6025186a-3451-4a49-937a-0992a35583ee tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:01.623803 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6025186a-3451-4a49-937a-0992a35583ee tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:01.624406 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6025186a-3451-4a49-937a-0992a35583ee tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:01.625291 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6025186a-3451-4a49-937a-0992a35583ee tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:01.626086 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6025186a-3451-4a49-937a-0992a35583ee tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:01.626665 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6025186a-3451-4a49-937a-0992a35583ee tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:01.654966 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:01.766853 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b8ffe932-16c2-43b5-bfc0-5ee3c2d050c3 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:01.767460 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b8ffe932-16c2-43b5-bfc0-5ee3c2d050c3 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 283de315-fdcb-4c89-91e3-96aa3e822b21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:01.775000 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b8ffe932-16c2-43b5-bfc0-5ee3c2d050c3 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:01.775700 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b8ffe932-16c2-43b5-bfc0-5ee3c2d050c3 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:01.776295 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b8ffe932-16c2-43b5-bfc0-5ee3c2d050c3 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:01.777178 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b8ffe932-16c2-43b5-bfc0-5ee3c2d050c3 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:01.777798 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b8ffe932-16c2-43b5-bfc0-5ee3c2d050c3 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:01.778348 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b8ffe932-16c2-43b5-bfc0-5ee3c2d050c3 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:01.815378 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6025186a-3451-4a49-937a-0992a35583ee tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262d5984b8c4775b86fae1c0d314718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc8f8cefbf441c98d6bda76e99e3173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:01.828153 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6025186a-3451-4a49-937a-0992a35583ee tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07" status: 200 len: 1354 microversion: 2.1 time: 0.219613 Oct 23 01:14:01.829314 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 505/962] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:01 2022] GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07 => generated 1354 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:01.906146 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-23c23ce3-ff6e-48f8-9e18-284e0e9bc51e tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:01.906933 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-23c23ce3-ff6e-48f8-9e18-284e0e9bc51e tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:01.916900 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-23c23ce3-ff6e-48f8-9e18-284e0e9bc51e tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:01.917844 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-23c23ce3-ff6e-48f8-9e18-284e0e9bc51e tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:01.919662 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-23c23ce3-ff6e-48f8-9e18-284e0e9bc51e tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:01.926884 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-23c23ce3-ff6e-48f8-9e18-284e0e9bc51e tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:01.926884 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-23c23ce3-ff6e-48f8-9e18-284e0e9bc51e tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:01.926884 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-23c23ce3-ff6e-48f8-9e18-284e0e9bc51e tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:02.009017 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-23c23ce3-ff6e-48f8-9e18-284e0e9bc51e tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:02.013724 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b8ffe932-16c2-43b5-bfc0-5ee3c2d050c3 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:02.017833 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-23c23ce3-ff6e-48f8-9e18-284e0e9bc51e tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:02.021685 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-23c23ce3-ff6e-48f8-9e18-284e0e9bc51e tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:02.023946 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b8ffe932-16c2-43b5-bfc0-5ee3c2d050c3 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:02.025686 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b8ffe932-16c2-43b5-bfc0-5ee3c2d050c3 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:02.027145 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b8ffe932-16c2-43b5-bfc0-5ee3c2d050c3 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21" status: 200 len: 1569 microversion: 2.25 time: 0.264930 Oct 23 01:14:02.028388 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 458/963] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:01 2022] GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21 => generated 1569 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:02.033183 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f0bb5fdb-3da6-4fca-8a67-4cc36c9a87df tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:02.034049 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f0bb5fdb-3da6-4fca-8a67-4cc36c9a87df tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f2a1666-1481-4519-9e9a-41909cd03da6] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:02.042687 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f0bb5fdb-3da6-4fca-8a67-4cc36c9a87df tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:02.044636 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f0bb5fdb-3da6-4fca-8a67-4cc36c9a87df tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:02.045380 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f0bb5fdb-3da6-4fca-8a67-4cc36c9a87df tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:02.046739 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f0bb5fdb-3da6-4fca-8a67-4cc36c9a87df tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:02.047353 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f0bb5fdb-3da6-4fca-8a67-4cc36c9a87df tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:02.047932 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f0bb5fdb-3da6-4fca-8a67-4cc36c9a87df tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:02.053093 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-23c23ce3-ff6e-48f8-9e18-284e0e9bc51e tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1553 microversion: 2.91 time: 0.151007 Oct 23 01:14:02.053767 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 506/964] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:01 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:14:02.088969 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-f0bb5fdb-3da6-4fca-8a67-4cc36c9a87df tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] HTTP exception thrown: Instance 8f2a1666-1481-4519-9e9a-41909cd03da6 could not be found. Oct 23 01:14:02.092497 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f0bb5fdb-3da6-4fca-8a67-4cc36c9a87df tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Request method failure captured: Oct 23 01:14:02.092497 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/8f2a1666-1481-4519-9e9a-41909cd03da6 HTTP/1.1 Oct 23 01:14:02.092497 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:14:02.092497 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:14:02.092497 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:14:02.092497 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:14:02.092497 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:14:02.092497 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:14:02.092497 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:14:02.092497 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:14:02.092497 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJTVplLO-qztXxG_HDLL4BH6TUJol2dB6z6DUNPFW9k310b4LZv5QpPDkoZhlrdq59k6Qs6f6BNo8v85mRnWdRNraQp3Vl4AO14KfdmEFg1RoGAnLZNH2F5_UNLb30n-rYZuom-6EDi63ydn3YnTT73OMWga6znvyJRBVfK8dEqr79c Oct 23 01:14:02.092497 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:14:02.092497 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:14:02.092497 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:14:02.092497 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:14:02.092497 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:14:02.092497 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:14:02.092497 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: e6bf637f9ea9423cb3e4e2c74d0382a7 Oct 23 01:14:02.092497 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersAdminTestJSON-634108158 Oct 23 01:14:02.092497 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:14:02.092497 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:14:02.094048 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e6bf637f9ea9423cb3e4e2c74d0382a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e6bf637f9ea9423cb3e4e2c74d0382a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e6bf637f9ea9423cb3e4e2c74d0382a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e6bf637f9ea9423cb3e4e2c74d0382a7"}]}] Oct 23 01:14:02.094048 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersAdminTestJSON-634108158 Oct 23 01:14:02.094048 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: e6bf637f9ea9423cb3e4e2c74d0382a7 Oct 23 01:14:02.094048 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersAdminTestJSON-634108158 Oct 23 01:14:02.094048 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersAdminTestJSON-634108158-project Oct 23 01:14:02.094048 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:14:02.094048 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:14:02.094048 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 275cdb98ca7a48f68441d6c934740df0 Oct 23 01:14:02.094048 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersAdminTestJSON-634108158-project Oct 23 01:14:02.094048 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:14:02.094048 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 8f2a1666-1481-4519-9e9a-41909cd03da6 could not be found. Oct 23 01:14:02.094048 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '8f2a1666-1481-4519-9e9a-41909cd03da6'} Oct 23 01:14:02.095274 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:14:02.095274 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:02.095274 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:14:02.095274 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:14:02.095274 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:14:02.095274 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:14:02.095274 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:14:02.095274 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:14:02.095274 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:14:02.095274 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:14:02.095274 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f2a1666-1481-4519-9e9a-41909cd03da6 could not be found. Oct 23 01:14:02.095274 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:14:02.095274 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:14:02.095274 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:14:02.095274 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:02.095274 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:14:02.095274 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:14:02.095274 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:14:02.095274 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:14:02.095274 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:14:02.096748 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:14:02.096748 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:14:02.096748 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:14:02.096748 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:14:02.096748 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:14:02.096748 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:14:02.096748 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:14:02.096748 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f2a1666-1481-4519-9e9a-41909cd03da6 could not be found. Oct 23 01:14:02.096748 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:14:02.096748 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:14:02.096748 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:14:02.096748 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:02.096748 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:14:02.096748 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:14:02.096748 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:14:02.096748 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:14:02.096748 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f2a1666-1481-4519-9e9a-41909cd03da6 could not be found. Oct 23 01:14:02.096748 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:14:02.102524 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f0bb5fdb-3da6-4fca-8a67-4cc36c9a87df tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Returning 404 to user: Instance 8f2a1666-1481-4519-9e9a-41909cd03da6 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:14:02.103556 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f0bb5fdb-3da6-4fca-8a67-4cc36c9a87df tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2a1666-1481-4519-9e9a-41909cd03da6" status: 404 len: 111 microversion: 2.1 time: 0.074054 Oct 23 01:14:02.108515 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 459/965] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:02 2022] GET /compute/v2.1/servers/8f2a1666-1481-4519-9e9a-41909cd03da6 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:14:02.112484 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4afbbd8a-e1b7-493f-908f-49fa1418035d tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:02.113613 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4afbbd8a-e1b7-493f-908f-49fa1418035d tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 46694c40-e6a6-48c1-a105-390bd0133d62] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:02.119863 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4afbbd8a-e1b7-493f-908f-49fa1418035d tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:02.120352 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4afbbd8a-e1b7-493f-908f-49fa1418035d tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:02.120793 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4afbbd8a-e1b7-493f-908f-49fa1418035d tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:02.121496 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4afbbd8a-e1b7-493f-908f-49fa1418035d tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:02.121957 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4afbbd8a-e1b7-493f-908f-49fa1418035d tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:02.122575 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4afbbd8a-e1b7-493f-908f-49fa1418035d tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:02.149817 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4afbbd8a-e1b7-493f-908f-49fa1418035d tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 46694c40-e6a6-48c1-a105-390bd0133d62] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:14:02.270542 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-a2c7acc9-40a8-4d4c-b796-0b4b8747d678 req-0b3e183e-1799-46ca-921d-93fa549fc353 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93d46a54-c775-4fc6-ad62-edf53bee2d07", "name": "network-vif-plugged", "status": "completed", "tag": "ee7f635a-8006-4ea3-ba81-b986f1e60bfa"}, {"server_uuid": "93d46a54-c775-4fc6-ad62-edf53bee2d07", "name": "network-vif-plugged", "status": "completed", "tag": "f15809ec-ef23-47b5-8334-7596b75bba15"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:14:02.282064 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-a2c7acc9-40a8-4d4c-b796-0b4b8747d678 req-0b3e183e-1799-46ca-921d-93fa549fc353 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:02.283202 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-a2c7acc9-40a8-4d4c-b796-0b4b8747d678 req-0b3e183e-1799-46ca-921d-93fa549fc353 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:02.283788 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-a2c7acc9-40a8-4d4c-b796-0b4b8747d678 req-0b3e183e-1799-46ca-921d-93fa549fc353 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:02.301700 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-a2c7acc9-40a8-4d4c-b796-0b4b8747d678 req-0b3e183e-1799-46ca-921d-93fa549fc353 service nova] Creating event network-vif-plugged:ee7f635a-8006-4ea3-ba81-b986f1e60bfa for instance 93d46a54-c775-4fc6-ad62-edf53bee2d07 on n-h2-master-1 Oct 23 01:14:02.302629 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-a2c7acc9-40a8-4d4c-b796-0b4b8747d678 req-0b3e183e-1799-46ca-921d-93fa549fc353 service nova] Creating event network-vif-plugged:f15809ec-ef23-47b5-8334-7596b75bba15 for instance 93d46a54-c775-4fc6-ad62-edf53bee2d07 on n-h2-master-1 Oct 23 01:14:02.310975 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-a2c7acc9-40a8-4d4c-b796-0b4b8747d678 req-0b3e183e-1799-46ca-921d-93fa549fc353 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044106 Oct 23 01:14:02.312235 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 460/966] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:14:02.428085 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=12,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:02.453435 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a7915a8b-131a-43a7-9e42-e5a27db14b65 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:02.454237 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a7915a8b-131a-43a7-9e42-e5a27db14b65 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: edb35c7d-9adc-4b53-9bef-147aadbeae5d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:02.463090 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a7915a8b-131a-43a7-9e42-e5a27db14b65 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:02.465391 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a7915a8b-131a-43a7-9e42-e5a27db14b65 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:02.465391 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a7915a8b-131a-43a7-9e42-e5a27db14b65 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:02.465391 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a7915a8b-131a-43a7-9e42-e5a27db14b65 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:02.465391 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a7915a8b-131a-43a7-9e42-e5a27db14b65 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:02.469071 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a7915a8b-131a-43a7-9e42-e5a27db14b65 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:02.494717 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4afbbd8a-e1b7-493f-908f-49fa1418035d tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "DELETE /compute/v2.1/servers/46694c40-e6a6-48c1-a105-390bd0133d62" status: 204 len: 0 microversion: 2.1 time: 0.385963 Oct 23 01:14:02.495363 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 507/967] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:14:02 2022] DELETE /compute/v2.1/servers/46694c40-e6a6-48c1-a105-390bd0133d62 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 23 01:14:02.514431 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9f2b0a2e-1527-487c-b89f-078a7e62da78 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:02.515375 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9f2b0a2e-1527-487c-b89f-078a7e62da78 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 46694c40-e6a6-48c1-a105-390bd0133d62] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:02.529403 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f2b0a2e-1527-487c-b89f-078a7e62da78 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:02.529889 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f2b0a2e-1527-487c-b89f-078a7e62da78 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:02.531388 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f2b0a2e-1527-487c-b89f-078a7e62da78 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:02.532103 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f2b0a2e-1527-487c-b89f-078a7e62da78 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:02.532569 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f2b0a2e-1527-487c-b89f-078a7e62da78 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:02.533167 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f2b0a2e-1527-487c-b89f-078a7e62da78 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:02.848686 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9f2b0a2e-1527-487c-b89f-078a7e62da78 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:02.857679 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9f2b0a2e-1527-487c-b89f-078a7e62da78 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/46694c40-e6a6-48c1-a105-390bd0133d62" status: 200 len: 1468 microversion: 2.1 time: 0.351832 Oct 23 01:14:02.862940 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 508/968] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:02 2022] GET /compute/v2.1/servers/46694c40-e6a6-48c1-a105-390bd0133d62 => generated 1468 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:14:02.877649 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a7915a8b-131a-43a7-9e42-e5a27db14b65 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:02.888148 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a7915a8b-131a-43a7-9e42-e5a27db14b65 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d" status: 200 len: 1475 microversion: 2.1 time: 0.439290 Oct 23 01:14:02.902846 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 461/969] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:02 2022] GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d => generated 1475 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:14:02.912735 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3df64d56-fece-40a9-868b-4557e55ae226 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:02.913727 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3df64d56-fece-40a9-868b-4557e55ae226 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 93d46a54-c775-4fc6-ad62-edf53bee2d07] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:02.921145 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3df64d56-fece-40a9-868b-4557e55ae226 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:02.921637 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3df64d56-fece-40a9-868b-4557e55ae226 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:02.922124 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3df64d56-fece-40a9-868b-4557e55ae226 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:02.922824 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3df64d56-fece-40a9-868b-4557e55ae226 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:02.923453 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3df64d56-fece-40a9-868b-4557e55ae226 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:02.924030 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3df64d56-fece-40a9-868b-4557e55ae226 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:03.120803 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0493717d-b16e-4b4c-8196-06d27f2d99d6 tempest-ImagesDeleteNegativeTestJSON-586919976 tempest-ImagesDeleteNegativeTestJSON-586919976-project] 10.222.0.42 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.256416 Oct 23 01:14:03.122897 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 509/970] 10.222.0.42 () {58 vars in 1128 bytes} [Sun Oct 23 01:14:02 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 23 01:14:03.131308 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9ad3692d-ae92-4b3a-bf3a-c7a32ea5fa79 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:03.132150 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9ad3692d-ae92-4b3a-bf3a-c7a32ea5fa79 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 283de315-fdcb-4c89-91e3-96aa3e822b21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:03.141018 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9ad3692d-ae92-4b3a-bf3a-c7a32ea5fa79 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:03.143924 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9ad3692d-ae92-4b3a-bf3a-c7a32ea5fa79 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:03.145054 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9ad3692d-ae92-4b3a-bf3a-c7a32ea5fa79 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:03.146143 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9ad3692d-ae92-4b3a-bf3a-c7a32ea5fa79 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:03.147546 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9ad3692d-ae92-4b3a-bf3a-c7a32ea5fa79 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:03.148461 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9ad3692d-ae92-4b3a-bf3a-c7a32ea5fa79 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:03.167212 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3df64d56-fece-40a9-868b-4557e55ae226 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262d5984b8c4775b86fae1c0d314718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc8f8cefbf441c98d6bda76e99e3173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:03.177039 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3df64d56-fece-40a9-868b-4557e55ae226 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07" status: 200 len: 1354 microversion: 2.1 time: 0.272828 Oct 23 01:14:03.197713 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 462/971] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:02 2022] GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07 => generated 1354 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:03.204377 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-35e9d2be-dfcd-4633-8166-b2beb031d877 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:03.205247 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-35e9d2be-dfcd-4633-8166-b2beb031d877 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:03.211602 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-35e9d2be-dfcd-4633-8166-b2beb031d877 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:03.212295 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-35e9d2be-dfcd-4633-8166-b2beb031d877 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:03.216489 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-35e9d2be-dfcd-4633-8166-b2beb031d877 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:03.216489 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-35e9d2be-dfcd-4633-8166-b2beb031d877 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:03.216489 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-35e9d2be-dfcd-4633-8166-b2beb031d877 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:03.216489 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-35e9d2be-dfcd-4633-8166-b2beb031d877 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:03.330171 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-35e9d2be-dfcd-4633-8166-b2beb031d877 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:03.344107 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-35e9d2be-dfcd-4633-8166-b2beb031d877 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:03.345678 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-35e9d2be-dfcd-4633-8166-b2beb031d877 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:03.352606 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-35e9d2be-dfcd-4633-8166-b2beb031d877 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1553 microversion: 2.91 time: 0.152034 Oct 23 01:14:03.353558 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 463/972] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:03 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:03.363770 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f6eea276-494e-49d8-9f41-52f093b735b9 tempest-ImagesDeleteNegativeTestJSON-586919976 tempest-ImagesDeleteNegativeTestJSON-586919976-project] Calling method '.version_select at 0x7f5cc2640d30>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:03.407123 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9ad3692d-ae92-4b3a-bf3a-c7a32ea5fa79 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:03.417314 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9ad3692d-ae92-4b3a-bf3a-c7a32ea5fa79 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:03.419319 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9ad3692d-ae92-4b3a-bf3a-c7a32ea5fa79 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:03.421679 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9ad3692d-ae92-4b3a-bf3a-c7a32ea5fa79 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21" status: 200 len: 1569 microversion: 2.25 time: 0.297356 Oct 23 01:14:03.425802 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 510/973] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:03 2022] GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21 => generated 1569 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:03.427328 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-f6eea276-494e-49d8-9f41-52f093b735b9 tempest-ImagesDeleteNegativeTestJSON-586919976 tempest-ImagesDeleteNegativeTestJSON-586919976-project] HTTP exception thrown: Image not found. Oct 23 01:14:03.447788 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f6eea276-494e-49d8-9f41-52f093b735b9 tempest-ImagesDeleteNegativeTestJSON-586919976 tempest-ImagesDeleteNegativeTestJSON-586919976-project] Request method failure captured: Oct 23 01:14:03.447788 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 23 01:14:03.447788 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:14:03.447788 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:14:03.447788 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:14:03.447788 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:14:03.447788 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:14:03.447788 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:14:03.447788 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:14:03.447788 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:14:03.447788 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJVaTZXA2rRnqcmNtthfNsRD91mVJlYR5w3x1G1mcB4al42SBa3U9oaEQbahrd0g_i1ATvq60XBRqIsUl-EkqSaADRUgJKoki30QdrcQZEwg8f642oUgSilpAVZVBqiOlTFSIO4zkEOMB9U5iemmBPwc5-u74ba_VEQpZFhFpxte_ME Oct 23 01:14:03.447788 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:14:03.447788 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:14:03.447788 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:14:03.447788 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:14:03.447788 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:14:03.447788 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:14:03.447788 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 68465df0a3cd4f3da1e5ba8956f16c3d Oct 23 01:14:03.447788 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-586919976 Oct 23 01:14:03.447788 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:14:03.447788 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:14:03.449260 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/68465df0a3cd4f3da1e5ba8956f16c3d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_68465df0a3cd4f3da1e5ba8956f16c3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/68465df0a3cd4f3da1e5ba8956f16c3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/68465df0a3cd4f3da1e5ba8956f16c3d"}]}] Oct 23 01:14:03.449260 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-586919976 Oct 23 01:14:03.449260 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 68465df0a3cd4f3da1e5ba8956f16c3d Oct 23 01:14:03.449260 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-586919976 Oct 23 01:14:03.449260 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ImagesDeleteNegativeTestJSON-586919976-project Oct 23 01:14:03.449260 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:14:03.449260 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:14:03.449260 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: f3c51a6267f14872b639612a6df38ac7 Oct 23 01:14:03.449260 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-586919976-project Oct 23 01:14:03.449260 n-d-master-1 devstack@n-api.service[120944]: method: Oct 23 01:14:03.449260 n-d-master-1 devstack@n-api.service[120944]: exception: Image not found. Oct 23 01:14:03.449260 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '-1'} Oct 23 01:14:03.449260 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:14:03.449260 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:03.450185 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 23 01:14:03.450185 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 23 01:14:03.450185 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 23 01:14:03.450185 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 23 01:14:03.450185 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 23 01:14:03.450185 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 23 01:14:03.450185 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 23 01:14:03.450185 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 23 01:14:03.450185 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 23 01:14:03.450185 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 23 01:14:03.450185 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 23 01:14:03.450185 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 23 01:14:03.450185 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 23 01:14:03.450185 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 23 01:14:03.450185 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 23 01:14:03.450185 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:14:03.450185 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:14:03.450185 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:14:03.450185 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:03.451308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 23 01:14:03.451308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 23 01:14:03.451308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 23 01:14:03.451308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 23 01:14:03.451308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 23 01:14:03.451308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 23 01:14:03.451308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 23 01:14:03.451308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:14:03.451308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:14:03.451308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:14:03.451308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:03.451308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:14:03.451308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:14:03.451308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:14:03.451308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:14:03.451308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:14:03.451308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:14:03.451308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:14:03.451308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:14:03.451308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 23 01:14:03.453931 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 23 01:14:03.453931 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 23 01:14:03.453931 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:14:03.453931 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:14:03.453931 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:14:03.453931 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:03.453931 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:14:03.453931 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:14:03.453931 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:14:03.453931 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:14:03.453931 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 23 01:14:03.453931 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:14:03.453931 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f6eea276-494e-49d8-9f41-52f093b735b9 tempest-ImagesDeleteNegativeTestJSON-586919976 tempest-ImagesDeleteNegativeTestJSON-586919976-project] Returning 404 to user: Image not found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:14:03.453931 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f6eea276-494e-49d8-9f41-52f093b735b9 tempest-ImagesDeleteNegativeTestJSON-586919976 tempest-ImagesDeleteNegativeTestJSON-586919976-project] 10.222.0.42 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.094515 Oct 23 01:14:03.453931 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 464/974] 10.222.0.42 () {58 vars in 1134 bytes} [Sun Oct 23 01:14:03 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:14:03.461519 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-849486c9-a196-41ed-b20c-ad675b4a3317 tempest-ImagesDeleteNegativeTestJSON-586919976 tempest-ImagesDeleteNegativeTestJSON-586919976-project] Calling method '.version_select at 0x7f5cc205dc10>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:03.500851 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-849486c9-a196-41ed-b20c-ad675b4a3317 tempest-ImagesDeleteNegativeTestJSON-586919976 tempest-ImagesDeleteNegativeTestJSON-586919976-project] HTTP exception thrown: Image not found. Oct 23 01:14:03.504140 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-849486c9-a196-41ed-b20c-ad675b4a3317 tempest-ImagesDeleteNegativeTestJSON-586919976 tempest-ImagesDeleteNegativeTestJSON-586919976-project] Request method failure captured: Oct 23 01:14:03.504140 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/images/3e2f6a34-6897-451e-9460-e17022fd962j HTTP/1.1 Oct 23 01:14:03.504140 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:14:03.504140 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:14:03.504140 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:14:03.504140 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:14:03.504140 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:14:03.504140 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:14:03.504140 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:14:03.504140 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:14:03.504140 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJVaTZXA2rRnqcmNtthfNsRD91mVJlYR5w3x1G1mcB4al42SBa3U9oaEQbahrd0g_i1ATvq60XBRqIsUl-EkqSaADRUgJKoki30QdrcQZEwg8f642oUgSilpAVZVBqiOlTFSIO4zkEOMB9U5iemmBPwc5-u74ba_VEQpZFhFpxte_ME Oct 23 01:14:03.504140 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:14:03.504140 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:14:03.504140 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:14:03.504140 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:14:03.504140 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:14:03.504140 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:14:03.504140 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 68465df0a3cd4f3da1e5ba8956f16c3d Oct 23 01:14:03.504140 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-586919976 Oct 23 01:14:03.504140 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:14:03.504140 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:14:03.505433 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/68465df0a3cd4f3da1e5ba8956f16c3d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_68465df0a3cd4f3da1e5ba8956f16c3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/68465df0a3cd4f3da1e5ba8956f16c3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/68465df0a3cd4f3da1e5ba8956f16c3d"}]}] Oct 23 01:14:03.505433 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-586919976 Oct 23 01:14:03.505433 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 68465df0a3cd4f3da1e5ba8956f16c3d Oct 23 01:14:03.505433 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-586919976 Oct 23 01:14:03.505433 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ImagesDeleteNegativeTestJSON-586919976-project Oct 23 01:14:03.505433 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:14:03.505433 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:14:03.505433 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: f3c51a6267f14872b639612a6df38ac7 Oct 23 01:14:03.505433 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-586919976-project Oct 23 01:14:03.505433 n-d-master-1 devstack@n-api.service[120945]: method: Oct 23 01:14:03.505433 n-d-master-1 devstack@n-api.service[120945]: exception: Image not found. Oct 23 01:14:03.505433 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '3e2f6a34-6897-451e-9460-e17022fd962j'} Oct 23 01:14:03.505433 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:14:03.506391 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:03.506391 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 23 01:14:03.506391 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 23 01:14:03.506391 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 23 01:14:03.506391 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 23 01:14:03.506391 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 23 01:14:03.506391 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 23 01:14:03.506391 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 23 01:14:03.506391 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 23 01:14:03.506391 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 23 01:14:03.506391 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 23 01:14:03.506391 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 23 01:14:03.506391 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 23 01:14:03.506391 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 23 01:14:03.506391 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 23 01:14:03.506391 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3e2f6a34-6897-451e-9460-e17022fd962j to delete Oct 23 01:14:03.506391 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:14:03.506391 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:14:03.506391 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:14:03.507547 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:03.507547 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 23 01:14:03.507547 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 23 01:14:03.507547 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 23 01:14:03.507547 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 23 01:14:03.507547 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 23 01:14:03.507547 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 23 01:14:03.507547 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3e2f6a34-6897-451e-9460-e17022fd962j could not be found. Oct 23 01:14:03.507547 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:14:03.507547 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:14:03.507547 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:14:03.507547 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:03.507547 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:14:03.507547 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:14:03.507547 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:14:03.507547 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:14:03.507547 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:14:03.507547 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:14:03.507547 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:14:03.507547 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:14:03.508798 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 23 01:14:03.508798 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 23 01:14:03.508798 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 23 01:14:03.508798 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:14:03.508798 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:14:03.508798 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:14:03.508798 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:03.508798 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:14:03.508798 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:14:03.508798 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:14:03.508798 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:14:03.508798 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 23 01:14:03.508798 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:14:03.508798 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-849486c9-a196-41ed-b20c-ad675b4a3317 tempest-ImagesDeleteNegativeTestJSON-586919976 tempest-ImagesDeleteNegativeTestJSON-586919976-project] Returning 404 to user: Image not found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:14:03.508798 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-849486c9-a196-41ed-b20c-ad675b4a3317 tempest-ImagesDeleteNegativeTestJSON-586919976 tempest-ImagesDeleteNegativeTestJSON-586919976-project] 10.222.0.42 "DELETE /compute/v2.1/images/3e2f6a34-6897-451e-9460-e17022fd962j" status: 404 len: 62 microversion: 2.1 time: 0.048518 Oct 23 01:14:03.509684 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 511/975] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:03 2022] DELETE /compute/v2.1/images/3e2f6a34-6897-451e-9460-e17022fd962j => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:14:03.517595 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fb5bf6a2-ee52-4a29-b5b2-d574bd293203 tempest-ImagesDeleteNegativeTestJSON-586919976 tempest-ImagesDeleteNegativeTestJSON-586919976-project] Calling method '.version_select at 0x7f5cc1cd80d0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:03.535530 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-fb5bf6a2-ee52-4a29-b5b2-d574bd293203 tempest-ImagesDeleteNegativeTestJSON-586919976 tempest-ImagesDeleteNegativeTestJSON-586919976-project] HTTP exception thrown: Image not found. Oct 23 01:14:03.540219 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fb5bf6a2-ee52-4a29-b5b2-d574bd293203 tempest-ImagesDeleteNegativeTestJSON-586919976 tempest-ImagesDeleteNegativeTestJSON-586919976-project] Request method failure captured: Oct 23 01:14:03.540219 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/images/1ac848c7-f657-465c-8d58-152a9d6f224d1 HTTP/1.1 Oct 23 01:14:03.540219 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:14:03.540219 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:14:03.540219 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:14:03.540219 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:14:03.540219 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:14:03.540219 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:14:03.540219 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:14:03.540219 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:14:03.540219 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJVaTZXA2rRnqcmNtthfNsRD91mVJlYR5w3x1G1mcB4al42SBa3U9oaEQbahrd0g_i1ATvq60XBRqIsUl-EkqSaADRUgJKoki30QdrcQZEwg8f642oUgSilpAVZVBqiOlTFSIO4zkEOMB9U5iemmBPwc5-u74ba_VEQpZFhFpxte_ME Oct 23 01:14:03.540219 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:14:03.540219 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:14:03.540219 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:14:03.540219 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:14:03.540219 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:14:03.540219 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:14:03.540219 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 68465df0a3cd4f3da1e5ba8956f16c3d Oct 23 01:14:03.540219 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-586919976 Oct 23 01:14:03.540219 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:14:03.540219 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:14:03.541567 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/68465df0a3cd4f3da1e5ba8956f16c3d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_68465df0a3cd4f3da1e5ba8956f16c3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/68465df0a3cd4f3da1e5ba8956f16c3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/68465df0a3cd4f3da1e5ba8956f16c3d"}]}] Oct 23 01:14:03.541567 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-586919976 Oct 23 01:14:03.541567 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 68465df0a3cd4f3da1e5ba8956f16c3d Oct 23 01:14:03.541567 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-586919976 Oct 23 01:14:03.541567 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ImagesDeleteNegativeTestJSON-586919976-project Oct 23 01:14:03.541567 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:14:03.541567 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:14:03.541567 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: f3c51a6267f14872b639612a6df38ac7 Oct 23 01:14:03.541567 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-586919976-project Oct 23 01:14:03.541567 n-d-master-1 devstack@n-api.service[120944]: method: Oct 23 01:14:03.541567 n-d-master-1 devstack@n-api.service[120944]: exception: Image not found. Oct 23 01:14:03.541567 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '1ac848c7-f657-465c-8d58-152a9d6f224d1'} Oct 23 01:14:03.541567 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:14:03.550977 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:03.550977 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 23 01:14:03.550977 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 23 01:14:03.550977 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 23 01:14:03.550977 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 23 01:14:03.550977 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 23 01:14:03.550977 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 23 01:14:03.550977 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 23 01:14:03.550977 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 23 01:14:03.550977 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 23 01:14:03.550977 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 23 01:14:03.550977 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 23 01:14:03.550977 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 23 01:14:03.550977 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 23 01:14:03.550977 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 23 01:14:03.550977 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 1ac848c7-f657-465c-8d58-152a9d6f224d1 to delete Oct 23 01:14:03.550977 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:14:03.550977 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:14:03.550977 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:14:03.552731 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:03.552731 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 23 01:14:03.552731 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 23 01:14:03.552731 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 23 01:14:03.552731 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 23 01:14:03.552731 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 23 01:14:03.552731 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 23 01:14:03.552731 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1ac848c7-f657-465c-8d58-152a9d6f224d1 could not be found. Oct 23 01:14:03.552731 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:14:03.552731 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:14:03.552731 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:14:03.552731 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:03.552731 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:14:03.552731 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:14:03.552731 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:14:03.552731 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:14:03.552731 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:14:03.552731 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:14:03.552731 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:14:03.552731 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:14:03.555701 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 23 01:14:03.555701 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 23 01:14:03.555701 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 23 01:14:03.555701 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:14:03.555701 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:14:03.555701 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:14:03.555701 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:03.555701 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:14:03.555701 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:14:03.555701 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:14:03.555701 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:14:03.555701 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 23 01:14:03.555701 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:14:03.555701 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fb5bf6a2-ee52-4a29-b5b2-d574bd293203 tempest-ImagesDeleteNegativeTestJSON-586919976 tempest-ImagesDeleteNegativeTestJSON-586919976-project] Returning 404 to user: Image not found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:14:03.555701 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fb5bf6a2-ee52-4a29-b5b2-d574bd293203 tempest-ImagesDeleteNegativeTestJSON-586919976 tempest-ImagesDeleteNegativeTestJSON-586919976-project] 10.222.0.42 "DELETE /compute/v2.1/images/1ac848c7-f657-465c-8d58-152a9d6f224d1" status: 404 len: 62 microversion: 2.1 time: 0.029742 Oct 23 01:14:03.557460 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 465/976] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:14:03 2022] DELETE /compute/v2.1/images/1ac848c7-f657-465c-8d58-152a9d6f224d1 => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:14:03.557768 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-eae1c085-8ae5-4d82-a6ae-c3762bb79e84 tempest-ImagesDeleteNegativeTestJSON-586919976 tempest-ImagesDeleteNegativeTestJSON-586919976-project] Calling method '.version_select at 0x7f5cc209ac10>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:03.578238 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-eae1c085-8ae5-4d82-a6ae-c3762bb79e84 tempest-ImagesDeleteNegativeTestJSON-586919976 tempest-ImagesDeleteNegativeTestJSON-586919976-project] HTTP exception thrown: Image not found. Oct 23 01:14:03.579997 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-eae1c085-8ae5-4d82-a6ae-c3762bb79e84 tempest-ImagesDeleteNegativeTestJSON-586919976 tempest-ImagesDeleteNegativeTestJSON-586919976-project] Request method failure captured: Oct 23 01:14:03.579997 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/images/tempest-invalid-1145490528 HTTP/1.1 Oct 23 01:14:03.579997 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:14:03.579997 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:14:03.579997 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:14:03.579997 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:14:03.579997 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:14:03.579997 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:14:03.579997 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:14:03.579997 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:14:03.579997 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJVaTZXA2rRnqcmNtthfNsRD91mVJlYR5w3x1G1mcB4al42SBa3U9oaEQbahrd0g_i1ATvq60XBRqIsUl-EkqSaADRUgJKoki30QdrcQZEwg8f642oUgSilpAVZVBqiOlTFSIO4zkEOMB9U5iemmBPwc5-u74ba_VEQpZFhFpxte_ME Oct 23 01:14:03.579997 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:14:03.579997 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:14:03.579997 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:14:03.579997 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:14:03.579997 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:14:03.579997 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:14:03.579997 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 68465df0a3cd4f3da1e5ba8956f16c3d Oct 23 01:14:03.579997 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-586919976 Oct 23 01:14:03.579997 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:14:03.579997 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:14:03.581263 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/68465df0a3cd4f3da1e5ba8956f16c3d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_68465df0a3cd4f3da1e5ba8956f16c3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/68465df0a3cd4f3da1e5ba8956f16c3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/68465df0a3cd4f3da1e5ba8956f16c3d"}]}] Oct 23 01:14:03.581263 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-586919976 Oct 23 01:14:03.581263 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 68465df0a3cd4f3da1e5ba8956f16c3d Oct 23 01:14:03.581263 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-586919976 Oct 23 01:14:03.581263 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ImagesDeleteNegativeTestJSON-586919976-project Oct 23 01:14:03.581263 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:14:03.581263 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:14:03.581263 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: f3c51a6267f14872b639612a6df38ac7 Oct 23 01:14:03.581263 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-586919976-project Oct 23 01:14:03.581263 n-d-master-1 devstack@n-api.service[120945]: method: Oct 23 01:14:03.581263 n-d-master-1 devstack@n-api.service[120945]: exception: Image not found. Oct 23 01:14:03.581263 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'tempest-invalid-1145490528'} Oct 23 01:14:03.581263 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:14:03.582485 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:03.582485 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 23 01:14:03.582485 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 23 01:14:03.582485 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 23 01:14:03.582485 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 23 01:14:03.582485 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 23 01:14:03.582485 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 23 01:14:03.582485 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 23 01:14:03.582485 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 23 01:14:03.582485 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 23 01:14:03.582485 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 23 01:14:03.582485 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 23 01:14:03.582485 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 23 01:14:03.582485 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 23 01:14:03.582485 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 23 01:14:03.582485 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1145490528 to delete Oct 23 01:14:03.582485 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:14:03.582485 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:14:03.582485 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:14:03.583603 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:03.583603 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 23 01:14:03.583603 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 23 01:14:03.583603 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 23 01:14:03.583603 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 23 01:14:03.583603 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 23 01:14:03.583603 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 23 01:14:03.583603 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1145490528 could not be found. Oct 23 01:14:03.583603 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:14:03.583603 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:14:03.583603 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:14:03.583603 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:03.583603 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:14:03.583603 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:14:03.583603 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:14:03.583603 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:14:03.583603 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:14:03.583603 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:14:03.583603 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:14:03.583603 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:14:03.587278 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 23 01:14:03.587278 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 23 01:14:03.587278 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 23 01:14:03.587278 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:14:03.587278 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:14:03.587278 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:14:03.587278 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:03.587278 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:14:03.587278 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:14:03.587278 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:14:03.587278 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:14:03.587278 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 23 01:14:03.587278 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:14:03.587278 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-eae1c085-8ae5-4d82-a6ae-c3762bb79e84 tempest-ImagesDeleteNegativeTestJSON-586919976 tempest-ImagesDeleteNegativeTestJSON-586919976-project] Returning 404 to user: Image not found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:14:03.587278 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-eae1c085-8ae5-4d82-a6ae-c3762bb79e84 tempest-ImagesDeleteNegativeTestJSON-586919976 tempest-ImagesDeleteNegativeTestJSON-586919976-project] 10.222.0.42 "DELETE /compute/v2.1/images/tempest-invalid-1145490528" status: 404 len: 62 microversion: 2.1 time: 0.033129 Oct 23 01:14:03.589654 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 512/977] 10.222.0.42 () {58 vars in 1206 bytes} [Sun Oct 23 01:14:03 2022] DELETE /compute/v2.1/images/tempest-invalid-1145490528 => generated 62 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:14:03.593315 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-36787ad3-1798-44ba-9e67-62b6253652d6 tempest-ImagesDeleteNegativeTestJSON-586919976 tempest-ImagesDeleteNegativeTestJSON-586919976-project] Calling method '.version_select at 0x7f5cc243e8b0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:03.616423 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-36787ad3-1798-44ba-9e67-62b6253652d6 tempest-ImagesDeleteNegativeTestJSON-586919976 tempest-ImagesDeleteNegativeTestJSON-586919976-project] HTTP exception thrown: Image not found. Oct 23 01:14:03.618715 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-36787ad3-1798-44ba-9e67-62b6253652d6 tempest-ImagesDeleteNegativeTestJSON-586919976 tempest-ImagesDeleteNegativeTestJSON-586919976-project] Request method failure captured: Oct 23 01:14:03.618715 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/images/1c95bb1d-4418-40c4-8471-a5aa84902f99 HTTP/1.1 Oct 23 01:14:03.618715 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:14:03.618715 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:14:03.618715 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:14:03.618715 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:14:03.618715 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:14:03.618715 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:14:03.618715 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:14:03.618715 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:14:03.618715 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJVaTZXA2rRnqcmNtthfNsRD91mVJlYR5w3x1G1mcB4al42SBa3U9oaEQbahrd0g_i1ATvq60XBRqIsUl-EkqSaADRUgJKoki30QdrcQZEwg8f642oUgSilpAVZVBqiOlTFSIO4zkEOMB9U5iemmBPwc5-u74ba_VEQpZFhFpxte_ME Oct 23 01:14:03.618715 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:14:03.618715 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:14:03.618715 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:14:03.618715 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:14:03.618715 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:14:03.618715 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:14:03.618715 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 68465df0a3cd4f3da1e5ba8956f16c3d Oct 23 01:14:03.618715 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-586919976 Oct 23 01:14:03.618715 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:14:03.618715 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:14:03.619998 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/68465df0a3cd4f3da1e5ba8956f16c3d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_68465df0a3cd4f3da1e5ba8956f16c3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/68465df0a3cd4f3da1e5ba8956f16c3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/68465df0a3cd4f3da1e5ba8956f16c3d"}]}] Oct 23 01:14:03.619998 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-586919976 Oct 23 01:14:03.619998 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 68465df0a3cd4f3da1e5ba8956f16c3d Oct 23 01:14:03.619998 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-586919976 Oct 23 01:14:03.619998 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ImagesDeleteNegativeTestJSON-586919976-project Oct 23 01:14:03.619998 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:14:03.619998 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:14:03.619998 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: f3c51a6267f14872b639612a6df38ac7 Oct 23 01:14:03.619998 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-586919976-project Oct 23 01:14:03.619998 n-d-master-1 devstack@n-api.service[120944]: method: Oct 23 01:14:03.619998 n-d-master-1 devstack@n-api.service[120944]: exception: Image not found. Oct 23 01:14:03.619998 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '1c95bb1d-4418-40c4-8471-a5aa84902f99'} Oct 23 01:14:03.619998 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:14:03.620781 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:03.620781 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 23 01:14:03.620781 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 23 01:14:03.620781 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 23 01:14:03.620781 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 23 01:14:03.620781 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 23 01:14:03.620781 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 23 01:14:03.620781 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 23 01:14:03.620781 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 23 01:14:03.620781 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 23 01:14:03.620781 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 23 01:14:03.620781 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 23 01:14:03.620781 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 23 01:14:03.620781 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 23 01:14:03.620781 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 23 01:14:03.620781 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 1c95bb1d-4418-40c4-8471-a5aa84902f99 to delete Oct 23 01:14:03.620781 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:14:03.620781 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:14:03.620781 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:14:03.622091 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:03.622091 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 23 01:14:03.622091 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 23 01:14:03.622091 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 23 01:14:03.622091 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 23 01:14:03.622091 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 23 01:14:03.622091 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 23 01:14:03.622091 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1c95bb1d-4418-40c4-8471-a5aa84902f99 could not be found. Oct 23 01:14:03.622091 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:14:03.622091 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:14:03.622091 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:14:03.622091 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:03.622091 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:14:03.622091 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:14:03.622091 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:14:03.622091 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:14:03.622091 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:14:03.622091 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:14:03.622091 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:14:03.622091 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:14:03.623248 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 23 01:14:03.623248 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 23 01:14:03.623248 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 23 01:14:03.623248 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:14:03.623248 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:14:03.623248 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:14:03.623248 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:03.623248 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:14:03.623248 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:14:03.623248 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:14:03.623248 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:14:03.623248 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 23 01:14:03.623248 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:14:03.623248 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-36787ad3-1798-44ba-9e67-62b6253652d6 tempest-ImagesDeleteNegativeTestJSON-586919976 tempest-ImagesDeleteNegativeTestJSON-586919976-project] Returning 404 to user: Image not found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:14:03.623248 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-36787ad3-1798-44ba-9e67-62b6253652d6 tempest-ImagesDeleteNegativeTestJSON-586919976 tempest-ImagesDeleteNegativeTestJSON-586919976-project] 10.222.0.42 "DELETE /compute/v2.1/images/1c95bb1d-4418-40c4-8471-a5aa84902f99" status: 404 len: 62 microversion: 2.1 time: 0.030691 Oct 23 01:14:03.624122 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 466/978] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:03 2022] DELETE /compute/v2.1/images/1c95bb1d-4418-40c4-8471-a5aa84902f99 => generated 62 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:14:03.897387 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-74461b01-5493-405b-9a3f-1d5959e19bbd tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:03.898856 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-74461b01-5493-405b-9a3f-1d5959e19bbd tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 46694c40-e6a6-48c1-a105-390bd0133d62] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:03.906469 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-74461b01-5493-405b-9a3f-1d5959e19bbd tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:03.907317 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-74461b01-5493-405b-9a3f-1d5959e19bbd tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:03.908310 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-74461b01-5493-405b-9a3f-1d5959e19bbd tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:03.909174 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-74461b01-5493-405b-9a3f-1d5959e19bbd tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:03.909806 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-74461b01-5493-405b-9a3f-1d5959e19bbd tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:03.910639 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-74461b01-5493-405b-9a3f-1d5959e19bbd tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:03.919769 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-283a75aa-4aaa-4ec5-b01a-ca345b324f27 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:03.924013 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-283a75aa-4aaa-4ec5-b01a-ca345b324f27 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: edb35c7d-9adc-4b53-9bef-147aadbeae5d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:03.943615 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-283a75aa-4aaa-4ec5-b01a-ca345b324f27 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:03.946765 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-283a75aa-4aaa-4ec5-b01a-ca345b324f27 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:03.949238 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-283a75aa-4aaa-4ec5-b01a-ca345b324f27 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:03.950509 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-283a75aa-4aaa-4ec5-b01a-ca345b324f27 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:03.952908 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-283a75aa-4aaa-4ec5-b01a-ca345b324f27 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:03.953343 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-283a75aa-4aaa-4ec5-b01a-ca345b324f27 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:04.298429 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-74461b01-5493-405b-9a3f-1d5959e19bbd tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:04.311651 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-74461b01-5493-405b-9a3f-1d5959e19bbd tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/46694c40-e6a6-48c1-a105-390bd0133d62" status: 200 len: 1468 microversion: 2.1 time: 0.422650 Oct 23 01:14:04.326759 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 513/979] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:03 2022] GET /compute/v2.1/servers/46694c40-e6a6-48c1-a105-390bd0133d62 => generated 1468 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:04.342787 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-059a7876-a373-40c5-b578-7cbe4fc548ec tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:04.343778 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-059a7876-a373-40c5-b578-7cbe4fc548ec tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 93d46a54-c775-4fc6-ad62-edf53bee2d07] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:04.355338 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-059a7876-a373-40c5-b578-7cbe4fc548ec tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:04.357248 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-059a7876-a373-40c5-b578-7cbe4fc548ec tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:04.358536 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-059a7876-a373-40c5-b578-7cbe4fc548ec tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:04.359480 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-059a7876-a373-40c5-b578-7cbe4fc548ec tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:04.361001 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-059a7876-a373-40c5-b578-7cbe4fc548ec tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:04.361624 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-059a7876-a373-40c5-b578-7cbe4fc548ec tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:04.618290 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-283a75aa-4aaa-4ec5-b01a-ca345b324f27 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:04.618290 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-283a75aa-4aaa-4ec5-b01a-ca345b324f27 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d" status: 200 len: 1475 microversion: 2.1 time: 0.599650 Oct 23 01:14:04.618290 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 467/980] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:03 2022] GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d => generated 1475 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:14:04.618290 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-daf779e8-c101-47cd-b592-948d65f55aff tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:04.619832 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-daf779e8-c101-47cd-b592-948d65f55aff tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:04.619832 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-daf779e8-c101-47cd-b592-948d65f55aff tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:04.619832 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-daf779e8-c101-47cd-b592-948d65f55aff tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:04.619832 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-daf779e8-c101-47cd-b592-948d65f55aff tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:04.620540 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-daf779e8-c101-47cd-b592-948d65f55aff tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:04.620540 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-daf779e8-c101-47cd-b592-948d65f55aff tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:04.620540 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-daf779e8-c101-47cd-b592-948d65f55aff tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:04.640353 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-daf779e8-c101-47cd-b592-948d65f55aff tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:04.650302 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-daf779e8-c101-47cd-b592-948d65f55aff tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:04.651903 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-daf779e8-c101-47cd-b592-948d65f55aff tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:04.657787 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-daf779e8-c101-47cd-b592-948d65f55aff tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1553 microversion: 2.91 time: 0.142517 Oct 23 01:14:04.658555 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 468/981] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:04 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1553 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:04.670176 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8dfb06b1-a7c3-4ef3-84a5-c711daf99073 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:04.670176 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8dfb06b1-a7c3-4ef3-84a5-c711daf99073 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 283de315-fdcb-4c89-91e3-96aa3e822b21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:04.671826 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8dfb06b1-a7c3-4ef3-84a5-c711daf99073 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:04.672399 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8dfb06b1-a7c3-4ef3-84a5-c711daf99073 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:04.672923 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8dfb06b1-a7c3-4ef3-84a5-c711daf99073 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:04.673710 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8dfb06b1-a7c3-4ef3-84a5-c711daf99073 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:04.674262 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8dfb06b1-a7c3-4ef3-84a5-c711daf99073 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:04.674713 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8dfb06b1-a7c3-4ef3-84a5-c711daf99073 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:04.692134 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-059a7876-a373-40c5-b578-7cbe4fc548ec tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262d5984b8c4775b86fae1c0d314718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc8f8cefbf441c98d6bda76e99e3173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:04.703946 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-059a7876-a373-40c5-b578-7cbe4fc548ec tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07" status: 200 len: 1354 microversion: 2.1 time: 0.368797 Oct 23 01:14:04.704760 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 514/982] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:04 2022] GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07 => generated 1354 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:04.942767 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8dfb06b1-a7c3-4ef3-84a5-c711daf99073 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:04.959097 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8dfb06b1-a7c3-4ef3-84a5-c711daf99073 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:04.960612 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8dfb06b1-a7c3-4ef3-84a5-c711daf99073 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:04.962438 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8dfb06b1-a7c3-4ef3-84a5-c711daf99073 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21" status: 200 len: 1569 microversion: 2.25 time: 0.302681 Oct 23 01:14:04.963008 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 469/983] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:04 2022] GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21 => generated 1569 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:05.344703 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d8152566-2b15-4368-8d30-493118d05a4a tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:05.345356 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d8152566-2b15-4368-8d30-493118d05a4a tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 46694c40-e6a6-48c1-a105-390bd0133d62] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:05.357256 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d8152566-2b15-4368-8d30-493118d05a4a tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:05.376304 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d8152566-2b15-4368-8d30-493118d05a4a tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:05.376649 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d8152566-2b15-4368-8d30-493118d05a4a tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:05.383019 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d8152566-2b15-4368-8d30-493118d05a4a tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:05.384019 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d8152566-2b15-4368-8d30-493118d05a4a tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:05.384655 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d8152566-2b15-4368-8d30-493118d05a4a tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:05.639925 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dff3cfd4-b4db-4be2-90bb-533a467f4315 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:05.640796 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-dff3cfd4-b4db-4be2-90bb-533a467f4315 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: edb35c7d-9adc-4b53-9bef-147aadbeae5d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:05.656844 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dff3cfd4-b4db-4be2-90bb-533a467f4315 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:05.659544 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dff3cfd4-b4db-4be2-90bb-533a467f4315 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:05.660116 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dff3cfd4-b4db-4be2-90bb-533a467f4315 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:05.660946 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dff3cfd4-b4db-4be2-90bb-533a467f4315 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:05.662987 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dff3cfd4-b4db-4be2-90bb-533a467f4315 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:05.663530 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dff3cfd4-b4db-4be2-90bb-533a467f4315 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:05.722585 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d8152566-2b15-4368-8d30-493118d05a4a tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:05.735322 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d8152566-2b15-4368-8d30-493118d05a4a tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/46694c40-e6a6-48c1-a105-390bd0133d62" status: 200 len: 1468 microversion: 2.1 time: 0.394943 Oct 23 01:14:05.754006 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 515/984] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:05 2022] GET /compute/v2.1/servers/46694c40-e6a6-48c1-a105-390bd0133d62 => generated 1468 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:05.754006 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-af5a04ec-c7f3-48cd-8d3f-52d08d5fca53 req-02c1ffe4-a4a8-4ba2-927d-829288fdc349 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46694c40-e6a6-48c1-a105-390bd0133d62", "name": "network-vif-deleted", "tag": "650e2f7b-3221-4215-9990-463fd0ecbef4"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:14:05.804684 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-af5a04ec-c7f3-48cd-8d3f-52d08d5fca53 req-02c1ffe4-a4a8-4ba2-927d-829288fdc349 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:05.805273 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-af5a04ec-c7f3-48cd-8d3f-52d08d5fca53 req-02c1ffe4-a4a8-4ba2-927d-829288fdc349 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:05.807765 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-af5a04ec-c7f3-48cd-8d3f-52d08d5fca53 req-02c1ffe4-a4a8-4ba2-927d-829288fdc349 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:05.849700 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-af5a04ec-c7f3-48cd-8d3f-52d08d5fca53 req-02c1ffe4-a4a8-4ba2-927d-829288fdc349 service nova] Creating event network-vif-deleted:650e2f7b-3221-4215-9990-463fd0ecbef4 for instance 46694c40-e6a6-48c1-a105-390bd0133d62 on n-h1-master-1 Oct 23 01:14:05.869788 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-af5a04ec-c7f3-48cd-8d3f-52d08d5fca53 req-02c1ffe4-a4a8-4ba2-927d-829288fdc349 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121740 Oct 23 01:14:05.870502 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 516/985] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:14:05.896754 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-78e010ce-b5bc-4f7a-acc9-2d26ea3ff2da tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:05.897877 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-78e010ce-b5bc-4f7a-acc9-2d26ea3ff2da tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:05.918551 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78e010ce-b5bc-4f7a-acc9-2d26ea3ff2da tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:05.920382 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78e010ce-b5bc-4f7a-acc9-2d26ea3ff2da tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:05.922185 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78e010ce-b5bc-4f7a-acc9-2d26ea3ff2da tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:05.923150 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78e010ce-b5bc-4f7a-acc9-2d26ea3ff2da tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:05.924368 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78e010ce-b5bc-4f7a-acc9-2d26ea3ff2da tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:05.927009 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78e010ce-b5bc-4f7a-acc9-2d26ea3ff2da tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:06.148870 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-78e010ce-b5bc-4f7a-acc9-2d26ea3ff2da tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:06.158357 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-78e010ce-b5bc-4f7a-acc9-2d26ea3ff2da tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:06.166649 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-78e010ce-b5bc-4f7a-acc9-2d26ea3ff2da tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:06.182364 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-78e010ce-b5bc-4f7a-acc9-2d26ea3ff2da tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1553 microversion: 2.91 time: 0.306949 Oct 23 01:14:06.187495 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 517/986] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:05 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1553 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:06.198412 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2d54346c-5a32-4893-a410-11b173ac071b tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:06.199038 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2d54346c-5a32-4893-a410-11b173ac071b tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 93d46a54-c775-4fc6-ad62-edf53bee2d07] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:06.229759 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2d54346c-5a32-4893-a410-11b173ac071b tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:06.230311 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2d54346c-5a32-4893-a410-11b173ac071b tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:06.233776 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2d54346c-5a32-4893-a410-11b173ac071b tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:06.234599 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2d54346c-5a32-4893-a410-11b173ac071b tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:06.235271 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2d54346c-5a32-4893-a410-11b173ac071b tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:06.235714 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2d54346c-5a32-4893-a410-11b173ac071b tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:06.254571 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-dff3cfd4-b4db-4be2-90bb-533a467f4315 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:06.292901 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-dff3cfd4-b4db-4be2-90bb-533a467f4315 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d" status: 200 len: 1475 microversion: 2.1 time: 0.643703 Oct 23 01:14:06.294732 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 470/987] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:05 2022] GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d => generated 1475 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:14:06.323973 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-45131454-068f-40f5-8f0b-cc7f089bb1a0 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:06.324593 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-45131454-068f-40f5-8f0b-cc7f089bb1a0 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 283de315-fdcb-4c89-91e3-96aa3e822b21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:06.343013 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-45131454-068f-40f5-8f0b-cc7f089bb1a0 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:06.343517 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-45131454-068f-40f5-8f0b-cc7f089bb1a0 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:06.343944 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-45131454-068f-40f5-8f0b-cc7f089bb1a0 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:06.344650 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-45131454-068f-40f5-8f0b-cc7f089bb1a0 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:06.345094 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-45131454-068f-40f5-8f0b-cc7f089bb1a0 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:06.347128 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-45131454-068f-40f5-8f0b-cc7f089bb1a0 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:06.770526 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2d54346c-5a32-4893-a410-11b173ac071b tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262d5984b8c4775b86fae1c0d314718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc8f8cefbf441c98d6bda76e99e3173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:06.781334 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2d54346c-5a32-4893-a410-11b173ac071b tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07" status: 200 len: 1804 microversion: 2.1 time: 0.592707 Oct 23 01:14:06.782228 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 518/988] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:06 2022] GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07 => generated 1804 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:06.795342 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ac823f7f-0c43-478b-bd81-a7c49656100f tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:06.795970 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ac823f7f-0c43-478b-bd81-a7c49656100f tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 46694c40-e6a6-48c1-a105-390bd0133d62] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:06.807310 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ac823f7f-0c43-478b-bd81-a7c49656100f tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:06.807814 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ac823f7f-0c43-478b-bd81-a7c49656100f tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:06.808244 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ac823f7f-0c43-478b-bd81-a7c49656100f tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:06.809628 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ac823f7f-0c43-478b-bd81-a7c49656100f tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:06.811345 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ac823f7f-0c43-478b-bd81-a7c49656100f tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:06.815288 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ac823f7f-0c43-478b-bd81-a7c49656100f tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:06.822643 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-45131454-068f-40f5-8f0b-cc7f089bb1a0 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:06.839778 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-45131454-068f-40f5-8f0b-cc7f089bb1a0 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:06.843323 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-45131454-068f-40f5-8f0b-cc7f089bb1a0 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:06.844741 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-45131454-068f-40f5-8f0b-cc7f089bb1a0 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21" status: 200 len: 1569 microversion: 2.25 time: 0.547487 Oct 23 01:14:06.864053 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 471/989] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:06 2022] GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21 => generated 1569 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:06.871830 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-efffa964-cb88-47eb-a87c-ff9917b4cf39 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:06.872627 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-efffa964-cb88-47eb-a87c-ff9917b4cf39 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 93d46a54-c775-4fc6-ad62-edf53bee2d07] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:06.879239 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-efffa964-cb88-47eb-a87c-ff9917b4cf39 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:06.880012 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-efffa964-cb88-47eb-a87c-ff9917b4cf39 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:06.880651 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-efffa964-cb88-47eb-a87c-ff9917b4cf39 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:06.881363 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-efffa964-cb88-47eb-a87c-ff9917b4cf39 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:06.881824 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-efffa964-cb88-47eb-a87c-ff9917b4cf39 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:06.883049 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-efffa964-cb88-47eb-a87c-ff9917b4cf39 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:06.897893 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ac823f7f-0c43-478b-bd81-a7c49656100f tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:06.899817 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ac823f7f-0c43-478b-bd81-a7c49656100f tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:06.903260 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ac823f7f-0c43-478b-bd81-a7c49656100f tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:06.904754 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-ac823f7f-0c43-478b-bd81-a7c49656100f tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lazy-loading 'fault' on Instance uuid 46694c40-e6a6-48c1-a105-390bd0133d62 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:14:06.917820 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-efffa964-cb88-47eb-a87c-ff9917b4cf39 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07/ips" status: 200 len: 218 microversion: 2.1 time: 0.052379 Oct 23 01:14:06.922202 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 472/990] 10.222.0.42 () {58 vars in 1248 bytes} [Sun Oct 23 01:14:06 2022] GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07/ips => generated 218 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:14:06.935611 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7b061738-a12d-4152-8b22-a8d522997eee tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:06.936404 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7b061738-a12d-4152-8b22-a8d522997eee tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 93d46a54-c775-4fc6-ad62-edf53bee2d07] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:06.944712 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b061738-a12d-4152-8b22-a8d522997eee tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:06.946081 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b061738-a12d-4152-8b22-a8d522997eee tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:06.946672 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b061738-a12d-4152-8b22-a8d522997eee tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:06.949845 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b061738-a12d-4152-8b22-a8d522997eee tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:06.950994 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b061738-a12d-4152-8b22-a8d522997eee tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:06.951589 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b061738-a12d-4152-8b22-a8d522997eee tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:07.003352 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ac823f7f-0c43-478b-bd81-a7c49656100f tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:07.005334 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7b061738-a12d-4152-8b22-a8d522997eee tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 93d46a54-c775-4fc6-ad62-edf53bee2d07] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:14:07.016788 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ac823f7f-0c43-478b-bd81-a7c49656100f tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/46694c40-e6a6-48c1-a105-390bd0133d62" status: 200 len: 1303 microversion: 2.1 time: 0.231670 Oct 23 01:14:07.017407 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 519/991] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:06 2022] GET /compute/v2.1/servers/46694c40-e6a6-48c1-a105-390bd0133d62 => generated 1303 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:07.221644 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ad3c22ca-2f41-493b-8dee-de81efb5f60d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:07.222174 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ad3c22ca-2f41-493b-8dee-de81efb5f60d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:07.233480 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ad3c22ca-2f41-493b-8dee-de81efb5f60d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:07.234725 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ad3c22ca-2f41-493b-8dee-de81efb5f60d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:07.235244 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ad3c22ca-2f41-493b-8dee-de81efb5f60d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:07.236068 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ad3c22ca-2f41-493b-8dee-de81efb5f60d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:07.236633 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ad3c22ca-2f41-493b-8dee-de81efb5f60d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:07.237866 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ad3c22ca-2f41-493b-8dee-de81efb5f60d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:07.339098 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ad3c22ca-2f41-493b-8dee-de81efb5f60d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:07.348364 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ad3c22ca-2f41-493b-8dee-de81efb5f60d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:07.350164 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ad3c22ca-2f41-493b-8dee-de81efb5f60d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:07.356866 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ad3c22ca-2f41-493b-8dee-de81efb5f60d tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1553 microversion: 2.91 time: 0.139249 Oct 23 01:14:07.358324 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 520/992] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:07 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1553 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:07.363711 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6462b3c6-aedf-46c6-815e-77922be2ec88 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:07.364549 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6462b3c6-aedf-46c6-815e-77922be2ec88 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: edb35c7d-9adc-4b53-9bef-147aadbeae5d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:07.371680 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6462b3c6-aedf-46c6-815e-77922be2ec88 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:07.372399 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6462b3c6-aedf-46c6-815e-77922be2ec88 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:07.373038 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6462b3c6-aedf-46c6-815e-77922be2ec88 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:07.373926 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6462b3c6-aedf-46c6-815e-77922be2ec88 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:07.374552 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6462b3c6-aedf-46c6-815e-77922be2ec88 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:07.375138 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6462b3c6-aedf-46c6-815e-77922be2ec88 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:07.380789 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7b061738-a12d-4152-8b22-a8d522997eee tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "DELETE /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07" status: 204 len: 0 microversion: 2.1 time: 0.448671 Oct 23 01:14:07.383837 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 473/993] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:14:06 2022] DELETE /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:14:07.395182 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-85edab01-b5c6-4312-b268-f904224331d0 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:07.396512 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-85edab01-b5c6-4312-b268-f904224331d0 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 93d46a54-c775-4fc6-ad62-edf53bee2d07] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:07.406699 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-85edab01-b5c6-4312-b268-f904224331d0 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:07.407560 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-85edab01-b5c6-4312-b268-f904224331d0 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:07.418304 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-85edab01-b5c6-4312-b268-f904224331d0 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:07.421545 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-85edab01-b5c6-4312-b268-f904224331d0 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:07.422295 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-85edab01-b5c6-4312-b268-f904224331d0 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:07.427772 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-85edab01-b5c6-4312-b268-f904224331d0 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:07.463874 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:07.679996 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6462b3c6-aedf-46c6-815e-77922be2ec88 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:07.692800 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6462b3c6-aedf-46c6-815e-77922be2ec88 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d" status: 200 len: 1475 microversion: 2.1 time: 0.332916 Oct 23 01:14:07.695644 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 521/994] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:07 2022] GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d => generated 1475 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:07.764518 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-85edab01-b5c6-4312-b268-f904224331d0 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262d5984b8c4775b86fae1c0d314718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc8f8cefbf441c98d6bda76e99e3173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:07.773597 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-85edab01-b5c6-4312-b268-f904224331d0 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07" status: 200 len: 1810 microversion: 2.1 time: 0.383673 Oct 23 01:14:07.776643 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 474/995] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:07 2022] GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07 => generated 1810 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:14:07.876063 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1d528900-d41a-4c1d-bd67-07a40d4dd61e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:07.877316 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1d528900-d41a-4c1d-bd67-07a40d4dd61e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 283de315-fdcb-4c89-91e3-96aa3e822b21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:07.887204 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1d528900-d41a-4c1d-bd67-07a40d4dd61e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:07.887673 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1d528900-d41a-4c1d-bd67-07a40d4dd61e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:07.888118 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1d528900-d41a-4c1d-bd67-07a40d4dd61e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:07.894155 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1d528900-d41a-4c1d-bd67-07a40d4dd61e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:07.895771 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1d528900-d41a-4c1d-bd67-07a40d4dd61e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:07.896386 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1d528900-d41a-4c1d-bd67-07a40d4dd61e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:08.049427 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-75e92012-fddf-4fb8-8d76-b8337e3018ad tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:08.050775 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-75e92012-fddf-4fb8-8d76-b8337e3018ad tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 46694c40-e6a6-48c1-a105-390bd0133d62] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:08.058669 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-75e92012-fddf-4fb8-8d76-b8337e3018ad tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:08.068169 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-75e92012-fddf-4fb8-8d76-b8337e3018ad tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:08.068908 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-75e92012-fddf-4fb8-8d76-b8337e3018ad tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:08.070008 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-75e92012-fddf-4fb8-8d76-b8337e3018ad tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:08.076028 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-75e92012-fddf-4fb8-8d76-b8337e3018ad tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:08.077466 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-75e92012-fddf-4fb8-8d76-b8337e3018ad tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:08.106934 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1d528900-d41a-4c1d-bd67-07a40d4dd61e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:08.121847 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1d528900-d41a-4c1d-bd67-07a40d4dd61e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:08.123821 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1d528900-d41a-4c1d-bd67-07a40d4dd61e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:08.125214 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1d528900-d41a-4c1d-bd67-07a40d4dd61e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21" status: 200 len: 1559 microversion: 2.25 time: 0.253585 Oct 23 01:14:08.145747 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 522/996] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:07 2022] GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21 => generated 1559 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:08.148182 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-75e92012-fddf-4fb8-8d76-b8337e3018ad tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:08.148677 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-75e92012-fddf-4fb8-8d76-b8337e3018ad tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:08.149110 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-75e92012-fddf-4fb8-8d76-b8337e3018ad tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:08.149559 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-75e92012-fddf-4fb8-8d76-b8337e3018ad tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lazy-loading 'fault' on Instance uuid 46694c40-e6a6-48c1-a105-390bd0133d62 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:14:08.196618 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-75e92012-fddf-4fb8-8d76-b8337e3018ad tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:08.206726 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-75e92012-fddf-4fb8-8d76-b8337e3018ad tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/46694c40-e6a6-48c1-a105-390bd0133d62" status: 200 len: 1303 microversion: 2.1 time: 0.161567 Oct 23 01:14:08.208540 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 475/997] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:08 2022] GET /compute/v2.1/servers/46694c40-e6a6-48c1-a105-390bd0133d62 => generated 1303 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:08.213477 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1744eb01-bf68-40b8-b9a3-793f90446156 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Calling method '.version_select at 0x7f5cc1d3d820>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:08.217164 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1744eb01-bf68-40b8-b9a3-793f90446156 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:08.217639 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1744eb01-bf68-40b8-b9a3-793f90446156 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:08.218265 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1744eb01-bf68-40b8-b9a3-793f90446156 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:08.229005 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1744eb01-bf68-40b8-b9a3-793f90446156 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] 10.222.0.42 "GET /compute/v2.1/os-migrations" status: 200 len: 2365 microversion: 2.25 time: 0.019328 Oct 23 01:14:08.238515 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 476/998] 10.222.0.42 () {60 vars in 1184 bytes} [Sun Oct 23 01:14:08 2022] GET /compute/v2.1/os-migrations => generated 2365 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:08.246282 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-de87aefd-2b97-4d55-8a9e-5ea43cf7048b tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:08.247217 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-de87aefd-2b97-4d55-8a9e-5ea43cf7048b tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] [instance: 283de315-fdcb-4c89-91e3-96aa3e822b21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:08.255396 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-de87aefd-2b97-4d55-8a9e-5ea43cf7048b tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:08.256119 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-de87aefd-2b97-4d55-8a9e-5ea43cf7048b tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:08.256720 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-de87aefd-2b97-4d55-8a9e-5ea43cf7048b tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:08.257745 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-de87aefd-2b97-4d55-8a9e-5ea43cf7048b tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:08.258449 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-de87aefd-2b97-4d55-8a9e-5ea43cf7048b tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:08.259383 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-de87aefd-2b97-4d55-8a9e-5ea43cf7048b tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:08.428220 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-af117970-7148-4dcb-9493-952536a4cb4f tempest-FlavorsAccessTestJSON-86283018 tempest-FlavorsAccessTestJSON-86283018-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-194412845", "id": 1337041334, "os-flavor-access:is_public": "False"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:14:08.484405 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-de87aefd-2b97-4d55-8a9e-5ea43cf7048b tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lazy-loading 'services' on Instance uuid 283de315-fdcb-4c89-91e3-96aa3e822b21 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:14:08.517135 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-de87aefd-2b97-4d55-8a9e-5ea43cf7048b tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21" status: 200 len: 2052 microversion: 2.25 time: 0.276240 Oct 23 01:14:08.518089 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 477/999] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:08 2022] GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21 => generated 2052 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:08.532981 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-af117970-7148-4dcb-9493-952536a4cb4f tempest-FlavorsAccessTestJSON-86283018 tempest-FlavorsAccessTestJSON-86283018-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.385893 Oct 23 01:14:08.541921 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 523/1000] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:14:08 2022] POST /compute/v2.1/flavors => generated 430 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:14:08.548095 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-965771d3-46d4-4b3a-ad67-5a90b646b262 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:08.550775 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-efcc0059-da01-49e2-8f4a-618c42e12cc6 tempest-FlavorsAccessTestJSON-86283018 tempest-FlavorsAccessTestJSON-86283018-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "a7f8618ec61641c3b971d537b58399b2"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:14:08.551627 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-965771d3-46d4-4b3a-ad67-5a90b646b262 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:08.567370 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-965771d3-46d4-4b3a-ad67-5a90b646b262 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:08.567870 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-965771d3-46d4-4b3a-ad67-5a90b646b262 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:08.568345 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-965771d3-46d4-4b3a-ad67-5a90b646b262 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:08.569028 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-965771d3-46d4-4b3a-ad67-5a90b646b262 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:08.569513 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-965771d3-46d4-4b3a-ad67-5a90b646b262 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:08.569934 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-965771d3-46d4-4b3a-ad67-5a90b646b262 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:08.679073 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-965771d3-46d4-4b3a-ad67-5a90b646b262 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:08.695603 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-965771d3-46d4-4b3a-ad67-5a90b646b262 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:08.697643 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-965771d3-46d4-4b3a-ad67-5a90b646b262 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:08.711486 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-965771d3-46d4-4b3a-ad67-5a90b646b262 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1553 microversion: 2.91 time: 0.187891 Oct 23 01:14:08.714603 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 478/1001] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:08 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1553 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:08.735515 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ed61fcb3-7310-4ad2-984e-853b171ea29c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-507943837", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "f12f5541-6400-4914-829d-7bf5434dae5d"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:14:08.808005 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-efcc0059-da01-49e2-8f4a-618c42e12cc6 tempest-FlavorsAccessTestJSON-86283018 tempest-FlavorsAccessTestJSON-86283018-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors/1337041334/action" status: 200 len: 97 microversion: 2.1 time: 0.264876 Oct 23 01:14:08.818672 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 524/1002] 10.222.0.42 () {60 vars in 1200 bytes} [Sun Oct 23 01:14:08 2022] POST /compute/v2.1/flavors/1337041334/action => generated 97 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:14:08.824596 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e36f9135-1552-45cf-a5ee-bc17a17643d4 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:08.825218 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e36f9135-1552-45cf-a5ee-bc17a17643d4 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: edb35c7d-9adc-4b53-9bef-147aadbeae5d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:08.843718 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-ed61fcb3-7310-4ad2-984e-853b171ea29c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] validate_networks() for [('f12f5541-6400-4914-829d-7bf5434dae5d', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:14:08.848771 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e36f9135-1552-45cf-a5ee-bc17a17643d4 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:08.849753 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e36f9135-1552-45cf-a5ee-bc17a17643d4 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:08.851108 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e36f9135-1552-45cf-a5ee-bc17a17643d4 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:08.852212 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e36f9135-1552-45cf-a5ee-bc17a17643d4 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:08.852890 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e36f9135-1552-45cf-a5ee-bc17a17643d4 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:08.853491 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e36f9135-1552-45cf-a5ee-bc17a17643d4 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:08.881263 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:09.296196 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e36f9135-1552-45cf-a5ee-bc17a17643d4 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:09.313043 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e36f9135-1552-45cf-a5ee-bc17a17643d4 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d" status: 200 len: 1475 microversion: 2.1 time: 0.492786 Oct 23 01:14:09.327790 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 525/1003] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:08 2022] GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d => generated 1475 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:09.355528 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-83914425-f937-44ca-ab7f-ee01a53ef5ce tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:09.382645 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-83914425-f937-44ca-ab7f-ee01a53ef5ce tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 93d46a54-c775-4fc6-ad62-edf53bee2d07] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:09.423243 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83914425-f937-44ca-ab7f-ee01a53ef5ce tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:09.424047 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83914425-f937-44ca-ab7f-ee01a53ef5ce tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:09.431173 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83914425-f937-44ca-ab7f-ee01a53ef5ce tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:09.431173 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83914425-f937-44ca-ab7f-ee01a53ef5ce tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:09.431173 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83914425-f937-44ca-ab7f-ee01a53ef5ce tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:09.431173 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83914425-f937-44ca-ab7f-ee01a53ef5ce tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:10.195325 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-83914425-f937-44ca-ab7f-ee01a53ef5ce tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262d5984b8c4775b86fae1c0d314718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc8f8cefbf441c98d6bda76e99e3173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:10.195325 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-83914425-f937-44ca-ab7f-ee01a53ef5ce tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07" status: 200 len: 1810 microversion: 2.1 time: 0.833044 Oct 23 01:14:10.195325 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 526/1004] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:09 2022] GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07 => generated 1810 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:10.216846 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-ed61fcb3-7310-4ad2-984e-853b171ea29c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:14:10.217888 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-ed61fcb3-7310-4ad2-984e-853b171ea29c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:14:10.218943 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-ed61fcb3-7310-4ad2-984e-853b171ea29c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:14:10.219578 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-ed61fcb3-7310-4ad2-984e-853b171ea29c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:14:10.220184 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-ed61fcb3-7310-4ad2-984e-853b171ea29c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:14:10.245221 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ed61fcb3-7310-4ad2-984e-853b171ea29c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:10.246024 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ed61fcb3-7310-4ad2-984e-853b171ea29c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:10.247349 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ed61fcb3-7310-4ad2-984e-853b171ea29c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:10.248117 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ed61fcb3-7310-4ad2-984e-853b171ea29c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:10.248585 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ed61fcb3-7310-4ad2-984e-853b171ea29c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:10.249276 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ed61fcb3-7310-4ad2-984e-853b171ea29c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:10.315696 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-ed61fcb3-7310-4ad2-984e-853b171ea29c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Getting quotas for project ccc52d9ecfdf43f58b665d06e1008b52. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:14:10.315696 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-ed61fcb3-7310-4ad2-984e-853b171ea29c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Getting quotas for user 8a246c84d8f444d59c9d5becae78f75a and project ccc52d9ecfdf43f58b665d06e1008b52. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:14:10.339854 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ed61fcb3-7310-4ad2-984e-853b171ea29c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:14:10.342206 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ed61fcb3-7310-4ad2-984e-853b171ea29c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 8db307a5-7a1e-4791-8fa9-e934894238e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:14:10.460255 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5244197c-cbfa-4d44-b52a-3ffc1301d75c tempest-FlavorsAccessTestJSON-761171126 tempest-FlavorsAccessTestJSON-761171126-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:10.509231 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5244197c-cbfa-4d44-b52a-3ffc1301d75c tempest-FlavorsAccessTestJSON-761171126 tempest-FlavorsAccessTestJSON-761171126-project] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5411 microversion: 2.1 time: 0.343904 Oct 23 01:14:10.509967 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 527/1005] 10.222.0.42 () {58 vars in 1146 bytes} [Sun Oct 23 01:14:10 2022] GET /compute/v2.1/flavors/detail => generated 5411 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:10.516542 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e8008cff-e178-4bd4-bfcd-dfab92cea28e tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:10.517461 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e8008cff-e178-4bd4-bfcd-dfab92cea28e tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 46694c40-e6a6-48c1-a105-390bd0133d62] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:10.525442 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8008cff-e178-4bd4-bfcd-dfab92cea28e tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:10.526240 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8008cff-e178-4bd4-bfcd-dfab92cea28e tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:10.526970 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8008cff-e178-4bd4-bfcd-dfab92cea28e tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:10.527875 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8008cff-e178-4bd4-bfcd-dfab92cea28e tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:10.528551 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8008cff-e178-4bd4-bfcd-dfab92cea28e tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:10.529427 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8008cff-e178-4bd4-bfcd-dfab92cea28e tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:10.556423 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ed61fcb3-7310-4ad2-984e-853b171ea29c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.840440 Oct 23 01:14:10.559879 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 479/1006] 10.222.0.42 () {62 vars in 1188 bytes} [Sun Oct 23 01:14:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1845 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 23 01:14:10.571182 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-baf5b265-9d97-40f2-993d-edf2b9dda709 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:10.579174 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-e8008cff-e178-4bd4-bfcd-dfab92cea28e tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] HTTP exception thrown: Instance 46694c40-e6a6-48c1-a105-390bd0133d62 could not be found. Oct 23 01:14:10.582345 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e8008cff-e178-4bd4-bfcd-dfab92cea28e tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Request method failure captured: Oct 23 01:14:10.582345 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/46694c40-e6a6-48c1-a105-390bd0133d62 HTTP/1.1 Oct 23 01:14:10.582345 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:14:10.582345 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:14:10.582345 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:14:10.582345 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:14:10.582345 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:14:10.582345 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:14:10.582345 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:14:10.582345 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:14:10.582345 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJTVplLO-qztXxG_HDLL4BH6TUJol2dB6z6DUNPFW9k310b4LZv5QpPDkoZhlrdq59k6Qs6f6BNo8v85mRnWdRNraQp3Vl4AO14KfdmEFg1RoGAnLZNH2F5_UNLb30n-rYZuom-6EDi63ydn3YnTT73OMWga6znvyJRBVfK8dEqr79c Oct 23 01:14:10.582345 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:14:10.582345 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:14:10.582345 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:14:10.582345 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:14:10.582345 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:14:10.582345 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:14:10.582345 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: e6bf637f9ea9423cb3e4e2c74d0382a7 Oct 23 01:14:10.582345 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServersAdminTestJSON-634108158 Oct 23 01:14:10.582345 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:14:10.582345 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:14:10.583975 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e6bf637f9ea9423cb3e4e2c74d0382a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e6bf637f9ea9423cb3e4e2c74d0382a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e6bf637f9ea9423cb3e4e2c74d0382a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e6bf637f9ea9423cb3e4e2c74d0382a7"}]}] Oct 23 01:14:10.583975 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServersAdminTestJSON-634108158 Oct 23 01:14:10.583975 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: e6bf637f9ea9423cb3e4e2c74d0382a7 Oct 23 01:14:10.583975 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServersAdminTestJSON-634108158 Oct 23 01:14:10.583975 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServersAdminTestJSON-634108158-project Oct 23 01:14:10.583975 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:14:10.583975 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:14:10.583975 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 275cdb98ca7a48f68441d6c934740df0 Oct 23 01:14:10.583975 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServersAdminTestJSON-634108158-project Oct 23 01:14:10.583975 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:14:10.583975 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 46694c40-e6a6-48c1-a105-390bd0133d62 could not be found. Oct 23 01:14:10.583975 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '46694c40-e6a6-48c1-a105-390bd0133d62'} Oct 23 01:14:10.584887 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:14:10.584887 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:10.584887 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:14:10.584887 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:14:10.584887 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:14:10.584887 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:14:10.584887 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:14:10.584887 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:14:10.584887 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:14:10.584887 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:14:10.584887 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46694c40-e6a6-48c1-a105-390bd0133d62 could not be found. Oct 23 01:14:10.584887 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:14:10.584887 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:14:10.584887 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:14:10.584887 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:10.584887 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:14:10.584887 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:14:10.584887 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:14:10.584887 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:14:10.584887 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:14:10.586981 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:14:10.586981 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:14:10.586981 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:14:10.586981 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:14:10.586981 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:14:10.586981 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:14:10.586981 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:14:10.586981 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46694c40-e6a6-48c1-a105-390bd0133d62 could not be found. Oct 23 01:14:10.586981 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:14:10.586981 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:14:10.586981 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:14:10.586981 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:10.586981 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:14:10.586981 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:14:10.586981 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:14:10.586981 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:14:10.586981 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46694c40-e6a6-48c1-a105-390bd0133d62 could not be found. Oct 23 01:14:10.586981 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:14:10.589067 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-baf5b265-9d97-40f2-993d-edf2b9dda709 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:10.590152 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e8008cff-e178-4bd4-bfcd-dfab92cea28e tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Returning 404 to user: Instance 46694c40-e6a6-48c1-a105-390bd0133d62 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:14:10.592442 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e8008cff-e178-4bd4-bfcd-dfab92cea28e tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/46694c40-e6a6-48c1-a105-390bd0133d62" status: 404 len: 111 microversion: 2.1 time: 0.079897 Oct 23 01:14:10.593310 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 528/1007] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:10 2022] GET /compute/v2.1/servers/46694c40-e6a6-48c1-a105-390bd0133d62 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:14:10.597875 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-baf5b265-9d97-40f2-993d-edf2b9dda709 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:10.599179 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d0bab3d3-3e99-4cae-ba49-9fa0da835083 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:10.599669 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-baf5b265-9d97-40f2-993d-edf2b9dda709 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:10.600309 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-baf5b265-9d97-40f2-993d-edf2b9dda709 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:10.600941 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d0bab3d3-3e99-4cae-ba49-9fa0da835083 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: edb35c7d-9adc-4b53-9bef-147aadbeae5d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:10.601915 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-baf5b265-9d97-40f2-993d-edf2b9dda709 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:10.602610 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-baf5b265-9d97-40f2-993d-edf2b9dda709 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:10.603258 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-baf5b265-9d97-40f2-993d-edf2b9dda709 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:10.625221 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0bab3d3-3e99-4cae-ba49-9fa0da835083 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:10.630416 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0bab3d3-3e99-4cae-ba49-9fa0da835083 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:10.631353 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0bab3d3-3e99-4cae-ba49-9fa0da835083 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:10.632339 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0bab3d3-3e99-4cae-ba49-9fa0da835083 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:10.633044 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0bab3d3-3e99-4cae-ba49-9fa0da835083 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:10.634473 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0bab3d3-3e99-4cae-ba49-9fa0da835083 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:10.834905 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-baf5b265-9d97-40f2-993d-edf2b9dda709 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:10.851545 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-baf5b265-9d97-40f2-993d-edf2b9dda709 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:10.853954 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-baf5b265-9d97-40f2-993d-edf2b9dda709 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:10.866276 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-baf5b265-9d97-40f2-993d-edf2b9dda709 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1553 microversion: 2.91 time: 0.302922 Oct 23 01:14:10.869130 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 480/1008] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:10 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1553 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:10.887542 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-54a09d07-ea08-4319-9d1f-2c6544907afe tempest-FlavorsAccessTestJSON-86283018 tempest-FlavorsAccessTestJSON-86283018-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "a7f8618ec61641c3b971d537b58399b2"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:14:11.125239 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d0bab3d3-3e99-4cae-ba49-9fa0da835083 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:11.142576 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d0bab3d3-3e99-4cae-ba49-9fa0da835083 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d" status: 200 len: 1474 microversion: 2.1 time: 0.547990 Oct 23 01:14:11.169377 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 529/1009] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:10 2022] GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d => generated 1474 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:11.183245 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fb0ae111-0667-45b5-8b42-c0a70b57bab7 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:11.184041 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-fb0ae111-0667-45b5-8b42-c0a70b57bab7 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 8db307a5-7a1e-4791-8fa9-e934894238e9] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:11.202390 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-54a09d07-ea08-4319-9d1f-2c6544907afe tempest-FlavorsAccessTestJSON-86283018 tempest-FlavorsAccessTestJSON-86283018-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors/1337041334/action" status: 200 len: 21 microversion: 2.1 time: 0.331904 Oct 23 01:14:11.204459 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 481/1010] 10.222.0.42 () {60 vars in 1200 bytes} [Sun Oct 23 01:14:10 2022] POST /compute/v2.1/flavors/1337041334/action => generated 21 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:14:11.225753 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f840040a-a642-41b9-a837-22de8c45ec6e tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:11.230797 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f840040a-a642-41b9-a837-22de8c45ec6e tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f277484-b3ae-465e-90b7-8febafef9329] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:11.262641 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f840040a-a642-41b9-a837-22de8c45ec6e tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:11.262641 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f840040a-a642-41b9-a837-22de8c45ec6e tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:11.262641 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f840040a-a642-41b9-a837-22de8c45ec6e tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:11.262641 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f840040a-a642-41b9-a837-22de8c45ec6e tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:11.263161 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f840040a-a642-41b9-a837-22de8c45ec6e tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:11.263161 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f840040a-a642-41b9-a837-22de8c45ec6e tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:11.368525 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f840040a-a642-41b9-a837-22de8c45ec6e tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f277484-b3ae-465e-90b7-8febafef9329] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:14:11.545407 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-fb0ae111-0667-45b5-8b42-c0a70b57bab7 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:11.556545 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-fb0ae111-0667-45b5-8b42-c0a70b57bab7 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:11.558108 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-fb0ae111-0667-45b5-8b42-c0a70b57bab7 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:11.565290 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fb0ae111-0667-45b5-8b42-c0a70b57bab7 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9" status: 200 len: 1261 microversion: 2.25 time: 0.393533 Oct 23 01:14:11.565903 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 530/1011] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:11 2022] GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9 => generated 1261 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:11.580686 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-44486778-aa63-48c7-9096-24d18d109527 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:11.581682 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-44486778-aa63-48c7-9096-24d18d109527 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 93d46a54-c775-4fc6-ad62-edf53bee2d07] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:11.595640 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44486778-aa63-48c7-9096-24d18d109527 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:11.596465 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44486778-aa63-48c7-9096-24d18d109527 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:11.597184 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44486778-aa63-48c7-9096-24d18d109527 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:11.598150 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44486778-aa63-48c7-9096-24d18d109527 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:11.598761 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44486778-aa63-48c7-9096-24d18d109527 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:11.599361 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44486778-aa63-48c7-9096-24d18d109527 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:11.820775 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:DELETE=7,nova_api:SELECT=88,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:11.915300 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f840040a-a642-41b9-a837-22de8c45ec6e tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329" status: 204 len: 0 microversion: 2.1 time: 0.702807 Oct 23 01:14:11.920143 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 482/1012] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:14:11 2022] DELETE /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329 => generated 0 bytes in 712 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:14:11.927239 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7589684d-9597-49ab-ad0f-2cb44a4a7fc5 tempest-FlavorsAccessTestJSON-761171126 tempest-FlavorsAccessTestJSON-761171126-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:11.953079 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7589684d-9597-49ab-ad0f-2cb44a4a7fc5 tempest-FlavorsAccessTestJSON-761171126 tempest-FlavorsAccessTestJSON-761171126-project] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031299 Oct 23 01:14:11.954053 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 483/1013] 10.222.0.42 () {58 vars in 1146 bytes} [Sun Oct 23 01:14:11 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:11.959359 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-9298f2b9-de22-4ad5-9281-3aae2b18b186 req-f7f6229a-5d85-49f8-92ba-a5d990220a42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93d46a54-c775-4fc6-ad62-edf53bee2d07", "name": "network-vif-deleted", "tag": "5eb643b1-6a02-464c-baa5-53c3a3e51506"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:14:11.971338 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-9298f2b9-de22-4ad5-9281-3aae2b18b186 req-f7f6229a-5d85-49f8-92ba-a5d990220a42 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:11.972231 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-9298f2b9-de22-4ad5-9281-3aae2b18b186 req-f7f6229a-5d85-49f8-92ba-a5d990220a42 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:11.973007 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-9298f2b9-de22-4ad5-9281-3aae2b18b186 req-f7f6229a-5d85-49f8-92ba-a5d990220a42 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:12.004669 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-9298f2b9-de22-4ad5-9281-3aae2b18b186 req-f7f6229a-5d85-49f8-92ba-a5d990220a42 service nova] Creating event network-vif-deleted:5eb643b1-6a02-464c-baa5-53c3a3e51506 for instance 93d46a54-c775-4fc6-ad62-edf53bee2d07 on n-h2-master-1 Oct 23 01:14:12.013234 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-9298f2b9-de22-4ad5-9281-3aae2b18b186 req-f7f6229a-5d85-49f8-92ba-a5d990220a42 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057418 Oct 23 01:14:12.014262 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 484/1014] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:14:12.019892 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-44486778-aa63-48c7-9096-24d18d109527 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262d5984b8c4775b86fae1c0d314718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc8f8cefbf441c98d6bda76e99e3173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:12.021201 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f0635927-d2d9-4b95-b94c-9841c32924d9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:12.021913 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f0635927-d2d9-4b95-b94c-9841c32924d9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:12.030436 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f0635927-d2d9-4b95-b94c-9841c32924d9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:12.030930 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f0635927-d2d9-4b95-b94c-9841c32924d9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:12.031575 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f0635927-d2d9-4b95-b94c-9841c32924d9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:12.033029 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f0635927-d2d9-4b95-b94c-9841c32924d9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:12.033157 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-44486778-aa63-48c7-9096-24d18d109527 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07" status: 200 len: 1789 microversion: 2.1 time: 0.463601 Oct 23 01:14:12.033672 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f0635927-d2d9-4b95-b94c-9841c32924d9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:12.033797 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 531/1015] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:11 2022] GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07 => generated 1789 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:12.038504 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f0635927-d2d9-4b95-b94c-9841c32924d9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:12.039031 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-522d6518-9521-445f-8b5e-4ce87fd0aa2d tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:12.039837 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-522d6518-9521-445f-8b5e-4ce87fd0aa2d tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f277484-b3ae-465e-90b7-8febafef9329] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:12.046950 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-522d6518-9521-445f-8b5e-4ce87fd0aa2d tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:12.047645 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-522d6518-9521-445f-8b5e-4ce87fd0aa2d tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:12.048954 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-522d6518-9521-445f-8b5e-4ce87fd0aa2d tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:12.049821 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-522d6518-9521-445f-8b5e-4ce87fd0aa2d tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:12.062407 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-522d6518-9521-445f-8b5e-4ce87fd0aa2d tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:12.062407 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-522d6518-9521-445f-8b5e-4ce87fd0aa2d tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:12.225964 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f0635927-d2d9-4b95-b94c-9841c32924d9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:12.238327 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f0635927-d2d9-4b95-b94c-9841c32924d9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:12.239875 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f0635927-d2d9-4b95-b94c-9841c32924d9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:12.246187 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f0635927-d2d9-4b95-b94c-9841c32924d9 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1553 microversion: 2.91 time: 0.230146 Oct 23 01:14:12.279029 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 485/1016] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:12 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1553 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:12.290092 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-10d1f981-a90b-4b9a-886d-1b6708c2831f tempest-FlavorsAccessTestJSON-86283018 tempest-FlavorsAccessTestJSON-86283018-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:12.387645 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-522d6518-9521-445f-8b5e-4ce87fd0aa2d tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:12.396793 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-10d1f981-a90b-4b9a-886d-1b6708c2831f tempest-FlavorsAccessTestJSON-86283018 tempest-FlavorsAccessTestJSON-86283018-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/1337041334" status: 202 len: 0 microversion: 2.1 time: 0.116459 Oct 23 01:14:12.397384 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 486/1017] 10.222.0.42 () {58 vars in 1161 bytes} [Sun Oct 23 01:14:12 2022] DELETE /compute/v2.1/flavors/1337041334 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:14:12.398027 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-522d6518-9521-445f-8b5e-4ce87fd0aa2d tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329" status: 200 len: 1469 microversion: 2.1 time: 0.362860 Oct 23 01:14:12.399428 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 532/1018] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:12 2022] GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329 => generated 1469 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:12.402299 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-41a5679a-0446-4e11-8cfe-b301da4a19eb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:12.402920 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-41a5679a-0446-4e11-8cfe-b301da4a19eb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: edb35c7d-9adc-4b53-9bef-147aadbeae5d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:12.406435 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-43e53bf4-5c37-4187-91e2-12c3ccaba13e tempest-FlavorsAccessTestJSON-86283018 tempest-FlavorsAccessTestJSON-86283018-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:12.417549 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41a5679a-0446-4e11-8cfe-b301da4a19eb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:12.418079 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41a5679a-0446-4e11-8cfe-b301da4a19eb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:12.418528 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41a5679a-0446-4e11-8cfe-b301da4a19eb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:12.419499 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41a5679a-0446-4e11-8cfe-b301da4a19eb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:12.419968 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41a5679a-0446-4e11-8cfe-b301da4a19eb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:12.420396 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41a5679a-0446-4e11-8cfe-b301da4a19eb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:12.461520 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-43e53bf4-5c37-4187-91e2-12c3ccaba13e tempest-FlavorsAccessTestJSON-86283018 tempest-FlavorsAccessTestJSON-86283018-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.057900 Oct 23 01:14:12.465213 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 533/1019] 10.222.0.42 () {58 vars in 1146 bytes} [Sun Oct 23 01:14:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:14:12.490881 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-94d91f04-f8f9-409d-9220-86a824421ebd tempest-FlavorsAccessTestJSON-86283018 tempest-FlavorsAccessTestJSON-86283018-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1378411601", "id": 1236631848, "os-flavor-access:is_public": "False"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:14:12.584738 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-94d91f04-f8f9-409d-9220-86a824421ebd tempest-FlavorsAccessTestJSON-86283018 tempest-FlavorsAccessTestJSON-86283018-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.100533 Oct 23 01:14:12.587501 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 534/1020] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:14:12 2022] POST /compute/v2.1/flavors => generated 431 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:14:12.601629 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b98cfc50-373d-46f1-af5a-acc63daccf92 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:12.602567 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b98cfc50-373d-46f1-af5a-acc63daccf92 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 8db307a5-7a1e-4791-8fa9-e934894238e9] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:12.614649 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b98cfc50-373d-46f1-af5a-acc63daccf92 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:12.617511 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b98cfc50-373d-46f1-af5a-acc63daccf92 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:12.617511 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b98cfc50-373d-46f1-af5a-acc63daccf92 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:12.617742 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b98cfc50-373d-46f1-af5a-acc63daccf92 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:12.618200 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b98cfc50-373d-46f1-af5a-acc63daccf92 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:12.618951 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b98cfc50-373d-46f1-af5a-acc63daccf92 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:12.741640 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b98cfc50-373d-46f1-af5a-acc63daccf92 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:12.767434 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b98cfc50-373d-46f1-af5a-acc63daccf92 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:12.769018 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b98cfc50-373d-46f1-af5a-acc63daccf92 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:12.772160 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b98cfc50-373d-46f1-af5a-acc63daccf92 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9" status: 200 len: 1257 microversion: 2.25 time: 0.176216 Oct 23 01:14:12.772962 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 535/1021] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:12 2022] GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9 => generated 1257 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:12.780413 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b2283ac0-d7d4-4726-90ff-c108e3dc695a tempest-FlavorsAccessTestJSON-86283018 tempest-FlavorsAccessTestJSON-86283018-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:12.787433 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-41a5679a-0446-4e11-8cfe-b301da4a19eb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:12.801366 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-41a5679a-0446-4e11-8cfe-b301da4a19eb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d" status: 200 len: 1474 microversion: 2.1 time: 0.402676 Oct 23 01:14:12.810203 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b2283ac0-d7d4-4726-90ff-c108e3dc695a tempest-FlavorsAccessTestJSON-86283018 tempest-FlavorsAccessTestJSON-86283018-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/1236631848/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.034704 Oct 23 01:14:12.817809 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 536/1022] 10.222.0.42 () {58 vars in 1209 bytes} [Sun Oct 23 01:14:12 2022] GET /compute/v2.1/flavors/1236631848/os-flavor-access => generated 21 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:14:12.817948 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 487/1023] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:12 2022] GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d => generated 1474 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:12.822782 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-448c2caa-10f0-4811-b8fb-b6177cbd5bc3 tempest-FlavorsAccessTestJSON-86283018 tempest-FlavorsAccessTestJSON-86283018-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:12.875566 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-29a5a28f-d6f7-476d-8641-f69b5c278615 req-f87dbe64-6c31-49fa-bf87-c84d29ffe765 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edb35c7d-9adc-4b53-9bef-147aadbeae5d", "name": "network-vif-unplugged", "status": "completed", "tag": "13993c6b-8acd-482a-a3cf-1db8731b8846"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:14:12.888458 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-29a5a28f-d6f7-476d-8641-f69b5c278615 req-f87dbe64-6c31-49fa-bf87-c84d29ffe765 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:12.889089 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-29a5a28f-d6f7-476d-8641-f69b5c278615 req-f87dbe64-6c31-49fa-bf87-c84d29ffe765 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:12.891795 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-29a5a28f-d6f7-476d-8641-f69b5c278615 req-f87dbe64-6c31-49fa-bf87-c84d29ffe765 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:12.907147 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-29a5a28f-d6f7-476d-8641-f69b5c278615 req-f87dbe64-6c31-49fa-bf87-c84d29ffe765 service nova] Creating event network-vif-unplugged:13993c6b-8acd-482a-a3cf-1db8731b8846 for instance edb35c7d-9adc-4b53-9bef-147aadbeae5d on n-h1-master-1 Oct 23 01:14:12.916291 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [req-29a5a28f-d6f7-476d-8641-f69b5c278615 req-f87dbe64-6c31-49fa-bf87-c84d29ffe765 service nova] Instance edb35c7d-9adc-4b53-9bef-147aadbeae5d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1'} {{(pid=120944) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 23 01:14:12.922975 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-448c2caa-10f0-4811-b8fb-b6177cbd5bc3 tempest-FlavorsAccessTestJSON-86283018 tempest-FlavorsAccessTestJSON-86283018-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/1236631848" status: 202 len: 0 microversion: 2.1 time: 0.103396 Oct 23 01:14:12.923938 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 537/1024] 10.222.0.42 () {58 vars in 1161 bytes} [Sun Oct 23 01:14:12 2022] DELETE /compute/v2.1/flavors/1236631848 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:14:12.933309 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3991ac62-73cb-476b-bd2a-0a70e8c9c3ce tempest-FlavorsAccessTestJSON-86283018 tempest-FlavorsAccessTestJSON-86283018-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:12.943298 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-29a5a28f-d6f7-476d-8641-f69b5c278615 req-f87dbe64-6c31-49fa-bf87-c84d29ffe765 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072897 Oct 23 01:14:12.948515 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 488/1025] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:14:12.990570 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3991ac62-73cb-476b-bd2a-0a70e8c9c3ce tempest-FlavorsAccessTestJSON-86283018 tempest-FlavorsAccessTestJSON-86283018-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.062165 Oct 23 01:14:12.990955 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 538/1026] 10.222.0.42 () {58 vars in 1146 bytes} [Sun Oct 23 01:14:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:13.061557 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c59c6cdb-978c-439e-9364-66917a741a47 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:13.062615 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c59c6cdb-978c-439e-9364-66917a741a47 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 93d46a54-c775-4fc6-ad62-edf53bee2d07] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:13.083103 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c59c6cdb-978c-439e-9364-66917a741a47 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:13.083603 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c59c6cdb-978c-439e-9364-66917a741a47 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:13.084247 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c59c6cdb-978c-439e-9364-66917a741a47 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:13.087237 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c59c6cdb-978c-439e-9364-66917a741a47 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:13.087894 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c59c6cdb-978c-439e-9364-66917a741a47 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:13.088493 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c59c6cdb-978c-439e-9364-66917a741a47 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:13.296124 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-57e41495-58f8-45aa-9739-0fbabcfbf9fc tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:13.296758 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-57e41495-58f8-45aa-9739-0fbabcfbf9fc tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:13.306097 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-57e41495-58f8-45aa-9739-0fbabcfbf9fc tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:13.322369 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-57e41495-58f8-45aa-9739-0fbabcfbf9fc tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:13.322369 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-57e41495-58f8-45aa-9739-0fbabcfbf9fc tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:13.322369 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-57e41495-58f8-45aa-9739-0fbabcfbf9fc tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:13.322369 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-57e41495-58f8-45aa-9739-0fbabcfbf9fc tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:13.322914 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-57e41495-58f8-45aa-9739-0fbabcfbf9fc tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:13.486157 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-57e41495-58f8-45aa-9739-0fbabcfbf9fc tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:13.506141 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-57e41495-58f8-45aa-9739-0fbabcfbf9fc tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:13.506141 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-57e41495-58f8-45aa-9739-0fbabcfbf9fc tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:13.510199 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-57e41495-58f8-45aa-9739-0fbabcfbf9fc tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1535 microversion: 2.91 time: 0.218272 Oct 23 01:14:13.511461 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 539/1027] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:13 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1535 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:13.516718 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-142ec041-1796-4fe7-87da-065ac71c80b4 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:13.517563 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-142ec041-1796-4fe7-87da-065ac71c80b4 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f277484-b3ae-465e-90b7-8febafef9329] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:13.536497 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-142ec041-1796-4fe7-87da-065ac71c80b4 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:13.537381 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-142ec041-1796-4fe7-87da-065ac71c80b4 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:13.538173 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-142ec041-1796-4fe7-87da-065ac71c80b4 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:13.539906 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-142ec041-1796-4fe7-87da-065ac71c80b4 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:13.540708 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-142ec041-1796-4fe7-87da-065ac71c80b4 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:13.541290 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-142ec041-1796-4fe7-87da-065ac71c80b4 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:13.572328 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c59c6cdb-978c-439e-9364-66917a741a47 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262d5984b8c4775b86fae1c0d314718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc8f8cefbf441c98d6bda76e99e3173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:13.599098 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c59c6cdb-978c-439e-9364-66917a741a47 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07" status: 200 len: 1653 microversion: 2.1 time: 0.539356 Oct 23 01:14:13.604704 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 489/1028] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:13 2022] GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07 => generated 1653 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:13.802358 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-64936a06-ed41-4ab0-9b4f-0774e590769d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:13.810424 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-64936a06-ed41-4ab0-9b4f-0774e590769d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 8db307a5-7a1e-4791-8fa9-e934894238e9] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:13.810687 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-142ec041-1796-4fe7-87da-065ac71c80b4 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:13.816985 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-64936a06-ed41-4ab0-9b4f-0774e590769d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:13.817601 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-64936a06-ed41-4ab0-9b4f-0774e590769d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:13.818160 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-64936a06-ed41-4ab0-9b4f-0774e590769d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:13.819054 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-142ec041-1796-4fe7-87da-065ac71c80b4 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329" status: 200 len: 1469 microversion: 2.1 time: 0.306210 Oct 23 01:14:13.819912 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 540/1029] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:13 2022] GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329 => generated 1469 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:13.824805 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-64936a06-ed41-4ab0-9b4f-0774e590769d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:13.825562 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-64936a06-ed41-4ab0-9b4f-0774e590769d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:13.826216 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-64936a06-ed41-4ab0-9b4f-0774e590769d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:13.837071 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f4b651c2-46e8-47bf-b52c-6a7a1736a3e7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:13.846925 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f4b651c2-46e8-47bf-b52c-6a7a1736a3e7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: edb35c7d-9adc-4b53-9bef-147aadbeae5d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:13.855084 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f4b651c2-46e8-47bf-b52c-6a7a1736a3e7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:13.855891 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f4b651c2-46e8-47bf-b52c-6a7a1736a3e7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:13.856520 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f4b651c2-46e8-47bf-b52c-6a7a1736a3e7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:13.857540 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f4b651c2-46e8-47bf-b52c-6a7a1736a3e7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:13.858234 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f4b651c2-46e8-47bf-b52c-6a7a1736a3e7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:13.858854 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f4b651c2-46e8-47bf-b52c-6a7a1736a3e7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:14.039590 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-64936a06-ed41-4ab0-9b4f-0774e590769d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:14.049295 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-64936a06-ed41-4ab0-9b4f-0774e590769d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:14.059256 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-64936a06-ed41-4ab0-9b4f-0774e590769d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:14.060742 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-64936a06-ed41-4ab0-9b4f-0774e590769d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9" status: 200 len: 1313 microversion: 2.25 time: 0.262368 Oct 23 01:14:14.061309 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 490/1030] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:13 2022] GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9 => generated 1313 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:14.077889 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-6c2c992c-5dc9-4ac2-b6c0-163dd1661936 req-74c2a61a-d94d-478b-9d01-36b01e6c98bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93d46a54-c775-4fc6-ad62-edf53bee2d07", "name": "network-vif-deleted", "tag": "f15809ec-ef23-47b5-8334-7596b75bba15"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:14:14.097854 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-6c2c992c-5dc9-4ac2-b6c0-163dd1661936 req-74c2a61a-d94d-478b-9d01-36b01e6c98bd service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:14.098613 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-6c2c992c-5dc9-4ac2-b6c0-163dd1661936 req-74c2a61a-d94d-478b-9d01-36b01e6c98bd service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:14.099240 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-6c2c992c-5dc9-4ac2-b6c0-163dd1661936 req-74c2a61a-d94d-478b-9d01-36b01e6c98bd service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:14.115507 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-6c2c992c-5dc9-4ac2-b6c0-163dd1661936 req-74c2a61a-d94d-478b-9d01-36b01e6c98bd service nova] Creating event network-vif-deleted:f15809ec-ef23-47b5-8334-7596b75bba15 for instance 93d46a54-c775-4fc6-ad62-edf53bee2d07 on n-h2-master-1 Oct 23 01:14:14.121707 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-6c2c992c-5dc9-4ac2-b6c0-163dd1661936 req-74c2a61a-d94d-478b-9d01-36b01e6c98bd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056394 Oct 23 01:14:14.123032 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 491/1031] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:14:14.203601 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f4b651c2-46e8-47bf-b52c-6a7a1736a3e7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:14.212670 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f4b651c2-46e8-47bf-b52c-6a7a1736a3e7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d" status: 200 len: 1474 microversion: 2.1 time: 0.389830 Oct 23 01:14:14.214720 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 541/1032] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:13 2022] GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d => generated 1474 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:14.541848 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3474c4e5-3072-4700-922f-b6e3c06f46bf tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:14.542549 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3474c4e5-3072-4700-922f-b6e3c06f46bf tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:14.549337 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3474c4e5-3072-4700-922f-b6e3c06f46bf tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:14.549818 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3474c4e5-3072-4700-922f-b6e3c06f46bf tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:14.550284 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3474c4e5-3072-4700-922f-b6e3c06f46bf tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:14.550977 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3474c4e5-3072-4700-922f-b6e3c06f46bf tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:14.551428 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3474c4e5-3072-4700-922f-b6e3c06f46bf tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:14.551851 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3474c4e5-3072-4700-922f-b6e3c06f46bf tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:14.619063 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3474c4e5-3072-4700-922f-b6e3c06f46bf tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:14.621906 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0d22b9b5-1bfa-47bd-a38b-6f4bbff87d86 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:14.622851 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0d22b9b5-1bfa-47bd-a38b-6f4bbff87d86 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 93d46a54-c775-4fc6-ad62-edf53bee2d07] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:14.632010 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d22b9b5-1bfa-47bd-a38b-6f4bbff87d86 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:14.636297 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3474c4e5-3072-4700-922f-b6e3c06f46bf tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:14.636652 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d22b9b5-1bfa-47bd-a38b-6f4bbff87d86 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:14.637767 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d22b9b5-1bfa-47bd-a38b-6f4bbff87d86 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:14.640951 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3474c4e5-3072-4700-922f-b6e3c06f46bf tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:14.648928 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d22b9b5-1bfa-47bd-a38b-6f4bbff87d86 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:14.650714 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3474c4e5-3072-4700-922f-b6e3c06f46bf tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1535 microversion: 2.91 time: 0.114657 Oct 23 01:14:14.652417 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d22b9b5-1bfa-47bd-a38b-6f4bbff87d86 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:14.653944 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d22b9b5-1bfa-47bd-a38b-6f4bbff87d86 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:14.666433 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 492/1033] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:14 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1535 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:14.718619 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-f4cab83e-f906-4ab2-94d4-5e876393fc3a req-dcb6e44d-c573-45f8-812f-b239f14024f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f277484-b3ae-465e-90b7-8febafef9329", "name": "network-vif-deleted", "tag": "4af1b3a5-4e5f-45a7-ab54-f98595e2f6f7"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:14:14.728806 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-f4cab83e-f906-4ab2-94d4-5e876393fc3a req-dcb6e44d-c573-45f8-812f-b239f14024f0 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:14.729403 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-f4cab83e-f906-4ab2-94d4-5e876393fc3a req-dcb6e44d-c573-45f8-812f-b239f14024f0 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:14.729841 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-f4cab83e-f906-4ab2-94d4-5e876393fc3a req-dcb6e44d-c573-45f8-812f-b239f14024f0 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:14.746874 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-f4cab83e-f906-4ab2-94d4-5e876393fc3a req-dcb6e44d-c573-45f8-812f-b239f14024f0 service nova] Creating event network-vif-deleted:4af1b3a5-4e5f-45a7-ab54-f98595e2f6f7 for instance 8f277484-b3ae-465e-90b7-8febafef9329 on n-h1-master-1 Oct 23 01:14:14.752363 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-f4cab83e-f906-4ab2-94d4-5e876393fc3a req-dcb6e44d-c573-45f8-812f-b239f14024f0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037357 Oct 23 01:14:14.753041 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 493/1034] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:14:14.765273 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0d22b9b5-1bfa-47bd-a38b-6f4bbff87d86 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262d5984b8c4775b86fae1c0d314718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc8f8cefbf441c98d6bda76e99e3173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:14.776027 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0d22b9b5-1bfa-47bd-a38b-6f4bbff87d86 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07" status: 200 len: 1611 microversion: 2.1 time: 0.158843 Oct 23 01:14:14.777235 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 542/1035] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:14 2022] GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07 => generated 1611 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:14.845716 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d4305818-d7aa-45e5-a904-8734cae4fe99 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:14.846769 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d4305818-d7aa-45e5-a904-8734cae4fe99 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f277484-b3ae-465e-90b7-8febafef9329] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:14.857686 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d4305818-d7aa-45e5-a904-8734cae4fe99 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:14.858287 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d4305818-d7aa-45e5-a904-8734cae4fe99 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:14.858735 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d4305818-d7aa-45e5-a904-8734cae4fe99 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:14.859444 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d4305818-d7aa-45e5-a904-8734cae4fe99 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:14.859907 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d4305818-d7aa-45e5-a904-8734cae4fe99 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:14.860338 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d4305818-d7aa-45e5-a904-8734cae4fe99 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:14.936950 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d4305818-d7aa-45e5-a904-8734cae4fe99 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:14.946542 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d4305818-d7aa-45e5-a904-8734cae4fe99 tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329" status: 200 len: 1427 microversion: 2.1 time: 0.105286 Oct 23 01:14:14.950385 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 494/1036] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:14 2022] GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329 => generated 1427 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:14.978343 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-2b172470-8b10-40ea-833a-5b097e6bf1c2 req-ade6489a-2cac-4fcd-ae62-df143a4c3fb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93d46a54-c775-4fc6-ad62-edf53bee2d07", "name": "network-vif-unplugged", "status": "completed", "tag": "ee7f635a-8006-4ea3-ba81-b986f1e60bfa"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:14:14.988704 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-2b172470-8b10-40ea-833a-5b097e6bf1c2 req-ade6489a-2cac-4fcd-ae62-df143a4c3fb2 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:14.990115 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-2b172470-8b10-40ea-833a-5b097e6bf1c2 req-ade6489a-2cac-4fcd-ae62-df143a4c3fb2 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:14.990115 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-2b172470-8b10-40ea-833a-5b097e6bf1c2 req-ade6489a-2cac-4fcd-ae62-df143a4c3fb2 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:15.002791 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-2b172470-8b10-40ea-833a-5b097e6bf1c2 req-ade6489a-2cac-4fcd-ae62-df143a4c3fb2 service nova] Creating event network-vif-unplugged:ee7f635a-8006-4ea3-ba81-b986f1e60bfa for instance 93d46a54-c775-4fc6-ad62-edf53bee2d07 on n-h2-master-1 Oct 23 01:14:15.008043 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-2b172470-8b10-40ea-833a-5b097e6bf1c2 req-ade6489a-2cac-4fcd-ae62-df143a4c3fb2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035836 Oct 23 01:14:15.013049 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 543/1037] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:14:15.088856 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4a223dc6-3979-48ab-a867-99db0727110c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:15.089753 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4a223dc6-3979-48ab-a867-99db0727110c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 8db307a5-7a1e-4791-8fa9-e934894238e9] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:15.096123 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4a223dc6-3979-48ab-a867-99db0727110c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:15.096869 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4a223dc6-3979-48ab-a867-99db0727110c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:15.097530 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4a223dc6-3979-48ab-a867-99db0727110c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:15.098467 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4a223dc6-3979-48ab-a867-99db0727110c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:15.098923 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4a223dc6-3979-48ab-a867-99db0727110c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:15.099347 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4a223dc6-3979-48ab-a867-99db0727110c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:15.119287 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:15.185187 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4a223dc6-3979-48ab-a867-99db0727110c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:15.207388 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4a223dc6-3979-48ab-a867-99db0727110c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:15.209146 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4a223dc6-3979-48ab-a867-99db0727110c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:15.210406 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4a223dc6-3979-48ab-a867-99db0727110c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9" status: 200 len: 1313 microversion: 2.25 time: 0.125542 Oct 23 01:14:15.211236 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 495/1038] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:15 2022] GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9 => generated 1313 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:15.240061 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b40a160f-ed8f-4f36-a199-5435deb3c6eb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:15.240905 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b40a160f-ed8f-4f36-a199-5435deb3c6eb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: edb35c7d-9adc-4b53-9bef-147aadbeae5d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:15.255829 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b40a160f-ed8f-4f36-a199-5435deb3c6eb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:15.256478 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b40a160f-ed8f-4f36-a199-5435deb3c6eb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:15.257110 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b40a160f-ed8f-4f36-a199-5435deb3c6eb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:15.258120 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b40a160f-ed8f-4f36-a199-5435deb3c6eb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:15.258732 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b40a160f-ed8f-4f36-a199-5435deb3c6eb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:15.259329 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b40a160f-ed8f-4f36-a199-5435deb3c6eb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:15.444850 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b40a160f-ed8f-4f36-a199-5435deb3c6eb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:15.453061 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b40a160f-ed8f-4f36-a199-5435deb3c6eb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d" status: 200 len: 1472 microversion: 2.1 time: 0.218647 Oct 23 01:14:15.458827 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 544/1039] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:15 2022] GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d => generated 1472 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:15.689408 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-514d761b-9931-40d4-afca-a9c87e9c485a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:15.690696 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-514d761b-9931-40d4-afca-a9c87e9c485a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:15.698913 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-514d761b-9931-40d4-afca-a9c87e9c485a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:15.699792 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-514d761b-9931-40d4-afca-a9c87e9c485a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:15.700221 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-514d761b-9931-40d4-afca-a9c87e9c485a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:15.701217 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-514d761b-9931-40d4-afca-a9c87e9c485a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:15.701776 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-514d761b-9931-40d4-afca-a9c87e9c485a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:15.702231 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-514d761b-9931-40d4-afca-a9c87e9c485a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:15.804914 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-514d761b-9931-40d4-afca-a9c87e9c485a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:15.809047 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4f55f46f-a260-4bc5-ae9c-127f3a5eb0b2 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:15.812925 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4f55f46f-a260-4bc5-ae9c-127f3a5eb0b2 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 93d46a54-c775-4fc6-ad62-edf53bee2d07] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:15.831753 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f55f46f-a260-4bc5-ae9c-127f3a5eb0b2 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:15.832256 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f55f46f-a260-4bc5-ae9c-127f3a5eb0b2 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:15.832707 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f55f46f-a260-4bc5-ae9c-127f3a5eb0b2 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:15.833413 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f55f46f-a260-4bc5-ae9c-127f3a5eb0b2 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:15.835236 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f55f46f-a260-4bc5-ae9c-127f3a5eb0b2 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:15.836180 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-514d761b-9931-40d4-afca-a9c87e9c485a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:15.836685 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f55f46f-a260-4bc5-ae9c-127f3a5eb0b2 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:15.842351 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-514d761b-9931-40d4-afca-a9c87e9c485a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:15.853477 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-514d761b-9931-40d4-afca-a9c87e9c485a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1535 microversion: 2.91 time: 0.169225 Oct 23 01:14:15.877295 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 496/1040] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:15 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1535 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:15.893919 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f55f46f-a260-4bc5-ae9c-127f3a5eb0b2 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:15.894734 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f55f46f-a260-4bc5-ae9c-127f3a5eb0b2 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:15.895409 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f55f46f-a260-4bc5-ae9c-127f3a5eb0b2 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:15.896041 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-4f55f46f-a260-4bc5-ae9c-127f3a5eb0b2 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lazy-loading 'fault' on Instance uuid 93d46a54-c775-4fc6-ad62-edf53bee2d07 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:14:15.952561 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4f55f46f-a260-4bc5-ae9c-127f3a5eb0b2 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262d5984b8c4775b86fae1c0d314718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc8f8cefbf441c98d6bda76e99e3173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:15.973619 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5fef2426-5d56-4d86-9c50-7452af15cead tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:15.979203 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5fef2426-5d56-4d86-9c50-7452af15cead tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f277484-b3ae-465e-90b7-8febafef9329] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:15.982611 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4f55f46f-a260-4bc5-ae9c-127f3a5eb0b2 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07" status: 200 len: 1302 microversion: 2.1 time: 0.183850 Oct 23 01:14:15.984823 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 545/1041] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:15 2022] GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07 => generated 1302 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:15.986598 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5fef2426-5d56-4d86-9c50-7452af15cead tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:15.987431 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5fef2426-5d56-4d86-9c50-7452af15cead tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:15.988787 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5fef2426-5d56-4d86-9c50-7452af15cead tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:15.989640 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5fef2426-5d56-4d86-9c50-7452af15cead tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:15.990233 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5fef2426-5d56-4d86-9c50-7452af15cead tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:15.991166 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5fef2426-5d56-4d86-9c50-7452af15cead tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:16.047659 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5fef2426-5d56-4d86-9c50-7452af15cead tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:16.048263 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5fef2426-5d56-4d86-9c50-7452af15cead tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:16.048889 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5fef2426-5d56-4d86-9c50-7452af15cead tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:16.049440 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-5fef2426-5d56-4d86-9c50-7452af15cead tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lazy-loading 'fault' on Instance uuid 8f277484-b3ae-465e-90b7-8febafef9329 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:14:16.136445 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5fef2426-5d56-4d86-9c50-7452af15cead tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275cdb98ca7a48f68441d6c934740df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:16.151777 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5fef2426-5d56-4d86-9c50-7452af15cead tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329" status: 200 len: 1303 microversion: 2.1 time: 0.184274 Oct 23 01:14:16.158501 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-73f8aa2a-8c30-4300-bc9d-55bcddc23eb8 req-56a412c5-e194-4c52-aee6-9ab8bdda5dd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93d46a54-c775-4fc6-ad62-edf53bee2d07", "name": "network-vif-deleted", "tag": "ee7f635a-8006-4ea3-ba81-b986f1e60bfa"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:14:16.177879 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 497/1042] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:15 2022] GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329 => generated 1303 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:16.187150 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-73f8aa2a-8c30-4300-bc9d-55bcddc23eb8 req-56a412c5-e194-4c52-aee6-9ab8bdda5dd4 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:16.187930 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-73f8aa2a-8c30-4300-bc9d-55bcddc23eb8 req-56a412c5-e194-4c52-aee6-9ab8bdda5dd4 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:16.188682 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-73f8aa2a-8c30-4300-bc9d-55bcddc23eb8 req-56a412c5-e194-4c52-aee6-9ab8bdda5dd4 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:16.207263 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-73f8aa2a-8c30-4300-bc9d-55bcddc23eb8 req-56a412c5-e194-4c52-aee6-9ab8bdda5dd4 service nova] Creating event network-vif-deleted:ee7f635a-8006-4ea3-ba81-b986f1e60bfa for instance 93d46a54-c775-4fc6-ad62-edf53bee2d07 on n-h2-master-1 Oct 23 01:14:16.220873 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-73f8aa2a-8c30-4300-bc9d-55bcddc23eb8 req-56a412c5-e194-4c52-aee6-9ab8bdda5dd4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067362 Oct 23 01:14:16.225651 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 546/1043] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:14:16.236889 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-94f294b9-1816-4268-a911-8952b0c271fc tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:16.237527 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-94f294b9-1816-4268-a911-8952b0c271fc tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 8db307a5-7a1e-4791-8fa9-e934894238e9] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:16.247812 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-94f294b9-1816-4268-a911-8952b0c271fc tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:16.248323 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-94f294b9-1816-4268-a911-8952b0c271fc tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:16.252053 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-94f294b9-1816-4268-a911-8952b0c271fc tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:16.252945 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-94f294b9-1816-4268-a911-8952b0c271fc tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:16.253444 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-94f294b9-1816-4268-a911-8952b0c271fc tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:16.253888 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-94f294b9-1816-4268-a911-8952b0c271fc tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:16.359565 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-94f294b9-1816-4268-a911-8952b0c271fc tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:16.373497 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-94f294b9-1816-4268-a911-8952b0c271fc tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:16.375053 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-94f294b9-1816-4268-a911-8952b0c271fc tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:16.376123 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-94f294b9-1816-4268-a911-8952b0c271fc tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9" status: 200 len: 1319 microversion: 2.25 time: 0.143372 Oct 23 01:14:16.376683 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 498/1044] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:16 2022] GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9 => generated 1319 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:16.481517 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-26985e81-c13a-4ecb-84e9-0292a8846e39 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:16.482486 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-26985e81-c13a-4ecb-84e9-0292a8846e39 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: edb35c7d-9adc-4b53-9bef-147aadbeae5d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:16.484926 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:16.498761 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-26985e81-c13a-4ecb-84e9-0292a8846e39 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:16.499566 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-26985e81-c13a-4ecb-84e9-0292a8846e39 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:16.500250 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-26985e81-c13a-4ecb-84e9-0292a8846e39 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:16.502754 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-26985e81-c13a-4ecb-84e9-0292a8846e39 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:16.504044 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-26985e81-c13a-4ecb-84e9-0292a8846e39 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:16.504695 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-26985e81-c13a-4ecb-84e9-0292a8846e39 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:16.770253 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-26985e81-c13a-4ecb-84e9-0292a8846e39 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:16.781617 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-26985e81-c13a-4ecb-84e9-0292a8846e39 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d" status: 200 len: 1469 microversion: 2.1 time: 0.307457 Oct 23 01:14:16.793581 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 547/1045] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:16 2022] GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d => generated 1469 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:16.809365 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-565438c9-1c68-41a2-a550-684847a731c8 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:14:16.809947 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-565438c9-1c68-41a2-a550-684847a731c8 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: edb35c7d-9adc-4b53-9bef-147aadbeae5d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:16.827997 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-565438c9-1c68-41a2-a550-684847a731c8 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:16.828208 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-565438c9-1c68-41a2-a550-684847a731c8 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:16.828539 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-565438c9-1c68-41a2-a550-684847a731c8 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:16.829272 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-565438c9-1c68-41a2-a550-684847a731c8 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:16.829833 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-565438c9-1c68-41a2-a550-684847a731c8 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:16.830295 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-565438c9-1c68-41a2-a550-684847a731c8 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:16.884694 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c5035497-0aa4-4636-ad33-7f55fa73f2f6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:16.885364 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c5035497-0aa4-4636-ad33-7f55fa73f2f6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:16.894753 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c5035497-0aa4-4636-ad33-7f55fa73f2f6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:16.897205 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c5035497-0aa4-4636-ad33-7f55fa73f2f6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:16.897367 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c5035497-0aa4-4636-ad33-7f55fa73f2f6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:16.905244 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c5035497-0aa4-4636-ad33-7f55fa73f2f6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:16.906969 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c5035497-0aa4-4636-ad33-7f55fa73f2f6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:16.907582 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c5035497-0aa4-4636-ad33-7f55fa73f2f6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:17.115377 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c5035497-0aa4-4636-ad33-7f55fa73f2f6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:17.133078 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c5035497-0aa4-4636-ad33-7f55fa73f2f6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:17.135411 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c5035497-0aa4-4636-ad33-7f55fa73f2f6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:17.144468 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c5035497-0aa4-4636-ad33-7f55fa73f2f6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1538 microversion: 2.91 time: 0.263107 Oct 23 01:14:17.147436 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 548/1046] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:16 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1538 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:14:17.165198 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b2fe1b38-6686-4b24-b0c4-9e10c8ab1855 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:17.165198 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b2fe1b38-6686-4b24-b0c4-9e10c8ab1855 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 93d46a54-c775-4fc6-ad62-edf53bee2d07] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:17.171815 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b2fe1b38-6686-4b24-b0c4-9e10c8ab1855 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:17.172578 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b2fe1b38-6686-4b24-b0c4-9e10c8ab1855 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:17.173379 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b2fe1b38-6686-4b24-b0c4-9e10c8ab1855 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:17.175080 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b2fe1b38-6686-4b24-b0c4-9e10c8ab1855 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:17.175714 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b2fe1b38-6686-4b24-b0c4-9e10c8ab1855 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:17.176388 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b2fe1b38-6686-4b24-b0c4-9e10c8ab1855 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:17.179051 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-565438c9-1c68-41a2-a550-684847a731c8 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "POST /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d/action" status: 204 len: 0 microversion: 2.1 time: 0.374706 Oct 23 01:14:17.184151 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 499/1047] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:14:16 2022] POST /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d/action => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:14:17.193675 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-79b308ba-18c6-4b90-a2a9-c1673e604d9b tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-master-1"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:14:17.203497 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-79b308ba-18c6-4b90-a2a9-c1673e604d9b tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:17.220690 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-79b308ba-18c6-4b90-a2a9-c1673e604d9b tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:17.220690 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-79b308ba-18c6-4b90-a2a9-c1673e604d9b tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:17.224317 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-79b308ba-18c6-4b90-a2a9-c1673e604d9b tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:17.228350 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-79b308ba-18c6-4b90-a2a9-c1673e604d9b tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:17.228968 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-79b308ba-18c6-4b90-a2a9-c1673e604d9b tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:17.234199 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-b2fe1b38-6686-4b24-b0c4-9e10c8ab1855 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] HTTP exception thrown: Instance 93d46a54-c775-4fc6-ad62-edf53bee2d07 could not be found. Oct 23 01:14:17.234308 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-79b308ba-18c6-4b90-a2a9-c1673e604d9b tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:17.237694 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b2fe1b38-6686-4b24-b0c4-9e10c8ab1855 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Request method failure captured: Oct 23 01:14:17.237694 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07 HTTP/1.1 Oct 23 01:14:17.237694 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:14:17.237694 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:14:17.237694 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:14:17.237694 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:14:17.237694 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:14:17.237694 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:14:17.237694 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:14:17.237694 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:14:17.237694 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJUqfBfUUlEO3Zu3H2tCeUoe5XnfNaUD7bKiDt2dwM_vHXdRyWKJRkiWdJuFGdub4DDH4raRIyo0Mk5Nmx3s4iA5jZNhGnIAixZlPXpUoWudHmkA-a7smsKDtHuvdILrKw6BGAV303EGuwNXW2iARTfT7KcTxhWKB1Hm1GgND3UMLls Oct 23 01:14:17.237694 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:14:17.237694 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:14:17.237694 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:14:17.237694 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:14:17.237694 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:14:17.237694 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:14:17.237694 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: abc8f8cefbf441c98d6bda76e99e3173 Oct 23 01:14:17.237694 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServersTestMultiNic-1641531956 Oct 23 01:14:17.237694 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:14:17.237694 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:14:17.239425 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/abc8f8cefbf441c98d6bda76e99e3173"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_abc8f8cefbf441c98d6bda76e99e3173"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/abc8f8cefbf441c98d6bda76e99e3173"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/abc8f8cefbf441c98d6bda76e99e3173"}]}] Oct 23 01:14:17.239425 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServersTestMultiNic-1641531956 Oct 23 01:14:17.239425 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: abc8f8cefbf441c98d6bda76e99e3173 Oct 23 01:14:17.239425 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServersTestMultiNic-1641531956 Oct 23 01:14:17.239425 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServersTestMultiNic-1641531956-project Oct 23 01:14:17.239425 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:14:17.239425 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:14:17.239425 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 7262d5984b8c4775b86fae1c0d314718 Oct 23 01:14:17.239425 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServersTestMultiNic-1641531956-project Oct 23 01:14:17.239425 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:14:17.239425 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 93d46a54-c775-4fc6-ad62-edf53bee2d07 could not be found. Oct 23 01:14:17.239425 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '93d46a54-c775-4fc6-ad62-edf53bee2d07'} Oct 23 01:14:17.240375 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:14:17.240375 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:17.240375 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:14:17.240375 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:14:17.240375 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:14:17.240375 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:14:17.240375 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:14:17.240375 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:14:17.240375 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:14:17.240375 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:14:17.240375 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93d46a54-c775-4fc6-ad62-edf53bee2d07 could not be found. Oct 23 01:14:17.240375 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:14:17.240375 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:14:17.240375 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:14:17.240375 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:17.240375 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:14:17.240375 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:14:17.240375 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:14:17.240375 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:14:17.240375 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:14:17.243100 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:14:17.243100 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:14:17.243100 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:14:17.243100 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:14:17.243100 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:14:17.243100 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:14:17.243100 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:14:17.243100 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93d46a54-c775-4fc6-ad62-edf53bee2d07 could not be found. Oct 23 01:14:17.243100 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:14:17.243100 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:14:17.243100 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:14:17.243100 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:17.243100 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:14:17.243100 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:14:17.243100 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:14:17.243100 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:14:17.243100 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93d46a54-c775-4fc6-ad62-edf53bee2d07 could not be found. Oct 23 01:14:17.243100 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:14:17.244407 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b2fe1b38-6686-4b24-b0c4-9e10c8ab1855 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Returning 404 to user: Instance 93d46a54-c775-4fc6-ad62-edf53bee2d07 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:14:17.244407 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b2fe1b38-6686-4b24-b0c4-9e10c8ab1855 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07" status: 404 len: 111 microversion: 2.1 time: 0.091678 Oct 23 01:14:17.245753 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 549/1048] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:17 2022] GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:14:17.260139 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0e151377-b5a6-4bc8-874c-5c713982a22b tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:17.260772 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0e151377-b5a6-4bc8-874c-5c713982a22b tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] [instance: 8f277484-b3ae-465e-90b7-8febafef9329] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:17.269838 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0e151377-b5a6-4bc8-874c-5c713982a22b tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:17.270541 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0e151377-b5a6-4bc8-874c-5c713982a22b tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:17.270990 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0e151377-b5a6-4bc8-874c-5c713982a22b tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:17.271719 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0e151377-b5a6-4bc8-874c-5c713982a22b tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:17.272167 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0e151377-b5a6-4bc8-874c-5c713982a22b tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:17.272593 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0e151377-b5a6-4bc8-874c-5c713982a22b tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:17.291442 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-0e151377-b5a6-4bc8-874c-5c713982a22b tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] HTTP exception thrown: Instance 8f277484-b3ae-465e-90b7-8febafef9329 could not be found. Oct 23 01:14:17.293456 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0e151377-b5a6-4bc8-874c-5c713982a22b tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Request method failure captured: Oct 23 01:14:17.293456 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329 HTTP/1.1 Oct 23 01:14:17.293456 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:14:17.293456 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:14:17.293456 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:14:17.293456 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:14:17.293456 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:14:17.293456 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:14:17.293456 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:14:17.293456 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:14:17.293456 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJTVplLO-qztXxG_HDLL4BH6TUJol2dB6z6DUNPFW9k310b4LZv5QpPDkoZhlrdq59k6Qs6f6BNo8v85mRnWdRNraQp3Vl4AO14KfdmEFg1RoGAnLZNH2F5_UNLb30n-rYZuom-6EDi63ydn3YnTT73OMWga6znvyJRBVfK8dEqr79c Oct 23 01:14:17.293456 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:14:17.293456 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:14:17.293456 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:14:17.293456 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:14:17.293456 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:14:17.293456 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:14:17.293456 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: e6bf637f9ea9423cb3e4e2c74d0382a7 Oct 23 01:14:17.293456 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServersAdminTestJSON-634108158 Oct 23 01:14:17.293456 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:14:17.293456 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:14:17.295337 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e6bf637f9ea9423cb3e4e2c74d0382a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e6bf637f9ea9423cb3e4e2c74d0382a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e6bf637f9ea9423cb3e4e2c74d0382a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e6bf637f9ea9423cb3e4e2c74d0382a7"}]}] Oct 23 01:14:17.295337 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServersAdminTestJSON-634108158 Oct 23 01:14:17.295337 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: e6bf637f9ea9423cb3e4e2c74d0382a7 Oct 23 01:14:17.295337 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServersAdminTestJSON-634108158 Oct 23 01:14:17.295337 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServersAdminTestJSON-634108158-project Oct 23 01:14:17.295337 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:14:17.295337 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:14:17.295337 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 275cdb98ca7a48f68441d6c934740df0 Oct 23 01:14:17.295337 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServersAdminTestJSON-634108158-project Oct 23 01:14:17.295337 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:14:17.295337 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 8f277484-b3ae-465e-90b7-8febafef9329 could not be found. Oct 23 01:14:17.295337 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '8f277484-b3ae-465e-90b7-8febafef9329'} Oct 23 01:14:17.296241 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:14:17.296241 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:17.296241 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:14:17.296241 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:14:17.296241 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:14:17.296241 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:14:17.296241 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:14:17.296241 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:14:17.296241 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:14:17.296241 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:14:17.296241 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f277484-b3ae-465e-90b7-8febafef9329 could not be found. Oct 23 01:14:17.296241 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:14:17.296241 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:14:17.296241 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:14:17.296241 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:17.296241 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:14:17.296241 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:14:17.296241 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:14:17.296241 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:14:17.296241 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:14:17.297720 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:14:17.297720 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:14:17.297720 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:14:17.297720 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:14:17.297720 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:14:17.297720 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:14:17.297720 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:14:17.297720 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f277484-b3ae-465e-90b7-8febafef9329 could not be found. Oct 23 01:14:17.297720 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:14:17.297720 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:14:17.297720 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:14:17.297720 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:17.297720 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:14:17.297720 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:14:17.297720 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:14:17.297720 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:14:17.297720 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f277484-b3ae-465e-90b7-8febafef9329 could not be found. Oct 23 01:14:17.297720 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:14:17.299977 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0e151377-b5a6-4bc8-874c-5c713982a22b tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] Returning 404 to user: Instance 8f277484-b3ae-465e-90b7-8febafef9329 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:14:17.300858 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0e151377-b5a6-4bc8-874c-5c713982a22b tempest-ServersAdminTestJSON-634108158 tempest-ServersAdminTestJSON-634108158-project] 10.222.0.42 "GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329" status: 404 len: 111 microversion: 2.1 time: 0.054108 Oct 23 01:14:17.301458 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 550/1049] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:17 2022] GET /compute/v2.1/servers/8f277484-b3ae-465e-90b7-8febafef9329 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:14:17.311692 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-98528f2e-82f5-4b92-b82a-135391af8c2d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:17.312506 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-98528f2e-82f5-4b92-b82a-135391af8c2d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: edb35c7d-9adc-4b53-9bef-147aadbeae5d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:17.323145 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-98528f2e-82f5-4b92-b82a-135391af8c2d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:17.323145 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-98528f2e-82f5-4b92-b82a-135391af8c2d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:17.323145 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-98528f2e-82f5-4b92-b82a-135391af8c2d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:17.323145 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-98528f2e-82f5-4b92-b82a-135391af8c2d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:17.323504 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-98528f2e-82f5-4b92-b82a-135391af8c2d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:17.323504 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-98528f2e-82f5-4b92-b82a-135391af8c2d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:17.450035 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-79b308ba-18c6-4b90-a2a9-c1673e604d9b tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-master-1". {{(pid=120944) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 23 01:14:17.781133 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-98528f2e-82f5-4b92-b82a-135391af8c2d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:17.791728 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-98528f2e-82f5-4b92-b82a-135391af8c2d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d" status: 200 len: 1469 microversion: 2.1 time: 0.487200 Oct 23 01:14:17.802225 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 551/1050] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:17 2022] GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d => generated 1469 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:17.814902 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7fda3b00-5e4f-4cae-801f-44e3920bdb87 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:17.819950 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7fda3b00-5e4f-4cae-801f-44e3920bdb87 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 8db307a5-7a1e-4791-8fa9-e934894238e9] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:17.835600 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7fda3b00-5e4f-4cae-801f-44e3920bdb87 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:17.836276 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7fda3b00-5e4f-4cae-801f-44e3920bdb87 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:17.837462 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7fda3b00-5e4f-4cae-801f-44e3920bdb87 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:17.839518 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7fda3b00-5e4f-4cae-801f-44e3920bdb87 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:17.842325 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7fda3b00-5e4f-4cae-801f-44e3920bdb87 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:17.844178 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7fda3b00-5e4f-4cae-801f-44e3920bdb87 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:17.847516 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-79b308ba-18c6-4b90-a2a9-c1673e604d9b tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b/action" status: 202 len: 0 microversion: 2.91 time: 0.661685 Oct 23 01:14:17.851371 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 500/1051] 10.222.0.42 () {62 vars in 1319 bytes} [Sun Oct 23 01:14:17 2022] POST /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b/action => generated 0 bytes in 666 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:14:17.869004 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bac45607-7e28-4ea2-83b7-70251d8f6f83 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:17.876286 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bac45607-7e28-4ea2-83b7-70251d8f6f83 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:17.897135 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=100 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:17.901389 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bac45607-7e28-4ea2-83b7-70251d8f6f83 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:17.901905 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bac45607-7e28-4ea2-83b7-70251d8f6f83 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:17.902557 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bac45607-7e28-4ea2-83b7-70251d8f6f83 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:17.903441 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bac45607-7e28-4ea2-83b7-70251d8f6f83 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:17.904055 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bac45607-7e28-4ea2-83b7-70251d8f6f83 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:17.904714 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bac45607-7e28-4ea2-83b7-70251d8f6f83 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:18.336318 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bac45607-7e28-4ea2-83b7-70251d8f6f83 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:18.356909 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bac45607-7e28-4ea2-83b7-70251d8f6f83 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:18.369758 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bac45607-7e28-4ea2-83b7-70251d8f6f83 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:18.396593 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bac45607-7e28-4ea2-83b7-70251d8f6f83 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1546 microversion: 2.91 time: 0.534663 Oct 23 01:14:18.399486 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 501/1052] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:17 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1546 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:18.819844 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1549407a-8af7-49cc-8496-4f7691c6fe71 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:18.821867 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1549407a-8af7-49cc-8496-4f7691c6fe71 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: edb35c7d-9adc-4b53-9bef-147aadbeae5d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:18.845386 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1549407a-8af7-49cc-8496-4f7691c6fe71 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:18.846074 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1549407a-8af7-49cc-8496-4f7691c6fe71 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:18.847000 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1549407a-8af7-49cc-8496-4f7691c6fe71 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:18.848060 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1549407a-8af7-49cc-8496-4f7691c6fe71 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:18.848631 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1549407a-8af7-49cc-8496-4f7691c6fe71 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:18.849671 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1549407a-8af7-49cc-8496-4f7691c6fe71 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:19.316777 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7fda3b00-5e4f-4cae-801f-44e3920bdb87 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:19.349251 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7fda3b00-5e4f-4cae-801f-44e3920bdb87 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:19.358461 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7fda3b00-5e4f-4cae-801f-44e3920bdb87 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:19.359887 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7fda3b00-5e4f-4cae-801f-44e3920bdb87 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9" status: 200 len: 1361 microversion: 2.25 time: 1.555947 Oct 23 01:14:19.360594 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 552/1053] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:17 2022] GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9 => generated 1361 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:19.379923 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-06ddf2b6-32b1-4e6a-a427-59c340ad4b57 req-dcf1177f-a16a-4084-a9bc-655343db2c89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edb35c7d-9adc-4b53-9bef-147aadbeae5d", "name": "network-vif-plugged", "status": "completed", "tag": "13993c6b-8acd-482a-a3cf-1db8731b8846"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:14:19.403685 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-06ddf2b6-32b1-4e6a-a427-59c340ad4b57 req-dcf1177f-a16a-4084-a9bc-655343db2c89 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:19.406750 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-06ddf2b6-32b1-4e6a-a427-59c340ad4b57 req-dcf1177f-a16a-4084-a9bc-655343db2c89 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:19.409832 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-06ddf2b6-32b1-4e6a-a427-59c340ad4b57 req-dcf1177f-a16a-4084-a9bc-655343db2c89 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:19.459491 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-06ddf2b6-32b1-4e6a-a427-59c340ad4b57 req-dcf1177f-a16a-4084-a9bc-655343db2c89 service nova] Creating event network-vif-plugged:13993c6b-8acd-482a-a3cf-1db8731b8846 for instance edb35c7d-9adc-4b53-9bef-147aadbeae5d on n-h1-master-1 Oct 23 01:14:19.468264 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [req-06ddf2b6-32b1-4e6a-a427-59c340ad4b57 req-dcf1177f-a16a-4084-a9bc-655343db2c89 service nova] Instance edb35c7d-9adc-4b53-9bef-147aadbeae5d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1'} {{(pid=120945) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 23 01:14:19.489789 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-06ddf2b6-32b1-4e6a-a427-59c340ad4b57 req-dcf1177f-a16a-4084-a9bc-655343db2c89 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127745 Oct 23 01:14:19.492488 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 553/1054] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:14:19.740607 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1549407a-8af7-49cc-8496-4f7691c6fe71 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:19.753094 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1549407a-8af7-49cc-8496-4f7691c6fe71 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d" status: 200 len: 1469 microversion: 2.1 time: 0.939006 Oct 23 01:14:19.757144 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 502/1055] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:18 2022] GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d => generated 1469 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:19.783887 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c6ae8fa8-ff21-4f11-bc9d-180185d31d9f tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:19.789517 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c6ae8fa8-ff21-4f11-bc9d-180185d31d9f tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:19.806657 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c6ae8fa8-ff21-4f11-bc9d-180185d31d9f tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:19.807575 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c6ae8fa8-ff21-4f11-bc9d-180185d31d9f tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:19.809273 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c6ae8fa8-ff21-4f11-bc9d-180185d31d9f tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:19.810826 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c6ae8fa8-ff21-4f11-bc9d-180185d31d9f tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:19.811557 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c6ae8fa8-ff21-4f11-bc9d-180185d31d9f tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:19.815273 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c6ae8fa8-ff21-4f11-bc9d-180185d31d9f tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:19.905372 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6f6795be-5ecb-4bde-a0ca-6db871c9bac6 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1315862377", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "537e6f6c-b939-45ba-bf2f-2215a082be45"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:14:19.981827 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c6ae8fa8-ff21-4f11-bc9d-180185d31d9f tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:20.003053 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-6f6795be-5ecb-4bde-a0ca-6db871c9bac6 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] validate_networks() for [('537e6f6c-b939-45ba-bf2f-2215a082be45', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:14:20.011058 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c6ae8fa8-ff21-4f11-bc9d-180185d31d9f tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:20.012541 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c6ae8fa8-ff21-4f11-bc9d-180185d31d9f tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:20.020569 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c6ae8fa8-ff21-4f11-bc9d-180185d31d9f tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1486 microversion: 2.91 time: 0.262256 Oct 23 01:14:20.036125 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 503/1056] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:19 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1486 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:20.388225 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-970592a3-018b-4ee8-b74b-e38d545e683a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:20.389293 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-970592a3-018b-4ee8-b74b-e38d545e683a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 8db307a5-7a1e-4791-8fa9-e934894238e9] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:20.392069 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:20.393039 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=6 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:20.409298 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-970592a3-018b-4ee8-b74b-e38d545e683a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:20.410363 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-970592a3-018b-4ee8-b74b-e38d545e683a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:20.410831 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-970592a3-018b-4ee8-b74b-e38d545e683a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:20.411955 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-970592a3-018b-4ee8-b74b-e38d545e683a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:20.412665 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-970592a3-018b-4ee8-b74b-e38d545e683a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:20.414638 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-970592a3-018b-4ee8-b74b-e38d545e683a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:20.933370 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-970592a3-018b-4ee8-b74b-e38d545e683a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:20.944324 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-970592a3-018b-4ee8-b74b-e38d545e683a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:20.945816 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-970592a3-018b-4ee8-b74b-e38d545e683a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:20.947178 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-970592a3-018b-4ee8-b74b-e38d545e683a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9" status: 200 len: 1361 microversion: 2.25 time: 0.563013 Oct 23 01:14:20.947749 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 504/1057] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:20 2022] GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9 => generated 1361 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:14:20.952220 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-d6f47120-ac81-45a5-a953-de58f25d07df req-f1db514c-5922-49a3-824f-bcf6db78145c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8db307a5-7a1e-4791-8fa9-e934894238e9", "tag": "7328ae33-f6ec-49e1-9744-c0a7a6f75e28"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:14:20.961782 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-d6f47120-ac81-45a5-a953-de58f25d07df req-f1db514c-5922-49a3-824f-bcf6db78145c service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:20.962624 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-d6f47120-ac81-45a5-a953-de58f25d07df req-f1db514c-5922-49a3-824f-bcf6db78145c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:20.963214 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-d6f47120-ac81-45a5-a953-de58f25d07df req-f1db514c-5922-49a3-824f-bcf6db78145c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:20.990954 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-d6f47120-ac81-45a5-a953-de58f25d07df req-f1db514c-5922-49a3-824f-bcf6db78145c service nova] Creating event network-changed:7328ae33-f6ec-49e1-9744-c0a7a6f75e28 for instance 8db307a5-7a1e-4791-8fa9-e934894238e9 on n-h2-master-1 Oct 23 01:14:21.000632 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-d6f47120-ac81-45a5-a953-de58f25d07df req-f1db514c-5922-49a3-824f-bcf6db78145c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049843 Oct 23 01:14:21.009648 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 505/1058] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:14:21.244298 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-6f6795be-5ecb-4bde-a0ca-6db871c9bac6 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:14:21.244801 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-6f6795be-5ecb-4bde-a0ca-6db871c9bac6 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:14:21.244914 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ad6e3659-f692-402f-aa81-9dad64b23c43 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-669735213", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:14:21.245491 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-6f6795be-5ecb-4bde-a0ca-6db871c9bac6 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:14:21.246234 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-6f6795be-5ecb-4bde-a0ca-6db871c9bac6 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:14:21.246862 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-6f6795be-5ecb-4bde-a0ca-6db871c9bac6 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:14:21.265720 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6f6795be-5ecb-4bde-a0ca-6db871c9bac6 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:21.267643 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6f6795be-5ecb-4bde-a0ca-6db871c9bac6 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:21.267643 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6f6795be-5ecb-4bde-a0ca-6db871c9bac6 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:21.267643 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6f6795be-5ecb-4bde-a0ca-6db871c9bac6 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:21.272852 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6f6795be-5ecb-4bde-a0ca-6db871c9bac6 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:21.274240 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6f6795be-5ecb-4bde-a0ca-6db871c9bac6 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:21.313768 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-ad6e3659-f692-402f-aa81-9dad64b23c43 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] validate_networks() for None {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:14:21.324173 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-6f6795be-5ecb-4bde-a0ca-6db871c9bac6 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Getting quotas for project 0d2182cae228436ba5c9fc59edb00274. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:14:21.342113 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-6f6795be-5ecb-4bde-a0ca-6db871c9bac6 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Getting quotas for user 870da6eeeb684fa380bf48b41f27b984 and project 0d2182cae228436ba5c9fc59edb00274. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:14:21.361808 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6f6795be-5ecb-4bde-a0ca-6db871c9bac6 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:14:21.366775 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6f6795be-5ecb-4bde-a0ca-6db871c9bac6 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] [instance: 1cd3fd39-6d38-4c30-9dda-dd9b5530c294] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:14:21.656041 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6f6795be-5ecb-4bde-a0ca-6db871c9bac6 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.163881 Oct 23 01:14:21.663301 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 554/1059] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:14:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2172 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:14:21.669068 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-04825ab3-ab2c-45fc-a507-bce88315ec44 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:21.670065 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-04825ab3-ab2c-45fc-a507-bce88315ec44 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: edb35c7d-9adc-4b53-9bef-147aadbeae5d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:21.676710 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-04825ab3-ab2c-45fc-a507-bce88315ec44 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:21.677516 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-04825ab3-ab2c-45fc-a507-bce88315ec44 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:21.689009 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-04825ab3-ab2c-45fc-a507-bce88315ec44 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:21.690921 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-04825ab3-ab2c-45fc-a507-bce88315ec44 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:21.691426 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-04825ab3-ab2c-45fc-a507-bce88315ec44 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:21.693928 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-04825ab3-ab2c-45fc-a507-bce88315ec44 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:21.723004 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-ad6e3659-f692-402f-aa81-9dad64b23c43 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:14:21.723713 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-ad6e3659-f692-402f-aa81-9dad64b23c43 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:14:21.724366 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-ad6e3659-f692-402f-aa81-9dad64b23c43 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:14:21.725119 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-ad6e3659-f692-402f-aa81-9dad64b23c43 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:14:21.725737 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-ad6e3659-f692-402f-aa81-9dad64b23c43 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:14:21.738625 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ad6e3659-f692-402f-aa81-9dad64b23c43 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:21.740904 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ad6e3659-f692-402f-aa81-9dad64b23c43 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:21.743625 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ad6e3659-f692-402f-aa81-9dad64b23c43 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:21.745702 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ad6e3659-f692-402f-aa81-9dad64b23c43 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:21.747773 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ad6e3659-f692-402f-aa81-9dad64b23c43 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:21.749840 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ad6e3659-f692-402f-aa81-9dad64b23c43 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:21.780451 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-ad6e3659-f692-402f-aa81-9dad64b23c43 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Getting quotas for project 356a4b3819db457fb5caf68ded0212fa. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:14:21.792176 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-ad6e3659-f692-402f-aa81-9dad64b23c43 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Getting quotas for user 80703c3d1dae419c9fd5ca103f3c28bf and project 356a4b3819db457fb5caf68ded0212fa. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:14:21.825386 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ad6e3659-f692-402f-aa81-9dad64b23c43 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:14:21.825386 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ad6e3659-f692-402f-aa81-9dad64b23c43 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] [instance: e0769a09-da3a-422f-a7a8-27edf4a2e209] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:14:21.919377 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-04825ab3-ab2c-45fc-a507-bce88315ec44 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:21.929634 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-04825ab3-ab2c-45fc-a507-bce88315ec44 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d" status: 200 len: 1461 microversion: 2.1 time: 0.264541 Oct 23 01:14:21.934046 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 555/1060] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:21 2022] GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d => generated 1461 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:21.955197 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-88f91cc0-00db-485a-8538-cac35558f8d5 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:21.957058 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-88f91cc0-00db-485a-8538-cac35558f8d5 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:21.999531 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-88f91cc0-00db-485a-8538-cac35558f8d5 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:22.000299 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-88f91cc0-00db-485a-8538-cac35558f8d5 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:22.003665 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-88f91cc0-00db-485a-8538-cac35558f8d5 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:22.007971 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ad6e3659-f692-402f-aa81-9dad64b23c43 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.991042 Oct 23 01:14:22.008803 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-88f91cc0-00db-485a-8538-cac35558f8d5 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:22.009414 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-88f91cc0-00db-485a-8538-cac35558f8d5 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:22.011243 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-88f91cc0-00db-485a-8538-cac35558f8d5 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:22.015824 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 506/1061] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:14:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1001 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:14:22.042492 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ed6e73e7-15c9-4852-ba4b-5a2397afeada tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:22.043893 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ed6e73e7-15c9-4852-ba4b-5a2397afeada tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] [instance: 1cd3fd39-6d38-4c30-9dda-dd9b5530c294] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:22.139472 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-88f91cc0-00db-485a-8538-cac35558f8d5 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:22.151259 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-88f91cc0-00db-485a-8538-cac35558f8d5 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:22.152775 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-88f91cc0-00db-485a-8538-cac35558f8d5 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:22.168249 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-88f91cc0-00db-485a-8538-cac35558f8d5 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1544 microversion: 2.91 time: 0.232489 Oct 23 01:14:22.178211 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 556/1062] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:21 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1544 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:22.181796 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ee0e45f6-1aa3-4218-983e-a7b4791f0987 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:22.182610 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ee0e45f6-1aa3-4218-983e-a7b4791f0987 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:22.188461 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ed6e73e7-15c9-4852-ba4b-5a2397afeada tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870da6eeeb684fa380bf48b41f27b984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2182cae228436ba5c9fc59edb00274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:22.196909 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee0e45f6-1aa3-4218-983e-a7b4791f0987 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:22.196909 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee0e45f6-1aa3-4218-983e-a7b4791f0987 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:22.197237 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee0e45f6-1aa3-4218-983e-a7b4791f0987 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:22.198272 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee0e45f6-1aa3-4218-983e-a7b4791f0987 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:22.198945 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee0e45f6-1aa3-4218-983e-a7b4791f0987 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:22.199541 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee0e45f6-1aa3-4218-983e-a7b4791f0987 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:22.201611 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ed6e73e7-15c9-4852-ba4b-5a2397afeada tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] 10.222.0.42 "GET /compute/v2.1/servers/1cd3fd39-6d38-4c30-9dda-dd9b5530c294" status: 200 len: 1216 microversion: 2.1 time: 0.184499 Oct 23 01:14:22.203592 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 507/1063] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:22 2022] GET /compute/v2.1/servers/1cd3fd39-6d38-4c30-9dda-dd9b5530c294 => generated 1216 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:22.212582 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6c2c9906-bc53-4c6b-9335-94ffa95d0d19 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:22.213328 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6c2c9906-bc53-4c6b-9335-94ffa95d0d19 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: edb35c7d-9adc-4b53-9bef-147aadbeae5d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:22.235691 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6c2c9906-bc53-4c6b-9335-94ffa95d0d19 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:22.235691 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6c2c9906-bc53-4c6b-9335-94ffa95d0d19 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:22.235691 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6c2c9906-bc53-4c6b-9335-94ffa95d0d19 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:22.235691 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6c2c9906-bc53-4c6b-9335-94ffa95d0d19 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:22.236090 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6c2c9906-bc53-4c6b-9335-94ffa95d0d19 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:22.236090 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6c2c9906-bc53-4c6b-9335-94ffa95d0d19 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:22.527813 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6c2c9906-bc53-4c6b-9335-94ffa95d0d19 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:22.536226 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6c2c9906-bc53-4c6b-9335-94ffa95d0d19 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d" status: 200 len: 1461 microversion: 2.1 time: 0.327649 Oct 23 01:14:22.537276 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 508/1064] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:22 2022] GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d => generated 1461 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:22.548856 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ee0e45f6-1aa3-4218-983e-a7b4791f0987 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 200 len: 1812 microversion: 2.1 time: 0.371007 Oct 23 01:14:22.549456 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 557/1065] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:22 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 1812 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:22.555480 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2c115fa9-2038-4743-8312-dec334a8ecdc tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:22.556311 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2c115fa9-2038-4743-8312-dec334a8ecdc tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] [instance: e0769a09-da3a-422f-a7a8-27edf4a2e209] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:22.557126 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1358f6ec-b13a-4fb8-a6e3-56d90eee5ec2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:22.559273 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1358f6ec-b13a-4fb8-a6e3-56d90eee5ec2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 8db307a5-7a1e-4791-8fa9-e934894238e9] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:22.588672 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1358f6ec-b13a-4fb8-a6e3-56d90eee5ec2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:22.593349 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1358f6ec-b13a-4fb8-a6e3-56d90eee5ec2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:22.594028 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1358f6ec-b13a-4fb8-a6e3-56d90eee5ec2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:22.598709 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1358f6ec-b13a-4fb8-a6e3-56d90eee5ec2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:22.600660 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1358f6ec-b13a-4fb8-a6e3-56d90eee5ec2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:22.602007 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1358f6ec-b13a-4fb8-a6e3-56d90eee5ec2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:22.633492 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2c115fa9-2038-4743-8312-dec334a8ecdc tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80703c3d1dae419c9fd5ca103f3c28bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356a4b3819db457fb5caf68ded0212fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:22.641844 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2c115fa9-2038-4743-8312-dec334a8ecdc tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] 10.222.0.42 "GET /compute/v2.1/servers/e0769a09-da3a-422f-a7a8-27edf4a2e209" status: 200 len: 1218 microversion: 2.1 time: 0.091328 Oct 23 01:14:22.642995 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 558/1066] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:22 2022] GET /compute/v2.1/servers/e0769a09-da3a-422f-a7a8-27edf4a2e209 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:22.650685 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-17181ad7-8723-4473-83ba-c6023ba33704 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Action: 'create', calling method: .version_select at 0x7f5cc1fef4c0>, body: {"keypair": {"name": "tempest-keypair-237042266", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJksJ/30zHbC5dg9KKZ3Gff1OVDP9uJRNutNxC732riNrZBDMm0OrxW3HaFX89UtCYp/h7hH/M7Rrz5BGv5CSWcaQ0J7JmezB5QQ1PFfR1Pgl4PXQvjXTSmL3dIkoJ07Wg=="}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:14:22.670433 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-17181ad7-8723-4473-83ba-c6023ba33704 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Getting quotas for project eb058785345d4e58a5820445efe09bee. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:14:22.677071 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-17181ad7-8723-4473-83ba-c6023ba33704 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Getting quotas for user 547aed83a7e44becb9c89dc6bae62255 and project eb058785345d4e58a5820445efe09bee. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:14:22.800331 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-17181ad7-8723-4473-83ba-c6023ba33704 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.151611 Oct 23 01:14:22.800331 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 559/1067] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 01:14:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:14:22.802847 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-772fa180-184e-44aa-b51d-cbd1810b7c27 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:22.807348 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-772fa180-184e-44aa-b51d-cbd1810b7c27 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:22.808687 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-772fa180-184e-44aa-b51d-cbd1810b7c27 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:22.809259 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-772fa180-184e-44aa-b51d-cbd1810b7c27 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:22.811876 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-772fa180-184e-44aa-b51d-cbd1810b7c27 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:22.812579 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-772fa180-184e-44aa-b51d-cbd1810b7c27 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:22.813426 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-772fa180-184e-44aa-b51d-cbd1810b7c27 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:22.860339 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-772fa180-184e-44aa-b51d-cbd1810b7c27 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.061460 Oct 23 01:14:22.878906 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 560/1068] 10.222.0.42 () {58 vars in 1176 bytes} [Sun Oct 23 01:14:22 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:14:22.913858 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1358f6ec-b13a-4fb8-a6e3-56d90eee5ec2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:22.923426 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1358f6ec-b13a-4fb8-a6e3-56d90eee5ec2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:22.932184 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1358f6ec-b13a-4fb8-a6e3-56d90eee5ec2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:22.938214 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1358f6ec-b13a-4fb8-a6e3-56d90eee5ec2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9" status: 200 len: 1361 microversion: 2.25 time: 0.394914 Oct 23 01:14:22.938214 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 509/1069] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:22 2022] GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9 => generated 1361 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:23.200344 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b4171948-1af9-4e91-aa56-380b29a44bc7 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:23.201375 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b4171948-1af9-4e91-aa56-380b29a44bc7 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:23.210776 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b4171948-1af9-4e91-aa56-380b29a44bc7 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:23.212667 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b4171948-1af9-4e91-aa56-380b29a44bc7 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:23.212667 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b4171948-1af9-4e91-aa56-380b29a44bc7 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:23.214630 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b4171948-1af9-4e91-aa56-380b29a44bc7 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:23.215488 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b4171948-1af9-4e91-aa56-380b29a44bc7 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:23.216088 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b4171948-1af9-4e91-aa56-380b29a44bc7 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:23.237772 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6ca86c44-a827-4fbf-9aa4-859e08e2079e tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:23.239051 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6ca86c44-a827-4fbf-9aa4-859e08e2079e tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] [instance: 1cd3fd39-6d38-4c30-9dda-dd9b5530c294] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:23.459914 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6ca86c44-a827-4fbf-9aa4-859e08e2079e tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870da6eeeb684fa380bf48b41f27b984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2182cae228436ba5c9fc59edb00274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:23.474050 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6ca86c44-a827-4fbf-9aa4-859e08e2079e tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] 10.222.0.42 "GET /compute/v2.1/servers/1cd3fd39-6d38-4c30-9dda-dd9b5530c294" status: 200 len: 1216 microversion: 2.1 time: 0.240957 Oct 23 01:14:23.479166 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 510/1070] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:23 2022] GET /compute/v2.1/servers/1cd3fd39-6d38-4c30-9dda-dd9b5530c294 => generated 1216 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:23.521530 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b4171948-1af9-4e91-aa56-380b29a44bc7 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:23.545510 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b4171948-1af9-4e91-aa56-380b29a44bc7 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:23.549153 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b4171948-1af9-4e91-aa56-380b29a44bc7 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:23.556776 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b4171948-1af9-4e91-aa56-380b29a44bc7 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1544 microversion: 2.91 time: 0.362544 Oct 23 01:14:23.558481 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 561/1071] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:23 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1544 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:23.667663 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2c602d95-67a8-4348-9706-7ac7b4f3f14c tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:23.668430 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2c602d95-67a8-4348-9706-7ac7b4f3f14c tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] [instance: e0769a09-da3a-422f-a7a8-27edf4a2e209] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:23.678306 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:23.796309 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2c602d95-67a8-4348-9706-7ac7b4f3f14c tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80703c3d1dae419c9fd5ca103f3c28bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356a4b3819db457fb5caf68ded0212fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:23.828505 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2c602d95-67a8-4348-9706-7ac7b4f3f14c tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] 10.222.0.42 "GET /compute/v2.1/servers/e0769a09-da3a-422f-a7a8-27edf4a2e209" status: 200 len: 1218 microversion: 2.1 time: 0.150713 Oct 23 01:14:23.830931 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 511/1072] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:23 2022] GET /compute/v2.1/servers/e0769a09-da3a-422f-a7a8-27edf4a2e209 => generated 1218 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:23.987337 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-397bae70-de31-4d1c-87e7-19c3845c3e87 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:23.987997 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-397bae70-de31-4d1c-87e7-19c3845c3e87 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 8db307a5-7a1e-4791-8fa9-e934894238e9] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:24.020773 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-397bae70-de31-4d1c-87e7-19c3845c3e87 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:24.021641 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-397bae70-de31-4d1c-87e7-19c3845c3e87 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:24.028549 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-397bae70-de31-4d1c-87e7-19c3845c3e87 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:24.028549 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-397bae70-de31-4d1c-87e7-19c3845c3e87 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:24.028549 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-397bae70-de31-4d1c-87e7-19c3845c3e87 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:24.028549 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-397bae70-de31-4d1c-87e7-19c3845c3e87 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:24.513268 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2fb1da7c-a8a4-4fc9-8288-9cd67c967e21 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:24.514000 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2fb1da7c-a8a4-4fc9-8288-9cd67c967e21 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] [instance: 1cd3fd39-6d38-4c30-9dda-dd9b5530c294] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:24.533176 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2fb1da7c-a8a4-4fc9-8288-9cd67c967e21 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:24.533739 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2fb1da7c-a8a4-4fc9-8288-9cd67c967e21 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:24.537912 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2fb1da7c-a8a4-4fc9-8288-9cd67c967e21 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:24.538748 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2fb1da7c-a8a4-4fc9-8288-9cd67c967e21 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:24.541063 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2fb1da7c-a8a4-4fc9-8288-9cd67c967e21 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:24.542564 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2fb1da7c-a8a4-4fc9-8288-9cd67c967e21 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:24.843453 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2fb1da7c-a8a4-4fc9-8288-9cd67c967e21 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870da6eeeb684fa380bf48b41f27b984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2182cae228436ba5c9fc59edb00274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:24.864276 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2fb1da7c-a8a4-4fc9-8288-9cd67c967e21 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] 10.222.0.42 "GET /compute/v2.1/servers/1cd3fd39-6d38-4c30-9dda-dd9b5530c294" status: 200 len: 1268 microversion: 2.1 time: 0.353976 Oct 23 01:14:24.890668 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 512/1073] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:24 2022] GET /compute/v2.1/servers/1cd3fd39-6d38-4c30-9dda-dd9b5530c294 => generated 1268 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:24.913292 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0119dc7b-8483-4e1c-b164-0ab3d9896471 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:24.914174 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0119dc7b-8483-4e1c-b164-0ab3d9896471 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:24.954954 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0119dc7b-8483-4e1c-b164-0ab3d9896471 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:24.955468 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0119dc7b-8483-4e1c-b164-0ab3d9896471 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:24.956981 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0119dc7b-8483-4e1c-b164-0ab3d9896471 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:24.959234 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0119dc7b-8483-4e1c-b164-0ab3d9896471 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:24.961886 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0119dc7b-8483-4e1c-b164-0ab3d9896471 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:24.965483 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0119dc7b-8483-4e1c-b164-0ab3d9896471 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:25.042575 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:25.206589 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0119dc7b-8483-4e1c-b164-0ab3d9896471 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:25.229219 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0119dc7b-8483-4e1c-b164-0ab3d9896471 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:25.235873 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0119dc7b-8483-4e1c-b164-0ab3d9896471 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:25.246784 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-397bae70-de31-4d1c-87e7-19c3845c3e87 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:25.253761 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0119dc7b-8483-4e1c-b164-0ab3d9896471 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1544 microversion: 2.91 time: 0.362884 Oct 23 01:14:25.255674 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 513/1074] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:24 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1544 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:25.267946 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-397bae70-de31-4d1c-87e7-19c3845c3e87 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:25.267946 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-397bae70-de31-4d1c-87e7-19c3845c3e87 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:25.267946 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-397bae70-de31-4d1c-87e7-19c3845c3e87 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9" status: 200 len: 1361 microversion: 2.25 time: 1.300410 Oct 23 01:14:25.268308 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 562/1075] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:23 2022] GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9 => generated 1361 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:25.268391 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-02045e0c-6ea5-4f9a-9e8d-02178654edec tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:25.268391 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-02045e0c-6ea5-4f9a-9e8d-02178654edec tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] [instance: e0769a09-da3a-422f-a7a8-27edf4a2e209] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:25.297809 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-02045e0c-6ea5-4f9a-9e8d-02178654edec tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:25.298432 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-02045e0c-6ea5-4f9a-9e8d-02178654edec tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:25.298872 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-02045e0c-6ea5-4f9a-9e8d-02178654edec tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:25.299771 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-02045e0c-6ea5-4f9a-9e8d-02178654edec tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:25.300395 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-02045e0c-6ea5-4f9a-9e8d-02178654edec tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:25.301093 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-02045e0c-6ea5-4f9a-9e8d-02178654edec tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:25.572008 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-02045e0c-6ea5-4f9a-9e8d-02178654edec tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80703c3d1dae419c9fd5ca103f3c28bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356a4b3819db457fb5caf68ded0212fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:25.586809 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-02045e0c-6ea5-4f9a-9e8d-02178654edec tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] 10.222.0.42 "GET /compute/v2.1/servers/e0769a09-da3a-422f-a7a8-27edf4a2e209" status: 200 len: 1214 microversion: 2.1 time: 0.325742 Oct 23 01:14:25.603399 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 514/1076] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:25 2022] GET /compute/v2.1/servers/e0769a09-da3a-422f-a7a8-27edf4a2e209 => generated 1214 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:25.900507 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5773b32a-f497-43a6-94ba-aef4bf355a5c tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:25.901097 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5773b32a-f497-43a6-94ba-aef4bf355a5c tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] [instance: 1cd3fd39-6d38-4c30-9dda-dd9b5530c294] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:25.927413 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5773b32a-f497-43a6-94ba-aef4bf355a5c tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:25.929602 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5773b32a-f497-43a6-94ba-aef4bf355a5c tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:25.937215 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5773b32a-f497-43a6-94ba-aef4bf355a5c tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:25.941589 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5773b32a-f497-43a6-94ba-aef4bf355a5c tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:25.945130 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5773b32a-f497-43a6-94ba-aef4bf355a5c tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:25.947094 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5773b32a-f497-43a6-94ba-aef4bf355a5c tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:26.193535 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5773b32a-f497-43a6-94ba-aef4bf355a5c tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870da6eeeb684fa380bf48b41f27b984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2182cae228436ba5c9fc59edb00274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:26.212168 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5773b32a-f497-43a6-94ba-aef4bf355a5c tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] 10.222.0.42 "GET /compute/v2.1/servers/1cd3fd39-6d38-4c30-9dda-dd9b5530c294" status: 200 len: 1268 microversion: 2.1 time: 0.312345 Oct 23 01:14:26.213308 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 563/1077] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:25 2022] GET /compute/v2.1/servers/1cd3fd39-6d38-4c30-9dda-dd9b5530c294 => generated 1268 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:26.288138 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-165b94b1-3aa1-45c6-b4f8-7d2379a3a5e6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:26.290099 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-165b94b1-3aa1-45c6-b4f8-7d2379a3a5e6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:26.312860 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-165b94b1-3aa1-45c6-b4f8-7d2379a3a5e6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:26.314168 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-165b94b1-3aa1-45c6-b4f8-7d2379a3a5e6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:26.317140 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-165b94b1-3aa1-45c6-b4f8-7d2379a3a5e6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:26.318151 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-165b94b1-3aa1-45c6-b4f8-7d2379a3a5e6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:26.318914 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-165b94b1-3aa1-45c6-b4f8-7d2379a3a5e6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:26.319598 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-165b94b1-3aa1-45c6-b4f8-7d2379a3a5e6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:26.450367 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-165b94b1-3aa1-45c6-b4f8-7d2379a3a5e6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:26.461150 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-165b94b1-3aa1-45c6-b4f8-7d2379a3a5e6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:26.474149 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-165b94b1-3aa1-45c6-b4f8-7d2379a3a5e6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:26.481836 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-165b94b1-3aa1-45c6-b4f8-7d2379a3a5e6 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1544 microversion: 2.91 time: 0.200997 Oct 23 01:14:26.485276 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 564/1078] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:26 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1544 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:14:26.519597 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-60470dd4-d819-4379-aefd-6349c21ada07 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:26.520228 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-60470dd4-d819-4379-aefd-6349c21ada07 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 8db307a5-7a1e-4791-8fa9-e934894238e9] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:26.540389 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-60470dd4-d819-4379-aefd-6349c21ada07 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:26.542743 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-60470dd4-d819-4379-aefd-6349c21ada07 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:26.543391 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-60470dd4-d819-4379-aefd-6349c21ada07 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:26.548517 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-60470dd4-d819-4379-aefd-6349c21ada07 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:26.551860 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-60470dd4-d819-4379-aefd-6349c21ada07 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:26.552546 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-60470dd4-d819-4379-aefd-6349c21ada07 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:26.597319 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5bf69744-5c44-410e-b173-b41e4c5686b8 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-292469105", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:14:26.773494 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-5bf69744-5c44-410e-b173-b41e4c5686b8 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] validate_networks() for None {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:14:27.129066 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-60470dd4-d819-4379-aefd-6349c21ada07 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:27.148415 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-60470dd4-d819-4379-aefd-6349c21ada07 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:27.151953 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-60470dd4-d819-4379-aefd-6349c21ada07 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:27.154733 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-60470dd4-d819-4379-aefd-6349c21ada07 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9" status: 200 len: 1361 microversion: 2.25 time: 0.668317 Oct 23 01:14:27.156878 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 565/1079] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:26 2022] GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9 => generated 1361 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:27.182099 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-87efdf1a-7e05-4b2a-9ead-a61b4f1b5a4f tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:27.184375 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-87efdf1a-7e05-4b2a-9ead-a61b4f1b5a4f tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] [instance: e0769a09-da3a-422f-a7a8-27edf4a2e209] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:27.209364 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-87efdf1a-7e05-4b2a-9ead-a61b4f1b5a4f tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:27.213013 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-87efdf1a-7e05-4b2a-9ead-a61b4f1b5a4f tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:27.214867 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-87efdf1a-7e05-4b2a-9ead-a61b4f1b5a4f tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:27.215618 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-87efdf1a-7e05-4b2a-9ead-a61b4f1b5a4f tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:27.216080 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-87efdf1a-7e05-4b2a-9ead-a61b4f1b5a4f tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:27.220542 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-87efdf1a-7e05-4b2a-9ead-a61b4f1b5a4f tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:27.480081 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-87efdf1a-7e05-4b2a-9ead-a61b4f1b5a4f tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80703c3d1dae419c9fd5ca103f3c28bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356a4b3819db457fb5caf68ded0212fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:27.499609 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-87efdf1a-7e05-4b2a-9ead-a61b4f1b5a4f tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] 10.222.0.42 "GET /compute/v2.1/servers/e0769a09-da3a-422f-a7a8-27edf4a2e209" status: 200 len: 1270 microversion: 2.1 time: 0.337318 Oct 23 01:14:27.523412 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 566/1080] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:27 2022] GET /compute/v2.1/servers/e0769a09-da3a-422f-a7a8-27edf4a2e209 => generated 1270 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:27.538175 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-5bf69744-5c44-410e-b173-b41e4c5686b8 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:14:27.540227 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-5bf69744-5c44-410e-b173-b41e4c5686b8 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:14:27.540944 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-5bf69744-5c44-410e-b173-b41e4c5686b8 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:14:27.541835 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-5bf69744-5c44-410e-b173-b41e4c5686b8 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:14:27.542515 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-5bf69744-5c44-410e-b173-b41e4c5686b8 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:14:27.551298 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-94aac23c-5f65-4afd-bc1d-4ef46eea3905 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:27.557025 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-94aac23c-5f65-4afd-bc1d-4ef46eea3905 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] [instance: 1cd3fd39-6d38-4c30-9dda-dd9b5530c294] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:27.578497 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5bf69744-5c44-410e-b173-b41e4c5686b8 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:27.585277 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5bf69744-5c44-410e-b173-b41e4c5686b8 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:27.588078 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94aac23c-5f65-4afd-bc1d-4ef46eea3905 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:27.588693 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5bf69744-5c44-410e-b173-b41e4c5686b8 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:27.590552 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5bf69744-5c44-410e-b173-b41e4c5686b8 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:27.594371 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94aac23c-5f65-4afd-bc1d-4ef46eea3905 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:27.597241 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5bf69744-5c44-410e-b173-b41e4c5686b8 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:27.597556 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94aac23c-5f65-4afd-bc1d-4ef46eea3905 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:27.598454 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94aac23c-5f65-4afd-bc1d-4ef46eea3905 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:27.599021 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5bf69744-5c44-410e-b173-b41e4c5686b8 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:27.602727 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94aac23c-5f65-4afd-bc1d-4ef46eea3905 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:27.603126 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94aac23c-5f65-4afd-bc1d-4ef46eea3905 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:27.691899 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-5bf69744-5c44-410e-b173-b41e4c5686b8 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Getting quotas for project 47aadec780734d03a262d4021f48d625. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:14:27.714283 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-5bf69744-5c44-410e-b173-b41e4c5686b8 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Getting quotas for user 519c893a1e094200b882cf23db7cae54 and project 47aadec780734d03a262d4021f48d625. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:14:27.801100 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5bf69744-5c44-410e-b173-b41e4c5686b8 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:14:27.821079 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5bf69744-5c44-410e-b173-b41e4c5686b8 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: cffc5366-8131-4a2b-bf51-39e4d23929e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:14:27.987331 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-94aac23c-5f65-4afd-bc1d-4ef46eea3905 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870da6eeeb684fa380bf48b41f27b984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2182cae228436ba5c9fc59edb00274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:27.999808 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-94aac23c-5f65-4afd-bc1d-4ef46eea3905 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] 10.222.0.42 "GET /compute/v2.1/servers/1cd3fd39-6d38-4c30-9dda-dd9b5530c294" status: 200 len: 1274 microversion: 2.1 time: 0.474725 Oct 23 01:14:28.002677 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 567/1081] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:27 2022] GET /compute/v2.1/servers/1cd3fd39-6d38-4c30-9dda-dd9b5530c294 => generated 1274 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:28.018540 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-49f1ff14-94a0-4fa6-a60a-aadad7dd31a2 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:28.020073 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-49f1ff14-94a0-4fa6-a60a-aadad7dd31a2 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:28.035525 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-49f1ff14-94a0-4fa6-a60a-aadad7dd31a2 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:28.036448 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-49f1ff14-94a0-4fa6-a60a-aadad7dd31a2 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:28.038857 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-49f1ff14-94a0-4fa6-a60a-aadad7dd31a2 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:28.039871 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-49f1ff14-94a0-4fa6-a60a-aadad7dd31a2 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:28.042828 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-49f1ff14-94a0-4fa6-a60a-aadad7dd31a2 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:28.043754 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-49f1ff14-94a0-4fa6-a60a-aadad7dd31a2 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:28.130323 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5bf69744-5c44-410e-b173-b41e4c5686b8 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.875025 Oct 23 01:14:28.142216 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 515/1082] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:14:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:14:28.149521 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0f35ba2f-7ce5-45f9-9747-0eb240184d61 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:28.173179 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0f35ba2f-7ce5-45f9-9747-0eb240184d61 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: cffc5366-8131-4a2b-bf51-39e4d23929e3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:28.437612 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-49f1ff14-94a0-4fa6-a60a-aadad7dd31a2 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:28.461405 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0f35ba2f-7ce5-45f9-9747-0eb240184d61 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:28.488416 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0f35ba2f-7ce5-45f9-9747-0eb240184d61 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/cffc5366-8131-4a2b-bf51-39e4d23929e3" status: 200 len: 1216 microversion: 2.1 time: 0.344729 Oct 23 01:14:28.491698 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-49f1ff14-94a0-4fa6-a60a-aadad7dd31a2 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:28.493182 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-49f1ff14-94a0-4fa6-a60a-aadad7dd31a2 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:28.498099 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 516/1083] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:28 2022] GET /compute/v2.1/servers/cffc5366-8131-4a2b-bf51-39e4d23929e3 => generated 1216 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:28.508387 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-49f1ff14-94a0-4fa6-a60a-aadad7dd31a2 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1544 microversion: 2.91 time: 0.501384 Oct 23 01:14:28.515202 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b91c2791-cf37-423d-b164-30343e8297d1 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:28.518849 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b91c2791-cf37-423d-b164-30343e8297d1 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 8db307a5-7a1e-4791-8fa9-e934894238e9] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:28.528053 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 568/1084] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:28 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1544 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:28.551286 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b91c2791-cf37-423d-b164-30343e8297d1 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:28.554040 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-61662439-31b1-4c99-b688-3b2f5c5918dc tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:28.555324 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b91c2791-cf37-423d-b164-30343e8297d1 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:28.556309 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-61662439-31b1-4c99-b688-3b2f5c5918dc tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] [instance: e0769a09-da3a-422f-a7a8-27edf4a2e209] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:28.556906 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b91c2791-cf37-423d-b164-30343e8297d1 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:28.558131 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b91c2791-cf37-423d-b164-30343e8297d1 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:28.560296 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b91c2791-cf37-423d-b164-30343e8297d1 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:28.562269 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b91c2791-cf37-423d-b164-30343e8297d1 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:28.570547 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61662439-31b1-4c99-b688-3b2f5c5918dc tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:28.573011 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61662439-31b1-4c99-b688-3b2f5c5918dc tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:28.573820 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61662439-31b1-4c99-b688-3b2f5c5918dc tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:28.574720 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61662439-31b1-4c99-b688-3b2f5c5918dc tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:28.578999 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61662439-31b1-4c99-b688-3b2f5c5918dc tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:28.579615 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61662439-31b1-4c99-b688-3b2f5c5918dc tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:28.774311 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-61662439-31b1-4c99-b688-3b2f5c5918dc tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80703c3d1dae419c9fd5ca103f3c28bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356a4b3819db457fb5caf68ded0212fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:28.802297 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-61662439-31b1-4c99-b688-3b2f5c5918dc tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] 10.222.0.42 "GET /compute/v2.1/servers/e0769a09-da3a-422f-a7a8-27edf4a2e209" status: 200 len: 1270 microversion: 2.1 time: 0.246726 Oct 23 01:14:28.802297 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 569/1085] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:28 2022] GET /compute/v2.1/servers/e0769a09-da3a-422f-a7a8-27edf4a2e209 => generated 1270 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:28.863023 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-e11f82fc-8998-4bac-a2c7-612650a99354 req-7ac01f32-e516-44f7-a34b-ef14d6e79c3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8db307a5-7a1e-4791-8fa9-e934894238e9", "name": "network-vif-plugged", "status": "completed", "tag": "7328ae33-f6ec-49e1-9744-c0a7a6f75e28"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:14:28.872910 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b91c2791-cf37-423d-b164-30343e8297d1 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:28.886062 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b91c2791-cf37-423d-b164-30343e8297d1 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:28.887908 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b91c2791-cf37-423d-b164-30343e8297d1 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:28.889616 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b91c2791-cf37-423d-b164-30343e8297d1 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9" status: 200 len: 1361 microversion: 2.25 time: 0.389720 Oct 23 01:14:28.890418 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 517/1086] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:28 2022] GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9 => generated 1361 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:28.890948 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-e11f82fc-8998-4bac-a2c7-612650a99354 req-7ac01f32-e516-44f7-a34b-ef14d6e79c3d service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:28.891484 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-e11f82fc-8998-4bac-a2c7-612650a99354 req-7ac01f32-e516-44f7-a34b-ef14d6e79c3d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:28.892148 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-e11f82fc-8998-4bac-a2c7-612650a99354 req-7ac01f32-e516-44f7-a34b-ef14d6e79c3d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:28.914376 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-e11f82fc-8998-4bac-a2c7-612650a99354 req-7ac01f32-e516-44f7-a34b-ef14d6e79c3d service nova] Creating event network-vif-plugged:7328ae33-f6ec-49e1-9744-c0a7a6f75e28 for instance 8db307a5-7a1e-4791-8fa9-e934894238e9 on n-h2-master-1 Oct 23 01:14:28.918741 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4caa94e8-733a-4004-9c84-53f81c090075 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Calling method '.version_select at 0x7f5cc1bb7c10>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:28.923227 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4caa94e8-733a-4004-9c84-53f81c090075 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:28.923713 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4caa94e8-733a-4004-9c84-53f81c090075 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:28.924236 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4caa94e8-733a-4004-9c84-53f81c090075 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:28.931193 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-e11f82fc-8998-4bac-a2c7-612650a99354 req-7ac01f32-e516-44f7-a34b-ef14d6e79c3d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072201 Oct 23 01:14:28.932168 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 570/1087] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:14:28.935364 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4caa94e8-733a-4004-9c84-53f81c090075 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] 10.222.0.42 "GET /compute/v2.1/os-migrations" status: 200 len: 1954 microversion: 2.1 time: 0.021409 Oct 23 01:14:28.936384 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 518/1088] 10.222.0.42 () {58 vars in 1143 bytes} [Sun Oct 23 01:14:28 2022] GET /compute/v2.1/os-migrations => generated 1954 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:14:28.973309 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-27e110b2-ca12-4f91-9136-79da26d42494 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:28.980543 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-27e110b2-ca12-4f91-9136-79da26d42494 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014920 Oct 23 01:14:28.988559 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 571/1089] 10.222.0.42 () {58 vars in 1137 bytes} [Sun Oct 23 01:14:28 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:14:28.996768 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-59bc9baf-70fb-4341-9252-d63b85ba1aa7 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1078225792", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:14:29.030901 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0254bda8-1ea7-4509-ad87-cd215f2e227f tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:29.032182 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0254bda8-1ea7-4509-ad87-cd215f2e227f tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] [instance: 1cd3fd39-6d38-4c30-9dda-dd9b5530c294] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:29.042421 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0254bda8-1ea7-4509-ad87-cd215f2e227f tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:29.043255 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0254bda8-1ea7-4509-ad87-cd215f2e227f tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:29.044027 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0254bda8-1ea7-4509-ad87-cd215f2e227f tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:29.045169 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0254bda8-1ea7-4509-ad87-cd215f2e227f tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:29.046152 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0254bda8-1ea7-4509-ad87-cd215f2e227f tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:29.046850 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0254bda8-1ea7-4509-ad87-cd215f2e227f tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:29.143559 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-59bc9baf-70fb-4341-9252-d63b85ba1aa7 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.153967 Oct 23 01:14:29.147955 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 519/1090] 10.222.0.42 () {60 vars in 1146 bytes} [Sun Oct 23 01:14:28 2022] POST /compute/v2.1/flavors => generated 499 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:14:29.161897 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-93216e79-bf5f-41ed-8b18-169ac648b496 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e2fc5fac-119f-4d57-9f0b-cc51d4b0d54f", "device": "/dev/xvdb"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:14:29.172509 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-93216e79-bf5f-41ed-8b18-169ac648b496 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:29.477107 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0254bda8-1ea7-4509-ad87-cd215f2e227f tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870da6eeeb684fa380bf48b41f27b984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2182cae228436ba5c9fc59edb00274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:29.495312 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0254bda8-1ea7-4509-ad87-cd215f2e227f tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] 10.222.0.42 "GET /compute/v2.1/servers/1cd3fd39-6d38-4c30-9dda-dd9b5530c294" status: 200 len: 1316 microversion: 2.1 time: 0.470187 Oct 23 01:14:29.520757 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 572/1091] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:29 2022] GET /compute/v2.1/servers/1cd3fd39-6d38-4c30-9dda-dd9b5530c294 => generated 1316 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:29.539090 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-01c642e2-8bc0-4e3f-9e56-dd5934c51a42 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:29.558493 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-01c642e2-8bc0-4e3f-9e56-dd5934c51a42 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.036458 Oct 23 01:14:29.569160 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 573/1092] 10.222.0.42 () {58 vars in 1182 bytes} [Sun Oct 23 01:14:29 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:14:29.576201 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-36cf7650-0148-4e47-bf66-d1f94663434e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:29.577143 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-36cf7650-0148-4e47-bf66-d1f94663434e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: cffc5366-8131-4a2b-bf51-39e4d23929e3] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:29.699694 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-93216e79-bf5f-41ed-8b18-169ac648b496 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:29.702351 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-93216e79-bf5f-41ed-8b18-169ac648b496 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:29.703135 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-93216e79-bf5f-41ed-8b18-169ac648b496 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:29.704824 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-93216e79-bf5f-41ed-8b18-169ac648b496 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:29.706164 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-93216e79-bf5f-41ed-8b18-169ac648b496 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:29.707191 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-93216e79-bf5f-41ed-8b18-169ac648b496 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:29.755657 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-36cf7650-0148-4e47-bf66-d1f94663434e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:29.765333 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-36cf7650-0148-4e47-bf66-d1f94663434e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/cffc5366-8131-4a2b-bf51-39e4d23929e3" status: 200 len: 1216 microversion: 2.1 time: 0.193981 Oct 23 01:14:29.778885 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 574/1093] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:29 2022] GET /compute/v2.1/servers/cffc5366-8131-4a2b-bf51-39e4d23929e3 => generated 1216 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:29.796280 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-85df4333-ae89-4fa2-bcaa-a6f77bfdb9e5 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:29.817332 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-85df4333-ae89-4fa2-bcaa-a6f77bfdb9e5 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:29.863323 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-85df4333-ae89-4fa2-bcaa-a6f77bfdb9e5 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:29.866425 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-85df4333-ae89-4fa2-bcaa-a6f77bfdb9e5 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:29.869350 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-85df4333-ae89-4fa2-bcaa-a6f77bfdb9e5 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:29.870843 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-85df4333-ae89-4fa2-bcaa-a6f77bfdb9e5 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:29.874840 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-85df4333-ae89-4fa2-bcaa-a6f77bfdb9e5 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:29.874840 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-85df4333-ae89-4fa2-bcaa-a6f77bfdb9e5 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:30.036775 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-85df4333-ae89-4fa2-bcaa-a6f77bfdb9e5 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:30.055476 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-85df4333-ae89-4fa2-bcaa-a6f77bfdb9e5 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:30.058187 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-85df4333-ae89-4fa2-bcaa-a6f77bfdb9e5 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:30.065889 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-85df4333-ae89-4fa2-bcaa-a6f77bfdb9e5 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1544 microversion: 2.91 time: 0.281879 Oct 23 01:14:30.066803 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 575/1094] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:29 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1544 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:30.077538 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bdb83579-62c7-4e04-907c-c6b8b8aa9bdf tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:30.082986 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-bdb83579-62c7-4e04-907c-c6b8b8aa9bdf tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] [instance: e0769a09-da3a-422f-a7a8-27edf4a2e209] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:30.098267 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:30.102179 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bdb83579-62c7-4e04-907c-c6b8b8aa9bdf tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:30.102770 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bdb83579-62c7-4e04-907c-c6b8b8aa9bdf tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:30.103173 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bdb83579-62c7-4e04-907c-c6b8b8aa9bdf tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:30.105822 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bdb83579-62c7-4e04-907c-c6b8b8aa9bdf tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:30.106733 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bdb83579-62c7-4e04-907c-c6b8b8aa9bdf tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:30.110225 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bdb83579-62c7-4e04-907c-c6b8b8aa9bdf tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:30.206205 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=100 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:30.369942 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bdb83579-62c7-4e04-907c-c6b8b8aa9bdf tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80703c3d1dae419c9fd5ca103f3c28bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356a4b3819db457fb5caf68ded0212fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:30.396095 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bdb83579-62c7-4e04-907c-c6b8b8aa9bdf tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] 10.222.0.42 "GET /compute/v2.1/servers/e0769a09-da3a-422f-a7a8-27edf4a2e209" status: 200 len: 1288 microversion: 2.1 time: 0.325929 Oct 23 01:14:30.396095 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 576/1095] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:30 2022] GET /compute/v2.1/servers/e0769a09-da3a-422f-a7a8-27edf4a2e209 => generated 1288 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:30.414682 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f206861d-84e9-4af3-ae21-a335bf4a39c1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-496907670", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "9bcda188-8c9a-4a0e-a7f3-bd5b16a30592"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:14:30.529441 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-f206861d-84e9-4af3-ae21-a335bf4a39c1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] validate_networks() for None {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:14:31.074210 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-f206861d-84e9-4af3-ae21-a335bf4a39c1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:14:31.074923 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-f206861d-84e9-4af3-ae21-a335bf4a39c1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:14:31.075602 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-f206861d-84e9-4af3-ae21-a335bf4a39c1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:14:31.076278 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-f206861d-84e9-4af3-ae21-a335bf4a39c1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:14:31.078821 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-f206861d-84e9-4af3-ae21-a335bf4a39c1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:14:31.140603 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f206861d-84e9-4af3-ae21-a335bf4a39c1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:31.143330 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f206861d-84e9-4af3-ae21-a335bf4a39c1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:31.144097 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f206861d-84e9-4af3-ae21-a335bf4a39c1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:31.145213 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f206861d-84e9-4af3-ae21-a335bf4a39c1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:31.145663 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f206861d-84e9-4af3-ae21-a335bf4a39c1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:31.149626 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f206861d-84e9-4af3-ae21-a335bf4a39c1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:31.189357 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-f206861d-84e9-4af3-ae21-a335bf4a39c1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Getting quotas for project eb058785345d4e58a5820445efe09bee. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:14:31.203604 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-f206861d-84e9-4af3-ae21-a335bf4a39c1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Getting quotas for user 547aed83a7e44becb9c89dc6bae62255 and project eb058785345d4e58a5820445efe09bee. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:14:31.241491 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f206861d-84e9-4af3-ae21-a335bf4a39c1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:14:31.251025 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f206861d-84e9-4af3-ae21-a335bf4a39c1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 8025dc46-71af-4fec-8f54-5ae9e92cc31f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:14:31.297316 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-93216e79-bf5f-41ed-8b18-169ac648b496 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "POST /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.145830 Oct 23 01:14:31.315812 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 520/1096] 10.222.0.42 () {60 vars in 1323 bytes} [Sun Oct 23 01:14:29 2022] POST /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d/os-volume_attachments => generated 194 bytes in 2162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:14:31.331313 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-51f1bbad-3ede-47ae-ad95-98acc8e073d6 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:31.332047 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-51f1bbad-3ede-47ae-ad95-98acc8e073d6 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 8db307a5-7a1e-4791-8fa9-e934894238e9] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:31.349563 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-51f1bbad-3ede-47ae-ad95-98acc8e073d6 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:31.350430 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-51f1bbad-3ede-47ae-ad95-98acc8e073d6 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:31.351218 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-51f1bbad-3ede-47ae-ad95-98acc8e073d6 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:31.352308 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-51f1bbad-3ede-47ae-ad95-98acc8e073d6 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:31.354124 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-51f1bbad-3ede-47ae-ad95-98acc8e073d6 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:31.372042 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-51f1bbad-3ede-47ae-ad95-98acc8e073d6 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:31.526001 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f206861d-84e9-4af3-ae21-a335bf4a39c1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.124037 Oct 23 01:14:31.542457 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 577/1097] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:14:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1147 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:14:31.552426 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2cfe6fcf-e7bb-406b-ae22-a865327fe343 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:31.553052 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2cfe6fcf-e7bb-406b-ae22-a865327fe343 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] [instance: 1cd3fd39-6d38-4c30-9dda-dd9b5530c294] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:31.568785 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2cfe6fcf-e7bb-406b-ae22-a865327fe343 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:31.568785 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2cfe6fcf-e7bb-406b-ae22-a865327fe343 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:31.569305 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2cfe6fcf-e7bb-406b-ae22-a865327fe343 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:31.570044 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2cfe6fcf-e7bb-406b-ae22-a865327fe343 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:31.570700 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2cfe6fcf-e7bb-406b-ae22-a865327fe343 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:31.571334 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2cfe6fcf-e7bb-406b-ae22-a865327fe343 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:33.749940 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-51f1bbad-3ede-47ae-ad95-98acc8e073d6 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:33.766667 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2cfe6fcf-e7bb-406b-ae22-a865327fe343 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870da6eeeb684fa380bf48b41f27b984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2182cae228436ba5c9fc59edb00274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:33.770683 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-51f1bbad-3ede-47ae-ad95-98acc8e073d6 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:33.772198 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-51f1bbad-3ede-47ae-ad95-98acc8e073d6 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:33.781191 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-51f1bbad-3ede-47ae-ad95-98acc8e073d6 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9" status: 200 len: 1558 microversion: 2.25 time: 2.462543 Oct 23 01:14:33.781785 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 521/1098] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:31 2022] GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9 => generated 1558 bytes in 2465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:33.813310 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2cfe6fcf-e7bb-406b-ae22-a865327fe343 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] 10.222.0.42 "GET /compute/v2.1/servers/1cd3fd39-6d38-4c30-9dda-dd9b5530c294" status: 200 len: 1316 microversion: 2.1 time: 2.269622 Oct 23 01:14:33.813910 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 578/1099] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:31 2022] GET /compute/v2.1/servers/1cd3fd39-6d38-4c30-9dda-dd9b5530c294 => generated 1316 bytes in 2271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:33.816036 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-adccf3fe-bdf2-494a-a0fc-6237b3194c98 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:33.818397 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-adccf3fe-bdf2-494a-a0fc-6237b3194c98 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: cffc5366-8131-4a2b-bf51-39e4d23929e3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:33.831980 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-21acac15-6ab7-469e-a768-bf47654182d5 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-2087268378", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "cf4f9666-645f-4bd1-990b-2a05d23e76be"}, {"uuid": "efe096ff-3eb5-4ebf-a4c6-b14e53039355"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:14:33.838556 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-adccf3fe-bdf2-494a-a0fc-6237b3194c98 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:33.840951 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-adccf3fe-bdf2-494a-a0fc-6237b3194c98 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:33.842008 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-adccf3fe-bdf2-494a-a0fc-6237b3194c98 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:33.843932 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-adccf3fe-bdf2-494a-a0fc-6237b3194c98 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:33.846094 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-adccf3fe-bdf2-494a-a0fc-6237b3194c98 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:33.847786 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-adccf3fe-bdf2-494a-a0fc-6237b3194c98 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:33.916559 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-21acac15-6ab7-469e-a768-bf47654182d5 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] validate_networks() for [('cf4f9666-645f-4bd1-990b-2a05d23e76be', None, None, None, None, None), ('efe096ff-3eb5-4ebf-a4c6-b14e53039355', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:14:34.030205 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-adccf3fe-bdf2-494a-a0fc-6237b3194c98 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:34.038909 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-adccf3fe-bdf2-494a-a0fc-6237b3194c98 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/cffc5366-8131-4a2b-bf51-39e4d23929e3" status: 200 len: 1268 microversion: 2.1 time: 0.254090 Oct 23 01:14:34.039629 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 522/1100] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:33 2022] GET /compute/v2.1/servers/cffc5366-8131-4a2b-bf51-39e4d23929e3 => generated 1268 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:34.044501 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-21b16660-69c5-4364-b7e1-11cc74f009c5 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:34.045760 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-21b16660-69c5-4364-b7e1-11cc74f009c5 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:34.052760 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-21b16660-69c5-4364-b7e1-11cc74f009c5 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:34.053883 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-21b16660-69c5-4364-b7e1-11cc74f009c5 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:34.055267 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-21b16660-69c5-4364-b7e1-11cc74f009c5 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:34.056211 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-21b16660-69c5-4364-b7e1-11cc74f009c5 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:34.056853 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-21b16660-69c5-4364-b7e1-11cc74f009c5 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:34.057464 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-21b16660-69c5-4364-b7e1-11cc74f009c5 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:34.242986 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-21b16660-69c5-4364-b7e1-11cc74f009c5 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:34.259256 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-21b16660-69c5-4364-b7e1-11cc74f009c5 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:34.262180 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-21b16660-69c5-4364-b7e1-11cc74f009c5 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:34.289729 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-21b16660-69c5-4364-b7e1-11cc74f009c5 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1544 microversion: 2.91 time: 0.248761 Oct 23 01:14:34.293429 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 523/1101] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:34 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1544 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:34.305510 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2d68fcd1-95cc-4d51-9185-18c152922dbe tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:34.307362 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2d68fcd1-95cc-4d51-9185-18c152922dbe tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] [instance: e0769a09-da3a-422f-a7a8-27edf4a2e209] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:34.346248 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2d68fcd1-95cc-4d51-9185-18c152922dbe tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:34.346874 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2d68fcd1-95cc-4d51-9185-18c152922dbe tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:34.347320 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2d68fcd1-95cc-4d51-9185-18c152922dbe tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:34.348249 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2d68fcd1-95cc-4d51-9185-18c152922dbe tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:34.348956 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2d68fcd1-95cc-4d51-9185-18c152922dbe tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:34.349543 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2d68fcd1-95cc-4d51-9185-18c152922dbe tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:34.792202 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2d68fcd1-95cc-4d51-9185-18c152922dbe tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80703c3d1dae419c9fd5ca103f3c28bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356a4b3819db457fb5caf68ded0212fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:34.810280 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2d68fcd1-95cc-4d51-9185-18c152922dbe tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] 10.222.0.42 "GET /compute/v2.1/servers/e0769a09-da3a-422f-a7a8-27edf4a2e209" status: 200 len: 1318 microversion: 2.1 time: 0.512262 Oct 23 01:14:34.811185 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 524/1102] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:34 2022] GET /compute/v2.1/servers/e0769a09-da3a-422f-a7a8-27edf4a2e209 => generated 1318 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:34.849106 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-74342fec-ce84-437c-81ea-8c46a6d914c0 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:34.852710 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-74342fec-ce84-437c-81ea-8c46a6d914c0 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 8025dc46-71af-4fec-8f54-5ae9e92cc31f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:34.871389 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-74342fec-ce84-437c-81ea-8c46a6d914c0 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:34.872294 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-74342fec-ce84-437c-81ea-8c46a6d914c0 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:34.872754 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-74342fec-ce84-437c-81ea-8c46a6d914c0 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:34.873506 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-74342fec-ce84-437c-81ea-8c46a6d914c0 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:34.873990 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-74342fec-ce84-437c-81ea-8c46a6d914c0 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:34.877682 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-74342fec-ce84-437c-81ea-8c46a6d914c0 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:35.244554 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-74342fec-ce84-437c-81ea-8c46a6d914c0 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:35.263327 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-74342fec-ce84-437c-81ea-8c46a6d914c0 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f" status: 200 len: 1330 microversion: 2.1 time: 0.440057 Oct 23 01:14:35.285046 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 525/1103] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:34 2022] GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f => generated 1330 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:35.290704 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-b87f6609-fdea-4693-8ac0-183e8256581a req-788f7966-4a14-4448-9b8c-f0d2b7ba5a06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cd3fd39-6d38-4c30-9dda-dd9b5530c294", "tag": "eff753b5-7858-42c9-8fa5-2b5cca32143e"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:14:35.305642 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-b87f6609-fdea-4693-8ac0-183e8256581a req-788f7966-4a14-4448-9b8c-f0d2b7ba5a06 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:35.306434 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-b87f6609-fdea-4693-8ac0-183e8256581a req-788f7966-4a14-4448-9b8c-f0d2b7ba5a06 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:35.307053 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-b87f6609-fdea-4693-8ac0-183e8256581a req-788f7966-4a14-4448-9b8c-f0d2b7ba5a06 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:35.333707 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-b87f6609-fdea-4693-8ac0-183e8256581a req-788f7966-4a14-4448-9b8c-f0d2b7ba5a06 service nova] Creating event network-changed:eff753b5-7858-42c9-8fa5-2b5cca32143e for instance 1cd3fd39-6d38-4c30-9dda-dd9b5530c294 on n-h1-master-1 Oct 23 01:14:35.342399 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-b87f6609-fdea-4693-8ac0-183e8256581a req-788f7966-4a14-4448-9b8c-f0d2b7ba5a06 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055135 Oct 23 01:14:35.344078 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 526/1104] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:14:35.353066 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-877a0e87-16e2-4d5d-ad57-f9724f8bf702 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:35.354107 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-877a0e87-16e2-4d5d-ad57-f9724f8bf702 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] [instance: 8db307a5-7a1e-4791-8fa9-e934894238e9] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:35.364063 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-877a0e87-16e2-4d5d-ad57-f9724f8bf702 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:35.365913 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-877a0e87-16e2-4d5d-ad57-f9724f8bf702 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:35.368303 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-877a0e87-16e2-4d5d-ad57-f9724f8bf702 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:35.370391 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-877a0e87-16e2-4d5d-ad57-f9724f8bf702 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:35.372331 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-877a0e87-16e2-4d5d-ad57-f9724f8bf702 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:35.373701 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-877a0e87-16e2-4d5d-ad57-f9724f8bf702 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:35.945840 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-877a0e87-16e2-4d5d-ad57-f9724f8bf702 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lazy-loading 'services' on Instance uuid 8db307a5-7a1e-4791-8fa9-e934894238e9 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:14:35.984245 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-877a0e87-16e2-4d5d-ad57-f9724f8bf702 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9" status: 200 len: 2050 microversion: 2.25 time: 0.637937 Oct 23 01:14:35.984837 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 527/1105] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:35 2022] GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9 => generated 2050 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:36.005999 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5069f133-c173-4da2-bf99-6ff2d2fad8cc tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:36.006908 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5069f133-c173-4da2-bf99-6ff2d2fad8cc tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] [instance: 1cd3fd39-6d38-4c30-9dda-dd9b5530c294] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:36.020083 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5069f133-c173-4da2-bf99-6ff2d2fad8cc tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:36.021438 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5069f133-c173-4da2-bf99-6ff2d2fad8cc tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:36.021438 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5069f133-c173-4da2-bf99-6ff2d2fad8cc tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:36.022210 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5069f133-c173-4da2-bf99-6ff2d2fad8cc tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:36.022659 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5069f133-c173-4da2-bf99-6ff2d2fad8cc tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:36.023716 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5069f133-c173-4da2-bf99-6ff2d2fad8cc tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:36.219207 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-21acac15-6ab7-469e-a768-bf47654182d5 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:14:36.219739 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-21acac15-6ab7-469e-a768-bf47654182d5 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:14:36.220084 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-21acac15-6ab7-469e-a768-bf47654182d5 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:14:36.220496 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-21acac15-6ab7-469e-a768-bf47654182d5 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:14:36.220897 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-21acac15-6ab7-469e-a768-bf47654182d5 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:14:36.244296 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-21acac15-6ab7-469e-a768-bf47654182d5 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:36.250361 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-21acac15-6ab7-469e-a768-bf47654182d5 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:36.250814 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-21acac15-6ab7-469e-a768-bf47654182d5 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:36.251835 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-21acac15-6ab7-469e-a768-bf47654182d5 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:36.252464 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-21acac15-6ab7-469e-a768-bf47654182d5 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:36.253055 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-21acac15-6ab7-469e-a768-bf47654182d5 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:36.278540 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-21acac15-6ab7-469e-a768-bf47654182d5 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Getting quotas for project abc8f8cefbf441c98d6bda76e99e3173. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:14:36.285330 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-21acac15-6ab7-469e-a768-bf47654182d5 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Getting quotas for user 7262d5984b8c4775b86fae1c0d314718 and project abc8f8cefbf441c98d6bda76e99e3173. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:14:36.303760 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-21acac15-6ab7-469e-a768-bf47654182d5 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:14:36.318890 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-21acac15-6ab7-469e-a768-bf47654182d5 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 59cf7af1-8bca-4768-ac86-6e56d0649946] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:14:36.385867 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5069f133-c173-4da2-bf99-6ff2d2fad8cc tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870da6eeeb684fa380bf48b41f27b984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2182cae228436ba5c9fc59edb00274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:36.399018 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5069f133-c173-4da2-bf99-6ff2d2fad8cc tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] 10.222.0.42 "GET /compute/v2.1/servers/1cd3fd39-6d38-4c30-9dda-dd9b5530c294" status: 200 len: 1316 microversion: 2.1 time: 0.403874 Oct 23 01:14:36.399018 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 528/1106] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:35 2022] GET /compute/v2.1/servers/1cd3fd39-6d38-4c30-9dda-dd9b5530c294 => generated 1316 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:36.407742 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dad5b890-9aff-47fb-bfc9-ad1742625328 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:36.410566 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-dad5b890-9aff-47fb-bfc9-ad1742625328 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: cffc5366-8131-4a2b-bf51-39e4d23929e3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:36.422300 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dad5b890-9aff-47fb-bfc9-ad1742625328 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:36.423054 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dad5b890-9aff-47fb-bfc9-ad1742625328 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:36.423680 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dad5b890-9aff-47fb-bfc9-ad1742625328 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:36.424634 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dad5b890-9aff-47fb-bfc9-ad1742625328 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:36.425258 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dad5b890-9aff-47fb-bfc9-ad1742625328 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:36.425904 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dad5b890-9aff-47fb-bfc9-ad1742625328 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:36.549905 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-dad5b890-9aff-47fb-bfc9-ad1742625328 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:36.559457 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-dad5b890-9aff-47fb-bfc9-ad1742625328 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/cffc5366-8131-4a2b-bf51-39e4d23929e3" status: 200 len: 1274 microversion: 2.1 time: 0.159440 Oct 23 01:14:36.574231 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 529/1107] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:36 2022] GET /compute/v2.1/servers/cffc5366-8131-4a2b-bf51-39e4d23929e3 => generated 1274 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:36.588384 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bc993178-a518-4ded-8364-96f9bf96ef27 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:36.589174 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bc993178-a518-4ded-8364-96f9bf96ef27 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:36.608193 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc993178-a518-4ded-8364-96f9bf96ef27 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:36.610660 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc993178-a518-4ded-8364-96f9bf96ef27 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:36.610660 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc993178-a518-4ded-8364-96f9bf96ef27 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:36.615260 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc993178-a518-4ded-8364-96f9bf96ef27 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:36.616570 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc993178-a518-4ded-8364-96f9bf96ef27 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:36.617168 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc993178-a518-4ded-8364-96f9bf96ef27 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:36.716773 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-21acac15-6ab7-469e-a768-bf47654182d5 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.901758 Oct 23 01:14:36.718961 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 579/1108] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:14:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2904 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:14:36.726182 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fdf2cfba-b3ad-484c-ae4b-94df30d84bc4 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:36.727418 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-fdf2cfba-b3ad-484c-ae4b-94df30d84bc4 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] [instance: e0769a09-da3a-422f-a7a8-27edf4a2e209] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:36.737229 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fdf2cfba-b3ad-484c-ae4b-94df30d84bc4 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:36.738029 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fdf2cfba-b3ad-484c-ae4b-94df30d84bc4 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:36.738898 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fdf2cfba-b3ad-484c-ae4b-94df30d84bc4 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:36.739909 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fdf2cfba-b3ad-484c-ae4b-94df30d84bc4 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:36.740774 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fdf2cfba-b3ad-484c-ae4b-94df30d84bc4 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:36.741413 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fdf2cfba-b3ad-484c-ae4b-94df30d84bc4 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:36.937862 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bc993178-a518-4ded-8364-96f9bf96ef27 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:36.960012 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bc993178-a518-4ded-8364-96f9bf96ef27 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:36.969550 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bc993178-a518-4ded-8364-96f9bf96ef27 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:36.988255 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bc993178-a518-4ded-8364-96f9bf96ef27 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1544 microversion: 2.91 time: 0.419298 Oct 23 01:14:36.988856 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 530/1109] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:36 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1544 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:36.995274 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a24c4606-9e64-4cb7-baa6-8254891833ad tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:37.006942 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a24c4606-9e64-4cb7-baa6-8254891833ad tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] [instance: 8db307a5-7a1e-4791-8fa9-e934894238e9] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:37.034880 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a24c4606-9e64-4cb7-baa6-8254891833ad tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:37.034880 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a24c4606-9e64-4cb7-baa6-8254891833ad tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:37.034880 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a24c4606-9e64-4cb7-baa6-8254891833ad tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:37.034880 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a24c4606-9e64-4cb7-baa6-8254891833ad tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:37.035254 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a24c4606-9e64-4cb7-baa6-8254891833ad tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:37.035254 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a24c4606-9e64-4cb7-baa6-8254891833ad tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:37.631187 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=4 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:37.750985 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-a24c4606-9e64-4cb7-baa6-8254891833ad tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lazy-loading 'services' on Instance uuid 8db307a5-7a1e-4791-8fa9-e934894238e9 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:14:37.772888 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a24c4606-9e64-4cb7-baa6-8254891833ad tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9" status: 200 len: 2050 microversion: 2.25 time: 0.782499 Oct 23 01:14:37.774365 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 531/1110] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:36 2022] GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9 => generated 2050 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:37.779505 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8bbb3209-a75d-4533-b114-64b25116a149 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:37.780141 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8bbb3209-a75d-4533-b114-64b25116a149 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 8025dc46-71af-4fec-8f54-5ae9e92cc31f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:37.786781 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8bbb3209-a75d-4533-b114-64b25116a149 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:37.787646 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8bbb3209-a75d-4533-b114-64b25116a149 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:37.788297 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8bbb3209-a75d-4533-b114-64b25116a149 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:37.789286 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8bbb3209-a75d-4533-b114-64b25116a149 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:37.790160 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8bbb3209-a75d-4533-b114-64b25116a149 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:37.790792 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8bbb3209-a75d-4533-b114-64b25116a149 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:37.795746 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:37.947979 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8bbb3209-a75d-4533-b114-64b25116a149 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:37.962085 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8bbb3209-a75d-4533-b114-64b25116a149 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f" status: 200 len: 1336 microversion: 2.1 time: 0.186557 Oct 23 01:14:37.963588 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 532/1111] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:37 2022] GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f => generated 1336 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:37.976763 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-31b8c63a-18b2-4622-9ef1-de57d2aba419 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:37.977836 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-31b8c63a-18b2-4622-9ef1-de57d2aba419 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 59cf7af1-8bca-4768-ac86-6e56d0649946] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:37.994121 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-31b8c63a-18b2-4622-9ef1-de57d2aba419 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:37.995314 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-31b8c63a-18b2-4622-9ef1-de57d2aba419 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:37.995765 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-31b8c63a-18b2-4622-9ef1-de57d2aba419 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:37.996533 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-31b8c63a-18b2-4622-9ef1-de57d2aba419 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:37.997013 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-31b8c63a-18b2-4622-9ef1-de57d2aba419 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:37.997562 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-31b8c63a-18b2-4622-9ef1-de57d2aba419 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:38.016738 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-fdf2cfba-b3ad-484c-ae4b-94df30d84bc4 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80703c3d1dae419c9fd5ca103f3c28bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356a4b3819db457fb5caf68ded0212fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:38.037879 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fdf2cfba-b3ad-484c-ae4b-94df30d84bc4 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] 10.222.0.42 "GET /compute/v2.1/servers/e0769a09-da3a-422f-a7a8-27edf4a2e209" status: 200 len: 1318 microversion: 2.1 time: 1.313158 Oct 23 01:14:38.042540 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 580/1112] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:36 2022] GET /compute/v2.1/servers/e0769a09-da3a-422f-a7a8-27edf4a2e209 => generated 1318 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:38.056518 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-158d5771-14a5-4ea3-bb3f-dcd66ceb91ec tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:38.060046 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-158d5771-14a5-4ea3-bb3f-dcd66ceb91ec tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] [instance: 1cd3fd39-6d38-4c30-9dda-dd9b5530c294] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:38.077505 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-158d5771-14a5-4ea3-bb3f-dcd66ceb91ec tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:38.081832 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-158d5771-14a5-4ea3-bb3f-dcd66ceb91ec tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:38.083176 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-158d5771-14a5-4ea3-bb3f-dcd66ceb91ec tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:38.084339 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-158d5771-14a5-4ea3-bb3f-dcd66ceb91ec tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:38.086994 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-158d5771-14a5-4ea3-bb3f-dcd66ceb91ec tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:38.087718 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-158d5771-14a5-4ea3-bb3f-dcd66ceb91ec tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:38.164181 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-31b8c63a-18b2-4622-9ef1-de57d2aba419 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262d5984b8c4775b86fae1c0d314718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc8f8cefbf441c98d6bda76e99e3173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:38.187625 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-31b8c63a-18b2-4622-9ef1-de57d2aba419 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946" status: 200 len: 1217 microversion: 2.1 time: 0.220311 Oct 23 01:14:38.188541 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 533/1113] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:37 2022] GET /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946 => generated 1217 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:38.201671 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6cf5988d-7ce8-4ae7-ac3c-5828757f0286 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:38.202396 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6cf5988d-7ce8-4ae7-ac3c-5828757f0286 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: cffc5366-8131-4a2b-bf51-39e4d23929e3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:38.219494 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6cf5988d-7ce8-4ae7-ac3c-5828757f0286 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:38.226729 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6cf5988d-7ce8-4ae7-ac3c-5828757f0286 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:38.226729 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6cf5988d-7ce8-4ae7-ac3c-5828757f0286 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:38.226729 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6cf5988d-7ce8-4ae7-ac3c-5828757f0286 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:38.226729 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6cf5988d-7ce8-4ae7-ac3c-5828757f0286 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:38.227160 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6cf5988d-7ce8-4ae7-ac3c-5828757f0286 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:38.488090 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=20 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:38.877274 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-158d5771-14a5-4ea3-bb3f-dcd66ceb91ec tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870da6eeeb684fa380bf48b41f27b984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2182cae228436ba5c9fc59edb00274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:38.888985 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-158d5771-14a5-4ea3-bb3f-dcd66ceb91ec tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] 10.222.0.42 "GET /compute/v2.1/servers/1cd3fd39-6d38-4c30-9dda-dd9b5530c294" status: 200 len: 1316 microversion: 2.1 time: 0.844692 Oct 23 01:14:38.900785 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6cf5988d-7ce8-4ae7-ac3c-5828757f0286 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:38.902719 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 581/1114] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:38 2022] GET /compute/v2.1/servers/1cd3fd39-6d38-4c30-9dda-dd9b5530c294 => generated 1316 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:38.909129 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6cf5988d-7ce8-4ae7-ac3c-5828757f0286 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/cffc5366-8131-4a2b-bf51-39e4d23929e3" status: 200 len: 1316 microversion: 2.1 time: 0.719495 Oct 23 01:14:38.909712 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 534/1115] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:38 2022] GET /compute/v2.1/servers/cffc5366-8131-4a2b-bf51-39e4d23929e3 => generated 1316 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:38.911496 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4a900906-e63a-411a-ad00-9c078cd10d95 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:38.916371 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4a900906-e63a-411a-ad00-9c078cd10d95 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:38.916905 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4a900906-e63a-411a-ad00-9c078cd10d95 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:38.917349 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4a900906-e63a-411a-ad00-9c078cd10d95 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:38.918119 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4a900906-e63a-411a-ad00-9c078cd10d95 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:38.919672 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-47839c0c-5c61-47dc-945e-904c5cf82daf tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:38.920747 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-47839c0c-5c61-47dc-945e-904c5cf82daf tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:38.925090 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4a900906-e63a-411a-ad00-9c078cd10d95 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:38.925571 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4a900906-e63a-411a-ad00-9c078cd10d95 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:38.941221 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-47839c0c-5c61-47dc-945e-904c5cf82daf tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:38.941902 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-47839c0c-5c61-47dc-945e-904c5cf82daf tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:38.942334 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-47839c0c-5c61-47dc-945e-904c5cf82daf tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:38.945603 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-47839c0c-5c61-47dc-945e-904c5cf82daf tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:38.945953 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-47839c0c-5c61-47dc-945e-904c5cf82daf tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:38.946426 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-47839c0c-5c61-47dc-945e-904c5cf82daf tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:38.992684 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4a900906-e63a-411a-ad00-9c078cd10d95 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.085044 Oct 23 01:14:38.993894 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 582/1116] 10.222.0.42 () {60 vars in 1217 bytes} [Sun Oct 23 01:14:38 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:14:39.005784 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f87a0f8a-6a4f-410e-ae08-c4a7c768c9c0 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:39.006600 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f87a0f8a-6a4f-410e-ae08-c4a7c768c9c0 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 8025dc46-71af-4fec-8f54-5ae9e92cc31f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:39.025226 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f87a0f8a-6a4f-410e-ae08-c4a7c768c9c0 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:39.026512 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f87a0f8a-6a4f-410e-ae08-c4a7c768c9c0 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:39.027175 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f87a0f8a-6a4f-410e-ae08-c4a7c768c9c0 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:39.028117 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f87a0f8a-6a4f-410e-ae08-c4a7c768c9c0 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:39.028802 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f87a0f8a-6a4f-410e-ae08-c4a7c768c9c0 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:39.029446 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f87a0f8a-6a4f-410e-ae08-c4a7c768c9c0 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:39.411642 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-47839c0c-5c61-47dc-945e-904c5cf82daf tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:39.423192 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-47839c0c-5c61-47dc-945e-904c5cf82daf tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:39.424941 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-47839c0c-5c61-47dc-945e-904c5cf82daf tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:39.430637 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-47839c0c-5c61-47dc-945e-904c5cf82daf tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1544 microversion: 2.91 time: 0.515923 Oct 23 01:14:39.431420 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 535/1117] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:38 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1544 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:39.436619 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-360c8c9a-2fcd-45db-86c1-a0afbb1cc9ab tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:14:39.437404 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-360c8c9a-2fcd-45db-86c1-a0afbb1cc9ab tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] [instance: 8db307a5-7a1e-4791-8fa9-e934894238e9] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:39.443759 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-360c8c9a-2fcd-45db-86c1-a0afbb1cc9ab tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:39.444480 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-360c8c9a-2fcd-45db-86c1-a0afbb1cc9ab tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:39.445209 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-360c8c9a-2fcd-45db-86c1-a0afbb1cc9ab tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:39.446187 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-360c8c9a-2fcd-45db-86c1-a0afbb1cc9ab tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:39.447227 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-360c8c9a-2fcd-45db-86c1-a0afbb1cc9ab tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:39.447883 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-360c8c9a-2fcd-45db-86c1-a0afbb1cc9ab tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:39.614401 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f87a0f8a-6a4f-410e-ae08-c4a7c768c9c0 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:39.622466 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f87a0f8a-6a4f-410e-ae08-c4a7c768c9c0 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f" status: 200 len: 1378 microversion: 2.1 time: 0.627050 Oct 23 01:14:39.628050 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 583/1118] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:38 2022] GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f => generated 1378 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:39.628050 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-b41b75a9-e19d-45ea-9f9d-1bdc77bfeb52 req-c4198f14-d463-41df-8975-47acd7fe3b1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0769a09-da3a-422f-a7a8-27edf4a2e209", "tag": "3cdea381-33bb-4ddd-903c-55b03ef495ae"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:14:39.639105 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-b41b75a9-e19d-45ea-9f9d-1bdc77bfeb52 req-c4198f14-d463-41df-8975-47acd7fe3b1a service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:39.639698 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-b41b75a9-e19d-45ea-9f9d-1bdc77bfeb52 req-c4198f14-d463-41df-8975-47acd7fe3b1a service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:39.640205 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-b41b75a9-e19d-45ea-9f9d-1bdc77bfeb52 req-c4198f14-d463-41df-8975-47acd7fe3b1a service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:39.651696 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-b41b75a9-e19d-45ea-9f9d-1bdc77bfeb52 req-c4198f14-d463-41df-8975-47acd7fe3b1a service nova] Creating event network-changed:3cdea381-33bb-4ddd-903c-55b03ef495ae for instance e0769a09-da3a-422f-a7a8-27edf4a2e209 on n-h1-master-1 Oct 23 01:14:39.657556 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-b41b75a9-e19d-45ea-9f9d-1bdc77bfeb52 req-c4198f14-d463-41df-8975-47acd7fe3b1a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033183 Oct 23 01:14:39.658234 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 584/1119] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:14:39.663300 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4804d087-fc21-49bd-99a0-bb1ff739e0f1 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:39.664024 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4804d087-fc21-49bd-99a0-bb1ff739e0f1 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] [instance: e0769a09-da3a-422f-a7a8-27edf4a2e209] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:39.670964 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4804d087-fc21-49bd-99a0-bb1ff739e0f1 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:39.671461 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4804d087-fc21-49bd-99a0-bb1ff739e0f1 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:39.671892 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4804d087-fc21-49bd-99a0-bb1ff739e0f1 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:39.672578 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4804d087-fc21-49bd-99a0-bb1ff739e0f1 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:39.673031 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4804d087-fc21-49bd-99a0-bb1ff739e0f1 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:39.673452 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4804d087-fc21-49bd-99a0-bb1ff739e0f1 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:39.736544 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-360c8c9a-2fcd-45db-86c1-a0afbb1cc9ab tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9/action" status: 202 len: 0 microversion: 2.25 time: 0.302989 Oct 23 01:14:39.738103 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 536/1120] 10.222.0.42 () {62 vars in 1319 bytes} [Sun Oct 23 01:14:39 2022] POST /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:14:39.748246 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cbe99f23-cb0a-446e-8f8d-f1ea5e4a9704 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:39.750976 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-cbe99f23-cb0a-446e-8f8d-f1ea5e4a9704 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 59cf7af1-8bca-4768-ac86-6e56d0649946] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:39.766884 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cbe99f23-cb0a-446e-8f8d-f1ea5e4a9704 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:39.770862 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cbe99f23-cb0a-446e-8f8d-f1ea5e4a9704 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:39.771814 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cbe99f23-cb0a-446e-8f8d-f1ea5e4a9704 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:39.772503 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cbe99f23-cb0a-446e-8f8d-f1ea5e4a9704 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:39.772966 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cbe99f23-cb0a-446e-8f8d-f1ea5e4a9704 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:39.776183 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cbe99f23-cb0a-446e-8f8d-f1ea5e4a9704 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:39.924063 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cbe99f23-cb0a-446e-8f8d-f1ea5e4a9704 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262d5984b8c4775b86fae1c0d314718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc8f8cefbf441c98d6bda76e99e3173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:39.927392 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cbe99f23-cb0a-446e-8f8d-f1ea5e4a9704 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946" status: 200 len: 1265 microversion: 2.1 time: 0.187686 Oct 23 01:14:39.927993 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 537/1121] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:39 2022] GET /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:39.935575 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-794b6fa7-4489-4ea1-8420-da68e9ecc277 req-e3d682e7-9d50-4133-95aa-e42ca38a34a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cd3fd39-6d38-4c30-9dda-dd9b5530c294", "name": "network-vif-plugged", "status": "completed", "tag": "eff753b5-7858-42c9-8fa5-2b5cca32143e"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:14:39.948216 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-794b6fa7-4489-4ea1-8420-da68e9ecc277 req-e3d682e7-9d50-4133-95aa-e42ca38a34a6 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:39.948762 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-794b6fa7-4489-4ea1-8420-da68e9ecc277 req-e3d682e7-9d50-4133-95aa-e42ca38a34a6 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:39.949202 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-794b6fa7-4489-4ea1-8420-da68e9ecc277 req-e3d682e7-9d50-4133-95aa-e42ca38a34a6 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:39.962451 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-794b6fa7-4489-4ea1-8420-da68e9ecc277 req-e3d682e7-9d50-4133-95aa-e42ca38a34a6 service nova] Creating event network-vif-plugged:eff753b5-7858-42c9-8fa5-2b5cca32143e for instance 1cd3fd39-6d38-4c30-9dda-dd9b5530c294 on n-h1-master-1 Oct 23 01:14:39.967763 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-794b6fa7-4489-4ea1-8420-da68e9ecc277 req-e3d682e7-9d50-4133-95aa-e42ca38a34a6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035913 Oct 23 01:14:39.968390 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 538/1122] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:14:39.973852 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-546f40d9-b446-4f8c-925b-c3e92e359de3 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:39.974630 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-546f40d9-b446-4f8c-925b-c3e92e359de3 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] [instance: 8db307a5-7a1e-4791-8fa9-e934894238e9] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:39.990794 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-546f40d9-b446-4f8c-925b-c3e92e359de3 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:39.991830 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-546f40d9-b446-4f8c-925b-c3e92e359de3 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:39.992598 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-546f40d9-b446-4f8c-925b-c3e92e359de3 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:39.994302 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-546f40d9-b446-4f8c-925b-c3e92e359de3 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:39.995922 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-546f40d9-b446-4f8c-925b-c3e92e359de3 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:39.996684 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-546f40d9-b446-4f8c-925b-c3e92e359de3 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:40.434689 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4804d087-fc21-49bd-99a0-bb1ff739e0f1 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80703c3d1dae419c9fd5ca103f3c28bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356a4b3819db457fb5caf68ded0212fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:40.444633 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4804d087-fc21-49bd-99a0-bb1ff739e0f1 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] 10.222.0.42 "GET /compute/v2.1/servers/e0769a09-da3a-422f-a7a8-27edf4a2e209" status: 200 len: 1318 microversion: 2.1 time: 0.785217 Oct 23 01:14:40.446250 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 585/1123] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:39 2022] GET /compute/v2.1/servers/e0769a09-da3a-422f-a7a8-27edf4a2e209 => generated 1318 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:40.451871 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7613658c-2602-48bc-8fbc-ef798b44ab31 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:40.452837 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7613658c-2602-48bc-8fbc-ef798b44ab31 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] [instance: 1cd3fd39-6d38-4c30-9dda-dd9b5530c294] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:40.463846 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7613658c-2602-48bc-8fbc-ef798b44ab31 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:40.467716 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7613658c-2602-48bc-8fbc-ef798b44ab31 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:40.467716 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7613658c-2602-48bc-8fbc-ef798b44ab31 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:40.467716 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7613658c-2602-48bc-8fbc-ef798b44ab31 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:40.467716 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7613658c-2602-48bc-8fbc-ef798b44ab31 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:40.468080 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7613658c-2602-48bc-8fbc-ef798b44ab31 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:40.635106 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-546f40d9-b446-4f8c-925b-c3e92e359de3 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lazy-loading 'services' on Instance uuid 8db307a5-7a1e-4791-8fa9-e934894238e9 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:14:40.653647 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-546f40d9-b446-4f8c-925b-c3e92e359de3 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9" status: 200 len: 2055 microversion: 2.25 time: 0.683947 Oct 23 01:14:40.654727 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 539/1124] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:39 2022] GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9 => generated 2055 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:40.660159 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2444ea74-b209-4032-8bf3-ce224851a154 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:40.660976 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2444ea74-b209-4032-8bf3-ce224851a154 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: cffc5366-8131-4a2b-bf51-39e4d23929e3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:40.669093 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2444ea74-b209-4032-8bf3-ce224851a154 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:40.669817 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2444ea74-b209-4032-8bf3-ce224851a154 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:40.670699 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2444ea74-b209-4032-8bf3-ce224851a154 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:40.671584 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2444ea74-b209-4032-8bf3-ce224851a154 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:40.672653 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2444ea74-b209-4032-8bf3-ce224851a154 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:40.673305 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2444ea74-b209-4032-8bf3-ce224851a154 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:40.818203 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7613658c-2602-48bc-8fbc-ef798b44ab31 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870da6eeeb684fa380bf48b41f27b984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2182cae228436ba5c9fc59edb00274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:40.833920 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7613658c-2602-48bc-8fbc-ef798b44ab31 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] 10.222.0.42 "GET /compute/v2.1/servers/1cd3fd39-6d38-4c30-9dda-dd9b5530c294" status: 200 len: 1316 microversion: 2.1 time: 0.386196 Oct 23 01:14:40.836224 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 586/1125] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:40 2022] GET /compute/v2.1/servers/1cd3fd39-6d38-4c30-9dda-dd9b5530c294 => generated 1316 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:40.844089 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-eec888f8-f9cd-4bb8-820d-e40b944a3127 req-a723de9b-84d0-46d4-bd8b-b5f85c827634 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8025dc46-71af-4fec-8f54-5ae9e92cc31f", "tag": "9dbeafb3-f8f6-45eb-993c-c817b00700d0"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:14:40.875553 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-eec888f8-f9cd-4bb8-820d-e40b944a3127 req-a723de9b-84d0-46d4-bd8b-b5f85c827634 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:40.876304 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-eec888f8-f9cd-4bb8-820d-e40b944a3127 req-a723de9b-84d0-46d4-bd8b-b5f85c827634 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:40.876942 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-eec888f8-f9cd-4bb8-820d-e40b944a3127 req-a723de9b-84d0-46d4-bd8b-b5f85c827634 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:40.915828 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-eec888f8-f9cd-4bb8-820d-e40b944a3127 req-a723de9b-84d0-46d4-bd8b-b5f85c827634 service nova] Creating event network-changed:9dbeafb3-f8f6-45eb-993c-c817b00700d0 for instance 8025dc46-71af-4fec-8f54-5ae9e92cc31f on n-h2-master-1 Oct 23 01:14:40.921602 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-eec888f8-f9cd-4bb8-820d-e40b944a3127 req-a723de9b-84d0-46d4-bd8b-b5f85c827634 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084014 Oct 23 01:14:40.922508 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 587/1126] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:14:40.928266 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7fae62d0-633c-46e1-86a1-b25528a00661 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:40.929286 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7fae62d0-633c-46e1-86a1-b25528a00661 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:40.936453 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7fae62d0-633c-46e1-86a1-b25528a00661 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:40.937040 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7fae62d0-633c-46e1-86a1-b25528a00661 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:40.937536 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7fae62d0-633c-46e1-86a1-b25528a00661 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:40.938323 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7fae62d0-633c-46e1-86a1-b25528a00661 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:40.938972 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7fae62d0-633c-46e1-86a1-b25528a00661 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:40.939794 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7fae62d0-633c-46e1-86a1-b25528a00661 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:40.965748 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2444ea74-b209-4032-8bf3-ce224851a154 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:40.979159 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2444ea74-b209-4032-8bf3-ce224851a154 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/cffc5366-8131-4a2b-bf51-39e4d23929e3" status: 200 len: 1316 microversion: 2.1 time: 0.319842 Oct 23 01:14:40.979847 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 540/1127] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:40 2022] GET /compute/v2.1/servers/cffc5366-8131-4a2b-bf51-39e4d23929e3 => generated 1316 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:40.985484 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8fbbac4a-d8b8-465d-b2df-7c6a50439757 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:40.986429 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8fbbac4a-d8b8-465d-b2df-7c6a50439757 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 8025dc46-71af-4fec-8f54-5ae9e92cc31f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:40.994686 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8fbbac4a-d8b8-465d-b2df-7c6a50439757 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:40.995464 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8fbbac4a-d8b8-465d-b2df-7c6a50439757 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:40.996089 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8fbbac4a-d8b8-465d-b2df-7c6a50439757 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:40.996829 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8fbbac4a-d8b8-465d-b2df-7c6a50439757 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:40.997298 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8fbbac4a-d8b8-465d-b2df-7c6a50439757 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:40.997733 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8fbbac4a-d8b8-465d-b2df-7c6a50439757 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:41.031596 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7fae62d0-633c-46e1-86a1-b25528a00661 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:41.044023 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7fae62d0-633c-46e1-86a1-b25528a00661 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:41.046784 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7fae62d0-633c-46e1-86a1-b25528a00661 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:41.053886 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7fae62d0-633c-46e1-86a1-b25528a00661 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1544 microversion: 2.91 time: 0.129643 Oct 23 01:14:41.056986 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 588/1128] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:40 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1544 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:41.062819 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9876d608-e160-4f4b-8804-7fd6befb374e tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:41.063680 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9876d608-e160-4f4b-8804-7fd6befb374e tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 59cf7af1-8bca-4768-ac86-6e56d0649946] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:41.071559 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9876d608-e160-4f4b-8804-7fd6befb374e tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:41.072308 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9876d608-e160-4f4b-8804-7fd6befb374e tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:41.072906 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9876d608-e160-4f4b-8804-7fd6befb374e tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:41.073821 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9876d608-e160-4f4b-8804-7fd6befb374e tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:41.074700 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9876d608-e160-4f4b-8804-7fd6befb374e tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:41.075660 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9876d608-e160-4f4b-8804-7fd6befb374e tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:41.173846 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9876d608-e160-4f4b-8804-7fd6befb374e tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262d5984b8c4775b86fae1c0d314718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc8f8cefbf441c98d6bda76e99e3173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:41.183419 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9876d608-e160-4f4b-8804-7fd6befb374e tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946" status: 200 len: 1273 microversion: 2.1 time: 0.125041 Oct 23 01:14:41.184244 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 589/1129] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:41 2022] GET /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946 => generated 1273 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:41.243052 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8fbbac4a-d8b8-465d-b2df-7c6a50439757 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:41.254349 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8fbbac4a-d8b8-465d-b2df-7c6a50439757 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f" status: 200 len: 1378 microversion: 2.1 time: 0.272411 Oct 23 01:14:41.255166 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 541/1130] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:40 2022] GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f => generated 1378 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:41.475077 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ba3d599d-4aff-48df-ad51-1dbd6d8f23fa tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:41.475786 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ba3d599d-4aff-48df-ad51-1dbd6d8f23fa tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] [instance: e0769a09-da3a-422f-a7a8-27edf4a2e209] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:41.483074 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ba3d599d-4aff-48df-ad51-1dbd6d8f23fa tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:41.483560 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ba3d599d-4aff-48df-ad51-1dbd6d8f23fa tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:41.483993 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ba3d599d-4aff-48df-ad51-1dbd6d8f23fa tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:41.484996 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ba3d599d-4aff-48df-ad51-1dbd6d8f23fa tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:41.485619 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ba3d599d-4aff-48df-ad51-1dbd6d8f23fa tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:41.486353 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ba3d599d-4aff-48df-ad51-1dbd6d8f23fa tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:41.674949 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-02c95f53-53cb-44e4-9781-6a4e9f4fad45 req-25785f91-b76f-4aa2-a5c6-e5e36d38de54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cffc5366-8131-4a2b-bf51-39e4d23929e3", "tag": "9c227e6f-548f-41bb-9cb3-74d96aabdc2a"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:14:41.685031 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-02c95f53-53cb-44e4-9781-6a4e9f4fad45 req-25785f91-b76f-4aa2-a5c6-e5e36d38de54 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:41.685517 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-02c95f53-53cb-44e4-9781-6a4e9f4fad45 req-25785f91-b76f-4aa2-a5c6-e5e36d38de54 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:41.685949 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-02c95f53-53cb-44e4-9781-6a4e9f4fad45 req-25785f91-b76f-4aa2-a5c6-e5e36d38de54 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:41.699013 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-02c95f53-53cb-44e4-9781-6a4e9f4fad45 req-25785f91-b76f-4aa2-a5c6-e5e36d38de54 service nova] Creating event network-changed:9c227e6f-548f-41bb-9cb3-74d96aabdc2a for instance cffc5366-8131-4a2b-bf51-39e4d23929e3 on n-h2-master-1 Oct 23 01:14:41.703802 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-02c95f53-53cb-44e4-9781-6a4e9f4fad45 req-25785f91-b76f-4aa2-a5c6-e5e36d38de54 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032625 Oct 23 01:14:41.704393 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 542/1131] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:14:41.709216 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-893157d4-c14c-459a-8eee-594b18fa70ef tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:41.709912 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-893157d4-c14c-459a-8eee-594b18fa70ef tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] [instance: 8db307a5-7a1e-4791-8fa9-e934894238e9] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:41.716584 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-893157d4-c14c-459a-8eee-594b18fa70ef tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:41.717023 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-893157d4-c14c-459a-8eee-594b18fa70ef tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:41.717456 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-893157d4-c14c-459a-8eee-594b18fa70ef tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:41.718194 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-893157d4-c14c-459a-8eee-594b18fa70ef tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:41.718652 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-893157d4-c14c-459a-8eee-594b18fa70ef tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:41.719077 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-893157d4-c14c-459a-8eee-594b18fa70ef tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:41.724152 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ba3d599d-4aff-48df-ad51-1dbd6d8f23fa tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80703c3d1dae419c9fd5ca103f3c28bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356a4b3819db457fb5caf68ded0212fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:41.733926 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ba3d599d-4aff-48df-ad51-1dbd6d8f23fa tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] 10.222.0.42 "GET /compute/v2.1/servers/e0769a09-da3a-422f-a7a8-27edf4a2e209" status: 200 len: 1318 microversion: 2.1 time: 0.263041 Oct 23 01:14:41.734759 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 590/1132] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:41 2022] GET /compute/v2.1/servers/e0769a09-da3a-422f-a7a8-27edf4a2e209 => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:41.849530 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-893157d4-c14c-459a-8eee-594b18fa70ef tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lazy-loading 'services' on Instance uuid 8db307a5-7a1e-4791-8fa9-e934894238e9 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:14:41.857401 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-52cec0be-a27e-46b2-9454-972121803627 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:41.857944 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-52cec0be-a27e-46b2-9454-972121803627 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] [instance: 1cd3fd39-6d38-4c30-9dda-dd9b5530c294] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:41.863621 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-893157d4-c14c-459a-8eee-594b18fa70ef tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9" status: 200 len: 2035 microversion: 2.25 time: 0.158026 Oct 23 01:14:41.864196 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 543/1133] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:41 2022] GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9 => generated 2035 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:41.864321 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52cec0be-a27e-46b2-9454-972121803627 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:41.864990 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52cec0be-a27e-46b2-9454-972121803627 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:41.865435 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52cec0be-a27e-46b2-9454-972121803627 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:41.866180 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52cec0be-a27e-46b2-9454-972121803627 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:41.866666 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52cec0be-a27e-46b2-9454-972121803627 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:41.867060 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52cec0be-a27e-46b2-9454-972121803627 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:41.888675 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-87dd78a8-8418-4695-80b7-e9fb9a5553aa tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": "auto"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:14:41.891168 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-87dd78a8-8418-4695-80b7-e9fb9a5553aa tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] [instance: 8db307a5-7a1e-4791-8fa9-e934894238e9] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:41.897232 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-87dd78a8-8418-4695-80b7-e9fb9a5553aa tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:41.898916 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-87dd78a8-8418-4695-80b7-e9fb9a5553aa tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:41.899364 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-87dd78a8-8418-4695-80b7-e9fb9a5553aa tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:41.900072 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-87dd78a8-8418-4695-80b7-e9fb9a5553aa tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:41.900609 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-87dd78a8-8418-4695-80b7-e9fb9a5553aa tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:41.901031 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-87dd78a8-8418-4695-80b7-e9fb9a5553aa tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:41.926177 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-87dd78a8-8418-4695-80b7-e9fb9a5553aa tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lazy-loading 'flavor' on Instance uuid 8db307a5-7a1e-4791-8fa9-e934894238e9 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:14:41.938715 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-87dd78a8-8418-4695-80b7-e9fb9a5553aa tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] [instance: 8db307a5-7a1e-4791-8fa9-e934894238e9] Going to try to live migrate instance to n-h1-master-1 {{(pid=120944) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 23 01:14:42.000261 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-52cec0be-a27e-46b2-9454-972121803627 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870da6eeeb684fa380bf48b41f27b984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2182cae228436ba5c9fc59edb00274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:42.008540 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-52cec0be-a27e-46b2-9454-972121803627 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] 10.222.0.42 "GET /compute/v2.1/servers/1cd3fd39-6d38-4c30-9dda-dd9b5530c294" status: 200 len: 1316 microversion: 2.1 time: 0.155092 Oct 23 01:14:42.009109 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 591/1134] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:41 2022] GET /compute/v2.1/servers/1cd3fd39-6d38-4c30-9dda-dd9b5530c294 => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:14:42.013401 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-dc49579a-f92d-44b2-835b-95d584b2c2a5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:42.014046 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-dc49579a-f92d-44b2-835b-95d584b2c2a5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: cffc5366-8131-4a2b-bf51-39e4d23929e3] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:42.019461 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dc49579a-f92d-44b2-835b-95d584b2c2a5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:42.019938 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dc49579a-f92d-44b2-835b-95d584b2c2a5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:42.020366 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dc49579a-f92d-44b2-835b-95d584b2c2a5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:42.021046 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dc49579a-f92d-44b2-835b-95d584b2c2a5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:42.021513 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dc49579a-f92d-44b2-835b-95d584b2c2a5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:42.021909 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dc49579a-f92d-44b2-835b-95d584b2c2a5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:42.153429 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-dc49579a-f92d-44b2-835b-95d584b2c2a5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:42.161167 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-dc49579a-f92d-44b2-835b-95d584b2c2a5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/cffc5366-8131-4a2b-bf51-39e4d23929e3" status: 200 len: 1316 microversion: 2.1 time: 0.151124 Oct 23 01:14:42.161735 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 592/1135] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:42 2022] GET /compute/v2.1/servers/cffc5366-8131-4a2b-bf51-39e4d23929e3 => generated 1316 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:42.166214 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bd68e7cd-6720-4732-9083-c0bc74ab0328 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:42.166819 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-bd68e7cd-6720-4732-9083-c0bc74ab0328 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:42.172720 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd68e7cd-6720-4732-9083-c0bc74ab0328 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:42.173205 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd68e7cd-6720-4732-9083-c0bc74ab0328 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:42.173654 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd68e7cd-6720-4732-9083-c0bc74ab0328 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:42.174446 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd68e7cd-6720-4732-9083-c0bc74ab0328 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:42.174905 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd68e7cd-6720-4732-9083-c0bc74ab0328 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:42.175325 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd68e7cd-6720-4732-9083-c0bc74ab0328 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:42.240602 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bd68e7cd-6720-4732-9083-c0bc74ab0328 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:42.250276 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bd68e7cd-6720-4732-9083-c0bc74ab0328 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:42.255552 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bd68e7cd-6720-4732-9083-c0bc74ab0328 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:42.262621 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bd68e7cd-6720-4732-9083-c0bc74ab0328 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1544 microversion: 2.91 time: 0.099831 Oct 23 01:14:42.263219 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 593/1136] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:42 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1544 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:42.267947 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e68d6cd4-8675-40d6-aa4f-6eacb62e1ad4 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:42.268736 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e68d6cd4-8675-40d6-aa4f-6eacb62e1ad4 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 59cf7af1-8bca-4768-ac86-6e56d0649946] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:42.276271 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e68d6cd4-8675-40d6-aa4f-6eacb62e1ad4 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:42.276779 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e68d6cd4-8675-40d6-aa4f-6eacb62e1ad4 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:42.277328 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e68d6cd4-8675-40d6-aa4f-6eacb62e1ad4 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:42.278457 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e68d6cd4-8675-40d6-aa4f-6eacb62e1ad4 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:42.278927 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e68d6cd4-8675-40d6-aa4f-6eacb62e1ad4 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:42.279358 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e68d6cd4-8675-40d6-aa4f-6eacb62e1ad4 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:42.423339 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e68d6cd4-8675-40d6-aa4f-6eacb62e1ad4 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262d5984b8c4775b86fae1c0d314718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc8f8cefbf441c98d6bda76e99e3173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:42.433767 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e68d6cd4-8675-40d6-aa4f-6eacb62e1ad4 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946" status: 200 len: 1283 microversion: 2.1 time: 0.169360 Oct 23 01:14:42.438867 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 594/1137] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:42 2022] GET /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946 => generated 1283 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:42.443872 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b1f4410a-0a26-4e92-9bb7-9334118ef927 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:42.444456 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b1f4410a-0a26-4e92-9bb7-9334118ef927 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 8025dc46-71af-4fec-8f54-5ae9e92cc31f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:42.454714 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1f4410a-0a26-4e92-9bb7-9334118ef927 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:42.454714 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1f4410a-0a26-4e92-9bb7-9334118ef927 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:42.454714 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1f4410a-0a26-4e92-9bb7-9334118ef927 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:42.454714 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1f4410a-0a26-4e92-9bb7-9334118ef927 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:42.455071 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1f4410a-0a26-4e92-9bb7-9334118ef927 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:42.455071 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1f4410a-0a26-4e92-9bb7-9334118ef927 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:42.610696 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b1f4410a-0a26-4e92-9bb7-9334118ef927 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:42.619411 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b1f4410a-0a26-4e92-9bb7-9334118ef927 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f" status: 200 len: 1378 microversion: 2.1 time: 0.179390 Oct 23 01:14:42.634420 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 595/1138] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:42 2022] GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f => generated 1378 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:42.756607 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-52e2fffa-363c-4467-b639-e347b5d0dceb tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:42.757571 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-52e2fffa-363c-4467-b639-e347b5d0dceb tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] [instance: e0769a09-da3a-422f-a7a8-27edf4a2e209] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:42.764895 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52e2fffa-363c-4467-b639-e347b5d0dceb tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:42.765546 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52e2fffa-363c-4467-b639-e347b5d0dceb tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:42.766156 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52e2fffa-363c-4467-b639-e347b5d0dceb tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:42.767078 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52e2fffa-363c-4467-b639-e347b5d0dceb tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:42.767685 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52e2fffa-363c-4467-b639-e347b5d0dceb tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:42.768284 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52e2fffa-363c-4467-b639-e347b5d0dceb tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:42.792729 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=100 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:43.000890 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-52e2fffa-363c-4467-b639-e347b5d0dceb tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80703c3d1dae419c9fd5ca103f3c28bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356a4b3819db457fb5caf68ded0212fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:43.006098 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-52e2fffa-363c-4467-b639-e347b5d0dceb tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] 10.222.0.42 "GET /compute/v2.1/servers/e0769a09-da3a-422f-a7a8-27edf4a2e209" status: 200 len: 1318 microversion: 2.1 time: 0.251480 Oct 23 01:14:43.010417 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 596/1139] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:42 2022] GET /compute/v2.1/servers/e0769a09-da3a-422f-a7a8-27edf4a2e209 => generated 1318 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:14:43.031855 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-80f58518-54a6-4fc9-a404-aa71570f7a7b tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:43.032543 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-80f58518-54a6-4fc9-a404-aa71570f7a7b tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] [instance: 1cd3fd39-6d38-4c30-9dda-dd9b5530c294] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:43.039714 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-80f58518-54a6-4fc9-a404-aa71570f7a7b tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:43.040209 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-80f58518-54a6-4fc9-a404-aa71570f7a7b tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:43.040646 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-80f58518-54a6-4fc9-a404-aa71570f7a7b tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:43.041446 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-80f58518-54a6-4fc9-a404-aa71570f7a7b tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:43.041903 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-80f58518-54a6-4fc9-a404-aa71570f7a7b tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:43.042362 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-80f58518-54a6-4fc9-a404-aa71570f7a7b tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:43.229374 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-80f58518-54a6-4fc9-a404-aa71570f7a7b tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870da6eeeb684fa380bf48b41f27b984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2182cae228436ba5c9fc59edb00274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:43.237113 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-80f58518-54a6-4fc9-a404-aa71570f7a7b tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] 10.222.0.42 "GET /compute/v2.1/servers/1cd3fd39-6d38-4c30-9dda-dd9b5530c294" status: 200 len: 1503 microversion: 2.1 time: 0.209299 Oct 23 01:14:43.237684 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 597/1140] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:43 2022] GET /compute/v2.1/servers/1cd3fd39-6d38-4c30-9dda-dd9b5530c294 => generated 1503 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:14:43.245193 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3eb5f156-11fe-407e-a161-64aaa3cff0ec tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:43.245870 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3eb5f156-11fe-407e-a161-64aaa3cff0ec tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: cffc5366-8131-4a2b-bf51-39e4d23929e3] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:43.251890 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3eb5f156-11fe-407e-a161-64aaa3cff0ec tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:43.252446 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3eb5f156-11fe-407e-a161-64aaa3cff0ec tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:43.252941 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3eb5f156-11fe-407e-a161-64aaa3cff0ec tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:43.253694 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3eb5f156-11fe-407e-a161-64aaa3cff0ec tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:43.254245 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3eb5f156-11fe-407e-a161-64aaa3cff0ec tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:43.254730 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3eb5f156-11fe-407e-a161-64aaa3cff0ec tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:43.434897 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3eb5f156-11fe-407e-a161-64aaa3cff0ec tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:43.442685 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3eb5f156-11fe-407e-a161-64aaa3cff0ec tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/cffc5366-8131-4a2b-bf51-39e4d23929e3" status: 200 len: 1316 microversion: 2.1 time: 0.203930 Oct 23 01:14:43.443205 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 598/1141] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:43 2022] GET /compute/v2.1/servers/cffc5366-8131-4a2b-bf51-39e4d23929e3 => generated 1316 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:43.450771 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5235d966-180e-4062-b333-867819a49d83 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:43.451266 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5235d966-180e-4062-b333-867819a49d83 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] [instance: 1cd3fd39-6d38-4c30-9dda-dd9b5530c294] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:43.457081 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5235d966-180e-4062-b333-867819a49d83 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:43.457560 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5235d966-180e-4062-b333-867819a49d83 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:43.458038 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5235d966-180e-4062-b333-867819a49d83 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:43.458700 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5235d966-180e-4062-b333-867819a49d83 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:43.459150 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5235d966-180e-4062-b333-867819a49d83 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:43.459590 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5235d966-180e-4062-b333-867819a49d83 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:43.486063 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5235d966-180e-4062-b333-867819a49d83 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] [instance: 1cd3fd39-6d38-4c30-9dda-dd9b5530c294] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:14:43.823990 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5235d966-180e-4062-b333-867819a49d83 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1cd3fd39-6d38-4c30-9dda-dd9b5530c294" status: 204 len: 0 microversion: 2.1 time: 0.379132 Oct 23 01:14:43.824825 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 599/1142] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:14:43 2022] DELETE /compute/v2.1/servers/1cd3fd39-6d38-4c30-9dda-dd9b5530c294 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:14:43.830290 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-46ada1ea-78c2-4e2e-bfb5-4d7af4781951 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:43.831106 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-46ada1ea-78c2-4e2e-bfb5-4d7af4781951 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:43.836957 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46ada1ea-78c2-4e2e-bfb5-4d7af4781951 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:43.837442 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46ada1ea-78c2-4e2e-bfb5-4d7af4781951 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:43.837873 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46ada1ea-78c2-4e2e-bfb5-4d7af4781951 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:43.838650 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46ada1ea-78c2-4e2e-bfb5-4d7af4781951 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:43.839102 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46ada1ea-78c2-4e2e-bfb5-4d7af4781951 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:43.839785 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46ada1ea-78c2-4e2e-bfb5-4d7af4781951 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:43.911997 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-46ada1ea-78c2-4e2e-bfb5-4d7af4781951 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:43.920874 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-46ada1ea-78c2-4e2e-bfb5-4d7af4781951 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:43.922327 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-46ada1ea-78c2-4e2e-bfb5-4d7af4781951 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:43.927351 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-46ada1ea-78c2-4e2e-bfb5-4d7af4781951 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1544 microversion: 2.91 time: 0.101101 Oct 23 01:14:43.927917 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 600/1143] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:43 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1544 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:43.932763 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bcdf0cf1-1824-4846-9fc5-91ac640ac3e6 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:43.933357 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-bcdf0cf1-1824-4846-9fc5-91ac640ac3e6 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 59cf7af1-8bca-4768-ac86-6e56d0649946] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:43.938977 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bcdf0cf1-1824-4846-9fc5-91ac640ac3e6 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:43.939454 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bcdf0cf1-1824-4846-9fc5-91ac640ac3e6 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:43.939883 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bcdf0cf1-1824-4846-9fc5-91ac640ac3e6 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:43.940561 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bcdf0cf1-1824-4846-9fc5-91ac640ac3e6 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:43.941008 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bcdf0cf1-1824-4846-9fc5-91ac640ac3e6 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:43.941427 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bcdf0cf1-1824-4846-9fc5-91ac640ac3e6 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:44.082070 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bcdf0cf1-1824-4846-9fc5-91ac640ac3e6 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262d5984b8c4775b86fae1c0d314718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc8f8cefbf441c98d6bda76e99e3173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:44.091488 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bcdf0cf1-1824-4846-9fc5-91ac640ac3e6 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946" status: 200 len: 1313 microversion: 2.1 time: 0.162531 Oct 23 01:14:44.092171 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 601/1144] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:43 2022] GET /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:44.097869 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6fe31e8f-c4bf-46c6-b957-877bdef52329 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:44.098604 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6fe31e8f-c4bf-46c6-b957-877bdef52329 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 8025dc46-71af-4fec-8f54-5ae9e92cc31f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:44.104912 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6fe31e8f-c4bf-46c6-b957-877bdef52329 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:44.105470 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6fe31e8f-c4bf-46c6-b957-877bdef52329 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:44.106165 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6fe31e8f-c4bf-46c6-b957-877bdef52329 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:44.107117 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6fe31e8f-c4bf-46c6-b957-877bdef52329 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:44.108553 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6fe31e8f-c4bf-46c6-b957-877bdef52329 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:44.109220 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6fe31e8f-c4bf-46c6-b957-877bdef52329 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:44.384059 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6fe31e8f-c4bf-46c6-b957-877bdef52329 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:44.394985 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6fe31e8f-c4bf-46c6-b957-877bdef52329 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f" status: 200 len: 1378 microversion: 2.1 time: 0.301376 Oct 23 01:14:44.395963 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 602/1145] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:44 2022] GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f => generated 1378 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:44.416116 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-adc9c71c-b3b2-4ebb-8f8e-d5d77d715851 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:44.416848 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-adc9c71c-b3b2-4ebb-8f8e-d5d77d715851 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] [instance: 1cd3fd39-6d38-4c30-9dda-dd9b5530c294] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:44.423216 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-adc9c71c-b3b2-4ebb-8f8e-d5d77d715851 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:44.423813 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-adc9c71c-b3b2-4ebb-8f8e-d5d77d715851 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:44.424403 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-adc9c71c-b3b2-4ebb-8f8e-d5d77d715851 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:44.425191 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-adc9c71c-b3b2-4ebb-8f8e-d5d77d715851 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:44.425711 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-adc9c71c-b3b2-4ebb-8f8e-d5d77d715851 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:44.426256 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-adc9c71c-b3b2-4ebb-8f8e-d5d77d715851 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:44.726811 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-adc9c71c-b3b2-4ebb-8f8e-d5d77d715851 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870da6eeeb684fa380bf48b41f27b984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2182cae228436ba5c9fc59edb00274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:44.734629 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-adc9c71c-b3b2-4ebb-8f8e-d5d77d715851 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] 10.222.0.42 "GET /compute/v2.1/servers/1cd3fd39-6d38-4c30-9dda-dd9b5530c294" status: 200 len: 1509 microversion: 2.1 time: 0.323384 Oct 23 01:14:44.735287 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 603/1146] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:44 2022] GET /compute/v2.1/servers/1cd3fd39-6d38-4c30-9dda-dd9b5530c294 => generated 1509 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:44.746286 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-92372604-0828-44c7-8d37-79a4d73dd9e6 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:44.746286 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-92372604-0828-44c7-8d37-79a4d73dd9e6 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] [instance: e0769a09-da3a-422f-a7a8-27edf4a2e209] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:44.746286 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-92372604-0828-44c7-8d37-79a4d73dd9e6 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:44.746689 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-92372604-0828-44c7-8d37-79a4d73dd9e6 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:44.747126 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-92372604-0828-44c7-8d37-79a4d73dd9e6 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:44.747819 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-92372604-0828-44c7-8d37-79a4d73dd9e6 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:44.748419 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-92372604-0828-44c7-8d37-79a4d73dd9e6 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:44.748842 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-92372604-0828-44c7-8d37-79a4d73dd9e6 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:45.062604 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-92372604-0828-44c7-8d37-79a4d73dd9e6 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80703c3d1dae419c9fd5ca103f3c28bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356a4b3819db457fb5caf68ded0212fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:45.070914 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-92372604-0828-44c7-8d37-79a4d73dd9e6 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] 10.222.0.42 "GET /compute/v2.1/servers/e0769a09-da3a-422f-a7a8-27edf4a2e209" status: 200 len: 1318 microversion: 2.1 time: 0.334629 Oct 23 01:14:45.071486 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 604/1147] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:44 2022] GET /compute/v2.1/servers/e0769a09-da3a-422f-a7a8-27edf4a2e209 => generated 1318 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:45.087140 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1cd968c3-74d6-4cf3-8da5-f324c5cb6c35 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:45.087783 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1cd968c3-74d6-4cf3-8da5-f324c5cb6c35 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: cffc5366-8131-4a2b-bf51-39e4d23929e3] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:45.089714 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:45.094909 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1cd968c3-74d6-4cf3-8da5-f324c5cb6c35 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:45.095346 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1cd968c3-74d6-4cf3-8da5-f324c5cb6c35 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:45.095780 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1cd968c3-74d6-4cf3-8da5-f324c5cb6c35 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:45.096511 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1cd968c3-74d6-4cf3-8da5-f324c5cb6c35 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:45.096979 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1cd968c3-74d6-4cf3-8da5-f324c5cb6c35 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:45.097404 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1cd968c3-74d6-4cf3-8da5-f324c5cb6c35 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:45.307745 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1cd968c3-74d6-4cf3-8da5-f324c5cb6c35 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:45.318817 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1cd968c3-74d6-4cf3-8da5-f324c5cb6c35 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/cffc5366-8131-4a2b-bf51-39e4d23929e3" status: 200 len: 1316 microversion: 2.1 time: 0.246289 Oct 23 01:14:45.319410 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 605/1148] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:45 2022] GET /compute/v2.1/servers/cffc5366-8131-4a2b-bf51-39e4d23929e3 => generated 1316 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:45.324667 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4fc83422-b778-46a7-9513-63aa6434a47a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:45.325435 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4fc83422-b778-46a7-9513-63aa6434a47a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:45.331854 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4fc83422-b778-46a7-9513-63aa6434a47a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:45.332419 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4fc83422-b778-46a7-9513-63aa6434a47a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:45.332860 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4fc83422-b778-46a7-9513-63aa6434a47a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:45.333563 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4fc83422-b778-46a7-9513-63aa6434a47a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:45.334040 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4fc83422-b778-46a7-9513-63aa6434a47a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:45.334475 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4fc83422-b778-46a7-9513-63aa6434a47a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:45.422394 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4fc83422-b778-46a7-9513-63aa6434a47a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:45.445313 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4fc83422-b778-46a7-9513-63aa6434a47a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:45.445313 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4fc83422-b778-46a7-9513-63aa6434a47a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:45.447234 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4fc83422-b778-46a7-9513-63aa6434a47a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1531 microversion: 2.91 time: 0.126250 Oct 23 01:14:45.447808 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 606/1149] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:45 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1531 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:45.452201 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f09b898b-3cec-4eb2-852f-7078f33db212 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:45.452851 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f09b898b-3cec-4eb2-852f-7078f33db212 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 59cf7af1-8bca-4768-ac86-6e56d0649946] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:45.458762 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f09b898b-3cec-4eb2-852f-7078f33db212 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:45.459243 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f09b898b-3cec-4eb2-852f-7078f33db212 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:45.459675 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f09b898b-3cec-4eb2-852f-7078f33db212 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:45.460389 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f09b898b-3cec-4eb2-852f-7078f33db212 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:45.460835 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f09b898b-3cec-4eb2-852f-7078f33db212 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:45.461256 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f09b898b-3cec-4eb2-852f-7078f33db212 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:45.598583 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f09b898b-3cec-4eb2-852f-7078f33db212 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262d5984b8c4775b86fae1c0d314718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc8f8cefbf441c98d6bda76e99e3173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:45.606290 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f09b898b-3cec-4eb2-852f-7078f33db212 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946" status: 200 len: 1334 microversion: 2.1 time: 0.157480 Oct 23 01:14:45.607606 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 607/1150] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:45 2022] GET /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946 => generated 1334 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:45.612357 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6822156e-dd62-4062-8f50-ee69a19967c9 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:45.612967 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6822156e-dd62-4062-8f50-ee69a19967c9 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 8025dc46-71af-4fec-8f54-5ae9e92cc31f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:45.619215 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6822156e-dd62-4062-8f50-ee69a19967c9 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:45.619689 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6822156e-dd62-4062-8f50-ee69a19967c9 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:45.620118 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6822156e-dd62-4062-8f50-ee69a19967c9 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:45.620810 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6822156e-dd62-4062-8f50-ee69a19967c9 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:45.621264 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6822156e-dd62-4062-8f50-ee69a19967c9 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:45.621679 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6822156e-dd62-4062-8f50-ee69a19967c9 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:46.275138 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6822156e-dd62-4062-8f50-ee69a19967c9 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:46.283835 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6822156e-dd62-4062-8f50-ee69a19967c9 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f" status: 200 len: 1378 microversion: 2.1 time: 0.675943 Oct 23 01:14:46.298437 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 608/1151] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:45 2022] GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f => generated 1378 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:46.298437 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fc8580b9-977f-40ae-ba89-e754f8097bf3 tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:46.298437 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-fc8580b9-977f-40ae-ba89-e754f8097bf3 tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:46.298437 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=28 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:46.298437 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc8580b9-977f-40ae-ba89-e754f8097bf3 tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:46.298888 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc8580b9-977f-40ae-ba89-e754f8097bf3 tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:46.299195 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc8580b9-977f-40ae-ba89-e754f8097bf3 tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:46.300596 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc8580b9-977f-40ae-ba89-e754f8097bf3 tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:46.302060 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc8580b9-977f-40ae-ba89-e754f8097bf3 tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:46.302214 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc8580b9-977f-40ae-ba89-e754f8097bf3 tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:46.459534 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-fc8580b9-977f-40ae-ba89-e754f8097bf3 tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] Lazy-loading 'services' on Instance uuid 12bc6f90-1421-4c4f-b651-ee7d941c725b {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:14:46.485246 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fc8580b9-977f-40ae-ba89-e754f8097bf3 tempest-UnshelveToHostMultiNodesTest-1795720254 tempest-UnshelveToHostMultiNodesTest-1795720254-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1936 microversion: 2.91 time: 0.199680 Oct 23 01:14:46.487727 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 609/1152] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:46 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1936 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:46.491240 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6cef09fc-e431-47b6-9aaf-e72a4d25c7aa tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:46.491878 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6cef09fc-e431-47b6-9aaf-e72a4d25c7aa tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] [instance: 1cd3fd39-6d38-4c30-9dda-dd9b5530c294] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:46.497994 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6cef09fc-e431-47b6-9aaf-e72a4d25c7aa tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:46.498495 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6cef09fc-e431-47b6-9aaf-e72a4d25c7aa tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:46.498933 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6cef09fc-e431-47b6-9aaf-e72a4d25c7aa tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:46.499740 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6cef09fc-e431-47b6-9aaf-e72a4d25c7aa tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:46.500193 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6cef09fc-e431-47b6-9aaf-e72a4d25c7aa tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:46.500625 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6cef09fc-e431-47b6-9aaf-e72a4d25c7aa tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:46.664335 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6cef09fc-e431-47b6-9aaf-e72a4d25c7aa tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870da6eeeb684fa380bf48b41f27b984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2182cae228436ba5c9fc59edb00274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:46.667564 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:46.675401 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6cef09fc-e431-47b6-9aaf-e72a4d25c7aa tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] 10.222.0.42 "GET /compute/v2.1/servers/1cd3fd39-6d38-4c30-9dda-dd9b5530c294" status: 200 len: 1467 microversion: 2.1 time: 0.187825 Oct 23 01:14:46.676504 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 610/1153] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:46 2022] GET /compute/v2.1/servers/1cd3fd39-6d38-4c30-9dda-dd9b5530c294 => generated 1467 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:46.681904 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9679e2a3-9926-4735-b848-655dca28502c tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:46.682628 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9679e2a3-9926-4735-b848-655dca28502c tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] [instance: e0769a09-da3a-422f-a7a8-27edf4a2e209] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:46.689057 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9679e2a3-9926-4735-b848-655dca28502c tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:46.689919 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9679e2a3-9926-4735-b848-655dca28502c tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:46.690850 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9679e2a3-9926-4735-b848-655dca28502c tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:46.691740 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9679e2a3-9926-4735-b848-655dca28502c tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:46.692387 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9679e2a3-9926-4735-b848-655dca28502c tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:46.693044 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9679e2a3-9926-4735-b848-655dca28502c tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:47.056769 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9679e2a3-9926-4735-b848-655dca28502c tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80703c3d1dae419c9fd5ca103f3c28bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356a4b3819db457fb5caf68ded0212fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:47.064944 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9679e2a3-9926-4735-b848-655dca28502c tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] 10.222.0.42 "GET /compute/v2.1/servers/e0769a09-da3a-422f-a7a8-27edf4a2e209" status: 200 len: 1318 microversion: 2.1 time: 0.386669 Oct 23 01:14:47.065844 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 611/1154] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:46 2022] GET /compute/v2.1/servers/e0769a09-da3a-422f-a7a8-27edf4a2e209 => generated 1318 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:47.086295 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ee5d2e3c-8c35-41ac-a34e-66ac7e244e63 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:47.088029 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ee5d2e3c-8c35-41ac-a34e-66ac7e244e63 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: cffc5366-8131-4a2b-bf51-39e4d23929e3] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:47.098053 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee5d2e3c-8c35-41ac-a34e-66ac7e244e63 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:47.098666 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee5d2e3c-8c35-41ac-a34e-66ac7e244e63 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:47.099937 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee5d2e3c-8c35-41ac-a34e-66ac7e244e63 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:47.100850 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee5d2e3c-8c35-41ac-a34e-66ac7e244e63 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:47.101629 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee5d2e3c-8c35-41ac-a34e-66ac7e244e63 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:47.102390 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee5d2e3c-8c35-41ac-a34e-66ac7e244e63 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:47.430664 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ee5d2e3c-8c35-41ac-a34e-66ac7e244e63 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:47.438759 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ee5d2e3c-8c35-41ac-a34e-66ac7e244e63 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/cffc5366-8131-4a2b-bf51-39e4d23929e3" status: 200 len: 1316 microversion: 2.1 time: 0.371526 Oct 23 01:14:47.439338 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 612/1155] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:47 2022] GET /compute/v2.1/servers/cffc5366-8131-4a2b-bf51-39e4d23929e3 => generated 1316 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:47.454362 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-025f5982-3fc1-4133-8ec6-ef84245da859 req-b796ce73-e309-465c-9d75-85f707500928 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cd3fd39-6d38-4c30-9dda-dd9b5530c294", "name": "network-vif-deleted", "tag": "eff753b5-7858-42c9-8fa5-2b5cca32143e"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:14:47.464035 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-025f5982-3fc1-4133-8ec6-ef84245da859 req-b796ce73-e309-465c-9d75-85f707500928 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:47.464519 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-025f5982-3fc1-4133-8ec6-ef84245da859 req-b796ce73-e309-465c-9d75-85f707500928 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:47.464955 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-025f5982-3fc1-4133-8ec6-ef84245da859 req-b796ce73-e309-465c-9d75-85f707500928 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:47.476779 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-025f5982-3fc1-4133-8ec6-ef84245da859 req-b796ce73-e309-465c-9d75-85f707500928 service nova] Creating event network-vif-deleted:eff753b5-7858-42c9-8fa5-2b5cca32143e for instance 1cd3fd39-6d38-4c30-9dda-dd9b5530c294 on n-h1-master-1 Oct 23 01:14:47.481801 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-025f5982-3fc1-4133-8ec6-ef84245da859 req-b796ce73-e309-465c-9d75-85f707500928 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031080 Oct 23 01:14:47.486226 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 613/1156] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:14:47.493190 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b2f078f5-2af1-43e8-9ba8-e051d114af96 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:47.493932 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b2f078f5-2af1-43e8-9ba8-e051d114af96 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:47.500068 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b2f078f5-2af1-43e8-9ba8-e051d114af96 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:47.500560 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b2f078f5-2af1-43e8-9ba8-e051d114af96 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:47.501343 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b2f078f5-2af1-43e8-9ba8-e051d114af96 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:47.501687 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b2f078f5-2af1-43e8-9ba8-e051d114af96 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:47.502171 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b2f078f5-2af1-43e8-9ba8-e051d114af96 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:47.502640 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b2f078f5-2af1-43e8-9ba8-e051d114af96 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:47.532725 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b2f078f5-2af1-43e8-9ba8-e051d114af96 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:14:47.727763 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-87dd78a8-8418-4695-80b7-e9fb9a5553aa tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9/action" status: 202 len: 0 microversion: 2.25 time: 5.841247 Oct 23 01:14:47.727763 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 544/1157] 10.222.0.42 () {62 vars in 1319 bytes} [Sun Oct 23 01:14:41 2022] POST /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9/action => generated 0 bytes in 5843 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 23 01:14:47.734467 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ed09e274-2988-42ca-9994-0905819138df tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:47.735406 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ed09e274-2988-42ca-9994-0905819138df tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 59cf7af1-8bca-4768-ac86-6e56d0649946] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:47.755146 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ed09e274-2988-42ca-9994-0905819138df tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:47.758129 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ed09e274-2988-42ca-9994-0905819138df tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:47.758947 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ed09e274-2988-42ca-9994-0905819138df tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:47.759791 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ed09e274-2988-42ca-9994-0905819138df tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:47.761159 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ed09e274-2988-42ca-9994-0905819138df tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:47.762457 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ed09e274-2988-42ca-9994-0905819138df tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:47.859705 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b2f078f5-2af1-43e8-9ba8-e051d114af96 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "DELETE /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 204 len: 0 microversion: 2.91 time: 0.371859 Oct 23 01:14:47.860477 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 614/1158] 10.222.0.42 () {60 vars in 1280 bytes} [Sun Oct 23 01:14:47 2022] DELETE /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 23 01:14:47.871692 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1b9bc5c4-294b-43b9-bc28-806704cd5fb9 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:47.873009 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1b9bc5c4-294b-43b9-bc28-806704cd5fb9 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 8025dc46-71af-4fec-8f54-5ae9e92cc31f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:47.879730 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b9bc5c4-294b-43b9-bc28-806704cd5fb9 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:47.880312 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b9bc5c4-294b-43b9-bc28-806704cd5fb9 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:47.880834 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b9bc5c4-294b-43b9-bc28-806704cd5fb9 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:47.881962 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b9bc5c4-294b-43b9-bc28-806704cd5fb9 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:47.883050 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b9bc5c4-294b-43b9-bc28-806704cd5fb9 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:47.883528 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b9bc5c4-294b-43b9-bc28-806704cd5fb9 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:48.108284 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ed09e274-2988-42ca-9994-0905819138df tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262d5984b8c4775b86fae1c0d314718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc8f8cefbf441c98d6bda76e99e3173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:48.118037 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ed09e274-2988-42ca-9994-0905819138df tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946" status: 200 len: 1334 microversion: 2.1 time: 0.388551 Oct 23 01:14:48.127582 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 545/1159] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:47 2022] GET /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946 => generated 1334 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:48.127582 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3acbc816-1cb6-49c2-be3c-65f4877899c4 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:48.127582 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3acbc816-1cb6-49c2-be3c-65f4877899c4 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] [instance: 1cd3fd39-6d38-4c30-9dda-dd9b5530c294] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:48.132004 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3acbc816-1cb6-49c2-be3c-65f4877899c4 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:48.133301 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3acbc816-1cb6-49c2-be3c-65f4877899c4 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:48.134040 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3acbc816-1cb6-49c2-be3c-65f4877899c4 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:48.135077 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3acbc816-1cb6-49c2-be3c-65f4877899c4 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:48.135558 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3acbc816-1cb6-49c2-be3c-65f4877899c4 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:48.136087 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3acbc816-1cb6-49c2-be3c-65f4877899c4 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:48.152606 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-3acbc816-1cb6-49c2-be3c-65f4877899c4 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] HTTP exception thrown: Instance 1cd3fd39-6d38-4c30-9dda-dd9b5530c294 could not be found. Oct 23 01:14:48.155892 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3acbc816-1cb6-49c2-be3c-65f4877899c4 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Request method failure captured: Oct 23 01:14:48.155892 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/1cd3fd39-6d38-4c30-9dda-dd9b5530c294 HTTP/1.1 Oct 23 01:14:48.155892 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:14:48.155892 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:14:48.155892 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:14:48.155892 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:14:48.155892 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:14:48.155892 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:14:48.155892 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:14:48.155892 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:14:48.155892 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJVrJWolWP7j4DVRnvJX0oHF89Qz7M1tlAflEer_wljogOtfRzyLYTE1rxn6Mi9E25VaGN3QdlElHcwT6fQ1-0cBQz4G1eTRIwO0cNI0bsg3i39h_AIS6sYqH1n64pue9Yo_zCWgPDYNbEoirmYrwkxQ3HbYfmawoDiRAF2hVoX2kRM Oct 23 01:14:48.155892 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:14:48.155892 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:14:48.155892 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:14:48.155892 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:14:48.155892 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:14:48.155892 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:14:48.155892 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 0d2182cae228436ba5c9fc59edb00274 Oct 23 01:14:48.155892 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ImagesNegativeTestJSON-1482646335 Oct 23 01:14:48.155892 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:14:48.155892 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:14:48.157398 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/0d2182cae228436ba5c9fc59edb00274"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_0d2182cae228436ba5c9fc59edb00274"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0d2182cae228436ba5c9fc59edb00274"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0d2182cae228436ba5c9fc59edb00274"}]}] Oct 23 01:14:48.157398 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ImagesNegativeTestJSON-1482646335 Oct 23 01:14:48.157398 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 0d2182cae228436ba5c9fc59edb00274 Oct 23 01:14:48.157398 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1482646335 Oct 23 01:14:48.157398 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ImagesNegativeTestJSON-1482646335-project Oct 23 01:14:48.157398 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:14:48.157398 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:14:48.157398 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 870da6eeeb684fa380bf48b41f27b984 Oct 23 01:14:48.157398 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ImagesNegativeTestJSON-1482646335-project Oct 23 01:14:48.157398 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:14:48.157398 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 1cd3fd39-6d38-4c30-9dda-dd9b5530c294 could not be found. Oct 23 01:14:48.157398 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '1cd3fd39-6d38-4c30-9dda-dd9b5530c294'} Oct 23 01:14:48.158255 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:14:48.158255 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:48.158255 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:14:48.158255 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:14:48.158255 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:14:48.158255 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:14:48.158255 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:14:48.158255 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:14:48.158255 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:14:48.158255 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:14:48.158255 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cd3fd39-6d38-4c30-9dda-dd9b5530c294 could not be found. Oct 23 01:14:48.158255 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:14:48.158255 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:14:48.158255 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:14:48.158255 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:48.158255 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:14:48.158255 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:14:48.158255 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:14:48.158255 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:14:48.158255 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:14:48.161156 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:14:48.161156 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:14:48.161156 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:14:48.161156 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:14:48.161156 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:14:48.161156 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:14:48.161156 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:14:48.161156 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cd3fd39-6d38-4c30-9dda-dd9b5530c294 could not be found. Oct 23 01:14:48.161156 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:14:48.161156 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:14:48.161156 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:14:48.161156 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:48.161156 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:14:48.161156 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:14:48.161156 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:14:48.161156 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:14:48.161156 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cd3fd39-6d38-4c30-9dda-dd9b5530c294 could not be found. Oct 23 01:14:48.161156 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:14:48.162822 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3acbc816-1cb6-49c2-be3c-65f4877899c4 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Returning 404 to user: Instance 1cd3fd39-6d38-4c30-9dda-dd9b5530c294 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:14:48.162822 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3acbc816-1cb6-49c2-be3c-65f4877899c4 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] 10.222.0.42 "GET /compute/v2.1/servers/1cd3fd39-6d38-4c30-9dda-dd9b5530c294" status: 404 len: 111 microversion: 2.1 time: 0.035914 Oct 23 01:14:48.162822 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 546/1160] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:48 2022] GET /compute/v2.1/servers/1cd3fd39-6d38-4c30-9dda-dd9b5530c294 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:14:48.162822 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-b61216e9-4a15-42e9-8ba5-91a4a8698010 req-2e0cdad8-6f0c-4014-adac-9db2e9a10f01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59cf7af1-8bca-4768-ac86-6e56d0649946", "tag": "0012d07c-1c5a-452e-8f4f-f3931c55a841"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:14:48.171357 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-b61216e9-4a15-42e9-8ba5-91a4a8698010 req-2e0cdad8-6f0c-4014-adac-9db2e9a10f01 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:48.171735 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-b61216e9-4a15-42e9-8ba5-91a4a8698010 req-2e0cdad8-6f0c-4014-adac-9db2e9a10f01 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:48.172179 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-b61216e9-4a15-42e9-8ba5-91a4a8698010 req-2e0cdad8-6f0c-4014-adac-9db2e9a10f01 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:48.181348 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:48.183937 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-b61216e9-4a15-42e9-8ba5-91a4a8698010 req-2e0cdad8-6f0c-4014-adac-9db2e9a10f01 service nova] Creating event network-changed:0012d07c-1c5a-452e-8f4f-f3931c55a841 for instance 59cf7af1-8bca-4768-ac86-6e56d0649946 on n-h1-master-1 Oct 23 01:14:48.188714 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-b61216e9-4a15-42e9-8ba5-91a4a8698010 req-2e0cdad8-6f0c-4014-adac-9db2e9a10f01 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031178 Oct 23 01:14:48.189314 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 547/1161] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:14:48.194516 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fd866e95-8d2b-4ef0-a038-511e4e1ed286 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:48.195737 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fd866e95-8d2b-4ef0-a038-511e4e1ed286 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 8db307a5-7a1e-4791-8fa9-e934894238e9] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:48.197703 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:48.202752 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fd866e95-8d2b-4ef0-a038-511e4e1ed286 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:48.203323 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fd866e95-8d2b-4ef0-a038-511e4e1ed286 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:48.203771 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fd866e95-8d2b-4ef0-a038-511e4e1ed286 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:48.204466 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fd866e95-8d2b-4ef0-a038-511e4e1ed286 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:48.205131 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fd866e95-8d2b-4ef0-a038-511e4e1ed286 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:48.205742 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fd866e95-8d2b-4ef0-a038-511e4e1ed286 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:48.283632 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1b9bc5c4-294b-43b9-bc28-806704cd5fb9 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:48.293542 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1b9bc5c4-294b-43b9-bc28-806704cd5fb9 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f" status: 200 len: 1378 microversion: 2.1 time: 0.429778 Oct 23 01:14:48.294750 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 615/1162] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:47 2022] GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f => generated 1378 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:48.302804 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-244778e1-96f6-4eec-af98-cdfe222d134a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:48.303540 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-244778e1-96f6-4eec-af98-cdfe222d134a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:48.315375 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-244778e1-96f6-4eec-af98-cdfe222d134a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:48.315901 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-244778e1-96f6-4eec-af98-cdfe222d134a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:48.316374 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-244778e1-96f6-4eec-af98-cdfe222d134a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:48.317098 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-244778e1-96f6-4eec-af98-cdfe222d134a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:48.317705 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-244778e1-96f6-4eec-af98-cdfe222d134a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:48.318164 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-244778e1-96f6-4eec-af98-cdfe222d134a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:48.456861 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-244778e1-96f6-4eec-af98-cdfe222d134a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:48.469789 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-244778e1-96f6-4eec-af98-cdfe222d134a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:48.471293 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-244778e1-96f6-4eec-af98-cdfe222d134a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:48.477490 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-244778e1-96f6-4eec-af98-cdfe222d134a tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1537 microversion: 2.91 time: 0.181197 Oct 23 01:14:48.478823 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 616/1163] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:48 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1537 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:48.484303 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5386a7c1-c925-46d2-8504-9347488a252f tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:48.485153 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5386a7c1-c925-46d2-8504-9347488a252f tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] [instance: e0769a09-da3a-422f-a7a8-27edf4a2e209] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:48.492831 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5386a7c1-c925-46d2-8504-9347488a252f tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:48.493624 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5386a7c1-c925-46d2-8504-9347488a252f tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:48.494238 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5386a7c1-c925-46d2-8504-9347488a252f tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:48.495086 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5386a7c1-c925-46d2-8504-9347488a252f tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:48.495719 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5386a7c1-c925-46d2-8504-9347488a252f tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:48.497056 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5386a7c1-c925-46d2-8504-9347488a252f tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:48.596400 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fd866e95-8d2b-4ef0-a038-511e4e1ed286 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:48.605259 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fd866e95-8d2b-4ef0-a038-511e4e1ed286 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:48.606839 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fd866e95-8d2b-4ef0-a038-511e4e1ed286 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:48.608272 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fd866e95-8d2b-4ef0-a038-511e4e1ed286 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9" status: 200 len: 1568 microversion: 2.25 time: 0.417777 Oct 23 01:14:48.609068 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 548/1164] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:48 2022] GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9 => generated 1568 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:48.620345 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-ab2a366a-a976-435c-bb84-2449d243e4ee req-1afc5e94-d03f-4c05-9e49-20f23102b234 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8025dc46-71af-4fec-8f54-5ae9e92cc31f", "name": "network-vif-plugged", "status": "completed", "tag": "9dbeafb3-f8f6-45eb-993c-c817b00700d0"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:14:48.630501 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-ab2a366a-a976-435c-bb84-2449d243e4ee req-1afc5e94-d03f-4c05-9e49-20f23102b234 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:48.631009 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-ab2a366a-a976-435c-bb84-2449d243e4ee req-1afc5e94-d03f-4c05-9e49-20f23102b234 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:48.631511 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-ab2a366a-a976-435c-bb84-2449d243e4ee req-1afc5e94-d03f-4c05-9e49-20f23102b234 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:48.646128 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-ab2a366a-a976-435c-bb84-2449d243e4ee req-1afc5e94-d03f-4c05-9e49-20f23102b234 service nova] Creating event network-vif-plugged:9dbeafb3-f8f6-45eb-993c-c817b00700d0 for instance 8025dc46-71af-4fec-8f54-5ae9e92cc31f on n-h2-master-1 Oct 23 01:14:48.651378 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-ab2a366a-a976-435c-bb84-2449d243e4ee req-1afc5e94-d03f-4c05-9e49-20f23102b234 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034940 Oct 23 01:14:48.651920 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 549/1165] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:14:48.657358 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-eb9ef515-0456-4eb0-9ee2-b192578406ce tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-308894275", "metadata": {"image_type": "test"}}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:14:48.659912 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-eb9ef515-0456-4eb0-9ee2-b192578406ce tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] [instance: 1cd3fd39-6d38-4c30-9dda-dd9b5530c294] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:48.666720 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb9ef515-0456-4eb0-9ee2-b192578406ce tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:48.667303 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb9ef515-0456-4eb0-9ee2-b192578406ce tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:48.667809 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb9ef515-0456-4eb0-9ee2-b192578406ce tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:48.668573 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb9ef515-0456-4eb0-9ee2-b192578406ce tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:48.669102 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb9ef515-0456-4eb0-9ee2-b192578406ce tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:48.669596 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb9ef515-0456-4eb0-9ee2-b192578406ce tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:48.685149 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-eb9ef515-0456-4eb0-9ee2-b192578406ce tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] HTTP exception thrown: Instance 1cd3fd39-6d38-4c30-9dda-dd9b5530c294 could not be found. Oct 23 01:14:48.687294 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-eb9ef515-0456-4eb0-9ee2-b192578406ce tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Request method failure captured: Oct 23 01:14:48.687294 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/servers/1cd3fd39-6d38-4c30-9dda-dd9b5530c294/action HTTP/1.1 Oct 23 01:14:48.687294 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:14:48.687294 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:14:48.687294 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:14:48.687294 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 111 Oct 23 01:14:48.687294 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:14:48.687294 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:14:48.687294 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:14:48.687294 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:14:48.687294 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJVrJWolWP7j4DVRnvJX0oHF89Qz7M1tlAflEer_wljogOtfRzyLYTE1rxn6Mi9E25VaGN3QdlElHcwT6fQ1-0cBQz4G1eTRIwO0cNI0bsg3i39h_AIS6sYqH1n64pue9Yo_zCWgPDYNbEoirmYrwkxQ3HbYfmawoDiRAF2hVoX2kRM Oct 23 01:14:48.687294 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:14:48.687294 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:14:48.687294 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:14:48.687294 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:14:48.687294 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:14:48.687294 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:14:48.687294 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 0d2182cae228436ba5c9fc59edb00274 Oct 23 01:14:48.687294 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ImagesNegativeTestJSON-1482646335 Oct 23 01:14:48.687294 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:14:48.687294 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:14:48.688656 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/0d2182cae228436ba5c9fc59edb00274"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_0d2182cae228436ba5c9fc59edb00274"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0d2182cae228436ba5c9fc59edb00274"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0d2182cae228436ba5c9fc59edb00274"}]}] Oct 23 01:14:48.688656 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ImagesNegativeTestJSON-1482646335 Oct 23 01:14:48.688656 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 0d2182cae228436ba5c9fc59edb00274 Oct 23 01:14:48.688656 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1482646335 Oct 23 01:14:48.688656 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ImagesNegativeTestJSON-1482646335-project Oct 23 01:14:48.688656 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:14:48.688656 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:14:48.688656 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 870da6eeeb684fa380bf48b41f27b984 Oct 23 01:14:48.688656 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ImagesNegativeTestJSON-1482646335-project Oct 23 01:14:48.688656 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:14:48.688656 n-d-master-1 devstack@n-api.service[120944]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-308894275", "metadata": {"image_type": "test"}}} Oct 23 01:14:48.688656 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:14:48.689968 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 1cd3fd39-6d38-4c30-9dda-dd9b5530c294 could not be found. Oct 23 01:14:48.689968 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '1cd3fd39-6d38-4c30-9dda-dd9b5530c294', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-308894275', 'metadata': {'image_type': 'test'}}}} Oct 23 01:14:48.689968 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:14:48.689968 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:48.689968 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:14:48.689968 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:14:48.689968 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:14:48.689968 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:14:48.689968 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:14:48.689968 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:14:48.689968 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:14:48.689968 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:14:48.689968 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cd3fd39-6d38-4c30-9dda-dd9b5530c294 could not be found. Oct 23 01:14:48.689968 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:14:48.689968 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:14:48.689968 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:14:48.689968 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:48.689968 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:14:48.689968 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:14:48.691249 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:14:48.691249 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:14:48.691249 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:14:48.691249 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:14:48.691249 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:14:48.691249 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:14:48.691249 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:14:48.691249 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:14:48.691249 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 23 01:14:48.691249 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 23 01:14:48.691249 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:14:48.691249 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:14:48.691249 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:14:48.691249 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:14:48.691249 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cd3fd39-6d38-4c30-9dda-dd9b5530c294 could not be found. Oct 23 01:14:48.691249 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:14:48.691249 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:14:48.691249 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:14:48.691249 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:48.691249 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:14:48.692630 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:14:48.692630 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:14:48.692630 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:14:48.692630 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cd3fd39-6d38-4c30-9dda-dd9b5530c294 could not be found. Oct 23 01:14:48.692630 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:14:48.692630 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-eb9ef515-0456-4eb0-9ee2-b192578406ce tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Returning 404 to user: Instance 1cd3fd39-6d38-4c30-9dda-dd9b5530c294 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:14:48.692630 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-eb9ef515-0456-4eb0-9ee2-b192578406ce tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] 10.222.0.42 "POST /compute/v2.1/servers/1cd3fd39-6d38-4c30-9dda-dd9b5530c294/action" status: 404 len: 111 microversion: 2.1 time: 0.035108 Oct 23 01:14:48.692630 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 550/1166] 10.222.0.42 () {60 vars in 1279 bytes} [Sun Oct 23 01:14:48 2022] POST /compute/v2.1/servers/1cd3fd39-6d38-4c30-9dda-dd9b5530c294/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:14:48.693654 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-db250e0e-863f-48ab-a033-7ab72bd3db59 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:48.694601 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-db250e0e-863f-48ab-a033-7ab72bd3db59 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: cffc5366-8131-4a2b-bf51-39e4d23929e3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:48.702799 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-db250e0e-863f-48ab-a033-7ab72bd3db59 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:48.704055 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-db250e0e-863f-48ab-a033-7ab72bd3db59 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:48.704055 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-db250e0e-863f-48ab-a033-7ab72bd3db59 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:48.704457 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-db250e0e-863f-48ab-a033-7ab72bd3db59 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:48.705080 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-db250e0e-863f-48ab-a033-7ab72bd3db59 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:48.705513 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-db250e0e-863f-48ab-a033-7ab72bd3db59 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:48.731257 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5386a7c1-c925-46d2-8504-9347488a252f tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80703c3d1dae419c9fd5ca103f3c28bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356a4b3819db457fb5caf68ded0212fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:48.742359 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5386a7c1-c925-46d2-8504-9347488a252f tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] 10.222.0.42 "GET /compute/v2.1/servers/e0769a09-da3a-422f-a7a8-27edf4a2e209" status: 200 len: 1318 microversion: 2.1 time: 0.261536 Oct 23 01:14:48.743064 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 617/1167] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:48 2022] GET /compute/v2.1/servers/e0769a09-da3a-422f-a7a8-27edf4a2e209 => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:48.749257 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ecbc8b44-08c2-481a-8821-4c1ffcc816b7 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1477708657", "metadata": {"image_type": "test"}}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:14:48.752703 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ecbc8b44-08c2-481a-8821-4c1ffcc816b7 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Failed to fetch instance by id tempest-invalid-609537611 {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 23 01:14:48.752703 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-ecbc8b44-08c2-481a-8821-4c1ffcc816b7 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] HTTP exception thrown: Instance tempest-invalid-609537611 could not be found. Oct 23 01:14:48.754298 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ecbc8b44-08c2-481a-8821-4c1ffcc816b7 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Request method failure captured: Oct 23 01:14:48.754298 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/servers/tempest-invalid-609537611/action HTTP/1.1 Oct 23 01:14:48.754298 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:14:48.754298 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:14:48.754298 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:14:48.754298 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 112 Oct 23 01:14:48.754298 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:14:48.754298 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:14:48.754298 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:14:48.754298 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:14:48.754298 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJVrJWolWP7j4DVRnvJX0oHF89Qz7M1tlAflEer_wljogOtfRzyLYTE1rxn6Mi9E25VaGN3QdlElHcwT6fQ1-0cBQz4G1eTRIwO0cNI0bsg3i39h_AIS6sYqH1n64pue9Yo_zCWgPDYNbEoirmYrwkxQ3HbYfmawoDiRAF2hVoX2kRM Oct 23 01:14:48.754298 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:14:48.754298 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:14:48.754298 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:14:48.754298 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:14:48.754298 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:14:48.754298 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:14:48.754298 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 0d2182cae228436ba5c9fc59edb00274 Oct 23 01:14:48.754298 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ImagesNegativeTestJSON-1482646335 Oct 23 01:14:48.754298 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:14:48.754298 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:14:48.755669 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/0d2182cae228436ba5c9fc59edb00274"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_0d2182cae228436ba5c9fc59edb00274"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0d2182cae228436ba5c9fc59edb00274"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0d2182cae228436ba5c9fc59edb00274"}]}] Oct 23 01:14:48.755669 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ImagesNegativeTestJSON-1482646335 Oct 23 01:14:48.755669 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 0d2182cae228436ba5c9fc59edb00274 Oct 23 01:14:48.755669 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1482646335 Oct 23 01:14:48.755669 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ImagesNegativeTestJSON-1482646335-project Oct 23 01:14:48.755669 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:14:48.755669 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:14:48.755669 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 870da6eeeb684fa380bf48b41f27b984 Oct 23 01:14:48.755669 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ImagesNegativeTestJSON-1482646335-project Oct 23 01:14:48.755669 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:14:48.755669 n-d-master-1 devstack@n-api.service[120945]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1477708657", "metadata": {"image_type": "test"}}} Oct 23 01:14:48.755669 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:14:48.756435 n-d-master-1 devstack@n-api.service[120945]: exception: Instance tempest-invalid-609537611 could not be found. Oct 23 01:14:48.756435 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'tempest-invalid-609537611', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1477708657', 'metadata': {'image_type': 'test'}}}} Oct 23 01:14:48.756435 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:14:48.756435 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:48.756435 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:14:48.756435 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:14:48.756435 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 23 01:14:48.756435 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 23 01:14:48.756435 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-609537611 could not be found. Oct 23 01:14:48.756435 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:14:48.756435 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:14:48.756435 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:14:48.756435 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:48.756435 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:14:48.756435 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:14:48.756435 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:14:48.756435 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:14:48.756435 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:14:48.756435 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:14:48.756435 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:14:48.757814 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:14:48.757814 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:14:48.757814 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:14:48.757814 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 23 01:14:48.757814 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 23 01:14:48.757814 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:14:48.757814 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:14:48.757814 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:14:48.757814 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:14:48.757814 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-609537611 could not be found. Oct 23 01:14:48.757814 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:14:48.757814 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:14:48.757814 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:14:48.757814 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:48.757814 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:14:48.757814 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:14:48.757814 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:14:48.757814 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:14:48.757814 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-609537611 could not be found. Oct 23 01:14:48.757814 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:14:48.759122 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ecbc8b44-08c2-481a-8821-4c1ffcc816b7 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Returning 404 to user: Instance tempest-invalid-609537611 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:14:48.759122 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ecbc8b44-08c2-481a-8821-4c1ffcc816b7 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] 10.222.0.42 "POST /compute/v2.1/servers/tempest-invalid-609537611/action" status: 404 len: 100 microversion: 2.1 time: 0.011610 Oct 23 01:14:48.759122 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 618/1168] 10.222.0.42 () {60 vars in 1246 bytes} [Sun Oct 23 01:14:48 2022] POST /compute/v2.1/servers/tempest-invalid-609537611/action => generated 100 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:14:48.766545 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5b754a51-10c9-427b-8810-d1a20419bb9f tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1143436675"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:14:48.770247 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5b754a51-10c9-427b-8810-d1a20419bb9f tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 23 01:14:48.770834 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-5b754a51-10c9-427b-8810-d1a20419bb9f tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 23 01:14:48.772460 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5b754a51-10c9-427b-8810-d1a20419bb9f tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Request method failure captured: Oct 23 01:14:48.772460 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 23 01:14:48.772460 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:14:48.772460 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:14:48.772460 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:14:48.772460 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 57 Oct 23 01:14:48.772460 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:14:48.772460 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:14:48.772460 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:14:48.772460 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:14:48.772460 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJVrJWolWP7j4DVRnvJX0oHF89Qz7M1tlAflEer_wljogOtfRzyLYTE1rxn6Mi9E25VaGN3QdlElHcwT6fQ1-0cBQz4G1eTRIwO0cNI0bsg3i39h_AIS6sYqH1n64pue9Yo_zCWgPDYNbEoirmYrwkxQ3HbYfmawoDiRAF2hVoX2kRM Oct 23 01:14:48.772460 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:14:48.772460 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:14:48.772460 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:14:48.772460 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:14:48.772460 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:14:48.772460 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:14:48.772460 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 0d2182cae228436ba5c9fc59edb00274 Oct 23 01:14:48.772460 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ImagesNegativeTestJSON-1482646335 Oct 23 01:14:48.772460 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:14:48.772460 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:14:48.774162 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/0d2182cae228436ba5c9fc59edb00274"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_0d2182cae228436ba5c9fc59edb00274"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0d2182cae228436ba5c9fc59edb00274"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0d2182cae228436ba5c9fc59edb00274"}]}] Oct 23 01:14:48.774162 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ImagesNegativeTestJSON-1482646335 Oct 23 01:14:48.774162 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 0d2182cae228436ba5c9fc59edb00274 Oct 23 01:14:48.774162 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1482646335 Oct 23 01:14:48.774162 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ImagesNegativeTestJSON-1482646335-project Oct 23 01:14:48.774162 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:14:48.774162 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:14:48.774162 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 870da6eeeb684fa380bf48b41f27b984 Oct 23 01:14:48.774162 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ImagesNegativeTestJSON-1482646335-project Oct 23 01:14:48.774162 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:14:48.774162 n-d-master-1 devstack@n-api.service[120945]: {"createImage": {"name": "tempest-test-snap-1143436675"}} Oct 23 01:14:48.774162 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:14:48.774162 n-d-master-1 devstack@n-api.service[120945]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 23 01:14:48.775121 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1143436675'}}} Oct 23 01:14:48.775121 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:14:48.775121 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:48.775121 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:14:48.775121 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:14:48.775121 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 23 01:14:48.775121 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 23 01:14:48.775121 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 23 01:14:48.775121 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:14:48.775121 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:14:48.775121 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:14:48.775121 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:48.775121 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:14:48.775121 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:14:48.775121 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:14:48.775121 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:14:48.775121 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:14:48.775121 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:14:48.775121 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:14:48.775121 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:14:48.777249 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:14:48.777249 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:14:48.777249 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 23 01:14:48.777249 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 23 01:14:48.777249 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:14:48.777249 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:14:48.777249 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:14:48.777249 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:14:48.777249 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 23 01:14:48.777249 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:14:48.777249 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:14:48.777249 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:14:48.777249 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:48.777249 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:14:48.777249 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:14:48.777249 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:14:48.777249 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:14:48.777249 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 23 01:14:48.777249 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:14:48.778727 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5b754a51-10c9-427b-8810-d1a20419bb9f tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:14:48.778727 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5b754a51-10c9-427b-8810-d1a20419bb9f tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] 10.222.0.42 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.011897 Oct 23 01:14:48.778727 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 619/1169] 10.222.0.42 () {60 vars in 1275 bytes} [Sun Oct 23 01:14:48 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 01:14:48.787708 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8d249bef-faec-40c0-9374-710cf6b6e017 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1708410897"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:14:48.790983 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8d249bef-faec-40c0-9374-710cf6b6e017 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 23 01:14:48.791492 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-8d249bef-faec-40c0-9374-710cf6b6e017 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 23 01:14:48.793015 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8d249bef-faec-40c0-9374-710cf6b6e017 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Request method failure captured: Oct 23 01:14:48.793015 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 23 01:14:48.793015 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:14:48.793015 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:14:48.793015 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:14:48.793015 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 57 Oct 23 01:14:48.793015 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:14:48.793015 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:14:48.793015 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:14:48.793015 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:14:48.793015 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJVrJWolWP7j4DVRnvJX0oHF89Qz7M1tlAflEer_wljogOtfRzyLYTE1rxn6Mi9E25VaGN3QdlElHcwT6fQ1-0cBQz4G1eTRIwO0cNI0bsg3i39h_AIS6sYqH1n64pue9Yo_zCWgPDYNbEoirmYrwkxQ3HbYfmawoDiRAF2hVoX2kRM Oct 23 01:14:48.793015 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:14:48.793015 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:14:48.793015 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:14:48.793015 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:14:48.793015 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:14:48.793015 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:14:48.793015 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 0d2182cae228436ba5c9fc59edb00274 Oct 23 01:14:48.793015 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ImagesNegativeTestJSON-1482646335 Oct 23 01:14:48.793015 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:14:48.793015 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:14:48.794623 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/0d2182cae228436ba5c9fc59edb00274"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_0d2182cae228436ba5c9fc59edb00274"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0d2182cae228436ba5c9fc59edb00274"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0d2182cae228436ba5c9fc59edb00274"}]}] Oct 23 01:14:48.794623 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ImagesNegativeTestJSON-1482646335 Oct 23 01:14:48.794623 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 0d2182cae228436ba5c9fc59edb00274 Oct 23 01:14:48.794623 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1482646335 Oct 23 01:14:48.794623 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ImagesNegativeTestJSON-1482646335-project Oct 23 01:14:48.794623 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:14:48.794623 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:14:48.794623 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 870da6eeeb684fa380bf48b41f27b984 Oct 23 01:14:48.794623 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ImagesNegativeTestJSON-1482646335-project Oct 23 01:14:48.794623 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:14:48.794623 n-d-master-1 devstack@n-api.service[120945]: {"createImage": {"name": "tempest-test-snap-1708410897"}} Oct 23 01:14:48.794623 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:14:48.794623 n-d-master-1 devstack@n-api.service[120945]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 23 01:14:48.795835 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1708410897'}}} Oct 23 01:14:48.795835 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:14:48.795835 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:48.795835 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:14:48.795835 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:14:48.795835 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 23 01:14:48.795835 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 23 01:14:48.795835 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 23 01:14:48.795835 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:14:48.795835 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:14:48.795835 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:14:48.795835 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:48.795835 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:14:48.795835 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:14:48.795835 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:14:48.795835 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:14:48.795835 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:14:48.795835 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:14:48.795835 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:14:48.795835 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:14:48.797774 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:14:48.797774 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:14:48.797774 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 23 01:14:48.797774 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 23 01:14:48.797774 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:14:48.797774 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:14:48.797774 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:14:48.797774 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:14:48.797774 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 23 01:14:48.797774 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:14:48.797774 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:14:48.797774 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:14:48.797774 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:48.797774 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:14:48.797774 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:14:48.797774 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:14:48.797774 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:14:48.797774 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 23 01:14:48.797774 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:14:48.799134 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8d249bef-faec-40c0-9374-710cf6b6e017 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:14:48.799134 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8d249bef-faec-40c0-9374-710cf6b6e017 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] 10.222.0.42 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.010924 Oct 23 01:14:48.799134 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 620/1170] 10.222.0.42 () {60 vars in 1281 bytes} [Sun Oct 23 01:14:48 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 01:14:48.804729 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7e76ce7a-daba-4dd3-b195-f3b6b100988a tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:48.805292 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7e76ce7a-daba-4dd3-b195-f3b6b100988a tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] [instance: 1cd3fd39-6d38-4c30-9dda-dd9b5530c294] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:48.811537 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7e76ce7a-daba-4dd3-b195-f3b6b100988a tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:48.812090 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7e76ce7a-daba-4dd3-b195-f3b6b100988a tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:48.812565 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7e76ce7a-daba-4dd3-b195-f3b6b100988a tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:48.815717 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7e76ce7a-daba-4dd3-b195-f3b6b100988a tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:48.815717 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7e76ce7a-daba-4dd3-b195-f3b6b100988a tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:48.815717 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7e76ce7a-daba-4dd3-b195-f3b6b100988a tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:48.828370 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-7e76ce7a-daba-4dd3-b195-f3b6b100988a tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] HTTP exception thrown: Instance 1cd3fd39-6d38-4c30-9dda-dd9b5530c294 could not be found. Oct 23 01:14:48.830204 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7e76ce7a-daba-4dd3-b195-f3b6b100988a tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Request method failure captured: Oct 23 01:14:48.830204 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/servers/1cd3fd39-6d38-4c30-9dda-dd9b5530c294 HTTP/1.1 Oct 23 01:14:48.830204 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:14:48.830204 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:14:48.830204 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:14:48.830204 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:14:48.830204 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:14:48.830204 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:14:48.830204 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:14:48.830204 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:14:48.830204 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJVrJWolWP7j4DVRnvJX0oHF89Qz7M1tlAflEer_wljogOtfRzyLYTE1rxn6Mi9E25VaGN3QdlElHcwT6fQ1-0cBQz4G1eTRIwO0cNI0bsg3i39h_AIS6sYqH1n64pue9Yo_zCWgPDYNbEoirmYrwkxQ3HbYfmawoDiRAF2hVoX2kRM Oct 23 01:14:48.830204 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:14:48.830204 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:14:48.830204 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:14:48.830204 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:14:48.830204 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:14:48.830204 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:14:48.830204 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 0d2182cae228436ba5c9fc59edb00274 Oct 23 01:14:48.830204 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ImagesNegativeTestJSON-1482646335 Oct 23 01:14:48.830204 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:14:48.830204 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:14:48.831735 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/0d2182cae228436ba5c9fc59edb00274"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_0d2182cae228436ba5c9fc59edb00274"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0d2182cae228436ba5c9fc59edb00274"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0d2182cae228436ba5c9fc59edb00274"}]}] Oct 23 01:14:48.831735 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ImagesNegativeTestJSON-1482646335 Oct 23 01:14:48.831735 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 0d2182cae228436ba5c9fc59edb00274 Oct 23 01:14:48.831735 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1482646335 Oct 23 01:14:48.831735 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ImagesNegativeTestJSON-1482646335-project Oct 23 01:14:48.831735 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:14:48.831735 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:14:48.831735 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 870da6eeeb684fa380bf48b41f27b984 Oct 23 01:14:48.831735 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ImagesNegativeTestJSON-1482646335-project Oct 23 01:14:48.831735 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:14:48.831735 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 1cd3fd39-6d38-4c30-9dda-dd9b5530c294 could not be found. Oct 23 01:14:48.831735 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '1cd3fd39-6d38-4c30-9dda-dd9b5530c294'} Oct 23 01:14:48.832670 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:14:48.832670 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:48.832670 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:14:48.832670 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:14:48.832670 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:14:48.832670 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:14:48.832670 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:14:48.832670 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:14:48.832670 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:14:48.832670 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:14:48.832670 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cd3fd39-6d38-4c30-9dda-dd9b5530c294 could not be found. Oct 23 01:14:48.832670 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:14:48.832670 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:14:48.832670 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:14:48.832670 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:48.832670 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:14:48.832670 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:14:48.832670 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:14:48.832670 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:14:48.832670 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:14:48.834145 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:14:48.834145 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:14:48.834145 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:14:48.834145 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:14:48.834145 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:14:48.834145 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:14:48.834145 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:14:48.834145 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:14:48.834145 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:14:48.834145 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cd3fd39-6d38-4c30-9dda-dd9b5530c294 could not be found. Oct 23 01:14:48.834145 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:14:48.834145 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:14:48.834145 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:14:48.834145 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:48.834145 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:14:48.834145 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:14:48.834145 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:14:48.834145 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:14:48.834145 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cd3fd39-6d38-4c30-9dda-dd9b5530c294 could not be found. Oct 23 01:14:48.834145 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:14:48.835646 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7e76ce7a-daba-4dd3-b195-f3b6b100988a tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Returning 404 to user: Instance 1cd3fd39-6d38-4c30-9dda-dd9b5530c294 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:14:48.835646 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7e76ce7a-daba-4dd3-b195-f3b6b100988a tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1cd3fd39-6d38-4c30-9dda-dd9b5530c294" status: 404 len: 111 microversion: 2.1 time: 0.031287 Oct 23 01:14:48.835646 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 621/1171] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:14:48 2022] DELETE /compute/v2.1/servers/1cd3fd39-6d38-4c30-9dda-dd9b5530c294 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:14:48.840538 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a1655970-2e4f-4d4d-9432-e888ed79e347 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:48.841224 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a1655970-2e4f-4d4d-9432-e888ed79e347 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] [instance: 1cd3fd39-6d38-4c30-9dda-dd9b5530c294] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:48.847171 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a1655970-2e4f-4d4d-9432-e888ed79e347 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:48.847652 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a1655970-2e4f-4d4d-9432-e888ed79e347 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:48.848088 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a1655970-2e4f-4d4d-9432-e888ed79e347 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:48.848778 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a1655970-2e4f-4d4d-9432-e888ed79e347 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:48.849228 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a1655970-2e4f-4d4d-9432-e888ed79e347 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:48.849647 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a1655970-2e4f-4d4d-9432-e888ed79e347 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:48.863936 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-a1655970-2e4f-4d4d-9432-e888ed79e347 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] HTTP exception thrown: Instance 1cd3fd39-6d38-4c30-9dda-dd9b5530c294 could not be found. Oct 23 01:14:48.865486 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a1655970-2e4f-4d4d-9432-e888ed79e347 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Request method failure captured: Oct 23 01:14:48.865486 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/1cd3fd39-6d38-4c30-9dda-dd9b5530c294 HTTP/1.1 Oct 23 01:14:48.865486 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:14:48.865486 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:14:48.865486 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:14:48.865486 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:14:48.865486 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:14:48.865486 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:14:48.865486 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:14:48.865486 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:14:48.865486 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJVrJWolWP7j4DVRnvJX0oHF89Qz7M1tlAflEer_wljogOtfRzyLYTE1rxn6Mi9E25VaGN3QdlElHcwT6fQ1-0cBQz4G1eTRIwO0cNI0bsg3i39h_AIS6sYqH1n64pue9Yo_zCWgPDYNbEoirmYrwkxQ3HbYfmawoDiRAF2hVoX2kRM Oct 23 01:14:48.865486 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:14:48.865486 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:14:48.865486 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:14:48.865486 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:14:48.865486 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:14:48.865486 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:14:48.865486 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 0d2182cae228436ba5c9fc59edb00274 Oct 23 01:14:48.865486 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ImagesNegativeTestJSON-1482646335 Oct 23 01:14:48.865486 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:14:48.865486 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:14:48.872424 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/0d2182cae228436ba5c9fc59edb00274"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_0d2182cae228436ba5c9fc59edb00274"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0d2182cae228436ba5c9fc59edb00274"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0d2182cae228436ba5c9fc59edb00274"}]}] Oct 23 01:14:48.872424 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ImagesNegativeTestJSON-1482646335 Oct 23 01:14:48.872424 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 0d2182cae228436ba5c9fc59edb00274 Oct 23 01:14:48.872424 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1482646335 Oct 23 01:14:48.872424 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ImagesNegativeTestJSON-1482646335-project Oct 23 01:14:48.872424 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:14:48.872424 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:14:48.872424 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 870da6eeeb684fa380bf48b41f27b984 Oct 23 01:14:48.872424 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ImagesNegativeTestJSON-1482646335-project Oct 23 01:14:48.872424 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:14:48.872424 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 1cd3fd39-6d38-4c30-9dda-dd9b5530c294 could not be found. Oct 23 01:14:48.872424 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '1cd3fd39-6d38-4c30-9dda-dd9b5530c294'} Oct 23 01:14:48.873477 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:14:48.873477 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:48.873477 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:14:48.873477 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:14:48.873477 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:14:48.873477 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:14:48.873477 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:14:48.873477 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:14:48.873477 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:14:48.873477 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:14:48.873477 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cd3fd39-6d38-4c30-9dda-dd9b5530c294 could not be found. Oct 23 01:14:48.873477 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:14:48.873477 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:14:48.873477 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:14:48.873477 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:48.873477 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:14:48.873477 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:14:48.873477 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:14:48.873477 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:14:48.873477 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:14:48.875036 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:14:48.875036 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:14:48.875036 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:14:48.875036 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:14:48.875036 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:14:48.875036 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:14:48.875036 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:14:48.875036 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cd3fd39-6d38-4c30-9dda-dd9b5530c294 could not be found. Oct 23 01:14:48.875036 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:14:48.875036 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:14:48.875036 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:14:48.875036 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:48.875036 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:14:48.875036 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:14:48.875036 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:14:48.875036 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:14:48.875036 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cd3fd39-6d38-4c30-9dda-dd9b5530c294 could not be found. Oct 23 01:14:48.875036 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:14:48.876379 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a1655970-2e4f-4d4d-9432-e888ed79e347 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] Returning 404 to user: Instance 1cd3fd39-6d38-4c30-9dda-dd9b5530c294 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:14:48.876379 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a1655970-2e4f-4d4d-9432-e888ed79e347 tempest-ImagesNegativeTestJSON-1482646335 tempest-ImagesNegativeTestJSON-1482646335-project] 10.222.0.42 "GET /compute/v2.1/servers/1cd3fd39-6d38-4c30-9dda-dd9b5530c294" status: 404 len: 111 microversion: 2.1 time: 0.031082 Oct 23 01:14:48.876379 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 622/1172] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:48 2022] GET /compute/v2.1/servers/1cd3fd39-6d38-4c30-9dda-dd9b5530c294 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:14:48.939868 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-db250e0e-863f-48ab-a033-7ab72bd3db59 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:48.949613 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-db250e0e-863f-48ab-a033-7ab72bd3db59 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/cffc5366-8131-4a2b-bf51-39e4d23929e3" status: 200 len: 1316 microversion: 2.1 time: 0.259373 Oct 23 01:14:48.963292 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 551/1173] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:48 2022] GET /compute/v2.1/servers/cffc5366-8131-4a2b-bf51-39e4d23929e3 => generated 1316 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:49.140950 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0ca25ef9-d869-498d-8cdd-f5645ed81983 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:49.142270 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0ca25ef9-d869-498d-8cdd-f5645ed81983 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 59cf7af1-8bca-4768-ac86-6e56d0649946] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:49.144854 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=10 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:49.150756 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0ca25ef9-d869-498d-8cdd-f5645ed81983 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:49.151938 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0ca25ef9-d869-498d-8cdd-f5645ed81983 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:49.152540 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0ca25ef9-d869-498d-8cdd-f5645ed81983 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:49.153730 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0ca25ef9-d869-498d-8cdd-f5645ed81983 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:49.154424 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0ca25ef9-d869-498d-8cdd-f5645ed81983 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:49.155386 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0ca25ef9-d869-498d-8cdd-f5645ed81983 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:49.317202 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-17e9d0b0-4dd8-45df-ae20-4eb28603bd82 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:49.318096 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-17e9d0b0-4dd8-45df-ae20-4eb28603bd82 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 8025dc46-71af-4fec-8f54-5ae9e92cc31f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:49.325045 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-17e9d0b0-4dd8-45df-ae20-4eb28603bd82 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:49.325729 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-17e9d0b0-4dd8-45df-ae20-4eb28603bd82 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:49.326358 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-17e9d0b0-4dd8-45df-ae20-4eb28603bd82 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:49.327234 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-17e9d0b0-4dd8-45df-ae20-4eb28603bd82 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:49.327882 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-17e9d0b0-4dd8-45df-ae20-4eb28603bd82 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:49.328460 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-17e9d0b0-4dd8-45df-ae20-4eb28603bd82 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:49.359585 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0ca25ef9-d869-498d-8cdd-f5645ed81983 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262d5984b8c4775b86fae1c0d314718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc8f8cefbf441c98d6bda76e99e3173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:49.369287 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0ca25ef9-d869-498d-8cdd-f5645ed81983 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946" status: 200 len: 1334 microversion: 2.1 time: 0.232300 Oct 23 01:14:49.387150 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 623/1174] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:49 2022] GET /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946 => generated 1334 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:49.473756 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-17e9d0b0-4dd8-45df-ae20-4eb28603bd82 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:49.482084 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-17e9d0b0-4dd8-45df-ae20-4eb28603bd82 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f" status: 200 len: 1378 microversion: 2.1 time: 0.169065 Oct 23 01:14:49.483295 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 552/1175] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:49 2022] GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f => generated 1378 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:14:49.508392 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7c75b19e-3d32-4a19-82ce-0bcf54e8c5b7 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:49.509322 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7c75b19e-3d32-4a19-82ce-0bcf54e8c5b7 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:49.516226 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7c75b19e-3d32-4a19-82ce-0bcf54e8c5b7 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:49.516705 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7c75b19e-3d32-4a19-82ce-0bcf54e8c5b7 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:49.517369 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7c75b19e-3d32-4a19-82ce-0bcf54e8c5b7 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:49.518074 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7c75b19e-3d32-4a19-82ce-0bcf54e8c5b7 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:49.518530 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7c75b19e-3d32-4a19-82ce-0bcf54e8c5b7 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:49.521584 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7c75b19e-3d32-4a19-82ce-0bcf54e8c5b7 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:49.594416 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7c75b19e-3d32-4a19-82ce-0bcf54e8c5b7 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:49.605839 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7c75b19e-3d32-4a19-82ce-0bcf54e8c5b7 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:49.607485 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7c75b19e-3d32-4a19-82ce-0bcf54e8c5b7 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b22ae04637942879cfd29edc41a5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936723f56dc549bd9b8e73c97297edf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:49.612654 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7c75b19e-3d32-4a19-82ce-0bcf54e8c5b7 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 200 len: 1537 microversion: 2.91 time: 0.108922 Oct 23 01:14:49.613315 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 624/1176] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:49 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 1537 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:49.634478 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e65282d6-7b6f-4aff-bdc3-228deeba5190 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:49.635129 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e65282d6-7b6f-4aff-bdc3-228deeba5190 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 8db307a5-7a1e-4791-8fa9-e934894238e9] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:49.641067 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e65282d6-7b6f-4aff-bdc3-228deeba5190 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:49.641561 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e65282d6-7b6f-4aff-bdc3-228deeba5190 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:49.642015 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e65282d6-7b6f-4aff-bdc3-228deeba5190 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:49.642720 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e65282d6-7b6f-4aff-bdc3-228deeba5190 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:49.643186 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e65282d6-7b6f-4aff-bdc3-228deeba5190 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:49.643615 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e65282d6-7b6f-4aff-bdc3-228deeba5190 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:49.765123 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c87a00ef-3322-463a-8437-25ef9dc32295 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:49.765875 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c87a00ef-3322-463a-8437-25ef9dc32295 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] [instance: e0769a09-da3a-422f-a7a8-27edf4a2e209] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:49.773373 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c87a00ef-3322-463a-8437-25ef9dc32295 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:49.774093 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c87a00ef-3322-463a-8437-25ef9dc32295 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:49.774705 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c87a00ef-3322-463a-8437-25ef9dc32295 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:49.776026 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c87a00ef-3322-463a-8437-25ef9dc32295 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:49.776657 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c87a00ef-3322-463a-8437-25ef9dc32295 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:49.777081 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c87a00ef-3322-463a-8437-25ef9dc32295 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:49.780245 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e65282d6-7b6f-4aff-bdc3-228deeba5190 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:49.799037 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e65282d6-7b6f-4aff-bdc3-228deeba5190 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:49.804259 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e65282d6-7b6f-4aff-bdc3-228deeba5190 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:49.804259 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e65282d6-7b6f-4aff-bdc3-228deeba5190 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9" status: 200 len: 1568 microversion: 2.25 time: 0.171273 Oct 23 01:14:49.804259 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 553/1177] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:49 2022] GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:49.978577 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f8c1f3df-fbe2-4764-bb9c-0dfd6639179b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:49.979218 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f8c1f3df-fbe2-4764-bb9c-0dfd6639179b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: cffc5366-8131-4a2b-bf51-39e4d23929e3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:49.998831 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8c1f3df-fbe2-4764-bb9c-0dfd6639179b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:49.998831 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8c1f3df-fbe2-4764-bb9c-0dfd6639179b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:49.998831 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8c1f3df-fbe2-4764-bb9c-0dfd6639179b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:50.000039 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8c1f3df-fbe2-4764-bb9c-0dfd6639179b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:50.000535 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8c1f3df-fbe2-4764-bb9c-0dfd6639179b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:50.001658 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8c1f3df-fbe2-4764-bb9c-0dfd6639179b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:50.217046 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c87a00ef-3322-463a-8437-25ef9dc32295 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80703c3d1dae419c9fd5ca103f3c28bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356a4b3819db457fb5caf68ded0212fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:50.247896 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c87a00ef-3322-463a-8437-25ef9dc32295 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] 10.222.0.42 "GET /compute/v2.1/servers/e0769a09-da3a-422f-a7a8-27edf4a2e209" status: 200 len: 1318 microversion: 2.1 time: 0.485422 Oct 23 01:14:50.250143 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 625/1178] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:49 2022] GET /compute/v2.1/servers/e0769a09-da3a-422f-a7a8-27edf4a2e209 => generated 1318 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:14:50.274206 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-70447abb-2e40-4b4c-9be9-4e737ce3e24b req-ceda95e1-b084-469d-8bb9-b8852ecea675 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59cf7af1-8bca-4768-ac86-6e56d0649946", "tag": "1af179f1-7395-4c6c-857c-f6bcc55abbbb"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:14:50.288127 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-70447abb-2e40-4b4c-9be9-4e737ce3e24b req-ceda95e1-b084-469d-8bb9-b8852ecea675 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:50.290947 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-70447abb-2e40-4b4c-9be9-4e737ce3e24b req-ceda95e1-b084-469d-8bb9-b8852ecea675 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:50.292850 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-70447abb-2e40-4b4c-9be9-4e737ce3e24b req-ceda95e1-b084-469d-8bb9-b8852ecea675 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:50.335036 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-70447abb-2e40-4b4c-9be9-4e737ce3e24b req-ceda95e1-b084-469d-8bb9-b8852ecea675 service nova] Creating event network-changed:1af179f1-7395-4c6c-857c-f6bcc55abbbb for instance 59cf7af1-8bca-4768-ac86-6e56d0649946 on n-h1-master-1 Oct 23 01:14:50.341385 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-70447abb-2e40-4b4c-9be9-4e737ce3e24b req-ceda95e1-b084-469d-8bb9-b8852ecea675 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070860 Oct 23 01:14:50.342645 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 626/1179] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:14:50.406652 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9fe3ffb1-287f-49a1-883c-2c2fb6b26340 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:50.407798 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9fe3ffb1-287f-49a1-883c-2c2fb6b26340 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 59cf7af1-8bca-4768-ac86-6e56d0649946] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:50.426490 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9fe3ffb1-287f-49a1-883c-2c2fb6b26340 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:50.427336 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9fe3ffb1-287f-49a1-883c-2c2fb6b26340 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:50.427995 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9fe3ffb1-287f-49a1-883c-2c2fb6b26340 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:50.433425 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9fe3ffb1-287f-49a1-883c-2c2fb6b26340 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:50.434426 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9fe3ffb1-287f-49a1-883c-2c2fb6b26340 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:50.435120 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9fe3ffb1-287f-49a1-883c-2c2fb6b26340 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:50.494490 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f8c1f3df-fbe2-4764-bb9c-0dfd6639179b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:50.509246 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f8c1f3df-fbe2-4764-bb9c-0dfd6639179b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/cffc5366-8131-4a2b-bf51-39e4d23929e3" status: 200 len: 1316 microversion: 2.1 time: 0.536995 Oct 23 01:14:50.527772 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 554/1180] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:49 2022] GET /compute/v2.1/servers/cffc5366-8131-4a2b-bf51-39e4d23929e3 => generated 1316 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:50.533131 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dd75fec1-c77b-4a6e-a04b-f7316750dd0e tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:50.534044 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-dd75fec1-c77b-4a6e-a04b-f7316750dd0e tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:50.542930 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd75fec1-c77b-4a6e-a04b-f7316750dd0e tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:50.543670 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd75fec1-c77b-4a6e-a04b-f7316750dd0e tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:50.544303 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd75fec1-c77b-4a6e-a04b-f7316750dd0e tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:50.545189 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd75fec1-c77b-4a6e-a04b-f7316750dd0e tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:50.547068 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd75fec1-c77b-4a6e-a04b-f7316750dd0e tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:50.547823 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd75fec1-c77b-4a6e-a04b-f7316750dd0e tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:50.831373 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9fe3ffb1-287f-49a1-883c-2c2fb6b26340 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262d5984b8c4775b86fae1c0d314718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc8f8cefbf441c98d6bda76e99e3173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:50.860426 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9fe3ffb1-287f-49a1-883c-2c2fb6b26340 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946" status: 200 len: 1334 microversion: 2.1 time: 0.466691 Oct 23 01:14:50.864413 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-dd75fec1-c77b-4a6e-a04b-f7316750dd0e tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 200 len: 1858 microversion: 2.1 time: 0.334893 Oct 23 01:14:50.865452 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 627/1181] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:50 2022] GET /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946 => generated 1334 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:50.868694 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 555/1182] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:50 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 1858 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:50.879708 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4779fe63-b2c7-460d-b4ee-ad9adc5ffd79 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:50.880331 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4779fe63-b2c7-460d-b4ee-ad9adc5ffd79 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] [instance: 12bc6f90-1421-4c4f-b651-ee7d941c725b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:50.881463 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-45fc123f-f6a6-44dc-831a-55f487fd9024 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:50.882829 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-45fc123f-f6a6-44dc-831a-55f487fd9024 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 8025dc46-71af-4fec-8f54-5ae9e92cc31f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:50.904279 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-45fc123f-f6a6-44dc-831a-55f487fd9024 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:50.904772 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-45fc123f-f6a6-44dc-831a-55f487fd9024 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:50.905205 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-45fc123f-f6a6-44dc-831a-55f487fd9024 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:50.906675 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4779fe63-b2c7-460d-b4ee-ad9adc5ffd79 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:50.907059 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4779fe63-b2c7-460d-b4ee-ad9adc5ffd79 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:50.907600 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4779fe63-b2c7-460d-b4ee-ad9adc5ffd79 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:50.908262 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4779fe63-b2c7-460d-b4ee-ad9adc5ffd79 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:50.908717 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4779fe63-b2c7-460d-b4ee-ad9adc5ffd79 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:50.909139 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4779fe63-b2c7-460d-b4ee-ad9adc5ffd79 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:50.910859 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-45fc123f-f6a6-44dc-831a-55f487fd9024 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:50.911275 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-45fc123f-f6a6-44dc-831a-55f487fd9024 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:50.911883 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-45fc123f-f6a6-44dc-831a-55f487fd9024 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:50.937758 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-4779fe63-b2c7-460d-b4ee-ad9adc5ffd79 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] HTTP exception thrown: Instance 12bc6f90-1421-4c4f-b651-ee7d941c725b could not be found. Oct 23 01:14:50.939362 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4779fe63-b2c7-460d-b4ee-ad9adc5ffd79 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Request method failure captured: Oct 23 01:14:50.939362 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b HTTP/1.1 Oct 23 01:14:50.939362 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:14:50.939362 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:14:50.939362 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:14:50.939362 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:14:50.939362 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:14:50.939362 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:14:50.939362 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:14:50.939362 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:14:50.939362 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJTHRUymrCxt6qjY0g7hDfOYrRaz5iJWozy2-fYZq09XgloGUYh35Ymk5e0pehTbsUl9hoypYzemOlqYF8i-i8kY00ASjZpgXtChF-xAiwL93UOrnsQcHTxw-jSCAV3BSXNcl1djqtBd1sMkx60oZydDhw9t7uqnBOMWEAQg_ulwVYM Oct 23 01:14:50.939362 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:14:50.939362 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:14:50.939362 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:14:50.939362 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:14:50.939362 n-d-master-1 devstack@n-api.service[120944]: X-Openstack-Nova-Api-Version: 2.91 Oct 23 01:14:50.939362 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:14:50.939362 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:14:50.939362 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 936723f56dc549bd9b8e73c97297edf1 Oct 23 01:14:50.939362 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-1114098782 Oct 23 01:14:50.939362 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:14:50.939362 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:14:50.941071 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/936723f56dc549bd9b8e73c97297edf1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_936723f56dc549bd9b8e73c97297edf1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/936723f56dc549bd9b8e73c97297edf1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/936723f56dc549bd9b8e73c97297edf1"}]}] Oct 23 01:14:50.941071 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-1114098782 Oct 23 01:14:50.941071 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 936723f56dc549bd9b8e73c97297edf1 Oct 23 01:14:50.941071 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-1114098782 Oct 23 01:14:50.941071 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-UnshelveToHostMultiNodesTest-1114098782-project Oct 23 01:14:50.941071 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:14:50.941071 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:14:50.941071 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 7b22ae04637942879cfd29edc41a5483 Oct 23 01:14:50.941071 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-1114098782-project Oct 23 01:14:50.941071 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:14:50.941071 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 12bc6f90-1421-4c4f-b651-ee7d941c725b could not be found. Oct 23 01:14:50.941071 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '12bc6f90-1421-4c4f-b651-ee7d941c725b'} Oct 23 01:14:50.942100 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:14:50.942100 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:50.942100 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:14:50.942100 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:14:50.942100 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:14:50.942100 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:14:50.942100 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:14:50.942100 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:14:50.942100 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:14:50.942100 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:14:50.942100 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12bc6f90-1421-4c4f-b651-ee7d941c725b could not be found. Oct 23 01:14:50.942100 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:14:50.942100 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:14:50.942100 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:14:50.942100 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:50.942100 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:14:50.942100 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:14:50.942100 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:14:50.942100 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:14:50.942100 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:14:50.943703 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:14:50.943703 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:14:50.943703 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:14:50.943703 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:14:50.943703 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:14:50.943703 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:14:50.943703 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:14:50.943703 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12bc6f90-1421-4c4f-b651-ee7d941c725b could not be found. Oct 23 01:14:50.943703 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:14:50.943703 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:14:50.943703 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:14:50.943703 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:50.943703 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:14:50.943703 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:14:50.943703 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:14:50.943703 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:14:50.943703 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12bc6f90-1421-4c4f-b651-ee7d941c725b could not be found. Oct 23 01:14:50.943703 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:14:50.945329 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4779fe63-b2c7-460d-b4ee-ad9adc5ffd79 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] Returning 404 to user: Instance 12bc6f90-1421-4c4f-b651-ee7d941c725b could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:14:50.945329 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4779fe63-b2c7-460d-b4ee-ad9adc5ffd79 tempest-UnshelveToHostMultiNodesTest-1114098782 tempest-UnshelveToHostMultiNodesTest-1114098782-project] 10.222.0.42 "GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b" status: 404 len: 111 microversion: 2.91 time: 0.068808 Oct 23 01:14:50.945329 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 556/1183] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:50 2022] GET /compute/v2.1/servers/12bc6f90-1421-4c4f-b651-ee7d941c725b => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:14:50.951437 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-fc115826-db57-48c4-91d5-82b999d52d51 req-8e6a77f6-6d14-444f-8b45-96c8cce32a2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0769a09-da3a-422f-a7a8-27edf4a2e209", "name": "network-vif-plugged", "status": "completed", "tag": "3cdea381-33bb-4ddd-903c-55b03ef495ae"}, {"server_uuid": "cffc5366-8131-4a2b-bf51-39e4d23929e3", "name": "network-vif-plugged", "status": "completed", "tag": "9c227e6f-548f-41bb-9cb3-74d96aabdc2a"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:14:50.964378 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-fc115826-db57-48c4-91d5-82b999d52d51 req-8e6a77f6-6d14-444f-8b45-96c8cce32a2a service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:50.964867 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-fc115826-db57-48c4-91d5-82b999d52d51 req-8e6a77f6-6d14-444f-8b45-96c8cce32a2a service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:50.965887 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-fc115826-db57-48c4-91d5-82b999d52d51 req-8e6a77f6-6d14-444f-8b45-96c8cce32a2a service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:50.993909 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-fc115826-db57-48c4-91d5-82b999d52d51 req-8e6a77f6-6d14-444f-8b45-96c8cce32a2a service nova] Creating event network-vif-plugged:3cdea381-33bb-4ddd-903c-55b03ef495ae for instance e0769a09-da3a-422f-a7a8-27edf4a2e209 on n-h1-master-1 Oct 23 01:14:50.994584 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-fc115826-db57-48c4-91d5-82b999d52d51 req-8e6a77f6-6d14-444f-8b45-96c8cce32a2a service nova] Creating event network-vif-plugged:9c227e6f-548f-41bb-9cb3-74d96aabdc2a for instance cffc5366-8131-4a2b-bf51-39e4d23929e3 on n-h2-master-1 Oct 23 01:14:51.008619 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-fc115826-db57-48c4-91d5-82b999d52d51 req-8e6a77f6-6d14-444f-8b45-96c8cce32a2a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.061499 Oct 23 01:14:51.009245 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 557/1184] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:14:51.015359 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b6a59b21-4f75-4761-9a67-fdc200bded3c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:51.022304 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b6a59b21-4f75-4761-9a67-fdc200bded3c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 8db307a5-7a1e-4791-8fa9-e934894238e9] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:51.024136 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b6a59b21-4f75-4761-9a67-fdc200bded3c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:51.024809 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b6a59b21-4f75-4761-9a67-fdc200bded3c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:51.025637 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b6a59b21-4f75-4761-9a67-fdc200bded3c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:51.026612 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b6a59b21-4f75-4761-9a67-fdc200bded3c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:51.027223 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b6a59b21-4f75-4761-9a67-fdc200bded3c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:51.027811 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b6a59b21-4f75-4761-9a67-fdc200bded3c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:51.859496 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b6a59b21-4f75-4761-9a67-fdc200bded3c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:51.872626 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-45fc123f-f6a6-44dc-831a-55f487fd9024 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:51.876138 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b6a59b21-4f75-4761-9a67-fdc200bded3c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:51.877966 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b6a59b21-4f75-4761-9a67-fdc200bded3c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:51.879396 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b6a59b21-4f75-4761-9a67-fdc200bded3c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9" status: 200 len: 1568 microversion: 2.25 time: 0.868854 Oct 23 01:14:51.880406 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 558/1185] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:51 2022] GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9 => generated 1568 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:51.885715 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3c734ee4-5d3f-455d-8040-c17bb45cd810 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:14:51.888728 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-45fc123f-f6a6-44dc-831a-55f487fd9024 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f" status: 200 len: 1378 microversion: 2.1 time: 1.017048 Oct 23 01:14:51.889777 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3c734ee4-5d3f-455d-8040-c17bb45cd810 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:51.890229 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 628/1186] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:50 2022] GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f => generated 1378 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:51.896218 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-edd7fc08-986f-447a-8e90-e5e53db6bed9 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:51.898420 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3c734ee4-5d3f-455d-8040-c17bb45cd810 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:51.898597 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-edd7fc08-986f-447a-8e90-e5e53db6bed9 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] [instance: e0769a09-da3a-422f-a7a8-27edf4a2e209] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:51.898713 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3c734ee4-5d3f-455d-8040-c17bb45cd810 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:51.898713 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3c734ee4-5d3f-455d-8040-c17bb45cd810 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:51.899286 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3c734ee4-5d3f-455d-8040-c17bb45cd810 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:51.899936 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3c734ee4-5d3f-455d-8040-c17bb45cd810 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:51.900471 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3c734ee4-5d3f-455d-8040-c17bb45cd810 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:51.908564 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-edd7fc08-986f-447a-8e90-e5e53db6bed9 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:51.910490 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-edd7fc08-986f-447a-8e90-e5e53db6bed9 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:51.911277 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-edd7fc08-986f-447a-8e90-e5e53db6bed9 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:51.912310 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-edd7fc08-986f-447a-8e90-e5e53db6bed9 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:51.912952 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-edd7fc08-986f-447a-8e90-e5e53db6bed9 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:51.913722 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-edd7fc08-986f-447a-8e90-e5e53db6bed9 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:51.948746 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-3c734ee4-5d3f-455d-8040-c17bb45cd810 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lazy-loading 'flavor' on Instance uuid 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:14:51.965688 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3c734ee4-5d3f-455d-8040-c17bb45cd810 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Going to try to live migrate instance to n-h1-master-1 {{(pid=120944) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 23 01:14:52.096675 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-edd7fc08-986f-447a-8e90-e5e53db6bed9 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80703c3d1dae419c9fd5ca103f3c28bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356a4b3819db457fb5caf68ded0212fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:52.105962 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-edd7fc08-986f-447a-8e90-e5e53db6bed9 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] 10.222.0.42 "GET /compute/v2.1/servers/e0769a09-da3a-422f-a7a8-27edf4a2e209" status: 200 len: 1318 microversion: 2.1 time: 0.214205 Oct 23 01:14:52.106622 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 629/1187] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:51 2022] GET /compute/v2.1/servers/e0769a09-da3a-422f-a7a8-27edf4a2e209 => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:52.111689 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d4bacce8-3020-40c3-9690-214d4d1bb3d3 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:52.112303 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d4bacce8-3020-40c3-9690-214d4d1bb3d3 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: cffc5366-8131-4a2b-bf51-39e4d23929e3] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:52.119562 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4bacce8-3020-40c3-9690-214d4d1bb3d3 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:52.120544 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4bacce8-3020-40c3-9690-214d4d1bb3d3 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:52.121082 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4bacce8-3020-40c3-9690-214d4d1bb3d3 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:52.122175 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4bacce8-3020-40c3-9690-214d4d1bb3d3 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:52.129053 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4bacce8-3020-40c3-9690-214d4d1bb3d3 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:52.129053 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4bacce8-3020-40c3-9690-214d4d1bb3d3 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:52.291901 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d4bacce8-3020-40c3-9690-214d4d1bb3d3 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:52.300295 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d4bacce8-3020-40c3-9690-214d4d1bb3d3 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/cffc5366-8131-4a2b-bf51-39e4d23929e3" status: 200 len: 1316 microversion: 2.1 time: 0.192356 Oct 23 01:14:52.300866 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 630/1188] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:52 2022] GET /compute/v2.1/servers/cffc5366-8131-4a2b-bf51-39e4d23929e3 => generated 1316 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:52.305906 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-87121994-b732-47e6-aaf2-654e9da2852c tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:52.306529 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-87121994-b732-47e6-aaf2-654e9da2852c tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 59cf7af1-8bca-4768-ac86-6e56d0649946] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:52.313636 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-87121994-b732-47e6-aaf2-654e9da2852c tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:52.314229 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-87121994-b732-47e6-aaf2-654e9da2852c tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:52.314668 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-87121994-b732-47e6-aaf2-654e9da2852c tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:52.315425 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-87121994-b732-47e6-aaf2-654e9da2852c tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:52.315881 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-87121994-b732-47e6-aaf2-654e9da2852c tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:52.316349 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-87121994-b732-47e6-aaf2-654e9da2852c tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:52.332627 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:52.490661 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-87121994-b732-47e6-aaf2-654e9da2852c tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262d5984b8c4775b86fae1c0d314718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc8f8cefbf441c98d6bda76e99e3173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:52.500876 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-87121994-b732-47e6-aaf2-654e9da2852c tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946" status: 200 len: 1334 microversion: 2.1 time: 0.198958 Oct 23 01:14:52.501807 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 631/1189] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:52 2022] GET /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946 => generated 1334 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:52.911532 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6219e833-a76d-42e4-9f54-dd6a40803d42 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:52.912919 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6219e833-a76d-42e4-9f54-dd6a40803d42 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 8db307a5-7a1e-4791-8fa9-e934894238e9] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:52.920486 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6219e833-a76d-42e4-9f54-dd6a40803d42 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:52.925186 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6219e833-a76d-42e4-9f54-dd6a40803d42 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:52.928649 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6219e833-a76d-42e4-9f54-dd6a40803d42 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:52.931672 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6219e833-a76d-42e4-9f54-dd6a40803d42 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:52.932299 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6219e833-a76d-42e4-9f54-dd6a40803d42 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:52.932826 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6219e833-a76d-42e4-9f54-dd6a40803d42 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:53.333288 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6219e833-a76d-42e4-9f54-dd6a40803d42 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:53.341595 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6219e833-a76d-42e4-9f54-dd6a40803d42 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:53.343146 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6219e833-a76d-42e4-9f54-dd6a40803d42 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:53.344276 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6219e833-a76d-42e4-9f54-dd6a40803d42 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9" status: 200 len: 1568 microversion: 2.25 time: 0.436785 Oct 23 01:14:53.344838 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 632/1190] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:52 2022] GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9 => generated 1568 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:14:53.350177 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f14d8939-19a1-4a79-a6fe-0c94f54ec185 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:53.351526 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f14d8939-19a1-4a79-a6fe-0c94f54ec185 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 8025dc46-71af-4fec-8f54-5ae9e92cc31f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:53.357922 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f14d8939-19a1-4a79-a6fe-0c94f54ec185 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:53.358452 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f14d8939-19a1-4a79-a6fe-0c94f54ec185 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:53.358887 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f14d8939-19a1-4a79-a6fe-0c94f54ec185 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:53.359584 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f14d8939-19a1-4a79-a6fe-0c94f54ec185 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:53.360037 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f14d8939-19a1-4a79-a6fe-0c94f54ec185 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:53.360458 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f14d8939-19a1-4a79-a6fe-0c94f54ec185 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:53.498984 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f14d8939-19a1-4a79-a6fe-0c94f54ec185 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:53.506712 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f14d8939-19a1-4a79-a6fe-0c94f54ec185 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f" status: 200 len: 1527 microversion: 2.1 time: 0.160570 Oct 23 01:14:53.507810 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 633/1191] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:53 2022] GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f => generated 1527 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:53.512289 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-75685261-8b4f-422b-8227-14d5c03857ba tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:53.512894 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-75685261-8b4f-422b-8227-14d5c03857ba tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] [instance: e0769a09-da3a-422f-a7a8-27edf4a2e209] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:53.518438 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-75685261-8b4f-422b-8227-14d5c03857ba tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:53.518992 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-75685261-8b4f-422b-8227-14d5c03857ba tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:53.519441 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-75685261-8b4f-422b-8227-14d5c03857ba tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:53.520132 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-75685261-8b4f-422b-8227-14d5c03857ba tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:53.520586 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-75685261-8b4f-422b-8227-14d5c03857ba tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:53.521007 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-75685261-8b4f-422b-8227-14d5c03857ba tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:53.794286 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-75685261-8b4f-422b-8227-14d5c03857ba tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80703c3d1dae419c9fd5ca103f3c28bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356a4b3819db457fb5caf68ded0212fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:53.802418 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-75685261-8b4f-422b-8227-14d5c03857ba tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] 10.222.0.42 "GET /compute/v2.1/servers/e0769a09-da3a-422f-a7a8-27edf4a2e209" status: 200 len: 1318 microversion: 2.1 time: 0.293457 Oct 23 01:14:53.803507 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 634/1192] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:53 2022] GET /compute/v2.1/servers/e0769a09-da3a-422f-a7a8-27edf4a2e209 => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:53.814995 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-42e5f376-56e5-44e2-bf79-4b98b6fe0923 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:53.820332 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-42e5f376-56e5-44e2-bf79-4b98b6fe0923 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: cffc5366-8131-4a2b-bf51-39e4d23929e3] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:53.826756 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-42e5f376-56e5-44e2-bf79-4b98b6fe0923 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:53.827507 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-42e5f376-56e5-44e2-bf79-4b98b6fe0923 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:53.828133 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-42e5f376-56e5-44e2-bf79-4b98b6fe0923 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:53.829256 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-42e5f376-56e5-44e2-bf79-4b98b6fe0923 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:53.829920 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-42e5f376-56e5-44e2-bf79-4b98b6fe0923 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:53.830434 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-42e5f376-56e5-44e2-bf79-4b98b6fe0923 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:54.063505 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-42e5f376-56e5-44e2-bf79-4b98b6fe0923 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:54.072188 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-42e5f376-56e5-44e2-bf79-4b98b6fe0923 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/cffc5366-8131-4a2b-bf51-39e4d23929e3" status: 200 len: 1466 microversion: 2.1 time: 0.266882 Oct 23 01:14:54.072758 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 635/1193] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:53 2022] GET /compute/v2.1/servers/cffc5366-8131-4a2b-bf51-39e4d23929e3 => generated 1466 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:54.077440 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-05d48490-8d84-44eb-9d64-3f5bef86c8df tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:54.078236 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-05d48490-8d84-44eb-9d64-3f5bef86c8df tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 59cf7af1-8bca-4768-ac86-6e56d0649946] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:54.084062 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05d48490-8d84-44eb-9d64-3f5bef86c8df tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:54.084539 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05d48490-8d84-44eb-9d64-3f5bef86c8df tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:54.084965 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05d48490-8d84-44eb-9d64-3f5bef86c8df tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:54.085689 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05d48490-8d84-44eb-9d64-3f5bef86c8df tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:54.086175 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05d48490-8d84-44eb-9d64-3f5bef86c8df tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:54.086595 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05d48490-8d84-44eb-9d64-3f5bef86c8df tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:54.442974 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-05d48490-8d84-44eb-9d64-3f5bef86c8df tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262d5984b8c4775b86fae1c0d314718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc8f8cefbf441c98d6bda76e99e3173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:54.451449 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-05d48490-8d84-44eb-9d64-3f5bef86c8df tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946" status: 200 len: 1334 microversion: 2.1 time: 0.377387 Oct 23 01:14:54.452040 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 636/1194] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:54 2022] GET /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946 => generated 1334 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:54.456803 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-552e00aa-9af0-461b-8070-ec019bdcc97a tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:54.457359 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-552e00aa-9af0-461b-8070-ec019bdcc97a tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 8025dc46-71af-4fec-8f54-5ae9e92cc31f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:54.466137 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-552e00aa-9af0-461b-8070-ec019bdcc97a tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:54.466635 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-552e00aa-9af0-461b-8070-ec019bdcc97a tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:54.467076 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-552e00aa-9af0-461b-8070-ec019bdcc97a tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:54.468409 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-552e00aa-9af0-461b-8070-ec019bdcc97a tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:54.470731 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-552e00aa-9af0-461b-8070-ec019bdcc97a tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:54.471191 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-552e00aa-9af0-461b-8070-ec019bdcc97a tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:54.869189 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-552e00aa-9af0-461b-8070-ec019bdcc97a tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:54.877122 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-552e00aa-9af0-461b-8070-ec019bdcc97a tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f" status: 200 len: 1527 microversion: 2.1 time: 0.423894 Oct 23 01:14:54.878121 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 637/1195] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:54 2022] GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f => generated 1527 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:55.376624 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f8391204-0ec6-4ccb-9a33-d2be2d08f188 tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:55.377246 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f8391204-0ec6-4ccb-9a33-d2be2d08f188 tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] [instance: cffc5366-8131-4a2b-bf51-39e4d23929e3] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:55.385189 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f8391204-0ec6-4ccb-9a33-d2be2d08f188 tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:55.388712 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f8391204-0ec6-4ccb-9a33-d2be2d08f188 tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:55.388712 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f8391204-0ec6-4ccb-9a33-d2be2d08f188 tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:55.388712 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f8391204-0ec6-4ccb-9a33-d2be2d08f188 tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:55.388712 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f8391204-0ec6-4ccb-9a33-d2be2d08f188 tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:55.389513 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f8391204-0ec6-4ccb-9a33-d2be2d08f188 tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:55.896880 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3c734ee4-5d3f-455d-8040-c17bb45cd810 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d/action" status: 202 len: 0 microversion: 2.1 time: 4.015174 Oct 23 01:14:55.901363 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 559/1196] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:14:51 2022] POST /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d/action => generated 0 bytes in 4019 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:14:55.905561 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4fc2c3bb-f8d1-4ebb-a18b-4bdb4efcf562 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:55.909370 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4fc2c3bb-f8d1-4ebb-a18b-4bdb4efcf562 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 8db307a5-7a1e-4791-8fa9-e934894238e9] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:55.914054 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4fc2c3bb-f8d1-4ebb-a18b-4bdb4efcf562 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:55.914735 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4fc2c3bb-f8d1-4ebb-a18b-4bdb4efcf562 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:55.915350 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4fc2c3bb-f8d1-4ebb-a18b-4bdb4efcf562 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:55.916262 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4fc2c3bb-f8d1-4ebb-a18b-4bdb4efcf562 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:55.916883 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4fc2c3bb-f8d1-4ebb-a18b-4bdb4efcf562 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:55.917307 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4fc2c3bb-f8d1-4ebb-a18b-4bdb4efcf562 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:55.962250 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f8391204-0ec6-4ccb-9a33-d2be2d08f188 tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/cffc5366-8131-4a2b-bf51-39e4d23929e3" status: 200 len: 1617 microversion: 2.1 time: 1.082129 Oct 23 01:14:55.963117 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 638/1197] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:54 2022] GET /compute/v2.1/servers/cffc5366-8131-4a2b-bf51-39e4d23929e3 => generated 1617 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:55.968610 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1b64fab1-45a1-46cc-b384-bbbc7002300d tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:55.969649 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1b64fab1-45a1-46cc-b384-bbbc7002300d tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] [instance: e0769a09-da3a-422f-a7a8-27edf4a2e209] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:55.980164 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b64fab1-45a1-46cc-b384-bbbc7002300d tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:55.986207 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b64fab1-45a1-46cc-b384-bbbc7002300d tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:55.986963 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b64fab1-45a1-46cc-b384-bbbc7002300d tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:55.987867 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b64fab1-45a1-46cc-b384-bbbc7002300d tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:55.989266 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b64fab1-45a1-46cc-b384-bbbc7002300d tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:55.989855 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b64fab1-45a1-46cc-b384-bbbc7002300d tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:56.191883 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4fc2c3bb-f8d1-4ebb-a18b-4bdb4efcf562 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:56.201591 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4fc2c3bb-f8d1-4ebb-a18b-4bdb4efcf562 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:56.204198 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4fc2c3bb-f8d1-4ebb-a18b-4bdb4efcf562 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:56.205836 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4fc2c3bb-f8d1-4ebb-a18b-4bdb4efcf562 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9" status: 200 len: 1568 microversion: 2.25 time: 0.304175 Oct 23 01:14:56.206449 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 560/1198] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:55 2022] GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9 => generated 1568 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:56.215969 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-171e213b-cdba-4096-9798-93889a348a22 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:56.216413 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1b64fab1-45a1-46cc-b384-bbbc7002300d tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80703c3d1dae419c9fd5ca103f3c28bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356a4b3819db457fb5caf68ded0212fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:56.225308 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1b64fab1-45a1-46cc-b384-bbbc7002300d tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] 10.222.0.42 "GET /compute/v2.1/servers/e0769a09-da3a-422f-a7a8-27edf4a2e209" status: 200 len: 1468 microversion: 2.1 time: 0.260948 Oct 23 01:14:56.226194 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 639/1199] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:55 2022] GET /compute/v2.1/servers/e0769a09-da3a-422f-a7a8-27edf4a2e209 => generated 1468 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:56.231014 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-69ce76c6-41a8-452c-bc89-a661ba6402bc req-b7247056-d3e7-4769-833e-d439dbccf517 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8db307a5-7a1e-4791-8fa9-e934894238e9", "name": "network-vif-unplugged", "status": "completed", "tag": "7328ae33-f6ec-49e1-9744-c0a7a6f75e28"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:14:56.241243 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-69ce76c6-41a8-452c-bc89-a661ba6402bc req-b7247056-d3e7-4769-833e-d439dbccf517 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:56.241753 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-69ce76c6-41a8-452c-bc89-a661ba6402bc req-b7247056-d3e7-4769-833e-d439dbccf517 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:56.242205 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-69ce76c6-41a8-452c-bc89-a661ba6402bc req-b7247056-d3e7-4769-833e-d439dbccf517 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:56.266343 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-69ce76c6-41a8-452c-bc89-a661ba6402bc req-b7247056-d3e7-4769-833e-d439dbccf517 service nova] Creating event network-vif-unplugged:7328ae33-f6ec-49e1-9744-c0a7a6f75e28 for instance 8db307a5-7a1e-4791-8fa9-e934894238e9 on n-h2-master-1 Oct 23 01:14:56.274241 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-69ce76c6-41a8-452c-bc89-a661ba6402bc req-b7247056-d3e7-4769-833e-d439dbccf517 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045085 Oct 23 01:14:56.278485 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 640/1200] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:14:56.285858 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f32fb22a-714c-4b5d-a9bc-450d4e92f1f0 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:56.287033 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f32fb22a-714c-4b5d-a9bc-450d4e92f1f0 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 59cf7af1-8bca-4768-ac86-6e56d0649946] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:56.294411 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f32fb22a-714c-4b5d-a9bc-450d4e92f1f0 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:56.294906 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f32fb22a-714c-4b5d-a9bc-450d4e92f1f0 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:56.295421 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f32fb22a-714c-4b5d-a9bc-450d4e92f1f0 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:56.296988 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f32fb22a-714c-4b5d-a9bc-450d4e92f1f0 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:56.297858 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f32fb22a-714c-4b5d-a9bc-450d4e92f1f0 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:56.298365 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f32fb22a-714c-4b5d-a9bc-450d4e92f1f0 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:56.340823 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-171e213b-cdba-4096-9798-93889a348a22 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/9bcda188-8c9a-4a0e-a7f3-bd5b16a30592" status: 202 len: 0 microversion: 2.1 time: 0.128788 Oct 23 01:14:56.341743 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 561/1201] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:14:56 2022] DELETE /compute/v2.1/flavors/9bcda188-8c9a-4a0e-a7f3-bd5b16a30592 => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:14:56.347476 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d6fb0d10-411a-4017-a06f-e8dce2cebc82 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:56.348550 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d6fb0d10-411a-4017-a06f-e8dce2cebc82 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:56.372207 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d6fb0d10-411a-4017-a06f-e8dce2cebc82 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:56.373016 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d6fb0d10-411a-4017-a06f-e8dce2cebc82 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:56.374699 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d6fb0d10-411a-4017-a06f-e8dce2cebc82 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:56.378901 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d6fb0d10-411a-4017-a06f-e8dce2cebc82 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:56.379755 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d6fb0d10-411a-4017-a06f-e8dce2cebc82 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:56.380353 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d6fb0d10-411a-4017-a06f-e8dce2cebc82 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:56.591559 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f32fb22a-714c-4b5d-a9bc-450d4e92f1f0 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262d5984b8c4775b86fae1c0d314718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc8f8cefbf441c98d6bda76e99e3173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:56.602753 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f32fb22a-714c-4b5d-a9bc-450d4e92f1f0 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946" status: 200 len: 1334 microversion: 2.1 time: 0.322702 Oct 23 01:14:56.603840 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 641/1202] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:56 2022] GET /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946 => generated 1334 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:56.610536 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9564759f-c648-45eb-9dd2-3b1c6f1e9840 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Action: 'create', calling method: .version_select at 0x7f5cc1f4ed30>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-931823112", "policies": ["affinity"]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:14:56.642362 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d6fb0d10-411a-4017-a06f-e8dce2cebc82 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:56.656894 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d6fb0d10-411a-4017-a06f-e8dce2cebc82 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 200 len: 1717 microversion: 2.1 time: 0.313808 Oct 23 01:14:56.662118 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 562/1203] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:56 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 1717 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:56.681212 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-9564759f-c648-45eb-9dd2-3b1c6f1e9840 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Getting quotas for project 47aadec780734d03a262d4021f48d625. Resources: {'server_groups'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:14:56.690263 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-9564759f-c648-45eb-9dd2-3b1c6f1e9840 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Getting quotas for user 519c893a1e094200b882cf23db7cae54 and project 47aadec780734d03a262d4021f48d625. Resources: {'server_groups'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:14:56.842382 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:56.852056 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-9564759f-c648-45eb-9dd2-3b1c6f1e9840 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Getting quotas for project 47aadec780734d03a262d4021f48d625. Resources: {'server_groups'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:14:56.857137 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-9564759f-c648-45eb-9dd2-3b1c6f1e9840 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Getting quotas for user 519c893a1e094200b882cf23db7cae54 and project 47aadec780734d03a262d4021f48d625. Resources: {'server_groups'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:14:56.870085 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9564759f-c648-45eb-9dd2-3b1c6f1e9840 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.263251 Oct 23 01:14:56.870876 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 642/1204] 10.222.0.42 () {60 vars in 1174 bytes} [Sun Oct 23 01:14:56 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:14:56.875258 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1cf00566-0916-4f2f-b323-93a67f5ab495 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:56.881852 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1734e22e-4054-4223-a7ad-8076a3c89d22 tempest-LiveMigrationNegativeTest-1953311517 tempest-LiveMigrationNegativeTest-1953311517-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1542612569", "block_migration": true, "disk_over_commit": false}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:14:56.885160 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1734e22e-4054-4223-a7ad-8076a3c89d22 tempest-LiveMigrationNegativeTest-1953311517 tempest-LiveMigrationNegativeTest-1953311517-project-admin] [instance: e0769a09-da3a-422f-a7a8-27edf4a2e209] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:56.891421 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1734e22e-4054-4223-a7ad-8076a3c89d22 tempest-LiveMigrationNegativeTest-1953311517 tempest-LiveMigrationNegativeTest-1953311517-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:56.892031 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1734e22e-4054-4223-a7ad-8076a3c89d22 tempest-LiveMigrationNegativeTest-1953311517 tempest-LiveMigrationNegativeTest-1953311517-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:56.892789 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1734e22e-4054-4223-a7ad-8076a3c89d22 tempest-LiveMigrationNegativeTest-1953311517 tempest-LiveMigrationNegativeTest-1953311517-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:56.893678 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1734e22e-4054-4223-a7ad-8076a3c89d22 tempest-LiveMigrationNegativeTest-1953311517 tempest-LiveMigrationNegativeTest-1953311517-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:56.894109 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1734e22e-4054-4223-a7ad-8076a3c89d22 tempest-LiveMigrationNegativeTest-1953311517 tempest-LiveMigrationNegativeTest-1953311517-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:56.894537 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1734e22e-4054-4223-a7ad-8076a3c89d22 tempest-LiveMigrationNegativeTest-1953311517 tempest-LiveMigrationNegativeTest-1953311517-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:56.900458 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1cf00566-0916-4f2f-b323-93a67f5ab495 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028526 Oct 23 01:14:56.901423 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 643/1205] 10.222.0.42 () {58 vars in 1146 bytes} [Sun Oct 23 01:14:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:56.934059 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-1734e22e-4054-4223-a7ad-8076a3c89d22 tempest-LiveMigrationNegativeTest-1953311517 tempest-LiveMigrationNegativeTest-1953311517-project-admin] Lazy-loading 'flavor' on Instance uuid e0769a09-da3a-422f-a7a8-27edf4a2e209 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:14:56.949367 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1734e22e-4054-4223-a7ad-8076a3c89d22 tempest-LiveMigrationNegativeTest-1953311517 tempest-LiveMigrationNegativeTest-1953311517-project-admin] [instance: e0769a09-da3a-422f-a7a8-27edf4a2e209] Going to try to live migrate instance to tempest-host-1542612569 {{(pid=120944) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 23 01:14:56.956595 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-1734e22e-4054-4223-a7ad-8076a3c89d22 tempest-LiveMigrationNegativeTest-1953311517 tempest-LiveMigrationNegativeTest-1953311517-project-admin] HTTP exception thrown: Compute host tempest-host-1542612569 could not be found. Oct 23 01:14:56.962367 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1734e22e-4054-4223-a7ad-8076a3c89d22 tempest-LiveMigrationNegativeTest-1953311517 tempest-LiveMigrationNegativeTest-1953311517-project-admin] Request method failure captured: Oct 23 01:14:56.962367 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/servers/e0769a09-da3a-422f-a7a8-27edf4a2e209/action HTTP/1.1 Oct 23 01:14:56.962367 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:14:56.962367 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:14:56.962367 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:14:56.962367 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 107 Oct 23 01:14:56.962367 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:14:56.962367 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:14:56.962367 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:14:56.962367 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:14:56.962367 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJVse-ECvFga4Of5Cs9dI20Z50A_aDh9LZEsnhuF1CZrGHVtWXjPtkpTfqgP7EW3UumE4IlOJlIZEYTuUJ5lUed7SCPFNoNMkczmnfykL5FobYEyrIu0hZmqW4EW4NyHvNveP23Kc1sqrqLXrGYCWwF5ISv1Je1knwM1yT9NGF4UugQ Oct 23 01:14:56.962367 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:14:56.962367 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:14:56.962367 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:14:56.962367 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:14:56.962367 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:14:56.962367 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:14:56.962367 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: d2d01301d47b40c8bb2ab24042d092b1 Oct 23 01:14:56.962367 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-LiveMigrationNegativeTest-1953311517 Oct 23 01:14:56.962367 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,admin,reader Oct 23 01:14:56.962367 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,admin,reader Oct 23 01:14:56.964149 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d2d01301d47b40c8bb2ab24042d092b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d2d01301d47b40c8bb2ab24042d092b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d2d01301d47b40c8bb2ab24042d092b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d2d01301d47b40c8bb2ab24042d092b1"}]}] Oct 23 01:14:56.964149 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-LiveMigrationNegativeTest-1953311517 Oct 23 01:14:56.964149 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: d2d01301d47b40c8bb2ab24042d092b1 Oct 23 01:14:56.964149 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1953311517 Oct 23 01:14:56.964149 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-LiveMigrationNegativeTest-1953311517-project-admin Oct 23 01:14:56.964149 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:14:56.964149 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:14:56.964149 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 1fd857a3b4cf4c97948ba349f8920fc6 Oct 23 01:14:56.964149 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-LiveMigrationNegativeTest-1953311517-project-admin Oct 23 01:14:56.964149 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:14:56.964149 n-d-master-1 devstack@n-api.service[120944]: {"os-migrateLive": {"host": "tempest-host-1542612569", "block_migration": true, "disk_over_commit": false}} Oct 23 01:14:56.964149 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:14:56.965728 n-d-master-1 devstack@n-api.service[120944]: exception: Compute host tempest-host-1542612569 could not be found. Oct 23 01:14:56.965728 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'e0769a09-da3a-422f-a7a8-27edf4a2e209', 'body': {'os-migrateLive': {'host': 'tempest-host-1542612569', 'block_migration': True, 'disk_over_commit': False}}} Oct 23 01:14:56.965728 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:14:56.965728 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:56.965728 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 23 01:14:56.965728 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 23 01:14:56.965728 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 23 01:14:56.965728 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 23 01:14:56.965728 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 23 01:14:56.965728 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 23 01:14:56.965728 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 23 01:14:56.965728 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 23 01:14:56.965728 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 23 01:14:56.965728 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 23 01:14:56.965728 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 23 01:14:56.965728 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 23 01:14:56.965728 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 23 01:14:56.965728 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 23 01:14:56.965728 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 23 01:14:56.971971 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 23 01:14:56.971971 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 23 01:14:56.971971 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 23 01:14:56.971971 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 23 01:14:56.971971 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 23 01:14:56.971971 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 01:14:56.971971 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 01:14:56.971971 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 23 01:14:56.971971 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 23 01:14:56.971971 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 23 01:14:56.971971 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:14:56.971971 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 23 01:14:56.971971 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 23 01:14:56.971971 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 23 01:14:56.971971 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 23 01:14:56.971971 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 23 01:14:56.971971 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 23 01:14:56.971971 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1542612569 could not be found. Oct 23 01:14:56.971971 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:14:56.973422 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:14:56.973422 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:14:56.973422 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:56.973422 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:14:56.973422 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:14:56.973422 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:14:56.973422 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:14:56.973422 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:14:56.973422 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:14:56.973422 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:14:56.973422 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:14:56.973422 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:14:56.973422 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:14:56.973422 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:14:56.973422 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:14:56.973422 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 23 01:14:56.973422 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 23 01:14:56.973422 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 23 01:14:56.973422 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1542612569 could not be found. Oct 23 01:14:56.973422 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:14:56.974924 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:14:56.974924 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:14:56.974924 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:14:56.974924 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:14:56.974924 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:14:56.974924 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:14:56.974924 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:14:56.974924 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1542612569 could not be found. Oct 23 01:14:56.974924 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:14:56.974924 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1734e22e-4054-4223-a7ad-8076a3c89d22 tempest-LiveMigrationNegativeTest-1953311517 tempest-LiveMigrationNegativeTest-1953311517-project-admin] Returning 400 to user: Compute host tempest-host-1542612569 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:14:56.974924 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1734e22e-4054-4223-a7ad-8076a3c89d22 tempest-LiveMigrationNegativeTest-1953311517 tempest-LiveMigrationNegativeTest-1953311517-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/e0769a09-da3a-422f-a7a8-27edf4a2e209/action" status: 400 len: 100 microversion: 2.1 time: 0.296453 Oct 23 01:14:56.974924 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 563/1206] 10.222.0.42 () {60 vars in 1279 bytes} [Sun Oct 23 01:14:56 2022] POST /compute/v2.1/servers/e0769a09-da3a-422f-a7a8-27edf4a2e209/action => generated 100 bytes in 298 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:14:56.975884 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-73765e0f-380f-4626-b9a1-c2b52997d69b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:14:56.975884 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-73765e0f-380f-4626-b9a1-c2b52997d69b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 8025dc46-71af-4fec-8f54-5ae9e92cc31f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:56.978828 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-73765e0f-380f-4626-b9a1-c2b52997d69b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:56.979326 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-73765e0f-380f-4626-b9a1-c2b52997d69b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:56.979774 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-73765e0f-380f-4626-b9a1-c2b52997d69b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:56.980483 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-73765e0f-380f-4626-b9a1-c2b52997d69b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:56.981069 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-73765e0f-380f-4626-b9a1-c2b52997d69b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:56.981530 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-73765e0f-380f-4626-b9a1-c2b52997d69b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:57.076645 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-73765e0f-380f-4626-b9a1-c2b52997d69b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:57.082845 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-73765e0f-380f-4626-b9a1-c2b52997d69b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 8025dc46-71af-4fec-8f54-5ae9e92cc31f] Old instance type tempest-test_resize_flavor_-1078225792, new instance type m1.heat {{(pid=120944) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 23 01:14:57.090325 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-73765e0f-380f-4626-b9a1-c2b52997d69b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:14:57.090761 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-73765e0f-380f-4626-b9a1-c2b52997d69b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:14:57.091246 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-73765e0f-380f-4626-b9a1-c2b52997d69b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:14:57.091660 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-73765e0f-380f-4626-b9a1-c2b52997d69b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:14:57.092240 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-73765e0f-380f-4626-b9a1-c2b52997d69b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:14:57.159868 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8521d642-2834-48ee-ae93-486a9d694e8f tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-617002447", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:14:57.187086 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:57.213169 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-8521d642-2834-48ee-ae93-486a9d694e8f tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] validate_networks() for None {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:14:57.371892 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-73765e0f-380f-4626-b9a1-c2b52997d69b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "POST /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f/action" status: 202 len: 0 microversion: 2.1 time: 0.406191 Oct 23 01:14:57.372876 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 564/1207] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:14:56 2022] POST /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f/action => generated 0 bytes in 408 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:14:57.379014 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ba21f7c5-1865-4cf3-bbd2-aa7a164ec81d tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:57.379997 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ba21f7c5-1865-4cf3-bbd2-aa7a164ec81d tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] [instance: e0769a09-da3a-422f-a7a8-27edf4a2e209] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:57.387627 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba21f7c5-1865-4cf3-bbd2-aa7a164ec81d tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:57.388167 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba21f7c5-1865-4cf3-bbd2-aa7a164ec81d tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:57.388637 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba21f7c5-1865-4cf3-bbd2-aa7a164ec81d tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:57.389564 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba21f7c5-1865-4cf3-bbd2-aa7a164ec81d tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:57.390262 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba21f7c5-1865-4cf3-bbd2-aa7a164ec81d tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:57.390699 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba21f7c5-1865-4cf3-bbd2-aa7a164ec81d tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:57.486839 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-8521d642-2834-48ee-ae93-486a9d694e8f tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:14:57.487443 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-8521d642-2834-48ee-ae93-486a9d694e8f tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:14:57.487986 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-8521d642-2834-48ee-ae93-486a9d694e8f tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:14:57.488470 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-8521d642-2834-48ee-ae93-486a9d694e8f tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:14:57.489061 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-8521d642-2834-48ee-ae93-486a9d694e8f tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:14:57.498968 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8521d642-2834-48ee-ae93-486a9d694e8f tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:57.499447 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8521d642-2834-48ee-ae93-486a9d694e8f tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:57.499883 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8521d642-2834-48ee-ae93-486a9d694e8f tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:57.500605 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8521d642-2834-48ee-ae93-486a9d694e8f tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:57.501060 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8521d642-2834-48ee-ae93-486a9d694e8f tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:57.501479 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8521d642-2834-48ee-ae93-486a9d694e8f tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:57.519335 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-8521d642-2834-48ee-ae93-486a9d694e8f tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Getting quotas for project c3730de9c65d4add9f6f34aa7d5aa77e. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:14:57.524421 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-8521d642-2834-48ee-ae93-486a9d694e8f tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Getting quotas for user 937a26d78d07458eaadc68fc9828d738 and project c3730de9c65d4add9f6f34aa7d5aa77e. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:14:57.537563 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8521d642-2834-48ee-ae93-486a9d694e8f tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:14:57.540643 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8521d642-2834-48ee-ae93-486a9d694e8f tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] [instance: df71be7c-a3b2-4d32-bdbd-45eb56a93154] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:14:57.586754 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ba21f7c5-1865-4cf3-bbd2-aa7a164ec81d tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80703c3d1dae419c9fd5ca103f3c28bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356a4b3819db457fb5caf68ded0212fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:57.594710 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ba21f7c5-1865-4cf3-bbd2-aa7a164ec81d tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] 10.222.0.42 "GET /compute/v2.1/servers/e0769a09-da3a-422f-a7a8-27edf4a2e209" status: 200 len: 1468 microversion: 2.1 time: 0.220514 Oct 23 01:14:57.595517 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 565/1208] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:57 2022] GET /compute/v2.1/servers/e0769a09-da3a-422f-a7a8-27edf4a2e209 => generated 1468 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:57.626106 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c9327667-e6fe-4fc6-b913-4519c2b9d571 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1214259692", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "8a917657-28a7-4dca-bda1-2dfd9f81a9de"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:14:57.667694 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8521d642-2834-48ee-ae93-486a9d694e8f tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.761497 Oct 23 01:14:57.668449 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 644/1209] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:14:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:14:57.695201 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5ccf0b5c-42a9-4ab8-90f2-4e43c43c2bd9 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:57.695201 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5ccf0b5c-42a9-4ab8-90f2-4e43c43c2bd9 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 8db307a5-7a1e-4791-8fa9-e934894238e9] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:57.700205 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-c9327667-e6fe-4fc6-b913-4519c2b9d571 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] validate_networks() for None {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:14:57.704689 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5ccf0b5c-42a9-4ab8-90f2-4e43c43c2bd9 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:57.705203 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5ccf0b5c-42a9-4ab8-90f2-4e43c43c2bd9 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:57.706126 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5ccf0b5c-42a9-4ab8-90f2-4e43c43c2bd9 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:57.707256 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5ccf0b5c-42a9-4ab8-90f2-4e43c43c2bd9 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:57.707719 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5ccf0b5c-42a9-4ab8-90f2-4e43c43c2bd9 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:57.708140 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5ccf0b5c-42a9-4ab8-90f2-4e43c43c2bd9 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:58.007526 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5ccf0b5c-42a9-4ab8-90f2-4e43c43c2bd9 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:58.016122 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5ccf0b5c-42a9-4ab8-90f2-4e43c43c2bd9 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:58.017872 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5ccf0b5c-42a9-4ab8-90f2-4e43c43c2bd9 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:58.019056 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5ccf0b5c-42a9-4ab8-90f2-4e43c43c2bd9 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9" status: 200 len: 1568 microversion: 2.25 time: 0.349504 Oct 23 01:14:58.020130 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 645/1210] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:57 2022] GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9 => generated 1568 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:58.025367 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8b8957d7-d5e5-4933-98fd-195c135f8d68 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:58.026178 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8b8957d7-d5e5-4933-98fd-195c135f8d68 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 8025dc46-71af-4fec-8f54-5ae9e92cc31f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:58.032258 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b8957d7-d5e5-4933-98fd-195c135f8d68 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:58.032948 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b8957d7-d5e5-4933-98fd-195c135f8d68 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:58.033524 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b8957d7-d5e5-4933-98fd-195c135f8d68 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:58.034437 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b8957d7-d5e5-4933-98fd-195c135f8d68 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:58.035344 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b8957d7-d5e5-4933-98fd-195c135f8d68 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:58.035953 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b8957d7-d5e5-4933-98fd-195c135f8d68 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:58.064191 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-c9327667-e6fe-4fc6-b913-4519c2b9d571 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:14:58.064641 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-c9327667-e6fe-4fc6-b913-4519c2b9d571 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:14:58.065151 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-c9327667-e6fe-4fc6-b913-4519c2b9d571 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:14:58.065493 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-c9327667-e6fe-4fc6-b913-4519c2b9d571 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:14:58.065909 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-c9327667-e6fe-4fc6-b913-4519c2b9d571 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:14:58.092009 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c9327667-e6fe-4fc6-b913-4519c2b9d571 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:58.092487 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c9327667-e6fe-4fc6-b913-4519c2b9d571 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:58.092927 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c9327667-e6fe-4fc6-b913-4519c2b9d571 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:58.093658 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c9327667-e6fe-4fc6-b913-4519c2b9d571 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:58.094165 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c9327667-e6fe-4fc6-b913-4519c2b9d571 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:58.094594 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c9327667-e6fe-4fc6-b913-4519c2b9d571 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:58.112147 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-c9327667-e6fe-4fc6-b913-4519c2b9d571 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Getting quotas for project 47aadec780734d03a262d4021f48d625. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:14:58.117161 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-c9327667-e6fe-4fc6-b913-4519c2b9d571 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Getting quotas for user 519c893a1e094200b882cf23db7cae54 and project 47aadec780734d03a262d4021f48d625. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:14:58.130183 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c9327667-e6fe-4fc6-b913-4519c2b9d571 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Going to run 2 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:14:58.132510 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c9327667-e6fe-4fc6-b913-4519c2b9d571 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: f3aa4181-fc02-43dc-95df-ae1a730fbdca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:14:58.226930 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-c9327667-e6fe-4fc6-b913-4519c2b9d571 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=120944) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 23 01:14:58.250855 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8b8957d7-d5e5-4933-98fd-195c135f8d68 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:58.262196 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8b8957d7-d5e5-4933-98fd-195c135f8d68 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f" status: 200 len: 1536 microversion: 2.1 time: 0.240829 Oct 23 01:14:58.263641 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 646/1211] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:58 2022] GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f => generated 1536 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:58.274876 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-c9327667-e6fe-4fc6-b913-4519c2b9d571 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Getting quotas for project 47aadec780734d03a262d4021f48d625. Resources: {'server_group_members'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:14:58.286619 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-c9327667-e6fe-4fc6-b913-4519c2b9d571 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Getting quotas for user 519c893a1e094200b882cf23db7cae54 and project 47aadec780734d03a262d4021f48d625. Resources: {'server_group_members'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:14:58.292044 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f73570fb-9c43-487e-80ca-d092fbfe4a93 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:58.292683 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f73570fb-9c43-487e-80ca-d092fbfe4a93 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 59cf7af1-8bca-4768-ac86-6e56d0649946] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:58.301078 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f73570fb-9c43-487e-80ca-d092fbfe4a93 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:58.301579 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f73570fb-9c43-487e-80ca-d092fbfe4a93 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:58.302319 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f73570fb-9c43-487e-80ca-d092fbfe4a93 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:58.303238 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f73570fb-9c43-487e-80ca-d092fbfe4a93 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:58.304853 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f73570fb-9c43-487e-80ca-d092fbfe4a93 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:58.305457 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f73570fb-9c43-487e-80ca-d092fbfe4a93 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:58.466423 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f73570fb-9c43-487e-80ca-d092fbfe4a93 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262d5984b8c4775b86fae1c0d314718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc8f8cefbf441c98d6bda76e99e3173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:58.473359 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-c9327667-e6fe-4fc6-b913-4519c2b9d571 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Getting quotas for project 47aadec780734d03a262d4021f48d625. Resources: {'server_group_members'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:14:58.474764 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f73570fb-9c43-487e-80ca-d092fbfe4a93 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946" status: 200 len: 1334 microversion: 2.1 time: 0.209726 Oct 23 01:14:58.476237 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 647/1212] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:58 2022] GET /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946 => generated 1334 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:58.486410 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-c9327667-e6fe-4fc6-b913-4519c2b9d571 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Getting quotas for user 519c893a1e094200b882cf23db7cae54 and project 47aadec780734d03a262d4021f48d625. Resources: {'server_group_members'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:14:58.497795 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-aca2202e-ca72-435c-aadd-14e88eec69b6 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:58.498754 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-aca2202e-ca72-435c-aadd-14e88eec69b6 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] [instance: df71be7c-a3b2-4d32-bdbd-45eb56a93154] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:58.503535 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c9327667-e6fe-4fc6-b913-4519c2b9d571 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 808c58c6-1606-4553-8dd3-8292fa1202b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=f3aa4181-fc02-43dc-95df-ae1a730fbdca,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:14:58.570688 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-aca2202e-ca72-435c-aadd-14e88eec69b6 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937a26d78d07458eaadc68fc9828d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3730de9c65d4add9f6f34aa7d5aa77e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:58.580426 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-aca2202e-ca72-435c-aadd-14e88eec69b6 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] 10.222.0.42 "GET /compute/v2.1/servers/df71be7c-a3b2-4d32-bdbd-45eb56a93154" status: 200 len: 1213 microversion: 2.1 time: 0.088411 Oct 23 01:14:58.581292 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 648/1213] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:58 2022] GET /compute/v2.1/servers/df71be7c-a3b2-4d32-bdbd-45eb56a93154 => generated 1213 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:58.602846 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5806b4ae-b2f6-4b05-a331-dd0e97c1a5e4 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:58.603851 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5806b4ae-b2f6-4b05-a331-dd0e97c1a5e4 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:58.610339 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5806b4ae-b2f6-4b05-a331-dd0e97c1a5e4 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:58.610947 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5806b4ae-b2f6-4b05-a331-dd0e97c1a5e4 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:58.611482 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5806b4ae-b2f6-4b05-a331-dd0e97c1a5e4 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:58.612313 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5806b4ae-b2f6-4b05-a331-dd0e97c1a5e4 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:58.612879 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5806b4ae-b2f6-4b05-a331-dd0e97c1a5e4 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:58.613535 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5806b4ae-b2f6-4b05-a331-dd0e97c1a5e4 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:58.721601 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-c9327667-e6fe-4fc6-b913-4519c2b9d571 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Getting quotas for project 47aadec780734d03a262d4021f48d625. Resources: {'server_group_members'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:14:58.724110 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=3,nova_api:INSERT=7 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:58.728634 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-c9327667-e6fe-4fc6-b913-4519c2b9d571 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Getting quotas for user 519c893a1e094200b882cf23db7cae54 and project 47aadec780734d03a262d4021f48d625. Resources: {'server_group_members'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:14:58.762270 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5806b4ae-b2f6-4b05-a331-dd0e97c1a5e4 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:58.770864 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5806b4ae-b2f6-4b05-a331-dd0e97c1a5e4 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 200 len: 1717 microversion: 2.1 time: 0.175322 Oct 23 01:14:58.771444 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 649/1214] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:58 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 1717 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:58.776694 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7b3939dc-bd18-43ce-b037-d32a35a77af3 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-960427003", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:14:58.856327 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-c9327667-e6fe-4fc6-b913-4519c2b9d571 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Getting quotas for project 47aadec780734d03a262d4021f48d625. Resources: {'server_group_members'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:14:58.861370 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-7b3939dc-bd18-43ce-b037-d32a35a77af3 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] validate_networks() for None {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:14:58.863532 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-c9327667-e6fe-4fc6-b913-4519c2b9d571 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Getting quotas for user 519c893a1e094200b882cf23db7cae54 and project 47aadec780734d03a262d4021f48d625. Resources: {'server_group_members'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:14:58.910208 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c9327667-e6fe-4fc6-b913-4519c2b9d571 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.303019 Oct 23 01:14:58.910992 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 566/1215] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:14:57 2022] POST /compute/v2.1/servers => generated 32 bytes in 1315 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 23 01:14:58.915897 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-e18a94aa-00ad-4c5a-8bc8-d75b8c6d8e21 req-ad273ecf-a2b8-41b7-9607-0c0b0077c02a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8db307a5-7a1e-4791-8fa9-e934894238e9", "tag": "7328ae33-f6ec-49e1-9744-c0a7a6f75e28"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:14:58.932489 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-e18a94aa-00ad-4c5a-8bc8-d75b8c6d8e21 req-ad273ecf-a2b8-41b7-9607-0c0b0077c02a service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:58.932980 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-e18a94aa-00ad-4c5a-8bc8-d75b8c6d8e21 req-ad273ecf-a2b8-41b7-9607-0c0b0077c02a service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:58.933413 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-e18a94aa-00ad-4c5a-8bc8-d75b8c6d8e21 req-ad273ecf-a2b8-41b7-9607-0c0b0077c02a service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:58.951255 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-e18a94aa-00ad-4c5a-8bc8-d75b8c6d8e21 req-ad273ecf-a2b8-41b7-9607-0c0b0077c02a service nova] Creating event network-changed:7328ae33-f6ec-49e1-9744-c0a7a6f75e28 for instance 8db307a5-7a1e-4791-8fa9-e934894238e9 on n-h2-master-1 Oct 23 01:14:58.956250 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-e18a94aa-00ad-4c5a-8bc8-d75b8c6d8e21 req-ad273ecf-a2b8-41b7-9607-0c0b0077c02a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044285 Oct 23 01:14:58.957363 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 567/1216] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:14:58.962660 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-a9880b75-207d-40a5-95d7-2b098f03736e req-4e4e6c97-a983-4b9b-a2a7-0c5f15b921c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59cf7af1-8bca-4768-ac86-6e56d0649946", "name": "network-vif-plugged", "status": "completed", "tag": "0012d07c-1c5a-452e-8f4f-f3931c55a841"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:14:58.972223 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-a9880b75-207d-40a5-95d7-2b098f03736e req-4e4e6c97-a983-4b9b-a2a7-0c5f15b921c0 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:58.972702 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-a9880b75-207d-40a5-95d7-2b098f03736e req-4e4e6c97-a983-4b9b-a2a7-0c5f15b921c0 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:58.973323 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-a9880b75-207d-40a5-95d7-2b098f03736e req-4e4e6c97-a983-4b9b-a2a7-0c5f15b921c0 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:58.985115 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-a9880b75-207d-40a5-95d7-2b098f03736e req-4e4e6c97-a983-4b9b-a2a7-0c5f15b921c0 service nova] Creating event network-vif-plugged:0012d07c-1c5a-452e-8f4f-f3931c55a841 for instance 59cf7af1-8bca-4768-ac86-6e56d0649946 on n-h1-master-1 Oct 23 01:14:58.990465 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-a9880b75-207d-40a5-95d7-2b098f03736e req-4e4e6c97-a983-4b9b-a2a7-0c5f15b921c0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031595 Oct 23 01:14:58.991047 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 568/1217] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:14:59.001034 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5b9e2a8c-2a35-45e9-beaa-699bbef22e1f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:59.005717 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5b9e2a8c-2a35-45e9-beaa-699bbef22e1f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:59.006506 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5b9e2a8c-2a35-45e9-beaa-699bbef22e1f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Searching by: {'deleted': False, 'project_id': '47aadec780734d03a262d4021f48d625'} {{(pid=120944) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 23 01:14:59.024147 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b9e2a8c-2a35-45e9-beaa-699bbef22e1f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:59.024633 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b9e2a8c-2a35-45e9-beaa-699bbef22e1f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:59.025085 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b9e2a8c-2a35-45e9-beaa-699bbef22e1f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:59.025841 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b9e2a8c-2a35-45e9-beaa-699bbef22e1f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:59.026327 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b9e2a8c-2a35-45e9-beaa-699bbef22e1f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:59.026747 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b9e2a8c-2a35-45e9-beaa-699bbef22e1f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:59.165745 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.multi_cell_list [None req-5b9e2a8c-2a35-45e9-beaa-699bbef22e1f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=120944) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 23 01:14:59.287415 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5b9e2a8c-2a35-45e9-beaa-699bbef22e1f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.291728 Oct 23 01:14:59.288126 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 569/1218] 10.222.0.42 () {58 vars in 1125 bytes} [Sun Oct 23 01:14:58 2022] GET /compute/v2.1/servers => generated 1003 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:59.303120 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5559bbd2-b34e-4890-b5c0-3dd60647e2f0 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:59.304709 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5559bbd2-b34e-4890-b5c0-3dd60647e2f0 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 8db307a5-7a1e-4791-8fa9-e934894238e9] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:59.309229 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-7b3939dc-bd18-43ce-b037-d32a35a77af3 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:14:59.309660 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-7b3939dc-bd18-43ce-b037-d32a35a77af3 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:14:59.310171 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-7b3939dc-bd18-43ce-b037-d32a35a77af3 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:14:59.310652 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-7b3939dc-bd18-43ce-b037-d32a35a77af3 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:14:59.311077 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-7b3939dc-bd18-43ce-b037-d32a35a77af3 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:14:59.313531 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5559bbd2-b34e-4890-b5c0-3dd60647e2f0 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:59.314050 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5559bbd2-b34e-4890-b5c0-3dd60647e2f0 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:59.315022 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5559bbd2-b34e-4890-b5c0-3dd60647e2f0 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:59.315945 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5559bbd2-b34e-4890-b5c0-3dd60647e2f0 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:59.317944 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5559bbd2-b34e-4890-b5c0-3dd60647e2f0 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:59.318958 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5559bbd2-b34e-4890-b5c0-3dd60647e2f0 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:59.328205 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b3939dc-bd18-43ce-b037-d32a35a77af3 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:59.328750 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b3939dc-bd18-43ce-b037-d32a35a77af3 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:59.329183 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b3939dc-bd18-43ce-b037-d32a35a77af3 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:59.332263 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b3939dc-bd18-43ce-b037-d32a35a77af3 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:59.332749 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b3939dc-bd18-43ce-b037-d32a35a77af3 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:59.333310 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b3939dc-bd18-43ce-b037-d32a35a77af3 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:59.374291 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-7b3939dc-bd18-43ce-b037-d32a35a77af3 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Getting quotas for project 356a4b3819db457fb5caf68ded0212fa. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:14:59.380332 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-7b3939dc-bd18-43ce-b037-d32a35a77af3 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Getting quotas for user 80703c3d1dae419c9fd5ca103f3c28bf and project 356a4b3819db457fb5caf68ded0212fa. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:14:59.395602 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7b3939dc-bd18-43ce-b037-d32a35a77af3 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:14:59.398300 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7b3939dc-bd18-43ce-b037-d32a35a77af3 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] [instance: de212c9c-e0e0-471f-8a01-5d180ac28d07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:14:59.580293 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5559bbd2-b34e-4890-b5c0-3dd60647e2f0 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:59.593185 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5559bbd2-b34e-4890-b5c0-3dd60647e2f0 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:59.599446 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5559bbd2-b34e-4890-b5c0-3dd60647e2f0 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:59.602945 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5559bbd2-b34e-4890-b5c0-3dd60647e2f0 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9" status: 200 len: 1568 microversion: 2.25 time: 0.307509 Oct 23 01:14:59.606024 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 570/1219] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:14:59 2022] GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9 => generated 1568 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:14:59.630380 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7b3939dc-bd18-43ce-b037-d32a35a77af3 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.853768 Oct 23 01:14:59.634117 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2006aded-15c5-4457-a5a0-80691eae623f tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:59.635472 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 650/1220] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:14:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 863 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:14:59.641334 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2006aded-15c5-4457-a5a0-80691eae623f tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 8025dc46-71af-4fec-8f54-5ae9e92cc31f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:59.648166 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e5530c98-90fc-40d7-a304-6068b49ebae7 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:59.650605 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e5530c98-90fc-40d7-a304-6068b49ebae7 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 808c58c6-1606-4553-8dd3-8292fa1202b5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:59.655777 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2006aded-15c5-4457-a5a0-80691eae623f tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:59.656578 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2006aded-15c5-4457-a5a0-80691eae623f tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:59.659447 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2006aded-15c5-4457-a5a0-80691eae623f tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:59.660122 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2006aded-15c5-4457-a5a0-80691eae623f tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:59.661895 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2006aded-15c5-4457-a5a0-80691eae623f tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:59.662612 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2006aded-15c5-4457-a5a0-80691eae623f tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:59.836008 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e5530c98-90fc-40d7-a304-6068b49ebae7 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:14:59.847836 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e5530c98-90fc-40d7-a304-6068b49ebae7 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/808c58c6-1606-4553-8dd3-8292fa1202b5" status: 200 len: 1219 microversion: 2.1 time: 0.211153 Oct 23 01:14:59.848697 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 651/1221] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:59 2022] GET /compute/v2.1/servers/808c58c6-1606-4553-8dd3-8292fa1202b5 => generated 1219 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:14:59.855050 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d8f032a3-1e4a-4288-b347-79655ef642af tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:14:59.856028 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d8f032a3-1e4a-4288-b347-79655ef642af tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 59cf7af1-8bca-4768-ac86-6e56d0649946] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:14:59.862840 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d8f032a3-1e4a-4288-b347-79655ef642af tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:59.863686 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d8f032a3-1e4a-4288-b347-79655ef642af tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:59.864337 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d8f032a3-1e4a-4288-b347-79655ef642af tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:14:59.865328 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d8f032a3-1e4a-4288-b347-79655ef642af tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:14:59.865883 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d8f032a3-1e4a-4288-b347-79655ef642af tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:14:59.866477 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d8f032a3-1e4a-4288-b347-79655ef642af tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:00.146039 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2006aded-15c5-4457-a5a0-80691eae623f tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:00.153950 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2006aded-15c5-4457-a5a0-80691eae623f tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f" status: 200 len: 1536 microversion: 2.1 time: 0.527913 Oct 23 01:15:00.158594 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 571/1222] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:59 2022] GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f => generated 1536 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:00.180428 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4a5f1cbb-dfd2-49f2-80f4-46f5711906f9 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:00.181740 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4a5f1cbb-dfd2-49f2-80f4-46f5711906f9 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] [instance: df71be7c-a3b2-4d32-bdbd-45eb56a93154] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:00.187859 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4a5f1cbb-dfd2-49f2-80f4-46f5711906f9 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:00.188655 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4a5f1cbb-dfd2-49f2-80f4-46f5711906f9 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:00.189323 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4a5f1cbb-dfd2-49f2-80f4-46f5711906f9 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:00.190347 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4a5f1cbb-dfd2-49f2-80f4-46f5711906f9 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:00.191014 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4a5f1cbb-dfd2-49f2-80f4-46f5711906f9 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:00.191647 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4a5f1cbb-dfd2-49f2-80f4-46f5711906f9 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:00.268718 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d8f032a3-1e4a-4288-b347-79655ef642af tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262d5984b8c4775b86fae1c0d314718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc8f8cefbf441c98d6bda76e99e3173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:00.284202 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d8f032a3-1e4a-4288-b347-79655ef642af tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946" status: 200 len: 1334 microversion: 2.1 time: 0.433416 Oct 23 01:15:00.285284 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 652/1223] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:14:59 2022] GET /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946 => generated 1334 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:00.304784 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3b240f42-3371-4144-ba28-424db90fe42e tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:00.305417 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3b240f42-3371-4144-ba28-424db90fe42e tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] [instance: de212c9c-e0e0-471f-8a01-5d180ac28d07] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:00.319200 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4a5f1cbb-dfd2-49f2-80f4-46f5711906f9 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937a26d78d07458eaadc68fc9828d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3730de9c65d4add9f6f34aa7d5aa77e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:00.328898 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4a5f1cbb-dfd2-49f2-80f4-46f5711906f9 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] 10.222.0.42 "GET /compute/v2.1/servers/df71be7c-a3b2-4d32-bdbd-45eb56a93154" status: 200 len: 1209 microversion: 2.1 time: 0.153351 Oct 23 01:15:00.329895 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 572/1224] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:00 2022] GET /compute/v2.1/servers/df71be7c-a3b2-4d32-bdbd-45eb56a93154 => generated 1209 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:00.336691 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-237b70ab-5cfc-4d24-b5e0-63380f299d3d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:00.338886 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-237b70ab-5cfc-4d24-b5e0-63380f299d3d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:00.360943 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-237b70ab-5cfc-4d24-b5e0-63380f299d3d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:00.361641 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-237b70ab-5cfc-4d24-b5e0-63380f299d3d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:00.362853 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-237b70ab-5cfc-4d24-b5e0-63380f299d3d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:00.363740 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-237b70ab-5cfc-4d24-b5e0-63380f299d3d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:00.365280 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-237b70ab-5cfc-4d24-b5e0-63380f299d3d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:00.366907 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-237b70ab-5cfc-4d24-b5e0-63380f299d3d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:00.741214 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3b240f42-3371-4144-ba28-424db90fe42e tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80703c3d1dae419c9fd5ca103f3c28bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356a4b3819db457fb5caf68ded0212fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:00.750689 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3b240f42-3371-4144-ba28-424db90fe42e tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] 10.222.0.42 "GET /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07" status: 200 len: 1218 microversion: 2.1 time: 0.462785 Oct 23 01:15:00.762023 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 653/1225] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:00 2022] GET /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07 => generated 1218 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:00.771039 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3f18b09b-4db6-49c7-94e6-9f8e0bc29c91 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:00.771039 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3f18b09b-4db6-49c7-94e6-9f8e0bc29c91 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 8db307a5-7a1e-4791-8fa9-e934894238e9] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:00.778505 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3f18b09b-4db6-49c7-94e6-9f8e0bc29c91 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:00.779035 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3f18b09b-4db6-49c7-94e6-9f8e0bc29c91 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:00.779480 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3f18b09b-4db6-49c7-94e6-9f8e0bc29c91 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:00.783423 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3f18b09b-4db6-49c7-94e6-9f8e0bc29c91 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:00.783935 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3f18b09b-4db6-49c7-94e6-9f8e0bc29c91 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:00.784372 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3f18b09b-4db6-49c7-94e6-9f8e0bc29c91 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:00.892091 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-237b70ab-5cfc-4d24-b5e0-63380f299d3d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:00.955597 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-237b70ab-5cfc-4d24-b5e0-63380f299d3d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 200 len: 1717 microversion: 2.1 time: 0.624214 Oct 23 01:15:00.956779 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 573/1226] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:00 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 1717 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:00.981425 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-214f0153-f449-4b7c-8fdc-0130e700c028 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:00.983714 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-214f0153-f449-4b7c-8fdc-0130e700c028 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 808c58c6-1606-4553-8dd3-8292fa1202b5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:01.080074 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3f18b09b-4db6-49c7-94e6-9f8e0bc29c91 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:01.094868 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3f18b09b-4db6-49c7-94e6-9f8e0bc29c91 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:01.097705 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3f18b09b-4db6-49c7-94e6-9f8e0bc29c91 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:01.100672 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3f18b09b-4db6-49c7-94e6-9f8e0bc29c91 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9" status: 200 len: 1568 microversion: 2.25 time: 0.342616 Oct 23 01:15:01.111802 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 654/1227] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:15:00 2022] GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9 => generated 1568 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:15:01.161081 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-783d0f23-ec90-4cd9-a1d4-306bd71553a0 req-8ea168f5-57ab-4768-8434-2e2f9e337dd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59cf7af1-8bca-4768-ac86-6e56d0649946", "name": "network-vif-plugged", "status": "completed", "tag": "1af179f1-7395-4c6c-857c-f6bcc55abbbb"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:15:01.182527 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-214f0153-f449-4b7c-8fdc-0130e700c028 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:01.194136 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-214f0153-f449-4b7c-8fdc-0130e700c028 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/808c58c6-1606-4553-8dd3-8292fa1202b5" status: 200 len: 1219 microversion: 2.1 time: 0.236054 Oct 23 01:15:01.199539 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-783d0f23-ec90-4cd9-a1d4-306bd71553a0 req-8ea168f5-57ab-4768-8434-2e2f9e337dd8 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:01.200563 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 574/1228] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:00 2022] GET /compute/v2.1/servers/808c58c6-1606-4553-8dd3-8292fa1202b5 => generated 1219 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:01.207164 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-783d0f23-ec90-4cd9-a1d4-306bd71553a0 req-8ea168f5-57ab-4768-8434-2e2f9e337dd8 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:01.207685 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-783d0f23-ec90-4cd9-a1d4-306bd71553a0 req-8ea168f5-57ab-4768-8434-2e2f9e337dd8 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:01.214361 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=100 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:15:01.218722 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c14dc3ff-716c-4693-bf32-687c8df9ae87 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:01.219580 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c14dc3ff-716c-4693-bf32-687c8df9ae87 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 8025dc46-71af-4fec-8f54-5ae9e92cc31f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:01.231211 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c14dc3ff-716c-4693-bf32-687c8df9ae87 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:01.238259 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c14dc3ff-716c-4693-bf32-687c8df9ae87 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:01.238259 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c14dc3ff-716c-4693-bf32-687c8df9ae87 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:01.238259 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c14dc3ff-716c-4693-bf32-687c8df9ae87 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:01.238259 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c14dc3ff-716c-4693-bf32-687c8df9ae87 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:01.238774 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c14dc3ff-716c-4693-bf32-687c8df9ae87 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:01.245893 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-783d0f23-ec90-4cd9-a1d4-306bd71553a0 req-8ea168f5-57ab-4768-8434-2e2f9e337dd8 service nova] Creating event network-vif-plugged:1af179f1-7395-4c6c-857c-f6bcc55abbbb for instance 59cf7af1-8bca-4768-ac86-6e56d0649946 on n-h1-master-1 Oct 23 01:15:01.253361 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-783d0f23-ec90-4cd9-a1d4-306bd71553a0 req-8ea168f5-57ab-4768-8434-2e2f9e337dd8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104939 Oct 23 01:15:01.256664 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 655/1229] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:15:01.313254 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ec41420f-783a-4168-9901-fa28150f500f tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:01.314565 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ec41420f-783a-4168-9901-fa28150f500f tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 59cf7af1-8bca-4768-ac86-6e56d0649946] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:01.326770 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec41420f-783a-4168-9901-fa28150f500f tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:01.327850 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec41420f-783a-4168-9901-fa28150f500f tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:01.328524 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec41420f-783a-4168-9901-fa28150f500f tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:01.329559 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec41420f-783a-4168-9901-fa28150f500f tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:01.330307 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec41420f-783a-4168-9901-fa28150f500f tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:01.330929 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec41420f-783a-4168-9901-fa28150f500f tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:01.658238 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c14dc3ff-716c-4693-bf32-687c8df9ae87 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:01.669419 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c14dc3ff-716c-4693-bf32-687c8df9ae87 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f" status: 200 len: 1536 microversion: 2.1 time: 0.467410 Oct 23 01:15:01.691975 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 575/1230] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:01 2022] GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f => generated 1536 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:01.703533 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b427138a-030f-4b20-8e70-8da8e4019083 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:01.704394 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b427138a-030f-4b20-8e70-8da8e4019083 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] [instance: df71be7c-a3b2-4d32-bdbd-45eb56a93154] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:01.719924 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b427138a-030f-4b20-8e70-8da8e4019083 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:01.722047 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b427138a-030f-4b20-8e70-8da8e4019083 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:01.722047 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b427138a-030f-4b20-8e70-8da8e4019083 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:01.724799 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b427138a-030f-4b20-8e70-8da8e4019083 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:01.725608 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b427138a-030f-4b20-8e70-8da8e4019083 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:01.727301 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b427138a-030f-4b20-8e70-8da8e4019083 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:01.830201 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ec41420f-783a-4168-9901-fa28150f500f tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262d5984b8c4775b86fae1c0d314718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc8f8cefbf441c98d6bda76e99e3173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:01.839005 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ec41420f-783a-4168-9901-fa28150f500f tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946" status: 200 len: 1334 microversion: 2.1 time: 0.531056 Oct 23 01:15:01.839591 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 656/1231] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:01 2022] GET /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946 => generated 1334 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:15:01.844242 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-10516983-0e1e-4df0-a103-b11fe4448ccd tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:01.851698 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-10516983-0e1e-4df0-a103-b11fe4448ccd tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] [instance: de212c9c-e0e0-471f-8a01-5d180ac28d07] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:01.859537 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10516983-0e1e-4df0-a103-b11fe4448ccd tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:01.860488 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10516983-0e1e-4df0-a103-b11fe4448ccd tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:01.861079 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10516983-0e1e-4df0-a103-b11fe4448ccd tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:01.862012 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10516983-0e1e-4df0-a103-b11fe4448ccd tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:01.871431 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10516983-0e1e-4df0-a103-b11fe4448ccd tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:01.871431 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10516983-0e1e-4df0-a103-b11fe4448ccd tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:01.871731 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b427138a-030f-4b20-8e70-8da8e4019083 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937a26d78d07458eaadc68fc9828d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3730de9c65d4add9f6f34aa7d5aa77e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:01.885858 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b427138a-030f-4b20-8e70-8da8e4019083 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] 10.222.0.42 "GET /compute/v2.1/servers/df71be7c-a3b2-4d32-bdbd-45eb56a93154" status: 200 len: 1265 microversion: 2.1 time: 0.192312 Oct 23 01:15:01.887150 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 576/1232] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:01 2022] GET /compute/v2.1/servers/df71be7c-a3b2-4d32-bdbd-45eb56a93154 => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:01.955813 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-10516983-0e1e-4df0-a103-b11fe4448ccd tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80703c3d1dae419c9fd5ca103f3c28bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356a4b3819db457fb5caf68ded0212fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:01.963894 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-10516983-0e1e-4df0-a103-b11fe4448ccd tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] 10.222.0.42 "GET /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07" status: 200 len: 1214 microversion: 2.1 time: 0.123133 Oct 23 01:15:01.964482 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 657/1233] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:01 2022] GET /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07 => generated 1214 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:01.995981 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-995a6b8a-1eba-48e9-bd7b-cf320a8e60f2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:01.999342 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-995a6b8a-1eba-48e9-bd7b-cf320a8e60f2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:02.011998 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-995a6b8a-1eba-48e9-bd7b-cf320a8e60f2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:02.012813 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-995a6b8a-1eba-48e9-bd7b-cf320a8e60f2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:02.013516 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-995a6b8a-1eba-48e9-bd7b-cf320a8e60f2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:02.015272 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-995a6b8a-1eba-48e9-bd7b-cf320a8e60f2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:02.016453 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-995a6b8a-1eba-48e9-bd7b-cf320a8e60f2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:02.017611 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-995a6b8a-1eba-48e9-bd7b-cf320a8e60f2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:02.143763 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8c056e26-6b79-48d2-b92b-7833ad89fdad tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:02.145210 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8c056e26-6b79-48d2-b92b-7833ad89fdad tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 8db307a5-7a1e-4791-8fa9-e934894238e9] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:02.152066 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8c056e26-6b79-48d2-b92b-7833ad89fdad tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:02.154491 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8c056e26-6b79-48d2-b92b-7833ad89fdad tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:02.154491 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8c056e26-6b79-48d2-b92b-7833ad89fdad tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:02.154491 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8c056e26-6b79-48d2-b92b-7833ad89fdad tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:02.155137 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8c056e26-6b79-48d2-b92b-7833ad89fdad tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:02.155719 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8c056e26-6b79-48d2-b92b-7833ad89fdad tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:02.347631 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-995a6b8a-1eba-48e9-bd7b-cf320a8e60f2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:02.356325 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-995a6b8a-1eba-48e9-bd7b-cf320a8e60f2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 200 len: 1717 microversion: 2.1 time: 0.371003 Oct 23 01:15:02.371599 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 577/1234] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:01 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 1717 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:02.378626 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-58f4a693-0acc-4ed5-b0f7-8983b71c5422 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:02.379655 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-58f4a693-0acc-4ed5-b0f7-8983b71c5422 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 808c58c6-1606-4553-8dd3-8292fa1202b5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:02.389777 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-58f4a693-0acc-4ed5-b0f7-8983b71c5422 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:02.390342 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-58f4a693-0acc-4ed5-b0f7-8983b71c5422 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:02.390781 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-58f4a693-0acc-4ed5-b0f7-8983b71c5422 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:02.392154 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-58f4a693-0acc-4ed5-b0f7-8983b71c5422 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:02.392732 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-58f4a693-0acc-4ed5-b0f7-8983b71c5422 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:02.393802 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-58f4a693-0acc-4ed5-b0f7-8983b71c5422 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:02.471834 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8c056e26-6b79-48d2-b92b-7833ad89fdad tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:02.495697 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8c056e26-6b79-48d2-b92b-7833ad89fdad tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:02.499050 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8c056e26-6b79-48d2-b92b-7833ad89fdad tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:02.500549 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8c056e26-6b79-48d2-b92b-7833ad89fdad tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9" status: 200 len: 1568 microversion: 2.25 time: 0.360807 Oct 23 01:15:02.501658 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 658/1235] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:15:02 2022] GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9 => generated 1568 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:15:02.522421 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-58f4a693-0acc-4ed5-b0f7-8983b71c5422 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:02.536022 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-58f4a693-0acc-4ed5-b0f7-8983b71c5422 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/808c58c6-1606-4553-8dd3-8292fa1202b5" status: 200 len: 1215 microversion: 2.1 time: 0.162656 Oct 23 01:15:02.537551 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 578/1236] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:02 2022] GET /compute/v2.1/servers/808c58c6-1606-4553-8dd3-8292fa1202b5 => generated 1215 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:02.700439 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-94b27267-9495-4038-9e3a-e05bc1c1c022 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:02.703422 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-94b27267-9495-4038-9e3a-e05bc1c1c022 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 8025dc46-71af-4fec-8f54-5ae9e92cc31f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:02.716526 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94b27267-9495-4038-9e3a-e05bc1c1c022 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:02.717875 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94b27267-9495-4038-9e3a-e05bc1c1c022 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:02.718522 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94b27267-9495-4038-9e3a-e05bc1c1c022 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:02.720287 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94b27267-9495-4038-9e3a-e05bc1c1c022 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:02.720935 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94b27267-9495-4038-9e3a-e05bc1c1c022 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:02.721950 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94b27267-9495-4038-9e3a-e05bc1c1c022 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:02.864249 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a918582a-5ea8-478d-8309-880eaaee10fb tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:02.864964 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a918582a-5ea8-478d-8309-880eaaee10fb tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 59cf7af1-8bca-4768-ac86-6e56d0649946] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:02.880584 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a918582a-5ea8-478d-8309-880eaaee10fb tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:02.881178 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a918582a-5ea8-478d-8309-880eaaee10fb tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:02.881647 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a918582a-5ea8-478d-8309-880eaaee10fb tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:02.884398 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a918582a-5ea8-478d-8309-880eaaee10fb tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:02.886465 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a918582a-5ea8-478d-8309-880eaaee10fb tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:02.886465 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a918582a-5ea8-478d-8309-880eaaee10fb tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:02.927218 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-94b27267-9495-4038-9e3a-e05bc1c1c022 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:02.935950 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-94b27267-9495-4038-9e3a-e05bc1c1c022 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f" status: 200 len: 1536 microversion: 2.1 time: 0.239968 Oct 23 01:15:02.936731 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 659/1237] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:02 2022] GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f => generated 1536 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:02.944715 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5c1c1a3c-a348-4eb1-a599-3300e98de8af tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:02.945635 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5c1c1a3c-a348-4eb1-a599-3300e98de8af tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] [instance: df71be7c-a3b2-4d32-bdbd-45eb56a93154] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:02.954975 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5c1c1a3c-a348-4eb1-a599-3300e98de8af tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:02.955573 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5c1c1a3c-a348-4eb1-a599-3300e98de8af tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:02.956090 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5c1c1a3c-a348-4eb1-a599-3300e98de8af tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:02.956860 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5c1c1a3c-a348-4eb1-a599-3300e98de8af tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:02.958018 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5c1c1a3c-a348-4eb1-a599-3300e98de8af tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:02.960557 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5c1c1a3c-a348-4eb1-a599-3300e98de8af tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:03.064153 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5c1c1a3c-a348-4eb1-a599-3300e98de8af tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937a26d78d07458eaadc68fc9828d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3730de9c65d4add9f6f34aa7d5aa77e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:03.076966 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5c1c1a3c-a348-4eb1-a599-3300e98de8af tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] 10.222.0.42 "GET /compute/v2.1/servers/df71be7c-a3b2-4d32-bdbd-45eb56a93154" status: 200 len: 1265 microversion: 2.1 time: 0.138375 Oct 23 01:15:03.076966 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 660/1238] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:02 2022] GET /compute/v2.1/servers/df71be7c-a3b2-4d32-bdbd-45eb56a93154 => generated 1265 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:03.082114 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-35070742-83e4-4a95-8626-ddd0683bd1e5 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:03.082924 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-35070742-83e4-4a95-8626-ddd0683bd1e5 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] [instance: de212c9c-e0e0-471f-8a01-5d180ac28d07] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:03.087292 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a918582a-5ea8-478d-8309-880eaaee10fb tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262d5984b8c4775b86fae1c0d314718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc8f8cefbf441c98d6bda76e99e3173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:03.090599 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-35070742-83e4-4a95-8626-ddd0683bd1e5 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:03.091236 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-35070742-83e4-4a95-8626-ddd0683bd1e5 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:03.091956 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-35070742-83e4-4a95-8626-ddd0683bd1e5 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:03.092829 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-35070742-83e4-4a95-8626-ddd0683bd1e5 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:03.093438 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-35070742-83e4-4a95-8626-ddd0683bd1e5 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:03.094031 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-35070742-83e4-4a95-8626-ddd0683bd1e5 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:03.098215 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a918582a-5ea8-478d-8309-880eaaee10fb tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946" status: 200 len: 1334 microversion: 2.1 time: 0.237781 Oct 23 01:15:03.099186 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 579/1239] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:02 2022] GET /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946 => generated 1334 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:15:03.162714 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-35070742-83e4-4a95-8626-ddd0683bd1e5 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80703c3d1dae419c9fd5ca103f3c28bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356a4b3819db457fb5caf68ded0212fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:03.192890 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-35070742-83e4-4a95-8626-ddd0683bd1e5 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] 10.222.0.42 "GET /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07" status: 200 len: 1214 microversion: 2.1 time: 0.114918 Oct 23 01:15:03.199318 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 661/1240] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:03 2022] GET /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07 => generated 1214 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:03.382798 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d2e82062-b528-4162-ae98-21988ffbdd6c tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:03.384077 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d2e82062-b528-4162-ae98-21988ffbdd6c tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:03.391336 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d2e82062-b528-4162-ae98-21988ffbdd6c tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:03.392330 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d2e82062-b528-4162-ae98-21988ffbdd6c tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:03.393049 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d2e82062-b528-4162-ae98-21988ffbdd6c tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:03.394007 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d2e82062-b528-4162-ae98-21988ffbdd6c tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:03.395054 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d2e82062-b528-4162-ae98-21988ffbdd6c tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:03.396020 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d2e82062-b528-4162-ae98-21988ffbdd6c tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:03.527370 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bdaf785d-8325-42a4-8f19-cd8639e14c1e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:03.528146 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-bdaf785d-8325-42a4-8f19-cd8639e14c1e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 8db307a5-7a1e-4791-8fa9-e934894238e9] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:03.535355 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bdaf785d-8325-42a4-8f19-cd8639e14c1e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:03.535940 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bdaf785d-8325-42a4-8f19-cd8639e14c1e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:03.536773 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bdaf785d-8325-42a4-8f19-cd8639e14c1e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:03.537777 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bdaf785d-8325-42a4-8f19-cd8639e14c1e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:03.538531 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bdaf785d-8325-42a4-8f19-cd8639e14c1e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:03.539148 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bdaf785d-8325-42a4-8f19-cd8639e14c1e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:03.809338 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d2e82062-b528-4162-ae98-21988ffbdd6c tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:03.817626 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d2e82062-b528-4162-ae98-21988ffbdd6c tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 200 len: 1717 microversion: 2.1 time: 0.441326 Oct 23 01:15:03.818236 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 580/1241] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:03 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 1717 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:03.835042 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-10a144aa-a4a0-41c1-85d4-f02f5df8bec3 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:03.835903 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-10a144aa-a4a0-41c1-85d4-f02f5df8bec3 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 808c58c6-1606-4553-8dd3-8292fa1202b5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:03.845292 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-10a144aa-a4a0-41c1-85d4-f02f5df8bec3 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:03.853760 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-10a144aa-a4a0-41c1-85d4-f02f5df8bec3 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:03.854414 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-10a144aa-a4a0-41c1-85d4-f02f5df8bec3 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:03.855304 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-10a144aa-a4a0-41c1-85d4-f02f5df8bec3 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:03.855917 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-10a144aa-a4a0-41c1-85d4-f02f5df8bec3 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:03.861711 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-10a144aa-a4a0-41c1-85d4-f02f5df8bec3 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:03.901558 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bdaf785d-8325-42a4-8f19-cd8639e14c1e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:03.910138 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bdaf785d-8325-42a4-8f19-cd8639e14c1e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:03.923911 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bdaf785d-8325-42a4-8f19-cd8639e14c1e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:03.925390 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bdaf785d-8325-42a4-8f19-cd8639e14c1e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9" status: 200 len: 1568 microversion: 2.25 time: 0.402269 Oct 23 01:15:03.926502 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 662/1242] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:15:03 2022] GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9 => generated 1568 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:15:03.962271 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9bbe76a2-6dc4-4614-8459-c38c16620cf7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:03.963464 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9bbe76a2-6dc4-4614-8459-c38c16620cf7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 8025dc46-71af-4fec-8f54-5ae9e92cc31f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:03.976297 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9bbe76a2-6dc4-4614-8459-c38c16620cf7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:03.978598 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9bbe76a2-6dc4-4614-8459-c38c16620cf7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:03.980904 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9bbe76a2-6dc4-4614-8459-c38c16620cf7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:03.983496 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9bbe76a2-6dc4-4614-8459-c38c16620cf7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:03.984553 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9bbe76a2-6dc4-4614-8459-c38c16620cf7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:03.986583 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9bbe76a2-6dc4-4614-8459-c38c16620cf7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:03.996848 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-10a144aa-a4a0-41c1-85d4-f02f5df8bec3 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:04.009788 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-10a144aa-a4a0-41c1-85d4-f02f5df8bec3 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/808c58c6-1606-4553-8dd3-8292fa1202b5" status: 200 len: 1215 microversion: 2.1 time: 0.178559 Oct 23 01:15:04.010539 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 581/1243] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:03 2022] GET /compute/v2.1/servers/808c58c6-1606-4553-8dd3-8292fa1202b5 => generated 1215 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:04.104091 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-91e6c87b-f822-4d42-9074-1d4c9bcfcc9a tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:04.104725 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-91e6c87b-f822-4d42-9074-1d4c9bcfcc9a tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] [instance: df71be7c-a3b2-4d32-bdbd-45eb56a93154] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:04.116528 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-91e6c87b-f822-4d42-9074-1d4c9bcfcc9a tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:04.117079 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-91e6c87b-f822-4d42-9074-1d4c9bcfcc9a tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:04.118872 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-91e6c87b-f822-4d42-9074-1d4c9bcfcc9a tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:04.118872 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-91e6c87b-f822-4d42-9074-1d4c9bcfcc9a tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:04.120952 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-91e6c87b-f822-4d42-9074-1d4c9bcfcc9a tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:04.123981 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-91e6c87b-f822-4d42-9074-1d4c9bcfcc9a tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:04.293840 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-91e6c87b-f822-4d42-9074-1d4c9bcfcc9a tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937a26d78d07458eaadc68fc9828d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3730de9c65d4add9f6f34aa7d5aa77e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:04.302815 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-91e6c87b-f822-4d42-9074-1d4c9bcfcc9a tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] 10.222.0.42 "GET /compute/v2.1/servers/df71be7c-a3b2-4d32-bdbd-45eb56a93154" status: 200 len: 1271 microversion: 2.1 time: 0.203235 Oct 23 01:15:04.303425 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 582/1244] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:04 2022] GET /compute/v2.1/servers/df71be7c-a3b2-4d32-bdbd-45eb56a93154 => generated 1271 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:15:04.319169 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cfcbfc52-c3b2-406f-96bf-a5d17347b2d1 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:04.320228 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-cfcbfc52-c3b2-406f-96bf-a5d17347b2d1 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 59cf7af1-8bca-4768-ac86-6e56d0649946] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:04.338626 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cfcbfc52-c3b2-406f-96bf-a5d17347b2d1 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:04.339529 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cfcbfc52-c3b2-406f-96bf-a5d17347b2d1 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:04.340521 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cfcbfc52-c3b2-406f-96bf-a5d17347b2d1 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:04.343093 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cfcbfc52-c3b2-406f-96bf-a5d17347b2d1 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:04.343779 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cfcbfc52-c3b2-406f-96bf-a5d17347b2d1 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:04.344836 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cfcbfc52-c3b2-406f-96bf-a5d17347b2d1 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:04.347604 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9bbe76a2-6dc4-4614-8459-c38c16620cf7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:04.361864 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9bbe76a2-6dc4-4614-8459-c38c16620cf7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f" status: 200 len: 1541 microversion: 2.1 time: 0.404019 Oct 23 01:15:04.362891 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 663/1245] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:03 2022] GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f => generated 1541 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:15:04.367602 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-15c5420f-5793-490d-9fd4-036225b9a396 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:04.368219 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-15c5420f-5793-490d-9fd4-036225b9a396 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] [instance: de212c9c-e0e0-471f-8a01-5d180ac28d07] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:04.374540 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-15c5420f-5793-490d-9fd4-036225b9a396 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:04.380099 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-15c5420f-5793-490d-9fd4-036225b9a396 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:04.380099 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-15c5420f-5793-490d-9fd4-036225b9a396 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:04.380099 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-15c5420f-5793-490d-9fd4-036225b9a396 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:04.380099 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-15c5420f-5793-490d-9fd4-036225b9a396 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:04.380457 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-15c5420f-5793-490d-9fd4-036225b9a396 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:04.478565 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-15c5420f-5793-490d-9fd4-036225b9a396 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80703c3d1dae419c9fd5ca103f3c28bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356a4b3819db457fb5caf68ded0212fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:04.493053 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-15c5420f-5793-490d-9fd4-036225b9a396 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] 10.222.0.42 "GET /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07" status: 200 len: 1270 microversion: 2.1 time: 0.129026 Oct 23 01:15:04.507405 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 664/1246] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:04 2022] GET /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07 => generated 1270 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:04.563942 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cfcbfc52-c3b2-406f-96bf-a5d17347b2d1 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262d5984b8c4775b86fae1c0d314718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc8f8cefbf441c98d6bda76e99e3173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:04.567528 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:15:04.579943 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cfcbfc52-c3b2-406f-96bf-a5d17347b2d1 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946" status: 200 len: 1667 microversion: 2.1 time: 0.275427 Oct 23 01:15:04.581661 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 583/1247] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:04 2022] GET /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946 => generated 1667 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:04.604974 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3cdd03ff-ce1f-4f58-884e-1f8f7c430875 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:04.605624 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3cdd03ff-ce1f-4f58-884e-1f8f7c430875 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 59cf7af1-8bca-4768-ac86-6e56d0649946] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:04.613675 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3cdd03ff-ce1f-4f58-884e-1f8f7c430875 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:04.614210 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3cdd03ff-ce1f-4f58-884e-1f8f7c430875 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:04.614650 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3cdd03ff-ce1f-4f58-884e-1f8f7c430875 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:04.615349 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3cdd03ff-ce1f-4f58-884e-1f8f7c430875 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:04.615810 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3cdd03ff-ce1f-4f58-884e-1f8f7c430875 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:04.616257 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3cdd03ff-ce1f-4f58-884e-1f8f7c430875 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:04.650906 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3cdd03ff-ce1f-4f58-884e-1f8f7c430875 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946/ips" status: 200 len: 177 microversion: 2.1 time: 0.050828 Oct 23 01:15:04.652010 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 665/1248] 10.222.0.42 () {58 vars in 1248 bytes} [Sun Oct 23 01:15:04 2022] GET /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946/ips => generated 177 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:15:04.665863 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0c246af2-b5ca-4951-85be-549c6d09e28c tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:04.666511 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0c246af2-b5ca-4951-85be-549c6d09e28c tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 59cf7af1-8bca-4768-ac86-6e56d0649946] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:04.673338 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0c246af2-b5ca-4951-85be-549c6d09e28c tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:04.673866 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0c246af2-b5ca-4951-85be-549c6d09e28c tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:04.679371 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0c246af2-b5ca-4951-85be-549c6d09e28c tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:04.680169 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0c246af2-b5ca-4951-85be-549c6d09e28c tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:04.680657 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0c246af2-b5ca-4951-85be-549c6d09e28c tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:04.681135 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0c246af2-b5ca-4951-85be-549c6d09e28c tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:04.742823 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0c246af2-b5ca-4951-85be-549c6d09e28c tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 59cf7af1-8bca-4768-ac86-6e56d0649946] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:15:04.841443 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4368dcc5-1149-43f3-bcd6-3d62cca935b7 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:04.844797 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4368dcc5-1149-43f3-bcd6-3d62cca935b7 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:04.854477 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4368dcc5-1149-43f3-bcd6-3d62cca935b7 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:04.855223 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4368dcc5-1149-43f3-bcd6-3d62cca935b7 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:04.858609 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4368dcc5-1149-43f3-bcd6-3d62cca935b7 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:04.859521 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4368dcc5-1149-43f3-bcd6-3d62cca935b7 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:04.861026 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4368dcc5-1149-43f3-bcd6-3d62cca935b7 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:04.861572 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4368dcc5-1149-43f3-bcd6-3d62cca935b7 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:05.164786 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0c246af2-b5ca-4951-85be-549c6d09e28c tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "DELETE /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946" status: 204 len: 0 microversion: 2.1 time: 0.504700 Oct 23 01:15:05.167480 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 584/1249] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:15:04 2022] DELETE /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:15:05.172657 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4368dcc5-1149-43f3-bcd6-3d62cca935b7 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:05.177858 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dda29897-c496-4042-9974-814a8590a998 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:05.177858 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-dda29897-c496-4042-9974-814a8590a998 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 8db307a5-7a1e-4791-8fa9-e934894238e9] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:05.184328 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4368dcc5-1149-43f3-bcd6-3d62cca935b7 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 200 len: 1717 microversion: 2.1 time: 0.347098 Oct 23 01:15:05.185219 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 666/1250] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:04 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 1717 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:05.190334 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dda29897-c496-4042-9974-814a8590a998 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:05.190910 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dda29897-c496-4042-9974-814a8590a998 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:05.191465 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dda29897-c496-4042-9974-814a8590a998 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:05.192243 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dda29897-c496-4042-9974-814a8590a998 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:05.195560 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dda29897-c496-4042-9974-814a8590a998 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:05.196087 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dda29897-c496-4042-9974-814a8590a998 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:05.197455 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-34b37f4c-4bcf-41ac-925d-4d9934016d95 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:05.198313 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-34b37f4c-4bcf-41ac-925d-4d9934016d95 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 808c58c6-1606-4553-8dd3-8292fa1202b5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:05.221485 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-34b37f4c-4bcf-41ac-925d-4d9934016d95 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:05.221485 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-34b37f4c-4bcf-41ac-925d-4d9934016d95 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:05.221485 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-34b37f4c-4bcf-41ac-925d-4d9934016d95 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:05.221485 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-34b37f4c-4bcf-41ac-925d-4d9934016d95 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:05.222068 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-34b37f4c-4bcf-41ac-925d-4d9934016d95 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:05.222068 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-34b37f4c-4bcf-41ac-925d-4d9934016d95 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:05.358149 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-34b37f4c-4bcf-41ac-925d-4d9934016d95 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:05.367016 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-34b37f4c-4bcf-41ac-925d-4d9934016d95 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/808c58c6-1606-4553-8dd3-8292fa1202b5" status: 200 len: 1215 microversion: 2.1 time: 0.180562 Oct 23 01:15:05.387639 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 667/1251] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:05 2022] GET /compute/v2.1/servers/808c58c6-1606-4553-8dd3-8292fa1202b5 => generated 1215 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:05.387639 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ef3c75fc-bfb9-4139-ab74-e8a7c4ab591a tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:05.387639 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ef3c75fc-bfb9-4139-ab74-e8a7c4ab591a tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 59cf7af1-8bca-4768-ac86-6e56d0649946] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:05.387639 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef3c75fc-bfb9-4139-ab74-e8a7c4ab591a tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:05.387639 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef3c75fc-bfb9-4139-ab74-e8a7c4ab591a tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:05.388343 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef3c75fc-bfb9-4139-ab74-e8a7c4ab591a tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:05.388343 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef3c75fc-bfb9-4139-ab74-e8a7c4ab591a tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:05.388343 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef3c75fc-bfb9-4139-ab74-e8a7c4ab591a tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:05.388343 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef3c75fc-bfb9-4139-ab74-e8a7c4ab591a tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:05.612372 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-dda29897-c496-4042-9974-814a8590a998 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:05.628092 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-dda29897-c496-4042-9974-814a8590a998 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:05.630879 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-dda29897-c496-4042-9974-814a8590a998 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:05.635679 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-dda29897-c496-4042-9974-814a8590a998 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9" status: 200 len: 1568 microversion: 2.25 time: 0.464548 Oct 23 01:15:05.635679 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 585/1252] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:15:05 2022] GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9 => generated 1568 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:15:05.641919 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-08773ddb-764d-4c7c-9f85-aaa2c7bef40b tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:05.642804 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-08773ddb-764d-4c7c-9f85-aaa2c7bef40b tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] [instance: df71be7c-a3b2-4d32-bdbd-45eb56a93154] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:05.649959 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ef3c75fc-bfb9-4139-ab74-e8a7c4ab591a tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262d5984b8c4775b86fae1c0d314718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc8f8cefbf441c98d6bda76e99e3173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:05.654257 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-08773ddb-764d-4c7c-9f85-aaa2c7bef40b tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:05.655365 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-08773ddb-764d-4c7c-9f85-aaa2c7bef40b tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:05.655997 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-08773ddb-764d-4c7c-9f85-aaa2c7bef40b tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:05.657196 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-08773ddb-764d-4c7c-9f85-aaa2c7bef40b tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:05.658052 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-08773ddb-764d-4c7c-9f85-aaa2c7bef40b tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:05.659071 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ef3c75fc-bfb9-4139-ab74-e8a7c4ab591a tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946" status: 200 len: 1673 microversion: 2.1 time: 0.290056 Oct 23 01:15:05.660385 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 668/1253] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:05 2022] GET /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946 => generated 1673 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:05.661311 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-08773ddb-764d-4c7c-9f85-aaa2c7bef40b tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:05.666358 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9d9565cd-9a98-4267-ad71-50e8531736fd tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:05.667064 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9d9565cd-9a98-4267-ad71-50e8531736fd tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 8025dc46-71af-4fec-8f54-5ae9e92cc31f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:05.685331 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d9565cd-9a98-4267-ad71-50e8531736fd tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:05.686189 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d9565cd-9a98-4267-ad71-50e8531736fd tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:05.687519 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d9565cd-9a98-4267-ad71-50e8531736fd tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:05.688483 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d9565cd-9a98-4267-ad71-50e8531736fd tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:05.689145 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d9565cd-9a98-4267-ad71-50e8531736fd tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:05.689742 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d9565cd-9a98-4267-ad71-50e8531736fd tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:05.996013 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-08773ddb-764d-4c7c-9f85-aaa2c7bef40b tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937a26d78d07458eaadc68fc9828d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3730de9c65d4add9f6f34aa7d5aa77e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:05.999905 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9d9565cd-9a98-4267-ad71-50e8531736fd tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:06.010875 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-08773ddb-764d-4c7c-9f85-aaa2c7bef40b tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] 10.222.0.42 "GET /compute/v2.1/servers/df71be7c-a3b2-4d32-bdbd-45eb56a93154" status: 200 len: 1313 microversion: 2.1 time: 0.375053 Oct 23 01:15:06.011489 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9d9565cd-9a98-4267-ad71-50e8531736fd tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f" status: 200 len: 1541 microversion: 2.1 time: 0.350059 Oct 23 01:15:06.011911 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 586/1254] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:05 2022] GET /compute/v2.1/servers/df71be7c-a3b2-4d32-bdbd-45eb56a93154 => generated 1313 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:06.026849 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-736a7f07-08e2-48e5-a3a4-1b342401ff82 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:06.029115 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 669/1255] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:05 2022] GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f => generated 1541 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:06.035229 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-736a7f07-08e2-48e5-a3a4-1b342401ff82 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] [instance: de212c9c-e0e0-471f-8a01-5d180ac28d07] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:06.051327 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-736a7f07-08e2-48e5-a3a4-1b342401ff82 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:06.058326 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-736a7f07-08e2-48e5-a3a4-1b342401ff82 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:06.058326 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-736a7f07-08e2-48e5-a3a4-1b342401ff82 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:06.058326 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-736a7f07-08e2-48e5-a3a4-1b342401ff82 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:06.059055 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-736a7f07-08e2-48e5-a3a4-1b342401ff82 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:06.059553 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-736a7f07-08e2-48e5-a3a4-1b342401ff82 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:06.153434 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-736a7f07-08e2-48e5-a3a4-1b342401ff82 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80703c3d1dae419c9fd5ca103f3c28bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356a4b3819db457fb5caf68ded0212fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:06.163894 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-736a7f07-08e2-48e5-a3a4-1b342401ff82 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] 10.222.0.42 "GET /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07" status: 200 len: 1276 microversion: 2.1 time: 0.148103 Oct 23 01:15:06.168420 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 587/1256] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:06 2022] GET /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07 => generated 1276 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:06.209781 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-435e851d-ecdb-4c9e-bb43-6de69b9745e5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:06.211157 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-435e851d-ecdb-4c9e-bb43-6de69b9745e5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:06.224926 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-435e851d-ecdb-4c9e-bb43-6de69b9745e5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:06.225461 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-435e851d-ecdb-4c9e-bb43-6de69b9745e5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:06.225965 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-435e851d-ecdb-4c9e-bb43-6de69b9745e5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:06.232759 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-435e851d-ecdb-4c9e-bb43-6de69b9745e5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:06.233762 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-435e851d-ecdb-4c9e-bb43-6de69b9745e5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:06.233852 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-435e851d-ecdb-4c9e-bb43-6de69b9745e5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:06.384932 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-49b1e630-aa70-45f0-9062-059d836fffe2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-572390352", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "9752ed79-332c-4c91-93b8-957eba739dbd"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:15:06.451711 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-49b1e630-aa70-45f0-9062-059d836fffe2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] validate_networks() for [('9752ed79-332c-4c91-93b8-957eba739dbd', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:15:06.515921 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-435e851d-ecdb-4c9e-bb43-6de69b9745e5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:06.524666 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-435e851d-ecdb-4c9e-bb43-6de69b9745e5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 200 len: 1717 microversion: 2.1 time: 0.319388 Oct 23 01:15:06.527760 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 670/1257] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:06 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 1717 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:15:06.530099 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2e192f09-5e32-4240-8c38-69b2278d374e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:06.530962 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2e192f09-5e32-4240-8c38-69b2278d374e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 808c58c6-1606-4553-8dd3-8292fa1202b5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:06.534128 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:15:06.537796 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2e192f09-5e32-4240-8c38-69b2278d374e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:06.538868 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2e192f09-5e32-4240-8c38-69b2278d374e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:06.539296 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2e192f09-5e32-4240-8c38-69b2278d374e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:06.539975 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2e192f09-5e32-4240-8c38-69b2278d374e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:06.540426 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2e192f09-5e32-4240-8c38-69b2278d374e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:06.540861 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2e192f09-5e32-4240-8c38-69b2278d374e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:06.626136 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2e192f09-5e32-4240-8c38-69b2278d374e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:06.635040 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2e192f09-5e32-4240-8c38-69b2278d374e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/808c58c6-1606-4553-8dd3-8292fa1202b5" status: 200 len: 1215 microversion: 2.1 time: 0.108685 Oct 23 01:15:06.642083 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 671/1258] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:06 2022] GET /compute/v2.1/servers/808c58c6-1606-4553-8dd3-8292fa1202b5 => generated 1215 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:06.662682 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cc352c35-3abb-4fbe-99fe-7ddc1896a990 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:06.663733 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cc352c35-3abb-4fbe-99fe-7ddc1896a990 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 8db307a5-7a1e-4791-8fa9-e934894238e9] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:06.669826 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cc352c35-3abb-4fbe-99fe-7ddc1896a990 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:06.670369 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cc352c35-3abb-4fbe-99fe-7ddc1896a990 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:06.670803 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cc352c35-3abb-4fbe-99fe-7ddc1896a990 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:06.671753 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cc352c35-3abb-4fbe-99fe-7ddc1896a990 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:06.672203 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cc352c35-3abb-4fbe-99fe-7ddc1896a990 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:06.672624 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cc352c35-3abb-4fbe-99fe-7ddc1896a990 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:07.199293 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cc352c35-3abb-4fbe-99fe-7ddc1896a990 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:07.199293 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=100 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:15:07.212435 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cc352c35-3abb-4fbe-99fe-7ddc1896a990 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:07.213733 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cc352c35-3abb-4fbe-99fe-7ddc1896a990 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:07.217206 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cc352c35-3abb-4fbe-99fe-7ddc1896a990 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9" status: 200 len: 1568 microversion: 2.25 time: 0.558328 Oct 23 01:15:07.217794 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 672/1259] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:15:06 2022] GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9 => generated 1568 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:15:07.238068 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f34bb61e-3d4a-4e19-b17b-e5b316a2ac8b tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:07.238068 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f34bb61e-3d4a-4e19-b17b-e5b316a2ac8b tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 59cf7af1-8bca-4768-ac86-6e56d0649946] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:07.241198 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f34bb61e-3d4a-4e19-b17b-e5b316a2ac8b tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:07.241745 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f34bb61e-3d4a-4e19-b17b-e5b316a2ac8b tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:07.242221 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f34bb61e-3d4a-4e19-b17b-e5b316a2ac8b tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:07.243067 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f34bb61e-3d4a-4e19-b17b-e5b316a2ac8b tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:07.243654 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f34bb61e-3d4a-4e19-b17b-e5b316a2ac8b tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:07.244089 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f34bb61e-3d4a-4e19-b17b-e5b316a2ac8b tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:07.486465 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-49b1e630-aa70-45f0-9062-059d836fffe2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:15:07.486997 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-49b1e630-aa70-45f0-9062-059d836fffe2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:15:07.489291 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-49b1e630-aa70-45f0-9062-059d836fffe2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:15:07.489745 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-49b1e630-aa70-45f0-9062-059d836fffe2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:15:07.490276 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-49b1e630-aa70-45f0-9062-059d836fffe2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:15:07.505968 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-49b1e630-aa70-45f0-9062-059d836fffe2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:07.507557 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-49b1e630-aa70-45f0-9062-059d836fffe2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:07.508205 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-49b1e630-aa70-45f0-9062-059d836fffe2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:07.509236 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-49b1e630-aa70-45f0-9062-059d836fffe2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:07.511503 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-49b1e630-aa70-45f0-9062-059d836fffe2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:07.512930 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-49b1e630-aa70-45f0-9062-059d836fffe2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:07.540494 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-49b1e630-aa70-45f0-9062-059d836fffe2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Getting quotas for project 1aa3395c4af3435eaa3a0f49e19167fe. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:15:07.550820 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-49b1e630-aa70-45f0-9062-059d836fffe2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Getting quotas for user 690143905857471f949b1f4454ad2139 and project 1aa3395c4af3435eaa3a0f49e19167fe. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:15:07.570241 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-49b1e630-aa70-45f0-9062-059d836fffe2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:15:07.575075 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-49b1e630-aa70-45f0-9062-059d836fffe2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 291a0671-7bab-404a-b836-95fb7acfd1dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:15:07.710662 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-49b1e630-aa70-45f0-9062-059d836fffe2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.391884 Oct 23 01:15:07.712074 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 588/1260] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:15:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1395 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 23 01:15:07.718339 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ecf26b4b-d5bf-4142-9b51-cdd0a34c3cbb tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:07.719561 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ecf26b4b-d5bf-4142-9b51-cdd0a34c3cbb tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] [instance: df71be7c-a3b2-4d32-bdbd-45eb56a93154] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:07.728532 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ecf26b4b-d5bf-4142-9b51-cdd0a34c3cbb tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:07.729708 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ecf26b4b-d5bf-4142-9b51-cdd0a34c3cbb tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:07.730422 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ecf26b4b-d5bf-4142-9b51-cdd0a34c3cbb tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:07.731418 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ecf26b4b-d5bf-4142-9b51-cdd0a34c3cbb tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:07.732047 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ecf26b4b-d5bf-4142-9b51-cdd0a34c3cbb tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:07.732656 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ecf26b4b-d5bf-4142-9b51-cdd0a34c3cbb tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:08.085649 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f34bb61e-3d4a-4e19-b17b-e5b316a2ac8b tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262d5984b8c4775b86fae1c0d314718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc8f8cefbf441c98d6bda76e99e3173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:08.100089 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f34bb61e-3d4a-4e19-b17b-e5b316a2ac8b tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946" status: 200 len: 1673 microversion: 2.1 time: 0.879999 Oct 23 01:15:08.147715 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 673/1261] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:07 2022] GET /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946 => generated 1673 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:08.159577 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-15b2b68d-bf03-49e0-9a5f-8cdb4f8a3991 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:08.164740 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-15b2b68d-bf03-49e0-9a5f-8cdb4f8a3991 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 8025dc46-71af-4fec-8f54-5ae9e92cc31f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:08.181934 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-15b2b68d-bf03-49e0-9a5f-8cdb4f8a3991 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:08.182529 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-15b2b68d-bf03-49e0-9a5f-8cdb4f8a3991 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:08.183020 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-15b2b68d-bf03-49e0-9a5f-8cdb4f8a3991 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:08.183742 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-15b2b68d-bf03-49e0-9a5f-8cdb4f8a3991 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:08.184210 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-15b2b68d-bf03-49e0-9a5f-8cdb4f8a3991 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:08.184637 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-15b2b68d-bf03-49e0-9a5f-8cdb4f8a3991 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:08.548398 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ecf26b4b-d5bf-4142-9b51-cdd0a34c3cbb tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937a26d78d07458eaadc68fc9828d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3730de9c65d4add9f6f34aa7d5aa77e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:08.558154 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ecf26b4b-d5bf-4142-9b51-cdd0a34c3cbb tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] 10.222.0.42 "GET /compute/v2.1/servers/df71be7c-a3b2-4d32-bdbd-45eb56a93154" status: 200 len: 1313 microversion: 2.1 time: 0.844751 Oct 23 01:15:08.559020 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 589/1262] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:07 2022] GET /compute/v2.1/servers/df71be7c-a3b2-4d32-bdbd-45eb56a93154 => generated 1313 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:08.565827 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7d41e94e-db24-471c-be40-14d23c45479f tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:08.566554 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7d41e94e-db24-471c-be40-14d23c45479f tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] [instance: de212c9c-e0e0-471f-8a01-5d180ac28d07] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:08.576105 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d41e94e-db24-471c-be40-14d23c45479f tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:08.576105 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d41e94e-db24-471c-be40-14d23c45479f tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:08.576105 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d41e94e-db24-471c-be40-14d23c45479f tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:08.576414 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d41e94e-db24-471c-be40-14d23c45479f tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:08.576699 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d41e94e-db24-471c-be40-14d23c45479f tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:08.577119 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d41e94e-db24-471c-be40-14d23c45479f tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:08.881343 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-15b2b68d-bf03-49e0-9a5f-8cdb4f8a3991 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:08.882995 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7d41e94e-db24-471c-be40-14d23c45479f tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80703c3d1dae419c9fd5ca103f3c28bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356a4b3819db457fb5caf68ded0212fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:08.893134 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7d41e94e-db24-471c-be40-14d23c45479f tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] 10.222.0.42 "GET /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07" status: 200 len: 1318 microversion: 2.1 time: 0.333046 Oct 23 01:15:08.895627 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-15b2b68d-bf03-49e0-9a5f-8cdb4f8a3991 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f" status: 200 len: 1541 microversion: 2.1 time: 0.745417 Oct 23 01:15:08.896961 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 674/1263] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:08 2022] GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f => generated 1541 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:08.907109 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 590/1264] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:08 2022] GET /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07 => generated 1318 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:08.915750 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9346d048-437d-4eeb-b813-806f173d0c13 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:08.916380 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9346d048-437d-4eeb-b813-806f173d0c13 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 808c58c6-1606-4553-8dd3-8292fa1202b5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:08.917077 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ccfd3666-f1b9-4562-8473-85060243c37d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:08.918120 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ccfd3666-f1b9-4562-8473-85060243c37d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:08.923306 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9346d048-437d-4eeb-b813-806f173d0c13 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:08.924054 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9346d048-437d-4eeb-b813-806f173d0c13 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:08.924752 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9346d048-437d-4eeb-b813-806f173d0c13 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:08.925633 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9346d048-437d-4eeb-b813-806f173d0c13 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:08.926277 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9346d048-437d-4eeb-b813-806f173d0c13 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:08.926870 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9346d048-437d-4eeb-b813-806f173d0c13 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:08.929772 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ccfd3666-f1b9-4562-8473-85060243c37d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:08.931094 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ccfd3666-f1b9-4562-8473-85060243c37d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:08.931586 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ccfd3666-f1b9-4562-8473-85060243c37d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:08.932818 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ccfd3666-f1b9-4562-8473-85060243c37d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:08.933386 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ccfd3666-f1b9-4562-8473-85060243c37d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:08.933861 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ccfd3666-f1b9-4562-8473-85060243c37d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:09.101155 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9346d048-437d-4eeb-b813-806f173d0c13 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:09.123896 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9346d048-437d-4eeb-b813-806f173d0c13 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/808c58c6-1606-4553-8dd3-8292fa1202b5" status: 200 len: 1271 microversion: 2.1 time: 0.214710 Oct 23 01:15:09.139228 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 591/1265] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:08 2022] GET /compute/v2.1/servers/808c58c6-1606-4553-8dd3-8292fa1202b5 => generated 1271 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:09.145642 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d6445f41-27d2-4bac-b528-5e6e4b3f4d78 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:09.146374 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d6445f41-27d2-4bac-b528-5e6e4b3f4d78 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 291a0671-7bab-404a-b836-95fb7acfd1dd] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:09.359534 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=4 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:15:09.379328 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d6445f41-27d2-4bac-b528-5e6e4b3f4d78 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:09.414744 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d6445f41-27d2-4bac-b528-5e6e4b3f4d78 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd" status: 200 len: 1224 microversion: 2.1 time: 0.272324 Oct 23 01:15:09.417289 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 592/1266] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:09 2022] GET /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd => generated 1224 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:09.457005 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-deb90699-ad51-4430-ba6d-fc336225cad4 req-89d09539-2468-413e-935e-cee6707e387b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df71be7c-a3b2-4d32-bdbd-45eb56a93154", "tag": "dfef34ff-6be1-4050-abaa-b1b9919c4da1"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:15:09.492373 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-deb90699-ad51-4430-ba6d-fc336225cad4 req-89d09539-2468-413e-935e-cee6707e387b service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:09.492895 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-deb90699-ad51-4430-ba6d-fc336225cad4 req-89d09539-2468-413e-935e-cee6707e387b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:09.495470 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-deb90699-ad51-4430-ba6d-fc336225cad4 req-89d09539-2468-413e-935e-cee6707e387b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:09.515995 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-deb90699-ad51-4430-ba6d-fc336225cad4 req-89d09539-2468-413e-935e-cee6707e387b service nova] Creating event network-changed:dfef34ff-6be1-4050-abaa-b1b9919c4da1 for instance df71be7c-a3b2-4d32-bdbd-45eb56a93154 on n-h1-master-1 Oct 23 01:15:09.525337 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-deb90699-ad51-4430-ba6d-fc336225cad4 req-89d09539-2468-413e-935e-cee6707e387b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087188 Oct 23 01:15:09.527232 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 593/1267] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:15:09.535383 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-81ca8c7b-3907-4a6c-a433-e495724f541b tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:09.538075 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-81ca8c7b-3907-4a6c-a433-e495724f541b tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 8db307a5-7a1e-4791-8fa9-e934894238e9] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:09.548025 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-81ca8c7b-3907-4a6c-a433-e495724f541b tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:09.548531 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-81ca8c7b-3907-4a6c-a433-e495724f541b tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:09.549392 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-81ca8c7b-3907-4a6c-a433-e495724f541b tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:09.550212 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-81ca8c7b-3907-4a6c-a433-e495724f541b tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:09.550726 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-81ca8c7b-3907-4a6c-a433-e495724f541b tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:09.551156 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-81ca8c7b-3907-4a6c-a433-e495724f541b tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:09.964501 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ccfd3666-f1b9-4562-8473-85060243c37d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:09.977146 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ccfd3666-f1b9-4562-8473-85060243c37d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 200 len: 1717 microversion: 2.1 time: 1.078167 Oct 23 01:15:09.990558 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 675/1268] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:08 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 1717 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:09.998573 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-250a512b-e26c-4a13-aafc-3c99c0aaf895 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:09.999665 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-250a512b-e26c-4a13-aafc-3c99c0aaf895 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 59cf7af1-8bca-4768-ac86-6e56d0649946] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:10.008254 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-250a512b-e26c-4a13-aafc-3c99c0aaf895 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:10.012506 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-250a512b-e26c-4a13-aafc-3c99c0aaf895 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:10.012506 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-250a512b-e26c-4a13-aafc-3c99c0aaf895 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:10.012506 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-250a512b-e26c-4a13-aafc-3c99c0aaf895 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:10.012506 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-250a512b-e26c-4a13-aafc-3c99c0aaf895 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:10.013529 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-250a512b-e26c-4a13-aafc-3c99c0aaf895 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:10.578955 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-81ca8c7b-3907-4a6c-a433-e495724f541b tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:10.590720 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-81ca8c7b-3907-4a6c-a433-e495724f541b tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:10.601958 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-81ca8c7b-3907-4a6c-a433-e495724f541b tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:10.606939 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-81ca8c7b-3907-4a6c-a433-e495724f541b tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9" status: 200 len: 1543 microversion: 2.25 time: 1.077904 Oct 23 01:15:10.609266 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 594/1269] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:15:09 2022] GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9 => generated 1543 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:15:10.623112 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-29255874-1e33-4d22-9db0-d962c6028775 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:10.623457 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-29255874-1e33-4d22-9db0-d962c6028775 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] [instance: df71be7c-a3b2-4d32-bdbd-45eb56a93154] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:10.627089 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:15:10.633877 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-29255874-1e33-4d22-9db0-d962c6028775 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:10.643375 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-29255874-1e33-4d22-9db0-d962c6028775 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:10.644245 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-29255874-1e33-4d22-9db0-d962c6028775 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:10.645502 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-29255874-1e33-4d22-9db0-d962c6028775 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:10.647225 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-29255874-1e33-4d22-9db0-d962c6028775 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:10.649288 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-29255874-1e33-4d22-9db0-d962c6028775 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:10.745639 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=26 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:15:10.784869 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-250a512b-e26c-4a13-aafc-3c99c0aaf895 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262d5984b8c4775b86fae1c0d314718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc8f8cefbf441c98d6bda76e99e3173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:10.809564 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-250a512b-e26c-4a13-aafc-3c99c0aaf895 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946" status: 200 len: 1652 microversion: 2.1 time: 0.806257 Oct 23 01:15:10.834429 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 676/1270] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:09 2022] GET /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946 => generated 1652 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:10.840686 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-c1c8417f-2d20-4b26-855d-109baa997b28 req-d28275a6-bc35-4094-bf50-ca167ab3f1cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59cf7af1-8bca-4768-ac86-6e56d0649946", "name": "network-vif-deleted", "tag": "0012d07c-1c5a-452e-8f4f-f3931c55a841"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:15:10.852786 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-c1c8417f-2d20-4b26-855d-109baa997b28 req-d28275a6-bc35-4094-bf50-ca167ab3f1cd service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:10.853270 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-c1c8417f-2d20-4b26-855d-109baa997b28 req-d28275a6-bc35-4094-bf50-ca167ab3f1cd service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:10.853699 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-c1c8417f-2d20-4b26-855d-109baa997b28 req-d28275a6-bc35-4094-bf50-ca167ab3f1cd service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:10.866960 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-c1c8417f-2d20-4b26-855d-109baa997b28 req-d28275a6-bc35-4094-bf50-ca167ab3f1cd service nova] Creating event network-vif-deleted:0012d07c-1c5a-452e-8f4f-f3931c55a841 for instance 59cf7af1-8bca-4768-ac86-6e56d0649946 on n-h1-master-1 Oct 23 01:15:10.876289 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-c1c8417f-2d20-4b26-855d-109baa997b28 req-d28275a6-bc35-4094-bf50-ca167ab3f1cd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048584 Oct 23 01:15:10.877485 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 677/1271] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:15:10.883906 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-987f6ea0-e302-4722-8d1d-1218910339a1 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:10.887118 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-987f6ea0-e302-4722-8d1d-1218910339a1 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] [instance: de212c9c-e0e0-471f-8a01-5d180ac28d07] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:10.894802 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-987f6ea0-e302-4722-8d1d-1218910339a1 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:10.895554 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-987f6ea0-e302-4722-8d1d-1218910339a1 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:10.896145 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-987f6ea0-e302-4722-8d1d-1218910339a1 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:10.897002 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-987f6ea0-e302-4722-8d1d-1218910339a1 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:10.897642 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-987f6ea0-e302-4722-8d1d-1218910339a1 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:10.898273 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-987f6ea0-e302-4722-8d1d-1218910339a1 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:11.252212 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-29255874-1e33-4d22-9db0-d962c6028775 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937a26d78d07458eaadc68fc9828d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3730de9c65d4add9f6f34aa7d5aa77e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:11.263923 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-29255874-1e33-4d22-9db0-d962c6028775 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] 10.222.0.42 "GET /compute/v2.1/servers/df71be7c-a3b2-4d32-bdbd-45eb56a93154" status: 200 len: 1313 microversion: 2.1 time: 0.653131 Oct 23 01:15:11.264530 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 595/1272] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:10 2022] GET /compute/v2.1/servers/df71be7c-a3b2-4d32-bdbd-45eb56a93154 => generated 1313 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:11.290240 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-14ab2e30-fb4b-4930-a7d5-123806bfa5cd tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:11.291198 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-14ab2e30-fb4b-4930-a7d5-123806bfa5cd tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 8025dc46-71af-4fec-8f54-5ae9e92cc31f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:11.302451 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-14ab2e30-fb4b-4930-a7d5-123806bfa5cd tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:11.302950 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-14ab2e30-fb4b-4930-a7d5-123806bfa5cd tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:11.303387 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-14ab2e30-fb4b-4930-a7d5-123806bfa5cd tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:11.304720 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-14ab2e30-fb4b-4930-a7d5-123806bfa5cd tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:11.305186 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-14ab2e30-fb4b-4930-a7d5-123806bfa5cd tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:11.305611 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-14ab2e30-fb4b-4930-a7d5-123806bfa5cd tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:11.366682 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-987f6ea0-e302-4722-8d1d-1218910339a1 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80703c3d1dae419c9fd5ca103f3c28bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356a4b3819db457fb5caf68ded0212fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:11.374906 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-987f6ea0-e302-4722-8d1d-1218910339a1 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] 10.222.0.42 "GET /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07" status: 200 len: 1318 microversion: 2.1 time: 0.496000 Oct 23 01:15:11.380094 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 678/1273] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:10 2022] GET /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07 => generated 1318 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:11.386030 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-064ffd87-fc13-464f-96e2-e80c2056e96b req-84967ce7-c846-4315-8e1a-bd2a1add2424 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59cf7af1-8bca-4768-ac86-6e56d0649946", "name": "network-vif-unplugged", "status": "completed", "tag": "1af179f1-7395-4c6c-857c-f6bcc55abbbb"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:15:11.423815 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-064ffd87-fc13-464f-96e2-e80c2056e96b req-84967ce7-c846-4315-8e1a-bd2a1add2424 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:11.428917 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-064ffd87-fc13-464f-96e2-e80c2056e96b req-84967ce7-c846-4315-8e1a-bd2a1add2424 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:11.429949 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-064ffd87-fc13-464f-96e2-e80c2056e96b req-84967ce7-c846-4315-8e1a-bd2a1add2424 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:11.443458 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-064ffd87-fc13-464f-96e2-e80c2056e96b req-84967ce7-c846-4315-8e1a-bd2a1add2424 service nova] Creating event network-vif-unplugged:1af179f1-7395-4c6c-857c-f6bcc55abbbb for instance 59cf7af1-8bca-4768-ac86-6e56d0649946 on n-h1-master-1 Oct 23 01:15:11.452071 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-064ffd87-fc13-464f-96e2-e80c2056e96b req-84967ce7-c846-4315-8e1a-bd2a1add2424 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070087 Oct 23 01:15:11.453330 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 679/1274] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:15:11.470103 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-db77b332-b97f-4062-87df-80ed80eb33b5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:11.471231 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-db77b332-b97f-4062-87df-80ed80eb33b5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 808c58c6-1606-4553-8dd3-8292fa1202b5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:11.479579 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-db77b332-b97f-4062-87df-80ed80eb33b5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:11.480467 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-db77b332-b97f-4062-87df-80ed80eb33b5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:11.481797 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-db77b332-b97f-4062-87df-80ed80eb33b5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:11.483408 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-db77b332-b97f-4062-87df-80ed80eb33b5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:11.484174 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-db77b332-b97f-4062-87df-80ed80eb33b5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:11.484810 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-db77b332-b97f-4062-87df-80ed80eb33b5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:11.682448 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-db77b332-b97f-4062-87df-80ed80eb33b5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:11.693069 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-db77b332-b97f-4062-87df-80ed80eb33b5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/808c58c6-1606-4553-8dd3-8292fa1202b5" status: 200 len: 1277 microversion: 2.1 time: 0.238072 Oct 23 01:15:11.714502 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 680/1275] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:11 2022] GET /compute/v2.1/servers/808c58c6-1606-4553-8dd3-8292fa1202b5 => generated 1277 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:11.741809 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-91510a05-eefb-49b9-a623-07ed0784387b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:11.744654 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-91510a05-eefb-49b9-a623-07ed0784387b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 291a0671-7bab-404a-b836-95fb7acfd1dd] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:11.759235 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-91510a05-eefb-49b9-a623-07ed0784387b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:11.767438 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-91510a05-eefb-49b9-a623-07ed0784387b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:11.768204 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-91510a05-eefb-49b9-a623-07ed0784387b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:11.770952 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-91510a05-eefb-49b9-a623-07ed0784387b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:11.771546 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-91510a05-eefb-49b9-a623-07ed0784387b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:11.772046 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-91510a05-eefb-49b9-a623-07ed0784387b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:11.801233 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-14ab2e30-fb4b-4930-a7d5-123806bfa5cd tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:11.821616 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-14ab2e30-fb4b-4930-a7d5-123806bfa5cd tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f" status: 200 len: 1541 microversion: 2.1 time: 0.541448 Oct 23 01:15:11.822344 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 596/1276] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:11 2022] GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f => generated 1541 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:11.840065 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e948c0c2-80a8-4d03-8600-d9bfbae59a22 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Calling method '.version_select at 0x7f5cc1a37700>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:11.856009 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e948c0c2-80a8-4d03-8600-d9bfbae59a22 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:11.856555 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e948c0c2-80a8-4d03-8600-d9bfbae59a22 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:11.856965 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e948c0c2-80a8-4d03-8600-d9bfbae59a22 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:11.914869 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e948c0c2-80a8-4d03-8600-d9bfbae59a22 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] 10.222.0.42 "GET /compute/v2.1/os-migrations" status: 200 len: 3869 microversion: 2.25 time: 0.072652 Oct 23 01:15:11.925544 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 597/1277] 10.222.0.42 () {60 vars in 1184 bytes} [Sun Oct 23 01:15:11 2022] GET /compute/v2.1/os-migrations => generated 3869 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:15:11.956163 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d6f47f70-1e54-4c1c-ac90-5d7d2a848e04 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:11.957455 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d6f47f70-1e54-4c1c-ac90-5d7d2a848e04 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:11.965682 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d6f47f70-1e54-4c1c-ac90-5d7d2a848e04 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:11.966634 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d6f47f70-1e54-4c1c-ac90-5d7d2a848e04 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:11.967415 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d6f47f70-1e54-4c1c-ac90-5d7d2a848e04 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:11.968695 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d6f47f70-1e54-4c1c-ac90-5d7d2a848e04 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:11.969325 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d6f47f70-1e54-4c1c-ac90-5d7d2a848e04 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:11.969919 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d6f47f70-1e54-4c1c-ac90-5d7d2a848e04 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:11.983730 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-91510a05-eefb-49b9-a623-07ed0784387b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:11.992285 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-91510a05-eefb-49b9-a623-07ed0784387b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd" status: 200 len: 1294 microversion: 2.1 time: 0.275868 Oct 23 01:15:12.003245 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 681/1278] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:11 2022] GET /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd => generated 1294 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:12.008584 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8b11e0af-e91c-4729-9710-527ef70de655 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:12.009430 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8b11e0af-e91c-4729-9710-527ef70de655 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 59cf7af1-8bca-4768-ac86-6e56d0649946] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:12.023531 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b11e0af-e91c-4729-9710-527ef70de655 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:12.024317 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b11e0af-e91c-4729-9710-527ef70de655 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:12.024942 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b11e0af-e91c-4729-9710-527ef70de655 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:12.025824 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b11e0af-e91c-4729-9710-527ef70de655 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:12.030618 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b11e0af-e91c-4729-9710-527ef70de655 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:12.031293 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b11e0af-e91c-4729-9710-527ef70de655 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:12.192169 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8b11e0af-e91c-4729-9710-527ef70de655 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262d5984b8c4775b86fae1c0d314718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc8f8cefbf441c98d6bda76e99e3173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:12.206187 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8b11e0af-e91c-4729-9710-527ef70de655 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946" status: 200 len: 1452 microversion: 2.1 time: 0.199889 Oct 23 01:15:12.207943 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 682/1279] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:12 2022] GET /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946 => generated 1452 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:12.222696 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-7748470e-ed88-40be-ab25-aa4d6acb4972 req-f9b7829d-66d6-4963-98f5-b5ea81e9afe7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3aa4181-fc02-43dc-95df-ae1a730fbdca", "tag": "ac87b72d-8aca-4ffa-993c-09cc2cf87903"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:15:12.245621 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-7748470e-ed88-40be-ab25-aa4d6acb4972 req-f9b7829d-66d6-4963-98f5-b5ea81e9afe7 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:12.246205 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-7748470e-ed88-40be-ab25-aa4d6acb4972 req-f9b7829d-66d6-4963-98f5-b5ea81e9afe7 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:12.247588 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-7748470e-ed88-40be-ab25-aa4d6acb4972 req-f9b7829d-66d6-4963-98f5-b5ea81e9afe7 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:12.278820 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-7748470e-ed88-40be-ab25-aa4d6acb4972 req-f9b7829d-66d6-4963-98f5-b5ea81e9afe7 service nova] Creating event network-changed:ac87b72d-8aca-4ffa-993c-09cc2cf87903 for instance f3aa4181-fc02-43dc-95df-ae1a730fbdca on n-h1-master-1 Oct 23 01:15:12.297644 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-7748470e-ed88-40be-ab25-aa4d6acb4972 req-f9b7829d-66d6-4963-98f5-b5ea81e9afe7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083568 Oct 23 01:15:12.297644 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 683/1280] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:15:12.303909 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-eac23944-8bc7-4e20-8217-25f7fd7cb17c tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:12.304798 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-eac23944-8bc7-4e20-8217-25f7fd7cb17c tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] [instance: 8db307a5-7a1e-4791-8fa9-e934894238e9] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:12.311163 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eac23944-8bc7-4e20-8217-25f7fd7cb17c tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:12.312010 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eac23944-8bc7-4e20-8217-25f7fd7cb17c tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:12.312659 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eac23944-8bc7-4e20-8217-25f7fd7cb17c tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:12.313523 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eac23944-8bc7-4e20-8217-25f7fd7cb17c tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:12.314212 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eac23944-8bc7-4e20-8217-25f7fd7cb17c tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:12.314790 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eac23944-8bc7-4e20-8217-25f7fd7cb17c tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:12.394411 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d6f47f70-1e54-4c1c-ac90-5d7d2a848e04 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:12.421548 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d6f47f70-1e54-4c1c-ac90-5d7d2a848e04 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 200 len: 1717 microversion: 2.1 time: 0.490685 Oct 23 01:15:12.423421 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 598/1281] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:11 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 1717 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:12.435231 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7d583aa8-c9ff-442d-98b8-da4d72c7c25d tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:12.435851 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7d583aa8-c9ff-442d-98b8-da4d72c7c25d tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] [instance: df71be7c-a3b2-4d32-bdbd-45eb56a93154] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:12.447874 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d583aa8-c9ff-442d-98b8-da4d72c7c25d tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:12.448558 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d583aa8-c9ff-442d-98b8-da4d72c7c25d tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:12.449012 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d583aa8-c9ff-442d-98b8-da4d72c7c25d tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:12.449728 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d583aa8-c9ff-442d-98b8-da4d72c7c25d tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:12.450230 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d583aa8-c9ff-442d-98b8-da4d72c7c25d tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:12.451511 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d583aa8-c9ff-442d-98b8-da4d72c7c25d tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:13.199879 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-eac23944-8bc7-4e20-8217-25f7fd7cb17c tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lazy-loading 'services' on Instance uuid 8db307a5-7a1e-4791-8fa9-e934894238e9 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:15:13.230348 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-eac23944-8bc7-4e20-8217-25f7fd7cb17c tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9" status: 200 len: 2035 microversion: 2.25 time: 0.934748 Oct 23 01:15:13.230939 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 684/1282] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:15:12 2022] GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9 => generated 2035 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:15:13.242917 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9c3c4d95-823f-47aa-aae8-dc93bdddbcf0 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:13.243699 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9c3c4d95-823f-47aa-aae8-dc93bdddbcf0 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] [instance: de212c9c-e0e0-471f-8a01-5d180ac28d07] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:13.262152 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9c3c4d95-823f-47aa-aae8-dc93bdddbcf0 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:13.262851 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9c3c4d95-823f-47aa-aae8-dc93bdddbcf0 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:13.263671 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9c3c4d95-823f-47aa-aae8-dc93bdddbcf0 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:13.265063 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9c3c4d95-823f-47aa-aae8-dc93bdddbcf0 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:13.265602 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9c3c4d95-823f-47aa-aae8-dc93bdddbcf0 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:13.266450 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9c3c4d95-823f-47aa-aae8-dc93bdddbcf0 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:13.277944 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7d583aa8-c9ff-442d-98b8-da4d72c7c25d tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937a26d78d07458eaadc68fc9828d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3730de9c65d4add9f6f34aa7d5aa77e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:13.286385 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7d583aa8-c9ff-442d-98b8-da4d72c7c25d tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] 10.222.0.42 "GET /compute/v2.1/servers/df71be7c-a3b2-4d32-bdbd-45eb56a93154" status: 200 len: 1313 microversion: 2.1 time: 0.861826 Oct 23 01:15:13.287333 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 599/1283] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:12 2022] GET /compute/v2.1/servers/df71be7c-a3b2-4d32-bdbd-45eb56a93154 => generated 1313 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:13.292088 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b33482bb-8daa-4616-9f24-d1532e9843ef tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:13.292932 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b33482bb-8daa-4616-9f24-d1532e9843ef tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 808c58c6-1606-4553-8dd3-8292fa1202b5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:13.299360 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b33482bb-8daa-4616-9f24-d1532e9843ef tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:13.300054 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b33482bb-8daa-4616-9f24-d1532e9843ef tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:13.305458 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b33482bb-8daa-4616-9f24-d1532e9843ef tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:13.305458 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b33482bb-8daa-4616-9f24-d1532e9843ef tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:13.305458 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b33482bb-8daa-4616-9f24-d1532e9843ef tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:13.305458 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b33482bb-8daa-4616-9f24-d1532e9843ef tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:13.588795 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9c3c4d95-823f-47aa-aae8-dc93bdddbcf0 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80703c3d1dae419c9fd5ca103f3c28bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356a4b3819db457fb5caf68ded0212fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:13.592770 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b33482bb-8daa-4616-9f24-d1532e9843ef tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:13.602147 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b33482bb-8daa-4616-9f24-d1532e9843ef tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/808c58c6-1606-4553-8dd3-8292fa1202b5" status: 200 len: 1319 microversion: 2.1 time: 0.313460 Oct 23 01:15:13.608287 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9c3c4d95-823f-47aa-aae8-dc93bdddbcf0 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] 10.222.0.42 "GET /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07" status: 200 len: 1318 microversion: 2.1 time: 0.374552 Oct 23 01:15:13.618226 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 600/1284] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:13 2022] GET /compute/v2.1/servers/808c58c6-1606-4553-8dd3-8292fa1202b5 => generated 1319 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:13.624059 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 685/1285] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:13 2022] GET /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07 => generated 1318 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:13.624548 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-38962070-0ac5-4a22-bc78-d1f23941d620 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:13.625324 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-38962070-0ac5-4a22-bc78-d1f23941d620 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 8025dc46-71af-4fec-8f54-5ae9e92cc31f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:13.633467 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-38962070-0ac5-4a22-bc78-d1f23941d620 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:13.634496 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-38962070-0ac5-4a22-bc78-d1f23941d620 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:13.635125 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-38962070-0ac5-4a22-bc78-d1f23941d620 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:13.636160 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-38962070-0ac5-4a22-bc78-d1f23941d620 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:13.637035 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e10d7f4b-9285-4650-8225-48a2e879efd3 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:13.637270 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-38962070-0ac5-4a22-bc78-d1f23941d620 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:13.637837 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e10d7f4b-9285-4650-8225-48a2e879efd3 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 291a0671-7bab-404a-b836-95fb7acfd1dd] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:13.638069 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-38962070-0ac5-4a22-bc78-d1f23941d620 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:13.649133 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e10d7f4b-9285-4650-8225-48a2e879efd3 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:13.650326 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e10d7f4b-9285-4650-8225-48a2e879efd3 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:13.650888 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e10d7f4b-9285-4650-8225-48a2e879efd3 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:13.651782 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e10d7f4b-9285-4650-8225-48a2e879efd3 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:13.652380 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e10d7f4b-9285-4650-8225-48a2e879efd3 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:13.652911 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e10d7f4b-9285-4650-8225-48a2e879efd3 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:13.786286 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e10d7f4b-9285-4650-8225-48a2e879efd3 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:13.809747 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e10d7f4b-9285-4650-8225-48a2e879efd3 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd" status: 200 len: 1282 microversion: 2.1 time: 0.184006 Oct 23 01:15:13.815287 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 686/1286] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:13 2022] GET /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd => generated 1282 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:13.827550 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-3c903da7-dd9d-409c-8d5e-8be27226b5a3 req-92974224-72f5-49ce-bebf-2b3bd0476ad7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59cf7af1-8bca-4768-ac86-6e56d0649946", "name": "network-vif-deleted", "tag": "1af179f1-7395-4c6c-857c-f6bcc55abbbb"}, {"name": "network-changed", "server_uuid": "de212c9c-e0e0-471f-8a01-5d180ac28d07", "tag": "e105d80f-51cc-42c7-8ece-f8e8a1806e71"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:15:13.849709 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-3c903da7-dd9d-409c-8d5e-8be27226b5a3 req-92974224-72f5-49ce-bebf-2b3bd0476ad7 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:13.850232 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-3c903da7-dd9d-409c-8d5e-8be27226b5a3 req-92974224-72f5-49ce-bebf-2b3bd0476ad7 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:13.850717 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-3c903da7-dd9d-409c-8d5e-8be27226b5a3 req-92974224-72f5-49ce-bebf-2b3bd0476ad7 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:13.869152 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-3c903da7-dd9d-409c-8d5e-8be27226b5a3 req-92974224-72f5-49ce-bebf-2b3bd0476ad7 service nova] Creating event network-vif-deleted:1af179f1-7395-4c6c-857c-f6bcc55abbbb for instance 59cf7af1-8bca-4768-ac86-6e56d0649946 on n-h1-master-1 Oct 23 01:15:13.869677 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-3c903da7-dd9d-409c-8d5e-8be27226b5a3 req-92974224-72f5-49ce-bebf-2b3bd0476ad7 service nova] Creating event network-changed:e105d80f-51cc-42c7-8ece-f8e8a1806e71 for instance de212c9c-e0e0-471f-8a01-5d180ac28d07 on n-h1-master-1 Oct 23 01:15:13.877044 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-3c903da7-dd9d-409c-8d5e-8be27226b5a3 req-92974224-72f5-49ce-bebf-2b3bd0476ad7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.059693 Oct 23 01:15:13.878727 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 687/1287] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:15:13.886852 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4490af8a-bf6a-4872-9119-fcc56f1f5367 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:13.887551 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4490af8a-bf6a-4872-9119-fcc56f1f5367 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 59cf7af1-8bca-4768-ac86-6e56d0649946] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:13.895178 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4490af8a-bf6a-4872-9119-fcc56f1f5367 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:13.895673 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4490af8a-bf6a-4872-9119-fcc56f1f5367 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:13.896110 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4490af8a-bf6a-4872-9119-fcc56f1f5367 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:13.896816 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4490af8a-bf6a-4872-9119-fcc56f1f5367 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:13.897275 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4490af8a-bf6a-4872-9119-fcc56f1f5367 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:13.897729 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4490af8a-bf6a-4872-9119-fcc56f1f5367 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:13.927047 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-38962070-0ac5-4a22-bc78-d1f23941d620 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:13.932481 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4490af8a-bf6a-4872-9119-fcc56f1f5367 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:13.936364 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4490af8a-bf6a-4872-9119-fcc56f1f5367 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:13.936364 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4490af8a-bf6a-4872-9119-fcc56f1f5367 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:13.936364 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-4490af8a-bf6a-4872-9119-fcc56f1f5367 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lazy-loading 'fault' on Instance uuid 59cf7af1-8bca-4768-ac86-6e56d0649946 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:15:13.942760 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:15:13.950273 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-38962070-0ac5-4a22-bc78-d1f23941d620 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f" status: 200 len: 1541 microversion: 2.1 time: 0.330545 Oct 23 01:15:13.951408 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 601/1288] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:13 2022] GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f => generated 1541 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:13.973408 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2913ef49-1b1e-4812-8a3b-724d4e6cff65 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Action: 'create', calling method: .version_select at 0x7f5cc21c7a60>, body: {"keypair": {"name": "tempest-keypair-1250025057", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7/c0FtLRi3NIq0GVD8uyzsKrlMqRS5WYjdx+2FNBnUKc1LMrV1eKaXBfXdLOQfoQhC32Uv14QwPunMpuFa2dd6GdbitXZ74Nd4hjJkT/vuCCjAJybJk+zdWtEwOHq4kA=="}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:15:13.992734 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-2913ef49-1b1e-4812-8a3b-724d4e6cff65 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Getting quotas for project ccc52d9ecfdf43f58b665d06e1008b52. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:15:13.998903 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-2913ef49-1b1e-4812-8a3b-724d4e6cff65 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Getting quotas for user 8a246c84d8f444d59c9d5becae78f75a and project ccc52d9ecfdf43f58b665d06e1008b52. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:15:14.005207 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4490af8a-bf6a-4872-9119-fcc56f1f5367 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262d5984b8c4775b86fae1c0d314718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc8f8cefbf441c98d6bda76e99e3173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:14.014434 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4490af8a-bf6a-4872-9119-fcc56f1f5367 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946" status: 200 len: 1303 microversion: 2.1 time: 0.132396 Oct 23 01:15:14.015755 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 688/1289] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:13 2022] GET /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946 => generated 1303 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:14.022418 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2792e581-25cf-4e24-a335-79177f11d9fb tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:14.023026 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2792e581-25cf-4e24-a335-79177f11d9fb tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:14.029439 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2792e581-25cf-4e24-a335-79177f11d9fb tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:14.030431 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2792e581-25cf-4e24-a335-79177f11d9fb tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:14.031172 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2792e581-25cf-4e24-a335-79177f11d9fb tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:14.031871 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2792e581-25cf-4e24-a335-79177f11d9fb tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:14.032318 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2792e581-25cf-4e24-a335-79177f11d9fb tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:14.032949 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2792e581-25cf-4e24-a335-79177f11d9fb tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:14.147067 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2913ef49-1b1e-4812-8a3b-724d4e6cff65 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.194412 Oct 23 01:15:14.147822 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 602/1290] 10.222.0.42 () {62 vars in 1200 bytes} [Sun Oct 23 01:15:13 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 196 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 23 01:15:14.218162 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2792e581-25cf-4e24-a335-79177f11d9fb tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:14.227908 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2792e581-25cf-4e24-a335-79177f11d9fb tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 200 len: 1717 microversion: 2.1 time: 0.210502 Oct 23 01:15:14.228483 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 689/1291] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:14 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 1717 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:14.311439 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1a26bf08-4847-46bb-8ed0-53bb0f338bd6 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:14.312683 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1a26bf08-4847-46bb-8ed0-53bb0f338bd6 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] [instance: df71be7c-a3b2-4d32-bdbd-45eb56a93154] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:14.313572 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-3ef75a86-636f-47c3-b31d-c93ce7eb2b41 req-bd7d1d63-b5e9-4a60-a16e-71665cec5eb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "808c58c6-1606-4553-8dd3-8292fa1202b5", "tag": "a1d9a75e-ec02-4175-8ef7-8581a5c472dc"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:15:14.322185 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1a26bf08-4847-46bb-8ed0-53bb0f338bd6 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:14.323026 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1a26bf08-4847-46bb-8ed0-53bb0f338bd6 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:14.323852 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1a26bf08-4847-46bb-8ed0-53bb0f338bd6 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:14.324900 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1a26bf08-4847-46bb-8ed0-53bb0f338bd6 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:14.325656 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1a26bf08-4847-46bb-8ed0-53bb0f338bd6 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:14.326315 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1a26bf08-4847-46bb-8ed0-53bb0f338bd6 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:14.327307 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-3ef75a86-636f-47c3-b31d-c93ce7eb2b41 req-bd7d1d63-b5e9-4a60-a16e-71665cec5eb5 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:14.327791 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-3ef75a86-636f-47c3-b31d-c93ce7eb2b41 req-bd7d1d63-b5e9-4a60-a16e-71665cec5eb5 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:14.328207 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-3ef75a86-636f-47c3-b31d-c93ce7eb2b41 req-bd7d1d63-b5e9-4a60-a16e-71665cec5eb5 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:14.357303 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-3ef75a86-636f-47c3-b31d-c93ce7eb2b41 req-bd7d1d63-b5e9-4a60-a16e-71665cec5eb5 service nova] Creating event network-changed:a1d9a75e-ec02-4175-8ef7-8581a5c472dc for instance 808c58c6-1606-4553-8dd3-8292fa1202b5 on n-h1-master-1 Oct 23 01:15:14.371323 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-3ef75a86-636f-47c3-b31d-c93ce7eb2b41 req-bd7d1d63-b5e9-4a60-a16e-71665cec5eb5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056014 Oct 23 01:15:14.372862 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 690/1292] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:15:14.604454 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1a26bf08-4847-46bb-8ed0-53bb0f338bd6 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937a26d78d07458eaadc68fc9828d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3730de9c65d4add9f6f34aa7d5aa77e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:14.611976 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1a26bf08-4847-46bb-8ed0-53bb0f338bd6 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] 10.222.0.42 "GET /compute/v2.1/servers/df71be7c-a3b2-4d32-bdbd-45eb56a93154" status: 200 len: 1313 microversion: 2.1 time: 0.304531 Oct 23 01:15:14.612546 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 603/1293] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:14 2022] GET /compute/v2.1/servers/df71be7c-a3b2-4d32-bdbd-45eb56a93154 => generated 1313 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:14.626441 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c51114ab-3aee-434d-bf93-3ad7304d04e7 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:14.627420 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c51114ab-3aee-434d-bf93-3ad7304d04e7 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 808c58c6-1606-4553-8dd3-8292fa1202b5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:14.635076 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c51114ab-3aee-434d-bf93-3ad7304d04e7 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:14.635574 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c51114ab-3aee-434d-bf93-3ad7304d04e7 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:14.636054 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c51114ab-3aee-434d-bf93-3ad7304d04e7 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:14.636756 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c51114ab-3aee-434d-bf93-3ad7304d04e7 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:14.637215 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c51114ab-3aee-434d-bf93-3ad7304d04e7 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:14.637637 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c51114ab-3aee-434d-bf93-3ad7304d04e7 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:14.638264 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8e7e95ec-a018-4659-89d0-63203fdc9248 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:14.639111 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8e7e95ec-a018-4659-89d0-63203fdc9248 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] [instance: de212c9c-e0e0-471f-8a01-5d180ac28d07] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:14.647920 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8e7e95ec-a018-4659-89d0-63203fdc9248 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:14.648503 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8e7e95ec-a018-4659-89d0-63203fdc9248 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:14.648947 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8e7e95ec-a018-4659-89d0-63203fdc9248 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:14.649681 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8e7e95ec-a018-4659-89d0-63203fdc9248 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:14.650193 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8e7e95ec-a018-4659-89d0-63203fdc9248 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:14.650805 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8e7e95ec-a018-4659-89d0-63203fdc9248 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:14.929873 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8e7e95ec-a018-4659-89d0-63203fdc9248 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80703c3d1dae419c9fd5ca103f3c28bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356a4b3819db457fb5caf68ded0212fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:14.936982 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c51114ab-3aee-434d-bf93-3ad7304d04e7 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:14.941998 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8e7e95ec-a018-4659-89d0-63203fdc9248 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] 10.222.0.42 "GET /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07" status: 200 len: 1318 microversion: 2.1 time: 0.308150 Oct 23 01:15:14.958154 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 604/1294] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:14 2022] GET /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07 => generated 1318 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:15:14.962506 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c51114ab-3aee-434d-bf93-3ad7304d04e7 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/808c58c6-1606-4553-8dd3-8292fa1202b5" status: 200 len: 1319 microversion: 2.1 time: 0.341016 Oct 23 01:15:14.964792 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 691/1295] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:14 2022] GET /compute/v2.1/servers/808c58c6-1606-4553-8dd3-8292fa1202b5 => generated 1319 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:14.964906 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d22dc693-a0c4-4bfe-8d92-418ddb4b7702 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:14.965673 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d22dc693-a0c4-4bfe-8d92-418ddb4b7702 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 291a0671-7bab-404a-b836-95fb7acfd1dd] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:14.973752 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d22dc693-a0c4-4bfe-8d92-418ddb4b7702 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:14.974836 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d22dc693-a0c4-4bfe-8d92-418ddb4b7702 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:14.975344 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d22dc693-a0c4-4bfe-8d92-418ddb4b7702 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:14.976671 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d22dc693-a0c4-4bfe-8d92-418ddb4b7702 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:14.977657 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d22dc693-a0c4-4bfe-8d92-418ddb4b7702 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:14.978355 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d22dc693-a0c4-4bfe-8d92-418ddb4b7702 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:14.988897 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d9f2fe34-1ce6-4ee2-bfe7-5b035e25f43b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:14.995577 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d9f2fe34-1ce6-4ee2-bfe7-5b035e25f43b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 8025dc46-71af-4fec-8f54-5ae9e92cc31f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:15.006977 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9f2fe34-1ce6-4ee2-bfe7-5b035e25f43b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:15.007931 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9f2fe34-1ce6-4ee2-bfe7-5b035e25f43b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:15.010283 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9f2fe34-1ce6-4ee2-bfe7-5b035e25f43b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:15.012767 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9f2fe34-1ce6-4ee2-bfe7-5b035e25f43b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:15.014038 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9f2fe34-1ce6-4ee2-bfe7-5b035e25f43b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:15.014733 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9f2fe34-1ce6-4ee2-bfe7-5b035e25f43b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:15.034243 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=100 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:15:15.366617 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d22dc693-a0c4-4bfe-8d92-418ddb4b7702 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:15.376051 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d22dc693-a0c4-4bfe-8d92-418ddb4b7702 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd" status: 200 len: 1324 microversion: 2.1 time: 0.416299 Oct 23 01:15:15.376639 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 605/1296] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:14 2022] GET /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd => generated 1324 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:15.383938 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a6263e2f-deeb-46b4-8e15-8e382e627e60 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:15.384791 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a6263e2f-deeb-46b4-8e15-8e382e627e60 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 59cf7af1-8bca-4768-ac86-6e56d0649946] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:15.391605 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6263e2f-deeb-46b4-8e15-8e382e627e60 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:15.392099 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6263e2f-deeb-46b4-8e15-8e382e627e60 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:15.392537 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6263e2f-deeb-46b4-8e15-8e382e627e60 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:15.393230 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6263e2f-deeb-46b4-8e15-8e382e627e60 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:15.393685 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6263e2f-deeb-46b4-8e15-8e382e627e60 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:15.394187 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6263e2f-deeb-46b4-8e15-8e382e627e60 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:15.401642 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d9f2fe34-1ce6-4ee2-bfe7-5b035e25f43b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:15.412618 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d9f2fe34-1ce6-4ee2-bfe7-5b035e25f43b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f" status: 200 len: 1541 microversion: 2.1 time: 0.427219 Oct 23 01:15:15.413253 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-a6263e2f-deeb-46b4-8e15-8e382e627e60 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] HTTP exception thrown: Instance 59cf7af1-8bca-4768-ac86-6e56d0649946 could not be found. Oct 23 01:15:15.414155 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 692/1297] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:14 2022] GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f => generated 1541 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:15.414982 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a6263e2f-deeb-46b4-8e15-8e382e627e60 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Request method failure captured: Oct 23 01:15:15.414982 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946 HTTP/1.1 Oct 23 01:15:15.414982 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:15:15.414982 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:15:15.414982 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:15:15.414982 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:15:15.414982 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:15:15.414982 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:15:15.414982 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:15:15.414982 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:15:15.414982 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJUqfBfUUlEO3Zu3H2tCeUoe5XnfNaUD7bKiDt2dwM_vHXdRyWKJRkiWdJuFGdub4DDH4raRIyo0Mk5Nmx3s4iA5jZNhGnIAixZlPXpUoWudHmkA-a7smsKDtHuvdILrKw6BGAV303EGuwNXW2iARTfT7KcTxhWKB1Hm1GgND3UMLls Oct 23 01:15:15.414982 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:15:15.414982 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:15:15.414982 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:15:15.414982 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:15:15.414982 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:15:15.414982 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:15:15.414982 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: abc8f8cefbf441c98d6bda76e99e3173 Oct 23 01:15:15.414982 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersTestMultiNic-1641531956 Oct 23 01:15:15.414982 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:15:15.414982 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:15:15.416528 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/abc8f8cefbf441c98d6bda76e99e3173"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_abc8f8cefbf441c98d6bda76e99e3173"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/abc8f8cefbf441c98d6bda76e99e3173"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/abc8f8cefbf441c98d6bda76e99e3173"}]}] Oct 23 01:15:15.416528 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersTestMultiNic-1641531956 Oct 23 01:15:15.416528 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: abc8f8cefbf441c98d6bda76e99e3173 Oct 23 01:15:15.416528 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersTestMultiNic-1641531956 Oct 23 01:15:15.416528 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersTestMultiNic-1641531956-project Oct 23 01:15:15.416528 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:15:15.416528 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:15:15.416528 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 7262d5984b8c4775b86fae1c0d314718 Oct 23 01:15:15.416528 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersTestMultiNic-1641531956-project Oct 23 01:15:15.416528 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:15:15.416528 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 59cf7af1-8bca-4768-ac86-6e56d0649946 could not be found. Oct 23 01:15:15.416528 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '59cf7af1-8bca-4768-ac86-6e56d0649946'} Oct 23 01:15:15.417549 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:15:15.417549 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:15:15.417549 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:15:15.417549 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:15:15.417549 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:15:15.417549 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:15:15.417549 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:15:15.417549 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:15:15.417549 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:15:15.417549 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:15:15.417549 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59cf7af1-8bca-4768-ac86-6e56d0649946 could not be found. Oct 23 01:15:15.417549 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:15:15.417549 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:15:15.417549 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:15:15.417549 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:15:15.417549 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:15:15.417549 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:15:15.417549 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:15:15.417549 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:15:15.417549 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:15:15.419564 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:15:15.419564 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:15:15.419564 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:15:15.419564 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:15:15.419564 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:15:15.419564 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:15:15.419564 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:15:15.419564 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59cf7af1-8bca-4768-ac86-6e56d0649946 could not be found. Oct 23 01:15:15.419564 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:15:15.419564 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:15:15.419564 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:15:15.419564 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:15:15.419564 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:15:15.419564 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:15:15.419564 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:15:15.419564 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:15:15.419564 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59cf7af1-8bca-4768-ac86-6e56d0649946 could not be found. Oct 23 01:15:15.419564 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:15:15.421701 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a6263e2f-deeb-46b4-8e15-8e382e627e60 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Returning 404 to user: Instance 59cf7af1-8bca-4768-ac86-6e56d0649946 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:15:15.421701 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a6263e2f-deeb-46b4-8e15-8e382e627e60 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946" status: 404 len: 111 microversion: 2.1 time: 0.037968 Oct 23 01:15:15.421701 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 606/1298] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:15 2022] GET /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:15:15.430769 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-792cba29-af05-47a4-af2e-66d8f0030e69 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:15.437458 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-792cba29-af05-47a4-af2e-66d8f0030e69 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:15.439333 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-792cba29-af05-47a4-af2e-66d8f0030e69 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:15.439826 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-792cba29-af05-47a4-af2e-66d8f0030e69 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:15.440591 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-792cba29-af05-47a4-af2e-66d8f0030e69 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:15.441305 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-792cba29-af05-47a4-af2e-66d8f0030e69 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:15.441758 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-792cba29-af05-47a4-af2e-66d8f0030e69 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:15.443194 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-792cba29-af05-47a4-af2e-66d8f0030e69 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:15.641426 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c606adce-c5fc-4744-9800-801cd985d3f9 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:15.643200 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c606adce-c5fc-4744-9800-801cd985d3f9 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] [instance: df71be7c-a3b2-4d32-bdbd-45eb56a93154] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:15.651133 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c606adce-c5fc-4744-9800-801cd985d3f9 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:15.656870 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c606adce-c5fc-4744-9800-801cd985d3f9 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:15.657448 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c606adce-c5fc-4744-9800-801cd985d3f9 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:15.658665 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c606adce-c5fc-4744-9800-801cd985d3f9 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:15.659659 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c606adce-c5fc-4744-9800-801cd985d3f9 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:15.660166 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c606adce-c5fc-4744-9800-801cd985d3f9 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:15.802811 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-792cba29-af05-47a4-af2e-66d8f0030e69 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:15.817757 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-792cba29-af05-47a4-af2e-66d8f0030e69 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 200 len: 1717 microversion: 2.1 time: 0.391654 Oct 23 01:15:15.822520 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 693/1299] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:15 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 1717 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:15.862199 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-a757cd28-640c-4c50-8bb9-04fe59552380 req-ba6abf24-8db1-4679-9be2-eb775136d92c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df71be7c-a3b2-4d32-bdbd-45eb56a93154", "name": "network-vif-plugged", "status": "completed", "tag": "dfef34ff-6be1-4050-abaa-b1b9919c4da1"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:15:15.862475 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c606adce-c5fc-4744-9800-801cd985d3f9 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937a26d78d07458eaadc68fc9828d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3730de9c65d4add9f6f34aa7d5aa77e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:15.871452 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c606adce-c5fc-4744-9800-801cd985d3f9 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] 10.222.0.42 "GET /compute/v2.1/servers/df71be7c-a3b2-4d32-bdbd-45eb56a93154" status: 200 len: 1313 microversion: 2.1 time: 0.239524 Oct 23 01:15:15.872037 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 607/1300] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:15 2022] GET /compute/v2.1/servers/df71be7c-a3b2-4d32-bdbd-45eb56a93154 => generated 1313 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:15.876820 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-a757cd28-640c-4c50-8bb9-04fe59552380 req-ba6abf24-8db1-4679-9be2-eb775136d92c service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:15.877597 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-a757cd28-640c-4c50-8bb9-04fe59552380 req-ba6abf24-8db1-4679-9be2-eb775136d92c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:15.878228 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-a757cd28-640c-4c50-8bb9-04fe59552380 req-ba6abf24-8db1-4679-9be2-eb775136d92c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:15.893170 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-a757cd28-640c-4c50-8bb9-04fe59552380 req-ba6abf24-8db1-4679-9be2-eb775136d92c service nova] Creating event network-vif-plugged:dfef34ff-6be1-4050-abaa-b1b9919c4da1 for instance df71be7c-a3b2-4d32-bdbd-45eb56a93154 on n-h1-master-1 Oct 23 01:15:15.899638 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-a757cd28-640c-4c50-8bb9-04fe59552380 req-ba6abf24-8db1-4679-9be2-eb775136d92c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042310 Oct 23 01:15:15.900836 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 694/1301] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:15:15.924437 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-41e357b7-101a-43a3-a518-9b751d424d95 req-f07da116-d011-43a1-bf13-c7c0932b5875 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "291a0671-7bab-404a-b836-95fb7acfd1dd", "tag": "35757a24-1cdf-43a8-b909-50d039effa1c"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:15:15.935701 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-41e357b7-101a-43a3-a518-9b751d424d95 req-f07da116-d011-43a1-bf13-c7c0932b5875 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:15.936194 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-41e357b7-101a-43a3-a518-9b751d424d95 req-f07da116-d011-43a1-bf13-c7c0932b5875 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:15.937021 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-41e357b7-101a-43a3-a518-9b751d424d95 req-f07da116-d011-43a1-bf13-c7c0932b5875 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:15.949621 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-41e357b7-101a-43a3-a518-9b751d424d95 req-f07da116-d011-43a1-bf13-c7c0932b5875 service nova] Creating event network-changed:35757a24-1cdf-43a8-b909-50d039effa1c for instance 291a0671-7bab-404a-b836-95fb7acfd1dd on n-h2-master-1 Oct 23 01:15:15.954920 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-41e357b7-101a-43a3-a518-9b751d424d95 req-f07da116-d011-43a1-bf13-c7c0932b5875 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035570 Oct 23 01:15:15.956076 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 608/1302] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:15:15.967213 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-82cc269f-914c-49ff-abfa-682964ad5855 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:15.967953 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-82cc269f-914c-49ff-abfa-682964ad5855 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] [instance: de212c9c-e0e0-471f-8a01-5d180ac28d07] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:15.976092 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-82cc269f-914c-49ff-abfa-682964ad5855 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:15.978177 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-82cc269f-914c-49ff-abfa-682964ad5855 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:15.978177 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-82cc269f-914c-49ff-abfa-682964ad5855 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:15.978177 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-82cc269f-914c-49ff-abfa-682964ad5855 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:15.978747 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-82cc269f-914c-49ff-abfa-682964ad5855 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:15.979182 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-82cc269f-914c-49ff-abfa-682964ad5855 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:15.990357 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-62e4ae45-917b-4b6f-a9c9-87bfb769a210 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:15.991926 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-62e4ae45-917b-4b6f-a9c9-87bfb769a210 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 808c58c6-1606-4553-8dd3-8292fa1202b5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:15.999424 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-62e4ae45-917b-4b6f-a9c9-87bfb769a210 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:16.000214 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-62e4ae45-917b-4b6f-a9c9-87bfb769a210 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:16.000902 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-62e4ae45-917b-4b6f-a9c9-87bfb769a210 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:16.002494 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-62e4ae45-917b-4b6f-a9c9-87bfb769a210 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:16.003169 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-62e4ae45-917b-4b6f-a9c9-87bfb769a210 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:16.003808 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-62e4ae45-917b-4b6f-a9c9-87bfb769a210 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:16.276869 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-82cc269f-914c-49ff-abfa-682964ad5855 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80703c3d1dae419c9fd5ca103f3c28bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356a4b3819db457fb5caf68ded0212fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:16.286427 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-82cc269f-914c-49ff-abfa-682964ad5855 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] 10.222.0.42 "GET /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07" status: 200 len: 1318 microversion: 2.1 time: 0.324075 Oct 23 01:15:16.295840 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 695/1303] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:15 2022] GET /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07 => generated 1318 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:16.329100 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-62e4ae45-917b-4b6f-a9c9-87bfb769a210 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:16.340259 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-62e4ae45-917b-4b6f-a9c9-87bfb769a210 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/808c58c6-1606-4553-8dd3-8292fa1202b5" status: 200 len: 1319 microversion: 2.1 time: 0.354187 Oct 23 01:15:16.341409 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 609/1304] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:15 2022] GET /compute/v2.1/servers/808c58c6-1606-4553-8dd3-8292fa1202b5 => generated 1319 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:15:16.404265 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-950ed510-b5d8-4374-bb8b-3f29880c5e8c tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:16.406829 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-950ed510-b5d8-4374-bb8b-3f29880c5e8c tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 291a0671-7bab-404a-b836-95fb7acfd1dd] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:16.424004 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-950ed510-b5d8-4374-bb8b-3f29880c5e8c tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:16.426676 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-950ed510-b5d8-4374-bb8b-3f29880c5e8c tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:16.433549 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-950ed510-b5d8-4374-bb8b-3f29880c5e8c tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:16.436027 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-950ed510-b5d8-4374-bb8b-3f29880c5e8c tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:16.436950 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-950ed510-b5d8-4374-bb8b-3f29880c5e8c tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:16.437553 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-950ed510-b5d8-4374-bb8b-3f29880c5e8c tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:16.439947 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-20bca8e3-c91c-4212-9370-201c2725707e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:16.441195 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-20bca8e3-c91c-4212-9370-201c2725707e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 8025dc46-71af-4fec-8f54-5ae9e92cc31f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:16.448190 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20bca8e3-c91c-4212-9370-201c2725707e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:16.458800 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20bca8e3-c91c-4212-9370-201c2725707e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:16.458800 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20bca8e3-c91c-4212-9370-201c2725707e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:16.458800 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20bca8e3-c91c-4212-9370-201c2725707e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:16.458800 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20bca8e3-c91c-4212-9370-201c2725707e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:16.459245 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20bca8e3-c91c-4212-9370-201c2725707e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:16.775846 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-20bca8e3-c91c-4212-9370-201c2725707e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:16.784486 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-950ed510-b5d8-4374-bb8b-3f29880c5e8c tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:16.786983 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-20bca8e3-c91c-4212-9370-201c2725707e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f" status: 200 len: 1541 microversion: 2.1 time: 0.348907 Oct 23 01:15:16.786983 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 610/1305] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:16 2022] GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f => generated 1541 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:15:16.799812 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-950ed510-b5d8-4374-bb8b-3f29880c5e8c tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd" status: 200 len: 1324 microversion: 2.1 time: 0.398881 Oct 23 01:15:16.801056 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 696/1306] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:16 2022] GET /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd => generated 1324 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:16.841917 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6b1f1642-a854-4fc5-abe1-cfc31c686fd3 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:16.842670 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6b1f1642-a854-4fc5-abe1-cfc31c686fd3 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:16.859265 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b1f1642-a854-4fc5-abe1-cfc31c686fd3 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:16.860086 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b1f1642-a854-4fc5-abe1-cfc31c686fd3 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:16.860520 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b1f1642-a854-4fc5-abe1-cfc31c686fd3 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:16.861489 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b1f1642-a854-4fc5-abe1-cfc31c686fd3 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:16.862792 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b1f1642-a854-4fc5-abe1-cfc31c686fd3 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:16.864219 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b1f1642-a854-4fc5-abe1-cfc31c686fd3 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:16.895428 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ec2f9f78-b856-42bd-8f0a-789b097c3add tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:16.896373 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ec2f9f78-b856-42bd-8f0a-789b097c3add tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] [instance: df71be7c-a3b2-4d32-bdbd-45eb56a93154] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:16.905621 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec2f9f78-b856-42bd-8f0a-789b097c3add tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:16.908086 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec2f9f78-b856-42bd-8f0a-789b097c3add tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:16.913305 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec2f9f78-b856-42bd-8f0a-789b097c3add tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:16.913305 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec2f9f78-b856-42bd-8f0a-789b097c3add tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:16.913305 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec2f9f78-b856-42bd-8f0a-789b097c3add tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:16.913305 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec2f9f78-b856-42bd-8f0a-789b097c3add tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:17.384589 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6b1f1642-a854-4fc5-abe1-cfc31c686fd3 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:17.396592 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6b1f1642-a854-4fc5-abe1-cfc31c686fd3 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 200 len: 1717 microversion: 2.1 time: 0.559647 Oct 23 01:15:17.398207 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 611/1307] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:16 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 1717 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:17.418801 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7787ec65-8c53-40cf-9744-edfdb4b824ef tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:17.421850 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7787ec65-8c53-40cf-9744-edfdb4b824ef tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] [instance: de212c9c-e0e0-471f-8a01-5d180ac28d07] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:17.429651 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7787ec65-8c53-40cf-9744-edfdb4b824ef tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:17.430704 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7787ec65-8c53-40cf-9744-edfdb4b824ef tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:17.432689 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7787ec65-8c53-40cf-9744-edfdb4b824ef tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:17.434057 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7787ec65-8c53-40cf-9744-edfdb4b824ef tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:17.435494 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7787ec65-8c53-40cf-9744-edfdb4b824ef tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:17.437087 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7787ec65-8c53-40cf-9744-edfdb4b824ef tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:17.438943 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ec2f9f78-b856-42bd-8f0a-789b097c3add tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937a26d78d07458eaadc68fc9828d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3730de9c65d4add9f6f34aa7d5aa77e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:17.455002 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ec2f9f78-b856-42bd-8f0a-789b097c3add tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] 10.222.0.42 "GET /compute/v2.1/servers/df71be7c-a3b2-4d32-bdbd-45eb56a93154" status: 200 len: 1313 microversion: 2.1 time: 0.564001 Oct 23 01:15:17.456571 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 697/1308] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:16 2022] GET /compute/v2.1/servers/df71be7c-a3b2-4d32-bdbd-45eb56a93154 => generated 1313 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:17.464440 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e45d5ca6-a9e1-438d-978c-0e90f05e8943 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:17.465419 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e45d5ca6-a9e1-438d-978c-0e90f05e8943 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 808c58c6-1606-4553-8dd3-8292fa1202b5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:17.480406 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e45d5ca6-a9e1-438d-978c-0e90f05e8943 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:17.480914 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e45d5ca6-a9e1-438d-978c-0e90f05e8943 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:17.481349 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e45d5ca6-a9e1-438d-978c-0e90f05e8943 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:17.488689 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e45d5ca6-a9e1-438d-978c-0e90f05e8943 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:17.489276 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e45d5ca6-a9e1-438d-978c-0e90f05e8943 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:17.489720 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e45d5ca6-a9e1-438d-978c-0e90f05e8943 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:17.526761 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=6 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:15:18.113336 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7787ec65-8c53-40cf-9744-edfdb4b824ef tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80703c3d1dae419c9fd5ca103f3c28bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356a4b3819db457fb5caf68ded0212fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:18.123163 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7787ec65-8c53-40cf-9744-edfdb4b824ef tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] 10.222.0.42 "GET /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07" status: 200 len: 1318 microversion: 2.1 time: 0.721897 Oct 23 01:15:18.124050 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 612/1309] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:17 2022] GET /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07 => generated 1318 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:18.129353 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3f862fb7-38e0-40a7-859f-ffa36af4c436 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:18.130144 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3f862fb7-38e0-40a7-859f-ffa36af4c436 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 8025dc46-71af-4fec-8f54-5ae9e92cc31f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:18.137453 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3f862fb7-38e0-40a7-859f-ffa36af4c436 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:18.150975 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3f862fb7-38e0-40a7-859f-ffa36af4c436 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:18.151819 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3f862fb7-38e0-40a7-859f-ffa36af4c436 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:18.167675 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3f862fb7-38e0-40a7-859f-ffa36af4c436 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:18.172809 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3f862fb7-38e0-40a7-859f-ffa36af4c436 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:18.173791 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3f862fb7-38e0-40a7-859f-ffa36af4c436 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:18.198581 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e45d5ca6-a9e1-438d-978c-0e90f05e8943 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:18.214146 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e45d5ca6-a9e1-438d-978c-0e90f05e8943 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/808c58c6-1606-4553-8dd3-8292fa1202b5" status: 200 len: 1319 microversion: 2.1 time: 0.755344 Oct 23 01:15:18.215920 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 698/1310] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:17 2022] GET /compute/v2.1/servers/808c58c6-1606-4553-8dd3-8292fa1202b5 => generated 1319 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:18.232410 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d22bfb26-9f11-4aab-a9a4-77fc54f8586d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:18.235604 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d22bfb26-9f11-4aab-a9a4-77fc54f8586d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 291a0671-7bab-404a-b836-95fb7acfd1dd] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:18.242116 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d22bfb26-9f11-4aab-a9a4-77fc54f8586d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:18.242602 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d22bfb26-9f11-4aab-a9a4-77fc54f8586d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:18.243034 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d22bfb26-9f11-4aab-a9a4-77fc54f8586d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:18.243733 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d22bfb26-9f11-4aab-a9a4-77fc54f8586d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:18.244181 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d22bfb26-9f11-4aab-a9a4-77fc54f8586d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:18.244860 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d22bfb26-9f11-4aab-a9a4-77fc54f8586d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:18.486652 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3f862fb7-38e0-40a7-859f-ffa36af4c436 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:18.498391 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3f862fb7-38e0-40a7-859f-ffa36af4c436 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f" status: 200 len: 1541 microversion: 2.1 time: 0.372942 Oct 23 01:15:18.499212 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 613/1311] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:18 2022] GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f => generated 1541 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:18.503788 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d22bfb26-9f11-4aab-a9a4-77fc54f8586d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:18.512652 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d22bfb26-9f11-4aab-a9a4-77fc54f8586d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd" status: 200 len: 1324 microversion: 2.1 time: 0.295589 Oct 23 01:15:18.513469 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 699/1312] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:18 2022] GET /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd => generated 1324 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:18.514734 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8a894de6-e8d5-4d14-a49d-8b58168f1d55 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:18.515540 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8a894de6-e8d5-4d14-a49d-8b58168f1d55 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:18.520113 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9617c2fc-94f6-4dcf-9989-1457f251c343 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:18.521054 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9617c2fc-94f6-4dcf-9989-1457f251c343 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] [instance: df71be7c-a3b2-4d32-bdbd-45eb56a93154] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:18.523552 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8a894de6-e8d5-4d14-a49d-8b58168f1d55 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:18.524052 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8a894de6-e8d5-4d14-a49d-8b58168f1d55 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:18.529804 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8a894de6-e8d5-4d14-a49d-8b58168f1d55 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:18.529804 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8a894de6-e8d5-4d14-a49d-8b58168f1d55 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:18.529804 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8a894de6-e8d5-4d14-a49d-8b58168f1d55 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:18.529804 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8a894de6-e8d5-4d14-a49d-8b58168f1d55 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:18.530773 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9617c2fc-94f6-4dcf-9989-1457f251c343 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:18.531257 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9617c2fc-94f6-4dcf-9989-1457f251c343 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:18.532013 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9617c2fc-94f6-4dcf-9989-1457f251c343 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:18.532832 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9617c2fc-94f6-4dcf-9989-1457f251c343 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:18.533744 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9617c2fc-94f6-4dcf-9989-1457f251c343 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:18.534406 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9617c2fc-94f6-4dcf-9989-1457f251c343 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:18.757956 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8a894de6-e8d5-4d14-a49d-8b58168f1d55 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:18.775774 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8a894de6-e8d5-4d14-a49d-8b58168f1d55 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 200 len: 1717 microversion: 2.1 time: 0.267366 Oct 23 01:15:18.777124 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 614/1313] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:18 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 1717 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:18.791838 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9617c2fc-94f6-4dcf-9989-1457f251c343 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937a26d78d07458eaadc68fc9828d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3730de9c65d4add9f6f34aa7d5aa77e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:18.800056 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b2c98343-6d5e-404a-82f8-bf2cff42ee29 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1597882651", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "f12f5541-6400-4914-829d-7bf5434dae5d"}], "security_groups": [{"name": "tempest-securitygroup--1211463211"}], "key_name": "tempest-keypair-1250025057", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:15:18.809459 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9617c2fc-94f6-4dcf-9989-1457f251c343 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] 10.222.0.42 "GET /compute/v2.1/servers/df71be7c-a3b2-4d32-bdbd-45eb56a93154" status: 200 len: 1313 microversion: 2.1 time: 0.294695 Oct 23 01:15:18.811170 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 700/1314] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:18 2022] GET /compute/v2.1/servers/df71be7c-a3b2-4d32-bdbd-45eb56a93154 => generated 1313 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:18.947829 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-b2c98343-6d5e-404a-82f8-bf2cff42ee29 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] validate_networks() for [('f12f5541-6400-4914-829d-7bf5434dae5d', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:15:19.149158 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-83001ea6-a29c-4a40-9931-4b311dfa2beb tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:19.149774 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-83001ea6-a29c-4a40-9931-4b311dfa2beb tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] [instance: de212c9c-e0e0-471f-8a01-5d180ac28d07] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:19.158952 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83001ea6-a29c-4a40-9931-4b311dfa2beb tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:19.160598 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83001ea6-a29c-4a40-9931-4b311dfa2beb tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:19.161048 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83001ea6-a29c-4a40-9931-4b311dfa2beb tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:19.161811 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83001ea6-a29c-4a40-9931-4b311dfa2beb tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:19.162536 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83001ea6-a29c-4a40-9931-4b311dfa2beb tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:19.163151 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83001ea6-a29c-4a40-9931-4b311dfa2beb tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:19.412107 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-83001ea6-a29c-4a40-9931-4b311dfa2beb tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80703c3d1dae419c9fd5ca103f3c28bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356a4b3819db457fb5caf68ded0212fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:19.421389 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-83001ea6-a29c-4a40-9931-4b311dfa2beb tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] 10.222.0.42 "GET /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07" status: 200 len: 1318 microversion: 2.1 time: 0.276490 Oct 23 01:15:19.432079 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 701/1315] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:19 2022] GET /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07 => generated 1318 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:15:19.441305 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2341233e-3fac-4b69-86b4-76e5c1d71fb7 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:19.446579 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2341233e-3fac-4b69-86b4-76e5c1d71fb7 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 808c58c6-1606-4553-8dd3-8292fa1202b5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:19.456495 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2341233e-3fac-4b69-86b4-76e5c1d71fb7 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:19.458143 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2341233e-3fac-4b69-86b4-76e5c1d71fb7 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:19.458763 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2341233e-3fac-4b69-86b4-76e5c1d71fb7 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:19.459559 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2341233e-3fac-4b69-86b4-76e5c1d71fb7 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:19.461249 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2341233e-3fac-4b69-86b4-76e5c1d71fb7 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:19.461789 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2341233e-3fac-4b69-86b4-76e5c1d71fb7 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:19.592617 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-b2c98343-6d5e-404a-82f8-bf2cff42ee29 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:15:19.593615 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-b2c98343-6d5e-404a-82f8-bf2cff42ee29 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:15:19.594132 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-b2c98343-6d5e-404a-82f8-bf2cff42ee29 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:15:19.594552 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-b2c98343-6d5e-404a-82f8-bf2cff42ee29 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:15:19.594963 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-b2c98343-6d5e-404a-82f8-bf2cff42ee29 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:15:19.603160 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=37 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:15:19.605053 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b2c98343-6d5e-404a-82f8-bf2cff42ee29 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:19.608595 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b2c98343-6d5e-404a-82f8-bf2cff42ee29 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:19.608595 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b2c98343-6d5e-404a-82f8-bf2cff42ee29 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:19.609394 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b2c98343-6d5e-404a-82f8-bf2cff42ee29 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:19.610493 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b2c98343-6d5e-404a-82f8-bf2cff42ee29 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:19.611104 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b2c98343-6d5e-404a-82f8-bf2cff42ee29 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:19.634846 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-b2c98343-6d5e-404a-82f8-bf2cff42ee29 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Getting quotas for project ccc52d9ecfdf43f58b665d06e1008b52. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:15:19.641232 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-b2c98343-6d5e-404a-82f8-bf2cff42ee29 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Getting quotas for user 8a246c84d8f444d59c9d5becae78f75a and project ccc52d9ecfdf43f58b665d06e1008b52. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:15:19.647139 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2341233e-3fac-4b69-86b4-76e5c1d71fb7 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:19.655824 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2341233e-3fac-4b69-86b4-76e5c1d71fb7 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/808c58c6-1606-4553-8dd3-8292fa1202b5" status: 200 len: 1319 microversion: 2.1 time: 0.223483 Oct 23 01:15:19.657136 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 702/1316] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:19 2022] GET /compute/v2.1/servers/808c58c6-1606-4553-8dd3-8292fa1202b5 => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:19.657578 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b2c98343-6d5e-404a-82f8-bf2cff42ee29 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:15:19.660095 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b2c98343-6d5e-404a-82f8-bf2cff42ee29 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:15:19.662632 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-37dbade6-bbd0-44ff-a52f-b09b0fc085d6 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:19.663381 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-37dbade6-bbd0-44ff-a52f-b09b0fc085d6 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 8025dc46-71af-4fec-8f54-5ae9e92cc31f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:19.670004 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-37dbade6-bbd0-44ff-a52f-b09b0fc085d6 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:19.670720 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-37dbade6-bbd0-44ff-a52f-b09b0fc085d6 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:19.671384 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-37dbade6-bbd0-44ff-a52f-b09b0fc085d6 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:19.672607 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-37dbade6-bbd0-44ff-a52f-b09b0fc085d6 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:19.673255 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-37dbade6-bbd0-44ff-a52f-b09b0fc085d6 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:19.673868 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-37dbade6-bbd0-44ff-a52f-b09b0fc085d6 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:19.828144 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b2c98343-6d5e-404a-82f8-bf2cff42ee29 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 1.048545 Oct 23 01:15:19.829234 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 615/1317] 10.222.0.42 () {62 vars in 1188 bytes} [Sun Oct 23 01:15:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 1051 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 23 01:15:19.833754 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-37dbade6-bbd0-44ff-a52f-b09b0fc085d6 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:19.835487 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a0376108-5103-4064-ac90-71ad36495ccd tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:19.836977 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a0376108-5103-4064-ac90-71ad36495ccd tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 291a0671-7bab-404a-b836-95fb7acfd1dd] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:19.843936 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-37dbade6-bbd0-44ff-a52f-b09b0fc085d6 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f" status: 200 len: 1541 microversion: 2.1 time: 0.185255 Oct 23 01:15:19.844176 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a0376108-5103-4064-ac90-71ad36495ccd tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:19.844768 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a0376108-5103-4064-ac90-71ad36495ccd tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:19.845409 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a0376108-5103-4064-ac90-71ad36495ccd tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:19.845797 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 703/1318] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:19 2022] GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f => generated 1541 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:19.846208 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a0376108-5103-4064-ac90-71ad36495ccd tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:19.846921 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a0376108-5103-4064-ac90-71ad36495ccd tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:19.847546 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a0376108-5103-4064-ac90-71ad36495ccd tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:19.852902 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c4e35ac4-daa0-43a6-a11d-aef7275d7cac tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:19.853406 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c4e35ac4-daa0-43a6-a11d-aef7275d7cac tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 59cf7af1-8bca-4768-ac86-6e56d0649946] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:19.875175 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c4e35ac4-daa0-43a6-a11d-aef7275d7cac tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:19.875673 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c4e35ac4-daa0-43a6-a11d-aef7275d7cac tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:19.876102 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c4e35ac4-daa0-43a6-a11d-aef7275d7cac tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:19.895832 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c4e35ac4-daa0-43a6-a11d-aef7275d7cac tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:19.899284 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c4e35ac4-daa0-43a6-a11d-aef7275d7cac tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:19.899911 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c4e35ac4-daa0-43a6-a11d-aef7275d7cac tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:19.923134 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-c4e35ac4-daa0-43a6-a11d-aef7275d7cac tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] HTTP exception thrown: Instance 59cf7af1-8bca-4768-ac86-6e56d0649946 could not be found. Oct 23 01:15:19.925085 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c4e35ac4-daa0-43a6-a11d-aef7275d7cac tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Request method failure captured: Oct 23 01:15:19.925085 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946 HTTP/1.1 Oct 23 01:15:19.925085 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:15:19.925085 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:15:19.925085 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:15:19.925085 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:15:19.925085 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:15:19.925085 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:15:19.925085 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:15:19.925085 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:15:19.925085 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJUqfBfUUlEO3Zu3H2tCeUoe5XnfNaUD7bKiDt2dwM_vHXdRyWKJRkiWdJuFGdub4DDH4raRIyo0Mk5Nmx3s4iA5jZNhGnIAixZlPXpUoWudHmkA-a7smsKDtHuvdILrKw6BGAV303EGuwNXW2iARTfT7KcTxhWKB1Hm1GgND3UMLls Oct 23 01:15:19.925085 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:15:19.925085 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:15:19.925085 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:15:19.925085 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:15:19.925085 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:15:19.925085 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:15:19.925085 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: abc8f8cefbf441c98d6bda76e99e3173 Oct 23 01:15:19.925085 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServersTestMultiNic-1641531956 Oct 23 01:15:19.925085 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:15:19.925085 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:15:19.926790 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/abc8f8cefbf441c98d6bda76e99e3173"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_abc8f8cefbf441c98d6bda76e99e3173"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/abc8f8cefbf441c98d6bda76e99e3173"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/abc8f8cefbf441c98d6bda76e99e3173"}]}] Oct 23 01:15:19.926790 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServersTestMultiNic-1641531956 Oct 23 01:15:19.926790 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: abc8f8cefbf441c98d6bda76e99e3173 Oct 23 01:15:19.926790 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServersTestMultiNic-1641531956 Oct 23 01:15:19.926790 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServersTestMultiNic-1641531956-project Oct 23 01:15:19.926790 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:15:19.926790 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:15:19.926790 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 7262d5984b8c4775b86fae1c0d314718 Oct 23 01:15:19.926790 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServersTestMultiNic-1641531956-project Oct 23 01:15:19.926790 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:15:19.926790 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 59cf7af1-8bca-4768-ac86-6e56d0649946 could not be found. Oct 23 01:15:19.926790 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '59cf7af1-8bca-4768-ac86-6e56d0649946'} Oct 23 01:15:19.927703 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:15:19.927703 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:15:19.927703 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:15:19.927703 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:15:19.927703 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:15:19.927703 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:15:19.927703 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:15:19.927703 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:15:19.927703 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:15:19.927703 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:15:19.927703 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59cf7af1-8bca-4768-ac86-6e56d0649946 could not be found. Oct 23 01:15:19.927703 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:15:19.927703 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:15:19.927703 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:15:19.927703 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:15:19.927703 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:15:19.927703 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:15:19.927703 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:15:19.927703 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:15:19.927703 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:15:19.929229 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:15:19.929229 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:15:19.929229 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:15:19.929229 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:15:19.929229 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:15:19.929229 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:15:19.929229 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:15:19.929229 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:15:19.929229 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:15:19.929229 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59cf7af1-8bca-4768-ac86-6e56d0649946 could not be found. Oct 23 01:15:19.929229 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:15:19.929229 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:15:19.929229 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:15:19.929229 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:15:19.929229 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:15:19.929229 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:15:19.929229 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:15:19.929229 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:15:19.929229 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59cf7af1-8bca-4768-ac86-6e56d0649946 could not be found. Oct 23 01:15:19.929229 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:15:19.931466 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c4e35ac4-daa0-43a6-a11d-aef7275d7cac tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Returning 404 to user: Instance 59cf7af1-8bca-4768-ac86-6e56d0649946 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:15:19.932461 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c4e35ac4-daa0-43a6-a11d-aef7275d7cac tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "DELETE /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946" status: 404 len: 111 microversion: 2.1 time: 0.085342 Oct 23 01:15:19.933500 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 704/1319] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:15:19 2022] DELETE /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:15:19.938594 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cbe8fcd0-b1dd-40dd-abce-032a5d2f39a1 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:19.939427 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cbe8fcd0-b1dd-40dd-abce-032a5d2f39a1 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:19.947218 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cbe8fcd0-b1dd-40dd-abce-032a5d2f39a1 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:19.948005 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cbe8fcd0-b1dd-40dd-abce-032a5d2f39a1 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:19.948799 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cbe8fcd0-b1dd-40dd-abce-032a5d2f39a1 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:19.949499 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cbe8fcd0-b1dd-40dd-abce-032a5d2f39a1 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:19.950139 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cbe8fcd0-b1dd-40dd-abce-032a5d2f39a1 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:19.950739 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cbe8fcd0-b1dd-40dd-abce-032a5d2f39a1 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:20.139140 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a0376108-5103-4064-ac90-71ad36495ccd tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:20.147743 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a0376108-5103-4064-ac90-71ad36495ccd tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd" status: 200 len: 1324 microversion: 2.1 time: 0.317310 Oct 23 01:15:20.156370 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 616/1320] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:19 2022] GET /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd => generated 1324 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:20.162439 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-404bcceb-83d9-4589-8605-9c2f64f9be92 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:20.163822 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-404bcceb-83d9-4589-8605-9c2f64f9be92 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] [instance: df71be7c-a3b2-4d32-bdbd-45eb56a93154] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:20.203485 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-404bcceb-83d9-4589-8605-9c2f64f9be92 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:20.203992 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-404bcceb-83d9-4589-8605-9c2f64f9be92 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:20.204443 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-404bcceb-83d9-4589-8605-9c2f64f9be92 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:20.205156 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-404bcceb-83d9-4589-8605-9c2f64f9be92 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:20.207676 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-404bcceb-83d9-4589-8605-9c2f64f9be92 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:20.211469 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-404bcceb-83d9-4589-8605-9c2f64f9be92 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:20.354446 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cbe8fcd0-b1dd-40dd-abce-032a5d2f39a1 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:20.367328 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cbe8fcd0-b1dd-40dd-abce-032a5d2f39a1 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 200 len: 1717 microversion: 2.1 time: 0.432531 Oct 23 01:15:20.368156 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 705/1321] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:19 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 1717 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:20.373367 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ef3b134a-3e30-4f7a-a426-fefdc0d9f632 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:20.374326 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ef3b134a-3e30-4f7a-a426-fefdc0d9f632 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:20.475896 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ef3b134a-3e30-4f7a-a426-fefdc0d9f632 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:20.486321 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ef3b134a-3e30-4f7a-a426-fefdc0d9f632 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:20.488580 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ef3b134a-3e30-4f7a-a426-fefdc0d9f632 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:20.490524 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ef3b134a-3e30-4f7a-a426-fefdc0d9f632 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7" status: 200 len: 1286 microversion: 2.25 time: 0.120908 Oct 23 01:15:20.491755 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 706/1322] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:15:20 2022] GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7 => generated 1286 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:15:20.497547 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-52998bc9-523c-4931-8336-2e1d9d4ac875 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:20.498798 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-52998bc9-523c-4931-8336-2e1d9d4ac875 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 59cf7af1-8bca-4768-ac86-6e56d0649946] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:20.507304 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52998bc9-523c-4931-8336-2e1d9d4ac875 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:20.508582 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52998bc9-523c-4931-8336-2e1d9d4ac875 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:20.512441 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52998bc9-523c-4931-8336-2e1d9d4ac875 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:20.512441 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52998bc9-523c-4931-8336-2e1d9d4ac875 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:20.512441 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52998bc9-523c-4931-8336-2e1d9d4ac875 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:20.512441 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52998bc9-523c-4931-8336-2e1d9d4ac875 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:20.529837 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-52998bc9-523c-4931-8336-2e1d9d4ac875 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] HTTP exception thrown: Instance 59cf7af1-8bca-4768-ac86-6e56d0649946 could not be found. Oct 23 01:15:20.541307 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-52998bc9-523c-4931-8336-2e1d9d4ac875 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Request method failure captured: Oct 23 01:15:20.541307 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946 HTTP/1.1 Oct 23 01:15:20.541307 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:15:20.541307 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:15:20.541307 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:15:20.541307 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:15:20.541307 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:15:20.541307 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:15:20.541307 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:15:20.541307 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:15:20.541307 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJUqfBfUUlEO3Zu3H2tCeUoe5XnfNaUD7bKiDt2dwM_vHXdRyWKJRkiWdJuFGdub4DDH4raRIyo0Mk5Nmx3s4iA5jZNhGnIAixZlPXpUoWudHmkA-a7smsKDtHuvdILrKw6BGAV303EGuwNXW2iARTfT7KcTxhWKB1Hm1GgND3UMLls Oct 23 01:15:20.541307 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:15:20.541307 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:15:20.541307 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:15:20.541307 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:15:20.541307 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:15:20.541307 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:15:20.541307 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: abc8f8cefbf441c98d6bda76e99e3173 Oct 23 01:15:20.541307 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServersTestMultiNic-1641531956 Oct 23 01:15:20.541307 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:15:20.541307 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:15:20.543246 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/abc8f8cefbf441c98d6bda76e99e3173"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_abc8f8cefbf441c98d6bda76e99e3173"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/abc8f8cefbf441c98d6bda76e99e3173"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/abc8f8cefbf441c98d6bda76e99e3173"}]}] Oct 23 01:15:20.543246 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServersTestMultiNic-1641531956 Oct 23 01:15:20.543246 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: abc8f8cefbf441c98d6bda76e99e3173 Oct 23 01:15:20.543246 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServersTestMultiNic-1641531956 Oct 23 01:15:20.543246 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServersTestMultiNic-1641531956-project Oct 23 01:15:20.543246 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:15:20.543246 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:15:20.543246 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 7262d5984b8c4775b86fae1c0d314718 Oct 23 01:15:20.543246 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServersTestMultiNic-1641531956-project Oct 23 01:15:20.543246 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:15:20.543246 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 59cf7af1-8bca-4768-ac86-6e56d0649946 could not be found. Oct 23 01:15:20.543246 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '59cf7af1-8bca-4768-ac86-6e56d0649946'} Oct 23 01:15:20.544028 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:15:20.544028 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:15:20.544028 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:15:20.544028 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:15:20.544028 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:15:20.544028 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:15:20.544028 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:15:20.544028 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:15:20.544028 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:15:20.544028 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:15:20.544028 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59cf7af1-8bca-4768-ac86-6e56d0649946 could not be found. Oct 23 01:15:20.544028 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:15:20.544028 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:15:20.544028 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:15:20.544028 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:15:20.544028 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:15:20.544028 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:15:20.544028 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:15:20.544028 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:15:20.544028 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:15:20.546331 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:15:20.546331 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:15:20.546331 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:15:20.546331 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:15:20.546331 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:15:20.546331 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:15:20.546331 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:15:20.546331 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59cf7af1-8bca-4768-ac86-6e56d0649946 could not be found. Oct 23 01:15:20.546331 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:15:20.546331 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:15:20.546331 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:15:20.546331 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:15:20.546331 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:15:20.546331 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:15:20.546331 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:15:20.546331 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:15:20.546331 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59cf7af1-8bca-4768-ac86-6e56d0649946 could not be found. Oct 23 01:15:20.546331 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:15:20.547967 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-52998bc9-523c-4931-8336-2e1d9d4ac875 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Returning 404 to user: Instance 59cf7af1-8bca-4768-ac86-6e56d0649946 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:15:20.547967 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-52998bc9-523c-4931-8336-2e1d9d4ac875 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946" status: 404 len: 111 microversion: 2.1 time: 0.042709 Oct 23 01:15:20.547967 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 707/1323] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:20 2022] GET /compute/v2.1/servers/59cf7af1-8bca-4768-ac86-6e56d0649946 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:15:20.548210 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-404bcceb-83d9-4589-8605-9c2f64f9be92 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937a26d78d07458eaadc68fc9828d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3730de9c65d4add9f6f34aa7d5aa77e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:20.552741 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-ac403209-79c6-45b8-98e4-574073bc3df8 req-35f6c842-11e7-4370-ba58-5c806f7b64f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3aa4181-fc02-43dc-95df-ae1a730fbdca", "name": "network-vif-plugged", "status": "completed", "tag": "ac87b72d-8aca-4ffa-993c-09cc2cf87903"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:15:20.556197 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-404bcceb-83d9-4589-8605-9c2f64f9be92 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] 10.222.0.42 "GET /compute/v2.1/servers/df71be7c-a3b2-4d32-bdbd-45eb56a93154" status: 200 len: 1463 microversion: 2.1 time: 0.398473 Oct 23 01:15:20.556805 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 617/1324] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:20 2022] GET /compute/v2.1/servers/df71be7c-a3b2-4d32-bdbd-45eb56a93154 => generated 1463 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:20.563629 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2a4c1cf2-4fa5-42a4-848a-18fa594ad4d1 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:20.564255 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2a4c1cf2-4fa5-42a4-848a-18fa594ad4d1 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] [instance: de212c9c-e0e0-471f-8a01-5d180ac28d07] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:20.567141 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ac403209-79c6-45b8-98e4-574073bc3df8 req-35f6c842-11e7-4370-ba58-5c806f7b64f7 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:20.567952 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ac403209-79c6-45b8-98e4-574073bc3df8 req-35f6c842-11e7-4370-ba58-5c806f7b64f7 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:20.570118 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ac403209-79c6-45b8-98e4-574073bc3df8 req-35f6c842-11e7-4370-ba58-5c806f7b64f7 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:20.571679 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a4c1cf2-4fa5-42a4-848a-18fa594ad4d1 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:20.572191 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a4c1cf2-4fa5-42a4-848a-18fa594ad4d1 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:20.572639 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a4c1cf2-4fa5-42a4-848a-18fa594ad4d1 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:20.573360 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a4c1cf2-4fa5-42a4-848a-18fa594ad4d1 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:20.573825 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a4c1cf2-4fa5-42a4-848a-18fa594ad4d1 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:20.574330 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a4c1cf2-4fa5-42a4-848a-18fa594ad4d1 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:20.586216 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-ac403209-79c6-45b8-98e4-574073bc3df8 req-35f6c842-11e7-4370-ba58-5c806f7b64f7 service nova] Creating event network-vif-plugged:ac87b72d-8aca-4ffa-993c-09cc2cf87903 for instance f3aa4181-fc02-43dc-95df-ae1a730fbdca on n-h1-master-1 Oct 23 01:15:20.593591 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-ac403209-79c6-45b8-98e4-574073bc3df8 req-35f6c842-11e7-4370-ba58-5c806f7b64f7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055364 Oct 23 01:15:20.594760 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 708/1325] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:15:20.609018 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-76976e5b-23ca-4007-b44b-2182c3db4ea2 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:20.609018 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-76976e5b-23ca-4007-b44b-2182c3db4ea2 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 93d46a54-c775-4fc6-ad62-edf53bee2d07] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:20.614476 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-76976e5b-23ca-4007-b44b-2182c3db4ea2 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:20.615232 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-76976e5b-23ca-4007-b44b-2182c3db4ea2 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:20.615904 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-76976e5b-23ca-4007-b44b-2182c3db4ea2 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:20.617207 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-76976e5b-23ca-4007-b44b-2182c3db4ea2 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:20.617667 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-76976e5b-23ca-4007-b44b-2182c3db4ea2 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:20.618122 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-76976e5b-23ca-4007-b44b-2182c3db4ea2 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:20.634068 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-76976e5b-23ca-4007-b44b-2182c3db4ea2 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] HTTP exception thrown: Instance 93d46a54-c775-4fc6-ad62-edf53bee2d07 could not be found. Oct 23 01:15:20.636846 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-76976e5b-23ca-4007-b44b-2182c3db4ea2 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Request method failure captured: Oct 23 01:15:20.636846 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07 HTTP/1.1 Oct 23 01:15:20.636846 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:15:20.636846 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:15:20.636846 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:15:20.636846 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:15:20.636846 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:15:20.636846 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:15:20.636846 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:15:20.636846 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:15:20.636846 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJUqfBfUUlEO3Zu3H2tCeUoe5XnfNaUD7bKiDt2dwM_vHXdRyWKJRkiWdJuFGdub4DDH4raRIyo0Mk5Nmx3s4iA5jZNhGnIAixZlPXpUoWudHmkA-a7smsKDtHuvdILrKw6BGAV303EGuwNXW2iARTfT7KcTxhWKB1Hm1GgND3UMLls Oct 23 01:15:20.636846 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:15:20.636846 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:15:20.636846 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:15:20.636846 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:15:20.636846 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:15:20.636846 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:15:20.636846 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: abc8f8cefbf441c98d6bda76e99e3173 Oct 23 01:15:20.636846 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServersTestMultiNic-1641531956 Oct 23 01:15:20.636846 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:15:20.636846 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:15:20.638287 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/abc8f8cefbf441c98d6bda76e99e3173"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_abc8f8cefbf441c98d6bda76e99e3173"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/abc8f8cefbf441c98d6bda76e99e3173"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/abc8f8cefbf441c98d6bda76e99e3173"}]}] Oct 23 01:15:20.638287 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServersTestMultiNic-1641531956 Oct 23 01:15:20.638287 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: abc8f8cefbf441c98d6bda76e99e3173 Oct 23 01:15:20.638287 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServersTestMultiNic-1641531956 Oct 23 01:15:20.638287 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServersTestMultiNic-1641531956-project Oct 23 01:15:20.638287 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:15:20.638287 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:15:20.638287 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 7262d5984b8c4775b86fae1c0d314718 Oct 23 01:15:20.638287 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServersTestMultiNic-1641531956-project Oct 23 01:15:20.638287 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:15:20.638287 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 93d46a54-c775-4fc6-ad62-edf53bee2d07 could not be found. Oct 23 01:15:20.638287 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '93d46a54-c775-4fc6-ad62-edf53bee2d07'} Oct 23 01:15:20.639056 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:15:20.639056 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:15:20.639056 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:15:20.639056 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:15:20.639056 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:15:20.639056 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:15:20.639056 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:15:20.639056 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:15:20.639056 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:15:20.639056 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:15:20.639056 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93d46a54-c775-4fc6-ad62-edf53bee2d07 could not be found. Oct 23 01:15:20.639056 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:15:20.639056 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:15:20.639056 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:15:20.639056 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:15:20.639056 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:15:20.639056 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:15:20.639056 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:15:20.639056 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:15:20.639056 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:15:20.640293 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:15:20.640293 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:15:20.640293 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:15:20.640293 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:15:20.640293 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:15:20.640293 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:15:20.640293 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:15:20.640293 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:15:20.640293 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:15:20.640293 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93d46a54-c775-4fc6-ad62-edf53bee2d07 could not be found. Oct 23 01:15:20.640293 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:15:20.640293 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:15:20.640293 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:15:20.640293 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:15:20.640293 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:15:20.640293 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:15:20.640293 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:15:20.640293 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:15:20.640293 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93d46a54-c775-4fc6-ad62-edf53bee2d07 could not be found. Oct 23 01:15:20.640293 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:15:20.641629 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-76976e5b-23ca-4007-b44b-2182c3db4ea2 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Returning 404 to user: Instance 93d46a54-c775-4fc6-ad62-edf53bee2d07 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:15:20.641629 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-76976e5b-23ca-4007-b44b-2182c3db4ea2 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "DELETE /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07" status: 404 len: 111 microversion: 2.1 time: 0.042251 Oct 23 01:15:20.641629 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 709/1326] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:15:20 2022] DELETE /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:15:20.800425 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-789d9af2-27ca-4d78-9806-99320e918301 tempest-TenantUsagesTestJSON-999382962 tempest-TenantUsagesTestJSON-999382962-project-admin] Calling method '.version_select at 0x7f5cc1fefdc0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:20.815119 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-789d9af2-27ca-4d78-9806-99320e918301 tempest-TenantUsagesTestJSON-999382962 tempest-TenantUsagesTestJSON-999382962-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:20.815894 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-789d9af2-27ca-4d78-9806-99320e918301 tempest-TenantUsagesTestJSON-999382962 tempest-TenantUsagesTestJSON-999382962-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:20.816488 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-789d9af2-27ca-4d78-9806-99320e918301 tempest-TenantUsagesTestJSON-999382962 tempest-TenantUsagesTestJSON-999382962-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:20.841998 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-789d9af2-27ca-4d78-9806-99320e918301 tempest-TenantUsagesTestJSON-999382962 tempest-TenantUsagesTestJSON-999382962-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:20.844076 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-789d9af2-27ca-4d78-9806-99320e918301 tempest-TenantUsagesTestJSON-999382962 tempest-TenantUsagesTestJSON-999382962-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:20.844695 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-789d9af2-27ca-4d78-9806-99320e918301 tempest-TenantUsagesTestJSON-999382962 tempest-TenantUsagesTestJSON-999382962-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:20.849136 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2a4c1cf2-4fa5-42a4-848a-18fa594ad4d1 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80703c3d1dae419c9fd5ca103f3c28bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356a4b3819db457fb5caf68ded0212fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:20.858407 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2a4c1cf2-4fa5-42a4-848a-18fa594ad4d1 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] 10.222.0.42 "GET /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07" status: 200 len: 1318 microversion: 2.1 time: 0.299461 Oct 23 01:15:20.866648 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 618/1327] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:20 2022] GET /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07 => generated 1318 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:20.877196 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e8f825fc-3874-4aa5-a59b-da6e4055f692 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:20.880738 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-789d9af2-27ca-4d78-9806-99320e918301 tempest-TenantUsagesTestJSON-999382962 tempest-TenantUsagesTestJSON-999382962-project-admin] 10.222.0.42 "GET /compute/v2.1/os-simple-tenant-usage/c3730de9c65d4add9f6f34aa7d5aa77e?start=2022-10-22T01%3A15%3A20.576662&end=2022-10-24T01%3A15%3A20.576662" status: 200 len: 694 microversion: 2.1 time: 0.240344 Oct 23 01:15:20.881342 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e8f825fc-3874-4aa5-a59b-da6e4055f692 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] [instance: 93d46a54-c775-4fc6-ad62-edf53bee2d07] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:20.882883 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 710/1328] 10.222.0.42 () {58 vars in 1412 bytes} [Sun Oct 23 01:15:20 2022] GET /compute/v2.1/os-simple-tenant-usage/c3730de9c65d4add9f6f34aa7d5aa77e?start=2022-10-22T01%3A15%3A20.576662&end=2022-10-24T01%3A15%3A20.576662 => generated 694 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:15:20.888404 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ed86fa18-8210-45eb-bd58-b96167be1fc0 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:20.889017 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ed86fa18-8210-45eb-bd58-b96167be1fc0 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 808c58c6-1606-4553-8dd3-8292fa1202b5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:20.891960 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e8f825fc-3874-4aa5-a59b-da6e4055f692 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:20.892717 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e8f825fc-3874-4aa5-a59b-da6e4055f692 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:20.893368 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e8f825fc-3874-4aa5-a59b-da6e4055f692 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:20.895218 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e8f825fc-3874-4aa5-a59b-da6e4055f692 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:20.895681 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ed86fa18-8210-45eb-bd58-b96167be1fc0 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:20.896084 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e8f825fc-3874-4aa5-a59b-da6e4055f692 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:20.896214 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ed86fa18-8210-45eb-bd58-b96167be1fc0 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:20.896643 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ed86fa18-8210-45eb-bd58-b96167be1fc0 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:20.896974 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e8f825fc-3874-4aa5-a59b-da6e4055f692 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:20.897376 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ed86fa18-8210-45eb-bd58-b96167be1fc0 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:20.897909 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ed86fa18-8210-45eb-bd58-b96167be1fc0 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:20.898614 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ed86fa18-8210-45eb-bd58-b96167be1fc0 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:20.914365 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-e8f825fc-3874-4aa5-a59b-da6e4055f692 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] HTTP exception thrown: Instance 93d46a54-c775-4fc6-ad62-edf53bee2d07 could not be found. Oct 23 01:15:20.923282 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e8f825fc-3874-4aa5-a59b-da6e4055f692 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Request method failure captured: Oct 23 01:15:20.923282 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07 HTTP/1.1 Oct 23 01:15:20.923282 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:15:20.923282 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:15:20.923282 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:15:20.923282 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:15:20.923282 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:15:20.923282 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:15:20.923282 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:15:20.923282 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:15:20.923282 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJUqfBfUUlEO3Zu3H2tCeUoe5XnfNaUD7bKiDt2dwM_vHXdRyWKJRkiWdJuFGdub4DDH4raRIyo0Mk5Nmx3s4iA5jZNhGnIAixZlPXpUoWudHmkA-a7smsKDtHuvdILrKw6BGAV303EGuwNXW2iARTfT7KcTxhWKB1Hm1GgND3UMLls Oct 23 01:15:20.923282 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:15:20.923282 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:15:20.923282 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:15:20.923282 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:15:20.923282 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:15:20.923282 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:15:20.923282 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: abc8f8cefbf441c98d6bda76e99e3173 Oct 23 01:15:20.923282 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersTestMultiNic-1641531956 Oct 23 01:15:20.923282 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:15:20.923282 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:15:20.924883 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/abc8f8cefbf441c98d6bda76e99e3173"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_abc8f8cefbf441c98d6bda76e99e3173"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/abc8f8cefbf441c98d6bda76e99e3173"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/abc8f8cefbf441c98d6bda76e99e3173"}]}] Oct 23 01:15:20.924883 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersTestMultiNic-1641531956 Oct 23 01:15:20.924883 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: abc8f8cefbf441c98d6bda76e99e3173 Oct 23 01:15:20.924883 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersTestMultiNic-1641531956 Oct 23 01:15:20.924883 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersTestMultiNic-1641531956-project Oct 23 01:15:20.924883 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:15:20.924883 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:15:20.924883 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 7262d5984b8c4775b86fae1c0d314718 Oct 23 01:15:20.924883 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersTestMultiNic-1641531956-project Oct 23 01:15:20.924883 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:15:20.924883 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 93d46a54-c775-4fc6-ad62-edf53bee2d07 could not be found. Oct 23 01:15:20.924883 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '93d46a54-c775-4fc6-ad62-edf53bee2d07'} Oct 23 01:15:20.925638 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:15:20.925638 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:15:20.925638 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:15:20.925638 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:15:20.925638 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:15:20.925638 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:15:20.925638 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:15:20.925638 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:15:20.925638 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:15:20.925638 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:15:20.925638 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93d46a54-c775-4fc6-ad62-edf53bee2d07 could not be found. Oct 23 01:15:20.925638 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:15:20.925638 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:15:20.925638 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:15:20.925638 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:15:20.925638 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:15:20.925638 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:15:20.925638 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:15:20.925638 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:15:20.925638 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:15:20.927005 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:15:20.927005 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:15:20.927005 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:15:20.927005 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:15:20.927005 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:15:20.927005 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:15:20.927005 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:15:20.927005 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93d46a54-c775-4fc6-ad62-edf53bee2d07 could not be found. Oct 23 01:15:20.927005 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:15:20.927005 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:15:20.927005 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:15:20.927005 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:15:20.927005 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:15:20.927005 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:15:20.927005 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:15:20.927005 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:15:20.927005 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93d46a54-c775-4fc6-ad62-edf53bee2d07 could not be found. Oct 23 01:15:20.927005 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:15:20.929231 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e8f825fc-3874-4aa5-a59b-da6e4055f692 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] Returning 404 to user: Instance 93d46a54-c775-4fc6-ad62-edf53bee2d07 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:15:20.929231 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e8f825fc-3874-4aa5-a59b-da6e4055f692 tempest-ServersTestMultiNic-1641531956 tempest-ServersTestMultiNic-1641531956-project] 10.222.0.42 "GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07" status: 404 len: 111 microversion: 2.1 time: 0.050693 Oct 23 01:15:20.929231 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 619/1329] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:20 2022] GET /compute/v2.1/servers/93d46a54-c775-4fc6-ad62-edf53bee2d07 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:15:20.930997 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f41b4dbc-d60a-4e6d-bca5-7b8bea7927f7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:20.931812 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f41b4dbc-d60a-4e6d-bca5-7b8bea7927f7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 8025dc46-71af-4fec-8f54-5ae9e92cc31f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:20.938344 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f41b4dbc-d60a-4e6d-bca5-7b8bea7927f7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:20.939129 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f41b4dbc-d60a-4e6d-bca5-7b8bea7927f7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:20.939742 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f41b4dbc-d60a-4e6d-bca5-7b8bea7927f7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:20.940633 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f41b4dbc-d60a-4e6d-bca5-7b8bea7927f7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:20.941260 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f41b4dbc-d60a-4e6d-bca5-7b8bea7927f7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:20.941867 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f41b4dbc-d60a-4e6d-bca5-7b8bea7927f7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:21.127652 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ed86fa18-8210-45eb-bd58-b96167be1fc0 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:21.136471 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ed86fa18-8210-45eb-bd58-b96167be1fc0 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/808c58c6-1606-4553-8dd3-8292fa1202b5" status: 200 len: 1319 microversion: 2.1 time: 0.251651 Oct 23 01:15:21.148234 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f41b4dbc-d60a-4e6d-bca5-7b8bea7927f7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:21.150453 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 711/1330] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:20 2022] GET /compute/v2.1/servers/808c58c6-1606-4553-8dd3-8292fa1202b5 => generated 1319 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:21.157730 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-562f4d0a-df3f-4ae8-9f8b-a9416a164caf tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Calling method '.version_select at 0x7f5cc2048550>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:21.159526 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f41b4dbc-d60a-4e6d-bca5-7b8bea7927f7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f" status: 200 len: 1541 microversion: 2.1 time: 0.239501 Oct 23 01:15:21.160504 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 620/1331] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:20 2022] GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f => generated 1541 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:21.177838 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-562f4d0a-df3f-4ae8-9f8b-a9416a164caf tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:21.177838 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-562f4d0a-df3f-4ae8-9f8b-a9416a164caf tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:21.177838 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-562f4d0a-df3f-4ae8-9f8b-a9416a164caf tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:21.180328 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3e52a566-dc96-4d35-b936-c6692ee82bf9 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:21.186214 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3e52a566-dc96-4d35-b936-c6692ee82bf9 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 291a0671-7bab-404a-b836-95fb7acfd1dd] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:21.190820 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-562f4d0a-df3f-4ae8-9f8b-a9416a164caf tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:21.191621 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-562f4d0a-df3f-4ae8-9f8b-a9416a164caf tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:21.192220 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-562f4d0a-df3f-4ae8-9f8b-a9416a164caf tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:21.196684 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3e52a566-dc96-4d35-b936-c6692ee82bf9 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:21.199811 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3e52a566-dc96-4d35-b936-c6692ee82bf9 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:21.199811 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3e52a566-dc96-4d35-b936-c6692ee82bf9 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:21.199811 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3e52a566-dc96-4d35-b936-c6692ee82bf9 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:21.199811 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3e52a566-dc96-4d35-b936-c6692ee82bf9 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:21.200254 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3e52a566-dc96-4d35-b936-c6692ee82bf9 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:21.209411 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-562f4d0a-df3f-4ae8-9f8b-a9416a164caf tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] 10.222.0.42 "GET /compute/v2.1/os-simple-tenant-usage/c3730de9c65d4add9f6f34aa7d5aa77e?start=2022-10-22T01%3A15%3A20.576662&end=2022-10-24T01%3A15%3A20.576662" status: 200 len: 694 microversion: 2.1 time: 0.056989 Oct 23 01:15:21.210496 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 712/1332] 10.222.0.42 () {58 vars in 1412 bytes} [Sun Oct 23 01:15:21 2022] GET /compute/v2.1/os-simple-tenant-usage/c3730de9c65d4add9f6f34aa7d5aa77e?start=2022-10-22T01%3A15%3A20.576662&end=2022-10-24T01%3A15%3A20.576662 => generated 694 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:15:21.231843 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-54ec6175-bbba-48ac-9dc5-b013e58809cc tempest-TenantUsagesTestJSON-999382962 tempest-TenantUsagesTestJSON-999382962-project-admin] Calling method '.version_select at 0x7f5cc1f419d0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:21.243138 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54ec6175-bbba-48ac-9dc5-b013e58809cc tempest-TenantUsagesTestJSON-999382962 tempest-TenantUsagesTestJSON-999382962-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:21.243748 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54ec6175-bbba-48ac-9dc5-b013e58809cc tempest-TenantUsagesTestJSON-999382962 tempest-TenantUsagesTestJSON-999382962-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:21.246308 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54ec6175-bbba-48ac-9dc5-b013e58809cc tempest-TenantUsagesTestJSON-999382962 tempest-TenantUsagesTestJSON-999382962-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:21.267644 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54ec6175-bbba-48ac-9dc5-b013e58809cc tempest-TenantUsagesTestJSON-999382962 tempest-TenantUsagesTestJSON-999382962-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:21.268140 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54ec6175-bbba-48ac-9dc5-b013e58809cc tempest-TenantUsagesTestJSON-999382962 tempest-TenantUsagesTestJSON-999382962-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:21.268581 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54ec6175-bbba-48ac-9dc5-b013e58809cc tempest-TenantUsagesTestJSON-999382962 tempest-TenantUsagesTestJSON-999382962-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:21.359505 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-54ec6175-bbba-48ac-9dc5-b013e58809cc tempest-TenantUsagesTestJSON-999382962 tempest-TenantUsagesTestJSON-999382962-project-admin] 10.222.0.42 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-22T01%3A15%3A20.576662&end=2022-10-24T01%3A15%3A20.576662&detailed=1" status: 200 len: 14225 microversion: 2.1 time: 0.133903 Oct 23 01:15:21.370925 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 713/1333] 10.222.0.42 () {58 vars in 1335 bytes} [Sun Oct 23 01:15:21 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-22T01%3A15%3A20.576662&end=2022-10-24T01%3A15%3A20.576662&detailed=1 => generated 14225 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:15:21.391144 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-aebfe7ea-652b-4aa5-a305-85ae5c5b0cc7 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:21.391641 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-aebfe7ea-652b-4aa5-a305-85ae5c5b0cc7 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] [instance: df71be7c-a3b2-4d32-bdbd-45eb56a93154] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:21.393148 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3e52a566-dc96-4d35-b936-c6692ee82bf9 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:21.401719 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aebfe7ea-652b-4aa5-a305-85ae5c5b0cc7 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:21.402235 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aebfe7ea-652b-4aa5-a305-85ae5c5b0cc7 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:21.402668 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aebfe7ea-652b-4aa5-a305-85ae5c5b0cc7 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:21.406279 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3e52a566-dc96-4d35-b936-c6692ee82bf9 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd" status: 200 len: 1324 microversion: 2.1 time: 0.226315 Oct 23 01:15:21.406638 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aebfe7ea-652b-4aa5-a305-85ae5c5b0cc7 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:21.407120 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aebfe7ea-652b-4aa5-a305-85ae5c5b0cc7 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:21.407296 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 621/1334] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:21 2022] GET /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd => generated 1324 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:21.407566 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aebfe7ea-652b-4aa5-a305-85ae5c5b0cc7 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:21.415079 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-795c4ac7-be9f-48a4-9a5a-75c9d8c0dfee tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:21.418553 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-795c4ac7-be9f-48a4-9a5a-75c9d8c0dfee tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:21.429449 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-795c4ac7-be9f-48a4-9a5a-75c9d8c0dfee tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:21.429954 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-795c4ac7-be9f-48a4-9a5a-75c9d8c0dfee tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:21.430438 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-795c4ac7-be9f-48a4-9a5a-75c9d8c0dfee tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:21.433035 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-795c4ac7-be9f-48a4-9a5a-75c9d8c0dfee tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:21.433565 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-795c4ac7-be9f-48a4-9a5a-75c9d8c0dfee tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:21.434027 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-795c4ac7-be9f-48a4-9a5a-75c9d8c0dfee tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:21.441460 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=100 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:15:21.458340 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-aebfe7ea-652b-4aa5-a305-85ae5c5b0cc7 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] [instance: df71be7c-a3b2-4d32-bdbd-45eb56a93154] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:15:21.483426 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=100 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:15:21.624844 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-795c4ac7-be9f-48a4-9a5a-75c9d8c0dfee tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:21.634257 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-795c4ac7-be9f-48a4-9a5a-75c9d8c0dfee tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 200 len: 1717 microversion: 2.1 time: 0.225953 Oct 23 01:15:21.650045 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 622/1335] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:21 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 1717 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:21.650045 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6133c14d-e2b5-458d-a218-b26157d94f42 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:21.650045 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6133c14d-e2b5-458d-a218-b26157d94f42 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:21.650947 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6133c14d-e2b5-458d-a218-b26157d94f42 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:21.652070 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6133c14d-e2b5-458d-a218-b26157d94f42 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:21.652070 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6133c14d-e2b5-458d-a218-b26157d94f42 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:21.652614 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6133c14d-e2b5-458d-a218-b26157d94f42 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:21.653076 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6133c14d-e2b5-458d-a218-b26157d94f42 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:21.653505 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6133c14d-e2b5-458d-a218-b26157d94f42 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:21.720547 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6133c14d-e2b5-458d-a218-b26157d94f42 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:21.744770 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6133c14d-e2b5-458d-a218-b26157d94f42 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:21.746321 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6133c14d-e2b5-458d-a218-b26157d94f42 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:21.747479 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6133c14d-e2b5-458d-a218-b26157d94f42 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7" status: 200 len: 1282 microversion: 2.25 time: 0.111149 Oct 23 01:15:21.748049 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 623/1336] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:15:21 2022] GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7 => generated 1282 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:15:21.830464 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-aebfe7ea-652b-4aa5-a305-85ae5c5b0cc7 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] 10.222.0.42 "DELETE /compute/v2.1/servers/df71be7c-a3b2-4d32-bdbd-45eb56a93154" status: 204 len: 0 microversion: 2.1 time: 0.442889 Oct 23 01:15:21.831140 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 714/1337] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:15:21 2022] DELETE /compute/v2.1/servers/df71be7c-a3b2-4d32-bdbd-45eb56a93154 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 23 01:15:21.842096 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9e45dfac-4c48-4dcd-8755-a13e36e294e6 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:21.843797 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9e45dfac-4c48-4dcd-8755-a13e36e294e6 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] [instance: df71be7c-a3b2-4d32-bdbd-45eb56a93154] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:21.849088 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9e45dfac-4c48-4dcd-8755-a13e36e294e6 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:21.850424 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9e45dfac-4c48-4dcd-8755-a13e36e294e6 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:21.850424 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9e45dfac-4c48-4dcd-8755-a13e36e294e6 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:21.851079 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9e45dfac-4c48-4dcd-8755-a13e36e294e6 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:21.851624 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9e45dfac-4c48-4dcd-8755-a13e36e294e6 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:21.852242 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9e45dfac-4c48-4dcd-8755-a13e36e294e6 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:21.890333 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-180341d4-676d-4858-8d24-9c0949148bac tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:21.891571 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-180341d4-676d-4858-8d24-9c0949148bac tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] [instance: de212c9c-e0e0-471f-8a01-5d180ac28d07] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:21.899704 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-180341d4-676d-4858-8d24-9c0949148bac tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:21.900335 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-180341d4-676d-4858-8d24-9c0949148bac tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:21.901253 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-180341d4-676d-4858-8d24-9c0949148bac tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:21.902098 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-180341d4-676d-4858-8d24-9c0949148bac tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:21.902630 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-180341d4-676d-4858-8d24-9c0949148bac tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:21.903120 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-180341d4-676d-4858-8d24-9c0949148bac tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:22.109118 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9e45dfac-4c48-4dcd-8755-a13e36e294e6 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937a26d78d07458eaadc68fc9828d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3730de9c65d4add9f6f34aa7d5aa77e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:22.119606 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9e45dfac-4c48-4dcd-8755-a13e36e294e6 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] 10.222.0.42 "GET /compute/v2.1/servers/df71be7c-a3b2-4d32-bdbd-45eb56a93154" status: 200 len: 1469 microversion: 2.1 time: 0.282309 Oct 23 01:15:22.126258 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 624/1338] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:21 2022] GET /compute/v2.1/servers/df71be7c-a3b2-4d32-bdbd-45eb56a93154 => generated 1469 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:22.154614 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-180341d4-676d-4858-8d24-9c0949148bac tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80703c3d1dae419c9fd5ca103f3c28bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356a4b3819db457fb5caf68ded0212fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:22.160514 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-75e77deb-d94c-4b88-a9bf-ce75ec10a238 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:22.163130 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-75e77deb-d94c-4b88-a9bf-ce75ec10a238 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 808c58c6-1606-4553-8dd3-8292fa1202b5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:22.174134 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-180341d4-676d-4858-8d24-9c0949148bac tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] 10.222.0.42 "GET /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07" status: 200 len: 1318 microversion: 2.1 time: 0.289616 Oct 23 01:15:22.186805 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-75e77deb-d94c-4b88-a9bf-ce75ec10a238 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:22.186805 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-75e77deb-d94c-4b88-a9bf-ce75ec10a238 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:22.186805 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-75e77deb-d94c-4b88-a9bf-ce75ec10a238 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:22.186805 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-75e77deb-d94c-4b88-a9bf-ce75ec10a238 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:22.187213 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-75e77deb-d94c-4b88-a9bf-ce75ec10a238 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:22.187213 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-75e77deb-d94c-4b88-a9bf-ce75ec10a238 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:22.196378 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 715/1339] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:21 2022] GET /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07 => generated 1318 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:15:22.201424 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4b3315d3-9b3f-4f6d-b5a4-b5af7049d56a tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:22.201859 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4b3315d3-9b3f-4f6d-b5a4-b5af7049d56a tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 8025dc46-71af-4fec-8f54-5ae9e92cc31f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:22.247143 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:15:22.257324 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b3315d3-9b3f-4f6d-b5a4-b5af7049d56a tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:22.260390 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b3315d3-9b3f-4f6d-b5a4-b5af7049d56a tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:22.260390 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b3315d3-9b3f-4f6d-b5a4-b5af7049d56a tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:22.266656 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b3315d3-9b3f-4f6d-b5a4-b5af7049d56a tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:22.266656 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b3315d3-9b3f-4f6d-b5a4-b5af7049d56a tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:22.266656 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b3315d3-9b3f-4f6d-b5a4-b5af7049d56a tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:22.592122 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4b3315d3-9b3f-4f6d-b5a4-b5af7049d56a tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:22.596550 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-75e77deb-d94c-4b88-a9bf-ce75ec10a238 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:22.604605 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4b3315d3-9b3f-4f6d-b5a4-b5af7049d56a tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f" status: 200 len: 1541 microversion: 2.1 time: 0.402760 Oct 23 01:15:22.605503 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 716/1340] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:22 2022] GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f => generated 1541 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:22.607223 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-75e77deb-d94c-4b88-a9bf-ce75ec10a238 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/808c58c6-1606-4553-8dd3-8292fa1202b5" status: 200 len: 1319 microversion: 2.1 time: 0.450307 Oct 23 01:15:22.608969 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 625/1341] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:22 2022] GET /compute/v2.1/servers/808c58c6-1606-4553-8dd3-8292fa1202b5 => generated 1319 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:15:22.613010 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6a807b60-3e1c-413f-b528-7f7f56375cea tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:22.618292 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6a807b60-3e1c-413f-b528-7f7f56375cea tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 291a0671-7bab-404a-b836-95fb7acfd1dd] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:22.627562 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6a807b60-3e1c-413f-b528-7f7f56375cea tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:22.628166 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6a807b60-3e1c-413f-b528-7f7f56375cea tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:22.629158 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6a807b60-3e1c-413f-b528-7f7f56375cea tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:22.629512 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6a807b60-3e1c-413f-b528-7f7f56375cea tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:22.630149 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6a807b60-3e1c-413f-b528-7f7f56375cea tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:22.630992 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6a807b60-3e1c-413f-b528-7f7f56375cea tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:22.659736 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c9e569af-9313-4024-9a02-80967648c0f7 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:22.660237 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c9e569af-9313-4024-9a02-80967648c0f7 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:22.672107 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c9e569af-9313-4024-9a02-80967648c0f7 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:22.690718 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c9e569af-9313-4024-9a02-80967648c0f7 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:22.691790 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c9e569af-9313-4024-9a02-80967648c0f7 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:22.695429 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c9e569af-9313-4024-9a02-80967648c0f7 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:22.695929 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c9e569af-9313-4024-9a02-80967648c0f7 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:22.696366 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c9e569af-9313-4024-9a02-80967648c0f7 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:22.864232 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6a807b60-3e1c-413f-b528-7f7f56375cea tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:22.877614 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6a807b60-3e1c-413f-b528-7f7f56375cea tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd" status: 200 len: 1324 microversion: 2.1 time: 0.270562 Oct 23 01:15:22.878752 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 717/1342] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:22 2022] GET /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd => generated 1324 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:22.892920 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-8b57d31d-f666-49f2-acb4-6ab9372a0b56 req-df8aa8e7-e698-48c2-982a-67229150aaeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de212c9c-e0e0-471f-8a01-5d180ac28d07", "name": "network-vif-plugged", "status": "completed", "tag": "e105d80f-51cc-42c7-8ece-f8e8a1806e71"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:15:22.911879 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-8b57d31d-f666-49f2-acb4-6ab9372a0b56 req-df8aa8e7-e698-48c2-982a-67229150aaeb service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:22.912270 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-8b57d31d-f666-49f2-acb4-6ab9372a0b56 req-df8aa8e7-e698-48c2-982a-67229150aaeb service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:22.915419 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-8b57d31d-f666-49f2-acb4-6ab9372a0b56 req-df8aa8e7-e698-48c2-982a-67229150aaeb service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:22.959590 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-8b57d31d-f666-49f2-acb4-6ab9372a0b56 req-df8aa8e7-e698-48c2-982a-67229150aaeb service nova] Creating event network-vif-plugged:e105d80f-51cc-42c7-8ece-f8e8a1806e71 for instance de212c9c-e0e0-471f-8a01-5d180ac28d07 on n-h1-master-1 Oct 23 01:15:22.972076 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-8b57d31d-f666-49f2-acb4-6ab9372a0b56 req-df8aa8e7-e698-48c2-982a-67229150aaeb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091949 Oct 23 01:15:22.976318 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 718/1343] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:15:22.997514 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-31d7fc7b-584a-46fb-8309-a7d017929911 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:22.999561 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-31d7fc7b-584a-46fb-8309-a7d017929911 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:23.012790 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-31d7fc7b-584a-46fb-8309-a7d017929911 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:23.013347 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-31d7fc7b-584a-46fb-8309-a7d017929911 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:23.013794 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-31d7fc7b-584a-46fb-8309-a7d017929911 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:23.018802 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-31d7fc7b-584a-46fb-8309-a7d017929911 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:23.019286 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-31d7fc7b-584a-46fb-8309-a7d017929911 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:23.020353 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-31d7fc7b-584a-46fb-8309-a7d017929911 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:23.032112 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c9e569af-9313-4024-9a02-80967648c0f7 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:23.049560 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c9e569af-9313-4024-9a02-80967648c0f7 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 200 len: 1717 microversion: 2.1 time: 0.393889 Oct 23 01:15:23.062014 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 626/1344] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:22 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 1717 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:15:23.146330 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5460f692-a07d-4d25-bd12-992ff23a97d7 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:23.146979 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5460f692-a07d-4d25-bd12-992ff23a97d7 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] [instance: df71be7c-a3b2-4d32-bdbd-45eb56a93154] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:23.158553 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5460f692-a07d-4d25-bd12-992ff23a97d7 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:23.159050 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5460f692-a07d-4d25-bd12-992ff23a97d7 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:23.161598 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5460f692-a07d-4d25-bd12-992ff23a97d7 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:23.162539 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5460f692-a07d-4d25-bd12-992ff23a97d7 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:23.163484 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5460f692-a07d-4d25-bd12-992ff23a97d7 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:23.163933 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5460f692-a07d-4d25-bd12-992ff23a97d7 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:23.277606 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-31d7fc7b-584a-46fb-8309-a7d017929911 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:23.299003 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-31d7fc7b-584a-46fb-8309-a7d017929911 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:23.305598 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-31d7fc7b-584a-46fb-8309-a7d017929911 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:23.307189 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-31d7fc7b-584a-46fb-8309-a7d017929911 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7" status: 200 len: 1346 microversion: 2.25 time: 0.329509 Oct 23 01:15:23.314066 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 719/1345] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:15:22 2022] GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7 => generated 1346 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:15:23.324313 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-87021ae5-7382-412a-83e9-cc38d2d8c1ab tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:23.324945 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-87021ae5-7382-412a-83e9-cc38d2d8c1ab tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] [instance: de212c9c-e0e0-471f-8a01-5d180ac28d07] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:23.337660 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-87021ae5-7382-412a-83e9-cc38d2d8c1ab tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:23.338189 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-87021ae5-7382-412a-83e9-cc38d2d8c1ab tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:23.342142 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-87021ae5-7382-412a-83e9-cc38d2d8c1ab tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:23.342928 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-87021ae5-7382-412a-83e9-cc38d2d8c1ab tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:23.343399 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-87021ae5-7382-412a-83e9-cc38d2d8c1ab tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:23.350165 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-87021ae5-7382-412a-83e9-cc38d2d8c1ab tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:23.925864 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5460f692-a07d-4d25-bd12-992ff23a97d7 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937a26d78d07458eaadc68fc9828d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3730de9c65d4add9f6f34aa7d5aa77e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:23.939590 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5460f692-a07d-4d25-bd12-992ff23a97d7 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] 10.222.0.42 "GET /compute/v2.1/servers/df71be7c-a3b2-4d32-bdbd-45eb56a93154" status: 200 len: 1469 microversion: 2.1 time: 0.794071 Oct 23 01:15:23.957398 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 627/1346] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:23 2022] GET /compute/v2.1/servers/df71be7c-a3b2-4d32-bdbd-45eb56a93154 => generated 1469 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:23.957398 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ce7bb819-c563-485b-a550-8f9ada8dd298 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:23.957398 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ce7bb819-c563-485b-a550-8f9ada8dd298 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 8025dc46-71af-4fec-8f54-5ae9e92cc31f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:23.985001 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce7bb819-c563-485b-a550-8f9ada8dd298 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:23.985511 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce7bb819-c563-485b-a550-8f9ada8dd298 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:23.989055 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce7bb819-c563-485b-a550-8f9ada8dd298 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:23.989801 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce7bb819-c563-485b-a550-8f9ada8dd298 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:23.991815 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce7bb819-c563-485b-a550-8f9ada8dd298 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:23.992282 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce7bb819-c563-485b-a550-8f9ada8dd298 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:24.033886 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-87021ae5-7382-412a-83e9-cc38d2d8c1ab tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80703c3d1dae419c9fd5ca103f3c28bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356a4b3819db457fb5caf68ded0212fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:24.044325 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-87021ae5-7382-412a-83e9-cc38d2d8c1ab tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] 10.222.0.42 "GET /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07" status: 200 len: 1318 microversion: 2.1 time: 0.729079 Oct 23 01:15:24.049368 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 720/1347] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:23 2022] GET /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07 => generated 1318 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:24.061043 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-05c920f3-bb80-460d-82b4-5b8f93d8daec tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:24.061887 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-05c920f3-bb80-460d-82b4-5b8f93d8daec tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 808c58c6-1606-4553-8dd3-8292fa1202b5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:24.079400 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05c920f3-bb80-460d-82b4-5b8f93d8daec tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:24.080690 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05c920f3-bb80-460d-82b4-5b8f93d8daec tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:24.082073 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05c920f3-bb80-460d-82b4-5b8f93d8daec tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:24.083102 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05c920f3-bb80-460d-82b4-5b8f93d8daec tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:24.087034 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05c920f3-bb80-460d-82b4-5b8f93d8daec tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:24.088204 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05c920f3-bb80-460d-82b4-5b8f93d8daec tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:24.385810 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ce7bb819-c563-485b-a550-8f9ada8dd298 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:24.392709 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-05c920f3-bb80-460d-82b4-5b8f93d8daec tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:24.402468 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ce7bb819-c563-485b-a550-8f9ada8dd298 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f" status: 200 len: 1541 microversion: 2.1 time: 0.458300 Oct 23 01:15:24.403072 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-05c920f3-bb80-460d-82b4-5b8f93d8daec tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/808c58c6-1606-4553-8dd3-8292fa1202b5" status: 200 len: 1319 microversion: 2.1 time: 0.349531 Oct 23 01:15:24.404310 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 721/1348] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:24 2022] GET /compute/v2.1/servers/808c58c6-1606-4553-8dd3-8292fa1202b5 => generated 1319 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:24.406816 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 628/1349] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:23 2022] GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f => generated 1541 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:24.409753 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e8f77c26-e39a-45a6-b684-954ec502bad2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:24.410635 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e8f77c26-e39a-45a6-b684-954ec502bad2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 291a0671-7bab-404a-b836-95fb7acfd1dd] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:24.418881 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8f77c26-e39a-45a6-b684-954ec502bad2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:24.419578 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8f77c26-e39a-45a6-b684-954ec502bad2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:24.420194 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8f77c26-e39a-45a6-b684-954ec502bad2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:24.421252 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8f77c26-e39a-45a6-b684-954ec502bad2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:24.422289 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8f77c26-e39a-45a6-b684-954ec502bad2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:24.422927 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8f77c26-e39a-45a6-b684-954ec502bad2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:24.437427 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ae06c4e8-a7f0-4d3e-953f-de3e56cc9ac9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:24.442753 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ae06c4e8-a7f0-4d3e-953f-de3e56cc9ac9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:24.452992 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ae06c4e8-a7f0-4d3e-953f-de3e56cc9ac9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:24.454412 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ae06c4e8-a7f0-4d3e-953f-de3e56cc9ac9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:24.456697 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ae06c4e8-a7f0-4d3e-953f-de3e56cc9ac9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:24.457732 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ae06c4e8-a7f0-4d3e-953f-de3e56cc9ac9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:24.460275 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ae06c4e8-a7f0-4d3e-953f-de3e56cc9ac9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:24.462957 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ae06c4e8-a7f0-4d3e-953f-de3e56cc9ac9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:24.721531 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e8f77c26-e39a-45a6-b684-954ec502bad2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:24.736829 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e8f77c26-e39a-45a6-b684-954ec502bad2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd" status: 200 len: 1324 microversion: 2.1 time: 0.330701 Oct 23 01:15:24.737821 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 722/1350] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:24 2022] GET /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd => generated 1324 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:24.743466 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5d3b0a99-c97f-44d2-a435-391b63210d72 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:24.744262 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5d3b0a99-c97f-44d2-a435-391b63210d72 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:24.759297 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5d3b0a99-c97f-44d2-a435-391b63210d72 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:24.762327 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5d3b0a99-c97f-44d2-a435-391b63210d72 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:24.762988 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5d3b0a99-c97f-44d2-a435-391b63210d72 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:24.764117 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5d3b0a99-c97f-44d2-a435-391b63210d72 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:24.764809 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5d3b0a99-c97f-44d2-a435-391b63210d72 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:24.765614 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ae06c4e8-a7f0-4d3e-953f-de3e56cc9ac9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:24.765908 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5d3b0a99-c97f-44d2-a435-391b63210d72 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:24.792586 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ae06c4e8-a7f0-4d3e-953f-de3e56cc9ac9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 200 len: 1717 microversion: 2.1 time: 0.384455 Oct 23 01:15:24.796371 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 629/1351] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:24 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 1717 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:24.854103 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5d3b0a99-c97f-44d2-a435-391b63210d72 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:24.854343 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-da66ae65-8b24-478d-a4bf-7e8556017ddd req-26326520-3c97-4f02-b289-7f6ab6b9c56c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df71be7c-a3b2-4d32-bdbd-45eb56a93154", "name": "network-vif-deleted", "tag": "dfef34ff-6be1-4050-abaa-b1b9919c4da1"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:15:24.863143 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5d3b0a99-c97f-44d2-a435-391b63210d72 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:24.865082 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5d3b0a99-c97f-44d2-a435-391b63210d72 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:24.866285 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5d3b0a99-c97f-44d2-a435-391b63210d72 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7" status: 200 len: 1344 microversion: 2.25 time: 0.127240 Oct 23 01:15:24.870077 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 723/1352] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:15:24 2022] GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7 => generated 1344 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:15:24.870240 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-da66ae65-8b24-478d-a4bf-7e8556017ddd req-26326520-3c97-4f02-b289-7f6ab6b9c56c service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:24.870240 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-da66ae65-8b24-478d-a4bf-7e8556017ddd req-26326520-3c97-4f02-b289-7f6ab6b9c56c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:24.870524 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-da66ae65-8b24-478d-a4bf-7e8556017ddd req-26326520-3c97-4f02-b289-7f6ab6b9c56c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:24.894690 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-da66ae65-8b24-478d-a4bf-7e8556017ddd req-26326520-3c97-4f02-b289-7f6ab6b9c56c service nova] Creating event network-vif-deleted:dfef34ff-6be1-4050-abaa-b1b9919c4da1 for instance df71be7c-a3b2-4d32-bdbd-45eb56a93154 on n-h1-master-1 Oct 23 01:15:24.901460 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-da66ae65-8b24-478d-a4bf-7e8556017ddd req-26326520-3c97-4f02-b289-7f6ab6b9c56c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051833 Oct 23 01:15:24.905854 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 630/1353] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:15:24.965565 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bbb2a0a1-2abf-49e1-8b41-f90a7da415bd tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:24.966362 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-bbb2a0a1-2abf-49e1-8b41-f90a7da415bd tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] [instance: df71be7c-a3b2-4d32-bdbd-45eb56a93154] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:24.975036 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bbb2a0a1-2abf-49e1-8b41-f90a7da415bd tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:24.975587 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bbb2a0a1-2abf-49e1-8b41-f90a7da415bd tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:24.976037 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bbb2a0a1-2abf-49e1-8b41-f90a7da415bd tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:24.976756 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bbb2a0a1-2abf-49e1-8b41-f90a7da415bd tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:24.977245 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bbb2a0a1-2abf-49e1-8b41-f90a7da415bd tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:24.977669 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bbb2a0a1-2abf-49e1-8b41-f90a7da415bd tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:25.038564 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-7bae8a07-2b1c-43c8-b861-880589cae008 req-979d5517-826d-4946-8a69-d392609eafc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "291a0671-7bab-404a-b836-95fb7acfd1dd", "name": "network-vif-plugged", "status": "completed", "tag": "35757a24-1cdf-43a8-b909-50d039effa1c"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:15:25.055264 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-7bae8a07-2b1c-43c8-b861-880589cae008 req-979d5517-826d-4946-8a69-d392609eafc5 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:25.058191 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-7bae8a07-2b1c-43c8-b861-880589cae008 req-979d5517-826d-4946-8a69-d392609eafc5 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:25.064698 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-7bae8a07-2b1c-43c8-b861-880589cae008 req-979d5517-826d-4946-8a69-d392609eafc5 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:25.111414 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-7bae8a07-2b1c-43c8-b861-880589cae008 req-979d5517-826d-4946-8a69-d392609eafc5 service nova] Creating event network-vif-plugged:35757a24-1cdf-43a8-b909-50d039effa1c for instance 291a0671-7bab-404a-b836-95fb7acfd1dd on n-h2-master-1 Oct 23 01:15:25.124512 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-7bae8a07-2b1c-43c8-b861-880589cae008 req-979d5517-826d-4946-8a69-d392609eafc5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091288 Oct 23 01:15:25.126874 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 631/1354] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:15:25.134874 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-96747f1d-e394-46f6-8a60-fc639ee192de tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:25.135668 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-96747f1d-e394-46f6-8a60-fc639ee192de tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] [instance: de212c9c-e0e0-471f-8a01-5d180ac28d07] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:25.143276 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-96747f1d-e394-46f6-8a60-fc639ee192de tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:25.143869 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-96747f1d-e394-46f6-8a60-fc639ee192de tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:25.144417 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-96747f1d-e394-46f6-8a60-fc639ee192de tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:25.145181 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-96747f1d-e394-46f6-8a60-fc639ee192de tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:25.145702 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-96747f1d-e394-46f6-8a60-fc639ee192de tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:25.146363 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-96747f1d-e394-46f6-8a60-fc639ee192de tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:25.207979 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bbb2a0a1-2abf-49e1-8b41-f90a7da415bd tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937a26d78d07458eaadc68fc9828d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3730de9c65d4add9f6f34aa7d5aa77e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:25.216739 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bbb2a0a1-2abf-49e1-8b41-f90a7da415bd tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] 10.222.0.42 "GET /compute/v2.1/servers/df71be7c-a3b2-4d32-bdbd-45eb56a93154" status: 200 len: 1427 microversion: 2.1 time: 0.255053 Oct 23 01:15:25.218033 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 724/1355] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:24 2022] GET /compute/v2.1/servers/df71be7c-a3b2-4d32-bdbd-45eb56a93154 => generated 1427 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:25.436695 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0d550a54-7d1c-46e4-9804-76c92dfd7c7d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:25.437315 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0d550a54-7d1c-46e4-9804-76c92dfd7c7d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 8025dc46-71af-4fec-8f54-5ae9e92cc31f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:25.453244 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d550a54-7d1c-46e4-9804-76c92dfd7c7d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:25.454098 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d550a54-7d1c-46e4-9804-76c92dfd7c7d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:25.454745 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d550a54-7d1c-46e4-9804-76c92dfd7c7d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:25.455635 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d550a54-7d1c-46e4-9804-76c92dfd7c7d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:25.456264 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d550a54-7d1c-46e4-9804-76c92dfd7c7d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:25.456861 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d550a54-7d1c-46e4-9804-76c92dfd7c7d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:25.537396 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-96747f1d-e394-46f6-8a60-fc639ee192de tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80703c3d1dae419c9fd5ca103f3c28bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356a4b3819db457fb5caf68ded0212fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:25.545489 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-96747f1d-e394-46f6-8a60-fc639ee192de tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] 10.222.0.42 "GET /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07" status: 200 len: 1318 microversion: 2.1 time: 0.417223 Oct 23 01:15:25.546416 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 632/1356] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:25 2022] GET /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07 => generated 1318 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:25.555981 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9018e3ba-a00e-4375-95b4-3af234464009 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:25.557111 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9018e3ba-a00e-4375-95b4-3af234464009 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 808c58c6-1606-4553-8dd3-8292fa1202b5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:25.565291 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:15:25.567374 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9018e3ba-a00e-4375-95b4-3af234464009 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:25.577830 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9018e3ba-a00e-4375-95b4-3af234464009 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:25.586978 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9018e3ba-a00e-4375-95b4-3af234464009 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:25.586978 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9018e3ba-a00e-4375-95b4-3af234464009 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:25.586978 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9018e3ba-a00e-4375-95b4-3af234464009 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:25.586978 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9018e3ba-a00e-4375-95b4-3af234464009 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:25.679907 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0d550a54-7d1c-46e4-9804-76c92dfd7c7d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:25.691145 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0d550a54-7d1c-46e4-9804-76c92dfd7c7d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f" status: 200 len: 1541 microversion: 2.1 time: 0.257121 Oct 23 01:15:25.711456 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 725/1357] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:25 2022] GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f => generated 1541 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:15:25.761960 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e8778f53-ef1f-4959-8aad-9e84070708be tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:25.768415 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e8778f53-ef1f-4959-8aad-9e84070708be tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 291a0671-7bab-404a-b836-95fb7acfd1dd] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:25.770246 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8778f53-ef1f-4959-8aad-9e84070708be tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:25.771001 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8778f53-ef1f-4959-8aad-9e84070708be tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:25.771898 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8778f53-ef1f-4959-8aad-9e84070708be tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:25.773448 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8778f53-ef1f-4959-8aad-9e84070708be tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:25.774328 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8778f53-ef1f-4959-8aad-9e84070708be tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:25.775036 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8778f53-ef1f-4959-8aad-9e84070708be tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:26.098346 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9018e3ba-a00e-4375-95b4-3af234464009 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:26.108883 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9018e3ba-a00e-4375-95b4-3af234464009 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/808c58c6-1606-4553-8dd3-8292fa1202b5" status: 200 len: 1319 microversion: 2.1 time: 0.560074 Oct 23 01:15:26.108883 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 633/1358] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:25 2022] GET /compute/v2.1/servers/808c58c6-1606-4553-8dd3-8292fa1202b5 => generated 1319 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:26.137411 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3cdfbd30-63ca-4bf2-b894-b5155f4b3477 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:26.142007 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3cdfbd30-63ca-4bf2-b894-b5155f4b3477 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:26.155650 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3cdfbd30-63ca-4bf2-b894-b5155f4b3477 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:26.156500 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3cdfbd30-63ca-4bf2-b894-b5155f4b3477 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:26.157718 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3cdfbd30-63ca-4bf2-b894-b5155f4b3477 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:26.159474 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3cdfbd30-63ca-4bf2-b894-b5155f4b3477 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:26.160164 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3cdfbd30-63ca-4bf2-b894-b5155f4b3477 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:26.161198 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3cdfbd30-63ca-4bf2-b894-b5155f4b3477 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:26.163582 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e8778f53-ef1f-4959-8aad-9e84070708be tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:26.177657 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e8778f53-ef1f-4959-8aad-9e84070708be tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd" status: 200 len: 1324 microversion: 2.1 time: 0.416570 Oct 23 01:15:26.198024 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 726/1359] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:25 2022] GET /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd => generated 1324 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:26.209925 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a4a0dee1-a588-4868-afa1-6f0e3b8d7b94 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:26.212347 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a4a0dee1-a588-4868-afa1-6f0e3b8d7b94 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:26.230190 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a4a0dee1-a588-4868-afa1-6f0e3b8d7b94 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:26.231032 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a4a0dee1-a588-4868-afa1-6f0e3b8d7b94 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:26.232702 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a4a0dee1-a588-4868-afa1-6f0e3b8d7b94 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:26.236173 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a4a0dee1-a588-4868-afa1-6f0e3b8d7b94 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:26.236674 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a4a0dee1-a588-4868-afa1-6f0e3b8d7b94 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:26.237117 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a4a0dee1-a588-4868-afa1-6f0e3b8d7b94 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:26.413123 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a4a0dee1-a588-4868-afa1-6f0e3b8d7b94 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:26.426925 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a4a0dee1-a588-4868-afa1-6f0e3b8d7b94 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:26.429286 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a4a0dee1-a588-4868-afa1-6f0e3b8d7b94 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:26.431244 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a4a0dee1-a588-4868-afa1-6f0e3b8d7b94 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7" status: 200 len: 1344 microversion: 2.25 time: 0.231851 Oct 23 01:15:26.433086 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 727/1360] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:15:26 2022] GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7 => generated 1344 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:15:26.439514 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-222f5ad2-426b-47d8-9d95-edbcb9522457 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:26.447084 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-222f5ad2-426b-47d8-9d95-edbcb9522457 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] [instance: df71be7c-a3b2-4d32-bdbd-45eb56a93154] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:26.453952 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-222f5ad2-426b-47d8-9d95-edbcb9522457 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:26.454761 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-222f5ad2-426b-47d8-9d95-edbcb9522457 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:26.455532 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-222f5ad2-426b-47d8-9d95-edbcb9522457 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:26.456505 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-222f5ad2-426b-47d8-9d95-edbcb9522457 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:26.458782 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-222f5ad2-426b-47d8-9d95-edbcb9522457 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:26.459547 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-222f5ad2-426b-47d8-9d95-edbcb9522457 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:26.560714 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-222f5ad2-426b-47d8-9d95-edbcb9522457 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:26.561526 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-222f5ad2-426b-47d8-9d95-edbcb9522457 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:26.563742 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-222f5ad2-426b-47d8-9d95-edbcb9522457 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:26.565832 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-222f5ad2-426b-47d8-9d95-edbcb9522457 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lazy-loading 'fault' on Instance uuid df71be7c-a3b2-4d32-bdbd-45eb56a93154 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:15:26.593651 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3cdfbd30-63ca-4bf2-b894-b5155f4b3477 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:26.609482 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3cdfbd30-63ca-4bf2-b894-b5155f4b3477 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 200 len: 1717 microversion: 2.1 time: 0.485986 Oct 23 01:15:26.610527 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 634/1361] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:26 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 1717 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:26.617937 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1a0de122-12f6-48ba-ab49-d7975eda7e0f tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:26.619095 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1a0de122-12f6-48ba-ab49-d7975eda7e0f tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] [instance: de212c9c-e0e0-471f-8a01-5d180ac28d07] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:26.627899 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1a0de122-12f6-48ba-ab49-d7975eda7e0f tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:26.629141 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1a0de122-12f6-48ba-ab49-d7975eda7e0f tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:26.629960 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1a0de122-12f6-48ba-ab49-d7975eda7e0f tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:26.631007 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1a0de122-12f6-48ba-ab49-d7975eda7e0f tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:26.631598 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1a0de122-12f6-48ba-ab49-d7975eda7e0f tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:26.633207 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1a0de122-12f6-48ba-ab49-d7975eda7e0f tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:26.637346 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-222f5ad2-426b-47d8-9d95-edbcb9522457 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937a26d78d07458eaadc68fc9828d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3730de9c65d4add9f6f34aa7d5aa77e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:26.648649 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-222f5ad2-426b-47d8-9d95-edbcb9522457 tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] 10.222.0.42 "GET /compute/v2.1/servers/df71be7c-a3b2-4d32-bdbd-45eb56a93154" status: 200 len: 1303 microversion: 2.1 time: 0.214200 Oct 23 01:15:26.652432 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 728/1362] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:26 2022] GET /compute/v2.1/servers/df71be7c-a3b2-4d32-bdbd-45eb56a93154 => generated 1303 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:26.730021 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5501d692-5c8d-4700-9d1a-0c954e0298fe tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:26.730419 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5501d692-5c8d-4700-9d1a-0c954e0298fe tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 8025dc46-71af-4fec-8f54-5ae9e92cc31f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:26.742265 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5501d692-5c8d-4700-9d1a-0c954e0298fe tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:26.749310 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5501d692-5c8d-4700-9d1a-0c954e0298fe tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:26.749789 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5501d692-5c8d-4700-9d1a-0c954e0298fe tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:26.750563 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5501d692-5c8d-4700-9d1a-0c954e0298fe tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:26.751158 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5501d692-5c8d-4700-9d1a-0c954e0298fe tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:26.751438 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5501d692-5c8d-4700-9d1a-0c954e0298fe tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:26.984132 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1a0de122-12f6-48ba-ab49-d7975eda7e0f tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80703c3d1dae419c9fd5ca103f3c28bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356a4b3819db457fb5caf68ded0212fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:26.993345 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1a0de122-12f6-48ba-ab49-d7975eda7e0f tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] 10.222.0.42 "GET /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07" status: 200 len: 1467 microversion: 2.1 time: 0.380737 Oct 23 01:15:27.008029 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 635/1363] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:26 2022] GET /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07 => generated 1467 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:27.021623 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-6150c70b-58a9-4635-b069-4d0acdcb9403 req-07b02a61-2111-4ee6-878d-0b3648dfa9d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8025dc46-71af-4fec-8f54-5ae9e92cc31f", "name": "network-vif-unplugged", "status": "completed", "tag": "9dbeafb3-f8f6-45eb-993c-c817b00700d0"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:15:27.042502 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-6150c70b-58a9-4635-b069-4d0acdcb9403 req-07b02a61-2111-4ee6-878d-0b3648dfa9d1 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:27.042999 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-6150c70b-58a9-4635-b069-4d0acdcb9403 req-07b02a61-2111-4ee6-878d-0b3648dfa9d1 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:27.043434 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-6150c70b-58a9-4635-b069-4d0acdcb9403 req-07b02a61-2111-4ee6-878d-0b3648dfa9d1 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:27.057290 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-6150c70b-58a9-4635-b069-4d0acdcb9403 req-07b02a61-2111-4ee6-878d-0b3648dfa9d1 service nova] Creating event network-vif-unplugged:9dbeafb3-f8f6-45eb-993c-c817b00700d0 for instance 8025dc46-71af-4fec-8f54-5ae9e92cc31f on n-h1-master-1 Oct 23 01:15:27.063995 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [req-6150c70b-58a9-4635-b069-4d0acdcb9403 req-07b02a61-2111-4ee6-878d-0b3648dfa9d1 service nova] Instance 8025dc46-71af-4fec-8f54-5ae9e92cc31f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120944) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 23 01:15:27.076081 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-6150c70b-58a9-4635-b069-4d0acdcb9403 req-07b02a61-2111-4ee6-878d-0b3648dfa9d1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066684 Oct 23 01:15:27.076946 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 636/1364] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:15:27.082548 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f2da315d-bbcb-4168-9dfa-434c01581aee tempest-LiveMigrationNegativeTest-1953311517 tempest-LiveMigrationNegativeTest-1953311517-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:15:27.083442 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f2da315d-bbcb-4168-9dfa-434c01581aee tempest-LiveMigrationNegativeTest-1953311517 tempest-LiveMigrationNegativeTest-1953311517-project-admin] [instance: de212c9c-e0e0-471f-8a01-5d180ac28d07] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:27.090185 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2da315d-bbcb-4168-9dfa-434c01581aee tempest-LiveMigrationNegativeTest-1953311517 tempest-LiveMigrationNegativeTest-1953311517-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:27.091063 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2da315d-bbcb-4168-9dfa-434c01581aee tempest-LiveMigrationNegativeTest-1953311517 tempest-LiveMigrationNegativeTest-1953311517-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:27.091694 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2da315d-bbcb-4168-9dfa-434c01581aee tempest-LiveMigrationNegativeTest-1953311517 tempest-LiveMigrationNegativeTest-1953311517-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:27.093175 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2da315d-bbcb-4168-9dfa-434c01581aee tempest-LiveMigrationNegativeTest-1953311517 tempest-LiveMigrationNegativeTest-1953311517-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:27.096180 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2da315d-bbcb-4168-9dfa-434c01581aee tempest-LiveMigrationNegativeTest-1953311517 tempest-LiveMigrationNegativeTest-1953311517-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:27.096796 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2da315d-bbcb-4168-9dfa-434c01581aee tempest-LiveMigrationNegativeTest-1953311517 tempest-LiveMigrationNegativeTest-1953311517-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:27.109694 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5501d692-5c8d-4700-9d1a-0c954e0298fe tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:27.121858 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5501d692-5c8d-4700-9d1a-0c954e0298fe tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f" status: 200 len: 1540 microversion: 2.1 time: 0.400140 Oct 23 01:15:27.124134 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 729/1365] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:26 2022] GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f => generated 1540 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:27.131899 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-f2da315d-bbcb-4168-9dfa-434c01581aee tempest-LiveMigrationNegativeTest-1953311517 tempest-LiveMigrationNegativeTest-1953311517-project-admin] Lazy-loading 'flavor' on Instance uuid de212c9c-e0e0-471f-8a01-5d180ac28d07 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:15:27.140301 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cf58efc8-799f-493a-85de-342e082a11aa tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:27.141111 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cf58efc8-799f-493a-85de-342e082a11aa tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 808c58c6-1606-4553-8dd3-8292fa1202b5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:27.158505 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf58efc8-799f-493a-85de-342e082a11aa tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:27.159057 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf58efc8-799f-493a-85de-342e082a11aa tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:27.159532 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf58efc8-799f-493a-85de-342e082a11aa tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:27.160259 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf58efc8-799f-493a-85de-342e082a11aa tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:27.162566 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf58efc8-799f-493a-85de-342e082a11aa tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:27.163709 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf58efc8-799f-493a-85de-342e082a11aa tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:27.194492 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:15:27.521326 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f2da315d-bbcb-4168-9dfa-434c01581aee tempest-LiveMigrationNegativeTest-1953311517 tempest-LiveMigrationNegativeTest-1953311517-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07/action" status: 202 len: 0 microversion: 2.1 time: 0.442788 Oct 23 01:15:27.523147 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 637/1366] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:15:27 2022] POST /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07/action => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:15:27.524366 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cf58efc8-799f-493a-85de-342e082a11aa tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:27.534476 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cf58efc8-799f-493a-85de-342e082a11aa tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/808c58c6-1606-4553-8dd3-8292fa1202b5" status: 200 len: 1319 microversion: 2.1 time: 0.402031 Oct 23 01:15:27.535062 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 730/1367] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:27 2022] GET /compute/v2.1/servers/808c58c6-1606-4553-8dd3-8292fa1202b5 => generated 1319 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:27.546011 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d0124255-112c-4eff-9332-64b41fdfc16a tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:27.547028 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d0124255-112c-4eff-9332-64b41fdfc16a tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 291a0671-7bab-404a-b836-95fb7acfd1dd] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:27.554329 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0124255-112c-4eff-9332-64b41fdfc16a tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:27.555125 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0124255-112c-4eff-9332-64b41fdfc16a tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:27.555322 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-557daab3-2525-47ea-9586-055b6a1f7d55 req-864f56a1-3e7f-4ebc-a595-869092f7e877 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "808c58c6-1606-4553-8dd3-8292fa1202b5", "name": "network-vif-plugged", "status": "completed", "tag": "a1d9a75e-ec02-4175-8ef7-8581a5c472dc"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:15:27.555886 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0124255-112c-4eff-9332-64b41fdfc16a tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:27.557293 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0124255-112c-4eff-9332-64b41fdfc16a tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:27.558046 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0124255-112c-4eff-9332-64b41fdfc16a tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:27.563432 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0124255-112c-4eff-9332-64b41fdfc16a tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:27.572102 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-557daab3-2525-47ea-9586-055b6a1f7d55 req-864f56a1-3e7f-4ebc-a595-869092f7e877 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:27.572524 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-557daab3-2525-47ea-9586-055b6a1f7d55 req-864f56a1-3e7f-4ebc-a595-869092f7e877 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:27.572975 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-557daab3-2525-47ea-9586-055b6a1f7d55 req-864f56a1-3e7f-4ebc-a595-869092f7e877 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:27.589181 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-557daab3-2525-47ea-9586-055b6a1f7d55 req-864f56a1-3e7f-4ebc-a595-869092f7e877 service nova] Creating event network-vif-plugged:a1d9a75e-ec02-4175-8ef7-8581a5c472dc for instance 808c58c6-1606-4553-8dd3-8292fa1202b5 on n-h1-master-1 Oct 23 01:15:27.594610 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-557daab3-2525-47ea-9586-055b6a1f7d55 req-864f56a1-3e7f-4ebc-a595-869092f7e877 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068463 Oct 23 01:15:27.595885 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 638/1368] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:15:27.603068 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bdb59d88-c6b9-41db-8af7-6326aef0f9fc tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:27.603921 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bdb59d88-c6b9-41db-8af7-6326aef0f9fc tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:27.610328 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bdb59d88-c6b9-41db-8af7-6326aef0f9fc tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:27.610885 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bdb59d88-c6b9-41db-8af7-6326aef0f9fc tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:27.611625 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bdb59d88-c6b9-41db-8af7-6326aef0f9fc tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:27.612328 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bdb59d88-c6b9-41db-8af7-6326aef0f9fc tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:27.612777 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bdb59d88-c6b9-41db-8af7-6326aef0f9fc tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:27.613200 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bdb59d88-c6b9-41db-8af7-6326aef0f9fc tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:27.636848 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:15:27.951922 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d0124255-112c-4eff-9332-64b41fdfc16a tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:27.961256 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d0124255-112c-4eff-9332-64b41fdfc16a tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd" status: 200 len: 1522 microversion: 2.1 time: 0.423066 Oct 23 01:15:27.974249 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bdb59d88-c6b9-41db-8af7-6326aef0f9fc tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:27.976073 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 731/1369] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:27 2022] GET /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd => generated 1522 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:27.988715 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-84536d32-a003-4864-b333-bfe0367b6f18 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:27.989679 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-84536d32-a003-4864-b333-bfe0367b6f18 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] [instance: de212c9c-e0e0-471f-8a01-5d180ac28d07] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:27.996416 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-84536d32-a003-4864-b333-bfe0367b6f18 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:27.997038 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-84536d32-a003-4864-b333-bfe0367b6f18 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:27.997590 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-84536d32-a003-4864-b333-bfe0367b6f18 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:27.998560 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-84536d32-a003-4864-b333-bfe0367b6f18 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:27.999116 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-84536d32-a003-4864-b333-bfe0367b6f18 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:27.999634 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-84536d32-a003-4864-b333-bfe0367b6f18 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:28.002884 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bdb59d88-c6b9-41db-8af7-6326aef0f9fc tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:28.009003 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bdb59d88-c6b9-41db-8af7-6326aef0f9fc tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:28.012817 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bdb59d88-c6b9-41db-8af7-6326aef0f9fc tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7" status: 200 len: 1412 microversion: 2.25 time: 0.415554 Oct 23 01:15:28.015008 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 639/1370] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:15:27 2022] GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7 => generated 1412 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:15:28.037456 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b5ea4370-bfe1-494e-92c8-7e64ddf46adb tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:28.038130 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b5ea4370-bfe1-494e-92c8-7e64ddf46adb tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:28.044581 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5ea4370-bfe1-494e-92c8-7e64ddf46adb tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:28.045067 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5ea4370-bfe1-494e-92c8-7e64ddf46adb tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:28.045493 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5ea4370-bfe1-494e-92c8-7e64ddf46adb tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:28.046421 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5ea4370-bfe1-494e-92c8-7e64ddf46adb tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:28.047306 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5ea4370-bfe1-494e-92c8-7e64ddf46adb tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:28.047902 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5ea4370-bfe1-494e-92c8-7e64ddf46adb tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:28.260456 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-84536d32-a003-4864-b333-bfe0367b6f18 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80703c3d1dae419c9fd5ca103f3c28bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356a4b3819db457fb5caf68ded0212fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:28.273211 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-84536d32-a003-4864-b333-bfe0367b6f18 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] 10.222.0.42 "GET /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07" status: 200 len: 1475 microversion: 2.1 time: 0.288218 Oct 23 01:15:28.273837 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 732/1371] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:27 2022] GET /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07 => generated 1475 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:28.279215 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9915c624-5988-41a1-836f-d6251a1a6b0f tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:28.283136 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9915c624-5988-41a1-836f-d6251a1a6b0f tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] [instance: df71be7c-a3b2-4d32-bdbd-45eb56a93154] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:28.286785 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9915c624-5988-41a1-836f-d6251a1a6b0f tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:28.287604 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9915c624-5988-41a1-836f-d6251a1a6b0f tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:28.288914 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9915c624-5988-41a1-836f-d6251a1a6b0f tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:28.290013 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9915c624-5988-41a1-836f-d6251a1a6b0f tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:28.290492 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9915c624-5988-41a1-836f-d6251a1a6b0f tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:28.290923 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9915c624-5988-41a1-836f-d6251a1a6b0f tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:28.292271 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b5ea4370-bfe1-494e-92c8-7e64ddf46adb tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:28.303251 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b5ea4370-bfe1-494e-92c8-7e64ddf46adb tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 200 len: 1717 microversion: 2.1 time: 0.271644 Oct 23 01:15:28.304418 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 640/1372] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:28 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 1717 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:28.306012 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-9915c624-5988-41a1-836f-d6251a1a6b0f tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] HTTP exception thrown: Instance df71be7c-a3b2-4d32-bdbd-45eb56a93154 could not be found. Oct 23 01:15:28.307671 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9915c624-5988-41a1-836f-d6251a1a6b0f tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Request method failure captured: Oct 23 01:15:28.307671 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/df71be7c-a3b2-4d32-bdbd-45eb56a93154 HTTP/1.1 Oct 23 01:15:28.307671 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:15:28.307671 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:15:28.307671 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:15:28.307671 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:15:28.307671 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:15:28.307671 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:15:28.307671 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:15:28.307671 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:15:28.307671 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJWPKeL_KLSlQ7kgZtwnBRI_nT3zoCUX_9mva7VgowzCHqjRCCN6ZLoUqT_aWdH4e17Q4kLTYRw0z7EtD3gFbqjcuFG9f2EcJDrmXiQ0sFgDnY7eha2JHpQkPiyGMU5GxZNpdjuf9Bz-zy3w0u37yIWPMRK3iOVkoxYt6UXN56UoEsg Oct 23 01:15:28.307671 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:15:28.307671 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:15:28.307671 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:15:28.307671 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:15:28.307671 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:15:28.307671 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:15:28.307671 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: c3730de9c65d4add9f6f34aa7d5aa77e Oct 23 01:15:28.307671 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-TenantUsagesTestJSON-255450561 Oct 23 01:15:28.307671 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:15:28.307671 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:15:28.309048 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c3730de9c65d4add9f6f34aa7d5aa77e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c3730de9c65d4add9f6f34aa7d5aa77e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c3730de9c65d4add9f6f34aa7d5aa77e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c3730de9c65d4add9f6f34aa7d5aa77e"}]}] Oct 23 01:15:28.309048 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-TenantUsagesTestJSON-255450561 Oct 23 01:15:28.309048 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: c3730de9c65d4add9f6f34aa7d5aa77e Oct 23 01:15:28.309048 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-TenantUsagesTestJSON-255450561 Oct 23 01:15:28.309048 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-TenantUsagesTestJSON-255450561-project Oct 23 01:15:28.309048 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:15:28.309048 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:15:28.309048 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 937a26d78d07458eaadc68fc9828d738 Oct 23 01:15:28.309048 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-TenantUsagesTestJSON-255450561-project Oct 23 01:15:28.309048 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:15:28.309048 n-d-master-1 devstack@n-api.service[120945]: exception: Instance df71be7c-a3b2-4d32-bdbd-45eb56a93154 could not be found. Oct 23 01:15:28.309048 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'df71be7c-a3b2-4d32-bdbd-45eb56a93154'} Oct 23 01:15:28.309816 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:15:28.309816 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:15:28.309816 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:15:28.309816 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:15:28.309816 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:15:28.309816 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:15:28.309816 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:15:28.309816 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:15:28.309816 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:15:28.309816 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:15:28.309816 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df71be7c-a3b2-4d32-bdbd-45eb56a93154 could not be found. Oct 23 01:15:28.309816 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:15:28.309816 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:15:28.309816 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:15:28.309816 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:15:28.309816 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:15:28.309816 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:15:28.309816 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:15:28.309816 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:15:28.309816 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:15:28.311943 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:15:28.311943 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:15:28.311943 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:15:28.311943 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:15:28.311943 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:15:28.311943 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:15:28.311943 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:15:28.311943 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df71be7c-a3b2-4d32-bdbd-45eb56a93154 could not be found. Oct 23 01:15:28.311943 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:15:28.311943 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:15:28.311943 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:15:28.311943 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:15:28.311943 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:15:28.311943 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:15:28.311943 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:15:28.311943 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:15:28.311943 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df71be7c-a3b2-4d32-bdbd-45eb56a93154 could not be found. Oct 23 01:15:28.311943 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:15:28.313992 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9915c624-5988-41a1-836f-d6251a1a6b0f tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] Returning 404 to user: Instance df71be7c-a3b2-4d32-bdbd-45eb56a93154 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:15:28.313992 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9915c624-5988-41a1-836f-d6251a1a6b0f tempest-TenantUsagesTestJSON-255450561 tempest-TenantUsagesTestJSON-255450561-project] 10.222.0.42 "GET /compute/v2.1/servers/df71be7c-a3b2-4d32-bdbd-45eb56a93154" status: 404 len: 111 microversion: 2.1 time: 0.034114 Oct 23 01:15:28.313992 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 733/1373] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:28 2022] GET /compute/v2.1/servers/df71be7c-a3b2-4d32-bdbd-45eb56a93154 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:15:28.321143 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3a2c9af9-232a-4a7a-ba34-130e61f072d8 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:28.322003 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3a2c9af9-232a-4a7a-ba34-130e61f072d8 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 291a0671-7bab-404a-b836-95fb7acfd1dd] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:28.325184 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-edd24f3d-6719-4d1a-9379-1502263d35a5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:28.325864 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-edd24f3d-6719-4d1a-9379-1502263d35a5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 8025dc46-71af-4fec-8f54-5ae9e92cc31f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:28.330633 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3a2c9af9-232a-4a7a-ba34-130e61f072d8 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:28.331650 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3a2c9af9-232a-4a7a-ba34-130e61f072d8 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:28.332267 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3a2c9af9-232a-4a7a-ba34-130e61f072d8 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:28.333035 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3a2c9af9-232a-4a7a-ba34-130e61f072d8 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:28.333561 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3a2c9af9-232a-4a7a-ba34-130e61f072d8 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:28.334114 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3a2c9af9-232a-4a7a-ba34-130e61f072d8 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:28.336494 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-edd24f3d-6719-4d1a-9379-1502263d35a5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:28.337358 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-edd24f3d-6719-4d1a-9379-1502263d35a5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:28.338068 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-edd24f3d-6719-4d1a-9379-1502263d35a5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:28.338969 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-edd24f3d-6719-4d1a-9379-1502263d35a5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:28.339612 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-edd24f3d-6719-4d1a-9379-1502263d35a5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:28.340223 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-edd24f3d-6719-4d1a-9379-1502263d35a5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:28.916793 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3a2c9af9-232a-4a7a-ba34-130e61f072d8 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:28.927322 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3a2c9af9-232a-4a7a-ba34-130e61f072d8 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd" status: 200 len: 1522 microversion: 2.1 time: 0.620849 Oct 23 01:15:28.943521 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 641/1374] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:28 2022] GET /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd => generated 1522 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:28.947105 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6b95935b-932f-4dd8-b61d-c199328d5d5a tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:28.947780 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6b95935b-932f-4dd8-b61d-c199328d5d5a tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 808c58c6-1606-4553-8dd3-8292fa1202b5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:28.959523 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b95935b-932f-4dd8-b61d-c199328d5d5a tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:28.960407 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b95935b-932f-4dd8-b61d-c199328d5d5a tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:28.961072 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b95935b-932f-4dd8-b61d-c199328d5d5a tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:28.962044 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b95935b-932f-4dd8-b61d-c199328d5d5a tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:28.962731 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b95935b-932f-4dd8-b61d-c199328d5d5a tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:28.963393 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b95935b-932f-4dd8-b61d-c199328d5d5a tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:28.971614 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-edd24f3d-6719-4d1a-9379-1502263d35a5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:28.980402 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-edd24f3d-6719-4d1a-9379-1502263d35a5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f" status: 200 len: 1540 microversion: 2.1 time: 0.669772 Oct 23 01:15:28.984100 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 734/1375] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:28 2022] GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f => generated 1540 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:28.994095 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c89dc1f3-ebd1-436d-97ac-8e5270f44196 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1529282697", "metadata": {"": ""}}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:15:29.008963 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c89dc1f3-ebd1-436d-97ac-8e5270f44196 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Request method failure captured: Oct 23 01:15:29.008963 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd/action HTTP/1.1 Oct 23 01:15:29.008963 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:15:29.008963 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:15:29.008963 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:15:29.008963 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 107 Oct 23 01:15:29.008963 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:15:29.008963 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:15:29.008963 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:15:29.008963 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:15:29.008963 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJWaABlg9aZPPmiKYOFyjnW3cUDNfMTW-9Ow-Ga99e9rhT_Xz0fOPaBTxk-ZvoWH3eiZ84RoqOaVKmH_NPvl5JjsEC9A2dnRRYDDEs3eUATgMIXjceNensPNpeVu874ElZedsjKlwKXnfqakqBoob0ap94r3bfJNgcmUxWbrsNVh5-k Oct 23 01:15:29.008963 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:15:29.008963 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:15:29.008963 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:15:29.008963 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:15:29.008963 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:15:29.008963 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:15:29.008963 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 1aa3395c4af3435eaa3a0f49e19167fe Oct 23 01:15:29.008963 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-421844011 Oct 23 01:15:29.008963 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:15:29.008963 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:15:29.012376 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1aa3395c4af3435eaa3a0f49e19167fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1aa3395c4af3435eaa3a0f49e19167fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1aa3395c4af3435eaa3a0f49e19167fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1aa3395c4af3435eaa3a0f49e19167fe"}]}] Oct 23 01:15:29.012376 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-421844011 Oct 23 01:15:29.012376 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 1aa3395c4af3435eaa3a0f49e19167fe Oct 23 01:15:29.012376 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-421844011 Oct 23 01:15:29.012376 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ImagesOneServerNegativeTestJSON-421844011-project Oct 23 01:15:29.012376 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:15:29.012376 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:15:29.012376 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 690143905857471f949b1f4454ad2139 Oct 23 01:15:29.012376 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-421844011-project Oct 23 01:15:29.012376 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:15:29.012376 n-d-master-1 devstack@n-api.service[120945]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1529282697", "metadata": {"": ""}}} Oct 23 01:15:29.012376 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:15:29.013208 n-d-master-1 devstack@n-api.service[120945]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 23 01:15:29.013208 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '291a0671-7bab-404a-b836-95fb7acfd1dd', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1529282697', 'metadata': {'': ''}}}} Oct 23 01:15:29.013208 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:15:29.013208 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:15:29.013208 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 23 01:15:29.013208 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 23 01:15:29.013208 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 01:15:29.013208 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise error Oct 23 01:15:29.013208 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 23 01:15:29.013208 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:15:29.013208 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 23 01:15:29.013208 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 23 01:15:29.013208 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 23 01:15:29.013208 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 23 01:15:29.013208 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 23 01:15:29.013208 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:15:29.013208 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 23 01:15:29.013208 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi {'': ''} Oct 23 01:15:29.013208 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:15:29.013208 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:15:29.013208 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:15:29.014668 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:15:29.014668 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:15:29.014668 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:15:29.014668 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:15:29.014668 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:15:29.014668 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:15:29.014668 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:15:29.014668 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:15:29.014668 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:15:29.014668 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 23 01:15:29.014668 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 23 01:15:29.014668 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 23 01:15:29.014668 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 23 01:15:29.014668 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 23 01:15:29.014668 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 23 01:15:29.014668 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 23 01:15:29.014668 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:15:29.014668 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:15:29.014668 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:15:29.014668 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:15:29.015911 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:15:29.015911 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:15:29.015911 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 23 01:15:29.015911 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 23 01:15:29.015911 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 23 01:15:29.015911 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:15:29.015911 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c89dc1f3-ebd1-436d-97ac-8e5270f44196 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:15:29.015911 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c89dc1f3-ebd1-436d-97ac-8e5270f44196 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "POST /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd/action" status: 400 len: 170 microversion: 2.1 time: 0.023815 Oct 23 01:15:29.015911 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 735/1376] 10.222.0.42 () {60 vars in 1279 bytes} [Sun Oct 23 01:15:28 2022] POST /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd/action => generated 170 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:15:29.021844 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a4a2fb4c-5fb5-4705-b8cc-de2e67b44cc6 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:29.022905 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a4a2fb4c-5fb5-4705-b8cc-de2e67b44cc6 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 291a0671-7bab-404a-b836-95fb7acfd1dd] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:29.031345 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a4a2fb4c-5fb5-4705-b8cc-de2e67b44cc6 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:29.032066 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a4a2fb4c-5fb5-4705-b8cc-de2e67b44cc6 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:29.032924 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a4a2fb4c-5fb5-4705-b8cc-de2e67b44cc6 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:29.033842 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a4a2fb4c-5fb5-4705-b8cc-de2e67b44cc6 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:29.034475 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a4a2fb4c-5fb5-4705-b8cc-de2e67b44cc6 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:29.035060 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a4a2fb4c-5fb5-4705-b8cc-de2e67b44cc6 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:29.205428 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6b95935b-932f-4dd8-b61d-c199328d5d5a tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:29.217788 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6b95935b-932f-4dd8-b61d-c199328d5d5a tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/808c58c6-1606-4553-8dd3-8292fa1202b5" status: 200 len: 1319 microversion: 2.1 time: 0.286584 Oct 23 01:15:29.218423 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 642/1377] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:28 2022] GET /compute/v2.1/servers/808c58c6-1606-4553-8dd3-8292fa1202b5 => generated 1319 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:29.223797 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b789be40-8565-4154-ad9e-563532a939d0 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:29.224407 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b789be40-8565-4154-ad9e-563532a939d0 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:29.231079 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b789be40-8565-4154-ad9e-563532a939d0 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:29.231570 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b789be40-8565-4154-ad9e-563532a939d0 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:29.232007 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b789be40-8565-4154-ad9e-563532a939d0 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:29.232708 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b789be40-8565-4154-ad9e-563532a939d0 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:29.233157 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b789be40-8565-4154-ad9e-563532a939d0 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:29.234248 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b789be40-8565-4154-ad9e-563532a939d0 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:29.495880 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b789be40-8565-4154-ad9e-563532a939d0 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:29.505567 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b789be40-8565-4154-ad9e-563532a939d0 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:29.507684 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b789be40-8565-4154-ad9e-563532a939d0 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:29.510280 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b789be40-8565-4154-ad9e-563532a939d0 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7" status: 200 len: 1412 microversion: 2.25 time: 0.290050 Oct 23 01:15:29.518070 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 643/1378] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:15:29 2022] GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7 => generated 1412 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:15:29.532668 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-5117d3e8-437d-4c88-9768-fad2baa1cbb4 req-19456307-a69d-454c-a2c4-f53790b9053c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8025dc46-71af-4fec-8f54-5ae9e92cc31f", "tag": "9dbeafb3-f8f6-45eb-993c-c817b00700d0"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:15:29.540524 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a4a2fb4c-5fb5-4705-b8cc-de2e67b44cc6 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:29.548626 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-5117d3e8-437d-4c88-9768-fad2baa1cbb4 req-19456307-a69d-454c-a2c4-f53790b9053c service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:29.549152 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a4a2fb4c-5fb5-4705-b8cc-de2e67b44cc6 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd" status: 200 len: 1522 microversion: 2.1 time: 0.533883 Oct 23 01:15:29.549789 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-5117d3e8-437d-4c88-9768-fad2baa1cbb4 req-19456307-a69d-454c-a2c4-f53790b9053c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:29.550129 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 736/1379] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:29 2022] GET /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd => generated 1522 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:29.550813 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-5117d3e8-437d-4c88-9768-fad2baa1cbb4 req-19456307-a69d-454c-a2c4-f53790b9053c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:29.564152 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1c3c5636-0bbf-4380-b845-2d5b55177160 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:29.565424 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1c3c5636-0bbf-4380-b845-2d5b55177160 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] [instance: de212c9c-e0e0-471f-8a01-5d180ac28d07] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:29.566689 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-5117d3e8-437d-4c88-9768-fad2baa1cbb4 req-19456307-a69d-454c-a2c4-f53790b9053c service nova] Creating event network-changed:9dbeafb3-f8f6-45eb-993c-c817b00700d0 for instance 8025dc46-71af-4fec-8f54-5ae9e92cc31f on n-h1-master-1 Oct 23 01:15:29.579987 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c3c5636-0bbf-4380-b845-2d5b55177160 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:29.580518 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c3c5636-0bbf-4380-b845-2d5b55177160 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:29.581178 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c3c5636-0bbf-4380-b845-2d5b55177160 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:29.581752 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c3c5636-0bbf-4380-b845-2d5b55177160 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:29.582260 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c3c5636-0bbf-4380-b845-2d5b55177160 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:29.582687 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c3c5636-0bbf-4380-b845-2d5b55177160 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:29.585352 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [req-5117d3e8-437d-4c88-9768-fad2baa1cbb4 req-19456307-a69d-454c-a2c4-f53790b9053c service nova] Instance 8025dc46-71af-4fec-8f54-5ae9e92cc31f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120944) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 23 01:15:29.615157 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-5117d3e8-437d-4c88-9768-fad2baa1cbb4 req-19456307-a69d-454c-a2c4-f53790b9053c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094762 Oct 23 01:15:29.615761 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 644/1380] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:15:29.623790 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:15:29.628817 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fab4a732-8a6c-4444-8b5b-1d727a935544 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:29.629645 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fab4a732-8a6c-4444-8b5b-1d727a935544 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:29.636904 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fab4a732-8a6c-4444-8b5b-1d727a935544 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:29.641187 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fab4a732-8a6c-4444-8b5b-1d727a935544 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:29.641187 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fab4a732-8a6c-4444-8b5b-1d727a935544 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:29.641187 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fab4a732-8a6c-4444-8b5b-1d727a935544 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:29.641187 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fab4a732-8a6c-4444-8b5b-1d727a935544 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:29.641674 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fab4a732-8a6c-4444-8b5b-1d727a935544 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:29.779216 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=5 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:15:29.950469 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1c3c5636-0bbf-4380-b845-2d5b55177160 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80703c3d1dae419c9fd5ca103f3c28bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356a4b3819db457fb5caf68ded0212fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:29.963465 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fab4a732-8a6c-4444-8b5b-1d727a935544 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:29.982361 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fab4a732-8a6c-4444-8b5b-1d727a935544 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 200 len: 1717 microversion: 2.1 time: 0.361512 Oct 23 01:15:29.983304 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1c3c5636-0bbf-4380-b845-2d5b55177160 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] 10.222.0.42 "GET /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07" status: 200 len: 1458 microversion: 2.1 time: 0.429656 Oct 23 01:15:29.986424 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 737/1381] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:29 2022] GET /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07 => generated 1458 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:29.987379 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 645/1382] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:29 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 1717 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:30.009526 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-07821e30-c1aa-4d25-9d33-378f2f1dc1db req-86eac131-146e-4c82-a708-d4b73cdfdbc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be9a2687-233d-43c3-95b3-3a8b455595c7", "tag": "a5573536-696d-47fb-b77e-270410ee0fca"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:15:30.011220 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6569111e-e3bd-4dff-bcb7-3b9600b52f39 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:30.017373 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6569111e-e3bd-4dff-bcb7-3b9600b52f39 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 291a0671-7bab-404a-b836-95fb7acfd1dd] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:30.035037 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6569111e-e3bd-4dff-bcb7-3b9600b52f39 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:30.035787 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6569111e-e3bd-4dff-bcb7-3b9600b52f39 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:30.036502 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6569111e-e3bd-4dff-bcb7-3b9600b52f39 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:30.037462 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6569111e-e3bd-4dff-bcb7-3b9600b52f39 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:30.039426 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6569111e-e3bd-4dff-bcb7-3b9600b52f39 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:30.040225 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6569111e-e3bd-4dff-bcb7-3b9600b52f39 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:30.044122 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-07821e30-c1aa-4d25-9d33-378f2f1dc1db req-86eac131-146e-4c82-a708-d4b73cdfdbc0 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:30.044781 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-07821e30-c1aa-4d25-9d33-378f2f1dc1db req-86eac131-146e-4c82-a708-d4b73cdfdbc0 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:30.047216 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-07821e30-c1aa-4d25-9d33-378f2f1dc1db req-86eac131-146e-4c82-a708-d4b73cdfdbc0 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:30.078796 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-07821e30-c1aa-4d25-9d33-378f2f1dc1db req-86eac131-146e-4c82-a708-d4b73cdfdbc0 service nova] Creating event network-changed:a5573536-696d-47fb-b77e-270410ee0fca for instance be9a2687-233d-43c3-95b3-3a8b455595c7 on n-h2-master-1 Oct 23 01:15:30.085827 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-07821e30-c1aa-4d25-9d33-378f2f1dc1db req-86eac131-146e-4c82-a708-d4b73cdfdbc0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097518 Oct 23 01:15:30.097551 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 738/1383] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:15:30.106074 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-17b0091f-e557-4be5-a176-924b637be0f7 tempest-LiveMigrationNegativeTest-1953311517 tempest-LiveMigrationNegativeTest-1953311517-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:30.107572 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-17b0091f-e557-4be5-a176-924b637be0f7 tempest-LiveMigrationNegativeTest-1953311517 tempest-LiveMigrationNegativeTest-1953311517-project-admin] [instance: de212c9c-e0e0-471f-8a01-5d180ac28d07] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:30.117251 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-17b0091f-e557-4be5-a176-924b637be0f7 tempest-LiveMigrationNegativeTest-1953311517 tempest-LiveMigrationNegativeTest-1953311517-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:30.118139 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-17b0091f-e557-4be5-a176-924b637be0f7 tempest-LiveMigrationNegativeTest-1953311517 tempest-LiveMigrationNegativeTest-1953311517-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:30.118801 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-17b0091f-e557-4be5-a176-924b637be0f7 tempest-LiveMigrationNegativeTest-1953311517 tempest-LiveMigrationNegativeTest-1953311517-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:30.119980 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-17b0091f-e557-4be5-a176-924b637be0f7 tempest-LiveMigrationNegativeTest-1953311517 tempest-LiveMigrationNegativeTest-1953311517-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:30.120691 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-17b0091f-e557-4be5-a176-924b637be0f7 tempest-LiveMigrationNegativeTest-1953311517 tempest-LiveMigrationNegativeTest-1953311517-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:30.121747 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-17b0091f-e557-4be5-a176-924b637be0f7 tempest-LiveMigrationNegativeTest-1953311517 tempest-LiveMigrationNegativeTest-1953311517-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:30.323894 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6569111e-e3bd-4dff-bcb7-3b9600b52f39 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:30.333192 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6569111e-e3bd-4dff-bcb7-3b9600b52f39 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd" status: 200 len: 1522 microversion: 2.1 time: 0.344733 Oct 23 01:15:30.364511 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 646/1384] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:29 2022] GET /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd => generated 1522 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:30.383177 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cef00e40-21b9-4b52-9f53-e4252c7c0830 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:30.386832 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-cef00e40-21b9-4b52-9f53-e4252c7c0830 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 8025dc46-71af-4fec-8f54-5ae9e92cc31f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:30.394600 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cef00e40-21b9-4b52-9f53-e4252c7c0830 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:30.395339 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cef00e40-21b9-4b52-9f53-e4252c7c0830 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:30.395983 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cef00e40-21b9-4b52-9f53-e4252c7c0830 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:30.396924 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cef00e40-21b9-4b52-9f53-e4252c7c0830 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:30.398195 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cef00e40-21b9-4b52-9f53-e4252c7c0830 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:30.398845 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cef00e40-21b9-4b52-9f53-e4252c7c0830 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:30.482220 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:15:30.552170 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cef00e40-21b9-4b52-9f53-e4252c7c0830 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:30.560126 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cef00e40-21b9-4b52-9f53-e4252c7c0830 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f" status: 200 len: 1474 microversion: 2.1 time: 0.194112 Oct 23 01:15:30.561126 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 647/1385] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:30 2022] GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f => generated 1474 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:30.566072 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-00014a1c-b882-45ce-9e4f-850f29b9e894 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:30.566768 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-00014a1c-b882-45ce-9e4f-850f29b9e894 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 808c58c6-1606-4553-8dd3-8292fa1202b5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:30.572730 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-00014a1c-b882-45ce-9e4f-850f29b9e894 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:30.573396 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-00014a1c-b882-45ce-9e4f-850f29b9e894 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:30.574095 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-00014a1c-b882-45ce-9e4f-850f29b9e894 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:30.574788 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-00014a1c-b882-45ce-9e4f-850f29b9e894 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:30.575335 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-00014a1c-b882-45ce-9e4f-850f29b9e894 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:30.575727 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-00014a1c-b882-45ce-9e4f-850f29b9e894 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:30.666555 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-17b0091f-e557-4be5-a176-924b637be0f7 tempest-LiveMigrationNegativeTest-1953311517 tempest-LiveMigrationNegativeTest-1953311517-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07" status: 200 len: 1609 microversion: 2.1 time: 0.567184 Oct 23 01:15:30.667366 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 739/1386] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:30 2022] GET /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07 => generated 1609 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:30.672775 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5356f5b5-1b67-413b-ab12-b1b4ad55e660 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-676492298", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:15:30.677238 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5356f5b5-1b67-413b-ab12-b1b4ad55e660 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Request method failure captured: Oct 23 01:15:30.677238 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd/action HTTP/1.1 Oct 23 01:15:30.677238 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:15:30.677238 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:15:30.677238 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:15:30.677238 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 618 Oct 23 01:15:30.677238 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:15:30.677238 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:15:30.677238 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:15:30.677238 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:15:30.677238 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJWaABlg9aZPPmiKYOFyjnW3cUDNfMTW-9Ow-Ga99e9rhT_Xz0fOPaBTxk-ZvoWH3eiZ84RoqOaVKmH_NPvl5JjsEC9A2dnRRYDDEs3eUATgMIXjceNensPNpeVu874ElZedsjKlwKXnfqakqBoob0ap94r3bfJNgcmUxWbrsNVh5-k Oct 23 01:15:30.677238 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:15:30.677238 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:15:30.677238 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:15:30.677238 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:15:30.677238 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:15:30.677238 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:15:30.677238 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 1aa3395c4af3435eaa3a0f49e19167fe Oct 23 01:15:30.677238 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-421844011 Oct 23 01:15:30.677238 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:15:30.677238 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:15:30.678960 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1aa3395c4af3435eaa3a0f49e19167fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1aa3395c4af3435eaa3a0f49e19167fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1aa3395c4af3435eaa3a0f49e19167fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1aa3395c4af3435eaa3a0f49e19167fe"}]}] Oct 23 01:15:30.678960 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-421844011 Oct 23 01:15:30.678960 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 1aa3395c4af3435eaa3a0f49e19167fe Oct 23 01:15:30.678960 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-421844011 Oct 23 01:15:30.678960 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ImagesOneServerNegativeTestJSON-421844011-project Oct 23 01:15:30.678960 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:15:30.678960 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:15:30.678960 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 690143905857471f949b1f4454ad2139 Oct 23 01:15:30.678960 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-421844011-project Oct 23 01:15:30.678960 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:15:30.679698 n-d-master-1 devstack@n-api.service[120945]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-676492298", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 23 01:15:30.679698 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:15:30.679698 n-d-master-1 devstack@n-api.service[120945]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 23 01:15:30.679929 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '291a0671-7bab-404a-b836-95fb7acfd1dd', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-676492298', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 23 01:15:30.679929 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:15:30.679929 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:15:30.679929 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 23 01:15:30.679929 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 23 01:15:30.679929 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 01:15:30.679929 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise error Oct 23 01:15:30.679929 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 23 01:15:30.679929 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:15:30.679929 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 23 01:15:30.679929 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 23 01:15:30.680628 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 23 01:15:30.680628 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 23 01:15:30.680628 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 23 01:15:30.680628 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:15:30.680628 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 23 01:15:30.680628 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 23 01:15:30.680628 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:15:30.680628 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:15:30.680628 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:15:30.680628 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:15:30.680628 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:15:30.680628 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:15:30.680628 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:15:30.680628 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:15:30.680628 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:15:30.680628 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:15:30.680628 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:15:30.681660 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:15:30.681660 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 23 01:15:30.681660 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 23 01:15:30.681660 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 23 01:15:30.681660 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 23 01:15:30.681660 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 23 01:15:30.681660 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 23 01:15:30.681660 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 23 01:15:30.681660 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:15:30.681660 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:15:30.681660 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:15:30.681660 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:15:30.683321 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:15:30.683321 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:15:30.683321 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 23 01:15:30.683321 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 23 01:15:30.683321 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 23 01:15:30.683321 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:15:30.684793 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5356f5b5-1b67-413b-ab12-b1b4ad55e660 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:15:30.686077 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5356f5b5-1b67-413b-ab12-b1b4ad55e660 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "POST /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd/action" status: 400 len: 938 microversion: 2.1 time: 0.017481 Oct 23 01:15:30.686922 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 740/1387] 10.222.0.42 () {60 vars in 1279 bytes} [Sun Oct 23 01:15:30 2022] POST /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd/action => generated 938 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:15:30.692357 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-14417d8c-371e-497a-b78d-a6e16740ef09 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:30.692976 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-14417d8c-371e-497a-b78d-a6e16740ef09 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:30.701123 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-14417d8c-371e-497a-b78d-a6e16740ef09 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:30.701619 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-14417d8c-371e-497a-b78d-a6e16740ef09 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:30.702101 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-14417d8c-371e-497a-b78d-a6e16740ef09 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:30.703019 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-14417d8c-371e-497a-b78d-a6e16740ef09 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:30.703644 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-14417d8c-371e-497a-b78d-a6e16740ef09 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:30.704236 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-14417d8c-371e-497a-b78d-a6e16740ef09 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:30.813340 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-00014a1c-b882-45ce-9e4f-850f29b9e894 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:30.822509 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-00014a1c-b882-45ce-9e4f-850f29b9e894 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/808c58c6-1606-4553-8dd3-8292fa1202b5" status: 200 len: 1468 microversion: 2.1 time: 0.260005 Oct 23 01:15:30.823168 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 648/1388] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:30 2022] GET /compute/v2.1/servers/808c58c6-1606-4553-8dd3-8292fa1202b5 => generated 1468 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:30.828010 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-11da7ed5-7046-4eee-bfd7-917319c83c64 tempest-LiveMigrationNegativeTest-1953311517 tempest-LiveMigrationNegativeTest-1953311517-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:30.831687 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-11da7ed5-7046-4eee-bfd7-917319c83c64 tempest-LiveMigrationNegativeTest-1953311517 tempest-LiveMigrationNegativeTest-1953311517-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:30.832176 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-11da7ed5-7046-4eee-bfd7-917319c83c64 tempest-LiveMigrationNegativeTest-1953311517 tempest-LiveMigrationNegativeTest-1953311517-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:30.832838 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-11da7ed5-7046-4eee-bfd7-917319c83c64 tempest-LiveMigrationNegativeTest-1953311517 tempest-LiveMigrationNegativeTest-1953311517-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:30.833577 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-11da7ed5-7046-4eee-bfd7-917319c83c64 tempest-LiveMigrationNegativeTest-1953311517 tempest-LiveMigrationNegativeTest-1953311517-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:30.834117 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-11da7ed5-7046-4eee-bfd7-917319c83c64 tempest-LiveMigrationNegativeTest-1953311517 tempest-LiveMigrationNegativeTest-1953311517-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:30.835331 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-11da7ed5-7046-4eee-bfd7-917319c83c64 tempest-LiveMigrationNegativeTest-1953311517 tempest-LiveMigrationNegativeTest-1953311517-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:30.861545 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-11da7ed5-7046-4eee-bfd7-917319c83c64 tempest-LiveMigrationNegativeTest-1953311517 tempest-LiveMigrationNegativeTest-1953311517-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.036777 Oct 23 01:15:30.862568 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 649/1389] 10.222.0.42 () {58 vars in 1176 bytes} [Sun Oct 23 01:15:30 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:15:30.867407 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8baa5d62-525a-4d76-a841-73200b8bd1de tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:30.868198 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8baa5d62-525a-4d76-a841-73200b8bd1de tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 291a0671-7bab-404a-b836-95fb7acfd1dd] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:30.876693 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8baa5d62-525a-4d76-a841-73200b8bd1de tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:30.876693 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8baa5d62-525a-4d76-a841-73200b8bd1de tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:30.876693 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8baa5d62-525a-4d76-a841-73200b8bd1de tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:30.877025 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8baa5d62-525a-4d76-a841-73200b8bd1de tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:30.877219 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8baa5d62-525a-4d76-a841-73200b8bd1de tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:30.878085 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8baa5d62-525a-4d76-a841-73200b8bd1de tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:30.880743 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-14417d8c-371e-497a-b78d-a6e16740ef09 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:30.891310 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-14417d8c-371e-497a-b78d-a6e16740ef09 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:30.893194 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-14417d8c-371e-497a-b78d-a6e16740ef09 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:30.894423 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-14417d8c-371e-497a-b78d-a6e16740ef09 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7" status: 200 len: 1412 microversion: 2.25 time: 0.206174 Oct 23 01:15:30.895319 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 741/1390] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:15:30 2022] GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7 => generated 1412 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:15:30.900929 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d3e43e34-fe21-4790-9976-17938a96a264 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:30.901417 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d3e43e34-fe21-4790-9976-17938a96a264 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: f3aa4181-fc02-43dc-95df-ae1a730fbdca] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:30.910412 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d3e43e34-fe21-4790-9976-17938a96a264 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:30.910965 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d3e43e34-fe21-4790-9976-17938a96a264 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:30.911378 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d3e43e34-fe21-4790-9976-17938a96a264 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:30.912249 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d3e43e34-fe21-4790-9976-17938a96a264 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:30.912730 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d3e43e34-fe21-4790-9976-17938a96a264 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:30.913425 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d3e43e34-fe21-4790-9976-17938a96a264 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:31.194874 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8baa5d62-525a-4d76-a841-73200b8bd1de tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:31.201349 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d3e43e34-fe21-4790-9976-17938a96a264 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:31.209791 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8baa5d62-525a-4d76-a841-73200b8bd1de tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd" status: 200 len: 1522 microversion: 2.1 time: 0.345846 Oct 23 01:15:31.210756 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 650/1391] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:30 2022] GET /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd => generated 1522 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:31.212178 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d3e43e34-fe21-4790-9976-17938a96a264 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/f3aa4181-fc02-43dc-95df-ae1a730fbdca" status: 200 len: 1468 microversion: 2.1 time: 0.315809 Oct 23 01:15:31.212752 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 742/1392] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:30 2022] GET /compute/v2.1/servers/f3aa4181-fc02-43dc-95df-ae1a730fbdca => generated 1468 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:31.226235 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d434e174-3720-4596-b9fb-e18b8fd6ee8b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:31.226849 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d434e174-3720-4596-b9fb-e18b8fd6ee8b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:31.228007 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-55354e72-1b0e-4157-a5e9-0e17e97cfffe tempest-LiveMigrationNegativeTest-1953311517 tempest-LiveMigrationNegativeTest-1953311517-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:15:31.233441 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-55354e72-1b0e-4157-a5e9-0e17e97cfffe tempest-LiveMigrationNegativeTest-1953311517 tempest-LiveMigrationNegativeTest-1953311517-project-admin] [instance: de212c9c-e0e0-471f-8a01-5d180ac28d07] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:31.238559 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d434e174-3720-4596-b9fb-e18b8fd6ee8b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:31.239451 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d434e174-3720-4596-b9fb-e18b8fd6ee8b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:31.240077 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d434e174-3720-4596-b9fb-e18b8fd6ee8b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:31.242184 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d434e174-3720-4596-b9fb-e18b8fd6ee8b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:31.242881 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d434e174-3720-4596-b9fb-e18b8fd6ee8b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:31.243506 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d434e174-3720-4596-b9fb-e18b8fd6ee8b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:31.243847 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55354e72-1b0e-4157-a5e9-0e17e97cfffe tempest-LiveMigrationNegativeTest-1953311517 tempest-LiveMigrationNegativeTest-1953311517-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:31.244453 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55354e72-1b0e-4157-a5e9-0e17e97cfffe tempest-LiveMigrationNegativeTest-1953311517 tempest-LiveMigrationNegativeTest-1953311517-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:31.245108 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55354e72-1b0e-4157-a5e9-0e17e97cfffe tempest-LiveMigrationNegativeTest-1953311517 tempest-LiveMigrationNegativeTest-1953311517-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:31.246576 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55354e72-1b0e-4157-a5e9-0e17e97cfffe tempest-LiveMigrationNegativeTest-1953311517 tempest-LiveMigrationNegativeTest-1953311517-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:31.247389 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55354e72-1b0e-4157-a5e9-0e17e97cfffe tempest-LiveMigrationNegativeTest-1953311517 tempest-LiveMigrationNegativeTest-1953311517-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:31.247840 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55354e72-1b0e-4157-a5e9-0e17e97cfffe tempest-LiveMigrationNegativeTest-1953311517 tempest-LiveMigrationNegativeTest-1953311517-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:31.267643 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=6 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:15:31.287450 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-55354e72-1b0e-4157-a5e9-0e17e97cfffe tempest-LiveMigrationNegativeTest-1953311517 tempest-LiveMigrationNegativeTest-1953311517-project-admin] Lazy-loading 'flavor' on Instance uuid de212c9c-e0e0-471f-8a01-5d180ac28d07 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:15:31.301003 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-55354e72-1b0e-4157-a5e9-0e17e97cfffe tempest-LiveMigrationNegativeTest-1953311517 tempest-LiveMigrationNegativeTest-1953311517-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance de212c9c-e0e0-471f-8a01-5d180ac28d07 while it is in vm_state suspended Oct 23 01:15:31.303961 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-55354e72-1b0e-4157-a5e9-0e17e97cfffe tempest-LiveMigrationNegativeTest-1953311517 tempest-LiveMigrationNegativeTest-1953311517-project-admin] Request method failure captured: Oct 23 01:15:31.303961 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07/action HTTP/1.1 Oct 23 01:15:31.303961 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:15:31.303961 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:15:31.303961 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:15:31.303961 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 97 Oct 23 01:15:31.303961 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:15:31.303961 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:15:31.303961 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:15:31.303961 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:15:31.303961 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJVse-ECvFga4Of5Cs9dI20Z50A_aDh9LZEsnhuF1CZrGHVtWXjPtkpTfqgP7EW3UumE4IlOJlIZEYTuUJ5lUed7SCPFNoNMkczmnfykL5FobYEyrIu0hZmqW4EW4NyHvNveP23Kc1sqrqLXrGYCWwF5ISv1Je1knwM1yT9NGF4UugQ Oct 23 01:15:31.303961 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:15:31.303961 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:15:31.303961 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:15:31.303961 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:15:31.303961 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:15:31.303961 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:15:31.303961 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: d2d01301d47b40c8bb2ab24042d092b1 Oct 23 01:15:31.303961 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-LiveMigrationNegativeTest-1953311517 Oct 23 01:15:31.303961 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,admin,reader Oct 23 01:15:31.303961 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,admin,reader Oct 23 01:15:31.305611 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d2d01301d47b40c8bb2ab24042d092b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d2d01301d47b40c8bb2ab24042d092b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d2d01301d47b40c8bb2ab24042d092b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d2d01301d47b40c8bb2ab24042d092b1"}]}] Oct 23 01:15:31.305611 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-LiveMigrationNegativeTest-1953311517 Oct 23 01:15:31.305611 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: d2d01301d47b40c8bb2ab24042d092b1 Oct 23 01:15:31.305611 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1953311517 Oct 23 01:15:31.305611 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-LiveMigrationNegativeTest-1953311517-project-admin Oct 23 01:15:31.305611 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:15:31.305611 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:15:31.305611 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 1fd857a3b4cf4c97948ba349f8920fc6 Oct 23 01:15:31.305611 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-LiveMigrationNegativeTest-1953311517-project-admin Oct 23 01:15:31.305611 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:15:31.305611 n-d-master-1 devstack@n-api.service[120944]: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": true, "disk_over_commit": false}} Oct 23 01:15:31.305611 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:15:31.306786 n-d-master-1 devstack@n-api.service[120944]: exception: Cannot 'os-migrateLive' instance de212c9c-e0e0-471f-8a01-5d180ac28d07 while it is in vm_state suspended Oct 23 01:15:31.306786 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'de212c9c-e0e0-471f-8a01-5d180ac28d07', 'body': {'os-migrateLive': {'host': 'n-h2-master-1', 'block_migration': True, 'disk_over_commit': False}}} Oct 23 01:15:31.306786 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:15:31.306786 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:15:31.306786 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 23 01:15:31.306786 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 23 01:15:31.306786 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 23 01:15:31.306786 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 23 01:15:31.306786 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 23 01:15:31.306786 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 23 01:15:31.306786 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 23 01:15:31.306786 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 23 01:15:31.306786 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 23 01:15:31.306786 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 23 01:15:31.306786 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 23 01:15:31.306786 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 23 01:15:31.306786 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 23 01:15:31.306786 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 23 01:15:31.308224 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 23 01:15:31.308224 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 23 01:15:31.308224 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 23 01:15:31.308224 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 23 01:15:31.308224 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance de212c9c-e0e0-471f-8a01-5d180ac28d07 in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 23 01:15:31.308224 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:15:31.308224 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:15:31.308224 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:15:31.308224 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:15:31.308224 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:15:31.308224 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:15:31.308224 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:15:31.308224 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:15:31.308224 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:15:31.308224 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:15:31.308224 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:15:31.308224 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:15:31.308224 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:15:31.308224 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:15:31.308224 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:15:31.309713 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:15:31.309713 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 23 01:15:31.309713 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 23 01:15:31.309713 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 23 01:15:31.309713 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 23 01:15:31.309713 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 23 01:15:31.309713 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance de212c9c-e0e0-471f-8a01-5d180ac28d07 while it is in vm_state suspended Oct 23 01:15:31.309713 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:15:31.309713 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:15:31.309713 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:15:31.309713 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:15:31.309713 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:15:31.309713 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:15:31.309713 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:15:31.309713 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:15:31.309713 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance de212c9c-e0e0-471f-8a01-5d180ac28d07 while it is in vm_state suspended Oct 23 01:15:31.309713 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:15:31.311026 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-55354e72-1b0e-4157-a5e9-0e17e97cfffe tempest-LiveMigrationNegativeTest-1953311517 tempest-LiveMigrationNegativeTest-1953311517-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance de212c9c-e0e0-471f-8a01-5d180ac28d07 while it is in vm_state suspended {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:15:31.311983 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-55354e72-1b0e-4157-a5e9-0e17e97cfffe tempest-LiveMigrationNegativeTest-1953311517 tempest-LiveMigrationNegativeTest-1953311517-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07/action" status: 409 len: 155 microversion: 2.1 time: 0.097856 Oct 23 01:15:31.314122 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 651/1393] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:15:31 2022] POST /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07/action => generated 155 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:15:31.324858 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a005ef98-0f34-4076-8b86-873c8dd38b25 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:31.330079 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a005ef98-0f34-4076-8b86-873c8dd38b25 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:31.331072 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a005ef98-0f34-4076-8b86-873c8dd38b25 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Searching by: {'reservation_id': 'r-2r0mznm1', 'deleted': False, 'project_id': '47aadec780734d03a262d4021f48d625'} {{(pid=120944) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 23 01:15:31.336419 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a005ef98-0f34-4076-8b86-873c8dd38b25 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:31.336905 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a005ef98-0f34-4076-8b86-873c8dd38b25 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:31.337385 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a005ef98-0f34-4076-8b86-873c8dd38b25 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:31.338134 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a005ef98-0f34-4076-8b86-873c8dd38b25 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:31.338592 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a005ef98-0f34-4076-8b86-873c8dd38b25 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:31.339017 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a005ef98-0f34-4076-8b86-873c8dd38b25 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:31.406138 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d434e174-3720-4596-b9fb-e18b8fd6ee8b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:31.416959 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d434e174-3720-4596-b9fb-e18b8fd6ee8b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 200 len: 1717 microversion: 2.1 time: 0.203207 Oct 23 01:15:31.417782 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 743/1394] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:31 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 1717 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:31.422563 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1b628005-6f29-4514-a0af-ad550de87984 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:31.423208 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1b628005-6f29-4514-a0af-ad550de87984 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 291a0671-7bab-404a-b836-95fb7acfd1dd] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:31.429912 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b628005-6f29-4514-a0af-ad550de87984 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:31.434113 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b628005-6f29-4514-a0af-ad550de87984 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:31.434113 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b628005-6f29-4514-a0af-ad550de87984 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:31.434113 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b628005-6f29-4514-a0af-ad550de87984 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:31.434113 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b628005-6f29-4514-a0af-ad550de87984 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:31.434534 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b628005-6f29-4514-a0af-ad550de87984 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:31.500887 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.multi_cell_list [None req-a005ef98-0f34-4076-8b86-873c8dd38b25 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120944) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 23 01:15:31.575298 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a005ef98-0f34-4076-8b86-873c8dd38b25 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:31.582669 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a005ef98-0f34-4076-8b86-873c8dd38b25 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:31.583178 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a005ef98-0f34-4076-8b86-873c8dd38b25 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:31.583625 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a005ef98-0f34-4076-8b86-873c8dd38b25 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:31.623241 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1b628005-6f29-4514-a0af-ad550de87984 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:31.640402 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1b628005-6f29-4514-a0af-ad550de87984 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd" status: 200 len: 1522 microversion: 2.1 time: 0.219002 Oct 23 01:15:31.640402 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 744/1395] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:31 2022] GET /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:31.643187 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e6b65c99-79f4-41ef-8d46-c8918ffbfe67 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:31.644013 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e6b65c99-79f4-41ef-8d46-c8918ffbfe67 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] [instance: de212c9c-e0e0-471f-8a01-5d180ac28d07] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:31.651089 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6b65c99-79f4-41ef-8d46-c8918ffbfe67 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:31.651823 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6b65c99-79f4-41ef-8d46-c8918ffbfe67 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:31.652425 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6b65c99-79f4-41ef-8d46-c8918ffbfe67 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:31.653270 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6b65c99-79f4-41ef-8d46-c8918ffbfe67 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:31.654049 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6b65c99-79f4-41ef-8d46-c8918ffbfe67 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:31.654625 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6b65c99-79f4-41ef-8d46-c8918ffbfe67 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:31.682529 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e6b65c99-79f4-41ef-8d46-c8918ffbfe67 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] [instance: de212c9c-e0e0-471f-8a01-5d180ac28d07] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:15:31.735206 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a005ef98-0f34-4076-8b86-873c8dd38b25 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/detail?reservation_id=r-2r0mznm1" status: 200 len: 2929 microversion: 2.1 time: 0.415903 Oct 23 01:15:31.735826 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 652/1396] 10.222.0.42 () {58 vars in 1197 bytes} [Sun Oct 23 01:15:31 2022] GET /compute/v2.1/servers/detail?reservation_id=r-2r0mznm1 => generated 2929 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:31.740681 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-767f3fd0-8c58-40cc-a342-1ebc6ae707fa tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:31.741333 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-767f3fd0-8c58-40cc-a342-1ebc6ae707fa tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 8025dc46-71af-4fec-8f54-5ae9e92cc31f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:31.757003 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-767f3fd0-8c58-40cc-a342-1ebc6ae707fa tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:31.757830 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-767f3fd0-8c58-40cc-a342-1ebc6ae707fa tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:31.758295 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-767f3fd0-8c58-40cc-a342-1ebc6ae707fa tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:31.759003 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-767f3fd0-8c58-40cc-a342-1ebc6ae707fa tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:31.760003 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-767f3fd0-8c58-40cc-a342-1ebc6ae707fa tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:31.766129 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-767f3fd0-8c58-40cc-a342-1ebc6ae707fa tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:31.911064 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-767f3fd0-8c58-40cc-a342-1ebc6ae707fa tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:31.918978 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-767f3fd0-8c58-40cc-a342-1ebc6ae707fa tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f" status: 200 len: 1472 microversion: 2.1 time: 0.182169 Oct 23 01:15:31.919558 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 653/1397] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:31 2022] GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f => generated 1472 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:31.924693 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-52d854e4-5328-4727-896f-ad3e9c776462 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:15:31.929472 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-52d854e4-5328-4727-896f-ad3e9c776462 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Request method failure captured: Oct 23 01:15:31.929472 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd/action HTTP/1.1 Oct 23 01:15:31.929472 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:15:31.929472 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:15:31.929472 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:15:31.929472 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 285 Oct 23 01:15:31.929472 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:15:31.929472 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:15:31.929472 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:15:31.929472 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:15:31.929472 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJWaABlg9aZPPmiKYOFyjnW3cUDNfMTW-9Ow-Ga99e9rhT_Xz0fOPaBTxk-ZvoWH3eiZ84RoqOaVKmH_NPvl5JjsEC9A2dnRRYDDEs3eUATgMIXjceNensPNpeVu874ElZedsjKlwKXnfqakqBoob0ap94r3bfJNgcmUxWbrsNVh5-k Oct 23 01:15:31.929472 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:15:31.929472 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:15:31.929472 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:15:31.929472 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:15:31.929472 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:15:31.929472 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:15:31.929472 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 1aa3395c4af3435eaa3a0f49e19167fe Oct 23 01:15:31.929472 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-421844011 Oct 23 01:15:31.929472 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:15:31.929472 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:15:31.931116 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1aa3395c4af3435eaa3a0f49e19167fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1aa3395c4af3435eaa3a0f49e19167fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1aa3395c4af3435eaa3a0f49e19167fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1aa3395c4af3435eaa3a0f49e19167fe"}]}] Oct 23 01:15:31.931116 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-421844011 Oct 23 01:15:31.931116 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 1aa3395c4af3435eaa3a0f49e19167fe Oct 23 01:15:31.931116 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-421844011 Oct 23 01:15:31.931116 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ImagesOneServerNegativeTestJSON-421844011-project Oct 23 01:15:31.931116 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:15:31.931116 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:15:31.931116 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 690143905857471f949b1f4454ad2139 Oct 23 01:15:31.931116 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-421844011-project Oct 23 01:15:31.931116 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:15:31.931116 n-d-master-1 devstack@n-api.service[120944]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 23 01:15:31.931971 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:15:31.931971 n-d-master-1 devstack@n-api.service[120944]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 23 01:15:31.931971 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '291a0671-7bab-404a-b836-95fb7acfd1dd', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 23 01:15:31.931971 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:15:31.931971 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:15:31.931971 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 23 01:15:31.931971 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 23 01:15:31.931971 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 01:15:31.931971 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise error Oct 23 01:15:31.931971 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 23 01:15:31.932763 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:15:31.932763 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 23 01:15:31.932763 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 23 01:15:31.932763 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:15:31.932763 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 23 01:15:31.932763 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 23 01:15:31.932763 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:15:31.932763 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:15:31.932763 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:15:31.932763 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:15:31.932763 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:15:31.932763 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:15:31.932763 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:15:31.932763 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:15:31.932763 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:15:31.932763 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:15:31.932763 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:15:31.932763 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:15:31.932763 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 23 01:15:31.932763 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 23 01:15:31.934610 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 23 01:15:31.934610 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 23 01:15:31.934610 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 23 01:15:31.934610 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 23 01:15:31.934610 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 23 01:15:31.934610 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:15:31.934610 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:15:31.934610 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:15:31.934610 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:15:31.934610 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:15:31.934610 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:15:31.934610 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 23 01:15:31.934610 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 23 01:15:31.935654 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 23 01:15:31.935654 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:15:31.935654 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-52d854e4-5328-4727-896f-ad3e9c776462 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:15:31.935654 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-52d854e4-5328-4727-896f-ad3e9c776462 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "POST /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd/action" status: 400 len: 619 microversion: 2.1 time: 0.010375 Oct 23 01:15:31.936025 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 654/1398] 10.222.0.42 () {60 vars in 1279 bytes} [Sun Oct 23 01:15:31 2022] POST /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd/action => generated 619 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:15:31.939164 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-578fae38-806a-4c50-a632-ff7ee14c87f8 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:31.975949 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.compute.server_groups [None req-578fae38-806a-4c50-a632-ff7ee14c87f8 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Querying cell 8efa99f7-1ff1-40c2-a97e-acbc153fb79d(cell1) for 2 instances {{(pid=120944) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 23 01:15:31.976673 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-578fae38-806a-4c50-a632-ff7ee14c87f8 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:31.977152 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-578fae38-806a-4c50-a632-ff7ee14c87f8 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:31.977888 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-578fae38-806a-4c50-a632-ff7ee14c87f8 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:32.026638 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-578fae38-806a-4c50-a632-ff7ee14c87f8 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/os-server-groups/8a917657-28a7-4dca-bda1-2dfd9f81a9de" status: 200 len: 265 microversion: 2.1 time: 0.089931 Oct 23 01:15:32.028008 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 655/1399] 10.222.0.42 () {58 vars in 1263 bytes} [Sun Oct 23 01:15:31 2022] GET /compute/v2.1/os-server-groups/8a917657-28a7-4dca-bda1-2dfd9f81a9de => generated 265 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:15:32.051681 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-41d98555-c441-42c4-85e3-d3fe76055c10 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:32.053087 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-41d98555-c441-42c4-85e3-d3fe76055c10 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:32.060096 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e6b65c99-79f4-41ef-8d46-c8918ffbfe67 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] 10.222.0.42 "DELETE /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07" status: 204 len: 0 microversion: 2.1 time: 0.420562 Oct 23 01:15:32.060802 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 745/1400] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:15:31 2022] DELETE /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:15:32.067003 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5c33fdbe-578d-41b3-9b2f-9a09a5ac6a52 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:32.067711 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5c33fdbe-578d-41b3-9b2f-9a09a5ac6a52 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 291a0671-7bab-404a-b836-95fb7acfd1dd] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:32.070464 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41d98555-c441-42c4-85e3-d3fe76055c10 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:32.071098 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41d98555-c441-42c4-85e3-d3fe76055c10 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:32.071606 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41d98555-c441-42c4-85e3-d3fe76055c10 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:32.072675 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41d98555-c441-42c4-85e3-d3fe76055c10 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:32.074937 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41d98555-c441-42c4-85e3-d3fe76055c10 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:32.075764 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41d98555-c441-42c4-85e3-d3fe76055c10 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:32.085570 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5c33fdbe-578d-41b3-9b2f-9a09a5ac6a52 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:32.090765 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5c33fdbe-578d-41b3-9b2f-9a09a5ac6a52 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:32.093436 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5c33fdbe-578d-41b3-9b2f-9a09a5ac6a52 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:32.094411 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5c33fdbe-578d-41b3-9b2f-9a09a5ac6a52 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:32.096788 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5c33fdbe-578d-41b3-9b2f-9a09a5ac6a52 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:32.104915 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5c33fdbe-578d-41b3-9b2f-9a09a5ac6a52 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:32.703880 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-41d98555-c441-42c4-85e3-d3fe76055c10 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:32.715464 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-41d98555-c441-42c4-85e3-d3fe76055c10 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:32.718348 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-41d98555-c441-42c4-85e3-d3fe76055c10 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:32.719306 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-41d98555-c441-42c4-85e3-d3fe76055c10 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7" status: 200 len: 1412 microversion: 2.25 time: 0.689648 Oct 23 01:15:32.720174 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 656/1401] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:15:32 2022] GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7 => generated 1412 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:15:32.727907 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-730d3205-d0d3-4433-ab41-0a5a19ad4554 tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:32.730022 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-730d3205-d0d3-4433-ab41-0a5a19ad4554 tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] [instance: 808c58c6-1606-4553-8dd3-8292fa1202b5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:32.738202 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-730d3205-d0d3-4433-ab41-0a5a19ad4554 tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:32.740625 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-730d3205-d0d3-4433-ab41-0a5a19ad4554 tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:32.741855 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-730d3205-d0d3-4433-ab41-0a5a19ad4554 tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:32.745162 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-730d3205-d0d3-4433-ab41-0a5a19ad4554 tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:32.746024 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-730d3205-d0d3-4433-ab41-0a5a19ad4554 tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:32.746810 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-730d3205-d0d3-4433-ab41-0a5a19ad4554 tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:32.762165 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5c33fdbe-578d-41b3-9b2f-9a09a5ac6a52 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:32.770987 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5c33fdbe-578d-41b3-9b2f-9a09a5ac6a52 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd" status: 200 len: 1522 microversion: 2.1 time: 0.708912 Oct 23 01:15:32.771581 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 746/1402] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:32 2022] GET /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd => generated 1522 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:32.800646 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2251137f-3e42-4ae4-9e50-0d342dcd73bc tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:32.801270 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2251137f-3e42-4ae4-9e50-0d342dcd73bc tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] [instance: de212c9c-e0e0-471f-8a01-5d180ac28d07] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:32.812980 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2251137f-3e42-4ae4-9e50-0d342dcd73bc tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:32.815842 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2251137f-3e42-4ae4-9e50-0d342dcd73bc tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:32.816522 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2251137f-3e42-4ae4-9e50-0d342dcd73bc tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:32.819090 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2251137f-3e42-4ae4-9e50-0d342dcd73bc tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:32.820718 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2251137f-3e42-4ae4-9e50-0d342dcd73bc tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:32.821486 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2251137f-3e42-4ae4-9e50-0d342dcd73bc tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:33.138626 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=100 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:15:33.145851 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-730d3205-d0d3-4433-ab41-0a5a19ad4554 tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/808c58c6-1606-4553-8dd3-8292fa1202b5" status: 200 len: 1619 microversion: 2.1 time: 0.422846 Oct 23 01:15:33.146254 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2251137f-3e42-4ae4-9e50-0d342dcd73bc tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80703c3d1dae419c9fd5ca103f3c28bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356a4b3819db457fb5caf68ded0212fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:33.149238 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 657/1403] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:32 2022] GET /compute/v2.1/servers/808c58c6-1606-4553-8dd3-8292fa1202b5 => generated 1619 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:33.158311 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c6f66c45-bc92-4d1d-811e-9b887dd0b0fd tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:33.164644 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c6f66c45-bc92-4d1d-811e-9b887dd0b0fd tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:33.170226 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2251137f-3e42-4ae4-9e50-0d342dcd73bc tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] 10.222.0.42 "GET /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07" status: 200 len: 1464 microversion: 2.1 time: 0.379056 Oct 23 01:15:33.174772 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 747/1404] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:32 2022] GET /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07 => generated 1464 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:33.175827 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c6f66c45-bc92-4d1d-811e-9b887dd0b0fd tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:33.177723 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c6f66c45-bc92-4d1d-811e-9b887dd0b0fd tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:33.179953 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c6f66c45-bc92-4d1d-811e-9b887dd0b0fd tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:33.180909 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c6f66c45-bc92-4d1d-811e-9b887dd0b0fd tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:33.182770 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c6f66c45-bc92-4d1d-811e-9b887dd0b0fd tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:33.183414 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c6f66c45-bc92-4d1d-811e-9b887dd0b0fd tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:33.187574 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-92488749-9e3a-46ba-89bf-665547cd94af tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:33.188516 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-92488749-9e3a-46ba-89bf-665547cd94af tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 291a0671-7bab-404a-b836-95fb7acfd1dd] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:33.196111 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-92488749-9e3a-46ba-89bf-665547cd94af tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:33.196111 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-92488749-9e3a-46ba-89bf-665547cd94af tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:33.196628 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-92488749-9e3a-46ba-89bf-665547cd94af tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:33.197448 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-92488749-9e3a-46ba-89bf-665547cd94af tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:33.197967 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-92488749-9e3a-46ba-89bf-665547cd94af tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:33.198887 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-92488749-9e3a-46ba-89bf-665547cd94af tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:33.958681 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c6f66c45-bc92-4d1d-811e-9b887dd0b0fd tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:33.968825 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c6f66c45-bc92-4d1d-811e-9b887dd0b0fd tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 200 len: 1717 microversion: 2.1 time: 0.818039 Oct 23 01:15:33.977005 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-92488749-9e3a-46ba-89bf-665547cd94af tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:33.984112 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:15:33.990148 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 658/1405] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:33 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 1717 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:33.992563 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-92488749-9e3a-46ba-89bf-665547cd94af tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd" status: 200 len: 1522 microversion: 2.1 time: 0.816458 Oct 23 01:15:33.998153 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e3df18e1-51e2-4a82-abf7-eecb9b21d7ae tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:34.000340 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e3df18e1-51e2-4a82-abf7-eecb9b21d7ae tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 8025dc46-71af-4fec-8f54-5ae9e92cc31f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:34.009796 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 748/1406] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:33 2022] GET /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd => generated 1522 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:34.015237 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2e91c3e5-aa19-43b0-8d59-2729f46b860b tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:34.016069 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e3df18e1-51e2-4a82-abf7-eecb9b21d7ae tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:34.016231 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2e91c3e5-aa19-43b0-8d59-2729f46b860b tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] [instance: f3aa4181-fc02-43dc-95df-ae1a730fbdca] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:34.016620 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e3df18e1-51e2-4a82-abf7-eecb9b21d7ae tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:34.018688 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e3df18e1-51e2-4a82-abf7-eecb9b21d7ae tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:34.022676 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e3df18e1-51e2-4a82-abf7-eecb9b21d7ae tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:34.023146 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e3df18e1-51e2-4a82-abf7-eecb9b21d7ae tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:34.023452 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e3df18e1-51e2-4a82-abf7-eecb9b21d7ae tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:34.024684 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2e91c3e5-aa19-43b0-8d59-2729f46b860b tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:34.025352 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2e91c3e5-aa19-43b0-8d59-2729f46b860b tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:34.025954 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2e91c3e5-aa19-43b0-8d59-2729f46b860b tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:34.026862 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2e91c3e5-aa19-43b0-8d59-2729f46b860b tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:34.027550 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2e91c3e5-aa19-43b0-8d59-2729f46b860b tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:34.028149 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2e91c3e5-aa19-43b0-8d59-2729f46b860b tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:34.437009 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2e91c3e5-aa19-43b0-8d59-2729f46b860b tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/f3aa4181-fc02-43dc-95df-ae1a730fbdca" status: 200 len: 1619 microversion: 2.1 time: 0.425732 Oct 23 01:15:34.439311 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e3df18e1-51e2-4a82-abf7-eecb9b21d7ae tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:34.447560 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e3df18e1-51e2-4a82-abf7-eecb9b21d7ae tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f" status: 200 len: 1472 microversion: 2.1 time: 0.455508 Oct 23 01:15:34.448132 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 659/1407] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:33 2022] GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f => generated 1472 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:34.455946 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 749/1408] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:34 2022] GET /compute/v2.1/servers/f3aa4181-fc02-43dc-95df-ae1a730fbdca => generated 1619 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:34.460221 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1d01d7d2-deb7-4fd2-bae5-55b3dfb89f35 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:34.461030 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1d01d7d2-deb7-4fd2-bae5-55b3dfb89f35 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:34.471315 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1d01d7d2-deb7-4fd2-bae5-55b3dfb89f35 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:34.472030 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1d01d7d2-deb7-4fd2-bae5-55b3dfb89f35 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:34.472664 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1d01d7d2-deb7-4fd2-bae5-55b3dfb89f35 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:34.473542 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1d01d7d2-deb7-4fd2-bae5-55b3dfb89f35 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:34.477650 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1d01d7d2-deb7-4fd2-bae5-55b3dfb89f35 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:34.478345 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1d01d7d2-deb7-4fd2-bae5-55b3dfb89f35 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:34.481055 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c20eb75f-4e03-47d1-9d8b-23ec90f862e1 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-359027786"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:15:34.485926 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c20eb75f-4e03-47d1-9d8b-23ec90f862e1 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 291a0671-7bab-404a-b836-95fb7acfd1dd] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:34.506308 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c20eb75f-4e03-47d1-9d8b-23ec90f862e1 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:34.510852 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c20eb75f-4e03-47d1-9d8b-23ec90f862e1 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:34.511314 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c20eb75f-4e03-47d1-9d8b-23ec90f862e1 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:34.512056 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c20eb75f-4e03-47d1-9d8b-23ec90f862e1 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:34.514684 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c20eb75f-4e03-47d1-9d8b-23ec90f862e1 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:34.515732 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c20eb75f-4e03-47d1-9d8b-23ec90f862e1 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:34.942523 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1d01d7d2-deb7-4fd2-bae5-55b3dfb89f35 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:34.956820 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1d01d7d2-deb7-4fd2-bae5-55b3dfb89f35 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:34.958861 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1d01d7d2-deb7-4fd2-bae5-55b3dfb89f35 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:34.961565 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1d01d7d2-deb7-4fd2-bae5-55b3dfb89f35 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7" status: 200 len: 1412 microversion: 2.25 time: 0.506866 Oct 23 01:15:34.979641 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 660/1409] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:15:34 2022] GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7 => generated 1412 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:15:34.990896 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ed2542dd-1e7e-4914-bca0-a0988e8af106 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:34.991838 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ed2542dd-1e7e-4914-bca0-a0988e8af106 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] [instance: de212c9c-e0e0-471f-8a01-5d180ac28d07] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:34.999073 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ed2542dd-1e7e-4914-bca0-a0988e8af106 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:35.000558 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ed2542dd-1e7e-4914-bca0-a0988e8af106 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:35.001175 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ed2542dd-1e7e-4914-bca0-a0988e8af106 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:35.002492 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ed2542dd-1e7e-4914-bca0-a0988e8af106 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:35.003123 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ed2542dd-1e7e-4914-bca0-a0988e8af106 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:35.005305 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ed2542dd-1e7e-4914-bca0-a0988e8af106 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:35.154857 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c20eb75f-4e03-47d1-9d8b-23ec90f862e1 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "POST /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd/action" status: 202 len: 0 microversion: 2.1 time: 0.697532 Oct 23 01:15:35.162068 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 750/1410] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:15:34 2022] POST /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd/action => generated 0 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 23 01:15:35.168595 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3f411166-3d5b-4746-bf18-2aa8aa68146e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Action: 'create', calling method: .version_select at 0x7f5cc1ec7430>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-810364776", "policies": ["anti-affinity"]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:15:35.195994 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-3f411166-3d5b-4746-bf18-2aa8aa68146e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Getting quotas for project 47aadec780734d03a262d4021f48d625. Resources: {'server_groups'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:15:35.203131 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-3f411166-3d5b-4746-bf18-2aa8aa68146e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Getting quotas for user 519c893a1e094200b882cf23db7cae54 and project 47aadec780734d03a262d4021f48d625. Resources: {'server_groups'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:15:35.361929 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ed2542dd-1e7e-4914-bca0-a0988e8af106 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80703c3d1dae419c9fd5ca103f3c28bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356a4b3819db457fb5caf68ded0212fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:35.371574 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ed2542dd-1e7e-4914-bca0-a0988e8af106 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] 10.222.0.42 "GET /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07" status: 200 len: 1464 microversion: 2.1 time: 0.390399 Oct 23 01:15:35.386859 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 661/1411] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:34 2022] GET /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07 => generated 1464 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:35.387102 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-3f411166-3d5b-4746-bf18-2aa8aa68146e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Getting quotas for project 47aadec780734d03a262d4021f48d625. Resources: {'server_groups'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:15:35.392025 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-637fb64e-29ab-41f0-b107-713567484068 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:35.392871 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-637fb64e-29ab-41f0-b107-713567484068 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:35.398877 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-3f411166-3d5b-4746-bf18-2aa8aa68146e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Getting quotas for user 519c893a1e094200b882cf23db7cae54 and project 47aadec780734d03a262d4021f48d625. Resources: {'server_groups'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:15:35.401478 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-637fb64e-29ab-41f0-b107-713567484068 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:35.406017 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-637fb64e-29ab-41f0-b107-713567484068 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:35.406675 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-637fb64e-29ab-41f0-b107-713567484068 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:35.407575 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-637fb64e-29ab-41f0-b107-713567484068 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:35.410366 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-637fb64e-29ab-41f0-b107-713567484068 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:35.411083 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-637fb64e-29ab-41f0-b107-713567484068 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:35.419590 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3f411166-3d5b-4746-bf18-2aa8aa68146e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.253930 Oct 23 01:15:35.420849 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 751/1412] 10.222.0.42 () {60 vars in 1174 bytes} [Sun Oct 23 01:15:35 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:15:35.427579 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-44738ede-9e01-43cc-8cab-cb93e3792a8d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1304703261"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:15:35.455798 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-44738ede-9e01-43cc-8cab-cb93e3792a8d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 291a0671-7bab-404a-b836-95fb7acfd1dd] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:35.463314 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:15:35.501596 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44738ede-9e01-43cc-8cab-cb93e3792a8d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:35.503343 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44738ede-9e01-43cc-8cab-cb93e3792a8d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:35.505122 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44738ede-9e01-43cc-8cab-cb93e3792a8d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:35.506173 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44738ede-9e01-43cc-8cab-cb93e3792a8d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:35.510090 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44738ede-9e01-43cc-8cab-cb93e3792a8d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:35.512409 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44738ede-9e01-43cc-8cab-cb93e3792a8d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:35.572555 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-44738ede-9e01-43cc-8cab-cb93e3792a8d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] HTTP exception thrown: Cannot 'createImage' instance 291a0671-7bab-404a-b836-95fb7acfd1dd while it is in task_state image_snapshot Oct 23 01:15:35.575828 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-44738ede-9e01-43cc-8cab-cb93e3792a8d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Request method failure captured: Oct 23 01:15:35.575828 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd/action HTTP/1.1 Oct 23 01:15:35.575828 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:15:35.575828 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:15:35.575828 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:15:35.575828 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 85 Oct 23 01:15:35.575828 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:15:35.575828 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:15:35.575828 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:15:35.575828 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:15:35.575828 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJWaABlg9aZPPmiKYOFyjnW3cUDNfMTW-9Ow-Ga99e9rhT_Xz0fOPaBTxk-ZvoWH3eiZ84RoqOaVKmH_NPvl5JjsEC9A2dnRRYDDEs3eUATgMIXjceNensPNpeVu874ElZedsjKlwKXnfqakqBoob0ap94r3bfJNgcmUxWbrsNVh5-k Oct 23 01:15:35.575828 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:15:35.575828 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:15:35.575828 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:15:35.575828 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:15:35.575828 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:15:35.575828 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:15:35.575828 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 1aa3395c4af3435eaa3a0f49e19167fe Oct 23 01:15:35.575828 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-421844011 Oct 23 01:15:35.575828 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:15:35.575828 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:15:35.577208 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1aa3395c4af3435eaa3a0f49e19167fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1aa3395c4af3435eaa3a0f49e19167fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1aa3395c4af3435eaa3a0f49e19167fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1aa3395c4af3435eaa3a0f49e19167fe"}]}] Oct 23 01:15:35.577208 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-421844011 Oct 23 01:15:35.577208 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 1aa3395c4af3435eaa3a0f49e19167fe Oct 23 01:15:35.577208 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-421844011 Oct 23 01:15:35.577208 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ImagesOneServerNegativeTestJSON-421844011-project Oct 23 01:15:35.577208 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:15:35.577208 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:15:35.577208 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 690143905857471f949b1f4454ad2139 Oct 23 01:15:35.577208 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-421844011-project Oct 23 01:15:35.577208 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:15:35.577208 n-d-master-1 devstack@n-api.service[120945]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1304703261"}} Oct 23 01:15:35.577208 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:15:35.578007 n-d-master-1 devstack@n-api.service[120945]: exception: Cannot 'createImage' instance 291a0671-7bab-404a-b836-95fb7acfd1dd while it is in task_state image_snapshot Oct 23 01:15:35.578007 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '291a0671-7bab-404a-b836-95fb7acfd1dd', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1304703261'}}} Oct 23 01:15:35.578007 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:15:35.578007 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:15:35.578007 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 23 01:15:35.578007 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 23 01:15:35.578007 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 23 01:15:35.578007 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 23 01:15:35.578007 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 291a0671-7bab-404a-b836-95fb7acfd1dd in task_state image_snapshot. Cannot snapshot while the instance is in this state. Oct 23 01:15:35.578007 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:15:35.578007 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:15:35.578007 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:15:35.578007 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:15:35.578007 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:15:35.578007 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:15:35.578007 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:15:35.578007 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:15:35.578007 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:15:35.578007 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:15:35.579278 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:15:35.579278 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:15:35.579278 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:15:35.579278 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:15:35.579278 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 23 01:15:35.579278 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 23 01:15:35.579278 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 23 01:15:35.579278 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 23 01:15:35.579278 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 291a0671-7bab-404a-b836-95fb7acfd1dd while it is in task_state image_snapshot Oct 23 01:15:35.579278 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:15:35.579278 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:15:35.579278 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:15:35.579278 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:15:35.579278 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:15:35.579278 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:15:35.579278 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:15:35.579278 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:15:35.579278 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 291a0671-7bab-404a-b836-95fb7acfd1dd while it is in task_state image_snapshot Oct 23 01:15:35.579278 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:15:35.585933 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-44738ede-9e01-43cc-8cab-cb93e3792a8d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Returning 409 to user: Cannot 'createImage' instance 291a0671-7bab-404a-b836-95fb7acfd1dd while it is in task_state image_snapshot {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:15:35.587591 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-44738ede-9e01-43cc-8cab-cb93e3792a8d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "POST /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd/action" status: 409 len: 159 microversion: 2.1 time: 0.164870 Oct 23 01:15:35.588749 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 752/1413] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:15:35 2022] POST /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd/action => generated 159 bytes in 167 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:15:35.594008 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d6e8bd9b-e44b-4c80-867e-91313131caa6 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:35.595423 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d6e8bd9b-e44b-4c80-867e-91313131caa6 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 8025dc46-71af-4fec-8f54-5ae9e92cc31f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:35.604493 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d6e8bd9b-e44b-4c80-867e-91313131caa6 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:35.606405 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d6e8bd9b-e44b-4c80-867e-91313131caa6 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:35.607857 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d6e8bd9b-e44b-4c80-867e-91313131caa6 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:35.609594 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d6e8bd9b-e44b-4c80-867e-91313131caa6 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:35.610335 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d6e8bd9b-e44b-4c80-867e-91313131caa6 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:35.610996 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d6e8bd9b-e44b-4c80-867e-91313131caa6 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:35.810297 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-637fb64e-29ab-41f0-b107-713567484068 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:35.826353 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-637fb64e-29ab-41f0-b107-713567484068 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 200 len: 1717 microversion: 2.1 time: 0.449316 Oct 23 01:15:35.854408 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 662/1414] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:35 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 1717 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:35.869443 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-de3f0606-6075-4858-9060-8949ff26f3a3 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '.version_select at 0x7f5cc1982310>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:35.971449 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d6e8bd9b-e44b-4c80-867e-91313131caa6 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:35.979385 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d6e8bd9b-e44b-4c80-867e-91313131caa6 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f" status: 200 len: 1469 microversion: 2.1 time: 0.389419 Oct 23 01:15:35.997308 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 753/1415] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:35 2022] GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f => generated 1469 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:36.004892 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-21635db6-8767-47ca-9026-ec6fdf7b7b32 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-484282001", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "6fba43e8-a5dc-41db-bd28-f3f6e8ef90f6"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:15:36.069392 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-21635db6-8767-47ca-9026-ec6fdf7b7b32 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] validate_networks() for None {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:15:36.253386 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-de3f0606-6075-4858-9060-8949ff26f3a3 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "DELETE /compute/v2.1/images/790f8b89-db93-4eda-b782-3a99ccdd410b" status: 204 len: 0 microversion: 2.1 time: 0.397250 Oct 23 01:15:36.254052 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 663/1416] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:35 2022] DELETE /compute/v2.1/images/790f8b89-db93-4eda-b782-3a99ccdd410b => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:15:36.260204 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-62142db5-f411-450c-9198-e56275383ae2 req-985d17b8-f6aa-4cb7-a2f8-8e45afaf2ed2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8025dc46-71af-4fec-8f54-5ae9e92cc31f", "name": "network-vif-plugged", "status": "completed", "tag": "9dbeafb3-f8f6-45eb-993c-c817b00700d0"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:15:36.285166 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-62142db5-f411-450c-9198-e56275383ae2 req-985d17b8-f6aa-4cb7-a2f8-8e45afaf2ed2 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:36.285166 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-62142db5-f411-450c-9198-e56275383ae2 req-985d17b8-f6aa-4cb7-a2f8-8e45afaf2ed2 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:36.285166 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-62142db5-f411-450c-9198-e56275383ae2 req-985d17b8-f6aa-4cb7-a2f8-8e45afaf2ed2 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:36.298362 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-62142db5-f411-450c-9198-e56275383ae2 req-985d17b8-f6aa-4cb7-a2f8-8e45afaf2ed2 service nova] Creating event network-vif-plugged:9dbeafb3-f8f6-45eb-993c-c817b00700d0 for instance 8025dc46-71af-4fec-8f54-5ae9e92cc31f on n-h1-master-1 Oct 23 01:15:36.305124 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [req-62142db5-f411-450c-9198-e56275383ae2 req-985d17b8-f6aa-4cb7-a2f8-8e45afaf2ed2 service nova] Instance 8025dc46-71af-4fec-8f54-5ae9e92cc31f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120944) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 23 01:15:36.323509 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-62142db5-f411-450c-9198-e56275383ae2 req-985d17b8-f6aa-4cb7-a2f8-8e45afaf2ed2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067794 Oct 23 01:15:36.324432 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 664/1417] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:15:36.329699 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-95cb3f57-6d4f-47ee-aaea-640c61604832 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:36.330445 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-95cb3f57-6d4f-47ee-aaea-640c61604832 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:36.337866 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-95cb3f57-6d4f-47ee-aaea-640c61604832 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:36.342561 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-95cb3f57-6d4f-47ee-aaea-640c61604832 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:36.342561 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-95cb3f57-6d4f-47ee-aaea-640c61604832 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:36.342561 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-95cb3f57-6d4f-47ee-aaea-640c61604832 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:36.342561 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-95cb3f57-6d4f-47ee-aaea-640c61604832 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:36.342948 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-95cb3f57-6d4f-47ee-aaea-640c61604832 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:36.418759 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-21635db6-8767-47ca-9026-ec6fdf7b7b32 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:15:36.419319 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-21635db6-8767-47ca-9026-ec6fdf7b7b32 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:15:36.419884 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-21635db6-8767-47ca-9026-ec6fdf7b7b32 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:15:36.420815 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-21635db6-8767-47ca-9026-ec6fdf7b7b32 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:15:36.421355 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-21635db6-8767-47ca-9026-ec6fdf7b7b32 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:15:36.452893 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-21635db6-8767-47ca-9026-ec6fdf7b7b32 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:36.453718 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-21635db6-8767-47ca-9026-ec6fdf7b7b32 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:36.454462 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-21635db6-8767-47ca-9026-ec6fdf7b7b32 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:36.455365 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-21635db6-8767-47ca-9026-ec6fdf7b7b32 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:36.455993 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-21635db6-8767-47ca-9026-ec6fdf7b7b32 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:36.456760 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-21635db6-8767-47ca-9026-ec6fdf7b7b32 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:36.477144 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-21635db6-8767-47ca-9026-ec6fdf7b7b32 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Getting quotas for project 47aadec780734d03a262d4021f48d625. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:15:36.483114 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-21635db6-8767-47ca-9026-ec6fdf7b7b32 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Getting quotas for user 519c893a1e094200b882cf23db7cae54 and project 47aadec780734d03a262d4021f48d625. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:15:36.501198 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-21635db6-8767-47ca-9026-ec6fdf7b7b32 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Going to run 2 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:15:36.507991 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-21635db6-8767-47ca-9026-ec6fdf7b7b32 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 024cb100-29e3-402c-b634-256694a63335] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:15:36.653270 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-21635db6-8767-47ca-9026-ec6fdf7b7b32 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=120945) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 23 01:15:36.679501 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-95cb3f57-6d4f-47ee-aaea-640c61604832 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:36.688972 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-95cb3f57-6d4f-47ee-aaea-640c61604832 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:36.691617 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-95cb3f57-6d4f-47ee-aaea-640c61604832 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:36.705346 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-21635db6-8767-47ca-9026-ec6fdf7b7b32 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Getting quotas for project 47aadec780734d03a262d4021f48d625. Resources: {'server_group_members'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:15:36.709597 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-95cb3f57-6d4f-47ee-aaea-640c61604832 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7" status: 200 len: 1412 microversion: 2.25 time: 0.383873 Oct 23 01:15:36.710230 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 665/1418] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:15:36 2022] GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7 => generated 1412 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:15:36.727121 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-21635db6-8767-47ca-9026-ec6fdf7b7b32 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Getting quotas for user 519c893a1e094200b882cf23db7cae54 and project 47aadec780734d03a262d4021f48d625. Resources: {'server_group_members'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:15:36.746620 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5c2cefd9-141c-4c85-aecd-a9b118eb6611 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:15:36.747467 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5c2cefd9-141c-4c85-aecd-a9b118eb6611 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 8025dc46-71af-4fec-8f54-5ae9e92cc31f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:36.758523 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5c2cefd9-141c-4c85-aecd-a9b118eb6611 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:36.762698 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5c2cefd9-141c-4c85-aecd-a9b118eb6611 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:36.763368 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5c2cefd9-141c-4c85-aecd-a9b118eb6611 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:36.764270 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5c2cefd9-141c-4c85-aecd-a9b118eb6611 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:36.764896 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5c2cefd9-141c-4c85-aecd-a9b118eb6611 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:36.765520 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5c2cefd9-141c-4c85-aecd-a9b118eb6611 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:36.831013 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5c2cefd9-141c-4c85-aecd-a9b118eb6611 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:36.835338 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5c2cefd9-141c-4c85-aecd-a9b118eb6611 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:36.835338 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5c2cefd9-141c-4c85-aecd-a9b118eb6611 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:36.835338 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5c2cefd9-141c-4c85-aecd-a9b118eb6611 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:36.835338 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5c2cefd9-141c-4c85-aecd-a9b118eb6611 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:36.835824 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5c2cefd9-141c-4c85-aecd-a9b118eb6611 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:36.884247 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-5c2cefd9-141c-4c85-aecd-a9b118eb6611 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Getting quotas for project eb058785345d4e58a5820445efe09bee. Resources: {'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:15:36.893131 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-5c2cefd9-141c-4c85-aecd-a9b118eb6611 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Getting quotas for user 547aed83a7e44becb9c89dc6bae62255 and project eb058785345d4e58a5820445efe09bee. Resources: {'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:15:36.904532 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-21635db6-8767-47ca-9026-ec6fdf7b7b32 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Getting quotas for project 47aadec780734d03a262d4021f48d625. Resources: {'server_group_members'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:15:36.918087 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-21635db6-8767-47ca-9026-ec6fdf7b7b32 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Getting quotas for user 519c893a1e094200b882cf23db7cae54 and project 47aadec780734d03a262d4021f48d625. Resources: {'server_group_members'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:15:36.949957 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-21635db6-8767-47ca-9026-ec6fdf7b7b32 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: fb12a9d1-a506-4e57-b93e-62cbe2ac4450] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=024cb100-29e3-402c-b634-256694a63335,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:15:37.173250 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-21635db6-8767-47ca-9026-ec6fdf7b7b32 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Getting quotas for project 47aadec780734d03a262d4021f48d625. Resources: {'server_group_members'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:15:37.181783 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-21635db6-8767-47ca-9026-ec6fdf7b7b32 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Getting quotas for user 519c893a1e094200b882cf23db7cae54 and project 47aadec780734d03a262d4021f48d625. Resources: {'server_group_members'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:15:37.354640 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-21635db6-8767-47ca-9026-ec6fdf7b7b32 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Getting quotas for project 47aadec780734d03a262d4021f48d625. Resources: {'server_group_members'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:15:37.362457 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-21635db6-8767-47ca-9026-ec6fdf7b7b32 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Getting quotas for user 519c893a1e094200b882cf23db7cae54 and project 47aadec780734d03a262d4021f48d625. Resources: {'server_group_members'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:15:37.444390 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-21635db6-8767-47ca-9026-ec6fdf7b7b32 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.442736 Oct 23 01:15:37.447090 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 754/1419] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:15:35 2022] POST /compute/v2.1/servers => generated 32 bytes in 1449 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 23 01:15:37.453184 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5c2cefd9-141c-4c85-aecd-a9b118eb6611 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "POST /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f/action" status: 202 len: 0 microversion: 2.1 time: 0.718714 Oct 23 01:15:37.455870 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d065a732-8cbf-4ce9-aba1-b1ef9e9b2d4d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:37.456519 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d065a732-8cbf-4ce9-aba1-b1ef9e9b2d4d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 291a0671-7bab-404a-b836-95fb7acfd1dd] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:37.458904 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 666/1420] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:15:36 2022] POST /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f/action => generated 0 bytes in 728 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:15:37.473585 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7d524509-555d-4e15-95c3-227f1f655b2f tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:37.474781 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7d524509-555d-4e15-95c3-227f1f655b2f tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] [instance: de212c9c-e0e0-471f-8a01-5d180ac28d07] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:37.478611 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d065a732-8cbf-4ce9-aba1-b1ef9e9b2d4d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:37.479387 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d065a732-8cbf-4ce9-aba1-b1ef9e9b2d4d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:37.483800 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d524509-555d-4e15-95c3-227f1f655b2f tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:37.484384 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d065a732-8cbf-4ce9-aba1-b1ef9e9b2d4d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:37.484741 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d524509-555d-4e15-95c3-227f1f655b2f tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:37.485946 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d524509-555d-4e15-95c3-227f1f655b2f tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:37.486189 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d065a732-8cbf-4ce9-aba1-b1ef9e9b2d4d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:37.486479 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d065a732-8cbf-4ce9-aba1-b1ef9e9b2d4d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:37.486973 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d065a732-8cbf-4ce9-aba1-b1ef9e9b2d4d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:37.487424 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d524509-555d-4e15-95c3-227f1f655b2f tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:37.492287 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d524509-555d-4e15-95c3-227f1f655b2f tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:37.492287 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d524509-555d-4e15-95c3-227f1f655b2f tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:38.400112 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d065a732-8cbf-4ce9-aba1-b1ef9e9b2d4d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:38.417272 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d065a732-8cbf-4ce9-aba1-b1ef9e9b2d4d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd" status: 200 len: 1540 microversion: 2.1 time: 0.962684 Oct 23 01:15:38.418847 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 755/1421] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:37 2022] GET /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd => generated 1540 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:38.429370 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-405a85bd-09a7-45a1-b5ec-d3f3f5ca42ca tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:38.430556 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-405a85bd-09a7-45a1-b5ec-d3f3f5ca42ca tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:38.444929 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-405a85bd-09a7-45a1-b5ec-d3f3f5ca42ca tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:38.447744 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-405a85bd-09a7-45a1-b5ec-d3f3f5ca42ca tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:38.449105 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-405a85bd-09a7-45a1-b5ec-d3f3f5ca42ca tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:38.451433 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-405a85bd-09a7-45a1-b5ec-d3f3f5ca42ca tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:38.452133 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-405a85bd-09a7-45a1-b5ec-d3f3f5ca42ca tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:38.452958 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-405a85bd-09a7-45a1-b5ec-d3f3f5ca42ca tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:38.900350 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7d524509-555d-4e15-95c3-227f1f655b2f tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80703c3d1dae419c9fd5ca103f3c28bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356a4b3819db457fb5caf68ded0212fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:38.913067 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7d524509-555d-4e15-95c3-227f1f655b2f tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] 10.222.0.42 "GET /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07" status: 200 len: 1464 microversion: 2.1 time: 1.450891 Oct 23 01:15:38.934886 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 667/1422] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:37 2022] GET /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07 => generated 1464 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:38.943691 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-de670c1e-2c9a-4acc-a5f9-e975650bc021 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:38.963011 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-de670c1e-2c9a-4acc-a5f9-e975650bc021 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:38.964249 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-de670c1e-2c9a-4acc-a5f9-e975650bc021 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Searching by: {'deleted': False, 'project_id': '47aadec780734d03a262d4021f48d625'} {{(pid=120944) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 23 01:15:38.996829 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-de670c1e-2c9a-4acc-a5f9-e975650bc021 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:38.997765 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-de670c1e-2c9a-4acc-a5f9-e975650bc021 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:38.998421 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-de670c1e-2c9a-4acc-a5f9-e975650bc021 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:38.999452 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-de670c1e-2c9a-4acc-a5f9-e975650bc021 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:39.000078 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-de670c1e-2c9a-4acc-a5f9-e975650bc021 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:39.000679 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-de670c1e-2c9a-4acc-a5f9-e975650bc021 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:39.059366 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.multi_cell_list [None req-de670c1e-2c9a-4acc-a5f9-e975650bc021 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=120944) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 23 01:15:39.129185 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-de670c1e-2c9a-4acc-a5f9-e975650bc021 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 1663 microversion: 2.1 time: 0.193032 Oct 23 01:15:39.129780 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 668/1423] 10.222.0.42 () {58 vars in 1125 bytes} [Sun Oct 23 01:15:38 2022] GET /compute/v2.1/servers => generated 1663 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:39.142341 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c64e2eab-4a91-47b9-9156-0fb0489f80a5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:39.143001 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c64e2eab-4a91-47b9-9156-0fb0489f80a5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 8025dc46-71af-4fec-8f54-5ae9e92cc31f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:39.155825 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c64e2eab-4a91-47b9-9156-0fb0489f80a5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:39.156292 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c64e2eab-4a91-47b9-9156-0fb0489f80a5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:39.156829 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c64e2eab-4a91-47b9-9156-0fb0489f80a5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:39.161485 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c64e2eab-4a91-47b9-9156-0fb0489f80a5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:39.162091 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c64e2eab-4a91-47b9-9156-0fb0489f80a5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:39.164659 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c64e2eab-4a91-47b9-9156-0fb0489f80a5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:39.643901 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-405a85bd-09a7-45a1-b5ec-d3f3f5ca42ca tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:39.659079 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-405a85bd-09a7-45a1-b5ec-d3f3f5ca42ca tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 200 len: 1717 microversion: 2.1 time: 1.238939 Oct 23 01:15:39.674945 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 756/1424] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:38 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 1717 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:39.684541 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e26bb9b8-6c9d-476f-9636-280fc822dd6e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:39.685159 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e26bb9b8-6c9d-476f-9636-280fc822dd6e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:39.691790 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e26bb9b8-6c9d-476f-9636-280fc822dd6e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:39.697710 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e26bb9b8-6c9d-476f-9636-280fc822dd6e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:39.697710 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e26bb9b8-6c9d-476f-9636-280fc822dd6e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:39.697710 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e26bb9b8-6c9d-476f-9636-280fc822dd6e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:39.697710 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e26bb9b8-6c9d-476f-9636-280fc822dd6e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:39.698145 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e26bb9b8-6c9d-476f-9636-280fc822dd6e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:40.092820 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c64e2eab-4a91-47b9-9156-0fb0489f80a5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:40.104763 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c64e2eab-4a91-47b9-9156-0fb0489f80a5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f" status: 200 len: 1468 microversion: 2.1 time: 0.973657 Oct 23 01:15:40.118095 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 669/1425] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:39 2022] GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f => generated 1468 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:40.118095 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-c830f108-9fed-420c-bd94-6785fd47e275 req-a3e46e5d-d9b4-48a2-a669-2ca516784931 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "510a3540-031d-4fab-bf7c-0a3bbc8c4d4d", "name": "network-vif-unplugged", "status": "completed", "tag": "baff0168-301d-414b-99b1-bb1e62f9bfcd"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:15:40.141019 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-c830f108-9fed-420c-bd94-6785fd47e275 req-a3e46e5d-d9b4-48a2-a669-2ca516784931 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:40.141593 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-c830f108-9fed-420c-bd94-6785fd47e275 req-a3e46e5d-d9b4-48a2-a669-2ca516784931 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:40.142068 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-c830f108-9fed-420c-bd94-6785fd47e275 req-a3e46e5d-d9b4-48a2-a669-2ca516784931 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:40.171979 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-c830f108-9fed-420c-bd94-6785fd47e275 req-a3e46e5d-d9b4-48a2-a669-2ca516784931 service nova] Creating event network-vif-unplugged:baff0168-301d-414b-99b1-bb1e62f9bfcd for instance 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d on n-h2-master-1 Oct 23 01:15:40.184007 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-c830f108-9fed-420c-bd94-6785fd47e275 req-a3e46e5d-d9b4-48a2-a669-2ca516784931 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076360 Oct 23 01:15:40.187075 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 670/1426] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:15:40.202950 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e60630be-7eb6-47d1-8bfd-f9243466b024 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:40.203976 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e60630be-7eb6-47d1-8bfd-f9243466b024 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: fb12a9d1-a506-4e57-b93e-62cbe2ac4450] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:40.215080 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e26bb9b8-6c9d-476f-9636-280fc822dd6e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:40.231559 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e26bb9b8-6c9d-476f-9636-280fc822dd6e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:40.234219 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e26bb9b8-6c9d-476f-9636-280fc822dd6e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:40.245540 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e26bb9b8-6c9d-476f-9636-280fc822dd6e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7" status: 200 len: 1412 microversion: 2.25 time: 0.569018 Oct 23 01:15:40.246760 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 757/1427] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:15:39 2022] GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7 => generated 1412 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:15:40.271111 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ab3313c8-2120-4a9f-8013-d85065dc3139 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:40.271742 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ab3313c8-2120-4a9f-8013-d85065dc3139 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 291a0671-7bab-404a-b836-95fb7acfd1dd] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:40.288299 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ab3313c8-2120-4a9f-8013-d85065dc3139 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:40.293185 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ab3313c8-2120-4a9f-8013-d85065dc3139 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:40.295229 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ab3313c8-2120-4a9f-8013-d85065dc3139 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:40.297541 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ab3313c8-2120-4a9f-8013-d85065dc3139 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:40.298530 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ab3313c8-2120-4a9f-8013-d85065dc3139 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:40.301254 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ab3313c8-2120-4a9f-8013-d85065dc3139 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:40.352748 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e60630be-7eb6-47d1-8bfd-f9243466b024 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:40.365392 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e60630be-7eb6-47d1-8bfd-f9243466b024 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/fb12a9d1-a506-4e57-b93e-62cbe2ac4450" status: 200 len: 1218 microversion: 2.1 time: 0.176183 Oct 23 01:15:40.366998 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 671/1428] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:40 2022] GET /compute/v2.1/servers/fb12a9d1-a506-4e57-b93e-62cbe2ac4450 => generated 1218 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:40.372162 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-55c1f0dc-7e9d-46f1-b9d1-2e0497845699 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:40.378253 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-55c1f0dc-7e9d-46f1-b9d1-2e0497845699 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] [instance: de212c9c-e0e0-471f-8a01-5d180ac28d07] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:40.406710 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55c1f0dc-7e9d-46f1-b9d1-2e0497845699 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:40.407227 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55c1f0dc-7e9d-46f1-b9d1-2e0497845699 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:40.411143 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55c1f0dc-7e9d-46f1-b9d1-2e0497845699 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:40.414769 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55c1f0dc-7e9d-46f1-b9d1-2e0497845699 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:40.415417 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55c1f0dc-7e9d-46f1-b9d1-2e0497845699 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:40.415918 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55c1f0dc-7e9d-46f1-b9d1-2e0497845699 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:40.517200 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55c1f0dc-7e9d-46f1-b9d1-2e0497845699 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:40.517952 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55c1f0dc-7e9d-46f1-b9d1-2e0497845699 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:40.519061 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55c1f0dc-7e9d-46f1-b9d1-2e0497845699 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:40.519964 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-55c1f0dc-7e9d-46f1-b9d1-2e0497845699 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lazy-loading 'fault' on Instance uuid de212c9c-e0e0-471f-8a01-5d180ac28d07 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:15:40.678559 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-55c1f0dc-7e9d-46f1-b9d1-2e0497845699 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80703c3d1dae419c9fd5ca103f3c28bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356a4b3819db457fb5caf68ded0212fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:40.699060 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-55c1f0dc-7e9d-46f1-b9d1-2e0497845699 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] 10.222.0.42 "GET /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07" status: 200 len: 1308 microversion: 2.1 time: 0.329121 Oct 23 01:15:40.700195 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 672/1429] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:40 2022] GET /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07 => generated 1308 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:40.717072 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-ae1592e9-984a-41ab-b1cd-55ee16a21ed0 req-144401e0-98ea-42d6-b76f-c75010655612 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be9a2687-233d-43c3-95b3-3a8b455595c7", "name": "network-vif-plugged", "status": "completed", "tag": "a5573536-696d-47fb-b77e-270410ee0fca"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:15:40.769715 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:15:40.776865 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-ae1592e9-984a-41ab-b1cd-55ee16a21ed0 req-144401e0-98ea-42d6-b76f-c75010655612 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:40.777486 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-ae1592e9-984a-41ab-b1cd-55ee16a21ed0 req-144401e0-98ea-42d6-b76f-c75010655612 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:40.778218 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-ae1592e9-984a-41ab-b1cd-55ee16a21ed0 req-144401e0-98ea-42d6-b76f-c75010655612 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:40.812563 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-ae1592e9-984a-41ab-b1cd-55ee16a21ed0 req-144401e0-98ea-42d6-b76f-c75010655612 service nova] Creating event network-vif-plugged:a5573536-696d-47fb-b77e-270410ee0fca for instance be9a2687-233d-43c3-95b3-3a8b455595c7 on n-h2-master-1 Oct 23 01:15:40.821356 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-ae1592e9-984a-41ab-b1cd-55ee16a21ed0 req-144401e0-98ea-42d6-b76f-c75010655612 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119366 Oct 23 01:15:40.825478 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 673/1430] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:15:40.835923 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-68b5af73-21eb-44e4-bde1-2481ea153c9d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:40.837656 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-68b5af73-21eb-44e4-bde1-2481ea153c9d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:40.845720 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68b5af73-21eb-44e4-bde1-2481ea153c9d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:40.846522 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68b5af73-21eb-44e4-bde1-2481ea153c9d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:40.847287 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68b5af73-21eb-44e4-bde1-2481ea153c9d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:40.848153 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68b5af73-21eb-44e4-bde1-2481ea153c9d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:40.848919 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68b5af73-21eb-44e4-bde1-2481ea153c9d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:40.849517 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68b5af73-21eb-44e4-bde1-2481ea153c9d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:40.901189 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ab3313c8-2120-4a9f-8013-d85065dc3139 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:40.915024 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:15:40.921577 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ab3313c8-2120-4a9f-8013-d85065dc3139 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd" status: 200 len: 1522 microversion: 2.1 time: 0.667729 Oct 23 01:15:40.921577 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 758/1431] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:40 2022] GET /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd => generated 1522 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:40.942059 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-335ddc01-358c-4a5c-a90a-0aafd22f61a1 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:40.942554 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-335ddc01-358c-4a5c-a90a-0aafd22f61a1 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 291a0671-7bab-404a-b836-95fb7acfd1dd] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:40.961644 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-335ddc01-358c-4a5c-a90a-0aafd22f61a1 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:40.964799 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-335ddc01-358c-4a5c-a90a-0aafd22f61a1 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:40.965450 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-335ddc01-358c-4a5c-a90a-0aafd22f61a1 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:40.970006 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-335ddc01-358c-4a5c-a90a-0aafd22f61a1 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:40.971091 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-335ddc01-358c-4a5c-a90a-0aafd22f61a1 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:40.971811 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-335ddc01-358c-4a5c-a90a-0aafd22f61a1 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:41.047903 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-335ddc01-358c-4a5c-a90a-0aafd22f61a1 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 291a0671-7bab-404a-b836-95fb7acfd1dd] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:15:41.525441 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-335ddc01-358c-4a5c-a90a-0aafd22f61a1 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "DELETE /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd" status: 204 len: 0 microversion: 2.1 time: 0.584484 Oct 23 01:15:41.528231 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 759/1432] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:15:40 2022] DELETE /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd => generated 0 bytes in 591 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:15:41.545249 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e1240e7e-b3c7-4ac6-b611-9578c8447a65 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:41.546583 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e1240e7e-b3c7-4ac6-b611-9578c8447a65 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 8025dc46-71af-4fec-8f54-5ae9e92cc31f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:41.575869 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e1240e7e-b3c7-4ac6-b611-9578c8447a65 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:41.576406 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e1240e7e-b3c7-4ac6-b611-9578c8447a65 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:41.578119 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e1240e7e-b3c7-4ac6-b611-9578c8447a65 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:41.580767 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e1240e7e-b3c7-4ac6-b611-9578c8447a65 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:41.581261 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e1240e7e-b3c7-4ac6-b611-9578c8447a65 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:41.581691 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e1240e7e-b3c7-4ac6-b611-9578c8447a65 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:41.696576 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-68b5af73-21eb-44e4-bde1-2481ea153c9d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:41.719785 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-68b5af73-21eb-44e4-bde1-2481ea153c9d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 200 len: 1717 microversion: 2.1 time: 0.888470 Oct 23 01:15:41.721023 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 674/1433] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:40 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 1717 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:41.729729 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-13feffe5-42a8-4062-891e-55bb91b4c9bd tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:41.730637 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-13feffe5-42a8-4062-891e-55bb91b4c9bd tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:41.753561 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13feffe5-42a8-4062-891e-55bb91b4c9bd tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:41.755622 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13feffe5-42a8-4062-891e-55bb91b4c9bd tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:41.756339 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13feffe5-42a8-4062-891e-55bb91b4c9bd tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:41.759240 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13feffe5-42a8-4062-891e-55bb91b4c9bd tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:41.778971 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13feffe5-42a8-4062-891e-55bb91b4c9bd tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:41.779768 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13feffe5-42a8-4062-891e-55bb91b4c9bd tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:42.593516 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e1240e7e-b3c7-4ac6-b611-9578c8447a65 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:42.611009 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e1240e7e-b3c7-4ac6-b611-9578c8447a65 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f" status: 200 len: 1468 microversion: 2.1 time: 1.076592 Oct 23 01:15:42.614692 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 760/1434] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:41 2022] GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f => generated 1468 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:42.624569 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bf582d95-6a6c-4566-828d-0d7a8e1b7a9e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:42.627593 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-bf582d95-6a6c-4566-828d-0d7a8e1b7a9e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: fb12a9d1-a506-4e57-b93e-62cbe2ac4450] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:42.637565 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-13feffe5-42a8-4062-891e-55bb91b4c9bd tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:42.648177 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-13feffe5-42a8-4062-891e-55bb91b4c9bd tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:42.649686 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-13feffe5-42a8-4062-891e-55bb91b4c9bd tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:42.659665 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bf582d95-6a6c-4566-828d-0d7a8e1b7a9e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:42.660162 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bf582d95-6a6c-4566-828d-0d7a8e1b7a9e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:42.660602 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bf582d95-6a6c-4566-828d-0d7a8e1b7a9e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:42.661327 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bf582d95-6a6c-4566-828d-0d7a8e1b7a9e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:42.661779 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bf582d95-6a6c-4566-828d-0d7a8e1b7a9e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:42.662234 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bf582d95-6a6c-4566-828d-0d7a8e1b7a9e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:42.670376 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-13feffe5-42a8-4062-891e-55bb91b4c9bd tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7" status: 200 len: 1412 microversion: 2.25 time: 0.947468 Oct 23 01:15:42.670634 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 675/1435] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:15:41 2022] GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7 => generated 1412 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:15:42.697333 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-393475ea-691c-42e6-aa62-562e7baff34d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:42.697891 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-393475ea-691c-42e6-aa62-562e7baff34d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 291a0671-7bab-404a-b836-95fb7acfd1dd] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:42.725650 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-393475ea-691c-42e6-aa62-562e7baff34d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:42.726178 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-393475ea-691c-42e6-aa62-562e7baff34d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:42.726622 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-393475ea-691c-42e6-aa62-562e7baff34d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:42.727332 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-393475ea-691c-42e6-aa62-562e7baff34d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:42.727788 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-393475ea-691c-42e6-aa62-562e7baff34d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:42.728212 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-393475ea-691c-42e6-aa62-562e7baff34d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:42.952762 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bf582d95-6a6c-4566-828d-0d7a8e1b7a9e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:42.964064 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bf582d95-6a6c-4566-828d-0d7a8e1b7a9e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/fb12a9d1-a506-4e57-b93e-62cbe2ac4450" status: 200 len: 1270 microversion: 2.1 time: 0.347980 Oct 23 01:15:42.982945 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 761/1436] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:42 2022] GET /compute/v2.1/servers/fb12a9d1-a506-4e57-b93e-62cbe2ac4450 => generated 1270 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:42.992511 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4f51e866-4bef-49aa-a6bf-2604c0ac02d8 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:42.996524 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4f51e866-4bef-49aa-a6bf-2604c0ac02d8 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] [instance: de212c9c-e0e0-471f-8a01-5d180ac28d07] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:43.008792 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f51e866-4bef-49aa-a6bf-2604c0ac02d8 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:43.012097 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f51e866-4bef-49aa-a6bf-2604c0ac02d8 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:43.012097 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f51e866-4bef-49aa-a6bf-2604c0ac02d8 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:43.016148 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f51e866-4bef-49aa-a6bf-2604c0ac02d8 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:43.018981 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f51e866-4bef-49aa-a6bf-2604c0ac02d8 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:43.019648 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f51e866-4bef-49aa-a6bf-2604c0ac02d8 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:43.040160 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-393475ea-691c-42e6-aa62-562e7baff34d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:43.049040 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-393475ea-691c-42e6-aa62-562e7baff34d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd" status: 200 len: 1528 microversion: 2.1 time: 0.354026 Oct 23 01:15:43.070478 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 676/1437] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:42 2022] GET /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd => generated 1528 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:43.078554 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-9a6b46b1-7a18-4ba5-8f18-84e990b125c4 req-7eb7c89c-9d12-4020-b495-08097a21f5e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de212c9c-e0e0-471f-8a01-5d180ac28d07", "name": "network-vif-deleted", "tag": "e105d80f-51cc-42c7-8ece-f8e8a1806e71"}, {"name": "network-changed", "server_uuid": "510a3540-031d-4fab-bf7c-0a3bbc8c4d4d", "tag": "baff0168-301d-414b-99b1-bb1e62f9bfcd"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:15:43.102757 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-9a6b46b1-7a18-4ba5-8f18-84e990b125c4 req-7eb7c89c-9d12-4020-b495-08097a21f5e9 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:43.109081 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-9a6b46b1-7a18-4ba5-8f18-84e990b125c4 req-7eb7c89c-9d12-4020-b495-08097a21f5e9 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:43.109081 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-9a6b46b1-7a18-4ba5-8f18-84e990b125c4 req-7eb7c89c-9d12-4020-b495-08097a21f5e9 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:43.124513 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-9a6b46b1-7a18-4ba5-8f18-84e990b125c4 req-7eb7c89c-9d12-4020-b495-08097a21f5e9 service nova] Creating event network-vif-deleted:e105d80f-51cc-42c7-8ece-f8e8a1806e71 for instance de212c9c-e0e0-471f-8a01-5d180ac28d07 on n-h1-master-1 Oct 23 01:15:43.125296 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-9a6b46b1-7a18-4ba5-8f18-84e990b125c4 req-7eb7c89c-9d12-4020-b495-08097a21f5e9 service nova] Creating event network-changed:baff0168-301d-414b-99b1-bb1e62f9bfcd for instance 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d on n-h2-master-1 Oct 23 01:15:43.150850 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-9a6b46b1-7a18-4ba5-8f18-84e990b125c4 req-7eb7c89c-9d12-4020-b495-08097a21f5e9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.081544 Oct 23 01:15:43.153574 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 677/1438] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:15:43.165031 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a32219a2-a3c2-4ac6-89a7-142e47075618 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:43.172917 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a32219a2-a3c2-4ac6-89a7-142e47075618 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:43.191231 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a32219a2-a3c2-4ac6-89a7-142e47075618 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:43.191832 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a32219a2-a3c2-4ac6-89a7-142e47075618 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:43.192375 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a32219a2-a3c2-4ac6-89a7-142e47075618 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:43.193207 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a32219a2-a3c2-4ac6-89a7-142e47075618 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:43.193846 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a32219a2-a3c2-4ac6-89a7-142e47075618 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:43.201378 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a32219a2-a3c2-4ac6-89a7-142e47075618 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:43.300847 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-4f51e866-4bef-49aa-a6bf-2604c0ac02d8 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] HTTP exception thrown: Instance de212c9c-e0e0-471f-8a01-5d180ac28d07 could not be found. Oct 23 01:15:43.303785 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4f51e866-4bef-49aa-a6bf-2604c0ac02d8 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Request method failure captured: Oct 23 01:15:43.303785 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07 HTTP/1.1 Oct 23 01:15:43.303785 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:15:43.303785 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:15:43.303785 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:15:43.303785 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:15:43.303785 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:15:43.303785 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:15:43.303785 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:15:43.303785 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:15:43.303785 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJVqFFod5GVyVA4k_BmIkD8Xi-oJdxd-QAhnIPS_zs5oaNtfZ478W39zApcf2E-hS7rg1yXrSgbdew57pFpG4-JPU4Nh4jloZuNd0DLzrLmv2iv4pZbDwF1cn2V0sSNfSQhykEvL4lYdz0SFaN81RNn5aZUx6AmpWTJlr0JtI2LcZUk Oct 23 01:15:43.303785 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:15:43.303785 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:15:43.303785 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:15:43.303785 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:15:43.303785 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:15:43.303785 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:15:43.303785 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 356a4b3819db457fb5caf68ded0212fa Oct 23 01:15:43.303785 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-LiveMigrationNegativeTest-653778629 Oct 23 01:15:43.303785 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:15:43.303785 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:15:43.305576 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/356a4b3819db457fb5caf68ded0212fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_356a4b3819db457fb5caf68ded0212fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/356a4b3819db457fb5caf68ded0212fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/356a4b3819db457fb5caf68ded0212fa"}]}] Oct 23 01:15:43.305576 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-LiveMigrationNegativeTest-653778629 Oct 23 01:15:43.305576 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 356a4b3819db457fb5caf68ded0212fa Oct 23 01:15:43.305576 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-653778629 Oct 23 01:15:43.305576 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-LiveMigrationNegativeTest-653778629-project Oct 23 01:15:43.305576 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:15:43.305576 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:15:43.305576 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 80703c3d1dae419c9fd5ca103f3c28bf Oct 23 01:15:43.305576 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-LiveMigrationNegativeTest-653778629-project Oct 23 01:15:43.305576 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:15:43.305576 n-d-master-1 devstack@n-api.service[120945]: exception: Instance de212c9c-e0e0-471f-8a01-5d180ac28d07 could not be found. Oct 23 01:15:43.305576 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'de212c9c-e0e0-471f-8a01-5d180ac28d07'} Oct 23 01:15:43.306596 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:15:43.306596 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:15:43.306596 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:15:43.306596 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:15:43.306596 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:15:43.306596 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:15:43.306596 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:15:43.306596 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:15:43.306596 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:15:43.306596 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:15:43.306596 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de212c9c-e0e0-471f-8a01-5d180ac28d07 could not be found. Oct 23 01:15:43.306596 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:15:43.306596 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:15:43.306596 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:15:43.306596 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:15:43.306596 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:15:43.306596 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:15:43.306596 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:15:43.306596 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:15:43.306596 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:15:43.308218 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:15:43.308218 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:15:43.308218 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:15:43.308218 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:15:43.308218 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:15:43.308218 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:15:43.308218 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:15:43.308218 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de212c9c-e0e0-471f-8a01-5d180ac28d07 could not be found. Oct 23 01:15:43.308218 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:15:43.308218 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:15:43.308218 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:15:43.308218 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:15:43.308218 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:15:43.308218 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:15:43.308218 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:15:43.308218 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:15:43.308218 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de212c9c-e0e0-471f-8a01-5d180ac28d07 could not be found. Oct 23 01:15:43.308218 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:15:43.311675 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4f51e866-4bef-49aa-a6bf-2604c0ac02d8 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Returning 404 to user: Instance de212c9c-e0e0-471f-8a01-5d180ac28d07 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:15:43.316083 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4f51e866-4bef-49aa-a6bf-2604c0ac02d8 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] 10.222.0.42 "GET /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07" status: 404 len: 111 microversion: 2.1 time: 0.328397 Oct 23 01:15:43.316083 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 762/1439] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:42 2022] GET /compute/v2.1/servers/de212c9c-e0e0-471f-8a01-5d180ac28d07 => generated 111 bytes in 331 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:15:43.461676 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a32219a2-a3c2-4ac6-89a7-142e47075618 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:43.480542 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a32219a2-a3c2-4ac6-89a7-142e47075618 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 200 len: 1717 microversion: 2.1 time: 0.316052 Oct 23 01:15:43.482131 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 678/1440] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:43 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 1717 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:43.498874 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3dd6a9cc-6fc1-48ac-a84b-ea3c07afdcb5 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:43.500049 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3dd6a9cc-6fc1-48ac-a84b-ea3c07afdcb5 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] [instance: e0769a09-da3a-422f-a7a8-27edf4a2e209] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:43.512318 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8ea4f746-c586-425b-a6e6-ad4fbdbdcfee tempest-FloatingIPsTestJSON-1569689524 tempest-FloatingIPsTestJSON-1569689524-project] Action: 'create', calling method: .version_select at 0x7f5cc1ec73a0>, body: {"pool": null} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:15:43.513721 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3dd6a9cc-6fc1-48ac-a84b-ea3c07afdcb5 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:43.514848 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3dd6a9cc-6fc1-48ac-a84b-ea3c07afdcb5 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:43.515301 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3dd6a9cc-6fc1-48ac-a84b-ea3c07afdcb5 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:43.519483 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3dd6a9cc-6fc1-48ac-a84b-ea3c07afdcb5 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:43.519483 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3dd6a9cc-6fc1-48ac-a84b-ea3c07afdcb5 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:43.519483 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3dd6a9cc-6fc1-48ac-a84b-ea3c07afdcb5 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:43.560884 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3dd6a9cc-6fc1-48ac-a84b-ea3c07afdcb5 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] [instance: e0769a09-da3a-422f-a7a8-27edf4a2e209] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:15:43.939373 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3dd6a9cc-6fc1-48ac-a84b-ea3c07afdcb5 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e0769a09-da3a-422f-a7a8-27edf4a2e209" status: 204 len: 0 microversion: 2.1 time: 0.455319 Oct 23 01:15:43.941532 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 679/1441] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:15:43 2022] DELETE /compute/v2.1/servers/e0769a09-da3a-422f-a7a8-27edf4a2e209 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:15:43.950523 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4425f863-1893-42a6-9d12-7800297a73c0 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:43.951235 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4425f863-1893-42a6-9d12-7800297a73c0 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 8025dc46-71af-4fec-8f54-5ae9e92cc31f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:43.958463 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4425f863-1893-42a6-9d12-7800297a73c0 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:43.959201 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4425f863-1893-42a6-9d12-7800297a73c0 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:43.959844 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4425f863-1893-42a6-9d12-7800297a73c0 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:43.961262 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4425f863-1893-42a6-9d12-7800297a73c0 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:43.961871 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4425f863-1893-42a6-9d12-7800297a73c0 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:43.962483 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4425f863-1893-42a6-9d12-7800297a73c0 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:44.196972 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4425f863-1893-42a6-9d12-7800297a73c0 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:44.207088 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4425f863-1893-42a6-9d12-7800297a73c0 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f" status: 200 len: 1468 microversion: 2.1 time: 0.263683 Oct 23 01:15:44.208080 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 680/1442] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:43 2022] GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f => generated 1468 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:44.213887 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5faffce6-9b8b-412f-a4c0-798ac2bd4ac2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:44.214841 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5faffce6-9b8b-412f-a4c0-798ac2bd4ac2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:44.221875 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5faffce6-9b8b-412f-a4c0-798ac2bd4ac2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:44.224360 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5faffce6-9b8b-412f-a4c0-798ac2bd4ac2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:44.224360 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5faffce6-9b8b-412f-a4c0-798ac2bd4ac2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:44.224360 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5faffce6-9b8b-412f-a4c0-798ac2bd4ac2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:44.225833 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5faffce6-9b8b-412f-a4c0-798ac2bd4ac2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:44.226672 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5faffce6-9b8b-412f-a4c0-798ac2bd4ac2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:44.887865 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5faffce6-9b8b-412f-a4c0-798ac2bd4ac2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:44.900779 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5faffce6-9b8b-412f-a4c0-798ac2bd4ac2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:44.903415 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5faffce6-9b8b-412f-a4c0-798ac2bd4ac2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:44.919672 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5faffce6-9b8b-412f-a4c0-798ac2bd4ac2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7" status: 200 len: 1412 microversion: 2.25 time: 0.705564 Oct 23 01:15:44.938564 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 681/1443] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:15:44 2022] GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7 => generated 1412 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:15:44.945108 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1d378cec-71f3-4339-8de5-5a4a012ee716 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:44.946983 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1d378cec-71f3-4339-8de5-5a4a012ee716 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] [instance: e0769a09-da3a-422f-a7a8-27edf4a2e209] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:44.958390 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1d378cec-71f3-4339-8de5-5a4a012ee716 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:44.959172 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1d378cec-71f3-4339-8de5-5a4a012ee716 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:44.960436 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1d378cec-71f3-4339-8de5-5a4a012ee716 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:44.961665 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1d378cec-71f3-4339-8de5-5a4a012ee716 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:44.962366 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1d378cec-71f3-4339-8de5-5a4a012ee716 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:44.962990 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1d378cec-71f3-4339-8de5-5a4a012ee716 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:45.437852 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1d378cec-71f3-4339-8de5-5a4a012ee716 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80703c3d1dae419c9fd5ca103f3c28bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356a4b3819db457fb5caf68ded0212fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:45.458636 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1d378cec-71f3-4339-8de5-5a4a012ee716 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] 10.222.0.42 "GET /compute/v2.1/servers/e0769a09-da3a-422f-a7a8-27edf4a2e209" status: 200 len: 1474 microversion: 2.1 time: 0.505747 Oct 23 01:15:45.459329 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 682/1444] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:44 2022] GET /compute/v2.1/servers/e0769a09-da3a-422f-a7a8-27edf4a2e209 => generated 1474 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:45.464060 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7e7e879c-224e-429f-be32-8ee9084419ad tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:45.464762 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7e7e879c-224e-429f-be32-8ee9084419ad tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: fb12a9d1-a506-4e57-b93e-62cbe2ac4450] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:45.481289 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e7e879c-224e-429f-be32-8ee9084419ad tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:45.481289 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e7e879c-224e-429f-be32-8ee9084419ad tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:45.481289 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e7e879c-224e-429f-be32-8ee9084419ad tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:45.481289 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e7e879c-224e-429f-be32-8ee9084419ad tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:45.481623 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e7e879c-224e-429f-be32-8ee9084419ad tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:45.481623 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e7e879c-224e-429f-be32-8ee9084419ad tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:45.558599 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7e7e879c-224e-429f-be32-8ee9084419ad tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:45.572849 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7e7e879c-224e-429f-be32-8ee9084419ad tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/fb12a9d1-a506-4e57-b93e-62cbe2ac4450" status: 200 len: 1288 microversion: 2.1 time: 0.108288 Oct 23 01:15:45.573816 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 683/1445] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:45 2022] GET /compute/v2.1/servers/fb12a9d1-a506-4e57-b93e-62cbe2ac4450 => generated 1288 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:45.589921 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3b3d4fef-1db4-40b2-aaf1-973147a1022b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:45.590955 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3b3d4fef-1db4-40b2-aaf1-973147a1022b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 291a0671-7bab-404a-b836-95fb7acfd1dd] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:45.598063 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3b3d4fef-1db4-40b2-aaf1-973147a1022b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:45.598841 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3b3d4fef-1db4-40b2-aaf1-973147a1022b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:45.599586 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3b3d4fef-1db4-40b2-aaf1-973147a1022b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:45.600598 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3b3d4fef-1db4-40b2-aaf1-973147a1022b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:45.601284 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3b3d4fef-1db4-40b2-aaf1-973147a1022b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:45.601917 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3b3d4fef-1db4-40b2-aaf1-973147a1022b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:45.949203 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3b3d4fef-1db4-40b2-aaf1-973147a1022b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:45.959168 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3b3d4fef-1db4-40b2-aaf1-973147a1022b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd" status: 200 len: 1528 microversion: 2.1 time: 0.383818 Oct 23 01:15:45.999342 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 684/1446] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:45 2022] GET /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd => generated 1528 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:46.125546 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a2373523-f203-4b49-8bef-aaa892d00722 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-850782423", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "8972a9b2-fd35-47e0-9140-aed5efe80dbb"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:15:46.228922 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-a2373523-f203-4b49-8bef-aaa892d00722 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] validate_networks() for [('8972a9b2-fd35-47e0-9140-aed5efe80dbb', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:15:46.466508 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:15:47.377686 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=30 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:15:47.402540 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8ea4f746-c586-425b-a6e6-ad4fbdbdcfee tempest-FloatingIPsTestJSON-1569689524 tempest-FloatingIPsTestJSON-1569689524-project] 10.222.0.42 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.086345 Oct 23 01:15:47.403779 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 763/1447] 10.222.0.42 () {60 vars in 1170 bytes} [Sun Oct 23 01:15:43 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4088 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:15:47.415218 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0ffa3257-de6d-4ede-b85d-be427b2832b9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:47.415856 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0ffa3257-de6d-4ede-b85d-be427b2832b9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:47.461785 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0ffa3257-de6d-4ede-b85d-be427b2832b9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:47.465782 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0ffa3257-de6d-4ede-b85d-be427b2832b9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:47.468103 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0ffa3257-de6d-4ede-b85d-be427b2832b9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:47.470581 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0ffa3257-de6d-4ede-b85d-be427b2832b9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:47.471227 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0ffa3257-de6d-4ede-b85d-be427b2832b9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:47.473440 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0ffa3257-de6d-4ede-b85d-be427b2832b9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:47.993132 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0ffa3257-de6d-4ede-b85d-be427b2832b9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:48.009292 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0ffa3257-de6d-4ede-b85d-be427b2832b9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 200 len: 1717 microversion: 2.1 time: 0.598799 Oct 23 01:15:48.010177 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 764/1448] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:47 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 1717 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:48.041083 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-006220e9-2d24-4b9f-b6e9-c52d510b81b7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:48.046705 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-006220e9-2d24-4b9f-b6e9-c52d510b81b7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 8025dc46-71af-4fec-8f54-5ae9e92cc31f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:48.063746 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:15:48.086346 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-006220e9-2d24-4b9f-b6e9-c52d510b81b7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:48.087318 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-006220e9-2d24-4b9f-b6e9-c52d510b81b7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:48.087982 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-006220e9-2d24-4b9f-b6e9-c52d510b81b7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:48.088911 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-006220e9-2d24-4b9f-b6e9-c52d510b81b7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:48.089601 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-006220e9-2d24-4b9f-b6e9-c52d510b81b7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:48.090422 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-006220e9-2d24-4b9f-b6e9-c52d510b81b7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:48.297864 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-a2373523-f203-4b49-8bef-aaa892d00722 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:15:48.298492 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-a2373523-f203-4b49-8bef-aaa892d00722 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:15:48.302143 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-a2373523-f203-4b49-8bef-aaa892d00722 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:15:48.304190 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-a2373523-f203-4b49-8bef-aaa892d00722 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:15:48.304884 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-a2373523-f203-4b49-8bef-aaa892d00722 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:15:48.325959 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a2373523-f203-4b49-8bef-aaa892d00722 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:48.330248 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a2373523-f203-4b49-8bef-aaa892d00722 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:48.331115 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a2373523-f203-4b49-8bef-aaa892d00722 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:48.332195 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a2373523-f203-4b49-8bef-aaa892d00722 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:48.332922 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a2373523-f203-4b49-8bef-aaa892d00722 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:48.334201 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a2373523-f203-4b49-8bef-aaa892d00722 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:48.387576 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-a2373523-f203-4b49-8bef-aaa892d00722 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Getting quotas for project 891f5b08deb441c0b0a6bff7b9ddb953. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:15:48.398677 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-a2373523-f203-4b49-8bef-aaa892d00722 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Getting quotas for user 9932e28d1de240f5a3b0dab50df11f31 and project 891f5b08deb441c0b0a6bff7b9ddb953. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:15:48.415843 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a2373523-f203-4b49-8bef-aaa892d00722 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:15:48.423175 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a2373523-f203-4b49-8bef-aaa892d00722 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] [instance: 881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:15:48.587792 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a2373523-f203-4b49-8bef-aaa892d00722 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.588407 Oct 23 01:15:48.596078 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 685/1449] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:15:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:15:48.603055 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f4c3c858-9e04-49c1-a140-17c2f5e2b5ca tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:48.603892 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f4c3c858-9e04-49c1-a140-17c2f5e2b5ca tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:48.611293 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4c3c858-9e04-49c1-a140-17c2f5e2b5ca tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:48.612029 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4c3c858-9e04-49c1-a140-17c2f5e2b5ca tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:48.612636 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4c3c858-9e04-49c1-a140-17c2f5e2b5ca tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:48.613759 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4c3c858-9e04-49c1-a140-17c2f5e2b5ca tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:48.614418 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4c3c858-9e04-49c1-a140-17c2f5e2b5ca tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:48.615012 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4c3c858-9e04-49c1-a140-17c2f5e2b5ca tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:48.967334 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-006220e9-2d24-4b9f-b6e9-c52d510b81b7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:48.974142 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:15:48.996446 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-006220e9-2d24-4b9f-b6e9-c52d510b81b7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f" status: 200 len: 1468 microversion: 2.1 time: 0.983635 Oct 23 01:15:49.034879 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 765/1450] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:48 2022] GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f => generated 1468 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:49.067891 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cff23032-f258-468d-b0ea-b48cdc61bb7e tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:49.068991 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cff23032-f258-468d-b0ea-b48cdc61bb7e tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] [instance: e0769a09-da3a-422f-a7a8-27edf4a2e209] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:49.083598 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cff23032-f258-468d-b0ea-b48cdc61bb7e tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:49.087137 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cff23032-f258-468d-b0ea-b48cdc61bb7e tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:49.087493 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cff23032-f258-468d-b0ea-b48cdc61bb7e tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:49.088424 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cff23032-f258-468d-b0ea-b48cdc61bb7e tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:49.090711 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cff23032-f258-468d-b0ea-b48cdc61bb7e tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:49.091391 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cff23032-f258-468d-b0ea-b48cdc61bb7e tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:49.175479 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cff23032-f258-468d-b0ea-b48cdc61bb7e tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:49.177362 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cff23032-f258-468d-b0ea-b48cdc61bb7e tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:49.180124 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cff23032-f258-468d-b0ea-b48cdc61bb7e tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:49.180859 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-cff23032-f258-468d-b0ea-b48cdc61bb7e tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lazy-loading 'fault' on Instance uuid e0769a09-da3a-422f-a7a8-27edf4a2e209 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:15:49.345944 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f4c3c858-9e04-49c1-a140-17c2f5e2b5ca tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:49.354059 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cff23032-f258-468d-b0ea-b48cdc61bb7e tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80703c3d1dae419c9fd5ca103f3c28bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356a4b3819db457fb5caf68ded0212fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:49.358024 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f4c3c858-9e04-49c1-a140-17c2f5e2b5ca tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:49.363340 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f4c3c858-9e04-49c1-a140-17c2f5e2b5ca tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:49.368330 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f4c3c858-9e04-49c1-a140-17c2f5e2b5ca tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7" status: 200 len: 1609 microversion: 2.25 time: 0.770708 Oct 23 01:15:49.368952 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 686/1451] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:15:48 2022] GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7 => generated 1609 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:15:49.372549 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cff23032-f258-468d-b0ea-b48cdc61bb7e tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] 10.222.0.42 "GET /compute/v2.1/servers/e0769a09-da3a-422f-a7a8-27edf4a2e209" status: 200 len: 1308 microversion: 2.1 time: 0.330644 Oct 23 01:15:49.386990 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 766/1452] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:49 2022] GET /compute/v2.1/servers/e0769a09-da3a-422f-a7a8-27edf4a2e209 => generated 1308 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:49.386990 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cf656ccd-68d6-4bab-af94-78cf544ad8f0 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:49.386990 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cf656ccd-68d6-4bab-af94-78cf544ad8f0 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: fb12a9d1-a506-4e57-b93e-62cbe2ac4450] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:49.420854 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf656ccd-68d6-4bab-af94-78cf544ad8f0 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:49.422663 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf656ccd-68d6-4bab-af94-78cf544ad8f0 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:49.423191 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf656ccd-68d6-4bab-af94-78cf544ad8f0 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:49.423969 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf656ccd-68d6-4bab-af94-78cf544ad8f0 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:49.429288 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf656ccd-68d6-4bab-af94-78cf544ad8f0 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:49.429832 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf656ccd-68d6-4bab-af94-78cf544ad8f0 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:49.520079 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-33bfadb5-b947-4cd3-9aca-e00a42cbaee9 req-05defac8-9a85-4eb6-b67b-1d49f917a2c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "291a0671-7bab-404a-b836-95fb7acfd1dd", "name": "network-vif-deleted", "tag": "35757a24-1cdf-43a8-b909-50d039effa1c"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:15:49.552711 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-33bfadb5-b947-4cd3-9aca-e00a42cbaee9 req-05defac8-9a85-4eb6-b67b-1d49f917a2c6 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:49.562053 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-33bfadb5-b947-4cd3-9aca-e00a42cbaee9 req-05defac8-9a85-4eb6-b67b-1d49f917a2c6 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:49.566163 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-33bfadb5-b947-4cd3-9aca-e00a42cbaee9 req-05defac8-9a85-4eb6-b67b-1d49f917a2c6 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:49.590375 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-33bfadb5-b947-4cd3-9aca-e00a42cbaee9 req-05defac8-9a85-4eb6-b67b-1d49f917a2c6 service nova] Creating event network-vif-deleted:35757a24-1cdf-43a8-b909-50d039effa1c for instance 291a0671-7bab-404a-b836-95fb7acfd1dd on n-h2-master-1 Oct 23 01:15:49.601283 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-33bfadb5-b947-4cd3-9aca-e00a42cbaee9 req-05defac8-9a85-4eb6-b67b-1d49f917a2c6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.229841 Oct 23 01:15:49.601927 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 687/1453] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:15:49.618563 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bcc00b38-418e-4682-a1e1-d13557f17c89 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:49.619972 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bcc00b38-418e-4682-a1e1-d13557f17c89 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 291a0671-7bab-404a-b836-95fb7acfd1dd] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:49.630472 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bcc00b38-418e-4682-a1e1-d13557f17c89 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:49.631653 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bcc00b38-418e-4682-a1e1-d13557f17c89 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:49.632339 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bcc00b38-418e-4682-a1e1-d13557f17c89 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:49.633344 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bcc00b38-418e-4682-a1e1-d13557f17c89 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:49.635001 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bcc00b38-418e-4682-a1e1-d13557f17c89 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:49.635774 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bcc00b38-418e-4682-a1e1-d13557f17c89 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:49.655742 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-bcc00b38-418e-4682-a1e1-d13557f17c89 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] HTTP exception thrown: Instance 291a0671-7bab-404a-b836-95fb7acfd1dd could not be found. Oct 23 01:15:49.666061 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bcc00b38-418e-4682-a1e1-d13557f17c89 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Request method failure captured: Oct 23 01:15:49.666061 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd HTTP/1.1 Oct 23 01:15:49.666061 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:15:49.666061 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:15:49.666061 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:15:49.666061 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:15:49.666061 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:15:49.666061 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:15:49.666061 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:15:49.666061 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:15:49.666061 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJWaABlg9aZPPmiKYOFyjnW3cUDNfMTW-9Ow-Ga99e9rhT_Xz0fOPaBTxk-ZvoWH3eiZ84RoqOaVKmH_NPvl5JjsEC9A2dnRRYDDEs3eUATgMIXjceNensPNpeVu874ElZedsjKlwKXnfqakqBoob0ap94r3bfJNgcmUxWbrsNVh5-k Oct 23 01:15:49.666061 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:15:49.666061 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:15:49.666061 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:15:49.666061 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:15:49.666061 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:15:49.666061 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:15:49.666061 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 1aa3395c4af3435eaa3a0f49e19167fe Oct 23 01:15:49.666061 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-421844011 Oct 23 01:15:49.666061 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:15:49.666061 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:15:49.671621 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1aa3395c4af3435eaa3a0f49e19167fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1aa3395c4af3435eaa3a0f49e19167fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1aa3395c4af3435eaa3a0f49e19167fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1aa3395c4af3435eaa3a0f49e19167fe"}]}] Oct 23 01:15:49.671621 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-421844011 Oct 23 01:15:49.671621 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 1aa3395c4af3435eaa3a0f49e19167fe Oct 23 01:15:49.671621 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-421844011 Oct 23 01:15:49.671621 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ImagesOneServerNegativeTestJSON-421844011-project Oct 23 01:15:49.671621 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:15:49.671621 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:15:49.671621 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 690143905857471f949b1f4454ad2139 Oct 23 01:15:49.671621 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-421844011-project Oct 23 01:15:49.671621 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:15:49.671621 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 291a0671-7bab-404a-b836-95fb7acfd1dd could not be found. Oct 23 01:15:49.671621 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '291a0671-7bab-404a-b836-95fb7acfd1dd'} Oct 23 01:15:49.672829 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:15:49.672829 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:15:49.672829 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:15:49.672829 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:15:49.672829 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:15:49.672829 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:15:49.672829 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:15:49.672829 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:15:49.672829 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:15:49.672829 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:15:49.672829 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 291a0671-7bab-404a-b836-95fb7acfd1dd could not be found. Oct 23 01:15:49.672829 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:15:49.672829 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:15:49.672829 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:15:49.672829 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:15:49.672829 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:15:49.672829 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:15:49.672829 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:15:49.672829 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:15:49.672829 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:15:49.674418 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:15:49.674418 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:15:49.674418 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:15:49.674418 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:15:49.674418 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:15:49.674418 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:15:49.674418 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:15:49.674418 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 291a0671-7bab-404a-b836-95fb7acfd1dd could not be found. Oct 23 01:15:49.674418 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:15:49.674418 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:15:49.674418 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:15:49.674418 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:15:49.674418 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:15:49.674418 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:15:49.674418 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:15:49.674418 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:15:49.674418 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 291a0671-7bab-404a-b836-95fb7acfd1dd could not be found. Oct 23 01:15:49.674418 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:15:49.675734 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bcc00b38-418e-4682-a1e1-d13557f17c89 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Returning 404 to user: Instance 291a0671-7bab-404a-b836-95fb7acfd1dd could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:15:49.675734 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bcc00b38-418e-4682-a1e1-d13557f17c89 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd" status: 404 len: 111 microversion: 2.1 time: 0.063213 Oct 23 01:15:49.675734 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 688/1454] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:49 2022] GET /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:15:49.688543 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b7e705c5-98c2-4fc1-839e-d3f0b7a598a7 tempest-FloatingIPsTestJSON-1569689524 tempest-FloatingIPsTestJSON-1569689524-project] Calling method '.version_select at 0x7f5cc19feee0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:50.226113 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b7e705c5-98c2-4fc1-839e-d3f0b7a598a7 tempest-FloatingIPsTestJSON-1569689524 tempest-FloatingIPsTestJSON-1569689524-project] 10.222.0.42 "GET /compute/v2.1/os-floating-ips/0d954526-ea46-4e6b-8eed-11b7211f6c37" status: 200 len: 142 microversion: 2.1 time: 0.555935 Oct 23 01:15:50.226898 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 689/1455] 10.222.0.42 () {58 vars in 1260 bytes} [Sun Oct 23 01:15:49 2022] GET /compute/v2.1/os-floating-ips/0d954526-ea46-4e6b-8eed-11b7211f6c37 => generated 142 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:15:50.234200 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-9b083e41-7058-492d-8496-b562573ef4a7 req-c2bfd48f-7170-4c37-bafc-c5601b8b40f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8025dc46-71af-4fec-8f54-5ae9e92cc31f", "name": "network-vif-unplugged", "status": "completed", "tag": "9dbeafb3-f8f6-45eb-993c-c817b00700d0"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:15:50.273690 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-9b083e41-7058-492d-8496-b562573ef4a7 req-c2bfd48f-7170-4c37-bafc-c5601b8b40f1 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:50.274243 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-9b083e41-7058-492d-8496-b562573ef4a7 req-c2bfd48f-7170-4c37-bafc-c5601b8b40f1 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:50.274678 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-9b083e41-7058-492d-8496-b562573ef4a7 req-c2bfd48f-7170-4c37-bafc-c5601b8b40f1 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:50.318185 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-9b083e41-7058-492d-8496-b562573ef4a7 req-c2bfd48f-7170-4c37-bafc-c5601b8b40f1 service nova] Creating event network-vif-unplugged:9dbeafb3-f8f6-45eb-993c-c817b00700d0 for instance 8025dc46-71af-4fec-8f54-5ae9e92cc31f on n-h2-master-1 Oct 23 01:15:50.325313 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cf656ccd-68d6-4bab-af94-78cf544ad8f0 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:50.332010 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [req-9b083e41-7058-492d-8496-b562573ef4a7 req-c2bfd48f-7170-4c37-bafc-c5601b8b40f1 service nova] Instance 8025dc46-71af-4fec-8f54-5ae9e92cc31f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120944) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 23 01:15:50.333386 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cf656ccd-68d6-4bab-af94-78cf544ad8f0 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/fb12a9d1-a506-4e57-b93e-62cbe2ac4450" status: 200 len: 1318 microversion: 2.1 time: 0.957325 Oct 23 01:15:50.333995 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 767/1456] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:49 2022] GET /compute/v2.1/servers/fb12a9d1-a506-4e57-b93e-62cbe2ac4450 => generated 1318 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:50.359214 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-9b083e41-7058-492d-8496-b562573ef4a7 req-c2bfd48f-7170-4c37-bafc-c5601b8b40f1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.130473 Oct 23 01:15:50.360128 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 690/1457] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:15:50.363747 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d4e6e878-032a-46c2-9ce5-706a540dcd76 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:50.364369 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d4e6e878-032a-46c2-9ce5-706a540dcd76 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] [instance: 881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:50.375044 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-0c728b8d-2186-4212-857b-d869f9258b96 req-e8cf7a74-a1ea-4a97-bb64-9f2b9ae48db9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0769a09-da3a-422f-a7a8-27edf4a2e209", "name": "network-vif-deleted", "tag": "3cdea381-33bb-4ddd-903c-55b03ef495ae"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:15:50.382113 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4e6e878-032a-46c2-9ce5-706a540dcd76 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:50.382751 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4e6e878-032a-46c2-9ce5-706a540dcd76 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:50.383048 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4e6e878-032a-46c2-9ce5-706a540dcd76 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:50.383844 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4e6e878-032a-46c2-9ce5-706a540dcd76 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:50.384476 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4e6e878-032a-46c2-9ce5-706a540dcd76 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:50.385069 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4e6e878-032a-46c2-9ce5-706a540dcd76 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:50.401333 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-0c728b8d-2186-4212-857b-d869f9258b96 req-e8cf7a74-a1ea-4a97-bb64-9f2b9ae48db9 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:50.401731 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-0c728b8d-2186-4212-857b-d869f9258b96 req-e8cf7a74-a1ea-4a97-bb64-9f2b9ae48db9 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:50.402198 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-0c728b8d-2186-4212-857b-d869f9258b96 req-e8cf7a74-a1ea-4a97-bb64-9f2b9ae48db9 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:50.435795 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-0c728b8d-2186-4212-857b-d869f9258b96 req-e8cf7a74-a1ea-4a97-bb64-9f2b9ae48db9 service nova] Creating event network-vif-deleted:3cdea381-33bb-4ddd-903c-55b03ef495ae for instance e0769a09-da3a-422f-a7a8-27edf4a2e209 on n-h1-master-1 Oct 23 01:15:50.450371 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-0c728b8d-2186-4212-857b-d869f9258b96 req-e8cf7a74-a1ea-4a97-bb64-9f2b9ae48db9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087414 Oct 23 01:15:50.452833 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 691/1458] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:15:50.460062 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fcd3ff07-e847-41ea-8ae8-7c81e8a57b14 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:50.460627 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fcd3ff07-e847-41ea-8ae8-7c81e8a57b14 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:50.476114 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fcd3ff07-e847-41ea-8ae8-7c81e8a57b14 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:50.476599 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fcd3ff07-e847-41ea-8ae8-7c81e8a57b14 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:50.479721 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fcd3ff07-e847-41ea-8ae8-7c81e8a57b14 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:50.482510 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fcd3ff07-e847-41ea-8ae8-7c81e8a57b14 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:50.482991 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fcd3ff07-e847-41ea-8ae8-7c81e8a57b14 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:50.483425 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fcd3ff07-e847-41ea-8ae8-7c81e8a57b14 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:50.690494 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d4e6e878-032a-46c2-9ce5-706a540dcd76 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932e28d1de240f5a3b0dab50df11f31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891f5b08deb441c0b0a6bff7b9ddb953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:50.701351 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d4e6e878-032a-46c2-9ce5-706a540dcd76 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] 10.222.0.42 "GET /compute/v2.1/servers/881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40" status: 200 len: 1227 microversion: 2.1 time: 0.345544 Oct 23 01:15:50.702440 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 768/1459] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:50 2022] GET /compute/v2.1/servers/881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40 => generated 1227 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:50.709956 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-abe15bd1-44e5-4c18-badd-588c84b4b67c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:50.721329 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-abe15bd1-44e5-4c18-badd-588c84b4b67c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:50.721329 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-abe15bd1-44e5-4c18-badd-588c84b4b67c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:50.721329 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-abe15bd1-44e5-4c18-badd-588c84b4b67c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:50.721329 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-abe15bd1-44e5-4c18-badd-588c84b4b67c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:50.721780 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-abe15bd1-44e5-4c18-badd-588c84b4b67c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:50.722496 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-abe15bd1-44e5-4c18-badd-588c84b4b67c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:50.723885 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-abe15bd1-44e5-4c18-badd-588c84b4b67c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:50.884195 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-abe15bd1-44e5-4c18-badd-588c84b4b67c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.179630 Oct 23 01:15:50.884831 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 769/1460] 10.222.0.42 () {60 vars in 1316 bytes} [Sun Oct 23 01:15:50 2022] GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7/os-interface => generated 285 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:15:50.902885 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e10eaef0-e682-4c52-94b5-73ebb194059d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Action: 'create', calling method: .version_select at 0x7f5cc2482af0>, body: {"keypair": {"name": "tempest-keypair-1090467130", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPE2RzBCB+yJFjRHdwTovREeOatk+2sDMeOxgBHoCS3IMG1AQlXI/KxC21qBUaU4uvzfbqloQLfqRRmQNVfIkn0K8LmNaQqnmB6sTK0hTln6Wkrtx9N8cxZyr+TS8FUvdA=="}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:15:50.935468 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-e10eaef0-e682-4c52-94b5-73ebb194059d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Getting quotas for project 1aa3395c4af3435eaa3a0f49e19167fe. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:15:50.962230 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-e10eaef0-e682-4c52-94b5-73ebb194059d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Getting quotas for user 690143905857471f949b1f4454ad2139 and project 1aa3395c4af3435eaa3a0f49e19167fe. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:15:51.004534 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fcd3ff07-e847-41ea-8ae8-7c81e8a57b14 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:51.015788 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fcd3ff07-e847-41ea-8ae8-7c81e8a57b14 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 200 len: 1717 microversion: 2.1 time: 0.561517 Oct 23 01:15:51.016402 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 692/1461] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:50 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 1717 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:51.031362 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a2d0a122-59f1-4978-ae2a-e3ec9305a665 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:51.032393 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a2d0a122-59f1-4978-ae2a-e3ec9305a665 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 8025dc46-71af-4fec-8f54-5ae9e92cc31f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:51.043845 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a2d0a122-59f1-4978-ae2a-e3ec9305a665 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:51.044509 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a2d0a122-59f1-4978-ae2a-e3ec9305a665 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:51.045468 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a2d0a122-59f1-4978-ae2a-e3ec9305a665 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:51.046213 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a2d0a122-59f1-4978-ae2a-e3ec9305a665 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:51.047097 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a2d0a122-59f1-4978-ae2a-e3ec9305a665 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:51.048598 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a2d0a122-59f1-4978-ae2a-e3ec9305a665 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:51.089723 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e10eaef0-e682-4c52-94b5-73ebb194059d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.203656 Oct 23 01:15:51.090761 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 770/1462] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 01:15:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:15:51.099693 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-21b0839a-527e-4fd8-9662-ca6186315635 tempest-FloatingIPsTestJSON-1569689524 tempest-FloatingIPsTestJSON-1569689524-project] Calling method '.version_select at 0x7f5cc1f00dc0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:51.894963 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a2d0a122-59f1-4978-ae2a-e3ec9305a665 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:51.905906 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a2d0a122-59f1-4978-ae2a-e3ec9305a665 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f" status: 200 len: 1534 microversion: 2.1 time: 0.885751 Oct 23 01:15:51.922699 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 693/1463] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:51 2022] GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f => generated 1534 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:51.928658 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-15466b0e-2d89-4985-8a9c-3de09bfec019 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:51.929360 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-15466b0e-2d89-4985-8a9c-3de09bfec019 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] [instance: e0769a09-da3a-422f-a7a8-27edf4a2e209] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:51.936252 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15466b0e-2d89-4985-8a9c-3de09bfec019 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:51.937000 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15466b0e-2d89-4985-8a9c-3de09bfec019 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:51.937603 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15466b0e-2d89-4985-8a9c-3de09bfec019 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:51.938506 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15466b0e-2d89-4985-8a9c-3de09bfec019 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:51.938966 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15466b0e-2d89-4985-8a9c-3de09bfec019 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:51.939384 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15466b0e-2d89-4985-8a9c-3de09bfec019 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:51.946996 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:15:51.966323 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-15466b0e-2d89-4985-8a9c-3de09bfec019 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] HTTP exception thrown: Instance e0769a09-da3a-422f-a7a8-27edf4a2e209 could not be found. Oct 23 01:15:51.969719 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-15466b0e-2d89-4985-8a9c-3de09bfec019 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Request method failure captured: Oct 23 01:15:51.969719 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/e0769a09-da3a-422f-a7a8-27edf4a2e209 HTTP/1.1 Oct 23 01:15:51.969719 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:15:51.969719 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:15:51.969719 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:15:51.969719 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:15:51.969719 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:15:51.969719 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:15:51.969719 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:15:51.969719 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:15:51.969719 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJVqFFod5GVyVA4k_BmIkD8Xi-oJdxd-QAhnIPS_zs5oaNtfZ478W39zApcf2E-hS7rg1yXrSgbdew57pFpG4-JPU4Nh4jloZuNd0DLzrLmv2iv4pZbDwF1cn2V0sSNfSQhykEvL4lYdz0SFaN81RNn5aZUx6AmpWTJlr0JtI2LcZUk Oct 23 01:15:51.969719 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:15:51.969719 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:15:51.969719 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:15:51.969719 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:15:51.969719 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:15:51.969719 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:15:51.969719 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 356a4b3819db457fb5caf68ded0212fa Oct 23 01:15:51.969719 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-LiveMigrationNegativeTest-653778629 Oct 23 01:15:51.969719 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:15:51.969719 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:15:51.971182 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/356a4b3819db457fb5caf68ded0212fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_356a4b3819db457fb5caf68ded0212fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/356a4b3819db457fb5caf68ded0212fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/356a4b3819db457fb5caf68ded0212fa"}]}] Oct 23 01:15:51.971182 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-LiveMigrationNegativeTest-653778629 Oct 23 01:15:51.971182 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 356a4b3819db457fb5caf68ded0212fa Oct 23 01:15:51.971182 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-653778629 Oct 23 01:15:51.971182 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-LiveMigrationNegativeTest-653778629-project Oct 23 01:15:51.971182 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:15:51.971182 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:15:51.971182 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 80703c3d1dae419c9fd5ca103f3c28bf Oct 23 01:15:51.971182 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-LiveMigrationNegativeTest-653778629-project Oct 23 01:15:51.971182 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:15:51.971182 n-d-master-1 devstack@n-api.service[120944]: exception: Instance e0769a09-da3a-422f-a7a8-27edf4a2e209 could not be found. Oct 23 01:15:51.971182 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'e0769a09-da3a-422f-a7a8-27edf4a2e209'} Oct 23 01:15:51.971996 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:15:51.971996 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:15:51.971996 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:15:51.971996 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:15:51.971996 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:15:51.971996 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:15:51.971996 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:15:51.971996 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:15:51.971996 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:15:51.971996 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:15:51.971996 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0769a09-da3a-422f-a7a8-27edf4a2e209 could not be found. Oct 23 01:15:51.971996 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:15:51.971996 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:15:51.971996 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:15:51.971996 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:15:51.971996 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:15:51.971996 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:15:51.971996 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:15:51.971996 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:15:51.971996 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:15:51.973947 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:15:51.973947 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:15:51.973947 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:15:51.973947 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:15:51.973947 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:15:51.973947 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:15:51.973947 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:15:51.973947 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0769a09-da3a-422f-a7a8-27edf4a2e209 could not be found. Oct 23 01:15:51.973947 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:15:51.973947 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:15:51.973947 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:15:51.973947 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:15:51.973947 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:15:51.973947 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:15:51.973947 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:15:51.973947 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:15:51.973947 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0769a09-da3a-422f-a7a8-27edf4a2e209 could not be found. Oct 23 01:15:51.973947 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:15:51.980980 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-15466b0e-2d89-4985-8a9c-3de09bfec019 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] Returning 404 to user: Instance e0769a09-da3a-422f-a7a8-27edf4a2e209 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:15:51.980980 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-15466b0e-2d89-4985-8a9c-3de09bfec019 tempest-LiveMigrationNegativeTest-653778629 tempest-LiveMigrationNegativeTest-653778629-project] 10.222.0.42 "GET /compute/v2.1/servers/e0769a09-da3a-422f-a7a8-27edf4a2e209" status: 404 len: 111 microversion: 2.1 time: 0.048197 Oct 23 01:15:51.980980 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 694/1464] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:51 2022] GET /compute/v2.1/servers/e0769a09-da3a-422f-a7a8-27edf4a2e209 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:15:51.988959 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-36cb18f1-493b-4c65-b903-4c3624a52c76 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:51.990199 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-36cb18f1-493b-4c65-b903-4c3624a52c76 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: fb12a9d1-a506-4e57-b93e-62cbe2ac4450] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:52.003719 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-21b0839a-527e-4fd8-9662-ca6186315635 tempest-FloatingIPsTestJSON-1569689524 tempest-FloatingIPsTestJSON-1569689524-project] 10.222.0.42 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.910815 Oct 23 01:15:52.004923 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36cb18f1-493b-4c65-b903-4c3624a52c76 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:52.005431 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36cb18f1-493b-4c65-b903-4c3624a52c76 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:52.005884 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36cb18f1-493b-4c65-b903-4c3624a52c76 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:52.007209 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36cb18f1-493b-4c65-b903-4c3624a52c76 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:52.007671 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36cb18f1-493b-4c65-b903-4c3624a52c76 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:52.008300 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36cb18f1-493b-4c65-b903-4c3624a52c76 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:52.010895 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 771/1465] 10.222.0.42 () {58 vars in 1149 bytes} [Sun Oct 23 01:15:51 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:15:52.017950 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e772a75a-eb7c-41aa-9e63-05b284bded8a tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:52.018595 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e772a75a-eb7c-41aa-9e63-05b284bded8a tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] [instance: 881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:52.027793 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e772a75a-eb7c-41aa-9e63-05b284bded8a tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:52.028281 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e772a75a-eb7c-41aa-9e63-05b284bded8a tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:52.028938 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e772a75a-eb7c-41aa-9e63-05b284bded8a tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:52.030357 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e772a75a-eb7c-41aa-9e63-05b284bded8a tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:52.030879 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e772a75a-eb7c-41aa-9e63-05b284bded8a tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:52.031305 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e772a75a-eb7c-41aa-9e63-05b284bded8a tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:52.233797 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e772a75a-eb7c-41aa-9e63-05b284bded8a tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932e28d1de240f5a3b0dab50df11f31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891f5b08deb441c0b0a6bff7b9ddb953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:52.250734 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e772a75a-eb7c-41aa-9e63-05b284bded8a tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] 10.222.0.42 "GET /compute/v2.1/servers/881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40" status: 200 len: 1275 microversion: 2.1 time: 0.237756 Oct 23 01:15:52.271454 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 772/1466] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:52 2022] GET /compute/v2.1/servers/881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40 => generated 1275 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:52.277437 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-274ef087-a098-4ba6-9276-0b21362a0866 tempest-FloatingIPsTestJSON-1569689524 tempest-FloatingIPsTestJSON-1569689524-project] Calling method '.version_select at 0x7f5cc1f00a60>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:52.555243 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-36cb18f1-493b-4c65-b903-4c3624a52c76 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:52.563794 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-36cb18f1-493b-4c65-b903-4c3624a52c76 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/fb12a9d1-a506-4e57-b93e-62cbe2ac4450" status: 200 len: 1318 microversion: 2.1 time: 0.583970 Oct 23 01:15:52.564893 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 695/1467] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:51 2022] GET /compute/v2.1/servers/fb12a9d1-a506-4e57-b93e-62cbe2ac4450 => generated 1318 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:52.570699 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6d2c8b23-791c-486a-995f-54a8a83bc2de tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:52.571419 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6d2c8b23-791c-486a-995f-54a8a83bc2de tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:52.577696 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6d2c8b23-791c-486a-995f-54a8a83bc2de tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:52.578291 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6d2c8b23-791c-486a-995f-54a8a83bc2de tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:52.578735 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6d2c8b23-791c-486a-995f-54a8a83bc2de tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:52.579588 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6d2c8b23-791c-486a-995f-54a8a83bc2de tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:52.580048 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6d2c8b23-791c-486a-995f-54a8a83bc2de tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:52.580656 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6d2c8b23-791c-486a-995f-54a8a83bc2de tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:53.109179 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6d2c8b23-791c-486a-995f-54a8a83bc2de tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:53.118191 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6d2c8b23-791c-486a-995f-54a8a83bc2de tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 200 len: 1717 microversion: 2.1 time: 0.552041 Oct 23 01:15:53.118782 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 696/1468] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:52 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 1717 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:53.136328 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-234f6504-494e-407c-9383-3a33fd685e4f req-75d86e04-ba22-4193-8024-4ae9b3feab76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "024cb100-29e3-402c-b634-256694a63335", "tag": "3a32c5da-961b-4d6a-ae78-57f2e74c8ec3"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:15:53.153644 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-234f6504-494e-407c-9383-3a33fd685e4f req-75d86e04-ba22-4193-8024-4ae9b3feab76 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:53.154161 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-234f6504-494e-407c-9383-3a33fd685e4f req-75d86e04-ba22-4193-8024-4ae9b3feab76 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:53.154595 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-234f6504-494e-407c-9383-3a33fd685e4f req-75d86e04-ba22-4193-8024-4ae9b3feab76 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:53.168025 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-234f6504-494e-407c-9383-3a33fd685e4f req-75d86e04-ba22-4193-8024-4ae9b3feab76 service nova] Creating event network-changed:3a32c5da-961b-4d6a-ae78-57f2e74c8ec3 for instance 024cb100-29e3-402c-b634-256694a63335 on n-h2-master-1 Oct 23 01:15:53.174276 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-234f6504-494e-407c-9383-3a33fd685e4f req-75d86e04-ba22-4193-8024-4ae9b3feab76 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054014 Oct 23 01:15:53.175984 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 697/1469] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:15:53.185656 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-57453e20-1f40-4f6b-9a4e-7b2795db44ef tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:53.186391 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-57453e20-1f40-4f6b-9a4e-7b2795db44ef tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 8025dc46-71af-4fec-8f54-5ae9e92cc31f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:53.193229 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-57453e20-1f40-4f6b-9a4e-7b2795db44ef tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:53.193764 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-57453e20-1f40-4f6b-9a4e-7b2795db44ef tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:53.194229 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-57453e20-1f40-4f6b-9a4e-7b2795db44ef tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:53.194926 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-57453e20-1f40-4f6b-9a4e-7b2795db44ef tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:53.195383 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-57453e20-1f40-4f6b-9a4e-7b2795db44ef tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:53.195805 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-57453e20-1f40-4f6b-9a4e-7b2795db44ef tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:54.137701 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-57453e20-1f40-4f6b-9a4e-7b2795db44ef tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:54.148879 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-57453e20-1f40-4f6b-9a4e-7b2795db44ef tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f" status: 200 len: 1534 microversion: 2.1 time: 0.971225 Oct 23 01:15:54.150605 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 698/1470] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:53 2022] GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f => generated 1534 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:54.174524 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-d84946bb-2181-424e-9bfb-6f5e6fe49dcf req-c42d1847-8cc8-48be-935f-4ec67d8eee08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8025dc46-71af-4fec-8f54-5ae9e92cc31f", "tag": "9dbeafb3-f8f6-45eb-993c-c817b00700d0"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:15:54.186866 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-d84946bb-2181-424e-9bfb-6f5e6fe49dcf req-c42d1847-8cc8-48be-935f-4ec67d8eee08 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:54.188369 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-d84946bb-2181-424e-9bfb-6f5e6fe49dcf req-c42d1847-8cc8-48be-935f-4ec67d8eee08 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:54.188369 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-d84946bb-2181-424e-9bfb-6f5e6fe49dcf req-c42d1847-8cc8-48be-935f-4ec67d8eee08 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:54.202876 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-d84946bb-2181-424e-9bfb-6f5e6fe49dcf req-c42d1847-8cc8-48be-935f-4ec67d8eee08 service nova] Creating event network-changed:9dbeafb3-f8f6-45eb-993c-c817b00700d0 for instance 8025dc46-71af-4fec-8f54-5ae9e92cc31f on n-h2-master-1 Oct 23 01:15:54.209048 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [req-d84946bb-2181-424e-9bfb-6f5e6fe49dcf req-c42d1847-8cc8-48be-935f-4ec67d8eee08 service nova] Instance 8025dc46-71af-4fec-8f54-5ae9e92cc31f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120944) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 23 01:15:54.222751 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-d84946bb-2181-424e-9bfb-6f5e6fe49dcf req-c42d1847-8cc8-48be-935f-4ec67d8eee08 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070471 Oct 23 01:15:54.224064 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 699/1471] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:15:54.229792 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e9749405-d213-4167-b8fb-c36ec5b210bf tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:54.231203 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e9749405-d213-4167-b8fb-c36ec5b210bf tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] [instance: 881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:54.238318 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9749405-d213-4167-b8fb-c36ec5b210bf tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:54.238935 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9749405-d213-4167-b8fb-c36ec5b210bf tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:54.239614 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9749405-d213-4167-b8fb-c36ec5b210bf tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:54.240593 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9749405-d213-4167-b8fb-c36ec5b210bf tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:54.241366 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9749405-d213-4167-b8fb-c36ec5b210bf tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:54.242280 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9749405-d213-4167-b8fb-c36ec5b210bf tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:54.426503 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e9749405-d213-4167-b8fb-c36ec5b210bf tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932e28d1de240f5a3b0dab50df11f31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891f5b08deb441c0b0a6bff7b9ddb953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:54.437410 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e9749405-d213-4167-b8fb-c36ec5b210bf tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] 10.222.0.42 "GET /compute/v2.1/servers/881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40" status: 200 len: 1281 microversion: 2.1 time: 0.211604 Oct 23 01:15:54.438407 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 700/1472] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:54 2022] GET /compute/v2.1/servers/881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40 => generated 1281 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:54.444231 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d93805d6-7057-45a8-b13e-3e45c879c506 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:54.445167 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d93805d6-7057-45a8-b13e-3e45c879c506 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: fb12a9d1-a506-4e57-b93e-62cbe2ac4450] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:54.452909 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d93805d6-7057-45a8-b13e-3e45c879c506 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:54.453755 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d93805d6-7057-45a8-b13e-3e45c879c506 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:54.458427 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d93805d6-7057-45a8-b13e-3e45c879c506 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:54.458427 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d93805d6-7057-45a8-b13e-3e45c879c506 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:54.458427 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d93805d6-7057-45a8-b13e-3e45c879c506 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:54.458427 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d93805d6-7057-45a8-b13e-3e45c879c506 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:55.007071 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d93805d6-7057-45a8-b13e-3e45c879c506 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:55.017379 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d93805d6-7057-45a8-b13e-3e45c879c506 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/fb12a9d1-a506-4e57-b93e-62cbe2ac4450" status: 200 len: 1318 microversion: 2.1 time: 0.577683 Oct 23 01:15:55.033444 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 701/1473] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:54 2022] GET /compute/v2.1/servers/fb12a9d1-a506-4e57-b93e-62cbe2ac4450 => generated 1318 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:55.038741 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c359e53f-427b-474e-9477-d2820b2049cf tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:55.039368 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c359e53f-427b-474e-9477-d2820b2049cf tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:55.045562 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c359e53f-427b-474e-9477-d2820b2049cf tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:55.046116 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c359e53f-427b-474e-9477-d2820b2049cf tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:55.046564 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c359e53f-427b-474e-9477-d2820b2049cf tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:55.047270 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c359e53f-427b-474e-9477-d2820b2049cf tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:55.047982 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c359e53f-427b-474e-9477-d2820b2049cf tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:55.048423 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c359e53f-427b-474e-9477-d2820b2049cf tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:55.451615 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c359e53f-427b-474e-9477-d2820b2049cf tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:55.470518 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c359e53f-427b-474e-9477-d2820b2049cf tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 200 len: 1717 microversion: 2.1 time: 0.435724 Oct 23 01:15:55.503163 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 702/1474] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:55 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 1717 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:55.505880 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dca18eb6-855f-4826-8b6b-c4cf30aba728 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:55.507274 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-dca18eb6-855f-4826-8b6b-c4cf30aba728 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 8025dc46-71af-4fec-8f54-5ae9e92cc31f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:55.516494 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dca18eb6-855f-4826-8b6b-c4cf30aba728 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:55.517188 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dca18eb6-855f-4826-8b6b-c4cf30aba728 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:55.517932 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dca18eb6-855f-4826-8b6b-c4cf30aba728 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:55.518878 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dca18eb6-855f-4826-8b6b-c4cf30aba728 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:55.520042 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dca18eb6-855f-4826-8b6b-c4cf30aba728 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:55.520758 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dca18eb6-855f-4826-8b6b-c4cf30aba728 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:55.736407 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-274ef087-a098-4ba6-9276-0b21362a0866 tempest-FloatingIPsTestJSON-1569689524 tempest-FloatingIPsTestJSON-1569689524-project] 10.222.0.42 "DELETE /compute/v2.1/os-floating-ips/0d954526-ea46-4e6b-8eed-11b7211f6c37" status: 202 len: 0 microversion: 2.1 time: 3.462934 Oct 23 01:15:55.737594 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 773/1475] 10.222.0.42 () {58 vars in 1263 bytes} [Sun Oct 23 01:15:52 2022] DELETE /compute/v2.1/os-floating-ips/0d954526-ea46-4e6b-8eed-11b7211f6c37 => generated 0 bytes in 3466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:15:55.742720 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5244290b-9477-4b5a-b5fd-ccf85339007e tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:55.743541 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5244290b-9477-4b5a-b5fd-ccf85339007e tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] [instance: 881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:55.755946 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5244290b-9477-4b5a-b5fd-ccf85339007e tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:55.758841 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5244290b-9477-4b5a-b5fd-ccf85339007e tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:55.761641 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5244290b-9477-4b5a-b5fd-ccf85339007e tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:55.762620 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5244290b-9477-4b5a-b5fd-ccf85339007e tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:55.763252 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5244290b-9477-4b5a-b5fd-ccf85339007e tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:55.769334 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5244290b-9477-4b5a-b5fd-ccf85339007e tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:55.977218 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5244290b-9477-4b5a-b5fd-ccf85339007e tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932e28d1de240f5a3b0dab50df11f31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891f5b08deb441c0b0a6bff7b9ddb953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:55.992659 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5244290b-9477-4b5a-b5fd-ccf85339007e tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] 10.222.0.42 "GET /compute/v2.1/servers/881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40" status: 200 len: 1281 microversion: 2.1 time: 0.251534 Oct 23 01:15:55.994952 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 774/1476] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:55 2022] GET /compute/v2.1/servers/881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40 => generated 1281 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:55.998054 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-dca18eb6-855f-4826-8b6b-c4cf30aba728 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:56.020709 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-dca18eb6-855f-4826-8b6b-c4cf30aba728 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f" status: 200 len: 1534 microversion: 2.1 time: 0.521826 Oct 23 01:15:56.025057 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 703/1477] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:55 2022] GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f => generated 1534 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:56.040780 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-af157c5d-9109-4198-b730-1d2dfe954db5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:56.051882 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-af157c5d-9109-4198-b730-1d2dfe954db5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: fb12a9d1-a506-4e57-b93e-62cbe2ac4450] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:56.052047 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-853ba338-6bd0-452e-99a0-b0e0011f2446 tempest-FloatingIPsTestJSON-1569689524 tempest-FloatingIPsTestJSON-1569689524-project] Action: 'create', calling method: .version_select at 0x7f5cc1f00af0>, body: {"pool": null} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:15:56.052155 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-af157c5d-9109-4198-b730-1d2dfe954db5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:56.052155 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-af157c5d-9109-4198-b730-1d2dfe954db5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:56.052155 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-af157c5d-9109-4198-b730-1d2dfe954db5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:56.052155 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-af157c5d-9109-4198-b730-1d2dfe954db5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:56.052434 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-af157c5d-9109-4198-b730-1d2dfe954db5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:56.052434 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-af157c5d-9109-4198-b730-1d2dfe954db5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:56.343217 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-af157c5d-9109-4198-b730-1d2dfe954db5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:56.353919 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-af157c5d-9109-4198-b730-1d2dfe954db5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/fb12a9d1-a506-4e57-b93e-62cbe2ac4450" status: 200 len: 1318 microversion: 2.1 time: 0.316980 Oct 23 01:15:56.358291 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 704/1478] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:56 2022] GET /compute/v2.1/servers/fb12a9d1-a506-4e57-b93e-62cbe2ac4450 => generated 1318 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:56.368840 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-805884c5-8565-422e-9ab4-ec0387dc7493 req-f14d131b-16e8-4967-8274-a0340da93225 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb12a9d1-a506-4e57-b93e-62cbe2ac4450", "tag": "a434ade4-9eef-4376-987c-501fe33cf25c"}, {"name": "network-changed", "server_uuid": "be9a2687-233d-43c3-95b3-3a8b455595c7", "tag": "a5573536-696d-47fb-b77e-270410ee0fca"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:15:56.389847 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-805884c5-8565-422e-9ab4-ec0387dc7493 req-f14d131b-16e8-4967-8274-a0340da93225 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:56.390351 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-805884c5-8565-422e-9ab4-ec0387dc7493 req-f14d131b-16e8-4967-8274-a0340da93225 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:56.390839 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-805884c5-8565-422e-9ab4-ec0387dc7493 req-f14d131b-16e8-4967-8274-a0340da93225 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:56.411713 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-805884c5-8565-422e-9ab4-ec0387dc7493 req-f14d131b-16e8-4967-8274-a0340da93225 service nova] Creating event network-changed:a434ade4-9eef-4376-987c-501fe33cf25c for instance fb12a9d1-a506-4e57-b93e-62cbe2ac4450 on n-h1-master-1 Oct 23 01:15:56.412375 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-805884c5-8565-422e-9ab4-ec0387dc7493 req-f14d131b-16e8-4967-8274-a0340da93225 service nova] Creating event network-changed:a5573536-696d-47fb-b77e-270410ee0fca for instance be9a2687-233d-43c3-95b3-3a8b455595c7 on n-h2-master-1 Oct 23 01:15:56.426742 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-805884c5-8565-422e-9ab4-ec0387dc7493 req-f14d131b-16e8-4967-8274-a0340da93225 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.066073 Oct 23 01:15:56.428202 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 705/1479] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:15:56.496497 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a72f6939-c00d-4652-ba94-7f00176b5117 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:56.498894 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a72f6939-c00d-4652-ba94-7f00176b5117 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:56.507771 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a72f6939-c00d-4652-ba94-7f00176b5117 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:56.508264 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a72f6939-c00d-4652-ba94-7f00176b5117 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:56.508847 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a72f6939-c00d-4652-ba94-7f00176b5117 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:56.509463 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a72f6939-c00d-4652-ba94-7f00176b5117 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:56.509923 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a72f6939-c00d-4652-ba94-7f00176b5117 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:56.510373 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a72f6939-c00d-4652-ba94-7f00176b5117 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:56.833616 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a72f6939-c00d-4652-ba94-7f00176b5117 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:56.842717 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a72f6939-c00d-4652-ba94-7f00176b5117 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 200 len: 1707 microversion: 2.1 time: 0.351682 Oct 23 01:15:56.847581 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 706/1480] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:56 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 1707 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:15:56.874714 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-702c32e1-3fe0-4b2e-86dd-7c1e4961c34c tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Calling method '.version_select at 0x7f5cc184f160>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:56.878684 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-702c32e1-3fe0-4b2e-86dd-7c1e4961c34c tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:56.882194 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-702c32e1-3fe0-4b2e-86dd-7c1e4961c34c tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:56.887016 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-702c32e1-3fe0-4b2e-86dd-7c1e4961c34c tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:56.910366 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-702c32e1-3fe0-4b2e-86dd-7c1e4961c34c tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] 10.222.0.42 "GET /compute/v2.1/os-migrations" status: 200 len: 3112 microversion: 2.1 time: 0.039405 Oct 23 01:15:56.915825 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 707/1481] 10.222.0.42 () {58 vars in 1143 bytes} [Sun Oct 23 01:15:56 2022] GET /compute/v2.1/os-migrations => generated 3112 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:56.930966 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-44247aad-b931-4347-9a21-4bce2ac8b4b5 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:56.933968 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-44247aad-b931-4347-9a21-4bce2ac8b4b5 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:56.948719 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-44247aad-b931-4347-9a21-4bce2ac8b4b5 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:56.950013 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-44247aad-b931-4347-9a21-4bce2ac8b4b5 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:56.950013 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-44247aad-b931-4347-9a21-4bce2ac8b4b5 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:56.954802 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-44247aad-b931-4347-9a21-4bce2ac8b4b5 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:56.955297 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-44247aad-b931-4347-9a21-4bce2ac8b4b5 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:56.955809 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-44247aad-b931-4347-9a21-4bce2ac8b4b5 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:57.507074 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-44247aad-b931-4347-9a21-4bce2ac8b4b5 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 200 len: 1858 microversion: 2.1 time: 0.580547 Oct 23 01:15:57.520056 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 708/1482] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:56 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 1858 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:15:57.545251 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d25d319b-b318-48a1-bfec-b781cc478958 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:57.546347 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d25d319b-b318-48a1-bfec-b781cc478958 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] [instance: 881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:57.556135 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d25d319b-b318-48a1-bfec-b781cc478958 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:57.556856 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d25d319b-b318-48a1-bfec-b781cc478958 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:57.557482 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d25d319b-b318-48a1-bfec-b781cc478958 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:57.558420 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d25d319b-b318-48a1-bfec-b781cc478958 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:57.559077 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d25d319b-b318-48a1-bfec-b781cc478958 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:57.560527 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d25d319b-b318-48a1-bfec-b781cc478958 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:57.947090 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d25d319b-b318-48a1-bfec-b781cc478958 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932e28d1de240f5a3b0dab50df11f31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891f5b08deb441c0b0a6bff7b9ddb953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:57.960150 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d25d319b-b318-48a1-bfec-b781cc478958 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] 10.222.0.42 "GET /compute/v2.1/servers/881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40" status: 200 len: 1323 microversion: 2.1 time: 0.434849 Oct 23 01:15:57.974547 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 709/1483] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:57 2022] GET /compute/v2.1/servers/881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40 => generated 1323 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:57.984340 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f2043600-a61c-49c9-9552-9137e3cef0f6 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:57.997037 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f2043600-a61c-49c9-9552-9137e3cef0f6 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 8025dc46-71af-4fec-8f54-5ae9e92cc31f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:57.997037 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2043600-a61c-49c9-9552-9137e3cef0f6 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:57.997037 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2043600-a61c-49c9-9552-9137e3cef0f6 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:57.997037 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2043600-a61c-49c9-9552-9137e3cef0f6 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:57.997421 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2043600-a61c-49c9-9552-9137e3cef0f6 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:57.997421 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2043600-a61c-49c9-9552-9137e3cef0f6 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:57.997421 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2043600-a61c-49c9-9552-9137e3cef0f6 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:58.368724 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=11 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:15:58.408694 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=10 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:15:58.749620 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f2043600-a61c-49c9-9552-9137e3cef0f6 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:15:58.761176 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f2043600-a61c-49c9-9552-9137e3cef0f6 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f" status: 200 len: 1527 microversion: 2.1 time: 0.780722 Oct 23 01:15:58.761947 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 710/1484] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:57 2022] GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f => generated 1527 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:15:58.903283 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-0789349c-ce14-4876-be8e-fec56b686ebb req-c7a513df-d0bd-4eb6-acd7-b7e4e2c86b0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "024cb100-29e3-402c-b634-256694a63335", "name": "network-vif-plugged", "status": "completed", "tag": "3a32c5da-961b-4d6a-ae78-57f2e74c8ec3"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:15:58.914628 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-0789349c-ce14-4876-be8e-fec56b686ebb req-c7a513df-d0bd-4eb6-acd7-b7e4e2c86b0a service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:58.915158 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-0789349c-ce14-4876-be8e-fec56b686ebb req-c7a513df-d0bd-4eb6-acd7-b7e4e2c86b0a service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:58.915800 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-0789349c-ce14-4876-be8e-fec56b686ebb req-c7a513df-d0bd-4eb6-acd7-b7e4e2c86b0a service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:58.928728 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-0789349c-ce14-4876-be8e-fec56b686ebb req-c7a513df-d0bd-4eb6-acd7-b7e4e2c86b0a service nova] Creating event network-vif-plugged:3a32c5da-961b-4d6a-ae78-57f2e74c8ec3 for instance 024cb100-29e3-402c-b634-256694a63335 on n-h2-master-1 Oct 23 01:15:58.934652 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-0789349c-ce14-4876-be8e-fec56b686ebb req-c7a513df-d0bd-4eb6-acd7-b7e4e2c86b0a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170784 Oct 23 01:15:58.935969 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 711/1485] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:15:58.944692 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c9267d57-58c1-414a-afb3-18bf5bf02c44 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1496161187", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:15:59.004401 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-c9267d57-58c1-414a-afb3-18bf5bf02c44 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] validate_networks() for [('9752ed79-332c-4c91-93b8-957eba739dbd', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:15:59.836140 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-c9267d57-58c1-414a-afb3-18bf5bf02c44 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:15:59.836735 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-c9267d57-58c1-414a-afb3-18bf5bf02c44 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:15:59.837089 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-c9267d57-58c1-414a-afb3-18bf5bf02c44 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:15:59.837503 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-c9267d57-58c1-414a-afb3-18bf5bf02c44 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:15:59.837913 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-c9267d57-58c1-414a-afb3-18bf5bf02c44 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:15:59.847079 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c9267d57-58c1-414a-afb3-18bf5bf02c44 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:59.847578 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c9267d57-58c1-414a-afb3-18bf5bf02c44 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:59.848010 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c9267d57-58c1-414a-afb3-18bf5bf02c44 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:59.852253 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c9267d57-58c1-414a-afb3-18bf5bf02c44 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:59.852253 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c9267d57-58c1-414a-afb3-18bf5bf02c44 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:59.852253 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c9267d57-58c1-414a-afb3-18bf5bf02c44 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:59.866676 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-c9267d57-58c1-414a-afb3-18bf5bf02c44 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Getting quotas for project 1aa3395c4af3435eaa3a0f49e19167fe. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:15:59.869833 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:15:59.873307 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-c9267d57-58c1-414a-afb3-18bf5bf02c44 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Getting quotas for user 690143905857471f949b1f4454ad2139 and project 1aa3395c4af3435eaa3a0f49e19167fe. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:15:59.887177 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c9267d57-58c1-414a-afb3-18bf5bf02c44 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:15:59.887923 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-853ba338-6bd0-452e-99a0-b0e0011f2446 tempest-FloatingIPsTestJSON-1569689524 tempest-FloatingIPsTestJSON-1569689524-project] 10.222.0.42 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.868483 Oct 23 01:15:59.888538 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 775/1486] 10.222.0.42 () {60 vars in 1170 bytes} [Sun Oct 23 01:15:55 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3893 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:15:59.889573 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c9267d57-58c1-414a-afb3-18bf5bf02c44 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 4150177f-2eef-435a-99b2-efa56983c53a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:15:59.893479 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-06307f57-eadf-4618-9ba4-660bc4d7638f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:59.894151 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-06307f57-eadf-4618-9ba4-660bc4d7638f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: fb12a9d1-a506-4e57-b93e-62cbe2ac4450] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:15:59.901989 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-06307f57-eadf-4618-9ba4-660bc4d7638f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:59.902474 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-06307f57-eadf-4618-9ba4-660bc4d7638f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:59.902962 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-06307f57-eadf-4618-9ba4-660bc4d7638f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:59.903665 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-06307f57-eadf-4618-9ba4-660bc4d7638f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:15:59.904170 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-06307f57-eadf-4618-9ba4-660bc4d7638f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:15:59.904594 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-06307f57-eadf-4618-9ba4-660bc4d7638f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:15:59.987734 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c9267d57-58c1-414a-afb3-18bf5bf02c44 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.050291 Oct 23 01:15:59.988466 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 712/1487] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:15:58 2022] POST /compute/v2.1/servers => generated 383 bytes in 1052 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:15:59.993046 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-57e0894d-6916-4d14-9829-0a9953e2dc51 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:15:59.993860 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-57e0894d-6916-4d14-9829-0a9953e2dc51 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:00.002707 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-57e0894d-6916-4d14-9829-0a9953e2dc51 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:00.003197 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-57e0894d-6916-4d14-9829-0a9953e2dc51 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:00.007449 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-57e0894d-6916-4d14-9829-0a9953e2dc51 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:00.007449 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-57e0894d-6916-4d14-9829-0a9953e2dc51 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:00.007449 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-57e0894d-6916-4d14-9829-0a9953e2dc51 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:00.007449 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-57e0894d-6916-4d14-9829-0a9953e2dc51 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:00.046720 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-06307f57-eadf-4618-9ba4-660bc4d7638f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:00.056117 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-06307f57-eadf-4618-9ba4-660bc4d7638f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/fb12a9d1-a506-4e57-b93e-62cbe2ac4450" status: 200 len: 1318 microversion: 2.1 time: 0.166459 Oct 23 01:16:00.070492 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 776/1488] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:59 2022] GET /compute/v2.1/servers/fb12a9d1-a506-4e57-b93e-62cbe2ac4450 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:00.160073 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8041130f-8309-4cc3-8c35-71377708484c tempest-QuotaClassesAdmin257Test-892353809 tempest-QuotaClassesAdmin257Test-892353809-project-admin] Calling method '.version_select at 0x7f5cc1f4e670>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:00.171873 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8041130f-8309-4cc3-8c35-71377708484c tempest-QuotaClassesAdmin257Test-892353809 tempest-QuotaClassesAdmin257Test-892353809-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.108427 Oct 23 01:16:00.172457 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 777/1489] 10.222.0.42 () {60 vars in 1226 bytes} [Sun Oct 23 01:16:00 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:16:00.177399 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-6e07341c-0b0b-4ac3-bc39-20a4225ca69a req-08cc1850-80c5-404b-b65e-3b207f35b1b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40", "tag": "da3f90c4-7b6b-4da0-bfab-d7a62593c2c8"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:16:00.189494 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-6e07341c-0b0b-4ac3-bc39-20a4225ca69a req-08cc1850-80c5-404b-b65e-3b207f35b1b4 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:00.190761 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-6e07341c-0b0b-4ac3-bc39-20a4225ca69a req-08cc1850-80c5-404b-b65e-3b207f35b1b4 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:00.191909 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-6e07341c-0b0b-4ac3-bc39-20a4225ca69a req-08cc1850-80c5-404b-b65e-3b207f35b1b4 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:00.207923 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-6e07341c-0b0b-4ac3-bc39-20a4225ca69a req-08cc1850-80c5-404b-b65e-3b207f35b1b4 service nova] Creating event network-changed:da3f90c4-7b6b-4da0-bfab-d7a62593c2c8 for instance 881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40 on n-h2-master-1 Oct 23 01:16:00.215673 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-6e07341c-0b0b-4ac3-bc39-20a4225ca69a req-08cc1850-80c5-404b-b65e-3b207f35b1b4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041077 Oct 23 01:16:00.219262 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 778/1490] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:16:00.225071 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-284ac3ad-0265-427a-a5f5-398c4c31e8b2 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:00.226084 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-284ac3ad-0265-427a-a5f5-398c4c31e8b2 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 8025dc46-71af-4fec-8f54-5ae9e92cc31f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:00.233774 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-284ac3ad-0265-427a-a5f5-398c4c31e8b2 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:00.234294 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-284ac3ad-0265-427a-a5f5-398c4c31e8b2 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:00.234807 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-284ac3ad-0265-427a-a5f5-398c4c31e8b2 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:00.235664 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-284ac3ad-0265-427a-a5f5-398c4c31e8b2 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:00.236126 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-284ac3ad-0265-427a-a5f5-398c4c31e8b2 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:00.236556 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-284ac3ad-0265-427a-a5f5-398c4c31e8b2 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:00.306002 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-57e0894d-6916-4d14-9829-0a9953e2dc51 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 200 len: 1858 microversion: 2.1 time: 0.315669 Oct 23 01:16:00.314663 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 713/1491] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:15:59 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 1858 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:00.321465 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dc8bb85f-f069-4d9a-b38b-752941f255b3 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:00.324119 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-dc8bb85f-f069-4d9a-b38b-752941f255b3 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] [instance: 881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:00.335254 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dc8bb85f-f069-4d9a-b38b-752941f255b3 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:00.336036 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dc8bb85f-f069-4d9a-b38b-752941f255b3 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:00.337940 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dc8bb85f-f069-4d9a-b38b-752941f255b3 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:00.338566 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dc8bb85f-f069-4d9a-b38b-752941f255b3 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:00.339187 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dc8bb85f-f069-4d9a-b38b-752941f255b3 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:00.339863 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dc8bb85f-f069-4d9a-b38b-752941f255b3 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:00.564104 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-284ac3ad-0265-427a-a5f5-398c4c31e8b2 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:00.581254 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-dc8bb85f-f069-4d9a-b38b-752941f255b3 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932e28d1de240f5a3b0dab50df11f31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891f5b08deb441c0b0a6bff7b9ddb953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:00.589419 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-dc8bb85f-f069-4d9a-b38b-752941f255b3 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] 10.222.0.42 "GET /compute/v2.1/servers/881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40" status: 200 len: 1323 microversion: 2.1 time: 0.273454 Oct 23 01:16:00.590253 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 714/1492] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:00 2022] GET /compute/v2.1/servers/881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40 => generated 1323 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:00.594938 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2407b6e1-cdf8-45a4-9e72-bfa9e491558b tempest-FloatingIPsTestJSON-1569689524 tempest-FloatingIPsTestJSON-1569689524-project] Calling method '.version_select at 0x7f5cc1989b80>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:00.606518 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-284ac3ad-0265-427a-a5f5-398c4c31e8b2 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f" status: 200 len: 1527 microversion: 2.1 time: 0.385754 Oct 23 01:16:00.607132 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 779/1493] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:00 2022] GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f => generated 1527 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:00.614599 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9bf02fc3-fb97-4623-8193-ab8aa391f282 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:00.618366 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9bf02fc3-fb97-4623-8193-ab8aa391f282 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 4150177f-2eef-435a-99b2-efa56983c53a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:00.692042 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9bf02fc3-fb97-4623-8193-ab8aa391f282 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:00.701253 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9bf02fc3-fb97-4623-8193-ab8aa391f282 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a" status: 200 len: 1225 microversion: 2.1 time: 0.090148 Oct 23 01:16:00.714206 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 780/1494] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:00 2022] GET /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:00.714206 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cc3b3a79-2c36-4c1d-9950-2c0c0e1531d1 tempest-QuotaClassesAdmin257Test-892353809 tempest-QuotaClassesAdmin257Test-892353809-project-admin] Action: 'update', calling method: .version_select at 0x7f5cc1ec1b80>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:16:01.332962 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cc3b3a79-2c36-4c1d-9950-2c0c0e1531d1 tempest-QuotaClassesAdmin257Test-892353809 tempest-QuotaClassesAdmin257Test-892353809-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.629740 Oct 23 01:16:01.339571 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 781/1495] 10.222.0.42 () {62 vars in 1247 bytes} [Sun Oct 23 01:16:00 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:16:01.339571 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-21e9fa41-7d99-42a6-aade-c40c229b193a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:01.339821 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-21e9fa41-7d99-42a6-aade-c40c229b193a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:01.345620 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-21e9fa41-7d99-42a6-aade-c40c229b193a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:01.346153 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-21e9fa41-7d99-42a6-aade-c40c229b193a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:01.346572 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-21e9fa41-7d99-42a6-aade-c40c229b193a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:01.347261 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-21e9fa41-7d99-42a6-aade-c40c229b193a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:01.347755 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-21e9fa41-7d99-42a6-aade-c40c229b193a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:01.348209 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-21e9fa41-7d99-42a6-aade-c40c229b193a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:01.436017 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2407b6e1-cdf8-45a4-9e72-bfa9e491558b tempest-FloatingIPsTestJSON-1569689524 tempest-FloatingIPsTestJSON-1569689524-project] 10.222.0.42 "DELETE /compute/v2.1/os-floating-ips/a748d29c-f79f-43cf-b3df-346e75a16e67" status: 202 len: 0 microversion: 2.1 time: 0.844550 Oct 23 01:16:01.436611 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 715/1496] 10.222.0.42 () {58 vars in 1263 bytes} [Sun Oct 23 01:16:00 2022] DELETE /compute/v2.1/os-floating-ips/a748d29c-f79f-43cf-b3df-346e75a16e67 => generated 0 bytes in 846 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:16:01.444537 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f0276b22-d19e-4ace-bf32-4683788b37fe tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:01.450614 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-f0276b22-d19e-4ace-bf32-4683788b37fe tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] HTTP exception thrown: Flavor 9bcda188-8c9a-4a0e-a7f3-bd5b16a30592 could not be found. Oct 23 01:16:01.454296 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f0276b22-d19e-4ace-bf32-4683788b37fe tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Request method failure captured: Oct 23 01:16:01.454296 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/flavors/9bcda188-8c9a-4a0e-a7f3-bd5b16a30592 HTTP/1.1 Oct 23 01:16:01.454296 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:16:01.454296 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:16:01.454296 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:16:01.454296 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:16:01.454296 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:16:01.454296 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:16:01.454296 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:16:01.454296 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:16:01.454296 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJTbUGjgo8grGzZRvsCX-330zGRl9fCr-4PaPwpGdzp_lgBmOi6c4NSNTMlTxew_e4jDV_WwlxVltOcbJy1GXxc0NoYwfHQBDIJftxTsvWjFhUkuykpxVEaU4eYppQcfPvXQDxuqJjjjVdDzbjKnkSG3pnVKFzey9ldIsZezCNo2ZCE Oct 23 01:16:01.454296 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:16:01.454296 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:16:01.454296 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:16:01.454296 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:16:01.454296 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:16:01.454296 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:16:01.454296 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 264d2f683757471183644d46da75d365 Oct 23 01:16:01.454296 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-MigrationsAdminTest-1308385605 Oct 23 01:16:01.454296 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,admin,reader Oct 23 01:16:01.454296 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,admin,reader Oct 23 01:16:01.458216 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/264d2f683757471183644d46da75d365"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_264d2f683757471183644d46da75d365"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/264d2f683757471183644d46da75d365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/264d2f683757471183644d46da75d365"}]}] Oct 23 01:16:01.458216 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-MigrationsAdminTest-1308385605 Oct 23 01:16:01.458216 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 264d2f683757471183644d46da75d365 Oct 23 01:16:01.458216 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-MigrationsAdminTest-1308385605 Oct 23 01:16:01.458216 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-MigrationsAdminTest-1308385605-project-admin Oct 23 01:16:01.458216 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:16:01.458216 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:16:01.458216 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: dce640e690324a588f758650bf3c4f9a Oct 23 01:16:01.458216 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-MigrationsAdminTest-1308385605-project-admin Oct 23 01:16:01.458216 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:16:01.458216 n-d-master-1 devstack@n-api.service[120944]: exception: Flavor 9bcda188-8c9a-4a0e-a7f3-bd5b16a30592 could not be found. Oct 23 01:16:01.458216 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '9bcda188-8c9a-4a0e-a7f3-bd5b16a30592'} Oct 23 01:16:01.459722 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:16:01.459722 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:16:01.459722 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 23 01:16:01.459722 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 23 01:16:01.459722 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 23 01:16:01.459722 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 23 01:16:01.459722 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 23 01:16:01.459722 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 23 01:16:01.459722 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 23 01:16:01.459722 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 23 01:16:01.459722 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 23 01:16:01.459722 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 23 01:16:01.459722 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 23 01:16:01.459722 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 23 01:16:01.459722 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 9bcda188-8c9a-4a0e-a7f3-bd5b16a30592 could not be found. Oct 23 01:16:01.459722 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:16:01.459722 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:16:01.459722 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:16:01.459722 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:16:01.459722 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:16:01.462552 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:16:01.462552 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:16:01.462552 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:16:01.462552 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:16:01.462552 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:16:01.462552 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 23 01:16:01.462552 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:16:01.462552 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 9bcda188-8c9a-4a0e-a7f3-bd5b16a30592 could not be found. Oct 23 01:16:01.462552 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:16:01.462552 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:16:01.462552 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:16:01.462552 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:16:01.462552 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:16:01.462552 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:16:01.462552 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:16:01.462552 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:16:01.462552 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 9bcda188-8c9a-4a0e-a7f3-bd5b16a30592 could not be found. Oct 23 01:16:01.462552 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:16:01.465503 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f0276b22-d19e-4ace-bf32-4683788b37fe tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Returning 404 to user: Flavor 9bcda188-8c9a-4a0e-a7f3-bd5b16a30592 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:16:01.465503 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f0276b22-d19e-4ace-bf32-4683788b37fe tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/9bcda188-8c9a-4a0e-a7f3-bd5b16a30592" status: 404 len: 109 microversion: 2.1 time: 0.018070 Oct 23 01:16:01.465503 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 716/1497] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:16:01 2022] DELETE /compute/v2.1/flavors/9bcda188-8c9a-4a0e-a7f3-bd5b16a30592 => generated 109 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:16:01.470711 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-fc382e7f-4e83-4f53-b254-41bb7bf86519 req-8fd95953-44e5-4649-8a88-012b4e71dc1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8025dc46-71af-4fec-8f54-5ae9e92cc31f", "name": "network-vif-plugged", "status": "completed", "tag": "9dbeafb3-f8f6-45eb-993c-c817b00700d0"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:16:01.491927 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-fc382e7f-4e83-4f53-b254-41bb7bf86519 req-8fd95953-44e5-4649-8a88-012b4e71dc1c service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:01.492504 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-fc382e7f-4e83-4f53-b254-41bb7bf86519 req-8fd95953-44e5-4649-8a88-012b4e71dc1c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:01.494624 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-fc382e7f-4e83-4f53-b254-41bb7bf86519 req-8fd95953-44e5-4649-8a88-012b4e71dc1c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:01.499443 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=100 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:16:01.507171 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-fc382e7f-4e83-4f53-b254-41bb7bf86519 req-8fd95953-44e5-4649-8a88-012b4e71dc1c service nova] Creating event network-vif-plugged:9dbeafb3-f8f6-45eb-993c-c817b00700d0 for instance 8025dc46-71af-4fec-8f54-5ae9e92cc31f on n-h2-master-1 Oct 23 01:16:01.513584 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-fc382e7f-4e83-4f53-b254-41bb7bf86519 req-8fd95953-44e5-4649-8a88-012b4e71dc1c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055558 Oct 23 01:16:01.514815 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 717/1498] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:16:01.522469 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-54e26291-218f-44cc-bb33-6bdca433d6ee tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:01.523257 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-21e9fa41-7d99-42a6-aade-c40c229b193a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lazy-loading 'services' on Instance uuid 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:16:01.523702 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-54e26291-218f-44cc-bb33-6bdca433d6ee tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: fb12a9d1-a506-4e57-b93e-62cbe2ac4450] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:01.530250 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-54e26291-218f-44cc-bb33-6bdca433d6ee tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:01.530812 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-54e26291-218f-44cc-bb33-6bdca433d6ee tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:01.531250 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-54e26291-218f-44cc-bb33-6bdca433d6ee tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:01.532141 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-54e26291-218f-44cc-bb33-6bdca433d6ee tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:01.532907 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-54e26291-218f-44cc-bb33-6bdca433d6ee tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:01.533188 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-54e26291-218f-44cc-bb33-6bdca433d6ee tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:01.714187 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-54e26291-218f-44cc-bb33-6bdca433d6ee tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:01.724376 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-54e26291-218f-44cc-bb33-6bdca433d6ee tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/fb12a9d1-a506-4e57-b93e-62cbe2ac4450" status: 200 len: 1318 microversion: 2.1 time: 0.208161 Oct 23 01:16:01.724952 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 718/1499] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:01 2022] GET /compute/v2.1/servers/fb12a9d1-a506-4e57-b93e-62cbe2ac4450 => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:01.730157 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ec3d32fc-49da-454d-8362-d4e71e8a4d13 tempest-QuotaClassesAdmin257Test-892353809 tempest-QuotaClassesAdmin257Test-892353809-project-admin] Calling method '.version_select at 0x7f5cc180b940>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:01.742192 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ec3d32fc-49da-454d-8362-d4e71e8a4d13 tempest-QuotaClassesAdmin257Test-892353809 tempest-QuotaClassesAdmin257Test-892353809-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.015460 Oct 23 01:16:01.743111 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 719/1500] 10.222.0.42 () {60 vars in 1226 bytes} [Sun Oct 23 01:16:01 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:16:01.748594 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3b7f3101-3213-4f8b-b5c5-accfa749aa54 tempest-FloatingIPsTestJSON-1569689524 tempest-FloatingIPsTestJSON-1569689524-project] Calling method '.version_select at 0x7f5cc180ba60>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:01.792384 n-d-master-1 devstack@n-api.service[120944]: DEBUG neutronclient.v2_0.client [None req-3b7f3101-3213-4f8b-b5c5-accfa749aa54 tempest-FloatingIPsTestJSON-1569689524 tempest-FloatingIPsTestJSON-1569689524-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP a748d29c-f79f-43cf-b3df-346e75a16e67 could not be found", "detail": ""}} {{(pid=120944) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 23 01:16:01.793080 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-3b7f3101-3213-4f8b-b5c5-accfa749aa54 tempest-FloatingIPsTestJSON-1569689524 tempest-FloatingIPsTestJSON-1569689524-project] HTTP exception thrown: Floating IP not found for ID a748d29c-f79f-43cf-b3df-346e75a16e67 Oct 23 01:16:01.795159 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3b7f3101-3213-4f8b-b5c5-accfa749aa54 tempest-FloatingIPsTestJSON-1569689524 tempest-FloatingIPsTestJSON-1569689524-project] Request method failure captured: Oct 23 01:16:01.795159 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/os-floating-ips/a748d29c-f79f-43cf-b3df-346e75a16e67 HTTP/1.1 Oct 23 01:16:01.795159 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:16:01.795159 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:16:01.795159 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:16:01.795159 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:16:01.795159 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:16:01.795159 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:16:01.795159 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:16:01.795159 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:16:01.795159 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJW-rEJAEgknnlciSs9dUplSsCWymw5cxFGDAXKyVcB2Y-IMqIpVr8ry-0XJKRxICwhMKNoaY5zJshzXhqC72JUF9GtB99gnaaZ5Bhkz5dP63Uip_ZWz8eBjCxHsSFmSiy2ZfMt2ypFE5Ael2-54kaJ2DRupuvM7cEft5glwxzzPPlc Oct 23 01:16:01.795159 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:16:01.795159 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:16:01.795159 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:16:01.795159 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:16:01.795159 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:16:01.795159 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:16:01.795159 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 683d8787354c48a39cd481a4888f9190 Oct 23 01:16:01.795159 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-FloatingIPsTestJSON-1569689524 Oct 23 01:16:01.795159 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:16:01.795159 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:16:01.796764 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/683d8787354c48a39cd481a4888f9190"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_683d8787354c48a39cd481a4888f9190"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/683d8787354c48a39cd481a4888f9190"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/683d8787354c48a39cd481a4888f9190"}]}] Oct 23 01:16:01.796764 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-FloatingIPsTestJSON-1569689524 Oct 23 01:16:01.796764 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 683d8787354c48a39cd481a4888f9190 Oct 23 01:16:01.796764 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1569689524 Oct 23 01:16:01.796764 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-FloatingIPsTestJSON-1569689524-project Oct 23 01:16:01.796764 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:16:01.796764 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:16:01.796764 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 0a7f934e65524239aa58bb015e67d047 Oct 23 01:16:01.796764 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-FloatingIPsTestJSON-1569689524-project Oct 23 01:16:01.796764 n-d-master-1 devstack@n-api.service[120944]: method: Oct 23 01:16:01.796764 n-d-master-1 devstack@n-api.service[120944]: exception: Floating IP not found for ID a748d29c-f79f-43cf-b3df-346e75a16e67 Oct 23 01:16:01.796764 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'a748d29c-f79f-43cf-b3df-346e75a16e67'} Oct 23 01:16:01.796764 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:16:01.798023 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:16:01.798023 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 23 01:16:01.798023 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 23 01:16:01.798023 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:16:01.798023 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:16:01.798023 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 23 01:16:01.798023 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 23 01:16:01.798023 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:16:01.798023 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:16:01.798023 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 23 01:16:01.798023 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 23 01:16:01.798023 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:16:01.798023 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:16:01.798023 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 23 01:16:01.798023 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 23 01:16:01.798023 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:16:01.798023 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:16:01.798023 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 23 01:16:01.798023 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 23 01:16:01.799475 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:16:01.799475 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:16:01.799475 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 23 01:16:01.799475 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 23 01:16:01.799475 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 23 01:16:01.799475 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 23 01:16:01.799475 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP a748d29c-f79f-43cf-b3df-346e75a16e67 could not be found Oct 23 01:16:01.799475 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6fc1ceca-91c0-4534-b262-975146be2637'] Oct 23 01:16:01.799475 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:16:01.799475 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:16:01.799475 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:16:01.799475 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:16:01.799475 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 23 01:16:01.799475 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 23 01:16:01.799475 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 23 01:16:01.799475 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 23 01:16:01.799475 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID a748d29c-f79f-43cf-b3df-346e75a16e67. Oct 23 01:16:01.799475 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:16:01.799475 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:16:01.799475 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:16:01.801084 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:16:01.801084 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:16:01.801084 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:16:01.801084 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:16:01.801084 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:16:01.801084 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:16:01.801084 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:16:01.801084 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:16:01.801084 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:16:01.801084 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 23 01:16:01.801084 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 23 01:16:01.801084 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID a748d29c-f79f-43cf-b3df-346e75a16e67 Oct 23 01:16:01.801084 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:16:01.801084 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:16:01.801084 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:16:01.801084 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:16:01.801084 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:16:01.801084 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:16:01.801084 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:16:01.801084 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:16:01.802642 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID a748d29c-f79f-43cf-b3df-346e75a16e67 Oct 23 01:16:01.802642 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:16:01.802642 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3b7f3101-3213-4f8b-b5c5-accfa749aa54 tempest-FloatingIPsTestJSON-1569689524 tempest-FloatingIPsTestJSON-1569689524-project] Returning 404 to user: Floating IP not found for ID a748d29c-f79f-43cf-b3df-346e75a16e67 {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:16:01.802642 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3b7f3101-3213-4f8b-b5c5-accfa749aa54 tempest-FloatingIPsTestJSON-1569689524 tempest-FloatingIPsTestJSON-1569689524-project] 10.222.0.42 "GET /compute/v2.1/os-floating-ips/a748d29c-f79f-43cf-b3df-346e75a16e67" status: 404 len: 111 microversion: 2.1 time: 0.052005 Oct 23 01:16:01.802642 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 720/1501] 10.222.0.42 () {58 vars in 1260 bytes} [Sun Oct 23 01:16:01 2022] GET /compute/v2.1/os-floating-ips/a748d29c-f79f-43cf-b3df-346e75a16e67 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:16:01.802642 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ee6cf519-f456-44b1-8444-f83178257907 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:01.803638 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ee6cf519-f456-44b1-8444-f83178257907 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] [instance: 881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:01.809614 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ee6cf519-f456-44b1-8444-f83178257907 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:01.811010 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ee6cf519-f456-44b1-8444-f83178257907 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:01.811010 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ee6cf519-f456-44b1-8444-f83178257907 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:01.811269 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ee6cf519-f456-44b1-8444-f83178257907 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:01.811719 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ee6cf519-f456-44b1-8444-f83178257907 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:01.812139 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ee6cf519-f456-44b1-8444-f83178257907 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:01.927071 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-21e9fa41-7d99-42a6-aade-c40c229b193a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "DELETE /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d/os-volume_attachments/e2fc5fac-119f-4d57-9f0b-cc51d4b0d54f" status: 202 len: 0 microversion: 2.1 time: 0.591067 Oct 23 01:16:01.927683 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 782/1502] 10.222.0.42 () {58 vars in 1416 bytes} [Sun Oct 23 01:16:01 2022] DELETE /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d/os-volume_attachments/e2fc5fac-119f-4d57-9f0b-cc51d4b0d54f => generated 0 bytes in 593 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:16:01.934367 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-04d857e4-0540-4f85-bbc3-0202bb97e16d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1118243340", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:16:01.944435 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ee6cf519-f456-44b1-8444-f83178257907 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932e28d1de240f5a3b0dab50df11f31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891f5b08deb441c0b0a6bff7b9ddb953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:01.952368 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ee6cf519-f456-44b1-8444-f83178257907 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] 10.222.0.42 "GET /compute/v2.1/servers/881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40" status: 200 len: 1323 microversion: 2.1 time: 0.154343 Oct 23 01:16:01.953092 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 721/1503] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:01 2022] GET /compute/v2.1/servers/881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40 => generated 1323 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:01.960234 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2c265609-b499-40dc-9581-3c3fcc097c8a tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:01.960234 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2c265609-b499-40dc-9581-3c3fcc097c8a tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 4150177f-2eef-435a-99b2-efa56983c53a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:01.965332 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2c265609-b499-40dc-9581-3c3fcc097c8a tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:01.965819 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2c265609-b499-40dc-9581-3c3fcc097c8a tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:01.966283 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2c265609-b499-40dc-9581-3c3fcc097c8a tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:01.966960 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2c265609-b499-40dc-9581-3c3fcc097c8a tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:01.967845 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2c265609-b499-40dc-9581-3c3fcc097c8a tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:01.967845 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2c265609-b499-40dc-9581-3c3fcc097c8a tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:01.993120 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-04d857e4-0540-4f85-bbc3-0202bb97e16d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] validate_networks() for None {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:16:02.051553 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2c265609-b499-40dc-9581-3c3fcc097c8a tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:02.059984 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2c265609-b499-40dc-9581-3c3fcc097c8a tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a" status: 200 len: 1229 microversion: 2.1 time: 0.105667 Oct 23 01:16:02.064176 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 722/1504] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:01 2022] GET /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a => generated 1229 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:02.065279 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b77c8006-104f-49b8-906b-431762b9a197 tempest-QuotaClassesAdmin257Test-892353809 tempest-QuotaClassesAdmin257Test-892353809-project-admin] Action: 'update', calling method: .version_select at 0x7f5cc1892820>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:16:02.232204 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-04d857e4-0540-4f85-bbc3-0202bb97e16d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:16:02.232642 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-04d857e4-0540-4f85-bbc3-0202bb97e16d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:16:02.233120 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-04d857e4-0540-4f85-bbc3-0202bb97e16d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:16:02.233534 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-04d857e4-0540-4f85-bbc3-0202bb97e16d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:16:02.233997 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-04d857e4-0540-4f85-bbc3-0202bb97e16d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:16:02.243971 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-04d857e4-0540-4f85-bbc3-0202bb97e16d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:02.244495 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-04d857e4-0540-4f85-bbc3-0202bb97e16d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:02.244936 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-04d857e4-0540-4f85-bbc3-0202bb97e16d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:02.245675 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-04d857e4-0540-4f85-bbc3-0202bb97e16d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:02.246207 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-04d857e4-0540-4f85-bbc3-0202bb97e16d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:02.246826 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-04d857e4-0540-4f85-bbc3-0202bb97e16d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:02.264420 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-04d857e4-0540-4f85-bbc3-0202bb97e16d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Getting quotas for project eb058785345d4e58a5820445efe09bee. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:16:02.270031 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-04d857e4-0540-4f85-bbc3-0202bb97e16d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Getting quotas for user 547aed83a7e44becb9c89dc6bae62255 and project eb058785345d4e58a5820445efe09bee. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:16:02.283371 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-04d857e4-0540-4f85-bbc3-0202bb97e16d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:16:02.285944 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-04d857e4-0540-4f85-bbc3-0202bb97e16d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:16:02.547554 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-04d857e4-0540-4f85-bbc3-0202bb97e16d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.618069 Oct 23 01:16:02.549488 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 783/1505] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:16:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:16:02.560880 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4a16f42d-42b2-4809-9f99-b03219e2b945 tempest-FloatingIPsTestJSON-1569689524 tempest-FloatingIPsTestJSON-1569689524-project] Calling method '.version_select at 0x7f5cc210aa60>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:02.630662 n-d-master-1 devstack@n-api.service[120945]: DEBUG neutronclient.v2_0.client [None req-4a16f42d-42b2-4809-9f99-b03219e2b945 tempest-FloatingIPsTestJSON-1569689524 tempest-FloatingIPsTestJSON-1569689524-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP a748d29c-f79f-43cf-b3df-346e75a16e67 could not be found", "detail": ""}} {{(pid=120945) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 23 01:16:02.632346 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-4a16f42d-42b2-4809-9f99-b03219e2b945 tempest-FloatingIPsTestJSON-1569689524 tempest-FloatingIPsTestJSON-1569689524-project] HTTP exception thrown: Floating IP not found for ID a748d29c-f79f-43cf-b3df-346e75a16e67 Oct 23 01:16:02.635380 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4a16f42d-42b2-4809-9f99-b03219e2b945 tempest-FloatingIPsTestJSON-1569689524 tempest-FloatingIPsTestJSON-1569689524-project] Request method failure captured: Oct 23 01:16:02.635380 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/os-floating-ips/a748d29c-f79f-43cf-b3df-346e75a16e67 HTTP/1.1 Oct 23 01:16:02.635380 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:16:02.635380 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:16:02.635380 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:16:02.635380 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:16:02.635380 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:16:02.635380 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:16:02.635380 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:16:02.635380 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:16:02.635380 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJW-rEJAEgknnlciSs9dUplSsCWymw5cxFGDAXKyVcB2Y-IMqIpVr8ry-0XJKRxICwhMKNoaY5zJshzXhqC72JUF9GtB99gnaaZ5Bhkz5dP63Uip_ZWz8eBjCxHsSFmSiy2ZfMt2ypFE5Ael2-54kaJ2DRupuvM7cEft5glwxzzPPlc Oct 23 01:16:02.635380 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:16:02.635380 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:16:02.635380 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:16:02.635380 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:16:02.635380 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:16:02.635380 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:16:02.635380 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 683d8787354c48a39cd481a4888f9190 Oct 23 01:16:02.635380 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-FloatingIPsTestJSON-1569689524 Oct 23 01:16:02.635380 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:16:02.635380 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:16:02.636988 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/683d8787354c48a39cd481a4888f9190"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_683d8787354c48a39cd481a4888f9190"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/683d8787354c48a39cd481a4888f9190"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/683d8787354c48a39cd481a4888f9190"}]}] Oct 23 01:16:02.636988 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-FloatingIPsTestJSON-1569689524 Oct 23 01:16:02.636988 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 683d8787354c48a39cd481a4888f9190 Oct 23 01:16:02.636988 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1569689524 Oct 23 01:16:02.636988 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-FloatingIPsTestJSON-1569689524-project Oct 23 01:16:02.636988 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:16:02.636988 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:16:02.636988 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 0a7f934e65524239aa58bb015e67d047 Oct 23 01:16:02.636988 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-FloatingIPsTestJSON-1569689524-project Oct 23 01:16:02.636988 n-d-master-1 devstack@n-api.service[120945]: method: Oct 23 01:16:02.636988 n-d-master-1 devstack@n-api.service[120945]: exception: Floating IP not found for ID a748d29c-f79f-43cf-b3df-346e75a16e67 Oct 23 01:16:02.636988 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'a748d29c-f79f-43cf-b3df-346e75a16e67'} Oct 23 01:16:02.636988 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:16:02.638004 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:16:02.638004 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 23 01:16:02.638004 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 23 01:16:02.638004 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:16:02.638004 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:16:02.638004 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 23 01:16:02.638004 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 23 01:16:02.638004 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:16:02.638004 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:16:02.638004 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 23 01:16:02.638004 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 23 01:16:02.638004 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:16:02.638004 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:16:02.638004 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 23 01:16:02.638004 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 23 01:16:02.638004 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:16:02.638004 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:16:02.638004 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 23 01:16:02.638004 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 23 01:16:02.639352 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:16:02.639352 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:16:02.639352 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 23 01:16:02.639352 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 23 01:16:02.639352 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 23 01:16:02.639352 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 23 01:16:02.639352 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP a748d29c-f79f-43cf-b3df-346e75a16e67 could not be found Oct 23 01:16:02.639352 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-60f5d0c9-1735-4b42-a556-7481e1aadc85'] Oct 23 01:16:02.639352 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:16:02.639352 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:16:02.639352 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:16:02.639352 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:16:02.639352 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 23 01:16:02.639352 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 23 01:16:02.639352 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 23 01:16:02.639352 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 23 01:16:02.639352 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID a748d29c-f79f-43cf-b3df-346e75a16e67. Oct 23 01:16:02.639352 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:16:02.639352 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:16:02.639352 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:16:02.641260 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:16:02.641260 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:16:02.641260 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:16:02.641260 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:16:02.641260 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:16:02.641260 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:16:02.641260 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:16:02.641260 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:16:02.641260 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:16:02.641260 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 23 01:16:02.641260 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 23 01:16:02.641260 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID a748d29c-f79f-43cf-b3df-346e75a16e67 Oct 23 01:16:02.641260 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:16:02.641260 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:16:02.641260 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:16:02.641260 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:16:02.641260 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:16:02.641260 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:16:02.641260 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:16:02.641260 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:16:02.644011 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID a748d29c-f79f-43cf-b3df-346e75a16e67 Oct 23 01:16:02.644011 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:16:02.644538 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4a16f42d-42b2-4809-9f99-b03219e2b945 tempest-FloatingIPsTestJSON-1569689524 tempest-FloatingIPsTestJSON-1569689524-project] Returning 404 to user: Floating IP not found for ID a748d29c-f79f-43cf-b3df-346e75a16e67 {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:16:02.645673 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4a16f42d-42b2-4809-9f99-b03219e2b945 tempest-FloatingIPsTestJSON-1569689524 tempest-FloatingIPsTestJSON-1569689524-project] 10.222.0.42 "DELETE /compute/v2.1/os-floating-ips/a748d29c-f79f-43cf-b3df-346e75a16e67" status: 404 len: 111 microversion: 2.1 time: 0.094771 Oct 23 01:16:02.646443 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 784/1506] 10.222.0.42 () {58 vars in 1263 bytes} [Sun Oct 23 01:16:02 2022] DELETE /compute/v2.1/os-floating-ips/a748d29c-f79f-43cf-b3df-346e75a16e67 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:16:02.665566 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5d6743e0-9a89-4b0b-b4ea-da0751f25d25 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:02.670199 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5d6743e0-9a89-4b0b-b4ea-da0751f25d25 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:02.685450 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5d6743e0-9a89-4b0b-b4ea-da0751f25d25 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:02.686236 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5d6743e0-9a89-4b0b-b4ea-da0751f25d25 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:02.686676 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5d6743e0-9a89-4b0b-b4ea-da0751f25d25 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:02.688918 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5d6743e0-9a89-4b0b-b4ea-da0751f25d25 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:02.688918 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5d6743e0-9a89-4b0b-b4ea-da0751f25d25 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:02.688918 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5d6743e0-9a89-4b0b-b4ea-da0751f25d25 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:02.735599 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b77c8006-104f-49b8-906b-431762b9a197 tempest-QuotaClassesAdmin257Test-892353809 tempest-QuotaClassesAdmin257Test-892353809-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.671941 Oct 23 01:16:02.739745 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 723/1507] 10.222.0.42 () {62 vars in 1247 bytes} [Sun Oct 23 01:16:02 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:16:02.752384 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5d6743e0-9a89-4b0b-b4ea-da0751f25d25 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090759 Oct 23 01:16:02.780477 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 785/1508] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:16:02 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:16:02.784069 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a4276e45-2a84-4043-952d-95a93fbf6148 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:02.785129 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a4276e45-2a84-4043-952d-95a93fbf6148 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:02.792436 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-25a65816-cd8d-42da-8616-5b56dc690669 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:02.800493 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-25a65816-cd8d-42da-8616-5b56dc690669 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: fb12a9d1-a506-4e57-b93e-62cbe2ac4450] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:02.815058 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25a65816-cd8d-42da-8616-5b56dc690669 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:02.818367 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25a65816-cd8d-42da-8616-5b56dc690669 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:02.820496 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25a65816-cd8d-42da-8616-5b56dc690669 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:02.823083 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25a65816-cd8d-42da-8616-5b56dc690669 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:02.824614 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25a65816-cd8d-42da-8616-5b56dc690669 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:02.826740 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25a65816-cd8d-42da-8616-5b56dc690669 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:02.937671 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a4276e45-2a84-4043-952d-95a93fbf6148 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:02.944692 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a4276e45-2a84-4043-952d-95a93fbf6148 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1213 microversion: 2.1 time: 0.202969 Oct 23 01:16:02.949046 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 724/1509] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:02 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1213 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:02.987920 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c54af49a-a631-49fd-9ac1-24d5c6eb0a00 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:02.989155 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c54af49a-a631-49fd-9ac1-24d5c6eb0a00 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] [instance: 881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:03.002506 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c54af49a-a631-49fd-9ac1-24d5c6eb0a00 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:03.003395 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c54af49a-a631-49fd-9ac1-24d5c6eb0a00 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:03.004014 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c54af49a-a631-49fd-9ac1-24d5c6eb0a00 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:03.008435 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c54af49a-a631-49fd-9ac1-24d5c6eb0a00 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:03.008435 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c54af49a-a631-49fd-9ac1-24d5c6eb0a00 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:03.008435 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c54af49a-a631-49fd-9ac1-24d5c6eb0a00 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:03.400242 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-25a65816-cd8d-42da-8616-5b56dc690669 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:03.410674 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-25a65816-cd8d-42da-8616-5b56dc690669 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/fb12a9d1-a506-4e57-b93e-62cbe2ac4450" status: 200 len: 1318 microversion: 2.1 time: 0.628881 Oct 23 01:16:03.412159 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 786/1510] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:02 2022] GET /compute/v2.1/servers/fb12a9d1-a506-4e57-b93e-62cbe2ac4450 => generated 1318 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:03.419069 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-da3a180a-f2ca-47d1-b5db-345c220cfc29 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:03.419964 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-da3a180a-f2ca-47d1-b5db-345c220cfc29 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 4150177f-2eef-435a-99b2-efa56983c53a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:03.427701 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da3a180a-f2ca-47d1-b5db-345c220cfc29 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:03.428515 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da3a180a-f2ca-47d1-b5db-345c220cfc29 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:03.429226 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da3a180a-f2ca-47d1-b5db-345c220cfc29 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:03.430483 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da3a180a-f2ca-47d1-b5db-345c220cfc29 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:03.431171 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da3a180a-f2ca-47d1-b5db-345c220cfc29 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:03.432397 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da3a180a-f2ca-47d1-b5db-345c220cfc29 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:03.530021 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c54af49a-a631-49fd-9ac1-24d5c6eb0a00 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932e28d1de240f5a3b0dab50df11f31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891f5b08deb441c0b0a6bff7b9ddb953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:03.544903 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c54af49a-a631-49fd-9ac1-24d5c6eb0a00 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] 10.222.0.42 "GET /compute/v2.1/servers/881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40" status: 200 len: 1323 microversion: 2.1 time: 0.565511 Oct 23 01:16:03.546039 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 725/1511] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:02 2022] GET /compute/v2.1/servers/881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40 => generated 1323 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:03.580692 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-462e9150-76b9-4a69-aec8-236d8eccad96 req-c7abf3f0-8ff4-41f2-b89e-fbbdae51df4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb12a9d1-a506-4e57-b93e-62cbe2ac4450", "name": "network-vif-plugged", "status": "completed", "tag": "a434ade4-9eef-4376-987c-501fe33cf25c"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:16:03.605351 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-462e9150-76b9-4a69-aec8-236d8eccad96 req-c7abf3f0-8ff4-41f2-b89e-fbbdae51df4f service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:03.606856 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-462e9150-76b9-4a69-aec8-236d8eccad96 req-c7abf3f0-8ff4-41f2-b89e-fbbdae51df4f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:03.609255 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-462e9150-76b9-4a69-aec8-236d8eccad96 req-c7abf3f0-8ff4-41f2-b89e-fbbdae51df4f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:03.628616 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-462e9150-76b9-4a69-aec8-236d8eccad96 req-c7abf3f0-8ff4-41f2-b89e-fbbdae51df4f service nova] Creating event network-vif-plugged:a434ade4-9eef-4376-987c-501fe33cf25c for instance fb12a9d1-a506-4e57-b93e-62cbe2ac4450 on n-h1-master-1 Oct 23 01:16:03.633347 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-da3a180a-f2ca-47d1-b5db-345c220cfc29 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:03.641468 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-462e9150-76b9-4a69-aec8-236d8eccad96 req-c7abf3f0-8ff4-41f2-b89e-fbbdae51df4f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067481 Oct 23 01:16:03.645748 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 726/1512] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:16:03.653228 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-da3a180a-f2ca-47d1-b5db-345c220cfc29 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a" status: 200 len: 1277 microversion: 2.1 time: 0.237370 Oct 23 01:16:03.667290 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 787/1513] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:03 2022] GET /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a => generated 1277 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:03.781475 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-37c1244e-f068-40f6-a4ba-6881309fa64e tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:03.783967 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-37c1244e-f068-40f6-a4ba-6881309fa64e tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:03.800822 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-37c1244e-f068-40f6-a4ba-6881309fa64e tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:03.804197 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-37c1244e-f068-40f6-a4ba-6881309fa64e tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:03.804804 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-37c1244e-f068-40f6-a4ba-6881309fa64e tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:03.806332 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-37c1244e-f068-40f6-a4ba-6881309fa64e tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:03.807912 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-37c1244e-f068-40f6-a4ba-6881309fa64e tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:03.809779 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-37c1244e-f068-40f6-a4ba-6881309fa64e tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:03.883088 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-37c1244e-f068-40f6-a4ba-6881309fa64e tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105869 Oct 23 01:16:03.889710 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 727/1514] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:16:03 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:16:03.979551 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f985566d-055e-4744-b9f0-d8f227824cb1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:03.980637 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f985566d-055e-4744-b9f0-d8f227824cb1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:03.992187 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f985566d-055e-4744-b9f0-d8f227824cb1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:03.995856 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f985566d-055e-4744-b9f0-d8f227824cb1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:03.996848 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f985566d-055e-4744-b9f0-d8f227824cb1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:03.998847 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f985566d-055e-4744-b9f0-d8f227824cb1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:03.999887 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f985566d-055e-4744-b9f0-d8f227824cb1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:04.002799 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f985566d-055e-4744-b9f0-d8f227824cb1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:04.079441 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f985566d-055e-4744-b9f0-d8f227824cb1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:04.088524 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f985566d-055e-4744-b9f0-d8f227824cb1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1217 microversion: 2.1 time: 0.116435 Oct 23 01:16:04.089686 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 788/1515] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:03 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1217 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:16:04.439205 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c766b6d9-62eb-4081-bff4-5d213677769a tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:04.439913 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c766b6d9-62eb-4081-bff4-5d213677769a tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: fb12a9d1-a506-4e57-b93e-62cbe2ac4450] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:04.455428 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c766b6d9-62eb-4081-bff4-5d213677769a tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:04.455927 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c766b6d9-62eb-4081-bff4-5d213677769a tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:04.457601 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c766b6d9-62eb-4081-bff4-5d213677769a tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:04.457601 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c766b6d9-62eb-4081-bff4-5d213677769a tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:04.457858 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c766b6d9-62eb-4081-bff4-5d213677769a tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:04.458478 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c766b6d9-62eb-4081-bff4-5d213677769a tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:04.569896 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7bf8c09b-d9b0-4e87-8b83-3073465fe8d4 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:04.571216 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7bf8c09b-d9b0-4e87-8b83-3073465fe8d4 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] [instance: 881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:04.582162 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7bf8c09b-d9b0-4e87-8b83-3073465fe8d4 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:04.585720 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7bf8c09b-d9b0-4e87-8b83-3073465fe8d4 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:04.586457 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7bf8c09b-d9b0-4e87-8b83-3073465fe8d4 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:04.588448 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7bf8c09b-d9b0-4e87-8b83-3073465fe8d4 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:04.590068 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7bf8c09b-d9b0-4e87-8b83-3073465fe8d4 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:04.590754 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7bf8c09b-d9b0-4e87-8b83-3073465fe8d4 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:05.358894 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c766b6d9-62eb-4081-bff4-5d213677769a tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:05.373921 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c766b6d9-62eb-4081-bff4-5d213677769a tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/fb12a9d1-a506-4e57-b93e-62cbe2ac4450" status: 200 len: 1318 microversion: 2.1 time: 0.939255 Oct 23 01:16:05.383452 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 728/1516] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:04 2022] GET /compute/v2.1/servers/fb12a9d1-a506-4e57-b93e-62cbe2ac4450 => generated 1318 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:05.383452 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7f47a1b0-0388-4bb4-9ba5-e825ba717766 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:05.383452 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7f47a1b0-0388-4bb4-9ba5-e825ba717766 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 4150177f-2eef-435a-99b2-efa56983c53a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:05.390041 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f47a1b0-0388-4bb4-9ba5-e825ba717766 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:05.391067 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f47a1b0-0388-4bb4-9ba5-e825ba717766 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:05.391862 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f47a1b0-0388-4bb4-9ba5-e825ba717766 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:05.393049 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f47a1b0-0388-4bb4-9ba5-e825ba717766 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:05.393775 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f47a1b0-0388-4bb4-9ba5-e825ba717766 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:05.394501 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f47a1b0-0388-4bb4-9ba5-e825ba717766 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:05.750728 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7bf8c09b-d9b0-4e87-8b83-3073465fe8d4 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932e28d1de240f5a3b0dab50df11f31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891f5b08deb441c0b0a6bff7b9ddb953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:05.750728 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7bf8c09b-d9b0-4e87-8b83-3073465fe8d4 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] 10.222.0.42 "GET /compute/v2.1/servers/881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40" status: 200 len: 1323 microversion: 2.1 time: 1.034402 Oct 23 01:16:05.750728 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 789/1517] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:04 2022] GET /compute/v2.1/servers/881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40 => generated 1323 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:05.750728 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3127f683-b214-4c7f-b80b-694723566730 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:05.751814 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3127f683-b214-4c7f-b80b-694723566730 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:05.751814 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3127f683-b214-4c7f-b80b-694723566730 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:05.751814 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3127f683-b214-4c7f-b80b-694723566730 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:05.751814 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3127f683-b214-4c7f-b80b-694723566730 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:05.752292 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3127f683-b214-4c7f-b80b-694723566730 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:05.752292 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3127f683-b214-4c7f-b80b-694723566730 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:05.752292 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3127f683-b214-4c7f-b80b-694723566730 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:05.752638 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7f47a1b0-0388-4bb4-9ba5-e825ba717766 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:05.752638 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7f47a1b0-0388-4bb4-9ba5-e825ba717766 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a" status: 200 len: 1283 microversion: 2.1 time: 0.299715 Oct 23 01:16:05.752638 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 729/1518] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:05 2022] GET /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a => generated 1283 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:05.752638 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1cd39772-3072-4408-a454-c0f923952b31 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:05.753238 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1cd39772-3072-4408-a454-c0f923952b31 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:05.761272 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3127f683-b214-4c7f-b80b-694723566730 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101754 Oct 23 01:16:05.761272 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 790/1519] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:16:05 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:16:05.761769 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1cd39772-3072-4408-a454-c0f923952b31 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:05.761769 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1cd39772-3072-4408-a454-c0f923952b31 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:05.761769 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1cd39772-3072-4408-a454-c0f923952b31 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:05.761769 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1cd39772-3072-4408-a454-c0f923952b31 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:05.762223 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1cd39772-3072-4408-a454-c0f923952b31 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:05.762223 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1cd39772-3072-4408-a454-c0f923952b31 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:05.763390 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-8f5e7983-a5c1-4df6-ba45-f2d6a612924c req-0d740f32-a838-424b-8392-2911ad951c1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40", "name": "network-vif-plugged", "status": "completed", "tag": "da3f90c4-7b6b-4da0-bfab-d7a62593c2c8"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:16:05.780160 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-8f5e7983-a5c1-4df6-ba45-f2d6a612924c req-0d740f32-a838-424b-8392-2911ad951c1d service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:05.789760 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-8f5e7983-a5c1-4df6-ba45-f2d6a612924c req-0d740f32-a838-424b-8392-2911ad951c1d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:05.789760 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-8f5e7983-a5c1-4df6-ba45-f2d6a612924c req-0d740f32-a838-424b-8392-2911ad951c1d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:05.808297 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:16:05.818394 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-8f5e7983-a5c1-4df6-ba45-f2d6a612924c req-0d740f32-a838-424b-8392-2911ad951c1d service nova] Creating event network-vif-plugged:da3f90c4-7b6b-4da0-bfab-d7a62593c2c8 for instance 881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40 on n-h2-master-1 Oct 23 01:16:05.828815 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-8f5e7983-a5c1-4df6-ba45-f2d6a612924c req-0d740f32-a838-424b-8392-2911ad951c1d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069107 Oct 23 01:16:05.830325 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 791/1520] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:16:05.893158 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1cd39772-3072-4408-a454-c0f923952b31 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:05.907938 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1cd39772-3072-4408-a454-c0f923952b31 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1265 microversion: 2.1 time: 0.221205 Oct 23 01:16:05.924699 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 730/1521] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:05 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1265 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:06.413545 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7e89c319-ed07-4bab-8a68-782bb7cab71d tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:06.417416 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7e89c319-ed07-4bab-8a68-782bb7cab71d tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: fb12a9d1-a506-4e57-b93e-62cbe2ac4450] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:06.437622 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7e89c319-ed07-4bab-8a68-782bb7cab71d tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:06.439927 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7e89c319-ed07-4bab-8a68-782bb7cab71d tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:06.440406 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7e89c319-ed07-4bab-8a68-782bb7cab71d tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:06.442684 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7e89c319-ed07-4bab-8a68-782bb7cab71d tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:06.444430 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7e89c319-ed07-4bab-8a68-782bb7cab71d tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:06.446242 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7e89c319-ed07-4bab-8a68-782bb7cab71d tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:06.639952 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cd1f49e3-2ee5-44bd-a7ed-0d558713262f tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:06.640638 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-cd1f49e3-2ee5-44bd-a7ed-0d558713262f tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] [instance: 881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:06.654832 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cd1f49e3-2ee5-44bd-a7ed-0d558713262f tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:06.655601 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cd1f49e3-2ee5-44bd-a7ed-0d558713262f tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:06.656484 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cd1f49e3-2ee5-44bd-a7ed-0d558713262f tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:06.657440 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cd1f49e3-2ee5-44bd-a7ed-0d558713262f tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:06.658593 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cd1f49e3-2ee5-44bd-a7ed-0d558713262f tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:06.659202 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cd1f49e3-2ee5-44bd-a7ed-0d558713262f tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:06.891889 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7e89c319-ed07-4bab-8a68-782bb7cab71d tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:06.907204 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7e89c319-ed07-4bab-8a68-782bb7cab71d tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/fb12a9d1-a506-4e57-b93e-62cbe2ac4450" status: 200 len: 1468 microversion: 2.1 time: 0.506438 Oct 23 01:16:06.909744 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 792/1522] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:06 2022] GET /compute/v2.1/servers/fb12a9d1-a506-4e57-b93e-62cbe2ac4450 => generated 1468 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:06.930716 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1c3a0af4-b4fe-4a6b-89fd-3b69bac3daac tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:06.932787 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1c3a0af4-b4fe-4a6b-89fd-3b69bac3daac tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 4150177f-2eef-435a-99b2-efa56983c53a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:06.942174 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c3a0af4-b4fe-4a6b-89fd-3b69bac3daac tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:06.943928 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c3a0af4-b4fe-4a6b-89fd-3b69bac3daac tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:06.944593 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c3a0af4-b4fe-4a6b-89fd-3b69bac3daac tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:06.945506 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c3a0af4-b4fe-4a6b-89fd-3b69bac3daac tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:06.947141 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c3a0af4-b4fe-4a6b-89fd-3b69bac3daac tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:06.947766 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c3a0af4-b4fe-4a6b-89fd-3b69bac3daac tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:07.013096 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cd1f49e3-2ee5-44bd-a7ed-0d558713262f tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932e28d1de240f5a3b0dab50df11f31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891f5b08deb441c0b0a6bff7b9ddb953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:07.061294 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cd1f49e3-2ee5-44bd-a7ed-0d558713262f tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] 10.222.0.42 "GET /compute/v2.1/servers/881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40" status: 200 len: 1323 microversion: 2.1 time: 0.402742 Oct 23 01:16:07.083238 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 731/1523] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:06 2022] GET /compute/v2.1/servers/881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40 => generated 1323 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:07.092125 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fe724c87-9fe8-4680-9b5a-b241277fba2f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:07.100705 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fe724c87-9fe8-4680-9b5a-b241277fba2f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:07.115682 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe724c87-9fe8-4680-9b5a-b241277fba2f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:07.116192 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe724c87-9fe8-4680-9b5a-b241277fba2f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:07.116628 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe724c87-9fe8-4680-9b5a-b241277fba2f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:07.117336 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe724c87-9fe8-4680-9b5a-b241277fba2f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:07.117791 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe724c87-9fe8-4680-9b5a-b241277fba2f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:07.118244 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe724c87-9fe8-4680-9b5a-b241277fba2f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:07.199543 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fe724c87-9fe8-4680-9b5a-b241277fba2f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114894 Oct 23 01:16:07.200993 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 732/1524] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:16:07 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:16:07.215911 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-97a3c321-1b46-4242-8082-b6446b2f4faa tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:07.219585 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-97a3c321-1b46-4242-8082-b6446b2f4faa tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:07.235182 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-97a3c321-1b46-4242-8082-b6446b2f4faa tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:07.241118 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-97a3c321-1b46-4242-8082-b6446b2f4faa tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:07.241118 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-97a3c321-1b46-4242-8082-b6446b2f4faa tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:07.241118 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-97a3c321-1b46-4242-8082-b6446b2f4faa tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:07.241118 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-97a3c321-1b46-4242-8082-b6446b2f4faa tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:07.241504 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-97a3c321-1b46-4242-8082-b6446b2f4faa tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:07.329461 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1c3a0af4-b4fe-4a6b-89fd-3b69bac3daac tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:07.340047 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1c3a0af4-b4fe-4a6b-89fd-3b69bac3daac tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a" status: 200 len: 1325 microversion: 2.1 time: 0.415038 Oct 23 01:16:07.340646 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 793/1525] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:06 2022] GET /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a => generated 1325 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:07.352132 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-98d3cabe-da91-421c-a355-f28714b86f82 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:07.353087 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-98d3cabe-da91-421c-a355-f28714b86f82 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 024cb100-29e3-402c-b634-256694a63335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:07.372843 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-98d3cabe-da91-421c-a355-f28714b86f82 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:07.373656 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-98d3cabe-da91-421c-a355-f28714b86f82 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:07.375568 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-98d3cabe-da91-421c-a355-f28714b86f82 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:07.376739 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-98d3cabe-da91-421c-a355-f28714b86f82 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:07.377409 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-98d3cabe-da91-421c-a355-f28714b86f82 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:07.378501 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-98d3cabe-da91-421c-a355-f28714b86f82 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:07.453401 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-97a3c321-1b46-4242-8082-b6446b2f4faa tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:07.460251 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-97a3c321-1b46-4242-8082-b6446b2f4faa tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1271 microversion: 2.1 time: 0.252457 Oct 23 01:16:07.474369 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 733/1526] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:07 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1271 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:07.678917 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-98d3cabe-da91-421c-a355-f28714b86f82 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:07.692812 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-98d3cabe-da91-421c-a355-f28714b86f82 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/024cb100-29e3-402c-b634-256694a63335" status: 200 len: 1467 microversion: 2.1 time: 0.346577 Oct 23 01:16:07.692812 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 794/1527] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:07 2022] GET /compute/v2.1/servers/024cb100-29e3-402c-b634-256694a63335 => generated 1467 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:07.711576 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-13e8032b-7a48-4713-8b38-276a10b665dd tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:07.716685 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-13e8032b-7a48-4713-8b38-276a10b665dd tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:07.718355 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-13e8032b-7a48-4713-8b38-276a10b665dd tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Searching by: {'reservation_id': 'r-hed9hg1k', 'deleted': False, 'project_id': '47aadec780734d03a262d4021f48d625'} {{(pid=120944) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 23 01:16:07.736100 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13e8032b-7a48-4713-8b38-276a10b665dd tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:07.741354 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13e8032b-7a48-4713-8b38-276a10b665dd tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:07.741354 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13e8032b-7a48-4713-8b38-276a10b665dd tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:07.741354 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13e8032b-7a48-4713-8b38-276a10b665dd tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:07.741354 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13e8032b-7a48-4713-8b38-276a10b665dd tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:07.742417 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13e8032b-7a48-4713-8b38-276a10b665dd tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:07.892943 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.multi_cell_list [None req-13e8032b-7a48-4713-8b38-276a10b665dd tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120944) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 23 01:16:08.031854 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-13e8032b-7a48-4713-8b38-276a10b665dd tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:08.037301 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13e8032b-7a48-4713-8b38-276a10b665dd tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:08.039279 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13e8032b-7a48-4713-8b38-276a10b665dd tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:08.039926 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13e8032b-7a48-4713-8b38-276a10b665dd tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:08.090896 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-439247d6-3e41-4047-be20-d732ea9a919b tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:08.092467 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-439247d6-3e41-4047-be20-d732ea9a919b tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] [instance: 881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:08.094886 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6,nova_api:UPDATE=7 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:16:08.100216 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-439247d6-3e41-4047-be20-d732ea9a919b tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:08.101095 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-439247d6-3e41-4047-be20-d732ea9a919b tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:08.101788 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-439247d6-3e41-4047-be20-d732ea9a919b tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:08.102926 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-439247d6-3e41-4047-be20-d732ea9a919b tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:08.103582 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-439247d6-3e41-4047-be20-d732ea9a919b tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:08.104204 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-439247d6-3e41-4047-be20-d732ea9a919b tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:08.436384 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-439247d6-3e41-4047-be20-d732ea9a919b tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932e28d1de240f5a3b0dab50df11f31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891f5b08deb441c0b0a6bff7b9ddb953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:08.439714 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-13e8032b-7a48-4713-8b38-276a10b665dd tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/detail?reservation_id=r-hed9hg1k" status: 200 len: 2928 microversion: 2.1 time: 0.732519 Oct 23 01:16:08.448070 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-439247d6-3e41-4047-be20-d732ea9a919b tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] 10.222.0.42 "GET /compute/v2.1/servers/881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40" status: 200 len: 1520 microversion: 2.1 time: 0.361243 Oct 23 01:16:08.465205 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 734/1528] 10.222.0.42 () {58 vars in 1197 bytes} [Sun Oct 23 01:16:07 2022] GET /compute/v2.1/servers/detail?reservation_id=r-hed9hg1k => generated 2928 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:08.465377 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 795/1529] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:08 2022] GET /compute/v2.1/servers/881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40 => generated 1520 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:16:08.476163 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-43f78fe6-4bd6-477f-a59e-845a0bea4a7d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:08.476163 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-43f78fe6-4bd6-477f-a59e-845a0bea4a7d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:08.478353 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-43f78fe6-4bd6-477f-a59e-845a0bea4a7d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:08.479048 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-43f78fe6-4bd6-477f-a59e-845a0bea4a7d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:08.479713 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-43f78fe6-4bd6-477f-a59e-845a0bea4a7d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:08.481422 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-43f78fe6-4bd6-477f-a59e-845a0bea4a7d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:08.482238 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-43f78fe6-4bd6-477f-a59e-845a0bea4a7d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:08.484735 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-43f78fe6-4bd6-477f-a59e-845a0bea4a7d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:08.485056 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fc9e24af-27f6-477d-b9d0-19d7b01f396c tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:08.486459 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-fc9e24af-27f6-477d-b9d0-19d7b01f396c tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 4150177f-2eef-435a-99b2-efa56983c53a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:08.495026 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc9e24af-27f6-477d-b9d0-19d7b01f396c tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:08.495523 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc9e24af-27f6-477d-b9d0-19d7b01f396c tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:08.495961 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc9e24af-27f6-477d-b9d0-19d7b01f396c tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:08.496666 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc9e24af-27f6-477d-b9d0-19d7b01f396c tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:08.497747 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc9e24af-27f6-477d-b9d0-19d7b01f396c tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:08.498433 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc9e24af-27f6-477d-b9d0-19d7b01f396c tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:08.518682 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-43f78fe6-4bd6-477f-a59e-845a0bea4a7d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066922 Oct 23 01:16:08.519523 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 735/1530] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:16:08 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:16:08.525181 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a59351e5-88bf-4667-92b2-4fd52d6ec420 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:08.545476 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.compute.server_groups [None req-a59351e5-88bf-4667-92b2-4fd52d6ec420 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Querying cell 8efa99f7-1ff1-40c2-a97e-acbc153fb79d(cell1) for 2 instances {{(pid=120944) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 23 01:16:08.546461 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a59351e5-88bf-4667-92b2-4fd52d6ec420 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:08.547118 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a59351e5-88bf-4667-92b2-4fd52d6ec420 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:08.547727 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a59351e5-88bf-4667-92b2-4fd52d6ec420 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:08.573961 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a59351e5-88bf-4667-92b2-4fd52d6ec420 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/os-server-groups/6fba43e8-a5dc-41db-bd28-f3f6e8ef90f6" status: 200 len: 270 microversion: 2.1 time: 0.053063 Oct 23 01:16:08.581261 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 736/1531] 10.222.0.42 () {58 vars in 1263 bytes} [Sun Oct 23 01:16:08 2022] GET /compute/v2.1/os-server-groups/6fba43e8-a5dc-41db-bd28-f3f6e8ef90f6 => generated 270 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:16:08.587617 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-621228c4-964d-47b9-b1c1-3006f7601b94 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:08.588513 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-621228c4-964d-47b9-b1c1-3006f7601b94 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:08.597073 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-621228c4-964d-47b9-b1c1-3006f7601b94 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:08.597073 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-621228c4-964d-47b9-b1c1-3006f7601b94 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:08.597073 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-621228c4-964d-47b9-b1c1-3006f7601b94 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:08.597073 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-621228c4-964d-47b9-b1c1-3006f7601b94 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:08.597869 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-621228c4-964d-47b9-b1c1-3006f7601b94 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:08.598606 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-621228c4-964d-47b9-b1c1-3006f7601b94 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:08.798679 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-621228c4-964d-47b9-b1c1-3006f7601b94 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:08.808428 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-621228c4-964d-47b9-b1c1-3006f7601b94 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1271 microversion: 2.1 time: 0.225038 Oct 23 01:16:08.809019 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 737/1532] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:08 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1271 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:08.818960 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5599d881-ce17-471f-9afb-4512b61c4fd9 tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:08.824526 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5599d881-ce17-471f-9afb-4512b61c4fd9 tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] [instance: fb12a9d1-a506-4e57-b93e-62cbe2ac4450] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:08.847272 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5599d881-ce17-471f-9afb-4512b61c4fd9 tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:08.848037 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5599d881-ce17-471f-9afb-4512b61c4fd9 tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:08.848667 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5599d881-ce17-471f-9afb-4512b61c4fd9 tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:08.849381 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5599d881-ce17-471f-9afb-4512b61c4fd9 tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:08.849874 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5599d881-ce17-471f-9afb-4512b61c4fd9 tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:08.850338 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5599d881-ce17-471f-9afb-4512b61c4fd9 tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:08.987240 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-fc9e24af-27f6-477d-b9d0-19d7b01f396c tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:09.006747 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fc9e24af-27f6-477d-b9d0-19d7b01f396c tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a" status: 200 len: 1325 microversion: 2.1 time: 0.553411 Oct 23 01:16:09.017816 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 796/1533] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:08 2022] GET /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a => generated 1325 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:09.034330 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ff42b299-ff45-4841-a887-27a5d0d4eef1 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1393330631", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "8972a9b2-fd35-47e0-9140-aed5efe80dbb"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:16:09.041539 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ff42b299-ff45-4841-a887-27a5d0d4eef1 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Request method failure captured: Oct 23 01:16:09.041539 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 23 01:16:09.041539 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:16:09.041539 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:16:09.041539 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:16:09.041539 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 243 Oct 23 01:16:09.041539 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:16:09.041539 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:16:09.041539 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:16:09.041539 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:16:09.041539 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJXAnN8glSpzjFJmkaUaiz6SrfHzbQXQKmpJba4I9yzUpRVvS20-VvHS8JBqLVlpddvCz63B1toZ2JYtfdyY6tTSU897azSYuTgHOJM9kmG8kotmljxc16KHdMfOFxcB_SPa8FrZqlhgDE3KpxfRWhyp4ImBsifEa9GX6tpMm3CYr7E Oct 23 01:16:09.041539 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:16:09.041539 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:16:09.041539 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:16:09.041539 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:16:09.041539 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:16:09.041539 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:16:09.041539 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 891f5b08deb441c0b0a6bff7b9ddb953 Oct 23 01:16:09.041539 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-756055722 Oct 23 01:16:09.041539 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:16:09.041539 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:16:09.043148 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/891f5b08deb441c0b0a6bff7b9ddb953"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_891f5b08deb441c0b0a6bff7b9ddb953"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/891f5b08deb441c0b0a6bff7b9ddb953"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/891f5b08deb441c0b0a6bff7b9ddb953"}]}] Oct 23 01:16:09.043148 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-756055722 Oct 23 01:16:09.043148 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 891f5b08deb441c0b0a6bff7b9ddb953 Oct 23 01:16:09.043148 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-756055722 Oct 23 01:16:09.043148 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServerMetadataNegativeTestJSON-756055722-project Oct 23 01:16:09.043148 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:16:09.043148 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:16:09.043148 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 9932e28d1de240f5a3b0dab50df11f31 Oct 23 01:16:09.043148 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-756055722-project Oct 23 01:16:09.043148 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:16:09.043148 n-d-master-1 devstack@n-api.service[120945]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1393330631", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "8972a9b2-fd35-47e0-9140-aed5efe80dbb"}]}} Oct 23 01:16:09.044295 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:16:09.044295 n-d-master-1 devstack@n-api.service[120945]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 23 01:16:09.044295 n-d-master-1 devstack@n-api.service[120945]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1393330631', 'imageRef': '446b40bc-db5b-4123-9278-997bd6d04a0d', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '8972a9b2-fd35-47e0-9140-aed5efe80dbb'}]}}} Oct 23 01:16:09.044295 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:16:09.044295 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:16:09.044295 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 23 01:16:09.044295 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 23 01:16:09.044295 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 01:16:09.044295 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise error Oct 23 01:16:09.044295 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 23 01:16:09.044295 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:16:09.044295 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 23 01:16:09.044295 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 23 01:16:09.044295 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 23 01:16:09.044295 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 23 01:16:09.044295 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 23 01:16:09.044295 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:16:09.044295 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 23 01:16:09.044295 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 23 01:16:09.045576 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:16:09.045576 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:16:09.045576 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:16:09.045576 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:16:09.045576 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:16:09.045576 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:16:09.045576 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:16:09.045576 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:16:09.045576 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:16:09.045576 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:16:09.045576 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:16:09.045576 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:16:09.045576 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 23 01:16:09.045576 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 23 01:16:09.045576 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 23 01:16:09.045576 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 23 01:16:09.045576 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 23 01:16:09.045576 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 23 01:16:09.045576 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 23 01:16:09.045576 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:16:09.049654 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:16:09.049654 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:16:09.049654 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:16:09.049654 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:16:09.049654 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:16:09.049654 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 23 01:16:09.049654 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 23 01:16:09.049654 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 23 01:16:09.049654 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:16:09.049654 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ff42b299-ff45-4841-a887-27a5d0d4eef1 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:16:09.049654 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ff42b299-ff45-4841-a887-27a5d0d4eef1 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.024211 Oct 23 01:16:09.049654 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 797/1534] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:16:09 2022] POST /compute/v2.1/servers => generated 175 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:16:09.294737 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b5567a3c-f832-489b-a667-fb77fd4f8afc tempest-FlavorsV2TestJSON-725275186 tempest-FlavorsV2TestJSON-725275186-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:09.302085 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=100 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:16:09.312495 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b5567a3c-f832-489b-a667-fb77fd4f8afc tempest-FlavorsV2TestJSON-725275186 tempest-FlavorsV2TestJSON-725275186-project] 10.222.0.42 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.267787 Oct 23 01:16:09.314845 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 798/1535] 10.222.0.42 () {58 vars in 1137 bytes} [Sun Oct 23 01:16:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:16:09.325941 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5599d881-ce17-471f-9afb-4512b61c4fd9 tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/fb12a9d1-a506-4e57-b93e-62cbe2ac4450" status: 200 len: 1619 microversion: 2.1 time: 0.514002 Oct 23 01:16:09.345328 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 738/1536] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:08 2022] GET /compute/v2.1/servers/fb12a9d1-a506-4e57-b93e-62cbe2ac4450 => generated 1619 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:09.352714 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-df91a409-5e6c-47fa-8449-ebdf2ce54679 tempest-FlavorsV2TestJSON-725275186 tempest-FlavorsV2TestJSON-725275186-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:09.355774 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a382657e-3329-4d3b-ab6f-9d343216b325 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:09.356280 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a382657e-3329-4d3b-ab6f-9d343216b325 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] [instance: 659039eb-5c66-400a-ae95-1822136a55e2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:09.390112 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-a382657e-3329-4d3b-ab6f-9d343216b325 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] HTTP exception thrown: Instance 659039eb-5c66-400a-ae95-1822136a55e2 could not be found. Oct 23 01:16:09.391907 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a382657e-3329-4d3b-ab6f-9d343216b325 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Request method failure captured: Oct 23 01:16:09.391907 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/659039eb-5c66-400a-ae95-1822136a55e2/metadata HTTP/1.1 Oct 23 01:16:09.391907 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:16:09.391907 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:16:09.391907 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:16:09.391907 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:16:09.391907 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:16:09.391907 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:16:09.391907 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:16:09.391907 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:16:09.391907 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJXAnN8glSpzjFJmkaUaiz6SrfHzbQXQKmpJba4I9yzUpRVvS20-VvHS8JBqLVlpddvCz63B1toZ2JYtfdyY6tTSU897azSYuTgHOJM9kmG8kotmljxc16KHdMfOFxcB_SPa8FrZqlhgDE3KpxfRWhyp4ImBsifEa9GX6tpMm3CYr7E Oct 23 01:16:09.391907 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:16:09.391907 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:16:09.391907 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:16:09.391907 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:16:09.391907 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:16:09.391907 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:16:09.391907 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 891f5b08deb441c0b0a6bff7b9ddb953 Oct 23 01:16:09.391907 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-756055722 Oct 23 01:16:09.391907 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:16:09.391907 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:16:09.393380 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/891f5b08deb441c0b0a6bff7b9ddb953"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_891f5b08deb441c0b0a6bff7b9ddb953"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/891f5b08deb441c0b0a6bff7b9ddb953"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/891f5b08deb441c0b0a6bff7b9ddb953"}]}] Oct 23 01:16:09.393380 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-756055722 Oct 23 01:16:09.393380 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 891f5b08deb441c0b0a6bff7b9ddb953 Oct 23 01:16:09.393380 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-756055722 Oct 23 01:16:09.393380 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServerMetadataNegativeTestJSON-756055722-project Oct 23 01:16:09.393380 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:16:09.393380 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:16:09.393380 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 9932e28d1de240f5a3b0dab50df11f31 Oct 23 01:16:09.393380 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-756055722-project Oct 23 01:16:09.393380 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:16:09.393380 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 659039eb-5c66-400a-ae95-1822136a55e2 could not be found. Oct 23 01:16:09.394170 n-d-master-1 devstack@n-api.service[120945]: action_args: {'server_id': '659039eb-5c66-400a-ae95-1822136a55e2'} Oct 23 01:16:09.394170 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:16:09.394170 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:16:09.394170 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:16:09.394170 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:16:09.394170 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:16:09.394170 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:16:09.394170 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 23 01:16:09.394170 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 23 01:16:09.394170 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 659039eb-5c66-400a-ae95-1822136a55e2 could not be found. Oct 23 01:16:09.394170 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:16:09.394170 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:16:09.394170 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:16:09.394170 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:16:09.394170 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:16:09.394170 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:16:09.394170 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:16:09.394170 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:16:09.394170 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:16:09.394170 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:16:09.395522 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 23 01:16:09.395522 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 23 01:16:09.395522 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:16:09.395522 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:16:09.395522 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 659039eb-5c66-400a-ae95-1822136a55e2 could not be found. Oct 23 01:16:09.395522 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:16:09.395522 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:16:09.395522 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:16:09.395522 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:16:09.395522 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:16:09.395522 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:16:09.395522 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:16:09.395522 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:16:09.395522 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 659039eb-5c66-400a-ae95-1822136a55e2 could not be found. Oct 23 01:16:09.395522 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:16:09.395522 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a382657e-3329-4d3b-ab6f-9d343216b325 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Returning 404 to user: Instance 659039eb-5c66-400a-ae95-1822136a55e2 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:16:09.397142 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a382657e-3329-4d3b-ab6f-9d343216b325 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] 10.222.0.42 "GET /compute/v2.1/servers/659039eb-5c66-400a-ae95-1822136a55e2/metadata" status: 404 len: 111 microversion: 2.1 time: 0.052242 Oct 23 01:16:09.410043 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 799/1537] 10.222.0.42 () {58 vars in 1263 bytes} [Sun Oct 23 01:16:09 2022] GET /compute/v2.1/servers/659039eb-5c66-400a-ae95-1822136a55e2/metadata => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:16:09.436625 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-87ede45f-f48c-495d-85ef-875489724ae9 tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:09.439021 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-87ede45f-f48c-495d-85ef-875489724ae9 tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] [instance: 024cb100-29e3-402c-b634-256694a63335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:09.448147 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-df91a409-5e6c-47fa-8449-ebdf2ce54679 tempest-FlavorsV2TestJSON-725275186 tempest-FlavorsV2TestJSON-725275186-project] 10.222.0.42 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.115419 Oct 23 01:16:09.461027 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 739/1538] 10.222.0.42 () {58 vars in 1125 bytes} [Sun Oct 23 01:16:09 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:09.477565 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-87ede45f-f48c-495d-85ef-875489724ae9 tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:09.477565 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-87ede45f-f48c-495d-85ef-875489724ae9 tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:09.477565 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-87ede45f-f48c-495d-85ef-875489724ae9 tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:09.478150 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e673d6e9-9d04-406e-9ecb-a51f2d06b20d tempest-FlavorsV2TestJSON-725275186 tempest-FlavorsV2TestJSON-725275186-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:09.479211 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-87ede45f-f48c-495d-85ef-875489724ae9 tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:09.479751 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-87ede45f-f48c-495d-85ef-875489724ae9 tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:09.484840 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-87ede45f-f48c-495d-85ef-875489724ae9 tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:09.503826 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e673d6e9-9d04-406e-9ecb-a51f2d06b20d tempest-FlavorsV2TestJSON-725275186 tempest-FlavorsV2TestJSON-725275186-project] 10.222.0.42 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.041531 Oct 23 01:16:09.514092 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 740/1539] 10.222.0.42 () {58 vars in 1137 bytes} [Sun Oct 23 01:16:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:16:09.526005 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d4e9c726-29e2-40cf-883a-cd3a3a100531 tempest-FlavorsV2TestJSON-725275186 tempest-FlavorsV2TestJSON-725275186-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:09.572865 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d4e9c726-29e2-40cf-883a-cd3a3a100531 tempest-FlavorsV2TestJSON-725275186 tempest-FlavorsV2TestJSON-725275186-project] 10.222.0.42 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.044729 Oct 23 01:16:09.577295 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 741/1540] 10.222.0.42 () {58 vars in 1137 bytes} [Sun Oct 23 01:16:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:16:09.589712 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f1045228-fed3-4797-9529-4f0805611ac2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:09.595034 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f1045228-fed3-4797-9529-4f0805611ac2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:09.615220 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1045228-fed3-4797-9529-4f0805611ac2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:09.618793 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1045228-fed3-4797-9529-4f0805611ac2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:09.619482 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1045228-fed3-4797-9529-4f0805611ac2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:09.620923 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1045228-fed3-4797-9529-4f0805611ac2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:09.621572 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1045228-fed3-4797-9529-4f0805611ac2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:09.622366 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1045228-fed3-4797-9529-4f0805611ac2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:09.734879 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f1045228-fed3-4797-9529-4f0805611ac2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.156683 Oct 23 01:16:09.738867 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 742/1541] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:16:09 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:16:09.750652 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-06467f9f-d999-48fa-b920-072b7c11a536 tempest-FlavorsV2TestJSON-725275186 tempest-FlavorsV2TestJSON-725275186-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:09.786578 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-87ede45f-f48c-495d-85ef-875489724ae9 tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/024cb100-29e3-402c-b634-256694a63335" status: 200 len: 1618 microversion: 2.1 time: 0.361218 Oct 23 01:16:09.789254 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 800/1542] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:09 2022] GET /compute/v2.1/servers/024cb100-29e3-402c-b634-256694a63335 => generated 1618 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:09.806150 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8c0fc412-84e5-4129-8acc-7c8539956e6b tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2109728929", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8972a9b2-fd35-47e0-9140-aed5efe80dbb"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:16:09.811195 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8c0fc412-84e5-4129-8acc-7c8539956e6b tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Request method failure captured: Oct 23 01:16:09.811195 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 23 01:16:09.811195 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:16:09.811195 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:16:09.811195 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:16:09.811195 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 499 Oct 23 01:16:09.811195 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:16:09.811195 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:16:09.811195 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:16:09.811195 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:16:09.811195 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJXAnN8glSpzjFJmkaUaiz6SrfHzbQXQKmpJba4I9yzUpRVvS20-VvHS8JBqLVlpddvCz63B1toZ2JYtfdyY6tTSU897azSYuTgHOJM9kmG8kotmljxc16KHdMfOFxcB_SPa8FrZqlhgDE3KpxfRWhyp4ImBsifEa9GX6tpMm3CYr7E Oct 23 01:16:09.811195 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:16:09.811195 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:16:09.811195 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:16:09.811195 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:16:09.811195 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:16:09.811195 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:16:09.811195 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 891f5b08deb441c0b0a6bff7b9ddb953 Oct 23 01:16:09.811195 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-756055722 Oct 23 01:16:09.811195 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:16:09.811195 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:16:09.812614 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/891f5b08deb441c0b0a6bff7b9ddb953"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_891f5b08deb441c0b0a6bff7b9ddb953"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/891f5b08deb441c0b0a6bff7b9ddb953"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/891f5b08deb441c0b0a6bff7b9ddb953"}]}] Oct 23 01:16:09.812614 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-756055722 Oct 23 01:16:09.812614 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 891f5b08deb441c0b0a6bff7b9ddb953 Oct 23 01:16:09.812614 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-756055722 Oct 23 01:16:09.812614 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServerMetadataNegativeTestJSON-756055722-project Oct 23 01:16:09.812614 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:16:09.812614 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:16:09.812614 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 9932e28d1de240f5a3b0dab50df11f31 Oct 23 01:16:09.812614 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-756055722-project Oct 23 01:16:09.812614 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:16:09.813257 n-d-master-1 devstack@n-api.service[120945]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2109728929", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8972a9b2-fd35-47e0-9140-aed5efe80dbb"}]}} Oct 23 01:16:09.813257 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:16:09.813257 n-d-master-1 devstack@n-api.service[120945]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 23 01:16:09.813257 n-d-master-1 devstack@n-api.service[120945]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2109728929', 'imageRef': '446b40bc-db5b-4123-9278-997bd6d04a0d', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '8972a9b2-fd35-47e0-9140-aed5efe80dbb'}]}}} Oct 23 01:16:09.813257 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:16:09.813257 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:16:09.813720 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 23 01:16:09.813720 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 23 01:16:09.813720 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 01:16:09.813720 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise error Oct 23 01:16:09.813720 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 23 01:16:09.813720 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:16:09.813720 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 23 01:16:09.813720 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 23 01:16:09.813720 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 23 01:16:09.813720 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 23 01:16:09.813720 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 23 01:16:09.813720 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:16:09.813720 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 23 01:16:09.813720 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 23 01:16:09.813720 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:16:09.813720 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:16:09.813720 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:16:09.815386 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:16:09.815386 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:16:09.815386 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:16:09.815386 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:16:09.815386 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:16:09.815386 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:16:09.815386 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:16:09.815386 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:16:09.815386 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:16:09.815386 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 23 01:16:09.815386 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 23 01:16:09.815386 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 23 01:16:09.815386 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 23 01:16:09.815386 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 23 01:16:09.815386 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 23 01:16:09.816419 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 23 01:16:09.816419 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:16:09.816419 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:16:09.816419 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:16:09.816419 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:16:09.816419 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:16:09.816419 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:16:09.816419 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 23 01:16:09.816419 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 23 01:16:09.817005 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 23 01:16:09.817005 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:16:09.819384 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8c0fc412-84e5-4129-8acc-7c8539956e6b tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:16:09.822349 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8c0fc412-84e5-4129-8acc-7c8539956e6b tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.030045 Oct 23 01:16:09.834933 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 801/1543] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:16:09 2022] POST /compute/v2.1/servers => generated 687 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:16:09.846112 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-06467f9f-d999-48fa-b920-072b7c11a536 tempest-FlavorsV2TestJSON-725275186 tempest-FlavorsV2TestJSON-725275186-project] 10.222.0.42 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.095715 Oct 23 01:16:09.846112 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 743/1544] 10.222.0.42 () {58 vars in 1165 bytes} [Sun Oct 23 01:16:09 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:09.849721 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-24b16b58-7cf1-4c73-b0b6-7bf631e25609 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:09.851340 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-24b16b58-7cf1-4c73-b0b6-7bf631e25609 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:09.861600 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-ac6c43b3-f845-44a2-af57-09275acc36bd req-a886c781-13c0-4ad7-a7b1-f7b1ecb1d352 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4150177f-2eef-435a-99b2-efa56983c53a", "tag": "50e0e9ab-b232-47f9-97de-7b93cc03e0c2"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:16:09.868800 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-24b16b58-7cf1-4c73-b0b6-7bf631e25609 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:09.871663 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-24b16b58-7cf1-4c73-b0b6-7bf631e25609 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:09.871663 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-24b16b58-7cf1-4c73-b0b6-7bf631e25609 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:09.872103 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-24b16b58-7cf1-4c73-b0b6-7bf631e25609 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:09.873492 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-24b16b58-7cf1-4c73-b0b6-7bf631e25609 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:09.874028 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-24b16b58-7cf1-4c73-b0b6-7bf631e25609 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:09.874982 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ac6c43b3-f845-44a2-af57-09275acc36bd req-a886c781-13c0-4ad7-a7b1-f7b1ecb1d352 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:09.875702 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ac6c43b3-f845-44a2-af57-09275acc36bd req-a886c781-13c0-4ad7-a7b1-f7b1ecb1d352 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:09.876415 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ac6c43b3-f845-44a2-af57-09275acc36bd req-a886c781-13c0-4ad7-a7b1-f7b1ecb1d352 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:09.911882 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-ac6c43b3-f845-44a2-af57-09275acc36bd req-a886c781-13c0-4ad7-a7b1-f7b1ecb1d352 service nova] Creating event network-changed:50e0e9ab-b232-47f9-97de-7b93cc03e0c2 for instance 4150177f-2eef-435a-99b2-efa56983c53a on n-h2-master-1 Oct 23 01:16:09.921027 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-ac6c43b3-f845-44a2-af57-09275acc36bd req-a886c781-13c0-4ad7-a7b1-f7b1ecb1d352 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084216 Oct 23 01:16:09.924966 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 802/1545] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:16:09.938938 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a8645d07-1563-4856-927f-8d5f374a3567 tempest-FlavorsV2TestJSON-725275186 tempest-FlavorsV2TestJSON-725275186-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:09.961001 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a8645d07-1563-4856-927f-8d5f374a3567 tempest-FlavorsV2TestJSON-725275186 tempest-FlavorsV2TestJSON-725275186-project] 10.222.0.42 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.034496 Oct 23 01:16:09.973059 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 803/1546] 10.222.0.42 () {58 vars in 1137 bytes} [Sun Oct 23 01:16:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:16:09.982715 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e2847a78-196b-4e80-9e0d-cabeaa798854 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-176093268", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8972a9b2-fd35-47e0-9140-aed5efe80dbb"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:16:09.987442 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e2847a78-196b-4e80-9e0d-cabeaa798854 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Request method failure captured: Oct 23 01:16:09.987442 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 23 01:16:09.987442 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:16:09.987442 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:16:09.987442 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:16:09.987442 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 499 Oct 23 01:16:09.987442 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:16:09.987442 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:16:09.987442 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:16:09.987442 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:16:09.987442 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJXAnN8glSpzjFJmkaUaiz6SrfHzbQXQKmpJba4I9yzUpRVvS20-VvHS8JBqLVlpddvCz63B1toZ2JYtfdyY6tTSU897azSYuTgHOJM9kmG8kotmljxc16KHdMfOFxcB_SPa8FrZqlhgDE3KpxfRWhyp4ImBsifEa9GX6tpMm3CYr7E Oct 23 01:16:09.987442 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:16:09.987442 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:16:09.987442 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:16:09.987442 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:16:09.987442 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:16:09.987442 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:16:09.987442 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 891f5b08deb441c0b0a6bff7b9ddb953 Oct 23 01:16:09.987442 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-756055722 Oct 23 01:16:09.987442 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:16:09.987442 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:16:09.988811 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/891f5b08deb441c0b0a6bff7b9ddb953"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_891f5b08deb441c0b0a6bff7b9ddb953"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/891f5b08deb441c0b0a6bff7b9ddb953"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/891f5b08deb441c0b0a6bff7b9ddb953"}]}] Oct 23 01:16:09.988811 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-756055722 Oct 23 01:16:09.988811 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 891f5b08deb441c0b0a6bff7b9ddb953 Oct 23 01:16:09.988811 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-756055722 Oct 23 01:16:09.988811 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServerMetadataNegativeTestJSON-756055722-project Oct 23 01:16:09.988811 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:16:09.988811 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:16:09.988811 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 9932e28d1de240f5a3b0dab50df11f31 Oct 23 01:16:09.988811 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-756055722-project Oct 23 01:16:09.988811 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:16:09.989469 n-d-master-1 devstack@n-api.service[120945]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-176093268", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8972a9b2-fd35-47e0-9140-aed5efe80dbb"}]}} Oct 23 01:16:09.989469 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:16:09.989469 n-d-master-1 devstack@n-api.service[120945]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 23 01:16:09.989469 n-d-master-1 devstack@n-api.service[120945]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-176093268', 'imageRef': '446b40bc-db5b-4123-9278-997bd6d04a0d', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '8972a9b2-fd35-47e0-9140-aed5efe80dbb'}]}}} Oct 23 01:16:09.989469 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:16:09.989469 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:16:09.989915 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 23 01:16:09.989915 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 23 01:16:09.989915 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 01:16:09.989915 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise error Oct 23 01:16:09.989915 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 23 01:16:09.989915 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:16:09.989915 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 23 01:16:09.989915 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 23 01:16:09.989915 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 23 01:16:09.989915 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 23 01:16:09.989915 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 23 01:16:09.989915 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:16:09.989915 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 23 01:16:09.989915 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 23 01:16:09.989915 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:16:09.989915 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:16:09.989915 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:16:09.991048 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:16:09.991048 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:16:09.991048 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:16:09.991048 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:16:09.991048 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:16:09.991048 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:16:09.991048 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:16:09.991048 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:16:09.991048 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:16:09.991048 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 23 01:16:09.991048 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 23 01:16:09.991048 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 23 01:16:09.991048 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 23 01:16:09.991048 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 23 01:16:09.991048 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 23 01:16:09.991994 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 23 01:16:09.991994 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:16:09.991994 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:16:09.991994 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:16:09.991994 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:16:09.991994 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:16:09.991994 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:16:09.991994 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 23 01:16:09.991994 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 23 01:16:09.992552 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 23 01:16:09.992552 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:16:10.009300 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e2847a78-196b-4e80-9e0d-cabeaa798854 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:16:10.009300 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e2847a78-196b-4e80-9e0d-cabeaa798854 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.025974 Oct 23 01:16:10.009300 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 804/1547] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:16:09 2022] POST /compute/v2.1/servers => generated 689 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:16:10.018071 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4b106d1c-3c64-43f8-91b1-7cb2a3dc0c2c tempest-FlavorsV2TestJSON-725275186 tempest-FlavorsV2TestJSON-725275186-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:10.046189 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4b106d1c-3c64-43f8-91b1-7cb2a3dc0c2c tempest-FlavorsV2TestJSON-725275186 tempest-FlavorsV2TestJSON-725275186-project] 10.222.0.42 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.034442 Oct 23 01:16:10.071892 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 805/1548] 10.222.0.42 () {58 vars in 1169 bytes} [Sun Oct 23 01:16:10 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:10.087793 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c41126a8-0f46-4444-b0e5-05b79afb8336 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1368066882", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "cffc5366-8131-4a2b-bf51-39e4d23929e3"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:16:10.156744 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-c41126a8-0f46-4444-b0e5-05b79afb8336 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] validate_networks() for None {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:16:10.340803 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-24b16b58-7cf1-4c73-b0b6-7bf631e25609 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:10.356564 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-24b16b58-7cf1-4c73-b0b6-7bf631e25609 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1313 microversion: 2.1 time: 0.515295 Oct 23 01:16:10.373545 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 744/1549] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:09 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1313 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:10.382181 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f706871e-f354-4909-8779-0ff2709eccea tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:10.382802 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f706871e-f354-4909-8779-0ff2709eccea tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 4150177f-2eef-435a-99b2-efa56983c53a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:10.389011 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f706871e-f354-4909-8779-0ff2709eccea tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:10.389637 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f706871e-f354-4909-8779-0ff2709eccea tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:10.389912 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f706871e-f354-4909-8779-0ff2709eccea tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:10.390672 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f706871e-f354-4909-8779-0ff2709eccea tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:10.391170 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f706871e-f354-4909-8779-0ff2709eccea tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:10.391593 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f706871e-f354-4909-8779-0ff2709eccea tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:10.653816 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-c41126a8-0f46-4444-b0e5-05b79afb8336 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:16:10.654383 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-c41126a8-0f46-4444-b0e5-05b79afb8336 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:16:10.654732 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-c41126a8-0f46-4444-b0e5-05b79afb8336 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:16:10.655145 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-c41126a8-0f46-4444-b0e5-05b79afb8336 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:16:10.655559 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-c41126a8-0f46-4444-b0e5-05b79afb8336 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:16:10.674246 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c41126a8-0f46-4444-b0e5-05b79afb8336 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:10.675876 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c41126a8-0f46-4444-b0e5-05b79afb8336 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:10.675876 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c41126a8-0f46-4444-b0e5-05b79afb8336 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:10.675876 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c41126a8-0f46-4444-b0e5-05b79afb8336 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:10.676312 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c41126a8-0f46-4444-b0e5-05b79afb8336 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:10.676931 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c41126a8-0f46-4444-b0e5-05b79afb8336 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:10.695646 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-c41126a8-0f46-4444-b0e5-05b79afb8336 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Getting quotas for project 47aadec780734d03a262d4021f48d625. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:16:10.701999 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-c41126a8-0f46-4444-b0e5-05b79afb8336 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Getting quotas for user 519c893a1e094200b882cf23db7cae54 and project 47aadec780734d03a262d4021f48d625. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:16:10.703585 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f706871e-f354-4909-8779-0ff2709eccea tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:10.716707 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c41126a8-0f46-4444-b0e5-05b79afb8336 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:16:10.718381 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f706871e-f354-4909-8779-0ff2709eccea tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a" status: 200 len: 1325 microversion: 2.1 time: 0.343518 Oct 23 01:16:10.719882 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c41126a8-0f46-4444-b0e5-05b79afb8336 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 1fb6d268-9409-4ca5-9429-6f00ae7b86c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:16:10.721211 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 745/1550] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:10 2022] GET /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a => generated 1325 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:10.739227 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-da7b4963-4438-4727-88fe-f1b270ecacdb tempest-FlavorsV2TestJSON-725275186 tempest-FlavorsV2TestJSON-725275186-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:10.757872 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-da7b4963-4438-4727-88fe-f1b270ecacdb tempest-FlavorsV2TestJSON-725275186 tempest-FlavorsV2TestJSON-725275186-project] 10.222.0.42 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.035553 Oct 23 01:16:10.758900 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 746/1551] 10.222.0.42 () {58 vars in 1161 bytes} [Sun Oct 23 01:16:10 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:16:10.776682 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-674a9f15-f6ec-4535-be1e-31535cd440e4 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1796189157", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8972a9b2-fd35-47e0-9140-aed5efe80dbb"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:16:10.786824 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-674a9f15-f6ec-4535-be1e-31535cd440e4 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Request method failure captured: Oct 23 01:16:10.786824 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 23 01:16:10.786824 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:16:10.786824 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:16:10.786824 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:16:10.786824 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 754 Oct 23 01:16:10.786824 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:16:10.786824 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:16:10.786824 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:16:10.786824 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:16:10.786824 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJXAnN8glSpzjFJmkaUaiz6SrfHzbQXQKmpJba4I9yzUpRVvS20-VvHS8JBqLVlpddvCz63B1toZ2JYtfdyY6tTSU897azSYuTgHOJM9kmG8kotmljxc16KHdMfOFxcB_SPa8FrZqlhgDE3KpxfRWhyp4ImBsifEa9GX6tpMm3CYr7E Oct 23 01:16:10.786824 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:16:10.786824 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:16:10.786824 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:16:10.786824 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:16:10.786824 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:16:10.786824 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:16:10.786824 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 891f5b08deb441c0b0a6bff7b9ddb953 Oct 23 01:16:10.786824 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-756055722 Oct 23 01:16:10.786824 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:16:10.786824 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:16:10.788808 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/891f5b08deb441c0b0a6bff7b9ddb953"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_891f5b08deb441c0b0a6bff7b9ddb953"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/891f5b08deb441c0b0a6bff7b9ddb953"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/891f5b08deb441c0b0a6bff7b9ddb953"}]}] Oct 23 01:16:10.788808 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-756055722 Oct 23 01:16:10.788808 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 891f5b08deb441c0b0a6bff7b9ddb953 Oct 23 01:16:10.788808 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-756055722 Oct 23 01:16:10.788808 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServerMetadataNegativeTestJSON-756055722-project Oct 23 01:16:10.788808 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:16:10.788808 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:16:10.788808 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 9932e28d1de240f5a3b0dab50df11f31 Oct 23 01:16:10.788808 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-756055722-project Oct 23 01:16:10.788808 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:16:10.789433 n-d-master-1 devstack@n-api.service[120944]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1796189157", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8972a9b2-fd35-47e0-9140-aed5efe80dbb"}]}} Oct 23 01:16:10.789433 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:16:10.789433 n-d-master-1 devstack@n-api.service[120944]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 23 01:16:10.789689 n-d-master-1 devstack@n-api.service[120944]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1796189157', 'imageRef': '446b40bc-db5b-4123-9278-997bd6d04a0d', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '8972a9b2-fd35-47e0-9140-aed5efe80dbb'}]}}} Oct 23 01:16:10.789689 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:16:10.789689 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:16:10.789689 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 23 01:16:10.789689 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 23 01:16:10.789689 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 01:16:10.789689 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise error Oct 23 01:16:10.789689 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 23 01:16:10.797484 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:16:10.797484 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 23 01:16:10.797484 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 23 01:16:10.797484 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 23 01:16:10.797484 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 23 01:16:10.797484 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 23 01:16:10.797484 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:16:10.797484 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 23 01:16:10.797484 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 23 01:16:10.797484 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:16:10.797484 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:16:10.797484 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:16:10.797484 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:16:10.797484 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:16:10.797484 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:16:10.797484 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:16:10.797484 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:16:10.799074 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:16:10.799074 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:16:10.799074 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:16:10.799074 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:16:10.799074 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 23 01:16:10.799074 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 23 01:16:10.799074 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 23 01:16:10.799074 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 23 01:16:10.799074 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 23 01:16:10.799074 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 23 01:16:10.799705 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 23 01:16:10.799705 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:16:10.799705 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:16:10.799705 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:16:10.799705 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:16:10.799705 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:16:10.799705 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:16:10.799705 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 23 01:16:10.799705 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 23 01:16:10.800292 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 23 01:16:10.800292 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:16:10.800461 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-674a9f15-f6ec-4535-be1e-31535cd440e4 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:16:10.800461 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-674a9f15-f6ec-4535-be1e-31535cd440e4 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.032048 Oct 23 01:16:10.800650 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 747/1552] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:16:10 2022] POST /compute/v2.1/servers => generated 1197 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 23 01:16:10.807441 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2f4ff1ac-7bc3-47dd-b1ba-9642ab20e20e tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:10.809746 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2f4ff1ac-7bc3-47dd-b1ba-9642ab20e20e tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:10.817391 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f4ff1ac-7bc3-47dd-b1ba-9642ab20e20e tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:10.818263 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f4ff1ac-7bc3-47dd-b1ba-9642ab20e20e tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:10.819097 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f4ff1ac-7bc3-47dd-b1ba-9642ab20e20e tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:10.820885 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f4ff1ac-7bc3-47dd-b1ba-9642ab20e20e tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:10.821581 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f4ff1ac-7bc3-47dd-b1ba-9642ab20e20e tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:10.822288 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f4ff1ac-7bc3-47dd-b1ba-9642ab20e20e tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:10.863007 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2f4ff1ac-7bc3-47dd-b1ba-9642ab20e20e tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067430 Oct 23 01:16:10.864842 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 748/1553] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:16:10 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:16:10.882393 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c41126a8-0f46-4444-b0e5-05b79afb8336 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.809041 Oct 23 01:16:10.883880 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 806/1554] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:16:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:16:10.887202 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a7820550-b561-41c3-af06-9bbf7b93675c tempest-FlavorsV2TestJSON-725275186 tempest-FlavorsV2TestJSON-725275186-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:10.897769 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b6cbe4f3-c731-4b7c-ae2c-60befa53ec79 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:10.898746 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b6cbe4f3-c731-4b7c-ae2c-60befa53ec79 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 1fb6d268-9409-4ca5-9429-6f00ae7b86c1] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:10.931770 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a7820550-b561-41c3-af06-9bbf7b93675c tempest-FlavorsV2TestJSON-725275186 tempest-FlavorsV2TestJSON-725275186-project] 10.222.0.42 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.062263 Oct 23 01:16:10.932696 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 749/1555] 10.222.0.42 () {58 vars in 1137 bytes} [Sun Oct 23 01:16:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:16:10.950161 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6062d9fc-ba90-46c7-b80b-3c145074b5b1 tempest-FlavorsV2TestJSON-725275186 tempest-FlavorsV2TestJSON-725275186-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:10.996193 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b6cbe4f3-c731-4b7c-ae2c-60befa53ec79 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:11.010534 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b6cbe4f3-c731-4b7c-ae2c-60befa53ec79 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/1fb6d268-9409-4ca5-9429-6f00ae7b86c1" status: 200 len: 1217 microversion: 2.1 time: 0.115764 Oct 23 01:16:11.010534 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 807/1556] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:10 2022] GET /compute/v2.1/servers/1fb6d268-9409-4ca5-9429-6f00ae7b86c1 => generated 1217 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:11.038249 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c5b7bbd5-54aa-44a6-9b1f-72f0785ab9c3 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1029110695", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8972a9b2-fd35-47e0-9140-aed5efe80dbb"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:16:11.042876 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c5b7bbd5-54aa-44a6-9b1f-72f0785ab9c3 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Request method failure captured: Oct 23 01:16:11.042876 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 23 01:16:11.042876 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:16:11.042876 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:16:11.042876 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:16:11.042876 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 1266 Oct 23 01:16:11.042876 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:16:11.042876 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:16:11.042876 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:16:11.042876 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:16:11.042876 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJXAnN8glSpzjFJmkaUaiz6SrfHzbQXQKmpJba4I9yzUpRVvS20-VvHS8JBqLVlpddvCz63B1toZ2JYtfdyY6tTSU897azSYuTgHOJM9kmG8kotmljxc16KHdMfOFxcB_SPa8FrZqlhgDE3KpxfRWhyp4ImBsifEa9GX6tpMm3CYr7E Oct 23 01:16:11.042876 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:16:11.042876 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:16:11.042876 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:16:11.042876 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:16:11.042876 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:16:11.042876 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:16:11.042876 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 891f5b08deb441c0b0a6bff7b9ddb953 Oct 23 01:16:11.042876 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-756055722 Oct 23 01:16:11.042876 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:16:11.042876 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:16:11.051179 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/891f5b08deb441c0b0a6bff7b9ddb953"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_891f5b08deb441c0b0a6bff7b9ddb953"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/891f5b08deb441c0b0a6bff7b9ddb953"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/891f5b08deb441c0b0a6bff7b9ddb953"}]}] Oct 23 01:16:11.051179 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-756055722 Oct 23 01:16:11.051179 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 891f5b08deb441c0b0a6bff7b9ddb953 Oct 23 01:16:11.051179 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-756055722 Oct 23 01:16:11.051179 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServerMetadataNegativeTestJSON-756055722-project Oct 23 01:16:11.051179 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:16:11.051179 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:16:11.051179 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 9932e28d1de240f5a3b0dab50df11f31 Oct 23 01:16:11.051179 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-756055722-project Oct 23 01:16:11.051179 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:16:11.052033 n-d-master-1 devstack@n-api.service[120945]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1029110695", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8972a9b2-fd35-47e0-9140-aed5efe80dbb"}]}} Oct 23 01:16:11.052033 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:16:11.052223 n-d-master-1 devstack@n-api.service[120945]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 23 01:16:11.052223 n-d-master-1 devstack@n-api.service[120945]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1029110695', 'imageRef': '446b40bc-db5b-4123-9278-997bd6d04a0d', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '8972a9b2-fd35-47e0-9140-aed5efe80dbb'}]}}} Oct 23 01:16:11.052223 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:16:11.052223 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:16:11.052223 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 23 01:16:11.052223 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 23 01:16:11.052223 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 01:16:11.052223 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise error Oct 23 01:16:11.052223 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 23 01:16:11.052223 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:16:11.052223 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 23 01:16:11.052223 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 23 01:16:11.052223 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 23 01:16:11.052223 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 23 01:16:11.052223 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 23 01:16:11.052223 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:16:11.052223 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 23 01:16:11.054998 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 23 01:16:11.054998 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:16:11.054998 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:16:11.054998 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:16:11.054998 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:16:11.054998 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:16:11.054998 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:16:11.054998 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:16:11.054998 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:16:11.054998 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:16:11.054998 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:16:11.054998 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:16:11.054998 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:16:11.054998 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 23 01:16:11.054998 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 23 01:16:11.054998 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 23 01:16:11.054998 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 23 01:16:11.054998 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 23 01:16:11.054998 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 23 01:16:11.054998 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 23 01:16:11.054998 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:16:11.054998 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:16:11.054998 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:16:11.054998 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:16:11.054998 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:16:11.054998 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:16:11.054998 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 23 01:16:11.054998 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 23 01:16:11.060166 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 23 01:16:11.060166 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:16:11.060166 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c5b7bbd5-54aa-44a6-9b1f-72f0785ab9c3 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:16:11.060166 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c5b7bbd5-54aa-44a6-9b1f-72f0785ab9c3 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.023607 Oct 23 01:16:11.060166 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 808/1557] 10.222.0.42 () {60 vars in 1148 bytes} [Sun Oct 23 01:16:11 2022] POST /compute/v2.1/servers => generated 2221 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 23 01:16:11.062272 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:UPDATE=7 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:16:11.062414 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f48422d3-cee5-42a1-8653-ca4740a8ac7c tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:11.062414 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f48422d3-cee5-42a1-8653-ca4740a8ac7c tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] [instance: 3e2568eb-babc-4755-9b4d-9af8be356b80] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:11.062641 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6062d9fc-ba90-46c7-b80b-3c145074b5b1 tempest-FlavorsV2TestJSON-725275186 tempest-FlavorsV2TestJSON-725275186-project] 10.222.0.42 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.120087 Oct 23 01:16:11.066494 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 750/1558] 10.222.0.42 () {58 vars in 1167 bytes} [Sun Oct 23 01:16:10 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:11.080691 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f913131d-2160-45ca-a0ac-8a450b77e4a9 tempest-FlavorsV2TestJSON-725275186 tempest-FlavorsV2TestJSON-725275186-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:11.083774 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-f48422d3-cee5-42a1-8653-ca4740a8ac7c tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] HTTP exception thrown: Instance 3e2568eb-babc-4755-9b4d-9af8be356b80 could not be found. Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f48422d3-cee5-42a1-8653-ca4740a8ac7c tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Request method failure captured: Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/3e2568eb-babc-4755-9b4d-9af8be356b80/metadata/test2 HTTP/1.1 Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJXAnN8glSpzjFJmkaUaiz6SrfHzbQXQKmpJba4I9yzUpRVvS20-VvHS8JBqLVlpddvCz63B1toZ2JYtfdyY6tTSU897azSYuTgHOJM9kmG8kotmljxc16KHdMfOFxcB_SPa8FrZqlhgDE3KpxfRWhyp4ImBsifEa9GX6tpMm3CYr7E Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 891f5b08deb441c0b0a6bff7b9ddb953 Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-756055722 Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/891f5b08deb441c0b0a6bff7b9ddb953"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_891f5b08deb441c0b0a6bff7b9ddb953"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/891f5b08deb441c0b0a6bff7b9ddb953"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/891f5b08deb441c0b0a6bff7b9ddb953"}]}] Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-756055722 Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 891f5b08deb441c0b0a6bff7b9ddb953 Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-756055722 Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServerMetadataNegativeTestJSON-756055722-project Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 9932e28d1de240f5a3b0dab50df11f31 Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-756055722-project Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 3e2568eb-babc-4755-9b4d-9af8be356b80 could not be found. Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: action_args: {'server_id': '3e2568eb-babc-4755-9b4d-9af8be356b80', 'id': 'test2'} Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e2568eb-babc-4755-9b4d-9af8be356b80 could not be found. Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e2568eb-babc-4755-9b4d-9af8be356b80 could not be found. Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:16:11.086739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:16:11.091447 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:16:11.091447 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:16:11.091447 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e2568eb-babc-4755-9b4d-9af8be356b80 could not be found. Oct 23 01:16:11.091447 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:16:11.093186 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f48422d3-cee5-42a1-8653-ca4740a8ac7c tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Returning 404 to user: Instance 3e2568eb-babc-4755-9b4d-9af8be356b80 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:16:11.094647 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f48422d3-cee5-42a1-8653-ca4740a8ac7c tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] 10.222.0.42 "GET /compute/v2.1/servers/3e2568eb-babc-4755-9b4d-9af8be356b80/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.038091 Oct 23 01:16:11.100346 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 809/1559] 10.222.0.42 () {58 vars in 1281 bytes} [Sun Oct 23 01:16:11 2022] GET /compute/v2.1/servers/3e2568eb-babc-4755-9b4d-9af8be356b80/metadata/test2 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 01:16:11.105550 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-ed096471-ed96-4f54-88b1-560987901393 req-bbbd358c-42af-4944-99e1-d54c58659567 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff95f7f4-2b30-4083-8643-3f9b1d203d02", "tag": "c2891809-9683-41d8-8d60-11982de58178"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:16:11.113364 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f913131d-2160-45ca-a0ac-8a450b77e4a9 tempest-FlavorsV2TestJSON-725275186 tempest-FlavorsV2TestJSON-725275186-project] 10.222.0.42 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.036426 Oct 23 01:16:11.114187 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 751/1560] 10.222.0.42 () {58 vars in 1137 bytes} [Sun Oct 23 01:16:11 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:16:11.123968 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5e3b474d-c9f7-4963-ada3-ccc0ff9bd6bb tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:11.124477 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5e3b474d-c9f7-4963-ada3-ccc0ff9bd6bb tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] [instance: 881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:11.128509 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ed096471-ed96-4f54-88b1-560987901393 req-bbbd358c-42af-4944-99e1-d54c58659567 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:11.132623 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ed096471-ed96-4f54-88b1-560987901393 req-bbbd358c-42af-4944-99e1-d54c58659567 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:11.134095 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ed096471-ed96-4f54-88b1-560987901393 req-bbbd358c-42af-4944-99e1-d54c58659567 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:11.141546 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5e3b474d-c9f7-4963-ada3-ccc0ff9bd6bb tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:11.142068 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5e3b474d-c9f7-4963-ada3-ccc0ff9bd6bb tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:11.142507 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5e3b474d-c9f7-4963-ada3-ccc0ff9bd6bb tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:11.143208 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5e3b474d-c9f7-4963-ada3-ccc0ff9bd6bb tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:11.149142 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5e3b474d-c9f7-4963-ada3-ccc0ff9bd6bb tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:11.150029 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5e3b474d-c9f7-4963-ada3-ccc0ff9bd6bb tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:11.153784 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-ed096471-ed96-4f54-88b1-560987901393 req-bbbd358c-42af-4944-99e1-d54c58659567 service nova] Creating event network-changed:c2891809-9683-41d8-8d60-11982de58178 for instance ff95f7f4-2b30-4083-8643-3f9b1d203d02 on n-h2-master-1 Oct 23 01:16:11.168277 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-ed096471-ed96-4f54-88b1-560987901393 req-bbbd358c-42af-4944-99e1-d54c58659567 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066031 Oct 23 01:16:11.168888 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 810/1561] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:16:11.180791 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d0678cc7-ff89-46f9-b489-623ceb79f06f tempest-FlavorsV2TestJSON-725275186 tempest-FlavorsV2TestJSON-725275186-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:11.222952 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d0678cc7-ff89-46f9-b489-623ceb79f06f tempest-FlavorsV2TestJSON-725275186 tempest-FlavorsV2TestJSON-725275186-project] 10.222.0.42 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.051288 Oct 23 01:16:11.224156 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 811/1562] 10.222.0.42 () {58 vars in 1144 bytes} [Sun Oct 23 01:16:11 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:11.236541 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5e3b474d-c9f7-4963-ada3-ccc0ff9bd6bb tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] [instance: 881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:16:11.242011 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-67a78cc4-7b27-46a5-b272-c20c4a3005ca tempest-FlavorsV2TestJSON-725275186 tempest-FlavorsV2TestJSON-725275186-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:11.249964 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-67a78cc4-7b27-46a5-b272-c20c4a3005ca tempest-FlavorsV2TestJSON-725275186 tempest-FlavorsV2TestJSON-725275186-project] 10.222.0.42 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013003 Oct 23 01:16:11.257669 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 812/1563] 10.222.0.42 () {58 vars in 1137 bytes} [Sun Oct 23 01:16:11 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:16:11.262790 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6c99cff2-e431-4914-83d3-30347253c8fb tempest-FlavorsV2TestJSON-725275186 tempest-FlavorsV2TestJSON-725275186-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:11.279443 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6c99cff2-e431-4914-83d3-30347253c8fb tempest-FlavorsV2TestJSON-725275186 tempest-FlavorsV2TestJSON-725275186-project] 10.222.0.42 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.020365 Oct 23 01:16:11.280110 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 813/1564] 10.222.0.42 () {58 vars in 1148 bytes} [Sun Oct 23 01:16:11 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:11.295578 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a5f44a1b-516e-4753-b8f3-17523e077b6c tempest-FlavorsV2TestJSON-725275186 tempest-FlavorsV2TestJSON-725275186-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:11.308445 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a5f44a1b-516e-4753-b8f3-17523e077b6c tempest-FlavorsV2TestJSON-725275186 tempest-FlavorsV2TestJSON-725275186-project] 10.222.0.42 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.016593 Oct 23 01:16:11.318032 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 814/1565] 10.222.0.42 () {58 vars in 1140 bytes} [Sun Oct 23 01:16:11 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:16:11.322853 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9f45cc56-69c3-4dbd-bf2f-487fa8266251 tempest-FlavorsV2TestJSON-725275186 tempest-FlavorsV2TestJSON-725275186-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:11.331174 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9f45cc56-69c3-4dbd-bf2f-487fa8266251 tempest-FlavorsV2TestJSON-725275186 tempest-FlavorsV2TestJSON-725275186-project] 10.222.0.42 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011998 Oct 23 01:16:11.339597 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 815/1566] 10.222.0.42 () {58 vars in 1137 bytes} [Sun Oct 23 01:16:11 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:16:11.349039 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ae3e4a62-5f15-44d6-ac35-41fb0892044b tempest-FlavorsV2TestJSON-725275186 tempest-FlavorsV2TestJSON-725275186-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:11.395627 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ae3e4a62-5f15-44d6-ac35-41fb0892044b tempest-FlavorsV2TestJSON-725275186 tempest-FlavorsV2TestJSON-725275186-project] 10.222.0.42 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.054820 Oct 23 01:16:11.396207 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 816/1567] 10.222.0.42 () {58 vars in 1146 bytes} [Sun Oct 23 01:16:11 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:11.400888 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-813bacb7-0be3-47de-a106-9f419a09e4f3 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:11.401603 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-813bacb7-0be3-47de-a106-9f419a09e4f3 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:11.408540 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-813bacb7-0be3-47de-a106-9f419a09e4f3 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:11.414519 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-813bacb7-0be3-47de-a106-9f419a09e4f3 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:11.414519 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-813bacb7-0be3-47de-a106-9f419a09e4f3 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:11.414519 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-813bacb7-0be3-47de-a106-9f419a09e4f3 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:11.414519 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-813bacb7-0be3-47de-a106-9f419a09e4f3 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:11.414519 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-813bacb7-0be3-47de-a106-9f419a09e4f3 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:11.598088 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-813bacb7-0be3-47de-a106-9f419a09e4f3 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:11.608858 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-813bacb7-0be3-47de-a106-9f419a09e4f3 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1313 microversion: 2.1 time: 0.211648 Oct 23 01:16:11.609676 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 817/1568] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:11 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:11.614213 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1f706da4-4d26-4ba0-b092-b10fb9a4dfa5 tempest-FlavorsV2TestJSON-725275186 tempest-FlavorsV2TestJSON-725275186-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:11.634463 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1f706da4-4d26-4ba0-b092-b10fb9a4dfa5 tempest-FlavorsV2TestJSON-725275186 tempest-FlavorsV2TestJSON-725275186-project] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023683 Oct 23 01:16:11.636456 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 818/1569] 10.222.0.42 () {58 vars in 1146 bytes} [Sun Oct 23 01:16:11 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:11.653175 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-87ea265b-a732-4ec0-8e3a-9e6300bd5a92 tempest-FlavorsV2TestJSON-725275186 tempest-FlavorsV2TestJSON-725275186-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:11.659772 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5e3b474d-c9f7-4963-ada3-ccc0ff9bd6bb tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] 10.222.0.42 "DELETE /compute/v2.1/servers/881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40" status: 204 len: 0 microversion: 2.1 time: 0.542935 Oct 23 01:16:11.660529 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 752/1570] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:16:11 2022] DELETE /compute/v2.1/servers/881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:16:11.661163 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-87ea265b-a732-4ec0-8e3a-9e6300bd5a92 tempest-FlavorsV2TestJSON-725275186 tempest-FlavorsV2TestJSON-725275186-project] 10.222.0.42 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011648 Oct 23 01:16:11.663060 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 819/1571] 10.222.0.42 () {58 vars in 1137 bytes} [Sun Oct 23 01:16:11 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:16:11.669848 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-649b247c-ade8-46ee-a319-8f1fea64d125 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:11.670584 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-649b247c-ade8-46ee-a319-8f1fea64d125 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] [instance: 881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:11.683308 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-649b247c-ade8-46ee-a319-8f1fea64d125 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:11.683837 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-649b247c-ade8-46ee-a319-8f1fea64d125 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:11.684297 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-649b247c-ade8-46ee-a319-8f1fea64d125 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:11.685015 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-649b247c-ade8-46ee-a319-8f1fea64d125 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:11.689108 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-649b247c-ade8-46ee-a319-8f1fea64d125 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:11.689724 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-649b247c-ade8-46ee-a319-8f1fea64d125 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:11.743742 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cdd31871-7618-4da6-90a7-cfc3dc5071ae tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:11.744375 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cdd31871-7618-4da6-90a7-cfc3dc5071ae tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 4150177f-2eef-435a-99b2-efa56983c53a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:11.751008 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cdd31871-7618-4da6-90a7-cfc3dc5071ae tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:11.754119 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cdd31871-7618-4da6-90a7-cfc3dc5071ae tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:11.754119 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cdd31871-7618-4da6-90a7-cfc3dc5071ae tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:11.754119 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cdd31871-7618-4da6-90a7-cfc3dc5071ae tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:11.754119 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cdd31871-7618-4da6-90a7-cfc3dc5071ae tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:11.754564 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cdd31871-7618-4da6-90a7-cfc3dc5071ae tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:11.885403 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-649b247c-ade8-46ee-a319-8f1fea64d125 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932e28d1de240f5a3b0dab50df11f31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891f5b08deb441c0b0a6bff7b9ddb953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:11.897709 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-649b247c-ade8-46ee-a319-8f1fea64d125 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] 10.222.0.42 "GET /compute/v2.1/servers/881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40" status: 200 len: 1526 microversion: 2.1 time: 0.231339 Oct 23 01:16:11.898480 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 753/1572] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:11 2022] GET /compute/v2.1/servers/881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40 => generated 1526 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:16:11.938106 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cdd31871-7618-4da6-90a7-cfc3dc5071ae tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:11.954389 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cdd31871-7618-4da6-90a7-cfc3dc5071ae tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a" status: 200 len: 1325 microversion: 2.1 time: 0.214394 Oct 23 01:16:11.955509 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 820/1573] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:11 2022] GET /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a => generated 1325 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:16:12.052670 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7fb0cef4-7c7b-4ab6-aa4a-e934aa4683d6 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:12.052670 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7fb0cef4-7c7b-4ab6-aa4a-e934aa4683d6 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 1fb6d268-9409-4ca5-9429-6f00ae7b86c1] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:12.123391 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7fb0cef4-7c7b-4ab6-aa4a-e934aa4683d6 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:12.130617 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7fb0cef4-7c7b-4ab6-aa4a-e934aa4683d6 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/1fb6d268-9409-4ca5-9429-6f00ae7b86c1" status: 200 len: 1217 microversion: 2.1 time: 0.085176 Oct 23 01:16:12.131697 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 754/1574] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:12 2022] GET /compute/v2.1/servers/1fb6d268-9409-4ca5-9429-6f00ae7b86c1 => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:12.632445 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8a48e2b8-8ed8-4e26-a2e9-194540274036 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:12.633198 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8a48e2b8-8ed8-4e26-a2e9-194540274036 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:12.639645 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a48e2b8-8ed8-4e26-a2e9-194540274036 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:12.640380 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a48e2b8-8ed8-4e26-a2e9-194540274036 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:12.640862 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a48e2b8-8ed8-4e26-a2e9-194540274036 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:12.641498 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a48e2b8-8ed8-4e26-a2e9-194540274036 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:12.641952 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a48e2b8-8ed8-4e26-a2e9-194540274036 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:12.642425 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a48e2b8-8ed8-4e26-a2e9-194540274036 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:12.824545 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8a48e2b8-8ed8-4e26-a2e9-194540274036 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:12.837673 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8a48e2b8-8ed8-4e26-a2e9-194540274036 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1313 microversion: 2.1 time: 0.209498 Oct 23 01:16:12.854043 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 821/1575] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:12 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:12.921911 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-887a736a-2262-493e-9560-8991b57e9dd2 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:12.923742 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-887a736a-2262-493e-9560-8991b57e9dd2 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] [instance: 881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:12.944903 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-887a736a-2262-493e-9560-8991b57e9dd2 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:12.946145 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-887a736a-2262-493e-9560-8991b57e9dd2 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:12.948753 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-887a736a-2262-493e-9560-8991b57e9dd2 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:12.949799 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-887a736a-2262-493e-9560-8991b57e9dd2 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:12.950508 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-887a736a-2262-493e-9560-8991b57e9dd2 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:12.955366 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-887a736a-2262-493e-9560-8991b57e9dd2 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:13.005827 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b331c76e-2681-48f6-af0d-bcedc30279d1 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:13.007573 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b331c76e-2681-48f6-af0d-bcedc30279d1 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 4150177f-2eef-435a-99b2-efa56983c53a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:13.026638 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b331c76e-2681-48f6-af0d-bcedc30279d1 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:13.027010 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b331c76e-2681-48f6-af0d-bcedc30279d1 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:13.027629 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b331c76e-2681-48f6-af0d-bcedc30279d1 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:13.030445 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b331c76e-2681-48f6-af0d-bcedc30279d1 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:13.030910 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b331c76e-2681-48f6-af0d-bcedc30279d1 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:13.033276 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b331c76e-2681-48f6-af0d-bcedc30279d1 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:13.245291 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-887a736a-2262-493e-9560-8991b57e9dd2 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932e28d1de240f5a3b0dab50df11f31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891f5b08deb441c0b0a6bff7b9ddb953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:13.269585 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b331c76e-2681-48f6-af0d-bcedc30279d1 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:13.270333 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-887a736a-2262-493e-9560-8991b57e9dd2 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] 10.222.0.42 "GET /compute/v2.1/servers/881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40" status: 200 len: 1526 microversion: 2.1 time: 0.339990 Oct 23 01:16:13.275273 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 755/1576] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:12 2022] GET /compute/v2.1/servers/881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40 => generated 1526 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:13.283519 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-03903d6d-6886-4395-9915-0b22d50788d6 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:13.283671 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b331c76e-2681-48f6-af0d-bcedc30279d1 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a" status: 200 len: 1325 microversion: 2.1 time: 0.308173 Oct 23 01:16:13.283781 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-03903d6d-6886-4395-9915-0b22d50788d6 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 1fb6d268-9409-4ca5-9429-6f00ae7b86c1] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:13.284029 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 822/1577] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:12 2022] GET /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a => generated 1325 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:13.292278 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-03903d6d-6886-4395-9915-0b22d50788d6 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:13.292970 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-03903d6d-6886-4395-9915-0b22d50788d6 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:13.293594 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-03903d6d-6886-4395-9915-0b22d50788d6 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:13.294493 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-03903d6d-6886-4395-9915-0b22d50788d6 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:13.295108 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-03903d6d-6886-4395-9915-0b22d50788d6 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:13.295695 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-03903d6d-6886-4395-9915-0b22d50788d6 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:13.405593 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-03903d6d-6886-4395-9915-0b22d50788d6 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:13.415393 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-03903d6d-6886-4395-9915-0b22d50788d6 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/1fb6d268-9409-4ca5-9429-6f00ae7b86c1" status: 200 len: 1269 microversion: 2.1 time: 0.138246 Oct 23 01:16:13.416654 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 756/1578] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:13 2022] GET /compute/v2.1/servers/1fb6d268-9409-4ca5-9429-6f00ae7b86c1 => generated 1269 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:13.861937 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9b8a2874-e809-462d-b184-7655e7e7508e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:13.864602 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9b8a2874-e809-462d-b184-7655e7e7508e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:13.870622 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b8a2874-e809-462d-b184-7655e7e7508e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:13.871456 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b8a2874-e809-462d-b184-7655e7e7508e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:13.872052 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b8a2874-e809-462d-b184-7655e7e7508e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:13.872939 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b8a2874-e809-462d-b184-7655e7e7508e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:13.873562 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b8a2874-e809-462d-b184-7655e7e7508e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:13.874006 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b8a2874-e809-462d-b184-7655e7e7508e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:14.030273 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9b8a2874-e809-462d-b184-7655e7e7508e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:14.038843 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9b8a2874-e809-462d-b184-7655e7e7508e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1313 microversion: 2.1 time: 0.180520 Oct 23 01:16:14.054560 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 823/1579] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:13 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:14.204892 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b28c7307-cafd-4cd0-a0d3-02c3688b1ac0 tempest-ImagesMetadataTestJSON-1031665108 tempest-ImagesMetadataTestJSON-1031665108-project] Calling method '.version_select at 0x7f5cc18774c0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:14.260980 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b28c7307-cafd-4cd0-a0d3-02c3688b1ac0 tempest-ImagesMetadataTestJSON-1031665108 tempest-ImagesMetadataTestJSON-1031665108-project] 10.222.0.42 "GET /compute/v2.1/images/278344ae-0386-4884-b956-8354866f8b47" status: 200 len: 636 microversion: 2.1 time: 0.059177 Oct 23 01:16:14.261361 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 757/1580] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:16:14 2022] GET /compute/v2.1/images/278344ae-0386-4884-b956-8354866f8b47 => generated 636 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:16:14.279584 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7f56259e-e815-4338-9602-b54749f1c9a1 tempest-ImagesMetadataTestJSON-1031665108 tempest-ImagesMetadataTestJSON-1031665108-project] Action: 'update_all', calling method: .version_select at 0x7f5cc222eb80>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:16:14.300471 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-98cd9804-d974-43f7-a9e9-1e5b30af9f0e tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:14.309232 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-98cd9804-d974-43f7-a9e9-1e5b30af9f0e tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] [instance: 881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:14.344847 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-98cd9804-d974-43f7-a9e9-1e5b30af9f0e tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:14.353894 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-98cd9804-d974-43f7-a9e9-1e5b30af9f0e tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:14.356285 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-98cd9804-d974-43f7-a9e9-1e5b30af9f0e tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:14.358307 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-98cd9804-d974-43f7-a9e9-1e5b30af9f0e tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:14.360534 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-98cd9804-d974-43f7-a9e9-1e5b30af9f0e tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:14.361362 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-98cd9804-d974-43f7-a9e9-1e5b30af9f0e tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:14.389358 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-7f56259e-e815-4338-9602-b54749f1c9a1 tempest-ImagesMetadataTestJSON-1031665108 tempest-ImagesMetadataTestJSON-1031665108-project] Getting quotas for project cd4dff948dba451c86b7ba29927a8b45. Resources: dict_keys(['metadata_items']) {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:16:14.415902 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-7f56259e-e815-4338-9602-b54749f1c9a1 tempest-ImagesMetadataTestJSON-1031665108 tempest-ImagesMetadataTestJSON-1031665108-project] Getting quotas for user 1e5066f2717f4d7bbde5347fc4903927 and project cd4dff948dba451c86b7ba29927a8b45. Resources: dict_keys(['metadata_items']) {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:16:14.722725 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-98cd9804-d974-43f7-a9e9-1e5b30af9f0e tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932e28d1de240f5a3b0dab50df11f31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891f5b08deb441c0b0a6bff7b9ddb953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:14.732318 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-98cd9804-d974-43f7-a9e9-1e5b30af9f0e tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] 10.222.0.42 "GET /compute/v2.1/servers/881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40" status: 200 len: 1526 microversion: 2.1 time: 0.431242 Oct 23 01:16:14.747500 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 758/1581] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:14 2022] GET /compute/v2.1/servers/881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40 => generated 1526 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:16:14.747500 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e1ff9cc0-97fe-4c51-adca-cae7bba3300d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:14.747500 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e1ff9cc0-97fe-4c51-adca-cae7bba3300d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 4150177f-2eef-435a-99b2-efa56983c53a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:14.758870 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e1ff9cc0-97fe-4c51-adca-cae7bba3300d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:14.759873 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e1ff9cc0-97fe-4c51-adca-cae7bba3300d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:14.760998 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e1ff9cc0-97fe-4c51-adca-cae7bba3300d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:14.770893 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e1ff9cc0-97fe-4c51-adca-cae7bba3300d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:14.770893 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e1ff9cc0-97fe-4c51-adca-cae7bba3300d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:14.770893 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e1ff9cc0-97fe-4c51-adca-cae7bba3300d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:15.004994 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7f56259e-e815-4338-9602-b54749f1c9a1 tempest-ImagesMetadataTestJSON-1031665108 tempest-ImagesMetadataTestJSON-1031665108-project] 10.222.0.42 "PUT /compute/v2.1/images/278344ae-0386-4884-b956-8354866f8b47/metadata" status: 200 len: 61 microversion: 2.1 time: 0.732919 Oct 23 01:16:15.006815 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 824/1582] 10.222.0.42 () {60 vars in 1280 bytes} [Sun Oct 23 01:16:14 2022] PUT /compute/v2.1/images/278344ae-0386-4884-b956-8354866f8b47/metadata => generated 61 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:16:15.012943 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7e8cb9f1-f371-4261-a0b5-bd8b7aea87ac tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:15.013567 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7e8cb9f1-f371-4261-a0b5-bd8b7aea87ac tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 1fb6d268-9409-4ca5-9429-6f00ae7b86c1] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:15.020652 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7e8cb9f1-f371-4261-a0b5-bd8b7aea87ac tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:15.022048 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7e8cb9f1-f371-4261-a0b5-bd8b7aea87ac tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:15.023668 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7e8cb9f1-f371-4261-a0b5-bd8b7aea87ac tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:15.024713 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7e8cb9f1-f371-4261-a0b5-bd8b7aea87ac tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:15.025342 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7e8cb9f1-f371-4261-a0b5-bd8b7aea87ac tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:15.025930 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7e8cb9f1-f371-4261-a0b5-bd8b7aea87ac tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:15.074514 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e1ff9cc0-97fe-4c51-adca-cae7bba3300d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:15.085316 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e1ff9cc0-97fe-4c51-adca-cae7bba3300d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a" status: 200 len: 1325 microversion: 2.1 time: 0.350715 Oct 23 01:16:15.090505 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 759/1583] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:14 2022] GET /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a => generated 1325 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:15.104239 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c39653d0-a80b-41d8-9858-3af311231c2d tempest-ImagesMetadataTestJSON-1031665108 tempest-ImagesMetadataTestJSON-1031665108-project] Calling method '.version_select at 0x7f5cc172d9d0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:15.219986 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7e8cb9f1-f371-4261-a0b5-bd8b7aea87ac tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:15.228666 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7e8cb9f1-f371-4261-a0b5-bd8b7aea87ac tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/1fb6d268-9409-4ca5-9429-6f00ae7b86c1" status: 200 len: 1275 microversion: 2.1 time: 0.220588 Oct 23 01:16:15.231522 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 825/1584] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:15 2022] GET /compute/v2.1/servers/1fb6d268-9409-4ca5-9429-6f00ae7b86c1 => generated 1275 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:15.250993 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-dd166c97-7eb0-42ca-9928-80251dac89f5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:15.252898 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-dd166c97-7eb0-42ca-9928-80251dac89f5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:15.263919 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dd166c97-7eb0-42ca-9928-80251dac89f5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:15.265080 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dd166c97-7eb0-42ca-9928-80251dac89f5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:15.265683 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dd166c97-7eb0-42ca-9928-80251dac89f5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:15.268936 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dd166c97-7eb0-42ca-9928-80251dac89f5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:15.269681 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dd166c97-7eb0-42ca-9928-80251dac89f5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:15.270301 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dd166c97-7eb0-42ca-9928-80251dac89f5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:15.557234 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-dd166c97-7eb0-42ca-9928-80251dac89f5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:15.572195 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-dd166c97-7eb0-42ca-9928-80251dac89f5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1313 microversion: 2.1 time: 0.338020 Oct 23 01:16:15.582061 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 826/1585] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:15 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1313 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:15.591966 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-7dffbd8d-28f3-4ad8-86ae-b09ad07225c4 req-1ae55f05-84ed-4537-911e-73cbca228968 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4150177f-2eef-435a-99b2-efa56983c53a", "name": "network-vif-plugged", "status": "completed", "tag": "50e0e9ab-b232-47f9-97de-7b93cc03e0c2"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:16:15.622305 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-7dffbd8d-28f3-4ad8-86ae-b09ad07225c4 req-1ae55f05-84ed-4537-911e-73cbca228968 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:15.622806 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-7dffbd8d-28f3-4ad8-86ae-b09ad07225c4 req-1ae55f05-84ed-4537-911e-73cbca228968 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:15.623236 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-7dffbd8d-28f3-4ad8-86ae-b09ad07225c4 req-1ae55f05-84ed-4537-911e-73cbca228968 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:15.647320 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c39653d0-a80b-41d8-9858-3af311231c2d tempest-ImagesMetadataTestJSON-1031665108 tempest-ImagesMetadataTestJSON-1031665108-project] 10.222.0.42 "DELETE /compute/v2.1/images/278344ae-0386-4884-b956-8354866f8b47/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.555466 Oct 23 01:16:15.648031 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 760/1586] 10.222.0.42 () {58 vars in 1296 bytes} [Sun Oct 23 01:16:15 2022] DELETE /compute/v2.1/images/278344ae-0386-4884-b956-8354866f8b47/metadata/os_version => generated 0 bytes in 557 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:16:15.653473 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-7dffbd8d-28f3-4ad8-86ae-b09ad07225c4 req-1ae55f05-84ed-4537-911e-73cbca228968 service nova] Creating event network-vif-plugged:50e0e9ab-b232-47f9-97de-7b93cc03e0c2 for instance 4150177f-2eef-435a-99b2-efa56983c53a on n-h2-master-1 Oct 23 01:16:15.655925 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-f3e423ce-60b8-46b5-9b06-2ca75ca88998 req-e9128c7c-6bb8-4806-9cab-10aa17c268b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40", "name": "network-vif-deleted", "tag": "da3f90c4-7b6b-4da0-bfab-d7a62593c2c8"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:16:15.660429 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-7dffbd8d-28f3-4ad8-86ae-b09ad07225c4 req-1ae55f05-84ed-4537-911e-73cbca228968 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086318 Oct 23 01:16:15.661558 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 827/1587] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:16:15.669727 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ef3b0833-48ec-4679-b782-b0db7f2d7115 tempest-ImagesMetadataTestJSON-1031665108 tempest-ImagesMetadataTestJSON-1031665108-project] Calling method '.version_select at 0x7f5cc258e4c0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:15.676503 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-f3e423ce-60b8-46b5-9b06-2ca75ca88998 req-e9128c7c-6bb8-4806-9cab-10aa17c268b4 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:15.677419 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-f3e423ce-60b8-46b5-9b06-2ca75ca88998 req-e9128c7c-6bb8-4806-9cab-10aa17c268b4 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:15.678638 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-f3e423ce-60b8-46b5-9b06-2ca75ca88998 req-e9128c7c-6bb8-4806-9cab-10aa17c268b4 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:15.704484 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-f3e423ce-60b8-46b5-9b06-2ca75ca88998 req-e9128c7c-6bb8-4806-9cab-10aa17c268b4 service nova] Creating event network-vif-deleted:da3f90c4-7b6b-4da0-bfab-d7a62593c2c8 for instance 881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40 on n-h2-master-1 Oct 23 01:16:15.720236 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-f3e423ce-60b8-46b5-9b06-2ca75ca88998 req-e9128c7c-6bb8-4806-9cab-10aa17c268b4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069364 Oct 23 01:16:15.725381 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 761/1588] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:16:15.728268 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ef3b0833-48ec-4679-b782-b0db7f2d7115 tempest-ImagesMetadataTestJSON-1031665108 tempest-ImagesMetadataTestJSON-1031665108-project] 10.222.0.42 "GET /compute/v2.1/images/278344ae-0386-4884-b956-8354866f8b47/metadata" status: 200 len: 37 microversion: 2.1 time: 0.064636 Oct 23 01:16:15.735389 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 828/1589] 10.222.0.42 () {58 vars in 1260 bytes} [Sun Oct 23 01:16:15 2022] GET /compute/v2.1/images/278344ae-0386-4884-b956-8354866f8b47/metadata => generated 37 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:16:15.746642 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-343f9ed6-da34-4d9d-945c-32ddf062a2ea tempest-ImagesMetadataTestJSON-1031665108 tempest-ImagesMetadataTestJSON-1031665108-project] Action: 'update_all', calling method: .version_select at 0x7f5cc19fe820>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:16:15.765929 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d6ff0ff7-2c53-49b3-a870-dc991ed22cb1 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:15.767586 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d6ff0ff7-2c53-49b3-a870-dc991ed22cb1 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] [instance: 881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:15.775465 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d6ff0ff7-2c53-49b3-a870-dc991ed22cb1 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:15.776312 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d6ff0ff7-2c53-49b3-a870-dc991ed22cb1 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:15.777154 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d6ff0ff7-2c53-49b3-a870-dc991ed22cb1 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:15.778363 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d6ff0ff7-2c53-49b3-a870-dc991ed22cb1 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:15.779059 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d6ff0ff7-2c53-49b3-a870-dc991ed22cb1 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:15.779547 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d6ff0ff7-2c53-49b3-a870-dc991ed22cb1 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:15.809926 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-343f9ed6-da34-4d9d-945c-32ddf062a2ea tempest-ImagesMetadataTestJSON-1031665108 tempest-ImagesMetadataTestJSON-1031665108-project] Getting quotas for project cd4dff948dba451c86b7ba29927a8b45. Resources: dict_keys(['metadata_items']) {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:16:15.819560 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-343f9ed6-da34-4d9d-945c-32ddf062a2ea tempest-ImagesMetadataTestJSON-1031665108 tempest-ImagesMetadataTestJSON-1031665108-project] Getting quotas for user 1e5066f2717f4d7bbde5347fc4903927 and project cd4dff948dba451c86b7ba29927a8b45. Resources: dict_keys(['metadata_items']) {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:16:15.913297 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d6ff0ff7-2c53-49b3-a870-dc991ed22cb1 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932e28d1de240f5a3b0dab50df11f31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891f5b08deb441c0b0a6bff7b9ddb953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:15.923706 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d6ff0ff7-2c53-49b3-a870-dc991ed22cb1 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] 10.222.0.42 "GET /compute/v2.1/servers/881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40" status: 200 len: 1484 microversion: 2.1 time: 0.161428 Oct 23 01:16:15.924297 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 829/1590] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:15 2022] GET /compute/v2.1/servers/881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40 => generated 1484 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:16.109603 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-183b9c03-1580-429c-adfb-e4dff4822e29 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:16.110452 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-183b9c03-1580-429c-adfb-e4dff4822e29 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 4150177f-2eef-435a-99b2-efa56983c53a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:16.119564 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-183b9c03-1580-429c-adfb-e4dff4822e29 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:16.120038 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-183b9c03-1580-429c-adfb-e4dff4822e29 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:16.121595 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-183b9c03-1580-429c-adfb-e4dff4822e29 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:16.126924 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-183b9c03-1580-429c-adfb-e4dff4822e29 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:16.131593 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-183b9c03-1580-429c-adfb-e4dff4822e29 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:16.132301 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-183b9c03-1580-429c-adfb-e4dff4822e29 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:16.279044 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-343f9ed6-da34-4d9d-945c-32ddf062a2ea tempest-ImagesMetadataTestJSON-1031665108 tempest-ImagesMetadataTestJSON-1031665108-project] 10.222.0.42 "PUT /compute/v2.1/images/278344ae-0386-4884-b956-8354866f8b47/metadata" status: 200 len: 61 microversion: 2.1 time: 0.543288 Oct 23 01:16:16.279644 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 762/1591] 10.222.0.42 () {60 vars in 1280 bytes} [Sun Oct 23 01:16:15 2022] PUT /compute/v2.1/images/278344ae-0386-4884-b956-8354866f8b47/metadata => generated 61 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:16:16.288430 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-08463418-78b9-4054-bb31-633e0a4d3ab8 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:16.289511 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-08463418-78b9-4054-bb31-633e0a4d3ab8 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 1fb6d268-9409-4ca5-9429-6f00ae7b86c1] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:16.297766 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-08463418-78b9-4054-bb31-633e0a4d3ab8 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:16.298891 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-08463418-78b9-4054-bb31-633e0a4d3ab8 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:16.299647 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-08463418-78b9-4054-bb31-633e0a4d3ab8 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:16.300605 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-08463418-78b9-4054-bb31-633e0a4d3ab8 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:16.302226 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-08463418-78b9-4054-bb31-633e0a4d3ab8 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:16.308890 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-08463418-78b9-4054-bb31-633e0a4d3ab8 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:16.913760 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-08463418-78b9-4054-bb31-633e0a4d3ab8 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:16.916394 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-183b9c03-1580-429c-adfb-e4dff4822e29 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:16.924501 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-08463418-78b9-4054-bb31-633e0a4d3ab8 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/1fb6d268-9409-4ca5-9429-6f00ae7b86c1" status: 200 len: 1317 microversion: 2.1 time: 0.642838 Oct 23 01:16:16.934968 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 763/1592] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:16 2022] GET /compute/v2.1/servers/1fb6d268-9409-4ca5-9429-6f00ae7b86c1 => generated 1317 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:16.938266 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-183b9c03-1580-429c-adfb-e4dff4822e29 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a" status: 200 len: 1325 microversion: 2.1 time: 0.831438 Oct 23 01:16:16.938266 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 830/1593] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:16 2022] GET /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a => generated 1325 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:16.946440 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-83b0606c-ffcf-4809-8a43-d81486a4bacb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:16.947065 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-83b0606c-ffcf-4809-8a43-d81486a4bacb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:16.953021 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83b0606c-ffcf-4809-8a43-d81486a4bacb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:16.953506 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83b0606c-ffcf-4809-8a43-d81486a4bacb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:16.953940 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83b0606c-ffcf-4809-8a43-d81486a4bacb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:16.954719 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83b0606c-ffcf-4809-8a43-d81486a4bacb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:16.955181 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83b0606c-ffcf-4809-8a43-d81486a4bacb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:16.955608 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83b0606c-ffcf-4809-8a43-d81486a4bacb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:16.960266 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=100 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:16:16.960749 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6a076968-726f-47cc-b63c-daeeea785d6b tempest-ImagesMetadataTestJSON-1031665108 tempest-ImagesMetadataTestJSON-1031665108-project] Calling method '.version_select at 0x7f5cc18ed550>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:17.002518 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6a076968-726f-47cc-b63c-daeeea785d6b tempest-ImagesMetadataTestJSON-1031665108 tempest-ImagesMetadataTestJSON-1031665108-project] 10.222.0.42 "GET /compute/v2.1/images/278344ae-0386-4884-b956-8354866f8b47/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.066160 Oct 23 01:16:17.003319 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 764/1594] 10.222.0.42 () {58 vars in 1290 bytes} [Sun Oct 23 01:16:16 2022] GET /compute/v2.1/images/278344ae-0386-4884-b956-8354866f8b47/metadata/os_distro => generated 33 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:16:17.013598 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-958855b2-7b89-47a9-8fd8-9510e1e97dde tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:17.014803 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-958855b2-7b89-47a9-8fd8-9510e1e97dde tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] [instance: 881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:17.021611 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-958855b2-7b89-47a9-8fd8-9510e1e97dde tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:17.022262 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-958855b2-7b89-47a9-8fd8-9510e1e97dde tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:17.022708 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-958855b2-7b89-47a9-8fd8-9510e1e97dde tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:17.024217 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-958855b2-7b89-47a9-8fd8-9510e1e97dde tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:17.025199 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-958855b2-7b89-47a9-8fd8-9510e1e97dde tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:17.026311 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-958855b2-7b89-47a9-8fd8-9510e1e97dde tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:17.078794 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-958855b2-7b89-47a9-8fd8-9510e1e97dde tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:17.079890 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-958855b2-7b89-47a9-8fd8-9510e1e97dde tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:17.080338 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-958855b2-7b89-47a9-8fd8-9510e1e97dde tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:17.080799 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-958855b2-7b89-47a9-8fd8-9510e1e97dde tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lazy-loading 'fault' on Instance uuid 881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:16:17.182608 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-958855b2-7b89-47a9-8fd8-9510e1e97dde tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932e28d1de240f5a3b0dab50df11f31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891f5b08deb441c0b0a6bff7b9ddb953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:17.191381 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-958855b2-7b89-47a9-8fd8-9510e1e97dde tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] 10.222.0.42 "GET /compute/v2.1/servers/881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40" status: 200 len: 1313 microversion: 2.1 time: 0.186875 Oct 23 01:16:17.207376 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 765/1595] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:17 2022] GET /compute/v2.1/servers/881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40 => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:17.212582 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8539f69a-886d-4f5e-a0d5-4189909cc431 tempest-ImagesMetadataTestJSON-1031665108 tempest-ImagesMetadataTestJSON-1031665108-project] Action: 'update_all', calling method: .version_select at 0x7f5cc172de50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:16:17.270711 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-8539f69a-886d-4f5e-a0d5-4189909cc431 tempest-ImagesMetadataTestJSON-1031665108 tempest-ImagesMetadataTestJSON-1031665108-project] Getting quotas for project cd4dff948dba451c86b7ba29927a8b45. Resources: dict_keys(['metadata_items']) {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:16:17.277996 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-8539f69a-886d-4f5e-a0d5-4189909cc431 tempest-ImagesMetadataTestJSON-1031665108 tempest-ImagesMetadataTestJSON-1031665108-project] Getting quotas for user 1e5066f2717f4d7bbde5347fc4903927 and project cd4dff948dba451c86b7ba29927a8b45. Resources: dict_keys(['metadata_items']) {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:16:17.340121 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-83b0606c-ffcf-4809-8a43-d81486a4bacb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:17.348534 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-83b0606c-ffcf-4809-8a43-d81486a4bacb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1313 microversion: 2.1 time: 0.408885 Oct 23 01:16:17.349118 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 831/1596] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:16 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1313 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:17.455030 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8539f69a-886d-4f5e-a0d5-4189909cc431 tempest-ImagesMetadataTestJSON-1031665108 tempest-ImagesMetadataTestJSON-1031665108-project] 10.222.0.42 "PUT /compute/v2.1/images/278344ae-0386-4884-b956-8354866f8b47/metadata" status: 200 len: 61 microversion: 2.1 time: 0.254232 Oct 23 01:16:17.455813 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 766/1597] 10.222.0.42 () {60 vars in 1280 bytes} [Sun Oct 23 01:16:17 2022] PUT /compute/v2.1/images/278344ae-0386-4884-b956-8354866f8b47/metadata => generated 61 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:16:17.466290 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e7b08263-2e61-45ad-b97a-c06274d85b64 tempest-ImagesMetadataTestJSON-1031665108 tempest-ImagesMetadataTestJSON-1031665108-project] Calling method '.version_select at 0x7f5cc24304c0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:17.518894 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e7b08263-2e61-45ad-b97a-c06274d85b64 tempest-ImagesMetadataTestJSON-1031665108 tempest-ImagesMetadataTestJSON-1031665108-project] 10.222.0.42 "GET /compute/v2.1/images/278344ae-0386-4884-b956-8354866f8b47/metadata" status: 200 len: 61 microversion: 2.1 time: 0.056380 Oct 23 01:16:17.525326 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 832/1598] 10.222.0.42 () {58 vars in 1260 bytes} [Sun Oct 23 01:16:17 2022] GET /compute/v2.1/images/278344ae-0386-4884-b956-8354866f8b47/metadata => generated 61 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:16:17.531062 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b17c80eb-4197-4811-bee7-78148b491831 tempest-ImagesMetadataTestJSON-1031665108 tempest-ImagesMetadataTestJSON-1031665108-project] Action: 'update_all', calling method: .version_select at 0x7f5cc174f280>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:16:17.584638 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-b17c80eb-4197-4811-bee7-78148b491831 tempest-ImagesMetadataTestJSON-1031665108 tempest-ImagesMetadataTestJSON-1031665108-project] Getting quotas for project cd4dff948dba451c86b7ba29927a8b45. Resources: dict_keys(['metadata_items']) {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:16:17.590582 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-b17c80eb-4197-4811-bee7-78148b491831 tempest-ImagesMetadataTestJSON-1031665108 tempest-ImagesMetadataTestJSON-1031665108-project] Getting quotas for user 1e5066f2717f4d7bbde5347fc4903927 and project cd4dff948dba451c86b7ba29927a8b45. Resources: dict_keys(['metadata_items']) {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:16:17.802631 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=4 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:16:17.835137 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b17c80eb-4197-4811-bee7-78148b491831 tempest-ImagesMetadataTestJSON-1031665108 tempest-ImagesMetadataTestJSON-1031665108-project] 10.222.0.42 "PUT /compute/v2.1/images/278344ae-0386-4884-b956-8354866f8b47/metadata" status: 200 len: 61 microversion: 2.1 time: 0.306659 Oct 23 01:16:17.837418 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 767/1599] 10.222.0.42 () {60 vars in 1280 bytes} [Sun Oct 23 01:16:17 2022] PUT /compute/v2.1/images/278344ae-0386-4884-b956-8354866f8b47/metadata => generated 61 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 23 01:16:17.847697 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-26e9e0d0-2365-48f0-8e51-687dd490aa99 tempest-ImagesMetadataTestJSON-1031665108 tempest-ImagesMetadataTestJSON-1031665108-project] Action: 'update_all', calling method: .version_select at 0x7f5cc1f71f70>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:16:17.941108 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=35,nova_cell0:UPDATE=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:16:17.948880 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-26e9e0d0-2365-48f0-8e51-687dd490aa99 tempest-ImagesMetadataTestJSON-1031665108 tempest-ImagesMetadataTestJSON-1031665108-project] Getting quotas for project cd4dff948dba451c86b7ba29927a8b45. Resources: dict_keys(['metadata_items']) {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:16:17.966854 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ec2181a6-f4a4-4fe6-a3f2-8c17faeddfc9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:17.967464 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ec2181a6-f4a4-4fe6-a3f2-8c17faeddfc9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 1fb6d268-9409-4ca5-9429-6f00ae7b86c1] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:17.969247 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-26e9e0d0-2365-48f0-8e51-687dd490aa99 tempest-ImagesMetadataTestJSON-1031665108 tempest-ImagesMetadataTestJSON-1031665108-project] Getting quotas for user 1e5066f2717f4d7bbde5347fc4903927 and project cd4dff948dba451c86b7ba29927a8b45. Resources: dict_keys(['metadata_items']) {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:16:17.979566 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ec2181a6-f4a4-4fe6-a3f2-8c17faeddfc9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:17.980076 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ec2181a6-f4a4-4fe6-a3f2-8c17faeddfc9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:17.982972 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ec2181a6-f4a4-4fe6-a3f2-8c17faeddfc9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:17.998384 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ec2181a6-f4a4-4fe6-a3f2-8c17faeddfc9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:18.001809 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ec2181a6-f4a4-4fe6-a3f2-8c17faeddfc9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:18.008221 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ec2181a6-f4a4-4fe6-a3f2-8c17faeddfc9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:18.293095 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ec2181a6-f4a4-4fe6-a3f2-8c17faeddfc9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:18.303122 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ec2181a6-f4a4-4fe6-a3f2-8c17faeddfc9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/1fb6d268-9409-4ca5-9429-6f00ae7b86c1" status: 200 len: 1317 microversion: 2.1 time: 0.341458 Oct 23 01:16:18.305039 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 768/1600] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:17 2022] GET /compute/v2.1/servers/1fb6d268-9409-4ca5-9429-6f00ae7b86c1 => generated 1317 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:16:18.328292 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bac69a0e-6936-4070-a09a-702c17609c9b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:18.329500 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bac69a0e-6936-4070-a09a-702c17609c9b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 4150177f-2eef-435a-99b2-efa56983c53a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:18.353543 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bac69a0e-6936-4070-a09a-702c17609c9b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:18.359056 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bac69a0e-6936-4070-a09a-702c17609c9b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:18.359899 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bac69a0e-6936-4070-a09a-702c17609c9b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:18.363458 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bac69a0e-6936-4070-a09a-702c17609c9b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:18.364254 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bac69a0e-6936-4070-a09a-702c17609c9b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:18.364861 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bac69a0e-6936-4070-a09a-702c17609c9b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:18.626107 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-26e9e0d0-2365-48f0-8e51-687dd490aa99 tempest-ImagesMetadataTestJSON-1031665108 tempest-ImagesMetadataTestJSON-1031665108-project] 10.222.0.42 "PUT /compute/v2.1/images/278344ae-0386-4884-b956-8354866f8b47/metadata" status: 200 len: 64 microversion: 2.1 time: 0.783049 Oct 23 01:16:18.627560 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 833/1601] 10.222.0.42 () {60 vars in 1280 bytes} [Sun Oct 23 01:16:17 2022] PUT /compute/v2.1/images/278344ae-0386-4884-b956-8354866f8b47/metadata => generated 64 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:16:18.633636 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-9c720e1f-6b57-4253-b94d-31f504d25387 req-412da239-38a7-4550-a399-8cca59565fc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fb6d268-9409-4ca5-9429-6f00ae7b86c1", "tag": "3fa70d62-e26e-4dbc-b762-9137ae590232"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:16:18.644845 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-9c720e1f-6b57-4253-b94d-31f504d25387 req-412da239-38a7-4550-a399-8cca59565fc3 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:18.645455 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-9c720e1f-6b57-4253-b94d-31f504d25387 req-412da239-38a7-4550-a399-8cca59565fc3 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:18.646450 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-9c720e1f-6b57-4253-b94d-31f504d25387 req-412da239-38a7-4550-a399-8cca59565fc3 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:18.656359 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bac69a0e-6936-4070-a09a-702c17609c9b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:18.663171 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-9c720e1f-6b57-4253-b94d-31f504d25387 req-412da239-38a7-4550-a399-8cca59565fc3 service nova] Creating event network-changed:3fa70d62-e26e-4dbc-b762-9137ae590232 for instance 1fb6d268-9409-4ca5-9429-6f00ae7b86c1 on n-h1-master-1 Oct 23 01:16:18.664650 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bac69a0e-6936-4070-a09a-702c17609c9b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a" status: 200 len: 1325 microversion: 2.1 time: 0.358266 Oct 23 01:16:18.665262 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 769/1602] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:18 2022] GET /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a => generated 1325 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:18.683136 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d938f450-5a9f-4793-a004-5c0bfb5424a4 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:18.684064 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-9c720e1f-6b57-4253-b94d-31f504d25387 req-412da239-38a7-4550-a399-8cca59565fc3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054946 Oct 23 01:16:18.685315 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 834/1603] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:16:18.689441 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d938f450-5a9f-4793-a004-5c0bfb5424a4 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] [instance: 881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:18.691107 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a4a231e4-fd07-4562-85dd-f13acc9d10cb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:18.692690 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a4a231e4-fd07-4562-85dd-f13acc9d10cb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:18.696727 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d938f450-5a9f-4793-a004-5c0bfb5424a4 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:18.702309 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d938f450-5a9f-4793-a004-5c0bfb5424a4 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:18.702309 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d938f450-5a9f-4793-a004-5c0bfb5424a4 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:18.704013 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a4a231e4-fd07-4562-85dd-f13acc9d10cb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:18.704767 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a4a231e4-fd07-4562-85dd-f13acc9d10cb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:18.705283 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d938f450-5a9f-4793-a004-5c0bfb5424a4 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:18.705850 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d938f450-5a9f-4793-a004-5c0bfb5424a4 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:18.706370 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a4a231e4-fd07-4562-85dd-f13acc9d10cb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:18.707487 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a4a231e4-fd07-4562-85dd-f13acc9d10cb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:18.708032 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d938f450-5a9f-4793-a004-5c0bfb5424a4 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:18.708279 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a4a231e4-fd07-4562-85dd-f13acc9d10cb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:18.708890 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a4a231e4-fd07-4562-85dd-f13acc9d10cb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:18.757603 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:16:18.774720 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d938f450-5a9f-4793-a004-5c0bfb5424a4 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:18.775546 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d938f450-5a9f-4793-a004-5c0bfb5424a4 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:18.776093 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d938f450-5a9f-4793-a004-5c0bfb5424a4 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:18.776656 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-d938f450-5a9f-4793-a004-5c0bfb5424a4 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lazy-loading 'fault' on Instance uuid 881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:16:18.883290 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d938f450-5a9f-4793-a004-5c0bfb5424a4 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932e28d1de240f5a3b0dab50df11f31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891f5b08deb441c0b0a6bff7b9ddb953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:18.894935 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d938f450-5a9f-4793-a004-5c0bfb5424a4 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] 10.222.0.42 "GET /compute/v2.1/servers/881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40" status: 200 len: 1313 microversion: 2.1 time: 0.228555 Oct 23 01:16:18.928302 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 770/1604] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:18 2022] GET /compute/v2.1/servers/881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40 => generated 1313 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:18.938667 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-51c37434-1784-4cbb-9e2a-2ba2f97eb457 tempest-ImagesMetadataTestJSON-1031665108 tempest-ImagesMetadataTestJSON-1031665108-project] Calling method '.version_select at 0x7f5cc19fe3a0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:19.025829 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-51c37434-1784-4cbb-9e2a-2ba2f97eb457 tempest-ImagesMetadataTestJSON-1031665108 tempest-ImagesMetadataTestJSON-1031665108-project] 10.222.0.42 "GET /compute/v2.1/images/278344ae-0386-4884-b956-8354866f8b47/metadata" status: 200 len: 64 microversion: 2.1 time: 0.095891 Oct 23 01:16:19.027251 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 771/1605] 10.222.0.42 () {58 vars in 1260 bytes} [Sun Oct 23 01:16:18 2022] GET /compute/v2.1/images/278344ae-0386-4884-b956-8354866f8b47/metadata => generated 64 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:16:19.039178 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9d5e93ce-4eea-474c-9f56-61b1b7492d97 tempest-ImagesMetadataTestJSON-1031665108 tempest-ImagesMetadataTestJSON-1031665108-project] Action: 'update_all', calling method: .version_select at 0x7f5cc1870040>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:16:19.157840 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-9d5e93ce-4eea-474c-9f56-61b1b7492d97 tempest-ImagesMetadataTestJSON-1031665108 tempest-ImagesMetadataTestJSON-1031665108-project] Getting quotas for project cd4dff948dba451c86b7ba29927a8b45. Resources: dict_keys(['metadata_items']) {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:16:19.169446 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-9d5e93ce-4eea-474c-9f56-61b1b7492d97 tempest-ImagesMetadataTestJSON-1031665108 tempest-ImagesMetadataTestJSON-1031665108-project] Getting quotas for user 1e5066f2717f4d7bbde5347fc4903927 and project cd4dff948dba451c86b7ba29927a8b45. Resources: dict_keys(['metadata_items']) {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:16:19.241865 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a4a231e4-fd07-4562-85dd-f13acc9d10cb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:19.272525 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a4a231e4-fd07-4562-85dd-f13acc9d10cb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1313 microversion: 2.1 time: 0.585793 Oct 23 01:16:19.274485 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 835/1606] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:18 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1313 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:19.329753 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-50321e19-afa3-4132-bbf5-790b5795d8b6 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:19.331096 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-50321e19-afa3-4132-bbf5-790b5795d8b6 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 1fb6d268-9409-4ca5-9429-6f00ae7b86c1] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:19.335706 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:16:19.348638 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-50321e19-afa3-4132-bbf5-790b5795d8b6 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:19.358146 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-50321e19-afa3-4132-bbf5-790b5795d8b6 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:19.358973 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-50321e19-afa3-4132-bbf5-790b5795d8b6 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:19.359923 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-50321e19-afa3-4132-bbf5-790b5795d8b6 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:19.361123 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-50321e19-afa3-4132-bbf5-790b5795d8b6 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:19.361712 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-50321e19-afa3-4132-bbf5-790b5795d8b6 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:19.631356 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-50321e19-afa3-4132-bbf5-790b5795d8b6 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:19.640679 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-50321e19-afa3-4132-bbf5-790b5795d8b6 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/1fb6d268-9409-4ca5-9429-6f00ae7b86c1" status: 200 len: 1317 microversion: 2.1 time: 0.315046 Oct 23 01:16:19.647687 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 836/1607] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:19 2022] GET /compute/v2.1/servers/1fb6d268-9409-4ca5-9429-6f00ae7b86c1 => generated 1317 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:19.689099 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-357b0d08-33d0-4996-90e6-673ddce350a0 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:19.690054 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-357b0d08-33d0-4996-90e6-673ddce350a0 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 4150177f-2eef-435a-99b2-efa56983c53a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:19.716184 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-357b0d08-33d0-4996-90e6-673ddce350a0 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:19.716663 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-357b0d08-33d0-4996-90e6-673ddce350a0 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:19.717090 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-357b0d08-33d0-4996-90e6-673ddce350a0 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:19.717798 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-357b0d08-33d0-4996-90e6-673ddce350a0 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:19.724177 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-357b0d08-33d0-4996-90e6-673ddce350a0 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:19.725442 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-357b0d08-33d0-4996-90e6-673ddce350a0 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:19.766855 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9d5e93ce-4eea-474c-9f56-61b1b7492d97 tempest-ImagesMetadataTestJSON-1031665108 tempest-ImagesMetadataTestJSON-1031665108-project] 10.222.0.42 "PUT /compute/v2.1/images/278344ae-0386-4884-b956-8354866f8b47/metadata" status: 200 len: 61 microversion: 2.1 time: 0.733123 Oct 23 01:16:19.767786 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 772/1608] 10.222.0.42 () {60 vars in 1280 bytes} [Sun Oct 23 01:16:19 2022] PUT /compute/v2.1/images/278344ae-0386-4884-b956-8354866f8b47/metadata => generated 61 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 23 01:16:19.780060 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-148b959f-b910-4bde-bd88-13be6166c60e tempest-ImagesMetadataTestJSON-1031665108 tempest-ImagesMetadataTestJSON-1031665108-project] Action: 'update', calling method: .version_select at 0x7f5cc176c8b0>, body: {"meta": {"os_version": "alt"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:16:19.865697 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-148b959f-b910-4bde-bd88-13be6166c60e tempest-ImagesMetadataTestJSON-1031665108 tempest-ImagesMetadataTestJSON-1031665108-project] Getting quotas for project cd4dff948dba451c86b7ba29927a8b45. Resources: dict_keys(['metadata_items']) {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:16:19.873700 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-148b959f-b910-4bde-bd88-13be6166c60e tempest-ImagesMetadataTestJSON-1031665108 tempest-ImagesMetadataTestJSON-1031665108-project] Getting quotas for user 1e5066f2717f4d7bbde5347fc4903927 and project cd4dff948dba451c86b7ba29927a8b45. Resources: dict_keys(['metadata_items']) {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:16:19.938298 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-357b0d08-33d0-4996-90e6-673ddce350a0 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:19.950103 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-357b0d08-33d0-4996-90e6-673ddce350a0 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a" status: 200 len: 1523 microversion: 2.1 time: 0.264773 Oct 23 01:16:19.951010 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 837/1609] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:19 2022] GET /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a => generated 1523 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:19.960632 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-125c97c4-776b-4e23-a4c2-151137df9f16 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:19.961544 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-125c97c4-776b-4e23-a4c2-151137df9f16 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] [instance: 881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:19.969386 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-125c97c4-776b-4e23-a4c2-151137df9f16 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:19.970317 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-125c97c4-776b-4e23-a4c2-151137df9f16 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:19.970954 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-125c97c4-776b-4e23-a4c2-151137df9f16 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:19.971831 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-125c97c4-776b-4e23-a4c2-151137df9f16 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:19.972496 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-125c97c4-776b-4e23-a4c2-151137df9f16 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:19.973223 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-125c97c4-776b-4e23-a4c2-151137df9f16 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:20.006520 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-125c97c4-776b-4e23-a4c2-151137df9f16 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] HTTP exception thrown: Instance 881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40 could not be found. Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-125c97c4-776b-4e23-a4c2-151137df9f16 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Request method failure captured: Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40 HTTP/1.1 Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJXAnN8glSpzjFJmkaUaiz6SrfHzbQXQKmpJba4I9yzUpRVvS20-VvHS8JBqLVlpddvCz63B1toZ2JYtfdyY6tTSU897azSYuTgHOJM9kmG8kotmljxc16KHdMfOFxcB_SPa8FrZqlhgDE3KpxfRWhyp4ImBsifEa9GX6tpMm3CYr7E Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 891f5b08deb441c0b0a6bff7b9ddb953 Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-756055722 Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/891f5b08deb441c0b0a6bff7b9ddb953"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_891f5b08deb441c0b0a6bff7b9ddb953"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/891f5b08deb441c0b0a6bff7b9ddb953"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/891f5b08deb441c0b0a6bff7b9ddb953"}]}] Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-756055722 Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 891f5b08deb441c0b0a6bff7b9ddb953 Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-756055722 Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServerMetadataNegativeTestJSON-756055722-project Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 9932e28d1de240f5a3b0dab50df11f31 Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-756055722-project Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40 could not be found. Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40'} Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40 could not be found. Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40 could not be found. Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:16:20.008550 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:16:20.012815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:16:20.012815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:16:20.012815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:16:20.012815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:16:20.012815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:16:20.012815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:16:20.012815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40 could not be found. Oct 23 01:16:20.012815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:16:20.014498 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-125c97c4-776b-4e23-a4c2-151137df9f16 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] Returning 404 to user: Instance 881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:16:20.015588 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-125c97c4-776b-4e23-a4c2-151137df9f16 tempest-ServerMetadataNegativeTestJSON-756055722 tempest-ServerMetadataNegativeTestJSON-756055722-project] 10.222.0.42 "GET /compute/v2.1/servers/881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40" status: 404 len: 111 microversion: 2.1 time: 0.063378 Oct 23 01:16:20.016896 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 838/1610] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:19 2022] GET /compute/v2.1/servers/881b9c32-f6cc-4a7e-8bd2-3f9f9e94bc40 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:16:20.026376 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-555d72b3-2599-48b3-8f7e-d4a0bf17d050 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:20.027218 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-555d72b3-2599-48b3-8f7e-d4a0bf17d050 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 4150177f-2eef-435a-99b2-efa56983c53a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:20.033757 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-555d72b3-2599-48b3-8f7e-d4a0bf17d050 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:20.034753 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-555d72b3-2599-48b3-8f7e-d4a0bf17d050 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:20.035373 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-555d72b3-2599-48b3-8f7e-d4a0bf17d050 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:20.036264 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-555d72b3-2599-48b3-8f7e-d4a0bf17d050 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:20.037266 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-555d72b3-2599-48b3-8f7e-d4a0bf17d050 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:20.038376 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-555d72b3-2599-48b3-8f7e-d4a0bf17d050 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:20.256036 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-148b959f-b910-4bde-bd88-13be6166c60e tempest-ImagesMetadataTestJSON-1031665108 tempest-ImagesMetadataTestJSON-1031665108-project] 10.222.0.42 "PUT /compute/v2.1/images/278344ae-0386-4884-b956-8354866f8b47/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.482373 Oct 23 01:16:20.258209 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 773/1611] 10.222.0.42 () {60 vars in 1313 bytes} [Sun Oct 23 01:16:19 2022] PUT /compute/v2.1/images/278344ae-0386-4884-b956-8354866f8b47/metadata/os_version => generated 31 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 23 01:16:20.268673 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ac212ce6-254e-41f5-bc34-69b10c1403a6 tempest-ImagesMetadataTestJSON-1031665108 tempest-ImagesMetadataTestJSON-1031665108-project] Calling method '.version_select at 0x7f5cc16cbe50>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:20.340555 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ac212ce6-254e-41f5-bc34-69b10c1403a6 tempest-ImagesMetadataTestJSON-1031665108 tempest-ImagesMetadataTestJSON-1031665108-project] 10.222.0.42 "GET /compute/v2.1/images/278344ae-0386-4884-b956-8354866f8b47/metadata" status: 200 len: 58 microversion: 2.1 time: 0.076704 Oct 23 01:16:20.341374 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 774/1612] 10.222.0.42 () {58 vars in 1260 bytes} [Sun Oct 23 01:16:20 2022] GET /compute/v2.1/images/278344ae-0386-4884-b956-8354866f8b47/metadata => generated 58 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:16:20.348685 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dac571f2-9e8b-46eb-a9d9-fa0815d18f57 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:20.348998 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-dac571f2-9e8b-46eb-a9d9-fa0815d18f57 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:20.373885 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dac571f2-9e8b-46eb-a9d9-fa0815d18f57 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:20.374500 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dac571f2-9e8b-46eb-a9d9-fa0815d18f57 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:20.374943 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dac571f2-9e8b-46eb-a9d9-fa0815d18f57 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:20.375665 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dac571f2-9e8b-46eb-a9d9-fa0815d18f57 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:20.376123 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dac571f2-9e8b-46eb-a9d9-fa0815d18f57 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:20.376550 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dac571f2-9e8b-46eb-a9d9-fa0815d18f57 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:20.410144 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-555d72b3-2599-48b3-8f7e-d4a0bf17d050 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:20.422392 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-555d72b3-2599-48b3-8f7e-d4a0bf17d050 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a" status: 200 len: 1523 microversion: 2.1 time: 0.404168 Oct 23 01:16:20.453314 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 839/1613] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:20 2022] GET /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a => generated 1523 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:20.460116 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-98216eff-a024-4078-9008-834277f0078c tempest-ImagesMetadataTestJSON-1031665108 tempest-ImagesMetadataTestJSON-1031665108-project] Action: 'update_all', calling method: .version_select at 0x7f5cc26aeb80>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:16:20.531680 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-98216eff-a024-4078-9008-834277f0078c tempest-ImagesMetadataTestJSON-1031665108 tempest-ImagesMetadataTestJSON-1031665108-project] Getting quotas for project cd4dff948dba451c86b7ba29927a8b45. Resources: dict_keys(['metadata_items']) {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:16:20.543298 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-98216eff-a024-4078-9008-834277f0078c tempest-ImagesMetadataTestJSON-1031665108 tempest-ImagesMetadataTestJSON-1031665108-project] Getting quotas for user 1e5066f2717f4d7bbde5347fc4903927 and project cd4dff948dba451c86b7ba29927a8b45. Resources: dict_keys(['metadata_items']) {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:16:20.684347 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=4 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:16:20.845463 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-dac571f2-9e8b-46eb-a9d9-fa0815d18f57 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:20.854979 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-dac571f2-9e8b-46eb-a9d9-fa0815d18f57 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1313 microversion: 2.1 time: 0.511583 Oct 23 01:16:20.855692 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 775/1614] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:20 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1313 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:20.864681 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5d43d296-9054-4924-b2a2-029c7eb7a296 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2031752394"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:16:20.871560 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5d43d296-9054-4924-b2a2-029c7eb7a296 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 4150177f-2eef-435a-99b2-efa56983c53a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:20.886357 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5d43d296-9054-4924-b2a2-029c7eb7a296 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:20.886973 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5d43d296-9054-4924-b2a2-029c7eb7a296 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:20.887531 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5d43d296-9054-4924-b2a2-029c7eb7a296 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:20.892701 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5d43d296-9054-4924-b2a2-029c7eb7a296 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:20.892701 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5d43d296-9054-4924-b2a2-029c7eb7a296 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:20.892701 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5d43d296-9054-4924-b2a2-029c7eb7a296 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:21.057163 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-98216eff-a024-4078-9008-834277f0078c tempest-ImagesMetadataTestJSON-1031665108 tempest-ImagesMetadataTestJSON-1031665108-project] 10.222.0.42 "PUT /compute/v2.1/images/278344ae-0386-4884-b956-8354866f8b47/metadata" status: 200 len: 61 microversion: 2.1 time: 0.602183 Oct 23 01:16:21.061863 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 840/1615] 10.222.0.42 () {60 vars in 1280 bytes} [Sun Oct 23 01:16:20 2022] PUT /compute/v2.1/images/278344ae-0386-4884-b956-8354866f8b47/metadata => generated 61 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:16:21.063256 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ee0b90f4-960b-4b25-891b-bd020c3271d7 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:21.063845 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ee0b90f4-960b-4b25-891b-bd020c3271d7 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 1fb6d268-9409-4ca5-9429-6f00ae7b86c1] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:21.089746 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee0b90f4-960b-4b25-891b-bd020c3271d7 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:21.090309 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee0b90f4-960b-4b25-891b-bd020c3271d7 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:21.090751 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee0b90f4-960b-4b25-891b-bd020c3271d7 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:21.102266 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee0b90f4-960b-4b25-891b-bd020c3271d7 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:21.102778 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee0b90f4-960b-4b25-891b-bd020c3271d7 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:21.112735 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee0b90f4-960b-4b25-891b-bd020c3271d7 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:21.615385 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ee0b90f4-960b-4b25-891b-bd020c3271d7 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:21.630578 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ee0b90f4-960b-4b25-891b-bd020c3271d7 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/1fb6d268-9409-4ca5-9429-6f00ae7b86c1" status: 200 len: 1317 microversion: 2.1 time: 0.568795 Oct 23 01:16:21.630578 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 841/1616] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:21 2022] GET /compute/v2.1/servers/1fb6d268-9409-4ca5-9429-6f00ae7b86c1 => generated 1317 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:21.633871 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5ae656ab-d58e-4a8f-9c61-e96737c70fc5 tempest-ImagesMetadataTestJSON-1031665108 tempest-ImagesMetadataTestJSON-1031665108-project] Action: 'create', calling method: .version_select at 0x7f5cc24dd3a0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:16:21.714586 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5d43d296-9054-4924-b2a2-029c7eb7a296 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "POST /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a/action" status: 202 len: 0 microversion: 2.1 time: 0.856778 Oct 23 01:16:21.716142 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 776/1617] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:16:20 2022] POST /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a/action => generated 0 bytes in 860 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 23 01:16:21.733939 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-50be0a63-04ec-4198-a3c9-f59d105abd4e tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '.version_select at 0x7f5cc1768280>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:22.358802 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-50be0a63-04ec-4198-a3c9-f59d105abd4e tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "DELETE /compute/v2.1/images/338c5ad9-5d11-43f3-aa02-6b0ba33ca720" status: 204 len: 0 microversion: 2.1 time: 0.606803 Oct 23 01:16:22.358802 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 777/1618] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:21 2022] DELETE /compute/v2.1/images/338c5ad9-5d11-43f3-aa02-6b0ba33ca720 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:16:22.358802 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-22c22462-6350-4f99-a34d-ce04e822a3da tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:22.359515 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-5ae656ab-d58e-4a8f-9c61-e96737c70fc5 tempest-ImagesMetadataTestJSON-1031665108 tempest-ImagesMetadataTestJSON-1031665108-project] Getting quotas for project cd4dff948dba451c86b7ba29927a8b45. Resources: dict_keys(['metadata_items']) {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:16:22.360000 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-22c22462-6350-4f99-a34d-ce04e822a3da tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:22.360115 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-5ae656ab-d58e-4a8f-9c61-e96737c70fc5 tempest-ImagesMetadataTestJSON-1031665108 tempest-ImagesMetadataTestJSON-1031665108-project] Getting quotas for user 1e5066f2717f4d7bbde5347fc4903927 and project cd4dff948dba451c86b7ba29927a8b45. Resources: dict_keys(['metadata_items']) {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:16:22.360229 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-22c22462-6350-4f99-a34d-ce04e822a3da tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:22.360229 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-22c22462-6350-4f99-a34d-ce04e822a3da tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:22.360229 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-22c22462-6350-4f99-a34d-ce04e822a3da tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:22.360229 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-22c22462-6350-4f99-a34d-ce04e822a3da tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:22.360229 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-22c22462-6350-4f99-a34d-ce04e822a3da tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:22.360229 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-22c22462-6350-4f99-a34d-ce04e822a3da tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:22.652279 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-22c22462-6350-4f99-a34d-ce04e822a3da tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:22.666272 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-22c22462-6350-4f99-a34d-ce04e822a3da tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1313 microversion: 2.1 time: 0.331203 Oct 23 01:16:22.684572 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 778/1619] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:22 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1313 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:22.684572 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-fe7848ae-cc15-46fe-a4e7-4d135f76df3a req-a1e2903a-ec2d-4a2b-a64c-6ff06a33a08b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff95f7f4-2b30-4083-8643-3f9b1d203d02", "name": "network-vif-plugged", "status": "completed", "tag": "c2891809-9683-41d8-8d60-11982de58178"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:16:22.704071 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-fe7848ae-cc15-46fe-a4e7-4d135f76df3a req-a1e2903a-ec2d-4a2b-a64c-6ff06a33a08b service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:22.704808 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-fe7848ae-cc15-46fe-a4e7-4d135f76df3a req-a1e2903a-ec2d-4a2b-a64c-6ff06a33a08b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:22.708596 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-fe7848ae-cc15-46fe-a4e7-4d135f76df3a req-a1e2903a-ec2d-4a2b-a64c-6ff06a33a08b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:22.733557 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-fe7848ae-cc15-46fe-a4e7-4d135f76df3a req-a1e2903a-ec2d-4a2b-a64c-6ff06a33a08b service nova] Creating event network-vif-plugged:c2891809-9683-41d8-8d60-11982de58178 for instance ff95f7f4-2b30-4083-8643-3f9b1d203d02 on n-h2-master-1 Oct 23 01:16:22.739774 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-fe7848ae-cc15-46fe-a4e7-4d135f76df3a req-a1e2903a-ec2d-4a2b-a64c-6ff06a33a08b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063233 Oct 23 01:16:22.740747 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 779/1620] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:16:22.749847 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-008098fd-b71c-4c37-be3d-35519bc73e69 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '.version_select at 0x7f5cc1768040>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:23.194853 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-008098fd-b71c-4c37-be3d-35519bc73e69 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] HTTP exception thrown: Image not found. Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-008098fd-b71c-4c37-be3d-35519bc73e69 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Request method failure captured: Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/images/338c5ad9-5d11-43f3-aa02-6b0ba33ca720 HTTP/1.1 Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJWaABlg9aZPPmiKYOFyjnW3cUDNfMTW-9Ow-Ga99e9rhT_Xz0fOPaBTxk-ZvoWH3eiZ84RoqOaVKmH_NPvl5JjsEC9A2dnRRYDDEs3eUATgMIXjceNensPNpeVu874ElZedsjKlwKXnfqakqBoob0ap94r3bfJNgcmUxWbrsNVh5-k Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 1aa3395c4af3435eaa3a0f49e19167fe Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-421844011 Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1aa3395c4af3435eaa3a0f49e19167fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1aa3395c4af3435eaa3a0f49e19167fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1aa3395c4af3435eaa3a0f49e19167fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1aa3395c4af3435eaa3a0f49e19167fe"}]}] Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-421844011 Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 1aa3395c4af3435eaa3a0f49e19167fe Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-421844011 Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ImagesOneServerNegativeTestJSON-421844011-project Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 690143905857471f949b1f4454ad2139 Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-421844011-project Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: method: Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: exception: Image not found. Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '338c5ad9-5d11-43f3-aa02-6b0ba33ca720'} Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 338c5ad9-5d11-43f3-aa02-6b0ba33ca720 Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 23 01:16:23.199611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 23 01:16:23.206761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 23 01:16:23.206761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 23 01:16:23.206761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 23 01:16:23.206761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 23 01:16:23.206761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 23 01:16:23.206761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 23 01:16:23.206761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 23 01:16:23.206761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 23 01:16:23.206761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 23 01:16:23.206761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 23 01:16:23.206761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 23 01:16:23.206761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 23 01:16:23.206761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 23 01:16:23.206761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 23 01:16:23.206761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 23 01:16:23.206761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 23 01:16:23.206761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 23 01:16:23.206761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 338c5ad9-5d11-43f3-aa02-6b0ba33ca720 could not be found. Oct 23 01:16:23.206761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:16:23.206761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:16:23.206761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:16:23.206761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:16:23.206761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:16:23.206761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:16:23.206761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:16:23.206761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:16:23.206761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:16:23.206761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:16:23.206761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:16:23.206761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:16:23.206761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 23 01:16:23.206761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 23 01:16:23.206761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 23 01:16:23.206761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:16:23.206761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:16:23.206761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:16:23.206761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:16:23.206761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:16:23.206761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:16:23.206761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:16:23.206761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:16:23.206761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 23 01:16:23.206761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:16:23.206761 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-008098fd-b71c-4c37-be3d-35519bc73e69 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Returning 404 to user: Image not found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:16:23.206761 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-008098fd-b71c-4c37-be3d-35519bc73e69 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/images/338c5ad9-5d11-43f3-aa02-6b0ba33ca720" status: 404 len: 62 microversion: 2.1 time: 0.453105 Oct 23 01:16:23.206761 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 780/1621] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:16:22 2022] GET /compute/v2.1/images/338c5ad9-5d11-43f3-aa02-6b0ba33ca720 => generated 62 bytes in 454 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:16:23.213071 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-07ccb353-034c-4177-a258-05ddcc423ad4 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:23.213071 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-07ccb353-034c-4177-a258-05ddcc423ad4 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 1fb6d268-9409-4ca5-9429-6f00ae7b86c1] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:23.243945 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07ccb353-034c-4177-a258-05ddcc423ad4 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:23.252710 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07ccb353-034c-4177-a258-05ddcc423ad4 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:23.257542 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07ccb353-034c-4177-a258-05ddcc423ad4 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:23.258598 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07ccb353-034c-4177-a258-05ddcc423ad4 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:23.260255 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07ccb353-034c-4177-a258-05ddcc423ad4 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:23.261488 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07ccb353-034c-4177-a258-05ddcc423ad4 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:23.279584 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5ae656ab-d58e-4a8f-9c61-e96737c70fc5 tempest-ImagesMetadataTestJSON-1031665108 tempest-ImagesMetadataTestJSON-1031665108-project] 10.222.0.42 "POST /compute/v2.1/images/278344ae-0386-4884-b956-8354866f8b47/metadata" status: 200 len: 85 microversion: 2.1 time: 1.645512 Oct 23 01:16:23.281916 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 842/1622] 10.222.0.42 () {60 vars in 1281 bytes} [Sun Oct 23 01:16:21 2022] POST /compute/v2.1/images/278344ae-0386-4884-b956-8354866f8b47/metadata => generated 85 bytes in 1652 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:16:23.306236 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d19a125b-17de-4330-bf14-0d9c1165b162 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:23.307995 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d19a125b-17de-4330-bf14-0d9c1165b162 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 4150177f-2eef-435a-99b2-efa56983c53a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:23.334722 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d19a125b-17de-4330-bf14-0d9c1165b162 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:23.337829 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d19a125b-17de-4330-bf14-0d9c1165b162 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:23.339476 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d19a125b-17de-4330-bf14-0d9c1165b162 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:23.345093 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d19a125b-17de-4330-bf14-0d9c1165b162 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:23.345093 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d19a125b-17de-4330-bf14-0d9c1165b162 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:23.345093 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d19a125b-17de-4330-bf14-0d9c1165b162 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:23.758786 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d19a125b-17de-4330-bf14-0d9c1165b162 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:23.775206 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d19a125b-17de-4330-bf14-0d9c1165b162 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a" status: 200 len: 1541 microversion: 2.1 time: 0.486377 Oct 23 01:16:23.776871 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 843/1623] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:23 2022] GET /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a => generated 1541 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:23.790242 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-39639b3f-24b2-4506-9163-74a9dfb618f8 tempest-ImagesMetadataTestJSON-1031665108 tempest-ImagesMetadataTestJSON-1031665108-project] Calling method '.version_select at 0x7f5cc24dd040>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:23.844706 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-07ccb353-034c-4177-a258-05ddcc423ad4 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:23.860828 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-07ccb353-034c-4177-a258-05ddcc423ad4 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/1fb6d268-9409-4ca5-9429-6f00ae7b86c1" status: 200 len: 1317 microversion: 2.1 time: 0.650366 Oct 23 01:16:23.860828 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 781/1624] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:23 2022] GET /compute/v2.1/servers/1fb6d268-9409-4ca5-9429-6f00ae7b86c1 => generated 1317 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:23.869259 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5a800535-5c6d-4444-82c2-50227bac3f91 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:23.869901 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5a800535-5c6d-4444-82c2-50227bac3f91 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:23.886689 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5a800535-5c6d-4444-82c2-50227bac3f91 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:23.887487 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5a800535-5c6d-4444-82c2-50227bac3f91 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:23.888158 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5a800535-5c6d-4444-82c2-50227bac3f91 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:23.889114 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5a800535-5c6d-4444-82c2-50227bac3f91 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:23.893915 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5a800535-5c6d-4444-82c2-50227bac3f91 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:23.894774 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5a800535-5c6d-4444-82c2-50227bac3f91 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:23.907813 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-39639b3f-24b2-4506-9163-74a9dfb618f8 tempest-ImagesMetadataTestJSON-1031665108 tempest-ImagesMetadataTestJSON-1031665108-project] 10.222.0.42 "GET /compute/v2.1/images/278344ae-0386-4884-b956-8354866f8b47/metadata" status: 200 len: 85 microversion: 2.1 time: 0.128709 Oct 23 01:16:23.909029 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 844/1625] 10.222.0.42 () {58 vars in 1260 bytes} [Sun Oct 23 01:16:23 2022] GET /compute/v2.1/images/278344ae-0386-4884-b956-8354866f8b47/metadata => generated 85 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:16:24.589088 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5a800535-5c6d-4444-82c2-50227bac3f91 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:24.607454 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5a800535-5c6d-4444-82c2-50227bac3f91 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1313 microversion: 2.1 time: 0.749294 Oct 23 01:16:24.623636 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 782/1626] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:23 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1313 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:24.808242 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a1ba9ea7-8d0d-4f09-b9a5-7fb589ea151e tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:24.809604 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a1ba9ea7-8d0d-4f09-b9a5-7fb589ea151e tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 4150177f-2eef-435a-99b2-efa56983c53a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:24.834519 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a1ba9ea7-8d0d-4f09-b9a5-7fb589ea151e tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:24.836175 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a1ba9ea7-8d0d-4f09-b9a5-7fb589ea151e tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:24.837169 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a1ba9ea7-8d0d-4f09-b9a5-7fb589ea151e tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:24.840228 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a1ba9ea7-8d0d-4f09-b9a5-7fb589ea151e tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:24.842314 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a1ba9ea7-8d0d-4f09-b9a5-7fb589ea151e tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:24.851200 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a1ba9ea7-8d0d-4f09-b9a5-7fb589ea151e tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:24.887155 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d8b96513-683a-48d0-a1de-e80d626b43b9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:24.887908 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d8b96513-683a-48d0-a1de-e80d626b43b9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 1fb6d268-9409-4ca5-9429-6f00ae7b86c1] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:24.905772 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d8b96513-683a-48d0-a1de-e80d626b43b9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:24.906726 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d8b96513-683a-48d0-a1de-e80d626b43b9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:24.908817 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d8b96513-683a-48d0-a1de-e80d626b43b9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:24.912120 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d8b96513-683a-48d0-a1de-e80d626b43b9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:24.912879 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d8b96513-683a-48d0-a1de-e80d626b43b9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:24.914799 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d8b96513-683a-48d0-a1de-e80d626b43b9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:25.518094 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a1ba9ea7-8d0d-4f09-b9a5-7fb589ea151e tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:25.535455 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a1ba9ea7-8d0d-4f09-b9a5-7fb589ea151e tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a" status: 200 len: 1541 microversion: 2.1 time: 0.732691 Oct 23 01:16:25.538126 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 845/1627] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:24 2022] GET /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a => generated 1541 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:25.564315 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d8b96513-683a-48d0-a1de-e80d626b43b9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:25.582826 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d8b96513-683a-48d0-a1de-e80d626b43b9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/1fb6d268-9409-4ca5-9429-6f00ae7b86c1" status: 200 len: 1317 microversion: 2.1 time: 0.699776 Oct 23 01:16:25.611564 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 783/1628] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:24 2022] GET /compute/v2.1/servers/1fb6d268-9409-4ca5-9429-6f00ae7b86c1 => generated 1317 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:25.638584 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-95696025-5258-4a18-a52e-e9d7e7d6bd1a tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:25.639554 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-95696025-5258-4a18-a52e-e9d7e7d6bd1a tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:25.650417 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-95696025-5258-4a18-a52e-e9d7e7d6bd1a tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:25.651362 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-95696025-5258-4a18-a52e-e9d7e7d6bd1a tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:25.654771 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-95696025-5258-4a18-a52e-e9d7e7d6bd1a tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:25.659337 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-95696025-5258-4a18-a52e-e9d7e7d6bd1a tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:25.664634 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-95696025-5258-4a18-a52e-e9d7e7d6bd1a tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:25.664634 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-95696025-5258-4a18-a52e-e9d7e7d6bd1a tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:26.032057 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-95696025-5258-4a18-a52e-e9d7e7d6bd1a tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:26.044248 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-95696025-5258-4a18-a52e-e9d7e7d6bd1a tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1463 microversion: 2.1 time: 0.410044 Oct 23 01:16:26.064821 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 784/1629] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:25 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1463 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:16:26.076191 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5b3ce2bb-3a8b-41b4-a3df-20cde0e58e55 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:26.078274 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5b3ce2bb-3a8b-41b4-a3df-20cde0e58e55 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:26.092326 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b3ce2bb-3a8b-41b4-a3df-20cde0e58e55 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:26.093219 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b3ce2bb-3a8b-41b4-a3df-20cde0e58e55 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:26.093897 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b3ce2bb-3a8b-41b4-a3df-20cde0e58e55 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:26.095662 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b3ce2bb-3a8b-41b4-a3df-20cde0e58e55 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:26.096378 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b3ce2bb-3a8b-41b4-a3df-20cde0e58e55 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:26.097078 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b3ce2bb-3a8b-41b4-a3df-20cde0e58e55 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:26.176146 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4e9a1ec5-1b41-4edd-8086-2c466750460f tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-980732470", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "1fd1125a-5e06-4668-a85b-393b7a6d4c8a"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:16:26.252723 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-4e9a1ec5-1b41-4edd-8086-2c466750460f tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] validate_networks() for [('1fd1125a-5e06-4668-a85b-393b7a6d4c8a', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:16:26.608611 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5b3ce2bb-3a8b-41b4-a3df-20cde0e58e55 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1614 microversion: 2.1 time: 0.537932 Oct 23 01:16:26.616173 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 785/1630] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:26 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1614 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:26.621345 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e24e3bce-a942-4c5b-93f6-4afc6c19c9c4 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:26.622401 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e24e3bce-a942-4c5b-93f6-4afc6c19c9c4 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 4150177f-2eef-435a-99b2-efa56983c53a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:26.632119 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:16:26.634436 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e24e3bce-a942-4c5b-93f6-4afc6c19c9c4 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:26.635185 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e24e3bce-a942-4c5b-93f6-4afc6c19c9c4 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:26.635810 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e24e3bce-a942-4c5b-93f6-4afc6c19c9c4 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:26.636694 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e24e3bce-a942-4c5b-93f6-4afc6c19c9c4 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:26.637458 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e24e3bce-a942-4c5b-93f6-4afc6c19c9c4 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:26.638095 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e24e3bce-a942-4c5b-93f6-4afc6c19c9c4 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:26.977778 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e24e3bce-a942-4c5b-93f6-4afc6c19c9c4 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:26.991411 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e24e3bce-a942-4c5b-93f6-4afc6c19c9c4 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a" status: 200 len: 1541 microversion: 2.1 time: 0.374041 Oct 23 01:16:26.994957 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 786/1631] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:26 2022] GET /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a => generated 1541 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:27.009881 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fae8880d-ea01-4de9-8269-7cbc6bcfd42a tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:27.010582 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fae8880d-ea01-4de9-8269-7cbc6bcfd42a tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 1fb6d268-9409-4ca5-9429-6f00ae7b86c1] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:27.018945 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fae8880d-ea01-4de9-8269-7cbc6bcfd42a tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:27.019232 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fae8880d-ea01-4de9-8269-7cbc6bcfd42a tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:27.020547 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fae8880d-ea01-4de9-8269-7cbc6bcfd42a tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:27.021169 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fae8880d-ea01-4de9-8269-7cbc6bcfd42a tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:27.021945 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fae8880d-ea01-4de9-8269-7cbc6bcfd42a tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:27.023079 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fae8880d-ea01-4de9-8269-7cbc6bcfd42a tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:27.515735 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fae8880d-ea01-4de9-8269-7cbc6bcfd42a tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:27.532094 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fae8880d-ea01-4de9-8269-7cbc6bcfd42a tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/1fb6d268-9409-4ca5-9429-6f00ae7b86c1" status: 200 len: 1317 microversion: 2.1 time: 0.532089 Oct 23 01:16:27.533787 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 787/1632] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:26 2022] GET /compute/v2.1/servers/1fb6d268-9409-4ca5-9429-6f00ae7b86c1 => generated 1317 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:27.552767 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1923c3de-800f-4e9d-9e29-3454c8485559 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:16:27.558438 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1923c3de-800f-4e9d-9e29-3454c8485559 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:27.567510 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1923c3de-800f-4e9d-9e29-3454c8485559 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:27.569136 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1923c3de-800f-4e9d-9e29-3454c8485559 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:27.571640 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1923c3de-800f-4e9d-9e29-3454c8485559 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:27.571640 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1923c3de-800f-4e9d-9e29-3454c8485559 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:27.571640 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1923c3de-800f-4e9d-9e29-3454c8485559 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:27.579630 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-4e9a1ec5-1b41-4edd-8086-2c466750460f tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:16:27.580180 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-4e9a1ec5-1b41-4edd-8086-2c466750460f tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:16:27.580513 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-4e9a1ec5-1b41-4edd-8086-2c466750460f tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:16:27.580923 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-4e9a1ec5-1b41-4edd-8086-2c466750460f tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:16:27.582335 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-4e9a1ec5-1b41-4edd-8086-2c466750460f tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:16:27.588797 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1923c3de-800f-4e9d-9e29-3454c8485559 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:27.592885 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4e9a1ec5-1b41-4edd-8086-2c466750460f tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:27.593435 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4e9a1ec5-1b41-4edd-8086-2c466750460f tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:27.594163 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4e9a1ec5-1b41-4edd-8086-2c466750460f tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:27.594910 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4e9a1ec5-1b41-4edd-8086-2c466750460f tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:27.595433 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4e9a1ec5-1b41-4edd-8086-2c466750460f tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:27.595854 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4e9a1ec5-1b41-4edd-8086-2c466750460f tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:27.621686 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-4e9a1ec5-1b41-4edd-8086-2c466750460f tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Getting quotas for project 386d20bba06b48be9a7e51162dc4d814. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:16:27.635660 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-4e9a1ec5-1b41-4edd-8086-2c466750460f tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Getting quotas for user c9681db3595440a88dacc40393e2e1dc and project 386d20bba06b48be9a7e51162dc4d814. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:16:27.660708 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4e9a1ec5-1b41-4edd-8086-2c466750460f tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:16:27.663632 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4e9a1ec5-1b41-4edd-8086-2c466750460f tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: a78b5bc9-4e8f-44d7-879c-737838cfe1b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:16:27.681611 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1923c3de-800f-4e9d-9e29-3454c8485559 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'dce640e690324a588f758650bf3c4f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264d2f683757471183644d46da75d365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:27.683176 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1923c3de-800f-4e9d-9e29-3454c8485559 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] flavor_id is None. Assuming migration. {{(pid=120944) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 23 01:16:27.683785 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1923c3de-800f-4e9d-9e29-3454c8485559 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120944) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 23 01:16:27.949185 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4e9a1ec5-1b41-4edd-8086-2c466750460f tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.400542 Oct 23 01:16:27.949926 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 846/1633] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:16:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2410 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:16:27.973676 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-db0d9f13-6a51-4fe8-a9b0-d2895cc18c79 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:27.979736 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-db0d9f13-6a51-4fe8-a9b0-d2895cc18c79 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: a78b5bc9-4e8f-44d7-879c-737838cfe1b6] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:28.138300 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-db0d9f13-6a51-4fe8-a9b0-d2895cc18c79 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9681db3595440a88dacc40393e2e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386d20bba06b48be9a7e51162dc4d814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:28.145710 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-db0d9f13-6a51-4fe8-a9b0-d2895cc18c79 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] 10.222.0.42 "GET /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6" status: 200 len: 1223 microversion: 2.1 time: 0.188607 Oct 23 01:16:28.148053 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 847/1634] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:27 2022] GET /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6 => generated 1223 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:16:28.155684 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-872fb976-b1c1-4444-8461-7130449edd3a tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:28.164768 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-872fb976-b1c1-4444-8461-7130449edd3a tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 4150177f-2eef-435a-99b2-efa56983c53a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:28.181469 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-872fb976-b1c1-4444-8461-7130449edd3a tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:28.182919 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-872fb976-b1c1-4444-8461-7130449edd3a tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:28.184926 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-872fb976-b1c1-4444-8461-7130449edd3a tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:28.186380 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-872fb976-b1c1-4444-8461-7130449edd3a tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:28.188716 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-872fb976-b1c1-4444-8461-7130449edd3a tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:28.192064 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-872fb976-b1c1-4444-8461-7130449edd3a tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:28.726270 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-872fb976-b1c1-4444-8461-7130449edd3a tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:28.736560 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-872fb976-b1c1-4444-8461-7130449edd3a tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a" status: 200 len: 1523 microversion: 2.1 time: 0.587248 Oct 23 01:16:28.740556 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 848/1635] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:28 2022] GET /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a => generated 1523 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:28.758314 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5d3eeddf-d2bb-4191-b683-2bbd5df0547c tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:28.760549 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5d3eeddf-d2bb-4191-b683-2bbd5df0547c tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 1fb6d268-9409-4ca5-9429-6f00ae7b86c1] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:28.791961 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5d3eeddf-d2bb-4191-b683-2bbd5df0547c tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:28.796446 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5d3eeddf-d2bb-4191-b683-2bbd5df0547c tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:28.797953 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5d3eeddf-d2bb-4191-b683-2bbd5df0547c tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:28.798629 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5d3eeddf-d2bb-4191-b683-2bbd5df0547c tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:28.799305 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5d3eeddf-d2bb-4191-b683-2bbd5df0547c tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:28.801167 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5d3eeddf-d2bb-4191-b683-2bbd5df0547c tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:28.911080 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1923c3de-800f-4e9d-9e29-3454c8485559 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02/action" status: 202 len: 0 microversion: 2.1 time: 1.376118 Oct 23 01:16:28.921434 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 788/1636] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:16:27 2022] POST /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02/action => generated 0 bytes in 1386 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:16:28.943137 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0f5248ad-4ac3-4c51-87ff-8d0d1393e586 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:28.948316 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0f5248ad-4ac3-4c51-87ff-8d0d1393e586 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 4150177f-2eef-435a-99b2-efa56983c53a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:28.983358 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0f5248ad-4ac3-4c51-87ff-8d0d1393e586 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:28.992266 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0f5248ad-4ac3-4c51-87ff-8d0d1393e586 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:28.993259 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0f5248ad-4ac3-4c51-87ff-8d0d1393e586 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:28.994062 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0f5248ad-4ac3-4c51-87ff-8d0d1393e586 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:28.994607 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0f5248ad-4ac3-4c51-87ff-8d0d1393e586 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:28.995141 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0f5248ad-4ac3-4c51-87ff-8d0d1393e586 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:29.079555 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0f5248ad-4ac3-4c51-87ff-8d0d1393e586 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 4150177f-2eef-435a-99b2-efa56983c53a] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:16:29.119615 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:16:29.179867 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5d3eeddf-d2bb-4191-b683-2bbd5df0547c tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:29.193231 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5d3eeddf-d2bb-4191-b683-2bbd5df0547c tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/1fb6d268-9409-4ca5-9429-6f00ae7b86c1" status: 200 len: 1317 microversion: 2.1 time: 0.450662 Oct 23 01:16:29.195106 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 849/1637] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:28 2022] GET /compute/v2.1/servers/1fb6d268-9409-4ca5-9429-6f00ae7b86c1 => generated 1317 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:29.230329 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4b41f9b5-668c-41b5-9bf3-99640d079c07 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:29.231126 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4b41f9b5-668c-41b5-9bf3-99640d079c07 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:29.244840 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b41f9b5-668c-41b5-9bf3-99640d079c07 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:29.247224 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b41f9b5-668c-41b5-9bf3-99640d079c07 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:29.247753 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b41f9b5-668c-41b5-9bf3-99640d079c07 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:29.249371 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b41f9b5-668c-41b5-9bf3-99640d079c07 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:29.256988 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b41f9b5-668c-41b5-9bf3-99640d079c07 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:29.257526 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b41f9b5-668c-41b5-9bf3-99640d079c07 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:29.575612 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0f5248ad-4ac3-4c51-87ff-8d0d1393e586 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a" status: 204 len: 0 microversion: 2.1 time: 0.650991 Oct 23 01:16:29.576313 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 789/1638] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:16:28 2022] DELETE /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a => generated 0 bytes in 654 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:16:29.587228 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4b41f9b5-668c-41b5-9bf3-99640d079c07 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:29.588924 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-266fc50a-1db5-4b76-b2a7-ccf709ac94e6 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:29.591762 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4b41f9b5-668c-41b5-9bf3-99640d079c07 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1472 microversion: 2.1 time: 0.393567 Oct 23 01:16:29.592082 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-266fc50a-1db5-4b76-b2a7-ccf709ac94e6 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: a78b5bc9-4e8f-44d7-879c-737838cfe1b6] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:29.598295 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 850/1639] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:29 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1472 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:29.611574 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-88352a4d-f71d-4bb7-a927-86587fb635da req-9e4ff393-fb20-4115-aa6c-c9265db4eb1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fb6d268-9409-4ca5-9429-6f00ae7b86c1", "name": "network-vif-plugged", "status": "completed", "tag": "3fa70d62-e26e-4dbc-b762-9137ae590232"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:16:29.633163 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-88352a4d-f71d-4bb7-a927-86587fb635da req-9e4ff393-fb20-4115-aa6c-c9265db4eb1a service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:29.636920 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-88352a4d-f71d-4bb7-a927-86587fb635da req-9e4ff393-fb20-4115-aa6c-c9265db4eb1a service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:29.639314 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-88352a4d-f71d-4bb7-a927-86587fb635da req-9e4ff393-fb20-4115-aa6c-c9265db4eb1a service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:29.656446 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-88352a4d-f71d-4bb7-a927-86587fb635da req-9e4ff393-fb20-4115-aa6c-c9265db4eb1a service nova] Creating event network-vif-plugged:3fa70d62-e26e-4dbc-b762-9137ae590232 for instance 1fb6d268-9409-4ca5-9429-6f00ae7b86c1 on n-h1-master-1 Oct 23 01:16:29.663114 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-88352a4d-f71d-4bb7-a927-86587fb635da req-9e4ff393-fb20-4115-aa6c-c9265db4eb1a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063520 Oct 23 01:16:29.664153 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 851/1640] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:16:29.675352 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f90ae508-4cab-4545-a4f0-28ddd76959f6 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:29.676437 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f90ae508-4cab-4545-a4f0-28ddd76959f6 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 4150177f-2eef-435a-99b2-efa56983c53a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:29.684757 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f90ae508-4cab-4545-a4f0-28ddd76959f6 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:29.685456 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f90ae508-4cab-4545-a4f0-28ddd76959f6 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:29.686146 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f90ae508-4cab-4545-a4f0-28ddd76959f6 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:29.687071 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f90ae508-4cab-4545-a4f0-28ddd76959f6 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:29.687845 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f90ae508-4cab-4545-a4f0-28ddd76959f6 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:29.688594 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f90ae508-4cab-4545-a4f0-28ddd76959f6 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:29.733860 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-266fc50a-1db5-4b76-b2a7-ccf709ac94e6 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9681db3595440a88dacc40393e2e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386d20bba06b48be9a7e51162dc4d814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:29.748122 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=37 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:16:29.753597 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-266fc50a-1db5-4b76-b2a7-ccf709ac94e6 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] 10.222.0.42 "GET /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6" status: 200 len: 1223 microversion: 2.1 time: 0.171875 Oct 23 01:16:29.812254 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 790/1641] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:29 2022] GET /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6 => generated 1223 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:30.131225 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f90ae508-4cab-4545-a4f0-28ddd76959f6 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:30.143717 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f90ae508-4cab-4545-a4f0-28ddd76959f6 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a" status: 200 len: 1529 microversion: 2.1 time: 0.477261 Oct 23 01:16:30.150789 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 852/1642] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:29 2022] GET /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a => generated 1529 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:30.219974 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-126d96e8-a1c3-40fc-ae9d-16cbc6c8e1cb tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:30.220593 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-126d96e8-a1c3-40fc-ae9d-16cbc6c8e1cb tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 1fb6d268-9409-4ca5-9429-6f00ae7b86c1] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:30.233299 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-126d96e8-a1c3-40fc-ae9d-16cbc6c8e1cb tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:30.236458 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-126d96e8-a1c3-40fc-ae9d-16cbc6c8e1cb tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:30.237109 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-126d96e8-a1c3-40fc-ae9d-16cbc6c8e1cb tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:30.237839 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-126d96e8-a1c3-40fc-ae9d-16cbc6c8e1cb tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:30.238326 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-126d96e8-a1c3-40fc-ae9d-16cbc6c8e1cb tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:30.238755 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-126d96e8-a1c3-40fc-ae9d-16cbc6c8e1cb tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:30.404031 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-126d96e8-a1c3-40fc-ae9d-16cbc6c8e1cb tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:30.416316 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-126d96e8-a1c3-40fc-ae9d-16cbc6c8e1cb tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/1fb6d268-9409-4ca5-9429-6f00ae7b86c1" status: 200 len: 1317 microversion: 2.1 time: 0.199632 Oct 23 01:16:30.417514 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 791/1643] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:30 2022] GET /compute/v2.1/servers/1fb6d268-9409-4ca5-9429-6f00ae7b86c1 => generated 1317 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:30.626560 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d4787dd3-87ed-4d4f-9bc7-0a98c1123781 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:30.627441 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d4787dd3-87ed-4d4f-9bc7-0a98c1123781 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:30.634480 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4787dd3-87ed-4d4f-9bc7-0a98c1123781 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:30.635191 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4787dd3-87ed-4d4f-9bc7-0a98c1123781 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:30.635816 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4787dd3-87ed-4d4f-9bc7-0a98c1123781 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:30.636699 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4787dd3-87ed-4d4f-9bc7-0a98c1123781 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:30.637465 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4787dd3-87ed-4d4f-9bc7-0a98c1123781 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:30.638110 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4787dd3-87ed-4d4f-9bc7-0a98c1123781 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:30.783822 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1fea3665-ee82-434c-81ff-20aa6f3190fa tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:30.784830 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1fea3665-ee82-434c-81ff-20aa6f3190fa tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: a78b5bc9-4e8f-44d7-879c-737838cfe1b6] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:30.796173 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1fea3665-ee82-434c-81ff-20aa6f3190fa tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:30.796853 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1fea3665-ee82-434c-81ff-20aa6f3190fa tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:30.797398 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1fea3665-ee82-434c-81ff-20aa6f3190fa tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:30.798236 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1fea3665-ee82-434c-81ff-20aa6f3190fa tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:30.799548 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1fea3665-ee82-434c-81ff-20aa6f3190fa tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:30.800404 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1fea3665-ee82-434c-81ff-20aa6f3190fa tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:30.866527 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d4787dd3-87ed-4d4f-9bc7-0a98c1123781 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:30.878592 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d4787dd3-87ed-4d4f-9bc7-0a98c1123781 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1472 microversion: 2.1 time: 0.259966 Oct 23 01:16:30.879743 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 853/1644] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:30 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1472 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:30.901013 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1fea3665-ee82-434c-81ff-20aa6f3190fa tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9681db3595440a88dacc40393e2e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386d20bba06b48be9a7e51162dc4d814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:30.919115 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1fea3665-ee82-434c-81ff-20aa6f3190fa tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] 10.222.0.42 "GET /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6" status: 200 len: 1227 microversion: 2.1 time: 0.142193 Oct 23 01:16:30.934002 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 792/1645] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:30 2022] GET /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6 => generated 1227 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:16:31.171245 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e4816ff7-fdd5-43be-8662-7fc9b385f87f tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:31.171245 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e4816ff7-fdd5-43be-8662-7fc9b385f87f tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 4150177f-2eef-435a-99b2-efa56983c53a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:31.181445 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e4816ff7-fdd5-43be-8662-7fc9b385f87f tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:31.194562 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e4816ff7-fdd5-43be-8662-7fc9b385f87f tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:31.194562 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e4816ff7-fdd5-43be-8662-7fc9b385f87f tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:31.194562 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e4816ff7-fdd5-43be-8662-7fc9b385f87f tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:31.194562 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e4816ff7-fdd5-43be-8662-7fc9b385f87f tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:31.194562 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e4816ff7-fdd5-43be-8662-7fc9b385f87f tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:31.440838 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ba230791-58b9-4025-9ddc-111667b4a8ce tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:31.441474 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ba230791-58b9-4025-9ddc-111667b4a8ce tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 1fb6d268-9409-4ca5-9429-6f00ae7b86c1] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:31.450358 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e4816ff7-fdd5-43be-8662-7fc9b385f87f tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:31.451524 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba230791-58b9-4025-9ddc-111667b4a8ce tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:31.466565 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e4816ff7-fdd5-43be-8662-7fc9b385f87f tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a" status: 200 len: 1529 microversion: 2.1 time: 0.300846 Oct 23 01:16:31.467100 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba230791-58b9-4025-9ddc-111667b4a8ce tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:31.467658 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba230791-58b9-4025-9ddc-111667b4a8ce tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:31.469001 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba230791-58b9-4025-9ddc-111667b4a8ce tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:31.469196 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 854/1646] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:31 2022] GET /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a => generated 1529 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:31.469385 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba230791-58b9-4025-9ddc-111667b4a8ce tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:31.470549 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba230791-58b9-4025-9ddc-111667b4a8ce tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:31.755490 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-6af3325c-548b-421b-9e0e-4b171e4659ba req-11daeb4e-e375-4763-83bd-a911b2c4b7cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4150177f-2eef-435a-99b2-efa56983c53a", "name": "network-vif-plugged", "status": "completed", "tag": "50e0e9ab-b232-47f9-97de-7b93cc03e0c2"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:16:31.780427 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-6af3325c-548b-421b-9e0e-4b171e4659ba req-11daeb4e-e375-4763-83bd-a911b2c4b7cc service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:31.781488 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-6af3325c-548b-421b-9e0e-4b171e4659ba req-11daeb4e-e375-4763-83bd-a911b2c4b7cc service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:31.783651 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-6af3325c-548b-421b-9e0e-4b171e4659ba req-11daeb4e-e375-4763-83bd-a911b2c4b7cc service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:31.852151 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-6af3325c-548b-421b-9e0e-4b171e4659ba req-11daeb4e-e375-4763-83bd-a911b2c4b7cc service nova] Creating event network-vif-plugged:50e0e9ab-b232-47f9-97de-7b93cc03e0c2 for instance 4150177f-2eef-435a-99b2-efa56983c53a on n-h2-master-1 Oct 23 01:16:31.881165 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-6af3325c-548b-421b-9e0e-4b171e4659ba req-11daeb4e-e375-4763-83bd-a911b2c4b7cc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130480 Oct 23 01:16:31.886495 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 855/1647] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:16:31.913109 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-351a892f-468e-4471-8b4e-0dfed78cd14e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:31.919318 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-351a892f-468e-4471-8b4e-0dfed78cd14e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:31.960849 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-351a892f-468e-4471-8b4e-0dfed78cd14e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:31.961285 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-351a892f-468e-4471-8b4e-0dfed78cd14e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:31.962903 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-351a892f-468e-4471-8b4e-0dfed78cd14e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:31.964065 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-351a892f-468e-4471-8b4e-0dfed78cd14e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:31.968119 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-351a892f-468e-4471-8b4e-0dfed78cd14e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:31.968830 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-351a892f-468e-4471-8b4e-0dfed78cd14e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:32.083891 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ba230791-58b9-4025-9ddc-111667b4a8ce tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:32.094642 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ba230791-58b9-4025-9ddc-111667b4a8ce tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/1fb6d268-9409-4ca5-9429-6f00ae7b86c1" status: 200 len: 1317 microversion: 2.1 time: 0.656498 Oct 23 01:16:32.096684 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 793/1648] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:31 2022] GET /compute/v2.1/servers/1fb6d268-9409-4ca5-9429-6f00ae7b86c1 => generated 1317 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:32.110381 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ff454d8a-f029-4213-92ce-2684cb1dfe72 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:32.111495 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ff454d8a-f029-4213-92ce-2684cb1dfe72 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: a78b5bc9-4e8f-44d7-879c-737838cfe1b6] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:32.140392 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ff454d8a-f029-4213-92ce-2684cb1dfe72 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:32.141561 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ff454d8a-f029-4213-92ce-2684cb1dfe72 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:32.142232 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ff454d8a-f029-4213-92ce-2684cb1dfe72 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:32.143022 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ff454d8a-f029-4213-92ce-2684cb1dfe72 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:32.143723 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ff454d8a-f029-4213-92ce-2684cb1dfe72 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:32.144390 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ff454d8a-f029-4213-92ce-2684cb1dfe72 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:32.271691 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ff454d8a-f029-4213-92ce-2684cb1dfe72 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9681db3595440a88dacc40393e2e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386d20bba06b48be9a7e51162dc4d814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:32.284188 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ff454d8a-f029-4213-92ce-2684cb1dfe72 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] 10.222.0.42 "GET /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6" status: 200 len: 1219 microversion: 2.1 time: 0.183900 Oct 23 01:16:32.285373 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 794/1649] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:32 2022] GET /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6 => generated 1219 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:32.497452 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f5bfd51c-bdb6-4d86-b3e0-f79f69988e90 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:32.498181 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f5bfd51c-bdb6-4d86-b3e0-f79f69988e90 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 4150177f-2eef-435a-99b2-efa56983c53a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:32.517788 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f5bfd51c-bdb6-4d86-b3e0-f79f69988e90 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:32.518402 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f5bfd51c-bdb6-4d86-b3e0-f79f69988e90 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:32.520154 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f5bfd51c-bdb6-4d86-b3e0-f79f69988e90 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:32.522006 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f5bfd51c-bdb6-4d86-b3e0-f79f69988e90 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:32.524376 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f5bfd51c-bdb6-4d86-b3e0-f79f69988e90 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:32.527177 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f5bfd51c-bdb6-4d86-b3e0-f79f69988e90 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:32.535979 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-351a892f-468e-4471-8b4e-0dfed78cd14e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:32.558993 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-351a892f-468e-4471-8b4e-0dfed78cd14e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1472 microversion: 2.1 time: 0.657377 Oct 23 01:16:32.560165 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 856/1650] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:31 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1472 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:16:32.991475 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f5bfd51c-bdb6-4d86-b3e0-f79f69988e90 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:33.006081 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f5bfd51c-bdb6-4d86-b3e0-f79f69988e90 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a" status: 200 len: 1529 microversion: 2.1 time: 0.514152 Oct 23 01:16:33.023911 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 795/1651] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:32 2022] GET /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a => generated 1529 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:33.127243 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ed234666-0d4c-4b71-a8c4-e339cd2386f2 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:33.128177 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ed234666-0d4c-4b71-a8c4-e339cd2386f2 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 1fb6d268-9409-4ca5-9429-6f00ae7b86c1] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:33.139447 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ed234666-0d4c-4b71-a8c4-e339cd2386f2 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:33.143674 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ed234666-0d4c-4b71-a8c4-e339cd2386f2 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:33.143674 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ed234666-0d4c-4b71-a8c4-e339cd2386f2 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:33.147963 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ed234666-0d4c-4b71-a8c4-e339cd2386f2 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:33.150194 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ed234666-0d4c-4b71-a8c4-e339cd2386f2 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:33.151288 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ed234666-0d4c-4b71-a8c4-e339cd2386f2 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:33.221547 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b4272ed0-1059-4e33-b78f-b409babb59da tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-444151452", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": "none"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:16:33.424242 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-b4272ed0-1059-4e33-b78f-b409babb59da tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:16:33.426884 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-b4272ed0-1059-4e33-b78f-b409babb59da tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:16:33.426884 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-b4272ed0-1059-4e33-b78f-b409babb59da tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:16:33.426884 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-b4272ed0-1059-4e33-b78f-b409babb59da tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:16:33.426884 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-b4272ed0-1059-4e33-b78f-b409babb59da tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:16:33.462584 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b4272ed0-1059-4e33-b78f-b409babb59da tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:33.466518 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b4272ed0-1059-4e33-b78f-b409babb59da tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:33.467776 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b4272ed0-1059-4e33-b78f-b409babb59da tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:33.472043 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b4272ed0-1059-4e33-b78f-b409babb59da tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:33.473032 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b4272ed0-1059-4e33-b78f-b409babb59da tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:33.475678 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b4272ed0-1059-4e33-b78f-b409babb59da tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:33.510389 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=100 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:16:33.556253 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-b4272ed0-1059-4e33-b78f-b409babb59da tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Getting quotas for project 5474182023f5424c84fbe3a41bd47dd9. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:16:33.567958 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-b4272ed0-1059-4e33-b78f-b409babb59da tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Getting quotas for user 7811b4427fd54e14956eae6faee795d7 and project 5474182023f5424c84fbe3a41bd47dd9. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:16:33.588744 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b4272ed0-1059-4e33-b78f-b409babb59da tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:16:33.591510 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b4272ed0-1059-4e33-b78f-b409babb59da tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] [instance: 120895a2-d6c4-47f6-a6e4-32cbcf028037] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:16:33.837641 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b4272ed0-1059-4e33-b78f-b409babb59da tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.902461 Oct 23 01:16:33.839327 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 857/1652] 10.222.0.42 () {62 vars in 1188 bytes} [Sun Oct 23 01:16:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 905 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 23 01:16:33.861336 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9faf9c11-dca9-4811-a128-e43ac63fe767 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:33.862295 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9faf9c11-dca9-4811-a128-e43ac63fe767 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: a78b5bc9-4e8f-44d7-879c-737838cfe1b6] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:33.911402 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9faf9c11-dca9-4811-a128-e43ac63fe767 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:33.912443 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9faf9c11-dca9-4811-a128-e43ac63fe767 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:33.917486 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9faf9c11-dca9-4811-a128-e43ac63fe767 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:33.918683 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9faf9c11-dca9-4811-a128-e43ac63fe767 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:33.919382 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9faf9c11-dca9-4811-a128-e43ac63fe767 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:33.919988 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9faf9c11-dca9-4811-a128-e43ac63fe767 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:34.067786 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9faf9c11-dca9-4811-a128-e43ac63fe767 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9681db3595440a88dacc40393e2e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386d20bba06b48be9a7e51162dc4d814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:34.081542 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9faf9c11-dca9-4811-a128-e43ac63fe767 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] 10.222.0.42 "GET /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6" status: 200 len: 1219 microversion: 2.1 time: 0.240802 Oct 23 01:16:34.099617 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 858/1653] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:33 2022] GET /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6 => generated 1219 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:34.104689 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-14387728-4737-46e4-8a17-b36d2d3a2b5d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:34.105317 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-14387728-4737-46e4-8a17-b36d2d3a2b5d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:34.120840 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ed234666-0d4c-4b71-a8c4-e339cd2386f2 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:34.125606 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-14387728-4737-46e4-8a17-b36d2d3a2b5d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:34.126152 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-14387728-4737-46e4-8a17-b36d2d3a2b5d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:34.126600 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-14387728-4737-46e4-8a17-b36d2d3a2b5d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:34.127314 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-14387728-4737-46e4-8a17-b36d2d3a2b5d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:34.127773 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-14387728-4737-46e4-8a17-b36d2d3a2b5d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:34.128197 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-14387728-4737-46e4-8a17-b36d2d3a2b5d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:34.139597 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ed234666-0d4c-4b71-a8c4-e339cd2386f2 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/1fb6d268-9409-4ca5-9429-6f00ae7b86c1" status: 200 len: 1465 microversion: 2.1 time: 1.021725 Oct 23 01:16:34.140211 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 796/1654] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:33 2022] GET /compute/v2.1/servers/1fb6d268-9409-4ca5-9429-6f00ae7b86c1 => generated 1465 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:34.270321 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-432c39ea-197f-4be2-b0a2-8b2959046613 req-54af71de-59b8-42ac-b37e-1180a716b06a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4150177f-2eef-435a-99b2-efa56983c53a", "name": "network-vif-deleted", "tag": "50e0e9ab-b232-47f9-97de-7b93cc03e0c2"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:16:34.290817 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-432c39ea-197f-4be2-b0a2-8b2959046613 req-54af71de-59b8-42ac-b37e-1180a716b06a service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:34.291295 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-432c39ea-197f-4be2-b0a2-8b2959046613 req-54af71de-59b8-42ac-b37e-1180a716b06a service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:34.291729 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-432c39ea-197f-4be2-b0a2-8b2959046613 req-54af71de-59b8-42ac-b37e-1180a716b06a service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:34.308069 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-432c39ea-197f-4be2-b0a2-8b2959046613 req-54af71de-59b8-42ac-b37e-1180a716b06a service nova] Creating event network-vif-deleted:50e0e9ab-b232-47f9-97de-7b93cc03e0c2 for instance 4150177f-2eef-435a-99b2-efa56983c53a on n-h2-master-1 Oct 23 01:16:34.313792 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-432c39ea-197f-4be2-b0a2-8b2959046613 req-54af71de-59b8-42ac-b37e-1180a716b06a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171885 Oct 23 01:16:34.314224 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 797/1655] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:16:34.322117 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e0bda94e-6dda-4192-a472-5496777c0f26 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:34.322964 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e0bda94e-6dda-4192-a472-5496777c0f26 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] [instance: 120895a2-d6c4-47f6-a6e4-32cbcf028037] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:34.426507 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e0bda94e-6dda-4192-a472-5496777c0f26 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:34.438005 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e0bda94e-6dda-4192-a472-5496777c0f26 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:34.440077 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e0bda94e-6dda-4192-a472-5496777c0f26 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:34.441668 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e0bda94e-6dda-4192-a472-5496777c0f26 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] 10.222.0.42 "GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037" status: 200 len: 1277 microversion: 2.57 time: 0.125522 Oct 23 01:16:34.442542 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 798/1656] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:16:34 2022] GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037 => generated 1277 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:16:34.449636 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-cb83dbdb-8ad2-4652-a9c7-150f5e9a2dec req-14244e05-4315-4e0f-8365-9169e783f349 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4150177f-2eef-435a-99b2-efa56983c53a", "name": "network-vif-unplugged", "status": "completed", "tag": "50e0e9ab-b232-47f9-97de-7b93cc03e0c2"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:16:34.460468 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-cb83dbdb-8ad2-4652-a9c7-150f5e9a2dec req-14244e05-4315-4e0f-8365-9169e783f349 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:34.461439 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-cb83dbdb-8ad2-4652-a9c7-150f5e9a2dec req-14244e05-4315-4e0f-8365-9169e783f349 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:34.462369 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-cb83dbdb-8ad2-4652-a9c7-150f5e9a2dec req-14244e05-4315-4e0f-8365-9169e783f349 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:34.496537 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-cb83dbdb-8ad2-4652-a9c7-150f5e9a2dec req-14244e05-4315-4e0f-8365-9169e783f349 service nova] Creating event network-vif-unplugged:50e0e9ab-b232-47f9-97de-7b93cc03e0c2 for instance 4150177f-2eef-435a-99b2-efa56983c53a on n-h2-master-1 Oct 23 01:16:34.505884 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-cb83dbdb-8ad2-4652-a9c7-150f5e9a2dec req-14244e05-4315-4e0f-8365-9169e783f349 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061658 Oct 23 01:16:34.509207 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 799/1657] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:16:34.515330 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-14387728-4737-46e4-8a17-b36d2d3a2b5d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:34.523075 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c5d8fc4e-2a95-4238-8877-aae4d6d599cc tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:34.523597 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-14387728-4737-46e4-8a17-b36d2d3a2b5d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1472 microversion: 2.1 time: 0.422702 Oct 23 01:16:34.524269 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 859/1658] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:34 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1472 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:34.529777 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e028e802-6a1b-4965-9cbf-41f8dccdcecc tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:34.545833 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c5d8fc4e-2a95-4238-8877-aae4d6d599cc tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 4150177f-2eef-435a-99b2-efa56983c53a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:34.546638 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e028e802-6a1b-4965-9cbf-41f8dccdcecc tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] [instance: 1fb6d268-9409-4ca5-9429-6f00ae7b86c1] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:34.559427 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c5d8fc4e-2a95-4238-8877-aae4d6d599cc tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:34.560241 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c5d8fc4e-2a95-4238-8877-aae4d6d599cc tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:34.562811 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c5d8fc4e-2a95-4238-8877-aae4d6d599cc tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:34.562811 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c5d8fc4e-2a95-4238-8877-aae4d6d599cc tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:34.562811 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c5d8fc4e-2a95-4238-8877-aae4d6d599cc tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:34.563637 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c5d8fc4e-2a95-4238-8877-aae4d6d599cc tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:34.566146 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e028e802-6a1b-4965-9cbf-41f8dccdcecc tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:34.566630 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e028e802-6a1b-4965-9cbf-41f8dccdcecc tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:34.569771 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e028e802-6a1b-4965-9cbf-41f8dccdcecc tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:34.570775 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e028e802-6a1b-4965-9cbf-41f8dccdcecc tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:34.571415 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e028e802-6a1b-4965-9cbf-41f8dccdcecc tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:34.571845 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e028e802-6a1b-4965-9cbf-41f8dccdcecc tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:34.656491 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c5d8fc4e-2a95-4238-8877-aae4d6d599cc tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:34.668583 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c5d8fc4e-2a95-4238-8877-aae4d6d599cc tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a" status: 200 len: 1310 microversion: 2.1 time: 0.150069 Oct 23 01:16:34.669297 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 800/1659] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:34 2022] GET /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a => generated 1310 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:34.843259 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e028e802-6a1b-4965-9cbf-41f8dccdcecc tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/1fb6d268-9409-4ca5-9429-6f00ae7b86c1" status: 200 len: 1616 microversion: 2.1 time: 0.317683 Oct 23 01:16:34.858586 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 860/1660] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:34 2022] GET /compute/v2.1/servers/1fb6d268-9409-4ca5-9429-6f00ae7b86c1 => generated 1616 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:35.001404 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-eab86f0b-24c9-458d-8ac6-de8621949a81 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-253847074", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["cffc5366-8131-4a2b-bf51-39e4d23929e3"]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:16:35.076272 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-eab86f0b-24c9-458d-8ac6-de8621949a81 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] validate_networks() for None {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:16:35.106674 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-480d758c-8252-496f-89d0-08054b6a1814 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:35.107538 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-480d758c-8252-496f-89d0-08054b6a1814 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: a78b5bc9-4e8f-44d7-879c-737838cfe1b6] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:35.120000 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-480d758c-8252-496f-89d0-08054b6a1814 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:35.120957 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-480d758c-8252-496f-89d0-08054b6a1814 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:35.121500 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-480d758c-8252-496f-89d0-08054b6a1814 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:35.124291 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-480d758c-8252-496f-89d0-08054b6a1814 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:35.124836 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-480d758c-8252-496f-89d0-08054b6a1814 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:35.125284 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-480d758c-8252-496f-89d0-08054b6a1814 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:35.265554 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-480d758c-8252-496f-89d0-08054b6a1814 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9681db3595440a88dacc40393e2e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386d20bba06b48be9a7e51162dc4d814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:35.274383 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-480d758c-8252-496f-89d0-08054b6a1814 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] 10.222.0.42 "GET /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6" status: 200 len: 1275 microversion: 2.1 time: 0.172193 Oct 23 01:16:35.290659 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 861/1661] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:35 2022] GET /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6 => generated 1275 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:16:35.453870 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-eab86f0b-24c9-458d-8ac6-de8621949a81 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:16:35.454595 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-eab86f0b-24c9-458d-8ac6-de8621949a81 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:16:35.455872 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-eab86f0b-24c9-458d-8ac6-de8621949a81 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:16:35.456349 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-eab86f0b-24c9-458d-8ac6-de8621949a81 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:16:35.456892 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-eab86f0b-24c9-458d-8ac6-de8621949a81 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:16:35.469221 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eab86f0b-24c9-458d-8ac6-de8621949a81 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:35.469707 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eab86f0b-24c9-458d-8ac6-de8621949a81 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:35.470234 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eab86f0b-24c9-458d-8ac6-de8621949a81 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:35.470964 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eab86f0b-24c9-458d-8ac6-de8621949a81 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:35.476296 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eab86f0b-24c9-458d-8ac6-de8621949a81 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:35.476296 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eab86f0b-24c9-458d-8ac6-de8621949a81 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:35.476550 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1b16060a-9c35-4ba0-a73a-9e1af77a55bd tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:35.476550 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1b16060a-9c35-4ba0-a73a-9e1af77a55bd tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] [instance: 120895a2-d6c4-47f6-a6e4-32cbcf028037] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:35.499032 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-eab86f0b-24c9-458d-8ac6-de8621949a81 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Getting quotas for project 47aadec780734d03a262d4021f48d625. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:16:35.507644 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-eab86f0b-24c9-458d-8ac6-de8621949a81 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Getting quotas for user 519c893a1e094200b882cf23db7cae54 and project 47aadec780734d03a262d4021f48d625. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:16:35.525070 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-eab86f0b-24c9-458d-8ac6-de8621949a81 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:16:35.528176 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-eab86f0b-24c9-458d-8ac6-de8621949a81 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 6d55bc9b-0956-48c3-956a-e72457f8d95e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:16:35.545504 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1b16060a-9c35-4ba0-a73a-9e1af77a55bd tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:35.557668 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1b16060a-9c35-4ba0-a73a-9e1af77a55bd tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:35.560185 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1b16060a-9c35-4ba0-a73a-9e1af77a55bd tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:35.562116 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1b16060a-9c35-4ba0-a73a-9e1af77a55bd tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] 10.222.0.42 "GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037" status: 200 len: 1277 microversion: 2.57 time: 0.092474 Oct 23 01:16:35.563174 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 862/1662] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:16:35 2022] GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037 => generated 1277 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:16:35.569796 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8c8d91f0-50c3-4c5a-8010-0a44fd4cd40b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:35.571088 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8c8d91f0-50c3-4c5a-8010-0a44fd4cd40b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:35.580445 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8c8d91f0-50c3-4c5a-8010-0a44fd4cd40b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:35.581228 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8c8d91f0-50c3-4c5a-8010-0a44fd4cd40b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:35.581891 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8c8d91f0-50c3-4c5a-8010-0a44fd4cd40b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:35.582948 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8c8d91f0-50c3-4c5a-8010-0a44fd4cd40b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:35.583776 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8c8d91f0-50c3-4c5a-8010-0a44fd4cd40b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:35.584404 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8c8d91f0-50c3-4c5a-8010-0a44fd4cd40b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:35.673182 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-eab86f0b-24c9-458d-8ac6-de8621949a81 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.675626 Oct 23 01:16:35.685281 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 801/1663] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:16:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:16:35.713572 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d05e04b6-5074-4bd7-82e2-0067de3c8268 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:35.735698 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d05e04b6-5074-4bd7-82e2-0067de3c8268 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 4150177f-2eef-435a-99b2-efa56983c53a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:35.789510 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d05e04b6-5074-4bd7-82e2-0067de3c8268 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:35.791236 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d05e04b6-5074-4bd7-82e2-0067de3c8268 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:35.804915 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d05e04b6-5074-4bd7-82e2-0067de3c8268 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:35.807162 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d05e04b6-5074-4bd7-82e2-0067de3c8268 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:35.812836 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d05e04b6-5074-4bd7-82e2-0067de3c8268 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:35.814917 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d05e04b6-5074-4bd7-82e2-0067de3c8268 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:35.933329 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d05e04b6-5074-4bd7-82e2-0067de3c8268 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:35.933880 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d05e04b6-5074-4bd7-82e2-0067de3c8268 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:35.934747 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d05e04b6-5074-4bd7-82e2-0067de3c8268 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:35.935253 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-d05e04b6-5074-4bd7-82e2-0067de3c8268 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lazy-loading 'fault' on Instance uuid 4150177f-2eef-435a-99b2-efa56983c53a {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:16:36.061135 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8c8d91f0-50c3-4c5a-8010-0a44fd4cd40b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:36.082914 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8c8d91f0-50c3-4c5a-8010-0a44fd4cd40b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1472 microversion: 2.1 time: 0.518498 Oct 23 01:16:36.085804 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 863/1664] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:35 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1472 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:36.091039 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d05e04b6-5074-4bd7-82e2-0067de3c8268 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:36.091753 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-41455531-8aee-458c-a12a-0a719f6e3135 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:36.092391 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-41455531-8aee-458c-a12a-0a719f6e3135 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 6d55bc9b-0956-48c3-956a-e72457f8d95e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:36.112324 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:16:36.125966 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d05e04b6-5074-4bd7-82e2-0067de3c8268 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a" status: 200 len: 1315 microversion: 2.1 time: 0.427149 Oct 23 01:16:36.128770 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 802/1665] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:35 2022] GET /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a => generated 1315 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:16:36.198039 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-41455531-8aee-458c-a12a-0a719f6e3135 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:36.204005 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-41455531-8aee-458c-a12a-0a719f6e3135 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/6d55bc9b-0956-48c3-956a-e72457f8d95e" status: 200 len: 1216 microversion: 2.1 time: 0.116719 Oct 23 01:16:36.207015 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 864/1666] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:36 2022] GET /compute/v2.1/servers/6d55bc9b-0956-48c3-956a-e72457f8d95e => generated 1216 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:36.301163 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-837a388a-9f09-43ef-b999-eaf243320e0c tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:36.302617 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-837a388a-9f09-43ef-b999-eaf243320e0c tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: a78b5bc9-4e8f-44d7-879c-737838cfe1b6] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:36.315700 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-837a388a-9f09-43ef-b999-eaf243320e0c tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:36.316448 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-837a388a-9f09-43ef-b999-eaf243320e0c tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:36.316883 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-837a388a-9f09-43ef-b999-eaf243320e0c tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:36.318385 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-837a388a-9f09-43ef-b999-eaf243320e0c tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:36.319055 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-837a388a-9f09-43ef-b999-eaf243320e0c tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:36.319480 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-837a388a-9f09-43ef-b999-eaf243320e0c tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:36.400288 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-837a388a-9f09-43ef-b999-eaf243320e0c tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9681db3595440a88dacc40393e2e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386d20bba06b48be9a7e51162dc4d814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:36.415377 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-837a388a-9f09-43ef-b999-eaf243320e0c tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] 10.222.0.42 "GET /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6" status: 200 len: 1283 microversion: 2.1 time: 0.118056 Oct 23 01:16:36.418131 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 803/1667] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:36 2022] GET /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6 => generated 1283 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:36.592812 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-78b6470f-2ef6-4756-aa84-c067996b3416 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:36.592812 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-78b6470f-2ef6-4756-aa84-c067996b3416 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] [instance: 120895a2-d6c4-47f6-a6e4-32cbcf028037] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:36.601537 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78b6470f-2ef6-4756-aa84-c067996b3416 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:36.611299 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78b6470f-2ef6-4756-aa84-c067996b3416 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:36.620575 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78b6470f-2ef6-4756-aa84-c067996b3416 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:36.623967 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78b6470f-2ef6-4756-aa84-c067996b3416 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:36.624916 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78b6470f-2ef6-4756-aa84-c067996b3416 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:36.625602 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78b6470f-2ef6-4756-aa84-c067996b3416 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:36.680616 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1ea7ddba-120b-42a4-a6d4-18f4ef8edd58 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:36.681240 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1ea7ddba-120b-42a4-a6d4-18f4ef8edd58 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:36.689016 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1ea7ddba-120b-42a4-a6d4-18f4ef8edd58 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:36.689517 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1ea7ddba-120b-42a4-a6d4-18f4ef8edd58 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:36.689961 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1ea7ddba-120b-42a4-a6d4-18f4ef8edd58 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:36.690691 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1ea7ddba-120b-42a4-a6d4-18f4ef8edd58 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:36.694298 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1ea7ddba-120b-42a4-a6d4-18f4ef8edd58 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:36.696243 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1ea7ddba-120b-42a4-a6d4-18f4ef8edd58 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:36.823560 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-78b6470f-2ef6-4756-aa84-c067996b3416 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:36.836898 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-78b6470f-2ef6-4756-aa84-c067996b3416 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:36.843735 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-78b6470f-2ef6-4756-aa84-c067996b3416 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:36.845350 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-78b6470f-2ef6-4756-aa84-c067996b3416 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] 10.222.0.42 "GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037" status: 200 len: 1273 microversion: 2.57 time: 0.258055 Oct 23 01:16:36.846598 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 865/1668] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:16:36 2022] GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037 => generated 1273 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:16:36.912387 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-1ea7ddba-120b-42a4-a6d4-18f4ef8edd58 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lazy-loading 'services' on Instance uuid be9a2687-233d-43c3-95b3-3a8b455595c7 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:16:36.933628 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1ea7ddba-120b-42a4-a6d4-18f4ef8edd58 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7" status: 200 len: 2346 microversion: 2.25 time: 0.257738 Oct 23 01:16:36.934802 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 804/1669] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:16:36 2022] GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7 => generated 2346 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:16:36.966306 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4f08f249-e44a-4105-880f-dfe3e3f561e6 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:36.970024 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f08f249-e44a-4105-880f-dfe3e3f561e6 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:36.970741 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f08f249-e44a-4105-880f-dfe3e3f561e6 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:36.971175 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f08f249-e44a-4105-880f-dfe3e3f561e6 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:36.971957 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f08f249-e44a-4105-880f-dfe3e3f561e6 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:36.972695 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f08f249-e44a-4105-880f-dfe3e3f561e6 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:36.973114 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f08f249-e44a-4105-880f-dfe3e3f561e6 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:37.024869 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4f08f249-e44a-4105-880f-dfe3e3f561e6 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.063170 Oct 23 01:16:37.025494 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 866/1670] 10.222.0.42 () {60 vars in 1217 bytes} [Sun Oct 23 01:16:36 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:16:37.128279 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-828834d9-2770-49a7-b4ae-dfa12386d0c1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:37.132094 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-828834d9-2770-49a7-b4ae-dfa12386d0c1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:37.152314 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-828834d9-2770-49a7-b4ae-dfa12386d0c1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:37.153289 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-828834d9-2770-49a7-b4ae-dfa12386d0c1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:37.154112 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-828834d9-2770-49a7-b4ae-dfa12386d0c1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:37.158789 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-eaee08ad-8aaf-4c02-8b7d-37c201e690dc tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:37.158950 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-828834d9-2770-49a7-b4ae-dfa12386d0c1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:37.159062 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-eaee08ad-8aaf-4c02-8b7d-37c201e690dc tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 4150177f-2eef-435a-99b2-efa56983c53a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:37.159174 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-828834d9-2770-49a7-b4ae-dfa12386d0c1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:37.159174 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-828834d9-2770-49a7-b4ae-dfa12386d0c1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:37.167017 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eaee08ad-8aaf-4c02-8b7d-37c201e690dc tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:37.170193 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eaee08ad-8aaf-4c02-8b7d-37c201e690dc tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:37.170811 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eaee08ad-8aaf-4c02-8b7d-37c201e690dc tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:37.172486 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eaee08ad-8aaf-4c02-8b7d-37c201e690dc tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:37.176196 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eaee08ad-8aaf-4c02-8b7d-37c201e690dc tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:37.176961 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eaee08ad-8aaf-4c02-8b7d-37c201e690dc tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:37.257704 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eaee08ad-8aaf-4c02-8b7d-37c201e690dc tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:37.258588 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eaee08ad-8aaf-4c02-8b7d-37c201e690dc tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:37.259187 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eaee08ad-8aaf-4c02-8b7d-37c201e690dc tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:37.259877 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-eaee08ad-8aaf-4c02-8b7d-37c201e690dc tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lazy-loading 'fault' on Instance uuid 4150177f-2eef-435a-99b2-efa56983c53a {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:16:37.388912 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-eaee08ad-8aaf-4c02-8b7d-37c201e690dc tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:37.398167 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-eaee08ad-8aaf-4c02-8b7d-37c201e690dc tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a" status: 200 len: 1315 microversion: 2.1 time: 0.249103 Oct 23 01:16:37.401958 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 867/1671] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:37 2022] GET /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:37.418410 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-61962a10-9b5c-4136-bb67-668746c385d9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:37.419296 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-61962a10-9b5c-4136-bb67-668746c385d9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 6d55bc9b-0956-48c3-956a-e72457f8d95e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:37.427879 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61962a10-9b5c-4136-bb67-668746c385d9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:37.428719 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61962a10-9b5c-4136-bb67-668746c385d9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:37.429393 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61962a10-9b5c-4136-bb67-668746c385d9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:37.430351 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61962a10-9b5c-4136-bb67-668746c385d9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:37.430991 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61962a10-9b5c-4136-bb67-668746c385d9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:37.431582 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61962a10-9b5c-4136-bb67-668746c385d9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:37.592971 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-828834d9-2770-49a7-b4ae-dfa12386d0c1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:37.607170 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-828834d9-2770-49a7-b4ae-dfa12386d0c1 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1477 microversion: 2.1 time: 0.493939 Oct 23 01:16:37.608312 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 805/1672] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:37 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1477 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:37.619370 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-61962a10-9b5c-4136-bb67-668746c385d9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:37.629193 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-61962a10-9b5c-4136-bb67-668746c385d9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/6d55bc9b-0956-48c3-956a-e72457f8d95e" status: 200 len: 1220 microversion: 2.1 time: 0.226074 Oct 23 01:16:37.634368 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-36390b7f-5ccf-4d4b-bc40-da7a5d8cffd1 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:37.635066 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-36390b7f-5ccf-4d4b-bc40-da7a5d8cffd1 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: a78b5bc9-4e8f-44d7-879c-737838cfe1b6] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:37.642030 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 868/1673] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:37 2022] GET /compute/v2.1/servers/6d55bc9b-0956-48c3-956a-e72457f8d95e => generated 1220 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:37.654716 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36390b7f-5ccf-4d4b-bc40-da7a5d8cffd1 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:37.655221 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36390b7f-5ccf-4d4b-bc40-da7a5d8cffd1 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:37.660027 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36390b7f-5ccf-4d4b-bc40-da7a5d8cffd1 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:37.661164 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36390b7f-5ccf-4d4b-bc40-da7a5d8cffd1 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:37.662903 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36390b7f-5ccf-4d4b-bc40-da7a5d8cffd1 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:37.663894 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36390b7f-5ccf-4d4b-bc40-da7a5d8cffd1 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:37.753661 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-36390b7f-5ccf-4d4b-bc40-da7a5d8cffd1 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9681db3595440a88dacc40393e2e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386d20bba06b48be9a7e51162dc4d814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:37.762294 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-36390b7f-5ccf-4d4b-bc40-da7a5d8cffd1 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] 10.222.0.42 "GET /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6" status: 200 len: 1281 microversion: 2.1 time: 0.152668 Oct 23 01:16:37.763082 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 806/1674] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:37 2022] GET /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6 => generated 1281 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:37.876617 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1a8e5318-dbfe-4dcc-8c92-abed51800ecc tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:37.877329 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1a8e5318-dbfe-4dcc-8c92-abed51800ecc tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] [instance: 120895a2-d6c4-47f6-a6e4-32cbcf028037] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:37.884946 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1a8e5318-dbfe-4dcc-8c92-abed51800ecc tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:37.885592 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1a8e5318-dbfe-4dcc-8c92-abed51800ecc tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:37.886065 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1a8e5318-dbfe-4dcc-8c92-abed51800ecc tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:37.886799 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1a8e5318-dbfe-4dcc-8c92-abed51800ecc tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:37.888566 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1a8e5318-dbfe-4dcc-8c92-abed51800ecc tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:37.889102 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1a8e5318-dbfe-4dcc-8c92-abed51800ecc tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:38.078972 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1a8e5318-dbfe-4dcc-8c92-abed51800ecc tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:38.096064 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1a8e5318-dbfe-4dcc-8c92-abed51800ecc tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:38.098961 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1a8e5318-dbfe-4dcc-8c92-abed51800ecc tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:38.113623 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1a8e5318-dbfe-4dcc-8c92-abed51800ecc tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] 10.222.0.42 "GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037" status: 200 len: 1329 microversion: 2.57 time: 0.242882 Oct 23 01:16:38.121954 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 869/1675] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:16:37 2022] GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037 => generated 1329 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:16:38.430372 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fddd6295-0fb2-4ff2-87d5-01bda8260fca tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:38.432545 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fddd6295-0fb2-4ff2-87d5-01bda8260fca tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 4150177f-2eef-435a-99b2-efa56983c53a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:38.444425 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fddd6295-0fb2-4ff2-87d5-01bda8260fca tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:38.445075 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fddd6295-0fb2-4ff2-87d5-01bda8260fca tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:38.445876 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fddd6295-0fb2-4ff2-87d5-01bda8260fca tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:38.446818 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fddd6295-0fb2-4ff2-87d5-01bda8260fca tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:38.447573 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fddd6295-0fb2-4ff2-87d5-01bda8260fca tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:38.448220 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fddd6295-0fb2-4ff2-87d5-01bda8260fca tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:38.478588 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-fddd6295-0fb2-4ff2-87d5-01bda8260fca tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] HTTP exception thrown: Instance 4150177f-2eef-435a-99b2-efa56983c53a could not be found. Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fddd6295-0fb2-4ff2-87d5-01bda8260fca tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Request method failure captured: Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a HTTP/1.1 Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJWaABlg9aZPPmiKYOFyjnW3cUDNfMTW-9Ow-Ga99e9rhT_Xz0fOPaBTxk-ZvoWH3eiZ84RoqOaVKmH_NPvl5JjsEC9A2dnRRYDDEs3eUATgMIXjceNensPNpeVu874ElZedsjKlwKXnfqakqBoob0ap94r3bfJNgcmUxWbrsNVh5-k Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 1aa3395c4af3435eaa3a0f49e19167fe Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-421844011 Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1aa3395c4af3435eaa3a0f49e19167fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1aa3395c4af3435eaa3a0f49e19167fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1aa3395c4af3435eaa3a0f49e19167fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1aa3395c4af3435eaa3a0f49e19167fe"}]}] Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-421844011 Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 1aa3395c4af3435eaa3a0f49e19167fe Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-421844011 Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ImagesOneServerNegativeTestJSON-421844011-project Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 690143905857471f949b1f4454ad2139 Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-421844011-project Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 4150177f-2eef-435a-99b2-efa56983c53a could not be found. Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '4150177f-2eef-435a-99b2-efa56983c53a'} Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4150177f-2eef-435a-99b2-efa56983c53a could not be found. Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4150177f-2eef-435a-99b2-efa56983c53a could not be found. Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:16:38.483297 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:16:38.488371 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:16:38.488371 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:16:38.488371 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:16:38.488371 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:16:38.488371 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:16:38.488371 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:16:38.488371 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4150177f-2eef-435a-99b2-efa56983c53a could not be found. Oct 23 01:16:38.488371 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:16:38.495103 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fddd6295-0fb2-4ff2-87d5-01bda8260fca tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Returning 404 to user: Instance 4150177f-2eef-435a-99b2-efa56983c53a could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:16:38.496178 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fddd6295-0fb2-4ff2-87d5-01bda8260fca tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a" status: 404 len: 111 microversion: 2.1 time: 0.074974 Oct 23 01:16:38.497688 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 807/1676] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:38 2022] GET /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:16:38.635216 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3ff929d5-c55b-4b2b-9b4c-2c8c6ac981c7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:38.636109 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3ff929d5-c55b-4b2b-9b4c-2c8c6ac981c7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:38.656419 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-34bee9c9-9b5f-44db-b8d7-7c7a5e80da82 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:38.657931 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-34bee9c9-9b5f-44db-b8d7-7c7a5e80da82 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 6d55bc9b-0956-48c3-956a-e72457f8d95e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:38.666591 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3ff929d5-c55b-4b2b-9b4c-2c8c6ac981c7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:38.669898 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3ff929d5-c55b-4b2b-9b4c-2c8c6ac981c7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:38.671415 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3ff929d5-c55b-4b2b-9b4c-2c8c6ac981c7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:38.672196 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3ff929d5-c55b-4b2b-9b4c-2c8c6ac981c7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:38.672653 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3ff929d5-c55b-4b2b-9b4c-2c8c6ac981c7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:38.679250 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3ff929d5-c55b-4b2b-9b4c-2c8c6ac981c7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:38.684264 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-34bee9c9-9b5f-44db-b8d7-7c7a5e80da82 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:38.685606 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-34bee9c9-9b5f-44db-b8d7-7c7a5e80da82 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:38.689602 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-34bee9c9-9b5f-44db-b8d7-7c7a5e80da82 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:38.695374 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-34bee9c9-9b5f-44db-b8d7-7c7a5e80da82 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:38.695899 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-34bee9c9-9b5f-44db-b8d7-7c7a5e80da82 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:38.696340 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-34bee9c9-9b5f-44db-b8d7-7c7a5e80da82 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:38.837260 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-34bee9c9-9b5f-44db-b8d7-7c7a5e80da82 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:38.848127 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-34bee9c9-9b5f-44db-b8d7-7c7a5e80da82 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/6d55bc9b-0956-48c3-956a-e72457f8d95e" status: 200 len: 1268 microversion: 2.1 time: 0.196367 Oct 23 01:16:38.864426 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 808/1677] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:38 2022] GET /compute/v2.1/servers/6d55bc9b-0956-48c3-956a-e72457f8d95e => generated 1268 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:16:38.864426 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3af15bcd-bf15-4bf4-babd-8ff0914f3e16 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-109245622", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:16:38.946792 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-3af15bcd-bf15-4bf4-babd-8ff0914f3e16 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] validate_networks() for [('9752ed79-332c-4c91-93b8-957eba739dbd', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:16:39.008191 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3ff929d5-c55b-4b2b-9b4c-2c8c6ac981c7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:39.019369 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3ff929d5-c55b-4b2b-9b4c-2c8c6ac981c7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1477 microversion: 2.1 time: 0.386384 Oct 23 01:16:39.022128 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 870/1678] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:38 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1477 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:39.041956 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-052f14a4-9353-4184-a78b-e201b84b655b tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:39.043110 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-052f14a4-9353-4184-a78b-e201b84b655b tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: a78b5bc9-4e8f-44d7-879c-737838cfe1b6] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:39.053047 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-052f14a4-9353-4184-a78b-e201b84b655b tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:39.055703 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-052f14a4-9353-4184-a78b-e201b84b655b tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:39.060752 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-052f14a4-9353-4184-a78b-e201b84b655b tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:39.061894 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-052f14a4-9353-4184-a78b-e201b84b655b tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:39.063645 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-052f14a4-9353-4184-a78b-e201b84b655b tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:39.064959 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-052f14a4-9353-4184-a78b-e201b84b655b tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:39.638496 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-052f14a4-9353-4184-a78b-e201b84b655b tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9681db3595440a88dacc40393e2e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386d20bba06b48be9a7e51162dc4d814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:39.671844 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-052f14a4-9353-4184-a78b-e201b84b655b tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] 10.222.0.42 "GET /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6" status: 200 len: 1323 microversion: 2.1 time: 0.639475 Oct 23 01:16:39.672572 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 871/1679] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:39 2022] GET /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6 => generated 1323 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:39.682044 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0ddc4ded-5bd3-4b86-9ffe-c9fd8ce3dc32 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:39.692496 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0ddc4ded-5bd3-4b86-9ffe-c9fd8ce3dc32 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] [instance: 120895a2-d6c4-47f6-a6e4-32cbcf028037] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:39.713708 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0ddc4ded-5bd3-4b86-9ffe-c9fd8ce3dc32 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:39.720013 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0ddc4ded-5bd3-4b86-9ffe-c9fd8ce3dc32 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:39.725233 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0ddc4ded-5bd3-4b86-9ffe-c9fd8ce3dc32 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:39.727344 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0ddc4ded-5bd3-4b86-9ffe-c9fd8ce3dc32 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:39.730845 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0ddc4ded-5bd3-4b86-9ffe-c9fd8ce3dc32 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:39.731279 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0ddc4ded-5bd3-4b86-9ffe-c9fd8ce3dc32 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:40.047873 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0ddc4ded-5bd3-4b86-9ffe-c9fd8ce3dc32 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:40.059984 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0ddc4ded-5bd3-4b86-9ffe-c9fd8ce3dc32 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:40.063623 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0ddc4ded-5bd3-4b86-9ffe-c9fd8ce3dc32 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:40.071499 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0ddc4ded-5bd3-4b86-9ffe-c9fd8ce3dc32 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] 10.222.0.42 "GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037" status: 200 len: 1335 microversion: 2.57 time: 0.395523 Oct 23 01:16:40.072720 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 872/1680] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:16:39 2022] GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037 => generated 1335 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:16:40.091072 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ccb9c2e7-22ca-447a-8f6d-4ec4594510a3 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:40.091705 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ccb9c2e7-22ca-447a-8f6d-4ec4594510a3 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 6d55bc9b-0956-48c3-956a-e72457f8d95e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:40.098049 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ccb9c2e7-22ca-447a-8f6d-4ec4594510a3 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:40.103330 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ccb9c2e7-22ca-447a-8f6d-4ec4594510a3 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:40.103330 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ccb9c2e7-22ca-447a-8f6d-4ec4594510a3 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:40.103330 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ccb9c2e7-22ca-447a-8f6d-4ec4594510a3 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:40.103330 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ccb9c2e7-22ca-447a-8f6d-4ec4594510a3 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:40.103330 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ccb9c2e7-22ca-447a-8f6d-4ec4594510a3 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:40.302812 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-3af15bcd-bf15-4bf4-babd-8ff0914f3e16 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:16:40.303333 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-3af15bcd-bf15-4bf4-babd-8ff0914f3e16 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:16:40.303957 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-3af15bcd-bf15-4bf4-babd-8ff0914f3e16 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:16:40.304374 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-3af15bcd-bf15-4bf4-babd-8ff0914f3e16 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:16:40.304922 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-3af15bcd-bf15-4bf4-babd-8ff0914f3e16 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:16:40.322508 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3af15bcd-bf15-4bf4-babd-8ff0914f3e16 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:40.324257 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3af15bcd-bf15-4bf4-babd-8ff0914f3e16 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:40.326119 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3af15bcd-bf15-4bf4-babd-8ff0914f3e16 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:40.326926 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3af15bcd-bf15-4bf4-babd-8ff0914f3e16 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:40.327395 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3af15bcd-bf15-4bf4-babd-8ff0914f3e16 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:40.327829 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3af15bcd-bf15-4bf4-babd-8ff0914f3e16 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:40.370802 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:16:40.375170 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ccb9c2e7-22ca-447a-8f6d-4ec4594510a3 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:40.378291 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-3af15bcd-bf15-4bf4-babd-8ff0914f3e16 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Getting quotas for project 1aa3395c4af3435eaa3a0f49e19167fe. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:16:40.390592 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ccb9c2e7-22ca-447a-8f6d-4ec4594510a3 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/6d55bc9b-0956-48c3-956a-e72457f8d95e" status: 200 len: 1274 microversion: 2.1 time: 0.312347 Oct 23 01:16:40.391482 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 873/1681] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:40 2022] GET /compute/v2.1/servers/6d55bc9b-0956-48c3-956a-e72457f8d95e => generated 1274 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:40.405253 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-276de395-392f-4f3a-b64a-045b41a652e6 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:40.405253 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-276de395-392f-4f3a-b64a-045b41a652e6 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:40.407310 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-3af15bcd-bf15-4bf4-babd-8ff0914f3e16 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Getting quotas for user 690143905857471f949b1f4454ad2139 and project 1aa3395c4af3435eaa3a0f49e19167fe. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:16:40.409713 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-276de395-392f-4f3a-b64a-045b41a652e6 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:40.410531 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-276de395-392f-4f3a-b64a-045b41a652e6 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:40.411036 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-276de395-392f-4f3a-b64a-045b41a652e6 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:40.412636 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-276de395-392f-4f3a-b64a-045b41a652e6 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:40.412987 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-276de395-392f-4f3a-b64a-045b41a652e6 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:40.413481 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-276de395-392f-4f3a-b64a-045b41a652e6 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:40.423257 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3af15bcd-bf15-4bf4-babd-8ff0914f3e16 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:16:40.426333 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3af15bcd-bf15-4bf4-babd-8ff0914f3e16 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 664ea2e5-4242-4119-9a39-e32c760345b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:16:40.640922 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3af15bcd-bf15-4bf4-babd-8ff0914f3e16 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.789524 Oct 23 01:16:40.642289 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 809/1682] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:16:38 2022] POST /compute/v2.1/servers => generated 383 bytes in 1792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:16:40.649682 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-989c2c5f-e0a2-424f-8fc0-3964910d4884 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "16b31471-3574-49f9-9720-04aa69642a80", "device": "/dev/xvdb"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:16:40.653074 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-989c2c5f-e0a2-424f-8fc0-3964910d4884 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:40.672101 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-989c2c5f-e0a2-424f-8fc0-3964910d4884 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:40.672916 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-989c2c5f-e0a2-424f-8fc0-3964910d4884 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:40.673611 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-989c2c5f-e0a2-424f-8fc0-3964910d4884 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:40.674825 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-989c2c5f-e0a2-424f-8fc0-3964910d4884 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:40.675542 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-989c2c5f-e0a2-424f-8fc0-3964910d4884 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:40.676173 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-989c2c5f-e0a2-424f-8fc0-3964910d4884 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:40.747245 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-276de395-392f-4f3a-b64a-045b41a652e6 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:40.760632 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-276de395-392f-4f3a-b64a-045b41a652e6 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1477 microversion: 2.1 time: 0.362046 Oct 23 01:16:40.765083 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 874/1683] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:40 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1477 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:40.769393 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2ebbfdb3-1abb-421b-8ca0-fd8ce666ab24 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:40.776599 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2ebbfdb3-1abb-421b-8ca0-fd8ce666ab24 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 664ea2e5-4242-4119-9a39-e32c760345b2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:41.074535 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2ebbfdb3-1abb-421b-8ca0-fd8ce666ab24 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:41.082738 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2ebbfdb3-1abb-421b-8ca0-fd8ce666ab24 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/664ea2e5-4242-4119-9a39-e32c760345b2" status: 200 len: 1224 microversion: 2.1 time: 0.319048 Oct 23 01:16:41.085349 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 875/1684] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:40 2022] GET /compute/v2.1/servers/664ea2e5-4242-4119-9a39-e32c760345b2 => generated 1224 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:41.093563 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-34f4011a-4951-4613-b39f-5a7e23271471 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:41.096327 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-34f4011a-4951-4613-b39f-5a7e23271471 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: a78b5bc9-4e8f-44d7-879c-737838cfe1b6] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:41.108644 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-34f4011a-4951-4613-b39f-5a7e23271471 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:41.111282 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-34f4011a-4951-4613-b39f-5a7e23271471 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:41.111741 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-34f4011a-4951-4613-b39f-5a7e23271471 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:41.112486 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-34f4011a-4951-4613-b39f-5a7e23271471 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:41.112943 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-34f4011a-4951-4613-b39f-5a7e23271471 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:41.116356 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-34f4011a-4951-4613-b39f-5a7e23271471 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:41.392315 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-34f4011a-4951-4613-b39f-5a7e23271471 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9681db3595440a88dacc40393e2e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386d20bba06b48be9a7e51162dc4d814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:41.402505 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-34f4011a-4951-4613-b39f-5a7e23271471 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] 10.222.0.42 "GET /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6" status: 200 len: 1323 microversion: 2.1 time: 0.315826 Oct 23 01:16:41.403512 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 876/1685] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:41 2022] GET /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6 => generated 1323 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:41.408287 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-22e1730d-3b1c-4a4b-8f63-ba5c5f2d9d46 req-613f3b4f-2b32-4305-ad02-ddd2671fb048 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a78b5bc9-4e8f-44d7-879c-737838cfe1b6", "tag": "c797d72c-fb4f-47ae-abdc-bb226e15b717"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:16:41.420109 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-22e1730d-3b1c-4a4b-8f63-ba5c5f2d9d46 req-613f3b4f-2b32-4305-ad02-ddd2671fb048 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:41.421069 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-22e1730d-3b1c-4a4b-8f63-ba5c5f2d9d46 req-613f3b4f-2b32-4305-ad02-ddd2671fb048 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:41.421852 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-22e1730d-3b1c-4a4b-8f63-ba5c5f2d9d46 req-613f3b4f-2b32-4305-ad02-ddd2671fb048 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:41.435725 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-22e1730d-3b1c-4a4b-8f63-ba5c5f2d9d46 req-613f3b4f-2b32-4305-ad02-ddd2671fb048 service nova] Creating event network-changed:c797d72c-fb4f-47ae-abdc-bb226e15b717 for instance a78b5bc9-4e8f-44d7-879c-737838cfe1b6 on n-h2-master-1 Oct 23 01:16:41.443137 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-22e1730d-3b1c-4a4b-8f63-ba5c5f2d9d46 req-613f3b4f-2b32-4305-ad02-ddd2671fb048 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038141 Oct 23 01:16:41.444367 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 877/1686] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:16:41.450086 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-638ad905-6ae7-41d6-a7c6-a16ffdf1b695 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:41.451697 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-638ad905-6ae7-41d6-a7c6-a16ffdf1b695 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] [instance: 120895a2-d6c4-47f6-a6e4-32cbcf028037] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:41.460547 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-638ad905-6ae7-41d6-a7c6-a16ffdf1b695 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:41.461614 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-638ad905-6ae7-41d6-a7c6-a16ffdf1b695 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:41.462386 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-638ad905-6ae7-41d6-a7c6-a16ffdf1b695 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:41.463343 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-638ad905-6ae7-41d6-a7c6-a16ffdf1b695 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:41.464024 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-638ad905-6ae7-41d6-a7c6-a16ffdf1b695 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:41.464666 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-638ad905-6ae7-41d6-a7c6-a16ffdf1b695 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:41.517090 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=100 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:16:41.579136 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-638ad905-6ae7-41d6-a7c6-a16ffdf1b695 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:41.588922 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-638ad905-6ae7-41d6-a7c6-a16ffdf1b695 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:41.590408 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-638ad905-6ae7-41d6-a7c6-a16ffdf1b695 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:41.591549 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-638ad905-6ae7-41d6-a7c6-a16ffdf1b695 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] 10.222.0.42 "GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037" status: 200 len: 1335 microversion: 2.57 time: 0.145786 Oct 23 01:16:41.592106 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 878/1687] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:16:41 2022] GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037 => generated 1335 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:16:41.596718 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1722c62e-e326-4c4a-89b3-f3c022a47de8 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:41.597325 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1722c62e-e326-4c4a-89b3-f3c022a47de8 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 6d55bc9b-0956-48c3-956a-e72457f8d95e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:41.603941 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1722c62e-e326-4c4a-89b3-f3c022a47de8 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:41.604436 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1722c62e-e326-4c4a-89b3-f3c022a47de8 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:41.604874 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1722c62e-e326-4c4a-89b3-f3c022a47de8 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:41.605573 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1722c62e-e326-4c4a-89b3-f3c022a47de8 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:41.606049 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1722c62e-e326-4c4a-89b3-f3c022a47de8 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:41.606528 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1722c62e-e326-4c4a-89b3-f3c022a47de8 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:41.694559 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1722c62e-e326-4c4a-89b3-f3c022a47de8 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:41.724880 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1722c62e-e326-4c4a-89b3-f3c022a47de8 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/6d55bc9b-0956-48c3-956a-e72457f8d95e" status: 200 len: 1274 microversion: 2.1 time: 0.131137 Oct 23 01:16:41.725631 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 879/1688] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:41 2022] GET /compute/v2.1/servers/6d55bc9b-0956-48c3-956a-e72457f8d95e => generated 1274 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:41.785684 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8b984858-35a9-4ef0-97ec-f04aae244b11 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:41.786989 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8b984858-35a9-4ef0-97ec-f04aae244b11 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:41.818139 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b984858-35a9-4ef0-97ec-f04aae244b11 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:41.818906 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b984858-35a9-4ef0-97ec-f04aae244b11 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:41.821681 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b984858-35a9-4ef0-97ec-f04aae244b11 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:41.822783 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b984858-35a9-4ef0-97ec-f04aae244b11 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:41.823774 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b984858-35a9-4ef0-97ec-f04aae244b11 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:41.826782 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b984858-35a9-4ef0-97ec-f04aae244b11 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:42.182634 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8b984858-35a9-4ef0-97ec-f04aae244b11 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:42.187067 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-989c2c5f-e0a2-424f-8fc0-3964910d4884 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "POST /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 1.543257 Oct 23 01:16:42.197137 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8b984858-35a9-4ef0-97ec-f04aae244b11 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1477 microversion: 2.1 time: 0.411393 Oct 23 01:16:42.213871 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 810/1690] 10.222.0.42 () {62 vars in 1364 bytes} [Sun Oct 23 01:16:40 2022] POST /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7/os-volume_attachments => generated 194 bytes in 1565 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:16:42.216080 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 880/1690] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:41 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1477 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:16:42.242798 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b1d213cd-5812-4770-80e9-fb180b75a80a tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:42.246038 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b1d213cd-5812-4770-80e9-fb180b75a80a tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 664ea2e5-4242-4119-9a39-e32c760345b2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:42.264174 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b1d213cd-5812-4770-80e9-fb180b75a80a tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:42.265420 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b1d213cd-5812-4770-80e9-fb180b75a80a tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:42.268177 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b1d213cd-5812-4770-80e9-fb180b75a80a tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:42.273868 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b1d213cd-5812-4770-80e9-fb180b75a80a tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:42.274728 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b1d213cd-5812-4770-80e9-fb180b75a80a tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:42.276430 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b1d213cd-5812-4770-80e9-fb180b75a80a tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:42.432151 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-94df328e-1110-4fbb-b5e9-34ac458da1b4 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:42.432853 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-94df328e-1110-4fbb-b5e9-34ac458da1b4 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: a78b5bc9-4e8f-44d7-879c-737838cfe1b6] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:42.443605 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94df328e-1110-4fbb-b5e9-34ac458da1b4 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:42.445691 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94df328e-1110-4fbb-b5e9-34ac458da1b4 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:42.447261 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94df328e-1110-4fbb-b5e9-34ac458da1b4 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:42.448428 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94df328e-1110-4fbb-b5e9-34ac458da1b4 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:42.458923 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94df328e-1110-4fbb-b5e9-34ac458da1b4 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:42.458923 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94df328e-1110-4fbb-b5e9-34ac458da1b4 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:42.591675 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b1d213cd-5812-4770-80e9-fb180b75a80a tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:42.604993 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b1d213cd-5812-4770-80e9-fb180b75a80a tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/664ea2e5-4242-4119-9a39-e32c760345b2" status: 200 len: 1228 microversion: 2.1 time: 0.390118 Oct 23 01:16:42.616921 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 811/1691] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:42 2022] GET /compute/v2.1/servers/664ea2e5-4242-4119-9a39-e32c760345b2 => generated 1228 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:42.659377 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4fc89862-846b-4391-8bf3-34023f1fcba9 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:42.665542 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4fc89862-846b-4391-8bf3-34023f1fcba9 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] [instance: 120895a2-d6c4-47f6-a6e4-32cbcf028037] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:42.677068 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4fc89862-846b-4391-8bf3-34023f1fcba9 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:42.677554 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4fc89862-846b-4391-8bf3-34023f1fcba9 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:42.681590 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4fc89862-846b-4391-8bf3-34023f1fcba9 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:42.685760 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4fc89862-846b-4391-8bf3-34023f1fcba9 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:42.686640 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4fc89862-846b-4391-8bf3-34023f1fcba9 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:42.688144 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4fc89862-846b-4391-8bf3-34023f1fcba9 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:42.864533 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-94df328e-1110-4fbb-b5e9-34ac458da1b4 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9681db3595440a88dacc40393e2e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386d20bba06b48be9a7e51162dc4d814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:42.876026 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-94df328e-1110-4fbb-b5e9-34ac458da1b4 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] 10.222.0.42 "GET /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6" status: 200 len: 1323 microversion: 2.1 time: 0.448336 Oct 23 01:16:42.893225 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 881/1692] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:42 2022] GET /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6 => generated 1323 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:42.920736 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2412f037-afa3-4a54-8e5e-0bca2154628e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:42.922788 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2412f037-afa3-4a54-8e5e-0bca2154628e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 6d55bc9b-0956-48c3-956a-e72457f8d95e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:42.944568 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2412f037-afa3-4a54-8e5e-0bca2154628e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:42.953436 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2412f037-afa3-4a54-8e5e-0bca2154628e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:42.959800 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2412f037-afa3-4a54-8e5e-0bca2154628e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:42.960018 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4fc89862-846b-4391-8bf3-34023f1fcba9 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:42.960598 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2412f037-afa3-4a54-8e5e-0bca2154628e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:42.963228 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2412f037-afa3-4a54-8e5e-0bca2154628e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:42.963716 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2412f037-afa3-4a54-8e5e-0bca2154628e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:42.969960 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4fc89862-846b-4391-8bf3-34023f1fcba9 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:42.972147 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4fc89862-846b-4391-8bf3-34023f1fcba9 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:42.974058 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4fc89862-846b-4391-8bf3-34023f1fcba9 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] 10.222.0.42 "GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037" status: 200 len: 1335 microversion: 2.57 time: 0.359002 Oct 23 01:16:42.975342 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 812/1693] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:16:42 2022] GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037 => generated 1335 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:16:43.224316 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c7ca617d-76bb-4ea0-85b1-468e5c577a00 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:43.225993 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c7ca617d-76bb-4ea0-85b1-468e5c577a00 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:43.245905 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c7ca617d-76bb-4ea0-85b1-468e5c577a00 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:43.247942 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c7ca617d-76bb-4ea0-85b1-468e5c577a00 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:43.251395 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c7ca617d-76bb-4ea0-85b1-468e5c577a00 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:43.252439 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c7ca617d-76bb-4ea0-85b1-468e5c577a00 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:43.254474 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c7ca617d-76bb-4ea0-85b1-468e5c577a00 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:43.267466 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c7ca617d-76bb-4ea0-85b1-468e5c577a00 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:43.520736 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2412f037-afa3-4a54-8e5e-0bca2154628e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:43.532092 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2412f037-afa3-4a54-8e5e-0bca2154628e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/6d55bc9b-0956-48c3-956a-e72457f8d95e" status: 200 len: 1316 microversion: 2.1 time: 0.634757 Oct 23 01:16:43.534708 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 882/1694] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:42 2022] GET /compute/v2.1/servers/6d55bc9b-0956-48c3-956a-e72457f8d95e => generated 1316 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:43.664842 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0c9e1b5f-96a1-48a7-b101-e7b742fd9753 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-822330798", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "7a6a6c21-62ee-4ff5-ad89-ac85c31d0d64"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:16:43.739032 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c7ca617d-76bb-4ea0-85b1-468e5c577a00 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:43.756289 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-0c9e1b5f-96a1-48a7-b101-e7b742fd9753 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] validate_networks() for [('7a6a6c21-62ee-4ff5-ad89-ac85c31d0d64', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:16:43.756973 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c7ca617d-76bb-4ea0-85b1-468e5c577a00 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1477 microversion: 2.1 time: 0.538251 Oct 23 01:16:43.774401 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 813/1695] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:43 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1477 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:16:43.779382 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bf1476ee-223c-46e3-88ba-8047f0989b10 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:43.780004 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bf1476ee-223c-46e3-88ba-8047f0989b10 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 664ea2e5-4242-4119-9a39-e32c760345b2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:43.786622 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf1476ee-223c-46e3-88ba-8047f0989b10 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:43.787113 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf1476ee-223c-46e3-88ba-8047f0989b10 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:43.787620 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf1476ee-223c-46e3-88ba-8047f0989b10 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:43.788323 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf1476ee-223c-46e3-88ba-8047f0989b10 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:43.788777 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf1476ee-223c-46e3-88ba-8047f0989b10 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:43.789198 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf1476ee-223c-46e3-88ba-8047f0989b10 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:43.932618 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bf1476ee-223c-46e3-88ba-8047f0989b10 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:43.950582 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bf1476ee-223c-46e3-88ba-8047f0989b10 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/664ea2e5-4242-4119-9a39-e32c760345b2" status: 200 len: 1276 microversion: 2.1 time: 0.174647 Oct 23 01:16:43.951211 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 814/1696] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:43 2022] GET /compute/v2.1/servers/664ea2e5-4242-4119-9a39-e32c760345b2 => generated 1276 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:43.964887 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6b566485-b5a5-49b2-a067-54d58819d65e tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:43.966915 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6b566485-b5a5-49b2-a067-54d58819d65e tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: a78b5bc9-4e8f-44d7-879c-737838cfe1b6] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:43.972746 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:16:43.980228 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b566485-b5a5-49b2-a067-54d58819d65e tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:43.981100 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b566485-b5a5-49b2-a067-54d58819d65e tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:43.981752 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b566485-b5a5-49b2-a067-54d58819d65e tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:43.982715 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b566485-b5a5-49b2-a067-54d58819d65e tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:43.984432 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b566485-b5a5-49b2-a067-54d58819d65e tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:43.985104 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b566485-b5a5-49b2-a067-54d58819d65e tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:44.310856 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6b566485-b5a5-49b2-a067-54d58819d65e tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9681db3595440a88dacc40393e2e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386d20bba06b48be9a7e51162dc4d814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:44.321877 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6b566485-b5a5-49b2-a067-54d58819d65e tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] 10.222.0.42 "GET /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6" status: 200 len: 1323 microversion: 2.1 time: 0.369448 Oct 23 01:16:44.324199 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 815/1697] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:43 2022] GET /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6 => generated 1323 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:44.331361 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3bd10b29-227c-4db2-8d00-943d66156e43 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:44.332800 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3bd10b29-227c-4db2-8d00-943d66156e43 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] [instance: 120895a2-d6c4-47f6-a6e4-32cbcf028037] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:44.344217 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3bd10b29-227c-4db2-8d00-943d66156e43 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:44.345100 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3bd10b29-227c-4db2-8d00-943d66156e43 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:44.345952 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3bd10b29-227c-4db2-8d00-943d66156e43 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:44.346763 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3bd10b29-227c-4db2-8d00-943d66156e43 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:44.347437 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3bd10b29-227c-4db2-8d00-943d66156e43 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:44.348222 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3bd10b29-227c-4db2-8d00-943d66156e43 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:44.448658 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3bd10b29-227c-4db2-8d00-943d66156e43 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:44.465233 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3bd10b29-227c-4db2-8d00-943d66156e43 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:44.479050 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3bd10b29-227c-4db2-8d00-943d66156e43 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:44.483399 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3bd10b29-227c-4db2-8d00-943d66156e43 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] 10.222.0.42 "GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037" status: 200 len: 1356 microversion: 2.57 time: 0.155107 Oct 23 01:16:44.494940 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 816/1698] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:16:44 2022] GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037 => generated 1356 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:16:44.525820 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0b4bf06f-3870-4409-8733-533e5ad2d9b3 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:16:44.531390 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0b4bf06f-3870-4409-8733-533e5ad2d9b3 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] [instance: 120895a2-d6c4-47f6-a6e4-32cbcf028037] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:44.546865 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b4bf06f-3870-4409-8733-533e5ad2d9b3 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:44.547959 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b4bf06f-3870-4409-8733-533e5ad2d9b3 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:44.547959 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b4bf06f-3870-4409-8733-533e5ad2d9b3 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:44.549929 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b4bf06f-3870-4409-8733-533e5ad2d9b3 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:44.549929 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b4bf06f-3870-4409-8733-533e5ad2d9b3 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:44.550168 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b4bf06f-3870-4409-8733-533e5ad2d9b3 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:44.566798 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-0c9e1b5f-96a1-48a7-b101-e7b742fd9753 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:16:44.567348 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-0c9e1b5f-96a1-48a7-b101-e7b742fd9753 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:16:44.567704 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-0c9e1b5f-96a1-48a7-b101-e7b742fd9753 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:16:44.568110 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-0c9e1b5f-96a1-48a7-b101-e7b742fd9753 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:16:44.568518 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-0c9e1b5f-96a1-48a7-b101-e7b742fd9753 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:16:44.577475 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0c9e1b5f-96a1-48a7-b101-e7b742fd9753 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:44.577943 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0c9e1b5f-96a1-48a7-b101-e7b742fd9753 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:44.578517 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0c9e1b5f-96a1-48a7-b101-e7b742fd9753 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:44.579231 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0c9e1b5f-96a1-48a7-b101-e7b742fd9753 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:44.579675 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0c9e1b5f-96a1-48a7-b101-e7b742fd9753 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:44.580282 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0c9e1b5f-96a1-48a7-b101-e7b742fd9753 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:44.602710 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-0c9e1b5f-96a1-48a7-b101-e7b742fd9753 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Getting quotas for project 50bd4c137b6a42488f39d173d46520dd. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:16:44.608347 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-0c9e1b5f-96a1-48a7-b101-e7b742fd9753 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Getting quotas for user ecb97fa679eb4bf8a41862d3c248a217 and project 50bd4c137b6a42488f39d173d46520dd. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:16:44.622893 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0c9e1b5f-96a1-48a7-b101-e7b742fd9753 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:16:44.625568 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0c9e1b5f-96a1-48a7-b101-e7b742fd9753 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 7fc07c10-f37b-4374-bcc0-25793b180d9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:16:44.664764 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-0b4bf06f-3870-4409-8733-533e5ad2d9b3 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:16:44.664764 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-0b4bf06f-3870-4409-8733-533e5ad2d9b3 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:16:44.665606 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-0b4bf06f-3870-4409-8733-533e5ad2d9b3 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:16:44.666395 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-0b4bf06f-3870-4409-8733-533e5ad2d9b3 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:16:44.668306 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-0b4bf06f-3870-4409-8733-533e5ad2d9b3 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:16:44.793872 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0c9e1b5f-96a1-48a7-b101-e7b742fd9753 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.257776 Oct 23 01:16:44.801403 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 883/1699] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:16:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1259 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:16:44.801403 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9b2223cd-866b-4930-8493-def3df821b0e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:44.809918 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9b2223cd-866b-4930-8493-def3df821b0e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 6d55bc9b-0956-48c3-956a-e72457f8d95e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:44.818252 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b2223cd-866b-4930-8493-def3df821b0e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:44.832415 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b2223cd-866b-4930-8493-def3df821b0e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:44.834601 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b2223cd-866b-4930-8493-def3df821b0e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:44.835514 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b2223cd-866b-4930-8493-def3df821b0e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:44.837057 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b2223cd-866b-4930-8493-def3df821b0e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:44.837768 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b2223cd-866b-4930-8493-def3df821b0e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:44.927664 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0b4bf06f-3870-4409-8733-533e5ad2d9b3 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] [instance: 120895a2-d6c4-47f6-a6e4-32cbcf028037] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:44.939980 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b4bf06f-3870-4409-8733-533e5ad2d9b3 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:44.941421 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b4bf06f-3870-4409-8733-533e5ad2d9b3 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:44.942238 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b4bf06f-3870-4409-8733-533e5ad2d9b3 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:44.944813 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b4bf06f-3870-4409-8733-533e5ad2d9b3 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:44.945692 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b4bf06f-3870-4409-8733-533e5ad2d9b3 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:44.946449 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b4bf06f-3870-4409-8733-533e5ad2d9b3 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:45.029887 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0b4bf06f-3870-4409-8733-533e5ad2d9b3 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] 10.222.0.42 "POST /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037/action" status: 202 len: 1137 microversion: 2.57 time: 0.511492 Oct 23 01:16:45.036611 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 817/1700] 10.222.0.42 () {62 vars in 1320 bytes} [Sun Oct 23 01:16:44 2022] POST /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037/action => generated 1137 bytes in 519 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 23 01:16:45.044841 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-acb97f92-871a-4b1f-8d51-83b619a2171b req-79fbb7d0-8296-476d-ae2d-373004fea7b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d55bc9b-0956-48c3-956a-e72457f8d95e", "tag": "03879caf-2024-417c-867f-e0c1d4c40f1d"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:16:45.085242 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9b2223cd-866b-4930-8493-def3df821b0e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:45.097163 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-acb97f92-871a-4b1f-8d51-83b619a2171b req-79fbb7d0-8296-476d-ae2d-373004fea7b8 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:45.097774 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-acb97f92-871a-4b1f-8d51-83b619a2171b req-79fbb7d0-8296-476d-ae2d-373004fea7b8 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:45.098258 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9b2223cd-866b-4930-8493-def3df821b0e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/6d55bc9b-0956-48c3-956a-e72457f8d95e" status: 200 len: 1316 microversion: 2.1 time: 0.301163 Oct 23 01:16:45.099182 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-acb97f92-871a-4b1f-8d51-83b619a2171b req-79fbb7d0-8296-476d-ae2d-373004fea7b8 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:45.099852 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 884/1701] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:44 2022] GET /compute/v2.1/servers/6d55bc9b-0956-48c3-956a-e72457f8d95e => generated 1316 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:45.120350 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-85efa13d-05d3-4072-ab41-d8c0174f4e12 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:45.120350 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-85efa13d-05d3-4072-ab41-d8c0174f4e12 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:45.135394 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-acb97f92-871a-4b1f-8d51-83b619a2171b req-79fbb7d0-8296-476d-ae2d-373004fea7b8 service nova] Creating event network-changed:03879caf-2024-417c-867f-e0c1d4c40f1d for instance 6d55bc9b-0956-48c3-956a-e72457f8d95e on n-h1-master-1 Oct 23 01:16:45.136976 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-85efa13d-05d3-4072-ab41-d8c0174f4e12 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:45.139896 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-85efa13d-05d3-4072-ab41-d8c0174f4e12 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:45.140471 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-85efa13d-05d3-4072-ab41-d8c0174f4e12 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:45.142890 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-85efa13d-05d3-4072-ab41-d8c0174f4e12 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:45.149038 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-85efa13d-05d3-4072-ab41-d8c0174f4e12 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:45.150542 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-85efa13d-05d3-4072-ab41-d8c0174f4e12 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:45.162221 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-acb97f92-871a-4b1f-8d51-83b619a2171b req-79fbb7d0-8296-476d-ae2d-373004fea7b8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123719 Oct 23 01:16:45.163119 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 818/1702] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:16:45.168980 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cfd7b7fa-ffc4-407d-bbc8-3e73b04189a4 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:45.183319 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-cfd7b7fa-ffc4-407d-bbc8-3e73b04189a4 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 7fc07c10-f37b-4374-bcc0-25793b180d9c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:45.350097 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cfd7b7fa-ffc4-407d-bbc8-3e73b04189a4 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:45.361033 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cfd7b7fa-ffc4-407d-bbc8-3e73b04189a4 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/7fc07c10-f37b-4374-bcc0-25793b180d9c" status: 200 len: 1207 microversion: 2.1 time: 0.195816 Oct 23 01:16:45.374026 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 819/1703] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:45 2022] GET /compute/v2.1/servers/7fc07c10-f37b-4374-bcc0-25793b180d9c => generated 1207 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:45.388252 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e06b5731-d5f4-46a7-aa78-4fe3e89560c5 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:45.390553 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e06b5731-d5f4-46a7-aa78-4fe3e89560c5 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 664ea2e5-4242-4119-9a39-e32c760345b2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:45.444576 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e06b5731-d5f4-46a7-aa78-4fe3e89560c5 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:45.445595 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e06b5731-d5f4-46a7-aa78-4fe3e89560c5 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:45.446398 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e06b5731-d5f4-46a7-aa78-4fe3e89560c5 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:45.447753 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e06b5731-d5f4-46a7-aa78-4fe3e89560c5 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:45.448437 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e06b5731-d5f4-46a7-aa78-4fe3e89560c5 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:45.449084 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e06b5731-d5f4-46a7-aa78-4fe3e89560c5 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:45.641273 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-85efa13d-05d3-4072-ab41-d8c0174f4e12 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:45.660877 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-85efa13d-05d3-4072-ab41-d8c0174f4e12 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1477 microversion: 2.1 time: 0.559019 Oct 23 01:16:45.662488 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 885/1704] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:45 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1477 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:45.670401 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3445ff6c-857b-4943-b397-f6583960482c tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:45.684196 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3445ff6c-857b-4943-b397-f6583960482c tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] [instance: 120895a2-d6c4-47f6-a6e4-32cbcf028037] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:45.695772 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3445ff6c-857b-4943-b397-f6583960482c tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:45.696643 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3445ff6c-857b-4943-b397-f6583960482c tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:45.697316 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3445ff6c-857b-4943-b397-f6583960482c tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:45.698295 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3445ff6c-857b-4943-b397-f6583960482c tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:45.699001 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3445ff6c-857b-4943-b397-f6583960482c tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:45.700371 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3445ff6c-857b-4943-b397-f6583960482c tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:46.032442 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3445ff6c-857b-4943-b397-f6583960482c tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:46.039075 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e06b5731-d5f4-46a7-aa78-4fe3e89560c5 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:46.050094 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e06b5731-d5f4-46a7-aa78-4fe3e89560c5 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/664ea2e5-4242-4119-9a39-e32c760345b2" status: 200 len: 1276 microversion: 2.1 time: 0.686844 Oct 23 01:16:46.055500 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 820/1705] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:45 2022] GET /compute/v2.1/servers/664ea2e5-4242-4119-9a39-e32c760345b2 => generated 1276 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:46.060894 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3445ff6c-857b-4943-b397-f6583960482c tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:46.067037 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-51bc3e00-4c11-44a8-8029-275eae06bcef tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:46.068564 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-51bc3e00-4c11-44a8-8029-275eae06bcef tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: a78b5bc9-4e8f-44d7-879c-737838cfe1b6] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:46.075287 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3445ff6c-857b-4943-b397-f6583960482c tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:46.079536 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3445ff6c-857b-4943-b397-f6583960482c tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] 10.222.0.42 "GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037" status: 200 len: 1365 microversion: 2.57 time: 0.415936 Oct 23 01:16:46.081140 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 886/1706] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:16:45 2022] GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037 => generated 1365 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:16:46.083520 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-51bc3e00-4c11-44a8-8029-275eae06bcef tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:46.084022 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-51bc3e00-4c11-44a8-8029-275eae06bcef tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:46.084466 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-51bc3e00-4c11-44a8-8029-275eae06bcef tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:46.085378 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-51bc3e00-4c11-44a8-8029-275eae06bcef tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:46.085838 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-51bc3e00-4c11-44a8-8029-275eae06bcef tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:46.086295 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-51bc3e00-4c11-44a8-8029-275eae06bcef tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:46.129245 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-852974c5-f1ca-45db-be3a-bba3cc0a2cad tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:46.130725 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-852974c5-f1ca-45db-be3a-bba3cc0a2cad tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 6d55bc9b-0956-48c3-956a-e72457f8d95e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:46.150655 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-852974c5-f1ca-45db-be3a-bba3cc0a2cad tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:46.153699 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-852974c5-f1ca-45db-be3a-bba3cc0a2cad tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:46.158897 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-852974c5-f1ca-45db-be3a-bba3cc0a2cad tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:46.158897 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-852974c5-f1ca-45db-be3a-bba3cc0a2cad tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:46.158897 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-852974c5-f1ca-45db-be3a-bba3cc0a2cad tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:46.158897 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-852974c5-f1ca-45db-be3a-bba3cc0a2cad tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:46.920156 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-852974c5-f1ca-45db-be3a-bba3cc0a2cad tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:46.932558 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-852974c5-f1ca-45db-be3a-bba3cc0a2cad tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/6d55bc9b-0956-48c3-956a-e72457f8d95e" status: 200 len: 1316 microversion: 2.1 time: 0.806867 Oct 23 01:16:46.947816 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 887/1707] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:46 2022] GET /compute/v2.1/servers/6d55bc9b-0956-48c3-956a-e72457f8d95e => generated 1316 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:46.959989 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-877a9972-7bfd-40ec-807c-fa2dc996ac65 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:46.962319 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-877a9972-7bfd-40ec-807c-fa2dc996ac65 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 7fc07c10-f37b-4374-bcc0-25793b180d9c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:46.964398 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-51bc3e00-4c11-44a8-8029-275eae06bcef tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9681db3595440a88dacc40393e2e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386d20bba06b48be9a7e51162dc4d814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:46.973357 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-51bc3e00-4c11-44a8-8029-275eae06bcef tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] 10.222.0.42 "GET /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6" status: 200 len: 1323 microversion: 2.1 time: 0.916472 Oct 23 01:16:46.975293 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 821/1708] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:46 2022] GET /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6 => generated 1323 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:46.984587 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-877a9972-7bfd-40ec-807c-fa2dc996ac65 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:46.985556 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-877a9972-7bfd-40ec-807c-fa2dc996ac65 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:46.988648 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-877a9972-7bfd-40ec-807c-fa2dc996ac65 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:46.991613 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-877a9972-7bfd-40ec-807c-fa2dc996ac65 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:46.992297 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e473fd7f-9159-46e8-bb9e-8861ebfd23d7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:46.992949 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e473fd7f-9159-46e8-bb9e-8861ebfd23d7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:46.993184 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-877a9972-7bfd-40ec-807c-fa2dc996ac65 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:46.993814 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-877a9972-7bfd-40ec-807c-fa2dc996ac65 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:47.001516 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e473fd7f-9159-46e8-bb9e-8861ebfd23d7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:47.002122 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e473fd7f-9159-46e8-bb9e-8861ebfd23d7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:47.002728 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e473fd7f-9159-46e8-bb9e-8861ebfd23d7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:47.003455 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e473fd7f-9159-46e8-bb9e-8861ebfd23d7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:47.004337 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e473fd7f-9159-46e8-bb9e-8861ebfd23d7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:47.004763 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e473fd7f-9159-46e8-bb9e-8861ebfd23d7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:47.137800 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-877a9972-7bfd-40ec-807c-fa2dc996ac65 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:47.147273 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-877a9972-7bfd-40ec-807c-fa2dc996ac65 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/7fc07c10-f37b-4374-bcc0-25793b180d9c" status: 200 len: 1211 microversion: 2.1 time: 0.198286 Oct 23 01:16:47.149727 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 888/1709] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:46 2022] GET /compute/v2.1/servers/7fc07c10-f37b-4374-bcc0-25793b180d9c => generated 1211 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:47.160956 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ac5784f9-7c62-4c10-a337-2d7d61f9c37e tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:47.162786 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ac5784f9-7c62-4c10-a337-2d7d61f9c37e tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 664ea2e5-4242-4119-9a39-e32c760345b2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:47.178267 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ac5784f9-7c62-4c10-a337-2d7d61f9c37e tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:47.180736 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ac5784f9-7c62-4c10-a337-2d7d61f9c37e tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:47.182699 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ac5784f9-7c62-4c10-a337-2d7d61f9c37e tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:47.183767 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ac5784f9-7c62-4c10-a337-2d7d61f9c37e tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:47.188609 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ac5784f9-7c62-4c10-a337-2d7d61f9c37e tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:47.189358 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ac5784f9-7c62-4c10-a337-2d7d61f9c37e tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:47.268172 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e473fd7f-9159-46e8-bb9e-8861ebfd23d7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:47.279319 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e473fd7f-9159-46e8-bb9e-8861ebfd23d7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1477 microversion: 2.1 time: 0.302732 Oct 23 01:16:47.281212 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 822/1710] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:46 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1477 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:47.287098 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cb227c1b-faaa-43c7-a242-2cead16c994d tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:47.288311 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-cb227c1b-faaa-43c7-a242-2cead16c994d tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] [instance: 120895a2-d6c4-47f6-a6e4-32cbcf028037] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:47.312784 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cb227c1b-faaa-43c7-a242-2cead16c994d tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:47.313389 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cb227c1b-faaa-43c7-a242-2cead16c994d tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:47.314529 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cb227c1b-faaa-43c7-a242-2cead16c994d tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:47.317681 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cb227c1b-faaa-43c7-a242-2cead16c994d tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:47.318320 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cb227c1b-faaa-43c7-a242-2cead16c994d tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:47.319510 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cb227c1b-faaa-43c7-a242-2cead16c994d tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:47.343159 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ac5784f9-7c62-4c10-a337-2d7d61f9c37e tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:47.357075 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ac5784f9-7c62-4c10-a337-2d7d61f9c37e tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/664ea2e5-4242-4119-9a39-e32c760345b2" status: 200 len: 1294 microversion: 2.1 time: 0.203792 Oct 23 01:16:47.357792 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 889/1711] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:47 2022] GET /compute/v2.1/servers/664ea2e5-4242-4119-9a39-e32c760345b2 => generated 1294 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:47.416191 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cb227c1b-faaa-43c7-a242-2cead16c994d tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:47.428326 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cb227c1b-faaa-43c7-a242-2cead16c994d tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:47.430110 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cb227c1b-faaa-43c7-a242-2cead16c994d tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:47.431742 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cb227c1b-faaa-43c7-a242-2cead16c994d tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] 10.222.0.42 "GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037" status: 200 len: 1365 microversion: 2.57 time: 0.149714 Oct 23 01:16:47.432490 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 823/1712] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:16:47 2022] GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:16:47.961705 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e2092373-b5ea-40be-8aa8-ae327d6253e4 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:47.962920 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e2092373-b5ea-40be-8aa8-ae327d6253e4 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 6d55bc9b-0956-48c3-956a-e72457f8d95e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:47.970463 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e2092373-b5ea-40be-8aa8-ae327d6253e4 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:47.974209 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e2092373-b5ea-40be-8aa8-ae327d6253e4 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:47.974209 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e2092373-b5ea-40be-8aa8-ae327d6253e4 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:47.974209 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e2092373-b5ea-40be-8aa8-ae327d6253e4 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:47.974209 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e2092373-b5ea-40be-8aa8-ae327d6253e4 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:47.974209 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e2092373-b5ea-40be-8aa8-ae327d6253e4 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:48.000455 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d4101243-181e-4226-a50b-eafa26ef0437 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:48.001426 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d4101243-181e-4226-a50b-eafa26ef0437 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: a78b5bc9-4e8f-44d7-879c-737838cfe1b6] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:48.008039 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d4101243-181e-4226-a50b-eafa26ef0437 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:48.008465 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d4101243-181e-4226-a50b-eafa26ef0437 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:48.008906 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d4101243-181e-4226-a50b-eafa26ef0437 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:48.009611 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d4101243-181e-4226-a50b-eafa26ef0437 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:48.010089 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d4101243-181e-4226-a50b-eafa26ef0437 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:48.010517 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d4101243-181e-4226-a50b-eafa26ef0437 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:48.305481 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e2092373-b5ea-40be-8aa8-ae327d6253e4 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:48.314221 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e2092373-b5ea-40be-8aa8-ae327d6253e4 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/6d55bc9b-0956-48c3-956a-e72457f8d95e" status: 200 len: 1316 microversion: 2.1 time: 0.356814 Oct 23 01:16:48.315180 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 890/1713] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:47 2022] GET /compute/v2.1/servers/6d55bc9b-0956-48c3-956a-e72457f8d95e => generated 1316 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:48.320399 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-783b7216-c7cd-4329-b821-8fadcf4cfd72 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:48.321499 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-783b7216-c7cd-4329-b821-8fadcf4cfd72 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 7fc07c10-f37b-4374-bcc0-25793b180d9c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:48.327990 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-783b7216-c7cd-4329-b821-8fadcf4cfd72 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:48.328750 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-783b7216-c7cd-4329-b821-8fadcf4cfd72 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:48.329416 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-783b7216-c7cd-4329-b821-8fadcf4cfd72 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:48.331317 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-783b7216-c7cd-4329-b821-8fadcf4cfd72 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:48.332132 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-783b7216-c7cd-4329-b821-8fadcf4cfd72 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:48.332792 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-783b7216-c7cd-4329-b821-8fadcf4cfd72 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:48.344452 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d4101243-181e-4226-a50b-eafa26ef0437 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9681db3595440a88dacc40393e2e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386d20bba06b48be9a7e51162dc4d814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:48.363679 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:16:48.366590 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d4101243-181e-4226-a50b-eafa26ef0437 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] 10.222.0.42 "GET /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6" status: 200 len: 1323 microversion: 2.1 time: 0.371019 Oct 23 01:16:48.367556 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 824/1714] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:47 2022] GET /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6 => generated 1323 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:16:48.372974 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d94f1bfd-cd50-4c96-99a9-f6760c379a60 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:48.386223 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d94f1bfd-cd50-4c96-99a9-f6760c379a60 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:48.425150 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d94f1bfd-cd50-4c96-99a9-f6760c379a60 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:48.425657 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d94f1bfd-cd50-4c96-99a9-f6760c379a60 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:48.426597 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d94f1bfd-cd50-4c96-99a9-f6760c379a60 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:48.426861 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d94f1bfd-cd50-4c96-99a9-f6760c379a60 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:48.427328 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d94f1bfd-cd50-4c96-99a9-f6760c379a60 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:48.427748 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d94f1bfd-cd50-4c96-99a9-f6760c379a60 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:48.429753 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-783b7216-c7cd-4329-b821-8fadcf4cfd72 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:48.441939 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-783b7216-c7cd-4329-b821-8fadcf4cfd72 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/7fc07c10-f37b-4374-bcc0-25793b180d9c" status: 200 len: 1259 microversion: 2.1 time: 0.125261 Oct 23 01:16:48.443445 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 891/1715] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:48 2022] GET /compute/v2.1/servers/7fc07c10-f37b-4374-bcc0-25793b180d9c => generated 1259 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:48.450490 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e4ec077a-5673-4cfa-8e49-1513e0b7fa60 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:48.451498 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e4ec077a-5673-4cfa-8e49-1513e0b7fa60 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 664ea2e5-4242-4119-9a39-e32c760345b2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:48.461849 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e4ec077a-5673-4cfa-8e49-1513e0b7fa60 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:48.462706 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e4ec077a-5673-4cfa-8e49-1513e0b7fa60 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:48.463141 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e4ec077a-5673-4cfa-8e49-1513e0b7fa60 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:48.464381 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e4ec077a-5673-4cfa-8e49-1513e0b7fa60 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:48.464855 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e4ec077a-5673-4cfa-8e49-1513e0b7fa60 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:48.465431 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e4ec077a-5673-4cfa-8e49-1513e0b7fa60 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:48.754793 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e4ec077a-5673-4cfa-8e49-1513e0b7fa60 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:48.766491 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e4ec077a-5673-4cfa-8e49-1513e0b7fa60 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/664ea2e5-4242-4119-9a39-e32c760345b2" status: 200 len: 1324 microversion: 2.1 time: 0.318398 Oct 23 01:16:48.785845 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 892/1716] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:48 2022] GET /compute/v2.1/servers/664ea2e5-4242-4119-9a39-e32c760345b2 => generated 1324 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:48.791743 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-122e9da0-7b8b-4ebc-87ba-912ee5caa2f8 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:48.795795 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-122e9da0-7b8b-4ebc-87ba-912ee5caa2f8 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] [instance: 120895a2-d6c4-47f6-a6e4-32cbcf028037] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:48.795925 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d94f1bfd-cd50-4c96-99a9-f6760c379a60 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:48.800064 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-122e9da0-7b8b-4ebc-87ba-912ee5caa2f8 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:48.800562 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-122e9da0-7b8b-4ebc-87ba-912ee5caa2f8 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:48.800997 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-122e9da0-7b8b-4ebc-87ba-912ee5caa2f8 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:48.801139 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d94f1bfd-cd50-4c96-99a9-f6760c379a60 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1477 microversion: 2.1 time: 0.432266 Oct 23 01:16:48.802125 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-122e9da0-7b8b-4ebc-87ba-912ee5caa2f8 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:48.802597 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-122e9da0-7b8b-4ebc-87ba-912ee5caa2f8 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:48.803031 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-122e9da0-7b8b-4ebc-87ba-912ee5caa2f8 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:48.818697 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 825/1717] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:48 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1477 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:48.823930 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-941c2d8f-ddab-4c00-8b65-e7106103d77f req-c494b039-3ae6-4614-b7c4-ff4adc84fb23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a78b5bc9-4e8f-44d7-879c-737838cfe1b6", "name": "network-vif-plugged", "status": "completed", "tag": "c797d72c-fb4f-47ae-abdc-bb226e15b717"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:16:48.834545 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-941c2d8f-ddab-4c00-8b65-e7106103d77f req-c494b039-3ae6-4614-b7c4-ff4adc84fb23 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:48.835280 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-941c2d8f-ddab-4c00-8b65-e7106103d77f req-c494b039-3ae6-4614-b7c4-ff4adc84fb23 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:48.835877 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-941c2d8f-ddab-4c00-8b65-e7106103d77f req-c494b039-3ae6-4614-b7c4-ff4adc84fb23 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:48.858873 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-941c2d8f-ddab-4c00-8b65-e7106103d77f req-c494b039-3ae6-4614-b7c4-ff4adc84fb23 service nova] Creating event network-vif-plugged:c797d72c-fb4f-47ae-abdc-bb226e15b717 for instance a78b5bc9-4e8f-44d7-879c-737838cfe1b6 on n-h2-master-1 Oct 23 01:16:48.865447 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-941c2d8f-ddab-4c00-8b65-e7106103d77f req-c494b039-3ae6-4614-b7c4-ff4adc84fb23 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044538 Oct 23 01:16:48.870310 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 826/1718] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:16:48.905178 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-122e9da0-7b8b-4ebc-87ba-912ee5caa2f8 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:48.919979 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-122e9da0-7b8b-4ebc-87ba-912ee5caa2f8 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:48.923692 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-122e9da0-7b8b-4ebc-87ba-912ee5caa2f8 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:48.925666 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-122e9da0-7b8b-4ebc-87ba-912ee5caa2f8 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] 10.222.0.42 "GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037" status: 200 len: 1365 microversion: 2.57 time: 0.138626 Oct 23 01:16:48.948815 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 893/1719] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:16:48 2022] GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:16:49.339183 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b9a34012-d875-4d4f-af18-becb360de673 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:49.340122 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b9a34012-d875-4d4f-af18-becb360de673 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 6d55bc9b-0956-48c3-956a-e72457f8d95e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:49.350320 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b9a34012-d875-4d4f-af18-becb360de673 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:49.350899 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b9a34012-d875-4d4f-af18-becb360de673 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:49.357855 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b9a34012-d875-4d4f-af18-becb360de673 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:49.357855 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b9a34012-d875-4d4f-af18-becb360de673 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:49.357855 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b9a34012-d875-4d4f-af18-becb360de673 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:49.357855 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b9a34012-d875-4d4f-af18-becb360de673 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:49.395631 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2e31c7f2-88cb-40a6-af86-99815e63328f tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:49.396916 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2e31c7f2-88cb-40a6-af86-99815e63328f tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: a78b5bc9-4e8f-44d7-879c-737838cfe1b6] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:49.405028 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2e31c7f2-88cb-40a6-af86-99815e63328f tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:49.405769 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2e31c7f2-88cb-40a6-af86-99815e63328f tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:49.406459 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2e31c7f2-88cb-40a6-af86-99815e63328f tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:49.407647 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2e31c7f2-88cb-40a6-af86-99815e63328f tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:49.408444 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2e31c7f2-88cb-40a6-af86-99815e63328f tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:49.409107 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2e31c7f2-88cb-40a6-af86-99815e63328f tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:49.556487 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b9a34012-d875-4d4f-af18-becb360de673 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:49.569237 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b9a34012-d875-4d4f-af18-becb360de673 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/6d55bc9b-0956-48c3-956a-e72457f8d95e" status: 200 len: 1316 microversion: 2.1 time: 0.234728 Oct 23 01:16:49.571192 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 827/1720] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:49 2022] GET /compute/v2.1/servers/6d55bc9b-0956-48c3-956a-e72457f8d95e => generated 1316 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:16:49.577371 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3fbfac32-1743-4cb2-bdb8-852563bfe3bd tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:49.578985 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3fbfac32-1743-4cb2-bdb8-852563bfe3bd tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 7fc07c10-f37b-4374-bcc0-25793b180d9c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:49.593270 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2e31c7f2-88cb-40a6-af86-99815e63328f tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9681db3595440a88dacc40393e2e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386d20bba06b48be9a7e51162dc4d814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:49.596006 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3fbfac32-1743-4cb2-bdb8-852563bfe3bd tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:49.596006 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3fbfac32-1743-4cb2-bdb8-852563bfe3bd tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:49.596006 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3fbfac32-1743-4cb2-bdb8-852563bfe3bd tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:49.596006 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3fbfac32-1743-4cb2-bdb8-852563bfe3bd tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:49.596006 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3fbfac32-1743-4cb2-bdb8-852563bfe3bd tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:49.596434 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3fbfac32-1743-4cb2-bdb8-852563bfe3bd tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:49.602642 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2e31c7f2-88cb-40a6-af86-99815e63328f tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] 10.222.0.42 "GET /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6" status: 200 len: 1323 microversion: 2.1 time: 0.212470 Oct 23 01:16:49.603224 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 894/1721] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:49 2022] GET /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6 => generated 1323 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:16:49.608434 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-1656bc41-3a5d-4a9c-9013-3f9144d45518 req-602928ca-d002-488d-90ce-06d80808bd34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "664ea2e5-4242-4119-9a39-e32c760345b2", "tag": "6b8ad487-ddba-4834-a4d5-10c797dc53f2"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:16:49.624277 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-1656bc41-3a5d-4a9c-9013-3f9144d45518 req-602928ca-d002-488d-90ce-06d80808bd34 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:49.624893 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-1656bc41-3a5d-4a9c-9013-3f9144d45518 req-602928ca-d002-488d-90ce-06d80808bd34 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:49.626101 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-1656bc41-3a5d-4a9c-9013-3f9144d45518 req-602928ca-d002-488d-90ce-06d80808bd34 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:49.639450 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-1656bc41-3a5d-4a9c-9013-3f9144d45518 req-602928ca-d002-488d-90ce-06d80808bd34 service nova] Creating event network-changed:6b8ad487-ddba-4834-a4d5-10c797dc53f2 for instance 664ea2e5-4242-4119-9a39-e32c760345b2 on n-h2-master-1 Oct 23 01:16:49.647872 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-1656bc41-3a5d-4a9c-9013-3f9144d45518 req-602928ca-d002-488d-90ce-06d80808bd34 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043097 Oct 23 01:16:49.648811 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 895/1722] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:16:49.687096 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3fbfac32-1743-4cb2-bdb8-852563bfe3bd tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:49.699322 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3fbfac32-1743-4cb2-bdb8-852563bfe3bd tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/7fc07c10-f37b-4374-bcc0-25793b180d9c" status: 200 len: 1259 microversion: 2.1 time: 0.126743 Oct 23 01:16:49.701745 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 828/1723] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:49 2022] GET /compute/v2.1/servers/7fc07c10-f37b-4374-bcc0-25793b180d9c => generated 1259 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:49.795653 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3b0b315c-d92b-4c59-84a9-683c2aafc63a tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:49.796439 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3b0b315c-d92b-4c59-84a9-683c2aafc63a tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 664ea2e5-4242-4119-9a39-e32c760345b2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:49.803586 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b0b315c-d92b-4c59-84a9-683c2aafc63a tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:49.804175 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b0b315c-d92b-4c59-84a9-683c2aafc63a tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:49.804945 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b0b315c-d92b-4c59-84a9-683c2aafc63a tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:49.805507 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b0b315c-d92b-4c59-84a9-683c2aafc63a tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:49.806053 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b0b315c-d92b-4c59-84a9-683c2aafc63a tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:49.806548 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b0b315c-d92b-4c59-84a9-683c2aafc63a tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:49.824138 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=100 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:16:49.825507 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0a05e35b-a8c2-4307-824d-87c953e21fd7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:49.826381 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0a05e35b-a8c2-4307-824d-87c953e21fd7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:49.840599 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0a05e35b-a8c2-4307-824d-87c953e21fd7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:49.841428 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0a05e35b-a8c2-4307-824d-87c953e21fd7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:49.842220 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0a05e35b-a8c2-4307-824d-87c953e21fd7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:49.843435 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0a05e35b-a8c2-4307-824d-87c953e21fd7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:49.844062 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0a05e35b-a8c2-4307-824d-87c953e21fd7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:49.844651 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0a05e35b-a8c2-4307-824d-87c953e21fd7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:50.150643 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3b0b315c-d92b-4c59-84a9-683c2aafc63a tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:50.158850 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3b0b315c-d92b-4c59-84a9-683c2aafc63a tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/664ea2e5-4242-4119-9a39-e32c760345b2" status: 200 len: 1324 microversion: 2.1 time: 0.368970 Oct 23 01:16:50.179353 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0a05e35b-a8c2-4307-824d-87c953e21fd7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:50.187675 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0a05e35b-a8c2-4307-824d-87c953e21fd7 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1477 microversion: 2.1 time: 0.366822 Oct 23 01:16:50.188615 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 829/1724] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:49 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1477 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:50.193574 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bfb957ec-4283-468d-95b9-146f61cac071 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:50.194420 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bfb957ec-4283-468d-95b9-146f61cac071 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] [instance: 120895a2-d6c4-47f6-a6e4-32cbcf028037] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:50.195088 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 896/1725] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:49 2022] GET /compute/v2.1/servers/664ea2e5-4242-4119-9a39-e32c760345b2 => generated 1324 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:50.200998 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bfb957ec-4283-468d-95b9-146f61cac071 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:50.201493 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bfb957ec-4283-468d-95b9-146f61cac071 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:50.201923 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bfb957ec-4283-468d-95b9-146f61cac071 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:50.202660 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bfb957ec-4283-468d-95b9-146f61cac071 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:50.203119 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bfb957ec-4283-468d-95b9-146f61cac071 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:50.203543 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bfb957ec-4283-468d-95b9-146f61cac071 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:50.278444 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bfb957ec-4283-468d-95b9-146f61cac071 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:50.297678 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bfb957ec-4283-468d-95b9-146f61cac071 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:50.299578 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bfb957ec-4283-468d-95b9-146f61cac071 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:50.300875 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bfb957ec-4283-468d-95b9-146f61cac071 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] 10.222.0.42 "GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037" status: 200 len: 1365 microversion: 2.57 time: 0.111125 Oct 23 01:16:50.301461 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 830/1726] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:16:50 2022] GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037 => generated 1365 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:16:50.594017 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fb77aba0-816c-4800-83df-a60abcf83e1a tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:50.594630 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-fb77aba0-816c-4800-83df-a60abcf83e1a tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 6d55bc9b-0956-48c3-956a-e72457f8d95e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:50.601709 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fb77aba0-816c-4800-83df-a60abcf83e1a tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:50.602452 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fb77aba0-816c-4800-83df-a60abcf83e1a tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:50.602882 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fb77aba0-816c-4800-83df-a60abcf83e1a tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:50.603567 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fb77aba0-816c-4800-83df-a60abcf83e1a tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:50.604185 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fb77aba0-816c-4800-83df-a60abcf83e1a tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:50.604601 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fb77aba0-816c-4800-83df-a60abcf83e1a tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:50.629542 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0910bd95-c556-4eb6-8766-302b9e2fa957 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:50.631176 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0910bd95-c556-4eb6-8766-302b9e2fa957 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: a78b5bc9-4e8f-44d7-879c-737838cfe1b6] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:50.641842 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=4 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:16:50.641842 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0910bd95-c556-4eb6-8766-302b9e2fa957 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:50.641842 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0910bd95-c556-4eb6-8766-302b9e2fa957 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:50.641842 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0910bd95-c556-4eb6-8766-302b9e2fa957 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:50.642879 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0910bd95-c556-4eb6-8766-302b9e2fa957 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:50.643589 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0910bd95-c556-4eb6-8766-302b9e2fa957 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:50.644316 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0910bd95-c556-4eb6-8766-302b9e2fa957 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:50.912298 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-fb77aba0-816c-4800-83df-a60abcf83e1a tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:50.922475 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fb77aba0-816c-4800-83df-a60abcf83e1a tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/6d55bc9b-0956-48c3-956a-e72457f8d95e" status: 200 len: 1316 microversion: 2.1 time: 0.332195 Oct 23 01:16:50.936426 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 897/1727] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:50 2022] GET /compute/v2.1/servers/6d55bc9b-0956-48c3-956a-e72457f8d95e => generated 1316 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:50.946184 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5e5bb98f-ee3b-48e6-8523-46c42081cae6 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:50.948159 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0910bd95-c556-4eb6-8766-302b9e2fa957 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9681db3595440a88dacc40393e2e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386d20bba06b48be9a7e51162dc4d814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:50.948308 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5e5bb98f-ee3b-48e6-8523-46c42081cae6 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 7fc07c10-f37b-4374-bcc0-25793b180d9c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:50.955155 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e5bb98f-ee3b-48e6-8523-46c42081cae6 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:50.955888 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e5bb98f-ee3b-48e6-8523-46c42081cae6 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:50.956503 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e5bb98f-ee3b-48e6-8523-46c42081cae6 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:50.957351 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0910bd95-c556-4eb6-8766-302b9e2fa957 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] 10.222.0.42 "GET /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6" status: 200 len: 1323 microversion: 2.1 time: 0.334347 Oct 23 01:16:50.957592 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e5bb98f-ee3b-48e6-8523-46c42081cae6 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:50.958866 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e5bb98f-ee3b-48e6-8523-46c42081cae6 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:50.959457 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e5bb98f-ee3b-48e6-8523-46c42081cae6 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:50.960033 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 831/1728] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:50 2022] GET /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6 => generated 1323 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:51.119885 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5e5bb98f-ee3b-48e6-8523-46c42081cae6 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:51.131114 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5e5bb98f-ee3b-48e6-8523-46c42081cae6 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/7fc07c10-f37b-4374-bcc0-25793b180d9c" status: 200 len: 1307 microversion: 2.1 time: 0.192991 Oct 23 01:16:51.132003 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 898/1729] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:50 2022] GET /compute/v2.1/servers/7fc07c10-f37b-4374-bcc0-25793b180d9c => generated 1307 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:51.195480 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dcd9f472-b8ef-4995-adc0-1560c70dcda5 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:51.196183 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-dcd9f472-b8ef-4995-adc0-1560c70dcda5 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 664ea2e5-4242-4119-9a39-e32c760345b2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:51.202684 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dcd9f472-b8ef-4995-adc0-1560c70dcda5 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:51.203264 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dcd9f472-b8ef-4995-adc0-1560c70dcda5 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:51.203766 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dcd9f472-b8ef-4995-adc0-1560c70dcda5 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:51.204567 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dcd9f472-b8ef-4995-adc0-1560c70dcda5 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:51.205136 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dcd9f472-b8ef-4995-adc0-1560c70dcda5 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:51.205628 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dcd9f472-b8ef-4995-adc0-1560c70dcda5 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:51.216238 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-86145d2a-cd8f-439d-b0cd-54b651ac044b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:51.217419 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-86145d2a-cd8f-439d-b0cd-54b651ac044b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:51.224867 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-86145d2a-cd8f-439d-b0cd-54b651ac044b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:51.225369 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-86145d2a-cd8f-439d-b0cd-54b651ac044b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:51.225808 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-86145d2a-cd8f-439d-b0cd-54b651ac044b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:51.227233 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-86145d2a-cd8f-439d-b0cd-54b651ac044b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:51.227884 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-86145d2a-cd8f-439d-b0cd-54b651ac044b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:51.228320 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-86145d2a-cd8f-439d-b0cd-54b651ac044b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:51.526880 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-dcd9f472-b8ef-4995-adc0-1560c70dcda5 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:51.534662 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-dcd9f472-b8ef-4995-adc0-1560c70dcda5 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/664ea2e5-4242-4119-9a39-e32c760345b2" status: 200 len: 1324 microversion: 2.1 time: 0.343693 Oct 23 01:16:51.535231 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 832/1730] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:51 2022] GET /compute/v2.1/servers/664ea2e5-4242-4119-9a39-e32c760345b2 => generated 1324 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:51.539632 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bc1b255b-b6ed-47dc-8249-e91cd27d1058 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:51.540238 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bc1b255b-b6ed-47dc-8249-e91cd27d1058 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] [instance: 120895a2-d6c4-47f6-a6e4-32cbcf028037] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:51.545819 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc1b255b-b6ed-47dc-8249-e91cd27d1058 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:51.546351 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc1b255b-b6ed-47dc-8249-e91cd27d1058 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:51.546779 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc1b255b-b6ed-47dc-8249-e91cd27d1058 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:51.547460 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc1b255b-b6ed-47dc-8249-e91cd27d1058 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:51.547915 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc1b255b-b6ed-47dc-8249-e91cd27d1058 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:51.548339 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc1b255b-b6ed-47dc-8249-e91cd27d1058 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:51.576506 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-86145d2a-cd8f-439d-b0cd-54b651ac044b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:51.587256 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-86145d2a-cd8f-439d-b0cd-54b651ac044b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1477 microversion: 2.1 time: 0.375245 Oct 23 01:16:51.587834 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 899/1731] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:51 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1477 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:16:51.623985 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bc1b255b-b6ed-47dc-8249-e91cd27d1058 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:51.632794 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bc1b255b-b6ed-47dc-8249-e91cd27d1058 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:51.634270 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bc1b255b-b6ed-47dc-8249-e91cd27d1058 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:51.635917 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bc1b255b-b6ed-47dc-8249-e91cd27d1058 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] 10.222.0.42 "GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037" status: 200 len: 1365 microversion: 2.57 time: 0.099314 Oct 23 01:16:51.636043 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 833/1732] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:16:51 2022] GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037 => generated 1365 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:16:51.940091 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-fc3e8ddb-6016-4a66-bccb-f8f0e16bcaf3 req-5d96bb4e-fb17-43c5-86b1-31800c635ece service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d55bc9b-0956-48c3-956a-e72457f8d95e", "name": "network-vif-plugged", "status": "completed", "tag": "03879caf-2024-417c-867f-e0c1d4c40f1d"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:16:51.951055 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7d99ef93-ed77-4fd7-9739-aac5da5590f6 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:51.951492 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-fc3e8ddb-6016-4a66-bccb-f8f0e16bcaf3 req-5d96bb4e-fb17-43c5-86b1-31800c635ece service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:51.951978 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-fc3e8ddb-6016-4a66-bccb-f8f0e16bcaf3 req-5d96bb4e-fb17-43c5-86b1-31800c635ece service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:51.952279 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7d99ef93-ed77-4fd7-9739-aac5da5590f6 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 6d55bc9b-0956-48c3-956a-e72457f8d95e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:51.952554 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-fc3e8ddb-6016-4a66-bccb-f8f0e16bcaf3 req-5d96bb4e-fb17-43c5-86b1-31800c635ece service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:51.959673 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d99ef93-ed77-4fd7-9739-aac5da5590f6 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:51.960431 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d99ef93-ed77-4fd7-9739-aac5da5590f6 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:51.961033 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d99ef93-ed77-4fd7-9739-aac5da5590f6 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:51.962109 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d99ef93-ed77-4fd7-9739-aac5da5590f6 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:51.962812 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d99ef93-ed77-4fd7-9739-aac5da5590f6 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:51.963305 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d99ef93-ed77-4fd7-9739-aac5da5590f6 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:51.964596 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-fc3e8ddb-6016-4a66-bccb-f8f0e16bcaf3 req-5d96bb4e-fb17-43c5-86b1-31800c635ece service nova] Creating event network-vif-plugged:03879caf-2024-417c-867f-e0c1d4c40f1d for instance 6d55bc9b-0956-48c3-956a-e72457f8d95e on n-h1-master-1 Oct 23 01:16:51.971996 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-fc3e8ddb-6016-4a66-bccb-f8f0e16bcaf3 req-5d96bb4e-fb17-43c5-86b1-31800c635ece service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036091 Oct 23 01:16:51.974686 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 900/1733] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:16:51.986628 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e58aa5d0-accc-46c8-91fc-6fc47cb5bab3 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:51.987587 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e58aa5d0-accc-46c8-91fc-6fc47cb5bab3 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: a78b5bc9-4e8f-44d7-879c-737838cfe1b6] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:51.994866 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e58aa5d0-accc-46c8-91fc-6fc47cb5bab3 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:51.995681 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e58aa5d0-accc-46c8-91fc-6fc47cb5bab3 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:51.996180 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e58aa5d0-accc-46c8-91fc-6fc47cb5bab3 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:51.996969 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e58aa5d0-accc-46c8-91fc-6fc47cb5bab3 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:51.997642 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e58aa5d0-accc-46c8-91fc-6fc47cb5bab3 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:51.998159 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e58aa5d0-accc-46c8-91fc-6fc47cb5bab3 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:52.258409 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7d99ef93-ed77-4fd7-9739-aac5da5590f6 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:52.266796 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7d99ef93-ed77-4fd7-9739-aac5da5590f6 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/6d55bc9b-0956-48c3-956a-e72457f8d95e" status: 200 len: 1316 microversion: 2.1 time: 0.320444 Oct 23 01:16:52.266938 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 834/1734] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:51 2022] GET /compute/v2.1/servers/6d55bc9b-0956-48c3-956a-e72457f8d95e => generated 1316 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:52.267152 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e58aa5d0-accc-46c8-91fc-6fc47cb5bab3 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9681db3595440a88dacc40393e2e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386d20bba06b48be9a7e51162dc4d814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:52.274442 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bc1bdfe9-1a46-4a72-95a9-538162ba8385 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:52.275061 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bc1bdfe9-1a46-4a72-95a9-538162ba8385 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 7fc07c10-f37b-4374-bcc0-25793b180d9c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:52.281242 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc1bdfe9-1a46-4a72-95a9-538162ba8385 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:52.281717 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc1bdfe9-1a46-4a72-95a9-538162ba8385 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:52.282406 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc1bdfe9-1a46-4a72-95a9-538162ba8385 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:52.283292 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc1bdfe9-1a46-4a72-95a9-538162ba8385 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:52.283444 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e58aa5d0-accc-46c8-91fc-6fc47cb5bab3 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] 10.222.0.42 "GET /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6" status: 200 len: 1520 microversion: 2.1 time: 0.300917 Oct 23 01:16:52.284123 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc1bdfe9-1a46-4a72-95a9-538162ba8385 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:52.290146 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 901/1735] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:51 2022] GET /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6 => generated 1520 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:52.291015 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc1bdfe9-1a46-4a72-95a9-538162ba8385 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:52.307253 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8dbbed05-f36f-446e-a39b-f0da11f73406 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Action: 'create', calling method: .version_select at 0x7f5cc631fc10>, body: {"pool": null} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:16:52.558400 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bc1bdfe9-1a46-4a72-95a9-538162ba8385 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:52.567204 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bc1bdfe9-1a46-4a72-95a9-538162ba8385 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/7fc07c10-f37b-4374-bcc0-25793b180d9c" status: 200 len: 1307 microversion: 2.1 time: 0.299169 Oct 23 01:16:52.568551 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 835/1736] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:52 2022] GET /compute/v2.1/servers/7fc07c10-f37b-4374-bcc0-25793b180d9c => generated 1307 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:52.579246 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-ea6e843d-bbe7-4697-af98-555a5a6a4250 req-e2128d14-62cb-4bae-b32b-5d950994af50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fc07c10-f37b-4374-bcc0-25793b180d9c", "tag": "bedfc922-9657-4f3f-8344-e550f8d72082"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:16:52.589502 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-ea6e843d-bbe7-4697-af98-555a5a6a4250 req-e2128d14-62cb-4bae-b32b-5d950994af50 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:52.590008 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-ea6e843d-bbe7-4697-af98-555a5a6a4250 req-e2128d14-62cb-4bae-b32b-5d950994af50 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:52.590436 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-ea6e843d-bbe7-4697-af98-555a5a6a4250 req-e2128d14-62cb-4bae-b32b-5d950994af50 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:52.601218 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-ea6e843d-bbe7-4697-af98-555a5a6a4250 req-e2128d14-62cb-4bae-b32b-5d950994af50 service nova] Creating event network-changed:bedfc922-9657-4f3f-8344-e550f8d72082 for instance 7fc07c10-f37b-4374-bcc0-25793b180d9c on n-h1-master-1 Oct 23 01:16:52.605912 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-ea6e843d-bbe7-4697-af98-555a5a6a4250 req-e2128d14-62cb-4bae-b32b-5d950994af50 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030562 Oct 23 01:16:52.606602 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 836/1737] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:16:52.611509 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-64e321fa-da9a-41a0-b9b6-a2a17e10182b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:52.612200 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-64e321fa-da9a-41a0-b9b6-a2a17e10182b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 664ea2e5-4242-4119-9a39-e32c760345b2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:52.618316 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-64e321fa-da9a-41a0-b9b6-a2a17e10182b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:52.618811 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-64e321fa-da9a-41a0-b9b6-a2a17e10182b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:52.619281 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-64e321fa-da9a-41a0-b9b6-a2a17e10182b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:52.619929 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-64e321fa-da9a-41a0-b9b6-a2a17e10182b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:52.621143 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-64e321fa-da9a-41a0-b9b6-a2a17e10182b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:52.621578 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-64e321fa-da9a-41a0-b9b6-a2a17e10182b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:52.862782 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-64e321fa-da9a-41a0-b9b6-a2a17e10182b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:52.871706 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-64e321fa-da9a-41a0-b9b6-a2a17e10182b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/664ea2e5-4242-4119-9a39-e32c760345b2" status: 200 len: 1324 microversion: 2.1 time: 0.263931 Oct 23 01:16:52.873113 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 837/1738] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:52 2022] GET /compute/v2.1/servers/664ea2e5-4242-4119-9a39-e32c760345b2 => generated 1324 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:52.877093 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-332baa93-dbc2-4e5a-8245-403ca5a36f3d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:52.877706 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-332baa93-dbc2-4e5a-8245-403ca5a36f3d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:52.884837 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-332baa93-dbc2-4e5a-8245-403ca5a36f3d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:52.885320 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-332baa93-dbc2-4e5a-8245-403ca5a36f3d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:52.885762 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-332baa93-dbc2-4e5a-8245-403ca5a36f3d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:52.886504 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-332baa93-dbc2-4e5a-8245-403ca5a36f3d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:52.886970 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-332baa93-dbc2-4e5a-8245-403ca5a36f3d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:52.887406 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-332baa93-dbc2-4e5a-8245-403ca5a36f3d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:53.091168 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-332baa93-dbc2-4e5a-8245-403ca5a36f3d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:53.099412 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-332baa93-dbc2-4e5a-8245-403ca5a36f3d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1477 microversion: 2.1 time: 0.225947 Oct 23 01:16:53.100000 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 838/1739] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:52 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1477 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:53.104941 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a1d9ecb0-9fa9-43cb-8cd7-b4a832c687fc tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:53.105546 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a1d9ecb0-9fa9-43cb-8cd7-b4a832c687fc tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] [instance: 120895a2-d6c4-47f6-a6e4-32cbcf028037] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:53.121229 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a1d9ecb0-9fa9-43cb-8cd7-b4a832c687fc tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:53.121726 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a1d9ecb0-9fa9-43cb-8cd7-b4a832c687fc tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:53.122196 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a1d9ecb0-9fa9-43cb-8cd7-b4a832c687fc tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:53.122943 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a1d9ecb0-9fa9-43cb-8cd7-b4a832c687fc tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:53.123450 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a1d9ecb0-9fa9-43cb-8cd7-b4a832c687fc tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:53.123901 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a1d9ecb0-9fa9-43cb-8cd7-b4a832c687fc tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:53.206395 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a1d9ecb0-9fa9-43cb-8cd7-b4a832c687fc tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:53.215808 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a1d9ecb0-9fa9-43cb-8cd7-b4a832c687fc tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:53.217278 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a1d9ecb0-9fa9-43cb-8cd7-b4a832c687fc tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:53.218499 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a1d9ecb0-9fa9-43cb-8cd7-b4a832c687fc tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] 10.222.0.42 "GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037" status: 200 len: 1365 microversion: 2.57 time: 0.117326 Oct 23 01:16:53.220184 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 839/1740] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:16:53 2022] GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037 => generated 1365 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:16:53.295439 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5df75f93-91a0-43bb-afe2-7dd9d08736d3 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:53.306469 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5df75f93-91a0-43bb-afe2-7dd9d08736d3 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 6d55bc9b-0956-48c3-956a-e72457f8d95e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:53.306469 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5df75f93-91a0-43bb-afe2-7dd9d08736d3 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:53.306469 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5df75f93-91a0-43bb-afe2-7dd9d08736d3 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:53.306469 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5df75f93-91a0-43bb-afe2-7dd9d08736d3 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:53.306469 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5df75f93-91a0-43bb-afe2-7dd9d08736d3 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:53.306469 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5df75f93-91a0-43bb-afe2-7dd9d08736d3 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:53.306469 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5df75f93-91a0-43bb-afe2-7dd9d08736d3 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:53.539001 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5df75f93-91a0-43bb-afe2-7dd9d08736d3 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:53.548073 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5df75f93-91a0-43bb-afe2-7dd9d08736d3 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/6d55bc9b-0956-48c3-956a-e72457f8d95e" status: 200 len: 1316 microversion: 2.1 time: 0.258467 Oct 23 01:16:53.548865 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 840/1741] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:53 2022] GET /compute/v2.1/servers/6d55bc9b-0956-48c3-956a-e72457f8d95e => generated 1316 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:16:53.591164 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-55b775f7-e489-4e72-aa7d-aed46a30656e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:53.591780 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-55b775f7-e489-4e72-aa7d-aed46a30656e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 7fc07c10-f37b-4374-bcc0-25793b180d9c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:53.598402 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55b775f7-e489-4e72-aa7d-aed46a30656e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:53.599481 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55b775f7-e489-4e72-aa7d-aed46a30656e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:53.599920 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55b775f7-e489-4e72-aa7d-aed46a30656e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:53.601250 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55b775f7-e489-4e72-aa7d-aed46a30656e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:53.601709 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55b775f7-e489-4e72-aa7d-aed46a30656e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:53.602173 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55b775f7-e489-4e72-aa7d-aed46a30656e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:53.849898 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-55b775f7-e489-4e72-aa7d-aed46a30656e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:53.861954 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-55b775f7-e489-4e72-aa7d-aed46a30656e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/7fc07c10-f37b-4374-bcc0-25793b180d9c" status: 200 len: 1307 microversion: 2.1 time: 0.274573 Oct 23 01:16:53.863103 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 841/1742] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:53 2022] GET /compute/v2.1/servers/7fc07c10-f37b-4374-bcc0-25793b180d9c => generated 1307 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:16:53.900073 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-07c16d15-a872-4523-bce3-2f1f45932399 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:53.901801 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-07c16d15-a872-4523-bce3-2f1f45932399 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 664ea2e5-4242-4119-9a39-e32c760345b2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:53.910840 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07c16d15-a872-4523-bce3-2f1f45932399 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:53.932301 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07c16d15-a872-4523-bce3-2f1f45932399 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:53.932301 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07c16d15-a872-4523-bce3-2f1f45932399 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:53.932301 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07c16d15-a872-4523-bce3-2f1f45932399 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:53.932301 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07c16d15-a872-4523-bce3-2f1f45932399 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:53.932301 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07c16d15-a872-4523-bce3-2f1f45932399 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:54.129231 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-07c16d15-a872-4523-bce3-2f1f45932399 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:54.133359 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=100 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:16:54.138105 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-07c16d15-a872-4523-bce3-2f1f45932399 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/664ea2e5-4242-4119-9a39-e32c760345b2" status: 200 len: 1324 microversion: 2.1 time: 0.245484 Oct 23 01:16:54.138685 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 842/1743] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:53 2022] GET /compute/v2.1/servers/664ea2e5-4242-4119-9a39-e32c760345b2 => generated 1324 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:54.143554 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2529ac09-89b0-4f96-a1f7-d6158d557033 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:54.144366 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2529ac09-89b0-4f96-a1f7-d6158d557033 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:54.151323 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2529ac09-89b0-4f96-a1f7-d6158d557033 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:54.151847 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2529ac09-89b0-4f96-a1f7-d6158d557033 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:54.152291 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2529ac09-89b0-4f96-a1f7-d6158d557033 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:54.152989 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2529ac09-89b0-4f96-a1f7-d6158d557033 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:54.153450 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2529ac09-89b0-4f96-a1f7-d6158d557033 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:54.153879 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2529ac09-89b0-4f96-a1f7-d6158d557033 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:54.355716 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2529ac09-89b0-4f96-a1f7-d6158d557033 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:54.374690 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2529ac09-89b0-4f96-a1f7-d6158d557033 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1477 microversion: 2.1 time: 0.232753 Oct 23 01:16:54.376321 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 843/1744] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:54 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1477 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:54.392008 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4bef8626-32f0-44f7-a121-f3c3428113a8 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:54.395308 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4bef8626-32f0-44f7-a121-f3c3428113a8 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] [instance: 120895a2-d6c4-47f6-a6e4-32cbcf028037] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:54.407435 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4bef8626-32f0-44f7-a121-f3c3428113a8 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:54.408019 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4bef8626-32f0-44f7-a121-f3c3428113a8 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:54.408542 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4bef8626-32f0-44f7-a121-f3c3428113a8 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:54.409298 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4bef8626-32f0-44f7-a121-f3c3428113a8 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:54.409814 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4bef8626-32f0-44f7-a121-f3c3428113a8 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:54.410323 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4bef8626-32f0-44f7-a121-f3c3428113a8 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:54.553147 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4bef8626-32f0-44f7-a121-f3c3428113a8 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:54.556940 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4bef8626-32f0-44f7-a121-f3c3428113a8 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:54.558539 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4bef8626-32f0-44f7-a121-f3c3428113a8 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:54.560068 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4bef8626-32f0-44f7-a121-f3c3428113a8 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] 10.222.0.42 "GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037" status: 200 len: 1365 microversion: 2.57 time: 0.182151 Oct 23 01:16:54.560960 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 844/1745] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:16:54 2022] GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037 => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:16:54.580256 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-972342c6-0602-4929-bc57-429a111f1d20 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:54.580966 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-972342c6-0602-4929-bc57-429a111f1d20 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 6d55bc9b-0956-48c3-956a-e72457f8d95e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:54.590494 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=8 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:16:54.591507 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-972342c6-0602-4929-bc57-429a111f1d20 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:54.592124 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-972342c6-0602-4929-bc57-429a111f1d20 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:54.592637 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-972342c6-0602-4929-bc57-429a111f1d20 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:54.593435 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-972342c6-0602-4929-bc57-429a111f1d20 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:54.594156 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-972342c6-0602-4929-bc57-429a111f1d20 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:54.597465 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-972342c6-0602-4929-bc57-429a111f1d20 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:54.616061 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=37 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:16:55.064381 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8dbbed05-f36f-446e-a39b-f0da11f73406 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] 10.222.0.42 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.761079 Oct 23 01:16:55.064982 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 902/1746] 10.222.0.42 () {60 vars in 1170 bytes} [Sun Oct 23 01:16:52 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2762 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:16:55.071278 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f2a74f79-6a47-4b4f-bf58-0c5a82dabaed tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:55.071895 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f2a74f79-6a47-4b4f-bf58-0c5a82dabaed tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 7fc07c10-f37b-4374-bcc0-25793b180d9c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:55.080599 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f2a74f79-6a47-4b4f-bf58-0c5a82dabaed tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:55.081356 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f2a74f79-6a47-4b4f-bf58-0c5a82dabaed tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:55.082403 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f2a74f79-6a47-4b4f-bf58-0c5a82dabaed tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:55.082501 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f2a74f79-6a47-4b4f-bf58-0c5a82dabaed tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:55.083604 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f2a74f79-6a47-4b4f-bf58-0c5a82dabaed tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:55.084042 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f2a74f79-6a47-4b4f-bf58-0c5a82dabaed tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:55.088626 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-972342c6-0602-4929-bc57-429a111f1d20 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:55.097250 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-972342c6-0602-4929-bc57-429a111f1d20 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/6d55bc9b-0956-48c3-956a-e72457f8d95e" status: 200 len: 1466 microversion: 2.1 time: 0.522163 Oct 23 01:16:55.098130 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 845/1747] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:54 2022] GET /compute/v2.1/servers/6d55bc9b-0956-48c3-956a-e72457f8d95e => generated 1466 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:55.125434 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-538c722a-4c98-497d-be4d-78830d683e94 tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:55.126305 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-538c722a-4c98-497d-be4d-78830d683e94 tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] [instance: 6d55bc9b-0956-48c3-956a-e72457f8d95e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:55.132678 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-538c722a-4c98-497d-be4d-78830d683e94 tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:55.133261 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-538c722a-4c98-497d-be4d-78830d683e94 tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:55.133927 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-538c722a-4c98-497d-be4d-78830d683e94 tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:55.134723 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-538c722a-4c98-497d-be4d-78830d683e94 tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:55.135401 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-538c722a-4c98-497d-be4d-78830d683e94 tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:55.135828 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-538c722a-4c98-497d-be4d-78830d683e94 tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:55.285287 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f2a74f79-6a47-4b4f-bf58-0c5a82dabaed tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:55.293999 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f2a74f79-6a47-4b4f-bf58-0c5a82dabaed tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/7fc07c10-f37b-4374-bcc0-25793b180d9c" status: 200 len: 1307 microversion: 2.1 time: 0.227877 Oct 23 01:16:55.305033 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 903/1748] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:55 2022] GET /compute/v2.1/servers/7fc07c10-f37b-4374-bcc0-25793b180d9c => generated 1307 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:55.310955 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6a5d3053-542d-4201-9d34-40b547f746e2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:55.311571 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6a5d3053-542d-4201-9d34-40b547f746e2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 664ea2e5-4242-4119-9a39-e32c760345b2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:55.317701 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6a5d3053-542d-4201-9d34-40b547f746e2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:55.318211 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6a5d3053-542d-4201-9d34-40b547f746e2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:55.318857 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6a5d3053-542d-4201-9d34-40b547f746e2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:55.319554 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6a5d3053-542d-4201-9d34-40b547f746e2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:55.320472 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6a5d3053-542d-4201-9d34-40b547f746e2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:55.323532 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-538c722a-4c98-497d-be4d-78830d683e94 tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/6d55bc9b-0956-48c3-956a-e72457f8d95e" status: 200 len: 1617 microversion: 2.1 time: 0.202073 Oct 23 01:16:55.329075 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 846/1749] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:55 2022] GET /compute/v2.1/servers/6d55bc9b-0956-48c3-956a-e72457f8d95e => generated 1617 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:16:55.329206 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6a5d3053-542d-4201-9d34-40b547f746e2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:55.329388 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a8ab5550-4a92-4b31-beea-bfabc6acc574 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-2106883987", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "1fd1125a-5e06-4668-a85b-393b7a6d4c8a"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:16:55.363974 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=17 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:16:55.393962 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-a8ab5550-4a92-4b31-beea-bfabc6acc574 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] validate_networks() for [('1fd1125a-5e06-4668-a85b-393b7a6d4c8a', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:16:55.562676 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6a5d3053-542d-4201-9d34-40b547f746e2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:55.571841 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6a5d3053-542d-4201-9d34-40b547f746e2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/664ea2e5-4242-4119-9a39-e32c760345b2" status: 200 len: 1324 microversion: 2.1 time: 0.264844 Oct 23 01:16:55.583682 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 904/1750] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:55 2022] GET /compute/v2.1/servers/664ea2e5-4242-4119-9a39-e32c760345b2 => generated 1324 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:55.583682 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cde12db5-0ac4-4e1b-bf4f-91360b8cdc1f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1537404669", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "cffc5366-8131-4a2b-bf51-39e4d23929e3"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:16:55.600361 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:16:55.655943 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-cde12db5-0ac4-4e1b-bf4f-91360b8cdc1f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] validate_networks() for None {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:16:56.176006 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-cde12db5-0ac4-4e1b-bf4f-91360b8cdc1f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:16:56.176776 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-cde12db5-0ac4-4e1b-bf4f-91360b8cdc1f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:16:56.177786 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-cde12db5-0ac4-4e1b-bf4f-91360b8cdc1f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:16:56.178296 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-cde12db5-0ac4-4e1b-bf4f-91360b8cdc1f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:16:56.178798 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-cde12db5-0ac4-4e1b-bf4f-91360b8cdc1f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:16:56.191222 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cde12db5-0ac4-4e1b-bf4f-91360b8cdc1f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:56.191222 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cde12db5-0ac4-4e1b-bf4f-91360b8cdc1f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:56.197467 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cde12db5-0ac4-4e1b-bf4f-91360b8cdc1f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:56.198682 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cde12db5-0ac4-4e1b-bf4f-91360b8cdc1f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:56.199483 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cde12db5-0ac4-4e1b-bf4f-91360b8cdc1f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:56.200387 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cde12db5-0ac4-4e1b-bf4f-91360b8cdc1f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:56.218862 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-cde12db5-0ac4-4e1b-bf4f-91360b8cdc1f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Getting quotas for project 47aadec780734d03a262d4021f48d625. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:16:56.224978 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-cde12db5-0ac4-4e1b-bf4f-91360b8cdc1f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Getting quotas for user 519c893a1e094200b882cf23db7cae54 and project 47aadec780734d03a262d4021f48d625. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:16:56.242637 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cde12db5-0ac4-4e1b-bf4f-91360b8cdc1f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:16:56.245413 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cde12db5-0ac4-4e1b-bf4f-91360b8cdc1f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 0d9df9b8-b177-4adc-bf48-941d99ddf249] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:16:56.255576 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-a8ab5550-4a92-4b31-beea-bfabc6acc574 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:16:56.256080 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-a8ab5550-4a92-4b31-beea-bfabc6acc574 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:16:56.256461 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-a8ab5550-4a92-4b31-beea-bfabc6acc574 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:16:56.256871 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-a8ab5550-4a92-4b31-beea-bfabc6acc574 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:16:56.257290 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-a8ab5550-4a92-4b31-beea-bfabc6acc574 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:16:56.270951 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a8ab5550-4a92-4b31-beea-bfabc6acc574 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:56.271438 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a8ab5550-4a92-4b31-beea-bfabc6acc574 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:56.271878 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a8ab5550-4a92-4b31-beea-bfabc6acc574 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:56.272613 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a8ab5550-4a92-4b31-beea-bfabc6acc574 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:56.273070 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a8ab5550-4a92-4b31-beea-bfabc6acc574 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:56.273496 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a8ab5550-4a92-4b31-beea-bfabc6acc574 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:56.304456 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-a8ab5550-4a92-4b31-beea-bfabc6acc574 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Getting quotas for project 386d20bba06b48be9a7e51162dc4d814. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:16:56.312257 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-a8ab5550-4a92-4b31-beea-bfabc6acc574 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Getting quotas for user c9681db3595440a88dacc40393e2e1dc and project 386d20bba06b48be9a7e51162dc4d814. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:16:56.327992 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a8ab5550-4a92-4b31-beea-bfabc6acc574 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:16:56.331380 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a8ab5550-4a92-4b31-beea-bfabc6acc574 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: bdd228c7-614f-4742-932f-5cb7faf5a68c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:16:56.380627 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cde12db5-0ac4-4e1b-bf4f-91360b8cdc1f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.805877 Oct 23 01:16:56.382851 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 905/1751] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:16:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 810 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:16:56.393504 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-83327325-6132-486c-a8ff-0ee59665d6af tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:56.396125 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-83327325-6132-486c-a8ff-0ee59665d6af tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:56.404693 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83327325-6132-486c-a8ff-0ee59665d6af tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:56.405445 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83327325-6132-486c-a8ff-0ee59665d6af tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:56.406067 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83327325-6132-486c-a8ff-0ee59665d6af tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:56.407455 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83327325-6132-486c-a8ff-0ee59665d6af tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:56.408082 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83327325-6132-486c-a8ff-0ee59665d6af tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:56.408688 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83327325-6132-486c-a8ff-0ee59665d6af tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:56.527223 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a8ab5550-4a92-4b31-beea-bfabc6acc574 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.200686 Oct 23 01:16:56.530122 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 847/1752] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:16:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1205 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:16:56.539064 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b543425b-a2b5-4f47-9025-56f1220bfee6 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:56.541172 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b543425b-a2b5-4f47-9025-56f1220bfee6 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] [instance: 120895a2-d6c4-47f6-a6e4-32cbcf028037] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:56.580994 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b543425b-a2b5-4f47-9025-56f1220bfee6 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:56.585108 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b543425b-a2b5-4f47-9025-56f1220bfee6 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:56.604689 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b543425b-a2b5-4f47-9025-56f1220bfee6 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:56.604689 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b543425b-a2b5-4f47-9025-56f1220bfee6 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:56.604689 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b543425b-a2b5-4f47-9025-56f1220bfee6 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:56.604689 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b543425b-a2b5-4f47-9025-56f1220bfee6 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:56.748758 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-83327325-6132-486c-a8ff-0ee59665d6af tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:56.759205 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-83327325-6132-486c-a8ff-0ee59665d6af tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1476 microversion: 2.1 time: 0.372350 Oct 23 01:16:56.775401 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 906/1753] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:56 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1476 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:56.779030 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b543425b-a2b5-4f47-9025-56f1220bfee6 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:56.782240 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7bfbc3fe-79da-4fa5-9834-a08957c88333 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-658517285", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "3be3e39f-fbeb-4ed9-a69b-dfb7241289c0"}], "block_device_mapping_v2": [{"uuid": "fe661fa1-fcaa-46f2-94c0-ba1edbddfeec", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:16:56.807715 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b543425b-a2b5-4f47-9025-56f1220bfee6 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:56.808665 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b543425b-a2b5-4f47-9025-56f1220bfee6 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:56.814215 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b543425b-a2b5-4f47-9025-56f1220bfee6 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] 10.222.0.42 "GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037" status: 200 len: 1365 microversion: 2.57 time: 0.281368 Oct 23 01:16:56.816160 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 848/1754] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:16:56 2022] GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037 => generated 1365 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:16:56.829601 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-6c534422-c00a-4b82-9f45-7da07fa1a30a req-a368103c-b5ae-4363-9818-ce01404ce472 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff95f7f4-2b30-4083-8643-3f9b1d203d02", "name": "network-vif-unplugged", "status": "completed", "tag": "c2891809-9683-41d8-8d60-11982de58178"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:16:56.849193 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-6c534422-c00a-4b82-9f45-7da07fa1a30a req-a368103c-b5ae-4363-9818-ce01404ce472 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:56.853694 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-6c534422-c00a-4b82-9f45-7da07fa1a30a req-a368103c-b5ae-4363-9818-ce01404ce472 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:56.853694 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-6c534422-c00a-4b82-9f45-7da07fa1a30a req-a368103c-b5ae-4363-9818-ce01404ce472 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:56.867246 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-6c534422-c00a-4b82-9f45-7da07fa1a30a req-a368103c-b5ae-4363-9818-ce01404ce472 service nova] Creating event network-vif-unplugged:c2891809-9683-41d8-8d60-11982de58178 for instance ff95f7f4-2b30-4083-8643-3f9b1d203d02 on n-h1-master-1 Oct 23 01:16:56.874412 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [req-6c534422-c00a-4b82-9f45-7da07fa1a30a req-a368103c-b5ae-4363-9818-ce01404ce472 service nova] Instance ff95f7f4-2b30-4083-8643-3f9b1d203d02 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120944) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 23 01:16:56.894408 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-6c534422-c00a-4b82-9f45-7da07fa1a30a req-a368103c-b5ae-4363-9818-ce01404ce472 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074383 Oct 23 01:16:56.894408 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 849/1755] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:16:56.898659 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e985675c-e159-4838-9666-1ce2f27fba6d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:56.899508 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e985675c-e159-4838-9666-1ce2f27fba6d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 7fc07c10-f37b-4374-bcc0-25793b180d9c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:56.901851 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-7bfbc3fe-79da-4fa5-9834-a08957c88333 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] validate_networks() for [('3be3e39f-fbeb-4ed9-a69b-dfb7241289c0', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:16:56.906545 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e985675c-e159-4838-9666-1ce2f27fba6d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:56.907116 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e985675c-e159-4838-9666-1ce2f27fba6d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:56.907635 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e985675c-e159-4838-9666-1ce2f27fba6d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:56.908419 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e985675c-e159-4838-9666-1ce2f27fba6d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:56.908986 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e985675c-e159-4838-9666-1ce2f27fba6d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:56.909501 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e985675c-e159-4838-9666-1ce2f27fba6d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:57.133696 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e985675c-e159-4838-9666-1ce2f27fba6d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:57.145072 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e985675c-e159-4838-9666-1ce2f27fba6d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/7fc07c10-f37b-4374-bcc0-25793b180d9c" status: 200 len: 1307 microversion: 2.1 time: 0.251284 Oct 23 01:16:57.147129 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 850/1756] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:56 2022] GET /compute/v2.1/servers/7fc07c10-f37b-4374-bcc0-25793b180d9c => generated 1307 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:57.155876 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-31a772b3-2e0e-45ef-82a8-7dfd8a5ece2e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:57.156716 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-31a772b3-2e0e-45ef-82a8-7dfd8a5ece2e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 0d9df9b8-b177-4adc-bf48-941d99ddf249] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:57.249715 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-31a772b3-2e0e-45ef-82a8-7dfd8a5ece2e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:57.258432 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-31a772b3-2e0e-45ef-82a8-7dfd8a5ece2e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/0d9df9b8-b177-4adc-bf48-941d99ddf249" status: 200 len: 1217 microversion: 2.1 time: 0.110094 Oct 23 01:16:57.259859 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 851/1757] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:57 2022] GET /compute/v2.1/servers/0d9df9b8-b177-4adc-bf48-941d99ddf249 => generated 1217 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:57.264580 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3bce8835-2bab-44f4-a757-e38ba296540e tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:57.265409 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3bce8835-2bab-44f4-a757-e38ba296540e tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: bdd228c7-614f-4742-932f-5cb7faf5a68c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:57.341454 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3bce8835-2bab-44f4-a757-e38ba296540e tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9681db3595440a88dacc40393e2e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386d20bba06b48be9a7e51162dc4d814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:57.352133 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3bce8835-2bab-44f4-a757-e38ba296540e tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] 10.222.0.42 "GET /compute/v2.1/servers/bdd228c7-614f-4742-932f-5cb7faf5a68c" status: 200 len: 1224 microversion: 2.1 time: 0.091052 Oct 23 01:16:57.353410 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 852/1758] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:57 2022] GET /compute/v2.1/servers/bdd228c7-614f-4742-932f-5cb7faf5a68c => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:57.359421 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ce9e22da-0a25-40c3-85da-557c67109b9b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:57.360248 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ce9e22da-0a25-40c3-85da-557c67109b9b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 664ea2e5-4242-4119-9a39-e32c760345b2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:57.367525 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:16:57.369532 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce9e22da-0a25-40c3-85da-557c67109b9b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:57.370287 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce9e22da-0a25-40c3-85da-557c67109b9b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:57.370768 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce9e22da-0a25-40c3-85da-557c67109b9b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:57.371603 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce9e22da-0a25-40c3-85da-557c67109b9b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:57.372109 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce9e22da-0a25-40c3-85da-557c67109b9b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:57.372600 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce9e22da-0a25-40c3-85da-557c67109b9b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:57.519769 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-7bfbc3fe-79da-4fa5-9834-a08957c88333 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:16:57.520249 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-7bfbc3fe-79da-4fa5-9834-a08957c88333 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:16:57.520761 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-7bfbc3fe-79da-4fa5-9834-a08957c88333 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:16:57.521170 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-7bfbc3fe-79da-4fa5-9834-a08957c88333 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:16:57.521586 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-7bfbc3fe-79da-4fa5-9834-a08957c88333 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:16:57.530488 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7bfbc3fe-79da-4fa5-9834-a08957c88333 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:57.530975 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7bfbc3fe-79da-4fa5-9834-a08957c88333 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:57.531823 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7bfbc3fe-79da-4fa5-9834-a08957c88333 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:57.532567 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7bfbc3fe-79da-4fa5-9834-a08957c88333 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:57.533309 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7bfbc3fe-79da-4fa5-9834-a08957c88333 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:57.533739 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7bfbc3fe-79da-4fa5-9834-a08957c88333 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:57.550263 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ce9e22da-0a25-40c3-85da-557c67109b9b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:57.555641 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-7bfbc3fe-79da-4fa5-9834-a08957c88333 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Getting quotas for project d46a7166e4144f55a102ea6335c5f820. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:16:57.558831 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ce9e22da-0a25-40c3-85da-557c67109b9b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/664ea2e5-4242-4119-9a39-e32c760345b2" status: 200 len: 1324 microversion: 2.1 time: 0.204184 Oct 23 01:16:57.559417 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 853/1759] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:57 2022] GET /compute/v2.1/servers/664ea2e5-4242-4119-9a39-e32c760345b2 => generated 1324 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:57.561142 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-7bfbc3fe-79da-4fa5-9834-a08957c88333 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Getting quotas for user 1c2310cbc3574eb29a6ca6291ba7808e and project d46a7166e4144f55a102ea6335c5f820. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:16:57.564043 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-ca0ed78b-5d64-4159-b85e-6544b68a332e req-aa53d8ea-2403-438f-8a23-d9a4350dbe30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "664ea2e5-4242-4119-9a39-e32c760345b2", "name": "network-vif-plugged", "status": "completed", "tag": "6b8ad487-ddba-4834-a4d5-10c797dc53f2"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:16:57.576471 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-ca0ed78b-5d64-4159-b85e-6544b68a332e req-aa53d8ea-2403-438f-8a23-d9a4350dbe30 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:57.584791 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-ca0ed78b-5d64-4159-b85e-6544b68a332e req-aa53d8ea-2403-438f-8a23-d9a4350dbe30 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:57.584791 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-ca0ed78b-5d64-4159-b85e-6544b68a332e req-aa53d8ea-2403-438f-8a23-d9a4350dbe30 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:57.590754 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-ca0ed78b-5d64-4159-b85e-6544b68a332e req-aa53d8ea-2403-438f-8a23-d9a4350dbe30 service nova] Creating event network-vif-plugged:6b8ad487-ddba-4834-a4d5-10c797dc53f2 for instance 664ea2e5-4242-4119-9a39-e32c760345b2 on n-h2-master-1 Oct 23 01:16:57.595706 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-ca0ed78b-5d64-4159-b85e-6544b68a332e req-aa53d8ea-2403-438f-8a23-d9a4350dbe30 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034919 Oct 23 01:16:57.596474 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 854/1760] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:16:57.625965 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7bfbc3fe-79da-4fa5-9834-a08957c88333 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:16:57.630838 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7bfbc3fe-79da-4fa5-9834-a08957c88333 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fe661fa1-fcaa-46f2-94c0-ba1edbddfeec',volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:16:57.751879 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-baeeb09b-f828-4039-a518-3e1183447400 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:57.752783 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-baeeb09b-f828-4039-a518-3e1183447400 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:57.765480 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-baeeb09b-f828-4039-a518-3e1183447400 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:57.766088 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-baeeb09b-f828-4039-a518-3e1183447400 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:57.766617 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-baeeb09b-f828-4039-a518-3e1183447400 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:57.767390 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-baeeb09b-f828-4039-a518-3e1183447400 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:57.767912 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-baeeb09b-f828-4039-a518-3e1183447400 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:57.768404 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-baeeb09b-f828-4039-a518-3e1183447400 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:57.931986 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-baeeb09b-f828-4039-a518-3e1183447400 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lazy-loading 'services' on Instance uuid be9a2687-233d-43c3-95b3-3a8b455595c7 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:16:57.945805 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-baeeb09b-f828-4039-a518-3e1183447400 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7" status: 200 len: 2424 microversion: 2.25 time: 0.199240 Oct 23 01:16:57.946464 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 855/1761] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:16:57 2022] GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7 => generated 2424 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:16:58.053431 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7bfbc3fe-79da-4fa5-9834-a08957c88333 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.276868 Oct 23 01:16:58.054100 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 907/1762] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:16:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1278 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:16:58.060067 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5dbece5f-1af0-409f-97e3-ed795da6a8b9 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:58.065346 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5dbece5f-1af0-409f-97e3-ed795da6a8b9 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] [instance: 120895a2-d6c4-47f6-a6e4-32cbcf028037] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:58.067070 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5dbece5f-1af0-409f-97e3-ed795da6a8b9 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:58.067313 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3cb426d6-097f-487e-8ba0-b32e47ae7663 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:58.068152 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5dbece5f-1af0-409f-97e3-ed795da6a8b9 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:58.068591 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5dbece5f-1af0-409f-97e3-ed795da6a8b9 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:58.068738 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3cb426d6-097f-487e-8ba0-b32e47ae7663 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:58.069342 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5dbece5f-1af0-409f-97e3-ed795da6a8b9 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:58.069788 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5dbece5f-1af0-409f-97e3-ed795da6a8b9 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:58.070302 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5dbece5f-1af0-409f-97e3-ed795da6a8b9 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:58.075222 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3cb426d6-097f-487e-8ba0-b32e47ae7663 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:58.075719 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3cb426d6-097f-487e-8ba0-b32e47ae7663 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:58.076214 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3cb426d6-097f-487e-8ba0-b32e47ae7663 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:58.076920 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3cb426d6-097f-487e-8ba0-b32e47ae7663 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:58.078325 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3cb426d6-097f-487e-8ba0-b32e47ae7663 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:58.079243 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3cb426d6-097f-487e-8ba0-b32e47ae7663 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:58.163339 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5dbece5f-1af0-409f-97e3-ed795da6a8b9 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:58.177990 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5dbece5f-1af0-409f-97e3-ed795da6a8b9 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:58.179835 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5dbece5f-1af0-409f-97e3-ed795da6a8b9 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:58.181173 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5dbece5f-1af0-409f-97e3-ed795da6a8b9 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] 10.222.0.42 "GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037" status: 200 len: 1365 microversion: 2.57 time: 0.126086 Oct 23 01:16:58.188643 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 908/1763] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:16:58 2022] GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037 => generated 1365 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:16:58.195585 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-27e41267-3aa0-49fb-84d4-2b66d87a2aa5 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": "auto"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:16:58.198435 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-27e41267-3aa0-49fb-84d4-2b66d87a2aa5 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:58.206566 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-27e41267-3aa0-49fb-84d4-2b66d87a2aa5 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:58.207097 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-27e41267-3aa0-49fb-84d4-2b66d87a2aa5 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:58.207479 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-27e41267-3aa0-49fb-84d4-2b66d87a2aa5 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:58.208571 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-27e41267-3aa0-49fb-84d4-2b66d87a2aa5 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:58.209027 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-27e41267-3aa0-49fb-84d4-2b66d87a2aa5 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:58.209446 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-27e41267-3aa0-49fb-84d4-2b66d87a2aa5 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:58.242246 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-27e41267-3aa0-49fb-84d4-2b66d87a2aa5 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lazy-loading 'flavor' on Instance uuid be9a2687-233d-43c3-95b3-3a8b455595c7 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:16:58.259949 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-27e41267-3aa0-49fb-84d4-2b66d87a2aa5 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Going to try to live migrate instance to n-h1-master-1 {{(pid=120945) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 23 01:16:58.260248 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3cb426d6-097f-487e-8ba0-b32e47ae7663 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:58.269866 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3cb426d6-097f-487e-8ba0-b32e47ae7663 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1474 microversion: 2.1 time: 0.321617 Oct 23 01:16:58.270528 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 856/1764] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:57 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1474 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:58.275802 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2aa29b6b-309d-4881-ac41-666699142987 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:58.277002 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2aa29b6b-309d-4881-ac41-666699142987 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:58.335055 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2aa29b6b-309d-4881-ac41-666699142987 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:58.342200 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2aa29b6b-309d-4881-ac41-666699142987 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1052 microversion: 2.1 time: 0.070293 Oct 23 01:16:58.342797 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 857/1765] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:58 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1052 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:58.347546 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f71fffeb-4da4-4bc5-a8d1-80c099855011 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:58.348162 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f71fffeb-4da4-4bc5-a8d1-80c099855011 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 7fc07c10-f37b-4374-bcc0-25793b180d9c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:58.354329 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f71fffeb-4da4-4bc5-a8d1-80c099855011 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:58.354825 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f71fffeb-4da4-4bc5-a8d1-80c099855011 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:58.355281 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f71fffeb-4da4-4bc5-a8d1-80c099855011 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:58.355961 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f71fffeb-4da4-4bc5-a8d1-80c099855011 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:58.356421 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f71fffeb-4da4-4bc5-a8d1-80c099855011 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:58.356853 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f71fffeb-4da4-4bc5-a8d1-80c099855011 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:58.495749 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f71fffeb-4da4-4bc5-a8d1-80c099855011 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:58.503705 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f71fffeb-4da4-4bc5-a8d1-80c099855011 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/7fc07c10-f37b-4374-bcc0-25793b180d9c" status: 200 len: 1307 microversion: 2.1 time: 0.159783 Oct 23 01:16:58.504283 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 858/1766] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:58 2022] GET /compute/v2.1/servers/7fc07c10-f37b-4374-bcc0-25793b180d9c => generated 1307 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:58.509811 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-eb8c09eb-963f-4abd-9404-c8f1f685e4d9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:58.510695 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-eb8c09eb-963f-4abd-9404-c8f1f685e4d9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 0d9df9b8-b177-4adc-bf48-941d99ddf249] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:58.517141 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb8c09eb-963f-4abd-9404-c8f1f685e4d9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:58.517956 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb8c09eb-963f-4abd-9404-c8f1f685e4d9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:58.526082 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb8c09eb-963f-4abd-9404-c8f1f685e4d9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:58.526082 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb8c09eb-963f-4abd-9404-c8f1f685e4d9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:58.526082 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb8c09eb-963f-4abd-9404-c8f1f685e4d9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:58.526082 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb8c09eb-963f-4abd-9404-c8f1f685e4d9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:58.588027 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-eb8c09eb-963f-4abd-9404-c8f1f685e4d9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:58.596333 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-eb8c09eb-963f-4abd-9404-c8f1f685e4d9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/0d9df9b8-b177-4adc-bf48-941d99ddf249" status: 200 len: 1269 microversion: 2.1 time: 0.090797 Oct 23 01:16:58.606263 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 859/1767] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:58 2022] GET /compute/v2.1/servers/0d9df9b8-b177-4adc-bf48-941d99ddf249 => generated 1269 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:58.606263 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e1467335-68cc-4a32-8973-9ee94734ef8f tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:58.606263 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e1467335-68cc-4a32-8973-9ee94734ef8f tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: bdd228c7-614f-4742-932f-5cb7faf5a68c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:58.609274 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e1467335-68cc-4a32-8973-9ee94734ef8f tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:58.609929 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e1467335-68cc-4a32-8973-9ee94734ef8f tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:58.610572 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e1467335-68cc-4a32-8973-9ee94734ef8f tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:58.611440 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e1467335-68cc-4a32-8973-9ee94734ef8f tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:58.612038 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e1467335-68cc-4a32-8973-9ee94734ef8f tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:58.612624 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e1467335-68cc-4a32-8973-9ee94734ef8f tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:58.675793 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e1467335-68cc-4a32-8973-9ee94734ef8f tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9681db3595440a88dacc40393e2e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386d20bba06b48be9a7e51162dc4d814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:58.684188 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e1467335-68cc-4a32-8973-9ee94734ef8f tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] 10.222.0.42 "GET /compute/v2.1/servers/bdd228c7-614f-4742-932f-5cb7faf5a68c" status: 200 len: 1220 microversion: 2.1 time: 0.085890 Oct 23 01:16:58.684832 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 860/1768] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:58 2022] GET /compute/v2.1/servers/bdd228c7-614f-4742-932f-5cb7faf5a68c => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:58.691022 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e5fb0214-77cb-4e99-a626-0524d9327452 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:58.695641 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e5fb0214-77cb-4e99-a626-0524d9327452 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 664ea2e5-4242-4119-9a39-e32c760345b2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:58.697852 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e5fb0214-77cb-4e99-a626-0524d9327452 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:58.698369 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e5fb0214-77cb-4e99-a626-0524d9327452 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:58.698807 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e5fb0214-77cb-4e99-a626-0524d9327452 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:58.699552 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e5fb0214-77cb-4e99-a626-0524d9327452 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:58.700009 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e5fb0214-77cb-4e99-a626-0524d9327452 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:58.700432 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e5fb0214-77cb-4e99-a626-0524d9327452 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:58.842362 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e5fb0214-77cb-4e99-a626-0524d9327452 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:58.854592 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e5fb0214-77cb-4e99-a626-0524d9327452 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/664ea2e5-4242-4119-9a39-e32c760345b2" status: 200 len: 1324 microversion: 2.1 time: 0.168548 Oct 23 01:16:58.855194 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 861/1769] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:58 2022] GET /compute/v2.1/servers/664ea2e5-4242-4119-9a39-e32c760345b2 => generated 1324 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:58.928524 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-36fa43b3-d479-48e7-b7d4-d92f54d94cf7 req-076cc84b-a2d5-4e6a-a9ce-66cd6f22474d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff95f7f4-2b30-4083-8643-3f9b1d203d02", "tag": "c2891809-9683-41d8-8d60-11982de58178"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:16:58.936031 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-36fa43b3-d479-48e7-b7d4-d92f54d94cf7 req-076cc84b-a2d5-4e6a-a9ce-66cd6f22474d service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:58.936593 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-36fa43b3-d479-48e7-b7d4-d92f54d94cf7 req-076cc84b-a2d5-4e6a-a9ce-66cd6f22474d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:58.937101 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-36fa43b3-d479-48e7-b7d4-d92f54d94cf7 req-076cc84b-a2d5-4e6a-a9ce-66cd6f22474d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:58.953000 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-36fa43b3-d479-48e7-b7d4-d92f54d94cf7 req-076cc84b-a2d5-4e6a-a9ce-66cd6f22474d service nova] Creating event network-changed:c2891809-9683-41d8-8d60-11982de58178 for instance ff95f7f4-2b30-4083-8643-3f9b1d203d02 on n-h1-master-1 Oct 23 01:16:58.960128 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [req-36fa43b3-d479-48e7-b7d4-d92f54d94cf7 req-076cc84b-a2d5-4e6a-a9ce-66cd6f22474d service nova] Instance ff95f7f4-2b30-4083-8643-3f9b1d203d02 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120944) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 23 01:16:58.971823 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-36fa43b3-d479-48e7-b7d4-d92f54d94cf7 req-076cc84b-a2d5-4e6a-a9ce-66cd6f22474d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050725 Oct 23 01:16:58.972766 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 862/1770] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:16:59.209423 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5aae4150-708c-4ba1-8a5e-fec38bca2f47 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:59.210255 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5aae4150-708c-4ba1-8a5e-fec38bca2f47 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] [instance: 120895a2-d6c4-47f6-a6e4-32cbcf028037] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:59.216445 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5aae4150-708c-4ba1-8a5e-fec38bca2f47 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:59.216934 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5aae4150-708c-4ba1-8a5e-fec38bca2f47 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:59.217371 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5aae4150-708c-4ba1-8a5e-fec38bca2f47 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:59.218097 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5aae4150-708c-4ba1-8a5e-fec38bca2f47 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:59.218555 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5aae4150-708c-4ba1-8a5e-fec38bca2f47 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:59.218978 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5aae4150-708c-4ba1-8a5e-fec38bca2f47 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:59.286228 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5aae4150-708c-4ba1-8a5e-fec38bca2f47 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:59.294567 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5aae4150-708c-4ba1-8a5e-fec38bca2f47 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:59.296017 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5aae4150-708c-4ba1-8a5e-fec38bca2f47 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:59.297221 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5aae4150-708c-4ba1-8a5e-fec38bca2f47 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] 10.222.0.42 "GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037" status: 200 len: 1365 microversion: 2.57 time: 0.093653 Oct 23 01:16:59.297767 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 863/1771] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:16:59 2022] GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037 => generated 1365 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:16:59.303167 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dd3df2dd-9261-45dd-a5bc-f7ee4a115859 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:59.303782 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-dd3df2dd-9261-45dd-a5bc-f7ee4a115859 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:59.309673 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd3df2dd-9261-45dd-a5bc-f7ee4a115859 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:59.310201 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd3df2dd-9261-45dd-a5bc-f7ee4a115859 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:59.310780 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd3df2dd-9261-45dd-a5bc-f7ee4a115859 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:59.311475 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd3df2dd-9261-45dd-a5bc-f7ee4a115859 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:59.311925 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd3df2dd-9261-45dd-a5bc-f7ee4a115859 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:59.312341 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd3df2dd-9261-45dd-a5bc-f7ee4a115859 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:59.316907 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=100 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:16:59.457842 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-dd3df2dd-9261-45dd-a5bc-f7ee4a115859 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:59.473280 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-dd3df2dd-9261-45dd-a5bc-f7ee4a115859 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1474 microversion: 2.1 time: 0.174313 Oct 23 01:16:59.474302 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 864/1772] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:59 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1474 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:59.480278 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7caf4a84-02d1-478b-80d6-b5fb3264f909 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:59.480588 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7caf4a84-02d1-478b-80d6-b5fb3264f909 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:59.488174 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7caf4a84-02d1-478b-80d6-b5fb3264f909 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:59.489074 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7caf4a84-02d1-478b-80d6-b5fb3264f909 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:59.489756 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7caf4a84-02d1-478b-80d6-b5fb3264f909 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:59.491133 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7caf4a84-02d1-478b-80d6-b5fb3264f909 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:59.491879 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7caf4a84-02d1-478b-80d6-b5fb3264f909 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:59.492529 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7caf4a84-02d1-478b-80d6-b5fb3264f909 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:59.559401 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7caf4a84-02d1-478b-80d6-b5fb3264f909 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:59.569580 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7caf4a84-02d1-478b-80d6-b5fb3264f909 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1102 microversion: 2.1 time: 0.094098 Oct 23 01:16:59.570447 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 865/1773] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:59 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1102 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:59.576905 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9683ca96-ab15-4929-b301-cda0c3cd6ae7 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:59.577476 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9683ca96-ab15-4929-b301-cda0c3cd6ae7 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 7fc07c10-f37b-4374-bcc0-25793b180d9c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:59.584225 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9683ca96-ab15-4929-b301-cda0c3cd6ae7 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:59.584718 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9683ca96-ab15-4929-b301-cda0c3cd6ae7 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:59.585196 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9683ca96-ab15-4929-b301-cda0c3cd6ae7 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:59.585897 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9683ca96-ab15-4929-b301-cda0c3cd6ae7 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:59.586589 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9683ca96-ab15-4929-b301-cda0c3cd6ae7 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:59.587006 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9683ca96-ab15-4929-b301-cda0c3cd6ae7 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:59.723187 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9683ca96-ab15-4929-b301-cda0c3cd6ae7 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:59.731051 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9683ca96-ab15-4929-b301-cda0c3cd6ae7 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/7fc07c10-f37b-4374-bcc0-25793b180d9c" status: 200 len: 1307 microversion: 2.1 time: 0.159331 Oct 23 01:16:59.731628 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 866/1774] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:59 2022] GET /compute/v2.1/servers/7fc07c10-f37b-4374-bcc0-25793b180d9c => generated 1307 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:59.736109 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d6c07e7e-310f-45e3-8866-98d13a6e9694 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:59.736728 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d6c07e7e-310f-45e3-8866-98d13a6e9694 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 0d9df9b8-b177-4adc-bf48-941d99ddf249] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:59.743362 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d6c07e7e-310f-45e3-8866-98d13a6e9694 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:59.743854 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d6c07e7e-310f-45e3-8866-98d13a6e9694 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:59.744335 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d6c07e7e-310f-45e3-8866-98d13a6e9694 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:59.744999 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d6c07e7e-310f-45e3-8866-98d13a6e9694 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:59.745471 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d6c07e7e-310f-45e3-8866-98d13a6e9694 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:59.746083 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d6c07e7e-310f-45e3-8866-98d13a6e9694 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:59.808099 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d6c07e7e-310f-45e3-8866-98d13a6e9694 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:59.815747 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d6c07e7e-310f-45e3-8866-98d13a6e9694 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/0d9df9b8-b177-4adc-bf48-941d99ddf249" status: 200 len: 1269 microversion: 2.1 time: 0.083147 Oct 23 01:16:59.816526 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 867/1775] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:59 2022] GET /compute/v2.1/servers/0d9df9b8-b177-4adc-bf48-941d99ddf249 => generated 1269 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:59.821814 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a90d7767-367b-4c87-8410-18e62059b64b tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:59.822486 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a90d7767-367b-4c87-8410-18e62059b64b tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: bdd228c7-614f-4742-932f-5cb7faf5a68c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:59.829444 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a90d7767-367b-4c87-8410-18e62059b64b tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:59.829943 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a90d7767-367b-4c87-8410-18e62059b64b tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:59.830401 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a90d7767-367b-4c87-8410-18e62059b64b tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:59.831109 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a90d7767-367b-4c87-8410-18e62059b64b tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:59.831565 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a90d7767-367b-4c87-8410-18e62059b64b tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:59.831990 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a90d7767-367b-4c87-8410-18e62059b64b tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:59.906226 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a90d7767-367b-4c87-8410-18e62059b64b tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9681db3595440a88dacc40393e2e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386d20bba06b48be9a7e51162dc4d814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:16:59.915088 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a90d7767-367b-4c87-8410-18e62059b64b tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] 10.222.0.42 "GET /compute/v2.1/servers/bdd228c7-614f-4742-932f-5cb7faf5a68c" status: 200 len: 1220 microversion: 2.1 time: 0.097752 Oct 23 01:16:59.915674 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 868/1776] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:59 2022] GET /compute/v2.1/servers/bdd228c7-614f-4742-932f-5cb7faf5a68c => generated 1220 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:16:59.920714 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-310a8930-e6ca-4f8a-8b9a-6602305d4b8f tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:16:59.921513 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-310a8930-e6ca-4f8a-8b9a-6602305d4b8f tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 664ea2e5-4242-4119-9a39-e32c760345b2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:16:59.928097 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-310a8930-e6ca-4f8a-8b9a-6602305d4b8f tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:59.929465 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-310a8930-e6ca-4f8a-8b9a-6602305d4b8f tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:59.929465 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-310a8930-e6ca-4f8a-8b9a-6602305d4b8f tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:16:59.929860 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-310a8930-e6ca-4f8a-8b9a-6602305d4b8f tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:16:59.930348 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-310a8930-e6ca-4f8a-8b9a-6602305d4b8f tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:16:59.930771 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-310a8930-e6ca-4f8a-8b9a-6602305d4b8f tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:00.111870 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-310a8930-e6ca-4f8a-8b9a-6602305d4b8f tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:00.122885 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-310a8930-e6ca-4f8a-8b9a-6602305d4b8f tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/664ea2e5-4242-4119-9a39-e32c760345b2" status: 200 len: 1521 microversion: 2.1 time: 0.206182 Oct 23 01:17:00.137999 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 869/1777] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:16:59 2022] GET /compute/v2.1/servers/664ea2e5-4242-4119-9a39-e32c760345b2 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:00.142242 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-75fd7aee-35fb-45c1-b016-dcaafa59aff5 req-d215ee42-674f-4c19-ae99-a15b5e38dd62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fc07c10-f37b-4374-bcc0-25793b180d9c", "name": "network-vif-plugged", "status": "completed", "tag": "bedfc922-9657-4f3f-8344-e550f8d72082"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:17:00.153133 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-75fd7aee-35fb-45c1-b016-dcaafa59aff5 req-d215ee42-674f-4c19-ae99-a15b5e38dd62 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:00.153613 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-75fd7aee-35fb-45c1-b016-dcaafa59aff5 req-d215ee42-674f-4c19-ae99-a15b5e38dd62 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:00.156065 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-75fd7aee-35fb-45c1-b016-dcaafa59aff5 req-d215ee42-674f-4c19-ae99-a15b5e38dd62 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:00.166472 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-75fd7aee-35fb-45c1-b016-dcaafa59aff5 req-d215ee42-674f-4c19-ae99-a15b5e38dd62 service nova] Creating event network-vif-plugged:bedfc922-9657-4f3f-8344-e550f8d72082 for instance 7fc07c10-f37b-4374-bcc0-25793b180d9c on n-h1-master-1 Oct 23 01:17:00.172516 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-75fd7aee-35fb-45c1-b016-dcaafa59aff5 req-d215ee42-674f-4c19-ae99-a15b5e38dd62 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045761 Oct 23 01:17:00.172714 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 870/1778] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:17:00.179218 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d8b6b7ff-d6a5-4e77-bfa4-0bb044845e75 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:00.179803 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d8b6b7ff-d6a5-4e77-bfa4-0bb044845e75 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 664ea2e5-4242-4119-9a39-e32c760345b2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:00.186330 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d8b6b7ff-d6a5-4e77-bfa4-0bb044845e75 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:00.186820 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d8b6b7ff-d6a5-4e77-bfa4-0bb044845e75 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:00.187310 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d8b6b7ff-d6a5-4e77-bfa4-0bb044845e75 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:00.188005 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d8b6b7ff-d6a5-4e77-bfa4-0bb044845e75 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:00.188460 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d8b6b7ff-d6a5-4e77-bfa4-0bb044845e75 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:00.188984 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d8b6b7ff-d6a5-4e77-bfa4-0bb044845e75 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:00.224634 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d8b6b7ff-d6a5-4e77-bfa4-0bb044845e75 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 664ea2e5-4242-4119-9a39-e32c760345b2] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:17:00.552835 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d8b6b7ff-d6a5-4e77-bfa4-0bb044845e75 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "DELETE /compute/v2.1/servers/664ea2e5-4242-4119-9a39-e32c760345b2" status: 204 len: 0 microversion: 2.1 time: 0.378322 Oct 23 01:17:00.557131 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 871/1779] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:17:00 2022] DELETE /compute/v2.1/servers/664ea2e5-4242-4119-9a39-e32c760345b2 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:17:00.560796 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a05fce52-f64f-4c4c-ab99-25abe1de7444 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:00.561562 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a05fce52-f64f-4c4c-ab99-25abe1de7444 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] [instance: 120895a2-d6c4-47f6-a6e4-32cbcf028037] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:00.568932 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a05fce52-f64f-4c4c-ab99-25abe1de7444 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:00.569432 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a05fce52-f64f-4c4c-ab99-25abe1de7444 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:00.569874 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a05fce52-f64f-4c4c-ab99-25abe1de7444 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:00.570646 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a05fce52-f64f-4c4c-ab99-25abe1de7444 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:00.571109 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a05fce52-f64f-4c4c-ab99-25abe1de7444 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:00.571620 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a05fce52-f64f-4c4c-ab99-25abe1de7444 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:00.639944 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a05fce52-f64f-4c4c-ab99-25abe1de7444 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:00.649228 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a05fce52-f64f-4c4c-ab99-25abe1de7444 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:00.650723 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a05fce52-f64f-4c4c-ab99-25abe1de7444 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:00.651899 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a05fce52-f64f-4c4c-ab99-25abe1de7444 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] 10.222.0.42 "GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037" status: 200 len: 1365 microversion: 2.57 time: 0.096655 Oct 23 01:17:00.652465 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 872/1780] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:17:00 2022] GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037 => generated 1365 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:17:00.657057 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5400b0a6-c1b5-4f7f-801b-04bd7d46e3f0 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:00.657878 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5400b0a6-c1b5-4f7f-801b-04bd7d46e3f0 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:00.663758 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5400b0a6-c1b5-4f7f-801b-04bd7d46e3f0 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:00.664427 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5400b0a6-c1b5-4f7f-801b-04bd7d46e3f0 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:00.664871 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5400b0a6-c1b5-4f7f-801b-04bd7d46e3f0 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:00.665570 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5400b0a6-c1b5-4f7f-801b-04bd7d46e3f0 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:00.666046 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5400b0a6-c1b5-4f7f-801b-04bd7d46e3f0 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:00.666473 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5400b0a6-c1b5-4f7f-801b-04bd7d46e3f0 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:00.813410 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5400b0a6-c1b5-4f7f-801b-04bd7d46e3f0 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:00.825668 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5400b0a6-c1b5-4f7f-801b-04bd7d46e3f0 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1471 microversion: 2.1 time: 0.172100 Oct 23 01:17:00.842134 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 873/1781] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:00 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1471 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:00.842134 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8c4de6da-8522-40fc-b102-2a14cd8af357 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:00.842134 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8c4de6da-8522-40fc-b102-2a14cd8af357 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 664ea2e5-4242-4119-9a39-e32c760345b2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:00.842134 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c4de6da-8522-40fc-b102-2a14cd8af357 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:00.842134 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c4de6da-8522-40fc-b102-2a14cd8af357 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:00.842134 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c4de6da-8522-40fc-b102-2a14cd8af357 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:00.842134 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c4de6da-8522-40fc-b102-2a14cd8af357 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:00.842134 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c4de6da-8522-40fc-b102-2a14cd8af357 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:00.843430 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c4de6da-8522-40fc-b102-2a14cd8af357 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:01.072888 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8c4de6da-8522-40fc-b102-2a14cd8af357 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:01.081105 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8c4de6da-8522-40fc-b102-2a14cd8af357 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/664ea2e5-4242-4119-9a39-e32c760345b2" status: 200 len: 1527 microversion: 2.1 time: 0.253813 Oct 23 01:17:01.081968 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 874/1782] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:00 2022] GET /compute/v2.1/servers/664ea2e5-4242-4119-9a39-e32c760345b2 => generated 1527 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:01.087474 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-aefc80e8-6eae-4fab-8d5a-419138635ad8 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:01.088609 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-aefc80e8-6eae-4fab-8d5a-419138635ad8 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:01.094854 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aefc80e8-6eae-4fab-8d5a-419138635ad8 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:01.095473 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aefc80e8-6eae-4fab-8d5a-419138635ad8 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:01.096013 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aefc80e8-6eae-4fab-8d5a-419138635ad8 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:01.097490 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aefc80e8-6eae-4fab-8d5a-419138635ad8 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:01.098397 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aefc80e8-6eae-4fab-8d5a-419138635ad8 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:01.098537 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aefc80e8-6eae-4fab-8d5a-419138635ad8 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:01.185942 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-aefc80e8-6eae-4fab-8d5a-419138635ad8 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:01.194928 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-aefc80e8-6eae-4fab-8d5a-419138635ad8 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1094 microversion: 2.1 time: 0.111152 Oct 23 01:17:01.195801 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 875/1783] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:01 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1094 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:01.202061 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-52433662-2414-46fe-ab66-757f7fe2118b tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:01.202820 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-52433662-2414-46fe-ab66-757f7fe2118b tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 7fc07c10-f37b-4374-bcc0-25793b180d9c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:01.209746 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-52433662-2414-46fe-ab66-757f7fe2118b tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:01.210366 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-52433662-2414-46fe-ab66-757f7fe2118b tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:01.211048 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-52433662-2414-46fe-ab66-757f7fe2118b tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:01.212043 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-52433662-2414-46fe-ab66-757f7fe2118b tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:01.212752 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-52433662-2414-46fe-ab66-757f7fe2118b tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:01.213394 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-52433662-2414-46fe-ab66-757f7fe2118b tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:01.428370 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-52433662-2414-46fe-ab66-757f7fe2118b tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:01.438053 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-52433662-2414-46fe-ab66-757f7fe2118b tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/7fc07c10-f37b-4374-bcc0-25793b180d9c" status: 200 len: 1307 microversion: 2.1 time: 0.239862 Oct 23 01:17:01.443352 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 876/1784] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:01 2022] GET /compute/v2.1/servers/7fc07c10-f37b-4374-bcc0-25793b180d9c => generated 1307 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:01.443675 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5c1bc726-b91b-4523-9b78-b6530222a039 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:01.444545 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5c1bc726-b91b-4523-9b78-b6530222a039 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 0d9df9b8-b177-4adc-bf48-941d99ddf249] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:01.451575 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5c1bc726-b91b-4523-9b78-b6530222a039 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:01.452740 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5c1bc726-b91b-4523-9b78-b6530222a039 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:01.453540 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5c1bc726-b91b-4523-9b78-b6530222a039 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:01.455109 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5c1bc726-b91b-4523-9b78-b6530222a039 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:01.456068 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5c1bc726-b91b-4523-9b78-b6530222a039 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:01.456776 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5c1bc726-b91b-4523-9b78-b6530222a039 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:01.613181 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5c1bc726-b91b-4523-9b78-b6530222a039 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:01.622318 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5c1bc726-b91b-4523-9b78-b6530222a039 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/0d9df9b8-b177-4adc-bf48-941d99ddf249" status: 200 len: 1317 microversion: 2.1 time: 0.182474 Oct 23 01:17:01.622957 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 877/1785] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:01 2022] GET /compute/v2.1/servers/0d9df9b8-b177-4adc-bf48-941d99ddf249 => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:01.629248 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5927a9fc-0405-465e-ac83-9b37b9d2e578 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:17:01.629788 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5927a9fc-0405-465e-ac83-9b37b9d2e578 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:01.636129 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5927a9fc-0405-465e-ac83-9b37b9d2e578 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:01.637122 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5927a9fc-0405-465e-ac83-9b37b9d2e578 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:01.637858 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5927a9fc-0405-465e-ac83-9b37b9d2e578 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:01.638763 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5927a9fc-0405-465e-ac83-9b37b9d2e578 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:01.639703 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5927a9fc-0405-465e-ac83-9b37b9d2e578 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:01.640298 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5927a9fc-0405-465e-ac83-9b37b9d2e578 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:01.689922 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-27e41267-3aa0-49fb-84d4-2b66d87a2aa5 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7/action" status: 202 len: 0 microversion: 2.25 time: 3.500080 Oct 23 01:17:01.691311 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 909/1786] 10.222.0.42 () {62 vars in 1319 bytes} [Sun Oct 23 01:16:58 2022] POST /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7/action => generated 0 bytes in 3502 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:17:01.697193 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bf31305a-3be5-4ba4-9a33-f48be57e2e7b tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:01.697995 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-bf31305a-3be5-4ba4-9a33-f48be57e2e7b tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: bdd228c7-614f-4742-932f-5cb7faf5a68c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:01.705834 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bf31305a-3be5-4ba4-9a33-f48be57e2e7b tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:01.707193 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bf31305a-3be5-4ba4-9a33-f48be57e2e7b tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:01.707193 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bf31305a-3be5-4ba4-9a33-f48be57e2e7b tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:01.707841 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bf31305a-3be5-4ba4-9a33-f48be57e2e7b tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:01.708384 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bf31305a-3be5-4ba4-9a33-f48be57e2e7b tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:01.709031 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bf31305a-3be5-4ba4-9a33-f48be57e2e7b tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:01.723274 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:17:01.785190 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bf31305a-3be5-4ba4-9a33-f48be57e2e7b tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9681db3595440a88dacc40393e2e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386d20bba06b48be9a7e51162dc4d814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:01.795621 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bf31305a-3be5-4ba4-9a33-f48be57e2e7b tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] 10.222.0.42 "GET /compute/v2.1/servers/bdd228c7-614f-4742-932f-5cb7faf5a68c" status: 200 len: 1276 microversion: 2.1 time: 0.102492 Oct 23 01:17:01.796206 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 910/1787] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:01 2022] GET /compute/v2.1/servers/bdd228c7-614f-4742-932f-5cb7faf5a68c => generated 1276 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:01.802103 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cc8c9b6f-a909-478e-88f2-32136a33a3f6 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:01.803011 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cc8c9b6f-a909-478e-88f2-32136a33a3f6 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] [instance: 120895a2-d6c4-47f6-a6e4-32cbcf028037] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:01.812847 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cc8c9b6f-a909-478e-88f2-32136a33a3f6 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:01.813700 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cc8c9b6f-a909-478e-88f2-32136a33a3f6 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:01.814412 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cc8c9b6f-a909-478e-88f2-32136a33a3f6 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:01.815952 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cc8c9b6f-a909-478e-88f2-32136a33a3f6 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:01.816634 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cc8c9b6f-a909-478e-88f2-32136a33a3f6 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:01.819394 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cc8c9b6f-a909-478e-88f2-32136a33a3f6 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:01.905169 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cc8c9b6f-a909-478e-88f2-32136a33a3f6 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:01.914646 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cc8c9b6f-a909-478e-88f2-32136a33a3f6 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:01.916492 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cc8c9b6f-a909-478e-88f2-32136a33a3f6 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:01.917999 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cc8c9b6f-a909-478e-88f2-32136a33a3f6 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] 10.222.0.42 "GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037" status: 200 len: 1365 microversion: 2.57 time: 0.120460 Oct 23 01:17:01.922329 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 911/1788] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:17:01 2022] GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037 => generated 1365 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:17:01.932228 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-13449bfe-d939-4edc-a5dc-60b9ac6cbca5 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:01.933878 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-13449bfe-d939-4edc-a5dc-60b9ac6cbca5 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:01.957672 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-13449bfe-d939-4edc-a5dc-60b9ac6cbca5 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:01.958529 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-13449bfe-d939-4edc-a5dc-60b9ac6cbca5 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:01.958973 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-13449bfe-d939-4edc-a5dc-60b9ac6cbca5 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:01.959559 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5927a9fc-0405-465e-ac83-9b37b9d2e578 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "POST /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02/action" status: 202 len: 0 microversion: 2.1 time: 0.329951 Oct 23 01:17:01.959932 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-13449bfe-d939-4edc-a5dc-60b9ac6cbca5 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:01.960643 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-13449bfe-d939-4edc-a5dc-60b9ac6cbca5 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:01.961525 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 878/1789] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:17:01 2022] POST /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02/action => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:17:01.961802 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-13449bfe-d939-4edc-a5dc-60b9ac6cbca5 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:01.982178 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-230daa0b-6712-42c0-8011-d49abd123abf tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:01.983412 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-230daa0b-6712-42c0-8011-d49abd123abf tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:01.994054 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-230daa0b-6712-42c0-8011-d49abd123abf tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:01.996479 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-230daa0b-6712-42c0-8011-d49abd123abf tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:01.997072 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-230daa0b-6712-42c0-8011-d49abd123abf tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:01.998674 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-230daa0b-6712-42c0-8011-d49abd123abf tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:02.000085 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-230daa0b-6712-42c0-8011-d49abd123abf tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:02.001600 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-230daa0b-6712-42c0-8011-d49abd123abf tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:02.235236 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-13449bfe-d939-4edc-a5dc-60b9ac6cbca5 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:02.248537 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-13449bfe-d939-4edc-a5dc-60b9ac6cbca5 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:02.251185 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-13449bfe-d939-4edc-a5dc-60b9ac6cbca5 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:02.252441 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-13449bfe-d939-4edc-a5dc-60b9ac6cbca5 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7" status: 200 len: 1815 microversion: 2.25 time: 0.332098 Oct 23 01:17:02.259942 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 912/1790] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:17:01 2022] GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7 => generated 1815 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:17:02.274132 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6fc02e2b-2818-453e-aa11-c1cc1b36ed28 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:02.275798 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6fc02e2b-2818-453e-aa11-c1cc1b36ed28 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 664ea2e5-4242-4119-9a39-e32c760345b2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:02.286838 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6fc02e2b-2818-453e-aa11-c1cc1b36ed28 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:02.287613 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6fc02e2b-2818-453e-aa11-c1cc1b36ed28 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:02.288215 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6fc02e2b-2818-453e-aa11-c1cc1b36ed28 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:02.289079 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6fc02e2b-2818-453e-aa11-c1cc1b36ed28 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:02.289680 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6fc02e2b-2818-453e-aa11-c1cc1b36ed28 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:02.290288 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6fc02e2b-2818-453e-aa11-c1cc1b36ed28 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:02.392281 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-230daa0b-6712-42c0-8011-d49abd123abf tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:02.424931 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-230daa0b-6712-42c0-8011-d49abd123abf tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1470 microversion: 2.1 time: 0.459554 Oct 23 01:17:02.428036 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 879/1791] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:01 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1470 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:02.443434 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e528c9b5-f5aa-4e57-87ab-5ca6bb80600d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:02.445001 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e528c9b5-f5aa-4e57-87ab-5ca6bb80600d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:02.455575 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e528c9b5-f5aa-4e57-87ab-5ca6bb80600d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:02.457388 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e528c9b5-f5aa-4e57-87ab-5ca6bb80600d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:02.459574 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e528c9b5-f5aa-4e57-87ab-5ca6bb80600d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:02.470693 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e528c9b5-f5aa-4e57-87ab-5ca6bb80600d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:02.470693 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e528c9b5-f5aa-4e57-87ab-5ca6bb80600d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:02.470693 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e528c9b5-f5aa-4e57-87ab-5ca6bb80600d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:02.522615 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6fc02e2b-2818-453e-aa11-c1cc1b36ed28 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:02.533908 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6fc02e2b-2818-453e-aa11-c1cc1b36ed28 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/664ea2e5-4242-4119-9a39-e32c760345b2" status: 200 len: 1527 microversion: 2.1 time: 0.279520 Oct 23 01:17:02.534515 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 913/1792] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:02 2022] GET /compute/v2.1/servers/664ea2e5-4242-4119-9a39-e32c760345b2 => generated 1527 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:02.539316 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8c3b04a4-27a4-497e-be35-fdd31434a171 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:02.542813 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8c3b04a4-27a4-497e-be35-fdd31434a171 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 7fc07c10-f37b-4374-bcc0-25793b180d9c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:02.559518 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8c3b04a4-27a4-497e-be35-fdd31434a171 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:02.560296 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8c3b04a4-27a4-497e-be35-fdd31434a171 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:02.560902 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8c3b04a4-27a4-497e-be35-fdd31434a171 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:02.567943 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8c3b04a4-27a4-497e-be35-fdd31434a171 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:02.567943 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8c3b04a4-27a4-497e-be35-fdd31434a171 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:02.567943 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8c3b04a4-27a4-497e-be35-fdd31434a171 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:02.567943 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:17:02.595445 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e528c9b5-f5aa-4e57-87ab-5ca6bb80600d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:02.607997 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e528c9b5-f5aa-4e57-87ab-5ca6bb80600d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1094 microversion: 2.1 time: 0.177398 Oct 23 01:17:02.609901 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 880/1793] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:02 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1094 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:02.652531 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d7aab96f-8590-464c-b9c1-5f0ea0e71d58 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:02.653460 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d7aab96f-8590-464c-b9c1-5f0ea0e71d58 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 0d9df9b8-b177-4adc-bf48-941d99ddf249] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:02.660674 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d7aab96f-8590-464c-b9c1-5f0ea0e71d58 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:02.661398 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d7aab96f-8590-464c-b9c1-5f0ea0e71d58 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:02.662026 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d7aab96f-8590-464c-b9c1-5f0ea0e71d58 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:02.663145 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d7aab96f-8590-464c-b9c1-5f0ea0e71d58 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:02.663509 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d7aab96f-8590-464c-b9c1-5f0ea0e71d58 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:02.669104 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d7aab96f-8590-464c-b9c1-5f0ea0e71d58 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:02.786990 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8c3b04a4-27a4-497e-be35-fdd31434a171 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:02.796213 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8c3b04a4-27a4-497e-be35-fdd31434a171 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/7fc07c10-f37b-4374-bcc0-25793b180d9c" status: 200 len: 1487 microversion: 2.1 time: 0.260387 Oct 23 01:17:02.797272 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 914/1794] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:02 2022] GET /compute/v2.1/servers/7fc07c10-f37b-4374-bcc0-25793b180d9c => generated 1487 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:02.820067 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b99516fb-4ca0-43e0-81e7-7ba7482f9494 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:02.820871 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b99516fb-4ca0-43e0-81e7-7ba7482f9494 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: bdd228c7-614f-4742-932f-5cb7faf5a68c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:02.827914 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b99516fb-4ca0-43e0-81e7-7ba7482f9494 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:02.828695 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b99516fb-4ca0-43e0-81e7-7ba7482f9494 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:02.829348 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b99516fb-4ca0-43e0-81e7-7ba7482f9494 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:02.830082 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b99516fb-4ca0-43e0-81e7-7ba7482f9494 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:02.830575 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b99516fb-4ca0-43e0-81e7-7ba7482f9494 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:02.831000 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b99516fb-4ca0-43e0-81e7-7ba7482f9494 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:02.944800 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b99516fb-4ca0-43e0-81e7-7ba7482f9494 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9681db3595440a88dacc40393e2e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386d20bba06b48be9a7e51162dc4d814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:02.952685 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d7aab96f-8590-464c-b9c1-5f0ea0e71d58 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:02.965643 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d7aab96f-8590-464c-b9c1-5f0ea0e71d58 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/0d9df9b8-b177-4adc-bf48-941d99ddf249" status: 200 len: 1317 microversion: 2.1 time: 0.316845 Oct 23 01:17:02.972009 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b99516fb-4ca0-43e0-81e7-7ba7482f9494 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] 10.222.0.42 "GET /compute/v2.1/servers/bdd228c7-614f-4742-932f-5cb7faf5a68c" status: 200 len: 1276 microversion: 2.1 time: 0.156133 Oct 23 01:17:02.976138 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 915/1795] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:02 2022] GET /compute/v2.1/servers/bdd228c7-614f-4742-932f-5cb7faf5a68c => generated 1276 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:17:02.980227 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 881/1796] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:02 2022] GET /compute/v2.1/servers/0d9df9b8-b177-4adc-bf48-941d99ddf249 => generated 1317 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:17:02.997923 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1db354fd-13ae-4775-bbe6-e403fbf80695 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:17:02.999142 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1db354fd-13ae-4775-bbe6-e403fbf80695 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 7fc07c10-f37b-4374-bcc0-25793b180d9c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:03.005636 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-25488d6a-3028-4649-aa2f-4674db257ef1 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:03.007614 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1db354fd-13ae-4775-bbe6-e403fbf80695 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:03.008106 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1db354fd-13ae-4775-bbe6-e403fbf80695 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:03.008537 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1db354fd-13ae-4775-bbe6-e403fbf80695 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:03.008925 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-25488d6a-3028-4649-aa2f-4674db257ef1 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] [instance: 120895a2-d6c4-47f6-a6e4-32cbcf028037] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:03.009232 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1db354fd-13ae-4775-bbe6-e403fbf80695 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:03.009679 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1db354fd-13ae-4775-bbe6-e403fbf80695 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:03.010377 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1db354fd-13ae-4775-bbe6-e403fbf80695 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:03.020872 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25488d6a-3028-4649-aa2f-4674db257ef1 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:03.021383 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25488d6a-3028-4649-aa2f-4674db257ef1 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:03.021835 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25488d6a-3028-4649-aa2f-4674db257ef1 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:03.022577 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25488d6a-3028-4649-aa2f-4674db257ef1 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:03.023079 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25488d6a-3028-4649-aa2f-4674db257ef1 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:03.023509 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25488d6a-3028-4649-aa2f-4674db257ef1 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:03.114808 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-25488d6a-3028-4649-aa2f-4674db257ef1 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:03.125492 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-25488d6a-3028-4649-aa2f-4674db257ef1 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:03.126993 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-25488d6a-3028-4649-aa2f-4674db257ef1 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:03.128213 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-25488d6a-3028-4649-aa2f-4674db257ef1 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] 10.222.0.42 "GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037" status: 200 len: 1365 microversion: 2.57 time: 0.146927 Oct 23 01:17:03.128865 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 882/1797] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:17:02 2022] GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037 => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:17:03.281731 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-335ce09c-89bd-4b7f-a7e4-b2ed9fd1d922 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:03.283700 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-335ce09c-89bd-4b7f-a7e4-b2ed9fd1d922 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:03.293859 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-335ce09c-89bd-4b7f-a7e4-b2ed9fd1d922 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:03.297421 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-335ce09c-89bd-4b7f-a7e4-b2ed9fd1d922 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:03.298146 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-335ce09c-89bd-4b7f-a7e4-b2ed9fd1d922 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:03.300250 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-335ce09c-89bd-4b7f-a7e4-b2ed9fd1d922 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:03.300989 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-335ce09c-89bd-4b7f-a7e4-b2ed9fd1d922 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:03.303284 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-335ce09c-89bd-4b7f-a7e4-b2ed9fd1d922 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:03.340815 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1db354fd-13ae-4775-bbe6-e403fbf80695 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "POST /compute/v2.1/servers/7fc07c10-f37b-4374-bcc0-25793b180d9c/action" status: 202 len: 0 microversion: 2.1 time: 0.362468 Oct 23 01:17:03.341821 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 916/1798] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:17:02 2022] POST /compute/v2.1/servers/7fc07c10-f37b-4374-bcc0-25793b180d9c/action => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:17:03.366952 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-27e77d78-8efb-4752-8c22-2b19649736bf tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:03.376138 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-27e77d78-8efb-4752-8c22-2b19649736bf tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 7fc07c10-f37b-4374-bcc0-25793b180d9c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:03.392542 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-27e77d78-8efb-4752-8c22-2b19649736bf tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:03.392542 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-27e77d78-8efb-4752-8c22-2b19649736bf tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:03.393113 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-27e77d78-8efb-4752-8c22-2b19649736bf tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:03.395512 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-27e77d78-8efb-4752-8c22-2b19649736bf tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:03.396808 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-27e77d78-8efb-4752-8c22-2b19649736bf tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:03.399006 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-27e77d78-8efb-4752-8c22-2b19649736bf tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:03.726940 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-27e77d78-8efb-4752-8c22-2b19649736bf tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:03.736284 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-27e77d78-8efb-4752-8c22-2b19649736bf tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/7fc07c10-f37b-4374-bcc0-25793b180d9c" status: 200 len: 1492 microversion: 2.1 time: 0.377173 Oct 23 01:17:03.739877 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 917/1799] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:03 2022] GET /compute/v2.1/servers/7fc07c10-f37b-4374-bcc0-25793b180d9c => generated 1492 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:03.744941 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1879b204-e068-4cba-aa93-18b777a42193 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:03.745822 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1879b204-e068-4cba-aa93-18b777a42193 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:03.755978 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1879b204-e068-4cba-aa93-18b777a42193 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:03.761922 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1879b204-e068-4cba-aa93-18b777a42193 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:03.762720 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1879b204-e068-4cba-aa93-18b777a42193 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:03.763803 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1879b204-e068-4cba-aa93-18b777a42193 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:03.764425 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1879b204-e068-4cba-aa93-18b777a42193 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:03.765016 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1879b204-e068-4cba-aa93-18b777a42193 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:03.775574 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-335ce09c-89bd-4b7f-a7e4-b2ed9fd1d922 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:03.788876 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-335ce09c-89bd-4b7f-a7e4-b2ed9fd1d922 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:03.789951 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-335ce09c-89bd-4b7f-a7e4-b2ed9fd1d922 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:03.799777 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-335ce09c-89bd-4b7f-a7e4-b2ed9fd1d922 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7" status: 200 len: 1815 microversion: 2.25 time: 0.522374 Oct 23 01:17:03.810685 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 883/1800] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:17:03 2022] GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7 => generated 1815 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:17:03.810685 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-18c823c5-d99a-4392-a347-0752a1c14db2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:03.810685 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-18c823c5-d99a-4392-a347-0752a1c14db2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 664ea2e5-4242-4119-9a39-e32c760345b2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:03.821726 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18c823c5-d99a-4392-a347-0752a1c14db2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:03.821726 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18c823c5-d99a-4392-a347-0752a1c14db2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:03.821726 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18c823c5-d99a-4392-a347-0752a1c14db2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:03.821726 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18c823c5-d99a-4392-a347-0752a1c14db2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:03.830438 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18c823c5-d99a-4392-a347-0752a1c14db2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:03.830838 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18c823c5-d99a-4392-a347-0752a1c14db2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:03.966098 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-18c823c5-d99a-4392-a347-0752a1c14db2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:03.976094 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-18c823c5-d99a-4392-a347-0752a1c14db2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/664ea2e5-4242-4119-9a39-e32c760345b2" status: 200 len: 1485 microversion: 2.1 time: 0.173913 Oct 23 01:17:03.981356 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 884/1801] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:03 2022] GET /compute/v2.1/servers/664ea2e5-4242-4119-9a39-e32c760345b2 => generated 1485 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:03.993160 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5f0b1857-39e2-4487-b376-1cdba7313b13 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:03.998323 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5f0b1857-39e2-4487-b376-1cdba7313b13 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:04.005435 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f0b1857-39e2-4487-b376-1cdba7313b13 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:04.006010 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f0b1857-39e2-4487-b376-1cdba7313b13 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:04.010758 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f0b1857-39e2-4487-b376-1cdba7313b13 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:04.011540 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f0b1857-39e2-4487-b376-1cdba7313b13 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:04.012454 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f0b1857-39e2-4487-b376-1cdba7313b13 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:04.012454 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f0b1857-39e2-4487-b376-1cdba7313b13 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:04.162424 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5f0b1857-39e2-4487-b376-1cdba7313b13 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:04.174149 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5f0b1857-39e2-4487-b376-1cdba7313b13 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1150 microversion: 2.1 time: 0.191318 Oct 23 01:17:04.175525 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 885/1802] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:03 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1150 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:04.184556 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-63c0aab3-aff0-4113-b97a-795b2c020dc9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:04.185454 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-63c0aab3-aff0-4113-b97a-795b2c020dc9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 0d9df9b8-b177-4adc-bf48-941d99ddf249] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:04.194122 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-63c0aab3-aff0-4113-b97a-795b2c020dc9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:04.194611 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-63c0aab3-aff0-4113-b97a-795b2c020dc9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:04.195125 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-63c0aab3-aff0-4113-b97a-795b2c020dc9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:04.195815 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-63c0aab3-aff0-4113-b97a-795b2c020dc9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:04.196366 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-63c0aab3-aff0-4113-b97a-795b2c020dc9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:04.197005 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-63c0aab3-aff0-4113-b97a-795b2c020dc9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:04.207374 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1879b204-e068-4cba-aa93-18b777a42193 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:04.215173 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1879b204-e068-4cba-aa93-18b777a42193 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1470 microversion: 2.1 time: 0.474017 Oct 23 01:17:04.231608 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 918/1803] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:03 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1470 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:04.240066 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fc6a21a3-4edd-439e-a117-8e66c16aecf8 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:04.240684 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-fc6a21a3-4edd-439e-a117-8e66c16aecf8 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: bdd228c7-614f-4742-932f-5cb7faf5a68c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:04.247719 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc6a21a3-4edd-439e-a117-8e66c16aecf8 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:04.248204 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc6a21a3-4edd-439e-a117-8e66c16aecf8 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:04.248640 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc6a21a3-4edd-439e-a117-8e66c16aecf8 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:04.249360 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc6a21a3-4edd-439e-a117-8e66c16aecf8 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:04.251670 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc6a21a3-4edd-439e-a117-8e66c16aecf8 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:04.251670 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc6a21a3-4edd-439e-a117-8e66c16aecf8 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:04.665522 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-fc6a21a3-4edd-439e-a117-8e66c16aecf8 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9681db3595440a88dacc40393e2e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386d20bba06b48be9a7e51162dc4d814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:04.677819 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fc6a21a3-4edd-439e-a117-8e66c16aecf8 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] 10.222.0.42 "GET /compute/v2.1/servers/bdd228c7-614f-4742-932f-5cb7faf5a68c" status: 200 len: 1282 microversion: 2.1 time: 0.444876 Oct 23 01:17:04.680771 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 919/1804] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:04 2022] GET /compute/v2.1/servers/bdd228c7-614f-4742-932f-5cb7faf5a68c => generated 1282 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:04.685282 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-faadbdab-0d1d-4926-b987-c75b5d6d6c8b req-6f97208b-f445-4f6a-8e57-79ba855a6b9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "664ea2e5-4242-4119-9a39-e32c760345b2", "name": "network-vif-deleted", "tag": "6b8ad487-ddba-4834-a4d5-10c797dc53f2"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:17:04.718703 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-faadbdab-0d1d-4926-b987-c75b5d6d6c8b req-6f97208b-f445-4f6a-8e57-79ba855a6b9f service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:04.722912 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-faadbdab-0d1d-4926-b987-c75b5d6d6c8b req-6f97208b-f445-4f6a-8e57-79ba855a6b9f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:04.724328 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-faadbdab-0d1d-4926-b987-c75b5d6d6c8b req-6f97208b-f445-4f6a-8e57-79ba855a6b9f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:04.774168 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-faadbdab-0d1d-4926-b987-c75b5d6d6c8b req-6f97208b-f445-4f6a-8e57-79ba855a6b9f service nova] Creating event network-vif-deleted:6b8ad487-ddba-4834-a4d5-10c797dc53f2 for instance 664ea2e5-4242-4119-9a39-e32c760345b2 on n-h2-master-1 Oct 23 01:17:04.783477 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-faadbdab-0d1d-4926-b987-c75b5d6d6c8b req-6f97208b-f445-4f6a-8e57-79ba855a6b9f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102918 Oct 23 01:17:04.786073 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 920/1805] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:17:04.800493 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-43073535-cde8-43d8-824b-fd26782d611c tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:04.801248 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-43073535-cde8-43d8-824b-fd26782d611c tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] [instance: 120895a2-d6c4-47f6-a6e4-32cbcf028037] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:04.815505 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-63c0aab3-aff0-4113-b97a-795b2c020dc9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:04.834166 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-63c0aab3-aff0-4113-b97a-795b2c020dc9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/0d9df9b8-b177-4adc-bf48-941d99ddf249" status: 200 len: 1317 microversion: 2.1 time: 0.653833 Oct 23 01:17:04.835087 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 886/1806] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:04 2022] GET /compute/v2.1/servers/0d9df9b8-b177-4adc-bf48-941d99ddf249 => generated 1317 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:04.842906 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-43073535-cde8-43d8-824b-fd26782d611c tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:04.846145 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-43073535-cde8-43d8-824b-fd26782d611c tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:04.849320 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5d531a41-00f8-4fae-9b8c-48dd87cf4a5a tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:04.850150 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-43073535-cde8-43d8-824b-fd26782d611c tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:04.853839 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-43073535-cde8-43d8-824b-fd26782d611c tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:04.853839 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-43073535-cde8-43d8-824b-fd26782d611c tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:04.853839 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-43073535-cde8-43d8-824b-fd26782d611c tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:04.858126 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5d531a41-00f8-4fae-9b8c-48dd87cf4a5a tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 7fc07c10-f37b-4374-bcc0-25793b180d9c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:04.875058 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5d531a41-00f8-4fae-9b8c-48dd87cf4a5a tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:04.875993 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5d531a41-00f8-4fae-9b8c-48dd87cf4a5a tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:04.876129 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5d531a41-00f8-4fae-9b8c-48dd87cf4a5a tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:04.878804 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5d531a41-00f8-4fae-9b8c-48dd87cf4a5a tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:04.879341 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5d531a41-00f8-4fae-9b8c-48dd87cf4a5a tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:04.882510 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5d531a41-00f8-4fae-9b8c-48dd87cf4a5a tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:05.062975 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-43073535-cde8-43d8-824b-fd26782d611c tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:05.075614 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-43073535-cde8-43d8-824b-fd26782d611c tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:05.077145 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-43073535-cde8-43d8-824b-fd26782d611c tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:05.078398 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-43073535-cde8-43d8-824b-fd26782d611c tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] 10.222.0.42 "GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037" status: 200 len: 1365 microversion: 2.57 time: 0.290948 Oct 23 01:17:05.090382 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 921/1807] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:17:04 2022] GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037 => generated 1365 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:17:05.095683 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3c0efc1b-05f7-4c1f-8274-c623568ea054 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:05.096544 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3c0efc1b-05f7-4c1f-8274-c623568ea054 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:05.113687 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c0efc1b-05f7-4c1f-8274-c623568ea054 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:05.114960 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c0efc1b-05f7-4c1f-8274-c623568ea054 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:05.115404 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c0efc1b-05f7-4c1f-8274-c623568ea054 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:05.116109 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c0efc1b-05f7-4c1f-8274-c623568ea054 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:05.116767 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c0efc1b-05f7-4c1f-8274-c623568ea054 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:05.117389 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c0efc1b-05f7-4c1f-8274-c623568ea054 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:05.314397 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5d531a41-00f8-4fae-9b8c-48dd87cf4a5a tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:05.326629 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5d531a41-00f8-4fae-9b8c-48dd87cf4a5a tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/7fc07c10-f37b-4374-bcc0-25793b180d9c" status: 200 len: 1472 microversion: 2.1 time: 0.486190 Oct 23 01:17:05.327535 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 887/1808] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:04 2022] GET /compute/v2.1/servers/7fc07c10-f37b-4374-bcc0-25793b180d9c => generated 1472 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:05.340400 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-97d4c3e9-b357-42d3-9848-4463c24d0f7d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:05.341166 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-97d4c3e9-b357-42d3-9848-4463c24d0f7d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 664ea2e5-4242-4119-9a39-e32c760345b2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:05.347554 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-97d4c3e9-b357-42d3-9848-4463c24d0f7d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:05.351080 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-97d4c3e9-b357-42d3-9848-4463c24d0f7d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:05.351712 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-97d4c3e9-b357-42d3-9848-4463c24d0f7d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:05.353964 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-97d4c3e9-b357-42d3-9848-4463c24d0f7d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:05.354711 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-97d4c3e9-b357-42d3-9848-4463c24d0f7d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:05.358642 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-97d4c3e9-b357-42d3-9848-4463c24d0f7d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:05.396561 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-97d4c3e9-b357-42d3-9848-4463c24d0f7d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:05.397315 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-97d4c3e9-b357-42d3-9848-4463c24d0f7d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:05.397967 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-97d4c3e9-b357-42d3-9848-4463c24d0f7d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:05.401990 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3c0efc1b-05f7-4c1f-8274-c623568ea054 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:05.406773 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-97d4c3e9-b357-42d3-9848-4463c24d0f7d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lazy-loading 'fault' on Instance uuid 664ea2e5-4242-4119-9a39-e32c760345b2 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:17:05.412961 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3c0efc1b-05f7-4c1f-8274-c623568ea054 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:05.415043 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3c0efc1b-05f7-4c1f-8274-c623568ea054 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:05.416644 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3c0efc1b-05f7-4c1f-8274-c623568ea054 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7" status: 200 len: 1815 microversion: 2.25 time: 0.324915 Oct 23 01:17:05.431222 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 922/1809] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:17:05 2022] GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7 => generated 1815 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:17:05.442768 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9b60e14d-dc48-4a05-80ea-f0b2731e1ab9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:05.443389 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9b60e14d-dc48-4a05-80ea-f0b2731e1ab9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:05.452180 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b60e14d-dc48-4a05-80ea-f0b2731e1ab9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:05.452590 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b60e14d-dc48-4a05-80ea-f0b2731e1ab9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:05.453018 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b60e14d-dc48-4a05-80ea-f0b2731e1ab9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:05.453718 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b60e14d-dc48-4a05-80ea-f0b2731e1ab9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:05.454207 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b60e14d-dc48-4a05-80ea-f0b2731e1ab9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:05.454622 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b60e14d-dc48-4a05-80ea-f0b2731e1ab9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:05.460546 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-97d4c3e9-b357-42d3-9848-4463c24d0f7d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:05.479906 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-97d4c3e9-b357-42d3-9848-4463c24d0f7d tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/664ea2e5-4242-4119-9a39-e32c760345b2" status: 200 len: 1314 microversion: 2.1 time: 0.151207 Oct 23 01:17:05.481124 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 888/1810] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:05 2022] GET /compute/v2.1/servers/664ea2e5-4242-4119-9a39-e32c760345b2 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:05.510064 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5279852c-5a2a-4121-89af-e2534aa931fb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:05.510064 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5279852c-5a2a-4121-89af-e2534aa931fb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:05.518774 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5279852c-5a2a-4121-89af-e2534aa931fb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:05.519198 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5279852c-5a2a-4121-89af-e2534aa931fb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:05.520949 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5279852c-5a2a-4121-89af-e2534aa931fb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:05.521689 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5279852c-5a2a-4121-89af-e2534aa931fb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:05.523323 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5279852c-5a2a-4121-89af-e2534aa931fb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:05.523769 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5279852c-5a2a-4121-89af-e2534aa931fb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:05.666010 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9b60e14d-dc48-4a05-80ea-f0b2731e1ab9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:05.678222 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9b60e14d-dc48-4a05-80ea-f0b2731e1ab9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1168 microversion: 2.1 time: 0.244128 Oct 23 01:17:05.680122 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 923/1811] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:05 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1168 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:05.694406 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1b8051ce-accf-4659-a1a8-5e7d193b2cdc tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-906097587"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:17:05.705174 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1b8051ce-accf-4659-a1a8-5e7d193b2cdc tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 7fc07c10-f37b-4374-bcc0-25793b180d9c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:05.714932 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b8051ce-accf-4659-a1a8-5e7d193b2cdc tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:05.715747 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b8051ce-accf-4659-a1a8-5e7d193b2cdc tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:05.716901 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b8051ce-accf-4659-a1a8-5e7d193b2cdc tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:05.722820 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b8051ce-accf-4659-a1a8-5e7d193b2cdc tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:05.724380 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b8051ce-accf-4659-a1a8-5e7d193b2cdc tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:05.728319 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b8051ce-accf-4659-a1a8-5e7d193b2cdc tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:05.995033 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5279852c-5a2a-4121-89af-e2534aa931fb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:06.004086 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5279852c-5a2a-4121-89af-e2534aa931fb tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1470 microversion: 2.1 time: 0.508194 Oct 23 01:17:06.006414 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 889/1812] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:05 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1470 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:06.011557 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-aafde1b9-3a55-4066-9645-5e2079da4661 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:06.012368 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-aafde1b9-3a55-4066-9645-5e2079da4661 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: bdd228c7-614f-4742-932f-5cb7faf5a68c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:06.018726 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aafde1b9-3a55-4066-9645-5e2079da4661 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:06.034638 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aafde1b9-3a55-4066-9645-5e2079da4661 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:06.034638 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aafde1b9-3a55-4066-9645-5e2079da4661 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:06.034638 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aafde1b9-3a55-4066-9645-5e2079da4661 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:06.034638 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aafde1b9-3a55-4066-9645-5e2079da4661 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:06.034638 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aafde1b9-3a55-4066-9645-5e2079da4661 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:06.256381 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-aafde1b9-3a55-4066-9645-5e2079da4661 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9681db3595440a88dacc40393e2e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386d20bba06b48be9a7e51162dc4d814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:06.266611 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-aafde1b9-3a55-4066-9645-5e2079da4661 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] 10.222.0.42 "GET /compute/v2.1/servers/bdd228c7-614f-4742-932f-5cb7faf5a68c" status: 200 len: 1324 microversion: 2.1 time: 0.258850 Oct 23 01:17:06.268468 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 890/1813] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:06 2022] GET /compute/v2.1/servers/bdd228c7-614f-4742-932f-5cb7faf5a68c => generated 1324 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:06.273518 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d8124cac-5a34-4d92-a0d3-25f34a392ece tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:06.274854 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d8124cac-5a34-4d92-a0d3-25f34a392ece tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 0d9df9b8-b177-4adc-bf48-941d99ddf249] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:06.300968 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:17:06.308923 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d8124cac-5a34-4d92-a0d3-25f34a392ece tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:06.309549 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d8124cac-5a34-4d92-a0d3-25f34a392ece tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:06.312204 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d8124cac-5a34-4d92-a0d3-25f34a392ece tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:06.313081 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d8124cac-5a34-4d92-a0d3-25f34a392ece tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:06.314258 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d8124cac-5a34-4d92-a0d3-25f34a392ece tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:06.315242 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d8124cac-5a34-4d92-a0d3-25f34a392ece tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:06.352017 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1b8051ce-accf-4659-a1a8-5e7d193b2cdc tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "POST /compute/v2.1/servers/7fc07c10-f37b-4374-bcc0-25793b180d9c/action" status: 202 len: 0 microversion: 2.1 time: 0.667907 Oct 23 01:17:06.404968 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 924/1814] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:17:05 2022] POST /compute/v2.1/servers/7fc07c10-f37b-4374-bcc0-25793b180d9c/action => generated 0 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 23 01:17:06.404968 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-34a9183d-2239-433f-9eb0-a546f21164f2 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:06.404968 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-34a9183d-2239-433f-9eb0-a546f21164f2 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] [instance: 120895a2-d6c4-47f6-a6e4-32cbcf028037] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:06.404968 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-34a9183d-2239-433f-9eb0-a546f21164f2 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:06.404968 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-34a9183d-2239-433f-9eb0-a546f21164f2 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:06.404968 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-34a9183d-2239-433f-9eb0-a546f21164f2 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:06.404968 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-34a9183d-2239-433f-9eb0-a546f21164f2 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:06.404968 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-34a9183d-2239-433f-9eb0-a546f21164f2 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:06.404968 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-34a9183d-2239-433f-9eb0-a546f21164f2 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:06.579698 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-34a9183d-2239-433f-9eb0-a546f21164f2 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:06.589628 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-34a9183d-2239-433f-9eb0-a546f21164f2 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:06.591978 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-34a9183d-2239-433f-9eb0-a546f21164f2 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:06.593439 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-34a9183d-2239-433f-9eb0-a546f21164f2 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] 10.222.0.42 "GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037" status: 200 len: 1365 microversion: 2.57 time: 0.236248 Oct 23 01:17:06.594804 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 925/1815] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:17:06 2022] GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037 => generated 1365 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:17:06.607163 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f5cbcce4-2003-414d-9dcc-3aef355854ab tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc1f12310>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:06.636301 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d8124cac-5a34-4d92-a0d3-25f34a392ece tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:06.636301 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d8124cac-5a34-4d92-a0d3-25f34a392ece tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/0d9df9b8-b177-4adc-bf48-941d99ddf249" status: 200 len: 1317 microversion: 2.1 time: 0.365469 Oct 23 01:17:06.648514 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 891/1816] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:06 2022] GET /compute/v2.1/servers/0d9df9b8-b177-4adc-bf48-941d99ddf249 => generated 1317 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:06.653775 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bf9093c1-416f-450f-83be-63adb3ac06ca tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:06.658488 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bf9093c1-416f-450f-83be-63adb3ac06ca tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:06.658763 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f5cbcce4-2003-414d-9dcc-3aef355854ab tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/90d42cdd-cddc-43cd-a2de-f4f225ffb04a" status: 200 len: 1413 microversion: 2.1 time: 0.061475 Oct 23 01:17:06.658892 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 926/1817] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:17:06 2022] GET /compute/v2.1/images/90d42cdd-cddc-43cd-a2de-f4f225ffb04a => generated 1413 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:06.662722 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf9093c1-416f-450f-83be-63adb3ac06ca tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:06.663492 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf9093c1-416f-450f-83be-63adb3ac06ca tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:06.664134 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-278225d8-16f6-413b-99ee-be9036758ea2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:06.664320 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf9093c1-416f-450f-83be-63adb3ac06ca tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:06.665199 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf9093c1-416f-450f-83be-63adb3ac06ca tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:06.665812 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf9093c1-416f-450f-83be-63adb3ac06ca tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:06.666434 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf9093c1-416f-450f-83be-63adb3ac06ca tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:06.666758 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-278225d8-16f6-413b-99ee-be9036758ea2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 664ea2e5-4242-4119-9a39-e32c760345b2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:06.675658 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-278225d8-16f6-413b-99ee-be9036758ea2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:06.676223 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-278225d8-16f6-413b-99ee-be9036758ea2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:06.679587 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-278225d8-16f6-413b-99ee-be9036758ea2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:06.679587 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-278225d8-16f6-413b-99ee-be9036758ea2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:06.679587 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-278225d8-16f6-413b-99ee-be9036758ea2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:06.679587 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-278225d8-16f6-413b-99ee-be9036758ea2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:06.716291 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-278225d8-16f6-413b-99ee-be9036758ea2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:06.716783 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-278225d8-16f6-413b-99ee-be9036758ea2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:06.717276 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-278225d8-16f6-413b-99ee-be9036758ea2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:06.717769 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-278225d8-16f6-413b-99ee-be9036758ea2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lazy-loading 'fault' on Instance uuid 664ea2e5-4242-4119-9a39-e32c760345b2 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:17:06.840721 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-278225d8-16f6-413b-99ee-be9036758ea2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690143905857471f949b1f4454ad2139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3395c4af3435eaa3a0f49e19167fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:06.854469 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-278225d8-16f6-413b-99ee-be9036758ea2 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/664ea2e5-4242-4119-9a39-e32c760345b2" status: 200 len: 1314 microversion: 2.1 time: 0.193038 Oct 23 01:17:06.857166 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 927/1818] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:06 2022] GET /compute/v2.1/servers/664ea2e5-4242-4119-9a39-e32c760345b2 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:06.866954 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fe9e371d-098d-4144-b63e-a224a0c66868 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:06.869199 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-fe9e371d-098d-4144-b63e-a224a0c66868 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:06.887947 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fe9e371d-098d-4144-b63e-a224a0c66868 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:06.888472 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fe9e371d-098d-4144-b63e-a224a0c66868 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:06.889089 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fe9e371d-098d-4144-b63e-a224a0c66868 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:06.892397 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fe9e371d-098d-4144-b63e-a224a0c66868 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:06.893093 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fe9e371d-098d-4144-b63e-a224a0c66868 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:06.893986 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fe9e371d-098d-4144-b63e-a224a0c66868 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:06.992235 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bf9093c1-416f-450f-83be-63adb3ac06ca tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:07.012659 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bf9093c1-416f-450f-83be-63adb3ac06ca tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:07.014172 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bf9093c1-416f-450f-83be-63adb3ac06ca tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:07.015405 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bf9093c1-416f-450f-83be-63adb3ac06ca tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7" status: 200 len: 1815 microversion: 2.25 time: 0.365852 Oct 23 01:17:07.015975 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 892/1819] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:17:06 2022] GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7 => generated 1815 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:17:07.033051 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-bb5691a5-852a-4266-9c20-14a9131d36ac req-b0879db5-5fe7-4611-9405-2049f0332f77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d9df9b8-b177-4adc-bf48-941d99ddf249", "tag": "0f5fc56f-c5f4-491f-8b04-9bf4c9867de9"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:17:07.056233 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-bb5691a5-852a-4266-9c20-14a9131d36ac req-b0879db5-5fe7-4611-9405-2049f0332f77 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:07.056990 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-bb5691a5-852a-4266-9c20-14a9131d36ac req-b0879db5-5fe7-4611-9405-2049f0332f77 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:07.057762 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-bb5691a5-852a-4266-9c20-14a9131d36ac req-b0879db5-5fe7-4611-9405-2049f0332f77 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:07.090754 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-bb5691a5-852a-4266-9c20-14a9131d36ac req-b0879db5-5fe7-4611-9405-2049f0332f77 service nova] Creating event network-changed:0f5fc56f-c5f4-491f-8b04-9bf4c9867de9 for instance 0d9df9b8-b177-4adc-bf48-941d99ddf249 on n-h2-master-1 Oct 23 01:17:07.096300 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-bb5691a5-852a-4266-9c20-14a9131d36ac req-b0879db5-5fe7-4611-9405-2049f0332f77 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070882 Oct 23 01:17:07.097434 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 893/1820] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:17:07.102919 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b2275afd-82f1-440a-a046-38915f068633 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:07.115393 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b2275afd-82f1-440a-a046-38915f068633 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:07.122326 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b2275afd-82f1-440a-a046-38915f068633 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:07.123274 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b2275afd-82f1-440a-a046-38915f068633 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:07.124027 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b2275afd-82f1-440a-a046-38915f068633 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:07.124949 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b2275afd-82f1-440a-a046-38915f068633 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:07.125589 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b2275afd-82f1-440a-a046-38915f068633 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:07.126210 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b2275afd-82f1-440a-a046-38915f068633 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:07.302008 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-fe9e371d-098d-4144-b63e-a224a0c66868 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:07.355548 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fe9e371d-098d-4144-b63e-a224a0c66868 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1210 microversion: 2.1 time: 0.493843 Oct 23 01:17:07.378273 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 928/1821] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:06 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1210 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:07.381337 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c00475dd-692c-42f2-8440-728a0f490b9c tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:07.382126 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c00475dd-692c-42f2-8440-728a0f490b9c tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: bdd228c7-614f-4742-932f-5cb7faf5a68c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:07.389777 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b2275afd-82f1-440a-a046-38915f068633 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:07.390840 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c00475dd-692c-42f2-8440-728a0f490b9c tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:07.391611 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c00475dd-692c-42f2-8440-728a0f490b9c tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:07.392421 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c00475dd-692c-42f2-8440-728a0f490b9c tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:07.393370 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c00475dd-692c-42f2-8440-728a0f490b9c tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:07.394040 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c00475dd-692c-42f2-8440-728a0f490b9c tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:07.394721 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c00475dd-692c-42f2-8440-728a0f490b9c tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:07.406100 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b2275afd-82f1-440a-a046-38915f068633 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1470 microversion: 2.1 time: 0.307065 Oct 23 01:17:07.407533 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 894/1822] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:07 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1470 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:07.542754 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=4 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:17:07.568459 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=12 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:17:07.622419 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c00475dd-692c-42f2-8440-728a0f490b9c tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9681db3595440a88dacc40393e2e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386d20bba06b48be9a7e51162dc4d814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:07.627620 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d5d963f9-026c-4b15-a940-89b60cf4679f tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:07.628329 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d5d963f9-026c-4b15-a940-89b60cf4679f tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] [instance: 120895a2-d6c4-47f6-a6e4-32cbcf028037] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:07.632670 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:17:07.637616 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d5d963f9-026c-4b15-a940-89b60cf4679f tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:07.639044 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c00475dd-692c-42f2-8440-728a0f490b9c tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] 10.222.0.42 "GET /compute/v2.1/servers/bdd228c7-614f-4742-932f-5cb7faf5a68c" status: 200 len: 1324 microversion: 2.1 time: 0.262170 Oct 23 01:17:07.640061 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d5d963f9-026c-4b15-a940-89b60cf4679f tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:07.640940 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 929/1823] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:07 2022] GET /compute/v2.1/servers/bdd228c7-614f-4742-932f-5cb7faf5a68c => generated 1324 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:07.655706 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d5d963f9-026c-4b15-a940-89b60cf4679f tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:07.659799 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d5d963f9-026c-4b15-a940-89b60cf4679f tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:07.663300 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d5d963f9-026c-4b15-a940-89b60cf4679f tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:07.665331 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d5d963f9-026c-4b15-a940-89b60cf4679f tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:07.665915 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-dab02d09-41f5-4e4d-9324-e9601c98cd8b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:07.666617 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-dab02d09-41f5-4e4d-9324-e9601c98cd8b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 0d9df9b8-b177-4adc-bf48-941d99ddf249] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:07.674140 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dab02d09-41f5-4e4d-9324-e9601c98cd8b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:07.675472 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dab02d09-41f5-4e4d-9324-e9601c98cd8b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:07.675905 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dab02d09-41f5-4e4d-9324-e9601c98cd8b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:07.676641 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dab02d09-41f5-4e4d-9324-e9601c98cd8b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:07.677090 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dab02d09-41f5-4e4d-9324-e9601c98cd8b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:07.677508 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dab02d09-41f5-4e4d-9324-e9601c98cd8b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:07.716524 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:17:07.852301 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d5d963f9-026c-4b15-a940-89b60cf4679f tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:07.890843 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d5d963f9-026c-4b15-a940-89b60cf4679f tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:07.896227 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d5d963f9-026c-4b15-a940-89b60cf4679f tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:07.898990 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d5d963f9-026c-4b15-a940-89b60cf4679f tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] 10.222.0.42 "GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037" status: 200 len: 1365 microversion: 2.57 time: 0.276698 Oct 23 01:17:07.902756 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 895/1824] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:17:07 2022] GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037 => generated 1365 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:17:07.912582 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-efb66839-d4b8-4547-9589-3dab0d97e6e3 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc16dfaf0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:08.003024 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-efb66839-d4b8-4547-9589-3dab0d97e6e3 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/90d42cdd-cddc-43cd-a2de-f4f225ffb04a" status: 200 len: 1413 microversion: 2.1 time: 0.097978 Oct 23 01:17:08.008889 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 896/1825] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:17:07 2022] GET /compute/v2.1/images/90d42cdd-cddc-43cd-a2de-f4f225ffb04a => generated 1413 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:08.012489 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c2c61f21-4afa-4d74-9e5b-572023ce240b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:08.015240 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c2c61f21-4afa-4d74-9e5b-572023ce240b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 664ea2e5-4242-4119-9a39-e32c760345b2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:08.030944 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-dab02d09-41f5-4e4d-9324-e9601c98cd8b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:08.034715 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:17:08.039537 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2c61f21-4afa-4d74-9e5b-572023ce240b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:08.040167 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2c61f21-4afa-4d74-9e5b-572023ce240b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:08.040699 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2c61f21-4afa-4d74-9e5b-572023ce240b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:08.042677 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2c61f21-4afa-4d74-9e5b-572023ce240b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:08.042677 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2c61f21-4afa-4d74-9e5b-572023ce240b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:08.043889 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2c61f21-4afa-4d74-9e5b-572023ce240b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:08.047460 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-dab02d09-41f5-4e4d-9324-e9601c98cd8b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/0d9df9b8-b177-4adc-bf48-941d99ddf249" status: 200 len: 1317 microversion: 2.1 time: 0.386732 Oct 23 01:17:08.060842 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 930/1826] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:07 2022] GET /compute/v2.1/servers/0d9df9b8-b177-4adc-bf48-941d99ddf249 => generated 1317 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:08.069638 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7a079e58-87a4-475d-8a66-6e22ca44626a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:08.070444 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7a079e58-87a4-475d-8a66-6e22ca44626a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:08.087910 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-c2c61f21-4afa-4d74-9e5b-572023ce240b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] HTTP exception thrown: Instance 664ea2e5-4242-4119-9a39-e32c760345b2 could not be found. Oct 23 01:17:08.088809 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a079e58-87a4-475d-8a66-6e22ca44626a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:08.089541 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a079e58-87a4-475d-8a66-6e22ca44626a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:08.091260 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a079e58-87a4-475d-8a66-6e22ca44626a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c2c61f21-4afa-4d74-9e5b-572023ce240b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Request method failure captured: Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/664ea2e5-4242-4119-9a39-e32c760345b2 HTTP/1.1 Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJWaABlg9aZPPmiKYOFyjnW3cUDNfMTW-9Ow-Ga99e9rhT_Xz0fOPaBTxk-ZvoWH3eiZ84RoqOaVKmH_NPvl5JjsEC9A2dnRRYDDEs3eUATgMIXjceNensPNpeVu874ElZedsjKlwKXnfqakqBoob0ap94r3bfJNgcmUxWbrsNVh5-k Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 1aa3395c4af3435eaa3a0f49e19167fe Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-421844011 Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1aa3395c4af3435eaa3a0f49e19167fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1aa3395c4af3435eaa3a0f49e19167fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1aa3395c4af3435eaa3a0f49e19167fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1aa3395c4af3435eaa3a0f49e19167fe"}]}] Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-421844011 Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 1aa3395c4af3435eaa3a0f49e19167fe Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-421844011 Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ImagesOneServerNegativeTestJSON-421844011-project Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 690143905857471f949b1f4454ad2139 Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-421844011-project Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 664ea2e5-4242-4119-9a39-e32c760345b2 could not be found. Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '664ea2e5-4242-4119-9a39-e32c760345b2'} Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 664ea2e5-4242-4119-9a39-e32c760345b2 could not be found. Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 664ea2e5-4242-4119-9a39-e32c760345b2 could not be found. Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:08.093075 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:17:08.097821 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:08.097821 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:08.097821 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:17:08.097821 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:17:08.097821 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:17:08.097821 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:17:08.097821 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 664ea2e5-4242-4119-9a39-e32c760345b2 could not be found. Oct 23 01:17:08.097821 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:08.100577 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a079e58-87a4-475d-8a66-6e22ca44626a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:08.101515 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c2c61f21-4afa-4d74-9e5b-572023ce240b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Returning 404 to user: Instance 664ea2e5-4242-4119-9a39-e32c760345b2 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:17:08.102247 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a079e58-87a4-475d-8a66-6e22ca44626a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:08.103084 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a079e58-87a4-475d-8a66-6e22ca44626a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:08.104221 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c2c61f21-4afa-4d74-9e5b-572023ce240b tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/664ea2e5-4242-4119-9a39-e32c760345b2" status: 404 len: 111 microversion: 2.1 time: 0.095973 Oct 23 01:17:08.107834 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 897/1827] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:08 2022] GET /compute/v2.1/servers/664ea2e5-4242-4119-9a39-e32c760345b2 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:17:08.117217 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fe8df17b-0d7c-46a3-947f-333e3fc73262 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '.version_select at 0x7f5cc180bb80>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:08.176323 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-fe8df17b-0d7c-46a3-947f-333e3fc73262 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] HTTP exception thrown: Image not found. Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fe8df17b-0d7c-46a3-947f-333e3fc73262 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Request method failure captured: Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/images/338c5ad9-5d11-43f3-aa02-6b0ba33ca720 HTTP/1.1 Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJWaABlg9aZPPmiKYOFyjnW3cUDNfMTW-9Ow-Ga99e9rhT_Xz0fOPaBTxk-ZvoWH3eiZ84RoqOaVKmH_NPvl5JjsEC9A2dnRRYDDEs3eUATgMIXjceNensPNpeVu874ElZedsjKlwKXnfqakqBoob0ap94r3bfJNgcmUxWbrsNVh5-k Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 1aa3395c4af3435eaa3a0f49e19167fe Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-421844011 Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1aa3395c4af3435eaa3a0f49e19167fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1aa3395c4af3435eaa3a0f49e19167fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1aa3395c4af3435eaa3a0f49e19167fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1aa3395c4af3435eaa3a0f49e19167fe"}]}] Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-421844011 Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 1aa3395c4af3435eaa3a0f49e19167fe Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-421844011 Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ImagesOneServerNegativeTestJSON-421844011-project Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 690143905857471f949b1f4454ad2139 Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-421844011-project Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: method: Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: exception: Image not found. Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '338c5ad9-5d11-43f3-aa02-6b0ba33ca720'} Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 338c5ad9-5d11-43f3-aa02-6b0ba33ca720 to delete Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 338c5ad9-5d11-43f3-aa02-6b0ba33ca720 could not be found. Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:17:08.178700 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:08.185908 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:08.185908 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:17:08.185908 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:17:08.185908 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:17:08.185908 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:17:08.185908 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:17:08.185908 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:17:08.185908 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:17:08.185908 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:17:08.185908 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 23 01:17:08.185908 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 23 01:17:08.185908 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 23 01:17:08.185908 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:08.185908 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:17:08.185908 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:08.185908 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:08.185908 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:17:08.185908 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:17:08.185908 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:17:08.185908 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:17:08.185908 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 23 01:17:08.185908 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:08.185908 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fe8df17b-0d7c-46a3-947f-333e3fc73262 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Returning 404 to user: Image not found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:17:08.185908 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fe8df17b-0d7c-46a3-947f-333e3fc73262 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "DELETE /compute/v2.1/images/338c5ad9-5d11-43f3-aa02-6b0ba33ca720" status: 404 len: 62 microversion: 2.1 time: 0.067976 Oct 23 01:17:08.185908 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 898/1828] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:08 2022] DELETE /compute/v2.1/images/338c5ad9-5d11-43f3-aa02-6b0ba33ca720 => generated 62 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 23 01:17:08.203182 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2257dd7c-dfca-4ae6-881c-9119541ff8c4 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:08.204594 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2257dd7c-dfca-4ae6-881c-9119541ff8c4 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 4150177f-2eef-435a-99b2-efa56983c53a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:08.214295 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2257dd7c-dfca-4ae6-881c-9119541ff8c4 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:08.215713 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2257dd7c-dfca-4ae6-881c-9119541ff8c4 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:08.216245 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2257dd7c-dfca-4ae6-881c-9119541ff8c4 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:08.218704 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2257dd7c-dfca-4ae6-881c-9119541ff8c4 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:08.219227 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2257dd7c-dfca-4ae6-881c-9119541ff8c4 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:08.219685 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2257dd7c-dfca-4ae6-881c-9119541ff8c4 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:08.234850 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-2257dd7c-dfca-4ae6-881c-9119541ff8c4 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] HTTP exception thrown: Instance 4150177f-2eef-435a-99b2-efa56983c53a could not be found. Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2257dd7c-dfca-4ae6-881c-9119541ff8c4 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Request method failure captured: Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a HTTP/1.1 Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJWaABlg9aZPPmiKYOFyjnW3cUDNfMTW-9Ow-Ga99e9rhT_Xz0fOPaBTxk-ZvoWH3eiZ84RoqOaVKmH_NPvl5JjsEC9A2dnRRYDDEs3eUATgMIXjceNensPNpeVu874ElZedsjKlwKXnfqakqBoob0ap94r3bfJNgcmUxWbrsNVh5-k Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 1aa3395c4af3435eaa3a0f49e19167fe Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-421844011 Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1aa3395c4af3435eaa3a0f49e19167fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1aa3395c4af3435eaa3a0f49e19167fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1aa3395c4af3435eaa3a0f49e19167fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1aa3395c4af3435eaa3a0f49e19167fe"}]}] Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-421844011 Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 1aa3395c4af3435eaa3a0f49e19167fe Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-421844011 Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ImagesOneServerNegativeTestJSON-421844011-project Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 690143905857471f949b1f4454ad2139 Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-421844011-project Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 4150177f-2eef-435a-99b2-efa56983c53a could not be found. Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '4150177f-2eef-435a-99b2-efa56983c53a'} Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4150177f-2eef-435a-99b2-efa56983c53a could not be found. Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:17:08.236614 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:17:08.243272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4150177f-2eef-435a-99b2-efa56983c53a could not be found. Oct 23 01:17:08.243272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:08.243272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:17:08.243272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:08.243272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:08.243272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:17:08.243272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:17:08.243272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:17:08.243272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:17:08.243272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4150177f-2eef-435a-99b2-efa56983c53a could not be found. Oct 23 01:17:08.243272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:08.243272 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2257dd7c-dfca-4ae6-881c-9119541ff8c4 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Returning 404 to user: Instance 4150177f-2eef-435a-99b2-efa56983c53a could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:17:08.243272 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2257dd7c-dfca-4ae6-881c-9119541ff8c4 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a" status: 404 len: 111 microversion: 2.1 time: 0.052241 Oct 23 01:17:08.243272 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 899/1829] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:17:08 2022] DELETE /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:17:08.247942 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b84ff134-d92d-4fee-a23f-f275f9a1e8ea tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:08.248774 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b84ff134-d92d-4fee-a23f-f275f9a1e8ea tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 4150177f-2eef-435a-99b2-efa56983c53a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:08.255604 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b84ff134-d92d-4fee-a23f-f275f9a1e8ea tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:08.257618 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b84ff134-d92d-4fee-a23f-f275f9a1e8ea tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:08.258511 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b84ff134-d92d-4fee-a23f-f275f9a1e8ea tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:08.259416 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b84ff134-d92d-4fee-a23f-f275f9a1e8ea tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:08.260045 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b84ff134-d92d-4fee-a23f-f275f9a1e8ea tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:08.260669 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b84ff134-d92d-4fee-a23f-f275f9a1e8ea tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:08.278071 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-b84ff134-d92d-4fee-a23f-f275f9a1e8ea tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] HTTP exception thrown: Instance 4150177f-2eef-435a-99b2-efa56983c53a could not be found. Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b84ff134-d92d-4fee-a23f-f275f9a1e8ea tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Request method failure captured: Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a HTTP/1.1 Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJWaABlg9aZPPmiKYOFyjnW3cUDNfMTW-9Ow-Ga99e9rhT_Xz0fOPaBTxk-ZvoWH3eiZ84RoqOaVKmH_NPvl5JjsEC9A2dnRRYDDEs3eUATgMIXjceNensPNpeVu874ElZedsjKlwKXnfqakqBoob0ap94r3bfJNgcmUxWbrsNVh5-k Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 1aa3395c4af3435eaa3a0f49e19167fe Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-421844011 Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1aa3395c4af3435eaa3a0f49e19167fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1aa3395c4af3435eaa3a0f49e19167fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1aa3395c4af3435eaa3a0f49e19167fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1aa3395c4af3435eaa3a0f49e19167fe"}]}] Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-421844011 Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 1aa3395c4af3435eaa3a0f49e19167fe Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-421844011 Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ImagesOneServerNegativeTestJSON-421844011-project Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 690143905857471f949b1f4454ad2139 Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-421844011-project Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 4150177f-2eef-435a-99b2-efa56983c53a could not be found. Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '4150177f-2eef-435a-99b2-efa56983c53a'} Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4150177f-2eef-435a-99b2-efa56983c53a could not be found. Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4150177f-2eef-435a-99b2-efa56983c53a could not be found. Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:08.285182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:17:08.292419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:08.292419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:08.292419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:17:08.292419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:17:08.292419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:17:08.292419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:17:08.292419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4150177f-2eef-435a-99b2-efa56983c53a could not be found. Oct 23 01:17:08.292419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:08.292419 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b84ff134-d92d-4fee-a23f-f275f9a1e8ea tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Returning 404 to user: Instance 4150177f-2eef-435a-99b2-efa56983c53a could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:17:08.292419 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b84ff134-d92d-4fee-a23f-f275f9a1e8ea tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a" status: 404 len: 111 microversion: 2.1 time: 0.037990 Oct 23 01:17:08.294020 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 900/1830] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:08 2022] GET /compute/v2.1/servers/4150177f-2eef-435a-99b2-efa56983c53a => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:17:08.298835 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9705adca-8875-4d91-bc34-12fd13ce9ab3 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '.version_select at 0x7f5cc18ed430>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:08.339832 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=12 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:17:08.366223 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7a079e58-87a4-475d-8a66-6e22ca44626a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:08.376258 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7a079e58-87a4-475d-8a66-6e22ca44626a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:08.377717 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7a079e58-87a4-475d-8a66-6e22ca44626a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:08.382209 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7a079e58-87a4-475d-8a66-6e22ca44626a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7" status: 200 len: 1815 microversion: 2.25 time: 0.330571 Oct 23 01:17:08.382726 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 931/1831] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:17:08 2022] GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7 => generated 1815 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:17:08.389726 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b88ec45e-f892-4cfe-b03e-09fcfcea1680 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:08.390646 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b88ec45e-f892-4cfe-b03e-09fcfcea1680 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:08.396965 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b88ec45e-f892-4cfe-b03e-09fcfcea1680 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:08.397739 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b88ec45e-f892-4cfe-b03e-09fcfcea1680 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:08.398541 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b88ec45e-f892-4cfe-b03e-09fcfcea1680 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:08.405534 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b88ec45e-f892-4cfe-b03e-09fcfcea1680 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:08.406422 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b88ec45e-f892-4cfe-b03e-09fcfcea1680 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:08.408241 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9705adca-8875-4d91-bc34-12fd13ce9ab3 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1090467130" status: 202 len: 0 microversion: 2.1 time: 0.113088 Oct 23 01:17:08.411325 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b88ec45e-f892-4cfe-b03e-09fcfcea1680 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:08.416391 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 901/1832] 10.222.0.42 () {58 vars in 1221 bytes} [Sun Oct 23 01:17:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1090467130 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:17:08.439350 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-46ab1b35-135e-4041-92a1-e89c90dc871b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:08.441252 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-46ab1b35-135e-4041-92a1-e89c90dc871b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:08.453548 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46ab1b35-135e-4041-92a1-e89c90dc871b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:08.454444 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46ab1b35-135e-4041-92a1-e89c90dc871b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:08.455062 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46ab1b35-135e-4041-92a1-e89c90dc871b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:08.455969 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46ab1b35-135e-4041-92a1-e89c90dc871b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:08.456656 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46ab1b35-135e-4041-92a1-e89c90dc871b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:08.457276 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46ab1b35-135e-4041-92a1-e89c90dc871b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:08.829138 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b88ec45e-f892-4cfe-b03e-09fcfcea1680 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:08.838253 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b88ec45e-f892-4cfe-b03e-09fcfcea1680 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1210 microversion: 2.1 time: 0.452291 Oct 23 01:17:08.842686 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 932/1833] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:08 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1210 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:08.851823 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-d180e3a3-da16-4ec3-b517-7ff8006bf02a req-4bdbd4e2-af96-41bf-9b15-22fae8322150 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdd228c7-614f-4742-932f-5cb7faf5a68c", "tag": "8eb58394-2229-4f50-8d19-48d755a79f37"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:17:08.864649 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-46ab1b35-135e-4041-92a1-e89c90dc871b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:08.872226 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-d180e3a3-da16-4ec3-b517-7ff8006bf02a req-4bdbd4e2-af96-41bf-9b15-22fae8322150 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:08.874850 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-d180e3a3-da16-4ec3-b517-7ff8006bf02a req-4bdbd4e2-af96-41bf-9b15-22fae8322150 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:08.875729 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-d180e3a3-da16-4ec3-b517-7ff8006bf02a req-4bdbd4e2-af96-41bf-9b15-22fae8322150 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:08.885773 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-46ab1b35-135e-4041-92a1-e89c90dc871b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1470 microversion: 2.1 time: 0.453899 Oct 23 01:17:08.891335 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-d180e3a3-da16-4ec3-b517-7ff8006bf02a req-4bdbd4e2-af96-41bf-9b15-22fae8322150 service nova] Creating event network-changed:8eb58394-2229-4f50-8d19-48d755a79f37 for instance bdd228c7-614f-4742-932f-5cb7faf5a68c on n-h2-master-1 Oct 23 01:17:08.900023 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 902/1834] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:08 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1470 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:17:08.904966 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-d180e3a3-da16-4ec3-b517-7ff8006bf02a req-4bdbd4e2-af96-41bf-9b15-22fae8322150 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054472 Oct 23 01:17:08.911423 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 933/1835] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:17:08.912809 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2e57a83b-8b65-49ce-ad23-5d4aef484196 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:08.916248 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2e57a83b-8b65-49ce-ad23-5d4aef484196 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: bdd228c7-614f-4742-932f-5cb7faf5a68c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:08.925519 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e57a83b-8b65-49ce-ad23-5d4aef484196 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:08.926105 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e57a83b-8b65-49ce-ad23-5d4aef484196 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:08.926662 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e57a83b-8b65-49ce-ad23-5d4aef484196 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:08.927386 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e57a83b-8b65-49ce-ad23-5d4aef484196 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:08.927856 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e57a83b-8b65-49ce-ad23-5d4aef484196 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:08.928293 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e57a83b-8b65-49ce-ad23-5d4aef484196 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:08.933234 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8be15f05-a7da-4b8a-8ec2-e77e8c24a478 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:08.935745 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8be15f05-a7da-4b8a-8ec2-e77e8c24a478 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] [instance: 120895a2-d6c4-47f6-a6e4-32cbcf028037] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:08.952369 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8be15f05-a7da-4b8a-8ec2-e77e8c24a478 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:08.953170 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8be15f05-a7da-4b8a-8ec2-e77e8c24a478 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:08.955293 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8be15f05-a7da-4b8a-8ec2-e77e8c24a478 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:08.955293 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8be15f05-a7da-4b8a-8ec2-e77e8c24a478 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:08.955962 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8be15f05-a7da-4b8a-8ec2-e77e8c24a478 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:08.956620 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8be15f05-a7da-4b8a-8ec2-e77e8c24a478 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:09.364468 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8be15f05-a7da-4b8a-8ec2-e77e8c24a478 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:09.375307 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8be15f05-a7da-4b8a-8ec2-e77e8c24a478 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:09.376781 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8be15f05-a7da-4b8a-8ec2-e77e8c24a478 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:09.378101 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8be15f05-a7da-4b8a-8ec2-e77e8c24a478 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] 10.222.0.42 "GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037" status: 200 len: 1365 microversion: 2.57 time: 0.449446 Oct 23 01:17:09.378758 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 934/1836] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:17:08 2022] GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037 => generated 1365 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:17:09.403985 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9c455636-2db3-4fa8-b25e-e929611b0a17 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc1f12d30>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:09.489353 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9c455636-2db3-4fa8-b25e-e929611b0a17 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/90d42cdd-cddc-43cd-a2de-f4f225ffb04a" status: 200 len: 1413 microversion: 2.1 time: 0.109009 Oct 23 01:17:09.491099 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 935/1837] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:17:09 2022] GET /compute/v2.1/images/90d42cdd-cddc-43cd-a2de-f4f225ffb04a => generated 1413 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:09.508240 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a9735841-f4af-4d16-bbe1-284e0e6633cb tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:09.509135 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a9735841-f4af-4d16-bbe1-284e0e6633cb tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 0d9df9b8-b177-4adc-bf48-941d99ddf249] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:09.515518 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9735841-f4af-4d16-bbe1-284e0e6633cb tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:09.516212 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9735841-f4af-4d16-bbe1-284e0e6633cb tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:09.516813 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9735841-f4af-4d16-bbe1-284e0e6633cb tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:09.517765 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9735841-f4af-4d16-bbe1-284e0e6633cb tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:09.530785 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9735841-f4af-4d16-bbe1-284e0e6633cb tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:09.531590 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9735841-f4af-4d16-bbe1-284e0e6633cb tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:09.561396 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2e57a83b-8b65-49ce-ad23-5d4aef484196 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9681db3595440a88dacc40393e2e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386d20bba06b48be9a7e51162dc4d814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:09.571719 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2e57a83b-8b65-49ce-ad23-5d4aef484196 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] 10.222.0.42 "GET /compute/v2.1/servers/bdd228c7-614f-4742-932f-5cb7faf5a68c" status: 200 len: 1324 microversion: 2.1 time: 0.670371 Oct 23 01:17:09.572306 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 903/1838] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:08 2022] GET /compute/v2.1/servers/bdd228c7-614f-4742-932f-5cb7faf5a68c => generated 1324 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:09.585884 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-f1b74d57-a162-4343-afb5-26b3d3eac199 req-aeab4da1-3977-4756-8d50-cdd27863b1a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dad12d7a-a01e-4f91-b35e-4f9f83df5b3b", "tag": "b5a5b9cd-a440-4270-b48f-5816d8d587a8"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:17:09.612458 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-f1b74d57-a162-4343-afb5-26b3d3eac199 req-aeab4da1-3977-4756-8d50-cdd27863b1a6 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:09.613333 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-f1b74d57-a162-4343-afb5-26b3d3eac199 req-aeab4da1-3977-4756-8d50-cdd27863b1a6 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:09.614544 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-f1b74d57-a162-4343-afb5-26b3d3eac199 req-aeab4da1-3977-4756-8d50-cdd27863b1a6 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:09.649378 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-f1b74d57-a162-4343-afb5-26b3d3eac199 req-aeab4da1-3977-4756-8d50-cdd27863b1a6 service nova] Creating event network-changed:b5a5b9cd-a440-4270-b48f-5816d8d587a8 for instance dad12d7a-a01e-4f91-b35e-4f9f83df5b3b on n-h2-master-1 Oct 23 01:17:09.660099 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-f1b74d57-a162-4343-afb5-26b3d3eac199 req-aeab4da1-3977-4756-8d50-cdd27863b1a6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081279 Oct 23 01:17:09.662545 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 904/1839] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:17:09.679246 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1fa5b682-ec75-40ec-abe2-d4ed2c5829fe tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:09.681072 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1fa5b682-ec75-40ec-abe2-d4ed2c5829fe tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:09.698133 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1fa5b682-ec75-40ec-abe2-d4ed2c5829fe tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:09.699012 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1fa5b682-ec75-40ec-abe2-d4ed2c5829fe tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:09.700966 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1fa5b682-ec75-40ec-abe2-d4ed2c5829fe tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:09.701947 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1fa5b682-ec75-40ec-abe2-d4ed2c5829fe tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:09.705260 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1fa5b682-ec75-40ec-abe2-d4ed2c5829fe tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:09.705934 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1fa5b682-ec75-40ec-abe2-d4ed2c5829fe tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:09.861747 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a9735841-f4af-4d16-bbe1-284e0e6633cb tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:09.876417 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a9735841-f4af-4d16-bbe1-284e0e6633cb tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/0d9df9b8-b177-4adc-bf48-941d99ddf249" status: 200 len: 1317 microversion: 2.1 time: 0.384007 Oct 23 01:17:09.877318 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 936/1840] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:09 2022] GET /compute/v2.1/servers/0d9df9b8-b177-4adc-bf48-941d99ddf249 => generated 1317 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:09.891492 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e2b4472a-7e50-4411-a10a-7a6d8a7fa8de tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:09.892465 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e2b4472a-7e50-4411-a10a-7a6d8a7fa8de tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:09.902650 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e2b4472a-7e50-4411-a10a-7a6d8a7fa8de tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:09.903512 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e2b4472a-7e50-4411-a10a-7a6d8a7fa8de tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:09.906767 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e2b4472a-7e50-4411-a10a-7a6d8a7fa8de tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:09.907805 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e2b4472a-7e50-4411-a10a-7a6d8a7fa8de tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:09.910543 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e2b4472a-7e50-4411-a10a-7a6d8a7fa8de tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:09.911834 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e2b4472a-7e50-4411-a10a-7a6d8a7fa8de tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:09.969217 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1fa5b682-ec75-40ec-abe2-d4ed2c5829fe tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:09.983468 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1fa5b682-ec75-40ec-abe2-d4ed2c5829fe tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:09.985615 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1fa5b682-ec75-40ec-abe2-d4ed2c5829fe tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:09.987490 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1fa5b682-ec75-40ec-abe2-d4ed2c5829fe tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7" status: 200 len: 1815 microversion: 2.25 time: 0.322562 Oct 23 01:17:10.004141 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 905/1841] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:17:09 2022] GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7 => generated 1815 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:17:10.012860 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3e53523c-a819-45fb-91e4-0697e8dd12de tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:10.013692 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3e53523c-a819-45fb-91e4-0697e8dd12de tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:10.023982 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3e53523c-a819-45fb-91e4-0697e8dd12de tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:10.024965 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3e53523c-a819-45fb-91e4-0697e8dd12de tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:10.025708 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3e53523c-a819-45fb-91e4-0697e8dd12de tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:10.026817 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3e53523c-a819-45fb-91e4-0697e8dd12de tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:10.027503 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3e53523c-a819-45fb-91e4-0697e8dd12de tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:10.028149 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3e53523c-a819-45fb-91e4-0697e8dd12de tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:10.216664 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e2b4472a-7e50-4411-a10a-7a6d8a7fa8de tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:10.224471 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e2b4472a-7e50-4411-a10a-7a6d8a7fa8de tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1210 microversion: 2.1 time: 0.345803 Oct 23 01:17:10.227491 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 937/1842] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:09 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1210 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:10.266049 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3e53523c-a819-45fb-91e4-0697e8dd12de tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:10.276789 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3e53523c-a819-45fb-91e4-0697e8dd12de tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1470 microversion: 2.1 time: 0.270263 Oct 23 01:17:10.289811 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 906/1843] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:10 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1470 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:10.406832 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a827f006-0f2c-416d-b0eb-69e1b5480b92 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:10.407568 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a827f006-0f2c-416d-b0eb-69e1b5480b92 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] [instance: 120895a2-d6c4-47f6-a6e4-32cbcf028037] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:10.414957 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a827f006-0f2c-416d-b0eb-69e1b5480b92 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:10.415700 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a827f006-0f2c-416d-b0eb-69e1b5480b92 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:10.416496 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a827f006-0f2c-416d-b0eb-69e1b5480b92 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:10.418110 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a827f006-0f2c-416d-b0eb-69e1b5480b92 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:10.418826 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a827f006-0f2c-416d-b0eb-69e1b5480b92 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:10.419547 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a827f006-0f2c-416d-b0eb-69e1b5480b92 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:10.508838 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fc40604a-7479-458b-b612-02a2bbec2775 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc2573ee0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:10.558931 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a827f006-0f2c-416d-b0eb-69e1b5480b92 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:10.570068 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a827f006-0f2c-416d-b0eb-69e1b5480b92 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:10.572815 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a827f006-0f2c-416d-b0eb-69e1b5480b92 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:10.574698 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a827f006-0f2c-416d-b0eb-69e1b5480b92 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] 10.222.0.42 "GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037" status: 200 len: 1365 microversion: 2.57 time: 0.171977 Oct 23 01:17:10.595301 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 938/1844] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:17:10 2022] GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037 => generated 1365 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:17:10.605225 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fc40604a-7479-458b-b612-02a2bbec2775 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/90d42cdd-cddc-43cd-a2de-f4f225ffb04a" status: 200 len: 1413 microversion: 2.1 time: 0.104273 Oct 23 01:17:10.606790 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 907/1845] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:17:10 2022] GET /compute/v2.1/images/90d42cdd-cddc-43cd-a2de-f4f225ffb04a => generated 1413 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:17:10.613737 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-03aa27e2-93fe-411c-874a-04fa87079b59 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '.version_select at 0x7f5cc23bb3a0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:10.614958 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7f916c7f-5038-4458-87f5-b2bc3c10b045 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:10.616112 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7f916c7f-5038-4458-87f5-b2bc3c10b045 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: bdd228c7-614f-4742-932f-5cb7faf5a68c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:10.629506 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f916c7f-5038-4458-87f5-b2bc3c10b045 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:10.630376 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f916c7f-5038-4458-87f5-b2bc3c10b045 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:10.631011 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f916c7f-5038-4458-87f5-b2bc3c10b045 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:10.631871 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f916c7f-5038-4458-87f5-b2bc3c10b045 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:10.632459 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f916c7f-5038-4458-87f5-b2bc3c10b045 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:10.632894 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f916c7f-5038-4458-87f5-b2bc3c10b045 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:10.652827 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-03aa27e2-93fe-411c-874a-04fa87079b59 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] HTTP exception thrown: Image not found. Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-03aa27e2-93fe-411c-874a-04fa87079b59 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Request method failure captured: Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/images/790f8b89-db93-4eda-b782-3a99ccdd410b HTTP/1.1 Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJWaABlg9aZPPmiKYOFyjnW3cUDNfMTW-9Ow-Ga99e9rhT_Xz0fOPaBTxk-ZvoWH3eiZ84RoqOaVKmH_NPvl5JjsEC9A2dnRRYDDEs3eUATgMIXjceNensPNpeVu874ElZedsjKlwKXnfqakqBoob0ap94r3bfJNgcmUxWbrsNVh5-k Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 1aa3395c4af3435eaa3a0f49e19167fe Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-421844011 Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1aa3395c4af3435eaa3a0f49e19167fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1aa3395c4af3435eaa3a0f49e19167fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1aa3395c4af3435eaa3a0f49e19167fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1aa3395c4af3435eaa3a0f49e19167fe"}]}] Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-421844011 Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 1aa3395c4af3435eaa3a0f49e19167fe Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-421844011 Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ImagesOneServerNegativeTestJSON-421844011-project Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 690143905857471f949b1f4454ad2139 Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-421844011-project Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: method: Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: exception: Image not found. Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '790f8b89-db93-4eda-b782-3a99ccdd410b'} Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 790f8b89-db93-4eda-b782-3a99ccdd410b to delete Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 790f8b89-db93-4eda-b782-3a99ccdd410b could not be found. Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:17:10.655520 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:17:10.660263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:10.660263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:17:10.660263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:17:10.660263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:17:10.660263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:17:10.660263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:17:10.660263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:17:10.660263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:17:10.660263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:17:10.660263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 23 01:17:10.660263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 23 01:17:10.660263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 23 01:17:10.660263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:17:10.660263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:17:10.660263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:17:10.660263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:10.660263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:17:10.660263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:17:10.660263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:17:10.660263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:17:10.660263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 23 01:17:10.660263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:17:10.663555 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-03aa27e2-93fe-411c-874a-04fa87079b59 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Returning 404 to user: Image not found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:17:10.666724 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-03aa27e2-93fe-411c-874a-04fa87079b59 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "DELETE /compute/v2.1/images/790f8b89-db93-4eda-b782-3a99ccdd410b" status: 404 len: 62 microversion: 2.1 time: 0.070187 Oct 23 01:17:10.667706 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 939/1846] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:10 2022] DELETE /compute/v2.1/images/790f8b89-db93-4eda-b782-3a99ccdd410b => generated 62 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:17:10.675432 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e4dc4d59-63f0-4d9d-8265-71e1478d6283 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:10.679587 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e4dc4d59-63f0-4d9d-8265-71e1478d6283 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 291a0671-7bab-404a-b836-95fb7acfd1dd] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:10.695403 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e4dc4d59-63f0-4d9d-8265-71e1478d6283 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:10.696364 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e4dc4d59-63f0-4d9d-8265-71e1478d6283 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:10.697052 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e4dc4d59-63f0-4d9d-8265-71e1478d6283 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:10.698052 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e4dc4d59-63f0-4d9d-8265-71e1478d6283 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:10.698764 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e4dc4d59-63f0-4d9d-8265-71e1478d6283 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:10.699411 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e4dc4d59-63f0-4d9d-8265-71e1478d6283 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:10.721842 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-e4dc4d59-63f0-4d9d-8265-71e1478d6283 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] HTTP exception thrown: Instance 291a0671-7bab-404a-b836-95fb7acfd1dd could not be found. Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e4dc4d59-63f0-4d9d-8265-71e1478d6283 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Request method failure captured: Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd HTTP/1.1 Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJWaABlg9aZPPmiKYOFyjnW3cUDNfMTW-9Ow-Ga99e9rhT_Xz0fOPaBTxk-ZvoWH3eiZ84RoqOaVKmH_NPvl5JjsEC9A2dnRRYDDEs3eUATgMIXjceNensPNpeVu874ElZedsjKlwKXnfqakqBoob0ap94r3bfJNgcmUxWbrsNVh5-k Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 1aa3395c4af3435eaa3a0f49e19167fe Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-421844011 Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1aa3395c4af3435eaa3a0f49e19167fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1aa3395c4af3435eaa3a0f49e19167fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1aa3395c4af3435eaa3a0f49e19167fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1aa3395c4af3435eaa3a0f49e19167fe"}]}] Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-421844011 Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 1aa3395c4af3435eaa3a0f49e19167fe Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-421844011 Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ImagesOneServerNegativeTestJSON-421844011-project Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 690143905857471f949b1f4454ad2139 Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-421844011-project Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 291a0671-7bab-404a-b836-95fb7acfd1dd could not be found. Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '291a0671-7bab-404a-b836-95fb7acfd1dd'} Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 291a0671-7bab-404a-b836-95fb7acfd1dd could not be found. Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:17:10.724640 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:17:10.729034 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 291a0671-7bab-404a-b836-95fb7acfd1dd could not be found. Oct 23 01:17:10.729034 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:17:10.729034 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:17:10.729034 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:17:10.729034 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:10.729034 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:17:10.729034 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:17:10.729034 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:17:10.729034 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:17:10.729034 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 291a0671-7bab-404a-b836-95fb7acfd1dd could not be found. Oct 23 01:17:10.729034 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:17:10.730844 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e4dc4d59-63f0-4d9d-8265-71e1478d6283 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Returning 404 to user: Instance 291a0671-7bab-404a-b836-95fb7acfd1dd could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:17:10.731722 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e4dc4d59-63f0-4d9d-8265-71e1478d6283 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "DELETE /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd" status: 404 len: 111 microversion: 2.1 time: 0.060256 Oct 23 01:17:10.735389 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 940/1847] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:17:10 2022] DELETE /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:17:10.741234 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8786883f-3c40-4f78-b0dc-30b6fe10c5d4 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:10.741938 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8786883f-3c40-4f78-b0dc-30b6fe10c5d4 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] [instance: 291a0671-7bab-404a-b836-95fb7acfd1dd] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:10.751730 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8786883f-3c40-4f78-b0dc-30b6fe10c5d4 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:10.752370 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8786883f-3c40-4f78-b0dc-30b6fe10c5d4 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:10.754280 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8786883f-3c40-4f78-b0dc-30b6fe10c5d4 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:10.755136 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8786883f-3c40-4f78-b0dc-30b6fe10c5d4 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:10.758406 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8786883f-3c40-4f78-b0dc-30b6fe10c5d4 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:10.758936 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8786883f-3c40-4f78-b0dc-30b6fe10c5d4 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:10.788295 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-8786883f-3c40-4f78-b0dc-30b6fe10c5d4 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] HTTP exception thrown: Instance 291a0671-7bab-404a-b836-95fb7acfd1dd could not be found. Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8786883f-3c40-4f78-b0dc-30b6fe10c5d4 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Request method failure captured: Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd HTTP/1.1 Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJWaABlg9aZPPmiKYOFyjnW3cUDNfMTW-9Ow-Ga99e9rhT_Xz0fOPaBTxk-ZvoWH3eiZ84RoqOaVKmH_NPvl5JjsEC9A2dnRRYDDEs3eUATgMIXjceNensPNpeVu874ElZedsjKlwKXnfqakqBoob0ap94r3bfJNgcmUxWbrsNVh5-k Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 1aa3395c4af3435eaa3a0f49e19167fe Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-421844011 Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1aa3395c4af3435eaa3a0f49e19167fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1aa3395c4af3435eaa3a0f49e19167fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1aa3395c4af3435eaa3a0f49e19167fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1aa3395c4af3435eaa3a0f49e19167fe"}]}] Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-421844011 Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 1aa3395c4af3435eaa3a0f49e19167fe Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-421844011 Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ImagesOneServerNegativeTestJSON-421844011-project Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 690143905857471f949b1f4454ad2139 Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-421844011-project Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 291a0671-7bab-404a-b836-95fb7acfd1dd could not be found. Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '291a0671-7bab-404a-b836-95fb7acfd1dd'} Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 291a0671-7bab-404a-b836-95fb7acfd1dd could not be found. Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 291a0671-7bab-404a-b836-95fb7acfd1dd could not be found. Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:17:10.789924 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:17:10.795482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:17:10.795482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:10.795482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:17:10.795482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:17:10.795482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:17:10.795482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:17:10.795482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 291a0671-7bab-404a-b836-95fb7acfd1dd could not be found. Oct 23 01:17:10.795482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:17:10.795482 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8786883f-3c40-4f78-b0dc-30b6fe10c5d4 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] Returning 404 to user: Instance 291a0671-7bab-404a-b836-95fb7acfd1dd could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:17:10.795482 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8786883f-3c40-4f78-b0dc-30b6fe10c5d4 tempest-ImagesOneServerNegativeTestJSON-421844011 tempest-ImagesOneServerNegativeTestJSON-421844011-project] 10.222.0.42 "GET /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd" status: 404 len: 111 microversion: 2.1 time: 0.054950 Oct 23 01:17:10.797732 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 941/1848] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:10 2022] GET /compute/v2.1/servers/291a0671-7bab-404a-b836-95fb7acfd1dd => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:17:10.900785 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-802d6a42-3976-4cc7-9a74-e6bb09c34e15 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:10.901463 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-802d6a42-3976-4cc7-9a74-e6bb09c34e15 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 0d9df9b8-b177-4adc-bf48-941d99ddf249] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:10.912687 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:17:10.915130 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-802d6a42-3976-4cc7-9a74-e6bb09c34e15 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:10.919035 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7f916c7f-5038-4458-87f5-b2bc3c10b045 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9681db3595440a88dacc40393e2e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386d20bba06b48be9a7e51162dc4d814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:10.927659 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7f916c7f-5038-4458-87f5-b2bc3c10b045 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] 10.222.0.42 "GET /compute/v2.1/servers/bdd228c7-614f-4742-932f-5cb7faf5a68c" status: 200 len: 1324 microversion: 2.1 time: 0.319405 Oct 23 01:17:10.928343 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-802d6a42-3976-4cc7-9a74-e6bb09c34e15 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:10.929577 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-802d6a42-3976-4cc7-9a74-e6bb09c34e15 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:10.930469 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-802d6a42-3976-4cc7-9a74-e6bb09c34e15 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:10.931011 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-802d6a42-3976-4cc7-9a74-e6bb09c34e15 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:10.931506 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-802d6a42-3976-4cc7-9a74-e6bb09c34e15 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:10.942087 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 908/1849] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:10 2022] GET /compute/v2.1/servers/bdd228c7-614f-4742-932f-5cb7faf5a68c => generated 1324 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:11.031569 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-628d2766-38b3-4090-a957-a581acbb3b9a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:11.031921 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-628d2766-38b3-4090-a957-a581acbb3b9a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:11.039088 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-628d2766-38b3-4090-a957-a581acbb3b9a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:11.039493 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-628d2766-38b3-4090-a957-a581acbb3b9a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:11.039933 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-628d2766-38b3-4090-a957-a581acbb3b9a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:11.040693 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-628d2766-38b3-4090-a957-a581acbb3b9a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:11.041213 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-628d2766-38b3-4090-a957-a581acbb3b9a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:11.041651 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-628d2766-38b3-4090-a957-a581acbb3b9a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:11.447054 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-802d6a42-3976-4cc7-9a74-e6bb09c34e15 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:11.458353 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-802d6a42-3976-4cc7-9a74-e6bb09c34e15 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/0d9df9b8-b177-4adc-bf48-941d99ddf249" status: 200 len: 1317 microversion: 2.1 time: 0.561275 Oct 23 01:17:11.466332 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 942/1850] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:10 2022] GET /compute/v2.1/servers/0d9df9b8-b177-4adc-bf48-941d99ddf249 => generated 1317 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:11.471252 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0b66fb79-478b-4492-a754-e858b16f0bc2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:11.472113 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0b66fb79-478b-4492-a754-e858b16f0bc2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:11.489122 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b66fb79-478b-4492-a754-e858b16f0bc2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:11.489865 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b66fb79-478b-4492-a754-e858b16f0bc2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:11.490494 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b66fb79-478b-4492-a754-e858b16f0bc2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:11.491613 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b66fb79-478b-4492-a754-e858b16f0bc2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:11.492253 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b66fb79-478b-4492-a754-e858b16f0bc2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:11.492851 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b66fb79-478b-4492-a754-e858b16f0bc2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:11.632693 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-628d2766-38b3-4090-a957-a581acbb3b9a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:11.649407 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-628d2766-38b3-4090-a957-a581acbb3b9a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:11.654149 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-628d2766-38b3-4090-a957-a581acbb3b9a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:11.656305 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-628d2766-38b3-4090-a957-a581acbb3b9a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7" status: 200 len: 1815 microversion: 2.25 time: 0.628980 Oct 23 01:17:11.656859 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 909/1851] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:17:11 2022] GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7 => generated 1815 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:17:11.675838 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-39455e71-fe01-4efc-810e-c3bf55a73b67 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:11.677212 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-39455e71-fe01-4efc-810e-c3bf55a73b67 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:11.690685 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-39455e71-fe01-4efc-810e-c3bf55a73b67 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:11.694126 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-39455e71-fe01-4efc-810e-c3bf55a73b67 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:11.696927 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-39455e71-fe01-4efc-810e-c3bf55a73b67 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:11.699582 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-39455e71-fe01-4efc-810e-c3bf55a73b67 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:11.701759 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-39455e71-fe01-4efc-810e-c3bf55a73b67 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:11.702456 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-39455e71-fe01-4efc-810e-c3bf55a73b67 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:11.784767 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0b66fb79-478b-4492-a754-e858b16f0bc2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:11.800139 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0b66fb79-478b-4492-a754-e858b16f0bc2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1210 microversion: 2.1 time: 0.326629 Oct 23 01:17:11.803487 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 943/1852] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:11 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1210 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:11.812320 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-96abb8f2-3c54-492d-a7d5-87fa6b68d0ad tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:11.816189 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-96abb8f2-3c54-492d-a7d5-87fa6b68d0ad tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] [instance: 120895a2-d6c4-47f6-a6e4-32cbcf028037] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:11.839336 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-96abb8f2-3c54-492d-a7d5-87fa6b68d0ad tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:11.841109 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-96abb8f2-3c54-492d-a7d5-87fa6b68d0ad tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:11.841109 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-96abb8f2-3c54-492d-a7d5-87fa6b68d0ad tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:11.844842 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-96abb8f2-3c54-492d-a7d5-87fa6b68d0ad tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:11.845747 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-96abb8f2-3c54-492d-a7d5-87fa6b68d0ad tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:11.846600 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-96abb8f2-3c54-492d-a7d5-87fa6b68d0ad tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:12.068127 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-96abb8f2-3c54-492d-a7d5-87fa6b68d0ad tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:12.096081 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-96abb8f2-3c54-492d-a7d5-87fa6b68d0ad tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:12.104216 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-96abb8f2-3c54-492d-a7d5-87fa6b68d0ad tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:12.104216 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-96abb8f2-3c54-492d-a7d5-87fa6b68d0ad tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] 10.222.0.42 "GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037" status: 200 len: 1365 microversion: 2.57 time: 0.297576 Oct 23 01:17:12.105937 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 944/1853] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:17:11 2022] GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037 => generated 1365 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:17:12.115364 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-23aa8708-ca95-40f2-aeb6-e84694c79ecb tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc6335ee0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:12.185481 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-23aa8708-ca95-40f2-aeb6-e84694c79ecb tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/90d42cdd-cddc-43cd-a2de-f4f225ffb04a" status: 200 len: 1413 microversion: 2.1 time: 0.078175 Oct 23 01:17:12.186805 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 945/1854] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:17:12 2022] GET /compute/v2.1/images/90d42cdd-cddc-43cd-a2de-f4f225ffb04a => generated 1413 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:12.192953 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-e93edc38-21de-48fa-9110-4c2870e9dbb1 req-df3d8742-0237-4308-bbe8-8f83c5664426 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d9df9b8-b177-4adc-bf48-941d99ddf249", "name": "network-vif-plugged", "status": "completed", "tag": "0f5fc56f-c5f4-491f-8b04-9bf4c9867de9"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:17:12.204506 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-e93edc38-21de-48fa-9110-4c2870e9dbb1 req-df3d8742-0237-4308-bbe8-8f83c5664426 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:12.205370 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-e93edc38-21de-48fa-9110-4c2870e9dbb1 req-df3d8742-0237-4308-bbe8-8f83c5664426 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:12.206541 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-e93edc38-21de-48fa-9110-4c2870e9dbb1 req-df3d8742-0237-4308-bbe8-8f83c5664426 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:12.223335 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-e93edc38-21de-48fa-9110-4c2870e9dbb1 req-df3d8742-0237-4308-bbe8-8f83c5664426 service nova] Creating event network-vif-plugged:0f5fc56f-c5f4-491f-8b04-9bf4c9867de9 for instance 0d9df9b8-b177-4adc-bf48-941d99ddf249 on n-h2-master-1 Oct 23 01:17:12.225608 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-39455e71-fe01-4efc-810e-c3bf55a73b67 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:12.229266 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-e93edc38-21de-48fa-9110-4c2870e9dbb1 req-df3d8742-0237-4308-bbe8-8f83c5664426 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040804 Oct 23 01:17:12.233458 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 946/1855] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:17:12.234587 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-39455e71-fe01-4efc-810e-c3bf55a73b67 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1470 microversion: 2.1 time: 0.572746 Oct 23 01:17:12.235159 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 910/1856] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:11 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1470 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:12.242891 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-22f622eb-f5fe-469f-a3e8-c96557f48829 req-f10eaa84-7202-4d9a-b733-a3d9432f063a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff95f7f4-2b30-4083-8643-3f9b1d203d02", "tag": "c2891809-9683-41d8-8d60-11982de58178"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:17:12.243045 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-79e0ebeb-65b7-4173-91eb-06126ebecce2 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:12.243681 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-79e0ebeb-65b7-4173-91eb-06126ebecce2 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: bdd228c7-614f-4742-932f-5cb7faf5a68c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:12.250014 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-79e0ebeb-65b7-4173-91eb-06126ebecce2 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:12.250571 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-79e0ebeb-65b7-4173-91eb-06126ebecce2 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:12.258212 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-22f622eb-f5fe-469f-a3e8-c96557f48829 req-f10eaa84-7202-4d9a-b733-a3d9432f063a service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:12.259160 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-22f622eb-f5fe-469f-a3e8-c96557f48829 req-f10eaa84-7202-4d9a-b733-a3d9432f063a service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:12.259959 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-22f622eb-f5fe-469f-a3e8-c96557f48829 req-f10eaa84-7202-4d9a-b733-a3d9432f063a service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:12.261358 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-79e0ebeb-65b7-4173-91eb-06126ebecce2 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:12.262215 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-79e0ebeb-65b7-4173-91eb-06126ebecce2 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:12.262704 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-79e0ebeb-65b7-4173-91eb-06126ebecce2 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:12.263146 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-79e0ebeb-65b7-4173-91eb-06126ebecce2 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:12.278896 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-22f622eb-f5fe-469f-a3e8-c96557f48829 req-f10eaa84-7202-4d9a-b733-a3d9432f063a service nova] Creating event network-changed:c2891809-9683-41d8-8d60-11982de58178 for instance ff95f7f4-2b30-4083-8643-3f9b1d203d02 on n-h2-master-1 Oct 23 01:17:12.286869 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [req-22f622eb-f5fe-469f-a3e8-c96557f48829 req-f10eaa84-7202-4d9a-b733-a3d9432f063a service nova] Instance ff95f7f4-2b30-4083-8643-3f9b1d203d02 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120945) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 23 01:17:12.316944 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-22f622eb-f5fe-469f-a3e8-c96557f48829 req-f10eaa84-7202-4d9a-b733-a3d9432f063a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081629 Oct 23 01:17:12.321835 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 947/1857] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:17:12.500765 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a2e21b37-afcc-4554-8ccd-6b8afbd3ca79 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:12.501492 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a2e21b37-afcc-4554-8ccd-6b8afbd3ca79 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 0d9df9b8-b177-4adc-bf48-941d99ddf249] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:12.519785 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a2e21b37-afcc-4554-8ccd-6b8afbd3ca79 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:12.521228 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a2e21b37-afcc-4554-8ccd-6b8afbd3ca79 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:12.521859 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a2e21b37-afcc-4554-8ccd-6b8afbd3ca79 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:12.524727 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a2e21b37-afcc-4554-8ccd-6b8afbd3ca79 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:12.527458 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a2e21b37-afcc-4554-8ccd-6b8afbd3ca79 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:12.529927 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a2e21b37-afcc-4554-8ccd-6b8afbd3ca79 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:12.717496 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-79e0ebeb-65b7-4173-91eb-06126ebecce2 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9681db3595440a88dacc40393e2e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386d20bba06b48be9a7e51162dc4d814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:12.728869 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-79e0ebeb-65b7-4173-91eb-06126ebecce2 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] 10.222.0.42 "GET /compute/v2.1/servers/bdd228c7-614f-4742-932f-5cb7faf5a68c" status: 200 len: 1324 microversion: 2.1 time: 0.492656 Oct 23 01:17:12.730639 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 911/1858] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:12 2022] GET /compute/v2.1/servers/bdd228c7-614f-4742-932f-5cb7faf5a68c => generated 1324 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:12.743026 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2b81d6bd-6dc8-4640-b64d-4ff1dc1e6144 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:12.747491 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2b81d6bd-6dc8-4640-b64d-4ff1dc1e6144 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:12.792728 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2b81d6bd-6dc8-4640-b64d-4ff1dc1e6144 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:12.797699 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2b81d6bd-6dc8-4640-b64d-4ff1dc1e6144 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:12.803922 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2b81d6bd-6dc8-4640-b64d-4ff1dc1e6144 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:12.804972 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2b81d6bd-6dc8-4640-b64d-4ff1dc1e6144 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:12.805617 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2b81d6bd-6dc8-4640-b64d-4ff1dc1e6144 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:12.807691 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2b81d6bd-6dc8-4640-b64d-4ff1dc1e6144 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:12.812810 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a2e21b37-afcc-4554-8ccd-6b8afbd3ca79 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:12.825548 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a2e21b37-afcc-4554-8ccd-6b8afbd3ca79 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/0d9df9b8-b177-4adc-bf48-941d99ddf249" status: 200 len: 1317 microversion: 2.1 time: 0.341849 Oct 23 01:17:12.826799 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 948/1859] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:12 2022] GET /compute/v2.1/servers/0d9df9b8-b177-4adc-bf48-941d99ddf249 => generated 1317 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:12.832454 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4024d4e7-22a0-4922-b90a-e092b111fc95 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:12.833314 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4024d4e7-22a0-4922-b90a-e092b111fc95 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:12.840145 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4024d4e7-22a0-4922-b90a-e092b111fc95 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:12.840839 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4024d4e7-22a0-4922-b90a-e092b111fc95 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:12.841913 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4024d4e7-22a0-4922-b90a-e092b111fc95 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:12.843359 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4024d4e7-22a0-4922-b90a-e092b111fc95 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:12.843984 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4024d4e7-22a0-4922-b90a-e092b111fc95 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:12.844568 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4024d4e7-22a0-4922-b90a-e092b111fc95 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:13.169391 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4024d4e7-22a0-4922-b90a-e092b111fc95 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:13.184203 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4024d4e7-22a0-4922-b90a-e092b111fc95 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1210 microversion: 2.1 time: 0.355975 Oct 23 01:17:13.189171 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 949/1860] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:12 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1210 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:13.198485 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a9d98b96-8e24-477a-93b4-05381e1cf28f tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:13.199668 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a9d98b96-8e24-477a-93b4-05381e1cf28f tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] [instance: 120895a2-d6c4-47f6-a6e4-32cbcf028037] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:13.217929 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9d98b96-8e24-477a-93b4-05381e1cf28f tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:13.219844 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9d98b96-8e24-477a-93b4-05381e1cf28f tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:13.220451 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9d98b96-8e24-477a-93b4-05381e1cf28f tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:13.222228 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9d98b96-8e24-477a-93b4-05381e1cf28f tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:13.227471 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9d98b96-8e24-477a-93b4-05381e1cf28f tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:13.228237 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9d98b96-8e24-477a-93b4-05381e1cf28f tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:13.282934 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2b81d6bd-6dc8-4640-b64d-4ff1dc1e6144 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:13.296073 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2b81d6bd-6dc8-4640-b64d-4ff1dc1e6144 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:13.305960 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2b81d6bd-6dc8-4640-b64d-4ff1dc1e6144 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:13.309710 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2b81d6bd-6dc8-4640-b64d-4ff1dc1e6144 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7" status: 200 len: 1815 microversion: 2.25 time: 0.573900 Oct 23 01:17:13.311842 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 912/1861] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:17:12 2022] GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7 => generated 1815 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:17:13.325177 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-09beee7a-1fcf-474e-a7ef-f8ba5e394959 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc19c4700>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:13.438348 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a9d98b96-8e24-477a-93b4-05381e1cf28f tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:13.454970 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a9d98b96-8e24-477a-93b4-05381e1cf28f tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:13.470837 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-09beee7a-1fcf-474e-a7ef-f8ba5e394959 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/90d42cdd-cddc-43cd-a2de-f4f225ffb04a" status: 200 len: 1413 microversion: 2.1 time: 0.154876 Oct 23 01:17:13.472332 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 913/1862] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:17:13 2022] GET /compute/v2.1/images/90d42cdd-cddc-43cd-a2de-f4f225ffb04a => generated 1413 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:13.480688 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a9d98b96-8e24-477a-93b4-05381e1cf28f tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:13.484279 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a9d98b96-8e24-477a-93b4-05381e1cf28f tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] 10.222.0.42 "GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037" status: 200 len: 1365 microversion: 2.57 time: 0.292333 Oct 23 01:17:13.486355 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 950/1863] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:17:13 2022] GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037 => generated 1365 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:17:13.490293 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-521522af-e94e-42d8-bc83-b77f45e6a784 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:13.498864 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-521522af-e94e-42d8-bc83-b77f45e6a784 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:13.509741 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-521522af-e94e-42d8-bc83-b77f45e6a784 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:13.510434 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-521522af-e94e-42d8-bc83-b77f45e6a784 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:13.511140 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-521522af-e94e-42d8-bc83-b77f45e6a784 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:13.511979 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-521522af-e94e-42d8-bc83-b77f45e6a784 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:13.512591 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-521522af-e94e-42d8-bc83-b77f45e6a784 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:13.513126 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-521522af-e94e-42d8-bc83-b77f45e6a784 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:13.754570 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-afda6d33-7bbd-4bf4-a667-51f122ae3602 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:13.755321 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-afda6d33-7bbd-4bf4-a667-51f122ae3602 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: bdd228c7-614f-4742-932f-5cb7faf5a68c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:13.766951 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-afda6d33-7bbd-4bf4-a667-51f122ae3602 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:13.768432 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-afda6d33-7bbd-4bf4-a667-51f122ae3602 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:13.769141 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-afda6d33-7bbd-4bf4-a667-51f122ae3602 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:13.770661 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-afda6d33-7bbd-4bf4-a667-51f122ae3602 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:13.771415 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-afda6d33-7bbd-4bf4-a667-51f122ae3602 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:13.772690 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-afda6d33-7bbd-4bf4-a667-51f122ae3602 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:13.786411 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-521522af-e94e-42d8-bc83-b77f45e6a784 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:13.799178 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-521522af-e94e-42d8-bc83-b77f45e6a784 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1470 microversion: 2.1 time: 0.326449 Oct 23 01:17:13.802647 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 914/1864] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:13 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1470 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:13.849279 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-62b03fea-dc49-4496-ac6f-43057b535a13 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:13.851794 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-62b03fea-dc49-4496-ac6f-43057b535a13 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 0d9df9b8-b177-4adc-bf48-941d99ddf249] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:13.872718 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-62b03fea-dc49-4496-ac6f-43057b535a13 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:13.875765 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-62b03fea-dc49-4496-ac6f-43057b535a13 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:13.876495 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-62b03fea-dc49-4496-ac6f-43057b535a13 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:13.877466 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-62b03fea-dc49-4496-ac6f-43057b535a13 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:13.880584 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-62b03fea-dc49-4496-ac6f-43057b535a13 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:13.888541 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-62b03fea-dc49-4496-ac6f-43057b535a13 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:13.994223 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-afda6d33-7bbd-4bf4-a667-51f122ae3602 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9681db3595440a88dacc40393e2e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386d20bba06b48be9a7e51162dc4d814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:14.010570 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-afda6d33-7bbd-4bf4-a667-51f122ae3602 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] 10.222.0.42 "GET /compute/v2.1/servers/bdd228c7-614f-4742-932f-5cb7faf5a68c" status: 200 len: 1324 microversion: 2.1 time: 0.260374 Oct 23 01:17:14.011161 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 951/1865] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:13 2022] GET /compute/v2.1/servers/bdd228c7-614f-4742-932f-5cb7faf5a68c => generated 1324 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:17:14.108431 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-62b03fea-dc49-4496-ac6f-43057b535a13 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:14.117547 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-62b03fea-dc49-4496-ac6f-43057b535a13 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/0d9df9b8-b177-4adc-bf48-941d99ddf249" status: 200 len: 1317 microversion: 2.1 time: 0.272739 Oct 23 01:17:14.118485 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 915/1866] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:13 2022] GET /compute/v2.1/servers/0d9df9b8-b177-4adc-bf48-941d99ddf249 => generated 1317 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:17:14.216980 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-499f7bda-b67d-4d8a-b71a-2389727f77fd tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:14.217607 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-499f7bda-b67d-4d8a-b71a-2389727f77fd tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:14.227459 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-499f7bda-b67d-4d8a-b71a-2389727f77fd tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:14.227952 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-499f7bda-b67d-4d8a-b71a-2389727f77fd tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:14.228386 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-499f7bda-b67d-4d8a-b71a-2389727f77fd tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:14.229085 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-499f7bda-b67d-4d8a-b71a-2389727f77fd tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:14.229534 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-499f7bda-b67d-4d8a-b71a-2389727f77fd tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:14.229951 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-499f7bda-b67d-4d8a-b71a-2389727f77fd tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:14.287287 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=100 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:17:14.290901 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-c0b705c5-a650-4e6a-96c5-f7648963ce3d req-7c38869c-4d76-47c4-89f3-2f556dd051df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fc07c10-f37b-4374-bcc0-25793b180d9c", "name": "network-vif-plugged", "status": "completed", "tag": "bedfc922-9657-4f3f-8344-e550f8d72082"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:17:14.326955 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-c0b705c5-a650-4e6a-96c5-f7648963ce3d req-7c38869c-4d76-47c4-89f3-2f556dd051df service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:14.333882 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-c0b705c5-a650-4e6a-96c5-f7648963ce3d req-7c38869c-4d76-47c4-89f3-2f556dd051df service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:14.336469 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-c0b705c5-a650-4e6a-96c5-f7648963ce3d req-7c38869c-4d76-47c4-89f3-2f556dd051df service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:14.387081 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-c0b705c5-a650-4e6a-96c5-f7648963ce3d req-7c38869c-4d76-47c4-89f3-2f556dd051df service nova] Creating event network-vif-plugged:bedfc922-9657-4f3f-8344-e550f8d72082 for instance 7fc07c10-f37b-4374-bcc0-25793b180d9c on n-h1-master-1 Oct 23 01:17:14.404379 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-c0b705c5-a650-4e6a-96c5-f7648963ce3d req-7c38869c-4d76-47c4-89f3-2f556dd051df service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119568 Oct 23 01:17:14.405157 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 916/1867] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:17:14.421115 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c51177a7-14b3-497a-8650-f76eb72c1c8e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:14.421840 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c51177a7-14b3-497a-8650-f76eb72c1c8e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:14.434692 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c51177a7-14b3-497a-8650-f76eb72c1c8e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:14.435191 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c51177a7-14b3-497a-8650-f76eb72c1c8e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:14.435702 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c51177a7-14b3-497a-8650-f76eb72c1c8e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:14.436478 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c51177a7-14b3-497a-8650-f76eb72c1c8e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:14.436879 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c51177a7-14b3-497a-8650-f76eb72c1c8e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:14.437304 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c51177a7-14b3-497a-8650-f76eb72c1c8e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:14.535464 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-499f7bda-b67d-4d8a-b71a-2389727f77fd tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:14.568792 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-499f7bda-b67d-4d8a-b71a-2389727f77fd tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1210 microversion: 2.1 time: 0.356231 Oct 23 01:17:14.572052 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 952/1868] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:14 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1210 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:14.584825 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f15fb3a6-1564-4344-b173-44ce6d6cdabd tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc6335820>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:14.667793 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f15fb3a6-1564-4344-b173-44ce6d6cdabd tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/90d42cdd-cddc-43cd-a2de-f4f225ffb04a" status: 200 len: 1413 microversion: 2.1 time: 0.092833 Oct 23 01:17:14.668395 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 953/1869] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:17:14 2022] GET /compute/v2.1/images/90d42cdd-cddc-43cd-a2de-f4f225ffb04a => generated 1413 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:14.684658 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1acd8cb2-fb28-4a27-aa24-68bb31205df3 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:14.695071 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1acd8cb2-fb28-4a27-aa24-68bb31205df3 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] [instance: 120895a2-d6c4-47f6-a6e4-32cbcf028037] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:14.706866 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1acd8cb2-fb28-4a27-aa24-68bb31205df3 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:14.709663 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1acd8cb2-fb28-4a27-aa24-68bb31205df3 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:14.710380 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1acd8cb2-fb28-4a27-aa24-68bb31205df3 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:14.711320 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1acd8cb2-fb28-4a27-aa24-68bb31205df3 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:14.713378 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c51177a7-14b3-497a-8650-f76eb72c1c8e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:14.713566 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1acd8cb2-fb28-4a27-aa24-68bb31205df3 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:14.714909 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1acd8cb2-fb28-4a27-aa24-68bb31205df3 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:14.724643 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c51177a7-14b3-497a-8650-f76eb72c1c8e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:14.729624 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c51177a7-14b3-497a-8650-f76eb72c1c8e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:14.730090 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c51177a7-14b3-497a-8650-f76eb72c1c8e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7" status: 200 len: 1815 microversion: 2.25 time: 0.321885 Oct 23 01:17:14.731276 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 917/1870] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:17:14 2022] GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7 => generated 1815 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:17:14.827620 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9f94b38b-07e8-48a9-916f-0b7f319d8b8b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:14.828304 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9f94b38b-07e8-48a9-916f-0b7f319d8b8b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:14.838954 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1acd8cb2-fb28-4a27-aa24-68bb31205df3 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:14.843225 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f94b38b-07e8-48a9-916f-0b7f319d8b8b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:14.843967 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f94b38b-07e8-48a9-916f-0b7f319d8b8b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:14.844603 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f94b38b-07e8-48a9-916f-0b7f319d8b8b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:14.845485 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f94b38b-07e8-48a9-916f-0b7f319d8b8b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:14.846216 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f94b38b-07e8-48a9-916f-0b7f319d8b8b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:14.846809 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f94b38b-07e8-48a9-916f-0b7f319d8b8b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:14.848271 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1acd8cb2-fb28-4a27-aa24-68bb31205df3 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:14.854600 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1acd8cb2-fb28-4a27-aa24-68bb31205df3 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:14.856052 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1acd8cb2-fb28-4a27-aa24-68bb31205df3 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] 10.222.0.42 "GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037" status: 200 len: 1365 microversion: 2.57 time: 0.185052 Oct 23 01:17:14.857033 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 954/1871] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:17:14 2022] GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037 => generated 1365 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:17:15.039949 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-528098b6-03d1-4497-ad44-f9ed65b6b5e7 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:15.040795 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-528098b6-03d1-4497-ad44-f9ed65b6b5e7 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: bdd228c7-614f-4742-932f-5cb7faf5a68c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:15.053649 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-528098b6-03d1-4497-ad44-f9ed65b6b5e7 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:15.056170 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-528098b6-03d1-4497-ad44-f9ed65b6b5e7 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:15.056632 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-528098b6-03d1-4497-ad44-f9ed65b6b5e7 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:15.059070 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-528098b6-03d1-4497-ad44-f9ed65b6b5e7 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:15.060682 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-528098b6-03d1-4497-ad44-f9ed65b6b5e7 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:15.061131 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-528098b6-03d1-4497-ad44-f9ed65b6b5e7 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:15.095255 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9f94b38b-07e8-48a9-916f-0b7f319d8b8b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:15.104545 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9f94b38b-07e8-48a9-916f-0b7f319d8b8b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1470 microversion: 2.1 time: 0.280768 Oct 23 01:17:15.123372 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 918/1872] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:14 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1470 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:17:15.144029 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f2a7f78b-c0ce-47b0-a2e1-f6b954d3c954 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:15.145329 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f2a7f78b-c0ce-47b0-a2e1-f6b954d3c954 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 0d9df9b8-b177-4adc-bf48-941d99ddf249] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:15.152923 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2a7f78b-c0ce-47b0-a2e1-f6b954d3c954 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:15.154540 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2a7f78b-c0ce-47b0-a2e1-f6b954d3c954 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:15.154993 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2a7f78b-c0ce-47b0-a2e1-f6b954d3c954 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:15.155721 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2a7f78b-c0ce-47b0-a2e1-f6b954d3c954 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:15.156187 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2a7f78b-c0ce-47b0-a2e1-f6b954d3c954 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:15.157148 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2a7f78b-c0ce-47b0-a2e1-f6b954d3c954 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:15.342826 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-528098b6-03d1-4497-ad44-f9ed65b6b5e7 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9681db3595440a88dacc40393e2e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386d20bba06b48be9a7e51162dc4d814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:15.356025 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-528098b6-03d1-4497-ad44-f9ed65b6b5e7 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] 10.222.0.42 "GET /compute/v2.1/servers/bdd228c7-614f-4742-932f-5cb7faf5a68c" status: 200 len: 1324 microversion: 2.1 time: 0.321470 Oct 23 01:17:15.358076 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 955/1873] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:15 2022] GET /compute/v2.1/servers/bdd228c7-614f-4742-932f-5cb7faf5a68c => generated 1324 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:17:15.447471 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f2a7f78b-c0ce-47b0-a2e1-f6b954d3c954 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:15.458501 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f2a7f78b-c0ce-47b0-a2e1-f6b954d3c954 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/0d9df9b8-b177-4adc-bf48-941d99ddf249" status: 200 len: 1317 microversion: 2.1 time: 0.318925 Oct 23 01:17:15.459624 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 919/1874] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:15 2022] GET /compute/v2.1/servers/0d9df9b8-b177-4adc-bf48-941d99ddf249 => generated 1317 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:15.595918 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-22ba0423-991b-45ca-987e-10e8ba57484b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:15.597147 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-22ba0423-991b-45ca-987e-10e8ba57484b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:15.606291 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-22ba0423-991b-45ca-987e-10e8ba57484b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:15.607188 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-22ba0423-991b-45ca-987e-10e8ba57484b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:15.608243 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-22ba0423-991b-45ca-987e-10e8ba57484b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:15.615769 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-22ba0423-991b-45ca-987e-10e8ba57484b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:15.616945 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-22ba0423-991b-45ca-987e-10e8ba57484b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:15.617605 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-22ba0423-991b-45ca-987e-10e8ba57484b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:15.683767 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-81fd28c8-0ba2-47bb-8afc-6d0e041e691b tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc273b790>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:15.785144 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-81fd28c8-0ba2-47bb-8afc-6d0e041e691b tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/90d42cdd-cddc-43cd-a2de-f4f225ffb04a" status: 200 len: 1413 microversion: 2.1 time: 0.105598 Oct 23 01:17:15.786285 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 920/1875] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:17:15 2022] GET /compute/v2.1/images/90d42cdd-cddc-43cd-a2de-f4f225ffb04a => generated 1413 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:17:15.811375 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7632a226-e60d-4342-afc0-0c4c17eff69e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:15.814043 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7632a226-e60d-4342-afc0-0c4c17eff69e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:15.825554 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7632a226-e60d-4342-afc0-0c4c17eff69e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:15.828642 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7632a226-e60d-4342-afc0-0c4c17eff69e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:15.829770 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7632a226-e60d-4342-afc0-0c4c17eff69e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:15.831478 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7632a226-e60d-4342-afc0-0c4c17eff69e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:15.831478 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7632a226-e60d-4342-afc0-0c4c17eff69e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:15.834510 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7632a226-e60d-4342-afc0-0c4c17eff69e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:15.840912 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=100 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:17:15.975778 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-22ba0423-991b-45ca-987e-10e8ba57484b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:15.991259 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-22ba0423-991b-45ca-987e-10e8ba57484b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1210 microversion: 2.1 time: 0.398995 Oct 23 01:17:15.992836 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 956/1876] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:15 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1210 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:17:15.998533 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-596093f7-c459-49aa-a36a-5c549383e7d7 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:15.999142 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-596093f7-c459-49aa-a36a-5c549383e7d7 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] [instance: 120895a2-d6c4-47f6-a6e4-32cbcf028037] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:16.026706 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-596093f7-c459-49aa-a36a-5c549383e7d7 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:16.027217 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-596093f7-c459-49aa-a36a-5c549383e7d7 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:16.027748 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-596093f7-c459-49aa-a36a-5c549383e7d7 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:16.028768 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-596093f7-c459-49aa-a36a-5c549383e7d7 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:16.029163 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-596093f7-c459-49aa-a36a-5c549383e7d7 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:16.029696 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-596093f7-c459-49aa-a36a-5c549383e7d7 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:16.076790 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7632a226-e60d-4342-afc0-0c4c17eff69e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:16.091669 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7632a226-e60d-4342-afc0-0c4c17eff69e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:16.114236 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7632a226-e60d-4342-afc0-0c4c17eff69e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:16.114236 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7632a226-e60d-4342-afc0-0c4c17eff69e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7" status: 200 len: 1815 microversion: 2.25 time: 0.308845 Oct 23 01:17:16.114236 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 921/1877] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:17:15 2022] GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7 => generated 1815 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:17:16.141667 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-25c2cd2c-11c3-4be0-b670-d8a895f82162 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:16.146356 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-25c2cd2c-11c3-4be0-b670-d8a895f82162 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:16.161107 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25c2cd2c-11c3-4be0-b670-d8a895f82162 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:16.164518 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25c2cd2c-11c3-4be0-b670-d8a895f82162 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:16.166465 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25c2cd2c-11c3-4be0-b670-d8a895f82162 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:16.167647 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25c2cd2c-11c3-4be0-b670-d8a895f82162 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:16.177133 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25c2cd2c-11c3-4be0-b670-d8a895f82162 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:16.178397 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25c2cd2c-11c3-4be0-b670-d8a895f82162 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:16.188252 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-596093f7-c459-49aa-a36a-5c549383e7d7 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:16.197404 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-596093f7-c459-49aa-a36a-5c549383e7d7 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:16.209935 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-596093f7-c459-49aa-a36a-5c549383e7d7 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:16.217712 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-596093f7-c459-49aa-a36a-5c549383e7d7 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] 10.222.0.42 "GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037" status: 200 len: 1365 microversion: 2.57 time: 0.217678 Oct 23 01:17:16.217712 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 957/1878] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:17:15 2022] GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037 => generated 1365 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:17:16.380863 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7a7bcfc4-7961-408f-a5e6-a929dfd953ee tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:16.385220 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7a7bcfc4-7961-408f-a5e6-a929dfd953ee tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: bdd228c7-614f-4742-932f-5cb7faf5a68c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:16.388603 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a7bcfc4-7961-408f-a5e6-a929dfd953ee tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:16.389437 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a7bcfc4-7961-408f-a5e6-a929dfd953ee tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:16.389576 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a7bcfc4-7961-408f-a5e6-a929dfd953ee tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:16.390260 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a7bcfc4-7961-408f-a5e6-a929dfd953ee tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:16.391064 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a7bcfc4-7961-408f-a5e6-a929dfd953ee tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:16.391211 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a7bcfc4-7961-408f-a5e6-a929dfd953ee tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:16.420763 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-25c2cd2c-11c3-4be0-b670-d8a895f82162 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:16.479258 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-25c2cd2c-11c3-4be0-b670-d8a895f82162 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1470 microversion: 2.1 time: 0.346429 Oct 23 01:17:16.510086 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 922/1879] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:16 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1470 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:16.514896 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bca1e28a-5abb-4745-95d8-3295f7c4c4a2 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:16.514896 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bca1e28a-5abb-4745-95d8-3295f7c4c4a2 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 0d9df9b8-b177-4adc-bf48-941d99ddf249] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:16.527135 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bca1e28a-5abb-4745-95d8-3295f7c4c4a2 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:16.527806 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bca1e28a-5abb-4745-95d8-3295f7c4c4a2 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:16.528313 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bca1e28a-5abb-4745-95d8-3295f7c4c4a2 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:16.533544 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bca1e28a-5abb-4745-95d8-3295f7c4c4a2 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:16.535018 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bca1e28a-5abb-4745-95d8-3295f7c4c4a2 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:16.538697 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bca1e28a-5abb-4745-95d8-3295f7c4c4a2 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:17.680698 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bca1e28a-5abb-4745-95d8-3295f7c4c4a2 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:17.692379 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bca1e28a-5abb-4745-95d8-3295f7c4c4a2 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/0d9df9b8-b177-4adc-bf48-941d99ddf249" status: 200 len: 1317 microversion: 2.1 time: 1.193654 Oct 23 01:17:17.697084 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 923/1880] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:16 2022] GET /compute/v2.1/servers/0d9df9b8-b177-4adc-bf48-941d99ddf249 => generated 1317 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:17.702140 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-f09d65e3-9202-4210-bc00-531b46667aa8 req-ef835ae1-c09b-41a7-8beb-dc68c73c0e82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdd228c7-614f-4742-932f-5cb7faf5a68c", "name": "network-vif-plugged", "status": "completed", "tag": "8eb58394-2229-4f50-8d19-48d755a79f37"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:17:17.707000 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7a7bcfc4-7961-408f-a5e6-a929dfd953ee tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9681db3595440a88dacc40393e2e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386d20bba06b48be9a7e51162dc4d814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:17.716210 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-f09d65e3-9202-4210-bc00-531b46667aa8 req-ef835ae1-c09b-41a7-8beb-dc68c73c0e82 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:17.722179 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-f09d65e3-9202-4210-bc00-531b46667aa8 req-ef835ae1-c09b-41a7-8beb-dc68c73c0e82 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:17.722179 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-f09d65e3-9202-4210-bc00-531b46667aa8 req-ef835ae1-c09b-41a7-8beb-dc68c73c0e82 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:17.722510 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7a7bcfc4-7961-408f-a5e6-a929dfd953ee tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] 10.222.0.42 "GET /compute/v2.1/servers/bdd228c7-614f-4742-932f-5cb7faf5a68c" status: 200 len: 1324 microversion: 2.1 time: 1.342303 Oct 23 01:17:17.722736 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 958/1881] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:16 2022] GET /compute/v2.1/servers/bdd228c7-614f-4742-932f-5cb7faf5a68c => generated 1324 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:17.756820 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-339d2d89-24b3-4ac8-84e6-18050c1e14df tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc631f550>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:17.774562 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-f09d65e3-9202-4210-bc00-531b46667aa8 req-ef835ae1-c09b-41a7-8beb-dc68c73c0e82 service nova] Creating event network-vif-plugged:8eb58394-2229-4f50-8d19-48d755a79f37 for instance bdd228c7-614f-4742-932f-5cb7faf5a68c on n-h2-master-1 Oct 23 01:17:17.786859 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-f09d65e3-9202-4210-bc00-531b46667aa8 req-ef835ae1-c09b-41a7-8beb-dc68c73c0e82 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087579 Oct 23 01:17:17.791333 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 924/1882] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:17:17.799505 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e5da6786-2dcc-4023-be67-4142ecb9a4cc tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:17.800473 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e5da6786-2dcc-4023-be67-4142ecb9a4cc tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:17.830800 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e5da6786-2dcc-4023-be67-4142ecb9a4cc tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:17.835476 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e5da6786-2dcc-4023-be67-4142ecb9a4cc tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:17.836022 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e5da6786-2dcc-4023-be67-4142ecb9a4cc tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:17.837275 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e5da6786-2dcc-4023-be67-4142ecb9a4cc tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:17.837275 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e5da6786-2dcc-4023-be67-4142ecb9a4cc tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:17.837661 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e5da6786-2dcc-4023-be67-4142ecb9a4cc tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:17.851552 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-339d2d89-24b3-4ac8-84e6-18050c1e14df tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/90d42cdd-cddc-43cd-a2de-f4f225ffb04a" status: 200 len: 1413 microversion: 2.1 time: 0.125746 Oct 23 01:17:17.852135 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 959/1883] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:17:17 2022] GET /compute/v2.1/images/90d42cdd-cddc-43cd-a2de-f4f225ffb04a => generated 1413 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:17.870346 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bb34f3e1-9461-4a52-b7bd-fea95794865b tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:17.879654 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-bb34f3e1-9461-4a52-b7bd-fea95794865b tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:17.912423 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bb34f3e1-9461-4a52-b7bd-fea95794865b tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:17.912925 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bb34f3e1-9461-4a52-b7bd-fea95794865b tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:17.913353 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bb34f3e1-9461-4a52-b7bd-fea95794865b tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:17.914110 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bb34f3e1-9461-4a52-b7bd-fea95794865b tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:17.919379 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bb34f3e1-9461-4a52-b7bd-fea95794865b tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:17.920837 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bb34f3e1-9461-4a52-b7bd-fea95794865b tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:18.295360 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bb34f3e1-9461-4a52-b7bd-fea95794865b tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:18.306547 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bb34f3e1-9461-4a52-b7bd-fea95794865b tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:18.308073 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bb34f3e1-9461-4a52-b7bd-fea95794865b tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:18.309334 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bb34f3e1-9461-4a52-b7bd-fea95794865b tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7" status: 200 len: 1815 microversion: 2.25 time: 0.456305 Oct 23 01:17:18.309964 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 960/1884] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:17:17 2022] GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7 => generated 1815 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:17:18.317387 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-102cf865-1eb8-464f-ab87-03fc239d9445 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:18.318334 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-102cf865-1eb8-464f-ab87-03fc239d9445 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] [instance: 120895a2-d6c4-47f6-a6e4-32cbcf028037] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:18.327746 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-102cf865-1eb8-464f-ab87-03fc239d9445 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:18.328571 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-102cf865-1eb8-464f-ab87-03fc239d9445 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:18.329214 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-102cf865-1eb8-464f-ab87-03fc239d9445 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:18.330914 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-102cf865-1eb8-464f-ab87-03fc239d9445 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:18.331578 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-102cf865-1eb8-464f-ab87-03fc239d9445 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:18.332761 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-102cf865-1eb8-464f-ab87-03fc239d9445 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:18.338315 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e5da6786-2dcc-4023-be67-4142ecb9a4cc tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:18.349130 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e5da6786-2dcc-4023-be67-4142ecb9a4cc tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1210 microversion: 2.1 time: 0.555704 Oct 23 01:17:18.359569 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 925/1885] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:17 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1210 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:18.367600 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5d0b9bcf-795d-496d-aacb-67099045dab6 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:18.368756 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5d0b9bcf-795d-496d-aacb-67099045dab6 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:18.376913 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5d0b9bcf-795d-496d-aacb-67099045dab6 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:18.377712 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5d0b9bcf-795d-496d-aacb-67099045dab6 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:18.378555 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5d0b9bcf-795d-496d-aacb-67099045dab6 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:18.380091 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5d0b9bcf-795d-496d-aacb-67099045dab6 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:18.380777 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5d0b9bcf-795d-496d-aacb-67099045dab6 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:18.381462 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5d0b9bcf-795d-496d-aacb-67099045dab6 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:18.495178 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-102cf865-1eb8-464f-ab87-03fc239d9445 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:18.505642 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-102cf865-1eb8-464f-ab87-03fc239d9445 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:18.508955 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-102cf865-1eb8-464f-ab87-03fc239d9445 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:18.510520 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-102cf865-1eb8-464f-ab87-03fc239d9445 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] 10.222.0.42 "GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037" status: 200 len: 1365 microversion: 2.57 time: 0.199140 Oct 23 01:17:18.511129 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 961/1886] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:17:18 2022] GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037 => generated 1365 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:17:18.688842 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5d0b9bcf-795d-496d-aacb-67099045dab6 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:18.702860 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5d0b9bcf-795d-496d-aacb-67099045dab6 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1470 microversion: 2.1 time: 0.341964 Oct 23 01:17:18.704875 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 926/1887] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:18 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1470 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:18.724775 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9a3c272d-0c19-41b6-8cd8-4077ac0970c5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:18.725336 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9a3c272d-0c19-41b6-8cd8-4077ac0970c5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 0d9df9b8-b177-4adc-bf48-941d99ddf249] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:18.740231 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a3c272d-0c19-41b6-8cd8-4077ac0970c5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:18.745930 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d40d2e87-325e-47c6-81d0-09d0600737c8 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:18.746593 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d40d2e87-325e-47c6-81d0-09d0600737c8 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: bdd228c7-614f-4742-932f-5cb7faf5a68c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:18.758791 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a3c272d-0c19-41b6-8cd8-4077ac0970c5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:18.762536 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a3c272d-0c19-41b6-8cd8-4077ac0970c5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:18.762536 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a3c272d-0c19-41b6-8cd8-4077ac0970c5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:18.762536 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a3c272d-0c19-41b6-8cd8-4077ac0970c5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:18.762536 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a3c272d-0c19-41b6-8cd8-4077ac0970c5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:18.763863 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d40d2e87-325e-47c6-81d0-09d0600737c8 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:18.764526 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d40d2e87-325e-47c6-81d0-09d0600737c8 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:18.765038 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d40d2e87-325e-47c6-81d0-09d0600737c8 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:18.766081 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d40d2e87-325e-47c6-81d0-09d0600737c8 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:18.766540 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d40d2e87-325e-47c6-81d0-09d0600737c8 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:18.767137 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d40d2e87-325e-47c6-81d0-09d0600737c8 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:19.262481 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9a3c272d-0c19-41b6-8cd8-4077ac0970c5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:19.272791 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9a3c272d-0c19-41b6-8cd8-4077ac0970c5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/0d9df9b8-b177-4adc-bf48-941d99ddf249" status: 200 len: 1467 microversion: 2.1 time: 0.553391 Oct 23 01:17:19.275731 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 962/1888] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:18 2022] GET /compute/v2.1/servers/0d9df9b8-b177-4adc-bf48-941d99ddf249 => generated 1467 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:19.284758 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d40d2e87-325e-47c6-81d0-09d0600737c8 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9681db3595440a88dacc40393e2e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386d20bba06b48be9a7e51162dc4d814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:19.290358 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-12a4f988-cc76-4664-adea-a03863888e7d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc21bbf70>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:19.320533 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d40d2e87-325e-47c6-81d0-09d0600737c8 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] 10.222.0.42 "GET /compute/v2.1/servers/bdd228c7-614f-4742-932f-5cb7faf5a68c" status: 200 len: 1324 microversion: 2.1 time: 0.576537 Oct 23 01:17:19.338383 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 927/1889] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:18 2022] GET /compute/v2.1/servers/bdd228c7-614f-4742-932f-5cb7faf5a68c => generated 1324 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:17:19.346132 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-15536e06-dc3d-4d75-822a-b0cf164a9e14 tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:19.352183 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-15536e06-dc3d-4d75-822a-b0cf164a9e14 tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] [instance: 0d9df9b8-b177-4adc-bf48-941d99ddf249] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:19.375050 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15536e06-dc3d-4d75-822a-b0cf164a9e14 tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:19.378079 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15536e06-dc3d-4d75-822a-b0cf164a9e14 tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:19.380073 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15536e06-dc3d-4d75-822a-b0cf164a9e14 tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:19.381047 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15536e06-dc3d-4d75-822a-b0cf164a9e14 tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:19.381726 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15536e06-dc3d-4d75-822a-b0cf164a9e14 tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:19.382465 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15536e06-dc3d-4d75-822a-b0cf164a9e14 tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:19.386261 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-12a4f988-cc76-4664-adea-a03863888e7d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/90d42cdd-cddc-43cd-a2de-f4f225ffb04a" status: 200 len: 1413 microversion: 2.1 time: 0.107965 Oct 23 01:17:19.386846 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 963/1890] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:17:19 2022] GET /compute/v2.1/images/90d42cdd-cddc-43cd-a2de-f4f225ffb04a => generated 1413 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:19.404155 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-eed93b30-c336-4389-991a-cf05ef30804a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:19.404888 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-eed93b30-c336-4389-991a-cf05ef30804a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:19.418503 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eed93b30-c336-4389-991a-cf05ef30804a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:19.425323 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eed93b30-c336-4389-991a-cf05ef30804a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:19.427304 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eed93b30-c336-4389-991a-cf05ef30804a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:19.428250 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eed93b30-c336-4389-991a-cf05ef30804a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:19.428874 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eed93b30-c336-4389-991a-cf05ef30804a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:19.429603 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eed93b30-c336-4389-991a-cf05ef30804a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:19.775727 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-15536e06-dc3d-4d75-822a-b0cf164a9e14 tempest-ServersOnMultiNodesTest-973515937 tempest-ServersOnMultiNodesTest-973515937-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/0d9df9b8-b177-4adc-bf48-941d99ddf249" status: 200 len: 1618 microversion: 2.1 time: 0.435459 Oct 23 01:17:19.779754 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 928/1891] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:19 2022] GET /compute/v2.1/servers/0d9df9b8-b177-4adc-bf48-941d99ddf249 => generated 1618 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:19.788868 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-869b5ebe-7252-48ca-b09c-7ef736697a05 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:19.803458 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-869b5ebe-7252-48ca-b09c-7ef736697a05 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:19.814258 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-869b5ebe-7252-48ca-b09c-7ef736697a05 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:19.814765 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-869b5ebe-7252-48ca-b09c-7ef736697a05 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:19.815206 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-869b5ebe-7252-48ca-b09c-7ef736697a05 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:19.815925 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-869b5ebe-7252-48ca-b09c-7ef736697a05 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:19.816377 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-869b5ebe-7252-48ca-b09c-7ef736697a05 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:19.817361 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-869b5ebe-7252-48ca-b09c-7ef736697a05 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:19.856103 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-eed93b30-c336-4389-991a-cf05ef30804a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:19.870326 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-eed93b30-c336-4389-991a-cf05ef30804a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:19.872313 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-eed93b30-c336-4389-991a-cf05ef30804a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:19.873884 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-eed93b30-c336-4389-991a-cf05ef30804a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7" status: 200 len: 1815 microversion: 2.25 time: 0.486135 Oct 23 01:17:19.874800 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 964/1892] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:17:19 2022] GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7 => generated 1815 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:17:19.880726 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-90b321da-5aad-48d8-baa8-e3110108d7cc tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:19.882729 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-90b321da-5aad-48d8-baa8-e3110108d7cc tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] [instance: 120895a2-d6c4-47f6-a6e4-32cbcf028037] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:19.891415 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-90b321da-5aad-48d8-baa8-e3110108d7cc tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:19.892246 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-90b321da-5aad-48d8-baa8-e3110108d7cc tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:19.892899 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-90b321da-5aad-48d8-baa8-e3110108d7cc tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:19.893819 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-90b321da-5aad-48d8-baa8-e3110108d7cc tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:19.894547 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-90b321da-5aad-48d8-baa8-e3110108d7cc tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:19.896178 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-90b321da-5aad-48d8-baa8-e3110108d7cc tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:20.044812 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-90b321da-5aad-48d8-baa8-e3110108d7cc tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:20.058262 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-90b321da-5aad-48d8-baa8-e3110108d7cc tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:20.059997 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-90b321da-5aad-48d8-baa8-e3110108d7cc tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:20.061430 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-90b321da-5aad-48d8-baa8-e3110108d7cc tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] 10.222.0.42 "GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037" status: 200 len: 1371 microversion: 2.57 time: 0.185311 Oct 23 01:17:20.062010 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 965/1893] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:17:19 2022] GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037 => generated 1371 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:17:20.071320 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5d83f894-051a-4f19-9aa9-3593fa6d8df2 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:20.072126 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5d83f894-051a-4f19-9aa9-3593fa6d8df2 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:20.078558 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5d83f894-051a-4f19-9aa9-3593fa6d8df2 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:20.079248 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5d83f894-051a-4f19-9aa9-3593fa6d8df2 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:20.079873 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5d83f894-051a-4f19-9aa9-3593fa6d8df2 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:20.080743 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5d83f894-051a-4f19-9aa9-3593fa6d8df2 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:20.081705 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5d83f894-051a-4f19-9aa9-3593fa6d8df2 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:20.082380 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5d83f894-051a-4f19-9aa9-3593fa6d8df2 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:20.224033 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-869b5ebe-7252-48ca-b09c-7ef736697a05 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:20.232620 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-869b5ebe-7252-48ca-b09c-7ef736697a05 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1210 microversion: 2.1 time: 0.451442 Oct 23 01:17:20.240982 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 929/1894] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:19 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1210 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:20.258284 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1c94be93-caf5-4968-97a2-4f02ff14d4dd tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:20.258875 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1c94be93-caf5-4968-97a2-4f02ff14d4dd tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 0d9df9b8-b177-4adc-bf48-941d99ddf249] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:20.271535 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1c94be93-caf5-4968-97a2-4f02ff14d4dd tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:20.274344 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1c94be93-caf5-4968-97a2-4f02ff14d4dd tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:20.274344 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1c94be93-caf5-4968-97a2-4f02ff14d4dd tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:20.274344 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1c94be93-caf5-4968-97a2-4f02ff14d4dd tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:20.274344 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1c94be93-caf5-4968-97a2-4f02ff14d4dd tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:20.274987 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1c94be93-caf5-4968-97a2-4f02ff14d4dd tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:20.309754 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1c94be93-caf5-4968-97a2-4f02ff14d4dd tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 0d9df9b8-b177-4adc-bf48-941d99ddf249] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:17:20.369651 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5d83f894-051a-4f19-9aa9-3593fa6d8df2 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:20.378418 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5d83f894-051a-4f19-9aa9-3593fa6d8df2 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1463 microversion: 2.1 time: 0.315125 Oct 23 01:17:20.385512 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 966/1895] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:20 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1463 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:20.392173 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f84cd22f-9a1f-43ee-b253-8a6bd675c985 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:20.392786 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f84cd22f-9a1f-43ee-b253-8a6bd675c985 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: bdd228c7-614f-4742-932f-5cb7faf5a68c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:20.403615 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f84cd22f-9a1f-43ee-b253-8a6bd675c985 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:20.404115 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f84cd22f-9a1f-43ee-b253-8a6bd675c985 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:20.404552 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f84cd22f-9a1f-43ee-b253-8a6bd675c985 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:20.405351 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f84cd22f-9a1f-43ee-b253-8a6bd675c985 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:20.405812 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f84cd22f-9a1f-43ee-b253-8a6bd675c985 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:20.406262 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f84cd22f-9a1f-43ee-b253-8a6bd675c985 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:20.632517 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f84cd22f-9a1f-43ee-b253-8a6bd675c985 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9681db3595440a88dacc40393e2e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386d20bba06b48be9a7e51162dc4d814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:20.642607 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f84cd22f-9a1f-43ee-b253-8a6bd675c985 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] 10.222.0.42 "GET /compute/v2.1/servers/bdd228c7-614f-4742-932f-5cb7faf5a68c" status: 200 len: 1324 microversion: 2.1 time: 0.255891 Oct 23 01:17:20.644010 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 967/1896] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:20 2022] GET /compute/v2.1/servers/bdd228c7-614f-4742-932f-5cb7faf5a68c => generated 1324 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:20.648909 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-257c0c27-55a7-4b1d-9119-9e00ea8a44c8 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc222e1f0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:20.667047 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1c94be93-caf5-4968-97a2-4f02ff14d4dd tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0d9df9b8-b177-4adc-bf48-941d99ddf249" status: 204 len: 0 microversion: 2.1 time: 0.424562 Oct 23 01:17:20.671189 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 930/1897] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:17:20 2022] DELETE /compute/v2.1/servers/0d9df9b8-b177-4adc-bf48-941d99ddf249 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:17:20.703364 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-257c0c27-55a7-4b1d-9119-9e00ea8a44c8 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/90d42cdd-cddc-43cd-a2de-f4f225ffb04a" status: 200 len: 1413 microversion: 2.1 time: 0.057991 Oct 23 01:17:20.704178 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 968/1898] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:17:20 2022] GET /compute/v2.1/images/90d42cdd-cddc-43cd-a2de-f4f225ffb04a => generated 1413 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:20.716052 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-6eeba91a-5fa7-4cf2-a725-441599472a8d req-64028982-ead2-43db-854f-2c448aa0cf33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff95f7f4-2b30-4083-8643-3f9b1d203d02", "name": "network-vif-plugged", "status": "completed", "tag": "c2891809-9683-41d8-8d60-11982de58178"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:17:20.726824 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-6eeba91a-5fa7-4cf2-a725-441599472a8d req-64028982-ead2-43db-854f-2c448aa0cf33 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:20.727757 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-6eeba91a-5fa7-4cf2-a725-441599472a8d req-64028982-ead2-43db-854f-2c448aa0cf33 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:20.728404 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-6eeba91a-5fa7-4cf2-a725-441599472a8d req-64028982-ead2-43db-854f-2c448aa0cf33 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:20.742839 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-6eeba91a-5fa7-4cf2-a725-441599472a8d req-64028982-ead2-43db-854f-2c448aa0cf33 service nova] Creating event network-vif-plugged:c2891809-9683-41d8-8d60-11982de58178 for instance ff95f7f4-2b30-4083-8643-3f9b1d203d02 on n-h2-master-1 Oct 23 01:17:20.750870 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-6eeba91a-5fa7-4cf2-a725-441599472a8d req-64028982-ead2-43db-854f-2c448aa0cf33 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045168 Oct 23 01:17:20.751788 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 969/1899] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:17:20.757222 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1912611e-6958-4a1e-addd-f9466c8b4784 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:20.758326 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1912611e-6958-4a1e-addd-f9466c8b4784 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 0d9df9b8-b177-4adc-bf48-941d99ddf249] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:20.764678 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1912611e-6958-4a1e-addd-f9466c8b4784 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:20.765424 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1912611e-6958-4a1e-addd-f9466c8b4784 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:20.766115 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1912611e-6958-4a1e-addd-f9466c8b4784 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:20.766980 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1912611e-6958-4a1e-addd-f9466c8b4784 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:20.767588 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1912611e-6958-4a1e-addd-f9466c8b4784 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:20.768359 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1912611e-6958-4a1e-addd-f9466c8b4784 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:20.844966 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1f91933c-4c09-47dd-aa77-0e299f000ef6 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:20.847775 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1f91933c-4c09-47dd-aa77-0e299f000ef6 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:20.857352 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f91933c-4c09-47dd-aa77-0e299f000ef6 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:20.863128 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f91933c-4c09-47dd-aa77-0e299f000ef6 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:20.863128 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f91933c-4c09-47dd-aa77-0e299f000ef6 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:20.863128 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f91933c-4c09-47dd-aa77-0e299f000ef6 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:20.863128 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f91933c-4c09-47dd-aa77-0e299f000ef6 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:20.863128 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f91933c-4c09-47dd-aa77-0e299f000ef6 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:20.927786 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1912611e-6958-4a1e-addd-f9466c8b4784 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:20.944578 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1912611e-6958-4a1e-addd-f9466c8b4784 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/0d9df9b8-b177-4adc-bf48-941d99ddf249" status: 200 len: 1473 microversion: 2.1 time: 0.187704 Oct 23 01:17:20.950027 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 970/1900] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:20 2022] GET /compute/v2.1/servers/0d9df9b8-b177-4adc-bf48-941d99ddf249 => generated 1473 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:20.950646 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8f34d812-0ed1-46ca-ba12-7cd5409d6ea5 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:20.951386 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8f34d812-0ed1-46ca-ba12-7cd5409d6ea5 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:20.958832 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f34d812-0ed1-46ca-ba12-7cd5409d6ea5 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:20.959513 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f34d812-0ed1-46ca-ba12-7cd5409d6ea5 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:20.960157 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f34d812-0ed1-46ca-ba12-7cd5409d6ea5 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:20.961146 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f34d812-0ed1-46ca-ba12-7cd5409d6ea5 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:20.961789 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f34d812-0ed1-46ca-ba12-7cd5409d6ea5 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:20.962468 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f34d812-0ed1-46ca-ba12-7cd5409d6ea5 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:21.093024 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1f91933c-4c09-47dd-aa77-0e299f000ef6 tempest-MigrationsAdminTest-1308385605 tempest-MigrationsAdminTest-1308385605-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1614 microversion: 2.1 time: 0.419802 Oct 23 01:17:21.098063 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 931/1901] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:20 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1614 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:21.121651 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f3331e6c-353f-47fb-b613-ad4282e4fa69 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:21.122655 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f3331e6c-353f-47fb-b613-ad4282e4fa69 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] [instance: 120895a2-d6c4-47f6-a6e4-32cbcf028037] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:21.132555 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f3331e6c-353f-47fb-b613-ad4282e4fa69 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:21.133630 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f3331e6c-353f-47fb-b613-ad4282e4fa69 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:21.134457 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f3331e6c-353f-47fb-b613-ad4282e4fa69 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:21.135331 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f3331e6c-353f-47fb-b613-ad4282e4fa69 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:21.136136 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f3331e6c-353f-47fb-b613-ad4282e4fa69 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:21.136561 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f3331e6c-353f-47fb-b613-ad4282e4fa69 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:21.209509 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8f34d812-0ed1-46ca-ba12-7cd5409d6ea5 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:21.222646 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8f34d812-0ed1-46ca-ba12-7cd5409d6ea5 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:21.224131 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8f34d812-0ed1-46ca-ba12-7cd5409d6ea5 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:21.225314 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8f34d812-0ed1-46ca-ba12-7cd5409d6ea5 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7" status: 200 len: 1815 microversion: 2.25 time: 0.278480 Oct 23 01:17:21.238868 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 971/1902] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:17:20 2022] GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7 => generated 1815 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:17:21.248669 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f3331e6c-353f-47fb-b613-ad4282e4fa69 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:21.249875 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d4cf256b-f4e9-4dce-9456-f58055ab11cf tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:21.250643 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d4cf256b-f4e9-4dce-9456-f58055ab11cf tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:21.259791 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4cf256b-f4e9-4dce-9456-f58055ab11cf tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:21.261929 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f3331e6c-353f-47fb-b613-ad4282e4fa69 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:21.262461 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4cf256b-f4e9-4dce-9456-f58055ab11cf tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:21.263150 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4cf256b-f4e9-4dce-9456-f58055ab11cf tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:21.264089 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4cf256b-f4e9-4dce-9456-f58055ab11cf tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:21.264740 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4cf256b-f4e9-4dce-9456-f58055ab11cf tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:21.264885 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f3331e6c-353f-47fb-b613-ad4282e4fa69 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:21.265526 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4cf256b-f4e9-4dce-9456-f58055ab11cf tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:21.266880 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f3331e6c-353f-47fb-b613-ad4282e4fa69 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] 10.222.0.42 "GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037" status: 200 len: 1371 microversion: 2.57 time: 0.167451 Oct 23 01:17:21.286277 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 932/1903] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:17:21 2022] GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037 => generated 1371 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:17:21.295969 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-18ae3de4-30f4-460c-96c9-03bd3e3dfca4 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:21.301945 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-18ae3de4-30f4-460c-96c9-03bd3e3dfca4 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:21.310249 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18ae3de4-30f4-460c-96c9-03bd3e3dfca4 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:21.311064 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d4cf256b-f4e9-4dce-9456-f58055ab11cf tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:17:21.314543 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18ae3de4-30f4-460c-96c9-03bd3e3dfca4 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:21.314889 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18ae3de4-30f4-460c-96c9-03bd3e3dfca4 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:21.315699 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18ae3de4-30f4-460c-96c9-03bd3e3dfca4 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:21.322160 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18ae3de4-30f4-460c-96c9-03bd3e3dfca4 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:21.322718 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18ae3de4-30f4-460c-96c9-03bd3e3dfca4 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:21.388866 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:17:21.527827 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-18ae3de4-30f4-460c-96c9-03bd3e3dfca4 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:21.547710 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-18ae3de4-30f4-460c-96c9-03bd3e3dfca4 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1210 microversion: 2.1 time: 0.256414 Oct 23 01:17:21.550283 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 933/1904] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:21 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1210 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:21.671660 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d3039f24-7cf5-471f-bc42-6e09391d515e tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:21.672294 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d3039f24-7cf5-471f-bc42-6e09391d515e tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: bdd228c7-614f-4742-932f-5cb7faf5a68c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:21.685395 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d3039f24-7cf5-471f-bc42-6e09391d515e tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:21.685906 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d3039f24-7cf5-471f-bc42-6e09391d515e tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:21.686382 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d3039f24-7cf5-471f-bc42-6e09391d515e tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:21.693530 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d4cf256b-f4e9-4dce-9456-f58055ab11cf tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 204 len: 0 microversion: 2.1 time: 0.453763 Oct 23 01:17:21.694465 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 972/1905] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:17:21 2022] DELETE /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:17:21.702530 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d3039f24-7cf5-471f-bc42-6e09391d515e tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:21.703520 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d3039f24-7cf5-471f-bc42-6e09391d515e tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:21.703984 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d3039f24-7cf5-471f-bc42-6e09391d515e tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:21.704120 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-19216017-c527-442f-a1da-fac1bd49cc5a tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:21.704870 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-19216017-c527-442f-a1da-fac1bd49cc5a tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:21.711207 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-19216017-c527-442f-a1da-fac1bd49cc5a tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:21.712038 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-19216017-c527-442f-a1da-fac1bd49cc5a tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:21.712702 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-19216017-c527-442f-a1da-fac1bd49cc5a tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:21.713667 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-19216017-c527-442f-a1da-fac1bd49cc5a tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:21.714528 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-19216017-c527-442f-a1da-fac1bd49cc5a tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:21.715177 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-19216017-c527-442f-a1da-fac1bd49cc5a tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:21.915161 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d3039f24-7cf5-471f-bc42-6e09391d515e tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9681db3595440a88dacc40393e2e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386d20bba06b48be9a7e51162dc4d814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:21.930255 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d3039f24-7cf5-471f-bc42-6e09391d515e tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] 10.222.0.42 "GET /compute/v2.1/servers/bdd228c7-614f-4742-932f-5cb7faf5a68c" status: 200 len: 1520 microversion: 2.1 time: 0.265368 Oct 23 01:17:21.943617 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 934/1906] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:21 2022] GET /compute/v2.1/servers/bdd228c7-614f-4742-932f-5cb7faf5a68c => generated 1520 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:21.943617 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f9086ac7-3175-43d8-a47c-c0de78ecaea6 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc18770d0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:21.959017 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-19216017-c527-442f-a1da-fac1bd49cc5a tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:21.967869 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-19216017-c527-442f-a1da-fac1bd49cc5a tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1469 microversion: 2.1 time: 0.269010 Oct 23 01:17:21.968457 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 973/1907] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:21 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1469 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:17:21.997444 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ea8f3076-a4d8-44db-9228-d72677e9ed2f tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.6.81"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:17:21.998511 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ea8f3076-a4d8-44db-9228-d72677e9ed2f tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: a78b5bc9-4e8f-44d7-879c-737838cfe1b6] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:22.005511 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f9086ac7-3175-43d8-a47c-c0de78ecaea6 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/90d42cdd-cddc-43cd-a2de-f4f225ffb04a" status: 200 len: 1413 microversion: 2.1 time: 0.073139 Oct 23 01:17:22.007572 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ea8f3076-a4d8-44db-9228-d72677e9ed2f tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:22.008071 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ea8f3076-a4d8-44db-9228-d72677e9ed2f tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:22.009031 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ea8f3076-a4d8-44db-9228-d72677e9ed2f tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:22.009741 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ea8f3076-a4d8-44db-9228-d72677e9ed2f tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:22.010229 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ea8f3076-a4d8-44db-9228-d72677e9ed2f tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:22.011158 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ea8f3076-a4d8-44db-9228-d72677e9ed2f tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:22.013858 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 935/1908] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:17:21 2022] GET /compute/v2.1/images/90d42cdd-cddc-43cd-a2de-f4f225ffb04a => generated 1413 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:22.018727 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-73011a08-d59a-492d-891b-adb7bb8327a0 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:22.019358 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-73011a08-d59a-492d-891b-adb7bb8327a0 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 0d9df9b8-b177-4adc-bf48-941d99ddf249] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:22.026292 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-73011a08-d59a-492d-891b-adb7bb8327a0 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:22.026792 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-73011a08-d59a-492d-891b-adb7bb8327a0 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:22.027238 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-73011a08-d59a-492d-891b-adb7bb8327a0 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:22.027951 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-73011a08-d59a-492d-891b-adb7bb8327a0 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:22.028413 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-73011a08-d59a-492d-891b-adb7bb8327a0 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:22.028848 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-73011a08-d59a-492d-891b-adb7bb8327a0 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:22.049250 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ea8f3076-a4d8-44db-9228-d72677e9ed2f tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "refresh_cache-a78b5bc9-4e8f-44d7-879c-737838cfe1b6" {{(pid=120945) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 23 01:17:22.050593 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ea8f3076-a4d8-44db-9228-d72677e9ed2f tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquired lock "refresh_cache-a78b5bc9-4e8f-44d7-879c-737838cfe1b6" {{(pid=120945) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 23 01:17:22.393902 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-73011a08-d59a-492d-891b-adb7bb8327a0 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:22.407857 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-73011a08-d59a-492d-891b-adb7bb8327a0 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/0d9df9b8-b177-4adc-bf48-941d99ddf249" status: 200 len: 1473 microversion: 2.1 time: 0.392823 Oct 23 01:17:22.413121 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 936/1909] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:22 2022] GET /compute/v2.1/servers/0d9df9b8-b177-4adc-bf48-941d99ddf249 => generated 1473 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:22.428619 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b8c082ee-3a32-46d1-8fc1-7be96055b60a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:22.429584 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b8c082ee-3a32-46d1-8fc1-7be96055b60a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:22.442409 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b8c082ee-3a32-46d1-8fc1-7be96055b60a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:22.443159 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b8c082ee-3a32-46d1-8fc1-7be96055b60a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:22.444717 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b8c082ee-3a32-46d1-8fc1-7be96055b60a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:22.445779 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b8c082ee-3a32-46d1-8fc1-7be96055b60a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:22.446443 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b8c082ee-3a32-46d1-8fc1-7be96055b60a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:22.447070 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b8c082ee-3a32-46d1-8fc1-7be96055b60a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:22.778854 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b8c082ee-3a32-46d1-8fc1-7be96055b60a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:22.781346 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:17:22.792757 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b8c082ee-3a32-46d1-8fc1-7be96055b60a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:22.794285 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b8c082ee-3a32-46d1-8fc1-7be96055b60a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:22.795508 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b8c082ee-3a32-46d1-8fc1-7be96055b60a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7" status: 200 len: 1815 microversion: 2.25 time: 0.381214 Oct 23 01:17:22.796080 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 937/1910] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:17:22 2022] GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7 => generated 1815 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:17:22.804156 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8f92c66c-4f3e-4efa-8a89-4b49d2450643 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:22.804768 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8f92c66c-4f3e-4efa-8a89-4b49d2450643 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] [instance: 120895a2-d6c4-47f6-a6e4-32cbcf028037] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:22.810987 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8f92c66c-4f3e-4efa-8a89-4b49d2450643 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:22.811672 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8f92c66c-4f3e-4efa-8a89-4b49d2450643 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:22.812262 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8f92c66c-4f3e-4efa-8a89-4b49d2450643 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:22.813148 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8f92c66c-4f3e-4efa-8a89-4b49d2450643 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:22.813758 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8f92c66c-4f3e-4efa-8a89-4b49d2450643 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:22.814379 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8f92c66c-4f3e-4efa-8a89-4b49d2450643 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:22.899844 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8f92c66c-4f3e-4efa-8a89-4b49d2450643 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:22.908974 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8f92c66c-4f3e-4efa-8a89-4b49d2450643 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:22.911071 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8f92c66c-4f3e-4efa-8a89-4b49d2450643 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:22.912484 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8f92c66c-4f3e-4efa-8a89-4b49d2450643 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] 10.222.0.42 "GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037" status: 200 len: 1371 microversion: 2.57 time: 0.113257 Oct 23 01:17:22.913508 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 938/1911] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:17:22 2022] GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037 => generated 1371 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:17:22.918487 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8c32044f-ed0e-4a77-b861-df56a292354d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:22.919826 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8c32044f-ed0e-4a77-b861-df56a292354d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:22.928769 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c32044f-ed0e-4a77-b861-df56a292354d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:22.929513 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c32044f-ed0e-4a77-b861-df56a292354d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:22.930228 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c32044f-ed0e-4a77-b861-df56a292354d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:22.931218 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c32044f-ed0e-4a77-b861-df56a292354d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:22.931881 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c32044f-ed0e-4a77-b861-df56a292354d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:22.932537 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c32044f-ed0e-4a77-b861-df56a292354d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:23.132225 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8c32044f-ed0e-4a77-b861-df56a292354d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:23.141188 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8c32044f-ed0e-4a77-b861-df56a292354d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1198 microversion: 2.1 time: 0.226130 Oct 23 01:17:23.142386 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 939/1912] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:22 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1198 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:23.149434 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2f276766-df46-4779-8b1a-4bccd12d4867 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:23.150372 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2f276766-df46-4779-8b1a-4bccd12d4867 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:23.156781 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f276766-df46-4779-8b1a-4bccd12d4867 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:23.157526 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f276766-df46-4779-8b1a-4bccd12d4867 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:23.158190 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f276766-df46-4779-8b1a-4bccd12d4867 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:23.159082 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f276766-df46-4779-8b1a-4bccd12d4867 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:23.159763 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f276766-df46-4779-8b1a-4bccd12d4867 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:23.160395 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f276766-df46-4779-8b1a-4bccd12d4867 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:23.376043 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2f276766-df46-4779-8b1a-4bccd12d4867 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:23.385261 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2f276766-df46-4779-8b1a-4bccd12d4867 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1469 microversion: 2.1 time: 0.240271 Oct 23 01:17:23.385858 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 940/1913] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:23 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1469 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:23.406201 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-43a4f856-ad8c-4c81-87c8-69eac4eb8411 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc1a271f0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:23.455717 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-43a4f856-ad8c-4c81-87c8-69eac4eb8411 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/90d42cdd-cddc-43cd-a2de-f4f225ffb04a" status: 200 len: 1413 microversion: 2.1 time: 0.053185 Oct 23 01:17:23.456157 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 941/1914] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:17:23 2022] GET /compute/v2.1/images/90d42cdd-cddc-43cd-a2de-f4f225ffb04a => generated 1413 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:23.461922 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-43f6d5b5-625c-4148-9e5a-2c48989ec208 req-8430568b-8078-4dbd-aa55-83926270c8cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be9a2687-233d-43c3-95b3-3a8b455595c7", "name": "network-vif-unplugged", "status": "completed", "tag": "a5573536-696d-47fb-b77e-270410ee0fca"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:17:23.474662 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-43f6d5b5-625c-4148-9e5a-2c48989ec208 req-8430568b-8078-4dbd-aa55-83926270c8cc service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:23.475403 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-43f6d5b5-625c-4148-9e5a-2c48989ec208 req-8430568b-8078-4dbd-aa55-83926270c8cc service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:23.476052 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-43f6d5b5-625c-4148-9e5a-2c48989ec208 req-8430568b-8078-4dbd-aa55-83926270c8cc service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:23.488670 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-43f6d5b5-625c-4148-9e5a-2c48989ec208 req-8430568b-8078-4dbd-aa55-83926270c8cc service nova] Creating event network-vif-unplugged:a5573536-696d-47fb-b77e-270410ee0fca for instance be9a2687-233d-43c3-95b3-3a8b455595c7 on n-h2-master-1 Oct 23 01:17:23.495096 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-43f6d5b5-625c-4148-9e5a-2c48989ec208 req-8430568b-8078-4dbd-aa55-83926270c8cc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037573 Oct 23 01:17:23.496239 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 942/1915] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:17:23.739705 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5c38ca4c-3d82-4817-bb38-5941952ed5cf tempest-ListImageFiltersNegativeTestJSON-784966907 tempest-ListImageFiltersNegativeTestJSON-784966907-project] Calling method '.version_select at 0x7f5cc18ed670>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:23.780046 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-5c38ca4c-3d82-4817-bb38-5941952ed5cf tempest-ListImageFiltersNegativeTestJSON-784966907 tempest-ListImageFiltersNegativeTestJSON-784966907-project] HTTP exception thrown: Image not found. Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5c38ca4c-3d82-4817-bb38-5941952ed5cf tempest-ListImageFiltersNegativeTestJSON-784966907 tempest-ListImageFiltersNegativeTestJSON-784966907-project] Request method failure captured: Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/images/33b05d92-27f2-4553-9cb1-6faecb0288ae HTTP/1.1 Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJYjOrXRGSrVMo4MPTPI5fo7oLbNOr9_Kd-nB7YIx7e2pRc4ew5HBPT3_Arzt3f13H7Sv_wIiAcXPRnAxDyx6YZL09405wVq1vEouuPSA2iYolK32tIl9pS3nag6VwAaxrVSe8o_TV6MUPJrPawgc3Cs_z3k3GSsg4Ps6dBBnxbvhoo Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 78462d3300c74b5fbcc1c29ec0182305 Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-784966907 Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/78462d3300c74b5fbcc1c29ec0182305"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_78462d3300c74b5fbcc1c29ec0182305"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/78462d3300c74b5fbcc1c29ec0182305"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/78462d3300c74b5fbcc1c29ec0182305"}]}] Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-784966907 Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 78462d3300c74b5fbcc1c29ec0182305 Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-784966907 Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ListImageFiltersNegativeTestJSON-784966907-project Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 1a6e6863d7c24324b6361e9e1aab435e Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-784966907-project Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: method: Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: exception: Image not found. Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '33b05d92-27f2-4553-9cb1-6faecb0288ae'} Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 33b05d92-27f2-4553-9cb1-6faecb0288ae Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 23 01:17:23.782812 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 23 01:17:23.792711 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 23 01:17:23.792711 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 23 01:17:23.792711 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 23 01:17:23.792711 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 23 01:17:23.792711 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 23 01:17:23.792711 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 23 01:17:23.792711 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 23 01:17:23.792711 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 23 01:17:23.792711 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 23 01:17:23.792711 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 23 01:17:23.792711 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 23 01:17:23.792711 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 23 01:17:23.792711 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 23 01:17:23.792711 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 23 01:17:23.792711 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 23 01:17:23.792711 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 23 01:17:23.792711 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 23 01:17:23.792711 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 33b05d92-27f2-4553-9cb1-6faecb0288ae could not be found. Oct 23 01:17:23.792711 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:23.792711 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:17:23.792711 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:23.792711 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:23.792711 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:17:23.792711 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:17:23.792711 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:17:23.792711 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:17:23.792711 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:17:23.792711 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:17:23.792711 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:17:23.792711 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:17:23.792711 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 23 01:17:23.792711 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 23 01:17:23.792711 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 23 01:17:23.792711 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:23.792711 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:17:23.792711 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:23.792711 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:23.792711 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:17:23.792711 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:17:23.792711 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:17:23.792711 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:17:23.792711 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 23 01:17:23.792711 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:23.792711 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5c38ca4c-3d82-4817-bb38-5941952ed5cf tempest-ListImageFiltersNegativeTestJSON-784966907 tempest-ListImageFiltersNegativeTestJSON-784966907-project] Returning 404 to user: Image not found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:17:23.792711 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5c38ca4c-3d82-4817-bb38-5941952ed5cf tempest-ListImageFiltersNegativeTestJSON-784966907 tempest-ListImageFiltersNegativeTestJSON-784966907-project] 10.222.0.42 "GET /compute/v2.1/images/33b05d92-27f2-4553-9cb1-6faecb0288ae" status: 404 len: 62 microversion: 2.1 time: 0.287169 Oct 23 01:17:23.792711 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 943/1916] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:17:23 2022] GET /compute/v2.1/images/33b05d92-27f2-4553-9cb1-6faecb0288ae => generated 62 bytes in 288 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:17:23.804512 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-88cfdce8-faa6-48bc-a023-d64210e6cb75 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:23.806315 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-88cfdce8-faa6-48bc-a023-d64210e6cb75 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 0d9df9b8-b177-4adc-bf48-941d99ddf249] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:23.813772 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-88cfdce8-faa6-48bc-a023-d64210e6cb75 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:23.814674 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-88cfdce8-faa6-48bc-a023-d64210e6cb75 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:23.815342 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-88cfdce8-faa6-48bc-a023-d64210e6cb75 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:23.816313 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-88cfdce8-faa6-48bc-a023-d64210e6cb75 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:23.819733 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-88cfdce8-faa6-48bc-a023-d64210e6cb75 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:23.823947 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-88cfdce8-faa6-48bc-a023-d64210e6cb75 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:24.122723 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-ea8f3076-a4d8-44db-9228-d72677e9ed2f tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: a78b5bc9-4e8f-44d7-879c-737838cfe1b6] Building network info cache for instance {{(pid=120945) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 23 01:17:24.147628 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-88cfdce8-faa6-48bc-a023-d64210e6cb75 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:24.188434 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-88cfdce8-faa6-48bc-a023-d64210e6cb75 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/0d9df9b8-b177-4adc-bf48-941d99ddf249" status: 200 len: 1473 microversion: 2.1 time: 0.398550 Oct 23 01:17:24.199943 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 944/1917] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:23 2022] GET /compute/v2.1/servers/0d9df9b8-b177-4adc-bf48-941d99ddf249 => generated 1473 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:24.212795 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f8cbadd4-9a72-42d8-af28-c20cf0fe71a3 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:24.213726 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f8cbadd4-9a72-42d8-af28-c20cf0fe71a3 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:24.242684 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8cbadd4-9a72-42d8-af28-c20cf0fe71a3 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:24.246073 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8cbadd4-9a72-42d8-af28-c20cf0fe71a3 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:24.246536 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8cbadd4-9a72-42d8-af28-c20cf0fe71a3 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:24.252918 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8cbadd4-9a72-42d8-af28-c20cf0fe71a3 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:24.253552 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8cbadd4-9a72-42d8-af28-c20cf0fe71a3 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:24.264999 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8cbadd4-9a72-42d8-af28-c20cf0fe71a3 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:24.825934 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f8cbadd4-9a72-42d8-af28-c20cf0fe71a3 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:24.835780 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f8cbadd4-9a72-42d8-af28-c20cf0fe71a3 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:24.838170 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f8cbadd4-9a72-42d8-af28-c20cf0fe71a3 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:24.840964 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f8cbadd4-9a72-42d8-af28-c20cf0fe71a3 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7" status: 200 len: 1815 microversion: 2.25 time: 0.647850 Oct 23 01:17:24.848916 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 945/1918] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:17:24 2022] GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7 => generated 1815 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:17:24.856630 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ecfa7577-0c18-4921-be3c-8891801819b8 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:24.859173 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ecfa7577-0c18-4921-be3c-8891801819b8 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] [instance: 120895a2-d6c4-47f6-a6e4-32cbcf028037] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:24.874036 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ecfa7577-0c18-4921-be3c-8891801819b8 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:24.874801 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ecfa7577-0c18-4921-be3c-8891801819b8 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:24.875416 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ecfa7577-0c18-4921-be3c-8891801819b8 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:24.876302 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ecfa7577-0c18-4921-be3c-8891801819b8 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:24.876953 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ecfa7577-0c18-4921-be3c-8891801819b8 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:24.877549 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ecfa7577-0c18-4921-be3c-8891801819b8 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:24.974230 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ecfa7577-0c18-4921-be3c-8891801819b8 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:25.020765 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ecfa7577-0c18-4921-be3c-8891801819b8 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:25.022808 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ecfa7577-0c18-4921-be3c-8891801819b8 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:25.025153 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ecfa7577-0c18-4921-be3c-8891801819b8 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] 10.222.0.42 "GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037" status: 200 len: 1371 microversion: 2.57 time: 0.174620 Oct 23 01:17:25.026607 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 946/1919] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:17:24 2022] GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037 => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:17:25.032793 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9d5f60c0-bfce-4488-a794-a97dcaaf3807 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:25.034399 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9d5f60c0-bfce-4488-a794-a97dcaaf3807 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:25.046381 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9d5f60c0-bfce-4488-a794-a97dcaaf3807 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:25.047881 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9d5f60c0-bfce-4488-a794-a97dcaaf3807 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:25.048531 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9d5f60c0-bfce-4488-a794-a97dcaaf3807 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:25.049502 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9d5f60c0-bfce-4488-a794-a97dcaaf3807 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:25.050631 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9d5f60c0-bfce-4488-a794-a97dcaaf3807 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:25.051315 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9d5f60c0-bfce-4488-a794-a97dcaaf3807 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:25.331797 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9d5f60c0-bfce-4488-a794-a97dcaaf3807 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:25.347082 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9d5f60c0-bfce-4488-a794-a97dcaaf3807 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1198 microversion: 2.1 time: 0.318940 Oct 23 01:17:25.361065 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 947/1920] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:25 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1198 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:25.372228 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-0497b00b-6975-442c-9bd9-2dadfb7e332c req-4c066629-4e2c-4cde-81f1-8b2c1bad767a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a78b5bc9-4e8f-44d7-879c-737838cfe1b6", "tag": "c797d72c-fb4f-47ae-abdc-bb226e15b717"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:17:25.386807 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-0497b00b-6975-442c-9bd9-2dadfb7e332c req-4c066629-4e2c-4cde-81f1-8b2c1bad767a service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:25.387720 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-0497b00b-6975-442c-9bd9-2dadfb7e332c req-4c066629-4e2c-4cde-81f1-8b2c1bad767a service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:25.388196 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-0497b00b-6975-442c-9bd9-2dadfb7e332c req-4c066629-4e2c-4cde-81f1-8b2c1bad767a service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:25.405876 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-ea8f3076-a4d8-44db-9228-d72677e9ed2f tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: a78b5bc9-4e8f-44d7-879c-737838cfe1b6] Updating instance_info_cache with network_info: [{"id": "c797d72c-fb4f-47ae-abdc-bb226e15b717", "address": "fa:16:3e:6c:28:3d", "network": {"id": "1fd1125a-5e06-4668-a85b-393b7a6d4c8a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1026242889-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.6.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "386d20bba06b48be9a7e51162dc4d814", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc797d72c-fb", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120945) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 23 01:17:25.410066 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-0497b00b-6975-442c-9bd9-2dadfb7e332c req-4c066629-4e2c-4cde-81f1-8b2c1bad767a service nova] Creating event network-changed:c797d72c-fb4f-47ae-abdc-bb226e15b717 for instance a78b5bc9-4e8f-44d7-879c-737838cfe1b6 on n-h2-master-1 Oct 23 01:17:25.416057 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-0497b00b-6975-442c-9bd9-2dadfb7e332c req-4c066629-4e2c-4cde-81f1-8b2c1bad767a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053548 Oct 23 01:17:25.417386 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 948/1921] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:17:25.425101 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5d1d10f9-069b-42b0-b7ae-a21988c170f5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:25.426673 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5d1d10f9-069b-42b0-b7ae-a21988c170f5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:25.434642 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5d1d10f9-069b-42b0-b7ae-a21988c170f5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:25.435554 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5d1d10f9-069b-42b0-b7ae-a21988c170f5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:25.436360 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5d1d10f9-069b-42b0-b7ae-a21988c170f5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:25.437341 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5d1d10f9-069b-42b0-b7ae-a21988c170f5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:25.437961 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5d1d10f9-069b-42b0-b7ae-a21988c170f5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:25.438660 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5d1d10f9-069b-42b0-b7ae-a21988c170f5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:25.539543 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ea8f3076-a4d8-44db-9228-d72677e9ed2f tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Releasing lock "refresh_cache-a78b5bc9-4e8f-44d7-879c-737838cfe1b6" {{(pid=120945) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 23 01:17:25.540438 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ea8f3076-a4d8-44db-9228-d72677e9ed2f tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] 10.222.0.42 "POST /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6/action" status: 202 len: 0 microversion: 2.1 time: 3.550412 Oct 23 01:17:25.544228 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 974/1922] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:17:21 2022] POST /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6/action => generated 0 bytes in 3555 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 23 01:17:25.551701 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3059502e-864f-464b-b595-94296b97cbbb tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc632a4c0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:25.616504 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3059502e-864f-464b-b595-94296b97cbbb tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/90d42cdd-cddc-43cd-a2de-f4f225ffb04a" status: 200 len: 1413 microversion: 2.1 time: 0.070898 Oct 23 01:17:25.617090 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 975/1923] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:17:25 2022] GET /compute/v2.1/images/90d42cdd-cddc-43cd-a2de-f4f225ffb04a => generated 1413 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:25.640966 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bd9b5270-35f7-4803-893b-54269a5b218f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:25.643454 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-bd9b5270-35f7-4803-893b-54269a5b218f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 0d9df9b8-b177-4adc-bf48-941d99ddf249] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:25.673065 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd9b5270-35f7-4803-893b-54269a5b218f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:25.673766 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd9b5270-35f7-4803-893b-54269a5b218f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:25.675767 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd9b5270-35f7-4803-893b-54269a5b218f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:25.677351 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd9b5270-35f7-4803-893b-54269a5b218f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:25.678876 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd9b5270-35f7-4803-893b-54269a5b218f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:25.681517 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd9b5270-35f7-4803-893b-54269a5b218f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:25.856184 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5d1d10f9-069b-42b0-b7ae-a21988c170f5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:25.864998 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5d1d10f9-069b-42b0-b7ae-a21988c170f5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1469 microversion: 2.1 time: 0.446129 Oct 23 01:17:25.869694 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 949/1924] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:25 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1469 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:25.886485 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-8d5acb24-94b6-4f6b-a602-2f86371e617f req-ca14705f-9be2-4e62-a0a4-bd20031d05e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be9a2687-233d-43c3-95b3-3a8b455595c7", "tag": "a5573536-696d-47fb-b77e-270410ee0fca"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:17:25.893525 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:17:25.899659 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-8d5acb24-94b6-4f6b-a602-2f86371e617f req-ca14705f-9be2-4e62-a0a4-bd20031d05e8 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:25.900390 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-8d5acb24-94b6-4f6b-a602-2f86371e617f req-ca14705f-9be2-4e62-a0a4-bd20031d05e8 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:25.901019 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-8d5acb24-94b6-4f6b-a602-2f86371e617f req-ca14705f-9be2-4e62-a0a4-bd20031d05e8 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:25.946044 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-8d5acb24-94b6-4f6b-a602-2f86371e617f req-ca14705f-9be2-4e62-a0a4-bd20031d05e8 service nova] Creating event network-changed:a5573536-696d-47fb-b77e-270410ee0fca for instance be9a2687-233d-43c3-95b3-3a8b455595c7 on n-h2-master-1 Oct 23 01:17:25.959554 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-8d5acb24-94b6-4f6b-a602-2f86371e617f req-ca14705f-9be2-4e62-a0a4-bd20031d05e8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084516 Oct 23 01:17:25.961635 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 950/1925] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:17:25.968322 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bd9b5270-35f7-4803-893b-54269a5b218f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:25.980351 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bd9b5270-35f7-4803-893b-54269a5b218f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/0d9df9b8-b177-4adc-bf48-941d99ddf249" status: 200 len: 1473 microversion: 2.1 time: 0.362243 Oct 23 01:17:26.003527 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 976/1926] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:25 2022] GET /compute/v2.1/servers/0d9df9b8-b177-4adc-bf48-941d99ddf249 => generated 1473 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:26.009215 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fc1a2e36-009a-4264-a665-d01556e29804 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:26.009830 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-fc1a2e36-009a-4264-a665-d01556e29804 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:26.012473 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0b6ed8a6-90bb-47b7-963e-0ba77dbe2dc3 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.6.81"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:17:26.015898 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0b6ed8a6-90bb-47b7-963e-0ba77dbe2dc3 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: bdd228c7-614f-4742-932f-5cb7faf5a68c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:26.027348 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b6ed8a6-90bb-47b7-963e-0ba77dbe2dc3 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:26.027847 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b6ed8a6-90bb-47b7-963e-0ba77dbe2dc3 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:26.029841 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc1a2e36-009a-4264-a665-d01556e29804 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:26.030362 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc1a2e36-009a-4264-a665-d01556e29804 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:26.030791 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc1a2e36-009a-4264-a665-d01556e29804 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:26.031576 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b6ed8a6-90bb-47b7-963e-0ba77dbe2dc3 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:26.032325 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b6ed8a6-90bb-47b7-963e-0ba77dbe2dc3 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:26.032785 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b6ed8a6-90bb-47b7-963e-0ba77dbe2dc3 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:26.033209 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b6ed8a6-90bb-47b7-963e-0ba77dbe2dc3 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:26.034186 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc1a2e36-009a-4264-a665-d01556e29804 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:26.039796 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc1a2e36-009a-4264-a665-d01556e29804 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:26.045119 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc1a2e36-009a-4264-a665-d01556e29804 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:26.092945 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b6ed8a6-90bb-47b7-963e-0ba77dbe2dc3 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "refresh_cache-bdd228c7-614f-4742-932f-5cb7faf5a68c" {{(pid=120944) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 23 01:17:26.097135 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b6ed8a6-90bb-47b7-963e-0ba77dbe2dc3 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquired lock "refresh_cache-bdd228c7-614f-4742-932f-5cb7faf5a68c" {{(pid=120944) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 23 01:17:26.518473 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-fc1a2e36-009a-4264-a665-d01556e29804 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:26.534649 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-fc1a2e36-009a-4264-a665-d01556e29804 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:26.542624 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-fc1a2e36-009a-4264-a665-d01556e29804 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:26.546988 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fc1a2e36-009a-4264-a665-d01556e29804 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7" status: 200 len: 1815 microversion: 2.25 time: 0.541647 Oct 23 01:17:26.547763 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 977/1927] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:17:26 2022] GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7 => generated 1815 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:17:26.569296 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d624cc03-95b5-4e82-8506-1bde40873516 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:26.572316 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d624cc03-95b5-4e82-8506-1bde40873516 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] [instance: 120895a2-d6c4-47f6-a6e4-32cbcf028037] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:26.580172 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d624cc03-95b5-4e82-8506-1bde40873516 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:26.581119 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d624cc03-95b5-4e82-8506-1bde40873516 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:26.582021 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d624cc03-95b5-4e82-8506-1bde40873516 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:26.583577 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d624cc03-95b5-4e82-8506-1bde40873516 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:26.584385 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d624cc03-95b5-4e82-8506-1bde40873516 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:26.585072 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d624cc03-95b5-4e82-8506-1bde40873516 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:26.681194 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d624cc03-95b5-4e82-8506-1bde40873516 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:26.699387 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d624cc03-95b5-4e82-8506-1bde40873516 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:26.702914 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d624cc03-95b5-4e82-8506-1bde40873516 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:26.705064 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d624cc03-95b5-4e82-8506-1bde40873516 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] 10.222.0.42 "GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037" status: 200 len: 1371 microversion: 2.57 time: 0.153562 Oct 23 01:17:26.706156 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 978/1928] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:17:26 2022] GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:17:26.713341 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-444187f9-fa6b-4717-8a15-d88f63b39b81 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:26.714227 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-444187f9-fa6b-4717-8a15-d88f63b39b81 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:26.722311 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-444187f9-fa6b-4717-8a15-d88f63b39b81 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:26.723655 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-444187f9-fa6b-4717-8a15-d88f63b39b81 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:26.724264 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-444187f9-fa6b-4717-8a15-d88f63b39b81 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:26.725431 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-444187f9-fa6b-4717-8a15-d88f63b39b81 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:26.728858 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-444187f9-fa6b-4717-8a15-d88f63b39b81 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:26.729669 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-444187f9-fa6b-4717-8a15-d88f63b39b81 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:27.197526 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-444187f9-fa6b-4717-8a15-d88f63b39b81 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:27.205780 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-444187f9-fa6b-4717-8a15-d88f63b39b81 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1198 microversion: 2.1 time: 0.498227 Oct 23 01:17:27.219027 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 979/1929] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:26 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1198 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:27.219027 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-17c85ea1-03d4-4894-923d-ed6d4884880a tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc222ec10>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:27.312179 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-17c85ea1-03d4-4894-923d-ed6d4884880a tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/90d42cdd-cddc-43cd-a2de-f4f225ffb04a" status: 200 len: 1413 microversion: 2.1 time: 0.104717 Oct 23 01:17:27.313123 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 980/1930] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:17:27 2022] GET /compute/v2.1/images/90d42cdd-cddc-43cd-a2de-f4f225ffb04a => generated 1413 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:27.325763 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-99693f4b-22d5-428f-9f90-41ceab8bd911 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:27.327701 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-99693f4b-22d5-428f-9f90-41ceab8bd911 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:27.341907 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-99693f4b-22d5-428f-9f90-41ceab8bd911 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:27.342918 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-99693f4b-22d5-428f-9f90-41ceab8bd911 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:27.343522 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-99693f4b-22d5-428f-9f90-41ceab8bd911 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:27.344451 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-99693f4b-22d5-428f-9f90-41ceab8bd911 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:27.345607 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-99693f4b-22d5-428f-9f90-41ceab8bd911 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:27.346452 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-99693f4b-22d5-428f-9f90-41ceab8bd911 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:27.894419 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-99693f4b-22d5-428f-9f90-41ceab8bd911 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:27.906265 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-99693f4b-22d5-428f-9f90-41ceab8bd911 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1469 microversion: 2.1 time: 0.591424 Oct 23 01:17:27.916407 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 981/1931] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:27 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1469 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:27.925394 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-37bfaccc-86be-4265-8533-83996f8bb508 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:27.940665 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-37bfaccc-86be-4265-8533-83996f8bb508 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 0d9df9b8-b177-4adc-bf48-941d99ddf249] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:27.959299 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-37bfaccc-86be-4265-8533-83996f8bb508 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:27.962805 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-37bfaccc-86be-4265-8533-83996f8bb508 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:27.963259 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-37bfaccc-86be-4265-8533-83996f8bb508 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:27.969049 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-37bfaccc-86be-4265-8533-83996f8bb508 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:27.970380 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-37bfaccc-86be-4265-8533-83996f8bb508 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:27.971802 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-37bfaccc-86be-4265-8533-83996f8bb508 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:28.243816 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-37bfaccc-86be-4265-8533-83996f8bb508 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:28.261644 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-37bfaccc-86be-4265-8533-83996f8bb508 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/0d9df9b8-b177-4adc-bf48-941d99ddf249" status: 200 len: 1431 microversion: 2.1 time: 0.342767 Oct 23 01:17:28.265114 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 982/1932] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:27 2022] GET /compute/v2.1/servers/0d9df9b8-b177-4adc-bf48-941d99ddf249 => generated 1431 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:28.279722 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2e4e6cbf-86b9-4d30-a5f1-accffadf0438 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:28.282387 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2e4e6cbf-86b9-4d30-a5f1-accffadf0438 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:28.298468 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2e4e6cbf-86b9-4d30-a5f1-accffadf0438 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:28.302318 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2e4e6cbf-86b9-4d30-a5f1-accffadf0438 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:28.302904 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2e4e6cbf-86b9-4d30-a5f1-accffadf0438 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:28.305218 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2e4e6cbf-86b9-4d30-a5f1-accffadf0438 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:28.308556 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2e4e6cbf-86b9-4d30-a5f1-accffadf0438 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:28.309537 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2e4e6cbf-86b9-4d30-a5f1-accffadf0438 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:28.686378 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2e4e6cbf-86b9-4d30-a5f1-accffadf0438 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:28.697789 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2e4e6cbf-86b9-4d30-a5f1-accffadf0438 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:28.699291 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2e4e6cbf-86b9-4d30-a5f1-accffadf0438 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:28.700531 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2e4e6cbf-86b9-4d30-a5f1-accffadf0438 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7" status: 200 len: 1815 microversion: 2.25 time: 0.434249 Oct 23 01:17:28.711445 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 983/1933] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:17:28 2022] GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7 => generated 1815 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:17:28.716362 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-46a0b81a-8126-4a84-afd9-233583006d22 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:28.716976 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-46a0b81a-8126-4a84-afd9-233583006d22 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] [instance: 120895a2-d6c4-47f6-a6e4-32cbcf028037] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:28.723205 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46a0b81a-8126-4a84-afd9-233583006d22 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:28.723939 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46a0b81a-8126-4a84-afd9-233583006d22 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:28.724543 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46a0b81a-8126-4a84-afd9-233583006d22 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:28.725407 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46a0b81a-8126-4a84-afd9-233583006d22 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:28.725867 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46a0b81a-8126-4a84-afd9-233583006d22 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:28.726498 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46a0b81a-8126-4a84-afd9-233583006d22 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:28.818511 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-46a0b81a-8126-4a84-afd9-233583006d22 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:28.827518 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-46a0b81a-8126-4a84-afd9-233583006d22 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:28.830102 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-46a0b81a-8126-4a84-afd9-233583006d22 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:28.831555 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-46a0b81a-8126-4a84-afd9-233583006d22 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] 10.222.0.42 "GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037" status: 200 len: 1356 microversion: 2.57 time: 0.119064 Oct 23 01:17:28.833426 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 984/1934] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:17:28 2022] GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037 => generated 1356 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:17:28.837400 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-34cfac28-6c52-4003-8b2b-06f77b697194 req-8190efc0-cbab-4811-adb2-0df461601c6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d9df9b8-b177-4adc-bf48-941d99ddf249", "name": "network-vif-deleted", "tag": "0f5fc56f-c5f4-491f-8b04-9bf4c9867de9"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:17:28.847478 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-34cfac28-6c52-4003-8b2b-06f77b697194 req-8190efc0-cbab-4811-adb2-0df461601c6b service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:28.848238 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-34cfac28-6c52-4003-8b2b-06f77b697194 req-8190efc0-cbab-4811-adb2-0df461601c6b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:28.848827 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-34cfac28-6c52-4003-8b2b-06f77b697194 req-8190efc0-cbab-4811-adb2-0df461601c6b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:28.860818 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-34cfac28-6c52-4003-8b2b-06f77b697194 req-8190efc0-cbab-4811-adb2-0df461601c6b service nova] Creating event network-vif-deleted:0f5fc56f-c5f4-491f-8b04-9bf4c9867de9 for instance 0d9df9b8-b177-4adc-bf48-941d99ddf249 on n-h2-master-1 Oct 23 01:17:28.870197 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-34cfac28-6c52-4003-8b2b-06f77b697194 req-8190efc0-cbab-4811-adb2-0df461601c6b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033218 Oct 23 01:17:28.870197 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 985/1935] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:17:28.874625 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ac94b820-ca18-4e3b-ba32-9f215fed4bf4 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:28.875680 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ac94b820-ca18-4e3b-ba32-9f215fed4bf4 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:28.882828 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ac94b820-ca18-4e3b-ba32-9f215fed4bf4 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:28.883578 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ac94b820-ca18-4e3b-ba32-9f215fed4bf4 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:28.884199 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ac94b820-ca18-4e3b-ba32-9f215fed4bf4 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:28.885207 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ac94b820-ca18-4e3b-ba32-9f215fed4bf4 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:28.886489 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ac94b820-ca18-4e3b-ba32-9f215fed4bf4 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:28.887205 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ac94b820-ca18-4e3b-ba32-9f215fed4bf4 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:29.231984 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ac94b820-ca18-4e3b-ba32-9f215fed4bf4 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:29.246111 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ac94b820-ca18-4e3b-ba32-9f215fed4bf4 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1198 microversion: 2.1 time: 0.376364 Oct 23 01:17:29.247237 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 986/1936] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:28 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1198 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:29.252943 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-40486e1a-4ea4-4051-9cef-9dd3ec7b4375 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc62c78b0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:29.326438 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-40486e1a-4ea4-4051-9cef-9dd3ec7b4375 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/90d42cdd-cddc-43cd-a2de-f4f225ffb04a" status: 200 len: 1413 microversion: 2.1 time: 0.077750 Oct 23 01:17:29.328547 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 987/1937] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:17:29 2022] GET /compute/v2.1/images/90d42cdd-cddc-43cd-a2de-f4f225ffb04a => generated 1413 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:29.343077 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2755ff78-50fd-4c4e-b07a-c616e855251f tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:29.344210 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2755ff78-50fd-4c4e-b07a-c616e855251f tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] [instance: 120895a2-d6c4-47f6-a6e4-32cbcf028037] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:29.365168 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2755ff78-50fd-4c4e-b07a-c616e855251f tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:29.365168 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2755ff78-50fd-4c4e-b07a-c616e855251f tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:29.365168 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2755ff78-50fd-4c4e-b07a-c616e855251f tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:29.374858 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2755ff78-50fd-4c4e-b07a-c616e855251f tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:29.376897 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2755ff78-50fd-4c4e-b07a-c616e855251f tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:29.378588 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2755ff78-50fd-4c4e-b07a-c616e855251f tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:29.455548 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2755ff78-50fd-4c4e-b07a-c616e855251f tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] [instance: 120895a2-d6c4-47f6-a6e4-32cbcf028037] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:17:29.814308 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2755ff78-50fd-4c4e-b07a-c616e855251f tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] 10.222.0.42 "DELETE /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037" status: 204 len: 0 microversion: 2.57 time: 0.484157 Oct 23 01:17:29.816128 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 988/1938] 10.222.0.42 () {60 vars in 1280 bytes} [Sun Oct 23 01:17:29 2022] DELETE /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 23 01:17:29.824381 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-69211a3e-b3bf-4880-9913-b8b0d09d696e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:29.877147 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-69211a3e-b3bf-4880-9913-b8b0d09d696e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:29.887153 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-69211a3e-b3bf-4880-9913-b8b0d09d696e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:29.887788 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-69211a3e-b3bf-4880-9913-b8b0d09d696e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:29.888345 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-69211a3e-b3bf-4880-9913-b8b0d09d696e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:29.889178 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-69211a3e-b3bf-4880-9913-b8b0d09d696e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:29.891124 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-69211a3e-b3bf-4880-9913-b8b0d09d696e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:29.891705 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-69211a3e-b3bf-4880-9913-b8b0d09d696e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:29.934805 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-69211a3e-b3bf-4880-9913-b8b0d09d696e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:29.935458 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-69211a3e-b3bf-4880-9913-b8b0d09d696e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:29.936011 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-69211a3e-b3bf-4880-9913-b8b0d09d696e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:29.936614 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-69211a3e-b3bf-4880-9913-b8b0d09d696e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lazy-loading 'fault' on Instance uuid ff95f7f4-2b30-4083-8643-3f9b1d203d02 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:17:29.940818 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:17:30.014847 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-69211a3e-b3bf-4880-9913-b8b0d09d696e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:30.032040 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-69211a3e-b3bf-4880-9913-b8b0d09d696e tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1303 microversion: 2.1 time: 0.213758 Oct 23 01:17:30.046925 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 989/1939] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:29 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1303 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:30.061736 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4c1d39c7-f9c4-4f1b-a090-644a0e86977b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:30.062356 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4c1d39c7-f9c4-4f1b-a090-644a0e86977b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 0d9df9b8-b177-4adc-bf48-941d99ddf249] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:30.069658 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4c1d39c7-f9c4-4f1b-a090-644a0e86977b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:30.070188 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4c1d39c7-f9c4-4f1b-a090-644a0e86977b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:30.070628 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4c1d39c7-f9c4-4f1b-a090-644a0e86977b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:30.071347 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4c1d39c7-f9c4-4f1b-a090-644a0e86977b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:30.071803 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4c1d39c7-f9c4-4f1b-a090-644a0e86977b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:30.072236 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4c1d39c7-f9c4-4f1b-a090-644a0e86977b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:30.107008 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4c1d39c7-f9c4-4f1b-a090-644a0e86977b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:30.107498 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4c1d39c7-f9c4-4f1b-a090-644a0e86977b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:30.108138 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4c1d39c7-f9c4-4f1b-a090-644a0e86977b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:30.108595 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-4c1d39c7-f9c4-4f1b-a090-644a0e86977b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lazy-loading 'fault' on Instance uuid 0d9df9b8-b177-4adc-bf48-941d99ddf249 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:17:30.227518 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4c1d39c7-f9c4-4f1b-a090-644a0e86977b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:30.235585 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4c1d39c7-f9c4-4f1b-a090-644a0e86977b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/0d9df9b8-b177-4adc-bf48-941d99ddf249" status: 200 len: 1307 microversion: 2.1 time: 0.187373 Oct 23 01:17:30.250383 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 990/1940] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:30 2022] GET /compute/v2.1/servers/0d9df9b8-b177-4adc-bf48-941d99ddf249 => generated 1307 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:30.257084 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-11d12b48-2e44-4a95-a12f-4729721c5aca tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:30.257969 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-11d12b48-2e44-4a95-a12f-4729721c5aca tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:30.264601 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-11d12b48-2e44-4a95-a12f-4729721c5aca tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:30.265351 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-11d12b48-2e44-4a95-a12f-4729721c5aca tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:30.266049 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-11d12b48-2e44-4a95-a12f-4729721c5aca tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:30.267219 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-11d12b48-2e44-4a95-a12f-4729721c5aca tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:30.267861 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-11d12b48-2e44-4a95-a12f-4729721c5aca tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:30.268668 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-11d12b48-2e44-4a95-a12f-4729721c5aca tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:30.350511 n-d-master-1 devstack@n-api.service[120944]: INFO nova.network.neutron [None req-0b6ed8a6-90bb-47b7-963e-0ba77dbe2dc3 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: bdd228c7-614f-4742-932f-5cb7faf5a68c] re-assign floating IP 172.35.6.81 from instance a78b5bc9-4e8f-44d7-879c-737838cfe1b6 Oct 23 01:17:30.508122 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-0b6ed8a6-90bb-47b7-963e-0ba77dbe2dc3 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: a78b5bc9-4e8f-44d7-879c-737838cfe1b6] Building network info cache for instance {{(pid=120944) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 23 01:17:31.064743 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-11d12b48-2e44-4a95-a12f-4729721c5aca tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:31.075316 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-11d12b48-2e44-4a95-a12f-4729721c5aca tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:31.077174 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-11d12b48-2e44-4a95-a12f-4729721c5aca tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:31.078766 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-11d12b48-2e44-4a95-a12f-4729721c5aca tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7" status: 200 len: 1815 microversion: 2.25 time: 0.827058 Oct 23 01:17:31.079515 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 991/1941] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:17:30 2022] GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7 => generated 1815 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:17:31.084253 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5bbb1350-18e7-4c9f-b549-b2b0c8e2041b tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:31.085076 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5bbb1350-18e7-4c9f-b549-b2b0c8e2041b tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] [instance: 120895a2-d6c4-47f6-a6e4-32cbcf028037] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:31.088306 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:17:31.092037 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5bbb1350-18e7-4c9f-b549-b2b0c8e2041b tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:31.092734 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5bbb1350-18e7-4c9f-b549-b2b0c8e2041b tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:31.093330 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5bbb1350-18e7-4c9f-b549-b2b0c8e2041b tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:31.094229 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5bbb1350-18e7-4c9f-b549-b2b0c8e2041b tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:31.094845 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5bbb1350-18e7-4c9f-b549-b2b0c8e2041b tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:31.095435 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5bbb1350-18e7-4c9f-b549-b2b0c8e2041b tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:31.273575 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5bbb1350-18e7-4c9f-b549-b2b0c8e2041b tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:31.285907 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5bbb1350-18e7-4c9f-b549-b2b0c8e2041b tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:31.287404 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5bbb1350-18e7-4c9f-b549-b2b0c8e2041b tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:31.294771 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5bbb1350-18e7-4c9f-b549-b2b0c8e2041b tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] 10.222.0.42 "GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037" status: 200 len: 1362 microversion: 2.57 time: 0.214050 Oct 23 01:17:31.295373 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 992/1942] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:17:31 2022] GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037 => generated 1362 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:17:31.302788 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-847ae26d-8165-40dc-996f-1d0ce45c50e5 req-6897a2d7-df97-4ce5-9d9b-4e2fbcdb9140 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a78b5bc9-4e8f-44d7-879c-737838cfe1b6", "tag": "c797d72c-fb4f-47ae-abdc-bb226e15b717"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:17:31.332121 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-847ae26d-8165-40dc-996f-1d0ce45c50e5 req-6897a2d7-df97-4ce5-9d9b-4e2fbcdb9140 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:31.332121 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-847ae26d-8165-40dc-996f-1d0ce45c50e5 req-6897a2d7-df97-4ce5-9d9b-4e2fbcdb9140 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:31.332121 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-847ae26d-8165-40dc-996f-1d0ce45c50e5 req-6897a2d7-df97-4ce5-9d9b-4e2fbcdb9140 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:31.360154 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-847ae26d-8165-40dc-996f-1d0ce45c50e5 req-6897a2d7-df97-4ce5-9d9b-4e2fbcdb9140 service nova] Creating event network-changed:c797d72c-fb4f-47ae-abdc-bb226e15b717 for instance a78b5bc9-4e8f-44d7-879c-737838cfe1b6 on n-h2-master-1 Oct 23 01:17:31.377573 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-847ae26d-8165-40dc-996f-1d0ce45c50e5 req-6897a2d7-df97-4ce5-9d9b-4e2fbcdb9140 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080800 Oct 23 01:17:31.378511 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 993/1943] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:17:31.384469 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bfcc833e-53e6-40cb-8047-133b6902568a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:31.390544 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-bfcc833e-53e6-40cb-8047-133b6902568a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:31.403227 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bfcc833e-53e6-40cb-8047-133b6902568a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:31.404098 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bfcc833e-53e6-40cb-8047-133b6902568a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:31.405278 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bfcc833e-53e6-40cb-8047-133b6902568a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:31.406539 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bfcc833e-53e6-40cb-8047-133b6902568a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:31.407189 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bfcc833e-53e6-40cb-8047-133b6902568a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:31.408084 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bfcc833e-53e6-40cb-8047-133b6902568a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:31.627122 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bfcc833e-53e6-40cb-8047-133b6902568a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:31.645827 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bfcc833e-53e6-40cb-8047-133b6902568a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1198 microversion: 2.1 time: 0.264640 Oct 23 01:17:31.648665 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 994/1944] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:31 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1198 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:31.654629 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d46f6cac-b7d0-4dea-ac23-f68ea5418300 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc62c78b0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:31.751787 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d46f6cac-b7d0-4dea-ac23-f68ea5418300 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/90d42cdd-cddc-43cd-a2de-f4f225ffb04a" status: 200 len: 1422 microversion: 2.1 time: 0.101748 Oct 23 01:17:31.764711 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 995/1945] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:17:31 2022] GET /compute/v2.1/images/90d42cdd-cddc-43cd-a2de-f4f225ffb04a => generated 1422 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:31.784346 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-3767a394-92f6-4232-85be-80caa1aa9a1d req-aa2f4869-1eee-4edd-8d09-c57b5806a8be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff95f7f4-2b30-4083-8643-3f9b1d203d02", "name": "network-vif-deleted", "tag": "c2891809-9683-41d8-8d60-11982de58178"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:17:31.809747 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-3767a394-92f6-4232-85be-80caa1aa9a1d req-aa2f4869-1eee-4edd-8d09-c57b5806a8be service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:31.809747 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-3767a394-92f6-4232-85be-80caa1aa9a1d req-aa2f4869-1eee-4edd-8d09-c57b5806a8be service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:31.811038 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-3767a394-92f6-4232-85be-80caa1aa9a1d req-aa2f4869-1eee-4edd-8d09-c57b5806a8be service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:31.843477 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-3767a394-92f6-4232-85be-80caa1aa9a1d req-aa2f4869-1eee-4edd-8d09-c57b5806a8be service nova] Creating event network-vif-deleted:c2891809-9683-41d8-8d60-11982de58178 for instance ff95f7f4-2b30-4083-8643-3f9b1d203d02 on n-h2-master-1 Oct 23 01:17:31.856000 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-3767a394-92f6-4232-85be-80caa1aa9a1d req-aa2f4869-1eee-4edd-8d09-c57b5806a8be service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089591 Oct 23 01:17:31.857856 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-0b6ed8a6-90bb-47b7-963e-0ba77dbe2dc3 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: a78b5bc9-4e8f-44d7-879c-737838cfe1b6] Updating instance_info_cache with network_info: [{"id": "c797d72c-fb4f-47ae-abdc-bb226e15b717", "address": "fa:16:3e:6c:28:3d", "network": {"id": "1fd1125a-5e06-4668-a85b-393b7a6d4c8a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1026242889-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "386d20bba06b48be9a7e51162dc4d814", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc797d72c-fb", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120944) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 23 01:17:31.859276 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 996/1946] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:17:31.871834 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3a222d6b-19e0-4cfc-b069-59dc990d7682 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:31.875156 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3a222d6b-19e0-4cfc-b069-59dc990d7682 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:31.891878 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3a222d6b-19e0-4cfc-b069-59dc990d7682 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:31.899018 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3a222d6b-19e0-4cfc-b069-59dc990d7682 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:31.899018 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3a222d6b-19e0-4cfc-b069-59dc990d7682 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:31.899018 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3a222d6b-19e0-4cfc-b069-59dc990d7682 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:31.899018 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3a222d6b-19e0-4cfc-b069-59dc990d7682 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:31.899018 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3a222d6b-19e0-4cfc-b069-59dc990d7682 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:31.945808 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-0b6ed8a6-90bb-47b7-963e-0ba77dbe2dc3 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: bdd228c7-614f-4742-932f-5cb7faf5a68c] Building network info cache for instance {{(pid=120944) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 23 01:17:32.010850 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3a222d6b-19e0-4cfc-b069-59dc990d7682 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:32.011334 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3a222d6b-19e0-4cfc-b069-59dc990d7682 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:32.011765 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3a222d6b-19e0-4cfc-b069-59dc990d7682 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:32.012202 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-3a222d6b-19e0-4cfc-b069-59dc990d7682 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lazy-loading 'fault' on Instance uuid ff95f7f4-2b30-4083-8643-3f9b1d203d02 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:17:32.083638 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3a222d6b-19e0-4cfc-b069-59dc990d7682 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:32.104463 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3a222d6b-19e0-4cfc-b069-59dc990d7682 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 200 len: 1303 microversion: 2.1 time: 0.242226 Oct 23 01:17:32.105556 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 997/1947] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:31 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 1303 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:32.111876 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b4ac4653-d09b-48c6-86d4-930e1d2e1011 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:32.112693 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b4ac4653-d09b-48c6-86d4-930e1d2e1011 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 0d9df9b8-b177-4adc-bf48-941d99ddf249] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:32.127398 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b4ac4653-d09b-48c6-86d4-930e1d2e1011 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:32.127918 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b4ac4653-d09b-48c6-86d4-930e1d2e1011 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:32.128346 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b4ac4653-d09b-48c6-86d4-930e1d2e1011 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:32.131229 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b4ac4653-d09b-48c6-86d4-930e1d2e1011 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:32.131725 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b4ac4653-d09b-48c6-86d4-930e1d2e1011 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:32.132164 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b4ac4653-d09b-48c6-86d4-930e1d2e1011 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:32.171597 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-b4ac4653-d09b-48c6-86d4-930e1d2e1011 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] HTTP exception thrown: Instance 0d9df9b8-b177-4adc-bf48-941d99ddf249 could not be found. Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b4ac4653-d09b-48c6-86d4-930e1d2e1011 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Request method failure captured: Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/0d9df9b8-b177-4adc-bf48-941d99ddf249 HTTP/1.1 Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJVv0uHUZkawxRif88fKy9LhJENRPZsKhmf6zOBQWEzP00qmPQkqAca2jhb2lRXN9t0zC2JkLeeBldWCPH61ICeNt4v5sTKxLKhNmtzMUUime8-v0hyE48rstyJIK6CJypqB2ITpC6L9yRd-7i6fCZp0NigLnXS0XEU_z_Ej3fGN7bI Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 47aadec780734d03a262d4021f48d625 Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServersOnMultiNodesTest-1204013784 Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/47aadec780734d03a262d4021f48d625"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_47aadec780734d03a262d4021f48d625"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/47aadec780734d03a262d4021f48d625"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/47aadec780734d03a262d4021f48d625"}]}] Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServersOnMultiNodesTest-1204013784 Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 47aadec780734d03a262d4021f48d625 Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1204013784 Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServersOnMultiNodesTest-1204013784-project Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 519c893a1e094200b882cf23db7cae54 Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServersOnMultiNodesTest-1204013784-project Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 0d9df9b8-b177-4adc-bf48-941d99ddf249 could not be found. Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '0d9df9b8-b177-4adc-bf48-941d99ddf249'} Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d9df9b8-b177-4adc-bf48-941d99ddf249 could not be found. Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d9df9b8-b177-4adc-bf48-941d99ddf249 could not be found. Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:17:32.173282 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:17:32.185183 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:32.185183 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:17:32.185183 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:17:32.185183 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:17:32.185183 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:17:32.185183 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d9df9b8-b177-4adc-bf48-941d99ddf249 could not be found. Oct 23 01:17:32.185183 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:17:32.191092 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b4ac4653-d09b-48c6-86d4-930e1d2e1011 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Returning 404 to user: Instance 0d9df9b8-b177-4adc-bf48-941d99ddf249 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:17:32.192301 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b4ac4653-d09b-48c6-86d4-930e1d2e1011 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/0d9df9b8-b177-4adc-bf48-941d99ddf249" status: 404 len: 111 microversion: 2.1 time: 0.084783 Oct 23 01:17:32.193058 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 998/1948] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:32 2022] GET /compute/v2.1/servers/0d9df9b8-b177-4adc-bf48-941d99ddf249 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:17:32.197816 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2a26fe4b-5b67-42aa-a4e3-e1a135921e6b tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc62e5ca0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:32.256434 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2a26fe4b-5b67-42aa-a4e3-e1a135921e6b tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/90d42cdd-cddc-43cd-a2de-f4f225ffb04a" status: 200 len: 1422 microversion: 2.1 time: 0.062158 Oct 23 01:17:32.257216 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 999/1949] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:17:32 2022] GET /compute/v2.1/images/90d42cdd-cddc-43cd-a2de-f4f225ffb04a => generated 1422 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:32.271636 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0277b8b9-6c4b-4374-b412-c22d3f17f114 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:32.273954 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0277b8b9-6c4b-4374-b412-c22d3f17f114 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:32.282196 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0277b8b9-6c4b-4374-b412-c22d3f17f114 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:32.282944 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0277b8b9-6c4b-4374-b412-c22d3f17f114 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:32.283563 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0277b8b9-6c4b-4374-b412-c22d3f17f114 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:32.284448 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0277b8b9-6c4b-4374-b412-c22d3f17f114 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:32.285058 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0277b8b9-6c4b-4374-b412-c22d3f17f114 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:32.286195 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0277b8b9-6c4b-4374-b412-c22d3f17f114 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:32.527662 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0277b8b9-6c4b-4374-b412-c22d3f17f114 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:32.542612 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0277b8b9-6c4b-4374-b412-c22d3f17f114 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:32.544957 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0277b8b9-6c4b-4374-b412-c22d3f17f114 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:32.550323 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0277b8b9-6c4b-4374-b412-c22d3f17f114 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7" status: 200 len: 1815 microversion: 2.25 time: 0.280774 Oct 23 01:17:32.550323 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1000/1950] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:17:32 2022] GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7 => generated 1815 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:17:32.581014 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-480d0d61-e9df-4056-90d1-1274909f4dec tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:32.587042 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-480d0d61-e9df-4056-90d1-1274909f4dec tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 6d55bc9b-0956-48c3-956a-e72457f8d95e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:32.602657 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-480d0d61-e9df-4056-90d1-1274909f4dec tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:32.605321 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-480d0d61-e9df-4056-90d1-1274909f4dec tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:32.607800 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-480d0d61-e9df-4056-90d1-1274909f4dec tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:32.608680 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-480d0d61-e9df-4056-90d1-1274909f4dec tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:32.612354 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-480d0d61-e9df-4056-90d1-1274909f4dec tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:32.612947 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-480d0d61-e9df-4056-90d1-1274909f4dec tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:32.663296 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-480d0d61-e9df-4056-90d1-1274909f4dec tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 6d55bc9b-0956-48c3-956a-e72457f8d95e] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:17:32.888385 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-0b6ed8a6-90bb-47b7-963e-0ba77dbe2dc3 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: bdd228c7-614f-4742-932f-5cb7faf5a68c] Updating instance_info_cache with network_info: [{"id": "8eb58394-2229-4f50-8d19-48d755a79f37", "address": "fa:16:3e:e4:e1:d4", "network": {"id": "1fd1125a-5e06-4668-a85b-393b7a6d4c8a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1026242889-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.6.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "386d20bba06b48be9a7e51162dc4d814", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8eb58394-22", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120944) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 23 01:17:32.991855 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b6ed8a6-90bb-47b7-963e-0ba77dbe2dc3 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Releasing lock "refresh_cache-bdd228c7-614f-4742-932f-5cb7faf5a68c" {{(pid=120944) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 23 01:17:32.992740 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0b6ed8a6-90bb-47b7-963e-0ba77dbe2dc3 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] 10.222.0.42 "POST /compute/v2.1/servers/bdd228c7-614f-4742-932f-5cb7faf5a68c/action" status: 202 len: 0 microversion: 2.1 time: 7.015853 Oct 23 01:17:32.993504 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 951/1951] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:17:25 2022] POST /compute/v2.1/servers/bdd228c7-614f-4742-932f-5cb7faf5a68c/action => generated 0 bytes in 7031 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 23 01:17:32.999743 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-af77d8b9-e78d-4c40-9246-111a154b4b9d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc21b48b0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:33.059975 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-480d0d61-e9df-4056-90d1-1274909f4dec tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6d55bc9b-0956-48c3-956a-e72457f8d95e" status: 204 len: 0 microversion: 2.1 time: 0.487119 Oct 23 01:17:33.061193 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1001/1952] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:17:32 2022] DELETE /compute/v2.1/servers/6d55bc9b-0956-48c3-956a-e72457f8d95e => generated 0 bytes in 511 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:17:33.068089 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-43f809be-effe-4bcf-bfa5-45bb54ccdd75 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:33.069181 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-43f809be-effe-4bcf-bfa5-45bb54ccdd75 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] [instance: 120895a2-d6c4-47f6-a6e4-32cbcf028037] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:33.076682 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-43f809be-effe-4bcf-bfa5-45bb54ccdd75 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:33.077423 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-43f809be-effe-4bcf-bfa5-45bb54ccdd75 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:33.078057 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-43f809be-effe-4bcf-bfa5-45bb54ccdd75 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:33.078910 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-43f809be-effe-4bcf-bfa5-45bb54ccdd75 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:33.079523 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-43f809be-effe-4bcf-bfa5-45bb54ccdd75 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:33.080212 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-43f809be-effe-4bcf-bfa5-45bb54ccdd75 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:33.188195 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-43f809be-effe-4bcf-bfa5-45bb54ccdd75 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:33.211635 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-43f809be-effe-4bcf-bfa5-45bb54ccdd75 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:33.213193 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-43f809be-effe-4bcf-bfa5-45bb54ccdd75 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:33.217428 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-43f809be-effe-4bcf-bfa5-45bb54ccdd75 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] 10.222.0.42 "GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037" status: 200 len: 1362 microversion: 2.57 time: 0.154275 Oct 23 01:17:33.218635 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1002/1953] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:17:33 2022] GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:17:33.225256 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-eea52a6a-f3f9-4206-99ec-17325f990aa5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:33.226128 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-eea52a6a-f3f9-4206-99ec-17325f990aa5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:33.233094 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eea52a6a-f3f9-4206-99ec-17325f990aa5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:33.233899 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eea52a6a-f3f9-4206-99ec-17325f990aa5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:33.234558 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eea52a6a-f3f9-4206-99ec-17325f990aa5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:33.235527 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eea52a6a-f3f9-4206-99ec-17325f990aa5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:33.236193 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eea52a6a-f3f9-4206-99ec-17325f990aa5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:33.236774 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eea52a6a-f3f9-4206-99ec-17325f990aa5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:33.455899 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-eea52a6a-f3f9-4206-99ec-17325f990aa5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:33.480384 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-eea52a6a-f3f9-4206-99ec-17325f990aa5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1198 microversion: 2.1 time: 0.259658 Oct 23 01:17:33.506468 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1003/1954] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:33 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1198 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:33.512478 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-edf527ce-6039-4bf2-9946-e5d133975016 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.6.81"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:17:33.841403 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-edf527ce-6039-4bf2-9946-e5d133975016 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: bdd228c7-614f-4742-932f-5cb7faf5a68c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:33.851703 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-edf527ce-6039-4bf2-9946-e5d133975016 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:33.851703 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-edf527ce-6039-4bf2-9946-e5d133975016 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:33.851703 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-edf527ce-6039-4bf2-9946-e5d133975016 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:33.851703 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-edf527ce-6039-4bf2-9946-e5d133975016 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:33.851703 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-edf527ce-6039-4bf2-9946-e5d133975016 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:33.852271 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-edf527ce-6039-4bf2-9946-e5d133975016 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:34.162425 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-edf527ce-6039-4bf2-9946-e5d133975016 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] HTTP exception thrown: Floating IP 172.35.6.81 is not associated with instance a78b5bc9-4e8f-44d7-879c-737838cfe1b6. Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-edf527ce-6039-4bf2-9946-e5d133975016 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Request method failure captured: Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6/action HTTP/1.1 Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 48 Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJXpa993jrYRXSo3h0JEnbdSd6b8ZTS-9twlCtOjHcZCOn9SWkUYPlRUeDTEsdRLQlb1foY28OZj4MCx6TZcc-A6_C0T9r8u9YkvhoGCHHByrfLzAJFiaQQv5tjLjf-B-XNYVOMRUWR11lSCiUN1mpEL0UOGWONyA-y2T7cK2Z6oZrs Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 386d20bba06b48be9a7e51162dc4d814 Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-928449743 Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/386d20bba06b48be9a7e51162dc4d814"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_386d20bba06b48be9a7e51162dc4d814"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/386d20bba06b48be9a7e51162dc4d814"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/386d20bba06b48be9a7e51162dc4d814"}]}] Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-928449743 Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 386d20bba06b48be9a7e51162dc4d814 Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-928449743 Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-FloatingIPsAssociationTestJSON-928449743-project Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: c9681db3595440a88dacc40393e2e1dc Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-928449743-project Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: {"removeFloatingIp": {"address": "172.35.6.81"}} Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: method: Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: exception: Floating IP 172.35.6.81 is not associated with instance a78b5bc9-4e8f-44d7-879c-737838cfe1b6. Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'a78b5bc9-4e8f-44d7-879c-737838cfe1b6', 'body': {'removeFloatingIp': {'address': '172.35.6.81'}}} Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.35.6.81 is not associated with instance a78b5bc9-4e8f-44d7-879c-737838cfe1b6. Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.35.6.81 is not associated with instance a78b5bc9-4e8f-44d7-879c-737838cfe1b6. Oct 23 01:17:34.164356 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:17:34.170349 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-edf527ce-6039-4bf2-9946-e5d133975016 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Returning 409 to user: Floating IP 172.35.6.81 is not associated with instance a78b5bc9-4e8f-44d7-879c-737838cfe1b6. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:17:34.171390 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-edf527ce-6039-4bf2-9946-e5d133975016 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] 10.222.0.42 "POST /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6/action" status: 409 len: 145 microversion: 2.1 time: 0.663657 Oct 23 01:17:34.189259 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1004/1955] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:17:33 2022] POST /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6/action => generated 145 bytes in 682 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:17:34.195014 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c6c84d86-324f-47aa-97a4-349a226f934c tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:34.216581 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c6c84d86-324f-47aa-97a4-349a226f934c tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 6d55bc9b-0956-48c3-956a-e72457f8d95e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:34.240720 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6c84d86-324f-47aa-97a4-349a226f934c tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:34.246092 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6c84d86-324f-47aa-97a4-349a226f934c tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:34.248162 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6c84d86-324f-47aa-97a4-349a226f934c tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:34.252159 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6c84d86-324f-47aa-97a4-349a226f934c tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:34.262419 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6c84d86-324f-47aa-97a4-349a226f934c tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:34.263173 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6c84d86-324f-47aa-97a4-349a226f934c tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:34.554284 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-af77d8b9-e78d-4c40-9246-111a154b4b9d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "DELETE /compute/v2.1/images/90d42cdd-cddc-43cd-a2de-f4f225ffb04a" status: 204 len: 0 microversion: 2.1 time: 1.558647 Oct 23 01:17:34.555775 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 952/1956] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:32 2022] DELETE /compute/v2.1/images/90d42cdd-cddc-43cd-a2de-f4f225ffb04a => generated 0 bytes in 1562 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:17:34.561379 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f72084af-1407-4b53-816f-c37ff66c956f tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:34.562365 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f72084af-1407-4b53-816f-c37ff66c956f tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: ff95f7f4-2b30-4083-8643-3f9b1d203d02] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:34.578774 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f72084af-1407-4b53-816f-c37ff66c956f tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:34.580028 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f72084af-1407-4b53-816f-c37ff66c956f tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:34.580767 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f72084af-1407-4b53-816f-c37ff66c956f tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:34.584271 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f72084af-1407-4b53-816f-c37ff66c956f tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:34.585025 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f72084af-1407-4b53-816f-c37ff66c956f tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:34.585707 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f72084af-1407-4b53-816f-c37ff66c956f tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:34.602991 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-f72084af-1407-4b53-816f-c37ff66c956f tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] HTTP exception thrown: Instance ff95f7f4-2b30-4083-8643-3f9b1d203d02 could not be found. Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f72084af-1407-4b53-816f-c37ff66c956f tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Request method failure captured: Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 HTTP/1.1 Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJTa-Wr5aQCLD3rHcHuWPO3k5Zd2x-Zj7msg1WbzBDpSz4nRffXqZyRc9nMkn-5sublS8Ra6cTmrG53-WjP6GHC8b93M3FjCGplKfzSQ_ARzbaX5VMNkF0TTzAxLiwBLsBoWRkYDWTDysXQOWpDSoHRrySRzsmQo-BI_ZSGX2bM3-b8 Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: eb058785345d4e58a5820445efe09bee Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-MigrationsAdminTest-2041739261 Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/eb058785345d4e58a5820445efe09bee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_eb058785345d4e58a5820445efe09bee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eb058785345d4e58a5820445efe09bee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eb058785345d4e58a5820445efe09bee"}]}] Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-MigrationsAdminTest-2041739261 Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: eb058785345d4e58a5820445efe09bee Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-MigrationsAdminTest-2041739261 Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-MigrationsAdminTest-2041739261-project Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 547aed83a7e44becb9c89dc6bae62255 Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-MigrationsAdminTest-2041739261-project Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: exception: Instance ff95f7f4-2b30-4083-8643-3f9b1d203d02 could not be found. Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'ff95f7f4-2b30-4083-8643-3f9b1d203d02'} Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff95f7f4-2b30-4083-8643-3f9b1d203d02 could not be found. Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff95f7f4-2b30-4083-8643-3f9b1d203d02 could not be found. Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:17:34.605155 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:34.609929 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:34.609929 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:17:34.609929 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:17:34.609929 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:17:34.609929 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:17:34.609929 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff95f7f4-2b30-4083-8643-3f9b1d203d02 could not be found. Oct 23 01:17:34.609929 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:34.612323 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f72084af-1407-4b53-816f-c37ff66c956f tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Returning 404 to user: Instance ff95f7f4-2b30-4083-8643-3f9b1d203d02 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:17:34.613655 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f72084af-1407-4b53-816f-c37ff66c956f tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02" status: 404 len: 111 microversion: 2.1 time: 0.056467 Oct 23 01:17:34.617757 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 953/1957] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:34 2022] GET /compute/v2.1/servers/ff95f7f4-2b30-4083-8643-3f9b1d203d02 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:17:34.623920 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-a36992ce-5498-452a-84d7-e7eac87783bf req-d049106e-9753-4d5b-8e74-0745e07c6129 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdd228c7-614f-4742-932f-5cb7faf5a68c", "tag": "8eb58394-2229-4f50-8d19-48d755a79f37"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:17:34.650150 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-a36992ce-5498-452a-84d7-e7eac87783bf req-d049106e-9753-4d5b-8e74-0745e07c6129 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:34.651043 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-a36992ce-5498-452a-84d7-e7eac87783bf req-d049106e-9753-4d5b-8e74-0745e07c6129 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:34.651754 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-a36992ce-5498-452a-84d7-e7eac87783bf req-d049106e-9753-4d5b-8e74-0745e07c6129 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:34.666658 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-a36992ce-5498-452a-84d7-e7eac87783bf req-d049106e-9753-4d5b-8e74-0745e07c6129 service nova] Creating event network-changed:8eb58394-2229-4f50-8d19-48d755a79f37 for instance bdd228c7-614f-4742-932f-5cb7faf5a68c on n-h2-master-1 Oct 23 01:17:34.672853 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-a36992ce-5498-452a-84d7-e7eac87783bf req-d049106e-9753-4d5b-8e74-0745e07c6129 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053428 Oct 23 01:17:34.673650 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 954/1958] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:17:34.680023 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3c587232-39ae-4011-bc44-acaf7f894901 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:34.680752 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3c587232-39ae-4011-bc44-acaf7f894901 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:34.688132 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3c587232-39ae-4011-bc44-acaf7f894901 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:34.695244 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3c587232-39ae-4011-bc44-acaf7f894901 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:34.695244 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3c587232-39ae-4011-bc44-acaf7f894901 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:34.695244 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3c587232-39ae-4011-bc44-acaf7f894901 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:34.695244 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3c587232-39ae-4011-bc44-acaf7f894901 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:34.695244 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3c587232-39ae-4011-bc44-acaf7f894901 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:34.996565 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c6c84d86-324f-47aa-97a4-349a226f934c tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:35.006976 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c6c84d86-324f-47aa-97a4-349a226f934c tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/6d55bc9b-0956-48c3-956a-e72457f8d95e" status: 200 len: 1472 microversion: 2.1 time: 0.816225 Oct 23 01:17:35.010679 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1005/1959] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:34 2022] GET /compute/v2.1/servers/6d55bc9b-0956-48c3-956a-e72457f8d95e => generated 1472 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:35.019169 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3295c232-aa1d-4c55-9554-f59a93238c22 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.6.81"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:17:35.152405 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3c587232-39ae-4011-bc44-acaf7f894901 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:35.168238 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3c587232-39ae-4011-bc44-acaf7f894901 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:35.171904 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3c587232-39ae-4011-bc44-acaf7f894901 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:35.188997 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3c587232-39ae-4011-bc44-acaf7f894901 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7" status: 200 len: 1815 microversion: 2.25 time: 0.498539 Oct 23 01:17:35.190528 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 955/1960] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:17:34 2022] GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7 => generated 1815 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:17:35.217079 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ce1a1505-3e0b-47ed-8af7-ec003ede3456 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:35.217997 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ce1a1505-3e0b-47ed-8af7-ec003ede3456 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] [instance: 120895a2-d6c4-47f6-a6e4-32cbcf028037] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:35.235811 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce1a1505-3e0b-47ed-8af7-ec003ede3456 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:35.236790 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce1a1505-3e0b-47ed-8af7-ec003ede3456 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:35.239099 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce1a1505-3e0b-47ed-8af7-ec003ede3456 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:35.242268 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce1a1505-3e0b-47ed-8af7-ec003ede3456 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:35.243167 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce1a1505-3e0b-47ed-8af7-ec003ede3456 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:35.245237 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce1a1505-3e0b-47ed-8af7-ec003ede3456 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:35.329137 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce1a1505-3e0b-47ed-8af7-ec003ede3456 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:35.329893 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce1a1505-3e0b-47ed-8af7-ec003ede3456 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:35.330599 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce1a1505-3e0b-47ed-8af7-ec003ede3456 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:35.331279 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-ce1a1505-3e0b-47ed-8af7-ec003ede3456 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lazy-loading 'fault' on Instance uuid 120895a2-d6c4-47f6-a6e4-32cbcf028037 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:17:35.477603 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ce1a1505-3e0b-47ed-8af7-ec003ede3456 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:35.491355 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ce1a1505-3e0b-47ed-8af7-ec003ede3456 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:35.492815 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ce1a1505-3e0b-47ed-8af7-ec003ede3456 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7811b4427fd54e14956eae6faee795d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5474182023f5424c84fbe3a41bd47dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:35.494407 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ce1a1505-3e0b-47ed-8af7-ec003ede3456 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] 10.222.0.42 "GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037" status: 200 len: 1367 microversion: 2.57 time: 0.301586 Oct 23 01:17:35.495239 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 956/1961] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:17:35 2022] GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037 => generated 1367 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:17:35.500052 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9f9ae72e-4419-4a08-9974-f61442cf339d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:35.501017 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9f9ae72e-4419-4a08-9974-f61442cf339d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:35.507887 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f9ae72e-4419-4a08-9974-f61442cf339d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:35.508599 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f9ae72e-4419-4a08-9974-f61442cf339d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:35.509216 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f9ae72e-4419-4a08-9974-f61442cf339d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:35.510133 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f9ae72e-4419-4a08-9974-f61442cf339d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:35.510798 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f9ae72e-4419-4a08-9974-f61442cf339d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:35.511384 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f9ae72e-4419-4a08-9974-f61442cf339d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:35.666545 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3295c232-aa1d-4c55-9554-f59a93238c22 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: bdd228c7-614f-4742-932f-5cb7faf5a68c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:35.674511 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3295c232-aa1d-4c55-9554-f59a93238c22 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:35.675497 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3295c232-aa1d-4c55-9554-f59a93238c22 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:35.676700 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3295c232-aa1d-4c55-9554-f59a93238c22 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:35.678054 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3295c232-aa1d-4c55-9554-f59a93238c22 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:35.683939 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3295c232-aa1d-4c55-9554-f59a93238c22 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:35.683939 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3295c232-aa1d-4c55-9554-f59a93238c22 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:35.860958 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9f9ae72e-4419-4a08-9974-f61442cf339d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:35.875010 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9f9ae72e-4419-4a08-9974-f61442cf339d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1198 microversion: 2.1 time: 0.377881 Oct 23 01:17:35.875628 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 957/1962] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:35 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1198 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:35.897679 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-400b9102-dd45-44a4-94f4-b18728d440ae tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:35.897679 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-400b9102-dd45-44a4-94f4-b18728d440ae tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 7fc07c10-f37b-4374-bcc0-25793b180d9c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:35.907982 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-400b9102-dd45-44a4-94f4-b18728d440ae tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:35.908488 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-400b9102-dd45-44a4-94f4-b18728d440ae tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:35.913291 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-400b9102-dd45-44a4-94f4-b18728d440ae tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:35.914342 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-400b9102-dd45-44a4-94f4-b18728d440ae tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:35.915029 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-400b9102-dd45-44a4-94f4-b18728d440ae tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:35.915783 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-400b9102-dd45-44a4-94f4-b18728d440ae tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:35.971195 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:17:35.987379 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-400b9102-dd45-44a4-94f4-b18728d440ae tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 7fc07c10-f37b-4374-bcc0-25793b180d9c] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:17:36.165950 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3295c232-aa1d-4c55-9554-f59a93238c22 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "refresh_cache-bdd228c7-614f-4742-932f-5cb7faf5a68c" {{(pid=120945) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 23 01:17:36.165950 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3295c232-aa1d-4c55-9554-f59a93238c22 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquired lock "refresh_cache-bdd228c7-614f-4742-932f-5cb7faf5a68c" {{(pid=120945) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 23 01:17:36.374557 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-400b9102-dd45-44a4-94f4-b18728d440ae tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7fc07c10-f37b-4374-bcc0-25793b180d9c" status: 204 len: 0 microversion: 2.1 time: 0.496313 Oct 23 01:17:36.375227 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 958/1963] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:17:35 2022] DELETE /compute/v2.1/servers/7fc07c10-f37b-4374-bcc0-25793b180d9c => generated 0 bytes in 499 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:17:36.389553 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c973a5a9-0001-49f2-af94-defa8162185b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:36.389553 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c973a5a9-0001-49f2-af94-defa8162185b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 8025dc46-71af-4fec-8f54-5ae9e92cc31f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:36.409792 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c973a5a9-0001-49f2-af94-defa8162185b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:36.410747 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c973a5a9-0001-49f2-af94-defa8162185b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:36.411208 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c973a5a9-0001-49f2-af94-defa8162185b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:36.411922 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c973a5a9-0001-49f2-af94-defa8162185b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:36.412384 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c973a5a9-0001-49f2-af94-defa8162185b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:36.412811 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c973a5a9-0001-49f2-af94-defa8162185b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:36.478819 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c973a5a9-0001-49f2-af94-defa8162185b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 8025dc46-71af-4fec-8f54-5ae9e92cc31f] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:17:36.883065 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c973a5a9-0001-49f2-af94-defa8162185b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f" status: 204 len: 0 microversion: 2.1 time: 0.506184 Oct 23 01:17:36.884937 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 959/1964] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:17:36 2022] DELETE /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f => generated 0 bytes in 509 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:17:36.895743 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ee1e4b2d-f3f7-4976-877c-e68a226a5acf tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:36.896632 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ee1e4b2d-f3f7-4976-877c-e68a226a5acf tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 6d55bc9b-0956-48c3-956a-e72457f8d95e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:36.904192 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ee1e4b2d-f3f7-4976-877c-e68a226a5acf tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:36.904959 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ee1e4b2d-f3f7-4976-877c-e68a226a5acf tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:36.905861 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ee1e4b2d-f3f7-4976-877c-e68a226a5acf tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:36.907394 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ee1e4b2d-f3f7-4976-877c-e68a226a5acf tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:36.908320 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ee1e4b2d-f3f7-4976-877c-e68a226a5acf tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:36.908925 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ee1e4b2d-f3f7-4976-877c-e68a226a5acf tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:36.957468 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ee1e4b2d-f3f7-4976-877c-e68a226a5acf tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:36.958617 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ee1e4b2d-f3f7-4976-877c-e68a226a5acf tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:36.959257 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ee1e4b2d-f3f7-4976-877c-e68a226a5acf tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:36.960159 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-ee1e4b2d-f3f7-4976-877c-e68a226a5acf tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lazy-loading 'fault' on Instance uuid 6d55bc9b-0956-48c3-956a-e72457f8d95e {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:17:37.063070 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ee1e4b2d-f3f7-4976-877c-e68a226a5acf tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:37.075005 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ee1e4b2d-f3f7-4976-877c-e68a226a5acf tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/6d55bc9b-0956-48c3-956a-e72457f8d95e" status: 200 len: 1306 microversion: 2.1 time: 0.186723 Oct 23 01:17:37.078189 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 960/1965] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:36 2022] GET /compute/v2.1/servers/6d55bc9b-0956-48c3-956a-e72457f8d95e => generated 1306 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:37.086389 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-a9114c29-a3e7-41ea-ba13-a8d4056a6dd7 req-caed3f4e-7417-488e-86f4-18372b15e9e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fc07c10-f37b-4374-bcc0-25793b180d9c", "name": "network-vif-unplugged", "status": "completed", "tag": "bedfc922-9657-4f3f-8344-e550f8d72082"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:17:37.102642 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-a9114c29-a3e7-41ea-ba13-a8d4056a6dd7 req-caed3f4e-7417-488e-86f4-18372b15e9e9 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:37.104116 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-a9114c29-a3e7-41ea-ba13-a8d4056a6dd7 req-caed3f4e-7417-488e-86f4-18372b15e9e9 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:37.104778 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-a9114c29-a3e7-41ea-ba13-a8d4056a6dd7 req-caed3f4e-7417-488e-86f4-18372b15e9e9 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:37.125593 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-a9114c29-a3e7-41ea-ba13-a8d4056a6dd7 req-caed3f4e-7417-488e-86f4-18372b15e9e9 service nova] Creating event network-vif-unplugged:bedfc922-9657-4f3f-8344-e550f8d72082 for instance 7fc07c10-f37b-4374-bcc0-25793b180d9c on n-h1-master-1 Oct 23 01:17:37.138185 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-a9114c29-a3e7-41ea-ba13-a8d4056a6dd7 req-caed3f4e-7417-488e-86f4-18372b15e9e9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056498 Oct 23 01:17:37.145140 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 961/1966] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:17:37.145691 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-418f67a2-ab90-47cb-b9b1-11071cd19736 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:37.146839 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-418f67a2-ab90-47cb-b9b1-11071cd19736 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:37.153341 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-418f67a2-ab90-47cb-b9b1-11071cd19736 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:37.153949 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-418f67a2-ab90-47cb-b9b1-11071cd19736 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:37.154821 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-418f67a2-ab90-47cb-b9b1-11071cd19736 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:37.155538 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-418f67a2-ab90-47cb-b9b1-11071cd19736 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:37.156174 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-418f67a2-ab90-47cb-b9b1-11071cd19736 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:37.156611 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-418f67a2-ab90-47cb-b9b1-11071cd19736 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:37.850097 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-418f67a2-ab90-47cb-b9b1-11071cd19736 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:37.861200 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-418f67a2-ab90-47cb-b9b1-11071cd19736 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:37.864425 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-418f67a2-ab90-47cb-b9b1-11071cd19736 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:37.866154 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-418f67a2-ab90-47cb-b9b1-11071cd19736 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7" status: 200 len: 1815 microversion: 2.25 time: 0.725939 Oct 23 01:17:37.867052 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 962/1967] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:17:37 2022] GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7 => generated 1815 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:17:37.874411 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1233c64b-e19f-4bc8-8a9a-e48b5ca7f160 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:37.876148 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1233c64b-e19f-4bc8-8a9a-e48b5ca7f160 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] [instance: 120895a2-d6c4-47f6-a6e4-32cbcf028037] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:37.888839 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1233c64b-e19f-4bc8-8a9a-e48b5ca7f160 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:37.891485 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1233c64b-e19f-4bc8-8a9a-e48b5ca7f160 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:37.891485 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1233c64b-e19f-4bc8-8a9a-e48b5ca7f160 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:37.891485 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1233c64b-e19f-4bc8-8a9a-e48b5ca7f160 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:37.891788 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1233c64b-e19f-4bc8-8a9a-e48b5ca7f160 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:37.892131 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1233c64b-e19f-4bc8-8a9a-e48b5ca7f160 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:37.907082 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-1233c64b-e19f-4bc8-8a9a-e48b5ca7f160 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] HTTP exception thrown: Instance 120895a2-d6c4-47f6-a6e4-32cbcf028037 could not be found. Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1233c64b-e19f-4bc8-8a9a-e48b5ca7f160 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Request method failure captured: Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037 HTTP/1.1 Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJXwZHUYm5zT5VjfTD8bovhZa4iW8gAFUWBJCkYGssnonUN_k-MPkjNBJaWXXJLHEWcqi03Z27CM94x4uv_DojEpiBagcuZhsoYaxKM1C_cnp4SsMZLCxOz4agto_sWqW5xDjSZv8_VVLVq2NnQuV3EYyoUW8TG5WZHQ65ymDvK_fs8 Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: X-Openstack-Nova-Api-Version: 2.57 Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 5474182023f5424c84fbe3a41bd47dd9 Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServerShowV257Test-752077255 Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5474182023f5424c84fbe3a41bd47dd9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5474182023f5424c84fbe3a41bd47dd9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5474182023f5424c84fbe3a41bd47dd9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5474182023f5424c84fbe3a41bd47dd9"}]}] Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServerShowV257Test-752077255 Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 5474182023f5424c84fbe3a41bd47dd9 Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServerShowV257Test-752077255 Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServerShowV257Test-752077255-project Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 7811b4427fd54e14956eae6faee795d7 Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServerShowV257Test-752077255-project Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 120895a2-d6c4-47f6-a6e4-32cbcf028037 could not be found. Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '120895a2-d6c4-47f6-a6e4-32cbcf028037'} Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 120895a2-d6c4-47f6-a6e4-32cbcf028037 could not be found. Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 120895a2-d6c4-47f6-a6e4-32cbcf028037 could not be found. Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:17:37.909055 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:37.919797 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:37.919797 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:17:37.919797 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:17:37.919797 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:17:37.919797 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:17:37.919797 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 120895a2-d6c4-47f6-a6e4-32cbcf028037 could not be found. Oct 23 01:17:37.919797 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:37.919797 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1233c64b-e19f-4bc8-8a9a-e48b5ca7f160 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] Returning 404 to user: Instance 120895a2-d6c4-47f6-a6e4-32cbcf028037 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:17:37.919797 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1233c64b-e19f-4bc8-8a9a-e48b5ca7f160 tempest-ServerShowV257Test-752077255 tempest-ServerShowV257Test-752077255-project] 10.222.0.42 "GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037" status: 404 len: 111 microversion: 2.57 time: 0.042402 Oct 23 01:17:37.919797 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 963/1968] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:17:37 2022] GET /compute/v2.1/servers/120895a2-d6c4-47f6-a6e4-32cbcf028037 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:17:37.928434 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-25a6f437-66fd-48c1-be8d-67b85ff5e357 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-688037024", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "7a6a6c21-62ee-4ff5-ad89-ac85c31d0d64"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:17:37.999464 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-25a6f437-66fd-48c1-be8d-67b85ff5e357 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] validate_networks() for [('7a6a6c21-62ee-4ff5-ad89-ac85c31d0d64', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:17:38.259273 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-3295c232-aa1d-4c55-9554-f59a93238c22 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: bdd228c7-614f-4742-932f-5cb7faf5a68c] Building network info cache for instance {{(pid=120945) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 23 01:17:39.619055 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-25a6f437-66fd-48c1-be8d-67b85ff5e357 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:17:39.620109 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-25a6f437-66fd-48c1-be8d-67b85ff5e357 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:17:39.620757 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-25a6f437-66fd-48c1-be8d-67b85ff5e357 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:17:39.621340 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-25a6f437-66fd-48c1-be8d-67b85ff5e357 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:17:39.621924 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-25a6f437-66fd-48c1-be8d-67b85ff5e357 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:17:39.649427 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25a6f437-66fd-48c1-be8d-67b85ff5e357 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:39.650491 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25a6f437-66fd-48c1-be8d-67b85ff5e357 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:39.652490 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25a6f437-66fd-48c1-be8d-67b85ff5e357 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:39.654532 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25a6f437-66fd-48c1-be8d-67b85ff5e357 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:39.655220 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25a6f437-66fd-48c1-be8d-67b85ff5e357 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:39.656011 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25a6f437-66fd-48c1-be8d-67b85ff5e357 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:39.688309 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-25a6f437-66fd-48c1-be8d-67b85ff5e357 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Getting quotas for project 50bd4c137b6a42488f39d173d46520dd. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:17:39.697858 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-25a6f437-66fd-48c1-be8d-67b85ff5e357 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Getting quotas for user ecb97fa679eb4bf8a41862d3c248a217 and project 50bd4c137b6a42488f39d173d46520dd. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:17:39.752383 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-25a6f437-66fd-48c1-be8d-67b85ff5e357 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:17:39.763417 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-25a6f437-66fd-48c1-be8d-67b85ff5e357 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 40104c3d-0e82-449a-a331-c4f6ba80afaf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:17:39.929846 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-25a6f437-66fd-48c1-be8d-67b85ff5e357 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.017581 Oct 23 01:17:39.932907 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 964/1969] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:17:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2021 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:17:39.943300 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-145340ab-f276-4217-85a7-8cc59307d4ae req-24abc148-317b-4ff7-aa21-8b4f29412edc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d55bc9b-0956-48c3-956a-e72457f8d95e", "name": "network-vif-deleted", "tag": "03879caf-2024-417c-867f-e0c1d4c40f1d"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:17:39.986850 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-145340ab-f276-4217-85a7-8cc59307d4ae req-24abc148-317b-4ff7-aa21-8b4f29412edc service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:39.990159 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-145340ab-f276-4217-85a7-8cc59307d4ae req-24abc148-317b-4ff7-aa21-8b4f29412edc service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:39.991160 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-145340ab-f276-4217-85a7-8cc59307d4ae req-24abc148-317b-4ff7-aa21-8b4f29412edc service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:40.037791 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-145340ab-f276-4217-85a7-8cc59307d4ae req-24abc148-317b-4ff7-aa21-8b4f29412edc service nova] Creating event network-vif-deleted:03879caf-2024-417c-867f-e0c1d4c40f1d for instance 6d55bc9b-0956-48c3-956a-e72457f8d95e on n-h1-master-1 Oct 23 01:17:40.057147 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-145340ab-f276-4217-85a7-8cc59307d4ae req-24abc148-317b-4ff7-aa21-8b4f29412edc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122621 Oct 23 01:17:40.061466 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 965/1970] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:17:40.082591 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4068af03-eb4a-4179-9135-47c092681148 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:40.083911 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4068af03-eb4a-4179-9135-47c092681148 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 8025dc46-71af-4fec-8f54-5ae9e92cc31f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:40.098130 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-3295c232-aa1d-4c55-9554-f59a93238c22 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: bdd228c7-614f-4742-932f-5cb7faf5a68c] Updating instance_info_cache with network_info: [{"id": "8eb58394-2229-4f50-8d19-48d755a79f37", "address": "fa:16:3e:e4:e1:d4", "network": {"id": "1fd1125a-5e06-4668-a85b-393b7a6d4c8a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1026242889-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "386d20bba06b48be9a7e51162dc4d814", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8eb58394-22", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120945) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 23 01:17:40.108284 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4068af03-eb4a-4179-9135-47c092681148 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:40.109098 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4068af03-eb4a-4179-9135-47c092681148 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:40.109791 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4068af03-eb4a-4179-9135-47c092681148 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:40.111668 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4068af03-eb4a-4179-9135-47c092681148 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:40.112378 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4068af03-eb4a-4179-9135-47c092681148 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:40.113592 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4068af03-eb4a-4179-9135-47c092681148 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:40.173620 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3295c232-aa1d-4c55-9554-f59a93238c22 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Releasing lock "refresh_cache-bdd228c7-614f-4742-932f-5cb7faf5a68c" {{(pid=120945) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 23 01:17:40.174942 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3295c232-aa1d-4c55-9554-f59a93238c22 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] 10.222.0.42 "POST /compute/v2.1/servers/bdd228c7-614f-4742-932f-5cb7faf5a68c/action" status: 202 len: 0 microversion: 2.1 time: 5.163110 Oct 23 01:17:40.176446 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1006/1971] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:17:35 2022] POST /compute/v2.1/servers/bdd228c7-614f-4742-932f-5cb7faf5a68c/action => generated 0 bytes in 5165 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 23 01:17:40.186076 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fa3cfd28-8913-4851-a5f4-bcac2864d0f4 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:40.193153 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-fa3cfd28-8913-4851-a5f4-bcac2864d0f4 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:40.214074 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fa3cfd28-8913-4851-a5f4-bcac2864d0f4 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:40.214868 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fa3cfd28-8913-4851-a5f4-bcac2864d0f4 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:40.216281 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fa3cfd28-8913-4851-a5f4-bcac2864d0f4 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:40.217820 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fa3cfd28-8913-4851-a5f4-bcac2864d0f4 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:40.218566 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fa3cfd28-8913-4851-a5f4-bcac2864d0f4 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:40.219209 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fa3cfd28-8913-4851-a5f4-bcac2864d0f4 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:40.240985 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:17:40.289408 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4068af03-eb4a-4179-9135-47c092681148 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:40.318206 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4068af03-eb4a-4179-9135-47c092681148 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f" status: 200 len: 1491 microversion: 2.1 time: 0.254868 Oct 23 01:17:40.331029 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 966/1972] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:40 2022] GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f => generated 1491 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:40.599551 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-fa3cfd28-8913-4851-a5f4-bcac2864d0f4 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:40.615687 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fa3cfd28-8913-4851-a5f4-bcac2864d0f4 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1198 microversion: 2.1 time: 0.438036 Oct 23 01:17:40.630009 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1007/1973] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:40 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1198 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:40.630009 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-768d2958-1fef-475f-bc5e-0d2ca4567476 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:40.630009 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-768d2958-1fef-475f-bc5e-0d2ca4567476 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 6d55bc9b-0956-48c3-956a-e72457f8d95e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:40.637877 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-768d2958-1fef-475f-bc5e-0d2ca4567476 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:40.639714 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-768d2958-1fef-475f-bc5e-0d2ca4567476 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:40.640171 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-768d2958-1fef-475f-bc5e-0d2ca4567476 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:40.640924 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-768d2958-1fef-475f-bc5e-0d2ca4567476 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:40.642807 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-768d2958-1fef-475f-bc5e-0d2ca4567476 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:40.643390 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-768d2958-1fef-475f-bc5e-0d2ca4567476 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:40.676929 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-768d2958-1fef-475f-bc5e-0d2ca4567476 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] HTTP exception thrown: Instance 6d55bc9b-0956-48c3-956a-e72457f8d95e could not be found. Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-768d2958-1fef-475f-bc5e-0d2ca4567476 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Request method failure captured: Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/6d55bc9b-0956-48c3-956a-e72457f8d95e HTTP/1.1 Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJVv0uHUZkawxRif88fKy9LhJENRPZsKhmf6zOBQWEzP00qmPQkqAca2jhb2lRXN9t0zC2JkLeeBldWCPH61ICeNt4v5sTKxLKhNmtzMUUime8-v0hyE48rstyJIK6CJypqB2ITpC6L9yRd-7i6fCZp0NigLnXS0XEU_z_Ej3fGN7bI Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 47aadec780734d03a262d4021f48d625 Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServersOnMultiNodesTest-1204013784 Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/47aadec780734d03a262d4021f48d625"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_47aadec780734d03a262d4021f48d625"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/47aadec780734d03a262d4021f48d625"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/47aadec780734d03a262d4021f48d625"}]}] Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServersOnMultiNodesTest-1204013784 Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 47aadec780734d03a262d4021f48d625 Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1204013784 Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServersOnMultiNodesTest-1204013784-project Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 519c893a1e094200b882cf23db7cae54 Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServersOnMultiNodesTest-1204013784-project Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 6d55bc9b-0956-48c3-956a-e72457f8d95e could not be found. Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '6d55bc9b-0956-48c3-956a-e72457f8d95e'} Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d55bc9b-0956-48c3-956a-e72457f8d95e could not be found. Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d55bc9b-0956-48c3-956a-e72457f8d95e could not be found. Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:17:40.678974 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:17:40.684392 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:40.684392 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:17:40.684392 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:17:40.684392 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:17:40.684392 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:17:40.684392 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d55bc9b-0956-48c3-956a-e72457f8d95e could not be found. Oct 23 01:17:40.684392 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:17:40.691213 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-768d2958-1fef-475f-bc5e-0d2ca4567476 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Returning 404 to user: Instance 6d55bc9b-0956-48c3-956a-e72457f8d95e could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:17:40.692537 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-768d2958-1fef-475f-bc5e-0d2ca4567476 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/6d55bc9b-0956-48c3-956a-e72457f8d95e" status: 404 len: 111 microversion: 2.1 time: 0.073470 Oct 23 01:17:40.696404 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1008/1974] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:40 2022] GET /compute/v2.1/servers/6d55bc9b-0956-48c3-956a-e72457f8d95e => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:17:40.700106 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b09970c7-32d1-4e98-a7ff-a8f79d6f4fd2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:40.704678 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b09970c7-32d1-4e98-a7ff-a8f79d6f4fd2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:40.744076 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b09970c7-32d1-4e98-a7ff-a8f79d6f4fd2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:40.748420 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b09970c7-32d1-4e98-a7ff-a8f79d6f4fd2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:40.750771 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b09970c7-32d1-4e98-a7ff-a8f79d6f4fd2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:40.762726 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b09970c7-32d1-4e98-a7ff-a8f79d6f4fd2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:40.762726 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b09970c7-32d1-4e98-a7ff-a8f79d6f4fd2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:40.762726 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b09970c7-32d1-4e98-a7ff-a8f79d6f4fd2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:41.009558 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-323af847-a9ee-464e-84cc-836bb655f4e3 tempest-SecurityGroupsNegativeTestJSON-1762943091 tempest-SecurityGroupsNegativeTestJSON-1762943091-project] Calling method '.version_select at 0x7f5cc2201430>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:41.070253 n-d-master-1 devstack@n-api.service[120944]: DEBUG neutronclient.v2_0.client [None req-323af847-a9ee-464e-84cc-836bb655f4e3 tempest-SecurityGroupsNegativeTestJSON-1762943091 tempest-SecurityGroupsNegativeTestJSON-1762943091-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 87d891e2-7049-42bf-9fc5-3c6e73fd3db2 does not exist", "detail": ""}} {{(pid=120944) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 23 01:17:41.070895 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.security_group_api [None req-323af847-a9ee-464e-84cc-836bb655f4e3 tempest-SecurityGroupsNegativeTestJSON-1762943091 tempest-SecurityGroupsNegativeTestJSON-1762943091-project] Neutron security group 87d891e2-7049-42bf-9fc5-3c6e73fd3db2 not found {{(pid=120944) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 23 01:17:41.071441 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-323af847-a9ee-464e-84cc-836bb655f4e3 tempest-SecurityGroupsNegativeTestJSON-1762943091 tempest-SecurityGroupsNegativeTestJSON-1762943091-project] HTTP exception thrown: Security group 87d891e2-7049-42bf-9fc5-3c6e73fd3db2 does not exist Oct 23 01:17:41.071441 n-d-master-1 devstack@n-api.service[120944]: Neutron server returns request_ids: ['req-caa0d038-9b5f-4b9f-82ad-b7a05f4702ad'] Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-323af847-a9ee-464e-84cc-836bb655f4e3 tempest-SecurityGroupsNegativeTestJSON-1762943091 tempest-SecurityGroupsNegativeTestJSON-1762943091-project] Request method failure captured: Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/os-security-groups/87d891e2-7049-42bf-9fc5-3c6e73fd3db2 HTTP/1.1 Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJYxxTXOnf1vSTk4nBteN5QEPWJK-RuuqUzPKE6ahEGobU9aGxS9xvVn7CfE1oDjL89LLjU5JZJSbzJkALgcJ58seSkppp8g80qMn_SITJmA3NNIAvgiPmRLKjudK9ijW2QYBB-sr0IGa-G9vGxZjncGQWvpaj8JKuvbIezCYRYsdd0 Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 1e823abcab484d2fb32ac12e846e95f0 Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1762943091 Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1e823abcab484d2fb32ac12e846e95f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1e823abcab484d2fb32ac12e846e95f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1e823abcab484d2fb32ac12e846e95f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1e823abcab484d2fb32ac12e846e95f0"}]}] Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1762943091 Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 1e823abcab484d2fb32ac12e846e95f0 Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1762943091 Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-SecurityGroupsNegativeTestJSON-1762943091-project Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 7b260d3a773e47a990fad3262ccc2e4f Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1762943091-project Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: method: Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: exception: Security group 87d891e2-7049-42bf-9fc5-3c6e73fd3db2 does not exist Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: Neutron server returns request_ids: ['req-caa0d038-9b5f-4b9f-82ad-b7a05f4702ad'] Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '87d891e2-7049-42bf-9fc5-3c6e73fd3db2'} Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 23 01:17:41.077113 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 87d891e2-7049-42bf-9fc5-3c6e73fd3db2 does not exist Oct 23 01:17:41.082699 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-caa0d038-9b5f-4b9f-82ad-b7a05f4702ad'] Oct 23 01:17:41.082699 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:41.082699 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:17:41.082699 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:41.082699 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:41.082699 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 23 01:17:41.082699 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 23 01:17:41.082699 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 23 01:17:41.082699 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 23 01:17:41.082699 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 87d891e2-7049-42bf-9fc5-3c6e73fd3db2 does not exist Oct 23 01:17:41.082699 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-caa0d038-9b5f-4b9f-82ad-b7a05f4702ad'] Oct 23 01:17:41.082699 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:41.082699 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:17:41.082699 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:41.082699 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:41.082699 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:17:41.082699 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:17:41.082699 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:17:41.082699 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:17:41.082699 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:17:41.082699 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:17:41.082699 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:17:41.082699 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:17:41.082699 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 23 01:17:41.082699 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 23 01:17:41.082699 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 87d891e2-7049-42bf-9fc5-3c6e73fd3db2 does not exist Oct 23 01:17:41.082699 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-caa0d038-9b5f-4b9f-82ad-b7a05f4702ad'] Oct 23 01:17:41.082699 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:41.082699 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:17:41.082699 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:41.082699 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:41.082699 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:17:41.082699 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:17:41.082699 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:17:41.082699 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:17:41.082699 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 87d891e2-7049-42bf-9fc5-3c6e73fd3db2 does not exist Oct 23 01:17:41.082699 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-caa0d038-9b5f-4b9f-82ad-b7a05f4702ad'] Oct 23 01:17:41.082699 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:41.082699 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-323af847-a9ee-464e-84cc-836bb655f4e3 tempest-SecurityGroupsNegativeTestJSON-1762943091 tempest-SecurityGroupsNegativeTestJSON-1762943091-project] Returning 404 to user: Security group 87d891e2-7049-42bf-9fc5-3c6e73fd3db2 does not exist Oct 23 01:17:41.082699 n-d-master-1 devstack@n-api.service[120944]: Neutron server returns request_ids: ['req-caa0d038-9b5f-4b9f-82ad-b7a05f4702ad'] {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:17:41.082699 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-323af847-a9ee-464e-84cc-836bb655f4e3 tempest-SecurityGroupsNegativeTestJSON-1762943091 tempest-SecurityGroupsNegativeTestJSON-1762943091-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/87d891e2-7049-42bf-9fc5-3c6e73fd3db2" status: 404 len: 194 microversion: 2.1 time: 0.740300 Oct 23 01:17:41.082699 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 967/1975] 10.222.0.42 () {58 vars in 1272 bytes} [Sun Oct 23 01:17:40 2022] DELETE /compute/v2.1/os-security-groups/87d891e2-7049-42bf-9fc5-3c6e73fd3db2 => generated 194 bytes in 742 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:17:41.091504 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-da923f6e-4841-4279-b93d-be0ddbe88d42 req-b2b94aa9-e926-4c00-8759-012772d30085 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dad12d7a-a01e-4f91-b35e-4f9f83df5b3b", "name": "network-vif-plugged", "status": "completed", "tag": "b5a5b9cd-a440-4270-b48f-5816d8d587a8"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:17:41.124235 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-da923f6e-4841-4279-b93d-be0ddbe88d42 req-b2b94aa9-e926-4c00-8759-012772d30085 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:41.124799 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-da923f6e-4841-4279-b93d-be0ddbe88d42 req-b2b94aa9-e926-4c00-8759-012772d30085 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:41.132126 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-da923f6e-4841-4279-b93d-be0ddbe88d42 req-b2b94aa9-e926-4c00-8759-012772d30085 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:41.175359 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b09970c7-32d1-4e98-a7ff-a8f79d6f4fd2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:41.177833 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-da923f6e-4841-4279-b93d-be0ddbe88d42 req-b2b94aa9-e926-4c00-8759-012772d30085 service nova] Creating event network-vif-plugged:b5a5b9cd-a440-4270-b48f-5816d8d587a8 for instance dad12d7a-a01e-4f91-b35e-4f9f83df5b3b on n-h2-master-1 Oct 23 01:17:41.191991 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-da923f6e-4841-4279-b93d-be0ddbe88d42 req-b2b94aa9-e926-4c00-8759-012772d30085 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110382 Oct 23 01:17:41.196949 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b09970c7-32d1-4e98-a7ff-a8f79d6f4fd2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:41.197654 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 968/1976] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:17:41.198876 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b09970c7-32d1-4e98-a7ff-a8f79d6f4fd2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:41.200699 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b09970c7-32d1-4e98-a7ff-a8f79d6f4fd2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7" status: 200 len: 1815 microversion: 2.25 time: 0.506263 Oct 23 01:17:41.201747 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1009/1977] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:17:40 2022] GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7 => generated 1815 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:17:41.208252 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d0173a0d-d83c-4505-aa45-1bbb5b110cda tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:41.210811 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d0173a0d-d83c-4505-aa45-1bbb5b110cda tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: bdd228c7-614f-4742-932f-5cb7faf5a68c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:41.216410 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0173a0d-d83c-4505-aa45-1bbb5b110cda tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:41.226709 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a7a53807-b5f4-4761-b56a-a106894fcfef tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:41.226881 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0173a0d-d83c-4505-aa45-1bbb5b110cda tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:41.227428 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0173a0d-d83c-4505-aa45-1bbb5b110cda tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:41.230291 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0173a0d-d83c-4505-aa45-1bbb5b110cda tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:41.230782 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0173a0d-d83c-4505-aa45-1bbb5b110cda tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:41.231236 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0173a0d-d83c-4505-aa45-1bbb5b110cda tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:41.232003 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a7a53807-b5f4-4761-b56a-a106894fcfef tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 40104c3d-0e82-449a-a331-c4f6ba80afaf] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:41.313047 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d0173a0d-d83c-4505-aa45-1bbb5b110cda tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: bdd228c7-614f-4742-932f-5cb7faf5a68c] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:17:41.456182 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a7a53807-b5f4-4761-b56a-a106894fcfef tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:41.471585 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a7a53807-b5f4-4761-b56a-a106894fcfef tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf" status: 200 len: 1207 microversion: 2.1 time: 0.271955 Oct 23 01:17:41.477272 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 969/1978] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:41 2022] GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf => generated 1207 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:41.482804 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-790760ad-a4cb-43b7-b55d-7f0f01fef72a req-87aa28b3-b5c1-4acf-9c54-8c53db510c1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8025dc46-71af-4fec-8f54-5ae9e92cc31f", "name": "network-vif-deleted", "tag": "9dbeafb3-f8f6-45eb-993c-c817b00700d0"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:17:41.509949 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-790760ad-a4cb-43b7-b55d-7f0f01fef72a req-87aa28b3-b5c1-4acf-9c54-8c53db510c1f service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:41.510868 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-790760ad-a4cb-43b7-b55d-7f0f01fef72a req-87aa28b3-b5c1-4acf-9c54-8c53db510c1f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:41.512188 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-790760ad-a4cb-43b7-b55d-7f0f01fef72a req-87aa28b3-b5c1-4acf-9c54-8c53db510c1f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:41.526771 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-790760ad-a4cb-43b7-b55d-7f0f01fef72a req-87aa28b3-b5c1-4acf-9c54-8c53db510c1f service nova] Creating event network-vif-deleted:9dbeafb3-f8f6-45eb-993c-c817b00700d0 for instance 8025dc46-71af-4fec-8f54-5ae9e92cc31f on n-h2-master-1 Oct 23 01:17:41.534234 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-790760ad-a4cb-43b7-b55d-7f0f01fef72a req-87aa28b3-b5c1-4acf-9c54-8c53db510c1f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054624 Oct 23 01:17:41.535724 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 970/1979] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:17:41.543544 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f2059633-2f9d-4023-bebf-4055cb9f49f9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:41.544415 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f2059633-2f9d-4023-bebf-4055cb9f49f9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 1fb6d268-9409-4ca5-9429-6f00ae7b86c1] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:41.552601 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2059633-2f9d-4023-bebf-4055cb9f49f9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:41.553196 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2059633-2f9d-4023-bebf-4055cb9f49f9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:41.553948 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2059633-2f9d-4023-bebf-4055cb9f49f9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:41.560701 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2059633-2f9d-4023-bebf-4055cb9f49f9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:41.560701 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2059633-2f9d-4023-bebf-4055cb9f49f9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:41.560701 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2059633-2f9d-4023-bebf-4055cb9f49f9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:41.597514 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f2059633-2f9d-4023-bebf-4055cb9f49f9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 1fb6d268-9409-4ca5-9429-6f00ae7b86c1] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:17:41.808536 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d0173a0d-d83c-4505-aa45-1bbb5b110cda tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bdd228c7-614f-4742-932f-5cb7faf5a68c" status: 204 len: 0 microversion: 2.1 time: 0.605213 Oct 23 01:17:41.809846 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1010/1980] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:17:41 2022] DELETE /compute/v2.1/servers/bdd228c7-614f-4742-932f-5cb7faf5a68c => generated 0 bytes in 607 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:17:41.831936 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d2ecaa77-1474-4fcb-9281-71b3be44e57f tempest-SecurityGroupsNegativeTestJSON-1762943091 tempest-SecurityGroupsNegativeTestJSON-1762943091-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.020534 Oct 23 01:17:41.831936 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1011/1981] 10.222.0.42 () {58 vars in 1164 bytes} [Sun Oct 23 01:17:41 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 22 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 23 01:17:41.841597 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-193886f5-5aca-410a-876f-ae69c4ec0f3b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:41.842275 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-193886f5-5aca-410a-876f-ae69c4ec0f3b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 8025dc46-71af-4fec-8f54-5ae9e92cc31f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:41.862434 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-193886f5-5aca-410a-876f-ae69c4ec0f3b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:41.863488 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-193886f5-5aca-410a-876f-ae69c4ec0f3b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:41.875547 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-193886f5-5aca-410a-876f-ae69c4ec0f3b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:41.875547 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-193886f5-5aca-410a-876f-ae69c4ec0f3b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:41.875547 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-193886f5-5aca-410a-876f-ae69c4ec0f3b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:41.875547 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-193886f5-5aca-410a-876f-ae69c4ec0f3b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:41.930275 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f2059633-2f9d-4023-bebf-4055cb9f49f9 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1fb6d268-9409-4ca5-9429-6f00ae7b86c1" status: 204 len: 0 microversion: 2.1 time: 0.391387 Oct 23 01:17:41.931425 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 971/1982] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:17:41 2022] DELETE /compute/v2.1/servers/1fb6d268-9409-4ca5-9429-6f00ae7b86c1 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:17:41.940507 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-193886f5-5aca-410a-876f-ae69c4ec0f3b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:41.940675 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-81295aa9-23cc-4046-b181-1add3875f8f3 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:41.941411 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-193886f5-5aca-410a-876f-ae69c4ec0f3b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:41.941888 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-193886f5-5aca-410a-876f-ae69c4ec0f3b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:41.942375 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-193886f5-5aca-410a-876f-ae69c4ec0f3b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lazy-loading 'fault' on Instance uuid 8025dc46-71af-4fec-8f54-5ae9e92cc31f {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:17:41.944797 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-81295aa9-23cc-4046-b181-1add3875f8f3 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:41.959742 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-81295aa9-23cc-4046-b181-1add3875f8f3 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:41.961592 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-81295aa9-23cc-4046-b181-1add3875f8f3 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:41.962425 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-81295aa9-23cc-4046-b181-1add3875f8f3 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:41.964033 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-81295aa9-23cc-4046-b181-1add3875f8f3 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:41.965252 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-81295aa9-23cc-4046-b181-1add3875f8f3 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:41.965895 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-81295aa9-23cc-4046-b181-1add3875f8f3 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:42.063276 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-193886f5-5aca-410a-876f-ae69c4ec0f3b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:42.075131 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-193886f5-5aca-410a-876f-ae69c4ec0f3b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f" status: 200 len: 1368 microversion: 2.1 time: 0.241622 Oct 23 01:17:42.075728 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1012/1983] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:41 2022] GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f => generated 1368 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:42.096663 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9a643d1a-d53e-4949-b93c-f03da281bebd tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.6.81"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:17:42.100166 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9a643d1a-d53e-4949-b93c-f03da281bebd tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: a78b5bc9-4e8f-44d7-879c-737838cfe1b6] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:42.106673 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a643d1a-d53e-4949-b93c-f03da281bebd tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:42.107372 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a643d1a-d53e-4949-b93c-f03da281bebd tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:42.108048 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a643d1a-d53e-4949-b93c-f03da281bebd tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:42.108958 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a643d1a-d53e-4949-b93c-f03da281bebd tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:42.109583 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a643d1a-d53e-4949-b93c-f03da281bebd tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:42.110241 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a643d1a-d53e-4949-b93c-f03da281bebd tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:42.141490 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a643d1a-d53e-4949-b93c-f03da281bebd tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "refresh_cache-a78b5bc9-4e8f-44d7-879c-737838cfe1b6" {{(pid=120945) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 23 01:17:42.141900 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a643d1a-d53e-4949-b93c-f03da281bebd tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquired lock "refresh_cache-a78b5bc9-4e8f-44d7-879c-737838cfe1b6" {{(pid=120945) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 23 01:17:42.344583 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-81295aa9-23cc-4046-b181-1add3875f8f3 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:42.356998 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-81295aa9-23cc-4046-b181-1add3875f8f3 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1198 microversion: 2.1 time: 0.423950 Oct 23 01:17:42.358318 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 972/1984] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:41 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1198 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:42.364492 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5335cef2-8056-4aa3-b507-256acfc18be0 tempest-SecurityGroupsNegativeTestJSON-1762943091 tempest-SecurityGroupsNegativeTestJSON-1762943091-project] Calling method '.version_select at 0x7f5cc19c4700>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:42.867943 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5335cef2-8056-4aa3-b507-256acfc18be0 tempest-SecurityGroupsNegativeTestJSON-1762943091 tempest-SecurityGroupsNegativeTestJSON-1762943091-project] 10.222.0.42 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.508096 Oct 23 01:17:42.877230 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 973/1985] 10.222.0.42 () {58 vars in 1158 bytes} [Sun Oct 23 01:17:42 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:17:42.883705 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6a75de7b-9e5e-48ee-8c6d-44b7c973b056 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:42.884323 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6a75de7b-9e5e-48ee-8c6d-44b7c973b056 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 1fb6d268-9409-4ca5-9429-6f00ae7b86c1] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:42.891106 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6a75de7b-9e5e-48ee-8c6d-44b7c973b056 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:42.891595 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6a75de7b-9e5e-48ee-8c6d-44b7c973b056 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:42.892031 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6a75de7b-9e5e-48ee-8c6d-44b7c973b056 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:42.892751 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6a75de7b-9e5e-48ee-8c6d-44b7c973b056 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:42.893204 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6a75de7b-9e5e-48ee-8c6d-44b7c973b056 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:42.893623 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6a75de7b-9e5e-48ee-8c6d-44b7c973b056 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:43.561956 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6a75de7b-9e5e-48ee-8c6d-44b7c973b056 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:43.576508 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6a75de7b-9e5e-48ee-8c6d-44b7c973b056 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/1fb6d268-9409-4ca5-9429-6f00ae7b86c1" status: 200 len: 1471 microversion: 2.1 time: 0.696675 Oct 23 01:17:43.590249 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 974/1986] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:42 2022] GET /compute/v2.1/servers/1fb6d268-9409-4ca5-9429-6f00ae7b86c1 => generated 1471 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:43.598215 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-d22131ea-a40c-43db-af40-7188118e99d6 req-fbe48274-cd2a-4947-8a3f-9031d66dd36e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdd228c7-614f-4742-932f-5cb7faf5a68c", "tag": "8eb58394-2229-4f50-8d19-48d755a79f37"}, {"server_uuid": "7fc07c10-f37b-4374-bcc0-25793b180d9c", "name": "network-vif-deleted", "tag": "bedfc922-9657-4f3f-8344-e550f8d72082"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:17:43.609735 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-d22131ea-a40c-43db-af40-7188118e99d6 req-fbe48274-cd2a-4947-8a3f-9031d66dd36e service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:43.610261 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-d22131ea-a40c-43db-af40-7188118e99d6 req-fbe48274-cd2a-4947-8a3f-9031d66dd36e service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:43.610700 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-d22131ea-a40c-43db-af40-7188118e99d6 req-fbe48274-cd2a-4947-8a3f-9031d66dd36e service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:43.628022 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-d22131ea-a40c-43db-af40-7188118e99d6 req-fbe48274-cd2a-4947-8a3f-9031d66dd36e service nova] Creating event network-changed:8eb58394-2229-4f50-8d19-48d755a79f37 for instance bdd228c7-614f-4742-932f-5cb7faf5a68c on n-h2-master-1 Oct 23 01:17:43.629055 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-d22131ea-a40c-43db-af40-7188118e99d6 req-fbe48274-cd2a-4947-8a3f-9031d66dd36e service nova] Creating event network-vif-deleted:bedfc922-9657-4f3f-8344-e550f8d72082 for instance 7fc07c10-f37b-4374-bcc0-25793b180d9c on n-h1-master-1 Oct 23 01:17:43.637516 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-d22131ea-a40c-43db-af40-7188118e99d6 req-fbe48274-cd2a-4947-8a3f-9031d66dd36e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.045572 Oct 23 01:17:43.641493 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 975/1987] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:17:43.648032 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fc612caf-301f-4a68-b836-ab409999238a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:43.649059 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fc612caf-301f-4a68-b836-ab409999238a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:43.667713 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fc612caf-301f-4a68-b836-ab409999238a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:43.668275 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fc612caf-301f-4a68-b836-ab409999238a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:43.668785 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fc612caf-301f-4a68-b836-ab409999238a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:43.670268 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fc612caf-301f-4a68-b836-ab409999238a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:43.670743 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fc612caf-301f-4a68-b836-ab409999238a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:43.671171 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fc612caf-301f-4a68-b836-ab409999238a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:44.130514 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fc612caf-301f-4a68-b836-ab409999238a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:44.145426 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fc612caf-301f-4a68-b836-ab409999238a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:44.147627 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fc612caf-301f-4a68-b836-ab409999238a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:44.154812 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fc612caf-301f-4a68-b836-ab409999238a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7" status: 200 len: 1815 microversion: 2.25 time: 0.506340 Oct 23 01:17:44.162389 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 976/1988] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:17:43 2022] GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7 => generated 1815 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:17:44.179943 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c37c145c-ad4e-49a7-9870-f9a1b4e31165 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:44.180450 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c37c145c-ad4e-49a7-9870-f9a1b4e31165 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 40104c3d-0e82-449a-a331-c4f6ba80afaf] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:44.209903 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c37c145c-ad4e-49a7-9870-f9a1b4e31165 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:44.213320 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c37c145c-ad4e-49a7-9870-f9a1b4e31165 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:44.213783 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c37c145c-ad4e-49a7-9870-f9a1b4e31165 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:44.214559 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c37c145c-ad4e-49a7-9870-f9a1b4e31165 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:44.215020 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c37c145c-ad4e-49a7-9870-f9a1b4e31165 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:44.220277 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c37c145c-ad4e-49a7-9870-f9a1b4e31165 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:44.240453 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:17:44.349675 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c37c145c-ad4e-49a7-9870-f9a1b4e31165 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:44.360867 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c37c145c-ad4e-49a7-9870-f9a1b4e31165 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf" status: 200 len: 1259 microversion: 2.1 time: 0.196079 Oct 23 01:17:44.362538 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 977/1989] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:44 2022] GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf => generated 1259 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:44.369531 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-efcf0a1d-45c4-4ed5-af4d-9bf3b9dcb59e tempest-SecurityGroupsNegativeTestJSON-1762943091 tempest-SecurityGroupsNegativeTestJSON-1762943091-project] Calling method '.version_select at 0x7f5cc1a09160>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:44.514980 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-9a643d1a-d53e-4949-b93c-f03da281bebd tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: a78b5bc9-4e8f-44d7-879c-737838cfe1b6] Building network info cache for instance {{(pid=120945) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 23 01:17:44.650384 n-d-master-1 devstack@n-api.service[120944]: DEBUG neutronclient.v2_0.client [None req-efcf0a1d-45c4-4ed5-af4d-9bf3b9dcb59e tempest-SecurityGroupsNegativeTestJSON-1762943091 tempest-SecurityGroupsNegativeTestJSON-1762943091-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=120944) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 23 01:17:44.651868 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-efcf0a1d-45c4-4ed5-af4d-9bf3b9dcb59e tempest-SecurityGroupsNegativeTestJSON-1762943091 tempest-SecurityGroupsNegativeTestJSON-1762943091-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 23 01:17:44.651868 n-d-master-1 devstack@n-api.service[120944]: Neutron server returns request_ids: ['req-0e7d8506-4a58-42c8-88ce-3a39d8840348'] Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-efcf0a1d-45c4-4ed5-af4d-9bf3b9dcb59e tempest-SecurityGroupsNegativeTestJSON-1762943091 tempest-SecurityGroupsNegativeTestJSON-1762943091-project] Request method failure captured: Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/os-security-groups/549387cd-7a84-4617-98f3-e1ce7d1dcae8 HTTP/1.1 Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJYxxTXOnf1vSTk4nBteN5QEPWJK-RuuqUzPKE6ahEGobU9aGxS9xvVn7CfE1oDjL89LLjU5JZJSbzJkALgcJ58seSkppp8g80qMn_SITJmA3NNIAvgiPmRLKjudK9ijW2QYBB-sr0IGa-G9vGxZjncGQWvpaj8JKuvbIezCYRYsdd0 Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 1e823abcab484d2fb32ac12e846e95f0 Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1762943091 Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1e823abcab484d2fb32ac12e846e95f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1e823abcab484d2fb32ac12e846e95f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1e823abcab484d2fb32ac12e846e95f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1e823abcab484d2fb32ac12e846e95f0"}]}] Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1762943091 Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 1e823abcab484d2fb32ac12e846e95f0 Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1762943091 Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-SecurityGroupsNegativeTestJSON-1762943091-project Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 7b260d3a773e47a990fad3262ccc2e4f Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1762943091-project Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: method: Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: exception: Insufficient rights for removing default security group. Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: Neutron server returns request_ids: ['req-0e7d8506-4a58-42c8-88ce-3a39d8840348'] Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '549387cd-7a84-4617-98f3-e1ce7d1dcae8'} Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 23 01:17:44.655040 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 23 01:17:44.659826 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0e7d8506-4a58-42c8-88ce-3a39d8840348'] Oct 23 01:17:44.659826 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:44.659826 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:17:44.659826 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:44.659826 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:44.659826 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 23 01:17:44.659826 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 23 01:17:44.659826 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 23 01:17:44.659826 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 23 01:17:44.659826 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 23 01:17:44.659826 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0e7d8506-4a58-42c8-88ce-3a39d8840348'] Oct 23 01:17:44.659826 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:44.659826 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:17:44.659826 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:44.659826 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:44.659826 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:17:44.659826 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:17:44.659826 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:17:44.659826 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:17:44.659826 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:17:44.659826 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:17:44.659826 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:17:44.659826 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:17:44.659826 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 23 01:17:44.659826 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 23 01:17:44.659826 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 23 01:17:44.659826 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0e7d8506-4a58-42c8-88ce-3a39d8840348'] Oct 23 01:17:44.659826 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:44.659826 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:17:44.659826 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:44.659826 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:44.659826 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:17:44.659826 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:17:44.659826 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:17:44.659826 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:17:44.659826 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 23 01:17:44.659826 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0e7d8506-4a58-42c8-88ce-3a39d8840348'] Oct 23 01:17:44.659826 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:44.659826 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-efcf0a1d-45c4-4ed5-af4d-9bf3b9dcb59e tempest-SecurityGroupsNegativeTestJSON-1762943091 tempest-SecurityGroupsNegativeTestJSON-1762943091-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 23 01:17:44.659826 n-d-master-1 devstack@n-api.service[120944]: Neutron server returns request_ids: ['req-0e7d8506-4a58-42c8-88ce-3a39d8840348'] {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:17:44.664850 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-efcf0a1d-45c4-4ed5-af4d-9bf3b9dcb59e tempest-SecurityGroupsNegativeTestJSON-1762943091 tempest-SecurityGroupsNegativeTestJSON-1762943091-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/549387cd-7a84-4617-98f3-e1ce7d1dcae8" status: 400 len: 182 microversion: 2.1 time: 0.295806 Oct 23 01:17:44.664850 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 978/1990] 10.222.0.42 () {58 vars in 1272 bytes} [Sun Oct 23 01:17:44 2022] DELETE /compute/v2.1/os-security-groups/549387cd-7a84-4617-98f3-e1ce7d1dcae8 => generated 182 bytes in 298 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:17:44.675825 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a7320c5e-d2c3-4f76-b341-25bd6366de93 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:44.676698 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a7320c5e-d2c3-4f76-b341-25bd6366de93 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 8025dc46-71af-4fec-8f54-5ae9e92cc31f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:44.685282 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a7320c5e-d2c3-4f76-b341-25bd6366de93 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:44.686021 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a7320c5e-d2c3-4f76-b341-25bd6366de93 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:44.686805 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a7320c5e-d2c3-4f76-b341-25bd6366de93 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:44.687832 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a7320c5e-d2c3-4f76-b341-25bd6366de93 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:44.688471 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a7320c5e-d2c3-4f76-b341-25bd6366de93 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:44.696811 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a7320c5e-d2c3-4f76-b341-25bd6366de93 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:44.716376 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-a7320c5e-d2c3-4f76-b341-25bd6366de93 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] HTTP exception thrown: Instance 8025dc46-71af-4fec-8f54-5ae9e92cc31f could not be found. Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a7320c5e-d2c3-4f76-b341-25bd6366de93 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Request method failure captured: Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f HTTP/1.1 Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJTa-Wr5aQCLD3rHcHuWPO3k5Zd2x-Zj7msg1WbzBDpSz4nRffXqZyRc9nMkn-5sublS8Ra6cTmrG53-WjP6GHC8b93M3FjCGplKfzSQ_ARzbaX5VMNkF0TTzAxLiwBLsBoWRkYDWTDysXQOWpDSoHRrySRzsmQo-BI_ZSGX2bM3-b8 Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: eb058785345d4e58a5820445efe09bee Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-MigrationsAdminTest-2041739261 Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/eb058785345d4e58a5820445efe09bee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_eb058785345d4e58a5820445efe09bee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eb058785345d4e58a5820445efe09bee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eb058785345d4e58a5820445efe09bee"}]}] Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-MigrationsAdminTest-2041739261 Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: eb058785345d4e58a5820445efe09bee Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-MigrationsAdminTest-2041739261 Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-MigrationsAdminTest-2041739261-project Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 547aed83a7e44becb9c89dc6bae62255 Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-MigrationsAdminTest-2041739261-project Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 8025dc46-71af-4fec-8f54-5ae9e92cc31f could not be found. Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '8025dc46-71af-4fec-8f54-5ae9e92cc31f'} Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8025dc46-71af-4fec-8f54-5ae9e92cc31f could not be found. Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8025dc46-71af-4fec-8f54-5ae9e92cc31f could not be found. Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:17:44.719205 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:44.725176 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:44.725176 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:17:44.725176 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:17:44.725176 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:17:44.725176 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:17:44.725176 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8025dc46-71af-4fec-8f54-5ae9e92cc31f could not be found. Oct 23 01:17:44.725176 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:44.727227 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a7320c5e-d2c3-4f76-b341-25bd6366de93 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Returning 404 to user: Instance 8025dc46-71af-4fec-8f54-5ae9e92cc31f could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:17:44.728124 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a7320c5e-d2c3-4f76-b341-25bd6366de93 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f" status: 404 len: 111 microversion: 2.1 time: 0.065482 Oct 23 01:17:44.732191 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 979/1991] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:44 2022] GET /compute/v2.1/servers/8025dc46-71af-4fec-8f54-5ae9e92cc31f => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:17:44.739206 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8b6b986f-26da-48c9-beea-ae605759d139 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:44.739206 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8b6b986f-26da-48c9-beea-ae605759d139 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:44.744966 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8b6b986f-26da-48c9-beea-ae605759d139 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:44.745354 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8b6b986f-26da-48c9-beea-ae605759d139 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:44.745800 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8b6b986f-26da-48c9-beea-ae605759d139 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:44.746964 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8b6b986f-26da-48c9-beea-ae605759d139 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:44.747434 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8b6b986f-26da-48c9-beea-ae605759d139 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:44.748086 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8b6b986f-26da-48c9-beea-ae605759d139 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:45.075356 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8b6b986f-26da-48c9-beea-ae605759d139 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:45.089950 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8b6b986f-26da-48c9-beea-ae605759d139 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1381 microversion: 2.1 time: 0.352624 Oct 23 01:17:45.092266 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 980/1992] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:44 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1381 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:45.102739 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5bc7ae63-9dc7-48aa-84b3-657632a307bf tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:45.108875 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5bc7ae63-9dc7-48aa-84b3-657632a307bf tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 1fb6d268-9409-4ca5-9429-6f00ae7b86c1] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:45.122217 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5bc7ae63-9dc7-48aa-84b3-657632a307bf tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:45.122992 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5bc7ae63-9dc7-48aa-84b3-657632a307bf tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:45.125961 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5bc7ae63-9dc7-48aa-84b3-657632a307bf tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:45.126933 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5bc7ae63-9dc7-48aa-84b3-657632a307bf tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:45.127600 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5bc7ae63-9dc7-48aa-84b3-657632a307bf tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:45.129233 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5bc7ae63-9dc7-48aa-84b3-657632a307bf tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:45.260870 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5bc7ae63-9dc7-48aa-84b3-657632a307bf tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:45.276913 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5bc7ae63-9dc7-48aa-84b3-657632a307bf tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/1fb6d268-9409-4ca5-9429-6f00ae7b86c1" status: 200 len: 1429 microversion: 2.1 time: 0.183307 Oct 23 01:17:45.279994 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 981/1993] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:45 2022] GET /compute/v2.1/servers/1fb6d268-9409-4ca5-9429-6f00ae7b86c1 => generated 1429 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:45.311405 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5f274e94-4d7a-44f9-bb7e-75ba4fe9c06b tempest-SecurityGroupsNegativeTestJSON-1762943091 tempest-SecurityGroupsNegativeTestJSON-1762943091-project] Calling method '.version_select at 0x7f5cc2439d30>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:45.599142 n-d-master-1 devstack@n-api.service[120944]: DEBUG neutronclient.v2_0.client [None req-5f274e94-4d7a-44f9-bb7e-75ba4fe9c06b tempest-SecurityGroupsNegativeTestJSON-1762943091 tempest-SecurityGroupsNegativeTestJSON-1762943091-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 426d94a3-4bc8-4398-b389-c38d632c9b6c does not exist", "detail": ""}} {{(pid=120944) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 23 01:17:45.599886 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.security_group_api [None req-5f274e94-4d7a-44f9-bb7e-75ba4fe9c06b tempest-SecurityGroupsNegativeTestJSON-1762943091 tempest-SecurityGroupsNegativeTestJSON-1762943091-project] Neutron security group 426d94a3-4bc8-4398-b389-c38d632c9b6c not found {{(pid=120944) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 23 01:17:45.600467 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-5f274e94-4d7a-44f9-bb7e-75ba4fe9c06b tempest-SecurityGroupsNegativeTestJSON-1762943091 tempest-SecurityGroupsNegativeTestJSON-1762943091-project] HTTP exception thrown: Security group 426d94a3-4bc8-4398-b389-c38d632c9b6c does not exist Oct 23 01:17:45.600467 n-d-master-1 devstack@n-api.service[120944]: Neutron server returns request_ids: ['req-a56eeeba-5cb1-49ae-ab37-5288c097f1c2'] Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5f274e94-4d7a-44f9-bb7e-75ba4fe9c06b tempest-SecurityGroupsNegativeTestJSON-1762943091 tempest-SecurityGroupsNegativeTestJSON-1762943091-project] Request method failure captured: Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/os-security-groups/426d94a3-4bc8-4398-b389-c38d632c9b6c HTTP/1.1 Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJYxxTXOnf1vSTk4nBteN5QEPWJK-RuuqUzPKE6ahEGobU9aGxS9xvVn7CfE1oDjL89LLjU5JZJSbzJkALgcJ58seSkppp8g80qMn_SITJmA3NNIAvgiPmRLKjudK9ijW2QYBB-sr0IGa-G9vGxZjncGQWvpaj8JKuvbIezCYRYsdd0 Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 1e823abcab484d2fb32ac12e846e95f0 Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1762943091 Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1e823abcab484d2fb32ac12e846e95f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1e823abcab484d2fb32ac12e846e95f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1e823abcab484d2fb32ac12e846e95f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1e823abcab484d2fb32ac12e846e95f0"}]}] Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1762943091 Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 1e823abcab484d2fb32ac12e846e95f0 Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1762943091 Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-SecurityGroupsNegativeTestJSON-1762943091-project Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 7b260d3a773e47a990fad3262ccc2e4f Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1762943091-project Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: method: Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: exception: Security group 426d94a3-4bc8-4398-b389-c38d632c9b6c does not exist Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: Neutron server returns request_ids: ['req-a56eeeba-5cb1-49ae-ab37-5288c097f1c2'] Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '426d94a3-4bc8-4398-b389-c38d632c9b6c'} Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 23 01:17:45.603330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 426d94a3-4bc8-4398-b389-c38d632c9b6c does not exist Oct 23 01:17:45.608618 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a56eeeba-5cb1-49ae-ab37-5288c097f1c2'] Oct 23 01:17:45.608618 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:45.608618 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:17:45.608618 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:45.608618 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:45.608618 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 23 01:17:45.608618 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 23 01:17:45.608618 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 23 01:17:45.608618 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 23 01:17:45.608618 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 426d94a3-4bc8-4398-b389-c38d632c9b6c does not exist Oct 23 01:17:45.608618 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a56eeeba-5cb1-49ae-ab37-5288c097f1c2'] Oct 23 01:17:45.608618 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:45.608618 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:17:45.608618 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:45.608618 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:45.608618 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:17:45.608618 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:17:45.608618 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:17:45.608618 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:17:45.608618 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:17:45.608618 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:17:45.608618 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:17:45.608618 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:17:45.608618 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 23 01:17:45.608618 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 23 01:17:45.608618 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 426d94a3-4bc8-4398-b389-c38d632c9b6c does not exist Oct 23 01:17:45.608618 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a56eeeba-5cb1-49ae-ab37-5288c097f1c2'] Oct 23 01:17:45.608618 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:45.608618 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:17:45.608618 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:45.608618 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:45.608618 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:17:45.608618 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:17:45.608618 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:17:45.608618 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:17:45.608618 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 426d94a3-4bc8-4398-b389-c38d632c9b6c does not exist Oct 23 01:17:45.608618 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a56eeeba-5cb1-49ae-ab37-5288c097f1c2'] Oct 23 01:17:45.608618 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:45.608618 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5f274e94-4d7a-44f9-bb7e-75ba4fe9c06b tempest-SecurityGroupsNegativeTestJSON-1762943091 tempest-SecurityGroupsNegativeTestJSON-1762943091-project] Returning 404 to user: Security group 426d94a3-4bc8-4398-b389-c38d632c9b6c does not exist Oct 23 01:17:45.608618 n-d-master-1 devstack@n-api.service[120944]: Neutron server returns request_ids: ['req-a56eeeba-5cb1-49ae-ab37-5288c097f1c2'] {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:17:45.608618 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5f274e94-4d7a-44f9-bb7e-75ba4fe9c06b tempest-SecurityGroupsNegativeTestJSON-1762943091 tempest-SecurityGroupsNegativeTestJSON-1762943091-project] 10.222.0.42 "GET /compute/v2.1/os-security-groups/426d94a3-4bc8-4398-b389-c38d632c9b6c" status: 404 len: 194 microversion: 2.1 time: 0.323905 Oct 23 01:17:45.612376 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 982/1994] 10.222.0.42 () {58 vars in 1269 bytes} [Sun Oct 23 01:17:45 2022] GET /compute/v2.1/os-security-groups/426d94a3-4bc8-4398-b389-c38d632c9b6c => generated 194 bytes in 330 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:17:45.619784 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e70d348c-eac9-4bab-b4c3-16bb7fb28273 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '.version_select at 0x7f5cc1a27ee0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:45.719337 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e70d348c-eac9-4bab-b4c3-16bb7fb28273 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-237042266" status: 202 len: 0 microversion: 2.1 time: 0.107324 Oct 23 01:17:45.720976 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 983/1995] 10.222.0.42 () {58 vars in 1218 bytes} [Sun Oct 23 01:17:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-237042266 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:17:45.726827 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-f58922af-f449-4c8e-b33a-b07ef1c2ccc9 req-2288baed-0fdc-416d-a35a-03fcc1aa5ada service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fb6d268-9409-4ca5-9429-6f00ae7b86c1", "name": "network-vif-deleted", "tag": "3fa70d62-e26e-4dbc-b762-9137ae590232"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:17:45.748276 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-f58922af-f449-4c8e-b33a-b07ef1c2ccc9 req-2288baed-0fdc-416d-a35a-03fcc1aa5ada service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:45.749056 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-f58922af-f449-4c8e-b33a-b07ef1c2ccc9 req-2288baed-0fdc-416d-a35a-03fcc1aa5ada service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:45.749654 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-f58922af-f449-4c8e-b33a-b07ef1c2ccc9 req-2288baed-0fdc-416d-a35a-03fcc1aa5ada service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:45.762761 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-f58922af-f449-4c8e-b33a-b07ef1c2ccc9 req-2288baed-0fdc-416d-a35a-03fcc1aa5ada service nova] Creating event network-vif-deleted:3fa70d62-e26e-4dbc-b762-9137ae590232 for instance 1fb6d268-9409-4ca5-9429-6f00ae7b86c1 on n-h1-master-1 Oct 23 01:17:45.768916 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-f58922af-f449-4c8e-b33a-b07ef1c2ccc9 req-2288baed-0fdc-416d-a35a-03fcc1aa5ada service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046541 Oct 23 01:17:45.772686 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 984/1996] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:17:46.115958 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-47c61e82-dd3e-4787-97a7-a35613c47186 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:46.117070 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-47c61e82-dd3e-4787-97a7-a35613c47186 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:46.121109 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:17:46.127505 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-47c61e82-dd3e-4787-97a7-a35613c47186 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:46.128190 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-47c61e82-dd3e-4787-97a7-a35613c47186 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:46.133534 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-47c61e82-dd3e-4787-97a7-a35613c47186 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:46.133534 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-47c61e82-dd3e-4787-97a7-a35613c47186 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:46.133534 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-47c61e82-dd3e-4787-97a7-a35613c47186 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:46.133534 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-47c61e82-dd3e-4787-97a7-a35613c47186 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:46.677437 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-9a643d1a-d53e-4949-b93c-f03da281bebd tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: a78b5bc9-4e8f-44d7-879c-737838cfe1b6] Updating instance_info_cache with network_info: [{"id": "c797d72c-fb4f-47ae-abdc-bb226e15b717", "address": "fa:16:3e:6c:28:3d", "network": {"id": "1fd1125a-5e06-4668-a85b-393b7a6d4c8a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1026242889-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.6.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "386d20bba06b48be9a7e51162dc4d814", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc797d72c-fb", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120945) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 23 01:17:46.791283 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a643d1a-d53e-4949-b93c-f03da281bebd tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Releasing lock "refresh_cache-a78b5bc9-4e8f-44d7-879c-737838cfe1b6" {{(pid=120945) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 23 01:17:46.792863 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9a643d1a-d53e-4949-b93c-f03da281bebd tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] 10.222.0.42 "POST /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6/action" status: 202 len: 0 microversion: 2.1 time: 4.705796 Oct 23 01:17:46.794163 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1013/1997] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:17:42 2022] POST /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6/action => generated 0 bytes in 4718 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 23 01:17:46.803585 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e7302125-5bfa-4633-a37c-8c03e61cd389 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:46.805414 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e7302125-5bfa-4633-a37c-8c03e61cd389 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:46.815587 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e7302125-5bfa-4633-a37c-8c03e61cd389 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:46.817491 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e7302125-5bfa-4633-a37c-8c03e61cd389 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:46.818468 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e7302125-5bfa-4633-a37c-8c03e61cd389 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:46.819531 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e7302125-5bfa-4633-a37c-8c03e61cd389 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:46.820290 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e7302125-5bfa-4633-a37c-8c03e61cd389 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:46.823135 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e7302125-5bfa-4633-a37c-8c03e61cd389 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:46.874972 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-47c61e82-dd3e-4787-97a7-a35613c47186 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1532 microversion: 2.1 time: 1.101884 Oct 23 01:17:46.893441 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 985/1998] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:45 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1532 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:46.902166 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d7438bfe-be87-423b-9e28-128e0ed5b206 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:46.903921 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d7438bfe-be87-423b-9e28-128e0ed5b206 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 40104c3d-0e82-449a-a331-c4f6ba80afaf] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:46.911716 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d7438bfe-be87-423b-9e28-128e0ed5b206 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:46.912457 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d7438bfe-be87-423b-9e28-128e0ed5b206 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:46.913777 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d7438bfe-be87-423b-9e28-128e0ed5b206 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:46.914752 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d7438bfe-be87-423b-9e28-128e0ed5b206 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:46.915401 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d7438bfe-be87-423b-9e28-128e0ed5b206 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:46.916030 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d7438bfe-be87-423b-9e28-128e0ed5b206 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:47.117167 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d7438bfe-be87-423b-9e28-128e0ed5b206 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:47.139489 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d7438bfe-be87-423b-9e28-128e0ed5b206 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf" status: 200 len: 1265 microversion: 2.1 time: 0.244629 Oct 23 01:17:47.140297 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 986/1999] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:46 2022] GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf => generated 1265 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:47.158046 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0afc13f4-7dfd-4859-ae1b-ad989829f242 tempest-SecurityGroupsNegativeTestJSON-1762943091 tempest-SecurityGroupsNegativeTestJSON-1762943091-project] Action: 'update', calling method: .version_select at 0x7f5cc1e905e0>, body: {"security_group": {"name": "tempest-sg-1208655435", "description": "tempest-description-1300511920"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:17:47.276347 n-d-master-1 devstack@n-api.service[120944]: DEBUG neutronclient.v2_0.client [None req-0afc13f4-7dfd-4859-ae1b-ad989829f242 tempest-SecurityGroupsNegativeTestJSON-1762943091 tempest-SecurityGroupsNegativeTestJSON-1762943091-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b7a5cf0b-6edc-4c8b-828d-461e8c51b955 does not exist", "detail": ""}} {{(pid=120944) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 23 01:17:47.276964 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.security_group_api [None req-0afc13f4-7dfd-4859-ae1b-ad989829f242 tempest-SecurityGroupsNegativeTestJSON-1762943091 tempest-SecurityGroupsNegativeTestJSON-1762943091-project] Neutron security group b7a5cf0b-6edc-4c8b-828d-461e8c51b955 not found {{(pid=120944) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 23 01:17:47.277501 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-0afc13f4-7dfd-4859-ae1b-ad989829f242 tempest-SecurityGroupsNegativeTestJSON-1762943091 tempest-SecurityGroupsNegativeTestJSON-1762943091-project] HTTP exception thrown: Security group b7a5cf0b-6edc-4c8b-828d-461e8c51b955 does not exist Oct 23 01:17:47.277501 n-d-master-1 devstack@n-api.service[120944]: Neutron server returns request_ids: ['req-65ab99ab-5cea-4ce7-8c1a-ba7d25f7cf35'] Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0afc13f4-7dfd-4859-ae1b-ad989829f242 tempest-SecurityGroupsNegativeTestJSON-1762943091 tempest-SecurityGroupsNegativeTestJSON-1762943091-project] Request method failure captured: Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: request: PUT /compute/v2.1/os-security-groups/b7a5cf0b-6edc-4c8b-828d-461e8c51b955 HTTP/1.1 Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 102 Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJYxxTXOnf1vSTk4nBteN5QEPWJK-RuuqUzPKE6ahEGobU9aGxS9xvVn7CfE1oDjL89LLjU5JZJSbzJkALgcJ58seSkppp8g80qMn_SITJmA3NNIAvgiPmRLKjudK9ijW2QYBB-sr0IGa-G9vGxZjncGQWvpaj8JKuvbIezCYRYsdd0 Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 1e823abcab484d2fb32ac12e846e95f0 Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1762943091 Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1e823abcab484d2fb32ac12e846e95f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1e823abcab484d2fb32ac12e846e95f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1e823abcab484d2fb32ac12e846e95f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1e823abcab484d2fb32ac12e846e95f0"}]}] Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1762943091 Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 1e823abcab484d2fb32ac12e846e95f0 Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1762943091 Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-SecurityGroupsNegativeTestJSON-1762943091-project Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 7b260d3a773e47a990fad3262ccc2e4f Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1762943091-project Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: {"security_group": {"name": "tempest-sg-1208655435", "description": "tempest-description-1300511920"}} Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: method: Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: exception: Security group b7a5cf0b-6edc-4c8b-828d-461e8c51b955 does not exist Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: Neutron server returns request_ids: ['req-65ab99ab-5cea-4ce7-8c1a-ba7d25f7cf35'] Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'b7a5cf0b-6edc-4c8b-828d-461e8c51b955', 'body': {'security_group': {'name': 'tempest-sg-1208655435', 'description': 'tempest-description-1300511920'}}} Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 23 01:17:47.279540 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 23 01:17:47.286527 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 23 01:17:47.286527 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b7a5cf0b-6edc-4c8b-828d-461e8c51b955 does not exist Oct 23 01:17:47.286527 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-65ab99ab-5cea-4ce7-8c1a-ba7d25f7cf35'] Oct 23 01:17:47.286527 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:47.286527 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:17:47.286527 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:47.286527 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:47.286527 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 23 01:17:47.286527 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 23 01:17:47.286527 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 23 01:17:47.286527 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 23 01:17:47.286527 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b7a5cf0b-6edc-4c8b-828d-461e8c51b955 does not exist Oct 23 01:17:47.286527 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-65ab99ab-5cea-4ce7-8c1a-ba7d25f7cf35'] Oct 23 01:17:47.286527 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:47.286527 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:17:47.286527 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:47.286527 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:47.286527 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:17:47.286527 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:17:47.286527 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:17:47.286527 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:17:47.286527 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:17:47.286527 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:17:47.286527 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:17:47.286527 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:17:47.286527 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 23 01:17:47.286527 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 23 01:17:47.286527 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b7a5cf0b-6edc-4c8b-828d-461e8c51b955 does not exist Oct 23 01:17:47.286527 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-65ab99ab-5cea-4ce7-8c1a-ba7d25f7cf35'] Oct 23 01:17:47.286527 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:47.286527 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:17:47.286527 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:47.286527 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:47.286527 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:17:47.286527 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:17:47.286527 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:17:47.286527 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:17:47.286527 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b7a5cf0b-6edc-4c8b-828d-461e8c51b955 does not exist Oct 23 01:17:47.286527 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-65ab99ab-5cea-4ce7-8c1a-ba7d25f7cf35'] Oct 23 01:17:47.286527 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:47.286527 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0afc13f4-7dfd-4859-ae1b-ad989829f242 tempest-SecurityGroupsNegativeTestJSON-1762943091 tempest-SecurityGroupsNegativeTestJSON-1762943091-project] Returning 404 to user: Security group b7a5cf0b-6edc-4c8b-828d-461e8c51b955 does not exist Oct 23 01:17:47.286527 n-d-master-1 devstack@n-api.service[120944]: Neutron server returns request_ids: ['req-65ab99ab-5cea-4ce7-8c1a-ba7d25f7cf35'] {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:17:47.286527 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0afc13f4-7dfd-4859-ae1b-ad989829f242 tempest-SecurityGroupsNegativeTestJSON-1762943091 tempest-SecurityGroupsNegativeTestJSON-1762943091-project] 10.222.0.42 "PUT /compute/v2.1/os-security-groups/b7a5cf0b-6edc-4c8b-828d-461e8c51b955" status: 404 len: 194 microversion: 2.1 time: 0.139712 Oct 23 01:17:47.294758 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 987/2000] 10.222.0.42 () {60 vars in 1290 bytes} [Sun Oct 23 01:17:47 2022] PUT /compute/v2.1/os-security-groups/b7a5cf0b-6edc-4c8b-828d-461e8c51b955 => generated 194 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:17:47.302225 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-5e1f451c-e5dc-45f5-a340-968372fd11ea req-975ce1eb-83e0-43ce-b3c0-d32a0e66a651 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a78b5bc9-4e8f-44d7-879c-737838cfe1b6", "tag": "c797d72c-fb4f-47ae-abdc-bb226e15b717"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:17:47.327228 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-5e1f451c-e5dc-45f5-a340-968372fd11ea req-975ce1eb-83e0-43ce-b3c0-d32a0e66a651 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:47.327719 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-5e1f451c-e5dc-45f5-a340-968372fd11ea req-975ce1eb-83e0-43ce-b3c0-d32a0e66a651 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:47.328153 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-5e1f451c-e5dc-45f5-a340-968372fd11ea req-975ce1eb-83e0-43ce-b3c0-d32a0e66a651 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:47.349384 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-5e1f451c-e5dc-45f5-a340-968372fd11ea req-975ce1eb-83e0-43ce-b3c0-d32a0e66a651 service nova] Creating event network-changed:c797d72c-fb4f-47ae-abdc-bb226e15b717 for instance a78b5bc9-4e8f-44d7-879c-737838cfe1b6 on n-h2-master-1 Oct 23 01:17:47.375633 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-5e1f451c-e5dc-45f5-a340-968372fd11ea req-975ce1eb-83e0-43ce-b3c0-d32a0e66a651 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074462 Oct 23 01:17:47.376735 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 988/2001] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:17:47.382777 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-68e94a35-77e4-4dda-ae65-472943e59c49 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:47.383501 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-68e94a35-77e4-4dda-ae65-472943e59c49 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 1fb6d268-9409-4ca5-9429-6f00ae7b86c1] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:47.404421 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68e94a35-77e4-4dda-ae65-472943e59c49 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:47.404919 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68e94a35-77e4-4dda-ae65-472943e59c49 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:47.405359 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68e94a35-77e4-4dda-ae65-472943e59c49 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:47.406174 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68e94a35-77e4-4dda-ae65-472943e59c49 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:47.406644 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68e94a35-77e4-4dda-ae65-472943e59c49 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:47.407073 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68e94a35-77e4-4dda-ae65-472943e59c49 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:47.432240 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-68e94a35-77e4-4dda-ae65-472943e59c49 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] HTTP exception thrown: Instance 1fb6d268-9409-4ca5-9429-6f00ae7b86c1 could not be found. Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-68e94a35-77e4-4dda-ae65-472943e59c49 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Request method failure captured: Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/1fb6d268-9409-4ca5-9429-6f00ae7b86c1 HTTP/1.1 Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJVv0uHUZkawxRif88fKy9LhJENRPZsKhmf6zOBQWEzP00qmPQkqAca2jhb2lRXN9t0zC2JkLeeBldWCPH61ICeNt4v5sTKxLKhNmtzMUUime8-v0hyE48rstyJIK6CJypqB2ITpC6L9yRd-7i6fCZp0NigLnXS0XEU_z_Ej3fGN7bI Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 47aadec780734d03a262d4021f48d625 Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersOnMultiNodesTest-1204013784 Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/47aadec780734d03a262d4021f48d625"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_47aadec780734d03a262d4021f48d625"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/47aadec780734d03a262d4021f48d625"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/47aadec780734d03a262d4021f48d625"}]}] Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersOnMultiNodesTest-1204013784 Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 47aadec780734d03a262d4021f48d625 Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1204013784 Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersOnMultiNodesTest-1204013784-project Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 519c893a1e094200b882cf23db7cae54 Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersOnMultiNodesTest-1204013784-project Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 1fb6d268-9409-4ca5-9429-6f00ae7b86c1 could not be found. Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '1fb6d268-9409-4ca5-9429-6f00ae7b86c1'} Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fb6d268-9409-4ca5-9429-6f00ae7b86c1 could not be found. Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fb6d268-9409-4ca5-9429-6f00ae7b86c1 could not be found. Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:17:47.434457 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:47.439196 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:47.439196 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:17:47.439196 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:17:47.439196 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:17:47.439196 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:17:47.439196 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fb6d268-9409-4ca5-9429-6f00ae7b86c1 could not be found. Oct 23 01:17:47.439196 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:47.443035 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-68e94a35-77e4-4dda-ae65-472943e59c49 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Returning 404 to user: Instance 1fb6d268-9409-4ca5-9429-6f00ae7b86c1 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:17:47.444046 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-68e94a35-77e4-4dda-ae65-472943e59c49 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/1fb6d268-9409-4ca5-9429-6f00ae7b86c1" status: 404 len: 111 microversion: 2.1 time: 0.066125 Oct 23 01:17:47.448115 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 989/2002] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:47 2022] GET /compute/v2.1/servers/1fb6d268-9409-4ca5-9429-6f00ae7b86c1 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:17:47.453662 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e2f268a4-5afe-4a0a-9940-45217a5985b0 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Calling method '.version_select at 0x7f5cc1a27700>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:47.561620 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e7302125-5bfa-4633-a37c-8c03e61cd389 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:47.580489 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e7302125-5bfa-4633-a37c-8c03e61cd389 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:47.582066 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e7302125-5bfa-4633-a37c-8c03e61cd389 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:47.583779 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e7302125-5bfa-4633-a37c-8c03e61cd389 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7" status: 200 len: 1805 microversion: 2.25 time: 0.788286 Oct 23 01:17:47.594424 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1014/2003] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:17:46 2022] GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7 => generated 1805 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:17:47.611895 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-75e85aa9-196d-477b-addc-ac22446f2acd tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:47.613332 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-75e85aa9-196d-477b-addc-ac22446f2acd tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:47.625840 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-75e85aa9-196d-477b-addc-ac22446f2acd tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:47.626476 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-75e85aa9-196d-477b-addc-ac22446f2acd tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:47.626980 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-75e85aa9-196d-477b-addc-ac22446f2acd tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:47.627900 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-75e85aa9-196d-477b-addc-ac22446f2acd tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:47.628398 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-75e85aa9-196d-477b-addc-ac22446f2acd tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:47.629325 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-75e85aa9-196d-477b-addc-ac22446f2acd tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:48.296557 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-75e85aa9-196d-477b-addc-ac22446f2acd tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1532 microversion: 2.1 time: 0.698445 Oct 23 01:17:48.297302 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1015/2004] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:47 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1532 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:48.305488 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-44dd139c-5316-4393-9684-963bf2c0402c tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:48.306014 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-44dd139c-5316-4393-9684-963bf2c0402c tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 024cb100-29e3-402c-b634-256694a63335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:48.318196 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44dd139c-5316-4393-9684-963bf2c0402c tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:48.318699 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44dd139c-5316-4393-9684-963bf2c0402c tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:48.319153 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44dd139c-5316-4393-9684-963bf2c0402c tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:48.319932 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44dd139c-5316-4393-9684-963bf2c0402c tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:48.320391 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44dd139c-5316-4393-9684-963bf2c0402c tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:48.320817 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44dd139c-5316-4393-9684-963bf2c0402c tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:48.352450 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-44dd139c-5316-4393-9684-963bf2c0402c tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 024cb100-29e3-402c-b634-256694a63335] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:17:48.476958 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e2f268a4-5afe-4a0a-9940-45217a5985b0 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] 10.222.0.42 "GET /compute/v2.1/os-floating-ips/4977642b-e824-4fde-af4d-ac486e41fc54" status: 200 len: 184 microversion: 2.1 time: 1.027640 Oct 23 01:17:48.483095 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 990/2005] 10.222.0.42 () {58 vars in 1260 bytes} [Sun Oct 23 01:17:47 2022] GET /compute/v2.1/os-floating-ips/4977642b-e824-4fde-af4d-ac486e41fc54 => generated 184 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:17:48.490792 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2791a20e-0a8e-4d29-a4ab-7df21c910da5 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Calling method '.version_select at 0x7f5cc2466e50>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:48.498371 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2791a20e-0a8e-4d29-a4ab-7df21c910da5 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:48.499339 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2791a20e-0a8e-4d29-a4ab-7df21c910da5 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:48.500072 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2791a20e-0a8e-4d29-a4ab-7df21c910da5 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:48.519561 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2791a20e-0a8e-4d29-a4ab-7df21c910da5 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] 10.222.0.42 "GET /compute/v2.1/os-migrations" status: 200 len: 3382 microversion: 2.25 time: 0.039570 Oct 23 01:17:48.520814 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 991/2006] 10.222.0.42 () {60 vars in 1184 bytes} [Sun Oct 23 01:17:48 2022] GET /compute/v2.1/os-migrations => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:17:48.526478 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-5fc4b000-3c33-417d-ac28-df64f880e241 req-f030d52f-9ad6-413b-a9d5-6f626522c841 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdd228c7-614f-4742-932f-5cb7faf5a68c", "name": "network-vif-deleted", "tag": "8eb58394-2229-4f50-8d19-48d755a79f37"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:17:48.537813 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-5fc4b000-3c33-417d-ac28-df64f880e241 req-f030d52f-9ad6-413b-a9d5-6f626522c841 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:48.538652 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-5fc4b000-3c33-417d-ac28-df64f880e241 req-f030d52f-9ad6-413b-a9d5-6f626522c841 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:48.539253 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-5fc4b000-3c33-417d-ac28-df64f880e241 req-f030d52f-9ad6-413b-a9d5-6f626522c841 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:48.578190 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-5fc4b000-3c33-417d-ac28-df64f880e241 req-f030d52f-9ad6-413b-a9d5-6f626522c841 service nova] Creating event network-vif-deleted:8eb58394-2229-4f50-8d19-48d755a79f37 for instance bdd228c7-614f-4742-932f-5cb7faf5a68c on n-h2-master-1 Oct 23 01:17:48.584792 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-5fc4b000-3c33-417d-ac28-df64f880e241 req-f030d52f-9ad6-413b-a9d5-6f626522c841 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061812 Oct 23 01:17:48.586579 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 992/2007] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:17:48.594369 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-35f13de3-4a55-4d5c-be61-41e6ab0f75b8 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:48.596438 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-35f13de3-4a55-4d5c-be61-41e6ab0f75b8 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: edb35c7d-9adc-4b53-9bef-147aadbeae5d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:48.604011 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-35f13de3-4a55-4d5c-be61-41e6ab0f75b8 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:48.604744 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-35f13de3-4a55-4d5c-be61-41e6ab0f75b8 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:48.605372 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-35f13de3-4a55-4d5c-be61-41e6ab0f75b8 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:48.606469 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-35f13de3-4a55-4d5c-be61-41e6ab0f75b8 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:48.607115 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-35f13de3-4a55-4d5c-be61-41e6ab0f75b8 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:48.615138 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-35f13de3-4a55-4d5c-be61-41e6ab0f75b8 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:48.649408 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-35f13de3-4a55-4d5c-be61-41e6ab0f75b8 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: edb35c7d-9adc-4b53-9bef-147aadbeae5d] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:17:48.826539 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-44dd139c-5316-4393-9684-963bf2c0402c tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "DELETE /compute/v2.1/servers/024cb100-29e3-402c-b634-256694a63335" status: 204 len: 0 microversion: 2.1 time: 0.527361 Oct 23 01:17:48.834045 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1016/2008] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:17:48 2022] DELETE /compute/v2.1/servers/024cb100-29e3-402c-b634-256694a63335 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:17:48.840144 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cdae71c5-f519-492a-8b12-423b5a4e0e6c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:48.841333 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cdae71c5-f519-492a-8b12-423b5a4e0e6c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 40104c3d-0e82-449a-a331-c4f6ba80afaf] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:48.855551 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cdae71c5-f519-492a-8b12-423b5a4e0e6c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:48.856459 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cdae71c5-f519-492a-8b12-423b5a4e0e6c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:48.856865 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cdae71c5-f519-492a-8b12-423b5a4e0e6c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:48.857646 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cdae71c5-f519-492a-8b12-423b5a4e0e6c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:48.858451 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cdae71c5-f519-492a-8b12-423b5a4e0e6c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:48.858969 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cdae71c5-f519-492a-8b12-423b5a4e0e6c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:49.008460 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-35f13de3-4a55-4d5c-be61-41e6ab0f75b8 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "DELETE /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d" status: 204 len: 0 microversion: 2.1 time: 0.419847 Oct 23 01:17:49.012970 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 993/2009] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:17:48 2022] DELETE /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:17:49.020480 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2156f374-a764-4e4b-9443-5e563d4518a4 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:49.025066 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2156f374-a764-4e4b-9443-5e563d4518a4 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:49.025572 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2156f374-a764-4e4b-9443-5e563d4518a4 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:49.026043 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2156f374-a764-4e4b-9443-5e563d4518a4 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:49.026792 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2156f374-a764-4e4b-9443-5e563d4518a4 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:49.027312 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2156f374-a764-4e4b-9443-5e563d4518a4 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:49.027749 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2156f374-a764-4e4b-9443-5e563d4518a4 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:49.056974 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2156f374-a764-4e4b-9443-5e563d4518a4 tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.042581 Oct 23 01:17:49.057926 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 994/2010] 10.222.0.42 () {58 vars in 1176 bytes} [Sun Oct 23 01:17:49 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:17:49.062856 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-43a93b48-06f7-40d4-b0db-d4407b8181fc tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Action: 'action', calling method: .version_select at 0x7f5cc3c8fc10>, body: {"removeFloatingIp": {"address": "172.35.6.81"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:17:49.724319 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cdae71c5-f519-492a-8b12-423b5a4e0e6c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:49.735451 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cdae71c5-f519-492a-8b12-423b5a4e0e6c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf" status: 200 len: 1307 microversion: 2.1 time: 0.899901 Oct 23 01:17:49.737815 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-43a93b48-06f7-40d4-b0db-d4407b8181fc tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: a78b5bc9-4e8f-44d7-879c-737838cfe1b6] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:49.746389 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-43a93b48-06f7-40d4-b0db-d4407b8181fc tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:49.747439 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-43a93b48-06f7-40d4-b0db-d4407b8181fc tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:49.748114 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-43a93b48-06f7-40d4-b0db-d4407b8181fc tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:49.750145 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-43a93b48-06f7-40d4-b0db-d4407b8181fc tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:49.750880 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-43a93b48-06f7-40d4-b0db-d4407b8181fc tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:49.751939 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-43a93b48-06f7-40d4-b0db-d4407b8181fc tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:49.752041 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1017/2011] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:48 2022] GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf => generated 1307 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:49.760578 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5c6ecb32-2b0e-4a4b-b89d-026e20c2fde7 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:49.761390 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5c6ecb32-2b0e-4a4b-b89d-026e20c2fde7 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:49.767621 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5c6ecb32-2b0e-4a4b-b89d-026e20c2fde7 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:49.768478 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5c6ecb32-2b0e-4a4b-b89d-026e20c2fde7 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:49.768915 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5c6ecb32-2b0e-4a4b-b89d-026e20c2fde7 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:49.771234 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5c6ecb32-2b0e-4a4b-b89d-026e20c2fde7 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:49.771942 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5c6ecb32-2b0e-4a4b-b89d-026e20c2fde7 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:49.772544 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5c6ecb32-2b0e-4a4b-b89d-026e20c2fde7 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:50.358378 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-5c6ecb32-2b0e-4a4b-b89d-026e20c2fde7 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lazy-loading 'services' on Instance uuid be9a2687-233d-43c3-95b3-3a8b455595c7 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:17:50.372628 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5c6ecb32-2b0e-4a4b-b89d-026e20c2fde7 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7" status: 200 len: 2424 microversion: 2.25 time: 0.619455 Oct 23 01:17:50.373210 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1018/2012] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:17:49 2022] GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7 => generated 2424 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:17:50.387870 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d47dedf3-863b-431a-9d05-797bab7cfff5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:50.387870 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d47dedf3-863b-431a-9d05-797bab7cfff5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: fb12a9d1-a506-4e57-b93e-62cbe2ac4450] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:50.387870 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d47dedf3-863b-431a-9d05-797bab7cfff5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:50.387870 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d47dedf3-863b-431a-9d05-797bab7cfff5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:50.387870 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d47dedf3-863b-431a-9d05-797bab7cfff5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:50.387870 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d47dedf3-863b-431a-9d05-797bab7cfff5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:50.387870 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d47dedf3-863b-431a-9d05-797bab7cfff5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:50.387870 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d47dedf3-863b-431a-9d05-797bab7cfff5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:50.396931 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-43a93b48-06f7-40d4-b0db-d4407b8181fc tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "refresh_cache-a78b5bc9-4e8f-44d7-879c-737838cfe1b6" {{(pid=120944) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 23 01:17:50.397442 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-43a93b48-06f7-40d4-b0db-d4407b8181fc tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquired lock "refresh_cache-a78b5bc9-4e8f-44d7-879c-737838cfe1b6" {{(pid=120944) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 23 01:17:50.414352 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d47dedf3-863b-431a-9d05-797bab7cfff5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: fb12a9d1-a506-4e57-b93e-62cbe2ac4450] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:17:50.452652 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:17:50.716799 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d47dedf3-863b-431a-9d05-797bab7cfff5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "DELETE /compute/v2.1/servers/fb12a9d1-a506-4e57-b93e-62cbe2ac4450" status: 204 len: 0 microversion: 2.1 time: 0.342236 Oct 23 01:17:50.717738 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1019/2013] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:17:50 2022] DELETE /compute/v2.1/servers/fb12a9d1-a506-4e57-b93e-62cbe2ac4450 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:17:50.727030 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3942908e-7e27-47c0-ae8e-a0ca809d555d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:50.728560 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3942908e-7e27-47c0-ae8e-a0ca809d555d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: edb35c7d-9adc-4b53-9bef-147aadbeae5d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:50.737090 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3942908e-7e27-47c0-ae8e-a0ca809d555d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:50.737585 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3942908e-7e27-47c0-ae8e-a0ca809d555d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:50.738108 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3942908e-7e27-47c0-ae8e-a0ca809d555d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:50.738826 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3942908e-7e27-47c0-ae8e-a0ca809d555d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:50.739284 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3942908e-7e27-47c0-ae8e-a0ca809d555d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:50.739717 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3942908e-7e27-47c0-ae8e-a0ca809d555d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:51.329821 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3942908e-7e27-47c0-ae8e-a0ca809d555d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:51.343194 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3942908e-7e27-47c0-ae8e-a0ca809d555d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d" status: 200 len: 1467 microversion: 2.1 time: 0.622616 Oct 23 01:17:51.344741 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1020/2014] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:50 2022] GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d => generated 1467 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:51.350030 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-161bd18b-6623-433b-b394-10d32ce65f2a tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": false, "disk_over_commit": false}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:17:51.354627 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-161bd18b-6623-433b-b394-10d32ce65f2a tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:51.362047 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-161bd18b-6623-433b-b394-10d32ce65f2a tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:51.363989 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-161bd18b-6623-433b-b394-10d32ce65f2a tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:51.377364 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-161bd18b-6623-433b-b394-10d32ce65f2a tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:51.382503 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-161bd18b-6623-433b-b394-10d32ce65f2a tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:51.384698 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-161bd18b-6623-433b-b394-10d32ce65f2a tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:51.386520 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-161bd18b-6623-433b-b394-10d32ce65f2a tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:51.418306 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-161bd18b-6623-433b-b394-10d32ce65f2a tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lazy-loading 'flavor' on Instance uuid dad12d7a-a01e-4f91-b35e-4f9f83df5b3b {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:17:51.435713 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-161bd18b-6623-433b-b394-10d32ce65f2a tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Going to try to live migrate instance to n-h1-master-1 {{(pid=120945) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 23 01:17:51.465610 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=8 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:17:53.220865 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-43a93b48-06f7-40d4-b0db-d4407b8181fc tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: a78b5bc9-4e8f-44d7-879c-737838cfe1b6] Building network info cache for instance {{(pid=120944) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 23 01:17:55.644946 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-43a93b48-06f7-40d4-b0db-d4407b8181fc tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: a78b5bc9-4e8f-44d7-879c-737838cfe1b6] Updating instance_info_cache with network_info: [{"id": "c797d72c-fb4f-47ae-abdc-bb226e15b717", "address": "fa:16:3e:6c:28:3d", "network": {"id": "1fd1125a-5e06-4668-a85b-393b7a6d4c8a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1026242889-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "386d20bba06b48be9a7e51162dc4d814", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc797d72c-fb", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120944) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 23 01:17:55.757104 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-43a93b48-06f7-40d4-b0db-d4407b8181fc tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Releasing lock "refresh_cache-a78b5bc9-4e8f-44d7-879c-737838cfe1b6" {{(pid=120944) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 23 01:17:55.758045 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-43a93b48-06f7-40d4-b0db-d4407b8181fc tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] 10.222.0.42 "POST /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6/action" status: 202 len: 0 microversion: 2.1 time: 6.698896 Oct 23 01:17:55.758862 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 995/2015] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:17:49 2022] POST /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6/action => generated 0 bytes in 6700 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 23 01:17:55.773209 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a16e075c-ca20-42b4-a677-984db98f2d57 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:55.780180 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a16e075c-ca20-42b4-a677-984db98f2d57 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:55.813142 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a16e075c-ca20-42b4-a677-984db98f2d57 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:55.815660 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a16e075c-ca20-42b4-a677-984db98f2d57 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:55.819522 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a16e075c-ca20-42b4-a677-984db98f2d57 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:55.823212 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a16e075c-ca20-42b4-a677-984db98f2d57 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:55.835341 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a16e075c-ca20-42b4-a677-984db98f2d57 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:55.836370 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a16e075c-ca20-42b4-a677-984db98f2d57 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:56.039833 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-a16e075c-ca20-42b4-a677-984db98f2d57 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lazy-loading 'services' on Instance uuid be9a2687-233d-43c3-95b3-3a8b455595c7 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:17:56.057167 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a16e075c-ca20-42b4-a677-984db98f2d57 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7" status: 200 len: 2424 microversion: 2.25 time: 0.292097 Oct 23 01:17:56.058418 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 996/2016] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:17:55 2022] GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7 => generated 2424 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:17:56.063700 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f5b7bd14-e876-425c-881f-beb75938cbda tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:56.064760 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f5b7bd14-e876-425c-881f-beb75938cbda tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 024cb100-29e3-402c-b634-256694a63335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:56.076458 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f5b7bd14-e876-425c-881f-beb75938cbda tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:56.082096 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f5b7bd14-e876-425c-881f-beb75938cbda tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:56.082096 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f5b7bd14-e876-425c-881f-beb75938cbda tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:56.082096 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f5b7bd14-e876-425c-881f-beb75938cbda tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:56.082096 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f5b7bd14-e876-425c-881f-beb75938cbda tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:56.082096 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f5b7bd14-e876-425c-881f-beb75938cbda tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:56.131315 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-f5b7bd14-e876-425c-881f-beb75938cbda tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] HTTP exception thrown: Instance 024cb100-29e3-402c-b634-256694a63335 could not be found. Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f5b7bd14-e876-425c-881f-beb75938cbda tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Request method failure captured: Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/024cb100-29e3-402c-b634-256694a63335 HTTP/1.1 Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJVv0uHUZkawxRif88fKy9LhJENRPZsKhmf6zOBQWEzP00qmPQkqAca2jhb2lRXN9t0zC2JkLeeBldWCPH61ICeNt4v5sTKxLKhNmtzMUUime8-v0hyE48rstyJIK6CJypqB2ITpC6L9yRd-7i6fCZp0NigLnXS0XEU_z_Ej3fGN7bI Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 47aadec780734d03a262d4021f48d625 Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersOnMultiNodesTest-1204013784 Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/47aadec780734d03a262d4021f48d625"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_47aadec780734d03a262d4021f48d625"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/47aadec780734d03a262d4021f48d625"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/47aadec780734d03a262d4021f48d625"}]}] Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersOnMultiNodesTest-1204013784 Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 47aadec780734d03a262d4021f48d625 Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1204013784 Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersOnMultiNodesTest-1204013784-project Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 519c893a1e094200b882cf23db7cae54 Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersOnMultiNodesTest-1204013784-project Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 024cb100-29e3-402c-b634-256694a63335 could not be found. Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '024cb100-29e3-402c-b634-256694a63335'} Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 024cb100-29e3-402c-b634-256694a63335 could not be found. Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 024cb100-29e3-402c-b634-256694a63335 could not be found. Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:17:56.134446 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:56.141794 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:56.141794 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:17:56.141794 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:17:56.141794 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:17:56.141794 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:17:56.141794 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 024cb100-29e3-402c-b634-256694a63335 could not be found. Oct 23 01:17:56.141794 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:56.161196 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f5b7bd14-e876-425c-881f-beb75938cbda tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Returning 404 to user: Instance 024cb100-29e3-402c-b634-256694a63335 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:17:56.166685 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-161bd18b-6623-433b-b394-10d32ce65f2a tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b/action" status: 202 len: 0 microversion: 2.1 time: 4.820235 Oct 23 01:17:56.172021 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1021/2017] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:17:51 2022] POST /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b/action => generated 0 bytes in 4822 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:17:56.175795 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7493aa1d-9751-4fe1-a24d-dbc3e2aad76b tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:56.177152 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7493aa1d-9751-4fe1-a24d-dbc3e2aad76b tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 40104c3d-0e82-449a-a331-c4f6ba80afaf] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:56.180575 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f5b7bd14-e876-425c-881f-beb75938cbda tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/024cb100-29e3-402c-b634-256694a63335" status: 404 len: 111 microversion: 2.1 time: 0.103384 Oct 23 01:17:56.184009 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 997/2018] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:56 2022] GET /compute/v2.1/servers/024cb100-29e3-402c-b634-256694a63335 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:17:56.229741 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-07be0837-ae74-459d-afba-c614f8a1df3d req-319547f8-ece2-450c-9d2b-55276b25a67b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "024cb100-29e3-402c-b634-256694a63335", "name": "network-vif-deleted", "tag": "3a32c5da-961b-4d6a-ae78-57f2e74c8ec3"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:17:56.230356 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7493aa1d-9751-4fe1-a24d-dbc3e2aad76b tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:56.238584 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7493aa1d-9751-4fe1-a24d-dbc3e2aad76b tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:56.245753 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7493aa1d-9751-4fe1-a24d-dbc3e2aad76b tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:56.247821 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7493aa1d-9751-4fe1-a24d-dbc3e2aad76b tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:56.251842 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7493aa1d-9751-4fe1-a24d-dbc3e2aad76b tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:56.255611 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7493aa1d-9751-4fe1-a24d-dbc3e2aad76b tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:56.285779 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-07be0837-ae74-459d-afba-c614f8a1df3d req-319547f8-ece2-450c-9d2b-55276b25a67b service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:56.290412 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-07be0837-ae74-459d-afba-c614f8a1df3d req-319547f8-ece2-450c-9d2b-55276b25a67b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:56.299872 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-07be0837-ae74-459d-afba-c614f8a1df3d req-319547f8-ece2-450c-9d2b-55276b25a67b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:56.365734 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-07be0837-ae74-459d-afba-c614f8a1df3d req-319547f8-ece2-450c-9d2b-55276b25a67b service nova] Creating event network-vif-deleted:3a32c5da-961b-4d6a-ae78-57f2e74c8ec3 for instance 024cb100-29e3-402c-b634-256694a63335 on n-h2-master-1 Oct 23 01:17:56.382406 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-07be0837-ae74-459d-afba-c614f8a1df3d req-319547f8-ece2-450c-9d2b-55276b25a67b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194490 Oct 23 01:17:56.394775 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 998/2019] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:17:56.405165 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-9f563188-fb7c-49f8-90a1-c2d1c548274b req-7d689bf6-1234-4cc0-8707-14c8c98d97ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40104c3d-0e82-449a-a331-c4f6ba80afaf", "tag": "c2cc7df3-aa5d-4a0e-abe9-5229c05e5354"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:17:56.417283 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-9f563188-fb7c-49f8-90a1-c2d1c548274b req-7d689bf6-1234-4cc0-8707-14c8c98d97ae service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:56.417768 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-9f563188-fb7c-49f8-90a1-c2d1c548274b req-7d689bf6-1234-4cc0-8707-14c8c98d97ae service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:56.418234 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-9f563188-fb7c-49f8-90a1-c2d1c548274b req-7d689bf6-1234-4cc0-8707-14c8c98d97ae service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:56.432700 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-9f563188-fb7c-49f8-90a1-c2d1c548274b req-7d689bf6-1234-4cc0-8707-14c8c98d97ae service nova] Creating event network-changed:c2cc7df3-aa5d-4a0e-abe9-5229c05e5354 for instance 40104c3d-0e82-449a-a331-c4f6ba80afaf on n-h1-master-1 Oct 23 01:17:56.439185 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-9f563188-fb7c-49f8-90a1-c2d1c548274b req-7d689bf6-1234-4cc0-8707-14c8c98d97ae service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042031 Oct 23 01:17:56.440099 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 999/2020] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:17:56.447219 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2ab3ddb3-7841-48bc-b6cd-4f5eeb5cd6f9 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:56.451775 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2ab3ddb3-7841-48bc-b6cd-4f5eeb5cd6f9 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: edb35c7d-9adc-4b53-9bef-147aadbeae5d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:56.457442 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2ab3ddb3-7841-48bc-b6cd-4f5eeb5cd6f9 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:56.458216 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2ab3ddb3-7841-48bc-b6cd-4f5eeb5cd6f9 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:56.459006 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2ab3ddb3-7841-48bc-b6cd-4f5eeb5cd6f9 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:56.460231 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2ab3ddb3-7841-48bc-b6cd-4f5eeb5cd6f9 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:56.461053 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2ab3ddb3-7841-48bc-b6cd-4f5eeb5cd6f9 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:56.461820 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2ab3ddb3-7841-48bc-b6cd-4f5eeb5cd6f9 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:56.537646 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2ab3ddb3-7841-48bc-b6cd-4f5eeb5cd6f9 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:56.539384 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2ab3ddb3-7841-48bc-b6cd-4f5eeb5cd6f9 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:56.539849 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2ab3ddb3-7841-48bc-b6cd-4f5eeb5cd6f9 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:56.542307 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-2ab3ddb3-7841-48bc-b6cd-4f5eeb5cd6f9 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lazy-loading 'fault' on Instance uuid edb35c7d-9adc-4b53-9bef-147aadbeae5d {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:17:56.684043 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2ab3ddb3-7841-48bc-b6cd-4f5eeb5cd6f9 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:56.713110 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2ab3ddb3-7841-48bc-b6cd-4f5eeb5cd6f9 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d" status: 200 len: 1302 microversion: 2.1 time: 0.269993 Oct 23 01:17:56.714745 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1000/2021] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:56 2022] GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d => generated 1302 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:56.719828 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b51c434b-a08b-4bde-997c-fed7a0850c7e tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:56.724164 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b51c434b-a08b-4bde-997c-fed7a0850c7e tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: bdd228c7-614f-4742-932f-5cb7faf5a68c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:56.728819 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b51c434b-a08b-4bde-997c-fed7a0850c7e tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:56.729870 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b51c434b-a08b-4bde-997c-fed7a0850c7e tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:56.730567 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b51c434b-a08b-4bde-997c-fed7a0850c7e tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:56.736295 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b51c434b-a08b-4bde-997c-fed7a0850c7e tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:56.737100 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b51c434b-a08b-4bde-997c-fed7a0850c7e tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:56.738671 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b51c434b-a08b-4bde-997c-fed7a0850c7e tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:56.771888 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-b51c434b-a08b-4bde-997c-fed7a0850c7e tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] HTTP exception thrown: Instance bdd228c7-614f-4742-932f-5cb7faf5a68c could not be found. Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b51c434b-a08b-4bde-997c-fed7a0850c7e tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Request method failure captured: Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/servers/bdd228c7-614f-4742-932f-5cb7faf5a68c HTTP/1.1 Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJXpa993jrYRXSo3h0JEnbdSd6b8ZTS-9twlCtOjHcZCOn9SWkUYPlRUeDTEsdRLQlb1foY28OZj4MCx6TZcc-A6_C0T9r8u9YkvhoGCHHByrfLzAJFiaQQv5tjLjf-B-XNYVOMRUWR11lSCiUN1mpEL0UOGWONyA-y2T7cK2Z6oZrs Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 386d20bba06b48be9a7e51162dc4d814 Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-928449743 Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/386d20bba06b48be9a7e51162dc4d814"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_386d20bba06b48be9a7e51162dc4d814"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/386d20bba06b48be9a7e51162dc4d814"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/386d20bba06b48be9a7e51162dc4d814"}]}] Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-928449743 Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 386d20bba06b48be9a7e51162dc4d814 Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-928449743 Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-FloatingIPsAssociationTestJSON-928449743-project Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: c9681db3595440a88dacc40393e2e1dc Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-928449743-project Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: exception: Instance bdd228c7-614f-4742-932f-5cb7faf5a68c could not be found. Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'bdd228c7-614f-4742-932f-5cb7faf5a68c'} Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdd228c7-614f-4742-932f-5cb7faf5a68c could not be found. Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:17:56.773907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:17:56.783142 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdd228c7-614f-4742-932f-5cb7faf5a68c could not be found. Oct 23 01:17:56.783142 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:56.783142 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:17:56.783142 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:56.783142 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:56.783142 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:17:56.783142 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:17:56.783142 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:17:56.783142 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:17:56.783142 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdd228c7-614f-4742-932f-5cb7faf5a68c could not be found. Oct 23 01:17:56.783142 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:17:56.783142 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b51c434b-a08b-4bde-997c-fed7a0850c7e tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Returning 404 to user: Instance bdd228c7-614f-4742-932f-5cb7faf5a68c could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:17:56.783142 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b51c434b-a08b-4bde-997c-fed7a0850c7e tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bdd228c7-614f-4742-932f-5cb7faf5a68c" status: 404 len: 111 microversion: 2.1 time: 0.059423 Oct 23 01:17:56.783142 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1001/2022] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:17:56 2022] DELETE /compute/v2.1/servers/bdd228c7-614f-4742-932f-5cb7faf5a68c => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:17:56.789994 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-03f106cd-f2b5-452f-b221-559895b22c94 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:56.790677 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-03f106cd-f2b5-452f-b221-559895b22c94 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:56.796980 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-03f106cd-f2b5-452f-b221-559895b22c94 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:56.797473 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-03f106cd-f2b5-452f-b221-559895b22c94 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:56.797912 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-03f106cd-f2b5-452f-b221-559895b22c94 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:56.798712 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-03f106cd-f2b5-452f-b221-559895b22c94 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:56.799165 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-03f106cd-f2b5-452f-b221-559895b22c94 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:56.799584 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-03f106cd-f2b5-452f-b221-559895b22c94 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:56.906108 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7493aa1d-9751-4fe1-a24d-dbc3e2aad76b tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:56.920696 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7493aa1d-9751-4fe1-a24d-dbc3e2aad76b tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf" status: 200 len: 1307 microversion: 2.1 time: 0.750946 Oct 23 01:17:56.926100 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1022/2023] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:56 2022] GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf => generated 1307 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:56.939762 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cb6cea74-912b-41d8-be57-2bfc2c9b1825 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:56.941382 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cb6cea74-912b-41d8-be57-2bfc2c9b1825 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: fb12a9d1-a506-4e57-b93e-62cbe2ac4450] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:56.956951 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb6cea74-912b-41d8-be57-2bfc2c9b1825 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:56.957453 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb6cea74-912b-41d8-be57-2bfc2c9b1825 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:56.957892 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb6cea74-912b-41d8-be57-2bfc2c9b1825 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:56.959004 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb6cea74-912b-41d8-be57-2bfc2c9b1825 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:56.959900 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb6cea74-912b-41d8-be57-2bfc2c9b1825 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:56.960347 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb6cea74-912b-41d8-be57-2bfc2c9b1825 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:57.015883 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb6cea74-912b-41d8-be57-2bfc2c9b1825 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:57.016528 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb6cea74-912b-41d8-be57-2bfc2c9b1825 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:57.016964 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb6cea74-912b-41d8-be57-2bfc2c9b1825 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:57.017437 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-cb6cea74-912b-41d8-be57-2bfc2c9b1825 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lazy-loading 'fault' on Instance uuid fb12a9d1-a506-4e57-b93e-62cbe2ac4450 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:17:57.145143 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cb6cea74-912b-41d8-be57-2bfc2c9b1825 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:57.155922 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cb6cea74-912b-41d8-be57-2bfc2c9b1825 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/fb12a9d1-a506-4e57-b93e-62cbe2ac4450" status: 200 len: 1308 microversion: 2.1 time: 0.233143 Oct 23 01:17:57.157006 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1023/2024] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:56 2022] GET /compute/v2.1/servers/fb12a9d1-a506-4e57-b93e-62cbe2ac4450 => generated 1308 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:57.164142 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0f85cf4d-28f9-48a2-a60d-01d575935268 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:57.165107 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0f85cf4d-28f9-48a2-a60d-01d575935268 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:57.172177 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0f85cf4d-28f9-48a2-a60d-01d575935268 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:57.172778 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0f85cf4d-28f9-48a2-a60d-01d575935268 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:57.173332 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0f85cf4d-28f9-48a2-a60d-01d575935268 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:57.174204 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0f85cf4d-28f9-48a2-a60d-01d575935268 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:57.174925 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0f85cf4d-28f9-48a2-a60d-01d575935268 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:57.176294 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0f85cf4d-28f9-48a2-a60d-01d575935268 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:57.252332 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-03f106cd-f2b5-452f-b221-559895b22c94 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:57.260219 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:17:57.270577 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-03f106cd-f2b5-452f-b221-559895b22c94 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1391 microversion: 2.1 time: 0.486732 Oct 23 01:17:57.271953 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1002/2025] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:56 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1391 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:57.302927 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-0f85cf4d-28f9-48a2-a60d-01d575935268 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lazy-loading 'services' on Instance uuid be9a2687-233d-43c3-95b3-3a8b455595c7 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:17:57.354933 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a96c268c-4aad-4461-b9e1-6ce2fa7678e2 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-948559178", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "06f4c921-9d2b-4ef6-806f-b77fdc508baa"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:17:57.455058 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-a96c268c-4aad-4461-b9e1-6ce2fa7678e2 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] validate_networks() for [('06f4c921-9d2b-4ef6-806f-b77fdc508baa', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:17:57.695944 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0f85cf4d-28f9-48a2-a60d-01d575935268 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "DELETE /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7/os-volume_attachments/16b31471-3574-49f9-9720-04aa69642a80" status: 202 len: 0 microversion: 2.25 time: 0.537200 Oct 23 01:17:57.696637 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1024/2026] 10.222.0.42 () {60 vars in 1457 bytes} [Sun Oct 23 01:17:57 2022] DELETE /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7/os-volume_attachments/16b31471-3574-49f9-9720-04aa69642a80 => generated 0 bytes in 539 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:17:57.720604 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-351af30e-2e0a-4ea3-a554-135aa506a299 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:57.723159 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-351af30e-2e0a-4ea3-a554-135aa506a299 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: bdd228c7-614f-4742-932f-5cb7faf5a68c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:57.744517 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-351af30e-2e0a-4ea3-a554-135aa506a299 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:57.745136 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-351af30e-2e0a-4ea3-a554-135aa506a299 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:57.746411 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-351af30e-2e0a-4ea3-a554-135aa506a299 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:57.748557 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-351af30e-2e0a-4ea3-a554-135aa506a299 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:57.750559 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-351af30e-2e0a-4ea3-a554-135aa506a299 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:57.751113 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-351af30e-2e0a-4ea3-a554-135aa506a299 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:57.808260 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-351af30e-2e0a-4ea3-a554-135aa506a299 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] HTTP exception thrown: Instance bdd228c7-614f-4742-932f-5cb7faf5a68c could not be found. Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-351af30e-2e0a-4ea3-a554-135aa506a299 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Request method failure captured: Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/bdd228c7-614f-4742-932f-5cb7faf5a68c HTTP/1.1 Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJXpa993jrYRXSo3h0JEnbdSd6b8ZTS-9twlCtOjHcZCOn9SWkUYPlRUeDTEsdRLQlb1foY28OZj4MCx6TZcc-A6_C0T9r8u9YkvhoGCHHByrfLzAJFiaQQv5tjLjf-B-XNYVOMRUWR11lSCiUN1mpEL0UOGWONyA-y2T7cK2Z6oZrs Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 386d20bba06b48be9a7e51162dc4d814 Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-928449743 Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/386d20bba06b48be9a7e51162dc4d814"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_386d20bba06b48be9a7e51162dc4d814"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/386d20bba06b48be9a7e51162dc4d814"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/386d20bba06b48be9a7e51162dc4d814"}]}] Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-928449743 Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 386d20bba06b48be9a7e51162dc4d814 Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-928449743 Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-FloatingIPsAssociationTestJSON-928449743-project Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: c9681db3595440a88dacc40393e2e1dc Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-928449743-project Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: exception: Instance bdd228c7-614f-4742-932f-5cb7faf5a68c could not be found. Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'bdd228c7-614f-4742-932f-5cb7faf5a68c'} Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdd228c7-614f-4742-932f-5cb7faf5a68c could not be found. Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdd228c7-614f-4742-932f-5cb7faf5a68c could not be found. Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:17:57.810368 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:17:57.817184 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:17:57.817184 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:57.817184 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:17:57.817184 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:17:57.817184 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:17:57.817184 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:17:57.817184 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdd228c7-614f-4742-932f-5cb7faf5a68c could not be found. Oct 23 01:17:57.817184 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:17:57.835976 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-351af30e-2e0a-4ea3-a554-135aa506a299 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Returning 404 to user: Instance bdd228c7-614f-4742-932f-5cb7faf5a68c could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:17:57.837098 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-351af30e-2e0a-4ea3-a554-135aa506a299 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] 10.222.0.42 "GET /compute/v2.1/servers/bdd228c7-614f-4742-932f-5cb7faf5a68c" status: 404 len: 111 microversion: 2.1 time: 0.139049 Oct 23 01:17:57.840315 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1025/2027] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:57 2022] GET /compute/v2.1/servers/bdd228c7-614f-4742-932f-5cb7faf5a68c => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:17:57.857685 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-124b2f33-e9bc-4965-abdd-69cd4b43d29a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:57.864973 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-124b2f33-e9bc-4965-abdd-69cd4b43d29a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:57.884289 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-124b2f33-e9bc-4965-abdd-69cd4b43d29a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:57.886633 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-124b2f33-e9bc-4965-abdd-69cd4b43d29a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:57.887434 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-124b2f33-e9bc-4965-abdd-69cd4b43d29a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:57.889641 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-124b2f33-e9bc-4965-abdd-69cd4b43d29a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:57.890152 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-124b2f33-e9bc-4965-abdd-69cd4b43d29a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:57.890821 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-124b2f33-e9bc-4965-abdd-69cd4b43d29a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:57.944300 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-124b2f33-e9bc-4965-abdd-69cd4b43d29a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.102179 Oct 23 01:17:57.945888 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1026/2028] 10.222.0.42 () {60 vars in 1343 bytes} [Sun Oct 23 01:17:57 2022] GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:17:57.951276 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8f5c6fb6-b3db-40da-a9d8-40af751a94dc tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:57.952479 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8f5c6fb6-b3db-40da-a9d8-40af751a94dc tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: edb35c7d-9adc-4b53-9bef-147aadbeae5d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:57.961629 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f5c6fb6-b3db-40da-a9d8-40af751a94dc tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:57.962153 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f5c6fb6-b3db-40da-a9d8-40af751a94dc tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:57.969807 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f5c6fb6-b3db-40da-a9d8-40af751a94dc tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:57.969807 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f5c6fb6-b3db-40da-a9d8-40af751a94dc tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:57.969807 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f5c6fb6-b3db-40da-a9d8-40af751a94dc tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:57.969807 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f5c6fb6-b3db-40da-a9d8-40af751a94dc tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:58.001083 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-8f5c6fb6-b3db-40da-a9d8-40af751a94dc tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] HTTP exception thrown: Instance edb35c7d-9adc-4b53-9bef-147aadbeae5d could not be found. Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8f5c6fb6-b3db-40da-a9d8-40af751a94dc tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Request method failure captured: Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d HTTP/1.1 Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJTa-Wr5aQCLD3rHcHuWPO3k5Zd2x-Zj7msg1WbzBDpSz4nRffXqZyRc9nMkn-5sublS8Ra6cTmrG53-WjP6GHC8b93M3FjCGplKfzSQ_ARzbaX5VMNkF0TTzAxLiwBLsBoWRkYDWTDysXQOWpDSoHRrySRzsmQo-BI_ZSGX2bM3-b8 Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: eb058785345d4e58a5820445efe09bee Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-MigrationsAdminTest-2041739261 Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/eb058785345d4e58a5820445efe09bee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_eb058785345d4e58a5820445efe09bee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eb058785345d4e58a5820445efe09bee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eb058785345d4e58a5820445efe09bee"}]}] Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-MigrationsAdminTest-2041739261 Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: eb058785345d4e58a5820445efe09bee Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-MigrationsAdminTest-2041739261 Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-MigrationsAdminTest-2041739261-project Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 547aed83a7e44becb9c89dc6bae62255 Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-MigrationsAdminTest-2041739261-project Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: exception: Instance edb35c7d-9adc-4b53-9bef-147aadbeae5d could not be found. Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'edb35c7d-9adc-4b53-9bef-147aadbeae5d'} Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edb35c7d-9adc-4b53-9bef-147aadbeae5d could not be found. Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edb35c7d-9adc-4b53-9bef-147aadbeae5d could not be found. Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:17:58.004234 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:17:58.010100 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:58.010100 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:17:58.010100 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:17:58.010100 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:17:58.010100 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:17:58.010100 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edb35c7d-9adc-4b53-9bef-147aadbeae5d could not be found. Oct 23 01:17:58.010100 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:17:58.011939 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8f5c6fb6-b3db-40da-a9d8-40af751a94dc tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Returning 404 to user: Instance edb35c7d-9adc-4b53-9bef-147aadbeae5d could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:17:58.013046 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8f5c6fb6-b3db-40da-a9d8-40af751a94dc tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d" status: 404 len: 111 microversion: 2.1 time: 0.065846 Oct 23 01:17:58.015868 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1027/2029] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:57 2022] GET /compute/v2.1/servers/edb35c7d-9adc-4b53-9bef-147aadbeae5d => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:17:58.028612 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-889a1f35-0523-4503-b39d-b4723001205b tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Calling method '.version_select at 0x7f5cc6286dc0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:58.354766 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-a96c268c-4aad-4461-b9e1-6ce2fa7678e2 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:17:58.355247 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-a96c268c-4aad-4461-b9e1-6ce2fa7678e2 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:17:58.355684 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-a96c268c-4aad-4461-b9e1-6ce2fa7678e2 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:17:58.356805 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-a96c268c-4aad-4461-b9e1-6ce2fa7678e2 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:17:58.357520 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-a96c268c-4aad-4461-b9e1-6ce2fa7678e2 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:17:58.375779 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a96c268c-4aad-4461-b9e1-6ce2fa7678e2 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:58.376397 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a96c268c-4aad-4461-b9e1-6ce2fa7678e2 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:58.376899 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a96c268c-4aad-4461-b9e1-6ce2fa7678e2 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:58.377745 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a96c268c-4aad-4461-b9e1-6ce2fa7678e2 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:58.378828 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a96c268c-4aad-4461-b9e1-6ce2fa7678e2 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:58.379252 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a96c268c-4aad-4461-b9e1-6ce2fa7678e2 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:58.431304 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-a96c268c-4aad-4461-b9e1-6ce2fa7678e2 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Getting quotas for project 1c099cb4056b438a9c9dead75e7eb797. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:17:58.447844 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-a96c268c-4aad-4461-b9e1-6ce2fa7678e2 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Getting quotas for user cd6a6c5240f94ace91e1f0ed3e53fa7c and project 1c099cb4056b438a9c9dead75e7eb797. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:17:58.492180 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a96c268c-4aad-4461-b9e1-6ce2fa7678e2 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:17:58.494994 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a96c268c-4aad-4461-b9e1-6ce2fa7678e2 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:17:58.653732 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a96c268c-4aad-4461-b9e1-6ce2fa7678e2 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.380300 Oct 23 01:17:58.671274 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1003/2030] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:17:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1399 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:17:58.677819 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-34805237-41a4-41a2-b7c3-8e7238daf6e0 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:58.678481 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-34805237-41a4-41a2-b7c3-8e7238daf6e0 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 40104c3d-0e82-449a-a331-c4f6ba80afaf] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:58.710550 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-34805237-41a4-41a2-b7c3-8e7238daf6e0 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:58.714974 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-34805237-41a4-41a2-b7c3-8e7238daf6e0 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:58.714974 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-34805237-41a4-41a2-b7c3-8e7238daf6e0 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:58.714974 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-34805237-41a4-41a2-b7c3-8e7238daf6e0 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:58.714974 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-34805237-41a4-41a2-b7c3-8e7238daf6e0 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:58.714974 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-34805237-41a4-41a2-b7c3-8e7238daf6e0 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:59.402043 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-34805237-41a4-41a2-b7c3-8e7238daf6e0 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:17:59.428728 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-34805237-41a4-41a2-b7c3-8e7238daf6e0 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf" status: 200 len: 1307 microversion: 2.1 time: 0.754965 Oct 23 01:17:59.430927 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1004/2031] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:58 2022] GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf => generated 1307 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:17:59.455023 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-86bac563-4472-4aff-b11f-0ca5225491f5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:59.455556 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-86bac563-4472-4aff-b11f-0ca5225491f5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:59.485843 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-86bac563-4472-4aff-b11f-0ca5225491f5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:59.485843 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-86bac563-4472-4aff-b11f-0ca5225491f5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:59.485843 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-86bac563-4472-4aff-b11f-0ca5225491f5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:59.485843 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-86bac563-4472-4aff-b11f-0ca5225491f5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:59.485843 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-86bac563-4472-4aff-b11f-0ca5225491f5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:59.485843 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-86bac563-4472-4aff-b11f-0ca5225491f5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:59.519862 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-86bac563-4472-4aff-b11f-0ca5225491f5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:17:59.711612 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-889a1f35-0523-4503-b39d-b4723001205b tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] 10.222.0.42 "DELETE /compute/v2.1/os-floating-ips/4977642b-e824-4fde-af4d-ac486e41fc54" status: 202 len: 0 microversion: 2.1 time: 1.693008 Oct 23 01:17:59.712742 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1028/2032] 10.222.0.42 () {58 vars in 1263 bytes} [Sun Oct 23 01:17:58 2022] DELETE /compute/v2.1/os-floating-ips/4977642b-e824-4fde-af4d-ac486e41fc54 => generated 0 bytes in 1696 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:17:59.719463 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-25f01bce-1457-4c06-81a1-77c55102c21f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:59.720808 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-25f01bce-1457-4c06-81a1-77c55102c21f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: fb12a9d1-a506-4e57-b93e-62cbe2ac4450] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:59.739839 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25f01bce-1457-4c06-81a1-77c55102c21f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:59.740358 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25f01bce-1457-4c06-81a1-77c55102c21f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:59.740816 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25f01bce-1457-4c06-81a1-77c55102c21f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:59.741535 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25f01bce-1457-4c06-81a1-77c55102c21f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:59.742147 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25f01bce-1457-4c06-81a1-77c55102c21f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:59.742438 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25f01bce-1457-4c06-81a1-77c55102c21f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:59.771295 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-25f01bce-1457-4c06-81a1-77c55102c21f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] HTTP exception thrown: Instance fb12a9d1-a506-4e57-b93e-62cbe2ac4450 could not be found. Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-25f01bce-1457-4c06-81a1-77c55102c21f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Request method failure captured: Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/fb12a9d1-a506-4e57-b93e-62cbe2ac4450 HTTP/1.1 Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJVv0uHUZkawxRif88fKy9LhJENRPZsKhmf6zOBQWEzP00qmPQkqAca2jhb2lRXN9t0zC2JkLeeBldWCPH61ICeNt4v5sTKxLKhNmtzMUUime8-v0hyE48rstyJIK6CJypqB2ITpC6L9yRd-7i6fCZp0NigLnXS0XEU_z_Ej3fGN7bI Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 47aadec780734d03a262d4021f48d625 Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServersOnMultiNodesTest-1204013784 Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/47aadec780734d03a262d4021f48d625"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_47aadec780734d03a262d4021f48d625"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/47aadec780734d03a262d4021f48d625"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/47aadec780734d03a262d4021f48d625"}]}] Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServersOnMultiNodesTest-1204013784 Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 47aadec780734d03a262d4021f48d625 Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1204013784 Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServersOnMultiNodesTest-1204013784-project Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 519c893a1e094200b882cf23db7cae54 Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServersOnMultiNodesTest-1204013784-project Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: exception: Instance fb12a9d1-a506-4e57-b93e-62cbe2ac4450 could not be found. Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'fb12a9d1-a506-4e57-b93e-62cbe2ac4450'} Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb12a9d1-a506-4e57-b93e-62cbe2ac4450 could not be found. Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb12a9d1-a506-4e57-b93e-62cbe2ac4450 could not be found. Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:17:59.772786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:17:59.782756 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:17:59.782756 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:17:59.782756 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:17:59.782756 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:17:59.782756 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:17:59.782756 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb12a9d1-a506-4e57-b93e-62cbe2ac4450 could not be found. Oct 23 01:17:59.782756 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:17:59.782756 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-25f01bce-1457-4c06-81a1-77c55102c21f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Returning 404 to user: Instance fb12a9d1-a506-4e57-b93e-62cbe2ac4450 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:17:59.782756 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-25f01bce-1457-4c06-81a1-77c55102c21f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/fb12a9d1-a506-4e57-b93e-62cbe2ac4450" status: 404 len: 111 microversion: 2.1 time: 0.060356 Oct 23 01:17:59.782756 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1029/2033] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:59 2022] GET /compute/v2.1/servers/fb12a9d1-a506-4e57-b93e-62cbe2ac4450 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:17:59.785196 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-82b11496-6589-4668-91dd-9a4d9a198bda tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:17:59.786385 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-82b11496-6589-4668-91dd-9a4d9a198bda tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:17:59.804718 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:17:59.806419 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-82b11496-6589-4668-91dd-9a4d9a198bda tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:59.806919 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-82b11496-6589-4668-91dd-9a4d9a198bda tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:59.807353 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-82b11496-6589-4668-91dd-9a4d9a198bda tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:59.808063 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-82b11496-6589-4668-91dd-9a4d9a198bda tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:59.814450 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-82b11496-6589-4668-91dd-9a4d9a198bda tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:59.815162 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-82b11496-6589-4668-91dd-9a4d9a198bda tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:59.922319 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-86bac563-4472-4aff-b11f-0ca5225491f5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2" status: 204 len: 0 microversion: 2.1 time: 0.487479 Oct 23 01:17:59.922920 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1005/2034] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:17:59 2022] DELETE /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:17:59.930770 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-27071ca4-df6f-4945-87ae-068b36edae24 req-b1432ddd-6f03-4c44-8b0f-ac124414fa45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edb35c7d-9adc-4b53-9bef-147aadbeae5d", "name": "network-vif-deleted", "tag": "13993c6b-8acd-482a-a3cf-1db8731b8846"}, {"server_uuid": "fb12a9d1-a506-4e57-b93e-62cbe2ac4450", "name": "network-vif-deleted", "tag": "a434ade4-9eef-4376-987c-501fe33cf25c"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:17:59.952091 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-27071ca4-df6f-4945-87ae-068b36edae24 req-b1432ddd-6f03-4c44-8b0f-ac124414fa45 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:17:59.953568 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-27071ca4-df6f-4945-87ae-068b36edae24 req-b1432ddd-6f03-4c44-8b0f-ac124414fa45 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:17:59.955068 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-27071ca4-df6f-4945-87ae-068b36edae24 req-b1432ddd-6f03-4c44-8b0f-ac124414fa45 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:17:59.983852 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-27071ca4-df6f-4945-87ae-068b36edae24 req-b1432ddd-6f03-4c44-8b0f-ac124414fa45 service nova] Creating event network-vif-deleted:13993c6b-8acd-482a-a3cf-1db8731b8846 for instance edb35c7d-9adc-4b53-9bef-147aadbeae5d on n-h1-master-1 Oct 23 01:17:59.986511 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-27071ca4-df6f-4945-87ae-068b36edae24 req-b1432ddd-6f03-4c44-8b0f-ac124414fa45 service nova] Creating event network-vif-deleted:a434ade4-9eef-4376-987c-501fe33cf25c for instance fb12a9d1-a506-4e57-b93e-62cbe2ac4450 on n-h1-master-1 Oct 23 01:18:00.008727 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-27071ca4-df6f-4945-87ae-068b36edae24 req-b1432ddd-6f03-4c44-8b0f-ac124414fa45 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.078075 Oct 23 01:18:00.008727 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1006/2035] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:18:00.017825 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-c9fdd6e8-1dee-46ca-a6f4-87b9ad862dad req-fd7db1fa-4561-4b2c-8ffe-6929a6282019 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a78b5bc9-4e8f-44d7-879c-737838cfe1b6", "tag": "c797d72c-fb4f-47ae-abdc-bb226e15b717"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:18:00.035875 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-c9fdd6e8-1dee-46ca-a6f4-87b9ad862dad req-fd7db1fa-4561-4b2c-8ffe-6929a6282019 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:00.036889 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-c9fdd6e8-1dee-46ca-a6f4-87b9ad862dad req-fd7db1fa-4561-4b2c-8ffe-6929a6282019 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:00.037733 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-c9fdd6e8-1dee-46ca-a6f4-87b9ad862dad req-fd7db1fa-4561-4b2c-8ffe-6929a6282019 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:00.054902 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-c9fdd6e8-1dee-46ca-a6f4-87b9ad862dad req-fd7db1fa-4561-4b2c-8ffe-6929a6282019 service nova] Creating event network-changed:c797d72c-fb4f-47ae-abdc-bb226e15b717 for instance a78b5bc9-4e8f-44d7-879c-737838cfe1b6 on n-h2-master-1 Oct 23 01:18:00.061961 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-c9fdd6e8-1dee-46ca-a6f4-87b9ad862dad req-fd7db1fa-4561-4b2c-8ffe-6929a6282019 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052783 Oct 23 01:18:00.063007 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1007/2036] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:18:00.070388 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f2a8c712-6494-4035-b9c0-66738966bc03 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:00.076577 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f2a8c712-6494-4035-b9c0-66738966bc03 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:00.087499 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-82b11496-6589-4668-91dd-9a4d9a198bda tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:00.095445 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-82b11496-6589-4668-91dd-9a4d9a198bda tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1391 microversion: 2.1 time: 0.317147 Oct 23 01:18:00.096022 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1030/2037] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:17:59 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1391 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:00.103751 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a28be4f6-cae1-4b4f-a1d7-8f203df94d69 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:00.127325 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a28be4f6-cae1-4b4f-a1d7-8f203df94d69 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:00.155454 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a28be4f6-cae1-4b4f-a1d7-8f203df94d69 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:00.156241 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a28be4f6-cae1-4b4f-a1d7-8f203df94d69 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:00.156879 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a28be4f6-cae1-4b4f-a1d7-8f203df94d69 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:00.157256 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f2a8c712-6494-4035-b9c0-66738966bc03 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:00.157951 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a28be4f6-cae1-4b4f-a1d7-8f203df94d69 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:00.158587 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a28be4f6-cae1-4b4f-a1d7-8f203df94d69 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:00.159176 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a28be4f6-cae1-4b4f-a1d7-8f203df94d69 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:00.170400 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f2a8c712-6494-4035-b9c0-66738966bc03 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1216 microversion: 2.1 time: 0.100080 Oct 23 01:18:00.171346 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1008/2038] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:00 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1216 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:00.177211 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a3fd63d1-2d9b-4e68-972f-959408e82fe0 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:00.178070 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a3fd63d1-2d9b-4e68-972f-959408e82fe0 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: a78b5bc9-4e8f-44d7-879c-737838cfe1b6] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:00.191905 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a3fd63d1-2d9b-4e68-972f-959408e82fe0 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:00.191905 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a3fd63d1-2d9b-4e68-972f-959408e82fe0 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:00.191905 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a3fd63d1-2d9b-4e68-972f-959408e82fe0 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:00.191905 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a3fd63d1-2d9b-4e68-972f-959408e82fe0 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:00.191905 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a3fd63d1-2d9b-4e68-972f-959408e82fe0 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:00.191905 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a3fd63d1-2d9b-4e68-972f-959408e82fe0 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:00.229226 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a3fd63d1-2d9b-4e68-972f-959408e82fe0 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: a78b5bc9-4e8f-44d7-879c-737838cfe1b6] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:18:00.232171 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a28be4f6-cae1-4b4f-a1d7-8f203df94d69 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.132026 Oct 23 01:18:00.232947 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1031/2039] 10.222.0.42 () {60 vars in 1343 bytes} [Sun Oct 23 01:18:00 2022] GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:18:00.246269 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4e384335-bf5d-4a1f-904a-072e348146f6 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:00.359277 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4e384335-bf5d-4a1f-904a-072e348146f6 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "DELETE /compute/v2.1/os-server-groups/6fba43e8-a5dc-41db-bd28-f3f6e8ef90f6" status: 204 len: 0 microversion: 2.1 time: 0.119860 Oct 23 01:18:00.373245 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1032/2040] 10.222.0.42 () {58 vars in 1266 bytes} [Sun Oct 23 01:18:00 2022] DELETE /compute/v2.1/os-server-groups/6fba43e8-a5dc-41db-bd28-f3f6e8ef90f6 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:18:00.388954 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1e3ec6d6-3d24-4104-9752-657f6a4e94cc tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:00.390972 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1e3ec6d6-3d24-4104-9752-657f6a4e94cc tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:00.401879 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1e3ec6d6-3d24-4104-9752-657f6a4e94cc tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:00.402685 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1e3ec6d6-3d24-4104-9752-657f6a4e94cc tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:00.403438 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1e3ec6d6-3d24-4104-9752-657f6a4e94cc tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:00.404731 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1e3ec6d6-3d24-4104-9752-657f6a4e94cc tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:00.405743 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1e3ec6d6-3d24-4104-9752-657f6a4e94cc tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:00.407079 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1e3ec6d6-3d24-4104-9752-657f6a4e94cc tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:00.604109 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1e3ec6d6-3d24-4104-9752-657f6a4e94cc tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:00.616751 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1e3ec6d6-3d24-4104-9752-657f6a4e94cc tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2" status: 200 len: 1469 microversion: 2.1 time: 0.240500 Oct 23 01:18:00.618273 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1033/2041] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:00 2022] GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2 => generated 1469 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:00.623328 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d2a74252-f48c-4eb5-90f7-98663dde4afa tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:00.624130 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d2a74252-f48c-4eb5-90f7-98663dde4afa tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: f3aa4181-fc02-43dc-95df-ae1a730fbdca] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:00.632958 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d2a74252-f48c-4eb5-90f7-98663dde4afa tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:00.633764 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d2a74252-f48c-4eb5-90f7-98663dde4afa tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:00.634456 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d2a74252-f48c-4eb5-90f7-98663dde4afa tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:00.635441 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d2a74252-f48c-4eb5-90f7-98663dde4afa tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:00.636123 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d2a74252-f48c-4eb5-90f7-98663dde4afa tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:00.636776 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d2a74252-f48c-4eb5-90f7-98663dde4afa tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:00.667659 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d2a74252-f48c-4eb5-90f7-98663dde4afa tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: f3aa4181-fc02-43dc-95df-ae1a730fbdca] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:18:00.746279 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a3fd63d1-2d9b-4e68-972f-959408e82fe0 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6" status: 204 len: 0 microversion: 2.1 time: 0.573526 Oct 23 01:18:00.747517 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1009/2042] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:18:00 2022] DELETE /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:18:00.766745 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0c75cadc-1db1-4808-b36c-1f4524bdc252 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:00.767982 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0c75cadc-1db1-4808-b36c-1f4524bdc252 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 40104c3d-0e82-449a-a331-c4f6ba80afaf] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:00.776666 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0c75cadc-1db1-4808-b36c-1f4524bdc252 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:00.777582 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0c75cadc-1db1-4808-b36c-1f4524bdc252 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:00.779004 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0c75cadc-1db1-4808-b36c-1f4524bdc252 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:00.786890 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0c75cadc-1db1-4808-b36c-1f4524bdc252 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:00.786890 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0c75cadc-1db1-4808-b36c-1f4524bdc252 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:00.786890 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0c75cadc-1db1-4808-b36c-1f4524bdc252 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:00.953422 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0c75cadc-1db1-4808-b36c-1f4524bdc252 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:00.962738 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0c75cadc-1db1-4808-b36c-1f4524bdc252 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf" status: 200 len: 1307 microversion: 2.1 time: 0.213044 Oct 23 01:18:00.978511 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1010/2043] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:00 2022] GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf => generated 1307 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:00.984476 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-840b94a2-4695-474d-b484-189001eae720 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:00.985168 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-840b94a2-4695-474d-b484-189001eae720 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: a78b5bc9-4e8f-44d7-879c-737838cfe1b6] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:00.992547 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-840b94a2-4695-474d-b484-189001eae720 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:00.993317 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-840b94a2-4695-474d-b484-189001eae720 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:00.994091 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-840b94a2-4695-474d-b484-189001eae720 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:00.995043 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-840b94a2-4695-474d-b484-189001eae720 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:00.995729 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-840b94a2-4695-474d-b484-189001eae720 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:00.996387 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-840b94a2-4695-474d-b484-189001eae720 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:01.042777 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d2a74252-f48c-4eb5-90f7-98663dde4afa tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f3aa4181-fc02-43dc-95df-ae1a730fbdca" status: 204 len: 0 microversion: 2.1 time: 0.422941 Oct 23 01:18:01.049102 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1034/2044] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:18:00 2022] DELETE /compute/v2.1/servers/f3aa4181-fc02-43dc-95df-ae1a730fbdca => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:18:01.058037 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ee7fe3c7-8bb5-4b64-869b-582fd79651e5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:01.058700 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ee7fe3c7-8bb5-4b64-869b-582fd79651e5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 808c58c6-1606-4553-8dd3-8292fa1202b5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:01.067199 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee7fe3c7-8bb5-4b64-869b-582fd79651e5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:01.067729 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee7fe3c7-8bb5-4b64-869b-582fd79651e5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:01.068739 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee7fe3c7-8bb5-4b64-869b-582fd79651e5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:01.069708 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee7fe3c7-8bb5-4b64-869b-582fd79651e5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:01.070205 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee7fe3c7-8bb5-4b64-869b-582fd79651e5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:01.070636 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee7fe3c7-8bb5-4b64-869b-582fd79651e5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:01.078478 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:01.103540 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ee7fe3c7-8bb5-4b64-869b-582fd79651e5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 808c58c6-1606-4553-8dd3-8292fa1202b5] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:18:01.169796 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-840b94a2-4695-474d-b484-189001eae720 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9681db3595440a88dacc40393e2e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386d20bba06b48be9a7e51162dc4d814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:01.185560 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-840b94a2-4695-474d-b484-189001eae720 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] 10.222.0.42 "GET /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6" status: 200 len: 1526 microversion: 2.1 time: 0.205541 Oct 23 01:18:01.186716 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1011/2045] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:00 2022] GET /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6 => generated 1526 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:01.193159 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-772e1acf-50ba-437c-958a-7c4a3b0d23ac tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:01.193836 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-772e1acf-50ba-437c-958a-7c4a3b0d23ac tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:01.207381 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-772e1acf-50ba-437c-958a-7c4a3b0d23ac tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:01.208016 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-772e1acf-50ba-437c-958a-7c4a3b0d23ac tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:01.208582 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-772e1acf-50ba-437c-958a-7c4a3b0d23ac tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:01.210184 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-772e1acf-50ba-437c-958a-7c4a3b0d23ac tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:01.210662 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-772e1acf-50ba-437c-958a-7c4a3b0d23ac tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:01.211115 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-772e1acf-50ba-437c-958a-7c4a3b0d23ac tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:01.466184 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ee7fe3c7-8bb5-4b64-869b-582fd79651e5 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "DELETE /compute/v2.1/servers/808c58c6-1606-4553-8dd3-8292fa1202b5" status: 204 len: 0 microversion: 2.1 time: 0.413072 Oct 23 01:18:01.477675 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1035/2046] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:18:01 2022] DELETE /compute/v2.1/servers/808c58c6-1606-4553-8dd3-8292fa1202b5 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:18:01.509055 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1b9295e3-6544-48a8-90bf-f5b49eb590b8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:01.510241 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1b9295e3-6544-48a8-90bf-f5b49eb590b8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:01.537445 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b9295e3-6544-48a8-90bf-f5b49eb590b8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:01.538761 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b9295e3-6544-48a8-90bf-f5b49eb590b8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:01.539574 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b9295e3-6544-48a8-90bf-f5b49eb590b8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:01.544744 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b9295e3-6544-48a8-90bf-f5b49eb590b8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:01.548060 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b9295e3-6544-48a8-90bf-f5b49eb590b8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:01.548798 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b9295e3-6544-48a8-90bf-f5b49eb590b8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:01.660642 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1b9295e3-6544-48a8-90bf-f5b49eb590b8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:01.668632 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1b9295e3-6544-48a8-90bf-f5b49eb590b8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1212 microversion: 2.1 time: 0.173751 Oct 23 01:18:01.669211 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1036/2047] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:01 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1212 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:01.680529 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cc0ba750-3ae6-421a-8ee8-97cc09df703d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:01.691854 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cc0ba750-3ae6-421a-8ee8-97cc09df703d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:01.707507 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cc0ba750-3ae6-421a-8ee8-97cc09df703d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:01.708014 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cc0ba750-3ae6-421a-8ee8-97cc09df703d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:01.708461 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cc0ba750-3ae6-421a-8ee8-97cc09df703d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:01.709175 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cc0ba750-3ae6-421a-8ee8-97cc09df703d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:01.709659 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cc0ba750-3ae6-421a-8ee8-97cc09df703d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:01.710113 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cc0ba750-3ae6-421a-8ee8-97cc09df703d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:01.734995 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-772e1acf-50ba-437c-958a-7c4a3b0d23ac tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:01.750304 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-772e1acf-50ba-437c-958a-7c4a3b0d23ac tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1391 microversion: 2.1 time: 0.560659 Oct 23 01:18:01.765618 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1012/2048] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:01 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1391 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:01.765618 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7d848635-86ed-4d16-8601-ce333afe1f7d tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:01.765618 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7d848635-86ed-4d16-8601-ce333afe1f7d tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: f3aa4181-fc02-43dc-95df-ae1a730fbdca] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:01.797803 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cc0ba750-3ae6-421a-8ee8-97cc09df703d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.127512 Oct 23 01:18:01.799430 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d848635-86ed-4d16-8601-ce333afe1f7d tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:01.801803 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d848635-86ed-4d16-8601-ce333afe1f7d tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:01.802640 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1037/2049] 10.222.0.42 () {60 vars in 1343 bytes} [Sun Oct 23 01:18:01 2022] GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:18:01.806421 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d848635-86ed-4d16-8601-ce333afe1f7d tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:01.807209 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d848635-86ed-4d16-8601-ce333afe1f7d tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:01.807682 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d848635-86ed-4d16-8601-ce333afe1f7d tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:01.808113 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d848635-86ed-4d16-8601-ce333afe1f7d tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:01.812899 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-960879d5-5a7d-4ba7-8fc1-b6cfb79ea479 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:01.814718 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-960879d5-5a7d-4ba7-8fc1-b6cfb79ea479 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:01.832229 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-960879d5-5a7d-4ba7-8fc1-b6cfb79ea479 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:01.832729 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-960879d5-5a7d-4ba7-8fc1-b6cfb79ea479 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:01.833278 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-960879d5-5a7d-4ba7-8fc1-b6cfb79ea479 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:01.834118 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-960879d5-5a7d-4ba7-8fc1-b6cfb79ea479 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:01.834570 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-960879d5-5a7d-4ba7-8fc1-b6cfb79ea479 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:01.834995 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-960879d5-5a7d-4ba7-8fc1-b6cfb79ea479 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:02.117734 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7d848635-86ed-4d16-8601-ce333afe1f7d tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:02.133535 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7d848635-86ed-4d16-8601-ce333afe1f7d tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/f3aa4181-fc02-43dc-95df-ae1a730fbdca" status: 200 len: 1474 microversion: 2.1 time: 0.377937 Oct 23 01:18:02.139189 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1013/2050] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:01 2022] GET /compute/v2.1/servers/f3aa4181-fc02-43dc-95df-ae1a730fbdca => generated 1474 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:02.148506 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8d55b931-250d-4cf7-b9d2-b7c3caf646fa tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:02.149529 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8d55b931-250d-4cf7-b9d2-b7c3caf646fa tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 40104c3d-0e82-449a-a331-c4f6ba80afaf] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:02.157834 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8d55b931-250d-4cf7-b9d2-b7c3caf646fa tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:02.158703 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8d55b931-250d-4cf7-b9d2-b7c3caf646fa tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:02.162907 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8d55b931-250d-4cf7-b9d2-b7c3caf646fa tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:02.162907 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8d55b931-250d-4cf7-b9d2-b7c3caf646fa tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:02.162907 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8d55b931-250d-4cf7-b9d2-b7c3caf646fa tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:02.162907 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8d55b931-250d-4cf7-b9d2-b7c3caf646fa tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:02.226491 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-960879d5-5a7d-4ba7-8fc1-b6cfb79ea479 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:02.235935 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-960879d5-5a7d-4ba7-8fc1-b6cfb79ea479 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2" status: 200 len: 1469 microversion: 2.1 time: 0.432168 Oct 23 01:18:02.240925 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1038/2051] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:01 2022] GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2 => generated 1469 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:02.254188 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-65c68320-f896-4019-8ae9-f5a0df9b8c37 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:02.260438 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-65c68320-f896-4019-8ae9-f5a0df9b8c37 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: a78b5bc9-4e8f-44d7-879c-737838cfe1b6] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:02.270773 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-65c68320-f896-4019-8ae9-f5a0df9b8c37 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:02.272265 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-65c68320-f896-4019-8ae9-f5a0df9b8c37 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:02.273043 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-65c68320-f896-4019-8ae9-f5a0df9b8c37 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:02.274215 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-65c68320-f896-4019-8ae9-f5a0df9b8c37 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:02.274903 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-65c68320-f896-4019-8ae9-f5a0df9b8c37 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:02.276800 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-65c68320-f896-4019-8ae9-f5a0df9b8c37 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:02.471250 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8d55b931-250d-4cf7-b9d2-b7c3caf646fa tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:02.484110 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8d55b931-250d-4cf7-b9d2-b7c3caf646fa tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf" status: 200 len: 1307 microversion: 2.1 time: 0.343560 Oct 23 01:18:02.484927 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1014/2052] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:02 2022] GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf => generated 1307 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:02.573448 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-65c68320-f896-4019-8ae9-f5a0df9b8c37 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9681db3595440a88dacc40393e2e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386d20bba06b48be9a7e51162dc4d814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:02.584741 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-65c68320-f896-4019-8ae9-f5a0df9b8c37 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] 10.222.0.42 "GET /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6" status: 200 len: 1526 microversion: 2.1 time: 0.340540 Oct 23 01:18:02.615674 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1039/2053] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:02 2022] GET /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6 => generated 1526 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:02.705007 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9d31b81a-8d97-4fcd-b2ec-5b9837417dbe tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:02.706713 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9d31b81a-8d97-4fcd-b2ec-5b9837417dbe tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:02.726255 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9d31b81a-8d97-4fcd-b2ec-5b9837417dbe tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:02.738890 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9d31b81a-8d97-4fcd-b2ec-5b9837417dbe tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:02.739263 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9d31b81a-8d97-4fcd-b2ec-5b9837417dbe tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:02.750859 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9d31b81a-8d97-4fcd-b2ec-5b9837417dbe tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:02.751501 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9d31b81a-8d97-4fcd-b2ec-5b9837417dbe tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:02.751888 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9d31b81a-8d97-4fcd-b2ec-5b9837417dbe tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:02.776756 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0310eb5e-4f12-4fb0-a7f2-912e68d8af24 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:02.777692 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0310eb5e-4f12-4fb0-a7f2-912e68d8af24 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:02.788698 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0310eb5e-4f12-4fb0-a7f2-912e68d8af24 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:02.790539 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0310eb5e-4f12-4fb0-a7f2-912e68d8af24 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:02.792304 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0310eb5e-4f12-4fb0-a7f2-912e68d8af24 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:02.794415 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0310eb5e-4f12-4fb0-a7f2-912e68d8af24 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:02.796978 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0310eb5e-4f12-4fb0-a7f2-912e68d8af24 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:02.799302 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0310eb5e-4f12-4fb0-a7f2-912e68d8af24 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:02.984102 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9d31b81a-8d97-4fcd-b2ec-5b9837417dbe tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:03.000889 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9d31b81a-8d97-4fcd-b2ec-5b9837417dbe tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1268 microversion: 2.1 time: 0.308104 Oct 23 01:18:03.004084 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1015/2054] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:02 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1268 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:03.015137 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8d7f19b7-2732-480f-907d-0d09d2c443e9 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:03.017546 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8d7f19b7-2732-480f-907d-0d09d2c443e9 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:03.033926 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8d7f19b7-2732-480f-907d-0d09d2c443e9 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:03.035078 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8d7f19b7-2732-480f-907d-0d09d2c443e9 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:03.035713 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8d7f19b7-2732-480f-907d-0d09d2c443e9 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:03.036603 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8d7f19b7-2732-480f-907d-0d09d2c443e9 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:03.038951 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8d7f19b7-2732-480f-907d-0d09d2c443e9 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:03.040038 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8d7f19b7-2732-480f-907d-0d09d2c443e9 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:03.122877 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8d7f19b7-2732-480f-907d-0d09d2c443e9 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.117272 Oct 23 01:18:03.123824 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1016/2055] 10.222.0.42 () {60 vars in 1343 bytes} [Sun Oct 23 01:18:03 2022] GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:18:03.130282 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-56c4c059-b2d5-4a97-ac48-0c8222fde950 req-f8942f6e-8532-4f70-ab6f-7b551d7c7948 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40104c3d-0e82-449a-a331-c4f6ba80afaf", "name": "network-vif-plugged", "status": "completed", "tag": "c2cc7df3-aa5d-4a0e-abe9-5229c05e5354"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:18:03.141258 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0310eb5e-4f12-4fb0-a7f2-912e68d8af24 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:03.148657 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-56c4c059-b2d5-4a97-ac48-0c8222fde950 req-f8942f6e-8532-4f70-ab6f-7b551d7c7948 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:03.150090 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-56c4c059-b2d5-4a97-ac48-0c8222fde950 req-f8942f6e-8532-4f70-ab6f-7b551d7c7948 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:03.150722 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-56c4c059-b2d5-4a97-ac48-0c8222fde950 req-f8942f6e-8532-4f70-ab6f-7b551d7c7948 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:03.150871 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0310eb5e-4f12-4fb0-a7f2-912e68d8af24 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1391 microversion: 2.1 time: 0.379279 Oct 23 01:18:03.164263 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1040/2056] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:02 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1391 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:18:03.182672 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-994834b4-a20b-4a1e-bc23-f2ff50191e8f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:03.183143 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-56c4c059-b2d5-4a97-ac48-0c8222fde950 req-f8942f6e-8532-4f70-ab6f-7b551d7c7948 service nova] Creating event network-vif-plugged:c2cc7df3-aa5d-4a0e-abe9-5229c05e5354 for instance 40104c3d-0e82-449a-a331-c4f6ba80afaf on n-h1-master-1 Oct 23 01:18:03.189475 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-994834b4-a20b-4a1e-bc23-f2ff50191e8f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: f3aa4181-fc02-43dc-95df-ae1a730fbdca] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:03.192891 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-56c4c059-b2d5-4a97-ac48-0c8222fde950 req-f8942f6e-8532-4f70-ab6f-7b551d7c7948 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065807 Oct 23 01:18:03.192891 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1017/2057] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:18:03.209148 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-994834b4-a20b-4a1e-bc23-f2ff50191e8f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:03.209661 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-994834b4-a20b-4a1e-bc23-f2ff50191e8f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:03.210187 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-994834b4-a20b-4a1e-bc23-f2ff50191e8f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:03.210957 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-994834b4-a20b-4a1e-bc23-f2ff50191e8f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:03.227946 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-994834b4-a20b-4a1e-bc23-f2ff50191e8f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:03.227946 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-994834b4-a20b-4a1e-bc23-f2ff50191e8f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:03.270856 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1173f5ee-5355-4b85-8815-6ef719726a0d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:03.271725 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1173f5ee-5355-4b85-8815-6ef719726a0d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:03.287191 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1173f5ee-5355-4b85-8815-6ef719726a0d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:03.287696 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1173f5ee-5355-4b85-8815-6ef719726a0d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:03.288138 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1173f5ee-5355-4b85-8815-6ef719726a0d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:03.289209 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1173f5ee-5355-4b85-8815-6ef719726a0d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:03.289334 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1173f5ee-5355-4b85-8815-6ef719726a0d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:03.289718 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1173f5ee-5355-4b85-8815-6ef719726a0d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:03.562913 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-994834b4-a20b-4a1e-bc23-f2ff50191e8f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:03.586625 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-994834b4-a20b-4a1e-bc23-f2ff50191e8f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/f3aa4181-fc02-43dc-95df-ae1a730fbdca" status: 200 len: 1474 microversion: 2.1 time: 0.420353 Oct 23 01:18:03.589526 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1041/2058] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:03 2022] GET /compute/v2.1/servers/f3aa4181-fc02-43dc-95df-ae1a730fbdca => generated 1474 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:03.592481 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1173f5ee-5355-4b85-8815-6ef719726a0d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:03.602406 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1173f5ee-5355-4b85-8815-6ef719726a0d tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2" status: 200 len: 1469 microversion: 2.1 time: 0.344394 Oct 23 01:18:03.603318 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1018/2059] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:03 2022] GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2 => generated 1469 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:03.617389 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bb9e1173-92ca-4e18-9de7-f4eb71421304 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:03.618827 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-bb9e1173-92ca-4e18-9de7-f4eb71421304 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 40104c3d-0e82-449a-a331-c4f6ba80afaf] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:03.620916 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cfbfd8ac-fc37-4469-ac7a-2ed422ef4060 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:03.621554 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-cfbfd8ac-fc37-4469-ac7a-2ed422ef4060 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: a78b5bc9-4e8f-44d7-879c-737838cfe1b6] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:03.627197 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bb9e1173-92ca-4e18-9de7-f4eb71421304 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:03.627463 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:03.627692 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bb9e1173-92ca-4e18-9de7-f4eb71421304 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:03.631462 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bb9e1173-92ca-4e18-9de7-f4eb71421304 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:03.632227 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bb9e1173-92ca-4e18-9de7-f4eb71421304 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:03.632901 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bb9e1173-92ca-4e18-9de7-f4eb71421304 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:03.633326 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bb9e1173-92ca-4e18-9de7-f4eb71421304 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:03.634561 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cfbfd8ac-fc37-4469-ac7a-2ed422ef4060 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:03.635290 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cfbfd8ac-fc37-4469-ac7a-2ed422ef4060 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:03.635973 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cfbfd8ac-fc37-4469-ac7a-2ed422ef4060 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:03.636891 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cfbfd8ac-fc37-4469-ac7a-2ed422ef4060 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:03.637553 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cfbfd8ac-fc37-4469-ac7a-2ed422ef4060 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:03.638206 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cfbfd8ac-fc37-4469-ac7a-2ed422ef4060 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:03.772666 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cfbfd8ac-fc37-4469-ac7a-2ed422ef4060 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9681db3595440a88dacc40393e2e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386d20bba06b48be9a7e51162dc4d814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:03.781462 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:03.787091 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cfbfd8ac-fc37-4469-ac7a-2ed422ef4060 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] 10.222.0.42 "GET /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6" status: 200 len: 1484 microversion: 2.1 time: 0.170879 Oct 23 01:18:03.788318 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1019/2060] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:03 2022] GET /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6 => generated 1484 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:03.871973 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bb9e1173-92ca-4e18-9de7-f4eb71421304 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:03.883612 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bb9e1173-92ca-4e18-9de7-f4eb71421304 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf" status: 200 len: 1307 microversion: 2.1 time: 0.292625 Oct 23 01:18:03.884803 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1042/2061] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:03 2022] GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf => generated 1307 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:04.027640 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d83a608a-d4ae-4c28-91a2-b7e654bc482f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:04.028364 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d83a608a-d4ae-4c28-91a2-b7e654bc482f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:04.045710 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d83a608a-d4ae-4c28-91a2-b7e654bc482f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:04.047736 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d83a608a-d4ae-4c28-91a2-b7e654bc482f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:04.048418 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d83a608a-d4ae-4c28-91a2-b7e654bc482f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:04.049161 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d83a608a-d4ae-4c28-91a2-b7e654bc482f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:04.049624 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d83a608a-d4ae-4c28-91a2-b7e654bc482f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:04.053835 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d83a608a-d4ae-4c28-91a2-b7e654bc482f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:04.135637 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-da8b3140-7d2a-46d5-9748-d82a49b6895d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:04.138264 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-da8b3140-7d2a-46d5-9748-d82a49b6895d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:04.144729 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d83a608a-d4ae-4c28-91a2-b7e654bc482f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:04.153245 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da8b3140-7d2a-46d5-9748-d82a49b6895d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:04.153745 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da8b3140-7d2a-46d5-9748-d82a49b6895d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:04.154215 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da8b3140-7d2a-46d5-9748-d82a49b6895d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:04.155157 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da8b3140-7d2a-46d5-9748-d82a49b6895d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:04.155788 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da8b3140-7d2a-46d5-9748-d82a49b6895d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:04.156396 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da8b3140-7d2a-46d5-9748-d82a49b6895d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:04.158028 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d83a608a-d4ae-4c28-91a2-b7e654bc482f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1286 microversion: 2.1 time: 0.135594 Oct 23 01:18:04.166939 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1020/2062] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:04 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1286 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:04.186164 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-111991e3-6225-44a8-aa43-1ae69343705a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:04.187045 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-111991e3-6225-44a8-aa43-1ae69343705a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:04.194229 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-111991e3-6225-44a8-aa43-1ae69343705a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:04.195006 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-111991e3-6225-44a8-aa43-1ae69343705a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:04.195611 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-111991e3-6225-44a8-aa43-1ae69343705a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:04.196484 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-111991e3-6225-44a8-aa43-1ae69343705a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:04.197103 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-111991e3-6225-44a8-aa43-1ae69343705a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:04.197692 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-111991e3-6225-44a8-aa43-1ae69343705a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:04.212190 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-da8b3140-7d2a-46d5-9748-d82a49b6895d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.080610 Oct 23 01:18:04.215119 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1043/2063] 10.222.0.42 () {60 vars in 1343 bytes} [Sun Oct 23 01:18:04 2022] GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 23 01:18:04.269207 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-9e17dad7-fc65-41a6-915c-2535bbc3494b req-531069ed-040d-46a3-a040-4afdfde5cd95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a78b5bc9-4e8f-44d7-879c-737838cfe1b6", "name": "network-vif-deleted", "tag": "c797d72c-fb4f-47ae-abdc-bb226e15b717"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:18:04.279553 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-9e17dad7-fc65-41a6-915c-2535bbc3494b req-531069ed-040d-46a3-a040-4afdfde5cd95 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:04.280079 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-9e17dad7-fc65-41a6-915c-2535bbc3494b req-531069ed-040d-46a3-a040-4afdfde5cd95 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:04.280734 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-9e17dad7-fc65-41a6-915c-2535bbc3494b req-531069ed-040d-46a3-a040-4afdfde5cd95 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:04.294565 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-9e17dad7-fc65-41a6-915c-2535bbc3494b req-531069ed-040d-46a3-a040-4afdfde5cd95 service nova] Creating event network-vif-deleted:c797d72c-fb4f-47ae-abdc-bb226e15b717 for instance a78b5bc9-4e8f-44d7-879c-737838cfe1b6 on n-h2-master-1 Oct 23 01:18:04.300874 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-9e17dad7-fc65-41a6-915c-2535bbc3494b req-531069ed-040d-46a3-a040-4afdfde5cd95 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034592 Oct 23 01:18:04.302240 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1044/2064] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:18:04.401453 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-111991e3-6225-44a8-aa43-1ae69343705a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:04.414046 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-111991e3-6225-44a8-aa43-1ae69343705a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1391 microversion: 2.1 time: 0.238067 Oct 23 01:18:04.416596 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1021/2065] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:04 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1391 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:04.629535 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f17d8cc4-83bf-4f73-aea5-797c14bee76b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:04.630270 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f17d8cc4-83bf-4f73-aea5-797c14bee76b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: f3aa4181-fc02-43dc-95df-ae1a730fbdca] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:04.630992 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fc0b10ad-d5d4-4102-ab79-187edd5b052b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:04.631602 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fc0b10ad-d5d4-4102-ab79-187edd5b052b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:04.644963 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fc0b10ad-d5d4-4102-ab79-187edd5b052b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:04.645546 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fc0b10ad-d5d4-4102-ab79-187edd5b052b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:04.646019 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fc0b10ad-d5d4-4102-ab79-187edd5b052b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:04.646718 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fc0b10ad-d5d4-4102-ab79-187edd5b052b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:04.647163 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fc0b10ad-d5d4-4102-ab79-187edd5b052b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:04.647583 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fc0b10ad-d5d4-4102-ab79-187edd5b052b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:04.656420 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f17d8cc4-83bf-4f73-aea5-797c14bee76b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:04.658609 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f17d8cc4-83bf-4f73-aea5-797c14bee76b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:04.660028 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f17d8cc4-83bf-4f73-aea5-797c14bee76b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:04.661057 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f17d8cc4-83bf-4f73-aea5-797c14bee76b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:04.661727 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f17d8cc4-83bf-4f73-aea5-797c14bee76b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:04.662426 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f17d8cc4-83bf-4f73-aea5-797c14bee76b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:05.146571 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f17d8cc4-83bf-4f73-aea5-797c14bee76b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:05.167000 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f17d8cc4-83bf-4f73-aea5-797c14bee76b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/f3aa4181-fc02-43dc-95df-ae1a730fbdca" status: 200 len: 1474 microversion: 2.1 time: 0.542001 Oct 23 01:18:05.167635 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1045/2066] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:04 2022] GET /compute/v2.1/servers/f3aa4181-fc02-43dc-95df-ae1a730fbdca => generated 1474 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:05.172283 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5ccab9ee-56ae-4b69-a1bf-d4e9d2fc5cb7 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:05.172892 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5ccab9ee-56ae-4b69-a1bf-d4e9d2fc5cb7 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: a78b5bc9-4e8f-44d7-879c-737838cfe1b6] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:05.184488 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5ccab9ee-56ae-4b69-a1bf-d4e9d2fc5cb7 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:05.185019 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5ccab9ee-56ae-4b69-a1bf-d4e9d2fc5cb7 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:05.185524 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5ccab9ee-56ae-4b69-a1bf-d4e9d2fc5cb7 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:05.189833 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5ccab9ee-56ae-4b69-a1bf-d4e9d2fc5cb7 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:05.190898 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5ccab9ee-56ae-4b69-a1bf-d4e9d2fc5cb7 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:05.193819 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5ccab9ee-56ae-4b69-a1bf-d4e9d2fc5cb7 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:05.201717 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fc0b10ad-d5d4-4102-ab79-187edd5b052b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:05.216637 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fc0b10ad-d5d4-4102-ab79-187edd5b052b tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2" status: 200 len: 1469 microversion: 2.1 time: 0.589400 Oct 23 01:18:05.222592 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1022/2067] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:04 2022] GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2 => generated 1469 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:05.234688 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-58485b4e-4c36-4a33-9ff6-e8006b882779 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:05.242823 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-58485b4e-4c36-4a33-9ff6-e8006b882779 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 40104c3d-0e82-449a-a331-c4f6ba80afaf] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:05.266423 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-58485b4e-4c36-4a33-9ff6-e8006b882779 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:05.266423 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-58485b4e-4c36-4a33-9ff6-e8006b882779 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:05.266423 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-58485b4e-4c36-4a33-9ff6-e8006b882779 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:05.272891 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-58485b4e-4c36-4a33-9ff6-e8006b882779 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:05.273390 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-58485b4e-4c36-4a33-9ff6-e8006b882779 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:05.273839 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-58485b4e-4c36-4a33-9ff6-e8006b882779 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:05.284727 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5ccab9ee-56ae-4b69-a1bf-d4e9d2fc5cb7 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:05.286754 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5ccab9ee-56ae-4b69-a1bf-d4e9d2fc5cb7 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:05.287233 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5ccab9ee-56ae-4b69-a1bf-d4e9d2fc5cb7 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:05.287704 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-5ccab9ee-56ae-4b69-a1bf-d4e9d2fc5cb7 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lazy-loading 'fault' on Instance uuid a78b5bc9-4e8f-44d7-879c-737838cfe1b6 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:18:05.397849 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5ccab9ee-56ae-4b69-a1bf-d4e9d2fc5cb7 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9681db3595440a88dacc40393e2e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386d20bba06b48be9a7e51162dc4d814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:05.412291 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5ccab9ee-56ae-4b69-a1bf-d4e9d2fc5cb7 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] 10.222.0.42 "GET /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6" status: 200 len: 1313 microversion: 2.1 time: 0.243558 Oct 23 01:18:05.417768 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1046/2068] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:05 2022] GET /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6 => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:05.428473 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e3bbbab4-f2cf-420e-b5d4-9619d86471d1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:05.431813 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e3bbbab4-f2cf-420e-b5d4-9619d86471d1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:05.447447 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e3bbbab4-f2cf-420e-b5d4-9619d86471d1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:05.449928 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e3bbbab4-f2cf-420e-b5d4-9619d86471d1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:05.449928 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e3bbbab4-f2cf-420e-b5d4-9619d86471d1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:05.449928 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e3bbbab4-f2cf-420e-b5d4-9619d86471d1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:05.449928 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e3bbbab4-f2cf-420e-b5d4-9619d86471d1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:05.454506 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e3bbbab4-f2cf-420e-b5d4-9619d86471d1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:05.629371 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e3bbbab4-f2cf-420e-b5d4-9619d86471d1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:05.644465 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e3bbbab4-f2cf-420e-b5d4-9619d86471d1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1274 microversion: 2.1 time: 0.222270 Oct 23 01:18:05.645219 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1047/2069] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:05 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1274 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:05.654460 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-33e1935c-9f56-495c-8333-86cb91b1973e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:05.660780 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-33e1935c-9f56-495c-8333-86cb91b1973e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:05.678418 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-33e1935c-9f56-495c-8333-86cb91b1973e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:05.679078 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-33e1935c-9f56-495c-8333-86cb91b1973e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:05.679669 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-33e1935c-9f56-495c-8333-86cb91b1973e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:05.682327 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-33e1935c-9f56-495c-8333-86cb91b1973e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:05.682939 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-33e1935c-9f56-495c-8333-86cb91b1973e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:05.685927 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-33e1935c-9f56-495c-8333-86cb91b1973e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:05.687334 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-58485b4e-4c36-4a33-9ff6-e8006b882779 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:05.702465 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-58485b4e-4c36-4a33-9ff6-e8006b882779 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf" status: 200 len: 1307 microversion: 2.1 time: 0.470684 Oct 23 01:18:05.714733 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1023/2070] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:05 2022] GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf => generated 1307 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:05.731525 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-facdaa4f-24f5-4071-90ce-842f044c2e86 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:05.736422 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-facdaa4f-24f5-4071-90ce-842f044c2e86 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:05.759066 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-facdaa4f-24f5-4071-90ce-842f044c2e86 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:05.759925 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-facdaa4f-24f5-4071-90ce-842f044c2e86 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:05.761500 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-facdaa4f-24f5-4071-90ce-842f044c2e86 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:05.764570 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-facdaa4f-24f5-4071-90ce-842f044c2e86 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:05.765363 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-facdaa4f-24f5-4071-90ce-842f044c2e86 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:05.766698 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-facdaa4f-24f5-4071-90ce-842f044c2e86 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:05.770461 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-33e1935c-9f56-495c-8333-86cb91b1973e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.122013 Oct 23 01:18:05.782792 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1048/2071] 10.222.0.42 () {60 vars in 1343 bytes} [Sun Oct 23 01:18:05 2022] GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7/os-volume_attachments => generated 25 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:06.044096 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-5523c980-3c0c-47fb-afa0-573a44eaf1c5 req-e13642f7-2ede-4e29-a8f1-326185add224 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ae2878c-23a6-4e78-bd92-69fb03fc27b2", "name": "network-vif-deleted", "tag": "9915372e-5565-43b8-b511-9fbf12974675"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:18:06.055020 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-5523c980-3c0c-47fb-afa0-573a44eaf1c5 req-e13642f7-2ede-4e29-a8f1-326185add224 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:06.055509 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-5523c980-3c0c-47fb-afa0-573a44eaf1c5 req-e13642f7-2ede-4e29-a8f1-326185add224 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:06.057585 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-5523c980-3c0c-47fb-afa0-573a44eaf1c5 req-e13642f7-2ede-4e29-a8f1-326185add224 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:06.087355 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-5523c980-3c0c-47fb-afa0-573a44eaf1c5 req-e13642f7-2ede-4e29-a8f1-326185add224 service nova] Creating event network-vif-deleted:9915372e-5565-43b8-b511-9fbf12974675 for instance 4ae2878c-23a6-4e78-bd92-69fb03fc27b2 on n-h1-master-1 Oct 23 01:18:06.095895 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-5523c980-3c0c-47fb-afa0-573a44eaf1c5 req-e13642f7-2ede-4e29-a8f1-326185add224 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061092 Oct 23 01:18:06.097767 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1049/2072] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:18:06.203130 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-168ff37d-74e0-4d61-818e-4210d7d1bd37 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:06.204428 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-168ff37d-74e0-4d61-818e-4210d7d1bd37 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: f3aa4181-fc02-43dc-95df-ae1a730fbdca] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:06.229003 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-168ff37d-74e0-4d61-818e-4210d7d1bd37 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:06.229332 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-168ff37d-74e0-4d61-818e-4210d7d1bd37 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:06.232183 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-168ff37d-74e0-4d61-818e-4210d7d1bd37 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:06.232980 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-168ff37d-74e0-4d61-818e-4210d7d1bd37 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:06.235763 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-168ff37d-74e0-4d61-818e-4210d7d1bd37 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:06.236226 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-168ff37d-74e0-4d61-818e-4210d7d1bd37 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:06.549868 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-facdaa4f-24f5-4071-90ce-842f044c2e86 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:06.563891 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-facdaa4f-24f5-4071-90ce-842f044c2e86 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1391 microversion: 2.1 time: 0.847906 Oct 23 01:18:06.571411 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1024/2073] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:05 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1391 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:06.578550 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-99da0004-5ff5-45a0-8ef2-b22dd564b390 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:06.585509 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-99da0004-5ff5-45a0-8ef2-b22dd564b390 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:06.614672 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-99da0004-5ff5-45a0-8ef2-b22dd564b390 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:06.615471 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-99da0004-5ff5-45a0-8ef2-b22dd564b390 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:06.616323 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-99da0004-5ff5-45a0-8ef2-b22dd564b390 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:06.617380 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-99da0004-5ff5-45a0-8ef2-b22dd564b390 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:06.620531 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-99da0004-5ff5-45a0-8ef2-b22dd564b390 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:06.621171 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-99da0004-5ff5-45a0-8ef2-b22dd564b390 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:06.625676 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-168ff37d-74e0-4d61-818e-4210d7d1bd37 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:06.654894 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-168ff37d-74e0-4d61-818e-4210d7d1bd37 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/f3aa4181-fc02-43dc-95df-ae1a730fbdca" status: 200 len: 1432 microversion: 2.1 time: 0.455836 Oct 23 01:18:06.654894 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1050/2074] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:06 2022] GET /compute/v2.1/servers/f3aa4181-fc02-43dc-95df-ae1a730fbdca => generated 1432 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:18:06.668888 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fbef6e75-6f10-47e6-b925-af0f985030e3 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:06.670744 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-fbef6e75-6f10-47e6-b925-af0f985030e3 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] [instance: a78b5bc9-4e8f-44d7-879c-737838cfe1b6] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:06.688889 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fbef6e75-6f10-47e6-b925-af0f985030e3 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:06.691572 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fbef6e75-6f10-47e6-b925-af0f985030e3 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:06.692468 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fbef6e75-6f10-47e6-b925-af0f985030e3 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:06.694182 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fbef6e75-6f10-47e6-b925-af0f985030e3 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:06.694909 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fbef6e75-6f10-47e6-b925-af0f985030e3 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:06.695527 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fbef6e75-6f10-47e6-b925-af0f985030e3 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:06.700459 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:06.734554 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-fbef6e75-6f10-47e6-b925-af0f985030e3 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] HTTP exception thrown: Instance a78b5bc9-4e8f-44d7-879c-737838cfe1b6 could not be found. Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fbef6e75-6f10-47e6-b925-af0f985030e3 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Request method failure captured: Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6 HTTP/1.1 Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJXpa993jrYRXSo3h0JEnbdSd6b8ZTS-9twlCtOjHcZCOn9SWkUYPlRUeDTEsdRLQlb1foY28OZj4MCx6TZcc-A6_C0T9r8u9YkvhoGCHHByrfLzAJFiaQQv5tjLjf-B-XNYVOMRUWR11lSCiUN1mpEL0UOGWONyA-y2T7cK2Z6oZrs Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 386d20bba06b48be9a7e51162dc4d814 Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-928449743 Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/386d20bba06b48be9a7e51162dc4d814"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_386d20bba06b48be9a7e51162dc4d814"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/386d20bba06b48be9a7e51162dc4d814"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/386d20bba06b48be9a7e51162dc4d814"}]}] Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-928449743 Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 386d20bba06b48be9a7e51162dc4d814 Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-928449743 Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-FloatingIPsAssociationTestJSON-928449743-project Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: c9681db3595440a88dacc40393e2e1dc Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-928449743-project Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: exception: Instance a78b5bc9-4e8f-44d7-879c-737838cfe1b6 could not be found. Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'a78b5bc9-4e8f-44d7-879c-737838cfe1b6'} Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a78b5bc9-4e8f-44d7-879c-737838cfe1b6 could not be found. Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a78b5bc9-4e8f-44d7-879c-737838cfe1b6 could not be found. Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:06.736263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:06.745160 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:06.745160 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:06.745160 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:18:06.745160 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:18:06.745160 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:18:06.745160 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:18:06.745160 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a78b5bc9-4e8f-44d7-879c-737838cfe1b6 could not be found. Oct 23 01:18:06.745160 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:06.745160 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fbef6e75-6f10-47e6-b925-af0f985030e3 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] Returning 404 to user: Instance a78b5bc9-4e8f-44d7-879c-737838cfe1b6 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:18:06.745160 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fbef6e75-6f10-47e6-b925-af0f985030e3 tempest-FloatingIPsAssociationTestJSON-928449743 tempest-FloatingIPsAssociationTestJSON-928449743-project] 10.222.0.42 "GET /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6" status: 404 len: 111 microversion: 2.1 time: 0.086086 Oct 23 01:18:06.745160 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1051/2075] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:06 2022] GET /compute/v2.1/servers/a78b5bc9-4e8f-44d7-879c-737838cfe1b6 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:18:06.751974 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6dfd3d7b-71b0-4e35-b332-3c687144bac0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:06.753432 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6dfd3d7b-71b0-4e35-b332-3c687144bac0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:06.761968 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6dfd3d7b-71b0-4e35-b332-3c687144bac0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:06.762746 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6dfd3d7b-71b0-4e35-b332-3c687144bac0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:06.763359 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6dfd3d7b-71b0-4e35-b332-3c687144bac0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:06.764239 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6dfd3d7b-71b0-4e35-b332-3c687144bac0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:06.764870 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6dfd3d7b-71b0-4e35-b332-3c687144bac0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:06.765459 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6dfd3d7b-71b0-4e35-b332-3c687144bac0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:06.772937 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-99da0004-5ff5-45a0-8ef2-b22dd564b390 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:06.775625 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-99da0004-5ff5-45a0-8ef2-b22dd564b390 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:06.775625 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-99da0004-5ff5-45a0-8ef2-b22dd564b390 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:06.775828 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-99da0004-5ff5-45a0-8ef2-b22dd564b390 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lazy-loading 'fault' on Instance uuid 4ae2878c-23a6-4e78-bd92-69fb03fc27b2 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:18:07.109731 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-99da0004-5ff5-45a0-8ef2-b22dd564b390 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547aed83a7e44becb9c89dc6bae62255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb058785345d4e58a5820445efe09bee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:07.122403 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-99da0004-5ff5-45a0-8ef2-b22dd564b390 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2" status: 200 len: 1303 microversion: 2.1 time: 0.549561 Oct 23 01:18:07.129793 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1025/2076] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:06 2022] GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2 => generated 1303 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:07.153403 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0c9a3ef6-cd6f-4b88-b011-be533cec8f1a tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:07.159932 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0c9a3ef6-cd6f-4b88-b011-be533cec8f1a tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 40104c3d-0e82-449a-a331-c4f6ba80afaf] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:07.174609 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0c9a3ef6-cd6f-4b88-b011-be533cec8f1a tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:07.175150 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0c9a3ef6-cd6f-4b88-b011-be533cec8f1a tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:07.175838 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0c9a3ef6-cd6f-4b88-b011-be533cec8f1a tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:07.176789 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0c9a3ef6-cd6f-4b88-b011-be533cec8f1a tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:07.177472 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0c9a3ef6-cd6f-4b88-b011-be533cec8f1a tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:07.178140 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0c9a3ef6-cd6f-4b88-b011-be533cec8f1a tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:07.522431 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6dfd3d7b-71b0-4e35-b332-3c687144bac0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:07.539235 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6dfd3d7b-71b0-4e35-b332-3c687144bac0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1316 microversion: 2.1 time: 0.789120 Oct 23 01:18:07.540287 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1052/2077] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:06 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1316 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:07.545337 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-3892900e-3186-4835-b98f-8baee5a09949 req-2ab269bc-abbb-41ec-9eee-62dc9eab6e69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3aa4181-fc02-43dc-95df-ae1a730fbdca", "name": "network-vif-deleted", "tag": "ac87b72d-8aca-4ffa-993c-09cc2cf87903"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:18:07.576199 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-3892900e-3186-4835-b98f-8baee5a09949 req-2ab269bc-abbb-41ec-9eee-62dc9eab6e69 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:07.578203 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-3892900e-3186-4835-b98f-8baee5a09949 req-2ab269bc-abbb-41ec-9eee-62dc9eab6e69 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:07.584102 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-3892900e-3186-4835-b98f-8baee5a09949 req-2ab269bc-abbb-41ec-9eee-62dc9eab6e69 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:07.603628 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-3892900e-3186-4835-b98f-8baee5a09949 req-2ab269bc-abbb-41ec-9eee-62dc9eab6e69 service nova] Creating event network-vif-deleted:ac87b72d-8aca-4ffa-993c-09cc2cf87903 for instance f3aa4181-fc02-43dc-95df-ae1a730fbdca on n-h1-master-1 Oct 23 01:18:07.609570 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-3892900e-3186-4835-b98f-8baee5a09949 req-2ab269bc-abbb-41ec-9eee-62dc9eab6e69 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067603 Oct 23 01:18:07.611116 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1053/2078] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:18:07.620745 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0c1a2d0e-493c-49f7-aa9f-60a4b9b4dadc tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:07.620745 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0c1a2d0e-493c-49f7-aa9f-60a4b9b4dadc tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:07.627435 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0c1a2d0e-493c-49f7-aa9f-60a4b9b4dadc tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:07.628985 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0c1a2d0e-493c-49f7-aa9f-60a4b9b4dadc tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:07.629694 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0c1a2d0e-493c-49f7-aa9f-60a4b9b4dadc tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:07.630963 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0c1a2d0e-493c-49f7-aa9f-60a4b9b4dadc tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:07.631744 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0c1a2d0e-493c-49f7-aa9f-60a4b9b4dadc tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:07.632775 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0c1a2d0e-493c-49f7-aa9f-60a4b9b4dadc tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:07.878795 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0c9a3ef6-cd6f-4b88-b011-be533cec8f1a tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:07.889071 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0c9a3ef6-cd6f-4b88-b011-be533cec8f1a tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf" status: 200 len: 1487 microversion: 2.1 time: 0.758077 Oct 23 01:18:07.889672 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1026/2079] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:07 2022] GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf => generated 1487 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:07.917158 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5f62448e-72eb-4e00-9205-6e30d3a3077f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:07.917802 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5f62448e-72eb-4e00-9205-6e30d3a3077f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: f3aa4181-fc02-43dc-95df-ae1a730fbdca] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:07.953199 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f62448e-72eb-4e00-9205-6e30d3a3077f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:07.959374 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f62448e-72eb-4e00-9205-6e30d3a3077f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:07.960089 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f62448e-72eb-4e00-9205-6e30d3a3077f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:07.961048 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f62448e-72eb-4e00-9205-6e30d3a3077f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:07.967510 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f62448e-72eb-4e00-9205-6e30d3a3077f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:07.969308 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f62448e-72eb-4e00-9205-6e30d3a3077f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:08.110340 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f62448e-72eb-4e00-9205-6e30d3a3077f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:08.112000 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f62448e-72eb-4e00-9205-6e30d3a3077f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:08.114223 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f62448e-72eb-4e00-9205-6e30d3a3077f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:08.116348 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-5f62448e-72eb-4e00-9205-6e30d3a3077f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lazy-loading 'fault' on Instance uuid f3aa4181-fc02-43dc-95df-ae1a730fbdca {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:18:08.330222 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5f62448e-72eb-4e00-9205-6e30d3a3077f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:08.349342 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5f62448e-72eb-4e00-9205-6e30d3a3077f tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/f3aa4181-fc02-43dc-95df-ae1a730fbdca" status: 200 len: 1309 microversion: 2.1 time: 0.444113 Oct 23 01:18:08.362001 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1027/2080] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:07 2022] GET /compute/v2.1/servers/f3aa4181-fc02-43dc-95df-ae1a730fbdca => generated 1309 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:08.362001 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d39bd41e-2c33-47fe-ad50-6b0a3478acbb tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:18:08.365044 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d39bd41e-2c33-47fe-ad50-6b0a3478acbb tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:08.365926 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d39bd41e-2c33-47fe-ad50-6b0a3478acbb tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:08.366619 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d39bd41e-2c33-47fe-ad50-6b0a3478acbb tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:08.449109 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0c1a2d0e-493c-49f7-aa9f-60a4b9b4dadc tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:08.465631 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0c1a2d0e-493c-49f7-aa9f-60a4b9b4dadc tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1391 microversion: 2.1 time: 0.850419 Oct 23 01:18:08.466695 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1054/2081] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:07 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1391 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:08.491824 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e8632c24-96e6-4a90-9944-e8006bed6ba5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:08.492485 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e8632c24-96e6-4a90-9944-e8006bed6ba5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] [instance: 4ae2878c-23a6-4e78-bd92-69fb03fc27b2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:08.512843 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8632c24-96e6-4a90-9944-e8006bed6ba5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:08.513356 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8632c24-96e6-4a90-9944-e8006bed6ba5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:08.513757 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8632c24-96e6-4a90-9944-e8006bed6ba5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:08.514974 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8632c24-96e6-4a90-9944-e8006bed6ba5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:08.515435 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8632c24-96e6-4a90-9944-e8006bed6ba5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:08.518207 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8632c24-96e6-4a90-9944-e8006bed6ba5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:08.527718 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=6 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:08.536120 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d39bd41e-2c33-47fe-ad50-6b0a3478acbb tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 40104c3d-0e82-449a-a331-c4f6ba80afaf] Going to try to stop instance {{(pid=120944) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 23 01:18:08.538188 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-e8632c24-96e6-4a90-9944-e8006bed6ba5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] HTTP exception thrown: Instance 4ae2878c-23a6-4e78-bd92-69fb03fc27b2 could not be found. Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e8632c24-96e6-4a90-9944-e8006bed6ba5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Request method failure captured: Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2 HTTP/1.1 Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJTa-Wr5aQCLD3rHcHuWPO3k5Zd2x-Zj7msg1WbzBDpSz4nRffXqZyRc9nMkn-5sublS8Ra6cTmrG53-WjP6GHC8b93M3FjCGplKfzSQ_ARzbaX5VMNkF0TTzAxLiwBLsBoWRkYDWTDysXQOWpDSoHRrySRzsmQo-BI_ZSGX2bM3-b8 Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: eb058785345d4e58a5820445efe09bee Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-MigrationsAdminTest-2041739261 Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/eb058785345d4e58a5820445efe09bee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_eb058785345d4e58a5820445efe09bee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eb058785345d4e58a5820445efe09bee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eb058785345d4e58a5820445efe09bee"}]}] Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-MigrationsAdminTest-2041739261 Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: eb058785345d4e58a5820445efe09bee Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-MigrationsAdminTest-2041739261 Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-MigrationsAdminTest-2041739261-project Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 547aed83a7e44becb9c89dc6bae62255 Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-MigrationsAdminTest-2041739261-project Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 4ae2878c-23a6-4e78-bd92-69fb03fc27b2 could not be found. Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '4ae2878c-23a6-4e78-bd92-69fb03fc27b2'} Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ae2878c-23a6-4e78-bd92-69fb03fc27b2 could not be found. Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ae2878c-23a6-4e78-bd92-69fb03fc27b2 could not be found. Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:08.541160 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:08.546898 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:08.546898 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:18:08.546898 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:18:08.546898 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:18:08.546898 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:18:08.546898 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ae2878c-23a6-4e78-bd92-69fb03fc27b2 could not be found. Oct 23 01:18:08.546898 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:08.546898 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e8632c24-96e6-4a90-9944-e8006bed6ba5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] Returning 404 to user: Instance 4ae2878c-23a6-4e78-bd92-69fb03fc27b2 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:18:08.546898 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e8632c24-96e6-4a90-9944-e8006bed6ba5 tempest-MigrationsAdminTest-2041739261 tempest-MigrationsAdminTest-2041739261-project] 10.222.0.42 "GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2" status: 404 len: 111 microversion: 2.1 time: 0.075051 Oct 23 01:18:08.546898 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1055/2082] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:08 2022] GET /compute/v2.1/servers/4ae2878c-23a6-4e78-bd92-69fb03fc27b2 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:18:08.552109 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-e4d9648a-de2b-4b85-8c85-66ae6255066b req-1d8c63fc-ea9a-4542-87bc-475960da5725 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "808c58c6-1606-4553-8dd3-8292fa1202b5", "name": "network-vif-deleted", "tag": "a1d9a75e-ec02-4175-8ef7-8581a5c472dc"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:18:08.563440 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-e4d9648a-de2b-4b85-8c85-66ae6255066b req-1d8c63fc-ea9a-4542-87bc-475960da5725 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:08.563735 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-e4d9648a-de2b-4b85-8c85-66ae6255066b req-1d8c63fc-ea9a-4542-87bc-475960da5725 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:08.564167 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-e4d9648a-de2b-4b85-8c85-66ae6255066b req-1d8c63fc-ea9a-4542-87bc-475960da5725 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:08.576543 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-e4d9648a-de2b-4b85-8c85-66ae6255066b req-1d8c63fc-ea9a-4542-87bc-475960da5725 service nova] Creating event network-vif-deleted:a1d9a75e-ec02-4175-8ef7-8581a5c472dc for instance 808c58c6-1606-4553-8dd3-8292fa1202b5 on n-h1-master-1 Oct 23 01:18:08.588098 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-e4d9648a-de2b-4b85-8c85-66ae6255066b req-1d8c63fc-ea9a-4542-87bc-475960da5725 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040098 Oct 23 01:18:08.589252 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1056/2083] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:18:08.596687 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-dc809b7e-e614-4a3d-b5a3-ffab3ae2faa5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:08.598242 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-dc809b7e-e614-4a3d-b5a3-ffab3ae2faa5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:08.606367 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dc809b7e-e614-4a3d-b5a3-ffab3ae2faa5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:08.607463 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dc809b7e-e614-4a3d-b5a3-ffab3ae2faa5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:08.608097 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dc809b7e-e614-4a3d-b5a3-ffab3ae2faa5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:08.609089 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dc809b7e-e614-4a3d-b5a3-ffab3ae2faa5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:08.609867 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dc809b7e-e614-4a3d-b5a3-ffab3ae2faa5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:08.610500 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dc809b7e-e614-4a3d-b5a3-ffab3ae2faa5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:08.849761 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d39bd41e-2c33-47fe-ad50-6b0a3478acbb tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "POST /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf/action" status: 202 len: 0 microversion: 2.1 time: 0.497740 Oct 23 01:18:08.850731 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1028/2084] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:18:08 2022] POST /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf/action => generated 0 bytes in 500 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:18:08.880426 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7668295d-4b15-46b5-94ae-3d61ff900934 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:08.883464 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7668295d-4b15-46b5-94ae-3d61ff900934 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 40104c3d-0e82-449a-a331-c4f6ba80afaf] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:08.920086 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7668295d-4b15-46b5-94ae-3d61ff900934 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:08.922839 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7668295d-4b15-46b5-94ae-3d61ff900934 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:08.923367 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7668295d-4b15-46b5-94ae-3d61ff900934 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:08.928089 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7668295d-4b15-46b5-94ae-3d61ff900934 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:08.928694 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7668295d-4b15-46b5-94ae-3d61ff900934 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:08.929248 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7668295d-4b15-46b5-94ae-3d61ff900934 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:09.333615 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-dc809b7e-e614-4a3d-b5a3-ffab3ae2faa5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:09.350442 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-dc809b7e-e614-4a3d-b5a3-ffab3ae2faa5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1316 microversion: 2.1 time: 0.759368 Oct 23 01:18:09.351045 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1057/2085] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:08 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1316 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:09.380269 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a46dc2a4-796a-454c-b373-979d3ba4369a tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:09.380896 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a46dc2a4-796a-454c-b373-979d3ba4369a tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: f3aa4181-fc02-43dc-95df-ae1a730fbdca] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:09.392353 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a46dc2a4-796a-454c-b373-979d3ba4369a tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:09.392839 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a46dc2a4-796a-454c-b373-979d3ba4369a tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:09.393276 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a46dc2a4-796a-454c-b373-979d3ba4369a tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:09.399711 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a46dc2a4-796a-454c-b373-979d3ba4369a tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:09.400280 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a46dc2a4-796a-454c-b373-979d3ba4369a tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:09.400912 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a46dc2a4-796a-454c-b373-979d3ba4369a tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:09.484162 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a46dc2a4-796a-454c-b373-979d3ba4369a tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:09.489404 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a46dc2a4-796a-454c-b373-979d3ba4369a tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:09.490137 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a46dc2a4-796a-454c-b373-979d3ba4369a tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:09.496436 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-a46dc2a4-796a-454c-b373-979d3ba4369a tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lazy-loading 'fault' on Instance uuid f3aa4181-fc02-43dc-95df-ae1a730fbdca {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:18:09.598095 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a46dc2a4-796a-454c-b373-979d3ba4369a tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:09.607249 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a46dc2a4-796a-454c-b373-979d3ba4369a tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/f3aa4181-fc02-43dc-95df-ae1a730fbdca" status: 200 len: 1309 microversion: 2.1 time: 0.234098 Oct 23 01:18:09.622603 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1058/2086] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:09 2022] GET /compute/v2.1/servers/f3aa4181-fc02-43dc-95df-ae1a730fbdca => generated 1309 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:09.622603 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-680a7f15-be30-47bd-a9e9-dd55292d206b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:09.622603 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-680a7f15-be30-47bd-a9e9-dd55292d206b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:09.641645 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-680a7f15-be30-47bd-a9e9-dd55292d206b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:09.642313 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-680a7f15-be30-47bd-a9e9-dd55292d206b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:09.649241 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-680a7f15-be30-47bd-a9e9-dd55292d206b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:09.649241 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-680a7f15-be30-47bd-a9e9-dd55292d206b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:09.649241 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-680a7f15-be30-47bd-a9e9-dd55292d206b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:09.649241 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-680a7f15-be30-47bd-a9e9-dd55292d206b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:09.662209 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7668295d-4b15-46b5-94ae-3d61ff900934 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:09.671677 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7668295d-4b15-46b5-94ae-3d61ff900934 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf" status: 200 len: 1497 microversion: 2.1 time: 0.805436 Oct 23 01:18:09.684885 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1029/2087] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:08 2022] GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf => generated 1497 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:09.985533 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-680a7f15-be30-47bd-a9e9-dd55292d206b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:10.005768 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-680a7f15-be30-47bd-a9e9-dd55292d206b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1391 microversion: 2.1 time: 0.389232 Oct 23 01:18:10.005768 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1059/2088] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:09 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1391 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:10.376866 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fd27675a-06b8-4f83-aa3f-7fad61857cf2 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:10.379003 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fd27675a-06b8-4f83-aa3f-7fad61857cf2 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:10.398150 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=8 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:10.415755 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fd27675a-06b8-4f83-aa3f-7fad61857cf2 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:10.416636 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fd27675a-06b8-4f83-aa3f-7fad61857cf2 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:10.417302 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fd27675a-06b8-4f83-aa3f-7fad61857cf2 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:10.418324 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fd27675a-06b8-4f83-aa3f-7fad61857cf2 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:10.419329 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fd27675a-06b8-4f83-aa3f-7fad61857cf2 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:10.419997 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fd27675a-06b8-4f83-aa3f-7fad61857cf2 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:10.645348 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8d0ea294-f09e-47d5-af88-b8fff0f7d38b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:10.647284 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8d0ea294-f09e-47d5-af88-b8fff0f7d38b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: f3aa4181-fc02-43dc-95df-ae1a730fbdca] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:10.655848 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d0ea294-f09e-47d5-af88-b8fff0f7d38b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:10.657169 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d0ea294-f09e-47d5-af88-b8fff0f7d38b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:10.658006 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d0ea294-f09e-47d5-af88-b8fff0f7d38b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:10.660229 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d0ea294-f09e-47d5-af88-b8fff0f7d38b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:10.661066 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d0ea294-f09e-47d5-af88-b8fff0f7d38b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:10.661717 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d0ea294-f09e-47d5-af88-b8fff0f7d38b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:10.685657 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-8d0ea294-f09e-47d5-af88-b8fff0f7d38b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] HTTP exception thrown: Instance f3aa4181-fc02-43dc-95df-ae1a730fbdca could not be found. Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8d0ea294-f09e-47d5-af88-b8fff0f7d38b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Request method failure captured: Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/f3aa4181-fc02-43dc-95df-ae1a730fbdca HTTP/1.1 Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJVv0uHUZkawxRif88fKy9LhJENRPZsKhmf6zOBQWEzP00qmPQkqAca2jhb2lRXN9t0zC2JkLeeBldWCPH61ICeNt4v5sTKxLKhNmtzMUUime8-v0hyE48rstyJIK6CJypqB2ITpC6L9yRd-7i6fCZp0NigLnXS0XEU_z_Ej3fGN7bI Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 47aadec780734d03a262d4021f48d625 Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServersOnMultiNodesTest-1204013784 Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/47aadec780734d03a262d4021f48d625"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_47aadec780734d03a262d4021f48d625"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/47aadec780734d03a262d4021f48d625"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/47aadec780734d03a262d4021f48d625"}]}] Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServersOnMultiNodesTest-1204013784 Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 47aadec780734d03a262d4021f48d625 Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1204013784 Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServersOnMultiNodesTest-1204013784-project Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 519c893a1e094200b882cf23db7cae54 Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServersOnMultiNodesTest-1204013784-project Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: exception: Instance f3aa4181-fc02-43dc-95df-ae1a730fbdca could not be found. Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'f3aa4181-fc02-43dc-95df-ae1a730fbdca'} Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3aa4181-fc02-43dc-95df-ae1a730fbdca could not be found. Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3aa4181-fc02-43dc-95df-ae1a730fbdca could not be found. Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:10.695263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:10.706459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:10.706459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:18:10.706459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:18:10.706459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:18:10.706459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:18:10.706459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3aa4181-fc02-43dc-95df-ae1a730fbdca could not be found. Oct 23 01:18:10.706459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:10.706459 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8d0ea294-f09e-47d5-af88-b8fff0f7d38b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Returning 404 to user: Instance f3aa4181-fc02-43dc-95df-ae1a730fbdca could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:18:10.706459 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8d0ea294-f09e-47d5-af88-b8fff0f7d38b tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/f3aa4181-fc02-43dc-95df-ae1a730fbdca" status: 404 len: 111 microversion: 2.1 time: 0.066362 Oct 23 01:18:10.706459 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1060/2089] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:10 2022] GET /compute/v2.1/servers/f3aa4181-fc02-43dc-95df-ae1a730fbdca => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 01:18:10.741747 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c54ebb91-b15d-48e8-b76f-a3f6308bca1c tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:10.742507 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c54ebb91-b15d-48e8-b76f-a3f6308bca1c tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: 808c58c6-1606-4553-8dd3-8292fa1202b5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:10.753504 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c54ebb91-b15d-48e8-b76f-a3f6308bca1c tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:10.755326 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c54ebb91-b15d-48e8-b76f-a3f6308bca1c tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:10.755859 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c54ebb91-b15d-48e8-b76f-a3f6308bca1c tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:10.757285 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c54ebb91-b15d-48e8-b76f-a3f6308bca1c tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:10.757807 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c54ebb91-b15d-48e8-b76f-a3f6308bca1c tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:10.758452 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c54ebb91-b15d-48e8-b76f-a3f6308bca1c tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:10.796512 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-c54ebb91-b15d-48e8-b76f-a3f6308bca1c tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] HTTP exception thrown: Instance 808c58c6-1606-4553-8dd3-8292fa1202b5 could not be found. Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c54ebb91-b15d-48e8-b76f-a3f6308bca1c tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Request method failure captured: Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/808c58c6-1606-4553-8dd3-8292fa1202b5 HTTP/1.1 Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJVv0uHUZkawxRif88fKy9LhJENRPZsKhmf6zOBQWEzP00qmPQkqAca2jhb2lRXN9t0zC2JkLeeBldWCPH61ICeNt4v5sTKxLKhNmtzMUUime8-v0hyE48rstyJIK6CJypqB2ITpC6L9yRd-7i6fCZp0NigLnXS0XEU_z_Ej3fGN7bI Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 47aadec780734d03a262d4021f48d625 Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServersOnMultiNodesTest-1204013784 Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/47aadec780734d03a262d4021f48d625"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_47aadec780734d03a262d4021f48d625"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/47aadec780734d03a262d4021f48d625"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/47aadec780734d03a262d4021f48d625"}]}] Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServersOnMultiNodesTest-1204013784 Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 47aadec780734d03a262d4021f48d625 Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1204013784 Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServersOnMultiNodesTest-1204013784-project Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 519c893a1e094200b882cf23db7cae54 Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServersOnMultiNodesTest-1204013784-project Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 808c58c6-1606-4553-8dd3-8292fa1202b5 could not be found. Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '808c58c6-1606-4553-8dd3-8292fa1202b5'} Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 808c58c6-1606-4553-8dd3-8292fa1202b5 could not be found. Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 808c58c6-1606-4553-8dd3-8292fa1202b5 could not be found. Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:10.798459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:10.806212 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:10.806212 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:18:10.806212 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:18:10.806212 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:18:10.806212 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:18:10.806212 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 808c58c6-1606-4553-8dd3-8292fa1202b5 could not be found. Oct 23 01:18:10.806212 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:10.806212 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c54ebb91-b15d-48e8-b76f-a3f6308bca1c tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Returning 404 to user: Instance 808c58c6-1606-4553-8dd3-8292fa1202b5 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:18:10.806212 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c54ebb91-b15d-48e8-b76f-a3f6308bca1c tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/808c58c6-1606-4553-8dd3-8292fa1202b5" status: 404 len: 111 microversion: 2.1 time: 0.079729 Oct 23 01:18:10.806212 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1061/2090] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:10 2022] GET /compute/v2.1/servers/808c58c6-1606-4553-8dd3-8292fa1202b5 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:18:10.811717 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-762f50f8-e2b9-4672-bef5-aca48bd805a6 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:10.811917 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-762f50f8-e2b9-4672-bef5-aca48bd805a6 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 40104c3d-0e82-449a-a331-c4f6ba80afaf] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:10.829299 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-762f50f8-e2b9-4672-bef5-aca48bd805a6 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:10.834386 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-762f50f8-e2b9-4672-bef5-aca48bd805a6 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:10.834386 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-762f50f8-e2b9-4672-bef5-aca48bd805a6 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:10.834386 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-762f50f8-e2b9-4672-bef5-aca48bd805a6 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:10.834386 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-762f50f8-e2b9-4672-bef5-aca48bd805a6 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:10.834386 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-762f50f8-e2b9-4672-bef5-aca48bd805a6 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:10.925510 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fd27675a-06b8-4f83-aa3f-7fad61857cf2 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:10.942049 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fd27675a-06b8-4f83-aa3f-7fad61857cf2 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1316 microversion: 2.1 time: 0.564257 Oct 23 01:18:10.942974 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1030/2091] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:10 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1316 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:10.970844 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-07a6e8c9-d6e2-4f1d-b603-003a3277db6c tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:11.188701 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-07a6e8c9-d6e2-4f1d-b603-003a3277db6c tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "DELETE /compute/v2.1/os-server-groups/8a917657-28a7-4dca-bda1-2dfd9f81a9de" status: 204 len: 0 microversion: 2.1 time: 0.243815 Oct 23 01:18:11.194069 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1031/2092] 10.222.0.42 () {58 vars in 1266 bytes} [Sun Oct 23 01:18:10 2022] DELETE /compute/v2.1/os-server-groups/8a917657-28a7-4dca-bda1-2dfd9f81a9de => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:18:11.202409 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-f52588fc-286c-40f1-83d4-83dda751e117 req-d6de17fb-7e1e-4853-803a-f0b381d39356 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62a8ad26-f65b-432d-a8da-48264c426335", "tag": "56917629-dd5e-4c91-a45e-1e8e6cd25138"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:18:11.230398 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-f52588fc-286c-40f1-83d4-83dda751e117 req-d6de17fb-7e1e-4853-803a-f0b381d39356 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:11.234624 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-f52588fc-286c-40f1-83d4-83dda751e117 req-d6de17fb-7e1e-4853-803a-f0b381d39356 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:11.236316 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-f52588fc-286c-40f1-83d4-83dda751e117 req-d6de17fb-7e1e-4853-803a-f0b381d39356 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:11.255568 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-f52588fc-286c-40f1-83d4-83dda751e117 req-d6de17fb-7e1e-4853-803a-f0b381d39356 service nova] Creating event network-changed:56917629-dd5e-4c91-a45e-1e8e6cd25138 for instance 62a8ad26-f65b-432d-a8da-48264c426335 on n-h2-master-1 Oct 23 01:18:11.270394 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-f52588fc-286c-40f1-83d4-83dda751e117 req-d6de17fb-7e1e-4853-803a-f0b381d39356 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072460 Oct 23 01:18:11.271789 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1032/2093] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:18:11.278446 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ba2f4690-e27d-45ca-a805-1751fe78bec2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:11.279823 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ba2f4690-e27d-45ca-a805-1751fe78bec2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:11.293830 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba2f4690-e27d-45ca-a805-1751fe78bec2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:11.304638 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba2f4690-e27d-45ca-a805-1751fe78bec2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:11.304638 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba2f4690-e27d-45ca-a805-1751fe78bec2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:11.304638 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba2f4690-e27d-45ca-a805-1751fe78bec2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:11.304638 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba2f4690-e27d-45ca-a805-1751fe78bec2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:11.304638 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba2f4690-e27d-45ca-a805-1751fe78bec2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:11.668630 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ba2f4690-e27d-45ca-a805-1751fe78bec2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:11.681854 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ba2f4690-e27d-45ca-a805-1751fe78bec2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1391 microversion: 2.1 time: 0.408307 Oct 23 01:18:11.683154 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1033/2094] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:11 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1391 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:11.698304 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b52e317f-a89f-4d72-b4c4-952c33a706be tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:11.701542 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b52e317f-a89f-4d72-b4c4-952c33a706be tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: cffc5366-8131-4a2b-bf51-39e4d23929e3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:11.716861 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b52e317f-a89f-4d72-b4c4-952c33a706be tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:11.719889 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b52e317f-a89f-4d72-b4c4-952c33a706be tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:11.722621 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b52e317f-a89f-4d72-b4c4-952c33a706be tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:11.724194 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b52e317f-a89f-4d72-b4c4-952c33a706be tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:11.727257 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b52e317f-a89f-4d72-b4c4-952c33a706be tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:11.729710 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b52e317f-a89f-4d72-b4c4-952c33a706be tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:11.799475 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b52e317f-a89f-4d72-b4c4-952c33a706be tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: cffc5366-8131-4a2b-bf51-39e4d23929e3] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:18:11.884107 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-762f50f8-e2b9-4672-bef5-aca48bd805a6 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:11.904335 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-762f50f8-e2b9-4672-bef5-aca48bd805a6 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf" status: 200 len: 1497 microversion: 2.1 time: 1.098380 Oct 23 01:18:11.909028 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1062/2095] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:10 2022] GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf => generated 1497 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:11.969923 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ab78f858-a444-4bdd-9c2d-1b4d60b88ac9 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:11.971219 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ab78f858-a444-4bdd-9c2d-1b4d60b88ac9 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:11.990167 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ab78f858-a444-4bdd-9c2d-1b4d60b88ac9 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:11.991597 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ab78f858-a444-4bdd-9c2d-1b4d60b88ac9 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:11.993598 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ab78f858-a444-4bdd-9c2d-1b4d60b88ac9 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:11.994526 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ab78f858-a444-4bdd-9c2d-1b4d60b88ac9 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:11.996390 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ab78f858-a444-4bdd-9c2d-1b4d60b88ac9 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:11.998333 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ab78f858-a444-4bdd-9c2d-1b4d60b88ac9 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:12.021745 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:12.231337 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b52e317f-a89f-4d72-b4c4-952c33a706be tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "DELETE /compute/v2.1/servers/cffc5366-8131-4a2b-bf51-39e4d23929e3" status: 204 len: 0 microversion: 2.1 time: 0.543752 Oct 23 01:18:12.232270 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1034/2096] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:18:11 2022] DELETE /compute/v2.1/servers/cffc5366-8131-4a2b-bf51-39e4d23929e3 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:18:12.242570 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c7778a10-efb7-4996-a82f-86f3d11c0d70 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:12.258775 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c7778a10-efb7-4996-a82f-86f3d11c0d70 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: cffc5366-8131-4a2b-bf51-39e4d23929e3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:12.270418 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c7778a10-efb7-4996-a82f-86f3d11c0d70 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:12.270418 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c7778a10-efb7-4996-a82f-86f3d11c0d70 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:12.270418 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c7778a10-efb7-4996-a82f-86f3d11c0d70 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:12.286240 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c7778a10-efb7-4996-a82f-86f3d11c0d70 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:12.288175 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c7778a10-efb7-4996-a82f-86f3d11c0d70 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:12.290520 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c7778a10-efb7-4996-a82f-86f3d11c0d70 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:12.578461 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ab78f858-a444-4bdd-9c2d-1b4d60b88ac9 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:12.587913 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ab78f858-a444-4bdd-9c2d-1b4d60b88ac9 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1316 microversion: 2.1 time: 0.623983 Oct 23 01:18:12.588494 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1063/2097] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:11 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1316 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:18:12.709234 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-06674276-9e53-4b5d-9cdf-19aedc7e8de4 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:12.710261 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-06674276-9e53-4b5d-9cdf-19aedc7e8de4 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:12.723464 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-06674276-9e53-4b5d-9cdf-19aedc7e8de4 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:12.724318 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-06674276-9e53-4b5d-9cdf-19aedc7e8de4 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:12.724948 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-06674276-9e53-4b5d-9cdf-19aedc7e8de4 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:12.726854 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-06674276-9e53-4b5d-9cdf-19aedc7e8de4 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:12.728991 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-06674276-9e53-4b5d-9cdf-19aedc7e8de4 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:12.729607 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-06674276-9e53-4b5d-9cdf-19aedc7e8de4 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:12.975363 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c7778a10-efb7-4996-a82f-86f3d11c0d70 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:12.986360 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c7778a10-efb7-4996-a82f-86f3d11c0d70 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/cffc5366-8131-4a2b-bf51-39e4d23929e3" status: 200 len: 1472 microversion: 2.1 time: 0.749103 Oct 23 01:18:12.987631 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1035/2098] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:12 2022] GET /compute/v2.1/servers/cffc5366-8131-4a2b-bf51-39e4d23929e3 => generated 1472 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:13.015086 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a6d8feff-5ec3-46a0-a8c4-fd02039b43a2 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:13.016187 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a6d8feff-5ec3-46a0-a8c4-fd02039b43a2 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 40104c3d-0e82-449a-a331-c4f6ba80afaf] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:13.031269 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6d8feff-5ec3-46a0-a8c4-fd02039b43a2 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:13.034075 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6d8feff-5ec3-46a0-a8c4-fd02039b43a2 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:13.037046 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6d8feff-5ec3-46a0-a8c4-fd02039b43a2 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:13.039700 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6d8feff-5ec3-46a0-a8c4-fd02039b43a2 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:13.040481 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6d8feff-5ec3-46a0-a8c4-fd02039b43a2 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:13.040699 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6d8feff-5ec3-46a0-a8c4-fd02039b43a2 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:13.412625 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-06674276-9e53-4b5d-9cdf-19aedc7e8de4 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:13.429838 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-06674276-9e53-4b5d-9cdf-19aedc7e8de4 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1391 microversion: 2.1 time: 0.725529 Oct 23 01:18:13.446722 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1064/2099] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:12 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1391 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:18:13.536832 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a6d8feff-5ec3-46a0-a8c4-fd02039b43a2 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:13.551025 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a6d8feff-5ec3-46a0-a8c4-fd02039b43a2 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf" status: 200 len: 1497 microversion: 2.1 time: 0.561737 Oct 23 01:18:13.552350 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1036/2100] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:12 2022] GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf => generated 1497 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:13.617920 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9e166ddd-4b9b-4a2a-9ba7-9d046000d510 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:13.618791 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9e166ddd-4b9b-4a2a-9ba7-9d046000d510 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:13.629886 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e166ddd-4b9b-4a2a-9ba7-9d046000d510 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:13.648407 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e166ddd-4b9b-4a2a-9ba7-9d046000d510 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:13.649170 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e166ddd-4b9b-4a2a-9ba7-9d046000d510 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:13.650165 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e166ddd-4b9b-4a2a-9ba7-9d046000d510 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:13.658727 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e166ddd-4b9b-4a2a-9ba7-9d046000d510 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:13.659712 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e166ddd-4b9b-4a2a-9ba7-9d046000d510 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:13.918975 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9e166ddd-4b9b-4a2a-9ba7-9d046000d510 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:13.927815 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9e166ddd-4b9b-4a2a-9ba7-9d046000d510 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1316 microversion: 2.1 time: 0.314276 Oct 23 01:18:13.936213 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1065/2101] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:13 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1316 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:14.011088 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-006b3e1b-e14c-4c47-a52b-53237c8056cb tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:14.012505 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-006b3e1b-e14c-4c47-a52b-53237c8056cb tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: cffc5366-8131-4a2b-bf51-39e4d23929e3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:14.024956 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-006b3e1b-e14c-4c47-a52b-53237c8056cb tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:14.026727 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-006b3e1b-e14c-4c47-a52b-53237c8056cb tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:14.032554 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-006b3e1b-e14c-4c47-a52b-53237c8056cb tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:14.037373 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-006b3e1b-e14c-4c47-a52b-53237c8056cb tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:14.038090 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-006b3e1b-e14c-4c47-a52b-53237c8056cb tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:14.038756 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-006b3e1b-e14c-4c47-a52b-53237c8056cb tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:14.406470 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-006b3e1b-e14c-4c47-a52b-53237c8056cb tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:14.419333 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-006b3e1b-e14c-4c47-a52b-53237c8056cb tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/cffc5366-8131-4a2b-bf51-39e4d23929e3" status: 200 len: 1472 microversion: 2.1 time: 0.411966 Oct 23 01:18:14.420641 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1037/2102] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:14 2022] GET /compute/v2.1/servers/cffc5366-8131-4a2b-bf51-39e4d23929e3 => generated 1472 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:14.453700 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-86bdbb57-6d85-46a4-9c6b-0633ccb2526f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:14.454339 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-86bdbb57-6d85-46a4-9c6b-0633ccb2526f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:14.479330 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-86bdbb57-6d85-46a4-9c6b-0633ccb2526f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:14.479911 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-86bdbb57-6d85-46a4-9c6b-0633ccb2526f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:14.480356 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-86bdbb57-6d85-46a4-9c6b-0633ccb2526f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:14.486920 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-86bdbb57-6d85-46a4-9c6b-0633ccb2526f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:14.487904 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-86bdbb57-6d85-46a4-9c6b-0633ccb2526f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:14.488552 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-86bdbb57-6d85-46a4-9c6b-0633ccb2526f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:14.576562 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-94440b0c-c487-4bb0-a070-98859aeb4fdb tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:14.585191 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-94440b0c-c487-4bb0-a070-98859aeb4fdb tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 40104c3d-0e82-449a-a331-c4f6ba80afaf] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:14.592496 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-94440b0c-c487-4bb0-a070-98859aeb4fdb tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:14.593198 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-94440b0c-c487-4bb0-a070-98859aeb4fdb tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:14.593642 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-94440b0c-c487-4bb0-a070-98859aeb4fdb tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:14.596630 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-94440b0c-c487-4bb0-a070-98859aeb4fdb tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:14.600951 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-94440b0c-c487-4bb0-a070-98859aeb4fdb tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:14.601607 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-94440b0c-c487-4bb0-a070-98859aeb4fdb tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:14.875784 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-86bdbb57-6d85-46a4-9c6b-0633ccb2526f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:14.899600 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-86bdbb57-6d85-46a4-9c6b-0633ccb2526f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1391 microversion: 2.1 time: 0.443312 Oct 23 01:18:14.902776 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1066/2103] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:14 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1391 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:14.957202 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cead7173-1e3a-4c8e-9781-87c43d020cb3 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:14.959070 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cead7173-1e3a-4c8e-9781-87c43d020cb3 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:14.968398 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cead7173-1e3a-4c8e-9781-87c43d020cb3 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:14.974950 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-94440b0c-c487-4bb0-a070-98859aeb4fdb tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:14.978706 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cead7173-1e3a-4c8e-9781-87c43d020cb3 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:14.980758 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cead7173-1e3a-4c8e-9781-87c43d020cb3 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:14.982398 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cead7173-1e3a-4c8e-9781-87c43d020cb3 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:14.985815 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cead7173-1e3a-4c8e-9781-87c43d020cb3 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:14.987942 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cead7173-1e3a-4c8e-9781-87c43d020cb3 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:14.997840 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-94440b0c-c487-4bb0-a070-98859aeb4fdb tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf" status: 200 len: 1497 microversion: 2.1 time: 0.415088 Oct 23 01:18:15.011186 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1038/2104] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:14 2022] GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf => generated 1497 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:15.206928 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cead7173-1e3a-4c8e-9781-87c43d020cb3 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:15.224299 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cead7173-1e3a-4c8e-9781-87c43d020cb3 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1316 microversion: 2.1 time: 0.277150 Oct 23 01:18:15.226716 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1067/2105] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:14 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1316 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:15.447233 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b610c5e1-a9e8-49d0-ab72-6ea242c18c68 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:15.448222 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b610c5e1-a9e8-49d0-ab72-6ea242c18c68 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: cffc5366-8131-4a2b-bf51-39e4d23929e3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:15.487658 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b610c5e1-a9e8-49d0-ab72-6ea242c18c68 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:15.488693 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b610c5e1-a9e8-49d0-ab72-6ea242c18c68 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:15.495950 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b610c5e1-a9e8-49d0-ab72-6ea242c18c68 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:15.503686 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b610c5e1-a9e8-49d0-ab72-6ea242c18c68 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:15.503686 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b610c5e1-a9e8-49d0-ab72-6ea242c18c68 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:15.503686 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b610c5e1-a9e8-49d0-ab72-6ea242c18c68 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:15.693577 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b610c5e1-a9e8-49d0-ab72-6ea242c18c68 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:15.703596 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b610c5e1-a9e8-49d0-ab72-6ea242c18c68 tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/cffc5366-8131-4a2b-bf51-39e4d23929e3" status: 200 len: 1472 microversion: 2.1 time: 0.260756 Oct 23 01:18:15.706121 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1039/2106] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:15 2022] GET /compute/v2.1/servers/cffc5366-8131-4a2b-bf51-39e4d23929e3 => generated 1472 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:15.929521 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-691a012d-4898-4a11-8404-ac3a61bbda7a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:15.930742 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-691a012d-4898-4a11-8404-ac3a61bbda7a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:15.943615 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-691a012d-4898-4a11-8404-ac3a61bbda7a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:15.944114 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-691a012d-4898-4a11-8404-ac3a61bbda7a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:15.944883 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-691a012d-4898-4a11-8404-ac3a61bbda7a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:15.945336 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-691a012d-4898-4a11-8404-ac3a61bbda7a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:15.946373 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-691a012d-4898-4a11-8404-ac3a61bbda7a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:15.947307 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-691a012d-4898-4a11-8404-ac3a61bbda7a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:16.030442 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4e13be2f-cc4e-44ba-9a0c-ff3a8316cf5e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:16.031319 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4e13be2f-cc4e-44ba-9a0c-ff3a8316cf5e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 40104c3d-0e82-449a-a331-c4f6ba80afaf] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:16.041662 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4e13be2f-cc4e-44ba-9a0c-ff3a8316cf5e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:16.044923 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4e13be2f-cc4e-44ba-9a0c-ff3a8316cf5e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:16.045507 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4e13be2f-cc4e-44ba-9a0c-ff3a8316cf5e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:16.047008 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4e13be2f-cc4e-44ba-9a0c-ff3a8316cf5e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:16.047596 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4e13be2f-cc4e-44ba-9a0c-ff3a8316cf5e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:16.048902 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4e13be2f-cc4e-44ba-9a0c-ff3a8316cf5e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:16.307534 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-691a012d-4898-4a11-8404-ac3a61bbda7a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:16.319248 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-691a012d-4898-4a11-8404-ac3a61bbda7a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1391 microversion: 2.1 time: 0.395714 Oct 23 01:18:16.320161 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1068/2107] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:15 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1391 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:16.325221 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-aac81ba6-9a42-4ce0-8cfd-19d3a7b71986 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:16.330705 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-aac81ba6-9a42-4ce0-8cfd-19d3a7b71986 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:16.339655 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=3,nova_api:UPDATE=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:16.340432 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4e13be2f-cc4e-44ba-9a0c-ff3a8316cf5e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:16.342347 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aac81ba6-9a42-4ce0-8cfd-19d3a7b71986 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:16.343053 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aac81ba6-9a42-4ce0-8cfd-19d3a7b71986 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:16.343659 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aac81ba6-9a42-4ce0-8cfd-19d3a7b71986 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:16.344576 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aac81ba6-9a42-4ce0-8cfd-19d3a7b71986 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:16.345198 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aac81ba6-9a42-4ce0-8cfd-19d3a7b71986 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:16.345789 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aac81ba6-9a42-4ce0-8cfd-19d3a7b71986 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:16.360655 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4e13be2f-cc4e-44ba-9a0c-ff3a8316cf5e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf" status: 200 len: 1497 microversion: 2.1 time: 0.335442 Oct 23 01:18:16.372433 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1040/2108] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:16 2022] GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf => generated 1497 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:16.551742 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-aac81ba6-9a42-4ce0-8cfd-19d3a7b71986 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:16.568086 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-aac81ba6-9a42-4ce0-8cfd-19d3a7b71986 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1316 microversion: 2.1 time: 0.246647 Oct 23 01:18:16.572511 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1069/2109] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:16 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1316 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:16.727581 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-07c216e7-2d8e-44ae-8a46-99c20b94350e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:16.728525 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-07c216e7-2d8e-44ae-8a46-99c20b94350e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: cffc5366-8131-4a2b-bf51-39e4d23929e3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:16.735731 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07c216e7-2d8e-44ae-8a46-99c20b94350e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:16.736486 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07c216e7-2d8e-44ae-8a46-99c20b94350e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:16.737668 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07c216e7-2d8e-44ae-8a46-99c20b94350e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:16.738810 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07c216e7-2d8e-44ae-8a46-99c20b94350e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:16.739452 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07c216e7-2d8e-44ae-8a46-99c20b94350e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:16.740045 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07c216e7-2d8e-44ae-8a46-99c20b94350e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:16.972012 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-07c216e7-2d8e-44ae-8a46-99c20b94350e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:16.980983 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-07c216e7-2d8e-44ae-8a46-99c20b94350e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/cffc5366-8131-4a2b-bf51-39e4d23929e3" status: 200 len: 1472 microversion: 2.1 time: 0.257624 Oct 23 01:18:16.981572 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1041/2110] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:16 2022] GET /compute/v2.1/servers/cffc5366-8131-4a2b-bf51-39e4d23929e3 => generated 1472 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:17.331714 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-5987e5b8-eb37-4a32-b88e-f26a18277555 req-5f58c7f4-d5e8-4518-817c-d0263288950d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cffc5366-8131-4a2b-bf51-39e4d23929e3", "name": "network-vif-deleted", "tag": "9c227e6f-548f-41bb-9cb3-74d96aabdc2a"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:18:17.347287 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-5987e5b8-eb37-4a32-b88e-f26a18277555 req-5f58c7f4-d5e8-4518-817c-d0263288950d service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:17.350762 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-5987e5b8-eb37-4a32-b88e-f26a18277555 req-5f58c7f4-d5e8-4518-817c-d0263288950d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:17.350762 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-5987e5b8-eb37-4a32-b88e-f26a18277555 req-5f58c7f4-d5e8-4518-817c-d0263288950d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:17.363987 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-5987e5b8-eb37-4a32-b88e-f26a18277555 req-5f58c7f4-d5e8-4518-817c-d0263288950d service nova] Creating event network-vif-deleted:9c227e6f-548f-41bb-9cb3-74d96aabdc2a for instance cffc5366-8131-4a2b-bf51-39e4d23929e3 on n-h2-master-1 Oct 23 01:18:17.373633 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-5987e5b8-eb37-4a32-b88e-f26a18277555 req-5f58c7f4-d5e8-4518-817c-d0263288950d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047300 Oct 23 01:18:17.374292 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1042/2111] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:18:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:18:17.381124 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6a385913-dfae-4fd0-a6fa-b2a30a9b5b5b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:17.382189 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6a385913-dfae-4fd0-a6fa-b2a30a9b5b5b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:17.389224 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6a385913-dfae-4fd0-a6fa-b2a30a9b5b5b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:17.390068 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6a385913-dfae-4fd0-a6fa-b2a30a9b5b5b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:17.390677 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6a385913-dfae-4fd0-a6fa-b2a30a9b5b5b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:17.391782 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6a385913-dfae-4fd0-a6fa-b2a30a9b5b5b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:17.392412 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6a385913-dfae-4fd0-a6fa-b2a30a9b5b5b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:17.393054 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6a385913-dfae-4fd0-a6fa-b2a30a9b5b5b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:17.584870 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-857e6682-703f-4bd2-b6f0-9065c0326471 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Action: 'update', calling method: .version_select at 0x7f5cc6254820>, body: {"quota_set": {"ram": "5120"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:18:17.709163 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-857e6682-703f-4bd2-b6f0-9065c0326471 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:17.710205 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-857e6682-703f-4bd2-b6f0-9065c0326471 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:17.710807 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-857e6682-703f-4bd2-b6f0-9065c0326471 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:17.713089 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-857e6682-703f-4bd2-b6f0-9065c0326471 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:17.714498 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-857e6682-703f-4bd2-b6f0-9065c0326471 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:17.715112 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-857e6682-703f-4bd2-b6f0-9065c0326471 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:17.723161 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6a385913-dfae-4fd0-a6fa-b2a30a9b5b5b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:17.754939 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6a385913-dfae-4fd0-a6fa-b2a30a9b5b5b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1391 microversion: 2.1 time: 0.378221 Oct 23 01:18:17.757114 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1043/2112] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:17 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1391 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:17.784581 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-824170a0-e6f1-4ab1-ba88-a872a79d7b74 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:17.791312 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-824170a0-e6f1-4ab1-ba88-a872a79d7b74 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 40104c3d-0e82-449a-a331-c4f6ba80afaf] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:17.807926 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-824170a0-e6f1-4ab1-ba88-a872a79d7b74 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:17.808566 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-824170a0-e6f1-4ab1-ba88-a872a79d7b74 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:17.809119 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-824170a0-e6f1-4ab1-ba88-a872a79d7b74 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:17.811581 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-824170a0-e6f1-4ab1-ba88-a872a79d7b74 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:17.812208 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-824170a0-e6f1-4ab1-ba88-a872a79d7b74 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:17.812755 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-824170a0-e6f1-4ab1-ba88-a872a79d7b74 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:17.898482 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-857e6682-703f-4bd2-b6f0-9065c0326471 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-sets/436a4880444e4effa3309044579198df" status: 200 len: 240 microversion: 2.36 time: 0.627844 Oct 23 01:18:17.906359 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1070/2113] 10.222.0.42 () {62 vars in 1303 bytes} [Sun Oct 23 01:18:17 2022] PUT /compute/v2.1/os-quota-sets/436a4880444e4effa3309044579198df => generated 240 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:18:17.920226 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f1959209-2c53-4057-93ba-33b7eee72ee7 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:17.922472 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f1959209-2c53-4057-93ba-33b7eee72ee7 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:17.953788 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f1959209-2c53-4057-93ba-33b7eee72ee7 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:17.955390 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f1959209-2c53-4057-93ba-33b7eee72ee7 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:17.956461 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f1959209-2c53-4057-93ba-33b7eee72ee7 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:17.957199 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f1959209-2c53-4057-93ba-33b7eee72ee7 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:17.957673 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f1959209-2c53-4057-93ba-33b7eee72ee7 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:17.962306 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f1959209-2c53-4057-93ba-33b7eee72ee7 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:18.048916 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-824170a0-e6f1-4ab1-ba88-a872a79d7b74 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:18.062160 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-824170a0-e6f1-4ab1-ba88-a872a79d7b74 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf" status: 200 len: 1497 microversion: 2.1 time: 0.302573 Oct 23 01:18:18.069076 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1044/2114] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:17 2022] GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf => generated 1497 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:18.082314 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-75617c9e-93ee-4fd0-b64e-79980ae6cb55 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Calling method '.version_select at 0x7f5cc25b0160>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:18.248856 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-75617c9e-93ee-4fd0-b64e-79980ae6cb55 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:18.249640 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-75617c9e-93ee-4fd0-b64e-79980ae6cb55 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:18.250393 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-75617c9e-93ee-4fd0-b64e-79980ae6cb55 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:18.251785 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-75617c9e-93ee-4fd0-b64e-79980ae6cb55 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:18.253019 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-75617c9e-93ee-4fd0-b64e-79980ae6cb55 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:18.253691 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-75617c9e-93ee-4fd0-b64e-79980ae6cb55 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:18.273347 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f1959209-2c53-4057-93ba-33b7eee72ee7 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:18.285509 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f1959209-2c53-4057-93ba-33b7eee72ee7 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1316 microversion: 2.1 time: 0.377871 Oct 23 01:18:18.306438 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1071/2115] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:17 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1316 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:18.316558 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-75617c9e-93ee-4fd0-b64e-79980ae6cb55 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/436a4880444e4effa3309044579198df/detail" status: 200 len: 672 microversion: 2.36 time: 0.246025 Oct 23 01:18:18.317777 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1045/2116] 10.222.0.42 () {60 vars in 1304 bytes} [Sun Oct 23 01:18:18 2022] GET /compute/v2.1/os-quota-sets/436a4880444e4effa3309044579198df/detail => generated 672 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:18:18.319715 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-868f08be-01bf-4f3f-9929-cddcce0684cf tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:18.321571 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-868f08be-01bf-4f3f-9929-cddcce0684cf tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: cffc5366-8131-4a2b-bf51-39e4d23929e3] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:18.327986 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-868f08be-01bf-4f3f-9929-cddcce0684cf tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:18.328475 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-868f08be-01bf-4f3f-9929-cddcce0684cf tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:18.328912 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-868f08be-01bf-4f3f-9929-cddcce0684cf tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:18.329608 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-868f08be-01bf-4f3f-9929-cddcce0684cf tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:18.331089 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-868f08be-01bf-4f3f-9929-cddcce0684cf tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:18.335477 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-868f08be-01bf-4f3f-9929-cddcce0684cf tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:18.338133 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=100 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:18.374887 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-868f08be-01bf-4f3f-9929-cddcce0684cf tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:18.375387 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-868f08be-01bf-4f3f-9929-cddcce0684cf tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:18.376239 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-868f08be-01bf-4f3f-9929-cddcce0684cf tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:18.376538 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-868f08be-01bf-4f3f-9929-cddcce0684cf tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lazy-loading 'fault' on Instance uuid cffc5366-8131-4a2b-bf51-39e4d23929e3 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:18:18.438318 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-868f08be-01bf-4f3f-9929-cddcce0684cf tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519c893a1e094200b882cf23db7cae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47aadec780734d03a262d4021f48d625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:18.461737 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-868f08be-01bf-4f3f-9929-cddcce0684cf tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/cffc5366-8131-4a2b-bf51-39e4d23929e3" status: 200 len: 1306 microversion: 2.1 time: 0.154135 Oct 23 01:18:18.471750 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1072/2117] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:18 2022] GET /compute/v2.1/servers/cffc5366-8131-4a2b-bf51-39e4d23929e3 => generated 1306 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:18.725648 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9c7fd5db-6993-4f50-876d-8cc947072758 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Action: 'update', calling method: .version_select at 0x7f5cc6286c10>, body: {"quota_set": {"ram": "2048"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:18:18.797589 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7dd419dd-deed-4fe7-8a1d-86f39bee6323 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-250848605", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "37cf4372-0b8e-493b-a1d7-4174c029ddaa"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:18:18.826104 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9c7fd5db-6993-4f50-876d-8cc947072758 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:18.826595 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9c7fd5db-6993-4f50-876d-8cc947072758 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:18.827034 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9c7fd5db-6993-4f50-876d-8cc947072758 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:18.827759 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9c7fd5db-6993-4f50-876d-8cc947072758 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:18.834405 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9c7fd5db-6993-4f50-876d-8cc947072758 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:18.834896 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9c7fd5db-6993-4f50-876d-8cc947072758 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:18.885672 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9c7fd5db-6993-4f50-876d-8cc947072758 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:18.886594 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9c7fd5db-6993-4f50-876d-8cc947072758 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:18.887233 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9c7fd5db-6993-4f50-876d-8cc947072758 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:18.888271 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9c7fd5db-6993-4f50-876d-8cc947072758 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:18.889127 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9c7fd5db-6993-4f50-876d-8cc947072758 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:18.890701 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9c7fd5db-6993-4f50-876d-8cc947072758 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:18.957856 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-7dd419dd-deed-4fe7-8a1d-86f39bee6323 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] validate_networks() for [('37cf4372-0b8e-493b-a1d7-4174c029ddaa', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:18:19.076215 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9c7fd5db-6993-4f50-876d-8cc947072758 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-sets/436a4880444e4effa3309044579198df?user_id=2b9869f8149c46f6ac3c707f18fe0c4a" status: 200 len: 240 microversion: 2.36 time: 0.355108 Oct 23 01:18:19.087972 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1073/2118] 10.222.0.42 () {62 vars in 1384 bytes} [Sun Oct 23 01:18:18 2022] PUT /compute/v2.1/os-quota-sets/436a4880444e4effa3309044579198df?user_id=2b9869f8149c46f6ac3c707f18fe0c4a => generated 240 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 23 01:18:19.101878 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-aa9e2348-e3eb-43b2-a090-aace0da7c670 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:19.102673 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-aa9e2348-e3eb-43b2-a090-aace0da7c670 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:19.120583 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa9e2348-e3eb-43b2-a090-aace0da7c670 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:19.122196 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa9e2348-e3eb-43b2-a090-aace0da7c670 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:19.122652 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa9e2348-e3eb-43b2-a090-aace0da7c670 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:19.123382 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa9e2348-e3eb-43b2-a090-aace0da7c670 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:19.131335 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa9e2348-e3eb-43b2-a090-aace0da7c670 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:19.131865 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa9e2348-e3eb-43b2-a090-aace0da7c670 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:19.528433 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-aa9e2348-e3eb-43b2-a090-aace0da7c670 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:19.538072 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-aa9e2348-e3eb-43b2-a090-aace0da7c670 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1391 microversion: 2.1 time: 0.448523 Oct 23 01:18:19.538935 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1074/2119] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:19 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1391 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:19.557626 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1a4d921b-e98c-45b4-98db-34bf2125c6ed tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Calling method '.version_select at 0x7f5cc272f790>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:19.674754 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1a4d921b-e98c-45b4-98db-34bf2125c6ed tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/436a4880444e4effa3309044579198df?user_id=2b9869f8149c46f6ac3c707f18fe0c4a" status: 200 len: 282 microversion: 2.36 time: 0.134239 Oct 23 01:18:19.682977 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1075/2120] 10.222.0.42 () {60 vars in 1364 bytes} [Sun Oct 23 01:18:19 2022] GET /compute/v2.1/os-quota-sets/436a4880444e4effa3309044579198df?user_id=2b9869f8149c46f6ac3c707f18fe0c4a => generated 282 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:18:19.688868 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-56a440aa-ecd1-4f05-9387-835274df6289 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:19.689680 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-56a440aa-ecd1-4f05-9387-835274df6289 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 40104c3d-0e82-449a-a331-c4f6ba80afaf] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:19.698119 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-56a440aa-ecd1-4f05-9387-835274df6289 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:19.699022 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-56a440aa-ecd1-4f05-9387-835274df6289 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:19.699718 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-56a440aa-ecd1-4f05-9387-835274df6289 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:19.700764 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-56a440aa-ecd1-4f05-9387-835274df6289 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:19.701467 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-56a440aa-ecd1-4f05-9387-835274df6289 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:19.702310 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-56a440aa-ecd1-4f05-9387-835274df6289 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:19.750788 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-7dd419dd-deed-4fe7-8a1d-86f39bee6323 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:18:19.751275 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-7dd419dd-deed-4fe7-8a1d-86f39bee6323 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:18:19.753853 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-7dd419dd-deed-4fe7-8a1d-86f39bee6323 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:18:19.754626 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-7dd419dd-deed-4fe7-8a1d-86f39bee6323 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:18:19.759235 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-7dd419dd-deed-4fe7-8a1d-86f39bee6323 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:18:19.780641 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7dd419dd-deed-4fe7-8a1d-86f39bee6323 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:19.781273 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7dd419dd-deed-4fe7-8a1d-86f39bee6323 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:19.782507 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7dd419dd-deed-4fe7-8a1d-86f39bee6323 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:19.784560 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7dd419dd-deed-4fe7-8a1d-86f39bee6323 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:19.788809 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7dd419dd-deed-4fe7-8a1d-86f39bee6323 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:19.789600 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7dd419dd-deed-4fe7-8a1d-86f39bee6323 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:19.847530 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-7dd419dd-deed-4fe7-8a1d-86f39bee6323 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Getting quotas for project a0556c0544d446a2aa3d54e00b16bab1. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:18:19.855757 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-7dd419dd-deed-4fe7-8a1d-86f39bee6323 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Getting quotas for user 18ea2d1dfc7441d2a2bb7b22c6065605 and project a0556c0544d446a2aa3d54e00b16bab1. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:18:19.882668 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7dd419dd-deed-4fe7-8a1d-86f39bee6323 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:18:19.885713 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7dd419dd-deed-4fe7-8a1d-86f39bee6323 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: d2d33142-cf85-4a5b-b63f-e3780f8ac0b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:18:19.972440 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-56a440aa-ecd1-4f05-9387-835274df6289 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:19.983857 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-56a440aa-ecd1-4f05-9387-835274df6289 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf" status: 200 len: 1497 microversion: 2.1 time: 0.299356 Oct 23 01:18:19.985152 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1076/2121] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:19 2022] GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf => generated 1497 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:19.992142 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c7fc2d36-ff36-463d-9b5f-202ad731ae09 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:19.994036 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c7fc2d36-ff36-463d-9b5f-202ad731ae09 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:20.005420 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7dd419dd-deed-4fe7-8a1d-86f39bee6323 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.334281 Oct 23 01:18:20.006258 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1046/2122] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:18:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1336 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:18:20.011105 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0ae78587-e8d3-4542-813d-061943076a4e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:20.011726 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0ae78587-e8d3-4542-813d-061943076a4e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] [instance: cffc5366-8131-4a2b-bf51-39e4d23929e3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:20.018507 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0ae78587-e8d3-4542-813d-061943076a4e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:20.020051 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0ae78587-e8d3-4542-813d-061943076a4e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:20.020688 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0ae78587-e8d3-4542-813d-061943076a4e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:20.021598 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0ae78587-e8d3-4542-813d-061943076a4e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:20.022164 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0ae78587-e8d3-4542-813d-061943076a4e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:20.022661 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0ae78587-e8d3-4542-813d-061943076a4e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:20.027082 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c7fc2d36-ff36-463d-9b5f-202ad731ae09 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:20.028393 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c7fc2d36-ff36-463d-9b5f-202ad731ae09 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:20.028393 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c7fc2d36-ff36-463d-9b5f-202ad731ae09 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:20.031286 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c7fc2d36-ff36-463d-9b5f-202ad731ae09 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:20.033038 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c7fc2d36-ff36-463d-9b5f-202ad731ae09 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:20.033750 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c7fc2d36-ff36-463d-9b5f-202ad731ae09 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:20.052597 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-0ae78587-e8d3-4542-813d-061943076a4e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] HTTP exception thrown: Instance cffc5366-8131-4a2b-bf51-39e4d23929e3 could not be found. Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0ae78587-e8d3-4542-813d-061943076a4e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Request method failure captured: Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/cffc5366-8131-4a2b-bf51-39e4d23929e3 HTTP/1.1 Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJVv0uHUZkawxRif88fKy9LhJENRPZsKhmf6zOBQWEzP00qmPQkqAca2jhb2lRXN9t0zC2JkLeeBldWCPH61ICeNt4v5sTKxLKhNmtzMUUime8-v0hyE48rstyJIK6CJypqB2ITpC6L9yRd-7i6fCZp0NigLnXS0XEU_z_Ej3fGN7bI Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 47aadec780734d03a262d4021f48d625 Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersOnMultiNodesTest-1204013784 Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/47aadec780734d03a262d4021f48d625"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_47aadec780734d03a262d4021f48d625"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/47aadec780734d03a262d4021f48d625"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/47aadec780734d03a262d4021f48d625"}]}] Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersOnMultiNodesTest-1204013784 Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 47aadec780734d03a262d4021f48d625 Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1204013784 Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersOnMultiNodesTest-1204013784-project Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 519c893a1e094200b882cf23db7cae54 Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersOnMultiNodesTest-1204013784-project Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: exception: Instance cffc5366-8131-4a2b-bf51-39e4d23929e3 could not be found. Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'cffc5366-8131-4a2b-bf51-39e4d23929e3'} Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cffc5366-8131-4a2b-bf51-39e4d23929e3 could not be found. Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cffc5366-8131-4a2b-bf51-39e4d23929e3 could not be found. Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:20.066692 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:18:20.071371 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:20.071371 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:18:20.071371 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:18:20.071371 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:18:20.071371 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:18:20.071371 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cffc5366-8131-4a2b-bf51-39e4d23929e3 could not be found. Oct 23 01:18:20.071371 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:18:20.079813 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0ae78587-e8d3-4542-813d-061943076a4e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] Returning 404 to user: Instance cffc5366-8131-4a2b-bf51-39e4d23929e3 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:18:20.081512 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0ae78587-e8d3-4542-813d-061943076a4e tempest-ServersOnMultiNodesTest-1204013784 tempest-ServersOnMultiNodesTest-1204013784-project] 10.222.0.42 "GET /compute/v2.1/servers/cffc5366-8131-4a2b-bf51-39e4d23929e3" status: 404 len: 111 microversion: 2.1 time: 0.074020 Oct 23 01:18:20.089827 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1047/2123] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:20 2022] GET /compute/v2.1/servers/cffc5366-8131-4a2b-bf51-39e4d23929e3 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:18:20.095750 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-819fca0a-26ba-41a8-a17e-c76bb1955430 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:20.097657 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-819fca0a-26ba-41a8-a17e-c76bb1955430 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: d2d33142-cf85-4a5b-b63f-e3780f8ac0b1] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:20.262330 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-819fca0a-26ba-41a8-a17e-c76bb1955430 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:20.262330 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-819fca0a-26ba-41a8-a17e-c76bb1955430 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1" status: 200 len: 1217 microversion: 2.1 time: 0.166407 Oct 23 01:18:20.262330 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1048/2124] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:20 2022] GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 => generated 1217 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:20.352599 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c7fc2d36-ff36-463d-9b5f-202ad731ae09 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:20.367460 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c7fc2d36-ff36-463d-9b5f-202ad731ae09 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1316 microversion: 2.1 time: 0.380317 Oct 23 01:18:20.368273 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1077/2125] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:19 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1316 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:20.540376 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-afdbbc9e-dd7a-46a8-a378-7ca9a9cbe010 req-9a899e2a-79d6-4aa8-9166-4e72348be073 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62a8ad26-f65b-432d-a8da-48264c426335", "name": "network-vif-plugged", "status": "completed", "tag": "56917629-dd5e-4c91-a45e-1e8e6cd25138"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:18:20.563292 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-afdbbc9e-dd7a-46a8-a378-7ca9a9cbe010 req-9a899e2a-79d6-4aa8-9166-4e72348be073 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:20.563536 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6f226ba1-e406-49e6-9835-b0176970d5f8 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:20.564110 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6f226ba1-e406-49e6-9835-b0176970d5f8 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:20.565299 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-afdbbc9e-dd7a-46a8-a378-7ca9a9cbe010 req-9a899e2a-79d6-4aa8-9166-4e72348be073 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:20.566961 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-afdbbc9e-dd7a-46a8-a378-7ca9a9cbe010 req-9a899e2a-79d6-4aa8-9166-4e72348be073 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:20.577340 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6f226ba1-e406-49e6-9835-b0176970d5f8 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:20.578742 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6f226ba1-e406-49e6-9835-b0176970d5f8 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:20.582062 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6f226ba1-e406-49e6-9835-b0176970d5f8 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:20.584038 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6f226ba1-e406-49e6-9835-b0176970d5f8 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:20.584516 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6f226ba1-e406-49e6-9835-b0176970d5f8 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:20.585113 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6f226ba1-e406-49e6-9835-b0176970d5f8 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:20.587392 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-afdbbc9e-dd7a-46a8-a378-7ca9a9cbe010 req-9a899e2a-79d6-4aa8-9166-4e72348be073 service nova] Creating event network-vif-plugged:56917629-dd5e-4c91-a45e-1e8e6cd25138 for instance 62a8ad26-f65b-432d-a8da-48264c426335 on n-h2-master-1 Oct 23 01:18:20.604632 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-afdbbc9e-dd7a-46a8-a378-7ca9a9cbe010 req-9a899e2a-79d6-4aa8-9166-4e72348be073 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068937 Oct 23 01:18:20.606235 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1049/2126] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:18:20.823065 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6f226ba1-e406-49e6-9835-b0176970d5f8 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:20.839220 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6f226ba1-e406-49e6-9835-b0176970d5f8 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1391 microversion: 2.1 time: 0.278467 Oct 23 01:18:20.842281 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1078/2127] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:20 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1391 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:18:21.012395 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-446f96be-81fa-4722-88a9-495a6eda8a80 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:21.013088 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-446f96be-81fa-4722-88a9-495a6eda8a80 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 40104c3d-0e82-449a-a331-c4f6ba80afaf] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:21.023130 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-446f96be-81fa-4722-88a9-495a6eda8a80 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:21.023953 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-446f96be-81fa-4722-88a9-495a6eda8a80 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:21.026768 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-446f96be-81fa-4722-88a9-495a6eda8a80 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:21.033592 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-446f96be-81fa-4722-88a9-495a6eda8a80 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:21.034997 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-446f96be-81fa-4722-88a9-495a6eda8a80 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:21.035744 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-446f96be-81fa-4722-88a9-495a6eda8a80 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:21.240415 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-446f96be-81fa-4722-88a9-495a6eda8a80 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:21.250437 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-446f96be-81fa-4722-88a9-495a6eda8a80 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf" status: 200 len: 1497 microversion: 2.1 time: 0.242889 Oct 23 01:18:21.258088 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1050/2128] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:21 2022] GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf => generated 1497 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:21.284288 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3742da54-9879-4940-aafc-bedb91c3176b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:21.284887 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3742da54-9879-4940-aafc-bedb91c3176b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: d2d33142-cf85-4a5b-b63f-e3780f8ac0b1] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:21.357676 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3742da54-9879-4940-aafc-bedb91c3176b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:21.365708 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3742da54-9879-4940-aafc-bedb91c3176b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1" status: 200 len: 1217 microversion: 2.1 time: 0.086212 Oct 23 01:18:21.367417 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1079/2129] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:21 2022] GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:21.397506 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-73518afc-12e7-4377-a2b4-81d127116893 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:21.397506 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-73518afc-12e7-4377-a2b4-81d127116893 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:21.397506 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:21.401818 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-73518afc-12e7-4377-a2b4-81d127116893 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:21.402353 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-73518afc-12e7-4377-a2b4-81d127116893 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:21.402797 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-73518afc-12e7-4377-a2b4-81d127116893 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:21.403694 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-73518afc-12e7-4377-a2b4-81d127116893 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:21.404158 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-73518afc-12e7-4377-a2b4-81d127116893 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:21.405067 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-73518afc-12e7-4377-a2b4-81d127116893 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:21.608680 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-73518afc-12e7-4377-a2b4-81d127116893 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:21.624467 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-73518afc-12e7-4377-a2b4-81d127116893 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1316 microversion: 2.1 time: 0.236884 Oct 23 01:18:21.646321 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1051/2130] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:21 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1316 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:21.865465 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-859f2231-1240-43bf-95e8-21887f8ce5d5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:21.866363 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-859f2231-1240-43bf-95e8-21887f8ce5d5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:21.879154 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-859f2231-1240-43bf-95e8-21887f8ce5d5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:21.879154 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-859f2231-1240-43bf-95e8-21887f8ce5d5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:21.879154 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-859f2231-1240-43bf-95e8-21887f8ce5d5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:21.880366 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-859f2231-1240-43bf-95e8-21887f8ce5d5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:21.881509 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-859f2231-1240-43bf-95e8-21887f8ce5d5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:21.882164 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-859f2231-1240-43bf-95e8-21887f8ce5d5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:22.170236 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-859f2231-1240-43bf-95e8-21887f8ce5d5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:22.181707 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-859f2231-1240-43bf-95e8-21887f8ce5d5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1391 microversion: 2.1 time: 0.319887 Oct 23 01:18:22.185752 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1080/2131] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:21 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1391 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:22.275055 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-171107f1-cc53-416d-a4ff-71c268e8255a tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:22.276739 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-171107f1-cc53-416d-a4ff-71c268e8255a tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 40104c3d-0e82-449a-a331-c4f6ba80afaf] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:22.292493 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-171107f1-cc53-416d-a4ff-71c268e8255a tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:22.292999 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-171107f1-cc53-416d-a4ff-71c268e8255a tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:22.294204 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-171107f1-cc53-416d-a4ff-71c268e8255a tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:22.298399 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-171107f1-cc53-416d-a4ff-71c268e8255a tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:22.298911 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-171107f1-cc53-416d-a4ff-71c268e8255a tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:22.299383 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-171107f1-cc53-416d-a4ff-71c268e8255a tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:22.395693 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-30f4597e-e766-4f66-99ca-45690b315858 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:22.396678 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-30f4597e-e766-4f66-99ca-45690b315858 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: d2d33142-cf85-4a5b-b63f-e3780f8ac0b1] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:22.405193 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-30f4597e-e766-4f66-99ca-45690b315858 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:22.406223 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-30f4597e-e766-4f66-99ca-45690b315858 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:22.406993 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-30f4597e-e766-4f66-99ca-45690b315858 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:22.407898 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-30f4597e-e766-4f66-99ca-45690b315858 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:22.408996 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-30f4597e-e766-4f66-99ca-45690b315858 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:22.409603 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-30f4597e-e766-4f66-99ca-45690b315858 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:22.637731 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-30f4597e-e766-4f66-99ca-45690b315858 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:22.673671 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-30f4597e-e766-4f66-99ca-45690b315858 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1" status: 200 len: 1213 microversion: 2.1 time: 0.255960 Oct 23 01:18:22.675621 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1081/2132] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:22 2022] GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 => generated 1213 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:22.687911 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-41c9455f-2761-4d77-9f5b-8b679ecc85b9 req-a23abd04-dd60-4517-a9c7-0d40ac93a0db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dad12d7a-a01e-4f91-b35e-4f9f83df5b3b", "name": "network-vif-unplugged", "status": "completed", "tag": "b5a5b9cd-a440-4270-b48f-5816d8d587a8"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:18:22.715152 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-41c9455f-2761-4d77-9f5b-8b679ecc85b9 req-a23abd04-dd60-4517-a9c7-0d40ac93a0db service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:22.717544 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-41c9455f-2761-4d77-9f5b-8b679ecc85b9 req-a23abd04-dd60-4517-a9c7-0d40ac93a0db service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:22.718005 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-41c9455f-2761-4d77-9f5b-8b679ecc85b9 req-a23abd04-dd60-4517-a9c7-0d40ac93a0db service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:22.762221 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-41c9455f-2761-4d77-9f5b-8b679ecc85b9 req-a23abd04-dd60-4517-a9c7-0d40ac93a0db service nova] Creating event network-vif-unplugged:b5a5b9cd-a440-4270-b48f-5816d8d587a8 for instance dad12d7a-a01e-4f91-b35e-4f9f83df5b3b on n-h2-master-1 Oct 23 01:18:22.779870 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-41c9455f-2761-4d77-9f5b-8b679ecc85b9 req-a23abd04-dd60-4517-a9c7-0d40ac93a0db service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100176 Oct 23 01:18:22.783748 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1082/2133] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:18:22.797467 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0fd63ced-783e-42da-b163-9e4860c74ab8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:22.803650 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0fd63ced-783e-42da-b163-9e4860c74ab8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:22.820412 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0fd63ced-783e-42da-b163-9e4860c74ab8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:22.821753 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0fd63ced-783e-42da-b163-9e4860c74ab8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:22.823872 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0fd63ced-783e-42da-b163-9e4860c74ab8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:22.824776 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0fd63ced-783e-42da-b163-9e4860c74ab8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:22.826524 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0fd63ced-783e-42da-b163-9e4860c74ab8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:22.827144 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0fd63ced-783e-42da-b163-9e4860c74ab8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:22.896419 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-171107f1-cc53-416d-a4ff-71c268e8255a tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:22.912926 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-171107f1-cc53-416d-a4ff-71c268e8255a tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf" status: 200 len: 1497 microversion: 2.1 time: 0.641709 Oct 23 01:18:22.916668 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1052/2134] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:22 2022] GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf => generated 1497 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:23.158095 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0fd63ced-783e-42da-b163-9e4860c74ab8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:23.167866 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0fd63ced-783e-42da-b163-9e4860c74ab8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.381543 Oct 23 01:18:23.171420 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1083/2135] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:22 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:23.208551 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2370f4b6-fffa-441c-8c6c-d8021ace3f8d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:23.209166 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2370f4b6-fffa-441c-8c6c-d8021ace3f8d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:23.217213 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2370f4b6-fffa-441c-8c6c-d8021ace3f8d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:23.217213 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2370f4b6-fffa-441c-8c6c-d8021ace3f8d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:23.217213 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2370f4b6-fffa-441c-8c6c-d8021ace3f8d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:23.217905 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2370f4b6-fffa-441c-8c6c-d8021ace3f8d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:23.218516 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2370f4b6-fffa-441c-8c6c-d8021ace3f8d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:23.218948 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2370f4b6-fffa-441c-8c6c-d8021ace3f8d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:23.388898 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e9a9901f-ce0a-4822-8381-e85ff53bbefc tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-601837869", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "06f4c921-9d2b-4ef6-806f-b77fdc508baa"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:18:23.479125 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-e9a9901f-ce0a-4822-8381-e85ff53bbefc tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] validate_networks() for [('06f4c921-9d2b-4ef6-806f-b77fdc508baa', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:18:24.063946 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2370f4b6-fffa-441c-8c6c-d8021ace3f8d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:24.085146 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2370f4b6-fffa-441c-8c6c-d8021ace3f8d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1391 microversion: 2.1 time: 0.880685 Oct 23 01:18:24.086990 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1053/2136] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:23 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1391 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:24.400124 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dde07173-bafe-4f5e-ac8c-0bbefe59a61d tempest-ImagesMetadataNegativeTestJSON-428891543 tempest-ImagesMetadataNegativeTestJSON-428891543-project] Calling method '.version_select at 0x7f5cc278b3a0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:24.439895 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-dde07173-bafe-4f5e-ac8c-0bbefe59a61d tempest-ImagesMetadataNegativeTestJSON-428891543 tempest-ImagesMetadataNegativeTestJSON-428891543-project] HTTP exception thrown: Image not found. Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dde07173-bafe-4f5e-ac8c-0bbefe59a61d tempest-ImagesMetadataNegativeTestJSON-428891543 tempest-ImagesMetadataNegativeTestJSON-428891543-project] Request method failure captured: Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/images/d31fe5e0-105f-4321-98d4-369a9d8e3873/metadata/os_distro HTTP/1.1 Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJZfd-wbEWdtnoKbpDUmUuTW3KhJHOb-5zFmB4GAfqcaETIVlLEWSEvRhULWCS2lSEMTzpmROGJSN-d_a9NHf7XFUnZB3Dwo_xiXUqAMwRfVFY1jS0eRKN-PCOoD-AHwn7qs2lA1sgJJsu1jgW611zWCl7OdgcBtDxwn6wpw51jlFf8 Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: b4193043521942fb82165e6542f7e1a0 Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-428891543 Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b4193043521942fb82165e6542f7e1a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b4193043521942fb82165e6542f7e1a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b4193043521942fb82165e6542f7e1a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b4193043521942fb82165e6542f7e1a0"}]}] Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-428891543 Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: b4193043521942fb82165e6542f7e1a0 Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-428891543 Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ImagesMetadataNegativeTestJSON-428891543-project Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 1c586dd247c84eb79c0cbdd81b08ecfe Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-428891543-project Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: method: Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: exception: Image not found. Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: action_args: {'image_id': 'd31fe5e0-105f-4321-98d4-369a9d8e3873', 'id': 'os_distro'} Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d31fe5e0-105f-4321-98d4-369a9d8e3873 Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 23 01:18:24.444876 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 23 01:18:24.462233 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 23 01:18:24.462233 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 23 01:18:24.462233 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 23 01:18:24.462233 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 23 01:18:24.462233 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 23 01:18:24.462233 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 23 01:18:24.462233 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 23 01:18:24.462233 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 23 01:18:24.462233 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 23 01:18:24.462233 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 23 01:18:24.462233 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 23 01:18:24.462233 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 23 01:18:24.462233 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 23 01:18:24.462233 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 23 01:18:24.462233 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 23 01:18:24.462233 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 23 01:18:24.462233 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 23 01:18:24.462233 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 23 01:18:24.462233 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d31fe5e0-105f-4321-98d4-369a9d8e3873 could not be found. Oct 23 01:18:24.462233 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:18:24.462233 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:24.462233 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:18:24.462233 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:24.462233 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:18:24.462233 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:18:24.462233 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:18:24.462233 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:18:24.462233 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:18:24.462233 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:18:24.462233 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:18:24.462233 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:18:24.462233 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 23 01:18:24.462233 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 23 01:18:24.462233 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 23 01:18:24.462233 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 23 01:18:24.462233 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 23 01:18:24.462233 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:18:24.462233 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:24.462233 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:18:24.462233 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:24.462233 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:18:24.462233 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:18:24.462233 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:18:24.462233 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:18:24.462233 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 23 01:18:24.462233 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:18:24.462233 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dde07173-bafe-4f5e-ac8c-0bbefe59a61d tempest-ImagesMetadataNegativeTestJSON-428891543 tempest-ImagesMetadataNegativeTestJSON-428891543-project] Returning 404 to user: Image not found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:18:24.462233 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-dde07173-bafe-4f5e-ac8c-0bbefe59a61d tempest-ImagesMetadataNegativeTestJSON-428891543 tempest-ImagesMetadataNegativeTestJSON-428891543-project] 10.222.0.42 "DELETE /compute/v2.1/images/d31fe5e0-105f-4321-98d4-369a9d8e3873/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.357714 Oct 23 01:18:24.462233 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1054/2137] 10.222.0.42 () {58 vars in 1293 bytes} [Sun Oct 23 01:18:24 2022] DELETE /compute/v2.1/images/d31fe5e0-105f-4321-98d4-369a9d8e3873/metadata/os_distro => generated 62 bytes in 359 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:18:24.462233 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b25cdd65-55f7-4908-900a-9b6c4a50946d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:24.467772 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b25cdd65-55f7-4908-900a-9b6c4a50946d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: d2d33142-cf85-4a5b-b63f-e3780f8ac0b1] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:24.489402 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b25cdd65-55f7-4908-900a-9b6c4a50946d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:24.494230 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b25cdd65-55f7-4908-900a-9b6c4a50946d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:24.494230 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b25cdd65-55f7-4908-900a-9b6c4a50946d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:24.494230 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b25cdd65-55f7-4908-900a-9b6c4a50946d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:24.494230 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b25cdd65-55f7-4908-900a-9b6c4a50946d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:24.494230 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b25cdd65-55f7-4908-900a-9b6c4a50946d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:24.495442 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-e9a9901f-ce0a-4822-8381-e85ff53bbefc tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:18:24.495442 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-e9a9901f-ce0a-4822-8381-e85ff53bbefc tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:18:24.495442 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-e9a9901f-ce0a-4822-8381-e85ff53bbefc tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:18:24.495983 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-e9a9901f-ce0a-4822-8381-e85ff53bbefc tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:18:24.495983 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-e9a9901f-ce0a-4822-8381-e85ff53bbefc tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:18:24.509786 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e9a9901f-ce0a-4822-8381-e85ff53bbefc tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:24.510349 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e9a9901f-ce0a-4822-8381-e85ff53bbefc tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:24.511066 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e9a9901f-ce0a-4822-8381-e85ff53bbefc tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:24.511803 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e9a9901f-ce0a-4822-8381-e85ff53bbefc tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:24.512260 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e9a9901f-ce0a-4822-8381-e85ff53bbefc tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:24.512686 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e9a9901f-ce0a-4822-8381-e85ff53bbefc tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:24.534290 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-e9a9901f-ce0a-4822-8381-e85ff53bbefc tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Getting quotas for project 1c099cb4056b438a9c9dead75e7eb797. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:18:24.540115 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-e9a9901f-ce0a-4822-8381-e85ff53bbefc tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Getting quotas for user cd6a6c5240f94ace91e1f0ed3e53fa7c and project 1c099cb4056b438a9c9dead75e7eb797. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:18:24.561028 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e9a9901f-ce0a-4822-8381-e85ff53bbefc tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:18:24.563711 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e9a9901f-ce0a-4822-8381-e85ff53bbefc tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: cce77239-7b98-4389-946e-8292bf160194] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:18:24.564731 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b25cdd65-55f7-4908-900a-9b6c4a50946d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:24.573965 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b25cdd65-55f7-4908-900a-9b6c4a50946d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1" status: 200 len: 1275 microversion: 2.1 time: 0.125324 Oct 23 01:18:24.583711 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1055/2138] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:24 2022] GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 => generated 1275 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:24.583711 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7667bdf0-3f14-49d6-8a9a-0cc6675f3feb tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:24.583711 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7667bdf0-3f14-49d6-8a9a-0cc6675f3feb tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 40104c3d-0e82-449a-a331-c4f6ba80afaf] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:24.592971 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7667bdf0-3f14-49d6-8a9a-0cc6675f3feb tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:24.592971 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7667bdf0-3f14-49d6-8a9a-0cc6675f3feb tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:24.592971 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7667bdf0-3f14-49d6-8a9a-0cc6675f3feb tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:24.592971 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7667bdf0-3f14-49d6-8a9a-0cc6675f3feb tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:24.592971 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7667bdf0-3f14-49d6-8a9a-0cc6675f3feb tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:24.592971 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7667bdf0-3f14-49d6-8a9a-0cc6675f3feb tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:24.754444 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7667bdf0-3f14-49d6-8a9a-0cc6675f3feb tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:24.762547 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=100 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:24.778368 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7667bdf0-3f14-49d6-8a9a-0cc6675f3feb tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf" status: 200 len: 1497 microversion: 2.1 time: 0.190538 Oct 23 01:18:24.778496 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e9a9901f-ce0a-4822-8381-e85ff53bbefc tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.392325 Oct 23 01:18:24.778496 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1084/2139] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:18:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1394 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 23 01:18:24.779293 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1056/2140] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:24 2022] GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf => generated 1497 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:24.791879 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c2d50997-74ae-4b2b-bf74-a9385f04c479 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:24.792680 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c2d50997-74ae-4b2b-bf74-a9385f04c479 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: cce77239-7b98-4389-946e-8292bf160194] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:24.799194 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8d95fc0b-4d12-4827-abdf-803e5532ef10 tempest-ImagesMetadataNegativeTestJSON-428891543 tempest-ImagesMetadataNegativeTestJSON-428891543-project] Calling method '.version_select at 0x7f5cc62549d0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:24.839519 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-8d95fc0b-4d12-4827-abdf-803e5532ef10 tempest-ImagesMetadataNegativeTestJSON-428891543 tempest-ImagesMetadataNegativeTestJSON-428891543-project] HTTP exception thrown: Image not found. Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8d95fc0b-4d12-4827-abdf-803e5532ef10 tempest-ImagesMetadataNegativeTestJSON-428891543 tempest-ImagesMetadataNegativeTestJSON-428891543-project] Request method failure captured: Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/images/593248ef-2d0a-467c-878a-7eec483b8820/metadata/os_version HTTP/1.1 Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJZfd-wbEWdtnoKbpDUmUuTW3KhJHOb-5zFmB4GAfqcaETIVlLEWSEvRhULWCS2lSEMTzpmROGJSN-d_a9NHf7XFUnZB3Dwo_xiXUqAMwRfVFY1jS0eRKN-PCOoD-AHwn7qs2lA1sgJJsu1jgW611zWCl7OdgcBtDxwn6wpw51jlFf8 Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: b4193043521942fb82165e6542f7e1a0 Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-428891543 Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b4193043521942fb82165e6542f7e1a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b4193043521942fb82165e6542f7e1a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b4193043521942fb82165e6542f7e1a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b4193043521942fb82165e6542f7e1a0"}]}] Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-428891543 Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: b4193043521942fb82165e6542f7e1a0 Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-428891543 Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ImagesMetadataNegativeTestJSON-428891543-project Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 1c586dd247c84eb79c0cbdd81b08ecfe Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-428891543-project Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: method: Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: exception: Image not found. Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: action_args: {'image_id': '593248ef-2d0a-467c-878a-7eec483b8820', 'id': 'os_version'} Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 593248ef-2d0a-467c-878a-7eec483b8820 Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 23 01:18:24.843357 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 23 01:18:24.851411 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 23 01:18:24.851411 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 23 01:18:24.851411 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 23 01:18:24.851411 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 23 01:18:24.851411 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 23 01:18:24.851411 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 23 01:18:24.851411 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 23 01:18:24.851411 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 23 01:18:24.851411 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 23 01:18:24.851411 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 23 01:18:24.851411 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 23 01:18:24.851411 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 23 01:18:24.851411 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 23 01:18:24.851411 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 23 01:18:24.851411 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 23 01:18:24.851411 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 23 01:18:24.851411 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 23 01:18:24.851411 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 23 01:18:24.851411 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 593248ef-2d0a-467c-878a-7eec483b8820 could not be found. Oct 23 01:18:24.851411 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:24.851411 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:24.851411 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:24.851411 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:24.851411 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:18:24.851411 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:18:24.851411 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:18:24.851411 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:18:24.851411 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:18:24.851411 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:18:24.851411 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:18:24.851411 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:18:24.851411 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 23 01:18:24.851411 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 23 01:18:24.851411 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 23 01:18:24.851411 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 23 01:18:24.851411 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 23 01:18:24.851411 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:24.851411 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:24.851411 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:24.851411 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:24.851411 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:18:24.851411 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:18:24.851411 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:18:24.851411 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:18:24.851411 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 23 01:18:24.851411 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:24.851411 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8d95fc0b-4d12-4827-abdf-803e5532ef10 tempest-ImagesMetadataNegativeTestJSON-428891543 tempest-ImagesMetadataNegativeTestJSON-428891543-project] Returning 404 to user: Image not found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:18:24.856201 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8d95fc0b-4d12-4827-abdf-803e5532ef10 tempest-ImagesMetadataNegativeTestJSON-428891543 tempest-ImagesMetadataNegativeTestJSON-428891543-project] 10.222.0.42 "GET /compute/v2.1/images/593248ef-2d0a-467c-878a-7eec483b8820/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.066701 Oct 23 01:18:24.858433 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1085/2141] 10.222.0.42 () {58 vars in 1293 bytes} [Sun Oct 23 01:18:24 2022] GET /compute/v2.1/images/593248ef-2d0a-467c-878a-7eec483b8820/metadata/os_version => generated 62 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:18:24.876312 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-3bbbff7a-d6a5-4234-8849-66711cef19b5 req-5f96d38f-9991-40e7-b327-d637cad34d5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dad12d7a-a01e-4f91-b35e-4f9f83df5b3b", "tag": "b5a5b9cd-a440-4270-b48f-5816d8d587a8"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:18:24.908873 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-3bbbff7a-d6a5-4234-8849-66711cef19b5 req-5f96d38f-9991-40e7-b327-d637cad34d5d service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:24.910373 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-3bbbff7a-d6a5-4234-8849-66711cef19b5 req-5f96d38f-9991-40e7-b327-d637cad34d5d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:24.910875 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-3bbbff7a-d6a5-4234-8849-66711cef19b5 req-5f96d38f-9991-40e7-b327-d637cad34d5d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:24.937104 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-3bbbff7a-d6a5-4234-8849-66711cef19b5 req-5f96d38f-9991-40e7-b327-d637cad34d5d service nova] Creating event network-changed:b5a5b9cd-a440-4270-b48f-5816d8d587a8 for instance dad12d7a-a01e-4f91-b35e-4f9f83df5b3b on n-h2-master-1 Oct 23 01:18:24.943171 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-3bbbff7a-d6a5-4234-8849-66711cef19b5 req-5f96d38f-9991-40e7-b327-d637cad34d5d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083382 Oct 23 01:18:24.944300 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1086/2142] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:18:24.951303 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cb058e89-89b2-4d84-8089-64750d1de7fe tempest-ImagesMetadataNegativeTestJSON-428891543 tempest-ImagesMetadataNegativeTestJSON-428891543-project] Calling method '.version_select at 0x7f5cc62de1f0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:24.956690 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c2d50997-74ae-4b2b-bf74-a9385f04c479 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:24.966084 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c2d50997-74ae-4b2b-bf74-a9385f04c479 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/cce77239-7b98-4389-946e-8292bf160194" status: 200 len: 1216 microversion: 2.1 time: 0.179436 Oct 23 01:18:24.966921 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1057/2143] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:24 2022] GET /compute/v2.1/servers/cce77239-7b98-4389-946e-8292bf160194 => generated 1216 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:24.994411 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-cb058e89-89b2-4d84-8089-64750d1de7fe tempest-ImagesMetadataNegativeTestJSON-428891543 tempest-ImagesMetadataNegativeTestJSON-428891543-project] HTTP exception thrown: Image not found. Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cb058e89-89b2-4d84-8089-64750d1de7fe tempest-ImagesMetadataNegativeTestJSON-428891543 tempest-ImagesMetadataNegativeTestJSON-428891543-project] Request method failure captured: Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/images/9e223184-7fe6-43ad-b1ae-ad95a78755b1/metadata HTTP/1.1 Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJZfd-wbEWdtnoKbpDUmUuTW3KhJHOb-5zFmB4GAfqcaETIVlLEWSEvRhULWCS2lSEMTzpmROGJSN-d_a9NHf7XFUnZB3Dwo_xiXUqAMwRfVFY1jS0eRKN-PCOoD-AHwn7qs2lA1sgJJsu1jgW611zWCl7OdgcBtDxwn6wpw51jlFf8 Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: b4193043521942fb82165e6542f7e1a0 Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-428891543 Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b4193043521942fb82165e6542f7e1a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b4193043521942fb82165e6542f7e1a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b4193043521942fb82165e6542f7e1a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b4193043521942fb82165e6542f7e1a0"}]}] Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-428891543 Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: b4193043521942fb82165e6542f7e1a0 Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-428891543 Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ImagesMetadataNegativeTestJSON-428891543-project Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 1c586dd247c84eb79c0cbdd81b08ecfe Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-428891543-project Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: method: Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: exception: Image not found. Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: action_args: {'image_id': '9e223184-7fe6-43ad-b1ae-ad95a78755b1'} Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9e223184-7fe6-43ad-b1ae-ad95a78755b1 Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 23 01:18:24.996896 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 23 01:18:25.014786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 23 01:18:25.014786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 23 01:18:25.014786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 23 01:18:25.014786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 23 01:18:25.014786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 23 01:18:25.014786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 23 01:18:25.014786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 23 01:18:25.014786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 23 01:18:25.014786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 23 01:18:25.014786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 23 01:18:25.014786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 23 01:18:25.014786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 23 01:18:25.014786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 23 01:18:25.014786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 23 01:18:25.014786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 23 01:18:25.014786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 23 01:18:25.014786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 23 01:18:25.014786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 23 01:18:25.014786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9e223184-7fe6-43ad-b1ae-ad95a78755b1 could not be found. Oct 23 01:18:25.014786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:25.014786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:25.014786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:25.014786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:25.014786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:18:25.014786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:18:25.014786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:18:25.014786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:18:25.014786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:18:25.014786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:18:25.014786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:18:25.014786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:18:25.014786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 23 01:18:25.014786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 23 01:18:25.014786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 23 01:18:25.014786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 23 01:18:25.014786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 23 01:18:25.014786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:25.014786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:25.014786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:25.014786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:25.014786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:18:25.014786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:18:25.014786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:18:25.014786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:18:25.014786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 23 01:18:25.014786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:25.014786 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cb058e89-89b2-4d84-8089-64750d1de7fe tempest-ImagesMetadataNegativeTestJSON-428891543 tempest-ImagesMetadataNegativeTestJSON-428891543-project] Returning 404 to user: Image not found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:18:25.014786 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cb058e89-89b2-4d84-8089-64750d1de7fe tempest-ImagesMetadataNegativeTestJSON-428891543 tempest-ImagesMetadataNegativeTestJSON-428891543-project] 10.222.0.42 "GET /compute/v2.1/images/9e223184-7fe6-43ad-b1ae-ad95a78755b1/metadata" status: 404 len: 62 microversion: 2.1 time: 0.052693 Oct 23 01:18:25.014786 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1087/2144] 10.222.0.42 () {58 vars in 1260 bytes} [Sun Oct 23 01:18:24 2022] GET /compute/v2.1/images/9e223184-7fe6-43ad-b1ae-ad95a78755b1/metadata => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:18:25.026038 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2336ad81-9051-44bc-a78e-8735e14231fd tempest-ImagesMetadataNegativeTestJSON-428891543 tempest-ImagesMetadataNegativeTestJSON-428891543-project] Action: 'update_all', calling method: .version_select at 0x7f5cc1a37b80>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:18:25.084248 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-2336ad81-9051-44bc-a78e-8735e14231fd tempest-ImagesMetadataNegativeTestJSON-428891543 tempest-ImagesMetadataNegativeTestJSON-428891543-project] HTTP exception thrown: Image not found. Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2336ad81-9051-44bc-a78e-8735e14231fd tempest-ImagesMetadataNegativeTestJSON-428891543 tempest-ImagesMetadataNegativeTestJSON-428891543-project] Request method failure captured: Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: request: PUT /compute/v2.1/images/4b0a3cb3-4973-4d0b-bcf6-ceb5684f9079/metadata HTTP/1.1 Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 57 Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJZfd-wbEWdtnoKbpDUmUuTW3KhJHOb-5zFmB4GAfqcaETIVlLEWSEvRhULWCS2lSEMTzpmROGJSN-d_a9NHf7XFUnZB3Dwo_xiXUqAMwRfVFY1jS0eRKN-PCOoD-AHwn7qs2lA1sgJJsu1jgW611zWCl7OdgcBtDxwn6wpw51jlFf8 Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: b4193043521942fb82165e6542f7e1a0 Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-428891543 Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b4193043521942fb82165e6542f7e1a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b4193043521942fb82165e6542f7e1a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b4193043521942fb82165e6542f7e1a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b4193043521942fb82165e6542f7e1a0"}]}] Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-428891543 Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: b4193043521942fb82165e6542f7e1a0 Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-428891543 Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ImagesMetadataNegativeTestJSON-428891543-project Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 1c586dd247c84eb79c0cbdd81b08ecfe Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-428891543-project Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: method: Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: exception: Image not found. Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: action_args: {'image_id': '4b0a3cb3-4973-4d0b-bcf6-ceb5684f9079', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 4b0a3cb3-4973-4d0b-bcf6-ceb5684f9079 Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 23 01:18:25.086887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 23 01:18:25.092313 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 23 01:18:25.092313 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 23 01:18:25.092313 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 23 01:18:25.092313 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 23 01:18:25.092313 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 23 01:18:25.092313 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 23 01:18:25.092313 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 23 01:18:25.092313 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 23 01:18:25.092313 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 23 01:18:25.092313 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 23 01:18:25.092313 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 23 01:18:25.092313 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 23 01:18:25.092313 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 23 01:18:25.092313 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 23 01:18:25.092313 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 23 01:18:25.092313 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 23 01:18:25.092313 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 23 01:18:25.092313 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 23 01:18:25.092313 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4b0a3cb3-4973-4d0b-bcf6-ceb5684f9079 could not be found. Oct 23 01:18:25.092313 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:18:25.092313 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:25.092313 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:18:25.092313 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:25.092313 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:18:25.092313 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:18:25.092313 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:18:25.092313 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:18:25.092313 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:18:25.092313 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:18:25.092313 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:18:25.092313 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:18:25.092313 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:18:25.092313 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:18:25.092313 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 23 01:18:25.092313 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 23 01:18:25.092313 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 23 01:18:25.092313 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 23 01:18:25.092313 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 23 01:18:25.092313 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:18:25.092313 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:25.092313 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:18:25.092313 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:25.092313 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:18:25.092313 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:18:25.092313 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:18:25.092313 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:18:25.092313 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 23 01:18:25.092313 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:18:25.092313 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2336ad81-9051-44bc-a78e-8735e14231fd tempest-ImagesMetadataNegativeTestJSON-428891543 tempest-ImagesMetadataNegativeTestJSON-428891543-project] Returning 404 to user: Image not found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:18:25.092313 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2336ad81-9051-44bc-a78e-8735e14231fd tempest-ImagesMetadataNegativeTestJSON-428891543 tempest-ImagesMetadataNegativeTestJSON-428891543-project] 10.222.0.42 "PUT /compute/v2.1/images/4b0a3cb3-4973-4d0b-bcf6-ceb5684f9079/metadata" status: 404 len: 62 microversion: 2.1 time: 0.077459 Oct 23 01:18:25.110072 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c5d68a7e-23d0-4949-aa18-e5eadb3fb5bb tempest-ImagesMetadataNegativeTestJSON-428891543 tempest-ImagesMetadataNegativeTestJSON-428891543-project] Action: 'update', calling method: .version_select at 0x7f5cc62deb80>, body: {"meta": {"os_distro": "alt"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:18:25.110197 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1058/2145] 10.222.0.42 () {60 vars in 1280 bytes} [Sun Oct 23 01:18:25 2022] PUT /compute/v2.1/images/4b0a3cb3-4973-4d0b-bcf6-ceb5684f9079/metadata => generated 62 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:18:25.125286 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-61821de5-60ba-4cce-ae64-04bd8fba1dd2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:25.128755 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-61821de5-60ba-4cce-ae64-04bd8fba1dd2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:25.141967 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-61821de5-60ba-4cce-ae64-04bd8fba1dd2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:25.144933 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-61821de5-60ba-4cce-ae64-04bd8fba1dd2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:25.145474 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-61821de5-60ba-4cce-ae64-04bd8fba1dd2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:25.146252 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-61821de5-60ba-4cce-ae64-04bd8fba1dd2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:25.151375 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-61821de5-60ba-4cce-ae64-04bd8fba1dd2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:25.157518 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-61821de5-60ba-4cce-ae64-04bd8fba1dd2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-c5d68a7e-23d0-4949-aa18-e5eadb3fb5bb tempest-ImagesMetadataNegativeTestJSON-428891543 tempest-ImagesMetadataNegativeTestJSON-428891543-project] HTTP exception thrown: Image not found. Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c5d68a7e-23d0-4949-aa18-e5eadb3fb5bb tempest-ImagesMetadataNegativeTestJSON-428891543 tempest-ImagesMetadataNegativeTestJSON-428891543-project] Request method failure captured: Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: request: PUT /compute/v2.1/images/56a69033-abca-4c82-a437-87de2248ff5a/metadata/os_distro HTTP/1.1 Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 30 Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJZfd-wbEWdtnoKbpDUmUuTW3KhJHOb-5zFmB4GAfqcaETIVlLEWSEvRhULWCS2lSEMTzpmROGJSN-d_a9NHf7XFUnZB3Dwo_xiXUqAMwRfVFY1jS0eRKN-PCOoD-AHwn7qs2lA1sgJJsu1jgW611zWCl7OdgcBtDxwn6wpw51jlFf8 Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: b4193043521942fb82165e6542f7e1a0 Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-428891543 Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b4193043521942fb82165e6542f7e1a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b4193043521942fb82165e6542f7e1a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b4193043521942fb82165e6542f7e1a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b4193043521942fb82165e6542f7e1a0"}]}] Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-428891543 Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: b4193043521942fb82165e6542f7e1a0 Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-428891543 Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ImagesMetadataNegativeTestJSON-428891543-project Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 1c586dd247c84eb79c0cbdd81b08ecfe Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-428891543-project Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: {"meta": {"os_distro": "alt"}} Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: method: Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: exception: Image not found. Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: action_args: {'image_id': '56a69033-abca-4c82-a437-87de2248ff5a', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 56a69033-abca-4c82-a437-87de2248ff5a Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 23 01:18:25.157786 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 23 01:18:25.162402 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 23 01:18:25.162402 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 23 01:18:25.162402 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 23 01:18:25.162402 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 23 01:18:25.162402 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 23 01:18:25.162402 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 23 01:18:25.162402 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 23 01:18:25.162402 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 23 01:18:25.162402 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 23 01:18:25.162402 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 23 01:18:25.162402 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 23 01:18:25.162402 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 23 01:18:25.162402 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 23 01:18:25.162402 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 23 01:18:25.162402 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 23 01:18:25.162402 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 23 01:18:25.162402 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 23 01:18:25.162402 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 23 01:18:25.162402 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 23 01:18:25.162402 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 23 01:18:25.162402 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 23 01:18:25.162402 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 56a69033-abca-4c82-a437-87de2248ff5a could not be found. Oct 23 01:18:25.162402 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:25.162402 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:25.162402 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:25.162402 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:25.162402 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:18:25.162402 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:18:25.162402 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:18:25.162402 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:18:25.162402 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:18:25.162402 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:18:25.162402 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:18:25.162402 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:18:25.162402 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:18:25.162402 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:18:25.162402 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 23 01:18:25.162402 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 23 01:18:25.162402 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 23 01:18:25.162402 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 23 01:18:25.162402 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 23 01:18:25.162402 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:25.162402 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:25.162402 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:25.162402 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:25.162402 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:18:25.162402 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:18:25.162402 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:18:25.162402 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:18:25.162402 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 23 01:18:25.162402 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:25.162402 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c5d68a7e-23d0-4949-aa18-e5eadb3fb5bb tempest-ImagesMetadataNegativeTestJSON-428891543 tempest-ImagesMetadataNegativeTestJSON-428891543-project] Returning 404 to user: Image not found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:18:25.162402 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c5d68a7e-23d0-4949-aa18-e5eadb3fb5bb tempest-ImagesMetadataNegativeTestJSON-428891543 tempest-ImagesMetadataNegativeTestJSON-428891543-project] 10.222.0.42 "PUT /compute/v2.1/images/56a69033-abca-4c82-a437-87de2248ff5a/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.060725 Oct 23 01:18:25.162402 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1088/2146] 10.222.0.42 () {60 vars in 1310 bytes} [Sun Oct 23 01:18:25 2022] PUT /compute/v2.1/images/56a69033-abca-4c82-a437-87de2248ff5a/metadata/os_distro => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:18:25.178405 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-dfb40afe-8f23-46fc-9386-d699c4f83515 tempest-ImagesMetadataNegativeTestJSON-428891543 tempest-ImagesMetadataNegativeTestJSON-428891543-project] Action: 'create', calling method: .version_select at 0x7f5cc62de3a0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:18:25.210890 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-dfb40afe-8f23-46fc-9386-d699c4f83515 tempest-ImagesMetadataNegativeTestJSON-428891543 tempest-ImagesMetadataNegativeTestJSON-428891543-project] HTTP exception thrown: Image not found. Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-dfb40afe-8f23-46fc-9386-d699c4f83515 tempest-ImagesMetadataNegativeTestJSON-428891543 tempest-ImagesMetadataNegativeTestJSON-428891543-project] Request method failure captured: Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/images/7bd7fbd9-628c-4660-a06c-c6d2502ad12e/metadata HTTP/1.1 Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 57 Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJZfd-wbEWdtnoKbpDUmUuTW3KhJHOb-5zFmB4GAfqcaETIVlLEWSEvRhULWCS2lSEMTzpmROGJSN-d_a9NHf7XFUnZB3Dwo_xiXUqAMwRfVFY1jS0eRKN-PCOoD-AHwn7qs2lA1sgJJsu1jgW611zWCl7OdgcBtDxwn6wpw51jlFf8 Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: b4193043521942fb82165e6542f7e1a0 Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-428891543 Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b4193043521942fb82165e6542f7e1a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b4193043521942fb82165e6542f7e1a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b4193043521942fb82165e6542f7e1a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b4193043521942fb82165e6542f7e1a0"}]}] Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-428891543 Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: b4193043521942fb82165e6542f7e1a0 Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-428891543 Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ImagesMetadataNegativeTestJSON-428891543-project Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 1c586dd247c84eb79c0cbdd81b08ecfe Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-428891543-project Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: method: Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: exception: Image not found. Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: action_args: {'image_id': '7bd7fbd9-628c-4660-a06c-c6d2502ad12e', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7bd7fbd9-628c-4660-a06c-c6d2502ad12e Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 23 01:18:25.214507 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 23 01:18:25.223478 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 23 01:18:25.223478 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 23 01:18:25.223478 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 23 01:18:25.223478 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 23 01:18:25.223478 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 23 01:18:25.223478 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 23 01:18:25.223478 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 23 01:18:25.223478 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 23 01:18:25.223478 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 23 01:18:25.223478 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 23 01:18:25.223478 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 23 01:18:25.223478 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 23 01:18:25.223478 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 23 01:18:25.223478 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 23 01:18:25.223478 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 23 01:18:25.223478 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 23 01:18:25.223478 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 23 01:18:25.223478 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 23 01:18:25.223478 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7bd7fbd9-628c-4660-a06c-c6d2502ad12e could not be found. Oct 23 01:18:25.223478 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:25.223478 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:25.223478 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:25.223478 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:25.223478 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:18:25.223478 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:18:25.223478 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:18:25.223478 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:18:25.223478 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:18:25.223478 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:18:25.223478 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:18:25.223478 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:18:25.223478 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:18:25.223478 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:18:25.223478 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 23 01:18:25.223478 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 23 01:18:25.223478 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 23 01:18:25.223478 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 23 01:18:25.223478 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 23 01:18:25.223478 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:25.223478 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:25.223478 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:25.223478 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:25.223478 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:18:25.223478 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:18:25.223478 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:18:25.223478 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:18:25.223478 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 23 01:18:25.223478 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:25.223478 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-dfb40afe-8f23-46fc-9386-d699c4f83515 tempest-ImagesMetadataNegativeTestJSON-428891543 tempest-ImagesMetadataNegativeTestJSON-428891543-project] Returning 404 to user: Image not found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:18:25.223478 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-dfb40afe-8f23-46fc-9386-d699c4f83515 tempest-ImagesMetadataNegativeTestJSON-428891543 tempest-ImagesMetadataNegativeTestJSON-428891543-project] 10.222.0.42 "POST /compute/v2.1/images/7bd7fbd9-628c-4660-a06c-c6d2502ad12e/metadata" status: 404 len: 62 microversion: 2.1 time: 0.052092 Oct 23 01:18:25.223478 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1089/2147] 10.222.0.42 () {60 vars in 1281 bytes} [Sun Oct 23 01:18:25 2022] POST /compute/v2.1/images/7bd7fbd9-628c-4660-a06c-c6d2502ad12e/metadata => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:18:25.349647 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-61821de5-60ba-4cce-ae64-04bd8fba1dd2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:25.358599 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-61821de5-60ba-4cce-ae64-04bd8fba1dd2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1391 microversion: 2.1 time: 0.243580 Oct 23 01:18:25.359298 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1059/2148] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:25 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1391 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:25.604171 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-448e130c-7d5e-4d85-92f6-5a6143157c32 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:25.605481 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-448e130c-7d5e-4d85-92f6-5a6143157c32 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: d2d33142-cf85-4a5b-b63f-e3780f8ac0b1] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:25.615776 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-448e130c-7d5e-4d85-92f6-5a6143157c32 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:25.616951 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-448e130c-7d5e-4d85-92f6-5a6143157c32 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:25.617927 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-448e130c-7d5e-4d85-92f6-5a6143157c32 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:25.619161 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-448e130c-7d5e-4d85-92f6-5a6143157c32 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:25.619888 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-448e130c-7d5e-4d85-92f6-5a6143157c32 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:25.620644 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-448e130c-7d5e-4d85-92f6-5a6143157c32 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:25.793141 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0a5db172-2719-496d-a782-3e90ecb74a49 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:25.794080 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0a5db172-2719-496d-a782-3e90ecb74a49 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 40104c3d-0e82-449a-a331-c4f6ba80afaf] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:25.827496 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0a5db172-2719-496d-a782-3e90ecb74a49 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:25.831101 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0a5db172-2719-496d-a782-3e90ecb74a49 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:25.839728 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0a5db172-2719-496d-a782-3e90ecb74a49 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:25.839728 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0a5db172-2719-496d-a782-3e90ecb74a49 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:25.839728 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0a5db172-2719-496d-a782-3e90ecb74a49 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:25.839728 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0a5db172-2719-496d-a782-3e90ecb74a49 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:25.891688 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-448e130c-7d5e-4d85-92f6-5a6143157c32 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:25.906920 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-448e130c-7d5e-4d85-92f6-5a6143157c32 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1" status: 200 len: 1317 microversion: 2.1 time: 0.308160 Oct 23 01:18:25.910792 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1090/2149] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:25 2022] GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 => generated 1317 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:25.994799 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-922669b4-64b5-4402-973b-d1cd7d44f4d1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:25.995516 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-922669b4-64b5-4402-973b-d1cd7d44f4d1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: cce77239-7b98-4389-946e-8292bf160194] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:26.163589 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-922669b4-64b5-4402-973b-d1cd7d44f4d1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:26.177841 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-922669b4-64b5-4402-973b-d1cd7d44f4d1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/cce77239-7b98-4389-946e-8292bf160194" status: 200 len: 1216 microversion: 2.1 time: 0.188062 Oct 23 01:18:26.182581 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1091/2150] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:25 2022] GET /compute/v2.1/servers/cce77239-7b98-4389-946e-8292bf160194 => generated 1216 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:26.235467 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0a5db172-2719-496d-a782-3e90ecb74a49 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:26.250517 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0a5db172-2719-496d-a782-3e90ecb74a49 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf" status: 200 len: 1497 microversion: 2.1 time: 0.459548 Oct 23 01:18:26.253505 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1060/2151] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:25 2022] GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf => generated 1497 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:26.383113 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-dfc76401-e9ed-42cd-a0b6-32f3c97ef9c0 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:26.383776 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-dfc76401-e9ed-42cd-a0b6-32f3c97ef9c0 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:26.392584 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dfc76401-e9ed-42cd-a0b6-32f3c97ef9c0 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:26.397821 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dfc76401-e9ed-42cd-a0b6-32f3c97ef9c0 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:26.403882 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dfc76401-e9ed-42cd-a0b6-32f3c97ef9c0 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:26.403882 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dfc76401-e9ed-42cd-a0b6-32f3c97ef9c0 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:26.403882 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dfc76401-e9ed-42cd-a0b6-32f3c97ef9c0 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:26.403882 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dfc76401-e9ed-42cd-a0b6-32f3c97ef9c0 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:26.661004 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-dfc76401-e9ed-42cd-a0b6-32f3c97ef9c0 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:26.670126 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-dfc76401-e9ed-42cd-a0b6-32f3c97ef9c0 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1391 microversion: 2.1 time: 0.290750 Oct 23 01:18:26.682723 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1092/2152] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:26 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1391 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:26.936094 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9971eed5-5cc3-4381-be29-f7ee0cfee120 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:26.936649 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9971eed5-5cc3-4381-be29-f7ee0cfee120 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: d2d33142-cf85-4a5b-b63f-e3780f8ac0b1] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:26.946846 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9971eed5-5cc3-4381-be29-f7ee0cfee120 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:26.947611 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9971eed5-5cc3-4381-be29-f7ee0cfee120 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:26.948464 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9971eed5-5cc3-4381-be29-f7ee0cfee120 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:26.949644 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9971eed5-5cc3-4381-be29-f7ee0cfee120 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:26.950278 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9971eed5-5cc3-4381-be29-f7ee0cfee120 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:26.951331 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9971eed5-5cc3-4381-be29-f7ee0cfee120 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:27.141188 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9971eed5-5cc3-4381-be29-f7ee0cfee120 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:27.150809 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9971eed5-5cc3-4381-be29-f7ee0cfee120 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1" status: 200 len: 1317 microversion: 2.1 time: 0.220545 Oct 23 01:18:27.158733 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1061/2153] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:26 2022] GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 => generated 1317 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:27.205195 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ebc3bcad-5413-4898-b42e-593288f90def tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:27.206517 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ebc3bcad-5413-4898-b42e-593288f90def tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: cce77239-7b98-4389-946e-8292bf160194] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:27.213506 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ebc3bcad-5413-4898-b42e-593288f90def tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:27.214016 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ebc3bcad-5413-4898-b42e-593288f90def tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:27.214460 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ebc3bcad-5413-4898-b42e-593288f90def tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:27.215163 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ebc3bcad-5413-4898-b42e-593288f90def tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:27.215618 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ebc3bcad-5413-4898-b42e-593288f90def tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:27.216041 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ebc3bcad-5413-4898-b42e-593288f90def tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:27.275555 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-204f5bbc-aa25-4fce-86d1-14f2c3891acc tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:27.294394 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-204f5bbc-aa25-4fce-86d1-14f2c3891acc tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 40104c3d-0e82-449a-a331-c4f6ba80afaf] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:27.294697 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ebc3bcad-5413-4898-b42e-593288f90def tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:27.294821 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-204f5bbc-aa25-4fce-86d1-14f2c3891acc tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:27.294821 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-204f5bbc-aa25-4fce-86d1-14f2c3891acc tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:27.294821 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-204f5bbc-aa25-4fce-86d1-14f2c3891acc tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:27.294821 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-204f5bbc-aa25-4fce-86d1-14f2c3891acc tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:27.294821 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-204f5bbc-aa25-4fce-86d1-14f2c3891acc tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:27.294821 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-204f5bbc-aa25-4fce-86d1-14f2c3891acc tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:27.295302 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ebc3bcad-5413-4898-b42e-593288f90def tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/cce77239-7b98-4389-946e-8292bf160194" status: 200 len: 1212 microversion: 2.1 time: 0.087962 Oct 23 01:18:27.295302 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1093/2154] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:27 2022] GET /compute/v2.1/servers/cce77239-7b98-4389-946e-8292bf160194 => generated 1212 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:27.436701 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-204f5bbc-aa25-4fce-86d1-14f2c3891acc tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:27.446875 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-204f5bbc-aa25-4fce-86d1-14f2c3891acc tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf" status: 200 len: 1497 microversion: 2.1 time: 0.175357 Oct 23 01:18:27.459119 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1062/2155] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:27 2022] GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf => generated 1497 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:18:27.695759 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-356dd9b8-a363-4af9-a93d-32b1d79d9c55 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:27.696426 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-356dd9b8-a363-4af9-a93d-32b1d79d9c55 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:27.703524 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-356dd9b8-a363-4af9-a93d-32b1d79d9c55 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:27.704242 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-356dd9b8-a363-4af9-a93d-32b1d79d9c55 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:27.704678 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-356dd9b8-a363-4af9-a93d-32b1d79d9c55 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:27.705722 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-356dd9b8-a363-4af9-a93d-32b1d79d9c55 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:27.706232 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-356dd9b8-a363-4af9-a93d-32b1d79d9c55 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:27.706657 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-356dd9b8-a363-4af9-a93d-32b1d79d9c55 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:27.879369 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-356dd9b8-a363-4af9-a93d-32b1d79d9c55 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:27.887547 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-356dd9b8-a363-4af9-a93d-32b1d79d9c55 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1391 microversion: 2.1 time: 0.196647 Oct 23 01:18:27.888133 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1094/2156] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:27 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1391 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:28.175244 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3f8b69d4-b37f-49c0-851e-468c3edbf403 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:28.176356 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3f8b69d4-b37f-49c0-851e-468c3edbf403 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: d2d33142-cf85-4a5b-b63f-e3780f8ac0b1] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:28.187425 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3f8b69d4-b37f-49c0-851e-468c3edbf403 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:28.189672 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3f8b69d4-b37f-49c0-851e-468c3edbf403 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:28.190624 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3f8b69d4-b37f-49c0-851e-468c3edbf403 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:28.194779 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3f8b69d4-b37f-49c0-851e-468c3edbf403 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:28.194779 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3f8b69d4-b37f-49c0-851e-468c3edbf403 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:28.194779 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3f8b69d4-b37f-49c0-851e-468c3edbf403 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:28.332268 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-dcfb07ac-e505-49f7-b804-bb95f68c8028 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:28.332993 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-dcfb07ac-e505-49f7-b804-bb95f68c8028 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: cce77239-7b98-4389-946e-8292bf160194] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:28.335118 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:28.343363 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dcfb07ac-e505-49f7-b804-bb95f68c8028 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:28.343985 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dcfb07ac-e505-49f7-b804-bb95f68c8028 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:28.344496 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dcfb07ac-e505-49f7-b804-bb95f68c8028 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:28.345492 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dcfb07ac-e505-49f7-b804-bb95f68c8028 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:28.353335 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dcfb07ac-e505-49f7-b804-bb95f68c8028 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:28.355441 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dcfb07ac-e505-49f7-b804-bb95f68c8028 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:28.584367 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-dcfb07ac-e505-49f7-b804-bb95f68c8028 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:28.595476 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-dcfb07ac-e505-49f7-b804-bb95f68c8028 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/cce77239-7b98-4389-946e-8292bf160194" status: 200 len: 1268 microversion: 2.1 time: 0.267470 Oct 23 01:18:28.599412 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1095/2157] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:28 2022] GET /compute/v2.1/servers/cce77239-7b98-4389-946e-8292bf160194 => generated 1268 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:18:28.609775 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3645af8d-92ac-4d85-be38-4c97562bcc36 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:28.613557 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3645af8d-92ac-4d85-be38-4c97562bcc36 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 40104c3d-0e82-449a-a331-c4f6ba80afaf] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:28.629837 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3645af8d-92ac-4d85-be38-4c97562bcc36 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:28.630405 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3645af8d-92ac-4d85-be38-4c97562bcc36 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:28.630994 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3645af8d-92ac-4d85-be38-4c97562bcc36 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:28.632489 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3645af8d-92ac-4d85-be38-4c97562bcc36 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:28.633417 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3645af8d-92ac-4d85-be38-4c97562bcc36 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:28.634479 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3645af8d-92ac-4d85-be38-4c97562bcc36 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:28.647731 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3f8b69d4-b37f-49c0-851e-468c3edbf403 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:28.658588 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3f8b69d4-b37f-49c0-851e-468c3edbf403 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1" status: 200 len: 1317 microversion: 2.1 time: 0.488033 Oct 23 01:18:28.669492 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1063/2158] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:28 2022] GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 => generated 1317 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:28.669492 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-b0e98902-ed1f-42ae-afd8-fedad0b135a9 req-eb87a242-afd2-4b41-b02f-d2b56ec287e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2d33142-cf85-4a5b-b63f-e3780f8ac0b1", "tag": "c671ef64-d392-46ae-a693-c9bcda7c8160"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:18:28.673560 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-b0e98902-ed1f-42ae-afd8-fedad0b135a9 req-eb87a242-afd2-4b41-b02f-d2b56ec287e4 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:28.674339 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-b0e98902-ed1f-42ae-afd8-fedad0b135a9 req-eb87a242-afd2-4b41-b02f-d2b56ec287e4 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:28.674952 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-b0e98902-ed1f-42ae-afd8-fedad0b135a9 req-eb87a242-afd2-4b41-b02f-d2b56ec287e4 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:28.698316 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-b0e98902-ed1f-42ae-afd8-fedad0b135a9 req-eb87a242-afd2-4b41-b02f-d2b56ec287e4 service nova] Creating event network-changed:c671ef64-d392-46ae-a693-c9bcda7c8160 for instance d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 on n-h2-master-1 Oct 23 01:18:28.703872 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-b0e98902-ed1f-42ae-afd8-fedad0b135a9 req-eb87a242-afd2-4b41-b02f-d2b56ec287e4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043006 Oct 23 01:18:28.704696 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1064/2159] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:18:28.844563 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3645af8d-92ac-4d85-be38-4c97562bcc36 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:28.865727 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3645af8d-92ac-4d85-be38-4c97562bcc36 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf" status: 200 len: 1497 microversion: 2.1 time: 0.264873 Oct 23 01:18:28.866831 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1096/2160] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:28 2022] GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf => generated 1497 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:28.920881 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7684dd83-7cf0-4289-9cb4-c4965f5b67bf tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:28.920881 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7684dd83-7cf0-4289-9cb4-c4965f5b67bf tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:28.936920 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7684dd83-7cf0-4289-9cb4-c4965f5b67bf tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:28.937497 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7684dd83-7cf0-4289-9cb4-c4965f5b67bf tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:28.937949 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7684dd83-7cf0-4289-9cb4-c4965f5b67bf tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:28.938713 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7684dd83-7cf0-4289-9cb4-c4965f5b67bf tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:28.939182 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7684dd83-7cf0-4289-9cb4-c4965f5b67bf tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:28.939659 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7684dd83-7cf0-4289-9cb4-c4965f5b67bf tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:29.217676 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7684dd83-7cf0-4289-9cb4-c4965f5b67bf tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:29.238615 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7684dd83-7cf0-4289-9cb4-c4965f5b67bf tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1391 microversion: 2.1 time: 0.323721 Oct 23 01:18:29.240402 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1065/2161] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:28 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1391 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:29.626062 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f72c016b-8949-4a5a-b999-9ee7365a3cdf tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:29.626992 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f72c016b-8949-4a5a-b999-9ee7365a3cdf tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: cce77239-7b98-4389-946e-8292bf160194] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:29.639973 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f72c016b-8949-4a5a-b999-9ee7365a3cdf tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:29.646676 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f72c016b-8949-4a5a-b999-9ee7365a3cdf tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:29.646676 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f72c016b-8949-4a5a-b999-9ee7365a3cdf tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:29.646676 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f72c016b-8949-4a5a-b999-9ee7365a3cdf tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:29.646676 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f72c016b-8949-4a5a-b999-9ee7365a3cdf tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:29.646676 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f72c016b-8949-4a5a-b999-9ee7365a3cdf tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:29.690668 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dfe7f9b0-a86f-463e-bcdd-bf66b63466a0 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:29.693665 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-dfe7f9b0-a86f-463e-bcdd-bf66b63466a0 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: d2d33142-cf85-4a5b-b63f-e3780f8ac0b1] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:29.720423 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dfe7f9b0-a86f-463e-bcdd-bf66b63466a0 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:29.723828 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dfe7f9b0-a86f-463e-bcdd-bf66b63466a0 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:29.727064 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dfe7f9b0-a86f-463e-bcdd-bf66b63466a0 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:29.754339 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dfe7f9b0-a86f-463e-bcdd-bf66b63466a0 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:29.754339 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dfe7f9b0-a86f-463e-bcdd-bf66b63466a0 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:29.754339 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dfe7f9b0-a86f-463e-bcdd-bf66b63466a0 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:29.826497 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=4 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:29.836713 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f72c016b-8949-4a5a-b999-9ee7365a3cdf tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:29.843732 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=100 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:29.859789 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f72c016b-8949-4a5a-b999-9ee7365a3cdf tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/cce77239-7b98-4389-946e-8292bf160194" status: 200 len: 1286 microversion: 2.1 time: 0.227295 Oct 23 01:18:29.862523 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1097/2162] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:29 2022] GET /compute/v2.1/servers/cce77239-7b98-4389-946e-8292bf160194 => generated 1286 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:29.888569 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-59365356-840a-47db-b853-4c523f467baf tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:29.892578 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-59365356-840a-47db-b853-4c523f467baf tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 40104c3d-0e82-449a-a331-c4f6ba80afaf] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:29.903067 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-59365356-840a-47db-b853-4c523f467baf tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:29.906812 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-59365356-840a-47db-b853-4c523f467baf tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:29.907514 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-59365356-840a-47db-b853-4c523f467baf tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:29.913414 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-59365356-840a-47db-b853-4c523f467baf tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:29.915623 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-59365356-840a-47db-b853-4c523f467baf tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:29.921000 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-59365356-840a-47db-b853-4c523f467baf tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:30.105496 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-dfe7f9b0-a86f-463e-bcdd-bf66b63466a0 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:30.118267 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-dfe7f9b0-a86f-463e-bcdd-bf66b63466a0 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1" status: 200 len: 1317 microversion: 2.1 time: 0.436956 Oct 23 01:18:30.135583 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1066/2163] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:29 2022] GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 => generated 1317 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:30.165964 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-59365356-840a-47db-b853-4c523f467baf tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:30.173117 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-59365356-840a-47db-b853-4c523f467baf tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf" status: 200 len: 1497 microversion: 2.1 time: 0.288391 Oct 23 01:18:30.174758 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1098/2164] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:29 2022] GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf => generated 1497 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:30.287285 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fba4f65e-12b6-488e-a57a-8218500d1273 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:30.287992 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-fba4f65e-12b6-488e-a57a-8218500d1273 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:30.325126 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fba4f65e-12b6-488e-a57a-8218500d1273 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:30.326070 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fba4f65e-12b6-488e-a57a-8218500d1273 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:30.328875 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fba4f65e-12b6-488e-a57a-8218500d1273 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:30.333292 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fba4f65e-12b6-488e-a57a-8218500d1273 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:30.334079 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fba4f65e-12b6-488e-a57a-8218500d1273 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:30.334531 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fba4f65e-12b6-488e-a57a-8218500d1273 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:30.563007 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-fba4f65e-12b6-488e-a57a-8218500d1273 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:30.570197 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e7e8dc68-9d44-4ac2-b40c-769187144740 tempest-TenantUsagesNegativeTestJSON-2121302310 tempest-TenantUsagesNegativeTestJSON-2121302310-project-admin] 10.222.0.42 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-22T01%3A18%3A29.907564&end=2022-10-24T01%3A18%3A29.907564" status: 404 len: 112 microversion: - time: 0.432619 Oct 23 01:18:30.573631 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fba4f65e-12b6-488e-a57a-8218500d1273 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1391 microversion: 2.1 time: 0.311294 Oct 23 01:18:30.574108 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1067/2165] 10.222.0.42 () {58 vars in 1316 bytes} [Sun Oct 23 01:18:30 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-22T01%3A18%3A29.907564&end=2022-10-24T01%3A18%3A29.907564 => generated 112 bytes in 438 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 23 01:18:30.582000 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1099/2166] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:30 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1391 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:30.587659 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9474b14f-1d2d-4fd9-9d9b-d689b1bdf293 tempest-TenantUsagesNegativeTestJSON-2121302310 tempest-TenantUsagesNegativeTestJSON-2121302310-project-admin] Calling method '.version_select at 0x7f5cc1e80ee0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:30.593597 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-9474b14f-1d2d-4fd9-9d9b-d689b1bdf293 tempest-TenantUsagesNegativeTestJSON-2121302310 tempest-TenantUsagesNegativeTestJSON-2121302310-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9474b14f-1d2d-4fd9-9d9b-d689b1bdf293 tempest-TenantUsagesNegativeTestJSON-2121302310 tempest-TenantUsagesNegativeTestJSON-2121302310-project-admin] Request method failure captured: Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/os-simple-tenant-usage/6039c024774e4b92a4765ffea4d77094?start=2022-10-24T01%3A18%3A29.907564&end=2022-10-22T01%3A18%3A29.907564 HTTP/1.1 Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJZlo-mvIvDEIFMRvC-40NupbTJhM8h1uKnGP9Wu8jz0cC-_QxrD-23nQuqwV87ttZ05ARx3MzcFiuxgwNDSHBelkv_S6OAh49XTTfsKMlMNRdaUI9vLkQym6CS1o4HbwNEPhk2xo48sct33hONlSG4zknM02crC1gGxBuA401Pm4q4 Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: a35fe7040e814522bad95df1c2072dba Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-2121302310 Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,admin,reader Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,admin,reader Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a35fe7040e814522bad95df1c2072dba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a35fe7040e814522bad95df1c2072dba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a35fe7040e814522bad95df1c2072dba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a35fe7040e814522bad95df1c2072dba"}]}] Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-2121302310 Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: a35fe7040e814522bad95df1c2072dba Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-2121302310 Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-TenantUsagesNegativeTestJSON-2121302310-project-admin Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 199e1efcbb724f45b875b678e1be14d2 Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-2121302310-project-admin Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: method: Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: exception: Invalid start time. The start time cannot occur after the end time. Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '6039c024774e4b92a4765ffea4d77094'} Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 23 01:18:30.603841 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:18:30.619411 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9474b14f-1d2d-4fd9-9d9b-d689b1bdf293 tempest-TenantUsagesNegativeTestJSON-2121302310 tempest-TenantUsagesNegativeTestJSON-2121302310-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:18:30.619411 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9474b14f-1d2d-4fd9-9d9b-d689b1bdf293 tempest-TenantUsagesNegativeTestJSON-2121302310 tempest-TenantUsagesNegativeTestJSON-2121302310-project-admin] 10.222.0.42 "GET /compute/v2.1/os-simple-tenant-usage/6039c024774e4b92a4765ffea4d77094?start=2022-10-24T01%3A18%3A29.907564&end=2022-10-22T01%3A18%3A29.907564" status: 400 len: 111 microversion: 2.1 time: 0.025681 Oct 23 01:18:30.619411 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1068/2167] 10.222.0.42 () {58 vars in 1412 bytes} [Sun Oct 23 01:18:30 2022] GET /compute/v2.1/os-simple-tenant-usage/6039c024774e4b92a4765ffea4d77094?start=2022-10-24T01%3A18%3A29.907564&end=2022-10-22T01%3A18%3A29.907564 => generated 111 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:18:30.844410 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5e1230d4-ae51-4f50-a455-ea18abfcc823 tempest-TenantUsagesNegativeTestJSON-1491835649 tempest-TenantUsagesNegativeTestJSON-1491835649-project] Calling method '.version_select at 0x7f5cc6274550>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:30.851614 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5e1230d4-ae51-4f50-a455-ea18abfcc823 tempest-TenantUsagesNegativeTestJSON-1491835649 tempest-TenantUsagesNegativeTestJSON-1491835649-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '582a76898d8c4d8f87a81dba9ce12a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6039c024774e4b92a4765ffea4d77094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5e1230d4-ae51-4f50-a455-ea18abfcc823 tempest-TenantUsagesNegativeTestJSON-1491835649 tempest-TenantUsagesNegativeTestJSON-1491835649-project] Request method failure captured: Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-22T01%3A18%3A29.907564&end=2022-10-24T01%3A18%3A29.907564&detailed=1 HTTP/1.1 Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJZiM7_0wX1b3ufH1iOjClNdArlnj0yMXlG55VW1Zu5AJIGsZbCP0CqULF5VKbmfZalMzEOcgyHPUF4gnYoTpeFX6n5N1YsYQnOmRMuF1arNRXWc9W-UogNC_RZrwyYr4toclxNWc4sOiS1FxI08j0Py6QiICnrFJmgu-sS9A4m_-RE Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 6039c024774e4b92a4765ffea4d77094 Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1491835649 Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6039c024774e4b92a4765ffea4d77094"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6039c024774e4b92a4765ffea4d77094"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6039c024774e4b92a4765ffea4d77094"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6039c024774e4b92a4765ffea4d77094"}]}] Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1491835649 Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 6039c024774e4b92a4765ffea4d77094 Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1491835649 Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-TenantUsagesNegativeTestJSON-1491835649-project Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 582a76898d8c4d8f87a81dba9ce12a15 Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1491835649-project Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: method: Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: action_args: {} Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise self.value Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 23 01:18:30.856183 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 23 01:18:30.865356 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 23 01:18:30.865356 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 23 01:18:30.865356 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:30.865356 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:30.865356 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:30.865356 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:30.865356 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:18:30.865356 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:18:30.865356 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 23 01:18:30.865356 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 23 01:18:30.865356 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 23 01:18:30.865356 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:30.873932 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5e1230d4-ae51-4f50-a455-ea18abfcc823 tempest-TenantUsagesNegativeTestJSON-1491835649 tempest-TenantUsagesNegativeTestJSON-1491835649-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:18:30.873932 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5e1230d4-ae51-4f50-a455-ea18abfcc823 tempest-TenantUsagesNegativeTestJSON-1491835649 tempest-TenantUsagesNegativeTestJSON-1491835649-project] 10.222.0.42 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-22T01%3A18%3A29.907564&end=2022-10-24T01%3A18%3A29.907564&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.253398 Oct 23 01:18:30.873932 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1100/2168] 10.222.0.42 () {58 vars in 1335 bytes} [Sun Oct 23 01:18:30 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-22T01%3A18%3A29.907564&end=2022-10-24T01%3A18%3A29.907564&detailed=1 => generated 123 bytes in 255 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:18:30.899435 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4e89503b-64fe-4f3b-93c4-81cf68f2350f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:30.899435 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4e89503b-64fe-4f3b-93c4-81cf68f2350f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: cce77239-7b98-4389-946e-8292bf160194] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:30.900981 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4e89503b-64fe-4f3b-93c4-81cf68f2350f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:30.901650 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4e89503b-64fe-4f3b-93c4-81cf68f2350f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:30.902454 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4e89503b-64fe-4f3b-93c4-81cf68f2350f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:30.903808 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4e89503b-64fe-4f3b-93c4-81cf68f2350f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:30.904333 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4e89503b-64fe-4f3b-93c4-81cf68f2350f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:30.904935 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4e89503b-64fe-4f3b-93c4-81cf68f2350f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:30.995341 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4e89503b-64fe-4f3b-93c4-81cf68f2350f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:31.004927 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4e89503b-64fe-4f3b-93c4-81cf68f2350f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/cce77239-7b98-4389-946e-8292bf160194" status: 200 len: 1274 microversion: 2.1 time: 0.124316 Oct 23 01:18:31.005502 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1069/2169] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:30 2022] GET /compute/v2.1/servers/cce77239-7b98-4389-946e-8292bf160194 => generated 1274 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:31.144794 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5985660d-dfb7-4bc3-a4d3-b2ad9de5457c tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:31.146184 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5985660d-dfb7-4bc3-a4d3-b2ad9de5457c tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: d2d33142-cf85-4a5b-b63f-e3780f8ac0b1] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:31.180295 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5985660d-dfb7-4bc3-a4d3-b2ad9de5457c tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:31.181296 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5985660d-dfb7-4bc3-a4d3-b2ad9de5457c tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:31.182080 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5985660d-dfb7-4bc3-a4d3-b2ad9de5457c tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:31.185145 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5985660d-dfb7-4bc3-a4d3-b2ad9de5457c tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:31.186427 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5985660d-dfb7-4bc3-a4d3-b2ad9de5457c tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:31.187185 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5985660d-dfb7-4bc3-a4d3-b2ad9de5457c tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:31.201486 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-76d06911-1131-4e99-a06d-915cfa375585 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:31.202193 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-76d06911-1131-4e99-a06d-915cfa375585 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 40104c3d-0e82-449a-a331-c4f6ba80afaf] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:31.235757 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-76d06911-1131-4e99-a06d-915cfa375585 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:31.238083 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-76d06911-1131-4e99-a06d-915cfa375585 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:31.238083 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-76d06911-1131-4e99-a06d-915cfa375585 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:31.238083 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-76d06911-1131-4e99-a06d-915cfa375585 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:31.247367 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-76d06911-1131-4e99-a06d-915cfa375585 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:31.247916 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-76d06911-1131-4e99-a06d-915cfa375585 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:31.537652 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5985660d-dfb7-4bc3-a4d3-b2ad9de5457c tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:31.549937 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5985660d-dfb7-4bc3-a4d3-b2ad9de5457c tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1" status: 200 len: 1317 microversion: 2.1 time: 0.410388 Oct 23 01:18:31.552202 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1101/2170] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:31 2022] GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 => generated 1317 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:31.584535 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-76d06911-1131-4e99-a06d-915cfa375585 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:31.592924 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-76d06911-1131-4e99-a06d-915cfa375585 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf" status: 200 len: 1497 microversion: 2.1 time: 0.396054 Oct 23 01:18:31.593502 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1070/2171] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:31 2022] GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf => generated 1497 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:31.609370 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e3c68896-9648-4e84-b9a2-85d5a499c6fb tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:31.619604 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e3c68896-9648-4e84-b9a2-85d5a499c6fb tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:31.633963 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e3c68896-9648-4e84-b9a2-85d5a499c6fb tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:31.636465 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e3c68896-9648-4e84-b9a2-85d5a499c6fb tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:31.636918 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e3c68896-9648-4e84-b9a2-85d5a499c6fb tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:31.637717 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e3c68896-9648-4e84-b9a2-85d5a499c6fb tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:31.638136 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e3c68896-9648-4e84-b9a2-85d5a499c6fb tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:31.641421 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e3c68896-9648-4e84-b9a2-85d5a499c6fb tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:31.913443 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e3c68896-9648-4e84-b9a2-85d5a499c6fb tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:31.933784 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e3c68896-9648-4e84-b9a2-85d5a499c6fb tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1391 microversion: 2.1 time: 0.328733 Oct 23 01:18:31.936986 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1071/2172] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:31 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1391 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:32.029860 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8ed6ae1f-ffc2-493d-9c16-eafb5274a221 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:32.030582 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8ed6ae1f-ffc2-493d-9c16-eafb5274a221 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: cce77239-7b98-4389-946e-8292bf160194] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:32.044411 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ed6ae1f-ffc2-493d-9c16-eafb5274a221 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:32.045517 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ed6ae1f-ffc2-493d-9c16-eafb5274a221 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:32.046952 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ed6ae1f-ffc2-493d-9c16-eafb5274a221 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:32.049904 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ed6ae1f-ffc2-493d-9c16-eafb5274a221 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:32.051430 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ed6ae1f-ffc2-493d-9c16-eafb5274a221 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:32.053152 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ed6ae1f-ffc2-493d-9c16-eafb5274a221 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:32.109569 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d0c084ba-7a95-4738-b972-0bd35f219fb3 tempest-KeyPairsV2TestJSON-476293209 tempest-KeyPairsV2TestJSON-476293209-project] Action: 'create', calling method: .version_select at 0x7f5cc62749d0>, body: {"keypair": {"name": "tempest-keypair-1241858550", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkzvhnUZ8ioOXgbLO6QRlmC66Iht3YXOMVzJawdycDllRtc6OdiufBUkXJ4LuFHdPMedeLJWOR8lu37lYU7NGuMcoJAmswtrOKFs/GYJdUF7U37dd6xeieBj23+bb3I+A=="}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:18:32.139750 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-d0c084ba-7a95-4738-b972-0bd35f219fb3 tempest-KeyPairsV2TestJSON-476293209 tempest-KeyPairsV2TestJSON-476293209-project] Getting quotas for project 38e182b74ee248a691cce4f31d5d24a1. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:18:32.146508 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-d0c084ba-7a95-4738-b972-0bd35f219fb3 tempest-KeyPairsV2TestJSON-476293209 tempest-KeyPairsV2TestJSON-476293209-project] Getting quotas for user 2ef087421d544ed1b56f73e64db80edb and project 38e182b74ee248a691cce4f31d5d24a1. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:18:32.302649 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d0c084ba-7a95-4738-b972-0bd35f219fb3 tempest-KeyPairsV2TestJSON-476293209 tempest-KeyPairsV2TestJSON-476293209-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.748536 Oct 23 01:18:32.303530 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1102/2173] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 01:18:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:18:32.316160 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-de6a6b7b-0d89-4906-9cb0-42adb570bf34 tempest-KeyPairsV2TestJSON-476293209 tempest-KeyPairsV2TestJSON-476293209-project] Calling method '.version_select at 0x7f5cc26ae4c0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:32.355117 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-de6a6b7b-0d89-4906-9cb0-42adb570bf34 tempest-KeyPairsV2TestJSON-476293209 tempest-KeyPairsV2TestJSON-476293209-project] 10.222.0.42 "GET /compute/v2.1/os-keypairs/tempest-keypair-1241858550" status: 200 len: 497 microversion: 2.1 time: 0.044849 Oct 23 01:18:32.367668 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1103/2174] 10.222.0.42 () {58 vars in 1218 bytes} [Sun Oct 23 01:18:32 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1241858550 => generated 497 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:18:32.373413 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1af4e566-c200-4803-9fc1-2eceb75920c5 tempest-KeyPairsV2TestJSON-476293209 tempest-KeyPairsV2TestJSON-476293209-project] Calling method '.version_select at 0x7f5cc6205700>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:32.536128 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1af4e566-c200-4803-9fc1-2eceb75920c5 tempest-KeyPairsV2TestJSON-476293209 tempest-KeyPairsV2TestJSON-476293209-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1241858550" status: 202 len: 0 microversion: 2.1 time: 0.166787 Oct 23 01:18:32.537022 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1104/2175] 10.222.0.42 () {58 vars in 1221 bytes} [Sun Oct 23 01:18:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1241858550 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:18:32.550179 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6728d188-2681-4bb9-9f33-105fbd12e962 tempest-KeyPairsV2TestJSON-476293209 tempest-KeyPairsV2TestJSON-476293209-project] Action: 'create', calling method: .version_select at 0x7f5cc6211ca0>, body: {"keypair": {"name": "tempest-keypair-432090448", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxJ59O+iNajnuQzf5wDtWVQ1olcOZipifa5FKsRpgRmzAX4a5UkLLWXkzNf6Xfoda1XGlCAeI6jcYfKwO+HUCOEtH+A8hoZVbPqXH2RhSGK3DMa/cdJ4L8KRSc0OBSCkQ=="}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:18:32.558533 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8ed6ae1f-ffc2-493d-9c16-eafb5274a221 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:32.578046 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8ed6ae1f-ffc2-493d-9c16-eafb5274a221 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/cce77239-7b98-4389-946e-8292bf160194" status: 200 len: 1316 microversion: 2.1 time: 0.550267 Oct 23 01:18:32.588693 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-6728d188-2681-4bb9-9f33-105fbd12e962 tempest-KeyPairsV2TestJSON-476293209 tempest-KeyPairsV2TestJSON-476293209-project] Getting quotas for project 38e182b74ee248a691cce4f31d5d24a1. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:18:32.597333 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1072/2176] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:32 2022] GET /compute/v2.1/servers/cce77239-7b98-4389-946e-8292bf160194 => generated 1316 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:18:32.607931 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-6728d188-2681-4bb9-9f33-105fbd12e962 tempest-KeyPairsV2TestJSON-476293209 tempest-KeyPairsV2TestJSON-476293209-project] Getting quotas for user 2ef087421d544ed1b56f73e64db80edb and project 38e182b74ee248a691cce4f31d5d24a1. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:18:32.608299 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-56d6e20d-cc6d-48df-b22b-8462b784bfa9 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:32.609308 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-56d6e20d-cc6d-48df-b22b-8462b784bfa9 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: d2d33142-cf85-4a5b-b63f-e3780f8ac0b1] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:32.617922 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-56d6e20d-cc6d-48df-b22b-8462b784bfa9 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:32.618797 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-56d6e20d-cc6d-48df-b22b-8462b784bfa9 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:32.619435 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-56d6e20d-cc6d-48df-b22b-8462b784bfa9 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:32.620414 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-56d6e20d-cc6d-48df-b22b-8462b784bfa9 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:32.621514 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-56d6e20d-cc6d-48df-b22b-8462b784bfa9 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:32.623344 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-56d6e20d-cc6d-48df-b22b-8462b784bfa9 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:32.758728 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6728d188-2681-4bb9-9f33-105fbd12e962 tempest-KeyPairsV2TestJSON-476293209 tempest-KeyPairsV2TestJSON-476293209-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.213471 Oct 23 01:18:32.765127 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1105/2177] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 01:18:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:18:32.765127 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bd10cdc8-d02a-456d-979c-d62ce1fc451e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:32.765127 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-bd10cdc8-d02a-456d-979c-d62ce1fc451e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 40104c3d-0e82-449a-a331-c4f6ba80afaf] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:32.779074 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd10cdc8-d02a-456d-979c-d62ce1fc451e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:32.782356 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd10cdc8-d02a-456d-979c-d62ce1fc451e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:32.782993 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd10cdc8-d02a-456d-979c-d62ce1fc451e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:32.784165 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd10cdc8-d02a-456d-979c-d62ce1fc451e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:32.784633 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd10cdc8-d02a-456d-979c-d62ce1fc451e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:32.785059 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd10cdc8-d02a-456d-979c-d62ce1fc451e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:33.039999 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-56d6e20d-cc6d-48df-b22b-8462b784bfa9 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:33.051677 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-56d6e20d-cc6d-48df-b22b-8462b784bfa9 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1" status: 200 len: 1317 microversion: 2.1 time: 0.448067 Oct 23 01:18:33.064346 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1073/2178] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:32 2022] GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 => generated 1317 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:33.073739 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a929a8c0-287c-44fb-8ca1-818d9644e1b8 tempest-KeyPairsV2TestJSON-476293209 tempest-KeyPairsV2TestJSON-476293209-project] Calling method '.version_select at 0x7f5cc172d040>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:33.138298 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bd10cdc8-d02a-456d-979c-d62ce1fc451e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:33.152045 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bd10cdc8-d02a-456d-979c-d62ce1fc451e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf" status: 200 len: 1497 microversion: 2.1 time: 0.391302 Oct 23 01:18:33.166883 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1106/2179] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:32 2022] GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf => generated 1497 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:33.290772 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a929a8c0-287c-44fb-8ca1-818d9644e1b8 tempest-KeyPairsV2TestJSON-476293209 tempest-KeyPairsV2TestJSON-476293209-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-432090448" status: 202 len: 0 microversion: 2.1 time: 0.224604 Oct 23 01:18:33.297893 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1074/2180] 10.222.0.42 () {58 vars in 1218 bytes} [Sun Oct 23 01:18:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-432090448 => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:18:33.303812 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0becef65-efe2-4d08-9d9d-df9b62a6f42f tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-230902408", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:18:33.304591 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fe26e9d0-cf1a-45c5-975f-c428e057b3d3 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:33.305437 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fe26e9d0-cf1a-45c5-975f-c428e057b3d3 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:33.315634 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe26e9d0-cf1a-45c5-975f-c428e057b3d3 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:33.316385 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe26e9d0-cf1a-45c5-975f-c428e057b3d3 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:33.320147 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe26e9d0-cf1a-45c5-975f-c428e057b3d3 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:33.320147 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe26e9d0-cf1a-45c5-975f-c428e057b3d3 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:33.320147 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe26e9d0-cf1a-45c5-975f-c428e057b3d3 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:33.320147 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe26e9d0-cf1a-45c5-975f-c428e057b3d3 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:33.395861 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-0becef65-efe2-4d08-9d9d-df9b62a6f42f tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] validate_networks() for None {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:18:33.874630 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fe26e9d0-cf1a-45c5-975f-c428e057b3d3 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:33.891709 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fe26e9d0-cf1a-45c5-975f-c428e057b3d3 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1391 microversion: 2.1 time: 0.590690 Oct 23 01:18:33.894761 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1075/2181] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:33 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1391 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:33.903913 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c1f97312-7ff9-4196-8200-80b94a1b51fb tempest-KeyPairsV2TestJSON-476293209 tempest-KeyPairsV2TestJSON-476293209-project] Action: 'create', calling method: .version_select at 0x7f5cc2201ca0>, body: {"keypair": {"name": "tempest-keypair-1855856170", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:18:33.954921 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-c1f97312-7ff9-4196-8200-80b94a1b51fb tempest-KeyPairsV2TestJSON-476293209 tempest-KeyPairsV2TestJSON-476293209-project] Getting quotas for project 38e182b74ee248a691cce4f31d5d24a1. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:18:33.969933 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-c1f97312-7ff9-4196-8200-80b94a1b51fb tempest-KeyPairsV2TestJSON-476293209 tempest-KeyPairsV2TestJSON-476293209-project] Getting quotas for user 2ef087421d544ed1b56f73e64db80edb and project 38e182b74ee248a691cce4f31d5d24a1. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:18:34.075680 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c1f97312-7ff9-4196-8200-80b94a1b51fb tempest-KeyPairsV2TestJSON-476293209 tempest-KeyPairsV2TestJSON-476293209-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.179398 Oct 23 01:18:34.077889 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1076/2182] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 01:18:33 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:18:34.081060 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-9ca1115b-240e-45af-83bc-6243a240d010 req-1b5b4071-5780-4d1a-a701-6956c7507302 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cce77239-7b98-4389-946e-8292bf160194", "tag": "aac9c20f-b1fa-4122-a799-18f1a928951f"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:18:34.091354 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-9ca1115b-240e-45af-83bc-6243a240d010 req-1b5b4071-5780-4d1a-a701-6956c7507302 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:34.095173 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-9ca1115b-240e-45af-83bc-6243a240d010 req-1b5b4071-5780-4d1a-a701-6956c7507302 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:34.095173 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-9ca1115b-240e-45af-83bc-6243a240d010 req-1b5b4071-5780-4d1a-a701-6956c7507302 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:34.103261 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-9ca1115b-240e-45af-83bc-6243a240d010 req-1b5b4071-5780-4d1a-a701-6956c7507302 service nova] Creating event network-changed:aac9c20f-b1fa-4122-a799-18f1a928951f for instance cce77239-7b98-4389-946e-8292bf160194 on n-h1-master-1 Oct 23 01:18:34.109019 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-9ca1115b-240e-45af-83bc-6243a240d010 req-1b5b4071-5780-4d1a-a701-6956c7507302 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031393 Oct 23 01:18:34.109927 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1077/2183] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:18:34.116032 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-10579503-b9c3-4db3-bb97-4d236e8c13b5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:34.120204 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-10579503-b9c3-4db3-bb97-4d236e8c13b5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: cce77239-7b98-4389-946e-8292bf160194] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:34.123853 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-10579503-b9c3-4db3-bb97-4d236e8c13b5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:34.125952 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-10579503-b9c3-4db3-bb97-4d236e8c13b5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:34.126542 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-10579503-b9c3-4db3-bb97-4d236e8c13b5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:34.127868 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-10579503-b9c3-4db3-bb97-4d236e8c13b5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:34.128343 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-10579503-b9c3-4db3-bb97-4d236e8c13b5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:34.128765 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-10579503-b9c3-4db3-bb97-4d236e8c13b5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:34.166417 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-0becef65-efe2-4d08-9d9d-df9b62a6f42f tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:18:34.166417 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-0becef65-efe2-4d08-9d9d-df9b62a6f42f tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:18:34.166417 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-0becef65-efe2-4d08-9d9d-df9b62a6f42f tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:18:34.166417 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-0becef65-efe2-4d08-9d9d-df9b62a6f42f tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:18:34.166417 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-0becef65-efe2-4d08-9d9d-df9b62a6f42f tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:18:34.181500 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0becef65-efe2-4d08-9d9d-df9b62a6f42f tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:34.182059 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0becef65-efe2-4d08-9d9d-df9b62a6f42f tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:34.182731 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0becef65-efe2-4d08-9d9d-df9b62a6f42f tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:34.183648 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0becef65-efe2-4d08-9d9d-df9b62a6f42f tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:34.184285 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0becef65-efe2-4d08-9d9d-df9b62a6f42f tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:34.194827 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0becef65-efe2-4d08-9d9d-df9b62a6f42f tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:34.234745 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-0becef65-efe2-4d08-9d9d-df9b62a6f42f tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Getting quotas for project bcdabdb037d54103a656623e2c4c4a78. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:18:34.242914 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-0becef65-efe2-4d08-9d9d-df9b62a6f42f tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Getting quotas for user 8417cd8a252c4d3c9f2059c42bc82aa0 and project bcdabdb037d54103a656623e2c4c4a78. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:18:34.260388 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0becef65-efe2-4d08-9d9d-df9b62a6f42f tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:18:34.263297 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0becef65-efe2-4d08-9d9d-df9b62a6f42f tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] [instance: afd593c3-d69a-4d5d-81b9-15a3138378ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:18:34.411024 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-10579503-b9c3-4db3-bb97-4d236e8c13b5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:34.416397 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0becef65-efe2-4d08-9d9d-df9b62a6f42f tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.260861 Oct 23 01:18:34.417664 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1107/2184] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:18:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1263 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:18:34.422726 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7a822961-33e8-4654-8616-bcbf9208364f tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:34.425311 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7a822961-33e8-4654-8616-bcbf9208364f tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: d2d33142-cf85-4a5b-b63f-e3780f8ac0b1] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:34.433775 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a822961-33e8-4654-8616-bcbf9208364f tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:34.434614 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a822961-33e8-4654-8616-bcbf9208364f tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:34.435240 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a822961-33e8-4654-8616-bcbf9208364f tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:34.436292 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a822961-33e8-4654-8616-bcbf9208364f tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:34.437481 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a822961-33e8-4654-8616-bcbf9208364f tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:34.438114 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a822961-33e8-4654-8616-bcbf9208364f tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:34.438249 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-10579503-b9c3-4db3-bb97-4d236e8c13b5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/cce77239-7b98-4389-946e-8292bf160194" status: 200 len: 1316 microversion: 2.1 time: 0.323825 Oct 23 01:18:34.439057 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1078/2185] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:34 2022] GET /compute/v2.1/servers/cce77239-7b98-4389-946e-8292bf160194 => generated 1316 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:34.452329 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dc3fa4c0-7a77-4f0b-9ec0-0a45a1e5785e tempest-KeyPairsV2TestJSON-476293209 tempest-KeyPairsV2TestJSON-476293209-project] Calling method '.version_select at 0x7f5cc62864c0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:34.604179 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7a822961-33e8-4654-8616-bcbf9208364f tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:34.614285 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7a822961-33e8-4654-8616-bcbf9208364f tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1" status: 200 len: 1317 microversion: 2.1 time: 0.195319 Oct 23 01:18:34.615976 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-dc3fa4c0-7a77-4f0b-9ec0-0a45a1e5785e tempest-KeyPairsV2TestJSON-476293209 tempest-KeyPairsV2TestJSON-476293209-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1855856170" status: 202 len: 0 microversion: 2.1 time: 0.173733 Oct 23 01:18:34.617027 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1079/2186] 10.222.0.42 () {58 vars in 1221 bytes} [Sun Oct 23 01:18:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1855856170 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:18:34.626813 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ad8f7910-2810-4e21-a885-c97814f06e8d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:34.627886 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1108/2187] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:34 2022] GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 => generated 1317 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:34.629769 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ad8f7910-2810-4e21-a885-c97814f06e8d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 40104c3d-0e82-449a-a331-c4f6ba80afaf] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:34.643384 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bfccf7f0-6940-4859-ac51-c43949e1c324 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:34.643384 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-bfccf7f0-6940-4859-ac51-c43949e1c324 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] [instance: afd593c3-d69a-4d5d-81b9-15a3138378ae] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:34.643925 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ad8f7910-2810-4e21-a885-c97814f06e8d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:34.644616 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ad8f7910-2810-4e21-a885-c97814f06e8d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:34.645735 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ad8f7910-2810-4e21-a885-c97814f06e8d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:34.646268 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ad8f7910-2810-4e21-a885-c97814f06e8d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:34.646843 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ad8f7910-2810-4e21-a885-c97814f06e8d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:34.647370 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ad8f7910-2810-4e21-a885-c97814f06e8d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:34.743355 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bfccf7f0-6940-4859-ac51-c43949e1c324 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8417cd8a252c4d3c9f2059c42bc82aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdabdb037d54103a656623e2c4c4a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:34.755368 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bfccf7f0-6940-4859-ac51-c43949e1c324 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] 10.222.0.42 "GET /compute/v2.1/servers/afd593c3-d69a-4d5d-81b9-15a3138378ae" status: 200 len: 1221 microversion: 2.1 time: 0.126012 Oct 23 01:18:34.755974 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1109/2188] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:34 2022] GET /compute/v2.1/servers/afd593c3-d69a-4d5d-81b9-15a3138378ae => generated 1221 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:34.767148 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-bfa8ca86-c79e-4e3d-9bfc-a00f696c68a1 req-d17d248b-f9e4-4baf-8893-8918f72db055 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2d33142-cf85-4a5b-b63f-e3780f8ac0b1", "name": "network-vif-plugged", "status": "completed", "tag": "c671ef64-d392-46ae-a693-c9bcda7c8160"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:18:34.788219 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-bfa8ca86-c79e-4e3d-9bfc-a00f696c68a1 req-d17d248b-f9e4-4baf-8893-8918f72db055 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:34.800128 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-bfa8ca86-c79e-4e3d-9bfc-a00f696c68a1 req-d17d248b-f9e4-4baf-8893-8918f72db055 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:34.800128 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-bfa8ca86-c79e-4e3d-9bfc-a00f696c68a1 req-d17d248b-f9e4-4baf-8893-8918f72db055 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:34.808740 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-bfa8ca86-c79e-4e3d-9bfc-a00f696c68a1 req-d17d248b-f9e4-4baf-8893-8918f72db055 service nova] Creating event network-vif-plugged:c671ef64-d392-46ae-a693-c9bcda7c8160 for instance d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 on n-h2-master-1 Oct 23 01:18:34.817005 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-bfa8ca86-c79e-4e3d-9bfc-a00f696c68a1 req-d17d248b-f9e4-4baf-8893-8918f72db055 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056627 Oct 23 01:18:34.818745 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1110/2189] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:18:34.829095 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1f3b274f-dd87-4137-a392-1bd0dd793a34 tempest-KeyPairsV2TestJSON-476293209 tempest-KeyPairsV2TestJSON-476293209-project] Action: 'create', calling method: .version_select at 0x7f5cc6286dc0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-438395605", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCV1ZnZT0NUpH7hi0RbftsCq1idj/K3kDrhC0bR5mR7mVAgVArREDDtdrfAoZVrj3sfbwwZaTXoaQlirVwsFS5G0Ui/js1nOwXRSu9w1P5B5UPFTGG5PKh5teHuPojFfg=="}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:18:34.847701 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-1f3b274f-dd87-4137-a392-1bd0dd793a34 tempest-KeyPairsV2TestJSON-476293209 tempest-KeyPairsV2TestJSON-476293209-project] Getting quotas for project 38e182b74ee248a691cce4f31d5d24a1. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:18:34.854284 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-1f3b274f-dd87-4137-a392-1bd0dd793a34 tempest-KeyPairsV2TestJSON-476293209 tempest-KeyPairsV2TestJSON-476293209-project] Getting quotas for user 2ef087421d544ed1b56f73e64db80edb and project 38e182b74ee248a691cce4f31d5d24a1. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:18:34.895210 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ad8f7910-2810-4e21-a885-c97814f06e8d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:34.908988 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ad8f7910-2810-4e21-a885-c97814f06e8d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf" status: 200 len: 1497 microversion: 2.1 time: 0.290607 Oct 23 01:18:34.909589 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1080/2190] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:34 2022] GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf => generated 1497 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:34.916924 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-eb80d365-b373-462a-91c9-8a50533a7552 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:34.917547 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-eb80d365-b373-462a-91c9-8a50533a7552 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:34.926880 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb80d365-b373-462a-91c9-8a50533a7552 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:34.932325 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb80d365-b373-462a-91c9-8a50533a7552 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:34.932325 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb80d365-b373-462a-91c9-8a50533a7552 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:34.932325 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb80d365-b373-462a-91c9-8a50533a7552 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:34.932325 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb80d365-b373-462a-91c9-8a50533a7552 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:34.932325 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb80d365-b373-462a-91c9-8a50533a7552 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:35.000000 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1f3b274f-dd87-4137-a392-1bd0dd793a34 tempest-KeyPairsV2TestJSON-476293209 tempest-KeyPairsV2TestJSON-476293209-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.178936 Oct 23 01:18:35.001915 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1111/2191] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 01:18:34 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:18:35.017108 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2c998626-6825-4ec0-b995-0f3024619fa1 tempest-KeyPairsV2TestJSON-476293209 tempest-KeyPairsV2TestJSON-476293209-project] Action: 'create', calling method: .version_select at 0x7f5cc6205dc0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-515121758", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZn84KC3R7WQ7V4nm7TJVfiUfyqpK6l+AbrcstqNxlwRI0OXz+/R1CsRwrFklrguGm0eToakyXiiNEattck2bdf2q4gMGzILYjLhioQAsFoqmVAUouYwAPXIc3CiubZ8Q=="}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:18:35.053279 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-2c998626-6825-4ec0-b995-0f3024619fa1 tempest-KeyPairsV2TestJSON-476293209 tempest-KeyPairsV2TestJSON-476293209-project] Getting quotas for project 38e182b74ee248a691cce4f31d5d24a1. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:18:35.062982 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-2c998626-6825-4ec0-b995-0f3024619fa1 tempest-KeyPairsV2TestJSON-476293209 tempest-KeyPairsV2TestJSON-476293209-project] Getting quotas for user 2ef087421d544ed1b56f73e64db80edb and project 38e182b74ee248a691cce4f31d5d24a1. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:18:35.096926 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-eb80d365-b373-462a-91c9-8a50533a7552 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:35.100878 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=100 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:35.105731 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-eb80d365-b373-462a-91c9-8a50533a7552 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1391 microversion: 2.1 time: 0.192784 Oct 23 01:18:35.107461 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1081/2192] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:34 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1391 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:35.215134 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2c998626-6825-4ec0-b995-0f3024619fa1 tempest-KeyPairsV2TestJSON-476293209 tempest-KeyPairsV2TestJSON-476293209-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.204009 Oct 23 01:18:35.215936 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1112/2193] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 01:18:35 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:18:35.229617 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-edbc885a-8777-4f81-ab13-b294775ebfe4 tempest-KeyPairsV2TestJSON-476293209 tempest-KeyPairsV2TestJSON-476293209-project] Action: 'create', calling method: .version_select at 0x7f5cc1c160d0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1700352939", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLxWeBi3J2yBa53Im7PWTiMdSCeec6B1ivmVic883pSeTizbmPO9gzRs77V1UDxj4PKGgDNw0z824uYvCBxPZfQGwtGSmbDxQIgWhdgMuOR1UTJU1GD4I5zd/8ua8NCVg=="}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:18:35.248943 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-edbc885a-8777-4f81-ab13-b294775ebfe4 tempest-KeyPairsV2TestJSON-476293209 tempest-KeyPairsV2TestJSON-476293209-project] Getting quotas for project 38e182b74ee248a691cce4f31d5d24a1. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:18:35.258049 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-edbc885a-8777-4f81-ab13-b294775ebfe4 tempest-KeyPairsV2TestJSON-476293209 tempest-KeyPairsV2TestJSON-476293209-project] Getting quotas for user 2ef087421d544ed1b56f73e64db80edb and project 38e182b74ee248a691cce4f31d5d24a1. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:18:35.351541 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-edbc885a-8777-4f81-ab13-b294775ebfe4 tempest-KeyPairsV2TestJSON-476293209 tempest-KeyPairsV2TestJSON-476293209-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.125854 Oct 23 01:18:35.352187 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1082/2194] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 01:18:35 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:18:35.370171 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f9249a5c-dfce-47b5-824d-0e3a4dd5398a tempest-KeyPairsV2TestJSON-476293209 tempest-KeyPairsV2TestJSON-476293209-project] Calling method '.version_select at 0x7f5cc62e5430>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:35.378812 n-d-master-1 devstack@n-api.service[120945]: WARNING oslo_db.sqlalchemy.utils [None req-f9249a5c-dfce-47b5-824d-0e3a4dd5398a tempest-KeyPairsV2TestJSON-476293209 tempest-KeyPairsV2TestJSON-476293209-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 23 01:18:35.386415 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f9249a5c-dfce-47b5-824d-0e3a4dd5398a tempest-KeyPairsV2TestJSON-476293209 tempest-KeyPairsV2TestJSON-476293209-project] 10.222.0.42 "GET /compute/v2.1/os-keypairs" status: 200 len: 1092 microversion: 2.1 time: 0.027298 Oct 23 01:18:35.387004 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1113/2195] 10.222.0.42 () {58 vars in 1137 bytes} [Sun Oct 23 01:18:35 2022] GET /compute/v2.1/os-keypairs => generated 1092 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:35.398784 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-68be9f7b-8456-43bc-b056-5936f51d1a08 tempest-KeyPairsV2TestJSON-476293209 tempest-KeyPairsV2TestJSON-476293209-project] Calling method '.version_select at 0x7f5cc16e0820>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:35.462759 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6be7f9df-6dbf-4a38-8244-d01ed027a7d8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:35.463901 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6be7f9df-6dbf-4a38-8244-d01ed027a7d8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: cce77239-7b98-4389-946e-8292bf160194] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:35.473841 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6be7f9df-6dbf-4a38-8244-d01ed027a7d8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:35.474722 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6be7f9df-6dbf-4a38-8244-d01ed027a7d8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:35.475332 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6be7f9df-6dbf-4a38-8244-d01ed027a7d8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:35.476212 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6be7f9df-6dbf-4a38-8244-d01ed027a7d8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:35.476942 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6be7f9df-6dbf-4a38-8244-d01ed027a7d8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:35.477545 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6be7f9df-6dbf-4a38-8244-d01ed027a7d8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:35.535842 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-68be9f7b-8456-43bc-b056-5936f51d1a08 tempest-KeyPairsV2TestJSON-476293209 tempest-KeyPairsV2TestJSON-476293209-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1700352939" status: 202 len: 0 microversion: 2.1 time: 0.140747 Oct 23 01:18:35.539011 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1083/2196] 10.222.0.42 () {58 vars in 1278 bytes} [Sun Oct 23 01:18:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1700352939 => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:18:35.548660 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-87e73a09-8f99-462b-b5d4-6bafbcde7d17 tempest-KeyPairsV2TestJSON-476293209 tempest-KeyPairsV2TestJSON-476293209-project] Calling method '.version_select at 0x7f5cc17508b0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:35.711814 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-87e73a09-8f99-462b-b5d4-6bafbcde7d17 tempest-KeyPairsV2TestJSON-476293209 tempest-KeyPairsV2TestJSON-476293209-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-515121758" status: 202 len: 0 microversion: 2.1 time: 0.169549 Oct 23 01:18:35.717868 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1084/2197] 10.222.0.42 () {58 vars in 1275 bytes} [Sun Oct 23 01:18:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-515121758 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:18:35.725423 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e5230671-8709-45a5-be7d-ccf32a6bf8a6 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:35.726137 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e5230671-8709-45a5-be7d-ccf32a6bf8a6 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: d2d33142-cf85-4a5b-b63f-e3780f8ac0b1] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:35.736875 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e5230671-8709-45a5-be7d-ccf32a6bf8a6 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:35.737856 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e5230671-8709-45a5-be7d-ccf32a6bf8a6 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:35.738373 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e5230671-8709-45a5-be7d-ccf32a6bf8a6 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:35.739368 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e5230671-8709-45a5-be7d-ccf32a6bf8a6 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:35.739834 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e5230671-8709-45a5-be7d-ccf32a6bf8a6 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:35.740264 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e5230671-8709-45a5-be7d-ccf32a6bf8a6 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:36.174804 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6be7f9df-6dbf-4a38-8244-d01ed027a7d8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:36.189273 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6be7f9df-6dbf-4a38-8244-d01ed027a7d8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/cce77239-7b98-4389-946e-8292bf160194" status: 200 len: 1316 microversion: 2.1 time: 0.730502 Oct 23 01:18:36.191095 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1114/2198] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:35 2022] GET /compute/v2.1/servers/cce77239-7b98-4389-946e-8292bf160194 => generated 1316 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:36.196331 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ee7a066b-b631-43e6-8691-aef6a6177bf0 tempest-KeyPairsV2TestJSON-476293209 tempest-KeyPairsV2TestJSON-476293209-project] Calling method '.version_select at 0x7f5cc62e5430>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:36.275477 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e5230671-8709-45a5-be7d-ccf32a6bf8a6 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:36.277843 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ee7a066b-b631-43e6-8691-aef6a6177bf0 tempest-KeyPairsV2TestJSON-476293209 tempest-KeyPairsV2TestJSON-476293209-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-438395605" status: 202 len: 0 microversion: 2.1 time: 0.085368 Oct 23 01:18:36.278464 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1115/2199] 10.222.0.42 () {58 vars in 1275 bytes} [Sun Oct 23 01:18:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-438395605 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:18:36.291255 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e5230671-8709-45a5-be7d-ccf32a6bf8a6 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1" status: 200 len: 1317 microversion: 2.1 time: 0.571510 Oct 23 01:18:36.298355 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1085/2200] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:35 2022] GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 => generated 1317 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:36.317019 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d096d47e-6165-4efd-b87c-a4ccfbfd4224 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:36.321618 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d096d47e-6165-4efd-b87c-a4ccfbfd4224 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 40104c3d-0e82-449a-a331-c4f6ba80afaf] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:36.321792 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5891b72f-4583-490e-a4ea-e5588972a35a tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:36.326027 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5891b72f-4583-490e-a4ea-e5588972a35a tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] [instance: afd593c3-d69a-4d5d-81b9-15a3138378ae] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:36.329050 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d096d47e-6165-4efd-b87c-a4ccfbfd4224 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:36.329739 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d096d47e-6165-4efd-b87c-a4ccfbfd4224 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:36.332024 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d096d47e-6165-4efd-b87c-a4ccfbfd4224 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:36.333365 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d096d47e-6165-4efd-b87c-a4ccfbfd4224 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:36.334762 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d096d47e-6165-4efd-b87c-a4ccfbfd4224 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:36.337783 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d096d47e-6165-4efd-b87c-a4ccfbfd4224 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:36.341440 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:DELETE=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:36.357452 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5891b72f-4583-490e-a4ea-e5588972a35a tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:36.357948 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5891b72f-4583-490e-a4ea-e5588972a35a tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:36.363076 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5891b72f-4583-490e-a4ea-e5588972a35a tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:36.367552 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5891b72f-4583-490e-a4ea-e5588972a35a tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:36.370083 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5891b72f-4583-490e-a4ea-e5588972a35a tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:36.370083 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5891b72f-4583-490e-a4ea-e5588972a35a tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:36.563593 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5891b72f-4583-490e-a4ea-e5588972a35a tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8417cd8a252c4d3c9f2059c42bc82aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdabdb037d54103a656623e2c4c4a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:36.575829 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5891b72f-4583-490e-a4ea-e5588972a35a tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] 10.222.0.42 "GET /compute/v2.1/servers/afd593c3-d69a-4d5d-81b9-15a3138378ae" status: 200 len: 1225 microversion: 2.1 time: 0.295004 Oct 23 01:18:36.586012 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1116/2201] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:36 2022] GET /compute/v2.1/servers/afd593c3-d69a-4d5d-81b9-15a3138378ae => generated 1225 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:36.586012 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-05502864-80c5-4a21-b5e0-1c0518e399ed tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:36.586012 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-05502864-80c5-4a21-b5e0-1c0518e399ed tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:36.593331 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05502864-80c5-4a21-b5e0-1c0518e399ed tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:36.593947 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05502864-80c5-4a21-b5e0-1c0518e399ed tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:36.594412 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05502864-80c5-4a21-b5e0-1c0518e399ed tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:36.595158 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05502864-80c5-4a21-b5e0-1c0518e399ed tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:36.595608 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05502864-80c5-4a21-b5e0-1c0518e399ed tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:36.596121 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05502864-80c5-4a21-b5e0-1c0518e399ed tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:36.877581 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d096d47e-6165-4efd-b87c-a4ccfbfd4224 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:36.889846 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d096d47e-6165-4efd-b87c-a4ccfbfd4224 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf" status: 200 len: 1474 microversion: 2.1 time: 0.588330 Oct 23 01:18:36.890495 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1086/2202] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:36 2022] GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf => generated 1474 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:36.916082 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-496b9632-6c39-4510-96c7-c31e19b5c11c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1002043616"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:18:36.919129 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-496b9632-6c39-4510-96c7-c31e19b5c11c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 40104c3d-0e82-449a-a331-c4f6ba80afaf] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:36.927863 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-496b9632-6c39-4510-96c7-c31e19b5c11c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:36.928602 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-496b9632-6c39-4510-96c7-c31e19b5c11c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:36.929221 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-496b9632-6c39-4510-96c7-c31e19b5c11c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:36.930166 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-496b9632-6c39-4510-96c7-c31e19b5c11c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:36.930787 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-496b9632-6c39-4510-96c7-c31e19b5c11c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:36.931423 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-496b9632-6c39-4510-96c7-c31e19b5c11c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:37.008464 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-05502864-80c5-4a21-b5e0-1c0518e399ed tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:37.017466 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-05502864-80c5-4a21-b5e0-1c0518e399ed tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1381 microversion: 2.1 time: 0.439457 Oct 23 01:18:37.018744 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1117/2203] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:36 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1381 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:37.050139 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ddbac2d9-d7df-4096-8b79-3d653c2f2f6f tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Calling method '.version_select at 0x7f5cc6263040>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:37.066987 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ddbac2d9-d7df-4096-8b79-3d653c2f2f6f tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:37.067186 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ddbac2d9-d7df-4096-8b79-3d653c2f2f6f tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:37.070680 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ddbac2d9-d7df-4096-8b79-3d653c2f2f6f tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:37.099180 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ddbac2d9-d7df-4096-8b79-3d653c2f2f6f tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] 10.222.0.42 "GET /compute/v2.1/os-migrations" status: 200 len: 2704 microversion: 2.1 time: 0.053447 Oct 23 01:18:37.101650 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1118/2204] 10.222.0.42 () {58 vars in 1143 bytes} [Sun Oct 23 01:18:37 2022] GET /compute/v2.1/os-migrations => generated 2704 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:37.130371 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7751b21b-50f6-4f87-8828-37539d61a5ff tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:37.132240 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7751b21b-50f6-4f87-8828-37539d61a5ff tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:37.161000 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7751b21b-50f6-4f87-8828-37539d61a5ff tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:37.161000 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7751b21b-50f6-4f87-8828-37539d61a5ff tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:37.161000 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7751b21b-50f6-4f87-8828-37539d61a5ff tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:37.168838 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7751b21b-50f6-4f87-8828-37539d61a5ff tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:37.168838 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7751b21b-50f6-4f87-8828-37539d61a5ff tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:37.168838 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7751b21b-50f6-4f87-8828-37539d61a5ff tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:37.390066 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7751b21b-50f6-4f87-8828-37539d61a5ff tempest-LiveMigrationTest-779744645 tempest-LiveMigrationTest-779744645-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1532 microversion: 2.1 time: 0.275213 Oct 23 01:18:37.394163 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1119/2205] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:37 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1532 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:37.396838 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fd62fbcb-9282-4aab-b35d-4c6f5fece6e8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:37.397618 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-fd62fbcb-9282-4aab-b35d-4c6f5fece6e8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: cce77239-7b98-4389-946e-8292bf160194] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:37.404082 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fd62fbcb-9282-4aab-b35d-4c6f5fece6e8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:37.404779 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fd62fbcb-9282-4aab-b35d-4c6f5fece6e8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:37.405383 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fd62fbcb-9282-4aab-b35d-4c6f5fece6e8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:37.406273 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fd62fbcb-9282-4aab-b35d-4c6f5fece6e8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:37.406893 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fd62fbcb-9282-4aab-b35d-4c6f5fece6e8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:37.407482 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fd62fbcb-9282-4aab-b35d-4c6f5fece6e8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:37.655202 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-fd62fbcb-9282-4aab-b35d-4c6f5fece6e8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:37.663963 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fd62fbcb-9282-4aab-b35d-4c6f5fece6e8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/cce77239-7b98-4389-946e-8292bf160194" status: 200 len: 1316 microversion: 2.1 time: 0.271105 Oct 23 01:18:37.664775 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1120/2206] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:37 2022] GET /compute/v2.1/servers/cce77239-7b98-4389-946e-8292bf160194 => generated 1316 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:37.682529 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5cbc67fd-3375-4439-abb9-5d010af7fc25 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:37.683480 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5cbc67fd-3375-4439-abb9-5d010af7fc25 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: d2d33142-cf85-4a5b-b63f-e3780f8ac0b1] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:37.690475 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5cbc67fd-3375-4439-abb9-5d010af7fc25 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:37.691123 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5cbc67fd-3375-4439-abb9-5d010af7fc25 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:37.691560 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5cbc67fd-3375-4439-abb9-5d010af7fc25 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:37.692462 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5cbc67fd-3375-4439-abb9-5d010af7fc25 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:37.692922 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5cbc67fd-3375-4439-abb9-5d010af7fc25 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:37.693342 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5cbc67fd-3375-4439-abb9-5d010af7fc25 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:37.833014 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-496b9632-6c39-4510-96c7-c31e19b5c11c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "POST /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf/action" status: 202 len: 0 microversion: 2.1 time: 0.921103 Oct 23 01:18:37.834803 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1087/2207] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:18:36 2022] POST /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf/action => generated 0 bytes in 924 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 23 01:18:37.840478 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5cbc67fd-3375-4439-abb9-5d010af7fc25 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:37.841934 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8ccea943-2a4d-4988-86a2-1c08e878c277 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:37.842829 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8ccea943-2a4d-4988-86a2-1c08e878c277 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:37.851470 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ccea943-2a4d-4988-86a2-1c08e878c277 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:37.852042 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ccea943-2a4d-4988-86a2-1c08e878c277 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:37.856497 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ccea943-2a4d-4988-86a2-1c08e878c277 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:37.856497 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ccea943-2a4d-4988-86a2-1c08e878c277 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:37.856733 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5cbc67fd-3375-4439-abb9-5d010af7fc25 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1" status: 200 len: 1507 microversion: 2.1 time: 0.187587 Oct 23 01:18:37.856828 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ccea943-2a4d-4988-86a2-1c08e878c277 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:37.856828 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ccea943-2a4d-4988-86a2-1c08e878c277 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:37.856988 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1121/2208] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:37 2022] GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 => generated 1507 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:37.872830 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c30604d9-1cba-4cd5-b634-3bbc166f2314 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:37.873460 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c30604d9-1cba-4cd5-b634-3bbc166f2314 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] [instance: afd593c3-d69a-4d5d-81b9-15a3138378ae] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:37.889092 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8ccea943-2a4d-4988-86a2-1c08e878c277 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:18:37.891087 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c30604d9-1cba-4cd5-b634-3bbc166f2314 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:37.891698 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c30604d9-1cba-4cd5-b634-3bbc166f2314 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:37.892169 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c30604d9-1cba-4cd5-b634-3bbc166f2314 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:37.894553 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c30604d9-1cba-4cd5-b634-3bbc166f2314 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:37.895244 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c30604d9-1cba-4cd5-b634-3bbc166f2314 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:37.895737 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c30604d9-1cba-4cd5-b634-3bbc166f2314 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:37.966296 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c30604d9-1cba-4cd5-b634-3bbc166f2314 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8417cd8a252c4d3c9f2059c42bc82aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdabdb037d54103a656623e2c4c4a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:37.976758 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c30604d9-1cba-4cd5-b634-3bbc166f2314 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] 10.222.0.42 "GET /compute/v2.1/servers/afd593c3-d69a-4d5d-81b9-15a3138378ae" status: 200 len: 1273 microversion: 2.1 time: 0.119972 Oct 23 01:18:37.977427 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1122/2209] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:37 2022] GET /compute/v2.1/servers/afd593c3-d69a-4d5d-81b9-15a3138378ae => generated 1273 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:37.987660 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-af0605d8-938c-4aca-a129-cfb725b797bd tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc62c7940>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:38.038582 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-af0605d8-938c-4aca-a129-cfb725b797bd tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/051dcffd-8f6c-4ce9-9ba8-61db53bafce2" status: 200 len: 1414 microversion: 2.1 time: 0.059985 Oct 23 01:18:38.046412 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1123/2210] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:18:37 2022] GET /compute/v2.1/images/051dcffd-8f6c-4ce9-9ba8-61db53bafce2 => generated 1414 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:38.052213 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4f0cae9b-9b11-40c3-b95c-a044b822247a tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:38.052877 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4f0cae9b-9b11-40c3-b95c-a044b822247a tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: d2d33142-cf85-4a5b-b63f-e3780f8ac0b1] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:38.059302 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f0cae9b-9b11-40c3-b95c-a044b822247a tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:38.059791 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f0cae9b-9b11-40c3-b95c-a044b822247a tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:38.067334 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f0cae9b-9b11-40c3-b95c-a044b822247a tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:38.067334 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f0cae9b-9b11-40c3-b95c-a044b822247a tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:38.067334 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f0cae9b-9b11-40c3-b95c-a044b822247a tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:38.067334 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f0cae9b-9b11-40c3-b95c-a044b822247a tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:38.226900 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4f0cae9b-9b11-40c3-b95c-a044b822247a tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:38.274500 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4f0cae9b-9b11-40c3-b95c-a044b822247a tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1" status: 200 len: 1507 microversion: 2.1 time: 0.220406 Oct 23 01:18:38.293911 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=4,nova_api:INSERT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:38.294413 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1124/2211] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:38 2022] GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 => generated 1507 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:38.302744 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ef0f6bbb-7d13-4c9e-b7b3-c575d8de70b2 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:18:38.306930 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ef0f6bbb-7d13-4c9e-b7b3-c575d8de70b2 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: d2d33142-cf85-4a5b-b63f-e3780f8ac0b1] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:38.314678 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef0f6bbb-7d13-4c9e-b7b3-c575d8de70b2 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:38.315177 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef0f6bbb-7d13-4c9e-b7b3-c575d8de70b2 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:38.315619 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef0f6bbb-7d13-4c9e-b7b3-c575d8de70b2 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:38.316376 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef0f6bbb-7d13-4c9e-b7b3-c575d8de70b2 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:38.316841 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef0f6bbb-7d13-4c9e-b7b3-c575d8de70b2 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:38.317310 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef0f6bbb-7d13-4c9e-b7b3-c575d8de70b2 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:38.418810 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-ef0f6bbb-7d13-4c9e-b7b3-c575d8de70b2 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:18:38.419848 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-ef0f6bbb-7d13-4c9e-b7b3-c575d8de70b2 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:18:38.420331 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-ef0f6bbb-7d13-4c9e-b7b3-c575d8de70b2 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:18:38.420897 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-ef0f6bbb-7d13-4c9e-b7b3-c575d8de70b2 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:18:38.421161 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-ef0f6bbb-7d13-4c9e-b7b3-c575d8de70b2 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:18:38.425450 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8ccea943-2a4d-4988-86a2-1c08e878c277 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "DELETE /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 204 len: 0 microversion: 2.1 time: 0.589000 Oct 23 01:18:38.430063 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1088/2212] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:18:37 2022] DELETE /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 0 bytes in 590 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:18:38.743406 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-20536c4b-26f7-49c8-9fec-1cda7c5ddbd1 tempest-AbsoluteLimitsNegativeTestJSON-1027647535 tempest-AbsoluteLimitsNegativeTestJSON-1027647535-project] Calling method '.version_select at 0x7f5cc62a5430>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:38.758808 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20536c4b-26f7-49c8-9fec-1cda7c5ddbd1 tempest-AbsoluteLimitsNegativeTestJSON-1027647535 tempest-AbsoluteLimitsNegativeTestJSON-1027647535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:38.759306 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20536c4b-26f7-49c8-9fec-1cda7c5ddbd1 tempest-AbsoluteLimitsNegativeTestJSON-1027647535 tempest-AbsoluteLimitsNegativeTestJSON-1027647535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:38.759744 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20536c4b-26f7-49c8-9fec-1cda7c5ddbd1 tempest-AbsoluteLimitsNegativeTestJSON-1027647535 tempest-AbsoluteLimitsNegativeTestJSON-1027647535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:38.760709 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20536c4b-26f7-49c8-9fec-1cda7c5ddbd1 tempest-AbsoluteLimitsNegativeTestJSON-1027647535 tempest-AbsoluteLimitsNegativeTestJSON-1027647535-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:38.761169 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20536c4b-26f7-49c8-9fec-1cda7c5ddbd1 tempest-AbsoluteLimitsNegativeTestJSON-1027647535 tempest-AbsoluteLimitsNegativeTestJSON-1027647535-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:38.762277 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20536c4b-26f7-49c8-9fec-1cda7c5ddbd1 tempest-AbsoluteLimitsNegativeTestJSON-1027647535 tempest-AbsoluteLimitsNegativeTestJSON-1027647535-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:38.800918 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-20536c4b-26f7-49c8-9fec-1cda7c5ddbd1 tempest-AbsoluteLimitsNegativeTestJSON-1027647535 tempest-AbsoluteLimitsNegativeTestJSON-1027647535-project] 10.222.0.42 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.361965 Oct 23 01:18:38.800918 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1089/2213] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:18:38 2022] GET /compute/v2.1/limits => generated 511 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:18:38.800918 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d19b9d41-8146-40bb-a281-eb3e669ebafd tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:38.800918 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d19b9d41-8146-40bb-a281-eb3e669ebafd tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:38.801679 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ef0f6bbb-7d13-4c9e-b7b3-c575d8de70b2 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: d2d33142-cf85-4a5b-b63f-e3780f8ac0b1] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:38.803276 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d19b9d41-8146-40bb-a281-eb3e669ebafd tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:38.804644 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d19b9d41-8146-40bb-a281-eb3e669ebafd tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:38.805117 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d19b9d41-8146-40bb-a281-eb3e669ebafd tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:38.805828 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d19b9d41-8146-40bb-a281-eb3e669ebafd tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:38.806598 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d19b9d41-8146-40bb-a281-eb3e669ebafd tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:38.807044 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d19b9d41-8146-40bb-a281-eb3e669ebafd tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:38.820669 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef0f6bbb-7d13-4c9e-b7b3-c575d8de70b2 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:38.824134 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef0f6bbb-7d13-4c9e-b7b3-c575d8de70b2 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:38.825161 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef0f6bbb-7d13-4c9e-b7b3-c575d8de70b2 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:38.827941 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef0f6bbb-7d13-4c9e-b7b3-c575d8de70b2 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:38.828436 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef0f6bbb-7d13-4c9e-b7b3-c575d8de70b2 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:38.854425 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef0f6bbb-7d13-4c9e-b7b3-c575d8de70b2 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:38.855242 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:38.942695 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ef0f6bbb-7d13-4c9e-b7b3-c575d8de70b2 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "POST /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1/action" status: 202 len: 1109 microversion: 2.1 time: 0.645552 Oct 23 01:18:38.965385 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1125/2214] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:18:38 2022] POST /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1/action => generated 1109 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Oct 23 01:18:38.976163 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-35ddeb08-edb4-41df-b21f-052e8241853a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:38.979458 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-35ddeb08-edb4-41df-b21f-052e8241853a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: cce77239-7b98-4389-946e-8292bf160194] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:38.993697 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-35ddeb08-edb4-41df-b21f-052e8241853a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:38.997264 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-35ddeb08-edb4-41df-b21f-052e8241853a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:38.998066 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-35ddeb08-edb4-41df-b21f-052e8241853a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:38.999053 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-35ddeb08-edb4-41df-b21f-052e8241853a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:38.999846 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-35ddeb08-edb4-41df-b21f-052e8241853a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:39.002899 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-35ddeb08-edb4-41df-b21f-052e8241853a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:39.095499 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d19b9d41-8146-40bb-a281-eb3e669ebafd tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:39.107798 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d19b9d41-8146-40bb-a281-eb3e669ebafd tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1387 microversion: 2.1 time: 0.315918 Oct 23 01:18:39.108821 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1090/2215] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:38 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1387 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:39.128538 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6e88dd3f-92dd-430d-a15a-ce51365559fd tempest-AbsoluteLimitsNegativeTestJSON-1027647535 tempest-AbsoluteLimitsNegativeTestJSON-1027647535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1088837804", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:18:39.195505 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-6e88dd3f-92dd-430d-a15a-ce51365559fd tempest-AbsoluteLimitsNegativeTestJSON-1027647535 tempest-AbsoluteLimitsNegativeTestJSON-1027647535-project] validate_networks() for None {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:18:39.219215 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-35ddeb08-edb4-41df-b21f-052e8241853a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:39.220218 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-35ddeb08-edb4-41df-b21f-052e8241853a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/cce77239-7b98-4389-946e-8292bf160194" status: 200 len: 1316 microversion: 2.1 time: 0.252953 Oct 23 01:18:39.221070 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1126/2216] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:38 2022] GET /compute/v2.1/servers/cce77239-7b98-4389-946e-8292bf160194 => generated 1316 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:39.226048 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3e9a5cd8-1151-4b08-9032-596801cfe887 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:39.226211 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3e9a5cd8-1151-4b08-9032-596801cfe887 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: d2d33142-cf85-4a5b-b63f-e3780f8ac0b1] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:39.232509 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3e9a5cd8-1151-4b08-9032-596801cfe887 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:39.233242 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3e9a5cd8-1151-4b08-9032-596801cfe887 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:39.233877 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3e9a5cd8-1151-4b08-9032-596801cfe887 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:39.234840 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3e9a5cd8-1151-4b08-9032-596801cfe887 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:39.235683 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3e9a5cd8-1151-4b08-9032-596801cfe887 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:39.236165 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3e9a5cd8-1151-4b08-9032-596801cfe887 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:39.489849 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3e9a5cd8-1151-4b08-9032-596801cfe887 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:39.504183 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3e9a5cd8-1151-4b08-9032-596801cfe887 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1" status: 200 len: 1514 microversion: 2.1 time: 0.282244 Oct 23 01:18:39.509058 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1127/2217] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:39 2022] GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 => generated 1514 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:39.514251 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e8b915e2-b713-4083-bc14-f58e9e51acbb tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:39.517878 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e8b915e2-b713-4083-bc14-f58e9e51acbb tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] [instance: afd593c3-d69a-4d5d-81b9-15a3138378ae] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:39.555599 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8b915e2-b713-4083-bc14-f58e9e51acbb tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:39.556912 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8b915e2-b713-4083-bc14-f58e9e51acbb tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:39.558138 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8b915e2-b713-4083-bc14-f58e9e51acbb tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:39.559665 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8b915e2-b713-4083-bc14-f58e9e51acbb tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:39.560702 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8b915e2-b713-4083-bc14-f58e9e51acbb tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:39.562698 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-6e88dd3f-92dd-430d-a15a-ce51365559fd tempest-AbsoluteLimitsNegativeTestJSON-1027647535 tempest-AbsoluteLimitsNegativeTestJSON-1027647535-project] Getting quotas for project 5474c468899142009da537662e2324ab. Resources: dict_keys(['metadata_items']) {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:18:39.563433 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8b915e2-b713-4083-bc14-f58e9e51acbb tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:39.577018 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-6e88dd3f-92dd-430d-a15a-ce51365559fd tempest-AbsoluteLimitsNegativeTestJSON-1027647535 tempest-AbsoluteLimitsNegativeTestJSON-1027647535-project] Getting quotas for user a5e9aba5c211461993a3ed53f2c88076 and project 5474c468899142009da537662e2324ab. Resources: dict_keys(['metadata_items']) {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:18:39.602897 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-6e88dd3f-92dd-430d-a15a-ce51365559fd tempest-AbsoluteLimitsNegativeTestJSON-1027647535 tempest-AbsoluteLimitsNegativeTestJSON-1027647535-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 23 01:18:39.635168 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6e88dd3f-92dd-430d-a15a-ce51365559fd tempest-AbsoluteLimitsNegativeTestJSON-1027647535 tempest-AbsoluteLimitsNegativeTestJSON-1027647535-project] Request method failure captured: Oct 23 01:18:39.635168 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 23 01:18:39.635168 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:18:39.635168 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:18:39.635168 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:18:39.635168 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 1752 Oct 23 01:18:39.635168 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:18:39.635168 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:18:39.635168 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:18:39.635168 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:18:39.635168 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJZu0_Z8j42xd88i1JGuXa-Cxtzbw-P_PNIDj0h9MhR4x1iQzVrfi0FEIKSUrmEmB0HODaCWX1Qg0Yy69yf4ibf8uow_8idE91-tD1FqKeafL4kbpHLJYILccb3yKVyJu-cCYcm900GNJPBgVHK0d6GpBDr4xbYd9FT_Q8iPjWesMPM Oct 23 01:18:39.635168 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:18:39.635168 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:18:39.635168 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:18:39.635168 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:18:39.635168 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:18:39.635168 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:18:39.635168 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 5474c468899142009da537662e2324ab Oct 23 01:18:39.635168 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1027647535 Oct 23 01:18:39.635168 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:18:39.635168 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:18:39.635168 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5474c468899142009da537662e2324ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5474c468899142009da537662e2324ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5474c468899142009da537662e2324ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5474c468899142009da537662e2324ab"}]}] Oct 23 01:18:39.635168 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1027647535 Oct 23 01:18:39.635168 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 5474c468899142009da537662e2324ab Oct 23 01:18:39.635168 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1027647535 Oct 23 01:18:39.635168 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1027647535-project Oct 23 01:18:39.635168 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:18:39.635168 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:18:39.635168 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: a5e9aba5c211461993a3ed53f2c88076 Oct 23 01:18:39.635168 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1027647535-project Oct 23 01:18:39.635168 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:18:39.635168 n-d-master-1 devstack@n-api.service[120944]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1088837804", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 23 01:18:39.635168 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:18:39.635168 n-d-master-1 devstack@n-api.service[120944]: exception: Maximum number of metadata items exceeds 128 Oct 23 01:18:39.642216 n-d-master-1 devstack@n-api.service[120944]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1088837804', 'imageRef': '446b40bc-db5b-4123-9278-997bd6d04a0d', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 23 01:18:39.642216 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:18:39.642216 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:39.642216 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 23 01:18:39.642216 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 23 01:18:39.642216 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 01:18:39.642216 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 01:18:39.642216 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 23 01:18:39.642216 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 23 01:18:39.642216 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 23 01:18:39.642216 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 23 01:18:39.642216 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 23 01:18:39.642216 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 23 01:18:39.642216 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 23 01:18:39.642216 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:18:39.642216 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:39.642216 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:18:39.642216 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:39.642216 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 23 01:18:39.642216 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 23 01:18:39.642216 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 23 01:18:39.642216 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 23 01:18:39.642216 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 23 01:18:39.642216 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 23 01:18:39.642216 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 23 01:18:39.642216 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 23 01:18:39.642216 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 23 01:18:39.642216 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 23 01:18:39.642216 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 23 01:18:39.642216 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:18:39.642216 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:39.642216 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:18:39.642216 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:39.642216 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:18:39.642216 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:18:39.642216 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:18:39.642216 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:18:39.642216 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:18:39.642216 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:18:39.642216 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:18:39.642216 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:18:39.642216 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:18:39.642216 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:18:39.642216 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:18:39.646186 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:18:39.646186 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 23 01:18:39.646186 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 23 01:18:39.646186 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 23 01:18:39.646186 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 23 01:18:39.646186 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:18:39.646186 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:39.646186 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:18:39.646186 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:39.646186 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:18:39.646186 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:18:39.646186 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:18:39.646186 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:18:39.646186 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 23 01:18:39.646186 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:18:39.646186 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6e88dd3f-92dd-430d-a15a-ce51365559fd tempest-AbsoluteLimitsNegativeTestJSON-1027647535 tempest-AbsoluteLimitsNegativeTestJSON-1027647535-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:18:39.650958 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6e88dd3f-92dd-430d-a15a-ce51365559fd tempest-AbsoluteLimitsNegativeTestJSON-1027647535 tempest-AbsoluteLimitsNegativeTestJSON-1027647535-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.526930 Oct 23 01:18:39.653148 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1091/2218] 10.222.0.42 () {60 vars in 1148 bytes} [Sun Oct 23 01:18:39 2022] POST /compute/v2.1/servers => generated 87 bytes in 544 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:18:39.673047 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8a9ea667-f7bc-481e-a850-79549c55d401 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc62adaf0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:39.767947 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8a9ea667-f7bc-481e-a850-79549c55d401 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/051dcffd-8f6c-4ce9-9ba8-61db53bafce2" status: 200 len: 1414 microversion: 2.1 time: 0.103707 Oct 23 01:18:39.768791 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1092/2219] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:18:39 2022] GET /compute/v2.1/images/051dcffd-8f6c-4ce9-9ba8-61db53bafce2 => generated 1414 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:39.792547 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-c87b3546-955d-483c-a02c-ecd1b08e4e15 req-94f009f5-b86e-4bf4-9075-4408294d94d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cce77239-7b98-4389-946e-8292bf160194", "name": "network-vif-plugged", "status": "completed", "tag": "aac9c20f-b1fa-4122-a799-18f1a928951f"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:18:39.806631 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-c87b3546-955d-483c-a02c-ecd1b08e4e15 req-94f009f5-b86e-4bf4-9075-4408294d94d2 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:39.807196 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-c87b3546-955d-483c-a02c-ecd1b08e4e15 req-94f009f5-b86e-4bf4-9075-4408294d94d2 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:39.807642 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-c87b3546-955d-483c-a02c-ecd1b08e4e15 req-94f009f5-b86e-4bf4-9075-4408294d94d2 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:39.807947 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e8b915e2-b713-4083-bc14-f58e9e51acbb tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8417cd8a252c4d3c9f2059c42bc82aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdabdb037d54103a656623e2c4c4a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:39.818081 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e8b915e2-b713-4083-bc14-f58e9e51acbb tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] 10.222.0.42 "GET /compute/v2.1/servers/afd593c3-d69a-4d5d-81b9-15a3138378ae" status: 200 len: 1279 microversion: 2.1 time: 0.307635 Oct 23 01:18:39.819066 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1128/2220] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:39 2022] GET /compute/v2.1/servers/afd593c3-d69a-4d5d-81b9-15a3138378ae => generated 1279 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:39.826999 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-c87b3546-955d-483c-a02c-ecd1b08e4e15 req-94f009f5-b86e-4bf4-9075-4408294d94d2 service nova] Creating event network-vif-plugged:aac9c20f-b1fa-4122-a799-18f1a928951f for instance cce77239-7b98-4389-946e-8292bf160194 on n-h1-master-1 Oct 23 01:18:39.835902 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-c87b3546-955d-483c-a02c-ecd1b08e4e15 req-94f009f5-b86e-4bf4-9075-4408294d94d2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060444 Oct 23 01:18:39.836520 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1093/2221] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:18:40.133954 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4abd1e75-0ad3-4ce4-8e40-90ce5d828b46 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:40.134619 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4abd1e75-0ad3-4ce4-8e40-90ce5d828b46 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:40.153709 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4abd1e75-0ad3-4ce4-8e40-90ce5d828b46 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:40.154238 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4abd1e75-0ad3-4ce4-8e40-90ce5d828b46 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:40.157853 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4abd1e75-0ad3-4ce4-8e40-90ce5d828b46 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:40.161456 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4abd1e75-0ad3-4ce4-8e40-90ce5d828b46 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:40.161948 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4abd1e75-0ad3-4ce4-8e40-90ce5d828b46 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:40.162416 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4abd1e75-0ad3-4ce4-8e40-90ce5d828b46 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:40.246210 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4738edbd-878d-45c5-b398-5c9f334a87fb tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:40.247798 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4738edbd-878d-45c5-b398-5c9f334a87fb tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: cce77239-7b98-4389-946e-8292bf160194] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:40.259991 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4738edbd-878d-45c5-b398-5c9f334a87fb tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:40.265484 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4738edbd-878d-45c5-b398-5c9f334a87fb tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:40.265484 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4738edbd-878d-45c5-b398-5c9f334a87fb tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:40.265484 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4738edbd-878d-45c5-b398-5c9f334a87fb tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:40.265484 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4738edbd-878d-45c5-b398-5c9f334a87fb tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:40.265484 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4738edbd-878d-45c5-b398-5c9f334a87fb tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:40.590879 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4abd1e75-0ad3-4ce4-8e40-90ce5d828b46 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:40.601548 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4abd1e75-0ad3-4ce4-8e40-90ce5d828b46 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1387 microversion: 2.1 time: 0.473235 Oct 23 01:18:40.602512 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1129/2222] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:40 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1387 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:40.617187 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4738edbd-878d-45c5-b398-5c9f334a87fb tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:40.627818 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4738edbd-878d-45c5-b398-5c9f334a87fb tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/cce77239-7b98-4389-946e-8292bf160194" status: 200 len: 1316 microversion: 2.1 time: 0.387709 Oct 23 01:18:40.628612 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1094/2223] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:40 2022] GET /compute/v2.1/servers/cce77239-7b98-4389-946e-8292bf160194 => generated 1316 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:40.633631 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ca92a1da-1eb3-4e85-9440-7fd53dc7b6be tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:40.635448 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ca92a1da-1eb3-4e85-9440-7fd53dc7b6be tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: d2d33142-cf85-4a5b-b63f-e3780f8ac0b1] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:40.641438 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ca92a1da-1eb3-4e85-9440-7fd53dc7b6be tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:40.642183 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ca92a1da-1eb3-4e85-9440-7fd53dc7b6be tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:40.649111 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ca92a1da-1eb3-4e85-9440-7fd53dc7b6be tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:40.649111 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ca92a1da-1eb3-4e85-9440-7fd53dc7b6be tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:40.649111 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ca92a1da-1eb3-4e85-9440-7fd53dc7b6be tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:40.649111 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ca92a1da-1eb3-4e85-9440-7fd53dc7b6be tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:40.905895 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ca92a1da-1eb3-4e85-9440-7fd53dc7b6be tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:40.916337 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ca92a1da-1eb3-4e85-9440-7fd53dc7b6be tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1" status: 200 len: 1514 microversion: 2.1 time: 0.286448 Oct 23 01:18:40.918645 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1095/2224] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:40 2022] GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 => generated 1514 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:40.928732 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-2dd682eb-663d-4233-89c8-ec88a29551de req-abdc8dcb-6622-4c11-97ae-25c40655bd2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dad12d7a-a01e-4f91-b35e-4f9f83df5b3b", "name": "network-vif-deleted", "tag": "b5a5b9cd-a440-4270-b48f-5816d8d587a8"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:18:40.931550 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a94071cc-09f1-4468-b285-ccbd259f81ef tempest-KeyPairsNegativeTestJSON-1632709755 tempest-KeyPairsNegativeTestJSON-1632709755-project] Action: 'create', calling method: .version_select at 0x7f5cc62050d0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGchxMIPSxJAF7uHKNrCUAGKRk8lYZw6/5Gl/2H8y/Rr+6bwEyUWhuowNC8iGa6M4lT4KXlUqoKyJs692LJOElGy8WNnv+kuwOq6/Uik49uYB/48Z1ikgdFVJNLFp11ckA=="}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a94071cc-09f1-4468-b285-ccbd259f81ef tempest-KeyPairsNegativeTestJSON-1632709755 tempest-KeyPairsNegativeTestJSON-1632709755-project] Request method failure captured: Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 257 Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJZwxCtaYtjiTXv5ahs9YY5sD7hRAMuX6guJjE3yIfa1EsuAvpu6hU5QquYwfFg1E0zt1d_rVfKoLa1wRahb2_PU4lwuB0ddzGsOSd_4KvhcR_eeJ9e60MOjyThDOXRtkWZuFow0i0xAPOsCCtti8vMuzBr0Vq15PtU_B1Ix9D_Zkd4 Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 3d1b3354a10047758b81ad7ff50e39de Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1632709755 Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3d1b3354a10047758b81ad7ff50e39de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3d1b3354a10047758b81ad7ff50e39de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3d1b3354a10047758b81ad7ff50e39de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3d1b3354a10047758b81ad7ff50e39de"}]}] Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1632709755 Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 3d1b3354a10047758b81ad7ff50e39de Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1632709755 Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-KeyPairsNegativeTestJSON-1632709755-project Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 5afd08e7fa4f4de7ad5386562f536bd7 Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1632709755-project Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGchxMIPSxJAF7uHKNrCUAGKRk8lYZw6/5Gl/2H8y/Rr+6bwEyUWhuowNC8iGa6M4lT4KXlUqoKyJs692LJOElGy8WNnv+kuwOq6/Uik49uYB/48Z1ikgdFVJNLFp11ckA=="}} Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: method: Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGchxMIPSxJAF7uHKNrCUAGKRk8lYZw6/5Gl/2H8y/Rr+6bwEyUWhuowNC8iGa6M4lT4KXlUqoKyJs692LJOElGy8WNnv+kuwOq6/Uik49uYB/48Z1ikgdFVJNLFp11ckA=='}}} Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise error Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 23 01:18:40.938908 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:40.945186 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:40.945186 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:40.945186 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:40.945186 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:18:40.945186 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:18:40.945186 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:18:40.945186 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:18:40.945186 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:18:40.945186 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:18:40.945186 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:18:40.945186 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:18:40.945186 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:18:40.945186 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:18:40.945186 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 23 01:18:40.945186 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 23 01:18:40.945186 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 23 01:18:40.945186 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 23 01:18:40.945186 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 23 01:18:40.945186 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 23 01:18:40.945186 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 23 01:18:40.945186 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:40.945186 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:40.945186 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:40.945186 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:40.945186 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:18:40.945186 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:18:40.945186 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 23 01:18:40.945186 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 23 01:18:40.945186 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 23 01:18:40.945186 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:40.945186 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a94071cc-09f1-4468-b285-ccbd259f81ef tempest-KeyPairsNegativeTestJSON-1632709755 tempest-KeyPairsNegativeTestJSON-1632709755-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:18:40.959485 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-2dd682eb-663d-4233-89c8-ec88a29551de req-abdc8dcb-6622-4c11-97ae-25c40655bd2d service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:40.959485 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-2dd682eb-663d-4233-89c8-ec88a29551de req-abdc8dcb-6622-4c11-97ae-25c40655bd2d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:40.959485 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-2dd682eb-663d-4233-89c8-ec88a29551de req-abdc8dcb-6622-4c11-97ae-25c40655bd2d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:40.959925 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a94071cc-09f1-4468-b285-ccbd259f81ef tempest-KeyPairsNegativeTestJSON-1632709755 tempest-KeyPairsNegativeTestJSON-1632709755-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.322013 Oct 23 01:18:40.959925 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1130/2225] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 01:18:40 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 344 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:18:40.959925 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e928f824-9803-482f-94f7-81c6cee1c925 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc6274700>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:40.965368 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-2dd682eb-663d-4233-89c8-ec88a29551de req-abdc8dcb-6622-4c11-97ae-25c40655bd2d service nova] Creating event network-vif-deleted:b5a5b9cd-a440-4270-b48f-5816d8d587a8 for instance dad12d7a-a01e-4f91-b35e-4f9f83df5b3b on n-h1-master-1 Oct 23 01:18:40.975309 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-2dd682eb-663d-4233-89c8-ec88a29551de req-abdc8dcb-6622-4c11-97ae-25c40655bd2d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051560 Oct 23 01:18:40.976158 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1096/2226] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:18:40.982516 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-19a677f7-b823-4032-98fe-c411f32ab99a tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:40.983679 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-19a677f7-b823-4032-98fe-c411f32ab99a tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] [instance: afd593c3-d69a-4d5d-81b9-15a3138378ae] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:40.990731 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-19a677f7-b823-4032-98fe-c411f32ab99a tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:40.991459 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-19a677f7-b823-4032-98fe-c411f32ab99a tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:40.991912 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-19a677f7-b823-4032-98fe-c411f32ab99a tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:40.992597 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-19a677f7-b823-4032-98fe-c411f32ab99a tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:40.993053 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-19a677f7-b823-4032-98fe-c411f32ab99a tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:40.993469 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-19a677f7-b823-4032-98fe-c411f32ab99a tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:41.036289 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e928f824-9803-482f-94f7-81c6cee1c925 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/051dcffd-8f6c-4ce9-9ba8-61db53bafce2" status: 200 len: 1414 microversion: 2.1 time: 0.087636 Oct 23 01:18:41.039677 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1131/2227] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:18:40 2022] GET /compute/v2.1/images/051dcffd-8f6c-4ce9-9ba8-61db53bafce2 => generated 1414 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:41.055417 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2a89d121-e754-42ff-808a-aee276cba784 tempest-KeyPairsNegativeTestJSON-1632709755 tempest-KeyPairsNegativeTestJSON-1632709755-project] Action: 'create', calling method: .version_select at 0x7f5cc6211940>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-965910117", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:18:41.113531 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=59 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:41.115042 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-2a89d121-e754-42ff-808a-aee276cba784 tempest-KeyPairsNegativeTestJSON-1632709755 tempest-KeyPairsNegativeTestJSON-1632709755-project] Getting quotas for project 3d1b3354a10047758b81ad7ff50e39de. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:18:41.122192 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-2a89d121-e754-42ff-808a-aee276cba784 tempest-KeyPairsNegativeTestJSON-1632709755 tempest-KeyPairsNegativeTestJSON-1632709755-project] Getting quotas for user 5afd08e7fa4f4de7ad5386562f536bd7 and project 3d1b3354a10047758b81ad7ff50e39de. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:18:41.142293 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-2a89d121-e754-42ff-808a-aee276cba784 tempest-KeyPairsNegativeTestJSON-1632709755 tempest-KeyPairsNegativeTestJSON-1632709755-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 23 01:18:41.155731 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2a89d121-e754-42ff-808a-aee276cba784 tempest-KeyPairsNegativeTestJSON-1632709755 tempest-KeyPairsNegativeTestJSON-1632709755-project] Request method failure captured: Oct 23 01:18:41.155731 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 23 01:18:41.155731 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:18:41.155731 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:18:41.155731 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:18:41.155731 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 2166 Oct 23 01:18:41.155731 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:18:41.155731 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:18:41.155731 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:18:41.155731 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:18:41.155731 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJZwxCtaYtjiTXv5ahs9YY5sD7hRAMuX6guJjE3yIfa1EsuAvpu6hU5QquYwfFg1E0zt1d_rVfKoLa1wRahb2_PU4lwuB0ddzGsOSd_4KvhcR_eeJ9e60MOjyThDOXRtkWZuFow0i0xAPOsCCtti8vMuzBr0Vq15PtU_B1Ix9D_Zkd4 Oct 23 01:18:41.155731 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:18:41.155731 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:18:41.155731 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:18:41.155731 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:18:41.155731 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:18:41.155731 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:18:41.155731 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 3d1b3354a10047758b81ad7ff50e39de Oct 23 01:18:41.155731 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1632709755 Oct 23 01:18:41.155731 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:18:41.155731 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:18:41.155731 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3d1b3354a10047758b81ad7ff50e39de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3d1b3354a10047758b81ad7ff50e39de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3d1b3354a10047758b81ad7ff50e39de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3d1b3354a10047758b81ad7ff50e39de"}]}] Oct 23 01:18:41.155731 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1632709755 Oct 23 01:18:41.155731 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 3d1b3354a10047758b81ad7ff50e39de Oct 23 01:18:41.155731 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1632709755 Oct 23 01:18:41.155731 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-KeyPairsNegativeTestJSON-1632709755-project Oct 23 01:18:41.155731 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:18:41.155731 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:18:41.155731 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 5afd08e7fa4f4de7ad5386562f536bd7 Oct 23 01:18:41.155731 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1632709755-project Oct 23 01:18:41.155731 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:18:41.155731 n-d-master-1 devstack@n-api.service[120945]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-965910117", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 23 01:18:41.155731 n-d-master-1 devstack@n-api.service[120945]: method: Oct 23 01:18:41.155731 n-d-master-1 devstack@n-api.service[120945]: exception: Keypair data is invalid: failed to generate fingerprint Oct 23 01:18:41.160802 n-d-master-1 devstack@n-api.service[120945]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-965910117', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 23 01:18:41.160802 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:18:41.160802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:41.160802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 23 01:18:41.160802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 23 01:18:41.160802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 23 01:18:41.160802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 23 01:18:41.160802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 23 01:18:41.160802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:41.160802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:41.160802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:41.160802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:41.160802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 23 01:18:41.160802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 23 01:18:41.160802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 23 01:18:41.160802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 23 01:18:41.160802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:18:41.160802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 23 01:18:41.160802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:18:41.160802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise self.value Oct 23 01:18:41.160802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 23 01:18:41.160802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 23 01:18:41.160802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 23 01:18:41.160802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 23 01:18:41.160802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 23 01:18:41.160802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 23 01:18:41.160802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 23 01:18:41.160802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 23 01:18:41.160802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 23 01:18:41.160802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:41.160802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:41.160802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:41.160802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:41.160802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:18:41.160802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:18:41.160802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:18:41.160802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:18:41.160802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:18:41.160802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:18:41.160802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:18:41.160802 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:18:41.164352 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:18:41.164352 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:18:41.164352 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:18:41.164352 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:18:41.164352 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 23 01:18:41.164352 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 23 01:18:41.164352 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 23 01:18:41.164352 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 23 01:18:41.164352 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 23 01:18:41.164352 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:41.164352 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:41.164352 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:41.164352 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:41.164352 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:18:41.164352 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:18:41.164352 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:18:41.164352 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:18:41.164352 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 23 01:18:41.164352 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:41.164352 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2a89d121-e754-42ff-808a-aee276cba784 tempest-KeyPairsNegativeTestJSON-1632709755 tempest-KeyPairsNegativeTestJSON-1632709755-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:18:41.164352 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2a89d121-e754-42ff-808a-aee276cba784 tempest-KeyPairsNegativeTestJSON-1632709755 tempest-KeyPairsNegativeTestJSON-1632709755-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.116596 Oct 23 01:18:41.164352 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1132/2228] 10.222.0.42 () {60 vars in 1160 bytes} [Sun Oct 23 01:18:41 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 119 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 23 01:18:41.174382 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cc7117d4-4634-4b8e-94b6-f9605ea8e501 tempest-KeyPairsNegativeTestJSON-1632709755 tempest-KeyPairsNegativeTestJSON-1632709755-project] Action: 'create', calling method: .version_select at 0x7f5cc61c6af0>, body: {"keypair": {"name": "tempest-keypair-1837697917", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrDGvihdj0+BDHj6Bj+EbS1IrykZpSalcRHaRfE9PHUw+IXW+DK05p8MMlruqQT4gXS0Pf8i5NKe8T3Swa3DWP4BfO3EfS6U5xzOEx2OZbsSWq6+wGx9aru6QI7QlDXdQ=="}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:18:41.190816 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-cc7117d4-4634-4b8e-94b6-f9605ea8e501 tempest-KeyPairsNegativeTestJSON-1632709755 tempest-KeyPairsNegativeTestJSON-1632709755-project] Getting quotas for project 3d1b3354a10047758b81ad7ff50e39de. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:18:41.197631 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-cc7117d4-4634-4b8e-94b6-f9605ea8e501 tempest-KeyPairsNegativeTestJSON-1632709755 tempest-KeyPairsNegativeTestJSON-1632709755-project] Getting quotas for user 5afd08e7fa4f4de7ad5386562f536bd7 and project 3d1b3354a10047758b81ad7ff50e39de. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:18:41.287898 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-19a677f7-b823-4032-98fe-c411f32ab99a tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8417cd8a252c4d3c9f2059c42bc82aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdabdb037d54103a656623e2c4c4a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:41.304238 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-19a677f7-b823-4032-98fe-c411f32ab99a tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] 10.222.0.42 "GET /compute/v2.1/servers/afd593c3-d69a-4d5d-81b9-15a3138378ae" status: 200 len: 1321 microversion: 2.1 time: 0.326677 Oct 23 01:18:41.305351 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1097/2229] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:40 2022] GET /compute/v2.1/servers/afd593c3-d69a-4d5d-81b9-15a3138378ae => generated 1321 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:41.387045 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cc7117d4-4634-4b8e-94b6-f9605ea8e501 tempest-KeyPairsNegativeTestJSON-1632709755 tempest-KeyPairsNegativeTestJSON-1632709755-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.219928 Oct 23 01:18:41.388100 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1133/2230] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 01:18:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:18:41.404077 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-22206561-c6a2-49c2-b147-1b0e8a1a22c7 tempest-KeyPairsNegativeTestJSON-1632709755 tempest-KeyPairsNegativeTestJSON-1632709755-project] Action: 'create', calling method: .version_select at 0x7f5cc6201670>, body: {"keypair": {"name": "tempest-keypair-1837697917", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDeNnoo9H/5h0OhpvQLTlvZlUPdg7Qls99ajAxERmwBAmAQHfAz396dlsVjgSasQe0TNyCEcyj9Arb3BpvYQcXWl/HZCMAo6degBK6PR3CVB+x6GZ+AH6k49QZAqZhSAXA=="}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:18:41.419576 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=27 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:41.422390 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-22206561-c6a2-49c2-b147-1b0e8a1a22c7 tempest-KeyPairsNegativeTestJSON-1632709755 tempest-KeyPairsNegativeTestJSON-1632709755-project] Getting quotas for project 3d1b3354a10047758b81ad7ff50e39de. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:18:41.429765 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-22206561-c6a2-49c2-b147-1b0e8a1a22c7 tempest-KeyPairsNegativeTestJSON-1632709755 tempest-KeyPairsNegativeTestJSON-1632709755-project] Getting quotas for user 5afd08e7fa4f4de7ad5386562f536bd7 and project 3d1b3354a10047758b81ad7ff50e39de. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:18:41.574890 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-22206561-c6a2-49c2-b147-1b0e8a1a22c7 tempest-KeyPairsNegativeTestJSON-1632709755 tempest-KeyPairsNegativeTestJSON-1632709755-project] HTTP exception thrown: Key pair 'tempest-keypair-1837697917' already exists. Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-22206561-c6a2-49c2-b147-1b0e8a1a22c7 tempest-KeyPairsNegativeTestJSON-1632709755 tempest-KeyPairsNegativeTestJSON-1632709755-project] Request method failure captured: Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 273 Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJZwxCtaYtjiTXv5ahs9YY5sD7hRAMuX6guJjE3yIfa1EsuAvpu6hU5QquYwfFg1E0zt1d_rVfKoLa1wRahb2_PU4lwuB0ddzGsOSd_4KvhcR_eeJ9e60MOjyThDOXRtkWZuFow0i0xAPOsCCtti8vMuzBr0Vq15PtU_B1Ix9D_Zkd4 Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 3d1b3354a10047758b81ad7ff50e39de Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1632709755 Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3d1b3354a10047758b81ad7ff50e39de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3d1b3354a10047758b81ad7ff50e39de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3d1b3354a10047758b81ad7ff50e39de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3d1b3354a10047758b81ad7ff50e39de"}]}] Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1632709755 Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 3d1b3354a10047758b81ad7ff50e39de Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1632709755 Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-KeyPairsNegativeTestJSON-1632709755-project Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 5afd08e7fa4f4de7ad5386562f536bd7 Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1632709755-project Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: {"keypair": {"name": "tempest-keypair-1837697917", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDeNnoo9H/5h0OhpvQLTlvZlUPdg7Qls99ajAxERmwBAmAQHfAz396dlsVjgSasQe0TNyCEcyj9Arb3BpvYQcXWl/HZCMAo6degBK6PR3CVB+x6GZ+AH6k49QZAqZhSAXA=="}} Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: method: Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: exception: Key pair 'tempest-keypair-1837697917' already exists. Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1837697917', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDeNnoo9H/5h0OhpvQLTlvZlUPdg7Qls99ajAxERmwBAmAQHfAz396dlsVjgSasQe0TNyCEcyj9Arb3BpvYQcXWl/HZCMAo6degBK6PR3CVB+x6GZ+AH6k49QZAqZhSAXA=='}}} Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result.read() Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '5afd08e7fa4f4de7ad5386562f536bd7-tempest-keypair-1837697917' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 23 01:18:41.578866 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi session.flush() Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result.read() Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 23 01:18:41.584671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 23 01:18:41.591333 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 23 01:18:41.591333 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '5afd08e7fa4f4de7ad5386562f536bd7-tempest-keypair-1837697917' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 23 01:18:41.591333 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 23 01:18:41.591333 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 23, 1, 18, 41, 495557), 'updated_at': None, 'name': 'tempest-keypair-1837697917', 'user_id': '5afd08e7fa4f4de7ad5386562f536bd7', 'fingerprint': 'df:bd:5a:4c:80:98:5a:b3:83:99:c0:a6:72:0a:67:5b', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDeNnoo9H/5h0OhpvQLTlvZlUPdg7Qls99ajAxERmwBAmAQHfAz396dlsVjgSasQe0TNyCEcyj9Arb3BpvYQcXWl/HZCMAo6degBK6PR3CVB+x6GZ+AH6k49QZAqZhSAXA==', 'type': 'ssh'}] Oct 23 01:18:41.591333 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 23 01:18:41.591333 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:18:41.591333 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:41.591333 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:18:41.591333 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:41.591333 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 23 01:18:41.591333 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 23 01:18:41.591333 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 23 01:18:41.591333 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 23 01:18:41.591333 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:18:41.591333 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 23 01:18:41.591333 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:18:41.591333 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise self.value Oct 23 01:18:41.591333 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 23 01:18:41.591333 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 23 01:18:41.591333 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 23 01:18:41.591333 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi keypair.create() Oct 23 01:18:41.591333 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 23 01:18:41.591333 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 23 01:18:41.591333 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 23 01:18:41.591333 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._create() Oct 23 01:18:41.591333 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 23 01:18:41.591333 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 23 01:18:41.591333 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 23 01:18:41.591333 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 23 01:18:41.591333 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 23 01:18:41.591333 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 23 01:18:41.591333 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 23 01:18:41.591333 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 23 01:18:41.591333 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1837697917' already exists. Oct 23 01:18:41.591333 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:18:41.591333 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:41.591333 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:18:41.591333 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:41.591333 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:18:41.591333 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:18:41.591333 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:18:41.591333 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:18:41.591333 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:18:41.591333 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:18:41.591333 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:18:41.591333 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:18:41.591333 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:18:41.591333 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:18:41.591333 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:18:41.591333 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:18:41.591333 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 23 01:18:41.591333 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 23 01:18:41.591333 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 23 01:18:41.591333 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 23 01:18:41.591333 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1837697917' already exists. Oct 23 01:18:41.602180 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:18:41.602180 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:41.602180 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:18:41.602180 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:41.602180 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:18:41.602180 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:18:41.602180 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:18:41.602180 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:18:41.602180 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1837697917' already exists. Oct 23 01:18:41.602180 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:18:41.602180 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-22206561-c6a2-49c2-b147-1b0e8a1a22c7 tempest-KeyPairsNegativeTestJSON-1632709755 tempest-KeyPairsNegativeTestJSON-1632709755-project] Returning 409 to user: Key pair 'tempest-keypair-1837697917' already exists. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:18:41.602180 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-22206561-c6a2-49c2-b147-1b0e8a1a22c7 tempest-KeyPairsNegativeTestJSON-1632709755 tempest-KeyPairsNegativeTestJSON-1632709755-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.182627 Oct 23 01:18:41.602180 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1098/2231] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 01:18:41 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 184 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:18:41.603473 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d15032d2-75ef-4cb0-8497-3520ec1f032e tempest-KeyPairsNegativeTestJSON-1632709755 tempest-KeyPairsNegativeTestJSON-1632709755-project] Calling method '.version_select at 0x7f5cc62113a0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:41.633305 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-adb75ca4-703e-4b4b-bd72-a54e6d913b2a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:41.633305 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-adb75ca4-703e-4b4b-bd72-a54e6d913b2a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:41.642380 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-adb75ca4-703e-4b4b-bd72-a54e6d913b2a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:41.643492 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-adb75ca4-703e-4b4b-bd72-a54e6d913b2a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:41.644505 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-adb75ca4-703e-4b4b-bd72-a54e6d913b2a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:41.645369 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-adb75ca4-703e-4b4b-bd72-a54e6d913b2a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:41.645932 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-adb75ca4-703e-4b4b-bd72-a54e6d913b2a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:41.646417 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-adb75ca4-703e-4b4b-bd72-a54e6d913b2a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:41.744420 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-adb75ca4-703e-4b4b-bd72-a54e6d913b2a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:41.755955 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-adb75ca4-703e-4b4b-bd72-a54e6d913b2a tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1183 microversion: 2.1 time: 0.133872 Oct 23 01:18:41.764266 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1099/2232] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:41 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:18:41.775542 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-01bc9ac0-ef85-4e44-9d24-8e01954886a3 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:41.776385 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-01bc9ac0-ef85-4e44-9d24-8e01954886a3 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: cce77239-7b98-4389-946e-8292bf160194] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:41.784776 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01bc9ac0-ef85-4e44-9d24-8e01954886a3 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:41.785277 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01bc9ac0-ef85-4e44-9d24-8e01954886a3 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:41.785722 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01bc9ac0-ef85-4e44-9d24-8e01954886a3 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:41.788642 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01bc9ac0-ef85-4e44-9d24-8e01954886a3 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:41.788642 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01bc9ac0-ef85-4e44-9d24-8e01954886a3 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:41.788642 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01bc9ac0-ef85-4e44-9d24-8e01954886a3 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:41.811697 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d15032d2-75ef-4cb0-8497-3520ec1f032e tempest-KeyPairsNegativeTestJSON-1632709755 tempest-KeyPairsNegativeTestJSON-1632709755-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1837697917" status: 202 len: 0 microversion: 2.1 time: 0.219368 Oct 23 01:18:41.811697 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1134/2233] 10.222.0.42 () {58 vars in 1221 bytes} [Sun Oct 23 01:18:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1837697917 => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:18:41.817602 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-af1892a0-2689-457a-a933-2c087d02ac9c req-e028bd83-7d3b-4993-a8a8-41583b93b17b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afd593c3-d69a-4d5d-81b9-15a3138378ae", "tag": "a7673b25-a889-40db-99b7-4d011a472009"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:18:41.827237 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-af1892a0-2689-457a-a933-2c087d02ac9c req-e028bd83-7d3b-4993-a8a8-41583b93b17b service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:41.827712 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-af1892a0-2689-457a-a933-2c087d02ac9c req-e028bd83-7d3b-4993-a8a8-41583b93b17b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:41.828135 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-af1892a0-2689-457a-a933-2c087d02ac9c req-e028bd83-7d3b-4993-a8a8-41583b93b17b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:41.841782 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-af1892a0-2689-457a-a933-2c087d02ac9c req-e028bd83-7d3b-4993-a8a8-41583b93b17b service nova] Creating event network-changed:a7673b25-a889-40db-99b7-4d011a472009 for instance afd593c3-d69a-4d5d-81b9-15a3138378ae on n-h2-master-1 Oct 23 01:18:41.849255 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-af1892a0-2689-457a-a933-2c087d02ac9c req-e028bd83-7d3b-4993-a8a8-41583b93b17b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040436 Oct 23 01:18:41.854012 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1135/2234] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:18:41.859608 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f112f39d-f731-49c1-b42c-6af50fb21492 tempest-KeyPairsNegativeTestJSON-1632709755 tempest-KeyPairsNegativeTestJSON-1632709755-project] Action: 'create', calling method: .version_select at 0x7f5cc617ad30>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3344Yf/Wn4tS1raUBPTsnam8+IvtkKbDMVnRfjY/pSpuzSlzTZHolPWrg9xnqRL/wMOMOMsLsff+xCnQlKmPjCqzxM1R/1ZEdBPmorsibBHsvxmDoFm2WTj3ZDSLWE8A=="}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f112f39d-f731-49c1-b42c-6af50fb21492 tempest-KeyPairsNegativeTestJSON-1632709755 tempest-KeyPairsNegativeTestJSON-1632709755-project] Request method failure captured: Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 247 Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJZwxCtaYtjiTXv5ahs9YY5sD7hRAMuX6guJjE3yIfa1EsuAvpu6hU5QquYwfFg1E0zt1d_rVfKoLa1wRahb2_PU4lwuB0ddzGsOSd_4KvhcR_eeJ9e60MOjyThDOXRtkWZuFow0i0xAPOsCCtti8vMuzBr0Vq15PtU_B1Ix9D_Zkd4 Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 3d1b3354a10047758b81ad7ff50e39de Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1632709755 Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3d1b3354a10047758b81ad7ff50e39de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3d1b3354a10047758b81ad7ff50e39de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3d1b3354a10047758b81ad7ff50e39de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3d1b3354a10047758b81ad7ff50e39de"}]}] Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1632709755 Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 3d1b3354a10047758b81ad7ff50e39de Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1632709755 Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-KeyPairsNegativeTestJSON-1632709755-project Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 5afd08e7fa4f4de7ad5386562f536bd7 Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1632709755-project Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3344Yf/Wn4tS1raUBPTsnam8+IvtkKbDMVnRfjY/pSpuzSlzTZHolPWrg9xnqRL/wMOMOMsLsff+xCnQlKmPjCqzxM1R/1ZEdBPmorsibBHsvxmDoFm2WTj3ZDSLWE8A=="}} Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: method: Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3344Yf/Wn4tS1raUBPTsnam8+IvtkKbDMVnRfjY/pSpuzSlzTZHolPWrg9xnqRL/wMOMOMsLsff+xCnQlKmPjCqzxM1R/1ZEdBPmorsibBHsvxmDoFm2WTj3ZDSLWE8A=='}}} Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise error Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi '' Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 23 01:18:41.864195 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 23 01:18:41.870727 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 23 01:18:41.870727 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 23 01:18:41.870727 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 23 01:18:41.870727 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 23 01:18:41.870727 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 23 01:18:41.870727 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:41.870727 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:41.870727 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:41.870727 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:41.870727 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:18:41.870727 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:18:41.870727 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 23 01:18:41.870727 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 23 01:18:41.870727 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 23 01:18:41.870727 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:41.873095 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f112f39d-f731-49c1-b42c-6af50fb21492 tempest-KeyPairsNegativeTestJSON-1632709755 tempest-KeyPairsNegativeTestJSON-1632709755-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:18:41.874608 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f112f39d-f731-49c1-b42c-6af50fb21492 tempest-KeyPairsNegativeTestJSON-1632709755 tempest-KeyPairsNegativeTestJSON-1632709755-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.019244 Oct 23 01:18:41.875321 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1136/2235] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 01:18:41 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:18:41.890171 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5340d6b6-e628-4f7c-b4d1-23d78855d963 tempest-KeyPairsNegativeTestJSON-1632709755 tempest-KeyPairsNegativeTestJSON-1632709755-project] Action: 'create', calling method: .version_select at 0x7f5cc6205550>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1973751126", "public_key": " "}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:18:41.908994 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-5340d6b6-e628-4f7c-b4d1-23d78855d963 tempest-KeyPairsNegativeTestJSON-1632709755 tempest-KeyPairsNegativeTestJSON-1632709755-project] Getting quotas for project 3d1b3354a10047758b81ad7ff50e39de. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:18:41.933190 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-5340d6b6-e628-4f7c-b4d1-23d78855d963 tempest-KeyPairsNegativeTestJSON-1632709755 tempest-KeyPairsNegativeTestJSON-1632709755-project] Getting quotas for user 5afd08e7fa4f4de7ad5386562f536bd7 and project 3d1b3354a10047758b81ad7ff50e39de. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:18:42.015697 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-01bc9ac0-ef85-4e44-9d24-8e01954886a3 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:42.019192 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-5340d6b6-e628-4f7c-b4d1-23d78855d963 tempest-KeyPairsNegativeTestJSON-1632709755 tempest-KeyPairsNegativeTestJSON-1632709755-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5340d6b6-e628-4f7c-b4d1-23d78855d963 tempest-KeyPairsNegativeTestJSON-1632709755 tempest-KeyPairsNegativeTestJSON-1632709755-project] Request method failure captured: Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 95 Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJZwxCtaYtjiTXv5ahs9YY5sD7hRAMuX6guJjE3yIfa1EsuAvpu6hU5QquYwfFg1E0zt1d_rVfKoLa1wRahb2_PU4lwuB0ddzGsOSd_4KvhcR_eeJ9e60MOjyThDOXRtkWZuFow0i0xAPOsCCtti8vMuzBr0Vq15PtU_B1Ix9D_Zkd4 Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 3d1b3354a10047758b81ad7ff50e39de Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1632709755 Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3d1b3354a10047758b81ad7ff50e39de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3d1b3354a10047758b81ad7ff50e39de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3d1b3354a10047758b81ad7ff50e39de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3d1b3354a10047758b81ad7ff50e39de"}]}] Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1632709755 Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 3d1b3354a10047758b81ad7ff50e39de Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1632709755 Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-KeyPairsNegativeTestJSON-1632709755-project Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 5afd08e7fa4f4de7ad5386562f536bd7 Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1632709755-project Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1973751126", "public_key": " "}} Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: method: Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: exception: Keypair data is invalid: failed to generate fingerprint Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1973751126', 'public_key': ' '}}} Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise self.value Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:42.021084 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:42.026917 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:42.026917 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:18:42.026917 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:18:42.026917 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:18:42.026917 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:18:42.026917 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:18:42.026917 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:18:42.026917 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:18:42.026917 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:18:42.026917 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:18:42.026917 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:18:42.026917 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:18:42.026917 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:18:42.026917 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 23 01:18:42.026917 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 23 01:18:42.026917 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 23 01:18:42.026917 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 23 01:18:42.026917 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 23 01:18:42.026917 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:42.026917 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:42.026917 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:42.026917 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:42.026917 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:18:42.026917 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:18:42.026917 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:18:42.026917 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:18:42.026917 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 23 01:18:42.026917 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:42.026917 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5340d6b6-e628-4f7c-b4d1-23d78855d963 tempest-KeyPairsNegativeTestJSON-1632709755 tempest-KeyPairsNegativeTestJSON-1632709755-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:18:42.026917 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5340d6b6-e628-4f7c-b4d1-23d78855d963 tempest-KeyPairsNegativeTestJSON-1632709755 tempest-KeyPairsNegativeTestJSON-1632709755-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.138360 Oct 23 01:18:42.033590 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-01bc9ac0-ef85-4e44-9d24-8e01954886a3 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/cce77239-7b98-4389-946e-8292bf160194" status: 200 len: 1316 microversion: 2.1 time: 0.267402 Oct 23 01:18:42.050212 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1100/2236] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:41 2022] GET /compute/v2.1/servers/cce77239-7b98-4389-946e-8292bf160194 => generated 1316 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:42.052064 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1137/2237] 10.222.0.42 () {60 vars in 1158 bytes} [Sun Oct 23 01:18:41 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 168 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 23 01:18:42.057340 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7cff23f8-5536-4560-90af-2e8d2679ec16 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:42.058828 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7cff23f8-5536-4560-90af-2e8d2679ec16 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: d2d33142-cf85-4a5b-b63f-e3780f8ac0b1] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:42.061447 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-00c4b978-ab4c-4ff2-9814-d6409687cf4d tempest-KeyPairsNegativeTestJSON-1632709755 tempest-KeyPairsNegativeTestJSON-1632709755-project] Action: 'create', calling method: .version_select at 0x7f5cc626a9d0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIuhNzCbzIjf4TRPmUviYIqbN9orkV7BJlvZPzagWAbvGoBxW8ioKQ1gcx9+3Osb4bvFMJgLigE6mwws/etnPepdzpO+rI5p+2a23PuH7w+ezwjAb6tdZZf9xAEI6cJcvw=="}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:18:42.065854 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-00c4b978-ab4c-4ff2-9814-d6409687cf4d tempest-KeyPairsNegativeTestJSON-1632709755 tempest-KeyPairsNegativeTestJSON-1632709755-project] Request method failure captured: Oct 23 01:18:42.065854 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 23 01:18:42.065854 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:18:42.065854 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:18:42.065854 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:18:42.065854 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 507 Oct 23 01:18:42.065854 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:18:42.065854 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:18:42.065854 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:18:42.065854 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:18:42.065854 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJZwxCtaYtjiTXv5ahs9YY5sD7hRAMuX6guJjE3yIfa1EsuAvpu6hU5QquYwfFg1E0zt1d_rVfKoLa1wRahb2_PU4lwuB0ddzGsOSd_4KvhcR_eeJ9e60MOjyThDOXRtkWZuFow0i0xAPOsCCtti8vMuzBr0Vq15PtU_B1Ix9D_Zkd4 Oct 23 01:18:42.065854 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:18:42.065854 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:18:42.065854 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:18:42.065854 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:18:42.065854 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:18:42.065854 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:18:42.065854 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 3d1b3354a10047758b81ad7ff50e39de Oct 23 01:18:42.065854 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1632709755 Oct 23 01:18:42.065854 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:18:42.065854 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:18:42.065854 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3d1b3354a10047758b81ad7ff50e39de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3d1b3354a10047758b81ad7ff50e39de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3d1b3354a10047758b81ad7ff50e39de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3d1b3354a10047758b81ad7ff50e39de"}]}] Oct 23 01:18:42.065854 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1632709755 Oct 23 01:18:42.065854 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 3d1b3354a10047758b81ad7ff50e39de Oct 23 01:18:42.065854 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1632709755 Oct 23 01:18:42.065854 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-KeyPairsNegativeTestJSON-1632709755-project Oct 23 01:18:42.065854 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:18:42.065854 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:18:42.065854 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 5afd08e7fa4f4de7ad5386562f536bd7 Oct 23 01:18:42.065854 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1632709755-project Oct 23 01:18:42.065854 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:18:42.065854 n-d-master-1 devstack@n-api.service[120945]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIuhNzCbzIjf4TRPmUviYIqbN9orkV7BJlvZPzagWAbvGoBxW8ioKQ1gcx9+3Osb4bvFMJgLigE6mwws/etnPepdzpO+rI5p+2a23PuH7w+ezwjAb6tdZZf9xAEI6cJcvw=="}} Oct 23 01:18:42.065854 n-d-master-1 devstack@n-api.service[120945]: method: Oct 23 01:18:42.065854 n-d-master-1 devstack@n-api.service[120945]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 23 01:18:42.065854 n-d-master-1 devstack@n-api.service[120945]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIuhNzCbzIjf4TRPmUviYIqbN9orkV7BJlvZPzagWAbvGoBxW8ioKQ1gcx9+3Osb4bvFMJgLigE6mwws/etnPepdzpO+rI5p+2a23PuH7w+ezwjAb6tdZZf9xAEI6cJcvw=='}}} Oct 23 01:18:42.065854 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:18:42.065854 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:42.065854 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 23 01:18:42.065854 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 23 01:18:42.065854 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 01:18:42.065854 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise error Oct 23 01:18:42.065854 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 23 01:18:42.065854 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:42.065854 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 23 01:18:42.065854 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 23 01:18:42.065854 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:42.065854 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 23 01:18:42.065854 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 23 01:18:42.069332 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:42.069332 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:42.069332 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:42.069332 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:42.069332 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:18:42.069332 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:18:42.069332 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:18:42.069332 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:18:42.069332 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:18:42.069332 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:18:42.069332 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:18:42.069332 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:18:42.069332 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:18:42.069332 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:18:42.069332 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 23 01:18:42.069332 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 23 01:18:42.069332 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 23 01:18:42.069332 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 23 01:18:42.069332 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 23 01:18:42.069332 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 23 01:18:42.069332 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 23 01:18:42.069332 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:42.069332 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:42.069332 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:42.069332 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:42.069332 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:18:42.069332 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:18:42.069332 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 23 01:18:42.069332 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 23 01:18:42.069332 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 23 01:18:42.069332 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:42.069332 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-00c4b978-ab4c-4ff2-9814-d6409687cf4d tempest-KeyPairsNegativeTestJSON-1632709755 tempest-KeyPairsNegativeTestJSON-1632709755-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:18:42.069332 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-00c4b978-ab4c-4ff2-9814-d6409687cf4d tempest-KeyPairsNegativeTestJSON-1632709755 tempest-KeyPairsNegativeTestJSON-1632709755-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.013710 Oct 23 01:18:42.071710 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7cff23f8-5536-4560-90af-2e8d2679ec16 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:42.071710 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7cff23f8-5536-4560-90af-2e8d2679ec16 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:42.071710 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7cff23f8-5536-4560-90af-2e8d2679ec16 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:42.071957 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7cff23f8-5536-4560-90af-2e8d2679ec16 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:42.072313 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7cff23f8-5536-4560-90af-2e8d2679ec16 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:42.073813 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1138/2238] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 01:18:42 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:18:42.079004 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b6231c3e-2761-48b1-b762-e53ca0652984 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc617a1f0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:42.096065 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7cff23f8-5536-4560-90af-2e8d2679ec16 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:42.146666 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b6231c3e-2761-48b1-b762-e53ca0652984 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/051dcffd-8f6c-4ce9-9ba8-61db53bafce2" status: 200 len: 1414 microversion: 2.1 time: 0.071538 Oct 23 01:18:42.147253 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1139/2239] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:18:42 2022] GET /compute/v2.1/images/051dcffd-8f6c-4ce9-9ba8-61db53bafce2 => generated 1414 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:42.155960 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8762455a-1eed-46b3-9fc6-5cb4a99c2577 tempest-KeyPairsNegativeTestJSON-1632709755 tempest-KeyPairsNegativeTestJSON-1632709755-project] Action: 'create', calling method: .version_select at 0x7f5cc6211c10>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-378360810", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:18:42.201421 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-8762455a-1eed-46b3-9fc6-5cb4a99c2577 tempest-KeyPairsNegativeTestJSON-1632709755 tempest-KeyPairsNegativeTestJSON-1632709755-project] Getting quotas for project 3d1b3354a10047758b81ad7ff50e39de. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:18:42.216355 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-8762455a-1eed-46b3-9fc6-5cb4a99c2577 tempest-KeyPairsNegativeTestJSON-1632709755 tempest-KeyPairsNegativeTestJSON-1632709755-project] Getting quotas for user 5afd08e7fa4f4de7ad5386562f536bd7 and project 3d1b3354a10047758b81ad7ff50e39de. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:18:42.256301 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-8762455a-1eed-46b3-9fc6-5cb4a99c2577 tempest-KeyPairsNegativeTestJSON-1632709755 tempest-KeyPairsNegativeTestJSON-1632709755-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8762455a-1eed-46b3-9fc6-5cb4a99c2577 tempest-KeyPairsNegativeTestJSON-1632709755 tempest-KeyPairsNegativeTestJSON-1632709755-project] Request method failure captured: Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 117 Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJZwxCtaYtjiTXv5ahs9YY5sD7hRAMuX6guJjE3yIfa1EsuAvpu6hU5QquYwfFg1E0zt1d_rVfKoLa1wRahb2_PU4lwuB0ddzGsOSd_4KvhcR_eeJ9e60MOjyThDOXRtkWZuFow0i0xAPOsCCtti8vMuzBr0Vq15PtU_B1Ix9D_Zkd4 Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 3d1b3354a10047758b81ad7ff50e39de Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1632709755 Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3d1b3354a10047758b81ad7ff50e39de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3d1b3354a10047758b81ad7ff50e39de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3d1b3354a10047758b81ad7ff50e39de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3d1b3354a10047758b81ad7ff50e39de"}]}] Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1632709755 Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 3d1b3354a10047758b81ad7ff50e39de Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1632709755 Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-KeyPairsNegativeTestJSON-1632709755-project Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 5afd08e7fa4f4de7ad5386562f536bd7 Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1632709755-project Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-378360810", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: method: Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: exception: Keypair data is invalid: failed to generate fingerprint Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-378360810', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise self.value Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 23 01:18:42.256964 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 23 01:18:42.262340 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 23 01:18:42.262340 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 23 01:18:42.262340 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 23 01:18:42.262340 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:42.262340 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:42.262340 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:42.262340 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:42.262340 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:18:42.262340 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:18:42.262340 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:18:42.262340 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:18:42.262340 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:18:42.262340 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:18:42.262340 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:18:42.262340 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:18:42.262340 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:18:42.262340 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:18:42.262340 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:18:42.262340 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:18:42.262340 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 23 01:18:42.262340 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 23 01:18:42.262340 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 23 01:18:42.262340 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 23 01:18:42.262340 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 23 01:18:42.262340 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:42.262340 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:42.262340 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:42.262340 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:42.262340 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:18:42.262340 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:18:42.262340 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:18:42.262340 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:18:42.262340 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 23 01:18:42.262340 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:42.270701 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8762455a-1eed-46b3-9fc6-5cb4a99c2577 tempest-KeyPairsNegativeTestJSON-1632709755 tempest-KeyPairsNegativeTestJSON-1632709755-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:18:42.272490 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8762455a-1eed-46b3-9fc6-5cb4a99c2577 tempest-KeyPairsNegativeTestJSON-1632709755 tempest-KeyPairsNegativeTestJSON-1632709755-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.123216 Oct 23 01:18:42.274078 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1140/2240] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 01:18:42 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 126 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 23 01:18:42.294585 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e2ab094f-a3f5-4c42-a492-e3928cbaac2e tempest-KeyPairsNegativeTestJSON-1632709755 tempest-KeyPairsNegativeTestJSON-1632709755-project] Calling method '.version_select at 0x7f5cc632a550>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:42.313737 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-e2ab094f-a3f5-4c42-a492-e3928cbaac2e tempest-KeyPairsNegativeTestJSON-1632709755 tempest-KeyPairsNegativeTestJSON-1632709755-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-44332128 not found for user 5afd08e7fa4f4de7ad5386562f536bd7 Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e2ab094f-a3f5-4c42-a492-e3928cbaac2e tempest-KeyPairsNegativeTestJSON-1632709755 tempest-KeyPairsNegativeTestJSON-1632709755-project] Request method failure captured: Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-44332128 HTTP/1.1 Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJZwxCtaYtjiTXv5ahs9YY5sD7hRAMuX6guJjE3yIfa1EsuAvpu6hU5QquYwfFg1E0zt1d_rVfKoLa1wRahb2_PU4lwuB0ddzGsOSd_4KvhcR_eeJ9e60MOjyThDOXRtkWZuFow0i0xAPOsCCtti8vMuzBr0Vq15PtU_B1Ix9D_Zkd4 Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 3d1b3354a10047758b81ad7ff50e39de Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1632709755 Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3d1b3354a10047758b81ad7ff50e39de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3d1b3354a10047758b81ad7ff50e39de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3d1b3354a10047758b81ad7ff50e39de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3d1b3354a10047758b81ad7ff50e39de"}]}] Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1632709755 Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 3d1b3354a10047758b81ad7ff50e39de Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1632709755 Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-KeyPairsNegativeTestJSON-1632709755-project Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 5afd08e7fa4f4de7ad5386562f536bd7 Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1632709755-project Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: method: Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: exception: Keypair tempest-keypair-non-existent-44332128 not found for user 5afd08e7fa4f4de7ad5386562f536bd7 Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'tempest-keypair-non-existent-44332128'} Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise self.value Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-44332128 not found for user 5afd08e7fa4f4de7ad5386562f536bd7 Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:42.319671 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:42.328047 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:42.328047 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:42.328047 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:18:42.328047 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:18:42.328047 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:18:42.328047 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:18:42.328047 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:18:42.328047 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:18:42.328047 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 23 01:18:42.328047 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:18:42.328047 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:18:42.328047 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:18:42.328047 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 23 01:18:42.328047 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 23 01:18:42.328047 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 23 01:18:42.328047 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 23 01:18:42.328047 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-44332128 not found for user 5afd08e7fa4f4de7ad5386562f536bd7 Oct 23 01:18:42.328047 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:42.328047 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:42.328047 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:42.328047 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:42.328047 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:18:42.328047 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:18:42.328047 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:18:42.328047 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:18:42.328047 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-44332128 not found for user 5afd08e7fa4f4de7ad5386562f536bd7 Oct 23 01:18:42.328047 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:42.328047 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e2ab094f-a3f5-4c42-a492-e3928cbaac2e tempest-KeyPairsNegativeTestJSON-1632709755 tempest-KeyPairsNegativeTestJSON-1632709755-project] Returning 404 to user: Keypair tempest-keypair-non-existent-44332128 not found for user 5afd08e7fa4f4de7ad5386562f536bd7 {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:18:42.328047 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e2ab094f-a3f5-4c42-a492-e3928cbaac2e tempest-KeyPairsNegativeTestJSON-1632709755 tempest-KeyPairsNegativeTestJSON-1632709755-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-44332128" status: 404 len: 143 microversion: 2.1 time: 0.036402 Oct 23 01:18:42.328047 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1141/2241] 10.222.0.42 () {58 vars in 1254 bytes} [Sun Oct 23 01:18:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-44332128 => generated 143 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:18:42.333315 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-61d9c233-f24c-459b-8b46-494bd1270cf6 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:42.333315 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-61d9c233-f24c-459b-8b46-494bd1270cf6 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] [instance: afd593c3-d69a-4d5d-81b9-15a3138378ae] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:42.336526 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61d9c233-f24c-459b-8b46-494bd1270cf6 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:42.337804 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61d9c233-f24c-459b-8b46-494bd1270cf6 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:42.338456 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61d9c233-f24c-459b-8b46-494bd1270cf6 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:42.339346 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61d9c233-f24c-459b-8b46-494bd1270cf6 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:42.339981 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61d9c233-f24c-459b-8b46-494bd1270cf6 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:42.340755 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61d9c233-f24c-459b-8b46-494bd1270cf6 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:42.343969 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7cff23f8-5536-4560-90af-2e8d2679ec16 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:42.374203 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7cff23f8-5536-4560-90af-2e8d2679ec16 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1" status: 200 len: 1514 microversion: 2.1 time: 0.333291 Oct 23 01:18:42.378193 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1101/2242] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:42 2022] GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 => generated 1514 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:42.531265 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-61d9c233-f24c-459b-8b46-494bd1270cf6 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8417cd8a252c4d3c9f2059c42bc82aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdabdb037d54103a656623e2c4c4a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:42.544531 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-61d9c233-f24c-459b-8b46-494bd1270cf6 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] 10.222.0.42 "GET /compute/v2.1/servers/afd593c3-d69a-4d5d-81b9-15a3138378ae" status: 200 len: 1321 microversion: 2.1 time: 0.219501 Oct 23 01:18:42.558559 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1142/2243] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:42 2022] GET /compute/v2.1/servers/afd593c3-d69a-4d5d-81b9-15a3138378ae => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:18:42.779086 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-14a5fd7f-88a0-430d-b766-f95433c0afcf tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:42.780112 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-14a5fd7f-88a0-430d-b766-f95433c0afcf tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:42.789217 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-14a5fd7f-88a0-430d-b766-f95433c0afcf tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:42.796400 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-14a5fd7f-88a0-430d-b766-f95433c0afcf tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:42.796400 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-14a5fd7f-88a0-430d-b766-f95433c0afcf tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:42.797095 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-14a5fd7f-88a0-430d-b766-f95433c0afcf tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:42.799548 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-14a5fd7f-88a0-430d-b766-f95433c0afcf tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:42.802505 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-14a5fd7f-88a0-430d-b766-f95433c0afcf tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:42.945507 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-14a5fd7f-88a0-430d-b766-f95433c0afcf tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:42.953295 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-14a5fd7f-88a0-430d-b766-f95433c0afcf tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1183 microversion: 2.1 time: 0.178142 Oct 23 01:18:42.972767 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1102/2244] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:42 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:43.016634 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-ff12ede8-f391-4ce3-8a2f-870d36855d4f req-5f4c6404-f86a-4c64-a25e-60a77b0cb73c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40104c3d-0e82-449a-a331-c4f6ba80afaf", "name": "network-vif-plugged", "status": "completed", "tag": "c2cc7df3-aa5d-4a0e-abe9-5229c05e5354"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:18:43.033031 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ff12ede8-f391-4ce3-8a2f-870d36855d4f req-5f4c6404-f86a-4c64-a25e-60a77b0cb73c service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:43.033764 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ff12ede8-f391-4ce3-8a2f-870d36855d4f req-5f4c6404-f86a-4c64-a25e-60a77b0cb73c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:43.034300 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ff12ede8-f391-4ce3-8a2f-870d36855d4f req-5f4c6404-f86a-4c64-a25e-60a77b0cb73c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:43.046283 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-ff12ede8-f391-4ce3-8a2f-870d36855d4f req-5f4c6404-f86a-4c64-a25e-60a77b0cb73c service nova] Creating event network-vif-plugged:c2cc7df3-aa5d-4a0e-abe9-5229c05e5354 for instance 40104c3d-0e82-449a-a331-c4f6ba80afaf on n-h1-master-1 Oct 23 01:18:43.051998 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-ff12ede8-f391-4ce3-8a2f-870d36855d4f req-5f4c6404-f86a-4c64-a25e-60a77b0cb73c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041511 Oct 23 01:18:43.052594 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1143/2245] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:18:43.059040 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c2307386-b784-42c4-8b84-1b4e99354ed8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:43.060787 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c2307386-b784-42c4-8b84-1b4e99354ed8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: cce77239-7b98-4389-946e-8292bf160194] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:43.070764 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2307386-b784-42c4-8b84-1b4e99354ed8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:43.077430 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2307386-b784-42c4-8b84-1b4e99354ed8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:43.078422 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2307386-b784-42c4-8b84-1b4e99354ed8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:43.080310 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2307386-b784-42c4-8b84-1b4e99354ed8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:43.080786 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2307386-b784-42c4-8b84-1b4e99354ed8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:43.081205 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2307386-b784-42c4-8b84-1b4e99354ed8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:43.123649 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:43.167582 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f9f53efb-f351-4098-a7f0-2f85c52c5d63 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc626a670>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:43.234373 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f9f53efb-f351-4098-a7f0-2f85c52c5d63 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/051dcffd-8f6c-4ce9-9ba8-61db53bafce2" status: 200 len: 1414 microversion: 2.1 time: 0.075649 Oct 23 01:18:43.238027 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1144/2246] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:18:43 2022] GET /compute/v2.1/images/051dcffd-8f6c-4ce9-9ba8-61db53bafce2 => generated 1414 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:43.344865 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c2307386-b784-42c4-8b84-1b4e99354ed8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:43.353389 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c2307386-b784-42c4-8b84-1b4e99354ed8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/cce77239-7b98-4389-946e-8292bf160194" status: 200 len: 1506 microversion: 2.1 time: 0.299646 Oct 23 01:18:43.354868 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1103/2247] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:43 2022] GET /compute/v2.1/servers/cce77239-7b98-4389-946e-8292bf160194 => generated 1506 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:43.382232 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-740ac887-5198-47ee-83e7-68a8a6194a73 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:43.382995 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-740ac887-5198-47ee-83e7-68a8a6194a73 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: cce77239-7b98-4389-946e-8292bf160194] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:43.390982 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-740ac887-5198-47ee-83e7-68a8a6194a73 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:43.395806 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-740ac887-5198-47ee-83e7-68a8a6194a73 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:43.395806 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-740ac887-5198-47ee-83e7-68a8a6194a73 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:43.395806 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-740ac887-5198-47ee-83e7-68a8a6194a73 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:43.395806 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-740ac887-5198-47ee-83e7-68a8a6194a73 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:43.395806 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-740ac887-5198-47ee-83e7-68a8a6194a73 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:43.402383 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-33578220-e3c7-425f-8229-aa9ccb8cb195 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:43.403102 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-33578220-e3c7-425f-8229-aa9ccb8cb195 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: d2d33142-cf85-4a5b-b63f-e3780f8ac0b1] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:43.411491 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-33578220-e3c7-425f-8229-aa9ccb8cb195 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:43.413398 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-33578220-e3c7-425f-8229-aa9ccb8cb195 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:43.414853 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-33578220-e3c7-425f-8229-aa9ccb8cb195 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:43.417462 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-33578220-e3c7-425f-8229-aa9ccb8cb195 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:43.418258 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-33578220-e3c7-425f-8229-aa9ccb8cb195 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:43.418901 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-33578220-e3c7-425f-8229-aa9ccb8cb195 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:43.428977 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-740ac887-5198-47ee-83e7-68a8a6194a73 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: cce77239-7b98-4389-946e-8292bf160194] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:18:43.890673 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-33578220-e3c7-425f-8229-aa9ccb8cb195 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:43.890673 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-33578220-e3c7-425f-8229-aa9ccb8cb195 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1" status: 200 len: 1514 microversion: 2.1 time: 0.230705 Oct 23 01:18:43.890673 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1104/2248] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:43 2022] GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 => generated 1514 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:18:43.890673 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-22eeb323-9461-4dd5-a4ca-4df09caca0e4 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:43.890673 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-22eeb323-9461-4dd5-a4ca-4df09caca0e4 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] [instance: afd593c3-d69a-4d5d-81b9-15a3138378ae] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:43.890673 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-22eeb323-9461-4dd5-a4ca-4df09caca0e4 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:43.890673 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-22eeb323-9461-4dd5-a4ca-4df09caca0e4 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:43.890673 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-22eeb323-9461-4dd5-a4ca-4df09caca0e4 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:43.890673 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-22eeb323-9461-4dd5-a4ca-4df09caca0e4 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:43.890673 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-22eeb323-9461-4dd5-a4ca-4df09caca0e4 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:43.890673 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-22eeb323-9461-4dd5-a4ca-4df09caca0e4 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:43.890673 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-22eeb323-9461-4dd5-a4ca-4df09caca0e4 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8417cd8a252c4d3c9f2059c42bc82aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdabdb037d54103a656623e2c4c4a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:43.894512 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-22eeb323-9461-4dd5-a4ca-4df09caca0e4 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] 10.222.0.42 "GET /compute/v2.1/servers/afd593c3-d69a-4d5d-81b9-15a3138378ae" status: 200 len: 1321 microversion: 2.1 time: 0.191084 Oct 23 01:18:43.894512 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1105/2249] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:43 2022] GET /compute/v2.1/servers/afd593c3-d69a-4d5d-81b9-15a3138378ae => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:43.982646 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e0e5e3aa-8658-4f7e-93c5-1cd0f56c2f93 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:43.983946 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e0e5e3aa-8658-4f7e-93c5-1cd0f56c2f93 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:43.992071 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0e5e3aa-8658-4f7e-93c5-1cd0f56c2f93 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:43.993429 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0e5e3aa-8658-4f7e-93c5-1cd0f56c2f93 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:43.994220 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0e5e3aa-8658-4f7e-93c5-1cd0f56c2f93 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:43.995454 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0e5e3aa-8658-4f7e-93c5-1cd0f56c2f93 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:43.996191 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0e5e3aa-8658-4f7e-93c5-1cd0f56c2f93 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:43.997085 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0e5e3aa-8658-4f7e-93c5-1cd0f56c2f93 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:44.116900 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e0e5e3aa-8658-4f7e-93c5-1cd0f56c2f93 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:44.133750 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e0e5e3aa-8658-4f7e-93c5-1cd0f56c2f93 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1183 microversion: 2.1 time: 0.156197 Oct 23 01:18:44.134750 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1106/2250] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:43 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:44.139070 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-740ac887-5198-47ee-83e7-68a8a6194a73 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "DELETE /compute/v2.1/servers/cce77239-7b98-4389-946e-8292bf160194" status: 204 len: 0 microversion: 2.1 time: 0.760765 Oct 23 01:18:44.139914 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1145/2251] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:18:43 2022] DELETE /compute/v2.1/servers/cce77239-7b98-4389-946e-8292bf160194 => generated 0 bytes in 763 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:18:44.160967 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e5d3c6dd-a4f2-4e47-b9f8-50ccffd3371d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:44.164581 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e5d3c6dd-a4f2-4e47-b9f8-50ccffd3371d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: cce77239-7b98-4389-946e-8292bf160194] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:44.213950 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e5d3c6dd-a4f2-4e47-b9f8-50ccffd3371d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:44.216046 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e5d3c6dd-a4f2-4e47-b9f8-50ccffd3371d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:44.217948 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e5d3c6dd-a4f2-4e47-b9f8-50ccffd3371d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:44.222477 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e5d3c6dd-a4f2-4e47-b9f8-50ccffd3371d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:44.223191 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e5d3c6dd-a4f2-4e47-b9f8-50ccffd3371d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:44.223963 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e5d3c6dd-a4f2-4e47-b9f8-50ccffd3371d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:44.253175 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-afd927f2-6317-417c-a32d-40cb143b3072 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc6211670>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:44.275711 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=11 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:44.358091 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-afd927f2-6317-417c-a32d-40cb143b3072 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/051dcffd-8f6c-4ce9-9ba8-61db53bafce2" status: 200 len: 1414 microversion: 2.1 time: 0.110433 Oct 23 01:18:44.358976 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1146/2252] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:18:44 2022] GET /compute/v2.1/images/051dcffd-8f6c-4ce9-9ba8-61db53bafce2 => generated 1414 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:44.608026 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e5d3c6dd-a4f2-4e47-b9f8-50ccffd3371d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:44.624712 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e5d3c6dd-a4f2-4e47-b9f8-50ccffd3371d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/cce77239-7b98-4389-946e-8292bf160194" status: 200 len: 1512 microversion: 2.1 time: 0.476823 Oct 23 01:18:44.628085 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1107/2253] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:44 2022] GET /compute/v2.1/servers/cce77239-7b98-4389-946e-8292bf160194 => generated 1512 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:44.655013 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-64e17995-41bd-4f3e-983e-519c7f6b871c tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:44.656270 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-64e17995-41bd-4f3e-983e-519c7f6b871c tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: d2d33142-cf85-4a5b-b63f-e3780f8ac0b1] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:44.668037 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64e17995-41bd-4f3e-983e-519c7f6b871c tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:44.668917 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64e17995-41bd-4f3e-983e-519c7f6b871c tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:44.670586 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64e17995-41bd-4f3e-983e-519c7f6b871c tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:44.675427 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64e17995-41bd-4f3e-983e-519c7f6b871c tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:44.676482 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64e17995-41bd-4f3e-983e-519c7f6b871c tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:44.677135 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64e17995-41bd-4f3e-983e-519c7f6b871c tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:44.845055 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a19ecd17-27ba-41fe-9efc-b45faa1266dc tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:44.845710 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a19ecd17-27ba-41fe-9efc-b45faa1266dc tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] [instance: afd593c3-d69a-4d5d-81b9-15a3138378ae] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:44.855957 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a19ecd17-27ba-41fe-9efc-b45faa1266dc tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:44.860006 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a19ecd17-27ba-41fe-9efc-b45faa1266dc tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:44.864817 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a19ecd17-27ba-41fe-9efc-b45faa1266dc tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:44.865835 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a19ecd17-27ba-41fe-9efc-b45faa1266dc tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:44.871887 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a19ecd17-27ba-41fe-9efc-b45faa1266dc tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:44.872464 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a19ecd17-27ba-41fe-9efc-b45faa1266dc tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:44.980115 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-64e17995-41bd-4f3e-983e-519c7f6b871c tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:44.991526 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-64e17995-41bd-4f3e-983e-519c7f6b871c tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1" status: 200 len: 1514 microversion: 2.1 time: 0.340854 Oct 23 01:18:44.995470 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1147/2254] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:44 2022] GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 => generated 1514 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:45.156862 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bf333610-71c6-4de4-a9da-f6bfe0e4b668 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:45.157615 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-bf333610-71c6-4de4-a9da-f6bfe0e4b668 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:45.168652 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bf333610-71c6-4de4-a9da-f6bfe0e4b668 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:45.169085 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bf333610-71c6-4de4-a9da-f6bfe0e4b668 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:45.169500 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bf333610-71c6-4de4-a9da-f6bfe0e4b668 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:45.170228 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bf333610-71c6-4de4-a9da-f6bfe0e4b668 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:45.170720 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bf333610-71c6-4de4-a9da-f6bfe0e4b668 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:45.174739 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bf333610-71c6-4de4-a9da-f6bfe0e4b668 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:45.203306 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a19ecd17-27ba-41fe-9efc-b45faa1266dc tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8417cd8a252c4d3c9f2059c42bc82aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdabdb037d54103a656623e2c4c4a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:45.214797 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a19ecd17-27ba-41fe-9efc-b45faa1266dc tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] 10.222.0.42 "GET /compute/v2.1/servers/afd593c3-d69a-4d5d-81b9-15a3138378ae" status: 200 len: 1321 microversion: 2.1 time: 0.372228 Oct 23 01:18:45.219049 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1108/2255] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:44 2022] GET /compute/v2.1/servers/afd593c3-d69a-4d5d-81b9-15a3138378ae => generated 1321 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:45.332234 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bf333610-71c6-4de4-a9da-f6bfe0e4b668 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:45.345169 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bf333610-71c6-4de4-a9da-f6bfe0e4b668 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1183 microversion: 2.1 time: 0.192044 Oct 23 01:18:45.368661 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1148/2256] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:45 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1183 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:45.374313 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-da39368b-3a5b-4004-b4e8-f6ddab027bc2 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc6202550>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:45.452622 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-da39368b-3a5b-4004-b4e8-f6ddab027bc2 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/051dcffd-8f6c-4ce9-9ba8-61db53bafce2" status: 200 len: 1414 microversion: 2.1 time: 0.080132 Oct 23 01:18:45.453839 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1109/2257] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:18:45 2022] GET /compute/v2.1/images/051dcffd-8f6c-4ce9-9ba8-61db53bafce2 => generated 1414 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:45.657209 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5a4dea66-f923-4ac6-82c9-20dd10b2ed8d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:45.658782 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5a4dea66-f923-4ac6-82c9-20dd10b2ed8d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: cce77239-7b98-4389-946e-8292bf160194] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:45.683563 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5a4dea66-f923-4ac6-82c9-20dd10b2ed8d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:45.684297 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5a4dea66-f923-4ac6-82c9-20dd10b2ed8d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:45.684995 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5a4dea66-f923-4ac6-82c9-20dd10b2ed8d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:45.686674 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5a4dea66-f923-4ac6-82c9-20dd10b2ed8d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:45.688104 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5a4dea66-f923-4ac6-82c9-20dd10b2ed8d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:45.689570 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5a4dea66-f923-4ac6-82c9-20dd10b2ed8d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:46.080177 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2e54cee2-1e39-422a-96e4-575920a3e593 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:46.080177 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2e54cee2-1e39-422a-96e4-575920a3e593 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: d2d33142-cf85-4a5b-b63f-e3780f8ac0b1] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:46.080177 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e54cee2-1e39-422a-96e4-575920a3e593 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:46.080177 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e54cee2-1e39-422a-96e4-575920a3e593 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:46.080177 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e54cee2-1e39-422a-96e4-575920a3e593 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:46.080177 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e54cee2-1e39-422a-96e4-575920a3e593 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:46.080177 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e54cee2-1e39-422a-96e4-575920a3e593 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:46.080177 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e54cee2-1e39-422a-96e4-575920a3e593 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:46.148415 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5a4dea66-f923-4ac6-82c9-20dd10b2ed8d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:46.156639 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5a4dea66-f923-4ac6-82c9-20dd10b2ed8d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/cce77239-7b98-4389-946e-8292bf160194" status: 200 len: 1512 microversion: 2.1 time: 0.503575 Oct 23 01:18:46.157848 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1149/2258] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:45 2022] GET /compute/v2.1/servers/cce77239-7b98-4389-946e-8292bf160194 => generated 1512 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:46.239878 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-29ebdbef-2329-4366-823a-8b1987dc3346 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:46.241206 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-29ebdbef-2329-4366-823a-8b1987dc3346 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] [instance: afd593c3-d69a-4d5d-81b9-15a3138378ae] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:46.261809 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-29ebdbef-2329-4366-823a-8b1987dc3346 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:46.264829 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-29ebdbef-2329-4366-823a-8b1987dc3346 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:46.265881 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-29ebdbef-2329-4366-823a-8b1987dc3346 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:46.271045 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-29ebdbef-2329-4366-823a-8b1987dc3346 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:46.271962 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-29ebdbef-2329-4366-823a-8b1987dc3346 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:46.273120 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-29ebdbef-2329-4366-823a-8b1987dc3346 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:46.791777 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2e54cee2-1e39-422a-96e4-575920a3e593 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:46.806110 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2e54cee2-1e39-422a-96e4-575920a3e593 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1" status: 200 len: 1514 microversion: 2.1 time: 0.786914 Oct 23 01:18:46.806997 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1110/2259] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:46 2022] GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 => generated 1514 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:18:46.814013 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-54c17b61-d1f0-40cf-aa73-ae470bf7e0a2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:46.815981 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-54c17b61-d1f0-40cf-aa73-ae470bf7e0a2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:46.833862 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-54c17b61-d1f0-40cf-aa73-ae470bf7e0a2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:46.838362 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-54c17b61-d1f0-40cf-aa73-ae470bf7e0a2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:46.839097 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-54c17b61-d1f0-40cf-aa73-ae470bf7e0a2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:46.840024 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-54c17b61-d1f0-40cf-aa73-ae470bf7e0a2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:46.841235 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-54c17b61-d1f0-40cf-aa73-ae470bf7e0a2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:46.842922 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-54c17b61-d1f0-40cf-aa73-ae470bf7e0a2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:47.014458 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-54c17b61-d1f0-40cf-aa73-ae470bf7e0a2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:47.024855 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-54c17b61-d1f0-40cf-aa73-ae470bf7e0a2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1183 microversion: 2.1 time: 0.216496 Oct 23 01:18:47.026078 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1111/2260] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:46 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1183 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:47.030855 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-26b05205-3408-438a-8522-fe3183872ba5 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc62124c0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:47.069291 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-29ebdbef-2329-4366-823a-8b1987dc3346 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8417cd8a252c4d3c9f2059c42bc82aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdabdb037d54103a656623e2c4c4a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:47.083978 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-29ebdbef-2329-4366-823a-8b1987dc3346 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] 10.222.0.42 "GET /compute/v2.1/servers/afd593c3-d69a-4d5d-81b9-15a3138378ae" status: 200 len: 1321 microversion: 2.1 time: 0.847317 Oct 23 01:18:47.088467 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1150/2261] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:46 2022] GET /compute/v2.1/servers/afd593c3-d69a-4d5d-81b9-15a3138378ae => generated 1321 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:47.097656 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-1237547f-fc35-44d4-a191-7a3ddc41f916 req-61e2eee0-c8a6-4086-a041-1fc09c4e1d38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afd593c3-d69a-4d5d-81b9-15a3138378ae", "name": "network-vif-plugged", "status": "completed", "tag": "a7673b25-a889-40db-99b7-4d011a472009"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:18:47.116670 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-1237547f-fc35-44d4-a191-7a3ddc41f916 req-61e2eee0-c8a6-4086-a041-1fc09c4e1d38 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:47.118064 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-1237547f-fc35-44d4-a191-7a3ddc41f916 req-61e2eee0-c8a6-4086-a041-1fc09c4e1d38 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:47.118682 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-1237547f-fc35-44d4-a191-7a3ddc41f916 req-61e2eee0-c8a6-4086-a041-1fc09c4e1d38 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:47.138319 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-26b05205-3408-438a-8522-fe3183872ba5 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/051dcffd-8f6c-4ce9-9ba8-61db53bafce2" status: 200 len: 1414 microversion: 2.1 time: 0.110874 Oct 23 01:18:47.146948 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1112/2262] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:18:47 2022] GET /compute/v2.1/images/051dcffd-8f6c-4ce9-9ba8-61db53bafce2 => generated 1414 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:47.149147 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-1237547f-fc35-44d4-a191-7a3ddc41f916 req-61e2eee0-c8a6-4086-a041-1fc09c4e1d38 service nova] Creating event network-vif-plugged:a7673b25-a889-40db-99b7-4d011a472009 for instance afd593c3-d69a-4d5d-81b9-15a3138378ae on n-h2-master-1 Oct 23 01:18:47.157771 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-1237547f-fc35-44d4-a191-7a3ddc41f916 req-61e2eee0-c8a6-4086-a041-1fc09c4e1d38 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066582 Oct 23 01:18:47.159564 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1151/2263] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:18:47.181470 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1480e806-1a33-40d0-9b11-38808f2a7555 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:47.182155 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1480e806-1a33-40d0-9b11-38808f2a7555 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: cce77239-7b98-4389-946e-8292bf160194] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:47.190229 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1480e806-1a33-40d0-9b11-38808f2a7555 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:47.190881 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1480e806-1a33-40d0-9b11-38808f2a7555 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:47.191386 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1480e806-1a33-40d0-9b11-38808f2a7555 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:47.192114 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1480e806-1a33-40d0-9b11-38808f2a7555 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:47.192574 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1480e806-1a33-40d0-9b11-38808f2a7555 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:47.193159 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1480e806-1a33-40d0-9b11-38808f2a7555 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:47.619277 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1480e806-1a33-40d0-9b11-38808f2a7555 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:47.628410 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1480e806-1a33-40d0-9b11-38808f2a7555 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/cce77239-7b98-4389-946e-8292bf160194" status: 200 len: 1512 microversion: 2.1 time: 0.451974 Oct 23 01:18:47.632820 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1113/2264] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:47 2022] GET /compute/v2.1/servers/cce77239-7b98-4389-946e-8292bf160194 => generated 1512 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:47.835335 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-87c6a6ce-8157-40f0-bed8-1ffdde99d510 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:47.836923 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-87c6a6ce-8157-40f0-bed8-1ffdde99d510 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: d2d33142-cf85-4a5b-b63f-e3780f8ac0b1] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:47.841718 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:47.848449 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-87c6a6ce-8157-40f0-bed8-1ffdde99d510 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:47.849742 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-87c6a6ce-8157-40f0-bed8-1ffdde99d510 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:47.850457 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-87c6a6ce-8157-40f0-bed8-1ffdde99d510 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:47.860882 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-87c6a6ce-8157-40f0-bed8-1ffdde99d510 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:47.860882 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-87c6a6ce-8157-40f0-bed8-1ffdde99d510 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:47.860882 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-87c6a6ce-8157-40f0-bed8-1ffdde99d510 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:48.049962 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-56988705-9a6d-463c-bd2a-7d65a47e08b9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:48.050668 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-56988705-9a6d-463c-bd2a-7d65a47e08b9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:48.067406 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-56988705-9a6d-463c-bd2a-7d65a47e08b9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:48.068641 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-56988705-9a6d-463c-bd2a-7d65a47e08b9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:48.069262 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-56988705-9a6d-463c-bd2a-7d65a47e08b9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:48.070206 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-56988705-9a6d-463c-bd2a-7d65a47e08b9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:48.070816 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-56988705-9a6d-463c-bd2a-7d65a47e08b9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:48.071407 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-56988705-9a6d-463c-bd2a-7d65a47e08b9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:48.132030 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-56988705-9a6d-463c-bd2a-7d65a47e08b9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:48.138002 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-56988705-9a6d-463c-bd2a-7d65a47e08b9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:48.140140 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-56988705-9a6d-463c-bd2a-7d65a47e08b9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:48.147448 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-56988705-9a6d-463c-bd2a-7d65a47e08b9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lazy-loading 'fault' on Instance uuid dad12d7a-a01e-4f91-b35e-4f9f83df5b3b {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:18:48.433893 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-56988705-9a6d-463c-bd2a-7d65a47e08b9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:48.444880 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-56988705-9a6d-463c-bd2a-7d65a47e08b9 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1188 microversion: 2.1 time: 0.399675 Oct 23 01:18:48.445423 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1114/2265] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:48 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1188 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:48.453267 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-009e69d4-1d9e-4aa7-9f20-36c11b8572bf tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:48.457616 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-009e69d4-1d9e-4aa7-9f20-36c11b8572bf tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] [instance: afd593c3-d69a-4d5d-81b9-15a3138378ae] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:48.490213 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-009e69d4-1d9e-4aa7-9f20-36c11b8572bf tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:48.497262 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-009e69d4-1d9e-4aa7-9f20-36c11b8572bf tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:48.497262 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-009e69d4-1d9e-4aa7-9f20-36c11b8572bf tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:48.497262 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-009e69d4-1d9e-4aa7-9f20-36c11b8572bf tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:48.497262 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-009e69d4-1d9e-4aa7-9f20-36c11b8572bf tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:48.497262 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-009e69d4-1d9e-4aa7-9f20-36c11b8572bf tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:48.524685 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-87c6a6ce-8157-40f0-bed8-1ffdde99d510 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:48.535924 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-87c6a6ce-8157-40f0-bed8-1ffdde99d510 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1" status: 200 len: 1514 microversion: 2.1 time: 0.707805 Oct 23 01:18:48.546190 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1152/2266] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:47 2022] GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 => generated 1514 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:48.554783 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cf09b541-dd96-42f2-aa44-dab3a6ba3abb tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc6186a60>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:48.683625 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cf09b541-dd96-42f2-aa44-dab3a6ba3abb tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/051dcffd-8f6c-4ce9-9ba8-61db53bafce2" status: 200 len: 1414 microversion: 2.1 time: 0.135682 Oct 23 01:18:48.684255 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1153/2267] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:18:48 2022] GET /compute/v2.1/images/051dcffd-8f6c-4ce9-9ba8-61db53bafce2 => generated 1414 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:48.693949 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-de4fb9ba-6257-4555-930e-045d67ff0961 req-aed10b63-b49b-4ff8-a75c-e4c6986b64ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cce77239-7b98-4389-946e-8292bf160194", "name": "network-vif-deleted", "tag": "aac9c20f-b1fa-4122-a799-18f1a928951f"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:18:48.719659 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-de4fb9ba-6257-4555-930e-045d67ff0961 req-aed10b63-b49b-4ff8-a75c-e4c6986b64ee service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:48.720147 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-de4fb9ba-6257-4555-930e-045d67ff0961 req-aed10b63-b49b-4ff8-a75c-e4c6986b64ee service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:48.720742 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-de4fb9ba-6257-4555-930e-045d67ff0961 req-aed10b63-b49b-4ff8-a75c-e4c6986b64ee service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:48.736058 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-de4fb9ba-6257-4555-930e-045d67ff0961 req-aed10b63-b49b-4ff8-a75c-e4c6986b64ee service nova] Creating event network-vif-deleted:aac9c20f-b1fa-4122-a799-18f1a928951f for instance cce77239-7b98-4389-946e-8292bf160194 on n-h1-master-1 Oct 23 01:18:48.744186 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-de4fb9ba-6257-4555-930e-045d67ff0961 req-aed10b63-b49b-4ff8-a75c-e4c6986b64ee service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058223 Oct 23 01:18:48.745138 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1154/2268] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:18:48.752945 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c0526f2e-3a66-4a3d-83c7-130894dd19a0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:48.753801 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c0526f2e-3a66-4a3d-83c7-130894dd19a0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: cce77239-7b98-4389-946e-8292bf160194] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:48.764399 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c0526f2e-3a66-4a3d-83c7-130894dd19a0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:48.764901 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c0526f2e-3a66-4a3d-83c7-130894dd19a0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:48.766453 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c0526f2e-3a66-4a3d-83c7-130894dd19a0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:48.767181 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c0526f2e-3a66-4a3d-83c7-130894dd19a0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:48.774919 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:48.778334 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c0526f2e-3a66-4a3d-83c7-130894dd19a0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:48.779161 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c0526f2e-3a66-4a3d-83c7-130894dd19a0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:48.993579 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c0526f2e-3a66-4a3d-83c7-130894dd19a0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:49.019512 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c0526f2e-3a66-4a3d-83c7-130894dd19a0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/cce77239-7b98-4389-946e-8292bf160194" status: 200 len: 1301 microversion: 2.1 time: 0.272516 Oct 23 01:18:49.030985 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1155/2269] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:48 2022] GET /compute/v2.1/servers/cce77239-7b98-4389-946e-8292bf160194 => generated 1301 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:49.193616 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-009e69d4-1d9e-4aa7-9f20-36c11b8572bf tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8417cd8a252c4d3c9f2059c42bc82aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdabdb037d54103a656623e2c4c4a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:49.207125 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-009e69d4-1d9e-4aa7-9f20-36c11b8572bf tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] 10.222.0.42 "GET /compute/v2.1/servers/afd593c3-d69a-4d5d-81b9-15a3138378ae" status: 200 len: 1321 microversion: 2.1 time: 0.759464 Oct 23 01:18:49.207716 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1115/2270] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:48 2022] GET /compute/v2.1/servers/afd593c3-d69a-4d5d-81b9-15a3138378ae => generated 1321 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:49.471940 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-52ea59d6-e3bf-45d0-9b39-e4039649eedc tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:49.472632 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-52ea59d6-e3bf-45d0-9b39-e4039649eedc tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:49.482065 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52ea59d6-e3bf-45d0-9b39-e4039649eedc tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:49.482573 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52ea59d6-e3bf-45d0-9b39-e4039649eedc tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:49.483018 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52ea59d6-e3bf-45d0-9b39-e4039649eedc tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:49.483742 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52ea59d6-e3bf-45d0-9b39-e4039649eedc tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:49.484205 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52ea59d6-e3bf-45d0-9b39-e4039649eedc tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:49.484633 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52ea59d6-e3bf-45d0-9b39-e4039649eedc tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:49.558889 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52ea59d6-e3bf-45d0-9b39-e4039649eedc tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:49.560159 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52ea59d6-e3bf-45d0-9b39-e4039649eedc tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:49.561001 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52ea59d6-e3bf-45d0-9b39-e4039649eedc tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:49.561636 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-52ea59d6-e3bf-45d0-9b39-e4039649eedc tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lazy-loading 'fault' on Instance uuid dad12d7a-a01e-4f91-b35e-4f9f83df5b3b {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:18:49.581361 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-abf6c2d1-36d0-4ba6-b67f-6a87a88965e2 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:49.581683 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-abf6c2d1-36d0-4ba6-b67f-6a87a88965e2 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: d2d33142-cf85-4a5b-b63f-e3780f8ac0b1] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:49.598368 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-abf6c2d1-36d0-4ba6-b67f-6a87a88965e2 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:49.598878 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-abf6c2d1-36d0-4ba6-b67f-6a87a88965e2 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:49.599329 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-abf6c2d1-36d0-4ba6-b67f-6a87a88965e2 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:49.600076 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-abf6c2d1-36d0-4ba6-b67f-6a87a88965e2 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:49.600558 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-abf6c2d1-36d0-4ba6-b67f-6a87a88965e2 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:49.609579 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-abf6c2d1-36d0-4ba6-b67f-6a87a88965e2 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:49.794109 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-52ea59d6-e3bf-45d0-9b39-e4039649eedc tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:49.794109 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:49.794109 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-52ea59d6-e3bf-45d0-9b39-e4039649eedc tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 200 len: 1188 microversion: 2.1 time: 0.260939 Oct 23 01:18:49.794109 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1156/2271] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:49 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 1188 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:49.794109 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ac0c7585-de22-4f11-b32b-281b3e17b01c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc61c6af0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:49.794109 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ac0c7585-de22-4f11-b32b-281b3e17b01c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/051dcffd-8f6c-4ce9-9ba8-61db53bafce2" status: 200 len: 1414 microversion: 2.1 time: 0.055560 Oct 23 01:18:49.794109 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1157/2272] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:18:49 2022] GET /compute/v2.1/images/051dcffd-8f6c-4ce9-9ba8-61db53bafce2 => generated 1414 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:50.021451 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-abf6c2d1-36d0-4ba6-b67f-6a87a88965e2 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:50.034230 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-abf6c2d1-36d0-4ba6-b67f-6a87a88965e2 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1" status: 200 len: 1514 microversion: 2.1 time: 0.465040 Oct 23 01:18:50.035623 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1116/2273] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:49 2022] GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 => generated 1514 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:50.049211 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bd0f9bd5-4cdc-4daf-977b-4f6c288f3c1f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:50.050204 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-bd0f9bd5-4cdc-4daf-977b-4f6c288f3c1f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: cce77239-7b98-4389-946e-8292bf160194] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:50.067337 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd0f9bd5-4cdc-4daf-977b-4f6c288f3c1f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:50.073228 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd0f9bd5-4cdc-4daf-977b-4f6c288f3c1f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:50.075340 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd0f9bd5-4cdc-4daf-977b-4f6c288f3c1f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:50.076573 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd0f9bd5-4cdc-4daf-977b-4f6c288f3c1f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:50.077207 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd0f9bd5-4cdc-4daf-977b-4f6c288f3c1f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:50.077789 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd0f9bd5-4cdc-4daf-977b-4f6c288f3c1f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:50.149016 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd0f9bd5-4cdc-4daf-977b-4f6c288f3c1f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:50.149606 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd0f9bd5-4cdc-4daf-977b-4f6c288f3c1f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:50.149948 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd0f9bd5-4cdc-4daf-977b-4f6c288f3c1f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:50.152323 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-bd0f9bd5-4cdc-4daf-977b-4f6c288f3c1f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lazy-loading 'fault' on Instance uuid cce77239-7b98-4389-946e-8292bf160194 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:18:50.234797 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-edff6109-cd48-42d8-b72f-4e43abfd43f0 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:50.235431 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-edff6109-cd48-42d8-b72f-4e43abfd43f0 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] [instance: afd593c3-d69a-4d5d-81b9-15a3138378ae] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:50.252475 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-edff6109-cd48-42d8-b72f-4e43abfd43f0 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:50.261420 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bd0f9bd5-4cdc-4daf-977b-4f6c288f3c1f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:50.266331 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-edff6109-cd48-42d8-b72f-4e43abfd43f0 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:50.267096 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-edff6109-cd48-42d8-b72f-4e43abfd43f0 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:50.270823 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-edff6109-cd48-42d8-b72f-4e43abfd43f0 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:50.272862 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-edff6109-cd48-42d8-b72f-4e43abfd43f0 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:50.273488 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-edff6109-cd48-42d8-b72f-4e43abfd43f0 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:50.274721 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bd0f9bd5-4cdc-4daf-977b-4f6c288f3c1f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/cce77239-7b98-4389-946e-8292bf160194" status: 200 len: 1306 microversion: 2.1 time: 0.232556 Oct 23 01:18:50.278284 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1158/2274] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:50 2022] GET /compute/v2.1/servers/cce77239-7b98-4389-946e-8292bf160194 => generated 1306 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:50.757507 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bc61fdff-bb5b-45cb-838d-e7406fceffc2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:50.760992 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-bc61fdff-bb5b-45cb-838d-e7406fceffc2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: dad12d7a-a01e-4f91-b35e-4f9f83df5b3b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:50.776939 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bc61fdff-bb5b-45cb-838d-e7406fceffc2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:50.780230 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bc61fdff-bb5b-45cb-838d-e7406fceffc2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:50.782834 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bc61fdff-bb5b-45cb-838d-e7406fceffc2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:50.784484 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bc61fdff-bb5b-45cb-838d-e7406fceffc2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:50.786069 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bc61fdff-bb5b-45cb-838d-e7406fceffc2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:50.788183 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bc61fdff-bb5b-45cb-838d-e7406fceffc2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:50.855273 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-bc61fdff-bb5b-45cb-838d-e7406fceffc2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] HTTP exception thrown: Instance dad12d7a-a01e-4f91-b35e-4f9f83df5b3b could not be found. Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bc61fdff-bb5b-45cb-838d-e7406fceffc2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Request method failure captured: Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b HTTP/1.1 Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJSlUKnwUUKDqVJ5SU0WlCbPMoTauyFJSJPCNWG4h-zCSHoo3KNkNO-CFy9_VuCymiA8kUSdGjR2yGG7onVmef7qXNWa7ROigyW7eGZs7ikwf4EUyMcuHo1C1lWtM2HnrUtFga6W0hGpij0W06vuDpo6qY-r0hwnHSvBgTzaVac7oHg Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: d46a7166e4144f55a102ea6335c5f820 Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-LiveMigrationTest-627897414 Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d46a7166e4144f55a102ea6335c5f820"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d46a7166e4144f55a102ea6335c5f820"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d46a7166e4144f55a102ea6335c5f820"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d46a7166e4144f55a102ea6335c5f820"}]}] Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-LiveMigrationTest-627897414 Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: d46a7166e4144f55a102ea6335c5f820 Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-LiveMigrationTest-627897414 Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-LiveMigrationTest-627897414-project Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 1c2310cbc3574eb29a6ca6291ba7808e Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-LiveMigrationTest-627897414-project Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: exception: Instance dad12d7a-a01e-4f91-b35e-4f9f83df5b3b could not be found. Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'dad12d7a-a01e-4f91-b35e-4f9f83df5b3b'} Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dad12d7a-a01e-4f91-b35e-4f9f83df5b3b could not be found. Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dad12d7a-a01e-4f91-b35e-4f9f83df5b3b could not be found. Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:50.857925 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:50.861881 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:50.861881 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:18:50.861881 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:18:50.861881 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:18:50.861881 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:18:50.861881 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dad12d7a-a01e-4f91-b35e-4f9f83df5b3b could not be found. Oct 23 01:18:50.861881 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:18:50.867212 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bc61fdff-bb5b-45cb-838d-e7406fceffc2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Returning 404 to user: Instance dad12d7a-a01e-4f91-b35e-4f9f83df5b3b could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:18:50.869917 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bc61fdff-bb5b-45cb-838d-e7406fceffc2 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b" status: 404 len: 111 microversion: 2.1 time: 0.118638 Oct 23 01:18:50.872117 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1159/2275] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:50 2022] GET /compute/v2.1/servers/dad12d7a-a01e-4f91-b35e-4f9f83df5b3b => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:18:50.882849 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9551133f-d024-4ecb-b745-d30c16b80939 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc61c6820>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:50.984421 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9551133f-d024-4ecb-b745-d30c16b80939 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/051dcffd-8f6c-4ce9-9ba8-61db53bafce2" status: 200 len: 1414 microversion: 2.1 time: 0.107864 Oct 23 01:18:50.987261 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1160/2276] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:18:50 2022] GET /compute/v2.1/images/051dcffd-8f6c-4ce9-9ba8-61db53bafce2 => generated 1414 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:51.062725 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-63630caa-3b2f-424d-9b15-597e2ccb9a0e tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:51.063367 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-63630caa-3b2f-424d-9b15-597e2ccb9a0e tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: d2d33142-cf85-4a5b-b63f-e3780f8ac0b1] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:51.096008 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-63630caa-3b2f-424d-9b15-597e2ccb9a0e tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:51.096972 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-edff6109-cd48-42d8-b72f-4e43abfd43f0 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8417cd8a252c4d3c9f2059c42bc82aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdabdb037d54103a656623e2c4c4a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:51.112194 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-63630caa-3b2f-424d-9b15-597e2ccb9a0e tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:51.117083 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-63630caa-3b2f-424d-9b15-597e2ccb9a0e tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:51.117299 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-edff6109-cd48-42d8-b72f-4e43abfd43f0 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] 10.222.0.42 "GET /compute/v2.1/servers/afd593c3-d69a-4d5d-81b9-15a3138378ae" status: 200 len: 1471 microversion: 2.1 time: 0.880907 Oct 23 01:18:51.117929 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-63630caa-3b2f-424d-9b15-597e2ccb9a0e tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:51.120338 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1117/2277] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:50 2022] GET /compute/v2.1/servers/afd593c3-d69a-4d5d-81b9-15a3138378ae => generated 1471 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:51.125772 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-63630caa-3b2f-424d-9b15-597e2ccb9a0e tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:51.127048 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-63630caa-3b2f-424d-9b15-597e2ccb9a0e tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:51.740858 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0a7ca0ac-a8f2-4acd-bd36-1ee379e3910c tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:18:51.742272 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0a7ca0ac-a8f2-4acd-bd36-1ee379e3910c tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] [instance: 8d52a16f-c248-4ab6-8c08-764abe111fa6] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:51.759592 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-0a7ca0ac-a8f2-4acd-bd36-1ee379e3910c tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] HTTP exception thrown: Instance 8d52a16f-c248-4ab6-8c08-764abe111fa6 could not be found. Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0a7ca0ac-a8f2-4acd-bd36-1ee379e3910c tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] Request method failure captured: Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/servers/8d52a16f-c248-4ab6-8c08-764abe111fa6/action HTTP/1.1 Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 15 Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJZo-MVusHe_JL7N5naiBnsLSxL2-gw3DhycBckt9c95xzA9l8CPMwkSlbDocXbv66cjXeV_VDC6sjcnFLxhblM5TRtHo6MK2QRE6PbdQUa1aZtGmVzwFBOP0CFZhDEHJ8VjHvj3GmI4Iie5_uvuGFqTUjMl8OYduRWQrdZDidzZ3Us Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 154b9d85a646422ea4978904144a7aff Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-842589533 Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,admin,reader Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,admin,reader Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/154b9d85a646422ea4978904144a7aff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_154b9d85a646422ea4978904144a7aff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/154b9d85a646422ea4978904144a7aff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/154b9d85a646422ea4978904144a7aff"}]}] Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersAdminNegativeTestJSON-842589533 Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 154b9d85a646422ea4978904144a7aff Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-842589533 Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersAdminNegativeTestJSON-842589533-project-admin Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 1055f18673474d189a5605319bc301da Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersAdminNegativeTestJSON-842589533-project-admin Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: {"migrate": {}} Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 8d52a16f-c248-4ab6-8c08-764abe111fa6 could not be found. Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '8d52a16f-c248-4ab6-8c08-764abe111fa6', 'body': {'migrate': {}}} Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d52a16f-c248-4ab6-8c08-764abe111fa6 could not be found. Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d52a16f-c248-4ab6-8c08-764abe111fa6 could not be found. Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:18:51.765541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:51.770543 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:18:51.770543 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:18:51.770543 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:18:51.770543 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:18:51.770543 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d52a16f-c248-4ab6-8c08-764abe111fa6 could not be found. Oct 23 01:18:51.770543 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:18:51.770543 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0a7ca0ac-a8f2-4acd-bd36-1ee379e3910c tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] Returning 404 to user: Instance 8d52a16f-c248-4ab6-8c08-764abe111fa6 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:18:51.779144 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0a7ca0ac-a8f2-4acd-bd36-1ee379e3910c tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/8d52a16f-c248-4ab6-8c08-764abe111fa6/action" status: 404 len: 111 microversion: 2.1 time: 0.629725 Oct 23 01:18:51.784166 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1118/2278] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:18:51 2022] POST /compute/v2.1/servers/8d52a16f-c248-4ab6-8c08-764abe111fa6/action => generated 111 bytes in 640 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 01:18:51.811055 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-aa4a14a2-4c00-499d-bc70-9d81950e7c15 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:51.815911 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-aa4a14a2-4c00-499d-bc70-9d81950e7c15 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: cce77239-7b98-4389-946e-8292bf160194] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:51.844870 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aa4a14a2-4c00-499d-bc70-9d81950e7c15 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:51.855249 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aa4a14a2-4c00-499d-bc70-9d81950e7c15 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:51.860591 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aa4a14a2-4c00-499d-bc70-9d81950e7c15 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:51.863767 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aa4a14a2-4c00-499d-bc70-9d81950e7c15 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:51.870376 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aa4a14a2-4c00-499d-bc70-9d81950e7c15 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:51.878550 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aa4a14a2-4c00-499d-bc70-9d81950e7c15 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:51.942000 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-aa4a14a2-4c00-499d-bc70-9d81950e7c15 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] HTTP exception thrown: Instance cce77239-7b98-4389-946e-8292bf160194 could not be found. Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-aa4a14a2-4c00-499d-bc70-9d81950e7c15 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Request method failure captured: Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/cce77239-7b98-4389-946e-8292bf160194 HTTP/1.1 Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJZEAurAeILsYJek3MCv_ryiTbidOLVZq6W4I7jJxeY_1_bTWRye2xM3EDOhowd_NyioevvIvzT9beBCgKqri_ZjLw9hdsIISMXmajO_VmobATT_GwpY_Y-GVylQtV9MoF1-Bup_Ahjld_2riQHnDzqLUWULm2acZYcK9UIbslVsdDU Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}] Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: cd6a6c5240f94ace91e1f0ed3e53fa7c Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: exception: Instance cce77239-7b98-4389-946e-8292bf160194 could not be found. Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'cce77239-7b98-4389-946e-8292bf160194'} Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cce77239-7b98-4389-946e-8292bf160194 could not be found. Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cce77239-7b98-4389-946e-8292bf160194 could not be found. Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:51.944824 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:18:51.947867 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:51.947867 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:18:51.947867 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:18:51.947867 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:18:51.947867 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:18:51.947867 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cce77239-7b98-4389-946e-8292bf160194 could not be found. Oct 23 01:18:51.947867 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:18:51.957832 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-aa4a14a2-4c00-499d-bc70-9d81950e7c15 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Returning 404 to user: Instance cce77239-7b98-4389-946e-8292bf160194 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:18:51.964720 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-aa4a14a2-4c00-499d-bc70-9d81950e7c15 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/cce77239-7b98-4389-946e-8292bf160194" status: 404 len: 111 microversion: 2.1 time: 0.175107 Oct 23 01:18:51.968255 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1119/2279] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:51 2022] GET /compute/v2.1/servers/cce77239-7b98-4389-946e-8292bf160194 => generated 111 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:18:51.991860 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-76192d76-a63d-4a57-b74f-d738f73494e1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:51.992877 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-76192d76-a63d-4a57-b74f-d738f73494e1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:52.019648 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-76192d76-a63d-4a57-b74f-d738f73494e1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:52.020467 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-76192d76-a63d-4a57-b74f-d738f73494e1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:52.021066 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-76192d76-a63d-4a57-b74f-d738f73494e1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:52.031334 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-76192d76-a63d-4a57-b74f-d738f73494e1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:52.032278 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-76192d76-a63d-4a57-b74f-d738f73494e1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:52.032981 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-76192d76-a63d-4a57-b74f-d738f73494e1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:52.473664 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-63630caa-3b2f-424d-9b15-597e2ccb9a0e tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:52.485728 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-63630caa-3b2f-424d-9b15-597e2ccb9a0e tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1" status: 200 len: 1514 microversion: 2.1 time: 1.428460 Oct 23 01:18:52.505824 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1161/2280] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:51 2022] GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 => generated 1514 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:52.521847 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e0c4616e-d9f3-4465-baee-1a9cb49aead9 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc62de790>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:52.700788 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e0c4616e-d9f3-4465-baee-1a9cb49aead9 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/051dcffd-8f6c-4ce9-9ba8-61db53bafce2" status: 200 len: 1414 microversion: 2.1 time: 0.189946 Oct 23 01:18:52.700788 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1162/2281] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:18:52 2022] GET /compute/v2.1/images/051dcffd-8f6c-4ce9-9ba8-61db53bafce2 => generated 1414 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:52.719437 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-05995e85-d72c-43dd-9baa-f23799c0178b tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1630202736", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:18:52.823686 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-76192d76-a63d-4a57-b74f-d738f73494e1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:52.840275 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-76192d76-a63d-4a57-b74f-d738f73494e1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.865149 Oct 23 01:18:52.844514 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1120/2282] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:51 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:52.869889 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-05995e85-d72c-43dd-9baa-f23799c0178b tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] validate_networks() for None {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:18:53.028787 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=15 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:53.155513 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c62d6b87-9058-43c8-a5cc-d8e896d159f4 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "06f4c921-9d2b-4ef6-806f-b77fdc508baa"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c62d6b87-9058-43c8-a5cc-d8e896d159f4 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Request method failure captured: Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 163 Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJZEAurAeILsYJek3MCv_ryiTbidOLVZq6W4I7jJxeY_1_bTWRye2xM3EDOhowd_NyioevvIvzT9beBCgKqri_ZjLw9hdsIISMXmajO_VmobATT_GwpY_Y-GVylQtV9MoF1-Bup_Ahjld_2riQHnDzqLUWULm2acZYcK9UIbslVsdDU Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}] Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: cd6a6c5240f94ace91e1f0ed3e53fa7c Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: {"server": {"name": 12345, "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "06f4c921-9d2b-4ef6-806f-b77fdc508baa"}]}} Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '446b40bc-db5b-4123-9278-997bd6d04a0d', 'flavorRef': '452', 'networks': [{'uuid': '06f4c921-9d2b-4ef6-806f-b77fdc508baa'}]}}} Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise error Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi 12345 Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 23 01:18:53.160182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 23 01:18:53.164435 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 23 01:18:53.164435 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 23 01:18:53.164435 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:18:53.164435 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:18:53.164435 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:18:53.164435 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:18:53.164435 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:18:53.164435 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:18:53.164435 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 23 01:18:53.164435 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 23 01:18:53.164435 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 23 01:18:53.164435 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:18:53.164435 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c62d6b87-9058-43c8-a5cc-d8e896d159f4 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:18:53.165660 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c62d6b87-9058-43c8-a5cc-d8e896d159f4 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.010231 Oct 23 01:18:53.169410 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1121/2283] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:18:53 2022] POST /compute/v2.1/servers => generated 127 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:18:53.181607 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-20fb0af2-3a2f-47bb-82b9-ba9cdd3693e6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:53.200262 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-20fb0af2-3a2f-47bb-82b9-ba9cdd3693e6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:53.245165 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20fb0af2-3a2f-47bb-82b9-ba9cdd3693e6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:53.247499 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20fb0af2-3a2f-47bb-82b9-ba9cdd3693e6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:53.248459 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20fb0af2-3a2f-47bb-82b9-ba9cdd3693e6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:53.252051 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20fb0af2-3a2f-47bb-82b9-ba9cdd3693e6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:53.253346 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20fb0af2-3a2f-47bb-82b9-ba9cdd3693e6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:53.255508 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20fb0af2-3a2f-47bb-82b9-ba9cdd3693e6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:53.337350 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=3 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:53.790536 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-05995e85-d72c-43dd-9baa-f23799c0178b tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:18:53.791019 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-05995e85-d72c-43dd-9baa-f23799c0178b tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:18:53.791410 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-05995e85-d72c-43dd-9baa-f23799c0178b tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:18:53.791816 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-05995e85-d72c-43dd-9baa-f23799c0178b tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:18:53.792222 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-05995e85-d72c-43dd-9baa-f23799c0178b tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:18:53.824535 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05995e85-d72c-43dd-9baa-f23799c0178b tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:53.825063 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05995e85-d72c-43dd-9baa-f23799c0178b tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:53.825506 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05995e85-d72c-43dd-9baa-f23799c0178b tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:53.826305 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05995e85-d72c-43dd-9baa-f23799c0178b tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:53.826716 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05995e85-d72c-43dd-9baa-f23799c0178b tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:53.827138 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05995e85-d72c-43dd-9baa-f23799c0178b tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:53.884713 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-20fb0af2-3a2f-47bb-82b9-ba9cdd3693e6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:53.893897 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-20fb0af2-3a2f-47bb-82b9-ba9cdd3693e6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.722466 Oct 23 01:18:53.894536 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1122/2284] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:53 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:53.900687 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-05995e85-d72c-43dd-9baa-f23799c0178b tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Getting quotas for project bcdabdb037d54103a656623e2c4c4a78. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:18:53.935133 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a4b07f7f-41b0-47e7-9310-57f4b0debd27 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:53.935833 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a4b07f7f-41b0-47e7-9310-57f4b0debd27 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: d2d33142-cf85-4a5b-b63f-e3780f8ac0b1] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:53.937992 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-05995e85-d72c-43dd-9baa-f23799c0178b tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Getting quotas for user 8417cd8a252c4d3c9f2059c42bc82aa0 and project bcdabdb037d54103a656623e2c4c4a78. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:18:53.960763 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a4b07f7f-41b0-47e7-9310-57f4b0debd27 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:53.960763 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a4b07f7f-41b0-47e7-9310-57f4b0debd27 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:53.962364 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a4b07f7f-41b0-47e7-9310-57f4b0debd27 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:53.963199 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a4b07f7f-41b0-47e7-9310-57f4b0debd27 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:53.963678 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a4b07f7f-41b0-47e7-9310-57f4b0debd27 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:53.964109 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a4b07f7f-41b0-47e7-9310-57f4b0debd27 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:53.987992 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-05995e85-d72c-43dd-9baa-f23799c0178b tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:18:53.994875 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-05995e85-d72c-43dd-9baa-f23799c0178b tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] [instance: 2dc8d790-1306-4a6d-b14d-6c3c1639770c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:18:54.198575 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-05995e85-d72c-43dd-9baa-f23799c0178b tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.486450 Oct 23 01:18:54.201570 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1163/2285] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:18:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1503 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:18:54.221716 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ae2a59e8-fca9-4458-80c2-0b0ad45ef341 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc6274700>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:54.355051 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ae2a59e8-fca9-4458-80c2-0b0ad45ef341 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/051dcffd-8f6c-4ce9-9ba8-61db53bafce2" status: 200 len: 1414 microversion: 2.1 time: 0.152159 Oct 23 01:18:54.356939 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1164/2286] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:18:54 2022] GET /compute/v2.1/images/051dcffd-8f6c-4ce9-9ba8-61db53bafce2 => generated 1414 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:54.375561 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a4b07f7f-41b0-47e7-9310-57f4b0debd27 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:54.383464 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-da1bd2fd-9d58-45bd-bcd3-e61641ffeeb8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:54.384143 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-da1bd2fd-9d58-45bd-bcd3-e61641ffeeb8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:54.385560 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a4b07f7f-41b0-47e7-9310-57f4b0debd27 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1" status: 200 len: 1514 microversion: 2.1 time: 0.478573 Oct 23 01:18:54.386179 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1123/2287] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:53 2022] GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 => generated 1514 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:54.396939 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c46fb856-fcb3-45ac-bbd4-5a77da15818b tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:54.403650 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c46fb856-fcb3-45ac-bbd4-5a77da15818b tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] [instance: 2dc8d790-1306-4a6d-b14d-6c3c1639770c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:54.418744 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da1bd2fd-9d58-45bd-bcd3-e61641ffeeb8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:54.419287 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da1bd2fd-9d58-45bd-bcd3-e61641ffeeb8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:54.430559 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da1bd2fd-9d58-45bd-bcd3-e61641ffeeb8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:54.432929 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da1bd2fd-9d58-45bd-bcd3-e61641ffeeb8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:54.432929 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da1bd2fd-9d58-45bd-bcd3-e61641ffeeb8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:54.432929 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da1bd2fd-9d58-45bd-bcd3-e61641ffeeb8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:54.581830 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c46fb856-fcb3-45ac-bbd4-5a77da15818b tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8417cd8a252c4d3c9f2059c42bc82aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdabdb037d54103a656623e2c4c4a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:54.587095 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c46fb856-fcb3-45ac-bbd4-5a77da15818b tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] 10.222.0.42 "GET /compute/v2.1/servers/2dc8d790-1306-4a6d-b14d-6c3c1639770c" status: 200 len: 1222 microversion: 2.1 time: 0.198566 Oct 23 01:18:54.589553 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1124/2288] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:54 2022] GET /compute/v2.1/servers/2dc8d790-1306-4a6d-b14d-6c3c1639770c => generated 1222 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:54.619681 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7adc88a8-6050-497d-8ffc-4cb71db15fa4 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-488203841", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "f12f5541-6400-4914-829d-7bf5434dae5d"}], "block_device_mapping_v2": [{"uuid": "ee34787a-b108-4e18-9eb1-b37062c8887b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:18:54.804719 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-7adc88a8-6050-497d-8ffc-4cb71db15fa4 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] validate_networks() for [('f12f5541-6400-4914-829d-7bf5434dae5d', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:18:55.425953 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-da1bd2fd-9d58-45bd-bcd3-e61641ffeeb8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:55.443264 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-da1bd2fd-9d58-45bd-bcd3-e61641ffeeb8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 1.084818 Oct 23 01:18:55.444739 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1165/2289] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:54 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:55.461880 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8f634315-b15e-4df3-831f-0df694733ca6 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc24ddc10>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:55.623625 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8f634315-b15e-4df3-831f-0df694733ca6 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/051dcffd-8f6c-4ce9-9ba8-61db53bafce2" status: 200 len: 1414 microversion: 2.1 time: 0.176507 Oct 23 01:18:55.624266 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1166/2290] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:18:55 2022] GET /compute/v2.1/images/051dcffd-8f6c-4ce9-9ba8-61db53bafce2 => generated 1414 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:55.648316 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7bf4854f-6d63-495d-9749-66de09a0c1f1 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:55.649046 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7bf4854f-6d63-495d-9749-66de09a0c1f1 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: d2d33142-cf85-4a5b-b63f-e3780f8ac0b1] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:55.684157 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7bf4854f-6d63-495d-9749-66de09a0c1f1 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:55.684922 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7bf4854f-6d63-495d-9749-66de09a0c1f1 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:55.685386 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7bf4854f-6d63-495d-9749-66de09a0c1f1 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:55.688144 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7bf4854f-6d63-495d-9749-66de09a0c1f1 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:55.688144 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7bf4854f-6d63-495d-9749-66de09a0c1f1 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:55.694627 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7bf4854f-6d63-495d-9749-66de09a0c1f1 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:56.219514 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7bf4854f-6d63-495d-9749-66de09a0c1f1 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:56.252666 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7bf4854f-6d63-495d-9749-66de09a0c1f1 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1" status: 200 len: 1514 microversion: 2.1 time: 0.627188 Oct 23 01:18:56.259215 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1167/2291] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:55 2022] GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 => generated 1514 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:56.274053 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a51412f4-b08d-4823-917b-b61ab37ad046 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:56.277115 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a51412f4-b08d-4823-917b-b61ab37ad046 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] [instance: 2dc8d790-1306-4a6d-b14d-6c3c1639770c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:56.300029 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a51412f4-b08d-4823-917b-b61ab37ad046 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:56.302524 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a51412f4-b08d-4823-917b-b61ab37ad046 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:56.304140 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a51412f4-b08d-4823-917b-b61ab37ad046 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:56.308923 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a51412f4-b08d-4823-917b-b61ab37ad046 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:56.309492 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a51412f4-b08d-4823-917b-b61ab37ad046 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:56.309943 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a51412f4-b08d-4823-917b-b61ab37ad046 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:56.575314 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a51412f4-b08d-4823-917b-b61ab37ad046 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8417cd8a252c4d3c9f2059c42bc82aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdabdb037d54103a656623e2c4c4a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:56.593452 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a51412f4-b08d-4823-917b-b61ab37ad046 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] 10.222.0.42 "GET /compute/v2.1/servers/2dc8d790-1306-4a6d-b14d-6c3c1639770c" status: 200 len: 1218 microversion: 2.1 time: 0.328447 Oct 23 01:18:56.612633 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1168/2292] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:56 2022] GET /compute/v2.1/servers/2dc8d790-1306-4a6d-b14d-6c3c1639770c => generated 1218 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:56.641503 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1c749f36-3241-4e51-831e-39a98f6c1572 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc6186b80>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:56.734087 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1c749f36-3241-4e51-831e-39a98f6c1572 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/051dcffd-8f6c-4ce9-9ba8-61db53bafce2" status: 200 len: 1414 microversion: 2.1 time: 0.094810 Oct 23 01:18:56.743190 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1169/2293] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:18:56 2022] GET /compute/v2.1/images/051dcffd-8f6c-4ce9-9ba8-61db53bafce2 => generated 1414 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:56.911520 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-7adc88a8-6050-497d-8ffc-4cb71db15fa4 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:18:56.912062 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-7adc88a8-6050-497d-8ffc-4cb71db15fa4 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:18:56.914197 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-7adc88a8-6050-497d-8ffc-4cb71db15fa4 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:18:56.914197 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-7adc88a8-6050-497d-8ffc-4cb71db15fa4 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:18:56.914197 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-7adc88a8-6050-497d-8ffc-4cb71db15fa4 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:18:56.934599 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7adc88a8-6050-497d-8ffc-4cb71db15fa4 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:56.941258 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7adc88a8-6050-497d-8ffc-4cb71db15fa4 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:56.941258 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7adc88a8-6050-497d-8ffc-4cb71db15fa4 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:56.941258 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7adc88a8-6050-497d-8ffc-4cb71db15fa4 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:56.941700 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7adc88a8-6050-497d-8ffc-4cb71db15fa4 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:56.941964 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7adc88a8-6050-497d-8ffc-4cb71db15fa4 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:57.016684 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-7adc88a8-6050-497d-8ffc-4cb71db15fa4 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Getting quotas for project ccc52d9ecfdf43f58b665d06e1008b52. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:18:57.030944 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=98,nova_api:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:57.037451 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-7adc88a8-6050-497d-8ffc-4cb71db15fa4 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Getting quotas for user 8a246c84d8f444d59c9d5becae78f75a and project ccc52d9ecfdf43f58b665d06e1008b52. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:18:57.252910 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7adc88a8-6050-497d-8ffc-4cb71db15fa4 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:18:57.255169 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7adc88a8-6050-497d-8ffc-4cb71db15fa4 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ee34787a-b108-4e18-9eb1-b37062c8887b',volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:18:57.292849 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ec3dcd18-2bc0-4473-a681-571da6dc3a50 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:57.294086 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ec3dcd18-2bc0-4473-a681-571da6dc3a50 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: d2d33142-cf85-4a5b-b63f-e3780f8ac0b1] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:57.324003 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec3dcd18-2bc0-4473-a681-571da6dc3a50 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:57.330160 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec3dcd18-2bc0-4473-a681-571da6dc3a50 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:57.331106 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec3dcd18-2bc0-4473-a681-571da6dc3a50 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:57.334093 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec3dcd18-2bc0-4473-a681-571da6dc3a50 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:57.347532 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec3dcd18-2bc0-4473-a681-571da6dc3a50 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:57.353023 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec3dcd18-2bc0-4473-a681-571da6dc3a50 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:58.008789 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7adc88a8-6050-497d-8ffc-4cb71db15fa4 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.416655 Oct 23 01:18:58.032206 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1125/2294] 10.222.0.42 () {62 vars in 1188 bytes} [Sun Oct 23 01:18:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 3442 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 23 01:18:58.044437 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a1c3f959-0ea4-4ae0-9cbb-52e1b2714129 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:58.075392 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a1c3f959-0ea4-4ae0-9cbb-52e1b2714129 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] [instance: 2dc8d790-1306-4a6d-b14d-6c3c1639770c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:58.119202 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a1c3f959-0ea4-4ae0-9cbb-52e1b2714129 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:58.132464 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a1c3f959-0ea4-4ae0-9cbb-52e1b2714129 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:58.132950 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a1c3f959-0ea4-4ae0-9cbb-52e1b2714129 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:58.133753 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a1c3f959-0ea4-4ae0-9cbb-52e1b2714129 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:58.134256 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a1c3f959-0ea4-4ae0-9cbb-52e1b2714129 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:58.134694 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a1c3f959-0ea4-4ae0-9cbb-52e1b2714129 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:58.156814 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=100 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:58.984715 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a1c3f959-0ea4-4ae0-9cbb-52e1b2714129 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8417cd8a252c4d3c9f2059c42bc82aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdabdb037d54103a656623e2c4c4a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:59.006199 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a1c3f959-0ea4-4ae0-9cbb-52e1b2714129 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] 10.222.0.42 "GET /compute/v2.1/servers/2dc8d790-1306-4a6d-b14d-6c3c1639770c" status: 200 len: 1282 microversion: 2.1 time: 0.972632 Oct 23 01:18:59.010198 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1126/2295] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:58 2022] GET /compute/v2.1/servers/2dc8d790-1306-4a6d-b14d-6c3c1639770c => generated 1282 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:59.018579 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-56ca597e-30f6-48bb-8ed3-5d2f02263e1d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc62185e0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:59.113281 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-56ca597e-30f6-48bb-8ed3-5d2f02263e1d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/051dcffd-8f6c-4ce9-9ba8-61db53bafce2" status: 200 len: 1414 microversion: 2.1 time: 0.100719 Oct 23 01:18:59.114220 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1127/2296] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:18:59 2022] GET /compute/v2.1/images/051dcffd-8f6c-4ce9-9ba8-61db53bafce2 => generated 1414 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:59.149485 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-22cbcaad-c584-4d85-a232-94f022e9d00f tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:59.155719 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-22cbcaad-c584-4d85-a232-94f022e9d00f tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:59.587070 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-22cbcaad-c584-4d85-a232-94f022e9d00f tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:59.631511 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-22cbcaad-c584-4d85-a232-94f022e9d00f tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:59.635264 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ec3dcd18-2bc0-4473-a681-571da6dc3a50 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:59.639329 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-22cbcaad-c584-4d85-a232-94f022e9d00f tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:18:59.640739 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-22cbcaad-c584-4d85-a232-94f022e9d00f tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b" status: 200 len: 1103 microversion: 2.25 time: 0.522782 Oct 23 01:18:59.654633 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1128/2297] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:18:59 2022] GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b => generated 1103 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:18:59.654871 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ec3dcd18-2bc0-4473-a681-571da6dc3a50 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1" status: 200 len: 1514 microversion: 2.1 time: 2.369818 Oct 23 01:18:59.662309 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1170/2298] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:18:57 2022] GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 => generated 1514 bytes in 2384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:18:59.699045 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-12f836ee-c440-4d33-938e-fd4cf727699d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:18:59.699748 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-12f836ee-c440-4d33-938e-fd4cf727699d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:18:59.717600 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-12f836ee-c440-4d33-938e-fd4cf727699d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:59.722833 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-12f836ee-c440-4d33-938e-fd4cf727699d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:59.725801 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-12f836ee-c440-4d33-938e-fd4cf727699d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:59.726593 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-12f836ee-c440-4d33-938e-fd4cf727699d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:18:59.727067 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-12f836ee-c440-4d33-938e-fd4cf727699d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:18:59.727503 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-12f836ee-c440-4d33-938e-fd4cf727699d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:18:59.834343 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a72f865d-c6d3-4d37-9811-5a1475f66427 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-110395010", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:18:59.841640 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-12f836ee-c440-4d33-938e-fd4cf727699d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:19:00.021352 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-a72f865d-c6d3-4d37-9811-5a1475f66427 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] validate_networks() for [('2a59b95d-281b-41be-a60e-c180887e0003', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:19:00.368822 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-12f836ee-c440-4d33-938e-fd4cf727699d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "DELETE /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 204 len: 0 microversion: 2.1 time: 0.668392 Oct 23 01:19:00.370250 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1171/2299] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:18:59 2022] DELETE /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 0 bytes in 676 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:19:00.391775 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-dd3eb542-37de-4d32-920c-d444eb716bab tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:00.393038 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-dd3eb542-37de-4d32-920c-d444eb716bab tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] [instance: 2dc8d790-1306-4a6d-b14d-6c3c1639770c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:00.414600 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dd3eb542-37de-4d32-920c-d444eb716bab tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:00.428910 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dd3eb542-37de-4d32-920c-d444eb716bab tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:00.432023 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dd3eb542-37de-4d32-920c-d444eb716bab tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:00.432023 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dd3eb542-37de-4d32-920c-d444eb716bab tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:00.432023 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dd3eb542-37de-4d32-920c-d444eb716bab tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:00.432023 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dd3eb542-37de-4d32-920c-d444eb716bab tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:01.127084 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-dd3eb542-37de-4d32-920c-d444eb716bab tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8417cd8a252c4d3c9f2059c42bc82aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdabdb037d54103a656623e2c4c4a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:01.135171 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-dd3eb542-37de-4d32-920c-d444eb716bab tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] 10.222.0.42 "GET /compute/v2.1/servers/2dc8d790-1306-4a6d-b14d-6c3c1639770c" status: 200 len: 1280 microversion: 2.1 time: 0.763464 Oct 23 01:19:01.135775 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1172/2300] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:00 2022] GET /compute/v2.1/servers/2dc8d790-1306-4a6d-b14d-6c3c1639770c => generated 1280 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:01.140304 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d82cef94-e3b3-4c4e-95fc-9b4910970621 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc62f23a0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:01.253361 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d82cef94-e3b3-4c4e-95fc-9b4910970621 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/051dcffd-8f6c-4ce9-9ba8-61db53bafce2" status: 200 len: 1414 microversion: 2.1 time: 0.116463 Oct 23 01:19:01.253952 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1173/2301] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:19:01 2022] GET /compute/v2.1/images/051dcffd-8f6c-4ce9-9ba8-61db53bafce2 => generated 1414 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:01.269474 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b9645725-b13d-4a80-8aa3-9569c8df7cd0 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:01.270275 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b9645725-b13d-4a80-8aa3-9569c8df7cd0 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:01.280332 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9645725-b13d-4a80-8aa3-9569c8df7cd0 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:01.286695 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9645725-b13d-4a80-8aa3-9569c8df7cd0 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:01.287350 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9645725-b13d-4a80-8aa3-9569c8df7cd0 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:01.288243 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9645725-b13d-4a80-8aa3-9569c8df7cd0 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:01.288855 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9645725-b13d-4a80-8aa3-9569c8df7cd0 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:01.289531 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9645725-b13d-4a80-8aa3-9569c8df7cd0 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:02.169743 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b9645725-b13d-4a80-8aa3-9569c8df7cd0 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:02.183769 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-a72f865d-c6d3-4d37-9811-5a1475f66427 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:19:02.184860 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-a72f865d-c6d3-4d37-9811-5a1475f66427 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:19:02.185489 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-a72f865d-c6d3-4d37-9811-5a1475f66427 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:19:02.186097 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-a72f865d-c6d3-4d37-9811-5a1475f66427 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:19:02.186490 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b9645725-b13d-4a80-8aa3-9569c8df7cd0 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 200 len: 1667 microversion: 2.1 time: 0.921316 Oct 23 01:19:02.186855 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-a72f865d-c6d3-4d37-9811-5a1475f66427 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:19:02.204485 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1174/2302] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:01 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 1667 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:02.217910 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a72f865d-c6d3-4d37-9811-5a1475f66427 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:02.218797 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a72f865d-c6d3-4d37-9811-5a1475f66427 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:02.220961 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a72f865d-c6d3-4d37-9811-5a1475f66427 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:02.222047 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a72f865d-c6d3-4d37-9811-5a1475f66427 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:02.222744 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a72f865d-c6d3-4d37-9811-5a1475f66427 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:02.223481 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a72f865d-c6d3-4d37-9811-5a1475f66427 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:02.227643 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e012ddc1-2fa2-4331-affc-67dd31e79b2e tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:02.233036 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e012ddc1-2fa2-4331-affc-67dd31e79b2e tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: d2d33142-cf85-4a5b-b63f-e3780f8ac0b1] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:02.245667 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e012ddc1-2fa2-4331-affc-67dd31e79b2e tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:02.246714 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e012ddc1-2fa2-4331-affc-67dd31e79b2e tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:02.247368 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e012ddc1-2fa2-4331-affc-67dd31e79b2e tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:02.248396 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e012ddc1-2fa2-4331-affc-67dd31e79b2e tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:02.249060 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e012ddc1-2fa2-4331-affc-67dd31e79b2e tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:02.249871 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e012ddc1-2fa2-4331-affc-67dd31e79b2e tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:02.280707 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-a72f865d-c6d3-4d37-9811-5a1475f66427 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Getting quotas for project ed372b4663a94ff1ba20abe32e2f9e77. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:19:02.299354 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-a72f865d-c6d3-4d37-9811-5a1475f66427 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Getting quotas for user 3838dd33052740fa88b9cf2888c208ff and project ed372b4663a94ff1ba20abe32e2f9e77. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:19:02.326877 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a72f865d-c6d3-4d37-9811-5a1475f66427 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:19:02.333466 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a72f865d-c6d3-4d37-9811-5a1475f66427 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: 08afe605-c9f1-4d8b-98bc-9253414ebe56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:19:02.600564 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a72f865d-c6d3-4d37-9811-5a1475f66427 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.912878 Oct 23 01:19:02.606889 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1129/2303] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:18:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 2920 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 23 01:19:02.630114 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b20d467b-b23b-4aa6-bade-6d574b8f9715 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:02.633536 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b20d467b-b23b-4aa6-bade-6d574b8f9715 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:02.662532 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b20d467b-b23b-4aa6-bade-6d574b8f9715 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:02.663220 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b20d467b-b23b-4aa6-bade-6d574b8f9715 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:02.663679 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b20d467b-b23b-4aa6-bade-6d574b8f9715 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:02.667644 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b20d467b-b23b-4aa6-bade-6d574b8f9715 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:02.668489 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b20d467b-b23b-4aa6-bade-6d574b8f9715 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:02.669136 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b20d467b-b23b-4aa6-bade-6d574b8f9715 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:02.890008 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b20d467b-b23b-4aa6-bade-6d574b8f9715 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:02.899260 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b20d467b-b23b-4aa6-bade-6d574b8f9715 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:02.906913 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b20d467b-b23b-4aa6-bade-6d574b8f9715 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:02.910139 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b20d467b-b23b-4aa6-bade-6d574b8f9715 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b" status: 200 len: 1250 microversion: 2.25 time: 0.299305 Oct 23 01:19:02.913619 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1130/2304] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:19:02 2022] GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b => generated 1250 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:19:02.925789 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-722aa669-cf4d-4945-a354-beb8bec651cb tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-561960166", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "7d4eb193-f57e-4185-bd5c-49d423865963", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "06f4c921-9d2b-4ef6-806f-b77fdc508baa"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:03.032273 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e012ddc1-2fa2-4331-affc-67dd31e79b2e tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:03.045135 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e012ddc1-2fa2-4331-affc-67dd31e79b2e tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1" status: 200 len: 1514 microversion: 2.1 time: 0.839057 Oct 23 01:19:03.050835 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1175/2305] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:02 2022] GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 => generated 1514 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:03.066192 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ff4cbcc8-54ab-4f49-9b8d-833d296a0bc5 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:03.070188 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ff4cbcc8-54ab-4f49-9b8d-833d296a0bc5 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] [instance: 2dc8d790-1306-4a6d-b14d-6c3c1639770c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:03.091914 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ff4cbcc8-54ab-4f49-9b8d-833d296a0bc5 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:03.093832 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ff4cbcc8-54ab-4f49-9b8d-833d296a0bc5 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:03.096201 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ff4cbcc8-54ab-4f49-9b8d-833d296a0bc5 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:03.098164 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ff4cbcc8-54ab-4f49-9b8d-833d296a0bc5 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:03.101120 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ff4cbcc8-54ab-4f49-9b8d-833d296a0bc5 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:03.102254 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ff4cbcc8-54ab-4f49-9b8d-833d296a0bc5 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:03.118617 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-722aa669-cf4d-4945-a354-beb8bec651cb tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] HTTP exception thrown: Block Device 7d4eb193-f57e-4185-bd5c-49d423865963 is not bootable. Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-722aa669-cf4d-4945-a354-beb8bec651cb tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Request method failure captured: Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 357 Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJZEAurAeILsYJek3MCv_ryiTbidOLVZq6W4I7jJxeY_1_bTWRye2xM3EDOhowd_NyioevvIvzT9beBCgKqri_ZjLw9hdsIISMXmajO_VmobATT_GwpY_Y-GVylQtV9MoF1-Bup_Ahjld_2riQHnDzqLUWULm2acZYcK9UIbslVsdDU Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}] Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: cd6a6c5240f94ace91e1f0ed3e53fa7c Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-561960166", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "7d4eb193-f57e-4185-bd5c-49d423865963", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "06f4c921-9d2b-4ef6-806f-b77fdc508baa"}]}} Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: exception: Block Device 7d4eb193-f57e-4185-bd5c-49d423865963 is not bootable. Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-561960166', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '7d4eb193-f57e-4185-bd5c-49d423865963'}], 'networks': [{'uuid': '06f4c921-9d2b-4ef6-806f-b77fdc508baa'}]}}} Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 7d4eb193-f57e-4185-bd5c-49d423865963 is not bootable. Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:19:03.129137 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:19:03.132072 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:19:03.132072 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:19:03.132072 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:19:03.132072 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 23 01:19:03.132072 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 23 01:19:03.132072 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 23 01:19:03.132072 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 7d4eb193-f57e-4185-bd5c-49d423865963 is not bootable. Oct 23 01:19:03.132072 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:03.132072 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:03.132072 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:03.132072 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:03.132072 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:03.132072 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:03.132072 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:19:03.132072 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:19:03.132072 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 7d4eb193-f57e-4185-bd5c-49d423865963 is not bootable. Oct 23 01:19:03.132072 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:03.132072 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-722aa669-cf4d-4945-a354-beb8bec651cb tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Returning 400 to user: Block Device 7d4eb193-f57e-4185-bd5c-49d423865963 is not bootable. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:19:03.132072 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-722aa669-cf4d-4945-a354-beb8bec651cb tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.214940 Oct 23 01:19:03.132072 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1131/2306] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:19:02 2022] POST /compute/v2.1/servers => generated 110 bytes in 217 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:19:03.140676 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-98cfafb3-d79e-445b-be0d-abb6c6cf64e8 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc62185e0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:03.238690 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ff4cbcc8-54ab-4f49-9b8d-833d296a0bc5 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8417cd8a252c4d3c9f2059c42bc82aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdabdb037d54103a656623e2c4c4a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:03.251673 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ff4cbcc8-54ab-4f49-9b8d-833d296a0bc5 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] 10.222.0.42 "GET /compute/v2.1/servers/2dc8d790-1306-4a6d-b14d-6c3c1639770c" status: 200 len: 1280 microversion: 2.1 time: 0.194259 Oct 23 01:19:03.252182 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-98cfafb3-d79e-445b-be0d-abb6c6cf64e8 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/051dcffd-8f6c-4ce9-9ba8-61db53bafce2" status: 200 len: 1414 microversion: 2.1 time: 0.115993 Oct 23 01:19:03.253112 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1176/2307] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:03 2022] GET /compute/v2.1/servers/2dc8d790-1306-4a6d-b14d-6c3c1639770c => generated 1280 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:03.267644 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f55ff10a-4c38-40c4-8c01-1503f7e856ab tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:03.268656 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f55ff10a-4c38-40c4-8c01-1503f7e856ab tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: 08afe605-c9f1-4d8b-98bc-9253414ebe56] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:03.275268 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1132/2308] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:19:03 2022] GET /compute/v2.1/images/051dcffd-8f6c-4ce9-9ba8-61db53bafce2 => generated 1414 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:03.292494 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c2f17816-2355-48e9-a80f-0f7ef07c9727 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:03.293118 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c2f17816-2355-48e9-a80f-0f7ef07c9727 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:03.326154 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2f17816-2355-48e9-a80f-0f7ef07c9727 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:03.326664 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2f17816-2355-48e9-a80f-0f7ef07c9727 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:03.327173 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2f17816-2355-48e9-a80f-0f7ef07c9727 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:03.335675 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2f17816-2355-48e9-a80f-0f7ef07c9727 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:03.339321 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2f17816-2355-48e9-a80f-0f7ef07c9727 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:03.342032 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2f17816-2355-48e9-a80f-0f7ef07c9727 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:03.733746 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f55ff10a-4c38-40c4-8c01-1503f7e856ab tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:03.745628 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f55ff10a-4c38-40c4-8c01-1503f7e856ab tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56" status: 200 len: 1213 microversion: 2.1 time: 0.489754 Oct 23 01:19:03.755482 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1177/2309] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:03 2022] GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56 => generated 1213 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:03.774184 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-af1347bf-9ac0-41b8-8ce8-b7392203639b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:03.774946 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-af1347bf-9ac0-41b8-8ce8-b7392203639b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:03.817996 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-af1347bf-9ac0-41b8-8ce8-b7392203639b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:03.818524 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-af1347bf-9ac0-41b8-8ce8-b7392203639b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:03.818977 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-af1347bf-9ac0-41b8-8ce8-b7392203639b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:03.819746 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-af1347bf-9ac0-41b8-8ce8-b7392203639b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:03.820209 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-af1347bf-9ac0-41b8-8ce8-b7392203639b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:03.820664 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-af1347bf-9ac0-41b8-8ce8-b7392203639b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:03.868879 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:19:04.968073 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c2f17816-2355-48e9-a80f-0f7ef07c9727 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:04.982007 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c2f17816-2355-48e9-a80f-0f7ef07c9727 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 1.705388 Oct 23 01:19:04.982530 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1133/2310] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:03 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 1707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:05.015244 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f64b5902-ca15-4a4b-bc0e-a2c490adc17e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:05.015892 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f64b5902-ca15-4a4b-bc0e-a2c490adc17e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:05.043364 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f64b5902-ca15-4a4b-bc0e-a2c490adc17e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:05.043866 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f64b5902-ca15-4a4b-bc0e-a2c490adc17e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:05.071762 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f64b5902-ca15-4a4b-bc0e-a2c490adc17e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:05.072891 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f64b5902-ca15-4a4b-bc0e-a2c490adc17e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:05.080154 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f64b5902-ca15-4a4b-bc0e-a2c490adc17e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:05.080663 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f64b5902-ca15-4a4b-bc0e-a2c490adc17e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:05.650139 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f64b5902-ca15-4a4b-bc0e-a2c490adc17e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:05.668987 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f64b5902-ca15-4a4b-bc0e-a2c490adc17e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:05.672460 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f64b5902-ca15-4a4b-bc0e-a2c490adc17e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:05.679086 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f64b5902-ca15-4a4b-bc0e-a2c490adc17e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b" status: 200 len: 1292 microversion: 2.25 time: 0.695304 Oct 23 01:19:05.679700 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1134/2311] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:19:04 2022] GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b => generated 1292 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:19:05.685328 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0b39ea77-a8d7-4b86-af1c-0c665eafe3bf tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:05.685328 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0b39ea77-a8d7-4b86-af1c-0c665eafe3bf tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: d2d33142-cf85-4a5b-b63f-e3780f8ac0b1] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:05.727482 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b39ea77-a8d7-4b86-af1c-0c665eafe3bf tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:05.730804 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b39ea77-a8d7-4b86-af1c-0c665eafe3bf tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:05.731402 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b39ea77-a8d7-4b86-af1c-0c665eafe3bf tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:05.734311 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b39ea77-a8d7-4b86-af1c-0c665eafe3bf tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:05.734996 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b39ea77-a8d7-4b86-af1c-0c665eafe3bf tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:05.736979 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b39ea77-a8d7-4b86-af1c-0c665eafe3bf tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:06.024467 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-af1347bf-9ac0-41b8-8ce8-b7392203639b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:06.050967 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-af1347bf-9ac0-41b8-8ce8-b7392203639b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 200 len: 1667 microversion: 2.1 time: 2.290701 Oct 23 01:19:06.069115 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1178/2312] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:03 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 1667 bytes in 2311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:06.080996 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3012620f-acc5-45a4-b4b7-59f00294c2c5 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc6186430>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:06.179833 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3012620f-acc5-45a4-b4b7-59f00294c2c5 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/051dcffd-8f6c-4ce9-9ba8-61db53bafce2" status: 200 len: 1414 microversion: 2.1 time: 0.107600 Oct 23 01:19:06.180612 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1179/2313] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:19:06 2022] GET /compute/v2.1/images/051dcffd-8f6c-4ce9-9ba8-61db53bafce2 => generated 1414 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:06.193807 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c8e46d6c-b1e5-44d5-81a2-c5d1f7b6a55e tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:06.194772 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c8e46d6c-b1e5-44d5-81a2-c5d1f7b6a55e tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] [instance: 2dc8d790-1306-4a6d-b14d-6c3c1639770c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:06.209220 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c8e46d6c-b1e5-44d5-81a2-c5d1f7b6a55e tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:06.209746 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c8e46d6c-b1e5-44d5-81a2-c5d1f7b6a55e tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:06.210224 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c8e46d6c-b1e5-44d5-81a2-c5d1f7b6a55e tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:06.210992 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c8e46d6c-b1e5-44d5-81a2-c5d1f7b6a55e tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:06.211443 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c8e46d6c-b1e5-44d5-81a2-c5d1f7b6a55e tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:06.211867 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c8e46d6c-b1e5-44d5-81a2-c5d1f7b6a55e tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:06.890191 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0b39ea77-a8d7-4b86-af1c-0c665eafe3bf tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:06.921914 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0b39ea77-a8d7-4b86-af1c-0c665eafe3bf tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1" status: 200 len: 1514 microversion: 2.1 time: 1.241081 Oct 23 01:19:06.927042 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1135/2314] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:05 2022] GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 => generated 1514 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:06.945162 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8ce93ae0-dbc5-4a13-9444-02f535b53f44 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:06.949685 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8ce93ae0-dbc5-4a13-9444-02f535b53f44 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: 08afe605-c9f1-4d8b-98bc-9253414ebe56] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:06.982770 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ce93ae0-dbc5-4a13-9444-02f535b53f44 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:06.983558 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ce93ae0-dbc5-4a13-9444-02f535b53f44 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:06.988207 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ce93ae0-dbc5-4a13-9444-02f535b53f44 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:06.994724 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ce93ae0-dbc5-4a13-9444-02f535b53f44 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:06.995345 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ce93ae0-dbc5-4a13-9444-02f535b53f44 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:06.996590 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ce93ae0-dbc5-4a13-9444-02f535b53f44 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:07.161607 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8ce93ae0-dbc5-4a13-9444-02f535b53f44 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:07.181888 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8ce93ae0-dbc5-4a13-9444-02f535b53f44 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56" status: 200 len: 1271 microversion: 2.1 time: 0.253444 Oct 23 01:19:07.194364 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1136/2315] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:06 2022] GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56 => generated 1271 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:07.205835 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-15e3b67e-5a03-4c63-b72d-47a36e27a49d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:07.207754 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-15e3b67e-5a03-4c63-b72d-47a36e27a49d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:07.226494 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15e3b67e-5a03-4c63-b72d-47a36e27a49d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:07.227894 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15e3b67e-5a03-4c63-b72d-47a36e27a49d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:07.228648 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15e3b67e-5a03-4c63-b72d-47a36e27a49d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:07.229950 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15e3b67e-5a03-4c63-b72d-47a36e27a49d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:07.231793 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15e3b67e-5a03-4c63-b72d-47a36e27a49d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:07.234293 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15e3b67e-5a03-4c63-b72d-47a36e27a49d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:07.558493 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c8e46d6c-b1e5-44d5-81a2-c5d1f7b6a55e tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8417cd8a252c4d3c9f2059c42bc82aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdabdb037d54103a656623e2c4c4a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:07.572587 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c8e46d6c-b1e5-44d5-81a2-c5d1f7b6a55e tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] 10.222.0.42 "GET /compute/v2.1/servers/2dc8d790-1306-4a6d-b14d-6c3c1639770c" status: 200 len: 1322 microversion: 2.1 time: 1.389338 Oct 23 01:19:07.573325 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1180/2316] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:06 2022] GET /compute/v2.1/servers/2dc8d790-1306-4a6d-b14d-6c3c1639770c => generated 1322 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:07.588358 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-b0c6945d-1778-4ee0-91f4-6eb1db48e77d req-ac134b10-b4b7-4d8c-abfe-2599b55776d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b", "tag": "5f7a3666-2b64-4e04-b1a0-59950284bbc9"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:07.616658 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-b0c6945d-1778-4ee0-91f4-6eb1db48e77d req-ac134b10-b4b7-4d8c-abfe-2599b55776d3 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:07.617578 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-b0c6945d-1778-4ee0-91f4-6eb1db48e77d req-ac134b10-b4b7-4d8c-abfe-2599b55776d3 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:07.622099 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-b0c6945d-1778-4ee0-91f4-6eb1db48e77d req-ac134b10-b4b7-4d8c-abfe-2599b55776d3 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:07.646900 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-b0c6945d-1778-4ee0-91f4-6eb1db48e77d req-ac134b10-b4b7-4d8c-abfe-2599b55776d3 service nova] Creating event network-changed:5f7a3666-2b64-4e04-b1a0-59950284bbc9 for instance 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b on n-h2-master-1 Oct 23 01:19:07.662230 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-b0c6945d-1778-4ee0-91f4-6eb1db48e77d req-ac134b10-b4b7-4d8c-abfe-2599b55776d3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086990 Oct 23 01:19:07.672013 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1181/2317] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:19:07.687619 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f2ae72f0-ddf6-444d-890d-69c6766423bf tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:07.689400 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f2ae72f0-ddf6-444d-890d-69c6766423bf tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:07.698953 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f2ae72f0-ddf6-444d-890d-69c6766423bf tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:07.699616 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f2ae72f0-ddf6-444d-890d-69c6766423bf tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:07.700268 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f2ae72f0-ddf6-444d-890d-69c6766423bf tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:07.701362 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f2ae72f0-ddf6-444d-890d-69c6766423bf tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:07.702043 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f2ae72f0-ddf6-444d-890d-69c6766423bf tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:07.702670 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f2ae72f0-ddf6-444d-890d-69c6766423bf tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:07.744474 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:19:07.818882 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-15e3b67e-5a03-4c63-b72d-47a36e27a49d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:07.826447 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-15e3b67e-5a03-4c63-b72d-47a36e27a49d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.630617 Oct 23 01:19:07.838302 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1137/2318] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:07 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:07.846009 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-45cbe2e7-d7c8-4efa-856a-f5c11626af75 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:07.855736 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-45cbe2e7-d7c8-4efa-856a-f5c11626af75 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:07.882262 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-45cbe2e7-d7c8-4efa-856a-f5c11626af75 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:07.882777 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-45cbe2e7-d7c8-4efa-856a-f5c11626af75 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:07.889042 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-45cbe2e7-d7c8-4efa-856a-f5c11626af75 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:07.889042 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-45cbe2e7-d7c8-4efa-856a-f5c11626af75 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:07.889042 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-45cbe2e7-d7c8-4efa-856a-f5c11626af75 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:07.889042 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-45cbe2e7-d7c8-4efa-856a-f5c11626af75 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:07.993033 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-45cbe2e7-d7c8-4efa-856a-f5c11626af75 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:07.993611 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-45cbe2e7-d7c8-4efa-856a-f5c11626af75 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:07.993964 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-45cbe2e7-d7c8-4efa-856a-f5c11626af75 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:07.995396 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-45cbe2e7-d7c8-4efa-856a-f5c11626af75 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lazy-loading 'fault' on Instance uuid 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:19:08.101501 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-45cbe2e7-d7c8-4efa-856a-f5c11626af75 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:08.113734 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-45cbe2e7-d7c8-4efa-856a-f5c11626af75 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 200 len: 1323 microversion: 2.1 time: 0.274020 Oct 23 01:19:08.114397 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1138/2319] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:07 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 1323 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:08.136805 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-d3f728c9-23ce-4851-817f-f37826cb5ea0 req-ddce6f35-217f-429e-8b9a-f8ef96083f8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "510a3540-031d-4fab-bf7c-0a3bbc8c4d4d", "name": "network-vif-deleted", "tag": "baff0168-301d-414b-99b1-bb1e62f9bfcd"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:08.169119 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-d3f728c9-23ce-4851-817f-f37826cb5ea0 req-ddce6f35-217f-429e-8b9a-f8ef96083f8b service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:08.169621 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-d3f728c9-23ce-4851-817f-f37826cb5ea0 req-ddce6f35-217f-429e-8b9a-f8ef96083f8b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:08.173873 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-d3f728c9-23ce-4851-817f-f37826cb5ea0 req-ddce6f35-217f-429e-8b9a-f8ef96083f8b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:08.207237 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-d3f728c9-23ce-4851-817f-f37826cb5ea0 req-ddce6f35-217f-429e-8b9a-f8ef96083f8b service nova] Creating event network-vif-deleted:baff0168-301d-414b-99b1-bb1e62f9bfcd for instance 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d on n-h1-master-1 Oct 23 01:19:08.216219 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-d3f728c9-23ce-4851-817f-f37826cb5ea0 req-ddce6f35-217f-429e-8b9a-f8ef96083f8b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100581 Oct 23 01:19:08.222180 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1139/2320] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:19:08.235170 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e937c99b-3318-460e-aacf-6290f979ec58 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc6235820>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:08.325928 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f2ae72f0-ddf6-444d-890d-69c6766423bf tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:08.345541 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e937c99b-3318-460e-aacf-6290f979ec58 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/051dcffd-8f6c-4ce9-9ba8-61db53bafce2" status: 200 len: 1414 microversion: 2.1 time: 0.120627 Oct 23 01:19:08.366740 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1140/2321] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:19:08 2022] GET /compute/v2.1/images/051dcffd-8f6c-4ce9-9ba8-61db53bafce2 => generated 1414 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:08.374411 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f2ae72f0-ddf6-444d-890d-69c6766423bf tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:08.383029 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f2ae72f0-ddf6-444d-890d-69c6766423bf tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:08.386200 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f2ae72f0-ddf6-444d-890d-69c6766423bf tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b" status: 200 len: 1292 microversion: 2.25 time: 0.709718 Oct 23 01:19:08.386905 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1182/2322] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:19:07 2022] GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b => generated 1292 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:19:08.401084 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4201b757-86a7-400d-80e4-462b4bb65155 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:08.401833 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4201b757-86a7-400d-80e4-462b4bb65155 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: d2d33142-cf85-4a5b-b63f-e3780f8ac0b1] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:08.411811 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4201b757-86a7-400d-80e4-462b4bb65155 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:08.414679 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4201b757-86a7-400d-80e4-462b4bb65155 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:08.415456 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4201b757-86a7-400d-80e4-462b4bb65155 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:08.416420 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4201b757-86a7-400d-80e4-462b4bb65155 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:08.418605 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4201b757-86a7-400d-80e4-462b4bb65155 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:08.420250 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4201b757-86a7-400d-80e4-462b4bb65155 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:08.474472 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c933548e-9cd1-4499-8077-48d606be3c9c tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] Action: 'create', calling method: .version_select at 0x7f5cc62019d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-463886252", "description": "tempest-description-1650915899"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:09.124721 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4201b757-86a7-400d-80e4-462b4bb65155 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:09.140201 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4201b757-86a7-400d-80e4-462b4bb65155 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1" status: 200 len: 1514 microversion: 2.1 time: 0.750050 Oct 23 01:19:09.150648 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1183/2323] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:08 2022] GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 => generated 1514 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:09.164687 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c308bb74-c70d-4792-982e-ef3038fcf0bf tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:09.170621 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c308bb74-c70d-4792-982e-ef3038fcf0bf tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: 08afe605-c9f1-4d8b-98bc-9253414ebe56] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:09.193276 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c308bb74-c70d-4792-982e-ef3038fcf0bf tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:09.194209 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c308bb74-c70d-4792-982e-ef3038fcf0bf tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:09.200400 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c308bb74-c70d-4792-982e-ef3038fcf0bf tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:09.200400 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c308bb74-c70d-4792-982e-ef3038fcf0bf tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:09.202257 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c308bb74-c70d-4792-982e-ef3038fcf0bf tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:09.203569 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c308bb74-c70d-4792-982e-ef3038fcf0bf tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:09.348802 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c933548e-9cd1-4499-8077-48d606be3c9c tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.980649 Oct 23 01:19:09.350427 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1141/2324] 10.222.0.42 () {60 vars in 1180 bytes} [Sun Oct 23 01:19:08 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:19:09.356510 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0ff994d1-088e-4dc4-8c41-10a036d67fe0 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:09.358543 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0ff994d1-088e-4dc4-8c41-10a036d67fe0 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] [instance: 2dc8d790-1306-4a6d-b14d-6c3c1639770c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:09.375447 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0ff994d1-088e-4dc4-8c41-10a036d67fe0 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:09.377648 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0ff994d1-088e-4dc4-8c41-10a036d67fe0 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:09.379378 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0ff994d1-088e-4dc4-8c41-10a036d67fe0 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:09.381782 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0ff994d1-088e-4dc4-8c41-10a036d67fe0 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:09.382547 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0ff994d1-088e-4dc4-8c41-10a036d67fe0 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:09.383251 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0ff994d1-088e-4dc4-8c41-10a036d67fe0 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:09.433740 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c308bb74-c70d-4792-982e-ef3038fcf0bf tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:09.449350 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c308bb74-c70d-4792-982e-ef3038fcf0bf tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56" status: 200 len: 1271 microversion: 2.1 time: 0.292588 Oct 23 01:19:09.456419 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1184/2325] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:09 2022] GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56 => generated 1271 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:09.479340 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-faaee085-d618-408d-a1b3-e692f5d7b968 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:09.479991 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-faaee085-d618-408d-a1b3-e692f5d7b968 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:09.504046 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-faaee085-d618-408d-a1b3-e692f5d7b968 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:09.514116 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-faaee085-d618-408d-a1b3-e692f5d7b968 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:09.514594 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-faaee085-d618-408d-a1b3-e692f5d7b968 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:09.517593 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-faaee085-d618-408d-a1b3-e692f5d7b968 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:09.518252 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-faaee085-d618-408d-a1b3-e692f5d7b968 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:09.521428 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-faaee085-d618-408d-a1b3-e692f5d7b968 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:09.570419 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-faaee085-d618-408d-a1b3-e692f5d7b968 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] HTTP exception thrown: Instance 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d could not be found. Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-faaee085-d618-408d-a1b3-e692f5d7b968 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Request method failure captured: Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d HTTP/1.1 Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJSlUKnwUUKDqVJ5SU0WlCbPMoTauyFJSJPCNWG4h-zCSHoo3KNkNO-CFy9_VuCymiA8kUSdGjR2yGG7onVmef7qXNWa7ROigyW7eGZs7ikwf4EUyMcuHo1C1lWtM2HnrUtFga6W0hGpij0W06vuDpo6qY-r0hwnHSvBgTzaVac7oHg Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: d46a7166e4144f55a102ea6335c5f820 Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-LiveMigrationTest-627897414 Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d46a7166e4144f55a102ea6335c5f820"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d46a7166e4144f55a102ea6335c5f820"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d46a7166e4144f55a102ea6335c5f820"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d46a7166e4144f55a102ea6335c5f820"}]}] Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-LiveMigrationTest-627897414 Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: d46a7166e4144f55a102ea6335c5f820 Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-LiveMigrationTest-627897414 Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-LiveMigrationTest-627897414-project Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 1c2310cbc3574eb29a6ca6291ba7808e Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-LiveMigrationTest-627897414-project Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d could not be found. Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '510a3540-031d-4fab-bf7c-0a3bbc8c4d4d'} Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d could not be found. Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d could not be found. Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:09.580108 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:09.584154 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:09.584154 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:09.584154 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:09.584154 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:19:09.584154 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:19:09.584154 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d could not be found. Oct 23 01:19:09.584154 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:09.585292 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-faaee085-d618-408d-a1b3-e692f5d7b968 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Returning 404 to user: Instance 510a3540-031d-4fab-bf7c-0a3bbc8c4d4d could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:19:09.589899 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-faaee085-d618-408d-a1b3-e692f5d7b968 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d" status: 404 len: 111 microversion: 2.1 time: 0.131358 Oct 23 01:19:09.593731 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1185/2326] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:09 2022] GET /compute/v2.1/servers/510a3540-031d-4fab-bf7c-0a3bbc8c4d4d => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:19:09.614843 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-dc3e8846-9842-4ec0-991a-354c5eefd0b6 tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] Action: 'create', calling method: .version_select at 0x7f5cc6186b80>, body: {"security_group_rule": {"parent_group_id": "6cb19689-904c-43f2-86b0-0f6c8cf111f0", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:10.121832 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0ff994d1-088e-4dc4-8c41-10a036d67fe0 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8417cd8a252c4d3c9f2059c42bc82aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdabdb037d54103a656623e2c4c4a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:10.135558 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0ff994d1-088e-4dc4-8c41-10a036d67fe0 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] 10.222.0.42 "GET /compute/v2.1/servers/2dc8d790-1306-4a6d-b14d-6c3c1639770c" status: 200 len: 1322 microversion: 2.1 time: 0.783787 Oct 23 01:19:10.136152 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1142/2327] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:09 2022] GET /compute/v2.1/servers/2dc8d790-1306-4a6d-b14d-6c3c1639770c => generated 1322 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:10.159705 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1f14ee4a-08e3-483e-8247-5370bcb5dc44 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc6235940>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:10.271893 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1f14ee4a-08e3-483e-8247-5370bcb5dc44 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/051dcffd-8f6c-4ce9-9ba8-61db53bafce2" status: 200 len: 1414 microversion: 2.1 time: 0.130944 Oct 23 01:19:10.286437 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1143/2328] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:19:10 2022] GET /compute/v2.1/images/051dcffd-8f6c-4ce9-9ba8-61db53bafce2 => generated 1414 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:10.296981 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4b52c954-6a84-4171-9db9-25e3143dbd86 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:10.299522 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4b52c954-6a84-4171-9db9-25e3143dbd86 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:10.310268 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4b52c954-6a84-4171-9db9-25e3143dbd86 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:10.311332 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4b52c954-6a84-4171-9db9-25e3143dbd86 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:10.311999 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4b52c954-6a84-4171-9db9-25e3143dbd86 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:10.312986 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4b52c954-6a84-4171-9db9-25e3143dbd86 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:10.327391 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4b52c954-6a84-4171-9db9-25e3143dbd86 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:10.330529 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4b52c954-6a84-4171-9db9-25e3143dbd86 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:10.771619 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4b52c954-6a84-4171-9db9-25e3143dbd86 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:10.800526 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4b52c954-6a84-4171-9db9-25e3143dbd86 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:10.805133 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4b52c954-6a84-4171-9db9-25e3143dbd86 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:10.807258 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4b52c954-6a84-4171-9db9-25e3143dbd86 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b" status: 200 len: 1292 microversion: 2.25 time: 0.519802 Oct 23 01:19:10.810073 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1144/2329] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:19:10 2022] GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b => generated 1292 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:19:10.823002 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-791a4a6c-fc55-482a-8f00-39711f8e6e8d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '.version_select at 0x7f5cc62015e0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:11.002115 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-791a4a6c-fc55-482a-8f00-39711f8e6e8d tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-224498026" status: 202 len: 0 microversion: 2.1 time: 0.189094 Oct 23 01:19:11.003129 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1145/2330] 10.222.0.42 () {58 vars in 1218 bytes} [Sun Oct 23 01:19:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-224498026 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:19:11.022678 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-699d653f-a2f7-4f4c-847c-c7495a2a272d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:11.031895 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-699d653f-a2f7-4f4c-847c-c7495a2a272d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: d2d33142-cf85-4a5b-b63f-e3780f8ac0b1] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:11.051097 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-699d653f-a2f7-4f4c-847c-c7495a2a272d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:11.065174 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-699d653f-a2f7-4f4c-847c-c7495a2a272d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:11.065761 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-699d653f-a2f7-4f4c-847c-c7495a2a272d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:11.066699 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-699d653f-a2f7-4f4c-847c-c7495a2a272d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:11.068842 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-699d653f-a2f7-4f4c-847c-c7495a2a272d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:11.071633 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-699d653f-a2f7-4f4c-847c-c7495a2a272d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:11.109228 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-dc3e8846-9842-4ec0-991a-354c5eefd0b6 tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] 10.222.0.42 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.508516 Oct 23 01:19:11.112133 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1186/2331] 10.222.0.42 () {60 vars in 1195 bytes} [Sun Oct 23 01:19:09 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:19:11.118953 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-77408478-d4be-44a3-b018-5374d2d86169 req-0f50c932-d99f-476b-a7c5-2f544a5e4685 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dc8d790-1306-4a6d-b14d-6c3c1639770c", "tag": "9092279f-a76e-4eac-928a-c17ce6983691"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:11.153812 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-77408478-d4be-44a3-b018-5374d2d86169 req-0f50c932-d99f-476b-a7c5-2f544a5e4685 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:11.154600 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-77408478-d4be-44a3-b018-5374d2d86169 req-0f50c932-d99f-476b-a7c5-2f544a5e4685 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:11.155177 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-77408478-d4be-44a3-b018-5374d2d86169 req-0f50c932-d99f-476b-a7c5-2f544a5e4685 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:11.207693 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-77408478-d4be-44a3-b018-5374d2d86169 req-0f50c932-d99f-476b-a7c5-2f544a5e4685 service nova] Creating event network-changed:9092279f-a76e-4eac-928a-c17ce6983691 for instance 2dc8d790-1306-4a6d-b14d-6c3c1639770c on n-h1-master-1 Oct 23 01:19:11.221791 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-77408478-d4be-44a3-b018-5374d2d86169 req-0f50c932-d99f-476b-a7c5-2f544a5e4685 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107870 Oct 23 01:19:11.224318 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1187/2332] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:19:11.239401 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-540c14d4-5f95-4311-96c7-ef5a29246f2a tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:11.244546 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-540c14d4-5f95-4311-96c7-ef5a29246f2a tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: 08afe605-c9f1-4d8b-98bc-9253414ebe56] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:11.262875 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-540c14d4-5f95-4311-96c7-ef5a29246f2a tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:11.267305 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-540c14d4-5f95-4311-96c7-ef5a29246f2a tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:11.269124 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-540c14d4-5f95-4311-96c7-ef5a29246f2a tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:11.270058 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-540c14d4-5f95-4311-96c7-ef5a29246f2a tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:11.270957 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-540c14d4-5f95-4311-96c7-ef5a29246f2a tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:11.272506 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-540c14d4-5f95-4311-96c7-ef5a29246f2a tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:12.171006 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-699d653f-a2f7-4f4c-847c-c7495a2a272d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:12.201899 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-540c14d4-5f95-4311-96c7-ef5a29246f2a tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:12.207126 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-699d653f-a2f7-4f4c-847c-c7495a2a272d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1" status: 200 len: 1514 microversion: 2.1 time: 1.202487 Oct 23 01:19:12.212281 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-540c14d4-5f95-4311-96c7-ef5a29246f2a tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56" status: 200 len: 1313 microversion: 2.1 time: 0.986031 Oct 23 01:19:12.214872 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1188/2333] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:11 2022] GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56 => generated 1313 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:12.240734 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1146/2334] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:11 2022] GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 => generated 1514 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:12.258436 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-160cef46-d785-49a0-a8fa-53a7b2885dd7 tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] Action: 'create', calling method: .version_select at 0x7f5cc61af5e0>, body: {"security_group_rule": {"parent_group_id": "6cb19689-904c-43f2-86b0-0f6c8cf111f0", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:12.264009 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6f476e1d-19c9-4a02-a78c-9687dd9e3b42 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:12.264634 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6f476e1d-19c9-4a02-a78c-9687dd9e3b42 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] [instance: 2dc8d790-1306-4a6d-b14d-6c3c1639770c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:12.275474 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=4 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:19:12.297645 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6f476e1d-19c9-4a02-a78c-9687dd9e3b42 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:12.302314 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6f476e1d-19c9-4a02-a78c-9687dd9e3b42 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:12.305262 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6f476e1d-19c9-4a02-a78c-9687dd9e3b42 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:12.306283 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6f476e1d-19c9-4a02-a78c-9687dd9e3b42 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:12.308057 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6f476e1d-19c9-4a02-a78c-9687dd9e3b42 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:12.309036 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6f476e1d-19c9-4a02-a78c-9687dd9e3b42 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:12.324673 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=16 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:19:12.741772 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-160cef46-d785-49a0-a8fa-53a7b2885dd7 tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] HTTP exception thrown: This rule already exists in group 6cb19689-904c-43f2-86b0-0f6c8cf111f0 Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-160cef46-d785-49a0-a8fa-53a7b2885dd7 tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] Request method failure captured: Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 138 Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJaLVIrxyfbwNFNga7PG16zjbUd6VAGq8KH3FwX8MM569X76oF_ev5ALdncToM2OOGfNbBxP60fsCcGW3_hQEVFEp30JZJngOkS1Gj1D5HlPgMxTtKAs6yn8l6xkHsAbrXHzbVh1cqz3kYRi16Q_F6fXY0KdCQ_78KpeoZEs07hPRXw Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 64925bb905eb4ece9a6f193d2d02ffd5 Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-93380100 Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/64925bb905eb4ece9a6f193d2d02ffd5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_64925bb905eb4ece9a6f193d2d02ffd5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/64925bb905eb4ece9a6f193d2d02ffd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/64925bb905eb4ece9a6f193d2d02ffd5"}]}] Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-93380100 Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 64925bb905eb4ece9a6f193d2d02ffd5 Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-93380100 Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-93380100-project Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 2be11a97bc52448d8537ea47327aa008 Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-93380100-project Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: {"security_group_rule": {"parent_group_id": "6cb19689-904c-43f2-86b0-0f6c8cf111f0", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: method: Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: exception: This rule already exists in group 6cb19689-904c-43f2-86b0-0f6c8cf111f0 Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: action_args: {'body': {'security_group_rule': {'parent_group_id': '6cb19689-904c-43f2-86b0-0f6c8cf111f0', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 6cb19689-904c-43f2-86b0-0f6c8cf111f0 Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 6cb19689-904c-43f2-86b0-0f6c8cf111f0 Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:12.744237 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:12.748602 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:19:12.748602 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:19:12.748602 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 6cb19689-904c-43f2-86b0-0f6c8cf111f0 Oct 23 01:19:12.748602 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:12.749922 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-160cef46-d785-49a0-a8fa-53a7b2885dd7 tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] Returning 400 to user: This rule already exists in group 6cb19689-904c-43f2-86b0-0f6c8cf111f0 {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:19:12.751645 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-160cef46-d785-49a0-a8fa-53a7b2885dd7 tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] 10.222.0.42 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.505657 Oct 23 01:19:12.752402 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1189/2335] 10.222.0.42 () {60 vars in 1195 bytes} [Sun Oct 23 01:19:12 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 539 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:19:12.768367 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b5b0c2da-433a-4367-8cc3-7cae78f5c853 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc6192ca0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:12.854263 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b5b0c2da-433a-4367-8cc3-7cae78f5c853 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/051dcffd-8f6c-4ce9-9ba8-61db53bafce2" status: 200 len: 1414 microversion: 2.1 time: 0.100597 Oct 23 01:19:12.854845 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1190/2336] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:19:12 2022] GET /compute/v2.1/images/051dcffd-8f6c-4ce9-9ba8-61db53bafce2 => generated 1414 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:12.865182 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-95622b0d-9e5b-4c22-b183-ea2ae103adaf tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:12.866237 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-95622b0d-9e5b-4c22-b183-ea2ae103adaf tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:12.888972 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-95622b0d-9e5b-4c22-b183-ea2ae103adaf tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:12.889740 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-95622b0d-9e5b-4c22-b183-ea2ae103adaf tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:12.890378 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-95622b0d-9e5b-4c22-b183-ea2ae103adaf tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:12.893884 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-95622b0d-9e5b-4c22-b183-ea2ae103adaf tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:12.893884 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-95622b0d-9e5b-4c22-b183-ea2ae103adaf tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:12.894476 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-95622b0d-9e5b-4c22-b183-ea2ae103adaf tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:13.151686 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6f476e1d-19c9-4a02-a78c-9687dd9e3b42 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8417cd8a252c4d3c9f2059c42bc82aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdabdb037d54103a656623e2c4c4a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:13.166653 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6f476e1d-19c9-4a02-a78c-9687dd9e3b42 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] 10.222.0.42 "GET /compute/v2.1/servers/2dc8d790-1306-4a6d-b14d-6c3c1639770c" status: 200 len: 1322 microversion: 2.1 time: 0.924383 Oct 23 01:19:13.167481 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1147/2337] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:12 2022] GET /compute/v2.1/servers/2dc8d790-1306-4a6d-b14d-6c3c1639770c => generated 1322 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:13.181851 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-abb226a4-da87-459b-959a-436ae6b93fa1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-68870949", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "446b40bc-db5b-4123-9278-997bd6d04a0d", "destination_type": "local"}, {"source_type": "volume", "uuid": "2da9a2ab-e2ae-43f3-81af-484f724869e0", "destination_type": "invalid"}], "networks": [{"uuid": "06f4c921-9d2b-4ef6-806f-b77fdc508baa"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-abb226a4-da87-459b-959a-436ae6b93fa1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Request method failure captured: Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 493 Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJZEAurAeILsYJek3MCv_ryiTbidOLVZq6W4I7jJxeY_1_bTWRye2xM3EDOhowd_NyioevvIvzT9beBCgKqri_ZjLw9hdsIISMXmajO_VmobATT_GwpY_Y-GVylQtV9MoF1-Bup_Ahjld_2riQHnDzqLUWULm2acZYcK9UIbslVsdDU Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}] Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: cd6a6c5240f94ace91e1f0ed3e53fa7c Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-68870949", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "446b40bc-db5b-4123-9278-997bd6d04a0d", "destination_type": "local"}, {"source_type": "volume", "uuid": "2da9a2ab-e2ae-43f3-81af-484f724869e0", "destination_type": "invalid"}], "networks": [{"uuid": "06f4c921-9d2b-4ef6-806f-b77fdc508baa"}]}} Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-68870949', 'imageRef': '446b40bc-db5b-4123-9278-997bd6d04a0d', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '446b40bc-db5b-4123-9278-997bd6d04a0d', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '2da9a2ab-e2ae-43f3-81af-484f724869e0', 'destination_type': 'invalid'}], 'networks': [{'uuid': '06f4c921-9d2b-4ef6-806f-b77fdc508baa'}]}}} Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise error Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi 'invalid' Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:19:13.213261 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:19:13.216982 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:19:13.216982 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:19:13.216982 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 23 01:19:13.216982 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 23 01:19:13.216982 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 23 01:19:13.216982 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 23 01:19:13.216982 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 23 01:19:13.216982 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 23 01:19:13.216982 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 23 01:19:13.216982 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:13.216982 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:13.216982 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:13.216982 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:13.216982 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:13.216982 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:13.216982 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 23 01:19:13.216982 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 23 01:19:13.216982 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 23 01:19:13.216982 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:13.216982 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-abb226a4-da87-459b-959a-436ae6b93fa1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:19:13.216982 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-abb226a4-da87-459b-959a-436ae6b93fa1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.046282 Oct 23 01:19:13.216982 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1148/2338] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:19:13 2022] POST /compute/v2.1/servers => generated 155 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:19:13.225787 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-df4032fd-544b-459a-9186-985e78fe65a8 tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] Calling method '.version_select at 0x7f5cc6201b80>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:13.483314 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-95622b0d-9e5b-4c22-b183-ea2ae103adaf tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:13.495156 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-95622b0d-9e5b-4c22-b183-ea2ae103adaf tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:13.502095 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-95622b0d-9e5b-4c22-b183-ea2ae103adaf tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:13.503442 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-95622b0d-9e5b-4c22-b183-ea2ae103adaf tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b" status: 200 len: 1292 microversion: 2.25 time: 0.647405 Oct 23 01:19:13.504044 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1191/2339] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:19:12 2022] GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b => generated 1292 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:19:13.512628 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e4155754-887e-4f74-b2e5-870e027b84b0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:13.513311 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e4155754-887e-4f74-b2e5-870e027b84b0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:13.531727 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e4155754-887e-4f74-b2e5-870e027b84b0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:13.532307 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e4155754-887e-4f74-b2e5-870e027b84b0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:13.542283 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e4155754-887e-4f74-b2e5-870e027b84b0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:13.543122 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e4155754-887e-4f74-b2e5-870e027b84b0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:13.544476 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e4155754-887e-4f74-b2e5-870e027b84b0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:13.545969 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e4155754-887e-4f74-b2e5-870e027b84b0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:13.738699 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=8 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:19:14.068400 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e4155754-887e-4f74-b2e5-870e027b84b0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:14.085163 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e4155754-887e-4f74-b2e5-870e027b84b0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.576322 Oct 23 01:19:14.092289 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1192/2340] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:13 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:14.093498 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a8707759-7f0b-47d6-aa86-9e6e81214a06 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:14.094186 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a8707759-7f0b-47d6-aa86-9e6e81214a06 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: d2d33142-cf85-4a5b-b63f-e3780f8ac0b1] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:14.102262 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a8707759-7f0b-47d6-aa86-9e6e81214a06 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:14.102695 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a8707759-7f0b-47d6-aa86-9e6e81214a06 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:14.103128 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a8707759-7f0b-47d6-aa86-9e6e81214a06 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:14.104520 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a8707759-7f0b-47d6-aa86-9e6e81214a06 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:14.105411 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a8707759-7f0b-47d6-aa86-9e6e81214a06 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:14.106331 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a8707759-7f0b-47d6-aa86-9e6e81214a06 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:14.201178 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-df4032fd-544b-459a-9186-985e78fe65a8 tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-group-rules/1f3b2ada-eac5-4edd-ace8-8228fc88acc4" status: 202 len: 0 microversion: 2.1 time: 0.984672 Oct 23 01:19:14.201779 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1149/2341] 10.222.0.42 () {58 vars in 1287 bytes} [Sun Oct 23 01:19:13 2022] DELETE /compute/v2.1/os-security-group-rules/1f3b2ada-eac5-4edd-ace8-8228fc88acc4 => generated 0 bytes in 986 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:19:14.207454 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f8e2abd1-1d03-4664-96fb-c09b5453fea0 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:14.208295 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f8e2abd1-1d03-4664-96fb-c09b5453fea0 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: 08afe605-c9f1-4d8b-98bc-9253414ebe56] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:14.222166 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8e2abd1-1d03-4664-96fb-c09b5453fea0 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:14.223186 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8e2abd1-1d03-4664-96fb-c09b5453fea0 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:14.225854 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8e2abd1-1d03-4664-96fb-c09b5453fea0 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:14.227410 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8e2abd1-1d03-4664-96fb-c09b5453fea0 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:14.228060 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8e2abd1-1d03-4664-96fb-c09b5453fea0 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:14.235884 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8e2abd1-1d03-4664-96fb-c09b5453fea0 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:14.416830 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a8707759-7f0b-47d6-aa86-9e6e81214a06 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:14.426048 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a8707759-7f0b-47d6-aa86-9e6e81214a06 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1" status: 200 len: 1520 microversion: 2.1 time: 0.336739 Oct 23 01:19:14.427099 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1193/2342] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:14 2022] GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 => generated 1520 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:14.431715 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-bdc730c5-083f-4404-8e94-ed33616ba8b2 req-f66d5af1-544d-4cfa-9d7c-e82d96bc3dde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08afe605-c9f1-4d8b-98bc-9253414ebe56", "tag": "4b120ca2-cd12-4f29-a253-45c547ab8eec"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:14.441834 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-bdc730c5-083f-4404-8e94-ed33616ba8b2 req-f66d5af1-544d-4cfa-9d7c-e82d96bc3dde service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:14.442473 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-bdc730c5-083f-4404-8e94-ed33616ba8b2 req-f66d5af1-544d-4cfa-9d7c-e82d96bc3dde service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:14.443765 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-bdc730c5-083f-4404-8e94-ed33616ba8b2 req-f66d5af1-544d-4cfa-9d7c-e82d96bc3dde service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:14.455888 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-bdc730c5-083f-4404-8e94-ed33616ba8b2 req-f66d5af1-544d-4cfa-9d7c-e82d96bc3dde service nova] Creating event network-changed:4b120ca2-cd12-4f29-a253-45c547ab8eec for instance 08afe605-c9f1-4d8b-98bc-9253414ebe56 on n-h1-master-1 Oct 23 01:19:14.460808 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-bdc730c5-083f-4404-8e94-ed33616ba8b2 req-f66d5af1-544d-4cfa-9d7c-e82d96bc3dde service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032392 Oct 23 01:19:14.461832 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1194/2343] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:19:14.467061 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8a804020-f55b-4d37-bed5-034fa94495bb tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc62f25e0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:14.520152 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8a804020-f55b-4d37-bed5-034fa94495bb tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/051dcffd-8f6c-4ce9-9ba8-61db53bafce2" status: 200 len: 1423 microversion: 2.1 time: 0.056849 Oct 23 01:19:14.521240 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1195/2344] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:19:14 2022] GET /compute/v2.1/images/051dcffd-8f6c-4ce9-9ba8-61db53bafce2 => generated 1423 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:14.523784 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f8e2abd1-1d03-4664-96fb-c09b5453fea0 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:14.528319 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0f6466a8-2b40-4543-b860-69282d961dc1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:14.532539 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0f6466a8-2b40-4543-b860-69282d961dc1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:14.535770 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f8e2abd1-1d03-4664-96fb-c09b5453fea0 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56" status: 200 len: 1313 microversion: 2.1 time: 0.332577 Oct 23 01:19:14.536300 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0f6466a8-2b40-4543-b860-69282d961dc1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:14.544862 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0f6466a8-2b40-4543-b860-69282d961dc1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:14.545064 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1150/2345] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:14 2022] GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56 => generated 1313 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:14.545165 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0f6466a8-2b40-4543-b860-69282d961dc1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:14.545165 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0f6466a8-2b40-4543-b860-69282d961dc1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:14.545165 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0f6466a8-2b40-4543-b860-69282d961dc1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:14.545165 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0f6466a8-2b40-4543-b860-69282d961dc1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:14.545414 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-78bac983-86dc-40bb-bea9-c2fa706d8d7c tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:14.545414 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-78bac983-86dc-40bb-bea9-c2fa706d8d7c tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] [instance: 2dc8d790-1306-4a6d-b14d-6c3c1639770c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:14.554149 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-78bac983-86dc-40bb-bea9-c2fa706d8d7c tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:14.555432 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-78bac983-86dc-40bb-bea9-c2fa706d8d7c tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:14.556049 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-78bac983-86dc-40bb-bea9-c2fa706d8d7c tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:14.556796 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-78bac983-86dc-40bb-bea9-c2fa706d8d7c tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:14.557253 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-78bac983-86dc-40bb-bea9-c2fa706d8d7c tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:14.557679 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-78bac983-86dc-40bb-bea9-c2fa706d8d7c tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:14.803841 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-78bac983-86dc-40bb-bea9-c2fa706d8d7c tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8417cd8a252c4d3c9f2059c42bc82aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdabdb037d54103a656623e2c4c4a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:14.815204 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-78bac983-86dc-40bb-bea9-c2fa706d8d7c tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] 10.222.0.42 "GET /compute/v2.1/servers/2dc8d790-1306-4a6d-b14d-6c3c1639770c" status: 200 len: 1322 microversion: 2.1 time: 0.275983 Oct 23 01:19:14.815204 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1151/2346] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:14 2022] GET /compute/v2.1/servers/2dc8d790-1306-4a6d-b14d-6c3c1639770c => generated 1322 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:14.817113 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0f6466a8-2b40-4543-b860-69282d961dc1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:14.820754 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-59570f0c-dbc1-4cdb-b7c4-7aa7cc261ca6 tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] Action: 'create', calling method: .version_select at 0x7f5cc6202b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-476829418", "description": "tempest-description-1496386516"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:14.830094 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0f6466a8-2b40-4543-b860-69282d961dc1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.307550 Oct 23 01:19:14.833103 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1196/2347] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:14 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:14.847953 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2be7fc7c-5e73-43ac-8be1-ae9408a3309b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:14.848836 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2be7fc7c-5e73-43ac-8be1-ae9408a3309b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: bc304d93-5c47-4830-af2c-bca071542590] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:14.856265 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2be7fc7c-5e73-43ac-8be1-ae9408a3309b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:14.857452 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2be7fc7c-5e73-43ac-8be1-ae9408a3309b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:14.858148 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2be7fc7c-5e73-43ac-8be1-ae9408a3309b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:14.866899 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2be7fc7c-5e73-43ac-8be1-ae9408a3309b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:14.867486 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2be7fc7c-5e73-43ac-8be1-ae9408a3309b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:14.868226 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2be7fc7c-5e73-43ac-8be1-ae9408a3309b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:14.899227 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2be7fc7c-5e73-43ac-8be1-ae9408a3309b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: bc304d93-5c47-4830-af2c-bca071542590] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:19:15.184691 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2be7fc7c-5e73-43ac-8be1-ae9408a3309b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590" status: 204 len: 0 microversion: 2.1 time: 0.346559 Oct 23 01:19:15.185591 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1197/2348] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:19:14 2022] DELETE /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:19:15.192493 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-59570f0c-dbc1-4cdb-b7c4-7aa7cc261ca6 tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.375528 Oct 23 01:19:15.193071 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1af9685a-2f35-4f61-9e7a-902f7d59fcfb tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:15.193183 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1152/2349] 10.222.0.42 () {60 vars in 1180 bytes} [Sun Oct 23 01:19:14 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:19:15.194117 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1af9685a-2f35-4f61-9e7a-902f7d59fcfb tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:15.197939 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ac13bfbb-adfc-449e-963b-cd25127e602c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc1750430>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:15.200918 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1af9685a-2f35-4f61-9e7a-902f7d59fcfb tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:15.201867 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1af9685a-2f35-4f61-9e7a-902f7d59fcfb tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:15.202523 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1af9685a-2f35-4f61-9e7a-902f7d59fcfb tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:15.203431 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1af9685a-2f35-4f61-9e7a-902f7d59fcfb tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:15.204617 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1af9685a-2f35-4f61-9e7a-902f7d59fcfb tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:15.205242 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1af9685a-2f35-4f61-9e7a-902f7d59fcfb tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:15.257959 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ac13bfbb-adfc-449e-963b-cd25127e602c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/051dcffd-8f6c-4ce9-9ba8-61db53bafce2" status: 200 len: 1423 microversion: 2.1 time: 0.063800 Oct 23 01:19:15.258790 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1153/2350] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:19:15 2022] GET /compute/v2.1/images/051dcffd-8f6c-4ce9-9ba8-61db53bafce2 => generated 1423 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:15.272077 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-956f4913-5382-472c-8bfe-8b64857df39c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-280806289", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "06f4c921-9d2b-4ef6-806f-b77fdc508baa"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:15.276606 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-956f4913-5382-472c-8bfe-8b64857df39c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Request method failure captured: Oct 23 01:19:15.276606 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 23 01:19:15.276606 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:19:15.276606 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:19:15.276606 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:19:15.276606 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 491 Oct 23 01:19:15.276606 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:19:15.276606 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:19:15.276606 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:19:15.276606 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:19:15.276606 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJZEAurAeILsYJek3MCv_ryiTbidOLVZq6W4I7jJxeY_1_bTWRye2xM3EDOhowd_NyioevvIvzT9beBCgKqri_ZjLw9hdsIISMXmajO_VmobATT_GwpY_Y-GVylQtV9MoF1-Bup_Ahjld_2riQHnDzqLUWULm2acZYcK9UIbslVsdDU Oct 23 01:19:15.276606 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:19:15.276606 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:19:15.276606 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:19:15.276606 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:19:15.276606 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:19:15.276606 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:19:15.276606 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:19:15.276606 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:15.276606 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:19:15.276606 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:19:15.276606 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}] Oct 23 01:19:15.276606 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:15.276606 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:19:15.276606 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:15.276606 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:19:15.276606 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:19:15.276606 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:19:15.276606 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: cd6a6c5240f94ace91e1f0ed3e53fa7c Oct 23 01:19:15.276606 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:19:15.276606 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:19:15.276606 n-d-master-1 devstack@n-api.service[120944]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-280806289", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "06f4c921-9d2b-4ef6-806f-b77fdc508baa"}]}} Oct 23 01:19:15.276606 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:19:15.276606 n-d-master-1 devstack@n-api.service[120944]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 23 01:19:15.276606 n-d-master-1 devstack@n-api.service[120944]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-280806289', 'imageRef': '446b40bc-db5b-4123-9278-997bd6d04a0d', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '06f4c921-9d2b-4ef6-806f-b77fdc508baa'}]}}} Oct 23 01:19:15.276606 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:19:15.276606 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:15.276606 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 23 01:19:15.276606 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 23 01:19:15.276606 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 01:19:15.276606 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise error Oct 23 01:19:15.276606 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 23 01:19:15.276606 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:15.276606 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 23 01:19:15.276606 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 23 01:19:15.276606 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:15.276606 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 23 01:19:15.276606 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 23 01:19:15.279198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:15.279198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:15.279198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:15.279198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:15.279198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:15.279198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:15.279198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:19:15.279198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:19:15.279198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:19:15.279198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:19:15.279198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:19:15.279198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:19:15.279198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 23 01:19:15.279198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 23 01:19:15.279198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 23 01:19:15.279198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 23 01:19:15.279198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 23 01:19:15.279198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 23 01:19:15.279198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 23 01:19:15.279198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:15.279198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:15.279198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:15.279198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:15.279198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:15.279198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:15.279198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 23 01:19:15.279198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 23 01:19:15.279198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 23 01:19:15.279198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:15.279198 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-956f4913-5382-472c-8bfe-8b64857df39c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:19:15.279198 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-956f4913-5382-472c-8bfe-8b64857df39c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.018286 Oct 23 01:19:15.279198 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1154/2351] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:19:15 2022] POST /compute/v2.1/servers => generated 624 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:19:15.284346 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-c38c9bae-32ac-46f3-9396-eedf456220f2 req-f9e2f324-2bd3-4a18-929c-b5f6f27aa88c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2d33142-cf85-4a5b-b63f-e3780f8ac0b1", "name": "network-vif-unplugged", "status": "completed", "tag": "c671ef64-d392-46ae-a693-c9bcda7c8160"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:15.297013 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-c38c9bae-32ac-46f3-9396-eedf456220f2 req-f9e2f324-2bd3-4a18-929c-b5f6f27aa88c service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:15.297507 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-c38c9bae-32ac-46f3-9396-eedf456220f2 req-f9e2f324-2bd3-4a18-929c-b5f6f27aa88c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:15.298493 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-c38c9bae-32ac-46f3-9396-eedf456220f2 req-f9e2f324-2bd3-4a18-929c-b5f6f27aa88c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:15.323645 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-c38c9bae-32ac-46f3-9396-eedf456220f2 req-f9e2f324-2bd3-4a18-929c-b5f6f27aa88c service nova] Creating event network-vif-unplugged:c671ef64-d392-46ae-a693-c9bcda7c8160 for instance d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 on n-h2-master-1 Oct 23 01:19:15.330933 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-c38c9bae-32ac-46f3-9396-eedf456220f2 req-f9e2f324-2bd3-4a18-929c-b5f6f27aa88c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051152 Oct 23 01:19:15.331630 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1155/2352] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:19:15.340787 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-308aa4af-592d-4415-a3f8-e32b9b759d8b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:15.341478 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-308aa4af-592d-4415-a3f8-e32b9b759d8b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: bc304d93-5c47-4830-af2c-bca071542590] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:15.347738 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-308aa4af-592d-4415-a3f8-e32b9b759d8b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:15.348217 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-308aa4af-592d-4415-a3f8-e32b9b759d8b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:15.348646 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-308aa4af-592d-4415-a3f8-e32b9b759d8b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:15.349331 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-308aa4af-592d-4415-a3f8-e32b9b759d8b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:15.349781 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-308aa4af-592d-4415-a3f8-e32b9b759d8b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:15.350241 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-308aa4af-592d-4415-a3f8-e32b9b759d8b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:15.369080 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1af9685a-2f35-4f61-9e7a-902f7d59fcfb tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:15.376936 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1af9685a-2f35-4f61-9e7a-902f7d59fcfb tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:15.378333 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1af9685a-2f35-4f61-9e7a-902f7d59fcfb tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:15.379439 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1af9685a-2f35-4f61-9e7a-902f7d59fcfb tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b" status: 200 len: 1280 microversion: 2.25 time: 0.192415 Oct 23 01:19:15.380006 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1198/2353] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:19:15 2022] GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b => generated 1280 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:19:15.384509 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2df2b87d-1956-4809-91ce-503fd4d9455a tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] Action: 'create', calling method: .version_select at 0x7f5cc6144310>, body: {"security_group_rule": {"parent_group_id": "ca90d93a-de6d-4084-928c-78adf7167025", "ip_protocol": "tcp", "from_port": 1477885710, "to_port": 22}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:15.477683 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-2df2b87d-1956-4809-91ce-503fd4d9455a tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] HTTP exception thrown: Invalid port range 1477885710:22. Former value cannot be greater than the later Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2df2b87d-1956-4809-91ce-503fd4d9455a tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] Request method failure captured: Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 146 Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJaLVIrxyfbwNFNga7PG16zjbUd6VAGq8KH3FwX8MM569X76oF_ev5ALdncToM2OOGfNbBxP60fsCcGW3_hQEVFEp30JZJngOkS1Gj1D5HlPgMxTtKAs6yn8l6xkHsAbrXHzbVh1cqz3kYRi16Q_F6fXY0KdCQ_78KpeoZEs07hPRXw Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 64925bb905eb4ece9a6f193d2d02ffd5 Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-93380100 Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/64925bb905eb4ece9a6f193d2d02ffd5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_64925bb905eb4ece9a6f193d2d02ffd5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/64925bb905eb4ece9a6f193d2d02ffd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/64925bb905eb4ece9a6f193d2d02ffd5"}]}] Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-93380100 Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 64925bb905eb4ece9a6f193d2d02ffd5 Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-93380100 Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-93380100-project Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 2be11a97bc52448d8537ea47327aa008 Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-93380100-project Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: {"security_group_rule": {"parent_group_id": "ca90d93a-de6d-4084-928c-78adf7167025", "ip_protocol": "tcp", "from_port": 1477885710, "to_port": 22}} Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: method: Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: exception: Invalid port range 1477885710:22. Former value cannot be greater than the later Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'ca90d93a-de6d-4084-928c-78adf7167025', 'ip_protocol': 'tcp', 'from_port': 1477885710, 'to_port': 22}}} Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1477885710:22. Former value cannot be greater than the later Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1477885710:22. Former value cannot be greater than the later Oct 23 01:19:15.479484 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:15.483464 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:15.483464 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:15.483464 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:15.483464 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:15.483464 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:15.483464 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:19:15.483464 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:19:15.483464 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1477885710:22. Former value cannot be greater than the later Oct 23 01:19:15.483464 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:15.483464 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2df2b87d-1956-4809-91ce-503fd4d9455a tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] Returning 400 to user: Invalid port range 1477885710:22. Former value cannot be greater than the later {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:19:15.483464 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2df2b87d-1956-4809-91ce-503fd4d9455a tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] 10.222.0.42 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.100004 Oct 23 01:19:15.483464 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1199/2354] 10.222.0.42 () {60 vars in 1195 bytes} [Sun Oct 23 01:19:15 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:19:15.494077 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f5611c2d-7b52-40a0-9102-e07ed5607142 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc6274280>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:15.529227 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-308aa4af-592d-4415-a3f8-e32b9b759d8b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:15.537363 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-308aa4af-592d-4415-a3f8-e32b9b759d8b tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590" status: 200 len: 1484 microversion: 2.1 time: 0.201885 Oct 23 01:19:15.537990 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1156/2355] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:15 2022] GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590 => generated 1484 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:15.542976 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9665c7a7-6835-48d2-81f8-b1a92b8de248 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:15.543751 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9665c7a7-6835-48d2-81f8-b1a92b8de248 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:15.550419 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9665c7a7-6835-48d2-81f8-b1a92b8de248 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:15.550909 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9665c7a7-6835-48d2-81f8-b1a92b8de248 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:15.551345 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9665c7a7-6835-48d2-81f8-b1a92b8de248 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:15.553584 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9665c7a7-6835-48d2-81f8-b1a92b8de248 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:15.554094 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9665c7a7-6835-48d2-81f8-b1a92b8de248 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:15.554680 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9665c7a7-6835-48d2-81f8-b1a92b8de248 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:15.574468 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=100 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:19:15.701579 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9665c7a7-6835-48d2-81f8-b1a92b8de248 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:15.709685 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9665c7a7-6835-48d2-81f8-b1a92b8de248 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.170691 Oct 23 01:19:15.710313 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1157/2356] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:15 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:15.715033 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dc33a270-cfb6-4c2f-86e3-85f87e8f3034 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:15.725322 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-dc33a270-cfb6-4c2f-86e3-85f87e8f3034 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: d2d33142-cf85-4a5b-b63f-e3780f8ac0b1] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:15.725322 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dc33a270-cfb6-4c2f-86e3-85f87e8f3034 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:15.725322 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dc33a270-cfb6-4c2f-86e3-85f87e8f3034 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:15.725322 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dc33a270-cfb6-4c2f-86e3-85f87e8f3034 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:15.725322 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dc33a270-cfb6-4c2f-86e3-85f87e8f3034 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:15.725322 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dc33a270-cfb6-4c2f-86e3-85f87e8f3034 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:15.725322 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dc33a270-cfb6-4c2f-86e3-85f87e8f3034 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:15.866418 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-dc33a270-cfb6-4c2f-86e3-85f87e8f3034 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:15.874345 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-dc33a270-cfb6-4c2f-86e3-85f87e8f3034 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1" status: 200 len: 1520 microversion: 2.1 time: 0.163027 Oct 23 01:19:15.874922 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1158/2357] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:15 2022] GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:15.879519 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-94f543f9-b4fe-4841-a906-8af56fbc3ed2 tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] Action: 'create', calling method: .version_select at 0x7f5cc6214550>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1566010555", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:15.881497 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-94f543f9-b4fe-4841-a906-8af56fbc3ed2 tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] HTTP exception thrown: Security group id should be uuid Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-94f543f9-b4fe-4841-a906-8af56fbc3ed2 tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] Request method failure captured: Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 131 Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJaLVIrxyfbwNFNga7PG16zjbUd6VAGq8KH3FwX8MM569X76oF_ev5ALdncToM2OOGfNbBxP60fsCcGW3_hQEVFEp30JZJngOkS1Gj1D5HlPgMxTtKAs6yn8l6xkHsAbrXHzbVh1cqz3kYRi16Q_F6fXY0KdCQ_78KpeoZEs07hPRXw Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 64925bb905eb4ece9a6f193d2d02ffd5 Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-93380100 Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/64925bb905eb4ece9a6f193d2d02ffd5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_64925bb905eb4ece9a6f193d2d02ffd5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/64925bb905eb4ece9a6f193d2d02ffd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/64925bb905eb4ece9a6f193d2d02ffd5"}]}] Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-93380100 Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 64925bb905eb4ece9a6f193d2d02ffd5 Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-93380100 Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-93380100-project Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 2be11a97bc52448d8537ea47327aa008 Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-93380100-project Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1566010555", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: method: Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: exception: Security group id should be uuid Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1566010555', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:19:15.882983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:19:15.886973 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 23 01:19:15.886973 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:15.886973 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-94f543f9-b4fe-4841-a906-8af56fbc3ed2 tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] Returning 400 to user: Security group id should be uuid {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:19:15.886973 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-94f543f9-b4fe-4841-a906-8af56fbc3ed2 tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] 10.222.0.42 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.008433 Oct 23 01:19:15.886973 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1159/2358] 10.222.0.42 () {60 vars in 1195 bytes} [Sun Oct 23 01:19:15 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 23 01:19:15.889425 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3491ba86-7c08-4139-abfc-b16b5bee1ebf tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:15.890092 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3491ba86-7c08-4139-abfc-b16b5bee1ebf tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: 08afe605-c9f1-4d8b-98bc-9253414ebe56] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:15.897217 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3491ba86-7c08-4139-abfc-b16b5bee1ebf tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:15.897707 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3491ba86-7c08-4139-abfc-b16b5bee1ebf tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:15.898171 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3491ba86-7c08-4139-abfc-b16b5bee1ebf tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:15.898855 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3491ba86-7c08-4139-abfc-b16b5bee1ebf tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:15.899318 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3491ba86-7c08-4139-abfc-b16b5bee1ebf tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:15.899743 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3491ba86-7c08-4139-abfc-b16b5bee1ebf tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:16.040480 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3491ba86-7c08-4139-abfc-b16b5bee1ebf tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:16.048502 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3491ba86-7c08-4139-abfc-b16b5bee1ebf tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56" status: 200 len: 1313 microversion: 2.1 time: 0.162431 Oct 23 01:19:16.049090 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1160/2359] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:15 2022] GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:16.055590 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f3814e61-ce0f-42a3-b2a5-9753bab48eb6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:16.056240 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f3814e61-ce0f-42a3-b2a5-9753bab48eb6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:16.062122 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f3814e61-ce0f-42a3-b2a5-9753bab48eb6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:16.062613 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f3814e61-ce0f-42a3-b2a5-9753bab48eb6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:16.063048 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f3814e61-ce0f-42a3-b2a5-9753bab48eb6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:16.063773 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f3814e61-ce0f-42a3-b2a5-9753bab48eb6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:16.064393 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f3814e61-ce0f-42a3-b2a5-9753bab48eb6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:16.064815 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f3814e61-ce0f-42a3-b2a5-9753bab48eb6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:16.294371 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f3814e61-ce0f-42a3-b2a5-9753bab48eb6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:16.303249 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f3814e61-ce0f-42a3-b2a5-9753bab48eb6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.252550 Oct 23 01:19:16.303857 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1161/2360] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:16 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:16.313886 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d21c0bb8-7414-4254-aafd-0830e5d53e09 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:16.314655 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d21c0bb8-7414-4254-aafd-0830e5d53e09 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] [instance: 2dc8d790-1306-4a6d-b14d-6c3c1639770c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:16.320967 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d21c0bb8-7414-4254-aafd-0830e5d53e09 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:16.321562 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d21c0bb8-7414-4254-aafd-0830e5d53e09 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:16.322091 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d21c0bb8-7414-4254-aafd-0830e5d53e09 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:16.322855 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d21c0bb8-7414-4254-aafd-0830e5d53e09 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:16.323384 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d21c0bb8-7414-4254-aafd-0830e5d53e09 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:16.323876 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d21c0bb8-7414-4254-aafd-0830e5d53e09 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:16.545006 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d21c0bb8-7414-4254-aafd-0830e5d53e09 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8417cd8a252c4d3c9f2059c42bc82aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdabdb037d54103a656623e2c4c4a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:16.553511 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d21c0bb8-7414-4254-aafd-0830e5d53e09 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] 10.222.0.42 "GET /compute/v2.1/servers/2dc8d790-1306-4a6d-b14d-6c3c1639770c" status: 200 len: 1322 microversion: 2.1 time: 0.248392 Oct 23 01:19:16.557806 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1162/2361] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:16 2022] GET /compute/v2.1/servers/2dc8d790-1306-4a6d-b14d-6c3c1639770c => generated 1322 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:16.562790 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6321931c-c9d6-4ce0-86b5-0915437db350 tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] Action: 'create', calling method: .version_select at 0x7f5cc6214dc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-480931685", "description": "tempest-description-408685011"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:16.680372 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f5611c2d-7b52-40a0-9102-e07ed5607142 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "DELETE /compute/v2.1/images/051dcffd-8f6c-4ce9-9ba8-61db53bafce2" status: 204 len: 0 microversion: 2.1 time: 1.190062 Oct 23 01:19:16.680938 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1200/2362] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:15 2022] DELETE /compute/v2.1/images/051dcffd-8f6c-4ce9-9ba8-61db53bafce2 => generated 0 bytes in 1199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:19:16.688024 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d3770865-7d5d-4c40-bf3d-a52d876926d4 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "06f4c921-9d2b-4ef6-806f-b77fdc508baa"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:16.692363 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d3770865-7d5d-4c40-bf3d-a52d876926d4 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Request method failure captured: Oct 23 01:19:16.692363 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 23 01:19:16.692363 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:19:16.692363 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:19:16.692363 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:19:16.692363 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 416 Oct 23 01:19:16.692363 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:19:16.692363 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:19:16.692363 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:19:16.692363 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:19:16.692363 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJZEAurAeILsYJek3MCv_ryiTbidOLVZq6W4I7jJxeY_1_bTWRye2xM3EDOhowd_NyioevvIvzT9beBCgKqri_ZjLw9hdsIISMXmajO_VmobATT_GwpY_Y-GVylQtV9MoF1-Bup_Ahjld_2riQHnDzqLUWULm2acZYcK9UIbslVsdDU Oct 23 01:19:16.692363 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:19:16.692363 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:19:16.692363 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:19:16.692363 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:19:16.692363 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:19:16.692363 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:19:16.692363 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:19:16.692363 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:16.692363 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:19:16.692363 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:19:16.692363 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}] Oct 23 01:19:16.692363 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:16.692363 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:19:16.692363 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:16.692363 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:19:16.692363 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:19:16.692363 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:19:16.692363 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: cd6a6c5240f94ace91e1f0ed3e53fa7c Oct 23 01:19:16.692363 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:19:16.692363 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:19:16.692363 n-d-master-1 devstack@n-api.service[120945]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "06f4c921-9d2b-4ef6-806f-b77fdc508baa"}]}} Oct 23 01:19:16.692363 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:19:16.692363 n-d-master-1 devstack@n-api.service[120945]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 23 01:19:16.692363 n-d-master-1 devstack@n-api.service[120945]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '446b40bc-db5b-4123-9278-997bd6d04a0d', 'flavorRef': '452', 'networks': [{'uuid': '06f4c921-9d2b-4ef6-806f-b77fdc508baa'}]}}} Oct 23 01:19:16.692363 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:19:16.692363 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:16.692363 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 23 01:19:16.692363 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 23 01:19:16.692363 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 01:19:16.692363 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise error Oct 23 01:19:16.692363 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 23 01:19:16.692363 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:16.692363 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 23 01:19:16.692363 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 23 01:19:16.692363 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:16.692363 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 23 01:19:16.692363 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 23 01:19:16.692363 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:16.692363 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:16.695043 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:16.695043 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:16.695043 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:16.695043 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:16.695043 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:19:16.695043 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:19:16.695043 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:19:16.695043 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:19:16.695043 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:19:16.695043 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:19:16.695043 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 23 01:19:16.695043 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 23 01:19:16.695043 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 23 01:19:16.695043 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 23 01:19:16.695043 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 23 01:19:16.695043 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 23 01:19:16.695043 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 23 01:19:16.695043 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:16.695043 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:16.695043 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:16.695043 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:16.695043 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:16.695043 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:16.695043 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 23 01:19:16.695043 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 23 01:19:16.695043 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 23 01:19:16.695043 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:16.695043 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d3770865-7d5d-4c40-bf3d-a52d876926d4 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:19:16.695043 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d3770865-7d5d-4c40-bf3d-a52d876926d4 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.011972 Oct 23 01:19:16.695043 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1201/2363] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:19:16 2022] POST /compute/v2.1/servers => generated 619 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:19:16.705222 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1bc6e9ac-1cbc-4050-b57b-c59291fb0560 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:16.706061 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1bc6e9ac-1cbc-4050-b57b-c59291fb0560 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:16.712834 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:19:16.714886 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1bc6e9ac-1cbc-4050-b57b-c59291fb0560 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:16.715472 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1bc6e9ac-1cbc-4050-b57b-c59291fb0560 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:16.716061 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1bc6e9ac-1cbc-4050-b57b-c59291fb0560 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:16.717442 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1bc6e9ac-1cbc-4050-b57b-c59291fb0560 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:16.718051 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1bc6e9ac-1cbc-4050-b57b-c59291fb0560 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:16.718893 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1bc6e9ac-1cbc-4050-b57b-c59291fb0560 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:16.872670 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1bc6e9ac-1cbc-4050-b57b-c59291fb0560 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:16.882421 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1bc6e9ac-1cbc-4050-b57b-c59291fb0560 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:16.884843 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1bc6e9ac-1cbc-4050-b57b-c59291fb0560 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:16.886364 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1bc6e9ac-1cbc-4050-b57b-c59291fb0560 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b" status: 200 len: 1280 microversion: 2.25 time: 0.190761 Oct 23 01:19:16.903156 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1202/2364] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:19:16 2022] GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b => generated 1280 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:19:16.910838 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-43c36f68-ad52-4683-920f-4431262f4f34 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:16.911647 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-43c36f68-ad52-4683-920f-4431262f4f34 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: bc304d93-5c47-4830-af2c-bca071542590] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:16.918786 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-43c36f68-ad52-4683-920f-4431262f4f34 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:16.919418 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-43c36f68-ad52-4683-920f-4431262f4f34 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:16.920045 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-43c36f68-ad52-4683-920f-4431262f4f34 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:16.920923 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-43c36f68-ad52-4683-920f-4431262f4f34 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:16.921425 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-43c36f68-ad52-4683-920f-4431262f4f34 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:16.922017 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-43c36f68-ad52-4683-920f-4431262f4f34 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:16.977899 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6321931c-c9d6-4ce0-86b5-0915437db350 tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.418804 Oct 23 01:19:16.979209 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1163/2365] 10.222.0.42 () {60 vars in 1180 bytes} [Sun Oct 23 01:19:16 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:19:16.986888 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b05fd379-f911-4a1e-883e-38bbbb901419 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:16.987714 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b05fd379-f911-4a1e-883e-38bbbb901419 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 40104c3d-0e82-449a-a331-c4f6ba80afaf] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:16.996369 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b05fd379-f911-4a1e-883e-38bbbb901419 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:16.997169 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b05fd379-f911-4a1e-883e-38bbbb901419 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:16.997812 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b05fd379-f911-4a1e-883e-38bbbb901419 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:16.998719 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b05fd379-f911-4a1e-883e-38bbbb901419 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:16.999352 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b05fd379-f911-4a1e-883e-38bbbb901419 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:16.999885 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b05fd379-f911-4a1e-883e-38bbbb901419 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:17.038100 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b05fd379-f911-4a1e-883e-38bbbb901419 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 40104c3d-0e82-449a-a331-c4f6ba80afaf] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:19:17.095813 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-43c36f68-ad52-4683-920f-4431262f4f34 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:17.103885 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-43c36f68-ad52-4683-920f-4431262f4f34 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590" status: 200 len: 1484 microversion: 2.1 time: 0.199638 Oct 23 01:19:17.104461 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1203/2366] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:16 2022] GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590 => generated 1484 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:17.109325 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7f3c3ab3-d347-4a42-aab1-fbfede4af84e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:17.110666 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7f3c3ab3-d347-4a42-aab1-fbfede4af84e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:17.125006 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f3c3ab3-d347-4a42-aab1-fbfede4af84e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:17.125575 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f3c3ab3-d347-4a42-aab1-fbfede4af84e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:17.126700 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f3c3ab3-d347-4a42-aab1-fbfede4af84e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:17.127630 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f3c3ab3-d347-4a42-aab1-fbfede4af84e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:17.128112 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f3c3ab3-d347-4a42-aab1-fbfede4af84e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:17.128826 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f3c3ab3-d347-4a42-aab1-fbfede4af84e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:17.271810 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7f3c3ab3-d347-4a42-aab1-fbfede4af84e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:17.292041 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7f3c3ab3-d347-4a42-aab1-fbfede4af84e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.186216 Oct 23 01:19:17.292651 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1204/2367] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:17 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:17.320182 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b6662a58-02c9-4ffe-b74f-e826dc84c120 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:17.320807 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b6662a58-02c9-4ffe-b74f-e826dc84c120 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: d2d33142-cf85-4a5b-b63f-e3780f8ac0b1] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:17.327474 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b6662a58-02c9-4ffe-b74f-e826dc84c120 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:17.327961 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b6662a58-02c9-4ffe-b74f-e826dc84c120 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:17.328392 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b6662a58-02c9-4ffe-b74f-e826dc84c120 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:17.329152 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b6662a58-02c9-4ffe-b74f-e826dc84c120 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:17.330674 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b6662a58-02c9-4ffe-b74f-e826dc84c120 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:17.331308 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b6662a58-02c9-4ffe-b74f-e826dc84c120 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:17.477332 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b05fd379-f911-4a1e-883e-38bbbb901419 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "DELETE /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf" status: 204 len: 0 microversion: 2.1 time: 0.496347 Oct 23 01:19:17.477926 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1164/2368] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:19:16 2022] DELETE /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf => generated 0 bytes in 498 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:19:17.488084 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ebbcff0c-05f1-4285-85c8-ab8666e547be tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] Action: 'create', calling method: .version_select at 0x7f5cc62141f0>, body: {"security_group_rule": {"parent_group_id": "ccb435d6-bfd0-49ff-ab90-021cab0706bb", "ip_protocol": "tempest-999-347019726", "from_port": 22, "to_port": 22}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:17.514668 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b6662a58-02c9-4ffe-b74f-e826dc84c120 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:17.527649 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b6662a58-02c9-4ffe-b74f-e826dc84c120 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1" status: 200 len: 1520 microversion: 2.1 time: 0.215513 Oct 23 01:19:17.527649 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1205/2369] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:17 2022] GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 => generated 1520 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:17.532757 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-91c04e00-4182-4a4d-a8d2-56c603a14b3d tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:17.533464 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-91c04e00-4182-4a4d-a8d2-56c603a14b3d tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: 08afe605-c9f1-4d8b-98bc-9253414ebe56] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:17.540373 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-91c04e00-4182-4a4d-a8d2-56c603a14b3d tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:17.540926 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-91c04e00-4182-4a4d-a8d2-56c603a14b3d tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:17.541860 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-91c04e00-4182-4a4d-a8d2-56c603a14b3d tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:17.542861 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-91c04e00-4182-4a4d-a8d2-56c603a14b3d tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:17.543503 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-91c04e00-4182-4a4d-a8d2-56c603a14b3d tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:17.544730 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-91c04e00-4182-4a4d-a8d2-56c603a14b3d tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:17.562672 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-ebbcff0c-05f1-4285-85c8-ab8666e547be tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] HTTP exception thrown: Invalid IP protocol tempest-999-347019726. Oct 23 01:19:17.564351 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ebbcff0c-05f1-4285-85c8-ab8666e547be tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] Request method failure captured: Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 156 Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJaLVIrxyfbwNFNga7PG16zjbUd6VAGq8KH3FwX8MM569X76oF_ev5ALdncToM2OOGfNbBxP60fsCcGW3_hQEVFEp30JZJngOkS1Gj1D5HlPgMxTtKAs6yn8l6xkHsAbrXHzbVh1cqz3kYRi16Q_F6fXY0KdCQ_78KpeoZEs07hPRXw Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 64925bb905eb4ece9a6f193d2d02ffd5 Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-93380100 Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/64925bb905eb4ece9a6f193d2d02ffd5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_64925bb905eb4ece9a6f193d2d02ffd5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/64925bb905eb4ece9a6f193d2d02ffd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/64925bb905eb4ece9a6f193d2d02ffd5"}]}] Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-93380100 Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 64925bb905eb4ece9a6f193d2d02ffd5 Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-93380100 Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-93380100-project Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 2be11a97bc52448d8537ea47327aa008 Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-93380100-project Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: {"security_group_rule": {"parent_group_id": "ccb435d6-bfd0-49ff-ab90-021cab0706bb", "ip_protocol": "tempest-999-347019726", "from_port": 22, "to_port": 22}} Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: method: Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: exception: Invalid IP protocol tempest-999-347019726. Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'ccb435d6-bfd0-49ff-ab90-021cab0706bb', 'ip_protocol': 'tempest-999-347019726', 'from_port': 22, 'to_port': 22}}} Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-347019726. Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-347019726. Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:17.564508 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:17.568613 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:17.568613 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:17.568613 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:17.568613 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:17.568613 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:19:17.568613 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:19:17.568613 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-347019726. Oct 23 01:19:17.568613 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:17.568613 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ebbcff0c-05f1-4285-85c8-ab8666e547be tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] Returning 400 to user: Invalid IP protocol tempest-999-347019726. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:19:17.568613 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ebbcff0c-05f1-4285-85c8-ab8666e547be tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] 10.222.0.42 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.084411 Oct 23 01:19:17.570953 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1165/2370] 10.222.0.42 () {60 vars in 1195 bytes} [Sun Oct 23 01:19:17 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 92 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 23 01:19:17.575920 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-be8238bc-c42f-4408-b3c3-deac61117a0a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:17.577494 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-be8238bc-c42f-4408-b3c3-deac61117a0a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:17.584491 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-be8238bc-c42f-4408-b3c3-deac61117a0a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:17.584999 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-be8238bc-c42f-4408-b3c3-deac61117a0a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:17.585440 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-be8238bc-c42f-4408-b3c3-deac61117a0a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:17.586369 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-be8238bc-c42f-4408-b3c3-deac61117a0a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:17.586829 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-be8238bc-c42f-4408-b3c3-deac61117a0a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:17.587428 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-be8238bc-c42f-4408-b3c3-deac61117a0a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:17.760881 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-91c04e00-4182-4a4d-a8d2-56c603a14b3d tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:17.769238 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-be8238bc-c42f-4408-b3c3-deac61117a0a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:17.769445 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-91c04e00-4182-4a4d-a8d2-56c603a14b3d tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56" status: 200 len: 1313 microversion: 2.1 time: 0.241136 Oct 23 01:19:17.770063 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1206/2371] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:17 2022] GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56 => generated 1313 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:17.774672 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-8d631739-87e2-4659-b6ca-d551a995151a req-c7351ab3-10c0-4dcb-92db-f9665d240af7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc304d93-5c47-4830-af2c-bca071542590", "name": "network-vif-deleted", "tag": "baef31c1-b065-44f5-818e-dbc3bbdd5ce4"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:17.777794 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-be8238bc-c42f-4408-b3c3-deac61117a0a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.205568 Oct 23 01:19:17.785085 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-8d631739-87e2-4659-b6ca-d551a995151a req-c7351ab3-10c0-4dcb-92db-f9665d240af7 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:17.785754 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-8d631739-87e2-4659-b6ca-d551a995151a req-c7351ab3-10c0-4dcb-92db-f9665d240af7 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:17.786081 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-8d631739-87e2-4659-b6ca-d551a995151a req-c7351ab3-10c0-4dcb-92db-f9665d240af7 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:17.791342 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1166/2372] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:17 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:17.808261 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-a702233d-079b-4206-bcdf-ee8e185b3397 req-63a5531f-4b2a-41b0-af08-40bdb3e29d85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dc8d790-1306-4a6d-b14d-6c3c1639770c", "name": "network-vif-plugged", "status": "completed", "tag": "9092279f-a76e-4eac-928a-c17ce6983691"}, {"server_uuid": "d2d33142-cf85-4a5b-b63f-e3780f8ac0b1", "name": "network-vif-plugged", "status": "completed", "tag": "c671ef64-d392-46ae-a693-c9bcda7c8160"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:17.816497 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-8d631739-87e2-4659-b6ca-d551a995151a req-c7351ab3-10c0-4dcb-92db-f9665d240af7 service nova] Creating event network-vif-deleted:baef31c1-b065-44f5-818e-dbc3bbdd5ce4 for instance bc304d93-5c47-4830-af2c-bca071542590 on n-h2-master-1 Oct 23 01:19:17.819629 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-a702233d-079b-4206-bcdf-ee8e185b3397 req-63a5531f-4b2a-41b0-af08-40bdb3e29d85 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:17.820360 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-a702233d-079b-4206-bcdf-ee8e185b3397 req-63a5531f-4b2a-41b0-af08-40bdb3e29d85 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:17.821018 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-a702233d-079b-4206-bcdf-ee8e185b3397 req-63a5531f-4b2a-41b0-af08-40bdb3e29d85 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:17.822274 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-8d631739-87e2-4659-b6ca-d551a995151a req-c7351ab3-10c0-4dcb-92db-f9665d240af7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050984 Oct 23 01:19:17.836268 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1207/2373] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:19:17.836448 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-a702233d-079b-4206-bcdf-ee8e185b3397 req-63a5531f-4b2a-41b0-af08-40bdb3e29d85 service nova] Creating event network-vif-plugged:9092279f-a76e-4eac-928a-c17ce6983691 for instance 2dc8d790-1306-4a6d-b14d-6c3c1639770c on n-h1-master-1 Oct 23 01:19:17.837126 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-a702233d-079b-4206-bcdf-ee8e185b3397 req-63a5531f-4b2a-41b0-af08-40bdb3e29d85 service nova] Creating event network-vif-plugged:c671ef64-d392-46ae-a693-c9bcda7c8160 for instance d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 on n-h2-master-1 Oct 23 01:19:17.842304 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-44608c13-ae42-420a-812e-f1fd36068cb2 tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] Action: 'create', calling method: .version_select at 0x7f5cc61af0d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1986307817", "description": "tempest-description-448761228"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:17.846289 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-a702233d-079b-4206-bcdf-ee8e185b3397 req-63a5531f-4b2a-41b0-af08-40bdb3e29d85 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.053222 Oct 23 01:19:17.846887 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1167/2374] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:19:17.852039 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7cd8d926-4761-47da-8119-6656a44f0eae tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:17.852969 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7cd8d926-4761-47da-8119-6656a44f0eae tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] [instance: 2dc8d790-1306-4a6d-b14d-6c3c1639770c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:17.859737 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7cd8d926-4761-47da-8119-6656a44f0eae tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:17.860177 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7cd8d926-4761-47da-8119-6656a44f0eae tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:17.860924 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7cd8d926-4761-47da-8119-6656a44f0eae tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:17.861641 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7cd8d926-4761-47da-8119-6656a44f0eae tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:17.862238 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7cd8d926-4761-47da-8119-6656a44f0eae tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:17.862549 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7cd8d926-4761-47da-8119-6656a44f0eae tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:18.042591 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7cd8d926-4761-47da-8119-6656a44f0eae tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8417cd8a252c4d3c9f2059c42bc82aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdabdb037d54103a656623e2c4c4a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:18.050533 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7cd8d926-4761-47da-8119-6656a44f0eae tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] 10.222.0.42 "GET /compute/v2.1/servers/2dc8d790-1306-4a6d-b14d-6c3c1639770c" status: 200 len: 1322 microversion: 2.1 time: 0.202281 Oct 23 01:19:18.051109 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1168/2375] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:17 2022] GET /compute/v2.1/servers/2dc8d790-1306-4a6d-b14d-6c3c1639770c => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:18.056729 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5b9c0be6-d4d4-4cf0-bfd1-0c2b05d9ec71 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-313237220", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "7a6a6c21-62ee-4ff5-ad89-ac85c31d0d64"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:18.135521 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-5b9c0be6-d4d4-4cf0-bfd1-0c2b05d9ec71 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] validate_networks() for [('7a6a6c21-62ee-4ff5-ad89-ac85c31d0d64', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:19:18.311287 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-44608c13-ae42-420a-812e-f1fd36068cb2 tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.473412 Oct 23 01:19:18.311892 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1208/2376] 10.222.0.42 () {60 vars in 1180 bytes} [Sun Oct 23 01:19:17 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:19:18.324009 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-281e3158-763e-4191-878d-2fc70cffda7e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1339120193", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": -1, "networks": [{"uuid": "06f4c921-9d2b-4ef6-806f-b77fdc508baa"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:18.336919 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-281e3158-763e-4191-878d-2fc70cffda7e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] HTTP exception thrown: Flavor -1 could not be found. Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-281e3158-763e-4191-878d-2fc70cffda7e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Request method failure captured: Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 206 Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJZEAurAeILsYJek3MCv_ryiTbidOLVZq6W4I7jJxeY_1_bTWRye2xM3EDOhowd_NyioevvIvzT9beBCgKqri_ZjLw9hdsIISMXmajO_VmobATT_GwpY_Y-GVylQtV9MoF1-Bup_Ahjld_2riQHnDzqLUWULm2acZYcK9UIbslVsdDU Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}] Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: cd6a6c5240f94ace91e1f0ed3e53fa7c Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1339120193", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": -1, "networks": [{"uuid": "06f4c921-9d2b-4ef6-806f-b77fdc508baa"}]}} Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: exception: Flavor -1 could not be found. Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1339120193', 'imageRef': '446b40bc-db5b-4123-9278-997bd6d04a0d', 'flavorRef': -1, 'networks': [{'uuid': '06f4c921-9d2b-4ef6-806f-b77fdc508baa'}]}}} Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:19:18.338843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:19:18.344429 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:19:18.344429 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:19:18.344429 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:19:18.344429 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:19:18.344429 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 23 01:19:18.344429 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 23 01:19:18.344429 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 23 01:19:18.344429 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 23 01:19:18.344429 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:18.344429 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:18.344429 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:18.344429 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:18.344429 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:18.344429 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:18.344429 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:19:18.344429 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:19:18.344429 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 23 01:19:18.344429 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:18.344429 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-281e3158-763e-4191-878d-2fc70cffda7e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:19:18.344429 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-281e3158-763e-4191-878d-2fc70cffda7e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.027402 Oct 23 01:19:18.344429 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1209/2377] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:19:18 2022] POST /compute/v2.1/servers => generated 73 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 23 01:19:18.350527 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-214b6156-7144-4912-8bff-d591160f667f tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:18.351246 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-214b6156-7144-4912-8bff-d591160f667f tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:18.357367 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-214b6156-7144-4912-8bff-d591160f667f tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:18.357851 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-214b6156-7144-4912-8bff-d591160f667f tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:18.358370 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-214b6156-7144-4912-8bff-d591160f667f tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:18.359067 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-214b6156-7144-4912-8bff-d591160f667f tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:18.359519 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-214b6156-7144-4912-8bff-d591160f667f tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:18.359941 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-214b6156-7144-4912-8bff-d591160f667f tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:18.580154 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-214b6156-7144-4912-8bff-d591160f667f tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:18.592281 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-214b6156-7144-4912-8bff-d591160f667f tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:18.593742 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-214b6156-7144-4912-8bff-d591160f667f tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:18.594883 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-214b6156-7144-4912-8bff-d591160f667f tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b" status: 200 len: 1280 microversion: 2.25 time: 0.253167 Oct 23 01:19:18.599348 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1210/2378] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:19:18 2022] GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b => generated 1280 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:19:18.601115 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7bfa292c-738c-4d39-9673-83f04053aac5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:18.601772 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7bfa292c-738c-4d39-9673-83f04053aac5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: bc304d93-5c47-4830-af2c-bca071542590] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:18.608581 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7bfa292c-738c-4d39-9673-83f04053aac5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:18.609174 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7bfa292c-738c-4d39-9673-83f04053aac5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:18.609695 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7bfa292c-738c-4d39-9673-83f04053aac5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:18.611321 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7bfa292c-738c-4d39-9673-83f04053aac5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:18.611858 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7bfa292c-738c-4d39-9673-83f04053aac5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:18.612598 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7bfa292c-738c-4d39-9673-83f04053aac5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:18.624935 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-5b9c0be6-d4d4-4cf0-bfd1-0c2b05d9ec71 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:19:18.625422 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-5b9c0be6-d4d4-4cf0-bfd1-0c2b05d9ec71 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:19:18.626662 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-5b9c0be6-d4d4-4cf0-bfd1-0c2b05d9ec71 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:19:18.627081 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-5b9c0be6-d4d4-4cf0-bfd1-0c2b05d9ec71 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:19:18.627668 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-5b9c0be6-d4d4-4cf0-bfd1-0c2b05d9ec71 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:19:18.637693 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b9c0be6-d4d4-4cf0-bfd1-0c2b05d9ec71 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:18.638226 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b9c0be6-d4d4-4cf0-bfd1-0c2b05d9ec71 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:18.638769 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b9c0be6-d4d4-4cf0-bfd1-0c2b05d9ec71 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:18.639540 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b9c0be6-d4d4-4cf0-bfd1-0c2b05d9ec71 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:18.640025 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b9c0be6-d4d4-4cf0-bfd1-0c2b05d9ec71 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:18.640483 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b9c0be6-d4d4-4cf0-bfd1-0c2b05d9ec71 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:18.647678 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7bfa292c-738c-4d39-9673-83f04053aac5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:18.648155 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7bfa292c-738c-4d39-9673-83f04053aac5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:18.648583 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7bfa292c-738c-4d39-9673-83f04053aac5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:18.649024 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-7bfa292c-738c-4d39-9673-83f04053aac5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lazy-loading 'fault' on Instance uuid bc304d93-5c47-4830-af2c-bca071542590 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:19:18.652476 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:19:18.658976 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-5b9c0be6-d4d4-4cf0-bfd1-0c2b05d9ec71 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Getting quotas for project 50bd4c137b6a42488f39d173d46520dd. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:19:18.664426 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-5b9c0be6-d4d4-4cf0-bfd1-0c2b05d9ec71 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Getting quotas for user ecb97fa679eb4bf8a41862d3c248a217 and project 50bd4c137b6a42488f39d173d46520dd. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:19:18.678208 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5b9c0be6-d4d4-4cf0-bfd1-0c2b05d9ec71 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:19:18.680599 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5b9c0be6-d4d4-4cf0-bfd1-0c2b05d9ec71 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 8fb6c2f7-737b-4b87-9f6b-58ba7f12e428] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:19:18.692039 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7bfa292c-738c-4d39-9673-83f04053aac5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:18.700107 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7bfa292c-738c-4d39-9673-83f04053aac5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590" status: 200 len: 1300 microversion: 2.1 time: 0.103647 Oct 23 01:19:18.707048 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1211/2379] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:18 2022] GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590 => generated 1300 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:18.707048 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c4b5e836-7c4a-404c-b151-0d8f0482c21f tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] Action: 'create', calling method: .version_select at 0x7f5cc6192790>, body: {"security_group_rule": {"parent_group_id": "6758bad0-ce53-4213-a882-cd8170ed6db9", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:18.751881 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-c4b5e836-7c4a-404c-b151-0d8f0482c21f tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c4b5e836-7c4a-404c-b151-0d8f0482c21f tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] Request method failure captured: Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 138 Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJaLVIrxyfbwNFNga7PG16zjbUd6VAGq8KH3FwX8MM569X76oF_ev5ALdncToM2OOGfNbBxP60fsCcGW3_hQEVFEp30JZJngOkS1Gj1D5HlPgMxTtKAs6yn8l6xkHsAbrXHzbVh1cqz3kYRi16Q_F6fXY0KdCQ_78KpeoZEs07hPRXw Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 64925bb905eb4ece9a6f193d2d02ffd5 Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-93380100 Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/64925bb905eb4ece9a6f193d2d02ffd5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_64925bb905eb4ece9a6f193d2d02ffd5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/64925bb905eb4ece9a6f193d2d02ffd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/64925bb905eb4ece9a6f193d2d02ffd5"}]}] Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-93380100 Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 64925bb905eb4ece9a6f193d2d02ffd5 Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-93380100 Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-93380100-project Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 2be11a97bc52448d8537ea47327aa008 Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-93380100-project Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: {"security_group_rule": {"parent_group_id": "6758bad0-ce53-4213-a882-cd8170ed6db9", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: method: Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: action_args: {'body': {'security_group_rule': {'parent_group_id': '6758bad0-ce53-4213-a882-cd8170ed6db9', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 23 01:19:18.753365 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:18.759524 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:18.759524 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:18.759524 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:18.759524 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:18.759524 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:18.759524 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:19:18.759524 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:19:18.759524 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 23 01:19:18.759524 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:18.759524 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c4b5e836-7c4a-404c-b151-0d8f0482c21f tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:19:18.759524 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c4b5e836-7c4a-404c-b151-0d8f0482c21f tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] 10.222.0.42 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.052309 Oct 23 01:19:18.759524 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1212/2380] 10.222.0.42 () {60 vars in 1195 bytes} [Sun Oct 23 01:19:18 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:19:18.760339 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-335311d9-fbe7-495a-8ffc-e75d2157216d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:18.760730 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-335311d9-fbe7-495a-8ffc-e75d2157216d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:18.767774 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-335311d9-fbe7-495a-8ffc-e75d2157216d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:18.768329 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-335311d9-fbe7-495a-8ffc-e75d2157216d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:18.768716 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-335311d9-fbe7-495a-8ffc-e75d2157216d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:18.769405 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-335311d9-fbe7-495a-8ffc-e75d2157216d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:18.769859 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-335311d9-fbe7-495a-8ffc-e75d2157216d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:18.770313 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-335311d9-fbe7-495a-8ffc-e75d2157216d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:18.832489 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5b9c0be6-d4d4-4cf0-bfd1-0c2b05d9ec71 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.779838 Oct 23 01:19:18.839191 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1169/2381] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:19:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:19:18.839191 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b9b845a4-0220-463a-871e-feb097f391ab tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:18.839191 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b9b845a4-0220-463a-871e-feb097f391ab tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: d2d33142-cf85-4a5b-b63f-e3780f8ac0b1] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:18.847319 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b9b845a4-0220-463a-871e-feb097f391ab tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:18.847863 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b9b845a4-0220-463a-871e-feb097f391ab tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:18.848315 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b9b845a4-0220-463a-871e-feb097f391ab tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:18.849123 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b9b845a4-0220-463a-871e-feb097f391ab tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:18.849623 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b9b845a4-0220-463a-871e-feb097f391ab tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:18.850075 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b9b845a4-0220-463a-871e-feb097f391ab tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:18.940557 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-335311d9-fbe7-495a-8ffc-e75d2157216d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:18.950519 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-335311d9-fbe7-495a-8ffc-e75d2157216d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.194094 Oct 23 01:19:18.951350 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1213/2382] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:18 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:18.956341 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3f23b8a2-1967-4031-9c13-7b46203a5f83 tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] Action: 'create', calling method: .version_select at 0x7f5cc61929d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1611406235", "description": "tempest-description-1794129236"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:19.024572 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b9b845a4-0220-463a-871e-feb097f391ab tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:19.032532 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b9b845a4-0220-463a-871e-feb097f391ab tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1" status: 200 len: 1520 microversion: 2.1 time: 0.198311 Oct 23 01:19:19.033101 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1170/2383] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:18 2022] GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:19.037631 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ddafe05d-24be-4271-a184-ad599aa543de tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:19.038263 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ddafe05d-24be-4271-a184-ad599aa543de tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: 08afe605-c9f1-4d8b-98bc-9253414ebe56] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:19.044178 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ddafe05d-24be-4271-a184-ad599aa543de tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:19.045035 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ddafe05d-24be-4271-a184-ad599aa543de tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:19.045626 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ddafe05d-24be-4271-a184-ad599aa543de tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:19.046498 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ddafe05d-24be-4271-a184-ad599aa543de tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:19.047094 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ddafe05d-24be-4271-a184-ad599aa543de tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:19.048309 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ddafe05d-24be-4271-a184-ad599aa543de tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:19.296166 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ddafe05d-24be-4271-a184-ad599aa543de tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:19.316717 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ddafe05d-24be-4271-a184-ad599aa543de tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56" status: 200 len: 1313 microversion: 2.1 time: 0.281546 Oct 23 01:19:19.319067 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1171/2384] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:19 2022] GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56 => generated 1313 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:19.332271 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f4863aa6-f62a-4b38-b3d3-59afb3982f59 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:19.333432 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f4863aa6-f62a-4b38-b3d3-59afb3982f59 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 8fb6c2f7-737b-4b87-9f6b-58ba7f12e428] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:19.404922 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f4863aa6-f62a-4b38-b3d3-59afb3982f59 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:19.414880 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f4863aa6-f62a-4b38-b3d3-59afb3982f59 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/8fb6c2f7-737b-4b87-9f6b-58ba7f12e428" status: 200 len: 1207 microversion: 2.1 time: 0.094381 Oct 23 01:19:19.416217 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1172/2385] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:19 2022] GET /compute/v2.1/servers/8fb6c2f7-737b-4b87-9f6b-58ba7f12e428 => generated 1207 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:19.422027 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4e8dc35a-e44c-4c58-aafd-1c701c5bef86 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:19.426091 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4e8dc35a-e44c-4c58-aafd-1c701c5bef86 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:19.430263 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4e8dc35a-e44c-4c58-aafd-1c701c5bef86 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:19.430813 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4e8dc35a-e44c-4c58-aafd-1c701c5bef86 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:19.431468 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4e8dc35a-e44c-4c58-aafd-1c701c5bef86 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:19.432460 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4e8dc35a-e44c-4c58-aafd-1c701c5bef86 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:19.433089 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4e8dc35a-e44c-4c58-aafd-1c701c5bef86 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:19.433701 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4e8dc35a-e44c-4c58-aafd-1c701c5bef86 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:19.549550 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3f23b8a2-1967-4031-9c13-7b46203a5f83 tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.596635 Oct 23 01:19:19.558155 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1214/2386] 10.222.0.42 () {60 vars in 1180 bytes} [Sun Oct 23 01:19:18 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:19:19.563974 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-741643b4-a69c-48ee-9de1-392a9b7e6ba2 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:19.569745 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-741643b4-a69c-48ee-9de1-392a9b7e6ba2 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] [instance: 2dc8d790-1306-4a6d-b14d-6c3c1639770c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:19.579884 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-741643b4-a69c-48ee-9de1-392a9b7e6ba2 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:19.583876 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-741643b4-a69c-48ee-9de1-392a9b7e6ba2 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:19.584688 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-741643b4-a69c-48ee-9de1-392a9b7e6ba2 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:19.587026 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-741643b4-a69c-48ee-9de1-392a9b7e6ba2 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:19.587652 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-741643b4-a69c-48ee-9de1-392a9b7e6ba2 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:19.589684 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-741643b4-a69c-48ee-9de1-392a9b7e6ba2 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:19.598833 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4e8dc35a-e44c-4c58-aafd-1c701c5bef86 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:19.610700 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4e8dc35a-e44c-4c58-aafd-1c701c5bef86 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.192409 Oct 23 01:19:19.611722 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1173/2387] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:19 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:19.617595 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8ebfd7b7-6284-4e87-ba97-43210d1c2f4b tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] Action: 'create', calling method: .version_select at 0x7f5cc6201550>, body: {"security_group_rule": {"parent_group_id": "192b1f9d-233e-42ac-9f3e-6464934d8a1d", "ip_protocol": "tcp", "from_port": 22, "to_port": 433344706}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:19.693758 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-8ebfd7b7-6284-4e87-ba97-43210d1c2f4b tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] HTTP exception thrown: Invalid port range 22:433344706. Valid TCP ports should be between 1-65535 Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8ebfd7b7-6284-4e87-ba97-43210d1c2f4b tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] Request method failure captured: Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 145 Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJaLVIrxyfbwNFNga7PG16zjbUd6VAGq8KH3FwX8MM569X76oF_ev5ALdncToM2OOGfNbBxP60fsCcGW3_hQEVFEp30JZJngOkS1Gj1D5HlPgMxTtKAs6yn8l6xkHsAbrXHzbVh1cqz3kYRi16Q_F6fXY0KdCQ_78KpeoZEs07hPRXw Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 64925bb905eb4ece9a6f193d2d02ffd5 Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-93380100 Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/64925bb905eb4ece9a6f193d2d02ffd5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_64925bb905eb4ece9a6f193d2d02ffd5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/64925bb905eb4ece9a6f193d2d02ffd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/64925bb905eb4ece9a6f193d2d02ffd5"}]}] Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-93380100 Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 64925bb905eb4ece9a6f193d2d02ffd5 Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-93380100 Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-93380100-project Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 2be11a97bc52448d8537ea47327aa008 Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-93380100-project Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: {"security_group_rule": {"parent_group_id": "192b1f9d-233e-42ac-9f3e-6464934d8a1d", "ip_protocol": "tcp", "from_port": 22, "to_port": 433344706}} Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: method: Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: exception: Invalid port range 22:433344706. Valid TCP ports should be between 1-65535 Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: action_args: {'body': {'security_group_rule': {'parent_group_id': '192b1f9d-233e-42ac-9f3e-6464934d8a1d', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 433344706}}} Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:433344706. Valid TCP ports should be between 1-65535 Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:433344706. Valid TCP ports should be between 1-65535 Oct 23 01:19:19.696063 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:19.699655 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:19.699655 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:19.699655 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:19.699655 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:19.699655 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:19.699655 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:19:19.699655 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:19:19.699655 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:433344706. Valid TCP ports should be between 1-65535 Oct 23 01:19:19.699655 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:19.699655 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8ebfd7b7-6284-4e87-ba97-43210d1c2f4b tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] Returning 400 to user: Invalid port range 22:433344706. Valid TCP ports should be between 1-65535 {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:19:19.699655 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8ebfd7b7-6284-4e87-ba97-43210d1c2f4b tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] 10.222.0.42 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.084614 Oct 23 01:19:19.703539 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1174/2388] 10.222.0.42 () {60 vars in 1195 bytes} [Sun Oct 23 01:19:19 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 91 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:19:19.709279 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f831e6d6-47c0-4205-81c6-b32b94787c31 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:19.709890 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f831e6d6-47c0-4205-81c6-b32b94787c31 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:19.723053 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f831e6d6-47c0-4205-81c6-b32b94787c31 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:19.725368 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f831e6d6-47c0-4205-81c6-b32b94787c31 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:19.725956 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f831e6d6-47c0-4205-81c6-b32b94787c31 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:19.726929 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f831e6d6-47c0-4205-81c6-b32b94787c31 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:19.727474 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f831e6d6-47c0-4205-81c6-b32b94787c31 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:19.728126 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f831e6d6-47c0-4205-81c6-b32b94787c31 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:19.855372 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-741643b4-a69c-48ee-9de1-392a9b7e6ba2 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8417cd8a252c4d3c9f2059c42bc82aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdabdb037d54103a656623e2c4c4a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:19.865633 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-741643b4-a69c-48ee-9de1-392a9b7e6ba2 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] 10.222.0.42 "GET /compute/v2.1/servers/2dc8d790-1306-4a6d-b14d-6c3c1639770c" status: 200 len: 1322 microversion: 2.1 time: 0.306113 Oct 23 01:19:19.866375 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1215/2389] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:19 2022] GET /compute/v2.1/servers/2dc8d790-1306-4a6d-b14d-6c3c1639770c => generated 1322 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:19.888025 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-99f3c8d2-ae1d-4663-b6c5-cc19d60686ec tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1403373408", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "06f4c921-9d2b-4ef6-806f-b77fdc508baa"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-99f3c8d2-ae1d-4663-b6c5-cc19d60686ec tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Request method failure captured: Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 173 Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJZEAurAeILsYJek3MCv_ryiTbidOLVZq6W4I7jJxeY_1_bTWRye2xM3EDOhowd_NyioevvIvzT9beBCgKqri_ZjLw9hdsIISMXmajO_VmobATT_GwpY_Y-GVylQtV9MoF1-Bup_Ahjld_2riQHnDzqLUWULm2acZYcK9UIbslVsdDU Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}] Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: cd6a6c5240f94ace91e1f0ed3e53fa7c Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1403373408", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "06f4c921-9d2b-4ef6-806f-b77fdc508baa"}]}} Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1403373408', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '06f4c921-9d2b-4ef6-806f-b77fdc508baa'}]}}} Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise error Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi -1 Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 23 01:19:19.893596 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 23 01:19:19.897492 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 23 01:19:19.897492 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 23 01:19:19.897492 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 23 01:19:19.897492 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:19.897492 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:19.897492 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:19.897492 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:19.897492 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:19.897492 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:19.897492 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 23 01:19:19.897492 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 23 01:19:19.897492 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 23 01:19:19.897492 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:19.899274 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-99f3c8d2-ae1d-4663-b6c5-cc19d60686ec tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:19:19.900345 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-99f3c8d2-ae1d-4663-b6c5-cc19d60686ec tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.020569 Oct 23 01:19:19.904658 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1216/2390] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:19:19 2022] POST /compute/v2.1/servers => generated 145 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:19:19.910409 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4aacfc2f-0349-4521-ab03-d35f1cd881fd tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] Action: 'create', calling method: .version_select at 0x7f5cc61925e0>, body: {"security_group_rule": {"parent_group_id": "3071a59d-97ac-45b6-b5ba-f3bd49a0150d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:19.947560 n-d-master-1 devstack@n-api.service[120945]: DEBUG neutronclient.v2_0.client [None req-4aacfc2f-0349-4521-ab03-d35f1cd881fd tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3071a59d-97ac-45b6-b5ba-f3bd49a0150d does not exist", "detail": ""}} {{(pid=120945) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 23 01:19:19.948339 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.security_group_api [None req-4aacfc2f-0349-4521-ab03-d35f1cd881fd tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] Neutron security group 3071a59d-97ac-45b6-b5ba-f3bd49a0150d not found {{(pid=120945) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 23 01:19:19.949028 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-4aacfc2f-0349-4521-ab03-d35f1cd881fd tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] HTTP exception thrown: Security group 3071a59d-97ac-45b6-b5ba-f3bd49a0150d does not exist Oct 23 01:19:19.949028 n-d-master-1 devstack@n-api.service[120945]: Neutron server returns request_ids: ['req-cc9ffdfa-56f6-4e3c-8eef-f4b35c0b21fb'] Oct 23 01:19:19.950828 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f831e6d6-47c0-4205-81c6-b32b94787c31 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4aacfc2f-0349-4521-ab03-d35f1cd881fd tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] Request method failure captured: Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 138 Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJaLVIrxyfbwNFNga7PG16zjbUd6VAGq8KH3FwX8MM569X76oF_ev5ALdncToM2OOGfNbBxP60fsCcGW3_hQEVFEp30JZJngOkS1Gj1D5HlPgMxTtKAs6yn8l6xkHsAbrXHzbVh1cqz3kYRi16Q_F6fXY0KdCQ_78KpeoZEs07hPRXw Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 64925bb905eb4ece9a6f193d2d02ffd5 Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-93380100 Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/64925bb905eb4ece9a6f193d2d02ffd5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_64925bb905eb4ece9a6f193d2d02ffd5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/64925bb905eb4ece9a6f193d2d02ffd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/64925bb905eb4ece9a6f193d2d02ffd5"}]}] Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-93380100 Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 64925bb905eb4ece9a6f193d2d02ffd5 Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-93380100 Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-93380100-project Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 2be11a97bc52448d8537ea47327aa008 Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-93380100-project Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: {"security_group_rule": {"parent_group_id": "3071a59d-97ac-45b6-b5ba-f3bd49a0150d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: method: Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: exception: Security group 3071a59d-97ac-45b6-b5ba-f3bd49a0150d does not exist Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: Neutron server returns request_ids: ['req-cc9ffdfa-56f6-4e3c-8eef-f4b35c0b21fb'] Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: action_args: {'body': {'security_group_rule': {'parent_group_id': '3071a59d-97ac-45b6-b5ba-f3bd49a0150d', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 23 01:19:19.951351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 23 01:19:19.955407 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 23 01:19:19.955407 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3071a59d-97ac-45b6-b5ba-f3bd49a0150d does not exist Oct 23 01:19:19.955407 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cc9ffdfa-56f6-4e3c-8eef-f4b35c0b21fb'] Oct 23 01:19:19.955407 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:19.955407 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:19.955407 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:19.955407 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:19.955407 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 23 01:19:19.955407 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 23 01:19:19.955407 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 23 01:19:19.955407 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 23 01:19:19.955407 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3071a59d-97ac-45b6-b5ba-f3bd49a0150d does not exist Oct 23 01:19:19.955407 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cc9ffdfa-56f6-4e3c-8eef-f4b35c0b21fb'] Oct 23 01:19:19.955407 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:19.955407 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:19.955407 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:19.955407 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:19.955407 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:19.955407 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:19.955407 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:19:19.955407 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:19:19.955407 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:19:19.955407 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:19:19.955407 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:19:19.955407 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:19:19.955407 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 23 01:19:19.955407 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 23 01:19:19.955407 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3071a59d-97ac-45b6-b5ba-f3bd49a0150d does not exist Oct 23 01:19:19.955407 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cc9ffdfa-56f6-4e3c-8eef-f4b35c0b21fb'] Oct 23 01:19:19.955407 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:19.955407 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:19.955407 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:19.955407 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:19.955407 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:19.955407 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:19.955407 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:19:19.955407 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:19:19.955407 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3071a59d-97ac-45b6-b5ba-f3bd49a0150d does not exist Oct 23 01:19:19.955407 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cc9ffdfa-56f6-4e3c-8eef-f4b35c0b21fb'] Oct 23 01:19:19.955407 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:19.958426 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4aacfc2f-0349-4521-ab03-d35f1cd881fd tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] Returning 404 to user: Security group 3071a59d-97ac-45b6-b5ba-f3bd49a0150d does not exist Oct 23 01:19:19.958426 n-d-master-1 devstack@n-api.service[120945]: Neutron server returns request_ids: ['req-cc9ffdfa-56f6-4e3c-8eef-f4b35c0b21fb'] {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:19:19.959498 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4aacfc2f-0349-4521-ab03-d35f1cd881fd tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] 10.222.0.42 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.053663 Oct 23 01:19:19.964225 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1217/2391] 10.222.0.42 () {60 vars in 1195 bytes} [Sun Oct 23 01:19:19 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:19:19.965870 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9e86c9d2-8907-46ca-96d2-33fae9b5751f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:19.966523 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9e86c9d2-8907-46ca-96d2-33fae9b5751f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: bc304d93-5c47-4830-af2c-bca071542590] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:19.973240 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e86c9d2-8907-46ca-96d2-33fae9b5751f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:19.973386 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f831e6d6-47c0-4205-81c6-b32b94787c31 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:19.973733 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e86c9d2-8907-46ca-96d2-33fae9b5751f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:19.974270 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e86c9d2-8907-46ca-96d2-33fae9b5751f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:19.974777 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f831e6d6-47c0-4205-81c6-b32b94787c31 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:19.974966 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e86c9d2-8907-46ca-96d2-33fae9b5751f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:19.975607 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e86c9d2-8907-46ca-96d2-33fae9b5751f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:19.975943 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f831e6d6-47c0-4205-81c6-b32b94787c31 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b" status: 200 len: 1280 microversion: 2.25 time: 0.270790 Oct 23 01:19:19.976184 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e86c9d2-8907-46ca-96d2-33fae9b5751f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:19.976501 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1175/2392] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:19:19 2022] GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b => generated 1280 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:19:19.992851 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-65388802-45e5-47a1-86f0-63c39f46dfaa req-cb31821d-b674-44f6-9406-35919c590567 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08afe605-c9f1-4d8b-98bc-9253414ebe56", "name": "network-vif-plugged", "status": "completed", "tag": "4b120ca2-cd12-4f29-a253-45c547ab8eec"}, {"server_uuid": "40104c3d-0e82-449a-a331-c4f6ba80afaf", "name": "network-vif-unplugged", "status": "completed", "tag": "c2cc7df3-aa5d-4a0e-abe9-5229c05e5354"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:20.007911 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-65388802-45e5-47a1-86f0-63c39f46dfaa req-cb31821d-b674-44f6-9406-35919c590567 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:20.008387 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-65388802-45e5-47a1-86f0-63c39f46dfaa req-cb31821d-b674-44f6-9406-35919c590567 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:20.009043 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-65388802-45e5-47a1-86f0-63c39f46dfaa req-cb31821d-b674-44f6-9406-35919c590567 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:20.021314 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e86c9d2-8907-46ca-96d2-33fae9b5751f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:20.021935 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e86c9d2-8907-46ca-96d2-33fae9b5751f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:20.022502 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e86c9d2-8907-46ca-96d2-33fae9b5751f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:20.022979 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-65388802-45e5-47a1-86f0-63c39f46dfaa req-cb31821d-b674-44f6-9406-35919c590567 service nova] Creating event network-vif-plugged:4b120ca2-cd12-4f29-a253-45c547ab8eec for instance 08afe605-c9f1-4d8b-98bc-9253414ebe56 on n-h1-master-1 Oct 23 01:19:20.023079 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-9e86c9d2-8907-46ca-96d2-33fae9b5751f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lazy-loading 'fault' on Instance uuid bc304d93-5c47-4830-af2c-bca071542590 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:19:20.023489 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-65388802-45e5-47a1-86f0-63c39f46dfaa req-cb31821d-b674-44f6-9406-35919c590567 service nova] Creating event network-vif-unplugged:c2cc7df3-aa5d-4a0e-abe9-5229c05e5354 for instance 40104c3d-0e82-449a-a331-c4f6ba80afaf on n-h1-master-1 Oct 23 01:19:20.029857 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-65388802-45e5-47a1-86f0-63c39f46dfaa req-cb31821d-b674-44f6-9406-35919c590567 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.052038 Oct 23 01:19:20.030552 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1176/2393] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:19:20.037272 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b79f991f-6052-49d3-94ed-8d5f72e4054c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:20.038149 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b79f991f-6052-49d3-94ed-8d5f72e4054c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:20.044742 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b79f991f-6052-49d3-94ed-8d5f72e4054c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:20.045413 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b79f991f-6052-49d3-94ed-8d5f72e4054c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:20.046025 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b79f991f-6052-49d3-94ed-8d5f72e4054c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:20.046725 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b79f991f-6052-49d3-94ed-8d5f72e4054c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:20.047209 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b79f991f-6052-49d3-94ed-8d5f72e4054c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:20.048154 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b79f991f-6052-49d3-94ed-8d5f72e4054c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:20.068726 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9e86c9d2-8907-46ca-96d2-33fae9b5751f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:20.077502 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9e86c9d2-8907-46ca-96d2-33fae9b5751f tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590" status: 200 len: 1300 microversion: 2.1 time: 0.115592 Oct 23 01:19:20.078102 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1218/2394] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:19 2022] GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590 => generated 1300 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:20.090083 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2a067905-17c9-416f-a739-b2fb7d8a3ed4 tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] Calling method '.version_select at 0x7f5cc6144700>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:20.143152 n-d-master-1 devstack@n-api.service[120945]: DEBUG neutronclient.v2_0.client [None req-2a067905-17c9-416f-a739-b2fb7d8a3ed4 tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule a993bb10-833d-47a5-8762-1a75a1953205 does not exist", "detail": ""}} {{(pid=120945) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 23 01:19:20.143925 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.security_group_api [None req-2a067905-17c9-416f-a739-b2fb7d8a3ed4 tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] Neutron security group rule a993bb10-833d-47a5-8762-1a75a1953205 not found {{(pid=120945) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 23 01:19:20.144601 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-2a067905-17c9-416f-a739-b2fb7d8a3ed4 tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] HTTP exception thrown: Security group rule a993bb10-833d-47a5-8762-1a75a1953205 does not exist Oct 23 01:19:20.144601 n-d-master-1 devstack@n-api.service[120945]: Neutron server returns request_ids: ['req-c0681ca9-7d5f-42a4-99e3-208cd1150330'] Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2a067905-17c9-416f-a739-b2fb7d8a3ed4 tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] Request method failure captured: Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/os-security-group-rules/a993bb10-833d-47a5-8762-1a75a1953205 HTTP/1.1 Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJaLVIrxyfbwNFNga7PG16zjbUd6VAGq8KH3FwX8MM569X76oF_ev5ALdncToM2OOGfNbBxP60fsCcGW3_hQEVFEp30JZJngOkS1Gj1D5HlPgMxTtKAs6yn8l6xkHsAbrXHzbVh1cqz3kYRi16Q_F6fXY0KdCQ_78KpeoZEs07hPRXw Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 64925bb905eb4ece9a6f193d2d02ffd5 Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-93380100 Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/64925bb905eb4ece9a6f193d2d02ffd5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_64925bb905eb4ece9a6f193d2d02ffd5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/64925bb905eb4ece9a6f193d2d02ffd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/64925bb905eb4ece9a6f193d2d02ffd5"}]}] Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-93380100 Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 64925bb905eb4ece9a6f193d2d02ffd5 Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-93380100 Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-93380100-project Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 2be11a97bc52448d8537ea47327aa008 Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-93380100-project Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: method: Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: exception: Security group rule a993bb10-833d-47a5-8762-1a75a1953205 does not exist Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: Neutron server returns request_ids: ['req-c0681ca9-7d5f-42a4-99e3-208cd1150330'] Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'a993bb10-833d-47a5-8762-1a75a1953205'} Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 23 01:19:20.146604 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule a993bb10-833d-47a5-8762-1a75a1953205 does not exist Oct 23 01:19:20.149799 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c0681ca9-7d5f-42a4-99e3-208cd1150330'] Oct 23 01:19:20.149799 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:20.149799 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:20.149799 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:20.149799 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:20.149799 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 23 01:19:20.149799 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 23 01:19:20.149799 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 23 01:19:20.149799 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 23 01:19:20.149799 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule a993bb10-833d-47a5-8762-1a75a1953205 does not exist Oct 23 01:19:20.149799 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c0681ca9-7d5f-42a4-99e3-208cd1150330'] Oct 23 01:19:20.149799 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:20.149799 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:20.149799 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:20.149799 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:20.149799 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:20.149799 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:20.149799 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:19:20.149799 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:19:20.149799 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:19:20.149799 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:19:20.149799 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:19:20.149799 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:19:20.149799 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 23 01:19:20.149799 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 23 01:19:20.149799 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule a993bb10-833d-47a5-8762-1a75a1953205 does not exist Oct 23 01:19:20.149799 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c0681ca9-7d5f-42a4-99e3-208cd1150330'] Oct 23 01:19:20.149799 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:20.149799 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:20.149799 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:20.149799 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:20.149799 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:20.149799 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:20.149799 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:19:20.149799 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:19:20.149799 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule a993bb10-833d-47a5-8762-1a75a1953205 does not exist Oct 23 01:19:20.149799 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c0681ca9-7d5f-42a4-99e3-208cd1150330'] Oct 23 01:19:20.149799 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:20.149799 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2a067905-17c9-416f-a739-b2fb7d8a3ed4 tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] Returning 404 to user: Security group rule a993bb10-833d-47a5-8762-1a75a1953205 does not exist Oct 23 01:19:20.149799 n-d-master-1 devstack@n-api.service[120945]: Neutron server returns request_ids: ['req-c0681ca9-7d5f-42a4-99e3-208cd1150330'] {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:19:20.149799 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2a067905-17c9-416f-a739-b2fb7d8a3ed4 tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-group-rules/a993bb10-833d-47a5-8762-1a75a1953205" status: 404 len: 199 microversion: 2.1 time: 0.065278 Oct 23 01:19:20.155976 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1219/2395] 10.222.0.42 () {58 vars in 1287 bytes} [Sun Oct 23 01:19:20 2022] DELETE /compute/v2.1/os-security-group-rules/a993bb10-833d-47a5-8762-1a75a1953205 => generated 199 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:19:20.160622 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-81715dad-16f0-424d-911b-4766751871c7 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:20.161555 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-81715dad-16f0-424d-911b-4766751871c7 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: d2d33142-cf85-4a5b-b63f-e3780f8ac0b1] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:20.170255 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-81715dad-16f0-424d-911b-4766751871c7 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:20.170785 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-81715dad-16f0-424d-911b-4766751871c7 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:20.171322 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-81715dad-16f0-424d-911b-4766751871c7 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:20.174950 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-81715dad-16f0-424d-911b-4766751871c7 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:20.174950 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-81715dad-16f0-424d-911b-4766751871c7 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:20.174950 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-81715dad-16f0-424d-911b-4766751871c7 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:20.255478 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b79f991f-6052-49d3-94ed-8d5f72e4054c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:20.264606 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b79f991f-6052-49d3-94ed-8d5f72e4054c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.232608 Oct 23 01:19:20.265187 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1177/2396] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:20 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:20.270352 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7096a926-0c53-44f1-b1e5-b7ea1e1d0b40 tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] Calling method '.version_select at 0x7f5cc62350d0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:20.715202 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-81715dad-16f0-424d-911b-4766751871c7 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:20.724500 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-81715dad-16f0-424d-911b-4766751871c7 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1" status: 200 len: 1505 microversion: 2.1 time: 0.569249 Oct 23 01:19:20.725184 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1220/2397] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:20 2022] GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 => generated 1505 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:20.730203 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-34571e24-2473-4e54-9e60-e0df82bb799f req-d320c352-a379-4c50-a593-1a6bdb5f438a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40104c3d-0e82-449a-a331-c4f6ba80afaf", "name": "network-vif-deleted", "tag": "c2cc7df3-aa5d-4a0e-abe9-5229c05e5354"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:20.740129 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-34571e24-2473-4e54-9e60-e0df82bb799f req-d320c352-a379-4c50-a593-1a6bdb5f438a service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:20.740696 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-34571e24-2473-4e54-9e60-e0df82bb799f req-d320c352-a379-4c50-a593-1a6bdb5f438a service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:20.741203 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-34571e24-2473-4e54-9e60-e0df82bb799f req-d320c352-a379-4c50-a593-1a6bdb5f438a service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:20.753021 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-34571e24-2473-4e54-9e60-e0df82bb799f req-d320c352-a379-4c50-a593-1a6bdb5f438a service nova] Creating event network-vif-deleted:c2cc7df3-aa5d-4a0e-abe9-5229c05e5354 for instance 40104c3d-0e82-449a-a331-c4f6ba80afaf on n-h1-master-1 Oct 23 01:19:20.763540 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-34571e24-2473-4e54-9e60-e0df82bb799f req-d320c352-a379-4c50-a593-1a6bdb5f438a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036408 Oct 23 01:19:20.763830 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1221/2398] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:19:20.772069 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-285e7d64-327a-4f16-b212-6f9d34c453a3 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:20.776966 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-285e7d64-327a-4f16-b212-6f9d34c453a3 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:20.779136 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-285e7d64-327a-4f16-b212-6f9d34c453a3 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:20.779631 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-285e7d64-327a-4f16-b212-6f9d34c453a3 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:20.780070 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-285e7d64-327a-4f16-b212-6f9d34c453a3 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:20.780768 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-285e7d64-327a-4f16-b212-6f9d34c453a3 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:20.781391 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-285e7d64-327a-4f16-b212-6f9d34c453a3 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:20.781841 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-285e7d64-327a-4f16-b212-6f9d34c453a3 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:20.898548 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7096a926-0c53-44f1-b1e5-b7ea1e1d0b40 tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/192b1f9d-233e-42ac-9f3e-6464934d8a1d" status: 202 len: 0 microversion: 2.1 time: 0.631385 Oct 23 01:19:20.902001 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1178/2399] 10.222.0.42 () {58 vars in 1272 bytes} [Sun Oct 23 01:19:20 2022] DELETE /compute/v2.1/os-security-groups/192b1f9d-233e-42ac-9f3e-6464934d8a1d => generated 0 bytes in 636 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:19:20.907965 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-767b0560-3c22-4215-ac5f-016958642c7e tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:20.908754 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-767b0560-3c22-4215-ac5f-016958642c7e tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: 08afe605-c9f1-4d8b-98bc-9253414ebe56] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:20.923469 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-767b0560-3c22-4215-ac5f-016958642c7e tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:20.924073 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-767b0560-3c22-4215-ac5f-016958642c7e tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:20.925153 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-767b0560-3c22-4215-ac5f-016958642c7e tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:20.925929 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-767b0560-3c22-4215-ac5f-016958642c7e tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:20.926559 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-767b0560-3c22-4215-ac5f-016958642c7e tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:20.927387 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-767b0560-3c22-4215-ac5f-016958642c7e tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:20.950378 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-285e7d64-327a-4f16-b212-6f9d34c453a3 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:20.958647 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-285e7d64-327a-4f16-b212-6f9d34c453a3 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.190964 Oct 23 01:19:20.959222 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1222/2400] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:20 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:20.968536 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-75ba8029-d117-428c-99c2-19fb2f96d79d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:20.969315 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-75ba8029-d117-428c-99c2-19fb2f96d79d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 8fb6c2f7-737b-4b87-9f6b-58ba7f12e428] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:20.975857 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-75ba8029-d117-428c-99c2-19fb2f96d79d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:20.976490 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-75ba8029-d117-428c-99c2-19fb2f96d79d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:20.977034 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-75ba8029-d117-428c-99c2-19fb2f96d79d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:20.978009 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-75ba8029-d117-428c-99c2-19fb2f96d79d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:20.978587 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-75ba8029-d117-428c-99c2-19fb2f96d79d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:20.979114 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-75ba8029-d117-428c-99c2-19fb2f96d79d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:21.060382 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-75ba8029-d117-428c-99c2-19fb2f96d79d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:21.068811 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-75ba8029-d117-428c-99c2-19fb2f96d79d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/8fb6c2f7-737b-4b87-9f6b-58ba7f12e428" status: 200 len: 1259 microversion: 2.1 time: 0.104895 Oct 23 01:19:21.069389 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1223/2401] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:20 2022] GET /compute/v2.1/servers/8fb6c2f7-737b-4b87-9f6b-58ba7f12e428 => generated 1259 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:21.073929 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-49939f90-1f4e-43cf-8aa2-fb4918bd96e2 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:21.074508 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-49939f90-1f4e-43cf-8aa2-fb4918bd96e2 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: d2d33142-cf85-4a5b-b63f-e3780f8ac0b1] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:21.081479 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-49939f90-1f4e-43cf-8aa2-fb4918bd96e2 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:21.082100 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-49939f90-1f4e-43cf-8aa2-fb4918bd96e2 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:21.082547 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-49939f90-1f4e-43cf-8aa2-fb4918bd96e2 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:21.083548 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-49939f90-1f4e-43cf-8aa2-fb4918bd96e2 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:21.083699 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-49939f90-1f4e-43cf-8aa2-fb4918bd96e2 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:21.084123 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-49939f90-1f4e-43cf-8aa2-fb4918bd96e2 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:21.097878 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-767b0560-3c22-4215-ac5f-016958642c7e tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:21.105657 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-767b0560-3c22-4215-ac5f-016958642c7e tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56" status: 200 len: 1313 microversion: 2.1 time: 0.202467 Oct 23 01:19:21.106251 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1179/2402] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:20 2022] GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56 => generated 1313 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:21.110874 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2efc53ae-bd91-41c3-85a4-394b35b5b079 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:21.111480 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2efc53ae-bd91-41c3-85a4-394b35b5b079 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] [instance: 2dc8d790-1306-4a6d-b14d-6c3c1639770c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:21.117139 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2efc53ae-bd91-41c3-85a4-394b35b5b079 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:21.117778 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2efc53ae-bd91-41c3-85a4-394b35b5b079 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:21.118333 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2efc53ae-bd91-41c3-85a4-394b35b5b079 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:21.119159 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2efc53ae-bd91-41c3-85a4-394b35b5b079 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:21.119615 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2efc53ae-bd91-41c3-85a4-394b35b5b079 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:21.120041 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2efc53ae-bd91-41c3-85a4-394b35b5b079 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:21.138542 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:19:21.273501 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-49939f90-1f4e-43cf-8aa2-fb4918bd96e2 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:21.282324 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-49939f90-1f4e-43cf-8aa2-fb4918bd96e2 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1" status: 200 len: 1505 microversion: 2.1 time: 0.211760 Oct 23 01:19:21.283027 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1224/2403] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:21 2022] GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 => generated 1505 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:21.288112 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f7394cbe-9b0a-4203-a60d-182742d5840c tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] Calling method '.version_select at 0x7f5cc62de790>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:21.297066 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2efc53ae-bd91-41c3-85a4-394b35b5b079 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8417cd8a252c4d3c9f2059c42bc82aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdabdb037d54103a656623e2c4c4a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:21.307000 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2efc53ae-bd91-41c3-85a4-394b35b5b079 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] 10.222.0.42 "GET /compute/v2.1/servers/2dc8d790-1306-4a6d-b14d-6c3c1639770c" status: 200 len: 1471 microversion: 2.1 time: 0.199574 Oct 23 01:19:21.312448 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1180/2404] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:21 2022] GET /compute/v2.1/servers/2dc8d790-1306-4a6d-b14d-6c3c1639770c => generated 1471 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:21.312589 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a2b940d8-58c9-4c91-b8c6-3fbd9429c439 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:21.314094 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a2b940d8-58c9-4c91-b8c6-3fbd9429c439 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:21.320466 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a2b940d8-58c9-4c91-b8c6-3fbd9429c439 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:21.321530 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a2b940d8-58c9-4c91-b8c6-3fbd9429c439 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:21.322206 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a2b940d8-58c9-4c91-b8c6-3fbd9429c439 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:21.324351 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a2b940d8-58c9-4c91-b8c6-3fbd9429c439 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:21.324974 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a2b940d8-58c9-4c91-b8c6-3fbd9429c439 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:21.325616 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a2b940d8-58c9-4c91-b8c6-3fbd9429c439 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:21.525237 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a2b940d8-58c9-4c91-b8c6-3fbd9429c439 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:21.542893 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a2b940d8-58c9-4c91-b8c6-3fbd9429c439 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:21.544394 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a2b940d8-58c9-4c91-b8c6-3fbd9429c439 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:21.545580 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a2b940d8-58c9-4c91-b8c6-3fbd9429c439 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b" status: 200 len: 1280 microversion: 2.25 time: 0.236884 Oct 23 01:19:21.546163 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1181/2405] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:19:21 2022] GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b => generated 1280 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:19:21.551339 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b34a93bc-3992-4534-9562-f6b6b0f12255 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1700937453", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:21.556816 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-b34a93bc-3992-4534-9562-f6b6b0f12255 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b34a93bc-3992-4534-9562-f6b6b0f12255 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Request method failure captured: Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 216 Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJZEAurAeILsYJek3MCv_ryiTbidOLVZq6W4I7jJxeY_1_bTWRye2xM3EDOhowd_NyioevvIvzT9beBCgKqri_ZjLw9hdsIISMXmajO_VmobATT_GwpY_Y-GVylQtV9MoF1-Bup_Ahjld_2riQHnDzqLUWULm2acZYcK9UIbslVsdDU Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}] Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: cd6a6c5240f94ace91e1f0ed3e53fa7c Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1700937453", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1700937453', 'imageRef': '446b40bc-db5b-4123-9278-997bd6d04a0d', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:21.558445 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:21.562553 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:21.562553 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:21.562553 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:21.562553 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:19:21.562553 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:19:21.562553 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 23 01:19:21.562553 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:21.562553 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b34a93bc-3992-4534-9562-f6b6b0f12255 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:19:21.562553 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b34a93bc-3992-4534-9562-f6b6b0f12255 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.012708 Oct 23 01:19:21.562553 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1182/2406] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:19:21 2022] POST /compute/v2.1/servers => generated 123 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:19:21.565926 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-696c0234-4cbb-4b89-aa8c-b59533f3954c tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:21.566582 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-696c0234-4cbb-4b89-aa8c-b59533f3954c tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: bc304d93-5c47-4830-af2c-bca071542590] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:21.574004 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-696c0234-4cbb-4b89-aa8c-b59533f3954c tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:21.574544 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-696c0234-4cbb-4b89-aa8c-b59533f3954c tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:21.574946 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-696c0234-4cbb-4b89-aa8c-b59533f3954c tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:21.575659 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-696c0234-4cbb-4b89-aa8c-b59533f3954c tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:21.576119 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-696c0234-4cbb-4b89-aa8c-b59533f3954c tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:21.576542 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-696c0234-4cbb-4b89-aa8c-b59533f3954c tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:21.589693 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-696c0234-4cbb-4b89-aa8c-b59533f3954c tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] HTTP exception thrown: Instance bc304d93-5c47-4830-af2c-bca071542590 could not be found. Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-696c0234-4cbb-4b89-aa8c-b59533f3954c tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Request method failure captured: Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590 HTTP/1.1 Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJSlUKnwUUKDqVJ5SU0WlCbPMoTauyFJSJPCNWG4h-zCSHoo3KNkNO-CFy9_VuCymiA8kUSdGjR2yGG7onVmef7qXNWa7ROigyW7eGZs7ikwf4EUyMcuHo1C1lWtM2HnrUtFga6W0hGpij0W06vuDpo6qY-r0hwnHSvBgTzaVac7oHg Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: d46a7166e4144f55a102ea6335c5f820 Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-LiveMigrationTest-627897414 Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d46a7166e4144f55a102ea6335c5f820"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d46a7166e4144f55a102ea6335c5f820"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d46a7166e4144f55a102ea6335c5f820"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d46a7166e4144f55a102ea6335c5f820"}]}] Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-LiveMigrationTest-627897414 Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: d46a7166e4144f55a102ea6335c5f820 Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-LiveMigrationTest-627897414 Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-LiveMigrationTest-627897414-project Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 1c2310cbc3574eb29a6ca6291ba7808e Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-LiveMigrationTest-627897414-project Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: exception: Instance bc304d93-5c47-4830-af2c-bca071542590 could not be found. Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'bc304d93-5c47-4830-af2c-bca071542590'} Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc304d93-5c47-4830-af2c-bca071542590 could not be found. Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc304d93-5c47-4830-af2c-bca071542590 could not be found. Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:21.591267 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:21.595421 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:21.595421 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:21.595421 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:21.595421 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:19:21.595421 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:19:21.595421 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc304d93-5c47-4830-af2c-bca071542590 could not be found. Oct 23 01:19:21.595421 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:21.595421 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-696c0234-4cbb-4b89-aa8c-b59533f3954c tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Returning 404 to user: Instance bc304d93-5c47-4830-af2c-bca071542590 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:19:21.595421 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-696c0234-4cbb-4b89-aa8c-b59533f3954c tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590" status: 404 len: 111 microversion: 2.1 time: 0.031402 Oct 23 01:19:21.595421 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1183/2407] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:21 2022] GET /compute/v2.1/servers/bc304d93-5c47-4830-af2c-bca071542590 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:19:21.597647 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9a226988-56d4-42b0-8f48-fa1679ed9a32 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:21.598186 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9a226988-56d4-42b0-8f48-fa1679ed9a32 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: d2d33142-cf85-4a5b-b63f-e3780f8ac0b1] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:21.603770 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9a226988-56d4-42b0-8f48-fa1679ed9a32 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:21.604251 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9a226988-56d4-42b0-8f48-fa1679ed9a32 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:21.604684 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9a226988-56d4-42b0-8f48-fa1679ed9a32 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:21.605357 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9a226988-56d4-42b0-8f48-fa1679ed9a32 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:21.605816 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9a226988-56d4-42b0-8f48-fa1679ed9a32 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:21.606279 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9a226988-56d4-42b0-8f48-fa1679ed9a32 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:21.634451 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9a226988-56d4-42b0-8f48-fa1679ed9a32 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: d2d33142-cf85-4a5b-b63f-e3780f8ac0b1] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:19:21.669311 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f7394cbe-9b0a-4203-a60d-182742d5840c tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/6758bad0-ce53-4213-a882-cd8170ed6db9" status: 202 len: 0 microversion: 2.1 time: 0.384761 Oct 23 01:19:21.670115 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1225/2408] 10.222.0.42 () {58 vars in 1272 bytes} [Sun Oct 23 01:19:21 2022] DELETE /compute/v2.1/os-security-groups/6758bad0-ce53-4213-a882-cd8170ed6db9 => generated 0 bytes in 386 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:19:21.675953 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f6c15cb3-ce98-437c-994a-9d0748ceb0e2 tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:21.677435 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f6c15cb3-ce98-437c-994a-9d0748ceb0e2 tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] [instance: 2dc8d790-1306-4a6d-b14d-6c3c1639770c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:21.683637 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f6c15cb3-ce98-437c-994a-9d0748ceb0e2 tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:21.683979 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f6c15cb3-ce98-437c-994a-9d0748ceb0e2 tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:21.684480 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f6c15cb3-ce98-437c-994a-9d0748ceb0e2 tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:21.685184 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f6c15cb3-ce98-437c-994a-9d0748ceb0e2 tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:21.685638 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f6c15cb3-ce98-437c-994a-9d0748ceb0e2 tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:21.686094 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f6c15cb3-ce98-437c-994a-9d0748ceb0e2 tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:21.709647 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-f6c15cb3-ce98-437c-994a-9d0748ceb0e2 tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] Lazy-loading 'flavor' on Instance uuid 2dc8d790-1306-4a6d-b14d-6c3c1639770c {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:19:21.932985 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9a226988-56d4-42b0-8f48-fa1679ed9a32 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1" status: 204 len: 0 microversion: 2.1 time: 0.338379 Oct 23 01:19:21.933653 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1184/2409] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:19:21 2022] DELETE /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:19:21.944009 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f6c15cb3-ce98-437c-994a-9d0748ceb0e2 tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/2dc8d790-1306-4a6d-b14d-6c3c1639770c/action" status: 202 len: 0 microversion: 2.1 time: 0.264933 Oct 23 01:19:21.944222 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e0430142-de9c-4d07-ab3f-5d6d7b9c1331 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:21.944336 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1226/2410] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:19:21 2022] POST /compute/v2.1/servers/2dc8d790-1306-4a6d-b14d-6c3c1639770c/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:19:21.944412 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e0430142-de9c-4d07-ab3f-5d6d7b9c1331 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:21.945583 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6394f156-418e-4dc0-aad3-b049948a1a7c tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:21.946329 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6394f156-418e-4dc0-aad3-b049948a1a7c tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 26043446-8442-4d38-98d8-6ff9a1432d1b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:21.947338 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0430142-de9c-4d07-ab3f-5d6d7b9c1331 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:21.948046 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0430142-de9c-4d07-ab3f-5d6d7b9c1331 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:21.948276 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0430142-de9c-4d07-ab3f-5d6d7b9c1331 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:21.949516 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0430142-de9c-4d07-ab3f-5d6d7b9c1331 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:21.949631 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0430142-de9c-4d07-ab3f-5d6d7b9c1331 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:21.950071 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0430142-de9c-4d07-ab3f-5d6d7b9c1331 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:21.953923 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6394f156-418e-4dc0-aad3-b049948a1a7c tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:21.955102 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6394f156-418e-4dc0-aad3-b049948a1a7c tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:21.955918 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6394f156-418e-4dc0-aad3-b049948a1a7c tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:21.956841 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6394f156-418e-4dc0-aad3-b049948a1a7c tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:21.957316 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6394f156-418e-4dc0-aad3-b049948a1a7c tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:21.957746 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6394f156-418e-4dc0-aad3-b049948a1a7c tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:21.989599 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6394f156-418e-4dc0-aad3-b049948a1a7c tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 26043446-8442-4d38-98d8-6ff9a1432d1b] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:19:22.142694 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e0430142-de9c-4d07-ab3f-5d6d7b9c1331 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:22.150897 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e0430142-de9c-4d07-ab3f-5d6d7b9c1331 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.215984 Oct 23 01:19:22.151481 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1185/2411] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:21 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:22.156138 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1170bb1a-ace2-478a-808b-b62a78e5a951 tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] Calling method '.version_select at 0x7f5cc61c0790>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:22.321771 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6394f156-418e-4dc0-aad3-b049948a1a7c tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "DELETE /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b" status: 204 len: 0 microversion: 2.1 time: 0.379973 Oct 23 01:19:22.322486 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1227/2412] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:19:21 2022] DELETE /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:19:22.329277 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3746119e-b48b-4431-8b42-ac1f1774315b tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:22.330111 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3746119e-b48b-4431-8b42-ac1f1774315b tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] [instance: 2dc8d790-1306-4a6d-b14d-6c3c1639770c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:22.335928 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3746119e-b48b-4431-8b42-ac1f1774315b tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:22.336447 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3746119e-b48b-4431-8b42-ac1f1774315b tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:22.336872 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3746119e-b48b-4431-8b42-ac1f1774315b tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:22.337550 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3746119e-b48b-4431-8b42-ac1f1774315b tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:22.338025 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3746119e-b48b-4431-8b42-ac1f1774315b tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:22.338617 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3746119e-b48b-4431-8b42-ac1f1774315b tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:22.354398 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:19:22.466922 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1170bb1a-ace2-478a-808b-b62a78e5a951 tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/ccb435d6-bfd0-49ff-ab90-021cab0706bb" status: 202 len: 0 microversion: 2.1 time: 0.314206 Oct 23 01:19:22.467934 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1186/2413] 10.222.0.42 () {58 vars in 1272 bytes} [Sun Oct 23 01:19:22 2022] DELETE /compute/v2.1/os-security-groups/ccb435d6-bfd0-49ff-ab90-021cab0706bb => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:19:22.473533 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-53e88bc8-c68d-4d42-b0ec-3c54b416b12e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:22.474316 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-53e88bc8-c68d-4d42-b0ec-3c54b416b12e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 8fb6c2f7-737b-4b87-9f6b-58ba7f12e428] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:22.490115 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-53e88bc8-c68d-4d42-b0ec-3c54b416b12e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:22.490616 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-53e88bc8-c68d-4d42-b0ec-3c54b416b12e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:22.491059 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-53e88bc8-c68d-4d42-b0ec-3c54b416b12e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:22.491793 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-53e88bc8-c68d-4d42-b0ec-3c54b416b12e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:22.492248 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-53e88bc8-c68d-4d42-b0ec-3c54b416b12e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:22.493020 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-53e88bc8-c68d-4d42-b0ec-3c54b416b12e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:22.574313 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-53e88bc8-c68d-4d42-b0ec-3c54b416b12e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:22.582924 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-53e88bc8-c68d-4d42-b0ec-3c54b416b12e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/8fb6c2f7-737b-4b87-9f6b-58ba7f12e428" status: 200 len: 1277 microversion: 2.1 time: 0.113713 Oct 23 01:19:22.583505 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1187/2414] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:22 2022] GET /compute/v2.1/servers/8fb6c2f7-737b-4b87-9f6b-58ba7f12e428 => generated 1277 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:22.588105 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-017a4125-0cd2-44b9-8851-44c516690645 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-438571730", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "37cf4372-0b8e-493b-a1d7-4174c029ddaa"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:22.641769 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-017a4125-0cd2-44b9-8851-44c516690645 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] validate_networks() for [('37cf4372-0b8e-493b-a1d7-4174c029ddaa', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:19:22.775748 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3746119e-b48b-4431-8b42-ac1f1774315b tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/2dc8d790-1306-4a6d-b14d-6c3c1639770c" status: 200 len: 1630 microversion: 2.1 time: 0.451594 Oct 23 01:19:22.776330 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1228/2415] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:22 2022] GET /compute/v2.1/servers/2dc8d790-1306-4a6d-b14d-6c3c1639770c => generated 1630 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:22.781287 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-21baa2ab-6e46-4dee-91cc-a4ab74000d7b tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:22.782230 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-21baa2ab-6e46-4dee-91cc-a4ab74000d7b tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: 08afe605-c9f1-4d8b-98bc-9253414ebe56] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:22.788529 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-21baa2ab-6e46-4dee-91cc-a4ab74000d7b tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:22.789231 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-21baa2ab-6e46-4dee-91cc-a4ab74000d7b tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:22.789663 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-21baa2ab-6e46-4dee-91cc-a4ab74000d7b tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:22.790544 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-21baa2ab-6e46-4dee-91cc-a4ab74000d7b tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:22.791151 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-21baa2ab-6e46-4dee-91cc-a4ab74000d7b tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:22.791918 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-21baa2ab-6e46-4dee-91cc-a4ab74000d7b tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:23.020107 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-21baa2ab-6e46-4dee-91cc-a4ab74000d7b tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:23.028836 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-21baa2ab-6e46-4dee-91cc-a4ab74000d7b tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56" status: 200 len: 1500 microversion: 2.1 time: 0.251244 Oct 23 01:19:23.029408 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1229/2416] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:22 2022] GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56 => generated 1500 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:23.034763 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-565b8b07-6353-45ef-a845-3c0f318c50c0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:23.035375 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-565b8b07-6353-45ef-a845-3c0f318c50c0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:23.041513 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-565b8b07-6353-45ef-a845-3c0f318c50c0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:23.042043 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-565b8b07-6353-45ef-a845-3c0f318c50c0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:23.042494 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-565b8b07-6353-45ef-a845-3c0f318c50c0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:23.043197 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-565b8b07-6353-45ef-a845-3c0f318c50c0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:23.043815 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-565b8b07-6353-45ef-a845-3c0f318c50c0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:23.044442 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-565b8b07-6353-45ef-a845-3c0f318c50c0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:23.211845 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-017a4125-0cd2-44b9-8851-44c516690645 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:19:23.212322 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-017a4125-0cd2-44b9-8851-44c516690645 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:19:23.213005 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-017a4125-0cd2-44b9-8851-44c516690645 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:19:23.213143 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-017a4125-0cd2-44b9-8851-44c516690645 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:19:23.213532 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-017a4125-0cd2-44b9-8851-44c516690645 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:19:23.224320 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-017a4125-0cd2-44b9-8851-44c516690645 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:23.224909 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-017a4125-0cd2-44b9-8851-44c516690645 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:23.225399 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-017a4125-0cd2-44b9-8851-44c516690645 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:23.226115 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-017a4125-0cd2-44b9-8851-44c516690645 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:23.226704 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-017a4125-0cd2-44b9-8851-44c516690645 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:23.227329 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-017a4125-0cd2-44b9-8851-44c516690645 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:23.234695 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-565b8b07-6353-45ef-a845-3c0f318c50c0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:23.243543 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-565b8b07-6353-45ef-a845-3c0f318c50c0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.212543 Oct 23 01:19:23.244595 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1230/2417] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:23 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:23.249183 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f3a55d98-ec66-4989-bb23-756d85b87f58 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:23.249781 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f3a55d98-ec66-4989-bb23-756d85b87f58 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 26043446-8442-4d38-98d8-6ff9a1432d1b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:23.254492 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-017a4125-0cd2-44b9-8851-44c516690645 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Getting quotas for project a0556c0544d446a2aa3d54e00b16bab1. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:19:23.258980 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f3a55d98-ec66-4989-bb23-756d85b87f58 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:23.259454 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f3a55d98-ec66-4989-bb23-756d85b87f58 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:23.265617 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f3a55d98-ec66-4989-bb23-756d85b87f58 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:23.265748 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-017a4125-0cd2-44b9-8851-44c516690645 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Getting quotas for user 18ea2d1dfc7441d2a2bb7b22c6065605 and project a0556c0544d446a2aa3d54e00b16bab1. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:19:23.265837 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f3a55d98-ec66-4989-bb23-756d85b87f58 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:23.265837 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f3a55d98-ec66-4989-bb23-756d85b87f58 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:23.265837 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f3a55d98-ec66-4989-bb23-756d85b87f58 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:23.273951 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-017a4125-0cd2-44b9-8851-44c516690645 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:19:23.276446 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-017a4125-0cd2-44b9-8851-44c516690645 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 6ccfe45d-f080-4066-9aad-a39c3c4cd097] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:19:23.421676 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f3a55d98-ec66-4989-bb23-756d85b87f58 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:23.425071 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-017a4125-0cd2-44b9-8851-44c516690645 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.840522 Oct 23 01:19:23.425922 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1188/2418] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:19:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 842 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:19:23.430960 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9c790c84-d178-460f-9990-c20487ce8061 tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] Calling method '.version_select at 0x7f5cc6235d30>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:23.468265 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f3a55d98-ec66-4989-bb23-756d85b87f58 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b" status: 200 len: 1500 microversion: 2.1 time: 0.205444 Oct 23 01:19:23.470121 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1231/2419] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:23 2022] GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b => generated 1500 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:23.484554 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8692c046-91a3-4952-9f62-d3374d686d2e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:23.486173 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8692c046-91a3-4952-9f62-d3374d686d2e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:23.494074 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8692c046-91a3-4952-9f62-d3374d686d2e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:23.495142 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8692c046-91a3-4952-9f62-d3374d686d2e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:23.496099 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8692c046-91a3-4952-9f62-d3374d686d2e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:23.496842 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8692c046-91a3-4952-9f62-d3374d686d2e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:23.498166 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8692c046-91a3-4952-9f62-d3374d686d2e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:23.498758 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8692c046-91a3-4952-9f62-d3374d686d2e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:23.702012 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8692c046-91a3-4952-9f62-d3374d686d2e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:23.713370 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8692c046-91a3-4952-9f62-d3374d686d2e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:23.716609 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8692c046-91a3-4952-9f62-d3374d686d2e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:23.718326 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8692c046-91a3-4952-9f62-d3374d686d2e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b" status: 200 len: 1280 microversion: 2.25 time: 0.246842 Oct 23 01:19:23.739991 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1232/2420] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:19:23 2022] GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b => generated 1280 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:19:23.750182 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-dbfad123-dbc4-4b83-bef6-e2a9a67258dd tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:23.752795 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-dbfad123-dbc4-4b83-bef6-e2a9a67258dd tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: 08afe605-c9f1-4d8b-98bc-9253414ebe56] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:23.759557 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dbfad123-dbc4-4b83-bef6-e2a9a67258dd tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:23.760307 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dbfad123-dbc4-4b83-bef6-e2a9a67258dd tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:23.760820 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dbfad123-dbc4-4b83-bef6-e2a9a67258dd tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:23.761625 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dbfad123-dbc4-4b83-bef6-e2a9a67258dd tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:23.762218 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dbfad123-dbc4-4b83-bef6-e2a9a67258dd tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:23.762708 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dbfad123-dbc4-4b83-bef6-e2a9a67258dd tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:23.790813 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-dbfad123-dbc4-4b83-bef6-e2a9a67258dd tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lazy-loading 'flavor' on Instance uuid 08afe605-c9f1-4d8b-98bc-9253414ebe56 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:19:23.812671 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9c790c84-d178-460f-9990-c20487ce8061 tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/ca90d93a-de6d-4084-928c-78adf7167025" status: 202 len: 0 microversion: 2.1 time: 0.385232 Oct 23 01:19:23.817887 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1189/2421] 10.222.0.42 () {58 vars in 1272 bytes} [Sun Oct 23 01:19:23 2022] DELETE /compute/v2.1/os-security-groups/ca90d93a-de6d-4084-928c-78adf7167025 => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:19:23.830286 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d219a13a-71c7-489b-ae6b-c790ea2e3b17 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1588991204", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "key_name": "tempest-key-195746574", "networks": [{"uuid": "06f4c921-9d2b-4ef6-806f-b77fdc508baa"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:23.899157 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-d219a13a-71c7-489b-ae6b-c790ea2e3b17 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] validate_networks() for [('06f4c921-9d2b-4ef6-806f-b77fdc508baa', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:19:24.118312 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-d219a13a-71c7-489b-ae6b-c790ea2e3b17 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] HTTP exception thrown: Invalid key_name provided. Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d219a13a-71c7-489b-ae6b-c790ea2e3b17 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Request method failure captured: Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 246 Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJZEAurAeILsYJek3MCv_ryiTbidOLVZq6W4I7jJxeY_1_bTWRye2xM3EDOhowd_NyioevvIvzT9beBCgKqri_ZjLw9hdsIISMXmajO_VmobATT_GwpY_Y-GVylQtV9MoF1-Bup_Ahjld_2riQHnDzqLUWULm2acZYcK9UIbslVsdDU Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}] Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: cd6a6c5240f94ace91e1f0ed3e53fa7c Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1588991204", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "key_name": "tempest-key-195746574", "networks": [{"uuid": "06f4c921-9d2b-4ef6-806f-b77fdc508baa"}]}} Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: exception: Invalid key_name provided. Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1588991204', 'imageRef': '446b40bc-db5b-4123-9278-997bd6d04a0d', 'flavorRef': '452', 'key_name': 'tempest-key-195746574', 'networks': [{'uuid': '06f4c921-9d2b-4ef6-806f-b77fdc508baa'}]}}} Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-195746574 not found for user cd6a6c5240f94ace91e1f0ed3e53fa7c Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:24.120308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:24.128505 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:24.128505 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:19:24.128505 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:19:24.128505 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:19:24.128505 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:19:24.128505 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:19:24.128505 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:19:24.128505 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:19:24.128505 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:19:24.128505 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:19:24.128505 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:19:24.128505 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 23 01:19:24.128505 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 23 01:19:24.128505 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 23 01:19:24.128505 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 23 01:19:24.128505 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:24.128505 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:24.128505 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:24.128505 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:24.128505 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:24.128505 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:24.128505 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:19:24.128505 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:19:24.128505 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 23 01:19:24.128505 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:24.128505 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d219a13a-71c7-489b-ae6b-c790ea2e3b17 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Returning 400 to user: Invalid key_name provided. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:19:24.128505 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d219a13a-71c7-489b-ae6b-c790ea2e3b17 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.302137 Oct 23 01:19:24.128505 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1190/2422] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:19:23 2022] POST /compute/v2.1/servers => generated 70 bytes in 304 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 23 01:19:24.128505 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c5279e8c-a0bd-4545-ad4c-0fdb45ee91f2 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:24.128505 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c5279e8c-a0bd-4545-ad4c-0fdb45ee91f2 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 6ccfe45d-f080-4066-9aad-a39c3c4cd097] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:24.132667 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-dbfad123-dbc4-4b83-bef6-e2a9a67258dd tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "POST /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56/action" status: 200 len: 32 microversion: 2.1 time: 0.388329 Oct 23 01:19:24.133459 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1233/2423] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:19:23 2022] POST /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56/action => generated 32 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:19:24.142750 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1a4378ca-50c6-4003-ac87-694269a9df55 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:24.143693 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1a4378ca-50c6-4003-ac87-694269a9df55 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 8fb6c2f7-737b-4b87-9f6b-58ba7f12e428] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:24.152570 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1a4378ca-50c6-4003-ac87-694269a9df55 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:24.155245 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1a4378ca-50c6-4003-ac87-694269a9df55 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:24.155245 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1a4378ca-50c6-4003-ac87-694269a9df55 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:24.155245 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1a4378ca-50c6-4003-ac87-694269a9df55 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:24.155245 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1a4378ca-50c6-4003-ac87-694269a9df55 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:24.155552 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1a4378ca-50c6-4003-ac87-694269a9df55 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:24.250245 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c5279e8c-a0bd-4545-ad4c-0fdb45ee91f2 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:24.263132 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c5279e8c-a0bd-4545-ad4c-0fdb45ee91f2 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097" status: 200 len: 1217 microversion: 2.1 time: 0.139773 Oct 23 01:19:24.264727 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1191/2424] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:24 2022] GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097 => generated 1217 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:24.271966 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cca1da7f-a1af-4fdc-8881-2970f98f8890 tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:24.272982 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-cca1da7f-a1af-4fdc-8881-2970f98f8890 tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] [instance: 2dc8d790-1306-4a6d-b14d-6c3c1639770c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:24.293309 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cca1da7f-a1af-4fdc-8881-2970f98f8890 tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:24.294088 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cca1da7f-a1af-4fdc-8881-2970f98f8890 tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:24.294698 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cca1da7f-a1af-4fdc-8881-2970f98f8890 tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:24.295554 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cca1da7f-a1af-4fdc-8881-2970f98f8890 tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:24.296201 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cca1da7f-a1af-4fdc-8881-2970f98f8890 tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:24.296734 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cca1da7f-a1af-4fdc-8881-2970f98f8890 tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:24.538080 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1a4378ca-50c6-4003-ac87-694269a9df55 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:24.548996 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1a4378ca-50c6-4003-ac87-694269a9df55 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/8fb6c2f7-737b-4b87-9f6b-58ba7f12e428" status: 200 len: 1307 microversion: 2.1 time: 0.413899 Oct 23 01:19:24.564806 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1234/2425] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:24 2022] GET /compute/v2.1/servers/8fb6c2f7-737b-4b87-9f6b-58ba7f12e428 => generated 1307 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:24.564806 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f9109dba-cdd6-45fa-9108-d87ee3ca8db9 tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] Calling method '.version_select at 0x7f5cc6186790>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:24.633402 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cca1da7f-a1af-4fdc-8881-2970f98f8890 tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/2dc8d790-1306-4a6d-b14d-6c3c1639770c" status: 200 len: 1613 microversion: 2.1 time: 0.365035 Oct 23 01:19:24.638068 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1192/2426] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:24 2022] GET /compute/v2.1/servers/2dc8d790-1306-4a6d-b14d-6c3c1639770c => generated 1613 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:24.643145 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e77b1612-0175-4a34-9828-ef1b7099bab0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:24.643774 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e77b1612-0175-4a34-9828-ef1b7099bab0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:24.651319 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e77b1612-0175-4a34-9828-ef1b7099bab0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:24.651822 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e77b1612-0175-4a34-9828-ef1b7099bab0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:24.653229 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e77b1612-0175-4a34-9828-ef1b7099bab0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:24.659547 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e77b1612-0175-4a34-9828-ef1b7099bab0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:24.659547 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e77b1612-0175-4a34-9828-ef1b7099bab0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:24.659547 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e77b1612-0175-4a34-9828-ef1b7099bab0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:24.936204 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e77b1612-0175-4a34-9828-ef1b7099bab0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:24.947218 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e77b1612-0175-4a34-9828-ef1b7099bab0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.311822 Oct 23 01:19:24.948680 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1193/2427] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:24 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:24.971423 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6be0b99e-6506-4044-85ec-121d5e661050 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:24.974157 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6be0b99e-6506-4044-85ec-121d5e661050 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: 08afe605-c9f1-4d8b-98bc-9253414ebe56] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:24.981926 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6be0b99e-6506-4044-85ec-121d5e661050 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:24.983258 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6be0b99e-6506-4044-85ec-121d5e661050 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:24.984009 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6be0b99e-6506-4044-85ec-121d5e661050 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:24.986853 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6be0b99e-6506-4044-85ec-121d5e661050 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:24.986853 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6be0b99e-6506-4044-85ec-121d5e661050 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:24.987530 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6be0b99e-6506-4044-85ec-121d5e661050 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:25.238772 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f9109dba-cdd6-45fa-9108-d87ee3ca8db9 tempest-SecurityGroupRulesNegativeTestJSON-93380100 tempest-SecurityGroupRulesNegativeTestJSON-93380100-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/6cb19689-904c-43f2-86b0-0f6c8cf111f0" status: 202 len: 0 microversion: 2.1 time: 0.687597 Oct 23 01:19:25.240858 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1235/2428] 10.222.0.42 () {58 vars in 1272 bytes} [Sun Oct 23 01:19:24 2022] DELETE /compute/v2.1/os-security-groups/6cb19689-904c-43f2-86b0-0f6c8cf111f0 => generated 0 bytes in 690 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:19:25.246677 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-be50acff-9373-4a00-a755-71378f1435cb tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:25.247554 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-be50acff-9373-4a00-a755-71378f1435cb tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 26043446-8442-4d38-98d8-6ff9a1432d1b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:25.257857 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-be50acff-9373-4a00-a755-71378f1435cb tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:25.258383 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-be50acff-9373-4a00-a755-71378f1435cb tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:25.258991 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-be50acff-9373-4a00-a755-71378f1435cb tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:25.260076 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-be50acff-9373-4a00-a755-71378f1435cb tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:25.260525 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-be50acff-9373-4a00-a755-71378f1435cb tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:25.261119 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-be50acff-9373-4a00-a755-71378f1435cb tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:25.276852 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6be0b99e-6506-4044-85ec-121d5e661050 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:25.291606 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6be0b99e-6506-4044-85ec-121d5e661050 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56" status: 200 len: 1506 microversion: 2.1 time: 0.341286 Oct 23 01:19:25.292832 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1194/2429] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:24 2022] GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56 => generated 1506 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:25.299325 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f366b588-04d9-473a-9dd5-e40326bcfcb4 tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:25.300155 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f366b588-04d9-473a-9dd5-e40326bcfcb4 tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] [instance: 2dc8d790-1306-4a6d-b14d-6c3c1639770c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:25.315832 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f366b588-04d9-473a-9dd5-e40326bcfcb4 tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:25.316564 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f366b588-04d9-473a-9dd5-e40326bcfcb4 tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:25.318936 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f366b588-04d9-473a-9dd5-e40326bcfcb4 tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:25.319322 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f366b588-04d9-473a-9dd5-e40326bcfcb4 tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:25.319902 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f366b588-04d9-473a-9dd5-e40326bcfcb4 tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:25.320342 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f366b588-04d9-473a-9dd5-e40326bcfcb4 tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:25.389207 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-f366b588-04d9-473a-9dd5-e40326bcfcb4 tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] HTTP exception thrown: Cannot 'migrate' instance 2dc8d790-1306-4a6d-b14d-6c3c1639770c while it is in vm_state suspended Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f366b588-04d9-473a-9dd5-e40326bcfcb4 tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] Request method failure captured: Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/servers/2dc8d790-1306-4a6d-b14d-6c3c1639770c/action HTTP/1.1 Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 15 Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJZo-MVusHe_JL7N5naiBnsLSxL2-gw3DhycBckt9c95xzA9l8CPMwkSlbDocXbv66cjXeV_VDC6sjcnFLxhblM5TRtHo6MK2QRE6PbdQUa1aZtGmVzwFBOP0CFZhDEHJ8VjHvj3GmI4Iie5_uvuGFqTUjMl8OYduRWQrdZDidzZ3Us Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 154b9d85a646422ea4978904144a7aff Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-842589533 Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,admin,reader Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,admin,reader Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/154b9d85a646422ea4978904144a7aff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_154b9d85a646422ea4978904144a7aff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/154b9d85a646422ea4978904144a7aff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/154b9d85a646422ea4978904144a7aff"}]}] Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersAdminNegativeTestJSON-842589533 Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 154b9d85a646422ea4978904144a7aff Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-842589533 Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersAdminNegativeTestJSON-842589533-project-admin Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 1055f18673474d189a5605319bc301da Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersAdminNegativeTestJSON-842589533-project-admin Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: {"migrate": {}} Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: exception: Cannot 'migrate' instance 2dc8d790-1306-4a6d-b14d-6c3c1639770c while it is in vm_state suspended Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '2dc8d790-1306-4a6d-b14d-6c3c1639770c', 'body': {'migrate': {}}} Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2dc8d790-1306-4a6d-b14d-6c3c1639770c in vm_state suspended. Cannot resize while the instance is in this state. Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:19:25.391557 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 23 01:19:25.395804 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 23 01:19:25.395804 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 23 01:19:25.395804 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 23 01:19:25.395804 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 2dc8d790-1306-4a6d-b14d-6c3c1639770c while it is in vm_state suspended Oct 23 01:19:25.395804 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:25.395804 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:25.395804 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:25.395804 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:25.395804 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:25.395804 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:25.395804 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:19:25.395804 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:19:25.395804 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 2dc8d790-1306-4a6d-b14d-6c3c1639770c while it is in vm_state suspended Oct 23 01:19:25.395804 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:25.401487 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f366b588-04d9-473a-9dd5-e40326bcfcb4 tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] Returning 409 to user: Cannot 'migrate' instance 2dc8d790-1306-4a6d-b14d-6c3c1639770c while it is in vm_state suspended {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:19:25.402672 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f366b588-04d9-473a-9dd5-e40326bcfcb4 tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/2dc8d790-1306-4a6d-b14d-6c3c1639770c/action" status: 409 len: 148 microversion: 2.1 time: 0.108680 Oct 23 01:19:25.403988 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1195/2430] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:19:25 2022] POST /compute/v2.1/servers/2dc8d790-1306-4a6d-b14d-6c3c1639770c/action => generated 148 bytes in 110 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:19:25.409861 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-be50acff-9373-4a00-a755-71378f1435cb tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:25.420960 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-be50acff-9373-4a00-a755-71378f1435cb tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b" status: 200 len: 1458 microversion: 2.1 time: 0.178606 Oct 23 01:19:25.424990 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7c257103-35b6-4796-8f1b-d39223090361 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:25.435092 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1236/2431] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:25 2022] GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b => generated 1458 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:25.435486 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7c257103-35b6-4796-8f1b-d39223090361 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:25.435562 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-57c6e767-dece-4115-af61-5547052d700d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:25.435562 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-57c6e767-dece-4115-af61-5547052d700d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:25.437361 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c257103-35b6-4796-8f1b-d39223090361 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:25.438688 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c257103-35b6-4796-8f1b-d39223090361 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:25.439289 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c257103-35b6-4796-8f1b-d39223090361 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:25.440250 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c257103-35b6-4796-8f1b-d39223090361 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:25.440840 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c257103-35b6-4796-8f1b-d39223090361 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:25.454364 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c257103-35b6-4796-8f1b-d39223090361 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:25.464598 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-57c6e767-dece-4115-af61-5547052d700d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:25.466974 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-57c6e767-dece-4115-af61-5547052d700d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:25.467705 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-57c6e767-dece-4115-af61-5547052d700d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:25.469443 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-57c6e767-dece-4115-af61-5547052d700d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:25.470621 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-57c6e767-dece-4115-af61-5547052d700d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:25.474969 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-57c6e767-dece-4115-af61-5547052d700d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:25.811840 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7c257103-35b6-4796-8f1b-d39223090361 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:25.825416 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7c257103-35b6-4796-8f1b-d39223090361 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:25.826935 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7c257103-35b6-4796-8f1b-d39223090361 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:25.828084 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7c257103-35b6-4796-8f1b-d39223090361 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b" status: 200 len: 1280 microversion: 2.25 time: 0.414042 Oct 23 01:19:25.828879 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1196/2432] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:19:25 2022] GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b => generated 1280 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:19:25.853342 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-c158014e-1079-47b8-af14-e9074c6363c5 req-d4bc6e6b-5450-4d1a-93a0-96bd7750f0b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b", "name": "network-vif-plugged", "status": "completed", "tag": "5f7a3666-2b64-4e04-b1a0-59950284bbc9"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:25.860989 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-c158014e-1079-47b8-af14-e9074c6363c5 req-d4bc6e6b-5450-4d1a-93a0-96bd7750f0b5 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:25.861490 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-c158014e-1079-47b8-af14-e9074c6363c5 req-d4bc6e6b-5450-4d1a-93a0-96bd7750f0b5 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:25.861936 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-c158014e-1079-47b8-af14-e9074c6363c5 req-d4bc6e6b-5450-4d1a-93a0-96bd7750f0b5 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:25.889070 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-c158014e-1079-47b8-af14-e9074c6363c5 req-d4bc6e6b-5450-4d1a-93a0-96bd7750f0b5 service nova] Creating event network-vif-plugged:5f7a3666-2b64-4e04-b1a0-59950284bbc9 for instance 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b on n-h2-master-1 Oct 23 01:19:25.896938 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-c158014e-1079-47b8-af14-e9074c6363c5 req-d4bc6e6b-5450-4d1a-93a0-96bd7750f0b5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065216 Oct 23 01:19:25.898450 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1197/2433] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:19:25.904974 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-07b81693-1fc9-496f-9275-4d6a16c9b860 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:25.905456 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-07b81693-1fc9-496f-9275-4d6a16c9b860 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 6ccfe45d-f080-4066-9aad-a39c3c4cd097] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:25.919084 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-57c6e767-dece-4115-af61-5547052d700d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:25.925878 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07b81693-1fc9-496f-9275-4d6a16c9b860 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:25.927746 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07b81693-1fc9-496f-9275-4d6a16c9b860 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:25.928261 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07b81693-1fc9-496f-9275-4d6a16c9b860 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:25.928998 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07b81693-1fc9-496f-9275-4d6a16c9b860 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:25.930050 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07b81693-1fc9-496f-9275-4d6a16c9b860 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:25.930050 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07b81693-1fc9-496f-9275-4d6a16c9b860 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:25.939553 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-57c6e767-dece-4115-af61-5547052d700d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.510713 Oct 23 01:19:25.940433 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1237/2434] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:25 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:25.978442 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-649c26a6-beae-4de0-bff3-0a766fd97992 req-e126bb8d-8fb2-4531-aae9-0a72dee3ce21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26043446-8442-4d38-98d8-6ff9a1432d1b", "name": "network-vif-deleted", "tag": "4a1925fc-3024-45ea-be46-b952667a8883"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:26.009177 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-649c26a6-beae-4de0-bff3-0a766fd97992 req-e126bb8d-8fb2-4531-aae9-0a72dee3ce21 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:26.009800 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-649c26a6-beae-4de0-bff3-0a766fd97992 req-e126bb8d-8fb2-4531-aae9-0a72dee3ce21 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:26.010450 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-649c26a6-beae-4de0-bff3-0a766fd97992 req-e126bb8d-8fb2-4531-aae9-0a72dee3ce21 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:26.029668 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-649c26a6-beae-4de0-bff3-0a766fd97992 req-e126bb8d-8fb2-4531-aae9-0a72dee3ce21 service nova] Creating event network-vif-deleted:4a1925fc-3024-45ea-be46-b952667a8883 for instance 26043446-8442-4d38-98d8-6ff9a1432d1b on n-h2-master-1 Oct 23 01:19:26.037436 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-649c26a6-beae-4de0-bff3-0a766fd97992 req-e126bb8d-8fb2-4531-aae9-0a72dee3ce21 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073476 Oct 23 01:19:26.043082 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1238/2435] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:19:26.060159 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e71c5a80-58ad-4a81-a337-7697c1ff198f tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e71c5a80-58ad-4a81-a337-7697c1ff198f tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] Request method failure captured: Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/servers/afd593c3-d69a-4d5d-81b9-15a3138378ae/action HTTP/1.1 Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 39 Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJZo-MVusHe_JL7N5naiBnsLSxL2-gw3DhycBckt9c95xzA9l8CPMwkSlbDocXbv66cjXeV_VDC6sjcnFLxhblM5TRtHo6MK2QRE6PbdQUa1aZtGmVzwFBOP0CFZhDEHJ8VjHvj3GmI4Iie5_uvuGFqTUjMl8OYduRWQrdZDidzZ3Us Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 154b9d85a646422ea4978904144a7aff Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-842589533 Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,admin,reader Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,admin,reader Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/154b9d85a646422ea4978904144a7aff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_154b9d85a646422ea4978904144a7aff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/154b9d85a646422ea4978904144a7aff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/154b9d85a646422ea4978904144a7aff"}]}] Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServersAdminNegativeTestJSON-842589533 Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 154b9d85a646422ea4978904144a7aff Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-842589533 Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServersAdminNegativeTestJSON-842589533-project-admin Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 1055f18673474d189a5605319bc301da Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServersAdminNegativeTestJSON-842589533-project-admin Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: {"os-resetState": {"state": "invalid"}} Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'afd593c3-d69a-4d5d-81b9-15a3138378ae', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise error Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 'invalid' Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 23 01:19:26.068651 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 23 01:19:26.072750 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 23 01:19:26.072750 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:26.072750 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:26.072750 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:26.072750 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:26.072750 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:26.072750 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:26.072750 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 23 01:19:26.072750 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 23 01:19:26.072750 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 23 01:19:26.072750 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:26.074303 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e71c5a80-58ad-4a81-a337-7697c1ff198f tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:19:26.075788 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e71c5a80-58ad-4a81-a337-7697c1ff198f tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/afd593c3-d69a-4d5d-81b9-15a3138378ae/action" status: 400 len: 144 microversion: 2.1 time: 0.026030 Oct 23 01:19:26.077618 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1239/2436] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:19:26 2022] POST /compute/v2.1/servers/afd593c3-d69a-4d5d-81b9-15a3138378ae/action => generated 144 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:19:26.078231 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-07b81693-1fc9-496f-9275-4d6a16c9b860 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:26.087751 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7cd0a24d-28d0-4418-93d6-d943ee84a4df tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:26.088752 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7cd0a24d-28d0-4418-93d6-d943ee84a4df tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 8fb6c2f7-737b-4b87-9f6b-58ba7f12e428] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:26.097272 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-07b81693-1fc9-496f-9275-4d6a16c9b860 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097" status: 200 len: 1269 microversion: 2.1 time: 0.195127 Oct 23 01:19:26.099354 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1198/2437] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:25 2022] GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097 => generated 1269 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:26.105954 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7cd0a24d-28d0-4418-93d6-d943ee84a4df tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:26.105954 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7cd0a24d-28d0-4418-93d6-d943ee84a4df tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:26.105954 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7cd0a24d-28d0-4418-93d6-d943ee84a4df tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:26.105954 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7cd0a24d-28d0-4418-93d6-d943ee84a4df tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:26.106267 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7cd0a24d-28d0-4418-93d6-d943ee84a4df tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:26.106650 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7cd0a24d-28d0-4418-93d6-d943ee84a4df tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:26.113099 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-a857fbd8-cb3d-4292-900e-b8ddbc79e6b3 req-478cf2ab-2bf7-4896-b09c-33785259f2ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2d33142-cf85-4a5b-b63f-e3780f8ac0b1", "name": "network-vif-deleted", "tag": "c671ef64-d392-46ae-a693-c9bcda7c8160"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:26.134111 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-a857fbd8-cb3d-4292-900e-b8ddbc79e6b3 req-478cf2ab-2bf7-4896-b09c-33785259f2ed service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:26.134875 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-a857fbd8-cb3d-4292-900e-b8ddbc79e6b3 req-478cf2ab-2bf7-4896-b09c-33785259f2ed service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:26.135571 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-a857fbd8-cb3d-4292-900e-b8ddbc79e6b3 req-478cf2ab-2bf7-4896-b09c-33785259f2ed service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:26.167480 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-a857fbd8-cb3d-4292-900e-b8ddbc79e6b3 req-478cf2ab-2bf7-4896-b09c-33785259f2ed service nova] Creating event network-vif-deleted:c671ef64-d392-46ae-a693-c9bcda7c8160 for instance d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 on n-h2-master-1 Oct 23 01:19:26.173013 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-a857fbd8-cb3d-4292-900e-b8ddbc79e6b3 req-478cf2ab-2bf7-4896-b09c-33785259f2ed service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071685 Oct 23 01:19:26.173941 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1199/2438] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:19:26.191394 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6351d814-f717-43cd-95bb-0797ad89a4c3 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-438540211", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "06f4c921-9d2b-4ef6-806f-b77fdc508baa"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:26.381482 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.security_group_api [None req-6351d814-f717-43cd-95bb-0797ad89a4c3 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Neutron security group does_not_exist not found {{(pid=120944) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 23 01:19:26.382096 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-6351d814-f717-43cd-95bb-0797ad89a4c3 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6351d814-f717-43cd-95bb-0797ad89a4c3 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Request method failure captured: Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 257 Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJZEAurAeILsYJek3MCv_ryiTbidOLVZq6W4I7jJxeY_1_bTWRye2xM3EDOhowd_NyioevvIvzT9beBCgKqri_ZjLw9hdsIISMXmajO_VmobATT_GwpY_Y-GVylQtV9MoF1-Bup_Ahjld_2riQHnDzqLUWULm2acZYcK9UIbslVsdDU Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}] Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: cd6a6c5240f94ace91e1f0ed3e53fa7c Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-438540211", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "06f4c921-9d2b-4ef6-806f-b77fdc508baa"}]}} Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-438540211', 'imageRef': '446b40bc-db5b-4123-9278-997bd6d04a0d', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '06f4c921-9d2b-4ef6-806f-b77fdc508baa'}]}}} Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 23 01:19:26.395964 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:26.399271 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6351d814-f717-43cd-95bb-0797ad89a4c3 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:19:26.406653 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6351d814-f717-43cd-95bb-0797ad89a4c3 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.215177 Oct 23 01:19:26.406653 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1200/2439] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:19:26 2022] POST /compute/v2.1/servers => generated 106 bytes in 231 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:19:26.415037 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-224e0064-3fb8-431f-a52c-052405a8f005 tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-224e0064-3fb8-431f-a52c-052405a8f005 tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] Request method failure captured: Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/servers/afd593c3-d69a-4d5d-81b9-15a3138378ae/action HTTP/1.1 Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 31 Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJZo-MVusHe_JL7N5naiBnsLSxL2-gw3DhycBckt9c95xzA9l8CPMwkSlbDocXbv66cjXeV_VDC6sjcnFLxhblM5TRtHo6MK2QRE6PbdQUa1aZtGmVzwFBOP0CFZhDEHJ8VjHvj3GmI4Iie5_uvuGFqTUjMl8OYduRWQrdZDidzZ3Us Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 154b9d85a646422ea4978904144a7aff Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-842589533 Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,admin,reader Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,admin,reader Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/154b9d85a646422ea4978904144a7aff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_154b9d85a646422ea4978904144a7aff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/154b9d85a646422ea4978904144a7aff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/154b9d85a646422ea4978904144a7aff"}]}] Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersAdminNegativeTestJSON-842589533 Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 154b9d85a646422ea4978904144a7aff Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-842589533 Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersAdminNegativeTestJSON-842589533-project-admin Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 1055f18673474d189a5605319bc301da Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersAdminNegativeTestJSON-842589533-project-admin Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: {"os-resetState": {"state": 1}} Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'afd593c3-d69a-4d5d-81b9-15a3138378ae', 'body': {'os-resetState': {'state': 1}}} Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise error Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi 1 Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 23 01:19:26.419973 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:26.426628 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:26.426628 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:26.426628 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:26.426628 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:26.426628 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:26.426628 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 23 01:19:26.426628 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 23 01:19:26.426628 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 23 01:19:26.426628 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:26.426628 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-224e0064-3fb8-431f-a52c-052405a8f005 tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:19:26.426628 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-224e0064-3fb8-431f-a52c-052405a8f005 tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/afd593c3-d69a-4d5d-81b9-15a3138378ae/action" status: 400 len: 120 microversion: 2.1 time: 0.017203 Oct 23 01:19:26.427450 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1201/2440] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:19:26 2022] POST /compute/v2.1/servers/afd593c3-d69a-4d5d-81b9-15a3138378ae/action => generated 120 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:19:26.433140 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cd73cc9c-7170-4db7-8d42-3e4d1bc5feab tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:26.433874 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-cd73cc9c-7170-4db7-8d42-3e4d1bc5feab tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: 08afe605-c9f1-4d8b-98bc-9253414ebe56] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:26.437060 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7cd0a24d-28d0-4418-93d6-d943ee84a4df tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:26.445075 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cd73cc9c-7170-4db7-8d42-3e4d1bc5feab tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:26.445582 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cd73cc9c-7170-4db7-8d42-3e4d1bc5feab tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:26.446500 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cd73cc9c-7170-4db7-8d42-3e4d1bc5feab tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:26.447240 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cd73cc9c-7170-4db7-8d42-3e4d1bc5feab tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:26.447550 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7cd0a24d-28d0-4418-93d6-d943ee84a4df tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/8fb6c2f7-737b-4b87-9f6b-58ba7f12e428" status: 200 len: 1307 microversion: 2.1 time: 0.368360 Oct 23 01:19:26.447840 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cd73cc9c-7170-4db7-8d42-3e4d1bc5feab tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:26.448145 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1240/2441] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:26 2022] GET /compute/v2.1/servers/8fb6c2f7-737b-4b87-9f6b-58ba7f12e428 => generated 1307 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:26.448251 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cd73cc9c-7170-4db7-8d42-3e4d1bc5feab tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:26.460184 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-aec633e4-6c14-4bd4-9a9b-10e5fcbd40fd tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:26.460823 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-aec633e4-6c14-4bd4-9a9b-10e5fcbd40fd tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:26.484938 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aec633e4-6c14-4bd4-9a9b-10e5fcbd40fd tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:26.485631 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aec633e4-6c14-4bd4-9a9b-10e5fcbd40fd tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:26.486188 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aec633e4-6c14-4bd4-9a9b-10e5fcbd40fd tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:26.487177 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aec633e4-6c14-4bd4-9a9b-10e5fcbd40fd tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:26.487751 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aec633e4-6c14-4bd4-9a9b-10e5fcbd40fd tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:26.490577 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aec633e4-6c14-4bd4-9a9b-10e5fcbd40fd tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:26.772667 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cd73cc9c-7170-4db7-8d42-3e4d1bc5feab tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:26.780605 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cd73cc9c-7170-4db7-8d42-3e4d1bc5feab tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56" status: 200 len: 1506 microversion: 2.1 time: 0.352233 Oct 23 01:19:26.781177 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1202/2442] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:26 2022] GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56 => generated 1506 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:26.786370 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e96bae76-629b-46fb-bfdd-825882f247cb tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:26.798164 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e96bae76-629b-46fb-bfdd-825882f247cb tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] Failed to fetch instance by id 999 {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 23 01:19:26.798702 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-e96bae76-629b-46fb-bfdd-825882f247cb tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e96bae76-629b-46fb-bfdd-825882f247cb tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] Request method failure captured: Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 37 Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJZo-MVusHe_JL7N5naiBnsLSxL2-gw3DhycBckt9c95xzA9l8CPMwkSlbDocXbv66cjXeV_VDC6sjcnFLxhblM5TRtHo6MK2QRE6PbdQUa1aZtGmVzwFBOP0CFZhDEHJ8VjHvj3GmI4Iie5_uvuGFqTUjMl8OYduRWQrdZDidzZ3Us Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 154b9d85a646422ea4978904144a7aff Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-842589533 Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,admin,reader Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,admin,reader Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/154b9d85a646422ea4978904144a7aff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_154b9d85a646422ea4978904144a7aff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/154b9d85a646422ea4978904144a7aff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/154b9d85a646422ea4978904144a7aff"}]}] Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersAdminNegativeTestJSON-842589533 Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 154b9d85a646422ea4978904144a7aff Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-842589533 Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersAdminNegativeTestJSON-842589533-project-admin Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 1055f18673474d189a5605319bc301da Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersAdminNegativeTestJSON-842589533-project-admin Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: {"os-resetState": {"state": "error"}} Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 999 could not be found. Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:26.805671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:19:26.809291 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:19:26.809291 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 23 01:19:26.809291 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:26.809291 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e96bae76-629b-46fb-bfdd-825882f247cb tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:19:26.809291 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e96bae76-629b-46fb-bfdd-825882f247cb tempest-ServersAdminNegativeTestJSON-842589533 tempest-ServersAdminNegativeTestJSON-842589533-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.024782 Oct 23 01:19:26.812637 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1203/2443] 10.222.0.42 () {60 vars in 1179 bytes} [Sun Oct 23 01:19:26 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:19:26.819698 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c6f2b155-9003-45af-aa62-7358cab8c250 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:26.820402 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c6f2b155-9003-45af-aa62-7358cab8c250 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 26043446-8442-4d38-98d8-6ff9a1432d1b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:26.828270 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c6f2b155-9003-45af-aa62-7358cab8c250 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:26.829352 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c6f2b155-9003-45af-aa62-7358cab8c250 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:26.829859 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c6f2b155-9003-45af-aa62-7358cab8c250 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:26.830659 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c6f2b155-9003-45af-aa62-7358cab8c250 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:26.831206 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c6f2b155-9003-45af-aa62-7358cab8c250 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:26.831703 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c6f2b155-9003-45af-aa62-7358cab8c250 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:26.872459 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c6f2b155-9003-45af-aa62-7358cab8c250 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:26.873324 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c6f2b155-9003-45af-aa62-7358cab8c250 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:26.873770 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c6f2b155-9003-45af-aa62-7358cab8c250 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:26.874353 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-c6f2b155-9003-45af-aa62-7358cab8c250 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lazy-loading 'fault' on Instance uuid 26043446-8442-4d38-98d8-6ff9a1432d1b {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:19:27.115226 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-aec633e4-6c14-4bd4-9a9b-10e5fcbd40fd tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:27.121745 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c6f2b155-9003-45af-aa62-7358cab8c250 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c2310cbc3574eb29a6ca6291ba7808e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46a7166e4144f55a102ea6335c5f820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:27.130676 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-aec633e4-6c14-4bd4-9a9b-10e5fcbd40fd tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.681489 Oct 23 01:19:27.131718 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1241/2444] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:26 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:27.136489 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7b812fdb-431b-487a-9951-cd129a81d0f8 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:27.137187 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7b812fdb-431b-487a-9951-cd129a81d0f8 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] [instance: 2dc8d790-1306-4a6d-b14d-6c3c1639770c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:27.144254 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b812fdb-431b-487a-9951-cd129a81d0f8 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:27.144908 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b812fdb-431b-487a-9951-cd129a81d0f8 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:27.145508 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b812fdb-431b-487a-9951-cd129a81d0f8 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:27.146426 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b812fdb-431b-487a-9951-cd129a81d0f8 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:27.147037 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b812fdb-431b-487a-9951-cd129a81d0f8 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:27.147516 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c6f2b155-9003-45af-aa62-7358cab8c250 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b" status: 200 len: 1300 microversion: 2.1 time: 0.317991 Oct 23 01:19:27.147883 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b812fdb-431b-487a-9951-cd129a81d0f8 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:27.158076 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1204/2445] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:26 2022] GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b => generated 1300 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:27.158076 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-65e54741-8c45-46df-9bfc-3ae7fcfb9838 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:27.158076 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-65e54741-8c45-46df-9bfc-3ae7fcfb9838 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:27.163729 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-65e54741-8c45-46df-9bfc-3ae7fcfb9838 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:27.164440 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-65e54741-8c45-46df-9bfc-3ae7fcfb9838 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:27.165029 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-65e54741-8c45-46df-9bfc-3ae7fcfb9838 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:27.165873 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-65e54741-8c45-46df-9bfc-3ae7fcfb9838 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:27.166509 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-65e54741-8c45-46df-9bfc-3ae7fcfb9838 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:27.167477 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-65e54741-8c45-46df-9bfc-3ae7fcfb9838 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:27.193688 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7b812fdb-431b-487a-9951-cd129a81d0f8 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] [instance: 2dc8d790-1306-4a6d-b14d-6c3c1639770c] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:19:27.398760 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-65e54741-8c45-46df-9bfc-3ae7fcfb9838 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:27.417248 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-65e54741-8c45-46df-9bfc-3ae7fcfb9838 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:27.419768 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-65e54741-8c45-46df-9bfc-3ae7fcfb9838 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:27.424057 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-65e54741-8c45-46df-9bfc-3ae7fcfb9838 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b" status: 200 len: 1280 microversion: 2.25 time: 0.271302 Oct 23 01:19:27.425041 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1205/2446] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:19:27 2022] GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b => generated 1280 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:19:27.441156 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5ea9b576-279d-43d3-b595-b5a78bd11814 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:27.442326 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5ea9b576-279d-43d3-b595-b5a78bd11814 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 6ccfe45d-f080-4066-9aad-a39c3c4cd097] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:27.452952 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5ea9b576-279d-43d3-b595-b5a78bd11814 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:27.454752 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5ea9b576-279d-43d3-b595-b5a78bd11814 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:27.455414 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5ea9b576-279d-43d3-b595-b5a78bd11814 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:27.456975 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5ea9b576-279d-43d3-b595-b5a78bd11814 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:27.463278 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5ea9b576-279d-43d3-b595-b5a78bd11814 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:27.463278 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5ea9b576-279d-43d3-b595-b5a78bd11814 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:27.464669 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:19:27.510703 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7b812fdb-431b-487a-9951-cd129a81d0f8 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2dc8d790-1306-4a6d-b14d-6c3c1639770c" status: 204 len: 0 microversion: 2.1 time: 0.377399 Oct 23 01:19:27.511352 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1242/2447] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:19:27 2022] DELETE /compute/v2.1/servers/2dc8d790-1306-4a6d-b14d-6c3c1639770c => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:19:27.517512 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b3cab2e3-16b1-4a02-a250-467bbb843096 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:27.518275 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b3cab2e3-16b1-4a02-a250-467bbb843096 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:27.525012 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b3cab2e3-16b1-4a02-a250-467bbb843096 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:27.525710 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b3cab2e3-16b1-4a02-a250-467bbb843096 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:27.526359 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b3cab2e3-16b1-4a02-a250-467bbb843096 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:27.527415 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b3cab2e3-16b1-4a02-a250-467bbb843096 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:27.528072 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b3cab2e3-16b1-4a02-a250-467bbb843096 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:27.528801 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b3cab2e3-16b1-4a02-a250-467bbb843096 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:27.819522 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5ea9b576-279d-43d3-b595-b5a78bd11814 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:27.823293 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b3cab2e3-16b1-4a02-a250-467bbb843096 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:27.830020 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5ea9b576-279d-43d3-b595-b5a78bd11814 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097" status: 200 len: 1317 microversion: 2.1 time: 0.403387 Oct 23 01:19:27.833816 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b3cab2e3-16b1-4a02-a250-467bbb843096 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.321145 Oct 23 01:19:27.834887 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1243/2448] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:27 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:27.843543 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1206/2449] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:27 2022] GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097 => generated 1317 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:27.844920 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4f44b562-258f-4541-8e13-627e7c4c7962 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:27.845691 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4f44b562-258f-4541-8e13-627e7c4c7962 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 8fb6c2f7-737b-4b87-9f6b-58ba7f12e428] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:27.852327 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-25bb6209-3180-4b89-b4d0-6bb2e83a5a4a tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:27.853251 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-25bb6209-3180-4b89-b4d0-6bb2e83a5a4a tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] [instance: 2dc8d790-1306-4a6d-b14d-6c3c1639770c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:27.858776 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:19:27.860592 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25bb6209-3180-4b89-b4d0-6bb2e83a5a4a tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:27.860951 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25bb6209-3180-4b89-b4d0-6bb2e83a5a4a tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:27.861480 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25bb6209-3180-4b89-b4d0-6bb2e83a5a4a tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:27.862314 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25bb6209-3180-4b89-b4d0-6bb2e83a5a4a tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:27.862516 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f44b562-258f-4541-8e13-627e7c4c7962 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:27.863030 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f44b562-258f-4541-8e13-627e7c4c7962 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:27.863212 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25bb6209-3180-4b89-b4d0-6bb2e83a5a4a tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:27.863474 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f44b562-258f-4541-8e13-627e7c4c7962 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:27.863913 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25bb6209-3180-4b89-b4d0-6bb2e83a5a4a tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:27.864183 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f44b562-258f-4541-8e13-627e7c4c7962 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:27.864713 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f44b562-258f-4541-8e13-627e7c4c7962 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:27.865149 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f44b562-258f-4541-8e13-627e7c4c7962 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:27.883124 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:19:28.186264 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4f44b562-258f-4541-8e13-627e7c4c7962 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:28.198532 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4f44b562-258f-4541-8e13-627e7c4c7962 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/8fb6c2f7-737b-4b87-9f6b-58ba7f12e428" status: 200 len: 1307 microversion: 2.1 time: 0.362248 Oct 23 01:19:28.199308 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1244/2450] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:27 2022] GET /compute/v2.1/servers/8fb6c2f7-737b-4b87-9f6b-58ba7f12e428 => generated 1307 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:28.219735 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-591fb9c9-8fee-4723-b8b2-8e659680916e tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:28.220381 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-591fb9c9-8fee-4723-b8b2-8e659680916e tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: 08afe605-c9f1-4d8b-98bc-9253414ebe56] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:28.234031 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-591fb9c9-8fee-4723-b8b2-8e659680916e tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:28.234631 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-591fb9c9-8fee-4723-b8b2-8e659680916e tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:28.235102 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-591fb9c9-8fee-4723-b8b2-8e659680916e tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:28.235816 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-591fb9c9-8fee-4723-b8b2-8e659680916e tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:28.236271 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-591fb9c9-8fee-4723-b8b2-8e659680916e tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:28.236700 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-591fb9c9-8fee-4723-b8b2-8e659680916e tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:28.238248 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-25bb6209-3180-4b89-b4d0-6bb2e83a5a4a tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8417cd8a252c4d3c9f2059c42bc82aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdabdb037d54103a656623e2c4c4a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:28.259585 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-25bb6209-3180-4b89-b4d0-6bb2e83a5a4a tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] 10.222.0.42 "GET /compute/v2.1/servers/2dc8d790-1306-4a6d-b14d-6c3c1639770c" status: 200 len: 1468 microversion: 2.1 time: 0.414644 Oct 23 01:19:28.275904 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1207/2451] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:27 2022] GET /compute/v2.1/servers/2dc8d790-1306-4a6d-b14d-6c3c1639770c => generated 1468 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:28.286613 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bf9b584f-449f-4be0-bab0-d1faf458f052 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:28.289379 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bf9b584f-449f-4be0-bab0-d1faf458f052 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 85c56bc8-f802-4683-b810-374ca7355821] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:28.293559 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-bf9b584f-449f-4be0-bab0-d1faf458f052 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] HTTP exception thrown: Instance 85c56bc8-f802-4683-b810-374ca7355821 could not be found. Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bf9b584f-449f-4be0-bab0-d1faf458f052 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Request method failure captured: Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/servers/85c56bc8-f802-4683-b810-374ca7355821 HTTP/1.1 Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJZEAurAeILsYJek3MCv_ryiTbidOLVZq6W4I7jJxeY_1_bTWRye2xM3EDOhowd_NyioevvIvzT9beBCgKqri_ZjLw9hdsIISMXmajO_VmobATT_GwpY_Y-GVylQtV9MoF1-Bup_Ahjld_2riQHnDzqLUWULm2acZYcK9UIbslVsdDU Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}] Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: cd6a6c5240f94ace91e1f0ed3e53fa7c Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 85c56bc8-f802-4683-b810-374ca7355821 could not be found. Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '85c56bc8-f802-4683-b810-374ca7355821'} Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85c56bc8-f802-4683-b810-374ca7355821 could not be found. Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85c56bc8-f802-4683-b810-374ca7355821 could not be found. Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:28.296308 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:28.300441 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:28.300441 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:28.300441 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:28.300441 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:28.300441 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:19:28.300441 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:19:28.300441 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85c56bc8-f802-4683-b810-374ca7355821 could not be found. Oct 23 01:19:28.300441 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:28.300441 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bf9b584f-449f-4be0-bab0-d1faf458f052 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Returning 404 to user: Instance 85c56bc8-f802-4683-b810-374ca7355821 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:19:28.300441 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bf9b584f-449f-4be0-bab0-d1faf458f052 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "DELETE /compute/v2.1/servers/85c56bc8-f802-4683-b810-374ca7355821" status: 404 len: 111 microversion: 2.1 time: 0.020734 Oct 23 01:19:28.302403 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1208/2452] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:19:28 2022] DELETE /compute/v2.1/servers/85c56bc8-f802-4683-b810-374ca7355821 => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:19:28.308270 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c3c2c869-1a71-4d4e-bbd3-68f8d5d4b5a5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:28.308944 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c3c2c869-1a71-4d4e-bbd3-68f8d5d4b5a5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] [instance: 26043446-8442-4d38-98d8-6ff9a1432d1b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:28.317235 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c3c2c869-1a71-4d4e-bbd3-68f8d5d4b5a5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:28.317733 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c3c2c869-1a71-4d4e-bbd3-68f8d5d4b5a5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:28.318659 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c3c2c869-1a71-4d4e-bbd3-68f8d5d4b5a5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:28.319372 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c3c2c869-1a71-4d4e-bbd3-68f8d5d4b5a5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:28.320373 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c3c2c869-1a71-4d4e-bbd3-68f8d5d4b5a5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:28.320810 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c3c2c869-1a71-4d4e-bbd3-68f8d5d4b5a5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:28.342320 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-c3c2c869-1a71-4d4e-bbd3-68f8d5d4b5a5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] HTTP exception thrown: Instance 26043446-8442-4d38-98d8-6ff9a1432d1b could not be found. Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c3c2c869-1a71-4d4e-bbd3-68f8d5d4b5a5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Request method failure captured: Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b HTTP/1.1 Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJSlUKnwUUKDqVJ5SU0WlCbPMoTauyFJSJPCNWG4h-zCSHoo3KNkNO-CFy9_VuCymiA8kUSdGjR2yGG7onVmef7qXNWa7ROigyW7eGZs7ikwf4EUyMcuHo1C1lWtM2HnrUtFga6W0hGpij0W06vuDpo6qY-r0hwnHSvBgTzaVac7oHg Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: d46a7166e4144f55a102ea6335c5f820 Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-LiveMigrationTest-627897414 Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d46a7166e4144f55a102ea6335c5f820"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d46a7166e4144f55a102ea6335c5f820"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d46a7166e4144f55a102ea6335c5f820"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d46a7166e4144f55a102ea6335c5f820"}]}] Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-LiveMigrationTest-627897414 Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: d46a7166e4144f55a102ea6335c5f820 Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-LiveMigrationTest-627897414 Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-LiveMigrationTest-627897414-project Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 1c2310cbc3574eb29a6ca6291ba7808e Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-LiveMigrationTest-627897414-project Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 26043446-8442-4d38-98d8-6ff9a1432d1b could not be found. Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '26043446-8442-4d38-98d8-6ff9a1432d1b'} Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26043446-8442-4d38-98d8-6ff9a1432d1b could not be found. Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26043446-8442-4d38-98d8-6ff9a1432d1b could not be found. Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:28.344887 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:28.349413 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:28.349413 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:28.349413 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:28.349413 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:19:28.349413 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:19:28.349413 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26043446-8442-4d38-98d8-6ff9a1432d1b could not be found. Oct 23 01:19:28.349413 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:28.349413 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c3c2c869-1a71-4d4e-bbd3-68f8d5d4b5a5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] Returning 404 to user: Instance 26043446-8442-4d38-98d8-6ff9a1432d1b could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:19:28.350550 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c3c2c869-1a71-4d4e-bbd3-68f8d5d4b5a5 tempest-LiveMigrationTest-627897414 tempest-LiveMigrationTest-627897414-project] 10.222.0.42 "GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b" status: 404 len: 111 microversion: 2.1 time: 0.047436 Oct 23 01:19:28.351459 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1209/2453] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:28 2022] GET /compute/v2.1/servers/26043446-8442-4d38-98d8-6ff9a1432d1b => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:19:28.364945 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-d10c2363-86b7-4786-84f2-85e660a26f75 req-90ad34a5-078e-4c0a-a3eb-217d96401331 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fb6c2f7-737b-4b87-9f6b-58ba7f12e428", "tag": "810f70db-7bee-41b2-9290-606e5cf23885"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:28.387213 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-d10c2363-86b7-4786-84f2-85e660a26f75 req-90ad34a5-078e-4c0a-a3eb-217d96401331 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:28.388033 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-d10c2363-86b7-4786-84f2-85e660a26f75 req-90ad34a5-078e-4c0a-a3eb-217d96401331 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:28.388600 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-d10c2363-86b7-4786-84f2-85e660a26f75 req-90ad34a5-078e-4c0a-a3eb-217d96401331 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:28.407639 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-d10c2363-86b7-4786-84f2-85e660a26f75 req-90ad34a5-078e-4c0a-a3eb-217d96401331 service nova] Creating event network-changed:810f70db-7bee-41b2-9290-606e5cf23885 for instance 8fb6c2f7-737b-4b87-9f6b-58ba7f12e428 on n-h2-master-1 Oct 23 01:19:28.411989 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-d10c2363-86b7-4786-84f2-85e660a26f75 req-90ad34a5-078e-4c0a-a3eb-217d96401331 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059072 Oct 23 01:19:28.412736 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1210/2454] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:19:28.419421 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c9bf2638-abff-43eb-8da5-16da2f2ca31a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:28.420123 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c9bf2638-abff-43eb-8da5-16da2f2ca31a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:28.428682 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c9bf2638-abff-43eb-8da5-16da2f2ca31a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:28.430761 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c9bf2638-abff-43eb-8da5-16da2f2ca31a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:28.433376 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c9bf2638-abff-43eb-8da5-16da2f2ca31a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:28.433376 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c9bf2638-abff-43eb-8da5-16da2f2ca31a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:28.433742 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c9bf2638-abff-43eb-8da5-16da2f2ca31a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:28.434252 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c9bf2638-abff-43eb-8da5-16da2f2ca31a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:28.694248 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-591fb9c9-8fee-4723-b8b2-8e659680916e tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:28.708487 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-591fb9c9-8fee-4723-b8b2-8e659680916e tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56" status: 200 len: 1506 microversion: 2.1 time: 0.492868 Oct 23 01:19:28.727092 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1245/2455] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:28 2022] GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56 => generated 1506 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:28.727310 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c9bf2638-abff-43eb-8da5-16da2f2ca31a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:28.733438 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-19ef3cb2-276e-4f42-ae3f-9acbc6ca946d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:28.734378 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-19ef3cb2-276e-4f42-ae3f-9acbc6ca946d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:28.736947 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c9bf2638-abff-43eb-8da5-16da2f2ca31a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.321246 Oct 23 01:19:28.742624 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1211/2456] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:28 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:28.754988 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-19ef3cb2-276e-4f42-ae3f-9acbc6ca946d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:28.755858 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-19ef3cb2-276e-4f42-ae3f-9acbc6ca946d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:28.756767 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-19ef3cb2-276e-4f42-ae3f-9acbc6ca946d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:28.757687 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-19ef3cb2-276e-4f42-ae3f-9acbc6ca946d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:28.758387 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-19ef3cb2-276e-4f42-ae3f-9acbc6ca946d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:28.759095 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-19ef3cb2-276e-4f42-ae3f-9acbc6ca946d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:28.761022 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7f52062e-8840-46c4-8d62-6dcfc0240bde tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:28.761647 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7f52062e-8840-46c4-8d62-6dcfc0240bde tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:28.768742 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f52062e-8840-46c4-8d62-6dcfc0240bde tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:28.769242 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f52062e-8840-46c4-8d62-6dcfc0240bde tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:28.769681 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f52062e-8840-46c4-8d62-6dcfc0240bde tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:28.770457 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f52062e-8840-46c4-8d62-6dcfc0240bde tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:28.771083 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f52062e-8840-46c4-8d62-6dcfc0240bde tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:28.771661 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f52062e-8840-46c4-8d62-6dcfc0240bde tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:29.034560 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7f52062e-8840-46c4-8d62-6dcfc0240bde tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:29.043548 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7f52062e-8840-46c4-8d62-6dcfc0240bde tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.287098 Oct 23 01:19:29.049163 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1212/2457] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:28 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:19:29.062226 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0b54b216-bc93-41ba-9d6d-523fb5a17efe tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:29.063672 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0b54b216-bc93-41ba-9d6d-523fb5a17efe tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 6ccfe45d-f080-4066-9aad-a39c3c4cd097] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:29.070517 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-19ef3cb2-276e-4f42-ae3f-9acbc6ca946d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:29.078705 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b54b216-bc93-41ba-9d6d-523fb5a17efe tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:29.080108 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b54b216-bc93-41ba-9d6d-523fb5a17efe tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:29.081078 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-19ef3cb2-276e-4f42-ae3f-9acbc6ca946d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:29.082986 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-19ef3cb2-276e-4f42-ae3f-9acbc6ca946d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:29.085927 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-19ef3cb2-276e-4f42-ae3f-9acbc6ca946d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b" status: 200 len: 1476 microversion: 2.25 time: 0.356488 Oct 23 01:19:29.086168 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b54b216-bc93-41ba-9d6d-523fb5a17efe tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:29.086750 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b54b216-bc93-41ba-9d6d-523fb5a17efe tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:29.087328 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b54b216-bc93-41ba-9d6d-523fb5a17efe tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:29.087662 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b54b216-bc93-41ba-9d6d-523fb5a17efe tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:29.088253 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1246/2458] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:19:28 2022] GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b => generated 1476 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:19:29.096801 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bff134cb-df06-4d37-adad-4451458cd015 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:29.097769 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-bff134cb-df06-4d37-adad-4451458cd015 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Failed to fetch instance by id 9223372036854775808 {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 23 01:19:29.099052 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-bff134cb-df06-4d37-adad-4451458cd015 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bff134cb-df06-4d37-adad-4451458cd015 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Request method failure captured: Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJZEAurAeILsYJek3MCv_ryiTbidOLVZq6W4I7jJxeY_1_bTWRye2xM3EDOhowd_NyioevvIvzT9beBCgKqri_ZjLw9hdsIISMXmajO_VmobATT_GwpY_Y-GVylQtV9MoF1-Bup_Ahjld_2riQHnDzqLUWULm2acZYcK9UIbslVsdDU Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}] Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: cd6a6c5240f94ace91e1f0ed3e53fa7c Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 9223372036854775808 could not be found. Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '9223372036854775808'} Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:29.101140 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:29.117313 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:29.117313 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:19:29.117313 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:19:29.117313 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 23 01:19:29.117313 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:29.117313 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bff134cb-df06-4d37-adad-4451458cd015 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:19:29.117313 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bff134cb-df06-4d37-adad-4451458cd015 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.014486 Oct 23 01:19:29.117313 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1247/2459] 10.222.0.42 () {58 vars in 1188 bytes} [Sun Oct 23 01:19:29 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:19:29.313076 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0b54b216-bc93-41ba-9d6d-523fb5a17efe tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:29.321578 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0b54b216-bc93-41ba-9d6d-523fb5a17efe tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097" status: 200 len: 1317 microversion: 2.1 time: 0.271072 Oct 23 01:19:29.326283 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1213/2460] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:29 2022] GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097 => generated 1317 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:29.337628 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-56a2dba6-17bd-41a4-af27-172f74cf0d97 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:29.338580 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-56a2dba6-17bd-41a4-af27-172f74cf0d97 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:29.347544 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f516fb76-10a7-4b34-8ed5-dff24f55945b tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:29.348370 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f516fb76-10a7-4b34-8ed5-dff24f55945b tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] [instance: 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:29.350131 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-56a2dba6-17bd-41a4-af27-172f74cf0d97 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:29.351661 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-56a2dba6-17bd-41a4-af27-172f74cf0d97 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:29.352181 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-56a2dba6-17bd-41a4-af27-172f74cf0d97 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:29.353100 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-56a2dba6-17bd-41a4-af27-172f74cf0d97 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:29.359679 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f516fb76-10a7-4b34-8ed5-dff24f55945b tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:29.360633 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-56a2dba6-17bd-41a4-af27-172f74cf0d97 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:29.360835 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f516fb76-10a7-4b34-8ed5-dff24f55945b tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:29.361226 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-56a2dba6-17bd-41a4-af27-172f74cf0d97 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:29.361605 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f516fb76-10a7-4b34-8ed5-dff24f55945b tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:29.368627 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f516fb76-10a7-4b34-8ed5-dff24f55945b tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:29.374991 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f516fb76-10a7-4b34-8ed5-dff24f55945b tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:29.375986 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f516fb76-10a7-4b34-8ed5-dff24f55945b tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:29.699403 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-56a2dba6-17bd-41a4-af27-172f74cf0d97 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:29.711911 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-56a2dba6-17bd-41a4-af27-172f74cf0d97 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.384308 Oct 23 01:19:29.712504 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1214/2461] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:29 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:29.743087 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e4901db7-85ec-40ba-bf63-44ef5af9e6da tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:29.743621 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e4901db7-85ec-40ba-bf63-44ef5af9e6da tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 8fb6c2f7-737b-4b87-9f6b-58ba7f12e428] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:29.755511 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e4901db7-85ec-40ba-bf63-44ef5af9e6da tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:29.755999 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e4901db7-85ec-40ba-bf63-44ef5af9e6da tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:29.756431 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e4901db7-85ec-40ba-bf63-44ef5af9e6da tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:29.757132 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e4901db7-85ec-40ba-bf63-44ef5af9e6da tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:29.757588 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e4901db7-85ec-40ba-bf63-44ef5af9e6da tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:29.758023 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e4901db7-85ec-40ba-bf63-44ef5af9e6da tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:29.780007 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-f516fb76-10a7-4b34-8ed5-dff24f55945b tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lazy-loading 'services' on Instance uuid 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:19:29.804261 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f516fb76-10a7-4b34-8ed5-dff24f55945b tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b" status: 200 len: 1968 microversion: 2.25 time: 0.685861 Oct 23 01:19:29.805709 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1248/2462] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:19:29 2022] GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b => generated 1968 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:19:29.810680 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a2b3d3c8-8f3b-42de-b08c-4a67a8a10dad tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:29.812515 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a2b3d3c8-8f3b-42de-b08c-4a67a8a10dad tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] [instance: 2dc8d790-1306-4a6d-b14d-6c3c1639770c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:29.824794 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a2b3d3c8-8f3b-42de-b08c-4a67a8a10dad tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:29.825565 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a2b3d3c8-8f3b-42de-b08c-4a67a8a10dad tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:29.826286 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a2b3d3c8-8f3b-42de-b08c-4a67a8a10dad tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:29.827592 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a2b3d3c8-8f3b-42de-b08c-4a67a8a10dad tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:29.829705 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a2b3d3c8-8f3b-42de-b08c-4a67a8a10dad tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:29.830600 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a2b3d3c8-8f3b-42de-b08c-4a67a8a10dad tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:30.086033 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e4901db7-85ec-40ba-bf63-44ef5af9e6da tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:30.094770 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e4901db7-85ec-40ba-bf63-44ef5af9e6da tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/8fb6c2f7-737b-4b87-9f6b-58ba7f12e428" status: 200 len: 1307 microversion: 2.1 time: 0.380693 Oct 23 01:19:30.106837 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1215/2463] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:29 2022] GET /compute/v2.1/servers/8fb6c2f7-737b-4b87-9f6b-58ba7f12e428 => generated 1307 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:30.107177 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a2b3d3c8-8f3b-42de-b08c-4a67a8a10dad tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8417cd8a252c4d3c9f2059c42bc82aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdabdb037d54103a656623e2c4c4a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:30.109266 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b8c9b4a9-ddc1-4ff6-a7d8-2da84de280da tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:30.110667 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b8c9b4a9-ddc1-4ff6-a7d8-2da84de280da tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: 08afe605-c9f1-4d8b-98bc-9253414ebe56] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:30.115910 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a2b3d3c8-8f3b-42de-b08c-4a67a8a10dad tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] 10.222.0.42 "GET /compute/v2.1/servers/2dc8d790-1306-4a6d-b14d-6c3c1639770c" status: 200 len: 1468 microversion: 2.1 time: 0.308846 Oct 23 01:19:30.116828 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1249/2464] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:29 2022] GET /compute/v2.1/servers/2dc8d790-1306-4a6d-b14d-6c3c1639770c => generated 1468 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:30.121591 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b8c9b4a9-ddc1-4ff6-a7d8-2da84de280da tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:30.121760 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-21da5a8f-429b-4791-9a99-949da04decb7 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:30.122317 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-21da5a8f-429b-4791-9a99-949da04decb7 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:30.122430 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b8c9b4a9-ddc1-4ff6-a7d8-2da84de280da tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:30.123047 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b8c9b4a9-ddc1-4ff6-a7d8-2da84de280da tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:30.123847 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b8c9b4a9-ddc1-4ff6-a7d8-2da84de280da tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:30.124400 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b8c9b4a9-ddc1-4ff6-a7d8-2da84de280da tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:30.124919 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b8c9b4a9-ddc1-4ff6-a7d8-2da84de280da tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:30.128517 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-21da5a8f-429b-4791-9a99-949da04decb7 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:30.129066 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-21da5a8f-429b-4791-9a99-949da04decb7 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:30.133787 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-21da5a8f-429b-4791-9a99-949da04decb7 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:30.133787 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-21da5a8f-429b-4791-9a99-949da04decb7 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:30.133787 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-21da5a8f-429b-4791-9a99-949da04decb7 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:30.133787 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-21da5a8f-429b-4791-9a99-949da04decb7 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:30.401936 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-21da5a8f-429b-4791-9a99-949da04decb7 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:30.410574 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-21da5a8f-429b-4791-9a99-949da04decb7 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.292732 Oct 23 01:19:30.413845 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1250/2465] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:30 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:30.424434 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b8c9b4a9-ddc1-4ff6-a7d8-2da84de280da tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:30.428124 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b8c9b4a9-ddc1-4ff6-a7d8-2da84de280da tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56" status: 200 len: 1506 microversion: 2.1 time: 0.331349 Oct 23 01:19:30.447188 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-96dc571d-9786-4f1e-b670-65f1f9411410 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:30.447188 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-96dc571d-9786-4f1e-b670-65f1f9411410 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] [instance: 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:30.447406 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1216/2466] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:30 2022] GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56 => generated 1506 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:30.447496 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-96dc571d-9786-4f1e-b670-65f1f9411410 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:30.447496 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-96dc571d-9786-4f1e-b670-65f1f9411410 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:30.447496 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-96dc571d-9786-4f1e-b670-65f1f9411410 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:30.447749 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a8ded42e-d4d4-441d-ae7f-b736f9f635a4 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:30.447837 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-96dc571d-9786-4f1e-b670-65f1f9411410 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:30.447919 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a8ded42e-d4d4-441d-ae7f-b736f9f635a4 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 6ccfe45d-f080-4066-9aad-a39c3c4cd097] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:30.448010 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-96dc571d-9786-4f1e-b670-65f1f9411410 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:30.448010 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-96dc571d-9786-4f1e-b670-65f1f9411410 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:30.505652 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a8ded42e-d4d4-441d-ae7f-b736f9f635a4 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:30.506212 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a8ded42e-d4d4-441d-ae7f-b736f9f635a4 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:30.507882 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a8ded42e-d4d4-441d-ae7f-b736f9f635a4 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:30.512286 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a8ded42e-d4d4-441d-ae7f-b736f9f635a4 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:30.512820 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a8ded42e-d4d4-441d-ae7f-b736f9f635a4 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:30.515762 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a8ded42e-d4d4-441d-ae7f-b736f9f635a4 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:30.769606 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a8ded42e-d4d4-441d-ae7f-b736f9f635a4 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:30.780219 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-96dc571d-9786-4f1e-b670-65f1f9411410 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lazy-loading 'services' on Instance uuid 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:19:30.781256 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a8ded42e-d4d4-441d-ae7f-b736f9f635a4 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097" status: 200 len: 1317 microversion: 2.1 time: 0.340222 Oct 23 01:19:30.782529 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1217/2467] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:30 2022] GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097 => generated 1317 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:30.787235 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-41f16e6b-93ab-4958-a524-c258fd15d160 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:30.787905 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-41f16e6b-93ab-4958-a524-c258fd15d160 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Failed to fetch instance by id -1 {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 23 01:19:30.788546 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-41f16e6b-93ab-4958-a524-c258fd15d160 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] HTTP exception thrown: Instance -1 could not be found. Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-41f16e6b-93ab-4958-a524-c258fd15d160 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Request method failure captured: Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJZEAurAeILsYJek3MCv_ryiTbidOLVZq6W4I7jJxeY_1_bTWRye2xM3EDOhowd_NyioevvIvzT9beBCgKqri_ZjLw9hdsIISMXmajO_VmobATT_GwpY_Y-GVylQtV9MoF1-Bup_Ahjld_2riQHnDzqLUWULm2acZYcK9UIbslVsdDU Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}] Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: cd6a6c5240f94ace91e1f0ed3e53fa7c Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: exception: Instance -1 could not be found. Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '-1'} Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:30.790290 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:30.793762 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:19:30.793762 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:19:30.793762 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 23 01:19:30.793762 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:30.794969 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-41f16e6b-93ab-4958-a524-c258fd15d160 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Returning 404 to user: Instance -1 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:19:30.795966 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-41f16e6b-93ab-4958-a524-c258fd15d160 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.012303 Oct 23 01:19:30.797007 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1218/2468] 10.222.0.42 () {58 vars in 1137 bytes} [Sun Oct 23 01:19:30 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:19:30.804597 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-3dde23c3-ff68-4e97-8cfd-f1d1e316491f req-1300ad08-60dd-4027-b3c9-f39773067f0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dc8d790-1306-4a6d-b14d-6c3c1639770c", "name": "network-vif-deleted", "tag": "9092279f-a76e-4eac-928a-c17ce6983691"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:30.817167 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-3dde23c3-ff68-4e97-8cfd-f1d1e316491f req-1300ad08-60dd-4027-b3c9-f39773067f0d service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:30.822549 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-3dde23c3-ff68-4e97-8cfd-f1d1e316491f req-1300ad08-60dd-4027-b3c9-f39773067f0d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:30.822549 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-3dde23c3-ff68-4e97-8cfd-f1d1e316491f req-1300ad08-60dd-4027-b3c9-f39773067f0d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:30.831344 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-3dde23c3-ff68-4e97-8cfd-f1d1e316491f req-1300ad08-60dd-4027-b3c9-f39773067f0d service nova] Creating event network-vif-deleted:9092279f-a76e-4eac-928a-c17ce6983691 for instance 2dc8d790-1306-4a6d-b14d-6c3c1639770c on n-h1-master-1 Oct 23 01:19:30.838326 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-3dde23c3-ff68-4e97-8cfd-f1d1e316491f req-1300ad08-60dd-4027-b3c9-f39773067f0d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037553 Oct 23 01:19:30.847196 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1219/2469] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:19:30.847196 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a6bc72cc-cc6a-4e10-a8db-6377db410bac tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:30.847196 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a6bc72cc-cc6a-4e10-a8db-6377db410bac tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:30.853567 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6bc72cc-cc6a-4e10-a8db-6377db410bac tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:30.854127 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6bc72cc-cc6a-4e10-a8db-6377db410bac tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:30.854569 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6bc72cc-cc6a-4e10-a8db-6377db410bac tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:30.855285 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6bc72cc-cc6a-4e10-a8db-6377db410bac tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:30.855750 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6bc72cc-cc6a-4e10-a8db-6377db410bac tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:30.856173 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6bc72cc-cc6a-4e10-a8db-6377db410bac tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:31.013153 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-96dc571d-9786-4f1e-b670-65f1f9411410 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b" status: 200 len: 1968 microversion: 2.25 time: 0.589728 Oct 23 01:19:31.014181 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1251/2470] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:19:30 2022] GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b => generated 1968 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:19:31.040677 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ab2e2209-9d0b-45e7-921a-eb981889e6df tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:31.046648 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ab2e2209-9d0b-45e7-921a-eb981889e6df tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:31.048046 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ab2e2209-9d0b-45e7-921a-eb981889e6df tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:31.048588 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ab2e2209-9d0b-45e7-921a-eb981889e6df tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:31.049451 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ab2e2209-9d0b-45e7-921a-eb981889e6df tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:31.053834 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ab2e2209-9d0b-45e7-921a-eb981889e6df tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:31.053834 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ab2e2209-9d0b-45e7-921a-eb981889e6df tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:31.054095 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a6bc72cc-cc6a-4e10-a8db-6377db410bac tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:31.067995 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a6bc72cc-cc6a-4e10-a8db-6377db410bac tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.227875 Oct 23 01:19:31.069277 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1220/2471] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:30 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:31.081829 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ab2e2209-9d0b-45e7-921a-eb981889e6df tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.046347 Oct 23 01:19:31.082813 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1252/2472] 10.222.0.42 () {60 vars in 1217 bytes} [Sun Oct 23 01:19:31 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:19:31.097694 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2255abcd-13af-46cd-b082-29090f953bab tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:31.098352 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2255abcd-13af-46cd-b082-29090f953bab tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:31.103030 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-139d213e-c85e-4267-85f4-631980424d13 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": "auto"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:31.105604 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-139d213e-c85e-4267-85f4-631980424d13 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] [instance: 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:31.107607 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:19:31.113632 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-139d213e-c85e-4267-85f4-631980424d13 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:31.114305 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-139d213e-c85e-4267-85f4-631980424d13 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:31.114743 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-139d213e-c85e-4267-85f4-631980424d13 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:31.115170 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2255abcd-13af-46cd-b082-29090f953bab tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:31.115440 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-139d213e-c85e-4267-85f4-631980424d13 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:31.115892 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-139d213e-c85e-4267-85f4-631980424d13 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:31.116312 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-139d213e-c85e-4267-85f4-631980424d13 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:31.116686 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2255abcd-13af-46cd-b082-29090f953bab tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:31.117407 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2255abcd-13af-46cd-b082-29090f953bab tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:31.118417 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2255abcd-13af-46cd-b082-29090f953bab tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:31.119075 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2255abcd-13af-46cd-b082-29090f953bab tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:31.119698 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2255abcd-13af-46cd-b082-29090f953bab tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:31.156463 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-139d213e-c85e-4267-85f4-631980424d13 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lazy-loading 'flavor' on Instance uuid 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:19:31.175167 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-139d213e-c85e-4267-85f4-631980424d13 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] [instance: 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b] Going to try to live migrate instance to n-h1-master-1 {{(pid=120945) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 23 01:19:31.301051 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2255abcd-13af-46cd-b082-29090f953bab tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:31.318719 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2255abcd-13af-46cd-b082-29090f953bab tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.229282 Oct 23 01:19:31.319318 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1221/2473] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:31 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:31.323766 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5b865ee8-481d-4e95-9bc3-4ae887370584 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:31.324469 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5b865ee8-481d-4e95-9bc3-4ae887370584 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 8fb6c2f7-737b-4b87-9f6b-58ba7f12e428] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:31.339480 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b865ee8-481d-4e95-9bc3-4ae887370584 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:31.340226 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b865ee8-481d-4e95-9bc3-4ae887370584 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:31.341760 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b865ee8-481d-4e95-9bc3-4ae887370584 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:31.342767 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b865ee8-481d-4e95-9bc3-4ae887370584 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:31.343421 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b865ee8-481d-4e95-9bc3-4ae887370584 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:31.344626 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b865ee8-481d-4e95-9bc3-4ae887370584 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:31.531663 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5b865ee8-481d-4e95-9bc3-4ae887370584 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:31.541298 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5b865ee8-481d-4e95-9bc3-4ae887370584 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/8fb6c2f7-737b-4b87-9f6b-58ba7f12e428" status: 200 len: 1307 microversion: 2.1 time: 0.220597 Oct 23 01:19:31.546795 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1222/2474] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:31 2022] GET /compute/v2.1/servers/8fb6c2f7-737b-4b87-9f6b-58ba7f12e428 => generated 1307 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:31.547850 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7101aada-86bd-4ebb-b24c-50d6fcee6b9e tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:31.548673 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7101aada-86bd-4ebb-b24c-50d6fcee6b9e tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] [instance: 2dc8d790-1306-4a6d-b14d-6c3c1639770c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:31.556898 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7101aada-86bd-4ebb-b24c-50d6fcee6b9e tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:31.557712 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7101aada-86bd-4ebb-b24c-50d6fcee6b9e tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:31.558328 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7101aada-86bd-4ebb-b24c-50d6fcee6b9e tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:31.559247 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7101aada-86bd-4ebb-b24c-50d6fcee6b9e tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:31.559779 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7101aada-86bd-4ebb-b24c-50d6fcee6b9e tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:31.560283 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7101aada-86bd-4ebb-b24c-50d6fcee6b9e tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:31.599500 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7101aada-86bd-4ebb-b24c-50d6fcee6b9e tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:31.600251 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7101aada-86bd-4ebb-b24c-50d6fcee6b9e tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:31.600895 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7101aada-86bd-4ebb-b24c-50d6fcee6b9e tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:31.601572 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-7101aada-86bd-4ebb-b24c-50d6fcee6b9e tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lazy-loading 'fault' on Instance uuid 2dc8d790-1306-4a6d-b14d-6c3c1639770c {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:19:31.663227 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7101aada-86bd-4ebb-b24c-50d6fcee6b9e tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8417cd8a252c4d3c9f2059c42bc82aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdabdb037d54103a656623e2c4c4a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:31.673023 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7101aada-86bd-4ebb-b24c-50d6fcee6b9e tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] 10.222.0.42 "GET /compute/v2.1/servers/2dc8d790-1306-4a6d-b14d-6c3c1639770c" status: 200 len: 1312 microversion: 2.1 time: 0.128891 Oct 23 01:19:31.674509 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1223/2475] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:31 2022] GET /compute/v2.1/servers/2dc8d790-1306-4a6d-b14d-6c3c1639770c => generated 1312 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:31.680431 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bea6880d-b4ce-4eb9-8cff-b4408085990f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:31.681222 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bea6880d-b4ce-4eb9-8cff-b4408085990f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: c5b84b55-b8d8-4ff7-9872-24bb8770f1d5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:31.689131 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-bea6880d-b4ce-4eb9-8cff-b4408085990f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] HTTP exception thrown: Instance c5b84b55-b8d8-4ff7-9872-24bb8770f1d5 could not be found. Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bea6880d-b4ce-4eb9-8cff-b4408085990f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Request method failure captured: Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/servers/c5b84b55-b8d8-4ff7-9872-24bb8770f1d5/action HTTP/1.1 Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 19 Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJZEAurAeILsYJek3MCv_ryiTbidOLVZq6W4I7jJxeY_1_bTWRye2xM3EDOhowd_NyioevvIvzT9beBCgKqri_ZjLw9hdsIISMXmajO_VmobATT_GwpY_Y-GVylQtV9MoF1-Bup_Ahjld_2riQHnDzqLUWULm2acZYcK9UIbslVsdDU Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}] Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: cd6a6c5240f94ace91e1f0ed3e53fa7c Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: {"forceDelete": {}} Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: exception: Instance c5b84b55-b8d8-4ff7-9872-24bb8770f1d5 could not be found. Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'c5b84b55-b8d8-4ff7-9872-24bb8770f1d5', 'body': {'forceDelete': {}}} Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5b84b55-b8d8-4ff7-9872-24bb8770f1d5 could not be found. Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5b84b55-b8d8-4ff7-9872-24bb8770f1d5 could not be found. Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:31.696190 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:31.701610 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:19:31.701610 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:19:31.701610 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5b84b55-b8d8-4ff7-9872-24bb8770f1d5 could not be found. Oct 23 01:19:31.701610 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:31.701610 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bea6880d-b4ce-4eb9-8cff-b4408085990f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Returning 404 to user: Instance c5b84b55-b8d8-4ff7-9872-24bb8770f1d5 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:19:31.701610 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bea6880d-b4ce-4eb9-8cff-b4408085990f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "POST /compute/v2.1/servers/c5b84b55-b8d8-4ff7-9872-24bb8770f1d5/action" status: 404 len: 111 microversion: 2.1 time: 0.023391 Oct 23 01:19:31.701610 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1224/2476] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:19:31 2022] POST /compute/v2.1/servers/c5b84b55-b8d8-4ff7-9872-24bb8770f1d5/action => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:19:31.711694 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-01bc211c-3bfe-49e2-9464-6d08cde425c3 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:31.712576 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-01bc211c-3bfe-49e2-9464-6d08cde425c3 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: 08afe605-c9f1-4d8b-98bc-9253414ebe56] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:31.720841 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01bc211c-3bfe-49e2-9464-6d08cde425c3 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:31.721347 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01bc211c-3bfe-49e2-9464-6d08cde425c3 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:31.721827 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01bc211c-3bfe-49e2-9464-6d08cde425c3 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:31.722553 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01bc211c-3bfe-49e2-9464-6d08cde425c3 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:31.723013 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01bc211c-3bfe-49e2-9464-6d08cde425c3 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:31.723437 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01bc211c-3bfe-49e2-9464-6d08cde425c3 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:31.954764 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-01bc211c-3bfe-49e2-9464-6d08cde425c3 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:31.973254 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-01bc211c-3bfe-49e2-9464-6d08cde425c3 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56" status: 200 len: 1506 microversion: 2.1 time: 0.265450 Oct 23 01:19:31.988402 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1225/2477] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:31 2022] GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56 => generated 1506 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:31.997854 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6e3b7c5a-7222-45c4-8613-adf4598c8815 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:32.003766 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6e3b7c5a-7222-45c4-8613-adf4598c8815 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:32.006660 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6e3b7c5a-7222-45c4-8613-adf4598c8815 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:32.007257 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6e3b7c5a-7222-45c4-8613-adf4598c8815 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:32.007864 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6e3b7c5a-7222-45c4-8613-adf4598c8815 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:32.008628 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6e3b7c5a-7222-45c4-8613-adf4598c8815 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:32.009087 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6e3b7c5a-7222-45c4-8613-adf4598c8815 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:32.009515 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6e3b7c5a-7222-45c4-8613-adf4598c8815 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:32.190678 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6e3b7c5a-7222-45c4-8613-adf4598c8815 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:32.199262 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6e3b7c5a-7222-45c4-8613-adf4598c8815 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.208282 Oct 23 01:19:32.214691 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1226/2478] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:31 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:32.224238 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-e44aba62-b5c0-4f0c-9faa-fd4c83c25e5e req-458e344e-1de0-4cb7-bd73-7177e3e708c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ccfe45d-f080-4066-9aad-a39c3c4cd097", "tag": "fce18087-d670-4b69-9cc5-11b42a9fa6de"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:32.234219 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-e44aba62-b5c0-4f0c-9faa-fd4c83c25e5e req-458e344e-1de0-4cb7-bd73-7177e3e708c2 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:32.235358 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-e44aba62-b5c0-4f0c-9faa-fd4c83c25e5e req-458e344e-1de0-4cb7-bd73-7177e3e708c2 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:32.235842 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-e44aba62-b5c0-4f0c-9faa-fd4c83c25e5e req-458e344e-1de0-4cb7-bd73-7177e3e708c2 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:32.260907 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-e44aba62-b5c0-4f0c-9faa-fd4c83c25e5e req-458e344e-1de0-4cb7-bd73-7177e3e708c2 service nova] Creating event network-changed:fce18087-d670-4b69-9cc5-11b42a9fa6de for instance 6ccfe45d-f080-4066-9aad-a39c3c4cd097 on n-h1-master-1 Oct 23 01:19:32.272586 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-e44aba62-b5c0-4f0c-9faa-fd4c83c25e5e req-458e344e-1de0-4cb7-bd73-7177e3e708c2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056434 Oct 23 01:19:32.273215 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1227/2479] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:19:32.288433 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7f40a139-93a1-4602-9a26-8ff19d7d5275 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:32.289305 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7f40a139-93a1-4602-9a26-8ff19d7d5275 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 6ccfe45d-f080-4066-9aad-a39c3c4cd097] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:32.320282 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f40a139-93a1-4602-9a26-8ff19d7d5275 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:32.320783 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f40a139-93a1-4602-9a26-8ff19d7d5275 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:32.321224 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f40a139-93a1-4602-9a26-8ff19d7d5275 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:32.322879 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f40a139-93a1-4602-9a26-8ff19d7d5275 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:32.323338 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f40a139-93a1-4602-9a26-8ff19d7d5275 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:32.323975 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f40a139-93a1-4602-9a26-8ff19d7d5275 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:32.329636 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=100 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:19:32.587646 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7f40a139-93a1-4602-9a26-8ff19d7d5275 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:32.595878 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7f40a139-93a1-4602-9a26-8ff19d7d5275 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097" status: 200 len: 1317 microversion: 2.1 time: 0.319726 Oct 23 01:19:32.597606 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1228/2480] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:32 2022] GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097 => generated 1317 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:32.602717 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-27f3ab45-9b8a-4e53-a7e9-7af2f629ac97 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:32.603532 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-27f3ab45-9b8a-4e53-a7e9-7af2f629ac97 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:32.610665 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-27f3ab45-9b8a-4e53-a7e9-7af2f629ac97 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:32.611433 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-27f3ab45-9b8a-4e53-a7e9-7af2f629ac97 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:32.612135 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-27f3ab45-9b8a-4e53-a7e9-7af2f629ac97 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:32.613073 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-27f3ab45-9b8a-4e53-a7e9-7af2f629ac97 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:32.613524 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-27f3ab45-9b8a-4e53-a7e9-7af2f629ac97 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:32.617432 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-27f3ab45-9b8a-4e53-a7e9-7af2f629ac97 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:32.774003 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-27f3ab45-9b8a-4e53-a7e9-7af2f629ac97 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:32.783281 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-27f3ab45-9b8a-4e53-a7e9-7af2f629ac97 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.184469 Oct 23 01:19:32.783856 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1229/2481] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:32 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:32.790875 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ef95ffd2-0cd6-4fdb-b65f-3c71f92c6f09 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:32.791726 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ef95ffd2-0cd6-4fdb-b65f-3c71f92c6f09 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 8fb6c2f7-737b-4b87-9f6b-58ba7f12e428] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:32.798615 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ef95ffd2-0cd6-4fdb-b65f-3c71f92c6f09 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:32.799369 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ef95ffd2-0cd6-4fdb-b65f-3c71f92c6f09 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:32.799950 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ef95ffd2-0cd6-4fdb-b65f-3c71f92c6f09 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:32.800916 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ef95ffd2-0cd6-4fdb-b65f-3c71f92c6f09 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:32.801402 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ef95ffd2-0cd6-4fdb-b65f-3c71f92c6f09 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:32.801830 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ef95ffd2-0cd6-4fdb-b65f-3c71f92c6f09 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:32.948807 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ef95ffd2-0cd6-4fdb-b65f-3c71f92c6f09 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:32.973413 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ef95ffd2-0cd6-4fdb-b65f-3c71f92c6f09 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/8fb6c2f7-737b-4b87-9f6b-58ba7f12e428" status: 200 len: 1307 microversion: 2.1 time: 0.171412 Oct 23 01:19:32.973413 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1230/2482] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:32 2022] GET /compute/v2.1/servers/8fb6c2f7-737b-4b87-9f6b-58ba7f12e428 => generated 1307 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:32.973413 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dbf0e533-b76b-4707-97ac-81547c943c53 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:32.973413 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-dbf0e533-b76b-4707-97ac-81547c943c53 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] [instance: 2dc8d790-1306-4a6d-b14d-6c3c1639770c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:32.973413 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dbf0e533-b76b-4707-97ac-81547c943c53 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:32.973413 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dbf0e533-b76b-4707-97ac-81547c943c53 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:32.973413 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dbf0e533-b76b-4707-97ac-81547c943c53 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:32.973413 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dbf0e533-b76b-4707-97ac-81547c943c53 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:32.974657 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dbf0e533-b76b-4707-97ac-81547c943c53 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:32.974657 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dbf0e533-b76b-4707-97ac-81547c943c53 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:32.991556 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-dbf0e533-b76b-4707-97ac-81547c943c53 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] HTTP exception thrown: Instance 2dc8d790-1306-4a6d-b14d-6c3c1639770c could not be found. Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dbf0e533-b76b-4707-97ac-81547c943c53 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Request method failure captured: Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/2dc8d790-1306-4a6d-b14d-6c3c1639770c HTTP/1.1 Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJZmoo6H9FGf873Bz4OUc4aTR0L1ZQ0jT8z94IbEkAbGzpfAdIfPFlU4MYldtKIKQhKSiHku16Abu_FD8LKFMVeaXmRmVExNemvGumyjuOMd5iGRbXUrJbK8OemwZk7szfQr0NS7dBwstK0BRTytzcp3YpkJarR2s_KTG2VO_I7DyOw Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: bcdabdb037d54103a656623e2c4c4a78 Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-283834885 Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bcdabdb037d54103a656623e2c4c4a78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bcdabdb037d54103a656623e2c4c4a78"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bcdabdb037d54103a656623e2c4c4a78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bcdabdb037d54103a656623e2c4c4a78"}]}] Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersAdminNegativeTestJSON-283834885 Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: bcdabdb037d54103a656623e2c4c4a78 Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-283834885 Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersAdminNegativeTestJSON-283834885-project Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 8417cd8a252c4d3c9f2059c42bc82aa0 Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersAdminNegativeTestJSON-283834885-project Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 2dc8d790-1306-4a6d-b14d-6c3c1639770c could not be found. Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '2dc8d790-1306-4a6d-b14d-6c3c1639770c'} Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dc8d790-1306-4a6d-b14d-6c3c1639770c could not be found. Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dc8d790-1306-4a6d-b14d-6c3c1639770c could not be found. Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:32.993276 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:32.997671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:32.997671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:32.997671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:32.997671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:32.997671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:19:32.997671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:19:32.997671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dc8d790-1306-4a6d-b14d-6c3c1639770c could not be found. Oct 23 01:19:32.997671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:32.997671 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dbf0e533-b76b-4707-97ac-81547c943c53 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Returning 404 to user: Instance 2dc8d790-1306-4a6d-b14d-6c3c1639770c could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:19:32.997671 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-dbf0e533-b76b-4707-97ac-81547c943c53 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] 10.222.0.42 "GET /compute/v2.1/servers/2dc8d790-1306-4a6d-b14d-6c3c1639770c" status: 404 len: 111 microversion: 2.1 time: 0.035512 Oct 23 01:19:32.999300 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1231/2483] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:32 2022] GET /compute/v2.1/servers/2dc8d790-1306-4a6d-b14d-6c3c1639770c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:19:33.004147 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ce10b275-00e7-4f09-abab-80fa258dc579 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:33.006960 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ce10b275-00e7-4f09-abab-80fa258dc579 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 22907549-9b26-45c5-8e09-779738f19a2e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:33.013815 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-ce10b275-00e7-4f09-abab-80fa258dc579 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] HTTP exception thrown: Instance 22907549-9b26-45c5-8e09-779738f19a2e could not be found. Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ce10b275-00e7-4f09-abab-80fa258dc579 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Request method failure captured: Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/servers/22907549-9b26-45c5-8e09-779738f19a2e/action HTTP/1.1 Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 39 Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJZEAurAeILsYJek3MCv_ryiTbidOLVZq6W4I7jJxeY_1_bTWRye2xM3EDOhowd_NyioevvIvzT9beBCgKqri_ZjLw9hdsIISMXmajO_VmobATT_GwpY_Y-GVylQtV9MoF1-Bup_Ahjld_2riQHnDzqLUWULm2acZYcK9UIbslVsdDU Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}] Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: cd6a6c5240f94ace91e1f0ed3e53fa7c Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: {"os-getConsoleOutput": {"length": 10}} Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 22907549-9b26-45c5-8e09-779738f19a2e could not be found. Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '22907549-9b26-45c5-8e09-779738f19a2e', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22907549-9b26-45c5-8e09-779738f19a2e could not be found. Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22907549-9b26-45c5-8e09-779738f19a2e could not be found. Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:33.020498 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:33.029301 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:33.029301 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:33.029301 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:19:33.029301 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:19:33.029301 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22907549-9b26-45c5-8e09-779738f19a2e could not be found. Oct 23 01:19:33.029301 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:33.029301 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ce10b275-00e7-4f09-abab-80fa258dc579 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Returning 404 to user: Instance 22907549-9b26-45c5-8e09-779738f19a2e could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:19:33.029301 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ce10b275-00e7-4f09-abab-80fa258dc579 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "POST /compute/v2.1/servers/22907549-9b26-45c5-8e09-779738f19a2e/action" status: 404 len: 111 microversion: 2.1 time: 0.022654 Oct 23 01:19:33.029301 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1232/2484] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:19:32 2022] POST /compute/v2.1/servers/22907549-9b26-45c5-8e09-779738f19a2e/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:19:33.032512 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fd2f21fa-41e0-406f-9257-98fd673fc0bc tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:33.033169 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fd2f21fa-41e0-406f-9257-98fd673fc0bc tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: 08afe605-c9f1-4d8b-98bc-9253414ebe56] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:33.043795 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fd2f21fa-41e0-406f-9257-98fd673fc0bc tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:33.044427 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fd2f21fa-41e0-406f-9257-98fd673fc0bc tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:33.044913 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fd2f21fa-41e0-406f-9257-98fd673fc0bc tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:33.045675 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fd2f21fa-41e0-406f-9257-98fd673fc0bc tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:33.046230 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fd2f21fa-41e0-406f-9257-98fd673fc0bc tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:33.047813 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fd2f21fa-41e0-406f-9257-98fd673fc0bc tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:33.244019 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=4 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:19:33.257264 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fd2f21fa-41e0-406f-9257-98fd673fc0bc tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:33.269610 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fd2f21fa-41e0-406f-9257-98fd673fc0bc tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56" status: 200 len: 1506 microversion: 2.1 time: 0.241331 Oct 23 01:19:33.270315 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1233/2485] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:33 2022] GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56 => generated 1506 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:33.292806 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9524a5c3-c3e9-4687-9177-a0e1dd5cc1dc tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:33.293687 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9524a5c3-c3e9-4687-9177-a0e1dd5cc1dc tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] [instance: afd593c3-d69a-4d5d-81b9-15a3138378ae] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:33.307686 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9524a5c3-c3e9-4687-9177-a0e1dd5cc1dc tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:33.309030 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9524a5c3-c3e9-4687-9177-a0e1dd5cc1dc tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:33.309842 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9524a5c3-c3e9-4687-9177-a0e1dd5cc1dc tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:33.310966 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9524a5c3-c3e9-4687-9177-a0e1dd5cc1dc tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:33.312246 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9524a5c3-c3e9-4687-9177-a0e1dd5cc1dc tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:33.325583 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9524a5c3-c3e9-4687-9177-a0e1dd5cc1dc tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:33.435380 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9524a5c3-c3e9-4687-9177-a0e1dd5cc1dc tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] [instance: afd593c3-d69a-4d5d-81b9-15a3138378ae] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:19:33.739200 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9524a5c3-c3e9-4687-9177-a0e1dd5cc1dc tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] 10.222.0.42 "DELETE /compute/v2.1/servers/afd593c3-d69a-4d5d-81b9-15a3138378ae" status: 204 len: 0 microversion: 2.1 time: 0.467302 Oct 23 01:19:33.740810 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1234/2486] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:19:33 2022] DELETE /compute/v2.1/servers/afd593c3-d69a-4d5d-81b9-15a3138378ae => generated 0 bytes in 470 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:19:33.748465 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d6396912-3ddc-4d3a-bb6f-955259d2888d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:33.752118 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d6396912-3ddc-4d3a-bb6f-955259d2888d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:33.770471 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d6396912-3ddc-4d3a-bb6f-955259d2888d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:33.771604 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d6396912-3ddc-4d3a-bb6f-955259d2888d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:33.772274 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d6396912-3ddc-4d3a-bb6f-955259d2888d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:33.774441 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d6396912-3ddc-4d3a-bb6f-955259d2888d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:33.776069 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d6396912-3ddc-4d3a-bb6f-955259d2888d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:33.776702 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d6396912-3ddc-4d3a-bb6f-955259d2888d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:34.257102 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=16 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:19:34.274986 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d6396912-3ddc-4d3a-bb6f-955259d2888d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:34.283399 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d6396912-3ddc-4d3a-bb6f-955259d2888d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.541002 Oct 23 01:19:34.284302 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1235/2487] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:33 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:34.289963 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-09f5ca27-f3f3-44a9-aeab-f8102cfdb472 req-ca035f81-2970-4e3b-884a-12e0dcb6010a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fb6c2f7-737b-4b87-9f6b-58ba7f12e428", "name": "network-vif-plugged", "status": "completed", "tag": "810f70db-7bee-41b2-9290-606e5cf23885"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:34.301743 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-09f5ca27-f3f3-44a9-aeab-f8102cfdb472 req-ca035f81-2970-4e3b-884a-12e0dcb6010a service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:34.302624 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-09f5ca27-f3f3-44a9-aeab-f8102cfdb472 req-ca035f81-2970-4e3b-884a-12e0dcb6010a service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:34.303083 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-09f5ca27-f3f3-44a9-aeab-f8102cfdb472 req-ca035f81-2970-4e3b-884a-12e0dcb6010a service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:34.330282 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-09f5ca27-f3f3-44a9-aeab-f8102cfdb472 req-ca035f81-2970-4e3b-884a-12e0dcb6010a service nova] Creating event network-vif-plugged:810f70db-7bee-41b2-9290-606e5cf23885 for instance 8fb6c2f7-737b-4b87-9f6b-58ba7f12e428 on n-h2-master-1 Oct 23 01:19:34.335523 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-09f5ca27-f3f3-44a9-aeab-f8102cfdb472 req-ca035f81-2970-4e3b-884a-12e0dcb6010a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049896 Oct 23 01:19:34.339331 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1236/2488] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:19:34.346007 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dd4f04ea-1d68-43f7-b5f6-9a76fe1eb307 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:34.346742 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-dd4f04ea-1d68-43f7-b5f6-9a76fe1eb307 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 6ccfe45d-f080-4066-9aad-a39c3c4cd097] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:34.354576 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd4f04ea-1d68-43f7-b5f6-9a76fe1eb307 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:34.355088 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd4f04ea-1d68-43f7-b5f6-9a76fe1eb307 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:34.356054 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd4f04ea-1d68-43f7-b5f6-9a76fe1eb307 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:34.356788 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd4f04ea-1d68-43f7-b5f6-9a76fe1eb307 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:34.357253 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd4f04ea-1d68-43f7-b5f6-9a76fe1eb307 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:34.357685 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd4f04ea-1d68-43f7-b5f6-9a76fe1eb307 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:34.692304 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-dd4f04ea-1d68-43f7-b5f6-9a76fe1eb307 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:34.701777 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-dd4f04ea-1d68-43f7-b5f6-9a76fe1eb307 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097" status: 200 len: 1317 microversion: 2.1 time: 0.362995 Oct 23 01:19:34.713663 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1237/2489] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:34 2022] GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097 => generated 1317 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:34.720115 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c0176352-b1a6-49a3-a8b0-7283eac558d4 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:34.720795 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c0176352-b1a6-49a3-a8b0-7283eac558d4 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] [instance: afd593c3-d69a-4d5d-81b9-15a3138378ae] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:34.727747 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c0176352-b1a6-49a3-a8b0-7283eac558d4 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:34.728351 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c0176352-b1a6-49a3-a8b0-7283eac558d4 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:34.728788 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c0176352-b1a6-49a3-a8b0-7283eac558d4 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:34.729489 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c0176352-b1a6-49a3-a8b0-7283eac558d4 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:34.729945 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c0176352-b1a6-49a3-a8b0-7283eac558d4 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:34.730419 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c0176352-b1a6-49a3-a8b0-7283eac558d4 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:34.989447 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c0176352-b1a6-49a3-a8b0-7283eac558d4 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8417cd8a252c4d3c9f2059c42bc82aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdabdb037d54103a656623e2c4c4a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:34.997205 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c0176352-b1a6-49a3-a8b0-7283eac558d4 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] 10.222.0.42 "GET /compute/v2.1/servers/afd593c3-d69a-4d5d-81b9-15a3138378ae" status: 200 len: 1477 microversion: 2.1 time: 0.282101 Oct 23 01:19:35.002415 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1238/2490] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:34 2022] GET /compute/v2.1/servers/afd593c3-d69a-4d5d-81b9-15a3138378ae => generated 1477 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:35.010560 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bfcc124f-82be-471e-8c10-276d1891c2dd tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:35.011857 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bfcc124f-82be-471e-8c10-276d1891c2dd tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 8fb6c2f7-737b-4b87-9f6b-58ba7f12e428] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:35.024721 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bfcc124f-82be-471e-8c10-276d1891c2dd tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:35.025243 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bfcc124f-82be-471e-8c10-276d1891c2dd tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:35.025669 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bfcc124f-82be-471e-8c10-276d1891c2dd tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:35.028631 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bfcc124f-82be-471e-8c10-276d1891c2dd tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:35.028631 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bfcc124f-82be-471e-8c10-276d1891c2dd tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:35.028631 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bfcc124f-82be-471e-8c10-276d1891c2dd tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:35.289858 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-139d213e-c85e-4267-85f4-631980424d13 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b/action" status: 202 len: 0 microversion: 2.25 time: 4.197235 Oct 23 01:19:35.291206 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1253/2491] 10.222.0.42 () {62 vars in 1319 bytes} [Sun Oct 23 01:19:31 2022] POST /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b/action => generated 0 bytes in 4199 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:19:35.298303 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3a9b45a5-ea8c-4e93-a707-513db7087e53 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:35.299635 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3a9b45a5-ea8c-4e93-a707-513db7087e53 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: 08afe605-c9f1-4d8b-98bc-9253414ebe56] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:35.320568 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3a9b45a5-ea8c-4e93-a707-513db7087e53 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:35.321066 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3a9b45a5-ea8c-4e93-a707-513db7087e53 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:35.321494 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3a9b45a5-ea8c-4e93-a707-513db7087e53 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:35.322397 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3a9b45a5-ea8c-4e93-a707-513db7087e53 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:35.324503 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3a9b45a5-ea8c-4e93-a707-513db7087e53 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:35.325103 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3a9b45a5-ea8c-4e93-a707-513db7087e53 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:35.371767 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bfcc124f-82be-471e-8c10-276d1891c2dd tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:35.390625 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bfcc124f-82be-471e-8c10-276d1891c2dd tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/8fb6c2f7-737b-4b87-9f6b-58ba7f12e428" status: 200 len: 1307 microversion: 2.1 time: 0.386525 Oct 23 01:19:35.392122 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1239/2492] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:35 2022] GET /compute/v2.1/servers/8fb6c2f7-737b-4b87-9f6b-58ba7f12e428 => generated 1307 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:35.396712 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7507c47d-73de-4941-9aaa-cb0670d7d357 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:35.397319 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7507c47d-73de-4941-9aaa-cb0670d7d357 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:35.408927 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7507c47d-73de-4941-9aaa-cb0670d7d357 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:35.409720 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7507c47d-73de-4941-9aaa-cb0670d7d357 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:35.410635 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7507c47d-73de-4941-9aaa-cb0670d7d357 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:35.411710 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7507c47d-73de-4941-9aaa-cb0670d7d357 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:35.412344 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7507c47d-73de-4941-9aaa-cb0670d7d357 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:35.412943 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7507c47d-73de-4941-9aaa-cb0670d7d357 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:35.752183 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3a9b45a5-ea8c-4e93-a707-513db7087e53 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:35.752472 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7507c47d-73de-4941-9aaa-cb0670d7d357 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:35.778980 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7507c47d-73de-4941-9aaa-cb0670d7d357 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.385720 Oct 23 01:19:35.779415 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3a9b45a5-ea8c-4e93-a707-513db7087e53 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56" status: 200 len: 1506 microversion: 2.1 time: 0.485812 Oct 23 01:19:35.780343 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1240/2493] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:35 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:35.794601 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1254/2494] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:35 2022] GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56 => generated 1506 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:35.806151 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-89778ea2-a166-4547-bd86-5d6b2263fc8b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:35.808164 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-89778ea2-a166-4547-bd86-5d6b2263fc8b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 6ccfe45d-f080-4066-9aad-a39c3c4cd097] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:35.811197 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-085f13a7-294f-4871-b6ea-f4c84b370656 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:35.812626 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-085f13a7-294f-4871-b6ea-f4c84b370656 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:35.820244 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-085f13a7-294f-4871-b6ea-f4c84b370656 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:35.820744 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-085f13a7-294f-4871-b6ea-f4c84b370656 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:35.821726 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-085f13a7-294f-4871-b6ea-f4c84b370656 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:35.822456 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-085f13a7-294f-4871-b6ea-f4c84b370656 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:35.823075 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-085f13a7-294f-4871-b6ea-f4c84b370656 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:35.823650 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-085f13a7-294f-4871-b6ea-f4c84b370656 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:35.826696 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-89778ea2-a166-4547-bd86-5d6b2263fc8b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:35.829043 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-89778ea2-a166-4547-bd86-5d6b2263fc8b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:35.830678 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-89778ea2-a166-4547-bd86-5d6b2263fc8b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:35.835450 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-89778ea2-a166-4547-bd86-5d6b2263fc8b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:35.848747 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-89778ea2-a166-4547-bd86-5d6b2263fc8b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:35.849958 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-89778ea2-a166-4547-bd86-5d6b2263fc8b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:36.152781 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-085f13a7-294f-4871-b6ea-f4c84b370656 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:36.160030 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-89778ea2-a166-4547-bd86-5d6b2263fc8b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:36.179457 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-085f13a7-294f-4871-b6ea-f4c84b370656 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:36.182386 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-89778ea2-a166-4547-bd86-5d6b2263fc8b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097" status: 200 len: 1317 microversion: 2.1 time: 0.382469 Oct 23 01:19:36.192112 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1255/2495] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:35 2022] GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097 => generated 1317 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:36.193034 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-085f13a7-294f-4871-b6ea-f4c84b370656 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:36.194316 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-085f13a7-294f-4871-b6ea-f4c84b370656 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b" status: 200 len: 1486 microversion: 2.25 time: 0.393793 Oct 23 01:19:36.195319 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1241/2496] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:19:35 2022] GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b => generated 1486 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:19:36.201340 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a43ec45b-6c1c-4786-b92e-df09e83029f6 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:36.202330 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a43ec45b-6c1c-4786-b92e-df09e83029f6 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] [instance: afd593c3-d69a-4d5d-81b9-15a3138378ae] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:36.203950 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4354c335-c54e-4168-a434-4285120f3fdf tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:36.204845 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4354c335-c54e-4168-a434-4285120f3fdf tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 05bc6340-82c0-46e1-9043-53569bbf40bd] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:36.209787 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a43ec45b-6c1c-4786-b92e-df09e83029f6 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:36.210516 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a43ec45b-6c1c-4786-b92e-df09e83029f6 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:36.211112 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a43ec45b-6c1c-4786-b92e-df09e83029f6 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:36.212008 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-4354c335-c54e-4168-a434-4285120f3fdf tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] HTTP exception thrown: Instance 05bc6340-82c0-46e1-9043-53569bbf40bd could not be found. Oct 23 01:19:36.212225 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a43ec45b-6c1c-4786-b92e-df09e83029f6 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:36.212832 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a43ec45b-6c1c-4786-b92e-df09e83029f6 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:36.213430 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a43ec45b-6c1c-4786-b92e-df09e83029f6 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4354c335-c54e-4168-a434-4285120f3fdf tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Request method failure captured: Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/05bc6340-82c0-46e1-9043-53569bbf40bd HTTP/1.1 Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJZEAurAeILsYJek3MCv_ryiTbidOLVZq6W4I7jJxeY_1_bTWRye2xM3EDOhowd_NyioevvIvzT9beBCgKqri_ZjLw9hdsIISMXmajO_VmobATT_GwpY_Y-GVylQtV9MoF1-Bup_Ahjld_2riQHnDzqLUWULm2acZYcK9UIbslVsdDU Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}] Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: cd6a6c5240f94ace91e1f0ed3e53fa7c Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 05bc6340-82c0-46e1-9043-53569bbf40bd could not be found. Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '05bc6340-82c0-46e1-9043-53569bbf40bd'} Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05bc6340-82c0-46e1-9043-53569bbf40bd could not be found. Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05bc6340-82c0-46e1-9043-53569bbf40bd could not be found. Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:36.214114 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:36.217799 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:36.217799 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:19:36.217799 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:19:36.217799 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05bc6340-82c0-46e1-9043-53569bbf40bd could not be found. Oct 23 01:19:36.217799 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:36.217799 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4354c335-c54e-4168-a434-4285120f3fdf tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Returning 404 to user: Instance 05bc6340-82c0-46e1-9043-53569bbf40bd could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:19:36.217799 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4354c335-c54e-4168-a434-4285120f3fdf tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/05bc6340-82c0-46e1-9043-53569bbf40bd" status: 404 len: 111 microversion: 2.1 time: 0.021710 Oct 23 01:19:36.217799 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1256/2497] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:36 2022] GET /compute/v2.1/servers/05bc6340-82c0-46e1-9043-53569bbf40bd => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:19:36.227234 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-40d0aa12-ad6f-47f7-a321-657cf59353aa tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:36.235601 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-40d0aa12-ad6f-47f7-a321-657cf59353aa tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:36.241022 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-40d0aa12-ad6f-47f7-a321-657cf59353aa tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:36.242490 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-40d0aa12-ad6f-47f7-a321-657cf59353aa tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:36.243116 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-40d0aa12-ad6f-47f7-a321-657cf59353aa tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:36.244130 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-40d0aa12-ad6f-47f7-a321-657cf59353aa tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:36.244781 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-40d0aa12-ad6f-47f7-a321-657cf59353aa tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:36.245395 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-40d0aa12-ad6f-47f7-a321-657cf59353aa tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:36.524121 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-40d0aa12-ad6f-47f7-a321-657cf59353aa tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:36.550433 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a43ec45b-6c1c-4786-b92e-df09e83029f6 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8417cd8a252c4d3c9f2059c42bc82aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdabdb037d54103a656623e2c4c4a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:36.551115 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-40d0aa12-ad6f-47f7-a321-657cf59353aa tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.320537 Oct 23 01:19:36.551115 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1257/2498] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:36 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:36.551243 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a43ec45b-6c1c-4786-b92e-df09e83029f6 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] 10.222.0.42 "GET /compute/v2.1/servers/afd593c3-d69a-4d5d-81b9-15a3138378ae" status: 200 len: 1477 microversion: 2.1 time: 0.352242 Oct 23 01:19:36.551243 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1242/2499] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:36 2022] GET /compute/v2.1/servers/afd593c3-d69a-4d5d-81b9-15a3138378ae => generated 1477 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:36.573954 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5f2db151-8d8f-4a63-99c2-f21ac8f83c4d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:36.573954 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5f2db151-8d8f-4a63-99c2-f21ac8f83c4d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 8fb6c2f7-737b-4b87-9f6b-58ba7f12e428] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:36.574130 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c6ded15c-977c-41b3-97f4-c6d7d4cafc3f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:36.574130 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c6ded15c-977c-41b3-97f4-c6d7d4cafc3f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:36.576930 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5f2db151-8d8f-4a63-99c2-f21ac8f83c4d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:36.577489 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5f2db151-8d8f-4a63-99c2-f21ac8f83c4d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:36.578072 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5f2db151-8d8f-4a63-99c2-f21ac8f83c4d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:36.579372 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5f2db151-8d8f-4a63-99c2-f21ac8f83c4d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:36.580011 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5f2db151-8d8f-4a63-99c2-f21ac8f83c4d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:36.580518 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5f2db151-8d8f-4a63-99c2-f21ac8f83c4d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:36.580738 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c6ded15c-977c-41b3-97f4-c6d7d4cafc3f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:36.581564 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c6ded15c-977c-41b3-97f4-c6d7d4cafc3f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:36.583084 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c6ded15c-977c-41b3-97f4-c6d7d4cafc3f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:36.583805 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c6ded15c-977c-41b3-97f4-c6d7d4cafc3f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:36.584274 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c6ded15c-977c-41b3-97f4-c6d7d4cafc3f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:36.584704 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c6ded15c-977c-41b3-97f4-c6d7d4cafc3f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:36.814709 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c6ded15c-977c-41b3-97f4-c6d7d4cafc3f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:36.829243 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c6ded15c-977c-41b3-97f4-c6d7d4cafc3f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.261573 Oct 23 01:19:36.830380 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1243/2500] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:36 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:36.831426 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5f2db151-8d8f-4a63-99c2-f21ac8f83c4d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:36.841755 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5f2db151-8d8f-4a63-99c2-f21ac8f83c4d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/8fb6c2f7-737b-4b87-9f6b-58ba7f12e428" status: 200 len: 1307 microversion: 2.1 time: 0.294158 Oct 23 01:19:36.843059 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1258/2501] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:36 2022] GET /compute/v2.1/servers/8fb6c2f7-737b-4b87-9f6b-58ba7f12e428 => generated 1307 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:36.844427 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-909dadb7-3319-40a9-b8e0-c08705c3b60c tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:36.845058 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-909dadb7-3319-40a9-b8e0-c08705c3b60c tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: 08afe605-c9f1-4d8b-98bc-9253414ebe56] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:36.859777 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-909dadb7-3319-40a9-b8e0-c08705c3b60c tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:36.860279 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-909dadb7-3319-40a9-b8e0-c08705c3b60c tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:36.860975 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-909dadb7-3319-40a9-b8e0-c08705c3b60c tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:36.861913 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-909dadb7-3319-40a9-b8e0-c08705c3b60c tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:36.862908 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-909dadb7-3319-40a9-b8e0-c08705c3b60c tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:36.867427 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-909dadb7-3319-40a9-b8e0-c08705c3b60c tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:36.997887 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-f71ddf3e-e32c-4f62-b12c-68119c26978f req-34038dbe-e051-425a-827c-82dd80af59cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afd593c3-d69a-4d5d-81b9-15a3138378ae", "name": "network-vif-deleted", "tag": "a7673b25-a889-40db-99b7-4d011a472009"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:37.018975 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-f71ddf3e-e32c-4f62-b12c-68119c26978f req-34038dbe-e051-425a-827c-82dd80af59cb service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:37.019783 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-f71ddf3e-e32c-4f62-b12c-68119c26978f req-34038dbe-e051-425a-827c-82dd80af59cb service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:37.021463 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-f71ddf3e-e32c-4f62-b12c-68119c26978f req-34038dbe-e051-425a-827c-82dd80af59cb service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:37.044143 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-f71ddf3e-e32c-4f62-b12c-68119c26978f req-34038dbe-e051-425a-827c-82dd80af59cb service nova] Creating event network-vif-deleted:a7673b25-a889-40db-99b7-4d011a472009 for instance afd593c3-d69a-4d5d-81b9-15a3138378ae on n-h2-master-1 Oct 23 01:19:37.070615 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-f71ddf3e-e32c-4f62-b12c-68119c26978f req-34038dbe-e051-425a-827c-82dd80af59cb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080939 Oct 23 01:19:37.080260 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1259/2502] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:19:37.106629 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c1781e92-8184-49f2-986d-13bc08fdc793 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-254920593", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "06f4c921-9d2b-4ef6-806f-b77fdc508baa"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c1781e92-8184-49f2-986d-13bc08fdc793 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Request method failure captured: Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 237 Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJZEAurAeILsYJek3MCv_ryiTbidOLVZq6W4I7jJxeY_1_bTWRye2xM3EDOhowd_NyioevvIvzT9beBCgKqri_ZjLw9hdsIISMXmajO_VmobATT_GwpY_Y-GVylQtV9MoF1-Bup_Ahjld_2riQHnDzqLUWULm2acZYcK9UIbslVsdDU Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}] Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: cd6a6c5240f94ace91e1f0ed3e53fa7c Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-254920593", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "06f4c921-9d2b-4ef6-806f-b77fdc508baa"}]}} Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-254920593', 'imageRef': '446b40bc-db5b-4123-9278-997bd6d04a0d', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '06f4c921-9d2b-4ef6-806f-b77fdc508baa'}]}}} Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise error Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:37.135219 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:37.140479 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:37.140479 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:37.140479 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:19:37.140479 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:19:37.140479 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:19:37.140479 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:19:37.140479 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:19:37.140479 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:19:37.140479 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 23 01:19:37.140479 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 23 01:19:37.140479 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 23 01:19:37.140479 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 23 01:19:37.140479 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 23 01:19:37.140479 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 23 01:19:37.140479 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 23 01:19:37.140479 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:37.140479 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:37.140479 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:37.140479 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:37.140479 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:37.140479 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:37.140479 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 23 01:19:37.140479 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 23 01:19:37.140479 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 23 01:19:37.140479 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:37.140479 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c1781e92-8184-49f2-986d-13bc08fdc793 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:19:37.140479 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c1781e92-8184-49f2-986d-13bc08fdc793 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.042575 Oct 23 01:19:37.144839 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1260/2503] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:19:37 2022] POST /compute/v2.1/servers => generated 139 bytes in 64 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:19:37.155911 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c6168fe4-4692-4e36-87fc-62ffac187d0b tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:37.157848 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c6168fe4-4692-4e36-87fc-62ffac187d0b tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:37.163274 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-909dadb7-3319-40a9-b8e0-c08705c3b60c tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:37.172867 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-909dadb7-3319-40a9-b8e0-c08705c3b60c tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56" status: 200 len: 1506 microversion: 2.1 time: 0.341255 Oct 23 01:19:37.173461 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1244/2504] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:36 2022] GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56 => generated 1506 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:37.176194 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6168fe4-4692-4e36-87fc-62ffac187d0b tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:37.178166 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6168fe4-4692-4e36-87fc-62ffac187d0b tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:37.179438 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6168fe4-4692-4e36-87fc-62ffac187d0b tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:37.181376 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6168fe4-4692-4e36-87fc-62ffac187d0b tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:37.182497 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6168fe4-4692-4e36-87fc-62ffac187d0b tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:37.183651 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6168fe4-4692-4e36-87fc-62ffac187d0b tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:37.208342 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7054caef-f290-46ca-a0a6-24f27247b1d0 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:37.209160 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7054caef-f290-46ca-a0a6-24f27247b1d0 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 6ccfe45d-f080-4066-9aad-a39c3c4cd097] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:37.218590 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7054caef-f290-46ca-a0a6-24f27247b1d0 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:37.219928 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7054caef-f290-46ca-a0a6-24f27247b1d0 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:37.220581 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7054caef-f290-46ca-a0a6-24f27247b1d0 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:37.221838 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7054caef-f290-46ca-a0a6-24f27247b1d0 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:37.222517 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7054caef-f290-46ca-a0a6-24f27247b1d0 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:37.223129 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7054caef-f290-46ca-a0a6-24f27247b1d0 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:37.266486 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:19:37.561726 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c6168fe4-4692-4e36-87fc-62ffac187d0b tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:37.574033 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c6168fe4-4692-4e36-87fc-62ffac187d0b tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.424197 Oct 23 01:19:37.579240 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1261/2505] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:37 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:37.592540 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7054caef-f290-46ca-a0a6-24f27247b1d0 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:37.603543 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4285d38b-7d0c-4df1-a94b-2b9e5276df24 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:37.610187 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4285d38b-7d0c-4df1-a94b-2b9e5276df24 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:37.612593 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7054caef-f290-46ca-a0a6-24f27247b1d0 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097" status: 200 len: 1317 microversion: 2.1 time: 0.411056 Oct 23 01:19:37.627426 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1245/2506] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:37 2022] GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097 => generated 1317 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:19:37.645426 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4285d38b-7d0c-4df1-a94b-2b9e5276df24 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:37.647516 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d53bc324-a82a-43ba-9ada-bb2b319a3460 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:37.650009 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4285d38b-7d0c-4df1-a94b-2b9e5276df24 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:37.651039 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4285d38b-7d0c-4df1-a94b-2b9e5276df24 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:37.655652 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4285d38b-7d0c-4df1-a94b-2b9e5276df24 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:37.655652 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4285d38b-7d0c-4df1-a94b-2b9e5276df24 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:37.655652 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4285d38b-7d0c-4df1-a94b-2b9e5276df24 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:37.655993 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d53bc324-a82a-43ba-9ada-bb2b319a3460 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] [instance: afd593c3-d69a-4d5d-81b9-15a3138378ae] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:37.676163 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d53bc324-a82a-43ba-9ada-bb2b319a3460 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:37.678362 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d53bc324-a82a-43ba-9ada-bb2b319a3460 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:37.680345 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d53bc324-a82a-43ba-9ada-bb2b319a3460 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:37.681168 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d53bc324-a82a-43ba-9ada-bb2b319a3460 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:37.686459 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d53bc324-a82a-43ba-9ada-bb2b319a3460 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:37.690278 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d53bc324-a82a-43ba-9ada-bb2b319a3460 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:37.699454 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:19:37.773913 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d53bc324-a82a-43ba-9ada-bb2b319a3460 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:37.776320 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d53bc324-a82a-43ba-9ada-bb2b319a3460 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:37.777386 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d53bc324-a82a-43ba-9ada-bb2b319a3460 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:37.779849 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-d53bc324-a82a-43ba-9ada-bb2b319a3460 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lazy-loading 'fault' on Instance uuid afd593c3-d69a-4d5d-81b9-15a3138378ae {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:19:37.889019 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d53bc324-a82a-43ba-9ada-bb2b319a3460 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8417cd8a252c4d3c9f2059c42bc82aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdabdb037d54103a656623e2c4c4a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:37.898520 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d53bc324-a82a-43ba-9ada-bb2b319a3460 tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] 10.222.0.42 "GET /compute/v2.1/servers/afd593c3-d69a-4d5d-81b9-15a3138378ae" status: 200 len: 1311 microversion: 2.1 time: 0.269600 Oct 23 01:19:37.899802 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1246/2507] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:37 2022] GET /compute/v2.1/servers/afd593c3-d69a-4d5d-81b9-15a3138378ae => generated 1311 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:37.906270 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fa27fa90-1ab6-4465-a4f6-9a5e5f9a93a6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:37.907061 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fa27fa90-1ab6-4465-a4f6-9a5e5f9a93a6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:37.913939 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fa27fa90-1ab6-4465-a4f6-9a5e5f9a93a6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:37.914804 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fa27fa90-1ab6-4465-a4f6-9a5e5f9a93a6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:37.915454 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fa27fa90-1ab6-4465-a4f6-9a5e5f9a93a6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:37.916464 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fa27fa90-1ab6-4465-a4f6-9a5e5f9a93a6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:37.917123 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fa27fa90-1ab6-4465-a4f6-9a5e5f9a93a6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:37.917704 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fa27fa90-1ab6-4465-a4f6-9a5e5f9a93a6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:38.074111 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4285d38b-7d0c-4df1-a94b-2b9e5276df24 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:38.088454 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4285d38b-7d0c-4df1-a94b-2b9e5276df24 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:38.090460 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4285d38b-7d0c-4df1-a94b-2b9e5276df24 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:38.095208 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4285d38b-7d0c-4df1-a94b-2b9e5276df24 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b" status: 200 len: 1486 microversion: 2.25 time: 0.513422 Oct 23 01:19:38.096122 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1262/2508] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:19:37 2022] GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b => generated 1486 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:19:38.122276 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-17331fcc-e340-49fb-a4ed-78f2f2919feb tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:38.134539 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-17331fcc-e340-49fb-a4ed-78f2f2919feb tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 8fb6c2f7-737b-4b87-9f6b-58ba7f12e428] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:38.145154 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-17331fcc-e340-49fb-a4ed-78f2f2919feb tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:38.145154 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-17331fcc-e340-49fb-a4ed-78f2f2919feb tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:38.145791 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-17331fcc-e340-49fb-a4ed-78f2f2919feb tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:38.147194 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-17331fcc-e340-49fb-a4ed-78f2f2919feb tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:38.148165 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-17331fcc-e340-49fb-a4ed-78f2f2919feb tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:38.148807 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-17331fcc-e340-49fb-a4ed-78f2f2919feb tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:38.223050 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fa27fa90-1ab6-4465-a4f6-9a5e5f9a93a6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:38.232038 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fa27fa90-1ab6-4465-a4f6-9a5e5f9a93a6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.330995 Oct 23 01:19:38.233206 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1247/2509] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:37 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:38.239148 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0d347df8-b7f1-4541-bd49-dd4b22c22fd8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:38.239972 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0d347df8-b7f1-4541-bd49-dd4b22c22fd8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: 08afe605-c9f1-4d8b-98bc-9253414ebe56] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:38.247127 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0d347df8-b7f1-4541-bd49-dd4b22c22fd8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:38.247821 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0d347df8-b7f1-4541-bd49-dd4b22c22fd8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:38.248410 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0d347df8-b7f1-4541-bd49-dd4b22c22fd8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:38.249417 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0d347df8-b7f1-4541-bd49-dd4b22c22fd8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:38.250085 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0d347df8-b7f1-4541-bd49-dd4b22c22fd8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:38.251129 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0d347df8-b7f1-4541-bd49-dd4b22c22fd8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:38.457356 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-17331fcc-e340-49fb-a4ed-78f2f2919feb tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:38.468927 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-17331fcc-e340-49fb-a4ed-78f2f2919feb tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/8fb6c2f7-737b-4b87-9f6b-58ba7f12e428" status: 200 len: 1487 microversion: 2.1 time: 0.368174 Oct 23 01:19:38.469732 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1263/2510] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:38 2022] GET /compute/v2.1/servers/8fb6c2f7-737b-4b87-9f6b-58ba7f12e428 => generated 1487 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:38.474544 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8d210b26-c950-4ca8-898c-8e87caf8fae1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-453055034", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "06f4c921-9d2b-4ef6-806f-b77fdc508baa"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8d210b26-c950-4ca8-898c-8e87caf8fae1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Request method failure captured: Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 234 Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJZEAurAeILsYJek3MCv_ryiTbidOLVZq6W4I7jJxeY_1_bTWRye2xM3EDOhowd_NyioevvIvzT9beBCgKqri_ZjLw9hdsIISMXmajO_VmobATT_GwpY_Y-GVylQtV9MoF1-Bup_Ahjld_2riQHnDzqLUWULm2acZYcK9UIbslVsdDU Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}] Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: cd6a6c5240f94ace91e1f0ed3e53fa7c Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-453055034", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "06f4c921-9d2b-4ef6-806f-b77fdc508baa"}]}} Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-453055034', 'imageRef': '446b40bc-db5b-4123-9278-997bd6d04a0d', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '06f4c921-9d2b-4ef6-806f-b77fdc508baa'}]}}} Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise error Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:38.494519 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:38.498760 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:38.498760 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:38.498760 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:19:38.498760 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:19:38.498760 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:19:38.498760 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:19:38.498760 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:19:38.498760 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:19:38.498760 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 23 01:19:38.498760 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 23 01:19:38.498760 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 23 01:19:38.498760 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 23 01:19:38.498760 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 23 01:19:38.498760 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 23 01:19:38.498760 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 23 01:19:38.498760 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:38.498760 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:38.498760 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:38.498760 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:38.498760 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:38.498760 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:38.498760 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 23 01:19:38.498760 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 23 01:19:38.498760 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 23 01:19:38.498760 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:38.501564 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8d210b26-c950-4ca8-898c-8e87caf8fae1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:19:38.502600 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8d210b26-c950-4ca8-898c-8e87caf8fae1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.031764 Oct 23 01:19:38.503317 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1264/2511] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:19:38 2022] POST /compute/v2.1/servers => generated 133 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:19:38.508172 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e5a07636-78b0-41bb-b8dc-685a5c01ae2b tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:38.514771 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e5a07636-78b0-41bb-b8dc-685a5c01ae2b tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 8fb6c2f7-737b-4b87-9f6b-58ba7f12e428] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:38.524372 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e5a07636-78b0-41bb-b8dc-685a5c01ae2b tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:38.524372 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e5a07636-78b0-41bb-b8dc-685a5c01ae2b tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:38.524372 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e5a07636-78b0-41bb-b8dc-685a5c01ae2b tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:38.524372 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e5a07636-78b0-41bb-b8dc-685a5c01ae2b tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:38.524719 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e5a07636-78b0-41bb-b8dc-685a5c01ae2b tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:38.525070 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e5a07636-78b0-41bb-b8dc-685a5c01ae2b tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:38.553849 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-e5a07636-78b0-41bb-b8dc-685a5c01ae2b tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lazy-loading 'flavor' on Instance uuid 8fb6c2f7-737b-4b87-9f6b-58ba7f12e428 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:19:38.616772 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0d347df8-b7f1-4541-bd49-dd4b22c22fd8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:38.628315 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0d347df8-b7f1-4541-bd49-dd4b22c22fd8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56" status: 200 len: 1506 microversion: 2.1 time: 0.393694 Oct 23 01:19:38.641415 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1248/2512] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:38 2022] GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56 => generated 1506 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:38.654348 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6829ca3a-178b-4038-98c2-6b19713d9d35 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:38.655351 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6829ca3a-178b-4038-98c2-6b19713d9d35 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:38.664054 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6829ca3a-178b-4038-98c2-6b19713d9d35 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:38.665538 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6829ca3a-178b-4038-98c2-6b19713d9d35 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:38.666579 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6829ca3a-178b-4038-98c2-6b19713d9d35 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:38.667755 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6829ca3a-178b-4038-98c2-6b19713d9d35 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:38.668432 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6829ca3a-178b-4038-98c2-6b19713d9d35 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:38.669118 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6829ca3a-178b-4038-98c2-6b19713d9d35 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:38.904087 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e5a07636-78b0-41bb-b8dc-685a5c01ae2b tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "POST /compute/v2.1/servers/8fb6c2f7-737b-4b87-9f6b-58ba7f12e428/action" status: 202 len: 0 microversion: 2.1 time: 0.398832 Oct 23 01:19:38.905040 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1265/2513] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:19:38 2022] POST /compute/v2.1/servers/8fb6c2f7-737b-4b87-9f6b-58ba7f12e428/action => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:19:38.916175 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-407374f2-1b17-4b51-b0f9-f9b629eb6a00 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:38.925044 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-407374f2-1b17-4b51-b0f9-f9b629eb6a00 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 6ccfe45d-f080-4066-9aad-a39c3c4cd097] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:38.927609 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-407374f2-1b17-4b51-b0f9-f9b629eb6a00 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:38.927847 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6829ca3a-178b-4038-98c2-6b19713d9d35 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:38.928354 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-407374f2-1b17-4b51-b0f9-f9b629eb6a00 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:38.928847 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-407374f2-1b17-4b51-b0f9-f9b629eb6a00 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:38.929618 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-407374f2-1b17-4b51-b0f9-f9b629eb6a00 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:38.930218 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-407374f2-1b17-4b51-b0f9-f9b629eb6a00 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:38.930647 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-407374f2-1b17-4b51-b0f9-f9b629eb6a00 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:38.941659 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6829ca3a-178b-4038-98c2-6b19713d9d35 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.298256 Oct 23 01:19:38.954625 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1249/2514] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:38 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:38.960831 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-46de464a-f78e-464a-a1be-0a3a7fb2adf2 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:38.962159 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-46de464a-f78e-464a-a1be-0a3a7fb2adf2 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 8fb6c2f7-737b-4b87-9f6b-58ba7f12e428] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:38.973113 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46de464a-f78e-464a-a1be-0a3a7fb2adf2 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:38.973602 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46de464a-f78e-464a-a1be-0a3a7fb2adf2 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:38.974803 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46de464a-f78e-464a-a1be-0a3a7fb2adf2 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:38.975678 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46de464a-f78e-464a-a1be-0a3a7fb2adf2 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:38.976511 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46de464a-f78e-464a-a1be-0a3a7fb2adf2 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:38.977138 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46de464a-f78e-464a-a1be-0a3a7fb2adf2 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:39.253453 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-407374f2-1b17-4b51-b0f9-f9b629eb6a00 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:39.265096 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-407374f2-1b17-4b51-b0f9-f9b629eb6a00 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097" status: 200 len: 1317 microversion: 2.1 time: 0.358525 Oct 23 01:19:39.268002 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1266/2515] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:38 2022] GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097 => generated 1317 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:39.286787 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-29f45cc0-e159-4b70-ba41-a5ad83f0b86a tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:39.288227 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-29f45cc0-e159-4b70-ba41-a5ad83f0b86a tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] [instance: afd593c3-d69a-4d5d-81b9-15a3138378ae] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:39.296429 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-29f45cc0-e159-4b70-ba41-a5ad83f0b86a tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:39.297154 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-29f45cc0-e159-4b70-ba41-a5ad83f0b86a tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:39.297585 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-29f45cc0-e159-4b70-ba41-a5ad83f0b86a tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:39.298464 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-29f45cc0-e159-4b70-ba41-a5ad83f0b86a tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:39.299068 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-29f45cc0-e159-4b70-ba41-a5ad83f0b86a tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:39.299643 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-29f45cc0-e159-4b70-ba41-a5ad83f0b86a tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:39.314742 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-29f45cc0-e159-4b70-ba41-a5ad83f0b86a tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] HTTP exception thrown: Instance afd593c3-d69a-4d5d-81b9-15a3138378ae could not be found. Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-29f45cc0-e159-4b70-ba41-a5ad83f0b86a tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Request method failure captured: Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/afd593c3-d69a-4d5d-81b9-15a3138378ae HTTP/1.1 Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJZmoo6H9FGf873Bz4OUc4aTR0L1ZQ0jT8z94IbEkAbGzpfAdIfPFlU4MYldtKIKQhKSiHku16Abu_FD8LKFMVeaXmRmVExNemvGumyjuOMd5iGRbXUrJbK8OemwZk7szfQr0NS7dBwstK0BRTytzcp3YpkJarR2s_KTG2VO_I7DyOw Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: bcdabdb037d54103a656623e2c4c4a78 Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-283834885 Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bcdabdb037d54103a656623e2c4c4a78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bcdabdb037d54103a656623e2c4c4a78"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bcdabdb037d54103a656623e2c4c4a78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bcdabdb037d54103a656623e2c4c4a78"}]}] Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServersAdminNegativeTestJSON-283834885 Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: bcdabdb037d54103a656623e2c4c4a78 Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-283834885 Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServersAdminNegativeTestJSON-283834885-project Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 8417cd8a252c4d3c9f2059c42bc82aa0 Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServersAdminNegativeTestJSON-283834885-project Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: exception: Instance afd593c3-d69a-4d5d-81b9-15a3138378ae could not be found. Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'afd593c3-d69a-4d5d-81b9-15a3138378ae'} Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afd593c3-d69a-4d5d-81b9-15a3138378ae could not be found. Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afd593c3-d69a-4d5d-81b9-15a3138378ae could not be found. Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:39.316926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:39.321520 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:39.321520 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:39.321520 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:39.321520 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:39.321520 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:19:39.321520 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:19:39.321520 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afd593c3-d69a-4d5d-81b9-15a3138378ae could not be found. Oct 23 01:19:39.321520 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:39.323240 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-29f45cc0-e159-4b70-ba41-a5ad83f0b86a tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] Returning 404 to user: Instance afd593c3-d69a-4d5d-81b9-15a3138378ae could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:19:39.324435 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-29f45cc0-e159-4b70-ba41-a5ad83f0b86a tempest-ServersAdminNegativeTestJSON-283834885 tempest-ServersAdminNegativeTestJSON-283834885-project] 10.222.0.42 "GET /compute/v2.1/servers/afd593c3-d69a-4d5d-81b9-15a3138378ae" status: 404 len: 111 microversion: 2.1 time: 0.055238 Oct 23 01:19:39.325739 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1267/2516] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:39 2022] GET /compute/v2.1/servers/afd593c3-d69a-4d5d-81b9-15a3138378ae => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:19:39.332080 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-073a1e96-33ee-4138-b3d4-dc8524696bc0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:39.332898 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-073a1e96-33ee-4138-b3d4-dc8524696bc0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:39.340815 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-073a1e96-33ee-4138-b3d4-dc8524696bc0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:39.341720 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-073a1e96-33ee-4138-b3d4-dc8524696bc0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:39.342446 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-073a1e96-33ee-4138-b3d4-dc8524696bc0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:39.343678 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-073a1e96-33ee-4138-b3d4-dc8524696bc0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:39.344923 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-073a1e96-33ee-4138-b3d4-dc8524696bc0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:39.346222 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-073a1e96-33ee-4138-b3d4-dc8524696bc0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:39.346476 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-46de464a-f78e-464a-a1be-0a3a7fb2adf2 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:39.362270 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-46de464a-f78e-464a-a1be-0a3a7fb2adf2 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/8fb6c2f7-737b-4b87-9f6b-58ba7f12e428" status: 200 len: 1495 microversion: 2.1 time: 0.401290 Oct 23 01:19:39.362974 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1250/2517] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:38 2022] GET /compute/v2.1/servers/8fb6c2f7-737b-4b87-9f6b-58ba7f12e428 => generated 1495 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:39.372567 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f37f6c0f-de07-4cdd-94a2-7d6f777b31d8 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:39.373179 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f37f6c0f-de07-4cdd-94a2-7d6f777b31d8 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:39.416201 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f37f6c0f-de07-4cdd-94a2-7d6f777b31d8 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:39.418664 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f37f6c0f-de07-4cdd-94a2-7d6f777b31d8 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:39.421252 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f37f6c0f-de07-4cdd-94a2-7d6f777b31d8 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:39.424980 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f37f6c0f-de07-4cdd-94a2-7d6f777b31d8 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:39.426553 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f37f6c0f-de07-4cdd-94a2-7d6f777b31d8 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:39.431199 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f37f6c0f-de07-4cdd-94a2-7d6f777b31d8 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:39.726898 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-073a1e96-33ee-4138-b3d4-dc8524696bc0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:39.739088 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-073a1e96-33ee-4138-b3d4-dc8524696bc0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.411705 Oct 23 01:19:39.742254 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1268/2518] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:39 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:39.765328 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-7a51d1f6-55ff-4684-8908-f2088e6821f7 req-54f25eb5-3c87-4bc6-88c0-0e04a3d1de79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ccfe45d-f080-4066-9aad-a39c3c4cd097", "name": "network-vif-plugged", "status": "completed", "tag": "fce18087-d670-4b69-9cc5-11b42a9fa6de"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:39.795103 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-7a51d1f6-55ff-4684-8908-f2088e6821f7 req-54f25eb5-3c87-4bc6-88c0-0e04a3d1de79 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:39.805920 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-7a51d1f6-55ff-4684-8908-f2088e6821f7 req-54f25eb5-3c87-4bc6-88c0-0e04a3d1de79 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:39.806576 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-7a51d1f6-55ff-4684-8908-f2088e6821f7 req-54f25eb5-3c87-4bc6-88c0-0e04a3d1de79 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:39.829089 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-7a51d1f6-55ff-4684-8908-f2088e6821f7 req-54f25eb5-3c87-4bc6-88c0-0e04a3d1de79 service nova] Creating event network-vif-plugged:fce18087-d670-4b69-9cc5-11b42a9fa6de for instance 6ccfe45d-f080-4066-9aad-a39c3c4cd097 on n-h1-master-1 Oct 23 01:19:39.844995 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-7a51d1f6-55ff-4684-8908-f2088e6821f7 req-54f25eb5-3c87-4bc6-88c0-0e04a3d1de79 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099161 Oct 23 01:19:39.845537 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1269/2519] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:19:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:19:39.851151 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-df9d446b-dff5-41a9-9b5b-e2351711ad93 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:39.856009 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-df9d446b-dff5-41a9-9b5b-e2351711ad93 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: 08afe605-c9f1-4d8b-98bc-9253414ebe56] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:39.867486 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-df9d446b-dff5-41a9-9b5b-e2351711ad93 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:39.871832 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-df9d446b-dff5-41a9-9b5b-e2351711ad93 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:39.872491 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-df9d446b-dff5-41a9-9b5b-e2351711ad93 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:39.873438 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-df9d446b-dff5-41a9-9b5b-e2351711ad93 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:39.874075 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-df9d446b-dff5-41a9-9b5b-e2351711ad93 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:39.878986 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-df9d446b-dff5-41a9-9b5b-e2351711ad93 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:39.894668 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f37f6c0f-de07-4cdd-94a2-7d6f777b31d8 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:39.916249 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f37f6c0f-de07-4cdd-94a2-7d6f777b31d8 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:39.932137 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f37f6c0f-de07-4cdd-94a2-7d6f777b31d8 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:39.941606 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f37f6c0f-de07-4cdd-94a2-7d6f777b31d8 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b" status: 200 len: 1486 microversion: 2.25 time: 0.574849 Oct 23 01:19:39.963924 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1251/2520] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:19:39 2022] GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b => generated 1486 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:19:39.983390 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5251067e-9fe6-4b77-98de-babe67347330 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:39.984398 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5251067e-9fe6-4b77-98de-babe67347330 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 9d861686-a610-45df-ac55-df5a41425d71] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:40.000633 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-5251067e-9fe6-4b77-98de-babe67347330 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] HTTP exception thrown: Instance 9d861686-a610-45df-ac55-df5a41425d71 could not be found. Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5251067e-9fe6-4b77-98de-babe67347330 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Request method failure captured: Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/servers/9d861686-a610-45df-ac55-df5a41425d71/action HTTP/1.1 Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 13 Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJZEAurAeILsYJek3MCv_ryiTbidOLVZq6W4I7jJxeY_1_bTWRye2xM3EDOhowd_NyioevvIvzT9beBCgKqri_ZjLw9hdsIISMXmajO_VmobATT_GwpY_Y-GVylQtV9MoF1-Bup_Ahjld_2riQHnDzqLUWULm2acZYcK9UIbslVsdDU Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}] Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: cd6a6c5240f94ace91e1f0ed3e53fa7c Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: {"pause": {}} Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 9d861686-a610-45df-ac55-df5a41425d71 could not be found. Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '9d861686-a610-45df-ac55-df5a41425d71', 'body': {'pause': {}}} Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d861686-a610-45df-ac55-df5a41425d71 could not be found. Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d861686-a610-45df-ac55-df5a41425d71 could not be found. Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:40.011335 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:40.017352 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:19:40.017352 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:19:40.017352 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d861686-a610-45df-ac55-df5a41425d71 could not be found. Oct 23 01:19:40.017352 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:40.017352 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5251067e-9fe6-4b77-98de-babe67347330 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Returning 404 to user: Instance 9d861686-a610-45df-ac55-df5a41425d71 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:19:40.017352 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5251067e-9fe6-4b77-98de-babe67347330 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "POST /compute/v2.1/servers/9d861686-a610-45df-ac55-df5a41425d71/action" status: 404 len: 111 microversion: 2.1 time: 0.044041 Oct 23 01:19:40.022064 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1252/2521] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:19:39 2022] POST /compute/v2.1/servers/9d861686-a610-45df-ac55-df5a41425d71/action => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:19:40.026443 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-baf02777-5eff-4ee1-afc2-408b08ba4250 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:40.027072 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-baf02777-5eff-4ee1-afc2-408b08ba4250 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:40.043317 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:19:40.048333 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-baf02777-5eff-4ee1-afc2-408b08ba4250 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:40.048833 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-baf02777-5eff-4ee1-afc2-408b08ba4250 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:40.049280 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-baf02777-5eff-4ee1-afc2-408b08ba4250 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:40.050130 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-baf02777-5eff-4ee1-afc2-408b08ba4250 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:40.050761 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-baf02777-5eff-4ee1-afc2-408b08ba4250 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:40.051153 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-baf02777-5eff-4ee1-afc2-408b08ba4250 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:40.227270 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-df9d446b-dff5-41a9-9b5b-e2351711ad93 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:40.241606 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-baf02777-5eff-4ee1-afc2-408b08ba4250 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:40.245255 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-df9d446b-dff5-41a9-9b5b-e2351711ad93 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56" status: 200 len: 1506 microversion: 2.1 time: 0.398139 Oct 23 01:19:40.250952 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1270/2522] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:39 2022] GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56 => generated 1506 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:40.254313 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-baf02777-5eff-4ee1-afc2-408b08ba4250 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.231704 Oct 23 01:19:40.256332 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1253/2523] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:40 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:19:40.287233 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-35662ef8-6174-4d45-8025-3f5540f06a4a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:40.287962 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-35662ef8-6174-4d45-8025-3f5540f06a4a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:40.290394 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-78750962-2e7d-4b44-bae1-2c1473158ed6 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:40.291080 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-78750962-2e7d-4b44-bae1-2c1473158ed6 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 6ccfe45d-f080-4066-9aad-a39c3c4cd097] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:40.303088 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-78750962-2e7d-4b44-bae1-2c1473158ed6 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:40.303568 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-35662ef8-6174-4d45-8025-3f5540f06a4a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:40.304106 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-78750962-2e7d-4b44-bae1-2c1473158ed6 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:40.304225 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-35662ef8-6174-4d45-8025-3f5540f06a4a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:40.304893 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-35662ef8-6174-4d45-8025-3f5540f06a4a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:40.305214 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-78750962-2e7d-4b44-bae1-2c1473158ed6 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:40.305753 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-35662ef8-6174-4d45-8025-3f5540f06a4a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:40.306387 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-35662ef8-6174-4d45-8025-3f5540f06a4a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:40.306570 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-78750962-2e7d-4b44-bae1-2c1473158ed6 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:40.307005 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-35662ef8-6174-4d45-8025-3f5540f06a4a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:40.307431 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-78750962-2e7d-4b44-bae1-2c1473158ed6 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:40.308000 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-78750962-2e7d-4b44-bae1-2c1473158ed6 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:40.555142 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-78750962-2e7d-4b44-bae1-2c1473158ed6 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:40.567231 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-78750962-2e7d-4b44-bae1-2c1473158ed6 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097" status: 200 len: 1317 microversion: 2.1 time: 0.281477 Oct 23 01:19:40.569053 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1254/2524] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:40 2022] GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097 => generated 1317 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:19:40.574530 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f9e06b15-e3c9-4923-bfc6-4b838b2e34cd tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:40.575331 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f9e06b15-e3c9-4923-bfc6-4b838b2e34cd tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 8fb6c2f7-737b-4b87-9f6b-58ba7f12e428] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:40.604019 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f9e06b15-e3c9-4923-bfc6-4b838b2e34cd tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:40.604757 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f9e06b15-e3c9-4923-bfc6-4b838b2e34cd tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:40.605375 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f9e06b15-e3c9-4923-bfc6-4b838b2e34cd tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:40.606454 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f9e06b15-e3c9-4923-bfc6-4b838b2e34cd tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:40.607872 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f9e06b15-e3c9-4923-bfc6-4b838b2e34cd tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:40.608954 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f9e06b15-e3c9-4923-bfc6-4b838b2e34cd tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:40.775695 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-35662ef8-6174-4d45-8025-3f5540f06a4a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:40.785487 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-35662ef8-6174-4d45-8025-3f5540f06a4a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.503120 Oct 23 01:19:40.786461 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1271/2525] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:40 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:40.812930 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3510cb13-6544-441b-a970-85dfc76722e7 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:40.813651 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3510cb13-6544-441b-a970-85dfc76722e7 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:40.824812 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3510cb13-6544-441b-a970-85dfc76722e7 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:40.825677 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3510cb13-6544-441b-a970-85dfc76722e7 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:40.826290 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3510cb13-6544-441b-a970-85dfc76722e7 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:40.827272 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3510cb13-6544-441b-a970-85dfc76722e7 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:40.834810 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3510cb13-6544-441b-a970-85dfc76722e7 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:40.835260 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3510cb13-6544-441b-a970-85dfc76722e7 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:40.916181 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f9e06b15-e3c9-4923-bfc6-4b838b2e34cd tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:40.927492 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f9e06b15-e3c9-4923-bfc6-4b838b2e34cd tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/8fb6c2f7-737b-4b87-9f6b-58ba7f12e428" status: 200 len: 1478 microversion: 2.1 time: 0.356846 Oct 23 01:19:40.929745 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1255/2526] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:40 2022] GET /compute/v2.1/servers/8fb6c2f7-737b-4b87-9f6b-58ba7f12e428 => generated 1478 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:40.955131 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-743c6f3a-6d1c-40b5-9bfc-ddf1adddcf3f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-364279240"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:40.957399 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-743c6f3a-6d1c-40b5-9bfc-ddf1adddcf3f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 8fb6c2f7-737b-4b87-9f6b-58ba7f12e428] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:40.971615 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-743c6f3a-6d1c-40b5-9bfc-ddf1adddcf3f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:40.972707 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-743c6f3a-6d1c-40b5-9bfc-ddf1adddcf3f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:40.973427 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-743c6f3a-6d1c-40b5-9bfc-ddf1adddcf3f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:40.974449 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-743c6f3a-6d1c-40b5-9bfc-ddf1adddcf3f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:40.975274 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-743c6f3a-6d1c-40b5-9bfc-ddf1adddcf3f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:40.976077 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-743c6f3a-6d1c-40b5-9bfc-ddf1adddcf3f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:41.056690 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3510cb13-6544-441b-a970-85dfc76722e7 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "POST /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335/action" status: 202 len: 0 microversion: 2.1 time: 0.248109 Oct 23 01:19:41.057587 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1272/2527] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:19:40 2022] POST /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 23 01:19:41.060476 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:19:41.068763 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a3d04ead-69fc-4e5f-a5b2-3418ac6ce9d7 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:41.069542 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a3d04ead-69fc-4e5f-a5b2-3418ac6ce9d7 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:41.080940 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a3d04ead-69fc-4e5f-a5b2-3418ac6ce9d7 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:41.081688 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a3d04ead-69fc-4e5f-a5b2-3418ac6ce9d7 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:41.082189 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a3d04ead-69fc-4e5f-a5b2-3418ac6ce9d7 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:41.082902 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a3d04ead-69fc-4e5f-a5b2-3418ac6ce9d7 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:41.083366 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a3d04ead-69fc-4e5f-a5b2-3418ac6ce9d7 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:41.083937 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a3d04ead-69fc-4e5f-a5b2-3418ac6ce9d7 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:41.305620 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a3d04ead-69fc-4e5f-a5b2-3418ac6ce9d7 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:41.322053 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a3d04ead-69fc-4e5f-a5b2-3418ac6ce9d7 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:41.336119 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a3d04ead-69fc-4e5f-a5b2-3418ac6ce9d7 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:41.339570 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a3d04ead-69fc-4e5f-a5b2-3418ac6ce9d7 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b" status: 200 len: 1486 microversion: 2.25 time: 0.280432 Oct 23 01:19:41.354007 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1273/2528] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:19:41 2022] GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b => generated 1486 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:19:41.355978 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-76b6155c-42dd-4662-b4b8-ecc3709edad5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:41.361757 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-76b6155c-42dd-4662-b4b8-ecc3709edad5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:41.369870 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-76b6155c-42dd-4662-b4b8-ecc3709edad5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:41.371703 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-76b6155c-42dd-4662-b4b8-ecc3709edad5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:41.372353 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-76b6155c-42dd-4662-b4b8-ecc3709edad5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:41.373361 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-76b6155c-42dd-4662-b4b8-ecc3709edad5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:41.373928 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-76b6155c-42dd-4662-b4b8-ecc3709edad5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:41.374587 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-76b6155c-42dd-4662-b4b8-ecc3709edad5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:41.668004 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-76b6155c-42dd-4662-b4b8-ecc3709edad5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:41.678482 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-76b6155c-42dd-4662-b4b8-ecc3709edad5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1510 microversion: 2.1 time: 0.325075 Oct 23 01:19:41.679471 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1274/2529] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:41 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1510 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:41.685280 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9bf637cc-3280-4b8d-865f-87a8e38f8d49 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:41.686217 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9bf637cc-3280-4b8d-865f-87a8e38f8d49 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: 08afe605-c9f1-4d8b-98bc-9253414ebe56] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:41.694604 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9bf637cc-3280-4b8d-865f-87a8e38f8d49 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:41.696132 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9bf637cc-3280-4b8d-865f-87a8e38f8d49 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:41.696132 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9bf637cc-3280-4b8d-865f-87a8e38f8d49 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:41.697028 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9bf637cc-3280-4b8d-865f-87a8e38f8d49 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:41.697610 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9bf637cc-3280-4b8d-865f-87a8e38f8d49 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:41.698334 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-743c6f3a-6d1c-40b5-9bfc-ddf1adddcf3f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "POST /compute/v2.1/servers/8fb6c2f7-737b-4b87-9f6b-58ba7f12e428/action" status: 202 len: 0 microversion: 2.1 time: 0.747251 Oct 23 01:19:41.698702 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9bf637cc-3280-4b8d-865f-87a8e38f8d49 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:41.703996 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1256/2530] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:19:40 2022] POST /compute/v2.1/servers/8fb6c2f7-737b-4b87-9f6b-58ba7f12e428/action => generated 0 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 23 01:19:41.735252 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d2b5b33d-2468-4911-9129-d2ea6f94d3bd tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:41.740163 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d2b5b33d-2468-4911-9129-d2ea6f94d3bd tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 6ccfe45d-f080-4066-9aad-a39c3c4cd097] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:41.763505 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d2b5b33d-2468-4911-9129-d2ea6f94d3bd tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:41.765788 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d2b5b33d-2468-4911-9129-d2ea6f94d3bd tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:41.766476 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d2b5b33d-2468-4911-9129-d2ea6f94d3bd tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:41.768065 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d2b5b33d-2468-4911-9129-d2ea6f94d3bd tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:41.768907 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d2b5b33d-2468-4911-9129-d2ea6f94d3bd tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:41.769968 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d2b5b33d-2468-4911-9129-d2ea6f94d3bd tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:41.989110 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9bf637cc-3280-4b8d-865f-87a8e38f8d49 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:42.009936 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9bf637cc-3280-4b8d-865f-87a8e38f8d49 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56" status: 200 len: 1506 microversion: 2.1 time: 0.328968 Oct 23 01:19:42.018075 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1275/2531] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:41 2022] GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56 => generated 1506 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:42.035927 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-56851217-1d35-42c1-b975-6edd07b5f0d7 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc62748b0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:42.138806 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d2b5b33d-2468-4911-9129-d2ea6f94d3bd tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:42.152963 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d2b5b33d-2468-4911-9129-d2ea6f94d3bd tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097" status: 200 len: 1508 microversion: 2.1 time: 0.438925 Oct 23 01:19:42.154086 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1257/2532] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:41 2022] GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097 => generated 1508 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:42.170965 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-56851217-1d35-42c1-b975-6edd07b5f0d7 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/797a003c-18f3-460b-ab19-805335e36552" status: 200 len: 1439 microversion: 2.1 time: 0.151008 Oct 23 01:19:42.173810 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1276/2533] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:19:42 2022] GET /compute/v2.1/images/797a003c-18f3-460b-ab19-805335e36552 => generated 1439 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:42.191971 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d0d13366-8baf-4e11-9a44-16cd06f55536 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:42.197960 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d0d13366-8baf-4e11-9a44-16cd06f55536 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 6ccfe45d-f080-4066-9aad-a39c3c4cd097] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:42.208817 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d0d13366-8baf-4e11-9a44-16cd06f55536 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:42.211733 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d0d13366-8baf-4e11-9a44-16cd06f55536 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:42.212293 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d0d13366-8baf-4e11-9a44-16cd06f55536 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:42.213129 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d0d13366-8baf-4e11-9a44-16cd06f55536 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:42.213914 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d0d13366-8baf-4e11-9a44-16cd06f55536 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:42.217301 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d0d13366-8baf-4e11-9a44-16cd06f55536 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:42.368891 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ecd22d0b-5677-4b3c-9772-08edf20fd879 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:42.369643 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ecd22d0b-5677-4b3c-9772-08edf20fd879 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:42.379446 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ecd22d0b-5677-4b3c-9772-08edf20fd879 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:42.382591 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ecd22d0b-5677-4b3c-9772-08edf20fd879 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:42.383371 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ecd22d0b-5677-4b3c-9772-08edf20fd879 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:42.385847 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ecd22d0b-5677-4b3c-9772-08edf20fd879 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:42.386525 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ecd22d0b-5677-4b3c-9772-08edf20fd879 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:42.388024 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ecd22d0b-5677-4b3c-9772-08edf20fd879 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:42.554921 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d0d13366-8baf-4e11-9a44-16cd06f55536 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:42.568434 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d0d13366-8baf-4e11-9a44-16cd06f55536 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097" status: 200 len: 1508 microversion: 2.1 time: 0.384273 Oct 23 01:19:42.570577 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1258/2534] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:42 2022] GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097 => generated 1508 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:42.595421 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d17c666e-9b63-4169-96f1-469d2c2d92aa tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:42.598171 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d17c666e-9b63-4169-96f1-469d2c2d92aa tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 6ccfe45d-f080-4066-9aad-a39c3c4cd097] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:42.615439 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d17c666e-9b63-4169-96f1-469d2c2d92aa tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:42.615946 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d17c666e-9b63-4169-96f1-469d2c2d92aa tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:42.616446 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d17c666e-9b63-4169-96f1-469d2c2d92aa tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:42.617092 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d17c666e-9b63-4169-96f1-469d2c2d92aa tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:42.617547 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d17c666e-9b63-4169-96f1-469d2c2d92aa tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:42.618002 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d17c666e-9b63-4169-96f1-469d2c2d92aa tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:42.786485 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ecd22d0b-5677-4b3c-9772-08edf20fd879 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:42.795921 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ecd22d0b-5677-4b3c-9772-08edf20fd879 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:42.805162 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ecd22d0b-5677-4b3c-9772-08edf20fd879 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:42.806921 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ecd22d0b-5677-4b3c-9772-08edf20fd879 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b" status: 200 len: 1486 microversion: 2.25 time: 0.442898 Oct 23 01:19:42.808521 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1277/2535] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:19:42 2022] GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b => generated 1486 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:19:42.819633 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e9fa6904-3af0-4932-b138-1b567967a72a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:42.884195 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e9fa6904-3af0-4932-b138-1b567967a72a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:42.885151 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d17c666e-9b63-4169-96f1-469d2c2d92aa tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "PUT /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097" status: 200 len: 1080 microversion: 2.1 time: 0.244452 Oct 23 01:19:42.885151 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1259/2536] 10.222.0.42 () {60 vars in 1256 bytes} [Sun Oct 23 01:19:42 2022] PUT /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097 => generated 1080 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:19:42.885448 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e9fa6904-3af0-4932-b138-1b567967a72a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:42.885448 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e9fa6904-3af0-4932-b138-1b567967a72a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:42.885448 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e9fa6904-3af0-4932-b138-1b567967a72a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:42.885448 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e9fa6904-3af0-4932-b138-1b567967a72a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:42.885448 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e9fa6904-3af0-4932-b138-1b567967a72a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:42.885448 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e9fa6904-3af0-4932-b138-1b567967a72a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:42.885926 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-31cd4592-1bbb-44ef-8379-03ca89e22644 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:42.885926 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-31cd4592-1bbb-44ef-8379-03ca89e22644 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 6ccfe45d-f080-4066-9aad-a39c3c4cd097] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:42.885926 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-31cd4592-1bbb-44ef-8379-03ca89e22644 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:42.885926 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-31cd4592-1bbb-44ef-8379-03ca89e22644 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:42.885926 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-31cd4592-1bbb-44ef-8379-03ca89e22644 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:42.885926 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-31cd4592-1bbb-44ef-8379-03ca89e22644 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:42.885926 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-31cd4592-1bbb-44ef-8379-03ca89e22644 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:42.886786 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-31cd4592-1bbb-44ef-8379-03ca89e22644 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:43.147799 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-31cd4592-1bbb-44ef-8379-03ca89e22644 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:43.151583 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:19:43.159241 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-31cd4592-1bbb-44ef-8379-03ca89e22644 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097" status: 200 len: 1506 microversion: 2.1 time: 0.298055 Oct 23 01:19:43.175108 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1260/2537] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:42 2022] GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097 => generated 1506 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:19:43.193253 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-91899fa0-156a-4338-a3c4-159465f917e0 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:43.193894 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-91899fa0-156a-4338-a3c4-159465f917e0 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: 08afe605-c9f1-4d8b-98bc-9253414ebe56] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:43.204271 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e9fa6904-3af0-4932-b138-1b567967a72a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:43.207582 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-91899fa0-156a-4338-a3c4-159465f917e0 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:43.208081 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-91899fa0-156a-4338-a3c4-159465f917e0 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:43.208518 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-91899fa0-156a-4338-a3c4-159465f917e0 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:43.209217 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-91899fa0-156a-4338-a3c4-159465f917e0 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:43.209672 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-91899fa0-156a-4338-a3c4-159465f917e0 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:43.210121 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-91899fa0-156a-4338-a3c4-159465f917e0 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:43.213747 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e9fa6904-3af0-4932-b138-1b567967a72a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1490 microversion: 2.1 time: 0.403486 Oct 23 01:19:43.221172 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1278/2538] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:42 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1490 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:43.226802 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0f003d5a-07f5-442b-a856-f58d3a753ab4 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc6274d30>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:43.277271 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0f003d5a-07f5-442b-a856-f58d3a753ab4 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/797a003c-18f3-460b-ab19-805335e36552" status: 200 len: 1439 microversion: 2.1 time: 0.054688 Oct 23 01:19:43.278010 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1279/2539] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:19:43 2022] GET /compute/v2.1/images/797a003c-18f3-460b-ab19-805335e36552 => generated 1439 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:43.286237 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-37154437-ba1a-469a-8f73-a61909b94f3e tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:43.293806 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-37154437-ba1a-469a-8f73-a61909b94f3e tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 6ccfe45d-f080-4066-9aad-a39c3c4cd097] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:43.306634 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-37154437-ba1a-469a-8f73-a61909b94f3e tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:43.307292 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-37154437-ba1a-469a-8f73-a61909b94f3e tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:43.307832 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-37154437-ba1a-469a-8f73-a61909b94f3e tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:43.308670 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-37154437-ba1a-469a-8f73-a61909b94f3e tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:43.309235 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-37154437-ba1a-469a-8f73-a61909b94f3e tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:43.322883 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-37154437-ba1a-469a-8f73-a61909b94f3e tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:43.817831 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-91899fa0-156a-4338-a3c4-159465f917e0 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:43.830344 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-91899fa0-156a-4338-a3c4-159465f917e0 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56" status: 200 len: 1506 microversion: 2.1 time: 0.651188 Oct 23 01:19:43.832034 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1261/2540] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:43 2022] GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56 => generated 1506 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:43.848367 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6e578bec-9bcc-4204-9ece-cb462c3e24d5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:43.848367 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6e578bec-9bcc-4204-9ece-cb462c3e24d5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:43.861596 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6e578bec-9bcc-4204-9ece-cb462c3e24d5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:43.862426 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6e578bec-9bcc-4204-9ece-cb462c3e24d5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:43.862754 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6e578bec-9bcc-4204-9ece-cb462c3e24d5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:43.863466 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6e578bec-9bcc-4204-9ece-cb462c3e24d5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:43.863920 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6e578bec-9bcc-4204-9ece-cb462c3e24d5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:43.864416 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6e578bec-9bcc-4204-9ece-cb462c3e24d5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:43.877757 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-37154437-ba1a-469a-8f73-a61909b94f3e tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:43.880030 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:19:43.889490 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-37154437-ba1a-469a-8f73-a61909b94f3e tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097" status: 200 len: 1506 microversion: 2.1 time: 0.610181 Oct 23 01:19:43.900187 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1280/2541] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:43 2022] GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097 => generated 1506 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:43.904463 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0b7b009d-bc23-4093-9cd1-4cdc611a6b59 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:43.908548 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0b7b009d-bc23-4093-9cd1-4cdc611a6b59 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:43.925759 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b7b009d-bc23-4093-9cd1-4cdc611a6b59 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:43.926371 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b7b009d-bc23-4093-9cd1-4cdc611a6b59 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:43.927542 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b7b009d-bc23-4093-9cd1-4cdc611a6b59 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:43.930919 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b7b009d-bc23-4093-9cd1-4cdc611a6b59 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:43.931593 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b7b009d-bc23-4093-9cd1-4cdc611a6b59 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:43.934421 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-6e578bec-9bcc-4204-9ece-cb462c3e24d5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] HTTP exception thrown: Cannot 'pause' instance 62a8ad26-f65b-432d-a8da-48264c426335 while it is in vm_state paused Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6e578bec-9bcc-4204-9ece-cb462c3e24d5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Request method failure captured: Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335/action HTTP/1.1 Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 13 Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJZEAurAeILsYJek3MCv_ryiTbidOLVZq6W4I7jJxeY_1_bTWRye2xM3EDOhowd_NyioevvIvzT9beBCgKqri_ZjLw9hdsIISMXmajO_VmobATT_GwpY_Y-GVylQtV9MoF1-Bup_Ahjld_2riQHnDzqLUWULm2acZYcK9UIbslVsdDU Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}] Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: cd6a6c5240f94ace91e1f0ed3e53fa7c Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: {"pause": {}} Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: exception: Cannot 'pause' instance 62a8ad26-f65b-432d-a8da-48264c426335 while it is in vm_state paused Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '62a8ad26-f65b-432d-a8da-48264c426335', 'body': {'pause': {}}} Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 62a8ad26-f65b-432d-a8da-48264c426335 in vm_state paused. Cannot pause while the instance is in this state. Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 62a8ad26-f65b-432d-a8da-48264c426335 while it is in vm_state paused Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:43.940151 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:43.944533 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:43.944533 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:19:43.944533 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:19:43.944533 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 62a8ad26-f65b-432d-a8da-48264c426335 while it is in vm_state paused Oct 23 01:19:43.944533 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:43.944533 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6e578bec-9bcc-4204-9ece-cb462c3e24d5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Returning 409 to user: Cannot 'pause' instance 62a8ad26-f65b-432d-a8da-48264c426335 while it is in vm_state paused {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:19:43.944921 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b7b009d-bc23-4093-9cd1-4cdc611a6b59 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:43.945000 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6e578bec-9bcc-4204-9ece-cb462c3e24d5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "POST /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335/action" status: 409 len: 143 microversion: 2.1 time: 0.105065 Oct 23 01:19:43.945000 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1262/2542] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:19:43 2022] POST /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335/action => generated 143 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:19:43.945842 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-de24e770-6106-443f-b745-2e049f589b9b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:43.948713 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-de24e770-6106-443f-b745-2e049f589b9b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 6ccfe45d-f080-4066-9aad-a39c3c4cd097] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:43.956583 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-de24e770-6106-443f-b745-2e049f589b9b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:43.957536 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-de24e770-6106-443f-b745-2e049f589b9b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:43.958142 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-de24e770-6106-443f-b745-2e049f589b9b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:43.959080 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-de24e770-6106-443f-b745-2e049f589b9b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:43.960542 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-de24e770-6106-443f-b745-2e049f589b9b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:43.961176 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-de24e770-6106-443f-b745-2e049f589b9b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:44.086462 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-de24e770-6106-443f-b745-2e049f589b9b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:19:44.088309 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-de24e770-6106-443f-b745-2e049f589b9b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:19:44.088872 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-de24e770-6106-443f-b745-2e049f589b9b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:19:44.089297 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-de24e770-6106-443f-b745-2e049f589b9b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:19:44.090821 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-de24e770-6106-443f-b745-2e049f589b9b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:19:44.142083 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0b7b009d-bc23-4093-9cd1-4cdc611a6b59 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:44.153905 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0b7b009d-bc23-4093-9cd1-4cdc611a6b59 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:44.155608 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0b7b009d-bc23-4093-9cd1-4cdc611a6b59 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:44.157709 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0b7b009d-bc23-4093-9cd1-4cdc611a6b59 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b" status: 200 len: 1486 microversion: 2.25 time: 0.259138 Oct 23 01:19:44.158824 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1281/2543] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:19:43 2022] GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b => generated 1486 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:19:44.163620 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-162a2702-f191-4406-a500-6d04d41e734e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:44.164394 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-162a2702-f191-4406-a500-6d04d41e734e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:44.170890 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-162a2702-f191-4406-a500-6d04d41e734e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:44.175145 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-162a2702-f191-4406-a500-6d04d41e734e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:44.175145 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-162a2702-f191-4406-a500-6d04d41e734e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:44.175145 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-162a2702-f191-4406-a500-6d04d41e734e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:44.175145 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-162a2702-f191-4406-a500-6d04d41e734e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:44.175145 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-162a2702-f191-4406-a500-6d04d41e734e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:44.426505 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-de24e770-6106-443f-b745-2e049f589b9b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 6ccfe45d-f080-4066-9aad-a39c3c4cd097] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:44.435860 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-de24e770-6106-443f-b745-2e049f589b9b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:44.436807 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-de24e770-6106-443f-b745-2e049f589b9b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:44.437838 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-de24e770-6106-443f-b745-2e049f589b9b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:44.439521 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-de24e770-6106-443f-b745-2e049f589b9b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:44.440367 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-de24e770-6106-443f-b745-2e049f589b9b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:44.441083 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-de24e770-6106-443f-b745-2e049f589b9b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:44.479826 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-de24e770-6106-443f-b745-2e049f589b9b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "POST /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097/action" status: 202 len: 1112 microversion: 2.1 time: 0.538343 Oct 23 01:19:44.496098 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1263/2544] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:19:43 2022] POST /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097/action => generated 1112 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 23 01:19:44.497700 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-162a2702-f191-4406-a500-6d04d41e734e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "POST /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335/action" status: 202 len: 0 microversion: 2.1 time: 0.322787 Oct 23 01:19:44.497700 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1282/2545] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:19:44 2022] POST /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:19:44.497868 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-488f21fe-9e7e-40d4-964b-34e6dbec30ba tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc613e8b0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:44.497960 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-342b7afe-1909-4a3f-ade4-66f20c46751d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:44.497960 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-342b7afe-1909-4a3f-ade4-66f20c46751d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:44.514245 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-342b7afe-1909-4a3f-ade4-66f20c46751d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:44.522157 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-342b7afe-1909-4a3f-ade4-66f20c46751d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:44.522795 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-342b7afe-1909-4a3f-ade4-66f20c46751d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:44.525465 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-342b7afe-1909-4a3f-ade4-66f20c46751d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:44.526223 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-342b7afe-1909-4a3f-ade4-66f20c46751d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:44.527982 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-342b7afe-1909-4a3f-ade4-66f20c46751d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:44.549783 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-488f21fe-9e7e-40d4-964b-34e6dbec30ba tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/797a003c-18f3-460b-ab19-805335e36552" status: 200 len: 1439 microversion: 2.1 time: 0.068177 Oct 23 01:19:44.550563 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1264/2546] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:19:44 2022] GET /compute/v2.1/images/797a003c-18f3-460b-ab19-805335e36552 => generated 1439 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:44.556077 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8c8ad3a5-e77c-4d27-917d-e6f8a7201ccc tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:44.556896 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8c8ad3a5-e77c-4d27-917d-e6f8a7201ccc tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 6ccfe45d-f080-4066-9aad-a39c3c4cd097] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:44.574893 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c8ad3a5-e77c-4d27-917d-e6f8a7201ccc tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:44.575604 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c8ad3a5-e77c-4d27-917d-e6f8a7201ccc tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:44.576217 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c8ad3a5-e77c-4d27-917d-e6f8a7201ccc tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:44.577104 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c8ad3a5-e77c-4d27-917d-e6f8a7201ccc tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:44.577711 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c8ad3a5-e77c-4d27-917d-e6f8a7201ccc tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:44.578985 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c8ad3a5-e77c-4d27-917d-e6f8a7201ccc tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:45.032179 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-342b7afe-1909-4a3f-ade4-66f20c46751d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:45.053202 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-342b7afe-1909-4a3f-ade4-66f20c46751d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1497 microversion: 2.1 time: 0.562913 Oct 23 01:19:45.059364 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1283/2547] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:44 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1497 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:45.079922 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4927f25d-948e-4fec-86ef-d120121f1670 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:45.083288 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4927f25d-948e-4fec-86ef-d120121f1670 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: 08afe605-c9f1-4d8b-98bc-9253414ebe56] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:45.110846 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4927f25d-948e-4fec-86ef-d120121f1670 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:45.111384 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4927f25d-948e-4fec-86ef-d120121f1670 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:45.114431 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4927f25d-948e-4fec-86ef-d120121f1670 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:45.122923 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4927f25d-948e-4fec-86ef-d120121f1670 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:45.123584 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4927f25d-948e-4fec-86ef-d120121f1670 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:45.124413 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4927f25d-948e-4fec-86ef-d120121f1670 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:45.151051 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8c8ad3a5-e77c-4d27-917d-e6f8a7201ccc tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:45.164555 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8c8ad3a5-e77c-4d27-917d-e6f8a7201ccc tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097" status: 200 len: 1517 microversion: 2.1 time: 0.612577 Oct 23 01:19:45.176738 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1265/2548] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:44 2022] GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097 => generated 1517 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:45.194184 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f19d63ab-4cbd-43d1-b31c-077d5b2a6aa8 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:45.197487 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f19d63ab-4cbd-43d1-b31c-077d5b2a6aa8 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:45.219289 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f19d63ab-4cbd-43d1-b31c-077d5b2a6aa8 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:45.220499 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f19d63ab-4cbd-43d1-b31c-077d5b2a6aa8 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:45.221173 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f19d63ab-4cbd-43d1-b31c-077d5b2a6aa8 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:45.222191 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f19d63ab-4cbd-43d1-b31c-077d5b2a6aa8 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:45.222833 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f19d63ab-4cbd-43d1-b31c-077d5b2a6aa8 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:45.223440 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f19d63ab-4cbd-43d1-b31c-077d5b2a6aa8 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:45.456738 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4927f25d-948e-4fec-86ef-d120121f1670 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:45.477396 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4927f25d-948e-4fec-86ef-d120121f1670 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56" status: 200 len: 1506 microversion: 2.1 time: 0.415607 Oct 23 01:19:45.496024 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1284/2549] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:45 2022] GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56 => generated 1506 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:45.588011 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f19d63ab-4cbd-43d1-b31c-077d5b2a6aa8 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:45.600191 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f19d63ab-4cbd-43d1-b31c-077d5b2a6aa8 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:45.606813 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f19d63ab-4cbd-43d1-b31c-077d5b2a6aa8 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:45.609888 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f19d63ab-4cbd-43d1-b31c-077d5b2a6aa8 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b" status: 200 len: 1486 microversion: 2.25 time: 0.421681 Oct 23 01:19:45.621516 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1266/2550] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:19:45 2022] GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b => generated 1486 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:19:45.629389 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ac117667-5bf0-429e-b680-a171593ef5df tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc6151ee0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:45.711275 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ac117667-5bf0-429e-b680-a171593ef5df tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/797a003c-18f3-460b-ab19-805335e36552" status: 200 len: 1439 microversion: 2.1 time: 0.096555 Oct 23 01:19:45.713215 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1267/2551] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:19:45 2022] GET /compute/v2.1/images/797a003c-18f3-460b-ab19-805335e36552 => generated 1439 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:45.773224 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6145b033-cc30-4ff7-9280-946c650f204c tempest-AbsoluteLimitsTestJSON-247931155 tempest-AbsoluteLimitsTestJSON-247931155-project] Calling method '.version_select at 0x7f5cc62f2b80>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:45.796226 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6145b033-cc30-4ff7-9280-946c650f204c tempest-AbsoluteLimitsTestJSON-247931155 tempest-AbsoluteLimitsTestJSON-247931155-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:45.800302 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6145b033-cc30-4ff7-9280-946c650f204c tempest-AbsoluteLimitsTestJSON-247931155 tempest-AbsoluteLimitsTestJSON-247931155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:45.801297 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6145b033-cc30-4ff7-9280-946c650f204c tempest-AbsoluteLimitsTestJSON-247931155 tempest-AbsoluteLimitsTestJSON-247931155-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:45.802677 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6145b033-cc30-4ff7-9280-946c650f204c tempest-AbsoluteLimitsTestJSON-247931155 tempest-AbsoluteLimitsTestJSON-247931155-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:45.810175 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6145b033-cc30-4ff7-9280-946c650f204c tempest-AbsoluteLimitsTestJSON-247931155 tempest-AbsoluteLimitsTestJSON-247931155-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:45.810175 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6145b033-cc30-4ff7-9280-946c650f204c tempest-AbsoluteLimitsTestJSON-247931155 tempest-AbsoluteLimitsTestJSON-247931155-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:45.835256 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6145b033-cc30-4ff7-9280-946c650f204c tempest-AbsoluteLimitsTestJSON-247931155 tempest-AbsoluteLimitsTestJSON-247931155-project] 10.222.0.42 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.342675 Oct 23 01:19:45.840380 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1285/2552] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:19:45 2022] GET /compute/v2.1/limits => generated 511 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:19:46.094398 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0582ce6a-7d56-4c6d-a82d-a61bda784c03 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:46.094398 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0582ce6a-7d56-4c6d-a82d-a61bda784c03 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:46.136505 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0582ce6a-7d56-4c6d-a82d-a61bda784c03 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:46.136505 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0582ce6a-7d56-4c6d-a82d-a61bda784c03 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:46.136505 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0582ce6a-7d56-4c6d-a82d-a61bda784c03 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:46.136505 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0582ce6a-7d56-4c6d-a82d-a61bda784c03 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:46.136505 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0582ce6a-7d56-4c6d-a82d-a61bda784c03 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:46.136505 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0582ce6a-7d56-4c6d-a82d-a61bda784c03 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:46.199499 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f23aff89-9f3f-45e3-a9a0-19b86a612c14 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:46.200417 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f23aff89-9f3f-45e3-a9a0-19b86a612c14 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 6ccfe45d-f080-4066-9aad-a39c3c4cd097] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:46.216627 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f23aff89-9f3f-45e3-a9a0-19b86a612c14 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:46.217943 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f23aff89-9f3f-45e3-a9a0-19b86a612c14 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:46.220285 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f23aff89-9f3f-45e3-a9a0-19b86a612c14 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:46.225623 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f23aff89-9f3f-45e3-a9a0-19b86a612c14 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:46.226790 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f23aff89-9f3f-45e3-a9a0-19b86a612c14 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:46.232128 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f23aff89-9f3f-45e3-a9a0-19b86a612c14 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:46.525676 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0582ce6a-7d56-4c6d-a82d-a61bda784c03 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:46.543137 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0582ce6a-7d56-4c6d-a82d-a61bda784c03 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.454803 Oct 23 01:19:46.547526 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1268/2553] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:46 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:46.573823 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c4f3f343-f8b9-426f-9b48-ecfc73a0a1f4 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:46.575347 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f23aff89-9f3f-45e3-a9a0-19b86a612c14 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:46.578843 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c4f3f343-f8b9-426f-9b48-ecfc73a0a1f4 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: 08afe605-c9f1-4d8b-98bc-9253414ebe56] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:46.586655 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f23aff89-9f3f-45e3-a9a0-19b86a612c14 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097" status: 200 len: 1517 microversion: 2.1 time: 0.392287 Oct 23 01:19:46.587481 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1286/2554] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:46 2022] GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097 => generated 1517 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:19:46.593234 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ebc27cc9-30e5-4d74-a69a-bc4b2d6958e2 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:46.594205 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ebc27cc9-30e5-4d74-a69a-bc4b2d6958e2 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:46.601858 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ebc27cc9-30e5-4d74-a69a-bc4b2d6958e2 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:46.602291 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c4f3f343-f8b9-426f-9b48-ecfc73a0a1f4 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:46.604852 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c4f3f343-f8b9-426f-9b48-ecfc73a0a1f4 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:46.604966 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ebc27cc9-30e5-4d74-a69a-bc4b2d6958e2 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:46.605059 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c4f3f343-f8b9-426f-9b48-ecfc73a0a1f4 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:46.605140 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ebc27cc9-30e5-4d74-a69a-bc4b2d6958e2 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:46.605211 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c4f3f343-f8b9-426f-9b48-ecfc73a0a1f4 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:46.605280 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ebc27cc9-30e5-4d74-a69a-bc4b2d6958e2 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:46.606346 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ebc27cc9-30e5-4d74-a69a-bc4b2d6958e2 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:46.606999 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ebc27cc9-30e5-4d74-a69a-bc4b2d6958e2 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:46.615297 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c4f3f343-f8b9-426f-9b48-ecfc73a0a1f4 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:46.615888 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c4f3f343-f8b9-426f-9b48-ecfc73a0a1f4 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:46.933052 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ebc27cc9-30e5-4d74-a69a-bc4b2d6958e2 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:46.945132 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ebc27cc9-30e5-4d74-a69a-bc4b2d6958e2 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.356108 Oct 23 01:19:46.946537 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1287/2555] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:46 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:46.982149 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-85eb2760-3fab-4479-9d6d-e64d7fd52563 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:46.989786 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-85eb2760-3fab-4479-9d6d-e64d7fd52563 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:47.005771 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c4f3f343-f8b9-426f-9b48-ecfc73a0a1f4 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:47.006727 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-85eb2760-3fab-4479-9d6d-e64d7fd52563 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:47.009723 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-85eb2760-3fab-4479-9d6d-e64d7fd52563 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:47.011309 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-85eb2760-3fab-4479-9d6d-e64d7fd52563 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:47.012149 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-85eb2760-3fab-4479-9d6d-e64d7fd52563 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:47.013766 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-85eb2760-3fab-4479-9d6d-e64d7fd52563 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:47.014328 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-85eb2760-3fab-4479-9d6d-e64d7fd52563 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:47.017917 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c4f3f343-f8b9-426f-9b48-ecfc73a0a1f4 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56" status: 200 len: 1506 microversion: 2.1 time: 0.467103 Oct 23 01:19:47.030278 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1269/2556] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:46 2022] GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56 => generated 1506 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:47.042724 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-45e0f7ca-e95c-43ac-a3f0-d360ee8122dc tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc61964c0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:47.124242 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-45e0f7ca-e95c-43ac-a3f0-d360ee8122dc tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/797a003c-18f3-460b-ab19-805335e36552" status: 200 len: 1439 microversion: 2.1 time: 0.096975 Oct 23 01:19:47.134056 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1270/2557] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:19:47 2022] GET /compute/v2.1/images/797a003c-18f3-460b-ab19-805335e36552 => generated 1439 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:47.136299 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f6cdbf81-52d7-4225-85fc-3367695e2b12 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:47.138640 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f6cdbf81-52d7-4225-85fc-3367695e2b12 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: cce77239-7b98-4389-946e-8292bf160194] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:47.167301 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f6cdbf81-52d7-4225-85fc-3367695e2b12 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:47.167893 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f6cdbf81-52d7-4225-85fc-3367695e2b12 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:47.168247 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f6cdbf81-52d7-4225-85fc-3367695e2b12 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:47.168969 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f6cdbf81-52d7-4225-85fc-3367695e2b12 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:47.169420 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f6cdbf81-52d7-4225-85fc-3367695e2b12 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:47.170051 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f6cdbf81-52d7-4225-85fc-3367695e2b12 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:47.208718 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-f6cdbf81-52d7-4225-85fc-3367695e2b12 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] HTTP exception thrown: Instance cce77239-7b98-4389-946e-8292bf160194 could not be found. Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f6cdbf81-52d7-4225-85fc-3367695e2b12 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Request method failure captured: Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/servers/cce77239-7b98-4389-946e-8292bf160194/action HTTP/1.1 Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 28 Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJZEAurAeILsYJek3MCv_ryiTbidOLVZq6W4I7jJxeY_1_bTWRye2xM3EDOhowd_NyioevvIvzT9beBCgKqri_ZjLw9hdsIISMXmajO_VmobATT_GwpY_Y-GVylQtV9MoF1-Bup_Ahjld_2riQHnDzqLUWULm2acZYcK9UIbslVsdDU Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}] Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: cd6a6c5240f94ace91e1f0ed3e53fa7c Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: {"reboot": {"type": "SOFT"}} Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: exception: Instance cce77239-7b98-4389-946e-8292bf160194 could not be found. Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'cce77239-7b98-4389-946e-8292bf160194', 'body': {'reboot': {'type': 'SOFT'}}} Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cce77239-7b98-4389-946e-8292bf160194 could not be found. Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:19:47.214071 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:19:47.217688 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cce77239-7b98-4389-946e-8292bf160194 could not be found. Oct 23 01:19:47.217688 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:47.217688 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:47.217688 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:47.217688 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:47.217688 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:47.217688 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:47.217688 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:19:47.217688 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:19:47.217688 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cce77239-7b98-4389-946e-8292bf160194 could not be found. Oct 23 01:19:47.217688 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:47.217688 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f6cdbf81-52d7-4225-85fc-3367695e2b12 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Returning 404 to user: Instance cce77239-7b98-4389-946e-8292bf160194 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:19:47.217688 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f6cdbf81-52d7-4225-85fc-3367695e2b12 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "POST /compute/v2.1/servers/cce77239-7b98-4389-946e-8292bf160194/action" status: 404 len: 111 microversion: 2.1 time: 0.088858 Oct 23 01:19:47.221478 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1271/2558] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:19:47 2022] POST /compute/v2.1/servers/cce77239-7b98-4389-946e-8292bf160194/action => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:19:47.230983 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f4646573-b662-42c6-8fce-75bccff9bf8a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:47.233170 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f4646573-b662-42c6-8fce-75bccff9bf8a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:47.251332 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4646573-b662-42c6-8fce-75bccff9bf8a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:47.253774 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4646573-b662-42c6-8fce-75bccff9bf8a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:47.256312 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4646573-b662-42c6-8fce-75bccff9bf8a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:47.257557 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4646573-b662-42c6-8fce-75bccff9bf8a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:47.258199 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4646573-b662-42c6-8fce-75bccff9bf8a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:47.264894 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4646573-b662-42c6-8fce-75bccff9bf8a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:47.644621 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-85eb2760-3fab-4479-9d6d-e64d7fd52563 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:47.658622 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f4646573-b662-42c6-8fce-75bccff9bf8a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:47.664342 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-85eb2760-3fab-4479-9d6d-e64d7fd52563 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:47.667007 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-85eb2760-3fab-4479-9d6d-e64d7fd52563 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:47.667487 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f4646573-b662-42c6-8fce-75bccff9bf8a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.444862 Oct 23 01:19:47.674872 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1272/2559] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:47 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:47.679579 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-85eb2760-3fab-4479-9d6d-e64d7fd52563 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b" status: 200 len: 1486 microversion: 2.25 time: 0.716619 Oct 23 01:19:47.680598 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1288/2560] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:19:46 2022] GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b => generated 1486 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:19:47.684747 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-c81ebb4d-ca9b-432c-bc38-f7b7f33d7b42 req-269e0330-2e2b-4c45-b605-793ed98e0c2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fb6c2f7-737b-4b87-9f6b-58ba7f12e428", "name": "network-vif-plugged", "status": "completed", "tag": "810f70db-7bee-41b2-9290-606e5cf23885"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:47.694836 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-09d2d13b-7c19-4f3a-99e9-a95ab7b79b4d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:47.695651 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-09d2d13b-7c19-4f3a-99e9-a95ab7b79b4d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 6ccfe45d-f080-4066-9aad-a39c3c4cd097] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:47.702663 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09d2d13b-7c19-4f3a-99e9-a95ab7b79b4d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:47.703239 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09d2d13b-7c19-4f3a-99e9-a95ab7b79b4d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:47.703682 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09d2d13b-7c19-4f3a-99e9-a95ab7b79b4d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:47.704389 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09d2d13b-7c19-4f3a-99e9-a95ab7b79b4d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:47.705004 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09d2d13b-7c19-4f3a-99e9-a95ab7b79b4d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:47.705672 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09d2d13b-7c19-4f3a-99e9-a95ab7b79b4d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:47.722427 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-c81ebb4d-ca9b-432c-bc38-f7b7f33d7b42 req-269e0330-2e2b-4c45-b605-793ed98e0c2a service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:47.723158 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-c81ebb4d-ca9b-432c-bc38-f7b7f33d7b42 req-269e0330-2e2b-4c45-b605-793ed98e0c2a service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:47.723686 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-c81ebb4d-ca9b-432c-bc38-f7b7f33d7b42 req-269e0330-2e2b-4c45-b605-793ed98e0c2a service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:47.741220 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-c81ebb4d-ca9b-432c-bc38-f7b7f33d7b42 req-269e0330-2e2b-4c45-b605-793ed98e0c2a service nova] Creating event network-vif-plugged:810f70db-7bee-41b2-9290-606e5cf23885 for instance 8fb6c2f7-737b-4b87-9f6b-58ba7f12e428 on n-h2-master-1 Oct 23 01:19:47.759890 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-c81ebb4d-ca9b-432c-bc38-f7b7f33d7b42 req-269e0330-2e2b-4c45-b605-793ed98e0c2a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083433 Oct 23 01:19:47.760791 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1273/2561] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:19:47.766437 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f2ddf677-7780-49a5-b3c2-8bc0f0beb1e1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:47.767069 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f2ddf677-7780-49a5-b3c2-8bc0f0beb1e1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:47.786438 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2ddf677-7780-49a5-b3c2-8bc0f0beb1e1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:47.787009 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2ddf677-7780-49a5-b3c2-8bc0f0beb1e1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:47.787361 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2ddf677-7780-49a5-b3c2-8bc0f0beb1e1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:47.788065 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2ddf677-7780-49a5-b3c2-8bc0f0beb1e1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:47.788522 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2ddf677-7780-49a5-b3c2-8bc0f0beb1e1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:47.788952 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2ddf677-7780-49a5-b3c2-8bc0f0beb1e1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:48.094600 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-09d2d13b-7c19-4f3a-99e9-a95ab7b79b4d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:48.104233 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-09d2d13b-7c19-4f3a-99e9-a95ab7b79b4d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097" status: 200 len: 1517 microversion: 2.1 time: 0.413355 Oct 23 01:19:48.105109 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1289/2562] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:47 2022] GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097 => generated 1517 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:48.112226 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9895004e-b791-470b-9b5c-a18b0e6eb780 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:48.114587 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9895004e-b791-470b-9b5c-a18b0e6eb780 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: 08afe605-c9f1-4d8b-98bc-9253414ebe56] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:48.130985 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9895004e-b791-470b-9b5c-a18b0e6eb780 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:48.132543 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9895004e-b791-470b-9b5c-a18b0e6eb780 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:48.132543 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9895004e-b791-470b-9b5c-a18b0e6eb780 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:48.136887 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9895004e-b791-470b-9b5c-a18b0e6eb780 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:48.137463 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9895004e-b791-470b-9b5c-a18b0e6eb780 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:48.138006 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9895004e-b791-470b-9b5c-a18b0e6eb780 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:48.152805 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f2ddf677-7780-49a5-b3c2-8bc0f0beb1e1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:48.162284 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f2ddf677-7780-49a5-b3c2-8bc0f0beb1e1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.400220 Oct 23 01:19:48.175029 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1274/2563] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:47 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:48.187780 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bddd35be-aa75-46fc-912c-63c28943ff5e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc61b1700>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:48.260086 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bddd35be-aa75-46fc-912c-63c28943ff5e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/797a003c-18f3-460b-ab19-805335e36552" status: 200 len: 1439 microversion: 2.1 time: 0.082101 Oct 23 01:19:48.260803 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1275/2564] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:19:48 2022] GET /compute/v2.1/images/797a003c-18f3-460b-ab19-805335e36552 => generated 1439 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:48.274937 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-644687c5-b8a4-4309-96f2-eed00700827f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:48.282699 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-644687c5-b8a4-4309-96f2-eed00700827f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 0e41fd6b-3dfb-4119-acfe-196055ef26ba] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:48.310993 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-644687c5-b8a4-4309-96f2-eed00700827f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] HTTP exception thrown: Instance 0e41fd6b-3dfb-4119-acfe-196055ef26ba could not be found. Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-644687c5-b8a4-4309-96f2-eed00700827f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Request method failure captured: Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/servers/0e41fd6b-3dfb-4119-acfe-196055ef26ba/action HTTP/1.1 Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 28 Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJZEAurAeILsYJek3MCv_ryiTbidOLVZq6W4I7jJxeY_1_bTWRye2xM3EDOhowd_NyioevvIvzT9beBCgKqri_ZjLw9hdsIISMXmajO_VmobATT_GwpY_Y-GVylQtV9MoF1-Bup_Ahjld_2riQHnDzqLUWULm2acZYcK9UIbslVsdDU Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}] Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: cd6a6c5240f94ace91e1f0ed3e53fa7c Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: {"reboot": {"type": "SOFT"}} Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 0e41fd6b-3dfb-4119-acfe-196055ef26ba could not be found. Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '0e41fd6b-3dfb-4119-acfe-196055ef26ba', 'body': {'reboot': {'type': 'SOFT'}}} Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e41fd6b-3dfb-4119-acfe-196055ef26ba could not be found. Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e41fd6b-3dfb-4119-acfe-196055ef26ba could not be found. Oct 23 01:19:48.320537 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:48.324275 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:48.324275 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:48.324275 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:48.324275 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:48.324275 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:48.324275 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:19:48.324275 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:19:48.324275 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e41fd6b-3dfb-4119-acfe-196055ef26ba could not be found. Oct 23 01:19:48.324275 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:48.324275 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-644687c5-b8a4-4309-96f2-eed00700827f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Returning 404 to user: Instance 0e41fd6b-3dfb-4119-acfe-196055ef26ba could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:19:48.324275 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-644687c5-b8a4-4309-96f2-eed00700827f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "POST /compute/v2.1/servers/0e41fd6b-3dfb-4119-acfe-196055ef26ba/action" status: 404 len: 111 microversion: 2.1 time: 0.060556 Oct 23 01:19:48.325898 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1276/2565] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:19:48 2022] POST /compute/v2.1/servers/0e41fd6b-3dfb-4119-acfe-196055ef26ba/action => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:19:48.341194 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e2e237fd-cdaa-495f-9280-75b4a69ad6bf tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:48.353150 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e2e237fd-cdaa-495f-9280-75b4a69ad6bf tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:48.361445 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e2e237fd-cdaa-495f-9280-75b4a69ad6bf tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:48.361939 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e2e237fd-cdaa-495f-9280-75b4a69ad6bf tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:48.362403 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e2e237fd-cdaa-495f-9280-75b4a69ad6bf tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:48.363101 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e2e237fd-cdaa-495f-9280-75b4a69ad6bf tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:48.364417 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e2e237fd-cdaa-495f-9280-75b4a69ad6bf tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:48.365002 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e2e237fd-cdaa-495f-9280-75b4a69ad6bf tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:48.534725 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9895004e-b791-470b-9b5c-a18b0e6eb780 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:48.554894 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9895004e-b791-470b-9b5c-a18b0e6eb780 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56" status: 200 len: 1506 microversion: 2.1 time: 0.448458 Oct 23 01:19:48.558622 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1290/2566] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:48 2022] GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56 => generated 1506 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:48.620311 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e2e237fd-cdaa-495f-9280-75b4a69ad6bf tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:48.632030 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e2e237fd-cdaa-495f-9280-75b4a69ad6bf tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.300794 Oct 23 01:19:48.648762 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1277/2567] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:48 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:48.665579 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-04e4866e-e5bd-43d5-a15c-c546a0042365 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:48.665579 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-04e4866e-e5bd-43d5-a15c-c546a0042365 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:48.691397 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-04e4866e-e5bd-43d5-a15c-c546a0042365 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:48.691397 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-04e4866e-e5bd-43d5-a15c-c546a0042365 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:48.691397 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-04e4866e-e5bd-43d5-a15c-c546a0042365 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:48.694116 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-04e4866e-e5bd-43d5-a15c-c546a0042365 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:48.694793 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-04e4866e-e5bd-43d5-a15c-c546a0042365 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:48.697726 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-04e4866e-e5bd-43d5-a15c-c546a0042365 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:48.709848 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9ddf454a-35b8-42a4-91cd-6430bd91aeaf tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:48.710493 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9ddf454a-35b8-42a4-91cd-6430bd91aeaf tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:48.721807 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ddf454a-35b8-42a4-91cd-6430bd91aeaf tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:48.724071 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ddf454a-35b8-42a4-91cd-6430bd91aeaf tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:48.724655 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ddf454a-35b8-42a4-91cd-6430bd91aeaf tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:48.725397 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ddf454a-35b8-42a4-91cd-6430bd91aeaf tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:48.734011 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ddf454a-35b8-42a4-91cd-6430bd91aeaf tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:48.736235 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ddf454a-35b8-42a4-91cd-6430bd91aeaf tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:49.297903 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-04e4866e-e5bd-43d5-a15c-c546a0042365 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:49.310030 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9ddf454a-35b8-42a4-91cd-6430bd91aeaf tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:49.311203 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-04e4866e-e5bd-43d5-a15c-c546a0042365 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.654238 Oct 23 01:19:49.314614 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1291/2568] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:48 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:19:49.327079 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9ddf454a-35b8-42a4-91cd-6430bd91aeaf tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:49.327079 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9ddf454a-35b8-42a4-91cd-6430bd91aeaf tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:49.327079 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9ddf454a-35b8-42a4-91cd-6430bd91aeaf tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b" status: 200 len: 1486 microversion: 2.25 time: 0.620216 Oct 23 01:19:49.334553 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1278/2569] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:19:48 2022] GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b => generated 1486 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:19:49.346485 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ca8ab66f-502b-41ed-a5e6-908821431bd2 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:49.347645 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ca8ab66f-502b-41ed-a5e6-908821431bd2 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 6ccfe45d-f080-4066-9aad-a39c3c4cd097] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:49.349957 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8723bb44-c317-472b-8071-8b98c0094525 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc613e670>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:49.355542 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca8ab66f-502b-41ed-a5e6-908821431bd2 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:49.356203 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca8ab66f-502b-41ed-a5e6-908821431bd2 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:49.356995 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca8ab66f-502b-41ed-a5e6-908821431bd2 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:49.358349 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca8ab66f-502b-41ed-a5e6-908821431bd2 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:49.359904 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca8ab66f-502b-41ed-a5e6-908821431bd2 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:49.360716 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca8ab66f-502b-41ed-a5e6-908821431bd2 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:49.414568 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8723bb44-c317-472b-8071-8b98c0094525 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/797a003c-18f3-460b-ab19-805335e36552" status: 200 len: 1439 microversion: 2.1 time: 0.078508 Oct 23 01:19:49.423689 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1279/2570] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:19:49 2022] GET /compute/v2.1/images/797a003c-18f3-460b-ab19-805335e36552 => generated 1439 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:49.426069 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6ef23f70-b7e6-438b-87e5-7db153299b1f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:49.430273 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6ef23f70-b7e6-438b-87e5-7db153299b1f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: cce77239-7b98-4389-946e-8292bf160194] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:49.440898 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6ef23f70-b7e6-438b-87e5-7db153299b1f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:49.441481 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6ef23f70-b7e6-438b-87e5-7db153299b1f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:49.441935 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6ef23f70-b7e6-438b-87e5-7db153299b1f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:49.442685 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6ef23f70-b7e6-438b-87e5-7db153299b1f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:49.446343 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6ef23f70-b7e6-438b-87e5-7db153299b1f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:49.447371 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6ef23f70-b7e6-438b-87e5-7db153299b1f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:49.476552 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-6ef23f70-b7e6-438b-87e5-7db153299b1f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] HTTP exception thrown: Instance cce77239-7b98-4389-946e-8292bf160194 could not be found. Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6ef23f70-b7e6-438b-87e5-7db153299b1f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Request method failure captured: Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/servers/cce77239-7b98-4389-946e-8292bf160194/action HTTP/1.1 Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 65 Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJZEAurAeILsYJek3MCv_ryiTbidOLVZq6W4I7jJxeY_1_bTWRye2xM3EDOhowd_NyioevvIvzT9beBCgKqri_ZjLw9hdsIISMXmajO_VmobATT_GwpY_Y-GVylQtV9MoF1-Bup_Ahjld_2riQHnDzqLUWULm2acZYcK9UIbslVsdDU Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}] Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: cd6a6c5240f94ace91e1f0ed3e53fa7c Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: {"rebuild": {"imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d"}} Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: exception: Instance cce77239-7b98-4389-946e-8292bf160194 could not be found. Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'cce77239-7b98-4389-946e-8292bf160194', 'body': {'rebuild': {'imageRef': '446b40bc-db5b-4123-9278-997bd6d04a0d'}}} Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cce77239-7b98-4389-946e-8292bf160194 could not be found. Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 23 01:19:49.478645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 23 01:19:49.482028 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 23 01:19:49.482028 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:19:49.482028 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:19:49.482028 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:19:49.482028 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:19:49.482028 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cce77239-7b98-4389-946e-8292bf160194 could not be found. Oct 23 01:19:49.482028 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:49.482028 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:49.482028 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:49.482028 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:49.482028 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:49.482028 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:49.482028 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:19:49.482028 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:19:49.482028 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cce77239-7b98-4389-946e-8292bf160194 could not be found. Oct 23 01:19:49.482028 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:49.484524 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6ef23f70-b7e6-438b-87e5-7db153299b1f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Returning 404 to user: Instance cce77239-7b98-4389-946e-8292bf160194 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:19:49.485613 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6ef23f70-b7e6-438b-87e5-7db153299b1f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "POST /compute/v2.1/servers/cce77239-7b98-4389-946e-8292bf160194/action" status: 404 len: 111 microversion: 2.1 time: 0.069125 Oct 23 01:19:49.491687 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1280/2571] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:19:49 2022] POST /compute/v2.1/servers/cce77239-7b98-4389-946e-8292bf160194/action => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:19:49.501547 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-27de8e0b-64dd-478f-bd45-1e4029fc4b46 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:49.502096 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-27de8e0b-64dd-478f-bd45-1e4029fc4b46 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:49.510130 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-27de8e0b-64dd-478f-bd45-1e4029fc4b46 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:49.510704 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-27de8e0b-64dd-478f-bd45-1e4029fc4b46 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:49.511217 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-27de8e0b-64dd-478f-bd45-1e4029fc4b46 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:49.512156 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-27de8e0b-64dd-478f-bd45-1e4029fc4b46 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:49.512589 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-27de8e0b-64dd-478f-bd45-1e4029fc4b46 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:49.513159 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-27de8e0b-64dd-478f-bd45-1e4029fc4b46 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:49.793931 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ca8ab66f-502b-41ed-a5e6-908821431bd2 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:49.821989 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ca8ab66f-502b-41ed-a5e6-908821431bd2 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097" status: 200 len: 1517 microversion: 2.1 time: 0.479564 Oct 23 01:19:49.826316 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1292/2572] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:49 2022] GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097 => generated 1517 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:49.852924 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9a40b05d-224e-42cc-a399-a1036bb2867e tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:49.858066 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9a40b05d-224e-42cc-a399-a1036bb2867e tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: 08afe605-c9f1-4d8b-98bc-9253414ebe56] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:49.875736 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a40b05d-224e-42cc-a399-a1036bb2867e tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:49.876360 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a40b05d-224e-42cc-a399-a1036bb2867e tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:49.878075 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a40b05d-224e-42cc-a399-a1036bb2867e tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:49.884149 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a40b05d-224e-42cc-a399-a1036bb2867e tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:49.886401 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a40b05d-224e-42cc-a399-a1036bb2867e tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:49.887037 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a40b05d-224e-42cc-a399-a1036bb2867e tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:50.060348 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-27de8e0b-64dd-478f-bd45-1e4029fc4b46 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:50.078774 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-27de8e0b-64dd-478f-bd45-1e4029fc4b46 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.582027 Oct 23 01:19:50.095993 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1281/2573] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:49 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:50.120187 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d15011d7-5952-4030-8dea-574ff2927a09 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:50.126791 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d15011d7-5952-4030-8dea-574ff2927a09 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:50.151875 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d15011d7-5952-4030-8dea-574ff2927a09 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:50.154988 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d15011d7-5952-4030-8dea-574ff2927a09 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:50.157469 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d15011d7-5952-4030-8dea-574ff2927a09 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:50.159668 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d15011d7-5952-4030-8dea-574ff2927a09 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:50.160450 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d15011d7-5952-4030-8dea-574ff2927a09 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:50.162955 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d15011d7-5952-4030-8dea-574ff2927a09 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:50.582540 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9a40b05d-224e-42cc-a399-a1036bb2867e tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:50.596455 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9a40b05d-224e-42cc-a399-a1036bb2867e tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56" status: 200 len: 1506 microversion: 2.1 time: 0.762484 Oct 23 01:19:50.597669 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1293/2574] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:49 2022] GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56 => generated 1506 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:50.661852 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d15011d7-5952-4030-8dea-574ff2927a09 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:50.672108 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d15011d7-5952-4030-8dea-574ff2927a09 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.566813 Oct 23 01:19:50.673285 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1282/2575] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:50 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:50.689120 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f36d3f37-8f53-446e-a4ff-536656496044 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:50.689464 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f36d3f37-8f53-446e-a4ff-536656496044 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:50.697136 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f36d3f37-8f53-446e-a4ff-536656496044 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:50.697740 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f36d3f37-8f53-446e-a4ff-536656496044 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:50.698283 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f36d3f37-8f53-446e-a4ff-536656496044 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:50.699186 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f36d3f37-8f53-446e-a4ff-536656496044 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:50.699725 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f36d3f37-8f53-446e-a4ff-536656496044 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:50.700221 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f36d3f37-8f53-446e-a4ff-536656496044 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:50.957640 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f36d3f37-8f53-446e-a4ff-536656496044 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:50.961352 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:19:50.977308 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f36d3f37-8f53-446e-a4ff-536656496044 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:50.979059 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f36d3f37-8f53-446e-a4ff-536656496044 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:50.980636 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f36d3f37-8f53-446e-a4ff-536656496044 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b" status: 200 len: 1486 microversion: 2.25 time: 0.305949 Oct 23 01:19:50.981437 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1283/2576] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:19:50 2022] GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b => generated 1486 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:19:50.987740 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-42622eb5-03b7-4a53-a566-6bd911a56f03 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc61a5a60>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:51.073903 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-42622eb5-03b7-4a53-a566-6bd911a56f03 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/797a003c-18f3-460b-ab19-805335e36552" status: 200 len: 1439 microversion: 2.1 time: 0.091049 Oct 23 01:19:51.075599 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1284/2577] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:19:50 2022] GET /compute/v2.1/images/797a003c-18f3-460b-ab19-805335e36552 => generated 1439 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:51.080794 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-059dafeb-a348-42d2-9d67-dbc9a7e375ba tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:51.084226 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-059dafeb-a348-42d2-9d67-dbc9a7e375ba tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 624b58b2-052f-4b92-bb09-92746efac5e9] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:51.092077 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-059dafeb-a348-42d2-9d67-dbc9a7e375ba tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] HTTP exception thrown: Instance 624b58b2-052f-4b92-bb09-92746efac5e9 could not be found. Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-059dafeb-a348-42d2-9d67-dbc9a7e375ba tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Request method failure captured: Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/servers/624b58b2-052f-4b92-bb09-92746efac5e9/action HTTP/1.1 Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 65 Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJZEAurAeILsYJek3MCv_ryiTbidOLVZq6W4I7jJxeY_1_bTWRye2xM3EDOhowd_NyioevvIvzT9beBCgKqri_ZjLw9hdsIISMXmajO_VmobATT_GwpY_Y-GVylQtV9MoF1-Bup_Ahjld_2riQHnDzqLUWULm2acZYcK9UIbslVsdDU Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}] Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: cd6a6c5240f94ace91e1f0ed3e53fa7c Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: {"rebuild": {"imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d"}} Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 624b58b2-052f-4b92-bb09-92746efac5e9 could not be found. Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '624b58b2-052f-4b92-bb09-92746efac5e9', 'body': {'rebuild': {'imageRef': '446b40bc-db5b-4123-9278-997bd6d04a0d'}}} Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 624b58b2-052f-4b92-bb09-92746efac5e9 could not be found. Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 23 01:19:51.095302 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:19:51.098760 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:19:51.098760 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:19:51.098760 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:19:51.098760 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 624b58b2-052f-4b92-bb09-92746efac5e9 could not be found. Oct 23 01:19:51.098760 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:51.098760 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:51.098760 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:51.098760 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:51.098760 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:51.098760 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:51.098760 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:19:51.098760 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:19:51.098760 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 624b58b2-052f-4b92-bb09-92746efac5e9 could not be found. Oct 23 01:19:51.098760 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:51.101725 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-059dafeb-a348-42d2-9d67-dbc9a7e375ba tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Returning 404 to user: Instance 624b58b2-052f-4b92-bb09-92746efac5e9 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:19:51.102888 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-059dafeb-a348-42d2-9d67-dbc9a7e375ba tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "POST /compute/v2.1/servers/624b58b2-052f-4b92-bb09-92746efac5e9/action" status: 404 len: 111 microversion: 2.1 time: 0.025977 Oct 23 01:19:51.104089 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1285/2578] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:19:51 2022] POST /compute/v2.1/servers/624b58b2-052f-4b92-bb09-92746efac5e9/action => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:19:51.110193 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0beacb3a-ab20-44dd-9e15-53b3c367b626 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:51.111155 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0beacb3a-ab20-44dd-9e15-53b3c367b626 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 6ccfe45d-f080-4066-9aad-a39c3c4cd097] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:51.120151 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0beacb3a-ab20-44dd-9e15-53b3c367b626 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:51.120799 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0beacb3a-ab20-44dd-9e15-53b3c367b626 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:51.121348 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0beacb3a-ab20-44dd-9e15-53b3c367b626 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:51.122227 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0beacb3a-ab20-44dd-9e15-53b3c367b626 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:51.122801 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0beacb3a-ab20-44dd-9e15-53b3c367b626 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:51.123358 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0beacb3a-ab20-44dd-9e15-53b3c367b626 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:51.261727 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6b2f3fd0-3ea2-4339-8ba9-a521b9defe24 tempest-AZV2TestJSON-813968611 tempest-AZV2TestJSON-813968611-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:51.263328 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6b2f3fd0-3ea2-4339-8ba9-a521b9defe24 tempest-AZV2TestJSON-813968611 tempest-AZV2TestJSON-813968611-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:51.264211 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6b2f3fd0-3ea2-4339-8ba9-a521b9defe24 tempest-AZV2TestJSON-813968611 tempest-AZV2TestJSON-813968611-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:51.264800 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6b2f3fd0-3ea2-4339-8ba9-a521b9defe24 tempest-AZV2TestJSON-813968611 tempest-AZV2TestJSON-813968611-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:51.266244 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6b2f3fd0-3ea2-4339-8ba9-a521b9defe24 tempest-AZV2TestJSON-813968611 tempest-AZV2TestJSON-813968611-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:51.269639 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6b2f3fd0-3ea2-4339-8ba9-a521b9defe24 tempest-AZV2TestJSON-813968611 tempest-AZV2TestJSON-813968611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:51.270106 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6b2f3fd0-3ea2-4339-8ba9-a521b9defe24 tempest-AZV2TestJSON-813968611 tempest-AZV2TestJSON-813968611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:51.329091 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6b2f3fd0-3ea2-4339-8ba9-a521b9defe24 tempest-AZV2TestJSON-813968611 tempest-AZV2TestJSON-813968611-project] 10.222.0.42 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.729966 Oct 23 01:19:51.329594 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1294/2579] 10.222.0.42 () {58 vars in 1164 bytes} [Sun Oct 23 01:19:50 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:19:51.350204 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a61455d8-befa-426b-8e6f-05ca0eceb08a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:51.363740 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a61455d8-befa-426b-8e6f-05ca0eceb08a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:51.389593 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a61455d8-befa-426b-8e6f-05ca0eceb08a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:51.390699 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a61455d8-befa-426b-8e6f-05ca0eceb08a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:51.396479 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a61455d8-befa-426b-8e6f-05ca0eceb08a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:51.400147 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a61455d8-befa-426b-8e6f-05ca0eceb08a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:51.400982 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a61455d8-befa-426b-8e6f-05ca0eceb08a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:51.404130 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a61455d8-befa-426b-8e6f-05ca0eceb08a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:51.407375 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0beacb3a-ab20-44dd-9e15-53b3c367b626 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:51.419115 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0beacb3a-ab20-44dd-9e15-53b3c367b626 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097" status: 200 len: 1517 microversion: 2.1 time: 0.313646 Oct 23 01:19:51.437632 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1286/2580] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:51 2022] GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097 => generated 1517 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:51.729784 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a61455d8-befa-426b-8e6f-05ca0eceb08a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:51.740398 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a61455d8-befa-426b-8e6f-05ca0eceb08a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.392778 Oct 23 01:19:51.740398 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1295/2581] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:51 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:51.743652 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-afdd3102-502a-48db-9419-6e5aef2e10b5 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:51.744259 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-afdd3102-502a-48db-9419-6e5aef2e10b5 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: 08afe605-c9f1-4d8b-98bc-9253414ebe56] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:51.750520 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-afdd3102-502a-48db-9419-6e5aef2e10b5 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:51.752090 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-afdd3102-502a-48db-9419-6e5aef2e10b5 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:51.752691 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-afdd3102-502a-48db-9419-6e5aef2e10b5 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:51.753534 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-afdd3102-502a-48db-9419-6e5aef2e10b5 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:51.754164 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-afdd3102-502a-48db-9419-6e5aef2e10b5 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:51.754737 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-afdd3102-502a-48db-9419-6e5aef2e10b5 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:52.022683 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-afdd3102-502a-48db-9419-6e5aef2e10b5 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:52.032331 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-afdd3102-502a-48db-9419-6e5aef2e10b5 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56" status: 200 len: 1506 microversion: 2.1 time: 0.292306 Oct 23 01:19:52.051349 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1296/2582] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:51 2022] GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56 => generated 1506 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:52.057409 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-97fdfdb2-1fce-458f-9878-844a03847753 req-608b715c-425e-4333-98d9-328e3b39f378 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b", "name": "network-vif-unplugged", "status": "completed", "tag": "5f7a3666-2b64-4e04-b1a0-59950284bbc9"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:52.074356 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-97fdfdb2-1fce-458f-9878-844a03847753 req-608b715c-425e-4333-98d9-328e3b39f378 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:52.076865 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-97fdfdb2-1fce-458f-9878-844a03847753 req-608b715c-425e-4333-98d9-328e3b39f378 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:52.077534 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-97fdfdb2-1fce-458f-9878-844a03847753 req-608b715c-425e-4333-98d9-328e3b39f378 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:52.106995 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-97fdfdb2-1fce-458f-9878-844a03847753 req-608b715c-425e-4333-98d9-328e3b39f378 service nova] Creating event network-vif-unplugged:5f7a3666-2b64-4e04-b1a0-59950284bbc9 for instance 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b on n-h2-master-1 Oct 23 01:19:52.125223 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-97fdfdb2-1fce-458f-9878-844a03847753 req-608b715c-425e-4333-98d9-328e3b39f378 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071032 Oct 23 01:19:52.126318 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1297/2583] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:19:52.142905 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7eac3324-2e3d-4119-bb90-f64aa1cb870e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:52.144031 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7eac3324-2e3d-4119-bb90-f64aa1cb870e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:52.150601 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7eac3324-2e3d-4119-bb90-f64aa1cb870e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:52.151444 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7eac3324-2e3d-4119-bb90-f64aa1cb870e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:52.152086 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7eac3324-2e3d-4119-bb90-f64aa1cb870e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:52.155336 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7eac3324-2e3d-4119-bb90-f64aa1cb870e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:52.156115 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7eac3324-2e3d-4119-bb90-f64aa1cb870e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:52.156758 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7eac3324-2e3d-4119-bb90-f64aa1cb870e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:52.199674 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:19:52.350716 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-145307b3-23e2-4eef-a1a6-bbdae2d283c4 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-171024360", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "f8417aaf-b203-40b1-b57a-a5c1f85367e0"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:52.372204 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7eac3324-2e3d-4119-bb90-f64aa1cb870e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:52.388973 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7eac3324-2e3d-4119-bb90-f64aa1cb870e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.260967 Oct 23 01:19:52.389862 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1298/2584] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:52 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:52.396182 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-33a51a5c-12bf-4547-81d7-ecee5ac440d2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:52.400661 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-33a51a5c-12bf-4547-81d7-ecee5ac440d2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:52.414291 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-33a51a5c-12bf-4547-81d7-ecee5ac440d2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:52.418322 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-33a51a5c-12bf-4547-81d7-ecee5ac440d2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:52.419084 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-33a51a5c-12bf-4547-81d7-ecee5ac440d2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:52.420925 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-33a51a5c-12bf-4547-81d7-ecee5ac440d2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:52.422656 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-33a51a5c-12bf-4547-81d7-ecee5ac440d2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:52.423278 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-33a51a5c-12bf-4547-81d7-ecee5ac440d2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:52.534198 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-145307b3-23e2-4eef-a1a6-bbdae2d283c4 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] validate_networks() for [('f8417aaf-b203-40b1-b57a-a5c1f85367e0', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:19:53.028903 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-33a51a5c-12bf-4547-81d7-ecee5ac440d2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:53.044838 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-33a51a5c-12bf-4547-81d7-ecee5ac440d2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:53.050177 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-33a51a5c-12bf-4547-81d7-ecee5ac440d2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:53.052490 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-33a51a5c-12bf-4547-81d7-ecee5ac440d2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b" status: 200 len: 1486 microversion: 2.25 time: 0.660038 Oct 23 01:19:53.054527 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1299/2585] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:19:52 2022] GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b => generated 1486 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:19:53.082940 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1d631eb3-4e23-4688-9387-e5ea3ba2a195 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc6192ca0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:53.174523 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1d631eb3-4e23-4688-9387-e5ea3ba2a195 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/797a003c-18f3-460b-ab19-805335e36552" status: 200 len: 1439 microversion: 2.1 time: 0.107258 Oct 23 01:19:53.180875 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1300/2586] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:19:53 2022] GET /compute/v2.1/images/797a003c-18f3-460b-ab19-805335e36552 => generated 1439 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:53.199983 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-76e2510a-62ea-4fd2-9221-91011f8d85d5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:53.204010 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-76e2510a-62ea-4fd2-9221-91011f8d85d5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 906e0bf0-0768-46e1-bc2c-15b637dd5ea1] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:53.226228 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-76e2510a-62ea-4fd2-9221-91011f8d85d5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] HTTP exception thrown: Instance 906e0bf0-0768-46e1-bc2c-15b637dd5ea1 could not be found. Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-76e2510a-62ea-4fd2-9221-91011f8d85d5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Request method failure captured: Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/servers/906e0bf0-0768-46e1-bc2c-15b637dd5ea1/action HTTP/1.1 Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 15 Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJZEAurAeILsYJek3MCv_ryiTbidOLVZq6W4I7jJxeY_1_bTWRye2xM3EDOhowd_NyioevvIvzT9beBCgKqri_ZjLw9hdsIISMXmajO_VmobATT_GwpY_Y-GVylQtV9MoF1-Bup_Ahjld_2riQHnDzqLUWULm2acZYcK9UIbslVsdDU Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}] Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: cd6a6c5240f94ace91e1f0ed3e53fa7c Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: {"restore": {}} Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 906e0bf0-0768-46e1-bc2c-15b637dd5ea1 could not be found. Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '906e0bf0-0768-46e1-bc2c-15b637dd5ea1', 'body': {'restore': {}}} Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 906e0bf0-0768-46e1-bc2c-15b637dd5ea1 could not be found. Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 906e0bf0-0768-46e1-bc2c-15b637dd5ea1 could not be found. Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:53.238040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:53.242297 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:19:53.242297 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:19:53.242297 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 906e0bf0-0768-46e1-bc2c-15b637dd5ea1 could not be found. Oct 23 01:19:53.242297 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:53.242297 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-76e2510a-62ea-4fd2-9221-91011f8d85d5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Returning 404 to user: Instance 906e0bf0-0768-46e1-bc2c-15b637dd5ea1 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:19:53.243675 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-76e2510a-62ea-4fd2-9221-91011f8d85d5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "POST /compute/v2.1/servers/906e0bf0-0768-46e1-bc2c-15b637dd5ea1/action" status: 404 len: 111 microversion: 2.1 time: 0.054159 Oct 23 01:19:53.246645 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1301/2587] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:19:53 2022] POST /compute/v2.1/servers/906e0bf0-0768-46e1-bc2c-15b637dd5ea1/action => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:19:53.258665 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-12553d77-ec87-4f67-b2fa-0a5475bc6583 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:53.259527 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-12553d77-ec87-4f67-b2fa-0a5475bc6583 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 6ccfe45d-f080-4066-9aad-a39c3c4cd097] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:53.272740 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-12553d77-ec87-4f67-b2fa-0a5475bc6583 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:53.273888 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-12553d77-ec87-4f67-b2fa-0a5475bc6583 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:53.277315 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-12553d77-ec87-4f67-b2fa-0a5475bc6583 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:53.279145 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-12553d77-ec87-4f67-b2fa-0a5475bc6583 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:53.280277 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-12553d77-ec87-4f67-b2fa-0a5475bc6583 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:53.281382 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-12553d77-ec87-4f67-b2fa-0a5475bc6583 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:53.617072 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-12553d77-ec87-4f67-b2fa-0a5475bc6583 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:53.626623 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-12553d77-ec87-4f67-b2fa-0a5475bc6583 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097" status: 200 len: 1517 microversion: 2.1 time: 0.378487 Oct 23 01:19:53.640760 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1302/2588] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:53 2022] GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097 => generated 1517 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:53.654062 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-de3e4a7e-136e-4c39-94f1-8351af7d0502 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:53.654862 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-de3e4a7e-136e-4c39-94f1-8351af7d0502 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: 08afe605-c9f1-4d8b-98bc-9253414ebe56] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:53.665877 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-de3e4a7e-136e-4c39-94f1-8351af7d0502 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:53.667269 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-de3e4a7e-136e-4c39-94f1-8351af7d0502 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:53.667881 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-de3e4a7e-136e-4c39-94f1-8351af7d0502 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:53.669185 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-de3e4a7e-136e-4c39-94f1-8351af7d0502 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:53.669780 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-de3e4a7e-136e-4c39-94f1-8351af7d0502 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:53.670469 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-de3e4a7e-136e-4c39-94f1-8351af7d0502 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:53.692480 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-145307b3-23e2-4eef-a1a6-bbdae2d283c4 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:19:53.701038 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-145307b3-23e2-4eef-a1a6-bbdae2d283c4 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:19:53.701038 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-145307b3-23e2-4eef-a1a6-bbdae2d283c4 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:19:53.701038 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-145307b3-23e2-4eef-a1a6-bbdae2d283c4 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:19:53.701038 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-145307b3-23e2-4eef-a1a6-bbdae2d283c4 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:19:53.709524 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-145307b3-23e2-4eef-a1a6-bbdae2d283c4 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:53.712207 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-145307b3-23e2-4eef-a1a6-bbdae2d283c4 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:53.712715 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-145307b3-23e2-4eef-a1a6-bbdae2d283c4 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:53.714936 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-145307b3-23e2-4eef-a1a6-bbdae2d283c4 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:53.716330 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-145307b3-23e2-4eef-a1a6-bbdae2d283c4 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:53.718809 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-145307b3-23e2-4eef-a1a6-bbdae2d283c4 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:53.756910 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-145307b3-23e2-4eef-a1a6-bbdae2d283c4 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Getting quotas for project d55fb3f415da42eeb5d5514410670b29. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:19:53.764919 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-145307b3-23e2-4eef-a1a6-bbdae2d283c4 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Getting quotas for user 86eb8880d07649b08bfe76a68901d81c and project d55fb3f415da42eeb5d5514410670b29. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:19:53.787535 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-145307b3-23e2-4eef-a1a6-bbdae2d283c4 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:19:53.791373 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-145307b3-23e2-4eef-a1a6-bbdae2d283c4 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] [instance: 9ed76d3e-f334-4835-91f8-8bcbc1076b60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:19:53.954883 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-de3e4a7e-136e-4c39-94f1-8351af7d0502 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:53.965264 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-de3e4a7e-136e-4c39-94f1-8351af7d0502 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56" status: 200 len: 1506 microversion: 2.1 time: 0.334123 Oct 23 01:19:53.977030 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1303/2589] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:53 2022] GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56 => generated 1506 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:53.986464 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b9f4f741-f983-43d4-86dc-0c6d6274e87a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:53.987295 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b9f4f741-f983-43d4-86dc-0c6d6274e87a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:53.994670 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=100 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:19:53.996729 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9f4f741-f983-43d4-86dc-0c6d6274e87a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:53.997260 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9f4f741-f983-43d4-86dc-0c6d6274e87a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:53.998476 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9f4f741-f983-43d4-86dc-0c6d6274e87a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:54.000157 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9f4f741-f983-43d4-86dc-0c6d6274e87a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:54.000312 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9f4f741-f983-43d4-86dc-0c6d6274e87a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:54.001689 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9f4f741-f983-43d4-86dc-0c6d6274e87a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:54.007085 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-145307b3-23e2-4eef-a1a6-bbdae2d283c4 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.567069 Oct 23 01:19:54.008213 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1287/2590] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:19:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:19:54.037858 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5b7db104-bbfe-4d35-af48-228b6939ceed tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:54.038959 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5b7db104-bbfe-4d35-af48-228b6939ceed tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] [instance: 9ed76d3e-f334-4835-91f8-8bcbc1076b60] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:54.255804 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5b7db104-bbfe-4d35-af48-228b6939ceed tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eb8880d07649b08bfe76a68901d81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55fb3f415da42eeb5d5514410670b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:54.269364 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5b7db104-bbfe-4d35-af48-228b6939ceed tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed76d3e-f334-4835-91f8-8bcbc1076b60" status: 200 len: 1216 microversion: 2.1 time: 0.239765 Oct 23 01:19:54.269364 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1288/2591] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:54 2022] GET /compute/v2.1/servers/9ed76d3e-f334-4835-91f8-8bcbc1076b60 => generated 1216 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:54.274396 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fed2b452-328c-4908-b874-e6b5d81d2562 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:54.275029 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fed2b452-328c-4908-b874-e6b5d81d2562 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:54.292650 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fed2b452-328c-4908-b874-e6b5d81d2562 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:54.294716 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fed2b452-328c-4908-b874-e6b5d81d2562 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:54.298077 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fed2b452-328c-4908-b874-e6b5d81d2562 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:54.298077 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fed2b452-328c-4908-b874-e6b5d81d2562 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:54.298077 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fed2b452-328c-4908-b874-e6b5d81d2562 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:54.298077 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fed2b452-328c-4908-b874-e6b5d81d2562 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:54.580387 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b9f4f741-f983-43d4-86dc-0c6d6274e87a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:54.592322 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b9f4f741-f983-43d4-86dc-0c6d6274e87a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.613311 Oct 23 01:19:54.594700 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1304/2592] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:53 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:54.615972 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9792324f-82c6-41fb-8995-335d532b7f0f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc6192ee0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:54.694474 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fed2b452-328c-4908-b874-e6b5d81d2562 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:54.715371 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fed2b452-328c-4908-b874-e6b5d81d2562 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:54.725237 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9792324f-82c6-41fb-8995-335d532b7f0f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/797a003c-18f3-460b-ab19-805335e36552" status: 200 len: 1439 microversion: 2.1 time: 0.129029 Oct 23 01:19:54.726194 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1305/2593] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:19:54 2022] GET /compute/v2.1/images/797a003c-18f3-460b-ab19-805335e36552 => generated 1439 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:54.728655 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fed2b452-328c-4908-b874-e6b5d81d2562 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:54.730066 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fed2b452-328c-4908-b874-e6b5d81d2562 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b" status: 200 len: 1486 microversion: 2.25 time: 0.462542 Oct 23 01:19:54.735387 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1289/2594] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:19:54 2022] GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b => generated 1486 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:19:54.735689 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-ddfd9867-9e9d-44b8-af3a-431c98073303 req-d2b7b28d-e4ee-460c-a037-c1a9eef7afd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b", "tag": "5f7a3666-2b64-4e04-b1a0-59950284bbc9"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:54.743678 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ddfd9867-9e9d-44b8-af3a-431c98073303 req-d2b7b28d-e4ee-460c-a037-c1a9eef7afd6 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:54.744613 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ddfd9867-9e9d-44b8-af3a-431c98073303 req-d2b7b28d-e4ee-460c-a037-c1a9eef7afd6 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:54.745234 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ddfd9867-9e9d-44b8-af3a-431c98073303 req-d2b7b28d-e4ee-460c-a037-c1a9eef7afd6 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:54.755551 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-26381f28-df11-4843-933a-52ececede278 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:54.759684 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-26381f28-df11-4843-933a-52ececede278 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:54.763617 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-ddfd9867-9e9d-44b8-af3a-431c98073303 req-d2b7b28d-e4ee-460c-a037-c1a9eef7afd6 service nova] Creating event network-changed:5f7a3666-2b64-4e04-b1a0-59950284bbc9 for instance 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b on n-h2-master-1 Oct 23 01:19:54.773433 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-ddfd9867-9e9d-44b8-af3a-431c98073303 req-d2b7b28d-e4ee-460c-a037-c1a9eef7afd6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045664 Oct 23 01:19:54.775809 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1306/2595] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:19:54.777885 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-26381f28-df11-4843-933a-52ececede278 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:54.779632 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-26381f28-df11-4843-933a-52ececede278 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:54.780080 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-26381f28-df11-4843-933a-52ececede278 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:54.783436 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-26381f28-df11-4843-933a-52ececede278 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:54.783937 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-26381f28-df11-4843-933a-52ececede278 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:54.784375 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-26381f28-df11-4843-933a-52ececede278 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:54.789893 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-942ef97d-2c9b-4f6c-9659-94b20f3fb898 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:54.790662 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-942ef97d-2c9b-4f6c-9659-94b20f3fb898 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 6ccfe45d-f080-4066-9aad-a39c3c4cd097] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:54.808550 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-942ef97d-2c9b-4f6c-9659-94b20f3fb898 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:54.810948 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-942ef97d-2c9b-4f6c-9659-94b20f3fb898 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:54.811409 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-942ef97d-2c9b-4f6c-9659-94b20f3fb898 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:54.815657 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-942ef97d-2c9b-4f6c-9659-94b20f3fb898 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:54.815657 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-942ef97d-2c9b-4f6c-9659-94b20f3fb898 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:54.815657 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-942ef97d-2c9b-4f6c-9659-94b20f3fb898 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:55.203415 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-942ef97d-2c9b-4f6c-9659-94b20f3fb898 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:55.228733 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-942ef97d-2c9b-4f6c-9659-94b20f3fb898 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097" status: 200 len: 1517 microversion: 2.1 time: 0.449958 Oct 23 01:19:55.232053 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1307/2596] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:54 2022] GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097 => generated 1517 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:55.245803 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c743390b-1853-43ba-b68c-d33aaa171196 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:55.251184 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c743390b-1853-43ba-b68c-d33aaa171196 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: 08afe605-c9f1-4d8b-98bc-9253414ebe56] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:55.267507 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-26381f28-df11-4843-933a-52ececede278 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:55.280413 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-26381f28-df11-4843-933a-52ececede278 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.545934 Oct 23 01:19:55.281487 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1290/2597] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:54 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:55.287135 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c743390b-1853-43ba-b68c-d33aaa171196 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:55.287666 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c743390b-1853-43ba-b68c-d33aaa171196 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:55.300704 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c743390b-1853-43ba-b68c-d33aaa171196 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:55.301668 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c743390b-1853-43ba-b68c-d33aaa171196 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:55.302446 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c743390b-1853-43ba-b68c-d33aaa171196 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:55.302886 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c743390b-1853-43ba-b68c-d33aaa171196 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:55.309691 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9e596625-5c4b-49c2-85d4-f158de79871d tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:55.323337 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9e596625-5c4b-49c2-85d4-f158de79871d tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] [instance: 9ed76d3e-f334-4835-91f8-8bcbc1076b60] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:55.493550 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9e596625-5c4b-49c2-85d4-f158de79871d tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eb8880d07649b08bfe76a68901d81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55fb3f415da42eeb5d5514410670b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:55.502097 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9e596625-5c4b-49c2-85d4-f158de79871d tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed76d3e-f334-4835-91f8-8bcbc1076b60" status: 200 len: 1216 microversion: 2.1 time: 0.203877 Oct 23 01:19:55.522225 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1291/2598] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:55 2022] GET /compute/v2.1/servers/9ed76d3e-f334-4835-91f8-8bcbc1076b60 => generated 1216 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:55.527466 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-eeb5578e-6b1c-4756-ad47-db358d54c50d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:55.531260 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-eeb5578e-6b1c-4756-ad47-db358d54c50d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:55.568556 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eeb5578e-6b1c-4756-ad47-db358d54c50d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:55.569218 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eeb5578e-6b1c-4756-ad47-db358d54c50d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:55.569720 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eeb5578e-6b1c-4756-ad47-db358d54c50d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:55.570471 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eeb5578e-6b1c-4756-ad47-db358d54c50d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:55.570937 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eeb5578e-6b1c-4756-ad47-db358d54c50d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:55.578571 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eeb5578e-6b1c-4756-ad47-db358d54c50d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:55.635306 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-eeb5578e-6b1c-4756-ad47-db358d54c50d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] HTTP exception thrown: Cannot 'restore' instance 62a8ad26-f65b-432d-a8da-48264c426335 while it is in vm_state active Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-eeb5578e-6b1c-4756-ad47-db358d54c50d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Request method failure captured: Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335/action HTTP/1.1 Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 15 Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJZEAurAeILsYJek3MCv_ryiTbidOLVZq6W4I7jJxeY_1_bTWRye2xM3EDOhowd_NyioevvIvzT9beBCgKqri_ZjLw9hdsIISMXmajO_VmobATT_GwpY_Y-GVylQtV9MoF1-Bup_Ahjld_2riQHnDzqLUWULm2acZYcK9UIbslVsdDU Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}] Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: cd6a6c5240f94ace91e1f0ed3e53fa7c Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: {"restore": {}} Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: exception: Cannot 'restore' instance 62a8ad26-f65b-432d-a8da-48264c426335 while it is in vm_state active Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '62a8ad26-f65b-432d-a8da-48264c426335', 'body': {'restore': {}}} Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 62a8ad26-f65b-432d-a8da-48264c426335 in vm_state active. Cannot restore while the instance is in this state. Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 62a8ad26-f65b-432d-a8da-48264c426335 while it is in vm_state active Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:55.638817 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:55.647579 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:55.647579 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:19:55.647579 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:19:55.647579 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 62a8ad26-f65b-432d-a8da-48264c426335 while it is in vm_state active Oct 23 01:19:55.647579 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:55.647579 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-eeb5578e-6b1c-4756-ad47-db358d54c50d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Returning 409 to user: Cannot 'restore' instance 62a8ad26-f65b-432d-a8da-48264c426335 while it is in vm_state active {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:19:55.647579 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-eeb5578e-6b1c-4756-ad47-db358d54c50d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "POST /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335/action" status: 409 len: 145 microversion: 2.1 time: 0.118479 Oct 23 01:19:55.647579 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1292/2599] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:19:55 2022] POST /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335/action => generated 145 bytes in 120 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:19:55.664884 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1e4957ef-fcc8-4141-8ba8-b326b51c0484 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:55.665829 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1e4957ef-fcc8-4141-8ba8-b326b51c0484 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:55.678446 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1e4957ef-fcc8-4141-8ba8-b326b51c0484 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:55.681210 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1e4957ef-fcc8-4141-8ba8-b326b51c0484 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:55.684123 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1e4957ef-fcc8-4141-8ba8-b326b51c0484 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:55.685494 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1e4957ef-fcc8-4141-8ba8-b326b51c0484 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:55.687592 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1e4957ef-fcc8-4141-8ba8-b326b51c0484 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:55.690349 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1e4957ef-fcc8-4141-8ba8-b326b51c0484 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:55.795925 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:19:55.801663 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c743390b-1853-43ba-b68c-d33aaa171196 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:55.811472 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c743390b-1853-43ba-b68c-d33aaa171196 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56" status: 200 len: 1486 microversion: 2.1 time: 0.578327 Oct 23 01:19:55.827384 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1308/2600] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:55 2022] GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56 => generated 1486 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:55.843867 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3c99aa13-40e8-496d-8009-ef4ee762040b tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc62e5940>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:55.948780 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3c99aa13-40e8-496d-8009-ef4ee762040b tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/797a003c-18f3-460b-ab19-805335e36552" status: 200 len: 1439 microversion: 2.1 time: 0.119562 Oct 23 01:19:55.950457 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1309/2601] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:19:55 2022] GET /compute/v2.1/images/797a003c-18f3-460b-ab19-805335e36552 => generated 1439 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:55.964887 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8a777170-590f-48a0-b4f8-03f1f68fdbdb tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:55.965917 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8a777170-590f-48a0-b4f8-03f1f68fdbdb tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:55.979582 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a777170-590f-48a0-b4f8-03f1f68fdbdb tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:55.981251 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a777170-590f-48a0-b4f8-03f1f68fdbdb tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:55.981848 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a777170-590f-48a0-b4f8-03f1f68fdbdb tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:55.982743 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a777170-590f-48a0-b4f8-03f1f68fdbdb tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:55.983656 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a777170-590f-48a0-b4f8-03f1f68fdbdb tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:55.985201 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a777170-590f-48a0-b4f8-03f1f68fdbdb tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:56.168865 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1e4957ef-fcc8-4141-8ba8-b326b51c0484 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:56.186689 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1e4957ef-fcc8-4141-8ba8-b326b51c0484 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.536130 Oct 23 01:19:56.188514 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1293/2602] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:55 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:56.195074 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4881318a-b4bf-4222-873a-aace9deef8b8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1788666191", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:56.332398 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-4881318a-b4bf-4222-873a-aace9deef8b8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] validate_networks() for [('2a59b95d-281b-41be-a60e-c180887e0003', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:19:56.431398 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8a777170-590f-48a0-b4f8-03f1f68fdbdb tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:56.447723 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8a777170-590f-48a0-b4f8-03f1f68fdbdb tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:56.458390 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8a777170-590f-48a0-b4f8-03f1f68fdbdb tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:56.464928 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8a777170-590f-48a0-b4f8-03f1f68fdbdb tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b" status: 200 len: 1486 microversion: 2.25 time: 0.509750 Oct 23 01:19:56.468249 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1310/2603] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:19:55 2022] GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b => generated 1486 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:19:56.488291 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-708acf2c-f92e-4e89-a99c-e2e503ae7613 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:56.504735 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-708acf2c-f92e-4e89-a99c-e2e503ae7613 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:56.513200 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-708acf2c-f92e-4e89-a99c-e2e503ae7613 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:56.514284 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-708acf2c-f92e-4e89-a99c-e2e503ae7613 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:56.514927 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-708acf2c-f92e-4e89-a99c-e2e503ae7613 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:56.516364 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-708acf2c-f92e-4e89-a99c-e2e503ae7613 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:56.518396 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-708acf2c-f92e-4e89-a99c-e2e503ae7613 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:56.518999 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-708acf2c-f92e-4e89-a99c-e2e503ae7613 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:56.786296 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-708acf2c-f92e-4e89-a99c-e2e503ae7613 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:56.799987 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-708acf2c-f92e-4e89-a99c-e2e503ae7613 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.330601 Oct 23 01:19:56.801312 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1311/2604] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:56 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:56.822901 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-063078c1-e03a-4fd6-8a60-7077f0f43853 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:56.826207 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-063078c1-e03a-4fd6-8a60-7077f0f43853 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 6ccfe45d-f080-4066-9aad-a39c3c4cd097] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:56.836464 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-063078c1-e03a-4fd6-8a60-7077f0f43853 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:56.837325 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-063078c1-e03a-4fd6-8a60-7077f0f43853 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:56.837965 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-063078c1-e03a-4fd6-8a60-7077f0f43853 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:56.839068 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-063078c1-e03a-4fd6-8a60-7077f0f43853 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:56.839836 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-063078c1-e03a-4fd6-8a60-7077f0f43853 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:56.840429 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-063078c1-e03a-4fd6-8a60-7077f0f43853 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:57.167672 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-063078c1-e03a-4fd6-8a60-7077f0f43853 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:57.181721 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-063078c1-e03a-4fd6-8a60-7077f0f43853 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097" status: 200 len: 1517 microversion: 2.1 time: 0.378895 Oct 23 01:19:57.193429 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1312/2605] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:56 2022] GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097 => generated 1517 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:57.332179 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-4881318a-b4bf-4222-873a-aace9deef8b8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:19:57.332179 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-4881318a-b4bf-4222-873a-aace9deef8b8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:19:57.332179 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-4881318a-b4bf-4222-873a-aace9deef8b8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:19:57.332179 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-4881318a-b4bf-4222-873a-aace9deef8b8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:19:57.332179 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-4881318a-b4bf-4222-873a-aace9deef8b8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:19:57.349203 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4881318a-b4bf-4222-873a-aace9deef8b8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:57.349772 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4881318a-b4bf-4222-873a-aace9deef8b8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:57.350581 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4881318a-b4bf-4222-873a-aace9deef8b8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:57.351447 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4881318a-b4bf-4222-873a-aace9deef8b8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:57.351571 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ef18440d-4c4b-4ce6-a70b-9d5262570f1c tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Calling method '.version_select at 0x7f5cc62741f0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:57.352118 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4881318a-b4bf-4222-873a-aace9deef8b8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:57.352689 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4881318a-b4bf-4222-873a-aace9deef8b8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:57.385888 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-4881318a-b4bf-4222-873a-aace9deef8b8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Getting quotas for project ed372b4663a94ff1ba20abe32e2f9e77. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:19:57.409315 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-4881318a-b4bf-4222-873a-aace9deef8b8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Getting quotas for user 3838dd33052740fa88b9cf2888c208ff and project ed372b4663a94ff1ba20abe32e2f9e77. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:19:57.419986 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:19:57.449095 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4881318a-b4bf-4222-873a-aace9deef8b8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:19:57.456491 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4881318a-b4bf-4222-873a-aace9deef8b8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: ad3fdbf4-6dba-46a6-9132-e555185544b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:19:57.506603 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ef18440d-4c4b-4ce6-a70b-9d5262570f1c tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/5b9136074f0b46428cd4a61e68be10a2" status: 200 len: 371 microversion: 2.1 time: 0.321343 Oct 23 01:19:57.508081 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1313/2606] 10.222.0.42 () {58 vars in 1242 bytes} [Sun Oct 23 01:19:57 2022] GET /compute/v2.1/os-quota-sets/5b9136074f0b46428cd4a61e68be10a2 => generated 371 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:19:57.514393 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0554c323-eb16-4f48-8b09-dd8476510d69 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:57.515456 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0554c323-eb16-4f48-8b09-dd8476510d69 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] [instance: 9ed76d3e-f334-4835-91f8-8bcbc1076b60] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:57.524366 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0554c323-eb16-4f48-8b09-dd8476510d69 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:57.525181 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0554c323-eb16-4f48-8b09-dd8476510d69 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:57.525815 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0554c323-eb16-4f48-8b09-dd8476510d69 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:57.530199 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0554c323-eb16-4f48-8b09-dd8476510d69 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:57.530199 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0554c323-eb16-4f48-8b09-dd8476510d69 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:57.530948 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0554c323-eb16-4f48-8b09-dd8476510d69 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:57.641138 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0554c323-eb16-4f48-8b09-dd8476510d69 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eb8880d07649b08bfe76a68901d81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55fb3f415da42eeb5d5514410670b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:57.654157 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0554c323-eb16-4f48-8b09-dd8476510d69 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed76d3e-f334-4835-91f8-8bcbc1076b60" status: 200 len: 1268 microversion: 2.1 time: 0.144708 Oct 23 01:19:57.654818 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1314/2607] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:57 2022] GET /compute/v2.1/servers/9ed76d3e-f334-4835-91f8-8bcbc1076b60 => generated 1268 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:57.661800 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2f523dbc-6e71-451f-9ac7-2aec09b19dff tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:57.663255 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2f523dbc-6e71-451f-9ac7-2aec09b19dff tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 20f7c9ad-db91-4636-ab5b-e94e62fb0fbb] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:57.670566 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-2f523dbc-6e71-451f-9ac7-2aec09b19dff tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] HTTP exception thrown: Instance 20f7c9ad-db91-4636-ab5b-e94e62fb0fbb could not be found. Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2f523dbc-6e71-451f-9ac7-2aec09b19dff tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Request method failure captured: Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/servers/20f7c9ad-db91-4636-ab5b-e94e62fb0fbb/action HTTP/1.1 Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 14 Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJZEAurAeILsYJek3MCv_ryiTbidOLVZq6W4I7jJxeY_1_bTWRye2xM3EDOhowd_NyioevvIvzT9beBCgKqri_ZjLw9hdsIISMXmajO_VmobATT_GwpY_Y-GVylQtV9MoF1-Bup_Ahjld_2riQHnDzqLUWULm2acZYcK9UIbslVsdDU Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}] Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: cd6a6c5240f94ace91e1f0ed3e53fa7c Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: {"resume": {}} Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 20f7c9ad-db91-4636-ab5b-e94e62fb0fbb could not be found. Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '20f7c9ad-db91-4636-ab5b-e94e62fb0fbb', 'body': {'resume': {}}} Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20f7c9ad-db91-4636-ab5b-e94e62fb0fbb could not be found. Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20f7c9ad-db91-4636-ab5b-e94e62fb0fbb could not be found. Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:57.680238 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:57.684715 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:19:57.684715 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:19:57.684715 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20f7c9ad-db91-4636-ab5b-e94e62fb0fbb could not be found. Oct 23 01:19:57.684715 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:19:57.686075 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2f523dbc-6e71-451f-9ac7-2aec09b19dff tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Returning 404 to user: Instance 20f7c9ad-db91-4636-ab5b-e94e62fb0fbb could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:19:57.687243 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2f523dbc-6e71-451f-9ac7-2aec09b19dff tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "POST /compute/v2.1/servers/20f7c9ad-db91-4636-ab5b-e94e62fb0fbb/action" status: 404 len: 111 microversion: 2.1 time: 0.030495 Oct 23 01:19:57.691842 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1315/2608] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:19:57 2022] POST /compute/v2.1/servers/20f7c9ad-db91-4636-ab5b-e94e62fb0fbb/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:19:57.716405 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f33de997-443d-4747-8237-8ae9f4933dab tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc6286280>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:57.721430 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4881318a-b4bf-4222-873a-aace9deef8b8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.531453 Oct 23 01:19:57.722716 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1294/2609] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:19:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 1533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:19:57.732168 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2096d4dc-8bae-4369-bd45-bbcd007502ca tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:57.736258 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2096d4dc-8bae-4369-bd45-bbcd007502ca tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:57.753475 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2096d4dc-8bae-4369-bd45-bbcd007502ca tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:57.754311 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2096d4dc-8bae-4369-bd45-bbcd007502ca tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:57.754974 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2096d4dc-8bae-4369-bd45-bbcd007502ca tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:57.755904 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2096d4dc-8bae-4369-bd45-bbcd007502ca tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:57.756559 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2096d4dc-8bae-4369-bd45-bbcd007502ca tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:57.757641 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2096d4dc-8bae-4369-bd45-bbcd007502ca tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:57.930395 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f33de997-443d-4747-8237-8ae9f4933dab tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/797a003c-18f3-460b-ab19-805335e36552" status: 200 len: 1439 microversion: 2.1 time: 0.236960 Oct 23 01:19:57.933322 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1316/2610] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:19:57 2022] GET /compute/v2.1/images/797a003c-18f3-460b-ab19-805335e36552 => generated 1439 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:57.953996 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-752f31a6-8561-420a-9b60-c48fb8083c50 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Action: 'update', calling method: .version_select at 0x7f5cc6186af0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:58.101392 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-752f31a6-8561-420a-9b60-c48fb8083c50 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:58.102267 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-752f31a6-8561-420a-9b60-c48fb8083c50 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:58.102851 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-752f31a6-8561-420a-9b60-c48fb8083c50 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:58.103809 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-752f31a6-8561-420a-9b60-c48fb8083c50 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:58.104409 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-752f31a6-8561-420a-9b60-c48fb8083c50 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:58.105037 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-752f31a6-8561-420a-9b60-c48fb8083c50 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:58.188782 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2096d4dc-8bae-4369-bd45-bbcd007502ca tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:58.207107 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2096d4dc-8bae-4369-bd45-bbcd007502ca tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:58.218606 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2096d4dc-8bae-4369-bd45-bbcd007502ca tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:58.220154 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2096d4dc-8bae-4369-bd45-bbcd007502ca tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b" status: 200 len: 1486 microversion: 2.25 time: 0.496162 Oct 23 01:19:58.230511 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1295/2611] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:19:57 2022] GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b => generated 1486 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:19:58.236206 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2d299005-7832-4373-b560-58e267fd2973 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:58.238736 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2d299005-7832-4373-b560-58e267fd2973 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:58.244005 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-752f31a6-8561-420a-9b60-c48fb8083c50 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-sets/5b9136074f0b46428cd4a61e68be10a2" status: 200 len: 328 microversion: 2.1 time: 0.309377 Oct 23 01:19:58.246294 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1317/2612] 10.222.0.42 () {60 vars in 1262 bytes} [Sun Oct 23 01:19:57 2022] PUT /compute/v2.1/os-quota-sets/5b9136074f0b46428cd4a61e68be10a2 => generated 328 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:19:58.252876 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3663c67d-1102-4930-8dbd-a8f6a7a07a95 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:58.253848 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3663c67d-1102-4930-8dbd-a8f6a7a07a95 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: ad3fdbf4-6dba-46a6-9132-e555185544b0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:58.274637 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2d299005-7832-4373-b560-58e267fd2973 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:58.275056 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2d299005-7832-4373-b560-58e267fd2973 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:58.275498 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2d299005-7832-4373-b560-58e267fd2973 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:58.276491 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2d299005-7832-4373-b560-58e267fd2973 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:58.276713 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2d299005-7832-4373-b560-58e267fd2973 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:58.277129 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2d299005-7832-4373-b560-58e267fd2973 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:58.445298 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3663c67d-1102-4930-8dbd-a8f6a7a07a95 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:58.453799 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3663c67d-1102-4930-8dbd-a8f6a7a07a95 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0" status: 200 len: 1214 microversion: 2.1 time: 0.205780 Oct 23 01:19:58.454426 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1318/2613] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:58 2022] GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0 => generated 1214 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:58.515500 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-32ff8d26-50b3-4cf6-bde3-b25e7773928b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:58.516181 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-32ff8d26-50b3-4cf6-bde3-b25e7773928b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 6ccfe45d-f080-4066-9aad-a39c3c4cd097] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:58.548626 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-32ff8d26-50b3-4cf6-bde3-b25e7773928b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:58.549245 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-32ff8d26-50b3-4cf6-bde3-b25e7773928b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:58.550860 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-32ff8d26-50b3-4cf6-bde3-b25e7773928b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:58.551767 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-32ff8d26-50b3-4cf6-bde3-b25e7773928b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:58.552600 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-32ff8d26-50b3-4cf6-bde3-b25e7773928b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:58.553134 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-32ff8d26-50b3-4cf6-bde3-b25e7773928b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:58.607052 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2d299005-7832-4373-b560-58e267fd2973 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:58.622603 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2d299005-7832-4373-b560-58e267fd2973 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.390408 Oct 23 01:19:58.623240 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1296/2614] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:58 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:58.768839 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1dd7ec62-3cfe-49b5-a28d-bee9c02367ac tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1126744222", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:19:58.857714 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-32ff8d26-50b3-4cf6-bde3-b25e7773928b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:58.870178 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-32ff8d26-50b3-4cf6-bde3-b25e7773928b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097" status: 200 len: 1517 microversion: 2.1 time: 0.364620 Oct 23 01:19:58.870760 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1319/2615] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:58 2022] GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097 => generated 1517 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:58.876259 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-465f52cb-a858-4643-beac-9ae592a279e0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:58.876855 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-1dd7ec62-3cfe-49b5-a28d-bee9c02367ac tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] validate_networks() for None {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:19:58.876999 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-465f52cb-a858-4643-beac-9ae592a279e0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:58.883515 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-465f52cb-a858-4643-beac-9ae592a279e0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:58.884252 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-465f52cb-a858-4643-beac-9ae592a279e0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:58.897227 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-465f52cb-a858-4643-beac-9ae592a279e0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:58.899684 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-465f52cb-a858-4643-beac-9ae592a279e0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:58.900413 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-465f52cb-a858-4643-beac-9ae592a279e0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:58.901518 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-465f52cb-a858-4643-beac-9ae592a279e0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:59.787123 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-465f52cb-a858-4643-beac-9ae592a279e0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:19:59.811794 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-1dd7ec62-3cfe-49b5-a28d-bee9c02367ac tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:19:59.812842 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-1dd7ec62-3cfe-49b5-a28d-bee9c02367ac tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:19:59.813506 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-1dd7ec62-3cfe-49b5-a28d-bee9c02367ac tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:19:59.814110 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-1dd7ec62-3cfe-49b5-a28d-bee9c02367ac tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:19:59.814667 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-1dd7ec62-3cfe-49b5-a28d-bee9c02367ac tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:19:59.820629 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-465f52cb-a858-4643-beac-9ae592a279e0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.934538 Oct 23 01:19:59.840507 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1320/2616] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:58 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:19:59.853100 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1dd7ec62-3cfe-49b5-a28d-bee9c02367ac tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:59.853593 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1dd7ec62-3cfe-49b5-a28d-bee9c02367ac tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:59.854051 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1dd7ec62-3cfe-49b5-a28d-bee9c02367ac tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:59.856253 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f20d1c10-894e-48b6-adff-0e9207a22ad7 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:19:59.857188 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1dd7ec62-3cfe-49b5-a28d-bee9c02367ac tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:59.857649 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1dd7ec62-3cfe-49b5-a28d-bee9c02367ac tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:59.858171 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1dd7ec62-3cfe-49b5-a28d-bee9c02367ac tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:59.865640 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f20d1c10-894e-48b6-adff-0e9207a22ad7 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] [instance: 9ed76d3e-f334-4835-91f8-8bcbc1076b60] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:19:59.878493 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-1dd7ec62-3cfe-49b5-a28d-bee9c02367ac tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] Getting quotas for project 5b9136074f0b46428cd4a61e68be10a2. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:19:59.878759 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f20d1c10-894e-48b6-adff-0e9207a22ad7 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:59.879586 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f20d1c10-894e-48b6-adff-0e9207a22ad7 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:59.879681 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f20d1c10-894e-48b6-adff-0e9207a22ad7 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:59.880390 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f20d1c10-894e-48b6-adff-0e9207a22ad7 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:19:59.880844 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f20d1c10-894e-48b6-adff-0e9207a22ad7 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:19:59.885388 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f20d1c10-894e-48b6-adff-0e9207a22ad7 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:19:59.885851 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-1dd7ec62-3cfe-49b5-a28d-bee9c02367ac tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] Getting quotas for user 2696d3387fd44aa1aab450f31f51c364 and project 5b9136074f0b46428cd4a61e68be10a2. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:19:59.900933 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.utils [None req-1dd7ec62-3cfe-49b5-a28d-bee9c02367ac tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] cores quota exceeded for 5b9136074f0b46428cd4a61e68be10a2, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120944) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 23 01:19:59.901829 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-1dd7ec62-3cfe-49b5-a28d-bee9c02367ac tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1dd7ec62-3cfe-49b5-a28d-bee9c02367ac tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] Request method failure captured: Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 145 Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJa6SbKc1evXvy2MfQ0y6zSQMG7ysAfhhIMr067_FxC8pJ9XyTbzvCcE8mXZzjQmLSFejcQQFcY61baAibic1wtiuD15vP-bWRD2Ox3f_8LMOpgAUkzS9pzlur9CFngKk1psb6DlQnF4X65kyVbeDN8DgeKX8KFskYg6VRyWXEeZpXk Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 5b9136074f0b46428cd4a61e68be10a2 Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-QuotasAdminNegativeTest-1714020103 Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5b9136074f0b46428cd4a61e68be10a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5b9136074f0b46428cd4a61e68be10a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5b9136074f0b46428cd4a61e68be10a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5b9136074f0b46428cd4a61e68be10a2"}]}] Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-QuotasAdminNegativeTest-1714020103 Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 5b9136074f0b46428cd4a61e68be10a2 Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1714020103 Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-QuotasAdminNegativeTest-1714020103-project Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 2696d3387fd44aa1aab450f31f51c364 Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-QuotasAdminNegativeTest-1714020103-project Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1126744222", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452"}} Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1126744222', 'imageRef': '446b40bc-db5b-4123-9278-997bd6d04a0d', 'flavorRef': '452'}}} Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 23 01:19:59.905724 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 23 01:19:59.909465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 23 01:19:59.909465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 23 01:19:59.909465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 23 01:19:59.909465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 23 01:19:59.909465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 23 01:19:59.909465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 23 01:19:59.909465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:59.909465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:59.909465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:59.909465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:59.909465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:59.909465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:59.909465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:19:59.909465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:19:59.909465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:19:59.909465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:19:59.909465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:19:59.909465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:19:59.909465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:19:59.909465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:19:59.909465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:19:59.909465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:19:59.909465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 23 01:19:59.909465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 23 01:19:59.909465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 23 01:19:59.909465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 23 01:19:59.909465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:59.909465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:19:59.909465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:59.909465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:19:59.909465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:19:59.909465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:19:59.909465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:19:59.909465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:19:59.909465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 23 01:19:59.909465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:19:59.914281 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1dd7ec62-3cfe-49b5-a28d-bee9c02367ac tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:19:59.915344 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1dd7ec62-3cfe-49b5-a28d-bee9c02367ac tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.291171 Oct 23 01:19:59.916120 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1297/2617] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:19:58 2022] POST /compute/v2.1/servers => generated 111 bytes in 1292 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:19:59.924721 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-97e865db-5565-48bf-8449-8d46e27abc3f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc6167160>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:00.017380 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-97e865db-5565-48bf-8449-8d46e27abc3f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/797a003c-18f3-460b-ab19-805335e36552" status: 200 len: 1439 microversion: 2.1 time: 0.096587 Oct 23 01:20:00.019491 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1298/2618] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:19:59 2022] GET /compute/v2.1/images/797a003c-18f3-460b-ab19-805335e36552 => generated 1439 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:00.028015 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4205585d-3054-41c2-a47e-20d202f16e7b tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:00.034156 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4205585d-3054-41c2-a47e-20d202f16e7b tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:00.048758 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4205585d-3054-41c2-a47e-20d202f16e7b tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:00.055522 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4205585d-3054-41c2-a47e-20d202f16e7b tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:00.056353 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4205585d-3054-41c2-a47e-20d202f16e7b tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:00.057278 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4205585d-3054-41c2-a47e-20d202f16e7b tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:00.057913 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4205585d-3054-41c2-a47e-20d202f16e7b tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:00.058540 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4205585d-3054-41c2-a47e-20d202f16e7b tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:00.145497 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f20d1c10-894e-48b6-adff-0e9207a22ad7 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eb8880d07649b08bfe76a68901d81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55fb3f415da42eeb5d5514410670b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:00.156032 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f20d1c10-894e-48b6-adff-0e9207a22ad7 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed76d3e-f334-4835-91f8-8bcbc1076b60" status: 200 len: 1316 microversion: 2.1 time: 0.312269 Oct 23 01:20:00.156803 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1321/2619] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:19:59 2022] GET /compute/v2.1/servers/9ed76d3e-f334-4835-91f8-8bcbc1076b60 => generated 1316 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:00.165449 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6ca029a1-e894-42b9-ad29-a146c6a43190 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:00.171129 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6ca029a1-e894-42b9-ad29-a146c6a43190 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: ad3fdbf4-6dba-46a6-9132-e555185544b0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:00.184510 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6ca029a1-e894-42b9-ad29-a146c6a43190 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:00.185386 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6ca029a1-e894-42b9-ad29-a146c6a43190 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:00.186568 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6ca029a1-e894-42b9-ad29-a146c6a43190 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:00.189953 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6ca029a1-e894-42b9-ad29-a146c6a43190 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:00.190462 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6ca029a1-e894-42b9-ad29-a146c6a43190 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:00.190908 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6ca029a1-e894-42b9-ad29-a146c6a43190 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:00.304185 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6ca029a1-e894-42b9-ad29-a146c6a43190 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:00.314927 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6ca029a1-e894-42b9-ad29-a146c6a43190 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0" status: 200 len: 1266 microversion: 2.1 time: 0.154955 Oct 23 01:20:00.330515 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1322/2620] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:00 2022] GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:00.344595 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c85b5716-d136-43da-a1a3-6c027b36b975 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:20:00.345062 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c85b5716-d136-43da-a1a3-6c027b36b975 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:00.358173 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c85b5716-d136-43da-a1a3-6c027b36b975 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:00.362549 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c85b5716-d136-43da-a1a3-6c027b36b975 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:00.363066 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c85b5716-d136-43da-a1a3-6c027b36b975 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:00.363837 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c85b5716-d136-43da-a1a3-6c027b36b975 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:00.364311 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c85b5716-d136-43da-a1a3-6c027b36b975 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:00.366704 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c85b5716-d136-43da-a1a3-6c027b36b975 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:00.417178 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4205585d-3054-41c2-a47e-20d202f16e7b tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:00.434877 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-c85b5716-d136-43da-a1a3-6c027b36b975 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] HTTP exception thrown: Cannot 'resume' instance 62a8ad26-f65b-432d-a8da-48264c426335 while it is in vm_state active Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c85b5716-d136-43da-a1a3-6c027b36b975 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Request method failure captured: Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335/action HTTP/1.1 Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 14 Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJZEAurAeILsYJek3MCv_ryiTbidOLVZq6W4I7jJxeY_1_bTWRye2xM3EDOhowd_NyioevvIvzT9beBCgKqri_ZjLw9hdsIISMXmajO_VmobATT_GwpY_Y-GVylQtV9MoF1-Bup_Ahjld_2riQHnDzqLUWULm2acZYcK9UIbslVsdDU Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}] Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: cd6a6c5240f94ace91e1f0ed3e53fa7c Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: {"resume": {}} Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: exception: Cannot 'resume' instance 62a8ad26-f65b-432d-a8da-48264c426335 while it is in vm_state active Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '62a8ad26-f65b-432d-a8da-48264c426335', 'body': {'resume': {}}} Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 62a8ad26-f65b-432d-a8da-48264c426335 in vm_state active. Cannot resume while the instance is in this state. Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 62a8ad26-f65b-432d-a8da-48264c426335 while it is in vm_state active Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:20:00.436566 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:20:00.440169 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:20:00.440169 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:20:00.440169 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:20:00.440169 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:20:00.440169 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:20:00.440169 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 62a8ad26-f65b-432d-a8da-48264c426335 while it is in vm_state active Oct 23 01:20:00.440169 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:20:00.440169 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c85b5716-d136-43da-a1a3-6c027b36b975 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Returning 409 to user: Cannot 'resume' instance 62a8ad26-f65b-432d-a8da-48264c426335 while it is in vm_state active {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:20:00.441873 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c85b5716-d136-43da-a1a3-6c027b36b975 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "POST /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335/action" status: 409 len: 144 microversion: 2.1 time: 0.105965 Oct 23 01:20:00.443146 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1323/2621] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:20:00 2022] POST /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335/action => generated 144 bytes in 111 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:20:00.445566 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4205585d-3054-41c2-a47e-20d202f16e7b tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:00.447581 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4205585d-3054-41c2-a47e-20d202f16e7b tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:00.449813 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4205585d-3054-41c2-a47e-20d202f16e7b tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b" status: 200 len: 1486 microversion: 2.25 time: 0.428825 Oct 23 01:20:00.453701 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c681da73-b72c-48c6-b673-5b62cfe66a02 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:00.454470 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c681da73-b72c-48c6-b673-5b62cfe66a02 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 6ccfe45d-f080-4066-9aad-a39c3c4cd097] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:00.462341 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1299/2622] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:20:00 2022] GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b => generated 1486 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:20:00.478581 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-57380b03-47af-4e72-9350-bc37f2031484 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Action: 'update', calling method: .version_select at 0x7f5cc6119af0>, body: {"quota_set": {"cores": 20}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:20:00.483863 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c681da73-b72c-48c6-b673-5b62cfe66a02 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:00.484815 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c681da73-b72c-48c6-b673-5b62cfe66a02 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:00.485422 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c681da73-b72c-48c6-b673-5b62cfe66a02 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:00.487511 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c681da73-b72c-48c6-b673-5b62cfe66a02 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:00.491377 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c681da73-b72c-48c6-b673-5b62cfe66a02 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:00.492427 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c681da73-b72c-48c6-b673-5b62cfe66a02 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:00.643256 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-57380b03-47af-4e72-9350-bc37f2031484 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:00.643749 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-57380b03-47af-4e72-9350-bc37f2031484 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:00.644184 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-57380b03-47af-4e72-9350-bc37f2031484 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:00.651826 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-57380b03-47af-4e72-9350-bc37f2031484 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:00.652572 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-57380b03-47af-4e72-9350-bc37f2031484 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:00.660318 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-57380b03-47af-4e72-9350-bc37f2031484 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:00.742872 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c681da73-b72c-48c6-b673-5b62cfe66a02 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:00.746580 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=100 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:20:00.755120 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c681da73-b72c-48c6-b673-5b62cfe66a02 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097" status: 200 len: 1517 microversion: 2.1 time: 0.310865 Oct 23 01:20:00.756924 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1324/2623] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:00 2022] GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097 => generated 1517 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:00.766178 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-69fabd72-d6b1-446e-9378-1cfa0f8b16b4 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:00.769463 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-69fabd72-d6b1-446e-9378-1cfa0f8b16b4 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:00.783070 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-69fabd72-d6b1-446e-9378-1cfa0f8b16b4 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:00.783573 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-69fabd72-d6b1-446e-9378-1cfa0f8b16b4 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:00.784010 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-69fabd72-d6b1-446e-9378-1cfa0f8b16b4 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:00.784727 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-69fabd72-d6b1-446e-9378-1cfa0f8b16b4 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:00.785184 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-69fabd72-d6b1-446e-9378-1cfa0f8b16b4 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:00.785609 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-69fabd72-d6b1-446e-9378-1cfa0f8b16b4 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:00.912879 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-57380b03-47af-4e72-9350-bc37f2031484 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-sets/5b9136074f0b46428cd4a61e68be10a2" status: 200 len: 329 microversion: 2.1 time: 0.448885 Oct 23 01:20:00.913478 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1300/2624] 10.222.0.42 () {60 vars in 1262 bytes} [Sun Oct 23 01:20:00 2022] PUT /compute/v2.1/os-quota-sets/5b9136074f0b46428cd4a61e68be10a2 => generated 329 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:20:00.934851 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7fba75d6-729e-4fc3-98ac-17fe9c95ccda tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Calling method '.version_select at 0x7f5cc61193a0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:01.086122 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-69fabd72-d6b1-446e-9378-1cfa0f8b16b4 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:01.087333 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7fba75d6-729e-4fc3-98ac-17fe9c95ccda tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/5b9136074f0b46428cd4a61e68be10a2" status: 200 len: 371 microversion: 2.1 time: 0.161022 Oct 23 01:20:01.087959 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1301/2625] 10.222.0.42 () {58 vars in 1242 bytes} [Sun Oct 23 01:20:00 2022] GET /compute/v2.1/os-quota-sets/5b9136074f0b46428cd4a61e68be10a2 => generated 371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:20:01.098466 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-94a5e1a4-d0cd-49ec-8361-b0543391ca0d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc61210d0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:01.107848 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-69fabd72-d6b1-446e-9378-1cfa0f8b16b4 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.347864 Oct 23 01:20:01.118495 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1325/2626] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:00 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:01.134605 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d0cf9348-e366-48b7-bc7b-7af7d75fdbea tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Action: 'update', calling method: .version_select at 0x7f5cc1f4e430>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:20:01.169920 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-94a5e1a4-d0cd-49ec-8361-b0543391ca0d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/797a003c-18f3-460b-ab19-805335e36552" status: 200 len: 1439 microversion: 2.1 time: 0.079937 Oct 23 01:20:01.170799 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1302/2627] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:20:01 2022] GET /compute/v2.1/images/797a003c-18f3-460b-ab19-805335e36552 => generated 1439 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:01.176301 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7149015f-f6be-444d-b654-8ea787358005 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:01.177132 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7149015f-f6be-444d-b654-8ea787358005 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:01.186797 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7149015f-f6be-444d-b654-8ea787358005 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:01.196751 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7149015f-f6be-444d-b654-8ea787358005 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:01.198858 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7149015f-f6be-444d-b654-8ea787358005 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:01.199783 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7149015f-f6be-444d-b654-8ea787358005 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:01.202133 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7149015f-f6be-444d-b654-8ea787358005 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:01.205434 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7149015f-f6be-444d-b654-8ea787358005 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:01.276411 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0cf9348-e366-48b7-bc7b-7af7d75fdbea tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:01.282943 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0cf9348-e366-48b7-bc7b-7af7d75fdbea tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:01.282943 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0cf9348-e366-48b7-bc7b-7af7d75fdbea tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:01.282943 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0cf9348-e366-48b7-bc7b-7af7d75fdbea tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:01.282943 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0cf9348-e366-48b7-bc7b-7af7d75fdbea tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:01.282943 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0cf9348-e366-48b7-bc7b-7af7d75fdbea tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:01.445524 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d0cf9348-e366-48b7-bc7b-7af7d75fdbea tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-sets/5b9136074f0b46428cd4a61e68be10a2" status: 200 len: 328 microversion: 2.1 time: 0.321564 Oct 23 01:20:01.453309 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1326/2628] 10.222.0.42 () {60 vars in 1262 bytes} [Sun Oct 23 01:20:01 2022] PUT /compute/v2.1/os-quota-sets/5b9136074f0b46428cd4a61e68be10a2 => generated 328 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:20:01.458777 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-69ed8010-c859-44de-b345-536cd927edcc tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:01.459495 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-69ed8010-c859-44de-b345-536cd927edcc tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] [instance: 9ed76d3e-f334-4835-91f8-8bcbc1076b60] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:01.478005 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-69ed8010-c859-44de-b345-536cd927edcc tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:01.478005 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-69ed8010-c859-44de-b345-536cd927edcc tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:01.478220 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-69ed8010-c859-44de-b345-536cd927edcc tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:01.484865 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-69ed8010-c859-44de-b345-536cd927edcc tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:01.485713 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-69ed8010-c859-44de-b345-536cd927edcc tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:01.486194 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-69ed8010-c859-44de-b345-536cd927edcc tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:01.653138 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7149015f-f6be-444d-b654-8ea787358005 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:01.675234 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7149015f-f6be-444d-b654-8ea787358005 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.503145 Oct 23 01:20:01.679127 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1303/2629] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:01 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:01.697103 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b06f8c68-6d26-46c5-973b-b4435c0522b4 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:01.699893 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b06f8c68-6d26-46c5-973b-b4435c0522b4 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: ad3fdbf4-6dba-46a6-9132-e555185544b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:01.713807 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b06f8c68-6d26-46c5-973b-b4435c0522b4 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:01.719349 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b06f8c68-6d26-46c5-973b-b4435c0522b4 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:01.722206 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b06f8c68-6d26-46c5-973b-b4435c0522b4 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:01.723146 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b06f8c68-6d26-46c5-973b-b4435c0522b4 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:01.723746 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b06f8c68-6d26-46c5-973b-b4435c0522b4 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:01.724314 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b06f8c68-6d26-46c5-973b-b4435c0522b4 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:01.924123 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b06f8c68-6d26-46c5-973b-b4435c0522b4 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:01.932710 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b06f8c68-6d26-46c5-973b-b4435c0522b4 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0" status: 200 len: 1284 microversion: 2.1 time: 0.249184 Oct 23 01:20:01.933408 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1304/2630] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:01 2022] GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0 => generated 1284 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:01.939020 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-877a1d65-45d8-4a24-97c5-da6d1ba42a9e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:01.939732 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-877a1d65-45d8-4a24-97c5-da6d1ba42a9e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:01.946060 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-877a1d65-45d8-4a24-97c5-da6d1ba42a9e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:01.946884 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-877a1d65-45d8-4a24-97c5-da6d1ba42a9e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:01.947526 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-877a1d65-45d8-4a24-97c5-da6d1ba42a9e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:01.948296 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-877a1d65-45d8-4a24-97c5-da6d1ba42a9e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:01.948869 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-877a1d65-45d8-4a24-97c5-da6d1ba42a9e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:01.949354 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-877a1d65-45d8-4a24-97c5-da6d1ba42a9e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:02.084250 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-69ed8010-c859-44de-b345-536cd927edcc tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eb8880d07649b08bfe76a68901d81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55fb3f415da42eeb5d5514410670b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:02.092406 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-69ed8010-c859-44de-b345-536cd927edcc tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed76d3e-f334-4835-91f8-8bcbc1076b60" status: 200 len: 1316 microversion: 2.1 time: 0.637695 Oct 23 01:20:02.093010 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1327/2631] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:01 2022] GET /compute/v2.1/servers/9ed76d3e-f334-4835-91f8-8bcbc1076b60 => generated 1316 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:02.097764 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a9dc0cd1-63fe-4b2b-bbba-8b12649013d5 tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-756856182", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:20:02.153743 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-877a1d65-45d8-4a24-97c5-da6d1ba42a9e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:02.154859 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-a9dc0cd1-63fe-4b2b-bbba-8b12649013d5 tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] validate_networks() for None {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:20:02.163017 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-877a1d65-45d8-4a24-97c5-da6d1ba42a9e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:02.164734 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-877a1d65-45d8-4a24-97c5-da6d1ba42a9e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:02.166115 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-877a1d65-45d8-4a24-97c5-da6d1ba42a9e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b" status: 200 len: 1486 microversion: 2.25 time: 0.231605 Oct 23 01:20:02.166678 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1305/2632] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:20:01 2022] GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b => generated 1486 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:20:02.184758 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cac18300-758d-4473-a3a3-42f8c2749563 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:02.184758 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-cac18300-758d-4473-a3a3-42f8c2749563 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 6ccfe45d-f080-4066-9aad-a39c3c4cd097] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:02.184758 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cac18300-758d-4473-a3a3-42f8c2749563 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:02.184758 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cac18300-758d-4473-a3a3-42f8c2749563 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:02.184758 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cac18300-758d-4473-a3a3-42f8c2749563 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:02.184758 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cac18300-758d-4473-a3a3-42f8c2749563 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:02.184758 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cac18300-758d-4473-a3a3-42f8c2749563 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:02.184758 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cac18300-758d-4473-a3a3-42f8c2749563 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:02.640709 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cac18300-758d-4473-a3a3-42f8c2749563 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:02.653090 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cac18300-758d-4473-a3a3-42f8c2749563 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097" status: 200 len: 1517 microversion: 2.1 time: 0.485345 Oct 23 01:20:02.653687 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1306/2633] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:02 2022] GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097 => generated 1517 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:02.672831 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-320bbeda-0e9f-4a81-a4e7-9ab866b629e3 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "06f4c921-9d2b-4ef6-806f-b77fdc508baa"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-320bbeda-0e9f-4a81-a4e7-9ab866b629e3 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Request method failure captured: Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 160 Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJZEAurAeILsYJek3MCv_ryiTbidOLVZq6W4I7jJxeY_1_bTWRye2xM3EDOhowd_NyioevvIvzT9beBCgKqri_ZjLw9hdsIISMXmajO_VmobATT_GwpY_Y-GVylQtV9MoF1-Bup_Ahjld_2riQHnDzqLUWULm2acZYcK9UIbslVsdDU Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}] Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: cd6a6c5240f94ace91e1f0ed3e53fa7c Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: {"server": {"name": "", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "06f4c921-9d2b-4ef6-806f-b77fdc508baa"}]}} Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: action_args: {'body': {'server': {'name': '', 'imageRef': '446b40bc-db5b-4123-9278-997bd6d04a0d', 'flavorRef': '452', 'networks': [{'uuid': '06f4c921-9d2b-4ef6-806f-b77fdc508baa'}]}}} Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise error Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi '' Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 23 01:20:02.677672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 23 01:20:02.682059 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 23 01:20:02.682059 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 23 01:20:02.682059 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:20:02.682059 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:20:02.682059 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:20:02.682059 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:20:02.682059 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:20:02.682059 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:20:02.682059 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 23 01:20:02.682059 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 23 01:20:02.682059 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 23 01:20:02.682059 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:20:02.687105 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-320bbeda-0e9f-4a81-a4e7-9ab866b629e3 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:20:02.698555 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-320bbeda-0e9f-4a81-a4e7-9ab866b629e3 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.043616 Oct 23 01:20:02.703238 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1307/2634] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:20:02 2022] POST /compute/v2.1/servers => generated 108 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:20:02.708194 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-be9d4a43-0066-4024-a7cb-ab41aafb04cc tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc6119670>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:02.769965 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-be9d4a43-0066-4024-a7cb-ab41aafb04cc tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/797a003c-18f3-460b-ab19-805335e36552" status: 200 len: 1439 microversion: 2.1 time: 0.065304 Oct 23 01:20:02.771649 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1308/2635] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:20:02 2022] GET /compute/v2.1/images/797a003c-18f3-460b-ab19-805335e36552 => generated 1439 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:02.777353 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-70b6256a-0841-46ec-aadf-332e5368a924 req-2b2ad346-76f5-4f91-b9b4-90023c699b44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ed76d3e-f334-4835-91f8-8bcbc1076b60", "tag": "df96f59d-1993-491c-9189-d26c9473816b"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:20:02.788820 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-70b6256a-0841-46ec-aadf-332e5368a924 req-2b2ad346-76f5-4f91-b9b4-90023c699b44 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:02.794177 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-70b6256a-0841-46ec-aadf-332e5368a924 req-2b2ad346-76f5-4f91-b9b4-90023c699b44 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:02.794177 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-70b6256a-0841-46ec-aadf-332e5368a924 req-2b2ad346-76f5-4f91-b9b4-90023c699b44 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:02.804270 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-70b6256a-0841-46ec-aadf-332e5368a924 req-2b2ad346-76f5-4f91-b9b4-90023c699b44 service nova] Creating event network-changed:df96f59d-1993-491c-9189-d26c9473816b for instance 9ed76d3e-f334-4835-91f8-8bcbc1076b60 on n-h2-master-1 Oct 23 01:20:02.810459 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-70b6256a-0841-46ec-aadf-332e5368a924 req-2b2ad346-76f5-4f91-b9b4-90023c699b44 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037374 Oct 23 01:20:02.811323 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1309/2636] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:20:02.818433 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a81a1109-d38f-49d8-9bb5-41a677930e23 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:02.819592 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a81a1109-d38f-49d8-9bb5-41a677930e23 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:02.828859 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a81a1109-d38f-49d8-9bb5-41a677930e23 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:02.829888 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a81a1109-d38f-49d8-9bb5-41a677930e23 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:02.830569 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a81a1109-d38f-49d8-9bb5-41a677930e23 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:02.831485 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a81a1109-d38f-49d8-9bb5-41a677930e23 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:02.832171 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a81a1109-d38f-49d8-9bb5-41a677930e23 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:02.832882 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a81a1109-d38f-49d8-9bb5-41a677930e23 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:02.939058 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-a9dc0cd1-63fe-4b2b-bbba-8b12649013d5 tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:20:02.939698 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-a9dc0cd1-63fe-4b2b-bbba-8b12649013d5 tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:20:02.940243 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-a9dc0cd1-63fe-4b2b-bbba-8b12649013d5 tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:20:02.941821 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-a9dc0cd1-63fe-4b2b-bbba-8b12649013d5 tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:20:02.942780 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-a9dc0cd1-63fe-4b2b-bbba-8b12649013d5 tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:20:02.977645 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9dc0cd1-63fe-4b2b-bbba-8b12649013d5 tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:02.979148 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9dc0cd1-63fe-4b2b-bbba-8b12649013d5 tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:02.979618 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9dc0cd1-63fe-4b2b-bbba-8b12649013d5 tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:02.982568 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9dc0cd1-63fe-4b2b-bbba-8b12649013d5 tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:02.983047 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9dc0cd1-63fe-4b2b-bbba-8b12649013d5 tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:02.984984 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9dc0cd1-63fe-4b2b-bbba-8b12649013d5 tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:03.018453 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-a9dc0cd1-63fe-4b2b-bbba-8b12649013d5 tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] Getting quotas for project 5b9136074f0b46428cd4a61e68be10a2. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:20:03.035404 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-a9dc0cd1-63fe-4b2b-bbba-8b12649013d5 tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] Getting quotas for user 2696d3387fd44aa1aab450f31f51c364 and project 5b9136074f0b46428cd4a61e68be10a2. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:20:03.058541 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.utils [None req-a9dc0cd1-63fe-4b2b-bbba-8b12649013d5 tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] instances quota exceeded for 5b9136074f0b46428cd4a61e68be10a2, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120945) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 23 01:20:03.059581 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-a9dc0cd1-63fe-4b2b-bbba-8b12649013d5 tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a9dc0cd1-63fe-4b2b-bbba-8b12649013d5 tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] Request method failure captured: Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 144 Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJa6SbKc1evXvy2MfQ0y6zSQMG7ysAfhhIMr067_FxC8pJ9XyTbzvCcE8mXZzjQmLSFejcQQFcY61baAibic1wtiuD15vP-bWRD2Ox3f_8LMOpgAUkzS9pzlur9CFngKk1psb6DlQnF4X65kyVbeDN8DgeKX8KFskYg6VRyWXEeZpXk Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 5b9136074f0b46428cd4a61e68be10a2 Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-QuotasAdminNegativeTest-1714020103 Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5b9136074f0b46428cd4a61e68be10a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5b9136074f0b46428cd4a61e68be10a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5b9136074f0b46428cd4a61e68be10a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5b9136074f0b46428cd4a61e68be10a2"}]}] Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-QuotasAdminNegativeTest-1714020103 Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 5b9136074f0b46428cd4a61e68be10a2 Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1714020103 Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-QuotasAdminNegativeTest-1714020103-project Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 2696d3387fd44aa1aab450f31f51c364 Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-QuotasAdminNegativeTest-1714020103-project Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-756856182", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452"}} Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-756856182', 'imageRef': '446b40bc-db5b-4123-9278-997bd6d04a0d', 'flavorRef': '452'}}} Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 23 01:20:03.064033 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 23 01:20:03.068017 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 23 01:20:03.068017 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 23 01:20:03.068017 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 23 01:20:03.068017 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 23 01:20:03.068017 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 23 01:20:03.068017 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 23 01:20:03.068017 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:20:03.068017 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:20:03.068017 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:20:03.068017 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:20:03.068017 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:20:03.068017 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:20:03.068017 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:20:03.068017 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:20:03.068017 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:20:03.068017 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:20:03.068017 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:20:03.068017 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:20:03.068017 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:20:03.068017 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:20:03.068017 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:20:03.068017 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:20:03.068017 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 23 01:20:03.068017 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 23 01:20:03.068017 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 23 01:20:03.068017 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 23 01:20:03.068017 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:20:03.068017 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:20:03.068017 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:20:03.068017 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:20:03.068017 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:20:03.068017 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:20:03.068017 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:20:03.068017 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:20:03.068017 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 23 01:20:03.068017 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:20:03.068017 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a9dc0cd1-63fe-4b2b-bbba-8b12649013d5 tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:20:03.068017 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a9dc0cd1-63fe-4b2b-bbba-8b12649013d5 tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.971694 Oct 23 01:20:03.068017 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1328/2637] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:20:02 2022] POST /compute/v2.1/servers => generated 119 bytes in 973 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:20:03.080631 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8a6b55be-dc58-489d-aac7-e6bcd8d742d7 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:03.082278 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8a6b55be-dc58-489d-aac7-e6bcd8d742d7 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: ad3fdbf4-6dba-46a6-9132-e555185544b0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:03.096048 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a81a1109-d38f-49d8-9bb5-41a677930e23 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:03.102962 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a6b55be-dc58-489d-aac7-e6bcd8d742d7 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:03.103521 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a6b55be-dc58-489d-aac7-e6bcd8d742d7 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:03.104608 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a6b55be-dc58-489d-aac7-e6bcd8d742d7 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:03.105530 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a6b55be-dc58-489d-aac7-e6bcd8d742d7 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:03.106476 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a6b55be-dc58-489d-aac7-e6bcd8d742d7 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:03.106915 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a6b55be-dc58-489d-aac7-e6bcd8d742d7 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:03.109075 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a81a1109-d38f-49d8-9bb5-41a677930e23 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.294439 Oct 23 01:20:03.110100 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1310/2638] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:02 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:03.123056 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a14aab14-b501-4b9c-b088-07b71eed91c7 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Action: 'update', calling method: .version_select at 0x7f5cc61b11f0>, body: {"quota_set": {"instances": 10}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:20:03.245837 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8a6b55be-dc58-489d-aac7-e6bcd8d742d7 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:03.257676 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8a6b55be-dc58-489d-aac7-e6bcd8d742d7 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0" status: 200 len: 1272 microversion: 2.1 time: 0.189884 Oct 23 01:20:03.259205 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1329/2639] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:03 2022] GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0 => generated 1272 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:03.274336 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-00e42fbe-63a0-4d20-ae08-b749d3cd121d tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:03.278159 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-00e42fbe-63a0-4d20-ae08-b749d3cd121d tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] [instance: 9ed76d3e-f334-4835-91f8-8bcbc1076b60] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:03.294540 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a14aab14-b501-4b9c-b088-07b71eed91c7 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:03.296636 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a14aab14-b501-4b9c-b088-07b71eed91c7 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:03.297090 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a14aab14-b501-4b9c-b088-07b71eed91c7 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:03.299226 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a14aab14-b501-4b9c-b088-07b71eed91c7 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:03.299703 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a14aab14-b501-4b9c-b088-07b71eed91c7 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:03.300870 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a14aab14-b501-4b9c-b088-07b71eed91c7 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:03.307050 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-00e42fbe-63a0-4d20-ae08-b749d3cd121d tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:03.307555 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-00e42fbe-63a0-4d20-ae08-b749d3cd121d tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:03.307998 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-00e42fbe-63a0-4d20-ae08-b749d3cd121d tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:03.308717 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-00e42fbe-63a0-4d20-ae08-b749d3cd121d tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:03.313327 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-00e42fbe-63a0-4d20-ae08-b749d3cd121d tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:03.316578 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-00e42fbe-63a0-4d20-ae08-b749d3cd121d tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:03.503273 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a14aab14-b501-4b9c-b088-07b71eed91c7 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-sets/5b9136074f0b46428cd4a61e68be10a2" status: 200 len: 329 microversion: 2.1 time: 0.383746 Oct 23 01:20:03.504090 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1311/2640] 10.222.0.42 () {60 vars in 1262 bytes} [Sun Oct 23 01:20:03 2022] PUT /compute/v2.1/os-quota-sets/5b9136074f0b46428cd4a61e68be10a2 => generated 329 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:20:03.519715 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e1ca43e2-9b8b-499b-94ca-c6982a81fd34 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:03.520368 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e1ca43e2-9b8b-499b-94ca-c6982a81fd34 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:03.528120 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e1ca43e2-9b8b-499b-94ca-c6982a81fd34 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:03.528614 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e1ca43e2-9b8b-499b-94ca-c6982a81fd34 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:03.529055 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e1ca43e2-9b8b-499b-94ca-c6982a81fd34 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:03.529762 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e1ca43e2-9b8b-499b-94ca-c6982a81fd34 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:03.530241 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e1ca43e2-9b8b-499b-94ca-c6982a81fd34 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:03.531230 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e1ca43e2-9b8b-499b-94ca-c6982a81fd34 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:04.093481 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e1ca43e2-9b8b-499b-94ca-c6982a81fd34 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:04.102504 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e1ca43e2-9b8b-499b-94ca-c6982a81fd34 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.587217 Oct 23 01:20:04.106684 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1312/2641] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:03 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:04.112966 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-00e42fbe-63a0-4d20-ae08-b749d3cd121d tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eb8880d07649b08bfe76a68901d81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55fb3f415da42eeb5d5514410670b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:04.130259 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-00e42fbe-63a0-4d20-ae08-b749d3cd121d tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed76d3e-f334-4835-91f8-8bcbc1076b60" status: 200 len: 1316 microversion: 2.1 time: 0.864320 Oct 23 01:20:04.132629 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1330/2642] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:03 2022] GET /compute/v2.1/servers/9ed76d3e-f334-4835-91f8-8bcbc1076b60 => generated 1316 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:04.140989 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1d482c62-9204-4384-b857-628ba27ce51e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:04.141720 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1d482c62-9204-4384-b857-628ba27ce51e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:04.145032 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-48221654-0a10-4639-9560-669be67111a6 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Calling method '.version_select at 0x7f5cc6263160>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:04.157452 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1d482c62-9204-4384-b857-628ba27ce51e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:04.157952 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1d482c62-9204-4384-b857-628ba27ce51e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:04.172251 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1d482c62-9204-4384-b857-628ba27ce51e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:04.175419 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1d482c62-9204-4384-b857-628ba27ce51e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:04.175900 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1d482c62-9204-4384-b857-628ba27ce51e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:04.176512 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1d482c62-9204-4384-b857-628ba27ce51e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:04.338505 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-48221654-0a10-4639-9560-669be67111a6 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/5b9136074f0b46428cd4a61e68be10a2" status: 200 len: 371 microversion: 2.1 time: 0.204488 Oct 23 01:20:04.339106 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1331/2643] 10.222.0.42 () {58 vars in 1242 bytes} [Sun Oct 23 01:20:04 2022] GET /compute/v2.1/os-quota-sets/5b9136074f0b46428cd4a61e68be10a2 => generated 371 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:20:04.358006 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8b8345c3-aebd-4d18-b1b3-bddb6fde1784 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:04.362418 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8b8345c3-aebd-4d18-b1b3-bddb6fde1784 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 6ccfe45d-f080-4066-9aad-a39c3c4cd097] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:04.385576 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b8345c3-aebd-4d18-b1b3-bddb6fde1784 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:04.387644 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b8345c3-aebd-4d18-b1b3-bddb6fde1784 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:04.388928 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b8345c3-aebd-4d18-b1b3-bddb6fde1784 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:04.394080 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b8345c3-aebd-4d18-b1b3-bddb6fde1784 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:04.394808 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b8345c3-aebd-4d18-b1b3-bddb6fde1784 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:04.396427 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b8345c3-aebd-4d18-b1b3-bddb6fde1784 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:04.643155 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1d482c62-9204-4384-b857-628ba27ce51e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:04.647613 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=100 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:20:04.657772 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1d482c62-9204-4384-b857-628ba27ce51e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:04.660482 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1d482c62-9204-4384-b857-628ba27ce51e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:04.661718 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1d482c62-9204-4384-b857-628ba27ce51e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b" status: 200 len: 1486 microversion: 2.25 time: 0.553303 Oct 23 01:20:04.662326 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1313/2644] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:20:04 2022] GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b => generated 1486 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:20:04.667156 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-64c4d006-4b42-4cc8-9c97-5f528aa1e13a tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc6119dc0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:04.753723 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-64c4d006-4b42-4cc8-9c97-5f528aa1e13a tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/797a003c-18f3-460b-ab19-805335e36552" status: 200 len: 1439 microversion: 2.1 time: 0.086448 Oct 23 01:20:04.753723 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1314/2645] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:20:04 2022] GET /compute/v2.1/images/797a003c-18f3-460b-ab19-805335e36552 => generated 1439 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:04.760164 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c7269892-383f-4db0-93d7-bb22ffdd8a02 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:20:04.760694 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c7269892-383f-4db0-93d7-bb22ffdd8a02 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 0c5579f5-c8c5-4226-baad-253c0a60b3f3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:04.781641 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-c7269892-383f-4db0-93d7-bb22ffdd8a02 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] HTTP exception thrown: Instance 0c5579f5-c8c5-4226-baad-253c0a60b3f3 could not be found. Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c7269892-383f-4db0-93d7-bb22ffdd8a02 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Request method failure captured: Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/servers/0c5579f5-c8c5-4226-baad-253c0a60b3f3/action HTTP/1.1 Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 14 Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJZEAurAeILsYJek3MCv_ryiTbidOLVZq6W4I7jJxeY_1_bTWRye2xM3EDOhowd_NyioevvIvzT9beBCgKqri_ZjLw9hdsIISMXmajO_VmobATT_GwpY_Y-GVylQtV9MoF1-Bup_Ahjld_2riQHnDzqLUWULm2acZYcK9UIbslVsdDU Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}] Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: cd6a6c5240f94ace91e1f0ed3e53fa7c Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: {"shelve": {}} Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 0c5579f5-c8c5-4226-baad-253c0a60b3f3 could not be found. Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '0c5579f5-c8c5-4226-baad-253c0a60b3f3', 'body': {'shelve': {}}} Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c5579f5-c8c5-4226-baad-253c0a60b3f3 could not be found. Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c5579f5-c8c5-4226-baad-253c0a60b3f3 could not be found. Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:20:04.803035 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:20:04.807848 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:20:04.807848 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:20:04.807848 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c5579f5-c8c5-4226-baad-253c0a60b3f3 could not be found. Oct 23 01:20:04.807848 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:20:04.811312 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c7269892-383f-4db0-93d7-bb22ffdd8a02 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Returning 404 to user: Instance 0c5579f5-c8c5-4226-baad-253c0a60b3f3 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:20:04.822061 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c7269892-383f-4db0-93d7-bb22ffdd8a02 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "POST /compute/v2.1/servers/0c5579f5-c8c5-4226-baad-253c0a60b3f3/action" status: 404 len: 111 microversion: 2.1 time: 0.061904 Oct 23 01:20:04.824849 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1315/2646] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:20:04 2022] POST /compute/v2.1/servers/0c5579f5-c8c5-4226-baad-253c0a60b3f3/action => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:20:04.835253 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d225cb12-943e-4ee1-aa28-48f0ef82a878 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:04.836726 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d225cb12-943e-4ee1-aa28-48f0ef82a878 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: ad3fdbf4-6dba-46a6-9132-e555185544b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:04.850716 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d225cb12-943e-4ee1-aa28-48f0ef82a878 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:04.854575 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d225cb12-943e-4ee1-aa28-48f0ef82a878 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:04.855318 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d225cb12-943e-4ee1-aa28-48f0ef82a878 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:04.856834 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d225cb12-943e-4ee1-aa28-48f0ef82a878 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:04.860416 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d225cb12-943e-4ee1-aa28-48f0ef82a878 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:04.861425 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d225cb12-943e-4ee1-aa28-48f0ef82a878 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:04.987700 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8b8345c3-aebd-4d18-b1b3-bddb6fde1784 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:04.998847 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8b8345c3-aebd-4d18-b1b3-bddb6fde1784 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097" status: 200 len: 1517 microversion: 2.1 time: 0.654314 Oct 23 01:20:05.013998 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1332/2647] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:04 2022] GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097 => generated 1517 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:05.017487 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-373d781d-68a3-4de5-b940-40232c3918cc tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Action: 'update', calling method: .version_select at 0x7f5cc631f790>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:20:05.106817 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-373d781d-68a3-4de5-b940-40232c3918cc tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:05.107566 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-373d781d-68a3-4de5-b940-40232c3918cc tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:05.108310 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-373d781d-68a3-4de5-b940-40232c3918cc tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:05.109787 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-373d781d-68a3-4de5-b940-40232c3918cc tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:05.110585 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-373d781d-68a3-4de5-b940-40232c3918cc tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:05.111202 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-373d781d-68a3-4de5-b940-40232c3918cc tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:05.149246 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:20:05.153807 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d225cb12-943e-4ee1-aa28-48f0ef82a878 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:05.164088 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d225cb12-943e-4ee1-aa28-48f0ef82a878 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0" status: 200 len: 1314 microversion: 2.1 time: 0.337892 Oct 23 01:20:05.165086 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1316/2648] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:04 2022] GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0 => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:05.183302 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9ca44657-0e0c-4f55-85a3-72b0199d253c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:05.184742 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9ca44657-0e0c-4f55-85a3-72b0199d253c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:05.196084 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ca44657-0e0c-4f55-85a3-72b0199d253c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:05.196625 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ca44657-0e0c-4f55-85a3-72b0199d253c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:05.197071 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ca44657-0e0c-4f55-85a3-72b0199d253c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:05.197771 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ca44657-0e0c-4f55-85a3-72b0199d253c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:05.199042 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ca44657-0e0c-4f55-85a3-72b0199d253c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:05.199760 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ca44657-0e0c-4f55-85a3-72b0199d253c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:05.314384 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-373d781d-68a3-4de5-b940-40232c3918cc tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-sets/5b9136074f0b46428cd4a61e68be10a2" status: 200 len: 325 microversion: 2.1 time: 0.311548 Oct 23 01:20:05.340513 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1333/2649] 10.222.0.42 () {60 vars in 1262 bytes} [Sun Oct 23 01:20:05 2022] PUT /compute/v2.1/os-quota-sets/5b9136074f0b46428cd4a61e68be10a2 => generated 325 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:20:05.355916 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-788c2971-ee02-4d97-8335-872d0446149a tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:05.363309 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-788c2971-ee02-4d97-8335-872d0446149a tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] [instance: 9ed76d3e-f334-4835-91f8-8bcbc1076b60] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:05.381367 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-788c2971-ee02-4d97-8335-872d0446149a tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:05.382183 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-788c2971-ee02-4d97-8335-872d0446149a tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:05.383598 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-788c2971-ee02-4d97-8335-872d0446149a tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:05.385358 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-788c2971-ee02-4d97-8335-872d0446149a tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:05.387232 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-788c2971-ee02-4d97-8335-872d0446149a tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:05.393349 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-788c2971-ee02-4d97-8335-872d0446149a tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:05.613861 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9ca44657-0e0c-4f55-85a3-72b0199d253c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:05.633428 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9ca44657-0e0c-4f55-85a3-72b0199d253c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.466463 Oct 23 01:20:05.636981 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1317/2650] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:05 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:05.665952 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f0fb9a92-bcda-44fb-8643-44efe2736ff3 tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2022627349", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:20:05.796877 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-788c2971-ee02-4d97-8335-872d0446149a tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eb8880d07649b08bfe76a68901d81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55fb3f415da42eeb5d5514410670b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:05.807639 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-f0fb9a92-bcda-44fb-8643-44efe2736ff3 tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] validate_networks() for None {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:20:05.819282 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-788c2971-ee02-4d97-8335-872d0446149a tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed76d3e-f334-4835-91f8-8bcbc1076b60" status: 200 len: 1316 microversion: 2.1 time: 0.481865 Oct 23 01:20:05.830919 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1334/2651] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:05 2022] GET /compute/v2.1/servers/9ed76d3e-f334-4835-91f8-8bcbc1076b60 => generated 1316 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:05.842878 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-99e859fb-c31d-4a02-a626-1198ba7e6a47 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:05.843996 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-99e859fb-c31d-4a02-a626-1198ba7e6a47 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:05.853027 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-99e859fb-c31d-4a02-a626-1198ba7e6a47 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:05.853790 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-99e859fb-c31d-4a02-a626-1198ba7e6a47 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:05.854475 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-99e859fb-c31d-4a02-a626-1198ba7e6a47 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:05.855384 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-99e859fb-c31d-4a02-a626-1198ba7e6a47 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:05.856100 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-99e859fb-c31d-4a02-a626-1198ba7e6a47 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:05.856748 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-99e859fb-c31d-4a02-a626-1198ba7e6a47 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:06.273901 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-f0fb9a92-bcda-44fb-8643-44efe2736ff3 tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:20:06.275322 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-f0fb9a92-bcda-44fb-8643-44efe2736ff3 tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:20:06.279051 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-f0fb9a92-bcda-44fb-8643-44efe2736ff3 tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:20:06.279051 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-f0fb9a92-bcda-44fb-8643-44efe2736ff3 tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:20:06.279051 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-f0fb9a92-bcda-44fb-8643-44efe2736ff3 tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:20:06.294174 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f0fb9a92-bcda-44fb-8643-44efe2736ff3 tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:06.295129 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f0fb9a92-bcda-44fb-8643-44efe2736ff3 tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:06.295844 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f0fb9a92-bcda-44fb-8643-44efe2736ff3 tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:06.297017 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f0fb9a92-bcda-44fb-8643-44efe2736ff3 tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:06.298606 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f0fb9a92-bcda-44fb-8643-44efe2736ff3 tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:06.299298 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f0fb9a92-bcda-44fb-8643-44efe2736ff3 tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:06.337173 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-f0fb9a92-bcda-44fb-8643-44efe2736ff3 tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] Getting quotas for project 5b9136074f0b46428cd4a61e68be10a2. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:20:06.350797 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-f0fb9a92-bcda-44fb-8643-44efe2736ff3 tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] Getting quotas for user 2696d3387fd44aa1aab450f31f51c364 and project 5b9136074f0b46428cd4a61e68be10a2. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:20:06.378626 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.utils [None req-f0fb9a92-bcda-44fb-8643-44efe2736ff3 tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] ram quota exceeded for 5b9136074f0b46428cd4a61e68be10a2, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120944) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 23 01:20:06.383308 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-f0fb9a92-bcda-44fb-8643-44efe2736ff3 tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f0fb9a92-bcda-44fb-8643-44efe2736ff3 tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] Request method failure captured: Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 145 Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJa6SbKc1evXvy2MfQ0y6zSQMG7ysAfhhIMr067_FxC8pJ9XyTbzvCcE8mXZzjQmLSFejcQQFcY61baAibic1wtiuD15vP-bWRD2Ox3f_8LMOpgAUkzS9pzlur9CFngKk1psb6DlQnF4X65kyVbeDN8DgeKX8KFskYg6VRyWXEeZpXk Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 5b9136074f0b46428cd4a61e68be10a2 Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-QuotasAdminNegativeTest-1714020103 Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5b9136074f0b46428cd4a61e68be10a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5b9136074f0b46428cd4a61e68be10a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5b9136074f0b46428cd4a61e68be10a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5b9136074f0b46428cd4a61e68be10a2"}]}] Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-QuotasAdminNegativeTest-1714020103 Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 5b9136074f0b46428cd4a61e68be10a2 Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1714020103 Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-QuotasAdminNegativeTest-1714020103-project Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 2696d3387fd44aa1aab450f31f51c364 Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-QuotasAdminNegativeTest-1714020103-project Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2022627349", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452"}} Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-2022627349', 'imageRef': '446b40bc-db5b-4123-9278-997bd6d04a0d', 'flavorRef': '452'}}} Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 23 01:20:06.386010 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 23 01:20:06.390877 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 23 01:20:06.390877 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 23 01:20:06.390877 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 23 01:20:06.390877 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 23 01:20:06.390877 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 23 01:20:06.390877 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 23 01:20:06.390877 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:20:06.390877 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:20:06.390877 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:20:06.390877 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:20:06.390877 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:20:06.390877 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:20:06.390877 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:20:06.390877 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:20:06.390877 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:20:06.390877 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:20:06.390877 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:20:06.390877 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:20:06.390877 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:20:06.390877 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:20:06.390877 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:20:06.390877 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:20:06.390877 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 23 01:20:06.390877 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 23 01:20:06.390877 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 23 01:20:06.390877 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 23 01:20:06.390877 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:20:06.390877 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:20:06.390877 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:20:06.390877 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:20:06.390877 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:20:06.390877 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:20:06.390877 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:20:06.390877 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:20:06.390877 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 23 01:20:06.390877 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:20:06.399463 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f0fb9a92-bcda-44fb-8643-44efe2736ff3 tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:20:06.400583 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f0fb9a92-bcda-44fb-8643-44efe2736ff3 tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.749555 Oct 23 01:20:06.401928 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1318/2652] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:20:05 2022] POST /compute/v2.1/servers => generated 110 bytes in 767 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:20:06.414944 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0467b7d8-3b9d-43a3-b455-4f0263cb8384 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:06.416839 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0467b7d8-3b9d-43a3-b455-4f0263cb8384 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:06.432075 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0467b7d8-3b9d-43a3-b455-4f0263cb8384 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:06.436734 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0467b7d8-3b9d-43a3-b455-4f0263cb8384 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:06.437564 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0467b7d8-3b9d-43a3-b455-4f0263cb8384 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:06.438920 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0467b7d8-3b9d-43a3-b455-4f0263cb8384 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:06.439593 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0467b7d8-3b9d-43a3-b455-4f0263cb8384 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:06.441555 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0467b7d8-3b9d-43a3-b455-4f0263cb8384 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:06.598017 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-99e859fb-c31d-4a02-a626-1198ba7e6a47 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:06.616670 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-99e859fb-c31d-4a02-a626-1198ba7e6a47 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.778360 Oct 23 01:20:06.618317 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1335/2653] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:05 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:06.646151 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-177adb54-44e7-41dd-a451-98983b17893e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc61af040>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:06.728295 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-177adb54-44e7-41dd-a451-98983b17893e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/797a003c-18f3-460b-ab19-805335e36552" status: 200 len: 1439 microversion: 2.1 time: 0.094975 Oct 23 01:20:06.729051 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1336/2654] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:20:06 2022] GET /compute/v2.1/images/797a003c-18f3-460b-ab19-805335e36552 => generated 1439 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:06.738838 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-efdfcd06-b3b2-4e0f-ae97-877a18f7bd5a tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:06.741268 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-efdfcd06-b3b2-4e0f-ae97-877a18f7bd5a tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 6ccfe45d-f080-4066-9aad-a39c3c4cd097] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:06.758747 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-efdfcd06-b3b2-4e0f-ae97-877a18f7bd5a tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:06.759399 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-efdfcd06-b3b2-4e0f-ae97-877a18f7bd5a tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:06.759907 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-efdfcd06-b3b2-4e0f-ae97-877a18f7bd5a tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:06.763053 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-efdfcd06-b3b2-4e0f-ae97-877a18f7bd5a tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:06.763732 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-efdfcd06-b3b2-4e0f-ae97-877a18f7bd5a tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:06.764245 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-efdfcd06-b3b2-4e0f-ae97-877a18f7bd5a tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:06.911516 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0467b7d8-3b9d-43a3-b455-4f0263cb8384 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:06.929718 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0467b7d8-3b9d-43a3-b455-4f0263cb8384 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:06.935820 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0467b7d8-3b9d-43a3-b455-4f0263cb8384 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:06.939051 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0467b7d8-3b9d-43a3-b455-4f0263cb8384 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b" status: 200 len: 1476 microversion: 2.25 time: 0.533621 Oct 23 01:20:06.957498 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1319/2655] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:20:06 2022] GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b => generated 1476 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:20:06.979206 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e83d65cb-6055-4f9c-b683-78fdf8b7054f tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:06.979858 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e83d65cb-6055-4f9c-b683-78fdf8b7054f tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: ad3fdbf4-6dba-46a6-9132-e555185544b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:07.000085 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e83d65cb-6055-4f9c-b683-78fdf8b7054f tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:07.006206 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e83d65cb-6055-4f9c-b683-78fdf8b7054f tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:07.009961 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e83d65cb-6055-4f9c-b683-78fdf8b7054f tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:07.009961 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e83d65cb-6055-4f9c-b683-78fdf8b7054f tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:07.009961 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e83d65cb-6055-4f9c-b683-78fdf8b7054f tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:07.009961 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e83d65cb-6055-4f9c-b683-78fdf8b7054f tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:07.375931 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-efdfcd06-b3b2-4e0f-ae97-877a18f7bd5a tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:07.388090 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-efdfcd06-b3b2-4e0f-ae97-877a18f7bd5a tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097" status: 200 len: 1517 microversion: 2.1 time: 0.657880 Oct 23 01:20:07.388693 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1337/2656] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:06 2022] GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097 => generated 1517 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:07.401743 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ef68b8b1-f72c-4593-8d66-acae85f0c2b3 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Action: 'update', calling method: .version_select at 0x7f5cc6335430>, body: {"quota_set": {"ram": 51200}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:20:07.425848 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e83d65cb-6055-4f9c-b683-78fdf8b7054f tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:07.439412 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e83d65cb-6055-4f9c-b683-78fdf8b7054f tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0" status: 200 len: 1314 microversion: 2.1 time: 0.480659 Oct 23 01:20:07.443109 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1320/2657] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:06 2022] GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0 => generated 1314 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:07.462506 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f63371de-d90c-4b49-a3eb-07601ecfadfc tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:20:07.463916 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f63371de-d90c-4b49-a3eb-07601ecfadfc tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:07.466122 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:UPDATE=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:20:07.470136 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f63371de-d90c-4b49-a3eb-07601ecfadfc tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:07.479407 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f63371de-d90c-4b49-a3eb-07601ecfadfc tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:07.479888 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f63371de-d90c-4b49-a3eb-07601ecfadfc tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:07.480646 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f63371de-d90c-4b49-a3eb-07601ecfadfc tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:07.481115 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f63371de-d90c-4b49-a3eb-07601ecfadfc tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:07.481547 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f63371de-d90c-4b49-a3eb-07601ecfadfc tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:07.550885 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef68b8b1-f72c-4593-8d66-acae85f0c2b3 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:07.554492 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef68b8b1-f72c-4593-8d66-acae85f0c2b3 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:07.554940 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef68b8b1-f72c-4593-8d66-acae85f0c2b3 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:07.557809 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-f63371de-d90c-4b49-a3eb-07601ecfadfc tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lazy-loading 'flavor' on Instance uuid 62a8ad26-f65b-432d-a8da-48264c426335 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:20:07.562440 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef68b8b1-f72c-4593-8d66-acae85f0c2b3 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:07.563135 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef68b8b1-f72c-4593-8d66-acae85f0c2b3 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:07.563928 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef68b8b1-f72c-4593-8d66-acae85f0c2b3 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:07.940520 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ef68b8b1-f72c-4593-8d66-acae85f0c2b3 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-sets/5b9136074f0b46428cd4a61e68be10a2" status: 200 len: 329 microversion: 2.1 time: 0.550385 Oct 23 01:20:07.954652 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1338/2658] 10.222.0.42 () {60 vars in 1262 bytes} [Sun Oct 23 01:20:07 2022] PUT /compute/v2.1/os-quota-sets/5b9136074f0b46428cd4a61e68be10a2 => generated 329 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:20:07.960460 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1ba7edf2-1ed8-452c-a5c6-e9dae04f98d4 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:07.961446 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1ba7edf2-1ed8-452c-a5c6-e9dae04f98d4 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] [instance: 9ed76d3e-f334-4835-91f8-8bcbc1076b60] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:07.969564 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1ba7edf2-1ed8-452c-a5c6-e9dae04f98d4 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:07.970501 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1ba7edf2-1ed8-452c-a5c6-e9dae04f98d4 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:07.971165 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1ba7edf2-1ed8-452c-a5c6-e9dae04f98d4 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:07.972141 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1ba7edf2-1ed8-452c-a5c6-e9dae04f98d4 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:07.972920 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1ba7edf2-1ed8-452c-a5c6-e9dae04f98d4 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:07.973724 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1ba7edf2-1ed8-452c-a5c6-e9dae04f98d4 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:08.272967 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1ba7edf2-1ed8-452c-a5c6-e9dae04f98d4 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eb8880d07649b08bfe76a68901d81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55fb3f415da42eeb5d5514410670b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:08.306395 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1ba7edf2-1ed8-452c-a5c6-e9dae04f98d4 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed76d3e-f334-4835-91f8-8bcbc1076b60" status: 200 len: 1316 microversion: 2.1 time: 0.350168 Oct 23 01:20:08.319091 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1339/2659] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:07 2022] GET /compute/v2.1/servers/9ed76d3e-f334-4835-91f8-8bcbc1076b60 => generated 1316 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:08.327806 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a9c4f682-f871-46bd-bbb7-160756398c3f tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Calling method '.version_select at 0x7f5cc61863a0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:08.331576 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9c4f682-f871-46bd-bbb7-160756398c3f tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:08.332143 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9c4f682-f871-46bd-bbb7-160756398c3f tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:08.332652 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9c4f682-f871-46bd-bbb7-160756398c3f tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:08.344866 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a9c4f682-f871-46bd-bbb7-160756398c3f tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] 10.222.0.42 "GET /compute/v2.1/os-migrations" status: 200 len: 1944 microversion: 2.25 time: 0.024522 Oct 23 01:20:08.345531 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1340/2660] 10.222.0.42 () {60 vars in 1184 bytes} [Sun Oct 23 01:20:08 2022] GET /compute/v2.1/os-migrations => generated 1944 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:20:08.361237 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-96e8cbd3-f3f8-4215-938d-579dcbef2073 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc6335040>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:08.415468 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-96e8cbd3-f3f8-4215-938d-579dcbef2073 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/797a003c-18f3-460b-ab19-805335e36552" status: 200 len: 1439 microversion: 2.1 time: 0.068923 Oct 23 01:20:08.430143 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1341/2661] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:20:08 2022] GET /compute/v2.1/images/797a003c-18f3-460b-ab19-805335e36552 => generated 1439 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:08.437881 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d1dcb96d-826d-43ef-a40e-7dc463e5f089 tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] Action: 'update', calling method: .version_select at 0x7f5cc6335e50>, body: {"quota_set": {"ram": 0}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:20:08.450072 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d1dcb96d-826d-43ef-a40e-7dc463e5f089 tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '2696d3387fd44aa1aab450f31f51c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9136074f0b46428cd4a61e68be10a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d1dcb96d-826d-43ef-a40e-7dc463e5f089 tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] Request method failure captured: Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: request: PUT /compute/v2.1/os-quota-sets/5b9136074f0b46428cd4a61e68be10a2 HTTP/1.1 Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 25 Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJa6SbKc1evXvy2MfQ0y6zSQMG7ysAfhhIMr067_FxC8pJ9XyTbzvCcE8mXZzjQmLSFejcQQFcY61baAibic1wtiuD15vP-bWRD2Ox3f_8LMOpgAUkzS9pzlur9CFngKk1psb6DlQnF4X65kyVbeDN8DgeKX8KFskYg6VRyWXEeZpXk Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 5b9136074f0b46428cd4a61e68be10a2 Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-QuotasAdminNegativeTest-1714020103 Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5b9136074f0b46428cd4a61e68be10a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5b9136074f0b46428cd4a61e68be10a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5b9136074f0b46428cd4a61e68be10a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5b9136074f0b46428cd4a61e68be10a2"}]}] Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-QuotasAdminNegativeTest-1714020103 Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 5b9136074f0b46428cd4a61e68be10a2 Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1714020103 Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-QuotasAdminNegativeTest-1714020103-project Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 2696d3387fd44aa1aab450f31f51c364 Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-QuotasAdminNegativeTest-1714020103-project Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: {"quota_set": {"ram": 0}} Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: method: Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '5b9136074f0b46428cd4a61e68be10a2', 'body': {'quota_set': {'ram': 0}}} Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise self.value Oct 23 01:20:08.462767 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 23 01:20:08.466336 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 23 01:20:08.466336 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 23 01:20:08.466336 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 23 01:20:08.466336 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 23 01:20:08.466336 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 23 01:20:08.466336 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 23 01:20:08.466336 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:20:08.466336 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:20:08.466336 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:20:08.466336 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:20:08.466336 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:20:08.466336 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:20:08.466336 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 23 01:20:08.466336 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 23 01:20:08.466336 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 23 01:20:08.466336 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:20:08.469037 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d1dcb96d-826d-43ef-a40e-7dc463e5f089 tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:20:08.470223 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d1dcb96d-826d-43ef-a40e-7dc463e5f089 tempest-QuotasAdminNegativeTest-1714020103 tempest-QuotasAdminNegativeTest-1714020103-project] 10.222.0.42 "PUT /compute/v2.1/os-quota-sets/5b9136074f0b46428cd4a61e68be10a2" status: 403 len: 116 microversion: 2.1 time: 0.038981 Oct 23 01:20:08.470978 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1342/2662] 10.222.0.42 () {60 vars in 1262 bytes} [Sun Oct 23 01:20:08 2022] PUT /compute/v2.1/os-quota-sets/5b9136074f0b46428cd4a61e68be10a2 => generated 116 bytes in 40 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:20:08.497390 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-5bf0c310-ffb5-4f25-ae47-463f9d6b8dfb req-bbfa5115-848c-4e6e-9411-f35d308bd68e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad3fdbf4-6dba-46a6-9132-e555185544b0", "tag": "815e9a21-8eb2-47db-8d75-f1f0dd7107fe"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:20:08.523250 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-5bf0c310-ffb5-4f25-ae47-463f9d6b8dfb req-bbfa5115-848c-4e6e-9411-f35d308bd68e service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:08.524309 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-5bf0c310-ffb5-4f25-ae47-463f9d6b8dfb req-bbfa5115-848c-4e6e-9411-f35d308bd68e service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:08.525931 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-5bf0c310-ffb5-4f25-ae47-463f9d6b8dfb req-bbfa5115-848c-4e6e-9411-f35d308bd68e service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:08.539039 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-5bf0c310-ffb5-4f25-ae47-463f9d6b8dfb req-bbfa5115-848c-4e6e-9411-f35d308bd68e service nova] Creating event network-changed:815e9a21-8eb2-47db-8d75-f1f0dd7107fe for instance ad3fdbf4-6dba-46a6-9132-e555185544b0 on n-h2-master-1 Oct 23 01:20:08.545671 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-5bf0c310-ffb5-4f25-ae47-463f9d6b8dfb req-bbfa5115-848c-4e6e-9411-f35d308bd68e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072390 Oct 23 01:20:08.547162 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1343/2663] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:20:08.557168 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e23bd1aa-e5c1-4796-98bc-363c48ccc765 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:08.581344 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e23bd1aa-e5c1-4796-98bc-363c48ccc765 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] [instance: 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:08.596017 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e23bd1aa-e5c1-4796-98bc-363c48ccc765 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:08.601715 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e23bd1aa-e5c1-4796-98bc-363c48ccc765 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:08.602630 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e23bd1aa-e5c1-4796-98bc-363c48ccc765 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:08.603537 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e23bd1aa-e5c1-4796-98bc-363c48ccc765 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:08.603998 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e23bd1aa-e5c1-4796-98bc-363c48ccc765 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:08.604421 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e23bd1aa-e5c1-4796-98bc-363c48ccc765 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:08.734153 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f63371de-d90c-4b49-a3eb-07601ecfadfc tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "POST /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335/action" status: 202 len: 0 microversion: 2.1 time: 1.283650 Oct 23 01:20:08.737335 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1321/2664] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:20:07 2022] POST /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335/action => generated 0 bytes in 1293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:20:08.765150 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dccfdb1b-4313-42f8-9412-ddb2bd19c4df tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:08.766177 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-dccfdb1b-4313-42f8-9412-ddb2bd19c4df tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 6ccfe45d-f080-4066-9aad-a39c3c4cd097] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:08.815740 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dccfdb1b-4313-42f8-9412-ddb2bd19c4df tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:08.816792 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dccfdb1b-4313-42f8-9412-ddb2bd19c4df tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:08.821429 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dccfdb1b-4313-42f8-9412-ddb2bd19c4df tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:08.826286 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dccfdb1b-4313-42f8-9412-ddb2bd19c4df tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:08.828243 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dccfdb1b-4313-42f8-9412-ddb2bd19c4df tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:08.829940 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dccfdb1b-4313-42f8-9412-ddb2bd19c4df tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:09.285277 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-e23bd1aa-e5c1-4796-98bc-363c48ccc765 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] Lazy-loading 'services' on Instance uuid 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:20:09.315849 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e23bd1aa-e5c1-4796-98bc-363c48ccc765 tempest-LiveAutoBlockMigrationV225Test-264481166 tempest-LiveAutoBlockMigrationV225Test-264481166-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b" status: 200 len: 1968 microversion: 2.25 time: 0.767263 Oct 23 01:20:09.326038 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1344/2665] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:20:08 2022] GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b => generated 1968 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:20:09.335781 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3675d0b9-b95b-4885-93ff-50735b7a236b tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:09.336408 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3675d0b9-b95b-4885-93ff-50735b7a236b tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: ad3fdbf4-6dba-46a6-9132-e555185544b0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:09.398503 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3675d0b9-b95b-4885-93ff-50735b7a236b tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:09.399251 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3675d0b9-b95b-4885-93ff-50735b7a236b tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:09.401409 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3675d0b9-b95b-4885-93ff-50735b7a236b tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:09.402357 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3675d0b9-b95b-4885-93ff-50735b7a236b tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:09.407219 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3675d0b9-b95b-4885-93ff-50735b7a236b tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:09.407855 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3675d0b9-b95b-4885-93ff-50735b7a236b tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:10.090161 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-dccfdb1b-4313-42f8-9412-ddb2bd19c4df tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:10.120729 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-dccfdb1b-4313-42f8-9412-ddb2bd19c4df tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097" status: 200 len: 1517 microversion: 2.1 time: 1.377610 Oct 23 01:20:10.136748 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1322/2666] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:08 2022] GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097 => generated 1517 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:10.149961 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6faf5844-e803-4411-be8f-5e7ec23c4571 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:10.150981 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6faf5844-e803-4411-be8f-5e7ec23c4571 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:10.158257 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6faf5844-e803-4411-be8f-5e7ec23c4571 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:10.158996 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6faf5844-e803-4411-be8f-5e7ec23c4571 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:10.160486 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6faf5844-e803-4411-be8f-5e7ec23c4571 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:10.161462 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6faf5844-e803-4411-be8f-5e7ec23c4571 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:10.163182 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6faf5844-e803-4411-be8f-5e7ec23c4571 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:10.163820 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6faf5844-e803-4411-be8f-5e7ec23c4571 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:10.334121 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3675d0b9-b95b-4885-93ff-50735b7a236b tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:10.343443 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3675d0b9-b95b-4885-93ff-50735b7a236b tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0" status: 200 len: 1314 microversion: 2.1 time: 1.010993 Oct 23 01:20:10.356847 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1345/2667] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:09 2022] GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0 => generated 1314 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:10.362206 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bb72473d-8ff8-4eea-8e43-ae6771effc4c tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:10.363409 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-bb72473d-8ff8-4eea-8e43-ae6771effc4c tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] [instance: 9ed76d3e-f334-4835-91f8-8bcbc1076b60] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:10.372296 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bb72473d-8ff8-4eea-8e43-ae6771effc4c tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:10.375783 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bb72473d-8ff8-4eea-8e43-ae6771effc4c tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:10.376305 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bb72473d-8ff8-4eea-8e43-ae6771effc4c tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:10.377175 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bb72473d-8ff8-4eea-8e43-ae6771effc4c tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:10.378120 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bb72473d-8ff8-4eea-8e43-ae6771effc4c tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:10.382618 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bb72473d-8ff8-4eea-8e43-ae6771effc4c tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:10.763532 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6faf5844-e803-4411-be8f-5e7ec23c4571 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:10.773220 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6faf5844-e803-4411-be8f-5e7ec23c4571 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1511 microversion: 2.1 time: 0.635072 Oct 23 01:20:10.773905 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1323/2668] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:10 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1511 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:10.779279 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7e471abf-1894-4c14-967b-d6946e767a8d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:10.779997 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7e471abf-1894-4c14-967b-d6946e767a8d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:10.785320 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bb72473d-8ff8-4eea-8e43-ae6771effc4c tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eb8880d07649b08bfe76a68901d81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55fb3f415da42eeb5d5514410670b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:10.787185 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e471abf-1894-4c14-967b-d6946e767a8d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:10.787742 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e471abf-1894-4c14-967b-d6946e767a8d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:10.788455 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e471abf-1894-4c14-967b-d6946e767a8d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:10.789296 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e471abf-1894-4c14-967b-d6946e767a8d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:10.789808 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e471abf-1894-4c14-967b-d6946e767a8d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:10.790552 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e471abf-1894-4c14-967b-d6946e767a8d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:10.794707 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bb72473d-8ff8-4eea-8e43-ae6771effc4c tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed76d3e-f334-4835-91f8-8bcbc1076b60" status: 200 len: 1316 microversion: 2.1 time: 0.436426 Oct 23 01:20:10.795329 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1346/2669] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:10 2022] GET /compute/v2.1/servers/9ed76d3e-f334-4835-91f8-8bcbc1076b60 => generated 1316 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:10.800647 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d80f79f3-0bbb-4b24-a3a6-8df0718077ae tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc6373700>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:10.823389 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7e471abf-1894-4c14-967b-d6946e767a8d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:20:10.877212 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d80f79f3-0bbb-4b24-a3a6-8df0718077ae tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/797a003c-18f3-460b-ab19-805335e36552" status: 200 len: 1448 microversion: 2.1 time: 0.080110 Oct 23 01:20:10.878137 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1347/2670] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:20:10 2022] GET /compute/v2.1/images/797a003c-18f3-460b-ab19-805335e36552 => generated 1448 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:10.884502 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-21d3669b-93cc-48b3-87d9-b35e9483dfdb req-bf21f6b5-66d0-44a5-9ac2-1370cb1dfab5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ed76d3e-f334-4835-91f8-8bcbc1076b60", "name": "network-vif-plugged", "status": "completed", "tag": "df96f59d-1993-491c-9189-d26c9473816b"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:20:10.895233 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-21d3669b-93cc-48b3-87d9-b35e9483dfdb req-bf21f6b5-66d0-44a5-9ac2-1370cb1dfab5 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:10.899054 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-21d3669b-93cc-48b3-87d9-b35e9483dfdb req-bf21f6b5-66d0-44a5-9ac2-1370cb1dfab5 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:10.899672 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-21d3669b-93cc-48b3-87d9-b35e9483dfdb req-bf21f6b5-66d0-44a5-9ac2-1370cb1dfab5 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:10.914822 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-21d3669b-93cc-48b3-87d9-b35e9483dfdb req-bf21f6b5-66d0-44a5-9ac2-1370cb1dfab5 service nova] Creating event network-vif-plugged:df96f59d-1993-491c-9189-d26c9473816b for instance 9ed76d3e-f334-4835-91f8-8bcbc1076b60 on n-h2-master-1 Oct 23 01:20:10.921535 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-21d3669b-93cc-48b3-87d9-b35e9483dfdb req-bf21f6b5-66d0-44a5-9ac2-1370cb1dfab5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041128 Oct 23 01:20:10.922742 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1348/2671] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:20:10.930375 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c1f888c4-6cc9-436e-b42c-ba70d85cdcc2 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc62e51f0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:10.986310 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c1f888c4-6cc9-436e-b42c-ba70d85cdcc2 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/797a003c-18f3-460b-ab19-805335e36552" status: 200 len: 1448 microversion: 2.1 time: 0.061740 Oct 23 01:20:10.986903 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1349/2672] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:20:10 2022] GET /compute/v2.1/images/797a003c-18f3-460b-ab19-805335e36552 => generated 1448 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:11.002169 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5a8e0c24-e724-4c48-91b8-c167e58edfed tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc2a19f70>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:11.236169 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7e471abf-1894-4c14-967b-d6946e767a8d tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b" status: 204 len: 0 microversion: 2.25 time: 0.460494 Oct 23 01:20:11.237783 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1324/2673] 10.222.0.42 () {60 vars in 1280 bytes} [Sun Oct 23 01:20:10 2022] DELETE /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 23 01:20:11.248753 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-74a75b31-77d5-484f-b10f-229a2eef5180 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:11.249707 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-74a75b31-77d5-484f-b10f-229a2eef5180 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 6ccfe45d-f080-4066-9aad-a39c3c4cd097] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:11.262380 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-74a75b31-77d5-484f-b10f-229a2eef5180 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:11.262899 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-74a75b31-77d5-484f-b10f-229a2eef5180 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:11.263454 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-74a75b31-77d5-484f-b10f-229a2eef5180 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:11.264325 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-74a75b31-77d5-484f-b10f-229a2eef5180 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:11.265021 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-74a75b31-77d5-484f-b10f-229a2eef5180 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:11.265464 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-74a75b31-77d5-484f-b10f-229a2eef5180 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:11.441396 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-74a75b31-77d5-484f-b10f-229a2eef5180 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:11.451106 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-74a75b31-77d5-484f-b10f-229a2eef5180 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097" status: 200 len: 1517 microversion: 2.1 time: 0.211928 Oct 23 01:20:11.454651 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1325/2674] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:11 2022] GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097 => generated 1517 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:11.468084 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-16d0997a-6204-48da-87fd-8d1a402fe8fa tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:11.468679 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-16d0997a-6204-48da-87fd-8d1a402fe8fa tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:11.477212 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-16d0997a-6204-48da-87fd-8d1a402fe8fa tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:11.477816 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-16d0997a-6204-48da-87fd-8d1a402fe8fa tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:11.478263 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-16d0997a-6204-48da-87fd-8d1a402fe8fa tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:11.478992 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-16d0997a-6204-48da-87fd-8d1a402fe8fa tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:11.479464 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-16d0997a-6204-48da-87fd-8d1a402fe8fa tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:11.480205 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-16d0997a-6204-48da-87fd-8d1a402fe8fa tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:11.662036 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-16d0997a-6204-48da-87fd-8d1a402fe8fa tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:11.674347 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-16d0997a-6204-48da-87fd-8d1a402fe8fa tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:11.679022 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-16d0997a-6204-48da-87fd-8d1a402fe8fa tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:11.680816 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-16d0997a-6204-48da-87fd-8d1a402fe8fa tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b" status: 200 len: 1482 microversion: 2.25 time: 0.224756 Oct 23 01:20:11.681585 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1326/2675] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:20:11 2022] GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b => generated 1482 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:20:11.689679 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0724b613-6124-4ed8-a037-53f99c0ebbdc tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:11.690860 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0724b613-6124-4ed8-a037-53f99c0ebbdc tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: ad3fdbf4-6dba-46a6-9132-e555185544b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:11.700854 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0724b613-6124-4ed8-a037-53f99c0ebbdc tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:11.701642 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0724b613-6124-4ed8-a037-53f99c0ebbdc tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:11.702872 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0724b613-6124-4ed8-a037-53f99c0ebbdc tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:11.704137 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0724b613-6124-4ed8-a037-53f99c0ebbdc tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:11.705122 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0724b613-6124-4ed8-a037-53f99c0ebbdc tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:11.705622 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0724b613-6124-4ed8-a037-53f99c0ebbdc tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:11.884816 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0724b613-6124-4ed8-a037-53f99c0ebbdc tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:11.896750 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0724b613-6124-4ed8-a037-53f99c0ebbdc tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0" status: 200 len: 1314 microversion: 2.1 time: 0.213669 Oct 23 01:20:11.911072 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1327/2676] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:11 2022] GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:11.920156 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-88c2177b-c26c-4699-89cc-44ede45817f8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:11.922107 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-88c2177b-c26c-4699-89cc-44ede45817f8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:11.928699 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-88c2177b-c26c-4699-89cc-44ede45817f8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:11.929400 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-88c2177b-c26c-4699-89cc-44ede45817f8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:11.930127 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-88c2177b-c26c-4699-89cc-44ede45817f8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:11.931651 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-88c2177b-c26c-4699-89cc-44ede45817f8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:11.932290 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-88c2177b-c26c-4699-89cc-44ede45817f8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:11.933006 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-88c2177b-c26c-4699-89cc-44ede45817f8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:12.144476 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-88c2177b-c26c-4699-89cc-44ede45817f8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:12.154359 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-88c2177b-c26c-4699-89cc-44ede45817f8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1511 microversion: 2.1 time: 0.242033 Oct 23 01:20:12.155254 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1328/2677] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:11 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1511 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:12.160161 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e534b893-a486-44f6-9bf8-cdf342b83c4f tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:12.161253 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e534b893-a486-44f6-9bf8-cdf342b83c4f tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] [instance: 9ed76d3e-f334-4835-91f8-8bcbc1076b60] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:12.167782 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e534b893-a486-44f6-9bf8-cdf342b83c4f tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:12.168661 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e534b893-a486-44f6-9bf8-cdf342b83c4f tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:12.169310 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e534b893-a486-44f6-9bf8-cdf342b83c4f tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:12.170334 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e534b893-a486-44f6-9bf8-cdf342b83c4f tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:12.194834 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e534b893-a486-44f6-9bf8-cdf342b83c4f tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:12.195757 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e534b893-a486-44f6-9bf8-cdf342b83c4f tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:12.243205 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:20:12.451069 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e534b893-a486-44f6-9bf8-cdf342b83c4f tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eb8880d07649b08bfe76a68901d81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55fb3f415da42eeb5d5514410670b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:12.459706 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e534b893-a486-44f6-9bf8-cdf342b83c4f tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed76d3e-f334-4835-91f8-8bcbc1076b60" status: 200 len: 1316 microversion: 2.1 time: 0.303170 Oct 23 01:20:12.460300 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1329/2678] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:12 2022] GET /compute/v2.1/servers/9ed76d3e-f334-4835-91f8-8bcbc1076b60 => generated 1316 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:12.489772 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fd40936a-ee22-4f72-a055-b82fc7362131 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:12.493801 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fd40936a-ee22-4f72-a055-b82fc7362131 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 6ccfe45d-f080-4066-9aad-a39c3c4cd097] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:12.504293 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fd40936a-ee22-4f72-a055-b82fc7362131 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:12.510542 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fd40936a-ee22-4f72-a055-b82fc7362131 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:12.513143 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fd40936a-ee22-4f72-a055-b82fc7362131 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:12.515527 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fd40936a-ee22-4f72-a055-b82fc7362131 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:12.518711 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fd40936a-ee22-4f72-a055-b82fc7362131 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:12.519664 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fd40936a-ee22-4f72-a055-b82fc7362131 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:12.751595 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fd40936a-ee22-4f72-a055-b82fc7362131 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:12.765889 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fd40936a-ee22-4f72-a055-b82fc7362131 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097" status: 200 len: 1535 microversion: 2.1 time: 0.284943 Oct 23 01:20:12.778731 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1330/2679] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:12 2022] GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097 => generated 1535 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:12.786262 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5a8e0c24-e724-4c48-91b8-c167e58edfed tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "DELETE /compute/v2.1/images/797a003c-18f3-460b-ab19-805335e36552" status: 204 len: 0 microversion: 2.1 time: 1.788474 Oct 23 01:20:12.791303 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1350/2680] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:10 2022] DELETE /compute/v2.1/images/797a003c-18f3-460b-ab19-805335e36552 => generated 0 bytes in 1791 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 23 01:20:12.793905 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e7f358e1-b74a-49ad-988d-d92c201afd75 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:12.794652 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e7f358e1-b74a-49ad-988d-d92c201afd75 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:12.798985 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8a63dfb6-937b-4466-83f2-b30a1fc4e41d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:12.800086 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8a63dfb6-937b-4466-83f2-b30a1fc4e41d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 8fb6c2f7-737b-4b87-9f6b-58ba7f12e428] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:12.808560 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e7f358e1-b74a-49ad-988d-d92c201afd75 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:12.809312 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a63dfb6-937b-4466-83f2-b30a1fc4e41d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:12.810108 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a63dfb6-937b-4466-83f2-b30a1fc4e41d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:12.810232 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e7f358e1-b74a-49ad-988d-d92c201afd75 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:12.810989 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a63dfb6-937b-4466-83f2-b30a1fc4e41d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:12.811915 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a63dfb6-937b-4466-83f2-b30a1fc4e41d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:12.812710 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e7f358e1-b74a-49ad-988d-d92c201afd75 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:12.813122 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a63dfb6-937b-4466-83f2-b30a1fc4e41d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:12.813797 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a63dfb6-937b-4466-83f2-b30a1fc4e41d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:12.813935 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e7f358e1-b74a-49ad-988d-d92c201afd75 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:12.814497 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e7f358e1-b74a-49ad-988d-d92c201afd75 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:12.814944 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e7f358e1-b74a-49ad-988d-d92c201afd75 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:12.861116 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8a63dfb6-937b-4466-83f2-b30a1fc4e41d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 8fb6c2f7-737b-4b87-9f6b-58ba7f12e428] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:20:12.928401 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:20:13.032205 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e7f358e1-b74a-49ad-988d-d92c201afd75 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:13.042083 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e7f358e1-b74a-49ad-988d-d92c201afd75 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:13.043959 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e7f358e1-b74a-49ad-988d-d92c201afd75 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:13.045340 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e7f358e1-b74a-49ad-988d-d92c201afd75 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b" status: 200 len: 1482 microversion: 2.25 time: 0.265503 Oct 23 01:20:13.047068 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1331/2681] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:20:12 2022] GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b => generated 1482 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:20:13.052023 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a6660226-7c6d-4e97-813d-e1d0fe24327c tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:13.053132 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a6660226-7c6d-4e97-813d-e1d0fe24327c tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: ad3fdbf4-6dba-46a6-9132-e555185544b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:13.060414 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6660226-7c6d-4e97-813d-e1d0fe24327c tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:13.061113 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6660226-7c6d-4e97-813d-e1d0fe24327c tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:13.062319 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6660226-7c6d-4e97-813d-e1d0fe24327c tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:13.063288 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6660226-7c6d-4e97-813d-e1d0fe24327c tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:13.063904 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6660226-7c6d-4e97-813d-e1d0fe24327c tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:13.064578 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6660226-7c6d-4e97-813d-e1d0fe24327c tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:13.276493 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8a63dfb6-937b-4466-83f2-b30a1fc4e41d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8fb6c2f7-737b-4b87-9f6b-58ba7f12e428" status: 204 len: 0 microversion: 2.1 time: 0.483222 Oct 23 01:20:13.277766 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1351/2682] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:20:12 2022] DELETE /compute/v2.1/servers/8fb6c2f7-737b-4b87-9f6b-58ba7f12e428 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:20:13.284459 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-338c9d9d-b26a-4fb8-b204-3a123e0ae321 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:13.286200 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-338c9d9d-b26a-4fb8-b204-3a123e0ae321 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:13.294338 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-338c9d9d-b26a-4fb8-b204-3a123e0ae321 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:13.296304 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-338c9d9d-b26a-4fb8-b204-3a123e0ae321 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:13.296745 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-338c9d9d-b26a-4fb8-b204-3a123e0ae321 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:13.297866 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-338c9d9d-b26a-4fb8-b204-3a123e0ae321 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:13.299021 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-338c9d9d-b26a-4fb8-b204-3a123e0ae321 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:13.299602 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-338c9d9d-b26a-4fb8-b204-3a123e0ae321 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:13.438998 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a6660226-7c6d-4e97-813d-e1d0fe24327c tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:13.447158 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a6660226-7c6d-4e97-813d-e1d0fe24327c tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0" status: 200 len: 1314 microversion: 2.1 time: 0.398915 Oct 23 01:20:13.448257 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1332/2683] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:13 2022] GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0 => generated 1314 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:13.454043 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0f3b8b20-6100-4cb5-a93e-a3e93383e3bc tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1551906264", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "7a6a6c21-62ee-4ff5-ad89-ac85c31d0d64"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:20:13.514232 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-0f3b8b20-6100-4cb5-a93e-a3e93383e3bc tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] validate_networks() for [('7a6a6c21-62ee-4ff5-ad89-ac85c31d0d64', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:20:13.678998 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-338c9d9d-b26a-4fb8-b204-3a123e0ae321 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:13.692603 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-338c9d9d-b26a-4fb8-b204-3a123e0ae321 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1511 microversion: 2.1 time: 0.413288 Oct 23 01:20:13.712024 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1352/2684] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:13 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1511 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:13.725738 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d794bb98-560e-4f9f-b1b9-a7188b8470d6 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:13.726390 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d794bb98-560e-4f9f-b1b9-a7188b8470d6 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] [instance: 9ed76d3e-f334-4835-91f8-8bcbc1076b60] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:13.747262 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d794bb98-560e-4f9f-b1b9-a7188b8470d6 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:13.754260 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d794bb98-560e-4f9f-b1b9-a7188b8470d6 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:13.754260 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d794bb98-560e-4f9f-b1b9-a7188b8470d6 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:13.754260 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d794bb98-560e-4f9f-b1b9-a7188b8470d6 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:13.754260 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d794bb98-560e-4f9f-b1b9-a7188b8470d6 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:13.754260 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d794bb98-560e-4f9f-b1b9-a7188b8470d6 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:14.235207 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d794bb98-560e-4f9f-b1b9-a7188b8470d6 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eb8880d07649b08bfe76a68901d81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55fb3f415da42eeb5d5514410670b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:14.251142 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d794bb98-560e-4f9f-b1b9-a7188b8470d6 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed76d3e-f334-4835-91f8-8bcbc1076b60" status: 200 len: 1316 microversion: 2.1 time: 0.525454 Oct 23 01:20:14.267885 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1353/2685] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:13 2022] GET /compute/v2.1/servers/9ed76d3e-f334-4835-91f8-8bcbc1076b60 => generated 1316 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:14.276230 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ed9877f4-1b25-43aa-9b85-0fee1191d56c tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:14.277698 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ed9877f4-1b25-43aa-9b85-0fee1191d56c tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 6ccfe45d-f080-4066-9aad-a39c3c4cd097] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:14.286161 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ed9877f4-1b25-43aa-9b85-0fee1191d56c tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:14.287029 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ed9877f4-1b25-43aa-9b85-0fee1191d56c tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:14.288133 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ed9877f4-1b25-43aa-9b85-0fee1191d56c tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:14.289142 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ed9877f4-1b25-43aa-9b85-0fee1191d56c tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:14.289813 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ed9877f4-1b25-43aa-9b85-0fee1191d56c tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:14.290509 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ed9877f4-1b25-43aa-9b85-0fee1191d56c tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:14.437065 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-0f3b8b20-6100-4cb5-a93e-a3e93383e3bc tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:20:14.437503 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-0f3b8b20-6100-4cb5-a93e-a3e93383e3bc tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:20:14.437999 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-0f3b8b20-6100-4cb5-a93e-a3e93383e3bc tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:20:14.438489 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-0f3b8b20-6100-4cb5-a93e-a3e93383e3bc tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:20:14.438910 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-0f3b8b20-6100-4cb5-a93e-a3e93383e3bc tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:20:14.453753 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=47 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:20:14.460530 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0f3b8b20-6100-4cb5-a93e-a3e93383e3bc tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:14.463737 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0f3b8b20-6100-4cb5-a93e-a3e93383e3bc tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:14.463737 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0f3b8b20-6100-4cb5-a93e-a3e93383e3bc tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:14.463737 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0f3b8b20-6100-4cb5-a93e-a3e93383e3bc tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:14.463737 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0f3b8b20-6100-4cb5-a93e-a3e93383e3bc tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:14.463737 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0f3b8b20-6100-4cb5-a93e-a3e93383e3bc tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:14.512411 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-0f3b8b20-6100-4cb5-a93e-a3e93383e3bc tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Getting quotas for project 50bd4c137b6a42488f39d173d46520dd. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:20:14.527874 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-0f3b8b20-6100-4cb5-a93e-a3e93383e3bc tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Getting quotas for user ecb97fa679eb4bf8a41862d3c248a217 and project 50bd4c137b6a42488f39d173d46520dd. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:20:14.554473 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0f3b8b20-6100-4cb5-a93e-a3e93383e3bc tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:20:14.566244 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0f3b8b20-6100-4cb5-a93e-a3e93383e3bc tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 9a64ad71-9caf-4645-be7a-b56f8f584c2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:20:14.681306 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ed9877f4-1b25-43aa-9b85-0fee1191d56c tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:14.692947 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ed9877f4-1b25-43aa-9b85-0fee1191d56c tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097" status: 200 len: 1523 microversion: 2.1 time: 0.423143 Oct 23 01:20:14.695746 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1354/2686] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:14 2022] GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097 => generated 1523 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:14.706219 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7f826ccb-4f91-4cd5-928d-ed0be8adac79 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:14.710723 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7f826ccb-4f91-4cd5-928d-ed0be8adac79 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:14.722824 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0f3b8b20-6100-4cb5-a93e-a3e93383e3bc tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.273186 Oct 23 01:20:14.725397 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1333/2687] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:20:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1277 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:20:14.727782 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f826ccb-4f91-4cd5-928d-ed0be8adac79 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:14.728593 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f826ccb-4f91-4cd5-928d-ed0be8adac79 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:14.729411 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f826ccb-4f91-4cd5-928d-ed0be8adac79 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:14.735928 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f826ccb-4f91-4cd5-928d-ed0be8adac79 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:14.735928 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f826ccb-4f91-4cd5-928d-ed0be8adac79 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:14.736116 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4f402148-105b-466c-8067-40080fad1762 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:14.736195 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f826ccb-4f91-4cd5-928d-ed0be8adac79 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:14.736279 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4f402148-105b-466c-8067-40080fad1762 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: ad3fdbf4-6dba-46a6-9132-e555185544b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:14.741933 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f402148-105b-466c-8067-40080fad1762 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:14.742736 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f402148-105b-466c-8067-40080fad1762 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:14.743381 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f402148-105b-466c-8067-40080fad1762 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:14.744786 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f402148-105b-466c-8067-40080fad1762 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:14.745403 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f402148-105b-466c-8067-40080fad1762 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:14.746007 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f402148-105b-466c-8067-40080fad1762 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:15.197848 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7f826ccb-4f91-4cd5-928d-ed0be8adac79 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:15.212635 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7f826ccb-4f91-4cd5-928d-ed0be8adac79 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:15.215827 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7f826ccb-4f91-4cd5-928d-ed0be8adac79 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:15.219146 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7f826ccb-4f91-4cd5-928d-ed0be8adac79 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b" status: 200 len: 1482 microversion: 2.25 time: 0.521533 Oct 23 01:20:15.220132 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1355/2688] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:20:14 2022] GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b => generated 1482 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:20:15.257135 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bd79dba3-c931-4016-9e01-f891fed29cf0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:15.259421 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-bd79dba3-c931-4016-9e01-f891fed29cf0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:15.260471 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4f402148-105b-466c-8067-40080fad1762 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:15.272153 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4f402148-105b-466c-8067-40080fad1762 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0" status: 200 len: 1314 microversion: 2.1 time: 0.545165 Oct 23 01:20:15.273302 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1334/2689] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:14 2022] GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0 => generated 1314 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:15.278980 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c6b9ecd2-d2c5-4df8-9271-f1616af94982 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:15.279834 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c6b9ecd2-d2c5-4df8-9271-f1616af94982 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 9a64ad71-9caf-4645-be7a-b56f8f584c2d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:15.283208 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd79dba3-c931-4016-9e01-f891fed29cf0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:15.284196 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd79dba3-c931-4016-9e01-f891fed29cf0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:15.284838 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd79dba3-c931-4016-9e01-f891fed29cf0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:15.287164 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd79dba3-c931-4016-9e01-f891fed29cf0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:15.289155 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd79dba3-c931-4016-9e01-f891fed29cf0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:15.298759 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd79dba3-c931-4016-9e01-f891fed29cf0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:15.451599 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c6b9ecd2-d2c5-4df8-9271-f1616af94982 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:15.460824 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c6b9ecd2-d2c5-4df8-9271-f1616af94982 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/9a64ad71-9caf-4645-be7a-b56f8f584c2d" status: 200 len: 1208 microversion: 2.1 time: 0.185851 Oct 23 01:20:15.465699 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1335/2690] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:15 2022] GET /compute/v2.1/servers/9a64ad71-9caf-4645-be7a-b56f8f584c2d => generated 1208 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:15.476533 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5e33bbd4-3118-4dae-80cb-926e80a8b0a6 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:15.476533 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5e33bbd4-3118-4dae-80cb-926e80a8b0a6 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] [instance: 9ed76d3e-f334-4835-91f8-8bcbc1076b60] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:15.519698 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5e33bbd4-3118-4dae-80cb-926e80a8b0a6 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:15.522472 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5e33bbd4-3118-4dae-80cb-926e80a8b0a6 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:15.523517 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5e33bbd4-3118-4dae-80cb-926e80a8b0a6 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:15.527626 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5e33bbd4-3118-4dae-80cb-926e80a8b0a6 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:15.529150 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5e33bbd4-3118-4dae-80cb-926e80a8b0a6 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:15.530617 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5e33bbd4-3118-4dae-80cb-926e80a8b0a6 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:15.709390 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bd79dba3-c931-4016-9e01-f891fed29cf0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:15.723554 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bd79dba3-c931-4016-9e01-f891fed29cf0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1511 microversion: 2.1 time: 0.495594 Oct 23 01:20:15.734690 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1356/2691] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:15 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1511 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:15.754841 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-c18549d9-3732-4fdf-b31d-fcc5fa993d0e req-fd7de081-fb04-4a64-8ce9-e45e89a286b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b", "name": "network-vif-deleted", "tag": "5f7a3666-2b64-4e04-b1a0-59950284bbc9"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:20:15.787308 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-c18549d9-3732-4fdf-b31d-fcc5fa993d0e req-fd7de081-fb04-4a64-8ce9-e45e89a286b4 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:15.788121 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-c18549d9-3732-4fdf-b31d-fcc5fa993d0e req-fd7de081-fb04-4a64-8ce9-e45e89a286b4 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:15.788792 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-c18549d9-3732-4fdf-b31d-fcc5fa993d0e req-fd7de081-fb04-4a64-8ce9-e45e89a286b4 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:15.804773 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5e33bbd4-3118-4dae-80cb-926e80a8b0a6 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eb8880d07649b08bfe76a68901d81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55fb3f415da42eeb5d5514410670b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:15.820913 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5e33bbd4-3118-4dae-80cb-926e80a8b0a6 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed76d3e-f334-4835-91f8-8bcbc1076b60" status: 200 len: 1505 microversion: 2.1 time: 0.353805 Oct 23 01:20:15.821516 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1336/2692] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:15 2022] GET /compute/v2.1/servers/9ed76d3e-f334-4835-91f8-8bcbc1076b60 => generated 1505 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:15.857636 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-c18549d9-3732-4fdf-b31d-fcc5fa993d0e req-fd7de081-fb04-4a64-8ce9-e45e89a286b4 service nova] Creating event network-vif-deleted:5f7a3666-2b64-4e04-b1a0-59950284bbc9 for instance 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b on n-h1-master-1 Oct 23 01:20:15.892041 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-c18549d9-3732-4fdf-b31d-fcc5fa993d0e req-fd7de081-fb04-4a64-8ce9-e45e89a286b4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154914 Oct 23 01:20:15.897408 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1357/2693] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:20:15.922735 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3ab3db44-b222-45ba-bf81-e683b23519f0 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:15.924672 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3ab3db44-b222-45ba-bf81-e683b23519f0 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 6ccfe45d-f080-4066-9aad-a39c3c4cd097] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:15.942826 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3ab3db44-b222-45ba-bf81-e683b23519f0 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:15.946646 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3ab3db44-b222-45ba-bf81-e683b23519f0 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:15.947639 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3ab3db44-b222-45ba-bf81-e683b23519f0 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:15.948364 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3ab3db44-b222-45ba-bf81-e683b23519f0 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:15.949165 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3ab3db44-b222-45ba-bf81-e683b23519f0 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:15.950084 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3ab3db44-b222-45ba-bf81-e683b23519f0 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:16.067842 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-007c10f4-7616-44f6-bc88-a96a7d027053 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-253791436", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": "none"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:20:16.161093 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-007c10f4-7616-44f6-bc88-a96a7d027053 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:20:16.161530 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-007c10f4-7616-44f6-bc88-a96a7d027053 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:20:16.162033 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-007c10f4-7616-44f6-bc88-a96a7d027053 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:20:16.162454 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-007c10f4-7616-44f6-bc88-a96a7d027053 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:20:16.162870 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-007c10f4-7616-44f6-bc88-a96a7d027053 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:20:16.175894 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3ab3db44-b222-45ba-bf81-e683b23519f0 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:16.187611 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3ab3db44-b222-45ba-bf81-e683b23519f0 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097" status: 200 len: 1523 microversion: 2.1 time: 0.284470 Oct 23 01:20:16.188980 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1358/2694] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:15 2022] GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097 => generated 1523 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:16.189167 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-007c10f4-7616-44f6-bc88-a96a7d027053 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:16.190526 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-007c10f4-7616-44f6-bc88-a96a7d027053 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:16.190979 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-007c10f4-7616-44f6-bc88-a96a7d027053 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:16.191723 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-007c10f4-7616-44f6-bc88-a96a7d027053 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:16.192192 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-007c10f4-7616-44f6-bc88-a96a7d027053 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:16.192626 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-007c10f4-7616-44f6-bc88-a96a7d027053 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:16.196613 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e96c0575-677f-40a4-9da2-e273b4708d51 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:16.197361 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e96c0575-677f-40a4-9da2-e273b4708d51 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] [instance: 9ed76d3e-f334-4835-91f8-8bcbc1076b60] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:16.206017 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e96c0575-677f-40a4-9da2-e273b4708d51 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:16.206831 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e96c0575-677f-40a4-9da2-e273b4708d51 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:16.207421 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e96c0575-677f-40a4-9da2-e273b4708d51 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:16.208518 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e96c0575-677f-40a4-9da2-e273b4708d51 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:16.208986 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e96c0575-677f-40a4-9da2-e273b4708d51 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:16.209418 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e96c0575-677f-40a4-9da2-e273b4708d51 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:16.254806 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-007c10f4-7616-44f6-bc88-a96a7d027053 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Getting quotas for project f211c102b8d3427d8884e2790b264dae. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:20:16.263844 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e96c0575-677f-40a4-9da2-e273b4708d51 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '86eb8880d07649b08bfe76a68901d81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55fb3f415da42eeb5d5514410670b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:16.264962 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-007c10f4-7616-44f6-bc88-a96a7d027053 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Getting quotas for user e26043c04dc34c7299990c1c405c53a6 and project f211c102b8d3427d8884e2790b264dae. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:20:16.271585 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e96c0575-677f-40a4-9da2-e273b4708d51 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed76d3e-f334-4835-91f8-8bcbc1076b60/os-instance-actions/req-145307b3-23e2-4eef-a1a6-bbdae2d283c4" status: 200 len: 313 microversion: 2.1 time: 0.079962 Oct 23 01:20:16.283790 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1359/2695] 10.222.0.42 () {58 vars in 1419 bytes} [Sun Oct 23 01:20:16 2022] GET /compute/v2.1/servers/9ed76d3e-f334-4835-91f8-8bcbc1076b60/os-instance-actions/req-145307b3-23e2-4eef-a1a6-bbdae2d283c4 => generated 313 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:20:16.292202 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d9f65dde-30ab-4c73-8340-a3a6eff60402 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:16.296143 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d9f65dde-30ab-4c73-8340-a3a6eff60402 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:16.303636 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-007c10f4-7616-44f6-bc88-a96a7d027053 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:20:16.307794 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9f65dde-30ab-4c73-8340-a3a6eff60402 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:16.308388 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9f65dde-30ab-4c73-8340-a3a6eff60402 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:16.308834 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9f65dde-30ab-4c73-8340-a3a6eff60402 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:16.309637 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9f65dde-30ab-4c73-8340-a3a6eff60402 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:16.312004 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-007c10f4-7616-44f6-bc88-a96a7d027053 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:20:16.312177 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9f65dde-30ab-4c73-8340-a3a6eff60402 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:16.312611 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9f65dde-30ab-4c73-8340-a3a6eff60402 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:16.454609 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d9f65dde-30ab-4c73-8340-a3a6eff60402 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:16.486286 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d9f65dde-30ab-4c73-8340-a3a6eff60402 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:16.487835 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d9f65dde-30ab-4c73-8340-a3a6eff60402 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:16.488871 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d9f65dde-30ab-4c73-8340-a3a6eff60402 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b" status: 200 len: 1265 microversion: 2.25 time: 0.204003 Oct 23 01:20:16.500477 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1360/2696] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:20:16 2022] GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b => generated 1265 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:20:16.515075 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b24af3d8-c382-41c4-bff4-e40c9f95b27f tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:20:16.516453 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b24af3d8-c382-41c4-bff4-e40c9f95b27f tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] [instance: 9ed76d3e-f334-4835-91f8-8bcbc1076b60] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:16.539413 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b24af3d8-c382-41c4-bff4-e40c9f95b27f tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:16.542366 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b24af3d8-c382-41c4-bff4-e40c9f95b27f tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:16.544055 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b24af3d8-c382-41c4-bff4-e40c9f95b27f tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:16.547815 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b24af3d8-c382-41c4-bff4-e40c9f95b27f tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:16.548594 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b24af3d8-c382-41c4-bff4-e40c9f95b27f tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:16.549276 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b24af3d8-c382-41c4-bff4-e40c9f95b27f tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:16.577559 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-007c10f4-7616-44f6-bc88-a96a7d027053 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.751374 Oct 23 01:20:16.578953 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1337/2697] 10.222.0.42 () {62 vars in 1188 bytes} [Sun Oct 23 01:20:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 23 01:20:16.585734 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fe174dae-7466-4403-9dc9-6915d72835d2 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:16.595334 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fe174dae-7466-4403-9dc9-6915d72835d2 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: ad3fdbf4-6dba-46a6-9132-e555185544b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:16.595799 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe174dae-7466-4403-9dc9-6915d72835d2 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:16.596584 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe174dae-7466-4403-9dc9-6915d72835d2 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:16.597246 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe174dae-7466-4403-9dc9-6915d72835d2 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:16.598425 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe174dae-7466-4403-9dc9-6915d72835d2 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:16.599154 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe174dae-7466-4403-9dc9-6915d72835d2 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:16.599820 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe174dae-7466-4403-9dc9-6915d72835d2 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:16.853806 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fe174dae-7466-4403-9dc9-6915d72835d2 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:16.860078 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b24af3d8-c382-41c4-bff4-e40c9f95b27f tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] 10.222.0.42 "POST /compute/v2.1/servers/9ed76d3e-f334-4835-91f8-8bcbc1076b60/action" status: 202 len: 0 microversion: 2.1 time: 0.356266 Oct 23 01:20:16.866902 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1361/2698] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:20:16 2022] POST /compute/v2.1/servers/9ed76d3e-f334-4835-91f8-8bcbc1076b60/action => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:20:16.869853 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fe174dae-7466-4403-9dc9-6915d72835d2 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0" status: 200 len: 1314 microversion: 2.1 time: 0.289367 Oct 23 01:20:16.870896 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1338/2699] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:16 2022] GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0 => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:16.877358 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f16a6cb9-0c58-430e-af0e-8335689d9c40 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:16.878919 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f16a6cb9-0c58-430e-af0e-8335689d9c40 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 9a64ad71-9caf-4645-be7a-b56f8f584c2d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:16.908977 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f16a6cb9-0c58-430e-af0e-8335689d9c40 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:16.909345 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-1c274841-2535-4020-b825-0ae2b7206b6f req-6377d3ec-a858-4c38-8e5e-b8d324c5ce84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fb6c2f7-737b-4b87-9f6b-58ba7f12e428", "name": "network-vif-unplugged", "status": "completed", "tag": "810f70db-7bee-41b2-9290-606e5cf23885"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:20:16.913367 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f16a6cb9-0c58-430e-af0e-8335689d9c40 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:16.913877 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f16a6cb9-0c58-430e-af0e-8335689d9c40 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:16.916186 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f16a6cb9-0c58-430e-af0e-8335689d9c40 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:16.916667 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f16a6cb9-0c58-430e-af0e-8335689d9c40 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:16.917108 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f16a6cb9-0c58-430e-af0e-8335689d9c40 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:16.942662 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-1c274841-2535-4020-b825-0ae2b7206b6f req-6377d3ec-a858-4c38-8e5e-b8d324c5ce84 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:16.943627 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-1c274841-2535-4020-b825-0ae2b7206b6f req-6377d3ec-a858-4c38-8e5e-b8d324c5ce84 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:16.944375 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-1c274841-2535-4020-b825-0ae2b7206b6f req-6377d3ec-a858-4c38-8e5e-b8d324c5ce84 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:16.965200 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-1c274841-2535-4020-b825-0ae2b7206b6f req-6377d3ec-a858-4c38-8e5e-b8d324c5ce84 service nova] Creating event network-vif-unplugged:810f70db-7bee-41b2-9290-606e5cf23885 for instance 8fb6c2f7-737b-4b87-9f6b-58ba7f12e428 on n-h2-master-1 Oct 23 01:20:16.974241 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-1c274841-2535-4020-b825-0ae2b7206b6f req-6377d3ec-a858-4c38-8e5e-b8d324c5ce84 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111245 Oct 23 01:20:16.975937 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1362/2700] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:20:16.988799 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-61b579a9-ee23-4586-8ea4-2a1bafcb5787 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:20:16.992056 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-61b579a9-ee23-4586-8ea4-2a1bafcb5787 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:17.059377 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f16a6cb9-0c58-430e-af0e-8335689d9c40 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:17.079242 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f16a6cb9-0c58-430e-af0e-8335689d9c40 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/9a64ad71-9caf-4645-be7a-b56f8f584c2d" status: 200 len: 1204 microversion: 2.1 time: 0.206306 Oct 23 01:20:17.082899 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1339/2701] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:16 2022] GET /compute/v2.1/servers/9a64ad71-9caf-4645-be7a-b56f8f584c2d => generated 1204 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:17.093087 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-de0970c6-394c-457b-b5e1-9c9496fa306d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:17.096112 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-de0970c6-394c-457b-b5e1-9c9496fa306d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:17.117186 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-de0970c6-394c-457b-b5e1-9c9496fa306d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:17.125128 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-de0970c6-394c-457b-b5e1-9c9496fa306d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:17.125128 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-de0970c6-394c-457b-b5e1-9c9496fa306d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:17.125128 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-de0970c6-394c-457b-b5e1-9c9496fa306d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:17.125128 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-de0970c6-394c-457b-b5e1-9c9496fa306d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:17.125128 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-de0970c6-394c-457b-b5e1-9c9496fa306d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:17.655933 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=14 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:20:17.714345 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-61b579a9-ee23-4586-8ea4-2a1bafcb5787 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:17.726520 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-61b579a9-ee23-4586-8ea4-2a1bafcb5787 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:17.729033 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-61b579a9-ee23-4586-8ea4-2a1bafcb5787 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:17.741334 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-61b579a9-ee23-4586-8ea4-2a1bafcb5787 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] 10.222.0.42 "PUT /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334" status: 200 len: 1358 microversion: 2.75 time: 0.758233 Oct 23 01:20:17.744955 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1363/2702] 10.222.0.42 () {62 vars in 1297 bytes} [Sun Oct 23 01:20:16 2022] PUT /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334 => generated 1358 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:20:17.753265 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-89f8f353-507f-4668-a81f-8e2fd1847183 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:17.756519 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-89f8f353-507f-4668-a81f-8e2fd1847183 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] [instance: 9ed76d3e-f334-4835-91f8-8bcbc1076b60] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:17.766729 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-89f8f353-507f-4668-a81f-8e2fd1847183 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:17.772604 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-89f8f353-507f-4668-a81f-8e2fd1847183 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:17.774251 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-89f8f353-507f-4668-a81f-8e2fd1847183 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:17.775525 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-89f8f353-507f-4668-a81f-8e2fd1847183 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:17.776928 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-89f8f353-507f-4668-a81f-8e2fd1847183 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:17.779513 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-89f8f353-507f-4668-a81f-8e2fd1847183 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:17.980720 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-de0970c6-394c-457b-b5e1-9c9496fa306d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:17.997373 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-de0970c6-394c-457b-b5e1-9c9496fa306d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1511 microversion: 2.1 time: 0.912051 Oct 23 01:20:17.999722 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1340/2703] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:17 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1511 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:18.026332 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-93317ac7-43e3-4f8a-8fcc-56425402c0af tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:18.027514 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-93317ac7-43e3-4f8a-8fcc-56425402c0af tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 6ccfe45d-f080-4066-9aad-a39c3c4cd097] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:18.046179 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-93317ac7-43e3-4f8a-8fcc-56425402c0af tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:18.050036 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-93317ac7-43e3-4f8a-8fcc-56425402c0af tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:18.050729 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-93317ac7-43e3-4f8a-8fcc-56425402c0af tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:18.053504 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-93317ac7-43e3-4f8a-8fcc-56425402c0af tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:18.054948 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-93317ac7-43e3-4f8a-8fcc-56425402c0af tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:18.056897 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-93317ac7-43e3-4f8a-8fcc-56425402c0af tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:18.093284 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-89f8f353-507f-4668-a81f-8e2fd1847183 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eb8880d07649b08bfe76a68901d81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55fb3f415da42eeb5d5514410670b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:18.116172 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-89f8f353-507f-4668-a81f-8e2fd1847183 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed76d3e-f334-4835-91f8-8bcbc1076b60" status: 200 len: 1507 microversion: 2.1 time: 0.362043 Oct 23 01:20:18.126004 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1364/2704] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:17 2022] GET /compute/v2.1/servers/9ed76d3e-f334-4835-91f8-8bcbc1076b60 => generated 1507 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:18.145351 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-d48691ee-c53d-47c2-a375-44f96e292aa8 req-beda576f-5260-4bc7-8414-cc76387f7eda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fb6c2f7-737b-4b87-9f6b-58ba7f12e428", "name": "network-vif-deleted", "tag": "810f70db-7bee-41b2-9290-606e5cf23885"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:20:18.178232 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-d48691ee-c53d-47c2-a375-44f96e292aa8 req-beda576f-5260-4bc7-8414-cc76387f7eda service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:18.181533 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-d48691ee-c53d-47c2-a375-44f96e292aa8 req-beda576f-5260-4bc7-8414-cc76387f7eda service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:18.182144 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-d48691ee-c53d-47c2-a375-44f96e292aa8 req-beda576f-5260-4bc7-8414-cc76387f7eda service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:18.207760 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-d48691ee-c53d-47c2-a375-44f96e292aa8 req-beda576f-5260-4bc7-8414-cc76387f7eda service nova] Creating event network-vif-deleted:810f70db-7bee-41b2-9290-606e5cf23885 for instance 8fb6c2f7-737b-4b87-9f6b-58ba7f12e428 on n-h2-master-1 Oct 23 01:20:18.214378 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-d48691ee-c53d-47c2-a375-44f96e292aa8 req-beda576f-5260-4bc7-8414-cc76387f7eda service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095844 Oct 23 01:20:18.215727 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1365/2705] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:20:18.223054 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fc2c51b4-3267-4293-bb55-a2b51b1d4a73 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:18.224382 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-fc2c51b4-3267-4293-bb55-a2b51b1d4a73 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:18.234864 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc2c51b4-3267-4293-bb55-a2b51b1d4a73 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:18.235469 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc2c51b4-3267-4293-bb55-a2b51b1d4a73 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:18.236072 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc2c51b4-3267-4293-bb55-a2b51b1d4a73 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:18.236916 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc2c51b4-3267-4293-bb55-a2b51b1d4a73 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:18.237633 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc2c51b4-3267-4293-bb55-a2b51b1d4a73 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:18.238731 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc2c51b4-3267-4293-bb55-a2b51b1d4a73 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:18.497367 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-fc2c51b4-3267-4293-bb55-a2b51b1d4a73 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:18.511669 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-fc2c51b4-3267-4293-bb55-a2b51b1d4a73 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:18.513572 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-fc2c51b4-3267-4293-bb55-a2b51b1d4a73 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:18.515463 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fc2c51b4-3267-4293-bb55-a2b51b1d4a73 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b" status: 200 len: 1265 microversion: 2.25 time: 0.298225 Oct 23 01:20:18.516035 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1366/2706] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:20:18 2022] GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b => generated 1265 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:20:18.523402 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-07b15ea0-9681-4af1-81b3-5cf747405311 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:18.524417 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-07b15ea0-9681-4af1-81b3-5cf747405311 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:18.533110 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-07b15ea0-9681-4af1-81b3-5cf747405311 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:18.533696 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-07b15ea0-9681-4af1-81b3-5cf747405311 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:18.534217 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-07b15ea0-9681-4af1-81b3-5cf747405311 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:18.534970 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-07b15ea0-9681-4af1-81b3-5cf747405311 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:18.535474 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-07b15ea0-9681-4af1-81b3-5cf747405311 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:18.535916 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-07b15ea0-9681-4af1-81b3-5cf747405311 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:18.688723 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-93317ac7-43e3-4f8a-8fcc-56425402c0af tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:18.694247 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-07b15ea0-9681-4af1-81b3-5cf747405311 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:18.702530 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-93317ac7-43e3-4f8a-8fcc-56425402c0af tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097" status: 200 len: 1523 microversion: 2.1 time: 0.698114 Oct 23 01:20:18.706748 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1341/2707] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:18 2022] GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097 => generated 1523 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:18.710867 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-07b15ea0-9681-4af1-81b3-5cf747405311 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:18.712358 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-07b15ea0-9681-4af1-81b3-5cf747405311 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:18.716816 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-10788282-9980-4674-beb3-1471fb999c9f tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:18.718311 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-10788282-9980-4674-beb3-1471fb999c9f tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: ad3fdbf4-6dba-46a6-9132-e555185544b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:18.722911 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-07b15ea0-9681-4af1-81b3-5cf747405311 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] 10.222.0.42 "GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334" status: 200 len: 1362 microversion: 2.75 time: 0.204785 Oct 23 01:20:18.723513 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1367/2708] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:20:18 2022] GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334 => generated 1362 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:20:18.735491 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-10788282-9980-4674-beb3-1471fb999c9f tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:18.736789 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-10788282-9980-4674-beb3-1471fb999c9f tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:18.737410 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-10788282-9980-4674-beb3-1471fb999c9f tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:18.738571 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-10788282-9980-4674-beb3-1471fb999c9f tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:18.739216 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-10788282-9980-4674-beb3-1471fb999c9f tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:18.739812 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-10788282-9980-4674-beb3-1471fb999c9f tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:18.749050 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-93bf3a41-5dc9-4c94-a4b3-cd7e418f4f26 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:18.749881 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-93bf3a41-5dc9-4c94-a4b3-cd7e418f4f26 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 9a64ad71-9caf-4645-be7a-b56f8f584c2d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:18.764010 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-93bf3a41-5dc9-4c94-a4b3-cd7e418f4f26 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:18.773817 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-93bf3a41-5dc9-4c94-a4b3-cd7e418f4f26 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:18.777003 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-93bf3a41-5dc9-4c94-a4b3-cd7e418f4f26 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:18.780897 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-93bf3a41-5dc9-4c94-a4b3-cd7e418f4f26 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:18.788346 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-93bf3a41-5dc9-4c94-a4b3-cd7e418f4f26 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:18.804598 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-93bf3a41-5dc9-4c94-a4b3-cd7e418f4f26 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:19.046949 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-93bf3a41-5dc9-4c94-a4b3-cd7e418f4f26 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:19.059962 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-93bf3a41-5dc9-4c94-a4b3-cd7e418f4f26 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/9a64ad71-9caf-4645-be7a-b56f8f584c2d" status: 200 len: 1278 microversion: 2.1 time: 0.325149 Oct 23 01:20:19.062933 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1368/2709] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:18 2022] GET /compute/v2.1/servers/9a64ad71-9caf-4645-be7a-b56f8f584c2d => generated 1278 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:19.079733 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e663120c-a16b-4632-bb01-b4b2aebcec52 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:19.080659 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e663120c-a16b-4632-bb01-b4b2aebcec52 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:19.098785 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e663120c-a16b-4632-bb01-b4b2aebcec52 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:19.098785 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e663120c-a16b-4632-bb01-b4b2aebcec52 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:19.109191 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e663120c-a16b-4632-bb01-b4b2aebcec52 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:19.112013 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e663120c-a16b-4632-bb01-b4b2aebcec52 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:19.114962 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e663120c-a16b-4632-bb01-b4b2aebcec52 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:19.115403 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e663120c-a16b-4632-bb01-b4b2aebcec52 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:19.214062 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-10788282-9980-4674-beb3-1471fb999c9f tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:19.226806 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-10788282-9980-4674-beb3-1471fb999c9f tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0" status: 200 len: 1314 microversion: 2.1 time: 0.518830 Oct 23 01:20:19.228981 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1342/2710] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:18 2022] GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0 => generated 1314 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:19.244772 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-3ef652d6-8fc2-4125-9132-eaf58ec061c1 req-5bf6be89-94c6-4c24-9dde-dc1d5b376601 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ccfe45d-f080-4066-9aad-a39c3c4cd097", "name": "network-vif-unplugged", "status": "completed", "tag": "fce18087-d670-4b69-9cc5-11b42a9fa6de"}, {"server_uuid": "ad3fdbf4-6dba-46a6-9132-e555185544b0", "name": "network-vif-plugged", "status": "completed", "tag": "815e9a21-8eb2-47db-8d75-f1f0dd7107fe"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:20:19.269940 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-3ef652d6-8fc2-4125-9132-eaf58ec061c1 req-5bf6be89-94c6-4c24-9dde-dc1d5b376601 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:19.271683 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-3ef652d6-8fc2-4125-9132-eaf58ec061c1 req-5bf6be89-94c6-4c24-9dde-dc1d5b376601 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:19.273097 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-3ef652d6-8fc2-4125-9132-eaf58ec061c1 req-5bf6be89-94c6-4c24-9dde-dc1d5b376601 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:19.327231 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-3ef652d6-8fc2-4125-9132-eaf58ec061c1 req-5bf6be89-94c6-4c24-9dde-dc1d5b376601 service nova] Creating event network-vif-unplugged:fce18087-d670-4b69-9cc5-11b42a9fa6de for instance 6ccfe45d-f080-4066-9aad-a39c3c4cd097 on n-h1-master-1 Oct 23 01:20:19.328321 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-3ef652d6-8fc2-4125-9132-eaf58ec061c1 req-5bf6be89-94c6-4c24-9dde-dc1d5b376601 service nova] Creating event network-vif-plugged:815e9a21-8eb2-47db-8d75-f1f0dd7107fe for instance ad3fdbf4-6dba-46a6-9132-e555185544b0 on n-h2-master-1 Oct 23 01:20:19.350232 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-3ef652d6-8fc2-4125-9132-eaf58ec061c1 req-5bf6be89-94c6-4c24-9dde-dc1d5b376601 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.117398 Oct 23 01:20:19.353117 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1343/2711] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:20:19.367584 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9e82c748-4a9e-4fb8-a4a4-7c0a9ac0680f tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:19.368797 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9e82c748-4a9e-4fb8-a4a4-7c0a9ac0680f tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] [instance: 9ed76d3e-f334-4835-91f8-8bcbc1076b60] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:19.401317 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9e82c748-4a9e-4fb8-a4a4-7c0a9ac0680f tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:19.404540 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9e82c748-4a9e-4fb8-a4a4-7c0a9ac0680f tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:19.407164 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9e82c748-4a9e-4fb8-a4a4-7c0a9ac0680f tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:19.410067 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9e82c748-4a9e-4fb8-a4a4-7c0a9ac0680f tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:19.410604 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9e82c748-4a9e-4fb8-a4a4-7c0a9ac0680f tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:19.411048 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9e82c748-4a9e-4fb8-a4a4-7c0a9ac0680f tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:19.814683 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e663120c-a16b-4632-bb01-b4b2aebcec52 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:19.817964 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:20:19.827949 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e663120c-a16b-4632-bb01-b4b2aebcec52 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1511 microversion: 2.1 time: 0.762980 Oct 23 01:20:19.834120 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1369/2712] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:19 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1511 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:19.839001 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9e82c748-4a9e-4fb8-a4a4-7c0a9ac0680f tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eb8880d07649b08bfe76a68901d81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55fb3f415da42eeb5d5514410670b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:19.852548 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9e82c748-4a9e-4fb8-a4a4-7c0a9ac0680f tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed76d3e-f334-4835-91f8-8bcbc1076b60" status: 200 len: 1507 microversion: 2.1 time: 0.496956 Oct 23 01:20:19.853670 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1344/2713] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:19 2022] GET /compute/v2.1/servers/9ed76d3e-f334-4835-91f8-8bcbc1076b60 => generated 1507 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:19.859358 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-94574c11-fe56-4399-a203-6672309c87c4 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:19.860119 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-94574c11-fe56-4399-a203-6672309c87c4 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:19.875127 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bd7bc0ce-d732-40e2-8abd-200a716e5d08 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:19.875767 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bd7bc0ce-d732-40e2-8abd-200a716e5d08 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 6ccfe45d-f080-4066-9aad-a39c3c4cd097] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:19.878898 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94574c11-fe56-4399-a203-6672309c87c4 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:19.879776 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94574c11-fe56-4399-a203-6672309c87c4 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:19.880490 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94574c11-fe56-4399-a203-6672309c87c4 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:19.881477 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94574c11-fe56-4399-a203-6672309c87c4 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:19.882200 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94574c11-fe56-4399-a203-6672309c87c4 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:19.883110 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94574c11-fe56-4399-a203-6672309c87c4 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:19.884170 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bd7bc0ce-d732-40e2-8abd-200a716e5d08 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:19.884660 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bd7bc0ce-d732-40e2-8abd-200a716e5d08 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:19.885088 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bd7bc0ce-d732-40e2-8abd-200a716e5d08 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:19.894584 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bd7bc0ce-d732-40e2-8abd-200a716e5d08 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:19.895077 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bd7bc0ce-d732-40e2-8abd-200a716e5d08 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:19.895658 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bd7bc0ce-d732-40e2-8abd-200a716e5d08 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:19.962401 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-94574c11-fe56-4399-a203-6672309c87c4 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:19.976704 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-94574c11-fe56-4399-a203-6672309c87c4 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:19.979320 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-94574c11-fe56-4399-a203-6672309c87c4 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:19.985188 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-94574c11-fe56-4399-a203-6672309c87c4 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b" status: 200 len: 1265 microversion: 2.25 time: 0.142773 Oct 23 01:20:19.986049 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1370/2714] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:20:19 2022] GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:20:19.996000 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-64e84e89-9285-4665-ab35-b86cc3405c3c tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:20.000687 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-64e84e89-9285-4665-ab35-b86cc3405c3c tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:20.017406 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64e84e89-9285-4665-ab35-b86cc3405c3c tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:20.018513 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64e84e89-9285-4665-ab35-b86cc3405c3c tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:20.020360 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64e84e89-9285-4665-ab35-b86cc3405c3c tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:20.021702 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64e84e89-9285-4665-ab35-b86cc3405c3c tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:20.024025 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64e84e89-9285-4665-ab35-b86cc3405c3c tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:20.026544 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64e84e89-9285-4665-ab35-b86cc3405c3c tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:20.173239 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bd7bc0ce-d732-40e2-8abd-200a716e5d08 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:20.188583 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bd7bc0ce-d732-40e2-8abd-200a716e5d08 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097" status: 200 len: 1523 microversion: 2.1 time: 0.333115 Oct 23 01:20:20.191278 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1345/2715] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:19 2022] GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097 => generated 1523 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:20.211982 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9392fa34-80c8-4dce-a09f-b729775bfd3f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:20.213323 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9392fa34-80c8-4dce-a09f-b729775bfd3f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 9a64ad71-9caf-4645-be7a-b56f8f584c2d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:20.230053 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9392fa34-80c8-4dce-a09f-b729775bfd3f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:20.232919 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9392fa34-80c8-4dce-a09f-b729775bfd3f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:20.242315 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9392fa34-80c8-4dce-a09f-b729775bfd3f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:20.242315 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9392fa34-80c8-4dce-a09f-b729775bfd3f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:20.242315 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9392fa34-80c8-4dce-a09f-b729775bfd3f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:20.242315 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9392fa34-80c8-4dce-a09f-b729775bfd3f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:20.269156 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-64e84e89-9285-4665-ab35-b86cc3405c3c tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:20.277273 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-64e84e89-9285-4665-ab35-b86cc3405c3c tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:20.281638 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-64e84e89-9285-4665-ab35-b86cc3405c3c tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:20.285642 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-64e84e89-9285-4665-ab35-b86cc3405c3c tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] 10.222.0.42 "GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334" status: 200 len: 1410 microversion: 2.75 time: 0.294151 Oct 23 01:20:20.298737 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1371/2716] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:20:19 2022] GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334 => generated 1410 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:20:20.312557 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-feaf93d0-64fb-42d2-9b8c-2198d357ce71 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:20.313184 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-feaf93d0-64fb-42d2-9b8c-2198d357ce71 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: ad3fdbf4-6dba-46a6-9132-e555185544b0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:20.318978 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=96,nova_api:UPDATE=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:20:20.320593 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-feaf93d0-64fb-42d2-9b8c-2198d357ce71 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:20.321260 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-feaf93d0-64fb-42d2-9b8c-2198d357ce71 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:20.321863 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-feaf93d0-64fb-42d2-9b8c-2198d357ce71 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:20.322801 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-feaf93d0-64fb-42d2-9b8c-2198d357ce71 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:20.323472 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-feaf93d0-64fb-42d2-9b8c-2198d357ce71 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:20.323608 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-feaf93d0-64fb-42d2-9b8c-2198d357ce71 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:20.390964 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9392fa34-80c8-4dce-a09f-b729775bfd3f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:20.400024 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9392fa34-80c8-4dce-a09f-b729775bfd3f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/9a64ad71-9caf-4645-be7a-b56f8f584c2d" status: 200 len: 1266 microversion: 2.1 time: 0.207275 Oct 23 01:20:20.404314 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1346/2717] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:20 2022] GET /compute/v2.1/servers/9a64ad71-9caf-4645-be7a-b56f8f584c2d => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:20.564545 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-feaf93d0-64fb-42d2-9b8c-2198d357ce71 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:20.573077 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-feaf93d0-64fb-42d2-9b8c-2198d357ce71 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0" status: 200 len: 1314 microversion: 2.1 time: 0.273114 Oct 23 01:20:20.574403 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1372/2718] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:20 2022] GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0 => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:20.862166 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-20ca9cc9-ec49-49a0-9eeb-061bebc033fc tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:20.864706 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-20ca9cc9-ec49-49a0-9eeb-061bebc033fc tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:20.874524 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20ca9cc9-ec49-49a0-9eeb-061bebc033fc tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:20.878370 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20ca9cc9-ec49-49a0-9eeb-061bebc033fc tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:20.878887 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20ca9cc9-ec49-49a0-9eeb-061bebc033fc tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:20.879691 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20ca9cc9-ec49-49a0-9eeb-061bebc033fc tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:20.881469 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20ca9cc9-ec49-49a0-9eeb-061bebc033fc tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:20.881935 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20ca9cc9-ec49-49a0-9eeb-061bebc033fc tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:20.887624 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-64ec7514-af31-45d7-b688-9fe0af982b24 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:20.889085 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-64ec7514-af31-45d7-b688-9fe0af982b24 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] [instance: 9ed76d3e-f334-4835-91f8-8bcbc1076b60] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:20.911731 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64ec7514-af31-45d7-b688-9fe0af982b24 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:20.914933 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64ec7514-af31-45d7-b688-9fe0af982b24 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:20.916674 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64ec7514-af31-45d7-b688-9fe0af982b24 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:20.917669 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64ec7514-af31-45d7-b688-9fe0af982b24 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:20.921800 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64ec7514-af31-45d7-b688-9fe0af982b24 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:20.927840 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64ec7514-af31-45d7-b688-9fe0af982b24 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:21.256543 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-20ca9cc9-ec49-49a0-9eeb-061bebc033fc tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:21.273185 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-20ca9cc9-ec49-49a0-9eeb-061bebc033fc tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1511 microversion: 2.1 time: 0.416232 Oct 23 01:20:21.276058 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1347/2719] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:20 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1511 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:21.286902 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-143ec38e-7874-4471-84c2-f275281bc4f3 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:21.287823 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-143ec38e-7874-4471-84c2-f275281bc4f3 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:21.297199 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-143ec38e-7874-4471-84c2-f275281bc4f3 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:21.301108 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-143ec38e-7874-4471-84c2-f275281bc4f3 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:21.301861 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-143ec38e-7874-4471-84c2-f275281bc4f3 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:21.303095 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-143ec38e-7874-4471-84c2-f275281bc4f3 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:21.304406 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-143ec38e-7874-4471-84c2-f275281bc4f3 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:21.306060 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-143ec38e-7874-4471-84c2-f275281bc4f3 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:21.372489 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-64ec7514-af31-45d7-b688-9fe0af982b24 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eb8880d07649b08bfe76a68901d81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55fb3f415da42eeb5d5514410670b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:21.387973 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-64ec7514-af31-45d7-b688-9fe0af982b24 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed76d3e-f334-4835-91f8-8bcbc1076b60" status: 200 len: 1512 microversion: 2.1 time: 0.511915 Oct 23 01:20:21.388596 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1373/2720] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:20 2022] GET /compute/v2.1/servers/9ed76d3e-f334-4835-91f8-8bcbc1076b60 => generated 1512 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:20:21.395424 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5f4a44a8-571e-4c3d-96f5-f0599323c6be tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:21.403716 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5f4a44a8-571e-4c3d-96f5-f0599323c6be tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 6ccfe45d-f080-4066-9aad-a39c3c4cd097] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:21.432787 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5f4a44a8-571e-4c3d-96f5-f0599323c6be tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:21.449416 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5f4a44a8-571e-4c3d-96f5-f0599323c6be tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:21.450009 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5f4a44a8-571e-4c3d-96f5-f0599323c6be tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:21.450784 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5f4a44a8-571e-4c3d-96f5-f0599323c6be tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:21.451262 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5f4a44a8-571e-4c3d-96f5-f0599323c6be tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:21.452220 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5f4a44a8-571e-4c3d-96f5-f0599323c6be tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:21.492734 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-143ec38e-7874-4471-84c2-f275281bc4f3 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:21.512989 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-143ec38e-7874-4471-84c2-f275281bc4f3 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:21.516884 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-143ec38e-7874-4471-84c2-f275281bc4f3 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:21.522474 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-143ec38e-7874-4471-84c2-f275281bc4f3 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b" status: 200 len: 1265 microversion: 2.25 time: 0.244144 Oct 23 01:20:21.526716 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1348/2721] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:20:21 2022] GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b => generated 1265 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:20:21.540887 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fda1b7db-1cb8-4509-b88a-8cf887d56c6b tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:21.541636 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fda1b7db-1cb8-4509-b88a-8cf887d56c6b tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:21.548654 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fda1b7db-1cb8-4509-b88a-8cf887d56c6b tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:21.549535 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fda1b7db-1cb8-4509-b88a-8cf887d56c6b tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:21.549735 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fda1b7db-1cb8-4509-b88a-8cf887d56c6b tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:21.551952 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fda1b7db-1cb8-4509-b88a-8cf887d56c6b tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:21.551952 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fda1b7db-1cb8-4509-b88a-8cf887d56c6b tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:21.555076 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fda1b7db-1cb8-4509-b88a-8cf887d56c6b tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:21.565286 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=100 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:20:21.899774 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fda1b7db-1cb8-4509-b88a-8cf887d56c6b tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:21.914831 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fda1b7db-1cb8-4509-b88a-8cf887d56c6b tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:21.924126 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fda1b7db-1cb8-4509-b88a-8cf887d56c6b tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:21.934861 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fda1b7db-1cb8-4509-b88a-8cf887d56c6b tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] 10.222.0.42 "GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334" status: 200 len: 1418 microversion: 2.75 time: 0.406754 Oct 23 01:20:21.936442 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1349/2722] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:20:21 2022] GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334 => generated 1418 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:20:21.954659 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5f4a44a8-571e-4c3d-96f5-f0599323c6be tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:21.974764 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5f4a44a8-571e-4c3d-96f5-f0599323c6be tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097" status: 200 len: 1523 microversion: 2.1 time: 0.582014 Oct 23 01:20:21.990220 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-65415236-a934-4fce-98b5-bf4c19062954 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:21.990608 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1374/2723] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:21 2022] GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097 => generated 1523 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:21.990703 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-65415236-a934-4fce-98b5-bf4c19062954 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 9a64ad71-9caf-4645-be7a-b56f8f584c2d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:21.999821 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-94967c7d-8522-4f30-b5f8-1ddc554508f2 req-a096159d-da19-47e9-b7e4-771d168578da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ccfe45d-f080-4066-9aad-a39c3c4cd097", "name": "network-vif-plugged", "status": "completed", "tag": "fce18087-d670-4b69-9cc5-11b42a9fa6de"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:20:22.000506 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-65415236-a934-4fce-98b5-bf4c19062954 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:22.001047 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-65415236-a934-4fce-98b5-bf4c19062954 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:22.002577 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-65415236-a934-4fce-98b5-bf4c19062954 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:22.004536 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-65415236-a934-4fce-98b5-bf4c19062954 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:22.005026 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-65415236-a934-4fce-98b5-bf4c19062954 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:22.005458 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-65415236-a934-4fce-98b5-bf4c19062954 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:22.023458 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-94967c7d-8522-4f30-b5f8-1ddc554508f2 req-a096159d-da19-47e9-b7e4-771d168578da service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:22.024798 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-94967c7d-8522-4f30-b5f8-1ddc554508f2 req-a096159d-da19-47e9-b7e4-771d168578da service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:22.028546 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-94967c7d-8522-4f30-b5f8-1ddc554508f2 req-a096159d-da19-47e9-b7e4-771d168578da service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:22.057143 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-94967c7d-8522-4f30-b5f8-1ddc554508f2 req-a096159d-da19-47e9-b7e4-771d168578da service nova] Creating event network-vif-plugged:fce18087-d670-4b69-9cc5-11b42a9fa6de for instance 6ccfe45d-f080-4066-9aad-a39c3c4cd097 on n-h1-master-1 Oct 23 01:20:22.066882 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-94967c7d-8522-4f30-b5f8-1ddc554508f2 req-a096159d-da19-47e9-b7e4-771d168578da service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087458 Oct 23 01:20:22.067803 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1375/2724] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:20:22.074688 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-18c8c9c1-4f7c-493a-b1f5-3b59584aec55 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:22.076583 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-18c8c9c1-4f7c-493a-b1f5-3b59584aec55 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: ad3fdbf4-6dba-46a6-9132-e555185544b0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:22.085106 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-18c8c9c1-4f7c-493a-b1f5-3b59584aec55 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:22.086236 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-18c8c9c1-4f7c-493a-b1f5-3b59584aec55 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:22.086861 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-18c8c9c1-4f7c-493a-b1f5-3b59584aec55 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:22.087765 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-18c8c9c1-4f7c-493a-b1f5-3b59584aec55 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:22.088563 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-18c8c9c1-4f7c-493a-b1f5-3b59584aec55 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:22.089333 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-18c8c9c1-4f7c-493a-b1f5-3b59584aec55 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:22.424029 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-65415236-a934-4fce-98b5-bf4c19062954 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:22.439297 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-65415236-a934-4fce-98b5-bf4c19062954 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/9a64ad71-9caf-4645-be7a-b56f8f584c2d" status: 200 len: 1308 microversion: 2.1 time: 0.501371 Oct 23 01:20:22.453091 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1350/2725] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:21 2022] GET /compute/v2.1/servers/9a64ad71-9caf-4645-be7a-b56f8f584c2d => generated 1308 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:22.462240 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2222d93d-4685-4097-9691-d650ca6c7a14 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:22.468914 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2222d93d-4685-4097-9691-d650ca6c7a14 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:22.487529 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2222d93d-4685-4097-9691-d650ca6c7a14 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:22.488189 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2222d93d-4685-4097-9691-d650ca6c7a14 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:22.488849 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2222d93d-4685-4097-9691-d650ca6c7a14 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:22.489853 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2222d93d-4685-4097-9691-d650ca6c7a14 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:22.490419 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2222d93d-4685-4097-9691-d650ca6c7a14 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:22.490912 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2222d93d-4685-4097-9691-d650ca6c7a14 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:22.533478 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-18c8c9c1-4f7c-493a-b1f5-3b59584aec55 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:22.550684 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-18c8c9c1-4f7c-493a-b1f5-3b59584aec55 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0" status: 200 len: 1501 microversion: 2.1 time: 0.481361 Oct 23 01:20:22.573849 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1376/2726] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:22 2022] GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0 => generated 1501 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:22.573849 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5f19dfa2-4e2e-475d-b0f6-435cb5f43841 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:22.573849 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5f19dfa2-4e2e-475d-b0f6-435cb5f43841 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] [instance: 9ed76d3e-f334-4835-91f8-8bcbc1076b60] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:22.585966 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5f19dfa2-4e2e-475d-b0f6-435cb5f43841 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:22.587603 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5f19dfa2-4e2e-475d-b0f6-435cb5f43841 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:22.588379 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5f19dfa2-4e2e-475d-b0f6-435cb5f43841 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:22.589364 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5f19dfa2-4e2e-475d-b0f6-435cb5f43841 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:22.589774 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5f19dfa2-4e2e-475d-b0f6-435cb5f43841 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:22.590419 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5f19dfa2-4e2e-475d-b0f6-435cb5f43841 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:22.868032 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2222d93d-4685-4097-9691-d650ca6c7a14 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:22.881929 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2222d93d-4685-4097-9691-d650ca6c7a14 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1511 microversion: 2.1 time: 0.427574 Oct 23 01:20:22.888198 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1351/2727] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:22 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1511 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:22.893775 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-101666d2-9d8a-4e83-915d-e17e0e9d5513 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:22.894420 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-101666d2-9d8a-4e83-915d-e17e0e9d5513 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:22.914403 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:20:22.915533 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-101666d2-9d8a-4e83-915d-e17e0e9d5513 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:22.916026 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-101666d2-9d8a-4e83-915d-e17e0e9d5513 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:22.916455 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-101666d2-9d8a-4e83-915d-e17e0e9d5513 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:22.917216 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-101666d2-9d8a-4e83-915d-e17e0e9d5513 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:22.917611 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-101666d2-9d8a-4e83-915d-e17e0e9d5513 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:22.918173 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-101666d2-9d8a-4e83-915d-e17e0e9d5513 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:22.938799 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5f19dfa2-4e2e-475d-b0f6-435cb5f43841 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eb8880d07649b08bfe76a68901d81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55fb3f415da42eeb5d5514410670b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:22.947389 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5f19dfa2-4e2e-475d-b0f6-435cb5f43841 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed76d3e-f334-4835-91f8-8bcbc1076b60" status: 200 len: 1505 microversion: 2.1 time: 0.384607 Oct 23 01:20:22.967461 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1377/2728] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:22 2022] GET /compute/v2.1/servers/9ed76d3e-f334-4835-91f8-8bcbc1076b60 => generated 1505 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:22.979885 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fece9336-09e8-4913-870c-adb8fdbb468a tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:20:22.985116 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-fece9336-09e8-4913-870c-adb8fdbb468a tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: ad3fdbf4-6dba-46a6-9132-e555185544b0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:23.000003 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fece9336-09e8-4913-870c-adb8fdbb468a tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:23.000702 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fece9336-09e8-4913-870c-adb8fdbb468a tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:23.001251 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fece9336-09e8-4913-870c-adb8fdbb468a tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:23.002136 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fece9336-09e8-4913-870c-adb8fdbb468a tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:23.005715 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fece9336-09e8-4913-870c-adb8fdbb468a tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:23.006966 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fece9336-09e8-4913-870c-adb8fdbb468a tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:23.033492 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-101666d2-9d8a-4e83-915d-e17e0e9d5513 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:23.047186 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-101666d2-9d8a-4e83-915d-e17e0e9d5513 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:23.053893 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-101666d2-9d8a-4e83-915d-e17e0e9d5513 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:23.054499 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-101666d2-9d8a-4e83-915d-e17e0e9d5513 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b" status: 200 len: 1265 microversion: 2.25 time: 0.165104 Oct 23 01:20:23.055667 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1352/2729] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:20:22 2022] GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:20:23.075815 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dd78ce8d-6fe2-4e62-b9b6-87d4e6ca6490 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:23.076949 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-dd78ce8d-6fe2-4e62-b9b6-87d4e6ca6490 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:23.089297 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-fece9336-09e8-4913-870c-adb8fdbb468a tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lazy-loading 'flavor' on Instance uuid ad3fdbf4-6dba-46a6-9132-e555185544b0 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:20:23.094353 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd78ce8d-6fe2-4e62-b9b6-87d4e6ca6490 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:23.095702 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd78ce8d-6fe2-4e62-b9b6-87d4e6ca6490 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:23.095702 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd78ce8d-6fe2-4e62-b9b6-87d4e6ca6490 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:23.108703 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd78ce8d-6fe2-4e62-b9b6-87d4e6ca6490 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:23.112271 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd78ce8d-6fe2-4e62-b9b6-87d4e6ca6490 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:23.112271 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd78ce8d-6fe2-4e62-b9b6-87d4e6ca6490 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:23.235330 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-dd78ce8d-6fe2-4e62-b9b6-87d4e6ca6490 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:23.245330 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-dd78ce8d-6fe2-4e62-b9b6-87d4e6ca6490 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:23.247308 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-dd78ce8d-6fe2-4e62-b9b6-87d4e6ca6490 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:23.254651 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-dd78ce8d-6fe2-4e62-b9b6-87d4e6ca6490 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] 10.222.0.42 "GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334" status: 200 len: 1416 microversion: 2.75 time: 0.197659 Oct 23 01:20:23.255663 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1353/2730] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:20:23 2022] GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334 => generated 1416 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:20:23.260536 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b178845b-a6bc-428b-9101-3c2f00db0c03 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Calling method '.version_select at 0x7f5cc61190d0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:23.261555 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b178845b-a6bc-428b-9101-3c2f00db0c03 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] [instance: 9ed76d3e-f334-4835-91f8-8bcbc1076b60] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:23.269540 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b178845b-a6bc-428b-9101-3c2f00db0c03 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:23.270059 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b178845b-a6bc-428b-9101-3c2f00db0c03 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:23.270506 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b178845b-a6bc-428b-9101-3c2f00db0c03 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:23.271220 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b178845b-a6bc-428b-9101-3c2f00db0c03 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:23.271682 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b178845b-a6bc-428b-9101-3c2f00db0c03 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:23.272113 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b178845b-a6bc-428b-9101-3c2f00db0c03 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:23.338001 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b178845b-a6bc-428b-9101-3c2f00db0c03 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed76d3e-f334-4835-91f8-8bcbc1076b60/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.080664 Oct 23 01:20:23.339228 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1354/2731] 10.222.0.42 () {58 vars in 1296 bytes} [Sun Oct 23 01:20:23 2022] GET /compute/v2.1/servers/9ed76d3e-f334-4835-91f8-8bcbc1076b60/os-instance-actions => generated 611 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:20:23.345086 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-92df61ae-d1a6-492f-8189-17821893ca9d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:23.345589 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-92df61ae-d1a6-492f-8189-17821893ca9d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 6ccfe45d-f080-4066-9aad-a39c3c4cd097] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:23.353490 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92df61ae-d1a6-492f-8189-17821893ca9d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:23.354110 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92df61ae-d1a6-492f-8189-17821893ca9d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:23.354620 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92df61ae-d1a6-492f-8189-17821893ca9d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:23.355592 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92df61ae-d1a6-492f-8189-17821893ca9d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:23.356111 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92df61ae-d1a6-492f-8189-17821893ca9d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:23.356744 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92df61ae-d1a6-492f-8189-17821893ca9d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:23.474568 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fece9336-09e8-4913-870c-adb8fdbb468a tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "POST /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0/action" status: 200 len: 32 microversion: 2.1 time: 0.508192 Oct 23 01:20:23.475545 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1378/2732] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:20:22 2022] POST /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0/action => generated 32 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:20:23.497290 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d0ec258b-918c-43f3-9806-99417bd14ed0 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:23.498154 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d0ec258b-918c-43f3-9806-99417bd14ed0 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] [instance: 9ed76d3e-f334-4835-91f8-8bcbc1076b60] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:23.518096 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0ec258b-918c-43f3-9806-99417bd14ed0 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:23.519473 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-92df61ae-d1a6-492f-8189-17821893ca9d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:23.523730 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0ec258b-918c-43f3-9806-99417bd14ed0 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:23.524186 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0ec258b-918c-43f3-9806-99417bd14ed0 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:23.524922 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0ec258b-918c-43f3-9806-99417bd14ed0 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:23.525380 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0ec258b-918c-43f3-9806-99417bd14ed0 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:23.525805 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0ec258b-918c-43f3-9806-99417bd14ed0 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:23.530958 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-92df61ae-d1a6-492f-8189-17821893ca9d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097" status: 200 len: 1523 microversion: 2.1 time: 0.190532 Oct 23 01:20:23.535818 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1355/2733] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:23 2022] GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097 => generated 1523 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:23.542077 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f4bd0f27-1850-4ab3-b23f-5f2c654d3ae0 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:23.542776 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f4bd0f27-1850-4ab3-b23f-5f2c654d3ae0 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 9a64ad71-9caf-4645-be7a-b56f8f584c2d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:23.549450 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4bd0f27-1850-4ab3-b23f-5f2c654d3ae0 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:23.550672 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4bd0f27-1850-4ab3-b23f-5f2c654d3ae0 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:23.551333 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4bd0f27-1850-4ab3-b23f-5f2c654d3ae0 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:23.552256 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4bd0f27-1850-4ab3-b23f-5f2c654d3ae0 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:23.553165 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4bd0f27-1850-4ab3-b23f-5f2c654d3ae0 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:23.553873 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4bd0f27-1850-4ab3-b23f-5f2c654d3ae0 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:23.573055 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d0ec258b-918c-43f3-9806-99417bd14ed0 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] [instance: 9ed76d3e-f334-4835-91f8-8bcbc1076b60] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:20:23.747800 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f4bd0f27-1850-4ab3-b23f-5f2c654d3ae0 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:23.770112 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f4bd0f27-1850-4ab3-b23f-5f2c654d3ae0 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/9a64ad71-9caf-4645-be7a-b56f8f584c2d" status: 200 len: 1308 microversion: 2.1 time: 0.232128 Oct 23 01:20:23.773629 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1356/2734] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:23 2022] GET /compute/v2.1/servers/9a64ad71-9caf-4645-be7a-b56f8f584c2d => generated 1308 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:23.782537 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bb26d2a6-7f29-43f8-ae66-e4ee34fde296 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:23.783580 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bb26d2a6-7f29-43f8-ae66-e4ee34fde296 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: ad3fdbf4-6dba-46a6-9132-e555185544b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:23.799252 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bb26d2a6-7f29-43f8-ae66-e4ee34fde296 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:23.800304 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bb26d2a6-7f29-43f8-ae66-e4ee34fde296 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:23.800899 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bb26d2a6-7f29-43f8-ae66-e4ee34fde296 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:23.802362 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bb26d2a6-7f29-43f8-ae66-e4ee34fde296 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:23.803306 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bb26d2a6-7f29-43f8-ae66-e4ee34fde296 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:23.803950 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bb26d2a6-7f29-43f8-ae66-e4ee34fde296 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:23.933125 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d0ec258b-918c-43f3-9806-99417bd14ed0 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9ed76d3e-f334-4835-91f8-8bcbc1076b60" status: 204 len: 0 microversion: 2.1 time: 0.448492 Oct 23 01:20:23.934138 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1379/2735] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:20:23 2022] DELETE /compute/v2.1/servers/9ed76d3e-f334-4835-91f8-8bcbc1076b60 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:20:23.943627 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-453c8286-3ddd-4ca2-b8b3-43c3d50f8f91 req-5c4920fe-b104-4e29-9628-20778ca5069e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a64ad71-9caf-4645-be7a-b56f8f584c2d", "tag": "40a2cfab-1f0a-4ac9-815e-ce16a0befa54"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:20:23.970539 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-453c8286-3ddd-4ca2-b8b3-43c3d50f8f91 req-5c4920fe-b104-4e29-9628-20778ca5069e service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:23.971206 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-453c8286-3ddd-4ca2-b8b3-43c3d50f8f91 req-5c4920fe-b104-4e29-9628-20778ca5069e service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:23.971487 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-453c8286-3ddd-4ca2-b8b3-43c3d50f8f91 req-5c4920fe-b104-4e29-9628-20778ca5069e service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:24.001524 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-453c8286-3ddd-4ca2-b8b3-43c3d50f8f91 req-5c4920fe-b104-4e29-9628-20778ca5069e service nova] Creating event network-changed:40a2cfab-1f0a-4ac9-815e-ce16a0befa54 for instance 9a64ad71-9caf-4645-be7a-b56f8f584c2d on n-h2-master-1 Oct 23 01:20:24.011385 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-453c8286-3ddd-4ca2-b8b3-43c3d50f8f91 req-5c4920fe-b104-4e29-9628-20778ca5069e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075311 Oct 23 01:20:24.012006 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1380/2736] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:20:24.023843 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2220ef55-fac1-413c-9b5e-90281151287f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:24.028009 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2220ef55-fac1-413c-9b5e-90281151287f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:24.039667 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2220ef55-fac1-413c-9b5e-90281151287f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:24.041263 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2220ef55-fac1-413c-9b5e-90281151287f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:24.042712 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2220ef55-fac1-413c-9b5e-90281151287f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:24.045103 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2220ef55-fac1-413c-9b5e-90281151287f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:24.047446 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2220ef55-fac1-413c-9b5e-90281151287f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:24.048082 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2220ef55-fac1-413c-9b5e-90281151287f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:24.049916 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bb26d2a6-7f29-43f8-ae66-e4ee34fde296 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:24.061383 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bb26d2a6-7f29-43f8-ae66-e4ee34fde296 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0" status: 200 len: 1507 microversion: 2.1 time: 0.286368 Oct 23 01:20:24.062568 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1357/2737] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:23 2022] GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0 => generated 1507 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:24.067616 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-444ffdc4-15b6-49ce-8f40-41406393d213 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:24.068348 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-444ffdc4-15b6-49ce-8f40-41406393d213 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] [instance: 9ed76d3e-f334-4835-91f8-8bcbc1076b60] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:24.074688 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-444ffdc4-15b6-49ce-8f40-41406393d213 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:24.075427 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-444ffdc4-15b6-49ce-8f40-41406393d213 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:24.076068 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-444ffdc4-15b6-49ce-8f40-41406393d213 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:24.077643 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-444ffdc4-15b6-49ce-8f40-41406393d213 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:24.078392 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-444ffdc4-15b6-49ce-8f40-41406393d213 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:24.079106 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-444ffdc4-15b6-49ce-8f40-41406393d213 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:24.324051 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-444ffdc4-15b6-49ce-8f40-41406393d213 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eb8880d07649b08bfe76a68901d81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55fb3f415da42eeb5d5514410670b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:24.330168 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2220ef55-fac1-413c-9b5e-90281151287f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:24.341100 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-444ffdc4-15b6-49ce-8f40-41406393d213 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed76d3e-f334-4835-91f8-8bcbc1076b60" status: 200 len: 1511 microversion: 2.1 time: 0.277073 Oct 23 01:20:24.342057 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1358/2738] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:24 2022] GET /compute/v2.1/servers/9ed76d3e-f334-4835-91f8-8bcbc1076b60 => generated 1511 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:24.342513 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2220ef55-fac1-413c-9b5e-90281151287f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1511 microversion: 2.1 time: 0.325810 Oct 23 01:20:24.343671 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1381/2739] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:24 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1511 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:24.347393 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1acd71cc-bf78-44ea-8a54-67ebf5be2c00 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:24.348010 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1acd71cc-bf78-44ea-8a54-67ebf5be2c00 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:24.357165 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1acd71cc-bf78-44ea-8a54-67ebf5be2c00 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:24.358501 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1acd71cc-bf78-44ea-8a54-67ebf5be2c00 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:24.359109 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1acd71cc-bf78-44ea-8a54-67ebf5be2c00 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:24.359965 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1acd71cc-bf78-44ea-8a54-67ebf5be2c00 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:24.360432 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1acd71cc-bf78-44ea-8a54-67ebf5be2c00 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:24.360940 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1acd71cc-bf78-44ea-8a54-67ebf5be2c00 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:24.365436 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b1af763c-eee8-4e25-80fd-a6179d8e7f08 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:24.366341 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b1af763c-eee8-4e25-80fd-a6179d8e7f08 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:24.397283 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1acd71cc-bf78-44ea-8a54-67ebf5be2c00 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:24.398287 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1acd71cc-bf78-44ea-8a54-67ebf5be2c00 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:24.398851 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1acd71cc-bf78-44ea-8a54-67ebf5be2c00 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:24.399584 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-1acd71cc-bf78-44ea-8a54-67ebf5be2c00 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lazy-loading 'fault' on Instance uuid 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:20:24.414287 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1af763c-eee8-4e25-80fd-a6179d8e7f08 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:24.416776 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1af763c-eee8-4e25-80fd-a6179d8e7f08 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:24.419516 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1af763c-eee8-4e25-80fd-a6179d8e7f08 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:24.419516 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1af763c-eee8-4e25-80fd-a6179d8e7f08 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:24.419516 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1af763c-eee8-4e25-80fd-a6179d8e7f08 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:24.420335 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1af763c-eee8-4e25-80fd-a6179d8e7f08 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:24.487197 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1acd71cc-bf78-44ea-8a54-67ebf5be2c00 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:24.497219 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1acd71cc-bf78-44ea-8a54-67ebf5be2c00 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:24.500223 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1acd71cc-bf78-44ea-8a54-67ebf5be2c00 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:24.502583 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1acd71cc-bf78-44ea-8a54-67ebf5be2c00 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b" status: 200 len: 1270 microversion: 2.25 time: 0.159506 Oct 23 01:20:24.503327 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1359/2740] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:20:24 2022] GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b => generated 1270 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:20:24.566176 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b342bc7d-75b1-4b68-bc63-c491e3d7029a tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:24.566802 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b342bc7d-75b1-4b68-bc63-c491e3d7029a tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 6ccfe45d-f080-4066-9aad-a39c3c4cd097] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:24.581145 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b342bc7d-75b1-4b68-bc63-c491e3d7029a tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:24.581605 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b342bc7d-75b1-4b68-bc63-c491e3d7029a tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:24.583470 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b342bc7d-75b1-4b68-bc63-c491e3d7029a tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:24.583470 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b342bc7d-75b1-4b68-bc63-c491e3d7029a tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:24.584039 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b342bc7d-75b1-4b68-bc63-c491e3d7029a tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:24.585280 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b342bc7d-75b1-4b68-bc63-c491e3d7029a tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:24.596146 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b1af763c-eee8-4e25-80fd-a6179d8e7f08 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:24.610201 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b1af763c-eee8-4e25-80fd-a6179d8e7f08 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:24.612087 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b1af763c-eee8-4e25-80fd-a6179d8e7f08 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:24.618673 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b1af763c-eee8-4e25-80fd-a6179d8e7f08 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] 10.222.0.42 "GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334" status: 200 len: 1416 microversion: 2.75 time: 0.273689 Oct 23 01:20:24.626117 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1382/2741] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:20:24 2022] GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334 => generated 1416 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:20:24.763374 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b342bc7d-75b1-4b68-bc63-c491e3d7029a tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:24.772466 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b342bc7d-75b1-4b68-bc63-c491e3d7029a tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097" status: 200 len: 1508 microversion: 2.1 time: 0.210117 Oct 23 01:20:24.773221 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1360/2742] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:24 2022] GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097 => generated 1508 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:24.795536 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-14390882-5e23-4cb6-8c4d-1d1dd6da3584 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:24.796152 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-14390882-5e23-4cb6-8c4d-1d1dd6da3584 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 6ccfe45d-f080-4066-9aad-a39c3c4cd097] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:24.800459 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6671dfee-df54-45a4-80cc-ee1c8a3822a5 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:24.801416 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6671dfee-df54-45a4-80cc-ee1c8a3822a5 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 9a64ad71-9caf-4645-be7a-b56f8f584c2d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:24.803471 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-14390882-5e23-4cb6-8c4d-1d1dd6da3584 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:24.804022 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-14390882-5e23-4cb6-8c4d-1d1dd6da3584 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:24.804456 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-14390882-5e23-4cb6-8c4d-1d1dd6da3584 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:24.805166 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-14390882-5e23-4cb6-8c4d-1d1dd6da3584 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:24.805623 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-14390882-5e23-4cb6-8c4d-1d1dd6da3584 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:24.806071 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-14390882-5e23-4cb6-8c4d-1d1dd6da3584 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:24.812474 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6671dfee-df54-45a4-80cc-ee1c8a3822a5 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:24.813701 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6671dfee-df54-45a4-80cc-ee1c8a3822a5 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:24.814814 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6671dfee-df54-45a4-80cc-ee1c8a3822a5 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:24.828270 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6671dfee-df54-45a4-80cc-ee1c8a3822a5 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:24.830658 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6671dfee-df54-45a4-80cc-ee1c8a3822a5 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:24.832453 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6671dfee-df54-45a4-80cc-ee1c8a3822a5 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:25.018835 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-14390882-5e23-4cb6-8c4d-1d1dd6da3584 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:25.026821 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-14390882-5e23-4cb6-8c4d-1d1dd6da3584 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097" status: 200 len: 1508 microversion: 2.1 time: 0.235160 Oct 23 01:20:25.027418 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1383/2743] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:24 2022] GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097 => generated 1508 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:25.049829 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2c44caf3-3a17-425f-ad28-17081041948a tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:25.050917 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2c44caf3-3a17-425f-ad28-17081041948a tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 6ccfe45d-f080-4066-9aad-a39c3c4cd097] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:25.058317 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2c44caf3-3a17-425f-ad28-17081041948a tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:25.059114 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2c44caf3-3a17-425f-ad28-17081041948a tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:25.059697 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2c44caf3-3a17-425f-ad28-17081041948a tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:25.062137 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2c44caf3-3a17-425f-ad28-17081041948a tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:25.062935 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2c44caf3-3a17-425f-ad28-17081041948a tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:25.063548 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2c44caf3-3a17-425f-ad28-17081041948a tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:25.071832 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6671dfee-df54-45a4-80cc-ee1c8a3822a5 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:25.083044 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6671dfee-df54-45a4-80cc-ee1c8a3822a5 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/9a64ad71-9caf-4645-be7a-b56f8f584c2d" status: 200 len: 1308 microversion: 2.1 time: 0.287334 Oct 23 01:20:25.083289 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1361/2744] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:24 2022] GET /compute/v2.1/servers/9a64ad71-9caf-4645-be7a-b56f8f584c2d => generated 1308 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:25.092121 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:20:25.097440 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2c44caf3-3a17-425f-ad28-17081041948a tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 6ccfe45d-f080-4066-9aad-a39c3c4cd097] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:20:25.104061 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-396cac29-fe21-4941-aa96-6d81fe6b834d tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:25.104688 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-396cac29-fe21-4941-aa96-6d81fe6b834d tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: ad3fdbf4-6dba-46a6-9132-e555185544b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:25.113851 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-396cac29-fe21-4941-aa96-6d81fe6b834d tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:25.114395 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-396cac29-fe21-4941-aa96-6d81fe6b834d tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:25.114838 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-396cac29-fe21-4941-aa96-6d81fe6b834d tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:25.115542 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-396cac29-fe21-4941-aa96-6d81fe6b834d tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:25.116001 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-396cac29-fe21-4941-aa96-6d81fe6b834d tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:25.116428 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-396cac29-fe21-4941-aa96-6d81fe6b834d tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:25.301676 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-396cac29-fe21-4941-aa96-6d81fe6b834d tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:25.338274 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-396cac29-fe21-4941-aa96-6d81fe6b834d tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0" status: 200 len: 1507 microversion: 2.1 time: 0.230036 Oct 23 01:20:25.340066 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1362/2745] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:25 2022] GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0 => generated 1507 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:25.367640 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3fc3d39f-85f1-4d91-8e67-f34b1c11a64c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:25.368776 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3fc3d39f-85f1-4d91-8e67-f34b1c11a64c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:25.379530 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3fc3d39f-85f1-4d91-8e67-f34b1c11a64c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:25.380522 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3fc3d39f-85f1-4d91-8e67-f34b1c11a64c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:25.381223 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3fc3d39f-85f1-4d91-8e67-f34b1c11a64c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:25.382230 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3fc3d39f-85f1-4d91-8e67-f34b1c11a64c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:25.382965 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3fc3d39f-85f1-4d91-8e67-f34b1c11a64c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:25.383469 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3fc3d39f-85f1-4d91-8e67-f34b1c11a64c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:25.435684 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2c44caf3-3a17-425f-ad28-17081041948a tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097" status: 204 len: 0 microversion: 2.1 time: 0.389943 Oct 23 01:20:25.441845 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1384/2746] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:20:25 2022] DELETE /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:20:25.460717 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a1a9c835-b334-4dfe-992f-27d9bd03862b tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:25.463138 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a1a9c835-b334-4dfe-992f-27d9bd03862b tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] [instance: 9ed76d3e-f334-4835-91f8-8bcbc1076b60] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:25.479547 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a1a9c835-b334-4dfe-992f-27d9bd03862b tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:25.480276 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a1a9c835-b334-4dfe-992f-27d9bd03862b tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:25.480867 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a1a9c835-b334-4dfe-992f-27d9bd03862b tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:25.492334 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a1a9c835-b334-4dfe-992f-27d9bd03862b tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:25.493009 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a1a9c835-b334-4dfe-992f-27d9bd03862b tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:25.493601 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a1a9c835-b334-4dfe-992f-27d9bd03862b tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:25.869686 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3fc3d39f-85f1-4d91-8e67-f34b1c11a64c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:25.877808 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a1a9c835-b334-4dfe-992f-27d9bd03862b tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eb8880d07649b08bfe76a68901d81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55fb3f415da42eeb5d5514410670b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:25.881426 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3fc3d39f-85f1-4d91-8e67-f34b1c11a64c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1511 microversion: 2.1 time: 0.518440 Oct 23 01:20:25.882592 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1363/2747] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:25 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1511 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:20:25.887084 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a1a9c835-b334-4dfe-992f-27d9bd03862b tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed76d3e-f334-4835-91f8-8bcbc1076b60" status: 200 len: 1511 microversion: 2.1 time: 0.431926 Oct 23 01:20:25.891709 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1385/2748] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:25 2022] GET /compute/v2.1/servers/9ed76d3e-f334-4835-91f8-8bcbc1076b60 => generated 1511 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:25.893872 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2af9a00a-1128-4001-bb6b-1cfd307a1ecf tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:25.894795 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2af9a00a-1128-4001-bb6b-1cfd307a1ecf tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:25.901068 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b1fd94f3-904b-4faa-8057-a0a6d4fe0990 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:25.901620 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2af9a00a-1128-4001-bb6b-1cfd307a1ecf tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:25.902169 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2af9a00a-1128-4001-bb6b-1cfd307a1ecf tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:25.902611 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2af9a00a-1128-4001-bb6b-1cfd307a1ecf tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:25.903313 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2af9a00a-1128-4001-bb6b-1cfd307a1ecf tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:25.903768 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2af9a00a-1128-4001-bb6b-1cfd307a1ecf tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:25.904195 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2af9a00a-1128-4001-bb6b-1cfd307a1ecf tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:25.916623 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b1fd94f3-904b-4faa-8057-a0a6d4fe0990 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:25.929113 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b1fd94f3-904b-4faa-8057-a0a6d4fe0990 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:25.930093 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b1fd94f3-904b-4faa-8057-a0a6d4fe0990 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:25.930725 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b1fd94f3-904b-4faa-8057-a0a6d4fe0990 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:25.932044 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b1fd94f3-904b-4faa-8057-a0a6d4fe0990 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:25.932675 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b1fd94f3-904b-4faa-8057-a0a6d4fe0990 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:25.933106 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b1fd94f3-904b-4faa-8057-a0a6d4fe0990 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:25.950702 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-b1fd94f3-904b-4faa-8057-a0a6d4fe0990 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] HTTP exception thrown: Instance 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b could not be found. Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b1fd94f3-904b-4faa-8057-a0a6d4fe0990 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Request method failure captured: Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b HTTP/1.1 Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJUfZCVXVkMS1oxq1YAiE8_rcVg9oiXHyz9jC68xBKkc_VTdXJeIi8SdyLyQDYRQBp4J5Pi7IKi-R-0TD7QfQlpZrg_PRVLwx1QzS_6nVtJj_1ZFFD2bz6tI5deH-6tSYBEMGiA_jmhO0uYEt6lNZX95QYuq4AbV3UNOqz3PgCuU88s Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: X-Openstack-Nova-Api-Version: 2.25 Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: ccc52d9ecfdf43f58b665d06e1008b52 Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1034616310 Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ccc52d9ecfdf43f58b665d06e1008b52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ccc52d9ecfdf43f58b665d06e1008b52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ccc52d9ecfdf43f58b665d06e1008b52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ccc52d9ecfdf43f58b665d06e1008b52"}]}] Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1034616310 Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: ccc52d9ecfdf43f58b665d06e1008b52 Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1034616310 Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-LiveAutoBlockMigrationV225Test-1034616310-project Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 8a246c84d8f444d59c9d5becae78f75a Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1034616310-project Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b could not be found. Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b'} Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b could not be found. Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b could not be found. Oct 23 01:20:25.953631 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:20:25.958138 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:20:25.958138 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:20:25.958138 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:20:25.958138 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:20:25.958138 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:20:25.958138 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:20:25.958138 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:20:25.958138 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b could not be found. Oct 23 01:20:25.958138 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:20:25.958138 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b1fd94f3-904b-4faa-8057-a0a6d4fe0990 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Returning 404 to user: Instance 3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:20:25.958138 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b1fd94f3-904b-4faa-8057-a0a6d4fe0990 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b" status: 404 len: 111 microversion: 2.25 time: 0.071526 Oct 23 01:20:25.958138 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1364/2749] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:20:25 2022] GET /compute/v2.1/servers/3bc937ba-7bd0-4b60-bb6a-fbefcfc8120b => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:20:25.962801 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3f2bca7c-5bb7-4b34-88bb-45c2d74f4238 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1823376609", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "37cf4372-0b8e-493b-a1d7-4174c029ddaa"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:20:26.019461 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2af9a00a-1128-4001-bb6b-1cfd307a1ecf tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:26.051263 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2af9a00a-1128-4001-bb6b-1cfd307a1ecf tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:26.055645 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2af9a00a-1128-4001-bb6b-1cfd307a1ecf tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:26.074072 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2af9a00a-1128-4001-bb6b-1cfd307a1ecf tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] 10.222.0.42 "GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334" status: 200 len: 1437 microversion: 2.75 time: 0.184843 Oct 23 01:20:26.096358 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1386/2750] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:20:25 2022] GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334 => generated 1437 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:20:26.119553 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-67bad31b-157e-4b50-bf75-8dd9b7b68a72 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:26.120192 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-67bad31b-157e-4b50-bf75-8dd9b7b68a72 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 9a64ad71-9caf-4645-be7a-b56f8f584c2d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:26.149892 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-67bad31b-157e-4b50-bf75-8dd9b7b68a72 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:26.160301 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-67bad31b-157e-4b50-bf75-8dd9b7b68a72 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:26.167829 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-67bad31b-157e-4b50-bf75-8dd9b7b68a72 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:26.172717 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-67bad31b-157e-4b50-bf75-8dd9b7b68a72 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:26.173212 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-67bad31b-157e-4b50-bf75-8dd9b7b68a72 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:26.173651 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-67bad31b-157e-4b50-bf75-8dd9b7b68a72 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:26.228273 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=16 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:20:26.285470 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=13 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:20:26.298715 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-3f2bca7c-5bb7-4b34-88bb-45c2d74f4238 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] validate_networks() for [('37cf4372-0b8e-493b-a1d7-4174c029ddaa', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:20:27.506286 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-67bad31b-157e-4b50-bf75-8dd9b7b68a72 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:27.519638 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-67bad31b-157e-4b50-bf75-8dd9b7b68a72 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/9a64ad71-9caf-4645-be7a-b56f8f584c2d" status: 200 len: 1308 microversion: 2.1 time: 1.412311 Oct 23 01:20:27.531373 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1387/2751] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:26 2022] GET /compute/v2.1/servers/9a64ad71-9caf-4645-be7a-b56f8f584c2d => generated 1308 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:27.547523 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-16b604c0-1500-4e9f-82cd-745bab43bea7 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:20:27.551479 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-16b604c0-1500-4e9f-82cd-745bab43bea7 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:27.567219 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-16b604c0-1500-4e9f-82cd-745bab43bea7 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:27.568060 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-16b604c0-1500-4e9f-82cd-745bab43bea7 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:27.568678 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-16b604c0-1500-4e9f-82cd-745bab43bea7 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:27.572355 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-16b604c0-1500-4e9f-82cd-745bab43bea7 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:27.572355 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-16b604c0-1500-4e9f-82cd-745bab43bea7 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:27.572355 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-16b604c0-1500-4e9f-82cd-745bab43bea7 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:27.710898 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-16b604c0-1500-4e9f-82cd-745bab43bea7 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:20:27.712319 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-16b604c0-1500-4e9f-82cd-745bab43bea7 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:20:27.713708 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-16b604c0-1500-4e9f-82cd-745bab43bea7 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:20:27.715022 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-16b604c0-1500-4e9f-82cd-745bab43bea7 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:20:27.715681 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-16b604c0-1500-4e9f-82cd-745bab43bea7 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:20:27.784255 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=46 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:20:28.007131 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-16b604c0-1500-4e9f-82cd-745bab43bea7 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:28.016261 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-16b604c0-1500-4e9f-82cd-745bab43bea7 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:28.016771 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-16b604c0-1500-4e9f-82cd-745bab43bea7 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:28.017220 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-16b604c0-1500-4e9f-82cd-745bab43bea7 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:28.017952 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-16b604c0-1500-4e9f-82cd-745bab43bea7 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:28.018450 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-16b604c0-1500-4e9f-82cd-745bab43bea7 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:28.018870 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-16b604c0-1500-4e9f-82cd-745bab43bea7 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:28.294580 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-16b604c0-1500-4e9f-82cd-745bab43bea7 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:28.310886 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-16b604c0-1500-4e9f-82cd-745bab43bea7 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:28.312573 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-16b604c0-1500-4e9f-82cd-745bab43bea7 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:28.329057 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-16b604c0-1500-4e9f-82cd-745bab43bea7 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] 10.222.0.42 "POST /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334/action" status: 202 len: 1494 microversion: 2.75 time: 0.796123 Oct 23 01:20:28.333008 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1388/2752] 10.222.0.42 () {62 vars in 1319 bytes} [Sun Oct 23 01:20:27 2022] POST /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334/action => generated 1494 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 23 01:20:28.344793 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5a44cf6d-04b7-491f-b698-b9cade326796 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:28.345846 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5a44cf6d-04b7-491f-b698-b9cade326796 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: ad3fdbf4-6dba-46a6-9132-e555185544b0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:28.363557 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5a44cf6d-04b7-491f-b698-b9cade326796 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:28.367264 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5a44cf6d-04b7-491f-b698-b9cade326796 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:28.368332 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5a44cf6d-04b7-491f-b698-b9cade326796 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:28.369775 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5a44cf6d-04b7-491f-b698-b9cade326796 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:28.370565 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5a44cf6d-04b7-491f-b698-b9cade326796 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:28.372454 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5a44cf6d-04b7-491f-b698-b9cade326796 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:28.672550 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-3f2bca7c-5bb7-4b34-88bb-45c2d74f4238 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:20:28.672999 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-3f2bca7c-5bb7-4b34-88bb-45c2d74f4238 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:20:28.673451 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-3f2bca7c-5bb7-4b34-88bb-45c2d74f4238 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:20:28.673917 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-3f2bca7c-5bb7-4b34-88bb-45c2d74f4238 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:20:28.674773 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-3f2bca7c-5bb7-4b34-88bb-45c2d74f4238 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:20:28.694511 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3f2bca7c-5bb7-4b34-88bb-45c2d74f4238 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:28.698587 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3f2bca7c-5bb7-4b34-88bb-45c2d74f4238 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:28.699224 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3f2bca7c-5bb7-4b34-88bb-45c2d74f4238 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:28.700577 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3f2bca7c-5bb7-4b34-88bb-45c2d74f4238 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:28.702848 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3f2bca7c-5bb7-4b34-88bb-45c2d74f4238 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:28.704927 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3f2bca7c-5bb7-4b34-88bb-45c2d74f4238 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:28.752047 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-3f2bca7c-5bb7-4b34-88bb-45c2d74f4238 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Getting quotas for project a0556c0544d446a2aa3d54e00b16bab1. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:20:28.764879 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-3f2bca7c-5bb7-4b34-88bb-45c2d74f4238 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Getting quotas for user 18ea2d1dfc7441d2a2bb7b22c6065605 and project a0556c0544d446a2aa3d54e00b16bab1. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:20:28.791598 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3f2bca7c-5bb7-4b34-88bb-45c2d74f4238 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:20:28.794487 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3f2bca7c-5bb7-4b34-88bb-45c2d74f4238 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 2fd0dd2b-4e96-4272-825b-5852451e3992] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:20:28.956058 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3f2bca7c-5bb7-4b34-88bb-45c2d74f4238 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.998538 Oct 23 01:20:28.968257 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1365/2753] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:20:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 3010 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:20:28.988205 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ef508995-8fb4-4e4c-885d-dba2c61de0aa tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:28.993255 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ef508995-8fb4-4e4c-885d-dba2c61de0aa tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:29.032820 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ef508995-8fb4-4e4c-885d-dba2c61de0aa tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:29.037524 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ef508995-8fb4-4e4c-885d-dba2c61de0aa tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:29.038019 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ef508995-8fb4-4e4c-885d-dba2c61de0aa tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:29.038788 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ef508995-8fb4-4e4c-885d-dba2c61de0aa tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:29.039256 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ef508995-8fb4-4e4c-885d-dba2c61de0aa tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:29.047001 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ef508995-8fb4-4e4c-885d-dba2c61de0aa tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:30.209012 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5a44cf6d-04b7-491f-b698-b9cade326796 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:30.230849 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5a44cf6d-04b7-491f-b698-b9cade326796 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0" status: 200 len: 1507 microversion: 2.1 time: 1.891753 Oct 23 01:20:30.233889 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1389/2754] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:28 2022] GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0 => generated 1507 bytes in 1900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:30.274108 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-98fcff24-d170-41be-8e6f-39f1e2586b92 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:30.283071 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-98fcff24-d170-41be-8e6f-39f1e2586b92 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] [instance: 9ed76d3e-f334-4835-91f8-8bcbc1076b60] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:30.313668 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-98fcff24-d170-41be-8e6f-39f1e2586b92 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:30.317554 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-98fcff24-d170-41be-8e6f-39f1e2586b92 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:30.318224 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-98fcff24-d170-41be-8e6f-39f1e2586b92 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:30.319183 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-98fcff24-d170-41be-8e6f-39f1e2586b92 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:30.319843 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-98fcff24-d170-41be-8e6f-39f1e2586b92 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:30.323360 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-98fcff24-d170-41be-8e6f-39f1e2586b92 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:30.363328 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ef508995-8fb4-4e4c-885d-dba2c61de0aa tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:30.367273 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=100 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:20:30.382988 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ef508995-8fb4-4e4c-885d-dba2c61de0aa tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1532 microversion: 2.1 time: 1.409508 Oct 23 01:20:30.398071 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1366/2755] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:28 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1532 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:30.406559 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-19ef8953-6cd3-4120-ae4e-fd8697e50be0 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:30.406559 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-19ef8953-6cd3-4120-ae4e-fd8697e50be0 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:30.424481 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-98fcff24-d170-41be-8e6f-39f1e2586b92 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:30.427512 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-98fcff24-d170-41be-8e6f-39f1e2586b92 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:30.427512 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-98fcff24-d170-41be-8e6f-39f1e2586b92 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:30.430256 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-98fcff24-d170-41be-8e6f-39f1e2586b92 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lazy-loading 'fault' on Instance uuid 9ed76d3e-f334-4835-91f8-8bcbc1076b60 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:20:30.469781 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-19ef8953-6cd3-4120-ae4e-fd8697e50be0 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:30.479824 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-19ef8953-6cd3-4120-ae4e-fd8697e50be0 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:30.482375 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-19ef8953-6cd3-4120-ae4e-fd8697e50be0 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:30.487764 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-19ef8953-6cd3-4120-ae4e-fd8697e50be0 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:30.488277 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-19ef8953-6cd3-4120-ae4e-fd8697e50be0 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:30.488730 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-19ef8953-6cd3-4120-ae4e-fd8697e50be0 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:30.614738 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-98fcff24-d170-41be-8e6f-39f1e2586b92 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eb8880d07649b08bfe76a68901d81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55fb3f415da42eeb5d5514410670b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:30.630357 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-98fcff24-d170-41be-8e6f-39f1e2586b92 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed76d3e-f334-4835-91f8-8bcbc1076b60" status: 200 len: 1306 microversion: 2.1 time: 0.384532 Oct 23 01:20:30.631342 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1390/2756] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:30 2022] GET /compute/v2.1/servers/9ed76d3e-f334-4835-91f8-8bcbc1076b60 => generated 1306 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:30.652351 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-b4c833a8-089b-40d1-8a0f-ac443ad930a4 req-1d951e9d-22cb-412b-b5dd-c9d031ac701c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ed76d3e-f334-4835-91f8-8bcbc1076b60", "name": "network-vif-deleted", "tag": "df96f59d-1993-491c-9189-d26c9473816b"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:20:30.670779 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-b4c833a8-089b-40d1-8a0f-ac443ad930a4 req-1d951e9d-22cb-412b-b5dd-c9d031ac701c service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:30.671574 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-b4c833a8-089b-40d1-8a0f-ac443ad930a4 req-1d951e9d-22cb-412b-b5dd-c9d031ac701c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:30.678654 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-b4c833a8-089b-40d1-8a0f-ac443ad930a4 req-1d951e9d-22cb-412b-b5dd-c9d031ac701c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:30.705675 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-b4c833a8-089b-40d1-8a0f-ac443ad930a4 req-1d951e9d-22cb-412b-b5dd-c9d031ac701c service nova] Creating event network-vif-deleted:df96f59d-1993-491c-9189-d26c9473816b for instance 9ed76d3e-f334-4835-91f8-8bcbc1076b60 on n-h2-master-1 Oct 23 01:20:30.717361 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-b4c833a8-089b-40d1-8a0f-ac443ad930a4 req-1d951e9d-22cb-412b-b5dd-c9d031ac701c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084488 Oct 23 01:20:30.722895 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1391/2757] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:20:30.735613 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-737a3892-b511-4435-a0a7-8a83f10f3acc tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:30.736640 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-737a3892-b511-4435-a0a7-8a83f10f3acc tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 9a64ad71-9caf-4645-be7a-b56f8f584c2d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:30.752338 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-737a3892-b511-4435-a0a7-8a83f10f3acc tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:30.753137 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-737a3892-b511-4435-a0a7-8a83f10f3acc tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:30.756505 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-737a3892-b511-4435-a0a7-8a83f10f3acc tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:30.760117 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-737a3892-b511-4435-a0a7-8a83f10f3acc tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:30.760117 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-737a3892-b511-4435-a0a7-8a83f10f3acc tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:30.760117 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-737a3892-b511-4435-a0a7-8a83f10f3acc tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:30.837312 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-19ef8953-6cd3-4120-ae4e-fd8697e50be0 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:30.851902 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-19ef8953-6cd3-4120-ae4e-fd8697e50be0 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:30.857580 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-19ef8953-6cd3-4120-ae4e-fd8697e50be0 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:30.875138 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-19ef8953-6cd3-4120-ae4e-fd8697e50be0 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] 10.222.0.42 "GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334" status: 200 len: 1446 microversion: 2.75 time: 0.488667 Oct 23 01:20:30.876460 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1367/2758] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:20:30 2022] GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334 => generated 1446 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:20:30.895904 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2158b3e7-53bd-4b5d-955b-363d4a8f7295 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:30.896926 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2158b3e7-53bd-4b5d-955b-363d4a8f7295 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 2fd0dd2b-4e96-4272-825b-5852451e3992] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:30.915712 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2158b3e7-53bd-4b5d-955b-363d4a8f7295 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:30.916406 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2158b3e7-53bd-4b5d-955b-363d4a8f7295 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:30.917231 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2158b3e7-53bd-4b5d-955b-363d4a8f7295 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:30.918233 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2158b3e7-53bd-4b5d-955b-363d4a8f7295 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:30.919395 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2158b3e7-53bd-4b5d-955b-363d4a8f7295 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:30.920019 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2158b3e7-53bd-4b5d-955b-363d4a8f7295 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:31.033710 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2158b3e7-53bd-4b5d-955b-363d4a8f7295 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:31.044679 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2158b3e7-53bd-4b5d-955b-363d4a8f7295 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/2fd0dd2b-4e96-4272-825b-5852451e3992" status: 200 len: 1214 microversion: 2.1 time: 0.165195 Oct 23 01:20:31.048197 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1368/2759] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:30 2022] GET /compute/v2.1/servers/2fd0dd2b-4e96-4272-825b-5852451e3992 => generated 1214 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:31.068390 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-59474a70-d0d8-4504-9300-081496172d3f req-5ca35261-7a98-43b4-9868-ccfcf2fab845 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62a8ad26-f65b-432d-a8da-48264c426335", "name": "network-vif-plugged", "status": "completed", "tag": "56917629-dd5e-4c91-a45e-1e8e6cd25138"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:20:31.088104 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-59474a70-d0d8-4504-9300-081496172d3f req-5ca35261-7a98-43b4-9868-ccfcf2fab845 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:31.088825 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-59474a70-d0d8-4504-9300-081496172d3f req-5ca35261-7a98-43b4-9868-ccfcf2fab845 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:31.089391 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-59474a70-d0d8-4504-9300-081496172d3f req-5ca35261-7a98-43b4-9868-ccfcf2fab845 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:31.127705 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-59474a70-d0d8-4504-9300-081496172d3f req-5ca35261-7a98-43b4-9868-ccfcf2fab845 service nova] Creating event network-vif-plugged:56917629-dd5e-4c91-a45e-1e8e6cd25138 for instance 62a8ad26-f65b-432d-a8da-48264c426335 on n-h2-master-1 Oct 23 01:20:31.140347 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-59474a70-d0d8-4504-9300-081496172d3f req-5ca35261-7a98-43b4-9868-ccfcf2fab845 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089793 Oct 23 01:20:31.149457 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1369/2760] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:20:31.272203 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7b93bd5b-7d81-45aa-8836-2344310f3f6c tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:31.273955 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7b93bd5b-7d81-45aa-8836-2344310f3f6c tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: ad3fdbf4-6dba-46a6-9132-e555185544b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:31.293242 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b93bd5b-7d81-45aa-8836-2344310f3f6c tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:31.296797 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b93bd5b-7d81-45aa-8836-2344310f3f6c tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:31.299254 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b93bd5b-7d81-45aa-8836-2344310f3f6c tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:31.303214 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b93bd5b-7d81-45aa-8836-2344310f3f6c tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:31.305520 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b93bd5b-7d81-45aa-8836-2344310f3f6c tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:31.307345 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b93bd5b-7d81-45aa-8836-2344310f3f6c tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:31.388224 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-737a3892-b511-4435-a0a7-8a83f10f3acc tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:31.401429 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-737a3892-b511-4435-a0a7-8a83f10f3acc tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/9a64ad71-9caf-4645-be7a-b56f8f584c2d" status: 200 len: 1308 microversion: 2.1 time: 0.674815 Oct 23 01:20:31.406511 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1392/2761] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:30 2022] GET /compute/v2.1/servers/9a64ad71-9caf-4645-be7a-b56f8f584c2d => generated 1308 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:31.429569 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-05c28dd3-7cda-4ff0-a975-0f4aaa1e553d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:31.430641 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-05c28dd3-7cda-4ff0-a975-0f4aaa1e553d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:31.445738 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05c28dd3-7cda-4ff0-a975-0f4aaa1e553d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:31.446368 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05c28dd3-7cda-4ff0-a975-0f4aaa1e553d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:31.446882 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05c28dd3-7cda-4ff0-a975-0f4aaa1e553d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:31.447694 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05c28dd3-7cda-4ff0-a975-0f4aaa1e553d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:31.450454 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05c28dd3-7cda-4ff0-a975-0f4aaa1e553d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:31.450974 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05c28dd3-7cda-4ff0-a975-0f4aaa1e553d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:31.891631 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7b93bd5b-7d81-45aa-8836-2344310f3f6c tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:31.905174 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7b93bd5b-7d81-45aa-8836-2344310f3f6c tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0" status: 200 len: 1507 microversion: 2.1 time: 0.645055 Oct 23 01:20:31.911219 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1370/2762] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:31 2022] GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0 => generated 1507 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:31.915935 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cd750e7e-8fae-4767-bfee-e2bc5c28da46 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:31.922209 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-cd750e7e-8fae-4767-bfee-e2bc5c28da46 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] [instance: 9ed76d3e-f334-4835-91f8-8bcbc1076b60] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:31.938369 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cd750e7e-8fae-4767-bfee-e2bc5c28da46 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:31.939071 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cd750e7e-8fae-4767-bfee-e2bc5c28da46 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:31.941440 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cd750e7e-8fae-4767-bfee-e2bc5c28da46 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:31.944090 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cd750e7e-8fae-4767-bfee-e2bc5c28da46 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:31.945279 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cd750e7e-8fae-4767-bfee-e2bc5c28da46 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:31.948830 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cd750e7e-8fae-4767-bfee-e2bc5c28da46 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:31.992849 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-cd750e7e-8fae-4767-bfee-e2bc5c28da46 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] HTTP exception thrown: Instance 9ed76d3e-f334-4835-91f8-8bcbc1076b60 could not be found. Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cd750e7e-8fae-4767-bfee-e2bc5c28da46 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Request method failure captured: Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/9ed76d3e-f334-4835-91f8-8bcbc1076b60 HTTP/1.1 Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJa2ByN4MOQIIV-ksvVzVsOAVSxCBJN_Ne2JEsbEZCLakk0Xn2wWPNDbbKeeANZ01_IZ61d99kMM0-Yu5jN2DpS1UO0WQ0teNBdr4MIaRIvyU3no7Pl42mY3qqUXKttUcnKOnx00pUoCwr7osGbkXa_Ndzk0nHSzVThPSOPHOsSqF00 Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: d55fb3f415da42eeb5d5514410670b29 Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-InstanceActionsTestJSON-1785889661 Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d55fb3f415da42eeb5d5514410670b29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d55fb3f415da42eeb5d5514410670b29"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d55fb3f415da42eeb5d5514410670b29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d55fb3f415da42eeb5d5514410670b29"}]}] Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-InstanceActionsTestJSON-1785889661 Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: d55fb3f415da42eeb5d5514410670b29 Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1785889661 Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-InstanceActionsTestJSON-1785889661-project Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 86eb8880d07649b08bfe76a68901d81c Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-InstanceActionsTestJSON-1785889661-project Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 9ed76d3e-f334-4835-91f8-8bcbc1076b60 could not be found. Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '9ed76d3e-f334-4835-91f8-8bcbc1076b60'} Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ed76d3e-f334-4835-91f8-8bcbc1076b60 could not be found. Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ed76d3e-f334-4835-91f8-8bcbc1076b60 could not be found. Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:20:31.999314 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:20:32.004914 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:20:32.004914 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:20:32.004914 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:20:32.004914 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:20:32.004914 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:20:32.004914 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ed76d3e-f334-4835-91f8-8bcbc1076b60 could not be found. Oct 23 01:20:32.004914 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:20:32.007408 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cd750e7e-8fae-4767-bfee-e2bc5c28da46 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] Returning 404 to user: Instance 9ed76d3e-f334-4835-91f8-8bcbc1076b60 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:20:32.009742 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cd750e7e-8fae-4767-bfee-e2bc5c28da46 tempest-InstanceActionsTestJSON-1785889661 tempest-InstanceActionsTestJSON-1785889661-project] 10.222.0.42 "GET /compute/v2.1/servers/9ed76d3e-f334-4835-91f8-8bcbc1076b60" status: 404 len: 111 microversion: 2.1 time: 0.098806 Oct 23 01:20:32.011183 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1371/2763] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:31 2022] GET /compute/v2.1/servers/9ed76d3e-f334-4835-91f8-8bcbc1076b60 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:20:32.017870 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f44356b0-039b-4d3b-a093-5006c005a685 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:32.018732 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f44356b0-039b-4d3b-a093-5006c005a685 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:32.026173 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f44356b0-039b-4d3b-a093-5006c005a685 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:32.026972 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f44356b0-039b-4d3b-a093-5006c005a685 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:32.027647 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f44356b0-039b-4d3b-a093-5006c005a685 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:32.028551 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f44356b0-039b-4d3b-a093-5006c005a685 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:32.029280 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f44356b0-039b-4d3b-a093-5006c005a685 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:32.030545 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f44356b0-039b-4d3b-a093-5006c005a685 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:32.032703 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-05c28dd3-7cda-4ff0-a975-0f4aaa1e553d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:32.048714 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-05c28dd3-7cda-4ff0-a975-0f4aaa1e553d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1527 microversion: 2.1 time: 0.626395 Oct 23 01:20:32.050137 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1393/2764] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:31 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1527 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:20:32.076449 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-161d2878-95d6-44b2-bfea-42dbf929ea3b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:32.077082 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-161d2878-95d6-44b2-bfea-42dbf929ea3b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 2fd0dd2b-4e96-4272-825b-5852451e3992] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:32.101808 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-161d2878-95d6-44b2-bfea-42dbf929ea3b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:32.105373 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-161d2878-95d6-44b2-bfea-42dbf929ea3b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:32.105864 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-161d2878-95d6-44b2-bfea-42dbf929ea3b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:32.110182 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-161d2878-95d6-44b2-bfea-42dbf929ea3b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:32.110741 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-161d2878-95d6-44b2-bfea-42dbf929ea3b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:32.111181 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-161d2878-95d6-44b2-bfea-42dbf929ea3b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:32.155274 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f44356b0-039b-4d3b-a093-5006c005a685 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:32.167239 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f44356b0-039b-4d3b-a093-5006c005a685 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:32.169674 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f44356b0-039b-4d3b-a093-5006c005a685 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:32.180446 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f44356b0-039b-4d3b-a093-5006c005a685 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] 10.222.0.42 "GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334" status: 200 len: 1446 microversion: 2.75 time: 0.167870 Oct 23 01:20:32.181827 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1372/2765] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:20:32 2022] GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334 => generated 1446 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:20:32.243364 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-161d2878-95d6-44b2-bfea-42dbf929ea3b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:32.255788 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-161d2878-95d6-44b2-bfea-42dbf929ea3b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/2fd0dd2b-4e96-4272-825b-5852451e3992" status: 200 len: 1270 microversion: 2.1 time: 0.183262 Oct 23 01:20:32.273784 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1394/2766] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:32 2022] GET /compute/v2.1/servers/2fd0dd2b-4e96-4272-825b-5852451e3992 => generated 1270 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:32.453723 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a9bd8aaf-bbe4-4c1a-92e7-6a2033e2616c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:32.454672 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a9bd8aaf-bbe4-4c1a-92e7-6a2033e2616c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 9a64ad71-9caf-4645-be7a-b56f8f584c2d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:32.490724 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a9bd8aaf-bbe4-4c1a-92e7-6a2033e2616c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:32.492960 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a9bd8aaf-bbe4-4c1a-92e7-6a2033e2616c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:32.494935 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a9bd8aaf-bbe4-4c1a-92e7-6a2033e2616c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:32.496025 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a9bd8aaf-bbe4-4c1a-92e7-6a2033e2616c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:32.497631 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a9bd8aaf-bbe4-4c1a-92e7-6a2033e2616c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:32.499271 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a9bd8aaf-bbe4-4c1a-92e7-6a2033e2616c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:32.699233 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a9bd8aaf-bbe4-4c1a-92e7-6a2033e2616c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:32.716172 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a9bd8aaf-bbe4-4c1a-92e7-6a2033e2616c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/9a64ad71-9caf-4645-be7a-b56f8f584c2d" status: 200 len: 1308 microversion: 2.1 time: 0.267765 Oct 23 01:20:32.716819 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1373/2767] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:32 2022] GET /compute/v2.1/servers/9a64ad71-9caf-4645-be7a-b56f8f584c2d => generated 1308 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:20:32.806628 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-7b0a7fda-e1ff-4c5c-bdc4-5d379a227130 req-a8b3532b-eac1-40ea-a1a4-2f198c50f5c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ccfe45d-f080-4066-9aad-a39c3c4cd097", "name": "network-vif-deleted", "tag": "fce18087-d670-4b69-9cc5-11b42a9fa6de"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:20:32.846093 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-7b0a7fda-e1ff-4c5c-bdc4-5d379a227130 req-a8b3532b-eac1-40ea-a1a4-2f198c50f5c6 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:32.847435 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-7b0a7fda-e1ff-4c5c-bdc4-5d379a227130 req-a8b3532b-eac1-40ea-a1a4-2f198c50f5c6 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:32.855128 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-7b0a7fda-e1ff-4c5c-bdc4-5d379a227130 req-a8b3532b-eac1-40ea-a1a4-2f198c50f5c6 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:32.883158 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-7b0a7fda-e1ff-4c5c-bdc4-5d379a227130 req-a8b3532b-eac1-40ea-a1a4-2f198c50f5c6 service nova] Creating event network-vif-deleted:fce18087-d670-4b69-9cc5-11b42a9fa6de for instance 6ccfe45d-f080-4066-9aad-a39c3c4cd097 on n-h1-master-1 Oct 23 01:20:32.891368 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-7b0a7fda-e1ff-4c5c-bdc4-5d379a227130 req-a8b3532b-eac1-40ea-a1a4-2f198c50f5c6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098320 Oct 23 01:20:32.892557 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1395/2768] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:20:32.940141 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-75e62a88-0773-4541-946f-873e45339c78 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:32.940831 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-75e62a88-0773-4541-946f-873e45339c78 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: ad3fdbf4-6dba-46a6-9132-e555185544b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:32.983460 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-75e62a88-0773-4541-946f-873e45339c78 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:32.997396 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-75e62a88-0773-4541-946f-873e45339c78 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:33.001365 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-75e62a88-0773-4541-946f-873e45339c78 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:33.002903 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-75e62a88-0773-4541-946f-873e45339c78 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:33.003369 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-75e62a88-0773-4541-946f-873e45339c78 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:33.005515 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-75e62a88-0773-4541-946f-873e45339c78 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:33.017873 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-300df96e-cac3-4014-8841-a67d82ccec9a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:33.018496 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-300df96e-cac3-4014-8841-a67d82ccec9a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:33.031501 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-300df96e-cac3-4014-8841-a67d82ccec9a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:33.032603 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-300df96e-cac3-4014-8841-a67d82ccec9a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:33.033288 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-300df96e-cac3-4014-8841-a67d82ccec9a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:33.038225 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-300df96e-cac3-4014-8841-a67d82ccec9a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:33.038225 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-300df96e-cac3-4014-8841-a67d82ccec9a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:33.038225 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-300df96e-cac3-4014-8841-a67d82ccec9a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:33.113756 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-300df96e-cac3-4014-8841-a67d82ccec9a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:20:33.253250 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:20:33.608103 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-300df96e-cac3-4014-8841-a67d82ccec9a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "DELETE /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7" status: 204 len: 0 microversion: 2.25 time: 0.595495 Oct 23 01:20:33.609744 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1396/2769] 10.222.0.42 () {60 vars in 1280 bytes} [Sun Oct 23 01:20:33 2022] DELETE /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 23 01:20:33.616408 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5e723250-980e-4e79-a666-94b758b62e06 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:33.617174 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5e723250-980e-4e79-a666-94b758b62e06 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:33.668397 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e723250-980e-4e79-a666-94b758b62e06 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:33.668397 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e723250-980e-4e79-a666-94b758b62e06 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:33.670200 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e723250-980e-4e79-a666-94b758b62e06 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:33.676175 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e723250-980e-4e79-a666-94b758b62e06 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:33.677957 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e723250-980e-4e79-a666-94b758b62e06 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:33.678607 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e723250-980e-4e79-a666-94b758b62e06 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:34.151546 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-75e62a88-0773-4541-946f-873e45339c78 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:34.160394 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-75e62a88-0773-4541-946f-873e45339c78 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0" status: 200 len: 1507 microversion: 2.1 time: 1.230378 Oct 23 01:20:34.166697 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1374/2770] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:32 2022] GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0 => generated 1507 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:34.182561 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-46238d33-a676-4c8c-be62-63ee49870c05 req-05d53aed-9883-44cc-8874-46be454f6ed7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a64ad71-9caf-4645-be7a-b56f8f584c2d", "name": "network-vif-plugged", "status": "completed", "tag": "40a2cfab-1f0a-4ac9-815e-ce16a0befa54"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:20:34.202910 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5e723250-980e-4e79-a666-94b758b62e06 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:34.208900 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-46238d33-a676-4c8c-be62-63ee49870c05 req-05d53aed-9883-44cc-8874-46be454f6ed7 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:34.213843 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-46238d33-a676-4c8c-be62-63ee49870c05 req-05d53aed-9883-44cc-8874-46be454f6ed7 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:34.217380 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-46238d33-a676-4c8c-be62-63ee49870c05 req-05d53aed-9883-44cc-8874-46be454f6ed7 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:34.224425 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5e723250-980e-4e79-a666-94b758b62e06 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1527 microversion: 2.1 time: 0.604885 Oct 23 01:20:34.225364 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1397/2771] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:33 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1527 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:34.237541 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8dde6c35-1087-4d49-8b50-5feb99ff9abf tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:34.244372 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8dde6c35-1087-4d49-8b50-5feb99ff9abf tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:34.254206 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-46238d33-a676-4c8c-be62-63ee49870c05 req-05d53aed-9883-44cc-8874-46be454f6ed7 service nova] Creating event network-vif-plugged:40a2cfab-1f0a-4ac9-815e-ce16a0befa54 for instance 9a64ad71-9caf-4645-be7a-b56f8f584c2d on n-h2-master-1 Oct 23 01:20:34.267461 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8dde6c35-1087-4d49-8b50-5feb99ff9abf tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:34.270226 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8dde6c35-1087-4d49-8b50-5feb99ff9abf tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:34.271127 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8dde6c35-1087-4d49-8b50-5feb99ff9abf tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:34.273497 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8dde6c35-1087-4d49-8b50-5feb99ff9abf tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:34.276832 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8dde6c35-1087-4d49-8b50-5feb99ff9abf tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:34.282368 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-46238d33-a676-4c8c-be62-63ee49870c05 req-05d53aed-9883-44cc-8874-46be454f6ed7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107284 Oct 23 01:20:34.282500 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8dde6c35-1087-4d49-8b50-5feb99ff9abf tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:34.282582 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1375/2772] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:20:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:20:34.310988 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-46b3d8a5-ac27-49a3-9a82-a735047aa2f9 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:34.311754 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-46b3d8a5-ac27-49a3-9a82-a735047aa2f9 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 2fd0dd2b-4e96-4272-825b-5852451e3992] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:34.340477 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46b3d8a5-ac27-49a3-9a82-a735047aa2f9 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:34.340983 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46b3d8a5-ac27-49a3-9a82-a735047aa2f9 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:34.341465 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46b3d8a5-ac27-49a3-9a82-a735047aa2f9 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:34.342768 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46b3d8a5-ac27-49a3-9a82-a735047aa2f9 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:34.358198 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46b3d8a5-ac27-49a3-9a82-a735047aa2f9 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:34.359200 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46b3d8a5-ac27-49a3-9a82-a735047aa2f9 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:34.573180 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-46b3d8a5-ac27-49a3-9a82-a735047aa2f9 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:34.590274 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-46b3d8a5-ac27-49a3-9a82-a735047aa2f9 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/2fd0dd2b-4e96-4272-825b-5852451e3992" status: 200 len: 1276 microversion: 2.1 time: 0.301844 Oct 23 01:20:34.594123 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1376/2773] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:34 2022] GET /compute/v2.1/servers/2fd0dd2b-4e96-4272-825b-5852451e3992 => generated 1276 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:34.616118 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-da2f2ba0-20fe-4087-8a61-cee02e8bd432 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:34.617588 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-da2f2ba0-20fe-4087-8a61-cee02e8bd432 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:34.635431 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-da2f2ba0-20fe-4087-8a61-cee02e8bd432 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:34.636005 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-da2f2ba0-20fe-4087-8a61-cee02e8bd432 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:34.641164 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-da2f2ba0-20fe-4087-8a61-cee02e8bd432 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:34.642155 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-da2f2ba0-20fe-4087-8a61-cee02e8bd432 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:34.643086 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-da2f2ba0-20fe-4087-8a61-cee02e8bd432 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:34.643527 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-da2f2ba0-20fe-4087-8a61-cee02e8bd432 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:34.755237 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8dde6c35-1087-4d49-8b50-5feb99ff9abf tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:34.765386 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8dde6c35-1087-4d49-8b50-5feb99ff9abf tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:34.772462 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8dde6c35-1087-4d49-8b50-5feb99ff9abf tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:34.787543 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8dde6c35-1087-4d49-8b50-5feb99ff9abf tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] 10.222.0.42 "GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334" status: 200 len: 1446 microversion: 2.75 time: 0.559906 Oct 23 01:20:34.800669 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1398/2774] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:20:34 2022] GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334 => generated 1446 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:20:34.840029 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-86e8ba05-cfbe-4fdb-a5e6-a732b3ea2f47 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:34.842900 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-86e8ba05-cfbe-4fdb-a5e6-a732b3ea2f47 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 9a64ad71-9caf-4645-be7a-b56f8f584c2d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:34.857188 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-86e8ba05-cfbe-4fdb-a5e6-a732b3ea2f47 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:34.866270 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-86e8ba05-cfbe-4fdb-a5e6-a732b3ea2f47 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:34.866907 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-86e8ba05-cfbe-4fdb-a5e6-a732b3ea2f47 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:34.867730 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-86e8ba05-cfbe-4fdb-a5e6-a732b3ea2f47 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:34.869391 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-86e8ba05-cfbe-4fdb-a5e6-a732b3ea2f47 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:34.878506 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-86e8ba05-cfbe-4fdb-a5e6-a732b3ea2f47 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:35.151826 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-86e8ba05-cfbe-4fdb-a5e6-a732b3ea2f47 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:35.182007 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-86e8ba05-cfbe-4fdb-a5e6-a732b3ea2f47 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/9a64ad71-9caf-4645-be7a-b56f8f584c2d" status: 200 len: 1308 microversion: 2.1 time: 0.371203 Oct 23 01:20:35.189243 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1399/2775] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:34 2022] GET /compute/v2.1/servers/9a64ad71-9caf-4645-be7a-b56f8f584c2d => generated 1308 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:35.200424 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-54da3291-96b0-4635-b022-4eb111738161 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:35.207386 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-54da3291-96b0-4635-b022-4eb111738161 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: ad3fdbf4-6dba-46a6-9132-e555185544b0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:35.228679 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54da3291-96b0-4635-b022-4eb111738161 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:35.229333 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54da3291-96b0-4635-b022-4eb111738161 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:35.229772 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54da3291-96b0-4635-b022-4eb111738161 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:35.230504 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54da3291-96b0-4635-b022-4eb111738161 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:35.230956 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54da3291-96b0-4635-b022-4eb111738161 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:35.234226 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54da3291-96b0-4635-b022-4eb111738161 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:35.673578 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-da2f2ba0-20fe-4087-8a61-cee02e8bd432 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:35.688348 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-da2f2ba0-20fe-4087-8a61-cee02e8bd432 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:35.688570 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-da2f2ba0-20fe-4087-8a61-cee02e8bd432 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:35.689831 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-da2f2ba0-20fe-4087-8a61-cee02e8bd432 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7" status: 200 len: 1733 microversion: 2.25 time: 1.091730 Oct 23 01:20:35.695122 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1377/2776] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:20:34 2022] GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7 => generated 1733 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:20:35.708036 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9209b581-96df-41a4-895f-fb3ff95a1c0d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:35.709089 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9209b581-96df-41a4-895f-fb3ff95a1c0d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:35.725007 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9209b581-96df-41a4-895f-fb3ff95a1c0d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:35.729337 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9209b581-96df-41a4-895f-fb3ff95a1c0d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:35.730069 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9209b581-96df-41a4-895f-fb3ff95a1c0d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:35.730974 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9209b581-96df-41a4-895f-fb3ff95a1c0d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:35.731581 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9209b581-96df-41a4-895f-fb3ff95a1c0d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:35.732156 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9209b581-96df-41a4-895f-fb3ff95a1c0d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:35.844564 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-54da3291-96b0-4635-b022-4eb111738161 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:35.864846 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-54da3291-96b0-4635-b022-4eb111738161 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0" status: 200 len: 1507 microversion: 2.1 time: 0.668166 Oct 23 01:20:35.866181 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1400/2777] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:35 2022] GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0 => generated 1507 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:20:35.871846 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e0f4a734-31bc-4309-9318-d478217075a4 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:35.872769 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e0f4a734-31bc-4309-9318-d478217075a4 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 2fd0dd2b-4e96-4272-825b-5852451e3992] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:35.880581 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e0f4a734-31bc-4309-9318-d478217075a4 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:35.881309 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e0f4a734-31bc-4309-9318-d478217075a4 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:35.882063 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e0f4a734-31bc-4309-9318-d478217075a4 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:35.883308 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e0f4a734-31bc-4309-9318-d478217075a4 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:35.884445 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e0f4a734-31bc-4309-9318-d478217075a4 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:35.885103 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e0f4a734-31bc-4309-9318-d478217075a4 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:36.840185 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9209b581-96df-41a4-895f-fb3ff95a1c0d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:36.854781 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9209b581-96df-41a4-895f-fb3ff95a1c0d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1527 microversion: 2.1 time: 1.158230 Oct 23 01:20:36.867419 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1378/2778] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:35 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1527 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:36.890035 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6778b339-1bff-4f37-8620-c6bff66ce4db tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:36.891325 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6778b339-1bff-4f37-8620-c6bff66ce4db tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:36.901169 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6778b339-1bff-4f37-8620-c6bff66ce4db tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:36.901926 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6778b339-1bff-4f37-8620-c6bff66ce4db tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:36.902608 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6778b339-1bff-4f37-8620-c6bff66ce4db tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:36.903523 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6778b339-1bff-4f37-8620-c6bff66ce4db tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:36.904222 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6778b339-1bff-4f37-8620-c6bff66ce4db tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:36.905754 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6778b339-1bff-4f37-8620-c6bff66ce4db tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:37.179287 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e0f4a734-31bc-4309-9318-d478217075a4 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:37.229652 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e0f4a734-31bc-4309-9318-d478217075a4 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/2fd0dd2b-4e96-4272-825b-5852451e3992" status: 200 len: 1318 microversion: 2.1 time: 1.361999 Oct 23 01:20:37.230552 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1401/2779] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:35 2022] GET /compute/v2.1/servers/2fd0dd2b-4e96-4272-825b-5852451e3992 => generated 1318 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:37.246404 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6778b339-1bff-4f37-8620-c6bff66ce4db tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:37.254023 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cba24557-8d90-4c1a-9095-faaa2f4fb842 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:37.256845 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cba24557-8d90-4c1a-9095-faaa2f4fb842 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 9a64ad71-9caf-4645-be7a-b56f8f584c2d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:37.281240 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cba24557-8d90-4c1a-9095-faaa2f4fb842 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:37.284052 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6778b339-1bff-4f37-8620-c6bff66ce4db tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:37.291632 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cba24557-8d90-4c1a-9095-faaa2f4fb842 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:37.292371 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cba24557-8d90-4c1a-9095-faaa2f4fb842 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:37.297667 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cba24557-8d90-4c1a-9095-faaa2f4fb842 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:37.304889 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cba24557-8d90-4c1a-9095-faaa2f4fb842 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:37.309602 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6778b339-1bff-4f37-8620-c6bff66ce4db tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:37.314188 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cba24557-8d90-4c1a-9095-faaa2f4fb842 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:37.367287 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6778b339-1bff-4f37-8620-c6bff66ce4db tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] 10.222.0.42 "GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334" status: 200 len: 1446 microversion: 2.75 time: 0.479923 Oct 23 01:20:37.369184 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1379/2780] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:20:36 2022] GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334 => generated 1446 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:20:37.410985 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-403032a0-c012-4a6a-9f63-8343652124d2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:37.413011 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-403032a0-c012-4a6a-9f63-8343652124d2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:37.431646 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-403032a0-c012-4a6a-9f63-8343652124d2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:37.431646 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-403032a0-c012-4a6a-9f63-8343652124d2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:37.431646 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-403032a0-c012-4a6a-9f63-8343652124d2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:37.433535 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-403032a0-c012-4a6a-9f63-8343652124d2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:37.437224 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-403032a0-c012-4a6a-9f63-8343652124d2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:37.437688 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-403032a0-c012-4a6a-9f63-8343652124d2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:38.176496 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-403032a0-c012-4a6a-9f63-8343652124d2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:38.193433 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-403032a0-c012-4a6a-9f63-8343652124d2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:38.194902 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-403032a0-c012-4a6a-9f63-8343652124d2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:38.196074 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-403032a0-c012-4a6a-9f63-8343652124d2 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7" status: 200 len: 1665 microversion: 2.25 time: 0.811740 Oct 23 01:20:38.196608 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1380/2781] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:20:37 2022] GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7 => generated 1665 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:20:38.209885 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-39cd7b85-2721-441e-a4ca-d6e33111d02c tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:38.228754 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-39cd7b85-2721-441e-a4ca-d6e33111d02c tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: ad3fdbf4-6dba-46a6-9132-e555185544b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:38.243170 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-39cd7b85-2721-441e-a4ca-d6e33111d02c tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:38.243676 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-39cd7b85-2721-441e-a4ca-d6e33111d02c tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:38.244117 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-39cd7b85-2721-441e-a4ca-d6e33111d02c tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:38.245179 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-39cd7b85-2721-441e-a4ca-d6e33111d02c tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:38.248313 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-39cd7b85-2721-441e-a4ca-d6e33111d02c tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:38.248778 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-39cd7b85-2721-441e-a4ca-d6e33111d02c tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:38.512645 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cba24557-8d90-4c1a-9095-faaa2f4fb842 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:38.551283 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cba24557-8d90-4c1a-9095-faaa2f4fb842 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/9a64ad71-9caf-4645-be7a-b56f8f584c2d" status: 200 len: 1489 microversion: 2.1 time: 1.301985 Oct 23 01:20:38.567835 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1402/2782] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:37 2022] GET /compute/v2.1/servers/9a64ad71-9caf-4645-be7a-b56f8f584c2d => generated 1489 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:38.586886 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9e8a948a-8553-4b11-a814-72be972b8994 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:38.587627 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9e8a948a-8553-4b11-a814-72be972b8994 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:38.724117 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e8a948a-8553-4b11-a814-72be972b8994 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:38.724117 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e8a948a-8553-4b11-a814-72be972b8994 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:38.724117 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e8a948a-8553-4b11-a814-72be972b8994 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:38.724117 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e8a948a-8553-4b11-a814-72be972b8994 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:38.724117 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e8a948a-8553-4b11-a814-72be972b8994 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:38.724117 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e8a948a-8553-4b11-a814-72be972b8994 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:38.724957 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-39cd7b85-2721-441e-a4ca-d6e33111d02c tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:38.724957 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-39cd7b85-2721-441e-a4ca-d6e33111d02c tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0" status: 200 len: 1507 microversion: 2.1 time: 0.439741 Oct 23 01:20:38.724957 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1381/2783] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:38 2022] GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0 => generated 1507 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:38.724957 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dd8057fe-5b4e-4604-acac-15d7bc236c4d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:38.724957 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-dd8057fe-5b4e-4604-acac-15d7bc236c4d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 2fd0dd2b-4e96-4272-825b-5852451e3992] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:38.724957 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd8057fe-5b4e-4604-acac-15d7bc236c4d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:38.724957 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd8057fe-5b4e-4604-acac-15d7bc236c4d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:38.724957 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd8057fe-5b4e-4604-acac-15d7bc236c4d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:38.724957 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd8057fe-5b4e-4604-acac-15d7bc236c4d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:38.724957 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd8057fe-5b4e-4604-acac-15d7bc236c4d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:38.724957 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd8057fe-5b4e-4604-acac-15d7bc236c4d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:38.724957 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:20:38.773427 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=6 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:20:39.133715 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-dd8057fe-5b4e-4604-acac-15d7bc236c4d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:39.142190 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-dd8057fe-5b4e-4604-acac-15d7bc236c4d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/2fd0dd2b-4e96-4272-825b-5852451e3992" status: 200 len: 1318 microversion: 2.1 time: 0.491359 Oct 23 01:20:39.149848 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1382/2784] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:38 2022] GET /compute/v2.1/servers/2fd0dd2b-4e96-4272-825b-5852451e3992 => generated 1318 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:39.155497 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b49e7f6c-eabc-4d17-b1f7-39363d610c8e tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:39.162934 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b49e7f6c-eabc-4d17-b1f7-39363d610c8e tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:39.169761 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b49e7f6c-eabc-4d17-b1f7-39363d610c8e tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:39.180752 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b49e7f6c-eabc-4d17-b1f7-39363d610c8e tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:39.181907 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b49e7f6c-eabc-4d17-b1f7-39363d610c8e tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:39.183063 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b49e7f6c-eabc-4d17-b1f7-39363d610c8e tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:39.183618 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b49e7f6c-eabc-4d17-b1f7-39363d610c8e tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:39.183971 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b49e7f6c-eabc-4d17-b1f7-39363d610c8e tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:39.312093 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9e8a948a-8553-4b11-a814-72be972b8994 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:39.319945 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9e8a948a-8553-4b11-a814-72be972b8994 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1527 microversion: 2.1 time: 0.750914 Oct 23 01:20:39.320713 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1403/2785] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:38 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1527 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:39.343479 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-62aba7b7-a74b-4ab0-b19e-4e1029eba04f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-636454557"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:20:39.346257 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-62aba7b7-a74b-4ab0-b19e-4e1029eba04f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 9a64ad71-9caf-4645-be7a-b56f8f584c2d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:39.353089 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-62aba7b7-a74b-4ab0-b19e-4e1029eba04f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:39.356369 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-62aba7b7-a74b-4ab0-b19e-4e1029eba04f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:39.356369 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-62aba7b7-a74b-4ab0-b19e-4e1029eba04f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:39.356369 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-62aba7b7-a74b-4ab0-b19e-4e1029eba04f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:39.356369 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-62aba7b7-a74b-4ab0-b19e-4e1029eba04f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:39.356369 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-62aba7b7-a74b-4ab0-b19e-4e1029eba04f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:39.402443 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b49e7f6c-eabc-4d17-b1f7-39363d610c8e tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:39.415468 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b49e7f6c-eabc-4d17-b1f7-39363d610c8e tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:39.417288 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b49e7f6c-eabc-4d17-b1f7-39363d610c8e tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:39.432056 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b49e7f6c-eabc-4d17-b1f7-39363d610c8e tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] 10.222.0.42 "GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334" status: 200 len: 1446 microversion: 2.75 time: 0.280828 Oct 23 01:20:39.434671 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1383/2786] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:20:39 2022] GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334 => generated 1446 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:20:39.445860 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3fec550b-dc9b-4224-8b52-38c0d26a745e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:39.453812 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3fec550b-dc9b-4224-8b52-38c0d26a745e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:39.458546 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3fec550b-dc9b-4224-8b52-38c0d26a745e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:39.459480 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3fec550b-dc9b-4224-8b52-38c0d26a745e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:39.460100 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3fec550b-dc9b-4224-8b52-38c0d26a745e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:39.461041 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3fec550b-dc9b-4224-8b52-38c0d26a745e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:39.461663 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3fec550b-dc9b-4224-8b52-38c0d26a745e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:39.462347 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3fec550b-dc9b-4224-8b52-38c0d26a745e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:39.608636 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3fec550b-dc9b-4224-8b52-38c0d26a745e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:39.637727 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3fec550b-dc9b-4224-8b52-38c0d26a745e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:39.642087 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3fec550b-dc9b-4224-8b52-38c0d26a745e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:39.647419 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3fec550b-dc9b-4224-8b52-38c0d26a745e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7" status: 200 len: 1665 microversion: 2.25 time: 0.209977 Oct 23 01:20:39.662786 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1384/2787] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:20:39 2022] GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7 => generated 1665 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:20:39.687935 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-87f0015e-bb25-4ba3-b9a0-a2daa1f82928 req-3084a11a-a303-4761-97db-7a34f339b675 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be9a2687-233d-43c3-95b3-3a8b455595c7", "name": "network-vif-deleted", "tag": "a5573536-696d-47fb-b77e-270410ee0fca"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:20:39.716792 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-87f0015e-bb25-4ba3-b9a0-a2daa1f82928 req-3084a11a-a303-4761-97db-7a34f339b675 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:39.718560 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-87f0015e-bb25-4ba3-b9a0-a2daa1f82928 req-3084a11a-a303-4761-97db-7a34f339b675 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:39.719214 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-87f0015e-bb25-4ba3-b9a0-a2daa1f82928 req-3084a11a-a303-4761-97db-7a34f339b675 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:39.734225 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-87f0015e-bb25-4ba3-b9a0-a2daa1f82928 req-3084a11a-a303-4761-97db-7a34f339b675 service nova] Creating event network-vif-deleted:a5573536-696d-47fb-b77e-270410ee0fca for instance be9a2687-233d-43c3-95b3-3a8b455595c7 on n-h1-master-1 Oct 23 01:20:39.752299 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-87f0015e-bb25-4ba3-b9a0-a2daa1f82928 req-3084a11a-a303-4761-97db-7a34f339b675 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076948 Oct 23 01:20:39.756195 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1385/2788] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:20:39.765043 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2e60e7cf-e777-44af-8539-2bf5eabdaf31 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:39.769067 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2e60e7cf-e777-44af-8539-2bf5eabdaf31 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: ad3fdbf4-6dba-46a6-9132-e555185544b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:39.777677 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e60e7cf-e777-44af-8539-2bf5eabdaf31 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:39.778539 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e60e7cf-e777-44af-8539-2bf5eabdaf31 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:39.779374 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e60e7cf-e777-44af-8539-2bf5eabdaf31 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:39.780348 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e60e7cf-e777-44af-8539-2bf5eabdaf31 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:39.781051 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e60e7cf-e777-44af-8539-2bf5eabdaf31 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:39.782530 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e60e7cf-e777-44af-8539-2bf5eabdaf31 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:39.799379 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=100 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:20:40.082067 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2e60e7cf-e777-44af-8539-2bf5eabdaf31 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:40.094447 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2e60e7cf-e777-44af-8539-2bf5eabdaf31 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0" status: 200 len: 1507 microversion: 2.1 time: 0.334807 Oct 23 01:20:40.120154 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1386/2789] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:39 2022] GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0 => generated 1507 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:40.179671 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d24db115-ed0b-485b-95e4-0f9dfca61a37 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:40.179671 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d24db115-ed0b-485b-95e4-0f9dfca61a37 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 2fd0dd2b-4e96-4272-825b-5852451e3992] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:40.190418 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d24db115-ed0b-485b-95e4-0f9dfca61a37 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:40.193578 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d24db115-ed0b-485b-95e4-0f9dfca61a37 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:40.194527 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d24db115-ed0b-485b-95e4-0f9dfca61a37 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:40.197812 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d24db115-ed0b-485b-95e4-0f9dfca61a37 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:40.199433 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d24db115-ed0b-485b-95e4-0f9dfca61a37 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:40.201573 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d24db115-ed0b-485b-95e4-0f9dfca61a37 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:40.634422 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d24db115-ed0b-485b-95e4-0f9dfca61a37 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:40.648459 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d24db115-ed0b-485b-95e4-0f9dfca61a37 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/2fd0dd2b-4e96-4272-825b-5852451e3992" status: 200 len: 1318 microversion: 2.1 time: 0.475596 Oct 23 01:20:40.649064 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1387/2790] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:40 2022] GET /compute/v2.1/servers/2fd0dd2b-4e96-4272-825b-5852451e3992 => generated 1318 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:40.690441 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9aee7b2a-7ab7-449d-a4ea-1909b3796eb5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:40.695855 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9aee7b2a-7ab7-449d-a4ea-1909b3796eb5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:40.707967 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9aee7b2a-7ab7-449d-a4ea-1909b3796eb5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:40.710717 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9aee7b2a-7ab7-449d-a4ea-1909b3796eb5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:40.712893 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9aee7b2a-7ab7-449d-a4ea-1909b3796eb5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:40.716918 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9aee7b2a-7ab7-449d-a4ea-1909b3796eb5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:40.717753 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9aee7b2a-7ab7-449d-a4ea-1909b3796eb5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:40.720238 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9aee7b2a-7ab7-449d-a4ea-1909b3796eb5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:41.268223 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9aee7b2a-7ab7-449d-a4ea-1909b3796eb5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:41.283778 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9aee7b2a-7ab7-449d-a4ea-1909b3796eb5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1527 microversion: 2.1 time: 0.630455 Oct 23 01:20:41.305289 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1388/2791] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:40 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1527 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:41.312557 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8abe3f5f-e178-465b-82d0-b072cf1f5e57 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:41.313548 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8abe3f5f-e178-465b-82d0-b072cf1f5e57 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:41.338586 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:20:41.340340 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8abe3f5f-e178-465b-82d0-b072cf1f5e57 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:41.344144 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8abe3f5f-e178-465b-82d0-b072cf1f5e57 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:41.344878 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8abe3f5f-e178-465b-82d0-b072cf1f5e57 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:41.349362 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8abe3f5f-e178-465b-82d0-b072cf1f5e57 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:41.351515 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8abe3f5f-e178-465b-82d0-b072cf1f5e57 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:41.354255 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8abe3f5f-e178-465b-82d0-b072cf1f5e57 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:41.535967 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8abe3f5f-e178-465b-82d0-b072cf1f5e57 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:41.561727 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8abe3f5f-e178-465b-82d0-b072cf1f5e57 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:41.563554 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8abe3f5f-e178-465b-82d0-b072cf1f5e57 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:41.587224 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8abe3f5f-e178-465b-82d0-b072cf1f5e57 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] 10.222.0.42 "GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334" status: 200 len: 1446 microversion: 2.75 time: 0.279647 Oct 23 01:20:41.590691 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1389/2792] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:20:41 2022] GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334 => generated 1446 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:20:41.605773 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-53b62219-908b-40e1-84da-a47d6c6e3607 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:41.607698 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-53b62219-908b-40e1-84da-a47d6c6e3607 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: be9a2687-233d-43c3-95b3-3a8b455595c7] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:41.616657 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-53b62219-908b-40e1-84da-a47d6c6e3607 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:41.623537 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-53b62219-908b-40e1-84da-a47d6c6e3607 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:41.623537 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-53b62219-908b-40e1-84da-a47d6c6e3607 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:41.623537 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-53b62219-908b-40e1-84da-a47d6c6e3607 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:41.623537 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-53b62219-908b-40e1-84da-a47d6c6e3607 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:41.623537 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-53b62219-908b-40e1-84da-a47d6c6e3607 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:41.652995 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-53b62219-908b-40e1-84da-a47d6c6e3607 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] HTTP exception thrown: Instance be9a2687-233d-43c3-95b3-3a8b455595c7 could not be found. Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-53b62219-908b-40e1-84da-a47d6c6e3607 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Request method failure captured: Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7 HTTP/1.1 Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJUfZCVXVkMS1oxq1YAiE8_rcVg9oiXHyz9jC68xBKkc_VTdXJeIi8SdyLyQDYRQBp4J5Pi7IKi-R-0TD7QfQlpZrg_PRVLwx1QzS_6nVtJj_1ZFFD2bz6tI5deH-6tSYBEMGiA_jmhO0uYEt6lNZX95QYuq4AbV3UNOqz3PgCuU88s Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: X-Openstack-Nova-Api-Version: 2.25 Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: ccc52d9ecfdf43f58b665d06e1008b52 Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1034616310 Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ccc52d9ecfdf43f58b665d06e1008b52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ccc52d9ecfdf43f58b665d06e1008b52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ccc52d9ecfdf43f58b665d06e1008b52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ccc52d9ecfdf43f58b665d06e1008b52"}]}] Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1034616310 Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: ccc52d9ecfdf43f58b665d06e1008b52 Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1034616310 Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-LiveAutoBlockMigrationV225Test-1034616310-project Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 8a246c84d8f444d59c9d5becae78f75a Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1034616310-project Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: exception: Instance be9a2687-233d-43c3-95b3-3a8b455595c7 could not be found. Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'be9a2687-233d-43c3-95b3-3a8b455595c7'} Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be9a2687-233d-43c3-95b3-3a8b455595c7 could not be found. Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be9a2687-233d-43c3-95b3-3a8b455595c7 could not be found. Oct 23 01:20:41.657153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:20:41.661823 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:20:41.661823 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:20:41.661823 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:20:41.661823 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:20:41.661823 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:20:41.661823 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:20:41.661823 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:20:41.661823 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be9a2687-233d-43c3-95b3-3a8b455595c7 could not be found. Oct 23 01:20:41.661823 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:20:41.663557 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-53b62219-908b-40e1-84da-a47d6c6e3607 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Returning 404 to user: Instance be9a2687-233d-43c3-95b3-3a8b455595c7 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:20:41.664841 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-53b62219-908b-40e1-84da-a47d6c6e3607 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7" status: 404 len: 111 microversion: 2.25 time: 0.071834 Oct 23 01:20:41.665991 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1390/2793] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:20:41 2022] GET /compute/v2.1/servers/be9a2687-233d-43c3-95b3-3a8b455595c7 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:20:41.671845 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-750b4240-f481-4fde-9fdc-74700cc03a49 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:41.672974 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-750b4240-f481-4fde-9fdc-74700cc03a49 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: ad3fdbf4-6dba-46a6-9132-e555185544b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:41.679881 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-750b4240-f481-4fde-9fdc-74700cc03a49 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:41.680643 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-750b4240-f481-4fde-9fdc-74700cc03a49 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:41.681245 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-750b4240-f481-4fde-9fdc-74700cc03a49 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:41.682402 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-750b4240-f481-4fde-9fdc-74700cc03a49 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:41.683302 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-750b4240-f481-4fde-9fdc-74700cc03a49 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:41.683923 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-750b4240-f481-4fde-9fdc-74700cc03a49 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:42.102557 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-750b4240-f481-4fde-9fdc-74700cc03a49 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:42.112626 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-750b4240-f481-4fde-9fdc-74700cc03a49 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0" status: 200 len: 1507 microversion: 2.1 time: 0.445208 Oct 23 01:20:42.126564 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1391/2794] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:41 2022] GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0 => generated 1507 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:42.137168 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6cb00c39-74d6-4151-8582-e49fe4262b81 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:42.137793 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6cb00c39-74d6-4151-8582-e49fe4262b81 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 2fd0dd2b-4e96-4272-825b-5852451e3992] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:42.144080 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6cb00c39-74d6-4151-8582-e49fe4262b81 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:42.144610 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6cb00c39-74d6-4151-8582-e49fe4262b81 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:42.145055 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6cb00c39-74d6-4151-8582-e49fe4262b81 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:42.145764 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6cb00c39-74d6-4151-8582-e49fe4262b81 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:42.149297 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6cb00c39-74d6-4151-8582-e49fe4262b81 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:42.149297 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6cb00c39-74d6-4151-8582-e49fe4262b81 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:42.372094 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6cb00c39-74d6-4151-8582-e49fe4262b81 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:42.386029 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6cb00c39-74d6-4151-8582-e49fe4262b81 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/2fd0dd2b-4e96-4272-825b-5852451e3992" status: 200 len: 1318 microversion: 2.1 time: 0.258218 Oct 23 01:20:42.394519 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1392/2795] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:42 2022] GET /compute/v2.1/servers/2fd0dd2b-4e96-4272-825b-5852451e3992 => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:42.399718 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-30ac8423-978f-41a7-8e5e-3a07dd58241b tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '.version_select at 0x7f5cc10baf70>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:42.474064 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-30ac8423-978f-41a7-8e5e-3a07dd58241b tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1250025057" status: 204 len: 0 microversion: 2.25 time: 0.078156 Oct 23 01:20:42.474663 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1393/2796] 10.222.0.42 () {60 vars in 1262 bytes} [Sun Oct 23 01:20:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1250025057 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 23 01:20:42.482260 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-713bb071-189c-4cc2-a805-a8b3abf19ab7 req-592f00ea-dd2e-460e-83f0-635f1f8fa5d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fd0dd2b-4e96-4272-825b-5852451e3992", "tag": "7605293d-a15a-43f7-8742-b49e8c14b9dc"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:20:42.511919 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-713bb071-189c-4cc2-a805-a8b3abf19ab7 req-592f00ea-dd2e-460e-83f0-635f1f8fa5d1 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:42.522385 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-713bb071-189c-4cc2-a805-a8b3abf19ab7 req-592f00ea-dd2e-460e-83f0-635f1f8fa5d1 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:42.523401 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-713bb071-189c-4cc2-a805-a8b3abf19ab7 req-592f00ea-dd2e-460e-83f0-635f1f8fa5d1 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:42.562236 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-713bb071-189c-4cc2-a805-a8b3abf19ab7 req-592f00ea-dd2e-460e-83f0-635f1f8fa5d1 service nova] Creating event network-changed:7605293d-a15a-43f7-8742-b49e8c14b9dc for instance 2fd0dd2b-4e96-4272-825b-5852451e3992 on n-h1-master-1 Oct 23 01:20:42.573170 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-713bb071-189c-4cc2-a805-a8b3abf19ab7 req-592f00ea-dd2e-460e-83f0-635f1f8fa5d1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097077 Oct 23 01:20:42.578437 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1394/2797] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:20:42.583836 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-07d1f60d-ed72-4d3d-ab04-26456fa0c32c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:42.584554 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-07d1f60d-ed72-4d3d-ab04-26456fa0c32c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:42.593462 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07d1f60d-ed72-4d3d-ab04-26456fa0c32c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:42.594263 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07d1f60d-ed72-4d3d-ab04-26456fa0c32c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:42.594899 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07d1f60d-ed72-4d3d-ab04-26456fa0c32c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:42.595824 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07d1f60d-ed72-4d3d-ab04-26456fa0c32c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:42.596695 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07d1f60d-ed72-4d3d-ab04-26456fa0c32c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:42.597384 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07d1f60d-ed72-4d3d-ab04-26456fa0c32c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:42.862354 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-07d1f60d-ed72-4d3d-ab04-26456fa0c32c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:42.878286 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-07d1f60d-ed72-4d3d-ab04-26456fa0c32c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1527 microversion: 2.1 time: 0.298526 Oct 23 01:20:42.898918 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1395/2798] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:42 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1527 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:42.909598 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dcfeb77a-0891-48d5-b07e-4a1b284ebbff tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:42.920150 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-dcfeb77a-0891-48d5-b07e-4a1b284ebbff tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:42.926640 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dcfeb77a-0891-48d5-b07e-4a1b284ebbff tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:42.927139 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dcfeb77a-0891-48d5-b07e-4a1b284ebbff tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:42.928108 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dcfeb77a-0891-48d5-b07e-4a1b284ebbff tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:42.930163 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dcfeb77a-0891-48d5-b07e-4a1b284ebbff tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:42.932654 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dcfeb77a-0891-48d5-b07e-4a1b284ebbff tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:42.933275 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dcfeb77a-0891-48d5-b07e-4a1b284ebbff tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:43.131561 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-dcfeb77a-0891-48d5-b07e-4a1b284ebbff tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:43.145162 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-dcfeb77a-0891-48d5-b07e-4a1b284ebbff tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:43.153070 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-dcfeb77a-0891-48d5-b07e-4a1b284ebbff tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:43.177202 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-dcfeb77a-0891-48d5-b07e-4a1b284ebbff tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] 10.222.0.42 "GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334" status: 200 len: 1446 microversion: 2.75 time: 0.275107 Oct 23 01:20:43.177202 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1396/2799] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:20:42 2022] GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334 => generated 1446 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:20:43.190344 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8937da2b-876a-45ac-95ec-ef70b2409f89 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:43.191942 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8937da2b-876a-45ac-95ec-ef70b2409f89 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: ad3fdbf4-6dba-46a6-9132-e555185544b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:43.205665 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8937da2b-876a-45ac-95ec-ef70b2409f89 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:43.206346 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8937da2b-876a-45ac-95ec-ef70b2409f89 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:43.206909 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8937da2b-876a-45ac-95ec-ef70b2409f89 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:43.208374 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8937da2b-876a-45ac-95ec-ef70b2409f89 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:43.208895 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8937da2b-876a-45ac-95ec-ef70b2409f89 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:43.209346 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8937da2b-876a-45ac-95ec-ef70b2409f89 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:43.428698 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8937da2b-876a-45ac-95ec-ef70b2409f89 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:43.438950 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8937da2b-876a-45ac-95ec-ef70b2409f89 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0" status: 200 len: 1507 microversion: 2.1 time: 0.261772 Oct 23 01:20:43.453031 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1397/2800] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:43 2022] GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0 => generated 1507 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:43.463058 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-886b7585-3325-4143-856a-6d052dd80517 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:43.463694 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-886b7585-3325-4143-856a-6d052dd80517 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 2fd0dd2b-4e96-4272-825b-5852451e3992] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:43.486685 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-886b7585-3325-4143-856a-6d052dd80517 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:43.487592 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-886b7585-3325-4143-856a-6d052dd80517 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:43.496615 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-886b7585-3325-4143-856a-6d052dd80517 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:43.498365 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-886b7585-3325-4143-856a-6d052dd80517 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:43.499400 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-886b7585-3325-4143-856a-6d052dd80517 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:43.500174 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-886b7585-3325-4143-856a-6d052dd80517 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:43.877284 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-886b7585-3325-4143-856a-6d052dd80517 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:43.886623 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-886b7585-3325-4143-856a-6d052dd80517 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/2fd0dd2b-4e96-4272-825b-5852451e3992" status: 200 len: 1318 microversion: 2.1 time: 0.432121 Oct 23 01:20:43.890518 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1398/2801] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:43 2022] GET /compute/v2.1/servers/2fd0dd2b-4e96-4272-825b-5852451e3992 => generated 1318 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:43.911918 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0b8e6bde-6da8-4a2a-99f7-6920cbec6dc8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:43.912549 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0b8e6bde-6da8-4a2a-99f7-6920cbec6dc8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:43.919384 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b8e6bde-6da8-4a2a-99f7-6920cbec6dc8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:43.919905 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b8e6bde-6da8-4a2a-99f7-6920cbec6dc8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:43.920347 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b8e6bde-6da8-4a2a-99f7-6920cbec6dc8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:43.922943 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b8e6bde-6da8-4a2a-99f7-6920cbec6dc8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:43.923505 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b8e6bde-6da8-4a2a-99f7-6920cbec6dc8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:43.924304 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b8e6bde-6da8-4a2a-99f7-6920cbec6dc8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:44.236799 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0b8e6bde-6da8-4a2a-99f7-6920cbec6dc8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:44.240022 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0b8e6bde-6da8-4a2a-99f7-6920cbec6dc8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1527 microversion: 2.1 time: 0.332230 Oct 23 01:20:44.240963 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1399/2802] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:43 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1527 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:44.254568 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-682e7b86-31c7-4e1b-b32f-3ea70767330c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:44.255648 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-682e7b86-31c7-4e1b-b32f-3ea70767330c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 8db307a5-7a1e-4791-8fa9-e934894238e9] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:44.261790 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-682e7b86-31c7-4e1b-b32f-3ea70767330c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:44.262531 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-682e7b86-31c7-4e1b-b32f-3ea70767330c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:44.263207 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-682e7b86-31c7-4e1b-b32f-3ea70767330c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:44.264066 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-682e7b86-31c7-4e1b-b32f-3ea70767330c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:44.264659 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-682e7b86-31c7-4e1b-b32f-3ea70767330c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:44.265220 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-682e7b86-31c7-4e1b-b32f-3ea70767330c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:44.304800 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-682e7b86-31c7-4e1b-b32f-3ea70767330c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 8db307a5-7a1e-4791-8fa9-e934894238e9] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:20:44.812052 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-682e7b86-31c7-4e1b-b32f-3ea70767330c tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9" status: 204 len: 0 microversion: 2.25 time: 0.569629 Oct 23 01:20:44.812729 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1400/2803] 10.222.0.42 () {60 vars in 1280 bytes} [Sun Oct 23 01:20:44 2022] DELETE /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 23 01:20:44.818210 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-41399002-91ef-4cba-81b0-810ac830b598 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:44.820874 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-41399002-91ef-4cba-81b0-810ac830b598 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:44.828183 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41399002-91ef-4cba-81b0-810ac830b598 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:44.828939 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41399002-91ef-4cba-81b0-810ac830b598 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:44.829545 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41399002-91ef-4cba-81b0-810ac830b598 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:44.830456 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41399002-91ef-4cba-81b0-810ac830b598 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:44.831109 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41399002-91ef-4cba-81b0-810ac830b598 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:44.831686 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41399002-91ef-4cba-81b0-810ac830b598 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:44.939396 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-41399002-91ef-4cba-81b0-810ac830b598 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:44.950650 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-41399002-91ef-4cba-81b0-810ac830b598 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:44.952838 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-41399002-91ef-4cba-81b0-810ac830b598 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:44.958604 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-41399002-91ef-4cba-81b0-810ac830b598 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] 10.222.0.42 "GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334" status: 200 len: 1446 microversion: 2.75 time: 0.144799 Oct 23 01:20:44.959360 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1401/2804] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:20:44 2022] GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334 => generated 1446 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:20:44.963949 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-02c9fbd4-4544-42a9-832b-8b134b6b6067 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:44.964562 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-02c9fbd4-4544-42a9-832b-8b134b6b6067 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: ad3fdbf4-6dba-46a6-9132-e555185544b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:44.970697 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-02c9fbd4-4544-42a9-832b-8b134b6b6067 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:44.971192 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-02c9fbd4-4544-42a9-832b-8b134b6b6067 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:44.971639 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-02c9fbd4-4544-42a9-832b-8b134b6b6067 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:44.972342 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-02c9fbd4-4544-42a9-832b-8b134b6b6067 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:44.972801 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-02c9fbd4-4544-42a9-832b-8b134b6b6067 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:44.973231 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-02c9fbd4-4544-42a9-832b-8b134b6b6067 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:45.209752 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-02c9fbd4-4544-42a9-832b-8b134b6b6067 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:45.222667 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-02c9fbd4-4544-42a9-832b-8b134b6b6067 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0" status: 200 len: 1507 microversion: 2.1 time: 0.261334 Oct 23 01:20:45.222667 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1402/2805] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:44 2022] GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0 => generated 1507 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:45.233267 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3aafe0b0-ee74-4d19-9315-3c89f186127f tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:45.236020 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3aafe0b0-ee74-4d19-9315-3c89f186127f tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 8db307a5-7a1e-4791-8fa9-e934894238e9] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:45.244684 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3aafe0b0-ee74-4d19-9315-3c89f186127f tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:45.248297 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3aafe0b0-ee74-4d19-9315-3c89f186127f tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:45.249394 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3aafe0b0-ee74-4d19-9315-3c89f186127f tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:45.250479 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3aafe0b0-ee74-4d19-9315-3c89f186127f tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:45.251244 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3aafe0b0-ee74-4d19-9315-3c89f186127f tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:45.254687 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3aafe0b0-ee74-4d19-9315-3c89f186127f tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:45.332295 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:20:45.696386 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3aafe0b0-ee74-4d19-9315-3c89f186127f tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:45.709760 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3aafe0b0-ee74-4d19-9315-3c89f186127f tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:45.710035 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3aafe0b0-ee74-4d19-9315-3c89f186127f tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:45.721093 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3aafe0b0-ee74-4d19-9315-3c89f186127f tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9" status: 200 len: 1549 microversion: 2.25 time: 0.497540 Oct 23 01:20:45.734219 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1403/2806] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:20:45 2022] GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9 => generated 1549 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:20:45.734219 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2dabe437-05e4-49f4-8c06-3cc60ef49d6f tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:45.734219 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2dabe437-05e4-49f4-8c06-3cc60ef49d6f tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 2fd0dd2b-4e96-4272-825b-5852451e3992] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:45.743059 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2dabe437-05e4-49f4-8c06-3cc60ef49d6f tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:45.743059 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2dabe437-05e4-49f4-8c06-3cc60ef49d6f tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:45.743443 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2dabe437-05e4-49f4-8c06-3cc60ef49d6f tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:45.747918 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2dabe437-05e4-49f4-8c06-3cc60ef49d6f tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:45.748419 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2dabe437-05e4-49f4-8c06-3cc60ef49d6f tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:45.748932 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2dabe437-05e4-49f4-8c06-3cc60ef49d6f tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:46.289511 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2dabe437-05e4-49f4-8c06-3cc60ef49d6f tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:46.297716 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2dabe437-05e4-49f4-8c06-3cc60ef49d6f tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/2fd0dd2b-4e96-4272-825b-5852451e3992" status: 200 len: 1318 microversion: 2.1 time: 0.571538 Oct 23 01:20:46.298555 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1404/2807] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:45 2022] GET /compute/v2.1/servers/2fd0dd2b-4e96-4272-825b-5852451e3992 => generated 1318 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:46.303185 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9bb48b18-5293-4009-bcbd-219e160f1c42 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:46.303822 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9bb48b18-5293-4009-bcbd-219e160f1c42 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:46.328812 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9bb48b18-5293-4009-bcbd-219e160f1c42 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:46.329332 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9bb48b18-5293-4009-bcbd-219e160f1c42 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:46.329773 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9bb48b18-5293-4009-bcbd-219e160f1c42 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:46.330527 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9bb48b18-5293-4009-bcbd-219e160f1c42 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:46.330971 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9bb48b18-5293-4009-bcbd-219e160f1c42 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:46.331402 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9bb48b18-5293-4009-bcbd-219e160f1c42 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:46.620241 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9bb48b18-5293-4009-bcbd-219e160f1c42 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:46.632864 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9bb48b18-5293-4009-bcbd-219e160f1c42 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1527 microversion: 2.1 time: 0.331187 Oct 23 01:20:46.635808 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1405/2808] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:46 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1527 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:46.650011 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0bb49d4e-d43c-4ee9-b2bc-b18cefaeb20e tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:46.655449 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0bb49d4e-d43c-4ee9-b2bc-b18cefaeb20e tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:46.668067 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0bb49d4e-d43c-4ee9-b2bc-b18cefaeb20e tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:46.668582 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0bb49d4e-d43c-4ee9-b2bc-b18cefaeb20e tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:46.669030 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0bb49d4e-d43c-4ee9-b2bc-b18cefaeb20e tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:46.669779 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0bb49d4e-d43c-4ee9-b2bc-b18cefaeb20e tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:46.670512 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0bb49d4e-d43c-4ee9-b2bc-b18cefaeb20e tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:46.670960 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0bb49d4e-d43c-4ee9-b2bc-b18cefaeb20e tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:46.776968 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0bb49d4e-d43c-4ee9-b2bc-b18cefaeb20e tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:46.791951 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0bb49d4e-d43c-4ee9-b2bc-b18cefaeb20e tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:46.793778 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0bb49d4e-d43c-4ee9-b2bc-b18cefaeb20e tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:46.805611 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0bb49d4e-d43c-4ee9-b2bc-b18cefaeb20e tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] 10.222.0.42 "GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334" status: 200 len: 1446 microversion: 2.75 time: 0.168664 Oct 23 01:20:46.806450 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1406/2809] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:20:46 2022] GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334 => generated 1446 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:20:46.821383 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-15d2186d-a970-4d09-bed7-d32fc4000caf tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:46.822041 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-15d2186d-a970-4d09-bed7-d32fc4000caf tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: ad3fdbf4-6dba-46a6-9132-e555185544b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:46.849314 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15d2186d-a970-4d09-bed7-d32fc4000caf tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:46.850164 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15d2186d-a970-4d09-bed7-d32fc4000caf tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:46.850847 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15d2186d-a970-4d09-bed7-d32fc4000caf tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:46.851900 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15d2186d-a970-4d09-bed7-d32fc4000caf tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:46.855562 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15d2186d-a970-4d09-bed7-d32fc4000caf tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:46.856142 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15d2186d-a970-4d09-bed7-d32fc4000caf tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:47.188891 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-15d2186d-a970-4d09-bed7-d32fc4000caf tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:47.203589 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-15d2186d-a970-4d09-bed7-d32fc4000caf tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0" status: 200 len: 1507 microversion: 2.1 time: 0.394701 Oct 23 01:20:47.204610 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1407/2810] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:46 2022] GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0 => generated 1507 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:47.215097 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-12899f08-5d6d-4beb-9e32-28ff593a0d7a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:47.218587 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-12899f08-5d6d-4beb-9e32-28ff593a0d7a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 8db307a5-7a1e-4791-8fa9-e934894238e9] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:47.237180 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-12899f08-5d6d-4beb-9e32-28ff593a0d7a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:47.238775 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-12899f08-5d6d-4beb-9e32-28ff593a0d7a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:47.241433 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-12899f08-5d6d-4beb-9e32-28ff593a0d7a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:47.241744 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-12899f08-5d6d-4beb-9e32-28ff593a0d7a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:47.243506 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-12899f08-5d6d-4beb-9e32-28ff593a0d7a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:47.243964 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-12899f08-5d6d-4beb-9e32-28ff593a0d7a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:47.388859 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-12899f08-5d6d-4beb-9e32-28ff593a0d7a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:47.413596 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-12899f08-5d6d-4beb-9e32-28ff593a0d7a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:47.418022 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-12899f08-5d6d-4beb-9e32-28ff593a0d7a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:47.421884 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-12899f08-5d6d-4beb-9e32-28ff593a0d7a tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9" status: 200 len: 1331 microversion: 2.25 time: 0.213280 Oct 23 01:20:47.439471 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1408/2811] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:20:47 2022] GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9 => generated 1331 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:20:47.449239 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-11281d47-afdd-43c9-9a79-ded101e9791c req-897ff9e4-194e-4497-a4ae-4eaa2cf8aa41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8db307a5-7a1e-4791-8fa9-e934894238e9", "name": "network-vif-deleted", "tag": "7328ae33-f6ec-49e1-9744-c0a7a6f75e28"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:20:47.465337 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-11281d47-afdd-43c9-9a79-ded101e9791c req-897ff9e4-194e-4497-a4ae-4eaa2cf8aa41 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:47.467895 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-11281d47-afdd-43c9-9a79-ded101e9791c req-897ff9e4-194e-4497-a4ae-4eaa2cf8aa41 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:47.470196 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-11281d47-afdd-43c9-9a79-ded101e9791c req-897ff9e4-194e-4497-a4ae-4eaa2cf8aa41 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:47.521055 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-11281d47-afdd-43c9-9a79-ded101e9791c req-897ff9e4-194e-4497-a4ae-4eaa2cf8aa41 service nova] Creating event network-vif-deleted:7328ae33-f6ec-49e1-9744-c0a7a6f75e28 for instance 8db307a5-7a1e-4791-8fa9-e934894238e9 on n-h1-master-1 Oct 23 01:20:47.533011 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-11281d47-afdd-43c9-9a79-ded101e9791c req-897ff9e4-194e-4497-a4ae-4eaa2cf8aa41 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091044 Oct 23 01:20:47.536373 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1409/2812] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:20:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:20:47.548455 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2a9caca4-e1e9-432a-89c7-dc612138eebd tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:47.550523 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2a9caca4-e1e9-432a-89c7-dc612138eebd tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 2fd0dd2b-4e96-4272-825b-5852451e3992] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:47.566874 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a9caca4-e1e9-432a-89c7-dc612138eebd tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:47.568193 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a9caca4-e1e9-432a-89c7-dc612138eebd tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:47.573258 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a9caca4-e1e9-432a-89c7-dc612138eebd tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:47.574125 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a9caca4-e1e9-432a-89c7-dc612138eebd tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:47.575442 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a9caca4-e1e9-432a-89c7-dc612138eebd tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:47.575925 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a9caca4-e1e9-432a-89c7-dc612138eebd tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:47.893186 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2a9caca4-e1e9-432a-89c7-dc612138eebd tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:47.914673 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2a9caca4-e1e9-432a-89c7-dc612138eebd tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/2fd0dd2b-4e96-4272-825b-5852451e3992" status: 200 len: 1318 microversion: 2.1 time: 0.374637 Oct 23 01:20:47.914673 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1410/2813] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:47 2022] GET /compute/v2.1/servers/2fd0dd2b-4e96-4272-825b-5852451e3992 => generated 1318 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:47.926197 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-efa8e2a6-2eb1-461c-8e24-f489d2521211 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:47.927022 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-efa8e2a6-2eb1-461c-8e24-f489d2521211 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:47.938968 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-efa8e2a6-2eb1-461c-8e24-f489d2521211 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:47.938968 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-efa8e2a6-2eb1-461c-8e24-f489d2521211 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:47.939394 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-efa8e2a6-2eb1-461c-8e24-f489d2521211 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:47.940187 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-efa8e2a6-2eb1-461c-8e24-f489d2521211 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:47.940714 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-efa8e2a6-2eb1-461c-8e24-f489d2521211 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:47.941212 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-efa8e2a6-2eb1-461c-8e24-f489d2521211 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:48.168701 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-efa8e2a6-2eb1-461c-8e24-f489d2521211 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:48.182863 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-efa8e2a6-2eb1-461c-8e24-f489d2521211 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1527 microversion: 2.1 time: 0.267323 Oct 23 01:20:48.183827 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1411/2814] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:47 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1527 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:48.203432 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-01c28d5a-52bf-425f-a324-2caff9f65cf3 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:48.205352 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-01c28d5a-52bf-425f-a324-2caff9f65cf3 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:48.233453 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01c28d5a-52bf-425f-a324-2caff9f65cf3 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:48.233453 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01c28d5a-52bf-425f-a324-2caff9f65cf3 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:48.233453 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01c28d5a-52bf-425f-a324-2caff9f65cf3 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:48.233453 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01c28d5a-52bf-425f-a324-2caff9f65cf3 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:48.233453 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01c28d5a-52bf-425f-a324-2caff9f65cf3 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:48.233453 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01c28d5a-52bf-425f-a324-2caff9f65cf3 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:48.261068 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-62aba7b7-a74b-4ab0-b19e-4e1029eba04f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "POST /compute/v2.1/servers/9a64ad71-9caf-4645-be7a-b56f8f584c2d/action" status: 202 len: 0 microversion: 2.1 time: 8.924274 Oct 23 01:20:48.263725 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1404/2815] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:20:39 2022] POST /compute/v2.1/servers/9a64ad71-9caf-4645-be7a-b56f8f584c2d/action => generated 0 bytes in 8928 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 23 01:20:48.276547 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-99d47d53-cdb3-4689-8a62-dcbad4742cde tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:48.281025 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-99d47d53-cdb3-4689-8a62-dcbad4742cde tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: ad3fdbf4-6dba-46a6-9132-e555185544b0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:48.310679 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-99d47d53-cdb3-4689-8a62-dcbad4742cde tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:48.320102 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-99d47d53-cdb3-4689-8a62-dcbad4742cde tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:48.320102 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-99d47d53-cdb3-4689-8a62-dcbad4742cde tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:48.321958 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-99d47d53-cdb3-4689-8a62-dcbad4742cde tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:48.323654 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-99d47d53-cdb3-4689-8a62-dcbad4742cde tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:48.324333 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-99d47d53-cdb3-4689-8a62-dcbad4742cde tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:48.508797 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-01c28d5a-52bf-425f-a324-2caff9f65cf3 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:48.529821 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-01c28d5a-52bf-425f-a324-2caff9f65cf3 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:48.538807 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-01c28d5a-52bf-425f-a324-2caff9f65cf3 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:48.556054 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-01c28d5a-52bf-425f-a324-2caff9f65cf3 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] 10.222.0.42 "GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334" status: 200 len: 1446 microversion: 2.75 time: 0.371025 Oct 23 01:20:48.558155 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1412/2816] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:20:48 2022] GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334 => generated 1446 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:20:48.566646 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-87c81bcd-6c37-4eae-8fca-ff3786cc9a82 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc10d7e50>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:48.669082 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-87c81bcd-6c37-4eae-8fca-ff3786cc9a82 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/d8995b1c-6b8e-4df7-b6c6-6372dcfaadbd" status: 200 len: 1413 microversion: 2.1 time: 0.109666 Oct 23 01:20:48.678395 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1413/2817] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:20:48 2022] GET /compute/v2.1/images/d8995b1c-6b8e-4df7-b6c6-6372dcfaadbd => generated 1413 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:48.679533 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-593de44f-72c4-41b6-96ef-8399909605c5 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:48.680228 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-593de44f-72c4-41b6-96ef-8399909605c5 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 8db307a5-7a1e-4791-8fa9-e934894238e9] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:48.687274 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-593de44f-72c4-41b6-96ef-8399909605c5 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:48.687830 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-593de44f-72c4-41b6-96ef-8399909605c5 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:48.688282 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-593de44f-72c4-41b6-96ef-8399909605c5 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:48.689457 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-593de44f-72c4-41b6-96ef-8399909605c5 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:48.689877 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-593de44f-72c4-41b6-96ef-8399909605c5 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:48.691288 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-593de44f-72c4-41b6-96ef-8399909605c5 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:48.846268 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-593de44f-72c4-41b6-96ef-8399909605c5 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:48.846778 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-593de44f-72c4-41b6-96ef-8399909605c5 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:48.847228 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-593de44f-72c4-41b6-96ef-8399909605c5 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:48.847693 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-593de44f-72c4-41b6-96ef-8399909605c5 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lazy-loading 'fault' on Instance uuid 8db307a5-7a1e-4791-8fa9-e934894238e9 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:20:48.876575 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-99d47d53-cdb3-4689-8a62-dcbad4742cde tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:48.889252 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-99d47d53-cdb3-4689-8a62-dcbad4742cde tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0" status: 200 len: 1507 microversion: 2.1 time: 0.622183 Oct 23 01:20:48.901027 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1405/2818] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:48 2022] GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0 => generated 1507 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:48.921907 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-f8f49e5f-940a-486c-9c2d-09582e037356 req-feddedee-3855-42ff-ac37-a3fc10134c48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fd0dd2b-4e96-4272-825b-5852451e3992", "name": "network-vif-plugged", "status": "completed", "tag": "7605293d-a15a-43f7-8742-b49e8c14b9dc"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:20:48.932775 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:20:48.956532 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-f8f49e5f-940a-486c-9c2d-09582e037356 req-feddedee-3855-42ff-ac37-a3fc10134c48 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:48.962403 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-f8f49e5f-940a-486c-9c2d-09582e037356 req-feddedee-3855-42ff-ac37-a3fc10134c48 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:48.962926 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-f8f49e5f-940a-486c-9c2d-09582e037356 req-feddedee-3855-42ff-ac37-a3fc10134c48 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:48.986485 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-593de44f-72c4-41b6-96ef-8399909605c5 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:49.008762 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-593de44f-72c4-41b6-96ef-8399909605c5 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:49.009470 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-f8f49e5f-940a-486c-9c2d-09582e037356 req-feddedee-3855-42ff-ac37-a3fc10134c48 service nova] Creating event network-vif-plugged:7605293d-a15a-43f7-8742-b49e8c14b9dc for instance 2fd0dd2b-4e96-4272-825b-5852451e3992 on n-h1-master-1 Oct 23 01:20:49.014426 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-593de44f-72c4-41b6-96ef-8399909605c5 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:49.015820 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-593de44f-72c4-41b6-96ef-8399909605c5 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9" status: 200 len: 1351 microversion: 2.25 time: 0.343929 Oct 23 01:20:49.016107 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-f8f49e5f-940a-486c-9c2d-09582e037356 req-feddedee-3855-42ff-ac37-a3fc10134c48 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105186 Oct 23 01:20:49.017238 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1406/2819] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:20:49.018129 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1414/2820] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:20:48 2022] GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9 => generated 1351 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:20:49.031802 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5e81bbfd-4698-4b55-be88-1bd67f4d9cb0 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:49.032772 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5e81bbfd-4698-4b55-be88-1bd67f4d9cb0 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 2fd0dd2b-4e96-4272-825b-5852451e3992] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:49.047479 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e81bbfd-4698-4b55-be88-1bd67f4d9cb0 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:49.047863 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e81bbfd-4698-4b55-be88-1bd67f4d9cb0 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:49.048337 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e81bbfd-4698-4b55-be88-1bd67f4d9cb0 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:49.049041 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e81bbfd-4698-4b55-be88-1bd67f4d9cb0 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:49.049834 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e81bbfd-4698-4b55-be88-1bd67f4d9cb0 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:49.050293 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e81bbfd-4698-4b55-be88-1bd67f4d9cb0 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:49.214780 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-96735868-8a28-4ee0-aebb-7c5be83edc92 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:49.214780 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-96735868-8a28-4ee0-aebb-7c5be83edc92 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:49.226191 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-96735868-8a28-4ee0-aebb-7c5be83edc92 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:49.226844 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-96735868-8a28-4ee0-aebb-7c5be83edc92 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:49.228461 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-96735868-8a28-4ee0-aebb-7c5be83edc92 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:49.229424 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-96735868-8a28-4ee0-aebb-7c5be83edc92 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:49.230180 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-96735868-8a28-4ee0-aebb-7c5be83edc92 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:49.230728 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-96735868-8a28-4ee0-aebb-7c5be83edc92 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:49.281908 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5e81bbfd-4698-4b55-be88-1bd67f4d9cb0 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:49.291144 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5e81bbfd-4698-4b55-be88-1bd67f4d9cb0 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/2fd0dd2b-4e96-4272-825b-5852451e3992" status: 200 len: 1318 microversion: 2.1 time: 0.271695 Oct 23 01:20:49.296235 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1407/2821] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:49 2022] GET /compute/v2.1/servers/2fd0dd2b-4e96-4272-825b-5852451e3992 => generated 1318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:49.434532 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-96735868-8a28-4ee0-aebb-7c5be83edc92 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:49.448660 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-96735868-8a28-4ee0-aebb-7c5be83edc92 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1527 microversion: 2.1 time: 0.241694 Oct 23 01:20:49.466806 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1415/2822] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:49 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1527 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:20:49.591703 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9c4372e4-783e-4d47-91e2-51d62c1707b8 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:49.593075 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9c4372e4-783e-4d47-91e2-51d62c1707b8 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:49.611585 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9c4372e4-783e-4d47-91e2-51d62c1707b8 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:49.612512 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9c4372e4-783e-4d47-91e2-51d62c1707b8 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:49.613153 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9c4372e4-783e-4d47-91e2-51d62c1707b8 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:49.615658 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9c4372e4-783e-4d47-91e2-51d62c1707b8 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:49.616361 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9c4372e4-783e-4d47-91e2-51d62c1707b8 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:49.618558 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9c4372e4-783e-4d47-91e2-51d62c1707b8 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:49.686761 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e20096b2-35d3-4de5-8f9e-ccec1f430b7e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc613ed30>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:49.761907 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e20096b2-35d3-4de5-8f9e-ccec1f430b7e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/d8995b1c-6b8e-4df7-b6c6-6372dcfaadbd" status: 200 len: 1413 microversion: 2.1 time: 0.078135 Oct 23 01:20:49.762559 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1416/2823] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:20:49 2022] GET /compute/v2.1/images/d8995b1c-6b8e-4df7-b6c6-6372dcfaadbd => generated 1413 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:49.806760 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9c4372e4-783e-4d47-91e2-51d62c1707b8 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:49.816935 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9c4372e4-783e-4d47-91e2-51d62c1707b8 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:49.818538 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9c4372e4-783e-4d47-91e2-51d62c1707b8 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:49.828544 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9c4372e4-783e-4d47-91e2-51d62c1707b8 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] 10.222.0.42 "GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334" status: 200 len: 1446 microversion: 2.75 time: 0.243009 Oct 23 01:20:49.832746 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1408/2824] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:20:49 2022] GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334 => generated 1446 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:20:49.936803 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d2448394-ce88-45e8-863c-9c5413867ed4 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:49.940213 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d2448394-ce88-45e8-863c-9c5413867ed4 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: ad3fdbf4-6dba-46a6-9132-e555185544b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:49.954508 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d2448394-ce88-45e8-863c-9c5413867ed4 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:49.956039 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d2448394-ce88-45e8-863c-9c5413867ed4 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:49.956700 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d2448394-ce88-45e8-863c-9c5413867ed4 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:49.957613 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d2448394-ce88-45e8-863c-9c5413867ed4 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:49.958323 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d2448394-ce88-45e8-863c-9c5413867ed4 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:49.959923 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d2448394-ce88-45e8-863c-9c5413867ed4 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:50.042714 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3c83d6db-e501-42cf-9017-a9c885f0e0ae tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:50.043446 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3c83d6db-e501-42cf-9017-a9c885f0e0ae tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 8db307a5-7a1e-4791-8fa9-e934894238e9] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:50.058695 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c83d6db-e501-42cf-9017-a9c885f0e0ae tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:50.063365 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c83d6db-e501-42cf-9017-a9c885f0e0ae tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:50.063895 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c83d6db-e501-42cf-9017-a9c885f0e0ae tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:50.067117 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c83d6db-e501-42cf-9017-a9c885f0e0ae tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:50.069740 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c83d6db-e501-42cf-9017-a9c885f0e0ae tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:50.072794 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c83d6db-e501-42cf-9017-a9c885f0e0ae tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:50.102580 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-3c83d6db-e501-42cf-9017-a9c885f0e0ae tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] HTTP exception thrown: Instance 8db307a5-7a1e-4791-8fa9-e934894238e9 could not be found. Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3c83d6db-e501-42cf-9017-a9c885f0e0ae tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Request method failure captured: Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9 HTTP/1.1 Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJUfZCVXVkMS1oxq1YAiE8_rcVg9oiXHyz9jC68xBKkc_VTdXJeIi8SdyLyQDYRQBp4J5Pi7IKi-R-0TD7QfQlpZrg_PRVLwx1QzS_6nVtJj_1ZFFD2bz6tI5deH-6tSYBEMGiA_jmhO0uYEt6lNZX95QYuq4AbV3UNOqz3PgCuU88s Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: X-Openstack-Nova-Api-Version: 2.25 Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: ccc52d9ecfdf43f58b665d06e1008b52 Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1034616310 Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ccc52d9ecfdf43f58b665d06e1008b52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ccc52d9ecfdf43f58b665d06e1008b52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ccc52d9ecfdf43f58b665d06e1008b52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ccc52d9ecfdf43f58b665d06e1008b52"}]}] Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1034616310 Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: ccc52d9ecfdf43f58b665d06e1008b52 Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1034616310 Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-LiveAutoBlockMigrationV225Test-1034616310-project Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 8a246c84d8f444d59c9d5becae78f75a Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1034616310-project Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 8db307a5-7a1e-4791-8fa9-e934894238e9 could not be found. Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '8db307a5-7a1e-4791-8fa9-e934894238e9'} Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8db307a5-7a1e-4791-8fa9-e934894238e9 could not be found. Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8db307a5-7a1e-4791-8fa9-e934894238e9 could not be found. Oct 23 01:20:50.104542 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:20:50.113645 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:20:50.113645 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:20:50.113645 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:20:50.113645 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:20:50.113645 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:20:50.113645 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:20:50.113645 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:20:50.113645 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8db307a5-7a1e-4791-8fa9-e934894238e9 could not be found. Oct 23 01:20:50.113645 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:20:50.113645 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3c83d6db-e501-42cf-9017-a9c885f0e0ae tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Returning 404 to user: Instance 8db307a5-7a1e-4791-8fa9-e934894238e9 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:20:50.113645 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3c83d6db-e501-42cf-9017-a9c885f0e0ae tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9" status: 404 len: 111 microversion: 2.25 time: 0.067466 Oct 23 01:20:50.113645 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1409/2825] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:20:50 2022] GET /compute/v2.1/servers/8db307a5-7a1e-4791-8fa9-e934894238e9 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:20:50.120749 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b7150a1b-720c-4275-ae6f-8523b78b0e97 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:50.121431 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b7150a1b-720c-4275-ae6f-8523b78b0e97 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 283de315-fdcb-4c89-91e3-96aa3e822b21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:50.132428 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b7150a1b-720c-4275-ae6f-8523b78b0e97 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:50.132428 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b7150a1b-720c-4275-ae6f-8523b78b0e97 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:50.132752 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b7150a1b-720c-4275-ae6f-8523b78b0e97 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:50.133689 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b7150a1b-720c-4275-ae6f-8523b78b0e97 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:50.134284 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b7150a1b-720c-4275-ae6f-8523b78b0e97 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:50.134927 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b7150a1b-720c-4275-ae6f-8523b78b0e97 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:50.206701 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b7150a1b-720c-4275-ae6f-8523b78b0e97 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 283de315-fdcb-4c89-91e3-96aa3e822b21] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:20:50.235020 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d2448394-ce88-45e8-863c-9c5413867ed4 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:50.246871 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d2448394-ce88-45e8-863c-9c5413867ed4 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0" status: 200 len: 1507 microversion: 2.1 time: 0.320721 Oct 23 01:20:50.252963 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1417/2826] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:49 2022] GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0 => generated 1507 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:50.316872 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e99b48a5-743a-428b-94fb-4f0f8279e28b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:50.318099 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e99b48a5-743a-428b-94fb-4f0f8279e28b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 2fd0dd2b-4e96-4272-825b-5852451e3992] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:50.326839 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e99b48a5-743a-428b-94fb-4f0f8279e28b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:50.330706 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e99b48a5-743a-428b-94fb-4f0f8279e28b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:50.331413 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e99b48a5-743a-428b-94fb-4f0f8279e28b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:50.332363 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e99b48a5-743a-428b-94fb-4f0f8279e28b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:50.333016 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e99b48a5-743a-428b-94fb-4f0f8279e28b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:50.333770 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e99b48a5-743a-428b-94fb-4f0f8279e28b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:50.610907 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b7150a1b-720c-4275-ae6f-8523b78b0e97 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "DELETE /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21" status: 204 len: 0 microversion: 2.25 time: 0.492764 Oct 23 01:20:50.616522 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1410/2827] 10.222.0.42 () {60 vars in 1280 bytes} [Sun Oct 23 01:20:50 2022] DELETE /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 23 01:20:50.632606 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-be7d492a-e23c-41fb-8fe9-801945d853c2 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:50.635114 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-be7d492a-e23c-41fb-8fe9-801945d853c2 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:50.659326 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-be7d492a-e23c-41fb-8fe9-801945d853c2 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:50.660902 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-be7d492a-e23c-41fb-8fe9-801945d853c2 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:50.662479 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-be7d492a-e23c-41fb-8fe9-801945d853c2 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:50.668217 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-be7d492a-e23c-41fb-8fe9-801945d853c2 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:50.668217 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-be7d492a-e23c-41fb-8fe9-801945d853c2 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:50.668217 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-be7d492a-e23c-41fb-8fe9-801945d853c2 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:50.677377 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:20:50.862560 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e99b48a5-743a-428b-94fb-4f0f8279e28b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:50.874999 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e99b48a5-743a-428b-94fb-4f0f8279e28b tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/2fd0dd2b-4e96-4272-825b-5852451e3992" status: 200 len: 1318 microversion: 2.1 time: 0.562064 Oct 23 01:20:50.894603 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1418/2828] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:50 2022] GET /compute/v2.1/servers/2fd0dd2b-4e96-4272-825b-5852451e3992 => generated 1318 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:50.911252 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-222ec9b9-a569-4db8-b377-eab0732cef29 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:50.916991 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-222ec9b9-a569-4db8-b377-eab0732cef29 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 283de315-fdcb-4c89-91e3-96aa3e822b21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:50.926239 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-222ec9b9-a569-4db8-b377-eab0732cef29 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:50.928310 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-222ec9b9-a569-4db8-b377-eab0732cef29 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:50.930566 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-222ec9b9-a569-4db8-b377-eab0732cef29 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:50.931590 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-222ec9b9-a569-4db8-b377-eab0732cef29 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:50.938974 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-222ec9b9-a569-4db8-b377-eab0732cef29 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:50.939813 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-222ec9b9-a569-4db8-b377-eab0732cef29 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:51.071327 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-be7d492a-e23c-41fb-8fe9-801945d853c2 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:51.071327 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-be7d492a-e23c-41fb-8fe9-801945d853c2 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1527 microversion: 2.1 time: 0.428650 Oct 23 01:20:51.071327 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1411/2829] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:50 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1527 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:51.071327 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-47cf5047-df4b-4315-8084-370226f30785 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc1eeed30>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:51.136493 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-47cf5047-df4b-4315-8084-370226f30785 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/d8995b1c-6b8e-4df7-b6c6-6372dcfaadbd" status: 200 len: 1413 microversion: 2.1 time: 0.089472 Oct 23 01:20:51.138682 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1412/2830] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:20:51 2022] GET /compute/v2.1/images/d8995b1c-6b8e-4df7-b6c6-6372dcfaadbd => generated 1413 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:51.143076 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-222ec9b9-a569-4db8-b377-eab0732cef29 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:51.148804 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-095e99d4-3aa5-439e-9c07-cabe90a208e0 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:51.155227 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-095e99d4-3aa5-439e-9c07-cabe90a208e0 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:51.155815 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-222ec9b9-a569-4db8-b377-eab0732cef29 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:51.155815 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-222ec9b9-a569-4db8-b377-eab0732cef29 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:51.157344 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-222ec9b9-a569-4db8-b377-eab0732cef29 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21" status: 200 len: 1565 microversion: 2.25 time: 0.259047 Oct 23 01:20:51.157782 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1419/2831] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:20:50 2022] GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21 => generated 1565 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:20:51.168729 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-095e99d4-3aa5-439e-9c07-cabe90a208e0 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:51.170128 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-095e99d4-3aa5-439e-9c07-cabe90a208e0 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:51.171243 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-095e99d4-3aa5-439e-9c07-cabe90a208e0 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:51.172218 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-095e99d4-3aa5-439e-9c07-cabe90a208e0 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:51.173497 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-095e99d4-3aa5-439e-9c07-cabe90a208e0 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:51.174199 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-095e99d4-3aa5-439e-9c07-cabe90a208e0 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:51.299123 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-37fc5dae-6e4a-4d08-8bc3-b3558158325e tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:51.299762 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-37fc5dae-6e4a-4d08-8bc3-b3558158325e tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: ad3fdbf4-6dba-46a6-9132-e555185544b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:51.327138 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-37fc5dae-6e4a-4d08-8bc3-b3558158325e tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:51.327688 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-37fc5dae-6e4a-4d08-8bc3-b3558158325e tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:51.331691 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-37fc5dae-6e4a-4d08-8bc3-b3558158325e tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:51.332774 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-37fc5dae-6e4a-4d08-8bc3-b3558158325e tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:51.333234 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-37fc5dae-6e4a-4d08-8bc3-b3558158325e tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:51.333673 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-37fc5dae-6e4a-4d08-8bc3-b3558158325e tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:51.343862 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-095e99d4-3aa5-439e-9c07-cabe90a208e0 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:51.363487 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-095e99d4-3aa5-439e-9c07-cabe90a208e0 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:51.366784 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-095e99d4-3aa5-439e-9c07-cabe90a208e0 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:51.376004 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-095e99d4-3aa5-439e-9c07-cabe90a208e0 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] 10.222.0.42 "GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334" status: 200 len: 1446 microversion: 2.75 time: 0.237431 Oct 23 01:20:51.377404 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1413/2832] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:20:51 2022] GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334 => generated 1446 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:20:51.614263 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-37fc5dae-6e4a-4d08-8bc3-b3558158325e tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:51.627796 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-37fc5dae-6e4a-4d08-8bc3-b3558158325e tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0" status: 200 len: 1507 microversion: 2.1 time: 0.349927 Oct 23 01:20:51.639098 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1420/2833] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:51 2022] GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0 => generated 1507 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:20:51.903131 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-96753e25-d43d-4cc5-bb80-6424c021fd24 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:51.903976 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-96753e25-d43d-4cc5-bb80-6424c021fd24 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 2fd0dd2b-4e96-4272-825b-5852451e3992] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:51.910537 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-96753e25-d43d-4cc5-bb80-6424c021fd24 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:51.911125 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-96753e25-d43d-4cc5-bb80-6424c021fd24 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:51.911791 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-96753e25-d43d-4cc5-bb80-6424c021fd24 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:51.912625 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-96753e25-d43d-4cc5-bb80-6424c021fd24 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:51.913301 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-96753e25-d43d-4cc5-bb80-6424c021fd24 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:51.913924 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-96753e25-d43d-4cc5-bb80-6424c021fd24 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:52.074455 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1e06e643-04bd-4967-882d-aed09a0ce58d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:52.075094 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1e06e643-04bd-4967-882d-aed09a0ce58d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:52.099418 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1e06e643-04bd-4967-882d-aed09a0ce58d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:52.099954 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1e06e643-04bd-4967-882d-aed09a0ce58d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:52.100412 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1e06e643-04bd-4967-882d-aed09a0ce58d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:52.101145 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1e06e643-04bd-4967-882d-aed09a0ce58d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:52.101608 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1e06e643-04bd-4967-882d-aed09a0ce58d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:52.102059 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1e06e643-04bd-4967-882d-aed09a0ce58d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:52.205341 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-96753e25-d43d-4cc5-bb80-6424c021fd24 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:52.217264 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-96753e25-d43d-4cc5-bb80-6424c021fd24 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/2fd0dd2b-4e96-4272-825b-5852451e3992" status: 200 len: 1508 microversion: 2.1 time: 0.318174 Oct 23 01:20:52.218216 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1414/2834] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:51 2022] GET /compute/v2.1/servers/2fd0dd2b-4e96-4272-825b-5852451e3992 => generated 1508 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:52.224270 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3af35342-d1fe-43c5-9681-86b5dd39a7d2 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc23ea0d0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:52.317433 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3af35342-d1fe-43c5-9681-86b5dd39a7d2 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/d8995b1c-6b8e-4df7-b6c6-6372dcfaadbd" status: 200 len: 1413 microversion: 2.1 time: 0.097841 Oct 23 01:20:52.322358 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1415/2835] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:20:52 2022] GET /compute/v2.1/images/d8995b1c-6b8e-4df7-b6c6-6372dcfaadbd => generated 1413 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:52.331194 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-41a68399-c73b-44d1-acb2-b50f0f005d10 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:52.342782 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-41a68399-c73b-44d1-acb2-b50f0f005d10 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 283de315-fdcb-4c89-91e3-96aa3e822b21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:52.357366 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-41a68399-c73b-44d1-acb2-b50f0f005d10 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:52.358065 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-41a68399-c73b-44d1-acb2-b50f0f005d10 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:52.358767 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-41a68399-c73b-44d1-acb2-b50f0f005d10 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:52.359708 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-41a68399-c73b-44d1-acb2-b50f0f005d10 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:52.360370 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-41a68399-c73b-44d1-acb2-b50f0f005d10 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:52.361023 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-41a68399-c73b-44d1-acb2-b50f0f005d10 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:52.551596 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-41a68399-c73b-44d1-acb2-b50f0f005d10 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:52.560837 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1e06e643-04bd-4967-882d-aed09a0ce58d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:52.567458 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-41a68399-c73b-44d1-acb2-b50f0f005d10 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:52.569862 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1e06e643-04bd-4967-882d-aed09a0ce58d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1527 microversion: 2.1 time: 0.502639 Oct 23 01:20:52.575859 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1421/2836] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:52 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1527 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:20:52.595797 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-41a68399-c73b-44d1-acb2-b50f0f005d10 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a246c84d8f444d59c9d5becae78f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc52d9ecfdf43f58b665d06e1008b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:52.597086 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-41a68399-c73b-44d1-acb2-b50f0f005d10 tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21" status: 200 len: 1523 microversion: 2.25 time: 0.273402 Oct 23 01:20:52.603660 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1416/2837] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:20:52 2022] GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21 => generated 1523 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:20:52.613197 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7816c582-09d5-40a7-a10e-3af4384e983d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:52.613197 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7816c582-09d5-40a7-a10e-3af4384e983d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 2fd0dd2b-4e96-4272-825b-5852451e3992] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:52.620790 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7816c582-09d5-40a7-a10e-3af4384e983d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:52.621495 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7816c582-09d5-40a7-a10e-3af4384e983d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:52.622253 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7816c582-09d5-40a7-a10e-3af4384e983d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:52.623331 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7816c582-09d5-40a7-a10e-3af4384e983d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:52.624509 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7816c582-09d5-40a7-a10e-3af4384e983d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:52.625093 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7816c582-09d5-40a7-a10e-3af4384e983d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:52.700064 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=100 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:20:52.949843 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-f07345ba-83ba-4063-83f9-59d2da148196 req-e9f131a9-2916-4534-9622-4351f19f4b67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "283de315-fdcb-4c89-91e3-96aa3e822b21", "name": "network-vif-deleted", "tag": "6fcf53a8-2a64-4797-8cda-509dc4504f75"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:20:52.965391 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-f07345ba-83ba-4063-83f9-59d2da148196 req-e9f131a9-2916-4534-9622-4351f19f4b67 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:52.966359 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-f07345ba-83ba-4063-83f9-59d2da148196 req-e9f131a9-2916-4534-9622-4351f19f4b67 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:52.967215 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-f07345ba-83ba-4063-83f9-59d2da148196 req-e9f131a9-2916-4534-9622-4351f19f4b67 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:52.983988 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-f07345ba-83ba-4063-83f9-59d2da148196 req-e9f131a9-2916-4534-9622-4351f19f4b67 service nova] Creating event network-vif-deleted:6fcf53a8-2a64-4797-8cda-509dc4504f75 for instance 283de315-fdcb-4c89-91e3-96aa3e822b21 on n-h1-master-1 Oct 23 01:20:53.005896 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-f07345ba-83ba-4063-83f9-59d2da148196 req-e9f131a9-2916-4534-9622-4351f19f4b67 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.384936 Oct 23 01:20:53.007698 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1417/2838] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:20:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:20:53.014573 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3fc83acc-0627-4a78-8ab8-e213a7acc5a9 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:53.015881 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3fc83acc-0627-4a78-8ab8-e213a7acc5a9 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:53.032790 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3fc83acc-0627-4a78-8ab8-e213a7acc5a9 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:53.032790 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3fc83acc-0627-4a78-8ab8-e213a7acc5a9 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:53.032790 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3fc83acc-0627-4a78-8ab8-e213a7acc5a9 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:53.032790 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3fc83acc-0627-4a78-8ab8-e213a7acc5a9 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:53.032790 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3fc83acc-0627-4a78-8ab8-e213a7acc5a9 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:53.032790 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3fc83acc-0627-4a78-8ab8-e213a7acc5a9 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:53.230634 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3fc83acc-0627-4a78-8ab8-e213a7acc5a9 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:53.244028 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3fc83acc-0627-4a78-8ab8-e213a7acc5a9 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:53.245878 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3fc83acc-0627-4a78-8ab8-e213a7acc5a9 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:53.264173 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3fc83acc-0627-4a78-8ab8-e213a7acc5a9 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] 10.222.0.42 "GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334" status: 200 len: 1446 microversion: 2.75 time: 0.254879 Oct 23 01:20:53.264979 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1418/2839] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:20:53 2022] GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334 => generated 1446 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:20:53.287370 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7816c582-09d5-40a7-a10e-3af4384e983d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:53.297404 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7816c582-09d5-40a7-a10e-3af4384e983d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/2fd0dd2b-4e96-4272-825b-5852451e3992" status: 200 len: 1508 microversion: 2.1 time: 0.717984 Oct 23 01:20:53.297717 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1422/2840] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:52 2022] GET /compute/v2.1/servers/2fd0dd2b-4e96-4272-825b-5852451e3992 => generated 1508 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:53.298734 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9b2e5969-ad5f-4299-9395-094236463fd0 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:53.299375 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9b2e5969-ad5f-4299-9395-094236463fd0 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: ad3fdbf4-6dba-46a6-9132-e555185544b0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:53.316554 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b2e5969-ad5f-4299-9395-094236463fd0 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:53.317052 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b2e5969-ad5f-4299-9395-094236463fd0 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:53.317613 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b2e5969-ad5f-4299-9395-094236463fd0 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:53.323482 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b2e5969-ad5f-4299-9395-094236463fd0 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:53.324048 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b2e5969-ad5f-4299-9395-094236463fd0 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:53.324498 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b2e5969-ad5f-4299-9395-094236463fd0 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:53.326875 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d1d2b715-a33b-4959-b207-2954e93d5f66 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:20:53.337700 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d1d2b715-a33b-4959-b207-2954e93d5f66 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 2fd0dd2b-4e96-4272-825b-5852451e3992] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:53.357549 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d1d2b715-a33b-4959-b207-2954e93d5f66 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:53.365135 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d1d2b715-a33b-4959-b207-2954e93d5f66 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:53.365135 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d1d2b715-a33b-4959-b207-2954e93d5f66 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:53.365135 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d1d2b715-a33b-4959-b207-2954e93d5f66 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:53.365135 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d1d2b715-a33b-4959-b207-2954e93d5f66 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:53.365135 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d1d2b715-a33b-4959-b207-2954e93d5f66 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:53.581578 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d1d2b715-a33b-4959-b207-2954e93d5f66 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "PUT /compute/v2.1/servers/2fd0dd2b-4e96-4272-825b-5852451e3992" status: 200 len: 1080 microversion: 2.1 time: 0.261780 Oct 23 01:20:53.583447 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1423/2841] 10.222.0.42 () {60 vars in 1256 bytes} [Sun Oct 23 01:20:53 2022] PUT /compute/v2.1/servers/2fd0dd2b-4e96-4272-825b-5852451e3992 => generated 1080 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:20:53.621434 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-70984074-7ee9-4c71-8932-4889d51adf6a tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc61198b0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:53.703931 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-70984074-7ee9-4c71-8932-4889d51adf6a tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/d8995b1c-6b8e-4df7-b6c6-6372dcfaadbd" status: 200 len: 1413 microversion: 2.1 time: 0.119773 Oct 23 01:20:53.718276 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1424/2842] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:20:53 2022] GET /compute/v2.1/images/d8995b1c-6b8e-4df7-b6c6-6372dcfaadbd => generated 1413 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:53.738206 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-521880ef-329b-4d74-8b4f-fabca9071e15 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:53.739991 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-521880ef-329b-4d74-8b4f-fabca9071e15 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:53.775146 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-521880ef-329b-4d74-8b4f-fabca9071e15 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:53.777447 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-521880ef-329b-4d74-8b4f-fabca9071e15 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:53.777937 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-521880ef-329b-4d74-8b4f-fabca9071e15 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:53.780147 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-521880ef-329b-4d74-8b4f-fabca9071e15 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:53.780635 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-521880ef-329b-4d74-8b4f-fabca9071e15 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:53.784157 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-521880ef-329b-4d74-8b4f-fabca9071e15 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:54.091413 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9b2e5969-ad5f-4299-9395-094236463fd0 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:54.104433 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9b2e5969-ad5f-4299-9395-094236463fd0 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0" status: 200 len: 1507 microversion: 2.1 time: 0.838602 Oct 23 01:20:54.105244 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1419/2843] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:53 2022] GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0 => generated 1507 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:54.119251 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6334c617-48ac-4d04-9de1-ac2b38df5b5d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:54.119872 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6334c617-48ac-4d04-9de1-ac2b38df5b5d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 2fd0dd2b-4e96-4272-825b-5852451e3992] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:54.127127 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6334c617-48ac-4d04-9de1-ac2b38df5b5d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:54.127622 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6334c617-48ac-4d04-9de1-ac2b38df5b5d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:54.128062 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6334c617-48ac-4d04-9de1-ac2b38df5b5d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:54.128899 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6334c617-48ac-4d04-9de1-ac2b38df5b5d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:54.129366 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6334c617-48ac-4d04-9de1-ac2b38df5b5d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:54.129891 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6334c617-48ac-4d04-9de1-ac2b38df5b5d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:54.136714 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-521880ef-329b-4d74-8b4f-fabca9071e15 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:54.147633 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-521880ef-329b-4d74-8b4f-fabca9071e15 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1509 microversion: 2.1 time: 0.427811 Oct 23 01:20:54.148230 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1425/2844] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:53 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1509 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:54.152830 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-88b9a4c2-4cba-4f37-b91c-35e0d173572e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:54.153464 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-88b9a4c2-4cba-4f37-b91c-35e0d173572e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] [instance: 283de315-fdcb-4c89-91e3-96aa3e822b21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:54.188389 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-88b9a4c2-4cba-4f37-b91c-35e0d173572e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:54.188897 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-88b9a4c2-4cba-4f37-b91c-35e0d173572e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:54.189347 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-88b9a4c2-4cba-4f37-b91c-35e0d173572e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:54.193731 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-88b9a4c2-4cba-4f37-b91c-35e0d173572e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:54.193908 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-88b9a4c2-4cba-4f37-b91c-35e0d173572e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:54.194259 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-88b9a4c2-4cba-4f37-b91c-35e0d173572e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:54.253435 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-88b9a4c2-4cba-4f37-b91c-35e0d173572e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] HTTP exception thrown: Instance 283de315-fdcb-4c89-91e3-96aa3e822b21 could not be found. Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-88b9a4c2-4cba-4f37-b91c-35e0d173572e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Request method failure captured: Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21 HTTP/1.1 Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJUfZCVXVkMS1oxq1YAiE8_rcVg9oiXHyz9jC68xBKkc_VTdXJeIi8SdyLyQDYRQBp4J5Pi7IKi-R-0TD7QfQlpZrg_PRVLwx1QzS_6nVtJj_1ZFFD2bz6tI5deH-6tSYBEMGiA_jmhO0uYEt6lNZX95QYuq4AbV3UNOqz3PgCuU88s Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: X-Openstack-Nova-Api-Version: 2.25 Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: ccc52d9ecfdf43f58b665d06e1008b52 Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1034616310 Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ccc52d9ecfdf43f58b665d06e1008b52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ccc52d9ecfdf43f58b665d06e1008b52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ccc52d9ecfdf43f58b665d06e1008b52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ccc52d9ecfdf43f58b665d06e1008b52"}]}] Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1034616310 Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: ccc52d9ecfdf43f58b665d06e1008b52 Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1034616310 Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-LiveAutoBlockMigrationV225Test-1034616310-project Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 8a246c84d8f444d59c9d5becae78f75a Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1034616310-project Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 283de315-fdcb-4c89-91e3-96aa3e822b21 could not be found. Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '283de315-fdcb-4c89-91e3-96aa3e822b21'} Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 283de315-fdcb-4c89-91e3-96aa3e822b21 could not be found. Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 283de315-fdcb-4c89-91e3-96aa3e822b21 could not be found. Oct 23 01:20:54.260073 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:20:54.268176 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:20:54.268176 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:20:54.268176 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:20:54.268176 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:20:54.268176 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:20:54.268176 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:20:54.268176 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:20:54.268176 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 283de315-fdcb-4c89-91e3-96aa3e822b21 could not be found. Oct 23 01:20:54.268176 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:20:54.268176 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-88b9a4c2-4cba-4f37-b91c-35e0d173572e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] Returning 404 to user: Instance 283de315-fdcb-4c89-91e3-96aa3e822b21 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:20:54.268176 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-88b9a4c2-4cba-4f37-b91c-35e0d173572e tempest-LiveAutoBlockMigrationV225Test-1034616310 tempest-LiveAutoBlockMigrationV225Test-1034616310-project] 10.222.0.42 "GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21" status: 404 len: 111 microversion: 2.25 time: 0.112303 Oct 23 01:20:54.276443 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1426/2845] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:20:54 2022] GET /compute/v2.1/servers/283de315-fdcb-4c89-91e3-96aa3e822b21 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:20:54.454200 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6334c617-48ac-4d04-9de1-ac2b38df5b5d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:54.491281 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6334c617-48ac-4d04-9de1-ac2b38df5b5d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/2fd0dd2b-4e96-4272-825b-5852451e3992" status: 200 len: 1506 microversion: 2.1 time: 0.384768 Oct 23 01:20:54.494921 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1420/2846] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:54 2022] GET /compute/v2.1/servers/2fd0dd2b-4e96-4272-825b-5852451e3992 => generated 1506 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:54.516420 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c06b83d5-02df-49df-ae00-951a885d3578 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:54.518237 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c06b83d5-02df-49df-ae00-951a885d3578 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:54.522223 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2646348b-2dc5-4e0b-a845-1bfafedb51b6 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-85496015", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "8f686b81-b5a0-4421-bbc8-d5adf0d513a6"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:20:54.537151 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c06b83d5-02df-49df-ae00-951a885d3578 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:54.537695 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c06b83d5-02df-49df-ae00-951a885d3578 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:54.541415 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c06b83d5-02df-49df-ae00-951a885d3578 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:54.543123 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c06b83d5-02df-49df-ae00-951a885d3578 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:54.546184 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c06b83d5-02df-49df-ae00-951a885d3578 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:54.546893 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c06b83d5-02df-49df-ae00-951a885d3578 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:54.613904 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-2646348b-2dc5-4e0b-a845-1bfafedb51b6 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] validate_networks() for [('8f686b81-b5a0-4421-bbc8-d5adf0d513a6', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:20:54.775794 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c06b83d5-02df-49df-ae00-951a885d3578 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:54.785210 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c06b83d5-02df-49df-ae00-951a885d3578 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:54.786708 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c06b83d5-02df-49df-ae00-951a885d3578 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:54.802657 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c06b83d5-02df-49df-ae00-951a885d3578 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] 10.222.0.42 "GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334" status: 200 len: 1446 microversion: 2.75 time: 0.306213 Oct 23 01:20:54.807137 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1421/2847] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:20:54 2022] GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334 => generated 1446 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:20:54.815532 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c6859b44-6c1c-411b-8be2-3f1b67e86b5d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:54.818718 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c6859b44-6c1c-411b-8be2-3f1b67e86b5d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 2fd0dd2b-4e96-4272-825b-5852451e3992] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:54.833331 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6859b44-6c1c-411b-8be2-3f1b67e86b5d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:54.834307 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6859b44-6c1c-411b-8be2-3f1b67e86b5d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:54.835530 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6859b44-6c1c-411b-8be2-3f1b67e86b5d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:54.836340 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6859b44-6c1c-411b-8be2-3f1b67e86b5d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:54.840509 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6859b44-6c1c-411b-8be2-3f1b67e86b5d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:54.841704 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6859b44-6c1c-411b-8be2-3f1b67e86b5d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:55.368290 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c6859b44-6c1c-411b-8be2-3f1b67e86b5d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:55.385797 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c6859b44-6c1c-411b-8be2-3f1b67e86b5d tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/2fd0dd2b-4e96-4272-825b-5852451e3992" status: 200 len: 1506 microversion: 2.1 time: 0.575415 Oct 23 01:20:55.386700 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1422/2848] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:54 2022] GET /compute/v2.1/servers/2fd0dd2b-4e96-4272-825b-5852451e3992 => generated 1506 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:55.399819 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-ed739a55-183c-465c-b5eb-7a6cbfea1ce1 req-ea1c6833-1c2b-41f3-95c3-47a45a28b827 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a64ad71-9caf-4645-be7a-b56f8f584c2d", "name": "network-vif-plugged", "status": "completed", "tag": "40a2cfab-1f0a-4ac9-815e-ce16a0befa54"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:20:55.426584 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ed739a55-183c-465c-b5eb-7a6cbfea1ce1 req-ea1c6833-1c2b-41f3-95c3-47a45a28b827 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:55.427394 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ed739a55-183c-465c-b5eb-7a6cbfea1ce1 req-ea1c6833-1c2b-41f3-95c3-47a45a28b827 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:55.428336 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ed739a55-183c-465c-b5eb-7a6cbfea1ce1 req-ea1c6833-1c2b-41f3-95c3-47a45a28b827 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:55.442426 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-ed739a55-183c-465c-b5eb-7a6cbfea1ce1 req-ea1c6833-1c2b-41f3-95c3-47a45a28b827 service nova] Creating event network-vif-plugged:40a2cfab-1f0a-4ac9-815e-ce16a0befa54 for instance 9a64ad71-9caf-4645-be7a-b56f8f584c2d on n-h2-master-1 Oct 23 01:20:55.452568 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-ed739a55-183c-465c-b5eb-7a6cbfea1ce1 req-ea1c6833-1c2b-41f3-95c3-47a45a28b827 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062535 Oct 23 01:20:55.457865 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1423/2849] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:20:55.464349 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f66c81fe-e30d-4d90-99c5-40efaaabae53 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc23d1c10>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:55.543774 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f66c81fe-e30d-4d90-99c5-40efaaabae53 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/d8995b1c-6b8e-4df7-b6c6-6372dcfaadbd" status: 200 len: 1413 microversion: 2.1 time: 0.084279 Oct 23 01:20:55.558251 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1424/2850] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:20:55 2022] GET /compute/v2.1/images/d8995b1c-6b8e-4df7-b6c6-6372dcfaadbd => generated 1413 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:55.564293 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-10d92c47-78e9-4e96-a691-2d6ecb00eb9b tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:55.565293 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-10d92c47-78e9-4e96-a691-2d6ecb00eb9b tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: ad3fdbf4-6dba-46a6-9132-e555185544b0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:55.572790 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10d92c47-78e9-4e96-a691-2d6ecb00eb9b tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:55.573716 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10d92c47-78e9-4e96-a691-2d6ecb00eb9b tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:55.574407 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10d92c47-78e9-4e96-a691-2d6ecb00eb9b tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:55.575894 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10d92c47-78e9-4e96-a691-2d6ecb00eb9b tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:55.576612 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10d92c47-78e9-4e96-a691-2d6ecb00eb9b tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:55.577275 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10d92c47-78e9-4e96-a691-2d6ecb00eb9b tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:55.613939 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-2646348b-2dc5-4e0b-a845-1bfafedb51b6 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:20:55.614882 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-2646348b-2dc5-4e0b-a845-1bfafedb51b6 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:20:55.618156 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-2646348b-2dc5-4e0b-a845-1bfafedb51b6 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:20:55.618156 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-2646348b-2dc5-4e0b-a845-1bfafedb51b6 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:20:55.618156 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-2646348b-2dc5-4e0b-a845-1bfafedb51b6 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:20:55.640964 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2646348b-2dc5-4e0b-a845-1bfafedb51b6 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:55.643369 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2646348b-2dc5-4e0b-a845-1bfafedb51b6 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:55.644309 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2646348b-2dc5-4e0b-a845-1bfafedb51b6 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:55.645551 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2646348b-2dc5-4e0b-a845-1bfafedb51b6 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:55.646089 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2646348b-2dc5-4e0b-a845-1bfafedb51b6 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:55.648381 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2646348b-2dc5-4e0b-a845-1bfafedb51b6 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:55.695739 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-2646348b-2dc5-4e0b-a845-1bfafedb51b6 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Getting quotas for project fee2e22f48754a4aa47426a27bebf68b. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:20:55.709587 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-2646348b-2dc5-4e0b-a845-1bfafedb51b6 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Getting quotas for user b74cdbbd7765495db29eb0428fadc992 and project fee2e22f48754a4aa47426a27bebf68b. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:20:55.742247 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:20:55.742247 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2646348b-2dc5-4e0b-a845-1bfafedb51b6 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:20:55.749644 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2646348b-2dc5-4e0b-a845-1bfafedb51b6 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] [instance: e973f866-0efe-40cb-82d5-846992200098] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:20:55.865324 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-10d92c47-78e9-4e96-a691-2d6ecb00eb9b tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:55.879848 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-10d92c47-78e9-4e96-a691-2d6ecb00eb9b tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0" status: 200 len: 1507 microversion: 2.1 time: 0.316803 Oct 23 01:20:55.886975 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1425/2851] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:55 2022] GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0 => generated 1507 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:55.899510 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-592b3e01-cb2d-4906-87e6-6fd88ec93a6e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:55.899510 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-592b3e01-cb2d-4906-87e6-6fd88ec93a6e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:55.906293 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-592b3e01-cb2d-4906-87e6-6fd88ec93a6e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:55.907073 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-592b3e01-cb2d-4906-87e6-6fd88ec93a6e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:55.907540 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-592b3e01-cb2d-4906-87e6-6fd88ec93a6e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:55.908378 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-592b3e01-cb2d-4906-87e6-6fd88ec93a6e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:55.908876 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-592b3e01-cb2d-4906-87e6-6fd88ec93a6e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:55.909629 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-592b3e01-cb2d-4906-87e6-6fd88ec93a6e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:56.000264 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2646348b-2dc5-4e0b-a845-1bfafedb51b6 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.710368 Oct 23 01:20:56.004353 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1427/2852] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:20:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:20:56.016199 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-06bab740-d6c8-43b0-a371-f968ffea6d11 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:20:56.027209 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-06bab740-d6c8-43b0-a371-f968ffea6d11 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 2fd0dd2b-4e96-4272-825b-5852451e3992] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:56.057021 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-06bab740-d6c8-43b0-a371-f968ffea6d11 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:56.057955 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-06bab740-d6c8-43b0-a371-f968ffea6d11 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:56.062580 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-06bab740-d6c8-43b0-a371-f968ffea6d11 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:56.070791 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-06bab740-d6c8-43b0-a371-f968ffea6d11 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:56.073274 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-06bab740-d6c8-43b0-a371-f968ffea6d11 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:56.073719 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-06bab740-d6c8-43b0-a371-f968ffea6d11 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:56.151169 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-592b3e01-cb2d-4906-87e6-6fd88ec93a6e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:56.170688 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-592b3e01-cb2d-4906-87e6-6fd88ec93a6e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1509 microversion: 2.1 time: 0.280524 Oct 23 01:20:56.171406 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1426/2853] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:55 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1509 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:56.176559 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8bef0866-fe0f-47f5-bc08-d93314e2e334 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:56.177182 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8bef0866-fe0f-47f5-bc08-d93314e2e334 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:56.185270 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8bef0866-fe0f-47f5-bc08-d93314e2e334 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:56.185771 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8bef0866-fe0f-47f5-bc08-d93314e2e334 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:56.186241 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8bef0866-fe0f-47f5-bc08-d93314e2e334 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:56.186972 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8bef0866-fe0f-47f5-bc08-d93314e2e334 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:56.190989 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8bef0866-fe0f-47f5-bc08-d93314e2e334 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:56.196209 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8bef0866-fe0f-47f5-bc08-d93314e2e334 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:56.367305 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8bef0866-fe0f-47f5-bc08-d93314e2e334 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:56.384585 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8bef0866-fe0f-47f5-bc08-d93314e2e334 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:56.386080 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8bef0866-fe0f-47f5-bc08-d93314e2e334 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:56.394436 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8bef0866-fe0f-47f5-bc08-d93314e2e334 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] 10.222.0.42 "GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334" status: 200 len: 1446 microversion: 2.75 time: 0.221943 Oct 23 01:20:56.395256 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1427/2854] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:20:56 2022] GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334 => generated 1446 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:20:56.402229 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-06bab740-d6c8-43b0-a371-f968ffea6d11 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "PUT /compute/v2.1/servers/2fd0dd2b-4e96-4272-825b-5852451e3992" status: 200 len: 1082 microversion: 2.1 time: 0.395641 Oct 23 01:20:56.414588 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-54bec628-521b-45ba-b336-dc559970fb50 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:56.414588 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-54bec628-521b-45ba-b336-dc559970fb50 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] [instance: e973f866-0efe-40cb-82d5-846992200098] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:56.424028 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1428/2855] 10.222.0.42 () {60 vars in 1256 bytes} [Sun Oct 23 01:20:56 2022] PUT /compute/v2.1/servers/2fd0dd2b-4e96-4272-825b-5852451e3992 => generated 1082 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:56.430878 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-51498102-bbf4-449a-b42e-aaa8845d87c7 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:56.435629 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-51498102-bbf4-449a-b42e-aaa8845d87c7 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 2fd0dd2b-4e96-4272-825b-5852451e3992] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:56.440742 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-51498102-bbf4-449a-b42e-aaa8845d87c7 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:56.441368 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-51498102-bbf4-449a-b42e-aaa8845d87c7 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:56.441954 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-51498102-bbf4-449a-b42e-aaa8845d87c7 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:56.442843 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-51498102-bbf4-449a-b42e-aaa8845d87c7 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:56.443404 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-51498102-bbf4-449a-b42e-aaa8845d87c7 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:56.444915 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-51498102-bbf4-449a-b42e-aaa8845d87c7 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:56.548681 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-54bec628-521b-45ba-b336-dc559970fb50 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74cdbbd7765495db29eb0428fadc992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee2e22f48754a4aa47426a27bebf68b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:56.579340 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-54bec628-521b-45ba-b336-dc559970fb50 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] 10.222.0.42 "GET /compute/v2.1/servers/e973f866-0efe-40cb-82d5-846992200098" status: 200 len: 1223 microversion: 2.1 time: 0.171677 Oct 23 01:20:56.579340 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1428/2856] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:56 2022] GET /compute/v2.1/servers/e973f866-0efe-40cb-82d5-846992200098 => generated 1223 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:56.584984 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d6d49529-7487-48a7-9506-505d8f51a27d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc1eee670>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:56.689705 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d6d49529-7487-48a7-9506-505d8f51a27d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/d8995b1c-6b8e-4df7-b6c6-6372dcfaadbd" status: 200 len: 1413 microversion: 2.1 time: 0.113589 Oct 23 01:20:56.693772 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1429/2857] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:20:56 2022] GET /compute/v2.1/images/d8995b1c-6b8e-4df7-b6c6-6372dcfaadbd => generated 1413 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:56.904366 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-51498102-bbf4-449a-b42e-aaa8845d87c7 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:56.912229 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-146b63a5-22d6-4bf6-8731-37934ba0e034 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:56.912982 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-146b63a5-22d6-4bf6-8731-37934ba0e034 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: ad3fdbf4-6dba-46a6-9132-e555185544b0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:56.930929 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-51498102-bbf4-449a-b42e-aaa8845d87c7 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/2fd0dd2b-4e96-4272-825b-5852451e3992" status: 200 len: 1508 microversion: 2.1 time: 0.505507 Oct 23 01:20:56.943199 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1429/2858] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:56 2022] GET /compute/v2.1/servers/2fd0dd2b-4e96-4272-825b-5852451e3992 => generated 1508 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:56.948424 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-146b63a5-22d6-4bf6-8731-37934ba0e034 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:56.948424 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-146b63a5-22d6-4bf6-8731-37934ba0e034 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:56.948424 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-146b63a5-22d6-4bf6-8731-37934ba0e034 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:56.948424 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-146b63a5-22d6-4bf6-8731-37934ba0e034 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:56.948424 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-146b63a5-22d6-4bf6-8731-37934ba0e034 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:56.948424 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-146b63a5-22d6-4bf6-8731-37934ba0e034 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:56.973563 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-30065dad-0625-442e-8526-e7693408797c tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:56.974508 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-30065dad-0625-442e-8526-e7693408797c tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 2fd0dd2b-4e96-4272-825b-5852451e3992] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:56.998949 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-30065dad-0625-442e-8526-e7693408797c tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:56.999470 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-30065dad-0625-442e-8526-e7693408797c tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:56.999923 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-30065dad-0625-442e-8526-e7693408797c tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:57.000670 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-30065dad-0625-442e-8526-e7693408797c tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:57.001125 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-30065dad-0625-442e-8526-e7693408797c tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:57.001605 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-30065dad-0625-442e-8526-e7693408797c tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:57.349582 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-146b63a5-22d6-4bf6-8731-37934ba0e034 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:57.360953 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-30065dad-0625-442e-8526-e7693408797c tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:57.364098 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-146b63a5-22d6-4bf6-8731-37934ba0e034 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0" status: 200 len: 1507 microversion: 2.1 time: 0.455460 Oct 23 01:20:57.365075 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1430/2859] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:56 2022] GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0 => generated 1507 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:57.373011 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-30065dad-0625-442e-8526-e7693408797c tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/2fd0dd2b-4e96-4272-825b-5852451e3992" status: 200 len: 1508 microversion: 2.1 time: 0.404264 Oct 23 01:20:57.373207 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1b154a38-fbdd-4b32-92dd-91dfead5f7e3 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:57.373867 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1b154a38-fbdd-4b32-92dd-91dfead5f7e3 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:57.374362 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1430/2860] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:56 2022] GET /compute/v2.1/servers/2fd0dd2b-4e96-4272-825b-5852451e3992 => generated 1508 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:20:57.388155 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b154a38-fbdd-4b32-92dd-91dfead5f7e3 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:57.389182 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b154a38-fbdd-4b32-92dd-91dfead5f7e3 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:57.389816 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b154a38-fbdd-4b32-92dd-91dfead5f7e3 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:57.390672 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b154a38-fbdd-4b32-92dd-91dfead5f7e3 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:57.391190 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b154a38-fbdd-4b32-92dd-91dfead5f7e3 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:57.396822 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b154a38-fbdd-4b32-92dd-91dfead5f7e3 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:57.402424 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-41c89945-7415-414a-93c4-636f6612ca08 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:57.403079 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-41c89945-7415-414a-93c4-636f6612ca08 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 2fd0dd2b-4e96-4272-825b-5852451e3992] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:57.414163 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41c89945-7415-414a-93c4-636f6612ca08 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:57.417198 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41c89945-7415-414a-93c4-636f6612ca08 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:57.424155 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41c89945-7415-414a-93c4-636f6612ca08 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:57.434555 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41c89945-7415-414a-93c4-636f6612ca08 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:57.434555 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41c89945-7415-414a-93c4-636f6612ca08 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:57.434555 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41c89945-7415-414a-93c4-636f6612ca08 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:57.510712 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-41c89945-7415-414a-93c4-636f6612ca08 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 2fd0dd2b-4e96-4272-825b-5852451e3992] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:20:57.646327 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1b154a38-fbdd-4b32-92dd-91dfead5f7e3 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:57.658146 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1b154a38-fbdd-4b32-92dd-91dfead5f7e3 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1509 microversion: 2.1 time: 0.291693 Oct 23 01:20:57.661245 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1431/2861] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:57 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1509 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:57.668220 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e649b629-d2a3-4c80-90fc-083329c82153 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:57.677277 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e649b629-d2a3-4c80-90fc-083329c82153 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:57.680167 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e649b629-d2a3-4c80-90fc-083329c82153 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:57.681137 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e649b629-d2a3-4c80-90fc-083329c82153 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:57.681806 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e649b629-d2a3-4c80-90fc-083329c82153 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:57.682908 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e649b629-d2a3-4c80-90fc-083329c82153 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:57.683788 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e649b629-d2a3-4c80-90fc-083329c82153 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:57.684419 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e649b629-d2a3-4c80-90fc-083329c82153 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:57.864715 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e649b629-d2a3-4c80-90fc-083329c82153 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:57.881172 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e649b629-d2a3-4c80-90fc-083329c82153 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:57.884333 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e649b629-d2a3-4c80-90fc-083329c82153 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:57.901035 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e649b629-d2a3-4c80-90fc-083329c82153 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] 10.222.0.42 "GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334" status: 200 len: 1446 microversion: 2.75 time: 0.238277 Oct 23 01:20:57.918645 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1432/2862] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:20:57 2022] GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334 => generated 1446 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:20:57.929899 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-4bf8cde7-d46e-408a-bb21-e009a1a6b93b req-f38611b4-e1eb-4f6e-b20a-50d7b1755fc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62a8ad26-f65b-432d-a8da-48264c426335", "name": "network-vif-unplugged", "status": "completed", "tag": "56917629-dd5e-4c91-a45e-1e8e6cd25138"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:20:57.941858 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-4bf8cde7-d46e-408a-bb21-e009a1a6b93b req-f38611b4-e1eb-4f6e-b20a-50d7b1755fc4 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:57.942542 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-4bf8cde7-d46e-408a-bb21-e009a1a6b93b req-f38611b4-e1eb-4f6e-b20a-50d7b1755fc4 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:57.943091 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-4bf8cde7-d46e-408a-bb21-e009a1a6b93b req-f38611b4-e1eb-4f6e-b20a-50d7b1755fc4 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:57.959740 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-4bf8cde7-d46e-408a-bb21-e009a1a6b93b req-f38611b4-e1eb-4f6e-b20a-50d7b1755fc4 service nova] Creating event network-vif-unplugged:56917629-dd5e-4c91-a45e-1e8e6cd25138 for instance 62a8ad26-f65b-432d-a8da-48264c426335 on n-h2-master-1 Oct 23 01:20:57.965389 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-4bf8cde7-d46e-408a-bb21-e009a1a6b93b req-f38611b4-e1eb-4f6e-b20a-50d7b1755fc4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044655 Oct 23 01:20:57.966838 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1433/2863] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:20:57.973420 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3e0b2aad-eb0a-4cbe-8060-b11733f64340 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:57.974132 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3e0b2aad-eb0a-4cbe-8060-b11733f64340 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] [instance: e973f866-0efe-40cb-82d5-846992200098] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:58.041392 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-41c89945-7415-414a-93c4-636f6612ca08 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2fd0dd2b-4e96-4272-825b-5852451e3992" status: 204 len: 0 microversion: 2.1 time: 0.645492 Oct 23 01:20:58.047998 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1431/2864] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:20:57 2022] DELETE /compute/v2.1/servers/2fd0dd2b-4e96-4272-825b-5852451e3992 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:20:58.055786 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-31dd8f17-fc04-4a43-8e49-7fb2dacc9814 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc6235c10>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:58.084685 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3e0b2aad-eb0a-4cbe-8060-b11733f64340 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74cdbbd7765495db29eb0428fadc992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee2e22f48754a4aa47426a27bebf68b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:58.101585 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3e0b2aad-eb0a-4cbe-8060-b11733f64340 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] 10.222.0.42 "GET /compute/v2.1/servers/e973f866-0efe-40cb-82d5-846992200098" status: 200 len: 1223 microversion: 2.1 time: 0.130329 Oct 23 01:20:58.109849 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1434/2865] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:57 2022] GET /compute/v2.1/servers/e973f866-0efe-40cb-82d5-846992200098 => generated 1223 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:58.134543 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0b75b825-dcdc-4e45-82e7-74b6e24223fb tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:58.137968 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0b75b825-dcdc-4e45-82e7-74b6e24223fb tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 2fd0dd2b-4e96-4272-825b-5852451e3992] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:58.142824 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-31dd8f17-fc04-4a43-8e49-7fb2dacc9814 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/d8995b1c-6b8e-4df7-b6c6-6372dcfaadbd" status: 200 len: 1413 microversion: 2.1 time: 0.092795 Oct 23 01:20:58.154134 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1432/2866] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:20:58 2022] GET /compute/v2.1/images/d8995b1c-6b8e-4df7-b6c6-6372dcfaadbd => generated 1413 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:58.181820 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b75b825-dcdc-4e45-82e7-74b6e24223fb tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:58.187250 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b75b825-dcdc-4e45-82e7-74b6e24223fb tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:58.191952 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b75b825-dcdc-4e45-82e7-74b6e24223fb tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:58.192807 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b75b825-dcdc-4e45-82e7-74b6e24223fb tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:58.195852 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b75b825-dcdc-4e45-82e7-74b6e24223fb tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:58.200035 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b75b825-dcdc-4e45-82e7-74b6e24223fb tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:58.288695 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0b75b825-dcdc-4e45-82e7-74b6e24223fb tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 2fd0dd2b-4e96-4272-825b-5852451e3992] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:20:58.307674 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=100 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:20:58.393249 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c08e8e08-fe00-4260-8d25-05cdce4e2aa5 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:58.393444 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c08e8e08-fe00-4260-8d25-05cdce4e2aa5 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: ad3fdbf4-6dba-46a6-9132-e555185544b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:58.409233 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c08e8e08-fe00-4260-8d25-05cdce4e2aa5 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:58.410722 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c08e8e08-fe00-4260-8d25-05cdce4e2aa5 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:58.413370 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c08e8e08-fe00-4260-8d25-05cdce4e2aa5 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:58.414533 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c08e8e08-fe00-4260-8d25-05cdce4e2aa5 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:58.415187 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c08e8e08-fe00-4260-8d25-05cdce4e2aa5 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:58.415625 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c08e8e08-fe00-4260-8d25-05cdce4e2aa5 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:58.473031 n-d-master-1 devstack@n-api.service[120945]: INFO nova.compute.api [None req-0b75b825-dcdc-4e45-82e7-74b6e24223fb tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 2fd0dd2b-4e96-4272-825b-5852451e3992] Instance is already in deleting state, ignoring this request Oct 23 01:20:58.479777 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0b75b825-dcdc-4e45-82e7-74b6e24223fb tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2fd0dd2b-4e96-4272-825b-5852451e3992" status: 204 len: 0 microversion: 2.1 time: 0.365149 Oct 23 01:20:58.487770 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1435/2867] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:20:58 2022] DELETE /compute/v2.1/servers/2fd0dd2b-4e96-4272-825b-5852451e3992 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:20:58.504646 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b1c143aa-4baa-4a77-ad7b-446b7f584dae tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:58.505476 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b1c143aa-4baa-4a77-ad7b-446b7f584dae tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 2fd0dd2b-4e96-4272-825b-5852451e3992] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:58.512142 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1c143aa-4baa-4a77-ad7b-446b7f584dae tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:58.513069 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1c143aa-4baa-4a77-ad7b-446b7f584dae tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:58.513660 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1c143aa-4baa-4a77-ad7b-446b7f584dae tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:58.524735 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1c143aa-4baa-4a77-ad7b-446b7f584dae tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:58.524735 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1c143aa-4baa-4a77-ad7b-446b7f584dae tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:58.524735 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1c143aa-4baa-4a77-ad7b-446b7f584dae tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:59.125148 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b1c143aa-4baa-4a77-ad7b-446b7f584dae tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:59.134438 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b1c143aa-4baa-4a77-ad7b-446b7f584dae tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/2fd0dd2b-4e96-4272-825b-5852451e3992" status: 200 len: 1514 microversion: 2.1 time: 0.634066 Oct 23 01:20:59.150157 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1436/2868] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:58 2022] GET /compute/v2.1/servers/2fd0dd2b-4e96-4272-825b-5852451e3992 => generated 1514 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:59.157237 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-930c58f4-8b53-48e0-8ecf-ef23053bf831 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:59.171111 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-930c58f4-8b53-48e0-8ecf-ef23053bf831 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:59.193607 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-930c58f4-8b53-48e0-8ecf-ef23053bf831 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:59.196512 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-930c58f4-8b53-48e0-8ecf-ef23053bf831 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:59.202148 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-930c58f4-8b53-48e0-8ecf-ef23053bf831 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:59.203098 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-930c58f4-8b53-48e0-8ecf-ef23053bf831 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:59.203588 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-930c58f4-8b53-48e0-8ecf-ef23053bf831 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:59.206640 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-930c58f4-8b53-48e0-8ecf-ef23053bf831 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:59.324424 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c08e8e08-fe00-4260-8d25-05cdce4e2aa5 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:59.344900 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c08e8e08-fe00-4260-8d25-05cdce4e2aa5 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0" status: 200 len: 1507 microversion: 2.1 time: 0.952225 Oct 23 01:20:59.350470 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1433/2869] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:58 2022] GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0 => generated 1507 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:20:59.357320 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e2c6c8b1-f553-4a9d-89da-ee8654485635 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:59.365020 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e2c6c8b1-f553-4a9d-89da-ee8654485635 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:59.377920 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e2c6c8b1-f553-4a9d-89da-ee8654485635 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:59.378867 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e2c6c8b1-f553-4a9d-89da-ee8654485635 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:59.379546 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e2c6c8b1-f553-4a9d-89da-ee8654485635 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:59.380485 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e2c6c8b1-f553-4a9d-89da-ee8654485635 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:59.385180 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e2c6c8b1-f553-4a9d-89da-ee8654485635 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:59.385946 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e2c6c8b1-f553-4a9d-89da-ee8654485635 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:59.555036 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e2c6c8b1-f553-4a9d-89da-ee8654485635 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:59.564579 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e2c6c8b1-f553-4a9d-89da-ee8654485635 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:59.574963 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e2c6c8b1-f553-4a9d-89da-ee8654485635 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:20:59.581903 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e2c6c8b1-f553-4a9d-89da-ee8654485635 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] 10.222.0.42 "GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334" status: 200 len: 1452 microversion: 2.75 time: 0.229969 Oct 23 01:20:59.602124 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1434/2870] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:20:59 2022] GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334 => generated 1452 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:20:59.602124 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-672bf7c9-e4a7-49b9-b3f6-d6ee2e16f00e tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:20:59.602124 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-672bf7c9-e4a7-49b9-b3f6-d6ee2e16f00e tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] [instance: e973f866-0efe-40cb-82d5-846992200098] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:20:59.612471 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-672bf7c9-e4a7-49b9-b3f6-d6ee2e16f00e tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:59.612979 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-672bf7c9-e4a7-49b9-b3f6-d6ee2e16f00e tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:59.613421 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-672bf7c9-e4a7-49b9-b3f6-d6ee2e16f00e tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:20:59.614175 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-672bf7c9-e4a7-49b9-b3f6-d6ee2e16f00e tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:20:59.619352 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-672bf7c9-e4a7-49b9-b3f6-d6ee2e16f00e tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:20:59.619352 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-672bf7c9-e4a7-49b9-b3f6-d6ee2e16f00e tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:00.099689 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-672bf7c9-e4a7-49b9-b3f6-d6ee2e16f00e tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74cdbbd7765495db29eb0428fadc992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee2e22f48754a4aa47426a27bebf68b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:00.128082 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-930c58f4-8b53-48e0-8ecf-ef23053bf831 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:00.128964 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-672bf7c9-e4a7-49b9-b3f6-d6ee2e16f00e tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] 10.222.0.42 "GET /compute/v2.1/servers/e973f866-0efe-40cb-82d5-846992200098" status: 200 len: 1227 microversion: 2.1 time: 0.542955 Oct 23 01:21:00.131163 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1435/2871] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:59 2022] GET /compute/v2.1/servers/e973f866-0efe-40cb-82d5-846992200098 => generated 1227 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:00.136337 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-930c58f4-8b53-48e0-8ecf-ef23053bf831 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1512 microversion: 2.1 time: 0.991641 Oct 23 01:21:00.143709 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-81f7a6e8-881c-4552-951d-f3ad0de0b84a tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc3ee25e0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:00.149261 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1437/2872] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:20:59 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1512 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:00.168358 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-94d75c27-2ed1-4dac-ab3a-610e69caa98c tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:00.170465 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-94d75c27-2ed1-4dac-ab3a-610e69caa98c tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 2fd0dd2b-4e96-4272-825b-5852451e3992] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:00.180212 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94d75c27-2ed1-4dac-ab3a-610e69caa98c tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:00.181141 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94d75c27-2ed1-4dac-ab3a-610e69caa98c tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:00.182277 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94d75c27-2ed1-4dac-ab3a-610e69caa98c tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:00.184577 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94d75c27-2ed1-4dac-ab3a-610e69caa98c tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:00.185511 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94d75c27-2ed1-4dac-ab3a-610e69caa98c tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:00.195859 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94d75c27-2ed1-4dac-ab3a-610e69caa98c tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:00.201490 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-81f7a6e8-881c-4552-951d-f3ad0de0b84a tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/d8995b1c-6b8e-4df7-b6c6-6372dcfaadbd" status: 200 len: 1413 microversion: 2.1 time: 0.067753 Oct 23 01:21:00.208753 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1436/2873] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:21:00 2022] GET /compute/v2.1/images/d8995b1c-6b8e-4df7-b6c6-6372dcfaadbd => generated 1413 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:00.229893 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b0b72270-80ea-4f9a-a99a-fbbbf834144e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:00.230869 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b0b72270-80ea-4f9a-a99a-fbbbf834144e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:00.249765 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b0b72270-80ea-4f9a-a99a-fbbbf834144e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:00.250571 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b0b72270-80ea-4f9a-a99a-fbbbf834144e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:00.252658 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b0b72270-80ea-4f9a-a99a-fbbbf834144e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:00.259909 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b0b72270-80ea-4f9a-a99a-fbbbf834144e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:00.259909 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b0b72270-80ea-4f9a-a99a-fbbbf834144e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:00.259909 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b0b72270-80ea-4f9a-a99a-fbbbf834144e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:00.639912 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-94d75c27-2ed1-4dac-ab3a-610e69caa98c tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:00.661091 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-94d75c27-2ed1-4dac-ab3a-610e69caa98c tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/2fd0dd2b-4e96-4272-825b-5852451e3992" status: 200 len: 1514 microversion: 2.1 time: 0.498595 Oct 23 01:21:00.663521 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1438/2874] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:00 2022] GET /compute/v2.1/servers/2fd0dd2b-4e96-4272-825b-5852451e3992 => generated 1514 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:00.674749 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-745cfe7c-44d1-45c4-9f77-488411aea407 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:00.677218 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-745cfe7c-44d1-45c4-9f77-488411aea407 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: ad3fdbf4-6dba-46a6-9132-e555185544b0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:00.706251 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-745cfe7c-44d1-45c4-9f77-488411aea407 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:00.706798 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-745cfe7c-44d1-45c4-9f77-488411aea407 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:00.707247 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-745cfe7c-44d1-45c4-9f77-488411aea407 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:00.707972 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-745cfe7c-44d1-45c4-9f77-488411aea407 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:00.708430 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-745cfe7c-44d1-45c4-9f77-488411aea407 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:00.708852 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-745cfe7c-44d1-45c4-9f77-488411aea407 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:01.169467 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b0b72270-80ea-4f9a-a99a-fbbbf834144e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:01.191971 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b0b72270-80ea-4f9a-a99a-fbbbf834144e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1512 microversion: 2.1 time: 0.978048 Oct 23 01:21:01.193066 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1437/2875] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:00 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1512 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:01.198801 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3d77c166-fdfc-4759-bea9-44451fd1a399 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:01.199472 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3d77c166-fdfc-4759-bea9-44451fd1a399 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:01.224068 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d77c166-fdfc-4759-bea9-44451fd1a399 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:01.224758 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d77c166-fdfc-4759-bea9-44451fd1a399 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:01.228923 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d77c166-fdfc-4759-bea9-44451fd1a399 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:01.229871 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d77c166-fdfc-4759-bea9-44451fd1a399 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:01.233736 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d77c166-fdfc-4759-bea9-44451fd1a399 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:01.234348 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d77c166-fdfc-4759-bea9-44451fd1a399 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:01.523130 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3d77c166-fdfc-4759-bea9-44451fd1a399 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:01.538113 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3d77c166-fdfc-4759-bea9-44451fd1a399 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:01.543270 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3d77c166-fdfc-4759-bea9-44451fd1a399 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:01.554453 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3d77c166-fdfc-4759-bea9-44451fd1a399 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] 10.222.0.42 "GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334" status: 200 len: 1452 microversion: 2.75 time: 0.359958 Oct 23 01:21:01.556417 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1438/2876] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:21:01 2022] GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334 => generated 1452 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:21:01.562944 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2288949c-b59e-46c7-a913-1584fccc0147 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:01.563942 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2288949c-b59e-46c7-a913-1584fccc0147 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] [instance: e973f866-0efe-40cb-82d5-846992200098] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:01.570806 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2288949c-b59e-46c7-a913-1584fccc0147 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:01.571762 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2288949c-b59e-46c7-a913-1584fccc0147 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:01.572747 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2288949c-b59e-46c7-a913-1584fccc0147 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:01.573676 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2288949c-b59e-46c7-a913-1584fccc0147 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:01.574505 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2288949c-b59e-46c7-a913-1584fccc0147 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:01.575818 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2288949c-b59e-46c7-a913-1584fccc0147 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:01.663005 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-745cfe7c-44d1-45c4-9f77-488411aea407 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:01.678363 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-745cfe7c-44d1-45c4-9f77-488411aea407 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0" status: 200 len: 1507 microversion: 2.1 time: 1.012759 Oct 23 01:21:01.682209 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1439/2877] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:00 2022] GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0 => generated 1507 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:01.696126 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8cdcd41a-f65d-46ba-93af-ce8e89d6c3e7 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc1f12d30>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:01.749830 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2288949c-b59e-46c7-a913-1584fccc0147 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74cdbbd7765495db29eb0428fadc992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee2e22f48754a4aa47426a27bebf68b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:01.762213 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2288949c-b59e-46c7-a913-1584fccc0147 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] 10.222.0.42 "GET /compute/v2.1/servers/e973f866-0efe-40cb-82d5-846992200098" status: 200 len: 1283 microversion: 2.1 time: 0.203722 Oct 23 01:21:01.790826 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1439/2878] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:01 2022] GET /compute/v2.1/servers/e973f866-0efe-40cb-82d5-846992200098 => generated 1283 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:01.798124 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b584c16f-86b3-439c-a3e4-29674b0d2366 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:21:01.799568 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b584c16f-86b3-439c-a3e4-29674b0d2366 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:01.808557 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b584c16f-86b3-439c-a3e4-29674b0d2366 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:01.808724 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8cdcd41a-f65d-46ba-93af-ce8e89d6c3e7 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/d8995b1c-6b8e-4df7-b6c6-6372dcfaadbd" status: 200 len: 1413 microversion: 2.1 time: 0.122634 Oct 23 01:21:01.809434 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b584c16f-86b3-439c-a3e4-29674b0d2366 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:01.810635 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b584c16f-86b3-439c-a3e4-29674b0d2366 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:01.811567 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b584c16f-86b3-439c-a3e4-29674b0d2366 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:01.812491 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b584c16f-86b3-439c-a3e4-29674b0d2366 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:01.813147 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b584c16f-86b3-439c-a3e4-29674b0d2366 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:01.819313 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1440/2879] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:21:01 2022] GET /compute/v2.1/images/d8995b1c-6b8e-4df7-b6c6-6372dcfaadbd => generated 1413 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:01.826561 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6cd0c6ab-8605-42ef-ba49-b1a942ee01fb tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:01.834396 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6cd0c6ab-8605-42ef-ba49-b1a942ee01fb tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 2fd0dd2b-4e96-4272-825b-5852451e3992] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:01.834396 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6cd0c6ab-8605-42ef-ba49-b1a942ee01fb tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:01.834938 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6cd0c6ab-8605-42ef-ba49-b1a942ee01fb tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:01.836215 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6cd0c6ab-8605-42ef-ba49-b1a942ee01fb tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:01.837104 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6cd0c6ab-8605-42ef-ba49-b1a942ee01fb tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:01.838409 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6cd0c6ab-8605-42ef-ba49-b1a942ee01fb tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:01.839501 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6cd0c6ab-8605-42ef-ba49-b1a942ee01fb tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:01.843228 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:01.851925 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-b584c16f-86b3-439c-a3e4-29674b0d2366 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lazy-loading 'flavor' on Instance uuid 62a8ad26-f65b-432d-a8da-48264c426335 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:21:01.878507 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-b584c16f-86b3-439c-a3e4-29674b0d2366 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] HTTP exception thrown: Cannot 'shelve' instance 62a8ad26-f65b-432d-a8da-48264c426335 while it is in vm_state shelved_offloaded Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b584c16f-86b3-439c-a3e4-29674b0d2366 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Request method failure captured: Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335/action HTTP/1.1 Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 14 Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJZEAurAeILsYJek3MCv_ryiTbidOLVZq6W4I7jJxeY_1_bTWRye2xM3EDOhowd_NyioevvIvzT9beBCgKqri_ZjLw9hdsIISMXmajO_VmobATT_GwpY_Y-GVylQtV9MoF1-Bup_Ahjld_2riQHnDzqLUWULm2acZYcK9UIbslVsdDU Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}] Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: cd6a6c5240f94ace91e1f0ed3e53fa7c Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: {"shelve": {}} Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: exception: Cannot 'shelve' instance 62a8ad26-f65b-432d-a8da-48264c426335 while it is in vm_state shelved_offloaded Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '62a8ad26-f65b-432d-a8da-48264c426335', 'body': {'shelve': {}}} Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 62a8ad26-f65b-432d-a8da-48264c426335 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 23 01:21:01.881996 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 23 01:21:01.896967 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 62a8ad26-f65b-432d-a8da-48264c426335 while it is in vm_state shelved_offloaded Oct 23 01:21:01.896967 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:21:01.896967 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:21:01.896967 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:21:01.896967 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:01.896967 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:21:01.896967 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:21:01.896967 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:21:01.896967 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:21:01.896967 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 62a8ad26-f65b-432d-a8da-48264c426335 while it is in vm_state shelved_offloaded Oct 23 01:21:01.896967 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:21:01.913205 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b584c16f-86b3-439c-a3e4-29674b0d2366 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Returning 409 to user: Cannot 'shelve' instance 62a8ad26-f65b-432d-a8da-48264c426335 while it is in vm_state shelved_offloaded {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:21:01.917400 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b584c16f-86b3-439c-a3e4-29674b0d2366 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "POST /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335/action" status: 409 len: 155 microversion: 2.1 time: 0.124819 Oct 23 01:21:01.922491 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1440/2880] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:21:01 2022] POST /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335/action => generated 155 bytes in 131 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:21:01.931516 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a75237a5-5d9b-4b29-b2d2-30c23f87aeb9 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:21:01.932411 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a75237a5-5d9b-4b29-b2d2-30c23f87aeb9 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:01.943112 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a75237a5-5d9b-4b29-b2d2-30c23f87aeb9 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:01.943791 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a75237a5-5d9b-4b29-b2d2-30c23f87aeb9 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:01.944318 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a75237a5-5d9b-4b29-b2d2-30c23f87aeb9 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:01.945250 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a75237a5-5d9b-4b29-b2d2-30c23f87aeb9 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:01.955388 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a75237a5-5d9b-4b29-b2d2-30c23f87aeb9 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:01.956273 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a75237a5-5d9b-4b29-b2d2-30c23f87aeb9 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:02.025839 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a75237a5-5d9b-4b29-b2d2-30c23f87aeb9 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120944) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 23 01:21:02.302303 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6cd0c6ab-8605-42ef-ba49-b1a942ee01fb tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:02.311149 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6cd0c6ab-8605-42ef-ba49-b1a942ee01fb tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/2fd0dd2b-4e96-4272-825b-5852451e3992" status: 200 len: 1514 microversion: 2.1 time: 0.488840 Oct 23 01:21:02.311753 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1441/2881] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:01 2022] GET /compute/v2.1/servers/2fd0dd2b-4e96-4272-825b-5852451e3992 => generated 1514 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:02.593642 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b471a82d-129e-4522-aeb3-23518cbc0404 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:02.596180 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b471a82d-129e-4522-aeb3-23518cbc0404 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:02.608789 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b471a82d-129e-4522-aeb3-23518cbc0404 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:02.611536 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b471a82d-129e-4522-aeb3-23518cbc0404 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:02.612186 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b471a82d-129e-4522-aeb3-23518cbc0404 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:02.613258 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b471a82d-129e-4522-aeb3-23518cbc0404 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:02.615567 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b471a82d-129e-4522-aeb3-23518cbc0404 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:02.618673 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b471a82d-129e-4522-aeb3-23518cbc0404 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:02.733226 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a75237a5-5d9b-4b29-b2d2-30c23f87aeb9 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "POST /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335/action" status: 202 len: 0 microversion: 2.1 time: 0.803721 Oct 23 01:21:02.741755 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1441/2882] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:21:01 2022] POST /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335/action => generated 0 bytes in 818 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:21:02.760587 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5a93c107-d259-47f4-a46d-21ac44e89eb8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:02.764942 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5a93c107-d259-47f4-a46d-21ac44e89eb8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: ad3fdbf4-6dba-46a6-9132-e555185544b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:02.803488 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5a93c107-d259-47f4-a46d-21ac44e89eb8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:02.803970 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5a93c107-d259-47f4-a46d-21ac44e89eb8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:02.804429 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5a93c107-d259-47f4-a46d-21ac44e89eb8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:02.812237 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5a93c107-d259-47f4-a46d-21ac44e89eb8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:02.812873 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5a93c107-d259-47f4-a46d-21ac44e89eb8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:02.813340 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5a93c107-d259-47f4-a46d-21ac44e89eb8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:03.058881 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b471a82d-129e-4522-aeb3-23518cbc0404 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:03.078343 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b471a82d-129e-4522-aeb3-23518cbc0404 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:03.088529 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b471a82d-129e-4522-aeb3-23518cbc0404 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:03.107827 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b471a82d-129e-4522-aeb3-23518cbc0404 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] 10.222.0.42 "GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334" status: 200 len: 1452 microversion: 2.75 time: 0.519877 Oct 23 01:21:03.111821 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1442/2883] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:21:02 2022] GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334 => generated 1452 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:21:03.131942 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3c4fae7a-d0f2-4026-9427-64545b2e56fa tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:03.136173 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3c4fae7a-d0f2-4026-9427-64545b2e56fa tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:03.155809 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c4fae7a-d0f2-4026-9427-64545b2e56fa tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:03.156645 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c4fae7a-d0f2-4026-9427-64545b2e56fa tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:03.165141 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c4fae7a-d0f2-4026-9427-64545b2e56fa tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:03.176511 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c4fae7a-d0f2-4026-9427-64545b2e56fa tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:03.176511 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c4fae7a-d0f2-4026-9427-64545b2e56fa tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:03.176511 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c4fae7a-d0f2-4026-9427-64545b2e56fa tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:03.635983 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3c4fae7a-d0f2-4026-9427-64545b2e56fa tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:03.647755 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3c4fae7a-d0f2-4026-9427-64545b2e56fa tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1460 microversion: 2.1 time: 0.534757 Oct 23 01:21:03.660471 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1443/2884] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:03 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1460 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:03.668506 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1c5e46c9-7bdc-410f-9fcb-211d9b2024e0 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:03.668506 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1c5e46c9-7bdc-410f-9fcb-211d9b2024e0 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] [instance: e973f866-0efe-40cb-82d5-846992200098] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:03.681551 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c5e46c9-7bdc-410f-9fcb-211d9b2024e0 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:03.682361 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c5e46c9-7bdc-410f-9fcb-211d9b2024e0 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:03.682855 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c5e46c9-7bdc-410f-9fcb-211d9b2024e0 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:03.683621 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c5e46c9-7bdc-410f-9fcb-211d9b2024e0 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:03.685009 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c5e46c9-7bdc-410f-9fcb-211d9b2024e0 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:03.685472 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c5e46c9-7bdc-410f-9fcb-211d9b2024e0 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:03.725159 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5a93c107-d259-47f4-a46d-21ac44e89eb8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:03.737610 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5a93c107-d259-47f4-a46d-21ac44e89eb8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0" status: 200 len: 1507 microversion: 2.1 time: 0.992298 Oct 23 01:21:03.754476 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1442/2885] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:02 2022] GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0 => generated 1507 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:03.754944 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-19cf18db-fa2e-4428-a01e-dc2e13ebff62 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc10d7040>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:03.795577 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1c5e46c9-7bdc-410f-9fcb-211d9b2024e0 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74cdbbd7765495db29eb0428fadc992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee2e22f48754a4aa47426a27bebf68b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:03.814512 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1c5e46c9-7bdc-410f-9fcb-211d9b2024e0 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] 10.222.0.42 "GET /compute/v2.1/servers/e973f866-0efe-40cb-82d5-846992200098" status: 200 len: 1281 microversion: 2.1 time: 0.162376 Oct 23 01:21:03.819305 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1444/2886] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:03 2022] GET /compute/v2.1/servers/e973f866-0efe-40cb-82d5-846992200098 => generated 1281 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:03.833026 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c0f1443c-aa64-491b-b876-e3930ddb0e24 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:03.838386 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c0f1443c-aa64-491b-b876-e3930ddb0e24 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 2fd0dd2b-4e96-4272-825b-5852451e3992] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:03.856833 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c0f1443c-aa64-491b-b876-e3930ddb0e24 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:03.860378 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c0f1443c-aa64-491b-b876-e3930ddb0e24 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:03.861308 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-19cf18db-fa2e-4428-a01e-dc2e13ebff62 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/d8995b1c-6b8e-4df7-b6c6-6372dcfaadbd" status: 200 len: 1413 microversion: 2.1 time: 0.117079 Oct 23 01:21:03.861744 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c0f1443c-aa64-491b-b876-e3930ddb0e24 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:03.861900 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1443/2887] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:21:03 2022] GET /compute/v2.1/images/d8995b1c-6b8e-4df7-b6c6-6372dcfaadbd => generated 1413 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:03.865784 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c0f1443c-aa64-491b-b876-e3930ddb0e24 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:03.867374 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c0f1443c-aa64-491b-b876-e3930ddb0e24 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:03.869422 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c0f1443c-aa64-491b-b876-e3930ddb0e24 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:03.873353 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-43fbfc86-3acf-4598-8dda-983cd55a1c50 req-1f7045c1-04ba-4726-82f8-e166a341715e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fd0dd2b-4e96-4272-825b-5852451e3992", "name": "network-vif-deleted", "tag": "7605293d-a15a-43f7-8742-b49e8c14b9dc"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:21:03.927225 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-43fbfc86-3acf-4598-8dda-983cd55a1c50 req-1f7045c1-04ba-4726-82f8-e166a341715e service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:03.932808 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-43fbfc86-3acf-4598-8dda-983cd55a1c50 req-1f7045c1-04ba-4726-82f8-e166a341715e service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:03.935195 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-43fbfc86-3acf-4598-8dda-983cd55a1c50 req-1f7045c1-04ba-4726-82f8-e166a341715e service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:03.981853 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-43fbfc86-3acf-4598-8dda-983cd55a1c50 req-1f7045c1-04ba-4726-82f8-e166a341715e service nova] Creating event network-vif-deleted:7605293d-a15a-43f7-8742-b49e8c14b9dc for instance 2fd0dd2b-4e96-4272-825b-5852451e3992 on n-h1-master-1 Oct 23 01:21:03.992671 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-43fbfc86-3acf-4598-8dda-983cd55a1c50 req-1f7045c1-04ba-4726-82f8-e166a341715e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129315 Oct 23 01:21:03.994109 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1444/2888] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:21:04.141780 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5926812f-cc4d-4171-b068-030bf4972f09 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:04.142628 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5926812f-cc4d-4171-b068-030bf4972f09 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:04.163727 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5926812f-cc4d-4171-b068-030bf4972f09 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:04.167537 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5926812f-cc4d-4171-b068-030bf4972f09 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:04.169567 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5926812f-cc4d-4171-b068-030bf4972f09 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:04.171798 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5926812f-cc4d-4171-b068-030bf4972f09 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:04.175332 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5926812f-cc4d-4171-b068-030bf4972f09 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:04.176330 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5926812f-cc4d-4171-b068-030bf4972f09 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:04.321954 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c0f1443c-aa64-491b-b876-e3930ddb0e24 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea2d1dfc7441d2a2bb7b22c6065605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0556c0544d446a2aa3d54e00b16bab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:04.334039 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c0f1443c-aa64-491b-b876-e3930ddb0e24 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/2fd0dd2b-4e96-4272-825b-5852451e3992" status: 200 len: 1303 microversion: 2.1 time: 0.513320 Oct 23 01:21:04.336050 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1445/2889] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:03 2022] GET /compute/v2.1/servers/2fd0dd2b-4e96-4272-825b-5852451e3992 => generated 1303 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:04.540899 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5926812f-cc4d-4171-b068-030bf4972f09 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:04.577524 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5926812f-cc4d-4171-b068-030bf4972f09 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:04.580858 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5926812f-cc4d-4171-b068-030bf4972f09 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:04.589064 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5926812f-cc4d-4171-b068-030bf4972f09 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] 10.222.0.42 "GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334" status: 200 len: 1437 microversion: 2.75 time: 0.451998 Oct 23 01:21:04.590295 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1445/2890] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:21:04 2022] GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334 => generated 1437 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:21:04.676555 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-be55a9d8-d76b-4417-b646-015c1e99db97 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:04.678163 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-be55a9d8-d76b-4417-b646-015c1e99db97 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:04.686016 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-be55a9d8-d76b-4417-b646-015c1e99db97 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:04.699342 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-be55a9d8-d76b-4417-b646-015c1e99db97 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:04.700065 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-be55a9d8-d76b-4417-b646-015c1e99db97 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:04.705240 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-be55a9d8-d76b-4417-b646-015c1e99db97 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:04.709950 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-be55a9d8-d76b-4417-b646-015c1e99db97 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:04.711040 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-be55a9d8-d76b-4417-b646-015c1e99db97 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:04.817328 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-457dc276-ef8c-4c8d-8903-91ece4215d81 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:21:04.820599 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-457dc276-ef8c-4c8d-8903-91ece4215d81 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:04.828041 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-457dc276-ef8c-4c8d-8903-91ece4215d81 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:04.828916 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-457dc276-ef8c-4c8d-8903-91ece4215d81 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:04.829570 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-457dc276-ef8c-4c8d-8903-91ece4215d81 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:04.830914 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-457dc276-ef8c-4c8d-8903-91ece4215d81 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:04.831626 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-457dc276-ef8c-4c8d-8903-91ece4215d81 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:04.832558 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-457dc276-ef8c-4c8d-8903-91ece4215d81 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:05.057496 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-457dc276-ef8c-4c8d-8903-91ece4215d81 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:21:05.057933 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-457dc276-ef8c-4c8d-8903-91ece4215d81 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:21:05.062095 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-457dc276-ef8c-4c8d-8903-91ece4215d81 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:21:05.062861 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-457dc276-ef8c-4c8d-8903-91ece4215d81 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:21:05.063472 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-457dc276-ef8c-4c8d-8903-91ece4215d81 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:21:05.136221 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-be55a9d8-d76b-4417-b646-015c1e99db97 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:05.147858 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-be55a9d8-d76b-4417-b646-015c1e99db97 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1460 microversion: 2.1 time: 0.475290 Oct 23 01:21:05.148465 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1446/2891] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:04 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1460 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:05.196463 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e7b112f4-e3b1-407d-b2ea-882192965261 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:05.197095 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e7b112f4-e3b1-407d-b2ea-882192965261 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: ad3fdbf4-6dba-46a6-9132-e555185544b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:05.214430 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e7b112f4-e3b1-407d-b2ea-882192965261 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:05.215028 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e7b112f4-e3b1-407d-b2ea-882192965261 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:05.216001 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e7b112f4-e3b1-407d-b2ea-882192965261 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:05.216775 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e7b112f4-e3b1-407d-b2ea-882192965261 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:05.217236 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e7b112f4-e3b1-407d-b2ea-882192965261 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:05.217673 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e7b112f4-e3b1-407d-b2ea-882192965261 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:05.319162 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-457dc276-ef8c-4c8d-8903-91ece4215d81 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:05.328582 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-457dc276-ef8c-4c8d-8903-91ece4215d81 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:05.329333 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-457dc276-ef8c-4c8d-8903-91ece4215d81 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:05.329760 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-457dc276-ef8c-4c8d-8903-91ece4215d81 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:05.331199 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-457dc276-ef8c-4c8d-8903-91ece4215d81 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:05.331790 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-457dc276-ef8c-4c8d-8903-91ece4215d81 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:05.332322 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-457dc276-ef8c-4c8d-8903-91ece4215d81 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:05.730679 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-457dc276-ef8c-4c8d-8903-91ece4215d81 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lazy-loading 'services' on Instance uuid 2d7a734d-28b1-4d9f-b80d-c272576f8334 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:21:05.730679 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:05.730679 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-457dc276-ef8c-4c8d-8903-91ece4215d81 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334/action" status: 202 len: 1940 microversion: 2.75 time: 0.981502 Oct 23 01:21:05.730679 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1446/2892] 10.222.0.42 () {62 vars in 1319 bytes} [Sun Oct 23 01:21:04 2022] POST /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334/action => generated 1940 bytes in 991 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 23 01:21:05.730679 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a9ff6451-7d49-46dc-b190-40bd48539f66 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:05.730679 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a9ff6451-7d49-46dc-b190-40bd48539f66 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] [instance: e973f866-0efe-40cb-82d5-846992200098] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:05.730679 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9ff6451-7d49-46dc-b190-40bd48539f66 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:05.730679 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9ff6451-7d49-46dc-b190-40bd48539f66 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:05.730679 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9ff6451-7d49-46dc-b190-40bd48539f66 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:05.730679 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9ff6451-7d49-46dc-b190-40bd48539f66 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:05.730679 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9ff6451-7d49-46dc-b190-40bd48539f66 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:05.730679 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9ff6451-7d49-46dc-b190-40bd48539f66 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:05.732914 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:05.732914 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=6 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:05.840023 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e7b112f4-e3b1-407d-b2ea-882192965261 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:05.862277 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e7b112f4-e3b1-407d-b2ea-882192965261 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0" status: 200 len: 1487 microversion: 2.1 time: 0.697856 Oct 23 01:21:05.863818 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1447/2893] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:05 2022] GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0 => generated 1487 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:05.874479 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-804f009f-72cd-47a0-b3d6-a64b529b6b92 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc10ba4c0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:06.029901 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a9ff6451-7d49-46dc-b190-40bd48539f66 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74cdbbd7765495db29eb0428fadc992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee2e22f48754a4aa47426a27bebf68b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:06.041104 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a9ff6451-7d49-46dc-b190-40bd48539f66 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] 10.222.0.42 "GET /compute/v2.1/servers/e973f866-0efe-40cb-82d5-846992200098" status: 200 len: 1323 microversion: 2.1 time: 0.432387 Oct 23 01:21:06.042828 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1447/2894] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:05 2022] GET /compute/v2.1/servers/e973f866-0efe-40cb-82d5-846992200098 => generated 1323 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:06.048886 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-804f009f-72cd-47a0-b3d6-a64b529b6b92 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/d8995b1c-6b8e-4df7-b6c6-6372dcfaadbd" status: 200 len: 1413 microversion: 2.1 time: 0.183739 Oct 23 01:21:06.050047 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1448/2895] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:21:05 2022] GET /compute/v2.1/images/d8995b1c-6b8e-4df7-b6c6-6372dcfaadbd => generated 1413 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:06.062760 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1b785768-5793-41a8-8859-f66de7345c31 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:06.065575 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1b785768-5793-41a8-8859-f66de7345c31 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 2fd0dd2b-4e96-4272-825b-5852451e3992] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:06.070793 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4f03e36e-26a4-4624-80df-642a22cf6901 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:06.071449 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4f03e36e-26a4-4624-80df-642a22cf6901 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:06.077643 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b785768-5793-41a8-8859-f66de7345c31 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:06.078873 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b785768-5793-41a8-8859-f66de7345c31 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:06.079511 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b785768-5793-41a8-8859-f66de7345c31 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:06.081115 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b785768-5793-41a8-8859-f66de7345c31 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:06.082521 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b785768-5793-41a8-8859-f66de7345c31 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:06.084208 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b785768-5793-41a8-8859-f66de7345c31 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:06.104592 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f03e36e-26a4-4624-80df-642a22cf6901 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:06.108370 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f03e36e-26a4-4624-80df-642a22cf6901 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:06.108862 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f03e36e-26a4-4624-80df-642a22cf6901 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:06.109611 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f03e36e-26a4-4624-80df-642a22cf6901 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:06.111967 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f03e36e-26a4-4624-80df-642a22cf6901 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:06.114323 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f03e36e-26a4-4624-80df-642a22cf6901 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:06.118863 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-1b785768-5793-41a8-8859-f66de7345c31 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] HTTP exception thrown: Instance 2fd0dd2b-4e96-4272-825b-5852451e3992 could not be found. Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1b785768-5793-41a8-8859-f66de7345c31 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Request method failure captured: Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/2fd0dd2b-4e96-4272-825b-5852451e3992 HTTP/1.1 Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJZabggJ7Ty3sFDp3Zjib-t_jvjNTKeukroJ0uON9s0fRm0wkvLeKb0obRXASLNCZzsxJhi1I3ENcTRi9-3QLEIKngq-GHQijKV6C-oa816zgU26i4NKU2PmYJ8A0TK6mxuhFTNfRaJKIfBMXM5Th1bsHuvFn3iQ80_0VO9_jan-uFA Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: a0556c0544d446a2aa3d54e00b16bab1 Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServerDiskConfigTestJSON-552182583 Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a0556c0544d446a2aa3d54e00b16bab1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a0556c0544d446a2aa3d54e00b16bab1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a0556c0544d446a2aa3d54e00b16bab1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a0556c0544d446a2aa3d54e00b16bab1"}]}] Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServerDiskConfigTestJSON-552182583 Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: a0556c0544d446a2aa3d54e00b16bab1 Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-552182583 Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServerDiskConfigTestJSON-552182583-project Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 18ea2d1dfc7441d2a2bb7b22c6065605 Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServerDiskConfigTestJSON-552182583-project Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 2fd0dd2b-4e96-4272-825b-5852451e3992 could not be found. Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '2fd0dd2b-4e96-4272-825b-5852451e3992'} Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fd0dd2b-4e96-4272-825b-5852451e3992 could not be found. Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fd0dd2b-4e96-4272-825b-5852451e3992 could not be found. Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:21:06.123146 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:21:06.127527 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:06.127527 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:21:06.127527 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:21:06.127527 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:21:06.127527 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:21:06.127527 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fd0dd2b-4e96-4272-825b-5852451e3992 could not be found. Oct 23 01:21:06.127527 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:21:06.127527 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1b785768-5793-41a8-8859-f66de7345c31 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Returning 404 to user: Instance 2fd0dd2b-4e96-4272-825b-5852451e3992 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:21:06.129428 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1b785768-5793-41a8-8859-f66de7345c31 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/2fd0dd2b-4e96-4272-825b-5852451e3992" status: 404 len: 111 microversion: 2.1 time: 0.083632 Oct 23 01:21:06.130595 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1448/2896] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:06 2022] GET /compute/v2.1/servers/2fd0dd2b-4e96-4272-825b-5852451e3992 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:21:06.137762 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a99029fa-a0e0-48eb-8fd6-1bfd38688102 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:21:06.138613 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a99029fa-a0e0-48eb-8fd6-1bfd38688102 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: ad3fdbf4-6dba-46a6-9132-e555185544b0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:06.145759 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a99029fa-a0e0-48eb-8fd6-1bfd38688102 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:06.146657 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a99029fa-a0e0-48eb-8fd6-1bfd38688102 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:06.147317 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a99029fa-a0e0-48eb-8fd6-1bfd38688102 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:06.148299 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a99029fa-a0e0-48eb-8fd6-1bfd38688102 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:06.149168 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a99029fa-a0e0-48eb-8fd6-1bfd38688102 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:06.149796 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a99029fa-a0e0-48eb-8fd6-1bfd38688102 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:06.218126 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:06.264771 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-4f03e36e-26a4-4624-80df-642a22cf6901 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lazy-loading 'services' on Instance uuid 2d7a734d-28b1-4d9f-b80d-c272576f8334 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:21:06.291908 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4f03e36e-26a4-4624-80df-642a22cf6901 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334" status: 200 len: 1927 microversion: 2.75 time: 0.240601 Oct 23 01:21:06.322366 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1449/2897] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:21:06 2022] GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334 => generated 1927 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:21:06.333611 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2948d15f-1840-42eb-8d19-6459ecd52fe9 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:06.338833 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2948d15f-1840-42eb-8d19-6459ecd52fe9 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 6ccfe45d-f080-4066-9aad-a39c3c4cd097] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:06.347421 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2948d15f-1840-42eb-8d19-6459ecd52fe9 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:06.348269 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2948d15f-1840-42eb-8d19-6459ecd52fe9 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:06.348945 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2948d15f-1840-42eb-8d19-6459ecd52fe9 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:06.349902 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2948d15f-1840-42eb-8d19-6459ecd52fe9 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:06.350609 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2948d15f-1840-42eb-8d19-6459ecd52fe9 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:06.351819 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2948d15f-1840-42eb-8d19-6459ecd52fe9 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:06.371531 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-2948d15f-1840-42eb-8d19-6459ecd52fe9 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] HTTP exception thrown: Instance 6ccfe45d-f080-4066-9aad-a39c3c4cd097 could not be found. Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2948d15f-1840-42eb-8d19-6459ecd52fe9 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Request method failure captured: Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097 HTTP/1.1 Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJZabggJ7Ty3sFDp3Zjib-t_jvjNTKeukroJ0uON9s0fRm0wkvLeKb0obRXASLNCZzsxJhi1I3ENcTRi9-3QLEIKngq-GHQijKV6C-oa816zgU26i4NKU2PmYJ8A0TK6mxuhFTNfRaJKIfBMXM5Th1bsHuvFn3iQ80_0VO9_jan-uFA Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: a0556c0544d446a2aa3d54e00b16bab1 Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServerDiskConfigTestJSON-552182583 Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a0556c0544d446a2aa3d54e00b16bab1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a0556c0544d446a2aa3d54e00b16bab1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a0556c0544d446a2aa3d54e00b16bab1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a0556c0544d446a2aa3d54e00b16bab1"}]}] Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServerDiskConfigTestJSON-552182583 Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: a0556c0544d446a2aa3d54e00b16bab1 Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-552182583 Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServerDiskConfigTestJSON-552182583-project Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 18ea2d1dfc7441d2a2bb7b22c6065605 Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServerDiskConfigTestJSON-552182583-project Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 6ccfe45d-f080-4066-9aad-a39c3c4cd097 could not be found. Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '6ccfe45d-f080-4066-9aad-a39c3c4cd097'} Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ccfe45d-f080-4066-9aad-a39c3c4cd097 could not be found. Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:21:06.375419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:21:06.382240 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ccfe45d-f080-4066-9aad-a39c3c4cd097 could not be found. Oct 23 01:21:06.382240 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:21:06.382240 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:21:06.382240 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:21:06.382240 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:06.382240 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:21:06.382240 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:21:06.382240 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:21:06.382240 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:21:06.382240 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ccfe45d-f080-4066-9aad-a39c3c4cd097 could not be found. Oct 23 01:21:06.382240 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:21:06.382240 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2948d15f-1840-42eb-8d19-6459ecd52fe9 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Returning 404 to user: Instance 6ccfe45d-f080-4066-9aad-a39c3c4cd097 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:21:06.382240 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2948d15f-1840-42eb-8d19-6459ecd52fe9 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097" status: 404 len: 111 microversion: 2.1 time: 0.057053 Oct 23 01:21:06.382240 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1450/2898] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:21:06 2022] DELETE /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:21:06.387124 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9f870892-db55-4158-9102-ccfcb1c154d5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:06.388372 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9f870892-db55-4158-9102-ccfcb1c154d5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:06.395213 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f870892-db55-4158-9102-ccfcb1c154d5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:06.396031 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f870892-db55-4158-9102-ccfcb1c154d5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:06.396708 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f870892-db55-4158-9102-ccfcb1c154d5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:06.397624 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f870892-db55-4158-9102-ccfcb1c154d5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:06.398348 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f870892-db55-4158-9102-ccfcb1c154d5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:06.398847 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f870892-db55-4158-9102-ccfcb1c154d5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:06.490649 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a99029fa-a0e0-48eb-8fd6-1bfd38688102 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "POST /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0/action" status: 202 len: 0 microversion: 2.1 time: 0.358539 Oct 23 01:21:06.491923 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1449/2899] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:21:06 2022] POST /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0/action => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:21:06.499971 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3a3049ae-c0a2-4466-8bfd-9bea05aca199 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:06.512839 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3a3049ae-c0a2-4466-8bfd-9bea05aca199 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: 6ccfe45d-f080-4066-9aad-a39c3c4cd097] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:06.519663 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3a3049ae-c0a2-4466-8bfd-9bea05aca199 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:06.520098 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3a3049ae-c0a2-4466-8bfd-9bea05aca199 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:06.520529 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3a3049ae-c0a2-4466-8bfd-9bea05aca199 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:06.521231 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3a3049ae-c0a2-4466-8bfd-9bea05aca199 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:06.521687 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3a3049ae-c0a2-4466-8bfd-9bea05aca199 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:06.534312 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3a3049ae-c0a2-4466-8bfd-9bea05aca199 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:06.560384 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-3a3049ae-c0a2-4466-8bfd-9bea05aca199 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] HTTP exception thrown: Instance 6ccfe45d-f080-4066-9aad-a39c3c4cd097 could not be found. Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3a3049ae-c0a2-4466-8bfd-9bea05aca199 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Request method failure captured: Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097 HTTP/1.1 Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJZabggJ7Ty3sFDp3Zjib-t_jvjNTKeukroJ0uON9s0fRm0wkvLeKb0obRXASLNCZzsxJhi1I3ENcTRi9-3QLEIKngq-GHQijKV6C-oa816zgU26i4NKU2PmYJ8A0TK6mxuhFTNfRaJKIfBMXM5Th1bsHuvFn3iQ80_0VO9_jan-uFA Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: a0556c0544d446a2aa3d54e00b16bab1 Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServerDiskConfigTestJSON-552182583 Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a0556c0544d446a2aa3d54e00b16bab1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a0556c0544d446a2aa3d54e00b16bab1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a0556c0544d446a2aa3d54e00b16bab1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a0556c0544d446a2aa3d54e00b16bab1"}]}] Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServerDiskConfigTestJSON-552182583 Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: a0556c0544d446a2aa3d54e00b16bab1 Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-552182583 Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServerDiskConfigTestJSON-552182583-project Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 18ea2d1dfc7441d2a2bb7b22c6065605 Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServerDiskConfigTestJSON-552182583-project Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 6ccfe45d-f080-4066-9aad-a39c3c4cd097 could not be found. Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '6ccfe45d-f080-4066-9aad-a39c3c4cd097'} Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ccfe45d-f080-4066-9aad-a39c3c4cd097 could not be found. Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ccfe45d-f080-4066-9aad-a39c3c4cd097 could not be found. Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:21:06.562085 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:21:06.565734 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:06.565734 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:21:06.565734 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:21:06.565734 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:21:06.565734 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:21:06.565734 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ccfe45d-f080-4066-9aad-a39c3c4cd097 could not be found. Oct 23 01:21:06.565734 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:21:06.565734 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3a3049ae-c0a2-4466-8bfd-9bea05aca199 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Returning 404 to user: Instance 6ccfe45d-f080-4066-9aad-a39c3c4cd097 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:21:06.565734 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3a3049ae-c0a2-4466-8bfd-9bea05aca199 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097" status: 404 len: 111 microversion: 2.1 time: 0.070137 Oct 23 01:21:06.565734 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1450/2900] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:06 2022] GET /compute/v2.1/servers/6ccfe45d-f080-4066-9aad-a39c3c4cd097 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:21:06.581695 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-30bb3b2f-fa39-486a-96b2-62d7b1904051 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:06.586145 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-30bb3b2f-fa39-486a-96b2-62d7b1904051 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: ad3fdbf4-6dba-46a6-9132-e555185544b0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:06.589616 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-30bb3b2f-fa39-486a-96b2-62d7b1904051 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:06.590158 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-30bb3b2f-fa39-486a-96b2-62d7b1904051 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:06.590634 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-30bb3b2f-fa39-486a-96b2-62d7b1904051 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:06.591340 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-30bb3b2f-fa39-486a-96b2-62d7b1904051 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:06.591862 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-30bb3b2f-fa39-486a-96b2-62d7b1904051 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:06.592293 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-30bb3b2f-fa39-486a-96b2-62d7b1904051 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:07.125747 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-30bb3b2f-fa39-486a-96b2-62d7b1904051 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:07.134261 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-30bb3b2f-fa39-486a-96b2-62d7b1904051 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0" status: 200 len: 1495 microversion: 2.1 time: 0.569096 Oct 23 01:21:07.171335 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1451/2901] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:06 2022] GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0 => generated 1495 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:07.199327 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d9469559-b600-4272-b36f-94ccc8f95ecd tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:07.201298 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d9469559-b600-4272-b36f-94ccc8f95ecd tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: d2d33142-cf85-4a5b-b63f-e3780f8ac0b1] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:07.222237 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9469559-b600-4272-b36f-94ccc8f95ecd tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:07.223003 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9469559-b600-4272-b36f-94ccc8f95ecd tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:07.224683 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9469559-b600-4272-b36f-94ccc8f95ecd tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:07.225673 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9469559-b600-4272-b36f-94ccc8f95ecd tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:07.226923 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9469559-b600-4272-b36f-94ccc8f95ecd tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:07.228701 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9469559-b600-4272-b36f-94ccc8f95ecd tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:07.263380 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-d9469559-b600-4272-b36f-94ccc8f95ecd tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] HTTP exception thrown: Instance d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 could not be found. Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d9469559-b600-4272-b36f-94ccc8f95ecd tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Request method failure captured: Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 HTTP/1.1 Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJZabggJ7Ty3sFDp3Zjib-t_jvjNTKeukroJ0uON9s0fRm0wkvLeKb0obRXASLNCZzsxJhi1I3ENcTRi9-3QLEIKngq-GHQijKV6C-oa816zgU26i4NKU2PmYJ8A0TK6mxuhFTNfRaJKIfBMXM5Th1bsHuvFn3iQ80_0VO9_jan-uFA Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: a0556c0544d446a2aa3d54e00b16bab1 Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServerDiskConfigTestJSON-552182583 Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a0556c0544d446a2aa3d54e00b16bab1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a0556c0544d446a2aa3d54e00b16bab1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a0556c0544d446a2aa3d54e00b16bab1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a0556c0544d446a2aa3d54e00b16bab1"}]}] Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServerDiskConfigTestJSON-552182583 Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: a0556c0544d446a2aa3d54e00b16bab1 Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-552182583 Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServerDiskConfigTestJSON-552182583-project Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 18ea2d1dfc7441d2a2bb7b22c6065605 Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServerDiskConfigTestJSON-552182583-project Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: exception: Instance d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 could not be found. Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'd2d33142-cf85-4a5b-b63f-e3780f8ac0b1'} Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 could not be found. Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:21:07.274620 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:21:07.279872 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 could not be found. Oct 23 01:21:07.279872 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:21:07.279872 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:21:07.279872 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:21:07.279872 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:07.279872 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:21:07.279872 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:21:07.279872 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:21:07.279872 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:21:07.279872 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 could not be found. Oct 23 01:21:07.279872 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:21:07.279872 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d9469559-b600-4272-b36f-94ccc8f95ecd tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Returning 404 to user: Instance d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:21:07.280891 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d9469559-b600-4272-b36f-94ccc8f95ecd tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1" status: 404 len: 111 microversion: 2.1 time: 0.107715 Oct 23 01:21:07.281036 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1452/2902] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:21:07 2022] DELETE /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:21:07.286006 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bbf0cd20-c4e1-4440-9ac2-ff7fd36c481a tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc1f12790>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:07.364118 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bbf0cd20-c4e1-4440-9ac2-ff7fd36c481a tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/d8995b1c-6b8e-4df7-b6c6-6372dcfaadbd" status: 200 len: 1413 microversion: 2.1 time: 0.081634 Oct 23 01:21:07.364721 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1453/2903] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:21:07 2022] GET /compute/v2.1/images/d8995b1c-6b8e-4df7-b6c6-6372dcfaadbd => generated 1413 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:07.385864 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-28d2864b-069c-4424-bdb2-69f97bcd2a81 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:07.386800 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-28d2864b-069c-4424-bdb2-69f97bcd2a81 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] [instance: e973f866-0efe-40cb-82d5-846992200098] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:07.407158 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-28d2864b-069c-4424-bdb2-69f97bcd2a81 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:07.414775 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-28d2864b-069c-4424-bdb2-69f97bcd2a81 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:07.415714 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-28d2864b-069c-4424-bdb2-69f97bcd2a81 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:07.416669 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-28d2864b-069c-4424-bdb2-69f97bcd2a81 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:07.417319 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-28d2864b-069c-4424-bdb2-69f97bcd2a81 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:07.417935 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-28d2864b-069c-4424-bdb2-69f97bcd2a81 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:07.967017 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9f870892-db55-4158-9102-ccfcb1c154d5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:07.979475 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9f870892-db55-4158-9102-ccfcb1c154d5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1518 microversion: 2.1 time: 1.596615 Oct 23 01:21:07.996486 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1451/2904] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:06 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1518 bytes in 1601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:07.996486 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5f1cae61-6bdd-4a25-b1c5-b2af4f080161 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:07.996486 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5f1cae61-6bdd-4a25-b1c5-b2af4f080161 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] [instance: d2d33142-cf85-4a5b-b63f-e3780f8ac0b1] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:08.010648 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f1cae61-6bdd-4a25-b1c5-b2af4f080161 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:08.011602 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f1cae61-6bdd-4a25-b1c5-b2af4f080161 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:08.012340 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f1cae61-6bdd-4a25-b1c5-b2af4f080161 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:08.015477 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f1cae61-6bdd-4a25-b1c5-b2af4f080161 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:08.016190 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f1cae61-6bdd-4a25-b1c5-b2af4f080161 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:08.019620 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f1cae61-6bdd-4a25-b1c5-b2af4f080161 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:08.055743 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-5f1cae61-6bdd-4a25-b1c5-b2af4f080161 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] HTTP exception thrown: Instance d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 could not be found. Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5f1cae61-6bdd-4a25-b1c5-b2af4f080161 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Request method failure captured: Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 HTTP/1.1 Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJZabggJ7Ty3sFDp3Zjib-t_jvjNTKeukroJ0uON9s0fRm0wkvLeKb0obRXASLNCZzsxJhi1I3ENcTRi9-3QLEIKngq-GHQijKV6C-oa816zgU26i4NKU2PmYJ8A0TK6mxuhFTNfRaJKIfBMXM5Th1bsHuvFn3iQ80_0VO9_jan-uFA Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: a0556c0544d446a2aa3d54e00b16bab1 Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServerDiskConfigTestJSON-552182583 Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a0556c0544d446a2aa3d54e00b16bab1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a0556c0544d446a2aa3d54e00b16bab1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a0556c0544d446a2aa3d54e00b16bab1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a0556c0544d446a2aa3d54e00b16bab1"}]}] Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServerDiskConfigTestJSON-552182583 Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: a0556c0544d446a2aa3d54e00b16bab1 Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-552182583 Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServerDiskConfigTestJSON-552182583-project Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 18ea2d1dfc7441d2a2bb7b22c6065605 Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServerDiskConfigTestJSON-552182583-project Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: exception: Instance d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 could not be found. Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'd2d33142-cf85-4a5b-b63f-e3780f8ac0b1'} Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 could not be found. Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 could not be found. Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:21:08.060780 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:21:08.064947 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:08.064947 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:21:08.064947 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:21:08.064947 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:21:08.064947 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:21:08.064947 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 could not be found. Oct 23 01:21:08.064947 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:21:08.064947 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5f1cae61-6bdd-4a25-b1c5-b2af4f080161 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] Returning 404 to user: Instance d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:21:08.064947 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5f1cae61-6bdd-4a25-b1c5-b2af4f080161 tempest-ServerDiskConfigTestJSON-552182583 tempest-ServerDiskConfigTestJSON-552182583-project] 10.222.0.42 "GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1" status: 404 len: 111 microversion: 2.1 time: 0.080693 Oct 23 01:21:08.068954 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1452/2905] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:07 2022] GET /compute/v2.1/servers/d2d33142-cf85-4a5b-b63f-e3780f8ac0b1 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:21:08.078719 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-45ceb6be-9f33-4cef-86e0-8551eb260a33 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:08.080877 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-45ceb6be-9f33-4cef-86e0-8551eb260a33 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:08.095004 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=4 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:08.097510 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-45ceb6be-9f33-4cef-86e0-8551eb260a33 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:08.098373 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-45ceb6be-9f33-4cef-86e0-8551eb260a33 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:08.100310 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-45ceb6be-9f33-4cef-86e0-8551eb260a33 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:08.102441 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-45ceb6be-9f33-4cef-86e0-8551eb260a33 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:08.103219 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-45ceb6be-9f33-4cef-86e0-8551eb260a33 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:08.105014 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-45ceb6be-9f33-4cef-86e0-8551eb260a33 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:08.355761 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-45ceb6be-9f33-4cef-86e0-8551eb260a33 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lazy-loading 'services' on Instance uuid 2d7a734d-28b1-4d9f-b80d-c272576f8334 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:21:08.406074 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-45ceb6be-9f33-4cef-86e0-8551eb260a33 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334" status: 200 len: 1927 microversion: 2.75 time: 0.335628 Oct 23 01:21:08.406996 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1453/2906] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:21:08 2022] GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334 => generated 1927 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:21:08.430725 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-69701f29-973e-408f-b06a-61d9645d4bc8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:08.433110 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-69701f29-973e-408f-b06a-61d9645d4bc8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: ad3fdbf4-6dba-46a6-9132-e555185544b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:08.447543 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-69701f29-973e-408f-b06a-61d9645d4bc8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:08.448058 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-69701f29-973e-408f-b06a-61d9645d4bc8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:08.448506 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-69701f29-973e-408f-b06a-61d9645d4bc8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:08.449227 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-69701f29-973e-408f-b06a-61d9645d4bc8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:08.449694 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-69701f29-973e-408f-b06a-61d9645d4bc8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:08.450812 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-69701f29-973e-408f-b06a-61d9645d4bc8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:08.938340 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-28d2864b-069c-4424-bdb2-69f97bcd2a81 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74cdbbd7765495db29eb0428fadc992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee2e22f48754a4aa47426a27bebf68b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:08.963238 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-28d2864b-069c-4424-bdb2-69f97bcd2a81 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] 10.222.0.42 "GET /compute/v2.1/servers/e973f866-0efe-40cb-82d5-846992200098" status: 200 len: 1323 microversion: 2.1 time: 1.597447 Oct 23 01:21:08.964275 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1454/2907] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:07 2022] GET /compute/v2.1/servers/e973f866-0efe-40cb-82d5-846992200098 => generated 1323 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:08.971809 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c140ceee-5fc7-445d-984c-d3db48f6673c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc6286160>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:09.066556 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c140ceee-5fc7-445d-984c-d3db48f6673c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/d8995b1c-6b8e-4df7-b6c6-6372dcfaadbd" status: 200 len: 1413 microversion: 2.1 time: 0.099291 Oct 23 01:21:09.067444 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1455/2908] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:21:08 2022] GET /compute/v2.1/images/d8995b1c-6b8e-4df7-b6c6-6372dcfaadbd => generated 1413 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:09.092559 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bccde115-98bb-4a1d-8adb-66b9ff64d7d1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:09.093187 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-bccde115-98bb-4a1d-8adb-66b9ff64d7d1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:09.112163 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bccde115-98bb-4a1d-8adb-66b9ff64d7d1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:09.112849 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bccde115-98bb-4a1d-8adb-66b9ff64d7d1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:09.113751 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bccde115-98bb-4a1d-8adb-66b9ff64d7d1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:09.114517 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bccde115-98bb-4a1d-8adb-66b9ff64d7d1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:09.114977 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bccde115-98bb-4a1d-8adb-66b9ff64d7d1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:09.115403 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bccde115-98bb-4a1d-8adb-66b9ff64d7d1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:09.189414 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-69701f29-973e-408f-b06a-61d9645d4bc8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:09.203687 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-69701f29-973e-408f-b06a-61d9645d4bc8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0" status: 200 len: 1495 microversion: 2.1 time: 0.795606 Oct 23 01:21:09.204287 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1454/2909] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:08 2022] GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0 => generated 1495 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:09.480088 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bbb2c7bd-e59f-478f-9270-91ac2a7ec9cd tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:09.480711 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bbb2c7bd-e59f-478f-9270-91ac2a7ec9cd tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:09.496744 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bbb2c7bd-e59f-478f-9270-91ac2a7ec9cd tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:09.498435 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bbb2c7bd-e59f-478f-9270-91ac2a7ec9cd tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:09.503610 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bbb2c7bd-e59f-478f-9270-91ac2a7ec9cd tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:09.504607 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bbb2c7bd-e59f-478f-9270-91ac2a7ec9cd tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:09.507668 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bbb2c7bd-e59f-478f-9270-91ac2a7ec9cd tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:09.508284 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bbb2c7bd-e59f-478f-9270-91ac2a7ec9cd tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:09.790083 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-bbb2c7bd-e59f-478f-9270-91ac2a7ec9cd tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lazy-loading 'services' on Instance uuid 2d7a734d-28b1-4d9f-b80d-c272576f8334 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:21:09.818547 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bbb2c7bd-e59f-478f-9270-91ac2a7ec9cd tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334" status: 200 len: 1927 microversion: 2.75 time: 0.379126 Oct 23 01:21:09.843642 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1455/2910] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:21:09 2022] GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334 => generated 1927 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:21:09.994486 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-22a27f4b-64ac-430f-9b38-e9dc4820759a tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:09.995583 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-22a27f4b-64ac-430f-9b38-e9dc4820759a tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] [instance: e973f866-0efe-40cb-82d5-846992200098] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:10.009641 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-22a27f4b-64ac-430f-9b38-e9dc4820759a tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:10.010289 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-22a27f4b-64ac-430f-9b38-e9dc4820759a tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:10.010289 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-22a27f4b-64ac-430f-9b38-e9dc4820759a tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:10.010289 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-22a27f4b-64ac-430f-9b38-e9dc4820759a tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:10.010289 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-22a27f4b-64ac-430f-9b38-e9dc4820759a tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:10.010289 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-22a27f4b-64ac-430f-9b38-e9dc4820759a tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:10.579505 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bccde115-98bb-4a1d-8adb-66b9ff64d7d1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:10.591120 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bccde115-98bb-4a1d-8adb-66b9ff64d7d1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1518 microversion: 2.1 time: 1.515499 Oct 23 01:21:10.596795 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1456/2911] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:09 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1518 bytes in 1528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:10.604472 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c9673a4e-2e50-4c2c-8f19-1e485aba7caa tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc2230550>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:10.709691 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c9673a4e-2e50-4c2c-8f19-1e485aba7caa tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/d8995b1c-6b8e-4df7-b6c6-6372dcfaadbd" status: 200 len: 1413 microversion: 2.1 time: 0.111768 Oct 23 01:21:10.720155 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1457/2912] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:21:10 2022] GET /compute/v2.1/images/d8995b1c-6b8e-4df7-b6c6-6372dcfaadbd => generated 1413 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:10.733330 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5410d33b-53e2-4cb2-8bc0-4926293e8e4c tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:10.735298 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5410d33b-53e2-4cb2-8bc0-4926293e8e4c tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: ad3fdbf4-6dba-46a6-9132-e555185544b0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:10.750590 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5410d33b-53e2-4cb2-8bc0-4926293e8e4c tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:10.752039 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5410d33b-53e2-4cb2-8bc0-4926293e8e4c tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:10.753632 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5410d33b-53e2-4cb2-8bc0-4926293e8e4c tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:10.754747 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5410d33b-53e2-4cb2-8bc0-4926293e8e4c tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:10.756588 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5410d33b-53e2-4cb2-8bc0-4926293e8e4c tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:10.757608 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5410d33b-53e2-4cb2-8bc0-4926293e8e4c tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:11.152217 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-22a27f4b-64ac-430f-9b38-e9dc4820759a tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74cdbbd7765495db29eb0428fadc992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee2e22f48754a4aa47426a27bebf68b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:11.167578 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-22a27f4b-64ac-430f-9b38-e9dc4820759a tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] 10.222.0.42 "GET /compute/v2.1/servers/e973f866-0efe-40cb-82d5-846992200098" status: 200 len: 1323 microversion: 2.1 time: 1.174481 Oct 23 01:21:11.176211 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1456/2913] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:09 2022] GET /compute/v2.1/servers/e973f866-0efe-40cb-82d5-846992200098 => generated 1323 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:11.191347 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-979e73bb-5a8d-4be7-96c9-1df59348633c req-38acd91b-f047-4d10-907a-743845cdb0b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e973f866-0efe-40cb-82d5-846992200098", "tag": "3aa616ae-3a51-4e63-9266-36211026f582"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:21:11.219579 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-979e73bb-5a8d-4be7-96c9-1df59348633c req-38acd91b-f047-4d10-907a-743845cdb0b5 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:11.222076 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-979e73bb-5a8d-4be7-96c9-1df59348633c req-38acd91b-f047-4d10-907a-743845cdb0b5 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:11.225447 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-979e73bb-5a8d-4be7-96c9-1df59348633c req-38acd91b-f047-4d10-907a-743845cdb0b5 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:11.249319 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-979e73bb-5a8d-4be7-96c9-1df59348633c req-38acd91b-f047-4d10-907a-743845cdb0b5 service nova] Creating event network-changed:3aa616ae-3a51-4e63-9266-36211026f582 for instance e973f866-0efe-40cb-82d5-846992200098 on n-h1-master-1 Oct 23 01:21:11.272980 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-979e73bb-5a8d-4be7-96c9-1df59348633c req-38acd91b-f047-4d10-907a-743845cdb0b5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094712 Oct 23 01:21:11.283167 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1457/2914] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:21:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:21:11.291442 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a98826b3-5aeb-49a8-b68e-418ca2bb7689 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:11.292524 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a98826b3-5aeb-49a8-b68e-418ca2bb7689 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:11.313770 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a98826b3-5aeb-49a8-b68e-418ca2bb7689 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:11.314679 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a98826b3-5aeb-49a8-b68e-418ca2bb7689 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:11.315346 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a98826b3-5aeb-49a8-b68e-418ca2bb7689 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:11.316296 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a98826b3-5aeb-49a8-b68e-418ca2bb7689 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:11.316967 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a98826b3-5aeb-49a8-b68e-418ca2bb7689 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:11.317601 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a98826b3-5aeb-49a8-b68e-418ca2bb7689 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:11.836365 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-a98826b3-5aeb-49a8-b68e-418ca2bb7689 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lazy-loading 'services' on Instance uuid 2d7a734d-28b1-4d9f-b80d-c272576f8334 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:21:11.882655 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a98826b3-5aeb-49a8-b68e-418ca2bb7689 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334" status: 200 len: 1927 microversion: 2.75 time: 0.595087 Oct 23 01:21:11.884613 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1458/2915] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:21:11 2022] GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334 => generated 1927 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:21:11.891068 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2718af69-62a9-428e-a90a-9967399d8b31 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:11.891863 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2718af69-62a9-428e-a90a-9967399d8b31 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:11.904684 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2718af69-62a9-428e-a90a-9967399d8b31 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:11.905426 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2718af69-62a9-428e-a90a-9967399d8b31 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:11.906075 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2718af69-62a9-428e-a90a-9967399d8b31 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:11.906964 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2718af69-62a9-428e-a90a-9967399d8b31 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:11.907570 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2718af69-62a9-428e-a90a-9967399d8b31 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:11.908149 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2718af69-62a9-428e-a90a-9967399d8b31 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:11.969244 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:12.009681 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5410d33b-53e2-4cb2-8bc0-4926293e8e4c tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:12.022013 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5410d33b-53e2-4cb2-8bc0-4926293e8e4c tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0" status: 200 len: 1495 microversion: 2.1 time: 1.300475 Oct 23 01:21:12.023941 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1458/2916] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:10 2022] GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0 => generated 1495 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:12.030388 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3d64dd84-009c-4cba-88c4-615c1b645d1c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc62869d0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:12.083686 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3d64dd84-009c-4cba-88c4-615c1b645d1c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/d8995b1c-6b8e-4df7-b6c6-6372dcfaadbd" status: 200 len: 1413 microversion: 2.1 time: 0.058081 Oct 23 01:21:12.084636 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1459/2917] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:21:12 2022] GET /compute/v2.1/images/d8995b1c-6b8e-4df7-b6c6-6372dcfaadbd => generated 1413 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:12.198263 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4386c801-5bf2-40ac-848d-5d79ddfe8679 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:12.199426 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4386c801-5bf2-40ac-848d-5d79ddfe8679 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] [instance: e973f866-0efe-40cb-82d5-846992200098] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:12.210881 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4386c801-5bf2-40ac-848d-5d79ddfe8679 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:12.220680 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4386c801-5bf2-40ac-848d-5d79ddfe8679 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:12.221463 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4386c801-5bf2-40ac-848d-5d79ddfe8679 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:12.226934 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4386c801-5bf2-40ac-848d-5d79ddfe8679 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:12.226934 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4386c801-5bf2-40ac-848d-5d79ddfe8679 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:12.226934 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4386c801-5bf2-40ac-848d-5d79ddfe8679 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:12.489834 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2718af69-62a9-428e-a90a-9967399d8b31 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:12.498168 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2718af69-62a9-428e-a90a-9967399d8b31 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1518 microversion: 2.1 time: 0.612264 Oct 23 01:21:12.498769 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1459/2918] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:11 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1518 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:12.684119 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4386c801-5bf2-40ac-848d-5d79ddfe8679 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74cdbbd7765495db29eb0428fadc992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee2e22f48754a4aa47426a27bebf68b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:12.696168 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4386c801-5bf2-40ac-848d-5d79ddfe8679 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] 10.222.0.42 "GET /compute/v2.1/servers/e973f866-0efe-40cb-82d5-846992200098" status: 200 len: 1323 microversion: 2.1 time: 0.501845 Oct 23 01:21:12.706155 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1460/2919] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:12 2022] GET /compute/v2.1/servers/e973f866-0efe-40cb-82d5-846992200098 => generated 1323 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:21:12.922720 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-98347620-24df-4a4c-9e84-9a89255b74ed tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:12.926109 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-98347620-24df-4a4c-9e84-9a89255b74ed tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:12.935934 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-98347620-24df-4a4c-9e84-9a89255b74ed tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:12.936647 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-98347620-24df-4a4c-9e84-9a89255b74ed tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:12.937264 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-98347620-24df-4a4c-9e84-9a89255b74ed tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:12.938219 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-98347620-24df-4a4c-9e84-9a89255b74ed tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:12.939525 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-98347620-24df-4a4c-9e84-9a89255b74ed tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:12.940314 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-98347620-24df-4a4c-9e84-9a89255b74ed tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:13.048424 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f9525102-d206-4eab-a17c-40a70abc0686 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:13.049191 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f9525102-d206-4eab-a17c-40a70abc0686 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: ad3fdbf4-6dba-46a6-9132-e555185544b0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:13.058271 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f9525102-d206-4eab-a17c-40a70abc0686 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:13.063804 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f9525102-d206-4eab-a17c-40a70abc0686 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:13.066300 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f9525102-d206-4eab-a17c-40a70abc0686 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:13.067253 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f9525102-d206-4eab-a17c-40a70abc0686 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:13.070473 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f9525102-d206-4eab-a17c-40a70abc0686 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:13.073313 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f9525102-d206-4eab-a17c-40a70abc0686 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:13.136407 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-98347620-24df-4a4c-9e84-9a89255b74ed tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lazy-loading 'services' on Instance uuid 2d7a734d-28b1-4d9f-b80d-c272576f8334 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:21:13.166679 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-98347620-24df-4a4c-9e84-9a89255b74ed tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334" status: 200 len: 1927 microversion: 2.75 time: 0.251940 Oct 23 01:21:13.167963 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1460/2920] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:21:12 2022] GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334 => generated 1927 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:21:13.173101 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fb0a9afe-3ba8-4be0-a23b-d546df074551 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc1bb7d30>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:13.232230 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fb0a9afe-3ba8-4be0-a23b-d546df074551 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/d8995b1c-6b8e-4df7-b6c6-6372dcfaadbd" status: 200 len: 1413 microversion: 2.1 time: 0.062829 Oct 23 01:21:13.233461 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1461/2921] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:21:13 2022] GET /compute/v2.1/images/d8995b1c-6b8e-4df7-b6c6-6372dcfaadbd => generated 1413 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:13.527097 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-450201fd-4d2a-4d7c-bfae-74e3f68c2fb4 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:13.528862 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-450201fd-4d2a-4d7c-bfae-74e3f68c2fb4 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:13.537469 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-450201fd-4d2a-4d7c-bfae-74e3f68c2fb4 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:13.537966 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-450201fd-4d2a-4d7c-bfae-74e3f68c2fb4 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:13.538688 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-450201fd-4d2a-4d7c-bfae-74e3f68c2fb4 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:13.539462 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-450201fd-4d2a-4d7c-bfae-74e3f68c2fb4 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:13.539925 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-450201fd-4d2a-4d7c-bfae-74e3f68c2fb4 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:13.540412 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-450201fd-4d2a-4d7c-bfae-74e3f68c2fb4 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:13.561424 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f9525102-d206-4eab-a17c-40a70abc0686 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:13.571232 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f9525102-d206-4eab-a17c-40a70abc0686 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0" status: 200 len: 1495 microversion: 2.1 time: 0.526294 Oct 23 01:21:13.572417 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1461/2922] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:13 2022] GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0 => generated 1495 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:13.728152 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-687e43bb-7577-433e-ac2d-80a465dbb207 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:13.728878 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-687e43bb-7577-433e-ac2d-80a465dbb207 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] [instance: e973f866-0efe-40cb-82d5-846992200098] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:13.738883 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-687e43bb-7577-433e-ac2d-80a465dbb207 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:13.742504 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-687e43bb-7577-433e-ac2d-80a465dbb207 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:13.750123 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-687e43bb-7577-433e-ac2d-80a465dbb207 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:13.750123 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-687e43bb-7577-433e-ac2d-80a465dbb207 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:13.750123 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-687e43bb-7577-433e-ac2d-80a465dbb207 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:13.750123 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-687e43bb-7577-433e-ac2d-80a465dbb207 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:13.959916 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-450201fd-4d2a-4d7c-bfae-74e3f68c2fb4 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:13.980357 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-450201fd-4d2a-4d7c-bfae-74e3f68c2fb4 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1518 microversion: 2.1 time: 0.458115 Oct 23 01:21:13.984738 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1462/2923] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:13 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1518 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:21:13.991658 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-f4ff4d4a-6282-4ec5-ad76-1dd1d34d1c67 req-d25b763c-e25b-459f-b94e-d473829d1287 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62a8ad26-f65b-432d-a8da-48264c426335", "tag": "56917629-dd5e-4c91-a45e-1e8e6cd25138"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:21:14.010812 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-f4ff4d4a-6282-4ec5-ad76-1dd1d34d1c67 req-d25b763c-e25b-459f-b94e-d473829d1287 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:14.011493 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-f4ff4d4a-6282-4ec5-ad76-1dd1d34d1c67 req-d25b763c-e25b-459f-b94e-d473829d1287 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:14.012386 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-f4ff4d4a-6282-4ec5-ad76-1dd1d34d1c67 req-d25b763c-e25b-459f-b94e-d473829d1287 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:14.031593 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-f4ff4d4a-6282-4ec5-ad76-1dd1d34d1c67 req-d25b763c-e25b-459f-b94e-d473829d1287 service nova] Creating event network-changed:56917629-dd5e-4c91-a45e-1e8e6cd25138 for instance 62a8ad26-f65b-432d-a8da-48264c426335 on n-h1-master-1 Oct 23 01:21:14.068784 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-f4ff4d4a-6282-4ec5-ad76-1dd1d34d1c67 req-d25b763c-e25b-459f-b94e-d473829d1287 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078292 Oct 23 01:21:14.070557 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1463/2924] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:21:14.202183 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7ff79115-772b-4229-9702-a1ec453341fe tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:14.204872 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7ff79115-772b-4229-9702-a1ec453341fe tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:14.212471 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ff79115-772b-4229-9702-a1ec453341fe tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:14.213789 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ff79115-772b-4229-9702-a1ec453341fe tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:14.214329 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ff79115-772b-4229-9702-a1ec453341fe tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:14.216028 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ff79115-772b-4229-9702-a1ec453341fe tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:14.216495 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ff79115-772b-4229-9702-a1ec453341fe tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:14.217525 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ff79115-772b-4229-9702-a1ec453341fe tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:14.228239 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-687e43bb-7577-433e-ac2d-80a465dbb207 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74cdbbd7765495db29eb0428fadc992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee2e22f48754a4aa47426a27bebf68b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:14.242389 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-687e43bb-7577-433e-ac2d-80a465dbb207 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] 10.222.0.42 "GET /compute/v2.1/servers/e973f866-0efe-40cb-82d5-846992200098" status: 200 len: 1323 microversion: 2.1 time: 0.522015 Oct 23 01:21:14.246069 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1462/2925] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:13 2022] GET /compute/v2.1/servers/e973f866-0efe-40cb-82d5-846992200098 => generated 1323 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:14.253699 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-886162a6-b379-46ba-bf61-e0d34e3c7908 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc22b3b80>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:14.342419 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-886162a6-b379-46ba-bf61-e0d34e3c7908 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/d8995b1c-6b8e-4df7-b6c6-6372dcfaadbd" status: 200 len: 1413 microversion: 2.1 time: 0.094631 Oct 23 01:21:14.343434 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1463/2926] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:21:14 2022] GET /compute/v2.1/images/d8995b1c-6b8e-4df7-b6c6-6372dcfaadbd => generated 1413 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:14.412563 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-7ff79115-772b-4229-9702-a1ec453341fe tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lazy-loading 'services' on Instance uuid 2d7a734d-28b1-4d9f-b80d-c272576f8334 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:21:14.447014 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7ff79115-772b-4229-9702-a1ec453341fe tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334" status: 200 len: 1927 microversion: 2.75 time: 0.252593 Oct 23 01:21:14.462844 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1464/2927] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:21:14 2022] GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334 => generated 1927 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:21:14.597452 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-73f8abee-44d7-4522-b323-25021c47909d tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:14.598474 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-73f8abee-44d7-4522-b323-25021c47909d tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: ad3fdbf4-6dba-46a6-9132-e555185544b0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:14.607080 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-73f8abee-44d7-4522-b323-25021c47909d tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:14.607874 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-73f8abee-44d7-4522-b323-25021c47909d tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:14.608416 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-73f8abee-44d7-4522-b323-25021c47909d tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:14.609698 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-73f8abee-44d7-4522-b323-25021c47909d tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:14.610425 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-73f8abee-44d7-4522-b323-25021c47909d tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:14.611080 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-73f8abee-44d7-4522-b323-25021c47909d tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:15.008087 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d3a4287d-9305-478c-896c-4e4047cf1797 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:15.008655 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d3a4287d-9305-478c-896c-4e4047cf1797 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:15.021151 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d3a4287d-9305-478c-896c-4e4047cf1797 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:15.021665 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d3a4287d-9305-478c-896c-4e4047cf1797 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:15.022147 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d3a4287d-9305-478c-896c-4e4047cf1797 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:15.034518 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d3a4287d-9305-478c-896c-4e4047cf1797 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:15.035189 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d3a4287d-9305-478c-896c-4e4047cf1797 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:15.035797 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d3a4287d-9305-478c-896c-4e4047cf1797 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:15.707754 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-73f8abee-44d7-4522-b323-25021c47909d tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:15.734379 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-73f8abee-44d7-4522-b323-25021c47909d tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0" status: 200 len: 1501 microversion: 2.1 time: 1.140638 Oct 23 01:21:15.740504 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1464/2928] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:14 2022] GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0 => generated 1501 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:15.750357 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8a673e67-d10c-448d-bddd-695cd460074d tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:15.751454 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8a673e67-d10c-448d-bddd-695cd460074d tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] [instance: e973f866-0efe-40cb-82d5-846992200098] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:15.787855 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a673e67-d10c-448d-bddd-695cd460074d tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:15.788633 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a673e67-d10c-448d-bddd-695cd460074d tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:15.790653 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a673e67-d10c-448d-bddd-695cd460074d tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:15.792347 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a673e67-d10c-448d-bddd-695cd460074d tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:15.793939 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a673e67-d10c-448d-bddd-695cd460074d tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:15.794944 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a673e67-d10c-448d-bddd-695cd460074d tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:15.829660 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d3a4287d-9305-478c-896c-4e4047cf1797 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:15.842015 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d3a4287d-9305-478c-896c-4e4047cf1797 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1518 microversion: 2.1 time: 0.838013 Oct 23 01:21:15.842635 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1465/2929] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:15 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1518 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:15.850117 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1517d278-c782-46c5-b428-3430681f8f47 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc1bb63a0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:15.921455 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1517d278-c782-46c5-b428-3430681f8f47 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/d8995b1c-6b8e-4df7-b6c6-6372dcfaadbd" status: 200 len: 1413 microversion: 2.1 time: 0.077754 Oct 23 01:21:15.922840 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1466/2930] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:21:15 2022] GET /compute/v2.1/images/d8995b1c-6b8e-4df7-b6c6-6372dcfaadbd => generated 1413 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:15.928760 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-257b05c9-4766-4224-bf66-733bfd8becef tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:15.929573 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-257b05c9-4766-4224-bf66-733bfd8becef tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:15.936462 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:15.938557 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-257b05c9-4766-4224-bf66-733bfd8becef tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:15.939224 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-257b05c9-4766-4224-bf66-733bfd8becef tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:15.939851 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-257b05c9-4766-4224-bf66-733bfd8becef tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:15.940731 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-257b05c9-4766-4224-bf66-733bfd8becef tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:15.941353 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-257b05c9-4766-4224-bf66-733bfd8becef tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:15.941944 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-257b05c9-4766-4224-bf66-733bfd8becef tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:16.313065 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-257b05c9-4766-4224-bf66-733bfd8becef tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lazy-loading 'services' on Instance uuid 2d7a734d-28b1-4d9f-b80d-c272576f8334 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:21:16.363716 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-257b05c9-4766-4224-bf66-733bfd8becef tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334" status: 200 len: 1927 microversion: 2.75 time: 0.439612 Oct 23 01:21:16.366698 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1467/2931] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:21:15 2022] GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334 => generated 1927 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:21:16.377095 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0470cc40-30a9-46ba-a10f-c97fbc071130 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:16.384233 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0470cc40-30a9-46ba-a10f-c97fbc071130 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: ad3fdbf4-6dba-46a6-9132-e555185544b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:16.394230 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0470cc40-30a9-46ba-a10f-c97fbc071130 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:16.396674 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0470cc40-30a9-46ba-a10f-c97fbc071130 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:16.399396 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0470cc40-30a9-46ba-a10f-c97fbc071130 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:16.400677 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0470cc40-30a9-46ba-a10f-c97fbc071130 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:16.402769 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0470cc40-30a9-46ba-a10f-c97fbc071130 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:16.403772 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0470cc40-30a9-46ba-a10f-c97fbc071130 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:16.423975 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8a673e67-d10c-448d-bddd-695cd460074d tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74cdbbd7765495db29eb0428fadc992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee2e22f48754a4aa47426a27bebf68b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:16.437528 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8a673e67-d10c-448d-bddd-695cd460074d tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] 10.222.0.42 "GET /compute/v2.1/servers/e973f866-0efe-40cb-82d5-846992200098" status: 200 len: 1323 microversion: 2.1 time: 0.696028 Oct 23 01:21:16.445728 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1465/2932] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:15 2022] GET /compute/v2.1/servers/e973f866-0efe-40cb-82d5-846992200098 => generated 1323 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:16.492919 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0470cc40-30a9-46ba-a10f-c97fbc071130 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: ad3fdbf4-6dba-46a6-9132-e555185544b0] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:21:16.875661 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3379bfd9-9f43-40ce-a872-d78a497cdf36 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:16.876395 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3379bfd9-9f43-40ce-a872-d78a497cdf36 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:16.904527 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3379bfd9-9f43-40ce-a872-d78a497cdf36 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:16.904527 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3379bfd9-9f43-40ce-a872-d78a497cdf36 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:16.906294 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3379bfd9-9f43-40ce-a872-d78a497cdf36 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:16.910630 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3379bfd9-9f43-40ce-a872-d78a497cdf36 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:16.913009 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3379bfd9-9f43-40ce-a872-d78a497cdf36 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:16.915411 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3379bfd9-9f43-40ce-a872-d78a497cdf36 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:16.927541 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0470cc40-30a9-46ba-a10f-c97fbc071130 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0" status: 204 len: 0 microversion: 2.1 time: 0.559278 Oct 23 01:21:16.928894 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1468/2933] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:21:16 2022] DELETE /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:21:16.942714 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2580f59d-c1c5-46d6-8472-ea49d1e48345 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:16.944445 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2580f59d-c1c5-46d6-8472-ea49d1e48345 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: ad3fdbf4-6dba-46a6-9132-e555185544b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:16.970708 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2580f59d-c1c5-46d6-8472-ea49d1e48345 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:16.973185 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2580f59d-c1c5-46d6-8472-ea49d1e48345 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:16.974609 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2580f59d-c1c5-46d6-8472-ea49d1e48345 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:16.975531 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2580f59d-c1c5-46d6-8472-ea49d1e48345 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:16.976881 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2580f59d-c1c5-46d6-8472-ea49d1e48345 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:16.980379 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2580f59d-c1c5-46d6-8472-ea49d1e48345 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:17.325336 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2580f59d-c1c5-46d6-8472-ea49d1e48345 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:17.338783 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2580f59d-c1c5-46d6-8472-ea49d1e48345 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0" status: 200 len: 1507 microversion: 2.1 time: 0.404962 Oct 23 01:21:17.339950 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1469/2934] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:16 2022] GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0 => generated 1507 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:17.350634 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9925764d-1cb0-458a-ab63-911ba508bbac tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc1e4fc10>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:17.427860 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3379bfd9-9f43-40ce-a872-d78a497cdf36 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:17.438763 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3379bfd9-9f43-40ce-a872-d78a497cdf36 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1518 microversion: 2.1 time: 0.568916 Oct 23 01:21:17.441430 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1466/2935] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:16 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1518 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:21:17.448075 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9925764d-1cb0-458a-ab63-911ba508bbac tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/d8995b1c-6b8e-4df7-b6c6-6372dcfaadbd" status: 200 len: 1422 microversion: 2.1 time: 0.106659 Oct 23 01:21:17.451205 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1470/2936] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:21:17 2022] GET /compute/v2.1/images/d8995b1c-6b8e-4df7-b6c6-6372dcfaadbd => generated 1422 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:17.453589 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-08bc93fb-52cd-424e-8be6-04bf13e6c137 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:17.453589 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-08bc93fb-52cd-424e-8be6-04bf13e6c137 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:17.459795 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-08bc93fb-52cd-424e-8be6-04bf13e6c137 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:17.460282 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-08bc93fb-52cd-424e-8be6-04bf13e6c137 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:17.460777 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-08bc93fb-52cd-424e-8be6-04bf13e6c137 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:17.466926 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b4b63f97-0a66-40d4-8191-72082d3c965a tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc3ee25e0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:17.475181 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-08bc93fb-52cd-424e-8be6-04bf13e6c137 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:17.475181 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-08bc93fb-52cd-424e-8be6-04bf13e6c137 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:17.475181 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-08bc93fb-52cd-424e-8be6-04bf13e6c137 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:17.579538 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b4b63f97-0a66-40d4-8191-72082d3c965a tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/d8995b1c-6b8e-4df7-b6c6-6372dcfaadbd" status: 200 len: 1422 microversion: 2.1 time: 0.117228 Oct 23 01:21:17.580684 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1471/2937] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:21:17 2022] GET /compute/v2.1/images/d8995b1c-6b8e-4df7-b6c6-6372dcfaadbd => generated 1422 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:21:17.589784 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e0b5aeb0-455c-4388-867c-4ca4d35a4ade tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:17.590674 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e0b5aeb0-455c-4388-867c-4ca4d35a4ade tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] [instance: e973f866-0efe-40cb-82d5-846992200098] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:17.623459 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0b5aeb0-455c-4388-867c-4ca4d35a4ade tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:17.623962 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0b5aeb0-455c-4388-867c-4ca4d35a4ade tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:17.624406 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0b5aeb0-455c-4388-867c-4ca4d35a4ade tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:17.641732 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0b5aeb0-455c-4388-867c-4ca4d35a4ade tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:17.642298 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0b5aeb0-455c-4388-867c-4ca4d35a4ade tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:17.646804 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0b5aeb0-455c-4388-867c-4ca4d35a4ade tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:17.767942 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-08bc93fb-52cd-424e-8be6-04bf13e6c137 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lazy-loading 'services' on Instance uuid 2d7a734d-28b1-4d9f-b80d-c272576f8334 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:21:17.865542 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-08bc93fb-52cd-424e-8be6-04bf13e6c137 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334" status: 200 len: 1927 microversion: 2.75 time: 0.419138 Oct 23 01:21:17.866412 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1467/2938] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:21:17 2022] GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334 => generated 1927 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:21:17.882240 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-853620ac-32cb-4e0c-8650-68e121d64a1c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-2091811600", "imageRef": "d8995b1c-6b8e-4df7-b6c6-6372dcfaadbd", "flavorRef": "452", "networks": [{"uuid": "7a6a6c21-62ee-4ff5-ad89-ac85c31d0d64"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:21:18.050508 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-853620ac-32cb-4e0c-8650-68e121d64a1c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] validate_networks() for [('7a6a6c21-62ee-4ff5-ad89-ac85c31d0d64', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:21:18.197600 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e0b5aeb0-455c-4388-867c-4ca4d35a4ade tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74cdbbd7765495db29eb0428fadc992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee2e22f48754a4aa47426a27bebf68b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:18.205998 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e0b5aeb0-455c-4388-867c-4ca4d35a4ade tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] 10.222.0.42 "GET /compute/v2.1/servers/e973f866-0efe-40cb-82d5-846992200098" status: 200 len: 1323 microversion: 2.1 time: 0.622229 Oct 23 01:21:18.209304 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1472/2939] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:17 2022] GET /compute/v2.1/servers/e973f866-0efe-40cb-82d5-846992200098 => generated 1323 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:18.510665 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-da8c6129-caac-4d97-bd1a-d1d16fe97502 tempest-ServicesAdminNegativeTestJSON-1550800104 tempest-ServicesAdminNegativeTestJSON-1550800104-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:18.515880 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-da8c6129-caac-4d97-bd1a-d1d16fe97502 tempest-ServicesAdminNegativeTestJSON-1550800104 tempest-ServicesAdminNegativeTestJSON-1550800104-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:18.515880 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-da8c6129-caac-4d97-bd1a-d1d16fe97502 tempest-ServicesAdminNegativeTestJSON-1550800104 tempest-ServicesAdminNegativeTestJSON-1550800104-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:18.519382 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-da8c6129-caac-4d97-bd1a-d1d16fe97502 tempest-ServicesAdminNegativeTestJSON-1550800104 tempest-ServicesAdminNegativeTestJSON-1550800104-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:18.520298 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-da8c6129-caac-4d97-bd1a-d1d16fe97502 tempest-ServicesAdminNegativeTestJSON-1550800104 tempest-ServicesAdminNegativeTestJSON-1550800104-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:18.524392 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-da8c6129-caac-4d97-bd1a-d1d16fe97502 tempest-ServicesAdminNegativeTestJSON-1550800104 tempest-ServicesAdminNegativeTestJSON-1550800104-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:18.529415 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-da8c6129-caac-4d97-bd1a-d1d16fe97502 tempest-ServicesAdminNegativeTestJSON-1550800104 tempest-ServicesAdminNegativeTestJSON-1550800104-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:18.618247 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-da8c6129-caac-4d97-bd1a-d1d16fe97502 tempest-ServicesAdminNegativeTestJSON-1550800104 tempest-ServicesAdminNegativeTestJSON-1550800104-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.407170 Oct 23 01:21:18.619960 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1473/2940] 10.222.0.42 () {58 vars in 1137 bytes} [Sun Oct 23 01:21:18 2022] GET /compute/v2.1/os-services => generated 944 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:21:18.631316 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-67a03ff3-ecd7-4923-bd1d-73d877c9735a tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:18.635473 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-67a03ff3-ecd7-4923-bd1d-73d877c9735a tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: ad3fdbf4-6dba-46a6-9132-e555185544b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:18.648581 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-67a03ff3-ecd7-4923-bd1d-73d877c9735a tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:18.655037 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-67a03ff3-ecd7-4923-bd1d-73d877c9735a tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:18.655852 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-67a03ff3-ecd7-4923-bd1d-73d877c9735a tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:18.656845 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-67a03ff3-ecd7-4923-bd1d-73d877c9735a tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:18.658453 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-67a03ff3-ecd7-4923-bd1d-73d877c9735a tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:18.659142 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-67a03ff3-ecd7-4923-bd1d-73d877c9735a tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:18.951084 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-67a03ff3-ecd7-4923-bd1d-73d877c9735a tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:18.962924 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-67a03ff3-ecd7-4923-bd1d-73d877c9735a tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0" status: 200 len: 1507 microversion: 2.1 time: 0.341681 Oct 23 01:21:18.965651 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-853620ac-32cb-4e0c-8650-68e121d64a1c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:21:18.972161 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-853620ac-32cb-4e0c-8650-68e121d64a1c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:21:18.973032 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-853620ac-32cb-4e0c-8650-68e121d64a1c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:21:18.974469 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-853620ac-32cb-4e0c-8650-68e121d64a1c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:21:18.975170 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-853620ac-32cb-4e0c-8650-68e121d64a1c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:21:18.978620 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1474/2941] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:18 2022] GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0 => generated 1507 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:18.990202 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3b3174e5-722e-41b7-91f6-00b5f9b4530c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:18.991227 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3b3174e5-722e-41b7-91f6-00b5f9b4530c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:18.999447 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3b3174e5-722e-41b7-91f6-00b5f9b4530c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:19.000207 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3b3174e5-722e-41b7-91f6-00b5f9b4530c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:19.000822 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3b3174e5-722e-41b7-91f6-00b5f9b4530c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:19.001824 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3b3174e5-722e-41b7-91f6-00b5f9b4530c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:19.002821 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3b3174e5-722e-41b7-91f6-00b5f9b4530c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:19.003399 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3b3174e5-722e-41b7-91f6-00b5f9b4530c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:19.014350 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-853620ac-32cb-4e0c-8650-68e121d64a1c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:19.015074 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-853620ac-32cb-4e0c-8650-68e121d64a1c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:19.020107 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-853620ac-32cb-4e0c-8650-68e121d64a1c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:19.021897 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-853620ac-32cb-4e0c-8650-68e121d64a1c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:19.023009 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-853620ac-32cb-4e0c-8650-68e121d64a1c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:19.023540 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-853620ac-32cb-4e0c-8650-68e121d64a1c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:19.117567 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-853620ac-32cb-4e0c-8650-68e121d64a1c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Getting quotas for project 50bd4c137b6a42488f39d173d46520dd. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:21:19.131096 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-853620ac-32cb-4e0c-8650-68e121d64a1c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Getting quotas for user ecb97fa679eb4bf8a41862d3c248a217 and project 50bd4c137b6a42488f39d173d46520dd. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:21:19.158994 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-853620ac-32cb-4e0c-8650-68e121d64a1c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:21:19.166014 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-853620ac-32cb-4e0c-8650-68e121d64a1c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: ff868ee0-f1e4-4c03-a039-c0a6cd548b58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8995b1c-6b8e-4df7-b6c6-6372dcfaadbd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:21:19.276795 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3b3174e5-722e-41b7-91f6-00b5f9b4530c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:19.298018 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3b3174e5-722e-41b7-91f6-00b5f9b4530c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1518 microversion: 2.1 time: 0.316788 Oct 23 01:21:19.299989 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1475/2942] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:18 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1518 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:19.313935 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fd199208-4be2-442b-9f0f-c6060a446f42 tempest-ServicesAdminNegativeTestJSON-1550800104 tempest-ServicesAdminNegativeTestJSON-1550800104-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:19.325773 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fd199208-4be2-442b-9f0f-c6060a446f42 tempest-ServicesAdminNegativeTestJSON-1550800104 tempest-ServicesAdminNegativeTestJSON-1550800104-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:19.326343 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fd199208-4be2-442b-9f0f-c6060a446f42 tempest-ServicesAdminNegativeTestJSON-1550800104 tempest-ServicesAdminNegativeTestJSON-1550800104-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:19.326789 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fd199208-4be2-442b-9f0f-c6060a446f42 tempest-ServicesAdminNegativeTestJSON-1550800104 tempest-ServicesAdminNegativeTestJSON-1550800104-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:19.327522 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fd199208-4be2-442b-9f0f-c6060a446f42 tempest-ServicesAdminNegativeTestJSON-1550800104 tempest-ServicesAdminNegativeTestJSON-1550800104-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:19.328040 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fd199208-4be2-442b-9f0f-c6060a446f42 tempest-ServicesAdminNegativeTestJSON-1550800104 tempest-ServicesAdminNegativeTestJSON-1550800104-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:19.328459 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fd199208-4be2-442b-9f0f-c6060a446f42 tempest-ServicesAdminNegativeTestJSON-1550800104 tempest-ServicesAdminNegativeTestJSON-1550800104-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:19.380559 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fd199208-4be2-442b-9f0f-c6060a446f42 tempest-ServicesAdminNegativeTestJSON-1550800104 tempest-ServicesAdminNegativeTestJSON-1550800104-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.078223 Oct 23 01:21:19.390567 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-853620ac-32cb-4e0c-8650-68e121d64a1c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.517748 Oct 23 01:21:19.391766 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1476/2944] 10.222.0.42 () {58 vars in 1170 bytes} [Sun Oct 23 01:21:19 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:21:19.392293 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1468/2944] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:21:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:21:19.401501 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-17454980-6f3c-4ce7-a647-9ad9e9420b1b tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:19.411691 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-17454980-6f3c-4ce7-a647-9ad9e9420b1b tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:19.416542 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8dbbbb67-a674-462f-aade-3259b5433436 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:19.417378 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8dbbbb67-a674-462f-aade-3259b5433436 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] [instance: e973f866-0efe-40cb-82d5-846992200098] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:19.432179 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-17454980-6f3c-4ce7-a647-9ad9e9420b1b tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:19.437617 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-17454980-6f3c-4ce7-a647-9ad9e9420b1b tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:19.437617 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-17454980-6f3c-4ce7-a647-9ad9e9420b1b tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:19.437617 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-17454980-6f3c-4ce7-a647-9ad9e9420b1b tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:19.437617 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-17454980-6f3c-4ce7-a647-9ad9e9420b1b tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:19.437617 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-17454980-6f3c-4ce7-a647-9ad9e9420b1b tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:19.439025 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8dbbbb67-a674-462f-aade-3259b5433436 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:19.439025 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8dbbbb67-a674-462f-aade-3259b5433436 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:19.439025 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8dbbbb67-a674-462f-aade-3259b5433436 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:19.439025 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8dbbbb67-a674-462f-aade-3259b5433436 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:19.439753 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8dbbbb67-a674-462f-aade-3259b5433436 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:19.440418 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8dbbbb67-a674-462f-aade-3259b5433436 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:19.893666 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-17454980-6f3c-4ce7-a647-9ad9e9420b1b tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lazy-loading 'services' on Instance uuid 2d7a734d-28b1-4d9f-b80d-c272576f8334 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:21:19.962701 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-17454980-6f3c-4ce7-a647-9ad9e9420b1b tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334" status: 200 len: 1927 microversion: 2.75 time: 0.568971 Oct 23 01:21:19.963303 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1469/2945] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:21:19 2022] GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334 => generated 1927 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:21:20.217699 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-0ef3da3a-ccd1-4d21-bc9f-c928a40525a2 req-04816313-c9cc-46be-b492-e80a73b91de4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e973f866-0efe-40cb-82d5-846992200098", "name": "network-vif-plugged", "status": "completed", "tag": "3aa616ae-3a51-4e63-9266-36211026f582"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:21:20.250006 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-0ef3da3a-ccd1-4d21-bc9f-c928a40525a2 req-04816313-c9cc-46be-b492-e80a73b91de4 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:20.255235 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-0ef3da3a-ccd1-4d21-bc9f-c928a40525a2 req-04816313-c9cc-46be-b492-e80a73b91de4 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:20.258804 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-0ef3da3a-ccd1-4d21-bc9f-c928a40525a2 req-04816313-c9cc-46be-b492-e80a73b91de4 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:20.300494 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-0ef3da3a-ccd1-4d21-bc9f-c928a40525a2 req-04816313-c9cc-46be-b492-e80a73b91de4 service nova] Creating event network-vif-plugged:3aa616ae-3a51-4e63-9266-36211026f582 for instance e973f866-0efe-40cb-82d5-846992200098 on n-h1-master-1 Oct 23 01:21:20.323417 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-0ef3da3a-ccd1-4d21-bc9f-c928a40525a2 req-04816313-c9cc-46be-b492-e80a73b91de4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.350021 Oct 23 01:21:20.323417 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1470/2946] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:21:20.350246 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ab3f7e7d-f070-4683-a336-b9f71607554b tempest-ServicesAdminNegativeTestJSON-1550800104 tempest-ServicesAdminNegativeTestJSON-1550800104-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:20.380071 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ab3f7e7d-f070-4683-a336-b9f71607554b tempest-ServicesAdminNegativeTestJSON-1550800104 tempest-ServicesAdminNegativeTestJSON-1550800104-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:20.382744 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ab3f7e7d-f070-4683-a336-b9f71607554b tempest-ServicesAdminNegativeTestJSON-1550800104 tempest-ServicesAdminNegativeTestJSON-1550800104-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:20.383194 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ab3f7e7d-f070-4683-a336-b9f71607554b tempest-ServicesAdminNegativeTestJSON-1550800104 tempest-ServicesAdminNegativeTestJSON-1550800104-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:20.384011 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ab3f7e7d-f070-4683-a336-b9f71607554b tempest-ServicesAdminNegativeTestJSON-1550800104 tempest-ServicesAdminNegativeTestJSON-1550800104-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:20.384466 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ab3f7e7d-f070-4683-a336-b9f71607554b tempest-ServicesAdminNegativeTestJSON-1550800104 tempest-ServicesAdminNegativeTestJSON-1550800104-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:20.389849 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8dbbbb67-a674-462f-aade-3259b5433436 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74cdbbd7765495db29eb0428fadc992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee2e22f48754a4aa47426a27bebf68b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:20.408507 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ab3f7e7d-f070-4683-a336-b9f71607554b tempest-ServicesAdminNegativeTestJSON-1550800104 tempest-ServicesAdminNegativeTestJSON-1550800104-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:20.431279 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8dbbbb67-a674-462f-aade-3259b5433436 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] 10.222.0.42 "GET /compute/v2.1/servers/e973f866-0efe-40cb-82d5-846992200098" status: 200 len: 1323 microversion: 2.1 time: 1.022358 Oct 23 01:21:20.432308 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1477/2947] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:19 2022] GET /compute/v2.1/servers/e973f866-0efe-40cb-82d5-846992200098 => generated 1323 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:20.447000 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-44a43b92-fe53-4520-8db3-e721a6600735 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:20.458641 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-44a43b92-fe53-4520-8db3-e721a6600735 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: ff868ee0-f1e4-4c03-a039-c0a6cd548b58] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:20.603541 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ab3f7e7d-f070-4683-a336-b9f71607554b tempest-ServicesAdminNegativeTestJSON-1550800104 tempest-ServicesAdminNegativeTestJSON-1550800104-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.274534 Oct 23 01:21:20.608845 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1471/2948] 10.222.0.42 () {58 vars in 1137 bytes} [Sun Oct 23 01:21:20 2022] GET /compute/v2.1/os-services => generated 944 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:21:20.638866 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-53890850-968f-46a4-ac26-60518532627b tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:20.644131 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-53890850-968f-46a4-ac26-60518532627b tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: ad3fdbf4-6dba-46a6-9132-e555185544b0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:20.672885 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-53890850-968f-46a4-ac26-60518532627b tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:20.672885 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-53890850-968f-46a4-ac26-60518532627b tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:20.672885 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-53890850-968f-46a4-ac26-60518532627b tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:20.672885 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-53890850-968f-46a4-ac26-60518532627b tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:20.687715 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-53890850-968f-46a4-ac26-60518532627b tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:20.688428 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-53890850-968f-46a4-ac26-60518532627b tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:20.745877 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-44a43b92-fe53-4520-8db3-e721a6600735 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:20.766252 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-44a43b92-fe53-4520-8db3-e721a6600735 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58" status: 200 len: 1208 microversion: 2.1 time: 0.330938 Oct 23 01:21:20.781088 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1478/2949] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:20 2022] GET /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58 => generated 1208 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:20.796658 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fb8a1f59-fb7b-439f-a2b0-8f3b12094593 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:20.797580 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fb8a1f59-fb7b-439f-a2b0-8f3b12094593 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:20.811947 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb8a1f59-fb7b-439f-a2b0-8f3b12094593 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:20.817120 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb8a1f59-fb7b-439f-a2b0-8f3b12094593 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:20.817120 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb8a1f59-fb7b-439f-a2b0-8f3b12094593 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:20.817120 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb8a1f59-fb7b-439f-a2b0-8f3b12094593 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:20.817120 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb8a1f59-fb7b-439f-a2b0-8f3b12094593 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:20.817120 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb8a1f59-fb7b-439f-a2b0-8f3b12094593 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:21.865227 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-53890850-968f-46a4-ac26-60518532627b tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:21.899793 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-53890850-968f-46a4-ac26-60518532627b tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0" status: 200 len: 1507 microversion: 2.1 time: 1.279250 Oct 23 01:21:21.906895 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1472/2950] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:20 2022] GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0 => generated 1507 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:21.929007 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d5f7942e-4e23-4095-afcc-19fe93cfc5e6 tempest-ServicesAdminNegativeTestJSON-1550800104 tempest-ServicesAdminNegativeTestJSON-1550800104-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:21.950075 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d5f7942e-4e23-4095-afcc-19fe93cfc5e6 tempest-ServicesAdminNegativeTestJSON-1550800104 tempest-ServicesAdminNegativeTestJSON-1550800104-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:21.950935 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d5f7942e-4e23-4095-afcc-19fe93cfc5e6 tempest-ServicesAdminNegativeTestJSON-1550800104 tempest-ServicesAdminNegativeTestJSON-1550800104-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:21.952842 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d5f7942e-4e23-4095-afcc-19fe93cfc5e6 tempest-ServicesAdminNegativeTestJSON-1550800104 tempest-ServicesAdminNegativeTestJSON-1550800104-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:21.953945 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d5f7942e-4e23-4095-afcc-19fe93cfc5e6 tempest-ServicesAdminNegativeTestJSON-1550800104 tempest-ServicesAdminNegativeTestJSON-1550800104-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:21.957380 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d5f7942e-4e23-4095-afcc-19fe93cfc5e6 tempest-ServicesAdminNegativeTestJSON-1550800104 tempest-ServicesAdminNegativeTestJSON-1550800104-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:21.957380 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d5f7942e-4e23-4095-afcc-19fe93cfc5e6 tempest-ServicesAdminNegativeTestJSON-1550800104 tempest-ServicesAdminNegativeTestJSON-1550800104-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:21.965639 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fb8a1f59-fb7b-439f-a2b0-8f3b12094593 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:21.979635 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fb8a1f59-fb7b-439f-a2b0-8f3b12094593 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1518 microversion: 2.1 time: 1.197078 Oct 23 01:21:21.980227 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1479/2951] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:20 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1518 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:21.985634 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-775a4388-e4ea-4053-a41f-e01e705bf275 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:21.990791 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-775a4388-e4ea-4053-a41f-e01e705bf275 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:22.003047 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-775a4388-e4ea-4053-a41f-e01e705bf275 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:22.004673 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-775a4388-e4ea-4053-a41f-e01e705bf275 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:22.006813 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-775a4388-e4ea-4053-a41f-e01e705bf275 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:22.009647 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-775a4388-e4ea-4053-a41f-e01e705bf275 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:22.010428 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-775a4388-e4ea-4053-a41f-e01e705bf275 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:22.015193 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-775a4388-e4ea-4053-a41f-e01e705bf275 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:22.019713 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d5f7942e-4e23-4095-afcc-19fe93cfc5e6 tempest-ServicesAdminNegativeTestJSON-1550800104 tempest-ServicesAdminNegativeTestJSON-1550800104-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.108753 Oct 23 01:21:22.020967 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1473/2952] 10.222.0.42 () {58 vars in 1194 bytes} [Sun Oct 23 01:21:21 2022] GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx => generated 16 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:21:22.040627 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bbc5fd03-c32f-4f0f-b54d-32fab78665f2 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:22.041402 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-bbc5fd03-c32f-4f0f-b54d-32fab78665f2 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] [instance: e973f866-0efe-40cb-82d5-846992200098] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:22.042155 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:22.051270 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bbc5fd03-c32f-4f0f-b54d-32fab78665f2 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:22.051952 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bbc5fd03-c32f-4f0f-b54d-32fab78665f2 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:22.052397 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bbc5fd03-c32f-4f0f-b54d-32fab78665f2 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:22.054622 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bbc5fd03-c32f-4f0f-b54d-32fab78665f2 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:22.055100 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bbc5fd03-c32f-4f0f-b54d-32fab78665f2 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:22.055582 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bbc5fd03-c32f-4f0f-b54d-32fab78665f2 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:22.061720 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:22.193532 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-775a4388-e4ea-4053-a41f-e01e705bf275 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lazy-loading 'services' on Instance uuid 2d7a734d-28b1-4d9f-b80d-c272576f8334 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:21:22.259613 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-775a4388-e4ea-4053-a41f-e01e705bf275 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334" status: 200 len: 1927 microversion: 2.75 time: 0.277423 Oct 23 01:21:22.262110 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1480/2953] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:21:21 2022] GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334 => generated 1927 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:21:22.278034 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ddd3fcc0-bae7-4b0b-a690-9679b179bb53 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Action: 'create', calling method: .version_select at 0x7f5cc2665940>, body: {"keypair": {"name": "tempest-keypair-990070396", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+KnqZ1V12t742sIGxZx3+OptLfsSB636HDtJHNwQdjP5Tuhhpev7+9lApU/ysVt1bUSgCN7lJty9uPCV0uU8gK1ybbPz4yrMosngt+2zz6AsMeHFI6etfiUBMfv9Bo2A=="}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:21:22.312203 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-ddd3fcc0-bae7-4b0b-a690-9679b179bb53 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Getting quotas for project a1f4adec8a4749a2bec19e7af0863059. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:21:22.322151 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-ddd3fcc0-bae7-4b0b-a690-9679b179bb53 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Getting quotas for user 69bd8aff49524f19ae950f92d46bd44b and project a1f4adec8a4749a2bec19e7af0863059. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:21:22.430656 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ddd3fcc0-bae7-4b0b-a690-9679b179bb53 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.167235 Oct 23 01:21:22.438176 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1481/2954] 10.222.0.42 () {62 vars in 1200 bytes} [Sun Oct 23 01:21:22 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 169 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 23 01:21:22.439712 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bc384909-f674-4303-bd64-8eb329af2a19 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:22.442079 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bc384909-f674-4303-bd64-8eb329af2a19 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: ff868ee0-f1e4-4c03-a039-c0a6cd548b58] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:22.459577 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc384909-f674-4303-bd64-8eb329af2a19 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:22.461754 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc384909-f674-4303-bd64-8eb329af2a19 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:22.465918 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc384909-f674-4303-bd64-8eb329af2a19 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:22.465918 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc384909-f674-4303-bd64-8eb329af2a19 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:22.465918 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc384909-f674-4303-bd64-8eb329af2a19 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:22.465918 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc384909-f674-4303-bd64-8eb329af2a19 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:22.973851 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bc384909-f674-4303-bd64-8eb329af2a19 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:22.983860 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bc384909-f674-4303-bd64-8eb329af2a19 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58" status: 200 len: 1260 microversion: 2.1 time: 0.550363 Oct 23 01:21:22.987698 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1482/2955] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:22 2022] GET /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58 => generated 1260 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:23.013915 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-52ddb5bf-49fc-464a-a406-4f036ff583ad tempest-ServicesAdminNegativeTestJSON-1550800104 tempest-ServicesAdminNegativeTestJSON-1550800104-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:23.024299 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-52ddb5bf-49fc-464a-a406-4f036ff583ad tempest-ServicesAdminNegativeTestJSON-1550800104 tempest-ServicesAdminNegativeTestJSON-1550800104-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:23.033748 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-52ddb5bf-49fc-464a-a406-4f036ff583ad tempest-ServicesAdminNegativeTestJSON-1550800104 tempest-ServicesAdminNegativeTestJSON-1550800104-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:23.033748 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-52ddb5bf-49fc-464a-a406-4f036ff583ad tempest-ServicesAdminNegativeTestJSON-1550800104 tempest-ServicesAdminNegativeTestJSON-1550800104-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:23.033748 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-52ddb5bf-49fc-464a-a406-4f036ff583ad tempest-ServicesAdminNegativeTestJSON-1550800104 tempest-ServicesAdminNegativeTestJSON-1550800104-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:23.033748 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-52ddb5bf-49fc-464a-a406-4f036ff583ad tempest-ServicesAdminNegativeTestJSON-1550800104 tempest-ServicesAdminNegativeTestJSON-1550800104-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:23.033748 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-52ddb5bf-49fc-464a-a406-4f036ff583ad tempest-ServicesAdminNegativeTestJSON-1550800104 tempest-ServicesAdminNegativeTestJSON-1550800104-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:23.125025 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-52ddb5bf-49fc-464a-a406-4f036ff583ad tempest-ServicesAdminNegativeTestJSON-1550800104 tempest-ServicesAdminNegativeTestJSON-1550800104-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.134741 Oct 23 01:21:23.126037 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1483/2956] 10.222.0.42 () {58 vars in 1137 bytes} [Sun Oct 23 01:21:22 2022] GET /compute/v2.1/os-services => generated 944 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:21:23.154938 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bbc5fd03-c32f-4f0f-b54d-32fab78665f2 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74cdbbd7765495db29eb0428fadc992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee2e22f48754a4aa47426a27bebf68b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:23.163327 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8ef2d04c-76c1-4060-9c1a-122c299f0a5e tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:23.164417 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8ef2d04c-76c1-4060-9c1a-122c299f0a5e tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: ad3fdbf4-6dba-46a6-9132-e555185544b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:23.166540 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bbc5fd03-c32f-4f0f-b54d-32fab78665f2 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] 10.222.0.42 "GET /compute/v2.1/servers/e973f866-0efe-40cb-82d5-846992200098" status: 200 len: 1323 microversion: 2.1 time: 1.138782 Oct 23 01:21:23.177691 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1474/2957] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:22 2022] GET /compute/v2.1/servers/e973f866-0efe-40cb-82d5-846992200098 => generated 1323 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:23.181765 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ef2d04c-76c1-4060-9c1a-122c299f0a5e tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:23.185446 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-276b6511-2114-4f70-bb32-fbdf6966be9b tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:23.186669 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-276b6511-2114-4f70-bb32-fbdf6966be9b tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:23.188371 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ef2d04c-76c1-4060-9c1a-122c299f0a5e tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:23.201296 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ef2d04c-76c1-4060-9c1a-122c299f0a5e tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:23.201296 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ef2d04c-76c1-4060-9c1a-122c299f0a5e tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:23.201296 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ef2d04c-76c1-4060-9c1a-122c299f0a5e tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:23.201296 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ef2d04c-76c1-4060-9c1a-122c299f0a5e tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:23.209111 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-276b6511-2114-4f70-bb32-fbdf6966be9b tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:23.212512 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-276b6511-2114-4f70-bb32-fbdf6966be9b tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:23.214464 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-276b6511-2114-4f70-bb32-fbdf6966be9b tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:23.226593 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-276b6511-2114-4f70-bb32-fbdf6966be9b tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:23.227440 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-276b6511-2114-4f70-bb32-fbdf6966be9b tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:23.228060 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-276b6511-2114-4f70-bb32-fbdf6966be9b tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:23.387875 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8ef2d04c-76c1-4060-9c1a-122c299f0a5e tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:23.401966 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8ef2d04c-76c1-4060-9c1a-122c299f0a5e tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0" status: 200 len: 1465 microversion: 2.1 time: 0.265316 Oct 23 01:21:23.407496 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1484/2958] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:23 2022] GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0 => generated 1465 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:23.415471 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-54ac3eb6-d92e-4575-a164-60c2840534de tempest-ServicesAdminNegativeTestJSON-1550800104 tempest-ServicesAdminNegativeTestJSON-1550800104-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:23.420657 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-54ac3eb6-d92e-4575-a164-60c2840534de tempest-ServicesAdminNegativeTestJSON-1550800104 tempest-ServicesAdminNegativeTestJSON-1550800104-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:23.434488 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-54ac3eb6-d92e-4575-a164-60c2840534de tempest-ServicesAdminNegativeTestJSON-1550800104 tempest-ServicesAdminNegativeTestJSON-1550800104-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:23.434488 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-54ac3eb6-d92e-4575-a164-60c2840534de tempest-ServicesAdminNegativeTestJSON-1550800104 tempest-ServicesAdminNegativeTestJSON-1550800104-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:23.437201 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-54ac3eb6-d92e-4575-a164-60c2840534de tempest-ServicesAdminNegativeTestJSON-1550800104 tempest-ServicesAdminNegativeTestJSON-1550800104-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:23.439379 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-54ac3eb6-d92e-4575-a164-60c2840534de tempest-ServicesAdminNegativeTestJSON-1550800104 tempest-ServicesAdminNegativeTestJSON-1550800104-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:23.440241 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-54ac3eb6-d92e-4575-a164-60c2840534de tempest-ServicesAdminNegativeTestJSON-1550800104 tempest-ServicesAdminNegativeTestJSON-1550800104-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:23.545420 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-54ac3eb6-d92e-4575-a164-60c2840534de tempest-ServicesAdminNegativeTestJSON-1550800104 tempest-ServicesAdminNegativeTestJSON-1550800104-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.136245 Oct 23 01:21:23.546185 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1485/2959] 10.222.0.42 () {58 vars in 1198 bytes} [Sun Oct 23 01:21:23 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:21:23.573953 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-929b97dd-9c52-440e-9906-9c5b2b658a1f tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:23.575559 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-929b97dd-9c52-440e-9906-9c5b2b658a1f tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:23.582891 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-929b97dd-9c52-440e-9906-9c5b2b658a1f tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:23.583878 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-929b97dd-9c52-440e-9906-9c5b2b658a1f tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:23.584658 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-929b97dd-9c52-440e-9906-9c5b2b658a1f tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:23.586689 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-929b97dd-9c52-440e-9906-9c5b2b658a1f tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:23.587433 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-929b97dd-9c52-440e-9906-9c5b2b658a1f tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:23.589309 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-929b97dd-9c52-440e-9906-9c5b2b658a1f tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:23.780071 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-276b6511-2114-4f70-bb32-fbdf6966be9b tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:23.794264 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-929b97dd-9c52-440e-9906-9c5b2b658a1f tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lazy-loading 'services' on Instance uuid 2d7a734d-28b1-4d9f-b80d-c272576f8334 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:21:23.794637 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-276b6511-2114-4f70-bb32-fbdf6966be9b tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1518 microversion: 2.1 time: 0.619264 Oct 23 01:21:23.795420 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1475/2960] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:23 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1518 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:23.853075 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-929b97dd-9c52-440e-9906-9c5b2b658a1f tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334" status: 200 len: 1927 microversion: 2.75 time: 0.285096 Oct 23 01:21:23.868446 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1486/2961] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:21:23 2022] GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334 => generated 1927 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:21:23.882377 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-1849b206-c586-4a50-8fc8-8bfd2aa94663 req-51a4ae61-5bbc-45a2-aae5-906e59b9c426 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad3fdbf4-6dba-46a6-9132-e555185544b0", "name": "network-vif-deleted", "tag": "815e9a21-8eb2-47db-8d75-f1f0dd7107fe"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:21:23.912278 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-1849b206-c586-4a50-8fc8-8bfd2aa94663 req-51a4ae61-5bbc-45a2-aae5-906e59b9c426 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:23.912816 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-1849b206-c586-4a50-8fc8-8bfd2aa94663 req-51a4ae61-5bbc-45a2-aae5-906e59b9c426 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:23.913263 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-1849b206-c586-4a50-8fc8-8bfd2aa94663 req-51a4ae61-5bbc-45a2-aae5-906e59b9c426 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:23.943386 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-1849b206-c586-4a50-8fc8-8bfd2aa94663 req-51a4ae61-5bbc-45a2-aae5-906e59b9c426 service nova] Creating event network-vif-deleted:815e9a21-8eb2-47db-8d75-f1f0dd7107fe for instance ad3fdbf4-6dba-46a6-9132-e555185544b0 on n-h2-master-1 Oct 23 01:21:23.967321 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-1849b206-c586-4a50-8fc8-8bfd2aa94663 req-51a4ae61-5bbc-45a2-aae5-906e59b9c426 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097342 Oct 23 01:21:23.968640 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1487/2962] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:21:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:21:24.024983 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cf007cf9-9c0e-4c42-9ca9-849409d58e9c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:24.026866 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-cf007cf9-9c0e-4c42-9ca9-849409d58e9c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: ff868ee0-f1e4-4c03-a039-c0a6cd548b58] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:24.030056 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1723b0d2-f161-4fad-8d50-f74664228967 tempest-ServicesAdminNegativeTestJSON-317538975 tempest-ServicesAdminNegativeTestJSON-317538975-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:24.034064 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1723b0d2-f161-4fad-8d50-f74664228967 tempest-ServicesAdminNegativeTestJSON-317538975 tempest-ServicesAdminNegativeTestJSON-317538975-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '43261fcfdb974c57954dd7885c248c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b5540404d47e3b0aadea2ff403128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:24.037109 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf007cf9-9c0e-4c42-9ca9-849409d58e9c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:24.039791 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf007cf9-9c0e-4c42-9ca9-849409d58e9c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:24.040571 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf007cf9-9c0e-4c42-9ca9-849409d58e9c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:24.041969 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf007cf9-9c0e-4c42-9ca9-849409d58e9c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:24.042954 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf007cf9-9c0e-4c42-9ca9-849409d58e9c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:24.043647 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf007cf9-9c0e-4c42-9ca9-849409d58e9c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1723b0d2-f161-4fad-8d50-f74664228967 tempest-ServicesAdminNegativeTestJSON-317538975 tempest-ServicesAdminNegativeTestJSON-317538975-project] Request method failure captured: Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJcMJ-v-VZ0v3iE1TRaTDRUaGBwlivz_IdwvfXzZZPvRD2D-bawQLy8NSblNed_AO3s2_TvpQc-6k8HuM_C_s4HEz-SGPQOdfjRl1JpBRymQ4cLb_Bk7urkqsGVR7QkXplkEXCViFX85fGrzQNbc0lg8xXbvCvjmZuY-sV63-lT4ngY Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 115b5540404d47e3b0aadea2ff403128 Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-317538975 Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/115b5540404d47e3b0aadea2ff403128"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_115b5540404d47e3b0aadea2ff403128"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/115b5540404d47e3b0aadea2ff403128"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/115b5540404d47e3b0aadea2ff403128"}]}] Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-317538975 Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 115b5540404d47e3b0aadea2ff403128 Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-317538975 Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServicesAdminNegativeTestJSON-317538975-project Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 43261fcfdb974c57954dd7885c248c40 Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-317538975-project Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: action_args: {} Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise self.value Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 23 01:21:24.050348 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:21:24.057496 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:21:24.057496 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:21:24.057496 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:24.057496 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:21:24.057496 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:21:24.057496 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 23 01:21:24.057496 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 23 01:21:24.057496 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 23 01:21:24.057496 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:21:24.057496 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1723b0d2-f161-4fad-8d50-f74664228967 tempest-ServicesAdminNegativeTestJSON-317538975 tempest-ServicesAdminNegativeTestJSON-317538975-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:21:24.057496 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1723b0d2-f161-4fad-8d50-f74664228967 tempest-ServicesAdminNegativeTestJSON-317538975 tempest-ServicesAdminNegativeTestJSON-317538975-project] 10.222.0.42 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.255467 Oct 23 01:21:24.064009 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1476/2963] 10.222.0.42 () {58 vars in 1137 bytes} [Sun Oct 23 01:21:23 2022] GET /compute/v2.1/os-services => generated 112 bytes in 268 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:21:24.206630 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4d8eedbd-5e1c-483f-81eb-e7833be658fa tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:24.277167 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4d8eedbd-5e1c-483f-81eb-e7833be658fa tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] [instance: e973f866-0efe-40cb-82d5-846992200098] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:24.277704 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cf007cf9-9c0e-4c42-9ca9-849409d58e9c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:24.277704 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cf007cf9-9c0e-4c42-9ca9-849409d58e9c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58" status: 200 len: 1260 microversion: 2.1 time: 0.212456 Oct 23 01:21:24.277704 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1488/2964] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:24 2022] GET /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58 => generated 1260 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:24.278660 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4d8eedbd-5e1c-483f-81eb-e7833be658fa tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:24.278660 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4d8eedbd-5e1c-483f-81eb-e7833be658fa tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:24.278660 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4d8eedbd-5e1c-483f-81eb-e7833be658fa tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:24.278660 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4d8eedbd-5e1c-483f-81eb-e7833be658fa tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:24.278660 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4d8eedbd-5e1c-483f-81eb-e7833be658fa tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:24.278660 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4d8eedbd-5e1c-483f-81eb-e7833be658fa tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:24.429375 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a01c4430-cd4f-49cf-88e6-481921080abf tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:24.430147 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a01c4430-cd4f-49cf-88e6-481921080abf tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: ad3fdbf4-6dba-46a6-9132-e555185544b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:24.441236 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a01c4430-cd4f-49cf-88e6-481921080abf tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:24.441742 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a01c4430-cd4f-49cf-88e6-481921080abf tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:24.442213 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a01c4430-cd4f-49cf-88e6-481921080abf tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:24.443030 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a01c4430-cd4f-49cf-88e6-481921080abf tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:24.443544 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a01c4430-cd4f-49cf-88e6-481921080abf tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:24.443971 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a01c4430-cd4f-49cf-88e6-481921080abf tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:24.548246 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a01c4430-cd4f-49cf-88e6-481921080abf tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:24.549225 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a01c4430-cd4f-49cf-88e6-481921080abf tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:24.550152 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a01c4430-cd4f-49cf-88e6-481921080abf tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:24.550986 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-a01c4430-cd4f-49cf-88e6-481921080abf tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lazy-loading 'fault' on Instance uuid ad3fdbf4-6dba-46a6-9132-e555185544b0 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:21:24.634605 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a01c4430-cd4f-49cf-88e6-481921080abf tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:24.639668 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4d8eedbd-5e1c-483f-81eb-e7833be658fa tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74cdbbd7765495db29eb0428fadc992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee2e22f48754a4aa47426a27bebf68b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:24.655331 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a01c4430-cd4f-49cf-88e6-481921080abf tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0" status: 200 len: 1304 microversion: 2.1 time: 0.230409 Oct 23 01:21:24.656389 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1489/2965] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:24 2022] GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0 => generated 1304 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:21:24.661583 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-1c69f29f-4554-4912-940f-5786158dba8b req-971c5e96-9936-4bd7-8e42-df3b548ee770 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a64ad71-9caf-4645-be7a-b56f8f584c2d", "name": "network-vif-unplugged", "status": "completed", "tag": "40a2cfab-1f0a-4ac9-815e-ce16a0befa54"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:21:24.663044 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4d8eedbd-5e1c-483f-81eb-e7833be658fa tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] 10.222.0.42 "GET /compute/v2.1/servers/e973f866-0efe-40cb-82d5-846992200098" status: 200 len: 1521 microversion: 2.1 time: 0.468814 Oct 23 01:21:24.678450 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-1c69f29f-4554-4912-940f-5786158dba8b req-971c5e96-9936-4bd7-8e42-df3b548ee770 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:24.678450 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-1c69f29f-4554-4912-940f-5786158dba8b req-971c5e96-9936-4bd7-8e42-df3b548ee770 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:24.678450 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-1c69f29f-4554-4912-940f-5786158dba8b req-971c5e96-9936-4bd7-8e42-df3b548ee770 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:24.688060 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1477/2966] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:24 2022] GET /compute/v2.1/servers/e973f866-0efe-40cb-82d5-846992200098 => generated 1521 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:24.700349 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-dcdb9bde-5710-4da5-8245-8ff1e3f246de tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:24.703428 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-dcdb9bde-5710-4da5-8245-8ff1e3f246de tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] [instance: e973f866-0efe-40cb-82d5-846992200098] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:24.707121 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-1c69f29f-4554-4912-940f-5786158dba8b req-971c5e96-9936-4bd7-8e42-df3b548ee770 service nova] Creating event network-vif-unplugged:40a2cfab-1f0a-4ac9-815e-ce16a0befa54 for instance 9a64ad71-9caf-4645-be7a-b56f8f584c2d on n-h2-master-1 Oct 23 01:21:24.713207 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-1c69f29f-4554-4912-940f-5786158dba8b req-971c5e96-9936-4bd7-8e42-df3b548ee770 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055519 Oct 23 01:21:24.714412 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1490/2967] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:21:24.723092 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dcdb9bde-5710-4da5-8245-8ff1e3f246de tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:24.723645 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dcdb9bde-5710-4da5-8245-8ff1e3f246de tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:24.724268 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dcdb9bde-5710-4da5-8245-8ff1e3f246de tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:24.725182 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dcdb9bde-5710-4da5-8245-8ff1e3f246de tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:24.725807 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dcdb9bde-5710-4da5-8245-8ff1e3f246de tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:24.726413 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dcdb9bde-5710-4da5-8245-8ff1e3f246de tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:24.789659 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-dcdb9bde-5710-4da5-8245-8ff1e3f246de tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] HTTP exception thrown: Instance is not a member of specified network Oct 23 01:21:24.802561 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-dcdb9bde-5710-4da5-8245-8ff1e3f246de tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Request method failure captured: Oct 23 01:21:24.802561 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/e973f866-0efe-40cb-82d5-846992200098/ips/invalid HTTP/1.1 Oct 23 01:21:24.802561 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:21:24.802561 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:21:24.802561 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:21:24.802561 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:21:24.802561 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:21:24.802561 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:21:24.802561 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:21:24.802561 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:21:24.802561 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJb2FhXIjs-QE00OpVgVRw0uLV3DjfyewOzoSDtBxegQ7x65rBbts4_UzCuwq_pDfjkBBd1G13IjfpUbrfawksd_y8YZBtG1vAkotjfZMcecyAoP_I2Cf_NiXmIIlPb5sIcClbzuOisk37NSbIl4jfFgIa9DnZA0Qsll5kTUmhKoceM Oct 23 01:21:24.802561 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:21:24.802561 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:21:24.802561 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:21:24.802561 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:21:24.802561 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:21:24.802561 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:21:24.802561 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: fee2e22f48754a4aa47426a27bebf68b Oct 23 01:21:24.802561 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-420579287 Oct 23 01:21:24.802561 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:21:24.802561 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:21:24.802561 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/fee2e22f48754a4aa47426a27bebf68b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_fee2e22f48754a4aa47426a27bebf68b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fee2e22f48754a4aa47426a27bebf68b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fee2e22f48754a4aa47426a27bebf68b"}]}] Oct 23 01:21:24.802561 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-420579287 Oct 23 01:21:24.802561 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: fee2e22f48754a4aa47426a27bebf68b Oct 23 01:21:24.802561 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-420579287 Oct 23 01:21:24.802561 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServerAddressesNegativeTestJSON-420579287-project Oct 23 01:21:24.802561 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:21:24.802561 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:21:24.802561 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: b74cdbbd7765495db29eb0428fadc992 Oct 23 01:21:24.802561 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-420579287-project Oct 23 01:21:24.802561 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:21:24.802561 n-d-master-1 devstack@n-api.service[120945]: exception: Instance is not a member of specified network Oct 23 01:21:24.802561 n-d-master-1 devstack@n-api.service[120945]: action_args: {'server_id': 'e973f866-0efe-40cb-82d5-846992200098', 'id': 'invalid'} Oct 23 01:21:24.802561 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:21:24.802561 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:24.802561 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:21:24.802561 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:21:24.802561 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:21:24.802561 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:21:24.802561 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:21:24.802561 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:21:24.802561 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 23 01:21:24.802561 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 23 01:21:24.802561 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 23 01:21:24.802561 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:21:24.802561 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:21:24.802561 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:21:24.802561 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:24.802561 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:21:24.802561 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:21:24.802561 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:21:24.802561 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:21:24.802561 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 23 01:21:24.802561 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:21:24.807996 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-dcdb9bde-5710-4da5-8245-8ff1e3f246de tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Returning 404 to user: Instance is not a member of specified network {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:21:24.811065 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-dcdb9bde-5710-4da5-8245-8ff1e3f246de tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] 10.222.0.42 "GET /compute/v2.1/servers/e973f866-0efe-40cb-82d5-846992200098/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.121125 Oct 23 01:21:24.812024 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1478/2968] 10.222.0.42 () {58 vars in 1272 bytes} [Sun Oct 23 01:21:24 2022] GET /compute/v2.1/servers/e973f866-0efe-40cb-82d5-846992200098/ips/invalid => generated 91 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:21:24.822894 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b818c7a5-d8e9-4a99-925c-bbc9ba855e0e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:24.823891 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b818c7a5-d8e9-4a99-925c-bbc9ba855e0e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:24.834821 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4aa7d5ff-7bf8-4709-98f0-9afb36a0598c tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:24.835425 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4aa7d5ff-7bf8-4709-98f0-9afb36a0598c tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Failed to fetch instance by id 999 {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 23 01:21:24.860266 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b818c7a5-d8e9-4a99-925c-bbc9ba855e0e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:24.860266 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b818c7a5-d8e9-4a99-925c-bbc9ba855e0e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:24.866069 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b818c7a5-d8e9-4a99-925c-bbc9ba855e0e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:24.869396 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b818c7a5-d8e9-4a99-925c-bbc9ba855e0e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:24.869895 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b818c7a5-d8e9-4a99-925c-bbc9ba855e0e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:24.870378 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b818c7a5-d8e9-4a99-925c-bbc9ba855e0e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:24.874279 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-4aa7d5ff-7bf8-4709-98f0-9afb36a0598c tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] HTTP exception thrown: Instance 999 could not be found. Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4aa7d5ff-7bf8-4709-98f0-9afb36a0598c tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Request method failure captured: Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJb2FhXIjs-QE00OpVgVRw0uLV3DjfyewOzoSDtBxegQ7x65rBbts4_UzCuwq_pDfjkBBd1G13IjfpUbrfawksd_y8YZBtG1vAkotjfZMcecyAoP_I2Cf_NiXmIIlPb5sIcClbzuOisk37NSbIl4jfFgIa9DnZA0Qsll5kTUmhKoceM Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: fee2e22f48754a4aa47426a27bebf68b Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-420579287 Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/fee2e22f48754a4aa47426a27bebf68b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_fee2e22f48754a4aa47426a27bebf68b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fee2e22f48754a4aa47426a27bebf68b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fee2e22f48754a4aa47426a27bebf68b"}]}] Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-420579287 Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: fee2e22f48754a4aa47426a27bebf68b Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-420579287 Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServerAddressesNegativeTestJSON-420579287-project Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: b74cdbbd7765495db29eb0428fadc992 Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-420579287-project Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 999 could not be found. Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: action_args: {'server_id': '999'} Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 23 01:21:24.875825 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:21:24.881437 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4aa7d5ff-7bf8-4709-98f0-9afb36a0598c tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Returning 404 to user: Instance 999 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:21:24.881437 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4aa7d5ff-7bf8-4709-98f0-9afb36a0598c tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] 10.222.0.42 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.049480 Oct 23 01:21:24.889487 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1479/2969] 10.222.0.42 () {58 vars in 1149 bytes} [Sun Oct 23 01:21:24 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:21:24.908497 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ab3006f6-511e-4ece-9436-0ceb85e2beee tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:24.909104 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ab3006f6-511e-4ece-9436-0ceb85e2beee tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:24.937115 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ab3006f6-511e-4ece-9436-0ceb85e2beee tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:24.937665 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ab3006f6-511e-4ece-9436-0ceb85e2beee tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:24.942429 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ab3006f6-511e-4ece-9436-0ceb85e2beee tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:24.944039 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ab3006f6-511e-4ece-9436-0ceb85e2beee tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:24.946312 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ab3006f6-511e-4ece-9436-0ceb85e2beee tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:24.946760 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ab3006f6-511e-4ece-9436-0ceb85e2beee tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:25.118981 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-ab3006f6-511e-4ece-9436-0ceb85e2beee tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lazy-loading 'services' on Instance uuid 2d7a734d-28b1-4d9f-b80d-c272576f8334 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:21:25.162506 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ab3006f6-511e-4ece-9436-0ceb85e2beee tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334" status: 200 len: 1927 microversion: 2.75 time: 0.271734 Oct 23 01:21:25.177561 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1480/2970] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:21:24 2022] GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334 => generated 1927 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:21:25.177561 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-31f3c120-67b9-46c5-8254-d8f8bb56207a tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:25.177561 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-31f3c120-67b9-46c5-8254-d8f8bb56207a tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] [instance: e973f866-0efe-40cb-82d5-846992200098] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:25.199962 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-31f3c120-67b9-46c5-8254-d8f8bb56207a tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:25.204178 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-31f3c120-67b9-46c5-8254-d8f8bb56207a tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:25.204178 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-31f3c120-67b9-46c5-8254-d8f8bb56207a tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:25.204178 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-31f3c120-67b9-46c5-8254-d8f8bb56207a tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:25.204178 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-31f3c120-67b9-46c5-8254-d8f8bb56207a tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:25.204178 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-31f3c120-67b9-46c5-8254-d8f8bb56207a tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:25.245264 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-31f3c120-67b9-46c5-8254-d8f8bb56207a tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] [instance: e973f866-0efe-40cb-82d5-846992200098] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:21:25.272188 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b818c7a5-d8e9-4a99-925c-bbc9ba855e0e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:25.286877 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b818c7a5-d8e9-4a99-925c-bbc9ba855e0e tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1518 microversion: 2.1 time: 0.468876 Oct 23 01:21:25.289403 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1491/2971] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:24 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1518 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:25.329091 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2d0760cb-9013-4584-b866-6d99b0184c99 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:25.330386 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2d0760cb-9013-4584-b866-6d99b0184c99 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: ff868ee0-f1e4-4c03-a039-c0a6cd548b58] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:25.345794 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2d0760cb-9013-4584-b866-6d99b0184c99 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:25.346325 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2d0760cb-9013-4584-b866-6d99b0184c99 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:25.354613 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2d0760cb-9013-4584-b866-6d99b0184c99 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:25.356016 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2d0760cb-9013-4584-b866-6d99b0184c99 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:25.356563 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2d0760cb-9013-4584-b866-6d99b0184c99 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:25.357004 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2d0760cb-9013-4584-b866-6d99b0184c99 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:25.464001 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2d0760cb-9013-4584-b866-6d99b0184c99 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:25.475911 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2d0760cb-9013-4584-b866-6d99b0184c99 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58" status: 200 len: 1260 microversion: 2.1 time: 0.152455 Oct 23 01:21:25.478340 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1492/2972] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:25 2022] GET /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:25.681221 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-41c496d1-31b7-405c-99f5-0d5fabd5ecb2 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:25.682103 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-41c496d1-31b7-405c-99f5-0d5fabd5ecb2 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: ad3fdbf4-6dba-46a6-9132-e555185544b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:25.701146 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41c496d1-31b7-405c-99f5-0d5fabd5ecb2 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:25.702384 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41c496d1-31b7-405c-99f5-0d5fabd5ecb2 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:25.705003 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41c496d1-31b7-405c-99f5-0d5fabd5ecb2 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:25.707022 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41c496d1-31b7-405c-99f5-0d5fabd5ecb2 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:25.709678 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41c496d1-31b7-405c-99f5-0d5fabd5ecb2 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:25.712863 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41c496d1-31b7-405c-99f5-0d5fabd5ecb2 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:25.765709 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-31f3c120-67b9-46c5-8254-d8f8bb56207a tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e973f866-0efe-40cb-82d5-846992200098" status: 204 len: 0 microversion: 2.1 time: 0.587395 Oct 23 01:21:25.766505 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1481/2973] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:21:25 2022] DELETE /compute/v2.1/servers/e973f866-0efe-40cb-82d5-846992200098 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:21:25.766616 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-41c496d1-31b7-405c-99f5-0d5fabd5ecb2 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] HTTP exception thrown: Instance ad3fdbf4-6dba-46a6-9132-e555185544b0 could not be found. Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-41c496d1-31b7-405c-99f5-0d5fabd5ecb2 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Request method failure captured: Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0 HTTP/1.1 Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJaDXUZvy62hgrSulw80Jlya2mFw7DpCTUsT6-_wQ5xOj3Tavsu0cKeMoq3s-3qr-_hC_ATNZZdhUgOGYjmgtJFbQjmls46TiXRt1tlqR_KL8EGPEv_o2R5XC5uqVhhVqc3i5ZwCsvyljnDE95g-GLc1BfA6rZRFgO5Npots12iUjIo Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: ed372b4663a94ff1ba20abe32e2f9e77 Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServerRescueTestJSON-1625154572 Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ed372b4663a94ff1ba20abe32e2f9e77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ed372b4663a94ff1ba20abe32e2f9e77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ed372b4663a94ff1ba20abe32e2f9e77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ed372b4663a94ff1ba20abe32e2f9e77"}]}] Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServerRescueTestJSON-1625154572 Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: ed372b4663a94ff1ba20abe32e2f9e77 Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServerRescueTestJSON-1625154572 Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServerRescueTestJSON-1625154572-project Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 3838dd33052740fa88b9cf2888c208ff Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServerRescueTestJSON-1625154572-project Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: exception: Instance ad3fdbf4-6dba-46a6-9132-e555185544b0 could not be found. Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'ad3fdbf4-6dba-46a6-9132-e555185544b0'} Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad3fdbf4-6dba-46a6-9132-e555185544b0 could not be found. Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad3fdbf4-6dba-46a6-9132-e555185544b0 could not be found. Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:21:25.771958 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:21:25.776836 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:25.776836 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:21:25.776836 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:21:25.776836 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:21:25.776836 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:21:25.776836 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad3fdbf4-6dba-46a6-9132-e555185544b0 could not be found. Oct 23 01:21:25.776836 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:21:25.780217 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-41c496d1-31b7-405c-99f5-0d5fabd5ecb2 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Returning 404 to user: Instance ad3fdbf4-6dba-46a6-9132-e555185544b0 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:21:25.783016 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-41c496d1-31b7-405c-99f5-0d5fabd5ecb2 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0" status: 404 len: 111 microversion: 2.1 time: 0.106224 Oct 23 01:21:25.785362 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1493/2974] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:25 2022] GET /compute/v2.1/servers/ad3fdbf4-6dba-46a6-9132-e555185544b0 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 01:21:25.791536 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9e974bf7-afb1-4e7b-bfc0-0cfd88d4efb2 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:25.793601 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9e974bf7-afb1-4e7b-bfc0-0cfd88d4efb2 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] [instance: e973f866-0efe-40cb-82d5-846992200098] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:25.805083 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bf913b2c-f15a-4d76-b158-dba5b9da9c90 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:25.805642 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bf913b2c-f15a-4d76-b158-dba5b9da9c90 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: 08afe605-c9f1-4d8b-98bc-9253414ebe56] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:25.817254 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e974bf7-afb1-4e7b-bfc0-0cfd88d4efb2 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:25.817254 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e974bf7-afb1-4e7b-bfc0-0cfd88d4efb2 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:25.820221 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf913b2c-f15a-4d76-b158-dba5b9da9c90 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:25.820469 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e974bf7-afb1-4e7b-bfc0-0cfd88d4efb2 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:25.820725 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf913b2c-f15a-4d76-b158-dba5b9da9c90 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:25.821168 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf913b2c-f15a-4d76-b158-dba5b9da9c90 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:25.821878 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf913b2c-f15a-4d76-b158-dba5b9da9c90 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:25.824406 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e974bf7-afb1-4e7b-bfc0-0cfd88d4efb2 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:25.826733 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e974bf7-afb1-4e7b-bfc0-0cfd88d4efb2 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:25.828076 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf913b2c-f15a-4d76-b158-dba5b9da9c90 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:25.828750 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf913b2c-f15a-4d76-b158-dba5b9da9c90 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:25.828947 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e974bf7-afb1-4e7b-bfc0-0cfd88d4efb2 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:25.861481 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bf913b2c-f15a-4d76-b158-dba5b9da9c90 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: 08afe605-c9f1-4d8b-98bc-9253414ebe56] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:21:26.078779 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9e974bf7-afb1-4e7b-bfc0-0cfd88d4efb2 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74cdbbd7765495db29eb0428fadc992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee2e22f48754a4aa47426a27bebf68b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:26.091605 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9e974bf7-afb1-4e7b-bfc0-0cfd88d4efb2 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] 10.222.0.42 "GET /compute/v2.1/servers/e973f866-0efe-40cb-82d5-846992200098" status: 200 len: 1527 microversion: 2.1 time: 0.320160 Oct 23 01:21:26.092918 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1482/2975] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:25 2022] GET /compute/v2.1/servers/e973f866-0efe-40cb-82d5-846992200098 => generated 1527 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:26.196745 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9da998fb-8bfb-4af3-9d88-718515da6743 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:26.197360 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9da998fb-8bfb-4af3-9d88-718515da6743 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:26.203493 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9da998fb-8bfb-4af3-9d88-718515da6743 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:26.203974 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9da998fb-8bfb-4af3-9d88-718515da6743 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:26.204400 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9da998fb-8bfb-4af3-9d88-718515da6743 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:26.205285 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9da998fb-8bfb-4af3-9d88-718515da6743 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:26.205738 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9da998fb-8bfb-4af3-9d88-718515da6743 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:26.206352 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9da998fb-8bfb-4af3-9d88-718515da6743 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:26.246812 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bf913b2c-f15a-4d76-b158-dba5b9da9c90 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "DELETE /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56" status: 204 len: 0 microversion: 2.1 time: 0.456947 Oct 23 01:21:26.247291 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1494/2976] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:21:25 2022] DELETE /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:21:26.255792 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dacde26d-10cb-473a-ba87-05b9da4179a8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:26.256773 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-dacde26d-10cb-473a-ba87-05b9da4179a8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: 08afe605-c9f1-4d8b-98bc-9253414ebe56] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:26.263753 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dacde26d-10cb-473a-ba87-05b9da4179a8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:26.264257 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dacde26d-10cb-473a-ba87-05b9da4179a8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:26.264799 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dacde26d-10cb-473a-ba87-05b9da4179a8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:26.265388 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dacde26d-10cb-473a-ba87-05b9da4179a8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:26.265842 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dacde26d-10cb-473a-ba87-05b9da4179a8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:26.266472 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dacde26d-10cb-473a-ba87-05b9da4179a8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:26.323832 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-9da998fb-8bfb-4af3-9d88-718515da6743 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lazy-loading 'services' on Instance uuid 2d7a734d-28b1-4d9f-b80d-c272576f8334 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:21:26.349679 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9da998fb-8bfb-4af3-9d88-718515da6743 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334" status: 200 len: 1927 microversion: 2.75 time: 0.156755 Oct 23 01:21:26.360268 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1483/2977] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:21:26 2022] GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334 => generated 1927 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:21:26.370588 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d772e05b-74d9-4264-a322-8b59dad244b0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:26.371992 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d772e05b-74d9-4264-a322-8b59dad244b0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:26.378796 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d772e05b-74d9-4264-a322-8b59dad244b0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:26.379298 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d772e05b-74d9-4264-a322-8b59dad244b0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:26.380349 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d772e05b-74d9-4264-a322-8b59dad244b0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:26.382521 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d772e05b-74d9-4264-a322-8b59dad244b0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:26.382999 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d772e05b-74d9-4264-a322-8b59dad244b0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:26.383807 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d772e05b-74d9-4264-a322-8b59dad244b0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:26.495106 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-dacde26d-10cb-473a-ba87-05b9da4179a8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:26.504483 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-dacde26d-10cb-473a-ba87-05b9da4179a8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56" status: 200 len: 1492 microversion: 2.1 time: 0.252789 Oct 23 01:21:26.505182 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1495/2978] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:26 2022] GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56 => generated 1492 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:21:26.514146 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-eb36c171-8a9c-423d-8a51-3e98d88d17c4 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:26.514859 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-eb36c171-8a9c-423d-8a51-3e98d88d17c4 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: ff868ee0-f1e4-4c03-a039-c0a6cd548b58] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:26.521587 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb36c171-8a9c-423d-8a51-3e98d88d17c4 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:26.526955 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb36c171-8a9c-423d-8a51-3e98d88d17c4 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:26.526955 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb36c171-8a9c-423d-8a51-3e98d88d17c4 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:26.526955 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb36c171-8a9c-423d-8a51-3e98d88d17c4 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:26.526955 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb36c171-8a9c-423d-8a51-3e98d88d17c4 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:26.526955 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb36c171-8a9c-423d-8a51-3e98d88d17c4 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:26.612084 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d772e05b-74d9-4264-a322-8b59dad244b0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:26.614559 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-eb36c171-8a9c-423d-8a51-3e98d88d17c4 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:26.621749 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d772e05b-74d9-4264-a322-8b59dad244b0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1518 microversion: 2.1 time: 0.269726 Oct 23 01:21:26.637638 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1484/2979] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:26 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1518 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:26.642066 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-eb36c171-8a9c-423d-8a51-3e98d88d17c4 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58" status: 200 len: 1278 microversion: 2.1 time: 0.132955 Oct 23 01:21:26.642066 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1496/2980] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:26 2022] GET /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58 => generated 1278 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:27.121580 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d84b7f42-ba94-4d36-93ec-fc397b8dcb96 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:27.121580 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d84b7f42-ba94-4d36-93ec-fc397b8dcb96 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] [instance: e973f866-0efe-40cb-82d5-846992200098] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:27.129921 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d84b7f42-ba94-4d36-93ec-fc397b8dcb96 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:27.130976 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d84b7f42-ba94-4d36-93ec-fc397b8dcb96 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:27.131733 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d84b7f42-ba94-4d36-93ec-fc397b8dcb96 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:27.132914 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d84b7f42-ba94-4d36-93ec-fc397b8dcb96 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:27.133590 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d84b7f42-ba94-4d36-93ec-fc397b8dcb96 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:27.134266 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d84b7f42-ba94-4d36-93ec-fc397b8dcb96 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:27.378870 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8b2e6233-8c26-4192-9159-fe67f0f162e8 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:27.380566 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8b2e6233-8c26-4192-9159-fe67f0f162e8 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:27.385262 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d84b7f42-ba94-4d36-93ec-fc397b8dcb96 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74cdbbd7765495db29eb0428fadc992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee2e22f48754a4aa47426a27bebf68b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:27.393766 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d84b7f42-ba94-4d36-93ec-fc397b8dcb96 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] 10.222.0.42 "GET /compute/v2.1/servers/e973f866-0efe-40cb-82d5-846992200098" status: 200 len: 1527 microversion: 2.1 time: 0.278296 Oct 23 01:21:27.394795 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1485/2981] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:27 2022] GET /compute/v2.1/servers/e973f866-0efe-40cb-82d5-846992200098 => generated 1527 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:27.398264 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8b2e6233-8c26-4192-9159-fe67f0f162e8 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:27.398777 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8b2e6233-8c26-4192-9159-fe67f0f162e8 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:27.410492 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8b2e6233-8c26-4192-9159-fe67f0f162e8 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:27.418926 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8b2e6233-8c26-4192-9159-fe67f0f162e8 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:27.418926 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8b2e6233-8c26-4192-9159-fe67f0f162e8 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:27.418926 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8b2e6233-8c26-4192-9159-fe67f0f162e8 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:27.528894 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-da9a9c2d-8f2e-4015-a561-841e8bb33aa8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:27.530011 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-da9a9c2d-8f2e-4015-a561-841e8bb33aa8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: 08afe605-c9f1-4d8b-98bc-9253414ebe56] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:27.540018 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da9a9c2d-8f2e-4015-a561-841e8bb33aa8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:27.543455 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da9a9c2d-8f2e-4015-a561-841e8bb33aa8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:27.543455 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da9a9c2d-8f2e-4015-a561-841e8bb33aa8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:27.543455 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da9a9c2d-8f2e-4015-a561-841e8bb33aa8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:27.547389 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da9a9c2d-8f2e-4015-a561-841e8bb33aa8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:27.548051 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da9a9c2d-8f2e-4015-a561-841e8bb33aa8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:27.590914 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-8b2e6233-8c26-4192-9159-fe67f0f162e8 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lazy-loading 'services' on Instance uuid 2d7a734d-28b1-4d9f-b80d-c272576f8334 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:21:27.627178 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8b2e6233-8c26-4192-9159-fe67f0f162e8 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334" status: 200 len: 1927 microversion: 2.75 time: 0.253208 Oct 23 01:21:27.630093 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1497/2982] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:21:27 2022] GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334 => generated 1927 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:21:27.648943 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e9c43129-29af-4578-8043-b2e19d241137 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:27.649782 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e9c43129-29af-4578-8043-b2e19d241137 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:27.656460 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:27.663421 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9c43129-29af-4578-8043-b2e19d241137 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:27.663421 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9c43129-29af-4578-8043-b2e19d241137 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:27.681070 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9c43129-29af-4578-8043-b2e19d241137 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:27.682053 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9c43129-29af-4578-8043-b2e19d241137 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:27.682736 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9c43129-29af-4578-8043-b2e19d241137 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:27.683172 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9c43129-29af-4578-8043-b2e19d241137 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:27.738180 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:27.826957 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-da9a9c2d-8f2e-4015-a561-841e8bb33aa8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:27.838202 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-da9a9c2d-8f2e-4015-a561-841e8bb33aa8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56" status: 200 len: 1492 microversion: 2.1 time: 0.313002 Oct 23 01:21:27.840076 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1486/2983] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:27 2022] GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56 => generated 1492 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:21:27.848144 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b4890280-c52a-4b43-bb84-6ac8677dfa2d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:27.852479 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b4890280-c52a-4b43-bb84-6ac8677dfa2d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: ff868ee0-f1e4-4c03-a039-c0a6cd548b58] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:27.863420 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:27.865715 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b4890280-c52a-4b43-bb84-6ac8677dfa2d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:27.866410 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b4890280-c52a-4b43-bb84-6ac8677dfa2d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:27.866996 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b4890280-c52a-4b43-bb84-6ac8677dfa2d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:27.868136 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b4890280-c52a-4b43-bb84-6ac8677dfa2d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:27.876048 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b4890280-c52a-4b43-bb84-6ac8677dfa2d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:27.876048 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b4890280-c52a-4b43-bb84-6ac8677dfa2d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:27.986252 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b4890280-c52a-4b43-bb84-6ac8677dfa2d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:28.000653 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b4890280-c52a-4b43-bb84-6ac8677dfa2d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58" status: 200 len: 1278 microversion: 2.1 time: 0.158975 Oct 23 01:21:28.002824 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1487/2984] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:27 2022] GET /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58 => generated 1278 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:28.010673 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-792adada-0cc8-4a5a-b816-f2bd698d7299 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-487370463", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "0428f8a8-06a6-4705-9f25-b012ecd9e4dc"}, {"port": "9c5bddd0-bc00-4d4f-9c6f-55ec9f8a68db", "tag": "port-1"}, {"port": "64f70211-a0f5-4eaa-bee0-cef52f477333", "tag": "port-2"}, {"uuid": "87a966cd-3d5e-4588-9759-8210cbf6ec55", "tag": "net-1"}, {"uuid": "87a966cd-3d5e-4588-9759-8210cbf6ec55"}, {"uuid": "7c1d2343-d39e-464a-a4bf-2ee31b9a6899", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "7c1d2343-d39e-464a-a4bf-2ee31b9a6899", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "41d2ecef-202f-4562-a7c7-8bad44b675b3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "c918429d-fd98-4974-822d-ad54d4d5dc7b", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "4399e35a-b007-4194-b420-69bf2f09e3f9", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1884782260"}], "key_name": "tempest-keypair-990070396", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:21:28.047607 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e9c43129-29af-4578-8043-b2e19d241137 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:28.056645 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e9c43129-29af-4578-8043-b2e19d241137 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1518 microversion: 2.1 time: 0.415372 Oct 23 01:21:28.059884 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1498/2985] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:27 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1518 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:21:28.216770 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-792adada-0cc8-4a5a-b816-f2bd698d7299 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] validate_networks() for [('0428f8a8-06a6-4705-9f25-b012ecd9e4dc', None, None, None, None, None), (None, None, '9c5bddd0-bc00-4d4f-9c6f-55ec9f8a68db', None, None, None), (None, None, '64f70211-a0f5-4eaa-bee0-cef52f477333', None, None, None), ('87a966cd-3d5e-4588-9759-8210cbf6ec55', None, None, None, None, None), ('87a966cd-3d5e-4588-9759-8210cbf6ec55', None, None, None, None, None), ('7c1d2343-d39e-464a-a4bf-2ee31b9a6899', '10.2.2.100', None, None, None, None), ('7c1d2343-d39e-464a-a4bf-2ee31b9a6899', '10.2.2.200', None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:21:28.417002 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a0af018e-d733-442e-b967-782faecd614c tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:28.418174 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a0af018e-d733-442e-b967-782faecd614c tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] [instance: e973f866-0efe-40cb-82d5-846992200098] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:28.443053 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a0af018e-d733-442e-b967-782faecd614c tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:28.445721 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a0af018e-d733-442e-b967-782faecd614c tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:28.446454 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a0af018e-d733-442e-b967-782faecd614c tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:28.447372 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a0af018e-d733-442e-b967-782faecd614c tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:28.448727 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a0af018e-d733-442e-b967-782faecd614c tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:28.450784 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a0af018e-d733-442e-b967-782faecd614c tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:28.799254 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a0af018e-d733-442e-b967-782faecd614c tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74cdbbd7765495db29eb0428fadc992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee2e22f48754a4aa47426a27bebf68b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:28.812307 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a0af018e-d733-442e-b967-782faecd614c tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] 10.222.0.42 "GET /compute/v2.1/servers/e973f866-0efe-40cb-82d5-846992200098" status: 200 len: 1527 microversion: 2.1 time: 0.399311 Oct 23 01:21:28.832198 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1499/2986] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:28 2022] GET /compute/v2.1/servers/e973f866-0efe-40cb-82d5-846992200098 => generated 1527 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:28.842581 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-adb393d2-3b72-4216-882f-88af7bc2c080 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:28.846169 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-adb393d2-3b72-4216-882f-88af7bc2c080 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:28.870115 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-adb393d2-3b72-4216-882f-88af7bc2c080 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:28.870115 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-adb393d2-3b72-4216-882f-88af7bc2c080 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:28.870115 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-adb393d2-3b72-4216-882f-88af7bc2c080 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:28.871801 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-adb393d2-3b72-4216-882f-88af7bc2c080 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:28.872452 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-adb393d2-3b72-4216-882f-88af7bc2c080 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:28.874496 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-adb393d2-3b72-4216-882f-88af7bc2c080 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:29.144637 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=6 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:29.175361 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-adb393d2-3b72-4216-882f-88af7bc2c080 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lazy-loading 'services' on Instance uuid 2d7a734d-28b1-4d9f-b80d-c272576f8334 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:21:29.227562 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-adb393d2-3b72-4216-882f-88af7bc2c080 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334" status: 200 len: 1927 microversion: 2.75 time: 0.392971 Oct 23 01:21:29.228489 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1500/2987] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:21:28 2022] GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334 => generated 1927 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:21:29.248704 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2257d222-3de8-4478-81f3-7a8292768233 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:29.250909 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2257d222-3de8-4478-81f3-7a8292768233 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: 08afe605-c9f1-4d8b-98bc-9253414ebe56] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:29.271612 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2257d222-3de8-4478-81f3-7a8292768233 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:29.275821 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2257d222-3de8-4478-81f3-7a8292768233 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:29.276378 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2257d222-3de8-4478-81f3-7a8292768233 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:29.277640 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2257d222-3de8-4478-81f3-7a8292768233 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:29.290745 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2257d222-3de8-4478-81f3-7a8292768233 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:29.291441 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2257d222-3de8-4478-81f3-7a8292768233 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:29.690197 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2257d222-3de8-4478-81f3-7a8292768233 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:29.698626 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2257d222-3de8-4478-81f3-7a8292768233 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56" status: 200 len: 1492 microversion: 2.1 time: 0.468240 Oct 23 01:21:29.718037 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1501/2988] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:29 2022] GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56 => generated 1492 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:29.722709 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-142933ba-e8b8-495f-a44d-88b65f9f434e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:29.723039 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-142933ba-e8b8-495f-a44d-88b65f9f434e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: ff868ee0-f1e4-4c03-a039-c0a6cd548b58] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:29.730380 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-142933ba-e8b8-495f-a44d-88b65f9f434e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:29.730882 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-142933ba-e8b8-495f-a44d-88b65f9f434e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:29.731323 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-142933ba-e8b8-495f-a44d-88b65f9f434e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:29.732089 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-142933ba-e8b8-495f-a44d-88b65f9f434e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:29.732552 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-142933ba-e8b8-495f-a44d-88b65f9f434e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:29.732980 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-142933ba-e8b8-495f-a44d-88b65f9f434e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:29.829929 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-142933ba-e8b8-495f-a44d-88b65f9f434e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:29.849205 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-142933ba-e8b8-495f-a44d-88b65f9f434e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58" status: 200 len: 1266 microversion: 2.1 time: 0.122693 Oct 23 01:21:29.850982 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1502/2989] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:29 2022] GET /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58 => generated 1266 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:29.857653 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f020c77b-77e7-429f-aefe-bab905ac6f08 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:29.858502 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f020c77b-77e7-429f-aefe-bab905ac6f08 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:29.874996 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f020c77b-77e7-429f-aefe-bab905ac6f08 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:29.875647 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f020c77b-77e7-429f-aefe-bab905ac6f08 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:29.876368 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f020c77b-77e7-429f-aefe-bab905ac6f08 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:29.877148 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f020c77b-77e7-429f-aefe-bab905ac6f08 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:29.877679 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f020c77b-77e7-429f-aefe-bab905ac6f08 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:29.878276 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f020c77b-77e7-429f-aefe-bab905ac6f08 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:30.087328 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f020c77b-77e7-429f-aefe-bab905ac6f08 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:30.095827 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f020c77b-77e7-429f-aefe-bab905ac6f08 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1518 microversion: 2.1 time: 0.243330 Oct 23 01:21:30.096545 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1503/2990] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:29 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1518 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:30.102251 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f62f70d8-8b10-469e-9224-ccbf535cbf84 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:30.102959 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f62f70d8-8b10-469e-9224-ccbf535cbf84 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] [instance: e973f866-0efe-40cb-82d5-846992200098] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:30.109565 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f62f70d8-8b10-469e-9224-ccbf535cbf84 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:30.110167 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f62f70d8-8b10-469e-9224-ccbf535cbf84 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:30.110646 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f62f70d8-8b10-469e-9224-ccbf535cbf84 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:30.111483 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f62f70d8-8b10-469e-9224-ccbf535cbf84 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:30.112011 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f62f70d8-8b10-469e-9224-ccbf535cbf84 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:30.112494 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f62f70d8-8b10-469e-9224-ccbf535cbf84 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:30.335409 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f62f70d8-8b10-469e-9224-ccbf535cbf84 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74cdbbd7765495db29eb0428fadc992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee2e22f48754a4aa47426a27bebf68b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:30.343408 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f62f70d8-8b10-469e-9224-ccbf535cbf84 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] 10.222.0.42 "GET /compute/v2.1/servers/e973f866-0efe-40cb-82d5-846992200098" status: 200 len: 1527 microversion: 2.1 time: 0.245787 Oct 23 01:21:30.353035 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1504/2991] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:30 2022] GET /compute/v2.1/servers/e973f866-0efe-40cb-82d5-846992200098 => generated 1527 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:30.353035 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-77a4bc3d-090a-4394-b516-8345bb643f68 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:30.353035 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-77a4bc3d-090a-4394-b516-8345bb643f68 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:30.358204 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-77a4bc3d-090a-4394-b516-8345bb643f68 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:30.358684 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-77a4bc3d-090a-4394-b516-8345bb643f68 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:30.359122 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-77a4bc3d-090a-4394-b516-8345bb643f68 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:30.359821 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-77a4bc3d-090a-4394-b516-8345bb643f68 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:30.360283 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-77a4bc3d-090a-4394-b516-8345bb643f68 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:30.360709 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-77a4bc3d-090a-4394-b516-8345bb643f68 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:30.531534 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-77a4bc3d-090a-4394-b516-8345bb643f68 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lazy-loading 'services' on Instance uuid 2d7a734d-28b1-4d9f-b80d-c272576f8334 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:21:30.577428 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-77a4bc3d-090a-4394-b516-8345bb643f68 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334" status: 200 len: 1927 microversion: 2.75 time: 0.232345 Oct 23 01:21:30.591475 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1505/2992] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:21:30 2022] GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334 => generated 1927 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:21:30.733528 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-af63b717-b60a-478b-92fa-fd86228384f8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:30.734543 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-af63b717-b60a-478b-92fa-fd86228384f8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: 08afe605-c9f1-4d8b-98bc-9253414ebe56] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:30.751053 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-af63b717-b60a-478b-92fa-fd86228384f8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:30.751654 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-af63b717-b60a-478b-92fa-fd86228384f8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:30.753623 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-af63b717-b60a-478b-92fa-fd86228384f8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:30.754445 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-af63b717-b60a-478b-92fa-fd86228384f8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:30.755072 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-af63b717-b60a-478b-92fa-fd86228384f8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:30.763007 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-af63b717-b60a-478b-92fa-fd86228384f8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:31.387889 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-af63b717-b60a-478b-92fa-fd86228384f8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:31.396181 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-af63b717-b60a-478b-92fa-fd86228384f8 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56" status: 200 len: 1492 microversion: 2.1 time: 0.672907 Oct 23 01:21:31.396778 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1506/2993] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:30 2022] GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56 => generated 1492 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:31.401502 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f1bc3f5d-cb82-496d-a8da-9abebb156b90 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:31.418606 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f1bc3f5d-cb82-496d-a8da-9abebb156b90 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: ff868ee0-f1e4-4c03-a039-c0a6cd548b58] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:31.425056 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1bc3f5d-cb82-496d-a8da-9abebb156b90 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:31.425563 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1bc3f5d-cb82-496d-a8da-9abebb156b90 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:31.426121 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1bc3f5d-cb82-496d-a8da-9abebb156b90 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:31.427087 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1bc3f5d-cb82-496d-a8da-9abebb156b90 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:31.427730 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1bc3f5d-cb82-496d-a8da-9abebb156b90 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:31.430115 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1bc3f5d-cb82-496d-a8da-9abebb156b90 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:31.545191 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f1bc3f5d-cb82-496d-a8da-9abebb156b90 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:31.573399 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f1bc3f5d-cb82-496d-a8da-9abebb156b90 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58" status: 200 len: 1266 microversion: 2.1 time: 0.175542 Oct 23 01:21:31.579244 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1507/2994] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:31 2022] GET /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:31.587744 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dc898178-ee09-4189-820e-2cac46461d06 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:31.595007 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-dc898178-ee09-4189-820e-2cac46461d06 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:31.599156 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dc898178-ee09-4189-820e-2cac46461d06 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:31.600459 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dc898178-ee09-4189-820e-2cac46461d06 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:31.601165 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dc898178-ee09-4189-820e-2cac46461d06 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:31.602422 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dc898178-ee09-4189-820e-2cac46461d06 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:31.602752 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dc898178-ee09-4189-820e-2cac46461d06 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:31.603420 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dc898178-ee09-4189-820e-2cac46461d06 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:31.981412 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=6 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:32.230061 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-dc898178-ee09-4189-820e-2cac46461d06 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:32.242472 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-dc898178-ee09-4189-820e-2cac46461d06 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1518 microversion: 2.1 time: 0.661312 Oct 23 01:21:32.246302 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1508/2995] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:31 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1518 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:32.252459 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-579eb296-99ac-469d-8d74-dd2d432ef758 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:32.263471 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-579eb296-99ac-469d-8d74-dd2d432ef758 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] [instance: e973f866-0efe-40cb-82d5-846992200098] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:32.279743 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-579eb296-99ac-469d-8d74-dd2d432ef758 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:32.284349 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-579eb296-99ac-469d-8d74-dd2d432ef758 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:32.285189 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-579eb296-99ac-469d-8d74-dd2d432ef758 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:32.286450 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-579eb296-99ac-469d-8d74-dd2d432ef758 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:32.292660 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-579eb296-99ac-469d-8d74-dd2d432ef758 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:32.295966 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-579eb296-99ac-469d-8d74-dd2d432ef758 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:32.366034 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=6 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:33.072211 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-579eb296-99ac-469d-8d74-dd2d432ef758 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74cdbbd7765495db29eb0428fadc992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee2e22f48754a4aa47426a27bebf68b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:33.090786 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-579eb296-99ac-469d-8d74-dd2d432ef758 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] 10.222.0.42 "GET /compute/v2.1/servers/e973f866-0efe-40cb-82d5-846992200098" status: 200 len: 1527 microversion: 2.1 time: 0.843091 Oct 23 01:21:33.098126 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1509/2996] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:32 2022] GET /compute/v2.1/servers/e973f866-0efe-40cb-82d5-846992200098 => generated 1527 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:33.117248 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-46f88780-3c37-4946-860e-fcf8d3ea30e4 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:33.119811 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-46f88780-3c37-4946-860e-fcf8d3ea30e4 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:33.141592 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46f88780-3c37-4946-860e-fcf8d3ea30e4 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:33.142701 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46f88780-3c37-4946-860e-fcf8d3ea30e4 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:33.147300 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46f88780-3c37-4946-860e-fcf8d3ea30e4 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:33.151076 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46f88780-3c37-4946-860e-fcf8d3ea30e4 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:33.152879 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46f88780-3c37-4946-860e-fcf8d3ea30e4 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:33.153924 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46f88780-3c37-4946-860e-fcf8d3ea30e4 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:33.460107 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=8 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:34.099097 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-46f88780-3c37-4946-860e-fcf8d3ea30e4 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lazy-loading 'services' on Instance uuid 2d7a734d-28b1-4d9f-b80d-c272576f8334 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:21:34.150225 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-46f88780-3c37-4946-860e-fcf8d3ea30e4 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334" status: 200 len: 1927 microversion: 2.75 time: 1.049121 Oct 23 01:21:34.165135 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1510/2997] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:21:33 2022] GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334 => generated 1927 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:21:34.428531 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fdfdbe3d-d04b-48d4-9fa2-e88df8278c77 tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Action: 'update', calling method: .version_select at 0x7f5cc1a09af0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:21:34.445057 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fdfdbe3d-d04b-48d4-9fa2-e88df8278c77 tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:34.446907 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fdfdbe3d-d04b-48d4-9fa2-e88df8278c77 tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:34.452121 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fdfdbe3d-d04b-48d4-9fa2-e88df8278c77 tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:34.473623 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fdfdbe3d-d04b-48d4-9fa2-e88df8278c77 tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:34.474425 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fdfdbe3d-d04b-48d4-9fa2-e88df8278c77 tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:34.479448 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fdfdbe3d-d04b-48d4-9fa2-e88df8278c77 tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:34.507053 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-fdfdbe3d-d04b-48d4-9fa2-e88df8278c77 tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] HTTP exception thrown: Service ec71dbfc-6de5-45cc-9065-2729669b51d0 could not be found. Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fdfdbe3d-d04b-48d4-9fa2-e88df8278c77 tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Request method failure captured: Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: request: PUT /compute/v2.1/os-services/ec71dbfc-6de5-45cc-9065-2729669b51d0 HTTP/1.1 Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 56 Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJcbhnBwHABK4RLZ_6vVNFlE-dxKZ0y_bF10xBQ75obpIGsbumVUctsaA8let-FX9ypRR9NRGml5qV5TZUAXtNagNjoWIr_ARp6qXHawsiRYO0jJgLRa1rLj8iPlQmaWO6pF3nEh4OI46KvRKC5dZVnJobwsruuCyUhJgP89dIpnWRI Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: X-Openstack-Nova-Api-Version: 2.53 Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 0551a7e254a2471ab15d5f12cdd99a00 Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2121859232 Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,admin,reader Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,admin,reader Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/0551a7e254a2471ab15d5f12cdd99a00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_0551a7e254a2471ab15d5f12cdd99a00"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0551a7e254a2471ab15d5f12cdd99a00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0551a7e254a2471ab15d5f12cdd99a00"}]}] Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2121859232 Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 0551a7e254a2471ab15d5f12cdd99a00 Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2121859232 Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 78a3374259e04cffa93ed7a62b7dcf64 Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: method: Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: exception: Service ec71dbfc-6de5-45cc-9065-2729669b51d0 could not be found. Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'ec71dbfc-6de5-45cc-9065-2729669b51d0', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service ec71dbfc-6de5-45cc-9065-2729669b51d0 could not be found. Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:21:34.515125 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:21:34.521624 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 23 01:21:34.521624 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:21:34.521624 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service ec71dbfc-6de5-45cc-9065-2729669b51d0 could not be found. Oct 23 01:21:34.521624 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:21:34.521624 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:21:34.521624 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:21:34.521624 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:34.521624 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:21:34.521624 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:21:34.521624 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:21:34.521624 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:21:34.521624 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service ec71dbfc-6de5-45cc-9065-2729669b51d0 could not be found. Oct 23 01:21:34.521624 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:21:34.521624 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fdfdbe3d-d04b-48d4-9fa2-e88df8278c77 tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Returning 404 to user: Service ec71dbfc-6de5-45cc-9065-2729669b51d0 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:21:34.525508 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fdfdbe3d-d04b-48d4-9fa2-e88df8278c77 tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-services/ec71dbfc-6de5-45cc-9065-2729669b51d0" status: 404 len: 110 microversion: 2.53 time: 0.358975 Oct 23 01:21:34.526675 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1511/2998] 10.222.0.42 () {62 vars in 1309 bytes} [Sun Oct 23 01:21:34 2022] PUT /compute/v2.1/os-services/ec71dbfc-6de5-45cc-9065-2729669b51d0 => generated 110 bytes in 361 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:21:34.565174 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-28b4ab30-405c-45c3-b999-3b4f93e8f7ee tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:34.566968 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-28b4ab30-405c-45c3-b999-3b4f93e8f7ee tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: 08afe605-c9f1-4d8b-98bc-9253414ebe56] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:34.592140 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-28b4ab30-405c-45c3-b999-3b4f93e8f7ee tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:34.595257 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-28b4ab30-405c-45c3-b999-3b4f93e8f7ee tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:34.595849 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-28b4ab30-405c-45c3-b999-3b4f93e8f7ee tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:34.597239 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-28b4ab30-405c-45c3-b999-3b4f93e8f7ee tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:34.617883 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-28b4ab30-405c-45c3-b999-3b4f93e8f7ee tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:34.620505 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-28b4ab30-405c-45c3-b999-3b4f93e8f7ee tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:35.025371 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-28b4ab30-405c-45c3-b999-3b4f93e8f7ee tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:35.037941 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-28b4ab30-405c-45c3-b999-3b4f93e8f7ee tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56" status: 200 len: 1450 microversion: 2.1 time: 0.509258 Oct 23 01:21:35.045497 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1512/2999] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:34 2022] GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56 => generated 1450 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:35.050397 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-12c7982f-ba8c-42e2-89b7-629f18884fc4 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:35.051013 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-12c7982f-ba8c-42e2-89b7-629f18884fc4 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: ff868ee0-f1e4-4c03-a039-c0a6cd548b58] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:35.069689 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-12c7982f-ba8c-42e2-89b7-629f18884fc4 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:35.070190 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-12c7982f-ba8c-42e2-89b7-629f18884fc4 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:35.080847 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-12c7982f-ba8c-42e2-89b7-629f18884fc4 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:35.081615 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-12c7982f-ba8c-42e2-89b7-629f18884fc4 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:35.086258 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-12c7982f-ba8c-42e2-89b7-629f18884fc4 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:35.086258 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-12c7982f-ba8c-42e2-89b7-629f18884fc4 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:35.775343 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-12c7982f-ba8c-42e2-89b7-629f18884fc4 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:35.793905 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-12c7982f-ba8c-42e2-89b7-629f18884fc4 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58" status: 200 len: 1308 microversion: 2.1 time: 0.745084 Oct 23 01:21:35.795362 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1513/3000] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:35 2022] GET /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58 => generated 1308 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:35.818018 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-63496cf0-7321-45e2-a793-4e4be87d6be1 req-e6c59ff0-e1a0-4e21-ac33-ff0bb1e337fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e973f866-0efe-40cb-82d5-846992200098", "name": "network-vif-unplugged", "status": "completed", "tag": "3aa616ae-3a51-4e63-9266-36211026f582"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:21:35.874000 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-63496cf0-7321-45e2-a793-4e4be87d6be1 req-e6c59ff0-e1a0-4e21-ac33-ff0bb1e337fe service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:35.874874 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-63496cf0-7321-45e2-a793-4e4be87d6be1 req-e6c59ff0-e1a0-4e21-ac33-ff0bb1e337fe service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:35.878128 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-63496cf0-7321-45e2-a793-4e4be87d6be1 req-e6c59ff0-e1a0-4e21-ac33-ff0bb1e337fe service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:35.904310 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-63496cf0-7321-45e2-a793-4e4be87d6be1 req-e6c59ff0-e1a0-4e21-ac33-ff0bb1e337fe service nova] Creating event network-vif-unplugged:3aa616ae-3a51-4e63-9266-36211026f582 for instance e973f866-0efe-40cb-82d5-846992200098 on n-h1-master-1 Oct 23 01:21:35.927181 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-63496cf0-7321-45e2-a793-4e4be87d6be1 req-e6c59ff0-e1a0-4e21-ac33-ff0bb1e337fe service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.129134 Oct 23 01:21:35.930819 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1514/3001] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:21:35.949527 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e3a6e20a-3439-4a4d-bf0a-55cda6fbfd50 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:35.951022 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e3a6e20a-3439-4a4d-bf0a-55cda6fbfd50 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:35.960591 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e3a6e20a-3439-4a4d-bf0a-55cda6fbfd50 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:35.961399 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e3a6e20a-3439-4a4d-bf0a-55cda6fbfd50 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:35.962119 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e3a6e20a-3439-4a4d-bf0a-55cda6fbfd50 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:35.963386 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e3a6e20a-3439-4a4d-bf0a-55cda6fbfd50 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:35.965699 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e3a6e20a-3439-4a4d-bf0a-55cda6fbfd50 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:35.966457 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e3a6e20a-3439-4a4d-bf0a-55cda6fbfd50 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:35.981881 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-792adada-0cc8-4a5a-b816-f2bd698d7299 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:21:35.981881 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-792adada-0cc8-4a5a-b816-f2bd698d7299 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:21:35.981881 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-792adada-0cc8-4a5a-b816-f2bd698d7299 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:21:35.981881 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-792adada-0cc8-4a5a-b816-f2bd698d7299 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:21:35.981881 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-792adada-0cc8-4a5a-b816-f2bd698d7299 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:21:36.003144 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-792adada-0cc8-4a5a-b816-f2bd698d7299 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:36.003898 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-792adada-0cc8-4a5a-b816-f2bd698d7299 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:36.004537 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-792adada-0cc8-4a5a-b816-f2bd698d7299 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:36.005445 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-792adada-0cc8-4a5a-b816-f2bd698d7299 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:36.006274 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-792adada-0cc8-4a5a-b816-f2bd698d7299 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:36.010321 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-792adada-0cc8-4a5a-b816-f2bd698d7299 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:36.046023 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=100 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:36.071707 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-792adada-0cc8-4a5a-b816-f2bd698d7299 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Getting quotas for project a1f4adec8a4749a2bec19e7af0863059. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:21:36.093942 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-792adada-0cc8-4a5a-b816-f2bd698d7299 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Getting quotas for user 69bd8aff49524f19ae950f92d46bd44b and project a1f4adec8a4749a2bec19e7af0863059. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:21:36.299870 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e3a6e20a-3439-4a4d-bf0a-55cda6fbfd50 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:36.313812 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e3a6e20a-3439-4a4d-bf0a-55cda6fbfd50 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1518 microversion: 2.1 time: 0.374121 Oct 23 01:21:36.314435 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1515/3002] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:35 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1518 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:36.331301 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-24b36607-6066-438f-a0aa-52133a7e876a tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:36.336361 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-24b36607-6066-438f-a0aa-52133a7e876a tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] [instance: e973f866-0efe-40cb-82d5-846992200098] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:36.351454 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-24b36607-6066-438f-a0aa-52133a7e876a tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:36.351959 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-24b36607-6066-438f-a0aa-52133a7e876a tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:36.352617 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-24b36607-6066-438f-a0aa-52133a7e876a tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:36.353519 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-24b36607-6066-438f-a0aa-52133a7e876a tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:36.354180 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-24b36607-6066-438f-a0aa-52133a7e876a tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:36.354766 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-24b36607-6066-438f-a0aa-52133a7e876a tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:36.394786 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-24b36607-6066-438f-a0aa-52133a7e876a tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:36.395470 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-24b36607-6066-438f-a0aa-52133a7e876a tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:36.396120 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-24b36607-6066-438f-a0aa-52133a7e876a tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:36.396734 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-24b36607-6066-438f-a0aa-52133a7e876a tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lazy-loading 'fault' on Instance uuid e973f866-0efe-40cb-82d5-846992200098 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:21:36.483285 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-24b36607-6066-438f-a0aa-52133a7e876a tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74cdbbd7765495db29eb0428fadc992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee2e22f48754a4aa47426a27bebf68b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:36.500665 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-24b36607-6066-438f-a0aa-52133a7e876a tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] 10.222.0.42 "GET /compute/v2.1/servers/e973f866-0efe-40cb-82d5-846992200098" status: 200 len: 1313 microversion: 2.1 time: 0.172300 Oct 23 01:21:36.504583 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1516/3003] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:36 2022] GET /compute/v2.1/servers/e973f866-0efe-40cb-82d5-846992200098 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:36.515601 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-52be1029-f1cd-4fac-9fae-30416f949385 tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Action: 'update', calling method: .version_select at 0x7f5cc2439ee0>, body: {"status": "disabled"} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:21:36.521536 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-52be1029-f1cd-4fac-9fae-30416f949385 tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:36.525395 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-52be1029-f1cd-4fac-9fae-30416f949385 tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:36.526093 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-52be1029-f1cd-4fac-9fae-30416f949385 tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:36.529408 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-792adada-0cc8-4a5a-b816-f2bd698d7299 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:21:36.532525 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-792adada-0cc8-4a5a-b816-f2bd698d7299 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='41d2ecef-202f-4562-a7c7-8bad44b675b3',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='c918429d-fd98-4974-822d-ad54d4d5dc7b',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4399e35a-b007-4194-b420-69bf2f09e3f9',volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:21:36.539534 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-52be1029-f1cd-4fac-9fae-30416f949385 tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:36.540101 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-52be1029-f1cd-4fac-9fae-30416f949385 tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:36.540945 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-52be1029-f1cd-4fac-9fae-30416f949385 tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:36.560202 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-52be1029-f1cd-4fac-9fae-30416f949385 tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] HTTP exception thrown: Service ec71dbfc-6de5-45cc-9065-2729669b51d0 could not be found. Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-52be1029-f1cd-4fac-9fae-30416f949385 tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Request method failure captured: Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: request: PUT /compute/v2.1/os-services/ec71dbfc-6de5-45cc-9065-2729669b51d0 HTTP/1.1 Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 22 Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJcbhnBwHABK4RLZ_6vVNFlE-dxKZ0y_bF10xBQ75obpIGsbumVUctsaA8let-FX9ypRR9NRGml5qV5TZUAXtNagNjoWIr_ARp6qXHawsiRYO0jJgLRa1rLj8iPlQmaWO6pF3nEh4OI46KvRKC5dZVnJobwsruuCyUhJgP89dIpnWRI Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: X-Openstack-Nova-Api-Version: 2.53 Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 0551a7e254a2471ab15d5f12cdd99a00 Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2121859232 Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,admin,reader Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,admin,reader Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/0551a7e254a2471ab15d5f12cdd99a00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_0551a7e254a2471ab15d5f12cdd99a00"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0551a7e254a2471ab15d5f12cdd99a00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0551a7e254a2471ab15d5f12cdd99a00"}]}] Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2121859232 Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 0551a7e254a2471ab15d5f12cdd99a00 Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2121859232 Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 78a3374259e04cffa93ed7a62b7dcf64 Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: {"status": "disabled"} Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: method: Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: exception: Service ec71dbfc-6de5-45cc-9065-2729669b51d0 could not be found. Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'ec71dbfc-6de5-45cc-9065-2729669b51d0', 'body': {'status': 'disabled'}} Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service ec71dbfc-6de5-45cc-9065-2729669b51d0 could not be found. Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:21:36.563779 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:21:36.568310 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 23 01:21:36.568310 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:21:36.568310 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service ec71dbfc-6de5-45cc-9065-2729669b51d0 could not be found. Oct 23 01:21:36.568310 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:21:36.568310 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:21:36.568310 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:21:36.568310 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:36.568310 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:21:36.568310 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:21:36.568310 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:21:36.568310 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:21:36.568310 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service ec71dbfc-6de5-45cc-9065-2729669b51d0 could not be found. Oct 23 01:21:36.568310 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:21:36.570706 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-52be1029-f1cd-4fac-9fae-30416f949385 tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Returning 404 to user: Service ec71dbfc-6de5-45cc-9065-2729669b51d0 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:21:36.573204 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-52be1029-f1cd-4fac-9fae-30416f949385 tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-services/ec71dbfc-6de5-45cc-9065-2729669b51d0" status: 404 len: 110 microversion: 2.53 time: 0.066623 Oct 23 01:21:36.574465 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1517/3004] 10.222.0.42 () {62 vars in 1309 bytes} [Sun Oct 23 01:21:36 2022] PUT /compute/v2.1/os-services/ec71dbfc-6de5-45cc-9065-2729669b51d0 => generated 110 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:21:36.587458 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-255e7222-e1e0-4200-9606-15b8be3a4c18 req-628fb12c-c01c-48a1-9df7-933f70d23876 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e973f866-0efe-40cb-82d5-846992200098", "name": "network-vif-deleted", "tag": "3aa616ae-3a51-4e63-9266-36211026f582"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:21:36.602947 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-255e7222-e1e0-4200-9606-15b8be3a4c18 req-628fb12c-c01c-48a1-9df7-933f70d23876 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:36.603745 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-255e7222-e1e0-4200-9606-15b8be3a4c18 req-628fb12c-c01c-48a1-9df7-933f70d23876 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:36.604536 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-255e7222-e1e0-4200-9606-15b8be3a4c18 req-628fb12c-c01c-48a1-9df7-933f70d23876 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:36.618131 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-255e7222-e1e0-4200-9606-15b8be3a4c18 req-628fb12c-c01c-48a1-9df7-933f70d23876 service nova] Creating event network-vif-deleted:3aa616ae-3a51-4e63-9266-36211026f582 for instance e973f866-0efe-40cb-82d5-846992200098 on n-h1-master-1 Oct 23 01:21:36.625108 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-255e7222-e1e0-4200-9606-15b8be3a4c18 req-628fb12c-c01c-48a1-9df7-933f70d23876 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043846 Oct 23 01:21:36.626118 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1518/3005] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:21:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:21:36.734457 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-7786e0cd-e41d-4a6f-a9ce-52b3908c8257 req-2fbfd120-446c-4217-819b-7cd78566e8d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08afe605-c9f1-4d8b-98bc-9253414ebe56", "name": "network-vif-deleted", "tag": "4b120ca2-cd12-4f29-a253-45c547ab8eec"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:21:36.745025 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-7786e0cd-e41d-4a6f-a9ce-52b3908c8257 req-2fbfd120-446c-4217-819b-7cd78566e8d9 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:36.745919 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-7786e0cd-e41d-4a6f-a9ce-52b3908c8257 req-2fbfd120-446c-4217-819b-7cd78566e8d9 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:36.746582 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-7786e0cd-e41d-4a6f-a9ce-52b3908c8257 req-2fbfd120-446c-4217-819b-7cd78566e8d9 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:36.761117 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-7786e0cd-e41d-4a6f-a9ce-52b3908c8257 req-2fbfd120-446c-4217-819b-7cd78566e8d9 service nova] Creating event network-vif-deleted:4b120ca2-cd12-4f29-a253-45c547ab8eec for instance 08afe605-c9f1-4d8b-98bc-9253414ebe56 on n-h1-master-1 Oct 23 01:21:36.766881 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-7786e0cd-e41d-4a6f-a9ce-52b3908c8257 req-2fbfd120-446c-4217-819b-7cd78566e8d9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139420 Oct 23 01:21:36.771281 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1519/3006] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:21:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:21:36.777731 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-76ca0abc-3466-4184-bf7e-b6607ff251b5 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:36.778574 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-76ca0abc-3466-4184-bf7e-b6607ff251b5 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:36.786339 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-76ca0abc-3466-4184-bf7e-b6607ff251b5 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:36.787169 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-76ca0abc-3466-4184-bf7e-b6607ff251b5 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:36.787873 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-76ca0abc-3466-4184-bf7e-b6607ff251b5 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:36.788803 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-76ca0abc-3466-4184-bf7e-b6607ff251b5 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:36.789455 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-76ca0abc-3466-4184-bf7e-b6607ff251b5 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:36.790147 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-76ca0abc-3466-4184-bf7e-b6607ff251b5 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:37.011004 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-76ca0abc-3466-4184-bf7e-b6607ff251b5 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] Lazy-loading 'services' on Instance uuid 2d7a734d-28b1-4d9f-b80d-c272576f8334 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:21:37.076784 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-76ca0abc-3466-4184-bf7e-b6607ff251b5 tempest-ServersAdmin275Test-1249597465 tempest-ServersAdmin275Test-1249597465-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334" status: 200 len: 1918 microversion: 2.75 time: 0.307649 Oct 23 01:21:37.087983 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1520/3007] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:21:36 2022] GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334 => generated 1918 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:21:37.087983 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7ada4e66-2033-4fd9-9c0a-96c1736fc83d tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:37.087983 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7ada4e66-2033-4fd9-9c0a-96c1736fc83d tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: 08afe605-c9f1-4d8b-98bc-9253414ebe56] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:37.097574 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ada4e66-2033-4fd9-9c0a-96c1736fc83d tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:37.098368 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ada4e66-2033-4fd9-9c0a-96c1736fc83d tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:37.098991 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ada4e66-2033-4fd9-9c0a-96c1736fc83d tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:37.099851 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ada4e66-2033-4fd9-9c0a-96c1736fc83d tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:37.100461 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ada4e66-2033-4fd9-9c0a-96c1736fc83d tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:37.101043 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ada4e66-2033-4fd9-9c0a-96c1736fc83d tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:37.191467 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ada4e66-2033-4fd9-9c0a-96c1736fc83d tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:37.192185 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ada4e66-2033-4fd9-9c0a-96c1736fc83d tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:37.199246 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ada4e66-2033-4fd9-9c0a-96c1736fc83d tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:37.199246 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-7ada4e66-2033-4fd9-9c0a-96c1736fc83d tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lazy-loading 'fault' on Instance uuid 08afe605-c9f1-4d8b-98bc-9253414ebe56 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:21:37.352303 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7ada4e66-2033-4fd9-9c0a-96c1736fc83d tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:37.385627 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7ada4e66-2033-4fd9-9c0a-96c1736fc83d tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56" status: 200 len: 1303 microversion: 2.1 time: 0.305627 Oct 23 01:21:37.390908 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1521/3008] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:37 2022] GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56 => generated 1303 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:37.427660 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ea113fe4-20dc-4791-80e2-ad38933ff38e tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Action: 'update', calling method: .version_select at 0x7f5cc21c7040>, body: {"status": "enabled"} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:21:37.445561 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ea113fe4-20dc-4791-80e2-ad38933ff38e tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:37.447862 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ea113fe4-20dc-4791-80e2-ad38933ff38e tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:37.451144 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ea113fe4-20dc-4791-80e2-ad38933ff38e tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:37.468969 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ea113fe4-20dc-4791-80e2-ad38933ff38e tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:37.472097 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ea113fe4-20dc-4791-80e2-ad38933ff38e tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:37.474179 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ea113fe4-20dc-4791-80e2-ad38933ff38e tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:37.493434 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-ea113fe4-20dc-4791-80e2-ad38933ff38e tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] HTTP exception thrown: Service ec71dbfc-6de5-45cc-9065-2729669b51d0 could not be found. Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ea113fe4-20dc-4791-80e2-ad38933ff38e tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Request method failure captured: Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: request: PUT /compute/v2.1/os-services/ec71dbfc-6de5-45cc-9065-2729669b51d0 HTTP/1.1 Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 21 Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJcbhnBwHABK4RLZ_6vVNFlE-dxKZ0y_bF10xBQ75obpIGsbumVUctsaA8let-FX9ypRR9NRGml5qV5TZUAXtNagNjoWIr_ARp6qXHawsiRYO0jJgLRa1rLj8iPlQmaWO6pF3nEh4OI46KvRKC5dZVnJobwsruuCyUhJgP89dIpnWRI Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: X-Openstack-Nova-Api-Version: 2.53 Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 0551a7e254a2471ab15d5f12cdd99a00 Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2121859232 Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,admin,reader Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,admin,reader Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/0551a7e254a2471ab15d5f12cdd99a00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_0551a7e254a2471ab15d5f12cdd99a00"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0551a7e254a2471ab15d5f12cdd99a00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0551a7e254a2471ab15d5f12cdd99a00"}]}] Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2121859232 Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 0551a7e254a2471ab15d5f12cdd99a00 Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2121859232 Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 78a3374259e04cffa93ed7a62b7dcf64 Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: {"status": "enabled"} Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: method: Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: exception: Service ec71dbfc-6de5-45cc-9065-2729669b51d0 could not be found. Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'ec71dbfc-6de5-45cc-9065-2729669b51d0', 'body': {'status': 'enabled'}} Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service ec71dbfc-6de5-45cc-9065-2729669b51d0 could not be found. Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:21:37.496352 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:21:37.501014 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 23 01:21:37.501014 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:21:37.501014 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service ec71dbfc-6de5-45cc-9065-2729669b51d0 could not be found. Oct 23 01:21:37.501014 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:21:37.501014 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:21:37.501014 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:21:37.501014 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:37.501014 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:21:37.501014 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:21:37.501014 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:21:37.501014 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:21:37.501014 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service ec71dbfc-6de5-45cc-9065-2729669b51d0 could not be found. Oct 23 01:21:37.501014 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:21:37.503015 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ea113fe4-20dc-4791-80e2-ad38933ff38e tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Returning 404 to user: Service ec71dbfc-6de5-45cc-9065-2729669b51d0 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:21:37.505652 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ea113fe4-20dc-4791-80e2-ad38933ff38e tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-services/ec71dbfc-6de5-45cc-9065-2729669b51d0" status: 404 len: 110 microversion: 2.53 time: 0.115578 Oct 23 01:21:37.506849 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1522/3009] 10.222.0.42 () {62 vars in 1309 bytes} [Sun Oct 23 01:21:37 2022] PUT /compute/v2.1/os-services/ec71dbfc-6de5-45cc-9065-2729669b51d0 => generated 110 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:21:37.512997 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-35dcae0c-beb2-4c3c-9215-369d7638480e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:37.514044 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-35dcae0c-beb2-4c3c-9215-369d7638480e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: ff868ee0-f1e4-4c03-a039-c0a6cd548b58] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:37.524970 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-35dcae0c-beb2-4c3c-9215-369d7638480e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:37.525930 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-35dcae0c-beb2-4c3c-9215-369d7638480e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:37.527963 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-35dcae0c-beb2-4c3c-9215-369d7638480e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:37.528970 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-35dcae0c-beb2-4c3c-9215-369d7638480e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:37.529598 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-35dcae0c-beb2-4c3c-9215-369d7638480e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:37.530784 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-35dcae0c-beb2-4c3c-9215-369d7638480e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:37.830325 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-35dcae0c-beb2-4c3c-9215-369d7638480e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:37.838737 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-35dcae0c-beb2-4c3c-9215-369d7638480e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58" status: 200 len: 1308 microversion: 2.1 time: 0.330357 Oct 23 01:21:37.853125 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1523/3010] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:37 2022] GET /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58 => generated 1308 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:37.859885 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-17fa3349-8e49-40be-ace9-7037fd0a25e4 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:37.860749 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-17fa3349-8e49-40be-ace9-7037fd0a25e4 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:37.867514 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-17fa3349-8e49-40be-ace9-7037fd0a25e4 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:37.868275 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-17fa3349-8e49-40be-ace9-7037fd0a25e4 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:37.871863 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-17fa3349-8e49-40be-ace9-7037fd0a25e4 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:37.871863 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-17fa3349-8e49-40be-ace9-7037fd0a25e4 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:37.871863 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-17fa3349-8e49-40be-ace9-7037fd0a25e4 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:37.871863 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-17fa3349-8e49-40be-ace9-7037fd0a25e4 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:37.903347 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-17fa3349-8e49-40be-ace9-7037fd0a25e4 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:21:38.036317 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-792adada-0cc8-4a5a-b816-f2bd698d7299 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 10.031692 Oct 23 01:21:38.037282 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1488/3011] 10.222.0.42 () {62 vars in 1189 bytes} [Sun Oct 23 01:21:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 10033 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 23 01:21:38.041926 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0d810ede-28d5-4738-9fa1-4c991c141136 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:38.043111 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0d810ede-28d5-4738-9fa1-4c991c141136 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:38.049656 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d810ede-28d5-4738-9fa1-4c991c141136 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:38.050712 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d810ede-28d5-4738-9fa1-4c991c141136 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:38.051449 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d810ede-28d5-4738-9fa1-4c991c141136 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:38.052154 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d810ede-28d5-4738-9fa1-4c991c141136 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:38.052608 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d810ede-28d5-4738-9fa1-4c991c141136 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:38.053032 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d810ede-28d5-4738-9fa1-4c991c141136 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:38.183943 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-17fa3349-8e49-40be-ace9-7037fd0a25e4 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334" status: 204 len: 0 microversion: 2.75 time: 0.328430 Oct 23 01:21:38.185157 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1524/3012] 10.222.0.42 () {60 vars in 1280 bytes} [Sun Oct 23 01:21:37 2022] DELETE /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 23 01:21:38.191550 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d32c2a60-7a57-4afd-bca6-39c7ae4efb18 tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:38.195274 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d32c2a60-7a57-4afd-bca6-39c7ae4efb18 tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:38.195864 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d32c2a60-7a57-4afd-bca6-39c7ae4efb18 tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:38.196474 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d32c2a60-7a57-4afd-bca6-39c7ae4efb18 tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:38.197218 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d32c2a60-7a57-4afd-bca6-39c7ae4efb18 tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:38.197682 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d32c2a60-7a57-4afd-bca6-39c7ae4efb18 tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:38.198166 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d32c2a60-7a57-4afd-bca6-39c7ae4efb18 tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:38.226791 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d32c2a60-7a57-4afd-bca6-39c7ae4efb18 tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.039930 Oct 23 01:21:38.227976 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1525/3013] 10.222.0.42 () {60 vars in 1178 bytes} [Sun Oct 23 01:21:38 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:21:38.240088 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7b6e8ef6-a31e-463f-bab7-1ae49fe1c219 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:38.241180 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7b6e8ef6-a31e-463f-bab7-1ae49fe1c219 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] [instance: e973f866-0efe-40cb-82d5-846992200098] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:38.247891 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b6e8ef6-a31e-463f-bab7-1ae49fe1c219 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:38.248595 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b6e8ef6-a31e-463f-bab7-1ae49fe1c219 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:38.249208 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b6e8ef6-a31e-463f-bab7-1ae49fe1c219 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:38.250288 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b6e8ef6-a31e-463f-bab7-1ae49fe1c219 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:38.250757 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b6e8ef6-a31e-463f-bab7-1ae49fe1c219 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:38.251183 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b6e8ef6-a31e-463f-bab7-1ae49fe1c219 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:38.267046 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-7b6e8ef6-a31e-463f-bab7-1ae49fe1c219 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] HTTP exception thrown: Instance e973f866-0efe-40cb-82d5-846992200098 could not be found. Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7b6e8ef6-a31e-463f-bab7-1ae49fe1c219 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Request method failure captured: Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/e973f866-0efe-40cb-82d5-846992200098 HTTP/1.1 Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJb2FhXIjs-QE00OpVgVRw0uLV3DjfyewOzoSDtBxegQ7x65rBbts4_UzCuwq_pDfjkBBd1G13IjfpUbrfawksd_y8YZBtG1vAkotjfZMcecyAoP_I2Cf_NiXmIIlPb5sIcClbzuOisk37NSbIl4jfFgIa9DnZA0Qsll5kTUmhKoceM Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: fee2e22f48754a4aa47426a27bebf68b Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-420579287 Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/fee2e22f48754a4aa47426a27bebf68b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_fee2e22f48754a4aa47426a27bebf68b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fee2e22f48754a4aa47426a27bebf68b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fee2e22f48754a4aa47426a27bebf68b"}]}] Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-420579287 Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: fee2e22f48754a4aa47426a27bebf68b Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-420579287 Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServerAddressesNegativeTestJSON-420579287-project Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: b74cdbbd7765495db29eb0428fadc992 Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-420579287-project Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: exception: Instance e973f866-0efe-40cb-82d5-846992200098 could not be found. Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'e973f866-0efe-40cb-82d5-846992200098'} Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e973f866-0efe-40cb-82d5-846992200098 could not be found. Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e973f866-0efe-40cb-82d5-846992200098 could not be found. Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:21:38.274003 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:21:38.278985 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:21:38.278985 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:38.278985 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:21:38.278985 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:21:38.278985 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:21:38.278985 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:21:38.278985 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e973f866-0efe-40cb-82d5-846992200098 could not be found. Oct 23 01:21:38.278985 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:21:38.278985 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7b6e8ef6-a31e-463f-bab7-1ae49fe1c219 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] Returning 404 to user: Instance e973f866-0efe-40cb-82d5-846992200098 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:21:38.278985 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7b6e8ef6-a31e-463f-bab7-1ae49fe1c219 tempest-ServerAddressesNegativeTestJSON-420579287 tempest-ServerAddressesNegativeTestJSON-420579287-project] 10.222.0.42 "GET /compute/v2.1/servers/e973f866-0efe-40cb-82d5-846992200098" status: 404 len: 111 microversion: 2.1 time: 0.041951 Oct 23 01:21:38.278985 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1526/3014] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:38 2022] GET /compute/v2.1/servers/e973f866-0efe-40cb-82d5-846992200098 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:21:38.351899 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4c1f0a0a-85c5-450d-b00f-c959fef3f7c5 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-790956974", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "adef91da-7c17-43a3-ab76-6f337732f444"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:21:38.376503 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0d810ede-28d5-4738-9fa1-4c991c141136 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:38.392651 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0d810ede-28d5-4738-9fa1-4c991c141136 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1518 microversion: 2.1 time: 0.354202 Oct 23 01:21:38.393674 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1489/3015] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:38 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1518 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:38.408480 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1e74e385-b844-4786-a483-828071df15d9 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:38.409684 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1e74e385-b844-4786-a483-828071df15d9 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:38.451928 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-4c1f0a0a-85c5-450d-b00f-c959fef3f7c5 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] validate_networks() for [('adef91da-7c17-43a3-ab76-6f337732f444', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:21:38.950768 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1e74e385-b844-4786-a483-828071df15d9 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:38.981201 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1e74e385-b844-4786-a483-828071df15d9 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:38.986359 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1e74e385-b844-4786-a483-828071df15d9 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:38.987938 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1e74e385-b844-4786-a483-828071df15d9 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1284 microversion: 2.42 time: 0.592800 Oct 23 01:21:38.989073 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1490/3016] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:21:38 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1284 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:21:38.995902 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7aed3d3b-e6fc-4a1a-b9f4-2c34c92fcb74 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:38.997268 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7aed3d3b-e6fc-4a1a-b9f4-2c34c92fcb74 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:39.006289 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7aed3d3b-e6fc-4a1a-b9f4-2c34c92fcb74 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:39.007218 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7aed3d3b-e6fc-4a1a-b9f4-2c34c92fcb74 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:39.007858 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7aed3d3b-e6fc-4a1a-b9f4-2c34c92fcb74 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:39.008791 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7aed3d3b-e6fc-4a1a-b9f4-2c34c92fcb74 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:39.009601 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7aed3d3b-e6fc-4a1a-b9f4-2c34c92fcb74 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:39.010483 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7aed3d3b-e6fc-4a1a-b9f4-2c34c92fcb74 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:39.256804 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7aed3d3b-e6fc-4a1a-b9f4-2c34c92fcb74 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:39.270908 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7aed3d3b-e6fc-4a1a-b9f4-2c34c92fcb74 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:39.275041 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7aed3d3b-e6fc-4a1a-b9f4-2c34c92fcb74 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:39.300435 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7aed3d3b-e6fc-4a1a-b9f4-2c34c92fcb74 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] 10.222.0.42 "GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334" status: 200 len: 1443 microversion: 2.75 time: 0.310014 Oct 23 01:21:39.305050 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1491/3017] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:21:38 2022] GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334 => generated 1443 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:21:39.330704 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c1732331-c435-499e-a931-72a31e8f751c tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:39.344218 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c1732331-c435-499e-a931-72a31e8f751c tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:39.344729 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c1732331-c435-499e-a931-72a31e8f751c tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:39.345246 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c1732331-c435-499e-a931-72a31e8f751c tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:39.346122 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c1732331-c435-499e-a931-72a31e8f751c tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:39.346613 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c1732331-c435-499e-a931-72a31e8f751c tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:39.347051 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c1732331-c435-499e-a931-72a31e8f751c tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:39.450892 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c1732331-c435-499e-a931-72a31e8f751c tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.144354 Oct 23 01:21:39.451832 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1492/3018] 10.222.0.42 () {60 vars in 1211 bytes} [Sun Oct 23 01:21:39 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:21:39.456622 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3c57ecd7-cc95-492b-ba39-c348f148aca2 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:39.457242 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3c57ecd7-cc95-492b-ba39-c348f148aca2 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: 08afe605-c9f1-4d8b-98bc-9253414ebe56] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:39.487027 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c57ecd7-cc95-492b-ba39-c348f148aca2 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:39.494155 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c57ecd7-cc95-492b-ba39-c348f148aca2 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:39.494155 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c57ecd7-cc95-492b-ba39-c348f148aca2 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:39.494155 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c57ecd7-cc95-492b-ba39-c348f148aca2 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:39.494155 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c57ecd7-cc95-492b-ba39-c348f148aca2 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:39.494155 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c57ecd7-cc95-492b-ba39-c348f148aca2 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:39.530011 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:39.579402 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c57ecd7-cc95-492b-ba39-c348f148aca2 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:39.580010 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c57ecd7-cc95-492b-ba39-c348f148aca2 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:39.580683 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c57ecd7-cc95-492b-ba39-c348f148aca2 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:39.581376 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-3c57ecd7-cc95-492b-ba39-c348f148aca2 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lazy-loading 'fault' on Instance uuid 08afe605-c9f1-4d8b-98bc-9253414ebe56 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:21:39.680449 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3c57ecd7-cc95-492b-ba39-c348f148aca2 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3838dd33052740fa88b9cf2888c208ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed372b4663a94ff1ba20abe32e2f9e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:39.690685 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3c57ecd7-cc95-492b-ba39-c348f148aca2 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56" status: 200 len: 1303 microversion: 2.1 time: 0.237401 Oct 23 01:21:39.691553 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1493/3019] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:39 2022] GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56 => generated 1303 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:39.696302 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-83f8adbb-90a6-46a7-8963-06eeb8d1e466 req-40a6029e-2180-44c4-82d9-5a7843df6dd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff868ee0-f1e4-4c03-a039-c0a6cd548b58", "tag": "aea99284-1df7-49c1-b874-c2f688b118b9"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:21:39.718402 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-83f8adbb-90a6-46a7-8963-06eeb8d1e466 req-40a6029e-2180-44c4-82d9-5a7843df6dd9 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:39.719378 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-83f8adbb-90a6-46a7-8963-06eeb8d1e466 req-40a6029e-2180-44c4-82d9-5a7843df6dd9 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:39.720067 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-83f8adbb-90a6-46a7-8963-06eeb8d1e466 req-40a6029e-2180-44c4-82d9-5a7843df6dd9 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:39.735426 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-83f8adbb-90a6-46a7-8963-06eeb8d1e466 req-40a6029e-2180-44c4-82d9-5a7843df6dd9 service nova] Creating event network-changed:aea99284-1df7-49c1-b874-c2f688b118b9 for instance ff868ee0-f1e4-4c03-a039-c0a6cd548b58 on n-h1-master-1 Oct 23 01:21:39.741998 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-83f8adbb-90a6-46a7-8963-06eeb8d1e466 req-40a6029e-2180-44c4-82d9-5a7843df6dd9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049391 Oct 23 01:21:39.742954 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1494/3020] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:21:39.749301 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-81777fed-ca9b-4185-a99d-fc21a7c2092e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:39.750127 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-81777fed-ca9b-4185-a99d-fc21a7c2092e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: ff868ee0-f1e4-4c03-a039-c0a6cd548b58] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:39.756783 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-81777fed-ca9b-4185-a99d-fc21a7c2092e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:39.757358 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-81777fed-ca9b-4185-a99d-fc21a7c2092e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:39.757866 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-81777fed-ca9b-4185-a99d-fc21a7c2092e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:39.758803 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-81777fed-ca9b-4185-a99d-fc21a7c2092e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:39.759199 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-81777fed-ca9b-4185-a99d-fc21a7c2092e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:39.759726 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-81777fed-ca9b-4185-a99d-fc21a7c2092e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:40.133422 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-81777fed-ca9b-4185-a99d-fc21a7c2092e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:40.149668 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-81777fed-ca9b-4185-a99d-fc21a7c2092e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58" status: 200 len: 1308 microversion: 2.1 time: 0.405430 Oct 23 01:21:40.168432 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1495/3021] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:39 2022] GET /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58 => generated 1308 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:40.174706 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-46037884-228a-4d43-9507-15861910b335 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:40.175914 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-46037884-228a-4d43-9507-15861910b335 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:40.198120 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46037884-228a-4d43-9507-15861910b335 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:40.199570 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46037884-228a-4d43-9507-15861910b335 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:40.201200 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46037884-228a-4d43-9507-15861910b335 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:40.202857 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46037884-228a-4d43-9507-15861910b335 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:40.204166 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46037884-228a-4d43-9507-15861910b335 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:40.205549 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46037884-228a-4d43-9507-15861910b335 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:40.316217 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-4c1f0a0a-85c5-450d-b00f-c959fef3f7c5 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:21:40.318051 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-4c1f0a0a-85c5-450d-b00f-c959fef3f7c5 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:21:40.318782 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-4c1f0a0a-85c5-450d-b00f-c959fef3f7c5 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:21:40.320622 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-4c1f0a0a-85c5-450d-b00f-c959fef3f7c5 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:21:40.321294 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-4c1f0a0a-85c5-450d-b00f-c959fef3f7c5 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:21:40.348514 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4c1f0a0a-85c5-450d-b00f-c959fef3f7c5 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:40.351331 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4c1f0a0a-85c5-450d-b00f-c959fef3f7c5 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:40.357597 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4c1f0a0a-85c5-450d-b00f-c959fef3f7c5 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:40.358046 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4c1f0a0a-85c5-450d-b00f-c959fef3f7c5 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:40.358971 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4c1f0a0a-85c5-450d-b00f-c959fef3f7c5 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:40.359635 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4c1f0a0a-85c5-450d-b00f-c959fef3f7c5 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:40.427900 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-4c1f0a0a-85c5-450d-b00f-c959fef3f7c5 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Getting quotas for project 4ac1b744484c41c88314112b572ccac1. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:21:40.440289 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-4c1f0a0a-85c5-450d-b00f-c959fef3f7c5 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Getting quotas for user a3bede03a6c44c3cbe86f7a06601d115 and project 4ac1b744484c41c88314112b572ccac1. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:21:40.474405 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4c1f0a0a-85c5-450d-b00f-c959fef3f7c5 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Going to run 2 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:21:40.474405 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4c1f0a0a-85c5-450d-b00f-c959fef3f7c5 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] [instance: 8e352f0d-c908-46b8-a28c-8704d0c92da6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:21:40.606065 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4c1f0a0a-85c5-450d-b00f-c959fef3f7c5 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] [instance: 05c1ab48-a6d9-464e-8c9f-69daf726e353] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=8e352f0d-c908-46b8-a28c-8704d0c92da6,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:21:40.900497 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4c1f0a0a-85c5-450d-b00f-c959fef3f7c5 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.627721 Oct 23 01:21:40.901156 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1527/3022] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:21:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:21:40.906205 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-271582a4-2fc6-4e9d-9e6b-17ce7abfff70 tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:40.910547 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-271582a4-2fc6-4e9d-9e6b-17ce7abfff70 tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:40.911254 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-271582a4-2fc6-4e9d-9e6b-17ce7abfff70 tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:40.912062 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-271582a4-2fc6-4e9d-9e6b-17ce7abfff70 tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:40.913209 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-271582a4-2fc6-4e9d-9e6b-17ce7abfff70 tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:40.913853 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-271582a4-2fc6-4e9d-9e6b-17ce7abfff70 tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:40.914475 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-271582a4-2fc6-4e9d-9e6b-17ce7abfff70 tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:40.969618 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-46037884-228a-4d43-9507-15861910b335 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:40.982737 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-46037884-228a-4d43-9507-15861910b335 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1518 microversion: 2.1 time: 0.811799 Oct 23 01:21:40.983661 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1496/3023] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:40 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1518 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:41.009825 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d94bf5e6-fd8f-42d7-9e31-16714bb51428 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:41.010682 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d94bf5e6-fd8f-42d7-9e31-16714bb51428 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:41.017447 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-271582a4-2fc6-4e9d-9e6b-17ce7abfff70 tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.114941 Oct 23 01:21:41.028056 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d94bf5e6-fd8f-42d7-9e31-16714bb51428 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:41.032441 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d94bf5e6-fd8f-42d7-9e31-16714bb51428 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:41.032441 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d94bf5e6-fd8f-42d7-9e31-16714bb51428 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:41.032441 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d94bf5e6-fd8f-42d7-9e31-16714bb51428 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:41.033053 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d94bf5e6-fd8f-42d7-9e31-16714bb51428 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:41.033053 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d94bf5e6-fd8f-42d7-9e31-16714bb51428 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:41.036392 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1528/3024] 10.222.0.42 () {60 vars in 1178 bytes} [Sun Oct 23 01:21:40 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:21:41.041639 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-62496b43-956d-4423-bfa4-8adcb2c1559b tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:41.051316 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-62496b43-956d-4423-bfa4-8adcb2c1559b tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:41.080807 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-62496b43-956d-4423-bfa4-8adcb2c1559b tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:41.081311 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-62496b43-956d-4423-bfa4-8adcb2c1559b tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:41.081754 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-62496b43-956d-4423-bfa4-8adcb2c1559b tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:41.083653 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-62496b43-956d-4423-bfa4-8adcb2c1559b tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:41.090942 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-62496b43-956d-4423-bfa4-8adcb2c1559b tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:41.091621 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-62496b43-956d-4423-bfa4-8adcb2c1559b tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:41.222821 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-62496b43-956d-4423-bfa4-8adcb2c1559b tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:41.223315 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-62496b43-956d-4423-bfa4-8adcb2c1559b tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:41.225249 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-62496b43-956d-4423-bfa4-8adcb2c1559b tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:41.226600 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-62496b43-956d-4423-bfa4-8adcb2c1559b tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lazy-loading 'fault' on Instance uuid 2d7a734d-28b1-4d9f-b80d-c272576f8334 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:21:41.238732 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d94bf5e6-fd8f-42d7-9e31-16714bb51428 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:41.252106 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d94bf5e6-fd8f-42d7-9e31-16714bb51428 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:41.271942 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d94bf5e6-fd8f-42d7-9e31-16714bb51428 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:41.275513 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d94bf5e6-fd8f-42d7-9e31-16714bb51428 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1518 microversion: 2.42 time: 0.290569 Oct 23 01:21:41.278374 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1497/3025] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:21:40 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1518 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:21:41.284827 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3c369e14-a762-4a03-9641-d65217575ac1 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:41.285762 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3c369e14-a762-4a03-9641-d65217575ac1 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] [instance: 08afe605-c9f1-4d8b-98bc-9253414ebe56] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:41.321317 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c369e14-a762-4a03-9641-d65217575ac1 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:41.321317 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c369e14-a762-4a03-9641-d65217575ac1 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:41.321317 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c369e14-a762-4a03-9641-d65217575ac1 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:41.321317 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c369e14-a762-4a03-9641-d65217575ac1 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:41.321317 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c369e14-a762-4a03-9641-d65217575ac1 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:41.321317 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c369e14-a762-4a03-9641-d65217575ac1 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:41.410984 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-3c369e14-a762-4a03-9641-d65217575ac1 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] HTTP exception thrown: Instance 08afe605-c9f1-4d8b-98bc-9253414ebe56 could not be found. Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3c369e14-a762-4a03-9641-d65217575ac1 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Request method failure captured: Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56 HTTP/1.1 Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJaDXUZvy62hgrSulw80Jlya2mFw7DpCTUsT6-_wQ5xOj3Tavsu0cKeMoq3s-3qr-_hC_ATNZZdhUgOGYjmgtJFbQjmls46TiXRt1tlqR_KL8EGPEv_o2R5XC5uqVhhVqc3i5ZwCsvyljnDE95g-GLc1BfA6rZRFgO5Npots12iUjIo Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: ed372b4663a94ff1ba20abe32e2f9e77 Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServerRescueTestJSON-1625154572 Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ed372b4663a94ff1ba20abe32e2f9e77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ed372b4663a94ff1ba20abe32e2f9e77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ed372b4663a94ff1ba20abe32e2f9e77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ed372b4663a94ff1ba20abe32e2f9e77"}]}] Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServerRescueTestJSON-1625154572 Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: ed372b4663a94ff1ba20abe32e2f9e77 Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServerRescueTestJSON-1625154572 Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServerRescueTestJSON-1625154572-project Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 3838dd33052740fa88b9cf2888c208ff Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServerRescueTestJSON-1625154572-project Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 08afe605-c9f1-4d8b-98bc-9253414ebe56 could not be found. Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '08afe605-c9f1-4d8b-98bc-9253414ebe56'} Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08afe605-c9f1-4d8b-98bc-9253414ebe56 could not be found. Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08afe605-c9f1-4d8b-98bc-9253414ebe56 could not be found. Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:21:41.427086 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:21:41.431866 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:41.431866 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:21:41.431866 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:21:41.431866 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:21:41.431866 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:21:41.431866 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08afe605-c9f1-4d8b-98bc-9253414ebe56 could not be found. Oct 23 01:21:41.431866 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:21:41.433804 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3c369e14-a762-4a03-9641-d65217575ac1 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] Returning 404 to user: Instance 08afe605-c9f1-4d8b-98bc-9253414ebe56 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:21:41.435025 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3c369e14-a762-4a03-9641-d65217575ac1 tempest-ServerRescueTestJSON-1625154572 tempest-ServerRescueTestJSON-1625154572-project] 10.222.0.42 "GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56" status: 404 len: 111 microversion: 2.1 time: 0.154906 Oct 23 01:21:41.436286 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1498/3026] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:41 2022] GET /compute/v2.1/servers/08afe605-c9f1-4d8b-98bc-9253414ebe56 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:21:41.450690 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-04cb7269-a81a-4663-af71-dea252c2d7ee tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:41.468652 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-04cb7269-a81a-4663-af71-dea252c2d7ee tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a3bede03a6c44c3cbe86f7a06601d115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1b744484c41c88314112b572ccac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:41.469837 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-04cb7269-a81a-4663-af71-dea252c2d7ee tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Searching by: {'deleted': False, 'project_id': '4ac1b744484c41c88314112b572ccac1'} {{(pid=120945) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 23 01:21:41.512788 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-04cb7269-a81a-4663-af71-dea252c2d7ee tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:41.521939 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-04cb7269-a81a-4663-af71-dea252c2d7ee tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:41.522747 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-04cb7269-a81a-4663-af71-dea252c2d7ee tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:41.523764 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-04cb7269-a81a-4663-af71-dea252c2d7ee tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:41.524490 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-04cb7269-a81a-4663-af71-dea252c2d7ee tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:41.525168 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-04cb7269-a81a-4663-af71-dea252c2d7ee tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:41.697029 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-62496b43-956d-4423-bfa4-8adcb2c1559b tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:41.714649 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-04cb7269-a81a-4663-af71-dea252c2d7ee tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.270340 Oct 23 01:21:41.714649 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1499/3027] 10.222.0.42 () {58 vars in 1125 bytes} [Sun Oct 23 01:21:41 2022] GET /compute/v2.1/servers => generated 675 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:21:41.714649 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4023522d-b863-4681-bb2c-633118682903 tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:41.716676 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-62496b43-956d-4423-bfa4-8adcb2c1559b tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:41.730140 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4023522d-b863-4681-bb2c-633118682903 tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:41.732206 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-62496b43-956d-4423-bfa4-8adcb2c1559b tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:41.733040 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4023522d-b863-4681-bb2c-633118682903 tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:41.734958 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:41.735148 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4023522d-b863-4681-bb2c-633118682903 tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:41.736240 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4023522d-b863-4681-bb2c-633118682903 tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:41.736872 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4023522d-b863-4681-bb2c-633118682903 tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:41.737476 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4023522d-b863-4681-bb2c-633118682903 tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:41.756574 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-62496b43-956d-4423-bfa4-8adcb2c1559b tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] 10.222.0.42 "GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334" status: 200 len: 1448 microversion: 2.75 time: 0.718934 Oct 23 01:21:41.757200 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1529/3028] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:21:41 2022] GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334 => generated 1448 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:21:41.772770 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dfe5843a-1343-4ad8-a48a-f7743828cb67 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:41.773509 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-dfe5843a-1343-4ad8-a48a-f7743828cb67 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: ff868ee0-f1e4-4c03-a039-c0a6cd548b58] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:41.795704 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dfe5843a-1343-4ad8-a48a-f7743828cb67 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:41.796231 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dfe5843a-1343-4ad8-a48a-f7743828cb67 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:41.796691 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dfe5843a-1343-4ad8-a48a-f7743828cb67 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:41.815068 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dfe5843a-1343-4ad8-a48a-f7743828cb67 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:41.818526 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dfe5843a-1343-4ad8-a48a-f7743828cb67 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:41.818526 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dfe5843a-1343-4ad8-a48a-f7743828cb67 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:41.827868 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4023522d-b863-4681-bb2c-633118682903 tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.108054 Oct 23 01:21:41.834532 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1500/3029] 10.222.0.42 () {60 vars in 1235 bytes} [Sun Oct 23 01:21:41 2022] GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx => generated 16 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:41.844919 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-77b09f33-2c2e-41bd-89de-a26c37d5e17f tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:41.845618 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-77b09f33-2c2e-41bd-89de-a26c37d5e17f tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] [instance: 05c1ab48-a6d9-464e-8c9f-69daf726e353] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:42.211201 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-77b09f33-2c2e-41bd-89de-a26c37d5e17f tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bede03a6c44c3cbe86f7a06601d115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1b744484c41c88314112b572ccac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:42.265244 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-77b09f33-2c2e-41bd-89de-a26c37d5e17f tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] 10.222.0.42 "GET /compute/v2.1/servers/05c1ab48-a6d9-464e-8c9f-69daf726e353" status: 200 len: 1219 microversion: 2.1 time: 0.401639 Oct 23 01:21:42.278637 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1501/3030] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:41 2022] GET /compute/v2.1/servers/05c1ab48-a6d9-464e-8c9f-69daf726e353 => generated 1219 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:42.309902 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-396c046c-abaa-4845-b838-b869bfcb740d tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:42.335221 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-396c046c-abaa-4845-b838-b869bfcb740d tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:42.344177 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-396c046c-abaa-4845-b838-b869bfcb740d tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:42.344919 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-396c046c-abaa-4845-b838-b869bfcb740d tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:42.345929 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-396c046c-abaa-4845-b838-b869bfcb740d tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:42.346683 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-396c046c-abaa-4845-b838-b869bfcb740d tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:42.348986 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-396c046c-abaa-4845-b838-b869bfcb740d tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:42.405489 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-396c046c-abaa-4845-b838-b869bfcb740d tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.115296 Oct 23 01:21:42.407589 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1502/3031] 10.222.0.42 () {60 vars in 1178 bytes} [Sun Oct 23 01:21:42 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:21:42.413940 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0c8cc785-10ed-45b5-bf95-e6c7c6b288cd tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:42.419700 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0c8cc785-10ed-45b5-bf95-e6c7c6b288cd tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:42.450297 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0c8cc785-10ed-45b5-bf95-e6c7c6b288cd tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:42.451191 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0c8cc785-10ed-45b5-bf95-e6c7c6b288cd tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:42.451814 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0c8cc785-10ed-45b5-bf95-e6c7c6b288cd tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:42.452738 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0c8cc785-10ed-45b5-bf95-e6c7c6b288cd tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:42.453383 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0c8cc785-10ed-45b5-bf95-e6c7c6b288cd tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:42.453991 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0c8cc785-10ed-45b5-bf95-e6c7c6b288cd tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:42.751090 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-dfe5843a-1343-4ad8-a48a-f7743828cb67 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:42.771139 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-dfe5843a-1343-4ad8-a48a-f7743828cb67 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58" status: 200 len: 1308 microversion: 2.1 time: 1.010678 Oct 23 01:21:42.791693 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1530/3032] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:41 2022] GET /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58 => generated 1308 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:42.803929 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c1e0c35d-b307-446d-a1f4-c006f10f9ec2 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:42.807154 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c1e0c35d-b307-446d-a1f4-c006f10f9ec2 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:42.831756 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c1e0c35d-b307-446d-a1f4-c006f10f9ec2 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:42.832582 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c1e0c35d-b307-446d-a1f4-c006f10f9ec2 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:42.833239 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c1e0c35d-b307-446d-a1f4-c006f10f9ec2 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:42.834294 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c1e0c35d-b307-446d-a1f4-c006f10f9ec2 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:42.835102 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c1e0c35d-b307-446d-a1f4-c006f10f9ec2 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:42.835867 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c1e0c35d-b307-446d-a1f4-c006f10f9ec2 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:42.884895 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0c8cc785-10ed-45b5-bf95-e6c7c6b288cd tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:42.896055 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0c8cc785-10ed-45b5-bf95-e6c7c6b288cd tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1518 microversion: 2.1 time: 0.486973 Oct 23 01:21:42.897543 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1503/3033] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:42 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1518 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:42.908137 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3b09c83d-9722-44f4-a692-34f9279fdacb tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:42.920485 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b09c83d-9722-44f4-a692-34f9279fdacb tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:42.921437 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b09c83d-9722-44f4-a692-34f9279fdacb tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:42.922168 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b09c83d-9722-44f4-a692-34f9279fdacb tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:42.934022 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b09c83d-9722-44f4-a692-34f9279fdacb tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:42.940816 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b09c83d-9722-44f4-a692-34f9279fdacb tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:42.941632 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b09c83d-9722-44f4-a692-34f9279fdacb tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:42.977944 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c1e0c35d-b307-446d-a1f4-c006f10f9ec2 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:42.997371 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c1e0c35d-b307-446d-a1f4-c006f10f9ec2 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:43.005169 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3b09c83d-9722-44f4-a692-34f9279fdacb tempest-ServicesAdminNegativeV253TestJSON-2121859232 tempest-ServicesAdminNegativeV253TestJSON-2121859232-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.105913 Oct 23 01:21:43.008503 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c1e0c35d-b307-446d-a1f4-c006f10f9ec2 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:43.010269 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c1e0c35d-b307-446d-a1f4-c006f10f9ec2 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1574 microversion: 2.42 time: 0.216513 Oct 23 01:21:43.014948 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1504/3034] 10.222.0.42 () {60 vars in 1239 bytes} [Sun Oct 23 01:21:42 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:43.023665 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1531/3035] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:21:42 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1574 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:21:43.041674 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-efd0ad95-1a75-43d5-b102-e1c612e32c40 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:43.047280 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-efd0ad95-1a75-43d5-b102-e1c612e32c40 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:43.069620 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-efd0ad95-1a75-43d5-b102-e1c612e32c40 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:43.070630 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-efd0ad95-1a75-43d5-b102-e1c612e32c40 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:43.073701 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-efd0ad95-1a75-43d5-b102-e1c612e32c40 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:43.074664 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-efd0ad95-1a75-43d5-b102-e1c612e32c40 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:43.075301 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-efd0ad95-1a75-43d5-b102-e1c612e32c40 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:43.078340 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-efd0ad95-1a75-43d5-b102-e1c612e32c40 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:43.142562 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-efd0ad95-1a75-43d5-b102-e1c612e32c40 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:43.143136 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-efd0ad95-1a75-43d5-b102-e1c612e32c40 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:43.143759 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-efd0ad95-1a75-43d5-b102-e1c612e32c40 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:43.144333 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-efd0ad95-1a75-43d5-b102-e1c612e32c40 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lazy-loading 'fault' on Instance uuid 2d7a734d-28b1-4d9f-b80d-c272576f8334 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:21:43.257115 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-95e17f2a-e27f-47a3-bde3-c7075f755af4 tempest-ServicesAdminNegativeV253TestJSON-2104095649 tempest-ServicesAdminNegativeV253TestJSON-2104095649-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:43.261479 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-95e17f2a-e27f-47a3-bde3-c7075f755af4 tempest-ServicesAdminNegativeV253TestJSON-2104095649 tempest-ServicesAdminNegativeV253TestJSON-2104095649-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '0a03e43dee164fbfae007c1be58b0ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc2aee3c7b442f7acaac4dbba594cb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-95e17f2a-e27f-47a3-bde3-c7075f755af4 tempest-ServicesAdminNegativeV253TestJSON-2104095649 tempest-ServicesAdminNegativeV253TestJSON-2104095649-project] Request method failure captured: Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJca-C4wynowqfwUJvTE_NKoc0EocpksyEbnsPbbGFDWjNBJqfxFz2qD2bhbxbrx8E99-oWTQ7Uda66IgTGazUSy3FyX-cI2NTh2bddUPe0XRT4bxPmnLx-shr0K5wkIcriSP2wAU0LyrICC1dPAju6HbzNz8ROQ9k9pqVHDLhnnsoM Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: X-Openstack-Nova-Api-Version: 2.53 Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 5bc2aee3c7b442f7acaac4dbba594cb2 Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2104095649 Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5bc2aee3c7b442f7acaac4dbba594cb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5bc2aee3c7b442f7acaac4dbba594cb2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5bc2aee3c7b442f7acaac4dbba594cb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5bc2aee3c7b442f7acaac4dbba594cb2"}]}] Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2104095649 Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 5bc2aee3c7b442f7acaac4dbba594cb2 Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2104095649 Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2104095649-project Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 0a03e43dee164fbfae007c1be58b0ace Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2104095649-project Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: action_args: {} Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise self.value Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 23 01:21:43.269013 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 23 01:21:43.285667 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:21:43.285667 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:21:43.285667 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:21:43.285667 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:43.285667 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:21:43.285667 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:21:43.285667 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 23 01:21:43.285667 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 23 01:21:43.285667 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 23 01:21:43.285667 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:21:43.285667 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-95e17f2a-e27f-47a3-bde3-c7075f755af4 tempest-ServicesAdminNegativeV253TestJSON-2104095649 tempest-ServicesAdminNegativeV253TestJSON-2104095649-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:21:43.285667 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-95e17f2a-e27f-47a3-bde3-c7075f755af4 tempest-ServicesAdminNegativeV253TestJSON-2104095649 tempest-ServicesAdminNegativeV253TestJSON-2104095649-project] 10.222.0.42 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.248770 Oct 23 01:21:43.285667 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1532/3036] 10.222.0.42 () {60 vars in 1178 bytes} [Sun Oct 23 01:21:43 2022] GET /compute/v2.1/os-services => generated 112 bytes in 250 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:21:43.305628 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3a48f950-8f16-4a0b-8fa7-0fbd1605e577 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:43.306678 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3a48f950-8f16-4a0b-8fa7-0fbd1605e577 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] [instance: 05c1ab48-a6d9-464e-8c9f-69daf726e353] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:43.442819 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-efd0ad95-1a75-43d5-b102-e1c612e32c40 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:43.473225 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-efd0ad95-1a75-43d5-b102-e1c612e32c40 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:43.475277 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-efd0ad95-1a75-43d5-b102-e1c612e32c40 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e26043c04dc34c7299990c1c405c53a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f211c102b8d3427d8884e2790b264dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:43.504735 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-efd0ad95-1a75-43d5-b102-e1c612e32c40 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] 10.222.0.42 "GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334" status: 200 len: 1448 microversion: 2.75 time: 0.472873 Oct 23 01:21:43.518031 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1505/3037] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:21:43 2022] GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334 => generated 1448 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:21:43.540076 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-75092413-db13-40dc-b7a9-25ad23ef689d req-a4aa7220-bd85-403d-a90b-026a77782d74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62a8ad26-f65b-432d-a8da-48264c426335", "name": "network-vif-plugged", "status": "completed", "tag": "56917629-dd5e-4c91-a45e-1e8e6cd25138"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:21:43.556872 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3a48f950-8f16-4a0b-8fa7-0fbd1605e577 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bede03a6c44c3cbe86f7a06601d115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1b744484c41c88314112b572ccac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:43.575304 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-75092413-db13-40dc-b7a9-25ad23ef689d req-a4aa7220-bd85-403d-a90b-026a77782d74 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:43.575304 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-75092413-db13-40dc-b7a9-25ad23ef689d req-a4aa7220-bd85-403d-a90b-026a77782d74 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:43.575304 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-75092413-db13-40dc-b7a9-25ad23ef689d req-a4aa7220-bd85-403d-a90b-026a77782d74 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:43.575664 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3a48f950-8f16-4a0b-8fa7-0fbd1605e577 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] 10.222.0.42 "GET /compute/v2.1/servers/05c1ab48-a6d9-464e-8c9f-69daf726e353" status: 200 len: 1219 microversion: 2.1 time: 0.271754 Oct 23 01:21:43.575664 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1533/3038] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:43 2022] GET /compute/v2.1/servers/05c1ab48-a6d9-464e-8c9f-69daf726e353 => generated 1219 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:43.607437 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-75092413-db13-40dc-b7a9-25ad23ef689d req-a4aa7220-bd85-403d-a90b-026a77782d74 service nova] Creating event network-vif-plugged:56917629-dd5e-4c91-a45e-1e8e6cd25138 for instance 62a8ad26-f65b-432d-a8da-48264c426335 on n-h1-master-1 Oct 23 01:21:43.615812 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-75092413-db13-40dc-b7a9-25ad23ef689d req-a4aa7220-bd85-403d-a90b-026a77782d74 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085401 Oct 23 01:21:43.627572 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1506/3039] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:21:43.801321 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5a00a2e0-ef69-446a-b13a-b4a89a7c1069 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:43.801957 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5a00a2e0-ef69-446a-b13a-b4a89a7c1069 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: ff868ee0-f1e4-4c03-a039-c0a6cd548b58] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:43.821278 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5a00a2e0-ef69-446a-b13a-b4a89a7c1069 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:43.822385 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5a00a2e0-ef69-446a-b13a-b4a89a7c1069 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:43.823102 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5a00a2e0-ef69-446a-b13a-b4a89a7c1069 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:43.824717 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5a00a2e0-ef69-446a-b13a-b4a89a7c1069 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:43.825362 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5a00a2e0-ef69-446a-b13a-b4a89a7c1069 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:43.844683 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5a00a2e0-ef69-446a-b13a-b4a89a7c1069 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:43.927719 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-90e717b9-6464-4a9b-9986-fde3aa50d27b tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:43.937534 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-90e717b9-6464-4a9b-9986-fde3aa50d27b tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:43.957070 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-90e717b9-6464-4a9b-9986-fde3aa50d27b tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:43.957070 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-90e717b9-6464-4a9b-9986-fde3aa50d27b tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:43.957070 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-90e717b9-6464-4a9b-9986-fde3aa50d27b tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:43.957070 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-90e717b9-6464-4a9b-9986-fde3aa50d27b tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:43.957070 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-90e717b9-6464-4a9b-9986-fde3aa50d27b tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:43.957070 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-90e717b9-6464-4a9b-9986-fde3aa50d27b tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:44.979490 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5a00a2e0-ef69-446a-b13a-b4a89a7c1069 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:45.009571 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5a00a2e0-ef69-446a-b13a-b4a89a7c1069 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58" status: 200 len: 1308 microversion: 2.1 time: 1.214272 Oct 23 01:21:45.017174 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1534/3040] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:43 2022] GET /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58 => generated 1308 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:45.022143 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2cef7258-15fb-4092-95b4-7e05e58dbea1 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:45.022760 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2cef7258-15fb-4092-95b4-7e05e58dbea1 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:45.035930 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-90e717b9-6464-4a9b-9986-fde3aa50d27b tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:45.042897 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2cef7258-15fb-4092-95b4-7e05e58dbea1 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:45.045517 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2cef7258-15fb-4092-95b4-7e05e58dbea1 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:45.046126 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2cef7258-15fb-4092-95b4-7e05e58dbea1 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:45.048264 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2cef7258-15fb-4092-95b4-7e05e58dbea1 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:45.049889 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2cef7258-15fb-4092-95b4-7e05e58dbea1 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:45.050456 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2cef7258-15fb-4092-95b4-7e05e58dbea1 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:45.063462 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-90e717b9-6464-4a9b-9986-fde3aa50d27b tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1518 microversion: 2.1 time: 1.142037 Oct 23 01:21:45.067238 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1507/3041] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:43 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1518 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:45.101492 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8abc8924-589b-4451-a729-b1d2a96db451 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:45.109883 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8abc8924-589b-4451-a729-b1d2a96db451 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] [instance: 2d7a734d-28b1-4d9f-b80d-c272576f8334] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:45.162498 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8abc8924-589b-4451-a729-b1d2a96db451 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:45.164022 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8abc8924-589b-4451-a729-b1d2a96db451 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:45.166025 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8abc8924-589b-4451-a729-b1d2a96db451 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:45.167040 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8abc8924-589b-4451-a729-b1d2a96db451 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:45.170444 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8abc8924-589b-4451-a729-b1d2a96db451 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:45.171338 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8abc8924-589b-4451-a729-b1d2a96db451 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:45.237769 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-8abc8924-589b-4451-a729-b1d2a96db451 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] HTTP exception thrown: Instance 2d7a734d-28b1-4d9f-b80d-c272576f8334 could not be found. Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8abc8924-589b-4451-a729-b1d2a96db451 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Request method failure captured: Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334 HTTP/1.1 Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJbO_tUBDJGX3LMMH_H_d4fEElelGPI5OCUSrMJJwYHVN06Tn-OT0EZ-s6PxQHoWEtnWRsr-1OEw8p4TRE41hs-scnv_wL02VMyKyb7CugBZSYY4rudCAglRSuHeuO4blapS_4oc-qEC33sMJpn7Kw6BqDTbzvBzIGm5dSeIgklBqj4 Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: X-Openstack-Nova-Api-Version: 2.75 Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: f211c102b8d3427d8884e2790b264dae Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServersAdmin275Test-1354064390 Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f211c102b8d3427d8884e2790b264dae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f211c102b8d3427d8884e2790b264dae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f211c102b8d3427d8884e2790b264dae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f211c102b8d3427d8884e2790b264dae"}]}] Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServersAdmin275Test-1354064390 Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: f211c102b8d3427d8884e2790b264dae Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServersAdmin275Test-1354064390 Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServersAdmin275Test-1354064390-project Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: e26043c04dc34c7299990c1c405c53a6 Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServersAdmin275Test-1354064390-project Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 2d7a734d-28b1-4d9f-b80d-c272576f8334 could not be found. Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '2d7a734d-28b1-4d9f-b80d-c272576f8334'} Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d7a734d-28b1-4d9f-b80d-c272576f8334 could not be found. Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d7a734d-28b1-4d9f-b80d-c272576f8334 could not be found. Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:21:45.246159 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:21:45.253958 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:45.253958 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:21:45.253958 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:21:45.253958 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:21:45.253958 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:21:45.253958 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d7a734d-28b1-4d9f-b80d-c272576f8334 could not be found. Oct 23 01:21:45.253958 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:21:45.253958 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8abc8924-589b-4451-a729-b1d2a96db451 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] Returning 404 to user: Instance 2d7a734d-28b1-4d9f-b80d-c272576f8334 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:21:45.255414 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8abc8924-589b-4451-a729-b1d2a96db451 tempest-ServersAdmin275Test-1354064390 tempest-ServersAdmin275Test-1354064390-project] 10.222.0.42 "GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334" status: 404 len: 111 microversion: 2.75 time: 0.186921 Oct 23 01:21:45.264378 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1508/3042] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:21:45 2022] GET /compute/v2.1/servers/2d7a734d-28b1-4d9f-b80d-c272576f8334 => generated 111 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:21:45.290299 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-05be4715-d42a-4d1f-aab2-f94755ac414b tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:45.304752 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-05be4715-d42a-4d1f-aab2-f94755ac414b tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] [instance: 05c1ab48-a6d9-464e-8c9f-69daf726e353] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:45.314936 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05be4715-d42a-4d1f-aab2-f94755ac414b tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:45.315802 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05be4715-d42a-4d1f-aab2-f94755ac414b tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:45.316463 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05be4715-d42a-4d1f-aab2-f94755ac414b tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:45.318270 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05be4715-d42a-4d1f-aab2-f94755ac414b tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:45.322562 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05be4715-d42a-4d1f-aab2-f94755ac414b tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:45.323977 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05be4715-d42a-4d1f-aab2-f94755ac414b tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:45.360100 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2cef7258-15fb-4092-95b4-7e05e58dbea1 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:45.377089 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2cef7258-15fb-4092-95b4-7e05e58dbea1 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:45.380089 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2cef7258-15fb-4092-95b4-7e05e58dbea1 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:45.386439 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2cef7258-15fb-4092-95b4-7e05e58dbea1 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1592 microversion: 2.42 time: 0.365108 Oct 23 01:21:45.387506 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1535/3043] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:21:45 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1592 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:21:45.571869 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-05be4715-d42a-4d1f-aab2-f94755ac414b tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bede03a6c44c3cbe86f7a06601d115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1b744484c41c88314112b572ccac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:45.592306 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-05be4715-d42a-4d1f-aab2-f94755ac414b tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] 10.222.0.42 "GET /compute/v2.1/servers/05c1ab48-a6d9-464e-8c9f-69daf726e353" status: 200 len: 1223 microversion: 2.1 time: 0.315514 Oct 23 01:21:45.597343 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1509/3044] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:45 2022] GET /compute/v2.1/servers/05c1ab48-a6d9-464e-8c9f-69daf726e353 => generated 1223 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:46.033106 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-437f7ba9-e211-43ae-a7f0-e822d4d8d4be tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:46.043745 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-437f7ba9-e211-43ae-a7f0-e822d4d8d4be tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: ff868ee0-f1e4-4c03-a039-c0a6cd548b58] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:46.058580 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-437f7ba9-e211-43ae-a7f0-e822d4d8d4be tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:46.074845 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-437f7ba9-e211-43ae-a7f0-e822d4d8d4be tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:46.075506 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-437f7ba9-e211-43ae-a7f0-e822d4d8d4be tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:46.076380 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-437f7ba9-e211-43ae-a7f0-e822d4d8d4be tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:46.091071 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bad10f6e-7a58-4c09-a288-6d3e6f97f1f4 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:46.095136 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-bad10f6e-7a58-4c09-a288-6d3e6f97f1f4 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:46.096816 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-437f7ba9-e211-43ae-a7f0-e822d4d8d4be tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:46.101268 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-437f7ba9-e211-43ae-a7f0-e822d4d8d4be tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:46.104110 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bad10f6e-7a58-4c09-a288-6d3e6f97f1f4 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:46.112919 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bad10f6e-7a58-4c09-a288-6d3e6f97f1f4 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:46.116692 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bad10f6e-7a58-4c09-a288-6d3e6f97f1f4 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:46.117775 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bad10f6e-7a58-4c09-a288-6d3e6f97f1f4 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:46.134282 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bad10f6e-7a58-4c09-a288-6d3e6f97f1f4 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:46.135136 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bad10f6e-7a58-4c09-a288-6d3e6f97f1f4 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:46.238468 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:47.911286 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bad10f6e-7a58-4c09-a288-6d3e6f97f1f4 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:47.924729 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bad10f6e-7a58-4c09-a288-6d3e6f97f1f4 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1518 microversion: 2.1 time: 1.837779 Oct 23 01:21:47.932095 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1510/3045] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:46 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1518 bytes in 1846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:47.942250 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-61b5b00b-8b23-4857-8006-01b73d36e7c1 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:47.959666 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-61b5b00b-8b23-4857-8006-01b73d36e7c1 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:47.978876 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61b5b00b-8b23-4857-8006-01b73d36e7c1 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:47.980062 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61b5b00b-8b23-4857-8006-01b73d36e7c1 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:47.980607 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61b5b00b-8b23-4857-8006-01b73d36e7c1 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:48.007047 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61b5b00b-8b23-4857-8006-01b73d36e7c1 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:48.010680 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61b5b00b-8b23-4857-8006-01b73d36e7c1 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:48.011328 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61b5b00b-8b23-4857-8006-01b73d36e7c1 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:48.206536 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-437f7ba9-e211-43ae-a7f0-e822d4d8d4be tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:48.260062 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-437f7ba9-e211-43ae-a7f0-e822d4d8d4be tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58" status: 200 len: 1308 microversion: 2.1 time: 2.223694 Oct 23 01:21:48.286912 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1536/3046] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:46 2022] GET /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58 => generated 1308 bytes in 2241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:48.295467 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-79391089-eee9-41ff-8313-665789e421cf tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:48.298524 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-79391089-eee9-41ff-8313-665789e421cf tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] [instance: 05c1ab48-a6d9-464e-8c9f-69daf726e353] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:48.366116 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-79391089-eee9-41ff-8313-665789e421cf tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:48.366795 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-79391089-eee9-41ff-8313-665789e421cf tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:48.367247 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-79391089-eee9-41ff-8313-665789e421cf tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:48.368017 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-79391089-eee9-41ff-8313-665789e421cf tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:48.382310 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-79391089-eee9-41ff-8313-665789e421cf tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:48.389003 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-79391089-eee9-41ff-8313-665789e421cf tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:48.936045 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-79391089-eee9-41ff-8313-665789e421cf tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bede03a6c44c3cbe86f7a06601d115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1b744484c41c88314112b572ccac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:48.961820 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-79391089-eee9-41ff-8313-665789e421cf tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] 10.222.0.42 "GET /compute/v2.1/servers/05c1ab48-a6d9-464e-8c9f-69daf726e353" status: 200 len: 1271 microversion: 2.1 time: 0.682617 Oct 23 01:21:48.982458 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1537/3047] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:48 2022] GET /compute/v2.1/servers/05c1ab48-a6d9-464e-8c9f-69daf726e353 => generated 1271 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:48.985753 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b8d78027-bc94-4b70-aa90-70aeb2113b6f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:48.995538 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b8d78027-bc94-4b70-aa90-70aeb2113b6f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:49.044064 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b8d78027-bc94-4b70-aa90-70aeb2113b6f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:49.050386 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b8d78027-bc94-4b70-aa90-70aeb2113b6f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:49.051690 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b8d78027-bc94-4b70-aa90-70aeb2113b6f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:49.054853 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b8d78027-bc94-4b70-aa90-70aeb2113b6f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:49.059163 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b8d78027-bc94-4b70-aa90-70aeb2113b6f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:49.064196 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b8d78027-bc94-4b70-aa90-70aeb2113b6f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:49.639896 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-61b5b00b-8b23-4857-8006-01b73d36e7c1 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:49.655623 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-61b5b00b-8b23-4857-8006-01b73d36e7c1 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:49.669650 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-61b5b00b-8b23-4857-8006-01b73d36e7c1 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:49.673741 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-61b5b00b-8b23-4857-8006-01b73d36e7c1 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1660 microversion: 2.42 time: 1.740209 Oct 23 01:21:49.678129 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1511/3048] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:21:47 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1660 bytes in 1745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:21:49.711700 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-83bfb014-89fe-4aba-af01-21d97e495b16 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:49.712324 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-83bfb014-89fe-4aba-af01-21d97e495b16 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: ff868ee0-f1e4-4c03-a039-c0a6cd548b58] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:49.731709 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83bfb014-89fe-4aba-af01-21d97e495b16 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:49.732491 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83bfb014-89fe-4aba-af01-21d97e495b16 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:49.733141 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83bfb014-89fe-4aba-af01-21d97e495b16 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:49.734069 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83bfb014-89fe-4aba-af01-21d97e495b16 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:49.736368 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83bfb014-89fe-4aba-af01-21d97e495b16 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:49.738645 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83bfb014-89fe-4aba-af01-21d97e495b16 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:50.044997 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b8d78027-bc94-4b70-aa90-70aeb2113b6f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:50.064585 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b8d78027-bc94-4b70-aa90-70aeb2113b6f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1518 microversion: 2.1 time: 1.087862 Oct 23 01:21:50.066642 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1538/3049] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:48 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1518 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:50.078421 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e0d345a7-91cb-4ab2-a471-84193210b28e tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:50.085954 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e0d345a7-91cb-4ab2-a471-84193210b28e tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] [instance: 05c1ab48-a6d9-464e-8c9f-69daf726e353] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:50.090214 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0d345a7-91cb-4ab2-a471-84193210b28e tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:50.090700 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0d345a7-91cb-4ab2-a471-84193210b28e tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:50.098879 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0d345a7-91cb-4ab2-a471-84193210b28e tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:50.101300 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0d345a7-91cb-4ab2-a471-84193210b28e tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:50.102237 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0d345a7-91cb-4ab2-a471-84193210b28e tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:50.103643 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0d345a7-91cb-4ab2-a471-84193210b28e tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:50.161483 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-83bfb014-89fe-4aba-af01-21d97e495b16 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:50.172051 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-83bfb014-89fe-4aba-af01-21d97e495b16 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58" status: 200 len: 1308 microversion: 2.1 time: 0.492437 Oct 23 01:21:50.172977 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1512/3050] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:49 2022] GET /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58 => generated 1308 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:50.243872 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e0d345a7-91cb-4ab2-a471-84193210b28e tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bede03a6c44c3cbe86f7a06601d115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1b744484c41c88314112b572ccac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:50.272544 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e0d345a7-91cb-4ab2-a471-84193210b28e tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] 10.222.0.42 "GET /compute/v2.1/servers/05c1ab48-a6d9-464e-8c9f-69daf726e353" status: 200 len: 1277 microversion: 2.1 time: 0.203552 Oct 23 01:21:50.296697 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1539/3051] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:50 2022] GET /compute/v2.1/servers/05c1ab48-a6d9-464e-8c9f-69daf726e353 => generated 1277 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:50.709271 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-30b0b633-e75f-4f65-88d6-dcce5d67ce40 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:50.710070 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-30b0b633-e75f-4f65-88d6-dcce5d67ce40 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:50.726081 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-30b0b633-e75f-4f65-88d6-dcce5d67ce40 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:50.728614 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-30b0b633-e75f-4f65-88d6-dcce5d67ce40 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:50.728614 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-30b0b633-e75f-4f65-88d6-dcce5d67ce40 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:50.737769 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-30b0b633-e75f-4f65-88d6-dcce5d67ce40 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:50.740986 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-30b0b633-e75f-4f65-88d6-dcce5d67ce40 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:50.743763 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-30b0b633-e75f-4f65-88d6-dcce5d67ce40 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:51.096153 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d066b659-4b72-4f01-928f-cbc4c910c5db tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:51.098753 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d066b659-4b72-4f01-928f-cbc4c910c5db tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:51.110969 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=12 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:51.116269 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d066b659-4b72-4f01-928f-cbc4c910c5db tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:51.122424 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d066b659-4b72-4f01-928f-cbc4c910c5db tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:51.122424 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d066b659-4b72-4f01-928f-cbc4c910c5db tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:51.125318 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d066b659-4b72-4f01-928f-cbc4c910c5db tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:51.126245 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d066b659-4b72-4f01-928f-cbc4c910c5db tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:51.127742 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d066b659-4b72-4f01-928f-cbc4c910c5db tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:51.244208 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-30b0b633-e75f-4f65-88d6-dcce5d67ce40 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:51.261701 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-30b0b633-e75f-4f65-88d6-dcce5d67ce40 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:51.279607 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-30b0b633-e75f-4f65-88d6-dcce5d67ce40 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:51.286205 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-30b0b633-e75f-4f65-88d6-dcce5d67ce40 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1707 microversion: 2.42 time: 0.582822 Oct 23 01:21:51.287283 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1513/3052] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:21:50 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1707 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:21:51.297146 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-daf4ff67-4fd6-4f69-a086-8ca623aa6e65 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:51.300062 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-daf4ff67-4fd6-4f69-a086-8ca623aa6e65 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: ff868ee0-f1e4-4c03-a039-c0a6cd548b58] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:51.311187 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-daf4ff67-4fd6-4f69-a086-8ca623aa6e65 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:51.314387 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-daf4ff67-4fd6-4f69-a086-8ca623aa6e65 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:51.315120 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-daf4ff67-4fd6-4f69-a086-8ca623aa6e65 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:51.316476 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-daf4ff67-4fd6-4f69-a086-8ca623aa6e65 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:51.318803 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-daf4ff67-4fd6-4f69-a086-8ca623aa6e65 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:51.321730 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-daf4ff67-4fd6-4f69-a086-8ca623aa6e65 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:51.752691 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d066b659-4b72-4f01-928f-cbc4c910c5db tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:51.763388 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d066b659-4b72-4f01-928f-cbc4c910c5db tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.674887 Oct 23 01:21:51.784859 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1540/3053] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:51 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:51.790596 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4ff08f8d-db35-4b09-9c8f-fc033c17a8a8 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:51.791580 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4ff08f8d-db35-4b09-9c8f-fc033c17a8a8 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] [instance: 05c1ab48-a6d9-464e-8c9f-69daf726e353] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:51.799171 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4ff08f8d-db35-4b09-9c8f-fc033c17a8a8 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:51.799766 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4ff08f8d-db35-4b09-9c8f-fc033c17a8a8 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:51.800310 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4ff08f8d-db35-4b09-9c8f-fc033c17a8a8 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:51.801173 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4ff08f8d-db35-4b09-9c8f-fc033c17a8a8 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:51.801727 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4ff08f8d-db35-4b09-9c8f-fc033c17a8a8 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:51.802423 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4ff08f8d-db35-4b09-9c8f-fc033c17a8a8 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:51.815206 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-daf4ff67-4fd6-4f69-a086-8ca623aa6e65 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:51.825764 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-daf4ff67-4fd6-4f69-a086-8ca623aa6e65 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58" status: 200 len: 1308 microversion: 2.1 time: 0.537322 Oct 23 01:21:51.826408 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1514/3054] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:51 2022] GET /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58 => generated 1308 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:51.843795 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-83d35037-3d67-4de4-96d1-9de6be464d32 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:51.845574 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-83d35037-3d67-4de4-96d1-9de6be464d32 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:51.858801 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83d35037-3d67-4de4-96d1-9de6be464d32 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:51.862377 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83d35037-3d67-4de4-96d1-9de6be464d32 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:51.863771 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83d35037-3d67-4de4-96d1-9de6be464d32 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:51.865129 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83d35037-3d67-4de4-96d1-9de6be464d32 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:51.867749 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83d35037-3d67-4de4-96d1-9de6be464d32 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:51.868342 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83d35037-3d67-4de4-96d1-9de6be464d32 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:51.905239 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=100 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:51.972105 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4ff08f8d-db35-4b09-9c8f-fc033c17a8a8 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bede03a6c44c3cbe86f7a06601d115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1b744484c41c88314112b572ccac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:51.987529 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4ff08f8d-db35-4b09-9c8f-fc033c17a8a8 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] 10.222.0.42 "GET /compute/v2.1/servers/05c1ab48-a6d9-464e-8c9f-69daf726e353" status: 200 len: 1277 microversion: 2.1 time: 0.201340 Oct 23 01:21:52.001532 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1541/3055] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:51 2022] GET /compute/v2.1/servers/05c1ab48-a6d9-464e-8c9f-69daf726e353 => generated 1277 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:52.162148 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-83d35037-3d67-4de4-96d1-9de6be464d32 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:52.173258 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-83d35037-3d67-4de4-96d1-9de6be464d32 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.345816 Oct 23 01:21:52.177049 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1515/3056] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:51 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:52.213782 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-98da0491-ab41-4c51-a08e-e1a3d8944e46 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:52.215635 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-98da0491-ab41-4c51-a08e-e1a3d8944e46 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:52.253762 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-98da0491-ab41-4c51-a08e-e1a3d8944e46 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:52.255448 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-98da0491-ab41-4c51-a08e-e1a3d8944e46 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:52.255911 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-98da0491-ab41-4c51-a08e-e1a3d8944e46 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:52.256644 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-98da0491-ab41-4c51-a08e-e1a3d8944e46 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:52.261401 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-98da0491-ab41-4c51-a08e-e1a3d8944e46 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:52.263480 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-98da0491-ab41-4c51-a08e-e1a3d8944e46 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:52.315904 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b8f1034f-629c-4992-9346-98dafc479391 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:52.316526 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b8f1034f-629c-4992-9346-98dafc479391 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:52.323698 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=10 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:52.328631 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b8f1034f-629c-4992-9346-98dafc479391 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:52.331300 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b8f1034f-629c-4992-9346-98dafc479391 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:52.332725 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b8f1034f-629c-4992-9346-98dafc479391 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:52.333817 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b8f1034f-629c-4992-9346-98dafc479391 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:52.335605 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b8f1034f-629c-4992-9346-98dafc479391 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:52.341171 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b8f1034f-629c-4992-9346-98dafc479391 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:52.764193 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b8f1034f-629c-4992-9346-98dafc479391 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:52.779252 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-98da0491-ab41-4c51-a08e-e1a3d8944e46 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:52.792454 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-98da0491-ab41-4c51-a08e-e1a3d8944e46 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.583410 Oct 23 01:21:52.793062 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1542/3057] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:52 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:52.795317 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b8f1034f-629c-4992-9346-98dafc479391 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:52.797218 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b8f1034f-629c-4992-9346-98dafc479391 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:52.798627 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b8f1034f-629c-4992-9346-98dafc479391 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1707 microversion: 2.42 time: 0.487389 Oct 23 01:21:52.799373 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1516/3058] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:21:52 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1707 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:21:52.829874 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f4145d94-bbe2-46a0-992a-c780761144e1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:21:52.839566 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-f4145d94-bbe2-46a0-992a-c780761144e1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] HTTP exception thrown: Instance 1c20e267-ec4c-4bb8-b36b-93122dad8b10 has no mapping to a cell. Oct 23 01:21:52.849141 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2fc6e335-f4c6-4a42-997b-65187910e6e7 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:52.850392 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2fc6e335-f4c6-4a42-997b-65187910e6e7 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: ff868ee0-f1e4-4c03-a039-c0a6cd548b58] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f4145d94-bbe2-46a0-992a-c780761144e1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Request method failure captured: Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/servers/1c20e267-ec4c-4bb8-b36b-93122dad8b10/action HTTP/1.1 Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 15 Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJZEAurAeILsYJek3MCv_ryiTbidOLVZq6W4I7jJxeY_1_bTWRye2xM3EDOhowd_NyioevvIvzT9beBCgKqri_ZjLw9hdsIISMXmajO_VmobATT_GwpY_Y-GVylQtV9MoF1-Bup_Ahjld_2riQHnDzqLUWULm2acZYcK9UIbslVsdDU Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}] Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: cd6a6c5240f94ace91e1f0ed3e53fa7c Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: {"os-stop": {}} Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 1c20e267-ec4c-4bb8-b36b-93122dad8b10 has no mapping to a cell. Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '1c20e267-ec4c-4bb8-b36b-93122dad8b10', 'body': {'os-stop': {}}} Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 1c20e267-ec4c-4bb8-b36b-93122dad8b10 has no mapping to a cell. Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:21:52.853131 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c20e267-ec4c-4bb8-b36b-93122dad8b10 has no mapping to a cell. Oct 23 01:21:52.858484 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:21:52.858484 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:21:52.858484 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:21:52.858484 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:52.858484 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:21:52.858484 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:21:52.858484 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:21:52.858484 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:21:52.858484 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c20e267-ec4c-4bb8-b36b-93122dad8b10 has no mapping to a cell. Oct 23 01:21:52.858484 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:21:52.859191 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2fc6e335-f4c6-4a42-997b-65187910e6e7 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:52.859191 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2fc6e335-f4c6-4a42-997b-65187910e6e7 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:52.859191 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2fc6e335-f4c6-4a42-997b-65187910e6e7 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:52.859455 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2fc6e335-f4c6-4a42-997b-65187910e6e7 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:52.859869 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2fc6e335-f4c6-4a42-997b-65187910e6e7 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:52.860380 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f4145d94-bbe2-46a0-992a-c780761144e1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Returning 404 to user: Instance 1c20e267-ec4c-4bb8-b36b-93122dad8b10 has no mapping to a cell. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:21:52.860656 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2fc6e335-f4c6-4a42-997b-65187910e6e7 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:52.861363 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f4145d94-bbe2-46a0-992a-c780761144e1 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "POST /compute/v2.1/servers/1c20e267-ec4c-4bb8-b36b-93122dad8b10/action" status: 404 len: 117 microversion: 2.1 time: 0.035629 Oct 23 01:21:52.861968 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1543/3059] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:21:52 2022] POST /compute/v2.1/servers/1c20e267-ec4c-4bb8-b36b-93122dad8b10/action => generated 117 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:21:52.877451 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dcb3f143-c5c4-4a47-ad39-ff1c4cd128a9 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:52.879279 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-dcb3f143-c5c4-4a47-ad39-ff1c4cd128a9 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:52.901144 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dcb3f143-c5c4-4a47-ad39-ff1c4cd128a9 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:52.902098 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dcb3f143-c5c4-4a47-ad39-ff1c4cd128a9 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:52.902552 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dcb3f143-c5c4-4a47-ad39-ff1c4cd128a9 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:52.903269 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dcb3f143-c5c4-4a47-ad39-ff1c4cd128a9 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:52.903735 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dcb3f143-c5c4-4a47-ad39-ff1c4cd128a9 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:52.904164 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dcb3f143-c5c4-4a47-ad39-ff1c4cd128a9 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:52.957338 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=12 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:53.274182 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2fc6e335-f4c6-4a42-997b-65187910e6e7 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:53.281841 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2fc6e335-f4c6-4a42-997b-65187910e6e7 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58" status: 200 len: 1308 microversion: 2.1 time: 0.437003 Oct 23 01:21:53.286947 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1517/3060] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:52 2022] GET /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58 => generated 1308 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:21:53.302520 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d46d3ba1-c20f-4bb8-8e2e-35adb1b7c10e tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:53.303146 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d46d3ba1-c20f-4bb8-8e2e-35adb1b7c10e tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] [instance: 05c1ab48-a6d9-464e-8c9f-69daf726e353] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:53.310018 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d46d3ba1-c20f-4bb8-8e2e-35adb1b7c10e tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:53.310387 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d46d3ba1-c20f-4bb8-8e2e-35adb1b7c10e tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:53.310866 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d46d3ba1-c20f-4bb8-8e2e-35adb1b7c10e tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:53.318504 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d46d3ba1-c20f-4bb8-8e2e-35adb1b7c10e tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:53.318504 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d46d3ba1-c20f-4bb8-8e2e-35adb1b7c10e tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:53.318504 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d46d3ba1-c20f-4bb8-8e2e-35adb1b7c10e tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:53.338002 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-dcb3f143-c5c4-4a47-ad39-ff1c4cd128a9 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:53.349769 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-dcb3f143-c5c4-4a47-ad39-ff1c4cd128a9 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.483252 Oct 23 01:21:53.367076 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1544/3061] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:52 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:53.379177 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d8ea5423-b39c-4b19-ab41-17bfd061dc59 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:53.380146 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d8ea5423-b39c-4b19-ab41-17bfd061dc59 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:53.388140 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d8ea5423-b39c-4b19-ab41-17bfd061dc59 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:53.388983 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d8ea5423-b39c-4b19-ab41-17bfd061dc59 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:53.389674 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d8ea5423-b39c-4b19-ab41-17bfd061dc59 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:53.390736 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d8ea5423-b39c-4b19-ab41-17bfd061dc59 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:53.391444 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d8ea5423-b39c-4b19-ab41-17bfd061dc59 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:53.392095 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d8ea5423-b39c-4b19-ab41-17bfd061dc59 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:53.431230 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d46d3ba1-c20f-4bb8-8e2e-35adb1b7c10e tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bede03a6c44c3cbe86f7a06601d115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1b744484c41c88314112b572ccac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:53.443018 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d46d3ba1-c20f-4bb8-8e2e-35adb1b7c10e tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] 10.222.0.42 "GET /compute/v2.1/servers/05c1ab48-a6d9-464e-8c9f-69daf726e353" status: 200 len: 1277 microversion: 2.1 time: 0.154949 Oct 23 01:21:53.449269 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1518/3062] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:53 2022] GET /compute/v2.1/servers/05c1ab48-a6d9-464e-8c9f-69daf726e353 => generated 1277 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:53.552228 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d8ea5423-b39c-4b19-ab41-17bfd061dc59 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:53.563653 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d8ea5423-b39c-4b19-ab41-17bfd061dc59 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.189245 Oct 23 01:21:53.568055 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1545/3063] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:53 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:21:53.589306 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c74d9f05-014b-4990-8e64-f9dfc0a98033 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:21:53.593132 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c74d9f05-014b-4990-8e64-f9dfc0a98033 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 0d1f47a7-467c-4811-b0e6-2c037adb55e0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:53.595812 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:53.608474 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-c74d9f05-014b-4990-8e64-f9dfc0a98033 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] HTTP exception thrown: Instance 0d1f47a7-467c-4811-b0e6-2c037adb55e0 could not be found. Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c74d9f05-014b-4990-8e64-f9dfc0a98033 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Request method failure captured: Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/servers/0d1f47a7-467c-4811-b0e6-2c037adb55e0/action HTTP/1.1 Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 15 Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJZEAurAeILsYJek3MCv_ryiTbidOLVZq6W4I7jJxeY_1_bTWRye2xM3EDOhowd_NyioevvIvzT9beBCgKqri_ZjLw9hdsIISMXmajO_VmobATT_GwpY_Y-GVylQtV9MoF1-Bup_Ahjld_2riQHnDzqLUWULm2acZYcK9UIbslVsdDU Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}] Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: cd6a6c5240f94ace91e1f0ed3e53fa7c Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: {"suspend": {}} Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 0d1f47a7-467c-4811-b0e6-2c037adb55e0 could not be found. Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '0d1f47a7-467c-4811-b0e6-2c037adb55e0', 'body': {'suspend': {}}} Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d1f47a7-467c-4811-b0e6-2c037adb55e0 could not be found. Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d1f47a7-467c-4811-b0e6-2c037adb55e0 could not be found. Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:21:53.613207 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:21:53.622108 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:21:53.622108 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:21:53.622108 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d1f47a7-467c-4811-b0e6-2c037adb55e0 could not be found. Oct 23 01:21:53.622108 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:21:53.622108 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c74d9f05-014b-4990-8e64-f9dfc0a98033 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Returning 404 to user: Instance 0d1f47a7-467c-4811-b0e6-2c037adb55e0 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:21:53.622108 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c74d9f05-014b-4990-8e64-f9dfc0a98033 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "POST /compute/v2.1/servers/0d1f47a7-467c-4811-b0e6-2c037adb55e0/action" status: 404 len: 111 microversion: 2.1 time: 0.029709 Oct 23 01:21:53.622108 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1519/3064] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:21:53 2022] POST /compute/v2.1/servers/0d1f47a7-467c-4811-b0e6-2c037adb55e0/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 01:21:53.625601 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7834a578-ad84-4e4b-af19-b46ae7d49fd6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:53.625601 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7834a578-ad84-4e4b-af19-b46ae7d49fd6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:53.627333 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=8 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:53.636696 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7834a578-ad84-4e4b-af19-b46ae7d49fd6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:53.637192 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7834a578-ad84-4e4b-af19-b46ae7d49fd6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:53.637631 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7834a578-ad84-4e4b-af19-b46ae7d49fd6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:53.643967 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7834a578-ad84-4e4b-af19-b46ae7d49fd6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:53.644475 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7834a578-ad84-4e4b-af19-b46ae7d49fd6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:53.645543 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7834a578-ad84-4e4b-af19-b46ae7d49fd6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:53.836582 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a5aae341-6e72-417e-9cc7-e94eee9c7a3a tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:53.837264 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a5aae341-6e72-417e-9cc7-e94eee9c7a3a tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:53.855147 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a5aae341-6e72-417e-9cc7-e94eee9c7a3a tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:53.855815 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a5aae341-6e72-417e-9cc7-e94eee9c7a3a tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:53.860219 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a5aae341-6e72-417e-9cc7-e94eee9c7a3a tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:53.860219 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a5aae341-6e72-417e-9cc7-e94eee9c7a3a tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:53.860778 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a5aae341-6e72-417e-9cc7-e94eee9c7a3a tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:53.861261 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a5aae341-6e72-417e-9cc7-e94eee9c7a3a tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:53.901670 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7834a578-ad84-4e4b-af19-b46ae7d49fd6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:53.923806 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7834a578-ad84-4e4b-af19-b46ae7d49fd6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.302268 Oct 23 01:21:53.928519 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1546/3065] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:53 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:53.955359 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d14bed8e-7ffc-40ac-9ac2-0c0967cc5c52 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:53.956204 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d14bed8e-7ffc-40ac-9ac2-0c0967cc5c52 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:53.965809 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d14bed8e-7ffc-40ac-9ac2-0c0967cc5c52 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:53.969333 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d14bed8e-7ffc-40ac-9ac2-0c0967cc5c52 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:53.969997 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d14bed8e-7ffc-40ac-9ac2-0c0967cc5c52 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:53.970886 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d14bed8e-7ffc-40ac-9ac2-0c0967cc5c52 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:53.971514 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d14bed8e-7ffc-40ac-9ac2-0c0967cc5c52 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:53.974938 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d14bed8e-7ffc-40ac-9ac2-0c0967cc5c52 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:54.199763 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a5aae341-6e72-417e-9cc7-e94eee9c7a3a tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:54.215014 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a5aae341-6e72-417e-9cc7-e94eee9c7a3a tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:54.223298 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a5aae341-6e72-417e-9cc7-e94eee9c7a3a tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:54.223298 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a5aae341-6e72-417e-9cc7-e94eee9c7a3a tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1754 microversion: 2.42 time: 0.386028 Oct 23 01:21:54.223298 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1520/3066] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:21:53 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1754 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:21:54.312362 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3b9cab2b-1da7-46f2-b429-197feabb5859 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:54.313076 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3b9cab2b-1da7-46f2-b429-197feabb5859 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: ff868ee0-f1e4-4c03-a039-c0a6cd548b58] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:54.323596 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b9cab2b-1da7-46f2-b429-197feabb5859 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:54.324352 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b9cab2b-1da7-46f2-b429-197feabb5859 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:54.326950 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b9cab2b-1da7-46f2-b429-197feabb5859 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:54.327902 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b9cab2b-1da7-46f2-b429-197feabb5859 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:54.331043 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b9cab2b-1da7-46f2-b429-197feabb5859 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:54.331724 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b9cab2b-1da7-46f2-b429-197feabb5859 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:54.529591 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d14bed8e-7ffc-40ac-9ac2-0c0967cc5c52 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:54.541065 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d14bed8e-7ffc-40ac-9ac2-0c0967cc5c52 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.589284 Oct 23 01:21:54.541190 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1547/3067] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:53 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:54.556257 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-727f1045-9b69-499c-aa11-c066d05bda4f tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:54.558595 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-727f1045-9b69-499c-aa11-c066d05bda4f tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] [instance: 05c1ab48-a6d9-464e-8c9f-69daf726e353] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:54.573374 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-727f1045-9b69-499c-aa11-c066d05bda4f tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:54.574112 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-727f1045-9b69-499c-aa11-c066d05bda4f tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:54.574763 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-727f1045-9b69-499c-aa11-c066d05bda4f tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:54.576081 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-727f1045-9b69-499c-aa11-c066d05bda4f tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:54.577488 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-727f1045-9b69-499c-aa11-c066d05bda4f tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:54.578282 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-727f1045-9b69-499c-aa11-c066d05bda4f tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:54.909149 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-727f1045-9b69-499c-aa11-c066d05bda4f tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bede03a6c44c3cbe86f7a06601d115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1b744484c41c88314112b572ccac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:54.909875 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3b9cab2b-1da7-46f2-b429-197feabb5859 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:54.918169 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-727f1045-9b69-499c-aa11-c066d05bda4f tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] 10.222.0.42 "GET /compute/v2.1/servers/05c1ab48-a6d9-464e-8c9f-69daf726e353" status: 200 len: 1319 microversion: 2.1 time: 0.375828 Oct 23 01:21:54.919021 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1548/3068] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:54 2022] GET /compute/v2.1/servers/05c1ab48-a6d9-464e-8c9f-69daf726e353 => generated 1319 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:54.919385 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3b9cab2b-1da7-46f2-b429-197feabb5859 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58" status: 200 len: 1308 microversion: 2.1 time: 0.609864 Oct 23 01:21:54.930006 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1521/3069] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:54 2022] GET /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58 => generated 1308 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:21:54.931138 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-1a9b679f-c91e-4120-954b-ac57edb01edc req-4a8532de-a748-462f-8fb6-03e83dc186dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff868ee0-f1e4-4c03-a039-c0a6cd548b58", "name": "network-vif-plugged", "status": "completed", "tag": "aea99284-1df7-49c1-b874-c2f688b118b9"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:21:54.942092 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7c485f3c-353e-460b-8e45-58ee1ec41772 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:21:54.942711 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7c485f3c-353e-460b-8e45-58ee1ec41772 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:54.949700 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c485f3c-353e-460b-8e45-58ee1ec41772 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:54.950303 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c485f3c-353e-460b-8e45-58ee1ec41772 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:54.950816 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c485f3c-353e-460b-8e45-58ee1ec41772 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:54.952170 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c485f3c-353e-460b-8e45-58ee1ec41772 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:54.952759 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c485f3c-353e-460b-8e45-58ee1ec41772 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:54.953276 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c485f3c-353e-460b-8e45-58ee1ec41772 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:54.956589 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-1a9b679f-c91e-4120-954b-ac57edb01edc req-4a8532de-a748-462f-8fb6-03e83dc186dc service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:54.957317 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-1a9b679f-c91e-4120-954b-ac57edb01edc req-4a8532de-a748-462f-8fb6-03e83dc186dc service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:54.957850 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-1a9b679f-c91e-4120-954b-ac57edb01edc req-4a8532de-a748-462f-8fb6-03e83dc186dc service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:54.982893 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-1a9b679f-c91e-4120-954b-ac57edb01edc req-4a8532de-a748-462f-8fb6-03e83dc186dc service nova] Creating event network-vif-plugged:aea99284-1df7-49c1-b874-c2f688b118b9 for instance ff868ee0-f1e4-4c03-a039-c0a6cd548b58 on n-h1-master-1 Oct 23 01:21:54.984119 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-7c485f3c-353e-460b-8e45-58ee1ec41772 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lazy-loading 'flavor' on Instance uuid 62a8ad26-f65b-432d-a8da-48264c426335 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:21:54.995992 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-1a9b679f-c91e-4120-954b-ac57edb01edc req-4a8532de-a748-462f-8fb6-03e83dc186dc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071089 Oct 23 01:21:54.996753 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1522/3070] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:21:55.268915 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cb3a4129-9453-4f79-9978-23be22727747 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:55.273669 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cb3a4129-9453-4f79-9978-23be22727747 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:55.299968 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb3a4129-9453-4f79-9978-23be22727747 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:55.301309 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb3a4129-9453-4f79-9978-23be22727747 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:55.301870 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb3a4129-9453-4f79-9978-23be22727747 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:55.303052 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb3a4129-9453-4f79-9978-23be22727747 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:55.305527 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb3a4129-9453-4f79-9978-23be22727747 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:55.306144 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb3a4129-9453-4f79-9978-23be22727747 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:55.398575 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7c485f3c-353e-460b-8e45-58ee1ec41772 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "POST /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335/action" status: 202 len: 0 microversion: 2.1 time: 0.466226 Oct 23 01:21:55.401696 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1549/3071] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:21:54 2022] POST /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335/action => generated 0 bytes in 480 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:21:55.411616 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8ca8c639-c1fe-4cf4-9b48-9cafaf8ca72a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:55.427611 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8ca8c639-c1fe-4cf4-9b48-9cafaf8ca72a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:55.439540 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ca8c639-c1fe-4cf4-9b48-9cafaf8ca72a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:55.444505 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ca8c639-c1fe-4cf4-9b48-9cafaf8ca72a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:55.445354 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ca8c639-c1fe-4cf4-9b48-9cafaf8ca72a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:55.450349 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ca8c639-c1fe-4cf4-9b48-9cafaf8ca72a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:55.453653 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ca8c639-c1fe-4cf4-9b48-9cafaf8ca72a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:55.454364 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ca8c639-c1fe-4cf4-9b48-9cafaf8ca72a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:55.657764 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cb3a4129-9453-4f79-9978-23be22727747 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:55.671628 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cb3a4129-9453-4f79-9978-23be22727747 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:55.676476 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cb3a4129-9453-4f79-9978-23be22727747 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:55.676476 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cb3a4129-9453-4f79-9978-23be22727747 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1754 microversion: 2.42 time: 0.424210 Oct 23 01:21:55.676476 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1523/3072] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:21:55 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1754 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:21:55.680705 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-7363fbc7-a751-4a59-a8a1-92a692504973 req-480e9c65-63a7-41e3-8576-121d155b3b15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e352f0d-c908-46b8-a28c-8704d0c92da6", "tag": "b462ddd0-60bd-4ba7-8465-936cb863b316"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:21:55.690835 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-7363fbc7-a751-4a59-a8a1-92a692504973 req-480e9c65-63a7-41e3-8576-121d155b3b15 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:55.691615 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-7363fbc7-a751-4a59-a8a1-92a692504973 req-480e9c65-63a7-41e3-8576-121d155b3b15 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:55.692359 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-7363fbc7-a751-4a59-a8a1-92a692504973 req-480e9c65-63a7-41e3-8576-121d155b3b15 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:55.718227 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-7363fbc7-a751-4a59-a8a1-92a692504973 req-480e9c65-63a7-41e3-8576-121d155b3b15 service nova] Creating event network-changed:b462ddd0-60bd-4ba7-8465-936cb863b316 for instance 8e352f0d-c908-46b8-a28c-8704d0c92da6 on n-h2-master-1 Oct 23 01:21:55.730408 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-7363fbc7-a751-4a59-a8a1-92a692504973 req-480e9c65-63a7-41e3-8576-121d155b3b15 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052675 Oct 23 01:21:55.731683 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1524/3073] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:21:55.912264 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8ca8c639-c1fe-4cf4-9b48-9cafaf8ca72a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:55.925859 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8ca8c639-c1fe-4cf4-9b48-9cafaf8ca72a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1513 microversion: 2.1 time: 0.521460 Oct 23 01:21:55.939928 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1550/3074] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:55 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1513 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:21:55.951534 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f43b7850-6549-4df1-a53b-75538cfda78d tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:55.951534 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f43b7850-6549-4df1-a53b-75538cfda78d tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] [instance: 05c1ab48-a6d9-464e-8c9f-69daf726e353] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:55.969960 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-844e70ab-94c2-4ba9-a197-ff904d0386ed tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:55.972328 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f43b7850-6549-4df1-a53b-75538cfda78d tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:55.973278 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f43b7850-6549-4df1-a53b-75538cfda78d tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:55.974240 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-844e70ab-94c2-4ba9-a197-ff904d0386ed tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: ff868ee0-f1e4-4c03-a039-c0a6cd548b58] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:55.974916 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f43b7850-6549-4df1-a53b-75538cfda78d tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:55.976471 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f43b7850-6549-4df1-a53b-75538cfda78d tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:55.979858 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f43b7850-6549-4df1-a53b-75538cfda78d tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:55.988003 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f43b7850-6549-4df1-a53b-75538cfda78d tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:55.996825 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-844e70ab-94c2-4ba9-a197-ff904d0386ed tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:55.997405 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-844e70ab-94c2-4ba9-a197-ff904d0386ed tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:55.998125 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-844e70ab-94c2-4ba9-a197-ff904d0386ed tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:55.999538 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-844e70ab-94c2-4ba9-a197-ff904d0386ed tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:56.001377 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-844e70ab-94c2-4ba9-a197-ff904d0386ed tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:56.005278 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-844e70ab-94c2-4ba9-a197-ff904d0386ed tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:56.501760 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-844e70ab-94c2-4ba9-a197-ff904d0386ed tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:56.511713 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-844e70ab-94c2-4ba9-a197-ff904d0386ed tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58" status: 200 len: 1308 microversion: 2.1 time: 0.555983 Oct 23 01:21:56.517141 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1551/3075] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:55 2022] GET /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58 => generated 1308 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:56.536562 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f43b7850-6549-4df1-a53b-75538cfda78d tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bede03a6c44c3cbe86f7a06601d115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1b744484c41c88314112b572ccac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:56.551146 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f43b7850-6549-4df1-a53b-75538cfda78d tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] 10.222.0.42 "GET /compute/v2.1/servers/05c1ab48-a6d9-464e-8c9f-69daf726e353" status: 200 len: 1319 microversion: 2.1 time: 0.607911 Oct 23 01:21:56.553869 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1525/3076] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:55 2022] GET /compute/v2.1/servers/05c1ab48-a6d9-464e-8c9f-69daf726e353 => generated 1319 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:56.701769 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d5e09a24-9a91-46fd-be4d-6a23366f06e7 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:56.702539 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d5e09a24-9a91-46fd-be4d-6a23366f06e7 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:56.714997 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d5e09a24-9a91-46fd-be4d-6a23366f06e7 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:56.716826 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d5e09a24-9a91-46fd-be4d-6a23366f06e7 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:56.720391 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d5e09a24-9a91-46fd-be4d-6a23366f06e7 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:56.722384 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d5e09a24-9a91-46fd-be4d-6a23366f06e7 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:56.728396 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d5e09a24-9a91-46fd-be4d-6a23366f06e7 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:56.730885 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d5e09a24-9a91-46fd-be4d-6a23366f06e7 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:56.805123 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:56.952566 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-18c76455-d9d7-4fa4-b41c-84ba40f6eff6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:56.954264 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-18c76455-d9d7-4fa4-b41c-84ba40f6eff6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:56.967733 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-18c76455-d9d7-4fa4-b41c-84ba40f6eff6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:56.973804 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-18c76455-d9d7-4fa4-b41c-84ba40f6eff6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:56.974438 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-18c76455-d9d7-4fa4-b41c-84ba40f6eff6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:56.975327 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-18c76455-d9d7-4fa4-b41c-84ba40f6eff6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:56.976332 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-18c76455-d9d7-4fa4-b41c-84ba40f6eff6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:56.981720 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-18c76455-d9d7-4fa4-b41c-84ba40f6eff6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:57.062320 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d5e09a24-9a91-46fd-be4d-6a23366f06e7 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:57.081444 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d5e09a24-9a91-46fd-be4d-6a23366f06e7 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:57.083625 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d5e09a24-9a91-46fd-be4d-6a23366f06e7 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:57.088783 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d5e09a24-9a91-46fd-be4d-6a23366f06e7 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1801 microversion: 2.42 time: 0.391673 Oct 23 01:21:57.090414 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1552/3077] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:21:56 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1801 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:21:57.215326 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-18c76455-d9d7-4fa4-b41c-84ba40f6eff6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:57.223797 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-18c76455-d9d7-4fa4-b41c-84ba40f6eff6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1496 microversion: 2.1 time: 0.275577 Oct 23 01:21:57.238306 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-7f85c472-97b1-469c-96d6-90ca87675768 req-a5e2c055-1cc1-428a-a445-3f65ff13d056 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05c1ab48-a6d9-464e-8c9f-69daf726e353", "tag": "6a552298-cbe9-405d-a6ea-1aae20a7bf7b"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:21:57.240570 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1526/3078] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:56 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1496 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:21:57.249355 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-7f85c472-97b1-469c-96d6-90ca87675768 req-a5e2c055-1cc1-428a-a445-3f65ff13d056 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:57.249848 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-7f85c472-97b1-469c-96d6-90ca87675768 req-a5e2c055-1cc1-428a-a445-3f65ff13d056 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:57.250344 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-7f85c472-97b1-469c-96d6-90ca87675768 req-a5e2c055-1cc1-428a-a445-3f65ff13d056 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:57.253269 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b451b00b-9ef9-4171-8e12-53cda8a99540 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:21:57.254132 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b451b00b-9ef9-4171-8e12-53cda8a99540 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:57.270701 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b451b00b-9ef9-4171-8e12-53cda8a99540 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:57.271426 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b451b00b-9ef9-4171-8e12-53cda8a99540 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:57.272053 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b451b00b-9ef9-4171-8e12-53cda8a99540 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:57.272968 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b451b00b-9ef9-4171-8e12-53cda8a99540 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:57.274112 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b451b00b-9ef9-4171-8e12-53cda8a99540 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:57.274820 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b451b00b-9ef9-4171-8e12-53cda8a99540 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:57.279887 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-7f85c472-97b1-469c-96d6-90ca87675768 req-a5e2c055-1cc1-428a-a445-3f65ff13d056 service nova] Creating event network-changed:6a552298-cbe9-405d-a6ea-1aae20a7bf7b for instance 05c1ab48-a6d9-464e-8c9f-69daf726e353 on n-h1-master-1 Oct 23 01:21:57.295383 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-7f85c472-97b1-469c-96d6-90ca87675768 req-a5e2c055-1cc1-428a-a445-3f65ff13d056 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067644 Oct 23 01:21:57.296351 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1553/3079] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:21:57.308763 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-b451b00b-9ef9-4171-8e12-53cda8a99540 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lazy-loading 'flavor' on Instance uuid 62a8ad26-f65b-432d-a8da-48264c426335 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:21:57.333269 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-b451b00b-9ef9-4171-8e12-53cda8a99540 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] HTTP exception thrown: Cannot 'suspend' instance 62a8ad26-f65b-432d-a8da-48264c426335 while it is in vm_state suspended Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b451b00b-9ef9-4171-8e12-53cda8a99540 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Request method failure captured: Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335/action HTTP/1.1 Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 15 Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJZEAurAeILsYJek3MCv_ryiTbidOLVZq6W4I7jJxeY_1_bTWRye2xM3EDOhowd_NyioevvIvzT9beBCgKqri_ZjLw9hdsIISMXmajO_VmobATT_GwpY_Y-GVylQtV9MoF1-Bup_Ahjld_2riQHnDzqLUWULm2acZYcK9UIbslVsdDU Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}] Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: cd6a6c5240f94ace91e1f0ed3e53fa7c Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: {"suspend": {}} Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: exception: Cannot 'suspend' instance 62a8ad26-f65b-432d-a8da-48264c426335 while it is in vm_state suspended Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '62a8ad26-f65b-432d-a8da-48264c426335', 'body': {'suspend': {}}} Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 62a8ad26-f65b-432d-a8da-48264c426335 in vm_state suspended. Cannot suspend while the instance is in this state. Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 23 01:21:57.338898 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 23 01:21:57.343352 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 23 01:21:57.343352 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 23 01:21:57.343352 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 62a8ad26-f65b-432d-a8da-48264c426335 while it is in vm_state suspended Oct 23 01:21:57.343352 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:21:57.343352 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:21:57.343352 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:21:57.343352 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:21:57.343352 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:21:57.343352 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:21:57.343352 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:21:57.343352 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:21:57.343352 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 62a8ad26-f65b-432d-a8da-48264c426335 while it is in vm_state suspended Oct 23 01:21:57.343352 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:21:57.343352 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b451b00b-9ef9-4171-8e12-53cda8a99540 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Returning 409 to user: Cannot 'suspend' instance 62a8ad26-f65b-432d-a8da-48264c426335 while it is in vm_state suspended {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:21:57.343352 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b451b00b-9ef9-4171-8e12-53cda8a99540 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "POST /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335/action" status: 409 len: 148 microversion: 2.1 time: 0.092895 Oct 23 01:21:57.343352 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1527/3080] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:21:57 2022] POST /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335/action => generated 148 bytes in 94 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:21:57.351133 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-47976588-a7ae-48c6-b34a-9f0e39e7d9d8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:21:57.351996 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-47976588-a7ae-48c6-b34a-9f0e39e7d9d8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:57.372372 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-47976588-a7ae-48c6-b34a-9f0e39e7d9d8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:57.372889 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-47976588-a7ae-48c6-b34a-9f0e39e7d9d8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:57.373445 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-47976588-a7ae-48c6-b34a-9f0e39e7d9d8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:57.374121 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-47976588-a7ae-48c6-b34a-9f0e39e7d9d8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:57.374547 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-47976588-a7ae-48c6-b34a-9f0e39e7d9d8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:57.377156 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-47976588-a7ae-48c6-b34a-9f0e39e7d9d8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:57.542142 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3560b735-c915-4965-b0f4-f99b6c344450 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:57.542972 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3560b735-c915-4965-b0f4-f99b6c344450 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: ff868ee0-f1e4-4c03-a039-c0a6cd548b58] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:57.555402 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3560b735-c915-4965-b0f4-f99b6c344450 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:57.562311 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3560b735-c915-4965-b0f4-f99b6c344450 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:57.562311 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3560b735-c915-4965-b0f4-f99b6c344450 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:57.562547 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3560b735-c915-4965-b0f4-f99b6c344450 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:57.563160 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3560b735-c915-4965-b0f4-f99b6c344450 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:57.563936 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3560b735-c915-4965-b0f4-f99b6c344450 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:57.688033 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-47976588-a7ae-48c6-b34a-9f0e39e7d9d8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "POST /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335/action" status: 202 len: 0 microversion: 2.1 time: 0.341017 Oct 23 01:21:57.689562 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1554/3081] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:21:57 2022] POST /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335/action => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:21:57.723099 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5fafc90c-4523-4ebb-a373-18424b57ee26 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:57.724234 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5fafc90c-4523-4ebb-a373-18424b57ee26 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] [instance: 05c1ab48-a6d9-464e-8c9f-69daf726e353] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:57.739752 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5fafc90c-4523-4ebb-a373-18424b57ee26 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:57.740998 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5fafc90c-4523-4ebb-a373-18424b57ee26 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:57.741669 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5fafc90c-4523-4ebb-a373-18424b57ee26 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:57.746634 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5fafc90c-4523-4ebb-a373-18424b57ee26 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:57.747476 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5fafc90c-4523-4ebb-a373-18424b57ee26 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:57.748279 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5fafc90c-4523-4ebb-a373-18424b57ee26 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:57.804074 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3560b735-c915-4965-b0f4-f99b6c344450 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:57.830361 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3560b735-c915-4965-b0f4-f99b6c344450 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58" status: 200 len: 1488 microversion: 2.1 time: 0.293803 Oct 23 01:21:57.830974 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1528/3082] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:57 2022] GET /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58 => generated 1488 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:57.856218 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c4d5ac04-20c1-4db8-af1c-712abab14961 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:57.856882 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c4d5ac04-20c1-4db8-af1c-712abab14961 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:57.878335 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c4d5ac04-20c1-4db8-af1c-712abab14961 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:57.880178 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c4d5ac04-20c1-4db8-af1c-712abab14961 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:57.881061 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c4d5ac04-20c1-4db8-af1c-712abab14961 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:57.882515 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c4d5ac04-20c1-4db8-af1c-712abab14961 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:57.884163 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c4d5ac04-20c1-4db8-af1c-712abab14961 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:57.887010 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c4d5ac04-20c1-4db8-af1c-712abab14961 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:58.971491 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5fafc90c-4523-4ebb-a373-18424b57ee26 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bede03a6c44c3cbe86f7a06601d115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1b744484c41c88314112b572ccac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:58.985963 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5fafc90c-4523-4ebb-a373-18424b57ee26 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] 10.222.0.42 "GET /compute/v2.1/servers/05c1ab48-a6d9-464e-8c9f-69daf726e353" status: 200 len: 1319 microversion: 2.1 time: 1.294670 Oct 23 01:21:58.986585 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1555/3083] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:57 2022] GET /compute/v2.1/servers/05c1ab48-a6d9-464e-8c9f-69daf726e353 => generated 1319 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:58.991427 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2a3faa3d-2d15-41e0-a7da-6850e1bf01db tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:58.991946 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2a3faa3d-2d15-41e0-a7da-6850e1bf01db tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: ff868ee0-f1e4-4c03-a039-c0a6cd548b58] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:59.020392 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a3faa3d-2d15-41e0-a7da-6850e1bf01db tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:59.022142 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c4d5ac04-20c1-4db8-af1c-712abab14961 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:59.023887 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a3faa3d-2d15-41e0-a7da-6850e1bf01db tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:59.024555 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a3faa3d-2d15-41e0-a7da-6850e1bf01db tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:59.029106 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a3faa3d-2d15-41e0-a7da-6850e1bf01db tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:59.031212 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a3faa3d-2d15-41e0-a7da-6850e1bf01db tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:59.031769 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a3faa3d-2d15-41e0-a7da-6850e1bf01db tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:59.040440 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c4d5ac04-20c1-4db8-af1c-712abab14961 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1502 microversion: 2.1 time: 1.206154 Oct 23 01:21:59.041050 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1529/3084] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:57 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1502 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:21:59.046263 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0951a853-093a-4423-aefb-5f739d407743 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:59.046885 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0951a853-093a-4423-aefb-5f739d407743 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:59.061903 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0951a853-093a-4423-aefb-5f739d407743 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:59.062447 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0951a853-093a-4423-aefb-5f739d407743 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:59.062893 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0951a853-093a-4423-aefb-5f739d407743 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:59.063621 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0951a853-093a-4423-aefb-5f739d407743 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:59.064095 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0951a853-093a-4423-aefb-5f739d407743 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:59.066493 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0951a853-093a-4423-aefb-5f739d407743 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:59.106149 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2a3faa3d-2d15-41e0-a7da-6850e1bf01db tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: ff868ee0-f1e4-4c03-a039-c0a6cd548b58] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:21:59.514779 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2a3faa3d-2d15-41e0-a7da-6850e1bf01db tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58" status: 204 len: 0 microversion: 2.1 time: 0.526857 Oct 23 01:21:59.515579 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1556/3085] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:21:58 2022] DELETE /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:21:59.530660 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2a3faa3d-2d15-41e0-a7da-6850e1bf01db tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:59.530660 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2a3faa3d-2d15-41e0-a7da-6850e1bf01db tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001310 Oct 23 01:21:59.530660 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1557/3086] 10.222.0.42 () {56 vars in 886 bytes} [Sun Oct 23 01:21:59 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 23 01:21:59.530660 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-aa416bd0-8c61-4be3-a372-07c6729bbec0 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:21:59.530660 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-aa416bd0-8c61-4be3-a372-07c6729bbec0 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: ff868ee0-f1e4-4c03-a039-c0a6cd548b58] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:21:59.534308 n-d-master-1 devstack@n-api.service[120945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 23 01:21:59.535069 n-d-master-1 devstack@n-api.service[120945]: Sun Oct 23 01:21:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 (ip 10.222.0.42) !!! Oct 23 01:21:59.540512 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aa416bd0-8c61-4be3-a372-07c6729bbec0 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:59.541142 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aa416bd0-8c61-4be3-a372-07c6729bbec0 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:59.543315 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aa416bd0-8c61-4be3-a372-07c6729bbec0 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:59.544158 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aa416bd0-8c61-4be3-a372-07c6729bbec0 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:21:59.546442 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aa416bd0-8c61-4be3-a372-07c6729bbec0 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:21:59.553146 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aa416bd0-8c61-4be3-a372-07c6729bbec0 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:21:59.715347 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0951a853-093a-4423-aefb-5f739d407743 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:59.734400 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0951a853-093a-4423-aefb-5f739d407743 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:59.735864 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0951a853-093a-4423-aefb-5f739d407743 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:59.737043 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0951a853-093a-4423-aefb-5f739d407743 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1801 microversion: 2.42 time: 0.694510 Oct 23 01:21:59.737835 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1530/3087] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:21:59 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1801 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:21:59.913764 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-aa416bd0-8c61-4be3-a372-07c6729bbec0 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:21:59.920941 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-aa416bd0-8c61-4be3-a372-07c6729bbec0 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58" status: 200 len: 1494 microversion: 2.1 time: 0.399848 Oct 23 01:21:59.922335 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1558/3088] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:21:59 2022] GET /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58 => generated 1494 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:00.013270 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a9241975-b593-4608-8290-392652000737 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:00.015062 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a9241975-b593-4608-8290-392652000737 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] [instance: 05c1ab48-a6d9-464e-8c9f-69daf726e353] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:00.021570 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9241975-b593-4608-8290-392652000737 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:00.022123 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9241975-b593-4608-8290-392652000737 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:00.024982 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9241975-b593-4608-8290-392652000737 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:00.024982 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9241975-b593-4608-8290-392652000737 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:00.024982 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9241975-b593-4608-8290-392652000737 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:00.024982 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9241975-b593-4608-8290-392652000737 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:00.071840 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bd40bedc-7493-48ee-b1ef-398efd279e17 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:00.071840 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bd40bedc-7493-48ee-b1ef-398efd279e17 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:00.081084 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bd40bedc-7493-48ee-b1ef-398efd279e17 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:00.081603 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bd40bedc-7493-48ee-b1ef-398efd279e17 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:00.082438 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bd40bedc-7493-48ee-b1ef-398efd279e17 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:00.083075 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bd40bedc-7493-48ee-b1ef-398efd279e17 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:00.083542 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bd40bedc-7493-48ee-b1ef-398efd279e17 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:00.083974 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bd40bedc-7493-48ee-b1ef-398efd279e17 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:00.331696 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a9241975-b593-4608-8290-392652000737 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bede03a6c44c3cbe86f7a06601d115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1b744484c41c88314112b572ccac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:00.343758 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bd40bedc-7493-48ee-b1ef-398efd279e17 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:00.346952 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a9241975-b593-4608-8290-392652000737 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] 10.222.0.42 "GET /compute/v2.1/servers/05c1ab48-a6d9-464e-8c9f-69daf726e353" status: 200 len: 1319 microversion: 2.1 time: 0.338287 Oct 23 01:22:00.347613 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1531/3089] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:00 2022] GET /compute/v2.1/servers/05c1ab48-a6d9-464e-8c9f-69daf726e353 => generated 1319 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:00.352690 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bd40bedc-7493-48ee-b1ef-398efd279e17 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1502 microversion: 2.1 time: 0.287367 Oct 23 01:22:00.354577 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1559/3090] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:00 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1502 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:00.366507 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-ef46fee8-b821-439a-b7a3-eb08a5b96cd8 req-893f8ffa-5286-44ec-9b1a-fb0d982b622f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e352f0d-c908-46b8-a28c-8704d0c92da6", "name": "network-vif-plugged", "status": "completed", "tag": "b462ddd0-60bd-4ba7-8465-936cb863b316"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:22:00.391151 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ef46fee8-b821-439a-b7a3-eb08a5b96cd8 req-893f8ffa-5286-44ec-9b1a-fb0d982b622f service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:00.391659 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ef46fee8-b821-439a-b7a3-eb08a5b96cd8 req-893f8ffa-5286-44ec-9b1a-fb0d982b622f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:00.392096 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ef46fee8-b821-439a-b7a3-eb08a5b96cd8 req-893f8ffa-5286-44ec-9b1a-fb0d982b622f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:00.420690 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-ef46fee8-b821-439a-b7a3-eb08a5b96cd8 req-893f8ffa-5286-44ec-9b1a-fb0d982b622f service nova] Creating event network-vif-plugged:b462ddd0-60bd-4ba7-8465-936cb863b316 for instance 8e352f0d-c908-46b8-a28c-8704d0c92da6 on n-h2-master-1 Oct 23 01:22:00.433927 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-ef46fee8-b821-439a-b7a3-eb08a5b96cd8 req-893f8ffa-5286-44ec-9b1a-fb0d982b622f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079724 Oct 23 01:22:00.436427 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1532/3091] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:22:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:22:00.764949 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dd7147cc-c4bd-4308-8da7-bffa135abbac tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:00.765631 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-dd7147cc-c4bd-4308-8da7-bffa135abbac tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:00.775309 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd7147cc-c4bd-4308-8da7-bffa135abbac tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:00.776217 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd7147cc-c4bd-4308-8da7-bffa135abbac tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:00.776816 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd7147cc-c4bd-4308-8da7-bffa135abbac tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:00.777719 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd7147cc-c4bd-4308-8da7-bffa135abbac tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:00.778374 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd7147cc-c4bd-4308-8da7-bffa135abbac tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:00.779552 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd7147cc-c4bd-4308-8da7-bffa135abbac tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:00.946035 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-36b49523-f29e-4e4f-812a-d2892c0febb4 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:00.946728 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-36b49523-f29e-4e4f-812a-d2892c0febb4 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: ff868ee0-f1e4-4c03-a039-c0a6cd548b58] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:00.957774 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36b49523-f29e-4e4f-812a-d2892c0febb4 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:00.964825 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36b49523-f29e-4e4f-812a-d2892c0febb4 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:00.965351 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36b49523-f29e-4e4f-812a-d2892c0febb4 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:00.966168 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36b49523-f29e-4e4f-812a-d2892c0febb4 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:00.966653 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36b49523-f29e-4e4f-812a-d2892c0febb4 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:00.967086 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36b49523-f29e-4e4f-812a-d2892c0febb4 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:01.225222 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-dd7147cc-c4bd-4308-8da7-bffa135abbac tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:01.248878 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-dd7147cc-c4bd-4308-8da7-bffa135abbac tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:01.255063 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-dd7147cc-c4bd-4308-8da7-bffa135abbac tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:01.256351 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-dd7147cc-c4bd-4308-8da7-bffa135abbac tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1801 microversion: 2.42 time: 0.497076 Oct 23 01:22:01.259409 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1560/3092] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:22:00 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1801 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:22:01.373785 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2f4876d5-8be5-4829-98d0-e6902a1effcf tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:01.374743 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2f4876d5-8be5-4829-98d0-e6902a1effcf tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] [instance: 05c1ab48-a6d9-464e-8c9f-69daf726e353] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:01.384731 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f4876d5-8be5-4829-98d0-e6902a1effcf tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:01.386864 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f4876d5-8be5-4829-98d0-e6902a1effcf tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:01.388948 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f4876d5-8be5-4829-98d0-e6902a1effcf tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:01.389873 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f4876d5-8be5-4829-98d0-e6902a1effcf tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:01.391021 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f4876d5-8be5-4829-98d0-e6902a1effcf tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:01.393103 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f4876d5-8be5-4829-98d0-e6902a1effcf tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:01.707149 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-36b49523-f29e-4e4f-812a-d2892c0febb4 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:01.720649 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-36b49523-f29e-4e4f-812a-d2892c0febb4 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58" status: 200 len: 1494 microversion: 2.1 time: 0.779395 Oct 23 01:22:01.737746 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1533/3093] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:00 2022] GET /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58 => generated 1494 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:01.759632 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ea42198a-8751-4371-b3b6-3e0d8819a1b0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:01.759632 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ea42198a-8751-4371-b3b6-3e0d8819a1b0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:01.771952 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ea42198a-8751-4371-b3b6-3e0d8819a1b0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:01.772648 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ea42198a-8751-4371-b3b6-3e0d8819a1b0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:01.773198 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ea42198a-8751-4371-b3b6-3e0d8819a1b0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:01.774194 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ea42198a-8751-4371-b3b6-3e0d8819a1b0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:01.774877 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ea42198a-8751-4371-b3b6-3e0d8819a1b0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:01.775658 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ea42198a-8751-4371-b3b6-3e0d8819a1b0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:02.251228 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ea42198a-8751-4371-b3b6-3e0d8819a1b0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:02.268009 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ea42198a-8751-4371-b3b6-3e0d8819a1b0 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1502 microversion: 2.1 time: 0.528254 Oct 23 01:22:02.269125 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1534/3094] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:01 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1502 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:02.291076 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c3822b74-b398-468c-931d-600494641dba tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:02.292531 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c3822b74-b398-468c-931d-600494641dba tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:02.299989 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c3822b74-b398-468c-931d-600494641dba tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:02.300667 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c3822b74-b398-468c-931d-600494641dba tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:02.301229 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c3822b74-b398-468c-931d-600494641dba tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:02.302568 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c3822b74-b398-468c-931d-600494641dba tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:02.303198 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c3822b74-b398-468c-931d-600494641dba tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:02.303996 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c3822b74-b398-468c-931d-600494641dba tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:02.310224 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=100 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:22:02.364159 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2f4876d5-8be5-4829-98d0-e6902a1effcf tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bede03a6c44c3cbe86f7a06601d115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1b744484c41c88314112b572ccac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:02.385393 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2f4876d5-8be5-4829-98d0-e6902a1effcf tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] 10.222.0.42 "GET /compute/v2.1/servers/05c1ab48-a6d9-464e-8c9f-69daf726e353" status: 200 len: 1319 microversion: 2.1 time: 1.016370 Oct 23 01:22:02.388182 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1561/3095] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:01 2022] GET /compute/v2.1/servers/05c1ab48-a6d9-464e-8c9f-69daf726e353 => generated 1319 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:22:02.767577 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c3822b74-b398-468c-931d-600494641dba tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:02.774759 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-742a3f01-11e1-4c2f-a688-781d26936e25 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:02.777021 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-742a3f01-11e1-4c2f-a688-781d26936e25 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: ff868ee0-f1e4-4c03-a039-c0a6cd548b58] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:02.799607 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-742a3f01-11e1-4c2f-a688-781d26936e25 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:02.801030 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c3822b74-b398-468c-931d-600494641dba tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:02.803009 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-742a3f01-11e1-4c2f-a688-781d26936e25 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:02.807613 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-742a3f01-11e1-4c2f-a688-781d26936e25 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:02.808319 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-742a3f01-11e1-4c2f-a688-781d26936e25 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:02.811205 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-742a3f01-11e1-4c2f-a688-781d26936e25 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:02.811824 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-742a3f01-11e1-4c2f-a688-781d26936e25 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:02.812126 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c3822b74-b398-468c-931d-600494641dba tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:02.821639 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c3822b74-b398-468c-931d-600494641dba tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1848 microversion: 2.42 time: 0.533154 Oct 23 01:22:02.828038 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1535/3096] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:22:02 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1848 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:22:03.130628 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-742a3f01-11e1-4c2f-a688-781d26936e25 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:03.144650 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-742a3f01-11e1-4c2f-a688-781d26936e25 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58" status: 200 len: 1452 microversion: 2.1 time: 0.394992 Oct 23 01:22:03.146003 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1562/3097] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:02 2022] GET /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58 => generated 1452 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:03.301721 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3f752e0e-6a4e-4ade-8870-72088a59566f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:03.302432 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3f752e0e-6a4e-4ade-8870-72088a59566f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:03.315884 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3f752e0e-6a4e-4ade-8870-72088a59566f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:03.316311 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3f752e0e-6a4e-4ade-8870-72088a59566f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:03.326970 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3f752e0e-6a4e-4ade-8870-72088a59566f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:03.327739 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3f752e0e-6a4e-4ade-8870-72088a59566f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:03.329278 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3f752e0e-6a4e-4ade-8870-72088a59566f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:03.331547 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3f752e0e-6a4e-4ade-8870-72088a59566f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:03.414008 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2e1bd161-6e0c-45ed-abd6-d78169b905ab tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:03.418779 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2e1bd161-6e0c-45ed-abd6-d78169b905ab tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] [instance: 05c1ab48-a6d9-464e-8c9f-69daf726e353] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:03.448976 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e1bd161-6e0c-45ed-abd6-d78169b905ab tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:03.448976 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e1bd161-6e0c-45ed-abd6-d78169b905ab tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:03.448976 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e1bd161-6e0c-45ed-abd6-d78169b905ab tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:03.448976 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e1bd161-6e0c-45ed-abd6-d78169b905ab tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:03.449584 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e1bd161-6e0c-45ed-abd6-d78169b905ab tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:03.466719 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e1bd161-6e0c-45ed-abd6-d78169b905ab tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:04.563405 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3f752e0e-6a4e-4ade-8870-72088a59566f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:04.572500 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3f752e0e-6a4e-4ade-8870-72088a59566f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 1.278794 Oct 23 01:22:04.582047 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1536/3098] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:03 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:04.598131 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b24e66f2-d5f5-43ef-b8db-cff6575a8e2a tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:04.603509 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b24e66f2-d5f5-43ef-b8db-cff6575a8e2a tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:04.627054 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b24e66f2-d5f5-43ef-b8db-cff6575a8e2a tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:04.632535 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b24e66f2-d5f5-43ef-b8db-cff6575a8e2a tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:04.633266 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b24e66f2-d5f5-43ef-b8db-cff6575a8e2a tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:04.636389 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b24e66f2-d5f5-43ef-b8db-cff6575a8e2a tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:04.637055 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b24e66f2-d5f5-43ef-b8db-cff6575a8e2a tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:04.638756 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b24e66f2-d5f5-43ef-b8db-cff6575a8e2a tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:04.651811 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2e1bd161-6e0c-45ed-abd6-d78169b905ab tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bede03a6c44c3cbe86f7a06601d115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1b744484c41c88314112b572ccac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:04.670944 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2e1bd161-6e0c-45ed-abd6-d78169b905ab tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] 10.222.0.42 "GET /compute/v2.1/servers/05c1ab48-a6d9-464e-8c9f-69daf726e353" status: 200 len: 1319 microversion: 2.1 time: 1.260707 Oct 23 01:22:04.675514 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1563/3099] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:03 2022] GET /compute/v2.1/servers/05c1ab48-a6d9-464e-8c9f-69daf726e353 => generated 1319 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:22:04.701085 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0cd7aeb7-ad03-428f-ac9f-0ae16859c732 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:04.702755 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0cd7aeb7-ad03-428f-ac9f-0ae16859c732 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: ff868ee0-f1e4-4c03-a039-c0a6cd548b58] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:04.719659 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0cd7aeb7-ad03-428f-ac9f-0ae16859c732 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:04.725386 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0cd7aeb7-ad03-428f-ac9f-0ae16859c732 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:04.728386 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0cd7aeb7-ad03-428f-ac9f-0ae16859c732 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:04.731415 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0cd7aeb7-ad03-428f-ac9f-0ae16859c732 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:04.736448 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0cd7aeb7-ad03-428f-ac9f-0ae16859c732 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:04.737128 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0cd7aeb7-ad03-428f-ac9f-0ae16859c732 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:04.890176 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0cd7aeb7-ad03-428f-ac9f-0ae16859c732 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:04.890794 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0cd7aeb7-ad03-428f-ac9f-0ae16859c732 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:04.891930 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0cd7aeb7-ad03-428f-ac9f-0ae16859c732 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:04.896558 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-0cd7aeb7-ad03-428f-ac9f-0ae16859c732 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lazy-loading 'fault' on Instance uuid ff868ee0-f1e4-4c03-a039-c0a6cd548b58 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:22:05.199336 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0cd7aeb7-ad03-428f-ac9f-0ae16859c732 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:05.211156 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0cd7aeb7-ad03-428f-ac9f-0ae16859c732 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58" status: 200 len: 1298 microversion: 2.1 time: 0.529488 Oct 23 01:22:05.212855 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1564/3100] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:04 2022] GET /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58 => generated 1298 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:05.241125 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-972f9b59-65c2-4960-89bc-87652a9219e4 req-65039342-57bd-4c88-a726-34e832f91f2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff868ee0-f1e4-4c03-a039-c0a6cd548b58", "name": "network-vif-deleted", "tag": "aea99284-1df7-49c1-b874-c2f688b118b9"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:22:05.273597 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-972f9b59-65c2-4960-89bc-87652a9219e4 req-65039342-57bd-4c88-a726-34e832f91f2c service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:05.277460 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-972f9b59-65c2-4960-89bc-87652a9219e4 req-65039342-57bd-4c88-a726-34e832f91f2c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:05.280879 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-972f9b59-65c2-4960-89bc-87652a9219e4 req-65039342-57bd-4c88-a726-34e832f91f2c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:05.341518 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-972f9b59-65c2-4960-89bc-87652a9219e4 req-65039342-57bd-4c88-a726-34e832f91f2c service nova] Creating event network-vif-deleted:aea99284-1df7-49c1-b874-c2f688b118b9 for instance ff868ee0-f1e4-4c03-a039-c0a6cd548b58 on n-h1-master-1 Oct 23 01:22:05.343759 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b24e66f2-d5f5-43ef-b8db-cff6575a8e2a tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:05.370452 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-972f9b59-65c2-4960-89bc-87652a9219e4 req-65039342-57bd-4c88-a726-34e832f91f2c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155318 Oct 23 01:22:05.374520 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1565/3101] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:22:05.377335 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b24e66f2-d5f5-43ef-b8db-cff6575a8e2a tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:05.380500 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b24e66f2-d5f5-43ef-b8db-cff6575a8e2a tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:05.382427 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b24e66f2-d5f5-43ef-b8db-cff6575a8e2a tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1848 microversion: 2.42 time: 0.798956 Oct 23 01:22:05.383426 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1537/3102] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:22:04 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1848 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:22:05.394260 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4eab904d-8320-44c1-888f-b1c3eacf0235 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:05.398053 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4eab904d-8320-44c1-888f-b1c3eacf0235 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:05.422273 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4eab904d-8320-44c1-888f-b1c3eacf0235 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:05.422794 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4eab904d-8320-44c1-888f-b1c3eacf0235 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:05.425397 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4eab904d-8320-44c1-888f-b1c3eacf0235 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:05.428638 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4eab904d-8320-44c1-888f-b1c3eacf0235 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:05.429125 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4eab904d-8320-44c1-888f-b1c3eacf0235 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:05.429563 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4eab904d-8320-44c1-888f-b1c3eacf0235 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:05.703573 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-052279cf-5822-4aa9-bcf0-2c68b0246baa tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:05.704937 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-052279cf-5822-4aa9-bcf0-2c68b0246baa tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] [instance: 05c1ab48-a6d9-464e-8c9f-69daf726e353] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:05.719648 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-052279cf-5822-4aa9-bcf0-2c68b0246baa tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:05.723821 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-052279cf-5822-4aa9-bcf0-2c68b0246baa tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:05.724731 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-052279cf-5822-4aa9-bcf0-2c68b0246baa tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:05.725718 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-052279cf-5822-4aa9-bcf0-2c68b0246baa tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:05.734918 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-052279cf-5822-4aa9-bcf0-2c68b0246baa tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:05.736582 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-052279cf-5822-4aa9-bcf0-2c68b0246baa tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:06.358493 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4eab904d-8320-44c1-888f-b1c3eacf0235 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:06.371870 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4eab904d-8320-44c1-888f-b1c3eacf0235 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.995029 Oct 23 01:22:06.381878 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1566/3103] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:05 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:06.394927 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-38bb1e66-f707-4796-a086-fe11f6ab84f3 req-f8fed675-8cd8-437d-a06c-a988f3bff8e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "defa5fbb-f632-4ce7-8e07-e00f6f491d82", "tag": "551d6a08-a233-4348-871c-71fc57b512b8"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:22:06.426236 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-38bb1e66-f707-4796-a086-fe11f6ab84f3 req-f8fed675-8cd8-437d-a06c-a988f3bff8e7 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:06.426716 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-38bb1e66-f707-4796-a086-fe11f6ab84f3 req-f8fed675-8cd8-437d-a06c-a988f3bff8e7 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:06.427172 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-38bb1e66-f707-4796-a086-fe11f6ab84f3 req-f8fed675-8cd8-437d-a06c-a988f3bff8e7 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:06.466729 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-38bb1e66-f707-4796-a086-fe11f6ab84f3 req-f8fed675-8cd8-437d-a06c-a988f3bff8e7 service nova] Creating event network-changed:551d6a08-a233-4348-871c-71fc57b512b8 for instance defa5fbb-f632-4ce7-8e07-e00f6f491d82 on n-h2-master-1 Oct 23 01:22:06.489433 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-38bb1e66-f707-4796-a086-fe11f6ab84f3 req-f8fed675-8cd8-437d-a06c-a988f3bff8e7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097496 Oct 23 01:22:06.492060 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1567/3104] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:22:06.507607 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5850f919-edcd-4e3a-b5b2-a58000675f14 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:06.514168 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5850f919-edcd-4e3a-b5b2-a58000675f14 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: ff868ee0-f1e4-4c03-a039-c0a6cd548b58] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:06.526618 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5850f919-edcd-4e3a-b5b2-a58000675f14 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:06.529122 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5850f919-edcd-4e3a-b5b2-a58000675f14 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:06.541292 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5850f919-edcd-4e3a-b5b2-a58000675f14 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:06.542897 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5850f919-edcd-4e3a-b5b2-a58000675f14 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:06.543616 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5850f919-edcd-4e3a-b5b2-a58000675f14 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:06.546806 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5850f919-edcd-4e3a-b5b2-a58000675f14 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:06.567201 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-5850f919-edcd-4e3a-b5b2-a58000675f14 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] HTTP exception thrown: Instance ff868ee0-f1e4-4c03-a039-c0a6cd548b58 could not be found. Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5850f919-edcd-4e3a-b5b2-a58000675f14 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Request method failure captured: Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58 HTTP/1.1 Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJX7oG_-NoIyIEUCGEKOm-ZSU72famr5yoDILLNePut_DL_3k_PnsEavv2TmsQSFm35k3Fu45TPlv7dICjEoTIb1EL-5tIQBr9VKjw1DYfXzc-CSkypChB5gjaj2o2v1qRku6UVlPiA8dos_KOVi1KUitKTyxYLFMCu3mKpc9neV8xU Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 50bd4c137b6a42488f39d173d46520dd Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ImagesTestJSON-1961542935 Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/50bd4c137b6a42488f39d173d46520dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_50bd4c137b6a42488f39d173d46520dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/50bd4c137b6a42488f39d173d46520dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/50bd4c137b6a42488f39d173d46520dd"}]}] Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ImagesTestJSON-1961542935 Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 50bd4c137b6a42488f39d173d46520dd Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ImagesTestJSON-1961542935 Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ImagesTestJSON-1961542935-project Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: ecb97fa679eb4bf8a41862d3c248a217 Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ImagesTestJSON-1961542935-project Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: exception: Instance ff868ee0-f1e4-4c03-a039-c0a6cd548b58 could not be found. Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'ff868ee0-f1e4-4c03-a039-c0a6cd548b58'} Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff868ee0-f1e4-4c03-a039-c0a6cd548b58 could not be found. Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff868ee0-f1e4-4c03-a039-c0a6cd548b58 could not be found. Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:22:06.571215 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:22:06.577943 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:22:06.577943 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:22:06.577943 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:22:06.577943 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:22:06.577943 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff868ee0-f1e4-4c03-a039-c0a6cd548b58 could not be found. Oct 23 01:22:06.577943 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:22:06.581394 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5850f919-edcd-4e3a-b5b2-a58000675f14 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Returning 404 to user: Instance ff868ee0-f1e4-4c03-a039-c0a6cd548b58 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:22:06.583182 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5850f919-edcd-4e3a-b5b2-a58000675f14 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58" status: 404 len: 111 microversion: 2.1 time: 0.087308 Oct 23 01:22:06.584066 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1568/3105] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:06 2022] GET /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:22:06.592298 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2a7fdcd7-999a-40de-8e2a-c6e1d04bbb50 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:22:06.593359 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2a7fdcd7-999a-40de-8e2a-c6e1d04bbb50 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: f0f662d9-739f-4a6d-9d4e-935babe6e327] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:06.599972 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-2a7fdcd7-999a-40de-8e2a-c6e1d04bbb50 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] HTTP exception thrown: Instance f0f662d9-739f-4a6d-9d4e-935babe6e327 could not be found. Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2a7fdcd7-999a-40de-8e2a-c6e1d04bbb50 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Request method failure captured: Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/servers/f0f662d9-739f-4a6d-9d4e-935babe6e327/action HTTP/1.1 Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 15 Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJZEAurAeILsYJek3MCv_ryiTbidOLVZq6W4I7jJxeY_1_bTWRye2xM3EDOhowd_NyioevvIvzT9beBCgKqri_ZjLw9hdsIISMXmajO_VmobATT_GwpY_Y-GVylQtV9MoF1-Bup_Ahjld_2riQHnDzqLUWULm2acZYcK9UIbslVsdDU Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}] Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: cd6a6c5240f94ace91e1f0ed3e53fa7c Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: {"unpause": {}} Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: exception: Instance f0f662d9-739f-4a6d-9d4e-935babe6e327 could not be found. Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'f0f662d9-739f-4a6d-9d4e-935babe6e327', 'body': {'unpause': {}}} Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0f662d9-739f-4a6d-9d4e-935babe6e327 could not be found. Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0f662d9-739f-4a6d-9d4e-935babe6e327 could not be found. Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:22:06.602103 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:22:06.608801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:22:06.608801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:22:06.608801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0f662d9-739f-4a6d-9d4e-935babe6e327 could not be found. Oct 23 01:22:06.608801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:22:06.608801 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2a7fdcd7-999a-40de-8e2a-c6e1d04bbb50 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Returning 404 to user: Instance f0f662d9-739f-4a6d-9d4e-935babe6e327 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:22:06.608801 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2a7fdcd7-999a-40de-8e2a-c6e1d04bbb50 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "POST /compute/v2.1/servers/f0f662d9-739f-4a6d-9d4e-935babe6e327/action" status: 404 len: 111 microversion: 2.1 time: 0.018047 Oct 23 01:22:06.610987 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1569/3106] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:22:06 2022] POST /compute/v2.1/servers/f0f662d9-739f-4a6d-9d4e-935babe6e327/action => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:22:06.618061 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-19fd1d71-ab1e-45b2-98a2-bbc3c39fcaff tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:06.619090 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-19fd1d71-ab1e-45b2-98a2-bbc3c39fcaff tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:06.632643 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-19fd1d71-ab1e-45b2-98a2-bbc3c39fcaff tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:06.633882 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-19fd1d71-ab1e-45b2-98a2-bbc3c39fcaff tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:06.634664 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-19fd1d71-ab1e-45b2-98a2-bbc3c39fcaff tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:06.636182 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-19fd1d71-ab1e-45b2-98a2-bbc3c39fcaff tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:06.637927 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-19fd1d71-ab1e-45b2-98a2-bbc3c39fcaff tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:06.639170 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-19fd1d71-ab1e-45b2-98a2-bbc3c39fcaff tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:06.663291 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-052279cf-5822-4aa9-bcf0-2c68b0246baa tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bede03a6c44c3cbe86f7a06601d115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1b744484c41c88314112b572ccac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:06.673418 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-052279cf-5822-4aa9-bcf0-2c68b0246baa tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] 10.222.0.42 "GET /compute/v2.1/servers/05c1ab48-a6d9-464e-8c9f-69daf726e353" status: 200 len: 1319 microversion: 2.1 time: 0.975357 Oct 23 01:22:06.678521 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1538/3107] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:05 2022] GET /compute/v2.1/servers/05c1ab48-a6d9-464e-8c9f-69daf726e353 => generated 1319 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:22:06.700602 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5f444b9d-cd78-4bd6-b832-101f92fb3e81 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc1821b80>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:07.537102 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-19fd1d71-ab1e-45b2-98a2-bbc3c39fcaff tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:07.543121 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:22:07.573493 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-19fd1d71-ab1e-45b2-98a2-bbc3c39fcaff tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:07.575775 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-19fd1d71-ab1e-45b2-98a2-bbc3c39fcaff tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:07.580828 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-19fd1d71-ab1e-45b2-98a2-bbc3c39fcaff tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1848 microversion: 2.42 time: 0.968169 Oct 23 01:22:07.585551 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1570/3108] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:22:06 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1848 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:22:07.603039 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-550d764d-7965-4b8d-a454-85c14424f80a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:07.603937 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-550d764d-7965-4b8d-a454-85c14424f80a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:07.610643 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-550d764d-7965-4b8d-a454-85c14424f80a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:07.614677 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-550d764d-7965-4b8d-a454-85c14424f80a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:07.615612 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-550d764d-7965-4b8d-a454-85c14424f80a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:07.616743 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-550d764d-7965-4b8d-a454-85c14424f80a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:07.620237 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-550d764d-7965-4b8d-a454-85c14424f80a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:07.620961 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-550d764d-7965-4b8d-a454-85c14424f80a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:08.936479 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-550d764d-7965-4b8d-a454-85c14424f80a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:08.948790 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-550d764d-7965-4b8d-a454-85c14424f80a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 1.356445 Oct 23 01:22:08.949749 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1571/3109] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:07 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:08.967754 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b770cc6e-7dcd-4d29-9969-8aaa49afc5ce tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:08.973800 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b770cc6e-7dcd-4d29-9969-8aaa49afc5ce tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] [instance: 05c1ab48-a6d9-464e-8c9f-69daf726e353] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:09.011891 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b770cc6e-7dcd-4d29-9969-8aaa49afc5ce tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:09.011891 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b770cc6e-7dcd-4d29-9969-8aaa49afc5ce tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:09.011891 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b770cc6e-7dcd-4d29-9969-8aaa49afc5ce tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:09.011891 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b770cc6e-7dcd-4d29-9969-8aaa49afc5ce tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:09.011891 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b770cc6e-7dcd-4d29-9969-8aaa49afc5ce tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:09.011891 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b770cc6e-7dcd-4d29-9969-8aaa49afc5ce tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:09.161923 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5f444b9d-cd78-4bd6-b832-101f92fb3e81 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "DELETE /compute/v2.1/images/d8995b1c-6b8e-4df7-b6c6-6372dcfaadbd" status: 204 len: 0 microversion: 2.1 time: 2.482349 Oct 23 01:22:09.162865 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1539/3110] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:06 2022] DELETE /compute/v2.1/images/d8995b1c-6b8e-4df7-b6c6-6372dcfaadbd => generated 0 bytes in 2484 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:22:09.168559 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e5e35468-a63e-408b-9929-589c823efa66 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:09.169182 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e5e35468-a63e-408b-9929-589c823efa66 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:09.195219 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e5e35468-a63e-408b-9929-589c823efa66 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:09.195749 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e5e35468-a63e-408b-9929-589c823efa66 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:09.201012 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e5e35468-a63e-408b-9929-589c823efa66 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:09.201012 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e5e35468-a63e-408b-9929-589c823efa66 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:09.201012 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e5e35468-a63e-408b-9929-589c823efa66 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:09.201012 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e5e35468-a63e-408b-9929-589c823efa66 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:10.073361 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b770cc6e-7dcd-4d29-9969-8aaa49afc5ce tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bede03a6c44c3cbe86f7a06601d115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1b744484c41c88314112b572ccac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:10.089589 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b770cc6e-7dcd-4d29-9969-8aaa49afc5ce tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] 10.222.0.42 "GET /compute/v2.1/servers/05c1ab48-a6d9-464e-8c9f-69daf726e353" status: 200 len: 1319 microversion: 2.1 time: 1.135405 Oct 23 01:22:10.091723 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1572/3111] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:08 2022] GET /compute/v2.1/servers/05c1ab48-a6d9-464e-8c9f-69daf726e353 => generated 1319 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:10.104883 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-c570518d-02ae-40a9-86f9-055f3c6fb654 req-96ca7f87-e8a2-4b4a-96ed-22cf52490e51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "defa5fbb-f632-4ce7-8e07-e00f6f491d82", "tag": "9c5bddd0-bc00-4d4f-9c6f-55ec9f8a68db"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:22:10.144379 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-c570518d-02ae-40a9-86f9-055f3c6fb654 req-96ca7f87-e8a2-4b4a-96ed-22cf52490e51 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:10.146215 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e5e35468-a63e-408b-9929-589c823efa66 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:10.146925 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-c570518d-02ae-40a9-86f9-055f3c6fb654 req-96ca7f87-e8a2-4b4a-96ed-22cf52490e51 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:10.149819 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-c570518d-02ae-40a9-86f9-055f3c6fb654 req-96ca7f87-e8a2-4b4a-96ed-22cf52490e51 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:10.165578 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e5e35468-a63e-408b-9929-589c823efa66 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:10.168230 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e5e35468-a63e-408b-9929-589c823efa66 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:10.171437 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e5e35468-a63e-408b-9929-589c823efa66 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1869 microversion: 2.42 time: 1.007292 Oct 23 01:22:10.180317 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1540/3112] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:22:09 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1869 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:22:10.186485 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-249b1a65-84b1-4c18-b93a-c7f2a87a8165 req-569ebd7a-bd33-4f53-a303-6df8b9e2b2bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05c1ab48-a6d9-464e-8c9f-69daf726e353", "name": "network-vif-plugged", "status": "completed", "tag": "6a552298-cbe9-405d-a6ea-1aae20a7bf7b"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:22:10.188500 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-c570518d-02ae-40a9-86f9-055f3c6fb654 req-96ca7f87-e8a2-4b4a-96ed-22cf52490e51 service nova] Creating event network-changed:9c5bddd0-bc00-4d4f-9c6f-55ec9f8a68db for instance defa5fbb-f632-4ce7-8e07-e00f6f491d82 on n-h2-master-1 Oct 23 01:22:10.197747 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-c570518d-02ae-40a9-86f9-055f3c6fb654 req-96ca7f87-e8a2-4b4a-96ed-22cf52490e51 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104462 Oct 23 01:22:10.199047 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1573/3113] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:22:10.215071 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-249b1a65-84b1-4c18-b93a-c7f2a87a8165 req-569ebd7a-bd33-4f53-a303-6df8b9e2b2bc service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:10.215966 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-249b1a65-84b1-4c18-b93a-c7f2a87a8165 req-569ebd7a-bd33-4f53-a303-6df8b9e2b2bc service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:10.216595 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-249b1a65-84b1-4c18-b93a-c7f2a87a8165 req-569ebd7a-bd33-4f53-a303-6df8b9e2b2bc service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:10.224902 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e3de4de4-dc2a-4aa0-bfa9-c4682132ff4a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:10.225729 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e3de4de4-dc2a-4aa0-bfa9-c4682132ff4a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:10.243254 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e3de4de4-dc2a-4aa0-bfa9-c4682132ff4a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:10.244846 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e3de4de4-dc2a-4aa0-bfa9-c4682132ff4a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:10.245301 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e3de4de4-dc2a-4aa0-bfa9-c4682132ff4a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:10.247075 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-249b1a65-84b1-4c18-b93a-c7f2a87a8165 req-569ebd7a-bd33-4f53-a303-6df8b9e2b2bc service nova] Creating event network-vif-plugged:6a552298-cbe9-405d-a6ea-1aae20a7bf7b for instance 05c1ab48-a6d9-464e-8c9f-69daf726e353 on n-h1-master-1 Oct 23 01:22:10.247893 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e3de4de4-dc2a-4aa0-bfa9-c4682132ff4a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:10.248741 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e3de4de4-dc2a-4aa0-bfa9-c4682132ff4a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:10.250131 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e3de4de4-dc2a-4aa0-bfa9-c4682132ff4a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:10.264211 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-249b1a65-84b1-4c18-b93a-c7f2a87a8165 req-569ebd7a-bd33-4f53-a303-6df8b9e2b2bc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074726 Oct 23 01:22:10.265610 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1541/3114] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:22:10.277382 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d9b95b97-84ab-4779-b031-76fe464bf287 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:10.277991 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d9b95b97-84ab-4779-b031-76fe464bf287 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 9a64ad71-9caf-4645-be7a-b56f8f584c2d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:10.312421 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9b95b97-84ab-4779-b031-76fe464bf287 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:10.313158 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9b95b97-84ab-4779-b031-76fe464bf287 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:10.313784 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9b95b97-84ab-4779-b031-76fe464bf287 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:10.314681 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9b95b97-84ab-4779-b031-76fe464bf287 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:10.315297 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9b95b97-84ab-4779-b031-76fe464bf287 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:10.315884 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9b95b97-84ab-4779-b031-76fe464bf287 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:10.398528 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d9b95b97-84ab-4779-b031-76fe464bf287 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 9a64ad71-9caf-4645-be7a-b56f8f584c2d] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:22:10.890128 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d9b95b97-84ab-4779-b031-76fe464bf287 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9a64ad71-9caf-4645-be7a-b56f8f584c2d" status: 204 len: 0 microversion: 2.1 time: 0.617329 Oct 23 01:22:10.890728 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1542/3115] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:22:10 2022] DELETE /compute/v2.1/servers/9a64ad71-9caf-4645-be7a-b56f8f584c2d => generated 0 bytes in 625 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:22:11.118468 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5140e3fb-fee7-48ac-b05d-aa024629d190 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-588882641", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "7a6a6c21-62ee-4ff5-ad89-ac85c31d0d64"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:22:11.211752 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-5140e3fb-fee7-48ac-b05d-aa024629d190 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] validate_networks() for [('7a6a6c21-62ee-4ff5-ad89-ac85c31d0d64', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:22:11.413507 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e3de4de4-dc2a-4aa0-bfa9-c4682132ff4a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:11.426771 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e3de4de4-dc2a-4aa0-bfa9-c4682132ff4a tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 1.224668 Oct 23 01:22:11.428738 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1574/3116] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:10 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:11.435772 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2e9c142b-e945-4c69-966b-4014ea767daa tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:11.436706 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2e9c142b-e945-4c69-966b-4014ea767daa tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] [instance: 05c1ab48-a6d9-464e-8c9f-69daf726e353] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:11.444718 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e9c142b-e945-4c69-966b-4014ea767daa tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:11.445708 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e9c142b-e945-4c69-966b-4014ea767daa tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:11.446396 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e9c142b-e945-4c69-966b-4014ea767daa tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:11.448146 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e9c142b-e945-4c69-966b-4014ea767daa tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:11.448770 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e9c142b-e945-4c69-966b-4014ea767daa tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:11.449356 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e9c142b-e945-4c69-966b-4014ea767daa tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:12.612174 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2e9c142b-e945-4c69-966b-4014ea767daa tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bede03a6c44c3cbe86f7a06601d115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1b744484c41c88314112b572ccac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:12.637734 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2e9c142b-e945-4c69-966b-4014ea767daa tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] 10.222.0.42 "GET /compute/v2.1/servers/05c1ab48-a6d9-464e-8c9f-69daf726e353" status: 200 len: 1319 microversion: 2.1 time: 1.207681 Oct 23 01:22:12.639902 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1575/3117] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:11 2022] GET /compute/v2.1/servers/05c1ab48-a6d9-464e-8c9f-69daf726e353 => generated 1319 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:12.655934 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fe9db9fe-87d0-48a6-a565-9cd50ae6446c tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:12.659190 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fe9db9fe-87d0-48a6-a565-9cd50ae6446c tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:12.680640 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:22:12.684632 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe9db9fe-87d0-48a6-a565-9cd50ae6446c tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:12.685148 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe9db9fe-87d0-48a6-a565-9cd50ae6446c tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:12.686166 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe9db9fe-87d0-48a6-a565-9cd50ae6446c tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:12.693109 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe9db9fe-87d0-48a6-a565-9cd50ae6446c tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:12.704899 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe9db9fe-87d0-48a6-a565-9cd50ae6446c tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:12.708517 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe9db9fe-87d0-48a6-a565-9cd50ae6446c tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:13.288658 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fe9db9fe-87d0-48a6-a565-9cd50ae6446c tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:13.323492 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fe9db9fe-87d0-48a6-a565-9cd50ae6446c tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:13.331212 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fe9db9fe-87d0-48a6-a565-9cd50ae6446c tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:13.335509 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fe9db9fe-87d0-48a6-a565-9cd50ae6446c tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1890 microversion: 2.42 time: 0.692564 Oct 23 01:22:13.336987 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1576/3118] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:22:12 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1890 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:22:13.356199 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6405acc5-5889-4f92-bc71-fc13ae51074b tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:22:13.359591 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6405acc5-5889-4f92-bc71-fc13ae51074b tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:13.361803 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-5140e3fb-fee7-48ac-b05d-aa024629d190 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:22:13.363393 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-5140e3fb-fee7-48ac-b05d-aa024629d190 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:22:13.364042 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-5140e3fb-fee7-48ac-b05d-aa024629d190 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:22:13.365666 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-5140e3fb-fee7-48ac-b05d-aa024629d190 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:22:13.366648 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-5140e3fb-fee7-48ac-b05d-aa024629d190 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:22:13.368452 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6405acc5-5889-4f92-bc71-fc13ae51074b tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:13.368933 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6405acc5-5889-4f92-bc71-fc13ae51074b tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:13.370066 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6405acc5-5889-4f92-bc71-fc13ae51074b tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:13.370773 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6405acc5-5889-4f92-bc71-fc13ae51074b tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:13.378385 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6405acc5-5889-4f92-bc71-fc13ae51074b tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:13.378968 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6405acc5-5889-4f92-bc71-fc13ae51074b tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:13.396555 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5140e3fb-fee7-48ac-b05d-aa024629d190 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:13.398335 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5140e3fb-fee7-48ac-b05d-aa024629d190 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:13.402244 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5140e3fb-fee7-48ac-b05d-aa024629d190 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:13.406711 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5140e3fb-fee7-48ac-b05d-aa024629d190 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:13.407602 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5140e3fb-fee7-48ac-b05d-aa024629d190 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:13.408409 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5140e3fb-fee7-48ac-b05d-aa024629d190 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:13.438026 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-6405acc5-5889-4f92-bc71-fc13ae51074b tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] HTTP exception thrown: Cannot 'unpause' instance 62a8ad26-f65b-432d-a8da-48264c426335 while it is in vm_state active Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6405acc5-5889-4f92-bc71-fc13ae51074b tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Request method failure captured: Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335/action HTTP/1.1 Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 15 Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJZEAurAeILsYJek3MCv_ryiTbidOLVZq6W4I7jJxeY_1_bTWRye2xM3EDOhowd_NyioevvIvzT9beBCgKqri_ZjLw9hdsIISMXmajO_VmobATT_GwpY_Y-GVylQtV9MoF1-Bup_Ahjld_2riQHnDzqLUWULm2acZYcK9UIbslVsdDU Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}] Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: cd6a6c5240f94ace91e1f0ed3e53fa7c Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: {"unpause": {}} Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: exception: Cannot 'unpause' instance 62a8ad26-f65b-432d-a8da-48264c426335 while it is in vm_state active Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '62a8ad26-f65b-432d-a8da-48264c426335', 'body': {'unpause': {}}} Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 62a8ad26-f65b-432d-a8da-48264c426335 in vm_state active. Cannot unpause while the instance is in this state. Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 62a8ad26-f65b-432d-a8da-48264c426335 while it is in vm_state active Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:22:13.439845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:22:13.452144 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:22:13.452144 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:22:13.452144 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:22:13.452144 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 62a8ad26-f65b-432d-a8da-48264c426335 while it is in vm_state active Oct 23 01:22:13.452144 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:22:13.452144 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6405acc5-5889-4f92-bc71-fc13ae51074b tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Returning 409 to user: Cannot 'unpause' instance 62a8ad26-f65b-432d-a8da-48264c426335 while it is in vm_state active {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:22:13.452144 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6405acc5-5889-4f92-bc71-fc13ae51074b tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "POST /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335/action" status: 409 len: 145 microversion: 2.1 time: 0.099766 Oct 23 01:22:13.454404 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1577/3119] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:22:13 2022] POST /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335/action => generated 145 bytes in 113 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:22:13.459311 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-b5b59e10-7e7f-4e7d-a0f5-0275014d6ee0 req-5b3b7c79-2d8c-454f-baf3-196d0e101ef1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "defa5fbb-f632-4ce7-8e07-e00f6f491d82", "tag": "64f70211-a0f5-4eaa-bee0-cef52f477333"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:22:13.479558 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-b5b59e10-7e7f-4e7d-a0f5-0275014d6ee0 req-5b3b7c79-2d8c-454f-baf3-196d0e101ef1 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:13.485511 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-b5b59e10-7e7f-4e7d-a0f5-0275014d6ee0 req-5b3b7c79-2d8c-454f-baf3-196d0e101ef1 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:13.486335 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-b5b59e10-7e7f-4e7d-a0f5-0275014d6ee0 req-5b3b7c79-2d8c-454f-baf3-196d0e101ef1 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:13.491011 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-5140e3fb-fee7-48ac-b05d-aa024629d190 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Getting quotas for project 50bd4c137b6a42488f39d173d46520dd. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:22:13.503521 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-5140e3fb-fee7-48ac-b05d-aa024629d190 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Getting quotas for user ecb97fa679eb4bf8a41862d3c248a217 and project 50bd4c137b6a42488f39d173d46520dd. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:22:13.511325 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-b5b59e10-7e7f-4e7d-a0f5-0275014d6ee0 req-5b3b7c79-2d8c-454f-baf3-196d0e101ef1 service nova] Creating event network-changed:64f70211-a0f5-4eaa-bee0-cef52f477333 for instance defa5fbb-f632-4ce7-8e07-e00f6f491d82 on n-h2-master-1 Oct 23 01:22:13.517160 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-b5b59e10-7e7f-4e7d-a0f5-0275014d6ee0 req-5b3b7c79-2d8c-454f-baf3-196d0e101ef1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061327 Oct 23 01:22:13.526017 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1578/3120] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:22:13.531713 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0bdf40f4-f64d-409d-95bc-389ce6bc28d5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:13.533883 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0bdf40f4-f64d-409d-95bc-389ce6bc28d5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:13.543894 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5140e3fb-fee7-48ac-b05d-aa024629d190 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:22:13.571548 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5140e3fb-fee7-48ac-b05d-aa024629d190 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 1842d55e-825b-4dc8-b3e4-d5eb8ab2b941] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:22:13.578719 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0bdf40f4-f64d-409d-95bc-389ce6bc28d5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:13.579375 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0bdf40f4-f64d-409d-95bc-389ce6bc28d5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:13.579659 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0bdf40f4-f64d-409d-95bc-389ce6bc28d5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:13.580362 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0bdf40f4-f64d-409d-95bc-389ce6bc28d5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:13.580817 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0bdf40f4-f64d-409d-95bc-389ce6bc28d5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:13.581242 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0bdf40f4-f64d-409d-95bc-389ce6bc28d5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:13.978891 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5140e3fb-fee7-48ac-b05d-aa024629d190 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.861353 Oct 23 01:22:13.984214 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1543/3121] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:22:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:22:13.995285 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a3d69684-318e-4a07-ba0a-638211c6c5ee tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:13.998344 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a3d69684-318e-4a07-ba0a-638211c6c5ee tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] [instance: 05c1ab48-a6d9-464e-8c9f-69daf726e353] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:14.027333 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a3d69684-318e-4a07-ba0a-638211c6c5ee tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:14.031596 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a3d69684-318e-4a07-ba0a-638211c6c5ee tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:14.032923 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a3d69684-318e-4a07-ba0a-638211c6c5ee tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:14.038991 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a3d69684-318e-4a07-ba0a-638211c6c5ee tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:14.040442 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a3d69684-318e-4a07-ba0a-638211c6c5ee tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:14.042367 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a3d69684-318e-4a07-ba0a-638211c6c5ee tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:14.807593 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a3d69684-318e-4a07-ba0a-638211c6c5ee tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bede03a6c44c3cbe86f7a06601d115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1b744484c41c88314112b572ccac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:14.817512 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a3d69684-318e-4a07-ba0a-638211c6c5ee tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] 10.222.0.42 "GET /compute/v2.1/servers/05c1ab48-a6d9-464e-8c9f-69daf726e353" status: 200 len: 1507 microversion: 2.1 time: 0.832298 Oct 23 01:22:14.835207 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1544/3122] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:13 2022] GET /compute/v2.1/servers/05c1ab48-a6d9-464e-8c9f-69daf726e353 => generated 1507 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:14.848025 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-09f782a9-27f8-4407-ba6e-13bc5affe9fb tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:14.855514 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-09f782a9-27f8-4407-ba6e-13bc5affe9fb tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 1842d55e-825b-4dc8-b3e4-d5eb8ab2b941] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:15.059649 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0bdf40f4-f64d-409d-95bc-389ce6bc28d5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:15.082615 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0bdf40f4-f64d-409d-95bc-389ce6bc28d5 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 1.551590 Oct 23 01:22:15.082615 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1579/3123] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:13 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:15.099080 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-311ebd14-ca47-47ce-abed-114fea367a26 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:15.099973 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-311ebd14-ca47-47ce-abed-114fea367a26 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:15.111169 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-311ebd14-ca47-47ce-abed-114fea367a26 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:15.111867 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-311ebd14-ca47-47ce-abed-114fea367a26 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:15.119588 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-311ebd14-ca47-47ce-abed-114fea367a26 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:15.120663 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-311ebd14-ca47-47ce-abed-114fea367a26 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:15.121324 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-311ebd14-ca47-47ce-abed-114fea367a26 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:15.122481 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-311ebd14-ca47-47ce-abed-114fea367a26 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:15.198635 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-09f782a9-27f8-4407-ba6e-13bc5affe9fb tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:15.210298 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-09f782a9-27f8-4407-ba6e-13bc5affe9fb tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/1842d55e-825b-4dc8-b3e4-d5eb8ab2b941" status: 200 len: 1207 microversion: 2.1 time: 0.373426 Oct 23 01:22:15.211584 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1545/3124] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:14 2022] GET /compute/v2.1/servers/1842d55e-825b-4dc8-b3e4-d5eb8ab2b941 => generated 1207 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:15.217516 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8da3a842-6e50-43f2-809c-72c561c6a007 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:15.222850 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8da3a842-6e50-43f2-809c-72c561c6a007 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] [instance: 8e352f0d-c908-46b8-a28c-8704d0c92da6] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:15.233705 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8da3a842-6e50-43f2-809c-72c561c6a007 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:15.244020 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8da3a842-6e50-43f2-809c-72c561c6a007 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:15.244020 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8da3a842-6e50-43f2-809c-72c561c6a007 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:15.244751 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8da3a842-6e50-43f2-809c-72c561c6a007 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:15.245793 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8da3a842-6e50-43f2-809c-72c561c6a007 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:15.247102 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8da3a842-6e50-43f2-809c-72c561c6a007 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:15.943548 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-311ebd14-ca47-47ce-abed-114fea367a26 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:15.968420 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8da3a842-6e50-43f2-809c-72c561c6a007 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bede03a6c44c3cbe86f7a06601d115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1b744484c41c88314112b572ccac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:15.973745 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-311ebd14-ca47-47ce-abed-114fea367a26 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:15.976696 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-311ebd14-ca47-47ce-abed-114fea367a26 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:15.983699 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-311ebd14-ca47-47ce-abed-114fea367a26 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1890 microversion: 2.42 time: 0.897096 Oct 23 01:22:15.984869 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1580/3125] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:22:15 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1890 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:22:15.985602 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8da3a842-6e50-43f2-809c-72c561c6a007 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] 10.222.0.42 "GET /compute/v2.1/servers/8e352f0d-c908-46b8-a28c-8704d0c92da6" status: 200 len: 1507 microversion: 2.1 time: 0.772788 Oct 23 01:22:15.989710 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7b9afe35-f51e-4d59-aaa9-619daa95621f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:15.990365 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7b9afe35-f51e-4d59-aaa9-619daa95621f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:16.003188 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1546/3126] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:15 2022] GET /compute/v2.1/servers/8e352f0d-c908-46b8-a28c-8704d0c92da6 => generated 1507 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:16.016527 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-eb7633d1-54b7-484c-b83c-c6c97f89110e req-0e593b84-1f5e-4cc6-8ecf-8862a85aac26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a64ad71-9caf-4645-be7a-b56f8f584c2d", "name": "network-vif-deleted", "tag": "40a2cfab-1f0a-4ac9-815e-ce16a0befa54"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:22:16.016739 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b9afe35-f51e-4d59-aaa9-619daa95621f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:16.017118 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b9afe35-f51e-4d59-aaa9-619daa95621f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:16.017573 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b9afe35-f51e-4d59-aaa9-619daa95621f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:16.018322 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b9afe35-f51e-4d59-aaa9-619daa95621f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:16.033044 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b9afe35-f51e-4d59-aaa9-619daa95621f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:16.033755 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b9afe35-f51e-4d59-aaa9-619daa95621f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:16.036578 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-eb7633d1-54b7-484c-b83c-c6c97f89110e req-0e593b84-1f5e-4cc6-8ecf-8862a85aac26 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:16.037322 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-eb7633d1-54b7-484c-b83c-c6c97f89110e req-0e593b84-1f5e-4cc6-8ecf-8862a85aac26 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:16.037910 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-eb7633d1-54b7-484c-b83c-c6c97f89110e req-0e593b84-1f5e-4cc6-8ecf-8862a85aac26 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:16.054069 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-eb7633d1-54b7-484c-b83c-c6c97f89110e req-0e593b84-1f5e-4cc6-8ecf-8862a85aac26 service nova] Creating event network-vif-deleted:40a2cfab-1f0a-4ac9-815e-ce16a0befa54 for instance 9a64ad71-9caf-4645-be7a-b56f8f584c2d on n-h2-master-1 Oct 23 01:22:16.061508 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-eb7633d1-54b7-484c-b83c-c6c97f89110e req-0e593b84-1f5e-4cc6-8ecf-8862a85aac26 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056854 Oct 23 01:22:16.062831 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1547/3127] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:22:16.070046 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ae40b1e0-7dca-40e5-b437-c00a5cba174d tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:16.070665 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ae40b1e0-7dca-40e5-b437-c00a5cba174d tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] [instance: 8e352f0d-c908-46b8-a28c-8704d0c92da6] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:16.080592 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ae40b1e0-7dca-40e5-b437-c00a5cba174d tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:16.081562 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ae40b1e0-7dca-40e5-b437-c00a5cba174d tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:16.082372 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ae40b1e0-7dca-40e5-b437-c00a5cba174d tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:16.083510 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ae40b1e0-7dca-40e5-b437-c00a5cba174d tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:16.084240 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ae40b1e0-7dca-40e5-b437-c00a5cba174d tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:16.084824 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ae40b1e0-7dca-40e5-b437-c00a5cba174d tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:16.149791 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ae40b1e0-7dca-40e5-b437-c00a5cba174d tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] [instance: 8e352f0d-c908-46b8-a28c-8704d0c92da6] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:22:16.588162 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7b9afe35-f51e-4d59-aaa9-619daa95621f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:16.597511 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7b9afe35-f51e-4d59-aaa9-619daa95621f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.611458 Oct 23 01:22:16.598529 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1581/3128] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:15 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:16.605081 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6d5fd870-5158-4dd4-8d61-033e913c5cb0 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:16.606069 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6d5fd870-5158-4dd4-8d61-033e913c5cb0 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 1842d55e-825b-4dc8-b3e4-d5eb8ab2b941] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:16.614923 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6d5fd870-5158-4dd4-8d61-033e913c5cb0 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:16.615558 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6d5fd870-5158-4dd4-8d61-033e913c5cb0 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:16.616100 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6d5fd870-5158-4dd4-8d61-033e913c5cb0 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:16.616918 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6d5fd870-5158-4dd4-8d61-033e913c5cb0 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:16.617496 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6d5fd870-5158-4dd4-8d61-033e913c5cb0 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:16.618077 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6d5fd870-5158-4dd4-8d61-033e913c5cb0 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:16.638258 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ae40b1e0-7dca-40e5-b437-c00a5cba174d tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8e352f0d-c908-46b8-a28c-8704d0c92da6" status: 204 len: 0 microversion: 2.1 time: 0.573801 Oct 23 01:22:16.639409 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1548/3129] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:22:16 2022] DELETE /compute/v2.1/servers/8e352f0d-c908-46b8-a28c-8704d0c92da6 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:22:16.656724 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-039edb91-c1fd-4d21-8f86-1aa350661d6d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:22:16.658014 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-039edb91-c1fd-4d21-8f86-1aa350661d6d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: ee4a8e3c-7fbb-404c-a958-de465f7765a0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:16.674533 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-039edb91-c1fd-4d21-8f86-1aa350661d6d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] HTTP exception thrown: Instance ee4a8e3c-7fbb-404c-a958-de465f7765a0 could not be found. Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-039edb91-c1fd-4d21-8f86-1aa350661d6d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Request method failure captured: Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/servers/ee4a8e3c-7fbb-404c-a958-de465f7765a0/action HTTP/1.1 Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 18 Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJZEAurAeILsYJek3MCv_ryiTbidOLVZq6W4I7jJxeY_1_bTWRye2xM3EDOhowd_NyioevvIvzT9beBCgKqri_ZjLw9hdsIISMXmajO_VmobATT_GwpY_Y-GVylQtV9MoF1-Bup_Ahjld_2riQHnDzqLUWULm2acZYcK9UIbslVsdDU Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}] Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: cd6a6c5240f94ace91e1f0ed3e53fa7c Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: {"unshelve": null} Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: exception: Instance ee4a8e3c-7fbb-404c-a958-de465f7765a0 could not be found. Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'ee4a8e3c-7fbb-404c-a958-de465f7765a0', 'body': {'unshelve': None}} Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee4a8e3c-7fbb-404c-a958-de465f7765a0 could not be found. Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee4a8e3c-7fbb-404c-a958-de465f7765a0 could not be found. Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:22:16.680844 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:22:16.686621 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:22:16.686621 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:22:16.686621 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:22:16.686621 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:22:16.686621 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:22:16.686621 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee4a8e3c-7fbb-404c-a958-de465f7765a0 could not be found. Oct 23 01:22:16.686621 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:22:16.688739 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-039edb91-c1fd-4d21-8f86-1aa350661d6d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Returning 404 to user: Instance ee4a8e3c-7fbb-404c-a958-de465f7765a0 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:22:16.689621 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-039edb91-c1fd-4d21-8f86-1aa350661d6d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "POST /compute/v2.1/servers/ee4a8e3c-7fbb-404c-a958-de465f7765a0/action" status: 404 len: 111 microversion: 2.1 time: 0.048919 Oct 23 01:22:16.690558 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1549/3130] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:22:16 2022] POST /compute/v2.1/servers/ee4a8e3c-7fbb-404c-a958-de465f7765a0/action => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:22:16.702478 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a66c539c-7e08-4c64-9866-70451a928d7e tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:16.702478 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a66c539c-7e08-4c64-9866-70451a928d7e tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] [instance: 05c1ab48-a6d9-464e-8c9f-69daf726e353] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:16.710562 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a66c539c-7e08-4c64-9866-70451a928d7e tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:16.711062 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a66c539c-7e08-4c64-9866-70451a928d7e tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:16.711501 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a66c539c-7e08-4c64-9866-70451a928d7e tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:16.712211 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a66c539c-7e08-4c64-9866-70451a928d7e tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:16.721871 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a66c539c-7e08-4c64-9866-70451a928d7e tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:16.724312 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a66c539c-7e08-4c64-9866-70451a928d7e tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:16.764780 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a66c539c-7e08-4c64-9866-70451a928d7e tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] [instance: 05c1ab48-a6d9-464e-8c9f-69daf726e353] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:22:16.822400 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6d5fd870-5158-4dd4-8d61-033e913c5cb0 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:16.836272 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6d5fd870-5158-4dd4-8d61-033e913c5cb0 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/1842d55e-825b-4dc8-b3e4-d5eb8ab2b941" status: 200 len: 1259 microversion: 2.1 time: 0.236257 Oct 23 01:22:16.838341 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1582/3131] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:16 2022] GET /compute/v2.1/servers/1842d55e-825b-4dc8-b3e4-d5eb8ab2b941 => generated 1259 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:16.847802 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ac4e7b2d-38de-4791-8f86-86febc6963f6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:16.849892 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ac4e7b2d-38de-4791-8f86-86febc6963f6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:16.859737 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac4e7b2d-38de-4791-8f86-86febc6963f6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:16.860768 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac4e7b2d-38de-4791-8f86-86febc6963f6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:16.861448 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac4e7b2d-38de-4791-8f86-86febc6963f6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:16.862581 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac4e7b2d-38de-4791-8f86-86febc6963f6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:16.863435 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac4e7b2d-38de-4791-8f86-86febc6963f6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:16.864413 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac4e7b2d-38de-4791-8f86-86febc6963f6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:17.121884 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a66c539c-7e08-4c64-9866-70451a928d7e tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] 10.222.0.42 "DELETE /compute/v2.1/servers/05c1ab48-a6d9-464e-8c9f-69daf726e353" status: 204 len: 0 microversion: 2.1 time: 0.429760 Oct 23 01:22:17.127670 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1550/3132] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:22:16 2022] DELETE /compute/v2.1/servers/05c1ab48-a6d9-464e-8c9f-69daf726e353 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:22:17.136072 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0637d329-f99f-47c9-b3ff-ea573a4927a2 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:17.137961 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0637d329-f99f-47c9-b3ff-ea573a4927a2 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:17.161060 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0637d329-f99f-47c9-b3ff-ea573a4927a2 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:17.163853 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0637d329-f99f-47c9-b3ff-ea573a4927a2 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:17.164495 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0637d329-f99f-47c9-b3ff-ea573a4927a2 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:17.166567 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0637d329-f99f-47c9-b3ff-ea573a4927a2 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:17.168338 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0637d329-f99f-47c9-b3ff-ea573a4927a2 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:17.170361 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0637d329-f99f-47c9-b3ff-ea573a4927a2 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:17.840826 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ac4e7b2d-38de-4791-8f86-86febc6963f6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:17.850684 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ac4e7b2d-38de-4791-8f86-86febc6963f6 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 1.010948 Oct 23 01:22:17.860423 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1583/3133] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:16 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:17.867187 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2e68e588-760e-4dd0-9723-758888b4d7fd tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-2115623349", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "adef91da-7c17-43a3-ab76-6f337732f444"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:22:17.985966 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-2e68e588-760e-4dd0-9723-758888b4d7fd tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] validate_networks() for [('adef91da-7c17-43a3-ab76-6f337732f444', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:22:18.077161 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0637d329-f99f-47c9-b3ff-ea573a4927a2 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:18.079977 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:22:18.089322 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0637d329-f99f-47c9-b3ff-ea573a4927a2 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:18.100379 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0637d329-f99f-47c9-b3ff-ea573a4927a2 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:18.101847 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0637d329-f99f-47c9-b3ff-ea573a4927a2 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1878 microversion: 2.42 time: 0.974061 Oct 23 01:22:18.102669 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1551/3134] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:22:17 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1878 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:22:18.109049 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-416ee4a2-61c7-40eb-be6a-fdfc74457742 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:18.126275 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-416ee4a2-61c7-40eb-be6a-fdfc74457742 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 1842d55e-825b-4dc8-b3e4-d5eb8ab2b941] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:18.130005 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-416ee4a2-61c7-40eb-be6a-fdfc74457742 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:18.130735 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-416ee4a2-61c7-40eb-be6a-fdfc74457742 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:18.131433 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-416ee4a2-61c7-40eb-be6a-fdfc74457742 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:18.132354 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-416ee4a2-61c7-40eb-be6a-fdfc74457742 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:18.142802 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-416ee4a2-61c7-40eb-be6a-fdfc74457742 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:18.143579 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-416ee4a2-61c7-40eb-be6a-fdfc74457742 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:18.753593 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-416ee4a2-61c7-40eb-be6a-fdfc74457742 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:18.762892 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-416ee4a2-61c7-40eb-be6a-fdfc74457742 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/1842d55e-825b-4dc8-b3e4-d5eb8ab2b941" status: 200 len: 1267 microversion: 2.1 time: 0.656165 Oct 23 01:22:18.762892 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1552/3135] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:18 2022] GET /compute/v2.1/servers/1842d55e-825b-4dc8-b3e4-d5eb8ab2b941 => generated 1267 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:18.796952 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2e661b15-1dc2-44f0-b0eb-be3bf35c7def tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:18.797605 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2e661b15-1dc2-44f0-b0eb-be3bf35c7def tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:18.810780 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:22:18.814800 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2e661b15-1dc2-44f0-b0eb-be3bf35c7def tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:18.815526 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2e661b15-1dc2-44f0-b0eb-be3bf35c7def tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:18.816195 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2e661b15-1dc2-44f0-b0eb-be3bf35c7def tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:18.817113 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2e661b15-1dc2-44f0-b0eb-be3bf35c7def tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:18.817774 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2e661b15-1dc2-44f0-b0eb-be3bf35c7def tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:18.821904 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2e661b15-1dc2-44f0-b0eb-be3bf35c7def tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:19.660638 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2e661b15-1dc2-44f0-b0eb-be3bf35c7def tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:19.669673 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2e661b15-1dc2-44f0-b0eb-be3bf35c7def tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.889552 Oct 23 01:22:19.670301 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1553/3136] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:18 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:19.685873 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-6994dcad-fc4c-44f3-8ac3-ce5dcad1ec8b req-0cb6666e-3591-4720-8c51-c4c450c05fb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "defa5fbb-f632-4ce7-8e07-e00f6f491d82", "tag": "3da8a6c9-ee04-43aa-bcd6-1059a44d5e18"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:22:19.702204 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-6994dcad-fc4c-44f3-8ac3-ce5dcad1ec8b req-0cb6666e-3591-4720-8c51-c4c450c05fb1 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:19.702939 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-6994dcad-fc4c-44f3-8ac3-ce5dcad1ec8b req-0cb6666e-3591-4720-8c51-c4c450c05fb1 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:19.703575 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-6994dcad-fc4c-44f3-8ac3-ce5dcad1ec8b req-0cb6666e-3591-4720-8c51-c4c450c05fb1 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:19.718287 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-6994dcad-fc4c-44f3-8ac3-ce5dcad1ec8b req-0cb6666e-3591-4720-8c51-c4c450c05fb1 service nova] Creating event network-changed:3da8a6c9-ee04-43aa-bcd6-1059a44d5e18 for instance defa5fbb-f632-4ce7-8e07-e00f6f491d82 on n-h2-master-1 Oct 23 01:22:19.724144 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-6994dcad-fc4c-44f3-8ac3-ce5dcad1ec8b req-0cb6666e-3591-4720-8c51-c4c450c05fb1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042343 Oct 23 01:22:19.725167 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1554/3137] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:22:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:22:19.733738 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-36a29de1-af16-42dc-be82-35e8e6c33676 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:19.733738 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-36a29de1-af16-42dc-be82-35e8e6c33676 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:19.747670 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36a29de1-af16-42dc-be82-35e8e6c33676 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:19.748606 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36a29de1-af16-42dc-be82-35e8e6c33676 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:19.749308 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36a29de1-af16-42dc-be82-35e8e6c33676 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:19.750280 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36a29de1-af16-42dc-be82-35e8e6c33676 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:19.752169 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36a29de1-af16-42dc-be82-35e8e6c33676 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:19.752898 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36a29de1-af16-42dc-be82-35e8e6c33676 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:20.509068 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-36a29de1-af16-42dc-be82-35e8e6c33676 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:20.524275 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-36a29de1-af16-42dc-be82-35e8e6c33676 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:20.526013 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-36a29de1-af16-42dc-be82-35e8e6c33676 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:20.527205 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-36a29de1-af16-42dc-be82-35e8e6c33676 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1878 microversion: 2.42 time: 0.800402 Oct 23 01:22:20.537552 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1555/3138] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:22:19 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1878 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:22:20.545345 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0130f97d-5dbd-499d-9600-38c888202363 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:22:20.545954 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0130f97d-5dbd-499d-9600-38c888202363 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:20.559449 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-2e68e588-760e-4dd0-9723-758888b4d7fd tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:22:20.559960 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-2e68e588-760e-4dd0-9723-758888b4d7fd tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:22:20.569103 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-2e68e588-760e-4dd0-9723-758888b4d7fd tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:22:20.569103 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-2e68e588-760e-4dd0-9723-758888b4d7fd tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:22:20.569103 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-2e68e588-760e-4dd0-9723-758888b4d7fd tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:22:20.577665 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0130f97d-5dbd-499d-9600-38c888202363 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:20.581838 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0130f97d-5dbd-499d-9600-38c888202363 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:20.584502 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0130f97d-5dbd-499d-9600-38c888202363 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:20.585507 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0130f97d-5dbd-499d-9600-38c888202363 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:20.586953 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e68e588-760e-4dd0-9723-758888b4d7fd tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:20.589110 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0130f97d-5dbd-499d-9600-38c888202363 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:20.589559 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0130f97d-5dbd-499d-9600-38c888202363 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:20.590393 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e68e588-760e-4dd0-9723-758888b4d7fd tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:20.590943 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e68e588-760e-4dd0-9723-758888b4d7fd tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:20.591807 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e68e588-760e-4dd0-9723-758888b4d7fd tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:20.596440 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e68e588-760e-4dd0-9723-758888b4d7fd tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:20.597003 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e68e588-760e-4dd0-9723-758888b4d7fd tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:20.652995 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-0130f97d-5dbd-499d-9600-38c888202363 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] HTTP exception thrown: Cannot 'unshelve' instance 62a8ad26-f65b-432d-a8da-48264c426335 while it is in vm_state active Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0130f97d-5dbd-499d-9600-38c888202363 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Request method failure captured: Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335/action HTTP/1.1 Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 18 Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJZEAurAeILsYJek3MCv_ryiTbidOLVZq6W4I7jJxeY_1_bTWRye2xM3EDOhowd_NyioevvIvzT9beBCgKqri_ZjLw9hdsIISMXmajO_VmobATT_GwpY_Y-GVylQtV9MoF1-Bup_Ahjld_2riQHnDzqLUWULm2acZYcK9UIbslVsdDU Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}] Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: cd6a6c5240f94ace91e1f0ed3e53fa7c Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: {"unshelve": null} Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: exception: Cannot 'unshelve' instance 62a8ad26-f65b-432d-a8da-48264c426335 while it is in vm_state active Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '62a8ad26-f65b-432d-a8da-48264c426335', 'body': {'unshelve': None}} Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 62a8ad26-f65b-432d-a8da-48264c426335 in vm_state active. Cannot unshelve while the instance is in this state. Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 23 01:22:20.660370 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 23 01:22:20.665484 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 62a8ad26-f65b-432d-a8da-48264c426335 while it is in vm_state active Oct 23 01:22:20.665484 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:22:20.665484 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:22:20.665484 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:22:20.665484 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:22:20.665484 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:22:20.665484 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:22:20.665484 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:22:20.665484 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:22:20.665484 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 62a8ad26-f65b-432d-a8da-48264c426335 while it is in vm_state active Oct 23 01:22:20.665484 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:22:20.669327 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-2e68e588-760e-4dd0-9723-758888b4d7fd tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Getting quotas for project 4ac1b744484c41c88314112b572ccac1. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:22:20.670312 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0130f97d-5dbd-499d-9600-38c888202363 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Returning 409 to user: Cannot 'unshelve' instance 62a8ad26-f65b-432d-a8da-48264c426335 while it is in vm_state active {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:22:20.671362 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0130f97d-5dbd-499d-9600-38c888202363 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "POST /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335/action" status: 409 len: 146 microversion: 2.1 time: 0.131682 Oct 23 01:22:20.672438 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1556/3139] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:22:20 2022] POST /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335/action => generated 146 bytes in 134 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:22:20.690913 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-2e68e588-760e-4dd0-9723-758888b4d7fd tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Getting quotas for user a3bede03a6c44c3cbe86f7a06601d115 and project 4ac1b744484c41c88314112b572ccac1. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:22:20.692956 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-18bc4a31-05ee-422c-819d-0edc50109159 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:20.699171 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-18bc4a31-05ee-422c-819d-0edc50109159 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 1842d55e-825b-4dc8-b3e4-d5eb8ab2b941] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:20.716121 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-18bc4a31-05ee-422c-819d-0edc50109159 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:20.717827 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-18bc4a31-05ee-422c-819d-0edc50109159 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:20.718503 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-18bc4a31-05ee-422c-819d-0edc50109159 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:20.719414 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-18bc4a31-05ee-422c-819d-0edc50109159 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:20.720263 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-18bc4a31-05ee-422c-819d-0edc50109159 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:20.729789 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2e68e588-760e-4dd0-9723-758888b4d7fd tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Going to run 2 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:22:20.733073 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-18bc4a31-05ee-422c-819d-0edc50109159 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:20.733254 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2e68e588-760e-4dd0-9723-758888b4d7fd tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] [instance: 3af7691f-0f59-4507-b9ea-17103f46c27e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:22:20.891140 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2e68e588-760e-4dd0-9723-758888b4d7fd tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] [instance: 98b17bd5-1bd0-4e2c-b17b-4964e7884942] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=3af7691f-0f59-4507-b9ea-17103f46c27e,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:22:20.991561 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-18bc4a31-05ee-422c-819d-0edc50109159 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:21.008427 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-18bc4a31-05ee-422c-819d-0edc50109159 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/1842d55e-825b-4dc8-b3e4-d5eb8ab2b941" status: 200 len: 1265 microversion: 2.1 time: 0.332467 Oct 23 01:22:21.009051 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1557/3140] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:20 2022] GET /compute/v2.1/servers/1842d55e-825b-4dc8-b3e4-d5eb8ab2b941 => generated 1265 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:21.013765 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2e68e588-760e-4dd0-9723-758888b4d7fd tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 3.152143 Oct 23 01:22:21.018783 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1584/3141] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:22:17 2022] POST /compute/v2.1/servers => generated 32 bytes in 3158 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 23 01:22:21.019791 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-94b2da26-8cfc-4025-98b4-6f686c0d30b7 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:21.022947 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-94b2da26-8cfc-4025-98b4-6f686c0d30b7 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:21.027238 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-33874bd2-9361-467a-a54c-80458481d511 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:21.033951 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-33874bd2-9361-467a-a54c-80458481d511 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a3bede03a6c44c3cbe86f7a06601d115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1b744484c41c88314112b572ccac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:21.035188 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-33874bd2-9361-467a-a54c-80458481d511 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Searching by: {'deleted': False, 'project_id': '4ac1b744484c41c88314112b572ccac1'} {{(pid=120944) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 23 01:22:21.038398 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94b2da26-8cfc-4025-98b4-6f686c0d30b7 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:21.058090 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-33874bd2-9361-467a-a54c-80458481d511 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:21.058689 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-33874bd2-9361-467a-a54c-80458481d511 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:21.059199 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-33874bd2-9361-467a-a54c-80458481d511 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:21.060032 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-33874bd2-9361-467a-a54c-80458481d511 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:21.060591 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-33874bd2-9361-467a-a54c-80458481d511 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:21.061262 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-33874bd2-9361-467a-a54c-80458481d511 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:21.067812 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94b2da26-8cfc-4025-98b4-6f686c0d30b7 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:21.069454 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94b2da26-8cfc-4025-98b4-6f686c0d30b7 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:21.070743 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94b2da26-8cfc-4025-98b4-6f686c0d30b7 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:21.070743 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94b2da26-8cfc-4025-98b4-6f686c0d30b7 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:21.071198 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94b2da26-8cfc-4025-98b4-6f686c0d30b7 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:21.098576 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.multi_cell_list [None req-33874bd2-9361-467a-a54c-80458481d511 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=120944) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 23 01:22:21.133257 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-33874bd2-9361-467a-a54c-80458481d511 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.112919 Oct 23 01:22:21.143244 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1585/3142] 10.222.0.42 () {58 vars in 1125 bytes} [Sun Oct 23 01:22:21 2022] GET /compute/v2.1/servers => generated 1335 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:21.151014 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cd77ec51-a739-4dfe-885e-99bddea9f26c tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:21.151910 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-cd77ec51-a739-4dfe-885e-99bddea9f26c tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] [instance: 98b17bd5-1bd0-4e2c-b17b-4964e7884942] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:21.276899 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cd77ec51-a739-4dfe-885e-99bddea9f26c tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bede03a6c44c3cbe86f7a06601d115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1b744484c41c88314112b572ccac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:21.288059 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cd77ec51-a739-4dfe-885e-99bddea9f26c tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] 10.222.0.42 "GET /compute/v2.1/servers/98b17bd5-1bd0-4e2c-b17b-4964e7884942" status: 200 len: 1218 microversion: 2.1 time: 0.142680 Oct 23 01:22:21.289746 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1586/3143] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:21 2022] GET /compute/v2.1/servers/98b17bd5-1bd0-4e2c-b17b-4964e7884942 => generated 1218 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:21.557686 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3ec5897f-a582-42b5-8db8-e32421048f0e tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:21.558565 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3ec5897f-a582-42b5-8db8-e32421048f0e tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:21.578652 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3ec5897f-a582-42b5-8db8-e32421048f0e tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:21.579842 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3ec5897f-a582-42b5-8db8-e32421048f0e tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:21.580474 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3ec5897f-a582-42b5-8db8-e32421048f0e tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:21.581386 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3ec5897f-a582-42b5-8db8-e32421048f0e tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:21.582066 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3ec5897f-a582-42b5-8db8-e32421048f0e tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:21.582682 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3ec5897f-a582-42b5-8db8-e32421048f0e tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:21.682344 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-94b2da26-8cfc-4025-98b4-6f686c0d30b7 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:21.707263 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-94b2da26-8cfc-4025-98b4-6f686c0d30b7 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.693623 Oct 23 01:22:21.715132 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1558/3144] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:21 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:21.780246 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c43be707-aa70-4793-a101-167e675705a9 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:21.780246 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c43be707-aa70-4793-a101-167e675705a9 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:21.817057 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c43be707-aa70-4793-a101-167e675705a9 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:21.820302 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c43be707-aa70-4793-a101-167e675705a9 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:21.823869 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c43be707-aa70-4793-a101-167e675705a9 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:21.830698 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c43be707-aa70-4793-a101-167e675705a9 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:21.832264 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c43be707-aa70-4793-a101-167e675705a9 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:21.833017 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c43be707-aa70-4793-a101-167e675705a9 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:23.143927 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3ec5897f-a582-42b5-8db8-e32421048f0e tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:23.164303 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3ec5897f-a582-42b5-8db8-e32421048f0e tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:23.170327 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3ec5897f-a582-42b5-8db8-e32421048f0e tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:23.171681 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3ec5897f-a582-42b5-8db8-e32421048f0e tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1878 microversion: 2.42 time: 1.618765 Oct 23 01:22:23.218866 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1587/3145] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:22:21 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1878 bytes in 1666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:22:23.233401 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-07ce7b66-d332-40ba-87d9-277acaf31c60 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:23.237141 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-07ce7b66-d332-40ba-87d9-277acaf31c60 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 1842d55e-825b-4dc8-b3e4-d5eb8ab2b941] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:23.251268 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07ce7b66-d332-40ba-87d9-277acaf31c60 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:23.251843 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07ce7b66-d332-40ba-87d9-277acaf31c60 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:23.252296 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07ce7b66-d332-40ba-87d9-277acaf31c60 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:23.253015 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07ce7b66-d332-40ba-87d9-277acaf31c60 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:23.258544 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07ce7b66-d332-40ba-87d9-277acaf31c60 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:23.259018 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07ce7b66-d332-40ba-87d9-277acaf31c60 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:23.464464 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:22:23.501547 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c43be707-aa70-4793-a101-167e675705a9 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:23.523779 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c43be707-aa70-4793-a101-167e675705a9 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 1.761959 Oct 23 01:22:23.549335 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1559/3146] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:21 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 1810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:23.563722 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a17cd424-4a1f-4514-9055-d15dc56fc9be tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:23.566860 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a17cd424-4a1f-4514-9055-d15dc56fc9be tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] [instance: 98b17bd5-1bd0-4e2c-b17b-4964e7884942] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:23.737938 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a17cd424-4a1f-4514-9055-d15dc56fc9be tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bede03a6c44c3cbe86f7a06601d115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1b744484c41c88314112b572ccac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:23.754362 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a17cd424-4a1f-4514-9055-d15dc56fc9be tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] 10.222.0.42 "GET /compute/v2.1/servers/98b17bd5-1bd0-4e2c-b17b-4964e7884942" status: 200 len: 1218 microversion: 2.1 time: 0.203610 Oct 23 01:22:23.763180 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1560/3147] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:23 2022] GET /compute/v2.1/servers/98b17bd5-1bd0-4e2c-b17b-4964e7884942 => generated 1218 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:23.780486 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-31233502-d9ad-4a9f-96bd-1f96295993a8 req-9cc17211-8f24-4464-8465-c1b7e0f479f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05c1ab48-a6d9-464e-8c9f-69daf726e353", "name": "network-vif-deleted", "tag": "6a552298-cbe9-405d-a6ea-1aae20a7bf7b"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:22:23.833054 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-07ce7b66-d332-40ba-87d9-277acaf31c60 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:23.860672 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-07ce7b66-d332-40ba-87d9-277acaf31c60 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/1842d55e-825b-4dc8-b3e4-d5eb8ab2b941" status: 200 len: 1307 microversion: 2.1 time: 0.637690 Oct 23 01:22:23.874992 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1588/3148] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:23 2022] GET /compute/v2.1/servers/1842d55e-825b-4dc8-b3e4-d5eb8ab2b941 => generated 1307 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:23.884887 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-31233502-d9ad-4a9f-96bd-1f96295993a8 req-9cc17211-8f24-4464-8465-c1b7e0f479f2 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:23.884887 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-31233502-d9ad-4a9f-96bd-1f96295993a8 req-9cc17211-8f24-4464-8465-c1b7e0f479f2 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.045s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:23.887980 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-bbe149ad-be87-49ae-9d6f-0de9866904f3 req-141141cd-c0c3-42f0-a6cf-a447d0541641 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e352f0d-c908-46b8-a28c-8704d0c92da6", "name": "network-vif-deleted", "tag": "b462ddd0-60bd-4ba7-8465-936cb863b316"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:22:23.888467 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-31233502-d9ad-4a9f-96bd-1f96295993a8 req-9cc17211-8f24-4464-8465-c1b7e0f479f2 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:23.923898 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-bbe149ad-be87-49ae-9d6f-0de9866904f3 req-141141cd-c0c3-42f0-a6cf-a447d0541641 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:23.925187 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-bbe149ad-be87-49ae-9d6f-0de9866904f3 req-141141cd-c0c3-42f0-a6cf-a447d0541641 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:23.927561 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-bbe149ad-be87-49ae-9d6f-0de9866904f3 req-141141cd-c0c3-42f0-a6cf-a447d0541641 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:23.968387 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-bbe149ad-be87-49ae-9d6f-0de9866904f3 req-141141cd-c0c3-42f0-a6cf-a447d0541641 service nova] Creating event network-vif-deleted:b462ddd0-60bd-4ba7-8465-936cb863b316 for instance 8e352f0d-c908-46b8-a28c-8704d0c92da6 on n-h2-master-1 Oct 23 01:22:23.981426 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-bbe149ad-be87-49ae-9d6f-0de9866904f3 req-141141cd-c0c3-42f0-a6cf-a447d0541641 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102626 Oct 23 01:22:23.988044 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-31233502-d9ad-4a9f-96bd-1f96295993a8 req-9cc17211-8f24-4464-8465-c1b7e0f479f2 service nova] Creating event network-vif-deleted:6a552298-cbe9-405d-a6ea-1aae20a7bf7b for instance 05c1ab48-a6d9-464e-8c9f-69daf726e353 on n-h1-master-1 Oct 23 01:22:23.990371 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1589/3149] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:22:24.000628 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-31233502-d9ad-4a9f-96bd-1f96295993a8 req-9cc17211-8f24-4464-8465-c1b7e0f479f2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.234627 Oct 23 01:22:24.004950 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1561/3150] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:22:24.017432 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c48081d3-9530-4f2a-b38b-51f4857cecdf tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-374049321_updated"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:22:24.020069 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c48081d3-9530-4f2a-b38b-51f4857cecdf tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: c1a5b7b7-fa67-41c4-ae46-179d4a5ad03e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:24.044508 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-c48081d3-9530-4f2a-b38b-51f4857cecdf tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] HTTP exception thrown: Instance c1a5b7b7-fa67-41c4-ae46-179d4a5ad03e could not be found. Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c48081d3-9530-4f2a-b38b-51f4857cecdf tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Request method failure captured: Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: request: PUT /compute/v2.1/servers/c1a5b7b7-fa67-41c4-ae46-179d4a5ad03e HTTP/1.1 Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 80 Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJZEAurAeILsYJek3MCv_ryiTbidOLVZq6W4I7jJxeY_1_bTWRye2xM3EDOhowd_NyioevvIvzT9beBCgKqri_ZjLw9hdsIISMXmajO_VmobATT_GwpY_Y-GVylQtV9MoF1-Bup_Ahjld_2riQHnDzqLUWULm2acZYcK9UIbslVsdDU Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}] Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: cd6a6c5240f94ace91e1f0ed3e53fa7c Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-374049321_updated"}} Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: exception: Instance c1a5b7b7-fa67-41c4-ae46-179d4a5ad03e could not be found. Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'c1a5b7b7-fa67-41c4-ae46-179d4a5ad03e', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-374049321_updated'}}} Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1a5b7b7-fa67-41c4-ae46-179d4a5ad03e could not be found. Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 23 01:22:24.046383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:22:24.051946 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:22:24.051946 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:22:24.051946 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:22:24.051946 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1a5b7b7-fa67-41c4-ae46-179d4a5ad03e could not be found. Oct 23 01:22:24.051946 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:22:24.051946 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:22:24.051946 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:22:24.051946 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:22:24.051946 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:22:24.051946 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:22:24.051946 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:22:24.051946 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:22:24.051946 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1a5b7b7-fa67-41c4-ae46-179d4a5ad03e could not be found. Oct 23 01:22:24.051946 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:22:24.051946 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c48081d3-9530-4f2a-b38b-51f4857cecdf tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Returning 404 to user: Instance c1a5b7b7-fa67-41c4-ae46-179d4a5ad03e could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:22:24.051946 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c48081d3-9530-4f2a-b38b-51f4857cecdf tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "PUT /compute/v2.1/servers/c1a5b7b7-fa67-41c4-ae46-179d4a5ad03e" status: 404 len: 111 microversion: 2.1 time: 0.054262 Oct 23 01:22:24.051946 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1590/3151] 10.222.0.42 () {60 vars in 1256 bytes} [Sun Oct 23 01:22:23 2022] PUT /compute/v2.1/servers/c1a5b7b7-fa67-41c4-ae46-179d4a5ad03e => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:22:24.058882 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-60a9576a-a54a-4f53-81a7-f51c9f1796ac tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:24.059895 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-60a9576a-a54a-4f53-81a7-f51c9f1796ac tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:24.075246 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-60a9576a-a54a-4f53-81a7-f51c9f1796ac tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:24.075929 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-60a9576a-a54a-4f53-81a7-f51c9f1796ac tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:24.076479 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-60a9576a-a54a-4f53-81a7-f51c9f1796ac tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:24.077492 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-60a9576a-a54a-4f53-81a7-f51c9f1796ac tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:24.078722 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-60a9576a-a54a-4f53-81a7-f51c9f1796ac tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:24.080249 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-60a9576a-a54a-4f53-81a7-f51c9f1796ac tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:24.213429 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6d7ef531-22cd-4b16-8d29-fd62267bf331 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:24.214824 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6d7ef531-22cd-4b16-8d29-fd62267bf331 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:24.229153 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6d7ef531-22cd-4b16-8d29-fd62267bf331 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:24.229949 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6d7ef531-22cd-4b16-8d29-fd62267bf331 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:24.230923 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6d7ef531-22cd-4b16-8d29-fd62267bf331 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:24.231938 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6d7ef531-22cd-4b16-8d29-fd62267bf331 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:24.235412 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6d7ef531-22cd-4b16-8d29-fd62267bf331 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:24.239530 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6d7ef531-22cd-4b16-8d29-fd62267bf331 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:25.068349 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-60a9576a-a54a-4f53-81a7-f51c9f1796ac tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:25.081273 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-60a9576a-a54a-4f53-81a7-f51c9f1796ac tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 1.028280 Oct 23 01:22:25.081906 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1562/3152] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:24 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:25.123351 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6d7ef531-22cd-4b16-8d29-fd62267bf331 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:25.140327 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6d7ef531-22cd-4b16-8d29-fd62267bf331 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:25.146799 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6d7ef531-22cd-4b16-8d29-fd62267bf331 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:25.149950 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6d7ef531-22cd-4b16-8d29-fd62267bf331 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1878 microversion: 2.42 time: 0.940961 Oct 23 01:22:25.153320 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1591/3153] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:22:24 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1878 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:22:25.159260 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8884c1bd-97bd-4079-90a9-8d9452271256 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:25.161582 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8884c1bd-97bd-4079-90a9-8d9452271256 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] [instance: 98b17bd5-1bd0-4e2c-b17b-4964e7884942] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:25.176248 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8884c1bd-97bd-4079-90a9-8d9452271256 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:25.180365 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8884c1bd-97bd-4079-90a9-8d9452271256 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:25.181683 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8884c1bd-97bd-4079-90a9-8d9452271256 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:25.184268 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8884c1bd-97bd-4079-90a9-8d9452271256 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:25.184965 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8884c1bd-97bd-4079-90a9-8d9452271256 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:25.188700 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8884c1bd-97bd-4079-90a9-8d9452271256 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:25.251035 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=100 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:22:25.325226 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8884c1bd-97bd-4079-90a9-8d9452271256 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bede03a6c44c3cbe86f7a06601d115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1b744484c41c88314112b572ccac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:25.338143 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8884c1bd-97bd-4079-90a9-8d9452271256 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] 10.222.0.42 "GET /compute/v2.1/servers/98b17bd5-1bd0-4e2c-b17b-4964e7884942" status: 200 len: 1214 microversion: 2.1 time: 0.181041 Oct 23 01:22:25.339546 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1592/3154] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:25 2022] GET /compute/v2.1/servers/98b17bd5-1bd0-4e2c-b17b-4964e7884942 => generated 1214 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:25.348654 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-17f326a2-feae-4762-b155-be6536647964 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:25.351209 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-17f326a2-feae-4762-b155-be6536647964 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 1842d55e-825b-4dc8-b3e4-d5eb8ab2b941] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:25.363124 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-17f326a2-feae-4762-b155-be6536647964 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:25.364932 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-17f326a2-feae-4762-b155-be6536647964 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:25.366521 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-17f326a2-feae-4762-b155-be6536647964 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:25.368254 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-17f326a2-feae-4762-b155-be6536647964 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:25.370583 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-17f326a2-feae-4762-b155-be6536647964 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:25.373767 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-17f326a2-feae-4762-b155-be6536647964 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:25.575232 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0d152983-72f4-45c8-9944-72d63949d547 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-872912639", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:22:25.718195 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-0d152983-72f4-45c8-9944-72d63949d547 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] validate_networks() for [('5e0c2166-5c86-44c0-95de-006225def5a5', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:22:25.942467 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-17f326a2-feae-4762-b155-be6536647964 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:25.961872 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-17f326a2-feae-4762-b155-be6536647964 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/1842d55e-825b-4dc8-b3e4-d5eb8ab2b941" status: 200 len: 1307 microversion: 2.1 time: 0.620656 Oct 23 01:22:25.964455 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1593/3155] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:25 2022] GET /compute/v2.1/servers/1842d55e-825b-4dc8-b3e4-d5eb8ab2b941 => generated 1307 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:25.973643 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e9ab7ee4-0cc0-4741-b5c7-25731bce93b7 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:25.974636 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e9ab7ee4-0cc0-4741-b5c7-25731bce93b7 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:25.985079 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9ab7ee4-0cc0-4741-b5c7-25731bce93b7 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:25.987043 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9ab7ee4-0cc0-4741-b5c7-25731bce93b7 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:25.987729 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9ab7ee4-0cc0-4741-b5c7-25731bce93b7 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:25.992754 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9ab7ee4-0cc0-4741-b5c7-25731bce93b7 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:25.994258 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9ab7ee4-0cc0-4741-b5c7-25731bce93b7 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:25.994874 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9ab7ee4-0cc0-4741-b5c7-25731bce93b7 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:26.838293 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e9ab7ee4-0cc0-4741-b5c7-25731bce93b7 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:26.850453 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e9ab7ee4-0cc0-4741-b5c7-25731bce93b7 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 0.884629 Oct 23 01:22:26.857732 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1594/3156] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:25 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:26.875666 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fbc1655c-0086-40e6-adc2-22a4463fbe8f tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:26.876713 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fbc1655c-0086-40e6-adc2-22a4463fbe8f tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:26.897094 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fbc1655c-0086-40e6-adc2-22a4463fbe8f tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:26.898930 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fbc1655c-0086-40e6-adc2-22a4463fbe8f tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:26.918288 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fbc1655c-0086-40e6-adc2-22a4463fbe8f tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:26.919212 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fbc1655c-0086-40e6-adc2-22a4463fbe8f tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:26.922789 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fbc1655c-0086-40e6-adc2-22a4463fbe8f tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:26.929086 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fbc1655c-0086-40e6-adc2-22a4463fbe8f tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:27.787632 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-0d152983-72f4-45c8-9944-72d63949d547 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:22:27.788168 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-0d152983-72f4-45c8-9944-72d63949d547 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:22:27.788521 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-0d152983-72f4-45c8-9944-72d63949d547 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:22:27.788931 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-0d152983-72f4-45c8-9944-72d63949d547 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:22:27.789345 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-0d152983-72f4-45c8-9944-72d63949d547 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:22:27.812353 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d152983-72f4-45c8-9944-72d63949d547 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:27.812935 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d152983-72f4-45c8-9944-72d63949d547 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:27.813534 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d152983-72f4-45c8-9944-72d63949d547 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:27.814572 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d152983-72f4-45c8-9944-72d63949d547 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:27.815205 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d152983-72f4-45c8-9944-72d63949d547 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:27.815825 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d152983-72f4-45c8-9944-72d63949d547 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:27.849721 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-0d152983-72f4-45c8-9944-72d63949d547 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Getting quotas for project 4c25b4509ad7457bad4a2e5e0bc59add. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:22:27.858058 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-0d152983-72f4-45c8-9944-72d63949d547 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Getting quotas for user 19bff9f7a4254110b3b89f0cba5d252f and project 4c25b4509ad7457bad4a2e5e0bc59add. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:22:27.877531 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0d152983-72f4-45c8-9944-72d63949d547 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:22:27.880990 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0d152983-72f4-45c8-9944-72d63949d547 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 3d9196f6-d696-45e0-b7fc-8d1557498393] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:22:28.075621 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0d152983-72f4-45c8-9944-72d63949d547 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.992566 Oct 23 01:22:28.077206 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1563/3157] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:22:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 2994 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:22:28.088961 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-19c7e7fe-fde0-4531-a7de-4d110f1ba142 req-886eada4-9444-4a05-b784-6379e0580d2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "defa5fbb-f632-4ce7-8e07-e00f6f491d82", "tag": "69d49907-1f64-490d-b949-d616f69931f1"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:22:28.121526 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fbc1655c-0086-40e6-adc2-22a4463fbe8f tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:28.141026 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fbc1655c-0086-40e6-adc2-22a4463fbe8f tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:28.145032 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-19c7e7fe-fde0-4531-a7de-4d110f1ba142 req-886eada4-9444-4a05-b784-6379e0580d2b service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:28.145525 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-19c7e7fe-fde0-4531-a7de-4d110f1ba142 req-886eada4-9444-4a05-b784-6379e0580d2b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:28.149282 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fbc1655c-0086-40e6-adc2-22a4463fbe8f tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:28.150184 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-19c7e7fe-fde0-4531-a7de-4d110f1ba142 req-886eada4-9444-4a05-b784-6379e0580d2b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:28.154743 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fbc1655c-0086-40e6-adc2-22a4463fbe8f tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1878 microversion: 2.42 time: 1.292706 Oct 23 01:22:28.155352 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1595/3158] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:22:26 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1878 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:22:28.176571 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-48c041a1-cb2b-4254-ba96-8bf831ceffc2 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:28.179457 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-48c041a1-cb2b-4254-ba96-8bf831ceffc2 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] [instance: 98b17bd5-1bd0-4e2c-b17b-4964e7884942] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:28.189403 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-19c7e7fe-fde0-4531-a7de-4d110f1ba142 req-886eada4-9444-4a05-b784-6379e0580d2b service nova] Creating event network-changed:69d49907-1f64-490d-b949-d616f69931f1 for instance defa5fbb-f632-4ce7-8e07-e00f6f491d82 on n-h2-master-1 Oct 23 01:22:28.195857 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-48c041a1-cb2b-4254-ba96-8bf831ceffc2 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:28.196362 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-48c041a1-cb2b-4254-ba96-8bf831ceffc2 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:28.196829 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-48c041a1-cb2b-4254-ba96-8bf831ceffc2 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:28.198742 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-48c041a1-cb2b-4254-ba96-8bf831ceffc2 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:28.200587 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-19c7e7fe-fde0-4531-a7de-4d110f1ba142 req-886eada4-9444-4a05-b784-6379e0580d2b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121515 Oct 23 01:22:28.201249 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-48c041a1-cb2b-4254-ba96-8bf831ceffc2 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:28.201870 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-48c041a1-cb2b-4254-ba96-8bf831ceffc2 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:28.205069 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1564/3159] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:22:28.222343 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-44e98e6d-9b73-4fe3-8712-686d91a259ef tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:22:28.236284 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-44e98e6d-9b73-4fe3-8712-686d91a259ef tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Request method failure captured: Oct 23 01:22:28.236284 n-d-master-1 devstack@n-api.service[120945]: request: PUT /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 HTTP/1.1 Oct 23 01:22:28.236284 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:22:28.236284 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:22:28.236284 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:22:28.236284 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 280 Oct 23 01:22:28.236284 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:22:28.236284 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:22:28.236284 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:22:28.236284 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:22:28.236284 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJZEAurAeILsYJek3MCv_ryiTbidOLVZq6W4I7jJxeY_1_bTWRye2xM3EDOhowd_NyioevvIvzT9beBCgKqri_ZjLw9hdsIISMXmajO_VmobATT_GwpY_Y-GVylQtV9MoF1-Bup_Ahjld_2riQHnDzqLUWULm2acZYcK9UIbslVsdDU Oct 23 01:22:28.236284 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:22:28.236284 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:22:28.236284 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:22:28.236284 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:22:28.236284 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:22:28.236284 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:22:28.236284 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:22:28.236284 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:22:28.236284 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:22:28.236284 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:22:28.236284 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}] Oct 23 01:22:28.236284 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:22:28.236284 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:22:28.236284 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:22:28.236284 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:22:28.236284 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:22:28.236284 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:22:28.236284 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: cd6a6c5240f94ace91e1f0ed3e53fa7c Oct 23 01:22:28.236284 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:22:28.236284 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:22:28.236284 n-d-master-1 devstack@n-api.service[120945]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 23 01:22:28.236284 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:22:28.236284 n-d-master-1 devstack@n-api.service[120945]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 23 01:22:28.236284 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '62a8ad26-f65b-432d-a8da-48264c426335', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 23 01:22:28.236284 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:22:28.236284 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:22:28.236284 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 23 01:22:28.236284 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 23 01:22:28.236284 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 01:22:28.236284 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise error Oct 23 01:22:28.236284 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 23 01:22:28.236284 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:22:28.236284 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 23 01:22:28.236284 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 23 01:22:28.236284 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:22:28.236284 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 23 01:22:28.236284 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 23 01:22:28.236284 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:22:28.236284 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:22:28.236284 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:22:28.236284 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:22:28.241459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:22:28.241459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:22:28.241459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:22:28.241459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:22:28.241459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:22:28.241459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:22:28.241459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:22:28.241459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:22:28.241459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 23 01:22:28.241459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 23 01:22:28.241459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 23 01:22:28.241459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 23 01:22:28.241459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 23 01:22:28.241459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 23 01:22:28.241459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 23 01:22:28.241459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:22:28.241459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:22:28.241459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:22:28.241459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:22:28.241459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:22:28.241459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:22:28.241459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 23 01:22:28.241459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 23 01:22:28.241459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 23 01:22:28.241459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:22:28.241459 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-44e98e6d-9b73-4fe3-8712-686d91a259ef tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:22:28.241459 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-44e98e6d-9b73-4fe3-8712-686d91a259ef tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "PUT /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 400 len: 619 microversion: 2.1 time: 0.030862 Oct 23 01:22:28.247529 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1565/3160] 10.222.0.42 () {60 vars in 1257 bytes} [Sun Oct 23 01:22:28 2022] PUT /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 619 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:22:28.260271 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f3ebe4d1-3eb1-453e-ae4d-cd86803473dd tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:28.264833 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f3ebe4d1-3eb1-453e-ae4d-cd86803473dd tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 1842d55e-825b-4dc8-b3e4-d5eb8ab2b941] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:28.281811 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f3ebe4d1-3eb1-453e-ae4d-cd86803473dd tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:28.283691 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f3ebe4d1-3eb1-453e-ae4d-cd86803473dd tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:28.294560 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f3ebe4d1-3eb1-453e-ae4d-cd86803473dd tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:28.294560 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f3ebe4d1-3eb1-453e-ae4d-cd86803473dd tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:28.294560 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f3ebe4d1-3eb1-453e-ae4d-cd86803473dd tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:28.294560 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f3ebe4d1-3eb1-453e-ae4d-cd86803473dd tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:29.736935 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f3ebe4d1-3eb1-453e-ae4d-cd86803473dd tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:29.761453 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f3ebe4d1-3eb1-453e-ae4d-cd86803473dd tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/1842d55e-825b-4dc8-b3e4-d5eb8ab2b941" status: 200 len: 1307 microversion: 2.1 time: 1.517821 Oct 23 01:22:29.763863 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1566/3161] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:28 2022] GET /compute/v2.1/servers/1842d55e-825b-4dc8-b3e4-d5eb8ab2b941 => generated 1307 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:29.771849 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-d7026483-f8c5-43fa-bf83-56863c42dfe4 req-1b5ff760-49b4-4fc3-a4c4-22608a60760d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1842d55e-825b-4dc8-b3e4-d5eb8ab2b941", "tag": "fdb229eb-24a1-4e18-afed-ef66e8ce931d"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:22:29.799227 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-d7026483-f8c5-43fa-bf83-56863c42dfe4 req-1b5ff760-49b4-4fc3-a4c4-22608a60760d service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:29.799714 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-d7026483-f8c5-43fa-bf83-56863c42dfe4 req-1b5ff760-49b4-4fc3-a4c4-22608a60760d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:29.801268 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-d7026483-f8c5-43fa-bf83-56863c42dfe4 req-1b5ff760-49b4-4fc3-a4c4-22608a60760d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:29.838596 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-d7026483-f8c5-43fa-bf83-56863c42dfe4 req-1b5ff760-49b4-4fc3-a4c4-22608a60760d service nova] Creating event network-changed:fdb229eb-24a1-4e18-afed-ef66e8ce931d for instance 1842d55e-825b-4dc8-b3e4-d5eb8ab2b941 on n-h1-master-1 Oct 23 01:22:29.857710 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-d7026483-f8c5-43fa-bf83-56863c42dfe4 req-1b5ff760-49b4-4fc3-a4c4-22608a60760d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090984 Oct 23 01:22:29.860554 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1567/3162] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:22:29.881478 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-be1af1f6-b6bd-4eed-bda6-430f8ca82f10 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:29.883159 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-be1af1f6-b6bd-4eed-bda6-430f8ca82f10 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 3d9196f6-d696-45e0-b7fc-8d1557498393] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:29.896328 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-be1af1f6-b6bd-4eed-bda6-430f8ca82f10 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:29.901662 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-be1af1f6-b6bd-4eed-bda6-430f8ca82f10 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:29.903035 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-be1af1f6-b6bd-4eed-bda6-430f8ca82f10 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:29.905386 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-be1af1f6-b6bd-4eed-bda6-430f8ca82f10 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:29.905856 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-be1af1f6-b6bd-4eed-bda6-430f8ca82f10 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:29.906321 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-be1af1f6-b6bd-4eed-bda6-430f8ca82f10 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:29.950721 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-48c041a1-cb2b-4254-ba96-8bf831ceffc2 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bede03a6c44c3cbe86f7a06601d115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1b744484c41c88314112b572ccac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:29.964577 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-48c041a1-cb2b-4254-ba96-8bf831ceffc2 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] 10.222.0.42 "GET /compute/v2.1/servers/98b17bd5-1bd0-4e2c-b17b-4964e7884942" status: 200 len: 1318 microversion: 2.1 time: 1.804050 Oct 23 01:22:29.969615 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1596/3163] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:28 2022] GET /compute/v2.1/servers/98b17bd5-1bd0-4e2c-b17b-4964e7884942 => generated 1318 bytes in 1812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:29.982938 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d65637b9-88f6-4ce3-bb53-f3704ee4fc8b tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:29.986402 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d65637b9-88f6-4ce3-bb53-f3704ee4fc8b tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:30.023394 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d65637b9-88f6-4ce3-bb53-f3704ee4fc8b tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:30.026112 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d65637b9-88f6-4ce3-bb53-f3704ee4fc8b tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:30.029050 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d65637b9-88f6-4ce3-bb53-f3704ee4fc8b tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:30.033132 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d65637b9-88f6-4ce3-bb53-f3704ee4fc8b tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:30.036533 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d65637b9-88f6-4ce3-bb53-f3704ee4fc8b tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:30.042203 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d65637b9-88f6-4ce3-bb53-f3704ee4fc8b tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:30.106476 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-be1af1f6-b6bd-4eed-bda6-430f8ca82f10 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:30.122300 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-be1af1f6-b6bd-4eed-bda6-430f8ca82f10 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393" status: 200 len: 1225 microversion: 2.1 time: 0.257840 Oct 23 01:22:30.123094 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1568/3164] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:29 2022] GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393 => generated 1225 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:30.153476 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-90c01291-0be0-455d-a0c8-59b18b617ba6 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:30.161853 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-90c01291-0be0-455d-a0c8-59b18b617ba6 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:30.176198 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-90c01291-0be0-455d-a0c8-59b18b617ba6 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:30.176695 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-90c01291-0be0-455d-a0c8-59b18b617ba6 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:30.177131 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-90c01291-0be0-455d-a0c8-59b18b617ba6 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:30.177884 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-90c01291-0be0-455d-a0c8-59b18b617ba6 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:30.182431 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-90c01291-0be0-455d-a0c8-59b18b617ba6 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:30.182791 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-90c01291-0be0-455d-a0c8-59b18b617ba6 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:31.076946 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=4 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:22:31.118171 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-90c01291-0be0-455d-a0c8-59b18b617ba6 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:31.133313 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-90c01291-0be0-455d-a0c8-59b18b617ba6 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:31.135483 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-90c01291-0be0-455d-a0c8-59b18b617ba6 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:31.142415 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-90c01291-0be0-455d-a0c8-59b18b617ba6 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1878 microversion: 2.42 time: 1.016104 Oct 23 01:22:31.143111 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1569/3165] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:22:30 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1878 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:22:31.285941 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=8 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:22:31.458662 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3a28adc8-10eb-4fb3-88e0-3f5094c32cce tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Action: 'create', calling method: .version_select at 0x7f5cc1821670>, body: {"keypair": {"name": "tempest-keypair-1120500951", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeZ2lOCTBXJcFp1NaMIhKDwjokruZx4n7EbXiVJ5Sq0zyI6Z9fbf0/CvrphS93i70lWJug9cW6eEQr/eTtZnH8jyrcK7cDk5dTsJTVssLGH/ytiunsECpnXPJ/vejHsOg=="}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:22:31.488458 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-3a28adc8-10eb-4fb3-88e0-3f5094c32cce tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Getting quotas for project 62a621d00a6b499f921337dda20b66bd. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:22:31.497332 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-3a28adc8-10eb-4fb3-88e0-3f5094c32cce tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Getting quotas for user 4ba4975d23874879b779282e5b9cecb0 and project 62a621d00a6b499f921337dda20b66bd. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:22:31.635478 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d65637b9-88f6-4ce3-bb53-f3704ee4fc8b tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:31.651819 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d65637b9-88f6-4ce3-bb53-f3704ee4fc8b tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 1.677564 Oct 23 01:22:31.656349 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1597/3166] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:29 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 1685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:31.673128 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-56218072-5a38-4274-badf-33c8ac65fc34 req-18d76e39-9f90-47e9-9ffc-539ed9c8a6a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "defa5fbb-f632-4ce7-8e07-e00f6f491d82", "tag": "a101ccc4-13ba-47da-b30f-6a0f1dbe2c91"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:22:31.697575 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-56218072-5a38-4274-badf-33c8ac65fc34 req-18d76e39-9f90-47e9-9ffc-539ed9c8a6a9 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:31.703683 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3a28adc8-10eb-4fb3-88e0-3f5094c32cce tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.554154 Oct 23 01:22:31.705729 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1570/3167] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 01:22:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:22:31.713406 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2ef816f3-4628-4c1f-af3b-ae2ea7d05131 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-581772362", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:22:31.716810 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-56218072-5a38-4274-badf-33c8ac65fc34 req-18d76e39-9f90-47e9-9ffc-539ed9c8a6a9 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:31.718502 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-56218072-5a38-4274-badf-33c8ac65fc34 req-18d76e39-9f90-47e9-9ffc-539ed9c8a6a9 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:31.777903 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-56218072-5a38-4274-badf-33c8ac65fc34 req-18d76e39-9f90-47e9-9ffc-539ed9c8a6a9 service nova] Creating event network-changed:a101ccc4-13ba-47da-b30f-6a0f1dbe2c91 for instance defa5fbb-f632-4ce7-8e07-e00f6f491d82 on n-h2-master-1 Oct 23 01:22:31.795485 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-56218072-5a38-4274-badf-33c8ac65fc34 req-18d76e39-9f90-47e9-9ffc-539ed9c8a6a9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132398 Oct 23 01:22:31.798133 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1598/3168] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:22:31.805709 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4256635f-5a8f-45c6-aba0-622aa101333d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:31.808143 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4256635f-5a8f-45c6-aba0-622aa101333d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 1842d55e-825b-4dc8-b3e4-d5eb8ab2b941] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:31.817888 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4256635f-5a8f-45c6-aba0-622aa101333d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:31.818673 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4256635f-5a8f-45c6-aba0-622aa101333d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:31.819320 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4256635f-5a8f-45c6-aba0-622aa101333d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:31.820914 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4256635f-5a8f-45c6-aba0-622aa101333d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:31.821724 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4256635f-5a8f-45c6-aba0-622aa101333d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:31.822380 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4256635f-5a8f-45c6-aba0-622aa101333d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:31.892244 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-2ef816f3-4628-4c1f-af3b-ae2ea7d05131 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] validate_networks() for [('5e0c2166-5c86-44c0-95de-006225def5a5', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:22:33.128722 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4256635f-5a8f-45c6-aba0-622aa101333d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:33.140016 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4256635f-5a8f-45c6-aba0-622aa101333d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/1842d55e-825b-4dc8-b3e4-d5eb8ab2b941" status: 200 len: 1307 microversion: 2.1 time: 1.340507 Oct 23 01:22:33.145502 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1599/3169] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:31 2022] GET /compute/v2.1/servers/1842d55e-825b-4dc8-b3e4-d5eb8ab2b941 => generated 1307 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:33.151364 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8982d382-56c5-4991-8ea1-643fe9810225 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:33.152270 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8982d382-56c5-4991-8ea1-643fe9810225 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] [instance: 98b17bd5-1bd0-4e2c-b17b-4964e7884942] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:33.159005 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8982d382-56c5-4991-8ea1-643fe9810225 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:33.159801 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8982d382-56c5-4991-8ea1-643fe9810225 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:33.160479 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8982d382-56c5-4991-8ea1-643fe9810225 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:33.161412 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8982d382-56c5-4991-8ea1-643fe9810225 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:33.162281 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8982d382-56c5-4991-8ea1-643fe9810225 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:33.162953 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8982d382-56c5-4991-8ea1-643fe9810225 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:34.751620 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8982d382-56c5-4991-8ea1-643fe9810225 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bede03a6c44c3cbe86f7a06601d115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1b744484c41c88314112b572ccac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:34.777152 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8982d382-56c5-4991-8ea1-643fe9810225 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] 10.222.0.42 "GET /compute/v2.1/servers/98b17bd5-1bd0-4e2c-b17b-4964e7884942" status: 200 len: 1318 microversion: 2.1 time: 1.618876 Oct 23 01:22:34.777896 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1600/3170] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:33 2022] GET /compute/v2.1/servers/98b17bd5-1bd0-4e2c-b17b-4964e7884942 => generated 1318 bytes in 1632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:34.805398 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3087eff1-b6c2-4d57-86d1-1b5f1a3df078 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:34.812410 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3087eff1-b6c2-4d57-86d1-1b5f1a3df078 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:34.845248 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3087eff1-b6c2-4d57-86d1-1b5f1a3df078 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:34.845767 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3087eff1-b6c2-4d57-86d1-1b5f1a3df078 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:34.848948 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3087eff1-b6c2-4d57-86d1-1b5f1a3df078 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:34.851109 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3087eff1-b6c2-4d57-86d1-1b5f1a3df078 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:34.851921 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3087eff1-b6c2-4d57-86d1-1b5f1a3df078 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:34.855304 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3087eff1-b6c2-4d57-86d1-1b5f1a3df078 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:35.009120 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-2ef816f3-4628-4c1f-af3b-ae2ea7d05131 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:22:35.009560 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-2ef816f3-4628-4c1f-af3b-ae2ea7d05131 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:22:35.009780 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-2ef816f3-4628-4c1f-af3b-ae2ea7d05131 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:22:35.010886 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-2ef816f3-4628-4c1f-af3b-ae2ea7d05131 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:22:35.011902 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-2ef816f3-4628-4c1f-af3b-ae2ea7d05131 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:22:35.022567 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2ef816f3-4628-4c1f-af3b-ae2ea7d05131 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:35.023437 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2ef816f3-4628-4c1f-af3b-ae2ea7d05131 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:35.023973 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2ef816f3-4628-4c1f-af3b-ae2ea7d05131 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:35.036265 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2ef816f3-4628-4c1f-af3b-ae2ea7d05131 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:35.036834 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2ef816f3-4628-4c1f-af3b-ae2ea7d05131 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:35.037387 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2ef816f3-4628-4c1f-af3b-ae2ea7d05131 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:35.093775 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-2ef816f3-4628-4c1f-af3b-ae2ea7d05131 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Getting quotas for project 4c25b4509ad7457bad4a2e5e0bc59add. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:22:35.111404 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-2ef816f3-4628-4c1f-af3b-ae2ea7d05131 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Getting quotas for user 19bff9f7a4254110b3b89f0cba5d252f and project 4c25b4509ad7457bad4a2e5e0bc59add. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:22:35.146696 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2ef816f3-4628-4c1f-af3b-ae2ea7d05131 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:22:35.152077 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2ef816f3-4628-4c1f-af3b-ae2ea7d05131 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 79681d58-1364-42d2-99e4-7fe4965bf625] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:22:35.347871 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2ef816f3-4628-4c1f-af3b-ae2ea7d05131 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.640748 Oct 23 01:22:35.356028 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1571/3171] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:22:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 3643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:22:35.363187 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c99d165c-299d-4f1d-aabd-db2f5f28bcd6 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:35.363820 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c99d165c-299d-4f1d-aabd-db2f5f28bcd6 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:35.381686 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c99d165c-299d-4f1d-aabd-db2f5f28bcd6 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:35.382235 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c99d165c-299d-4f1d-aabd-db2f5f28bcd6 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:35.382670 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c99d165c-299d-4f1d-aabd-db2f5f28bcd6 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:35.383410 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c99d165c-299d-4f1d-aabd-db2f5f28bcd6 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:35.383896 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c99d165c-299d-4f1d-aabd-db2f5f28bcd6 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:35.384318 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c99d165c-299d-4f1d-aabd-db2f5f28bcd6 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:35.952626 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3087eff1-b6c2-4d57-86d1-1b5f1a3df078 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:35.966972 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3087eff1-b6c2-4d57-86d1-1b5f1a3df078 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 1.170387 Oct 23 01:22:35.967758 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1601/3172] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:34 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:35.989331 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-0768619d-7a43-4e5e-bbc8-5aa13221eebc req-b4f1dcfa-5786-4440-a278-ced33b9652a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98b17bd5-1bd0-4e2c-b17b-4964e7884942", "tag": "24dca9c9-3c1a-465a-8733-b14dcb7f51ae"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:22:36.000156 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-0768619d-7a43-4e5e-bbc8-5aa13221eebc req-b4f1dcfa-5786-4440-a278-ced33b9652a5 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:36.000642 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-0768619d-7a43-4e5e-bbc8-5aa13221eebc req-b4f1dcfa-5786-4440-a278-ced33b9652a5 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:36.001079 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-0768619d-7a43-4e5e-bbc8-5aa13221eebc req-b4f1dcfa-5786-4440-a278-ced33b9652a5 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:36.013357 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-0768619d-7a43-4e5e-bbc8-5aa13221eebc req-b4f1dcfa-5786-4440-a278-ced33b9652a5 service nova] Creating event network-changed:24dca9c9-3c1a-465a-8733-b14dcb7f51ae for instance 98b17bd5-1bd0-4e2c-b17b-4964e7884942 on n-h2-master-1 Oct 23 01:22:36.023173 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-0768619d-7a43-4e5e-bbc8-5aa13221eebc req-b4f1dcfa-5786-4440-a278-ced33b9652a5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038281 Oct 23 01:22:36.025043 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1602/3173] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:22:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:22:36.032938 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d17811c9-cc5d-4298-8768-3b5c923d5b58 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:36.037748 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d17811c9-cc5d-4298-8768-3b5c923d5b58 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 1842d55e-825b-4dc8-b3e4-d5eb8ab2b941] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:36.044580 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d17811c9-cc5d-4298-8768-3b5c923d5b58 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:36.045109 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d17811c9-cc5d-4298-8768-3b5c923d5b58 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:36.045520 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d17811c9-cc5d-4298-8768-3b5c923d5b58 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:36.046267 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d17811c9-cc5d-4298-8768-3b5c923d5b58 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:36.046778 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d17811c9-cc5d-4298-8768-3b5c923d5b58 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:36.047369 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d17811c9-cc5d-4298-8768-3b5c923d5b58 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:36.231831 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c99d165c-299d-4f1d-aabd-db2f5f28bcd6 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:36.244823 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c99d165c-299d-4f1d-aabd-db2f5f28bcd6 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:36.248940 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c99d165c-299d-4f1d-aabd-db2f5f28bcd6 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:36.250855 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c99d165c-299d-4f1d-aabd-db2f5f28bcd6 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1878 microversion: 2.42 time: 0.899851 Oct 23 01:22:36.252399 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1572/3174] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:22:35 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1878 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:22:36.278840 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-96f07b5a-e3ee-4e53-b038-dbe50f78db27 req-2ea2b058-1ab2-4d06-b5b4-e59de4134128 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "defa5fbb-f632-4ce7-8e07-e00f6f491d82", "tag": "29c00bf1-c7c4-4e37-8aad-d647f963331c"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:22:36.302406 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-96f07b5a-e3ee-4e53-b038-dbe50f78db27 req-2ea2b058-1ab2-4d06-b5b4-e59de4134128 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:36.303340 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-96f07b5a-e3ee-4e53-b038-dbe50f78db27 req-2ea2b058-1ab2-4d06-b5b4-e59de4134128 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:36.305366 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-96f07b5a-e3ee-4e53-b038-dbe50f78db27 req-2ea2b058-1ab2-4d06-b5b4-e59de4134128 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:36.329400 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-96f07b5a-e3ee-4e53-b038-dbe50f78db27 req-2ea2b058-1ab2-4d06-b5b4-e59de4134128 service nova] Creating event network-changed:29c00bf1-c7c4-4e37-8aad-d647f963331c for instance defa5fbb-f632-4ce7-8e07-e00f6f491d82 on n-h2-master-1 Oct 23 01:22:36.337549 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-96f07b5a-e3ee-4e53-b038-dbe50f78db27 req-2ea2b058-1ab2-4d06-b5b4-e59de4134128 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083096 Oct 23 01:22:36.342169 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1573/3175] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:22:36.346050 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a19a72b3-5250-4eac-beb6-dd4982d38b09 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:36.347514 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a19a72b3-5250-4eac-beb6-dd4982d38b09 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 79681d58-1364-42d2-99e4-7fe4965bf625] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:36.463432 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a19a72b3-5250-4eac-beb6-dd4982d38b09 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:36.473666 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a19a72b3-5250-4eac-beb6-dd4982d38b09 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625" status: 200 len: 1221 microversion: 2.1 time: 0.133579 Oct 23 01:22:36.480498 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1574/3176] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:36 2022] GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625 => generated 1221 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:36.506084 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-698d93ae-f8e7-4292-a93f-2b07a76a44fa tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:36.507023 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-698d93ae-f8e7-4292-a93f-2b07a76a44fa tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] [instance: 98b17bd5-1bd0-4e2c-b17b-4964e7884942] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:36.516130 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-698d93ae-f8e7-4292-a93f-2b07a76a44fa tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:36.516946 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-698d93ae-f8e7-4292-a93f-2b07a76a44fa tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:36.517589 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-698d93ae-f8e7-4292-a93f-2b07a76a44fa tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:36.518536 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-698d93ae-f8e7-4292-a93f-2b07a76a44fa tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:36.519217 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-698d93ae-f8e7-4292-a93f-2b07a76a44fa tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:36.519974 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-698d93ae-f8e7-4292-a93f-2b07a76a44fa tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:36.758483 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d17811c9-cc5d-4298-8768-3b5c923d5b58 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:36.771470 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d17811c9-cc5d-4298-8768-3b5c923d5b58 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/1842d55e-825b-4dc8-b3e4-d5eb8ab2b941" status: 200 len: 1307 microversion: 2.1 time: 0.745154 Oct 23 01:22:36.776242 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1603/3177] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:36 2022] GET /compute/v2.1/servers/1842d55e-825b-4dc8-b3e4-d5eb8ab2b941 => generated 1307 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:36.783966 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-734877ef-2127-40d9-8655-6d2c552f2d22 req-fe7c1681-2372-4227-b638-ba6b7765341c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1842d55e-825b-4dc8-b3e4-d5eb8ab2b941", "name": "network-vif-plugged", "status": "completed", "tag": "fdb229eb-24a1-4e18-afed-ef66e8ce931d"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:22:36.816199 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-734877ef-2127-40d9-8655-6d2c552f2d22 req-fe7c1681-2372-4227-b638-ba6b7765341c service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:36.817066 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-734877ef-2127-40d9-8655-6d2c552f2d22 req-fe7c1681-2372-4227-b638-ba6b7765341c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:36.817743 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-734877ef-2127-40d9-8655-6d2c552f2d22 req-fe7c1681-2372-4227-b638-ba6b7765341c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:36.859017 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-734877ef-2127-40d9-8655-6d2c552f2d22 req-fe7c1681-2372-4227-b638-ba6b7765341c service nova] Creating event network-vif-plugged:fdb229eb-24a1-4e18-afed-ef66e8ce931d for instance 1842d55e-825b-4dc8-b3e4-d5eb8ab2b941 on n-h1-master-1 Oct 23 01:22:36.865021 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-734877ef-2127-40d9-8655-6d2c552f2d22 req-fe7c1681-2372-4227-b638-ba6b7765341c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087168 Oct 23 01:22:36.868315 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1604/3178] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:22:36.881019 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-39a5db61-f31e-40aa-beb4-f86d8024c72d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-39a5db61-f31e-40aa-beb4-f86d8024c72d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Request method failure captured: Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: request: PUT /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 HTTP/1.1 Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 24 Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJZEAurAeILsYJek3MCv_ryiTbidOLVZq6W4I7jJxeY_1_bTWRye2xM3EDOhowd_NyioevvIvzT9beBCgKqri_ZjLw9hdsIISMXmajO_VmobATT_GwpY_Y-GVylQtV9MoF1-Bup_Ahjld_2riQHnDzqLUWULm2acZYcK9UIbslVsdDU Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}] Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: cd6a6c5240f94ace91e1f0ed3e53fa7c Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: {"server": {"name": ""}} Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '62a8ad26-f65b-432d-a8da-48264c426335', 'body': {'server': {'name': ''}}} Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise error Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi '' Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 23 01:22:36.886553 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 23 01:22:36.894348 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:22:36.894348 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:22:36.894348 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:22:36.894348 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:22:36.894348 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:22:36.894348 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:22:36.894348 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 23 01:22:36.894348 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 23 01:22:36.894348 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 23 01:22:36.894348 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:22:36.894348 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-39a5db61-f31e-40aa-beb4-f86d8024c72d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:22:36.894348 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-39a5db61-f31e-40aa-beb4-f86d8024c72d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "PUT /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 400 len: 108 microversion: 2.1 time: 0.017122 Oct 23 01:22:36.894348 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1605/3179] 10.222.0.42 () {60 vars in 1256 bytes} [Sun Oct 23 01:22:36 2022] PUT /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 108 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:22:36.904907 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-75c0d420-4d02-4fb8-bfac-21fb8fddc853 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:36.907224 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-75c0d420-4d02-4fb8-bfac-21fb8fddc853 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:36.922507 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-75c0d420-4d02-4fb8-bfac-21fb8fddc853 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:36.923021 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-75c0d420-4d02-4fb8-bfac-21fb8fddc853 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:36.923473 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-75c0d420-4d02-4fb8-bfac-21fb8fddc853 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:36.924199 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-75c0d420-4d02-4fb8-bfac-21fb8fddc853 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:36.924666 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-75c0d420-4d02-4fb8-bfac-21fb8fddc853 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:36.925104 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-75c0d420-4d02-4fb8-bfac-21fb8fddc853 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:37.120610 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-698d93ae-f8e7-4292-a93f-2b07a76a44fa tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bede03a6c44c3cbe86f7a06601d115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1b744484c41c88314112b572ccac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:37.129696 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-698d93ae-f8e7-4292-a93f-2b07a76a44fa tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] 10.222.0.42 "GET /compute/v2.1/servers/98b17bd5-1bd0-4e2c-b17b-4964e7884942" status: 200 len: 1318 microversion: 2.1 time: 0.653891 Oct 23 01:22:37.131115 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1575/3180] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:36 2022] GET /compute/v2.1/servers/98b17bd5-1bd0-4e2c-b17b-4964e7884942 => generated 1318 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:37.285506 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e5cee90a-5129-49aa-92a5-d3a2fed49d2f tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:37.286381 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e5cee90a-5129-49aa-92a5-d3a2fed49d2f tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:37.305012 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e5cee90a-5129-49aa-92a5-d3a2fed49d2f tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:37.305873 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e5cee90a-5129-49aa-92a5-d3a2fed49d2f tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:37.307517 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e5cee90a-5129-49aa-92a5-d3a2fed49d2f tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:37.308849 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e5cee90a-5129-49aa-92a5-d3a2fed49d2f tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:37.309559 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e5cee90a-5129-49aa-92a5-d3a2fed49d2f tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:37.310280 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e5cee90a-5129-49aa-92a5-d3a2fed49d2f tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:37.904517 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-75c0d420-4d02-4fb8-bfac-21fb8fddc853 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:37.917801 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-75c0d420-4d02-4fb8-bfac-21fb8fddc853 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1505 microversion: 2.1 time: 1.024812 Oct 23 01:22:37.918848 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1606/3181] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:36 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1505 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:37.970149 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e5cee90a-5129-49aa-92a5-d3a2fed49d2f tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:37.987542 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e5cee90a-5129-49aa-92a5-d3a2fed49d2f tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:37.992411 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-61d8987f-260c-4961-a2a7-b5e7e607aa27 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:37.996292 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e5cee90a-5129-49aa-92a5-d3a2fed49d2f tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:37.997370 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-61d8987f-260c-4961-a2a7-b5e7e607aa27 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 79681d58-1364-42d2-99e4-7fe4965bf625] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:37.998852 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e5cee90a-5129-49aa-92a5-d3a2fed49d2f tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1878 microversion: 2.42 time: 0.718449 Oct 23 01:22:38.011837 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1576/3182] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:22:37 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1878 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:22:38.020690 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-61d8987f-260c-4961-a2a7-b5e7e607aa27 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:38.021998 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-61d8987f-260c-4961-a2a7-b5e7e607aa27 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:38.021998 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-61d8987f-260c-4961-a2a7-b5e7e607aa27 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:38.022351 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-61d8987f-260c-4961-a2a7-b5e7e607aa27 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:38.028032 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-61d8987f-260c-4961-a2a7-b5e7e607aa27 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:38.028492 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-61d8987f-260c-4961-a2a7-b5e7e607aa27 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:38.035828 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-201b8b57-5c89-4118-b213-528ca4e30a22 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:38.036544 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-201b8b57-5c89-4118-b213-528ca4e30a22 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 1842d55e-825b-4dc8-b3e4-d5eb8ab2b941] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:38.056987 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-201b8b57-5c89-4118-b213-528ca4e30a22 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:38.057804 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-201b8b57-5c89-4118-b213-528ca4e30a22 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:38.058460 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-201b8b57-5c89-4118-b213-528ca4e30a22 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:38.059603 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-201b8b57-5c89-4118-b213-528ca4e30a22 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:38.060259 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-201b8b57-5c89-4118-b213-528ca4e30a22 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:38.060994 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-201b8b57-5c89-4118-b213-528ca4e30a22 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:38.112426 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=100 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:22:38.872589 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-61d8987f-260c-4961-a2a7-b5e7e607aa27 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:38.890223 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-61d8987f-260c-4961-a2a7-b5e7e607aa27 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625" status: 200 len: 1225 microversion: 2.1 time: 0.968938 Oct 23 01:22:38.890839 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1607/3183] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:37 2022] GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625 => generated 1225 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:38.904288 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-aa52789a-1883-46f1-8077-fe2cb52ca579 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:38.905360 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-aa52789a-1883-46f1-8077-fe2cb52ca579 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] [instance: 98b17bd5-1bd0-4e2c-b17b-4964e7884942] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:38.913199 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aa52789a-1883-46f1-8077-fe2cb52ca579 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:38.913431 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aa52789a-1883-46f1-8077-fe2cb52ca579 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:38.913882 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aa52789a-1883-46f1-8077-fe2cb52ca579 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:38.928970 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aa52789a-1883-46f1-8077-fe2cb52ca579 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:38.929481 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aa52789a-1883-46f1-8077-fe2cb52ca579 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:38.929931 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aa52789a-1883-46f1-8077-fe2cb52ca579 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:40.065753 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-aa52789a-1883-46f1-8077-fe2cb52ca579 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bede03a6c44c3cbe86f7a06601d115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1b744484c41c88314112b572ccac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:40.075887 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-aa52789a-1883-46f1-8077-fe2cb52ca579 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] 10.222.0.42 "GET /compute/v2.1/servers/98b17bd5-1bd0-4e2c-b17b-4964e7884942" status: 200 len: 1318 microversion: 2.1 time: 1.183729 Oct 23 01:22:40.078647 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1608/3184] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:38 2022] GET /compute/v2.1/servers/98b17bd5-1bd0-4e2c-b17b-4964e7884942 => generated 1318 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:40.085990 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-1ebfc141-e361-4c20-887f-ccdba908812e req-3194f82b-17cd-47b5-8fcf-ccfae276817c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3af7691f-0f59-4507-b9ea-17103f46c27e", "tag": "b01274a4-5406-4e64-9c2a-bd952d13d90e"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:22:40.122999 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-1ebfc141-e361-4c20-887f-ccdba908812e req-3194f82b-17cd-47b5-8fcf-ccfae276817c service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:40.123848 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-1ebfc141-e361-4c20-887f-ccdba908812e req-3194f82b-17cd-47b5-8fcf-ccfae276817c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:40.124524 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-1ebfc141-e361-4c20-887f-ccdba908812e req-3194f82b-17cd-47b5-8fcf-ccfae276817c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:40.173661 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-1ebfc141-e361-4c20-887f-ccdba908812e req-3194f82b-17cd-47b5-8fcf-ccfae276817c service nova] Creating event network-changed:b01274a4-5406-4e64-9c2a-bd952d13d90e for instance 3af7691f-0f59-4507-b9ea-17103f46c27e on n-h1-master-1 Oct 23 01:22:40.190108 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-1ebfc141-e361-4c20-887f-ccdba908812e req-3194f82b-17cd-47b5-8fcf-ccfae276817c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109036 Oct 23 01:22:40.191027 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1609/3185] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:22:40.195137 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-201b8b57-5c89-4118-b213-528ca4e30a22 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:40.197581 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-40d7e787-5cde-45a7-8dc9-872deef1aeee tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:40.198519 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-40d7e787-5cde-45a7-8dc9-872deef1aeee tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:40.205183 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-40d7e787-5cde-45a7-8dc9-872deef1aeee tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:40.205929 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-40d7e787-5cde-45a7-8dc9-872deef1aeee tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:40.206568 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-40d7e787-5cde-45a7-8dc9-872deef1aeee tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:40.207436 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-40d7e787-5cde-45a7-8dc9-872deef1aeee tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:40.208057 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-40d7e787-5cde-45a7-8dc9-872deef1aeee tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:40.208646 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-40d7e787-5cde-45a7-8dc9-872deef1aeee tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:40.217088 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-201b8b57-5c89-4118-b213-528ca4e30a22 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/1842d55e-825b-4dc8-b3e4-d5eb8ab2b941" status: 200 len: 1307 microversion: 2.1 time: 2.203929 Oct 23 01:22:40.258399 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1577/3186] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:38 2022] GET /compute/v2.1/servers/1842d55e-825b-4dc8-b3e4-d5eb8ab2b941 => generated 1307 bytes in 2246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:40.269042 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3feeaafb-6493-4508-8ddb-697caefa7ea3 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:40.269793 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3feeaafb-6493-4508-8ddb-697caefa7ea3 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 79681d58-1364-42d2-99e4-7fe4965bf625] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:40.309908 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3feeaafb-6493-4508-8ddb-697caefa7ea3 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:40.310854 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3feeaafb-6493-4508-8ddb-697caefa7ea3 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:40.311541 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3feeaafb-6493-4508-8ddb-697caefa7ea3 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:40.312626 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3feeaafb-6493-4508-8ddb-697caefa7ea3 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:40.313248 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3feeaafb-6493-4508-8ddb-697caefa7ea3 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:40.313843 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3feeaafb-6493-4508-8ddb-697caefa7ea3 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:41.451746 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3feeaafb-6493-4508-8ddb-697caefa7ea3 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:41.469549 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3feeaafb-6493-4508-8ddb-697caefa7ea3 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625" status: 200 len: 1281 microversion: 2.1 time: 1.207530 Oct 23 01:22:41.504915 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1578/3187] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:40 2022] GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625 => generated 1281 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:41.510156 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-740cadd0-2bfb-4bce-8026-5a59cc6cef2f tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:41.530266 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-740cadd0-2bfb-4bce-8026-5a59cc6cef2f tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] [instance: 98b17bd5-1bd0-4e2c-b17b-4964e7884942] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:41.547627 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-740cadd0-2bfb-4bce-8026-5a59cc6cef2f tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:41.549176 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-740cadd0-2bfb-4bce-8026-5a59cc6cef2f tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:41.550497 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-740cadd0-2bfb-4bce-8026-5a59cc6cef2f tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:41.556540 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-740cadd0-2bfb-4bce-8026-5a59cc6cef2f tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:41.557222 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-740cadd0-2bfb-4bce-8026-5a59cc6cef2f tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:41.558483 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-740cadd0-2bfb-4bce-8026-5a59cc6cef2f tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:41.966100 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-40d7e787-5cde-45a7-8dc9-872deef1aeee tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:41.983009 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-40d7e787-5cde-45a7-8dc9-872deef1aeee tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:41.988129 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-40d7e787-5cde-45a7-8dc9-872deef1aeee tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:41.994436 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-40d7e787-5cde-45a7-8dc9-872deef1aeee tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1878 microversion: 2.42 time: 1.798696 Oct 23 01:22:41.995317 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1610/3188] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:22:40 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1878 bytes in 1804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:22:42.001111 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-465658ce-e4af-4787-91d5-f88b08c9b359 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:42.002017 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-465658ce-e4af-4787-91d5-f88b08c9b359 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 1842d55e-825b-4dc8-b3e4-d5eb8ab2b941] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:42.017642 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-465658ce-e4af-4787-91d5-f88b08c9b359 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:42.018588 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-465658ce-e4af-4787-91d5-f88b08c9b359 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:42.019268 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-465658ce-e4af-4787-91d5-f88b08c9b359 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:42.030989 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-465658ce-e4af-4787-91d5-f88b08c9b359 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:42.031819 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-465658ce-e4af-4787-91d5-f88b08c9b359 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:42.032483 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-465658ce-e4af-4787-91d5-f88b08c9b359 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:42.753091 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-740cadd0-2bfb-4bce-8026-5a59cc6cef2f tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bede03a6c44c3cbe86f7a06601d115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1b744484c41c88314112b572ccac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:42.806362 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-740cadd0-2bfb-4bce-8026-5a59cc6cef2f tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] 10.222.0.42 "GET /compute/v2.1/servers/98b17bd5-1bd0-4e2c-b17b-4964e7884942" status: 200 len: 1318 microversion: 2.1 time: 1.299890 Oct 23 01:22:42.807419 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1579/3189] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:41 2022] GET /compute/v2.1/servers/98b17bd5-1bd0-4e2c-b17b-4964e7884942 => generated 1318 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:42.814903 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-cbede773-c60c-4810-8515-b57a7e734747 req-24a75666-6abd-48fe-a497-e449fd8f5dc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98b17bd5-1bd0-4e2c-b17b-4964e7884942", "name": "network-vif-plugged", "status": "completed", "tag": "24dca9c9-3c1a-465a-8733-b14dcb7f51ae"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:22:42.843871 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-cbede773-c60c-4810-8515-b57a7e734747 req-24a75666-6abd-48fe-a497-e449fd8f5dc5 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:42.844913 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-cbede773-c60c-4810-8515-b57a7e734747 req-24a75666-6abd-48fe-a497-e449fd8f5dc5 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:42.848692 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-cbede773-c60c-4810-8515-b57a7e734747 req-24a75666-6abd-48fe-a497-e449fd8f5dc5 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:42.861157 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-cbede773-c60c-4810-8515-b57a7e734747 req-24a75666-6abd-48fe-a497-e449fd8f5dc5 service nova] Creating event network-vif-plugged:24dca9c9-3c1a-465a-8733-b14dcb7f51ae for instance 98b17bd5-1bd0-4e2c-b17b-4964e7884942 on n-h2-master-1 Oct 23 01:22:42.867401 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-cbede773-c60c-4810-8515-b57a7e734747 req-24a75666-6abd-48fe-a497-e449fd8f5dc5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058664 Oct 23 01:22:42.869262 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1580/3190] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:22:42.878328 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-823fd758-71ca-4492-986b-662305c1accb tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:42.880482 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-823fd758-71ca-4492-986b-662305c1accb tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 79681d58-1364-42d2-99e4-7fe4965bf625] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:42.889914 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-823fd758-71ca-4492-986b-662305c1accb tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:42.890656 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-823fd758-71ca-4492-986b-662305c1accb tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:42.891480 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-823fd758-71ca-4492-986b-662305c1accb tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:42.892363 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-823fd758-71ca-4492-986b-662305c1accb tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:42.893249 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-823fd758-71ca-4492-986b-662305c1accb tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:42.893845 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-823fd758-71ca-4492-986b-662305c1accb tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:43.332173 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-465658ce-e4af-4787-91d5-f88b08c9b359 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:43.387232 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-465658ce-e4af-4787-91d5-f88b08c9b359 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/1842d55e-825b-4dc8-b3e4-d5eb8ab2b941" status: 200 len: 1487 microversion: 2.1 time: 1.390527 Oct 23 01:22:43.388310 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1611/3191] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:41 2022] GET /compute/v2.1/servers/1842d55e-825b-4dc8-b3e4-d5eb8ab2b941 => generated 1487 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:43.393596 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-faab68b0-8769-4e65-b3ec-b20b69fbb8c0 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:43.394483 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-faab68b0-8769-4e65-b3ec-b20b69fbb8c0 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:43.401438 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=6 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:22:43.403412 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-faab68b0-8769-4e65-b3ec-b20b69fbb8c0 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:43.404075 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-faab68b0-8769-4e65-b3ec-b20b69fbb8c0 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:43.404688 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-faab68b0-8769-4e65-b3ec-b20b69fbb8c0 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:43.410008 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-faab68b0-8769-4e65-b3ec-b20b69fbb8c0 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:43.410008 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-faab68b0-8769-4e65-b3ec-b20b69fbb8c0 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:43.410008 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-faab68b0-8769-4e65-b3ec-b20b69fbb8c0 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:43.436316 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=100 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:22:45.054489 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=4 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:22:45.383001 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-823fd758-71ca-4492-986b-662305c1accb tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:45.402181 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-823fd758-71ca-4492-986b-662305c1accb tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625" status: 200 len: 1321 microversion: 2.1 time: 2.530808 Oct 23 01:22:45.410914 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1581/3192] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:42 2022] GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625 => generated 1321 bytes in 2541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:45.424300 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-eea262a1-41ef-4195-979a-12739aa028a2 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1244753394"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:22:45.440327 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-eea262a1-41ef-4195-979a-12739aa028a2 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 1842d55e-825b-4dc8-b3e4-d5eb8ab2b941] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:45.471818 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eea262a1-41ef-4195-979a-12739aa028a2 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:45.478221 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eea262a1-41ef-4195-979a-12739aa028a2 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:45.479688 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eea262a1-41ef-4195-979a-12739aa028a2 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:45.480587 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eea262a1-41ef-4195-979a-12739aa028a2 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:45.488193 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eea262a1-41ef-4195-979a-12739aa028a2 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:45.489789 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eea262a1-41ef-4195-979a-12739aa028a2 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:45.775417 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-faab68b0-8769-4e65-b3ec-b20b69fbb8c0 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:45.807200 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-faab68b0-8769-4e65-b3ec-b20b69fbb8c0 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:45.818935 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-faab68b0-8769-4e65-b3ec-b20b69fbb8c0 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:45.821460 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-faab68b0-8769-4e65-b3ec-b20b69fbb8c0 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1878 microversion: 2.42 time: 2.431194 Oct 23 01:22:45.835203 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1612/3193] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:22:43 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1878 bytes in 2446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:22:45.856838 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-20b328c7-80d4-4e65-a56a-6790ed49e9db tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:45.859885 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-20b328c7-80d4-4e65-a56a-6790ed49e9db tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] [instance: 98b17bd5-1bd0-4e2c-b17b-4964e7884942] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:45.892487 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20b328c7-80d4-4e65-a56a-6790ed49e9db tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:45.894630 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20b328c7-80d4-4e65-a56a-6790ed49e9db tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:45.901630 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20b328c7-80d4-4e65-a56a-6790ed49e9db tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:45.907307 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20b328c7-80d4-4e65-a56a-6790ed49e9db tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:45.909924 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20b328c7-80d4-4e65-a56a-6790ed49e9db tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:45.911392 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20b328c7-80d4-4e65-a56a-6790ed49e9db tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:46.413902 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-20b328c7-80d4-4e65-a56a-6790ed49e9db tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bede03a6c44c3cbe86f7a06601d115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1b744484c41c88314112b572ccac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:46.431012 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-20b328c7-80d4-4e65-a56a-6790ed49e9db tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] 10.222.0.42 "GET /compute/v2.1/servers/98b17bd5-1bd0-4e2c-b17b-4964e7884942" status: 200 len: 1507 microversion: 2.1 time: 0.593345 Oct 23 01:22:46.455826 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1613/3194] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:45 2022] GET /compute/v2.1/servers/98b17bd5-1bd0-4e2c-b17b-4964e7884942 => generated 1507 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:46.468580 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=28 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:22:46.481466 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-eea262a1-41ef-4195-979a-12739aa028a2 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "POST /compute/v2.1/servers/1842d55e-825b-4dc8-b3e4-d5eb8ab2b941/action" status: 202 len: 0 microversion: 2.1 time: 1.064109 Oct 23 01:22:46.489206 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-35bb333e-17c7-45fd-a537-c6a40ba5c10e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1347828424", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "03c7c850-f0e3-41ad-b527-7392408bf205"}], "security_groups": [{"name": "tempest-securitygroup--799628571"}], "key_name": "tempest-keypair-1120500951", "user_data": "}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:22:46.517465 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1582/3195] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:22:45 2022] POST /compute/v2.1/servers/1842d55e-825b-4dc8-b3e4-d5eb8ab2b941/action => generated 0 bytes in 1101 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 23 01:22:46.534325 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-0d9c64a1-36ff-4606-a19a-1fee47271cef req-8da5580f-ec2a-491e-b5f1-04753bad1146 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3af7691f-0f59-4507-b9ea-17103f46c27e", "name": "network-vif-plugged", "status": "completed", "tag": "b01274a4-5406-4e64-9c2a-bd952d13d90e"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:22:46.641574 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:22:46.665634 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-0d9c64a1-36ff-4606-a19a-1fee47271cef req-8da5580f-ec2a-491e-b5f1-04753bad1146 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:46.676732 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-0d9c64a1-36ff-4606-a19a-1fee47271cef req-8da5580f-ec2a-491e-b5f1-04753bad1146 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:46.683829 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-0d9c64a1-36ff-4606-a19a-1fee47271cef req-8da5580f-ec2a-491e-b5f1-04753bad1146 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:46.771068 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-0d9c64a1-36ff-4606-a19a-1fee47271cef req-8da5580f-ec2a-491e-b5f1-04753bad1146 service nova] Creating event network-vif-plugged:b01274a4-5406-4e64-9c2a-bd952d13d90e for instance 3af7691f-0f59-4507-b9ea-17103f46c27e on n-h1-master-1 Oct 23 01:22:46.793751 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-0d9c64a1-36ff-4606-a19a-1fee47271cef req-8da5580f-ec2a-491e-b5f1-04753bad1146 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.274590 Oct 23 01:22:46.804072 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1583/3196] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:22:46.829112 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7e919efd-2b42-430f-a52a-fc629cb095ca tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:46.835183 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7e919efd-2b42-430f-a52a-fc629cb095ca tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 79681d58-1364-42d2-99e4-7fe4965bf625] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:46.854059 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7e919efd-2b42-430f-a52a-fc629cb095ca tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:46.854573 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7e919efd-2b42-430f-a52a-fc629cb095ca tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:46.855019 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7e919efd-2b42-430f-a52a-fc629cb095ca tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:46.866701 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7e919efd-2b42-430f-a52a-fc629cb095ca tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:46.866701 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7e919efd-2b42-430f-a52a-fc629cb095ca tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:46.866701 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7e919efd-2b42-430f-a52a-fc629cb095ca tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:47.094526 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-35bb333e-17c7-45fd-a537-c6a40ba5c10e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] validate_networks() for [('03c7c850-f0e3-41ad-b527-7392408bf205', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:22:47.597182 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7e919efd-2b42-430f-a52a-fc629cb095ca tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:47.623167 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7e919efd-2b42-430f-a52a-fc629cb095ca tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625" status: 200 len: 1321 microversion: 2.1 time: 0.815229 Oct 23 01:22:47.626543 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1584/3197] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:46 2022] GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625 => generated 1321 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:47.663079 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7a640d19-1fe8-4d55-961f-da8b086daf12 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:47.663739 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7a640d19-1fe8-4d55-961f-da8b086daf12 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] [instance: 3af7691f-0f59-4507-b9ea-17103f46c27e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:47.722565 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a640d19-1fe8-4d55-961f-da8b086daf12 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:47.722565 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a640d19-1fe8-4d55-961f-da8b086daf12 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:47.731216 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a640d19-1fe8-4d55-961f-da8b086daf12 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:47.732016 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a640d19-1fe8-4d55-961f-da8b086daf12 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:47.732526 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a640d19-1fe8-4d55-961f-da8b086daf12 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:47.736980 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a640d19-1fe8-4d55-961f-da8b086daf12 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:48.076273 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7a640d19-1fe8-4d55-961f-da8b086daf12 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bede03a6c44c3cbe86f7a06601d115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1b744484c41c88314112b572ccac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:48.090014 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7a640d19-1fe8-4d55-961f-da8b086daf12 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] 10.222.0.42 "GET /compute/v2.1/servers/3af7691f-0f59-4507-b9ea-17103f46c27e" status: 200 len: 1318 microversion: 2.1 time: 0.447564 Oct 23 01:22:48.090014 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1585/3198] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:47 2022] GET /compute/v2.1/servers/3af7691f-0f59-4507-b9ea-17103f46c27e => generated 1318 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:48.099820 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cd3c1302-91bf-4ccd-8bac-6b2dddeb1a1e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc18125e0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:48.194343 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cd3c1302-91bf-4ccd-8bac-6b2dddeb1a1e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/69ae47c2-2bf5-4e8b-bee1-015fb0ad2210" status: 200 len: 1414 microversion: 2.1 time: 0.096591 Oct 23 01:22:48.194343 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1586/3199] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:22:48 2022] GET /compute/v2.1/images/69ae47c2-2bf5-4e8b-bee1-015fb0ad2210 => generated 1414 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:48.209086 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-78947143-4d1d-4c37-bb84-35154ee8e6e6 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:48.215483 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-78947143-4d1d-4c37-bb84-35154ee8e6e6 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:48.242004 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78947143-4d1d-4c37-bb84-35154ee8e6e6 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:48.242004 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78947143-4d1d-4c37-bb84-35154ee8e6e6 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:48.242004 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78947143-4d1d-4c37-bb84-35154ee8e6e6 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:48.246202 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78947143-4d1d-4c37-bb84-35154ee8e6e6 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:48.248561 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78947143-4d1d-4c37-bb84-35154ee8e6e6 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:48.252335 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78947143-4d1d-4c37-bb84-35154ee8e6e6 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:48.480828 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-35bb333e-17c7-45fd-a537-c6a40ba5c10e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:22:48.493012 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-35bb333e-17c7-45fd-a537-c6a40ba5c10e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:22:48.493829 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-35bb333e-17c7-45fd-a537-c6a40ba5c10e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:22:48.494591 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-35bb333e-17c7-45fd-a537-c6a40ba5c10e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:22:48.495254 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-35bb333e-17c7-45fd-a537-c6a40ba5c10e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:22:48.522264 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-35bb333e-17c7-45fd-a537-c6a40ba5c10e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:48.524985 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-35bb333e-17c7-45fd-a537-c6a40ba5c10e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:48.526875 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-35bb333e-17c7-45fd-a537-c6a40ba5c10e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:48.542490 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-35bb333e-17c7-45fd-a537-c6a40ba5c10e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:48.542490 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-35bb333e-17c7-45fd-a537-c6a40ba5c10e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:48.542490 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-35bb333e-17c7-45fd-a537-c6a40ba5c10e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:48.621749 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-35bb333e-17c7-45fd-a537-c6a40ba5c10e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Getting quotas for project 62a621d00a6b499f921337dda20b66bd. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:22:48.648469 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-35bb333e-17c7-45fd-a537-c6a40ba5c10e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Getting quotas for user 4ba4975d23874879b779282e5b9cecb0 and project 62a621d00a6b499f921337dda20b66bd. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:22:48.694199 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-35bb333e-17c7-45fd-a537-c6a40ba5c10e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:22:48.715198 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-35bb333e-17c7-45fd-a537-c6a40ba5c10e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:22:48.996921 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-35bb333e-17c7-45fd-a537-c6a40ba5c10e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.539043 Oct 23 01:22:48.999103 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1614/3200] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:22:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 2550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:22:49.019244 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-69c9513c-c102-464e-8dc1-048c33ed74b4 req-71ed83b3-96e0-4ec1-8261-d4134be7843c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d9196f6-d696-45e0-b7fc-8d1557498393", "tag": "dae6ca4c-8045-4763-8841-33c56c0c2212"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:22:49.032634 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-78947143-4d1d-4c37-bb84-35154ee8e6e6 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:49.046569 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-78947143-4d1d-4c37-bb84-35154ee8e6e6 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:49.057309 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-78947143-4d1d-4c37-bb84-35154ee8e6e6 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:49.060829 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-78947143-4d1d-4c37-bb84-35154ee8e6e6 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1878 microversion: 2.42 time: 0.866853 Oct 23 01:22:49.098543 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-69c9513c-c102-464e-8dc1-048c33ed74b4 req-71ed83b3-96e0-4ec1-8261-d4134be7843c service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:49.100575 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-69c9513c-c102-464e-8dc1-048c33ed74b4 req-71ed83b3-96e0-4ec1-8261-d4134be7843c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.041s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:49.104959 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1587/3201] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:22:48 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1878 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:22:49.107156 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-69c9513c-c102-464e-8dc1-048c33ed74b4 req-71ed83b3-96e0-4ec1-8261-d4134be7843c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:49.113678 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ee89969b-c5f9-44d5-ac87-dd40a1abd32e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc1821040>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:49.192240 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-69c9513c-c102-464e-8dc1-048c33ed74b4 req-71ed83b3-96e0-4ec1-8261-d4134be7843c service nova] Creating event network-changed:dae6ca4c-8045-4763-8841-33c56c0c2212 for instance 3d9196f6-d696-45e0-b7fc-8d1557498393 on n-h1-master-1 Oct 23 01:22:49.218741 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-69c9513c-c102-464e-8dc1-048c33ed74b4 req-71ed83b3-96e0-4ec1-8261-d4134be7843c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.217326 Oct 23 01:22:49.232482 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1615/3202] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:22:49.262002 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ee89969b-c5f9-44d5-ac87-dd40a1abd32e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/69ae47c2-2bf5-4e8b-bee1-015fb0ad2210" status: 200 len: 1414 microversion: 2.1 time: 0.149039 Oct 23 01:22:49.284066 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2f626e46-1777-4ae1-b43e-2332f975dd60 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:49.284790 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2f626e46-1777-4ae1-b43e-2332f975dd60 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 79681d58-1364-42d2-99e4-7fe4965bf625] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:49.286588 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1588/3203] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:22:49 2022] GET /compute/v2.1/images/69ae47c2-2bf5-4e8b-bee1-015fb0ad2210 => generated 1414 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:49.301473 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0005faef-0870-4a08-a036-a2741c4111a5 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:49.309449 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0005faef-0870-4a08-a036-a2741c4111a5 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:49.325925 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f626e46-1777-4ae1-b43e-2332f975dd60 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:49.327430 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f626e46-1777-4ae1-b43e-2332f975dd60 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:49.330221 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f626e46-1777-4ae1-b43e-2332f975dd60 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:49.333756 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f626e46-1777-4ae1-b43e-2332f975dd60 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:49.335872 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f626e46-1777-4ae1-b43e-2332f975dd60 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:49.338119 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f626e46-1777-4ae1-b43e-2332f975dd60 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:49.531450 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0005faef-0870-4a08-a036-a2741c4111a5 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:49.541582 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0005faef-0870-4a08-a036-a2741c4111a5 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1238 microversion: 2.1 time: 0.253805 Oct 23 01:22:49.542235 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1589/3204] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:49 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1238 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:49.572186 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d03ae6f9-b079-48de-804b-b5ca1e694d3a tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:49.581630 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d03ae6f9-b079-48de-804b-b5ca1e694d3a tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] [instance: 3af7691f-0f59-4507-b9ea-17103f46c27e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:49.598283 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d03ae6f9-b079-48de-804b-b5ca1e694d3a tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:49.604317 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d03ae6f9-b079-48de-804b-b5ca1e694d3a tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:49.605401 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d03ae6f9-b079-48de-804b-b5ca1e694d3a tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:49.606989 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d03ae6f9-b079-48de-804b-b5ca1e694d3a tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:49.608808 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d03ae6f9-b079-48de-804b-b5ca1e694d3a tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:49.610172 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d03ae6f9-b079-48de-804b-b5ca1e694d3a tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:50.751574 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2f626e46-1777-4ae1-b43e-2332f975dd60 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:50.770256 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2f626e46-1777-4ae1-b43e-2332f975dd60 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625" status: 200 len: 1321 microversion: 2.1 time: 1.533855 Oct 23 01:22:50.771145 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d03ae6f9-b079-48de-804b-b5ca1e694d3a tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bede03a6c44c3cbe86f7a06601d115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1b744484c41c88314112b572ccac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:50.771647 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1616/3205] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:49 2022] GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625 => generated 1321 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:50.781084 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d03ae6f9-b079-48de-804b-b5ca1e694d3a tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] 10.222.0.42 "GET /compute/v2.1/servers/3af7691f-0f59-4507-b9ea-17103f46c27e" status: 200 len: 1506 microversion: 2.1 time: 1.234925 Oct 23 01:22:50.785364 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1590/3206] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:49 2022] GET /compute/v2.1/servers/3af7691f-0f59-4507-b9ea-17103f46c27e => generated 1506 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:50.791261 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-449eb19b-e7dc-488b-b07c-ad5a8d7f369c req-7be9ca5f-c0ae-48d3-b09f-448e2b30cdc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79681d58-1364-42d2-99e4-7fe4965bf625", "tag": "60e97be3-b803-4c66-9436-f1a9cc2abcdd"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:22:50.798302 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-173a54d9-6c5f-4353-a062-e32cc1006791 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc1982a60>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:50.857689 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-449eb19b-e7dc-488b-b07c-ad5a8d7f369c req-7be9ca5f-c0ae-48d3-b09f-448e2b30cdc9 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:50.864978 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-449eb19b-e7dc-488b-b07c-ad5a8d7f369c req-7be9ca5f-c0ae-48d3-b09f-448e2b30cdc9 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:50.865496 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-449eb19b-e7dc-488b-b07c-ad5a8d7f369c req-7be9ca5f-c0ae-48d3-b09f-448e2b30cdc9 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:50.908266 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-449eb19b-e7dc-488b-b07c-ad5a8d7f369c req-7be9ca5f-c0ae-48d3-b09f-448e2b30cdc9 service nova] Creating event network-changed:60e97be3-b803-4c66-9436-f1a9cc2abcdd for instance 79681d58-1364-42d2-99e4-7fe4965bf625 on n-h2-master-1 Oct 23 01:22:50.924398 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-449eb19b-e7dc-488b-b07c-ad5a8d7f369c req-7be9ca5f-c0ae-48d3-b09f-448e2b30cdc9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141310 Oct 23 01:22:50.925522 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1591/3207] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:22:50.932947 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4c753e46-fa6d-4994-b473-76042e8e1537 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:50.933910 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4c753e46-fa6d-4994-b473-76042e8e1537 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:50.940927 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4c753e46-fa6d-4994-b473-76042e8e1537 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:50.941669 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4c753e46-fa6d-4994-b473-76042e8e1537 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:50.942619 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4c753e46-fa6d-4994-b473-76042e8e1537 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:50.943353 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4c753e46-fa6d-4994-b473-76042e8e1537 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:50.943808 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4c753e46-fa6d-4994-b473-76042e8e1537 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:50.944854 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4c753e46-fa6d-4994-b473-76042e8e1537 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:51.233380 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4c753e46-fa6d-4994-b473-76042e8e1537 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:51.243638 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4c753e46-fa6d-4994-b473-76042e8e1537 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:51.245099 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4c753e46-fa6d-4994-b473-76042e8e1537 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:51.247824 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-173a54d9-6c5f-4353-a062-e32cc1006791 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "DELETE /compute/v2.1/images/69ae47c2-2bf5-4e8b-bee1-015fb0ad2210" status: 204 len: 0 microversion: 2.1 time: 0.473392 Oct 23 01:22:51.248104 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1617/3208] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:50 2022] DELETE /compute/v2.1/images/69ae47c2-2bf5-4e8b-bee1-015fb0ad2210 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:22:51.253462 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ac57861e-5747-4270-9733-abd3e58164ff tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:51.254237 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ac57861e-5747-4270-9733-abd3e58164ff tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:51.257394 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4c753e46-fa6d-4994-b473-76042e8e1537 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1878 microversion: 2.42 time: 0.319983 Oct 23 01:22:51.258735 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1592/3209] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:22:50 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1878 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:22:51.274697 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0055ca92-d85c-49f7-8ed0-3699de259810 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:51.274697 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0055ca92-d85c-49f7-8ed0-3699de259810 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] [instance: 3af7691f-0f59-4507-b9ea-17103f46c27e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:51.274889 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac57861e-5747-4270-9733-abd3e58164ff tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:51.274889 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac57861e-5747-4270-9733-abd3e58164ff tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:51.274889 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac57861e-5747-4270-9733-abd3e58164ff tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:51.274889 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac57861e-5747-4270-9733-abd3e58164ff tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:51.274889 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac57861e-5747-4270-9733-abd3e58164ff tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:51.274889 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac57861e-5747-4270-9733-abd3e58164ff tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:51.276967 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0055ca92-d85c-49f7-8ed0-3699de259810 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:51.280991 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0055ca92-d85c-49f7-8ed0-3699de259810 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:51.280991 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0055ca92-d85c-49f7-8ed0-3699de259810 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:51.286910 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0055ca92-d85c-49f7-8ed0-3699de259810 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:51.287462 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0055ca92-d85c-49f7-8ed0-3699de259810 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:51.288780 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0055ca92-d85c-49f7-8ed0-3699de259810 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:51.330650 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0055ca92-d85c-49f7-8ed0-3699de259810 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] [instance: 3af7691f-0f59-4507-b9ea-17103f46c27e] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:22:51.363110 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ac57861e-5747-4270-9733-abd3e58164ff tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:51.373555 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ac57861e-5747-4270-9733-abd3e58164ff tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1242 microversion: 2.1 time: 0.124204 Oct 23 01:22:51.374221 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1618/3210] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:51 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1242 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:51.379304 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1a402a68-391c-4580-978e-f61b901dbe2d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:51.379812 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1a402a68-391c-4580-978e-f61b901dbe2d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: cce77239-7b98-4389-946e-8292bf160194] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:51.391320 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1a402a68-391c-4580-978e-f61b901dbe2d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:51.391320 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1a402a68-391c-4580-978e-f61b901dbe2d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:51.391320 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1a402a68-391c-4580-978e-f61b901dbe2d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:51.391320 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1a402a68-391c-4580-978e-f61b901dbe2d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:51.391320 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1a402a68-391c-4580-978e-f61b901dbe2d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:51.391320 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1a402a68-391c-4580-978e-f61b901dbe2d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:51.411755 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-1a402a68-391c-4580-978e-f61b901dbe2d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] HTTP exception thrown: Instance cce77239-7b98-4389-946e-8292bf160194 could not be found. Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1a402a68-391c-4580-978e-f61b901dbe2d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Request method failure captured: Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/servers/cce77239-7b98-4389-946e-8292bf160194 HTTP/1.1 Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJZEAurAeILsYJek3MCv_ryiTbidOLVZq6W4I7jJxeY_1_bTWRye2xM3EDOhowd_NyioevvIvzT9beBCgKqri_ZjLw9hdsIISMXmajO_VmobATT_GwpY_Y-GVylQtV9MoF1-Bup_Ahjld_2riQHnDzqLUWULm2acZYcK9UIbslVsdDU Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}] Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: cd6a6c5240f94ace91e1f0ed3e53fa7c Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: exception: Instance cce77239-7b98-4389-946e-8292bf160194 could not be found. Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'cce77239-7b98-4389-946e-8292bf160194'} Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cce77239-7b98-4389-946e-8292bf160194 could not be found. Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:22:51.413934 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:22:51.423987 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cce77239-7b98-4389-946e-8292bf160194 could not be found. Oct 23 01:22:51.423987 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:22:51.423987 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:22:51.423987 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:22:51.423987 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:22:51.423987 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:22:51.423987 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:22:51.423987 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:22:51.423987 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:22:51.423987 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cce77239-7b98-4389-946e-8292bf160194 could not be found. Oct 23 01:22:51.423987 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:22:51.423987 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1a402a68-391c-4580-978e-f61b901dbe2d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Returning 404 to user: Instance cce77239-7b98-4389-946e-8292bf160194 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:22:51.423987 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1a402a68-391c-4580-978e-f61b901dbe2d tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "DELETE /compute/v2.1/servers/cce77239-7b98-4389-946e-8292bf160194" status: 404 len: 111 microversion: 2.1 time: 0.040540 Oct 23 01:22:51.423987 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1619/3211] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:22:51 2022] DELETE /compute/v2.1/servers/cce77239-7b98-4389-946e-8292bf160194 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:22:51.433365 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d9857148-e53b-4cdb-b878-8acedd37c512 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc174f310>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-d9857148-e53b-4cdb-b878-8acedd37c512 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] HTTP exception thrown: Image not found. Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d9857148-e53b-4cdb-b878-8acedd37c512 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Request method failure captured: Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/images/69ae47c2-2bf5-4e8b-bee1-015fb0ad2210 HTTP/1.1 Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJX7oG_-NoIyIEUCGEKOm-ZSU72famr5yoDILLNePut_DL_3k_PnsEavv2TmsQSFm35k3Fu45TPlv7dICjEoTIb1EL-5tIQBr9VKjw1DYfXzc-CSkypChB5gjaj2o2v1qRku6UVlPiA8dos_KOVi1KUitKTyxYLFMCu3mKpc9neV8xU Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 50bd4c137b6a42488f39d173d46520dd Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ImagesTestJSON-1961542935 Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/50bd4c137b6a42488f39d173d46520dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_50bd4c137b6a42488f39d173d46520dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/50bd4c137b6a42488f39d173d46520dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/50bd4c137b6a42488f39d173d46520dd"}]}] Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ImagesTestJSON-1961542935 Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 50bd4c137b6a42488f39d173d46520dd Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ImagesTestJSON-1961542935 Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ImagesTestJSON-1961542935-project Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: ecb97fa679eb4bf8a41862d3c248a217 Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ImagesTestJSON-1961542935-project Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: method: Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: exception: Image not found. Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '69ae47c2-2bf5-4e8b-bee1-015fb0ad2210'} Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 69ae47c2-2bf5-4e8b-bee1-015fb0ad2210 Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 23 01:22:51.505746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 23 01:22:51.510532 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 23 01:22:51.510532 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 23 01:22:51.510532 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 23 01:22:51.510532 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 23 01:22:51.510532 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 23 01:22:51.510532 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 23 01:22:51.510532 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 23 01:22:51.510532 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 23 01:22:51.510532 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 23 01:22:51.510532 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 23 01:22:51.510532 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 23 01:22:51.510532 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 23 01:22:51.510532 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 23 01:22:51.510532 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 23 01:22:51.510532 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 23 01:22:51.510532 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 23 01:22:51.510532 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 23 01:22:51.510532 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 23 01:22:51.510532 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 69ae47c2-2bf5-4e8b-bee1-015fb0ad2210 could not be found. Oct 23 01:22:51.510532 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:22:51.510532 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:22:51.510532 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:22:51.510532 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:22:51.510532 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:22:51.510532 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:22:51.510532 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:22:51.510532 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:22:51.510532 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:22:51.510532 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:22:51.510532 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:22:51.510532 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:22:51.510532 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 23 01:22:51.510532 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 23 01:22:51.510532 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 23 01:22:51.510532 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:22:51.510532 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:22:51.510532 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:22:51.510532 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:22:51.510532 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:22:51.510532 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:22:51.510532 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:22:51.510532 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:22:51.510532 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 23 01:22:51.510532 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:22:51.510532 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d9857148-e53b-4cdb-b878-8acedd37c512 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Returning 404 to user: Image not found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:22:51.510532 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d9857148-e53b-4cdb-b878-8acedd37c512 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/images/69ae47c2-2bf5-4e8b-bee1-015fb0ad2210" status: 404 len: 62 microversion: 2.1 time: 0.090192 Oct 23 01:22:51.510532 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1620/3212] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:22:51 2022] GET /compute/v2.1/images/69ae47c2-2bf5-4e8b-bee1-015fb0ad2210 => generated 62 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:22:51.544156 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5625d96f-ed65-44fc-891c-22fa8137ddf8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:51.545857 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5625d96f-ed65-44fc-891c-22fa8137ddf8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: cce77239-7b98-4389-946e-8292bf160194] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:51.552671 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5625d96f-ed65-44fc-891c-22fa8137ddf8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:51.553313 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5625d96f-ed65-44fc-891c-22fa8137ddf8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:51.554188 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5625d96f-ed65-44fc-891c-22fa8137ddf8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:51.555073 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5625d96f-ed65-44fc-891c-22fa8137ddf8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:51.555606 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5625d96f-ed65-44fc-891c-22fa8137ddf8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:51.556110 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5625d96f-ed65-44fc-891c-22fa8137ddf8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:51.574984 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-5625d96f-ed65-44fc-891c-22fa8137ddf8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] HTTP exception thrown: Instance cce77239-7b98-4389-946e-8292bf160194 could not be found. Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5625d96f-ed65-44fc-891c-22fa8137ddf8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Request method failure captured: Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/cce77239-7b98-4389-946e-8292bf160194 HTTP/1.1 Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJZEAurAeILsYJek3MCv_ryiTbidOLVZq6W4I7jJxeY_1_bTWRye2xM3EDOhowd_NyioevvIvzT9beBCgKqri_ZjLw9hdsIISMXmajO_VmobATT_GwpY_Y-GVylQtV9MoF1-Bup_Ahjld_2riQHnDzqLUWULm2acZYcK9UIbslVsdDU Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}] Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: cd6a6c5240f94ace91e1f0ed3e53fa7c Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: exception: Instance cce77239-7b98-4389-946e-8292bf160194 could not be found. Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'cce77239-7b98-4389-946e-8292bf160194'} Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cce77239-7b98-4389-946e-8292bf160194 could not be found. Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cce77239-7b98-4389-946e-8292bf160194 could not be found. Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:22:51.576786 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:22:51.581683 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:22:51.581683 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:22:51.581683 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:22:51.581683 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:22:51.581683 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:22:51.581683 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cce77239-7b98-4389-946e-8292bf160194 could not be found. Oct 23 01:22:51.581683 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:22:51.581683 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5625d96f-ed65-44fc-891c-22fa8137ddf8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Returning 404 to user: Instance cce77239-7b98-4389-946e-8292bf160194 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:22:51.581683 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5625d96f-ed65-44fc-891c-22fa8137ddf8 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/cce77239-7b98-4389-946e-8292bf160194" status: 404 len: 111 microversion: 2.1 time: 0.068481 Oct 23 01:22:51.585439 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1621/3213] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:51 2022] GET /compute/v2.1/servers/cce77239-7b98-4389-946e-8292bf160194 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:22:51.591346 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8e15fda7-48bd-4289-b79f-108a86fc43d9 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:51.595596 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8e15fda7-48bd-4289-b79f-108a86fc43d9 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 1842d55e-825b-4dc8-b3e4-d5eb8ab2b941] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:51.598460 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8e15fda7-48bd-4289-b79f-108a86fc43d9 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:51.598964 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8e15fda7-48bd-4289-b79f-108a86fc43d9 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:51.599454 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8e15fda7-48bd-4289-b79f-108a86fc43d9 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:51.600153 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8e15fda7-48bd-4289-b79f-108a86fc43d9 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:51.600610 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8e15fda7-48bd-4289-b79f-108a86fc43d9 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:51.601037 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8e15fda7-48bd-4289-b79f-108a86fc43d9 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:51.741811 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0055ca92-d85c-49f7-8ed0-3699de259810 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3af7691f-0f59-4507-b9ea-17103f46c27e" status: 204 len: 0 microversion: 2.1 time: 0.481778 Oct 23 01:22:51.743073 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1593/3214] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:22:51 2022] DELETE /compute/v2.1/servers/3af7691f-0f59-4507-b9ea-17103f46c27e => generated 0 bytes in 484 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:22:51.751438 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fd288b19-5810-4b52-ac25-38cf987ebf9f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:51.752300 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-fd288b19-5810-4b52-ac25-38cf987ebf9f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:51.776340 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fd288b19-5810-4b52-ac25-38cf987ebf9f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:51.778330 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fd288b19-5810-4b52-ac25-38cf987ebf9f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:51.778952 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fd288b19-5810-4b52-ac25-38cf987ebf9f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:51.783748 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fd288b19-5810-4b52-ac25-38cf987ebf9f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:51.784171 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fd288b19-5810-4b52-ac25-38cf987ebf9f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:51.784611 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fd288b19-5810-4b52-ac25-38cf987ebf9f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:51.810630 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8e15fda7-48bd-4289-b79f-108a86fc43d9 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:51.823651 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8e15fda7-48bd-4289-b79f-108a86fc43d9 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/1842d55e-825b-4dc8-b3e4-d5eb8ab2b941" status: 200 len: 1500 microversion: 2.1 time: 0.236179 Oct 23 01:22:51.831659 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1622/3215] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:51 2022] GET /compute/v2.1/servers/1842d55e-825b-4dc8-b3e4-d5eb8ab2b941 => generated 1500 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:51.838757 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6a2e8ee5-bfde-4ac9-8989-4adf337dabc8 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:51.839434 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6a2e8ee5-bfde-4ac9-8989-4adf337dabc8 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] [instance: 98b17bd5-1bd0-4e2c-b17b-4964e7884942] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:51.847122 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6a2e8ee5-bfde-4ac9-8989-4adf337dabc8 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:51.847928 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6a2e8ee5-bfde-4ac9-8989-4adf337dabc8 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:51.848545 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6a2e8ee5-bfde-4ac9-8989-4adf337dabc8 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:51.849395 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6a2e8ee5-bfde-4ac9-8989-4adf337dabc8 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:51.850059 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6a2e8ee5-bfde-4ac9-8989-4adf337dabc8 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:51.850634 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6a2e8ee5-bfde-4ac9-8989-4adf337dabc8 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:51.884916 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6a2e8ee5-bfde-4ac9-8989-4adf337dabc8 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] [instance: 98b17bd5-1bd0-4e2c-b17b-4964e7884942] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:22:51.886023 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-fd288b19-5810-4b52-ac25-38cf987ebf9f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:22:52.066660 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:22:52.238228 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6a2e8ee5-bfde-4ac9-8989-4adf337dabc8 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] 10.222.0.42 "DELETE /compute/v2.1/servers/98b17bd5-1bd0-4e2c-b17b-4964e7884942" status: 204 len: 0 microversion: 2.1 time: 0.404643 Oct 23 01:22:52.239166 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1623/3216] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:22:51 2022] DELETE /compute/v2.1/servers/98b17bd5-1bd0-4e2c-b17b-4964e7884942 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:22:52.249513 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6057b147-57dc-4114-afb7-feb9955a89d8 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:52.250304 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6057b147-57dc-4114-afb7-feb9955a89d8 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 79681d58-1364-42d2-99e4-7fe4965bf625] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:52.270922 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6057b147-57dc-4114-afb7-feb9955a89d8 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:52.276273 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6057b147-57dc-4114-afb7-feb9955a89d8 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:52.276273 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6057b147-57dc-4114-afb7-feb9955a89d8 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:52.278259 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6057b147-57dc-4114-afb7-feb9955a89d8 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:52.282115 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6057b147-57dc-4114-afb7-feb9955a89d8 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:52.282774 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6057b147-57dc-4114-afb7-feb9955a89d8 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:52.349706 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fd288b19-5810-4b52-ac25-38cf987ebf9f tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "DELETE /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 204 len: 0 microversion: 2.1 time: 0.593146 Oct 23 01:22:52.349706 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1594/3217] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:22:51 2022] DELETE /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:22:52.352843 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0487dd77-708a-4888-9f12-06070970c975 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:52.353689 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0487dd77-708a-4888-9f12-06070970c975 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] [instance: 3af7691f-0f59-4507-b9ea-17103f46c27e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:52.364303 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0487dd77-708a-4888-9f12-06070970c975 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:52.372120 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0487dd77-708a-4888-9f12-06070970c975 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:52.375013 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0487dd77-708a-4888-9f12-06070970c975 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:52.375893 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0487dd77-708a-4888-9f12-06070970c975 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:52.377754 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0487dd77-708a-4888-9f12-06070970c975 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:52.380994 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0487dd77-708a-4888-9f12-06070970c975 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:52.481130 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6057b147-57dc-4114-afb7-feb9955a89d8 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:52.501726 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6057b147-57dc-4114-afb7-feb9955a89d8 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625" status: 200 len: 1321 microversion: 2.1 time: 0.261296 Oct 23 01:22:52.508843 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1624/3218] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:52 2022] GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625 => generated 1321 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:52.517909 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-03b94f20-ffc6-4aa1-aad8-bc153e1ed92f tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:52.522533 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-03b94f20-ffc6-4aa1-aad8-bc153e1ed92f tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:52.535812 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-03b94f20-ffc6-4aa1-aad8-bc153e1ed92f tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:52.536639 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-03b94f20-ffc6-4aa1-aad8-bc153e1ed92f tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:52.537301 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-03b94f20-ffc6-4aa1-aad8-bc153e1ed92f tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:52.538213 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-03b94f20-ffc6-4aa1-aad8-bc153e1ed92f tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:52.538884 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-03b94f20-ffc6-4aa1-aad8-bc153e1ed92f tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:52.539561 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-03b94f20-ffc6-4aa1-aad8-bc153e1ed92f tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:52.804728 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0487dd77-708a-4888-9f12-06070970c975 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bede03a6c44c3cbe86f7a06601d115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1b744484c41c88314112b572ccac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:52.818163 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0487dd77-708a-4888-9f12-06070970c975 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] 10.222.0.42 "GET /compute/v2.1/servers/3af7691f-0f59-4507-b9ea-17103f46c27e" status: 200 len: 1512 microversion: 2.1 time: 0.476062 Oct 23 01:22:52.819636 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1595/3219] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:52 2022] GET /compute/v2.1/servers/3af7691f-0f59-4507-b9ea-17103f46c27e => generated 1512 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:52.831282 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d66dc602-d1b3-49c5-9d00-ee859c03e613 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:52.832730 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d66dc602-d1b3-49c5-9d00-ee859c03e613 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:52.846481 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d66dc602-d1b3-49c5-9d00-ee859c03e613 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:52.847573 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d66dc602-d1b3-49c5-9d00-ee859c03e613 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:52.852433 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d66dc602-d1b3-49c5-9d00-ee859c03e613 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:52.854596 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d66dc602-d1b3-49c5-9d00-ee859c03e613 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:52.855266 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d66dc602-d1b3-49c5-9d00-ee859c03e613 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:52.857666 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d66dc602-d1b3-49c5-9d00-ee859c03e613 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:52.887383 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-03b94f20-ffc6-4aa1-aad8-bc153e1ed92f tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:52.903545 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-03b94f20-ffc6-4aa1-aad8-bc153e1ed92f tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:52.907125 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-03b94f20-ffc6-4aa1-aad8-bc153e1ed92f tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:52.911294 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-03b94f20-ffc6-4aa1-aad8-bc153e1ed92f tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1878 microversion: 2.42 time: 0.399612 Oct 23 01:22:52.913672 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1625/3220] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:22:52 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1878 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:22:52.926123 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-88092182-8569-45ad-bacb-a22e3c8b19ae tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:52.927504 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-88092182-8569-45ad-bacb-a22e3c8b19ae tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:52.941441 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-88092182-8569-45ad-bacb-a22e3c8b19ae tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:52.942053 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-88092182-8569-45ad-bacb-a22e3c8b19ae tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:52.942513 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-88092182-8569-45ad-bacb-a22e3c8b19ae tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:52.943215 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-88092182-8569-45ad-bacb-a22e3c8b19ae tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:52.943676 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-88092182-8569-45ad-bacb-a22e3c8b19ae tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:52.944638 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-88092182-8569-45ad-bacb-a22e3c8b19ae tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:53.039916 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-88092182-8569-45ad-bacb-a22e3c8b19ae tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:53.051634 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-88092182-8569-45ad-bacb-a22e3c8b19ae tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1290 microversion: 2.1 time: 0.134903 Oct 23 01:22:53.053080 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1626/3221] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:52 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1290 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:53.179104 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d66dc602-d1b3-49c5-9d00-ee859c03e613 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:53.192713 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d66dc602-d1b3-49c5-9d00-ee859c03e613 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1511 microversion: 2.1 time: 0.370198 Oct 23 01:22:53.194912 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1596/3222] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:52 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1511 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:53.213967 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-da877efc-5afe-44eb-a1fa-7dae86163671 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:53.216427 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-da877efc-5afe-44eb-a1fa-7dae86163671 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 1842d55e-825b-4dc8-b3e4-d5eb8ab2b941] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:53.222529 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c6b643c2-5af6-45fd-bf1b-50a8741c50fc tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Action: 'create', calling method: .version_select at 0x7f5cc174f1f0>, body: {"keypair": {"name": "tempest-keypair-620645861", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJRmv34VrtBpdVdiYWS+5Q7Um5kW+JXqTvdeInuNz8HA9zw0bKxlUiqF9aeoLMmPRLorn0t/OXd1iUlz4iB5Se5xyI0SDelOTWLpYWgJzt83V3qH+RkbNpVo2Fp8m751hg=="}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:22:53.230324 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da877efc-5afe-44eb-a1fa-7dae86163671 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:53.231242 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da877efc-5afe-44eb-a1fa-7dae86163671 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:53.232524 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da877efc-5afe-44eb-a1fa-7dae86163671 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:53.235464 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da877efc-5afe-44eb-a1fa-7dae86163671 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:53.235960 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da877efc-5afe-44eb-a1fa-7dae86163671 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:53.236322 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da877efc-5afe-44eb-a1fa-7dae86163671 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:53.243123 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-c6b643c2-5af6-45fd-bf1b-50a8741c50fc tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Getting quotas for project 0a369d45e4804ffca2e89cb72f447a82. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:22:53.253551 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-c6b643c2-5af6-45fd-bf1b-50a8741c50fc tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Getting quotas for user 60276a4031ee45ffa651b5467a62a81b and project 0a369d45e4804ffca2e89cb72f447a82. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:22:53.346227 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c6b643c2-5af6-45fd-bf1b-50a8741c50fc tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.279581 Oct 23 01:22:53.355820 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1627/3223] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 01:22:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:22:53.471616 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-acbd2480-b3c6-48d0-83e3-19175e63710c req-ffc691ce-4f9a-4fdb-970b-7c874387311b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1842d55e-825b-4dc8-b3e4-d5eb8ab2b941", "name": "network-vif-plugged", "status": "completed", "tag": "fdb229eb-24a1-4e18-afed-ef66e8ce931d"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:22:53.493356 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-acbd2480-b3c6-48d0-83e3-19175e63710c req-ffc691ce-4f9a-4fdb-970b-7c874387311b service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:53.494672 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-acbd2480-b3c6-48d0-83e3-19175e63710c req-ffc691ce-4f9a-4fdb-970b-7c874387311b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:53.495955 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-acbd2480-b3c6-48d0-83e3-19175e63710c req-ffc691ce-4f9a-4fdb-970b-7c874387311b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:53.513609 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-acbd2480-b3c6-48d0-83e3-19175e63710c req-ffc691ce-4f9a-4fdb-970b-7c874387311b service nova] Creating event network-vif-plugged:fdb229eb-24a1-4e18-afed-ef66e8ce931d for instance 1842d55e-825b-4dc8-b3e4-d5eb8ab2b941 on n-h1-master-1 Oct 23 01:22:53.519743 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-acbd2480-b3c6-48d0-83e3-19175e63710c req-ffc691ce-4f9a-4fdb-970b-7c874387311b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053744 Oct 23 01:22:53.521003 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1628/3224] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:22:53.546198 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d6f8c631-ea6a-459b-8e0d-7edf32470199 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:53.546198 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d6f8c631-ea6a-459b-8e0d-7edf32470199 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 79681d58-1364-42d2-99e4-7fe4965bf625] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:53.546198 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d6f8c631-ea6a-459b-8e0d-7edf32470199 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:53.546198 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d6f8c631-ea6a-459b-8e0d-7edf32470199 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:53.546198 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d6f8c631-ea6a-459b-8e0d-7edf32470199 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:53.546198 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d6f8c631-ea6a-459b-8e0d-7edf32470199 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:53.547735 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d6f8c631-ea6a-459b-8e0d-7edf32470199 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:53.548601 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d6f8c631-ea6a-459b-8e0d-7edf32470199 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:53.607256 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-da877efc-5afe-44eb-a1fa-7dae86163671 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:53.627143 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-da877efc-5afe-44eb-a1fa-7dae86163671 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/1842d55e-825b-4dc8-b3e4-d5eb8ab2b941" status: 200 len: 1500 microversion: 2.1 time: 0.429220 Oct 23 01:22:53.630969 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1597/3225] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:53 2022] GET /compute/v2.1/servers/1842d55e-825b-4dc8-b3e4-d5eb8ab2b941 => generated 1500 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:53.761672 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d6f8c631-ea6a-459b-8e0d-7edf32470199 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:53.782835 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d6f8c631-ea6a-459b-8e0d-7edf32470199 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625" status: 200 len: 1321 microversion: 2.1 time: 0.252920 Oct 23 01:22:53.792373 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1629/3226] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:53 2022] GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625 => generated 1321 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:53.856071 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a284fe43-699d-4eca-9187-4e1ca4e12043 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:53.857392 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a284fe43-699d-4eca-9187-4e1ca4e12043 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] [instance: 3af7691f-0f59-4507-b9ea-17103f46c27e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:53.868351 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a284fe43-699d-4eca-9187-4e1ca4e12043 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:53.869089 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a284fe43-699d-4eca-9187-4e1ca4e12043 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:53.869711 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a284fe43-699d-4eca-9187-4e1ca4e12043 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:53.870689 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a284fe43-699d-4eca-9187-4e1ca4e12043 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:53.871327 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a284fe43-699d-4eca-9187-4e1ca4e12043 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:53.871944 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a284fe43-699d-4eca-9187-4e1ca4e12043 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:53.943575 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f758bc7a-4724-4051-9853-2bd39f0ffc5d tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:53.944314 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f758bc7a-4724-4051-9853-2bd39f0ffc5d tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:53.960098 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f758bc7a-4724-4051-9853-2bd39f0ffc5d tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:53.961785 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f758bc7a-4724-4051-9853-2bd39f0ffc5d tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:53.961921 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f758bc7a-4724-4051-9853-2bd39f0ffc5d tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:53.963978 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f758bc7a-4724-4051-9853-2bd39f0ffc5d tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:53.964573 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f758bc7a-4724-4051-9853-2bd39f0ffc5d tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:53.969842 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f758bc7a-4724-4051-9853-2bd39f0ffc5d tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:54.223944 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a284fe43-699d-4eca-9187-4e1ca4e12043 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bede03a6c44c3cbe86f7a06601d115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1b744484c41c88314112b572ccac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:54.237417 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a284fe43-699d-4eca-9187-4e1ca4e12043 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] 10.222.0.42 "GET /compute/v2.1/servers/3af7691f-0f59-4507-b9ea-17103f46c27e" status: 200 len: 1512 microversion: 2.1 time: 0.395667 Oct 23 01:22:54.245246 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1598/3227] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:53 2022] GET /compute/v2.1/servers/3af7691f-0f59-4507-b9ea-17103f46c27e => generated 1512 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:54.246107 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ac81742b-5c26-4279-9c11-4f86d007f883 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:54.246904 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ac81742b-5c26-4279-9c11-4f86d007f883 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:54.253412 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ac81742b-5c26-4279-9c11-4f86d007f883 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:54.254222 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ac81742b-5c26-4279-9c11-4f86d007f883 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:54.254885 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ac81742b-5c26-4279-9c11-4f86d007f883 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:54.255827 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ac81742b-5c26-4279-9c11-4f86d007f883 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:54.256461 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ac81742b-5c26-4279-9c11-4f86d007f883 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:54.257051 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ac81742b-5c26-4279-9c11-4f86d007f883 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:54.353129 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f758bc7a-4724-4051-9853-2bd39f0ffc5d tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:54.363060 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f758bc7a-4724-4051-9853-2bd39f0ffc5d tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:54.378352 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f758bc7a-4724-4051-9853-2bd39f0ffc5d tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:54.382018 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f758bc7a-4724-4051-9853-2bd39f0ffc5d tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1878 microversion: 2.42 time: 0.444910 Oct 23 01:22:54.382826 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1630/3228] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:22:53 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1878 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:22:54.391955 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a6780786-fdce-4621-8db4-919942ca9f96 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:54.392831 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a6780786-fdce-4621-8db4-919942ca9f96 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:54.412857 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6780786-fdce-4621-8db4-919942ca9f96 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:54.417445 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6780786-fdce-4621-8db4-919942ca9f96 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:54.419148 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6780786-fdce-4621-8db4-919942ca9f96 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:54.420048 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6780786-fdce-4621-8db4-919942ca9f96 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:54.421134 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6780786-fdce-4621-8db4-919942ca9f96 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:54.422185 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6780786-fdce-4621-8db4-919942ca9f96 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:54.428766 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ac81742b-5c26-4279-9c11-4f86d007f883 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:54.448804 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ac81742b-5c26-4279-9c11-4f86d007f883 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1290 microversion: 2.1 time: 0.205858 Oct 23 01:22:54.449695 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1599/3229] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:54 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1290 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:54.654522 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-53fc77f8-936a-4aa0-8d71-24b745d79dd9 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:54.655129 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-53fc77f8-936a-4aa0-8d71-24b745d79dd9 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 1842d55e-825b-4dc8-b3e4-d5eb8ab2b941] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:54.665901 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-53fc77f8-936a-4aa0-8d71-24b745d79dd9 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:54.666687 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-53fc77f8-936a-4aa0-8d71-24b745d79dd9 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:54.668088 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-53fc77f8-936a-4aa0-8d71-24b745d79dd9 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:54.670701 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-53fc77f8-936a-4aa0-8d71-24b745d79dd9 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:54.671497 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-53fc77f8-936a-4aa0-8d71-24b745d79dd9 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:54.674480 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-53fc77f8-936a-4aa0-8d71-24b745d79dd9 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:54.772373 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a6780786-fdce-4621-8db4-919942ca9f96 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:54.790307 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a6780786-fdce-4621-8db4-919942ca9f96 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1511 microversion: 2.1 time: 0.401915 Oct 23 01:22:54.791159 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1631/3230] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:54 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1511 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:54.818461 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-66b3e2ca-3767-499f-b50f-65c55ba69147 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:54.821194 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-66b3e2ca-3767-499f-b50f-65c55ba69147 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 79681d58-1364-42d2-99e4-7fe4965bf625] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:54.832143 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-66b3e2ca-3767-499f-b50f-65c55ba69147 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:54.832849 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-66b3e2ca-3767-499f-b50f-65c55ba69147 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:54.833494 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-66b3e2ca-3767-499f-b50f-65c55ba69147 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:54.834408 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-66b3e2ca-3767-499f-b50f-65c55ba69147 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:54.835029 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-66b3e2ca-3767-499f-b50f-65c55ba69147 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:54.835686 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-66b3e2ca-3767-499f-b50f-65c55ba69147 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:55.078548 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-53fc77f8-936a-4aa0-8d71-24b745d79dd9 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:55.087659 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-53fc77f8-936a-4aa0-8d71-24b745d79dd9 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/1842d55e-825b-4dc8-b3e4-d5eb8ab2b941" status: 200 len: 1487 microversion: 2.1 time: 0.437509 Oct 23 01:22:55.091915 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1600/3231] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:54 2022] GET /compute/v2.1/servers/1842d55e-825b-4dc8-b3e4-d5eb8ab2b941 => generated 1487 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:55.112278 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8e710550-d1ea-4b60-ab1d-98be9374a026 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:55.116489 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8e710550-d1ea-4b60-ab1d-98be9374a026 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 1842d55e-825b-4dc8-b3e4-d5eb8ab2b941] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:55.125390 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8e710550-d1ea-4b60-ab1d-98be9374a026 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:55.130611 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8e710550-d1ea-4b60-ab1d-98be9374a026 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:55.142426 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-66b3e2ca-3767-499f-b50f-65c55ba69147 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:55.143481 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8e710550-d1ea-4b60-ab1d-98be9374a026 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:55.147611 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8e710550-d1ea-4b60-ab1d-98be9374a026 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:55.151724 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-66b3e2ca-3767-499f-b50f-65c55ba69147 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625" status: 200 len: 1321 microversion: 2.1 time: 0.342821 Oct 23 01:22:55.152417 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8e710550-d1ea-4b60-ab1d-98be9374a026 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:55.155614 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8e710550-d1ea-4b60-ab1d-98be9374a026 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:55.169964 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1632/3232] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:54 2022] GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625 => generated 1321 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:55.213524 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8e710550-d1ea-4b60-ab1d-98be9374a026 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 1842d55e-825b-4dc8-b3e4-d5eb8ab2b941] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:22:55.267181 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e807d422-6c9f-44a4-8b82-c5c99465c0c5 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:55.267790 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e807d422-6c9f-44a4-8b82-c5c99465c0c5 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] [instance: 3af7691f-0f59-4507-b9ea-17103f46c27e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:55.275952 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e807d422-6c9f-44a4-8b82-c5c99465c0c5 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:55.279693 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e807d422-6c9f-44a4-8b82-c5c99465c0c5 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:55.280320 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e807d422-6c9f-44a4-8b82-c5c99465c0c5 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:55.281316 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e807d422-6c9f-44a4-8b82-c5c99465c0c5 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:55.283034 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e807d422-6c9f-44a4-8b82-c5c99465c0c5 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:55.283474 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e807d422-6c9f-44a4-8b82-c5c99465c0c5 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:55.530349 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8e710550-d1ea-4b60-ab1d-98be9374a026 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1842d55e-825b-4dc8-b3e4-d5eb8ab2b941" status: 204 len: 0 microversion: 2.1 time: 0.421915 Oct 23 01:22:55.531490 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1601/3233] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:22:55 2022] DELETE /compute/v2.1/servers/1842d55e-825b-4dc8-b3e4-d5eb8ab2b941 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 23 01:22:55.541824 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5e0d267a-3512-4049-b4a4-a33ebe1f4029 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:55.542826 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5e0d267a-3512-4049-b4a4-a33ebe1f4029 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:55.559470 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e0d267a-3512-4049-b4a4-a33ebe1f4029 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:55.560172 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e0d267a-3512-4049-b4a4-a33ebe1f4029 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:55.562559 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e0d267a-3512-4049-b4a4-a33ebe1f4029 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:55.563510 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e0d267a-3512-4049-b4a4-a33ebe1f4029 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:55.564132 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e0d267a-3512-4049-b4a4-a33ebe1f4029 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:55.565878 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e0d267a-3512-4049-b4a4-a33ebe1f4029 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:55.905802 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e807d422-6c9f-44a4-8b82-c5c99465c0c5 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bede03a6c44c3cbe86f7a06601d115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1b744484c41c88314112b572ccac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:55.912456 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:22:55.933797 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e807d422-6c9f-44a4-8b82-c5c99465c0c5 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] 10.222.0.42 "GET /compute/v2.1/servers/3af7691f-0f59-4507-b9ea-17103f46c27e" status: 200 len: 1512 microversion: 2.1 time: 0.667908 Oct 23 01:22:55.935576 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1633/3234] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:55 2022] GET /compute/v2.1/servers/3af7691f-0f59-4507-b9ea-17103f46c27e => generated 1512 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:55.976423 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5fbecc56-1133-4082-96e7-8a17af5d9948 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:55.979189 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5fbecc56-1133-4082-96e7-8a17af5d9948 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:55.988138 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5fbecc56-1133-4082-96e7-8a17af5d9948 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:55.990538 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5fbecc56-1133-4082-96e7-8a17af5d9948 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:55.993838 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5fbecc56-1133-4082-96e7-8a17af5d9948 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:55.993838 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5fbecc56-1133-4082-96e7-8a17af5d9948 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:55.993838 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5fbecc56-1133-4082-96e7-8a17af5d9948 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:55.993838 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5fbecc56-1133-4082-96e7-8a17af5d9948 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:56.176632 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5fbecc56-1133-4082-96e7-8a17af5d9948 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:56.194208 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5fbecc56-1133-4082-96e7-8a17af5d9948 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1296 microversion: 2.1 time: 0.225150 Oct 23 01:22:56.195749 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1634/3235] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:55 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1296 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:56.215768 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-00478c9c-525a-4501-9664-f53913d6f242 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc1892790>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:56.303978 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-00478c9c-525a-4501-9664-f53913d6f242 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] HTTP exception thrown: Image not found. Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-00478c9c-525a-4501-9664-f53913d6f242 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Request method failure captured: Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/images/69ae47c2-2bf5-4e8b-bee1-015fb0ad2210 HTTP/1.1 Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJX7oG_-NoIyIEUCGEKOm-ZSU72famr5yoDILLNePut_DL_3k_PnsEavv2TmsQSFm35k3Fu45TPlv7dICjEoTIb1EL-5tIQBr9VKjw1DYfXzc-CSkypChB5gjaj2o2v1qRku6UVlPiA8dos_KOVi1KUitKTyxYLFMCu3mKpc9neV8xU Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 50bd4c137b6a42488f39d173d46520dd Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ImagesTestJSON-1961542935 Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/50bd4c137b6a42488f39d173d46520dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_50bd4c137b6a42488f39d173d46520dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/50bd4c137b6a42488f39d173d46520dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/50bd4c137b6a42488f39d173d46520dd"}]}] Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ImagesTestJSON-1961542935 Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 50bd4c137b6a42488f39d173d46520dd Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ImagesTestJSON-1961542935 Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ImagesTestJSON-1961542935-project Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: ecb97fa679eb4bf8a41862d3c248a217 Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ImagesTestJSON-1961542935-project Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: method: Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: exception: Image not found. Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '69ae47c2-2bf5-4e8b-bee1-015fb0ad2210'} Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 69ae47c2-2bf5-4e8b-bee1-015fb0ad2210 to delete Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 69ae47c2-2bf5-4e8b-bee1-015fb0ad2210 could not be found. Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:22:56.309172 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:22:56.313808 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:22:56.313808 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:22:56.313808 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:22:56.313808 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:22:56.313808 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:22:56.313808 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:22:56.313808 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:22:56.313808 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:22:56.313808 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 23 01:22:56.313808 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 23 01:22:56.313808 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 23 01:22:56.313808 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:22:56.313808 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:22:56.313808 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:22:56.313808 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:22:56.313808 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:22:56.313808 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:22:56.313808 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:22:56.313808 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:22:56.313808 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 23 01:22:56.313808 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:22:56.313808 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-00478c9c-525a-4501-9664-f53913d6f242 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Returning 404 to user: Image not found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:22:56.313808 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-00478c9c-525a-4501-9664-f53913d6f242 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "DELETE /compute/v2.1/images/69ae47c2-2bf5-4e8b-bee1-015fb0ad2210" status: 404 len: 62 microversion: 2.1 time: 0.114112 Oct 23 01:22:56.313808 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1635/3236] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:56 2022] DELETE /compute/v2.1/images/69ae47c2-2bf5-4e8b-bee1-015fb0ad2210 => generated 62 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:22:56.322258 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-41e675a6-b8cd-4061-82b6-7f6b08b35c57 req-69f0164d-3d9f-411e-b1f3-662434141a8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1842d55e-825b-4dc8-b3e4-d5eb8ab2b941", "name": "network-vif-unplugged", "status": "completed", "tag": "fdb229eb-24a1-4e18-afed-ef66e8ce931d"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:22:56.362525 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-41e675a6-b8cd-4061-82b6-7f6b08b35c57 req-69f0164d-3d9f-411e-b1f3-662434141a8c service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:56.362978 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-41e675a6-b8cd-4061-82b6-7f6b08b35c57 req-69f0164d-3d9f-411e-b1f3-662434141a8c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:56.363425 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-41e675a6-b8cd-4061-82b6-7f6b08b35c57 req-69f0164d-3d9f-411e-b1f3-662434141a8c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:56.377677 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5e0d267a-3512-4049-b4a4-a33ebe1f4029 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:56.397191 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5e0d267a-3512-4049-b4a4-a33ebe1f4029 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:56.408572 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-41e675a6-b8cd-4061-82b6-7f6b08b35c57 req-69f0164d-3d9f-411e-b1f3-662434141a8c service nova] Creating event network-vif-unplugged:fdb229eb-24a1-4e18-afed-ef66e8ce931d for instance 1842d55e-825b-4dc8-b3e4-d5eb8ab2b941 on n-h1-master-1 Oct 23 01:22:56.408993 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5e0d267a-3512-4049-b4a4-a33ebe1f4029 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:56.410551 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5e0d267a-3512-4049-b4a4-a33ebe1f4029 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1878 microversion: 2.42 time: 0.877657 Oct 23 01:22:56.415994 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1602/3237] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:22:55 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1878 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:22:56.420947 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6bb5fd9b-02df-4dc5-98a2-c2a78a5151cf tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:56.426475 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-41e675a6-b8cd-4061-82b6-7f6b08b35c57 req-69f0164d-3d9f-411e-b1f3-662434141a8c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113705 Oct 23 01:22:56.435810 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6bb5fd9b-02df-4dc5-98a2-c2a78a5151cf tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:56.436787 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1636/3238] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:22:56.468958 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6bb5fd9b-02df-4dc5-98a2-c2a78a5151cf tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:56.480649 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e32d13dc-8e8b-4bb3-8851-54deea3b37fb tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:56.481106 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e32d13dc-8e8b-4bb3-8851-54deea3b37fb tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 79681d58-1364-42d2-99e4-7fe4965bf625] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:56.484790 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6bb5fd9b-02df-4dc5-98a2-c2a78a5151cf tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:56.485237 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6bb5fd9b-02df-4dc5-98a2-c2a78a5151cf tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:56.486082 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6bb5fd9b-02df-4dc5-98a2-c2a78a5151cf tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:56.486541 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6bb5fd9b-02df-4dc5-98a2-c2a78a5151cf tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:56.486968 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6bb5fd9b-02df-4dc5-98a2-c2a78a5151cf tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:56.508663 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e32d13dc-8e8b-4bb3-8851-54deea3b37fb tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:56.509099 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e32d13dc-8e8b-4bb3-8851-54deea3b37fb tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:56.515052 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e32d13dc-8e8b-4bb3-8851-54deea3b37fb tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:56.515052 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e32d13dc-8e8b-4bb3-8851-54deea3b37fb tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:56.515052 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e32d13dc-8e8b-4bb3-8851-54deea3b37fb tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:56.515052 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e32d13dc-8e8b-4bb3-8851-54deea3b37fb tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:57.058619 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6bb5fd9b-02df-4dc5-98a2-c2a78a5151cf tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:57.092010 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6bb5fd9b-02df-4dc5-98a2-c2a78a5151cf tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1511 microversion: 2.1 time: 0.674404 Oct 23 01:22:57.092594 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1603/3239] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:56 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1511 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:57.092764 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e32d13dc-8e8b-4bb3-8851-54deea3b37fb tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:57.100735 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e32d13dc-8e8b-4bb3-8851-54deea3b37fb tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625" status: 200 len: 1321 microversion: 2.1 time: 0.659686 Oct 23 01:22:57.101330 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1637/3240] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:56 2022] GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625 => generated 1321 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:57.105945 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-dc81de16-a2c2-4e77-954a-d6244a703f7e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:57.106865 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-dc81de16-a2c2-4e77-954a-d6244a703f7e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 1842d55e-825b-4dc8-b3e4-d5eb8ab2b941] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:57.124190 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-5c31034e-1f06-4c0d-8e5b-b4e2e0059088 req-43a46493-ea1c-4ced-89d1-d4e8882556c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98b17bd5-1bd0-4e2c-b17b-4964e7884942", "name": "network-vif-deleted", "tag": "24dca9c9-3c1a-465a-8733-b14dcb7f51ae"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:22:57.128229 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dc81de16-a2c2-4e77-954a-d6244a703f7e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:57.129036 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dc81de16-a2c2-4e77-954a-d6244a703f7e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:57.129690 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dc81de16-a2c2-4e77-954a-d6244a703f7e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:57.131042 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dc81de16-a2c2-4e77-954a-d6244a703f7e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:57.131724 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dc81de16-a2c2-4e77-954a-d6244a703f7e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:57.132515 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dc81de16-a2c2-4e77-954a-d6244a703f7e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:57.154188 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-5c31034e-1f06-4c0d-8e5b-b4e2e0059088 req-43a46493-ea1c-4ced-89d1-d4e8882556c7 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:57.154680 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-5c31034e-1f06-4c0d-8e5b-b4e2e0059088 req-43a46493-ea1c-4ced-89d1-d4e8882556c7 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:57.155119 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-5c31034e-1f06-4c0d-8e5b-b4e2e0059088 req-43a46493-ea1c-4ced-89d1-d4e8882556c7 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:57.204094 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-5c31034e-1f06-4c0d-8e5b-b4e2e0059088 req-43a46493-ea1c-4ced-89d1-d4e8882556c7 service nova] Creating event network-vif-deleted:24dca9c9-3c1a-465a-8733-b14dcb7f51ae for instance 98b17bd5-1bd0-4e2c-b17b-4964e7884942 on n-h2-master-1 Oct 23 01:22:57.212172 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-dc81de16-a2c2-4e77-954a-d6244a703f7e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 1842d55e-825b-4dc8-b3e4-d5eb8ab2b941] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:22:57.246356 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-5c31034e-1f06-4c0d-8e5b-b4e2e0059088 req-43a46493-ea1c-4ced-89d1-d4e8882556c7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143083 Oct 23 01:22:57.261719 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1638/3241] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:22:57.271345 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a59ae228-1845-4d05-9b57-0efd99b7b91c tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:57.272065 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a59ae228-1845-4d05-9b57-0efd99b7b91c tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] [instance: 3af7691f-0f59-4507-b9ea-17103f46c27e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:57.298074 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a59ae228-1845-4d05-9b57-0efd99b7b91c tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:57.299701 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a59ae228-1845-4d05-9b57-0efd99b7b91c tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:57.300064 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a59ae228-1845-4d05-9b57-0efd99b7b91c tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:57.301133 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a59ae228-1845-4d05-9b57-0efd99b7b91c tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:57.301780 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a59ae228-1845-4d05-9b57-0efd99b7b91c tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:57.302388 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a59ae228-1845-4d05-9b57-0efd99b7b91c tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:57.430910 n-d-master-1 devstack@n-api.service[120945]: INFO nova.compute.api [None req-dc81de16-a2c2-4e77-954a-d6244a703f7e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 1842d55e-825b-4dc8-b3e4-d5eb8ab2b941] Instance is already in deleting state, ignoring this request Oct 23 01:22:57.431789 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-dc81de16-a2c2-4e77-954a-d6244a703f7e tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1842d55e-825b-4dc8-b3e4-d5eb8ab2b941" status: 204 len: 0 microversion: 2.1 time: 0.336298 Oct 23 01:22:57.439268 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1604/3242] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:22:57 2022] DELETE /compute/v2.1/servers/1842d55e-825b-4dc8-b3e4-d5eb8ab2b941 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:22:57.454282 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2f072df1-6e43-411b-afaa-a669148939e7 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:57.455008 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2f072df1-6e43-411b-afaa-a669148939e7 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:57.483313 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2f072df1-6e43-411b-afaa-a669148939e7 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:57.483850 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2f072df1-6e43-411b-afaa-a669148939e7 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:57.485344 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2f072df1-6e43-411b-afaa-a669148939e7 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:57.485344 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2f072df1-6e43-411b-afaa-a669148939e7 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:57.494676 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2f072df1-6e43-411b-afaa-a669148939e7 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:57.495374 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2f072df1-6e43-411b-afaa-a669148939e7 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:58.234552 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2f072df1-6e43-411b-afaa-a669148939e7 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:58.247676 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2f072df1-6e43-411b-afaa-a669148939e7 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1296 microversion: 2.1 time: 0.806767 Oct 23 01:22:58.253458 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1605/3243] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:57 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1296 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:58.254333 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-86cba753-2b27-4bb7-8ffe-40efd6333889 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:58.255175 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-86cba753-2b27-4bb7-8ffe-40efd6333889 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 1842d55e-825b-4dc8-b3e4-d5eb8ab2b941] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:58.262888 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-86cba753-2b27-4bb7-8ffe-40efd6333889 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:58.263970 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-86cba753-2b27-4bb7-8ffe-40efd6333889 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:58.265270 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-86cba753-2b27-4bb7-8ffe-40efd6333889 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:58.266689 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-86cba753-2b27-4bb7-8ffe-40efd6333889 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:58.267609 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-86cba753-2b27-4bb7-8ffe-40efd6333889 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:58.268251 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-86cba753-2b27-4bb7-8ffe-40efd6333889 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:58.583345 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:22:58.668080 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a59ae228-1845-4d05-9b57-0efd99b7b91c tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bede03a6c44c3cbe86f7a06601d115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1b744484c41c88314112b572ccac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:58.681033 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a59ae228-1845-4d05-9b57-0efd99b7b91c tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] 10.222.0.42 "GET /compute/v2.1/servers/3af7691f-0f59-4507-b9ea-17103f46c27e" status: 200 len: 1512 microversion: 2.1 time: 1.415250 Oct 23 01:22:58.681769 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1639/3244] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:57 2022] GET /compute/v2.1/servers/3af7691f-0f59-4507-b9ea-17103f46c27e => generated 1512 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:58.696203 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-387a6c37-ef5d-4ec4-b15d-51fac7750966 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:58.697023 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-387a6c37-ef5d-4ec4-b15d-51fac7750966 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:58.706840 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-387a6c37-ef5d-4ec4-b15d-51fac7750966 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:58.710241 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-387a6c37-ef5d-4ec4-b15d-51fac7750966 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:58.711015 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-387a6c37-ef5d-4ec4-b15d-51fac7750966 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:58.716079 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-387a6c37-ef5d-4ec4-b15d-51fac7750966 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:58.716774 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-387a6c37-ef5d-4ec4-b15d-51fac7750966 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:58.717419 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-387a6c37-ef5d-4ec4-b15d-51fac7750966 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:58.765116 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-86cba753-2b27-4bb7-8ffe-40efd6333889 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:58.783891 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-86cba753-2b27-4bb7-8ffe-40efd6333889 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/1842d55e-825b-4dc8-b3e4-d5eb8ab2b941" status: 200 len: 1493 microversion: 2.1 time: 0.533265 Oct 23 01:22:58.786691 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1606/3245] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:58 2022] GET /compute/v2.1/servers/1842d55e-825b-4dc8-b3e4-d5eb8ab2b941 => generated 1493 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:58.800444 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cec7fa4c-0bae-40bc-88b9-d56190eaff9c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:58.801495 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cec7fa4c-0bae-40bc-88b9-d56190eaff9c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:58.815658 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cec7fa4c-0bae-40bc-88b9-d56190eaff9c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:58.819094 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cec7fa4c-0bae-40bc-88b9-d56190eaff9c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:58.820992 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cec7fa4c-0bae-40bc-88b9-d56190eaff9c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:58.823751 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cec7fa4c-0bae-40bc-88b9-d56190eaff9c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:58.825179 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cec7fa4c-0bae-40bc-88b9-d56190eaff9c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:58.832869 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cec7fa4c-0bae-40bc-88b9-d56190eaff9c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:59.411105 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cec7fa4c-0bae-40bc-88b9-d56190eaff9c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:59.421107 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cec7fa4c-0bae-40bc-88b9-d56190eaff9c tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1511 microversion: 2.1 time: 0.632142 Oct 23 01:22:59.426553 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1607/3246] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:58 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1511 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:22:59.440592 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ec04ab16-c2be-4aa2-831e-125b97e089a2 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:59.452851 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ec04ab16-c2be-4aa2-831e-125b97e089a2 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 79681d58-1364-42d2-99e4-7fe4965bf625] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:59.465037 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec04ab16-c2be-4aa2-831e-125b97e089a2 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:59.465037 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec04ab16-c2be-4aa2-831e-125b97e089a2 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:59.465037 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec04ab16-c2be-4aa2-831e-125b97e089a2 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:59.465356 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec04ab16-c2be-4aa2-831e-125b97e089a2 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:59.480390 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec04ab16-c2be-4aa2-831e-125b97e089a2 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:59.480954 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec04ab16-c2be-4aa2-831e-125b97e089a2 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:59.488693 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-387a6c37-ef5d-4ec4-b15d-51fac7750966 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:59.500369 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:22:59.507519 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-387a6c37-ef5d-4ec4-b15d-51fac7750966 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:59.520335 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-387a6c37-ef5d-4ec4-b15d-51fac7750966 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:22:59.521578 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-387a6c37-ef5d-4ec4-b15d-51fac7750966 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1878 microversion: 2.42 time: 0.838621 Oct 23 01:22:59.530329 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1640/3247] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:22:58 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1878 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:22:59.535708 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-7d48925d-7df5-4c23-afd6-929e97f313f6 req-10b7b62b-3368-434e-b91e-b3367386e5f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3af7691f-0f59-4507-b9ea-17103f46c27e", "name": "network-vif-unplugged", "status": "completed", "tag": "b01274a4-5406-4e64-9c2a-bd952d13d90e"}, {"server_uuid": "3d9196f6-d696-45e0-b7fc-8d1557498393", "name": "network-vif-plugged", "status": "completed", "tag": "dae6ca4c-8045-4763-8841-33c56c0c2212"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:22:59.555654 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:22:59.584781 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-7d48925d-7df5-4c23-afd6-929e97f313f6 req-10b7b62b-3368-434e-b91e-b3367386e5f5 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:59.594863 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-7d48925d-7df5-4c23-afd6-929e97f313f6 req-10b7b62b-3368-434e-b91e-b3367386e5f5 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:59.595785 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-7d48925d-7df5-4c23-afd6-929e97f313f6 req-10b7b62b-3368-434e-b91e-b3367386e5f5 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:59.639543 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-7d48925d-7df5-4c23-afd6-929e97f313f6 req-10b7b62b-3368-434e-b91e-b3367386e5f5 service nova] Creating event network-vif-unplugged:b01274a4-5406-4e64-9c2a-bd952d13d90e for instance 3af7691f-0f59-4507-b9ea-17103f46c27e on n-h1-master-1 Oct 23 01:22:59.640055 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-7d48925d-7df5-4c23-afd6-929e97f313f6 req-10b7b62b-3368-434e-b91e-b3367386e5f5 service nova] Creating event network-vif-plugged:dae6ca4c-8045-4763-8841-33c56c0c2212 for instance 3d9196f6-d696-45e0-b7fc-8d1557498393 on n-h1-master-1 Oct 23 01:22:59.651797 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-7d48925d-7df5-4c23-afd6-929e97f313f6 req-10b7b62b-3368-434e-b91e-b3367386e5f5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.119729 Oct 23 01:22:59.652904 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1641/3248] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:22:59.658454 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f06bf913-4d9f-4d90-8980-eb78ee6deb38 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:22:59.659184 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f06bf913-4d9f-4d90-8980-eb78ee6deb38 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:22:59.681188 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f06bf913-4d9f-4d90-8980-eb78ee6deb38 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:59.681781 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f06bf913-4d9f-4d90-8980-eb78ee6deb38 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:59.686626 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f06bf913-4d9f-4d90-8980-eb78ee6deb38 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:22:59.686626 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f06bf913-4d9f-4d90-8980-eb78ee6deb38 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:22:59.686880 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f06bf913-4d9f-4d90-8980-eb78ee6deb38 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:22:59.687595 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f06bf913-4d9f-4d90-8980-eb78ee6deb38 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:00.132249 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ec04ab16-c2be-4aa2-831e-125b97e089a2 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:00.140220 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ec04ab16-c2be-4aa2-831e-125b97e089a2 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625" status: 200 len: 1321 microversion: 2.1 time: 0.707491 Oct 23 01:23:00.140809 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1608/3249] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:59 2022] GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625 => generated 1321 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:00.165800 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-499e2f86-2a1b-43b5-8d6e-8c2a9a3058c4 req-ae18f910-6e0b-4580-8dea-c7dc3fbee5c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1842d55e-825b-4dc8-b3e4-d5eb8ab2b941", "name": "network-vif-deleted", "tag": "fdb229eb-24a1-4e18-afed-ef66e8ce931d"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:23:00.191848 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-499e2f86-2a1b-43b5-8d6e-8c2a9a3058c4 req-ae18f910-6e0b-4580-8dea-c7dc3fbee5c6 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:00.192602 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-499e2f86-2a1b-43b5-8d6e-8c2a9a3058c4 req-ae18f910-6e0b-4580-8dea-c7dc3fbee5c6 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:00.194076 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-499e2f86-2a1b-43b5-8d6e-8c2a9a3058c4 req-ae18f910-6e0b-4580-8dea-c7dc3fbee5c6 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:00.218624 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-499e2f86-2a1b-43b5-8d6e-8c2a9a3058c4 req-ae18f910-6e0b-4580-8dea-c7dc3fbee5c6 service nova] Creating event network-vif-deleted:fdb229eb-24a1-4e18-afed-ef66e8ce931d for instance 1842d55e-825b-4dc8-b3e4-d5eb8ab2b941 on n-h1-master-1 Oct 23 01:23:00.235921 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-499e2f86-2a1b-43b5-8d6e-8c2a9a3058c4 req-ae18f910-6e0b-4580-8dea-c7dc3fbee5c6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076894 Oct 23 01:23:00.237111 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1609/3250] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:23:00.246876 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-579cc588-2e7d-4553-85af-eb83260c155c tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:00.250708 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-579cc588-2e7d-4553-85af-eb83260c155c tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] [instance: 3af7691f-0f59-4507-b9ea-17103f46c27e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:00.261940 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f06bf913-4d9f-4d90-8980-eb78ee6deb38 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:00.275384 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-579cc588-2e7d-4553-85af-eb83260c155c tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:00.276325 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-579cc588-2e7d-4553-85af-eb83260c155c tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:00.276927 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-579cc588-2e7d-4553-85af-eb83260c155c tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:00.277826 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-579cc588-2e7d-4553-85af-eb83260c155c tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:00.280511 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f06bf913-4d9f-4d90-8980-eb78ee6deb38 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1363 microversion: 2.1 time: 0.623950 Oct 23 01:23:00.281206 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-579cc588-2e7d-4553-85af-eb83260c155c tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:00.281823 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-579cc588-2e7d-4553-85af-eb83260c155c tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:00.282318 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1642/3251] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:22:59 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1363 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:00.303447 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-08775ab6-7a90-49ff-bbd8-2bf9a4bdf061 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:00.305633 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-08775ab6-7a90-49ff-bbd8-2bf9a4bdf061 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 1842d55e-825b-4dc8-b3e4-d5eb8ab2b941] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:00.326148 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-08775ab6-7a90-49ff-bbd8-2bf9a4bdf061 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:00.327546 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-08775ab6-7a90-49ff-bbd8-2bf9a4bdf061 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:00.328163 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-08775ab6-7a90-49ff-bbd8-2bf9a4bdf061 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:00.331227 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-08775ab6-7a90-49ff-bbd8-2bf9a4bdf061 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:00.331935 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-08775ab6-7a90-49ff-bbd8-2bf9a4bdf061 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:00.332570 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-08775ab6-7a90-49ff-bbd8-2bf9a4bdf061 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:00.471591 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-08775ab6-7a90-49ff-bbd8-2bf9a4bdf061 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:00.472387 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-08775ab6-7a90-49ff-bbd8-2bf9a4bdf061 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:00.474943 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-08775ab6-7a90-49ff-bbd8-2bf9a4bdf061 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:00.477132 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-08775ab6-7a90-49ff-bbd8-2bf9a4bdf061 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lazy-loading 'fault' on Instance uuid 1842d55e-825b-4dc8-b3e4-d5eb8ab2b941 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:23:00.510081 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-579cc588-2e7d-4553-85af-eb83260c155c tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bede03a6c44c3cbe86f7a06601d115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1b744484c41c88314112b572ccac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:00.522151 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-579cc588-2e7d-4553-85af-eb83260c155c tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] 10.222.0.42 "GET /compute/v2.1/servers/3af7691f-0f59-4507-b9ea-17103f46c27e" status: 200 len: 1470 microversion: 2.1 time: 0.283611 Oct 23 01:23:00.523212 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1610/3252] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:00 2022] GET /compute/v2.1/servers/3af7691f-0f59-4507-b9ea-17103f46c27e => generated 1470 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:00.528500 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-846cb234-5551-4546-8ae7-8d82793d7273 req-f8c9075e-e038-4cb5-b4d1-51f8b9637114 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3af7691f-0f59-4507-b9ea-17103f46c27e", "name": "network-vif-deleted", "tag": "b01274a4-5406-4e64-9c2a-bd952d13d90e"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:23:00.539162 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-846cb234-5551-4546-8ae7-8d82793d7273 req-f8c9075e-e038-4cb5-b4d1-51f8b9637114 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:00.539776 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-846cb234-5551-4546-8ae7-8d82793d7273 req-f8c9075e-e038-4cb5-b4d1-51f8b9637114 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:00.540598 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-846cb234-5551-4546-8ae7-8d82793d7273 req-f8c9075e-e038-4cb5-b4d1-51f8b9637114 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:00.558216 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-846cb234-5551-4546-8ae7-8d82793d7273 req-f8c9075e-e038-4cb5-b4d1-51f8b9637114 service nova] Creating event network-vif-deleted:b01274a4-5406-4e64-9c2a-bd952d13d90e for instance 3af7691f-0f59-4507-b9ea-17103f46c27e on n-h1-master-1 Oct 23 01:23:00.564236 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-846cb234-5551-4546-8ae7-8d82793d7273 req-f8c9075e-e038-4cb5-b4d1-51f8b9637114 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039174 Oct 23 01:23:00.565399 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1611/3253] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:23:00.571748 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f31a11b7-ac0a-47e1-a1af-489a6c938530 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:00.572793 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f31a11b7-ac0a-47e1-a1af-489a6c938530 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:00.579613 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f31a11b7-ac0a-47e1-a1af-489a6c938530 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:00.580396 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f31a11b7-ac0a-47e1-a1af-489a6c938530 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:00.581011 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f31a11b7-ac0a-47e1-a1af-489a6c938530 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:00.587424 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f31a11b7-ac0a-47e1-a1af-489a6c938530 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:00.587424 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f31a11b7-ac0a-47e1-a1af-489a6c938530 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:00.587424 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f31a11b7-ac0a-47e1-a1af-489a6c938530 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:00.620512 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f31a11b7-ac0a-47e1-a1af-489a6c938530 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:00.621315 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f31a11b7-ac0a-47e1-a1af-489a6c938530 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:00.622163 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f31a11b7-ac0a-47e1-a1af-489a6c938530 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:00.622944 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-f31a11b7-ac0a-47e1-a1af-489a6c938530 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lazy-loading 'fault' on Instance uuid 62a8ad26-f65b-432d-a8da-48264c426335 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:23:00.663735 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-08775ab6-7a90-49ff-bbd8-2bf9a4bdf061 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:00.677889 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-08775ab6-7a90-49ff-bbd8-2bf9a4bdf061 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/1842d55e-825b-4dc8-b3e4-d5eb8ab2b941" status: 200 len: 1297 microversion: 2.1 time: 0.381896 Oct 23 01:23:00.694880 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1643/3254] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:00 2022] GET /compute/v2.1/servers/1842d55e-825b-4dc8-b3e4-d5eb8ab2b941 => generated 1297 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:00.706945 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f31a11b7-ac0a-47e1-a1af-489a6c938530 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:00.708910 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6919da70-9e89-4312-924b-5fa927d37cc5 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:00.709779 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6919da70-9e89-4312-924b-5fa927d37cc5 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:00.713538 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f31a11b7-ac0a-47e1-a1af-489a6c938530 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1306 microversion: 2.1 time: 0.146305 Oct 23 01:23:00.714180 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1612/3255] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:00 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1306 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:00.717220 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6919da70-9e89-4312-924b-5fa927d37cc5 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:00.718220 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6919da70-9e89-4312-924b-5fa927d37cc5 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:00.718969 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6919da70-9e89-4312-924b-5fa927d37cc5 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:00.719982 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6919da70-9e89-4312-924b-5fa927d37cc5 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:00.720684 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6919da70-9e89-4312-924b-5fa927d37cc5 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:00.721317 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6919da70-9e89-4312-924b-5fa927d37cc5 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:01.168216 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6919da70-9e89-4312-924b-5fa927d37cc5 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:01.169522 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f55d77e4-2c44-4214-a2c4-d89726b38569 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:01.170179 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f55d77e4-2c44-4214-a2c4-d89726b38569 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 79681d58-1364-42d2-99e4-7fe4965bf625] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:01.179396 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f55d77e4-2c44-4214-a2c4-d89726b38569 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:01.180414 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f55d77e4-2c44-4214-a2c4-d89726b38569 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:01.180857 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f55d77e4-2c44-4214-a2c4-d89726b38569 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:01.180978 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6919da70-9e89-4312-924b-5fa927d37cc5 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:01.181559 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f55d77e4-2c44-4214-a2c4-d89726b38569 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:01.182039 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f55d77e4-2c44-4214-a2c4-d89726b38569 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:01.182469 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f55d77e4-2c44-4214-a2c4-d89726b38569 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:01.182602 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6919da70-9e89-4312-924b-5fa927d37cc5 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:01.185463 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6919da70-9e89-4312-924b-5fa927d37cc5 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1878 microversion: 2.42 time: 0.486388 Oct 23 01:23:01.186528 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1644/3256] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:23:00 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1878 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:23:01.269255 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7f6508c5-8673-47b8-a597-a22d79e0cc6e tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-691575936", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "bfd27401-e218-45f7-934d-3c3c9ab67b12"}], "security_groups": [{"name": "tempest-securitygroup--1870998399"}], "key_name": "tempest-keypair-620645861", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:23:01.432834 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f55d77e4-2c44-4214-a2c4-d89726b38569 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:01.450630 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f55d77e4-2c44-4214-a2c4-d89726b38569 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625" status: 200 len: 1321 microversion: 2.1 time: 0.286442 Oct 23 01:23:01.454081 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1613/3257] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:01 2022] GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625 => generated 1321 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:23:01.485615 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9ed5dc7f-c839-48c8-9a6a-45c22c064210 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:01.486593 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9ed5dc7f-c839-48c8-9a6a-45c22c064210 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:01.496765 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9ed5dc7f-c839-48c8-9a6a-45c22c064210 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:01.497471 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9ed5dc7f-c839-48c8-9a6a-45c22c064210 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:01.498109 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9ed5dc7f-c839-48c8-9a6a-45c22c064210 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:01.500176 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9ed5dc7f-c839-48c8-9a6a-45c22c064210 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:01.500176 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9ed5dc7f-c839-48c8-9a6a-45c22c064210 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:01.500176 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9ed5dc7f-c839-48c8-9a6a-45c22c064210 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:01.537458 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-7f6508c5-8673-47b8-a597-a22d79e0cc6e tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] validate_networks() for [('bfd27401-e218-45f7-934d-3c3c9ab67b12', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:23:01.805130 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9ed5dc7f-c839-48c8-9a6a-45c22c064210 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:01.818065 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9ed5dc7f-c839-48c8-9a6a-45c22c064210 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1363 microversion: 2.1 time: 0.347145 Oct 23 01:23:01.822760 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1614/3258] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:01 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1363 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:01.835701 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ed25963b-c254-41b0-aad8-dc847f6d77e7 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:01.837286 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ed25963b-c254-41b0-aad8-dc847f6d77e7 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] [instance: 3af7691f-0f59-4507-b9ea-17103f46c27e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:01.853405 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ed25963b-c254-41b0-aad8-dc847f6d77e7 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:01.856314 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ed25963b-c254-41b0-aad8-dc847f6d77e7 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:01.857080 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ed25963b-c254-41b0-aad8-dc847f6d77e7 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:01.857712 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ed25963b-c254-41b0-aad8-dc847f6d77e7 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:01.858317 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ed25963b-c254-41b0-aad8-dc847f6d77e7 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:01.858716 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ed25963b-c254-41b0-aad8-dc847f6d77e7 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:01.912287 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ed25963b-c254-41b0-aad8-dc847f6d77e7 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:01.913199 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ed25963b-c254-41b0-aad8-dc847f6d77e7 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:01.913640 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ed25963b-c254-41b0-aad8-dc847f6d77e7 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:01.914231 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-ed25963b-c254-41b0-aad8-dc847f6d77e7 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lazy-loading 'fault' on Instance uuid 3af7691f-0f59-4507-b9ea-17103f46c27e {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:23:02.057735 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ed25963b-c254-41b0-aad8-dc847f6d77e7 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bede03a6c44c3cbe86f7a06601d115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1b744484c41c88314112b572ccac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:02.069911 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ed25963b-c254-41b0-aad8-dc847f6d77e7 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] 10.222.0.42 "GET /compute/v2.1/servers/3af7691f-0f59-4507-b9ea-17103f46c27e" status: 200 len: 1308 microversion: 2.1 time: 0.245256 Oct 23 01:23:02.071419 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1615/3259] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:01 2022] GET /compute/v2.1/servers/3af7691f-0f59-4507-b9ea-17103f46c27e => generated 1308 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:02.076232 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-ebf8447b-b1fa-4ab8-8b89-bc60271218d1 req-c6785c73-277c-4ed9-ade6-f49f6523445d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79681d58-1364-42d2-99e4-7fe4965bf625", "name": "network-vif-plugged", "status": "completed", "tag": "60e97be3-b803-4c66-9436-f1a9cc2abcdd"}, {"server_uuid": "62a8ad26-f65b-432d-a8da-48264c426335", "name": "network-vif-unplugged", "status": "completed", "tag": "56917629-dd5e-4c91-a45e-1e8e6cd25138"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:23:02.089225 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ebf8447b-b1fa-4ab8-8b89-bc60271218d1 req-c6785c73-277c-4ed9-ade6-f49f6523445d service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:02.089959 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ebf8447b-b1fa-4ab8-8b89-bc60271218d1 req-c6785c73-277c-4ed9-ade6-f49f6523445d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:02.090605 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ebf8447b-b1fa-4ab8-8b89-bc60271218d1 req-c6785c73-277c-4ed9-ade6-f49f6523445d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:02.107497 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-ebf8447b-b1fa-4ab8-8b89-bc60271218d1 req-c6785c73-277c-4ed9-ade6-f49f6523445d service nova] Creating event network-vif-plugged:60e97be3-b803-4c66-9436-f1a9cc2abcdd for instance 79681d58-1364-42d2-99e4-7fe4965bf625 on n-h2-master-1 Oct 23 01:23:02.108001 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-ebf8447b-b1fa-4ab8-8b89-bc60271218d1 req-c6785c73-277c-4ed9-ade6-f49f6523445d service nova] Creating event network-vif-unplugged:56917629-dd5e-4c91-a45e-1e8e6cd25138 for instance 62a8ad26-f65b-432d-a8da-48264c426335 on n-h1-master-1 Oct 23 01:23:02.117935 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-ebf8447b-b1fa-4ab8-8b89-bc60271218d1 req-c6785c73-277c-4ed9-ade6-f49f6523445d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.044477 Oct 23 01:23:02.118592 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1616/3260] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:23:02.128215 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-826ac02a-5d33-42d8-add8-0cf2aa3e8edf tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:02.129143 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-826ac02a-5d33-42d8-add8-0cf2aa3e8edf tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 1842d55e-825b-4dc8-b3e4-d5eb8ab2b941] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:02.135756 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-826ac02a-5d33-42d8-add8-0cf2aa3e8edf tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:02.136392 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-826ac02a-5d33-42d8-add8-0cf2aa3e8edf tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:02.136832 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-826ac02a-5d33-42d8-add8-0cf2aa3e8edf tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:02.137702 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-826ac02a-5d33-42d8-add8-0cf2aa3e8edf tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:02.140875 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-826ac02a-5d33-42d8-add8-0cf2aa3e8edf tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:02.140875 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-826ac02a-5d33-42d8-add8-0cf2aa3e8edf tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:02.175608 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-826ac02a-5d33-42d8-add8-0cf2aa3e8edf tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:02.176272 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-826ac02a-5d33-42d8-add8-0cf2aa3e8edf tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:02.176502 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-826ac02a-5d33-42d8-add8-0cf2aa3e8edf tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:02.177270 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-826ac02a-5d33-42d8-add8-0cf2aa3e8edf tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lazy-loading 'fault' on Instance uuid 1842d55e-825b-4dc8-b3e4-d5eb8ab2b941 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:23:02.202724 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-7f6508c5-8673-47b8-a597-a22d79e0cc6e tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:23:02.209177 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-7f6508c5-8673-47b8-a597-a22d79e0cc6e tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:23:02.209177 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-7f6508c5-8673-47b8-a597-a22d79e0cc6e tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:23:02.209177 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-7f6508c5-8673-47b8-a597-a22d79e0cc6e tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:23:02.209177 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-7f6508c5-8673-47b8-a597-a22d79e0cc6e tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:23:02.223406 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f6508c5-8673-47b8-a597-a22d79e0cc6e tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:02.225159 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f6508c5-8673-47b8-a597-a22d79e0cc6e tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:02.226084 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f6508c5-8673-47b8-a597-a22d79e0cc6e tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:02.227754 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f6508c5-8673-47b8-a597-a22d79e0cc6e tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:02.228553 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f6508c5-8673-47b8-a597-a22d79e0cc6e tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:02.229208 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f6508c5-8673-47b8-a597-a22d79e0cc6e tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:02.263044 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-826ac02a-5d33-42d8-add8-0cf2aa3e8edf tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb97fa679eb4bf8a41862d3c248a217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd4c137b6a42488f39d173d46520dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:02.264723 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:02.277661 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-7f6508c5-8673-47b8-a597-a22d79e0cc6e tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Getting quotas for project 0a369d45e4804ffca2e89cb72f447a82. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:23:02.283443 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-826ac02a-5d33-42d8-add8-0cf2aa3e8edf tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/1842d55e-825b-4dc8-b3e4-d5eb8ab2b941" status: 200 len: 1297 microversion: 2.1 time: 0.157947 Oct 23 01:23:02.286403 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1617/3261] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:02 2022] GET /compute/v2.1/servers/1842d55e-825b-4dc8-b3e4-d5eb8ab2b941 => generated 1297 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:02.289366 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-7f6508c5-8673-47b8-a597-a22d79e0cc6e tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Getting quotas for user 60276a4031ee45ffa651b5467a62a81b and project 0a369d45e4804ffca2e89cb72f447a82. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:23:02.292293 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-076625c9-4091-415c-9190-760ab7021ade tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:02.293093 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-076625c9-4091-415c-9190-760ab7021ade tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:02.301156 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-076625c9-4091-415c-9190-760ab7021ade tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:02.301885 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-076625c9-4091-415c-9190-760ab7021ade tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:02.302529 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-076625c9-4091-415c-9190-760ab7021ade tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:02.313092 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-076625c9-4091-415c-9190-760ab7021ade tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:02.313092 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-076625c9-4091-415c-9190-760ab7021ade tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:02.313092 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-076625c9-4091-415c-9190-760ab7021ade tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:02.315322 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7f6508c5-8673-47b8-a597-a22d79e0cc6e tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:23:02.319611 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7f6508c5-8673-47b8-a597-a22d79e0cc6e tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: 8ce9f585-473f-4f8f-a5e6-7b83b7303ccb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:23:02.385235 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-076625c9-4091-415c-9190-760ab7021ade tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:02.386078 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-076625c9-4091-415c-9190-760ab7021ade tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:02.386078 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-076625c9-4091-415c-9190-760ab7021ade tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:02.388257 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-076625c9-4091-415c-9190-760ab7021ade tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lazy-loading 'fault' on Instance uuid 62a8ad26-f65b-432d-a8da-48264c426335 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:23:02.453203 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-076625c9-4091-415c-9190-760ab7021ade tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6a6c5240f94ace91e1f0ed3e53fa7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c099cb4056b438a9c9dead75e7eb797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:02.465786 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-076625c9-4091-415c-9190-760ab7021ade tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 200 len: 1306 microversion: 2.1 time: 0.177947 Oct 23 01:23:02.479980 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1618/3262] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:02 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 1306 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:02.492652 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cb2c52f1-961c-4d70-b65f-38f9156333ec tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:02.493968 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cb2c52f1-961c-4d70-b65f-38f9156333ec tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:02.503478 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb2c52f1-961c-4d70-b65f-38f9156333ec tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:02.507084 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb2c52f1-961c-4d70-b65f-38f9156333ec tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:02.507084 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb2c52f1-961c-4d70-b65f-38f9156333ec tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:02.507084 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb2c52f1-961c-4d70-b65f-38f9156333ec tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:02.507084 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb2c52f1-961c-4d70-b65f-38f9156333ec tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:02.507084 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb2c52f1-961c-4d70-b65f-38f9156333ec tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:02.522621 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7f6508c5-8673-47b8-a597-a22d79e0cc6e tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.258887 Oct 23 01:23:02.524977 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1645/3263] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:23:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 1262 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 23 01:23:02.535469 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-e736df6c-adac-4f4d-adec-940480354458 req-56a56992-5f47-45d7-8538-39a8390ad23f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62a8ad26-f65b-432d-a8da-48264c426335", "name": "network-vif-deleted", "tag": "56917629-dd5e-4c91-a45e-1e8e6cd25138"}, {"name": "network-changed", "server_uuid": "c48a830d-d375-47f5-8c08-d721f856c8ca", "tag": "ce65010c-1fbf-42ac-84db-f0f7244b8d88"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:23:02.550174 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-e736df6c-adac-4f4d-adec-940480354458 req-56a56992-5f47-45d7-8538-39a8390ad23f service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:02.551040 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-e736df6c-adac-4f4d-adec-940480354458 req-56a56992-5f47-45d7-8538-39a8390ad23f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:02.552136 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-e736df6c-adac-4f4d-adec-940480354458 req-56a56992-5f47-45d7-8538-39a8390ad23f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:02.569605 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-e736df6c-adac-4f4d-adec-940480354458 req-56a56992-5f47-45d7-8538-39a8390ad23f service nova] Creating event network-vif-deleted:56917629-dd5e-4c91-a45e-1e8e6cd25138 for instance 62a8ad26-f65b-432d-a8da-48264c426335 on n-h1-master-1 Oct 23 01:23:02.569605 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-e736df6c-adac-4f4d-adec-940480354458 req-56a56992-5f47-45d7-8538-39a8390ad23f service nova] Creating event network-changed:ce65010c-1fbf-42ac-84db-f0f7244b8d88 for instance c48a830d-d375-47f5-8c08-d721f856c8ca on n-h2-master-1 Oct 23 01:23:02.583797 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-e736df6c-adac-4f4d-adec-940480354458 req-56a56992-5f47-45d7-8538-39a8390ad23f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.056473 Oct 23 01:23:02.584490 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1646/3264] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:23:02.592413 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-76e7c4b7-59ac-4389-b368-2b858ee642ba tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:02.593717 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-76e7c4b7-59ac-4389-b368-2b858ee642ba tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 79681d58-1364-42d2-99e4-7fe4965bf625] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:02.601899 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-76e7c4b7-59ac-4389-b368-2b858ee642ba tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:02.607660 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-76e7c4b7-59ac-4389-b368-2b858ee642ba tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:02.607660 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-76e7c4b7-59ac-4389-b368-2b858ee642ba tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:02.607660 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-76e7c4b7-59ac-4389-b368-2b858ee642ba tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:02.607660 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-76e7c4b7-59ac-4389-b368-2b858ee642ba tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:02.607660 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-76e7c4b7-59ac-4389-b368-2b858ee642ba tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:02.923390 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-76e7c4b7-59ac-4389-b368-2b858ee642ba tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:02.934102 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-76e7c4b7-59ac-4389-b368-2b858ee642ba tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625" status: 200 len: 1321 microversion: 2.1 time: 0.345988 Oct 23 01:23:02.935127 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1647/3265] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:02 2022] GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625 => generated 1321 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:02.947884 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b847272d-b558-421e-be58-cdecd29a8d0f tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:02.949875 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b847272d-b558-421e-be58-cdecd29a8d0f tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: 8ce9f585-473f-4f8f-a5e6-7b83b7303ccb] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:02.978998 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cb2c52f1-961c-4d70-b65f-38f9156333ec tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:02.989012 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cb2c52f1-961c-4d70-b65f-38f9156333ec tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:02.990632 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cb2c52f1-961c-4d70-b65f-38f9156333ec tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:02.991864 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cb2c52f1-961c-4d70-b65f-38f9156333ec tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1878 microversion: 2.42 time: 0.510490 Oct 23 01:23:02.992853 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1619/3266] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:23:02 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1878 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:23:03.011074 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4167df5b-eecf-4ab3-a049-cbaa241ac6ed tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:03.011998 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4167df5b-eecf-4ab3-a049-cbaa241ac6ed tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:03.029647 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4167df5b-eecf-4ab3-a049-cbaa241ac6ed tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:03.031314 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4167df5b-eecf-4ab3-a049-cbaa241ac6ed tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:03.031917 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4167df5b-eecf-4ab3-a049-cbaa241ac6ed tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:03.033635 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4167df5b-eecf-4ab3-a049-cbaa241ac6ed tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:03.041099 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4167df5b-eecf-4ab3-a049-cbaa241ac6ed tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:03.041551 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4167df5b-eecf-4ab3-a049-cbaa241ac6ed tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:03.052153 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b847272d-b558-421e-be58-cdecd29a8d0f tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60276a4031ee45ffa651b5467a62a81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a369d45e4804ffca2e89cb72f447a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:03.060485 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b847272d-b558-421e-be58-cdecd29a8d0f tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb" status: 200 len: 1240 microversion: 2.1 time: 0.124729 Oct 23 01:23:03.068133 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1648/3267] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:02 2022] GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb => generated 1240 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:03.095911 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a71b3e26-7f28-487d-9066-f14dd4558333 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:03.096589 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a71b3e26-7f28-487d-9066-f14dd4558333 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] [instance: 3af7691f-0f59-4507-b9ea-17103f46c27e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:03.107267 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a71b3e26-7f28-487d-9066-f14dd4558333 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:03.107849 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a71b3e26-7f28-487d-9066-f14dd4558333 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:03.108243 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a71b3e26-7f28-487d-9066-f14dd4558333 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:03.109016 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a71b3e26-7f28-487d-9066-f14dd4558333 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:03.115273 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a71b3e26-7f28-487d-9066-f14dd4558333 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:03.115273 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a71b3e26-7f28-487d-9066-f14dd4558333 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:03.218434 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a71b3e26-7f28-487d-9066-f14dd4558333 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:03.219055 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a71b3e26-7f28-487d-9066-f14dd4558333 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:03.220256 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a71b3e26-7f28-487d-9066-f14dd4558333 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:03.220470 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-a71b3e26-7f28-487d-9066-f14dd4558333 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lazy-loading 'fault' on Instance uuid 3af7691f-0f59-4507-b9ea-17103f46c27e {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:23:03.374687 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a71b3e26-7f28-487d-9066-f14dd4558333 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bede03a6c44c3cbe86f7a06601d115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac1b744484c41c88314112b572ccac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:03.387369 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a71b3e26-7f28-487d-9066-f14dd4558333 tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] 10.222.0.42 "GET /compute/v2.1/servers/3af7691f-0f59-4507-b9ea-17103f46c27e" status: 200 len: 1308 microversion: 2.1 time: 0.295633 Oct 23 01:23:03.387988 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1649/3268] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:03 2022] GET /compute/v2.1/servers/3af7691f-0f59-4507-b9ea-17103f46c27e => generated 1308 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:03.399594 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-307840af-f31c-44d7-845a-87e0cb54423f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:03.400218 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-307840af-f31c-44d7-845a-87e0cb54423f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 1842d55e-825b-4dc8-b3e4-d5eb8ab2b941] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:03.411053 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-307840af-f31c-44d7-845a-87e0cb54423f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:03.411550 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-307840af-f31c-44d7-845a-87e0cb54423f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:03.411985 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-307840af-f31c-44d7-845a-87e0cb54423f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:03.412683 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-307840af-f31c-44d7-845a-87e0cb54423f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:03.413145 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-307840af-f31c-44d7-845a-87e0cb54423f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:03.418457 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4167df5b-eecf-4ab3-a049-cbaa241ac6ed tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:03.422439 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-307840af-f31c-44d7-845a-87e0cb54423f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:03.432813 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4167df5b-eecf-4ab3-a049-cbaa241ac6ed tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1363 microversion: 2.1 time: 0.438545 Oct 23 01:23:03.435089 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1620/3269] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:02 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1363 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:03.467096 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-307840af-f31c-44d7-845a-87e0cb54423f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] HTTP exception thrown: Instance 1842d55e-825b-4dc8-b3e4-d5eb8ab2b941 could not be found. Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-307840af-f31c-44d7-845a-87e0cb54423f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Request method failure captured: Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/1842d55e-825b-4dc8-b3e4-d5eb8ab2b941 HTTP/1.1 Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJX7oG_-NoIyIEUCGEKOm-ZSU72famr5yoDILLNePut_DL_3k_PnsEavv2TmsQSFm35k3Fu45TPlv7dICjEoTIb1EL-5tIQBr9VKjw1DYfXzc-CSkypChB5gjaj2o2v1qRku6UVlPiA8dos_KOVi1KUitKTyxYLFMCu3mKpc9neV8xU Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 50bd4c137b6a42488f39d173d46520dd Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ImagesTestJSON-1961542935 Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/50bd4c137b6a42488f39d173d46520dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_50bd4c137b6a42488f39d173d46520dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/50bd4c137b6a42488f39d173d46520dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/50bd4c137b6a42488f39d173d46520dd"}]}] Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ImagesTestJSON-1961542935 Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 50bd4c137b6a42488f39d173d46520dd Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ImagesTestJSON-1961542935 Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ImagesTestJSON-1961542935-project Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: ecb97fa679eb4bf8a41862d3c248a217 Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ImagesTestJSON-1961542935-project Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 1842d55e-825b-4dc8-b3e4-d5eb8ab2b941 could not be found. Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '1842d55e-825b-4dc8-b3e4-d5eb8ab2b941'} Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1842d55e-825b-4dc8-b3e4-d5eb8ab2b941 could not be found. Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1842d55e-825b-4dc8-b3e4-d5eb8ab2b941 could not be found. Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:03.474534 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:03.479272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:23:03.479272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:23:03.479272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:23:03.479272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:23:03.479272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1842d55e-825b-4dc8-b3e4-d5eb8ab2b941 could not be found. Oct 23 01:23:03.479272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:03.481159 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-307840af-f31c-44d7-845a-87e0cb54423f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Returning 404 to user: Instance 1842d55e-825b-4dc8-b3e4-d5eb8ab2b941 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:23:03.488023 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-307840af-f31c-44d7-845a-87e0cb54423f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/1842d55e-825b-4dc8-b3e4-d5eb8ab2b941" status: 404 len: 111 microversion: 2.1 time: 0.098730 Oct 23 01:23:03.489922 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1650/3270] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:03 2022] GET /compute/v2.1/servers/1842d55e-825b-4dc8-b3e4-d5eb8ab2b941 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:23:03.501994 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-302e2926-851b-45d1-9132-993bc352ab34 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:03.503226 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-302e2926-851b-45d1-9132-993bc352ab34 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] [instance: 62a8ad26-f65b-432d-a8da-48264c426335] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:03.512429 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:03.515123 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-302e2926-851b-45d1-9132-993bc352ab34 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:03.515708 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-302e2926-851b-45d1-9132-993bc352ab34 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:03.516798 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-302e2926-851b-45d1-9132-993bc352ab34 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:03.517482 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-302e2926-851b-45d1-9132-993bc352ab34 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:03.517953 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-302e2926-851b-45d1-9132-993bc352ab34 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:03.518469 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-302e2926-851b-45d1-9132-993bc352ab34 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:03.535028 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-302e2926-851b-45d1-9132-993bc352ab34 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] HTTP exception thrown: Instance 62a8ad26-f65b-432d-a8da-48264c426335 could not be found. Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-302e2926-851b-45d1-9132-993bc352ab34 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Request method failure captured: Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 HTTP/1.1 Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJZEAurAeILsYJek3MCv_ryiTbidOLVZq6W4I7jJxeY_1_bTWRye2xM3EDOhowd_NyioevvIvzT9beBCgKqri_ZjLw9hdsIISMXmajO_VmobATT_GwpY_Y-GVylQtV9MoF1-Bup_Ahjld_2riQHnDzqLUWULm2acZYcK9UIbslVsdDU Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c099cb4056b438a9c9dead75e7eb797"}]}] Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 1c099cb4056b438a9c9dead75e7eb797 Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServersNegativeTestJSON-46219804 Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: cd6a6c5240f94ace91e1f0ed3e53fa7c Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServersNegativeTestJSON-46219804-project Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 62a8ad26-f65b-432d-a8da-48264c426335 could not be found. Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '62a8ad26-f65b-432d-a8da-48264c426335'} Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62a8ad26-f65b-432d-a8da-48264c426335 could not be found. Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62a8ad26-f65b-432d-a8da-48264c426335 could not be found. Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:23:03.536709 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:23:03.541647 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:03.541647 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:23:03.541647 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:23:03.541647 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:23:03.541647 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:23:03.541647 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62a8ad26-f65b-432d-a8da-48264c426335 could not be found. Oct 23 01:23:03.541647 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:23:03.543113 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-302e2926-851b-45d1-9132-993bc352ab34 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] Returning 404 to user: Instance 62a8ad26-f65b-432d-a8da-48264c426335 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:23:03.544460 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-302e2926-851b-45d1-9132-993bc352ab34 tempest-ServersNegativeTestJSON-46219804 tempest-ServersNegativeTestJSON-46219804-project] 10.222.0.42 "GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335" status: 404 len: 111 microversion: 2.1 time: 0.048711 Oct 23 01:23:03.545102 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1621/3271] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:03 2022] GET /compute/v2.1/servers/62a8ad26-f65b-432d-a8da-48264c426335 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:23:03.749862 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-05c01ab1-11a2-42e7-b1e5-0268be93c64f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:03.750606 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-05c01ab1-11a2-42e7-b1e5-0268be93c64f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: ff868ee0-f1e4-4c03-a039-c0a6cd548b58] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:03.759719 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-05c01ab1-11a2-42e7-b1e5-0268be93c64f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:03.760235 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-05c01ab1-11a2-42e7-b1e5-0268be93c64f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:03.760731 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-05c01ab1-11a2-42e7-b1e5-0268be93c64f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:03.761451 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-05c01ab1-11a2-42e7-b1e5-0268be93c64f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:03.761997 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-05c01ab1-11a2-42e7-b1e5-0268be93c64f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:03.762498 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-05c01ab1-11a2-42e7-b1e5-0268be93c64f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:03.779326 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-05c01ab1-11a2-42e7-b1e5-0268be93c64f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] HTTP exception thrown: Instance ff868ee0-f1e4-4c03-a039-c0a6cd548b58 could not be found. Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-05c01ab1-11a2-42e7-b1e5-0268be93c64f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Request method failure captured: Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58 HTTP/1.1 Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJX7oG_-NoIyIEUCGEKOm-ZSU72famr5yoDILLNePut_DL_3k_PnsEavv2TmsQSFm35k3Fu45TPlv7dICjEoTIb1EL-5tIQBr9VKjw1DYfXzc-CSkypChB5gjaj2o2v1qRku6UVlPiA8dos_KOVi1KUitKTyxYLFMCu3mKpc9neV8xU Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 50bd4c137b6a42488f39d173d46520dd Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ImagesTestJSON-1961542935 Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/50bd4c137b6a42488f39d173d46520dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_50bd4c137b6a42488f39d173d46520dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/50bd4c137b6a42488f39d173d46520dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/50bd4c137b6a42488f39d173d46520dd"}]}] Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ImagesTestJSON-1961542935 Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 50bd4c137b6a42488f39d173d46520dd Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ImagesTestJSON-1961542935 Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ImagesTestJSON-1961542935-project Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: ecb97fa679eb4bf8a41862d3c248a217 Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ImagesTestJSON-1961542935-project Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: exception: Instance ff868ee0-f1e4-4c03-a039-c0a6cd548b58 could not be found. Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'ff868ee0-f1e4-4c03-a039-c0a6cd548b58'} Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff868ee0-f1e4-4c03-a039-c0a6cd548b58 could not be found. Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:23:03.781047 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff868ee0-f1e4-4c03-a039-c0a6cd548b58 could not be found. Oct 23 01:23:03.787337 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:03.787337 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:23:03.787337 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:03.787337 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:03.787337 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:23:03.787337 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:23:03.787337 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:23:03.787337 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:23:03.787337 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff868ee0-f1e4-4c03-a039-c0a6cd548b58 could not be found. Oct 23 01:23:03.787337 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:03.787337 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-05c01ab1-11a2-42e7-b1e5-0268be93c64f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Returning 404 to user: Instance ff868ee0-f1e4-4c03-a039-c0a6cd548b58 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:23:03.787337 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-05c01ab1-11a2-42e7-b1e5-0268be93c64f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58" status: 404 len: 111 microversion: 2.1 time: 0.037011 Oct 23 01:23:03.787337 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1651/3272] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:23:03 2022] DELETE /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:23:03.793150 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-46ec166b-eccd-41ac-bc14-2bb819c521f6 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:03.793859 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-46ec166b-eccd-41ac-bc14-2bb819c521f6 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: ff868ee0-f1e4-4c03-a039-c0a6cd548b58] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:03.800676 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46ec166b-eccd-41ac-bc14-2bb819c521f6 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:03.801313 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46ec166b-eccd-41ac-bc14-2bb819c521f6 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:03.801753 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46ec166b-eccd-41ac-bc14-2bb819c521f6 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:03.802478 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46ec166b-eccd-41ac-bc14-2bb819c521f6 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:03.802939 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46ec166b-eccd-41ac-bc14-2bb819c521f6 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:03.803357 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46ec166b-eccd-41ac-bc14-2bb819c521f6 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:03.820847 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-46ec166b-eccd-41ac-bc14-2bb819c521f6 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] HTTP exception thrown: Instance ff868ee0-f1e4-4c03-a039-c0a6cd548b58 could not be found. Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-46ec166b-eccd-41ac-bc14-2bb819c521f6 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Request method failure captured: Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58 HTTP/1.1 Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJX7oG_-NoIyIEUCGEKOm-ZSU72famr5yoDILLNePut_DL_3k_PnsEavv2TmsQSFm35k3Fu45TPlv7dICjEoTIb1EL-5tIQBr9VKjw1DYfXzc-CSkypChB5gjaj2o2v1qRku6UVlPiA8dos_KOVi1KUitKTyxYLFMCu3mKpc9neV8xU Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 50bd4c137b6a42488f39d173d46520dd Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ImagesTestJSON-1961542935 Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/50bd4c137b6a42488f39d173d46520dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_50bd4c137b6a42488f39d173d46520dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/50bd4c137b6a42488f39d173d46520dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/50bd4c137b6a42488f39d173d46520dd"}]}] Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ImagesTestJSON-1961542935 Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 50bd4c137b6a42488f39d173d46520dd Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ImagesTestJSON-1961542935 Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ImagesTestJSON-1961542935-project Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: ecb97fa679eb4bf8a41862d3c248a217 Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ImagesTestJSON-1961542935-project Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: exception: Instance ff868ee0-f1e4-4c03-a039-c0a6cd548b58 could not be found. Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'ff868ee0-f1e4-4c03-a039-c0a6cd548b58'} Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff868ee0-f1e4-4c03-a039-c0a6cd548b58 could not be found. Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff868ee0-f1e4-4c03-a039-c0a6cd548b58 could not be found. Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:23:03.822428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:03.826306 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:23:03.826306 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:23:03.826306 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:23:03.826306 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:23:03.826306 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff868ee0-f1e4-4c03-a039-c0a6cd548b58 could not be found. Oct 23 01:23:03.826306 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:23:03.826306 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-46ec166b-eccd-41ac-bc14-2bb819c521f6 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Returning 404 to user: Instance ff868ee0-f1e4-4c03-a039-c0a6cd548b58 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:23:03.826306 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-46ec166b-eccd-41ac-bc14-2bb819c521f6 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58" status: 404 len: 111 microversion: 2.1 time: 0.035513 Oct 23 01:23:03.826306 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1622/3273] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:03 2022] GET /compute/v2.1/servers/ff868ee0-f1e4-4c03-a039-c0a6cd548b58 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 01:23:03.834708 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9c8b676a-2ad6-4361-a635-3f11a3d1721f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc2759f70>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:03.865239 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-9c8b676a-2ad6-4361-a635-3f11a3d1721f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] HTTP exception thrown: Image not found. Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9c8b676a-2ad6-4361-a635-3f11a3d1721f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Request method failure captured: Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/images/d8995b1c-6b8e-4df7-b6c6-6372dcfaadbd HTTP/1.1 Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJX7oG_-NoIyIEUCGEKOm-ZSU72famr5yoDILLNePut_DL_3k_PnsEavv2TmsQSFm35k3Fu45TPlv7dICjEoTIb1EL-5tIQBr9VKjw1DYfXzc-CSkypChB5gjaj2o2v1qRku6UVlPiA8dos_KOVi1KUitKTyxYLFMCu3mKpc9neV8xU Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 50bd4c137b6a42488f39d173d46520dd Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ImagesTestJSON-1961542935 Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/50bd4c137b6a42488f39d173d46520dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_50bd4c137b6a42488f39d173d46520dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/50bd4c137b6a42488f39d173d46520dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/50bd4c137b6a42488f39d173d46520dd"}]}] Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ImagesTestJSON-1961542935 Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 50bd4c137b6a42488f39d173d46520dd Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ImagesTestJSON-1961542935 Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ImagesTestJSON-1961542935-project Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: ecb97fa679eb4bf8a41862d3c248a217 Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ImagesTestJSON-1961542935-project Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: method: Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: exception: Image not found. Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'd8995b1c-6b8e-4df7-b6c6-6372dcfaadbd'} Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d8995b1c-6b8e-4df7-b6c6-6372dcfaadbd to delete Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d8995b1c-6b8e-4df7-b6c6-6372dcfaadbd could not be found. Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:03.867665 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:03.876307 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:23:03.876307 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:23:03.876307 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:23:03.876307 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:23:03.876307 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:23:03.876307 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:23:03.876307 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:23:03.876307 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:23:03.876307 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 23 01:23:03.876307 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 23 01:23:03.876307 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 23 01:23:03.876307 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:03.876307 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:23:03.876307 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:03.876307 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:03.876307 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:23:03.876307 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:23:03.876307 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:23:03.876307 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:23:03.876307 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 23 01:23:03.876307 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:03.876307 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9c8b676a-2ad6-4361-a635-3f11a3d1721f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Returning 404 to user: Image not found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:23:03.876307 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9c8b676a-2ad6-4361-a635-3f11a3d1721f tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "DELETE /compute/v2.1/images/d8995b1c-6b8e-4df7-b6c6-6372dcfaadbd" status: 404 len: 62 microversion: 2.1 time: 0.038601 Oct 23 01:23:03.876307 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1652/3274] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:03 2022] DELETE /compute/v2.1/images/d8995b1c-6b8e-4df7-b6c6-6372dcfaadbd => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:23:03.883179 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-801dd845-b4a5-4af0-a80f-1fc586eb9e1d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:03.883179 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-801dd845-b4a5-4af0-a80f-1fc586eb9e1d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 9a64ad71-9caf-4645-be7a-b56f8f584c2d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:03.886795 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-801dd845-b4a5-4af0-a80f-1fc586eb9e1d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:03.887444 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-801dd845-b4a5-4af0-a80f-1fc586eb9e1d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:03.888036 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-801dd845-b4a5-4af0-a80f-1fc586eb9e1d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:03.888740 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-801dd845-b4a5-4af0-a80f-1fc586eb9e1d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:03.889196 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-801dd845-b4a5-4af0-a80f-1fc586eb9e1d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:03.889649 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-801dd845-b4a5-4af0-a80f-1fc586eb9e1d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:03.903293 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-801dd845-b4a5-4af0-a80f-1fc586eb9e1d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] HTTP exception thrown: Instance 9a64ad71-9caf-4645-be7a-b56f8f584c2d could not be found. Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-801dd845-b4a5-4af0-a80f-1fc586eb9e1d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Request method failure captured: Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/servers/9a64ad71-9caf-4645-be7a-b56f8f584c2d HTTP/1.1 Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJX7oG_-NoIyIEUCGEKOm-ZSU72famr5yoDILLNePut_DL_3k_PnsEavv2TmsQSFm35k3Fu45TPlv7dICjEoTIb1EL-5tIQBr9VKjw1DYfXzc-CSkypChB5gjaj2o2v1qRku6UVlPiA8dos_KOVi1KUitKTyxYLFMCu3mKpc9neV8xU Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 50bd4c137b6a42488f39d173d46520dd Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ImagesTestJSON-1961542935 Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/50bd4c137b6a42488f39d173d46520dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_50bd4c137b6a42488f39d173d46520dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/50bd4c137b6a42488f39d173d46520dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/50bd4c137b6a42488f39d173d46520dd"}]}] Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ImagesTestJSON-1961542935 Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 50bd4c137b6a42488f39d173d46520dd Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ImagesTestJSON-1961542935 Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ImagesTestJSON-1961542935-project Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: ecb97fa679eb4bf8a41862d3c248a217 Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ImagesTestJSON-1961542935-project Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 9a64ad71-9caf-4645-be7a-b56f8f584c2d could not be found. Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '9a64ad71-9caf-4645-be7a-b56f8f584c2d'} Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a64ad71-9caf-4645-be7a-b56f8f584c2d could not be found. Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:23:03.904856 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a64ad71-9caf-4645-be7a-b56f8f584c2d could not be found. Oct 23 01:23:03.912589 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:23:03.912589 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:23:03.912589 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:23:03.912589 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:03.912589 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:23:03.912589 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:23:03.912589 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:23:03.912589 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:23:03.912589 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a64ad71-9caf-4645-be7a-b56f8f584c2d could not be found. Oct 23 01:23:03.912589 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:23:03.912589 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-801dd845-b4a5-4af0-a80f-1fc586eb9e1d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Returning 404 to user: Instance 9a64ad71-9caf-4645-be7a-b56f8f584c2d could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:23:03.912589 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-801dd845-b4a5-4af0-a80f-1fc586eb9e1d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9a64ad71-9caf-4645-be7a-b56f8f584c2d" status: 404 len: 111 microversion: 2.1 time: 0.030746 Oct 23 01:23:03.912589 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1623/3275] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:23:03 2022] DELETE /compute/v2.1/servers/9a64ad71-9caf-4645-be7a-b56f8f584c2d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 01:23:03.914887 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0c06e248-037c-4bf1-b93f-cd55261b8f9d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:03.915532 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0c06e248-037c-4bf1-b93f-cd55261b8f9d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 9a64ad71-9caf-4645-be7a-b56f8f584c2d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:03.922606 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0c06e248-037c-4bf1-b93f-cd55261b8f9d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:03.923096 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0c06e248-037c-4bf1-b93f-cd55261b8f9d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:03.923553 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0c06e248-037c-4bf1-b93f-cd55261b8f9d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:03.924253 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0c06e248-037c-4bf1-b93f-cd55261b8f9d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:03.924710 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0c06e248-037c-4bf1-b93f-cd55261b8f9d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:03.925136 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0c06e248-037c-4bf1-b93f-cd55261b8f9d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:03.939219 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-0c06e248-037c-4bf1-b93f-cd55261b8f9d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] HTTP exception thrown: Instance 9a64ad71-9caf-4645-be7a-b56f8f584c2d could not be found. Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0c06e248-037c-4bf1-b93f-cd55261b8f9d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Request method failure captured: Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/9a64ad71-9caf-4645-be7a-b56f8f584c2d HTTP/1.1 Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJX7oG_-NoIyIEUCGEKOm-ZSU72famr5yoDILLNePut_DL_3k_PnsEavv2TmsQSFm35k3Fu45TPlv7dICjEoTIb1EL-5tIQBr9VKjw1DYfXzc-CSkypChB5gjaj2o2v1qRku6UVlPiA8dos_KOVi1KUitKTyxYLFMCu3mKpc9neV8xU Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 50bd4c137b6a42488f39d173d46520dd Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ImagesTestJSON-1961542935 Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/50bd4c137b6a42488f39d173d46520dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_50bd4c137b6a42488f39d173d46520dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/50bd4c137b6a42488f39d173d46520dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/50bd4c137b6a42488f39d173d46520dd"}]}] Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ImagesTestJSON-1961542935 Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 50bd4c137b6a42488f39d173d46520dd Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ImagesTestJSON-1961542935 Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ImagesTestJSON-1961542935-project Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: ecb97fa679eb4bf8a41862d3c248a217 Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ImagesTestJSON-1961542935-project Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 9a64ad71-9caf-4645-be7a-b56f8f584c2d could not be found. Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '9a64ad71-9caf-4645-be7a-b56f8f584c2d'} Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a64ad71-9caf-4645-be7a-b56f8f584c2d could not be found. Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a64ad71-9caf-4645-be7a-b56f8f584c2d could not be found. Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:03.940801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:03.948903 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:23:03.948903 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:23:03.948903 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:23:03.948903 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:23:03.948903 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a64ad71-9caf-4645-be7a-b56f8f584c2d could not be found. Oct 23 01:23:03.948903 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:03.948903 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0c06e248-037c-4bf1-b93f-cd55261b8f9d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Returning 404 to user: Instance 9a64ad71-9caf-4645-be7a-b56f8f584c2d could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:23:03.948903 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0c06e248-037c-4bf1-b93f-cd55261b8f9d tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/9a64ad71-9caf-4645-be7a-b56f8f584c2d" status: 404 len: 111 microversion: 2.1 time: 0.031251 Oct 23 01:23:03.948903 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1653/3276] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:03 2022] GET /compute/v2.1/servers/9a64ad71-9caf-4645-be7a-b56f8f584c2d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:23:03.951183 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e29273f0-73c4-4efe-8773-7127cf1dac65 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc1ef6a60>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:03.961927 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-49fb2ce2-aff3-47be-8971-7a927fd87f3a tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:03.963024 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-49fb2ce2-aff3-47be-8971-7a927fd87f3a tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 79681d58-1364-42d2-99e4-7fe4965bf625] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:03.969658 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-49fb2ce2-aff3-47be-8971-7a927fd87f3a tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:03.970196 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-49fb2ce2-aff3-47be-8971-7a927fd87f3a tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:03.970790 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-49fb2ce2-aff3-47be-8971-7a927fd87f3a tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:03.971562 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-49fb2ce2-aff3-47be-8971-7a927fd87f3a tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:03.972041 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-49fb2ce2-aff3-47be-8971-7a927fd87f3a tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:03.972476 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-49fb2ce2-aff3-47be-8971-7a927fd87f3a tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:03.973426 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-e29273f0-73c4-4efe-8773-7127cf1dac65 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] HTTP exception thrown: Image not found. Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e29273f0-73c4-4efe-8773-7127cf1dac65 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Request method failure captured: Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/images/797a003c-18f3-460b-ab19-805335e36552 HTTP/1.1 Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJX7oG_-NoIyIEUCGEKOm-ZSU72famr5yoDILLNePut_DL_3k_PnsEavv2TmsQSFm35k3Fu45TPlv7dICjEoTIb1EL-5tIQBr9VKjw1DYfXzc-CSkypChB5gjaj2o2v1qRku6UVlPiA8dos_KOVi1KUitKTyxYLFMCu3mKpc9neV8xU Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 50bd4c137b6a42488f39d173d46520dd Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ImagesTestJSON-1961542935 Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/50bd4c137b6a42488f39d173d46520dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_50bd4c137b6a42488f39d173d46520dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/50bd4c137b6a42488f39d173d46520dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/50bd4c137b6a42488f39d173d46520dd"}]}] Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ImagesTestJSON-1961542935 Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 50bd4c137b6a42488f39d173d46520dd Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ImagesTestJSON-1961542935 Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ImagesTestJSON-1961542935-project Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: ecb97fa679eb4bf8a41862d3c248a217 Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ImagesTestJSON-1961542935-project Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: method: Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: exception: Image not found. Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '797a003c-18f3-460b-ab19-805335e36552'} Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 797a003c-18f3-460b-ab19-805335e36552 to delete Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 797a003c-18f3-460b-ab19-805335e36552 could not be found. Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:23:03.975273 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:03.979250 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:23:03.979250 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:23:03.979250 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:23:03.979250 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:23:03.979250 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:23:03.979250 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:23:03.979250 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:23:03.979250 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:23:03.979250 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 23 01:23:03.979250 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 23 01:23:03.979250 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 23 01:23:03.979250 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:23:03.979250 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:23:03.979250 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:23:03.979250 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:03.979250 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:23:03.979250 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:23:03.979250 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:23:03.979250 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:23:03.979250 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 23 01:23:03.979250 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:23:03.979250 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e29273f0-73c4-4efe-8773-7127cf1dac65 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Returning 404 to user: Image not found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:23:03.979250 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e29273f0-73c4-4efe-8773-7127cf1dac65 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "DELETE /compute/v2.1/images/797a003c-18f3-460b-ab19-805335e36552" status: 404 len: 62 microversion: 2.1 time: 0.029340 Oct 23 01:23:03.979250 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1624/3277] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:03 2022] DELETE /compute/v2.1/images/797a003c-18f3-460b-ab19-805335e36552 => generated 62 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 23 01:23:03.985129 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b1a5cb01-408b-46dd-a1f8-c81c5804e7d4 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:03.986789 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b1a5cb01-408b-46dd-a1f8-c81c5804e7d4 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 8fb6c2f7-737b-4b87-9f6b-58ba7f12e428] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:03.993201 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1a5cb01-408b-46dd-a1f8-c81c5804e7d4 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:03.993694 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1a5cb01-408b-46dd-a1f8-c81c5804e7d4 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:03.994161 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1a5cb01-408b-46dd-a1f8-c81c5804e7d4 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:03.994852 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1a5cb01-408b-46dd-a1f8-c81c5804e7d4 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:03.995304 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1a5cb01-408b-46dd-a1f8-c81c5804e7d4 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:03.995723 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1a5cb01-408b-46dd-a1f8-c81c5804e7d4 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:04.010824 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-b1a5cb01-408b-46dd-a1f8-c81c5804e7d4 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] HTTP exception thrown: Instance 8fb6c2f7-737b-4b87-9f6b-58ba7f12e428 could not be found. Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b1a5cb01-408b-46dd-a1f8-c81c5804e7d4 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Request method failure captured: Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/servers/8fb6c2f7-737b-4b87-9f6b-58ba7f12e428 HTTP/1.1 Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJX7oG_-NoIyIEUCGEKOm-ZSU72famr5yoDILLNePut_DL_3k_PnsEavv2TmsQSFm35k3Fu45TPlv7dICjEoTIb1EL-5tIQBr9VKjw1DYfXzc-CSkypChB5gjaj2o2v1qRku6UVlPiA8dos_KOVi1KUitKTyxYLFMCu3mKpc9neV8xU Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 50bd4c137b6a42488f39d173d46520dd Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ImagesTestJSON-1961542935 Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/50bd4c137b6a42488f39d173d46520dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_50bd4c137b6a42488f39d173d46520dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/50bd4c137b6a42488f39d173d46520dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/50bd4c137b6a42488f39d173d46520dd"}]}] Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ImagesTestJSON-1961542935 Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 50bd4c137b6a42488f39d173d46520dd Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ImagesTestJSON-1961542935 Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ImagesTestJSON-1961542935-project Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: ecb97fa679eb4bf8a41862d3c248a217 Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ImagesTestJSON-1961542935-project Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 8fb6c2f7-737b-4b87-9f6b-58ba7f12e428 could not be found. Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '8fb6c2f7-737b-4b87-9f6b-58ba7f12e428'} Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fb6c2f7-737b-4b87-9f6b-58ba7f12e428 could not be found. Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:23:04.011325 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fb6c2f7-737b-4b87-9f6b-58ba7f12e428 could not be found. Oct 23 01:23:04.015994 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:23:04.015994 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:23:04.015994 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:23:04.015994 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:04.015994 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:23:04.015994 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:23:04.015994 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:23:04.015994 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:23:04.015994 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fb6c2f7-737b-4b87-9f6b-58ba7f12e428 could not be found. Oct 23 01:23:04.015994 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:23:04.015994 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b1a5cb01-408b-46dd-a1f8-c81c5804e7d4 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Returning 404 to user: Instance 8fb6c2f7-737b-4b87-9f6b-58ba7f12e428 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:23:04.015994 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b1a5cb01-408b-46dd-a1f8-c81c5804e7d4 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8fb6c2f7-737b-4b87-9f6b-58ba7f12e428" status: 404 len: 111 microversion: 2.1 time: 0.031252 Oct 23 01:23:04.016721 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1625/3278] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:23:03 2022] DELETE /compute/v2.1/servers/8fb6c2f7-737b-4b87-9f6b-58ba7f12e428 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:23:04.021084 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0d10090c-4ffa-401e-a5ea-4f05008ac7ab tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:04.021692 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0d10090c-4ffa-401e-a5ea-4f05008ac7ab tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 8fb6c2f7-737b-4b87-9f6b-58ba7f12e428] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:04.027556 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d10090c-4ffa-401e-a5ea-4f05008ac7ab tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:04.028041 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d10090c-4ffa-401e-a5ea-4f05008ac7ab tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:04.028474 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d10090c-4ffa-401e-a5ea-4f05008ac7ab tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:04.029157 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d10090c-4ffa-401e-a5ea-4f05008ac7ab tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:04.029812 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d10090c-4ffa-401e-a5ea-4f05008ac7ab tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:04.030078 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d10090c-4ffa-401e-a5ea-4f05008ac7ab tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:04.044597 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-0d10090c-4ffa-401e-a5ea-4f05008ac7ab tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] HTTP exception thrown: Instance 8fb6c2f7-737b-4b87-9f6b-58ba7f12e428 could not be found. Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0d10090c-4ffa-401e-a5ea-4f05008ac7ab tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Request method failure captured: Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/8fb6c2f7-737b-4b87-9f6b-58ba7f12e428 HTTP/1.1 Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJX7oG_-NoIyIEUCGEKOm-ZSU72famr5yoDILLNePut_DL_3k_PnsEavv2TmsQSFm35k3Fu45TPlv7dICjEoTIb1EL-5tIQBr9VKjw1DYfXzc-CSkypChB5gjaj2o2v1qRku6UVlPiA8dos_KOVi1KUitKTyxYLFMCu3mKpc9neV8xU Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 50bd4c137b6a42488f39d173d46520dd Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ImagesTestJSON-1961542935 Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/50bd4c137b6a42488f39d173d46520dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_50bd4c137b6a42488f39d173d46520dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/50bd4c137b6a42488f39d173d46520dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/50bd4c137b6a42488f39d173d46520dd"}]}] Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ImagesTestJSON-1961542935 Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 50bd4c137b6a42488f39d173d46520dd Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ImagesTestJSON-1961542935 Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ImagesTestJSON-1961542935-project Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: ecb97fa679eb4bf8a41862d3c248a217 Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ImagesTestJSON-1961542935-project Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 8fb6c2f7-737b-4b87-9f6b-58ba7f12e428 could not be found. Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '8fb6c2f7-737b-4b87-9f6b-58ba7f12e428'} Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fb6c2f7-737b-4b87-9f6b-58ba7f12e428 could not be found. Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fb6c2f7-737b-4b87-9f6b-58ba7f12e428 could not be found. Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:23:04.046287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:04.051012 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:23:04.051012 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:23:04.051012 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:23:04.051012 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:23:04.051012 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fb6c2f7-737b-4b87-9f6b-58ba7f12e428 could not be found. Oct 23 01:23:04.051012 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:23:04.051012 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0d10090c-4ffa-401e-a5ea-4f05008ac7ab tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Returning 404 to user: Instance 8fb6c2f7-737b-4b87-9f6b-58ba7f12e428 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:23:04.051012 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0d10090c-4ffa-401e-a5ea-4f05008ac7ab tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/8fb6c2f7-737b-4b87-9f6b-58ba7f12e428" status: 404 len: 111 microversion: 2.1 time: 0.031577 Oct 23 01:23:04.051667 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1626/3279] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:04 2022] GET /compute/v2.1/servers/8fb6c2f7-737b-4b87-9f6b-58ba7f12e428 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:23:04.059591 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7a19e607-005c-4d00-959c-9900523f7266 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:04.060286 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7a19e607-005c-4d00-959c-9900523f7266 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:04.066158 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a19e607-005c-4d00-959c-9900523f7266 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:04.066743 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a19e607-005c-4d00-959c-9900523f7266 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:04.067247 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a19e607-005c-4d00-959c-9900523f7266 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:04.068012 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a19e607-005c-4d00-959c-9900523f7266 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:04.068521 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a19e607-005c-4d00-959c-9900523f7266 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:04.069014 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a19e607-005c-4d00-959c-9900523f7266 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:04.391722 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-49fb2ce2-aff3-47be-8971-7a927fd87f3a tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:04.401683 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-49fb2ce2-aff3-47be-8971-7a927fd87f3a tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625" status: 200 len: 1321 microversion: 2.1 time: 0.444605 Oct 23 01:23:04.402291 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1654/3280] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:03 2022] GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625 => generated 1321 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:23:04.416536 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-37932fed-c4f3-48a2-95ce-7e11b6305e7c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc1892670>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:04.449929 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-37932fed-c4f3-48a2-95ce-7e11b6305e7c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] HTTP exception thrown: Image not found. Oct 23 01:23:04.451611 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7a19e607-005c-4d00-959c-9900523f7266 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-37932fed-c4f3-48a2-95ce-7e11b6305e7c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Request method failure captured: Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/images/051dcffd-8f6c-4ce9-9ba8-61db53bafce2 HTTP/1.1 Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJX7oG_-NoIyIEUCGEKOm-ZSU72famr5yoDILLNePut_DL_3k_PnsEavv2TmsQSFm35k3Fu45TPlv7dICjEoTIb1EL-5tIQBr9VKjw1DYfXzc-CSkypChB5gjaj2o2v1qRku6UVlPiA8dos_KOVi1KUitKTyxYLFMCu3mKpc9neV8xU Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 50bd4c137b6a42488f39d173d46520dd Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ImagesTestJSON-1961542935 Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/50bd4c137b6a42488f39d173d46520dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_50bd4c137b6a42488f39d173d46520dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/50bd4c137b6a42488f39d173d46520dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/50bd4c137b6a42488f39d173d46520dd"}]}] Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ImagesTestJSON-1961542935 Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 50bd4c137b6a42488f39d173d46520dd Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ImagesTestJSON-1961542935 Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ImagesTestJSON-1961542935-project Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: ecb97fa679eb4bf8a41862d3c248a217 Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ImagesTestJSON-1961542935-project Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: method: Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: exception: Image not found. Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '051dcffd-8f6c-4ce9-9ba8-61db53bafce2'} Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 051dcffd-8f6c-4ce9-9ba8-61db53bafce2 to delete Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 051dcffd-8f6c-4ce9-9ba8-61db53bafce2 could not be found. Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:04.452077 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:04.459013 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:23:04.459013 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:23:04.459013 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:23:04.459013 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:23:04.459013 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:23:04.459013 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:23:04.459013 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:23:04.459013 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:23:04.459013 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 23 01:23:04.459013 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 23 01:23:04.459013 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 23 01:23:04.459013 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:04.459013 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:23:04.459013 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:04.459013 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:04.459013 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:23:04.459013 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:23:04.459013 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:23:04.459013 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:23:04.459013 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 23 01:23:04.459013 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:04.459013 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-37932fed-c4f3-48a2-95ce-7e11b6305e7c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Returning 404 to user: Image not found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:23:04.459013 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-37932fed-c4f3-48a2-95ce-7e11b6305e7c tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "DELETE /compute/v2.1/images/051dcffd-8f6c-4ce9-9ba8-61db53bafce2" status: 404 len: 62 microversion: 2.1 time: 0.045995 Oct 23 01:23:04.459013 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1655/3281] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:04 2022] DELETE /compute/v2.1/images/051dcffd-8f6c-4ce9-9ba8-61db53bafce2 => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:23:04.462570 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b25f6145-85f1-429b-89e9-4e895c2f35f3 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:04.462570 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b25f6145-85f1-429b-89e9-4e895c2f35f3 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: 8ce9f585-473f-4f8f-a5e6-7b83b7303ccb] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:04.502287 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7a19e607-005c-4d00-959c-9900523f7266 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:04.505442 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7a19e607-005c-4d00-959c-9900523f7266 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:04.506983 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7a19e607-005c-4d00-959c-9900523f7266 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1878 microversion: 2.42 time: 0.451207 Oct 23 01:23:04.510635 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1627/3282] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:23:04 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1878 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:23:04.516135 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b6482b63-7200-46bb-9f21-bc04373dae75 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:04.516951 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b6482b63-7200-46bb-9f21-bc04373dae75 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:04.525059 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b6482b63-7200-46bb-9f21-bc04373dae75 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:04.526576 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b6482b63-7200-46bb-9f21-bc04373dae75 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:04.527251 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b6482b63-7200-46bb-9f21-bc04373dae75 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:04.528238 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b6482b63-7200-46bb-9f21-bc04373dae75 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:04.528926 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b6482b63-7200-46bb-9f21-bc04373dae75 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:04.529651 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b6482b63-7200-46bb-9f21-bc04373dae75 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:04.558758 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b25f6145-85f1-429b-89e9-4e895c2f35f3 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60276a4031ee45ffa651b5467a62a81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a369d45e4804ffca2e89cb72f447a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:04.566452 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b25f6145-85f1-429b-89e9-4e895c2f35f3 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb" status: 200 len: 1240 microversion: 2.1 time: 0.108717 Oct 23 01:23:04.567034 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1656/3283] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:04 2022] GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb => generated 1240 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:04.582891 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6fe3e03d-8ea6-4008-9002-592084c89f51 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:04.586222 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6fe3e03d-8ea6-4008-9002-592084c89f51 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 40104c3d-0e82-449a-a331-c4f6ba80afaf] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:04.605540 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6fe3e03d-8ea6-4008-9002-592084c89f51 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:04.613131 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6fe3e03d-8ea6-4008-9002-592084c89f51 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:04.621500 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6fe3e03d-8ea6-4008-9002-592084c89f51 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:04.630752 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6fe3e03d-8ea6-4008-9002-592084c89f51 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:04.630752 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6fe3e03d-8ea6-4008-9002-592084c89f51 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:04.630752 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6fe3e03d-8ea6-4008-9002-592084c89f51 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:04.645725 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-6fe3e03d-8ea6-4008-9002-592084c89f51 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] HTTP exception thrown: Instance 40104c3d-0e82-449a-a331-c4f6ba80afaf could not be found. Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6fe3e03d-8ea6-4008-9002-592084c89f51 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Request method failure captured: Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf HTTP/1.1 Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJX7oG_-NoIyIEUCGEKOm-ZSU72famr5yoDILLNePut_DL_3k_PnsEavv2TmsQSFm35k3Fu45TPlv7dICjEoTIb1EL-5tIQBr9VKjw1DYfXzc-CSkypChB5gjaj2o2v1qRku6UVlPiA8dos_KOVi1KUitKTyxYLFMCu3mKpc9neV8xU Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 50bd4c137b6a42488f39d173d46520dd Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ImagesTestJSON-1961542935 Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/50bd4c137b6a42488f39d173d46520dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_50bd4c137b6a42488f39d173d46520dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/50bd4c137b6a42488f39d173d46520dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/50bd4c137b6a42488f39d173d46520dd"}]}] Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ImagesTestJSON-1961542935 Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 50bd4c137b6a42488f39d173d46520dd Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ImagesTestJSON-1961542935 Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ImagesTestJSON-1961542935-project Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: ecb97fa679eb4bf8a41862d3c248a217 Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ImagesTestJSON-1961542935-project Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 40104c3d-0e82-449a-a331-c4f6ba80afaf could not be found. Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '40104c3d-0e82-449a-a331-c4f6ba80afaf'} Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40104c3d-0e82-449a-a331-c4f6ba80afaf could not be found. Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:23:04.655878 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40104c3d-0e82-449a-a331-c4f6ba80afaf could not be found. Oct 23 01:23:04.663918 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:04.663918 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:23:04.663918 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:04.663918 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:04.663918 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:23:04.663918 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:23:04.663918 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:23:04.663918 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:23:04.663918 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40104c3d-0e82-449a-a331-c4f6ba80afaf could not be found. Oct 23 01:23:04.663918 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:04.663918 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6fe3e03d-8ea6-4008-9002-592084c89f51 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Returning 404 to user: Instance 40104c3d-0e82-449a-a331-c4f6ba80afaf could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:23:04.663918 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6fe3e03d-8ea6-4008-9002-592084c89f51 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "DELETE /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf" status: 404 len: 111 microversion: 2.1 time: 0.086154 Oct 23 01:23:04.663918 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1657/3284] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:23:04 2022] DELETE /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:23:04.669906 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fb354e6b-5b64-467e-87b1-bc50c96889ce tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:04.670576 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fb354e6b-5b64-467e-87b1-bc50c96889ce tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] [instance: 3af7691f-0f59-4507-b9ea-17103f46c27e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:04.685801 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb354e6b-5b64-467e-87b1-bc50c96889ce tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:04.686329 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb354e6b-5b64-467e-87b1-bc50c96889ce tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:04.686769 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb354e6b-5b64-467e-87b1-bc50c96889ce tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:04.687481 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb354e6b-5b64-467e-87b1-bc50c96889ce tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:04.687940 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb354e6b-5b64-467e-87b1-bc50c96889ce tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:04.688366 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb354e6b-5b64-467e-87b1-bc50c96889ce tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:04.736021 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-fb354e6b-5b64-467e-87b1-bc50c96889ce tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] HTTP exception thrown: Instance 3af7691f-0f59-4507-b9ea-17103f46c27e could not be found. Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fb354e6b-5b64-467e-87b1-bc50c96889ce tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Request method failure captured: Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/3af7691f-0f59-4507-b9ea-17103f46c27e HTTP/1.1 Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJchB0bQY7Y9zbD_hq_YYzNioLQe1LQxmFDK28e291-TXB-BOAAJUZwfftC0gj-qI9OEaOibdRTdFAdie40gVVKAh_BQeMMhV2asUNzFuuEAa2wmOONJAKXm73XzeqWW44G-zmBrFxrJtUOeOF9L907IhaF-sfW_HJwBbW_vjPP5IFM Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 4ac1b744484c41c88314112b572ccac1 Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-MultipleCreateTestJSON-1324838873 Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4ac1b744484c41c88314112b572ccac1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4ac1b744484c41c88314112b572ccac1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4ac1b744484c41c88314112b572ccac1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4ac1b744484c41c88314112b572ccac1"}]}] Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-MultipleCreateTestJSON-1324838873 Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 4ac1b744484c41c88314112b572ccac1 Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1324838873 Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-MultipleCreateTestJSON-1324838873-project Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: a3bede03a6c44c3cbe86f7a06601d115 Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-MultipleCreateTestJSON-1324838873-project Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 3af7691f-0f59-4507-b9ea-17103f46c27e could not be found. Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '3af7691f-0f59-4507-b9ea-17103f46c27e'} Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3af7691f-0f59-4507-b9ea-17103f46c27e could not be found. Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3af7691f-0f59-4507-b9ea-17103f46c27e could not be found. Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:23:04.738331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:04.743008 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:04.743008 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:23:04.743008 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:23:04.743008 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:23:04.743008 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:23:04.743008 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3af7691f-0f59-4507-b9ea-17103f46c27e could not be found. Oct 23 01:23:04.743008 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:04.743008 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fb354e6b-5b64-467e-87b1-bc50c96889ce tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Returning 404 to user: Instance 3af7691f-0f59-4507-b9ea-17103f46c27e could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:23:04.743008 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fb354e6b-5b64-467e-87b1-bc50c96889ce tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] 10.222.0.42 "GET /compute/v2.1/servers/3af7691f-0f59-4507-b9ea-17103f46c27e" status: 404 len: 111 microversion: 2.1 time: 0.077169 Oct 23 01:23:04.748633 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1658/3285] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:04 2022] GET /compute/v2.1/servers/3af7691f-0f59-4507-b9ea-17103f46c27e => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:23:04.753652 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0f0baa50-f59e-45aa-9ebf-acd8bd509db9 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:04.754300 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0f0baa50-f59e-45aa-9ebf-acd8bd509db9 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 40104c3d-0e82-449a-a331-c4f6ba80afaf] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:04.761859 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0f0baa50-f59e-45aa-9ebf-acd8bd509db9 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:04.762380 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0f0baa50-f59e-45aa-9ebf-acd8bd509db9 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:04.762820 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0f0baa50-f59e-45aa-9ebf-acd8bd509db9 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:04.763526 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0f0baa50-f59e-45aa-9ebf-acd8bd509db9 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:04.763982 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0f0baa50-f59e-45aa-9ebf-acd8bd509db9 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:04.764411 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0f0baa50-f59e-45aa-9ebf-acd8bd509db9 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:04.782534 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-0f0baa50-f59e-45aa-9ebf-acd8bd509db9 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] HTTP exception thrown: Instance 40104c3d-0e82-449a-a331-c4f6ba80afaf could not be found. Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0f0baa50-f59e-45aa-9ebf-acd8bd509db9 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Request method failure captured: Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf HTTP/1.1 Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJX7oG_-NoIyIEUCGEKOm-ZSU72famr5yoDILLNePut_DL_3k_PnsEavv2TmsQSFm35k3Fu45TPlv7dICjEoTIb1EL-5tIQBr9VKjw1DYfXzc-CSkypChB5gjaj2o2v1qRku6UVlPiA8dos_KOVi1KUitKTyxYLFMCu3mKpc9neV8xU Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 50bd4c137b6a42488f39d173d46520dd Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ImagesTestJSON-1961542935 Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/50bd4c137b6a42488f39d173d46520dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_50bd4c137b6a42488f39d173d46520dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/50bd4c137b6a42488f39d173d46520dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/50bd4c137b6a42488f39d173d46520dd"}]}] Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ImagesTestJSON-1961542935 Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 50bd4c137b6a42488f39d173d46520dd Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ImagesTestJSON-1961542935 Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ImagesTestJSON-1961542935-project Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: ecb97fa679eb4bf8a41862d3c248a217 Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ImagesTestJSON-1961542935-project Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 40104c3d-0e82-449a-a331-c4f6ba80afaf could not be found. Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '40104c3d-0e82-449a-a331-c4f6ba80afaf'} Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40104c3d-0e82-449a-a331-c4f6ba80afaf could not be found. Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40104c3d-0e82-449a-a331-c4f6ba80afaf could not be found. Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:04.789482 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:04.794543 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:23:04.794543 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:23:04.794543 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:23:04.794543 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:23:04.794543 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40104c3d-0e82-449a-a331-c4f6ba80afaf could not be found. Oct 23 01:23:04.794543 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:04.794543 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0f0baa50-f59e-45aa-9ebf-acd8bd509db9 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Returning 404 to user: Instance 40104c3d-0e82-449a-a331-c4f6ba80afaf could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:23:04.794543 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0f0baa50-f59e-45aa-9ebf-acd8bd509db9 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf" status: 404 len: 111 microversion: 2.1 time: 0.035736 Oct 23 01:23:04.794543 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1659/3286] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:04 2022] GET /compute/v2.1/servers/40104c3d-0e82-449a-a331-c4f6ba80afaf => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:23:04.795250 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cd1f6c6c-586d-4f8e-922a-07991e478f0d tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:04.796126 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-cd1f6c6c-586d-4f8e-922a-07991e478f0d tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] [instance: 98b17bd5-1bd0-4e2c-b17b-4964e7884942] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:04.805391 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cd1f6c6c-586d-4f8e-922a-07991e478f0d tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:04.806179 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cd1f6c6c-586d-4f8e-922a-07991e478f0d tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:04.806781 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cd1f6c6c-586d-4f8e-922a-07991e478f0d tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:04.807647 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cd1f6c6c-586d-4f8e-922a-07991e478f0d tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:04.808299 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cd1f6c6c-586d-4f8e-922a-07991e478f0d tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:04.809489 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cd1f6c6c-586d-4f8e-922a-07991e478f0d tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:04.838025 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-cd1f6c6c-586d-4f8e-922a-07991e478f0d tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] HTTP exception thrown: Instance 98b17bd5-1bd0-4e2c-b17b-4964e7884942 could not be found. Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cd1f6c6c-586d-4f8e-922a-07991e478f0d tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Request method failure captured: Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/98b17bd5-1bd0-4e2c-b17b-4964e7884942 HTTP/1.1 Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJchB0bQY7Y9zbD_hq_YYzNioLQe1LQxmFDK28e291-TXB-BOAAJUZwfftC0gj-qI9OEaOibdRTdFAdie40gVVKAh_BQeMMhV2asUNzFuuEAa2wmOONJAKXm73XzeqWW44G-zmBrFxrJtUOeOF9L907IhaF-sfW_HJwBbW_vjPP5IFM Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 4ac1b744484c41c88314112b572ccac1 Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-MultipleCreateTestJSON-1324838873 Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4ac1b744484c41c88314112b572ccac1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4ac1b744484c41c88314112b572ccac1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4ac1b744484c41c88314112b572ccac1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4ac1b744484c41c88314112b572ccac1"}]}] Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-MultipleCreateTestJSON-1324838873 Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 4ac1b744484c41c88314112b572ccac1 Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1324838873 Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-MultipleCreateTestJSON-1324838873-project Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: a3bede03a6c44c3cbe86f7a06601d115 Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-MultipleCreateTestJSON-1324838873-project Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 98b17bd5-1bd0-4e2c-b17b-4964e7884942 could not be found. Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '98b17bd5-1bd0-4e2c-b17b-4964e7884942'} Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98b17bd5-1bd0-4e2c-b17b-4964e7884942 could not be found. Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98b17bd5-1bd0-4e2c-b17b-4964e7884942 could not be found. Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:23:04.843120 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:04.852540 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:04.852540 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:23:04.852540 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:23:04.852540 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:23:04.852540 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:23:04.852540 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98b17bd5-1bd0-4e2c-b17b-4964e7884942 could not be found. Oct 23 01:23:04.852540 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:04.852540 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cd1f6c6c-586d-4f8e-922a-07991e478f0d tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] Returning 404 to user: Instance 98b17bd5-1bd0-4e2c-b17b-4964e7884942 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:23:04.852540 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cd1f6c6c-586d-4f8e-922a-07991e478f0d tempest-MultipleCreateTestJSON-1324838873 tempest-MultipleCreateTestJSON-1324838873-project] 10.222.0.42 "GET /compute/v2.1/servers/98b17bd5-1bd0-4e2c-b17b-4964e7884942" status: 404 len: 111 microversion: 2.1 time: 0.057293 Oct 23 01:23:04.853717 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1660/3287] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:04 2022] GET /compute/v2.1/servers/98b17bd5-1bd0-4e2c-b17b-4964e7884942 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:23:04.859296 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c0c0e754-7b41-43fc-ad44-1f9cb8290555 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '.version_select at 0x7f5cc24665e0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:04.899220 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-c0c0e754-7b41-43fc-ad44-1f9cb8290555 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] HTTP exception thrown: Image not found. Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c0c0e754-7b41-43fc-ad44-1f9cb8290555 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Request method failure captured: Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/images/90d42cdd-cddc-43cd-a2de-f4f225ffb04a HTTP/1.1 Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJX7oG_-NoIyIEUCGEKOm-ZSU72famr5yoDILLNePut_DL_3k_PnsEavv2TmsQSFm35k3Fu45TPlv7dICjEoTIb1EL-5tIQBr9VKjw1DYfXzc-CSkypChB5gjaj2o2v1qRku6UVlPiA8dos_KOVi1KUitKTyxYLFMCu3mKpc9neV8xU Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 50bd4c137b6a42488f39d173d46520dd Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ImagesTestJSON-1961542935 Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/50bd4c137b6a42488f39d173d46520dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_50bd4c137b6a42488f39d173d46520dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/50bd4c137b6a42488f39d173d46520dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/50bd4c137b6a42488f39d173d46520dd"}]}] Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ImagesTestJSON-1961542935 Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 50bd4c137b6a42488f39d173d46520dd Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ImagesTestJSON-1961542935 Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ImagesTestJSON-1961542935-project Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: ecb97fa679eb4bf8a41862d3c248a217 Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ImagesTestJSON-1961542935-project Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: method: Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: exception: Image not found. Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '90d42cdd-cddc-43cd-a2de-f4f225ffb04a'} Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 90d42cdd-cddc-43cd-a2de-f4f225ffb04a to delete Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 90d42cdd-cddc-43cd-a2de-f4f225ffb04a could not be found. Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:04.902008 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:04.908565 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:23:04.908565 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:23:04.908565 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:23:04.908565 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:23:04.908565 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:23:04.908565 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:23:04.908565 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:23:04.908565 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:23:04.908565 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 23 01:23:04.908565 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 23 01:23:04.908565 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 23 01:23:04.908565 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:04.908565 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:23:04.908565 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:04.908565 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:04.908565 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:23:04.908565 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:23:04.908565 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:23:04.908565 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:23:04.908565 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 23 01:23:04.908565 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:04.908565 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c0c0e754-7b41-43fc-ad44-1f9cb8290555 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Returning 404 to user: Image not found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:23:04.908565 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c0c0e754-7b41-43fc-ad44-1f9cb8290555 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "DELETE /compute/v2.1/images/90d42cdd-cddc-43cd-a2de-f4f225ffb04a" status: 404 len: 62 microversion: 2.1 time: 0.048306 Oct 23 01:23:04.911525 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b6482b63-7200-46bb-9f21-bc04373dae75 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:04.911658 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1661/3288] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:04 2022] DELETE /compute/v2.1/images/90d42cdd-cddc-43cd-a2de-f4f225ffb04a => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:23:04.920004 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a246493f-a740-4ac0-b3e2-eb76d8b175e2 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:04.920617 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a246493f-a740-4ac0-b3e2-eb76d8b175e2 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 7fc07c10-f37b-4374-bcc0-25793b180d9c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:04.922599 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b6482b63-7200-46bb-9f21-bc04373dae75 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1363 microversion: 2.1 time: 0.408849 Oct 23 01:23:04.938962 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1628/3289] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:04 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1363 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:04.941009 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a246493f-a740-4ac0-b3e2-eb76d8b175e2 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:04.951130 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a246493f-a740-4ac0-b3e2-eb76d8b175e2 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:04.951808 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a246493f-a740-4ac0-b3e2-eb76d8b175e2 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:04.952753 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a246493f-a740-4ac0-b3e2-eb76d8b175e2 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:04.954764 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a246493f-a740-4ac0-b3e2-eb76d8b175e2 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:04.955419 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a246493f-a740-4ac0-b3e2-eb76d8b175e2 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:05.001403 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-a246493f-a740-4ac0-b3e2-eb76d8b175e2 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] HTTP exception thrown: Instance 7fc07c10-f37b-4374-bcc0-25793b180d9c could not be found. Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a246493f-a740-4ac0-b3e2-eb76d8b175e2 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Request method failure captured: Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/servers/7fc07c10-f37b-4374-bcc0-25793b180d9c HTTP/1.1 Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJX7oG_-NoIyIEUCGEKOm-ZSU72famr5yoDILLNePut_DL_3k_PnsEavv2TmsQSFm35k3Fu45TPlv7dICjEoTIb1EL-5tIQBr9VKjw1DYfXzc-CSkypChB5gjaj2o2v1qRku6UVlPiA8dos_KOVi1KUitKTyxYLFMCu3mKpc9neV8xU Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 50bd4c137b6a42488f39d173d46520dd Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ImagesTestJSON-1961542935 Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/50bd4c137b6a42488f39d173d46520dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_50bd4c137b6a42488f39d173d46520dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/50bd4c137b6a42488f39d173d46520dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/50bd4c137b6a42488f39d173d46520dd"}]}] Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ImagesTestJSON-1961542935 Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 50bd4c137b6a42488f39d173d46520dd Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ImagesTestJSON-1961542935 Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ImagesTestJSON-1961542935-project Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: ecb97fa679eb4bf8a41862d3c248a217 Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ImagesTestJSON-1961542935-project Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 7fc07c10-f37b-4374-bcc0-25793b180d9c could not be found. Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '7fc07c10-f37b-4374-bcc0-25793b180d9c'} Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fc07c10-f37b-4374-bcc0-25793b180d9c could not be found. Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:23:05.003893 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fc07c10-f37b-4374-bcc0-25793b180d9c could not be found. Oct 23 01:23:05.008675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:05.008675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:23:05.008675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:05.008675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:05.008675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:23:05.008675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:23:05.008675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:23:05.008675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:23:05.008675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fc07c10-f37b-4374-bcc0-25793b180d9c could not be found. Oct 23 01:23:05.008675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:05.012840 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a246493f-a740-4ac0-b3e2-eb76d8b175e2 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Returning 404 to user: Instance 7fc07c10-f37b-4374-bcc0-25793b180d9c could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:23:05.014759 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a246493f-a740-4ac0-b3e2-eb76d8b175e2 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7fc07c10-f37b-4374-bcc0-25793b180d9c" status: 404 len: 111 microversion: 2.1 time: 0.102298 Oct 23 01:23:05.018698 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1662/3290] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:23:04 2022] DELETE /compute/v2.1/servers/7fc07c10-f37b-4374-bcc0-25793b180d9c => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:23:05.024011 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5aea237b-7c99-413e-a343-1b3fac3c5278 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:05.024641 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5aea237b-7c99-413e-a343-1b3fac3c5278 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] [instance: 7fc07c10-f37b-4374-bcc0-25793b180d9c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:05.041529 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5aea237b-7c99-413e-a343-1b3fac3c5278 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:05.042064 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5aea237b-7c99-413e-a343-1b3fac3c5278 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:05.042494 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5aea237b-7c99-413e-a343-1b3fac3c5278 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:05.050064 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5aea237b-7c99-413e-a343-1b3fac3c5278 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:05.055374 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5aea237b-7c99-413e-a343-1b3fac3c5278 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:05.056075 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5aea237b-7c99-413e-a343-1b3fac3c5278 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:05.104373 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-5aea237b-7c99-413e-a343-1b3fac3c5278 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] HTTP exception thrown: Instance 7fc07c10-f37b-4374-bcc0-25793b180d9c could not be found. Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5aea237b-7c99-413e-a343-1b3fac3c5278 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Request method failure captured: Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/7fc07c10-f37b-4374-bcc0-25793b180d9c HTTP/1.1 Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJX7oG_-NoIyIEUCGEKOm-ZSU72famr5yoDILLNePut_DL_3k_PnsEavv2TmsQSFm35k3Fu45TPlv7dICjEoTIb1EL-5tIQBr9VKjw1DYfXzc-CSkypChB5gjaj2o2v1qRku6UVlPiA8dos_KOVi1KUitKTyxYLFMCu3mKpc9neV8xU Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 50bd4c137b6a42488f39d173d46520dd Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ImagesTestJSON-1961542935 Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/50bd4c137b6a42488f39d173d46520dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_50bd4c137b6a42488f39d173d46520dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/50bd4c137b6a42488f39d173d46520dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/50bd4c137b6a42488f39d173d46520dd"}]}] Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ImagesTestJSON-1961542935 Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 50bd4c137b6a42488f39d173d46520dd Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ImagesTestJSON-1961542935 Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ImagesTestJSON-1961542935-project Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: ecb97fa679eb4bf8a41862d3c248a217 Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ImagesTestJSON-1961542935-project Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 7fc07c10-f37b-4374-bcc0-25793b180d9c could not be found. Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '7fc07c10-f37b-4374-bcc0-25793b180d9c'} Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fc07c10-f37b-4374-bcc0-25793b180d9c could not be found. Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fc07c10-f37b-4374-bcc0-25793b180d9c could not be found. Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:23:05.106263 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:05.110543 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:23:05.110543 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:23:05.110543 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:23:05.110543 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:23:05.110543 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fc07c10-f37b-4374-bcc0-25793b180d9c could not be found. Oct 23 01:23:05.110543 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:23:05.118864 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5aea237b-7c99-413e-a343-1b3fac3c5278 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] Returning 404 to user: Instance 7fc07c10-f37b-4374-bcc0-25793b180d9c could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:23:05.119978 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5aea237b-7c99-413e-a343-1b3fac3c5278 tempest-ImagesTestJSON-1961542935 tempest-ImagesTestJSON-1961542935-project] 10.222.0.42 "GET /compute/v2.1/servers/7fc07c10-f37b-4374-bcc0-25793b180d9c" status: 404 len: 111 microversion: 2.1 time: 0.100165 Oct 23 01:23:05.124218 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1629/3291] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:05 2022] GET /compute/v2.1/servers/7fc07c10-f37b-4374-bcc0-25793b180d9c => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 01:23:05.428233 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-20a3f470-4188-42ed-843f-c345366aaf17 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:05.429106 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-20a3f470-4188-42ed-843f-c345366aaf17 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 79681d58-1364-42d2-99e4-7fe4965bf625] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:05.448628 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20a3f470-4188-42ed-843f-c345366aaf17 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:05.450609 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20a3f470-4188-42ed-843f-c345366aaf17 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:05.451236 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20a3f470-4188-42ed-843f-c345366aaf17 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:05.457715 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20a3f470-4188-42ed-843f-c345366aaf17 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:05.458758 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20a3f470-4188-42ed-843f-c345366aaf17 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:05.460303 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20a3f470-4188-42ed-843f-c345366aaf17 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:05.539788 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-46f429f2-3bd3-4237-8baa-443a47302d9c tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:05.541080 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-46f429f2-3bd3-4237-8baa-443a47302d9c tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:05.555966 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46f429f2-3bd3-4237-8baa-443a47302d9c tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:05.558423 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46f429f2-3bd3-4237-8baa-443a47302d9c tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:05.560941 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46f429f2-3bd3-4237-8baa-443a47302d9c tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:05.564249 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46f429f2-3bd3-4237-8baa-443a47302d9c tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:05.565242 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46f429f2-3bd3-4237-8baa-443a47302d9c tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:05.569070 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46f429f2-3bd3-4237-8baa-443a47302d9c tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:05.653765 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=100 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:06.037013 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-20a3f470-4188-42ed-843f-c345366aaf17 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:06.050995 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-20a3f470-4188-42ed-843f-c345366aaf17 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625" status: 200 len: 1515 microversion: 2.1 time: 0.626977 Oct 23 01:23:06.052207 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1663/3292] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:05 2022] GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625 => generated 1515 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:06.058000 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9dc17d34-afe1-475d-9237-27794818cf95 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:06.062840 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9dc17d34-afe1-475d-9237-27794818cf95 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: 8ce9f585-473f-4f8f-a5e6-7b83b7303ccb] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:06.080368 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9dc17d34-afe1-475d-9237-27794818cf95 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:06.081046 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9dc17d34-afe1-475d-9237-27794818cf95 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:06.081682 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9dc17d34-afe1-475d-9237-27794818cf95 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:06.082058 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-46f429f2-3bd3-4237-8baa-443a47302d9c tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:06.084498 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9dc17d34-afe1-475d-9237-27794818cf95 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:06.085322 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9dc17d34-afe1-475d-9237-27794818cf95 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:06.086484 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9dc17d34-afe1-475d-9237-27794818cf95 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:06.092664 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-46f429f2-3bd3-4237-8baa-443a47302d9c tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:06.097181 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-46f429f2-3bd3-4237-8baa-443a47302d9c tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:06.098804 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-46f429f2-3bd3-4237-8baa-443a47302d9c tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1878 microversion: 2.42 time: 0.563515 Oct 23 01:23:06.099920 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1630/3293] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:23:05 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1878 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:23:06.105397 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-267bc45e-c200-47ec-a863-106e56915917 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:06.106401 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-267bc45e-c200-47ec-a863-106e56915917 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:06.113750 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-267bc45e-c200-47ec-a863-106e56915917 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:06.114764 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-267bc45e-c200-47ec-a863-106e56915917 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:06.115433 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-267bc45e-c200-47ec-a863-106e56915917 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:06.116395 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-267bc45e-c200-47ec-a863-106e56915917 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:06.117116 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-267bc45e-c200-47ec-a863-106e56915917 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:06.117764 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-267bc45e-c200-47ec-a863-106e56915917 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:06.140830 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=100 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:06.224969 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9dc17d34-afe1-475d-9237-27794818cf95 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60276a4031ee45ffa651b5467a62a81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a369d45e4804ffca2e89cb72f447a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:06.233781 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9dc17d34-afe1-475d-9237-27794818cf95 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb" status: 200 len: 1292 microversion: 2.1 time: 0.180330 Oct 23 01:23:06.234942 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1664/3294] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:06 2022] GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb => generated 1292 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:06.240537 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d992762f-032d-4dcc-83d9-08f054bfe8ba tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:23:06.243381 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d992762f-032d-4dcc-83d9-08f054bfe8ba tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 79681d58-1364-42d2-99e4-7fe4965bf625] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:06.252216 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d992762f-032d-4dcc-83d9-08f054bfe8ba tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:06.253003 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d992762f-032d-4dcc-83d9-08f054bfe8ba tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:06.253616 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d992762f-032d-4dcc-83d9-08f054bfe8ba tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:06.254547 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d992762f-032d-4dcc-83d9-08f054bfe8ba tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:06.255166 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d992762f-032d-4dcc-83d9-08f054bfe8ba tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:06.256942 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d992762f-032d-4dcc-83d9-08f054bfe8ba tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:06.288562 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-d992762f-032d-4dcc-83d9-08f054bfe8ba tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lazy-loading 'flavor' on Instance uuid 79681d58-1364-42d2-99e4-7fe4965bf625 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:23:06.381912 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-267bc45e-c200-47ec-a863-106e56915917 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:06.395062 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-267bc45e-c200-47ec-a863-106e56915917 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1363 microversion: 2.1 time: 0.293720 Oct 23 01:23:06.396065 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1631/3295] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:06 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1363 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:06.597063 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d992762f-032d-4dcc-83d9-08f054bfe8ba tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "POST /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625/action" status: 200 len: 32 microversion: 2.1 time: 0.360500 Oct 23 01:23:06.604257 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1665/3296] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:23:06 2022] POST /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625/action => generated 32 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:23:06.609817 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5244a5b6-fb2a-4baf-9f28-c523ab3c94a6 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:06.610676 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5244a5b6-fb2a-4baf-9f28-c523ab3c94a6 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 79681d58-1364-42d2-99e4-7fe4965bf625] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:06.623739 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5244a5b6-fb2a-4baf-9f28-c523ab3c94a6 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:06.627209 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5244a5b6-fb2a-4baf-9f28-c523ab3c94a6 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:06.629361 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5244a5b6-fb2a-4baf-9f28-c523ab3c94a6 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:06.632784 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5244a5b6-fb2a-4baf-9f28-c523ab3c94a6 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:06.633488 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5244a5b6-fb2a-4baf-9f28-c523ab3c94a6 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:06.635315 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5244a5b6-fb2a-4baf-9f28-c523ab3c94a6 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:07.020101 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5244a5b6-fb2a-4baf-9f28-c523ab3c94a6 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:07.028433 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5244a5b6-fb2a-4baf-9f28-c523ab3c94a6 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625" status: 200 len: 1521 microversion: 2.1 time: 0.422825 Oct 23 01:23:07.029032 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1632/3297] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:06 2022] GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625 => generated 1521 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:07.129573 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e9f5f8ff-9d0f-428b-a659-791434554af5 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:07.130323 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e9f5f8ff-9d0f-428b-a659-791434554af5 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:07.160467 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9f5f8ff-9d0f-428b-a659-791434554af5 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:07.160979 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9f5f8ff-9d0f-428b-a659-791434554af5 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:07.161394 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9f5f8ff-9d0f-428b-a659-791434554af5 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:07.162139 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9f5f8ff-9d0f-428b-a659-791434554af5 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:07.162781 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9f5f8ff-9d0f-428b-a659-791434554af5 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:07.163371 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9f5f8ff-9d0f-428b-a659-791434554af5 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:07.261877 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b5daa0c6-ab50-43b0-b2ef-3f02996a7f1e tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:07.262549 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b5daa0c6-ab50-43b0-b2ef-3f02996a7f1e tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: 8ce9f585-473f-4f8f-a5e6-7b83b7303ccb] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:07.283569 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b5daa0c6-ab50-43b0-b2ef-3f02996a7f1e tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:07.286663 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b5daa0c6-ab50-43b0-b2ef-3f02996a7f1e tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:07.287351 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b5daa0c6-ab50-43b0-b2ef-3f02996a7f1e tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:07.290592 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b5daa0c6-ab50-43b0-b2ef-3f02996a7f1e tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:07.293046 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b5daa0c6-ab50-43b0-b2ef-3f02996a7f1e tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:07.293658 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b5daa0c6-ab50-43b0-b2ef-3f02996a7f1e tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:07.492777 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b5daa0c6-ab50-43b0-b2ef-3f02996a7f1e tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60276a4031ee45ffa651b5467a62a81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a369d45e4804ffca2e89cb72f447a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:07.504720 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b5daa0c6-ab50-43b0-b2ef-3f02996a7f1e tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb" status: 200 len: 1298 microversion: 2.1 time: 0.247363 Oct 23 01:23:07.505626 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1633/3298] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:07 2022] GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb => generated 1298 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:23:07.527460 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-25ac811e-8a3a-42f3-ae9a-3816337822c7 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:07.528298 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-25ac811e-8a3a-42f3-ae9a-3816337822c7 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:07.535171 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25ac811e-8a3a-42f3-ae9a-3816337822c7 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:07.535962 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25ac811e-8a3a-42f3-ae9a-3816337822c7 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:07.536762 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25ac811e-8a3a-42f3-ae9a-3816337822c7 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:07.551144 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25ac811e-8a3a-42f3-ae9a-3816337822c7 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:07.551144 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25ac811e-8a3a-42f3-ae9a-3816337822c7 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:07.551144 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25ac811e-8a3a-42f3-ae9a-3816337822c7 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:07.810673 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e9f5f8ff-9d0f-428b-a659-791434554af5 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:07.820958 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e9f5f8ff-9d0f-428b-a659-791434554af5 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:07.831496 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e9f5f8ff-9d0f-428b-a659-791434554af5 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:07.832982 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e9f5f8ff-9d0f-428b-a659-791434554af5 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1878 microversion: 2.42 time: 0.707875 Oct 23 01:23:07.843294 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1666/3299] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:23:07 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1878 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:23:07.925885 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-25ac811e-8a3a-42f3-ae9a-3816337822c7 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:07.944524 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-25ac811e-8a3a-42f3-ae9a-3816337822c7 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1363 microversion: 2.1 time: 0.424222 Oct 23 01:23:07.945950 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1634/3300] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:07 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1363 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:08.052219 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6c78fb96-cb66-4116-8ac8-f074aa67a62f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:08.053097 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6c78fb96-cb66-4116-8ac8-f074aa67a62f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 79681d58-1364-42d2-99e4-7fe4965bf625] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:08.064619 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6c78fb96-cb66-4116-8ac8-f074aa67a62f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:08.065327 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6c78fb96-cb66-4116-8ac8-f074aa67a62f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:08.068197 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6c78fb96-cb66-4116-8ac8-f074aa67a62f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:08.070321 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6c78fb96-cb66-4116-8ac8-f074aa67a62f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:08.070321 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6c78fb96-cb66-4116-8ac8-f074aa67a62f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:08.070321 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6c78fb96-cb66-4116-8ac8-f074aa67a62f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:08.464021 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6c78fb96-cb66-4116-8ac8-f074aa67a62f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:08.480984 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6c78fb96-cb66-4116-8ac8-f074aa67a62f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625" status: 200 len: 1521 microversion: 2.1 time: 0.432598 Oct 23 01:23:08.491592 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1667/3301] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:08 2022] GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625 => generated 1521 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:23:08.530403 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a03988ce-12f1-4775-acf1-993c0e17e100 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:08.531341 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a03988ce-12f1-4775-acf1-993c0e17e100 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: 8ce9f585-473f-4f8f-a5e6-7b83b7303ccb] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:08.541279 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a03988ce-12f1-4775-acf1-993c0e17e100 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:08.546172 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a03988ce-12f1-4775-acf1-993c0e17e100 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:08.546936 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a03988ce-12f1-4775-acf1-993c0e17e100 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:08.547964 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a03988ce-12f1-4775-acf1-993c0e17e100 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:08.548625 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a03988ce-12f1-4775-acf1-993c0e17e100 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:08.549246 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a03988ce-12f1-4775-acf1-993c0e17e100 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:08.671534 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a03988ce-12f1-4775-acf1-993c0e17e100 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60276a4031ee45ffa651b5467a62a81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a369d45e4804ffca2e89cb72f447a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:08.681758 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a03988ce-12f1-4775-acf1-993c0e17e100 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb" status: 200 len: 1298 microversion: 2.1 time: 0.155322 Oct 23 01:23:08.690005 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1635/3302] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:08 2022] GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb => generated 1298 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:08.863369 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-02a109fe-9a62-4c64-b7e7-066b1d8b81c1 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:08.863997 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-02a109fe-9a62-4c64-b7e7-066b1d8b81c1 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:08.877558 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-02a109fe-9a62-4c64-b7e7-066b1d8b81c1 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:08.878105 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-02a109fe-9a62-4c64-b7e7-066b1d8b81c1 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:08.878554 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-02a109fe-9a62-4c64-b7e7-066b1d8b81c1 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:08.885473 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-02a109fe-9a62-4c64-b7e7-066b1d8b81c1 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:08.886250 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-02a109fe-9a62-4c64-b7e7-066b1d8b81c1 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:08.886858 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-02a109fe-9a62-4c64-b7e7-066b1d8b81c1 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:08.967704 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f3bf8bfa-52d2-45d2-9459-c34a3c17fdbe tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:08.968318 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f3bf8bfa-52d2-45d2-9459-c34a3c17fdbe tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:08.974926 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f3bf8bfa-52d2-45d2-9459-c34a3c17fdbe tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:08.979948 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f3bf8bfa-52d2-45d2-9459-c34a3c17fdbe tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:08.980900 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f3bf8bfa-52d2-45d2-9459-c34a3c17fdbe tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:08.981868 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f3bf8bfa-52d2-45d2-9459-c34a3c17fdbe tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:08.987579 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f3bf8bfa-52d2-45d2-9459-c34a3c17fdbe tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:08.988319 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f3bf8bfa-52d2-45d2-9459-c34a3c17fdbe tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:10.318703 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-02a109fe-9a62-4c64-b7e7-066b1d8b81c1 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:10.328859 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-02a109fe-9a62-4c64-b7e7-066b1d8b81c1 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:10.334690 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-02a109fe-9a62-4c64-b7e7-066b1d8b81c1 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:10.345472 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f3bf8bfa-52d2-45d2-9459-c34a3c17fdbe tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:10.352164 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-02a109fe-9a62-4c64-b7e7-066b1d8b81c1 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1878 microversion: 2.42 time: 1.492836 Oct 23 01:23:10.356990 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f3bf8bfa-52d2-45d2-9459-c34a3c17fdbe tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1363 microversion: 2.1 time: 1.393539 Oct 23 01:23:10.374247 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1636/3303] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:08 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1363 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:10.375167 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1668/3304] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:23:08 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1878 bytes in 1516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:23:10.384177 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-13dab40d-f465-4c74-bfd5-dbcdbd4b1e31 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:10.388862 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7678045a-6dec-408b-ab76-3be05f9baa15 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:10.390912 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-13dab40d-f465-4c74-bfd5-dbcdbd4b1e31 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 79681d58-1364-42d2-99e4-7fe4965bf625] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:10.391812 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7678045a-6dec-408b-ab76-3be05f9baa15 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: 8ce9f585-473f-4f8f-a5e6-7b83b7303ccb] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:10.411356 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-13dab40d-f465-4c74-bfd5-dbcdbd4b1e31 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:10.414706 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-13dab40d-f465-4c74-bfd5-dbcdbd4b1e31 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:10.415416 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-13dab40d-f465-4c74-bfd5-dbcdbd4b1e31 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:10.416406 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-13dab40d-f465-4c74-bfd5-dbcdbd4b1e31 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:10.416620 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7678045a-6dec-408b-ab76-3be05f9baa15 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:10.417424 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7678045a-6dec-408b-ab76-3be05f9baa15 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:10.418217 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-13dab40d-f465-4c74-bfd5-dbcdbd4b1e31 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:10.418914 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7678045a-6dec-408b-ab76-3be05f9baa15 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:10.419899 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7678045a-6dec-408b-ab76-3be05f9baa15 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:10.420587 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-13dab40d-f465-4c74-bfd5-dbcdbd4b1e31 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:10.422541 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7678045a-6dec-408b-ab76-3be05f9baa15 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:10.423212 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7678045a-6dec-408b-ab76-3be05f9baa15 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:10.928404 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-13dab40d-f465-4c74-bfd5-dbcdbd4b1e31 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:10.960465 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-13dab40d-f465-4c74-bfd5-dbcdbd4b1e31 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625" status: 200 len: 1521 microversion: 2.1 time: 0.580927 Oct 23 01:23:10.961071 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1637/3305] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:10 2022] GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625 => generated 1521 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:11.386858 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5937181e-69d7-44b1-9473-9bf5b84f0207 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:11.387514 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5937181e-69d7-44b1-9473-9bf5b84f0207 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:11.393747 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5937181e-69d7-44b1-9473-9bf5b84f0207 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:11.394288 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5937181e-69d7-44b1-9473-9bf5b84f0207 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:11.394705 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5937181e-69d7-44b1-9473-9bf5b84f0207 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:11.395411 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5937181e-69d7-44b1-9473-9bf5b84f0207 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:11.395870 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5937181e-69d7-44b1-9473-9bf5b84f0207 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:11.396297 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5937181e-69d7-44b1-9473-9bf5b84f0207 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:12.248939 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:12.406958 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5937181e-69d7-44b1-9473-9bf5b84f0207 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:12.419065 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5937181e-69d7-44b1-9473-9bf5b84f0207 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1363 microversion: 2.1 time: 1.036588 Oct 23 01:23:12.423186 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1638/3306] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:11 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1363 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:12.431133 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c771519a-763c-47ae-bcd5-5a1e23eb61f6 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:12.432085 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c771519a-763c-47ae-bcd5-5a1e23eb61f6 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:12.454613 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c771519a-763c-47ae-bcd5-5a1e23eb61f6 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:12.456853 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c771519a-763c-47ae-bcd5-5a1e23eb61f6 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:12.457722 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c771519a-763c-47ae-bcd5-5a1e23eb61f6 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:12.459151 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c771519a-763c-47ae-bcd5-5a1e23eb61f6 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:12.462419 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c771519a-763c-47ae-bcd5-5a1e23eb61f6 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:12.463142 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c771519a-763c-47ae-bcd5-5a1e23eb61f6 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:12.521667 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7678045a-6dec-408b-ab76-3be05f9baa15 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60276a4031ee45ffa651b5467a62a81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a369d45e4804ffca2e89cb72f447a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:12.532425 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7678045a-6dec-408b-ab76-3be05f9baa15 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb" status: 200 len: 1366 microversion: 2.1 time: 2.155830 Oct 23 01:23:12.539242 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1669/3307] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:10 2022] GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb => generated 1366 bytes in 2163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:12.565325 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-621194dd-9f49-4b15-b64c-ba9d9e06b97f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:12.568162 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-621194dd-9f49-4b15-b64c-ba9d9e06b97f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 79681d58-1364-42d2-99e4-7fe4965bf625] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:12.610587 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-621194dd-9f49-4b15-b64c-ba9d9e06b97f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:12.611458 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-621194dd-9f49-4b15-b64c-ba9d9e06b97f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:12.613004 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-621194dd-9f49-4b15-b64c-ba9d9e06b97f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:12.615257 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-621194dd-9f49-4b15-b64c-ba9d9e06b97f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:12.618446 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-621194dd-9f49-4b15-b64c-ba9d9e06b97f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:12.621507 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-621194dd-9f49-4b15-b64c-ba9d9e06b97f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:13.140891 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c771519a-763c-47ae-bcd5-5a1e23eb61f6 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:13.160862 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c771519a-763c-47ae-bcd5-5a1e23eb61f6 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:13.164712 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c771519a-763c-47ae-bcd5-5a1e23eb61f6 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:13.169230 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c771519a-763c-47ae-bcd5-5a1e23eb61f6 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1878 microversion: 2.42 time: 0.743166 Oct 23 01:23:13.172156 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1639/3308] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:23:12 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1878 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:23:13.188848 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-215675c2-e12e-42d2-a45d-95bd396410e0 req-6069a093-37b1-4705-8ebc-d16a4e543ff2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "defa5fbb-f632-4ce7-8e07-e00f6f491d82", "name": "network-vif-plugged", "status": "completed", "tag": "9c5bddd0-bc00-4d4f-9c6f-55ec9f8a68db"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:23:13.214248 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-215675c2-e12e-42d2-a45d-95bd396410e0 req-6069a093-37b1-4705-8ebc-d16a4e543ff2 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:13.215544 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-621194dd-9f49-4b15-b64c-ba9d9e06b97f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:13.216261 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-215675c2-e12e-42d2-a45d-95bd396410e0 req-6069a093-37b1-4705-8ebc-d16a4e543ff2 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:13.216891 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-215675c2-e12e-42d2-a45d-95bd396410e0 req-6069a093-37b1-4705-8ebc-d16a4e543ff2 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:13.226956 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-621194dd-9f49-4b15-b64c-ba9d9e06b97f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625" status: 200 len: 1521 microversion: 2.1 time: 0.684842 Oct 23 01:23:13.233895 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1670/3309] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:12 2022] GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625 => generated 1521 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:13.259615 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-215675c2-e12e-42d2-a45d-95bd396410e0 req-6069a093-37b1-4705-8ebc-d16a4e543ff2 service nova] Creating event network-vif-plugged:9c5bddd0-bc00-4d4f-9c6f-55ec9f8a68db for instance defa5fbb-f632-4ce7-8e07-e00f6f491d82 on n-h2-master-1 Oct 23 01:23:13.272192 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-215675c2-e12e-42d2-a45d-95bd396410e0 req-6069a093-37b1-4705-8ebc-d16a4e543ff2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097801 Oct 23 01:23:13.274583 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1640/3310] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:23:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:23:13.449441 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e2064c74-db67-4e37-a5a1-93da7aade07e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:13.450092 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e2064c74-db67-4e37-a5a1-93da7aade07e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:13.463024 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e2064c74-db67-4e37-a5a1-93da7aade07e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:13.465099 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e2064c74-db67-4e37-a5a1-93da7aade07e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:13.466741 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e2064c74-db67-4e37-a5a1-93da7aade07e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:13.477031 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e2064c74-db67-4e37-a5a1-93da7aade07e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:13.482258 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e2064c74-db67-4e37-a5a1-93da7aade07e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:13.491097 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e2064c74-db67-4e37-a5a1-93da7aade07e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:13.562602 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-57ad1259-210d-44b9-8437-043d2189e06a tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:13.564673 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-57ad1259-210d-44b9-8437-043d2189e06a tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: 8ce9f585-473f-4f8f-a5e6-7b83b7303ccb] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:13.584614 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-57ad1259-210d-44b9-8437-043d2189e06a tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:13.585395 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-57ad1259-210d-44b9-8437-043d2189e06a tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:13.597375 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-57ad1259-210d-44b9-8437-043d2189e06a tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:13.599278 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-57ad1259-210d-44b9-8437-043d2189e06a tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:13.600198 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-57ad1259-210d-44b9-8437-043d2189e06a tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:13.600843 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-57ad1259-210d-44b9-8437-043d2189e06a tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:14.058335 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-57ad1259-210d-44b9-8437-043d2189e06a tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60276a4031ee45ffa651b5467a62a81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a369d45e4804ffca2e89cb72f447a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:14.074075 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-57ad1259-210d-44b9-8437-043d2189e06a tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb" status: 200 len: 1366 microversion: 2.1 time: 0.515104 Oct 23 01:23:14.075338 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1641/3311] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:13 2022] GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb => generated 1366 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:23:14.161460 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e2064c74-db67-4e37-a5a1-93da7aade07e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:14.173000 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e2064c74-db67-4e37-a5a1-93da7aade07e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1363 microversion: 2.1 time: 0.728103 Oct 23 01:23:14.174242 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1671/3312] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:13 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1363 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:14.204990 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e2679543-6145-44a8-b98e-8540ddb0d922 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:14.206293 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e2679543-6145-44a8-b98e-8540ddb0d922 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:14.231024 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e2679543-6145-44a8-b98e-8540ddb0d922 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:14.232443 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e2679543-6145-44a8-b98e-8540ddb0d922 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:14.234920 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e2679543-6145-44a8-b98e-8540ddb0d922 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:14.235901 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e2679543-6145-44a8-b98e-8540ddb0d922 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:14.240391 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e2679543-6145-44a8-b98e-8540ddb0d922 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:14.241425 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e2679543-6145-44a8-b98e-8540ddb0d922 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:14.420661 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0e89dd37-a60e-4402-a6be-05e8280c88b9 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Action: 'create', calling method: .version_select at 0x7f5cc17deaf0>, body: {"keypair": {"name": "tempest-keypair-843674769", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBXrjKRxRH0rBpNSYD7L9+BMK7mzfIYaNwIGOCmDHjIEiM/nwVxz9a91aYXiH9nzU9W71OGTw2SkxhYHdscIhPw4fV6HyyP/Bn2lMAX8K7gBt2v5FgLloHOXKtG1S0xbsg=="}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:23:14.465295 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-0e89dd37-a60e-4402-a6be-05e8280c88b9 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Getting quotas for project 8525dcc00e844959a1527424291a3149. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:23:14.475621 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-0e89dd37-a60e-4402-a6be-05e8280c88b9 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Getting quotas for user 0501ceda4e8140e09fb4e94552487cc3 and project 8525dcc00e844959a1527424291a3149. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:23:14.563034 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=20 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:14.608436 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0e89dd37-a60e-4402-a6be-05e8280c88b9 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.445869 Oct 23 01:23:14.608436 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1642/3313] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 01:23:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:23:14.608436 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0b404b83-1aed-465a-9c2c-3d7975a758f6 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:14.608436 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0b404b83-1aed-465a-9c2c-3d7975a758f6 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 79681d58-1364-42d2-99e4-7fe4965bf625] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:14.617351 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b404b83-1aed-465a-9c2c-3d7975a758f6 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:14.618303 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b404b83-1aed-465a-9c2c-3d7975a758f6 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:14.618908 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b404b83-1aed-465a-9c2c-3d7975a758f6 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:14.621014 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b404b83-1aed-465a-9c2c-3d7975a758f6 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:14.621707 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b404b83-1aed-465a-9c2c-3d7975a758f6 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:14.623366 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b404b83-1aed-465a-9c2c-3d7975a758f6 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:15.475051 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e2679543-6145-44a8-b98e-8540ddb0d922 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:15.494233 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e2679543-6145-44a8-b98e-8540ddb0d922 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:15.495976 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e2679543-6145-44a8-b98e-8540ddb0d922 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:15.497404 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e2679543-6145-44a8-b98e-8540ddb0d922 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1878 microversion: 2.42 time: 1.303531 Oct 23 01:23:15.498555 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1672/3314] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:23:14 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1878 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:23:15.503475 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-ffc645f6-d709-4903-85a2-7fc4c2ad9256 req-8ccd4190-d0cb-4023-92ff-d883bf00acee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ce9f585-473f-4f8f-a5e6-7b83b7303ccb", "tag": "a158141a-72f3-48f2-91ac-ae7c2afce6d5"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:23:15.515113 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-ffc645f6-d709-4903-85a2-7fc4c2ad9256 req-8ccd4190-d0cb-4023-92ff-d883bf00acee service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:15.515840 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-ffc645f6-d709-4903-85a2-7fc4c2ad9256 req-8ccd4190-d0cb-4023-92ff-d883bf00acee service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:15.516435 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-ffc645f6-d709-4903-85a2-7fc4c2ad9256 req-8ccd4190-d0cb-4023-92ff-d883bf00acee service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:15.529897 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-ffc645f6-d709-4903-85a2-7fc4c2ad9256 req-8ccd4190-d0cb-4023-92ff-d883bf00acee service nova] Creating event network-changed:a158141a-72f3-48f2-91ac-ae7c2afce6d5 for instance 8ce9f585-473f-4f8f-a5e6-7b83b7303ccb on n-h1-master-1 Oct 23 01:23:15.536316 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0b404b83-1aed-465a-9c2c-3d7975a758f6 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:15.544610 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-ffc645f6-d709-4903-85a2-7fc4c2ad9256 req-8ccd4190-d0cb-4023-92ff-d883bf00acee service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044548 Oct 23 01:23:15.547676 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0b404b83-1aed-465a-9c2c-3d7975a758f6 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625" status: 200 len: 1521 microversion: 2.1 time: 0.944701 Oct 23 01:23:15.549500 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1673/3315] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:23:15.559397 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1643/3316] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:14 2022] GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625 => generated 1521 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:15.559559 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4cccd726-a66d-433a-9820-344f5c8055f0 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:15.559559 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4cccd726-a66d-433a-9820-344f5c8055f0 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: 8ce9f585-473f-4f8f-a5e6-7b83b7303ccb] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:15.564463 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-54cfcfdd-bdf9-4930-81d2-ea92d8da992e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:15.565317 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-54cfcfdd-bdf9-4930-81d2-ea92d8da992e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:15.576825 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54cfcfdd-bdf9-4930-81d2-ea92d8da992e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:15.579022 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4cccd726-a66d-433a-9820-344f5c8055f0 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:15.580104 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54cfcfdd-bdf9-4930-81d2-ea92d8da992e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:15.580770 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4cccd726-a66d-433a-9820-344f5c8055f0 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:15.581432 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54cfcfdd-bdf9-4930-81d2-ea92d8da992e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:15.583297 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54cfcfdd-bdf9-4930-81d2-ea92d8da992e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:15.583667 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4cccd726-a66d-433a-9820-344f5c8055f0 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:15.584702 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4cccd726-a66d-433a-9820-344f5c8055f0 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:15.585430 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54cfcfdd-bdf9-4930-81d2-ea92d8da992e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:15.586093 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4cccd726-a66d-433a-9820-344f5c8055f0 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:15.586694 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54cfcfdd-bdf9-4930-81d2-ea92d8da992e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:15.587290 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4cccd726-a66d-433a-9820-344f5c8055f0 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:16.181755 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4cccd726-a66d-433a-9820-344f5c8055f0 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60276a4031ee45ffa651b5467a62a81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a369d45e4804ffca2e89cb72f447a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:16.191744 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4cccd726-a66d-433a-9820-344f5c8055f0 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb" status: 200 len: 1366 microversion: 2.1 time: 0.638598 Oct 23 01:23:16.193027 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1674/3317] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:15 2022] GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb => generated 1366 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:16.232559 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-d90ee286-be35-4825-9262-add7216fa486 req-be88f2f1-3c15-4a33-9634-79228e451eaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "defa5fbb-f632-4ce7-8e07-e00f6f491d82", "name": "network-vif-plugged", "status": "completed", "tag": "a101ccc4-13ba-47da-b30f-6a0f1dbe2c91"}, {"server_uuid": "defa5fbb-f632-4ce7-8e07-e00f6f491d82", "name": "network-vif-plugged", "status": "completed", "tag": "3da8a6c9-ee04-43aa-bcd6-1059a44d5e18"}, {"server_uuid": "c48a830d-d375-47f5-8c08-d721f856c8ca", "name": "network-vif-plugged", "status": "completed", "tag": "ce65010c-1fbf-42ac-84db-f0f7244b8d88"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:23:16.258241 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-54cfcfdd-bdf9-4930-81d2-ea92d8da992e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:16.267595 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-54cfcfdd-bdf9-4930-81d2-ea92d8da992e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1363 microversion: 2.1 time: 0.716308 Oct 23 01:23:16.270205 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-d90ee286-be35-4825-9262-add7216fa486 req-be88f2f1-3c15-4a33-9634-79228e451eaa service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:16.271978 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-d90ee286-be35-4825-9262-add7216fa486 req-be88f2f1-3c15-4a33-9634-79228e451eaa service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:16.273173 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-d90ee286-be35-4825-9262-add7216fa486 req-be88f2f1-3c15-4a33-9634-79228e451eaa service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:16.275944 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1644/3318] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:15 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1363 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:16.309377 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-d90ee286-be35-4825-9262-add7216fa486 req-be88f2f1-3c15-4a33-9634-79228e451eaa service nova] Creating event network-vif-plugged:a101ccc4-13ba-47da-b30f-6a0f1dbe2c91 for instance defa5fbb-f632-4ce7-8e07-e00f6f491d82 on n-h2-master-1 Oct 23 01:23:16.314281 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-d90ee286-be35-4825-9262-add7216fa486 req-be88f2f1-3c15-4a33-9634-79228e451eaa service nova] Creating event network-vif-plugged:3da8a6c9-ee04-43aa-bcd6-1059a44d5e18 for instance defa5fbb-f632-4ce7-8e07-e00f6f491d82 on n-h2-master-1 Oct 23 01:23:16.314281 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-d90ee286-be35-4825-9262-add7216fa486 req-be88f2f1-3c15-4a33-9634-79228e451eaa service nova] Creating event network-vif-plugged:ce65010c-1fbf-42ac-84db-f0f7244b8d88 for instance c48a830d-d375-47f5-8c08-d721f856c8ca on n-h2-master-1 Oct 23 01:23:16.323175 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-d90ee286-be35-4825-9262-add7216fa486 req-be88f2f1-3c15-4a33-9634-79228e451eaa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.128305 Oct 23 01:23:16.325803 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1675/3319] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:23:16.524997 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b60f5cf4-0957-40a4-b543-eb4c72d75400 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:16.525658 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b60f5cf4-0957-40a4-b543-eb4c72d75400 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:16.533930 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b60f5cf4-0957-40a4-b543-eb4c72d75400 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:16.534462 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b60f5cf4-0957-40a4-b543-eb4c72d75400 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:16.534904 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b60f5cf4-0957-40a4-b543-eb4c72d75400 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:16.535609 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b60f5cf4-0957-40a4-b543-eb4c72d75400 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:16.536063 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b60f5cf4-0957-40a4-b543-eb4c72d75400 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:16.536490 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b60f5cf4-0957-40a4-b543-eb4c72d75400 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:16.589290 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7cae622f-74d2-49a9-bf30-47bf6c42874b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:16.589777 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7cae622f-74d2-49a9-bf30-47bf6c42874b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 79681d58-1364-42d2-99e4-7fe4965bf625] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:16.600788 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7cae622f-74d2-49a9-bf30-47bf6c42874b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:16.601568 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7cae622f-74d2-49a9-bf30-47bf6c42874b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:16.602718 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7cae622f-74d2-49a9-bf30-47bf6c42874b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:16.603693 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7cae622f-74d2-49a9-bf30-47bf6c42874b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:16.604528 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7cae622f-74d2-49a9-bf30-47bf6c42874b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:16.605222 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7cae622f-74d2-49a9-bf30-47bf6c42874b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:16.908606 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7cae622f-74d2-49a9-bf30-47bf6c42874b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:16.918136 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7cae622f-74d2-49a9-bf30-47bf6c42874b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625" status: 200 len: 1521 microversion: 2.1 time: 0.334953 Oct 23 01:23:16.919335 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1676/3320] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:16 2022] GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625 => generated 1521 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:16.932161 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b60f5cf4-0957-40a4-b543-eb4c72d75400 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:16.942291 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b60f5cf4-0957-40a4-b543-eb4c72d75400 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:16.943786 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b60f5cf4-0957-40a4-b543-eb4c72d75400 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:16.945516 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b60f5cf4-0957-40a4-b543-eb4c72d75400 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1878 microversion: 2.42 time: 0.425334 Oct 23 01:23:16.946608 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1645/3321] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:23:16 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1878 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:23:17.229761 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d8957e3d-5cab-436e-91cd-fa2d0daff474 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:17.232534 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d8957e3d-5cab-436e-91cd-fa2d0daff474 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: 8ce9f585-473f-4f8f-a5e6-7b83b7303ccb] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:17.251687 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d8957e3d-5cab-436e-91cd-fa2d0daff474 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:17.255370 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d8957e3d-5cab-436e-91cd-fa2d0daff474 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:17.257539 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d8957e3d-5cab-436e-91cd-fa2d0daff474 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:17.260028 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d8957e3d-5cab-436e-91cd-fa2d0daff474 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:17.261471 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d8957e3d-5cab-436e-91cd-fa2d0daff474 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:17.264439 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d8957e3d-5cab-436e-91cd-fa2d0daff474 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:17.299591 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5216a24e-e55f-4e3d-8c91-6f615aae8b85 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:17.301204 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5216a24e-e55f-4e3d-8c91-6f615aae8b85 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:17.309875 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5216a24e-e55f-4e3d-8c91-6f615aae8b85 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:17.310651 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5216a24e-e55f-4e3d-8c91-6f615aae8b85 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:17.311271 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5216a24e-e55f-4e3d-8c91-6f615aae8b85 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:17.312161 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5216a24e-e55f-4e3d-8c91-6f615aae8b85 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:17.312805 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5216a24e-e55f-4e3d-8c91-6f615aae8b85 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:17.313433 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5216a24e-e55f-4e3d-8c91-6f615aae8b85 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:17.604853 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5216a24e-e55f-4e3d-8c91-6f615aae8b85 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:17.620056 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5216a24e-e55f-4e3d-8c91-6f615aae8b85 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1363 microversion: 2.1 time: 0.324450 Oct 23 01:23:17.622083 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1646/3322] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:17 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1363 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:17.626293 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d8957e3d-5cab-436e-91cd-fa2d0daff474 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60276a4031ee45ffa651b5467a62a81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a369d45e4804ffca2e89cb72f447a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:17.641399 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d8957e3d-5cab-436e-91cd-fa2d0daff474 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb" status: 200 len: 1366 microversion: 2.1 time: 0.420016 Oct 23 01:23:17.642117 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1677/3323] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:17 2022] GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb => generated 1366 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:17.943374 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-64bb98de-850e-4694-a4cd-e74b4cefe1c3 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:17.944197 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-64bb98de-850e-4694-a4cd-e74b4cefe1c3 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 79681d58-1364-42d2-99e4-7fe4965bf625] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:17.951770 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64bb98de-850e-4694-a4cd-e74b4cefe1c3 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:17.952312 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64bb98de-850e-4694-a4cd-e74b4cefe1c3 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:17.952742 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64bb98de-850e-4694-a4cd-e74b4cefe1c3 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:17.953439 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64bb98de-850e-4694-a4cd-e74b4cefe1c3 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:17.953906 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64bb98de-850e-4694-a4cd-e74b4cefe1c3 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:17.954331 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64bb98de-850e-4694-a4cd-e74b4cefe1c3 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:17.972945 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-163e8b77-6f39-4891-b833-33df4498ade2 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:17.973847 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-163e8b77-6f39-4891-b833-33df4498ade2 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:18.010561 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-163e8b77-6f39-4891-b833-33df4498ade2 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:18.011056 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-163e8b77-6f39-4891-b833-33df4498ade2 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:18.016496 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-163e8b77-6f39-4891-b833-33df4498ade2 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:18.017580 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-163e8b77-6f39-4891-b833-33df4498ade2 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:18.018367 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-163e8b77-6f39-4891-b833-33df4498ade2 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:18.024538 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-163e8b77-6f39-4891-b833-33df4498ade2 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:18.386665 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-64bb98de-850e-4694-a4cd-e74b4cefe1c3 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:18.398173 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-64bb98de-850e-4694-a4cd-e74b4cefe1c3 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625" status: 200 len: 1521 microversion: 2.1 time: 0.458697 Oct 23 01:23:18.404910 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1647/3324] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:17 2022] GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625 => generated 1521 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:18.425283 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-7b088966-7e77-4241-8195-f5f49ac99d74 req-758a4f7b-7f22-40a4-9cdc-cbd611db7503 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "defa5fbb-f632-4ce7-8e07-e00f6f491d82", "name": "network-vif-plugged", "status": "completed", "tag": "551d6a08-a233-4348-871c-71fc57b512b8"}, {"server_uuid": "defa5fbb-f632-4ce7-8e07-e00f6f491d82", "name": "network-vif-plugged", "status": "completed", "tag": "29c00bf1-c7c4-4e37-8aad-d647f963331c"}, {"server_uuid": "defa5fbb-f632-4ce7-8e07-e00f6f491d82", "name": "network-vif-plugged", "status": "completed", "tag": "69d49907-1f64-490d-b949-d616f69931f1"}, {"server_uuid": "defa5fbb-f632-4ce7-8e07-e00f6f491d82", "name": "network-vif-plugged", "status": "completed", "tag": "64f70211-a0f5-4eaa-bee0-cef52f477333"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:23:18.435149 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-7b088966-7e77-4241-8195-f5f49ac99d74 req-758a4f7b-7f22-40a4-9cdc-cbd611db7503 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:18.435985 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-7b088966-7e77-4241-8195-f5f49ac99d74 req-758a4f7b-7f22-40a4-9cdc-cbd611db7503 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:18.436759 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-7b088966-7e77-4241-8195-f5f49ac99d74 req-758a4f7b-7f22-40a4-9cdc-cbd611db7503 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:18.449397 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-7b088966-7e77-4241-8195-f5f49ac99d74 req-758a4f7b-7f22-40a4-9cdc-cbd611db7503 service nova] Creating event network-vif-plugged:551d6a08-a233-4348-871c-71fc57b512b8 for instance defa5fbb-f632-4ce7-8e07-e00f6f491d82 on n-h2-master-1 Oct 23 01:23:18.449932 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-7b088966-7e77-4241-8195-f5f49ac99d74 req-758a4f7b-7f22-40a4-9cdc-cbd611db7503 service nova] Creating event network-vif-plugged:29c00bf1-c7c4-4e37-8aad-d647f963331c for instance defa5fbb-f632-4ce7-8e07-e00f6f491d82 on n-h2-master-1 Oct 23 01:23:18.450457 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-7b088966-7e77-4241-8195-f5f49ac99d74 req-758a4f7b-7f22-40a4-9cdc-cbd611db7503 service nova] Creating event network-vif-plugged:69d49907-1f64-490d-b949-d616f69931f1 for instance defa5fbb-f632-4ce7-8e07-e00f6f491d82 on n-h2-master-1 Oct 23 01:23:18.450996 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-7b088966-7e77-4241-8195-f5f49ac99d74 req-758a4f7b-7f22-40a4-9cdc-cbd611db7503 service nova] Creating event network-vif-plugged:64f70211-a0f5-4eaa-bee0-cef52f477333 for instance defa5fbb-f632-4ce7-8e07-e00f6f491d82 on n-h2-master-1 Oct 23 01:23:18.457068 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-7b088966-7e77-4241-8195-f5f49ac99d74 req-758a4f7b-7f22-40a4-9cdc-cbd611db7503 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.049011 Oct 23 01:23:18.457672 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1648/3325] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:23:18.493544 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-163e8b77-6f39-4891-b833-33df4498ade2 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:18.504884 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-163e8b77-6f39-4891-b833-33df4498ade2 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:18.506716 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-163e8b77-6f39-4891-b833-33df4498ade2 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:18.508157 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-163e8b77-6f39-4891-b833-33df4498ade2 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1878 microversion: 2.42 time: 0.539338 Oct 23 01:23:18.509064 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1678/3326] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:23:17 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1878 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:23:18.661596 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-59217e7f-2bd9-4756-b0bf-d667545be54c tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:18.661596 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-59217e7f-2bd9-4756-b0bf-d667545be54c tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:18.666196 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0377ce65-d654-48f0-b307-ab4691a2dd5f tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:18.667572 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0377ce65-d654-48f0-b307-ab4691a2dd5f tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: 8ce9f585-473f-4f8f-a5e6-7b83b7303ccb] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:18.670305 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-59217e7f-2bd9-4756-b0bf-d667545be54c tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:18.671915 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-59217e7f-2bd9-4756-b0bf-d667545be54c tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:18.672813 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-59217e7f-2bd9-4756-b0bf-d667545be54c tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:18.673825 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-59217e7f-2bd9-4756-b0bf-d667545be54c tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:18.674533 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-59217e7f-2bd9-4756-b0bf-d667545be54c tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:18.675258 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-59217e7f-2bd9-4756-b0bf-d667545be54c tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:18.680536 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0377ce65-d654-48f0-b307-ab4691a2dd5f tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:18.681104 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0377ce65-d654-48f0-b307-ab4691a2dd5f tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:18.681555 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0377ce65-d654-48f0-b307-ab4691a2dd5f tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:18.684476 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0377ce65-d654-48f0-b307-ab4691a2dd5f tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:18.685002 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0377ce65-d654-48f0-b307-ab4691a2dd5f tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:18.685452 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0377ce65-d654-48f0-b307-ab4691a2dd5f tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:18.711044 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=100 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:18.934927 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-59217e7f-2bd9-4756-b0bf-d667545be54c tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:18.948117 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-59217e7f-2bd9-4756-b0bf-d667545be54c tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1363 microversion: 2.1 time: 0.307070 Oct 23 01:23:18.953287 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1649/3327] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:18 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1363 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:18.969939 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d66df194-0868-4866-8152-2bc33da24051 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-171469554", "imageRef": "fed61d7c-d2be-4478-847d-4f93e2116816", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "be13e30a-ee50-486d-89e2-f2652bbee9d7"}], "security_groups": [{"name": "tempest-securitygroup--1940773493"}], "key_name": "tempest-keypair-843674769", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:23:18.999682 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0377ce65-d654-48f0-b307-ab4691a2dd5f tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60276a4031ee45ffa651b5467a62a81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a369d45e4804ffca2e89cb72f447a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:19.010415 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0377ce65-d654-48f0-b307-ab4691a2dd5f tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb" status: 200 len: 1366 microversion: 2.1 time: 0.349090 Oct 23 01:23:19.011671 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1679/3328] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:18 2022] GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb => generated 1366 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:19.107719 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-d66df194-0868-4866-8152-2bc33da24051 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] validate_networks() for [('be13e30a-ee50-486d-89e2-f2652bbee9d7', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:23:19.423601 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ac14c151-bb37-49cf-af0a-f57a3fa5910b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:19.424710 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ac14c151-bb37-49cf-af0a-f57a3fa5910b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 79681d58-1364-42d2-99e4-7fe4965bf625] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:19.434709 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac14c151-bb37-49cf-af0a-f57a3fa5910b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:19.435773 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac14c151-bb37-49cf-af0a-f57a3fa5910b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:19.436314 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac14c151-bb37-49cf-af0a-f57a3fa5910b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:19.446929 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac14c151-bb37-49cf-af0a-f57a3fa5910b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:19.447588 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac14c151-bb37-49cf-af0a-f57a3fa5910b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:19.448195 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac14c151-bb37-49cf-af0a-f57a3fa5910b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:19.474165 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:19.602292 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-d66df194-0868-4866-8152-2bc33da24051 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:23:19.602810 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-d66df194-0868-4866-8152-2bc33da24051 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:23:19.603319 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-d66df194-0868-4866-8152-2bc33da24051 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:23:19.603801 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-d66df194-0868-4866-8152-2bc33da24051 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:23:19.604287 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-d66df194-0868-4866-8152-2bc33da24051 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:23:19.613551 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d66df194-0868-4866-8152-2bc33da24051 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:19.614162 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d66df194-0868-4866-8152-2bc33da24051 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:19.614601 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d66df194-0868-4866-8152-2bc33da24051 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:19.615329 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d66df194-0868-4866-8152-2bc33da24051 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:19.615784 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d66df194-0868-4866-8152-2bc33da24051 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:19.616749 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d66df194-0868-4866-8152-2bc33da24051 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:19.634698 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-d66df194-0868-4866-8152-2bc33da24051 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Getting quotas for project 8525dcc00e844959a1527424291a3149. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:23:19.638287 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ac14c151-bb37-49cf-af0a-f57a3fa5910b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:19.640848 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-d66df194-0868-4866-8152-2bc33da24051 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Getting quotas for user 0501ceda4e8140e09fb4e94552487cc3 and project 8525dcc00e844959a1527424291a3149. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:23:19.645927 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ac14c151-bb37-49cf-af0a-f57a3fa5910b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625" status: 200 len: 1521 microversion: 2.1 time: 0.227630 Oct 23 01:23:19.646523 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1680/3329] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:19 2022] GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625 => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:23:19.654626 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d66df194-0868-4866-8152-2bc33da24051 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:23:19.659529 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d66df194-0868-4866-8152-2bc33da24051 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] [instance: e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fed61d7c-d2be-4478-847d-4f93e2116816',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:23:19.890298 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9571fe47-94a7-4c12-a47a-bba8dadfa4c7 tempest-ExtensionsTest-1739761121 tempest-ExtensionsTest-1739761121-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:19.892564 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9571fe47-94a7-4c12-a47a-bba8dadfa4c7 tempest-ExtensionsTest-1739761121 tempest-ExtensionsTest-1739761121-project] 10.222.0.42 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.245102 Oct 23 01:23:19.893115 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1681/3330] 10.222.0.42 () {58 vars in 1170 bytes} [Sun Oct 23 01:23:19 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:23:19.916408 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-48fbf067-cbc3-4439-9a80-8df96890d71a tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:19.917041 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-48fbf067-cbc3-4439-9a80-8df96890d71a tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:19.924029 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-48fbf067-cbc3-4439-9a80-8df96890d71a tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:19.924532 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-48fbf067-cbc3-4439-9a80-8df96890d71a tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:19.924978 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-48fbf067-cbc3-4439-9a80-8df96890d71a tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:19.925706 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-48fbf067-cbc3-4439-9a80-8df96890d71a tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:19.926178 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-48fbf067-cbc3-4439-9a80-8df96890d71a tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:19.926610 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-48fbf067-cbc3-4439-9a80-8df96890d71a tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:19.932984 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d66df194-0868-4866-8152-2bc33da24051 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.983217 Oct 23 01:23:19.933962 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1650/3331] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:23:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:23:19.943656 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c5c02e99-87d6-4385-b80e-f9f31acd37d4 tempest-ExtensionsTest-1739761121 tempest-ExtensionsTest-1739761121-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:19.950680 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c5c02e99-87d6-4385-b80e-f9f31acd37d4 tempest-ExtensionsTest-1739761121 tempest-ExtensionsTest-1739761121-project] 10.222.0.42 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.015500 Oct 23 01:23:19.966123 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1651/3332] 10.222.0.42 () {58 vars in 1134 bytes} [Sun Oct 23 01:23:19 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:23:19.966123 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5ea3d964-5119-4320-b772-ea07ed8c83ca tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:19.966123 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5ea3d964-5119-4320-b772-ea07ed8c83ca tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] [instance: e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:20.131286 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5ea3d964-5119-4320-b772-ea07ed8c83ca tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0501ceda4e8140e09fb4e94552487cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8525dcc00e844959a1527424291a3149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:20.139805 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5ea3d964-5119-4320-b772-ea07ed8c83ca tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] 10.222.0.42 "GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c" status: 200 len: 1244 microversion: 2.1 time: 0.183647 Oct 23 01:23:20.140403 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1652/3333] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:19 2022] GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c => generated 1244 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:20.145799 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c005808d-eee2-4d0c-851a-5f9aacabda8b tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:20.146900 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c005808d-eee2-4d0c-851a-5f9aacabda8b tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:20.165229 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c005808d-eee2-4d0c-851a-5f9aacabda8b tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:20.165782 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c005808d-eee2-4d0c-851a-5f9aacabda8b tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:20.166381 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c005808d-eee2-4d0c-851a-5f9aacabda8b tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:20.167088 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c005808d-eee2-4d0c-851a-5f9aacabda8b tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:20.167667 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c005808d-eee2-4d0c-851a-5f9aacabda8b tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:20.168443 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c005808d-eee2-4d0c-851a-5f9aacabda8b tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:20.207768 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-48fbf067-cbc3-4439-9a80-8df96890d71a tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:20.222806 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-48fbf067-cbc3-4439-9a80-8df96890d71a tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:20.225196 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-48fbf067-cbc3-4439-9a80-8df96890d71a tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:20.232921 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-48fbf067-cbc3-4439-9a80-8df96890d71a tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1878 microversion: 2.42 time: 0.334590 Oct 23 01:23:20.240029 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1682/3334] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:23:19 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1878 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:23:20.245097 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-730601eb-d913-4b34-b274-87c47a999084 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:20.247637 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-730601eb-d913-4b34-b274-87c47a999084 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: 8ce9f585-473f-4f8f-a5e6-7b83b7303ccb] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:20.262809 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-730601eb-d913-4b34-b274-87c47a999084 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:20.262809 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-730601eb-d913-4b34-b274-87c47a999084 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:20.262809 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-730601eb-d913-4b34-b274-87c47a999084 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:20.262809 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-730601eb-d913-4b34-b274-87c47a999084 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:20.262809 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-730601eb-d913-4b34-b274-87c47a999084 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:20.262809 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-730601eb-d913-4b34-b274-87c47a999084 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:20.366809 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c005808d-eee2-4d0c-851a-5f9aacabda8b tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:20.377638 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c005808d-eee2-4d0c-851a-5f9aacabda8b tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1550 microversion: 2.1 time: 0.236042 Oct 23 01:23:20.378924 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1653/3335] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:20 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1550 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:20.408340 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-30d1858f-cc25-4937-88e4-453294ef469f tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:20.409036 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-30d1858f-cc25-4937-88e4-453294ef469f tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:20.416654 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-30d1858f-cc25-4937-88e4-453294ef469f tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:20.429561 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-30d1858f-cc25-4937-88e4-453294ef469f tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:20.429561 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-30d1858f-cc25-4937-88e4-453294ef469f tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:20.430035 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-30d1858f-cc25-4937-88e4-453294ef469f tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:20.430506 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-30d1858f-cc25-4937-88e4-453294ef469f tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:20.430934 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-30d1858f-cc25-4937-88e4-453294ef469f tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:20.541187 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-730601eb-d913-4b34-b274-87c47a999084 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60276a4031ee45ffa651b5467a62a81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a369d45e4804ffca2e89cb72f447a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:20.555935 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-730601eb-d913-4b34-b274-87c47a999084 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb" status: 200 len: 1366 microversion: 2.1 time: 0.308044 Oct 23 01:23:20.556627 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1683/3336] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:20 2022] GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb => generated 1366 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:20.567662 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-30d1858f-cc25-4937-88e4-453294ef469f tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.163777 Oct 23 01:23:20.568805 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1654/3337] 10.222.0.42 () {58 vars in 1275 bytes} [Sun Oct 23 01:23:20 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca/os-interface => generated 285 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:23:20.670813 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a15b80f5-05b3-4527-950d-8df7777cfb27 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:20.673224 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a15b80f5-05b3-4527-950d-8df7777cfb27 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 79681d58-1364-42d2-99e4-7fe4965bf625] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:20.686156 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a15b80f5-05b3-4527-950d-8df7777cfb27 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:20.687587 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a15b80f5-05b3-4527-950d-8df7777cfb27 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:20.688579 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a15b80f5-05b3-4527-950d-8df7777cfb27 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:20.690660 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a15b80f5-05b3-4527-950d-8df7777cfb27 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:20.692934 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a15b80f5-05b3-4527-950d-8df7777cfb27 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:20.702125 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a15b80f5-05b3-4527-950d-8df7777cfb27 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:20.828001 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-60a4cf66-3261-4e8c-b5eb-eb0a6efbe60d tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-790780027", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": "none"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:23:20.915243 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-60a4cf66-3261-4e8c-b5eb-eb0a6efbe60d tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:23:20.915852 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-60a4cf66-3261-4e8c-b5eb-eb0a6efbe60d tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:23:20.916213 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-60a4cf66-3261-4e8c-b5eb-eb0a6efbe60d tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:23:20.916598 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-60a4cf66-3261-4e8c-b5eb-eb0a6efbe60d tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:23:20.917045 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-60a4cf66-3261-4e8c-b5eb-eb0a6efbe60d tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:23:20.930589 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-60a4cf66-3261-4e8c-b5eb-eb0a6efbe60d tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:20.932704 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-60a4cf66-3261-4e8c-b5eb-eb0a6efbe60d tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:20.933453 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-60a4cf66-3261-4e8c-b5eb-eb0a6efbe60d tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:20.935174 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-60a4cf66-3261-4e8c-b5eb-eb0a6efbe60d tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:20.936024 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-60a4cf66-3261-4e8c-b5eb-eb0a6efbe60d tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:20.939307 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-60a4cf66-3261-4e8c-b5eb-eb0a6efbe60d tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:20.987376 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-60a4cf66-3261-4e8c-b5eb-eb0a6efbe60d tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Getting quotas for project 3c8546a1c3b3418fae012aa51fd37c82. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:23:20.995565 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-60a4cf66-3261-4e8c-b5eb-eb0a6efbe60d tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Getting quotas for user 7f33238147dc49209bcebea4dfa47ad4 and project 3c8546a1c3b3418fae012aa51fd37c82. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:23:21.012207 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-60a4cf66-3261-4e8c-b5eb-eb0a6efbe60d tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:23:21.014711 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-60a4cf66-3261-4e8c-b5eb-eb0a6efbe60d tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] [instance: 5edd25b9-affc-45f4-a54f-66b262543ae5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:23:21.031055 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a15b80f5-05b3-4527-950d-8df7777cfb27 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:21.041369 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a15b80f5-05b3-4527-950d-8df7777cfb27 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625" status: 200 len: 1521 microversion: 2.1 time: 0.376258 Oct 23 01:23:21.043036 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1655/3338] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:20 2022] GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625 => generated 1521 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:23:21.044511 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:21.123300 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-60a4cf66-3261-4e8c-b5eb-eb0a6efbe60d tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.565367 Oct 23 01:23:21.130426 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1684/3339] 10.222.0.42 () {62 vars in 1188 bytes} [Sun Oct 23 01:23:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 23 01:23:21.135705 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1fe0b04e-4fd9-4dd9-937e-482163d0d5cd tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:21.136326 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1fe0b04e-4fd9-4dd9-937e-482163d0d5cd tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] [instance: 5edd25b9-affc-45f4-a54f-66b262543ae5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:21.164549 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-27c47d6a-9125-4073-91af-fa6fc36b8df5 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:21.165392 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-27c47d6a-9125-4073-91af-fa6fc36b8df5 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] [instance: e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:21.295080 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1fe0b04e-4fd9-4dd9-937e-482163d0d5cd tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f33238147dc49209bcebea4dfa47ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8546a1c3b3418fae012aa51fd37c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:21.302582 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1fe0b04e-4fd9-4dd9-937e-482163d0d5cd tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f33238147dc49209bcebea4dfa47ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8546a1c3b3418fae012aa51fd37c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:21.310249 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-27c47d6a-9125-4073-91af-fa6fc36b8df5 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0501ceda4e8140e09fb4e94552487cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8525dcc00e844959a1527424291a3149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:21.313906 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1fe0b04e-4fd9-4dd9-937e-482163d0d5cd tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f33238147dc49209bcebea4dfa47ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8546a1c3b3418fae012aa51fd37c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:21.317330 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1fe0b04e-4fd9-4dd9-937e-482163d0d5cd tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] 10.222.0.42 "GET /compute/v2.1/servers/5edd25b9-affc-45f4-a54f-66b262543ae5" status: 200 len: 1280 microversion: 2.47 time: 0.183490 Oct 23 01:23:21.317330 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1656/3340] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:23:21 2022] GET /compute/v2.1/servers/5edd25b9-affc-45f4-a54f-66b262543ae5 => generated 1280 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:23:21.329648 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-6cb2b889-3b94-4dd4-ad8c-e57e5745db70 req-5e7fd179-6e32-4dab-9138-365185e89856 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ce9f585-473f-4f8f-a5e6-7b83b7303ccb", "name": "network-vif-plugged", "status": "completed", "tag": "a158141a-72f3-48f2-91ac-ae7c2afce6d5"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:23:21.331510 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-27c47d6a-9125-4073-91af-fa6fc36b8df5 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] 10.222.0.42 "GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c" status: 200 len: 1244 microversion: 2.1 time: 0.172073 Oct 23 01:23:21.333137 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1685/3341] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:21 2022] GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c => generated 1244 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:23:21.344385 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-902b2cda-9497-4b6c-86ed-3d7ef4bc85ab tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:21.345384 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-902b2cda-9497-4b6c-86ed-3d7ef4bc85ab tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:21.352572 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-6cb2b889-3b94-4dd4-ad8c-e57e5745db70 req-5e7fd179-6e32-4dab-9138-365185e89856 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:21.353057 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-6cb2b889-3b94-4dd4-ad8c-e57e5745db70 req-5e7fd179-6e32-4dab-9138-365185e89856 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:21.353889 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-6cb2b889-3b94-4dd4-ad8c-e57e5745db70 req-5e7fd179-6e32-4dab-9138-365185e89856 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:21.357576 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-902b2cda-9497-4b6c-86ed-3d7ef4bc85ab tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:21.358654 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-902b2cda-9497-4b6c-86ed-3d7ef4bc85ab tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:21.359086 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-902b2cda-9497-4b6c-86ed-3d7ef4bc85ab tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:21.360151 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-902b2cda-9497-4b6c-86ed-3d7ef4bc85ab tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:21.360823 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-902b2cda-9497-4b6c-86ed-3d7ef4bc85ab tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:21.361405 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-902b2cda-9497-4b6c-86ed-3d7ef4bc85ab tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:21.377076 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-6cb2b889-3b94-4dd4-ad8c-e57e5745db70 req-5e7fd179-6e32-4dab-9138-365185e89856 service nova] Creating event network-vif-plugged:a158141a-72f3-48f2-91ac-ae7c2afce6d5 for instance 8ce9f585-473f-4f8f-a5e6-7b83b7303ccb on n-h1-master-1 Oct 23 01:23:21.384380 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-6cb2b889-3b94-4dd4-ad8c-e57e5745db70 req-5e7fd179-6e32-4dab-9138-365185e89856 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067403 Oct 23 01:23:21.384998 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1657/3342] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:23:21.581273 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d85c7d1c-954c-4629-906c-977a305cb7a6 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:21.582008 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d85c7d1c-954c-4629-906c-977a305cb7a6 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: 8ce9f585-473f-4f8f-a5e6-7b83b7303ccb] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:21.592659 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:21.594309 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d85c7d1c-954c-4629-906c-977a305cb7a6 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:21.594806 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d85c7d1c-954c-4629-906c-977a305cb7a6 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:21.595337 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d85c7d1c-954c-4629-906c-977a305cb7a6 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:21.595950 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d85c7d1c-954c-4629-906c-977a305cb7a6 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:21.598642 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d85c7d1c-954c-4629-906c-977a305cb7a6 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:21.599312 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d85c7d1c-954c-4629-906c-977a305cb7a6 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:21.917317 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-902b2cda-9497-4b6c-86ed-3d7ef4bc85ab tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:21.928084 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-902b2cda-9497-4b6c-86ed-3d7ef4bc85ab tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:21.930590 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-902b2cda-9497-4b6c-86ed-3d7ef4bc85ab tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:21.932180 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-902b2cda-9497-4b6c-86ed-3d7ef4bc85ab tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 2835 microversion: 2.42 time: 0.597438 Oct 23 01:23:21.955134 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1686/3343] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:23:21 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 2835 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:23:21.985898 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3a949712-38d5-4913-b1ea-4f4b2a5bf115 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:21.986640 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d85c7d1c-954c-4629-906c-977a305cb7a6 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60276a4031ee45ffa651b5467a62a81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a369d45e4804ffca2e89cb72f447a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:21.987335 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3a949712-38d5-4913-b1ea-4f4b2a5bf115 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:21.996152 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3a949712-38d5-4913-b1ea-4f4b2a5bf115 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:21.996825 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d85c7d1c-954c-4629-906c-977a305cb7a6 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb" status: 200 len: 1366 microversion: 2.1 time: 0.419746 Oct 23 01:23:21.997250 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3a949712-38d5-4913-b1ea-4f4b2a5bf115 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:21.997959 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3a949712-38d5-4913-b1ea-4f4b2a5bf115 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:21.998958 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3a949712-38d5-4913-b1ea-4f4b2a5bf115 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:21.999610 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3a949712-38d5-4913-b1ea-4f4b2a5bf115 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:22.000227 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3a949712-38d5-4913-b1ea-4f4b2a5bf115 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:22.013087 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1658/3344] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:21 2022] GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb => generated 1366 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:23:22.070374 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b1e8116d-56ba-4fdd-a18d-5de9118bd97c tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:22.071510 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b1e8116d-56ba-4fdd-a18d-5de9118bd97c tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 79681d58-1364-42d2-99e4-7fe4965bf625] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:22.091419 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1e8116d-56ba-4fdd-a18d-5de9118bd97c tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:22.092250 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1e8116d-56ba-4fdd-a18d-5de9118bd97c tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:22.093466 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1e8116d-56ba-4fdd-a18d-5de9118bd97c tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:22.094490 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1e8116d-56ba-4fdd-a18d-5de9118bd97c tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:22.095173 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1e8116d-56ba-4fdd-a18d-5de9118bd97c tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:22.095781 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1e8116d-56ba-4fdd-a18d-5de9118bd97c tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:22.592644 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3a949712-38d5-4913-b1ea-4f4b2a5bf115 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.619503 Oct 23 01:23:22.594174 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1687/3345] 10.222.0.42 () {60 vars in 1316 bytes} [Sun Oct 23 01:23:21 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82/os-interface => generated 1830 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:23:22.601099 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7dbb140f-b216-4ff7-a81a-ce886118e55a tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:22.601949 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7dbb140f-b216-4ff7-a81a-ce886118e55a tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] [instance: 5edd25b9-affc-45f4-a54f-66b262543ae5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:22.758908 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7dbb140f-b216-4ff7-a81a-ce886118e55a tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f33238147dc49209bcebea4dfa47ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8546a1c3b3418fae012aa51fd37c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:22.767839 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7dbb140f-b216-4ff7-a81a-ce886118e55a tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f33238147dc49209bcebea4dfa47ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8546a1c3b3418fae012aa51fd37c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:22.769624 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7dbb140f-b216-4ff7-a81a-ce886118e55a tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f33238147dc49209bcebea4dfa47ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8546a1c3b3418fae012aa51fd37c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:22.771737 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7dbb140f-b216-4ff7-a81a-ce886118e55a tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] 10.222.0.42 "GET /compute/v2.1/servers/5edd25b9-affc-45f4-a54f-66b262543ae5" status: 200 len: 1280 microversion: 2.47 time: 0.176346 Oct 23 01:23:22.775872 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1688/3346] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:23:22 2022] GET /compute/v2.1/servers/5edd25b9-affc-45f4-a54f-66b262543ae5 => generated 1280 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:23:22.785270 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-728772d0-37c9-4fc5-ad4c-77affccadec8 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:22.793773 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-728772d0-37c9-4fc5-ad4c-77affccadec8 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] [instance: e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:22.814274 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-728772d0-37c9-4fc5-ad4c-77affccadec8 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:22.814782 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-728772d0-37c9-4fc5-ad4c-77affccadec8 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:22.817882 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-728772d0-37c9-4fc5-ad4c-77affccadec8 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:22.818605 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-728772d0-37c9-4fc5-ad4c-77affccadec8 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:22.819096 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-728772d0-37c9-4fc5-ad4c-77affccadec8 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:22.819577 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-728772d0-37c9-4fc5-ad4c-77affccadec8 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:22.896237 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b1e8116d-56ba-4fdd-a18d-5de9118bd97c tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:22.904903 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b1e8116d-56ba-4fdd-a18d-5de9118bd97c tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625" status: 200 len: 1521 microversion: 2.1 time: 0.841264 Oct 23 01:23:22.908425 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1659/3347] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:22 2022] GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625 => generated 1521 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:23:22.939522 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-728772d0-37c9-4fc5-ad4c-77affccadec8 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0501ceda4e8140e09fb4e94552487cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8525dcc00e844959a1527424291a3149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:22.966240 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-728772d0-37c9-4fc5-ad4c-77affccadec8 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] 10.222.0.42 "GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c" status: 200 len: 1296 microversion: 2.1 time: 0.189222 Oct 23 01:23:22.967803 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1689/3348] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:22 2022] GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c => generated 1296 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:23.024198 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-eda6a929-32a9-43c8-b307-ba20e0c89e8b tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:23.024796 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-eda6a929-32a9-43c8-b307-ba20e0c89e8b tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: 8ce9f585-473f-4f8f-a5e6-7b83b7303ccb] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:23.031553 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eda6a929-32a9-43c8-b307-ba20e0c89e8b tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:23.032292 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eda6a929-32a9-43c8-b307-ba20e0c89e8b tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:23.032914 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eda6a929-32a9-43c8-b307-ba20e0c89e8b tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:23.033821 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eda6a929-32a9-43c8-b307-ba20e0c89e8b tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:23.034302 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eda6a929-32a9-43c8-b307-ba20e0c89e8b tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:23.034926 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eda6a929-32a9-43c8-b307-ba20e0c89e8b tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:23.310904 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-1ddc8679-88f6-4349-b792-e3d753ecc058 req-acc65521-7c67-422d-bdd5-7a2e21ae0d29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c48a830d-d375-47f5-8c08-d721f856c8ca", "tag": "ce65010c-1fbf-42ac-84db-f0f7244b8d88"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:23:23.322905 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-1ddc8679-88f6-4349-b792-e3d753ecc058 req-acc65521-7c67-422d-bdd5-7a2e21ae0d29 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:23.323391 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-1ddc8679-88f6-4349-b792-e3d753ecc058 req-acc65521-7c67-422d-bdd5-7a2e21ae0d29 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:23.323877 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-1ddc8679-88f6-4349-b792-e3d753ecc058 req-acc65521-7c67-422d-bdd5-7a2e21ae0d29 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:23.378738 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-1ddc8679-88f6-4349-b792-e3d753ecc058 req-acc65521-7c67-422d-bdd5-7a2e21ae0d29 service nova] Creating event network-changed:ce65010c-1fbf-42ac-84db-f0f7244b8d88 for instance c48a830d-d375-47f5-8c08-d721f856c8ca on n-h2-master-1 Oct 23 01:23:23.388054 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-1ddc8679-88f6-4349-b792-e3d753ecc058 req-acc65521-7c67-422d-bdd5-7a2e21ae0d29 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081629 Oct 23 01:23:23.389306 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1690/3349] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:23:23.408105 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-eda6a929-32a9-43c8-b307-ba20e0c89e8b tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60276a4031ee45ffa651b5467a62a81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a369d45e4804ffca2e89cb72f447a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:23.420179 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-eda6a929-32a9-43c8-b307-ba20e0c89e8b tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb" status: 200 len: 1366 microversion: 2.1 time: 0.397845 Oct 23 01:23:23.420179 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1660/3350] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:23 2022] GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb => generated 1366 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:23.806939 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-541ac449-d420-4c7b-b0f8-97666f4b2d81 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:23.808038 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-541ac449-d420-4c7b-b0f8-97666f4b2d81 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] [instance: 5edd25b9-affc-45f4-a54f-66b262543ae5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:23.817690 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-541ac449-d420-4c7b-b0f8-97666f4b2d81 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:23.818495 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-541ac449-d420-4c7b-b0f8-97666f4b2d81 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:23.822573 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-541ac449-d420-4c7b-b0f8-97666f4b2d81 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:23.823795 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-541ac449-d420-4c7b-b0f8-97666f4b2d81 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:23.825101 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-541ac449-d420-4c7b-b0f8-97666f4b2d81 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:23.825702 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-541ac449-d420-4c7b-b0f8-97666f4b2d81 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:23.903209 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bcdcd914-bfbf-4515-b053-fae3b6b45d1c tempest-VolumesGetTestJSON-1153915978 tempest-VolumesGetTestJSON-1153915978-project] Action: 'create', calling method: .version_select at 0x7f5cc176cf70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-381243187", "metadata": {"Type": "work"}}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:23:23.948184 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-541ac449-d420-4c7b-b0f8-97666f4b2d81 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f33238147dc49209bcebea4dfa47ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8546a1c3b3418fae012aa51fd37c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:23.957824 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-541ac449-d420-4c7b-b0f8-97666f4b2d81 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f33238147dc49209bcebea4dfa47ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8546a1c3b3418fae012aa51fd37c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:23.959829 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-541ac449-d420-4c7b-b0f8-97666f4b2d81 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f33238147dc49209bcebea4dfa47ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8546a1c3b3418fae012aa51fd37c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:23.974092 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-541ac449-d420-4c7b-b0f8-97666f4b2d81 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] 10.222.0.42 "GET /compute/v2.1/servers/5edd25b9-affc-45f4-a54f-66b262543ae5" status: 200 len: 1276 microversion: 2.47 time: 0.159194 Oct 23 01:23:23.974862 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1661/3351] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:23:23 2022] GET /compute/v2.1/servers/5edd25b9-affc-45f4-a54f-66b262543ae5 => generated 1276 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:23:23.989298 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cacb6047-c1bc-4b0a-9a7b-cd4d0d82d5c9 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:23.990368 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cacb6047-c1bc-4b0a-9a7b-cd4d0d82d5c9 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 79681d58-1364-42d2-99e4-7fe4965bf625] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:23.998991 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cacb6047-c1bc-4b0a-9a7b-cd4d0d82d5c9 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:23.999295 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cacb6047-c1bc-4b0a-9a7b-cd4d0d82d5c9 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:23.999892 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cacb6047-c1bc-4b0a-9a7b-cd4d0d82d5c9 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:24.000776 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cacb6047-c1bc-4b0a-9a7b-cd4d0d82d5c9 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:24.001590 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cacb6047-c1bc-4b0a-9a7b-cd4d0d82d5c9 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:24.002213 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cacb6047-c1bc-4b0a-9a7b-cd4d0d82d5c9 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:24.282327 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cacb6047-c1bc-4b0a-9a7b-cd4d0d82d5c9 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:24.299061 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cacb6047-c1bc-4b0a-9a7b-cd4d0d82d5c9 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625" status: 200 len: 1521 microversion: 2.1 time: 0.316235 Oct 23 01:23:24.299664 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1662/3352] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:23 2022] GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625 => generated 1521 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:24.314265 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1acd054d-2636-4a61-935a-544577cb8f30 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:24.314907 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1acd054d-2636-4a61-935a-544577cb8f30 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] [instance: e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:24.321606 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1acd054d-2636-4a61-935a-544577cb8f30 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:24.342128 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1acd054d-2636-4a61-935a-544577cb8f30 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:24.344643 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1acd054d-2636-4a61-935a-544577cb8f30 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:24.345396 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1acd054d-2636-4a61-935a-544577cb8f30 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:24.346303 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1acd054d-2636-4a61-935a-544577cb8f30 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:24.346900 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1acd054d-2636-4a61-935a-544577cb8f30 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:24.494720 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1acd054d-2636-4a61-935a-544577cb8f30 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0501ceda4e8140e09fb4e94552487cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8525dcc00e844959a1527424291a3149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:24.520762 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1acd054d-2636-4a61-935a-544577cb8f30 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] 10.222.0.42 "GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c" status: 200 len: 1314 microversion: 2.1 time: 0.219949 Oct 23 01:23:24.521390 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1663/3353] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:24 2022] GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:24.527260 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-aa12ee1a-e22f-4f0e-a588-ec8cfc7d468f tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:24.528103 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-aa12ee1a-e22f-4f0e-a588-ec8cfc7d468f tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: 8ce9f585-473f-4f8f-a5e6-7b83b7303ccb] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:24.547509 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa12ee1a-e22f-4f0e-a588-ec8cfc7d468f tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:24.548251 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa12ee1a-e22f-4f0e-a588-ec8cfc7d468f tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:24.548707 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa12ee1a-e22f-4f0e-a588-ec8cfc7d468f tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:24.550144 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa12ee1a-e22f-4f0e-a588-ec8cfc7d468f tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:24.550606 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa12ee1a-e22f-4f0e-a588-ec8cfc7d468f tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:24.551041 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa12ee1a-e22f-4f0e-a588-ec8cfc7d468f tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:24.778170 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-aa12ee1a-e22f-4f0e-a588-ec8cfc7d468f tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60276a4031ee45ffa651b5467a62a81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a369d45e4804ffca2e89cb72f447a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:24.792658 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-aa12ee1a-e22f-4f0e-a588-ec8cfc7d468f tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb" status: 200 len: 1557 microversion: 2.1 time: 0.269012 Oct 23 01:23:24.809681 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1664/3354] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:24 2022] GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb => generated 1557 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:24.827521 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6ba0776e-7b67-4d57-8f17-63512b272e6f tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:24.830247 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6ba0776e-7b67-4d57-8f17-63512b272e6f tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: 8ce9f585-473f-4f8f-a5e6-7b83b7303ccb] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:24.848567 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6ba0776e-7b67-4d57-8f17-63512b272e6f tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:24.849523 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6ba0776e-7b67-4d57-8f17-63512b272e6f tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:24.850668 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6ba0776e-7b67-4d57-8f17-63512b272e6f tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:24.854192 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6ba0776e-7b67-4d57-8f17-63512b272e6f tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:24.854643 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6ba0776e-7b67-4d57-8f17-63512b272e6f tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:24.855150 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6ba0776e-7b67-4d57-8f17-63512b272e6f tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:24.946695 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bcdcd914-bfbf-4515-b053-fae3b6b45d1c tempest-VolumesGetTestJSON-1153915978 tempest-VolumesGetTestJSON-1153915978-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.242918 Oct 23 01:23:24.948795 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1691/3355] 10.222.0.42 () {60 vars in 1156 bytes} [Sun Oct 23 01:23:23 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1246 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 23 01:23:24.962962 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ed88dccb-a212-4e3d-a7b5-1db3241980b8 tempest-VolumesGetTestJSON-1153915978 tempest-VolumesGetTestJSON-1153915978-project] Calling method '.version_select at 0x7f5cc1a273a0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:25.028074 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6ba0776e-7b67-4d57-8f17-63512b272e6f tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.208328 Oct 23 01:23:25.029291 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1665/3356] 10.222.0.42 () {58 vars in 1275 bytes} [Sun Oct 23 01:23:24 2022] GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb/os-interface => generated 285 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:23:25.035596 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f8e7da5d-eed3-4e57-808a-efed8efd424b tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:25.036437 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f8e7da5d-eed3-4e57-808a-efed8efd424b tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] [instance: 5edd25b9-affc-45f4-a54f-66b262543ae5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:25.056157 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ed88dccb-a212-4e3d-a7b5-1db3241980b8 tempest-VolumesGetTestJSON-1153915978 tempest-VolumesGetTestJSON-1153915978-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/63b48007-10e0-472f-b012-d19ae48f7ffa" status: 200 len: 352 microversion: 2.1 time: 0.098270 Oct 23 01:23:25.056777 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1692/3357] 10.222.0.42 () {58 vars in 1245 bytes} [Sun Oct 23 01:23:24 2022] GET /compute/v2.1/os-volumes/63b48007-10e0-472f-b012-d19ae48f7ffa => generated 352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:23:25.057298 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f8e7da5d-eed3-4e57-808a-efed8efd424b tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:25.058564 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f8e7da5d-eed3-4e57-808a-efed8efd424b tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:25.059163 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f8e7da5d-eed3-4e57-808a-efed8efd424b tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:25.060105 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f8e7da5d-eed3-4e57-808a-efed8efd424b tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:25.060878 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f8e7da5d-eed3-4e57-808a-efed8efd424b tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:25.061480 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f8e7da5d-eed3-4e57-808a-efed8efd424b tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:25.231693 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f8e7da5d-eed3-4e57-808a-efed8efd424b tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f33238147dc49209bcebea4dfa47ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8546a1c3b3418fae012aa51fd37c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:25.240071 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f8e7da5d-eed3-4e57-808a-efed8efd424b tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f33238147dc49209bcebea4dfa47ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8546a1c3b3418fae012aa51fd37c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:25.246215 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f8e7da5d-eed3-4e57-808a-efed8efd424b tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f33238147dc49209bcebea4dfa47ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8546a1c3b3418fae012aa51fd37c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:25.247424 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f8e7da5d-eed3-4e57-808a-efed8efd424b tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] 10.222.0.42 "GET /compute/v2.1/servers/5edd25b9-affc-45f4-a54f-66b262543ae5" status: 200 len: 1340 microversion: 2.47 time: 0.216549 Oct 23 01:23:25.258309 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1666/3358] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:23:25 2022] GET /compute/v2.1/servers/5edd25b9-affc-45f4-a54f-66b262543ae5 => generated 1340 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:23:25.340692 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b5ee87fa-c622-47bb-b74c-8b64089337db tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:25.340692 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b5ee87fa-c622-47bb-b74c-8b64089337db tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 79681d58-1364-42d2-99e4-7fe4965bf625] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:25.363409 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5ee87fa-c622-47bb-b74c-8b64089337db tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:25.369187 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5ee87fa-c622-47bb-b74c-8b64089337db tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:25.369187 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5ee87fa-c622-47bb-b74c-8b64089337db tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:25.371269 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5ee87fa-c622-47bb-b74c-8b64089337db tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:25.371965 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5ee87fa-c622-47bb-b74c-8b64089337db tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:25.374982 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5ee87fa-c622-47bb-b74c-8b64089337db tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:25.554867 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-93c9aa8f-dcc2-40dd-b7ec-9bbd5fc64c27 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:25.555416 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-93c9aa8f-dcc2-40dd-b7ec-9bbd5fc64c27 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] [instance: e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:25.580979 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-93c9aa8f-dcc2-40dd-b7ec-9bbd5fc64c27 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:25.588501 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-93c9aa8f-dcc2-40dd-b7ec-9bbd5fc64c27 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:25.595330 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-93c9aa8f-dcc2-40dd-b7ec-9bbd5fc64c27 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:25.604997 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-93c9aa8f-dcc2-40dd-b7ec-9bbd5fc64c27 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:25.604997 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-93c9aa8f-dcc2-40dd-b7ec-9bbd5fc64c27 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:25.604997 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-93c9aa8f-dcc2-40dd-b7ec-9bbd5fc64c27 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:25.898356 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-93c9aa8f-dcc2-40dd-b7ec-9bbd5fc64c27 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0501ceda4e8140e09fb4e94552487cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8525dcc00e844959a1527424291a3149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:25.909243 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-93c9aa8f-dcc2-40dd-b7ec-9bbd5fc64c27 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] 10.222.0.42 "GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c" status: 200 len: 1302 microversion: 2.1 time: 0.360290 Oct 23 01:23:25.917516 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1667/3359] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:25 2022] GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c => generated 1302 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:23:26.070278 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-54415244-a0ca-4f3f-accc-2660cbdf2c69 req-082a4828-4abd-4716-847e-446f4c944832 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "defa5fbb-f632-4ce7-8e07-e00f6f491d82", "tag": "551d6a08-a233-4348-871c-71fc57b512b8"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:23:26.090481 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-54415244-a0ca-4f3f-accc-2660cbdf2c69 req-082a4828-4abd-4716-847e-446f4c944832 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:26.091239 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-54415244-a0ca-4f3f-accc-2660cbdf2c69 req-082a4828-4abd-4716-847e-446f4c944832 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:26.094762 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-54415244-a0ca-4f3f-accc-2660cbdf2c69 req-082a4828-4abd-4716-847e-446f4c944832 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:26.128389 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-54415244-a0ca-4f3f-accc-2660cbdf2c69 req-082a4828-4abd-4716-847e-446f4c944832 service nova] Creating event network-changed:551d6a08-a233-4348-871c-71fc57b512b8 for instance defa5fbb-f632-4ce7-8e07-e00f6f491d82 on n-h2-master-1 Oct 23 01:23:26.143046 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-54415244-a0ca-4f3f-accc-2660cbdf2c69 req-082a4828-4abd-4716-847e-446f4c944832 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086968 Oct 23 01:23:26.147699 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1668/3360] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:23:26.157426 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a8475773-bf3f-43ce-806c-27b0b31d2102 tempest-VolumesGetTestJSON-1153915978 tempest-VolumesGetTestJSON-1153915978-project] Calling method '.version_select at 0x7f5cc1732c10>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:26.225114 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b5ee87fa-c622-47bb-b74c-8b64089337db tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:26.238955 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b5ee87fa-c622-47bb-b74c-8b64089337db tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625" status: 200 len: 1521 microversion: 2.1 time: 0.913886 Oct 23 01:23:26.239588 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1693/3361] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:25 2022] GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625 => generated 1521 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:23:26.280945 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a8475773-bf3f-43ce-806c-27b0b31d2102 tempest-VolumesGetTestJSON-1153915978 tempest-VolumesGetTestJSON-1153915978-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/63b48007-10e0-472f-b012-d19ae48f7ffa" status: 200 len: 352 microversion: 2.1 time: 0.131516 Oct 23 01:23:26.281596 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1669/3362] 10.222.0.42 () {58 vars in 1245 bytes} [Sun Oct 23 01:23:26 2022] GET /compute/v2.1/os-volumes/63b48007-10e0-472f-b012-d19ae48f7ffa => generated 352 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:23:26.284159 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-658715d7-e8d5-43aa-9212-46df98441c32 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:26.285552 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-658715d7-e8d5-43aa-9212-46df98441c32 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] [instance: 5edd25b9-affc-45f4-a54f-66b262543ae5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:26.300270 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-658715d7-e8d5-43aa-9212-46df98441c32 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:26.301228 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-658715d7-e8d5-43aa-9212-46df98441c32 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:26.301863 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-658715d7-e8d5-43aa-9212-46df98441c32 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:26.303003 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-658715d7-e8d5-43aa-9212-46df98441c32 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:26.305200 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-658715d7-e8d5-43aa-9212-46df98441c32 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:26.306210 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-658715d7-e8d5-43aa-9212-46df98441c32 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:26.386996 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-658715d7-e8d5-43aa-9212-46df98441c32 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f33238147dc49209bcebea4dfa47ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8546a1c3b3418fae012aa51fd37c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:26.395608 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-658715d7-e8d5-43aa-9212-46df98441c32 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f33238147dc49209bcebea4dfa47ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8546a1c3b3418fae012aa51fd37c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:26.397237 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-658715d7-e8d5-43aa-9212-46df98441c32 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f33238147dc49209bcebea4dfa47ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8546a1c3b3418fae012aa51fd37c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:26.398431 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-658715d7-e8d5-43aa-9212-46df98441c32 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] 10.222.0.42 "GET /compute/v2.1/servers/5edd25b9-affc-45f4-a54f-66b262543ae5" status: 200 len: 1338 microversion: 2.47 time: 0.125032 Oct 23 01:23:26.399323 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1694/3363] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:23:26 2022] GET /compute/v2.1/servers/5edd25b9-affc-45f4-a54f-66b262543ae5 => generated 1338 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:23:26.944639 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c4222e3d-0844-4c2e-99dc-4dadfa6c5151 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:26.946452 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c4222e3d-0844-4c2e-99dc-4dadfa6c5151 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] [instance: e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:26.959306 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c4222e3d-0844-4c2e-99dc-4dadfa6c5151 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:26.972935 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c4222e3d-0844-4c2e-99dc-4dadfa6c5151 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:26.974876 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c4222e3d-0844-4c2e-99dc-4dadfa6c5151 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:26.977273 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c4222e3d-0844-4c2e-99dc-4dadfa6c5151 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:26.979016 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c4222e3d-0844-4c2e-99dc-4dadfa6c5151 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:26.982467 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c4222e3d-0844-4c2e-99dc-4dadfa6c5151 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:27.286610 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cf98005b-b158-44c5-b34f-feb723978bd2 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:27.287935 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-cf98005b-b158-44c5-b34f-feb723978bd2 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 79681d58-1364-42d2-99e4-7fe4965bf625] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:27.296999 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf98005b-b158-44c5-b34f-feb723978bd2 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:27.297895 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf98005b-b158-44c5-b34f-feb723978bd2 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:27.298476 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf98005b-b158-44c5-b34f-feb723978bd2 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:27.299881 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf98005b-b158-44c5-b34f-feb723978bd2 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:27.300686 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf98005b-b158-44c5-b34f-feb723978bd2 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:27.301364 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf98005b-b158-44c5-b34f-feb723978bd2 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:27.615206 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c4222e3d-0844-4c2e-99dc-4dadfa6c5151 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0501ceda4e8140e09fb4e94552487cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8525dcc00e844959a1527424291a3149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:27.626567 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c4222e3d-0844-4c2e-99dc-4dadfa6c5151 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] 10.222.0.42 "GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c" status: 200 len: 1370 microversion: 2.1 time: 0.687557 Oct 23 01:23:27.631392 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1670/3364] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:26 2022] GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c => generated 1370 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:27.654516 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-716e16c3-4a6f-411d-ac81-fb7fdab68d1d tempest-VolumesGetTestJSON-1153915978 tempest-VolumesGetTestJSON-1153915978-project] Calling method '.version_select at 0x7f5cc1821a60>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:27.748852 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-716e16c3-4a6f-411d-ac81-fb7fdab68d1d tempest-VolumesGetTestJSON-1153915978 tempest-VolumesGetTestJSON-1153915978-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/63b48007-10e0-472f-b012-d19ae48f7ffa" status: 200 len: 353 microversion: 2.1 time: 0.115507 Oct 23 01:23:27.752328 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1671/3365] 10.222.0.42 () {58 vars in 1245 bytes} [Sun Oct 23 01:23:27 2022] GET /compute/v2.1/os-volumes/63b48007-10e0-472f-b012-d19ae48f7ffa => generated 353 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:23:27.764622 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-522c6243-9123-4fd0-b146-5b9ad12bba86 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:27.765551 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-522c6243-9123-4fd0-b146-5b9ad12bba86 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] [instance: 5edd25b9-affc-45f4-a54f-66b262543ae5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:27.804036 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-522c6243-9123-4fd0-b146-5b9ad12bba86 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:27.807343 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-522c6243-9123-4fd0-b146-5b9ad12bba86 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:27.808085 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-522c6243-9123-4fd0-b146-5b9ad12bba86 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:27.810140 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-522c6243-9123-4fd0-b146-5b9ad12bba86 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:27.812509 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-522c6243-9123-4fd0-b146-5b9ad12bba86 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:27.813264 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-522c6243-9123-4fd0-b146-5b9ad12bba86 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:27.958950 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cf98005b-b158-44c5-b34f-feb723978bd2 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:27.969962 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cf98005b-b158-44c5-b34f-feb723978bd2 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625" status: 200 len: 1521 microversion: 2.1 time: 0.709564 Oct 23 01:23:27.971990 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1695/3366] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:27 2022] GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625 => generated 1521 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:27.986273 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-65442f99-7f7f-460c-812f-2b9d65b02927 tempest-VolumesGetTestJSON-1153915978 tempest-VolumesGetTestJSON-1153915978-project] Calling method '.version_select at 0x7f5cc6109700>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:28.097385 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-65442f99-7f7f-460c-812f-2b9d65b02927 tempest-VolumesGetTestJSON-1153915978 tempest-VolumesGetTestJSON-1153915978-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/63b48007-10e0-472f-b012-d19ae48f7ffa" status: 200 len: 353 microversion: 2.1 time: 0.124046 Oct 23 01:23:28.107830 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1696/3367] 10.222.0.42 () {58 vars in 1245 bytes} [Sun Oct 23 01:23:27 2022] GET /compute/v2.1/os-volumes/63b48007-10e0-472f-b012-d19ae48f7ffa => generated 353 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:23:28.113104 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a42f22a9-1fb0-40f8-b7c4-e42fee7d5861 tempest-VolumesGetTestJSON-1153915978 tempest-VolumesGetTestJSON-1153915978-project] Calling method '.version_select at 0x7f5cc11285e0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:28.355962 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-522c6243-9123-4fd0-b146-5b9ad12bba86 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f33238147dc49209bcebea4dfa47ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8546a1c3b3418fae012aa51fd37c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:28.370990 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-522c6243-9123-4fd0-b146-5b9ad12bba86 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f33238147dc49209bcebea4dfa47ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8546a1c3b3418fae012aa51fd37c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:28.373113 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-522c6243-9123-4fd0-b146-5b9ad12bba86 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f33238147dc49209bcebea4dfa47ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8546a1c3b3418fae012aa51fd37c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:28.374615 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-522c6243-9123-4fd0-b146-5b9ad12bba86 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] 10.222.0.42 "GET /compute/v2.1/servers/5edd25b9-affc-45f4-a54f-66b262543ae5" status: 200 len: 1338 microversion: 2.47 time: 0.620615 Oct 23 01:23:28.376186 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1672/3368] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:23:27 2022] GET /compute/v2.1/servers/5edd25b9-affc-45f4-a54f-66b262543ae5 => generated 1338 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:23:28.438973 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a42f22a9-1fb0-40f8-b7c4-e42fee7d5861 tempest-VolumesGetTestJSON-1153915978 tempest-VolumesGetTestJSON-1153915978-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/63b48007-10e0-472f-b012-d19ae48f7ffa" status: 202 len: 0 microversion: 2.1 time: 0.329832 Oct 23 01:23:28.439578 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1697/3369] 10.222.0.42 () {58 vars in 1248 bytes} [Sun Oct 23 01:23:28 2022] DELETE /compute/v2.1/os-volumes/63b48007-10e0-472f-b012-d19ae48f7ffa => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:23:28.453366 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f19d53aa-b2c3-4cc1-9372-256536425906 tempest-VolumesGetTestJSON-1153915978 tempest-VolumesGetTestJSON-1153915978-project] Calling method '.version_select at 0x7f5cc17b0670>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:28.565126 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f19d53aa-b2c3-4cc1-9372-256536425906 tempest-VolumesGetTestJSON-1153915978 tempest-VolumesGetTestJSON-1153915978-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/63b48007-10e0-472f-b012-d19ae48f7ffa" status: 200 len: 352 microversion: 2.1 time: 0.121095 Oct 23 01:23:28.566365 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1673/3370] 10.222.0.42 () {58 vars in 1245 bytes} [Sun Oct 23 01:23:28 2022] GET /compute/v2.1/os-volumes/63b48007-10e0-472f-b012-d19ae48f7ffa => generated 352 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:23:28.654870 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-edd4e49c-cad1-4dc7-8f5e-0e15d021a03d tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:28.656374 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-edd4e49c-cad1-4dc7-8f5e-0e15d021a03d tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] [instance: e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:28.672752 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-edd4e49c-cad1-4dc7-8f5e-0e15d021a03d tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:28.674542 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-edd4e49c-cad1-4dc7-8f5e-0e15d021a03d tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:28.675373 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-edd4e49c-cad1-4dc7-8f5e-0e15d021a03d tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:28.680813 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-edd4e49c-cad1-4dc7-8f5e-0e15d021a03d tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:28.681737 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-edd4e49c-cad1-4dc7-8f5e-0e15d021a03d tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:28.685023 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-edd4e49c-cad1-4dc7-8f5e-0e15d021a03d tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:28.996017 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f354715c-70fd-4235-a22f-e3925cb72b9a tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:28.997022 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f354715c-70fd-4235-a22f-e3925cb72b9a tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 79681d58-1364-42d2-99e4-7fe4965bf625] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:29.017155 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f354715c-70fd-4235-a22f-e3925cb72b9a tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:29.018497 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f354715c-70fd-4235-a22f-e3925cb72b9a tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:29.024607 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f354715c-70fd-4235-a22f-e3925cb72b9a tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:29.026000 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f354715c-70fd-4235-a22f-e3925cb72b9a tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:29.026958 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f354715c-70fd-4235-a22f-e3925cb72b9a tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:29.027727 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f354715c-70fd-4235-a22f-e3925cb72b9a tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:29.392674 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-edd4e49c-cad1-4dc7-8f5e-0e15d021a03d tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0501ceda4e8140e09fb4e94552487cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8525dcc00e844959a1527424291a3149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:29.404088 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-edd4e49c-cad1-4dc7-8f5e-0e15d021a03d tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] 10.222.0.42 "GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c" status: 200 len: 1370 microversion: 2.1 time: 0.753597 Oct 23 01:23:29.423261 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1698/3371] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:28 2022] GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c => generated 1370 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:29.435127 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-eb0e10e6-cf3e-4b98-baf4-e2e2d7a77b85 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:29.437340 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-eb0e10e6-cf3e-4b98-baf4-e2e2d7a77b85 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] [instance: 5edd25b9-affc-45f4-a54f-66b262543ae5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:29.453315 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb0e10e6-cf3e-4b98-baf4-e2e2d7a77b85 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:29.454010 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb0e10e6-cf3e-4b98-baf4-e2e2d7a77b85 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:29.454826 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb0e10e6-cf3e-4b98-baf4-e2e2d7a77b85 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:29.456867 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb0e10e6-cf3e-4b98-baf4-e2e2d7a77b85 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:29.458513 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb0e10e6-cf3e-4b98-baf4-e2e2d7a77b85 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:29.460158 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb0e10e6-cf3e-4b98-baf4-e2e2d7a77b85 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:29.496497 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f354715c-70fd-4235-a22f-e3925cb72b9a tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:29.505501 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=100 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:29.515179 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f354715c-70fd-4235-a22f-e3925cb72b9a tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625" status: 200 len: 1521 microversion: 2.1 time: 0.524952 Oct 23 01:23:29.519714 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1674/3372] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:28 2022] GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625 => generated 1521 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:29.588007 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0b6d93da-a1f1-440e-8520-0e240be117f8 tempest-VolumesGetTestJSON-1153915978 tempest-VolumesGetTestJSON-1153915978-project] Calling method '.version_select at 0x7f5cc1821820>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:29.624710 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:29.705235 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0b6d93da-a1f1-440e-8520-0e240be117f8 tempest-VolumesGetTestJSON-1153915978 tempest-VolumesGetTestJSON-1153915978-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/63b48007-10e0-472f-b012-d19ae48f7ffa" status: 200 len: 352 microversion: 2.1 time: 0.128157 Oct 23 01:23:29.706113 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1675/3373] 10.222.0.42 () {58 vars in 1245 bytes} [Sun Oct 23 01:23:29 2022] GET /compute/v2.1/os-volumes/63b48007-10e0-472f-b012-d19ae48f7ffa => generated 352 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:23:29.742690 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-eb0e10e6-cf3e-4b98-baf4-e2e2d7a77b85 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f33238147dc49209bcebea4dfa47ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8546a1c3b3418fae012aa51fd37c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:29.752108 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-eb0e10e6-cf3e-4b98-baf4-e2e2d7a77b85 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f33238147dc49209bcebea4dfa47ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8546a1c3b3418fae012aa51fd37c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:29.755120 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-eb0e10e6-cf3e-4b98-baf4-e2e2d7a77b85 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f33238147dc49209bcebea4dfa47ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8546a1c3b3418fae012aa51fd37c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:29.756978 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-eb0e10e6-cf3e-4b98-baf4-e2e2d7a77b85 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] 10.222.0.42 "GET /compute/v2.1/servers/5edd25b9-affc-45f4-a54f-66b262543ae5" status: 200 len: 1359 microversion: 2.47 time: 0.325907 Oct 23 01:23:29.757666 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1699/3374] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:23:29 2022] GET /compute/v2.1/servers/5edd25b9-affc-45f4-a54f-66b262543ae5 => generated 1359 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:23:29.790492 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-26aa1932-fc09-420e-b89e-c74a6ca45e24 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1212352012"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:23:29.793313 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-26aa1932-fc09-420e-b89e-c74a6ca45e24 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] [instance: 5edd25b9-affc-45f4-a54f-66b262543ae5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:29.826545 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-26aa1932-fc09-420e-b89e-c74a6ca45e24 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:29.827024 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-26aa1932-fc09-420e-b89e-c74a6ca45e24 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:29.827487 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-26aa1932-fc09-420e-b89e-c74a6ca45e24 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:29.828238 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-26aa1932-fc09-420e-b89e-c74a6ca45e24 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:29.828701 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-26aa1932-fc09-420e-b89e-c74a6ca45e24 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:29.829134 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-26aa1932-fc09-420e-b89e-c74a6ca45e24 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:29.841627 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-8e6487f6-9712-4ff0-a236-fdb364745a46 req-ea2c001b-aa76-461d-9f44-7328ff69b353 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ce9f585-473f-4f8f-a5e6-7b83b7303ccb", "tag": "a158141a-72f3-48f2-91ac-ae7c2afce6d5"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:23:29.863435 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-8e6487f6-9712-4ff0-a236-fdb364745a46 req-ea2c001b-aa76-461d-9f44-7328ff69b353 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:29.875642 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-8e6487f6-9712-4ff0-a236-fdb364745a46 req-ea2c001b-aa76-461d-9f44-7328ff69b353 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:29.876329 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-8e6487f6-9712-4ff0-a236-fdb364745a46 req-ea2c001b-aa76-461d-9f44-7328ff69b353 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:29.926241 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-8e6487f6-9712-4ff0-a236-fdb364745a46 req-ea2c001b-aa76-461d-9f44-7328ff69b353 service nova] Creating event network-changed:a158141a-72f3-48f2-91ac-ae7c2afce6d5 for instance 8ce9f585-473f-4f8f-a5e6-7b83b7303ccb on n-h1-master-1 Oct 23 01:23:29.947318 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-8e6487f6-9712-4ff0-a236-fdb364745a46 req-ea2c001b-aa76-461d-9f44-7328ff69b353 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109624 Oct 23 01:23:29.958741 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1700/3375] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:23:29.973091 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-33fcb9c4-2de0-4eb2-a39c-31814f8bc36f req-679f1009-b121-4fb8-8aac-072dc5b4e156 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c", "tag": "9cec7f90-b6d7-4f93-9440-efa7b73f0b1c"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:23:30.039311 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-33fcb9c4-2de0-4eb2-a39c-31814f8bc36f req-679f1009-b121-4fb8-8aac-072dc5b4e156 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:30.041508 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-33fcb9c4-2de0-4eb2-a39c-31814f8bc36f req-679f1009-b121-4fb8-8aac-072dc5b4e156 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:30.044115 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-33fcb9c4-2de0-4eb2-a39c-31814f8bc36f req-679f1009-b121-4fb8-8aac-072dc5b4e156 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:30.072558 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-33fcb9c4-2de0-4eb2-a39c-31814f8bc36f req-679f1009-b121-4fb8-8aac-072dc5b4e156 service nova] Creating event network-changed:9cec7f90-b6d7-4f93-9440-efa7b73f0b1c for instance e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c on n-h1-master-1 Oct 23 01:23:30.085378 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-33fcb9c4-2de0-4eb2-a39c-31814f8bc36f req-679f1009-b121-4fb8-8aac-072dc5b4e156 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120518 Oct 23 01:23:30.087876 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1701/3376] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:23:30.435764 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7f2fd892-3c1b-4f43-87db-c7312582de7a tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:30.436742 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7f2fd892-3c1b-4f43-87db-c7312582de7a tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] [instance: e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:30.447197 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f2fd892-3c1b-4f43-87db-c7312582de7a tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:30.448168 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f2fd892-3c1b-4f43-87db-c7312582de7a tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:30.449811 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f2fd892-3c1b-4f43-87db-c7312582de7a tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:30.451928 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f2fd892-3c1b-4f43-87db-c7312582de7a tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:30.452954 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f2fd892-3c1b-4f43-87db-c7312582de7a tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:30.453966 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f2fd892-3c1b-4f43-87db-c7312582de7a tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:30.569907 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-26aa1932-fc09-420e-b89e-c74a6ca45e24 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] 10.222.0.42 "POST /compute/v2.1/servers/5edd25b9-affc-45f4-a54f-66b262543ae5/action" status: 202 len: 52 microversion: 2.47 time: 0.785996 Oct 23 01:23:30.580155 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1676/3377] 10.222.0.42 () {62 vars in 1319 bytes} [Sun Oct 23 01:23:29 2022] POST /compute/v2.1/servers/5edd25b9-affc-45f4-a54f-66b262543ae5/action => generated 52 bytes in 791 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 23 01:23:30.612110 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0bebc0c8-b6e0-47f6-b076-733617679e06 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:30.614775 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0bebc0c8-b6e0-47f6-b076-733617679e06 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 79681d58-1364-42d2-99e4-7fe4965bf625] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:30.657474 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0bebc0c8-b6e0-47f6-b076-733617679e06 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:30.658175 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0bebc0c8-b6e0-47f6-b076-733617679e06 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:30.660697 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0bebc0c8-b6e0-47f6-b076-733617679e06 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:30.662907 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0bebc0c8-b6e0-47f6-b076-733617679e06 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:30.665041 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0bebc0c8-b6e0-47f6-b076-733617679e06 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:30.669119 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0bebc0c8-b6e0-47f6-b076-733617679e06 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:30.953496 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:31.129411 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0bebc0c8-b6e0-47f6-b076-733617679e06 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:31.145494 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0bebc0c8-b6e0-47f6-b076-733617679e06 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625" status: 200 len: 1521 microversion: 2.1 time: 0.563376 Oct 23 01:23:31.146901 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1677/3378] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:30 2022] GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625 => generated 1521 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:31.153167 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7f2fd892-3c1b-4f43-87db-c7312582de7a tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0501ceda4e8140e09fb4e94552487cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8525dcc00e844959a1527424291a3149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:31.189116 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7f2fd892-3c1b-4f43-87db-c7312582de7a tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] 10.222.0.42 "GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c" status: 200 len: 1370 microversion: 2.1 time: 0.763226 Oct 23 01:23:31.216580 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6f8fdfa5-754e-42da-a729-b3b1dec92aa4 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:31.217443 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1702/3379] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:30 2022] GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c => generated 1370 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:31.220283 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6f8fdfa5-754e-42da-a729-b3b1dec92aa4 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] [instance: 5edd25b9-affc-45f4-a54f-66b262543ae5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:31.237915 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-660855a1-a15f-458f-9d4f-c7f1dfa25550 tempest-VolumesGetTestJSON-1153915978 tempest-VolumesGetTestJSON-1153915978-project] Calling method '.version_select at 0x7f5cc16e0160>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:31.243660 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6f8fdfa5-754e-42da-a729-b3b1dec92aa4 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:31.247344 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6f8fdfa5-754e-42da-a729-b3b1dec92aa4 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:31.248135 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6f8fdfa5-754e-42da-a729-b3b1dec92aa4 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:31.250210 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6f8fdfa5-754e-42da-a729-b3b1dec92aa4 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:31.257413 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6f8fdfa5-754e-42da-a729-b3b1dec92aa4 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:31.268863 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6f8fdfa5-754e-42da-a729-b3b1dec92aa4 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:31.364126 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=14 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:31.380912 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6f8fdfa5-754e-42da-a729-b3b1dec92aa4 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] [instance: 5edd25b9-affc-45f4-a54f-66b262543ae5] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:23:31.434636 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-660855a1-a15f-458f-9d4f-c7f1dfa25550 tempest-VolumesGetTestJSON-1153915978 tempest-VolumesGetTestJSON-1153915978-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/63b48007-10e0-472f-b012-d19ae48f7ffa" status: 200 len: 352 microversion: 2.1 time: 0.214328 Oct 23 01:23:31.435518 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1703/3380] 10.222.0.42 () {58 vars in 1245 bytes} [Sun Oct 23 01:23:31 2022] GET /compute/v2.1/os-volumes/63b48007-10e0-472f-b012-d19ae48f7ffa => generated 352 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:23:32.042132 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6f8fdfa5-754e-42da-a729-b3b1dec92aa4 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5edd25b9-affc-45f4-a54f-66b262543ae5" status: 204 len: 0 microversion: 2.47 time: 0.890698 Oct 23 01:23:32.047725 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1678/3381] 10.222.0.42 () {60 vars in 1280 bytes} [Sun Oct 23 01:23:31 2022] DELETE /compute/v2.1/servers/5edd25b9-affc-45f4-a54f-66b262543ae5 => generated 0 bytes in 896 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 23 01:23:32.068055 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a1a50b56-50f7-4ac4-a1b4-94c25556b9f4 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:32.071993 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a1a50b56-50f7-4ac4-a1b4-94c25556b9f4 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] [instance: 5edd25b9-affc-45f4-a54f-66b262543ae5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:32.092228 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a1a50b56-50f7-4ac4-a1b4-94c25556b9f4 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:32.095080 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a1a50b56-50f7-4ac4-a1b4-94c25556b9f4 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:32.095080 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a1a50b56-50f7-4ac4-a1b4-94c25556b9f4 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:32.095080 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a1a50b56-50f7-4ac4-a1b4-94c25556b9f4 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:32.095080 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a1a50b56-50f7-4ac4-a1b4-94c25556b9f4 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:32.106557 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a1a50b56-50f7-4ac4-a1b4-94c25556b9f4 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:32.175296 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d7262979-b53f-4115-997b-052cd622c6ab tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:32.179516 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d7262979-b53f-4115-997b-052cd622c6ab tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 79681d58-1364-42d2-99e4-7fe4965bf625] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:32.201353 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d7262979-b53f-4115-997b-052cd622c6ab tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:32.202249 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d7262979-b53f-4115-997b-052cd622c6ab tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:32.210224 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d7262979-b53f-4115-997b-052cd622c6ab tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:32.210224 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d7262979-b53f-4115-997b-052cd622c6ab tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:32.210224 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d7262979-b53f-4115-997b-052cd622c6ab tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:32.210224 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d7262979-b53f-4115-997b-052cd622c6ab tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:32.441658 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a1a50b56-50f7-4ac4-a1b4-94c25556b9f4 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f33238147dc49209bcebea4dfa47ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8546a1c3b3418fae012aa51fd37c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:32.473466 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a1a50b56-50f7-4ac4-a1b4-94c25556b9f4 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f33238147dc49209bcebea4dfa47ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8546a1c3b3418fae012aa51fd37c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:32.475138 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a1a50b56-50f7-4ac4-a1b4-94c25556b9f4 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f33238147dc49209bcebea4dfa47ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8546a1c3b3418fae012aa51fd37c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:32.484392 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a1a50b56-50f7-4ac4-a1b4-94c25556b9f4 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] 10.222.0.42 "GET /compute/v2.1/servers/5edd25b9-affc-45f4-a54f-66b262543ae5" status: 200 len: 1365 microversion: 2.47 time: 0.435851 Oct 23 01:23:32.493755 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1704/3382] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:23:32 2022] GET /compute/v2.1/servers/5edd25b9-affc-45f4-a54f-66b262543ae5 => generated 1365 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:23:32.508888 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a3dcc461-796c-4a24-88ff-4eefab10837f tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:32.516727 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a3dcc461-796c-4a24-88ff-4eefab10837f tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] [instance: e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:32.536837 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a3dcc461-796c-4a24-88ff-4eefab10837f tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:32.538211 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a3dcc461-796c-4a24-88ff-4eefab10837f tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:32.541671 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a3dcc461-796c-4a24-88ff-4eefab10837f tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:32.542797 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a3dcc461-796c-4a24-88ff-4eefab10837f tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:32.546877 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a3dcc461-796c-4a24-88ff-4eefab10837f tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:32.547642 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a3dcc461-796c-4a24-88ff-4eefab10837f tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:32.767113 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=10 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:32.990296 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a3dcc461-796c-4a24-88ff-4eefab10837f tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0501ceda4e8140e09fb4e94552487cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8525dcc00e844959a1527424291a3149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:33.003598 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a3dcc461-796c-4a24-88ff-4eefab10837f tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] 10.222.0.42 "GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c" status: 200 len: 1370 microversion: 2.1 time: 0.506208 Oct 23 01:23:33.007805 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1705/3383] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:32 2022] GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c => generated 1370 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:33.014826 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d7262979-b53f-4115-997b-052cd622c6ab tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:33.032422 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d7262979-b53f-4115-997b-052cd622c6ab tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625" status: 200 len: 1521 microversion: 2.1 time: 0.862451 Oct 23 01:23:33.036575 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1679/3384] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:32 2022] GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625 => generated 1521 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:23:33.040130 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1533fbb1-6b7d-4680-aa9b-dc187a7e62e2 tempest-VolumesGetTestJSON-1153915978 tempest-VolumesGetTestJSON-1153915978-project] Calling method '.version_select at 0x7f5cc19ea820>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:33.122831 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1533fbb1-6b7d-4680-aa9b-dc187a7e62e2 tempest-VolumesGetTestJSON-1153915978 tempest-VolumesGetTestJSON-1153915978-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/63b48007-10e0-472f-b012-d19ae48f7ffa" status: 200 len: 352 microversion: 2.1 time: 0.112943 Oct 23 01:23:33.123439 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1706/3385] 10.222.0.42 () {58 vars in 1245 bytes} [Sun Oct 23 01:23:33 2022] GET /compute/v2.1/os-volumes/63b48007-10e0-472f-b012-d19ae48f7ffa => generated 352 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:23:33.523630 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e86deaa3-590a-4299-b443-e92b744f0a21 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:33.525082 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e86deaa3-590a-4299-b443-e92b744f0a21 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] [instance: 5edd25b9-affc-45f4-a54f-66b262543ae5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:33.534546 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e86deaa3-590a-4299-b443-e92b744f0a21 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:33.535507 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e86deaa3-590a-4299-b443-e92b744f0a21 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:33.536164 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e86deaa3-590a-4299-b443-e92b744f0a21 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:33.539522 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e86deaa3-590a-4299-b443-e92b744f0a21 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:33.540169 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e86deaa3-590a-4299-b443-e92b744f0a21 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:33.540940 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e86deaa3-590a-4299-b443-e92b744f0a21 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:33.649539 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e86deaa3-590a-4299-b443-e92b744f0a21 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f33238147dc49209bcebea4dfa47ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8546a1c3b3418fae012aa51fd37c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:33.661513 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e86deaa3-590a-4299-b443-e92b744f0a21 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f33238147dc49209bcebea4dfa47ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8546a1c3b3418fae012aa51fd37c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:33.664061 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e86deaa3-590a-4299-b443-e92b744f0a21 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f33238147dc49209bcebea4dfa47ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8546a1c3b3418fae012aa51fd37c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:33.665773 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e86deaa3-590a-4299-b443-e92b744f0a21 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] 10.222.0.42 "GET /compute/v2.1/servers/5edd25b9-affc-45f4-a54f-66b262543ae5" status: 200 len: 1365 microversion: 2.47 time: 0.147505 Oct 23 01:23:33.666911 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1680/3386] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:23:33 2022] GET /compute/v2.1/servers/5edd25b9-affc-45f4-a54f-66b262543ae5 => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:23:34.012723 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-610bf1b0-0cb0-43bc-801a-052a765d22ba tempest-SecurityGroupRulesTestJSON-1771044740 tempest-SecurityGroupRulesTestJSON-1771044740-project] Action: 'create', calling method: .version_select at 0x7f5cc18925e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1682622665", "description": "tempest-description-911658006"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:23:34.032740 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0b0e7017-186a-4399-a272-d0c47125089d tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:34.033463 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0b0e7017-186a-4399-a272-d0c47125089d tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] [instance: e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:34.043765 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b0e7017-186a-4399-a272-d0c47125089d tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:34.044524 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b0e7017-186a-4399-a272-d0c47125089d tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:34.045123 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b0e7017-186a-4399-a272-d0c47125089d tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:34.047338 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b0e7017-186a-4399-a272-d0c47125089d tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:34.047979 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b0e7017-186a-4399-a272-d0c47125089d tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:34.048418 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b0e7017-186a-4399-a272-d0c47125089d tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:34.213087 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0b0e7017-186a-4399-a272-d0c47125089d tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0501ceda4e8140e09fb4e94552487cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8525dcc00e844959a1527424291a3149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:34.220992 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0b0e7017-186a-4399-a272-d0c47125089d tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] 10.222.0.42 "GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c" status: 200 len: 1370 microversion: 2.1 time: 0.192059 Oct 23 01:23:34.221578 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1681/3387] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:34 2022] GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c => generated 1370 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:23:34.230643 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9c389e7e-90af-4bf5-811f-182b614e6bc2 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:34.230643 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9c389e7e-90af-4bf5-811f-182b614e6bc2 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 79681d58-1364-42d2-99e4-7fe4965bf625] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:34.233921 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9c389e7e-90af-4bf5-811f-182b614e6bc2 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:34.234592 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9c389e7e-90af-4bf5-811f-182b614e6bc2 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:34.235231 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9c389e7e-90af-4bf5-811f-182b614e6bc2 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:34.236093 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9c389e7e-90af-4bf5-811f-182b614e6bc2 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:34.236727 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9c389e7e-90af-4bf5-811f-182b614e6bc2 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:34.237440 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9c389e7e-90af-4bf5-811f-182b614e6bc2 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:34.497753 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9c389e7e-90af-4bf5-811f-182b614e6bc2 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:34.507033 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9c389e7e-90af-4bf5-811f-182b614e6bc2 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625" status: 200 len: 1521 microversion: 2.1 time: 0.283700 Oct 23 01:23:34.531048 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-610bf1b0-0cb0-43bc-801a-052a765d22ba tempest-SecurityGroupRulesTestJSON-1771044740 tempest-SecurityGroupRulesTestJSON-1771044740-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.571790 Oct 23 01:23:34.532599 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1707/3388] 10.222.0.42 () {60 vars in 1180 bytes} [Sun Oct 23 01:23:33 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:23:34.538038 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ba9edc2d-e336-46d7-87bd-6eeba41e1229 tempest-VolumesGetTestJSON-1153915978 tempest-VolumesGetTestJSON-1153915978-project] Calling method '.version_select at 0x7f5cc176ce50>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:34.541172 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1682/3389] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:34 2022] GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625 => generated 1521 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:34.552458 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-23910724-5704-4fa7-a025-73691d54ff6c tempest-SecurityGroupRulesTestJSON-1771044740 tempest-SecurityGroupRulesTestJSON-1771044740-project] Action: 'create', calling method: .version_select at 0x7f5cc1791790>, body: {"security_group_rule": {"parent_group_id": "feaa54c9-461e-4dcb-bcd6-b8b8eb719f68", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:23:34.602928 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-ba9edc2d-e336-46d7-87bd-6eeba41e1229 tempest-VolumesGetTestJSON-1153915978 tempest-VolumesGetTestJSON-1153915978-project] HTTP exception thrown: Volume 63b48007-10e0-472f-b012-d19ae48f7ffa could not be found. Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ba9edc2d-e336-46d7-87bd-6eeba41e1229 tempest-VolumesGetTestJSON-1153915978 tempest-VolumesGetTestJSON-1153915978-project] Request method failure captured: Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/os-volumes/63b48007-10e0-472f-b012-d19ae48f7ffa HTTP/1.1 Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJeLAc_sE1jAEwHQZqQKAwg6R-oeF1wCijY33KyxNkev6Bd4wk7NV4Hwo2v2_pCCQ11cEuPFi-lTG3PhamXqYSe4ZLua9RQcqnPFAla-rzlXvfOoUEhpUJBn90n0p0IszIpD5MKHTmbzvmzcgJjsy0ojjSsdlcxEn3w4nnZKglKf9eQ Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 1d059158eca14b8ab0caa00c193d6bc9 Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-VolumesGetTestJSON-1153915978 Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1d059158eca14b8ab0caa00c193d6bc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1d059158eca14b8ab0caa00c193d6bc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1d059158eca14b8ab0caa00c193d6bc9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1d059158eca14b8ab0caa00c193d6bc9"}]}] Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-VolumesGetTestJSON-1153915978 Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 1d059158eca14b8ab0caa00c193d6bc9 Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-VolumesGetTestJSON-1153915978 Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-VolumesGetTestJSON-1153915978-project Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 335bd787ce2e4d07b9d983cbec741c08 Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-VolumesGetTestJSON-1153915978-project Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: method: Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: exception: Volume 63b48007-10e0-472f-b012-d19ae48f7ffa could not be found. Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '63b48007-10e0-472f-b012-d19ae48f7ffa'} Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 63b48007-10e0-472f-b012-d19ae48f7ffa could not be found. (HTTP 404) (Request-ID: req-9da4a0ca-fabf-46fc-843c-9caa0d9c9f62) Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 23 01:23:34.636576 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 01:23:34.641845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 01:23:34.641845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 23 01:23:34.641845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 23 01:23:34.641845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 23 01:23:34.641845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 23 01:23:34.641845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 23 01:23:34.641845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 23 01:23:34.641845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 23 01:23:34.641845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 23 01:23:34.641845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 01:23:34.641845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 01:23:34.641845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 01:23:34.641845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 01:23:34.641845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 63b48007-10e0-472f-b012-d19ae48f7ffa could not be found. Oct 23 01:23:34.641845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:34.641845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:23:34.641845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:34.641845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:34.641845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:23:34.641845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:23:34.641845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:23:34.641845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:23:34.641845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:23:34.641845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:23:34.641845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:23:34.641845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:23:34.641845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 23 01:23:34.641845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:23:34.641845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 63b48007-10e0-472f-b012-d19ae48f7ffa could not be found. Oct 23 01:23:34.641845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:34.641845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:23:34.641845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:34.641845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:34.641845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:23:34.641845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:23:34.641845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:23:34.641845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:23:34.641845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 63b48007-10e0-472f-b012-d19ae48f7ffa could not be found. Oct 23 01:23:34.641845 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:34.649022 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ba9edc2d-e336-46d7-87bd-6eeba41e1229 tempest-VolumesGetTestJSON-1153915978 tempest-VolumesGetTestJSON-1153915978-project] Returning 404 to user: Volume 63b48007-10e0-472f-b012-d19ae48f7ffa could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:23:34.649022 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ba9edc2d-e336-46d7-87bd-6eeba41e1229 tempest-VolumesGetTestJSON-1153915978 tempest-VolumesGetTestJSON-1153915978-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/63b48007-10e0-472f-b012-d19ae48f7ffa" status: 404 len: 109 microversion: 2.1 time: 0.110684 Oct 23 01:23:34.649022 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1708/3390] 10.222.0.42 () {58 vars in 1245 bytes} [Sun Oct 23 01:23:34 2022] GET /compute/v2.1/os-volumes/63b48007-10e0-472f-b012-d19ae48f7ffa => generated 109 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:23:34.698440 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-68383f1a-c8ed-4c90-8da8-099bc6ed9346 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:34.699067 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-68383f1a-c8ed-4c90-8da8-099bc6ed9346 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] [instance: 5edd25b9-affc-45f4-a54f-66b262543ae5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:34.719287 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68383f1a-c8ed-4c90-8da8-099bc6ed9346 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:34.722069 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68383f1a-c8ed-4c90-8da8-099bc6ed9346 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:34.726668 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68383f1a-c8ed-4c90-8da8-099bc6ed9346 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:34.727630 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68383f1a-c8ed-4c90-8da8-099bc6ed9346 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:34.728261 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68383f1a-c8ed-4c90-8da8-099bc6ed9346 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:34.728882 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68383f1a-c8ed-4c90-8da8-099bc6ed9346 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:34.839275 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-68383f1a-c8ed-4c90-8da8-099bc6ed9346 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f33238147dc49209bcebea4dfa47ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8546a1c3b3418fae012aa51fd37c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:34.851531 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-68383f1a-c8ed-4c90-8da8-099bc6ed9346 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f33238147dc49209bcebea4dfa47ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8546a1c3b3418fae012aa51fd37c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:34.853446 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-68383f1a-c8ed-4c90-8da8-099bc6ed9346 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f33238147dc49209bcebea4dfa47ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8546a1c3b3418fae012aa51fd37c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:34.855189 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-68383f1a-c8ed-4c90-8da8-099bc6ed9346 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] 10.222.0.42 "GET /compute/v2.1/servers/5edd25b9-affc-45f4-a54f-66b262543ae5" status: 200 len: 1365 microversion: 2.47 time: 0.162617 Oct 23 01:23:34.870772 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1709/3391] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:23:34 2022] GET /compute/v2.1/servers/5edd25b9-affc-45f4-a54f-66b262543ae5 => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:23:35.177624 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-23910724-5704-4fa7-a025-73691d54ff6c tempest-SecurityGroupRulesTestJSON-1771044740 tempest-SecurityGroupRulesTestJSON-1771044740-project] 10.222.0.42 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.627170 Oct 23 01:23:35.177624 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1683/3392] 10.222.0.42 () {60 vars in 1195 bytes} [Sun Oct 23 01:23:34 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:23:35.190806 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a32ccfc5-e1bf-4c4d-9c60-977d3b95e9c2 tempest-SecurityGroupRulesTestJSON-1771044740 tempest-SecurityGroupRulesTestJSON-1771044740-project] Action: 'create', calling method: .version_select at 0x7f5cc184fca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-372552829", "description": "tempest-description-19198701"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:23:35.245113 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-14a759b8-9e9b-4acf-a029-a0c2ac2584ea tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:35.246614 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-14a759b8-9e9b-4acf-a029-a0c2ac2584ea tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] [instance: e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:35.255631 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-14a759b8-9e9b-4acf-a029-a0c2ac2584ea tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:35.256418 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-14a759b8-9e9b-4acf-a029-a0c2ac2584ea tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:35.257070 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-14a759b8-9e9b-4acf-a029-a0c2ac2584ea tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:35.258284 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-14a759b8-9e9b-4acf-a029-a0c2ac2584ea tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:35.259345 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-14a759b8-9e9b-4acf-a029-a0c2ac2584ea tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:35.260050 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-14a759b8-9e9b-4acf-a029-a0c2ac2584ea tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:35.535941 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-14a759b8-9e9b-4acf-a029-a0c2ac2584ea tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0501ceda4e8140e09fb4e94552487cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8525dcc00e844959a1527424291a3149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:35.545470 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-14a759b8-9e9b-4acf-a029-a0c2ac2584ea tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] 10.222.0.42 "GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c" status: 200 len: 1370 microversion: 2.1 time: 0.304196 Oct 23 01:23:35.568758 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1684/3393] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:35 2022] GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c => generated 1370 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:23:35.574131 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-da33bc22-3f07-4fa1-bccb-9626aa83a606 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:35.577751 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-da33bc22-3f07-4fa1-bccb-9626aa83a606 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 79681d58-1364-42d2-99e4-7fe4965bf625] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:35.592859 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da33bc22-3f07-4fa1-bccb-9626aa83a606 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:35.600737 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da33bc22-3f07-4fa1-bccb-9626aa83a606 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:35.601571 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da33bc22-3f07-4fa1-bccb-9626aa83a606 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:35.610348 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da33bc22-3f07-4fa1-bccb-9626aa83a606 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:35.610990 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da33bc22-3f07-4fa1-bccb-9626aa83a606 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:35.611442 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da33bc22-3f07-4fa1-bccb-9626aa83a606 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:35.757903 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a32ccfc5-e1bf-4c4d-9c60-977d3b95e9c2 tempest-SecurityGroupRulesTestJSON-1771044740 tempest-SecurityGroupRulesTestJSON-1771044740-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.571008 Oct 23 01:23:35.758433 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1710/3394] 10.222.0.42 () {60 vars in 1180 bytes} [Sun Oct 23 01:23:35 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:23:35.773866 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c5a9f336-750d-4d5b-a759-cef301b857aa tempest-SecurityGroupRulesTestJSON-1771044740 tempest-SecurityGroupRulesTestJSON-1771044740-project] Action: 'create', calling method: .version_select at 0x7f5cc19ea4c0>, body: {"security_group_rule": {"parent_group_id": "acc0dc3b-b2c6-4fc3-b7d7-0f5e6dd403aa", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:23:35.837055 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-da33bc22-3f07-4fa1-bccb-9626aa83a606 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:35.850810 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-da33bc22-3f07-4fa1-bccb-9626aa83a606 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625" status: 200 len: 1521 microversion: 2.1 time: 0.285962 Oct 23 01:23:35.855679 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1685/3395] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:35 2022] GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625 => generated 1521 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:35.887709 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-315db3a9-1d0f-40da-9ca9-e6509db0a026 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:35.888725 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-315db3a9-1d0f-40da-9ca9-e6509db0a026 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] [instance: 5edd25b9-affc-45f4-a54f-66b262543ae5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:35.896219 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-315db3a9-1d0f-40da-9ca9-e6509db0a026 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:35.897707 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-315db3a9-1d0f-40da-9ca9-e6509db0a026 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:35.909775 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-315db3a9-1d0f-40da-9ca9-e6509db0a026 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:35.910983 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-315db3a9-1d0f-40da-9ca9-e6509db0a026 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:35.911721 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-315db3a9-1d0f-40da-9ca9-e6509db0a026 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:35.913782 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-315db3a9-1d0f-40da-9ca9-e6509db0a026 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:36.099166 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-315db3a9-1d0f-40da-9ca9-e6509db0a026 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f33238147dc49209bcebea4dfa47ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8546a1c3b3418fae012aa51fd37c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:36.165419 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-315db3a9-1d0f-40da-9ca9-e6509db0a026 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f33238147dc49209bcebea4dfa47ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8546a1c3b3418fae012aa51fd37c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:36.167034 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-315db3a9-1d0f-40da-9ca9-e6509db0a026 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f33238147dc49209bcebea4dfa47ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8546a1c3b3418fae012aa51fd37c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:36.170955 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-315db3a9-1d0f-40da-9ca9-e6509db0a026 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] 10.222.0.42 "GET /compute/v2.1/servers/5edd25b9-affc-45f4-a54f-66b262543ae5" status: 200 len: 1365 microversion: 2.47 time: 0.287227 Oct 23 01:23:36.172089 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1686/3396] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:23:35 2022] GET /compute/v2.1/servers/5edd25b9-affc-45f4-a54f-66b262543ae5 => generated 1365 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:23:36.575093 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d592865f-32ce-43eb-9eb1-2fb2a7ff113b tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:36.577055 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d592865f-32ce-43eb-9eb1-2fb2a7ff113b tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] [instance: e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:36.591542 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d592865f-32ce-43eb-9eb1-2fb2a7ff113b tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:36.592264 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d592865f-32ce-43eb-9eb1-2fb2a7ff113b tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:36.592875 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d592865f-32ce-43eb-9eb1-2fb2a7ff113b tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:36.594490 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d592865f-32ce-43eb-9eb1-2fb2a7ff113b tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:36.595190 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d592865f-32ce-43eb-9eb1-2fb2a7ff113b tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:36.595825 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d592865f-32ce-43eb-9eb1-2fb2a7ff113b tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:36.646342 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c5a9f336-750d-4d5b-a759-cef301b857aa tempest-SecurityGroupRulesTestJSON-1771044740 tempest-SecurityGroupRulesTestJSON-1771044740-project] 10.222.0.42 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.876805 Oct 23 01:23:36.646342 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1711/3397] 10.222.0.42 () {60 vars in 1195 bytes} [Sun Oct 23 01:23:35 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:23:36.666332 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e774a34d-3e9b-4aff-9d6f-1b1f4826be24 tempest-SecurityGroupRulesTestJSON-1771044740 tempest-SecurityGroupRulesTestJSON-1771044740-project] Action: 'create', calling method: .version_select at 0x7f5cc6109280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-728588063", "description": "tempest-description-42011180"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:23:36.868419 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d592865f-32ce-43eb-9eb1-2fb2a7ff113b tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0501ceda4e8140e09fb4e94552487cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8525dcc00e844959a1527424291a3149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:36.878169 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d592865f-32ce-43eb-9eb1-2fb2a7ff113b tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] 10.222.0.42 "GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c" status: 200 len: 1370 microversion: 2.1 time: 0.307497 Oct 23 01:23:36.889929 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1687/3398] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:36 2022] GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c => generated 1370 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:23:36.899339 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3cb477f7-0ace-4d31-83fe-7ee41a90f92b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:36.901102 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3cb477f7-0ace-4d31-83fe-7ee41a90f92b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 79681d58-1364-42d2-99e4-7fe4965bf625] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:36.906611 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3cb477f7-0ace-4d31-83fe-7ee41a90f92b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:36.907334 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3cb477f7-0ace-4d31-83fe-7ee41a90f92b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:36.908080 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3cb477f7-0ace-4d31-83fe-7ee41a90f92b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:36.909261 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3cb477f7-0ace-4d31-83fe-7ee41a90f92b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:36.909872 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3cb477f7-0ace-4d31-83fe-7ee41a90f92b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:36.910488 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3cb477f7-0ace-4d31-83fe-7ee41a90f92b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:37.106356 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3cb477f7-0ace-4d31-83fe-7ee41a90f92b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:37.119727 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3cb477f7-0ace-4d31-83fe-7ee41a90f92b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625" status: 200 len: 1521 microversion: 2.1 time: 0.228430 Oct 23 01:23:37.134002 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1688/3399] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:36 2022] GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625 => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:37.200576 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2486edf7-f573-49e7-af98-4a0d3496284e tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:37.229621 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2486edf7-f573-49e7-af98-4a0d3496284e tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] [instance: 5edd25b9-affc-45f4-a54f-66b262543ae5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:37.229621 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2486edf7-f573-49e7-af98-4a0d3496284e tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:37.229621 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2486edf7-f573-49e7-af98-4a0d3496284e tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:37.229621 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2486edf7-f573-49e7-af98-4a0d3496284e tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:37.229621 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2486edf7-f573-49e7-af98-4a0d3496284e tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:37.229621 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2486edf7-f573-49e7-af98-4a0d3496284e tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:37.229621 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2486edf7-f573-49e7-af98-4a0d3496284e tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:37.338040 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2486edf7-f573-49e7-af98-4a0d3496284e tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f33238147dc49209bcebea4dfa47ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8546a1c3b3418fae012aa51fd37c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:37.390867 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e774a34d-3e9b-4aff-9d6f-1b1f4826be24 tempest-SecurityGroupRulesTestJSON-1771044740 tempest-SecurityGroupRulesTestJSON-1771044740-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.717694 Oct 23 01:23:37.390867 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1712/3400] 10.222.0.42 () {60 vars in 1180 bytes} [Sun Oct 23 01:23:36 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:23:37.391428 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2486edf7-f573-49e7-af98-4a0d3496284e tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f33238147dc49209bcebea4dfa47ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8546a1c3b3418fae012aa51fd37c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:37.391428 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2486edf7-f573-49e7-af98-4a0d3496284e tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f33238147dc49209bcebea4dfa47ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8546a1c3b3418fae012aa51fd37c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:37.391428 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2486edf7-f573-49e7-af98-4a0d3496284e tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] 10.222.0.42 "GET /compute/v2.1/servers/5edd25b9-affc-45f4-a54f-66b262543ae5" status: 200 len: 1365 microversion: 2.47 time: 0.184606 Oct 23 01:23:37.391428 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1689/3401] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:23:37 2022] GET /compute/v2.1/servers/5edd25b9-affc-45f4-a54f-66b262543ae5 => generated 1365 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:23:37.396243 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3cd3f3d4-9e6b-4fce-afd7-58e947dd11fe tempest-SecurityGroupRulesTestJSON-1771044740 tempest-SecurityGroupRulesTestJSON-1771044740-project] Action: 'create', calling method: .version_select at 0x7f5cc1a27700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2116572065", "description": "tempest-description-1197701120"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:23:37.904379 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d5e2c28f-d166-4fdb-8ee5-d3bd28ed26d6 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:37.907517 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d5e2c28f-d166-4fdb-8ee5-d3bd28ed26d6 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] [instance: e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:37.916281 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d5e2c28f-d166-4fdb-8ee5-d3bd28ed26d6 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:37.918834 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d5e2c28f-d166-4fdb-8ee5-d3bd28ed26d6 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:37.919572 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d5e2c28f-d166-4fdb-8ee5-d3bd28ed26d6 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:37.920480 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d5e2c28f-d166-4fdb-8ee5-d3bd28ed26d6 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:37.921197 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d5e2c28f-d166-4fdb-8ee5-d3bd28ed26d6 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:37.921792 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d5e2c28f-d166-4fdb-8ee5-d3bd28ed26d6 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:37.955133 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:38.097065 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3cd3f3d4-9e6b-4fce-afd7-58e947dd11fe tempest-SecurityGroupRulesTestJSON-1771044740 tempest-SecurityGroupRulesTestJSON-1771044740-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.708442 Oct 23 01:23:38.098607 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1713/3402] 10.222.0.42 () {60 vars in 1180 bytes} [Sun Oct 23 01:23:37 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:23:38.114553 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e29f1565-4f3c-4275-9f4c-ff1715609875 tempest-SecurityGroupRulesTestJSON-1771044740 tempest-SecurityGroupRulesTestJSON-1771044740-project] Action: 'create', calling method: .version_select at 0x7f5cc180b4c0>, body: {"security_group_rule": {"parent_group_id": "d3ec3002-9179-49f9-a4cd-15e82caf3420", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "54d42099-9329-4796-8c5e-ed0ef094af21"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:23:38.155351 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d5e2c28f-d166-4fdb-8ee5-d3bd28ed26d6 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0501ceda4e8140e09fb4e94552487cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8525dcc00e844959a1527424291a3149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:38.169260 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d5e2c28f-d166-4fdb-8ee5-d3bd28ed26d6 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] 10.222.0.42 "GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c" status: 200 len: 1370 microversion: 2.1 time: 0.267822 Oct 23 01:23:38.173159 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1690/3403] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:37 2022] GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c => generated 1370 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:23:38.185245 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9613491f-1096-48f7-87fc-6f2bdd4189f3 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:38.186770 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9613491f-1096-48f7-87fc-6f2bdd4189f3 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 79681d58-1364-42d2-99e4-7fe4965bf625] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:38.197414 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9613491f-1096-48f7-87fc-6f2bdd4189f3 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:38.197414 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9613491f-1096-48f7-87fc-6f2bdd4189f3 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:38.197414 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9613491f-1096-48f7-87fc-6f2bdd4189f3 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:38.197414 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9613491f-1096-48f7-87fc-6f2bdd4189f3 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:38.197414 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9613491f-1096-48f7-87fc-6f2bdd4189f3 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:38.198454 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9613491f-1096-48f7-87fc-6f2bdd4189f3 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:38.893161 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9613491f-1096-48f7-87fc-6f2bdd4189f3 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:38.904032 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9613491f-1096-48f7-87fc-6f2bdd4189f3 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625" status: 200 len: 1501 microversion: 2.1 time: 0.729205 Oct 23 01:23:38.910780 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1691/3404] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:38 2022] GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625 => generated 1501 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:38.910780 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ed3f0e1c-81b0-4ca3-8416-2422b7ad007b tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:38.911772 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ed3f0e1c-81b0-4ca3-8416-2422b7ad007b tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] [instance: 5edd25b9-affc-45f4-a54f-66b262543ae5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:38.920405 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ed3f0e1c-81b0-4ca3-8416-2422b7ad007b tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:38.920905 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ed3f0e1c-81b0-4ca3-8416-2422b7ad007b tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:38.921350 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ed3f0e1c-81b0-4ca3-8416-2422b7ad007b tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:38.922182 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ed3f0e1c-81b0-4ca3-8416-2422b7ad007b tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:38.922720 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ed3f0e1c-81b0-4ca3-8416-2422b7ad007b tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:38.923155 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ed3f0e1c-81b0-4ca3-8416-2422b7ad007b tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:39.051184 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ed3f0e1c-81b0-4ca3-8416-2422b7ad007b tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f33238147dc49209bcebea4dfa47ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8546a1c3b3418fae012aa51fd37c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:39.072474 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ed3f0e1c-81b0-4ca3-8416-2422b7ad007b tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f33238147dc49209bcebea4dfa47ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8546a1c3b3418fae012aa51fd37c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:39.075130 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ed3f0e1c-81b0-4ca3-8416-2422b7ad007b tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f33238147dc49209bcebea4dfa47ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8546a1c3b3418fae012aa51fd37c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:39.083339 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ed3f0e1c-81b0-4ca3-8416-2422b7ad007b tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] 10.222.0.42 "GET /compute/v2.1/servers/5edd25b9-affc-45f4-a54f-66b262543ae5" status: 200 len: 1365 microversion: 2.47 time: 0.177130 Oct 23 01:23:39.083947 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1692/3405] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:23:38 2022] GET /compute/v2.1/servers/5edd25b9-affc-45f4-a54f-66b262543ae5 => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:23:39.101860 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a67e0acf-408b-452e-9a92-ecf6f8c9bf3f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:39.102836 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a67e0acf-408b-452e-9a92-ecf6f8c9bf3f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 3d9196f6-d696-45e0-b7fc-8d1557498393] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:39.111887 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a67e0acf-408b-452e-9a92-ecf6f8c9bf3f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:39.112535 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a67e0acf-408b-452e-9a92-ecf6f8c9bf3f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:39.113294 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a67e0acf-408b-452e-9a92-ecf6f8c9bf3f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:39.114751 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a67e0acf-408b-452e-9a92-ecf6f8c9bf3f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:39.115518 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a67e0acf-408b-452e-9a92-ecf6f8c9bf3f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:39.116520 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a67e0acf-408b-452e-9a92-ecf6f8c9bf3f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:39.375017 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a67e0acf-408b-452e-9a92-ecf6f8c9bf3f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:39.385719 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a67e0acf-408b-452e-9a92-ecf6f8c9bf3f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393" status: 200 len: 1515 microversion: 2.1 time: 0.300097 Oct 23 01:23:39.387023 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1693/3406] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:39 2022] GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393 => generated 1515 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:39.391913 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3d1b9de6-94bf-46be-991e-406e1ba28f74 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:39.392790 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3d1b9de6-94bf-46be-991e-406e1ba28f74 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] [instance: e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:39.400299 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3d1b9de6-94bf-46be-991e-406e1ba28f74 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:39.401162 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3d1b9de6-94bf-46be-991e-406e1ba28f74 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:39.401951 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3d1b9de6-94bf-46be-991e-406e1ba28f74 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:39.402907 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3d1b9de6-94bf-46be-991e-406e1ba28f74 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:39.404357 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3d1b9de6-94bf-46be-991e-406e1ba28f74 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:39.404800 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3d1b9de6-94bf-46be-991e-406e1ba28f74 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:39.552411 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3d1b9de6-94bf-46be-991e-406e1ba28f74 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0501ceda4e8140e09fb4e94552487cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8525dcc00e844959a1527424291a3149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:39.561152 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3d1b9de6-94bf-46be-991e-406e1ba28f74 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] 10.222.0.42 "GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c" status: 200 len: 1370 microversion: 2.1 time: 0.173234 Oct 23 01:23:39.561798 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1694/3407] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:39 2022] GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c => generated 1370 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:39.566322 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-baf114f3-6d15-4e2c-9618-fb1d06f15cde tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:23:39.569499 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-baf114f3-6d15-4e2c-9618-fb1d06f15cde tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 710f66c4-0b40-4297-b687-89055e9e2865] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:39.575054 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-baf114f3-6d15-4e2c-9618-fb1d06f15cde tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] HTTP exception thrown: Instance 710f66c4-0b40-4297-b687-89055e9e2865 could not be found. Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-baf114f3-6d15-4e2c-9618-fb1d06f15cde tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Request method failure captured: Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/servers/710f66c4-0b40-4297-b687-89055e9e2865/action HTTP/1.1 Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 14 Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJdQk8hX6uPg4qHO6qc2mwusfqzM5L9E46F0sE_pC33qOsFxuj7jBx97KQnGjJpiMRyi7Ccd4qVZLYee5QWMbRFkTPXMBEfS5K72Bw65O1CzepVHWqpUTGTMXTiFqb2LFyp2Lx0G54EC4LTSr0BIWkU_QP9JqR2fGUhTDQevTmiXx40 Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 4c25b4509ad7457bad4a2e5e0bc59add Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1648319695 Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4c25b4509ad7457bad4a2e5e0bc59add"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4c25b4509ad7457bad4a2e5e0bc59add"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4c25b4509ad7457bad4a2e5e0bc59add"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4c25b4509ad7457bad4a2e5e0bc59add"}]}] Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1648319695 Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 4c25b4509ad7457bad4a2e5e0bc59add Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1648319695 Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServerRescueNegativeTestJSON-1648319695-project Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 19bff9f7a4254110b3b89f0cba5d252f Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1648319695-project Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: {"rescue": {}} Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 710f66c4-0b40-4297-b687-89055e9e2865 could not be found. Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '710f66c4-0b40-4297-b687-89055e9e2865', 'body': {'rescue': {}}} Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 710f66c4-0b40-4297-b687-89055e9e2865 could not be found. Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 710f66c4-0b40-4297-b687-89055e9e2865 could not be found. Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:23:39.584019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:39.589425 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:23:39.589425 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:23:39.589425 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:23:39.589425 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:23:39.589425 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 710f66c4-0b40-4297-b687-89055e9e2865 could not be found. Oct 23 01:23:39.589425 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:23:39.589425 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-baf114f3-6d15-4e2c-9618-fb1d06f15cde tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Returning 404 to user: Instance 710f66c4-0b40-4297-b687-89055e9e2865 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:23:39.589425 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-baf114f3-6d15-4e2c-9618-fb1d06f15cde tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "POST /compute/v2.1/servers/710f66c4-0b40-4297-b687-89055e9e2865/action" status: 404 len: 111 microversion: 2.1 time: 0.023220 Oct 23 01:23:39.589425 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1695/3408] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:23:39 2022] POST /compute/v2.1/servers/710f66c4-0b40-4297-b687-89055e9e2865/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:23:39.595297 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e37a1a11-1b28-414e-add1-89a8083cc4eb tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:23:39.595826 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e37a1a11-1b28-414e-add1-89a8083cc4eb tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 3d9196f6-d696-45e0-b7fc-8d1557498393] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:39.604787 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e37a1a11-1b28-414e-add1-89a8083cc4eb tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:39.605290 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e37a1a11-1b28-414e-add1-89a8083cc4eb tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:39.605716 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e37a1a11-1b28-414e-add1-89a8083cc4eb tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:39.606507 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e37a1a11-1b28-414e-add1-89a8083cc4eb tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:39.606970 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e37a1a11-1b28-414e-add1-89a8083cc4eb tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:39.607403 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e37a1a11-1b28-414e-add1-89a8083cc4eb tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:39.744716 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e29f1565-4f3c-4275-9f4c-ff1715609875 tempest-SecurityGroupRulesTestJSON-1771044740 tempest-SecurityGroupRulesTestJSON-1771044740-project] 10.222.0.42 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.636762 Oct 23 01:23:39.745381 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1714/3409] 10.222.0.42 () {60 vars in 1195 bytes} [Sun Oct 23 01:23:38 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1638 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:23:39.760263 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-36ec2b90-c0dc-4733-bbb7-ab46cf54c359 tempest-SecurityGroupRulesTestJSON-1771044740 tempest-SecurityGroupRulesTestJSON-1771044740-project] Action: 'create', calling method: .version_select at 0x7f5cc62181f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-211127421", "description": "tempest-description-1713058882"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:23:39.912420 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e37a1a11-1b28-414e-add1-89a8083cc4eb tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "POST /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393/action" status: 202 len: 0 microversion: 2.1 time: 0.320316 Oct 23 01:23:39.916015 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1696/3410] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:23:39 2022] POST /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 23 01:23:39.921357 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bdf37108-da2f-45bd-826a-83b332b9a435 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:39.922188 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-bdf37108-da2f-45bd-826a-83b332b9a435 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 3d9196f6-d696-45e0-b7fc-8d1557498393] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:39.932338 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bdf37108-da2f-45bd-826a-83b332b9a435 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:39.932338 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bdf37108-da2f-45bd-826a-83b332b9a435 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:39.932338 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bdf37108-da2f-45bd-826a-83b332b9a435 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:39.932338 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bdf37108-da2f-45bd-826a-83b332b9a435 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:39.932338 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bdf37108-da2f-45bd-826a-83b332b9a435 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:39.933166 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bdf37108-da2f-45bd-826a-83b332b9a435 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:40.132256 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bdf37108-da2f-45bd-826a-83b332b9a435 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:40.143035 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bdf37108-da2f-45bd-826a-83b332b9a435 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393" status: 200 len: 1520 microversion: 2.1 time: 0.224146 Oct 23 01:23:40.143035 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1697/3411] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:39 2022] GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393 => generated 1520 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:40.147077 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b7e4f970-3ea3-404b-8563-141eed36167a tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:40.147756 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b7e4f970-3ea3-404b-8563-141eed36167a tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] [instance: 5edd25b9-affc-45f4-a54f-66b262543ae5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:40.153616 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b7e4f970-3ea3-404b-8563-141eed36167a tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:40.154242 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b7e4f970-3ea3-404b-8563-141eed36167a tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:40.154771 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b7e4f970-3ea3-404b-8563-141eed36167a tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:40.156281 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b7e4f970-3ea3-404b-8563-141eed36167a tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:40.157201 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b7e4f970-3ea3-404b-8563-141eed36167a tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:40.158154 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b7e4f970-3ea3-404b-8563-141eed36167a tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:40.252206 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b7e4f970-3ea3-404b-8563-141eed36167a tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f33238147dc49209bcebea4dfa47ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8546a1c3b3418fae012aa51fd37c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:40.272474 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b7e4f970-3ea3-404b-8563-141eed36167a tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f33238147dc49209bcebea4dfa47ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8546a1c3b3418fae012aa51fd37c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:40.275103 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b7e4f970-3ea3-404b-8563-141eed36167a tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f33238147dc49209bcebea4dfa47ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8546a1c3b3418fae012aa51fd37c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:40.276846 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b7e4f970-3ea3-404b-8563-141eed36167a tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] 10.222.0.42 "GET /compute/v2.1/servers/5edd25b9-affc-45f4-a54f-66b262543ae5" status: 200 len: 1365 microversion: 2.47 time: 0.133817 Oct 23 01:23:40.277744 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1698/3412] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:23:40 2022] GET /compute/v2.1/servers/5edd25b9-affc-45f4-a54f-66b262543ae5 => generated 1365 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:23:40.339629 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-36ec2b90-c0dc-4733-bbb7-ab46cf54c359 tempest-SecurityGroupRulesTestJSON-1771044740 tempest-SecurityGroupRulesTestJSON-1771044740-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.584640 Oct 23 01:23:40.340356 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1715/3413] 10.222.0.42 () {60 vars in 1180 bytes} [Sun Oct 23 01:23:39 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:23:40.354003 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7a8ceae8-76f7-41d8-a892-6a4054d9b823 tempest-SecurityGroupRulesTestJSON-1771044740 tempest-SecurityGroupRulesTestJSON-1771044740-project] Action: 'create', calling method: .version_select at 0x7f5cc16f1160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1898434868", "description": "tempest-description-56680477"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:23:40.585831 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-428ba870-2e6a-48a5-b54a-f1449087dd88 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:40.586735 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-428ba870-2e6a-48a5-b54a-f1449087dd88 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] [instance: e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:40.592826 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-428ba870-2e6a-48a5-b54a-f1449087dd88 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:40.593314 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-428ba870-2e6a-48a5-b54a-f1449087dd88 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:40.593750 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-428ba870-2e6a-48a5-b54a-f1449087dd88 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:40.595026 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-428ba870-2e6a-48a5-b54a-f1449087dd88 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:40.595147 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-428ba870-2e6a-48a5-b54a-f1449087dd88 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:40.595584 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-428ba870-2e6a-48a5-b54a-f1449087dd88 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:40.755649 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-428ba870-2e6a-48a5-b54a-f1449087dd88 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0501ceda4e8140e09fb4e94552487cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8525dcc00e844959a1527424291a3149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:40.765566 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-428ba870-2e6a-48a5-b54a-f1449087dd88 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] 10.222.0.42 "GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c" status: 200 len: 1370 microversion: 2.1 time: 0.184706 Oct 23 01:23:40.766533 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1716/3414] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:40 2022] GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c => generated 1370 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:23:40.837735 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7a8ceae8-76f7-41d8-a892-6a4054d9b823 tempest-SecurityGroupRulesTestJSON-1771044740 tempest-SecurityGroupRulesTestJSON-1771044740-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.488180 Oct 23 01:23:40.838638 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1699/3415] 10.222.0.42 () {60 vars in 1180 bytes} [Sun Oct 23 01:23:40 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:23:40.851336 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2c345af4-d925-408f-8880-e97bfb3bfee4 tempest-SecurityGroupRulesTestJSON-1771044740 tempest-SecurityGroupRulesTestJSON-1771044740-project] Action: 'create', calling method: .version_select at 0x7f5cc28f38b0>, body: {"security_group_rule": {"parent_group_id": "d3a9fb40-540d-40c5-a0b8-8f0ac2b303c8", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "556bba8c-95fb-4324-a2f9-7380315f8e2e"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:23:41.166159 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e502b021-5a57-433c-aeed-fda951cad3c0 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:41.173203 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e502b021-5a57-433c-aeed-fda951cad3c0 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 3d9196f6-d696-45e0-b7fc-8d1557498393] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:41.177320 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e502b021-5a57-433c-aeed-fda951cad3c0 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:41.177958 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e502b021-5a57-433c-aeed-fda951cad3c0 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:41.178530 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e502b021-5a57-433c-aeed-fda951cad3c0 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:41.179456 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e502b021-5a57-433c-aeed-fda951cad3c0 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:41.179921 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e502b021-5a57-433c-aeed-fda951cad3c0 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:41.182630 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e502b021-5a57-433c-aeed-fda951cad3c0 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:41.368354 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e502b021-5a57-433c-aeed-fda951cad3c0 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:41.376204 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e502b021-5a57-433c-aeed-fda951cad3c0 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393" status: 200 len: 1500 microversion: 2.1 time: 0.214618 Oct 23 01:23:41.376926 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1700/3416] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:41 2022] GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393 => generated 1500 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:41.382500 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d9204401-eaed-40d8-a9ef-b1464c830f44 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:41.383142 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d9204401-eaed-40d8-a9ef-b1464c830f44 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] [instance: 5edd25b9-affc-45f4-a54f-66b262543ae5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:41.389203 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9204401-eaed-40d8-a9ef-b1464c830f44 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:41.389752 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9204401-eaed-40d8-a9ef-b1464c830f44 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:41.390354 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9204401-eaed-40d8-a9ef-b1464c830f44 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:41.391106 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9204401-eaed-40d8-a9ef-b1464c830f44 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:41.391759 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9204401-eaed-40d8-a9ef-b1464c830f44 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:41.392378 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9204401-eaed-40d8-a9ef-b1464c830f44 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:41.397178 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2c345af4-d925-408f-8880-e97bfb3bfee4 tempest-SecurityGroupRulesTestJSON-1771044740 tempest-SecurityGroupRulesTestJSON-1771044740-project] 10.222.0.42 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.549762 Oct 23 01:23:41.398172 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1717/3417] 10.222.0.42 () {60 vars in 1195 bytes} [Sun Oct 23 01:23:40 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:23:41.403516 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a86dcfa4-2f10-455f-9584-261a05451eea tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:23:41.408056 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a86dcfa4-2f10-455f-9584-261a05451eea tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 3d9196f6-d696-45e0-b7fc-8d1557498393] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:41.415877 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a86dcfa4-2f10-455f-9584-261a05451eea tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:41.416977 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a86dcfa4-2f10-455f-9584-261a05451eea tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:41.418325 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a86dcfa4-2f10-455f-9584-261a05451eea tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:41.419050 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a86dcfa4-2f10-455f-9584-261a05451eea tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:41.419833 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a86dcfa4-2f10-455f-9584-261a05451eea tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:41.420444 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a86dcfa4-2f10-455f-9584-261a05451eea tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:41.424831 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=100 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:41.447883 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-a86dcfa4-2f10-455f-9584-261a05451eea tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lazy-loading 'flavor' on Instance uuid 3d9196f6-d696-45e0-b7fc-8d1557498393 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:23:41.461528 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-a86dcfa4-2f10-455f-9584-261a05451eea tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] HTTP exception thrown: Cannot 'rescue' instance 3d9196f6-d696-45e0-b7fc-8d1557498393 while it is in vm_state paused Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a86dcfa4-2f10-455f-9584-261a05451eea tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Request method failure captured: Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393/action HTTP/1.1 Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 14 Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJdQk8hX6uPg4qHO6qc2mwusfqzM5L9E46F0sE_pC33qOsFxuj7jBx97KQnGjJpiMRyi7Ccd4qVZLYee5QWMbRFkTPXMBEfS5K72Bw65O1CzepVHWqpUTGTMXTiFqb2LFyp2Lx0G54EC4LTSr0BIWkU_QP9JqR2fGUhTDQevTmiXx40 Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 4c25b4509ad7457bad4a2e5e0bc59add Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1648319695 Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4c25b4509ad7457bad4a2e5e0bc59add"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4c25b4509ad7457bad4a2e5e0bc59add"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4c25b4509ad7457bad4a2e5e0bc59add"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4c25b4509ad7457bad4a2e5e0bc59add"}]}] Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1648319695 Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 4c25b4509ad7457bad4a2e5e0bc59add Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1648319695 Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServerRescueNegativeTestJSON-1648319695-project Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 19bff9f7a4254110b3b89f0cba5d252f Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1648319695-project Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: {"rescue": {}} Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: exception: Cannot 'rescue' instance 3d9196f6-d696-45e0-b7fc-8d1557498393 while it is in vm_state paused Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '3d9196f6-d696-45e0-b7fc-8d1557498393', 'body': {'rescue': {}}} Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3d9196f6-d696-45e0-b7fc-8d1557498393 in vm_state paused. Cannot rescue while the instance is in this state. Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 3d9196f6-d696-45e0-b7fc-8d1557498393 while it is in vm_state paused Oct 23 01:23:41.463368 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:41.472426 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:23:41.472426 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:41.472426 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:41.472426 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:23:41.472426 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:23:41.472426 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:23:41.472426 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:23:41.472426 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 3d9196f6-d696-45e0-b7fc-8d1557498393 while it is in vm_state paused Oct 23 01:23:41.472426 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:41.472426 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a86dcfa4-2f10-455f-9584-261a05451eea tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Returning 409 to user: Cannot 'rescue' instance 3d9196f6-d696-45e0-b7fc-8d1557498393 while it is in vm_state paused {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:23:41.472426 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a86dcfa4-2f10-455f-9584-261a05451eea tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "POST /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393/action" status: 409 len: 144 microversion: 2.1 time: 0.065368 Oct 23 01:23:41.472426 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1718/3418] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:23:41 2022] POST /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393/action => generated 144 bytes in 70 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:23:41.475537 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6bcffc63-435d-4bc9-bdcf-8b4ef17593c9 tempest-SecurityGroupRulesTestJSON-1771044740 tempest-SecurityGroupRulesTestJSON-1771044740-project] Calling method '.version_select at 0x7f5cc1768dc0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:41.540346 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d9204401-eaed-40d8-a9ef-b1464c830f44 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f33238147dc49209bcebea4dfa47ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8546a1c3b3418fae012aa51fd37c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:41.549352 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d9204401-eaed-40d8-a9ef-b1464c830f44 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f33238147dc49209bcebea4dfa47ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8546a1c3b3418fae012aa51fd37c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:41.550966 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d9204401-eaed-40d8-a9ef-b1464c830f44 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f33238147dc49209bcebea4dfa47ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8546a1c3b3418fae012aa51fd37c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:41.552536 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d9204401-eaed-40d8-a9ef-b1464c830f44 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] 10.222.0.42 "GET /compute/v2.1/servers/5edd25b9-affc-45f4-a54f-66b262543ae5" status: 200 len: 1365 microversion: 2.47 time: 0.174360 Oct 23 01:23:41.554194 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1701/3419] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:23:41 2022] GET /compute/v2.1/servers/5edd25b9-affc-45f4-a54f-66b262543ae5 => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:23:41.559282 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-422fd2a3-cfec-4749-824f-91e6f41bdc2f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:23:41.560018 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-422fd2a3-cfec-4749-824f-91e6f41bdc2f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 3d9196f6-d696-45e0-b7fc-8d1557498393] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:41.566489 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-422fd2a3-cfec-4749-824f-91e6f41bdc2f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:41.567245 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-422fd2a3-cfec-4749-824f-91e6f41bdc2f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:41.567752 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-422fd2a3-cfec-4749-824f-91e6f41bdc2f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:41.568516 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-422fd2a3-cfec-4749-824f-91e6f41bdc2f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:41.569121 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-422fd2a3-cfec-4749-824f-91e6f41bdc2f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:41.569580 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-422fd2a3-cfec-4749-824f-91e6f41bdc2f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:41.834567 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-422fd2a3-cfec-4749-824f-91e6f41bdc2f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "POST /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393/action" status: 202 len: 0 microversion: 2.1 time: 0.278750 Oct 23 01:23:41.835257 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1702/3420] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:23:41 2022] POST /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:23:41.841764 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-09fdc8a7-b166-4e72-9d1d-94cb05d49a8d tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:41.842688 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-09fdc8a7-b166-4e72-9d1d-94cb05d49a8d tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] [instance: e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:41.850522 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09fdc8a7-b166-4e72-9d1d-94cb05d49a8d tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:41.851249 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09fdc8a7-b166-4e72-9d1d-94cb05d49a8d tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:41.851873 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09fdc8a7-b166-4e72-9d1d-94cb05d49a8d tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:41.852574 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09fdc8a7-b166-4e72-9d1d-94cb05d49a8d tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:41.853023 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09fdc8a7-b166-4e72-9d1d-94cb05d49a8d tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:41.853621 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09fdc8a7-b166-4e72-9d1d-94cb05d49a8d tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:41.941052 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6bcffc63-435d-4bc9-bdcf-8b4ef17593c9 tempest-SecurityGroupRulesTestJSON-1771044740 tempest-SecurityGroupRulesTestJSON-1771044740-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/556bba8c-95fb-4324-a2f9-7380315f8e2e" status: 202 len: 0 microversion: 2.1 time: 0.470695 Oct 23 01:23:41.945689 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1719/3421] 10.222.0.42 () {58 vars in 1272 bytes} [Sun Oct 23 01:23:41 2022] DELETE /compute/v2.1/os-security-groups/556bba8c-95fb-4324-a2f9-7380315f8e2e => generated 0 bytes in 476 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:23:41.953335 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8f3bc490-4afa-49af-b9e4-9fc2a0eecb78 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:41.954231 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8f3bc490-4afa-49af-b9e4-9fc2a0eecb78 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 3d9196f6-d696-45e0-b7fc-8d1557498393] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:41.977024 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8f3bc490-4afa-49af-b9e4-9fc2a0eecb78 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:41.980328 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8f3bc490-4afa-49af-b9e4-9fc2a0eecb78 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:41.980862 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8f3bc490-4afa-49af-b9e4-9fc2a0eecb78 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:41.981667 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8f3bc490-4afa-49af-b9e4-9fc2a0eecb78 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:41.984036 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8f3bc490-4afa-49af-b9e4-9fc2a0eecb78 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:41.985922 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8f3bc490-4afa-49af-b9e4-9fc2a0eecb78 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:42.053410 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-09fdc8a7-b166-4e72-9d1d-94cb05d49a8d tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0501ceda4e8140e09fb4e94552487cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8525dcc00e844959a1527424291a3149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:42.063598 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-09fdc8a7-b166-4e72-9d1d-94cb05d49a8d tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] 10.222.0.42 "GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c" status: 200 len: 1370 microversion: 2.1 time: 0.226817 Oct 23 01:23:42.064680 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1703/3422] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:41 2022] GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c => generated 1370 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:42.071877 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1dec06a0-95d1-4760-8dc4-d66e382e7976 tempest-SecurityGroupRulesTestJSON-1771044740 tempest-SecurityGroupRulesTestJSON-1771044740-project] Calling method '.version_select at 0x7f5cc17325e0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:42.163800 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1dec06a0-95d1-4760-8dc4-d66e382e7976 tempest-SecurityGroupRulesTestJSON-1771044740 tempest-SecurityGroupRulesTestJSON-1771044740-project] 10.222.0.42 "GET /compute/v2.1/os-security-groups/d3a9fb40-540d-40c5-a0b8-8f0ac2b303c8" status: 200 len: 247 microversion: 2.1 time: 0.097886 Oct 23 01:23:42.169226 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1704/3423] 10.222.0.42 () {58 vars in 1269 bytes} [Sun Oct 23 01:23:42 2022] GET /compute/v2.1/os-security-groups/d3a9fb40-540d-40c5-a0b8-8f0ac2b303c8 => generated 247 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:23:42.192169 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-449b2792-957d-4e55-abd3-c965b0dc24ce tempest-SecurityGroupRulesTestJSON-1771044740 tempest-SecurityGroupRulesTestJSON-1771044740-project] Action: 'create', calling method: .version_select at 0x7f5cc17089d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-571135268", "description": "tempest-description-1133786828"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:23:42.206882 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8f3bc490-4afa-49af-b9e4-9fc2a0eecb78 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:42.219521 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8f3bc490-4afa-49af-b9e4-9fc2a0eecb78 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393" status: 200 len: 1507 microversion: 2.1 time: 0.272628 Oct 23 01:23:42.229017 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1720/3424] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:41 2022] GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393 => generated 1507 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:42.579186 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-449b2792-957d-4e55-abd3-c965b0dc24ce tempest-SecurityGroupRulesTestJSON-1771044740 tempest-SecurityGroupRulesTestJSON-1771044740-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.398557 Oct 23 01:23:42.580015 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1705/3425] 10.222.0.42 () {60 vars in 1180 bytes} [Sun Oct 23 01:23:42 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:23:42.586365 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ff3dd176-544b-47da-b5fc-12fe0cdfb890 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:42.587123 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ff3dd176-544b-47da-b5fc-12fe0cdfb890 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] [instance: 5edd25b9-affc-45f4-a54f-66b262543ae5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:42.592680 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a7c5d4fa-7eac-47bb-bf90-4523500ec323 tempest-SecurityGroupRulesTestJSON-1771044740 tempest-SecurityGroupRulesTestJSON-1771044740-project] Action: 'create', calling method: .version_select at 0x7f5cc175bd30>, body: {"security_group_rule": {"parent_group_id": "9f03d39f-bbb5-4fb6-be0b-ebe48fb045ac", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:23:42.607080 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ff3dd176-544b-47da-b5fc-12fe0cdfb890 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:42.607716 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ff3dd176-544b-47da-b5fc-12fe0cdfb890 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:42.608157 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ff3dd176-544b-47da-b5fc-12fe0cdfb890 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:42.608859 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ff3dd176-544b-47da-b5fc-12fe0cdfb890 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:42.609340 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ff3dd176-544b-47da-b5fc-12fe0cdfb890 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:42.609720 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ff3dd176-544b-47da-b5fc-12fe0cdfb890 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:42.661377 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ff3dd176-544b-47da-b5fc-12fe0cdfb890 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:42.661870 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ff3dd176-544b-47da-b5fc-12fe0cdfb890 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:42.663293 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ff3dd176-544b-47da-b5fc-12fe0cdfb890 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:42.663762 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-ff3dd176-544b-47da-b5fc-12fe0cdfb890 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lazy-loading 'fault' on Instance uuid 5edd25b9-affc-45f4-a54f-66b262543ae5 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:23:42.722692 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ff3dd176-544b-47da-b5fc-12fe0cdfb890 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f33238147dc49209bcebea4dfa47ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8546a1c3b3418fae012aa51fd37c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:42.733405 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ff3dd176-544b-47da-b5fc-12fe0cdfb890 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f33238147dc49209bcebea4dfa47ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8546a1c3b3418fae012aa51fd37c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:42.735236 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ff3dd176-544b-47da-b5fc-12fe0cdfb890 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f33238147dc49209bcebea4dfa47ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8546a1c3b3418fae012aa51fd37c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:42.737133 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ff3dd176-544b-47da-b5fc-12fe0cdfb890 tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] 10.222.0.42 "GET /compute/v2.1/servers/5edd25b9-affc-45f4-a54f-66b262543ae5" status: 200 len: 1370 microversion: 2.47 time: 0.154803 Oct 23 01:23:42.738517 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1721/3426] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:23:42 2022] GET /compute/v2.1/servers/5edd25b9-affc-45f4-a54f-66b262543ae5 => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:23:43.089847 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-18f8cd84-6f0e-4e80-b094-83bdc315093e tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:43.091221 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-18f8cd84-6f0e-4e80-b094-83bdc315093e tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] [instance: e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:43.097733 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18f8cd84-6f0e-4e80-b094-83bdc315093e tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:43.100868 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18f8cd84-6f0e-4e80-b094-83bdc315093e tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:43.100868 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18f8cd84-6f0e-4e80-b094-83bdc315093e tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:43.100868 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18f8cd84-6f0e-4e80-b094-83bdc315093e tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:43.100868 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18f8cd84-6f0e-4e80-b094-83bdc315093e tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:43.101411 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18f8cd84-6f0e-4e80-b094-83bdc315093e tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:43.185389 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a7c5d4fa-7eac-47bb-bf90-4523500ec323 tempest-SecurityGroupRulesTestJSON-1771044740 tempest-SecurityGroupRulesTestJSON-1771044740-project] 10.222.0.42 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.595567 Oct 23 01:23:43.186664 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1706/3427] 10.222.0.42 () {60 vars in 1195 bytes} [Sun Oct 23 01:23:42 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:23:43.199730 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b8d6231e-a918-4632-a4de-0c20d53d0622 tempest-SecurityGroupRulesTestJSON-1771044740 tempest-SecurityGroupRulesTestJSON-1771044740-project] Action: 'create', calling method: .version_select at 0x7f5cc17deaf0>, body: {"security_group_rule": {"parent_group_id": "9f03d39f-bbb5-4fb6-be0b-ebe48fb045ac", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:23:43.298334 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-18f8cd84-6f0e-4e80-b094-83bdc315093e tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0501ceda4e8140e09fb4e94552487cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8525dcc00e844959a1527424291a3149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:43.313914 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-18f8cd84-6f0e-4e80-b094-83bdc315093e tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] 10.222.0.42 "GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c" status: 200 len: 1370 microversion: 2.1 time: 0.226423 Oct 23 01:23:43.314463 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1722/3428] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:43 2022] GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c => generated 1370 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:23:43.319984 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b5a649a8-9af9-41f2-a132-6db5cc492a5a tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:43.320588 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b5a649a8-9af9-41f2-a132-6db5cc492a5a tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 3d9196f6-d696-45e0-b7fc-8d1557498393] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:43.326746 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5a649a8-9af9-41f2-a132-6db5cc492a5a tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:43.327434 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5a649a8-9af9-41f2-a132-6db5cc492a5a tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:43.327868 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5a649a8-9af9-41f2-a132-6db5cc492a5a tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:43.328976 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5a649a8-9af9-41f2-a132-6db5cc492a5a tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:43.329319 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5a649a8-9af9-41f2-a132-6db5cc492a5a tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:43.329746 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5a649a8-9af9-41f2-a132-6db5cc492a5a tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:43.530504 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b5a649a8-9af9-41f2-a132-6db5cc492a5a tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:43.536411 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b5a649a8-9af9-41f2-a132-6db5cc492a5a tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393" status: 200 len: 1515 microversion: 2.1 time: 0.220441 Oct 23 01:23:43.538003 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1723/3429] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:43 2022] GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393 => generated 1515 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:43.737748 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b8d6231e-a918-4632-a4de-0c20d53d0622 tempest-SecurityGroupRulesTestJSON-1771044740 tempest-SecurityGroupRulesTestJSON-1771044740-project] 10.222.0.42 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.542758 Oct 23 01:23:43.746543 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1707/3430] 10.222.0.42 () {60 vars in 1195 bytes} [Sun Oct 23 01:23:43 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:23:43.751146 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-30a8ce66-c0c2-4721-8bb1-0b50ac41e7a6 tempest-SecurityGroupRulesTestJSON-1771044740 tempest-SecurityGroupRulesTestJSON-1771044740-project] Calling method '.version_select at 0x7f5cc6179700>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:43.764640 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-88be9578-f79a-4a8a-9d9b-c152975465ed tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:43.765252 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-88be9578-f79a-4a8a-9d9b-c152975465ed tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] [instance: 5edd25b9-affc-45f4-a54f-66b262543ae5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:43.771755 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-88be9578-f79a-4a8a-9d9b-c152975465ed tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:43.776062 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-88be9578-f79a-4a8a-9d9b-c152975465ed tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:43.776062 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-88be9578-f79a-4a8a-9d9b-c152975465ed tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:43.776062 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-88be9578-f79a-4a8a-9d9b-c152975465ed tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:43.776062 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-88be9578-f79a-4a8a-9d9b-c152975465ed tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:43.776062 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-88be9578-f79a-4a8a-9d9b-c152975465ed tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:43.788644 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-88be9578-f79a-4a8a-9d9b-c152975465ed tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] HTTP exception thrown: Instance 5edd25b9-affc-45f4-a54f-66b262543ae5 could not be found. Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-88be9578-f79a-4a8a-9d9b-c152975465ed tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Request method failure captured: Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/5edd25b9-affc-45f4-a54f-66b262543ae5 HTTP/1.1 Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJeIRnaWIb4bnurE4fRXuCPeZy6vaTER8g-3vvUrrU4Xy2TH4u7wAYxqGo_czWrZsTyuXBGn3oOJC2I58vSV0xTJOnLjhEfFkukMqtQi7-YHjIiMSfj7Nv6tjGXsUc165_8B3NK5G4gDROeUP6OCUADBuKVSnTuGvwRYRmKBJZGzLrE Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: X-Openstack-Nova-Api-Version: 2.47 Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 3c8546a1c3b3418fae012aa51fd37c82 Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServersAaction247Test-405742889 Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3c8546a1c3b3418fae012aa51fd37c82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3c8546a1c3b3418fae012aa51fd37c82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3c8546a1c3b3418fae012aa51fd37c82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3c8546a1c3b3418fae012aa51fd37c82"}]}] Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServersAaction247Test-405742889 Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 3c8546a1c3b3418fae012aa51fd37c82 Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServersAaction247Test-405742889 Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServersAaction247Test-405742889-project Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 7f33238147dc49209bcebea4dfa47ad4 Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServersAaction247Test-405742889-project Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 5edd25b9-affc-45f4-a54f-66b262543ae5 could not be found. Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '5edd25b9-affc-45f4-a54f-66b262543ae5'} Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5edd25b9-affc-45f4-a54f-66b262543ae5 could not be found. Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5edd25b9-affc-45f4-a54f-66b262543ae5 could not be found. Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:23:43.790590 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:23:43.795564 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:43.795564 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:23:43.795564 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:23:43.795564 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:23:43.795564 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:23:43.795564 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5edd25b9-affc-45f4-a54f-66b262543ae5 could not be found. Oct 23 01:23:43.795564 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:23:43.795564 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-88be9578-f79a-4a8a-9d9b-c152975465ed tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] Returning 404 to user: Instance 5edd25b9-affc-45f4-a54f-66b262543ae5 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:23:43.795564 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-88be9578-f79a-4a8a-9d9b-c152975465ed tempest-ServersAaction247Test-405742889 tempest-ServersAaction247Test-405742889-project] 10.222.0.42 "GET /compute/v2.1/servers/5edd25b9-affc-45f4-a54f-66b262543ae5" status: 404 len: 111 microversion: 2.47 time: 0.031241 Oct 23 01:23:43.796234 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1708/3431] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:23:43 2022] GET /compute/v2.1/servers/5edd25b9-affc-45f4-a54f-66b262543ae5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 23 01:23:43.822528 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-30a8ce66-c0c2-4721-8bb1-0b50ac41e7a6 tempest-SecurityGroupRulesTestJSON-1771044740 tempest-SecurityGroupRulesTestJSON-1771044740-project] 10.222.0.42 "GET /compute/v2.1/os-security-groups/9f03d39f-bbb5-4fb6-be0b-ebe48fb045ac" status: 200 len: 664 microversion: 2.1 time: 0.075176 Oct 23 01:23:43.823452 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1724/3432] 10.222.0.42 () {58 vars in 1269 bytes} [Sun Oct 23 01:23:43 2022] GET /compute/v2.1/os-security-groups/9f03d39f-bbb5-4fb6-be0b-ebe48fb045ac => generated 664 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:23:43.836636 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2b979add-5951-481f-a62c-9153a28fe3bf tempest-SecurityGroupRulesTestJSON-1771044740 tempest-SecurityGroupRulesTestJSON-1771044740-project] Calling method '.version_select at 0x7f5cc1732670>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:44.069207 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2b979add-5951-481f-a62c-9153a28fe3bf tempest-SecurityGroupRulesTestJSON-1771044740 tempest-SecurityGroupRulesTestJSON-1771044740-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-group-rules/a585ce86-efee-4b7e-aaa5-6b13b7dc4915" status: 202 len: 0 microversion: 2.1 time: 0.236037 Oct 23 01:23:44.069793 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1709/3433] 10.222.0.42 () {58 vars in 1287 bytes} [Sun Oct 23 01:23:43 2022] DELETE /compute/v2.1/os-security-group-rules/a585ce86-efee-4b7e-aaa5-6b13b7dc4915 => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:23:44.079446 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-85a22ea4-b657-4dec-ac43-b1a726708ecc tempest-SecurityGroupRulesTestJSON-1771044740 tempest-SecurityGroupRulesTestJSON-1771044740-project] Calling method '.version_select at 0x7f5cc184fee0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:44.344826 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2148215e-e3ba-4a40-8b7f-6d7286814aca tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:44.347171 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2148215e-e3ba-4a40-8b7f-6d7286814aca tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] [instance: e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:44.354150 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2148215e-e3ba-4a40-8b7f-6d7286814aca tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:44.354503 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2148215e-e3ba-4a40-8b7f-6d7286814aca tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:44.355177 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2148215e-e3ba-4a40-8b7f-6d7286814aca tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:44.355833 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2148215e-e3ba-4a40-8b7f-6d7286814aca tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:44.356289 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2148215e-e3ba-4a40-8b7f-6d7286814aca tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:44.356713 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2148215e-e3ba-4a40-8b7f-6d7286814aca tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:44.449905 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-85a22ea4-b657-4dec-ac43-b1a726708ecc tempest-SecurityGroupRulesTestJSON-1771044740 tempest-SecurityGroupRulesTestJSON-1771044740-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/9f03d39f-bbb5-4fb6-be0b-ebe48fb045ac" status: 202 len: 0 microversion: 2.1 time: 0.374424 Oct 23 01:23:44.458345 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1725/3434] 10.222.0.42 () {58 vars in 1272 bytes} [Sun Oct 23 01:23:44 2022] DELETE /compute/v2.1/os-security-groups/9f03d39f-bbb5-4fb6-be0b-ebe48fb045ac => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:23:44.464055 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2cf21aa8-609f-4c94-928f-7488aafa7f75 tempest-SecurityGroupRulesTestJSON-1771044740 tempest-SecurityGroupRulesTestJSON-1771044740-project] Calling method '.version_select at 0x7f5cc180b940>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:44.521066 n-d-master-1 devstack@n-api.service[120944]: DEBUG neutronclient.v2_0.client [None req-2cf21aa8-609f-4c94-928f-7488aafa7f75 tempest-SecurityGroupRulesTestJSON-1771044740 tempest-SecurityGroupRulesTestJSON-1771044740-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 556bba8c-95fb-4324-a2f9-7380315f8e2e does not exist", "detail": ""}} {{(pid=120944) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 23 01:23:44.522880 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.security_group_api [None req-2cf21aa8-609f-4c94-928f-7488aafa7f75 tempest-SecurityGroupRulesTestJSON-1771044740 tempest-SecurityGroupRulesTestJSON-1771044740-project] Neutron security group 556bba8c-95fb-4324-a2f9-7380315f8e2e not found {{(pid=120944) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 23 01:23:44.523810 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-2cf21aa8-609f-4c94-928f-7488aafa7f75 tempest-SecurityGroupRulesTestJSON-1771044740 tempest-SecurityGroupRulesTestJSON-1771044740-project] HTTP exception thrown: Security group 556bba8c-95fb-4324-a2f9-7380315f8e2e does not exist Oct 23 01:23:44.523810 n-d-master-1 devstack@n-api.service[120944]: Neutron server returns request_ids: ['req-b820a022-31d3-4a09-a86d-f8cfb696b7bb'] Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2cf21aa8-609f-4c94-928f-7488aafa7f75 tempest-SecurityGroupRulesTestJSON-1771044740 tempest-SecurityGroupRulesTestJSON-1771044740-project] Request method failure captured: Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/os-security-groups/556bba8c-95fb-4324-a2f9-7380315f8e2e HTTP/1.1 Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJeVHufE5-nrmnGjbPPiscinl_BTM9F8zD4G1gy1PGHOedWeAndGHxlxOymX7u3X_Ga5GM4CCkli6-hBviyU9ZnPoTD94oTHDqUur48ZSZ42S0Mci3WenYB0n1lCX7dGHs53YEtvLPnH8qvNokBdxa3V0lg_YNCzMNwvPraXJgQUSQA Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: ada99164dbe24d8698a111af349d9539 Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1771044740 Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ada99164dbe24d8698a111af349d9539"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ada99164dbe24d8698a111af349d9539"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ada99164dbe24d8698a111af349d9539"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ada99164dbe24d8698a111af349d9539"}]}] Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1771044740 Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: ada99164dbe24d8698a111af349d9539 Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1771044740 Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-SecurityGroupRulesTestJSON-1771044740-project Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 6bc47b4f60e746c8a9e30b742f783dd9 Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1771044740-project Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: method: Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: exception: Security group 556bba8c-95fb-4324-a2f9-7380315f8e2e does not exist Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: Neutron server returns request_ids: ['req-b820a022-31d3-4a09-a86d-f8cfb696b7bb'] Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '556bba8c-95fb-4324-a2f9-7380315f8e2e'} Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 23 01:23:44.533292 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 556bba8c-95fb-4324-a2f9-7380315f8e2e does not exist Oct 23 01:23:44.538842 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b820a022-31d3-4a09-a86d-f8cfb696b7bb'] Oct 23 01:23:44.538842 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:44.538842 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:23:44.538842 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:44.538842 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:44.538842 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 23 01:23:44.538842 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 23 01:23:44.538842 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 23 01:23:44.538842 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 23 01:23:44.538842 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 556bba8c-95fb-4324-a2f9-7380315f8e2e does not exist Oct 23 01:23:44.538842 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b820a022-31d3-4a09-a86d-f8cfb696b7bb'] Oct 23 01:23:44.538842 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:44.538842 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:23:44.538842 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:44.538842 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:44.538842 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:23:44.538842 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:23:44.538842 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:23:44.538842 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:23:44.538842 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:23:44.538842 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:23:44.538842 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:23:44.538842 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:23:44.538842 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 23 01:23:44.538842 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 23 01:23:44.538842 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 556bba8c-95fb-4324-a2f9-7380315f8e2e does not exist Oct 23 01:23:44.538842 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b820a022-31d3-4a09-a86d-f8cfb696b7bb'] Oct 23 01:23:44.538842 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:44.538842 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:23:44.538842 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:44.538842 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:23:44.538842 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:23:44.538842 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:23:44.538842 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:23:44.538842 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:23:44.538842 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 556bba8c-95fb-4324-a2f9-7380315f8e2e does not exist Oct 23 01:23:44.538842 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b820a022-31d3-4a09-a86d-f8cfb696b7bb'] Oct 23 01:23:44.538842 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:23:44.538842 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2cf21aa8-609f-4c94-928f-7488aafa7f75 tempest-SecurityGroupRulesTestJSON-1771044740 tempest-SecurityGroupRulesTestJSON-1771044740-project] Returning 404 to user: Security group 556bba8c-95fb-4324-a2f9-7380315f8e2e does not exist Oct 23 01:23:44.538842 n-d-master-1 devstack@n-api.service[120944]: Neutron server returns request_ids: ['req-b820a022-31d3-4a09-a86d-f8cfb696b7bb'] {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:23:44.545353 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2cf21aa8-609f-4c94-928f-7488aafa7f75 tempest-SecurityGroupRulesTestJSON-1771044740 tempest-SecurityGroupRulesTestJSON-1771044740-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/556bba8c-95fb-4324-a2f9-7380315f8e2e" status: 404 len: 194 microversion: 2.1 time: 0.084176 Oct 23 01:23:44.548273 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1726/3435] 10.222.0.42 () {58 vars in 1272 bytes} [Sun Oct 23 01:23:44 2022] DELETE /compute/v2.1/os-security-groups/556bba8c-95fb-4324-a2f9-7380315f8e2e => generated 194 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:23:44.561122 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6c1e13ac-761c-474e-8113-9b52e0ef6253 tempest-SecurityGroupRulesTestJSON-1771044740 tempest-SecurityGroupRulesTestJSON-1771044740-project] Calling method '.version_select at 0x7f5cc184f700>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:44.639633 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2148215e-e3ba-4a40-8b7f-6d7286814aca tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0501ceda4e8140e09fb4e94552487cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8525dcc00e844959a1527424291a3149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:44.653609 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2148215e-e3ba-4a40-8b7f-6d7286814aca tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] 10.222.0.42 "GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c" status: 200 len: 1370 microversion: 2.1 time: 0.311444 Oct 23 01:23:44.665229 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1710/3436] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:44 2022] GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c => generated 1370 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:23:45.590730 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6c1e13ac-761c-474e-8113-9b52e0ef6253 tempest-SecurityGroupRulesTestJSON-1771044740 tempest-SecurityGroupRulesTestJSON-1771044740-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/d3a9fb40-540d-40c5-a0b8-8f0ac2b303c8" status: 202 len: 0 microversion: 2.1 time: 1.037518 Oct 23 01:23:45.591326 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1727/3437] 10.222.0.42 () {58 vars in 1272 bytes} [Sun Oct 23 01:23:44 2022] DELETE /compute/v2.1/os-security-groups/d3a9fb40-540d-40c5-a0b8-8f0ac2b303c8 => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:23:45.600016 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b9d7df5a-6be3-4928-bce8-9183819b0cb8 tempest-SecurityGroupRulesTestJSON-1771044740 tempest-SecurityGroupRulesTestJSON-1771044740-project] Calling method '.version_select at 0x7f5cc1819670>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:45.682188 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-586aa9f0-5a96-433d-b9c4-dcd49bfb8401 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:45.686216 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-586aa9f0-5a96-433d-b9c4-dcd49bfb8401 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] [instance: e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:45.696959 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-586aa9f0-5a96-433d-b9c4-dcd49bfb8401 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:45.700833 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-586aa9f0-5a96-433d-b9c4-dcd49bfb8401 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:45.703535 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-586aa9f0-5a96-433d-b9c4-dcd49bfb8401 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:45.704533 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-586aa9f0-5a96-433d-b9c4-dcd49bfb8401 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:45.707230 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-586aa9f0-5a96-433d-b9c4-dcd49bfb8401 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:45.709755 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-586aa9f0-5a96-433d-b9c4-dcd49bfb8401 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:45.989779 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-586aa9f0-5a96-433d-b9c4-dcd49bfb8401 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0501ceda4e8140e09fb4e94552487cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8525dcc00e844959a1527424291a3149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:45.997477 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-586aa9f0-5a96-433d-b9c4-dcd49bfb8401 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] 10.222.0.42 "GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c" status: 200 len: 1370 microversion: 2.1 time: 0.322315 Oct 23 01:23:45.998289 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1728/3438] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:45 2022] GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c => generated 1370 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:46.002552 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-8ce9d3ff-7093-4837-91b0-16ef62857e9b req-9033d8d7-49e2-4944-a5d1-39426bc8111c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c", "name": "network-vif-plugged", "status": "completed", "tag": "9cec7f90-b6d7-4f93-9440-efa7b73f0b1c"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:23:46.013022 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-8ce9d3ff-7093-4837-91b0-16ef62857e9b req-9033d8d7-49e2-4944-a5d1-39426bc8111c service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:46.013777 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-8ce9d3ff-7093-4837-91b0-16ef62857e9b req-9033d8d7-49e2-4944-a5d1-39426bc8111c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:46.014464 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-8ce9d3ff-7093-4837-91b0-16ef62857e9b req-9033d8d7-49e2-4944-a5d1-39426bc8111c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:46.028108 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-8ce9d3ff-7093-4837-91b0-16ef62857e9b req-9033d8d7-49e2-4944-a5d1-39426bc8111c service nova] Creating event network-vif-plugged:9cec7f90-b6d7-4f93-9440-efa7b73f0b1c for instance e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c on n-h1-master-1 Oct 23 01:23:46.037549 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-8ce9d3ff-7093-4837-91b0-16ef62857e9b req-9033d8d7-49e2-4944-a5d1-39426bc8111c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038211 Oct 23 01:23:46.038389 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1729/3439] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:23:46.202871 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b9d7df5a-6be3-4928-bce8-9183819b0cb8 tempest-SecurityGroupRulesTestJSON-1771044740 tempest-SecurityGroupRulesTestJSON-1771044740-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/54d42099-9329-4796-8c5e-ed0ef094af21" status: 202 len: 0 microversion: 2.1 time: 0.607432 Oct 23 01:23:46.207454 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1711/3440] 10.222.0.42 () {58 vars in 1272 bytes} [Sun Oct 23 01:23:45 2022] DELETE /compute/v2.1/os-security-groups/54d42099-9329-4796-8c5e-ed0ef094af21 => generated 0 bytes in 613 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:23:46.216034 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7388079b-d3a1-4b67-a1f6-eaa56d9af39d tempest-SecurityGroupRulesTestJSON-1771044740 tempest-SecurityGroupRulesTestJSON-1771044740-project] Calling method '.version_select at 0x7f5cc176c5e0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:46.420659 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-11b4e88c-0dd9-4ab0-b987-3ebd9354b9d5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:23:46.424090 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-11b4e88c-0dd9-4ab0-b987-3ebd9354b9d5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 3d9196f6-d696-45e0-b7fc-8d1557498393] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:46.433330 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-11b4e88c-0dd9-4ab0-b987-3ebd9354b9d5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:46.433956 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-11b4e88c-0dd9-4ab0-b987-3ebd9354b9d5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:46.434570 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-11b4e88c-0dd9-4ab0-b987-3ebd9354b9d5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:46.436072 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-11b4e88c-0dd9-4ab0-b987-3ebd9354b9d5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:46.436624 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-11b4e88c-0dd9-4ab0-b987-3ebd9354b9d5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:46.437495 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-11b4e88c-0dd9-4ab0-b987-3ebd9354b9d5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:46.465084 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-11b4e88c-0dd9-4ab0-b987-3ebd9354b9d5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lazy-loading 'flavor' on Instance uuid 3d9196f6-d696-45e0-b7fc-8d1557498393 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:23:46.596272 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7388079b-d3a1-4b67-a1f6-eaa56d9af39d tempest-SecurityGroupRulesTestJSON-1771044740 tempest-SecurityGroupRulesTestJSON-1771044740-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/d3ec3002-9179-49f9-a4cd-15e82caf3420" status: 202 len: 0 microversion: 2.1 time: 0.388175 Oct 23 01:23:46.597033 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1730/3441] 10.222.0.42 () {58 vars in 1272 bytes} [Sun Oct 23 01:23:46 2022] DELETE /compute/v2.1/os-security-groups/d3ec3002-9179-49f9-a4cd-15e82caf3420 => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 23 01:23:46.604863 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-81d78ee6-2a64-4fe4-ad0e-814b3e68e703 tempest-SecurityGroupRulesTestJSON-1771044740 tempest-SecurityGroupRulesTestJSON-1771044740-project] Calling method '.version_select at 0x7f5cc184f040>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:46.650512 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:46.861439 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-11b4e88c-0dd9-4ab0-b987-3ebd9354b9d5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "POST /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393/action" status: 200 len: 32 microversion: 2.1 time: 0.445024 Oct 23 01:23:46.861439 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1712/3442] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:23:46 2022] POST /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393/action => generated 32 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:23:46.869165 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-605dd6e1-735a-4d48-8254-de21a9a6d7bd tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:46.869862 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-605dd6e1-735a-4d48-8254-de21a9a6d7bd tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 3d9196f6-d696-45e0-b7fc-8d1557498393] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:46.876071 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-605dd6e1-735a-4d48-8254-de21a9a6d7bd tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:46.876550 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-605dd6e1-735a-4d48-8254-de21a9a6d7bd tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:46.876983 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-605dd6e1-735a-4d48-8254-de21a9a6d7bd tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:46.877664 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-605dd6e1-735a-4d48-8254-de21a9a6d7bd tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:46.878171 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-605dd6e1-735a-4d48-8254-de21a9a6d7bd tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:46.878595 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-605dd6e1-735a-4d48-8254-de21a9a6d7bd tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:46.948364 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-81d78ee6-2a64-4fe4-ad0e-814b3e68e703 tempest-SecurityGroupRulesTestJSON-1771044740 tempest-SecurityGroupRulesTestJSON-1771044740-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/acc0dc3b-b2c6-4fc3-b7d7-0f5e6dd403aa" status: 202 len: 0 microversion: 2.1 time: 0.347216 Oct 23 01:23:46.950441 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1731/3443] 10.222.0.42 () {58 vars in 1272 bytes} [Sun Oct 23 01:23:46 2022] DELETE /compute/v2.1/os-security-groups/acc0dc3b-b2c6-4fc3-b7d7-0f5e6dd403aa => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 23 01:23:46.960927 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-52e15e43-9983-4029-8245-f2fe70e41426 tempest-SecurityGroupRulesTestJSON-1771044740 tempest-SecurityGroupRulesTestJSON-1771044740-project] Calling method '.version_select at 0x7f5cc10dfdc0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:47.077464 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-605dd6e1-735a-4d48-8254-de21a9a6d7bd tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:47.089918 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-605dd6e1-735a-4d48-8254-de21a9a6d7bd tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393" status: 200 len: 1521 microversion: 2.1 time: 0.225139 Oct 23 01:23:47.094041 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1713/3444] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:46 2022] GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:23:47.097528 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6f0d9160-6f3f-4c80-b34a-b3577a30bec4 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:47.098398 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6f0d9160-6f3f-4c80-b34a-b3577a30bec4 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] [instance: e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:47.106557 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6f0d9160-6f3f-4c80-b34a-b3577a30bec4 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:47.107128 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6f0d9160-6f3f-4c80-b34a-b3577a30bec4 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:47.107634 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6f0d9160-6f3f-4c80-b34a-b3577a30bec4 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:47.108341 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6f0d9160-6f3f-4c80-b34a-b3577a30bec4 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:47.108800 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6f0d9160-6f3f-4c80-b34a-b3577a30bec4 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:47.109457 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6f0d9160-6f3f-4c80-b34a-b3577a30bec4 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:47.335527 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6f0d9160-6f3f-4c80-b34a-b3577a30bec4 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0501ceda4e8140e09fb4e94552487cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8525dcc00e844959a1527424291a3149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:47.343232 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6f0d9160-6f3f-4c80-b34a-b3577a30bec4 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] 10.222.0.42 "GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c" status: 200 len: 1370 microversion: 2.1 time: 0.251529 Oct 23 01:23:47.343813 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1714/3445] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:47 2022] GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c => generated 1370 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:47.409062 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-52e15e43-9983-4029-8245-f2fe70e41426 tempest-SecurityGroupRulesTestJSON-1771044740 tempest-SecurityGroupRulesTestJSON-1771044740-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/feaa54c9-461e-4dcb-bcd6-b8b8eb719f68" status: 202 len: 0 microversion: 2.1 time: 0.454329 Oct 23 01:23:47.413612 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1732/3446] 10.222.0.42 () {58 vars in 1272 bytes} [Sun Oct 23 01:23:46 2022] DELETE /compute/v2.1/os-security-groups/feaa54c9-461e-4dcb-bcd6-b8b8eb719f68 => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:23:48.114745 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2fbb50d8-9340-493d-9a3c-4f3d969e73f4 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:48.116314 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2fbb50d8-9340-493d-9a3c-4f3d969e73f4 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 3d9196f6-d696-45e0-b7fc-8d1557498393] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:48.123547 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2fbb50d8-9340-493d-9a3c-4f3d969e73f4 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:48.125188 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2fbb50d8-9340-493d-9a3c-4f3d969e73f4 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:48.125877 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2fbb50d8-9340-493d-9a3c-4f3d969e73f4 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:48.126895 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2fbb50d8-9340-493d-9a3c-4f3d969e73f4 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:48.127581 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2fbb50d8-9340-493d-9a3c-4f3d969e73f4 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:48.128212 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2fbb50d8-9340-493d-9a3c-4f3d969e73f4 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:48.336639 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2fbb50d8-9340-493d-9a3c-4f3d969e73f4 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:48.344650 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2fbb50d8-9340-493d-9a3c-4f3d969e73f4 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393" status: 200 len: 1521 microversion: 2.1 time: 0.234133 Oct 23 01:23:48.345225 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1715/3447] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:48 2022] GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:48.370013 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3ca9b39a-dd4e-4c08-95fb-d654d91311b6 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:48.378374 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3ca9b39a-dd4e-4c08-95fb-d654d91311b6 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] [instance: e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:48.390147 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3ca9b39a-dd4e-4c08-95fb-d654d91311b6 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:48.391115 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3ca9b39a-dd4e-4c08-95fb-d654d91311b6 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:48.391543 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3ca9b39a-dd4e-4c08-95fb-d654d91311b6 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:48.392309 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3ca9b39a-dd4e-4c08-95fb-d654d91311b6 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:48.392714 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3ca9b39a-dd4e-4c08-95fb-d654d91311b6 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:48.393126 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3ca9b39a-dd4e-4c08-95fb-d654d91311b6 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:48.589871 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3ca9b39a-dd4e-4c08-95fb-d654d91311b6 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0501ceda4e8140e09fb4e94552487cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8525dcc00e844959a1527424291a3149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:48.600161 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3ca9b39a-dd4e-4c08-95fb-d654d91311b6 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] 10.222.0.42 "GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c" status: 200 len: 1556 microversion: 2.1 time: 0.235408 Oct 23 01:23:48.610124 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1733/3448] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:48 2022] GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c => generated 1556 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:48.627334 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-453a6cde-52c6-4088-aef5-36bf9eeee20d tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:48.628088 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-453a6cde-52c6-4088-aef5-36bf9eeee20d tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] [instance: e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:48.634883 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-453a6cde-52c6-4088-aef5-36bf9eeee20d tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:48.635378 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-453a6cde-52c6-4088-aef5-36bf9eeee20d tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:48.635885 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-453a6cde-52c6-4088-aef5-36bf9eeee20d tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:48.636584 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-453a6cde-52c6-4088-aef5-36bf9eeee20d tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:48.637011 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-453a6cde-52c6-4088-aef5-36bf9eeee20d tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:48.637682 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-453a6cde-52c6-4088-aef5-36bf9eeee20d tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:48.742603 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-453a6cde-52c6-4088-aef5-36bf9eeee20d tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] 10.222.0.42 "GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.118812 Oct 23 01:23:48.743224 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1716/3449] 10.222.0.42 () {58 vars in 1275 bytes} [Sun Oct 23 01:23:48 2022] GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c/os-interface => generated 285 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:23:49.371077 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-818ff3f0-192a-41e5-bad7-30074433cfcc tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:49.372348 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-818ff3f0-192a-41e5-bad7-30074433cfcc tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 3d9196f6-d696-45e0-b7fc-8d1557498393] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:49.379801 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-818ff3f0-192a-41e5-bad7-30074433cfcc tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:49.380645 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-818ff3f0-192a-41e5-bad7-30074433cfcc tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:49.381312 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-818ff3f0-192a-41e5-bad7-30074433cfcc tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:49.382299 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-818ff3f0-192a-41e5-bad7-30074433cfcc tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:49.382974 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-818ff3f0-192a-41e5-bad7-30074433cfcc tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:49.383921 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-818ff3f0-192a-41e5-bad7-30074433cfcc tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:49.728999 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-818ff3f0-192a-41e5-bad7-30074433cfcc tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:49.742188 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-818ff3f0-192a-41e5-bad7-30074433cfcc tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393" status: 200 len: 1521 microversion: 2.1 time: 0.374218 Oct 23 01:23:49.743418 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1734/3450] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:49 2022] GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393 => generated 1521 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:50.768070 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3ee4d4b3-95b0-402b-8e3e-4a99e0ed6737 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:50.769377 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3ee4d4b3-95b0-402b-8e3e-4a99e0ed6737 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 3d9196f6-d696-45e0-b7fc-8d1557498393] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:50.775211 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:50.777561 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3ee4d4b3-95b0-402b-8e3e-4a99e0ed6737 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:50.778305 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3ee4d4b3-95b0-402b-8e3e-4a99e0ed6737 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:50.778983 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3ee4d4b3-95b0-402b-8e3e-4a99e0ed6737 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:50.779905 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3ee4d4b3-95b0-402b-8e3e-4a99e0ed6737 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:50.780577 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3ee4d4b3-95b0-402b-8e3e-4a99e0ed6737 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:50.786247 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3ee4d4b3-95b0-402b-8e3e-4a99e0ed6737 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:50.859907 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-08536578-6f5a-4f95-a4ef-f4f2847aff34 req-87e17186-af15-4f91-b7a7-d9d9ae60fc1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c", "tag": "9cec7f90-b6d7-4f93-9440-efa7b73f0b1c"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:23:50.876632 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-08536578-6f5a-4f95-a4ef-f4f2847aff34 req-87e17186-af15-4f91-b7a7-d9d9ae60fc1b service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:50.880879 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-08536578-6f5a-4f95-a4ef-f4f2847aff34 req-87e17186-af15-4f91-b7a7-d9d9ae60fc1b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:50.881337 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-08536578-6f5a-4f95-a4ef-f4f2847aff34 req-87e17186-af15-4f91-b7a7-d9d9ae60fc1b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:50.917610 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-08536578-6f5a-4f95-a4ef-f4f2847aff34 req-87e17186-af15-4f91-b7a7-d9d9ae60fc1b service nova] Creating event network-changed:9cec7f90-b6d7-4f93-9440-efa7b73f0b1c for instance e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c on n-h1-master-1 Oct 23 01:23:50.929511 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-08536578-6f5a-4f95-a4ef-f4f2847aff34 req-87e17186-af15-4f91-b7a7-d9d9ae60fc1b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073372 Oct 23 01:23:50.930259 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1735/3451] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:23:51.499300 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3ee4d4b3-95b0-402b-8e3e-4a99e0ed6737 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:51.514323 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3ee4d4b3-95b0-402b-8e3e-4a99e0ed6737 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393" status: 200 len: 1521 microversion: 2.1 time: 0.751884 Oct 23 01:23:51.527217 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1717/3452] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:50 2022] GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393 => generated 1521 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:52.558467 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ce60f1a9-909d-446d-a729-0b50b44a89ea tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:52.563099 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ce60f1a9-909d-446d-a729-0b50b44a89ea tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 3d9196f6-d696-45e0-b7fc-8d1557498393] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:52.563972 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=63 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:52.572638 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce60f1a9-909d-446d-a729-0b50b44a89ea tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:52.573225 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce60f1a9-909d-446d-a729-0b50b44a89ea tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:52.573605 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce60f1a9-909d-446d-a729-0b50b44a89ea tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:52.574369 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce60f1a9-909d-446d-a729-0b50b44a89ea tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:52.576337 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce60f1a9-909d-446d-a729-0b50b44a89ea tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:52.578642 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce60f1a9-909d-446d-a729-0b50b44a89ea tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:52.986444 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ce60f1a9-909d-446d-a729-0b50b44a89ea tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:52.997225 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ce60f1a9-909d-446d-a729-0b50b44a89ea tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393" status: 200 len: 1521 microversion: 2.1 time: 0.450815 Oct 23 01:23:53.004352 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1736/3453] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:52 2022] GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393 => generated 1521 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:54.026760 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e95a7452-b6f0-46d0-a354-e673307cc571 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:54.027374 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e95a7452-b6f0-46d0-a354-e673307cc571 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 3d9196f6-d696-45e0-b7fc-8d1557498393] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:54.041520 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e95a7452-b6f0-46d0-a354-e673307cc571 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:54.044792 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e95a7452-b6f0-46d0-a354-e673307cc571 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:54.045434 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e95a7452-b6f0-46d0-a354-e673307cc571 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:54.046778 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e95a7452-b6f0-46d0-a354-e673307cc571 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:54.051154 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e95a7452-b6f0-46d0-a354-e673307cc571 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:54.051621 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e95a7452-b6f0-46d0-a354-e673307cc571 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:54.279825 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e95a7452-b6f0-46d0-a354-e673307cc571 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:54.295127 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e95a7452-b6f0-46d0-a354-e673307cc571 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393" status: 200 len: 1521 microversion: 2.1 time: 0.272350 Oct 23 01:23:54.296277 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1718/3454] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:54 2022] GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393 => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:55.323416 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2c1d5c55-c8f6-477c-8691-9eaf809ffe2e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:55.324164 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2c1d5c55-c8f6-477c-8691-9eaf809ffe2e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 3d9196f6-d696-45e0-b7fc-8d1557498393] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:55.345554 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2c1d5c55-c8f6-477c-8691-9eaf809ffe2e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:55.354158 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2c1d5c55-c8f6-477c-8691-9eaf809ffe2e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:55.354158 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2c1d5c55-c8f6-477c-8691-9eaf809ffe2e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:55.354158 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2c1d5c55-c8f6-477c-8691-9eaf809ffe2e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:55.354158 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2c1d5c55-c8f6-477c-8691-9eaf809ffe2e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:55.354158 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2c1d5c55-c8f6-477c-8691-9eaf809ffe2e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:55.554454 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2c1d5c55-c8f6-477c-8691-9eaf809ffe2e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:55.566855 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2c1d5c55-c8f6-477c-8691-9eaf809ffe2e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393" status: 200 len: 1521 microversion: 2.1 time: 0.249161 Oct 23 01:23:55.566855 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1737/3455] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:55 2022] GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393 => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:56.170887 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4be62d17-8f1e-40b8-946d-a37d136413f3 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Action: 'create', calling method: .version_select at 0x7f5cc175b280>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1587369920", "policies": ["affinity"]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:23:56.192279 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-4be62d17-8f1e-40b8-946d-a37d136413f3 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Getting quotas for project 4308ac3d1dbe4e798f6650316f479826. Resources: {'server_groups'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:23:56.201464 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-4be62d17-8f1e-40b8-946d-a37d136413f3 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Getting quotas for user 418a4c6848204bea8eadb505ccb9c04e and project 4308ac3d1dbe4e798f6650316f479826. Resources: {'server_groups'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:23:56.426303 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-4be62d17-8f1e-40b8-946d-a37d136413f3 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Getting quotas for project 4308ac3d1dbe4e798f6650316f479826. Resources: {'server_groups'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:23:56.433117 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-4be62d17-8f1e-40b8-946d-a37d136413f3 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Getting quotas for user 418a4c6848204bea8eadb505ccb9c04e and project 4308ac3d1dbe4e798f6650316f479826. Resources: {'server_groups'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:23:56.446543 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4be62d17-8f1e-40b8-946d-a37d136413f3 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] 10.222.0.42 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.550278 Oct 23 01:23:56.447150 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1719/3456] 10.222.0.42 () {60 vars in 1174 bytes} [Sun Oct 23 01:23:55 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:23:56.458928 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-77c00cb0-de34-4d59-a0fb-07ccd5f28b4d tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Action: 'create', calling method: .version_select at 0x7f5cc176c1f0>, body: {"server_group": {"name": "tempest-server-group-1463813505", "policies": ["affinity"]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:23:56.480339 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-77c00cb0-de34-4d59-a0fb-07ccd5f28b4d tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Getting quotas for project 4308ac3d1dbe4e798f6650316f479826. Resources: {'server_groups'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:23:56.487492 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-77c00cb0-de34-4d59-a0fb-07ccd5f28b4d tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Getting quotas for user 418a4c6848204bea8eadb505ccb9c04e and project 4308ac3d1dbe4e798f6650316f479826. Resources: {'server_groups'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:23:56.594700 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-964589c5-6adc-4195-b6e9-16a459e9dac5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:56.595404 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-964589c5-6adc-4195-b6e9-16a459e9dac5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 3d9196f6-d696-45e0-b7fc-8d1557498393] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:56.602323 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-964589c5-6adc-4195-b6e9-16a459e9dac5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:56.602812 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-964589c5-6adc-4195-b6e9-16a459e9dac5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:56.603246 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-964589c5-6adc-4195-b6e9-16a459e9dac5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:56.603944 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-964589c5-6adc-4195-b6e9-16a459e9dac5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:56.604390 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-964589c5-6adc-4195-b6e9-16a459e9dac5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:56.604805 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-964589c5-6adc-4195-b6e9-16a459e9dac5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:56.671745 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-77c00cb0-de34-4d59-a0fb-07ccd5f28b4d tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Getting quotas for project 4308ac3d1dbe4e798f6650316f479826. Resources: {'server_groups'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:23:56.679114 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-77c00cb0-de34-4d59-a0fb-07ccd5f28b4d tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Getting quotas for user 418a4c6848204bea8eadb505ccb9c04e and project 4308ac3d1dbe4e798f6650316f479826. Resources: {'server_groups'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:23:56.692881 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-77c00cb0-de34-4d59-a0fb-07ccd5f28b4d tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] 10.222.0.42 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.238555 Oct 23 01:23:56.699316 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1738/3457] 10.222.0.42 () {60 vars in 1173 bytes} [Sun Oct 23 01:23:56 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:23:56.704956 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6761a887-acee-4bc6-979e-4a33c88bf994 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Action: 'create', calling method: .version_select at 0x7f5cc61a75e0>, body: {"server_group": {"name": "tempest-server-group-1463813505", "policies": ["affinity"]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:23:56.726333 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-6761a887-acee-4bc6-979e-4a33c88bf994 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Getting quotas for project 4308ac3d1dbe4e798f6650316f479826. Resources: {'server_groups'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:23:56.732008 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-6761a887-acee-4bc6-979e-4a33c88bf994 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Getting quotas for user 418a4c6848204bea8eadb505ccb9c04e and project 4308ac3d1dbe4e798f6650316f479826. Resources: {'server_groups'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:23:56.773041 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-964589c5-6adc-4195-b6e9-16a459e9dac5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:56.781537 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-964589c5-6adc-4195-b6e9-16a459e9dac5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393" status: 200 len: 1521 microversion: 2.1 time: 0.191392 Oct 23 01:23:56.784186 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1720/3458] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:56 2022] GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:23:56.916135 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-6761a887-acee-4bc6-979e-4a33c88bf994 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Getting quotas for project 4308ac3d1dbe4e798f6650316f479826. Resources: {'server_groups'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:23:56.921802 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-6761a887-acee-4bc6-979e-4a33c88bf994 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Getting quotas for user 418a4c6848204bea8eadb505ccb9c04e and project 4308ac3d1dbe4e798f6650316f479826. Resources: {'server_groups'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:23:56.935289 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6761a887-acee-4bc6-979e-4a33c88bf994 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] 10.222.0.42 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.234720 Oct 23 01:23:56.935906 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1739/3459] 10.222.0.42 () {60 vars in 1173 bytes} [Sun Oct 23 01:23:56 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:23:56.946717 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-75f8a343-9df6-4196-8ac4-e0d1027410a7 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:57.063847 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-75f8a343-9df6-4196-8ac4-e0d1027410a7 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] 10.222.0.42 "DELETE /compute/v2.1/os-server-groups/61350fe9-1fd7-4889-ac4f-3a1ce00e3b2a" status: 204 len: 0 microversion: 2.1 time: 0.120486 Oct 23 01:23:57.064776 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1721/3460] 10.222.0.42 () {58 vars in 1266 bytes} [Sun Oct 23 01:23:56 2022] DELETE /compute/v2.1/os-server-groups/61350fe9-1fd7-4889-ac4f-3a1ce00e3b2a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:23:57.074860 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-687bcff9-38b6-48bd-893d-4ad85fb8904d tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:57.095139 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-687bcff9-38b6-48bd-893d-4ad85fb8904d tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] 10.222.0.42 "GET /compute/v2.1/os-server-groups" status: 200 len: 335 microversion: 2.1 time: 0.025362 Oct 23 01:23:57.095869 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1740/3461] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Oct 23 01:23:57 2022] GET /compute/v2.1/os-server-groups => generated 335 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:23:57.108043 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7adc9c99-e5cc-4086-bdcd-684064f4a25f tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:57.219742 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7adc9c99-e5cc-4086-bdcd-684064f4a25f tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] 10.222.0.42 "DELETE /compute/v2.1/os-server-groups/1c6b81f3-f3b3-4099-8e43-e41580a3b8bb" status: 204 len: 0 microversion: 2.1 time: 0.114850 Oct 23 01:23:57.221863 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1722/3462] 10.222.0.42 () {58 vars in 1266 bytes} [Sun Oct 23 01:23:57 2022] DELETE /compute/v2.1/os-server-groups/1c6b81f3-f3b3-4099-8e43-e41580a3b8bb => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:23:57.231364 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-79f5d075-0dcf-461c-8cba-d48dba3fa73d tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:57.242326 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-79f5d075-0dcf-461c-8cba-d48dba3fa73d tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] 10.222.0.42 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.015401 Oct 23 01:23:57.243182 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1741/3463] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Oct 23 01:23:57 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:23:57.262457 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a4af9abb-1dc4-4a0c-8b78-46f5be034c10 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Action: 'create', calling method: .version_select at 0x7f5cc172d5e0>, body: {"server_group": {"name": "tempest-server-group-1266853279", "policies": ["affinity"]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:23:57.290059 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-a4af9abb-1dc4-4a0c-8b78-46f5be034c10 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Getting quotas for project 4308ac3d1dbe4e798f6650316f479826. Resources: {'server_groups'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:23:57.296254 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-a4af9abb-1dc4-4a0c-8b78-46f5be034c10 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Getting quotas for user 418a4c6848204bea8eadb505ccb9c04e and project 4308ac3d1dbe4e798f6650316f479826. Resources: {'server_groups'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:23:57.471009 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-a4af9abb-1dc4-4a0c-8b78-46f5be034c10 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Getting quotas for project 4308ac3d1dbe4e798f6650316f479826. Resources: {'server_groups'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:23:57.481612 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-a4af9abb-1dc4-4a0c-8b78-46f5be034c10 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Getting quotas for user 418a4c6848204bea8eadb505ccb9c04e and project 4308ac3d1dbe4e798f6650316f479826. Resources: {'server_groups'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:23:57.499020 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a4af9abb-1dc4-4a0c-8b78-46f5be034c10 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] 10.222.0.42 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.240510 Oct 23 01:23:57.499639 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1723/3464] 10.222.0.42 () {60 vars in 1173 bytes} [Sun Oct 23 01:23:57 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:23:57.511427 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-193c2f4a-9ab8-403a-b3cd-cd34d3aafc03 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:57.662685 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-193c2f4a-9ab8-403a-b3cd-cd34d3aafc03 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] 10.222.0.42 "DELETE /compute/v2.1/os-server-groups/24a2b84e-1d1f-438c-8e14-02f5a7d30c00" status: 204 len: 0 microversion: 2.1 time: 0.155127 Oct 23 01:23:57.663391 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1742/3465] 10.222.0.42 () {58 vars in 1266 bytes} [Sun Oct 23 01:23:57 2022] DELETE /compute/v2.1/os-server-groups/24a2b84e-1d1f-438c-8e14-02f5a7d30c00 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:23:57.671675 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7cea3b6d-8d3e-44ff-a971-bb551b836c0a tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:57.698847 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7cea3b6d-8d3e-44ff-a971-bb551b836c0a tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] 10.222.0.42 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.031151 Oct 23 01:23:57.699637 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1724/3466] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Oct 23 01:23:57 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:23:57.713586 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8f5db984-5cf8-4cf4-ac9b-d21d07c8be5d tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Action: 'create', calling method: .version_select at 0x7f5cc10f01f0>, body: {"server_group": {"name": "tempest-server-group-11672509", "policies": ["anti-affinity"]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:23:57.737938 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-8f5db984-5cf8-4cf4-ac9b-d21d07c8be5d tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Getting quotas for project 4308ac3d1dbe4e798f6650316f479826. Resources: {'server_groups'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:23:57.751028 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-8f5db984-5cf8-4cf4-ac9b-d21d07c8be5d tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Getting quotas for user 418a4c6848204bea8eadb505ccb9c04e and project 4308ac3d1dbe4e798f6650316f479826. Resources: {'server_groups'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:23:57.811149 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cb1282b0-1fe5-47a0-9f74-45477a6aeafe tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:57.812143 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cb1282b0-1fe5-47a0-9f74-45477a6aeafe tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 3d9196f6-d696-45e0-b7fc-8d1557498393] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:57.819430 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb1282b0-1fe5-47a0-9f74-45477a6aeafe tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:57.820206 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb1282b0-1fe5-47a0-9f74-45477a6aeafe tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:57.820858 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb1282b0-1fe5-47a0-9f74-45477a6aeafe tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:57.821553 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb1282b0-1fe5-47a0-9f74-45477a6aeafe tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:57.822333 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb1282b0-1fe5-47a0-9f74-45477a6aeafe tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:57.822930 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb1282b0-1fe5-47a0-9f74-45477a6aeafe tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:57.880870 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-8f5db984-5cf8-4cf4-ac9b-d21d07c8be5d tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Getting quotas for project 4308ac3d1dbe4e798f6650316f479826. Resources: {'server_groups'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:23:57.896698 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-8f5db984-5cf8-4cf4-ac9b-d21d07c8be5d tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Getting quotas for user 418a4c6848204bea8eadb505ccb9c04e and project 4308ac3d1dbe4e798f6650316f479826. Resources: {'server_groups'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:23:57.938057 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8f5db984-5cf8-4cf4-ac9b-d21d07c8be5d tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] 10.222.0.42 "POST /compute/v2.1/os-server-groups" status: 200 len: 167 microversion: 2.1 time: 0.223769 Oct 23 01:23:57.938730 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1743/3467] 10.222.0.42 () {60 vars in 1173 bytes} [Sun Oct 23 01:23:57 2022] POST /compute/v2.1/os-server-groups => generated 167 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:23:57.948473 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a5e61dc3-6bf8-48cd-89db-92ad5f0d6f00 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:57.949229 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a5e61dc3-6bf8-48cd-89db-92ad5f0d6f00 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:57.956314 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5e61dc3-6bf8-48cd-89db-92ad5f0d6f00 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:57.957072 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5e61dc3-6bf8-48cd-89db-92ad5f0d6f00 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:57.957932 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5e61dc3-6bf8-48cd-89db-92ad5f0d6f00 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:57.959100 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5e61dc3-6bf8-48cd-89db-92ad5f0d6f00 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:57.959668 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5e61dc3-6bf8-48cd-89db-92ad5f0d6f00 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:57.960269 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5e61dc3-6bf8-48cd-89db-92ad5f0d6f00 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:57.987611 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a5e61dc3-6bf8-48cd-89db-92ad5f0d6f00 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca/ips" status: 200 len: 147 microversion: 2.1 time: 0.047801 Oct 23 01:23:57.996244 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1744/3468] 10.222.0.42 () {58 vars in 1248 bytes} [Sun Oct 23 01:23:57 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca/ips => generated 147 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:23:58.002079 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-514f4b7b-b005-42c6-96b4-ea380f1cdbaf tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:58.006849 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:58.007675 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cb1282b0-1fe5-47a0-9f74-45477a6aeafe tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:58.018020 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cb1282b0-1fe5-47a0-9f74-45477a6aeafe tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393" status: 200 len: 1521 microversion: 2.1 time: 0.210358 Oct 23 01:23:58.020028 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1725/3469] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:57 2022] GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:23:58.187663 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-514f4b7b-b005-42c6-96b4-ea380f1cdbaf tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] 10.222.0.42 "DELETE /compute/v2.1/os-server-groups/0739ec7b-79d1-4dfd-bacb-44847ce3c3f6" status: 204 len: 0 microversion: 2.1 time: 0.190000 Oct 23 01:23:58.190305 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1745/3470] 10.222.0.42 () {58 vars in 1266 bytes} [Sun Oct 23 01:23:57 2022] DELETE /compute/v2.1/os-server-groups/0739ec7b-79d1-4dfd-bacb-44847ce3c3f6 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:23:58.198214 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5cbc5121-1cae-4ae4-91c7-99a9c5c59d55 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:58.208711 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5cbc5121-1cae-4ae4-91c7-99a9c5c59d55 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] 10.222.0.42 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.014244 Oct 23 01:23:58.209653 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1726/3471] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Oct 23 01:23:58 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:23:58.336644 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7c65f64b-4505-4777-b85f-0f14cf16d891 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1478683846", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "8517451d-b655-4197-a2d9-38a57039dd0e"}]}, "os:scheduler_hints": {"group": "bdd09618-574b-473d-8736-d98d05a72605"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:23:58.401912 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-7c65f64b-4505-4777-b85f-0f14cf16d891 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] validate_networks() for [('8517451d-b655-4197-a2d9-38a57039dd0e', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:23:58.947460 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-7c65f64b-4505-4777-b85f-0f14cf16d891 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:23:58.948042 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-7c65f64b-4505-4777-b85f-0f14cf16d891 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:23:58.948468 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-7c65f64b-4505-4777-b85f-0f14cf16d891 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:23:58.948885 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-7c65f64b-4505-4777-b85f-0f14cf16d891 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:23:58.949302 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-7c65f64b-4505-4777-b85f-0f14cf16d891 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:23:58.969508 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c65f64b-4505-4777-b85f-0f14cf16d891 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:58.971318 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c65f64b-4505-4777-b85f-0f14cf16d891 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:58.973155 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c65f64b-4505-4777-b85f-0f14cf16d891 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:58.975160 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c65f64b-4505-4777-b85f-0f14cf16d891 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:58.976498 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c65f64b-4505-4777-b85f-0f14cf16d891 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:58.976498 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c65f64b-4505-4777-b85f-0f14cf16d891 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:59.001414 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-7c65f64b-4505-4777-b85f-0f14cf16d891 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Getting quotas for project 4308ac3d1dbe4e798f6650316f479826. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:23:59.008737 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-7c65f64b-4505-4777-b85f-0f14cf16d891 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Getting quotas for user 418a4c6848204bea8eadb505ccb9c04e and project 4308ac3d1dbe4e798f6650316f479826. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:23:59.025320 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7c65f64b-4505-4777-b85f-0f14cf16d891 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:23:59.029145 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7c65f64b-4505-4777-b85f-0f14cf16d891 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] [instance: 9950e3c9-688e-405c-b1df-9a07f65f7dcf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:23:59.043394 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-564f6bd5-4e09-48fd-a9a6-89cc2914c070 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:59.044019 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-564f6bd5-4e09-48fd-a9a6-89cc2914c070 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 3d9196f6-d696-45e0-b7fc-8d1557498393] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:59.059088 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-564f6bd5-4e09-48fd-a9a6-89cc2914c070 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:59.060842 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-564f6bd5-4e09-48fd-a9a6-89cc2914c070 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:59.062528 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-564f6bd5-4e09-48fd-a9a6-89cc2914c070 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:59.064090 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-564f6bd5-4e09-48fd-a9a6-89cc2914c070 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:23:59.066050 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-564f6bd5-4e09-48fd-a9a6-89cc2914c070 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:23:59.066050 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-564f6bd5-4e09-48fd-a9a6-89cc2914c070 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:23:59.249246 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-7c65f64b-4505-4777-b85f-0f14cf16d891 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Getting quotas for project 4308ac3d1dbe4e798f6650316f479826. Resources: {'server_group_members'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:23:59.256291 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-7c65f64b-4505-4777-b85f-0f14cf16d891 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Getting quotas for user 418a4c6848204bea8eadb505ccb9c04e and project 4308ac3d1dbe4e798f6650316f479826. Resources: {'server_group_members'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:23:59.284334 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-564f6bd5-4e09-48fd-a9a6-89cc2914c070 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:59.297020 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-564f6bd5-4e09-48fd-a9a6-89cc2914c070 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393" status: 200 len: 1521 microversion: 2.1 time: 0.259513 Oct 23 01:23:59.300822 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1727/3472] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:59 2022] GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393 => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:23:59.370864 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-7c65f64b-4505-4777-b85f-0f14cf16d891 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Getting quotas for project 4308ac3d1dbe4e798f6650316f479826. Resources: {'server_group_members'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:23:59.376706 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-7c65f64b-4505-4777-b85f-0f14cf16d891 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Getting quotas for user 418a4c6848204bea8eadb505ccb9c04e and project 4308ac3d1dbe4e798f6650316f479826. Resources: {'server_group_members'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:23:59.410299 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7c65f64b-4505-4777-b85f-0f14cf16d891 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.079298 Oct 23 01:23:59.411195 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1746/3473] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:23:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1081 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:23:59.422291 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fdf33014-8954-4dad-9901-bc8d1c063736 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:23:59.422911 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-fdf33014-8954-4dad-9901-bc8d1c063736 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] [instance: 9950e3c9-688e-405c-b1df-9a07f65f7dcf] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:23:59.493113 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-fdf33014-8954-4dad-9901-bc8d1c063736 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418a4c6848204bea8eadb505ccb9c04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4308ac3d1dbe4e798f6650316f479826', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:23:59.502001 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fdf33014-8954-4dad-9901-bc8d1c063736 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] 10.222.0.42 "GET /compute/v2.1/servers/9950e3c9-688e-405c-b1df-9a07f65f7dcf" status: 200 len: 1213 microversion: 2.1 time: 0.083743 Oct 23 01:23:59.502676 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1728/3474] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:23:59 2022] GET /compute/v2.1/servers/9950e3c9-688e-405c-b1df-9a07f65f7dcf => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:00.328798 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3eb4c858-c1ac-4354-a518-0eda8edc082f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:00.329406 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3eb4c858-c1ac-4354-a518-0eda8edc082f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 3d9196f6-d696-45e0-b7fc-8d1557498393] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:00.340729 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3eb4c858-c1ac-4354-a518-0eda8edc082f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:00.341239 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3eb4c858-c1ac-4354-a518-0eda8edc082f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:00.341699 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3eb4c858-c1ac-4354-a518-0eda8edc082f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:00.346509 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3eb4c858-c1ac-4354-a518-0eda8edc082f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:00.347025 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3eb4c858-c1ac-4354-a518-0eda8edc082f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:00.347669 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3eb4c858-c1ac-4354-a518-0eda8edc082f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:00.528238 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-664917db-0918-4397-b28a-7acbb0ea577c tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:00.529251 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-664917db-0918-4397-b28a-7acbb0ea577c tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] [instance: 9950e3c9-688e-405c-b1df-9a07f65f7dcf] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:00.558943 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3eb4c858-c1ac-4354-a518-0eda8edc082f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:00.574276 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3eb4c858-c1ac-4354-a518-0eda8edc082f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393" status: 200 len: 1521 microversion: 2.1 time: 0.252375 Oct 23 01:24:00.577252 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1747/3475] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:00 2022] GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393 => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:00.674420 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-664917db-0918-4397-b28a-7acbb0ea577c tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418a4c6848204bea8eadb505ccb9c04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4308ac3d1dbe4e798f6650316f479826', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:00.684014 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-664917db-0918-4397-b28a-7acbb0ea577c tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] 10.222.0.42 "GET /compute/v2.1/servers/9950e3c9-688e-405c-b1df-9a07f65f7dcf" status: 200 len: 1213 microversion: 2.1 time: 0.163117 Oct 23 01:24:00.685736 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1729/3476] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:00 2022] GET /compute/v2.1/servers/9950e3c9-688e-405c-b1df-9a07f65f7dcf => generated 1213 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:01.603133 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f1a799a9-01cb-491d-bf10-0bfe56996904 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:01.603745 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f1a799a9-01cb-491d-bf10-0bfe56996904 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 3d9196f6-d696-45e0-b7fc-8d1557498393] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:01.615652 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1a799a9-01cb-491d-bf10-0bfe56996904 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:01.616143 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1a799a9-01cb-491d-bf10-0bfe56996904 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:01.616577 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1a799a9-01cb-491d-bf10-0bfe56996904 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:01.618586 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1a799a9-01cb-491d-bf10-0bfe56996904 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:01.619629 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1a799a9-01cb-491d-bf10-0bfe56996904 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:01.619629 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1a799a9-01cb-491d-bf10-0bfe56996904 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:01.707954 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ce5b97d5-be5f-4e58-ba3b-9fd1d79fa343 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:01.708696 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ce5b97d5-be5f-4e58-ba3b-9fd1d79fa343 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] [instance: 9950e3c9-688e-405c-b1df-9a07f65f7dcf] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:01.719067 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ce5b97d5-be5f-4e58-ba3b-9fd1d79fa343 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:01.720281 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ce5b97d5-be5f-4e58-ba3b-9fd1d79fa343 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:01.722404 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ce5b97d5-be5f-4e58-ba3b-9fd1d79fa343 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:01.724162 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ce5b97d5-be5f-4e58-ba3b-9fd1d79fa343 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:01.732409 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ce5b97d5-be5f-4e58-ba3b-9fd1d79fa343 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:01.732409 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ce5b97d5-be5f-4e58-ba3b-9fd1d79fa343 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:01.832157 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ce5b97d5-be5f-4e58-ba3b-9fd1d79fa343 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418a4c6848204bea8eadb505ccb9c04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4308ac3d1dbe4e798f6650316f479826', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:01.841964 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ce5b97d5-be5f-4e58-ba3b-9fd1d79fa343 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] 10.222.0.42 "GET /compute/v2.1/servers/9950e3c9-688e-405c-b1df-9a07f65f7dcf" status: 200 len: 1209 microversion: 2.1 time: 0.137982 Oct 23 01:24:01.856840 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1730/3477] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:01 2022] GET /compute/v2.1/servers/9950e3c9-688e-405c-b1df-9a07f65f7dcf => generated 1209 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:24:01.922747 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f1a799a9-01cb-491d-bf10-0bfe56996904 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:01.931498 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f1a799a9-01cb-491d-bf10-0bfe56996904 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393" status: 200 len: 1521 microversion: 2.1 time: 0.332198 Oct 23 01:24:01.932558 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1748/3478] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:01 2022] GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393 => generated 1521 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:24:02.295183 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8aa50c0b-4fe3-43ac-a9e1-0122ff63b24d tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26ea4b53-99ec-45cd-8bd2-688a14da82c0"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:24:02.297600 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8aa50c0b-4fe3-43ac-a9e1-0122ff63b24d tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:02.304685 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8aa50c0b-4fe3-43ac-a9e1-0122ff63b24d tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:02.305161 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8aa50c0b-4fe3-43ac-a9e1-0122ff63b24d tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:02.305929 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8aa50c0b-4fe3-43ac-a9e1-0122ff63b24d tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:02.306653 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8aa50c0b-4fe3-43ac-a9e1-0122ff63b24d tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:02.307086 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8aa50c0b-4fe3-43ac-a9e1-0122ff63b24d tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:02.307502 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8aa50c0b-4fe3-43ac-a9e1-0122ff63b24d tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:02.866216 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-93d7c358-2438-48cd-a031-4ed171869ef2 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:02.867547 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-93d7c358-2438-48cd-a031-4ed171869ef2 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] [instance: 9950e3c9-688e-405c-b1df-9a07f65f7dcf] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:02.875010 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-93d7c358-2438-48cd-a031-4ed171869ef2 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:02.879968 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-93d7c358-2438-48cd-a031-4ed171869ef2 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:02.879968 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-93d7c358-2438-48cd-a031-4ed171869ef2 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:02.879968 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-93d7c358-2438-48cd-a031-4ed171869ef2 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:02.879968 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-93d7c358-2438-48cd-a031-4ed171869ef2 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:02.879968 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-93d7c358-2438-48cd-a031-4ed171869ef2 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:02.996890 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-93d7c358-2438-48cd-a031-4ed171869ef2 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418a4c6848204bea8eadb505ccb9c04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4308ac3d1dbe4e798f6650316f479826', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:03.009790 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-93d7c358-2438-48cd-a031-4ed171869ef2 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] 10.222.0.42 "GET /compute/v2.1/servers/9950e3c9-688e-405c-b1df-9a07f65f7dcf" status: 200 len: 1265 microversion: 2.1 time: 0.145756 Oct 23 01:24:03.026065 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1749/3479] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:02 2022] GET /compute/v2.1/servers/9950e3c9-688e-405c-b1df-9a07f65f7dcf => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:24:03.038120 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1f79eccf-9f92-4cc9-a11a-c449f34fdfc0 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:03.038827 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1f79eccf-9f92-4cc9-a11a-c449f34fdfc0 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 3d9196f6-d696-45e0-b7fc-8d1557498393] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:03.048106 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f79eccf-9f92-4cc9-a11a-c449f34fdfc0 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:03.049044 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f79eccf-9f92-4cc9-a11a-c449f34fdfc0 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:03.049750 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f79eccf-9f92-4cc9-a11a-c449f34fdfc0 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:03.051040 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f79eccf-9f92-4cc9-a11a-c449f34fdfc0 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:03.051771 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f79eccf-9f92-4cc9-a11a-c449f34fdfc0 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:03.053095 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f79eccf-9f92-4cc9-a11a-c449f34fdfc0 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:03.322961 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1f79eccf-9f92-4cc9-a11a-c449f34fdfc0 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:03.338981 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1f79eccf-9f92-4cc9-a11a-c449f34fdfc0 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393" status: 200 len: 1521 microversion: 2.1 time: 0.311684 Oct 23 01:24:03.339823 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1750/3480] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:03 2022] GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393 => generated 1521 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:03.521838 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8aa50c0b-4fe3-43ac-a9e1-0122ff63b24d tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "POST /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.230396 Oct 23 01:24:03.523420 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1731/3481] 10.222.0.42 () {60 vars in 1323 bytes} [Sun Oct 23 01:24:02 2022] POST /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca/os-volume_attachments => generated 194 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:24:04.035069 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-eb462d57-b6d1-41b8-ab8a-efc8f0d1d446 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:04.035730 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-eb462d57-b6d1-41b8-ab8a-efc8f0d1d446 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] [instance: 9950e3c9-688e-405c-b1df-9a07f65f7dcf] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:04.059085 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb462d57-b6d1-41b8-ab8a-efc8f0d1d446 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:04.062295 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb462d57-b6d1-41b8-ab8a-efc8f0d1d446 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:04.063834 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb462d57-b6d1-41b8-ab8a-efc8f0d1d446 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:04.064731 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb462d57-b6d1-41b8-ab8a-efc8f0d1d446 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:04.068743 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb462d57-b6d1-41b8-ab8a-efc8f0d1d446 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:04.069539 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb462d57-b6d1-41b8-ab8a-efc8f0d1d446 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:04.365808 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2aa30829-3698-4811-8a18-64bc724a9f16 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:04.367065 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2aa30829-3698-4811-8a18-64bc724a9f16 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 3d9196f6-d696-45e0-b7fc-8d1557498393] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:04.380205 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2aa30829-3698-4811-8a18-64bc724a9f16 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:04.380706 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2aa30829-3698-4811-8a18-64bc724a9f16 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:04.381145 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2aa30829-3698-4811-8a18-64bc724a9f16 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:04.381854 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2aa30829-3698-4811-8a18-64bc724a9f16 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:04.384043 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2aa30829-3698-4811-8a18-64bc724a9f16 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:04.387071 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2aa30829-3698-4811-8a18-64bc724a9f16 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:04.469710 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-eb462d57-b6d1-41b8-ab8a-efc8f0d1d446 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418a4c6848204bea8eadb505ccb9c04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4308ac3d1dbe4e798f6650316f479826', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:04.482276 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=100 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:04.500761 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-eb462d57-b6d1-41b8-ab8a-efc8f0d1d446 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] 10.222.0.42 "GET /compute/v2.1/servers/9950e3c9-688e-405c-b1df-9a07f65f7dcf" status: 200 len: 1313 microversion: 2.1 time: 0.466375 Oct 23 01:24:04.506253 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1751/3482] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:04 2022] GET /compute/v2.1/servers/9950e3c9-688e-405c-b1df-9a07f65f7dcf => generated 1313 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:04.845362 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2aa30829-3698-4811-8a18-64bc724a9f16 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:04.868079 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2aa30829-3698-4811-8a18-64bc724a9f16 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393" status: 200 len: 1521 microversion: 2.1 time: 0.507565 Oct 23 01:24:04.882562 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1732/3483] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:04 2022] GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393 => generated 1521 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:24:05.535224 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5045d6c4-a909-498e-b4e6-297fbfb60702 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:05.536723 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5045d6c4-a909-498e-b4e6-297fbfb60702 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] [instance: 9950e3c9-688e-405c-b1df-9a07f65f7dcf] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:05.554661 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5045d6c4-a909-498e-b4e6-297fbfb60702 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:05.570590 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5045d6c4-a909-498e-b4e6-297fbfb60702 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:05.572251 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5045d6c4-a909-498e-b4e6-297fbfb60702 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:05.574299 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5045d6c4-a909-498e-b4e6-297fbfb60702 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:05.581811 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5045d6c4-a909-498e-b4e6-297fbfb60702 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:05.582674 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5045d6c4-a909-498e-b4e6-297fbfb60702 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:05.899151 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a9b2c191-d765-4cd1-a6dd-bb9e188e2958 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:05.900351 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a9b2c191-d765-4cd1-a6dd-bb9e188e2958 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 3d9196f6-d696-45e0-b7fc-8d1557498393] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:05.913943 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9b2c191-d765-4cd1-a6dd-bb9e188e2958 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:05.921716 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9b2c191-d765-4cd1-a6dd-bb9e188e2958 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:05.921716 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9b2c191-d765-4cd1-a6dd-bb9e188e2958 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:05.921716 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9b2c191-d765-4cd1-a6dd-bb9e188e2958 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:05.921716 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9b2c191-d765-4cd1-a6dd-bb9e188e2958 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:05.921716 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9b2c191-d765-4cd1-a6dd-bb9e188e2958 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:06.373750 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5045d6c4-a909-498e-b4e6-297fbfb60702 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418a4c6848204bea8eadb505ccb9c04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4308ac3d1dbe4e798f6650316f479826', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:06.384691 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5045d6c4-a909-498e-b4e6-297fbfb60702 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] 10.222.0.42 "GET /compute/v2.1/servers/9950e3c9-688e-405c-b1df-9a07f65f7dcf" status: 200 len: 1313 microversion: 2.1 time: 0.853614 Oct 23 01:24:06.396341 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1752/3484] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:05 2022] GET /compute/v2.1/servers/9950e3c9-688e-405c-b1df-9a07f65f7dcf => generated 1313 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:06.413402 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-7056578b-a9c6-4b3b-ad0a-811da1d2bb84 req-7301ef0a-da40-4e50-81f7-72ad780cd717 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9950e3c9-688e-405c-b1df-9a07f65f7dcf", "tag": "bbf8f67f-9c0c-45aa-bdd4-adb8c1656a3c"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:24:06.441643 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-7056578b-a9c6-4b3b-ad0a-811da1d2bb84 req-7301ef0a-da40-4e50-81f7-72ad780cd717 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:06.443658 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-7056578b-a9c6-4b3b-ad0a-811da1d2bb84 req-7301ef0a-da40-4e50-81f7-72ad780cd717 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:06.444120 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-7056578b-a9c6-4b3b-ad0a-811da1d2bb84 req-7301ef0a-da40-4e50-81f7-72ad780cd717 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:06.475580 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a9b2c191-d765-4cd1-a6dd-bb9e188e2958 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:06.499049 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-7056578b-a9c6-4b3b-ad0a-811da1d2bb84 req-7301ef0a-da40-4e50-81f7-72ad780cd717 service nova] Creating event network-changed:bbf8f67f-9c0c-45aa-bdd4-adb8c1656a3c for instance 9950e3c9-688e-405c-b1df-9a07f65f7dcf on n-h2-master-1 Oct 23 01:24:06.510576 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a9b2c191-d765-4cd1-a6dd-bb9e188e2958 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393" status: 200 len: 1521 microversion: 2.1 time: 0.614841 Oct 23 01:24:06.511457 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1733/3485] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:05 2022] GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393 => generated 1521 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:06.529036 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-7056578b-a9c6-4b3b-ad0a-811da1d2bb84 req-7301ef0a-da40-4e50-81f7-72ad780cd717 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124617 Oct 23 01:24:06.542450 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1753/3486] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:24:07.409479 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3c700f3a-ca9e-406c-8cb9-99a71a90024e tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:07.410127 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3c700f3a-ca9e-406c-8cb9-99a71a90024e tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] [instance: 9950e3c9-688e-405c-b1df-9a07f65f7dcf] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:07.420371 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:DELETE=6 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:07.421861 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c700f3a-ca9e-406c-8cb9-99a71a90024e tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:07.427556 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c700f3a-ca9e-406c-8cb9-99a71a90024e tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:07.428047 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c700f3a-ca9e-406c-8cb9-99a71a90024e tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:07.429121 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c700f3a-ca9e-406c-8cb9-99a71a90024e tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:07.429599 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c700f3a-ca9e-406c-8cb9-99a71a90024e tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:07.438213 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c700f3a-ca9e-406c-8cb9-99a71a90024e tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:07.540525 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-934fb1d5-48f0-406c-96c3-553b65fda9b5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:07.541555 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-934fb1d5-48f0-406c-96c3-553b65fda9b5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 3d9196f6-d696-45e0-b7fc-8d1557498393] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:07.565112 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-934fb1d5-48f0-406c-96c3-553b65fda9b5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:07.565800 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-934fb1d5-48f0-406c-96c3-553b65fda9b5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:07.566088 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-934fb1d5-48f0-406c-96c3-553b65fda9b5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:07.566784 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-934fb1d5-48f0-406c-96c3-553b65fda9b5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:07.567804 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-934fb1d5-48f0-406c-96c3-553b65fda9b5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:07.568247 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-934fb1d5-48f0-406c-96c3-553b65fda9b5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:07.838598 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3c700f3a-ca9e-406c-8cb9-99a71a90024e tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418a4c6848204bea8eadb505ccb9c04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4308ac3d1dbe4e798f6650316f479826', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:07.840947 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-934fb1d5-48f0-406c-96c3-553b65fda9b5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:07.847054 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3c700f3a-ca9e-406c-8cb9-99a71a90024e tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] 10.222.0.42 "GET /compute/v2.1/servers/9950e3c9-688e-405c-b1df-9a07f65f7dcf" status: 200 len: 1313 microversion: 2.1 time: 0.441518 Oct 23 01:24:07.847634 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1734/3487] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:07 2022] GET /compute/v2.1/servers/9950e3c9-688e-405c-b1df-9a07f65f7dcf => generated 1313 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:07.858316 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-934fb1d5-48f0-406c-96c3-553b65fda9b5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393" status: 200 len: 1501 microversion: 2.1 time: 0.316471 Oct 23 01:24:07.858316 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1754/3488] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:07 2022] GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393 => generated 1501 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:24:07.880231 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b4513a65-f3e9-4d9e-a68a-c5071bfc5460 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "18940a1c-2c64-4eb3-93da-9a56a3fe6d0e"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:24:07.883337 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b4513a65-f3e9-4d9e-a68a-c5071bfc5460 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 3d9196f6-d696-45e0-b7fc-8d1557498393] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:07.899427 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b4513a65-f3e9-4d9e-a68a-c5071bfc5460 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:07.900276 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b4513a65-f3e9-4d9e-a68a-c5071bfc5460 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:07.900902 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b4513a65-f3e9-4d9e-a68a-c5071bfc5460 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:07.901626 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b4513a65-f3e9-4d9e-a68a-c5071bfc5460 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:07.902182 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b4513a65-f3e9-4d9e-a68a-c5071bfc5460 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:07.908363 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b4513a65-f3e9-4d9e-a68a-c5071bfc5460 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:07.953996 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:07.959782 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-b4513a65-f3e9-4d9e-a68a-c5071bfc5460 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] HTTP exception thrown: Cannot 'attach_volume' instance 3d9196f6-d696-45e0-b7fc-8d1557498393 while it is in vm_state rescued Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b4513a65-f3e9-4d9e-a68a-c5071bfc5460 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Request method failure captured: Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393/os-volume_attachments HTTP/1.1 Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 74 Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJdQk8hX6uPg4qHO6qc2mwusfqzM5L9E46F0sE_pC33qOsFxuj7jBx97KQnGjJpiMRyi7Ccd4qVZLYee5QWMbRFkTPXMBEfS5K72Bw65O1CzepVHWqpUTGTMXTiFqb2LFyp2Lx0G54EC4LTSr0BIWkU_QP9JqR2fGUhTDQevTmiXx40 Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 4c25b4509ad7457bad4a2e5e0bc59add Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1648319695 Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4c25b4509ad7457bad4a2e5e0bc59add"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4c25b4509ad7457bad4a2e5e0bc59add"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4c25b4509ad7457bad4a2e5e0bc59add"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4c25b4509ad7457bad4a2e5e0bc59add"}]}] Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1648319695 Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 4c25b4509ad7457bad4a2e5e0bc59add Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1648319695 Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServerRescueNegativeTestJSON-1648319695-project Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 19bff9f7a4254110b3b89f0cba5d252f Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1648319695-project Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: {"volumeAttachment": {"volumeId": "18940a1c-2c64-4eb3-93da-9a56a3fe6d0e"}} Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: exception: Cannot 'attach_volume' instance 3d9196f6-d696-45e0-b7fc-8d1557498393 while it is in vm_state rescued Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: action_args: {'server_id': '3d9196f6-d696-45e0-b7fc-8d1557498393', 'body': {'volumeAttachment': {'volumeId': '18940a1c-2c64-4eb3-93da-9a56a3fe6d0e'}}} Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3d9196f6-d696-45e0-b7fc-8d1557498393 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 23 01:24:07.964482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 23 01:24:07.985198 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 23 01:24:07.985198 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 23 01:24:07.985198 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 3d9196f6-d696-45e0-b7fc-8d1557498393 while it is in vm_state rescued Oct 23 01:24:07.985198 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:24:07.985198 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:24:07.985198 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:24:07.985198 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:24:07.985198 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:24:07.985198 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:24:07.985198 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:24:07.985198 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:24:07.985198 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 3d9196f6-d696-45e0-b7fc-8d1557498393 while it is in vm_state rescued Oct 23 01:24:07.985198 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:24:07.985198 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b4513a65-f3e9-4d9e-a68a-c5071bfc5460 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Returning 409 to user: Cannot 'attach_volume' instance 3d9196f6-d696-45e0-b7fc-8d1557498393 while it is in vm_state rescued {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:24:07.985198 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b4513a65-f3e9-4d9e-a68a-c5071bfc5460 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "POST /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.095028 Oct 23 01:24:07.985198 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1735/3489] 10.222.0.42 () {60 vars in 1323 bytes} [Sun Oct 23 01:24:07 2022] POST /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393/os-volume_attachments => generated 152 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 23 01:24:07.985198 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b60c2189-7cc9-4c1f-b3d2-35e1fd53d779 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:24:07.985198 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b60c2189-7cc9-4c1f-b3d2-35e1fd53d779 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 3d9196f6-d696-45e0-b7fc-8d1557498393] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:07.992699 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b60c2189-7cc9-4c1f-b3d2-35e1fd53d779 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:07.993425 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b60c2189-7cc9-4c1f-b3d2-35e1fd53d779 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:07.994156 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b60c2189-7cc9-4c1f-b3d2-35e1fd53d779 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:07.994861 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b60c2189-7cc9-4c1f-b3d2-35e1fd53d779 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:07.995364 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b60c2189-7cc9-4c1f-b3d2-35e1fd53d779 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:07.996006 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b60c2189-7cc9-4c1f-b3d2-35e1fd53d779 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:08.015129 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-47aee950-fcff-4fea-8b47-35658b918a58 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Action: 'create', calling method: .version_select at 0x7f5cc18d0dc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-134925099", "description": "tempest-description-1486722559"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:24:08.218043 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b60c2189-7cc9-4c1f-b3d2-35e1fd53d779 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "POST /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393/action" status: 202 len: 0 microversion: 2.1 time: 0.242343 Oct 23 01:24:08.223042 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1736/3490] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:24:07 2022] POST /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 23 01:24:08.234385 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a861507c-0f91-4e3d-8359-3a2f818353bc tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:08.235529 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a861507c-0f91-4e3d-8359-3a2f818353bc tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 3d9196f6-d696-45e0-b7fc-8d1557498393] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:08.244728 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a861507c-0f91-4e3d-8359-3a2f818353bc tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:08.245602 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a861507c-0f91-4e3d-8359-3a2f818353bc tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:08.246224 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a861507c-0f91-4e3d-8359-3a2f818353bc tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:08.247011 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a861507c-0f91-4e3d-8359-3a2f818353bc tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:08.247683 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a861507c-0f91-4e3d-8359-3a2f818353bc tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:08.253428 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a861507c-0f91-4e3d-8359-3a2f818353bc tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:08.486603 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a861507c-0f91-4e3d-8359-3a2f818353bc tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:08.498727 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a861507c-0f91-4e3d-8359-3a2f818353bc tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393" status: 200 len: 1509 microversion: 2.1 time: 0.273195 Oct 23 01:24:08.499326 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1737/3491] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:08 2022] GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393 => generated 1509 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:08.552446 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-47aee950-fcff-4fea-8b47-35658b918a58 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.698909 Oct 23 01:24:08.555124 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1755/3492] 10.222.0.42 () {60 vars in 1180 bytes} [Sun Oct 23 01:24:07 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:24:08.557148 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0e1c6c12-d690-4a17-b961-4359c702ac2e tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3c684ec1-f364-40c2-8f01-d028f6b4ff21"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:24:08.559522 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0e1c6c12-d690-4a17-b961-4359c702ac2e tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: 8ce9f585-473f-4f8f-a5e6-7b83b7303ccb] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:08.566660 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0c355dcc-9ce9-4082-affa-c8ce8fd581fa tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Action: 'create', calling method: .version_select at 0x7f5cc1078040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1334726409", "description": "tempest-description-737753515"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:24:08.572403 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0e1c6c12-d690-4a17-b961-4359c702ac2e tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:08.573209 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0e1c6c12-d690-4a17-b961-4359c702ac2e tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:08.574029 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0e1c6c12-d690-4a17-b961-4359c702ac2e tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:08.576941 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0e1c6c12-d690-4a17-b961-4359c702ac2e tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:08.577794 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0e1c6c12-d690-4a17-b961-4359c702ac2e tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:08.578483 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0e1c6c12-d690-4a17-b961-4359c702ac2e tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:08.990449 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:09.119357 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0c355dcc-9ce9-4082-affa-c8ce8fd581fa tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.556382 Oct 23 01:24:09.120345 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1756/3493] 10.222.0.42 () {60 vars in 1180 bytes} [Sun Oct 23 01:24:08 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:24:09.136023 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e35fcbfd-4fe9-46ee-a4e9-7f98217cf39c tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:09.137750 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e35fcbfd-4fe9-46ee-a4e9-7f98217cf39c tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] [instance: 9950e3c9-688e-405c-b1df-9a07f65f7dcf] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:09.175686 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e35fcbfd-4fe9-46ee-a4e9-7f98217cf39c tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:09.182420 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e35fcbfd-4fe9-46ee-a4e9-7f98217cf39c tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:09.186176 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e35fcbfd-4fe9-46ee-a4e9-7f98217cf39c tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:09.186825 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e35fcbfd-4fe9-46ee-a4e9-7f98217cf39c tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:09.187307 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e35fcbfd-4fe9-46ee-a4e9-7f98217cf39c tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:09.192809 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e35fcbfd-4fe9-46ee-a4e9-7f98217cf39c tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:09.389040 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=38 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:09.565523 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e35fcbfd-4fe9-46ee-a4e9-7f98217cf39c tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418a4c6848204bea8eadb505ccb9c04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4308ac3d1dbe4e798f6650316f479826', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:09.577335 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e35fcbfd-4fe9-46ee-a4e9-7f98217cf39c tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] 10.222.0.42 "GET /compute/v2.1/servers/9950e3c9-688e-405c-b1df-9a07f65f7dcf" status: 200 len: 1313 microversion: 2.1 time: 0.455542 Oct 23 01:24:09.582318 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1757/3494] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:09 2022] GET /compute/v2.1/servers/9950e3c9-688e-405c-b1df-9a07f65f7dcf => generated 1313 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:09.588338 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b0a372aa-5dab-4b1a-a924-5f56470c5a5d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-910920650", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "583410c3-050d-4b95-8c25-d6e0ac312b91"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:24:09.696087 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-b0a372aa-5dab-4b1a-a924-5f56470c5a5d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] validate_networks() for [('583410c3-050d-4b95-8c25-d6e0ac312b91', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:24:09.881772 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0e1c6c12-d690-4a17-b961-4359c702ac2e tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "POST /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.330169 Oct 23 01:24:09.889307 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1738/3495] 10.222.0.42 () {60 vars in 1323 bytes} [Sun Oct 23 01:24:08 2022] POST /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb/os-volume_attachments => generated 194 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:24:09.896077 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-97835f7b-6a15-4521-bfbc-f11bd930e79a tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:09.897130 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-97835f7b-6a15-4521-bfbc-f11bd930e79a tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 3d9196f6-d696-45e0-b7fc-8d1557498393] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:09.912909 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-97835f7b-6a15-4521-bfbc-f11bd930e79a tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:09.916706 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-97835f7b-6a15-4521-bfbc-f11bd930e79a tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:09.917434 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-97835f7b-6a15-4521-bfbc-f11bd930e79a tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:09.918524 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-97835f7b-6a15-4521-bfbc-f11bd930e79a tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:09.919223 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-97835f7b-6a15-4521-bfbc-f11bd930e79a tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:09.920207 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-97835f7b-6a15-4521-bfbc-f11bd930e79a tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:10.179472 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-97835f7b-6a15-4521-bfbc-f11bd930e79a tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:10.196673 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-97835f7b-6a15-4521-bfbc-f11bd930e79a tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393" status: 200 len: 1509 microversion: 2.1 time: 0.305534 Oct 23 01:24:10.198074 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1739/3496] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:09 2022] GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393 => generated 1509 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:10.602099 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-63087018-eee4-4f66-882c-dc680d64c9df tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:10.603087 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-63087018-eee4-4f66-882c-dc680d64c9df tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] [instance: 9950e3c9-688e-405c-b1df-9a07f65f7dcf] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:10.609788 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-b0a372aa-5dab-4b1a-a924-5f56470c5a5d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:24:10.611636 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-b0a372aa-5dab-4b1a-a924-5f56470c5a5d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:24:10.612243 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-b0a372aa-5dab-4b1a-a924-5f56470c5a5d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:24:10.612852 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-b0a372aa-5dab-4b1a-a924-5f56470c5a5d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:24:10.619937 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-b0a372aa-5dab-4b1a-a924-5f56470c5a5d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:24:10.627686 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-63087018-eee4-4f66-882c-dc680d64c9df tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:10.630336 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b0a372aa-5dab-4b1a-a924-5f56470c5a5d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:10.631090 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-63087018-eee4-4f66-882c-dc680d64c9df tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:10.631743 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-63087018-eee4-4f66-882c-dc680d64c9df tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:10.632740 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-63087018-eee4-4f66-882c-dc680d64c9df tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:10.633467 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b0a372aa-5dab-4b1a-a924-5f56470c5a5d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:10.634317 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-63087018-eee4-4f66-882c-dc680d64c9df tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:10.635445 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b0a372aa-5dab-4b1a-a924-5f56470c5a5d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:10.637704 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-63087018-eee4-4f66-882c-dc680d64c9df tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:10.640996 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b0a372aa-5dab-4b1a-a924-5f56470c5a5d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:10.641767 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b0a372aa-5dab-4b1a-a924-5f56470c5a5d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:10.642500 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b0a372aa-5dab-4b1a-a924-5f56470c5a5d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:10.686244 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=20 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:10.707838 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-b0a372aa-5dab-4b1a-a924-5f56470c5a5d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Getting quotas for project 8d9f6afbdbf74318a98dfe455a72ac7c. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:24:10.729221 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-b0a372aa-5dab-4b1a-a924-5f56470c5a5d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Getting quotas for user 2b8a867611614ea585d510d62c63cfa3 and project 8d9f6afbdbf74318a98dfe455a72ac7c. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:24:10.756862 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b0a372aa-5dab-4b1a-a924-5f56470c5a5d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:24:10.759114 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b0a372aa-5dab-4b1a-a924-5f56470c5a5d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] [instance: 7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:24:10.961470 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-63087018-eee4-4f66-882c-dc680d64c9df tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418a4c6848204bea8eadb505ccb9c04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4308ac3d1dbe4e798f6650316f479826', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:10.965617 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b0a372aa-5dab-4b1a-a924-5f56470c5a5d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.380830 Oct 23 01:24:10.970140 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1758/3497] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:24:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1385 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:24:10.987048 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-63087018-eee4-4f66-882c-dc680d64c9df tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] 10.222.0.42 "GET /compute/v2.1/servers/9950e3c9-688e-405c-b1df-9a07f65f7dcf" status: 200 len: 1313 microversion: 2.1 time: 0.389694 Oct 23 01:24:10.988575 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1740/3498] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:10 2022] GET /compute/v2.1/servers/9950e3c9-688e-405c-b1df-9a07f65f7dcf => generated 1313 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:24:10.991559 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-08e13d6e-e77d-4688-8a59-6caa4507c095 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:10.995894 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-08e13d6e-e77d-4688-8a59-6caa4507c095 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] [instance: 7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:11.197683 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-08e13d6e-e77d-4688-8a59-6caa4507c095 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8a867611614ea585d510d62c63cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9f6afbdbf74318a98dfe455a72ac7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:11.224179 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-08e13d6e-e77d-4688-8a59-6caa4507c095 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "GET /compute/v2.1/servers/7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3" status: 200 len: 1215 microversion: 2.1 time: 0.248427 Oct 23 01:24:11.235932 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e525c134-a907-4147-8e38-73898bec6eab tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:11.237512 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e525c134-a907-4147-8e38-73898bec6eab tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 3d9196f6-d696-45e0-b7fc-8d1557498393] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:11.241406 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1759/3499] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:10 2022] GET /compute/v2.1/servers/7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3 => generated 1215 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:11.258240 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e525c134-a907-4147-8e38-73898bec6eab tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:11.262663 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e525c134-a907-4147-8e38-73898bec6eab tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:11.263238 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e525c134-a907-4147-8e38-73898bec6eab tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:11.264092 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e525c134-a907-4147-8e38-73898bec6eab tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:11.264623 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e525c134-a907-4147-8e38-73898bec6eab tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:11.265391 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e525c134-a907-4147-8e38-73898bec6eab tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:11.510973 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e525c134-a907-4147-8e38-73898bec6eab tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:11.524032 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e525c134-a907-4147-8e38-73898bec6eab tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393" status: 200 len: 1509 microversion: 2.1 time: 0.303291 Oct 23 01:24:11.525321 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1741/3500] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:11 2022] GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393 => generated 1509 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:12.015795 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4cb5fcfd-592f-41f6-bb70-bd82410b3533 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:12.017377 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4cb5fcfd-592f-41f6-bb70-bd82410b3533 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] [instance: 9950e3c9-688e-405c-b1df-9a07f65f7dcf] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:12.029453 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4cb5fcfd-592f-41f6-bb70-bd82410b3533 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:12.030329 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4cb5fcfd-592f-41f6-bb70-bd82410b3533 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:12.031677 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4cb5fcfd-592f-41f6-bb70-bd82410b3533 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:12.032679 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4cb5fcfd-592f-41f6-bb70-bd82410b3533 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:12.041837 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4cb5fcfd-592f-41f6-bb70-bd82410b3533 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:12.042743 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4cb5fcfd-592f-41f6-bb70-bd82410b3533 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:12.255482 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-8ae4250f-00d7-4bd8-8bbe-09db1ac1ae7c req-96c2a196-9fa4-4b2d-a2c9-d49567500256 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9950e3c9-688e-405c-b1df-9a07f65f7dcf", "name": "network-vif-plugged", "status": "completed", "tag": "bbf8f67f-9c0c-45aa-bdd4-adb8c1656a3c"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:24:12.278053 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4cb5fcfd-592f-41f6-bb70-bd82410b3533 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418a4c6848204bea8eadb505ccb9c04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4308ac3d1dbe4e798f6650316f479826', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:12.281465 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-8ae4250f-00d7-4bd8-8bbe-09db1ac1ae7c req-96c2a196-9fa4-4b2d-a2c9-d49567500256 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:12.281960 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-8ae4250f-00d7-4bd8-8bbe-09db1ac1ae7c req-96c2a196-9fa4-4b2d-a2c9-d49567500256 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:12.282441 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-8ae4250f-00d7-4bd8-8bbe-09db1ac1ae7c req-96c2a196-9fa4-4b2d-a2c9-d49567500256 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:12.287729 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4cb5fcfd-592f-41f6-bb70-bd82410b3533 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] 10.222.0.42 "GET /compute/v2.1/servers/9950e3c9-688e-405c-b1df-9a07f65f7dcf" status: 200 len: 1313 microversion: 2.1 time: 0.277902 Oct 23 01:24:12.289658 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1760/3501] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:12 2022] GET /compute/v2.1/servers/9950e3c9-688e-405c-b1df-9a07f65f7dcf => generated 1313 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:12.294475 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ba0c9b67-46eb-4466-a048-993f6c90ef45 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:12.295883 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ba0c9b67-46eb-4466-a048-993f6c90ef45 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] [instance: 7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:12.377414 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ba0c9b67-46eb-4466-a048-993f6c90ef45 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8a867611614ea585d510d62c63cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9f6afbdbf74318a98dfe455a72ac7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:12.385177 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ba0c9b67-46eb-4466-a048-993f6c90ef45 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "GET /compute/v2.1/servers/7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3" status: 200 len: 1215 microversion: 2.1 time: 0.094343 Oct 23 01:24:12.389666 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1761/3502] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:12 2022] GET /compute/v2.1/servers/7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3 => generated 1215 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:12.550272 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4618c81b-1dfb-445e-a371-86b25d8d81fd tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:12.550789 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4618c81b-1dfb-445e-a371-86b25d8d81fd tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 3d9196f6-d696-45e0-b7fc-8d1557498393] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:12.558880 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4618c81b-1dfb-445e-a371-86b25d8d81fd tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:12.559208 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4618c81b-1dfb-445e-a371-86b25d8d81fd tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:12.559940 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4618c81b-1dfb-445e-a371-86b25d8d81fd tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:12.560837 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4618c81b-1dfb-445e-a371-86b25d8d81fd tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:12.561476 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4618c81b-1dfb-445e-a371-86b25d8d81fd tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:12.562113 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4618c81b-1dfb-445e-a371-86b25d8d81fd tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:12.621738 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-8ae4250f-00d7-4bd8-8bbe-09db1ac1ae7c req-96c2a196-9fa4-4b2d-a2c9-d49567500256 service nova] Creating event network-vif-plugged:bbf8f67f-9c0c-45aa-bdd4-adb8c1656a3c for instance 9950e3c9-688e-405c-b1df-9a07f65f7dcf on n-h2-master-1 Oct 23 01:24:12.627289 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-8ae4250f-00d7-4bd8-8bbe-09db1ac1ae7c req-96c2a196-9fa4-4b2d-a2c9-d49567500256 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.376573 Oct 23 01:24:12.629100 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1742/3503] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:24:12.752349 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4618c81b-1dfb-445e-a371-86b25d8d81fd tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:12.768793 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4618c81b-1dfb-445e-a371-86b25d8d81fd tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393" status: 200 len: 1515 microversion: 2.1 time: 0.222907 Oct 23 01:24:12.770001 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1762/3504] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:12 2022] GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393 => generated 1515 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:13.313405 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c64dfeac-5cae-4ce6-9207-61ec010c6b5d tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:13.315343 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c64dfeac-5cae-4ce6-9207-61ec010c6b5d tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] [instance: 9950e3c9-688e-405c-b1df-9a07f65f7dcf] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:13.327787 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c64dfeac-5cae-4ce6-9207-61ec010c6b5d tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:13.328948 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c64dfeac-5cae-4ce6-9207-61ec010c6b5d tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:13.329572 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c64dfeac-5cae-4ce6-9207-61ec010c6b5d tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:13.331350 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c64dfeac-5cae-4ce6-9207-61ec010c6b5d tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:13.335695 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c64dfeac-5cae-4ce6-9207-61ec010c6b5d tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:13.335695 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c64dfeac-5cae-4ce6-9207-61ec010c6b5d tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:13.417925 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b17be71f-9e3e-4f09-bc8e-0074ec0c0872 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:13.418583 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b17be71f-9e3e-4f09-bc8e-0074ec0c0872 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] [instance: 7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:13.439198 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b17be71f-9e3e-4f09-bc8e-0074ec0c0872 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:13.444010 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b17be71f-9e3e-4f09-bc8e-0074ec0c0872 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:13.445304 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b17be71f-9e3e-4f09-bc8e-0074ec0c0872 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:13.446411 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b17be71f-9e3e-4f09-bc8e-0074ec0c0872 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:13.447234 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b17be71f-9e3e-4f09-bc8e-0074ec0c0872 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:13.449104 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b17be71f-9e3e-4f09-bc8e-0074ec0c0872 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:13.606720 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b17be71f-9e3e-4f09-bc8e-0074ec0c0872 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8a867611614ea585d510d62c63cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9f6afbdbf74318a98dfe455a72ac7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:13.631837 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b17be71f-9e3e-4f09-bc8e-0074ec0c0872 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "GET /compute/v2.1/servers/7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3" status: 200 len: 1211 microversion: 2.1 time: 0.222960 Oct 23 01:24:13.632851 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1763/3505] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:13 2022] GET /compute/v2.1/servers/7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3 => generated 1211 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:24:13.660419 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c64dfeac-5cae-4ce6-9207-61ec010c6b5d tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418a4c6848204bea8eadb505ccb9c04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4308ac3d1dbe4e798f6650316f479826', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:13.669307 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c64dfeac-5cae-4ce6-9207-61ec010c6b5d tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] 10.222.0.42 "GET /compute/v2.1/servers/9950e3c9-688e-405c-b1df-9a07f65f7dcf" status: 200 len: 1313 microversion: 2.1 time: 0.361616 Oct 23 01:24:13.678960 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1743/3506] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:13 2022] GET /compute/v2.1/servers/9950e3c9-688e-405c-b1df-9a07f65f7dcf => generated 1313 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:14.656495 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2266cc3b-cae9-4d47-ae57-50ddd944b6d0 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:14.657114 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2266cc3b-cae9-4d47-ae57-50ddd944b6d0 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] [instance: 7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:14.667557 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2266cc3b-cae9-4d47-ae57-50ddd944b6d0 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:14.668583 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2266cc3b-cae9-4d47-ae57-50ddd944b6d0 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:14.669475 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2266cc3b-cae9-4d47-ae57-50ddd944b6d0 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:14.671088 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2266cc3b-cae9-4d47-ae57-50ddd944b6d0 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:14.672008 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2266cc3b-cae9-4d47-ae57-50ddd944b6d0 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:14.675222 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2266cc3b-cae9-4d47-ae57-50ddd944b6d0 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:14.705506 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8e59186f-da60-4cd9-a8a8-fd0c9ea30682 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:14.706459 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8e59186f-da60-4cd9-a8a8-fd0c9ea30682 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] [instance: 9950e3c9-688e-405c-b1df-9a07f65f7dcf] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:14.716370 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8e59186f-da60-4cd9-a8a8-fd0c9ea30682 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:14.716854 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8e59186f-da60-4cd9-a8a8-fd0c9ea30682 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:14.717308 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8e59186f-da60-4cd9-a8a8-fd0c9ea30682 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:14.718191 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8e59186f-da60-4cd9-a8a8-fd0c9ea30682 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:14.718648 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8e59186f-da60-4cd9-a8a8-fd0c9ea30682 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:14.719131 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8e59186f-da60-4cd9-a8a8-fd0c9ea30682 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:14.753468 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2266cc3b-cae9-4d47-ae57-50ddd944b6d0 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8a867611614ea585d510d62c63cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9f6afbdbf74318a98dfe455a72ac7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:14.762509 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2266cc3b-cae9-4d47-ae57-50ddd944b6d0 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "GET /compute/v2.1/servers/7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3" status: 200 len: 1267 microversion: 2.1 time: 0.109675 Oct 23 01:24:14.763364 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1764/3507] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:14 2022] GET /compute/v2.1/servers/7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3 => generated 1267 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:14.913214 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8e59186f-da60-4cd9-a8a8-fd0c9ea30682 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418a4c6848204bea8eadb505ccb9c04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4308ac3d1dbe4e798f6650316f479826', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:14.923267 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8e59186f-da60-4cd9-a8a8-fd0c9ea30682 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] 10.222.0.42 "GET /compute/v2.1/servers/9950e3c9-688e-405c-b1df-9a07f65f7dcf" status: 200 len: 1497 microversion: 2.1 time: 0.223890 Oct 23 01:24:14.924436 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1744/3508] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:14 2022] GET /compute/v2.1/servers/9950e3c9-688e-405c-b1df-9a07f65f7dcf => generated 1497 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:24:14.952295 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d88d4bd0-3777-42dd-8166-4ba9af812385 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:14.955705 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=3,nova_api:INSERT=7 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:14.969721 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.compute.server_groups [None req-d88d4bd0-3777-42dd-8166-4ba9af812385 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Querying cell 8efa99f7-1ff1-40c2-a97e-acbc153fb79d(cell1) for 1 instances {{(pid=120944) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 23 01:24:14.971451 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d88d4bd0-3777-42dd-8166-4ba9af812385 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:14.972149 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d88d4bd0-3777-42dd-8166-4ba9af812385 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:14.972819 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d88d4bd0-3777-42dd-8166-4ba9af812385 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:15.001689 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d88d4bd0-3777-42dd-8166-4ba9af812385 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] 10.222.0.42 "GET /compute/v2.1/os-server-groups/bdd09618-574b-473d-8736-d98d05a72605" status: 200 len: 222 microversion: 2.1 time: 0.053684 Oct 23 01:24:15.002653 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1765/3509] 10.222.0.42 () {58 vars in 1263 bytes} [Sun Oct 23 01:24:14 2022] GET /compute/v2.1/os-server-groups/bdd09618-574b-473d-8736-d98d05a72605 => generated 222 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:24:15.022593 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c6c6d618-1d22-49d8-bd61-56ebc80ac308 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:15.025264 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c6c6d618-1d22-49d8-bd61-56ebc80ac308 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] [instance: 9950e3c9-688e-405c-b1df-9a07f65f7dcf] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:15.038560 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6c6d618-1d22-49d8-bd61-56ebc80ac308 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:15.039492 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6c6d618-1d22-49d8-bd61-56ebc80ac308 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:15.040200 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6c6d618-1d22-49d8-bd61-56ebc80ac308 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:15.041182 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6c6d618-1d22-49d8-bd61-56ebc80ac308 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:15.042664 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6c6d618-1d22-49d8-bd61-56ebc80ac308 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:15.043644 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6c6d618-1d22-49d8-bd61-56ebc80ac308 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:15.076079 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c6c6d618-1d22-49d8-bd61-56ebc80ac308 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] [instance: 9950e3c9-688e-405c-b1df-9a07f65f7dcf] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:24:15.449607 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c6c6d618-1d22-49d8-bd61-56ebc80ac308 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9950e3c9-688e-405c-b1df-9a07f65f7dcf" status: 204 len: 0 microversion: 2.1 time: 0.432439 Oct 23 01:24:15.449607 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1745/3510] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:24:15 2022] DELETE /compute/v2.1/servers/9950e3c9-688e-405c-b1df-9a07f65f7dcf => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:24:15.453163 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a1c63b3f-cc59-40ac-b058-dcf9ed2da0bc tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:15.453876 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a1c63b3f-cc59-40ac-b058-dcf9ed2da0bc tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] [instance: 9950e3c9-688e-405c-b1df-9a07f65f7dcf] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:15.461603 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a1c63b3f-cc59-40ac-b058-dcf9ed2da0bc tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:15.462252 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a1c63b3f-cc59-40ac-b058-dcf9ed2da0bc tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:15.462944 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a1c63b3f-cc59-40ac-b058-dcf9ed2da0bc tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:15.463941 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a1c63b3f-cc59-40ac-b058-dcf9ed2da0bc tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:15.464596 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a1c63b3f-cc59-40ac-b058-dcf9ed2da0bc tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:15.465093 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a1c63b3f-cc59-40ac-b058-dcf9ed2da0bc tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:15.622188 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a1c63b3f-cc59-40ac-b058-dcf9ed2da0bc tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418a4c6848204bea8eadb505ccb9c04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4308ac3d1dbe4e798f6650316f479826', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:15.633094 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a1c63b3f-cc59-40ac-b058-dcf9ed2da0bc tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] 10.222.0.42 "GET /compute/v2.1/servers/9950e3c9-688e-405c-b1df-9a07f65f7dcf" status: 200 len: 1503 microversion: 2.1 time: 0.182481 Oct 23 01:24:15.634186 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1766/3511] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:15 2022] GET /compute/v2.1/servers/9950e3c9-688e-405c-b1df-9a07f65f7dcf => generated 1503 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:15.759936 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-297d91e0-46c4-4793-8760-1b29811fd260 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Action: 'create', calling method: .version_select at 0x7f5cc16f1ee0>, body: {"keypair": {"name": "tempest-keypair-2022753251", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRKUm/VgEnU71B/v326ChCOGJ/qK5jRkQWXd8tNBf5/TLW79LH0NHSFgcuYSjt9YkH5nIQR6gP4a4PwgfeunHimizoc3aUbQX6WfKmuKaXrbGk7/1OvUOhfR2CUAHwXcg=="}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:24:15.779647 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-297d91e0-46c4-4793-8760-1b29811fd260 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Getting quotas for project 4c25b4509ad7457bad4a2e5e0bc59add. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:24:15.786106 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9812f9dc-048b-4c6a-b0c8-bd9393a1170d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:15.786833 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9812f9dc-048b-4c6a-b0c8-bd9393a1170d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] [instance: 7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:15.797208 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9812f9dc-048b-4c6a-b0c8-bd9393a1170d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:15.799020 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9812f9dc-048b-4c6a-b0c8-bd9393a1170d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:15.802554 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-297d91e0-46c4-4793-8760-1b29811fd260 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Getting quotas for user 19bff9f7a4254110b3b89f0cba5d252f and project 4c25b4509ad7457bad4a2e5e0bc59add. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:24:15.802780 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9812f9dc-048b-4c6a-b0c8-bd9393a1170d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:15.804032 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9812f9dc-048b-4c6a-b0c8-bd9393a1170d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:15.804664 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9812f9dc-048b-4c6a-b0c8-bd9393a1170d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:15.805272 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9812f9dc-048b-4c6a-b0c8-bd9393a1170d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:15.893169 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9812f9dc-048b-4c6a-b0c8-bd9393a1170d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8a867611614ea585d510d62c63cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9f6afbdbf74318a98dfe455a72ac7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:15.902065 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-297d91e0-46c4-4793-8760-1b29811fd260 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.147038 Oct 23 01:24:15.903406 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1746/3512] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 01:24:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:24:15.903816 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9812f9dc-048b-4c6a-b0c8-bd9393a1170d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "GET /compute/v2.1/servers/7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3" status: 200 len: 1273 microversion: 2.1 time: 0.121999 Oct 23 01:24:15.904681 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1767/3513] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:15 2022] GET /compute/v2.1/servers/7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3 => generated 1273 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:16.662455 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-eb8d8813-5d0c-4d79-979b-569aaf83ba96 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:16.662455 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-eb8d8813-5d0c-4d79-979b-569aaf83ba96 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] [instance: 9950e3c9-688e-405c-b1df-9a07f65f7dcf] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:16.664873 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eb8d8813-5d0c-4d79-979b-569aaf83ba96 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:16.665570 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eb8d8813-5d0c-4d79-979b-569aaf83ba96 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:16.666240 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eb8d8813-5d0c-4d79-979b-569aaf83ba96 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:16.667070 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eb8d8813-5d0c-4d79-979b-569aaf83ba96 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:16.667754 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eb8d8813-5d0c-4d79-979b-569aaf83ba96 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:16.668278 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eb8d8813-5d0c-4d79-979b-569aaf83ba96 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:16.834619 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-eb8d8813-5d0c-4d79-979b-569aaf83ba96 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418a4c6848204bea8eadb505ccb9c04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4308ac3d1dbe4e798f6650316f479826', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:16.843065 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-eb8d8813-5d0c-4d79-979b-569aaf83ba96 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] 10.222.0.42 "GET /compute/v2.1/servers/9950e3c9-688e-405c-b1df-9a07f65f7dcf" status: 200 len: 1503 microversion: 2.1 time: 0.190082 Oct 23 01:24:16.847767 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1747/3514] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:16 2022] GET /compute/v2.1/servers/9950e3c9-688e-405c-b1df-9a07f65f7dcf => generated 1503 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:16.938321 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b0e8cc0b-e49b-4559-bf65-f38d505fd58c tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:16.939099 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b0e8cc0b-e49b-4559-bf65-f38d505fd58c tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] [instance: 7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:16.948246 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b0e8cc0b-e49b-4559-bf65-f38d505fd58c tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:16.961833 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b0e8cc0b-e49b-4559-bf65-f38d505fd58c tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:16.961833 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b0e8cc0b-e49b-4559-bf65-f38d505fd58c tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:16.961833 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b0e8cc0b-e49b-4559-bf65-f38d505fd58c tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:16.961833 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b0e8cc0b-e49b-4559-bf65-f38d505fd58c tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:16.961833 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b0e8cc0b-e49b-4559-bf65-f38d505fd58c tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:17.173688 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b0e8cc0b-e49b-4559-bf65-f38d505fd58c tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8a867611614ea585d510d62c63cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9f6afbdbf74318a98dfe455a72ac7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:17.190954 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b0e8cc0b-e49b-4559-bf65-f38d505fd58c tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "GET /compute/v2.1/servers/7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3" status: 200 len: 1315 microversion: 2.1 time: 0.256922 Oct 23 01:24:17.191829 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1768/3515] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:16 2022] GET /compute/v2.1/servers/7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3 => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:17.868417 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-488e6ea0-6de8-421d-b0e6-c783aa0be587 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:17.871402 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-488e6ea0-6de8-421d-b0e6-c783aa0be587 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] [instance: 9950e3c9-688e-405c-b1df-9a07f65f7dcf] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:17.876543 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-488e6ea0-6de8-421d-b0e6-c783aa0be587 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:17.877030 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-488e6ea0-6de8-421d-b0e6-c783aa0be587 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:17.877459 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-488e6ea0-6de8-421d-b0e6-c783aa0be587 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:17.878188 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-488e6ea0-6de8-421d-b0e6-c783aa0be587 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:17.878698 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-488e6ea0-6de8-421d-b0e6-c783aa0be587 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:17.879166 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-488e6ea0-6de8-421d-b0e6-c783aa0be587 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:18.039554 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-51ad5e35-7d08-4074-8d57-2f1b50029925 req-cf15fdc6-a1eb-4727-aac4-3007c9be1563 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3", "tag": "8adc3934-5630-470e-a6f0-e96f18681270"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:24:18.054825 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-51ad5e35-7d08-4074-8d57-2f1b50029925 req-cf15fdc6-a1eb-4727-aac4-3007c9be1563 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:18.055418 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-51ad5e35-7d08-4074-8d57-2f1b50029925 req-cf15fdc6-a1eb-4727-aac4-3007c9be1563 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:18.056326 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-51ad5e35-7d08-4074-8d57-2f1b50029925 req-cf15fdc6-a1eb-4727-aac4-3007c9be1563 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:18.069895 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-51ad5e35-7d08-4074-8d57-2f1b50029925 req-cf15fdc6-a1eb-4727-aac4-3007c9be1563 service nova] Creating event network-changed:8adc3934-5630-470e-a6f0-e96f18681270 for instance 7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3 on n-h1-master-1 Oct 23 01:24:18.087888 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-51ad5e35-7d08-4074-8d57-2f1b50029925 req-cf15fdc6-a1eb-4727-aac4-3007c9be1563 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054384 Oct 23 01:24:18.089647 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1769/3516] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:24:18.129258 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-488e6ea0-6de8-421d-b0e6-c783aa0be587 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418a4c6848204bea8eadb505ccb9c04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4308ac3d1dbe4e798f6650316f479826', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:18.138167 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-488e6ea0-6de8-421d-b0e6-c783aa0be587 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] 10.222.0.42 "GET /compute/v2.1/servers/9950e3c9-688e-405c-b1df-9a07f65f7dcf" status: 200 len: 1503 microversion: 2.1 time: 0.275336 Oct 23 01:24:18.149675 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1748/3517] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:17 2022] GET /compute/v2.1/servers/9950e3c9-688e-405c-b1df-9a07f65f7dcf => generated 1503 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:18.219369 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c06db07f-4a95-453c-9a66-367046b92fe0 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:18.220323 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c06db07f-4a95-453c-9a66-367046b92fe0 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] [instance: 7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:18.227454 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c06db07f-4a95-453c-9a66-367046b92fe0 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:18.228233 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c06db07f-4a95-453c-9a66-367046b92fe0 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:18.228907 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c06db07f-4a95-453c-9a66-367046b92fe0 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:18.229904 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c06db07f-4a95-453c-9a66-367046b92fe0 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:18.230563 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c06db07f-4a95-453c-9a66-367046b92fe0 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:18.231028 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c06db07f-4a95-453c-9a66-367046b92fe0 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:18.403202 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c06db07f-4a95-453c-9a66-367046b92fe0 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8a867611614ea585d510d62c63cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9f6afbdbf74318a98dfe455a72ac7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:18.418014 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c06db07f-4a95-453c-9a66-367046b92fe0 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "GET /compute/v2.1/servers/7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3" status: 200 len: 1315 microversion: 2.1 time: 0.204361 Oct 23 01:24:18.431548 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1770/3518] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:18 2022] GET /compute/v2.1/servers/7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:19.163741 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3a5176ce-a5d3-44ca-9991-6bf318be2ef8 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:19.164365 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3a5176ce-a5d3-44ca-9991-6bf318be2ef8 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] [instance: 9950e3c9-688e-405c-b1df-9a07f65f7dcf] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:19.181919 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3a5176ce-a5d3-44ca-9991-6bf318be2ef8 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:19.182475 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3a5176ce-a5d3-44ca-9991-6bf318be2ef8 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:19.182954 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3a5176ce-a5d3-44ca-9991-6bf318be2ef8 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:19.183775 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3a5176ce-a5d3-44ca-9991-6bf318be2ef8 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:19.184231 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3a5176ce-a5d3-44ca-9991-6bf318be2ef8 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:19.184653 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3a5176ce-a5d3-44ca-9991-6bf318be2ef8 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:19.217527 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3a5176ce-a5d3-44ca-9991-6bf318be2ef8 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:19.218035 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3a5176ce-a5d3-44ca-9991-6bf318be2ef8 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:19.220570 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3a5176ce-a5d3-44ca-9991-6bf318be2ef8 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:19.220570 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-3a5176ce-a5d3-44ca-9991-6bf318be2ef8 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lazy-loading 'fault' on Instance uuid 9950e3c9-688e-405c-b1df-9a07f65f7dcf {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:24:19.264430 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3a5176ce-a5d3-44ca-9991-6bf318be2ef8 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418a4c6848204bea8eadb505ccb9c04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4308ac3d1dbe4e798f6650316f479826', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:19.266825 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:19.274164 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3a5176ce-a5d3-44ca-9991-6bf318be2ef8 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] 10.222.0.42 "GET /compute/v2.1/servers/9950e3c9-688e-405c-b1df-9a07f65f7dcf" status: 200 len: 1303 microversion: 2.1 time: 0.114770 Oct 23 01:24:19.278160 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1749/3519] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:19 2022] GET /compute/v2.1/servers/9950e3c9-688e-405c-b1df-9a07f65f7dcf => generated 1303 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:19.357661 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-37568c28-ec12-467c-baa7-4f64906c29f5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-589828501", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5e0c2166-5c86-44c0-95de-006225def5a5"}], "security_groups": [{"name": "tempest-securitygroup--1102276471"}], "key_name": "tempest-keypair-2022753251", "user_data": "}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:24:19.444843 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-620bc64e-b597-48b1-8598-b81dafdb9195 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:19.445922 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-620bc64e-b597-48b1-8598-b81dafdb9195 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] [instance: 7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:19.454511 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-620bc64e-b597-48b1-8598-b81dafdb9195 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:19.460605 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-620bc64e-b597-48b1-8598-b81dafdb9195 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:19.461127 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-620bc64e-b597-48b1-8598-b81dafdb9195 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:19.463285 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-620bc64e-b597-48b1-8598-b81dafdb9195 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:19.463285 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-620bc64e-b597-48b1-8598-b81dafdb9195 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:19.463285 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-620bc64e-b597-48b1-8598-b81dafdb9195 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:19.479077 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-37568c28-ec12-467c-baa7-4f64906c29f5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] validate_networks() for [('5e0c2166-5c86-44c0-95de-006225def5a5', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:24:19.708146 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-620bc64e-b597-48b1-8598-b81dafdb9195 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8a867611614ea585d510d62c63cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9f6afbdbf74318a98dfe455a72ac7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:19.715640 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-620bc64e-b597-48b1-8598-b81dafdb9195 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "GET /compute/v2.1/servers/7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3" status: 200 len: 1315 microversion: 2.1 time: 0.274935 Oct 23 01:24:19.716206 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1750/3520] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:19 2022] GET /compute/v2.1/servers/7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3 => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:19.720761 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4844bad9-dfe6-44ba-9639-fffe766d5f83 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:24:19.727175 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4844bad9-dfe6-44ba-9639-fffe766d5f83 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:19.727655 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4844bad9-dfe6-44ba-9639-fffe766d5f83 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:19.740315 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4844bad9-dfe6-44ba-9639-fffe766d5f83 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:19.797262 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4844bad9-dfe6-44ba-9639-fffe766d5f83 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Going to try to stop instance {{(pid=120945) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 23 01:24:19.968213 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-37568c28-ec12-467c-baa7-4f64906c29f5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:24:19.968679 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-37568c28-ec12-467c-baa7-4f64906c29f5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:24:19.969188 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-37568c28-ec12-467c-baa7-4f64906c29f5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:24:19.969620 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-37568c28-ec12-467c-baa7-4f64906c29f5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:24:19.970055 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-37568c28-ec12-467c-baa7-4f64906c29f5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:24:19.978164 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4844bad9-dfe6-44ba-9639-fffe766d5f83 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "POST /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca/action" status: 202 len: 0 microversion: 2.1 time: 0.260592 Oct 23 01:24:19.978914 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1751/3521] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:24:19 2022] POST /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:24:19.980987 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-37568c28-ec12-467c-baa7-4f64906c29f5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:19.981467 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-37568c28-ec12-467c-baa7-4f64906c29f5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:19.982048 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-37568c28-ec12-467c-baa7-4f64906c29f5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:19.982785 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-37568c28-ec12-467c-baa7-4f64906c29f5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:19.983244 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-37568c28-ec12-467c-baa7-4f64906c29f5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:19.983747 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-37568c28-ec12-467c-baa7-4f64906c29f5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:19.987590 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b9b3f276-ff9e-4f79-aad5-114394f16953 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:19.988579 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b9b3f276-ff9e-4f79-aad5-114394f16953 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:19.995268 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9b3f276-ff9e-4f79-aad5-114394f16953 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:19.996041 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9b3f276-ff9e-4f79-aad5-114394f16953 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:19.996604 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9b3f276-ff9e-4f79-aad5-114394f16953 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:19.997385 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9b3f276-ff9e-4f79-aad5-114394f16953 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:19.997910 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9b3f276-ff9e-4f79-aad5-114394f16953 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:19.998523 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9b3f276-ff9e-4f79-aad5-114394f16953 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:20.002931 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-37568c28-ec12-467c-baa7-4f64906c29f5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Getting quotas for project 4c25b4509ad7457bad4a2e5e0bc59add. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:24:20.010213 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-37568c28-ec12-467c-baa7-4f64906c29f5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Getting quotas for user 19bff9f7a4254110b3b89f0cba5d252f and project 4c25b4509ad7457bad4a2e5e0bc59add. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:24:20.026065 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-37568c28-ec12-467c-baa7-4f64906c29f5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:24:20.028403 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-37568c28-ec12-467c-baa7-4f64906c29f5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:24:20.149220 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b9b3f276-ff9e-4f79-aad5-114394f16953 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:20.157664 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b9b3f276-ff9e-4f79-aad5-114394f16953 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1725 microversion: 2.1 time: 0.174261 Oct 23 01:24:20.174215 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1752/3522] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:19 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:24:20.174215 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-5cc321a7-e852-4139-b149-944f37e1c1f8 req-e77e2b05-5499-4477-a254-962103646b70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9950e3c9-688e-405c-b1df-9a07f65f7dcf", "name": "network-vif-deleted", "tag": "bbf8f67f-9c0c-45aa-bdd4-adb8c1656a3c"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:24:20.174215 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-5cc321a7-e852-4139-b149-944f37e1c1f8 req-e77e2b05-5499-4477-a254-962103646b70 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:20.174215 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-5cc321a7-e852-4139-b149-944f37e1c1f8 req-e77e2b05-5499-4477-a254-962103646b70 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:20.174215 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-5cc321a7-e852-4139-b149-944f37e1c1f8 req-e77e2b05-5499-4477-a254-962103646b70 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:20.192276 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-5cc321a7-e852-4139-b149-944f37e1c1f8 req-e77e2b05-5499-4477-a254-962103646b70 service nova] Creating event network-vif-deleted:bbf8f67f-9c0c-45aa-bdd4-adb8c1656a3c for instance 9950e3c9-688e-405c-b1df-9a07f65f7dcf on n-h2-master-1 Oct 23 01:24:20.197405 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-5cc321a7-e852-4139-b149-944f37e1c1f8 req-e77e2b05-5499-4477-a254-962103646b70 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037753 Oct 23 01:24:20.198032 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1753/3523] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:24:20.232123 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-37568c28-ec12-467c-baa7-4f64906c29f5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.879585 Oct 23 01:24:20.232907 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1771/3524] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:24:19 2022] POST /compute/v2.1/servers => generated 409 bytes in 881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:24:20.248041 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f8c6d502-dfc2-4f93-a2d0-ea331a30a98a tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:20.248845 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f8c6d502-dfc2-4f93-a2d0-ea331a30a98a tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:20.308742 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dfcad953-457d-4b91-b8d7-a29ed0cf9c69 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:20.309501 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-dfcad953-457d-4b91-b8d7-a29ed0cf9c69 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] [instance: 9950e3c9-688e-405c-b1df-9a07f65f7dcf] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:20.320910 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f8c6d502-dfc2-4f93-a2d0-ea331a30a98a tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:20.326361 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dfcad953-457d-4b91-b8d7-a29ed0cf9c69 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:20.327178 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dfcad953-457d-4b91-b8d7-a29ed0cf9c69 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:20.327787 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dfcad953-457d-4b91-b8d7-a29ed0cf9c69 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:20.328537 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dfcad953-457d-4b91-b8d7-a29ed0cf9c69 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:20.329014 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dfcad953-457d-4b91-b8d7-a29ed0cf9c69 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:20.329451 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dfcad953-457d-4b91-b8d7-a29ed0cf9c69 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:20.332581 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f8c6d502-dfc2-4f93-a2d0-ea331a30a98a tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4" status: 200 len: 1245 microversion: 2.1 time: 0.090563 Oct 23 01:24:20.333440 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1754/3525] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:20 2022] GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4 => generated 1245 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:24:20.368018 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dfcad953-457d-4b91-b8d7-a29ed0cf9c69 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:20.368527 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dfcad953-457d-4b91-b8d7-a29ed0cf9c69 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:20.368932 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dfcad953-457d-4b91-b8d7-a29ed0cf9c69 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:20.369386 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-dfcad953-457d-4b91-b8d7-a29ed0cf9c69 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lazy-loading 'fault' on Instance uuid 9950e3c9-688e-405c-b1df-9a07f65f7dcf {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:24:20.411257 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-dfcad953-457d-4b91-b8d7-a29ed0cf9c69 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418a4c6848204bea8eadb505ccb9c04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4308ac3d1dbe4e798f6650316f479826', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:20.419239 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-dfcad953-457d-4b91-b8d7-a29ed0cf9c69 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] 10.222.0.42 "GET /compute/v2.1/servers/9950e3c9-688e-405c-b1df-9a07f65f7dcf" status: 200 len: 1303 microversion: 2.1 time: 0.121933 Oct 23 01:24:20.419813 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1772/3526] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:20 2022] GET /compute/v2.1/servers/9950e3c9-688e-405c-b1df-9a07f65f7dcf => generated 1303 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:24:20.739036 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-dc413964-0e93-4de7-bc82-e8819a9007dd tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:20.739720 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-dc413964-0e93-4de7-bc82-e8819a9007dd tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] [instance: 7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:20.747506 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dc413964-0e93-4de7-bc82-e8819a9007dd tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:20.747988 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dc413964-0e93-4de7-bc82-e8819a9007dd tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:20.748419 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dc413964-0e93-4de7-bc82-e8819a9007dd tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:20.749109 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dc413964-0e93-4de7-bc82-e8819a9007dd tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:20.749655 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dc413964-0e93-4de7-bc82-e8819a9007dd tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:20.750208 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dc413964-0e93-4de7-bc82-e8819a9007dd tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:20.903337 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-dc413964-0e93-4de7-bc82-e8819a9007dd tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8a867611614ea585d510d62c63cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9f6afbdbf74318a98dfe455a72ac7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:20.911511 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-dc413964-0e93-4de7-bc82-e8819a9007dd tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "GET /compute/v2.1/servers/7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3" status: 200 len: 1315 microversion: 2.1 time: 0.177253 Oct 23 01:24:20.918199 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1755/3527] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:20 2022] GET /compute/v2.1/servers/7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:21.184725 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ecae8ca1-0b03-4225-bafd-6de16c8bf0ed tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:21.185341 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ecae8ca1-0b03-4225-bafd-6de16c8bf0ed tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:21.191423 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ecae8ca1-0b03-4225-bafd-6de16c8bf0ed tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:21.191919 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ecae8ca1-0b03-4225-bafd-6de16c8bf0ed tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:21.192353 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ecae8ca1-0b03-4225-bafd-6de16c8bf0ed tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:21.193043 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ecae8ca1-0b03-4225-bafd-6de16c8bf0ed tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:21.193494 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ecae8ca1-0b03-4225-bafd-6de16c8bf0ed tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:21.193917 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ecae8ca1-0b03-4225-bafd-6de16c8bf0ed tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:21.334937 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ecae8ca1-0b03-4225-bafd-6de16c8bf0ed tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:21.343171 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ecae8ca1-0b03-4225-bafd-6de16c8bf0ed tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1725 microversion: 2.1 time: 0.162388 Oct 23 01:24:21.343746 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1773/3528] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:21 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:21.355518 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-dbd0b400-29d3-4c25-a383-0836ad2c7576 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:21.356364 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-dbd0b400-29d3-4c25-a383-0836ad2c7576 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:21.363297 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dbd0b400-29d3-4c25-a383-0836ad2c7576 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:21.363773 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dbd0b400-29d3-4c25-a383-0836ad2c7576 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:21.365144 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dbd0b400-29d3-4c25-a383-0836ad2c7576 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:21.365144 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dbd0b400-29d3-4c25-a383-0836ad2c7576 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:21.365413 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dbd0b400-29d3-4c25-a383-0836ad2c7576 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:21.365754 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dbd0b400-29d3-4c25-a383-0836ad2c7576 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:21.431815 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-dbd0b400-29d3-4c25-a383-0836ad2c7576 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:21.440418 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-dbd0b400-29d3-4c25-a383-0836ad2c7576 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4" status: 200 len: 1249 microversion: 2.1 time: 0.088830 Oct 23 01:24:21.441096 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1756/3529] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:21 2022] GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4 => generated 1249 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:21.444648 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d0748f96-74de-4b4a-84fd-4a3fb548ddcd tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:21.445290 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d0748f96-74de-4b4a-84fd-4a3fb548ddcd tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] [instance: 9950e3c9-688e-405c-b1df-9a07f65f7dcf] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:21.453263 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d0748f96-74de-4b4a-84fd-4a3fb548ddcd tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:21.453762 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d0748f96-74de-4b4a-84fd-4a3fb548ddcd tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:21.460046 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d0748f96-74de-4b4a-84fd-4a3fb548ddcd tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:21.460046 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d0748f96-74de-4b4a-84fd-4a3fb548ddcd tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:21.460046 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d0748f96-74de-4b4a-84fd-4a3fb548ddcd tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:21.460046 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d0748f96-74de-4b4a-84fd-4a3fb548ddcd tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-d0748f96-74de-4b4a-84fd-4a3fb548ddcd tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] HTTP exception thrown: Instance 9950e3c9-688e-405c-b1df-9a07f65f7dcf could not be found. Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d0748f96-74de-4b4a-84fd-4a3fb548ddcd tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Request method failure captured: Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/9950e3c9-688e-405c-b1df-9a07f65f7dcf HTTP/1.1 Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJerANgR_BHTvCcIfVn4Sdg40K-CqAail70_fo3camktEGP1OLlCwXGvy9ISR5L6IxuBuJ-9RpLc-YgWBhhAHcmvjHcdisV5mBVGsymhJhNNxEkwVLNOmgJJuQqW_k3JicK0LbwCmK_tBGhl1PxK8rhicmG8fkR44yQIgg8Ir-gZ9N8 Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 4308ac3d1dbe4e798f6650316f479826 Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServerGroupTestJSON-1241656537 Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4308ac3d1dbe4e798f6650316f479826"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4308ac3d1dbe4e798f6650316f479826"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4308ac3d1dbe4e798f6650316f479826"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4308ac3d1dbe4e798f6650316f479826"}]}] Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServerGroupTestJSON-1241656537 Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 4308ac3d1dbe4e798f6650316f479826 Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServerGroupTestJSON-1241656537 Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServerGroupTestJSON-1241656537-project Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 418a4c6848204bea8eadb505ccb9c04e Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServerGroupTestJSON-1241656537-project Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 9950e3c9-688e-405c-b1df-9a07f65f7dcf could not be found. Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '9950e3c9-688e-405c-b1df-9a07f65f7dcf'} Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9950e3c9-688e-405c-b1df-9a07f65f7dcf could not be found. Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:24:21.489002 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:24:21.494609 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9950e3c9-688e-405c-b1df-9a07f65f7dcf could not be found. Oct 23 01:24:21.494609 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:24:21.494609 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:24:21.494609 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:24:21.494609 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:24:21.494609 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:24:21.494609 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:24:21.494609 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:24:21.494609 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:24:21.494609 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9950e3c9-688e-405c-b1df-9a07f65f7dcf could not be found. Oct 23 01:24:21.494609 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:24:21.494609 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d0748f96-74de-4b4a-84fd-4a3fb548ddcd tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Returning 404 to user: Instance 9950e3c9-688e-405c-b1df-9a07f65f7dcf could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:24:21.494609 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d0748f96-74de-4b4a-84fd-4a3fb548ddcd tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] 10.222.0.42 "GET /compute/v2.1/servers/9950e3c9-688e-405c-b1df-9a07f65f7dcf" status: 404 len: 111 microversion: 2.1 time: 0.042262 Oct 23 01:24:21.494609 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1774/3530] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:21 2022] GET /compute/v2.1/servers/9950e3c9-688e-405c-b1df-9a07f65f7dcf => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 01:24:21.500982 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8c42ed15-90db-44c4-a4a1-7e272376549b tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:21.518689 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.compute.server_groups [None req-8c42ed15-90db-44c4-a4a1-7e272376549b tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Querying cell 8efa99f7-1ff1-40c2-a97e-acbc153fb79d(cell1) for 1 instances {{(pid=120945) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 23 01:24:21.519394 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8c42ed15-90db-44c4-a4a1-7e272376549b tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:21.520526 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8c42ed15-90db-44c4-a4a1-7e272376549b tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:21.520954 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8c42ed15-90db-44c4-a4a1-7e272376549b tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:21.542662 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8c42ed15-90db-44c4-a4a1-7e272376549b tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] 10.222.0.42 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.045389 Oct 23 01:24:21.543243 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1757/3531] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Oct 23 01:24:21 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:24:21.555360 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a1b16d97-85c1-4d76-a15e-8e3c68508605 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:21.569044 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.compute.server_groups [None req-a1b16d97-85c1-4d76-a15e-8e3c68508605 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Querying cell 8efa99f7-1ff1-40c2-a97e-acbc153fb79d(cell1) for 1 instances {{(pid=120944) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 23 01:24:21.569765 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a1b16d97-85c1-4d76-a15e-8e3c68508605 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:21.570267 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a1b16d97-85c1-4d76-a15e-8e3c68508605 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:21.570698 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a1b16d97-85c1-4d76-a15e-8e3c68508605 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:21.580813 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a1b16d97-85c1-4d76-a15e-8e3c68508605 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] 10.222.0.42 "GET /compute/v2.1/os-server-groups/bdd09618-574b-473d-8736-d98d05a72605" status: 200 len: 184 microversion: 2.1 time: 0.029564 Oct 23 01:24:21.581365 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1775/3532] 10.222.0.42 () {58 vars in 1263 bytes} [Sun Oct 23 01:24:21 2022] GET /compute/v2.1/os-server-groups/bdd09618-574b-473d-8736-d98d05a72605 => generated 184 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:24:21.593740 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c3de3909-896a-4c1c-b3ce-0fbb0776e73b tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:21.594268 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c3de3909-896a-4c1c-b3ce-0fbb0776e73b tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] [instance: 9950e3c9-688e-405c-b1df-9a07f65f7dcf] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:21.600441 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c3de3909-896a-4c1c-b3ce-0fbb0776e73b tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:21.600933 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c3de3909-896a-4c1c-b3ce-0fbb0776e73b tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:21.601374 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c3de3909-896a-4c1c-b3ce-0fbb0776e73b tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:21.602120 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c3de3909-896a-4c1c-b3ce-0fbb0776e73b tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:21.602588 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c3de3909-896a-4c1c-b3ce-0fbb0776e73b tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:21.603035 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c3de3909-896a-4c1c-b3ce-0fbb0776e73b tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:21.617573 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-c3de3909-896a-4c1c-b3ce-0fbb0776e73b tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] HTTP exception thrown: Instance 9950e3c9-688e-405c-b1df-9a07f65f7dcf could not be found. Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c3de3909-896a-4c1c-b3ce-0fbb0776e73b tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Request method failure captured: Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/servers/9950e3c9-688e-405c-b1df-9a07f65f7dcf HTTP/1.1 Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJerANgR_BHTvCcIfVn4Sdg40K-CqAail70_fo3camktEGP1OLlCwXGvy9ISR5L6IxuBuJ-9RpLc-YgWBhhAHcmvjHcdisV5mBVGsymhJhNNxEkwVLNOmgJJuQqW_k3JicK0LbwCmK_tBGhl1PxK8rhicmG8fkR44yQIgg8Ir-gZ9N8 Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 4308ac3d1dbe4e798f6650316f479826 Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServerGroupTestJSON-1241656537 Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4308ac3d1dbe4e798f6650316f479826"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4308ac3d1dbe4e798f6650316f479826"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4308ac3d1dbe4e798f6650316f479826"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4308ac3d1dbe4e798f6650316f479826"}]}] Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServerGroupTestJSON-1241656537 Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 4308ac3d1dbe4e798f6650316f479826 Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServerGroupTestJSON-1241656537 Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServerGroupTestJSON-1241656537-project Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 418a4c6848204bea8eadb505ccb9c04e Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServerGroupTestJSON-1241656537-project Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 9950e3c9-688e-405c-b1df-9a07f65f7dcf could not be found. Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '9950e3c9-688e-405c-b1df-9a07f65f7dcf'} Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9950e3c9-688e-405c-b1df-9a07f65f7dcf could not be found. Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:24:21.619328 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:24:21.623926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9950e3c9-688e-405c-b1df-9a07f65f7dcf could not be found. Oct 23 01:24:21.623926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:24:21.623926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:24:21.623926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:24:21.623926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:24:21.623926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:24:21.623926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:24:21.623926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:24:21.623926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:24:21.623926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9950e3c9-688e-405c-b1df-9a07f65f7dcf could not be found. Oct 23 01:24:21.623926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:24:21.623926 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c3de3909-896a-4c1c-b3ce-0fbb0776e73b tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Returning 404 to user: Instance 9950e3c9-688e-405c-b1df-9a07f65f7dcf could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:24:21.623926 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c3de3909-896a-4c1c-b3ce-0fbb0776e73b tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9950e3c9-688e-405c-b1df-9a07f65f7dcf" status: 404 len: 111 microversion: 2.1 time: 0.031261 Oct 23 01:24:21.623926 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1758/3533] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:24:21 2022] DELETE /compute/v2.1/servers/9950e3c9-688e-405c-b1df-9a07f65f7dcf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:24:21.630012 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-70a0b33f-183f-4815-bdef-36a8e8ed2268 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:21.630639 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-70a0b33f-183f-4815-bdef-36a8e8ed2268 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] [instance: 9950e3c9-688e-405c-b1df-9a07f65f7dcf] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:21.636678 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-70a0b33f-183f-4815-bdef-36a8e8ed2268 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:21.637378 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-70a0b33f-183f-4815-bdef-36a8e8ed2268 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:21.638006 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-70a0b33f-183f-4815-bdef-36a8e8ed2268 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:21.638871 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-70a0b33f-183f-4815-bdef-36a8e8ed2268 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:21.639495 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-70a0b33f-183f-4815-bdef-36a8e8ed2268 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:21.640164 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-70a0b33f-183f-4815-bdef-36a8e8ed2268 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:21.655797 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-70a0b33f-183f-4815-bdef-36a8e8ed2268 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] HTTP exception thrown: Instance 9950e3c9-688e-405c-b1df-9a07f65f7dcf could not be found. Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-70a0b33f-183f-4815-bdef-36a8e8ed2268 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Request method failure captured: Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/9950e3c9-688e-405c-b1df-9a07f65f7dcf HTTP/1.1 Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJerANgR_BHTvCcIfVn4Sdg40K-CqAail70_fo3camktEGP1OLlCwXGvy9ISR5L6IxuBuJ-9RpLc-YgWBhhAHcmvjHcdisV5mBVGsymhJhNNxEkwVLNOmgJJuQqW_k3JicK0LbwCmK_tBGhl1PxK8rhicmG8fkR44yQIgg8Ir-gZ9N8 Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 4308ac3d1dbe4e798f6650316f479826 Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServerGroupTestJSON-1241656537 Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4308ac3d1dbe4e798f6650316f479826"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4308ac3d1dbe4e798f6650316f479826"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4308ac3d1dbe4e798f6650316f479826"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4308ac3d1dbe4e798f6650316f479826"}]}] Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServerGroupTestJSON-1241656537 Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 4308ac3d1dbe4e798f6650316f479826 Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServerGroupTestJSON-1241656537 Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServerGroupTestJSON-1241656537-project Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 418a4c6848204bea8eadb505ccb9c04e Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServerGroupTestJSON-1241656537-project Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 9950e3c9-688e-405c-b1df-9a07f65f7dcf could not be found. Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '9950e3c9-688e-405c-b1df-9a07f65f7dcf'} Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9950e3c9-688e-405c-b1df-9a07f65f7dcf could not be found. Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9950e3c9-688e-405c-b1df-9a07f65f7dcf could not be found. Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:24:21.656801 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:24:21.664648 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:24:21.664648 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:24:21.664648 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:24:21.664648 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:24:21.664648 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:24:21.664648 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9950e3c9-688e-405c-b1df-9a07f65f7dcf could not be found. Oct 23 01:24:21.664648 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:24:21.664648 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-70a0b33f-183f-4815-bdef-36a8e8ed2268 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Returning 404 to user: Instance 9950e3c9-688e-405c-b1df-9a07f65f7dcf could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:24:21.664648 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-70a0b33f-183f-4815-bdef-36a8e8ed2268 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] 10.222.0.42 "GET /compute/v2.1/servers/9950e3c9-688e-405c-b1df-9a07f65f7dcf" status: 404 len: 111 microversion: 2.1 time: 0.035512 Oct 23 01:24:21.664648 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1776/3534] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:21 2022] GET /compute/v2.1/servers/9950e3c9-688e-405c-b1df-9a07f65f7dcf => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:24:21.673581 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-60677a24-c50a-49be-8ea9-1f019d99cf3e tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:21.680833 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-60677a24-c50a-49be-8ea9-1f019d99cf3e tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] HTTP exception thrown: Instance group 0739ec7b-79d1-4dfd-bacb-44847ce3c3f6 could not be found. Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-60677a24-c50a-49be-8ea9-1f019d99cf3e tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Request method failure captured: Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/os-server-groups/0739ec7b-79d1-4dfd-bacb-44847ce3c3f6 HTTP/1.1 Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJerANgR_BHTvCcIfVn4Sdg40K-CqAail70_fo3camktEGP1OLlCwXGvy9ISR5L6IxuBuJ-9RpLc-YgWBhhAHcmvjHcdisV5mBVGsymhJhNNxEkwVLNOmgJJuQqW_k3JicK0LbwCmK_tBGhl1PxK8rhicmG8fkR44yQIgg8Ir-gZ9N8 Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 4308ac3d1dbe4e798f6650316f479826 Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServerGroupTestJSON-1241656537 Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4308ac3d1dbe4e798f6650316f479826"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4308ac3d1dbe4e798f6650316f479826"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4308ac3d1dbe4e798f6650316f479826"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4308ac3d1dbe4e798f6650316f479826"}]}] Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServerGroupTestJSON-1241656537 Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 4308ac3d1dbe4e798f6650316f479826 Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServerGroupTestJSON-1241656537 Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServerGroupTestJSON-1241656537-project Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 418a4c6848204bea8eadb505ccb9c04e Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServerGroupTestJSON-1241656537-project Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: exception: Instance group 0739ec7b-79d1-4dfd-bacb-44847ce3c3f6 could not be found. Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '0739ec7b-79d1-4dfd-bacb-44847ce3c3f6'} Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 0739ec7b-79d1-4dfd-bacb-44847ce3c3f6 could not be found. Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 0739ec7b-79d1-4dfd-bacb-44847ce3c3f6 could not be found. Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:24:21.688830 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:24:21.696383 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:24:21.696383 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:24:21.696383 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:24:21.696383 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:24:21.696383 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 0739ec7b-79d1-4dfd-bacb-44847ce3c3f6 could not be found. Oct 23 01:24:21.696383 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:24:21.696383 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-60677a24-c50a-49be-8ea9-1f019d99cf3e tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Returning 404 to user: Instance group 0739ec7b-79d1-4dfd-bacb-44847ce3c3f6 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:24:21.696383 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-60677a24-c50a-49be-8ea9-1f019d99cf3e tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] 10.222.0.42 "DELETE /compute/v2.1/os-server-groups/0739ec7b-79d1-4dfd-bacb-44847ce3c3f6" status: 404 len: 117 microversion: 2.1 time: 0.022454 Oct 23 01:24:21.696383 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1759/3535] 10.222.0.42 () {58 vars in 1266 bytes} [Sun Oct 23 01:24:21 2022] DELETE /compute/v2.1/os-server-groups/0739ec7b-79d1-4dfd-bacb-44847ce3c3f6 => generated 117 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:24:21.701715 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3d7ba74c-de83-4332-b69f-3be06e923f91 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:21.714792 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-3d7ba74c-de83-4332-b69f-3be06e923f91 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] HTTP exception thrown: Instance group 24a2b84e-1d1f-438c-8e14-02f5a7d30c00 could not be found. Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3d7ba74c-de83-4332-b69f-3be06e923f91 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Request method failure captured: Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/os-server-groups/24a2b84e-1d1f-438c-8e14-02f5a7d30c00 HTTP/1.1 Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJerANgR_BHTvCcIfVn4Sdg40K-CqAail70_fo3camktEGP1OLlCwXGvy9ISR5L6IxuBuJ-9RpLc-YgWBhhAHcmvjHcdisV5mBVGsymhJhNNxEkwVLNOmgJJuQqW_k3JicK0LbwCmK_tBGhl1PxK8rhicmG8fkR44yQIgg8Ir-gZ9N8 Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 4308ac3d1dbe4e798f6650316f479826 Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServerGroupTestJSON-1241656537 Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4308ac3d1dbe4e798f6650316f479826"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4308ac3d1dbe4e798f6650316f479826"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4308ac3d1dbe4e798f6650316f479826"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4308ac3d1dbe4e798f6650316f479826"}]}] Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServerGroupTestJSON-1241656537 Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 4308ac3d1dbe4e798f6650316f479826 Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServerGroupTestJSON-1241656537 Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServerGroupTestJSON-1241656537-project Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 418a4c6848204bea8eadb505ccb9c04e Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServerGroupTestJSON-1241656537-project Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: exception: Instance group 24a2b84e-1d1f-438c-8e14-02f5a7d30c00 could not be found. Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '24a2b84e-1d1f-438c-8e14-02f5a7d30c00'} Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 24a2b84e-1d1f-438c-8e14-02f5a7d30c00 could not be found. Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 24a2b84e-1d1f-438c-8e14-02f5a7d30c00 could not be found. Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:24:21.722750 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:24:21.727012 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:24:21.727012 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:24:21.727012 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:24:21.727012 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:24:21.727012 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 24a2b84e-1d1f-438c-8e14-02f5a7d30c00 could not be found. Oct 23 01:24:21.727012 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:24:21.727012 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3d7ba74c-de83-4332-b69f-3be06e923f91 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Returning 404 to user: Instance group 24a2b84e-1d1f-438c-8e14-02f5a7d30c00 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:24:21.727012 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3d7ba74c-de83-4332-b69f-3be06e923f91 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] 10.222.0.42 "DELETE /compute/v2.1/os-server-groups/24a2b84e-1d1f-438c-8e14-02f5a7d30c00" status: 404 len: 117 microversion: 2.1 time: 0.021899 Oct 23 01:24:21.727012 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1777/3536] 10.222.0.42 () {58 vars in 1266 bytes} [Sun Oct 23 01:24:21 2022] DELETE /compute/v2.1/os-server-groups/24a2b84e-1d1f-438c-8e14-02f5a7d30c00 => generated 117 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:24:21.729669 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-10104a7d-070b-4c3f-8b9c-ca7b0043d391 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:21.737710 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-10104a7d-070b-4c3f-8b9c-ca7b0043d391 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] HTTP exception thrown: Instance group 1c6b81f3-f3b3-4099-8e43-e41580a3b8bb could not be found. Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-10104a7d-070b-4c3f-8b9c-ca7b0043d391 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Request method failure captured: Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/os-server-groups/1c6b81f3-f3b3-4099-8e43-e41580a3b8bb HTTP/1.1 Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJerANgR_BHTvCcIfVn4Sdg40K-CqAail70_fo3camktEGP1OLlCwXGvy9ISR5L6IxuBuJ-9RpLc-YgWBhhAHcmvjHcdisV5mBVGsymhJhNNxEkwVLNOmgJJuQqW_k3JicK0LbwCmK_tBGhl1PxK8rhicmG8fkR44yQIgg8Ir-gZ9N8 Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 4308ac3d1dbe4e798f6650316f479826 Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServerGroupTestJSON-1241656537 Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4308ac3d1dbe4e798f6650316f479826"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4308ac3d1dbe4e798f6650316f479826"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4308ac3d1dbe4e798f6650316f479826"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4308ac3d1dbe4e798f6650316f479826"}]}] Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServerGroupTestJSON-1241656537 Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 4308ac3d1dbe4e798f6650316f479826 Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServerGroupTestJSON-1241656537 Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServerGroupTestJSON-1241656537-project Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 418a4c6848204bea8eadb505ccb9c04e Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServerGroupTestJSON-1241656537-project Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: exception: Instance group 1c6b81f3-f3b3-4099-8e43-e41580a3b8bb could not be found. Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '1c6b81f3-f3b3-4099-8e43-e41580a3b8bb'} Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 1c6b81f3-f3b3-4099-8e43-e41580a3b8bb could not be found. Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 1c6b81f3-f3b3-4099-8e43-e41580a3b8bb could not be found. Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:24:21.742019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:24:21.746461 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:24:21.746461 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:24:21.746461 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:24:21.746461 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:24:21.746461 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 1c6b81f3-f3b3-4099-8e43-e41580a3b8bb could not be found. Oct 23 01:24:21.746461 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:24:21.746461 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-10104a7d-070b-4c3f-8b9c-ca7b0043d391 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Returning 404 to user: Instance group 1c6b81f3-f3b3-4099-8e43-e41580a3b8bb could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:24:21.746461 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-10104a7d-070b-4c3f-8b9c-ca7b0043d391 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] 10.222.0.42 "DELETE /compute/v2.1/os-server-groups/1c6b81f3-f3b3-4099-8e43-e41580a3b8bb" status: 404 len: 117 microversion: 2.1 time: 0.017326 Oct 23 01:24:21.746461 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1760/3537] 10.222.0.42 () {58 vars in 1266 bytes} [Sun Oct 23 01:24:21 2022] DELETE /compute/v2.1/os-server-groups/1c6b81f3-f3b3-4099-8e43-e41580a3b8bb => generated 117 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:24:21.750679 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9c8c1776-fb84-401d-8339-a2e721408218 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:21.758362 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-9c8c1776-fb84-401d-8339-a2e721408218 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] HTTP exception thrown: Instance group 61350fe9-1fd7-4889-ac4f-3a1ce00e3b2a could not be found. Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9c8c1776-fb84-401d-8339-a2e721408218 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Request method failure captured: Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/os-server-groups/61350fe9-1fd7-4889-ac4f-3a1ce00e3b2a HTTP/1.1 Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJerANgR_BHTvCcIfVn4Sdg40K-CqAail70_fo3camktEGP1OLlCwXGvy9ISR5L6IxuBuJ-9RpLc-YgWBhhAHcmvjHcdisV5mBVGsymhJhNNxEkwVLNOmgJJuQqW_k3JicK0LbwCmK_tBGhl1PxK8rhicmG8fkR44yQIgg8Ir-gZ9N8 Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 4308ac3d1dbe4e798f6650316f479826 Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServerGroupTestJSON-1241656537 Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4308ac3d1dbe4e798f6650316f479826"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4308ac3d1dbe4e798f6650316f479826"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4308ac3d1dbe4e798f6650316f479826"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4308ac3d1dbe4e798f6650316f479826"}]}] Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServerGroupTestJSON-1241656537 Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 4308ac3d1dbe4e798f6650316f479826 Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServerGroupTestJSON-1241656537 Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServerGroupTestJSON-1241656537-project Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 418a4c6848204bea8eadb505ccb9c04e Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServerGroupTestJSON-1241656537-project Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: exception: Instance group 61350fe9-1fd7-4889-ac4f-3a1ce00e3b2a could not be found. Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '61350fe9-1fd7-4889-ac4f-3a1ce00e3b2a'} Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 61350fe9-1fd7-4889-ac4f-3a1ce00e3b2a could not be found. Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 61350fe9-1fd7-4889-ac4f-3a1ce00e3b2a could not be found. Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:24:21.760119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:24:21.769098 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:24:21.769098 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:24:21.769098 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:24:21.769098 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:24:21.769098 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 61350fe9-1fd7-4889-ac4f-3a1ce00e3b2a could not be found. Oct 23 01:24:21.769098 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:24:21.769098 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9c8c1776-fb84-401d-8339-a2e721408218 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Returning 404 to user: Instance group 61350fe9-1fd7-4889-ac4f-3a1ce00e3b2a could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:24:21.769098 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9c8c1776-fb84-401d-8339-a2e721408218 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] 10.222.0.42 "DELETE /compute/v2.1/os-server-groups/61350fe9-1fd7-4889-ac4f-3a1ce00e3b2a" status: 404 len: 117 microversion: 2.1 time: 0.014942 Oct 23 01:24:21.769098 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1778/3538] 10.222.0.42 () {58 vars in 1266 bytes} [Sun Oct 23 01:24:21 2022] DELETE /compute/v2.1/os-server-groups/61350fe9-1fd7-4889-ac4f-3a1ce00e3b2a => generated 117 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 01:24:21.775536 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4a329fe3-fdf2-4f5f-bf2d-dcb62edba247 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:21.878568 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4a329fe3-fdf2-4f5f-bf2d-dcb62edba247 tempest-ServerGroupTestJSON-1241656537 tempest-ServerGroupTestJSON-1241656537-project] 10.222.0.42 "DELETE /compute/v2.1/os-server-groups/bdd09618-574b-473d-8736-d98d05a72605" status: 204 len: 0 microversion: 2.1 time: 0.106791 Oct 23 01:24:21.879811 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1761/3539] 10.222.0.42 () {58 vars in 1266 bytes} [Sun Oct 23 01:24:21 2022] DELETE /compute/v2.1/os-server-groups/bdd09618-574b-473d-8736-d98d05a72605 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:24:21.935563 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ce7ac088-6c21-4248-8e11-0a8ee21689dd tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:21.936541 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ce7ac088-6c21-4248-8e11-0a8ee21689dd tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] [instance: 7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:21.943427 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce7ac088-6c21-4248-8e11-0a8ee21689dd tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:21.944132 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce7ac088-6c21-4248-8e11-0a8ee21689dd tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:21.944581 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce7ac088-6c21-4248-8e11-0a8ee21689dd tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:21.945445 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce7ac088-6c21-4248-8e11-0a8ee21689dd tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:21.946094 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce7ac088-6c21-4248-8e11-0a8ee21689dd tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:21.946740 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce7ac088-6c21-4248-8e11-0a8ee21689dd tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:21.951372 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=100 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:22.196000 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ce7ac088-6c21-4248-8e11-0a8ee21689dd tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8a867611614ea585d510d62c63cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9f6afbdbf74318a98dfe455a72ac7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:22.205008 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ce7ac088-6c21-4248-8e11-0a8ee21689dd tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "GET /compute/v2.1/servers/7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3" status: 200 len: 1315 microversion: 2.1 time: 0.273300 Oct 23 01:24:22.205596 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1779/3540] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:21 2022] GET /compute/v2.1/servers/7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3 => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:22.367971 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f73f3cdd-99b9-46e7-b22e-f4645e3cd5f3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:22.368596 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f73f3cdd-99b9-46e7-b22e-f4645e3cd5f3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:22.382782 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f73f3cdd-99b9-46e7-b22e-f4645e3cd5f3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:22.383278 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f73f3cdd-99b9-46e7-b22e-f4645e3cd5f3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:22.383987 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f73f3cdd-99b9-46e7-b22e-f4645e3cd5f3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:22.384697 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f73f3cdd-99b9-46e7-b22e-f4645e3cd5f3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:22.385158 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f73f3cdd-99b9-46e7-b22e-f4645e3cd5f3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:22.385600 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f73f3cdd-99b9-46e7-b22e-f4645e3cd5f3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:22.464123 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4ec03ed4-0137-4f25-b190-2a8343ba40ce tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:22.464767 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4ec03ed4-0137-4f25-b190-2a8343ba40ce tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:22.480279 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4ec03ed4-0137-4f25-b190-2a8343ba40ce tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:22.480733 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4ec03ed4-0137-4f25-b190-2a8343ba40ce tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:22.481308 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4ec03ed4-0137-4f25-b190-2a8343ba40ce tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:22.482601 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4ec03ed4-0137-4f25-b190-2a8343ba40ce tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:22.484267 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4ec03ed4-0137-4f25-b190-2a8343ba40ce tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:22.485005 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4ec03ed4-0137-4f25-b190-2a8343ba40ce tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:22.588542 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4ec03ed4-0137-4f25-b190-2a8343ba40ce tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:22.596118 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4ec03ed4-0137-4f25-b190-2a8343ba40ce tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4" status: 200 len: 1297 microversion: 2.1 time: 0.135908 Oct 23 01:24:22.596684 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1780/3541] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:22 2022] GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4 => generated 1297 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:24:22.628738 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f73f3cdd-99b9-46e7-b22e-f4645e3cd5f3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:22.637886 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f73f3cdd-99b9-46e7-b22e-f4645e3cd5f3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1725 microversion: 2.1 time: 0.275409 Oct 23 01:24:22.638489 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1762/3542] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:22 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1725 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:23.120017 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-ae62582a-ace0-43b8-ac5e-67b5d6450728 req-c2bb31a8-346e-4bdd-8092-c62f4de359d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3", "name": "network-vif-plugged", "status": "completed", "tag": "8adc3934-5630-470e-a6f0-e96f18681270"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:24:23.127310 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-ae62582a-ace0-43b8-ac5e-67b5d6450728 req-c2bb31a8-346e-4bdd-8092-c62f4de359d6 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:23.128418 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-ae62582a-ace0-43b8-ac5e-67b5d6450728 req-c2bb31a8-346e-4bdd-8092-c62f4de359d6 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:23.128872 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-ae62582a-ace0-43b8-ac5e-67b5d6450728 req-c2bb31a8-346e-4bdd-8092-c62f4de359d6 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:23.144394 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-ae62582a-ace0-43b8-ac5e-67b5d6450728 req-c2bb31a8-346e-4bdd-8092-c62f4de359d6 service nova] Creating event network-vif-plugged:8adc3934-5630-470e-a6f0-e96f18681270 for instance 7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3 on n-h1-master-1 Oct 23 01:24:23.152654 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-ae62582a-ace0-43b8-ac5e-67b5d6450728 req-c2bb31a8-346e-4bdd-8092-c62f4de359d6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046922 Oct 23 01:24:23.154187 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1781/3543] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:24:23.229931 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a93de0f2-5d17-4c32-9791-dd639ae4608f tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:23.230705 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a93de0f2-5d17-4c32-9791-dd639ae4608f tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] [instance: 7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:23.252108 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a93de0f2-5d17-4c32-9791-dd639ae4608f tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:23.252591 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a93de0f2-5d17-4c32-9791-dd639ae4608f tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:23.252983 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a93de0f2-5d17-4c32-9791-dd639ae4608f tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:23.253696 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a93de0f2-5d17-4c32-9791-dd639ae4608f tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:23.260778 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a93de0f2-5d17-4c32-9791-dd639ae4608f tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:23.264099 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a93de0f2-5d17-4c32-9791-dd639ae4608f tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:23.621540 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7f9e7ae2-7b8e-4062-918d-1bb8463a8cee tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:23.622195 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7f9e7ae2-7b8e-4062-918d-1bb8463a8cee tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:23.630245 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f9e7ae2-7b8e-4062-918d-1bb8463a8cee tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:23.638954 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f9e7ae2-7b8e-4062-918d-1bb8463a8cee tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:23.639180 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f9e7ae2-7b8e-4062-918d-1bb8463a8cee tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:23.639831 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f9e7ae2-7b8e-4062-918d-1bb8463a8cee tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:23.640227 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f9e7ae2-7b8e-4062-918d-1bb8463a8cee tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:23.640661 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f9e7ae2-7b8e-4062-918d-1bb8463a8cee tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:23.823155 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7f9e7ae2-7b8e-4062-918d-1bb8463a8cee tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:23.840426 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7f9e7ae2-7b8e-4062-918d-1bb8463a8cee tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4" status: 200 len: 1315 microversion: 2.1 time: 0.223243 Oct 23 01:24:23.846569 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1782/3544] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:23 2022] GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4 => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:24:23.866464 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1dcdb611-a649-4ce1-9f65-87f906f7ddfb tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:23.875559 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1dcdb611-a649-4ce1-9f65-87f906f7ddfb tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:23.897050 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a93de0f2-5d17-4c32-9791-dd639ae4608f tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8a867611614ea585d510d62c63cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9f6afbdbf74318a98dfe455a72ac7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:23.917123 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a93de0f2-5d17-4c32-9791-dd639ae4608f tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "GET /compute/v2.1/servers/7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3" status: 200 len: 1315 microversion: 2.1 time: 0.691362 Oct 23 01:24:23.926429 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1dcdb611-a649-4ce1-9f65-87f906f7ddfb tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:23.926429 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1dcdb611-a649-4ce1-9f65-87f906f7ddfb tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:23.926429 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1dcdb611-a649-4ce1-9f65-87f906f7ddfb tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:23.926429 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1dcdb611-a649-4ce1-9f65-87f906f7ddfb tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:23.926429 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1dcdb611-a649-4ce1-9f65-87f906f7ddfb tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:23.926429 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1dcdb611-a649-4ce1-9f65-87f906f7ddfb tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:23.927709 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1763/3545] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:23 2022] GET /compute/v2.1/servers/7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3 => generated 1315 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:24:24.214126 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1dcdb611-a649-4ce1-9f65-87f906f7ddfb tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:24.225737 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1dcdb611-a649-4ce1-9f65-87f906f7ddfb tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1725 microversion: 2.1 time: 0.380746 Oct 23 01:24:24.230165 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1783/3546] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:23 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1725 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:24.879478 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c36cc12f-80dd-476f-b1df-aa4a91ec7d07 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:24.879971 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c36cc12f-80dd-476f-b1df-aa4a91ec7d07 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:24.890920 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c36cc12f-80dd-476f-b1df-aa4a91ec7d07 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:24.894974 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c36cc12f-80dd-476f-b1df-aa4a91ec7d07 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:24.898038 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c36cc12f-80dd-476f-b1df-aa4a91ec7d07 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:24.901109 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c36cc12f-80dd-476f-b1df-aa4a91ec7d07 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:24.901770 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c36cc12f-80dd-476f-b1df-aa4a91ec7d07 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:24.903515 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c36cc12f-80dd-476f-b1df-aa4a91ec7d07 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:24.944848 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c544101c-6fac-42ca-b405-25dd235e0f85 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:24.945479 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c544101c-6fac-42ca-b405-25dd235e0f85 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] [instance: 7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:24.960185 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c544101c-6fac-42ca-b405-25dd235e0f85 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:24.960782 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c544101c-6fac-42ca-b405-25dd235e0f85 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:24.961226 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c544101c-6fac-42ca-b405-25dd235e0f85 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:24.961939 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c544101c-6fac-42ca-b405-25dd235e0f85 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:24.991890 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c544101c-6fac-42ca-b405-25dd235e0f85 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:24.992357 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c544101c-6fac-42ca-b405-25dd235e0f85 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:25.508978 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c36cc12f-80dd-476f-b1df-aa4a91ec7d07 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:25.517359 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c36cc12f-80dd-476f-b1df-aa4a91ec7d07 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4" status: 200 len: 1371 microversion: 2.1 time: 0.642609 Oct 23 01:24:25.518209 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c544101c-6fac-42ca-b405-25dd235e0f85 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8a867611614ea585d510d62c63cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9f6afbdbf74318a98dfe455a72ac7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:25.518860 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1764/3547] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:24 2022] GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4 => generated 1371 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:25.534861 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c544101c-6fac-42ca-b405-25dd235e0f85 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "GET /compute/v2.1/servers/7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3" status: 200 len: 1315 microversion: 2.1 time: 0.589991 Oct 23 01:24:25.534861 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1784/3548] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:24 2022] GET /compute/v2.1/servers/7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3 => generated 1315 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:25.545750 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8496e133-ab7c-4ef7-8e78-91a4b70ced34 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:25.546874 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8496e133-ab7c-4ef7-8e78-91a4b70ced34 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:25.556521 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8496e133-ab7c-4ef7-8e78-91a4b70ced34 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:25.557222 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8496e133-ab7c-4ef7-8e78-91a4b70ced34 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:25.558119 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8496e133-ab7c-4ef7-8e78-91a4b70ced34 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:25.559127 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8496e133-ab7c-4ef7-8e78-91a4b70ced34 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:25.559775 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8496e133-ab7c-4ef7-8e78-91a4b70ced34 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:25.561137 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8496e133-ab7c-4ef7-8e78-91a4b70ced34 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:25.829153 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-49e3e93c-71e2-4e89-9184-1b0d6f1710dc tempest-VolumesAdminNegativeTest-922623748 tempest-VolumesAdminNegativeTest-922623748-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "41ab0215-ee5e-42b3-b974-1b12dc9c7b74"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:24:25.832441 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-49e3e93c-71e2-4e89-9184-1b0d6f1710dc tempest-VolumesAdminNegativeTest-922623748 tempest-VolumesAdminNegativeTest-922623748-project-admin] [instance: 8ce9f585-473f-4f8f-a5e6-7b83b7303ccb] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:25.844372 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-49e3e93c-71e2-4e89-9184-1b0d6f1710dc tempest-VolumesAdminNegativeTest-922623748 tempest-VolumesAdminNegativeTest-922623748-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:25.849231 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-49e3e93c-71e2-4e89-9184-1b0d6f1710dc tempest-VolumesAdminNegativeTest-922623748 tempest-VolumesAdminNegativeTest-922623748-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:25.850003 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-49e3e93c-71e2-4e89-9184-1b0d6f1710dc tempest-VolumesAdminNegativeTest-922623748 tempest-VolumesAdminNegativeTest-922623748-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:25.850935 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-49e3e93c-71e2-4e89-9184-1b0d6f1710dc tempest-VolumesAdminNegativeTest-922623748 tempest-VolumesAdminNegativeTest-922623748-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:25.852476 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-49e3e93c-71e2-4e89-9184-1b0d6f1710dc tempest-VolumesAdminNegativeTest-922623748 tempest-VolumesAdminNegativeTest-922623748-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:25.854560 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-49e3e93c-71e2-4e89-9184-1b0d6f1710dc tempest-VolumesAdminNegativeTest-922623748 tempest-VolumesAdminNegativeTest-922623748-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:26.012722 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-49e3e93c-71e2-4e89-9184-1b0d6f1710dc tempest-VolumesAdminNegativeTest-922623748 tempest-VolumesAdminNegativeTest-922623748-project-admin] HTTP exception thrown: Volume 41ab0215-ee5e-42b3-b974-1b12dc9c7b74 could not be found. Oct 23 01:24:26.017230 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8496e133-ab7c-4ef7-8e78-91a4b70ced34 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-49e3e93c-71e2-4e89-9184-1b0d6f1710dc tempest-VolumesAdminNegativeTest-922623748 tempest-VolumesAdminNegativeTest-922623748-project-admin] Request method failure captured: Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: request: PUT /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb/os-volume_attachments/3c684ec1-f364-40c2-8f01-d028f6b4ff21 HTTP/1.1 Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 74 Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJds6BAPoEQ0cj5pS3PPHWZxAD2yMhoqvLCaN5j9L7fyQWxVBRj99Aqh_xl1fUpLXLc7xdD09VSPaDSGdtVyyOq04bXA7E4wcytKh456NeteOquyvKl7rjvSrEWC5BiBxoG4yHwyHoizHuSR0Y1GMsMytmjMTrreyWgaCUOcIgwtydI Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: a4faf89299604d51b0b70e63f4b7022c Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-VolumesAdminNegativeTest-922623748 Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,admin,reader Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,admin,reader Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a4faf89299604d51b0b70e63f4b7022c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a4faf89299604d51b0b70e63f4b7022c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a4faf89299604d51b0b70e63f4b7022c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a4faf89299604d51b0b70e63f4b7022c"}]}] Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-VolumesAdminNegativeTest-922623748 Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: a4faf89299604d51b0b70e63f4b7022c Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-922623748 Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-VolumesAdminNegativeTest-922623748-project-admin Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: b16c8a1cdf2741cb8618a48a38e98455 Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-VolumesAdminNegativeTest-922623748-project-admin Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: {"volumeAttachment": {"volumeId": "41ab0215-ee5e-42b3-b974-1b12dc9c7b74"}} Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: exception: Volume 41ab0215-ee5e-42b3-b974-1b12dc9c7b74 could not be found. Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: action_args: {'server_id': '8ce9f585-473f-4f8f-a5e6-7b83b7303ccb', 'id': '3c684ec1-f364-40c2-8f01-d028f6b4ff21', 'body': {'volumeAttachment': {'volumeId': '41ab0215-ee5e-42b3-b974-1b12dc9c7b74'}}} Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 41ab0215-ee5e-42b3-b974-1b12dc9c7b74 could not be found. (HTTP 404) (Request-ID: req-74374f4c-3315-4bb5-99ac-0eefe198880b) Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 23 01:24:26.019126 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 23 01:24:26.025231 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 23 01:24:26.025231 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 23 01:24:26.025231 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 23 01:24:26.025231 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 01:24:26.025231 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 01:24:26.025231 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 23 01:24:26.025231 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 23 01:24:26.025231 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 23 01:24:26.025231 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 23 01:24:26.025231 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 23 01:24:26.025231 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 23 01:24:26.025231 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 23 01:24:26.025231 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 23 01:24:26.025231 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 01:24:26.025231 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 01:24:26.025231 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 01:24:26.025231 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 01:24:26.025231 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 41ab0215-ee5e-42b3-b974-1b12dc9c7b74 could not be found. Oct 23 01:24:26.025231 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:24:26.025231 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:24:26.025231 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:24:26.025231 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:24:26.025231 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:24:26.025231 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:24:26.025231 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:24:26.025231 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:24:26.025231 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:24:26.025231 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:24:26.025231 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:24:26.025231 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:24:26.025231 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:24:26.025231 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:24:26.025231 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 23 01:24:26.025231 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 23 01:24:26.025231 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 23 01:24:26.025231 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 23 01:24:26.025231 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 41ab0215-ee5e-42b3-b974-1b12dc9c7b74 could not be found. Oct 23 01:24:26.025231 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:24:26.025231 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:24:26.025231 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:24:26.025231 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:24:26.025231 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:24:26.025231 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:24:26.025231 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:24:26.025231 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:24:26.025231 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 41ab0215-ee5e-42b3-b974-1b12dc9c7b74 could not be found. Oct 23 01:24:26.025231 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:24:26.025231 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-49e3e93c-71e2-4e89-9184-1b0d6f1710dc tempest-VolumesAdminNegativeTest-922623748 tempest-VolumesAdminNegativeTest-922623748-project-admin] Returning 400 to user: Volume 41ab0215-ee5e-42b3-b974-1b12dc9c7b74 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:24:26.025231 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-49e3e93c-71e2-4e89-9184-1b0d6f1710dc tempest-VolumesAdminNegativeTest-922623748 tempest-VolumesAdminNegativeTest-922623748-project-admin] 10.222.0.42 "PUT /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb/os-volume_attachments/3c684ec1-f364-40c2-8f01-d028f6b4ff21" status: 400 len: 107 microversion: 2.1 time: 0.502031 Oct 23 01:24:26.040527 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1765/3549] 10.222.0.42 () {60 vars in 1433 bytes} [Sun Oct 23 01:24:25 2022] PUT /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb/os-volume_attachments/3c684ec1-f364-40c2-8f01-d028f6b4ff21 => generated 107 bytes in 506 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:24:26.045863 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8496e133-ab7c-4ef7-8e78-91a4b70ced34 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1725 microversion: 2.1 time: 0.505840 Oct 23 01:24:26.063613 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-0281014c-fa7b-4502-9d27-e4506609c3eb req-6827b9ae-5c0f-4dad-9373-fddaba3e9f5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38daa540-d4d0-4644-8ed5-a1f6a4fea4e4", "tag": "d22e97f1-10e1-4cba-878f-0a05d24b97c0"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:24:26.065119 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1785/3550] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:25 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1725 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:26.082685 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-0281014c-fa7b-4502-9d27-e4506609c3eb req-6827b9ae-5c0f-4dad-9373-fddaba3e9f5d service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:26.083222 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-0281014c-fa7b-4502-9d27-e4506609c3eb req-6827b9ae-5c0f-4dad-9373-fddaba3e9f5d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:26.083874 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-0281014c-fa7b-4502-9d27-e4506609c3eb req-6827b9ae-5c0f-4dad-9373-fddaba3e9f5d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:26.095678 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-0281014c-fa7b-4502-9d27-e4506609c3eb req-6827b9ae-5c0f-4dad-9373-fddaba3e9f5d service nova] Creating event network-changed:d22e97f1-10e1-4cba-878f-0a05d24b97c0 for instance 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4 on n-h2-master-1 Oct 23 01:24:26.101958 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-0281014c-fa7b-4502-9d27-e4506609c3eb req-6827b9ae-5c0f-4dad-9373-fddaba3e9f5d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050805 Oct 23 01:24:26.102823 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1766/3551] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:24:26.145640 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-657815b4-99db-4509-b538-d8ee956eaf45 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:26.146179 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-657815b4-99db-4509-b538-d8ee956eaf45 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: 8ce9f585-473f-4f8f-a5e6-7b83b7303ccb] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:26.153115 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-657815b4-99db-4509-b538-d8ee956eaf45 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:26.153611 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-657815b4-99db-4509-b538-d8ee956eaf45 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:26.154115 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-657815b4-99db-4509-b538-d8ee956eaf45 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:26.154813 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-657815b4-99db-4509-b538-d8ee956eaf45 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:26.155265 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-657815b4-99db-4509-b538-d8ee956eaf45 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:26.155697 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-657815b4-99db-4509-b538-d8ee956eaf45 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:26.304720 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-657815b4-99db-4509-b538-d8ee956eaf45 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lazy-loading 'services' on Instance uuid 8ce9f585-473f-4f8f-a5e6-7b83b7303ccb {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:24:26.548072 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a560e149-a765-4290-bcf7-88a465f29a69 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:26.548072 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a560e149-a765-4290-bcf7-88a465f29a69 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:26.554151 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a560e149-a765-4290-bcf7-88a465f29a69 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:26.554552 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a560e149-a765-4290-bcf7-88a465f29a69 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:26.554995 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a560e149-a765-4290-bcf7-88a465f29a69 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:26.555706 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a560e149-a765-4290-bcf7-88a465f29a69 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:26.556169 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a560e149-a765-4290-bcf7-88a465f29a69 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:26.556601 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a560e149-a765-4290-bcf7-88a465f29a69 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:26.668926 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-657815b4-99db-4509-b538-d8ee956eaf45 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb/os-volume_attachments/3c684ec1-f364-40c2-8f01-d028f6b4ff21" status: 202 len: 0 microversion: 2.1 time: 0.527994 Oct 23 01:24:26.685935 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1786/3552] 10.222.0.42 () {58 vars in 1416 bytes} [Sun Oct 23 01:24:26 2022] DELETE /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb/os-volume_attachments/3c684ec1-f364-40c2-8f01-d028f6b4ff21 => generated 0 bytes in 544 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:24:26.691955 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5336ba37-4358-4c0c-8df2-665d93f9bee8 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:26.692710 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5336ba37-4358-4c0c-8df2-665d93f9bee8 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] [instance: 7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:26.699002 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5336ba37-4358-4c0c-8df2-665d93f9bee8 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:26.699487 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5336ba37-4358-4c0c-8df2-665d93f9bee8 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:26.699920 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5336ba37-4358-4c0c-8df2-665d93f9bee8 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:26.700614 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5336ba37-4358-4c0c-8df2-665d93f9bee8 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:26.701177 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5336ba37-4358-4c0c-8df2-665d93f9bee8 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:26.701603 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5336ba37-4358-4c0c-8df2-665d93f9bee8 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:26.701815 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a560e149-a765-4290-bcf7-88a465f29a69 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:26.709890 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a560e149-a765-4290-bcf7-88a465f29a69 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4" status: 200 len: 1371 microversion: 2.1 time: 0.168798 Oct 23 01:24:26.710657 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1767/3553] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:26 2022] GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4 => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:24:26.715634 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3bde61a4-59a0-4282-a460-7a0885f098d7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:26.718177 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3bde61a4-59a0-4282-a460-7a0885f098d7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: 8ce9f585-473f-4f8f-a5e6-7b83b7303ccb] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:26.725523 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3bde61a4-59a0-4282-a460-7a0885f098d7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:26.726199 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3bde61a4-59a0-4282-a460-7a0885f098d7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:26.726749 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3bde61a4-59a0-4282-a460-7a0885f098d7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:26.727537 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3bde61a4-59a0-4282-a460-7a0885f098d7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:26.728190 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3bde61a4-59a0-4282-a460-7a0885f098d7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:26.728616 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3bde61a4-59a0-4282-a460-7a0885f098d7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:26.763276 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3bde61a4-59a0-4282-a460-7a0885f098d7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051324 Oct 23 01:24:26.763855 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1768/3554] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:24:26 2022] GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:24:26.963111 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5336ba37-4358-4c0c-8df2-665d93f9bee8 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8a867611614ea585d510d62c63cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9f6afbdbf74318a98dfe455a72ac7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:26.973711 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5336ba37-4358-4c0c-8df2-665d93f9bee8 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "GET /compute/v2.1/servers/7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3" status: 200 len: 1503 microversion: 2.1 time: 0.288586 Oct 23 01:24:26.974319 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1787/3555] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:26 2022] GET /compute/v2.1/servers/7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3 => generated 1503 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:27.000797 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f6d6017f-2f35-434a-aaa9-b697375e0194 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-134925099"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:24:27.001618 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f6d6017f-2f35-434a-aaa9-b697375e0194 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] [instance: 7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:27.010209 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f6d6017f-2f35-434a-aaa9-b697375e0194 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:27.010719 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f6d6017f-2f35-434a-aaa9-b697375e0194 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:27.011193 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f6d6017f-2f35-434a-aaa9-b697375e0194 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:27.012283 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f6d6017f-2f35-434a-aaa9-b697375e0194 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:27.013033 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f6d6017f-2f35-434a-aaa9-b697375e0194 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:27.013564 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f6d6017f-2f35-434a-aaa9-b697375e0194 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:27.071774 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cb850e13-b1db-46a9-ba17-276f2047a619 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:27.073734 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-cb850e13-b1db-46a9-ba17-276f2047a619 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:27.080356 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cb850e13-b1db-46a9-ba17-276f2047a619 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:27.081074 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cb850e13-b1db-46a9-ba17-276f2047a619 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:27.081662 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cb850e13-b1db-46a9-ba17-276f2047a619 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:27.083064 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cb850e13-b1db-46a9-ba17-276f2047a619 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:27.083687 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cb850e13-b1db-46a9-ba17-276f2047a619 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:27.084206 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cb850e13-b1db-46a9-ba17-276f2047a619 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:27.328311 n-d-master-1 devstack@n-api.service[120945]: INFO nova.network.security_group_api [None req-f6d6017f-2f35-434a-aaa9-b697375e0194 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Adding security group 49324941-cd8f-45b9-a833-d1d054b2127e to port 8adc3934-5630-470e-a6f0-e96f18681270 Oct 23 01:24:27.433265 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cb850e13-b1db-46a9-ba17-276f2047a619 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:27.440916 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cb850e13-b1db-46a9-ba17-276f2047a619 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1725 microversion: 2.1 time: 0.371846 Oct 23 01:24:27.444348 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1788/3556] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:27 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1725 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:27.736331 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8bb69380-6b39-4e15-990e-784eb379eacb tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:27.737088 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8bb69380-6b39-4e15-990e-784eb379eacb tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:27.748251 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8bb69380-6b39-4e15-990e-784eb379eacb tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:27.752731 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8bb69380-6b39-4e15-990e-784eb379eacb tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:27.753401 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8bb69380-6b39-4e15-990e-784eb379eacb tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:27.756746 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8bb69380-6b39-4e15-990e-784eb379eacb tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:27.756746 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8bb69380-6b39-4e15-990e-784eb379eacb tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:27.756746 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8bb69380-6b39-4e15-990e-784eb379eacb tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:28.052655 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8bb69380-6b39-4e15-990e-784eb379eacb tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:28.061668 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8bb69380-6b39-4e15-990e-784eb379eacb tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4" status: 200 len: 1371 microversion: 2.1 time: 0.330105 Oct 23 01:24:28.081764 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1789/3557] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:27 2022] GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4 => generated 1371 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:24:28.087836 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4c2600c8-a78b-4ec1-8d10-a763980b5978 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:28.101612 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4c2600c8-a78b-4ec1-8d10-a763980b5978 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: 8ce9f585-473f-4f8f-a5e6-7b83b7303ccb] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:28.116601 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f6d6017f-2f35-434a-aaa9-b697375e0194 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "POST /compute/v2.1/servers/7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3/action" status: 202 len: 0 microversion: 2.1 time: 1.119233 Oct 23 01:24:28.116601 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1769/3558] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:24:26 2022] POST /compute/v2.1/servers/7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3/action => generated 0 bytes in 1123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:24:28.123828 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e7953e03-a860-4fee-a70d-9f89ef1c8667 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1334726409"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:24:28.124948 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e7953e03-a860-4fee-a70d-9f89ef1c8667 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] [instance: 7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:28.127870 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4c2600c8-a78b-4ec1-8d10-a763980b5978 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:28.133543 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4c2600c8-a78b-4ec1-8d10-a763980b5978 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:28.135583 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4c2600c8-a78b-4ec1-8d10-a763980b5978 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:28.136437 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4c2600c8-a78b-4ec1-8d10-a763980b5978 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:28.139584 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4c2600c8-a78b-4ec1-8d10-a763980b5978 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:28.140952 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4c2600c8-a78b-4ec1-8d10-a763980b5978 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:28.141903 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:28.145157 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e7953e03-a860-4fee-a70d-9f89ef1c8667 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:28.148724 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e7953e03-a860-4fee-a70d-9f89ef1c8667 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:28.149843 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e7953e03-a860-4fee-a70d-9f89ef1c8667 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:28.155265 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e7953e03-a860-4fee-a70d-9f89ef1c8667 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:28.156005 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e7953e03-a860-4fee-a70d-9f89ef1c8667 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:28.158990 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e7953e03-a860-4fee-a70d-9f89ef1c8667 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:28.247270 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4c2600c8-a78b-4ec1-8d10-a763980b5978 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.163548 Oct 23 01:24:28.248592 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1790/3559] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:24:28 2022] GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:24:28.255709 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-6c6d4c78-7f1a-4e48-8333-198cfea16117 req-f6fc5bdc-8f93-4980-8de2-44558222250a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3", "tag": "8adc3934-5630-470e-a6f0-e96f18681270"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:24:28.269931 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-6c6d4c78-7f1a-4e48-8333-198cfea16117 req-f6fc5bdc-8f93-4980-8de2-44558222250a service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:28.277031 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-6c6d4c78-7f1a-4e48-8333-198cfea16117 req-f6fc5bdc-8f93-4980-8de2-44558222250a service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:28.277031 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-6c6d4c78-7f1a-4e48-8333-198cfea16117 req-f6fc5bdc-8f93-4980-8de2-44558222250a service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:28.291188 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-6c6d4c78-7f1a-4e48-8333-198cfea16117 req-f6fc5bdc-8f93-4980-8de2-44558222250a service nova] Creating event network-changed:8adc3934-5630-470e-a6f0-e96f18681270 for instance 7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3 on n-h1-master-1 Oct 23 01:24:28.300181 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-6c6d4c78-7f1a-4e48-8333-198cfea16117 req-f6fc5bdc-8f93-4980-8de2-44558222250a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049319 Oct 23 01:24:28.301782 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1791/3560] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:24:28.437629 n-d-master-1 devstack@n-api.service[120945]: INFO nova.network.security_group_api [None req-e7953e03-a860-4fee-a70d-9f89ef1c8667 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Adding security group d073eb11-172f-4946-a169-00b3d5acf473 to port 8adc3934-5630-470e-a6f0-e96f18681270 Oct 23 01:24:28.487814 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6b987fa4-c0a9-4a14-a3b4-d4a6983ca928 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:28.489244 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6b987fa4-c0a9-4a14-a3b4-d4a6983ca928 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:28.507384 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b987fa4-c0a9-4a14-a3b4-d4a6983ca928 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:28.508154 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b987fa4-c0a9-4a14-a3b4-d4a6983ca928 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:28.508793 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b987fa4-c0a9-4a14-a3b4-d4a6983ca928 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:28.509692 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b987fa4-c0a9-4a14-a3b4-d4a6983ca928 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:28.510350 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b987fa4-c0a9-4a14-a3b4-d4a6983ca928 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:28.510969 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b987fa4-c0a9-4a14-a3b4-d4a6983ca928 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:28.894104 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6b987fa4-c0a9-4a14-a3b4-d4a6983ca928 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:28.910551 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6b987fa4-c0a9-4a14-a3b4-d4a6983ca928 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1725 microversion: 2.1 time: 0.442104 Oct 23 01:24:28.920413 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1792/3561] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:28 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1725 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:24:29.088282 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7e580cea-c8b8-4bf9-aa7c-4140d989bbe5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:29.088892 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7e580cea-c8b8-4bf9-aa7c-4140d989bbe5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:29.096239 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e580cea-c8b8-4bf9-aa7c-4140d989bbe5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:29.096829 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e580cea-c8b8-4bf9-aa7c-4140d989bbe5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:29.098389 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e580cea-c8b8-4bf9-aa7c-4140d989bbe5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:29.099413 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e580cea-c8b8-4bf9-aa7c-4140d989bbe5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:29.100109 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e580cea-c8b8-4bf9-aa7c-4140d989bbe5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:29.100801 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e580cea-c8b8-4bf9-aa7c-4140d989bbe5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:29.395935 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7e580cea-c8b8-4bf9-aa7c-4140d989bbe5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:29.413336 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7e580cea-c8b8-4bf9-aa7c-4140d989bbe5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4" status: 200 len: 1371 microversion: 2.1 time: 0.328930 Oct 23 01:24:29.433355 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1793/3562] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:29 2022] GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4 => generated 1371 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:29.441471 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bb0ee731-ee4b-4469-9c56-46fefd1a72d8 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:29.444837 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bb0ee731-ee4b-4469-9c56-46fefd1a72d8 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: 8ce9f585-473f-4f8f-a5e6-7b83b7303ccb] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:29.451361 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bb0ee731-ee4b-4469-9c56-46fefd1a72d8 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:29.451852 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bb0ee731-ee4b-4469-9c56-46fefd1a72d8 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:29.452288 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bb0ee731-ee4b-4469-9c56-46fefd1a72d8 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:29.453182 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bb0ee731-ee4b-4469-9c56-46fefd1a72d8 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:29.453635 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bb0ee731-ee4b-4469-9c56-46fefd1a72d8 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:29.454271 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bb0ee731-ee4b-4469-9c56-46fefd1a72d8 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:29.493743 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bb0ee731-ee4b-4469-9c56-46fefd1a72d8 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058732 Oct 23 01:24:29.494348 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1794/3563] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:24:29 2022] GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:24:29.523530 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e7953e03-a860-4fee-a70d-9f89ef1c8667 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "POST /compute/v2.1/servers/7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3/action" status: 202 len: 0 microversion: 2.1 time: 1.404171 Oct 23 01:24:29.525128 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1770/3564] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:24:28 2022] POST /compute/v2.1/servers/7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3/action => generated 0 bytes in 1406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 23 01:24:29.533859 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d58639da-75a2-43f9-a269-c1b02d12bd06 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:29.534694 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d58639da-75a2-43f9-a269-c1b02d12bd06 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] [instance: 7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:29.564173 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d58639da-75a2-43f9-a269-c1b02d12bd06 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:29.565018 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d58639da-75a2-43f9-a269-c1b02d12bd06 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:29.565666 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d58639da-75a2-43f9-a269-c1b02d12bd06 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:29.567393 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d58639da-75a2-43f9-a269-c1b02d12bd06 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:29.569623 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d58639da-75a2-43f9-a269-c1b02d12bd06 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:29.572245 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d58639da-75a2-43f9-a269-c1b02d12bd06 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:29.773777 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d58639da-75a2-43f9-a269-c1b02d12bd06 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "GET /compute/v2.1/servers/7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.244475 Oct 23 01:24:29.774621 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1795/3565] 10.222.0.42 () {58 vars in 1293 bytes} [Sun Oct 23 01:24:29 2022] GET /compute/v2.1/servers/7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3/os-security-groups => generated 1157 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:29.790752 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-26f3906f-fed4-462f-bef6-ae28c154edf9 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Action: 'create', calling method: .version_select at 0x7f5cc1ef68b0>, body: {"security_group": {"name": " tempest-securitygroup -1921560767 ", "description": "tempest-description-1193885253"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:24:29.940906 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9ee72ea4-e37b-4bee-89e3-f602da191199 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:29.948545 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9ee72ea4-e37b-4bee-89e3-f602da191199 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:29.966680 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ee72ea4-e37b-4bee-89e3-f602da191199 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:29.967862 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ee72ea4-e37b-4bee-89e3-f602da191199 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:29.968514 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ee72ea4-e37b-4bee-89e3-f602da191199 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:29.969554 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ee72ea4-e37b-4bee-89e3-f602da191199 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:29.970257 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ee72ea4-e37b-4bee-89e3-f602da191199 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:29.970915 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ee72ea4-e37b-4bee-89e3-f602da191199 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:30.010828 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=4 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:30.022544 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=16 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:30.197776 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9ee72ea4-e37b-4bee-89e3-f602da191199 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:30.201239 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:30.207596 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9ee72ea4-e37b-4bee-89e3-f602da191199 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1725 microversion: 2.1 time: 0.274883 Oct 23 01:24:30.210000 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1796/3566] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:29 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1725 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:30.214315 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e08ca033-50b4-47c2-83f1-e73a3782c03f tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c992e6fd-3092-481d-8b6c-ef42f9c9cfef"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:24:30.216877 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e08ca033-50b4-47c2-83f1-e73a3782c03f tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] [instance: e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:30.223716 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e08ca033-50b4-47c2-83f1-e73a3782c03f tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:30.224414 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e08ca033-50b4-47c2-83f1-e73a3782c03f tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:30.225028 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e08ca033-50b4-47c2-83f1-e73a3782c03f tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:30.225871 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e08ca033-50b4-47c2-83f1-e73a3782c03f tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:30.226507 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e08ca033-50b4-47c2-83f1-e73a3782c03f tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:30.226936 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e08ca033-50b4-47c2-83f1-e73a3782c03f tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:30.326687 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=6 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:30.435459 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-26f3906f-fed4-462f-bef6-ae28c154edf9 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 0.648373 Oct 23 01:24:30.444318 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1771/3567] 10.222.0.42 () {60 vars in 1180 bytes} [Sun Oct 23 01:24:29 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:24:30.450412 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-b08e1fad-df9c-4946-adf8-d2cfd26a2718 req-43f222f3-cbe6-486e-b8e1-561b7d4f918e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3", "tag": "8adc3934-5630-470e-a6f0-e96f18681270"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:24:30.462597 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-b08e1fad-df9c-4946-adf8-d2cfd26a2718 req-43f222f3-cbe6-486e-b8e1-561b7d4f918e service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:30.463424 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-b08e1fad-df9c-4946-adf8-d2cfd26a2718 req-43f222f3-cbe6-486e-b8e1-561b7d4f918e service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:30.464067 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-b08e1fad-df9c-4946-adf8-d2cfd26a2718 req-43f222f3-cbe6-486e-b8e1-561b7d4f918e service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:30.483652 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-b08e1fad-df9c-4946-adf8-d2cfd26a2718 req-43f222f3-cbe6-486e-b8e1-561b7d4f918e service nova] Creating event network-changed:8adc3934-5630-470e-a6f0-e96f18681270 for instance 7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3 on n-h1-master-1 Oct 23 01:24:30.489459 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-b08e1fad-df9c-4946-adf8-d2cfd26a2718 req-43f222f3-cbe6-486e-b8e1-561b7d4f918e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043538 Oct 23 01:24:30.491378 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1772/3568] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:24:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:24:30.499064 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-989eed33-0909-4007-82df-e01741dd83d3 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:30.500150 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-989eed33-0909-4007-82df-e01741dd83d3 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:30.508064 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-989eed33-0909-4007-82df-e01741dd83d3 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:30.508817 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-989eed33-0909-4007-82df-e01741dd83d3 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:30.509476 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-989eed33-0909-4007-82df-e01741dd83d3 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:30.510434 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-989eed33-0909-4007-82df-e01741dd83d3 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:30.511113 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-989eed33-0909-4007-82df-e01741dd83d3 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:30.511769 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-989eed33-0909-4007-82df-e01741dd83d3 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:30.724825 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-989eed33-0909-4007-82df-e01741dd83d3 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:30.735064 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-989eed33-0909-4007-82df-e01741dd83d3 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4" status: 200 len: 1371 microversion: 2.1 time: 0.241976 Oct 23 01:24:30.736177 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1773/3569] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:30 2022] GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4 => generated 1371 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:30.742357 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d9ae92f5-d768-491f-a3c6-845a371ad4d3 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '.version_select at 0x7f5cc1ef6d30>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:30.817100 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d9ae92f5-d768-491f-a3c6-845a371ad4d3 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "GET /compute/v2.1/os-security-groups/3e7ee609-b62e-413c-8667-8711a29148e3" status: 200 len: 224 microversion: 2.1 time: 0.078980 Oct 23 01:24:30.817692 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1774/3570] 10.222.0.42 () {58 vars in 1269 bytes} [Sun Oct 23 01:24:30 2022] GET /compute/v2.1/os-security-groups/3e7ee609-b62e-413c-8667-8711a29148e3 => generated 224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:24:30.831113 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3b1b7790-69d0-45b0-acfd-433d813b86d7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:30.837868 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3b1b7790-69d0-45b0-acfd-433d813b86d7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: 8ce9f585-473f-4f8f-a5e6-7b83b7303ccb] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:30.844889 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b1b7790-69d0-45b0-acfd-433d813b86d7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:30.845567 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b1b7790-69d0-45b0-acfd-433d813b86d7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:30.846219 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b1b7790-69d0-45b0-acfd-433d813b86d7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:30.847169 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b1b7790-69d0-45b0-acfd-433d813b86d7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:30.847886 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b1b7790-69d0-45b0-acfd-433d813b86d7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:30.848541 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b1b7790-69d0-45b0-acfd-433d813b86d7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:30.881446 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:30.889032 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3b1b7790-69d0-45b0-acfd-433d813b86d7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062648 Oct 23 01:24:30.890059 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1775/3571] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:24:30 2022] GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:24:30.899339 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-72531fd3-d74d-4b85-a0fb-bfde7a2d0438 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '.version_select at 0x7f5cc1ef6790>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:31.394988 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-72531fd3-d74d-4b85-a0fb-bfde7a2d0438 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/3e7ee609-b62e-413c-8667-8711a29148e3" status: 202 len: 0 microversion: 2.1 time: 0.498883 Oct 23 01:24:31.395256 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e08ca033-50b4-47c2-83f1-e73a3782c03f tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] 10.222.0.42 "POST /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.184187 Oct 23 01:24:31.396051 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1776/3572] 10.222.0.42 () {58 vars in 1272 bytes} [Sun Oct 23 01:24:30 2022] DELETE /compute/v2.1/os-security-groups/3e7ee609-b62e-413c-8667-8711a29148e3 => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:24:31.397231 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1797/3573] 10.222.0.42 () {60 vars in 1323 bytes} [Sun Oct 23 01:24:30 2022] POST /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c/os-volume_attachments => generated 194 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:24:31.403186 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cd242291-2b3c-49a3-8106-ca0b2231469c tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:31.405242 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cd242291-2b3c-49a3-8106-ca0b2231469c tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:31.420599 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cd242291-2b3c-49a3-8106-ca0b2231469c tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:31.421134 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cd242291-2b3c-49a3-8106-ca0b2231469c tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:31.421748 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cd242291-2b3c-49a3-8106-ca0b2231469c tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:31.421927 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b0c235a4-1a38-4d31-978c-54771a24e156 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '.version_select at 0x7f5cc1064040>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:31.422590 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cd242291-2b3c-49a3-8106-ca0b2231469c tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:31.423130 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cd242291-2b3c-49a3-8106-ca0b2231469c tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:31.423580 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cd242291-2b3c-49a3-8106-ca0b2231469c tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:31.495446 n-d-master-1 devstack@n-api.service[120944]: DEBUG neutronclient.v2_0.client [None req-b0c235a4-1a38-4d31-978c-54771a24e156 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3e7ee609-b62e-413c-8667-8711a29148e3 does not exist", "detail": ""}} {{(pid=120944) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 23 01:24:31.496750 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.security_group_api [None req-b0c235a4-1a38-4d31-978c-54771a24e156 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Neutron security group 3e7ee609-b62e-413c-8667-8711a29148e3 not found {{(pid=120944) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 23 01:24:31.497500 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-b0c235a4-1a38-4d31-978c-54771a24e156 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] HTTP exception thrown: Security group 3e7ee609-b62e-413c-8667-8711a29148e3 does not exist Oct 23 01:24:31.497500 n-d-master-1 devstack@n-api.service[120944]: Neutron server returns request_ids: ['req-3818da03-acfc-4250-9f36-ec633ee2f93f'] Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b0c235a4-1a38-4d31-978c-54771a24e156 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Request method failure captured: Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/os-security-groups/3e7ee609-b62e-413c-8667-8711a29148e3 HTTP/1.1 Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJe3mET0Sd7lZbPfIN3VkjmqiroRssL9JbOguxpn1sZ00E3M8viQBbgfQ2g7IyamsO6Vg1eRk3unJQGVa1SLVceO_jtTkwsvZ7R_UZpRIovLO2xYyroaQHuRt-8XjOXN_zV_7Obxi_ZE4mM221EAm7ZWkONLhuVRvJ2vR8Bciy4qSyo Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 8d9f6afbdbf74318a98dfe455a72ac7c Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-SecurityGroupsTestJSON-215153901 Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8d9f6afbdbf74318a98dfe455a72ac7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8d9f6afbdbf74318a98dfe455a72ac7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8d9f6afbdbf74318a98dfe455a72ac7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8d9f6afbdbf74318a98dfe455a72ac7c"}]}] Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-SecurityGroupsTestJSON-215153901 Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 8d9f6afbdbf74318a98dfe455a72ac7c Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-215153901 Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-SecurityGroupsTestJSON-215153901-project Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 2b8a867611614ea585d510d62c63cfa3 Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-SecurityGroupsTestJSON-215153901-project Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: method: Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: exception: Security group 3e7ee609-b62e-413c-8667-8711a29148e3 does not exist Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: Neutron server returns request_ids: ['req-3818da03-acfc-4250-9f36-ec633ee2f93f'] Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '3e7ee609-b62e-413c-8667-8711a29148e3'} Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 23 01:24:31.500145 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3e7ee609-b62e-413c-8667-8711a29148e3 does not exist Oct 23 01:24:31.504295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3818da03-acfc-4250-9f36-ec633ee2f93f'] Oct 23 01:24:31.504295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:24:31.504295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:24:31.504295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:24:31.504295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:24:31.504295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 23 01:24:31.504295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 23 01:24:31.504295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 23 01:24:31.504295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 23 01:24:31.504295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3e7ee609-b62e-413c-8667-8711a29148e3 does not exist Oct 23 01:24:31.504295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3818da03-acfc-4250-9f36-ec633ee2f93f'] Oct 23 01:24:31.504295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:24:31.504295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:24:31.504295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:24:31.504295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:24:31.504295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:24:31.504295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:24:31.504295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:24:31.504295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:24:31.504295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:24:31.504295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:24:31.504295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:24:31.504295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:24:31.504295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 23 01:24:31.504295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 23 01:24:31.504295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3e7ee609-b62e-413c-8667-8711a29148e3 does not exist Oct 23 01:24:31.504295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3818da03-acfc-4250-9f36-ec633ee2f93f'] Oct 23 01:24:31.504295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:24:31.504295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:24:31.504295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:24:31.504295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:24:31.504295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:24:31.504295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:24:31.504295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:24:31.504295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:24:31.504295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3e7ee609-b62e-413c-8667-8711a29148e3 does not exist Oct 23 01:24:31.504295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3818da03-acfc-4250-9f36-ec633ee2f93f'] Oct 23 01:24:31.504295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:24:31.508606 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b0c235a4-1a38-4d31-978c-54771a24e156 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Returning 404 to user: Security group 3e7ee609-b62e-413c-8667-8711a29148e3 does not exist Oct 23 01:24:31.508606 n-d-master-1 devstack@n-api.service[120944]: Neutron server returns request_ids: ['req-3818da03-acfc-4250-9f36-ec633ee2f93f'] {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:24:31.509893 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b0c235a4-1a38-4d31-978c-54771a24e156 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "GET /compute/v2.1/os-security-groups/3e7ee609-b62e-413c-8667-8711a29148e3" status: 404 len: 194 microversion: 2.1 time: 0.101471 Oct 23 01:24:31.510656 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1798/3574] 10.222.0.42 () {58 vars in 1269 bytes} [Sun Oct 23 01:24:31 2022] GET /compute/v2.1/os-security-groups/3e7ee609-b62e-413c-8667-8711a29148e3 => generated 194 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:24:31.527926 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dab569b3-b836-4662-b5e4-a62fe7332a5d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Action: 'create', calling method: .version_select at 0x7f5cc10e3f70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1820836589", "description": "tempest-description-1784070514"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:24:31.661274 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cd242291-2b3c-49a3-8106-ca0b2231469c tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:31.669634 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cd242291-2b3c-49a3-8106-ca0b2231469c tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1725 microversion: 2.1 time: 0.272390 Oct 23 01:24:31.670237 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1777/3575] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:31 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1725 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:31.760268 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-49d82657-be28-405c-9be1-24a77539aa66 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:31.762520 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-49d82657-be28-405c-9be1-24a77539aa66 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:31.772843 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-49d82657-be28-405c-9be1-24a77539aa66 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:31.773658 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-49d82657-be28-405c-9be1-24a77539aa66 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:31.774490 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-49d82657-be28-405c-9be1-24a77539aa66 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:31.776331 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-49d82657-be28-405c-9be1-24a77539aa66 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:31.777014 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-49d82657-be28-405c-9be1-24a77539aa66 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:31.777718 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-49d82657-be28-405c-9be1-24a77539aa66 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:32.050621 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-49d82657-be28-405c-9be1-24a77539aa66 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:32.060662 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-49d82657-be28-405c-9be1-24a77539aa66 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4" status: 200 len: 1371 microversion: 2.1 time: 0.306021 Oct 23 01:24:32.061499 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1778/3576] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:31 2022] GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4 => generated 1371 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:24:32.077280 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-dab569b3-b836-4662-b5e4-a62fe7332a5d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.553892 Oct 23 01:24:32.082535 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1799/3577] 10.222.0.42 () {60 vars in 1180 bytes} [Sun Oct 23 01:24:31 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:24:32.082804 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e346be6b-ece3-40fa-bc4a-8ecd8dd2eeed tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:32.084368 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e346be6b-ece3-40fa-bc4a-8ecd8dd2eeed tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: 8ce9f585-473f-4f8f-a5e6-7b83b7303ccb] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:32.094033 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2ffff820-67a9-48c5-b648-81fd89c15698 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Action: 'create', calling method: .version_select at 0x7f5cc1064820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1435119309", "description": "tempest-description-1691989125"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:24:32.095471 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e346be6b-ece3-40fa-bc4a-8ecd8dd2eeed tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:32.096134 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e346be6b-ece3-40fa-bc4a-8ecd8dd2eeed tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:32.097893 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e346be6b-ece3-40fa-bc4a-8ecd8dd2eeed tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:32.102496 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e346be6b-ece3-40fa-bc4a-8ecd8dd2eeed tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:32.102496 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e346be6b-ece3-40fa-bc4a-8ecd8dd2eeed tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:32.102496 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e346be6b-ece3-40fa-bc4a-8ecd8dd2eeed tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:32.143615 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e346be6b-ece3-40fa-bc4a-8ecd8dd2eeed tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066928 Oct 23 01:24:32.145398 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1779/3578] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:24:32 2022] GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:24:32.608579 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-8b8caa54-0e35-4afc-97eb-cbd10d899af9 req-faabe250-9437-48fb-aa10-4ad345edc135 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38daa540-d4d0-4644-8ed5-a1f6a4fea4e4", "name": "network-vif-plugged", "status": "completed", "tag": "d22e97f1-10e1-4cba-878f-0a05d24b97c0"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:24:32.629952 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-8b8caa54-0e35-4afc-97eb-cbd10d899af9 req-faabe250-9437-48fb-aa10-4ad345edc135 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:32.631735 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-8b8caa54-0e35-4afc-97eb-cbd10d899af9 req-faabe250-9437-48fb-aa10-4ad345edc135 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:32.632233 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-8b8caa54-0e35-4afc-97eb-cbd10d899af9 req-faabe250-9437-48fb-aa10-4ad345edc135 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:32.644270 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-8b8caa54-0e35-4afc-97eb-cbd10d899af9 req-faabe250-9437-48fb-aa10-4ad345edc135 service nova] Creating event network-vif-plugged:d22e97f1-10e1-4cba-878f-0a05d24b97c0 for instance 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4 on n-h2-master-1 Oct 23 01:24:32.653657 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-8b8caa54-0e35-4afc-97eb-cbd10d899af9 req-faabe250-9437-48fb-aa10-4ad345edc135 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047930 Oct 23 01:24:32.661174 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1780/3579] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:24:32.695159 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-eba80fdb-fd47-41b4-96e1-be1771d52f17 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:32.695975 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-eba80fdb-fd47-41b4-96e1-be1771d52f17 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:32.703258 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eba80fdb-fd47-41b4-96e1-be1771d52f17 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:32.703743 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eba80fdb-fd47-41b4-96e1-be1771d52f17 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:32.704648 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eba80fdb-fd47-41b4-96e1-be1771d52f17 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:32.707076 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eba80fdb-fd47-41b4-96e1-be1771d52f17 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:32.707883 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eba80fdb-fd47-41b4-96e1-be1771d52f17 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:32.708587 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eba80fdb-fd47-41b4-96e1-be1771d52f17 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:32.731322 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2ffff820-67a9-48c5-b648-81fd89c15698 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.640593 Oct 23 01:24:32.732502 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1800/3580] 10.222.0.42 () {60 vars in 1180 bytes} [Sun Oct 23 01:24:32 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:24:32.748236 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-af8505f1-5209-4980-8b4f-3f6770d703c4 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Action: 'create', calling method: .version_select at 0x7f5cc108e940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1724467844", "description": "tempest-description-601726809"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:24:32.886732 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-eba80fdb-fd47-41b4-96e1-be1771d52f17 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:32.900934 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-eba80fdb-fd47-41b4-96e1-be1771d52f17 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1725 microversion: 2.1 time: 0.210357 Oct 23 01:24:32.915227 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1781/3581] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:32 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1725 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:24:33.086604 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-495960a3-bedd-4ac4-a24c-86588cb65f82 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:33.087228 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-495960a3-bedd-4ac4-a24c-86588cb65f82 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:33.093504 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-495960a3-bedd-4ac4-a24c-86588cb65f82 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:33.094031 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-495960a3-bedd-4ac4-a24c-86588cb65f82 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:33.094635 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-495960a3-bedd-4ac4-a24c-86588cb65f82 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:33.095343 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-495960a3-bedd-4ac4-a24c-86588cb65f82 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:33.095797 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-495960a3-bedd-4ac4-a24c-86588cb65f82 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:33.096220 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-495960a3-bedd-4ac4-a24c-86588cb65f82 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:33.306876 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-af8505f1-5209-4980-8b4f-3f6770d703c4 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.563752 Oct 23 01:24:33.307909 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1801/3582] 10.222.0.42 () {60 vars in 1180 bytes} [Sun Oct 23 01:24:32 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:24:33.311824 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-495960a3-bedd-4ac4-a24c-86588cb65f82 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:33.312831 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8ebf52cf-a018-479c-a505-7cd08048ca89 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:33.317994 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8ebf52cf-a018-479c-a505-7cd08048ca89 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: 8ce9f585-473f-4f8f-a5e6-7b83b7303ccb] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:33.323206 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-495960a3-bedd-4ac4-a24c-86588cb65f82 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4" status: 200 len: 1371 microversion: 2.1 time: 0.240867 Oct 23 01:24:33.324365 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1782/3583] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:33 2022] GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4 => generated 1371 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:24:33.345427 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ba0555f4-3647-4d76-ada7-63ae4be4769a tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '.version_select at 0x7f5cc17de940>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:33.359352 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ebf52cf-a018-479c-a505-7cd08048ca89 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:33.364524 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ebf52cf-a018-479c-a505-7cd08048ca89 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:33.365139 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ebf52cf-a018-479c-a505-7cd08048ca89 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:33.367550 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ebf52cf-a018-479c-a505-7cd08048ca89 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:33.376272 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ebf52cf-a018-479c-a505-7cd08048ca89 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:33.377023 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ebf52cf-a018-479c-a505-7cd08048ca89 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:33.416766 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8ebf52cf-a018-479c-a505-7cd08048ca89 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107579 Oct 23 01:24:33.417588 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1802/3584] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:24:33 2022] GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:24:33.650782 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ba0555f4-3647-4d76-ada7-63ae4be4769a tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "GET /compute/v2.1/os-security-groups" status: 200 len: 1834 microversion: 2.1 time: 0.325024 Oct 23 01:24:33.651276 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1783/3585] 10.222.0.42 () {58 vars in 1158 bytes} [Sun Oct 23 01:24:33 2022] GET /compute/v2.1/os-security-groups => generated 1834 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:33.666561 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4c5b9332-a26c-43ec-8482-58717688da9a tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '.version_select at 0x7f5cc1067ca0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:33.927279 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-09c46e10-69c2-404f-b73b-2d6d648e6142 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:33.928566 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-09c46e10-69c2-404f-b73b-2d6d648e6142 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:33.942908 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09c46e10-69c2-404f-b73b-2d6d648e6142 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:33.945065 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09c46e10-69c2-404f-b73b-2d6d648e6142 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:33.945633 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09c46e10-69c2-404f-b73b-2d6d648e6142 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:33.948747 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09c46e10-69c2-404f-b73b-2d6d648e6142 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:33.949388 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09c46e10-69c2-404f-b73b-2d6d648e6142 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:33.950413 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09c46e10-69c2-404f-b73b-2d6d648e6142 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:34.009089 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4c5b9332-a26c-43ec-8482-58717688da9a tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/51c408df-5c0d-4b84-a46c-93a514c393fe" status: 202 len: 0 microversion: 2.1 time: 0.346291 Oct 23 01:24:34.010677 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1803/3586] 10.222.0.42 () {58 vars in 1272 bytes} [Sun Oct 23 01:24:33 2022] DELETE /compute/v2.1/os-security-groups/51c408df-5c0d-4b84-a46c-93a514c393fe => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:24:34.022926 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1e46f8ad-4eba-4149-8921-ccbcd7f4507b tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '.version_select at 0x7f5cc10678b0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:34.110373 n-d-master-1 devstack@n-api.service[120944]: DEBUG neutronclient.v2_0.client [None req-1e46f8ad-4eba-4149-8921-ccbcd7f4507b tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 51c408df-5c0d-4b84-a46c-93a514c393fe does not exist", "detail": ""}} {{(pid=120944) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 23 01:24:34.112602 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.security_group_api [None req-1e46f8ad-4eba-4149-8921-ccbcd7f4507b tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Neutron security group 51c408df-5c0d-4b84-a46c-93a514c393fe not found {{(pid=120944) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 23 01:24:34.113219 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-1e46f8ad-4eba-4149-8921-ccbcd7f4507b tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] HTTP exception thrown: Security group 51c408df-5c0d-4b84-a46c-93a514c393fe does not exist Oct 23 01:24:34.113219 n-d-master-1 devstack@n-api.service[120944]: Neutron server returns request_ids: ['req-3bd64ab1-1f6d-4290-8ffe-b000dc9f00fb'] Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1e46f8ad-4eba-4149-8921-ccbcd7f4507b tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Request method failure captured: Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/os-security-groups/51c408df-5c0d-4b84-a46c-93a514c393fe HTTP/1.1 Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJe3mET0Sd7lZbPfIN3VkjmqiroRssL9JbOguxpn1sZ00E3M8viQBbgfQ2g7IyamsO6Vg1eRk3unJQGVa1SLVceO_jtTkwsvZ7R_UZpRIovLO2xYyroaQHuRt-8XjOXN_zV_7Obxi_ZE4mM221EAm7ZWkONLhuVRvJ2vR8Bciy4qSyo Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 8d9f6afbdbf74318a98dfe455a72ac7c Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-SecurityGroupsTestJSON-215153901 Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8d9f6afbdbf74318a98dfe455a72ac7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8d9f6afbdbf74318a98dfe455a72ac7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8d9f6afbdbf74318a98dfe455a72ac7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8d9f6afbdbf74318a98dfe455a72ac7c"}]}] Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-SecurityGroupsTestJSON-215153901 Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 8d9f6afbdbf74318a98dfe455a72ac7c Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-215153901 Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-SecurityGroupsTestJSON-215153901-project Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 2b8a867611614ea585d510d62c63cfa3 Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-SecurityGroupsTestJSON-215153901-project Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: method: Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: exception: Security group 51c408df-5c0d-4b84-a46c-93a514c393fe does not exist Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: Neutron server returns request_ids: ['req-3bd64ab1-1f6d-4290-8ffe-b000dc9f00fb'] Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '51c408df-5c0d-4b84-a46c-93a514c393fe'} Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 23 01:24:34.124051 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 51c408df-5c0d-4b84-a46c-93a514c393fe does not exist Oct 23 01:24:34.138331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3bd64ab1-1f6d-4290-8ffe-b000dc9f00fb'] Oct 23 01:24:34.138331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:24:34.138331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:24:34.138331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:24:34.138331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:24:34.138331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 23 01:24:34.138331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 23 01:24:34.138331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 23 01:24:34.138331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 23 01:24:34.138331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 51c408df-5c0d-4b84-a46c-93a514c393fe does not exist Oct 23 01:24:34.138331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3bd64ab1-1f6d-4290-8ffe-b000dc9f00fb'] Oct 23 01:24:34.138331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:24:34.138331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:24:34.138331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:24:34.138331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:24:34.138331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:24:34.138331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:24:34.138331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:24:34.138331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:24:34.138331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:24:34.138331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:24:34.138331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:24:34.138331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:24:34.138331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 23 01:24:34.138331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 23 01:24:34.138331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 51c408df-5c0d-4b84-a46c-93a514c393fe does not exist Oct 23 01:24:34.138331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3bd64ab1-1f6d-4290-8ffe-b000dc9f00fb'] Oct 23 01:24:34.138331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:24:34.138331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:24:34.138331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:24:34.138331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:24:34.138331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:24:34.138331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:24:34.138331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:24:34.138331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:24:34.138331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 51c408df-5c0d-4b84-a46c-93a514c393fe does not exist Oct 23 01:24:34.138331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3bd64ab1-1f6d-4290-8ffe-b000dc9f00fb'] Oct 23 01:24:34.138331 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:24:34.138331 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1e46f8ad-4eba-4149-8921-ccbcd7f4507b tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Returning 404 to user: Security group 51c408df-5c0d-4b84-a46c-93a514c393fe does not exist Oct 23 01:24:34.138331 n-d-master-1 devstack@n-api.service[120944]: Neutron server returns request_ids: ['req-3bd64ab1-1f6d-4290-8ffe-b000dc9f00fb'] {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:24:34.138331 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1e46f8ad-4eba-4149-8921-ccbcd7f4507b tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "GET /compute/v2.1/os-security-groups/51c408df-5c0d-4b84-a46c-93a514c393fe" status: 404 len: 194 microversion: 2.1 time: 0.110619 Oct 23 01:24:34.138331 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1804/3587] 10.222.0.42 () {58 vars in 1269 bytes} [Sun Oct 23 01:24:34 2022] GET /compute/v2.1/os-security-groups/51c408df-5c0d-4b84-a46c-93a514c393fe => generated 194 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:24:34.154099 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-766422f1-c411-4710-9144-7ee691fe23a3 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '.version_select at 0x7f5cc1064550>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:34.302265 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-09c46e10-69c2-404f-b73b-2d6d648e6142 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:34.323052 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-09c46e10-69c2-404f-b73b-2d6d648e6142 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1725 microversion: 2.1 time: 0.396905 Oct 23 01:24:34.325219 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1784/3588] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:33 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1725 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:24:34.349737 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0f770fa5-c0da-4b50-8cf5-0a60809feec9 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:34.351471 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0f770fa5-c0da-4b50-8cf5-0a60809feec9 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:34.366495 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0f770fa5-c0da-4b50-8cf5-0a60809feec9 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:34.369257 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0f770fa5-c0da-4b50-8cf5-0a60809feec9 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:34.369257 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0f770fa5-c0da-4b50-8cf5-0a60809feec9 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:34.378417 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0f770fa5-c0da-4b50-8cf5-0a60809feec9 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:34.379410 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0f770fa5-c0da-4b50-8cf5-0a60809feec9 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:34.379869 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0f770fa5-c0da-4b50-8cf5-0a60809feec9 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:34.587560 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0f770fa5-c0da-4b50-8cf5-0a60809feec9 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:34.597211 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0f770fa5-c0da-4b50-8cf5-0a60809feec9 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4" status: 200 len: 1371 microversion: 2.1 time: 0.252435 Oct 23 01:24:34.597815 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1785/3589] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:34 2022] GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4 => generated 1371 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:34.602891 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7baa3465-b892-4693-9582-dd537d80f17e tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:34.605190 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7baa3465-b892-4693-9582-dd537d80f17e tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: 8ce9f585-473f-4f8f-a5e6-7b83b7303ccb] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:34.614809 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7baa3465-b892-4693-9582-dd537d80f17e tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:34.615310 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7baa3465-b892-4693-9582-dd537d80f17e tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:34.615764 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7baa3465-b892-4693-9582-dd537d80f17e tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:34.616477 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7baa3465-b892-4693-9582-dd537d80f17e tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:34.616940 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7baa3465-b892-4693-9582-dd537d80f17e tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:34.617585 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7baa3465-b892-4693-9582-dd537d80f17e tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:34.651018 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7baa3465-b892-4693-9582-dd537d80f17e tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051839 Oct 23 01:24:34.651672 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1786/3590] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:24:34 2022] GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:24:34.787142 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-766422f1-c411-4710-9144-7ee691fe23a3 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/26276d43-87d4-4bdf-b629-89c13322aeb7" status: 202 len: 0 microversion: 2.1 time: 0.648773 Oct 23 01:24:34.793836 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1805/3591] 10.222.0.42 () {58 vars in 1272 bytes} [Sun Oct 23 01:24:34 2022] DELETE /compute/v2.1/os-security-groups/26276d43-87d4-4bdf-b629-89c13322aeb7 => generated 0 bytes in 656 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:24:34.799785 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7858131a-109d-4b0e-8d61-79d40bedcb2d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '.version_select at 0x7f5cc1eee670>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:34.895622 n-d-master-1 devstack@n-api.service[120945]: DEBUG neutronclient.v2_0.client [None req-7858131a-109d-4b0e-8d61-79d40bedcb2d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 26276d43-87d4-4bdf-b629-89c13322aeb7 does not exist", "detail": ""}} {{(pid=120945) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 23 01:24:34.896515 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.security_group_api [None req-7858131a-109d-4b0e-8d61-79d40bedcb2d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Neutron security group 26276d43-87d4-4bdf-b629-89c13322aeb7 not found {{(pid=120945) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 23 01:24:34.897302 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-7858131a-109d-4b0e-8d61-79d40bedcb2d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] HTTP exception thrown: Security group 26276d43-87d4-4bdf-b629-89c13322aeb7 does not exist Oct 23 01:24:34.897302 n-d-master-1 devstack@n-api.service[120945]: Neutron server returns request_ids: ['req-b55111dc-bc3a-40b7-a655-a64692cb857a'] Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7858131a-109d-4b0e-8d61-79d40bedcb2d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Request method failure captured: Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/os-security-groups/26276d43-87d4-4bdf-b629-89c13322aeb7 HTTP/1.1 Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJe3mET0Sd7lZbPfIN3VkjmqiroRssL9JbOguxpn1sZ00E3M8viQBbgfQ2g7IyamsO6Vg1eRk3unJQGVa1SLVceO_jtTkwsvZ7R_UZpRIovLO2xYyroaQHuRt-8XjOXN_zV_7Obxi_ZE4mM221EAm7ZWkONLhuVRvJ2vR8Bciy4qSyo Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 8d9f6afbdbf74318a98dfe455a72ac7c Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-SecurityGroupsTestJSON-215153901 Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8d9f6afbdbf74318a98dfe455a72ac7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8d9f6afbdbf74318a98dfe455a72ac7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8d9f6afbdbf74318a98dfe455a72ac7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8d9f6afbdbf74318a98dfe455a72ac7c"}]}] Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-SecurityGroupsTestJSON-215153901 Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 8d9f6afbdbf74318a98dfe455a72ac7c Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-215153901 Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-SecurityGroupsTestJSON-215153901-project Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 2b8a867611614ea585d510d62c63cfa3 Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-SecurityGroupsTestJSON-215153901-project Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: method: Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: exception: Security group 26276d43-87d4-4bdf-b629-89c13322aeb7 does not exist Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: Neutron server returns request_ids: ['req-b55111dc-bc3a-40b7-a655-a64692cb857a'] Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '26276d43-87d4-4bdf-b629-89c13322aeb7'} Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 23 01:24:34.900537 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 26276d43-87d4-4bdf-b629-89c13322aeb7 does not exist Oct 23 01:24:34.905225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b55111dc-bc3a-40b7-a655-a64692cb857a'] Oct 23 01:24:34.905225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:24:34.905225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:24:34.905225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:24:34.905225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:24:34.905225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 23 01:24:34.905225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 23 01:24:34.905225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 23 01:24:34.905225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 23 01:24:34.905225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 26276d43-87d4-4bdf-b629-89c13322aeb7 does not exist Oct 23 01:24:34.905225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b55111dc-bc3a-40b7-a655-a64692cb857a'] Oct 23 01:24:34.905225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:24:34.905225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:24:34.905225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:24:34.905225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:24:34.905225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:24:34.905225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:24:34.905225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:24:34.905225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:24:34.905225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:24:34.905225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:24:34.905225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:24:34.905225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:24:34.905225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 23 01:24:34.905225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 23 01:24:34.905225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 26276d43-87d4-4bdf-b629-89c13322aeb7 does not exist Oct 23 01:24:34.905225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b55111dc-bc3a-40b7-a655-a64692cb857a'] Oct 23 01:24:34.905225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:24:34.905225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:24:34.905225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:24:34.905225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:24:34.905225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:24:34.905225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:24:34.905225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:24:34.905225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:24:34.905225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 26276d43-87d4-4bdf-b629-89c13322aeb7 does not exist Oct 23 01:24:34.905225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b55111dc-bc3a-40b7-a655-a64692cb857a'] Oct 23 01:24:34.905225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:24:34.909488 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7858131a-109d-4b0e-8d61-79d40bedcb2d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Returning 404 to user: Security group 26276d43-87d4-4bdf-b629-89c13322aeb7 does not exist Oct 23 01:24:34.909488 n-d-master-1 devstack@n-api.service[120945]: Neutron server returns request_ids: ['req-b55111dc-bc3a-40b7-a655-a64692cb857a'] {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:24:34.910913 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7858131a-109d-4b0e-8d61-79d40bedcb2d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "GET /compute/v2.1/os-security-groups/26276d43-87d4-4bdf-b629-89c13322aeb7" status: 404 len: 194 microversion: 2.1 time: 0.116284 Oct 23 01:24:34.913446 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1787/3592] 10.222.0.42 () {58 vars in 1269 bytes} [Sun Oct 23 01:24:34 2022] GET /compute/v2.1/os-security-groups/26276d43-87d4-4bdf-b629-89c13322aeb7 => generated 194 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 01:24:34.921365 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-071197dc-59c8-4cee-bcbf-b174da65be56 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '.version_select at 0x7f5cc105aaf0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:34.980172 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-61460c1e-2f14-489c-98ba-39d6ab45f9b7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1471224606", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "bfd27401-e218-45f7-934d-3c3c9ab67b12"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:24:35.085734 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-61460c1e-2f14-489c-98ba-39d6ab45f9b7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] validate_networks() for [('bfd27401-e218-45f7-934d-3c3c9ab67b12', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:24:35.594113 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-071197dc-59c8-4cee-bcbf-b174da65be56 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/4a618366-6623-40a6-a8d1-4b374cbba96a" status: 202 len: 0 microversion: 2.1 time: 0.676841 Oct 23 01:24:35.600976 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1806/3593] 10.222.0.42 () {58 vars in 1272 bytes} [Sun Oct 23 01:24:34 2022] DELETE /compute/v2.1/os-security-groups/4a618366-6623-40a6-a8d1-4b374cbba96a => generated 0 bytes in 684 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:24:35.610332 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-13f745b7-a14f-450e-97a8-89d0365eb912 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:35.611193 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-13f745b7-a14f-450e-97a8-89d0365eb912 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:35.648562 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13f745b7-a14f-450e-97a8-89d0365eb912 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:35.651917 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13f745b7-a14f-450e-97a8-89d0365eb912 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:35.652567 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13f745b7-a14f-450e-97a8-89d0365eb912 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:35.655049 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13f745b7-a14f-450e-97a8-89d0365eb912 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:35.657490 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13f745b7-a14f-450e-97a8-89d0365eb912 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:35.659404 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13f745b7-a14f-450e-97a8-89d0365eb912 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:35.741391 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-61460c1e-2f14-489c-98ba-39d6ab45f9b7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:24:35.741954 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-61460c1e-2f14-489c-98ba-39d6ab45f9b7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:24:35.742646 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-61460c1e-2f14-489c-98ba-39d6ab45f9b7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:24:35.743324 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-61460c1e-2f14-489c-98ba-39d6ab45f9b7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:24:35.743808 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-61460c1e-2f14-489c-98ba-39d6ab45f9b7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:24:35.766673 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61460c1e-2f14-489c-98ba-39d6ab45f9b7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:35.773074 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61460c1e-2f14-489c-98ba-39d6ab45f9b7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:35.773074 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61460c1e-2f14-489c-98ba-39d6ab45f9b7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:35.773074 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61460c1e-2f14-489c-98ba-39d6ab45f9b7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:35.773074 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61460c1e-2f14-489c-98ba-39d6ab45f9b7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:35.776192 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61460c1e-2f14-489c-98ba-39d6ab45f9b7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:35.814456 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-61460c1e-2f14-489c-98ba-39d6ab45f9b7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Getting quotas for project 0a369d45e4804ffca2e89cb72f447a82. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:24:35.820933 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-61460c1e-2f14-489c-98ba-39d6ab45f9b7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Getting quotas for user 60276a4031ee45ffa651b5467a62a81b and project 0a369d45e4804ffca2e89cb72f447a82. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:24:35.855400 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-61460c1e-2f14-489c-98ba-39d6ab45f9b7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:24:35.859010 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-61460c1e-2f14-489c-98ba-39d6ab45f9b7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:24:35.922517 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-13f745b7-a14f-450e-97a8-89d0365eb912 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:35.936805 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-13f745b7-a14f-450e-97a8-89d0365eb912 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1725 microversion: 2.1 time: 0.333845 Oct 23 01:24:35.937900 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1807/3594] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:35 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1725 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:35.943465 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6ba057d0-9a90-49aa-ac0e-44c64264568f tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '.version_select at 0x7f5cc0ff9160>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:35.972825 n-d-master-1 devstack@n-api.service[120944]: DEBUG neutronclient.v2_0.client [None req-6ba057d0-9a90-49aa-ac0e-44c64264568f tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4a618366-6623-40a6-a8d1-4b374cbba96a does not exist", "detail": ""}} {{(pid=120944) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 23 01:24:35.973437 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.security_group_api [None req-6ba057d0-9a90-49aa-ac0e-44c64264568f tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Neutron security group 4a618366-6623-40a6-a8d1-4b374cbba96a not found {{(pid=120944) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 23 01:24:35.973968 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-6ba057d0-9a90-49aa-ac0e-44c64264568f tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] HTTP exception thrown: Security group 4a618366-6623-40a6-a8d1-4b374cbba96a does not exist Oct 23 01:24:35.973968 n-d-master-1 devstack@n-api.service[120944]: Neutron server returns request_ids: ['req-aede2038-ddc7-4a87-a175-6b1bb319bcf1'] Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6ba057d0-9a90-49aa-ac0e-44c64264568f tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Request method failure captured: Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/os-security-groups/4a618366-6623-40a6-a8d1-4b374cbba96a HTTP/1.1 Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJe3mET0Sd7lZbPfIN3VkjmqiroRssL9JbOguxpn1sZ00E3M8viQBbgfQ2g7IyamsO6Vg1eRk3unJQGVa1SLVceO_jtTkwsvZ7R_UZpRIovLO2xYyroaQHuRt-8XjOXN_zV_7Obxi_ZE4mM221EAm7ZWkONLhuVRvJ2vR8Bciy4qSyo Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 8d9f6afbdbf74318a98dfe455a72ac7c Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-SecurityGroupsTestJSON-215153901 Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8d9f6afbdbf74318a98dfe455a72ac7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8d9f6afbdbf74318a98dfe455a72ac7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8d9f6afbdbf74318a98dfe455a72ac7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8d9f6afbdbf74318a98dfe455a72ac7c"}]}] Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-SecurityGroupsTestJSON-215153901 Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 8d9f6afbdbf74318a98dfe455a72ac7c Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-215153901 Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-SecurityGroupsTestJSON-215153901-project Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 2b8a867611614ea585d510d62c63cfa3 Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-SecurityGroupsTestJSON-215153901-project Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: method: Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: exception: Security group 4a618366-6623-40a6-a8d1-4b374cbba96a does not exist Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: Neutron server returns request_ids: ['req-aede2038-ddc7-4a87-a175-6b1bb319bcf1'] Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '4a618366-6623-40a6-a8d1-4b374cbba96a'} Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 23 01:24:35.982363 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4a618366-6623-40a6-a8d1-4b374cbba96a does not exist Oct 23 01:24:35.986339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-aede2038-ddc7-4a87-a175-6b1bb319bcf1'] Oct 23 01:24:35.986339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:24:35.986339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:24:35.986339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:24:35.986339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:24:35.986339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 23 01:24:35.986339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 23 01:24:35.986339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 23 01:24:35.986339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 23 01:24:35.986339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4a618366-6623-40a6-a8d1-4b374cbba96a does not exist Oct 23 01:24:35.986339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-aede2038-ddc7-4a87-a175-6b1bb319bcf1'] Oct 23 01:24:35.986339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:24:35.986339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:24:35.986339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:24:35.986339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:24:35.986339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:24:35.986339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:24:35.986339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:24:35.986339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:24:35.986339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:24:35.986339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:24:35.986339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:24:35.986339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:24:35.986339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 23 01:24:35.986339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 23 01:24:35.986339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4a618366-6623-40a6-a8d1-4b374cbba96a does not exist Oct 23 01:24:35.986339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-aede2038-ddc7-4a87-a175-6b1bb319bcf1'] Oct 23 01:24:35.986339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:24:35.986339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:24:35.986339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:24:35.986339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:24:35.986339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:24:35.986339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:24:35.986339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:24:35.986339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:24:35.986339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4a618366-6623-40a6-a8d1-4b374cbba96a does not exist Oct 23 01:24:35.986339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-aede2038-ddc7-4a87-a175-6b1bb319bcf1'] Oct 23 01:24:35.986339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:24:35.986339 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6ba057d0-9a90-49aa-ac0e-44c64264568f tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Returning 404 to user: Security group 4a618366-6623-40a6-a8d1-4b374cbba96a does not exist Oct 23 01:24:35.986339 n-d-master-1 devstack@n-api.service[120944]: Neutron server returns request_ids: ['req-aede2038-ddc7-4a87-a175-6b1bb319bcf1'] {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:24:35.986339 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6ba057d0-9a90-49aa-ac0e-44c64264568f tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "GET /compute/v2.1/os-security-groups/4a618366-6623-40a6-a8d1-4b374cbba96a" status: 404 len: 194 microversion: 2.1 time: 0.038108 Oct 23 01:24:35.986339 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1808/3595] 10.222.0.42 () {58 vars in 1269 bytes} [Sun Oct 23 01:24:35 2022] GET /compute/v2.1/os-security-groups/4a618366-6623-40a6-a8d1-4b374cbba96a => generated 194 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:24:35.992048 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-13c6b082-21e3-4449-91d0-335faef7fff4 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:35.992902 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-13c6b082-21e3-4449-91d0-335faef7fff4 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:35.999922 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13c6b082-21e3-4449-91d0-335faef7fff4 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:36.000519 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13c6b082-21e3-4449-91d0-335faef7fff4 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:36.000959 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13c6b082-21e3-4449-91d0-335faef7fff4 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:36.005547 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13c6b082-21e3-4449-91d0-335faef7fff4 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:36.005547 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13c6b082-21e3-4449-91d0-335faef7fff4 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:36.005547 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13c6b082-21e3-4449-91d0-335faef7fff4 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:36.075136 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-61460c1e-2f14-489c-98ba-39d6ab45f9b7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.099931 Oct 23 01:24:36.076464 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1788/3596] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:24:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1103 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 23 01:24:36.089577 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-aa23b520-7878-4ca5-b100-5dfd7ff5c2c7 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '.version_select at 0x7f5cc18af040>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:36.521710 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-13c6b082-21e3-4449-91d0-335faef7fff4 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:36.530981 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-13c6b082-21e3-4449-91d0-335faef7fff4 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4" status: 200 len: 1565 microversion: 2.1 time: 0.549102 Oct 23 01:24:36.542063 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1809/3597] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:35 2022] GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4 => generated 1565 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:36.551875 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-984a7679-5371-4b0f-be95-fa55e7bcb3a2 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:36.554471 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-984a7679-5371-4b0f-be95-fa55e7bcb3a2 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:36.584235 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-aa23b520-7878-4ca5-b100-5dfd7ff5c2c7 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.506305 Oct 23 01:24:36.584814 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1789/3598] 10.222.0.42 () {58 vars in 1158 bytes} [Sun Oct 23 01:24:36 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:36.609263 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-59329e94-9578-42be-a5f5-97e013c227d4 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:36.609263 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-59329e94-9578-42be-a5f5-97e013c227d4 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:36.618095 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-59329e94-9578-42be-a5f5-97e013c227d4 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:36.618868 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-59329e94-9578-42be-a5f5-97e013c227d4 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:36.619521 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-59329e94-9578-42be-a5f5-97e013c227d4 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:36.621063 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-59329e94-9578-42be-a5f5-97e013c227d4 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:36.621711 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-59329e94-9578-42be-a5f5-97e013c227d4 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:36.622856 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-59329e94-9578-42be-a5f5-97e013c227d4 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:37.094870 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-984a7679-5371-4b0f-be95-fa55e7bcb3a2 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60276a4031ee45ffa651b5467a62a81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a369d45e4804ffca2e89cb72f447a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:37.124074 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-984a7679-5371-4b0f-be95-fa55e7bcb3a2 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "GET /compute/v2.1/servers/c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd" status: 200 len: 1218 microversion: 2.1 time: 0.582392 Oct 23 01:24:37.124789 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1810/3599] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:36 2022] GET /compute/v2.1/servers/c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd => generated 1218 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:37.151981 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f5aff29a-63d6-4a5f-943b-70e603b4c6ee tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Action: 'create', calling method: .version_select at 0x7f5cc0ffaca0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1146812390", "description": "tempest-description-518231975"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:24:37.184177 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-59329e94-9578-42be-a5f5-97e013c227d4 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.582341 Oct 23 01:24:37.185625 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1790/3600] 10.222.0.42 () {58 vars in 1275 bytes} [Sun Oct 23 01:24:36 2022] GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4/os-interface => generated 284 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:24:37.192294 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-38305604-8afc-40a0-ae47-ee4e81d2c59a tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:37.193376 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-38305604-8afc-40a0-ae47-ee4e81d2c59a tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:37.204937 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-38305604-8afc-40a0-ae47-ee4e81d2c59a tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:37.205442 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-38305604-8afc-40a0-ae47-ee4e81d2c59a tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:37.208777 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-38305604-8afc-40a0-ae47-ee4e81d2c59a tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:37.216338 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-38305604-8afc-40a0-ae47-ee4e81d2c59a tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:37.216338 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-38305604-8afc-40a0-ae47-ee4e81d2c59a tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:37.216338 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-38305604-8afc-40a0-ae47-ee4e81d2c59a tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:37.529246 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-38305604-8afc-40a0-ae47-ee4e81d2c59a tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:37.544041 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-38305604-8afc-40a0-ae47-ee4e81d2c59a tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1725 microversion: 2.1 time: 0.354913 Oct 23 01:24:37.548630 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1791/3601] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:37 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1725 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:37.835265 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f5aff29a-63d6-4a5f-943b-70e603b4c6ee tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.704684 Oct 23 01:24:37.838520 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1811/3602] 10.222.0.42 () {60 vars in 1180 bytes} [Sun Oct 23 01:24:37 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:24:37.855261 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c42648ab-d001-4c29-abdc-514b0dcbdefc tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Action: 'create', calling method: .version_select at 0x7f5cc1851dc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-965208627", "description": "tempest-description-1296815025"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:24:38.151020 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-477f4fa6-0622-478e-9de6-f71cba0d453f tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:38.152533 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-477f4fa6-0622-478e-9de6-f71cba0d453f tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:38.161266 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-477f4fa6-0622-478e-9de6-f71cba0d453f tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:38.168742 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-477f4fa6-0622-478e-9de6-f71cba0d453f tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:38.168742 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-477f4fa6-0622-478e-9de6-f71cba0d453f tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:38.168742 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-477f4fa6-0622-478e-9de6-f71cba0d453f tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:38.168742 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-477f4fa6-0622-478e-9de6-f71cba0d453f tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:38.168742 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-477f4fa6-0622-478e-9de6-f71cba0d453f tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:38.338483 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-477f4fa6-0622-478e-9de6-f71cba0d453f tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60276a4031ee45ffa651b5467a62a81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a369d45e4804ffca2e89cb72f447a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:38.349786 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-477f4fa6-0622-478e-9de6-f71cba0d453f tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "GET /compute/v2.1/servers/c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd" status: 200 len: 1214 microversion: 2.1 time: 0.202561 Oct 23 01:24:38.350338 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1812/3603] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:38 2022] GET /compute/v2.1/servers/c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd => generated 1214 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:24:38.416148 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c42648ab-d001-4c29-abdc-514b0dcbdefc tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.569698 Oct 23 01:24:38.416753 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1792/3604] 10.222.0.42 () {60 vars in 1180 bytes} [Sun Oct 23 01:24:37 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:24:38.572777 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7a65a094-0c6d-4834-aecb-503c97df5d18 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:38.573396 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7a65a094-0c6d-4834-aecb-503c97df5d18 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:38.579841 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:38.582825 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7a65a094-0c6d-4834-aecb-503c97df5d18 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:38.582825 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7a65a094-0c6d-4834-aecb-503c97df5d18 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:38.582825 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7a65a094-0c6d-4834-aecb-503c97df5d18 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:38.583838 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7a65a094-0c6d-4834-aecb-503c97df5d18 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:38.584448 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7a65a094-0c6d-4834-aecb-503c97df5d18 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:38.585025 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7a65a094-0c6d-4834-aecb-503c97df5d18 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:38.654356 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2890cd2c-bfcb-48d9-836f-fbeb20db4dd7 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1132284931", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "583410c3-050d-4b95-8c25-d6e0ac312b91"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:24:38.750193 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-2890cd2c-bfcb-48d9-836f-fbeb20db4dd7 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] validate_networks() for [('583410c3-050d-4b95-8c25-d6e0ac312b91', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:24:38.896022 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7a65a094-0c6d-4834-aecb-503c97df5d18 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:38.920133 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7a65a094-0c6d-4834-aecb-503c97df5d18 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1725 microversion: 2.1 time: 0.350882 Oct 23 01:24:38.927745 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1813/3605] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:38 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1725 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:39.374901 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-61964849-82b1-4e16-b0d7-7eafef67be11 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:39.375695 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-61964849-82b1-4e16-b0d7-7eafef67be11 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:39.396873 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-61964849-82b1-4e16-b0d7-7eafef67be11 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:39.399757 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-61964849-82b1-4e16-b0d7-7eafef67be11 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:39.401467 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-2890cd2c-bfcb-48d9-836f-fbeb20db4dd7 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:24:39.401681 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-61964849-82b1-4e16-b0d7-7eafef67be11 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:39.404190 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-2890cd2c-bfcb-48d9-836f-fbeb20db4dd7 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:24:39.404333 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-61964849-82b1-4e16-b0d7-7eafef67be11 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:39.404440 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-2890cd2c-bfcb-48d9-836f-fbeb20db4dd7 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:24:39.404440 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-2890cd2c-bfcb-48d9-836f-fbeb20db4dd7 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:24:39.404440 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-2890cd2c-bfcb-48d9-836f-fbeb20db4dd7 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:24:39.404952 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-61964849-82b1-4e16-b0d7-7eafef67be11 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:39.405612 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-61964849-82b1-4e16-b0d7-7eafef67be11 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:39.421927 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2890cd2c-bfcb-48d9-836f-fbeb20db4dd7 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:39.427924 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2890cd2c-bfcb-48d9-836f-fbeb20db4dd7 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:39.427924 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2890cd2c-bfcb-48d9-836f-fbeb20db4dd7 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:39.427924 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2890cd2c-bfcb-48d9-836f-fbeb20db4dd7 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:39.427924 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2890cd2c-bfcb-48d9-836f-fbeb20db4dd7 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:39.428359 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2890cd2c-bfcb-48d9-836f-fbeb20db4dd7 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:39.455306 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-2890cd2c-bfcb-48d9-836f-fbeb20db4dd7 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Getting quotas for project 8d9f6afbdbf74318a98dfe455a72ac7c. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:24:39.461882 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-2890cd2c-bfcb-48d9-836f-fbeb20db4dd7 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Getting quotas for user 2b8a867611614ea585d510d62c63cfa3 and project 8d9f6afbdbf74318a98dfe455a72ac7c. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:24:39.479128 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2890cd2c-bfcb-48d9-836f-fbeb20db4dd7 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:24:39.481670 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2890cd2c-bfcb-48d9-836f-fbeb20db4dd7 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] [instance: aa768b59-9807-4365-a405-b6e688b1e0f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:24:39.521268 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-61964849-82b1-4e16-b0d7-7eafef67be11 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60276a4031ee45ffa651b5467a62a81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a369d45e4804ffca2e89cb72f447a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:39.530258 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-61964849-82b1-4e16-b0d7-7eafef67be11 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "GET /compute/v2.1/servers/c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd" status: 200 len: 1270 microversion: 2.1 time: 0.161348 Oct 23 01:24:39.548034 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1814/3606] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:39 2022] GET /compute/v2.1/servers/c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd => generated 1270 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:39.647698 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2890cd2c-bfcb-48d9-836f-fbeb20db4dd7 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.997410 Oct 23 01:24:39.651852 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1793/3607] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:24:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1002 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 23 01:24:39.667168 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-aca73212-fc4a-4135-b1cb-afe972071f9e tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:39.668322 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-aca73212-fc4a-4135-b1cb-afe972071f9e tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] [instance: aa768b59-9807-4365-a405-b6e688b1e0f6] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:39.773339 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-a0b7287d-62b6-4ede-a707-9f819665b758 req-31f35aaf-5582-4d48-bdc6-005b33ccd51e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38daa540-d4d0-4644-8ed5-a1f6a4fea4e4", "tag": "d22e97f1-10e1-4cba-878f-0a05d24b97c0"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:24:39.793968 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-aca73212-fc4a-4135-b1cb-afe972071f9e tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8a867611614ea585d510d62c63cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9f6afbdbf74318a98dfe455a72ac7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:39.802220 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-a0b7287d-62b6-4ede-a707-9f819665b758 req-31f35aaf-5582-4d48-bdc6-005b33ccd51e service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:39.805105 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-a0b7287d-62b6-4ede-a707-9f819665b758 req-31f35aaf-5582-4d48-bdc6-005b33ccd51e service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:39.806765 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-aca73212-fc4a-4135-b1cb-afe972071f9e tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "GET /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6" status: 200 len: 1216 microversion: 2.1 time: 0.139971 Oct 23 01:24:39.808054 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1815/3608] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:39 2022] GET /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6 => generated 1216 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:39.814355 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-a0b7287d-62b6-4ede-a707-9f819665b758 req-31f35aaf-5582-4d48-bdc6-005b33ccd51e service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:39.835410 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-a0b7287d-62b6-4ede-a707-9f819665b758 req-31f35aaf-5582-4d48-bdc6-005b33ccd51e service nova] Creating event network-changed:d22e97f1-10e1-4cba-878f-0a05d24b97c0 for instance 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4 on n-h2-master-1 Oct 23 01:24:39.844737 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-a0b7287d-62b6-4ede-a707-9f819665b758 req-31f35aaf-5582-4d48-bdc6-005b33ccd51e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074952 Oct 23 01:24:39.846255 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1794/3609] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:24:39.950165 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-665448f9-8cda-4e88-9218-2ec2560f4807 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:39.950793 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-665448f9-8cda-4e88-9218-2ec2560f4807 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:39.960303 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-665448f9-8cda-4e88-9218-2ec2560f4807 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:39.970751 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-665448f9-8cda-4e88-9218-2ec2560f4807 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:39.971463 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-665448f9-8cda-4e88-9218-2ec2560f4807 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:40.017077 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-665448f9-8cda-4e88-9218-2ec2560f4807 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:40.021706 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-665448f9-8cda-4e88-9218-2ec2560f4807 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.048s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:40.026246 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-665448f9-8cda-4e88-9218-2ec2560f4807 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:40.513927 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-665448f9-8cda-4e88-9218-2ec2560f4807 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:40.536677 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-665448f9-8cda-4e88-9218-2ec2560f4807 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1725 microversion: 2.1 time: 0.591493 Oct 23 01:24:40.538861 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1816/3610] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:39 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1725 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:40.555201 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-22b7b967-97aa-432f-9312-4f174f6f4b43 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:40.556071 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-22b7b967-97aa-432f-9312-4f174f6f4b43 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:40.572767 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-22b7b967-97aa-432f-9312-4f174f6f4b43 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:40.575893 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-22b7b967-97aa-432f-9312-4f174f6f4b43 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:40.575893 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-22b7b967-97aa-432f-9312-4f174f6f4b43 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:40.575893 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-22b7b967-97aa-432f-9312-4f174f6f4b43 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:40.575893 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-22b7b967-97aa-432f-9312-4f174f6f4b43 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:40.584105 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-22b7b967-97aa-432f-9312-4f174f6f4b43 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:40.672429 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-22b7b967-97aa-432f-9312-4f174f6f4b43 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60276a4031ee45ffa651b5467a62a81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a369d45e4804ffca2e89cb72f447a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:40.683249 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-22b7b967-97aa-432f-9312-4f174f6f4b43 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "GET /compute/v2.1/servers/c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd" status: 200 len: 1276 microversion: 2.1 time: 0.132558 Oct 23 01:24:40.698010 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1795/3611] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:40 2022] GET /compute/v2.1/servers/c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd => generated 1276 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:40.834203 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-118114da-a42c-45db-a56d-842bfd47ad68 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:40.835116 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-118114da-a42c-45db-a56d-842bfd47ad68 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] [instance: aa768b59-9807-4365-a405-b6e688b1e0f6] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:40.927002 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-118114da-a42c-45db-a56d-842bfd47ad68 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8a867611614ea585d510d62c63cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9f6afbdbf74318a98dfe455a72ac7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:40.938775 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-118114da-a42c-45db-a56d-842bfd47ad68 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "GET /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6" status: 200 len: 1216 microversion: 2.1 time: 0.109728 Oct 23 01:24:40.943413 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1817/3612] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:40 2022] GET /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6 => generated 1216 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:41.567838 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bcce8cc6-8fbb-4443-8ab6-f4f8d7c8becc tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:41.569200 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-bcce8cc6-8fbb-4443-8ab6-f4f8d7c8becc tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:41.580558 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bcce8cc6-8fbb-4443-8ab6-f4f8d7c8becc tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:41.581953 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bcce8cc6-8fbb-4443-8ab6-f4f8d7c8becc tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:41.583875 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bcce8cc6-8fbb-4443-8ab6-f4f8d7c8becc tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:41.584946 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bcce8cc6-8fbb-4443-8ab6-f4f8d7c8becc tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:41.585621 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bcce8cc6-8fbb-4443-8ab6-f4f8d7c8becc tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:41.586639 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bcce8cc6-8fbb-4443-8ab6-f4f8d7c8becc tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:41.712817 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-47ca7fc6-fc14-44df-8402-60405f2a2f16 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:41.716812 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-47ca7fc6-fc14-44df-8402-60405f2a2f16 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:41.731162 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-47ca7fc6-fc14-44df-8402-60405f2a2f16 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:41.731781 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-47ca7fc6-fc14-44df-8402-60405f2a2f16 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:41.732137 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-47ca7fc6-fc14-44df-8402-60405f2a2f16 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:41.732871 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-47ca7fc6-fc14-44df-8402-60405f2a2f16 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:41.733359 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-47ca7fc6-fc14-44df-8402-60405f2a2f16 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:41.733881 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-47ca7fc6-fc14-44df-8402-60405f2a2f16 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:41.826606 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bcce8cc6-8fbb-4443-8ab6-f4f8d7c8becc tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:41.836892 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bcce8cc6-8fbb-4443-8ab6-f4f8d7c8becc tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1725 microversion: 2.1 time: 0.275229 Oct 23 01:24:41.837501 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1796/3613] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:41 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1725 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:41.970861 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9eb1755f-22e5-44fe-9c1b-915b046ae6be tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:41.971567 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9eb1755f-22e5-44fe-9c1b-915b046ae6be tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] [instance: aa768b59-9807-4365-a405-b6e688b1e0f6] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:41.983839 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9eb1755f-22e5-44fe-9c1b-915b046ae6be tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:41.984350 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9eb1755f-22e5-44fe-9c1b-915b046ae6be tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:41.984801 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9eb1755f-22e5-44fe-9c1b-915b046ae6be tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:41.985536 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9eb1755f-22e5-44fe-9c1b-915b046ae6be tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:41.990056 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9eb1755f-22e5-44fe-9c1b-915b046ae6be tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:41.990653 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9eb1755f-22e5-44fe-9c1b-915b046ae6be tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:42.011596 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-47ca7fc6-fc14-44df-8402-60405f2a2f16 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60276a4031ee45ffa651b5467a62a81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a369d45e4804ffca2e89cb72f447a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:42.022011 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-47ca7fc6-fc14-44df-8402-60405f2a2f16 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "GET /compute/v2.1/servers/c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd" status: 200 len: 1318 microversion: 2.1 time: 0.312563 Oct 23 01:24:42.022934 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1818/3614] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:41 2022] GET /compute/v2.1/servers/c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd => generated 1318 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:42.148054 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9eb1755f-22e5-44fe-9c1b-915b046ae6be tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8a867611614ea585d510d62c63cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9f6afbdbf74318a98dfe455a72ac7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:42.173264 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9eb1755f-22e5-44fe-9c1b-915b046ae6be tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "GET /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6" status: 200 len: 1212 microversion: 2.1 time: 0.200919 Oct 23 01:24:42.176154 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1797/3615] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:41 2022] GET /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6 => generated 1212 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:24:42.864718 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b65c7e69-1774-4bd5-9512-f8dd75cd25dc tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:42.865396 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b65c7e69-1774-4bd5-9512-f8dd75cd25dc tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:42.875691 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b65c7e69-1774-4bd5-9512-f8dd75cd25dc tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:42.876196 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b65c7e69-1774-4bd5-9512-f8dd75cd25dc tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:42.876640 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b65c7e69-1774-4bd5-9512-f8dd75cd25dc tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:42.877350 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b65c7e69-1774-4bd5-9512-f8dd75cd25dc tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:42.877806 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b65c7e69-1774-4bd5-9512-f8dd75cd25dc tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:42.878813 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b65c7e69-1774-4bd5-9512-f8dd75cd25dc tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:43.035658 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b65c7e69-1774-4bd5-9512-f8dd75cd25dc tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:43.045403 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b65c7e69-1774-4bd5-9512-f8dd75cd25dc tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1725 microversion: 2.1 time: 0.185154 Oct 23 01:24:43.046003 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1819/3616] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:42 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1725 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:43.049209 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5e815a7c-57fb-4bf5-b099-b6872b2d3ffa tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:43.050461 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5e815a7c-57fb-4bf5-b099-b6872b2d3ffa tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:43.058091 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e815a7c-57fb-4bf5-b099-b6872b2d3ffa tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:43.059952 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e815a7c-57fb-4bf5-b099-b6872b2d3ffa tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:43.060649 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e815a7c-57fb-4bf5-b099-b6872b2d3ffa tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:43.061677 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e815a7c-57fb-4bf5-b099-b6872b2d3ffa tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:43.063110 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e815a7c-57fb-4bf5-b099-b6872b2d3ffa tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:43.063788 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e815a7c-57fb-4bf5-b099-b6872b2d3ffa tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:43.201463 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9cc5a38c-893f-4205-8c49-9150d7d17b38 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:43.202146 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9cc5a38c-893f-4205-8c49-9150d7d17b38 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] [instance: aa768b59-9807-4365-a405-b6e688b1e0f6] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:43.213054 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9cc5a38c-893f-4205-8c49-9150d7d17b38 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:43.213647 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9cc5a38c-893f-4205-8c49-9150d7d17b38 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:43.213995 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9cc5a38c-893f-4205-8c49-9150d7d17b38 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:43.217031 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9cc5a38c-893f-4205-8c49-9150d7d17b38 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:43.217552 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9cc5a38c-893f-4205-8c49-9150d7d17b38 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:43.218019 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9cc5a38c-893f-4205-8c49-9150d7d17b38 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:43.335201 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5e815a7c-57fb-4bf5-b099-b6872b2d3ffa tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60276a4031ee45ffa651b5467a62a81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a369d45e4804ffca2e89cb72f447a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:43.343965 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5e815a7c-57fb-4bf5-b099-b6872b2d3ffa tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "GET /compute/v2.1/servers/c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd" status: 200 len: 1318 microversion: 2.1 time: 0.300205 Oct 23 01:24:43.353037 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1798/3617] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:43 2022] GET /compute/v2.1/servers/c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:24:43.435759 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9cc5a38c-893f-4205-8c49-9150d7d17b38 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8a867611614ea585d510d62c63cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9f6afbdbf74318a98dfe455a72ac7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:43.447515 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9cc5a38c-893f-4205-8c49-9150d7d17b38 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "GET /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6" status: 200 len: 1268 microversion: 2.1 time: 0.250623 Oct 23 01:24:43.463560 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1820/3618] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:43 2022] GET /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6 => generated 1268 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:43.819590 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-83fc9e27-c557-4f2f-971c-aa5d32f1f9d4 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1409677705", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "5ec7e299-263d-4686-93fb-d95f25b57cf3"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:24:43.888981 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-83fc9e27-c557-4f2f-971c-aa5d32f1f9d4 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] validate_networks() for [('5ec7e299-263d-4686-93fb-d95f25b57cf3', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:24:44.072038 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a9bfe5f2-c2c0-4302-af29-bb4ff69df880 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:44.075472 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a9bfe5f2-c2c0-4302-af29-bb4ff69df880 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:44.087890 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a9bfe5f2-c2c0-4302-af29-bb4ff69df880 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:44.092394 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a9bfe5f2-c2c0-4302-af29-bb4ff69df880 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:44.092394 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a9bfe5f2-c2c0-4302-af29-bb4ff69df880 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:44.093529 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a9bfe5f2-c2c0-4302-af29-bb4ff69df880 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:44.094201 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a9bfe5f2-c2c0-4302-af29-bb4ff69df880 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:44.095321 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a9bfe5f2-c2c0-4302-af29-bb4ff69df880 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:44.384214 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a9bfe5f2-c2c0-4302-af29-bb4ff69df880 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:44.393000 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a9bfe5f2-c2c0-4302-af29-bb4ff69df880 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1725 microversion: 2.1 time: 0.326540 Oct 23 01:24:44.394575 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1821/3619] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:44 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1725 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:24:44.401171 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b261c6b8-15c4-4c1b-95a7-aa5bbd3b02f3 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:44.402384 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b261c6b8-15c4-4c1b-95a7-aa5bbd3b02f3 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:44.408912 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b261c6b8-15c4-4c1b-95a7-aa5bbd3b02f3 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:44.410196 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b261c6b8-15c4-4c1b-95a7-aa5bbd3b02f3 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:44.410804 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b261c6b8-15c4-4c1b-95a7-aa5bbd3b02f3 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:44.411744 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b261c6b8-15c4-4c1b-95a7-aa5bbd3b02f3 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:44.412197 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b261c6b8-15c4-4c1b-95a7-aa5bbd3b02f3 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:44.412688 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b261c6b8-15c4-4c1b-95a7-aa5bbd3b02f3 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:44.544937 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-83fc9e27-c557-4f2f-971c-aa5d32f1f9d4 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:24:44.548547 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-83fc9e27-c557-4f2f-971c-aa5d32f1f9d4 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:24:44.549409 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-83fc9e27-c557-4f2f-971c-aa5d32f1f9d4 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:24:44.551751 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-83fc9e27-c557-4f2f-971c-aa5d32f1f9d4 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:24:44.553066 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-83fc9e27-c557-4f2f-971c-aa5d32f1f9d4 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:24:44.594537 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83fc9e27-c557-4f2f-971c-aa5d32f1f9d4 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:44.599507 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83fc9e27-c557-4f2f-971c-aa5d32f1f9d4 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:44.603005 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83fc9e27-c557-4f2f-971c-aa5d32f1f9d4 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:44.604333 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83fc9e27-c557-4f2f-971c-aa5d32f1f9d4 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:44.604981 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83fc9e27-c557-4f2f-971c-aa5d32f1f9d4 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:44.607028 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83fc9e27-c557-4f2f-971c-aa5d32f1f9d4 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:44.619443 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b261c6b8-15c4-4c1b-95a7-aa5bbd3b02f3 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60276a4031ee45ffa651b5467a62a81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a369d45e4804ffca2e89cb72f447a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:44.631920 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b261c6b8-15c4-4c1b-95a7-aa5bbd3b02f3 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "GET /compute/v2.1/servers/c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd" status: 200 len: 1318 microversion: 2.1 time: 0.236190 Oct 23 01:24:44.632540 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1822/3620] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:44 2022] GET /compute/v2.1/servers/c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:44.638711 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0dbc5915-3523-4038-9146-6e400a1f435f tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:44.639637 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0dbc5915-3523-4038-9146-6e400a1f435f tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] [instance: aa768b59-9807-4365-a405-b6e688b1e0f6] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:44.647278 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0dbc5915-3523-4038-9146-6e400a1f435f tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:44.648889 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0dbc5915-3523-4038-9146-6e400a1f435f tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:44.648889 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0dbc5915-3523-4038-9146-6e400a1f435f tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:44.649506 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0dbc5915-3523-4038-9146-6e400a1f435f tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:44.650241 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0dbc5915-3523-4038-9146-6e400a1f435f tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:44.650825 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0dbc5915-3523-4038-9146-6e400a1f435f tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:44.671818 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-83fc9e27-c557-4f2f-971c-aa5d32f1f9d4 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Getting quotas for project 316cbb6f558c4bc8b34050cc1b8ea134. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:24:44.681690 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-83fc9e27-c557-4f2f-971c-aa5d32f1f9d4 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Getting quotas for user 4024e1a8f515435f86d3d36d59262813 and project 316cbb6f558c4bc8b34050cc1b8ea134. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:24:44.743614 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-83fc9e27-c557-4f2f-971c-aa5d32f1f9d4 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:24:44.746359 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-83fc9e27-c557-4f2f-971c-aa5d32f1f9d4 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] [instance: 623b5796-affa-4692-a43d-7bbb95ce8270] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:24:44.776170 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0dbc5915-3523-4038-9146-6e400a1f435f tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8a867611614ea585d510d62c63cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9f6afbdbf74318a98dfe455a72ac7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:44.785272 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0dbc5915-3523-4038-9146-6e400a1f435f tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "GET /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6" status: 200 len: 1274 microversion: 2.1 time: 0.151648 Oct 23 01:24:44.785860 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1823/3621] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:44 2022] GET /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6 => generated 1274 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:44.818555 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-47d72eb9-bcd5-426f-a810-fa4c37af84c2 req-6b90b88e-975c-498c-a7ce-66b98f783b3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd", "tag": "b2c35d7d-5dbd-491a-b4d5-140000b3abd3"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:24:44.829389 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-47d72eb9-bcd5-426f-a810-fa4c37af84c2 req-6b90b88e-975c-498c-a7ce-66b98f783b3e service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:44.830325 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-47d72eb9-bcd5-426f-a810-fa4c37af84c2 req-6b90b88e-975c-498c-a7ce-66b98f783b3e service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:44.831057 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-47d72eb9-bcd5-426f-a810-fa4c37af84c2 req-6b90b88e-975c-498c-a7ce-66b98f783b3e service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:44.850423 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-47d72eb9-bcd5-426f-a810-fa4c37af84c2 req-6b90b88e-975c-498c-a7ce-66b98f783b3e service nova] Creating event network-changed:b2c35d7d-5dbd-491a-b4d5-140000b3abd3 for instance c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd on n-h2-master-1 Oct 23 01:24:44.858669 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-47d72eb9-bcd5-426f-a810-fa4c37af84c2 req-6b90b88e-975c-498c-a7ce-66b98f783b3e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044289 Oct 23 01:24:44.859929 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1824/3622] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:24:44.953052 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-83fc9e27-c557-4f2f-971c-aa5d32f1f9d4 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.553618 Oct 23 01:24:44.955160 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1799/3623] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:24:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:24:44.968737 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cacdd658-0e67-4398-85bb-fa9f882edb42 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:44.970046 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-cacdd658-0e67-4398-85bb-fa9f882edb42 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] [instance: 623b5796-affa-4692-a43d-7bbb95ce8270] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:45.126271 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cacdd658-0e67-4398-85bb-fa9f882edb42 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4024e1a8f515435f86d3d36d59262813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316cbb6f558c4bc8b34050cc1b8ea134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:45.139002 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cacdd658-0e67-4398-85bb-fa9f882edb42 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] 10.222.0.42 "GET /compute/v2.1/servers/623b5796-affa-4692-a43d-7bbb95ce8270" status: 200 len: 1216 microversion: 2.1 time: 0.174355 Oct 23 01:24:45.153310 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1825/3624] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:44 2022] GET /compute/v2.1/servers/623b5796-affa-4692-a43d-7bbb95ce8270 => generated 1216 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:45.427065 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0f6416f0-7673-4a17-88bf-19818adf62a2 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:45.428380 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0f6416f0-7673-4a17-88bf-19818adf62a2 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:45.455882 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0f6416f0-7673-4a17-88bf-19818adf62a2 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:45.457153 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0f6416f0-7673-4a17-88bf-19818adf62a2 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:45.459780 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0f6416f0-7673-4a17-88bf-19818adf62a2 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:45.469159 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0f6416f0-7673-4a17-88bf-19818adf62a2 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:45.469753 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0f6416f0-7673-4a17-88bf-19818adf62a2 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:45.471305 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0f6416f0-7673-4a17-88bf-19818adf62a2 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:45.662315 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8b19fae5-7ec4-4a78-9ce9-324a6cdd03bf tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:45.663244 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8b19fae5-7ec4-4a78-9ce9-324a6cdd03bf tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:45.675011 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8b19fae5-7ec4-4a78-9ce9-324a6cdd03bf tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:45.675807 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8b19fae5-7ec4-4a78-9ce9-324a6cdd03bf tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:45.677870 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8b19fae5-7ec4-4a78-9ce9-324a6cdd03bf tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:45.679713 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8b19fae5-7ec4-4a78-9ce9-324a6cdd03bf tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:45.680835 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8b19fae5-7ec4-4a78-9ce9-324a6cdd03bf tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:45.681494 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8b19fae5-7ec4-4a78-9ce9-324a6cdd03bf tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:45.690448 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0f6416f0-7673-4a17-88bf-19818adf62a2 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:45.706774 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0f6416f0-7673-4a17-88bf-19818adf62a2 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1725 microversion: 2.1 time: 0.290430 Oct 23 01:24:45.707964 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1800/3625] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:45 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1725 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:45.812159 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-82f6f9c4-780f-4f10-a460-2d4c93163649 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:45.812971 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-82f6f9c4-780f-4f10-a460-2d4c93163649 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] [instance: aa768b59-9807-4365-a405-b6e688b1e0f6] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:45.832279 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-82f6f9c4-780f-4f10-a460-2d4c93163649 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:45.836081 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-82f6f9c4-780f-4f10-a460-2d4c93163649 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:45.852440 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-82f6f9c4-780f-4f10-a460-2d4c93163649 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:45.852440 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-82f6f9c4-780f-4f10-a460-2d4c93163649 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:45.852440 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-82f6f9c4-780f-4f10-a460-2d4c93163649 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:45.852440 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-82f6f9c4-780f-4f10-a460-2d4c93163649 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:45.912239 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=100 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:45.980566 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8b19fae5-7ec4-4a78-9ce9-324a6cdd03bf tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60276a4031ee45ffa651b5467a62a81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a369d45e4804ffca2e89cb72f447a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:46.006103 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:46.021234 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8b19fae5-7ec4-4a78-9ce9-324a6cdd03bf tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "GET /compute/v2.1/servers/c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd" status: 200 len: 1318 microversion: 2.1 time: 0.365565 Oct 23 01:24:46.081593 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1826/3626] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:45 2022] GET /compute/v2.1/servers/c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd => generated 1318 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:46.109226 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ebafcad9-2cda-48e7-ab47-c4fb509b9022 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:46.118189 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ebafcad9-2cda-48e7-ab47-c4fb509b9022 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] [instance: e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:46.132720 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ebafcad9-2cda-48e7-ab47-c4fb509b9022 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:46.136394 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ebafcad9-2cda-48e7-ab47-c4fb509b9022 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:46.136394 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ebafcad9-2cda-48e7-ab47-c4fb509b9022 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:46.136394 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ebafcad9-2cda-48e7-ab47-c4fb509b9022 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:46.141014 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ebafcad9-2cda-48e7-ab47-c4fb509b9022 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:46.142184 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ebafcad9-2cda-48e7-ab47-c4fb509b9022 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:46.200504 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-82f6f9c4-780f-4f10-a460-2d4c93163649 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8a867611614ea585d510d62c63cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9f6afbdbf74318a98dfe455a72ac7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:46.202965 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-82f6f9c4-780f-4f10-a460-2d4c93163649 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "GET /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6" status: 200 len: 1316 microversion: 2.1 time: 0.395099 Oct 23 01:24:46.203350 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ebafcad9-2cda-48e7-ab47-c4fb509b9022 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] 10.222.0.42 "GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115291 Oct 23 01:24:46.204492 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1827/3627] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:24:46 2022] GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:24:46.209466 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9c3d325d-1d2a-4519-ad9f-7065f8b145f6 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:46.210326 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9c3d325d-1d2a-4519-ad9f-7065f8b145f6 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] [instance: 623b5796-affa-4692-a43d-7bbb95ce8270] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:46.210494 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1801/3628] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:45 2022] GET /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6 => generated 1316 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:46.230790 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-de4dc2d5-071f-4e04-b833-f133d9acb972 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:46.232165 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-de4dc2d5-071f-4e04-b833-f133d9acb972 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] [instance: e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:46.242873 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-de4dc2d5-071f-4e04-b833-f133d9acb972 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:46.243713 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-de4dc2d5-071f-4e04-b833-f133d9acb972 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:46.244333 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-de4dc2d5-071f-4e04-b833-f133d9acb972 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:46.249516 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-de4dc2d5-071f-4e04-b833-f133d9acb972 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:46.252128 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-de4dc2d5-071f-4e04-b833-f133d9acb972 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:46.252831 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-de4dc2d5-071f-4e04-b833-f133d9acb972 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:46.287573 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9c3d325d-1d2a-4519-ad9f-7065f8b145f6 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4024e1a8f515435f86d3d36d59262813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316cbb6f558c4bc8b34050cc1b8ea134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:46.291924 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9c3d325d-1d2a-4519-ad9f-7065f8b145f6 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] 10.222.0.42 "GET /compute/v2.1/servers/623b5796-affa-4692-a43d-7bbb95ce8270" status: 200 len: 1216 microversion: 2.1 time: 0.086200 Oct 23 01:24:46.292510 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1828/3629] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:46 2022] GET /compute/v2.1/servers/623b5796-affa-4692-a43d-7bbb95ce8270 => generated 1216 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:46.411644 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-de4dc2d5-071f-4e04-b833-f133d9acb972 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lazy-loading 'services' on Instance uuid e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:24:46.714799 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-de4dc2d5-071f-4e04-b833-f133d9acb972 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c/os-volume_attachments/c992e6fd-3092-481d-8b6c-ef42f9c9cfef" status: 202 len: 0 microversion: 2.1 time: 0.487507 Oct 23 01:24:46.717117 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1802/3630] 10.222.0.42 () {58 vars in 1416 bytes} [Sun Oct 23 01:24:46 2022] DELETE /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c/os-volume_attachments/c992e6fd-3092-481d-8b6c-ef42f9c9cfef => generated 0 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:24:46.735451 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f33de55f-0464-47bd-baae-7287e5213296 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:46.737772 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f33de55f-0464-47bd-baae-7287e5213296 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:46.759801 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f33de55f-0464-47bd-baae-7287e5213296 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:46.761080 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f33de55f-0464-47bd-baae-7287e5213296 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:46.764301 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f33de55f-0464-47bd-baae-7287e5213296 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:46.766274 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f33de55f-0464-47bd-baae-7287e5213296 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:46.770158 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f33de55f-0464-47bd-baae-7287e5213296 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:46.770742 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f33de55f-0464-47bd-baae-7287e5213296 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:47.017050 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f33de55f-0464-47bd-baae-7287e5213296 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:47.026469 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f33de55f-0464-47bd-baae-7287e5213296 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1702 microversion: 2.1 time: 0.296808 Oct 23 01:24:47.027053 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1829/3631] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:46 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1702 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:47.050914 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bdd39e4a-949e-4118-b0ad-c2bb7c80cba5 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:24:47.051563 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c74b3efb-8ec7-44a1-a94c-8610ba926cfc tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:47.052285 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c74b3efb-8ec7-44a1-a94c-8610ba926cfc tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:47.058021 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bdd39e4a-949e-4118-b0ad-c2bb7c80cba5 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:47.058521 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bdd39e4a-949e-4118-b0ad-c2bb7c80cba5 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:47.059186 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bdd39e4a-949e-4118-b0ad-c2bb7c80cba5 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:47.059424 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c74b3efb-8ec7-44a1-a94c-8610ba926cfc tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:47.059927 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c74b3efb-8ec7-44a1-a94c-8610ba926cfc tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:47.060408 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c74b3efb-8ec7-44a1-a94c-8610ba926cfc tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:47.061127 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c74b3efb-8ec7-44a1-a94c-8610ba926cfc tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:47.061622 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c74b3efb-8ec7-44a1-a94c-8610ba926cfc tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:47.062085 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c74b3efb-8ec7-44a1-a94c-8610ba926cfc tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:47.083174 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bdd39e4a-949e-4118-b0ad-c2bb7c80cba5 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Going to try to start instance {{(pid=120944) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 23 01:24:47.237451 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c74b3efb-8ec7-44a1-a94c-8610ba926cfc tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60276a4031ee45ffa651b5467a62a81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a369d45e4804ffca2e89cb72f447a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:47.249620 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c74b3efb-8ec7-44a1-a94c-8610ba926cfc tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "GET /compute/v2.1/servers/c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd" status: 200 len: 1318 microversion: 2.1 time: 0.202931 Oct 23 01:24:47.263159 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1803/3632] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:47 2022] GET /compute/v2.1/servers/c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:47.263159 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-add2f921-09e8-4f68-bf00-85928e213b38 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:47.263159 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-add2f921-09e8-4f68-bf00-85928e213b38 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] [instance: aa768b59-9807-4365-a405-b6e688b1e0f6] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:47.271961 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-add2f921-09e8-4f68-bf00-85928e213b38 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:47.272765 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-add2f921-09e8-4f68-bf00-85928e213b38 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:47.273348 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-add2f921-09e8-4f68-bf00-85928e213b38 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:47.274164 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-add2f921-09e8-4f68-bf00-85928e213b38 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:47.274680 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-add2f921-09e8-4f68-bf00-85928e213b38 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:47.279857 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-add2f921-09e8-4f68-bf00-85928e213b38 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:47.301091 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bdd39e4a-949e-4118-b0ad-c2bb7c80cba5 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "POST /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca/action" status: 202 len: 0 microversion: 2.1 time: 0.254501 Oct 23 01:24:47.301633 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1830/3633] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:24:47 2022] POST /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:24:47.320170 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8c31d73a-4922-4cc8-8ea5-12c8105342ae tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:47.324214 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8c31d73a-4922-4cc8-8ea5-12c8105342ae tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:47.330028 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c31d73a-4922-4cc8-8ea5-12c8105342ae tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:47.330782 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c31d73a-4922-4cc8-8ea5-12c8105342ae tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:47.331762 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c31d73a-4922-4cc8-8ea5-12c8105342ae tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:47.332488 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c31d73a-4922-4cc8-8ea5-12c8105342ae tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:47.332949 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c31d73a-4922-4cc8-8ea5-12c8105342ae tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:47.333372 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c31d73a-4922-4cc8-8ea5-12c8105342ae tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:47.677504 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8c31d73a-4922-4cc8-8ea5-12c8105342ae tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:47.687990 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8c31d73a-4922-4cc8-8ea5-12c8105342ae tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1711 microversion: 2.1 time: 0.374294 Oct 23 01:24:47.688716 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-add2f921-09e8-4f68-bf00-85928e213b38 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8a867611614ea585d510d62c63cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9f6afbdbf74318a98dfe455a72ac7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:47.703694 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-add2f921-09e8-4f68-bf00-85928e213b38 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "GET /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6" status: 200 len: 1316 microversion: 2.1 time: 0.452015 Oct 23 01:24:47.707484 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1804/3634] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:47 2022] GET /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6 => generated 1316 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:47.708925 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1831/3635] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:47 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1711 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:47.714929 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-750047f1-bd44-4efa-a801-f0e29c301146 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:47.716684 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-750047f1-bd44-4efa-a801-f0e29c301146 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] [instance: 623b5796-affa-4692-a43d-7bbb95ce8270] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:47.731082 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-750047f1-bd44-4efa-a801-f0e29c301146 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:47.731579 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-750047f1-bd44-4efa-a801-f0e29c301146 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:47.732020 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-750047f1-bd44-4efa-a801-f0e29c301146 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:47.732730 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-750047f1-bd44-4efa-a801-f0e29c301146 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:47.733183 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-750047f1-bd44-4efa-a801-f0e29c301146 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:47.734224 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-750047f1-bd44-4efa-a801-f0e29c301146 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:47.829694 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-750047f1-bd44-4efa-a801-f0e29c301146 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4024e1a8f515435f86d3d36d59262813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316cbb6f558c4bc8b34050cc1b8ea134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:47.839313 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-750047f1-bd44-4efa-a801-f0e29c301146 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] 10.222.0.42 "GET /compute/v2.1/servers/623b5796-affa-4692-a43d-7bbb95ce8270" status: 200 len: 1212 microversion: 2.1 time: 0.128776 Oct 23 01:24:47.839960 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1805/3636] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:47 2022] GET /compute/v2.1/servers/623b5796-affa-4692-a43d-7bbb95ce8270 => generated 1212 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:48.084392 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-8203905b-3521-4b95-8d26-bd22179ad776 req-857de789-95ad-435a-bacf-830a543d4e3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa768b59-9807-4365-a405-b6e688b1e0f6", "tag": "66f1253e-27b9-42ba-b3ee-ef4ed5990380"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:24:48.094052 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-8203905b-3521-4b95-8d26-bd22179ad776 req-857de789-95ad-435a-bacf-830a543d4e3e service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:48.094609 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-8203905b-3521-4b95-8d26-bd22179ad776 req-857de789-95ad-435a-bacf-830a543d4e3e service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:48.095131 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-8203905b-3521-4b95-8d26-bd22179ad776 req-857de789-95ad-435a-bacf-830a543d4e3e service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:48.106123 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-8203905b-3521-4b95-8d26-bd22179ad776 req-857de789-95ad-435a-bacf-830a543d4e3e service nova] Creating event network-changed:66f1253e-27b9-42ba-b3ee-ef4ed5990380 for instance aa768b59-9807-4365-a405-b6e688b1e0f6 on n-h1-master-1 Oct 23 01:24:48.110903 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-8203905b-3521-4b95-8d26-bd22179ad776 req-857de789-95ad-435a-bacf-830a543d4e3e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030910 Oct 23 01:24:48.111574 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1832/3637] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:24:48.273433 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c21b6765-c0a2-48f5-9bed-dc060f122236 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:48.274368 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c21b6765-c0a2-48f5-9bed-dc060f122236 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:48.276634 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:48.289611 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c21b6765-c0a2-48f5-9bed-dc060f122236 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:48.290407 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c21b6765-c0a2-48f5-9bed-dc060f122236 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:48.291070 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c21b6765-c0a2-48f5-9bed-dc060f122236 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:48.292073 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c21b6765-c0a2-48f5-9bed-dc060f122236 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:48.292533 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c21b6765-c0a2-48f5-9bed-dc060f122236 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:48.293219 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c21b6765-c0a2-48f5-9bed-dc060f122236 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:48.450788 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c21b6765-c0a2-48f5-9bed-dc060f122236 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60276a4031ee45ffa651b5467a62a81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a369d45e4804ffca2e89cb72f447a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:48.458896 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c21b6765-c0a2-48f5-9bed-dc060f122236 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "GET /compute/v2.1/servers/c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd" status: 200 len: 1318 microversion: 2.1 time: 0.189481 Oct 23 01:24:48.459488 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1806/3638] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:48 2022] GET /compute/v2.1/servers/c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:48.746069 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b55c526f-69e6-4e8c-923a-d799bc0d6d73 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:48.749747 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b55c526f-69e6-4e8c-923a-d799bc0d6d73 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] [instance: aa768b59-9807-4365-a405-b6e688b1e0f6] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:48.752328 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4c7ae898-58dd-41ee-a30d-3d9a401ab2fc tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:48.756309 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4c7ae898-58dd-41ee-a30d-3d9a401ab2fc tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:48.769197 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b55c526f-69e6-4e8c-923a-d799bc0d6d73 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:48.773829 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4c7ae898-58dd-41ee-a30d-3d9a401ab2fc tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:48.774341 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b55c526f-69e6-4e8c-923a-d799bc0d6d73 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:48.774858 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b55c526f-69e6-4e8c-923a-d799bc0d6d73 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:48.775708 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b55c526f-69e6-4e8c-923a-d799bc0d6d73 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:48.776284 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b55c526f-69e6-4e8c-923a-d799bc0d6d73 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:48.776779 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b55c526f-69e6-4e8c-923a-d799bc0d6d73 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:48.778177 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4c7ae898-58dd-41ee-a30d-3d9a401ab2fc tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:48.778713 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4c7ae898-58dd-41ee-a30d-3d9a401ab2fc tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:48.785307 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4c7ae898-58dd-41ee-a30d-3d9a401ab2fc tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:48.786102 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4c7ae898-58dd-41ee-a30d-3d9a401ab2fc tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:48.786556 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4c7ae898-58dd-41ee-a30d-3d9a401ab2fc tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:49.125261 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4c7ae898-58dd-41ee-a30d-3d9a401ab2fc tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:49.139976 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4c7ae898-58dd-41ee-a30d-3d9a401ab2fc tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1711 microversion: 2.1 time: 0.413594 Oct 23 01:24:49.149863 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b55c526f-69e6-4e8c-923a-d799bc0d6d73 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8a867611614ea585d510d62c63cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9f6afbdbf74318a98dfe455a72ac7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:49.152609 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1833/3639] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:48 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1711 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:49.164783 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-671f44d8-f42f-48d3-bb2d-cc3f9670b9c8 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:49.169600 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-671f44d8-f42f-48d3-bb2d-cc3f9670b9c8 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] [instance: 623b5796-affa-4692-a43d-7bbb95ce8270] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:49.177966 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b55c526f-69e6-4e8c-923a-d799bc0d6d73 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "GET /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6" status: 200 len: 1316 microversion: 2.1 time: 0.450330 Oct 23 01:24:49.179053 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-671f44d8-f42f-48d3-bb2d-cc3f9670b9c8 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:49.179808 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-671f44d8-f42f-48d3-bb2d-cc3f9670b9c8 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:49.180413 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-671f44d8-f42f-48d3-bb2d-cc3f9670b9c8 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:49.181297 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-671f44d8-f42f-48d3-bb2d-cc3f9670b9c8 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:49.181940 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-671f44d8-f42f-48d3-bb2d-cc3f9670b9c8 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:49.182562 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-671f44d8-f42f-48d3-bb2d-cc3f9670b9c8 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:49.188450 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1807/3640] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:48 2022] GET /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6 => generated 1316 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:49.279590 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-671f44d8-f42f-48d3-bb2d-cc3f9670b9c8 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4024e1a8f515435f86d3d36d59262813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316cbb6f558c4bc8b34050cc1b8ea134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:49.294522 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-671f44d8-f42f-48d3-bb2d-cc3f9670b9c8 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] 10.222.0.42 "GET /compute/v2.1/servers/623b5796-affa-4692-a43d-7bbb95ce8270" status: 200 len: 1268 microversion: 2.1 time: 0.139338 Oct 23 01:24:49.297746 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1834/3641] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:49 2022] GET /compute/v2.1/servers/623b5796-affa-4692-a43d-7bbb95ce8270 => generated 1268 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:49.484014 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5a984037-596c-488f-90dd-56dea872332d tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:49.484647 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5a984037-596c-488f-90dd-56dea872332d tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:49.499026 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5a984037-596c-488f-90dd-56dea872332d tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:49.499026 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5a984037-596c-488f-90dd-56dea872332d tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:49.499026 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5a984037-596c-488f-90dd-56dea872332d tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:49.499026 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5a984037-596c-488f-90dd-56dea872332d tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:49.499026 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5a984037-596c-488f-90dd-56dea872332d tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:49.499026 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5a984037-596c-488f-90dd-56dea872332d tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:49.681908 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5a984037-596c-488f-90dd-56dea872332d tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60276a4031ee45ffa651b5467a62a81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a369d45e4804ffca2e89cb72f447a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:49.696043 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5a984037-596c-488f-90dd-56dea872332d tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "GET /compute/v2.1/servers/c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd" status: 200 len: 1318 microversion: 2.1 time: 0.215079 Oct 23 01:24:49.697550 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1808/3642] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:49 2022] GET /compute/v2.1/servers/c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:50.181308 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-46bceb38-3a53-45df-8d1e-77e8c0fbdd8a tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:50.182685 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-46bceb38-3a53-45df-8d1e-77e8c0fbdd8a tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:50.195602 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46bceb38-3a53-45df-8d1e-77e8c0fbdd8a tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:50.199837 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46bceb38-3a53-45df-8d1e-77e8c0fbdd8a tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:50.200581 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46bceb38-3a53-45df-8d1e-77e8c0fbdd8a tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:50.201489 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46bceb38-3a53-45df-8d1e-77e8c0fbdd8a tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:50.201632 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6d023e2e-6e93-4664-84be-b2fe45bc5d1b tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:50.202301 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6d023e2e-6e93-4664-84be-b2fe45bc5d1b tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] [instance: aa768b59-9807-4365-a405-b6e688b1e0f6] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:50.209223 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46bceb38-3a53-45df-8d1e-77e8c0fbdd8a tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:50.209688 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46bceb38-3a53-45df-8d1e-77e8c0fbdd8a tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:50.216446 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6d023e2e-6e93-4664-84be-b2fe45bc5d1b tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:50.217453 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6d023e2e-6e93-4664-84be-b2fe45bc5d1b tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:50.223139 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6d023e2e-6e93-4664-84be-b2fe45bc5d1b tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:50.223579 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6d023e2e-6e93-4664-84be-b2fe45bc5d1b tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:50.224175 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6d023e2e-6e93-4664-84be-b2fe45bc5d1b tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:50.224700 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6d023e2e-6e93-4664-84be-b2fe45bc5d1b tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:50.492493 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-46bceb38-3a53-45df-8d1e-77e8c0fbdd8a tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:50.504824 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-46bceb38-3a53-45df-8d1e-77e8c0fbdd8a tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1711 microversion: 2.1 time: 0.327611 Oct 23 01:24:50.506506 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1835/3643] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:50 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1711 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:50.527257 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6d023e2e-6e93-4664-84be-b2fe45bc5d1b tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8a867611614ea585d510d62c63cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9f6afbdbf74318a98dfe455a72ac7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:50.539476 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6d023e2e-6e93-4664-84be-b2fe45bc5d1b tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "GET /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6" status: 200 len: 1316 microversion: 2.1 time: 0.342255 Oct 23 01:24:50.554119 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-253e318e-27b1-4e6d-9652-ee2f67085973 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:50.554119 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-253e318e-27b1-4e6d-9652-ee2f67085973 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] [instance: 623b5796-affa-4692-a43d-7bbb95ce8270] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:50.559440 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1809/3644] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:50 2022] GET /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6 => generated 1316 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:24:50.559595 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-253e318e-27b1-4e6d-9652-ee2f67085973 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:50.559595 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-253e318e-27b1-4e6d-9652-ee2f67085973 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:50.559595 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-253e318e-27b1-4e6d-9652-ee2f67085973 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:50.559595 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-253e318e-27b1-4e6d-9652-ee2f67085973 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:50.559595 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-253e318e-27b1-4e6d-9652-ee2f67085973 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:50.560064 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-253e318e-27b1-4e6d-9652-ee2f67085973 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:50.663023 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-253e318e-27b1-4e6d-9652-ee2f67085973 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4024e1a8f515435f86d3d36d59262813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316cbb6f558c4bc8b34050cc1b8ea134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:50.677215 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-253e318e-27b1-4e6d-9652-ee2f67085973 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] 10.222.0.42 "GET /compute/v2.1/servers/623b5796-affa-4692-a43d-7bbb95ce8270" status: 200 len: 1274 microversion: 2.1 time: 0.163637 Oct 23 01:24:50.678912 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1836/3645] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:50 2022] GET /compute/v2.1/servers/623b5796-affa-4692-a43d-7bbb95ce8270 => generated 1274 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:50.723172 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a4a25e6e-4e74-46c0-9bf8-0f2a2bdf34c7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:50.723802 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a4a25e6e-4e74-46c0-9bf8-0f2a2bdf34c7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:50.730691 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a4a25e6e-4e74-46c0-9bf8-0f2a2bdf34c7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:50.731407 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a4a25e6e-4e74-46c0-9bf8-0f2a2bdf34c7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:50.731855 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a4a25e6e-4e74-46c0-9bf8-0f2a2bdf34c7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:50.732572 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a4a25e6e-4e74-46c0-9bf8-0f2a2bdf34c7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:50.733020 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a4a25e6e-4e74-46c0-9bf8-0f2a2bdf34c7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:50.733617 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a4a25e6e-4e74-46c0-9bf8-0f2a2bdf34c7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:50.942191 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a4a25e6e-4e74-46c0-9bf8-0f2a2bdf34c7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60276a4031ee45ffa651b5467a62a81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a369d45e4804ffca2e89cb72f447a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:50.949619 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a4a25e6e-4e74-46c0-9bf8-0f2a2bdf34c7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "GET /compute/v2.1/servers/c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd" status: 200 len: 1318 microversion: 2.1 time: 0.230464 Oct 23 01:24:50.950483 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1810/3646] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:50 2022] GET /compute/v2.1/servers/c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:51.530383 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e70ae5ce-5f7e-4f86-b6df-ffe45a8195e7 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:51.530990 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e70ae5ce-5f7e-4f86-b6df-ffe45a8195e7 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:51.541535 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e70ae5ce-5f7e-4f86-b6df-ffe45a8195e7 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:51.546042 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e70ae5ce-5f7e-4f86-b6df-ffe45a8195e7 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:51.546042 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e70ae5ce-5f7e-4f86-b6df-ffe45a8195e7 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:51.546042 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e70ae5ce-5f7e-4f86-b6df-ffe45a8195e7 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:51.546042 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e70ae5ce-5f7e-4f86-b6df-ffe45a8195e7 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:51.546042 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e70ae5ce-5f7e-4f86-b6df-ffe45a8195e7 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:51.565568 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cbd09337-980f-4173-a889-e593044b8f1d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:51.570712 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cbd09337-980f-4173-a889-e593044b8f1d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] [instance: aa768b59-9807-4365-a405-b6e688b1e0f6] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:51.577392 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cbd09337-980f-4173-a889-e593044b8f1d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:51.578166 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cbd09337-980f-4173-a889-e593044b8f1d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:51.578786 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cbd09337-980f-4173-a889-e593044b8f1d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:51.580643 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cbd09337-980f-4173-a889-e593044b8f1d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:51.590740 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cbd09337-980f-4173-a889-e593044b8f1d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:51.591473 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cbd09337-980f-4173-a889-e593044b8f1d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:51.849781 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cbd09337-980f-4173-a889-e593044b8f1d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8a867611614ea585d510d62c63cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9f6afbdbf74318a98dfe455a72ac7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:51.853609 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e70ae5ce-5f7e-4f86-b6df-ffe45a8195e7 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:51.863353 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cbd09337-980f-4173-a889-e593044b8f1d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "GET /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6" status: 200 len: 1316 microversion: 2.1 time: 0.301954 Oct 23 01:24:51.864410 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1811/3647] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:51 2022] GET /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6 => generated 1316 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:24:51.870118 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6266c451-0ff4-4b2e-be07-a66522ce7d78 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:51.871425 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6266c451-0ff4-4b2e-be07-a66522ce7d78 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] [instance: 623b5796-affa-4692-a43d-7bbb95ce8270] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:51.878786 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6266c451-0ff4-4b2e-be07-a66522ce7d78 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:51.879729 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6266c451-0ff4-4b2e-be07-a66522ce7d78 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:51.879868 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e70ae5ce-5f7e-4f86-b6df-ffe45a8195e7 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1715 microversion: 2.1 time: 0.338232 Oct 23 01:24:51.880200 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6266c451-0ff4-4b2e-be07-a66522ce7d78 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:51.881267 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6266c451-0ff4-4b2e-be07-a66522ce7d78 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:51.882106 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6266c451-0ff4-4b2e-be07-a66522ce7d78 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:51.882761 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6266c451-0ff4-4b2e-be07-a66522ce7d78 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:51.884987 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1837/3648] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:51 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1715 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:51.973589 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0dce8cb8-612d-4926-937e-e05b50b16c1c tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:51.974232 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0dce8cb8-612d-4926-937e-e05b50b16c1c tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:51.980409 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0dce8cb8-612d-4926-937e-e05b50b16c1c tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:51.980898 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0dce8cb8-612d-4926-937e-e05b50b16c1c tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:51.981329 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0dce8cb8-612d-4926-937e-e05b50b16c1c tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:51.982285 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0dce8cb8-612d-4926-937e-e05b50b16c1c tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:51.982738 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0dce8cb8-612d-4926-937e-e05b50b16c1c tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:51.983161 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0dce8cb8-612d-4926-937e-e05b50b16c1c tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:52.089087 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6266c451-0ff4-4b2e-be07-a66522ce7d78 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4024e1a8f515435f86d3d36d59262813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316cbb6f558c4bc8b34050cc1b8ea134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:52.105263 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6266c451-0ff4-4b2e-be07-a66522ce7d78 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] 10.222.0.42 "GET /compute/v2.1/servers/623b5796-affa-4692-a43d-7bbb95ce8270" status: 200 len: 1316 microversion: 2.1 time: 0.238466 Oct 23 01:24:52.108119 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1812/3649] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:51 2022] GET /compute/v2.1/servers/623b5796-affa-4692-a43d-7bbb95ce8270 => generated 1316 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:52.192349 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0dce8cb8-612d-4926-937e-e05b50b16c1c tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60276a4031ee45ffa651b5467a62a81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a369d45e4804ffca2e89cb72f447a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:52.201219 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0dce8cb8-612d-4926-937e-e05b50b16c1c tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "GET /compute/v2.1/servers/c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd" status: 200 len: 1318 microversion: 2.1 time: 0.231421 Oct 23 01:24:52.202127 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1838/3650] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:51 2022] GET /compute/v2.1/servers/c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:24:52.491892 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-8022c9f7-352f-463d-ad9b-2a71ce515974 req-13f55551-5b2f-4f22-bc54-e0acc23f45f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "623b5796-affa-4692-a43d-7bbb95ce8270", "tag": "f86d5c82-c234-49b7-9637-45d8048180ab"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:24:52.502068 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-8022c9f7-352f-463d-ad9b-2a71ce515974 req-13f55551-5b2f-4f22-bc54-e0acc23f45f7 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:52.503567 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-8022c9f7-352f-463d-ad9b-2a71ce515974 req-13f55551-5b2f-4f22-bc54-e0acc23f45f7 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:52.510177 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-8022c9f7-352f-463d-ad9b-2a71ce515974 req-13f55551-5b2f-4f22-bc54-e0acc23f45f7 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:52.519631 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-8022c9f7-352f-463d-ad9b-2a71ce515974 req-13f55551-5b2f-4f22-bc54-e0acc23f45f7 service nova] Creating event network-changed:f86d5c82-c234-49b7-9637-45d8048180ab for instance 623b5796-affa-4692-a43d-7bbb95ce8270 on n-h2-master-1 Oct 23 01:24:52.525071 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-8022c9f7-352f-463d-ad9b-2a71ce515974 req-13f55551-5b2f-4f22-bc54-e0acc23f45f7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040402 Oct 23 01:24:52.526761 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1813/3651] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:24:52.855031 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-db12dc59-134c-456f-955a-50646e5c17a8 req-95fe15f2-8293-41dd-971c-317025231e47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd", "name": "network-vif-plugged", "status": "completed", "tag": "b2c35d7d-5dbd-491a-b4d5-140000b3abd3"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:24:52.866719 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-db12dc59-134c-456f-955a-50646e5c17a8 req-95fe15f2-8293-41dd-971c-317025231e47 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:52.867207 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-db12dc59-134c-456f-955a-50646e5c17a8 req-95fe15f2-8293-41dd-971c-317025231e47 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:52.867922 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-db12dc59-134c-456f-955a-50646e5c17a8 req-95fe15f2-8293-41dd-971c-317025231e47 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:52.882675 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-db12dc59-134c-456f-955a-50646e5c17a8 req-95fe15f2-8293-41dd-971c-317025231e47 service nova] Creating event network-vif-plugged:b2c35d7d-5dbd-491a-b4d5-140000b3abd3 for instance c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd on n-h2-master-1 Oct 23 01:24:52.887556 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4b25c0a7-ed52-45e8-a717-1c7a9fb7a427 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:52.888033 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-db12dc59-134c-456f-955a-50646e5c17a8 req-95fe15f2-8293-41dd-971c-317025231e47 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036874 Oct 23 01:24:52.888271 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4b25c0a7-ed52-45e8-a717-1c7a9fb7a427 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] [instance: aa768b59-9807-4365-a405-b6e688b1e0f6] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:52.888639 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1839/3652] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:24:52.895264 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b25c0a7-ed52-45e8-a717-1c7a9fb7a427 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:52.895788 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b25c0a7-ed52-45e8-a717-1c7a9fb7a427 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:52.902024 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b25c0a7-ed52-45e8-a717-1c7a9fb7a427 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:52.902024 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b25c0a7-ed52-45e8-a717-1c7a9fb7a427 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:52.902024 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b25c0a7-ed52-45e8-a717-1c7a9fb7a427 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:52.902024 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b25c0a7-ed52-45e8-a717-1c7a9fb7a427 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:53.091210 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4b25c0a7-ed52-45e8-a717-1c7a9fb7a427 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8a867611614ea585d510d62c63cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9f6afbdbf74318a98dfe455a72ac7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:53.109577 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4b25c0a7-ed52-45e8-a717-1c7a9fb7a427 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "GET /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6" status: 200 len: 1316 microversion: 2.1 time: 0.227010 Oct 23 01:24:53.110466 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1814/3653] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:52 2022] GET /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6 => generated 1316 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:24:53.130748 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-251a5439-1274-4d4f-af65-f2a4115dae14 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:53.131944 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-251a5439-1274-4d4f-af65-f2a4115dae14 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] [instance: 623b5796-affa-4692-a43d-7bbb95ce8270] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:53.139197 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-251a5439-1274-4d4f-af65-f2a4115dae14 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:53.139767 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-251a5439-1274-4d4f-af65-f2a4115dae14 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:53.140291 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-251a5439-1274-4d4f-af65-f2a4115dae14 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:53.141054 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-251a5439-1274-4d4f-af65-f2a4115dae14 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:53.141628 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-251a5439-1274-4d4f-af65-f2a4115dae14 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:53.142140 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-251a5439-1274-4d4f-af65-f2a4115dae14 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:53.226582 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f76f7dce-e600-4812-a09e-b469fb60d3d2 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:53.227422 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f76f7dce-e600-4812-a09e-b469fb60d3d2 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:53.234151 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f76f7dce-e600-4812-a09e-b469fb60d3d2 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:53.234873 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f76f7dce-e600-4812-a09e-b469fb60d3d2 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:53.235398 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f76f7dce-e600-4812-a09e-b469fb60d3d2 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:53.236171 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f76f7dce-e600-4812-a09e-b469fb60d3d2 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:53.237033 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f76f7dce-e600-4812-a09e-b469fb60d3d2 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:53.237695 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f76f7dce-e600-4812-a09e-b469fb60d3d2 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:53.380873 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-251a5439-1274-4d4f-af65-f2a4115dae14 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4024e1a8f515435f86d3d36d59262813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316cbb6f558c4bc8b34050cc1b8ea134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:53.389260 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-251a5439-1274-4d4f-af65-f2a4115dae14 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] 10.222.0.42 "GET /compute/v2.1/servers/623b5796-affa-4692-a43d-7bbb95ce8270" status: 200 len: 1316 microversion: 2.1 time: 0.264734 Oct 23 01:24:53.398720 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1840/3654] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:53 2022] GET /compute/v2.1/servers/623b5796-affa-4692-a43d-7bbb95ce8270 => generated 1316 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:53.428540 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e50a7042-3e5c-479e-8f81-4a080598685f tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:53.431173 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e50a7042-3e5c-479e-8f81-4a080598685f tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] [instance: e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:53.435049 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f76f7dce-e600-4812-a09e-b469fb60d3d2 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60276a4031ee45ffa651b5467a62a81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a369d45e4804ffca2e89cb72f447a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:53.437910 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e50a7042-3e5c-479e-8f81-4a080598685f tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:53.438578 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e50a7042-3e5c-479e-8f81-4a080598685f tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:53.439102 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e50a7042-3e5c-479e-8f81-4a080598685f tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:53.440668 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e50a7042-3e5c-479e-8f81-4a080598685f tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:53.441198 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e50a7042-3e5c-479e-8f81-4a080598685f tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:53.441716 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e50a7042-3e5c-479e-8f81-4a080598685f tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:53.444324 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f76f7dce-e600-4812-a09e-b469fb60d3d2 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "GET /compute/v2.1/servers/c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd" status: 200 len: 1318 microversion: 2.1 time: 0.221826 Oct 23 01:24:53.444920 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1815/3655] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:53 2022] GET /compute/v2.1/servers/c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:53.473208 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e50a7042-3e5c-479e-8f81-4a080598685f tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] 10.222.0.42 "GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049636 Oct 23 01:24:53.473968 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1841/3656] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:24:53 2022] GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 23 01:24:53.541149 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-37995fa8-6ab8-4eab-bb3a-5beefaddb94d tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:53.543494 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-37995fa8-6ab8-4eab-bb3a-5beefaddb94d tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] [instance: e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:53.550631 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-37995fa8-6ab8-4eab-bb3a-5beefaddb94d tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:53.551110 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-37995fa8-6ab8-4eab-bb3a-5beefaddb94d tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:53.551541 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-37995fa8-6ab8-4eab-bb3a-5beefaddb94d tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:53.552234 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-37995fa8-6ab8-4eab-bb3a-5beefaddb94d tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:53.552763 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-37995fa8-6ab8-4eab-bb3a-5beefaddb94d tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:53.553199 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-37995fa8-6ab8-4eab-bb3a-5beefaddb94d tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:53.582836 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-37995fa8-6ab8-4eab-bb3a-5beefaddb94d tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] 10.222.0.42 "GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045832 Oct 23 01:24:53.583394 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1816/3657] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:24:53 2022] GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:24:53.649524 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-887c8ddd-d42a-4f50-996c-088237cfbf1a tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:53.650059 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-887c8ddd-d42a-4f50-996c-088237cfbf1a tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] [instance: e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:53.656087 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-887c8ddd-d42a-4f50-996c-088237cfbf1a tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:53.659843 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-887c8ddd-d42a-4f50-996c-088237cfbf1a tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:53.659843 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-887c8ddd-d42a-4f50-996c-088237cfbf1a tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:53.659843 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-887c8ddd-d42a-4f50-996c-088237cfbf1a tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:53.659843 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-887c8ddd-d42a-4f50-996c-088237cfbf1a tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:53.659843 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-887c8ddd-d42a-4f50-996c-088237cfbf1a tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:53.684713 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-887c8ddd-d42a-4f50-996c-088237cfbf1a tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] [instance: e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:24:54.007487 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-887c8ddd-d42a-4f50-996c-088237cfbf1a tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c" status: 204 len: 0 microversion: 2.1 time: 0.361519 Oct 23 01:24:54.008111 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1842/3658] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:24:53 2022] DELETE /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:24:54.016555 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6d924746-77cd-417d-b1c3-56e020401c46 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:54.017179 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6d924746-77cd-417d-b1c3-56e020401c46 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] [instance: e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:54.024674 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6d924746-77cd-417d-b1c3-56e020401c46 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:54.025106 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6d924746-77cd-417d-b1c3-56e020401c46 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:54.025588 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6d924746-77cd-417d-b1c3-56e020401c46 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:54.026321 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6d924746-77cd-417d-b1c3-56e020401c46 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:54.026785 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6d924746-77cd-417d-b1c3-56e020401c46 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:54.027212 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6d924746-77cd-417d-b1c3-56e020401c46 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:54.133284 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0011f51c-41cb-473f-a0d5-d7a79cde41a8 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:54.134798 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0011f51c-41cb-473f-a0d5-d7a79cde41a8 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] [instance: aa768b59-9807-4365-a405-b6e688b1e0f6] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:54.155127 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0011f51c-41cb-473f-a0d5-d7a79cde41a8 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:54.161891 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0011f51c-41cb-473f-a0d5-d7a79cde41a8 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:54.161891 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0011f51c-41cb-473f-a0d5-d7a79cde41a8 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:54.161891 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0011f51c-41cb-473f-a0d5-d7a79cde41a8 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:54.161891 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0011f51c-41cb-473f-a0d5-d7a79cde41a8 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:54.161891 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0011f51c-41cb-473f-a0d5-d7a79cde41a8 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:54.166534 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:54.171260 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6d924746-77cd-417d-b1c3-56e020401c46 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0501ceda4e8140e09fb4e94552487cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8525dcc00e844959a1527424291a3149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:54.173730 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:54.182996 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6d924746-77cd-417d-b1c3-56e020401c46 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] 10.222.0.42 "GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c" status: 200 len: 1681 microversion: 2.1 time: 0.170311 Oct 23 01:24:54.183593 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1817/3659] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:54 2022] GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:54.310090 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0011f51c-41cb-473f-a0d5-d7a79cde41a8 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8a867611614ea585d510d62c63cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9f6afbdbf74318a98dfe455a72ac7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:54.318418 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0011f51c-41cb-473f-a0d5-d7a79cde41a8 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "GET /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6" status: 200 len: 1316 microversion: 2.1 time: 0.189424 Oct 23 01:24:54.319011 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1843/3660] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:54 2022] GET /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6 => generated 1316 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:54.411912 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-971685f9-6519-4f56-a2bd-f8a37fd6ac95 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:54.412562 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-971685f9-6519-4f56-a2bd-f8a37fd6ac95 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] [instance: 623b5796-affa-4692-a43d-7bbb95ce8270] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:54.418624 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-971685f9-6519-4f56-a2bd-f8a37fd6ac95 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:54.419104 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-971685f9-6519-4f56-a2bd-f8a37fd6ac95 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:54.419545 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-971685f9-6519-4f56-a2bd-f8a37fd6ac95 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:54.420239 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-971685f9-6519-4f56-a2bd-f8a37fd6ac95 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:54.420701 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-971685f9-6519-4f56-a2bd-f8a37fd6ac95 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:54.421131 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-971685f9-6519-4f56-a2bd-f8a37fd6ac95 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:54.467260 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e18ad863-6642-4681-894f-fbf3fdf5a241 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:54.474969 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e18ad863-6642-4681-894f-fbf3fdf5a241 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:54.488188 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e18ad863-6642-4681-894f-fbf3fdf5a241 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:54.497435 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e18ad863-6642-4681-894f-fbf3fdf5a241 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:54.497435 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e18ad863-6642-4681-894f-fbf3fdf5a241 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:54.497435 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e18ad863-6642-4681-894f-fbf3fdf5a241 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:54.497435 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e18ad863-6642-4681-894f-fbf3fdf5a241 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:54.497435 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e18ad863-6642-4681-894f-fbf3fdf5a241 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:54.656895 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-971685f9-6519-4f56-a2bd-f8a37fd6ac95 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4024e1a8f515435f86d3d36d59262813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316cbb6f558c4bc8b34050cc1b8ea134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:54.659251 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=6 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:54.665790 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-971685f9-6519-4f56-a2bd-f8a37fd6ac95 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] 10.222.0.42 "GET /compute/v2.1/servers/623b5796-affa-4692-a43d-7bbb95ce8270" status: 200 len: 1316 microversion: 2.1 time: 0.257848 Oct 23 01:24:54.666558 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1818/3661] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:54 2022] GET /compute/v2.1/servers/623b5796-affa-4692-a43d-7bbb95ce8270 => generated 1316 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:54.715514 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e18ad863-6642-4681-894f-fbf3fdf5a241 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60276a4031ee45ffa651b5467a62a81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a369d45e4804ffca2e89cb72f447a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:54.723359 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e18ad863-6642-4681-894f-fbf3fdf5a241 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "GET /compute/v2.1/servers/c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd" status: 200 len: 1318 microversion: 2.1 time: 0.259874 Oct 23 01:24:54.724166 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1844/3662] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:54 2022] GET /compute/v2.1/servers/c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd => generated 1318 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:24:54.903656 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-0efdba94-3bb6-43c4-8706-08d679772e4a req-f4085ed0-b8fe-4533-b6a5-ff594ca5d229 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa768b59-9807-4365-a405-b6e688b1e0f6", "name": "network-vif-plugged", "status": "completed", "tag": "66f1253e-27b9-42ba-b3ee-ef4ed5990380"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:24:54.908466 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=18 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:54.914120 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-0efdba94-3bb6-43c4-8706-08d679772e4a req-f4085ed0-b8fe-4533-b6a5-ff594ca5d229 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:54.914604 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-0efdba94-3bb6-43c4-8706-08d679772e4a req-f4085ed0-b8fe-4533-b6a5-ff594ca5d229 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:54.915040 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-0efdba94-3bb6-43c4-8706-08d679772e4a req-f4085ed0-b8fe-4533-b6a5-ff594ca5d229 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:54.926337 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-0efdba94-3bb6-43c4-8706-08d679772e4a req-f4085ed0-b8fe-4533-b6a5-ff594ca5d229 service nova] Creating event network-vif-plugged:66f1253e-27b9-42ba-b3ee-ef4ed5990380 for instance aa768b59-9807-4365-a405-b6e688b1e0f6 on n-h1-master-1 Oct 23 01:24:54.931390 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-0efdba94-3bb6-43c4-8706-08d679772e4a req-f4085ed0-b8fe-4533-b6a5-ff594ca5d229 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031935 Oct 23 01:24:54.931983 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1819/3663] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:24:55.207252 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e7db8d36-7675-46f0-ac10-f88faf89c325 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:55.207972 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e7db8d36-7675-46f0-ac10-f88faf89c325 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] [instance: e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:55.216372 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e7db8d36-7675-46f0-ac10-f88faf89c325 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:55.221209 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e7db8d36-7675-46f0-ac10-f88faf89c325 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:55.221209 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e7db8d36-7675-46f0-ac10-f88faf89c325 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:55.221209 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e7db8d36-7675-46f0-ac10-f88faf89c325 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:55.221209 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e7db8d36-7675-46f0-ac10-f88faf89c325 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:55.221209 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e7db8d36-7675-46f0-ac10-f88faf89c325 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:55.343561 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8cf7b9f4-7f58-4cff-9cae-f4b8f83fcff8 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:55.344293 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8cf7b9f4-7f58-4cff-9cae-f4b8f83fcff8 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] [instance: aa768b59-9807-4365-a405-b6e688b1e0f6] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:55.351193 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8cf7b9f4-7f58-4cff-9cae-f4b8f83fcff8 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:55.351708 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8cf7b9f4-7f58-4cff-9cae-f4b8f83fcff8 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:55.352145 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8cf7b9f4-7f58-4cff-9cae-f4b8f83fcff8 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:55.353044 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8cf7b9f4-7f58-4cff-9cae-f4b8f83fcff8 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:55.353505 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8cf7b9f4-7f58-4cff-9cae-f4b8f83fcff8 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:55.353942 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8cf7b9f4-7f58-4cff-9cae-f4b8f83fcff8 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:55.360896 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e7db8d36-7675-46f0-ac10-f88faf89c325 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0501ceda4e8140e09fb4e94552487cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8525dcc00e844959a1527424291a3149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:55.369160 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e7db8d36-7675-46f0-ac10-f88faf89c325 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] 10.222.0.42 "GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c" status: 200 len: 1681 microversion: 2.1 time: 0.166039 Oct 23 01:24:55.369743 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1845/3664] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:55 2022] GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:55.496616 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8cf7b9f4-7f58-4cff-9cae-f4b8f83fcff8 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8a867611614ea585d510d62c63cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9f6afbdbf74318a98dfe455a72ac7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:55.504741 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8cf7b9f4-7f58-4cff-9cae-f4b8f83fcff8 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "GET /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6" status: 200 len: 1316 microversion: 2.1 time: 0.167196 Oct 23 01:24:55.505431 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1820/3665] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:55 2022] GET /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6 => generated 1316 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:24:55.691063 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8035b293-c7f7-4fc9-9015-78d2231da5af tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:55.691916 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8035b293-c7f7-4fc9-9015-78d2231da5af tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] [instance: 623b5796-affa-4692-a43d-7bbb95ce8270] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:55.698235 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8035b293-c7f7-4fc9-9015-78d2231da5af tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:55.698733 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8035b293-c7f7-4fc9-9015-78d2231da5af tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:55.699313 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8035b293-c7f7-4fc9-9015-78d2231da5af tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:55.699893 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8035b293-c7f7-4fc9-9015-78d2231da5af tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:55.700354 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8035b293-c7f7-4fc9-9015-78d2231da5af tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:55.700778 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8035b293-c7f7-4fc9-9015-78d2231da5af tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:55.748301 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0fca9e3b-e81f-449d-855f-5b8f9556dd2d tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:55.749345 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0fca9e3b-e81f-449d-855f-5b8f9556dd2d tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:55.759427 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0fca9e3b-e81f-449d-855f-5b8f9556dd2d tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:55.759920 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0fca9e3b-e81f-449d-855f-5b8f9556dd2d tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:55.760352 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0fca9e3b-e81f-449d-855f-5b8f9556dd2d tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:55.761897 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0fca9e3b-e81f-449d-855f-5b8f9556dd2d tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:55.762386 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0fca9e3b-e81f-449d-855f-5b8f9556dd2d tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:55.763240 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0fca9e3b-e81f-449d-855f-5b8f9556dd2d tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:55.894390 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8035b293-c7f7-4fc9-9015-78d2231da5af tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4024e1a8f515435f86d3d36d59262813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316cbb6f558c4bc8b34050cc1b8ea134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:55.903225 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8035b293-c7f7-4fc9-9015-78d2231da5af tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] 10.222.0.42 "GET /compute/v2.1/servers/623b5796-affa-4692-a43d-7bbb95ce8270" status: 200 len: 1316 microversion: 2.1 time: 0.216855 Oct 23 01:24:55.909221 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1846/3666] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:55 2022] GET /compute/v2.1/servers/623b5796-affa-4692-a43d-7bbb95ce8270 => generated 1316 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:55.936957 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0fca9e3b-e81f-449d-855f-5b8f9556dd2d tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60276a4031ee45ffa651b5467a62a81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a369d45e4804ffca2e89cb72f447a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:55.945571 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0fca9e3b-e81f-449d-855f-5b8f9556dd2d tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "GET /compute/v2.1/servers/c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd" status: 200 len: 1508 microversion: 2.1 time: 0.202661 Oct 23 01:24:55.946310 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1821/3667] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:55 2022] GET /compute/v2.1/servers/c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd => generated 1508 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:56.392917 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9ffc3703-1afb-4649-ad64-b21f5ef5e023 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:56.393527 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9ffc3703-1afb-4649-ad64-b21f5ef5e023 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] [instance: e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:56.397494 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=10 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:56.416322 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ffc3703-1afb-4649-ad64-b21f5ef5e023 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:56.417299 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ffc3703-1afb-4649-ad64-b21f5ef5e023 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:56.426991 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ffc3703-1afb-4649-ad64-b21f5ef5e023 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:56.426991 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ffc3703-1afb-4649-ad64-b21f5ef5e023 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:56.426991 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ffc3703-1afb-4649-ad64-b21f5ef5e023 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:56.426991 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ffc3703-1afb-4649-ad64-b21f5ef5e023 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:56.528487 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-39013766-5220-4bbc-a298-f0a64949e33d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:56.529725 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-39013766-5220-4bbc-a298-f0a64949e33d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] [instance: aa768b59-9807-4365-a405-b6e688b1e0f6] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:56.539958 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-39013766-5220-4bbc-a298-f0a64949e33d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:56.544760 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-39013766-5220-4bbc-a298-f0a64949e33d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:56.545830 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-39013766-5220-4bbc-a298-f0a64949e33d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:56.548861 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-39013766-5220-4bbc-a298-f0a64949e33d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:56.551625 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-39013766-5220-4bbc-a298-f0a64949e33d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:56.552951 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-39013766-5220-4bbc-a298-f0a64949e33d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:56.667843 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9ffc3703-1afb-4649-ad64-b21f5ef5e023 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0501ceda4e8140e09fb4e94552487cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8525dcc00e844959a1527424291a3149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:56.676157 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9ffc3703-1afb-4649-ad64-b21f5ef5e023 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] 10.222.0.42 "GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c" status: 200 len: 1681 microversion: 2.1 time: 0.286477 Oct 23 01:24:56.676744 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1847/3668] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:56 2022] GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c => generated 1681 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:56.785558 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-39013766-5220-4bbc-a298-f0a64949e33d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8a867611614ea585d510d62c63cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9f6afbdbf74318a98dfe455a72ac7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:56.793816 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-39013766-5220-4bbc-a298-f0a64949e33d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "GET /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6" status: 200 len: 1316 microversion: 2.1 time: 0.269551 Oct 23 01:24:56.794461 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1822/3669] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:56 2022] GET /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6 => generated 1316 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:56.928233 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bd9dd2fe-2633-4ef9-9515-19b75d40847b tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:56.929113 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bd9dd2fe-2633-4ef9-9515-19b75d40847b tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] [instance: 623b5796-affa-4692-a43d-7bbb95ce8270] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:56.936220 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bd9dd2fe-2633-4ef9-9515-19b75d40847b tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:56.936746 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bd9dd2fe-2633-4ef9-9515-19b75d40847b tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:56.937184 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bd9dd2fe-2633-4ef9-9515-19b75d40847b tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:56.938608 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bd9dd2fe-2633-4ef9-9515-19b75d40847b tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:56.939042 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bd9dd2fe-2633-4ef9-9515-19b75d40847b tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:56.939469 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bd9dd2fe-2633-4ef9-9515-19b75d40847b tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:57.101646 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-73632e46-ee07-4619-9ed4-c6656ae3d226 req-fd97f02c-4f90-4178-8d61-b506bfdd58a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c", "name": "network-vif-deleted", "tag": "9cec7f90-b6d7-4f93-9440-efa7b73f0b1c"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:24:57.117849 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-73632e46-ee07-4619-9ed4-c6656ae3d226 req-fd97f02c-4f90-4178-8d61-b506bfdd58a8 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:57.118714 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-73632e46-ee07-4619-9ed4-c6656ae3d226 req-fd97f02c-4f90-4178-8d61-b506bfdd58a8 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:57.119322 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-73632e46-ee07-4619-9ed4-c6656ae3d226 req-fd97f02c-4f90-4178-8d61-b506bfdd58a8 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:57.135570 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-73632e46-ee07-4619-9ed4-c6656ae3d226 req-fd97f02c-4f90-4178-8d61-b506bfdd58a8 service nova] Creating event network-vif-deleted:9cec7f90-b6d7-4f93-9440-efa7b73f0b1c for instance e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c on n-h1-master-1 Oct 23 01:24:57.141683 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-73632e46-ee07-4619-9ed4-c6656ae3d226 req-fd97f02c-4f90-4178-8d61-b506bfdd58a8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045666 Oct 23 01:24:57.143138 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1823/3670] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:24:57.187241 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bd9dd2fe-2633-4ef9-9515-19b75d40847b tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4024e1a8f515435f86d3d36d59262813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316cbb6f558c4bc8b34050cc1b8ea134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:57.201835 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bd9dd2fe-2633-4ef9-9515-19b75d40847b tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] 10.222.0.42 "GET /compute/v2.1/servers/623b5796-affa-4692-a43d-7bbb95ce8270" status: 200 len: 1316 microversion: 2.1 time: 0.278206 Oct 23 01:24:57.208110 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1848/3671] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:56 2022] GET /compute/v2.1/servers/623b5796-affa-4692-a43d-7bbb95ce8270 => generated 1316 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:57.705528 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bae9581c-fc9b-4fbb-a8f6-fc6be88e67f3 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:57.707794 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-bae9581c-fc9b-4fbb-a8f6-fc6be88e67f3 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] [instance: e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:57.717734 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bae9581c-fc9b-4fbb-a8f6-fc6be88e67f3 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:57.718651 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bae9581c-fc9b-4fbb-a8f6-fc6be88e67f3 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:57.719927 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bae9581c-fc9b-4fbb-a8f6-fc6be88e67f3 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:57.721716 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bae9581c-fc9b-4fbb-a8f6-fc6be88e67f3 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:57.723882 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bae9581c-fc9b-4fbb-a8f6-fc6be88e67f3 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:57.724716 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bae9581c-fc9b-4fbb-a8f6-fc6be88e67f3 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:57.763030 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bae9581c-fc9b-4fbb-a8f6-fc6be88e67f3 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:57.763660 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bae9581c-fc9b-4fbb-a8f6-fc6be88e67f3 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:57.764425 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bae9581c-fc9b-4fbb-a8f6-fc6be88e67f3 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:57.766673 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-bae9581c-fc9b-4fbb-a8f6-fc6be88e67f3 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lazy-loading 'fault' on Instance uuid e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:24:57.824471 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ef32fe62-25f5-4c57-a866-01b3b37f6a3c tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:57.826722 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ef32fe62-25f5-4c57-a866-01b3b37f6a3c tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] [instance: aa768b59-9807-4365-a405-b6e688b1e0f6] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:57.844929 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ef32fe62-25f5-4c57-a866-01b3b37f6a3c tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:57.845452 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ef32fe62-25f5-4c57-a866-01b3b37f6a3c tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:57.847169 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ef32fe62-25f5-4c57-a866-01b3b37f6a3c tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:57.847317 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bae9581c-fc9b-4fbb-a8f6-fc6be88e67f3 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0501ceda4e8140e09fb4e94552487cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8525dcc00e844959a1527424291a3149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:57.848279 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ef32fe62-25f5-4c57-a866-01b3b37f6a3c tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:57.851888 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ef32fe62-25f5-4c57-a866-01b3b37f6a3c tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:57.851888 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ef32fe62-25f5-4c57-a866-01b3b37f6a3c tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:57.856767 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bae9581c-fc9b-4fbb-a8f6-fc6be88e67f3 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] 10.222.0.42 "GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c" status: 200 len: 1330 microversion: 2.1 time: 0.156872 Oct 23 01:24:57.858015 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1824/3672] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:57 2022] GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c => generated 1330 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:58.055231 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ef32fe62-25f5-4c57-a866-01b3b37f6a3c tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8a867611614ea585d510d62c63cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9f6afbdbf74318a98dfe455a72ac7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:58.063521 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ef32fe62-25f5-4c57-a866-01b3b37f6a3c tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "GET /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6" status: 200 len: 1504 microversion: 2.1 time: 0.246141 Oct 23 01:24:58.064248 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1849/3673] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:57 2022] GET /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6 => generated 1504 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:58.088652 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7cec580f-3ffc-4eee-88e0-6721246d153b tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1146812390"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:24:58.089191 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7cec580f-3ffc-4eee-88e0-6721246d153b tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] [instance: aa768b59-9807-4365-a405-b6e688b1e0f6] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:58.095299 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7cec580f-3ffc-4eee-88e0-6721246d153b tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:58.095738 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7cec580f-3ffc-4eee-88e0-6721246d153b tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:58.096179 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7cec580f-3ffc-4eee-88e0-6721246d153b tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:58.096878 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7cec580f-3ffc-4eee-88e0-6721246d153b tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:58.097883 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7cec580f-3ffc-4eee-88e0-6721246d153b tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:58.098589 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7cec580f-3ffc-4eee-88e0-6721246d153b tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:58.237598 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dfb28604-4b03-4677-8b5e-18880fd8ac3f tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:58.238189 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-dfb28604-4b03-4677-8b5e-18880fd8ac3f tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] [instance: 623b5796-affa-4692-a43d-7bbb95ce8270] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:58.244693 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dfb28604-4b03-4677-8b5e-18880fd8ac3f tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:58.245197 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dfb28604-4b03-4677-8b5e-18880fd8ac3f tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:58.245635 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dfb28604-4b03-4677-8b5e-18880fd8ac3f tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:58.246363 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dfb28604-4b03-4677-8b5e-18880fd8ac3f tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:58.246879 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dfb28604-4b03-4677-8b5e-18880fd8ac3f tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:58.247381 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dfb28604-4b03-4677-8b5e-18880fd8ac3f tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:58.265509 n-d-master-1 devstack@n-api.service[120945]: INFO nova.network.security_group_api [None req-7cec580f-3ffc-4eee-88e0-6721246d153b tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Adding security group e386a1ff-2e8c-4093-9300-e27bb7a458a6 to port 66f1253e-27b9-42ba-b3ee-ef4ed5990380 Oct 23 01:24:58.487344 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-dfb28604-4b03-4677-8b5e-18880fd8ac3f tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4024e1a8f515435f86d3d36d59262813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316cbb6f558c4bc8b34050cc1b8ea134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:58.501899 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-dfb28604-4b03-4677-8b5e-18880fd8ac3f tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] 10.222.0.42 "GET /compute/v2.1/servers/623b5796-affa-4692-a43d-7bbb95ce8270" status: 200 len: 1316 microversion: 2.1 time: 0.268198 Oct 23 01:24:58.502652 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1850/3674] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:58 2022] GET /compute/v2.1/servers/623b5796-affa-4692-a43d-7bbb95ce8270 => generated 1316 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:58.793297 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9ff12332-2e5d-413a-a08d-17eeb2046a13 tempest-VolumesAdminNegativeTest-922623748 tempest-VolumesAdminNegativeTest-922623748-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "1eff1f56-6c61-43fc-84c9-772bbb148a8e"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:24:58.796082 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9ff12332-2e5d-413a-a08d-17eeb2046a13 tempest-VolumesAdminNegativeTest-922623748 tempest-VolumesAdminNegativeTest-922623748-project-admin] [instance: c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:58.816312 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ff12332-2e5d-413a-a08d-17eeb2046a13 tempest-VolumesAdminNegativeTest-922623748 tempest-VolumesAdminNegativeTest-922623748-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:58.817088 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7cec580f-3ffc-4eee-88e0-6721246d153b tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "POST /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6/action" status: 202 len: 0 microversion: 2.1 time: 0.732398 Oct 23 01:24:58.818146 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1825/3675] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:24:58 2022] POST /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6/action => generated 0 bytes in 734 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:24:58.821504 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ff12332-2e5d-413a-a08d-17eeb2046a13 tempest-VolumesAdminNegativeTest-922623748 tempest-VolumesAdminNegativeTest-922623748-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:58.822182 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ff12332-2e5d-413a-a08d-17eeb2046a13 tempest-VolumesAdminNegativeTest-922623748 tempest-VolumesAdminNegativeTest-922623748-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:58.823002 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ff12332-2e5d-413a-a08d-17eeb2046a13 tempest-VolumesAdminNegativeTest-922623748 tempest-VolumesAdminNegativeTest-922623748-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:58.824237 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ff12332-2e5d-413a-a08d-17eeb2046a13 tempest-VolumesAdminNegativeTest-922623748 tempest-VolumesAdminNegativeTest-922623748-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:58.824882 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ff12332-2e5d-413a-a08d-17eeb2046a13 tempest-VolumesAdminNegativeTest-922623748 tempest-VolumesAdminNegativeTest-922623748-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:58.830751 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-db6b61d1-c782-4e6d-bc7c-aafd05338ec9 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '.version_select at 0x7f5cc2a4c700>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-9ff12332-2e5d-413a-a08d-17eeb2046a13 tempest-VolumesAdminNegativeTest-922623748 tempest-VolumesAdminNegativeTest-922623748-project-admin] HTTP exception thrown: Volume f68dd3ab-ade6-41b3-8de5-58a7eb826cc6 could not be found. Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9ff12332-2e5d-413a-a08d-17eeb2046a13 tempest-VolumesAdminNegativeTest-922623748 tempest-VolumesAdminNegativeTest-922623748-project-admin] Request method failure captured: Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: request: PUT /compute/v2.1/servers/c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd/os-volume_attachments/f68dd3ab-ade6-41b3-8de5-58a7eb826cc6 HTTP/1.1 Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 74 Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJds6BAPoEQ0cj5pS3PPHWZxAD2yMhoqvLCaN5j9L7fyQWxVBRj99Aqh_xl1fUpLXLc7xdD09VSPaDSGdtVyyOq04bXA7E4wcytKh456NeteOquyvKl7rjvSrEWC5BiBxoG4yHwyHoizHuSR0Y1GMsMytmjMTrreyWgaCUOcIgwtydI Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: a4faf89299604d51b0b70e63f4b7022c Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-VolumesAdminNegativeTest-922623748 Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,admin,reader Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,admin,reader Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a4faf89299604d51b0b70e63f4b7022c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a4faf89299604d51b0b70e63f4b7022c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a4faf89299604d51b0b70e63f4b7022c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a4faf89299604d51b0b70e63f4b7022c"}]}] Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-VolumesAdminNegativeTest-922623748 Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: a4faf89299604d51b0b70e63f4b7022c Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-922623748 Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-VolumesAdminNegativeTest-922623748-project-admin Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: b16c8a1cdf2741cb8618a48a38e98455 Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-VolumesAdminNegativeTest-922623748-project-admin Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: {"volumeAttachment": {"volumeId": "1eff1f56-6c61-43fc-84c9-772bbb148a8e"}} Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: exception: Volume f68dd3ab-ade6-41b3-8de5-58a7eb826cc6 could not be found. Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: action_args: {'server_id': 'c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd', 'id': 'f68dd3ab-ade6-41b3-8de5-58a7eb826cc6', 'body': {'volumeAttachment': {'volumeId': '1eff1f56-6c61-43fc-84c9-772bbb148a8e'}}} Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f68dd3ab-ade6-41b3-8de5-58a7eb826cc6 could not be found. (HTTP 404) (Request-ID: req-d8fc9259-5c9e-426d-bc0f-3a5e5b0552bf) Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 23 01:24:58.893090 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 23 01:24:58.897907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 23 01:24:58.897907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 23 01:24:58.897907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 23 01:24:58.897907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 23 01:24:58.897907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 23 01:24:58.897907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 23 01:24:58.897907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 01:24:58.897907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 01:24:58.897907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 23 01:24:58.897907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 23 01:24:58.897907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 23 01:24:58.897907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 23 01:24:58.897907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 23 01:24:58.897907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 23 01:24:58.897907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 23 01:24:58.897907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 23 01:24:58.897907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 01:24:58.897907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 01:24:58.897907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 01:24:58.897907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 01:24:58.897907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f68dd3ab-ade6-41b3-8de5-58a7eb826cc6 could not be found. Oct 23 01:24:58.897907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:24:58.897907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:24:58.897907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:24:58.897907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:24:58.897907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:24:58.897907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:24:58.897907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:24:58.897907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:24:58.897907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:24:58.897907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:24:58.897907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:24:58.897907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:24:58.897907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:24:58.897907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:24:58.897907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 23 01:24:58.897907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 23 01:24:58.897907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 23 01:24:58.897907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:24:58.897907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f68dd3ab-ade6-41b3-8de5-58a7eb826cc6 could not be found. Oct 23 01:24:58.897907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:24:58.897907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:24:58.897907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:24:58.897907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:24:58.897907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:24:58.897907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:24:58.897907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:24:58.897907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:24:58.897907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f68dd3ab-ade6-41b3-8de5-58a7eb826cc6 could not be found. Oct 23 01:24:58.897907 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:24:58.897907 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9ff12332-2e5d-413a-a08d-17eeb2046a13 tempest-VolumesAdminNegativeTest-922623748 tempest-VolumesAdminNegativeTest-922623748-project-admin] Returning 404 to user: Volume f68dd3ab-ade6-41b3-8de5-58a7eb826cc6 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:24:58.897907 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9ff12332-2e5d-413a-a08d-17eeb2046a13 tempest-VolumesAdminNegativeTest-922623748 tempest-VolumesAdminNegativeTest-922623748-project-admin] 10.222.0.42 "PUT /compute/v2.1/servers/c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd/os-volume_attachments/f68dd3ab-ade6-41b3-8de5-58a7eb826cc6" status: 404 len: 109 microversion: 2.1 time: 0.105135 Oct 23 01:24:58.902852 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1851/3676] 10.222.0.42 () {60 vars in 1433 bytes} [Sun Oct 23 01:24:58 2022] PUT /compute/v2.1/servers/c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd/os-volume_attachments/f68dd3ab-ade6-41b3-8de5-58a7eb826cc6 => generated 109 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 01:24:58.902852 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-10769c6b-77e1-4ac3-9234-fb4233322a36 req-7acec577-c42e-4e58-a50b-9dedff099300 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa768b59-9807-4365-a405-b6e688b1e0f6", "tag": "66f1253e-27b9-42ba-b3ee-ef4ed5990380"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:24:58.920113 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-10769c6b-77e1-4ac3-9234-fb4233322a36 req-7acec577-c42e-4e58-a50b-9dedff099300 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:58.920606 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-10769c6b-77e1-4ac3-9234-fb4233322a36 req-7acec577-c42e-4e58-a50b-9dedff099300 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:58.925133 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-10769c6b-77e1-4ac3-9234-fb4233322a36 req-7acec577-c42e-4e58-a50b-9dedff099300 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:58.948135 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-10769c6b-77e1-4ac3-9234-fb4233322a36 req-7acec577-c42e-4e58-a50b-9dedff099300 service nova] Creating event network-changed:66f1253e-27b9-42ba-b3ee-ef4ed5990380 for instance aa768b59-9807-4365-a405-b6e688b1e0f6 on n-h1-master-1 Oct 23 01:24:58.954844 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-10769c6b-77e1-4ac3-9234-fb4233322a36 req-7acec577-c42e-4e58-a50b-9dedff099300 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058070 Oct 23 01:24:58.955459 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1852/3677] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:24:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:24:58.962372 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-272fa89a-e119-428c-980c-2d951802e58a tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:58.963076 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-272fa89a-e119-428c-980c-2d951802e58a tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] [instance: e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:58.969799 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-272fa89a-e119-428c-980c-2d951802e58a tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:58.970451 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-272fa89a-e119-428c-980c-2d951802e58a tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:58.970889 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-272fa89a-e119-428c-980c-2d951802e58a tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:58.971592 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-272fa89a-e119-428c-980c-2d951802e58a tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:58.972805 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-272fa89a-e119-428c-980c-2d951802e58a tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:58.973406 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-272fa89a-e119-428c-980c-2d951802e58a tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:58.990969 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-272fa89a-e119-428c-980c-2d951802e58a tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] HTTP exception thrown: Instance e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c could not be found. Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-272fa89a-e119-428c-980c-2d951802e58a tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Request method failure captured: Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c HTTP/1.1 Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJdEGmClPp4UD2PaOyKqqXvx0fGsewCdu0LYVmEf4ary7O6uTR2MxL9PoeI4bFS-lXr_RgZeBaG4-2L1CY7--u8E_pS-lzvXkVNnthe_io1YBUzagOpHfRm5_sEjuJgHwMml6ZljusEfcn8MvU3ALJY61Ab2OqnO5U344SLBpBRgZj4 Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 8525dcc00e844959a1527424291a3149 Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-394550811 Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8525dcc00e844959a1527424291a3149"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8525dcc00e844959a1527424291a3149"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8525dcc00e844959a1527424291a3149"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8525dcc00e844959a1527424291a3149"}]}] Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-394550811 Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 8525dcc00e844959a1527424291a3149 Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-394550811 Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-AttachSCSIVolumeTestJSON-394550811-project Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 0501ceda4e8140e09fb4e94552487cc3 Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-394550811-project Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: exception: Instance e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c could not be found. Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c'} Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c could not be found. Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c could not be found. Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:24:58.992634 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:24:58.997736 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:24:58.997736 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:24:58.997736 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:24:58.997736 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:24:58.997736 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:24:58.997736 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c could not be found. Oct 23 01:24:58.997736 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:24:58.997736 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-272fa89a-e119-428c-980c-2d951802e58a tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Returning 404 to user: Instance e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:24:58.997736 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-272fa89a-e119-428c-980c-2d951802e58a tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] 10.222.0.42 "GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c" status: 404 len: 111 microversion: 2.1 time: 0.037816 Oct 23 01:24:58.999071 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1853/3678] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:58 2022] GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:24:59.005449 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b4252acf-bc43-4c99-8d29-7aa30ab1a720 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Calling method '.version_select at 0x7f5cc0ff4430>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:59.022598 n-d-master-1 devstack@n-api.service[120945]: DEBUG neutronclient.v2_0.client [None req-db6b61d1-c782-4e6d-bc7c-aafd05338ec9 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group e386a1ff-2e8c-4093-9300-e27bb7a458a6 in use.", "detail": ""}} {{(pid=120945) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 23 01:24:59.022598 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-db6b61d1-c782-4e6d-bc7c-aafd05338ec9 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] HTTP exception thrown: Security Group e386a1ff-2e8c-4093-9300-e27bb7a458a6 in use. Oct 23 01:24:59.022598 n-d-master-1 devstack@n-api.service[120945]: Neutron server returns request_ids: ['req-4960cfc1-3284-49bb-9b51-b27204ba57cf'] Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-db6b61d1-c782-4e6d-bc7c-aafd05338ec9 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Request method failure captured: Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/os-security-groups/e386a1ff-2e8c-4093-9300-e27bb7a458a6 HTTP/1.1 Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJe3mET0Sd7lZbPfIN3VkjmqiroRssL9JbOguxpn1sZ00E3M8viQBbgfQ2g7IyamsO6Vg1eRk3unJQGVa1SLVceO_jtTkwsvZ7R_UZpRIovLO2xYyroaQHuRt-8XjOXN_zV_7Obxi_ZE4mM221EAm7ZWkONLhuVRvJ2vR8Bciy4qSyo Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 8d9f6afbdbf74318a98dfe455a72ac7c Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-SecurityGroupsTestJSON-215153901 Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8d9f6afbdbf74318a98dfe455a72ac7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8d9f6afbdbf74318a98dfe455a72ac7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8d9f6afbdbf74318a98dfe455a72ac7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8d9f6afbdbf74318a98dfe455a72ac7c"}]}] Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-SecurityGroupsTestJSON-215153901 Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 8d9f6afbdbf74318a98dfe455a72ac7c Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-215153901 Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-SecurityGroupsTestJSON-215153901-project Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 2b8a867611614ea585d510d62c63cfa3 Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-SecurityGroupsTestJSON-215153901-project Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: method: Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: exception: Security Group e386a1ff-2e8c-4093-9300-e27bb7a458a6 in use. Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: Neutron server returns request_ids: ['req-4960cfc1-3284-49bb-9b51-b27204ba57cf'] Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'e386a1ff-2e8c-4093-9300-e27bb7a458a6'} Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 23 01:24:59.023782 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group e386a1ff-2e8c-4093-9300-e27bb7a458a6 in use. Oct 23 01:24:59.029646 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4960cfc1-3284-49bb-9b51-b27204ba57cf'] Oct 23 01:24:59.029646 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:24:59.029646 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:24:59.029646 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:24:59.029646 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:24:59.029646 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 23 01:24:59.029646 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 23 01:24:59.029646 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 23 01:24:59.029646 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 23 01:24:59.029646 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group e386a1ff-2e8c-4093-9300-e27bb7a458a6 in use. Oct 23 01:24:59.029646 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4960cfc1-3284-49bb-9b51-b27204ba57cf'] Oct 23 01:24:59.029646 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:24:59.029646 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:24:59.029646 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:24:59.029646 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:24:59.029646 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:24:59.029646 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:24:59.029646 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:24:59.029646 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:24:59.029646 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:24:59.029646 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:24:59.029646 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:24:59.029646 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:24:59.029646 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 23 01:24:59.029646 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 23 01:24:59.029646 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group e386a1ff-2e8c-4093-9300-e27bb7a458a6 in use. Oct 23 01:24:59.029646 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4960cfc1-3284-49bb-9b51-b27204ba57cf'] Oct 23 01:24:59.029646 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:24:59.029646 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:24:59.029646 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:24:59.029646 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:24:59.029646 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:24:59.029646 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:24:59.029646 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:24:59.029646 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:24:59.029646 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group e386a1ff-2e8c-4093-9300-e27bb7a458a6 in use. Oct 23 01:24:59.029646 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4960cfc1-3284-49bb-9b51-b27204ba57cf'] Oct 23 01:24:59.029646 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:24:59.029646 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-db6b61d1-c782-4e6d-bc7c-aafd05338ec9 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Returning 400 to user: Security Group e386a1ff-2e8c-4093-9300-e27bb7a458a6 in use. Oct 23 01:24:59.029646 n-d-master-1 devstack@n-api.service[120945]: Neutron server returns request_ids: ['req-4960cfc1-3284-49bb-9b51-b27204ba57cf'] {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:24:59.029646 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-db6b61d1-c782-4e6d-bc7c-aafd05338ec9 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/e386a1ff-2e8c-4093-9300-e27bb7a458a6" status: 400 len: 185 microversion: 2.1 time: 0.203365 Oct 23 01:24:59.029646 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1826/3679] 10.222.0.42 () {58 vars in 1272 bytes} [Sun Oct 23 01:24:58 2022] DELETE /compute/v2.1/os-security-groups/e386a1ff-2e8c-4093-9300-e27bb7a458a6 => generated 185 bytes in 205 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 23 01:24:59.040636 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-05e3fceb-8db1-447e-bca2-0db3b45f2501 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:24:59.043599 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-05e3fceb-8db1-447e-bca2-0db3b45f2501 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] [instance: aa768b59-9807-4365-a405-b6e688b1e0f6] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:59.052819 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05e3fceb-8db1-447e-bca2-0db3b45f2501 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:59.053473 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05e3fceb-8db1-447e-bca2-0db3b45f2501 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:59.054261 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05e3fceb-8db1-447e-bca2-0db3b45f2501 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:59.054977 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05e3fceb-8db1-447e-bca2-0db3b45f2501 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:59.055493 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05e3fceb-8db1-447e-bca2-0db3b45f2501 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:59.056011 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05e3fceb-8db1-447e-bca2-0db3b45f2501 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:59.146941 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b4252acf-bc43-4c99-8d29-7aa30ab1a720 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-843674769" status: 202 len: 0 microversion: 2.1 time: 0.146950 Oct 23 01:24:59.147529 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1854/3680] 10.222.0.42 () {58 vars in 1218 bytes} [Sun Oct 23 01:24:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-843674769 => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:24:59.321534 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-05e3fceb-8db1-447e-bca2-0db3b45f2501 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "POST /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6/action" status: 202 len: 0 microversion: 2.1 time: 0.286829 Oct 23 01:24:59.322646 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1827/3681] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:24:59 2022] POST /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:24:59.332025 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0f64f70c-5c89-40f1-8f32-e97dbb3acce2 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:59.332655 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0f64f70c-5c89-40f1-8f32-e97dbb3acce2 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] [instance: aa768b59-9807-4365-a405-b6e688b1e0f6] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:59.348963 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:59.360298 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0f64f70c-5c89-40f1-8f32-e97dbb3acce2 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:59.360851 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0f64f70c-5c89-40f1-8f32-e97dbb3acce2 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:59.361295 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0f64f70c-5c89-40f1-8f32-e97dbb3acce2 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:59.363932 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0f64f70c-5c89-40f1-8f32-e97dbb3acce2 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:59.364759 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0f64f70c-5c89-40f1-8f32-e97dbb3acce2 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:59.365189 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0f64f70c-5c89-40f1-8f32-e97dbb3acce2 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:59.400419 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-7edc852f-2728-4bac-a79f-3900b832d076 req-826df6ac-4257-488a-9998-6d17b4d32e98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "623b5796-affa-4692-a43d-7bbb95ce8270", "name": "network-vif-plugged", "status": "completed", "tag": "f86d5c82-c234-49b7-9637-45d8048180ab"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:24:59.421111 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-7edc852f-2728-4bac-a79f-3900b832d076 req-826df6ac-4257-488a-9998-6d17b4d32e98 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:59.421623 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-7edc852f-2728-4bac-a79f-3900b832d076 req-826df6ac-4257-488a-9998-6d17b4d32e98 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:59.422143 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-7edc852f-2728-4bac-a79f-3900b832d076 req-826df6ac-4257-488a-9998-6d17b4d32e98 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:59.446440 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-7edc852f-2728-4bac-a79f-3900b832d076 req-826df6ac-4257-488a-9998-6d17b4d32e98 service nova] Creating event network-vif-plugged:f86d5c82-c234-49b7-9637-45d8048180ab for instance 623b5796-affa-4692-a43d-7bbb95ce8270 on n-h2-master-1 Oct 23 01:24:59.458966 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-7edc852f-2728-4bac-a79f-3900b832d076 req-826df6ac-4257-488a-9998-6d17b4d32e98 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062284 Oct 23 01:24:59.487370 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1828/3682] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:24:59.527217 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-782920c8-6947-48ec-adb1-1bc04a795b61 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:24:59.527844 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-782920c8-6947-48ec-adb1-1bc04a795b61 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] [instance: 623b5796-affa-4692-a43d-7bbb95ce8270] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:24:59.554803 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-782920c8-6947-48ec-adb1-1bc04a795b61 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:59.554803 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-782920c8-6947-48ec-adb1-1bc04a795b61 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:59.554803 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-782920c8-6947-48ec-adb1-1bc04a795b61 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:59.555140 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-782920c8-6947-48ec-adb1-1bc04a795b61 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:24:59.555684 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-782920c8-6947-48ec-adb1-1bc04a795b61 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:24:59.556240 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-782920c8-6947-48ec-adb1-1bc04a795b61 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:24:59.679992 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0f64f70c-5c89-40f1-8f32-e97dbb3acce2 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8a867611614ea585d510d62c63cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9f6afbdbf74318a98dfe455a72ac7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:59.692884 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0f64f70c-5c89-40f1-8f32-e97dbb3acce2 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "GET /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6" status: 200 len: 1575 microversion: 2.1 time: 0.365903 Oct 23 01:24:59.694176 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1855/3683] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:59 2022] GET /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6 => generated 1575 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:24:59.777099 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-782920c8-6947-48ec-adb1-1bc04a795b61 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4024e1a8f515435f86d3d36d59262813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316cbb6f558c4bc8b34050cc1b8ea134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:24:59.791872 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-782920c8-6947-48ec-adb1-1bc04a795b61 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] 10.222.0.42 "GET /compute/v2.1/servers/623b5796-affa-4692-a43d-7bbb95ce8270" status: 200 len: 1316 microversion: 2.1 time: 0.264645 Oct 23 01:24:59.791872 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1829/3684] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:24:59 2022] GET /compute/v2.1/servers/623b5796-affa-4692-a43d-7bbb95ce8270 => generated 1316 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:25:00.719222 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e254e74f-e2c3-42cf-8546-79f442818b35 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:00.719222 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e254e74f-e2c3-42cf-8546-79f442818b35 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] [instance: aa768b59-9807-4365-a405-b6e688b1e0f6] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:00.728387 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e254e74f-e2c3-42cf-8546-79f442818b35 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:00.729164 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e254e74f-e2c3-42cf-8546-79f442818b35 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:00.729832 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e254e74f-e2c3-42cf-8546-79f442818b35 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:00.730851 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e254e74f-e2c3-42cf-8546-79f442818b35 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:00.731536 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e254e74f-e2c3-42cf-8546-79f442818b35 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:00.732188 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e254e74f-e2c3-42cf-8546-79f442818b35 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:00.812579 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b9c8c75f-6ed7-4692-bf7b-2c7ad144d4f8 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:00.813428 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b9c8c75f-6ed7-4692-bf7b-2c7ad144d4f8 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] [instance: 623b5796-affa-4692-a43d-7bbb95ce8270] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:00.828498 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9c8c75f-6ed7-4692-bf7b-2c7ad144d4f8 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:00.829665 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9c8c75f-6ed7-4692-bf7b-2c7ad144d4f8 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:00.830440 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9c8c75f-6ed7-4692-bf7b-2c7ad144d4f8 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:00.832508 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9c8c75f-6ed7-4692-bf7b-2c7ad144d4f8 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:00.833358 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9c8c75f-6ed7-4692-bf7b-2c7ad144d4f8 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:00.834679 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9c8c75f-6ed7-4692-bf7b-2c7ad144d4f8 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:00.996590 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e254e74f-e2c3-42cf-8546-79f442818b35 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8a867611614ea585d510d62c63cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9f6afbdbf74318a98dfe455a72ac7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:01.008308 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e254e74f-e2c3-42cf-8546-79f442818b35 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "GET /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6" status: 200 len: 1575 microversion: 2.1 time: 0.294782 Oct 23 01:25:01.010042 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1856/3685] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:00 2022] GET /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6 => generated 1575 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:25:01.079682 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b9c8c75f-6ed7-4692-bf7b-2c7ad144d4f8 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4024e1a8f515435f86d3d36d59262813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316cbb6f558c4bc8b34050cc1b8ea134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:01.097639 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b9c8c75f-6ed7-4692-bf7b-2c7ad144d4f8 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] 10.222.0.42 "GET /compute/v2.1/servers/623b5796-affa-4692-a43d-7bbb95ce8270" status: 200 len: 1316 microversion: 2.1 time: 0.289086 Oct 23 01:25:01.098582 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1830/3686] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:00 2022] GET /compute/v2.1/servers/623b5796-affa-4692-a43d-7bbb95ce8270 => generated 1316 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:25:02.035713 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b724766d-cfe3-495c-a5a0-745a793082e2 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:02.037263 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b724766d-cfe3-495c-a5a0-745a793082e2 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] [instance: aa768b59-9807-4365-a405-b6e688b1e0f6] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:02.048314 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b724766d-cfe3-495c-a5a0-745a793082e2 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:02.049099 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b724766d-cfe3-495c-a5a0-745a793082e2 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:02.049541 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b724766d-cfe3-495c-a5a0-745a793082e2 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:02.050448 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b724766d-cfe3-495c-a5a0-745a793082e2 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:02.050960 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b724766d-cfe3-495c-a5a0-745a793082e2 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:02.051536 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b724766d-cfe3-495c-a5a0-745a793082e2 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:02.123936 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-20d57c19-4b2c-466b-ad69-539ca18cc108 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:02.124563 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-20d57c19-4b2c-466b-ad69-539ca18cc108 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] [instance: 623b5796-affa-4692-a43d-7bbb95ce8270] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:02.132077 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-20d57c19-4b2c-466b-ad69-539ca18cc108 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:02.134717 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-20d57c19-4b2c-466b-ad69-539ca18cc108 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:02.134717 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-20d57c19-4b2c-466b-ad69-539ca18cc108 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:02.134717 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-20d57c19-4b2c-466b-ad69-539ca18cc108 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:02.134717 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-20d57c19-4b2c-466b-ad69-539ca18cc108 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:02.135086 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-20d57c19-4b2c-466b-ad69-539ca18cc108 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:02.252292 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b724766d-cfe3-495c-a5a0-745a793082e2 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8a867611614ea585d510d62c63cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9f6afbdbf74318a98dfe455a72ac7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:02.261360 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b724766d-cfe3-495c-a5a0-745a793082e2 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "GET /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6" status: 200 len: 1573 microversion: 2.1 time: 0.230132 Oct 23 01:25:02.262032 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1857/3687] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:02 2022] GET /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6 => generated 1573 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:25:02.284507 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fa3df974-ceb1-4421-8e15-fd48d099aea6 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-965208627"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:25:02.285422 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fa3df974-ceb1-4421-8e15-fd48d099aea6 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] [instance: aa768b59-9807-4365-a405-b6e688b1e0f6] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:02.291666 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fa3df974-ceb1-4421-8e15-fd48d099aea6 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:02.292272 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fa3df974-ceb1-4421-8e15-fd48d099aea6 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:02.292861 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fa3df974-ceb1-4421-8e15-fd48d099aea6 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:02.293874 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fa3df974-ceb1-4421-8e15-fd48d099aea6 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:02.294496 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fa3df974-ceb1-4421-8e15-fd48d099aea6 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:02.295116 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fa3df974-ceb1-4421-8e15-fd48d099aea6 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:02.308853 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-20d57c19-4b2c-466b-ad69-539ca18cc108 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4024e1a8f515435f86d3d36d59262813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316cbb6f558c4bc8b34050cc1b8ea134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:02.318473 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-20d57c19-4b2c-466b-ad69-539ca18cc108 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] 10.222.0.42 "GET /compute/v2.1/servers/623b5796-affa-4692-a43d-7bbb95ce8270" status: 200 len: 1503 microversion: 2.1 time: 0.199683 Oct 23 01:25:02.319303 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1831/3688] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:02 2022] GET /compute/v2.1/servers/623b5796-affa-4692-a43d-7bbb95ce8270 => generated 1503 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:25:02.341583 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a52555ab-60a2-456f-9d8e-4d0a91f8c27e tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:02.342113 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a52555ab-60a2-456f-9d8e-4d0a91f8c27e tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] [instance: 623b5796-affa-4692-a43d-7bbb95ce8270] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:02.348366 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a52555ab-60a2-456f-9d8e-4d0a91f8c27e tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:02.348861 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a52555ab-60a2-456f-9d8e-4d0a91f8c27e tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:02.349482 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a52555ab-60a2-456f-9d8e-4d0a91f8c27e tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:02.350208 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a52555ab-60a2-456f-9d8e-4d0a91f8c27e tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:02.350670 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a52555ab-60a2-456f-9d8e-4d0a91f8c27e tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:02.351097 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a52555ab-60a2-456f-9d8e-4d0a91f8c27e tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:02.477671 n-d-master-1 devstack@n-api.service[120944]: INFO nova.network.security_group_api [None req-fa3df974-ceb1-4421-8e15-fd48d099aea6 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Adding security group 702a07e0-48c3-4e56-a03d-0233890d4617 to port 66f1253e-27b9-42ba-b3ee-ef4ed5990380 Oct 23 01:25:02.515903 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a52555ab-60a2-456f-9d8e-4d0a91f8c27e tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] 10.222.0.42 "DELETE /compute/v2.1/servers/623b5796-affa-4692-a43d-7bbb95ce8270/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.177676 Oct 23 01:25:02.522023 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1832/3689] 10.222.0.42 () {58 vars in 1296 bytes} [Sun Oct 23 01:25:02 2022] DELETE /compute/v2.1/servers/623b5796-affa-4692-a43d-7bbb95ce8270/os-server-password => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 23 01:25:02.531402 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-de1e5d90-a982-42ab-a370-0b4b5dd38fdb tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:02.533713 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-de1e5d90-a982-42ab-a370-0b4b5dd38fdb tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:02.542692 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-de1e5d90-a982-42ab-a370-0b4b5dd38fdb tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:02.543254 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-de1e5d90-a982-42ab-a370-0b4b5dd38fdb tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:02.543687 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-de1e5d90-a982-42ab-a370-0b4b5dd38fdb tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:02.544907 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-de1e5d90-a982-42ab-a370-0b4b5dd38fdb tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:02.545413 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-de1e5d90-a982-42ab-a370-0b4b5dd38fdb tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:02.545841 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-de1e5d90-a982-42ab-a370-0b4b5dd38fdb tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:02.579632 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-de1e5d90-a982-42ab-a370-0b4b5dd38fdb tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:25:02.699272 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=5 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:02.974185 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-de1e5d90-a982-42ab-a370-0b4b5dd38fdb tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd" status: 204 len: 0 microversion: 2.1 time: 0.450342 Oct 23 01:25:02.974737 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1833/3690] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:25:02 2022] DELETE /compute/v2.1/servers/c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:25:02.980298 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-47a89f86-40e4-4695-8362-f16305442e37 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:02.980955 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-47a89f86-40e4-4695-8362-f16305442e37 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] [instance: 623b5796-affa-4692-a43d-7bbb95ce8270] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:02.987086 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-47a89f86-40e4-4695-8362-f16305442e37 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:02.987578 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-47a89f86-40e4-4695-8362-f16305442e37 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:02.988009 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-47a89f86-40e4-4695-8362-f16305442e37 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:02.988692 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-47a89f86-40e4-4695-8362-f16305442e37 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:02.989141 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-47a89f86-40e4-4695-8362-f16305442e37 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:02.989557 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-47a89f86-40e4-4695-8362-f16305442e37 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:03.066940 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-47a89f86-40e4-4695-8362-f16305442e37 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] 10.222.0.42 "GET /compute/v2.1/servers/623b5796-affa-4692-a43d-7bbb95ce8270/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.086155 Oct 23 01:25:03.066940 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1834/3691] 10.222.0.42 () {58 vars in 1293 bytes} [Sun Oct 23 01:25:02 2022] GET /compute/v2.1/servers/623b5796-affa-4692-a43d-7bbb95ce8270/os-server-password => generated 16 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:25:03.074994 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d74317a6-f71a-4efc-9213-9eb7120edbe7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:03.075621 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d74317a6-f71a-4efc-9213-9eb7120edbe7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:03.090760 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d74317a6-f71a-4efc-9213-9eb7120edbe7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:03.091194 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d74317a6-f71a-4efc-9213-9eb7120edbe7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:03.091643 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d74317a6-f71a-4efc-9213-9eb7120edbe7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:03.094314 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d74317a6-f71a-4efc-9213-9eb7120edbe7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:03.095189 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d74317a6-f71a-4efc-9213-9eb7120edbe7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:03.095916 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d74317a6-f71a-4efc-9213-9eb7120edbe7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:03.109995 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fa3df974-ceb1-4421-8e15-fd48d099aea6 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "POST /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6/action" status: 202 len: 0 microversion: 2.1 time: 0.829318 Oct 23 01:25:03.111222 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1858/3692] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:25:02 2022] POST /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6/action => generated 0 bytes in 831 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 23 01:25:03.119185 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f729762c-b952-49a2-b654-42c4a78369e8 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:03.120246 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f729762c-b952-49a2-b654-42c4a78369e8 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] [instance: 623b5796-affa-4692-a43d-7bbb95ce8270] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:03.145585 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f729762c-b952-49a2-b654-42c4a78369e8 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:03.148930 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f729762c-b952-49a2-b654-42c4a78369e8 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:03.149658 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f729762c-b952-49a2-b654-42c4a78369e8 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:03.150667 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f729762c-b952-49a2-b654-42c4a78369e8 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:03.152350 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f729762c-b952-49a2-b654-42c4a78369e8 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:03.154031 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f729762c-b952-49a2-b654-42c4a78369e8 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:03.193855 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f729762c-b952-49a2-b654-42c4a78369e8 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] [instance: 623b5796-affa-4692-a43d-7bbb95ce8270] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:25:03.363728 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d74317a6-f71a-4efc-9213-9eb7120edbe7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60276a4031ee45ffa651b5467a62a81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a369d45e4804ffca2e89cb72f447a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:03.373945 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d74317a6-f71a-4efc-9213-9eb7120edbe7 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "GET /compute/v2.1/servers/c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd" status: 200 len: 1514 microversion: 2.1 time: 0.307384 Oct 23 01:25:03.375132 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1835/3693] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:03 2022] GET /compute/v2.1/servers/c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd => generated 1514 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:25:03.380620 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-87280eac-09d0-4c2a-b70c-6608bbfe2675 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '.version_select at 0x7f5cc1f0f1f0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:03.546684 n-d-master-1 devstack@n-api.service[120945]: DEBUG neutronclient.v2_0.client [None req-87280eac-09d0-4c2a-b70c-6608bbfe2675 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 702a07e0-48c3-4e56-a03d-0233890d4617 in use.", "detail": ""}} {{(pid=120945) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 23 01:25:03.548458 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-87280eac-09d0-4c2a-b70c-6608bbfe2675 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] HTTP exception thrown: Security Group 702a07e0-48c3-4e56-a03d-0233890d4617 in use. Oct 23 01:25:03.548458 n-d-master-1 devstack@n-api.service[120945]: Neutron server returns request_ids: ['req-cca834b5-49b4-443d-a64d-bc396ffc52c6'] Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-87280eac-09d0-4c2a-b70c-6608bbfe2675 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Request method failure captured: Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/os-security-groups/702a07e0-48c3-4e56-a03d-0233890d4617 HTTP/1.1 Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJe3mET0Sd7lZbPfIN3VkjmqiroRssL9JbOguxpn1sZ00E3M8viQBbgfQ2g7IyamsO6Vg1eRk3unJQGVa1SLVceO_jtTkwsvZ7R_UZpRIovLO2xYyroaQHuRt-8XjOXN_zV_7Obxi_ZE4mM221EAm7ZWkONLhuVRvJ2vR8Bciy4qSyo Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 8d9f6afbdbf74318a98dfe455a72ac7c Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-SecurityGroupsTestJSON-215153901 Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8d9f6afbdbf74318a98dfe455a72ac7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8d9f6afbdbf74318a98dfe455a72ac7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8d9f6afbdbf74318a98dfe455a72ac7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8d9f6afbdbf74318a98dfe455a72ac7c"}]}] Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-SecurityGroupsTestJSON-215153901 Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 8d9f6afbdbf74318a98dfe455a72ac7c Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-215153901 Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-SecurityGroupsTestJSON-215153901-project Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 2b8a867611614ea585d510d62c63cfa3 Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-SecurityGroupsTestJSON-215153901-project Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: method: Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: exception: Security Group 702a07e0-48c3-4e56-a03d-0233890d4617 in use. Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: Neutron server returns request_ids: ['req-cca834b5-49b4-443d-a64d-bc396ffc52c6'] Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '702a07e0-48c3-4e56-a03d-0233890d4617'} Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 23 01:25:03.551354 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 702a07e0-48c3-4e56-a03d-0233890d4617 in use. Oct 23 01:25:03.562192 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cca834b5-49b4-443d-a64d-bc396ffc52c6'] Oct 23 01:25:03.562192 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:25:03.562192 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:25:03.562192 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:25:03.562192 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:03.562192 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 23 01:25:03.562192 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 23 01:25:03.562192 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 23 01:25:03.562192 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 23 01:25:03.562192 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 702a07e0-48c3-4e56-a03d-0233890d4617 in use. Oct 23 01:25:03.562192 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cca834b5-49b4-443d-a64d-bc396ffc52c6'] Oct 23 01:25:03.562192 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:25:03.562192 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:25:03.562192 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:25:03.562192 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:03.562192 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:25:03.562192 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:25:03.562192 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:25:03.562192 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:25:03.562192 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:25:03.562192 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:25:03.562192 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:25:03.562192 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:25:03.562192 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 23 01:25:03.562192 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 23 01:25:03.562192 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 702a07e0-48c3-4e56-a03d-0233890d4617 in use. Oct 23 01:25:03.562192 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cca834b5-49b4-443d-a64d-bc396ffc52c6'] Oct 23 01:25:03.562192 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:25:03.562192 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:25:03.562192 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:25:03.562192 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:03.562192 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:25:03.562192 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:25:03.562192 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:25:03.562192 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:25:03.562192 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 702a07e0-48c3-4e56-a03d-0233890d4617 in use. Oct 23 01:25:03.562192 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cca834b5-49b4-443d-a64d-bc396ffc52c6'] Oct 23 01:25:03.562192 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:25:03.562192 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-87280eac-09d0-4c2a-b70c-6608bbfe2675 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Returning 400 to user: Security Group 702a07e0-48c3-4e56-a03d-0233890d4617 in use. Oct 23 01:25:03.562192 n-d-master-1 devstack@n-api.service[120945]: Neutron server returns request_ids: ['req-cca834b5-49b4-443d-a64d-bc396ffc52c6'] {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:25:03.562192 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-87280eac-09d0-4c2a-b70c-6608bbfe2675 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/702a07e0-48c3-4e56-a03d-0233890d4617" status: 400 len: 185 microversion: 2.1 time: 0.176769 Oct 23 01:25:03.562192 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1836/3694] 10.222.0.42 () {58 vars in 1272 bytes} [Sun Oct 23 01:25:03 2022] DELETE /compute/v2.1/os-security-groups/702a07e0-48c3-4e56-a03d-0233890d4617 => generated 185 bytes in 179 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:25:03.562192 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-c1d6bca9-699e-40a3-a7dd-ef80d2ae07b0 req-d6b3cf75-6bac-4abd-bf4e-02d1d4b46a64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa768b59-9807-4365-a405-b6e688b1e0f6", "tag": "66f1253e-27b9-42ba-b3ee-ef4ed5990380"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:25:03.575888 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-c1d6bca9-699e-40a3-a7dd-ef80d2ae07b0 req-d6b3cf75-6bac-4abd-bf4e-02d1d4b46a64 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:03.575888 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-c1d6bca9-699e-40a3-a7dd-ef80d2ae07b0 req-d6b3cf75-6bac-4abd-bf4e-02d1d4b46a64 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:03.575888 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-c1d6bca9-699e-40a3-a7dd-ef80d2ae07b0 req-d6b3cf75-6bac-4abd-bf4e-02d1d4b46a64 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:03.589305 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-c1d6bca9-699e-40a3-a7dd-ef80d2ae07b0 req-d6b3cf75-6bac-4abd-bf4e-02d1d4b46a64 service nova] Creating event network-changed:66f1253e-27b9-42ba-b3ee-ef4ed5990380 for instance aa768b59-9807-4365-a405-b6e688b1e0f6 on n-h1-master-1 Oct 23 01:25:03.596355 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-c1d6bca9-699e-40a3-a7dd-ef80d2ae07b0 req-d6b3cf75-6bac-4abd-bf4e-02d1d4b46a64 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040868 Oct 23 01:25:03.600367 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1837/3695] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:25:03.606582 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c86d3945-9b64-4ab6-8e20-aef90b1b0800 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:03.607180 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c86d3945-9b64-4ab6-8e20-aef90b1b0800 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] [instance: aa768b59-9807-4365-a405-b6e688b1e0f6] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:03.615117 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c86d3945-9b64-4ab6-8e20-aef90b1b0800 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:03.615942 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c86d3945-9b64-4ab6-8e20-aef90b1b0800 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:03.616582 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c86d3945-9b64-4ab6-8e20-aef90b1b0800 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:03.623539 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f729762c-b952-49a2-b654-42c4a78369e8 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] 10.222.0.42 "DELETE /compute/v2.1/servers/623b5796-affa-4692-a43d-7bbb95ce8270" status: 204 len: 0 microversion: 2.1 time: 0.504621 Oct 23 01:25:03.623539 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1859/3696] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:25:03 2022] DELETE /compute/v2.1/servers/623b5796-affa-4692-a43d-7bbb95ce8270 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:25:03.625075 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c86d3945-9b64-4ab6-8e20-aef90b1b0800 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:03.626003 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c86d3945-9b64-4ab6-8e20-aef90b1b0800 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:03.626767 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c86d3945-9b64-4ab6-8e20-aef90b1b0800 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:03.632266 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-995918b0-5850-4f2f-a6aa-da60bea694e2 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:03.633022 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-995918b0-5850-4f2f-a6aa-da60bea694e2 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] [instance: 623b5796-affa-4692-a43d-7bbb95ce8270] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:03.652190 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-995918b0-5850-4f2f-a6aa-da60bea694e2 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:03.652701 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-995918b0-5850-4f2f-a6aa-da60bea694e2 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:03.656380 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-995918b0-5850-4f2f-a6aa-da60bea694e2 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:03.657158 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-995918b0-5850-4f2f-a6aa-da60bea694e2 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:03.657638 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-995918b0-5850-4f2f-a6aa-da60bea694e2 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:03.661163 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-995918b0-5850-4f2f-a6aa-da60bea694e2 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:03.673591 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c86d3945-9b64-4ab6-8e20-aef90b1b0800 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] [instance: aa768b59-9807-4365-a405-b6e688b1e0f6] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:25:03.880863 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-995918b0-5850-4f2f-a6aa-da60bea694e2 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4024e1a8f515435f86d3d36d59262813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316cbb6f558c4bc8b34050cc1b8ea134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:03.890283 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-995918b0-5850-4f2f-a6aa-da60bea694e2 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] 10.222.0.42 "GET /compute/v2.1/servers/623b5796-affa-4692-a43d-7bbb95ce8270" status: 200 len: 1509 microversion: 2.1 time: 0.265064 Oct 23 01:25:03.891887 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1860/3697] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:03 2022] GET /compute/v2.1/servers/623b5796-affa-4692-a43d-7bbb95ce8270 => generated 1509 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:25:04.048873 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c86d3945-9b64-4ab6-8e20-aef90b1b0800 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "DELETE /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6" status: 204 len: 0 microversion: 2.1 time: 0.446807 Oct 23 01:25:04.051215 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1838/3698] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:25:03 2022] DELETE /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:25:04.059900 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-55d360f9-1eb6-4820-aa34-f9f23f7c5ad8 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:04.060517 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-55d360f9-1eb6-4820-aa34-f9f23f7c5ad8 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] [instance: aa768b59-9807-4365-a405-b6e688b1e0f6] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:04.067931 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55d360f9-1eb6-4820-aa34-f9f23f7c5ad8 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:04.068351 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55d360f9-1eb6-4820-aa34-f9f23f7c5ad8 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:04.070519 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55d360f9-1eb6-4820-aa34-f9f23f7c5ad8 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:04.070519 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55d360f9-1eb6-4820-aa34-f9f23f7c5ad8 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:04.070519 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55d360f9-1eb6-4820-aa34-f9f23f7c5ad8 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:04.070519 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55d360f9-1eb6-4820-aa34-f9f23f7c5ad8 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:04.074539 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:04.244258 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-55d360f9-1eb6-4820-aa34-f9f23f7c5ad8 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8a867611614ea585d510d62c63cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9f6afbdbf74318a98dfe455a72ac7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:04.253321 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-55d360f9-1eb6-4820-aa34-f9f23f7c5ad8 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "GET /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6" status: 200 len: 1647 microversion: 2.1 time: 0.197191 Oct 23 01:25:04.254031 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1861/3699] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:04 2022] GET /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6 => generated 1647 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:25:04.404911 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-28f0e473-9926-4645-8059-79d4d88308e2 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:04.405565 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-28f0e473-9926-4645-8059-79d4d88308e2 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:04.412830 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-28f0e473-9926-4645-8059-79d4d88308e2 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:04.413325 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-28f0e473-9926-4645-8059-79d4d88308e2 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:04.413756 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-28f0e473-9926-4645-8059-79d4d88308e2 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:04.414658 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-28f0e473-9926-4645-8059-79d4d88308e2 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:04.415120 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-28f0e473-9926-4645-8059-79d4d88308e2 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:04.415542 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-28f0e473-9926-4645-8059-79d4d88308e2 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:04.564241 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-28f0e473-9926-4645-8059-79d4d88308e2 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60276a4031ee45ffa651b5467a62a81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a369d45e4804ffca2e89cb72f447a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:04.572965 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-28f0e473-9926-4645-8059-79d4d88308e2 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "GET /compute/v2.1/servers/c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd" status: 200 len: 1514 microversion: 2.1 time: 0.173337 Oct 23 01:25:04.573550 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1839/3700] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:04 2022] GET /compute/v2.1/servers/c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:25:04.915941 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e7155018-2f27-43b4-8d89-c9c1b018754a tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:04.916577 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e7155018-2f27-43b4-8d89-c9c1b018754a tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] [instance: 623b5796-affa-4692-a43d-7bbb95ce8270] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:04.923050 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e7155018-2f27-43b4-8d89-c9c1b018754a tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:04.923535 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e7155018-2f27-43b4-8d89-c9c1b018754a tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:04.923968 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e7155018-2f27-43b4-8d89-c9c1b018754a tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:04.924653 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e7155018-2f27-43b4-8d89-c9c1b018754a tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:04.925757 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e7155018-2f27-43b4-8d89-c9c1b018754a tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:04.926265 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e7155018-2f27-43b4-8d89-c9c1b018754a tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:05.069566 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e7155018-2f27-43b4-8d89-c9c1b018754a tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4024e1a8f515435f86d3d36d59262813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316cbb6f558c4bc8b34050cc1b8ea134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:05.077595 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e7155018-2f27-43b4-8d89-c9c1b018754a tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] 10.222.0.42 "GET /compute/v2.1/servers/623b5796-affa-4692-a43d-7bbb95ce8270" status: 200 len: 1509 microversion: 2.1 time: 0.165933 Oct 23 01:25:05.078423 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1862/3701] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:04 2022] GET /compute/v2.1/servers/623b5796-affa-4692-a43d-7bbb95ce8270 => generated 1509 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:25:05.276941 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7a36b13f-9636-4cef-9273-9264b61a06a0 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:05.277644 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7a36b13f-9636-4cef-9273-9264b61a06a0 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] [instance: aa768b59-9807-4365-a405-b6e688b1e0f6] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:05.284154 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a36b13f-9636-4cef-9273-9264b61a06a0 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:05.285581 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a36b13f-9636-4cef-9273-9264b61a06a0 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:05.286114 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a36b13f-9636-4cef-9273-9264b61a06a0 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:05.286878 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a36b13f-9636-4cef-9273-9264b61a06a0 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:05.287399 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a36b13f-9636-4cef-9273-9264b61a06a0 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:05.287887 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a36b13f-9636-4cef-9273-9264b61a06a0 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:05.504085 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7a36b13f-9636-4cef-9273-9264b61a06a0 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8a867611614ea585d510d62c63cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9f6afbdbf74318a98dfe455a72ac7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:05.512867 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7a36b13f-9636-4cef-9273-9264b61a06a0 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "GET /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6" status: 200 len: 1647 microversion: 2.1 time: 0.239820 Oct 23 01:25:05.513755 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1840/3702] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:05 2022] GET /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6 => generated 1647 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:25:05.596942 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-660aef38-7f10-45d3-a90b-b21ec66a3e87 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:05.597548 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-660aef38-7f10-45d3-a90b-b21ec66a3e87 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:05.603960 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-660aef38-7f10-45d3-a90b-b21ec66a3e87 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:05.604445 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-660aef38-7f10-45d3-a90b-b21ec66a3e87 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:05.604891 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-660aef38-7f10-45d3-a90b-b21ec66a3e87 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:05.605592 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-660aef38-7f10-45d3-a90b-b21ec66a3e87 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:05.606068 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-660aef38-7f10-45d3-a90b-b21ec66a3e87 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:05.606494 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-660aef38-7f10-45d3-a90b-b21ec66a3e87 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:05.755423 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-660aef38-7f10-45d3-a90b-b21ec66a3e87 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60276a4031ee45ffa651b5467a62a81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a369d45e4804ffca2e89cb72f447a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:05.763780 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-660aef38-7f10-45d3-a90b-b21ec66a3e87 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "GET /compute/v2.1/servers/c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd" status: 200 len: 1514 microversion: 2.1 time: 0.171028 Oct 23 01:25:05.764927 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1863/3703] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:05 2022] GET /compute/v2.1/servers/c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd => generated 1514 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:25:06.102351 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b3a3cad8-81cf-4aa9-b05b-7c8a8e627ecf tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:06.103877 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b3a3cad8-81cf-4aa9-b05b-7c8a8e627ecf tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] [instance: 623b5796-affa-4692-a43d-7bbb95ce8270] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:06.122960 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b3a3cad8-81cf-4aa9-b05b-7c8a8e627ecf tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:06.124040 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b3a3cad8-81cf-4aa9-b05b-7c8a8e627ecf tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:06.124520 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b3a3cad8-81cf-4aa9-b05b-7c8a8e627ecf tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:06.125284 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b3a3cad8-81cf-4aa9-b05b-7c8a8e627ecf tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:06.126152 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b3a3cad8-81cf-4aa9-b05b-7c8a8e627ecf tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:06.126862 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b3a3cad8-81cf-4aa9-b05b-7c8a8e627ecf tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:06.540537 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8250b916-beaf-41f7-af5e-4c1899065c29 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:06.541341 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8250b916-beaf-41f7-af5e-4c1899065c29 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] [instance: aa768b59-9807-4365-a405-b6e688b1e0f6] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:06.556925 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8250b916-beaf-41f7-af5e-4c1899065c29 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:06.557568 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8250b916-beaf-41f7-af5e-4c1899065c29 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:06.560185 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8250b916-beaf-41f7-af5e-4c1899065c29 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:06.561115 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8250b916-beaf-41f7-af5e-4c1899065c29 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:06.571026 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8250b916-beaf-41f7-af5e-4c1899065c29 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:06.571654 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8250b916-beaf-41f7-af5e-4c1899065c29 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:06.805757 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b3a3cad8-81cf-4aa9-b05b-7c8a8e627ecf tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4024e1a8f515435f86d3d36d59262813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316cbb6f558c4bc8b34050cc1b8ea134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:06.821916 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b3a3cad8-81cf-4aa9-b05b-7c8a8e627ecf tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] 10.222.0.42 "GET /compute/v2.1/servers/623b5796-affa-4692-a43d-7bbb95ce8270" status: 200 len: 1509 microversion: 2.1 time: 0.724573 Oct 23 01:25:06.823134 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1841/3704] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:06 2022] GET /compute/v2.1/servers/623b5796-affa-4692-a43d-7bbb95ce8270 => generated 1509 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:25:06.843912 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-be1e8e97-931d-4d4b-b1d6-ccdbd1bf7fc9 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:06.844789 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-be1e8e97-931d-4d4b-b1d6-ccdbd1bf7fc9 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:06.853769 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8250b916-beaf-41f7-af5e-4c1899065c29 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8a867611614ea585d510d62c63cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9f6afbdbf74318a98dfe455a72ac7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:06.865615 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8250b916-beaf-41f7-af5e-4c1899065c29 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "GET /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6" status: 200 len: 1468 microversion: 2.1 time: 0.332033 Oct 23 01:25:06.873839 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-be1e8e97-931d-4d4b-b1d6-ccdbd1bf7fc9 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:06.874304 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1864/3705] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:06 2022] GET /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6 => generated 1468 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:25:06.889487 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-562137da-2722-461f-935c-2b3e7811b1f3 req-4a0eee02-5ce1-4c41-ae50-09cc91c2860b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa768b59-9807-4365-a405-b6e688b1e0f6", "name": "network-vif-deleted", "tag": "66f1253e-27b9-42ba-b3ee-ef4ed5990380"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:25:06.889672 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-be1e8e97-931d-4d4b-b1d6-ccdbd1bf7fc9 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:06.889672 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-be1e8e97-931d-4d4b-b1d6-ccdbd1bf7fc9 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:06.889672 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-be1e8e97-931d-4d4b-b1d6-ccdbd1bf7fc9 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:06.889672 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-be1e8e97-931d-4d4b-b1d6-ccdbd1bf7fc9 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:06.889672 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-be1e8e97-931d-4d4b-b1d6-ccdbd1bf7fc9 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:06.909795 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-562137da-2722-461f-935c-2b3e7811b1f3 req-4a0eee02-5ce1-4c41-ae50-09cc91c2860b service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:06.918504 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-562137da-2722-461f-935c-2b3e7811b1f3 req-4a0eee02-5ce1-4c41-ae50-09cc91c2860b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:06.918504 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-562137da-2722-461f-935c-2b3e7811b1f3 req-4a0eee02-5ce1-4c41-ae50-09cc91c2860b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:06.934678 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-562137da-2722-461f-935c-2b3e7811b1f3 req-4a0eee02-5ce1-4c41-ae50-09cc91c2860b service nova] Creating event network-vif-deleted:66f1253e-27b9-42ba-b3ee-ef4ed5990380 for instance aa768b59-9807-4365-a405-b6e688b1e0f6 on n-h1-master-1 Oct 23 01:25:06.951870 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-562137da-2722-461f-935c-2b3e7811b1f3 req-4a0eee02-5ce1-4c41-ae50-09cc91c2860b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075602 Oct 23 01:25:06.953001 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1865/3706] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:25:07.109199 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-be1e8e97-931d-4d4b-b1d6-ccdbd1bf7fc9 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60276a4031ee45ffa651b5467a62a81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a369d45e4804ffca2e89cb72f447a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:07.118392 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-be1e8e97-931d-4d4b-b1d6-ccdbd1bf7fc9 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "GET /compute/v2.1/servers/c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd" status: 200 len: 1514 microversion: 2.1 time: 0.290334 Oct 23 01:25:07.119280 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1842/3707] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:06 2022] GET /compute/v2.1/servers/c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd => generated 1514 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:25:07.567289 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-97b39c66-509d-46e4-9990-124d25378750 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:07.568129 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-97b39c66-509d-46e4-9990-124d25378750 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] [instance: e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:07.585337 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-97b39c66-509d-46e4-9990-124d25378750 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:07.585686 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-97b39c66-509d-46e4-9990-124d25378750 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:07.586216 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-97b39c66-509d-46e4-9990-124d25378750 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:07.589672 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-97b39c66-509d-46e4-9990-124d25378750 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:07.590205 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-97b39c66-509d-46e4-9990-124d25378750 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:07.590651 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-97b39c66-509d-46e4-9990-124d25378750 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:07.607561 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-97b39c66-509d-46e4-9990-124d25378750 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] HTTP exception thrown: Instance e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c could not be found. Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-97b39c66-509d-46e4-9990-124d25378750 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Request method failure captured: Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c HTTP/1.1 Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJdEGmClPp4UD2PaOyKqqXvx0fGsewCdu0LYVmEf4ary7O6uTR2MxL9PoeI4bFS-lXr_RgZeBaG4-2L1CY7--u8E_pS-lzvXkVNnthe_io1YBUzagOpHfRm5_sEjuJgHwMml6ZljusEfcn8MvU3ALJY61Ab2OqnO5U344SLBpBRgZj4 Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 8525dcc00e844959a1527424291a3149 Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-394550811 Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8525dcc00e844959a1527424291a3149"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8525dcc00e844959a1527424291a3149"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8525dcc00e844959a1527424291a3149"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8525dcc00e844959a1527424291a3149"}]}] Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-394550811 Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 8525dcc00e844959a1527424291a3149 Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-394550811 Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-AttachSCSIVolumeTestJSON-394550811-project Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 0501ceda4e8140e09fb4e94552487cc3 Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-394550811-project Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: exception: Instance e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c could not be found. Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c'} Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c could not be found. Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:25:07.610409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:25:07.615788 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c could not be found. Oct 23 01:25:07.615788 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:07.615788 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:25:07.615788 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:07.615788 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:07.615788 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:25:07.615788 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:25:07.615788 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:25:07.615788 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:25:07.615788 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c could not be found. Oct 23 01:25:07.615788 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:07.624007 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-97b39c66-509d-46e4-9990-124d25378750 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Returning 404 to user: Instance e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:25:07.625886 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-97b39c66-509d-46e4-9990-124d25378750 tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c" status: 404 len: 111 microversion: 2.1 time: 0.064327 Oct 23 01:25:07.627229 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1866/3708] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:25:07 2022] DELETE /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:25:07.637319 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3ffb69b6-cdec-483c-b79c-22d7c2d418ab tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:07.639127 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3ffb69b6-cdec-483c-b79c-22d7c2d418ab tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] [instance: e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:07.656549 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3ffb69b6-cdec-483c-b79c-22d7c2d418ab tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:07.660358 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3ffb69b6-cdec-483c-b79c-22d7c2d418ab tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:07.660974 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3ffb69b6-cdec-483c-b79c-22d7c2d418ab tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:07.663289 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3ffb69b6-cdec-483c-b79c-22d7c2d418ab tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:07.666563 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3ffb69b6-cdec-483c-b79c-22d7c2d418ab tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:07.667144 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3ffb69b6-cdec-483c-b79c-22d7c2d418ab tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:07.697926 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-3ffb69b6-cdec-483c-b79c-22d7c2d418ab tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] HTTP exception thrown: Instance e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c could not be found. Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3ffb69b6-cdec-483c-b79c-22d7c2d418ab tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Request method failure captured: Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c HTTP/1.1 Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJdEGmClPp4UD2PaOyKqqXvx0fGsewCdu0LYVmEf4ary7O6uTR2MxL9PoeI4bFS-lXr_RgZeBaG4-2L1CY7--u8E_pS-lzvXkVNnthe_io1YBUzagOpHfRm5_sEjuJgHwMml6ZljusEfcn8MvU3ALJY61Ab2OqnO5U344SLBpBRgZj4 Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 8525dcc00e844959a1527424291a3149 Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-394550811 Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8525dcc00e844959a1527424291a3149"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8525dcc00e844959a1527424291a3149"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8525dcc00e844959a1527424291a3149"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8525dcc00e844959a1527424291a3149"}]}] Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-394550811 Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 8525dcc00e844959a1527424291a3149 Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-394550811 Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-AttachSCSIVolumeTestJSON-394550811-project Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 0501ceda4e8140e09fb4e94552487cc3 Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-394550811-project Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: exception: Instance e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c could not be found. Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c'} Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c could not be found. Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c could not be found. Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:25:07.699813 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:25:07.704666 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:07.704666 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:25:07.704666 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:25:07.704666 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:25:07.704666 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:25:07.704666 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c could not be found. Oct 23 01:25:07.704666 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:25:07.704666 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3ffb69b6-cdec-483c-b79c-22d7c2d418ab tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] Returning 404 to user: Instance e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:25:07.706709 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3ffb69b6-cdec-483c-b79c-22d7c2d418ab tempest-AttachSCSIVolumeTestJSON-394550811 tempest-AttachSCSIVolumeTestJSON-394550811-project] 10.222.0.42 "GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c" status: 404 len: 111 microversion: 2.1 time: 0.073769 Oct 23 01:25:07.709269 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1843/3709] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:07 2022] GET /compute/v2.1/servers/e0b2d8e3-1b8b-4263-9e8a-2780efa34e1c => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:25:07.848667 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9984a4da-b5a1-406b-912e-ed6f6bf1f1fd tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:07.851643 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9984a4da-b5a1-406b-912e-ed6f6bf1f1fd tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] [instance: 623b5796-affa-4692-a43d-7bbb95ce8270] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:07.874152 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9984a4da-b5a1-406b-912e-ed6f6bf1f1fd tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:07.875505 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9984a4da-b5a1-406b-912e-ed6f6bf1f1fd tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:07.877109 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9984a4da-b5a1-406b-912e-ed6f6bf1f1fd tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:07.881744 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9984a4da-b5a1-406b-912e-ed6f6bf1f1fd tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:07.883998 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9984a4da-b5a1-406b-912e-ed6f6bf1f1fd tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:07.886010 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9984a4da-b5a1-406b-912e-ed6f6bf1f1fd tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:07.902601 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-32a5e18c-bd7f-42bd-8539-9fb2fa6e3326 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:07.908419 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-32a5e18c-bd7f-42bd-8539-9fb2fa6e3326 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] [instance: aa768b59-9807-4365-a405-b6e688b1e0f6] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:07.915615 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-32a5e18c-bd7f-42bd-8539-9fb2fa6e3326 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:07.916213 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-32a5e18c-bd7f-42bd-8539-9fb2fa6e3326 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:07.916737 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-32a5e18c-bd7f-42bd-8539-9fb2fa6e3326 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:07.917550 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-32a5e18c-bd7f-42bd-8539-9fb2fa6e3326 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:07.918133 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-32a5e18c-bd7f-42bd-8539-9fb2fa6e3326 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:07.918639 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-32a5e18c-bd7f-42bd-8539-9fb2fa6e3326 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:07.972438 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-32a5e18c-bd7f-42bd-8539-9fb2fa6e3326 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:07.973160 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-32a5e18c-bd7f-42bd-8539-9fb2fa6e3326 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:07.973748 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-32a5e18c-bd7f-42bd-8539-9fb2fa6e3326 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:07.974399 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-32a5e18c-bd7f-42bd-8539-9fb2fa6e3326 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lazy-loading 'fault' on Instance uuid aa768b59-9807-4365-a405-b6e688b1e0f6 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:25:08.070772 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-32a5e18c-bd7f-42bd-8539-9fb2fa6e3326 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8a867611614ea585d510d62c63cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9f6afbdbf74318a98dfe455a72ac7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:08.078463 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9984a4da-b5a1-406b-912e-ed6f6bf1f1fd tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4024e1a8f515435f86d3d36d59262813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316cbb6f558c4bc8b34050cc1b8ea134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:08.086474 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-32a5e18c-bd7f-42bd-8539-9fb2fa6e3326 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "GET /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6" status: 200 len: 1306 microversion: 2.1 time: 0.187217 Oct 23 01:25:08.092836 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9984a4da-b5a1-406b-912e-ed6f6bf1f1fd tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] 10.222.0.42 "GET /compute/v2.1/servers/623b5796-affa-4692-a43d-7bbb95ce8270" status: 200 len: 1301 microversion: 2.1 time: 0.249035 Oct 23 01:25:08.093903 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1867/3710] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:07 2022] GET /compute/v2.1/servers/623b5796-affa-4692-a43d-7bbb95ce8270 => generated 1301 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:25:08.108455 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1844/3711] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:07 2022] GET /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6 => generated 1306 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:25:08.144089 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a0d7f7d0-9a68-41f7-b517-df8195fdfa21 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:08.145089 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a0d7f7d0-9a68-41f7-b517-df8195fdfa21 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:08.153664 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a0d7f7d0-9a68-41f7-b517-df8195fdfa21 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:08.154249 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a0d7f7d0-9a68-41f7-b517-df8195fdfa21 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:08.154693 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a0d7f7d0-9a68-41f7-b517-df8195fdfa21 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:08.155718 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a0d7f7d0-9a68-41f7-b517-df8195fdfa21 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:08.156185 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a0d7f7d0-9a68-41f7-b517-df8195fdfa21 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:08.156781 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a0d7f7d0-9a68-41f7-b517-df8195fdfa21 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:08.322762 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a0d7f7d0-9a68-41f7-b517-df8195fdfa21 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60276a4031ee45ffa651b5467a62a81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a369d45e4804ffca2e89cb72f447a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:08.338028 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a0d7f7d0-9a68-41f7-b517-df8195fdfa21 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "GET /compute/v2.1/servers/c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd" status: 200 len: 1303 microversion: 2.1 time: 0.196720 Oct 23 01:25:08.338028 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1845/3712] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:08 2022] GET /compute/v2.1/servers/c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd => generated 1303 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:25:08.995517 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-e62dece5-0b18-4330-a1e3-e46d8fd1b6c5 req-70c34538-e012-45ff-8369-78e9298dc222 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "623b5796-affa-4692-a43d-7bbb95ce8270", "name": "network-vif-deleted", "tag": "f86d5c82-c234-49b7-9637-45d8048180ab"}, {"server_uuid": "c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd", "name": "network-vif-deleted", "tag": "b2c35d7d-5dbd-491a-b4d5-140000b3abd3"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:25:09.023992 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-e62dece5-0b18-4330-a1e3-e46d8fd1b6c5 req-70c34538-e012-45ff-8369-78e9298dc222 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:09.024553 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-e62dece5-0b18-4330-a1e3-e46d8fd1b6c5 req-70c34538-e012-45ff-8369-78e9298dc222 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:09.025027 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-e62dece5-0b18-4330-a1e3-e46d8fd1b6c5 req-70c34538-e012-45ff-8369-78e9298dc222 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:09.040981 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-e62dece5-0b18-4330-a1e3-e46d8fd1b6c5 req-70c34538-e012-45ff-8369-78e9298dc222 service nova] Creating event network-vif-deleted:f86d5c82-c234-49b7-9637-45d8048180ab for instance 623b5796-affa-4692-a43d-7bbb95ce8270 on n-h2-master-1 Oct 23 01:25:09.043335 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-e62dece5-0b18-4330-a1e3-e46d8fd1b6c5 req-70c34538-e012-45ff-8369-78e9298dc222 service nova] Creating event network-vif-deleted:b2c35d7d-5dbd-491a-b4d5-140000b3abd3 for instance c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd on n-h2-master-1 Oct 23 01:25:09.054361 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-e62dece5-0b18-4330-a1e3-e46d8fd1b6c5 req-70c34538-e012-45ff-8369-78e9298dc222 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.073685 Oct 23 01:25:09.062287 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1868/3713] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:25:09.123846 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-984558ae-4426-42c4-955d-94202b43f5fb tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:09.130369 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-984558ae-4426-42c4-955d-94202b43f5fb tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] [instance: aa768b59-9807-4365-a405-b6e688b1e0f6] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:09.138454 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bf1edd86-47a9-4b8c-83c0-28dbaf6e6e5f tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:09.139437 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bf1edd86-47a9-4b8c-83c0-28dbaf6e6e5f tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] [instance: 623b5796-affa-4692-a43d-7bbb95ce8270] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:09.149178 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-984558ae-4426-42c4-955d-94202b43f5fb tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:09.153673 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-984558ae-4426-42c4-955d-94202b43f5fb tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:09.155458 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-984558ae-4426-42c4-955d-94202b43f5fb tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:09.158533 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-984558ae-4426-42c4-955d-94202b43f5fb tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:09.159717 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-984558ae-4426-42c4-955d-94202b43f5fb tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:09.159985 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf1edd86-47a9-4b8c-83c0-28dbaf6e6e5f tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:09.160166 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-984558ae-4426-42c4-955d-94202b43f5fb tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:09.160841 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf1edd86-47a9-4b8c-83c0-28dbaf6e6e5f tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:09.163361 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf1edd86-47a9-4b8c-83c0-28dbaf6e6e5f tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:09.164407 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf1edd86-47a9-4b8c-83c0-28dbaf6e6e5f tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:09.166099 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf1edd86-47a9-4b8c-83c0-28dbaf6e6e5f tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:09.167628 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf1edd86-47a9-4b8c-83c0-28dbaf6e6e5f tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:09.197488 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-984558ae-4426-42c4-955d-94202b43f5fb tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] HTTP exception thrown: Instance aa768b59-9807-4365-a405-b6e688b1e0f6 could not be found. Oct 23 01:25:09.203932 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf1edd86-47a9-4b8c-83c0-28dbaf6e6e5f tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-984558ae-4426-42c4-955d-94202b43f5fb tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Request method failure captured: Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6 HTTP/1.1 Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJe3mET0Sd7lZbPfIN3VkjmqiroRssL9JbOguxpn1sZ00E3M8viQBbgfQ2g7IyamsO6Vg1eRk3unJQGVa1SLVceO_jtTkwsvZ7R_UZpRIovLO2xYyroaQHuRt-8XjOXN_zV_7Obxi_ZE4mM221EAm7ZWkONLhuVRvJ2vR8Bciy4qSyo Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 8d9f6afbdbf74318a98dfe455a72ac7c Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-SecurityGroupsTestJSON-215153901 Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8d9f6afbdbf74318a98dfe455a72ac7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8d9f6afbdbf74318a98dfe455a72ac7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8d9f6afbdbf74318a98dfe455a72ac7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8d9f6afbdbf74318a98dfe455a72ac7c"}]}] Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-SecurityGroupsTestJSON-215153901 Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 8d9f6afbdbf74318a98dfe455a72ac7c Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-215153901 Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-SecurityGroupsTestJSON-215153901-project Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 2b8a867611614ea585d510d62c63cfa3 Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-SecurityGroupsTestJSON-215153901-project Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: exception: Instance aa768b59-9807-4365-a405-b6e688b1e0f6 could not be found. Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'aa768b59-9807-4365-a405-b6e688b1e0f6'} Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa768b59-9807-4365-a405-b6e688b1e0f6 could not be found. Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa768b59-9807-4365-a405-b6e688b1e0f6 could not be found. Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:25:09.204867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:25:09.214221 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:09.214221 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:25:09.214221 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:25:09.214221 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:25:09.214221 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:25:09.214221 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa768b59-9807-4365-a405-b6e688b1e0f6 could not be found. Oct 23 01:25:09.214221 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:25:09.214837 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf1edd86-47a9-4b8c-83c0-28dbaf6e6e5f tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:09.214925 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-984558ae-4426-42c4-955d-94202b43f5fb tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Returning 404 to user: Instance aa768b59-9807-4365-a405-b6e688b1e0f6 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:25:09.215014 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf1edd86-47a9-4b8c-83c0-28dbaf6e6e5f tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:09.215104 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-984558ae-4426-42c4-955d-94202b43f5fb tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "GET /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6" status: 404 len: 111 microversion: 2.1 time: 0.093048 Oct 23 01:25:09.215185 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-bf1edd86-47a9-4b8c-83c0-28dbaf6e6e5f tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lazy-loading 'fault' on Instance uuid 623b5796-affa-4692-a43d-7bbb95ce8270 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:25:09.215273 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1846/3714] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:09 2022] GET /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:25:09.216793 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-251aab86-3cc4-41e3-9211-08ac1397726a tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '.version_select at 0x7f5cc173fa60>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:09.342003 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bf1edd86-47a9-4b8c-83c0-28dbaf6e6e5f tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4024e1a8f515435f86d3d36d59262813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316cbb6f558c4bc8b34050cc1b8ea134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:09.355459 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bf1edd86-47a9-4b8c-83c0-28dbaf6e6e5f tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] 10.222.0.42 "GET /compute/v2.1/servers/623b5796-affa-4692-a43d-7bbb95ce8270" status: 200 len: 1306 microversion: 2.1 time: 0.229366 Oct 23 01:25:09.369675 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1869/3715] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:09 2022] GET /compute/v2.1/servers/623b5796-affa-4692-a43d-7bbb95ce8270 => generated 1306 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:25:09.369675 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-259200f3-bc12-4c6a-a17b-2c9e5cfd1444 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:09.369675 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-259200f3-bc12-4c6a-a17b-2c9e5cfd1444 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:09.372418 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-259200f3-bc12-4c6a-a17b-2c9e5cfd1444 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:09.373193 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-259200f3-bc12-4c6a-a17b-2c9e5cfd1444 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:09.373896 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-259200f3-bc12-4c6a-a17b-2c9e5cfd1444 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:09.374927 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-259200f3-bc12-4c6a-a17b-2c9e5cfd1444 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:09.375467 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-259200f3-bc12-4c6a-a17b-2c9e5cfd1444 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:09.376088 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-259200f3-bc12-4c6a-a17b-2c9e5cfd1444 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:09.416496 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-259200f3-bc12-4c6a-a17b-2c9e5cfd1444 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:09.417076 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-259200f3-bc12-4c6a-a17b-2c9e5cfd1444 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:09.417661 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-259200f3-bc12-4c6a-a17b-2c9e5cfd1444 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:09.418216 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-259200f3-bc12-4c6a-a17b-2c9e5cfd1444 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lazy-loading 'fault' on Instance uuid c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:25:09.495534 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-259200f3-bc12-4c6a-a17b-2c9e5cfd1444 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60276a4031ee45ffa651b5467a62a81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a369d45e4804ffca2e89cb72f447a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:09.506642 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-259200f3-bc12-4c6a-a17b-2c9e5cfd1444 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "GET /compute/v2.1/servers/c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd" status: 200 len: 1308 microversion: 2.1 time: 0.149209 Oct 23 01:25:09.510713 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1870/3716] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:09 2022] GET /compute/v2.1/servers/c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd => generated 1308 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:25:09.527576 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-00d30f59-5868-4b33-9949-26add0ea28c4 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:09.528550 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-00d30f59-5868-4b33-9949-26add0ea28c4 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:09.542930 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-00d30f59-5868-4b33-9949-26add0ea28c4 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:09.545961 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-00d30f59-5868-4b33-9949-26add0ea28c4 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:09.545961 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-00d30f59-5868-4b33-9949-26add0ea28c4 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:09.545961 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-00d30f59-5868-4b33-9949-26add0ea28c4 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:09.562044 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-00d30f59-5868-4b33-9949-26add0ea28c4 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:09.564365 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-00d30f59-5868-4b33-9949-26add0ea28c4 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:09.912338 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-00d30f59-5868-4b33-9949-26add0ea28c4 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:09.932697 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-00d30f59-5868-4b33-9949-26add0ea28c4 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:09.934210 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-00d30f59-5868-4b33-9949-26add0ea28c4 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:09.935469 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-00d30f59-5868-4b33-9949-26add0ea28c4 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 2954 microversion: 2.42 time: 0.423362 Oct 23 01:25:09.942494 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1871/3717] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:25:09 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 2954 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:25:09.979057 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-60cbb68f-a584-4663-8278-3903ee7f0f18 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:09.980026 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-60cbb68f-a584-4663-8278-3903ee7f0f18 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:09.987191 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-60cbb68f-a584-4663-8278-3903ee7f0f18 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:09.988580 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-60cbb68f-a584-4663-8278-3903ee7f0f18 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:09.989314 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-60cbb68f-a584-4663-8278-3903ee7f0f18 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:09.992736 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-60cbb68f-a584-4663-8278-3903ee7f0f18 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:09.992736 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-60cbb68f-a584-4663-8278-3903ee7f0f18 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:09.992736 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-60cbb68f-a584-4663-8278-3903ee7f0f18 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:10.064332 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-251aab86-3cc4-41e3-9211-08ac1397726a tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/e386a1ff-2e8c-4093-9300-e27bb7a458a6" status: 202 len: 0 microversion: 2.1 time: 0.851765 Oct 23 01:25:10.065200 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1847/3718] 10.222.0.42 () {58 vars in 1272 bytes} [Sun Oct 23 01:25:09 2022] DELETE /compute/v2.1/os-security-groups/e386a1ff-2e8c-4093-9300-e27bb7a458a6 => generated 0 bytes in 853 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:25:10.074368 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a8b57bd1-b689-4691-8c29-8c0b6eb15c4a tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '.version_select at 0x7f5cc1ee4550>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:10.230988 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-60cbb68f-a584-4663-8278-3903ee7f0f18 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.257899 Oct 23 01:25:10.243539 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1872/3719] 10.222.0.42 () {60 vars in 1316 bytes} [Sun Oct 23 01:25:09 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82/os-interface => generated 1830 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:25:10.381698 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0bbad7a2-ac14-4746-be4b-b5d60a167a95 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:10.382363 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0bbad7a2-ac14-4746-be4b-b5d60a167a95 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] [instance: 623b5796-affa-4692-a43d-7bbb95ce8270] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:10.394812 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0bbad7a2-ac14-4746-be4b-b5d60a167a95 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:10.410432 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0bbad7a2-ac14-4746-be4b-b5d60a167a95 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:10.411007 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0bbad7a2-ac14-4746-be4b-b5d60a167a95 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:10.411809 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0bbad7a2-ac14-4746-be4b-b5d60a167a95 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:10.412291 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0bbad7a2-ac14-4746-be4b-b5d60a167a95 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:10.412786 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0bbad7a2-ac14-4746-be4b-b5d60a167a95 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:10.439663 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-0bbad7a2-ac14-4746-be4b-b5d60a167a95 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] HTTP exception thrown: Instance 623b5796-affa-4692-a43d-7bbb95ce8270 could not be found. Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0bbad7a2-ac14-4746-be4b-b5d60a167a95 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Request method failure captured: Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/623b5796-affa-4692-a43d-7bbb95ce8270 HTTP/1.1 Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJfb7Nh7dDgrdfPcbstOigyWufUUnDLiwFw4u_RNmC71ms7lIkz0OBtkuwSatyr9Dp8byH2fxWwOlerB6u8XUnUyNP3bZe9atvK42Y8AF4R0fW5dorSd0QypMQNU2tooog2W-TDgDyh_kd85q7vv1bhJBD97rlwcOXTxZuleJ4mgJdM Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 316cbb6f558c4bc8b34050cc1b8ea134 Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServerPasswordTestJSON-616405482 Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/316cbb6f558c4bc8b34050cc1b8ea134"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_316cbb6f558c4bc8b34050cc1b8ea134"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/316cbb6f558c4bc8b34050cc1b8ea134"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/316cbb6f558c4bc8b34050cc1b8ea134"}]}] Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServerPasswordTestJSON-616405482 Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 316cbb6f558c4bc8b34050cc1b8ea134 Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServerPasswordTestJSON-616405482 Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServerPasswordTestJSON-616405482-project Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 4024e1a8f515435f86d3d36d59262813 Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServerPasswordTestJSON-616405482-project Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 623b5796-affa-4692-a43d-7bbb95ce8270 could not be found. Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '623b5796-affa-4692-a43d-7bbb95ce8270'} Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 623b5796-affa-4692-a43d-7bbb95ce8270 could not be found. Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 623b5796-affa-4692-a43d-7bbb95ce8270 could not be found. Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:25:10.442032 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:10.449317 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:10.449317 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:25:10.449317 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:25:10.449317 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:25:10.449317 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:25:10.449317 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 623b5796-affa-4692-a43d-7bbb95ce8270 could not be found. Oct 23 01:25:10.449317 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:10.449317 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0bbad7a2-ac14-4746-be4b-b5d60a167a95 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] Returning 404 to user: Instance 623b5796-affa-4692-a43d-7bbb95ce8270 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:25:10.449317 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0bbad7a2-ac14-4746-be4b-b5d60a167a95 tempest-ServerPasswordTestJSON-616405482 tempest-ServerPasswordTestJSON-616405482-project] 10.222.0.42 "GET /compute/v2.1/servers/623b5796-affa-4692-a43d-7bbb95ce8270" status: 404 len: 111 microversion: 2.1 time: 0.065945 Oct 23 01:25:10.450523 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1873/3720] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:10 2022] GET /compute/v2.1/servers/623b5796-affa-4692-a43d-7bbb95ce8270 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 01:25:10.537023 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-995e82db-897f-46c7-8d14-bfce58961bd9 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:10.537554 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-995e82db-897f-46c7-8d14-bfce58961bd9 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:10.556686 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-995e82db-897f-46c7-8d14-bfce58961bd9 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:10.557335 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-995e82db-897f-46c7-8d14-bfce58961bd9 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:10.557785 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-995e82db-897f-46c7-8d14-bfce58961bd9 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:10.558618 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-995e82db-897f-46c7-8d14-bfce58961bd9 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:10.559777 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-995e82db-897f-46c7-8d14-bfce58961bd9 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:10.560217 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-995e82db-897f-46c7-8d14-bfce58961bd9 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:10.600425 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-995e82db-897f-46c7-8d14-bfce58961bd9 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] HTTP exception thrown: Instance c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd could not be found. Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-995e82db-897f-46c7-8d14-bfce58961bd9 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Request method failure captured: Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd HTTP/1.1 Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJdQvIRclWGUu3yQGBJ9l3Cws_fBXVHOSevO8slTJcKTcmBGgTG6m1D1LwZoif8LD-xa9Ftz3dMh3SZfRfBwRy-ZT00BXJnYGoKmbhwfhEsYxk27cfpFHyX1eanOP3oxDKoebkii2PObCr8kr1nw2nvMhrHA9tMoVZkSYy5r9o_35MU Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 0a369d45e4804ffca2e89cb72f447a82 Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-VolumesAdminNegativeTest-1898841118 Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/0a369d45e4804ffca2e89cb72f447a82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_0a369d45e4804ffca2e89cb72f447a82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0a369d45e4804ffca2e89cb72f447a82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0a369d45e4804ffca2e89cb72f447a82"}]}] Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-VolumesAdminNegativeTest-1898841118 Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 0a369d45e4804ffca2e89cb72f447a82 Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1898841118 Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-VolumesAdminNegativeTest-1898841118-project Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 60276a4031ee45ffa651b5467a62a81b Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-VolumesAdminNegativeTest-1898841118-project Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: exception: Instance c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd could not be found. Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd'} Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd could not be found. Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd could not be found. Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:25:10.604390 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:10.614694 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:10.614694 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:25:10.614694 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:25:10.614694 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:25:10.614694 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:25:10.614694 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd could not be found. Oct 23 01:25:10.614694 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:10.614694 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-995e82db-897f-46c7-8d14-bfce58961bd9 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Returning 404 to user: Instance c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:25:10.614694 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-995e82db-897f-46c7-8d14-bfce58961bd9 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "GET /compute/v2.1/servers/c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd" status: 404 len: 111 microversion: 2.1 time: 0.075280 Oct 23 01:25:10.614694 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1874/3721] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:10 2022] GET /compute/v2.1/servers/c08eb121-d7d9-4ad8-8d15-c4d936d0d2fd => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 01:25:11.069774 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a8b57bd1-b689-4691-8c29-8c0b6eb15c4a tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/702a07e0-48c3-4e56-a03d-0233890d4617" status: 202 len: 0 microversion: 2.1 time: 0.999389 Oct 23 01:25:11.073787 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1848/3722] 10.222.0.42 () {58 vars in 1272 bytes} [Sun Oct 23 01:25:10 2022] DELETE /compute/v2.1/os-security-groups/702a07e0-48c3-4e56-a03d-0233890d4617 => generated 0 bytes in 1001 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:25:11.101249 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c26dd5a8-2999-4bda-9feb-bb4be8645a54 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Action: 'create', calling method: .version_select at 0x7f5cc19ea4c0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1274045647", "description": "tempest-description-2086504956"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:25:12.217835 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c26dd5a8-2999-4bda-9feb-bb4be8645a54 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.134744 Oct 23 01:25:12.229794 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1875/3723] 10.222.0.42 () {60 vars in 1180 bytes} [Sun Oct 23 01:25:11 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:25:12.232946 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2703b428-2fee-442a-9363-a4a2b97d0239 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Action: 'update', calling method: .version_select at 0x7f5cc62c41f0>, body: {"security_group": {"name": "tempest-sg-hth-1715658185", "description": "tempest-description-hth-335376467"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:25:12.819696 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2703b428-2fee-442a-9363-a4a2b97d0239 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "PUT /compute/v2.1/os-security-groups/ea375bf8-29e2-4866-b809-5b5960c2095f" status: 200 len: 217 microversion: 2.1 time: 0.591442 Oct 23 01:25:12.828921 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1849/3724] 10.222.0.42 () {60 vars in 1290 bytes} [Sun Oct 23 01:25:12 2022] PUT /compute/v2.1/os-security-groups/ea375bf8-29e2-4866-b809-5b5960c2095f => generated 217 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:25:12.834070 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ea5e7d7a-706a-4245-a1b1-b65aa2ec3b4a tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '.version_select at 0x7f5cc0fc64c0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:13.081054 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ea5e7d7a-706a-4245-a1b1-b65aa2ec3b4a tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "GET /compute/v2.1/os-security-groups/ea375bf8-29e2-4866-b809-5b5960c2095f" status: 200 len: 217 microversion: 2.1 time: 0.250678 Oct 23 01:25:13.090957 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1876/3725] 10.222.0.42 () {58 vars in 1269 bytes} [Sun Oct 23 01:25:12 2022] GET /compute/v2.1/os-security-groups/ea375bf8-29e2-4866-b809-5b5960c2095f => generated 217 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:25:13.116175 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c5275b2c-7dc1-49d8-989b-831a3a0966ff tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '.version_select at 0x7f5cc631f550>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:13.758381 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c5275b2c-7dc1-49d8-989b-831a3a0966ff tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/ea375bf8-29e2-4866-b809-5b5960c2095f" status: 202 len: 0 microversion: 2.1 time: 0.665114 Oct 23 01:25:13.759976 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1850/3726] 10.222.0.42 () {58 vars in 1272 bytes} [Sun Oct 23 01:25:13 2022] DELETE /compute/v2.1/os-security-groups/ea375bf8-29e2-4866-b809-5b5960c2095f => generated 0 bytes in 668 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:25:13.770996 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-86467659-1b49-4daa-9fd9-69cacf7ab277 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:13.771577 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-86467659-1b49-4daa-9fd9-69cacf7ab277 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] [instance: aa768b59-9807-4365-a405-b6e688b1e0f6] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:13.793789 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-86467659-1b49-4daa-9fd9-69cacf7ab277 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:13.793789 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-86467659-1b49-4daa-9fd9-69cacf7ab277 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:13.793789 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-86467659-1b49-4daa-9fd9-69cacf7ab277 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:13.793789 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-86467659-1b49-4daa-9fd9-69cacf7ab277 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:13.793789 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-86467659-1b49-4daa-9fd9-69cacf7ab277 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:13.793789 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-86467659-1b49-4daa-9fd9-69cacf7ab277 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:13.827756 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-86467659-1b49-4daa-9fd9-69cacf7ab277 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] HTTP exception thrown: Instance aa768b59-9807-4365-a405-b6e688b1e0f6 could not be found. Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-86467659-1b49-4daa-9fd9-69cacf7ab277 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Request method failure captured: Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6 HTTP/1.1 Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJe3mET0Sd7lZbPfIN3VkjmqiroRssL9JbOguxpn1sZ00E3M8viQBbgfQ2g7IyamsO6Vg1eRk3unJQGVa1SLVceO_jtTkwsvZ7R_UZpRIovLO2xYyroaQHuRt-8XjOXN_zV_7Obxi_ZE4mM221EAm7ZWkONLhuVRvJ2vR8Bciy4qSyo Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 8d9f6afbdbf74318a98dfe455a72ac7c Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-SecurityGroupsTestJSON-215153901 Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8d9f6afbdbf74318a98dfe455a72ac7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8d9f6afbdbf74318a98dfe455a72ac7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8d9f6afbdbf74318a98dfe455a72ac7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8d9f6afbdbf74318a98dfe455a72ac7c"}]}] Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-SecurityGroupsTestJSON-215153901 Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 8d9f6afbdbf74318a98dfe455a72ac7c Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-215153901 Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-SecurityGroupsTestJSON-215153901-project Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 2b8a867611614ea585d510d62c63cfa3 Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-SecurityGroupsTestJSON-215153901-project Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: exception: Instance aa768b59-9807-4365-a405-b6e688b1e0f6 could not be found. Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'aa768b59-9807-4365-a405-b6e688b1e0f6'} Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa768b59-9807-4365-a405-b6e688b1e0f6 could not be found. Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:25:13.829339 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:25:13.837017 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa768b59-9807-4365-a405-b6e688b1e0f6 could not be found. Oct 23 01:25:13.837017 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:13.837017 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:25:13.837017 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:13.837017 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:13.837017 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:25:13.837017 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:25:13.837017 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:25:13.837017 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:25:13.837017 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa768b59-9807-4365-a405-b6e688b1e0f6 could not be found. Oct 23 01:25:13.837017 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:13.837017 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-86467659-1b49-4daa-9fd9-69cacf7ab277 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Returning 404 to user: Instance aa768b59-9807-4365-a405-b6e688b1e0f6 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:25:13.837017 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-86467659-1b49-4daa-9fd9-69cacf7ab277 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "DELETE /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6" status: 404 len: 111 microversion: 2.1 time: 0.066446 Oct 23 01:25:13.838662 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1877/3727] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:25:13 2022] DELETE /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:25:13.849017 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a7f76d0a-f777-4fd8-a9ea-0d2c3073670d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:13.849834 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a7f76d0a-f777-4fd8-a9ea-0d2c3073670d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] [instance: aa768b59-9807-4365-a405-b6e688b1e0f6] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:13.858885 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a7f76d0a-f777-4fd8-a9ea-0d2c3073670d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:13.859379 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a7f76d0a-f777-4fd8-a9ea-0d2c3073670d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:13.862352 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a7f76d0a-f777-4fd8-a9ea-0d2c3073670d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:13.864349 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a7f76d0a-f777-4fd8-a9ea-0d2c3073670d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:13.866390 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a7f76d0a-f777-4fd8-a9ea-0d2c3073670d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:13.868628 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a7f76d0a-f777-4fd8-a9ea-0d2c3073670d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:13.904582 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-a7f76d0a-f777-4fd8-a9ea-0d2c3073670d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] HTTP exception thrown: Instance aa768b59-9807-4365-a405-b6e688b1e0f6 could not be found. Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a7f76d0a-f777-4fd8-a9ea-0d2c3073670d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Request method failure captured: Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6 HTTP/1.1 Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJe3mET0Sd7lZbPfIN3VkjmqiroRssL9JbOguxpn1sZ00E3M8viQBbgfQ2g7IyamsO6Vg1eRk3unJQGVa1SLVceO_jtTkwsvZ7R_UZpRIovLO2xYyroaQHuRt-8XjOXN_zV_7Obxi_ZE4mM221EAm7ZWkONLhuVRvJ2vR8Bciy4qSyo Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 8d9f6afbdbf74318a98dfe455a72ac7c Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-SecurityGroupsTestJSON-215153901 Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8d9f6afbdbf74318a98dfe455a72ac7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8d9f6afbdbf74318a98dfe455a72ac7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8d9f6afbdbf74318a98dfe455a72ac7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8d9f6afbdbf74318a98dfe455a72ac7c"}]}] Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-SecurityGroupsTestJSON-215153901 Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 8d9f6afbdbf74318a98dfe455a72ac7c Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-215153901 Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-SecurityGroupsTestJSON-215153901-project Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 2b8a867611614ea585d510d62c63cfa3 Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-SecurityGroupsTestJSON-215153901-project Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: exception: Instance aa768b59-9807-4365-a405-b6e688b1e0f6 could not be found. Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'aa768b59-9807-4365-a405-b6e688b1e0f6'} Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa768b59-9807-4365-a405-b6e688b1e0f6 could not be found. Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa768b59-9807-4365-a405-b6e688b1e0f6 could not be found. Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:25:13.910793 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:25:13.916040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:13.916040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:25:13.916040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:25:13.916040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:25:13.916040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:25:13.916040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa768b59-9807-4365-a405-b6e688b1e0f6 could not be found. Oct 23 01:25:13.916040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:25:13.917569 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a7f76d0a-f777-4fd8-a9ea-0d2c3073670d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Returning 404 to user: Instance aa768b59-9807-4365-a405-b6e688b1e0f6 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:25:13.919064 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a7f76d0a-f777-4fd8-a9ea-0d2c3073670d tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "GET /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6" status: 404 len: 111 microversion: 2.1 time: 0.082069 Oct 23 01:25:13.921451 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1851/3728] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:13 2022] GET /compute/v2.1/servers/aa768b59-9807-4365-a405-b6e688b1e0f6 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:25:13.930040 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1f4affba-5e71-4be8-ac74-b46a3bfd6990 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '.version_select at 0x7f5cc0fd63a0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:14.058947 n-d-master-1 devstack@n-api.service[120944]: DEBUG neutronclient.v2_0.client [None req-1f4affba-5e71-4be8-ac74-b46a3bfd6990 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 702a07e0-48c3-4e56-a03d-0233890d4617 does not exist", "detail": ""}} {{(pid=120944) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 23 01:25:14.060068 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.security_group_api [None req-1f4affba-5e71-4be8-ac74-b46a3bfd6990 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Neutron security group 702a07e0-48c3-4e56-a03d-0233890d4617 not found {{(pid=120944) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 23 01:25:14.060804 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-1f4affba-5e71-4be8-ac74-b46a3bfd6990 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] HTTP exception thrown: Security group 702a07e0-48c3-4e56-a03d-0233890d4617 does not exist Oct 23 01:25:14.060804 n-d-master-1 devstack@n-api.service[120944]: Neutron server returns request_ids: ['req-79d5308b-13a2-4f52-8c2a-f2c2f7ee5ae3'] Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1f4affba-5e71-4be8-ac74-b46a3bfd6990 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Request method failure captured: Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/os-security-groups/702a07e0-48c3-4e56-a03d-0233890d4617 HTTP/1.1 Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJe3mET0Sd7lZbPfIN3VkjmqiroRssL9JbOguxpn1sZ00E3M8viQBbgfQ2g7IyamsO6Vg1eRk3unJQGVa1SLVceO_jtTkwsvZ7R_UZpRIovLO2xYyroaQHuRt-8XjOXN_zV_7Obxi_ZE4mM221EAm7ZWkONLhuVRvJ2vR8Bciy4qSyo Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 8d9f6afbdbf74318a98dfe455a72ac7c Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-SecurityGroupsTestJSON-215153901 Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8d9f6afbdbf74318a98dfe455a72ac7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8d9f6afbdbf74318a98dfe455a72ac7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8d9f6afbdbf74318a98dfe455a72ac7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8d9f6afbdbf74318a98dfe455a72ac7c"}]}] Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-SecurityGroupsTestJSON-215153901 Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 8d9f6afbdbf74318a98dfe455a72ac7c Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-215153901 Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-SecurityGroupsTestJSON-215153901-project Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 2b8a867611614ea585d510d62c63cfa3 Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-SecurityGroupsTestJSON-215153901-project Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: method: Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: exception: Security group 702a07e0-48c3-4e56-a03d-0233890d4617 does not exist Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: Neutron server returns request_ids: ['req-79d5308b-13a2-4f52-8c2a-f2c2f7ee5ae3'] Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '702a07e0-48c3-4e56-a03d-0233890d4617'} Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 23 01:25:14.064040 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 702a07e0-48c3-4e56-a03d-0233890d4617 does not exist Oct 23 01:25:14.070162 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-79d5308b-13a2-4f52-8c2a-f2c2f7ee5ae3'] Oct 23 01:25:14.070162 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:14.070162 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:25:14.070162 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:14.070162 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:14.070162 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 23 01:25:14.070162 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 23 01:25:14.070162 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 23 01:25:14.070162 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 23 01:25:14.070162 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 702a07e0-48c3-4e56-a03d-0233890d4617 does not exist Oct 23 01:25:14.070162 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-79d5308b-13a2-4f52-8c2a-f2c2f7ee5ae3'] Oct 23 01:25:14.070162 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:14.070162 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:25:14.070162 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:14.070162 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:14.070162 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:25:14.070162 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:25:14.070162 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:25:14.070162 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:25:14.070162 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:25:14.070162 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:25:14.070162 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:25:14.070162 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:25:14.070162 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 23 01:25:14.070162 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 23 01:25:14.070162 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 702a07e0-48c3-4e56-a03d-0233890d4617 does not exist Oct 23 01:25:14.070162 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-79d5308b-13a2-4f52-8c2a-f2c2f7ee5ae3'] Oct 23 01:25:14.070162 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:14.070162 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:25:14.070162 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:14.070162 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:14.070162 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:25:14.070162 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:25:14.070162 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:25:14.070162 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:25:14.070162 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 702a07e0-48c3-4e56-a03d-0233890d4617 does not exist Oct 23 01:25:14.070162 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-79d5308b-13a2-4f52-8c2a-f2c2f7ee5ae3'] Oct 23 01:25:14.070162 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:14.082206 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1f4affba-5e71-4be8-ac74-b46a3bfd6990 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Returning 404 to user: Security group 702a07e0-48c3-4e56-a03d-0233890d4617 does not exist Oct 23 01:25:14.082206 n-d-master-1 devstack@n-api.service[120944]: Neutron server returns request_ids: ['req-79d5308b-13a2-4f52-8c2a-f2c2f7ee5ae3'] {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:25:14.082206 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1f4affba-5e71-4be8-ac74-b46a3bfd6990 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/702a07e0-48c3-4e56-a03d-0233890d4617" status: 404 len: 194 microversion: 2.1 time: 0.150669 Oct 23 01:25:14.082206 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1878/3729] 10.222.0.42 () {58 vars in 1272 bytes} [Sun Oct 23 01:25:13 2022] DELETE /compute/v2.1/os-security-groups/702a07e0-48c3-4e56-a03d-0233890d4617 => generated 194 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:25:14.087126 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7dbac910-d1c3-45dc-8be5-31d2383e8da2 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '.version_select at 0x7f5cc631fa60>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:14.164041 n-d-master-1 devstack@n-api.service[120945]: DEBUG neutronclient.v2_0.client [None req-7dbac910-d1c3-45dc-8be5-31d2383e8da2 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e386a1ff-2e8c-4093-9300-e27bb7a458a6 does not exist", "detail": ""}} {{(pid=120945) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 23 01:25:14.164661 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.security_group_api [None req-7dbac910-d1c3-45dc-8be5-31d2383e8da2 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Neutron security group e386a1ff-2e8c-4093-9300-e27bb7a458a6 not found {{(pid=120945) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 23 01:25:14.165185 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-7dbac910-d1c3-45dc-8be5-31d2383e8da2 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] HTTP exception thrown: Security group e386a1ff-2e8c-4093-9300-e27bb7a458a6 does not exist Oct 23 01:25:14.165185 n-d-master-1 devstack@n-api.service[120945]: Neutron server returns request_ids: ['req-15fadc74-b965-486b-8845-3d224e0be5d3'] Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7dbac910-d1c3-45dc-8be5-31d2383e8da2 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Request method failure captured: Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/os-security-groups/e386a1ff-2e8c-4093-9300-e27bb7a458a6 HTTP/1.1 Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJe3mET0Sd7lZbPfIN3VkjmqiroRssL9JbOguxpn1sZ00E3M8viQBbgfQ2g7IyamsO6Vg1eRk3unJQGVa1SLVceO_jtTkwsvZ7R_UZpRIovLO2xYyroaQHuRt-8XjOXN_zV_7Obxi_ZE4mM221EAm7ZWkONLhuVRvJ2vR8Bciy4qSyo Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 8d9f6afbdbf74318a98dfe455a72ac7c Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-SecurityGroupsTestJSON-215153901 Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8d9f6afbdbf74318a98dfe455a72ac7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8d9f6afbdbf74318a98dfe455a72ac7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8d9f6afbdbf74318a98dfe455a72ac7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8d9f6afbdbf74318a98dfe455a72ac7c"}]}] Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-SecurityGroupsTestJSON-215153901 Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 8d9f6afbdbf74318a98dfe455a72ac7c Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-215153901 Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-SecurityGroupsTestJSON-215153901-project Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 2b8a867611614ea585d510d62c63cfa3 Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-SecurityGroupsTestJSON-215153901-project Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: method: Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: exception: Security group e386a1ff-2e8c-4093-9300-e27bb7a458a6 does not exist Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: Neutron server returns request_ids: ['req-15fadc74-b965-486b-8845-3d224e0be5d3'] Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'e386a1ff-2e8c-4093-9300-e27bb7a458a6'} Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 23 01:25:14.167479 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e386a1ff-2e8c-4093-9300-e27bb7a458a6 does not exist Oct 23 01:25:14.173471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-15fadc74-b965-486b-8845-3d224e0be5d3'] Oct 23 01:25:14.173471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:25:14.173471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:25:14.173471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:25:14.173471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:14.173471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 23 01:25:14.173471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 23 01:25:14.173471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 23 01:25:14.173471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 23 01:25:14.173471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e386a1ff-2e8c-4093-9300-e27bb7a458a6 does not exist Oct 23 01:25:14.173471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-15fadc74-b965-486b-8845-3d224e0be5d3'] Oct 23 01:25:14.173471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:25:14.173471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:25:14.173471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:25:14.173471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:14.173471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:25:14.173471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:25:14.173471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:25:14.173471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:25:14.173471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:25:14.173471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:25:14.173471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:25:14.173471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:25:14.173471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 23 01:25:14.173471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 23 01:25:14.173471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e386a1ff-2e8c-4093-9300-e27bb7a458a6 does not exist Oct 23 01:25:14.173471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-15fadc74-b965-486b-8845-3d224e0be5d3'] Oct 23 01:25:14.173471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:25:14.173471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:25:14.173471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:25:14.173471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:14.173471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:25:14.173471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:25:14.173471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:25:14.173471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:25:14.173471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e386a1ff-2e8c-4093-9300-e27bb7a458a6 does not exist Oct 23 01:25:14.173471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-15fadc74-b965-486b-8845-3d224e0be5d3'] Oct 23 01:25:14.173471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:25:14.173471 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7dbac910-d1c3-45dc-8be5-31d2383e8da2 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Returning 404 to user: Security group e386a1ff-2e8c-4093-9300-e27bb7a458a6 does not exist Oct 23 01:25:14.173471 n-d-master-1 devstack@n-api.service[120945]: Neutron server returns request_ids: ['req-15fadc74-b965-486b-8845-3d224e0be5d3'] {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:25:14.173471 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7dbac910-d1c3-45dc-8be5-31d2383e8da2 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/e386a1ff-2e8c-4093-9300-e27bb7a458a6" status: 404 len: 194 microversion: 2.1 time: 0.087843 Oct 23 01:25:14.182361 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1852/3730] 10.222.0.42 () {58 vars in 1272 bytes} [Sun Oct 23 01:25:14 2022] DELETE /compute/v2.1/os-security-groups/e386a1ff-2e8c-4093-9300-e27bb7a458a6 => generated 194 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:25:14.188723 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9ee0e2b9-d487-4de4-9457-f9d197f9d795 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '.version_select at 0x7f5cc0fc7310>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:14.325455 n-d-master-1 devstack@n-api.service[120944]: DEBUG neutronclient.v2_0.client [None req-9ee0e2b9-d487-4de4-9457-f9d197f9d795 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4a618366-6623-40a6-a8d1-4b374cbba96a does not exist", "detail": ""}} {{(pid=120944) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 23 01:25:14.326998 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.security_group_api [None req-9ee0e2b9-d487-4de4-9457-f9d197f9d795 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Neutron security group 4a618366-6623-40a6-a8d1-4b374cbba96a not found {{(pid=120944) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 23 01:25:14.328479 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-9ee0e2b9-d487-4de4-9457-f9d197f9d795 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] HTTP exception thrown: Security group 4a618366-6623-40a6-a8d1-4b374cbba96a does not exist Oct 23 01:25:14.328479 n-d-master-1 devstack@n-api.service[120944]: Neutron server returns request_ids: ['req-96ce328f-ca10-4dfe-8346-ac850225c13c'] Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9ee0e2b9-d487-4de4-9457-f9d197f9d795 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Request method failure captured: Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/os-security-groups/4a618366-6623-40a6-a8d1-4b374cbba96a HTTP/1.1 Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJe3mET0Sd7lZbPfIN3VkjmqiroRssL9JbOguxpn1sZ00E3M8viQBbgfQ2g7IyamsO6Vg1eRk3unJQGVa1SLVceO_jtTkwsvZ7R_UZpRIovLO2xYyroaQHuRt-8XjOXN_zV_7Obxi_ZE4mM221EAm7ZWkONLhuVRvJ2vR8Bciy4qSyo Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 8d9f6afbdbf74318a98dfe455a72ac7c Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-SecurityGroupsTestJSON-215153901 Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8d9f6afbdbf74318a98dfe455a72ac7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8d9f6afbdbf74318a98dfe455a72ac7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8d9f6afbdbf74318a98dfe455a72ac7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8d9f6afbdbf74318a98dfe455a72ac7c"}]}] Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-SecurityGroupsTestJSON-215153901 Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 8d9f6afbdbf74318a98dfe455a72ac7c Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-215153901 Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-SecurityGroupsTestJSON-215153901-project Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 2b8a867611614ea585d510d62c63cfa3 Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-SecurityGroupsTestJSON-215153901-project Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: method: Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: exception: Security group 4a618366-6623-40a6-a8d1-4b374cbba96a does not exist Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: Neutron server returns request_ids: ['req-96ce328f-ca10-4dfe-8346-ac850225c13c'] Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '4a618366-6623-40a6-a8d1-4b374cbba96a'} Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 23 01:25:14.332284 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4a618366-6623-40a6-a8d1-4b374cbba96a does not exist Oct 23 01:25:14.337359 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-96ce328f-ca10-4dfe-8346-ac850225c13c'] Oct 23 01:25:14.337359 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:14.337359 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:25:14.337359 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:14.337359 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:14.337359 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 23 01:25:14.337359 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 23 01:25:14.337359 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 23 01:25:14.337359 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 23 01:25:14.337359 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4a618366-6623-40a6-a8d1-4b374cbba96a does not exist Oct 23 01:25:14.337359 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-96ce328f-ca10-4dfe-8346-ac850225c13c'] Oct 23 01:25:14.337359 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:14.337359 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:25:14.337359 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:14.337359 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:14.337359 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:25:14.337359 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:25:14.337359 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:25:14.337359 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:25:14.337359 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:25:14.337359 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:25:14.337359 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:25:14.337359 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:25:14.337359 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 23 01:25:14.337359 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 23 01:25:14.337359 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4a618366-6623-40a6-a8d1-4b374cbba96a does not exist Oct 23 01:25:14.337359 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-96ce328f-ca10-4dfe-8346-ac850225c13c'] Oct 23 01:25:14.337359 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:14.337359 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:25:14.337359 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:14.337359 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:14.337359 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:25:14.337359 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:25:14.337359 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:25:14.337359 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:25:14.337359 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4a618366-6623-40a6-a8d1-4b374cbba96a does not exist Oct 23 01:25:14.337359 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-96ce328f-ca10-4dfe-8346-ac850225c13c'] Oct 23 01:25:14.337359 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:14.349365 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9ee0e2b9-d487-4de4-9457-f9d197f9d795 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Returning 404 to user: Security group 4a618366-6623-40a6-a8d1-4b374cbba96a does not exist Oct 23 01:25:14.349365 n-d-master-1 devstack@n-api.service[120944]: Neutron server returns request_ids: ['req-96ce328f-ca10-4dfe-8346-ac850225c13c'] {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:25:14.349365 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9ee0e2b9-d487-4de4-9457-f9d197f9d795 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/4a618366-6623-40a6-a8d1-4b374cbba96a" status: 404 len: 194 microversion: 2.1 time: 0.156857 Oct 23 01:25:14.349365 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1879/3731] 10.222.0.42 () {58 vars in 1272 bytes} [Sun Oct 23 01:25:14 2022] DELETE /compute/v2.1/os-security-groups/4a618366-6623-40a6-a8d1-4b374cbba96a => generated 194 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:25:14.356137 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-88092e5c-b0a5-4832-be3c-aec5d6185acd tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '.version_select at 0x7f5cc2315ca0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:14.412447 n-d-master-1 devstack@n-api.service[120945]: DEBUG neutronclient.v2_0.client [None req-88092e5c-b0a5-4832-be3c-aec5d6185acd tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 26276d43-87d4-4bdf-b629-89c13322aeb7 does not exist", "detail": ""}} {{(pid=120945) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 23 01:25:14.413244 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.security_group_api [None req-88092e5c-b0a5-4832-be3c-aec5d6185acd tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Neutron security group 26276d43-87d4-4bdf-b629-89c13322aeb7 not found {{(pid=120945) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 23 01:25:14.413906 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-88092e5c-b0a5-4832-be3c-aec5d6185acd tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] HTTP exception thrown: Security group 26276d43-87d4-4bdf-b629-89c13322aeb7 does not exist Oct 23 01:25:14.413906 n-d-master-1 devstack@n-api.service[120945]: Neutron server returns request_ids: ['req-8e84fb4b-500d-47bf-b610-80ab9022a98e'] Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-88092e5c-b0a5-4832-be3c-aec5d6185acd tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Request method failure captured: Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/os-security-groups/26276d43-87d4-4bdf-b629-89c13322aeb7 HTTP/1.1 Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJe3mET0Sd7lZbPfIN3VkjmqiroRssL9JbOguxpn1sZ00E3M8viQBbgfQ2g7IyamsO6Vg1eRk3unJQGVa1SLVceO_jtTkwsvZ7R_UZpRIovLO2xYyroaQHuRt-8XjOXN_zV_7Obxi_ZE4mM221EAm7ZWkONLhuVRvJ2vR8Bciy4qSyo Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 8d9f6afbdbf74318a98dfe455a72ac7c Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-SecurityGroupsTestJSON-215153901 Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8d9f6afbdbf74318a98dfe455a72ac7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8d9f6afbdbf74318a98dfe455a72ac7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8d9f6afbdbf74318a98dfe455a72ac7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8d9f6afbdbf74318a98dfe455a72ac7c"}]}] Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-SecurityGroupsTestJSON-215153901 Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 8d9f6afbdbf74318a98dfe455a72ac7c Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-215153901 Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-SecurityGroupsTestJSON-215153901-project Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 2b8a867611614ea585d510d62c63cfa3 Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-SecurityGroupsTestJSON-215153901-project Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: method: Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: exception: Security group 26276d43-87d4-4bdf-b629-89c13322aeb7 does not exist Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: Neutron server returns request_ids: ['req-8e84fb4b-500d-47bf-b610-80ab9022a98e'] Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '26276d43-87d4-4bdf-b629-89c13322aeb7'} Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 23 01:25:14.415957 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 26276d43-87d4-4bdf-b629-89c13322aeb7 does not exist Oct 23 01:25:14.424161 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8e84fb4b-500d-47bf-b610-80ab9022a98e'] Oct 23 01:25:14.424161 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:25:14.424161 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:25:14.424161 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:25:14.424161 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:14.424161 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 23 01:25:14.424161 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 23 01:25:14.424161 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 23 01:25:14.424161 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 23 01:25:14.424161 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 26276d43-87d4-4bdf-b629-89c13322aeb7 does not exist Oct 23 01:25:14.424161 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8e84fb4b-500d-47bf-b610-80ab9022a98e'] Oct 23 01:25:14.424161 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:25:14.424161 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:25:14.424161 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:25:14.424161 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:14.424161 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:25:14.424161 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:25:14.424161 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:25:14.424161 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:25:14.424161 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:25:14.424161 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:25:14.424161 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:25:14.424161 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:25:14.424161 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 23 01:25:14.424161 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 23 01:25:14.424161 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 26276d43-87d4-4bdf-b629-89c13322aeb7 does not exist Oct 23 01:25:14.424161 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8e84fb4b-500d-47bf-b610-80ab9022a98e'] Oct 23 01:25:14.424161 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:25:14.424161 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:25:14.424161 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:25:14.424161 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:14.424161 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:25:14.424161 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:25:14.424161 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:25:14.424161 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:25:14.424161 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 26276d43-87d4-4bdf-b629-89c13322aeb7 does not exist Oct 23 01:25:14.424161 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8e84fb4b-500d-47bf-b610-80ab9022a98e'] Oct 23 01:25:14.424161 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:25:14.424161 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-88092e5c-b0a5-4832-be3c-aec5d6185acd tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Returning 404 to user: Security group 26276d43-87d4-4bdf-b629-89c13322aeb7 does not exist Oct 23 01:25:14.424161 n-d-master-1 devstack@n-api.service[120945]: Neutron server returns request_ids: ['req-8e84fb4b-500d-47bf-b610-80ab9022a98e'] {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:25:14.424161 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-88092e5c-b0a5-4832-be3c-aec5d6185acd tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/26276d43-87d4-4bdf-b629-89c13322aeb7" status: 404 len: 194 microversion: 2.1 time: 0.073726 Oct 23 01:25:14.424161 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1853/3732] 10.222.0.42 () {58 vars in 1272 bytes} [Sun Oct 23 01:25:14 2022] DELETE /compute/v2.1/os-security-groups/26276d43-87d4-4bdf-b629-89c13322aeb7 => generated 194 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:25:14.439613 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-98baddaf-baae-4dc5-93c2-07c2c1dcd84b tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '.version_select at 0x7f5cc0ff4430>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:14.520977 n-d-master-1 devstack@n-api.service[120944]: DEBUG neutronclient.v2_0.client [None req-98baddaf-baae-4dc5-93c2-07c2c1dcd84b tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 51c408df-5c0d-4b84-a46c-93a514c393fe does not exist", "detail": ""}} {{(pid=120944) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 23 01:25:14.521560 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.security_group_api [None req-98baddaf-baae-4dc5-93c2-07c2c1dcd84b tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Neutron security group 51c408df-5c0d-4b84-a46c-93a514c393fe not found {{(pid=120944) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 23 01:25:14.529584 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-98baddaf-baae-4dc5-93c2-07c2c1dcd84b tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] HTTP exception thrown: Security group 51c408df-5c0d-4b84-a46c-93a514c393fe does not exist Oct 23 01:25:14.529584 n-d-master-1 devstack@n-api.service[120944]: Neutron server returns request_ids: ['req-5840b774-5bcb-420b-b5a3-470fddff1b3f'] Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-98baddaf-baae-4dc5-93c2-07c2c1dcd84b tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Request method failure captured: Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/os-security-groups/51c408df-5c0d-4b84-a46c-93a514c393fe HTTP/1.1 Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJe3mET0Sd7lZbPfIN3VkjmqiroRssL9JbOguxpn1sZ00E3M8viQBbgfQ2g7IyamsO6Vg1eRk3unJQGVa1SLVceO_jtTkwsvZ7R_UZpRIovLO2xYyroaQHuRt-8XjOXN_zV_7Obxi_ZE4mM221EAm7ZWkONLhuVRvJ2vR8Bciy4qSyo Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 8d9f6afbdbf74318a98dfe455a72ac7c Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-SecurityGroupsTestJSON-215153901 Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8d9f6afbdbf74318a98dfe455a72ac7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8d9f6afbdbf74318a98dfe455a72ac7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8d9f6afbdbf74318a98dfe455a72ac7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8d9f6afbdbf74318a98dfe455a72ac7c"}]}] Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-SecurityGroupsTestJSON-215153901 Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 8d9f6afbdbf74318a98dfe455a72ac7c Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-215153901 Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-SecurityGroupsTestJSON-215153901-project Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 2b8a867611614ea585d510d62c63cfa3 Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-SecurityGroupsTestJSON-215153901-project Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: method: Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: exception: Security group 51c408df-5c0d-4b84-a46c-93a514c393fe does not exist Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: Neutron server returns request_ids: ['req-5840b774-5bcb-420b-b5a3-470fddff1b3f'] Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '51c408df-5c0d-4b84-a46c-93a514c393fe'} Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 23 01:25:14.533272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 51c408df-5c0d-4b84-a46c-93a514c393fe does not exist Oct 23 01:25:14.538345 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5840b774-5bcb-420b-b5a3-470fddff1b3f'] Oct 23 01:25:14.538345 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:14.538345 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:25:14.538345 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:14.538345 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:14.538345 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 23 01:25:14.538345 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 23 01:25:14.538345 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 23 01:25:14.538345 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 23 01:25:14.538345 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 51c408df-5c0d-4b84-a46c-93a514c393fe does not exist Oct 23 01:25:14.538345 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5840b774-5bcb-420b-b5a3-470fddff1b3f'] Oct 23 01:25:14.538345 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:14.538345 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:25:14.538345 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:14.538345 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:14.538345 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:25:14.538345 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:25:14.538345 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:25:14.538345 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:25:14.538345 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:25:14.538345 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:25:14.538345 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:25:14.538345 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:25:14.538345 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 23 01:25:14.538345 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 23 01:25:14.538345 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 51c408df-5c0d-4b84-a46c-93a514c393fe does not exist Oct 23 01:25:14.538345 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5840b774-5bcb-420b-b5a3-470fddff1b3f'] Oct 23 01:25:14.538345 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:14.538345 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:25:14.538345 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:14.538345 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:14.538345 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:25:14.538345 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:25:14.538345 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:25:14.538345 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:25:14.538345 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 51c408df-5c0d-4b84-a46c-93a514c393fe does not exist Oct 23 01:25:14.538345 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5840b774-5bcb-420b-b5a3-470fddff1b3f'] Oct 23 01:25:14.538345 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:14.538345 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-98baddaf-baae-4dc5-93c2-07c2c1dcd84b tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Returning 404 to user: Security group 51c408df-5c0d-4b84-a46c-93a514c393fe does not exist Oct 23 01:25:14.538345 n-d-master-1 devstack@n-api.service[120944]: Neutron server returns request_ids: ['req-5840b774-5bcb-420b-b5a3-470fddff1b3f'] {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:25:14.538345 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-98baddaf-baae-4dc5-93c2-07c2c1dcd84b tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/51c408df-5c0d-4b84-a46c-93a514c393fe" status: 404 len: 194 microversion: 2.1 time: 0.101957 Oct 23 01:25:14.538345 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1880/3733] 10.222.0.42 () {58 vars in 1272 bytes} [Sun Oct 23 01:25:14 2022] DELETE /compute/v2.1/os-security-groups/51c408df-5c0d-4b84-a46c-93a514c393fe => generated 194 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:25:14.546037 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a2a6ee69-a85a-401b-8e86-808ecc63eaea tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '.version_select at 0x7f5cc23bbc10>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:15.056160 n-d-master-1 devstack@n-api.service[120945]: DEBUG neutronclient.v2_0.client [None req-a2a6ee69-a85a-401b-8e86-808ecc63eaea tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3e7ee609-b62e-413c-8667-8711a29148e3 does not exist", "detail": ""}} {{(pid=120945) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 23 01:25:15.057000 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.security_group_api [None req-a2a6ee69-a85a-401b-8e86-808ecc63eaea tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Neutron security group 3e7ee609-b62e-413c-8667-8711a29148e3 not found {{(pid=120945) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 23 01:25:15.059970 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-a2a6ee69-a85a-401b-8e86-808ecc63eaea tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] HTTP exception thrown: Security group 3e7ee609-b62e-413c-8667-8711a29148e3 does not exist Oct 23 01:25:15.059970 n-d-master-1 devstack@n-api.service[120945]: Neutron server returns request_ids: ['req-dec48888-8702-4ccc-a3f2-4e72112c2f87'] Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a2a6ee69-a85a-401b-8e86-808ecc63eaea tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Request method failure captured: Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/os-security-groups/3e7ee609-b62e-413c-8667-8711a29148e3 HTTP/1.1 Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJe3mET0Sd7lZbPfIN3VkjmqiroRssL9JbOguxpn1sZ00E3M8viQBbgfQ2g7IyamsO6Vg1eRk3unJQGVa1SLVceO_jtTkwsvZ7R_UZpRIovLO2xYyroaQHuRt-8XjOXN_zV_7Obxi_ZE4mM221EAm7ZWkONLhuVRvJ2vR8Bciy4qSyo Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 8d9f6afbdbf74318a98dfe455a72ac7c Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-SecurityGroupsTestJSON-215153901 Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8d9f6afbdbf74318a98dfe455a72ac7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8d9f6afbdbf74318a98dfe455a72ac7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8d9f6afbdbf74318a98dfe455a72ac7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8d9f6afbdbf74318a98dfe455a72ac7c"}]}] Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-SecurityGroupsTestJSON-215153901 Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 8d9f6afbdbf74318a98dfe455a72ac7c Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-215153901 Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-SecurityGroupsTestJSON-215153901-project Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 2b8a867611614ea585d510d62c63cfa3 Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-SecurityGroupsTestJSON-215153901-project Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: method: Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: exception: Security group 3e7ee609-b62e-413c-8667-8711a29148e3 does not exist Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: Neutron server returns request_ids: ['req-dec48888-8702-4ccc-a3f2-4e72112c2f87'] Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '3e7ee609-b62e-413c-8667-8711a29148e3'} Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 23 01:25:15.063106 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3e7ee609-b62e-413c-8667-8711a29148e3 does not exist Oct 23 01:25:15.070773 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dec48888-8702-4ccc-a3f2-4e72112c2f87'] Oct 23 01:25:15.070773 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:25:15.070773 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:25:15.070773 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:25:15.070773 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:15.070773 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 23 01:25:15.070773 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 23 01:25:15.070773 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 23 01:25:15.070773 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 23 01:25:15.070773 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3e7ee609-b62e-413c-8667-8711a29148e3 does not exist Oct 23 01:25:15.070773 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dec48888-8702-4ccc-a3f2-4e72112c2f87'] Oct 23 01:25:15.070773 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:25:15.070773 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:25:15.070773 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:25:15.070773 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:15.070773 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:25:15.070773 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:25:15.070773 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:25:15.070773 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:25:15.070773 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:25:15.070773 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:25:15.070773 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:25:15.070773 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:25:15.070773 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 23 01:25:15.070773 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 23 01:25:15.070773 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3e7ee609-b62e-413c-8667-8711a29148e3 does not exist Oct 23 01:25:15.070773 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dec48888-8702-4ccc-a3f2-4e72112c2f87'] Oct 23 01:25:15.070773 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:25:15.070773 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:25:15.070773 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:25:15.070773 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:15.070773 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:25:15.070773 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:25:15.070773 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:25:15.070773 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:25:15.070773 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3e7ee609-b62e-413c-8667-8711a29148e3 does not exist Oct 23 01:25:15.070773 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dec48888-8702-4ccc-a3f2-4e72112c2f87'] Oct 23 01:25:15.070773 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:25:15.070773 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a2a6ee69-a85a-401b-8e86-808ecc63eaea tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Returning 404 to user: Security group 3e7ee609-b62e-413c-8667-8711a29148e3 does not exist Oct 23 01:25:15.070773 n-d-master-1 devstack@n-api.service[120945]: Neutron server returns request_ids: ['req-dec48888-8702-4ccc-a3f2-4e72112c2f87'] {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:25:15.075414 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a2a6ee69-a85a-401b-8e86-808ecc63eaea tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/3e7ee609-b62e-413c-8667-8711a29148e3" status: 404 len: 194 microversion: 2.1 time: 0.530974 Oct 23 01:25:15.085366 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fad03b1b-6b2e-4c59-895b-5d4b4a2239bb tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:15.089054 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fad03b1b-6b2e-4c59-895b-5d4b4a2239bb tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] [instance: 7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:15.089899 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1854/3734] 10.222.0.42 () {58 vars in 1272 bytes} [Sun Oct 23 01:25:14 2022] DELETE /compute/v2.1/os-security-groups/3e7ee609-b62e-413c-8667-8711a29148e3 => generated 194 bytes in 535 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:25:15.103378 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fad03b1b-6b2e-4c59-895b-5d4b4a2239bb tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:15.105791 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fad03b1b-6b2e-4c59-895b-5d4b4a2239bb tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:15.105791 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fad03b1b-6b2e-4c59-895b-5d4b4a2239bb tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:15.107348 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fad03b1b-6b2e-4c59-895b-5d4b4a2239bb tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:15.107910 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fad03b1b-6b2e-4c59-895b-5d4b4a2239bb tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:15.109802 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fad03b1b-6b2e-4c59-895b-5d4b4a2239bb tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:15.153994 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fad03b1b-6b2e-4c59-895b-5d4b4a2239bb tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] [instance: 7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:25:15.321628 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-60c2a764-7dbd-4c1a-bc2d-cb457969f1a4 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:15.322169 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-60c2a764-7dbd-4c1a-bc2d-cb457969f1a4 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: 8ce9f585-473f-4f8f-a5e6-7b83b7303ccb] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:15.328157 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-60c2a764-7dbd-4c1a-bc2d-cb457969f1a4 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:15.328663 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-60c2a764-7dbd-4c1a-bc2d-cb457969f1a4 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:15.329100 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-60c2a764-7dbd-4c1a-bc2d-cb457969f1a4 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:15.329809 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-60c2a764-7dbd-4c1a-bc2d-cb457969f1a4 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:15.330302 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-60c2a764-7dbd-4c1a-bc2d-cb457969f1a4 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:15.330755 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-60c2a764-7dbd-4c1a-bc2d-cb457969f1a4 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:15.358335 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-60c2a764-7dbd-4c1a-bc2d-cb457969f1a4 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: 8ce9f585-473f-4f8f-a5e6-7b83b7303ccb] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:25:15.644898 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fad03b1b-6b2e-4c59-895b-5d4b4a2239bb tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3" status: 204 len: 0 microversion: 2.1 time: 0.565379 Oct 23 01:25:15.645490 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1881/3735] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:25:15 2022] DELETE /compute/v2.1/servers/7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:25:15.661522 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1318b957-092c-4ed3-bb54-1ff6079cea25 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:15.662278 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1318b957-092c-4ed3-bb54-1ff6079cea25 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] [instance: 7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:15.675002 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:15.687651 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1318b957-092c-4ed3-bb54-1ff6079cea25 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:15.688161 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1318b957-092c-4ed3-bb54-1ff6079cea25 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:15.688611 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1318b957-092c-4ed3-bb54-1ff6079cea25 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:15.689325 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1318b957-092c-4ed3-bb54-1ff6079cea25 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:15.697322 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1318b957-092c-4ed3-bb54-1ff6079cea25 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:15.698018 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1318b957-092c-4ed3-bb54-1ff6079cea25 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:15.851623 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-60c2a764-7dbd-4c1a-bc2d-cb457969f1a4 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb" status: 204 len: 0 microversion: 2.1 time: 0.534324 Oct 23 01:25:15.855112 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1855/3736] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:25:15 2022] DELETE /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb => generated 0 bytes in 539 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 23 01:25:15.867175 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7eb1502d-a7ea-4bae-822d-57638b8631ee tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:15.867920 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7eb1502d-a7ea-4bae-822d-57638b8631ee tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: 8ce9f585-473f-4f8f-a5e6-7b83b7303ccb] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:15.876696 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7eb1502d-a7ea-4bae-822d-57638b8631ee tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:15.877543 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7eb1502d-a7ea-4bae-822d-57638b8631ee tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:15.883879 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7eb1502d-a7ea-4bae-822d-57638b8631ee tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:15.886455 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7eb1502d-a7ea-4bae-822d-57638b8631ee tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:15.887124 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7eb1502d-a7ea-4bae-822d-57638b8631ee tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:15.888754 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7eb1502d-a7ea-4bae-822d-57638b8631ee tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:16.156042 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1318b957-092c-4ed3-bb54-1ff6079cea25 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8a867611614ea585d510d62c63cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9f6afbdbf74318a98dfe455a72ac7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:16.171319 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7eb1502d-a7ea-4bae-822d-57638b8631ee tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60276a4031ee45ffa651b5467a62a81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a369d45e4804ffca2e89cb72f447a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:16.174034 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1318b957-092c-4ed3-bb54-1ff6079cea25 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "GET /compute/v2.1/servers/7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3" status: 200 len: 1646 microversion: 2.1 time: 0.520230 Oct 23 01:25:16.175385 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1882/3737] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:15 2022] GET /compute/v2.1/servers/7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3 => generated 1646 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:25:16.181924 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7eb1502d-a7ea-4bae-822d-57638b8631ee tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb" status: 200 len: 1682 microversion: 2.1 time: 0.322628 Oct 23 01:25:16.199110 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1856/3738] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:15 2022] GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb => generated 1682 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:25:16.388326 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2453d0ec-108f-44ed-85f1-fea25f86fe80 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b0c31d7-c097-43d2-85b1-b1596c0576e9"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:25:16.390804 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2453d0ec-108f-44ed-85f1-fea25f86fe80 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:16.408573 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2453d0ec-108f-44ed-85f1-fea25f86fe80 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:16.409119 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2453d0ec-108f-44ed-85f1-fea25f86fe80 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:16.409563 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2453d0ec-108f-44ed-85f1-fea25f86fe80 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:16.410759 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2453d0ec-108f-44ed-85f1-fea25f86fe80 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:16.411388 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2453d0ec-108f-44ed-85f1-fea25f86fe80 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:16.411986 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2453d0ec-108f-44ed-85f1-fea25f86fe80 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:17.211497 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d495bf8d-7129-40bb-9b3b-f32b1ed89e5e tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:17.212828 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d495bf8d-7129-40bb-9b3b-f32b1ed89e5e tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] [instance: 7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:17.231694 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d495bf8d-7129-40bb-9b3b-f32b1ed89e5e tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:17.235840 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d495bf8d-7129-40bb-9b3b-f32b1ed89e5e tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:17.237635 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d495bf8d-7129-40bb-9b3b-f32b1ed89e5e tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:17.239186 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d495bf8d-7129-40bb-9b3b-f32b1ed89e5e tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:17.240275 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d495bf8d-7129-40bb-9b3b-f32b1ed89e5e tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:17.242142 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d495bf8d-7129-40bb-9b3b-f32b1ed89e5e tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:17.285474 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:17.344698 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:17.533234 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2453d0ec-108f-44ed-85f1-fea25f86fe80 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "POST /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.148677 Oct 23 01:25:17.534724 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1883/3739] 10.222.0.42 () {60 vars in 1323 bytes} [Sun Oct 23 01:25:16 2022] POST /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4/os-volume_attachments => generated 194 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:25:17.548931 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-da813a9c-6e13-4cf8-afa2-c9801a79c46c tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:17.549879 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-da813a9c-6e13-4cf8-afa2-c9801a79c46c tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: 8ce9f585-473f-4f8f-a5e6-7b83b7303ccb] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:17.570927 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-da813a9c-6e13-4cf8-afa2-c9801a79c46c tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:17.571122 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-da813a9c-6e13-4cf8-afa2-c9801a79c46c tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:17.576730 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-da813a9c-6e13-4cf8-afa2-c9801a79c46c tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:17.577848 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-da813a9c-6e13-4cf8-afa2-c9801a79c46c tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:17.578844 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-da813a9c-6e13-4cf8-afa2-c9801a79c46c tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:17.581715 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-da813a9c-6e13-4cf8-afa2-c9801a79c46c tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:17.790045 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d495bf8d-7129-40bb-9b3b-f32b1ed89e5e tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8a867611614ea585d510d62c63cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9f6afbdbf74318a98dfe455a72ac7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:17.801389 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d495bf8d-7129-40bb-9b3b-f32b1ed89e5e tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "GET /compute/v2.1/servers/7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3" status: 200 len: 1646 microversion: 2.1 time: 0.602654 Oct 23 01:25:17.818006 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1857/3740] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:17 2022] GET /compute/v2.1/servers/7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3 => generated 1646 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:25:17.954346 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-da813a9c-6e13-4cf8-afa2-c9801a79c46c tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60276a4031ee45ffa651b5467a62a81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a369d45e4804ffca2e89cb72f447a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:17.965622 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-da813a9c-6e13-4cf8-afa2-c9801a79c46c tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb" status: 200 len: 1682 microversion: 2.1 time: 0.428839 Oct 23 01:25:17.967454 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1884/3741] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:17 2022] GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb => generated 1682 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:25:18.827726 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-42a3adcb-a34d-4986-93d1-a71df5f130ce tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:18.828352 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-42a3adcb-a34d-4986-93d1-a71df5f130ce tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] [instance: 7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:18.875980 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-42a3adcb-a34d-4986-93d1-a71df5f130ce tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:18.877411 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-42a3adcb-a34d-4986-93d1-a71df5f130ce tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:18.879673 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-42a3adcb-a34d-4986-93d1-a71df5f130ce tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:18.880936 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-42a3adcb-a34d-4986-93d1-a71df5f130ce tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:18.885130 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-42a3adcb-a34d-4986-93d1-a71df5f130ce tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:18.886269 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-42a3adcb-a34d-4986-93d1-a71df5f130ce tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:18.996513 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-70624cde-c851-40fa-9a09-253e7dc850d9 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:18.997699 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-70624cde-c851-40fa-9a09-253e7dc850d9 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: 8ce9f585-473f-4f8f-a5e6-7b83b7303ccb] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:19.014279 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-70624cde-c851-40fa-9a09-253e7dc850d9 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:19.021521 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-70624cde-c851-40fa-9a09-253e7dc850d9 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:19.031573 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-70624cde-c851-40fa-9a09-253e7dc850d9 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:19.031573 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-70624cde-c851-40fa-9a09-253e7dc850d9 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:19.031573 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-70624cde-c851-40fa-9a09-253e7dc850d9 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:19.031573 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-70624cde-c851-40fa-9a09-253e7dc850d9 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:19.541150 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-70624cde-c851-40fa-9a09-253e7dc850d9 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60276a4031ee45ffa651b5467a62a81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a369d45e4804ffca2e89cb72f447a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:19.561534 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-70624cde-c851-40fa-9a09-253e7dc850d9 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb" status: 200 len: 1682 microversion: 2.1 time: 0.565691 Oct 23 01:25:19.561534 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1885/3742] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:18 2022] GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb => generated 1682 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:25:19.564060 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-42a3adcb-a34d-4986-93d1-a71df5f130ce tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8a867611614ea585d510d62c63cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9f6afbdbf74318a98dfe455a72ac7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:19.572650 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-42a3adcb-a34d-4986-93d1-a71df5f130ce tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "GET /compute/v2.1/servers/7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3" status: 200 len: 1646 microversion: 2.1 time: 0.749276 Oct 23 01:25:19.578026 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1858/3743] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:18 2022] GET /compute/v2.1/servers/7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3 => generated 1646 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:25:20.181015 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-bb3a5575-76dd-4113-8e75-0718eecc8762 req-6aac54f8-9db0-433c-ae31-4d0e6e6a645d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3", "name": "network-vif-deleted", "tag": "8adc3934-5630-470e-a6f0-e96f18681270"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:25:20.195581 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-bb3a5575-76dd-4113-8e75-0718eecc8762 req-6aac54f8-9db0-433c-ae31-4d0e6e6a645d service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:20.196258 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-bb3a5575-76dd-4113-8e75-0718eecc8762 req-6aac54f8-9db0-433c-ae31-4d0e6e6a645d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:20.197134 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-bb3a5575-76dd-4113-8e75-0718eecc8762 req-6aac54f8-9db0-433c-ae31-4d0e6e6a645d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:20.209605 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-bb3a5575-76dd-4113-8e75-0718eecc8762 req-6aac54f8-9db0-433c-ae31-4d0e6e6a645d service nova] Creating event network-vif-deleted:8adc3934-5630-470e-a6f0-e96f18681270 for instance 7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3 on n-h1-master-1 Oct 23 01:25:20.215257 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-bb3a5575-76dd-4113-8e75-0718eecc8762 req-6aac54f8-9db0-433c-ae31-4d0e6e6a645d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038116 Oct 23 01:25:20.216583 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1886/3744] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:25:20.588006 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fa6e4ae1-2068-49fb-a40d-578b06028174 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:20.588774 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-fa6e4ae1-2068-49fb-a40d-578b06028174 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: 8ce9f585-473f-4f8f-a5e6-7b83b7303ccb] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:20.612996 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fa6e4ae1-2068-49fb-a40d-578b06028174 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:20.613518 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fa6e4ae1-2068-49fb-a40d-578b06028174 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:20.613992 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fa6e4ae1-2068-49fb-a40d-578b06028174 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:20.618945 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fa6e4ae1-2068-49fb-a40d-578b06028174 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:20.626296 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fa6e4ae1-2068-49fb-a40d-578b06028174 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:20.626296 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fa6e4ae1-2068-49fb-a40d-578b06028174 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:20.659842 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c0a6453c-21fb-40f0-be6b-3f449e7d8c49 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:20.673496 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c0a6453c-21fb-40f0-be6b-3f449e7d8c49 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] [instance: 7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:20.722623 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c0a6453c-21fb-40f0-be6b-3f449e7d8c49 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:20.739489 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c0a6453c-21fb-40f0-be6b-3f449e7d8c49 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:20.739789 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c0a6453c-21fb-40f0-be6b-3f449e7d8c49 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:20.746216 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c0a6453c-21fb-40f0-be6b-3f449e7d8c49 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:20.755167 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c0a6453c-21fb-40f0-be6b-3f449e7d8c49 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:20.761119 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c0a6453c-21fb-40f0-be6b-3f449e7d8c49 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:20.881302 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c0a6453c-21fb-40f0-be6b-3f449e7d8c49 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:20.884808 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c0a6453c-21fb-40f0-be6b-3f449e7d8c49 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:20.887556 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c0a6453c-21fb-40f0-be6b-3f449e7d8c49 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:20.888331 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-c0a6453c-21fb-40f0-be6b-3f449e7d8c49 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lazy-loading 'fault' on Instance uuid 7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:25:20.888826 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-fa6e4ae1-2068-49fb-a40d-578b06028174 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60276a4031ee45ffa651b5467a62a81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a369d45e4804ffca2e89cb72f447a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:20.907827 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fa6e4ae1-2068-49fb-a40d-578b06028174 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb" status: 200 len: 1614 microversion: 2.1 time: 0.329479 Oct 23 01:25:20.918485 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1859/3745] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:20 2022] GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb => generated 1614 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:25:21.079586 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c0a6453c-21fb-40f0-be6b-3f449e7d8c49 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8a867611614ea585d510d62c63cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9f6afbdbf74318a98dfe455a72ac7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:21.094947 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c0a6453c-21fb-40f0-be6b-3f449e7d8c49 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "GET /compute/v2.1/servers/7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3" status: 200 len: 1305 microversion: 2.1 time: 0.501172 Oct 23 01:25:21.106198 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1887/3746] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:20 2022] GET /compute/v2.1/servers/7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3 => generated 1305 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:25:21.944121 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b3df6862-98a9-4dfe-b5cb-5ac7356cb709 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:21.945495 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b3df6862-98a9-4dfe-b5cb-5ac7356cb709 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: 8ce9f585-473f-4f8f-a5e6-7b83b7303ccb] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:21.963997 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b3df6862-98a9-4dfe-b5cb-5ac7356cb709 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:21.964500 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b3df6862-98a9-4dfe-b5cb-5ac7356cb709 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:21.971655 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b3df6862-98a9-4dfe-b5cb-5ac7356cb709 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:21.971655 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b3df6862-98a9-4dfe-b5cb-5ac7356cb709 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:21.971655 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b3df6862-98a9-4dfe-b5cb-5ac7356cb709 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:21.971655 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b3df6862-98a9-4dfe-b5cb-5ac7356cb709 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:22.039496 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b3df6862-98a9-4dfe-b5cb-5ac7356cb709 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:22.040174 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b3df6862-98a9-4dfe-b5cb-5ac7356cb709 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:22.041813 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b3df6862-98a9-4dfe-b5cb-5ac7356cb709 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:22.042531 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-b3df6862-98a9-4dfe-b5cb-5ac7356cb709 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lazy-loading 'fault' on Instance uuid 8ce9f585-473f-4f8f-a5e6-7b83b7303ccb {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:25:22.128606 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ebc1896f-841a-4136-b2a3-15227a1b8500 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:22.130096 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ebc1896f-841a-4136-b2a3-15227a1b8500 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] [instance: 7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:22.135737 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b3df6862-98a9-4dfe-b5cb-5ac7356cb709 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60276a4031ee45ffa651b5467a62a81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a369d45e4804ffca2e89cb72f447a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:22.147962 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b3df6862-98a9-4dfe-b5cb-5ac7356cb709 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb" status: 200 len: 1330 microversion: 2.1 time: 0.209977 Oct 23 01:25:22.169712 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1860/3747] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:21 2022] GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb => generated 1330 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:25:22.179660 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ebc1896f-841a-4136-b2a3-15227a1b8500 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:22.180416 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ebc1896f-841a-4136-b2a3-15227a1b8500 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:22.182753 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ebc1896f-841a-4136-b2a3-15227a1b8500 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:22.183739 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ebc1896f-841a-4136-b2a3-15227a1b8500 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:22.185759 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ebc1896f-841a-4136-b2a3-15227a1b8500 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:22.187485 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ebc1896f-841a-4136-b2a3-15227a1b8500 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:22.252290 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-8557ce9a-293f-4496-83d8-5502dd8eb2e4 req-8a0942cd-7d92-41a7-a9de-4328c0df346c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ce9f585-473f-4f8f-a5e6-7b83b7303ccb", "name": "network-vif-deleted", "tag": "a158141a-72f3-48f2-91ac-ae7c2afce6d5"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:25:22.260741 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-ebc1896f-841a-4136-b2a3-15227a1b8500 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] HTTP exception thrown: Instance 7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3 could not be found. Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ebc1896f-841a-4136-b2a3-15227a1b8500 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Request method failure captured: Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3 HTTP/1.1 Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJe3mET0Sd7lZbPfIN3VkjmqiroRssL9JbOguxpn1sZ00E3M8viQBbgfQ2g7IyamsO6Vg1eRk3unJQGVa1SLVceO_jtTkwsvZ7R_UZpRIovLO2xYyroaQHuRt-8XjOXN_zV_7Obxi_ZE4mM221EAm7ZWkONLhuVRvJ2vR8Bciy4qSyo Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 8d9f6afbdbf74318a98dfe455a72ac7c Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-SecurityGroupsTestJSON-215153901 Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8d9f6afbdbf74318a98dfe455a72ac7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8d9f6afbdbf74318a98dfe455a72ac7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8d9f6afbdbf74318a98dfe455a72ac7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8d9f6afbdbf74318a98dfe455a72ac7c"}]}] Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-SecurityGroupsTestJSON-215153901 Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 8d9f6afbdbf74318a98dfe455a72ac7c Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-215153901 Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-SecurityGroupsTestJSON-215153901-project Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 2b8a867611614ea585d510d62c63cfa3 Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-SecurityGroupsTestJSON-215153901-project Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3 could not be found. Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3'} Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3 could not be found. Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3 could not be found. Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:25:22.270387 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:22.275839 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:22.275839 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:25:22.275839 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:25:22.275839 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:25:22.275839 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:25:22.275839 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3 could not be found. Oct 23 01:25:22.275839 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:22.276453 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-8557ce9a-293f-4496-83d8-5502dd8eb2e4 req-8a0942cd-7d92-41a7-a9de-4328c0df346c service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:22.276559 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ebc1896f-841a-4136-b2a3-15227a1b8500 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Returning 404 to user: Instance 7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:25:22.276666 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-8557ce9a-293f-4496-83d8-5502dd8eb2e4 req-8a0942cd-7d92-41a7-a9de-4328c0df346c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:22.276666 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-8557ce9a-293f-4496-83d8-5502dd8eb2e4 req-8a0942cd-7d92-41a7-a9de-4328c0df346c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:22.277348 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ebc1896f-841a-4136-b2a3-15227a1b8500 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "GET /compute/v2.1/servers/7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3" status: 404 len: 111 microversion: 2.1 time: 0.154461 Oct 23 01:25:22.278259 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1888/3748] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:22 2022] GET /compute/v2.1/servers/7b8c9eb0-fe9c-499b-be6f-cf1d1b9b9eb3 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:25:22.285917 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-8557ce9a-293f-4496-83d8-5502dd8eb2e4 req-8a0942cd-7d92-41a7-a9de-4328c0df346c service nova] Creating event network-vif-deleted:a158141a-72f3-48f2-91ac-ae7c2afce6d5 for instance 8ce9f585-473f-4f8f-a5e6-7b83b7303ccb on n-h1-master-1 Oct 23 01:25:22.292975 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-8557ce9a-293f-4496-83d8-5502dd8eb2e4 req-8a0942cd-7d92-41a7-a9de-4328c0df346c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046536 Oct 23 01:25:22.293937 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1861/3749] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:25:22.296772 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e61fca3b-0fda-4498-aace-e3f527b5114a tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '.version_select at 0x7f5cc10df310>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:22.738803 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e61fca3b-0fda-4498-aace-e3f527b5114a tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/d073eb11-172f-4946-a169-00b3d5acf473" status: 202 len: 0 microversion: 2.1 time: 0.450988 Oct 23 01:25:22.743731 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1889/3750] 10.222.0.42 () {58 vars in 1272 bytes} [Sun Oct 23 01:25:22 2022] DELETE /compute/v2.1/os-security-groups/d073eb11-172f-4946-a169-00b3d5acf473 => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:25:22.751028 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-94ad72c3-76e3-48fe-9882-52ee87551961 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] Calling method '.version_select at 0x7f5cc2266e50>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:23.104441 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-94ad72c3-76e3-48fe-9882-52ee87551961 tempest-SecurityGroupsTestJSON-215153901 tempest-SecurityGroupsTestJSON-215153901-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/49324941-cd8f-45b9-a833-d1d054b2127e" status: 202 len: 0 microversion: 2.1 time: 0.358907 Oct 23 01:25:23.107107 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1862/3751] 10.222.0.42 () {58 vars in 1272 bytes} [Sun Oct 23 01:25:22 2022] DELETE /compute/v2.1/os-security-groups/49324941-cd8f-45b9-a833-d1d054b2127e => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 23 01:25:23.179582 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-58c9a28e-eb46-4058-b6e5-f937e2a4b636 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:23.180745 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-58c9a28e-eb46-4058-b6e5-f937e2a4b636 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] [instance: 8ce9f585-473f-4f8f-a5e6-7b83b7303ccb] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:23.191193 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-58c9a28e-eb46-4058-b6e5-f937e2a4b636 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:23.191981 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-58c9a28e-eb46-4058-b6e5-f937e2a4b636 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:23.192728 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-58c9a28e-eb46-4058-b6e5-f937e2a4b636 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:23.195308 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-58c9a28e-eb46-4058-b6e5-f937e2a4b636 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:23.195776 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-58c9a28e-eb46-4058-b6e5-f937e2a4b636 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:23.196734 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-58c9a28e-eb46-4058-b6e5-f937e2a4b636 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:23.211781 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-58c9a28e-eb46-4058-b6e5-f937e2a4b636 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] HTTP exception thrown: Instance 8ce9f585-473f-4f8f-a5e6-7b83b7303ccb could not be found. Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-58c9a28e-eb46-4058-b6e5-f937e2a4b636 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Request method failure captured: Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb HTTP/1.1 Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJdQvIRclWGUu3yQGBJ9l3Cws_fBXVHOSevO8slTJcKTcmBGgTG6m1D1LwZoif8LD-xa9Ftz3dMh3SZfRfBwRy-ZT00BXJnYGoKmbhwfhEsYxk27cfpFHyX1eanOP3oxDKoebkii2PObCr8kr1nw2nvMhrHA9tMoVZkSYy5r9o_35MU Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 0a369d45e4804ffca2e89cb72f447a82 Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-VolumesAdminNegativeTest-1898841118 Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/0a369d45e4804ffca2e89cb72f447a82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_0a369d45e4804ffca2e89cb72f447a82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0a369d45e4804ffca2e89cb72f447a82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0a369d45e4804ffca2e89cb72f447a82"}]}] Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-VolumesAdminNegativeTest-1898841118 Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 0a369d45e4804ffca2e89cb72f447a82 Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1898841118 Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-VolumesAdminNegativeTest-1898841118-project Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 60276a4031ee45ffa651b5467a62a81b Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-VolumesAdminNegativeTest-1898841118-project Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 8ce9f585-473f-4f8f-a5e6-7b83b7303ccb could not be found. Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '8ce9f585-473f-4f8f-a5e6-7b83b7303ccb'} Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ce9f585-473f-4f8f-a5e6-7b83b7303ccb could not be found. Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ce9f585-473f-4f8f-a5e6-7b83b7303ccb could not be found. Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:25:23.213752 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:23.219030 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:23.219030 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:25:23.219030 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:25:23.219030 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:25:23.219030 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:25:23.219030 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ce9f585-473f-4f8f-a5e6-7b83b7303ccb could not be found. Oct 23 01:25:23.219030 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:23.219030 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-58c9a28e-eb46-4058-b6e5-f937e2a4b636 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Returning 404 to user: Instance 8ce9f585-473f-4f8f-a5e6-7b83b7303ccb could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:25:23.219681 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-58c9a28e-eb46-4058-b6e5-f937e2a4b636 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb" status: 404 len: 111 microversion: 2.1 time: 0.042039 Oct 23 01:25:23.222494 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1890/3752] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:23 2022] GET /compute/v2.1/servers/8ce9f585-473f-4f8f-a5e6-7b83b7303ccb => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:25:23.229152 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bd1e2dee-bf2c-4e74-af74-834980a41347 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] Calling method '.version_select at 0x7f5cc2430ee0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:23.358267 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bd1e2dee-bf2c-4e74-af74-834980a41347 tempest-VolumesAdminNegativeTest-1898841118 tempest-VolumesAdminNegativeTest-1898841118-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-620645861" status: 202 len: 0 microversion: 2.1 time: 0.132803 Oct 23 01:25:23.374690 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1863/3753] 10.222.0.42 () {58 vars in 1218 bytes} [Sun Oct 23 01:25:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-620645861 => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:25:31.284961 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1517b4ec-7233-4277-ad7b-e9456b376331 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:31.286059 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1517b4ec-7233-4277-ad7b-e9456b376331 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:31.295404 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1517b4ec-7233-4277-ad7b-e9456b376331 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:31.296436 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1517b4ec-7233-4277-ad7b-e9456b376331 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:31.297071 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1517b4ec-7233-4277-ad7b-e9456b376331 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:31.297985 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1517b4ec-7233-4277-ad7b-e9456b376331 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:31.298831 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1517b4ec-7233-4277-ad7b-e9456b376331 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:31.299266 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1517b4ec-7233-4277-ad7b-e9456b376331 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:32.124141 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-1517b4ec-7233-4277-ad7b-e9456b376331 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lazy-loading 'services' on Instance uuid c48a830d-d375-47f5-8c08-d721f856c8ca {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:25:32.346037 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4ec47bc6-7472-4d9b-a747-a8901675757e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:25:32.349471 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4ec47bc6-7472-4d9b-a747-a8901675757e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:32.396041 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=25 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:32.399987 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4ec47bc6-7472-4d9b-a747-a8901675757e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:32.400488 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4ec47bc6-7472-4d9b-a747-a8901675757e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:32.400934 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4ec47bc6-7472-4d9b-a747-a8901675757e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:32.401650 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4ec47bc6-7472-4d9b-a747-a8901675757e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:32.411066 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4ec47bc6-7472-4d9b-a747-a8901675757e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:32.414472 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4ec47bc6-7472-4d9b-a747-a8901675757e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:32.440034 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1517b4ec-7233-4277-ad7b-e9456b376331 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca/os-volume_attachments/26ea4b53-99ec-45cd-8bd2-688a14da82c0" status: 202 len: 0 microversion: 2.1 time: 1.161662 Oct 23 01:25:32.441627 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1891/3754] 10.222.0.42 () {58 vars in 1416 bytes} [Sun Oct 23 01:25:31 2022] DELETE /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca/os-volume_attachments/26ea4b53-99ec-45cd-8bd2-688a14da82c0 => generated 0 bytes in 1179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:25:32.526121 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-4ec47bc6-7472-4d9b-a747-a8901675757e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lazy-loading 'flavor' on Instance uuid 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:25:33.692378 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4ec47bc6-7472-4d9b-a747-a8901675757e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "POST /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4/action" status: 200 len: 32 microversion: 2.1 time: 1.352265 Oct 23 01:25:33.693402 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1864/3755] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:25:32 2022] POST /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4/action => generated 32 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 23 01:25:33.729411 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-38bca0ac-d6a5-4fc5-9133-aa810527da79 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:33.729411 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-38bca0ac-d6a5-4fc5-9133-aa810527da79 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:33.735373 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:33.748557 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-38bca0ac-d6a5-4fc5-9133-aa810527da79 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:33.750888 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-38bca0ac-d6a5-4fc5-9133-aa810527da79 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:33.751963 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-38bca0ac-d6a5-4fc5-9133-aa810527da79 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:33.755533 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-38bca0ac-d6a5-4fc5-9133-aa810527da79 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:33.757023 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-38bca0ac-d6a5-4fc5-9133-aa810527da79 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:33.758627 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-38bca0ac-d6a5-4fc5-9133-aa810527da79 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:34.386440 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-38bca0ac-d6a5-4fc5-9133-aa810527da79 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:34.413545 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-38bca0ac-d6a5-4fc5-9133-aa810527da79 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4" status: 200 len: 1735 microversion: 2.1 time: 0.705420 Oct 23 01:25:34.415120 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1892/3756] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:33 2022] GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4 => generated 1735 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:25:35.470013 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f705f5b1-9688-49c1-9c06-306003c30837 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:35.472484 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f705f5b1-9688-49c1-9c06-306003c30837 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:35.488634 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f705f5b1-9688-49c1-9c06-306003c30837 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:35.491224 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f705f5b1-9688-49c1-9c06-306003c30837 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:35.493286 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f705f5b1-9688-49c1-9c06-306003c30837 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:35.494371 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f705f5b1-9688-49c1-9c06-306003c30837 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:35.496862 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f705f5b1-9688-49c1-9c06-306003c30837 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:35.498768 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f705f5b1-9688-49c1-9c06-306003c30837 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:36.517665 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f705f5b1-9688-49c1-9c06-306003c30837 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:36.533444 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f705f5b1-9688-49c1-9c06-306003c30837 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4" status: 200 len: 1735 microversion: 2.1 time: 1.085031 Oct 23 01:25:36.551109 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1865/3757] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:35 2022] GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4 => generated 1735 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:25:37.504009 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ae6f03a7-a7c5-4655-8e3a-51fc40aaf6f4 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Action: 'create', calling method: .version_select at 0x7f5cc0f89040>, body: {"keypair": {"name": "tempest-keypair-690124222", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBvARQDC1NR7BIUy2o1vOL8xKymn1A8e0/DX+UPt15229KyRD5AbpXsO0gxDPKRxyBUWADQV47Ys8lFcPqfegSku4Ay5ZQIL8BGszuM98m9wcDoQhA6bW9KkgbNrHo0jQ=="}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:25:37.553025 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-ae6f03a7-a7c5-4655-8e3a-51fc40aaf6f4 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Getting quotas for project 4464938aec13451f910daa714d060e46. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:25:37.568567 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2a5c68a0-b161-4e40-8800-3392c90c0756 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:37.574649 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2a5c68a0-b161-4e40-8800-3392c90c0756 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:37.585520 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2a5c68a0-b161-4e40-8800-3392c90c0756 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:37.587582 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-ae6f03a7-a7c5-4655-8e3a-51fc40aaf6f4 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Getting quotas for user 1864708a7b2f4223bc8f0015c765eb0f and project 4464938aec13451f910daa714d060e46. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:25:37.588759 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2a5c68a0-b161-4e40-8800-3392c90c0756 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:37.592922 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2a5c68a0-b161-4e40-8800-3392c90c0756 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:37.596038 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2a5c68a0-b161-4e40-8800-3392c90c0756 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:37.597527 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2a5c68a0-b161-4e40-8800-3392c90c0756 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:37.600067 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2a5c68a0-b161-4e40-8800-3392c90c0756 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:37.741595 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ae6f03a7-a7c5-4655-8e3a-51fc40aaf6f4 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.545704 Oct 23 01:25:37.746630 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1893/3758] 10.222.0.42 () {62 vars in 1200 bytes} [Sun Oct 23 01:25:37 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 547 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 23 01:25:38.003642 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2a5c68a0-b161-4e40-8800-3392c90c0756 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:38.014252 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2a5c68a0-b161-4e40-8800-3392c90c0756 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4" status: 200 len: 1735 microversion: 2.1 time: 0.454838 Oct 23 01:25:38.016643 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1866/3759] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:37 2022] GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4 => generated 1735 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:25:39.043035 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9db0e939-f013-4a67-92b8-4c544d9f0742 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:39.043856 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9db0e939-f013-4a67-92b8-4c544d9f0742 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:39.058566 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9db0e939-f013-4a67-92b8-4c544d9f0742 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:39.068155 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9db0e939-f013-4a67-92b8-4c544d9f0742 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:39.068962 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9db0e939-f013-4a67-92b8-4c544d9f0742 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:39.070005 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9db0e939-f013-4a67-92b8-4c544d9f0742 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:39.074075 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9db0e939-f013-4a67-92b8-4c544d9f0742 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:39.074639 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9db0e939-f013-4a67-92b8-4c544d9f0742 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:40.021659 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9db0e939-f013-4a67-92b8-4c544d9f0742 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:40.032087 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9db0e939-f013-4a67-92b8-4c544d9f0742 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4" status: 200 len: 1735 microversion: 2.1 time: 0.994297 Oct 23 01:25:40.034307 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1894/3760] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:39 2022] GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4 => generated 1735 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:25:41.061125 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b1f3d1a2-8f0d-4650-9692-a12a4804a352 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:41.065775 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b1f3d1a2-8f0d-4650-9692-a12a4804a352 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:41.077031 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1f3d1a2-8f0d-4650-9692-a12a4804a352 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:41.078379 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1f3d1a2-8f0d-4650-9692-a12a4804a352 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:41.078837 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1f3d1a2-8f0d-4650-9692-a12a4804a352 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:41.079600 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1f3d1a2-8f0d-4650-9692-a12a4804a352 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:41.080063 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1f3d1a2-8f0d-4650-9692-a12a4804a352 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:41.080501 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1f3d1a2-8f0d-4650-9692-a12a4804a352 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:42.517677 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b1f3d1a2-8f0d-4650-9692-a12a4804a352 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:42.537691 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b1f3d1a2-8f0d-4650-9692-a12a4804a352 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4" status: 200 len: 1735 microversion: 2.1 time: 1.480400 Oct 23 01:25:42.550012 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1867/3761] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:41 2022] GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4 => generated 1735 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:25:42.747988 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-00d0487d-3d45-4f75-aac4-ce3f83bef661 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:25:42.758371 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-00d0487d-3d45-4f75-aac4-ce3f83bef661 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:42.758989 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-00d0487d-3d45-4f75-aac4-ce3f83bef661 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:42.761026 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-00d0487d-3d45-4f75-aac4-ce3f83bef661 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:42.814335 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-00d0487d-3d45-4f75-aac4-ce3f83bef661 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Going to try to stop instance {{(pid=120944) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 23 01:25:43.029157 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-00d0487d-3d45-4f75-aac4-ce3f83bef661 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "POST /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca/action" status: 202 len: 0 microversion: 2.1 time: 0.284156 Oct 23 01:25:43.032010 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1895/3762] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:25:42 2022] POST /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:25:43.055489 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fbee96f4-7a76-4619-9777-f23cdd624540 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:43.057013 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-fbee96f4-7a76-4619-9777-f23cdd624540 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:43.070397 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fbee96f4-7a76-4619-9777-f23cdd624540 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:43.073214 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fbee96f4-7a76-4619-9777-f23cdd624540 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:43.075055 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fbee96f4-7a76-4619-9777-f23cdd624540 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:43.077241 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fbee96f4-7a76-4619-9777-f23cdd624540 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:43.078051 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fbee96f4-7a76-4619-9777-f23cdd624540 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:43.078891 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fbee96f4-7a76-4619-9777-f23cdd624540 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:43.422498 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-fbee96f4-7a76-4619-9777-f23cdd624540 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:43.452670 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fbee96f4-7a76-4619-9777-f23cdd624540 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1679 microversion: 2.1 time: 0.416224 Oct 23 01:25:43.470097 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1868/3763] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:43 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1679 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:25:43.569829 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dbfc32ba-e902-4332-8254-2aad5e234adf tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:43.570755 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-dbfc32ba-e902-4332-8254-2aad5e234adf tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:43.586171 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dbfc32ba-e902-4332-8254-2aad5e234adf tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:43.588945 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dbfc32ba-e902-4332-8254-2aad5e234adf tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:43.590774 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dbfc32ba-e902-4332-8254-2aad5e234adf tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:43.592988 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dbfc32ba-e902-4332-8254-2aad5e234adf tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:43.593546 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dbfc32ba-e902-4332-8254-2aad5e234adf tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:43.596599 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dbfc32ba-e902-4332-8254-2aad5e234adf tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:44.258338 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-dbfc32ba-e902-4332-8254-2aad5e234adf tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:44.271257 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-dbfc32ba-e902-4332-8254-2aad5e234adf tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4" status: 200 len: 1735 microversion: 2.1 time: 0.705639 Oct 23 01:25:44.272451 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1896/3764] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:43 2022] GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4 => generated 1735 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:25:44.477548 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-568fa4b2-ad53-440e-9405-568f06a28996 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:44.479446 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-568fa4b2-ad53-440e-9405-568f06a28996 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:44.503954 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-568fa4b2-ad53-440e-9405-568f06a28996 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:44.504201 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-568fa4b2-ad53-440e-9405-568f06a28996 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:44.506961 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-568fa4b2-ad53-440e-9405-568f06a28996 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:44.510719 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-568fa4b2-ad53-440e-9405-568f06a28996 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:44.511656 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-568fa4b2-ad53-440e-9405-568f06a28996 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:44.512132 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-568fa4b2-ad53-440e-9405-568f06a28996 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:45.132479 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-568fa4b2-ad53-440e-9405-568f06a28996 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:45.155961 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-568fa4b2-ad53-440e-9405-568f06a28996 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1679 microversion: 2.1 time: 0.682521 Oct 23 01:25:45.164639 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1869/3765] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:44 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1679 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:25:45.173017 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1a640131-fc50-4fdb-9d76-46f8098c78c8 tempest-FloatingIPDetailsTestJSON-945854673 tempest-FloatingIPDetailsTestJSON-945854673-project] Action: 'create', calling method: .version_select at 0x7f5cc0fba550>, body: {"pool": null} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:25:45.306256 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-74a45669-5f57-4c83-a320-e53e88801edc tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:45.307161 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-74a45669-5f57-4c83-a320-e53e88801edc tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:45.321421 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-74a45669-5f57-4c83-a320-e53e88801edc tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:45.324166 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-74a45669-5f57-4c83-a320-e53e88801edc tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:45.325680 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-74a45669-5f57-4c83-a320-e53e88801edc tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:45.326753 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-74a45669-5f57-4c83-a320-e53e88801edc tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:45.330108 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-74a45669-5f57-4c83-a320-e53e88801edc tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:45.330806 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-74a45669-5f57-4c83-a320-e53e88801edc tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:45.909240 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-74a45669-5f57-4c83-a320-e53e88801edc tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:45.924897 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-74a45669-5f57-4c83-a320-e53e88801edc tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4" status: 200 len: 1735 microversion: 2.1 time: 0.630147 Oct 23 01:25:45.928045 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1870/3766] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:45 2022] GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4 => generated 1735 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:25:46.186664 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1c77e5d3-5879-423d-9265-d64d0036b562 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:46.187378 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1c77e5d3-5879-423d-9265-d64d0036b562 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:46.200371 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c77e5d3-5879-423d-9265-d64d0036b562 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:46.200961 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c77e5d3-5879-423d-9265-d64d0036b562 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:46.201481 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c77e5d3-5879-423d-9265-d64d0036b562 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:46.202272 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c77e5d3-5879-423d-9265-d64d0036b562 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:46.202793 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c77e5d3-5879-423d-9265-d64d0036b562 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:46.203584 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c77e5d3-5879-423d-9265-d64d0036b562 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:47.159188 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1c77e5d3-5879-423d-9265-d64d0036b562 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:47.171449 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1c77e5d3-5879-423d-9265-d64d0036b562 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1679 microversion: 2.1 time: 0.988944 Oct 23 01:25:47.177349 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1871/3767] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:46 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1679 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:25:47.183014 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7bc1b1be-9518-45d8-bd43-009d15b46270 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-696579535", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a8d88ca8-59e1-4c08-ac51-8d1481c432f4"}], "security_groups": [{"name": "tempest-securitygroup--1652988635"}], "key_name": "tempest-keypair-690124222", "user_data": "}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:25:47.618193 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=4 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:47.788138 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-7bc1b1be-9518-45d8-bd43-009d15b46270 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] validate_networks() for [('a8d88ca8-59e1-4c08-ac51-8d1481c432f4', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:25:49.252614 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-7bc1b1be-9518-45d8-bd43-009d15b46270 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:25:49.253164 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-7bc1b1be-9518-45d8-bd43-009d15b46270 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:25:49.253541 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-7bc1b1be-9518-45d8-bd43-009d15b46270 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:25:49.253956 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-7bc1b1be-9518-45d8-bd43-009d15b46270 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:25:49.254533 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-7bc1b1be-9518-45d8-bd43-009d15b46270 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:25:49.256843 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:49.265063 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7bc1b1be-9518-45d8-bd43-009d15b46270 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:49.265816 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7bc1b1be-9518-45d8-bd43-009d15b46270 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:49.266540 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7bc1b1be-9518-45d8-bd43-009d15b46270 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:49.267467 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7bc1b1be-9518-45d8-bd43-009d15b46270 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:49.268136 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7bc1b1be-9518-45d8-bd43-009d15b46270 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:49.268746 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7bc1b1be-9518-45d8-bd43-009d15b46270 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:49.289323 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-7bc1b1be-9518-45d8-bd43-009d15b46270 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Getting quotas for project 4464938aec13451f910daa714d060e46. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:25:49.295003 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-7bc1b1be-9518-45d8-bd43-009d15b46270 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Getting quotas for user 1864708a7b2f4223bc8f0015c765eb0f and project 4464938aec13451f910daa714d060e46. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:25:49.310588 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7bc1b1be-9518-45d8-bd43-009d15b46270 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:25:49.313537 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7bc1b1be-9518-45d8-bd43-009d15b46270 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:25:49.528703 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7bc1b1be-9518-45d8-bd43-009d15b46270 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.350151 Oct 23 01:25:49.529678 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1872/3768] 10.222.0.42 () {62 vars in 1188 bytes} [Sun Oct 23 01:25:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 2352 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 23 01:25:49.543921 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-028a25ca-b2e5-4af4-94f8-27d2ffade2cc tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:49.544818 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-028a25ca-b2e5-4af4-94f8-27d2ffade2cc tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:49.555633 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-028a25ca-b2e5-4af4-94f8-27d2ffade2cc tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:49.556446 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-028a25ca-b2e5-4af4-94f8-27d2ffade2cc tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:49.557220 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-028a25ca-b2e5-4af4-94f8-27d2ffade2cc tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:49.561726 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-028a25ca-b2e5-4af4-94f8-27d2ffade2cc tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:49.561726 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-028a25ca-b2e5-4af4-94f8-27d2ffade2cc tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:49.561726 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-028a25ca-b2e5-4af4-94f8-27d2ffade2cc tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:50.012682 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-028a25ca-b2e5-4af4-94f8-27d2ffade2cc tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:50.033329 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-028a25ca-b2e5-4af4-94f8-27d2ffade2cc tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4" status: 200 len: 1715 microversion: 2.1 time: 0.491724 Oct 23 01:25:50.034340 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1873/3769] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:49 2022] GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4 => generated 1715 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:25:50.080924 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-01fb5b0f-6fca-4fbf-a185-b626d6796f0d tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:50.083968 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-01fb5b0f-6fca-4fbf-a185-b626d6796f0d tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:50.097007 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-01fb5b0f-6fca-4fbf-a185-b626d6796f0d tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:50.097522 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-01fb5b0f-6fca-4fbf-a185-b626d6796f0d tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:50.097954 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-01fb5b0f-6fca-4fbf-a185-b626d6796f0d tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:50.103510 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-01fb5b0f-6fca-4fbf-a185-b626d6796f0d tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:50.106153 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-01fb5b0f-6fca-4fbf-a185-b626d6796f0d tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:50.110721 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-01fb5b0f-6fca-4fbf-a185-b626d6796f0d tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:50.480319 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1a640131-fc50-4fdb-9d76-46f8098c78c8 tempest-FloatingIPDetailsTestJSON-945854673 tempest-FloatingIPDetailsTestJSON-945854673-project] 10.222.0.42 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.518139 Oct 23 01:25:50.481702 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1897/3770] 10.222.0.42 () {60 vars in 1170 bytes} [Sun Oct 23 01:25:44 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:25:50.487353 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-97e79f79-ce53-4d82-866e-4afd2349ee4a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:50.488155 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-97e79f79-ce53-4d82-866e-4afd2349ee4a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:50.588341 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-97e79f79-ce53-4d82-866e-4afd2349ee4a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:50.597856 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-97e79f79-ce53-4d82-866e-4afd2349ee4a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:50.603732 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-97e79f79-ce53-4d82-866e-4afd2349ee4a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:50.610622 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-97e79f79-ce53-4d82-866e-4afd2349ee4a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1280 microversion: 2.20 time: 0.127668 Oct 23 01:25:50.611493 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1898/3771] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:25:50 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1280 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:25:50.616384 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-052f3fca-621a-4d4c-b92e-bafa4f06d251 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:50.616877 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-052f3fca-621a-4d4c-b92e-bafa4f06d251 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:50.627544 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-01fb5b0f-6fca-4fbf-a185-b626d6796f0d tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:50.641299 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-052f3fca-621a-4d4c-b92e-bafa4f06d251 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:50.642780 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-052f3fca-621a-4d4c-b92e-bafa4f06d251 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:50.643142 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-01fb5b0f-6fca-4fbf-a185-b626d6796f0d tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1679 microversion: 2.1 time: 0.594992 Oct 23 01:25:50.643961 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1874/3772] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:50 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1679 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:25:50.644451 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-052f3fca-621a-4d4c-b92e-bafa4f06d251 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:50.647198 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-052f3fca-621a-4d4c-b92e-bafa4f06d251 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:50.647644 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-052f3fca-621a-4d4c-b92e-bafa4f06d251 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:50.648305 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-052f3fca-621a-4d4c-b92e-bafa4f06d251 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:50.661142 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=65,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:50.675131 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7ca9fbff-d97c-45a8-81ec-fb6605574dbb tempest-FloatingIPDetailsTestJSON-945854673 tempest-FloatingIPDetailsTestJSON-945854673-project] Action: 'create', calling method: .version_select at 0x7f5cc23bb310>, body: {"pool": null} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:25:50.825174 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-052f3fca-621a-4d4c-b92e-bafa4f06d251 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] HTTP exception thrown: Cannot 'detach_volume' instance 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4 while it is in vm_state rescued Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-052f3fca-621a-4d4c-b92e-bafa4f06d251 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Request method failure captured: Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4/os-volume_attachments/6b0c31d7-c097-43d2-85b1-b1596c0576e9 HTTP/1.1 Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJdQk8hX6uPg4qHO6qc2mwusfqzM5L9E46F0sE_pC33qOsFxuj7jBx97KQnGjJpiMRyi7Ccd4qVZLYee5QWMbRFkTPXMBEfS5K72Bw65O1CzepVHWqpUTGTMXTiFqb2LFyp2Lx0G54EC4LTSr0BIWkU_QP9JqR2fGUhTDQevTmiXx40 Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 4c25b4509ad7457bad4a2e5e0bc59add Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1648319695 Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4c25b4509ad7457bad4a2e5e0bc59add"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4c25b4509ad7457bad4a2e5e0bc59add"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4c25b4509ad7457bad4a2e5e0bc59add"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4c25b4509ad7457bad4a2e5e0bc59add"}]}] Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1648319695 Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 4c25b4509ad7457bad4a2e5e0bc59add Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1648319695 Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServerRescueNegativeTestJSON-1648319695-project Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 19bff9f7a4254110b3b89f0cba5d252f Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1648319695-project Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: exception: Cannot 'detach_volume' instance 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4 while it is in vm_state rescued Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: action_args: {'server_id': '38daa540-d4d0-4644-8ed5-a1f6a4fea4e4', 'id': '6b0c31d7-c097-43d2-85b1-b1596c0576e9'} Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4 while it is in vm_state rescued Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:50.826850 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:25:50.834406 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:25:50.834406 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:25:50.834406 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:25:50.834406 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:25:50.834406 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4 while it is in vm_state rescued Oct 23 01:25:50.834406 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:25:50.834406 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-052f3fca-621a-4d4c-b92e-bafa4f06d251 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Returning 409 to user: Cannot 'detach_volume' instance 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4 while it is in vm_state rescued {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:25:50.835459 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-052f3fca-621a-4d4c-b92e-bafa4f06d251 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "DELETE /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4/os-volume_attachments/6b0c31d7-c097-43d2-85b1-b1596c0576e9" status: 409 len: 152 microversion: 2.1 time: 0.222285 Oct 23 01:25:50.835564 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1899/3773] 10.222.0.42 () {58 vars in 1416 bytes} [Sun Oct 23 01:25:50 2022] DELETE /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4/os-volume_attachments/6b0c31d7-c097-43d2-85b1-b1596c0576e9 => generated 152 bytes in 223 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:25:50.844582 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bf14b070-df32-4f5c-bf47-3a0f2337465e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:25:50.845177 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bf14b070-df32-4f5c-bf47-3a0f2337465e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:50.860525 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf14b070-df32-4f5c-bf47-3a0f2337465e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:50.860525 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf14b070-df32-4f5c-bf47-3a0f2337465e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:50.860525 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf14b070-df32-4f5c-bf47-3a0f2337465e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:50.860525 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf14b070-df32-4f5c-bf47-3a0f2337465e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:50.860525 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf14b070-df32-4f5c-bf47-3a0f2337465e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:50.860525 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf14b070-df32-4f5c-bf47-3a0f2337465e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:51.189906 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bf14b070-df32-4f5c-bf47-3a0f2337465e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "POST /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4/action" status: 202 len: 0 microversion: 2.1 time: 0.347627 Oct 23 01:25:51.193773 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1900/3774] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:25:50 2022] POST /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4/action => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:25:51.492487 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9b4da6e9-4fec-4aed-9a92-428cb2ebd0e7 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-2085961484", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:25:51.627713 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-9b4da6e9-4fec-4aed-9a92-428cb2ebd0e7 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] validate_networks() for None {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:25:52.549938 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-9b4da6e9-4fec-4aed-9a92-428cb2ebd0e7 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:25:52.550667 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-9b4da6e9-4fec-4aed-9a92-428cb2ebd0e7 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:25:52.551281 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-9b4da6e9-4fec-4aed-9a92-428cb2ebd0e7 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:25:52.552018 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-9b4da6e9-4fec-4aed-9a92-428cb2ebd0e7 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:25:52.552716 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-9b4da6e9-4fec-4aed-9a92-428cb2ebd0e7 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:25:52.567714 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9b4da6e9-4fec-4aed-9a92-428cb2ebd0e7 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:52.568476 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9b4da6e9-4fec-4aed-9a92-428cb2ebd0e7 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:52.569083 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9b4da6e9-4fec-4aed-9a92-428cb2ebd0e7 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:52.570061 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9b4da6e9-4fec-4aed-9a92-428cb2ebd0e7 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:52.570708 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9b4da6e9-4fec-4aed-9a92-428cb2ebd0e7 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:52.571495 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9b4da6e9-4fec-4aed-9a92-428cb2ebd0e7 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:52.596968 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-9b4da6e9-4fec-4aed-9a92-428cb2ebd0e7 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Getting quotas for project badf117bb5bf4e76b3bab3ef518dce11. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:25:52.605016 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-9b4da6e9-4fec-4aed-9a92-428cb2ebd0e7 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Getting quotas for user c1fb3cadf09d4d5da19e37b0080a0f26 and project badf117bb5bf4e76b3bab3ef518dce11. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:25:52.622726 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9b4da6e9-4fec-4aed-9a92-428cb2ebd0e7 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:25:52.625249 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9b4da6e9-4fec-4aed-9a92-428cb2ebd0e7 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] [instance: ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:25:52.746811 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9b4da6e9-4fec-4aed-9a92-428cb2ebd0e7 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.551595 Oct 23 01:25:52.748128 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1901/3775] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:25:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1554 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:25:52.760589 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e65a6b17-f396-4945-baf3-5654d0a81aa9 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:52.761717 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e65a6b17-f396-4945-baf3-5654d0a81aa9 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:52.772323 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e65a6b17-f396-4945-baf3-5654d0a81aa9 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:52.774780 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e65a6b17-f396-4945-baf3-5654d0a81aa9 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:52.774780 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e65a6b17-f396-4945-baf3-5654d0a81aa9 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:52.774780 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e65a6b17-f396-4945-baf3-5654d0a81aa9 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:52.775651 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e65a6b17-f396-4945-baf3-5654d0a81aa9 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:52.777300 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e65a6b17-f396-4945-baf3-5654d0a81aa9 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:53.199924 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e65a6b17-f396-4945-baf3-5654d0a81aa9 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:53.213284 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e65a6b17-f396-4945-baf3-5654d0a81aa9 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4" status: 200 len: 1723 microversion: 2.1 time: 0.463856 Oct 23 01:25:53.214335 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1902/3776] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:52 2022] GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4 => generated 1723 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:25:53.332166 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b7d1c29b-d3d8-49bf-83df-aa1e8b380455 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Action: 'create', calling method: .version_select at 0x7f5cc10e3f70>, body: {"keypair": {"name": "tempest-keypair-744068114", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDCG/mTFAqzwKebOFQcxCNNrsRtVxoCRwp24mdLASoT5mnHGHTy0sUu+4aQ6R6kHpQQNwEJHL62az1H0hKI6UP7Ovm8U4TMDlXXdeXv2b8EXaoLywhUnDP3cUYZPQAYsNg=="}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:25:53.349604 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-b7d1c29b-d3d8-49bf-83df-aa1e8b380455 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Getting quotas for project a3bb23cbc0c142a2a4b7a39df99a7d4a. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:25:53.355769 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-b7d1c29b-d3d8-49bf-83df-aa1e8b380455 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Getting quotas for user fbb8ce5c15bd4a6199cfdf84c49837ef and project a3bb23cbc0c142a2a4b7a39df99a7d4a. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:25:53.479060 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b7d1c29b-d3d8-49bf-83df-aa1e8b380455 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.263474 Oct 23 01:25:53.480272 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1903/3777] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 01:25:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:25:53.510553 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f03c5b6b-b6f8-4d1b-b662-430f5ccaf865 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:53.512149 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f03c5b6b-b6f8-4d1b-b662-430f5ccaf865 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:53.528853 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f03c5b6b-b6f8-4d1b-b662-430f5ccaf865 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:53.531796 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f03c5b6b-b6f8-4d1b-b662-430f5ccaf865 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:53.532586 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f03c5b6b-b6f8-4d1b-b662-430f5ccaf865 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:53.535524 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f03c5b6b-b6f8-4d1b-b662-430f5ccaf865 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:53.536584 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f03c5b6b-b6f8-4d1b-b662-430f5ccaf865 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:53.537835 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f03c5b6b-b6f8-4d1b-b662-430f5ccaf865 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:53.758451 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f03c5b6b-b6f8-4d1b-b662-430f5ccaf865 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:53.771747 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f03c5b6b-b6f8-4d1b-b662-430f5ccaf865 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:53.774214 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f03c5b6b-b6f8-4d1b-b662-430f5ccaf865 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:53.775402 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f03c5b6b-b6f8-4d1b-b662-430f5ccaf865 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1350 microversion: 2.20 time: 0.293450 Oct 23 01:25:53.775976 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1904/3778] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:25:53 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1350 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:25:53.780550 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c1df7ead-b438-4c85-9df1-91310e534a7e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:53.786994 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c1df7ead-b438-4c85-9df1-91310e534a7e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:53.811117 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c1df7ead-b438-4c85-9df1-91310e534a7e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:53.811926 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c1df7ead-b438-4c85-9df1-91310e534a7e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:53.812541 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c1df7ead-b438-4c85-9df1-91310e534a7e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:53.814012 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c1df7ead-b438-4c85-9df1-91310e534a7e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:53.814452 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c1df7ead-b438-4c85-9df1-91310e534a7e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:53.814879 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c1df7ead-b438-4c85-9df1-91310e534a7e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:54.245931 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c1df7ead-b438-4c85-9df1-91310e534a7e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:54.258910 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c1df7ead-b438-4c85-9df1-91310e534a7e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1679 microversion: 2.1 time: 0.481862 Oct 23 01:25:54.259528 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1905/3779] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:53 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1679 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:25:54.268036 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d61c6e3e-171c-4f44-9298-06ab6da6c30d tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:54.268789 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d61c6e3e-171c-4f44-9298-06ab6da6c30d tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] [instance: ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:54.346287 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d61c6e3e-171c-4f44-9298-06ab6da6c30d tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1fb3cadf09d4d5da19e37b0080a0f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf117bb5bf4e76b3bab3ef518dce11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:54.356003 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d61c6e3e-171c-4f44-9298-06ab6da6c30d tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/servers/ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d" status: 200 len: 1217 microversion: 2.1 time: 0.095107 Oct 23 01:25:54.356931 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1906/3780] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:54 2022] GET /compute/v2.1/servers/ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d => generated 1217 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:25:54.364962 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b663da24-07dd-4591-ad6e-152a95924395 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:54.365941 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b663da24-07dd-4591-ad6e-152a95924395 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:54.374140 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b663da24-07dd-4591-ad6e-152a95924395 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:54.375117 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b663da24-07dd-4591-ad6e-152a95924395 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:54.375852 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b663da24-07dd-4591-ad6e-152a95924395 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:54.376781 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b663da24-07dd-4591-ad6e-152a95924395 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:54.377475 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b663da24-07dd-4591-ad6e-152a95924395 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:54.378614 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b663da24-07dd-4591-ad6e-152a95924395 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:54.747305 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b663da24-07dd-4591-ad6e-152a95924395 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:54.758486 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b663da24-07dd-4591-ad6e-152a95924395 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4" status: 200 len: 1723 microversion: 2.1 time: 0.399668 Oct 23 01:25:54.759465 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1907/3781] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:54 2022] GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4 => generated 1723 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:25:54.804238 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d444ef7d-db7b-4e8b-bd0e-0dd8e3154e6f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:54.805126 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d444ef7d-db7b-4e8b-bd0e-0dd8e3154e6f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:54.811649 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d444ef7d-db7b-4e8b-bd0e-0dd8e3154e6f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:54.812386 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d444ef7d-db7b-4e8b-bd0e-0dd8e3154e6f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:54.813075 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d444ef7d-db7b-4e8b-bd0e-0dd8e3154e6f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:54.813771 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d444ef7d-db7b-4e8b-bd0e-0dd8e3154e6f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:54.814336 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d444ef7d-db7b-4e8b-bd0e-0dd8e3154e6f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:54.814789 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d444ef7d-db7b-4e8b-bd0e-0dd8e3154e6f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:55.181353 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7ca9fbff-d97c-45a8-81ec-fb6605574dbb tempest-FloatingIPDetailsTestJSON-945854673 tempest-FloatingIPDetailsTestJSON-945854673-project] 10.222.0.42 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.533381 Oct 23 01:25:55.183189 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1875/3782] 10.222.0.42 () {60 vars in 1170 bytes} [Sun Oct 23 01:25:50 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:25:55.197853 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d444ef7d-db7b-4e8b-bd0e-0dd8e3154e6f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:55.200356 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a3aa6a86-f3bf-48a3-8362-5de7d042c768 tempest-FloatingIPDetailsTestJSON-945854673 tempest-FloatingIPDetailsTestJSON-945854673-project] Action: 'create', calling method: .version_select at 0x7f5cc62c4dc0>, body: {"pool": null} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:25:55.207857 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d444ef7d-db7b-4e8b-bd0e-0dd8e3154e6f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:55.223096 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d444ef7d-db7b-4e8b-bd0e-0dd8e3154e6f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:55.224314 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d444ef7d-db7b-4e8b-bd0e-0dd8e3154e6f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1406 microversion: 2.20 time: 0.424309 Oct 23 01:25:55.225214 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1908/3783] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:25:54 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1406 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:25:55.284212 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3664d214-dfa5-4fd0-8cb1-1e44145e08fb tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:55.284836 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3664d214-dfa5-4fd0-8cb1-1e44145e08fb tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:55.291048 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3664d214-dfa5-4fd0-8cb1-1e44145e08fb tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:55.291550 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3664d214-dfa5-4fd0-8cb1-1e44145e08fb tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:55.291986 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3664d214-dfa5-4fd0-8cb1-1e44145e08fb tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:55.298994 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3664d214-dfa5-4fd0-8cb1-1e44145e08fb tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:55.299583 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3664d214-dfa5-4fd0-8cb1-1e44145e08fb tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:55.300041 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3664d214-dfa5-4fd0-8cb1-1e44145e08fb tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:55.752749 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3664d214-dfa5-4fd0-8cb1-1e44145e08fb tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:55.764058 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3664d214-dfa5-4fd0-8cb1-1e44145e08fb tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1656 microversion: 2.1 time: 0.484168 Oct 23 01:25:55.766841 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1909/3784] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:55 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1656 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:25:55.772189 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c2d788b2-74da-4a58-a1c3-ea2571a3c010 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:55.773413 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c2d788b2-74da-4a58-a1c3-ea2571a3c010 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] [instance: ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:55.794823 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2d788b2-74da-4a58-a1c3-ea2571a3c010 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:55.794823 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2d788b2-74da-4a58-a1c3-ea2571a3c010 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:55.794823 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2d788b2-74da-4a58-a1c3-ea2571a3c010 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:55.795955 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2d788b2-74da-4a58-a1c3-ea2571a3c010 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:55.796576 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2d788b2-74da-4a58-a1c3-ea2571a3c010 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:55.797170 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2d788b2-74da-4a58-a1c3-ea2571a3c010 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:55.946036 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c2d788b2-74da-4a58-a1c3-ea2571a3c010 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1fb3cadf09d4d5da19e37b0080a0f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf117bb5bf4e76b3bab3ef518dce11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:55.957222 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c2d788b2-74da-4a58-a1c3-ea2571a3c010 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/servers/ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d" status: 200 len: 1269 microversion: 2.1 time: 0.189188 Oct 23 01:25:55.977749 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1910/3785] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:55 2022] GET /compute/v2.1/servers/ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d => generated 1269 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:25:55.984523 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f1804e00-8ebf-4bdc-8d43-f45d520694d3 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:55.986092 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f1804e00-8ebf-4bdc-8d43-f45d520694d3 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:55.992786 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1804e00-8ebf-4bdc-8d43-f45d520694d3 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:55.993553 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1804e00-8ebf-4bdc-8d43-f45d520694d3 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:55.994026 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1804e00-8ebf-4bdc-8d43-f45d520694d3 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:55.994754 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1804e00-8ebf-4bdc-8d43-f45d520694d3 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:55.995219 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1804e00-8ebf-4bdc-8d43-f45d520694d3 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:55.995659 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1804e00-8ebf-4bdc-8d43-f45d520694d3 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:56.362624 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f1804e00-8ebf-4bdc-8d43-f45d520694d3 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:56.373240 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f1804e00-8ebf-4bdc-8d43-f45d520694d3 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4" status: 200 len: 1729 microversion: 2.1 time: 0.393945 Oct 23 01:25:56.388570 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1911/3786] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:55 2022] GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4 => generated 1729 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:25:56.388570 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9c64719e-97b2-4c0f-8c08-0f3475af5fc6 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:25:56.393750 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9c64719e-97b2-4c0f-8c08-0f3475af5fc6 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:56.395009 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9c64719e-97b2-4c0f-8c08-0f3475af5fc6 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:56.395647 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9c64719e-97b2-4c0f-8c08-0f3475af5fc6 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:56.438417 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9c64719e-97b2-4c0f-8c08-0f3475af5fc6 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Going to try to start instance {{(pid=120944) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 23 01:25:56.685690 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9c64719e-97b2-4c0f-8c08-0f3475af5fc6 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "POST /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca/action" status: 202 len: 0 microversion: 2.1 time: 0.310457 Oct 23 01:25:56.686311 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1912/3787] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:25:56 2022] POST /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca/action => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:25:56.693771 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d3fc941c-cf83-4d81-bf0f-7e8437c7f055 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:56.694644 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d3fc941c-cf83-4d81-bf0f-7e8437c7f055 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:56.701488 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d3fc941c-cf83-4d81-bf0f-7e8437c7f055 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:56.707444 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d3fc941c-cf83-4d81-bf0f-7e8437c7f055 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:56.707444 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d3fc941c-cf83-4d81-bf0f-7e8437c7f055 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:56.707444 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d3fc941c-cf83-4d81-bf0f-7e8437c7f055 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:56.707444 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d3fc941c-cf83-4d81-bf0f-7e8437c7f055 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:56.707444 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d3fc941c-cf83-4d81-bf0f-7e8437c7f055 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:56.981934 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d3fc941c-cf83-4d81-bf0f-7e8437c7f055 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:56.992136 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d3fc941c-cf83-4d81-bf0f-7e8437c7f055 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:56.994080 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d3fc941c-cf83-4d81-bf0f-7e8437c7f055 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:56.995282 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d3fc941c-cf83-4d81-bf0f-7e8437c7f055 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1406 microversion: 2.20 time: 0.306983 Oct 23 01:25:56.995864 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1913/3788] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:25:56 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1406 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:25:57.001442 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ddbeacca-2711-41cd-845f-25331fe06361 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:57.002189 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ddbeacca-2711-41cd-845f-25331fe06361 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:57.008867 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ddbeacca-2711-41cd-845f-25331fe06361 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:57.011956 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ddbeacca-2711-41cd-845f-25331fe06361 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:57.011956 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ddbeacca-2711-41cd-845f-25331fe06361 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:57.011956 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ddbeacca-2711-41cd-845f-25331fe06361 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:57.011956 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ddbeacca-2711-41cd-845f-25331fe06361 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:57.011956 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ddbeacca-2711-41cd-845f-25331fe06361 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:57.185058 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ddbeacca-2711-41cd-845f-25331fe06361 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.187577 Oct 23 01:25:57.185568 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1914/3789] 10.222.0.42 () {58 vars in 1275 bytes} [Sun Oct 23 01:25:56 2022] GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4/os-interface => generated 284 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:25:57.198629 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d7434fff-0825-445b-8c8a-fd61277ceb46 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:57.199252 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d7434fff-0825-445b-8c8a-fd61277ceb46 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:57.206966 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d7434fff-0825-445b-8c8a-fd61277ceb46 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:57.207679 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d7434fff-0825-445b-8c8a-fd61277ceb46 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:57.208342 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d7434fff-0825-445b-8c8a-fd61277ceb46 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:57.209226 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d7434fff-0825-445b-8c8a-fd61277ceb46 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:57.209687 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d7434fff-0825-445b-8c8a-fd61277ceb46 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:57.210321 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d7434fff-0825-445b-8c8a-fd61277ceb46 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:57.816972 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d7434fff-0825-445b-8c8a-fd61277ceb46 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:57.830104 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d7434fff-0825-445b-8c8a-fd61277ceb46 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1665 microversion: 2.1 time: 0.635366 Oct 23 01:25:57.832667 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1915/3790] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:57 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1665 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:25:57.837509 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-eebebda3-61db-43e4-a658-002ac9c45f51 req-af7245a1-0b3e-4efe-b2c8-4868e13decb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6eb59b7-d1ee-442c-8142-19a88ad6a039", "tag": "82e540c0-e210-47a2-a17d-495549fe7222"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:25:57.847714 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-eebebda3-61db-43e4-a658-002ac9c45f51 req-af7245a1-0b3e-4efe-b2c8-4868e13decb6 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:57.848196 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-eebebda3-61db-43e4-a658-002ac9c45f51 req-af7245a1-0b3e-4efe-b2c8-4868e13decb6 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:57.848631 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-eebebda3-61db-43e4-a658-002ac9c45f51 req-af7245a1-0b3e-4efe-b2c8-4868e13decb6 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:57.860433 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-eebebda3-61db-43e4-a658-002ac9c45f51 req-af7245a1-0b3e-4efe-b2c8-4868e13decb6 service nova] Creating event network-changed:82e540c0-e210-47a2-a17d-495549fe7222 for instance c6eb59b7-d1ee-442c-8142-19a88ad6a039 on n-h1-master-1 Oct 23 01:25:57.865407 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-eebebda3-61db-43e4-a658-002ac9c45f51 req-af7245a1-0b3e-4efe-b2c8-4868e13decb6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032409 Oct 23 01:25:57.866272 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1916/3791] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:25:57.871705 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6c9aa1c2-eb0f-4b8a-b074-c1febf8a8526 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:57.872694 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6c9aa1c2-eb0f-4b8a-b074-c1febf8a8526 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] [instance: ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:57.879183 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6c9aa1c2-eb0f-4b8a-b074-c1febf8a8526 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:57.879680 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6c9aa1c2-eb0f-4b8a-b074-c1febf8a8526 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:57.880123 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6c9aa1c2-eb0f-4b8a-b074-c1febf8a8526 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:57.880829 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6c9aa1c2-eb0f-4b8a-b074-c1febf8a8526 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:57.881291 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6c9aa1c2-eb0f-4b8a-b074-c1febf8a8526 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:57.881721 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6c9aa1c2-eb0f-4b8a-b074-c1febf8a8526 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:57.898392 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:57.990294 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6c9aa1c2-eb0f-4b8a-b074-c1febf8a8526 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1fb3cadf09d4d5da19e37b0080a0f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf117bb5bf4e76b3bab3ef518dce11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:58.004189 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6c9aa1c2-eb0f-4b8a-b074-c1febf8a8526 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/servers/ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d" status: 200 len: 1275 microversion: 2.1 time: 0.136354 Oct 23 01:25:58.005705 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1917/3792] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:57 2022] GET /compute/v2.1/servers/ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d => generated 1275 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:25:58.023872 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ca05e79e-ad90-4f62-8973-d02d261eb9da tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:58.026804 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ca05e79e-ad90-4f62-8973-d02d261eb9da tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:58.032434 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ca05e79e-ad90-4f62-8973-d02d261eb9da tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:58.032934 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ca05e79e-ad90-4f62-8973-d02d261eb9da tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:58.033578 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ca05e79e-ad90-4f62-8973-d02d261eb9da tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:58.034487 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ca05e79e-ad90-4f62-8973-d02d261eb9da tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:58.035123 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ca05e79e-ad90-4f62-8973-d02d261eb9da tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:58.035551 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ca05e79e-ad90-4f62-8973-d02d261eb9da tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:58.365759 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ca05e79e-ad90-4f62-8973-d02d261eb9da tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:58.374834 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ca05e79e-ad90-4f62-8973-d02d261eb9da tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:58.376796 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ca05e79e-ad90-4f62-8973-d02d261eb9da tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:58.378099 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ca05e79e-ad90-4f62-8973-d02d261eb9da tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1406 microversion: 2.20 time: 0.361073 Oct 23 01:25:58.383792 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1918/3793] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:25:58 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1406 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:25:58.399012 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a3aa6a86-f3bf-48a3-8362-5de7d042c768 tempest-FloatingIPDetailsTestJSON-945854673 tempest-FloatingIPDetailsTestJSON-945854673-project] 10.222.0.42 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.207014 Oct 23 01:25:58.400266 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1876/3794] 10.222.0.42 () {60 vars in 1170 bytes} [Sun Oct 23 01:25:55 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:25:58.415128 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e37a8fd1-3db7-4aeb-b98d-562a45a5bec7 tempest-FloatingIPDetailsTestJSON-945854673 tempest-FloatingIPDetailsTestJSON-945854673-project] Action: 'create', calling method: .version_select at 0x7f5cc0fea4c0>, body: {"pool": null} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:25:58.689735 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ced880b7-89ea-4479-b74e-35aef452d2c8 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "065676fb-11b5-4d77-a1c0-576e2343d16c"}], "security_groups": [{"name": "tempest-securitygroup--934457087"}], "key_name": "tempest-keypair-744068114", "user_data": "}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:25:58.831527 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-ced880b7-89ea-4479-b74e-35aef452d2c8 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] validate_networks() for [('065676fb-11b5-4d77-a1c0-576e2343d16c', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:25:59.283166 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:59.305622 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=6 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:59.417940 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-ced880b7-89ea-4479-b74e-35aef452d2c8 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:25:59.419646 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-ced880b7-89ea-4479-b74e-35aef452d2c8 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:25:59.419886 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-ced880b7-89ea-4479-b74e-35aef452d2c8 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:25:59.420329 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-ced880b7-89ea-4479-b74e-35aef452d2c8 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:25:59.420730 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-ced880b7-89ea-4479-b74e-35aef452d2c8 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:25:59.430868 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ced880b7-89ea-4479-b74e-35aef452d2c8 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:59.431959 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ced880b7-89ea-4479-b74e-35aef452d2c8 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:59.432403 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ced880b7-89ea-4479-b74e-35aef452d2c8 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:59.433606 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ced880b7-89ea-4479-b74e-35aef452d2c8 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:59.434356 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ced880b7-89ea-4479-b74e-35aef452d2c8 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:59.435009 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ced880b7-89ea-4479-b74e-35aef452d2c8 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:59.455761 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-ced880b7-89ea-4479-b74e-35aef452d2c8 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Getting quotas for project a3bb23cbc0c142a2a4b7a39df99a7d4a. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:25:59.460990 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-ced880b7-89ea-4479-b74e-35aef452d2c8 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Getting quotas for user fbb8ce5c15bd4a6199cfdf84c49837ef and project a3bb23cbc0c142a2a4b7a39df99a7d4a. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:25:59.479891 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ced880b7-89ea-4479-b74e-35aef452d2c8 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:25:59.480791 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ced880b7-89ea-4479-b74e-35aef452d2c8 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] [instance: d27396ae-9295-4187-9ef7-6d7416ee02b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:25:59.695067 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ced880b7-89ea-4479-b74e-35aef452d2c8 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.010300 Oct 23 01:25:59.695902 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1877/3795] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:25:58 2022] POST /compute/v2.1/servers => generated 408 bytes in 1012 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 23 01:25:59.704562 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7409e327-d3ac-4fce-8fa1-93526b93443c tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:25:59.705187 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7409e327-d3ac-4fce-8fa1-93526b93443c tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:25:59.713447 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7409e327-d3ac-4fce-8fa1-93526b93443c tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:59.713956 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7409e327-d3ac-4fce-8fa1-93526b93443c tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:59.716249 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7409e327-d3ac-4fce-8fa1-93526b93443c tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:59.716998 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7409e327-d3ac-4fce-8fa1-93526b93443c tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:25:59.717464 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7409e327-d3ac-4fce-8fa1-93526b93443c tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:25:59.717890 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7409e327-d3ac-4fce-8fa1-93526b93443c tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:25:59.972520 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7409e327-d3ac-4fce-8fa1-93526b93443c tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:25:59.981330 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7409e327-d3ac-4fce-8fa1-93526b93443c tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1665 microversion: 2.1 time: 0.284525 Oct 23 01:26:00.001601 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1878/3796] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:59 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1665 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:00.001601 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b6e6cc61-3dcf-4099-b051-cec6f8ccb5f8 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:00.001601 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b6e6cc61-3dcf-4099-b051-cec6f8ccb5f8 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] [instance: ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:00.017595 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b6e6cc61-3dcf-4099-b051-cec6f8ccb5f8 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:00.018178 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b6e6cc61-3dcf-4099-b051-cec6f8ccb5f8 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:00.018625 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b6e6cc61-3dcf-4099-b051-cec6f8ccb5f8 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:00.019338 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b6e6cc61-3dcf-4099-b051-cec6f8ccb5f8 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:00.019795 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b6e6cc61-3dcf-4099-b051-cec6f8ccb5f8 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:00.020219 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b6e6cc61-3dcf-4099-b051-cec6f8ccb5f8 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:00.332272 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b6e6cc61-3dcf-4099-b051-cec6f8ccb5f8 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1fb3cadf09d4d5da19e37b0080a0f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf117bb5bf4e76b3bab3ef518dce11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:00.342521 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b6e6cc61-3dcf-4099-b051-cec6f8ccb5f8 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/servers/ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d" status: 200 len: 1317 microversion: 2.1 time: 0.356334 Oct 23 01:26:00.343695 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1879/3797] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:25:59 2022] GET /compute/v2.1/servers/ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d => generated 1317 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:00.348848 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7d97fd2b-256d-4186-9861-81798f82c4fc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:00.349837 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7d97fd2b-256d-4186-9861-81798f82c4fc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:00.356654 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7d97fd2b-256d-4186-9861-81798f82c4fc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:00.357487 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7d97fd2b-256d-4186-9861-81798f82c4fc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:00.358146 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7d97fd2b-256d-4186-9861-81798f82c4fc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:00.359040 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7d97fd2b-256d-4186-9861-81798f82c4fc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:00.359739 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7d97fd2b-256d-4186-9861-81798f82c4fc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:00.360433 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7d97fd2b-256d-4186-9861-81798f82c4fc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:00.596973 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7d97fd2b-256d-4186-9861-81798f82c4fc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:00.607145 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7d97fd2b-256d-4186-9861-81798f82c4fc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:00.608646 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7d97fd2b-256d-4186-9861-81798f82c4fc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:00.610475 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7d97fd2b-256d-4186-9861-81798f82c4fc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1406 microversion: 2.20 time: 0.264808 Oct 23 01:26:00.613107 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1880/3798] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:26:00 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1406 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:26:00.619417 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-96d62479-0940-4ffd-985b-029aab58b22b tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:00.620288 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-96d62479-0940-4ffd-985b-029aab58b22b tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] [instance: d27396ae-9295-4187-9ef7-6d7416ee02b0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:00.703432 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-96d62479-0940-4ffd-985b-029aab58b22b tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb8ce5c15bd4a6199cfdf84c49837ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb23cbc0c142a2a4b7a39df99a7d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:00.716613 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-96d62479-0940-4ffd-985b-029aab58b22b tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] 10.222.0.42 "GET /compute/v2.1/servers/d27396ae-9295-4187-9ef7-6d7416ee02b0" status: 200 len: 1225 microversion: 2.1 time: 0.100431 Oct 23 01:26:00.717761 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1881/3799] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:00 2022] GET /compute/v2.1/servers/d27396ae-9295-4187-9ef7-6d7416ee02b0 => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:00.722992 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-b894f25c-3fc4-419c-9270-8f9873714d4b req-4ed567b2-2a46-43d2-b06f-a4102c856fa7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38daa540-d4d0-4644-8ed5-a1f6a4fea4e4", "tag": "d22e97f1-10e1-4cba-878f-0a05d24b97c0"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:26:00.736772 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-b894f25c-3fc4-419c-9270-8f9873714d4b req-4ed567b2-2a46-43d2-b06f-a4102c856fa7 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:00.737320 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-b894f25c-3fc4-419c-9270-8f9873714d4b req-4ed567b2-2a46-43d2-b06f-a4102c856fa7 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:00.737749 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-b894f25c-3fc4-419c-9270-8f9873714d4b req-4ed567b2-2a46-43d2-b06f-a4102c856fa7 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:00.752827 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-b894f25c-3fc4-419c-9270-8f9873714d4b req-4ed567b2-2a46-43d2-b06f-a4102c856fa7 service nova] Creating event network-changed:d22e97f1-10e1-4cba-878f-0a05d24b97c0 for instance 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4 on n-h2-master-1 Oct 23 01:26:00.760682 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-b894f25c-3fc4-419c-9270-8f9873714d4b req-4ed567b2-2a46-43d2-b06f-a4102c856fa7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041271 Oct 23 01:26:00.761601 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1882/3800] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:26:00.939511 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e37a8fd1-3db7-4aeb-b98d-562a45a5bec7 tempest-FloatingIPDetailsTestJSON-945854673 tempest-FloatingIPDetailsTestJSON-945854673-project] 10.222.0.42 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.528578 Oct 23 01:26:00.948701 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1919/3801] 10.222.0.42 () {60 vars in 1170 bytes} [Sun Oct 23 01:25:58 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:26:00.954596 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c4f0da29-955b-4e43-9488-6993ed841d41 tempest-FloatingIPDetailsTestJSON-945854673 tempest-FloatingIPDetailsTestJSON-945854673-project] Calling method '.version_select at 0x7f5cc2430ca0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:01.013166 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5d08be71-6e8b-4d30-9780-d92a65d8ceb3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:01.014078 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5d08be71-6e8b-4d30-9780-d92a65d8ceb3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:01.033799 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5d08be71-6e8b-4d30-9780-d92a65d8ceb3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:01.036396 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5d08be71-6e8b-4d30-9780-d92a65d8ceb3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:01.037020 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5d08be71-6e8b-4d30-9780-d92a65d8ceb3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:01.038550 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5d08be71-6e8b-4d30-9780-d92a65d8ceb3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:01.041352 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5d08be71-6e8b-4d30-9780-d92a65d8ceb3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:01.045884 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5d08be71-6e8b-4d30-9780-d92a65d8ceb3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:01.251228 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c4f0da29-955b-4e43-9488-6993ed841d41 tempest-FloatingIPDetailsTestJSON-945854673 tempest-FloatingIPDetailsTestJSON-945854673-project] 10.222.0.42 "GET /compute/v2.1/os-floating-ips/c7b4cda6-8cc0-4438-ba99-76c459ee2a7e" status: 200 len: 141 microversion: 2.1 time: 0.300703 Oct 23 01:26:01.253057 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1883/3802] 10.222.0.42 () {58 vars in 1260 bytes} [Sun Oct 23 01:26:00 2022] GET /compute/v2.1/os-floating-ips/c7b4cda6-8cc0-4438-ba99-76c459ee2a7e => generated 141 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:26:01.268004 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-41fd5a82-c24b-4dd0-a5fd-5a56eb99bc0d tempest-FloatingIPDetailsTestJSON-945854673 tempest-FloatingIPDetailsTestJSON-945854673-project] Calling method '.version_select at 0x7f5cc172ddc0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:01.279136 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5d08be71-6e8b-4d30-9780-d92a65d8ceb3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:01.315768 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5d08be71-6e8b-4d30-9780-d92a65d8ceb3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1669 microversion: 2.1 time: 0.307126 Oct 23 01:26:01.316621 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1920/3803] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:01 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1669 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:01.372002 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f346576e-8960-4cf4-820d-5f4a0a6e7c1f tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:01.372250 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f346576e-8960-4cf4-820d-5f4a0a6e7c1f tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] [instance: ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:01.379889 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f346576e-8960-4cf4-820d-5f4a0a6e7c1f tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:01.380903 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f346576e-8960-4cf4-820d-5f4a0a6e7c1f tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:01.381652 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f346576e-8960-4cf4-820d-5f4a0a6e7c1f tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:01.382614 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f346576e-8960-4cf4-820d-5f4a0a6e7c1f tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:01.383238 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f346576e-8960-4cf4-820d-5f4a0a6e7c1f tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:01.383856 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f346576e-8960-4cf4-820d-5f4a0a6e7c1f tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:01.622963 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f346576e-8960-4cf4-820d-5f4a0a6e7c1f tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1fb3cadf09d4d5da19e37b0080a0f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf117bb5bf4e76b3bab3ef518dce11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:01.644643 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f346576e-8960-4cf4-820d-5f4a0a6e7c1f tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/servers/ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d" status: 200 len: 1317 microversion: 2.1 time: 0.275365 Oct 23 01:26:01.644643 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1921/3804] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:01 2022] GET /compute/v2.1/servers/ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d => generated 1317 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:26:01.650868 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-af8fccfe-2d82-44a5-b3cc-53e7f36d5850 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:01.651704 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-af8fccfe-2d82-44a5-b3cc-53e7f36d5850 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:01.659438 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-af8fccfe-2d82-44a5-b3cc-53e7f36d5850 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:01.660089 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-af8fccfe-2d82-44a5-b3cc-53e7f36d5850 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:01.660728 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-af8fccfe-2d82-44a5-b3cc-53e7f36d5850 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:01.661428 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-af8fccfe-2d82-44a5-b3cc-53e7f36d5850 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:01.661886 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-af8fccfe-2d82-44a5-b3cc-53e7f36d5850 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:01.662411 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-af8fccfe-2d82-44a5-b3cc-53e7f36d5850 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:02.469895 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-af8fccfe-2d82-44a5-b3cc-53e7f36d5850 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:02.479738 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-af8fccfe-2d82-44a5-b3cc-53e7f36d5850 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:02.481550 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-af8fccfe-2d82-44a5-b3cc-53e7f36d5850 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:02.482944 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-af8fccfe-2d82-44a5-b3cc-53e7f36d5850 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1406 microversion: 2.20 time: 0.839860 Oct 23 01:26:02.483733 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1922/3805] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:26:01 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1406 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:26:02.489532 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e7c87090-ee27-4e84-a533-11ac8a1d4d27 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:02.490413 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e7c87090-ee27-4e84-a533-11ac8a1d4d27 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] [instance: d27396ae-9295-4187-9ef7-6d7416ee02b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:02.497772 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e7c87090-ee27-4e84-a533-11ac8a1d4d27 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:02.498304 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e7c87090-ee27-4e84-a533-11ac8a1d4d27 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:02.499147 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e7c87090-ee27-4e84-a533-11ac8a1d4d27 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:02.501114 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e7c87090-ee27-4e84-a533-11ac8a1d4d27 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:02.501803 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e7c87090-ee27-4e84-a533-11ac8a1d4d27 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:02.502276 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e7c87090-ee27-4e84-a533-11ac8a1d4d27 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:02.586212 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:26:02.594769 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e7c87090-ee27-4e84-a533-11ac8a1d4d27 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb8ce5c15bd4a6199cfdf84c49837ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb23cbc0c142a2a4b7a39df99a7d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:02.604415 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e7c87090-ee27-4e84-a533-11ac8a1d4d27 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] 10.222.0.42 "GET /compute/v2.1/servers/d27396ae-9295-4187-9ef7-6d7416ee02b0" status: 200 len: 1277 microversion: 2.1 time: 0.119262 Oct 23 01:26:02.605094 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1923/3806] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:02 2022] GET /compute/v2.1/servers/d27396ae-9295-4187-9ef7-6d7416ee02b0 => generated 1277 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:02.667180 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3928a248-d3d9-4182-b8f8-6d6b6448afcf tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:02.668130 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3928a248-d3d9-4182-b8f8-6d6b6448afcf tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] [instance: ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:02.674305 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3928a248-d3d9-4182-b8f8-6d6b6448afcf tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:02.674795 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3928a248-d3d9-4182-b8f8-6d6b6448afcf tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:02.675237 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3928a248-d3d9-4182-b8f8-6d6b6448afcf tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:02.676097 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3928a248-d3d9-4182-b8f8-6d6b6448afcf tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:02.676560 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3928a248-d3d9-4182-b8f8-6d6b6448afcf tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:02.676990 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3928a248-d3d9-4182-b8f8-6d6b6448afcf tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:02.900664 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3928a248-d3d9-4182-b8f8-6d6b6448afcf tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1fb3cadf09d4d5da19e37b0080a0f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf117bb5bf4e76b3bab3ef518dce11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:02.906045 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-41fd5a82-c24b-4dd0-a5fd-5a56eb99bc0d tempest-FloatingIPDetailsTestJSON-945854673 tempest-FloatingIPDetailsTestJSON-945854673-project] 10.222.0.42 "DELETE /compute/v2.1/os-floating-ips/c7b4cda6-8cc0-4438-ba99-76c459ee2a7e" status: 202 len: 0 microversion: 2.1 time: 1.644501 Oct 23 01:26:02.906673 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1884/3807] 10.222.0.42 () {58 vars in 1263 bytes} [Sun Oct 23 01:26:01 2022] DELETE /compute/v2.1/os-floating-ips/c7b4cda6-8cc0-4438-ba99-76c459ee2a7e => generated 0 bytes in 1646 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:26:02.911163 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-759ce657-2e76-4631-ae73-39e47506e935 req-4e56570e-012d-4ccc-9515-8d4f3c1a0b39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38daa540-d4d0-4644-8ed5-a1f6a4fea4e4", "tag": "d22e97f1-10e1-4cba-878f-0a05d24b97c0"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:26:02.918611 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3928a248-d3d9-4182-b8f8-6d6b6448afcf tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/servers/ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d" status: 200 len: 1317 microversion: 2.1 time: 0.256084 Oct 23 01:26:02.919192 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1924/3808] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:02 2022] GET /compute/v2.1/servers/ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d => generated 1317 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:26:02.927536 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-730f6d09-3ddd-4bb7-b256-017da80df97b tempest-FloatingIPDetailsTestJSON-945854673 tempest-FloatingIPDetailsTestJSON-945854673-project] Calling method '.version_select at 0x7f5cc0fba4c0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:02.936702 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-759ce657-2e76-4631-ae73-39e47506e935 req-4e56570e-012d-4ccc-9515-8d4f3c1a0b39 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:02.937177 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-759ce657-2e76-4631-ae73-39e47506e935 req-4e56570e-012d-4ccc-9515-8d4f3c1a0b39 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:02.937628 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-759ce657-2e76-4631-ae73-39e47506e935 req-4e56570e-012d-4ccc-9515-8d4f3c1a0b39 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:02.949593 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-759ce657-2e76-4631-ae73-39e47506e935 req-4e56570e-012d-4ccc-9515-8d4f3c1a0b39 service nova] Creating event network-changed:d22e97f1-10e1-4cba-878f-0a05d24b97c0 for instance 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4 on n-h2-master-1 Oct 23 01:26:02.955025 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-759ce657-2e76-4631-ae73-39e47506e935 req-4e56570e-012d-4ccc-9515-8d4f3c1a0b39 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047202 Oct 23 01:26:02.955741 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1885/3809] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:26:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:26:03.151306 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-730f6d09-3ddd-4bb7-b256-017da80df97b tempest-FloatingIPDetailsTestJSON-945854673 tempest-FloatingIPDetailsTestJSON-945854673-project] 10.222.0.42 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.230945 Oct 23 01:26:03.154109 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1925/3810] 10.222.0.42 () {58 vars in 1164 bytes} [Sun Oct 23 01:26:02 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:26:03.164029 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2a4e03b0-577f-464b-8eb6-f8fc355cf59a tempest-FloatingIPDetailsTestJSON-945854673 tempest-FloatingIPDetailsTestJSON-945854673-project] Calling method '.version_select at 0x7f5cc38ae040>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:03.415535 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2a4e03b0-577f-464b-8eb6-f8fc355cf59a tempest-FloatingIPDetailsTestJSON-945854673 tempest-FloatingIPDetailsTestJSON-945854673-project] 10.222.0.42 "GET /compute/v2.1/os-floating-ips" status: 200 len: 396 microversion: 2.1 time: 0.255579 Oct 23 01:26:03.416125 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1886/3811] 10.222.0.42 () {58 vars in 1149 bytes} [Sun Oct 23 01:26:03 2022] GET /compute/v2.1/os-floating-ips => generated 396 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:26:03.431078 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8a95b744-45d9-48cb-84b9-3502baac5c31 tempest-FloatingIPDetailsTestJSON-945854673 tempest-FloatingIPDetailsTestJSON-945854673-project] Calling method '.version_select at 0x7f5cc0fd65e0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:03.511023 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3c6bd04e-0ef1-4d2a-ab69-f0eeb3174955 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:03.512593 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3c6bd04e-0ef1-4d2a-ab69-f0eeb3174955 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:03.521700 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c6bd04e-0ef1-4d2a-ab69-f0eeb3174955 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:03.523074 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c6bd04e-0ef1-4d2a-ab69-f0eeb3174955 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:03.528744 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c6bd04e-0ef1-4d2a-ab69-f0eeb3174955 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:03.528744 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c6bd04e-0ef1-4d2a-ab69-f0eeb3174955 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:03.528744 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c6bd04e-0ef1-4d2a-ab69-f0eeb3174955 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:03.528744 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c6bd04e-0ef1-4d2a-ab69-f0eeb3174955 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:03.534102 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:26:03.799379 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3c6bd04e-0ef1-4d2a-ab69-f0eeb3174955 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:03.810677 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3c6bd04e-0ef1-4d2a-ab69-f0eeb3174955 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:03.812537 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3c6bd04e-0ef1-4d2a-ab69-f0eeb3174955 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:03.814137 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3c6bd04e-0ef1-4d2a-ab69-f0eeb3174955 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1406 microversion: 2.20 time: 0.307912 Oct 23 01:26:03.817379 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1887/3812] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:26:03 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1406 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:26:03.820008 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-228a1c0d-a37d-4c24-9971-69835226c779 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:03.821578 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-228a1c0d-a37d-4c24-9971-69835226c779 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] [instance: d27396ae-9295-4187-9ef7-6d7416ee02b0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:03.828665 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-228a1c0d-a37d-4c24-9971-69835226c779 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:03.829360 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-228a1c0d-a37d-4c24-9971-69835226c779 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:03.830111 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-228a1c0d-a37d-4c24-9971-69835226c779 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:03.830963 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-228a1c0d-a37d-4c24-9971-69835226c779 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:03.831716 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-228a1c0d-a37d-4c24-9971-69835226c779 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:03.832326 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-228a1c0d-a37d-4c24-9971-69835226c779 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:03.922717 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-228a1c0d-a37d-4c24-9971-69835226c779 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb8ce5c15bd4a6199cfdf84c49837ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb23cbc0c142a2a4b7a39df99a7d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:03.931498 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-228a1c0d-a37d-4c24-9971-69835226c779 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] 10.222.0.42 "GET /compute/v2.1/servers/d27396ae-9295-4187-9ef7-6d7416ee02b0" status: 200 len: 1283 microversion: 2.1 time: 0.115480 Oct 23 01:26:03.932329 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1888/3813] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:03 2022] GET /compute/v2.1/servers/d27396ae-9295-4187-9ef7-6d7416ee02b0 => generated 1283 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:03.943207 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d7f4ec51-f7f2-4629-89c7-f99c835a95f4 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:03.944060 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d7f4ec51-f7f2-4629-89c7-f99c835a95f4 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] [instance: ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:03.951291 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d7f4ec51-f7f2-4629-89c7-f99c835a95f4 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:03.951866 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d7f4ec51-f7f2-4629-89c7-f99c835a95f4 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:03.952371 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d7f4ec51-f7f2-4629-89c7-f99c835a95f4 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:03.953649 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d7f4ec51-f7f2-4629-89c7-f99c835a95f4 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:03.954215 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d7f4ec51-f7f2-4629-89c7-f99c835a95f4 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:03.954702 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d7f4ec51-f7f2-4629-89c7-f99c835a95f4 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:04.185614 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d7f4ec51-f7f2-4629-89c7-f99c835a95f4 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1fb3cadf09d4d5da19e37b0080a0f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf117bb5bf4e76b3bab3ef518dce11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:04.194239 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d7f4ec51-f7f2-4629-89c7-f99c835a95f4 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/servers/ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d" status: 200 len: 1317 microversion: 2.1 time: 0.255745 Oct 23 01:26:04.195061 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1889/3814] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:03 2022] GET /compute/v2.1/servers/ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d => generated 1317 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:04.352347 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=14 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:26:04.474505 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8a95b744-45d9-48cb-84b9-3502baac5c31 tempest-FloatingIPDetailsTestJSON-945854673 tempest-FloatingIPDetailsTestJSON-945854673-project] 10.222.0.42 "DELETE /compute/v2.1/os-floating-ips/77cbb293-d16f-48c1-9aba-57fde6584b77" status: 202 len: 0 microversion: 2.1 time: 1.047791 Oct 23 01:26:04.475086 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1926/3815] 10.222.0.42 () {58 vars in 1263 bytes} [Sun Oct 23 01:26:03 2022] DELETE /compute/v2.1/os-floating-ips/77cbb293-d16f-48c1-9aba-57fde6584b77 => generated 0 bytes in 1049 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:26:04.483279 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0a252ab1-ae47-4698-98a0-bda0067ac56d tempest-FloatingIPDetailsTestJSON-945854673 tempest-FloatingIPDetailsTestJSON-945854673-project] Calling method '.version_select at 0x7f5cc62f2b80>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:04.842786 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7e950266-01bf-40df-b64e-302c69cf346d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:04.843396 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7e950266-01bf-40df-b64e-302c69cf346d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:04.849691 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:26:04.851410 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e950266-01bf-40df-b64e-302c69cf346d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:04.852077 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e950266-01bf-40df-b64e-302c69cf346d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:04.852694 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e950266-01bf-40df-b64e-302c69cf346d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:04.853557 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e950266-01bf-40df-b64e-302c69cf346d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:04.854216 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e950266-01bf-40df-b64e-302c69cf346d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:04.854799 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e950266-01bf-40df-b64e-302c69cf346d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:05.060427 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7e950266-01bf-40df-b64e-302c69cf346d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:05.069362 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7e950266-01bf-40df-b64e-302c69cf346d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:05.070849 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7e950266-01bf-40df-b64e-302c69cf346d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:05.071984 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7e950266-01bf-40df-b64e-302c69cf346d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1406 microversion: 2.20 time: 0.233166 Oct 23 01:26:05.082258 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1927/3816] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:26:04 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1406 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:26:05.090779 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7615a477-34d7-4742-8cb3-43456d68123f tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:05.091630 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7615a477-34d7-4742-8cb3-43456d68123f tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] [instance: d27396ae-9295-4187-9ef7-6d7416ee02b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:05.098401 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7615a477-34d7-4742-8cb3-43456d68123f tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:05.098908 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7615a477-34d7-4742-8cb3-43456d68123f tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:05.099365 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7615a477-34d7-4742-8cb3-43456d68123f tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:05.100077 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7615a477-34d7-4742-8cb3-43456d68123f tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:05.100664 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7615a477-34d7-4742-8cb3-43456d68123f tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:05.101098 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7615a477-34d7-4742-8cb3-43456d68123f tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:05.172904 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7615a477-34d7-4742-8cb3-43456d68123f tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb8ce5c15bd4a6199cfdf84c49837ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb23cbc0c142a2a4b7a39df99a7d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:05.184345 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7615a477-34d7-4742-8cb3-43456d68123f tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] 10.222.0.42 "GET /compute/v2.1/servers/d27396ae-9295-4187-9ef7-6d7416ee02b0" status: 200 len: 1283 microversion: 2.1 time: 0.109953 Oct 23 01:26:05.185674 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1928/3817] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:05 2022] GET /compute/v2.1/servers/d27396ae-9295-4187-9ef7-6d7416ee02b0 => generated 1283 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:05.191655 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-4103b92c-cc5a-47ee-b355-174944229ddb req-9cb3f1ee-6289-44db-84cf-8d52654bf7f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d", "tag": "007e6906-2969-451c-bd1b-9c4c9e24d5ed"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:26:05.201332 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-4103b92c-cc5a-47ee-b355-174944229ddb req-9cb3f1ee-6289-44db-84cf-8d52654bf7f5 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:05.201832 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-4103b92c-cc5a-47ee-b355-174944229ddb req-9cb3f1ee-6289-44db-84cf-8d52654bf7f5 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:05.202310 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-4103b92c-cc5a-47ee-b355-174944229ddb req-9cb3f1ee-6289-44db-84cf-8d52654bf7f5 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:05.217282 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-4103b92c-cc5a-47ee-b355-174944229ddb req-9cb3f1ee-6289-44db-84cf-8d52654bf7f5 service nova] Creating event network-changed:007e6906-2969-451c-bd1b-9c4c9e24d5ed for instance ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d on n-h1-master-1 Oct 23 01:26:05.222997 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-4103b92c-cc5a-47ee-b355-174944229ddb req-9cb3f1ee-6289-44db-84cf-8d52654bf7f5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035612 Oct 23 01:26:05.223787 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1929/3818] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:26:05.230683 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cfdcaf40-60f3-4f35-83f2-e4a9e6784c6d tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:05.232095 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-cfdcaf40-60f3-4f35-83f2-e4a9e6784c6d tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] [instance: ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:05.238791 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cfdcaf40-60f3-4f35-83f2-e4a9e6784c6d tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:05.239289 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cfdcaf40-60f3-4f35-83f2-e4a9e6784c6d tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:05.239731 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cfdcaf40-60f3-4f35-83f2-e4a9e6784c6d tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:05.240635 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cfdcaf40-60f3-4f35-83f2-e4a9e6784c6d tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:05.241106 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cfdcaf40-60f3-4f35-83f2-e4a9e6784c6d tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:05.241534 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cfdcaf40-60f3-4f35-83f2-e4a9e6784c6d tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:05.470743 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0a252ab1-ae47-4698-98a0-bda0067ac56d tempest-FloatingIPDetailsTestJSON-945854673 tempest-FloatingIPDetailsTestJSON-945854673-project] 10.222.0.42 "DELETE /compute/v2.1/os-floating-ips/52ed9492-6192-48f0-abd7-b99fcbe12f7b" status: 202 len: 0 microversion: 2.1 time: 0.991463 Oct 23 01:26:05.480180 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cfdcaf40-60f3-4f35-83f2-e4a9e6784c6d tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1fb3cadf09d4d5da19e37b0080a0f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf117bb5bf4e76b3bab3ef518dce11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:05.482137 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1890/3819] 10.222.0.42 () {58 vars in 1263 bytes} [Sun Oct 23 01:26:04 2022] DELETE /compute/v2.1/os-floating-ips/52ed9492-6192-48f0-abd7-b99fcbe12f7b => generated 0 bytes in 1003 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:26:05.488126 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cfdcaf40-60f3-4f35-83f2-e4a9e6784c6d tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/servers/ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d" status: 200 len: 1317 microversion: 2.1 time: 0.262972 Oct 23 01:26:05.494809 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1930/3820] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:05 2022] GET /compute/v2.1/servers/ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d => generated 1317 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:05.497914 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f697fe27-bf13-42ff-8beb-2aec5f84bfe7 tempest-FloatingIPDetailsTestJSON-945854673 tempest-FloatingIPDetailsTestJSON-945854673-project] Calling method '.version_select at 0x7f5cc172d280>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:05.907636 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-e1cf3e57-06be-4f61-9c25-d6bd84d143c4 req-e124c01e-0fd4-46b0-9ce8-0a04c31c2346 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6eb59b7-d1ee-442c-8142-19a88ad6a039", "name": "network-vif-plugged", "status": "completed", "tag": "82e540c0-e210-47a2-a17d-495549fe7222"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:26:05.923988 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-e1cf3e57-06be-4f61-9c25-d6bd84d143c4 req-e124c01e-0fd4-46b0-9ce8-0a04c31c2346 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:05.924589 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-e1cf3e57-06be-4f61-9c25-d6bd84d143c4 req-e124c01e-0fd4-46b0-9ce8-0a04c31c2346 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:05.925092 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-e1cf3e57-06be-4f61-9c25-d6bd84d143c4 req-e124c01e-0fd4-46b0-9ce8-0a04c31c2346 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:05.940231 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-e1cf3e57-06be-4f61-9c25-d6bd84d143c4 req-e124c01e-0fd4-46b0-9ce8-0a04c31c2346 service nova] Creating event network-vif-plugged:82e540c0-e210-47a2-a17d-495549fe7222 for instance c6eb59b7-d1ee-442c-8142-19a88ad6a039 on n-h1-master-1 Oct 23 01:26:05.945581 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-e1cf3e57-06be-4f61-9c25-d6bd84d143c4 req-e124c01e-0fd4-46b0-9ce8-0a04c31c2346 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043201 Oct 23 01:26:05.949625 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1931/3821] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:26:06.112680 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5861562e-a7ff-4a5a-86e3-853e9382d568 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:06.112680 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5861562e-a7ff-4a5a-86e3-853e9382d568 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:06.112680 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5861562e-a7ff-4a5a-86e3-853e9382d568 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:06.112680 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5861562e-a7ff-4a5a-86e3-853e9382d568 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:06.112680 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5861562e-a7ff-4a5a-86e3-853e9382d568 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:06.120380 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5861562e-a7ff-4a5a-86e3-853e9382d568 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:06.122018 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5861562e-a7ff-4a5a-86e3-853e9382d568 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:06.122568 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5861562e-a7ff-4a5a-86e3-853e9382d568 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:06.435771 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5861562e-a7ff-4a5a-86e3-853e9382d568 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:06.450754 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5861562e-a7ff-4a5a-86e3-853e9382d568 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:06.450754 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5861562e-a7ff-4a5a-86e3-853e9382d568 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:06.450754 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5861562e-a7ff-4a5a-86e3-853e9382d568 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1406 microversion: 2.20 time: 0.352158 Oct 23 01:26:06.458347 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1932/3822] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:26:06 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1406 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:26:06.470675 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cbe2a472-e448-4e74-80f8-ff7c5162cec3 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:06.471586 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-cbe2a472-e448-4e74-80f8-ff7c5162cec3 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] [instance: d27396ae-9295-4187-9ef7-6d7416ee02b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:06.485913 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cbe2a472-e448-4e74-80f8-ff7c5162cec3 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:06.485913 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cbe2a472-e448-4e74-80f8-ff7c5162cec3 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:06.485913 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cbe2a472-e448-4e74-80f8-ff7c5162cec3 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:06.485913 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cbe2a472-e448-4e74-80f8-ff7c5162cec3 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:06.485913 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cbe2a472-e448-4e74-80f8-ff7c5162cec3 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:06.485913 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cbe2a472-e448-4e74-80f8-ff7c5162cec3 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:06.680495 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f697fe27-bf13-42ff-8beb-2aec5f84bfe7 tempest-FloatingIPDetailsTestJSON-945854673 tempest-FloatingIPDetailsTestJSON-945854673-project] 10.222.0.42 "DELETE /compute/v2.1/os-floating-ips/59209f83-1c9f-4dd2-861b-176644ed0199" status: 202 len: 0 microversion: 2.1 time: 1.196617 Oct 23 01:26:06.685246 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1891/3823] 10.222.0.42 () {58 vars in 1263 bytes} [Sun Oct 23 01:26:05 2022] DELETE /compute/v2.1/os-floating-ips/59209f83-1c9f-4dd2-861b-176644ed0199 => generated 0 bytes in 1202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:26:06.691300 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5c10d097-441e-4f9b-9250-77340a85eb18 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:06.692176 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5c10d097-441e-4f9b-9250-77340a85eb18 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] [instance: ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:06.699285 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5c10d097-441e-4f9b-9250-77340a85eb18 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:06.700228 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5c10d097-441e-4f9b-9250-77340a85eb18 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:06.701016 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5c10d097-441e-4f9b-9250-77340a85eb18 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:06.701942 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5c10d097-441e-4f9b-9250-77340a85eb18 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:06.702592 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5c10d097-441e-4f9b-9250-77340a85eb18 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:06.703505 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5c10d097-441e-4f9b-9250-77340a85eb18 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:06.707851 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cbe2a472-e448-4e74-80f8-ff7c5162cec3 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb8ce5c15bd4a6199cfdf84c49837ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb23cbc0c142a2a4b7a39df99a7d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:06.719307 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cbe2a472-e448-4e74-80f8-ff7c5162cec3 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] 10.222.0.42 "GET /compute/v2.1/servers/d27396ae-9295-4187-9ef7-6d7416ee02b0" status: 200 len: 1350 microversion: 2.1 time: 0.258974 Oct 23 01:26:06.720141 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1933/3824] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:06 2022] GET /compute/v2.1/servers/d27396ae-9295-4187-9ef7-6d7416ee02b0 => generated 1350 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:07.192854 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5c10d097-441e-4f9b-9250-77340a85eb18 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1fb3cadf09d4d5da19e37b0080a0f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf117bb5bf4e76b3bab3ef518dce11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:07.204597 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5c10d097-441e-4f9b-9250-77340a85eb18 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/servers/ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d" status: 200 len: 1317 microversion: 2.1 time: 0.517600 Oct 23 01:26:07.206462 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1892/3825] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:06 2022] GET /compute/v2.1/servers/ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d => generated 1317 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:07.479810 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-51ccf5b2-718b-49e6-9471-28349182aacd tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:07.480525 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-51ccf5b2-718b-49e6-9471-28349182aacd tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:07.489520 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-51ccf5b2-718b-49e6-9471-28349182aacd tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:07.493644 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-51ccf5b2-718b-49e6-9471-28349182aacd tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:07.493644 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-51ccf5b2-718b-49e6-9471-28349182aacd tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:07.493644 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-51ccf5b2-718b-49e6-9471-28349182aacd tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:07.493644 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-51ccf5b2-718b-49e6-9471-28349182aacd tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:07.493644 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-51ccf5b2-718b-49e6-9471-28349182aacd tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:07.666569 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-51ccf5b2-718b-49e6-9471-28349182aacd tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:07.675575 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-51ccf5b2-718b-49e6-9471-28349182aacd tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:07.677049 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-51ccf5b2-718b-49e6-9471-28349182aacd tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:07.678472 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-51ccf5b2-718b-49e6-9471-28349182aacd tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1406 microversion: 2.20 time: 0.205991 Oct 23 01:26:07.690001 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1934/3826] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:26:07 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1406 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:26:07.690396 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-8ea1ab4b-c358-4933-9000-90e743533105 req-ab775b69-8ba8-4919-9f5f-96d51e279eab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d27396ae-9295-4187-9ef7-6d7416ee02b0", "tag": "fc1e5b9c-a069-4fdd-bbaf-44813ca2a747"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:26:07.717571 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-8ea1ab4b-c358-4933-9000-90e743533105 req-ab775b69-8ba8-4919-9f5f-96d51e279eab service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:07.718425 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-8ea1ab4b-c358-4933-9000-90e743533105 req-ab775b69-8ba8-4919-9f5f-96d51e279eab service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:07.720204 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-8ea1ab4b-c358-4933-9000-90e743533105 req-ab775b69-8ba8-4919-9f5f-96d51e279eab service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:07.735431 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-8ea1ab4b-c358-4933-9000-90e743533105 req-ab775b69-8ba8-4919-9f5f-96d51e279eab service nova] Creating event network-changed:fc1e5b9c-a069-4fdd-bbaf-44813ca2a747 for instance d27396ae-9295-4187-9ef7-6d7416ee02b0 on n-h2-master-1 Oct 23 01:26:07.741639 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-8ea1ab4b-c358-4933-9000-90e743533105 req-ab775b69-8ba8-4919-9f5f-96d51e279eab service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061532 Oct 23 01:26:07.742914 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1893/3827] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:26:07.743432 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ba284349-67b2-4a0f-9871-c71c90493b22 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:07.744449 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ba284349-67b2-4a0f-9871-c71c90493b22 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] [instance: d27396ae-9295-4187-9ef7-6d7416ee02b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:07.751124 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba284349-67b2-4a0f-9871-c71c90493b22 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:07.751513 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba284349-67b2-4a0f-9871-c71c90493b22 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:07.751927 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba284349-67b2-4a0f-9871-c71c90493b22 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:07.753444 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba284349-67b2-4a0f-9871-c71c90493b22 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:07.754317 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba284349-67b2-4a0f-9871-c71c90493b22 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:07.755545 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba284349-67b2-4a0f-9871-c71c90493b22 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:07.949832 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ba284349-67b2-4a0f-9871-c71c90493b22 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb8ce5c15bd4a6199cfdf84c49837ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb23cbc0c142a2a4b7a39df99a7d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:07.960637 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ba284349-67b2-4a0f-9871-c71c90493b22 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] 10.222.0.42 "GET /compute/v2.1/servers/d27396ae-9295-4187-9ef7-6d7416ee02b0" status: 200 len: 1350 microversion: 2.1 time: 0.222029 Oct 23 01:26:07.961320 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1935/3828] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:07 2022] GET /compute/v2.1/servers/d27396ae-9295-4187-9ef7-6d7416ee02b0 => generated 1350 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:08.228772 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b9dd8137-a3b0-458b-a50c-984e4202ab44 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:08.229588 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b9dd8137-a3b0-458b-a50c-984e4202ab44 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] [instance: ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:08.236091 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9dd8137-a3b0-458b-a50c-984e4202ab44 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:08.236681 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9dd8137-a3b0-458b-a50c-984e4202ab44 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:08.237191 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9dd8137-a3b0-458b-a50c-984e4202ab44 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:08.237956 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9dd8137-a3b0-458b-a50c-984e4202ab44 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:08.238449 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9dd8137-a3b0-458b-a50c-984e4202ab44 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:08.238877 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9dd8137-a3b0-458b-a50c-984e4202ab44 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:08.368106 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b9dd8137-a3b0-458b-a50c-984e4202ab44 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1fb3cadf09d4d5da19e37b0080a0f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf117bb5bf4e76b3bab3ef518dce11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:08.375828 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b9dd8137-a3b0-458b-a50c-984e4202ab44 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/servers/ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d" status: 200 len: 1317 microversion: 2.1 time: 0.151426 Oct 23 01:26:08.376410 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1894/3829] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:08 2022] GET /compute/v2.1/servers/ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:08.706970 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e3763831-2482-476c-9435-e3bde2b57d36 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:08.711115 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e3763831-2482-476c-9435-e3bde2b57d36 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:08.715136 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e3763831-2482-476c-9435-e3bde2b57d36 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:08.715635 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e3763831-2482-476c-9435-e3bde2b57d36 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:08.716083 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e3763831-2482-476c-9435-e3bde2b57d36 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:08.716795 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e3763831-2482-476c-9435-e3bde2b57d36 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:08.717259 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e3763831-2482-476c-9435-e3bde2b57d36 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:08.717802 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e3763831-2482-476c-9435-e3bde2b57d36 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:08.863055 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e3763831-2482-476c-9435-e3bde2b57d36 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:08.873089 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e3763831-2482-476c-9435-e3bde2b57d36 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:08.875777 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e3763831-2482-476c-9435-e3bde2b57d36 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:08.877129 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e3763831-2482-476c-9435-e3bde2b57d36 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1597 microversion: 2.20 time: 0.175743 Oct 23 01:26:08.887109 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1936/3830] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:26:08 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1597 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:26:08.901790 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-06b24d15-bee0-4c1c-b6df-74b7f583bd81 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:08.902381 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-06b24d15-bee0-4c1c-b6df-74b7f583bd81 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:08.909301 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-06b24d15-bee0-4c1c-b6df-74b7f583bd81 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:08.911586 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-06b24d15-bee0-4c1c-b6df-74b7f583bd81 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:08.911586 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-06b24d15-bee0-4c1c-b6df-74b7f583bd81 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:08.911586 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-06b24d15-bee0-4c1c-b6df-74b7f583bd81 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:08.912219 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-06b24d15-bee0-4c1c-b6df-74b7f583bd81 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:08.912660 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-06b24d15-bee0-4c1c-b6df-74b7f583bd81 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:08.984633 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-456b4a13-6811-4936-a02e-ac79d8cfa50d tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:08.985259 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-456b4a13-6811-4936-a02e-ac79d8cfa50d tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] [instance: d27396ae-9295-4187-9ef7-6d7416ee02b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:08.991599 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-456b4a13-6811-4936-a02e-ac79d8cfa50d tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:08.992338 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-456b4a13-6811-4936-a02e-ac79d8cfa50d tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:08.992784 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-456b4a13-6811-4936-a02e-ac79d8cfa50d tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:08.993489 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-456b4a13-6811-4936-a02e-ac79d8cfa50d tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:08.995918 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-06b24d15-bee0-4c1c-b6df-74b7f583bd81 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.098095 Oct 23 01:26:08.996569 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1895/3831] 10.222.0.42 () {60 vars in 1316 bytes} [Sun Oct 23 01:26:08 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:26:09.004327 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-456b4a13-6811-4936-a02e-ac79d8cfa50d tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:09.004327 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-456b4a13-6811-4936-a02e-ac79d8cfa50d tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:09.255170 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-456b4a13-6811-4936-a02e-ac79d8cfa50d tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb8ce5c15bd4a6199cfdf84c49837ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb23cbc0c142a2a4b7a39df99a7d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:09.264075 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-456b4a13-6811-4936-a02e-ac79d8cfa50d tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] 10.222.0.42 "GET /compute/v2.1/servers/d27396ae-9295-4187-9ef7-6d7416ee02b0" status: 200 len: 1350 microversion: 2.1 time: 0.283731 Oct 23 01:26:09.279809 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1937/3832] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:08 2022] GET /compute/v2.1/servers/d27396ae-9295-4187-9ef7-6d7416ee02b0 => generated 1350 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:26:09.399156 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5e9b7dd3-249f-4b11-be50-b1a4bf0a29ed tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:09.406933 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5e9b7dd3-249f-4b11-be50-b1a4bf0a29ed tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] [instance: ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:09.408863 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e9b7dd3-249f-4b11-be50-b1a4bf0a29ed tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:09.410199 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e9b7dd3-249f-4b11-be50-b1a4bf0a29ed tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:09.411683 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e9b7dd3-249f-4b11-be50-b1a4bf0a29ed tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:09.413887 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e9b7dd3-249f-4b11-be50-b1a4bf0a29ed tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:09.414557 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e9b7dd3-249f-4b11-be50-b1a4bf0a29ed tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:09.416280 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e9b7dd3-249f-4b11-be50-b1a4bf0a29ed tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:09.471042 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:26:09.765280 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5e9b7dd3-249f-4b11-be50-b1a4bf0a29ed tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1fb3cadf09d4d5da19e37b0080a0f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf117bb5bf4e76b3bab3ef518dce11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:09.773622 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5e9b7dd3-249f-4b11-be50-b1a4bf0a29ed tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/servers/ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d" status: 200 len: 1317 microversion: 2.1 time: 0.378600 Oct 23 01:26:09.783374 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1896/3833] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:09 2022] GET /compute/v2.1/servers/ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d => generated 1317 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:10.290953 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e932e642-aaf6-43ab-8332-cf00a814c094 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:10.292205 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e932e642-aaf6-43ab-8332-cf00a814c094 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] [instance: d27396ae-9295-4187-9ef7-6d7416ee02b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:10.307559 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e932e642-aaf6-43ab-8332-cf00a814c094 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:10.310261 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e932e642-aaf6-43ab-8332-cf00a814c094 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:10.310261 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e932e642-aaf6-43ab-8332-cf00a814c094 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:10.311008 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e932e642-aaf6-43ab-8332-cf00a814c094 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:10.311439 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e932e642-aaf6-43ab-8332-cf00a814c094 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:10.311873 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e932e642-aaf6-43ab-8332-cf00a814c094 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:10.365685 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=100 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:26:10.783097 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e932e642-aaf6-43ab-8332-cf00a814c094 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb8ce5c15bd4a6199cfdf84c49837ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb23cbc0c142a2a4b7a39df99a7d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:10.796567 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e932e642-aaf6-43ab-8332-cf00a814c094 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] 10.222.0.42 "GET /compute/v2.1/servers/d27396ae-9295-4187-9ef7-6d7416ee02b0" status: 200 len: 1350 microversion: 2.1 time: 0.510085 Oct 23 01:26:10.800003 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1938/3834] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:10 2022] GET /compute/v2.1/servers/d27396ae-9295-4187-9ef7-6d7416ee02b0 => generated 1350 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:10.801122 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=8 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:26:10.818064 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e367f188-dfc3-4fb0-96b3-796f5f1d878c tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:10.819244 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e367f188-dfc3-4fb0-96b3-796f5f1d878c tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] [instance: ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:10.833069 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e367f188-dfc3-4fb0-96b3-796f5f1d878c tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:10.834727 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e367f188-dfc3-4fb0-96b3-796f5f1d878c tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:10.837443 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e367f188-dfc3-4fb0-96b3-796f5f1d878c tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:10.838245 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e367f188-dfc3-4fb0-96b3-796f5f1d878c tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:10.840979 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e367f188-dfc3-4fb0-96b3-796f5f1d878c tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:10.842972 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e367f188-dfc3-4fb0-96b3-796f5f1d878c tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:11.114854 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-7a03c348-7ffc-4235-b8e1-66c78f831b4e req-62b31baa-9c9e-47c8-a0df-317cd73d4b78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6eb59b7-d1ee-442c-8142-19a88ad6a039", "tag": "82e540c0-e210-47a2-a17d-495549fe7222"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:26:11.145376 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-7a03c348-7ffc-4235-b8e1-66c78f831b4e req-62b31baa-9c9e-47c8-a0df-317cd73d4b78 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:11.149691 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-7a03c348-7ffc-4235-b8e1-66c78f831b4e req-62b31baa-9c9e-47c8-a0df-317cd73d4b78 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:11.151839 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-7a03c348-7ffc-4235-b8e1-66c78f831b4e req-62b31baa-9c9e-47c8-a0df-317cd73d4b78 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:11.153674 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e367f188-dfc3-4fb0-96b3-796f5f1d878c tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1fb3cadf09d4d5da19e37b0080a0f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf117bb5bf4e76b3bab3ef518dce11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:11.163940 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e367f188-dfc3-4fb0-96b3-796f5f1d878c tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/servers/ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d" status: 200 len: 1317 microversion: 2.1 time: 0.349755 Oct 23 01:26:11.171092 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1939/3835] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:10 2022] GET /compute/v2.1/servers/ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d => generated 1317 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:11.186596 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-7a03c348-7ffc-4235-b8e1-66c78f831b4e req-62b31baa-9c9e-47c8-a0df-317cd73d4b78 service nova] Creating event network-changed:82e540c0-e210-47a2-a17d-495549fe7222 for instance c6eb59b7-d1ee-442c-8142-19a88ad6a039 on n-h1-master-1 Oct 23 01:26:11.200902 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-7a03c348-7ffc-4235-b8e1-66c78f831b4e req-62b31baa-9c9e-47c8-a0df-317cd73d4b78 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.406194 Oct 23 01:26:11.209284 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1897/3836] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:26:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:26:11.828468 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8ff96795-a109-49b3-92d4-0cec4c70a110 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:11.830972 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8ff96795-a109-49b3-92d4-0cec4c70a110 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] [instance: d27396ae-9295-4187-9ef7-6d7416ee02b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:11.848509 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ff96795-a109-49b3-92d4-0cec4c70a110 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:11.849915 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ff96795-a109-49b3-92d4-0cec4c70a110 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:11.851366 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ff96795-a109-49b3-92d4-0cec4c70a110 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:11.853315 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ff96795-a109-49b3-92d4-0cec4c70a110 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:11.854662 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ff96795-a109-49b3-92d4-0cec4c70a110 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:11.858045 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ff96795-a109-49b3-92d4-0cec4c70a110 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:12.052124 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8ff96795-a109-49b3-92d4-0cec4c70a110 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb8ce5c15bd4a6199cfdf84c49837ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb23cbc0c142a2a4b7a39df99a7d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:12.072671 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8ff96795-a109-49b3-92d4-0cec4c70a110 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] 10.222.0.42 "GET /compute/v2.1/servers/d27396ae-9295-4187-9ef7-6d7416ee02b0" status: 200 len: 1350 microversion: 2.1 time: 0.241916 Oct 23 01:26:12.074048 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1940/3837] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:11 2022] GET /compute/v2.1/servers/d27396ae-9295-4187-9ef7-6d7416ee02b0 => generated 1350 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:12.101831 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-28fca0eb-f3d2-4ad9-a7d1-ac13ceb54a0c req-1e5731e6-6cc6-4c6e-a2de-53f5e6a8c08c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d", "name": "network-vif-plugged", "status": "completed", "tag": "007e6906-2969-451c-bd1b-9c4c9e24d5ed"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:26:12.122567 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-28fca0eb-f3d2-4ad9-a7d1-ac13ceb54a0c req-1e5731e6-6cc6-4c6e-a2de-53f5e6a8c08c service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:12.123408 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-28fca0eb-f3d2-4ad9-a7d1-ac13ceb54a0c req-1e5731e6-6cc6-4c6e-a2de-53f5e6a8c08c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:12.124084 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-28fca0eb-f3d2-4ad9-a7d1-ac13ceb54a0c req-1e5731e6-6cc6-4c6e-a2de-53f5e6a8c08c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:12.144640 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-28fca0eb-f3d2-4ad9-a7d1-ac13ceb54a0c req-1e5731e6-6cc6-4c6e-a2de-53f5e6a8c08c service nova] Creating event network-vif-plugged:007e6906-2969-451c-bd1b-9c4c9e24d5ed for instance ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d on n-h1-master-1 Oct 23 01:26:12.154523 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-28fca0eb-f3d2-4ad9-a7d1-ac13ceb54a0c req-1e5731e6-6cc6-4c6e-a2de-53f5e6a8c08c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059195 Oct 23 01:26:12.157180 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1898/3838] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:26:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:26:12.189998 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d3b6c0ec-20d5-4b5d-bc92-2abc804b9670 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:12.191007 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d3b6c0ec-20d5-4b5d-bc92-2abc804b9670 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] [instance: ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:12.197764 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d3b6c0ec-20d5-4b5d-bc92-2abc804b9670 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:12.198390 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d3b6c0ec-20d5-4b5d-bc92-2abc804b9670 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:12.199044 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d3b6c0ec-20d5-4b5d-bc92-2abc804b9670 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:12.199758 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d3b6c0ec-20d5-4b5d-bc92-2abc804b9670 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:12.200220 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d3b6c0ec-20d5-4b5d-bc92-2abc804b9670 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:12.200838 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d3b6c0ec-20d5-4b5d-bc92-2abc804b9670 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:12.468915 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d3b6c0ec-20d5-4b5d-bc92-2abc804b9670 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1fb3cadf09d4d5da19e37b0080a0f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf117bb5bf4e76b3bab3ef518dce11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:12.480240 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d3b6c0ec-20d5-4b5d-bc92-2abc804b9670 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/servers/ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d" status: 200 len: 1317 microversion: 2.1 time: 0.294767 Oct 23 01:26:12.481080 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1941/3839] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:12 2022] GET /compute/v2.1/servers/ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d => generated 1317 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:13.087264 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9d7c9732-5a0e-48de-bfa8-22470a20af27 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:13.088601 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9d7c9732-5a0e-48de-bfa8-22470a20af27 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] [instance: d27396ae-9295-4187-9ef7-6d7416ee02b0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:13.100290 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d7c9732-5a0e-48de-bfa8-22470a20af27 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:13.100780 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d7c9732-5a0e-48de-bfa8-22470a20af27 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:13.101276 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d7c9732-5a0e-48de-bfa8-22470a20af27 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:13.111220 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d7c9732-5a0e-48de-bfa8-22470a20af27 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:13.115055 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d7c9732-5a0e-48de-bfa8-22470a20af27 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:13.122325 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d7c9732-5a0e-48de-bfa8-22470a20af27 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:13.353334 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9d7c9732-5a0e-48de-bfa8-22470a20af27 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb8ce5c15bd4a6199cfdf84c49837ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb23cbc0c142a2a4b7a39df99a7d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:13.366467 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9d7c9732-5a0e-48de-bfa8-22470a20af27 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] 10.222.0.42 "GET /compute/v2.1/servers/d27396ae-9295-4187-9ef7-6d7416ee02b0" status: 200 len: 1350 microversion: 2.1 time: 0.281913 Oct 23 01:26:13.369894 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1899/3840] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:13 2022] GET /compute/v2.1/servers/d27396ae-9295-4187-9ef7-6d7416ee02b0 => generated 1350 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:26:13.506192 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8fbdc267-284b-452b-b494-45b7b22e14bc tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:13.507012 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8fbdc267-284b-452b-b494-45b7b22e14bc tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] [instance: ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:13.523734 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8fbdc267-284b-452b-b494-45b7b22e14bc tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:13.523734 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8fbdc267-284b-452b-b494-45b7b22e14bc tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:13.523734 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8fbdc267-284b-452b-b494-45b7b22e14bc tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:13.523734 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8fbdc267-284b-452b-b494-45b7b22e14bc tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:13.523734 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8fbdc267-284b-452b-b494-45b7b22e14bc tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:13.523734 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8fbdc267-284b-452b-b494-45b7b22e14bc tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:13.744818 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8fbdc267-284b-452b-b494-45b7b22e14bc tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1fb3cadf09d4d5da19e37b0080a0f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf117bb5bf4e76b3bab3ef518dce11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:13.753281 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8fbdc267-284b-452b-b494-45b7b22e14bc tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/servers/ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d" status: 200 len: 1317 microversion: 2.1 time: 0.252268 Oct 23 01:26:13.753852 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1942/3841] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:13 2022] GET /compute/v2.1/servers/ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d => generated 1317 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:14.392778 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-25427d3d-9379-4f35-a5ba-0c645bac739f tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:14.393529 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-25427d3d-9379-4f35-a5ba-0c645bac739f tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] [instance: d27396ae-9295-4187-9ef7-6d7416ee02b0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:14.402073 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25427d3d-9379-4f35-a5ba-0c645bac739f tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:14.402673 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25427d3d-9379-4f35-a5ba-0c645bac739f tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:14.403110 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25427d3d-9379-4f35-a5ba-0c645bac739f tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:14.403810 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25427d3d-9379-4f35-a5ba-0c645bac739f tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:14.404258 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25427d3d-9379-4f35-a5ba-0c645bac739f tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:14.405059 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25427d3d-9379-4f35-a5ba-0c645bac739f tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:14.562623 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-25427d3d-9379-4f35-a5ba-0c645bac739f tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb8ce5c15bd4a6199cfdf84c49837ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb23cbc0c142a2a4b7a39df99a7d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:14.573606 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-25427d3d-9379-4f35-a5ba-0c645bac739f tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] 10.222.0.42 "GET /compute/v2.1/servers/d27396ae-9295-4187-9ef7-6d7416ee02b0" status: 200 len: 1350 microversion: 2.1 time: 0.185587 Oct 23 01:26:14.575168 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1900/3842] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:14 2022] GET /compute/v2.1/servers/d27396ae-9295-4187-9ef7-6d7416ee02b0 => generated 1350 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:14.777310 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-038bc288-2538-4a3f-8ea2-7f7289e775e4 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:14.777961 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-038bc288-2538-4a3f-8ea2-7f7289e775e4 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] [instance: ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:14.785335 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-038bc288-2538-4a3f-8ea2-7f7289e775e4 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:14.785849 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-038bc288-2538-4a3f-8ea2-7f7289e775e4 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:14.786414 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-038bc288-2538-4a3f-8ea2-7f7289e775e4 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:14.787119 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-038bc288-2538-4a3f-8ea2-7f7289e775e4 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:14.787613 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-038bc288-2538-4a3f-8ea2-7f7289e775e4 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:14.788007 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-038bc288-2538-4a3f-8ea2-7f7289e775e4 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:14.936871 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-038bc288-2538-4a3f-8ea2-7f7289e775e4 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1fb3cadf09d4d5da19e37b0080a0f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf117bb5bf4e76b3bab3ef518dce11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:14.946722 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-038bc288-2538-4a3f-8ea2-7f7289e775e4 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/servers/ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d" status: 200 len: 1467 microversion: 2.1 time: 0.173463 Oct 23 01:26:14.948393 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1943/3843] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:14 2022] GET /compute/v2.1/servers/ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d => generated 1467 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:14.969449 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e31a102f-5031-43b1-b8e9-f542210ed27f tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-80768052", "metadata": {"image_type": "test"}}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:26:14.971950 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e31a102f-5031-43b1-b8e9-f542210ed27f tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] [instance: ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:14.977916 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e31a102f-5031-43b1-b8e9-f542210ed27f tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:14.978447 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e31a102f-5031-43b1-b8e9-f542210ed27f tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:14.978884 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e31a102f-5031-43b1-b8e9-f542210ed27f tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:14.979583 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e31a102f-5031-43b1-b8e9-f542210ed27f tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:14.980039 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e31a102f-5031-43b1-b8e9-f542210ed27f tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:14.980464 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e31a102f-5031-43b1-b8e9-f542210ed27f tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:15.029461 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-e31a102f-5031-43b1-b8e9-f542210ed27f tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Getting quotas for project badf117bb5bf4e76b3bab3ef518dce11. Resources: dict_keys(['metadata_items']) {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:26:15.039023 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-e31a102f-5031-43b1-b8e9-f542210ed27f tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Getting quotas for user c1fb3cadf09d4d5da19e37b0080a0f26 and project badf117bb5bf4e76b3bab3ef518dce11. Resources: dict_keys(['metadata_items']) {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:26:15.601569 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f65ccd00-087c-4ddd-be70-6854d194b260 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:15.603897 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f65ccd00-087c-4ddd-be70-6854d194b260 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] [instance: d27396ae-9295-4187-9ef7-6d7416ee02b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:15.612583 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e31a102f-5031-43b1-b8e9-f542210ed27f tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "POST /compute/v2.1/servers/ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d/action" status: 202 len: 0 microversion: 2.1 time: 0.646778 Oct 23 01:26:15.616329 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1901/3844] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:26:14 2022] POST /compute/v2.1/servers/ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d/action => generated 0 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 23 01:26:15.619129 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f65ccd00-087c-4ddd-be70-6854d194b260 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:15.620406 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f65ccd00-087c-4ddd-be70-6854d194b260 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:15.621172 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f65ccd00-087c-4ddd-be70-6854d194b260 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:15.628040 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f65ccd00-087c-4ddd-be70-6854d194b260 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:15.630382 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f65ccd00-087c-4ddd-be70-6854d194b260 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:15.631887 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f65ccd00-087c-4ddd-be70-6854d194b260 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:15.638274 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e638adf5-b008-48f8-b1e9-dbfedf29dcfa tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '.version_select at 0x7f5cc6205430>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:15.708354 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e638adf5-b008-48f8-b1e9-dbfedf29dcfa tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/images/cc5e23d8-d864-48d6-b8a1-beb73b289f7b" status: 200 len: 1420 microversion: 2.1 time: 0.084798 Oct 23 01:26:15.723203 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1902/3845] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:26:15 2022] GET /compute/v2.1/images/cc5e23d8-d864-48d6-b8a1-beb73b289f7b => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:26:15.910354 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f65ccd00-087c-4ddd-be70-6854d194b260 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb8ce5c15bd4a6199cfdf84c49837ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb23cbc0c142a2a4b7a39df99a7d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:15.920728 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f65ccd00-087c-4ddd-be70-6854d194b260 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] 10.222.0.42 "GET /compute/v2.1/servers/d27396ae-9295-4187-9ef7-6d7416ee02b0" status: 200 len: 1350 microversion: 2.1 time: 0.325836 Oct 23 01:26:15.922082 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1944/3846] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:15 2022] GET /compute/v2.1/servers/d27396ae-9295-4187-9ef7-6d7416ee02b0 => generated 1350 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:16.114379 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-d11e3305-f5ca-4168-9168-c9b12040e662 req-21d403da-98a0-4116-b1ae-d1d7e8326754 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d27396ae-9295-4187-9ef7-6d7416ee02b0", "name": "network-vif-plugged", "status": "completed", "tag": "fc1e5b9c-a069-4fdd-bbaf-44813ca2a747"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:26:16.140335 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-d11e3305-f5ca-4168-9168-c9b12040e662 req-21d403da-98a0-4116-b1ae-d1d7e8326754 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:16.140814 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-d11e3305-f5ca-4168-9168-c9b12040e662 req-21d403da-98a0-4116-b1ae-d1d7e8326754 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:16.141257 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-d11e3305-f5ca-4168-9168-c9b12040e662 req-21d403da-98a0-4116-b1ae-d1d7e8326754 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:16.165240 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-d11e3305-f5ca-4168-9168-c9b12040e662 req-21d403da-98a0-4116-b1ae-d1d7e8326754 service nova] Creating event network-vif-plugged:fc1e5b9c-a069-4fdd-bbaf-44813ca2a747 for instance d27396ae-9295-4187-9ef7-6d7416ee02b0 on n-h2-master-1 Oct 23 01:26:16.176316 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-d11e3305-f5ca-4168-9168-c9b12040e662 req-21d403da-98a0-4116-b1ae-d1d7e8326754 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065920 Oct 23 01:26:16.176949 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1903/3847] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:26:16.724734 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dafdb627-aeae-40a2-8920-1e5f9770c94d tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '.version_select at 0x7f5cc0fd6670>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:16.768454 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-dafdb627-aeae-40a2-8920-1e5f9770c94d tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/images/cc5e23d8-d864-48d6-b8a1-beb73b289f7b" status: 200 len: 1420 microversion: 2.1 time: 0.047576 Oct 23 01:26:16.769036 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1945/3848] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:26:16 2022] GET /compute/v2.1/images/cc5e23d8-d864-48d6-b8a1-beb73b289f7b => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:16.946150 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-50c9d186-073f-4102-ae3b-386aeec43432 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:16.946906 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-50c9d186-073f-4102-ae3b-386aeec43432 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] [instance: d27396ae-9295-4187-9ef7-6d7416ee02b0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:16.954113 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-50c9d186-073f-4102-ae3b-386aeec43432 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:16.954612 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-50c9d186-073f-4102-ae3b-386aeec43432 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:16.955046 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-50c9d186-073f-4102-ae3b-386aeec43432 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:16.955747 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-50c9d186-073f-4102-ae3b-386aeec43432 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:16.956201 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-50c9d186-073f-4102-ae3b-386aeec43432 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:16.956625 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-50c9d186-073f-4102-ae3b-386aeec43432 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:17.148746 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-50c9d186-073f-4102-ae3b-386aeec43432 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb8ce5c15bd4a6199cfdf84c49837ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb23cbc0c142a2a4b7a39df99a7d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:17.157388 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-50c9d186-073f-4102-ae3b-386aeec43432 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] 10.222.0.42 "GET /compute/v2.1/servers/d27396ae-9295-4187-9ef7-6d7416ee02b0" status: 200 len: 1350 microversion: 2.1 time: 0.216300 Oct 23 01:26:17.158319 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1904/3849] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:16 2022] GET /compute/v2.1/servers/d27396ae-9295-4187-9ef7-6d7416ee02b0 => generated 1350 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:17.787264 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ac0b3950-5fa7-434b-9bc0-d9b4d21dd14f tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '.version_select at 0x7f5cc16e04c0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:17.834555 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ac0b3950-5fa7-434b-9bc0-d9b4d21dd14f tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/images/cc5e23d8-d864-48d6-b8a1-beb73b289f7b" status: 200 len: 1420 microversion: 2.1 time: 0.054954 Oct 23 01:26:17.835146 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1946/3850] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:26:17 2022] GET /compute/v2.1/images/cc5e23d8-d864-48d6-b8a1-beb73b289f7b => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:18.180379 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9f0f5ca8-e0ac-4d58-b26b-25bc7f32ff60 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:18.180993 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9f0f5ca8-e0ac-4d58-b26b-25bc7f32ff60 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] [instance: d27396ae-9295-4187-9ef7-6d7416ee02b0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:18.188144 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f0f5ca8-e0ac-4d58-b26b-25bc7f32ff60 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:18.190885 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f0f5ca8-e0ac-4d58-b26b-25bc7f32ff60 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:18.190885 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f0f5ca8-e0ac-4d58-b26b-25bc7f32ff60 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:18.190885 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f0f5ca8-e0ac-4d58-b26b-25bc7f32ff60 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:18.190885 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f0f5ca8-e0ac-4d58-b26b-25bc7f32ff60 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:18.190885 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f0f5ca8-e0ac-4d58-b26b-25bc7f32ff60 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:18.328608 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-aa0d0419-4106-409f-8dec-dc1e90463066 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc10e34c0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:18.371244 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-aa0d0419-4106-409f-8dec-dc1e90463066 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images/a06024e3-3441-4336-9669-e39d31cd51ab" status: 200 len: 661 microversion: 2.1 time: 0.047060 Oct 23 01:26:18.372088 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1947/3851] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:26:18 2022] GET /compute/v2.1/images/a06024e3-3441-4336-9669-e39d31cd51ab => generated 661 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:26:18.386201 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cc15345d-f7a6-4a9b-8646-f5e1c074b6b4 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc0feaaf0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:18.426989 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cc15345d-f7a6-4a9b-8646-f5e1c074b6b4 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images/a06024e3-3441-4336-9669-e39d31cd51ab" status: 200 len: 661 microversion: 2.1 time: 0.044534 Oct 23 01:26:18.427568 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1948/3852] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:26:18 2022] GET /compute/v2.1/images/a06024e3-3441-4336-9669-e39d31cd51ab => generated 661 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:26:18.468440 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9f0f5ca8-e0ac-4d58-b26b-25bc7f32ff60 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb8ce5c15bd4a6199cfdf84c49837ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb23cbc0c142a2a4b7a39df99a7d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:18.478069 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9f0f5ca8-e0ac-4d58-b26b-25bc7f32ff60 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] 10.222.0.42 "GET /compute/v2.1/servers/d27396ae-9295-4187-9ef7-6d7416ee02b0" status: 200 len: 1540 microversion: 2.1 time: 0.301750 Oct 23 01:26:18.478661 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1905/3853] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:18 2022] GET /compute/v2.1/servers/d27396ae-9295-4187-9ef7-6d7416ee02b0 => generated 1540 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:18.502580 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-927d79ee-0a0f-4b98-bd10-96967f4d8d88 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:18.506063 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-927d79ee-0a0f-4b98-bd10-96967f4d8d88 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] [instance: d27396ae-9295-4187-9ef7-6d7416ee02b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:18.512462 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-927d79ee-0a0f-4b98-bd10-96967f4d8d88 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:18.512962 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-927d79ee-0a0f-4b98-bd10-96967f4d8d88 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:18.513406 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-927d79ee-0a0f-4b98-bd10-96967f4d8d88 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:18.514237 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-927d79ee-0a0f-4b98-bd10-96967f4d8d88 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:18.514596 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-927d79ee-0a0f-4b98-bd10-96967f4d8d88 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:18.515643 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-927d79ee-0a0f-4b98-bd10-96967f4d8d88 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:18.621110 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-927d79ee-0a0f-4b98-bd10-96967f4d8d88 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] 10.222.0.42 "GET /compute/v2.1/servers/d27396ae-9295-4187-9ef7-6d7416ee02b0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.122303 Oct 23 01:26:18.621110 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1949/3854] 10.222.0.42 () {58 vars in 1275 bytes} [Sun Oct 23 01:26:18 2022] GET /compute/v2.1/servers/d27396ae-9295-4187-9ef7-6d7416ee02b0/os-interface => generated 284 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:26:18.852885 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bd29105c-d19a-4ecf-ad3d-9922272655f0 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '.version_select at 0x7f5cc62c4f70>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:18.907711 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bd29105c-d19a-4ecf-ad3d-9922272655f0 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/images/cc5e23d8-d864-48d6-b8a1-beb73b289f7b" status: 200 len: 1420 microversion: 2.1 time: 0.059327 Oct 23 01:26:18.908297 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1906/3855] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:26:18 2022] GET /compute/v2.1/images/cc5e23d8-d864-48d6-b8a1-beb73b289f7b => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:19.924424 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-22fa2879-b584-42a9-811d-782ad58826ac tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '.version_select at 0x7f5cc108e1f0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:20.433393 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f0d7178e-e535-42a2-bbf2-9bdc20aa8fbb tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc1708c10>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:20.535901 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-22fa2879-b584-42a9-811d-782ad58826ac tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/images/cc5e23d8-d864-48d6-b8a1-beb73b289f7b" status: 200 len: 1420 microversion: 2.1 time: 0.616167 Oct 23 01:26:20.544085 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1950/3856] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:26:19 2022] GET /compute/v2.1/images/cc5e23d8-d864-48d6-b8a1-beb73b289f7b => generated 1420 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:20.574896 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-c01f7a13-fec1-40bb-9a1a-6c470112cf75 req-cef4b230-9bf7-490a-8a3f-8bc07d3d7bc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d27396ae-9295-4187-9ef7-6d7416ee02b0", "tag": "fc1e5b9c-a069-4fdd-bbaf-44813ca2a747"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:26:20.582703 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f0d7178e-e535-42a2-bbf2-9bdc20aa8fbb tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images/eb5a8a92-5612-4503-b9cd-997d9d49d37b" status: 200 len: 661 microversion: 2.1 time: 0.155683 Oct 23 01:26:20.583291 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1907/3857] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:26:20 2022] GET /compute/v2.1/images/eb5a8a92-5612-4503-b9cd-997d9d49d37b => generated 661 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:26:20.592620 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-c01f7a13-fec1-40bb-9a1a-6c470112cf75 req-cef4b230-9bf7-490a-8a3f-8bc07d3d7bc0 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:20.592620 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-c01f7a13-fec1-40bb-9a1a-6c470112cf75 req-cef4b230-9bf7-490a-8a3f-8bc07d3d7bc0 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:20.592620 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-c01f7a13-fec1-40bb-9a1a-6c470112cf75 req-cef4b230-9bf7-490a-8a3f-8bc07d3d7bc0 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:20.604412 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-c01f7a13-fec1-40bb-9a1a-6c470112cf75 req-cef4b230-9bf7-490a-8a3f-8bc07d3d7bc0 service nova] Creating event network-changed:fc1e5b9c-a069-4fdd-bbaf-44813ca2a747 for instance d27396ae-9295-4187-9ef7-6d7416ee02b0 on n-h2-master-1 Oct 23 01:26:20.605345 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c7f124df-d80e-46fe-b5e0-a03507a5a798 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc62c4ee0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:20.610168 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-c01f7a13-fec1-40bb-9a1a-6c470112cf75 req-cef4b230-9bf7-490a-8a3f-8bc07d3d7bc0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072094 Oct 23 01:26:20.611268 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1951/3858] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:26:20.665813 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c7f124df-d80e-46fe-b5e0-a03507a5a798 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images/eb5a8a92-5612-4503-b9cd-997d9d49d37b" status: 200 len: 661 microversion: 2.1 time: 0.068893 Oct 23 01:26:20.669686 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1908/3859] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:26:20 2022] GET /compute/v2.1/images/eb5a8a92-5612-4503-b9cd-997d9d49d37b => generated 661 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:26:21.557331 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-544b90d9-d3a0-4a21-8b05-bb6ec15c9910 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '.version_select at 0x7f5cc108e670>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:21.659933 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-544b90d9-d3a0-4a21-8b05-bb6ec15c9910 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/images/cc5e23d8-d864-48d6-b8a1-beb73b289f7b" status: 200 len: 1420 microversion: 2.1 time: 0.111422 Oct 23 01:26:21.660522 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1952/3860] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:26:21 2022] GET /compute/v2.1/images/cc5e23d8-d864-48d6-b8a1-beb73b289f7b => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:22.382768 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-122e9648-a517-4b5f-a959-6977d7a46b12 req-7e93b5c7-0a29-46b9-ab94-006e59dec208 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d", "name": "network-vif-plugged", "status": "completed", "tag": "007e6906-2969-451c-bd1b-9c4c9e24d5ed"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:26:22.391411 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=6 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:26:22.403055 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-122e9648-a517-4b5f-a959-6977d7a46b12 req-7e93b5c7-0a29-46b9-ab94-006e59dec208 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:22.404611 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-122e9648-a517-4b5f-a959-6977d7a46b12 req-7e93b5c7-0a29-46b9-ab94-006e59dec208 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:22.405093 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-122e9648-a517-4b5f-a959-6977d7a46b12 req-7e93b5c7-0a29-46b9-ab94-006e59dec208 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:22.417493 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-122e9648-a517-4b5f-a959-6977d7a46b12 req-7e93b5c7-0a29-46b9-ab94-006e59dec208 service nova] Creating event network-vif-plugged:007e6906-2969-451c-bd1b-9c4c9e24d5ed for instance ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d on n-h1-master-1 Oct 23 01:26:22.424633 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-122e9648-a517-4b5f-a959-6977d7a46b12 req-7e93b5c7-0a29-46b9-ab94-006e59dec208 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.396178 Oct 23 01:26:22.429864 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1909/3861] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:26:22.675947 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f01673b8-f349-4458-bdfc-2f297b625298 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '.version_select at 0x7f5cc0fd68b0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:23.285730 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ed5506cc-3107-4216-9828-6d56d38adca0 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc61929d0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:23.351780 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f01673b8-f349-4458-bdfc-2f297b625298 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/images/cc5e23d8-d864-48d6-b8a1-beb73b289f7b" status: 200 len: 1420 microversion: 2.1 time: 0.680661 Oct 23 01:26:23.352372 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1953/3862] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:26:22 2022] GET /compute/v2.1/images/cc5e23d8-d864-48d6-b8a1-beb73b289f7b => generated 1420 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:23.361865 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ed5506cc-3107-4216-9828-6d56d38adca0 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images/a32c241c-7c96-4540-ac0c-d8e44c934115" status: 200 len: 662 microversion: 2.1 time: 0.085456 Oct 23 01:26:23.364836 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1910/3863] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:26:23 2022] GET /compute/v2.1/images/a32c241c-7c96-4540-ac0c-d8e44c934115 => generated 662 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:26:23.380665 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-266f7093-358a-48e9-aa57-7f20dba83de3 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc105a670>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:23.428945 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-266f7093-358a-48e9-aa57-7f20dba83de3 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images/a32c241c-7c96-4540-ac0c-d8e44c934115" status: 200 len: 662 microversion: 2.1 time: 0.052128 Oct 23 01:26:23.443321 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1954/3864] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:26:23 2022] GET /compute/v2.1/images/a32c241c-7c96-4540-ac0c-d8e44c934115 => generated 662 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:26:23.582658 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ec64bbdd-fe12-4bce-8a72-0913ddfff7af tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1285964672", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:26:23.642872 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-ec64bbdd-fe12-4bce-8a72-0913ddfff7af tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] validate_networks() for None {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:26:23.849088 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-ec64bbdd-fe12-4bce-8a72-0913ddfff7af tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:26:23.849512 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-ec64bbdd-fe12-4bce-8a72-0913ddfff7af tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:26:23.850039 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-ec64bbdd-fe12-4bce-8a72-0913ddfff7af tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:26:23.850453 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-ec64bbdd-fe12-4bce-8a72-0913ddfff7af tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:26:23.850867 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-ec64bbdd-fe12-4bce-8a72-0913ddfff7af tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:26:23.860839 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec64bbdd-fe12-4bce-8a72-0913ddfff7af tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:23.861368 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec64bbdd-fe12-4bce-8a72-0913ddfff7af tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:23.866470 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec64bbdd-fe12-4bce-8a72-0913ddfff7af tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:23.866470 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec64bbdd-fe12-4bce-8a72-0913ddfff7af tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:23.866470 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec64bbdd-fe12-4bce-8a72-0913ddfff7af tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:23.866470 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec64bbdd-fe12-4bce-8a72-0913ddfff7af tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:23.883757 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-ec64bbdd-fe12-4bce-8a72-0913ddfff7af tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Getting quotas for project bf35beeccb814ce490d2142b21c2b1c1. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:26:23.891100 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-ec64bbdd-fe12-4bce-8a72-0913ddfff7af tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Getting quotas for user f86e186e88524064b8dca040c1814927 and project bf35beeccb814ce490d2142b21c2b1c1. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:26:23.902036 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ec64bbdd-fe12-4bce-8a72-0913ddfff7af tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:26:23.904425 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ec64bbdd-fe12-4bce-8a72-0913ddfff7af tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] [instance: ad46f590-af38-463e-87db-62c442e08669] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:26:24.075092 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ec64bbdd-fe12-4bce-8a72-0913ddfff7af tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.497723 Oct 23 01:26:24.076411 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1911/3865] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:26:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:26:24.138925 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a3c01653-c067-47fc-8906-d87791f3370b tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-782672664", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:26:24.207210 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-a3c01653-c067-47fc-8906-d87791f3370b tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] validate_networks() for None {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:26:24.369833 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fb05fe67-967d-46d6-890a-fd8b66e17fb5 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '.version_select at 0x7f5cc2a4cdc0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:24.460281 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fb05fe67-967d-46d6-890a-fd8b66e17fb5 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/images/cc5e23d8-d864-48d6-b8a1-beb73b289f7b" status: 200 len: 1420 microversion: 2.1 time: 0.096497 Oct 23 01:26:24.460882 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1912/3866] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:26:24 2022] GET /compute/v2.1/images/cc5e23d8-d864-48d6-b8a1-beb73b289f7b => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:24.541955 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-a3c01653-c067-47fc-8906-d87791f3370b tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:26:24.542422 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-a3c01653-c067-47fc-8906-d87791f3370b tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:26:24.542910 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-a3c01653-c067-47fc-8906-d87791f3370b tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:26:24.543367 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-a3c01653-c067-47fc-8906-d87791f3370b tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:26:24.543790 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-a3c01653-c067-47fc-8906-d87791f3370b tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:26:24.557185 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a3c01653-c067-47fc-8906-d87791f3370b tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:24.558181 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a3c01653-c067-47fc-8906-d87791f3370b tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:24.558848 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a3c01653-c067-47fc-8906-d87791f3370b tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:24.560226 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a3c01653-c067-47fc-8906-d87791f3370b tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:24.560922 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a3c01653-c067-47fc-8906-d87791f3370b tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:24.561357 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a3c01653-c067-47fc-8906-d87791f3370b tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:24.583512 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-a3c01653-c067-47fc-8906-d87791f3370b tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Getting quotas for project bf35beeccb814ce490d2142b21c2b1c1. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:26:24.589305 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-a3c01653-c067-47fc-8906-d87791f3370b tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Getting quotas for user f86e186e88524064b8dca040c1814927 and project bf35beeccb814ce490d2142b21c2b1c1. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:26:24.605770 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a3c01653-c067-47fc-8906-d87791f3370b tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:26:24.609085 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a3c01653-c067-47fc-8906-d87791f3370b tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] [instance: 36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:26:24.787762 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a3c01653-c067-47fc-8906-d87791f3370b tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.654273 Oct 23 01:26:24.790998 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1955/3867] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:26:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:26:24.801177 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-388f4157-6117-4220-a72a-b28a5a8784ad tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:24.801952 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-388f4157-6117-4220-a72a-b28a5a8784ad tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] [instance: 36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:24.896750 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-388f4157-6117-4220-a72a-b28a5a8784ad tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86e186e88524064b8dca040c1814927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf35beeccb814ce490d2142b21c2b1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:24.908093 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-388f4157-6117-4220-a72a-b28a5a8784ad tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb" status: 200 len: 1217 microversion: 2.1 time: 0.112443 Oct 23 01:26:24.913108 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1913/3868] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:24 2022] GET /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb => generated 1217 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:26:25.477919 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a414ec80-1f51-4336-93c5-1378e48d07d1 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '.version_select at 0x7f5cc0fd60d0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:25.547716 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a414ec80-1f51-4336-93c5-1378e48d07d1 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/images/cc5e23d8-d864-48d6-b8a1-beb73b289f7b" status: 200 len: 1420 microversion: 2.1 time: 0.074604 Oct 23 01:26:25.548548 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1956/3869] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:26:25 2022] GET /compute/v2.1/images/cc5e23d8-d864-48d6-b8a1-beb73b289f7b => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:25.941313 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3955ac02-1709-47f9-a452-3171c2692b4b tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:25.942136 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3955ac02-1709-47f9-a452-3171c2692b4b tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] [instance: 36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:26.012940 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3955ac02-1709-47f9-a452-3171c2692b4b tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86e186e88524064b8dca040c1814927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf35beeccb814ce490d2142b21c2b1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:26.021077 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3955ac02-1709-47f9-a452-3171c2692b4b tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb" status: 200 len: 1217 microversion: 2.1 time: 0.084247 Oct 23 01:26:26.021939 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1914/3870] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:25 2022] GET /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:26.566663 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-916a5f80-564b-4d22-9db2-2cd9f94c227d tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '.version_select at 0x7f5cc10e3a60>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:26.681551 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-916a5f80-564b-4d22-9db2-2cd9f94c227d tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/images/cc5e23d8-d864-48d6-b8a1-beb73b289f7b" status: 200 len: 1420 microversion: 2.1 time: 0.121140 Oct 23 01:26:26.682820 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1957/3871] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:26:26 2022] GET /compute/v2.1/images/cc5e23d8-d864-48d6-b8a1-beb73b289f7b => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:27.052993 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5eca4d90-716e-476f-a3cf-1301b75377a8 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:27.054509 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5eca4d90-716e-476f-a3cf-1301b75377a8 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] [instance: 36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:27.071504 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5eca4d90-716e-476f-a3cf-1301b75377a8 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:27.073830 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5eca4d90-716e-476f-a3cf-1301b75377a8 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:27.074320 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5eca4d90-716e-476f-a3cf-1301b75377a8 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:27.075044 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5eca4d90-716e-476f-a3cf-1301b75377a8 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:27.075591 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5eca4d90-716e-476f-a3cf-1301b75377a8 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:27.075961 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5eca4d90-716e-476f-a3cf-1301b75377a8 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:27.162626 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5eca4d90-716e-476f-a3cf-1301b75377a8 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86e186e88524064b8dca040c1814927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf35beeccb814ce490d2142b21c2b1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:27.174050 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5eca4d90-716e-476f-a3cf-1301b75377a8 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb" status: 200 len: 1213 microversion: 2.1 time: 0.126187 Oct 23 01:26:27.175350 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1915/3872] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:27 2022] GET /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb => generated 1213 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:27.699274 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-507be887-22ea-4975-8a47-a1c9018afc16 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '.version_select at 0x7f5cc176c430>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:27.755036 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-507be887-22ea-4975-8a47-a1c9018afc16 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/images/cc5e23d8-d864-48d6-b8a1-beb73b289f7b" status: 200 len: 1420 microversion: 2.1 time: 0.060530 Oct 23 01:26:27.763411 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1958/3873] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:26:27 2022] GET /compute/v2.1/images/cc5e23d8-d864-48d6-b8a1-beb73b289f7b => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:28.206609 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e3025be7-41da-481e-8fbb-478f0b90afac tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:28.207258 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e3025be7-41da-481e-8fbb-478f0b90afac tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] [instance: 36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:28.226669 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e3025be7-41da-481e-8fbb-478f0b90afac tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:28.227769 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e3025be7-41da-481e-8fbb-478f0b90afac tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:28.228582 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e3025be7-41da-481e-8fbb-478f0b90afac tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:28.232412 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e3025be7-41da-481e-8fbb-478f0b90afac tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:28.234683 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e3025be7-41da-481e-8fbb-478f0b90afac tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:28.235302 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e3025be7-41da-481e-8fbb-478f0b90afac tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:28.242083 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:26:28.341275 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e3025be7-41da-481e-8fbb-478f0b90afac tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86e186e88524064b8dca040c1814927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf35beeccb814ce490d2142b21c2b1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:28.356581 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e3025be7-41da-481e-8fbb-478f0b90afac tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb" status: 200 len: 1269 microversion: 2.1 time: 0.156496 Oct 23 01:26:28.358089 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1916/3874] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:28 2022] GET /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb => generated 1269 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:28.772708 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ed6f7b63-1d47-4cec-9c6d-778cb25cbf6c tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '.version_select at 0x7f5cc0fd61f0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:28.857262 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ed6f7b63-1d47-4cec-9c6d-778cb25cbf6c tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/images/cc5e23d8-d864-48d6-b8a1-beb73b289f7b" status: 200 len: 1420 microversion: 2.1 time: 0.089523 Oct 23 01:26:28.857868 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1959/3875] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:26:28 2022] GET /compute/v2.1/images/cc5e23d8-d864-48d6-b8a1-beb73b289f7b => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:29.381380 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-04721aad-2b39-4f7e-b789-a3a8bdd23b1e tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:29.382939 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-04721aad-2b39-4f7e-b789-a3a8bdd23b1e tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] [instance: 36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:29.398973 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-04721aad-2b39-4f7e-b789-a3a8bdd23b1e tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:29.401492 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-04721aad-2b39-4f7e-b789-a3a8bdd23b1e tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:29.402160 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-04721aad-2b39-4f7e-b789-a3a8bdd23b1e tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:29.412767 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-04721aad-2b39-4f7e-b789-a3a8bdd23b1e tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:29.413813 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-04721aad-2b39-4f7e-b789-a3a8bdd23b1e tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:29.415652 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-04721aad-2b39-4f7e-b789-a3a8bdd23b1e tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:29.685765 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-10b4a41a-791b-41c0-afc9-de202a65b765 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:29.686960 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-10b4a41a-791b-41c0-afc9-de202a65b765 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:29.705362 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-10b4a41a-791b-41c0-afc9-de202a65b765 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:29.705878 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-10b4a41a-791b-41c0-afc9-de202a65b765 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:29.706365 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-10b4a41a-791b-41c0-afc9-de202a65b765 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:29.707108 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-10b4a41a-791b-41c0-afc9-de202a65b765 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:29.707841 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-10b4a41a-791b-41c0-afc9-de202a65b765 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:29.708376 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-10b4a41a-791b-41c0-afc9-de202a65b765 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:29.809688 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-04721aad-2b39-4f7e-b789-a3a8bdd23b1e tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86e186e88524064b8dca040c1814927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf35beeccb814ce490d2142b21c2b1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:29.822663 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-04721aad-2b39-4f7e-b789-a3a8bdd23b1e tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb" status: 200 len: 1269 microversion: 2.1 time: 0.442777 Oct 23 01:26:29.824819 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1917/3876] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:29 2022] GET /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb => generated 1269 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:29.875513 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1b821bf6-786c-4280-8287-4983e7c1fb9c tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '.version_select at 0x7f5cc6211700>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:29.895287 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-10b4a41a-791b-41c0-afc9-de202a65b765 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lazy-loading 'services' on Instance uuid 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:26:29.979396 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1b821bf6-786c-4280-8287-4983e7c1fb9c tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/images/cc5e23d8-d864-48d6-b8a1-beb73b289f7b" status: 200 len: 1420 microversion: 2.1 time: 0.110255 Oct 23 01:26:29.981212 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1918/3877] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:26:29 2022] GET /compute/v2.1/images/cc5e23d8-d864-48d6-b8a1-beb73b289f7b => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:30.251057 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-10b4a41a-791b-41c0-afc9-de202a65b765 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "DELETE /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4/os-volume_attachments/6b0c31d7-c097-43d2-85b1-b1596c0576e9" status: 202 len: 0 microversion: 2.1 time: 0.568944 Oct 23 01:26:30.251818 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1960/3878] 10.222.0.42 () {58 vars in 1416 bytes} [Sun Oct 23 01:26:29 2022] DELETE /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4/os-volume_attachments/6b0c31d7-c097-43d2-85b1-b1596c0576e9 => generated 0 bytes in 571 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:26:30.261817 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1cc73fd8-00e0-48f0-a02c-33ae06ff454e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:30.265436 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1cc73fd8-00e0-48f0-a02c-33ae06ff454e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:30.278311 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1cc73fd8-00e0-48f0-a02c-33ae06ff454e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:30.282303 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1cc73fd8-00e0-48f0-a02c-33ae06ff454e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:30.282810 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1cc73fd8-00e0-48f0-a02c-33ae06ff454e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:30.283712 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1cc73fd8-00e0-48f0-a02c-33ae06ff454e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:30.285774 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1cc73fd8-00e0-48f0-a02c-33ae06ff454e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:30.286257 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1cc73fd8-00e0-48f0-a02c-33ae06ff454e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:30.366852 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1cc73fd8-00e0-48f0-a02c-33ae06ff454e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110461 Oct 23 01:26:30.367838 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1919/3879] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:26:30 2022] GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:26:30.851045 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8c031a2f-4cb4-42dd-a082-72eb84c65fdf tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:30.851990 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8c031a2f-4cb4-42dd-a082-72eb84c65fdf tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] [instance: 36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:30.867731 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c031a2f-4cb4-42dd-a082-72eb84c65fdf tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:30.868310 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c031a2f-4cb4-42dd-a082-72eb84c65fdf tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:30.868810 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c031a2f-4cb4-42dd-a082-72eb84c65fdf tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:30.869718 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c031a2f-4cb4-42dd-a082-72eb84c65fdf tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:30.874115 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c031a2f-4cb4-42dd-a082-72eb84c65fdf tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:30.874985 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c031a2f-4cb4-42dd-a082-72eb84c65fdf tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:30.984620 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8c031a2f-4cb4-42dd-a082-72eb84c65fdf tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86e186e88524064b8dca040c1814927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf35beeccb814ce490d2142b21c2b1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:30.997310 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7883ade1-f41b-472d-acee-cf1c83e90213 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '.version_select at 0x7f5cc16be310>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:30.997894 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8c031a2f-4cb4-42dd-a082-72eb84c65fdf tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb" status: 200 len: 1275 microversion: 2.1 time: 0.153409 Oct 23 01:26:31.002444 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1961/3880] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:30 2022] GET /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb => generated 1275 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:31.068049 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7883ade1-f41b-472d-acee-cf1c83e90213 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/images/cc5e23d8-d864-48d6-b8a1-beb73b289f7b" status: 200 len: 1420 microversion: 2.1 time: 0.074736 Oct 23 01:26:31.069625 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1920/3881] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:26:30 2022] GET /compute/v2.1/images/cc5e23d8-d864-48d6-b8a1-beb73b289f7b => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:31.380817 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1481b7ef-6b56-441a-83be-d04cb59a9a58 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:31.391256 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1481b7ef-6b56-441a-83be-d04cb59a9a58 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:31.414164 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1481b7ef-6b56-441a-83be-d04cb59a9a58 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:31.414667 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1481b7ef-6b56-441a-83be-d04cb59a9a58 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:31.415134 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1481b7ef-6b56-441a-83be-d04cb59a9a58 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:31.415862 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1481b7ef-6b56-441a-83be-d04cb59a9a58 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:31.416318 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1481b7ef-6b56-441a-83be-d04cb59a9a58 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:31.416750 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1481b7ef-6b56-441a-83be-d04cb59a9a58 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:31.523536 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1481b7ef-6b56-441a-83be-d04cb59a9a58 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.140934 Oct 23 01:26:31.529628 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1962/3882] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:26:31 2022] GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:26:32.033963 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-61816385-37db-4eed-8091-9f7668270169 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:32.035871 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-61816385-37db-4eed-8091-9f7668270169 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] [instance: 36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:32.048385 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61816385-37db-4eed-8091-9f7668270169 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:32.049703 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61816385-37db-4eed-8091-9f7668270169 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:32.050670 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61816385-37db-4eed-8091-9f7668270169 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:32.052052 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61816385-37db-4eed-8091-9f7668270169 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:32.052692 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61816385-37db-4eed-8091-9f7668270169 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:32.053293 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61816385-37db-4eed-8091-9f7668270169 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:32.088636 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bb0051f4-5e34-4256-8429-ca08c6477eed tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '.version_select at 0x7f5cc1877160>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:32.164411 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bb0051f4-5e34-4256-8429-ca08c6477eed tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/images/cc5e23d8-d864-48d6-b8a1-beb73b289f7b" status: 200 len: 1420 microversion: 2.1 time: 0.082626 Oct 23 01:26:32.165509 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1963/3883] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:26:32 2022] GET /compute/v2.1/images/cc5e23d8-d864-48d6-b8a1-beb73b289f7b => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:32.406136 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-61816385-37db-4eed-8091-9f7668270169 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86e186e88524064b8dca040c1814927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf35beeccb814ce490d2142b21c2b1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:32.419411 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-61816385-37db-4eed-8091-9f7668270169 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb" status: 200 len: 1317 microversion: 2.1 time: 0.392899 Oct 23 01:26:32.433410 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1921/3884] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:32 2022] GET /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb => generated 1317 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:32.548684 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b2e5f07b-baa9-40b0-a740-1f6f5922263a tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:32.555085 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b2e5f07b-baa9-40b0-a740-1f6f5922263a tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:32.579314 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b2e5f07b-baa9-40b0-a740-1f6f5922263a tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:32.579686 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b2e5f07b-baa9-40b0-a740-1f6f5922263a tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:32.580143 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b2e5f07b-baa9-40b0-a740-1f6f5922263a tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:32.580874 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b2e5f07b-baa9-40b0-a740-1f6f5922263a tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:32.581338 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b2e5f07b-baa9-40b0-a740-1f6f5922263a tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:32.581783 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b2e5f07b-baa9-40b0-a740-1f6f5922263a tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:32.658614 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b2e5f07b-baa9-40b0-a740-1f6f5922263a tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125029 Oct 23 01:26:32.659551 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1964/3885] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:26:32 2022] GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:26:32.792550 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-0b2f0ded-cd32-4701-b22a-dd63a584ea95 req-1cc10786-8114-4637-9dbf-4cd978a9febb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad46f590-af38-463e-87db-62c442e08669", "tag": "d91fdad3-e41c-42ed-88d5-cc3ba6ed68a4"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:26:32.812980 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-0b2f0ded-cd32-4701-b22a-dd63a584ea95 req-1cc10786-8114-4637-9dbf-4cd978a9febb service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:32.813848 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-0b2f0ded-cd32-4701-b22a-dd63a584ea95 req-1cc10786-8114-4637-9dbf-4cd978a9febb service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:32.815328 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-0b2f0ded-cd32-4701-b22a-dd63a584ea95 req-1cc10786-8114-4637-9dbf-4cd978a9febb service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:32.849453 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-0b2f0ded-cd32-4701-b22a-dd63a584ea95 req-1cc10786-8114-4637-9dbf-4cd978a9febb service nova] Creating event network-changed:d91fdad3-e41c-42ed-88d5-cc3ba6ed68a4 for instance ad46f590-af38-463e-87db-62c442e08669 on n-h1-master-1 Oct 23 01:26:32.863103 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-0b2f0ded-cd32-4701-b22a-dd63a584ea95 req-1cc10786-8114-4637-9dbf-4cd978a9febb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075165 Oct 23 01:26:32.864347 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1922/3886] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:26:33.183018 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6cd52ea5-c852-4942-9f04-7f29bb39fd51 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '.version_select at 0x7f5cc16cb0d0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:33.232014 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6cd52ea5-c852-4942-9f04-7f29bb39fd51 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/images/cc5e23d8-d864-48d6-b8a1-beb73b289f7b" status: 200 len: 1420 microversion: 2.1 time: 0.053229 Oct 23 01:26:33.234162 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1965/3887] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:26:33 2022] GET /compute/v2.1/images/cc5e23d8-d864-48d6-b8a1-beb73b289f7b => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:33.457846 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-56b9ec34-4bf4-4b31-a428-f5297e8226e7 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:33.460226 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-56b9ec34-4bf4-4b31-a428-f5297e8226e7 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] [instance: 36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:33.490148 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-56b9ec34-4bf4-4b31-a428-f5297e8226e7 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:33.490860 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-56b9ec34-4bf4-4b31-a428-f5297e8226e7 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:33.491464 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-56b9ec34-4bf4-4b31-a428-f5297e8226e7 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:33.494525 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-56b9ec34-4bf4-4b31-a428-f5297e8226e7 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:33.494679 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-56b9ec34-4bf4-4b31-a428-f5297e8226e7 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:33.495116 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-56b9ec34-4bf4-4b31-a428-f5297e8226e7 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:33.676707 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e98b56c6-f756-4a42-978d-6f88d2b27c45 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:33.679765 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e98b56c6-f756-4a42-978d-6f88d2b27c45 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:33.698076 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e98b56c6-f756-4a42-978d-6f88d2b27c45 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:33.698918 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e98b56c6-f756-4a42-978d-6f88d2b27c45 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:33.699813 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e98b56c6-f756-4a42-978d-6f88d2b27c45 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:33.701242 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e98b56c6-f756-4a42-978d-6f88d2b27c45 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:33.705303 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e98b56c6-f756-4a42-978d-6f88d2b27c45 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:33.705884 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e98b56c6-f756-4a42-978d-6f88d2b27c45 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:33.755083 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e98b56c6-f756-4a42-978d-6f88d2b27c45 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087727 Oct 23 01:26:33.756386 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1966/3888] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:26:33 2022] GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:26:33.814219 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-56b9ec34-4bf4-4b31-a428-f5297e8226e7 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86e186e88524064b8dca040c1814927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf35beeccb814ce490d2142b21c2b1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:33.825481 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-56b9ec34-4bf4-4b31-a428-f5297e8226e7 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb" status: 200 len: 1317 microversion: 2.1 time: 0.378582 Oct 23 01:26:33.838181 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1923/3889] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:33 2022] GET /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb => generated 1317 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:34.250400 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-87c0201f-92d0-4719-a9f7-a179533eb079 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '.version_select at 0x7f5cc18774c0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:34.298472 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-87c0201f-92d0-4719-a9f7-a179533eb079 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/images/cc5e23d8-d864-48d6-b8a1-beb73b289f7b" status: 200 len: 1420 microversion: 2.1 time: 0.051893 Oct 23 01:26:34.299486 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1967/3890] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:26:34 2022] GET /compute/v2.1/images/cc5e23d8-d864-48d6-b8a1-beb73b289f7b => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:34.768591 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-84c5bbe5-0dc6-4223-b0fa-c3bc49b9a8fd tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:34.770775 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-84c5bbe5-0dc6-4223-b0fa-c3bc49b9a8fd tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:34.775497 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:26:34.779860 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-84c5bbe5-0dc6-4223-b0fa-c3bc49b9a8fd tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:34.780584 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-84c5bbe5-0dc6-4223-b0fa-c3bc49b9a8fd tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:34.781185 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-84c5bbe5-0dc6-4223-b0fa-c3bc49b9a8fd tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:34.782083 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-84c5bbe5-0dc6-4223-b0fa-c3bc49b9a8fd tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:34.782743 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-84c5bbe5-0dc6-4223-b0fa-c3bc49b9a8fd tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:34.783170 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-84c5bbe5-0dc6-4223-b0fa-c3bc49b9a8fd tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:34.814955 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-84c5bbe5-0dc6-4223-b0fa-c3bc49b9a8fd tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050989 Oct 23 01:26:34.815697 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1924/3891] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:26:34 2022] GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:26:34.850957 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:26:34.851874 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=6 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:26:34.855981 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1552e927-921b-4008-831a-90e84b96f952 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:34.856671 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1552e927-921b-4008-831a-90e84b96f952 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] [instance: 36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:34.869715 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1552e927-921b-4008-831a-90e84b96f952 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:34.869715 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1552e927-921b-4008-831a-90e84b96f952 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:34.869715 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1552e927-921b-4008-831a-90e84b96f952 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:34.869715 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1552e927-921b-4008-831a-90e84b96f952 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:34.869715 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1552e927-921b-4008-831a-90e84b96f952 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:34.869715 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1552e927-921b-4008-831a-90e84b96f952 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:34.885097 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-d305d6d2-3778-4262-bf12-83cfd53cbd9f req-8bb19664-11bb-4500-9892-c275ad8b7c00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb", "tag": "54e7645f-922e-48c7-870d-b18d536be4be"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:26:34.895800 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-d305d6d2-3778-4262-bf12-83cfd53cbd9f req-8bb19664-11bb-4500-9892-c275ad8b7c00 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:34.896409 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-d305d6d2-3778-4262-bf12-83cfd53cbd9f req-8bb19664-11bb-4500-9892-c275ad8b7c00 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:34.896833 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-d305d6d2-3778-4262-bf12-83cfd53cbd9f req-8bb19664-11bb-4500-9892-c275ad8b7c00 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:34.908726 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-d305d6d2-3778-4262-bf12-83cfd53cbd9f req-8bb19664-11bb-4500-9892-c275ad8b7c00 service nova] Creating event network-changed:54e7645f-922e-48c7-870d-b18d536be4be for instance 36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb on n-h1-master-1 Oct 23 01:26:34.913865 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-d305d6d2-3778-4262-bf12-83cfd53cbd9f req-8bb19664-11bb-4500-9892-c275ad8b7c00 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035430 Oct 23 01:26:34.923678 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1925/3892] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:26:35.091462 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1552e927-921b-4008-831a-90e84b96f952 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86e186e88524064b8dca040c1814927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf35beeccb814ce490d2142b21c2b1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:35.101400 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1552e927-921b-4008-831a-90e84b96f952 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb" status: 200 len: 1317 microversion: 2.1 time: 0.251237 Oct 23 01:26:35.112960 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1968/3893] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:34 2022] GET /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb => generated 1317 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:35.133662 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b46acaa3-ee09-46cc-813c-11752f075b24 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:35.136525 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b46acaa3-ee09-46cc-813c-11752f075b24 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:35.143797 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b46acaa3-ee09-46cc-813c-11752f075b24 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:35.144558 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b46acaa3-ee09-46cc-813c-11752f075b24 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:35.145276 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b46acaa3-ee09-46cc-813c-11752f075b24 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:35.146198 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b46acaa3-ee09-46cc-813c-11752f075b24 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:35.146827 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b46acaa3-ee09-46cc-813c-11752f075b24 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:35.147428 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b46acaa3-ee09-46cc-813c-11752f075b24 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:35.181765 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b46acaa3-ee09-46cc-813c-11752f075b24 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052470 Oct 23 01:26:35.188573 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1926/3894] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:26:35 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:26:35.251970 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-41eef505-84eb-455e-b918-f68f05364173 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:35.253131 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-41eef505-84eb-455e-b918-f68f05364173 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:35.260572 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41eef505-84eb-455e-b918-f68f05364173 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:35.261294 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41eef505-84eb-455e-b918-f68f05364173 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:35.261752 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41eef505-84eb-455e-b918-f68f05364173 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:35.262498 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41eef505-84eb-455e-b918-f68f05364173 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:35.262967 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41eef505-84eb-455e-b918-f68f05364173 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:35.263413 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41eef505-84eb-455e-b918-f68f05364173 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:35.291638 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-41eef505-84eb-455e-b918-f68f05364173 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:26:35.315548 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a1f94ac7-ab8d-41fb-9008-9c017702c385 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '.version_select at 0x7f5cc61af700>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:35.366127 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a1f94ac7-ab8d-41fb-9008-9c017702c385 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/images/cc5e23d8-d864-48d6-b8a1-beb73b289f7b" status: 200 len: 1429 microversion: 2.1 time: 0.054584 Oct 23 01:26:35.367249 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1927/3895] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:26:35 2022] GET /compute/v2.1/images/cc5e23d8-d864-48d6-b8a1-beb73b289f7b => generated 1429 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:26:35.382990 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c1102ec9-2231-41b8-b873-51f37a207fb6 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '.version_select at 0x7f5cc62f2040>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:35.445648 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:26:35.456643 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c1102ec9-2231-41b8-b873-51f37a207fb6 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/images/cc5e23d8-d864-48d6-b8a1-beb73b289f7b" status: 200 len: 1429 microversion: 2.1 time: 0.078517 Oct 23 01:26:35.458222 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1928/3896] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:26:35 2022] GET /compute/v2.1/images/cc5e23d8-d864-48d6-b8a1-beb73b289f7b => generated 1429 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:26:35.473480 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a06f102d-3a7b-49ca-8c18-1b4216752320 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:35.474483 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a06f102d-3a7b-49ca-8c18-1b4216752320 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] [instance: ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:35.481565 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a06f102d-3a7b-49ca-8c18-1b4216752320 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:35.482389 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a06f102d-3a7b-49ca-8c18-1b4216752320 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:35.483831 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a06f102d-3a7b-49ca-8c18-1b4216752320 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:35.484804 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a06f102d-3a7b-49ca-8c18-1b4216752320 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:35.485502 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a06f102d-3a7b-49ca-8c18-1b4216752320 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:35.486202 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a06f102d-3a7b-49ca-8c18-1b4216752320 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:35.643229 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a06f102d-3a7b-49ca-8c18-1b4216752320 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1fb3cadf09d4d5da19e37b0080a0f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf117bb5bf4e76b3bab3ef518dce11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:35.651293 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a06f102d-3a7b-49ca-8c18-1b4216752320 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/servers/ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d" status: 200 len: 1480 microversion: 2.1 time: 0.182034 Oct 23 01:26:35.651882 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1929/3897] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:35 2022] GET /compute/v2.1/servers/ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d => generated 1480 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:26:35.745134 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-41eef505-84eb-455e-b918-f68f05364173 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 204 len: 0 microversion: 2.1 time: 0.493687 Oct 23 01:26:35.745134 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1969/3898] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:26:35 2022] DELETE /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 0 bytes in 495 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:26:35.750433 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ce216644-4d9d-4578-b294-aa798aa44c6d tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:35.751100 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ce216644-4d9d-4578-b294-aa798aa44c6d tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:35.757337 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ce216644-4d9d-4578-b294-aa798aa44c6d tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:35.757827 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ce216644-4d9d-4578-b294-aa798aa44c6d tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:35.758492 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ce216644-4d9d-4578-b294-aa798aa44c6d tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:35.759204 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ce216644-4d9d-4578-b294-aa798aa44c6d tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:35.759666 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ce216644-4d9d-4578-b294-aa798aa44c6d tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:35.760095 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ce216644-4d9d-4578-b294-aa798aa44c6d tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:35.835628 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4db5ca7a-368e-4871-9577-24064dbf7b3f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:35.838093 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4db5ca7a-368e-4871-9577-24064dbf7b3f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:35.845863 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4db5ca7a-368e-4871-9577-24064dbf7b3f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:35.848518 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4db5ca7a-368e-4871-9577-24064dbf7b3f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:35.848518 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4db5ca7a-368e-4871-9577-24064dbf7b3f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:35.848518 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4db5ca7a-368e-4871-9577-24064dbf7b3f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:35.848518 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4db5ca7a-368e-4871-9577-24064dbf7b3f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:35.849604 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4db5ca7a-368e-4871-9577-24064dbf7b3f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:35.888158 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4db5ca7a-368e-4871-9577-24064dbf7b3f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058274 Oct 23 01:26:35.893895 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1970/3899] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:26:35 2022] GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:26:35.996769 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ce216644-4d9d-4578-b294-aa798aa44c6d tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:36.005186 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ce216644-4d9d-4578-b294-aa798aa44c6d tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1675 microversion: 2.1 time: 0.258631 Oct 23 01:26:36.005819 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1930/3900] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:35 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1675 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:36.131035 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d18ed31c-4aaf-441d-9f0e-f142407939d8 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:36.131817 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d18ed31c-4aaf-441d-9f0e-f142407939d8 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] [instance: 36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:36.134128 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:26:36.139621 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d18ed31c-4aaf-441d-9f0e-f142407939d8 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:36.143731 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d18ed31c-4aaf-441d-9f0e-f142407939d8 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:36.143731 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d18ed31c-4aaf-441d-9f0e-f142407939d8 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:36.143731 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d18ed31c-4aaf-441d-9f0e-f142407939d8 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:36.143731 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d18ed31c-4aaf-441d-9f0e-f142407939d8 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:36.143731 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d18ed31c-4aaf-441d-9f0e-f142407939d8 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:36.306466 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d18ed31c-4aaf-441d-9f0e-f142407939d8 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86e186e88524064b8dca040c1814927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf35beeccb814ce490d2142b21c2b1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:36.314801 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d18ed31c-4aaf-441d-9f0e-f142407939d8 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb" status: 200 len: 1317 microversion: 2.1 time: 0.190886 Oct 23 01:26:36.315387 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1971/3901] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:36 2022] GET /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb => generated 1317 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:36.674908 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7fdee4bb-d1a4-4530-85ef-7748379364ba tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:36.675414 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7fdee4bb-d1a4-4530-85ef-7748379364ba tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] [instance: ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:36.677416 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=10 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:26:36.682549 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7fdee4bb-d1a4-4530-85ef-7748379364ba tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:36.683035 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7fdee4bb-d1a4-4530-85ef-7748379364ba tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:36.683471 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7fdee4bb-d1a4-4530-85ef-7748379364ba tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:36.684167 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7fdee4bb-d1a4-4530-85ef-7748379364ba tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:36.684621 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7fdee4bb-d1a4-4530-85ef-7748379364ba tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:36.685047 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7fdee4bb-d1a4-4530-85ef-7748379364ba tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:36.902469 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-07066a2c-c8a4-46bd-8b61-929445fb1ad2 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:36.905824 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-07066a2c-c8a4-46bd-8b61-929445fb1ad2 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:36.913382 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07066a2c-c8a4-46bd-8b61-929445fb1ad2 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:36.914184 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07066a2c-c8a4-46bd-8b61-929445fb1ad2 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:36.914691 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07066a2c-c8a4-46bd-8b61-929445fb1ad2 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:36.915474 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07066a2c-c8a4-46bd-8b61-929445fb1ad2 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:36.916026 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07066a2c-c8a4-46bd-8b61-929445fb1ad2 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:36.916652 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07066a2c-c8a4-46bd-8b61-929445fb1ad2 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:36.950858 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-07066a2c-c8a4-46bd-8b61-929445fb1ad2 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053419 Oct 23 01:26:36.955920 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1972/3902] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:26:36 2022] GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:26:37.031165 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ec274c63-3e8b-47ba-b8be-a4e7dc32b108 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:37.031807 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ec274c63-3e8b-47ba-b8be-a4e7dc32b108 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:37.039011 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ec274c63-3e8b-47ba-b8be-a4e7dc32b108 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:37.039518 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ec274c63-3e8b-47ba-b8be-a4e7dc32b108 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:37.039957 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ec274c63-3e8b-47ba-b8be-a4e7dc32b108 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:37.040851 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ec274c63-3e8b-47ba-b8be-a4e7dc32b108 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:37.041346 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ec274c63-3e8b-47ba-b8be-a4e7dc32b108 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:37.041776 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ec274c63-3e8b-47ba-b8be-a4e7dc32b108 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:37.266955 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7fdee4bb-d1a4-4530-85ef-7748379364ba tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1fb3cadf09d4d5da19e37b0080a0f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf117bb5bf4e76b3bab3ef518dce11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:37.275872 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7fdee4bb-d1a4-4530-85ef-7748379364ba tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/servers/ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d" status: 200 len: 1467 microversion: 2.1 time: 0.604962 Oct 23 01:26:37.276469 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1931/3903] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:36 2022] GET /compute/v2.1/servers/ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d => generated 1467 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:37.299291 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b52c27e9-a653-40ed-9592-fd75ff1cbe01 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '.version_select at 0x7f5cc2430790>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:37.334517 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ec274c63-3e8b-47ba-b8be-a4e7dc32b108 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:37.347568 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b52c27e9-a653-40ed-9592-fd75ff1cbe01 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/images/446b40bc-db5b-4123-9278-997bd6d04a0d" status: 200 len: 784 microversion: 2.1 time: 0.052209 Oct 23 01:26:37.350625 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ec274c63-3e8b-47ba-b8be-a4e7dc32b108 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1675 microversion: 2.1 time: 0.325420 Oct 23 01:26:37.366705 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1973/3904] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:37 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1675 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:26:37.366705 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-85b7c1f4-4a14-49d3-a058-34fec38732c1 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:37.366705 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-85b7c1f4-4a14-49d3-a058-34fec38732c1 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] [instance: 36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:37.367138 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1932/3905] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:26:37 2022] GET /compute/v2.1/images/446b40bc-db5b-4123-9278-997bd6d04a0d => generated 784 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:26:37.367138 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d4b861fd-eafb-4633-87cf-f65c4d614a1a tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:37.367309 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-85b7c1f4-4a14-49d3-a058-34fec38732c1 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:37.367309 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-85b7c1f4-4a14-49d3-a058-34fec38732c1 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:37.367309 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-85b7c1f4-4a14-49d3-a058-34fec38732c1 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:37.367309 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-85b7c1f4-4a14-49d3-a058-34fec38732c1 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:37.367309 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-85b7c1f4-4a14-49d3-a058-34fec38732c1 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:37.367922 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-85b7c1f4-4a14-49d3-a058-34fec38732c1 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:37.383627 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d4b861fd-eafb-4633-87cf-f65c4d614a1a tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023843 Oct 23 01:26:37.384232 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1933/3906] 10.222.0.42 () {58 vars in 1137 bytes} [Sun Oct 23 01:26:37 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:26:37.397254 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3f0affde-c9f6-4443-a31a-fc2342427931 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '.version_select at 0x7f5cc62f2160>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:37.629962 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-85b7c1f4-4a14-49d3-a058-34fec38732c1 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86e186e88524064b8dca040c1814927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf35beeccb814ce490d2142b21c2b1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:37.638733 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-85b7c1f4-4a14-49d3-a058-34fec38732c1 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb" status: 200 len: 1317 microversion: 2.1 time: 0.285737 Oct 23 01:26:37.642210 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1974/3907] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:37 2022] GET /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb => generated 1317 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:37.963904 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c35caa16-8810-4860-a296-3210cc9a287c tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:37.966072 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c35caa16-8810-4860-a296-3210cc9a287c tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:37.973827 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c35caa16-8810-4860-a296-3210cc9a287c tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:37.974355 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c35caa16-8810-4860-a296-3210cc9a287c tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:37.974799 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c35caa16-8810-4860-a296-3210cc9a287c tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:37.975505 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c35caa16-8810-4860-a296-3210cc9a287c tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:37.975965 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c35caa16-8810-4860-a296-3210cc9a287c tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:37.976394 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c35caa16-8810-4860-a296-3210cc9a287c tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:38.007965 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c35caa16-8810-4860-a296-3210cc9a287c tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048101 Oct 23 01:26:38.008543 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1975/3908] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:26:37 2022] GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:26:38.097030 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2f4f456a-22d2-4040-a084-5b00d8080d57 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:26:38.101181 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2f4f456a-22d2-4040-a084-5b00d8080d57 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 79681d58-1364-42d2-99e4-7fe4965bf625] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:38.107788 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f4f456a-22d2-4040-a084-5b00d8080d57 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:38.114494 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f4f456a-22d2-4040-a084-5b00d8080d57 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:38.120946 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f4f456a-22d2-4040-a084-5b00d8080d57 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:38.121969 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f4f456a-22d2-4040-a084-5b00d8080d57 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:38.126680 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f4f456a-22d2-4040-a084-5b00d8080d57 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:38.126680 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f4f456a-22d2-4040-a084-5b00d8080d57 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:38.151315 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-2f4f456a-22d2-4040-a084-5b00d8080d57 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] HTTP exception thrown: Cannot 'reboot' instance 79681d58-1364-42d2-99e4-7fe4965bf625 while it is in vm_state rescued Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2f4f456a-22d2-4040-a084-5b00d8080d57 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Request method failure captured: Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625/action HTTP/1.1 Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 28 Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJdQk8hX6uPg4qHO6qc2mwusfqzM5L9E46F0sE_pC33qOsFxuj7jBx97KQnGjJpiMRyi7Ccd4qVZLYee5QWMbRFkTPXMBEfS5K72Bw65O1CzepVHWqpUTGTMXTiFqb2LFyp2Lx0G54EC4LTSr0BIWkU_QP9JqR2fGUhTDQevTmiXx40 Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 4c25b4509ad7457bad4a2e5e0bc59add Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1648319695 Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4c25b4509ad7457bad4a2e5e0bc59add"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4c25b4509ad7457bad4a2e5e0bc59add"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4c25b4509ad7457bad4a2e5e0bc59add"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4c25b4509ad7457bad4a2e5e0bc59add"}]}] Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1648319695 Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 4c25b4509ad7457bad4a2e5e0bc59add Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1648319695 Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServerRescueNegativeTestJSON-1648319695-project Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 19bff9f7a4254110b3b89f0cba5d252f Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1648319695-project Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: {"reboot": {"type": "HARD"}} Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: exception: Cannot 'reboot' instance 79681d58-1364-42d2-99e4-7fe4965bf625 while it is in vm_state rescued Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '79681d58-1364-42d2-99e4-7fe4965bf625', 'body': {'reboot': {'type': 'HARD'}}} Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 79681d58-1364-42d2-99e4-7fe4965bf625 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 23 01:26:38.153277 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 23 01:26:38.159258 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 79681d58-1364-42d2-99e4-7fe4965bf625 while it is in vm_state rescued Oct 23 01:26:38.159258 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:26:38.159258 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:26:38.159258 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:26:38.159258 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:26:38.159258 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:26:38.159258 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:26:38.159258 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:26:38.159258 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:26:38.159258 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 79681d58-1364-42d2-99e4-7fe4965bf625 while it is in vm_state rescued Oct 23 01:26:38.159258 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:26:38.160900 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2f4f456a-22d2-4040-a084-5b00d8080d57 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Returning 409 to user: Cannot 'reboot' instance 79681d58-1364-42d2-99e4-7fe4965bf625 while it is in vm_state rescued {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:26:38.161963 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2f4f456a-22d2-4040-a084-5b00d8080d57 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "POST /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625/action" status: 409 len: 145 microversion: 2.1 time: 0.073754 Oct 23 01:26:38.163046 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1976/3909] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:26:38 2022] POST /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625/action => generated 145 bytes in 75 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:26:38.173032 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8573fcf1-606a-4155-be8e-eb768eb7cf73 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:26:38.176036 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8573fcf1-606a-4155-be8e-eb768eb7cf73 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 79681d58-1364-42d2-99e4-7fe4965bf625] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:38.182800 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8573fcf1-606a-4155-be8e-eb768eb7cf73 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:38.183299 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8573fcf1-606a-4155-be8e-eb768eb7cf73 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:38.184184 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8573fcf1-606a-4155-be8e-eb768eb7cf73 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:38.184438 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8573fcf1-606a-4155-be8e-eb768eb7cf73 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:38.185043 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8573fcf1-606a-4155-be8e-eb768eb7cf73 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:38.185502 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8573fcf1-606a-4155-be8e-eb768eb7cf73 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:38.227641 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-8573fcf1-606a-4155-be8e-eb768eb7cf73 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] HTTP exception thrown: Cannot 'rebuild' instance 79681d58-1364-42d2-99e4-7fe4965bf625 while it is in vm_state rescued Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8573fcf1-606a-4155-be8e-eb768eb7cf73 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Request method failure captured: Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625/action HTTP/1.1 Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 65 Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJdQk8hX6uPg4qHO6qc2mwusfqzM5L9E46F0sE_pC33qOsFxuj7jBx97KQnGjJpiMRyi7Ccd4qVZLYee5QWMbRFkTPXMBEfS5K72Bw65O1CzepVHWqpUTGTMXTiFqb2LFyp2Lx0G54EC4LTSr0BIWkU_QP9JqR2fGUhTDQevTmiXx40 Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 4c25b4509ad7457bad4a2e5e0bc59add Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1648319695 Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4c25b4509ad7457bad4a2e5e0bc59add"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4c25b4509ad7457bad4a2e5e0bc59add"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4c25b4509ad7457bad4a2e5e0bc59add"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4c25b4509ad7457bad4a2e5e0bc59add"}]}] Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1648319695 Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 4c25b4509ad7457bad4a2e5e0bc59add Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1648319695 Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServerRescueNegativeTestJSON-1648319695-project Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 19bff9f7a4254110b3b89f0cba5d252f Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1648319695-project Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: {"rebuild": {"imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d"}} Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: exception: Cannot 'rebuild' instance 79681d58-1364-42d2-99e4-7fe4965bf625 while it is in vm_state rescued Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '79681d58-1364-42d2-99e4-7fe4965bf625', 'body': {'rebuild': {'imageRef': '446b40bc-db5b-4123-9278-997bd6d04a0d'}}} Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 79681d58-1364-42d2-99e4-7fe4965bf625 in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:26:38.229419 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:26:38.234405 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:26:38.234405 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 23 01:26:38.234405 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 23 01:26:38.234405 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 23 01:26:38.234405 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 23 01:26:38.234405 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 23 01:26:38.234405 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 79681d58-1364-42d2-99e4-7fe4965bf625 while it is in vm_state rescued Oct 23 01:26:38.234405 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:26:38.234405 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:26:38.234405 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:26:38.234405 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:26:38.234405 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:26:38.234405 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:26:38.234405 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:26:38.234405 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:26:38.234405 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 79681d58-1364-42d2-99e4-7fe4965bf625 while it is in vm_state rescued Oct 23 01:26:38.234405 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:26:38.234405 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8573fcf1-606a-4155-be8e-eb768eb7cf73 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Returning 409 to user: Cannot 'rebuild' instance 79681d58-1364-42d2-99e4-7fe4965bf625 while it is in vm_state rescued {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:26:38.234405 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8573fcf1-606a-4155-be8e-eb768eb7cf73 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "POST /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625/action" status: 409 len: 146 microversion: 2.1 time: 0.062489 Oct 23 01:26:38.234405 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1977/3910] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:26:38 2022] POST /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625/action => generated 146 bytes in 64 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 23 01:26:38.240646 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-623d42f8-9563-4161-a158-7374b30c672c tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:38.241316 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-623d42f8-9563-4161-a158-7374b30c672c tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:38.247437 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-623d42f8-9563-4161-a158-7374b30c672c tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:38.247926 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-623d42f8-9563-4161-a158-7374b30c672c tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:38.250470 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-623d42f8-9563-4161-a158-7374b30c672c tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:38.250470 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-623d42f8-9563-4161-a158-7374b30c672c tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:38.250470 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-623d42f8-9563-4161-a158-7374b30c672c tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:38.250470 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-623d42f8-9563-4161-a158-7374b30c672c tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:38.280301 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-623d42f8-9563-4161-a158-7374b30c672c tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:26:38.648739 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-623d42f8-9563-4161-a158-7374b30c672c tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "DELETE /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4" status: 204 len: 0 microversion: 2.1 time: 0.411711 Oct 23 01:26:38.649476 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1978/3911] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:26:38 2022] DELETE /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:26:38.658570 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b13d3558-c7a0-4682-9528-4329aba45263 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:38.659276 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b13d3558-c7a0-4682-9528-4329aba45263 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:38.665491 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b13d3558-c7a0-4682-9528-4329aba45263 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:38.665952 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b13d3558-c7a0-4682-9528-4329aba45263 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:38.666488 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b13d3558-c7a0-4682-9528-4329aba45263 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:38.667191 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b13d3558-c7a0-4682-9528-4329aba45263 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:38.667646 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b13d3558-c7a0-4682-9528-4329aba45263 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:38.668068 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b13d3558-c7a0-4682-9528-4329aba45263 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:38.769667 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3f0affde-c9f6-4443-a31a-fc2342427931 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "DELETE /compute/v2.1/images/cc5e23d8-d864-48d6-b8a1-beb73b289f7b" status: 204 len: 0 microversion: 2.1 time: 1.376474 Oct 23 01:26:38.773807 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1934/3912] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:37 2022] DELETE /compute/v2.1/images/cc5e23d8-d864-48d6-b8a1-beb73b289f7b => generated 0 bytes in 1378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 23 01:26:38.775888 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1c1baf62-0436-44f1-a8f7-7f6c6b57eb6f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:38.776508 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1c1baf62-0436-44f1-a8f7-7f6c6b57eb6f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:38.782805 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c1baf62-0436-44f1-a8f7-7f6c6b57eb6f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:38.783300 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c1baf62-0436-44f1-a8f7-7f6c6b57eb6f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:38.783929 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c1baf62-0436-44f1-a8f7-7f6c6b57eb6f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:38.784794 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c1baf62-0436-44f1-a8f7-7f6c6b57eb6f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:38.785520 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c1baf62-0436-44f1-a8f7-7f6c6b57eb6f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:38.785903 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c1baf62-0436-44f1-a8f7-7f6c6b57eb6f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:38.825861 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b13d3558-c7a0-4682-9528-4329aba45263 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:38.834914 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b13d3558-c7a0-4682-9528-4329aba45263 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1675 microversion: 2.1 time: 0.181218 Oct 23 01:26:38.835499 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1979/3913] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:38 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1675 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:38.842990 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-14d06ac2-45c3-4edc-a146-25b6445c549a tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:38.843869 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-14d06ac2-45c3-4edc-a146-25b6445c549a tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] [instance: 36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:38.851534 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-14d06ac2-45c3-4edc-a146-25b6445c549a tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:38.852274 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-14d06ac2-45c3-4edc-a146-25b6445c549a tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:38.852744 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-14d06ac2-45c3-4edc-a146-25b6445c549a tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:38.853455 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-14d06ac2-45c3-4edc-a146-25b6445c549a tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:38.853893 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-14d06ac2-45c3-4edc-a146-25b6445c549a tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:38.854345 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-14d06ac2-45c3-4edc-a146-25b6445c549a tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:38.973959 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1c1baf62-0436-44f1-a8f7-7f6c6b57eb6f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:38.982083 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1c1baf62-0436-44f1-a8f7-7f6c6b57eb6f tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4" status: 200 len: 1689 microversion: 2.1 time: 0.210394 Oct 23 01:26:38.983197 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1935/3914] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:38 2022] GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4 => generated 1689 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:39.004487 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-15e30250-915b-414d-b6bc-1e521bb0fcb0 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '.version_select at 0x7f5cc16be8b0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:39.026676 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-15e30250-915b-414d-b6bc-1e521bb0fcb0 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] HTTP exception thrown: Image not found. Oct 23 01:26:39.027131 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-14d06ac2-45c3-4edc-a146-25b6445c549a tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86e186e88524064b8dca040c1814927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf35beeccb814ce490d2142b21c2b1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-15e30250-915b-414d-b6bc-1e521bb0fcb0 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Request method failure captured: Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/images/cc5e23d8-d864-48d6-b8a1-beb73b289f7b HTTP/1.1 Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJgeiRNhY5TL1HJfq7MfvXXxwFIC1B1X_xQe6JFoUeycgKPlRyoIIoRkRC7wwv6_4ehsCaKPL7GY0lxy2bZxxafXhBo-TYEkwi_iXxPklBGh1dTr8A9PaTyX9awdaO1SCNrsf5xgFRLve4Wkf-sAGkwxB_azvNig0RlkVH-WlSvuPmM Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: badf117bb5bf4e76b3bab3ef518dce11 Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ImagesOneServerTestJSON-327190347 Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/badf117bb5bf4e76b3bab3ef518dce11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_badf117bb5bf4e76b3bab3ef518dce11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/badf117bb5bf4e76b3bab3ef518dce11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/badf117bb5bf4e76b3bab3ef518dce11"}]}] Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ImagesOneServerTestJSON-327190347 Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: badf117bb5bf4e76b3bab3ef518dce11 Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-327190347 Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ImagesOneServerTestJSON-327190347-project Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: c1fb3cadf09d4d5da19e37b0080a0f26 Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ImagesOneServerTestJSON-327190347-project Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: method: Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: exception: Image not found. Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'cc5e23d8-d864-48d6-b8a1-beb73b289f7b'} Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID cc5e23d8-d864-48d6-b8a1-beb73b289f7b Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 23 01:26:39.028800 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 23 01:26:39.034926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 23 01:26:39.034926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 23 01:26:39.034926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 23 01:26:39.034926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 23 01:26:39.034926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 23 01:26:39.034926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 23 01:26:39.034926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 23 01:26:39.034926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 23 01:26:39.034926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 23 01:26:39.034926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 23 01:26:39.034926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 23 01:26:39.034926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 23 01:26:39.034926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 23 01:26:39.034926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 23 01:26:39.034926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 23 01:26:39.034926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 23 01:26:39.034926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 23 01:26:39.034926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cc5e23d8-d864-48d6-b8a1-beb73b289f7b could not be found. Oct 23 01:26:39.034926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:26:39.034926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:26:39.034926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:26:39.034926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:26:39.034926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:26:39.034926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:26:39.034926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:26:39.034926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:26:39.034926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:26:39.034926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:26:39.034926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:26:39.034926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:26:39.034926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 23 01:26:39.034926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 23 01:26:39.034926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 23 01:26:39.034926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:26:39.034926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:26:39.034926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:26:39.034926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:26:39.034926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:26:39.034926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:26:39.034926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:26:39.034926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:26:39.034926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 23 01:26:39.034926 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:26:39.034926 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-15e30250-915b-414d-b6bc-1e521bb0fcb0 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Returning 404 to user: Image not found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:26:39.034926 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-15e30250-915b-414d-b6bc-1e521bb0fcb0 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/images/cc5e23d8-d864-48d6-b8a1-beb73b289f7b" status: 404 len: 62 microversion: 2.1 time: 0.030948 Oct 23 01:26:39.039292 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1936/3915] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:26:38 2022] GET /compute/v2.1/images/cc5e23d8-d864-48d6-b8a1-beb73b289f7b => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:26:39.041793 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-93658f45-d299-48ce-993b-2fd3faa3b4d5 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1078533467"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:26:39.044265 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-93658f45-d299-48ce-993b-2fd3faa3b4d5 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] [instance: ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:39.048913 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-14d06ac2-45c3-4edc-a146-25b6445c549a tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb" status: 200 len: 1317 microversion: 2.1 time: 0.208172 Oct 23 01:26:39.048913 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1980/3916] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:38 2022] GET /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb => generated 1317 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:39.051622 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-93658f45-d299-48ce-993b-2fd3faa3b4d5 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:39.052111 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-93658f45-d299-48ce-993b-2fd3faa3b4d5 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:39.052547 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-93658f45-d299-48ce-993b-2fd3faa3b4d5 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:39.053267 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-93658f45-d299-48ce-993b-2fd3faa3b4d5 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:39.054182 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-93658f45-d299-48ce-993b-2fd3faa3b4d5 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:39.054610 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-93658f45-d299-48ce-993b-2fd3faa3b4d5 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:39.537617 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-93658f45-d299-48ce-993b-2fd3faa3b4d5 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "POST /compute/v2.1/servers/ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d/action" status: 202 len: 0 microversion: 2.1 time: 0.499403 Oct 23 01:26:39.538995 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1937/3917] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:26:39 2022] POST /compute/v2.1/servers/ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d/action => generated 0 bytes in 501 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 23 01:26:39.550006 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-85578f4a-77b2-4d33-84f0-4651e0e9fbb2 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '.version_select at 0x7f5cc61098b0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:39.600589 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-85578f4a-77b2-4d33-84f0-4651e0e9fbb2 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/images/884b39f6-5cfa-4879-a0b6-dc72f1975144" status: 200 len: 1427 microversion: 2.1 time: 0.054584 Oct 23 01:26:39.601909 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1981/3918] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:26:39 2022] GET /compute/v2.1/images/884b39f6-5cfa-4879-a0b6-dc72f1975144 => generated 1427 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:39.861018 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c555312c-b040-47b3-9e76-658e6f438d9e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:39.861728 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c555312c-b040-47b3-9e76-658e6f438d9e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:39.875213 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c555312c-b040-47b3-9e76-658e6f438d9e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:39.875716 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c555312c-b040-47b3-9e76-658e6f438d9e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:39.876365 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c555312c-b040-47b3-9e76-658e6f438d9e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:39.877264 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c555312c-b040-47b3-9e76-658e6f438d9e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:39.877899 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c555312c-b040-47b3-9e76-658e6f438d9e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:39.878523 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c555312c-b040-47b3-9e76-658e6f438d9e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:39.969380 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c555312c-b040-47b3-9e76-658e6f438d9e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:39.977403 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c555312c-b040-47b3-9e76-658e6f438d9e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1608 microversion: 2.1 time: 0.122019 Oct 23 01:26:39.994922 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1938/3919] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:39 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1608 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:40.016626 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b31e3dc7-c8e7-4aef-b3a6-7912101c0f61 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:40.017560 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b31e3dc7-c8e7-4aef-b3a6-7912101c0f61 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:40.031917 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b31e3dc7-c8e7-4aef-b3a6-7912101c0f61 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:40.040203 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b31e3dc7-c8e7-4aef-b3a6-7912101c0f61 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:40.040794 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b31e3dc7-c8e7-4aef-b3a6-7912101c0f61 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:40.041612 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b31e3dc7-c8e7-4aef-b3a6-7912101c0f61 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:40.042586 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b31e3dc7-c8e7-4aef-b3a6-7912101c0f61 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:40.042586 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b31e3dc7-c8e7-4aef-b3a6-7912101c0f61 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:40.202709 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-86f3dccb-d82b-438e-92ea-501ec68831bc req-8777f7c1-2cf3-40b5-b96a-a8dd3cef9066 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c48a830d-d375-47f5-8c08-d721f856c8ca", "name": "network-vif-deleted", "tag": "ce65010c-1fbf-42ac-84db-f0f7244b8d88"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:26:40.223947 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-86f3dccb-d82b-438e-92ea-501ec68831bc req-8777f7c1-2cf3-40b5-b96a-a8dd3cef9066 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:40.224446 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-86f3dccb-d82b-438e-92ea-501ec68831bc req-8777f7c1-2cf3-40b5-b96a-a8dd3cef9066 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:40.224889 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-86f3dccb-d82b-438e-92ea-501ec68831bc req-8777f7c1-2cf3-40b5-b96a-a8dd3cef9066 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:40.253533 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-86f3dccb-d82b-438e-92ea-501ec68831bc req-8777f7c1-2cf3-40b5-b96a-a8dd3cef9066 service nova] Creating event network-vif-deleted:ce65010c-1fbf-42ac-84db-f0f7244b8d88 for instance c48a830d-d375-47f5-8c08-d721f856c8ca on n-h2-master-1 Oct 23 01:26:40.269861 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-86f3dccb-d82b-438e-92ea-501ec68831bc req-8777f7c1-2cf3-40b5-b96a-a8dd3cef9066 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.266019 Oct 23 01:26:40.269861 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1982/3920] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:26:40.283318 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6d372ce9-b059-497b-8e44-3b4caadc6ba5 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:40.283623 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6d372ce9-b059-497b-8e44-3b4caadc6ba5 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] [instance: 36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:40.298356 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6d372ce9-b059-497b-8e44-3b4caadc6ba5 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:40.298860 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6d372ce9-b059-497b-8e44-3b4caadc6ba5 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:40.299305 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6d372ce9-b059-497b-8e44-3b4caadc6ba5 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:40.299914 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b31e3dc7-c8e7-4aef-b3a6-7912101c0f61 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:40.300059 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6d372ce9-b059-497b-8e44-3b4caadc6ba5 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:40.300466 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6d372ce9-b059-497b-8e44-3b4caadc6ba5 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:40.301960 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6d372ce9-b059-497b-8e44-3b4caadc6ba5 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:40.315888 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b31e3dc7-c8e7-4aef-b3a6-7912101c0f61 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4" status: 200 len: 1689 microversion: 2.1 time: 0.302306 Oct 23 01:26:40.317248 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1939/3921] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:40 2022] GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4 => generated 1689 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:40.323327 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-5b407dd6-2133-4f3f-96f4-07afcdcebdc2 req-090b2165-d94f-4a31-9d80-b801231bce39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad46f590-af38-463e-87db-62c442e08669", "name": "network-vif-plugged", "status": "completed", "tag": "d91fdad3-e41c-42ed-88d5-cc3ba6ed68a4"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:26:40.338454 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-5b407dd6-2133-4f3f-96f4-07afcdcebdc2 req-090b2165-d94f-4a31-9d80-b801231bce39 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:40.339606 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-5b407dd6-2133-4f3f-96f4-07afcdcebdc2 req-090b2165-d94f-4a31-9d80-b801231bce39 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:40.340385 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-5b407dd6-2133-4f3f-96f4-07afcdcebdc2 req-090b2165-d94f-4a31-9d80-b801231bce39 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:40.365829 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-5b407dd6-2133-4f3f-96f4-07afcdcebdc2 req-090b2165-d94f-4a31-9d80-b801231bce39 service nova] Creating event network-vif-plugged:d91fdad3-e41c-42ed-88d5-cc3ba6ed68a4 for instance ad46f590-af38-463e-87db-62c442e08669 on n-h1-master-1 Oct 23 01:26:40.386351 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-5b407dd6-2133-4f3f-96f4-07afcdcebdc2 req-090b2165-d94f-4a31-9d80-b801231bce39 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067498 Oct 23 01:26:40.386966 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1940/3922] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:26:40.517641 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6d372ce9-b059-497b-8e44-3b4caadc6ba5 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86e186e88524064b8dca040c1814927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf35beeccb814ce490d2142b21c2b1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:40.527728 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6d372ce9-b059-497b-8e44-3b4caadc6ba5 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb" status: 200 len: 1317 microversion: 2.1 time: 0.257273 Oct 23 01:26:40.531771 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1983/3923] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:40 2022] GET /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb => generated 1317 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:40.617509 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-28e3d100-991f-487f-a110-101deb9e2d83 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '.version_select at 0x7f5cc62f2790>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:40.665800 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-28e3d100-991f-487f-a110-101deb9e2d83 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/images/884b39f6-5cfa-4879-a0b6-dc72f1975144" status: 200 len: 1427 microversion: 2.1 time: 0.052559 Oct 23 01:26:40.674639 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1941/3924] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:26:40 2022] GET /compute/v2.1/images/884b39f6-5cfa-4879-a0b6-dc72f1975144 => generated 1427 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:41.005428 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9fc9fe37-e08d-4483-a8ae-153919256fa3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:41.006562 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9fc9fe37-e08d-4483-a8ae-153919256fa3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:41.015924 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9fc9fe37-e08d-4483-a8ae-153919256fa3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:41.016445 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9fc9fe37-e08d-4483-a8ae-153919256fa3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:41.016945 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9fc9fe37-e08d-4483-a8ae-153919256fa3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:41.019258 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9fc9fe37-e08d-4483-a8ae-153919256fa3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:41.019757 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9fc9fe37-e08d-4483-a8ae-153919256fa3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:41.020206 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9fc9fe37-e08d-4483-a8ae-153919256fa3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:41.130853 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9fc9fe37-e08d-4483-a8ae-153919256fa3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:41.142452 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9fc9fe37-e08d-4483-a8ae-153919256fa3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1608 microversion: 2.1 time: 0.142199 Oct 23 01:26:41.143059 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1984/3925] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:40 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1608 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:41.343186 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5e1f1067-6de7-46a8-96f2-0a5cfb54b0d7 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:41.344103 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5e1f1067-6de7-46a8-96f2-0a5cfb54b0d7 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:41.351044 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e1f1067-6de7-46a8-96f2-0a5cfb54b0d7 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:41.351624 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e1f1067-6de7-46a8-96f2-0a5cfb54b0d7 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:41.352270 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e1f1067-6de7-46a8-96f2-0a5cfb54b0d7 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:41.353190 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e1f1067-6de7-46a8-96f2-0a5cfb54b0d7 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:41.353649 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e1f1067-6de7-46a8-96f2-0a5cfb54b0d7 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:41.354132 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e1f1067-6de7-46a8-96f2-0a5cfb54b0d7 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:41.370317 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:26:41.559661 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cd50e60f-2f59-4b52-af60-e61d983d70bb tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:41.560963 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-cd50e60f-2f59-4b52-af60-e61d983d70bb tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] [instance: 36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:41.570678 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cd50e60f-2f59-4b52-af60-e61d983d70bb tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:41.571174 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cd50e60f-2f59-4b52-af60-e61d983d70bb tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:41.571611 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cd50e60f-2f59-4b52-af60-e61d983d70bb tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:41.572532 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cd50e60f-2f59-4b52-af60-e61d983d70bb tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:41.573060 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cd50e60f-2f59-4b52-af60-e61d983d70bb tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:41.573647 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cd50e60f-2f59-4b52-af60-e61d983d70bb tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:41.636309 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5e1f1067-6de7-46a8-96f2-0a5cfb54b0d7 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:41.645556 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5e1f1067-6de7-46a8-96f2-0a5cfb54b0d7 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4" status: 200 len: 1689 microversion: 2.1 time: 0.307391 Oct 23 01:26:41.646285 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1942/3926] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:41 2022] GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4 => generated 1689 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:41.683998 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-848418b5-a8f7-4124-ae76-3b5f427f2af0 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '.version_select at 0x7f5cc62f20d0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:41.733892 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-848418b5-a8f7-4124-ae76-3b5f427f2af0 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/images/884b39f6-5cfa-4879-a0b6-dc72f1975144" status: 200 len: 1427 microversion: 2.1 time: 0.055881 Oct 23 01:26:41.734110 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cd50e60f-2f59-4b52-af60-e61d983d70bb tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86e186e88524064b8dca040c1814927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf35beeccb814ce490d2142b21c2b1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:41.734924 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1943/3927] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:26:41 2022] GET /compute/v2.1/images/884b39f6-5cfa-4879-a0b6-dc72f1975144 => generated 1427 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:26:41.745903 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cd50e60f-2f59-4b52-af60-e61d983d70bb tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb" status: 200 len: 1317 microversion: 2.1 time: 0.195414 Oct 23 01:26:41.746845 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1985/3928] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:41 2022] GET /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb => generated 1317 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:42.167964 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-94c31d2b-6f58-4dd5-b684-34fcf2213605 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:42.171112 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-94c31d2b-6f58-4dd5-b684-34fcf2213605 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:42.177583 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94c31d2b-6f58-4dd5-b684-34fcf2213605 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:42.178107 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94c31d2b-6f58-4dd5-b684-34fcf2213605 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:42.178807 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94c31d2b-6f58-4dd5-b684-34fcf2213605 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:42.179508 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94c31d2b-6f58-4dd5-b684-34fcf2213605 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:42.179965 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94c31d2b-6f58-4dd5-b684-34fcf2213605 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:42.180388 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94c31d2b-6f58-4dd5-b684-34fcf2213605 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:42.251161 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-94c31d2b-6f58-4dd5-b684-34fcf2213605 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:42.259607 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-94c31d2b-6f58-4dd5-b684-34fcf2213605 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1323 microversion: 2.1 time: 0.095854 Oct 23 01:26:42.260433 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1944/3929] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:42 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1323 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:42.552161 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-d33c1347-981a-4108-8c0c-80c0e5b7c5ef req-716b60b4-0f14-409b-8666-305829e3fea6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d", "name": "network-vif-unplugged", "status": "completed", "tag": "007e6906-2969-451c-bd1b-9c4c9e24d5ed"}, {"server_uuid": "36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb", "name": "network-vif-plugged", "status": "completed", "tag": "54e7645f-922e-48c7-870d-b18d536be4be"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:26:42.564578 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-d33c1347-981a-4108-8c0c-80c0e5b7c5ef req-716b60b4-0f14-409b-8666-305829e3fea6 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:42.565269 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-d33c1347-981a-4108-8c0c-80c0e5b7c5ef req-716b60b4-0f14-409b-8666-305829e3fea6 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:42.565496 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-d33c1347-981a-4108-8c0c-80c0e5b7c5ef req-716b60b4-0f14-409b-8666-305829e3fea6 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:42.580782 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-d33c1347-981a-4108-8c0c-80c0e5b7c5ef req-716b60b4-0f14-409b-8666-305829e3fea6 service nova] Creating event network-vif-unplugged:007e6906-2969-451c-bd1b-9c4c9e24d5ed for instance ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d on n-h1-master-1 Oct 23 01:26:42.581304 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-d33c1347-981a-4108-8c0c-80c0e5b7c5ef req-716b60b4-0f14-409b-8666-305829e3fea6 service nova] Creating event network-vif-plugged:54e7645f-922e-48c7-870d-b18d536be4be for instance 36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb on n-h1-master-1 Oct 23 01:26:42.587794 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-d33c1347-981a-4108-8c0c-80c0e5b7c5ef req-716b60b4-0f14-409b-8666-305829e3fea6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.039400 Oct 23 01:26:42.588418 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1986/3930] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:26:42.672017 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a16a88e8-002d-48d8-ac37-30473dcbe84b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:42.672745 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a16a88e8-002d-48d8-ac37-30473dcbe84b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:42.680288 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a16a88e8-002d-48d8-ac37-30473dcbe84b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:42.681066 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a16a88e8-002d-48d8-ac37-30473dcbe84b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:42.681636 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a16a88e8-002d-48d8-ac37-30473dcbe84b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:42.682504 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a16a88e8-002d-48d8-ac37-30473dcbe84b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:42.683089 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a16a88e8-002d-48d8-ac37-30473dcbe84b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:42.683696 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a16a88e8-002d-48d8-ac37-30473dcbe84b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:42.755041 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-be93aa72-23ff-4aa7-a16a-726bfdabdb8a tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '.version_select at 0x7f5cc1877940>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:42.836728 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-be93aa72-23ff-4aa7-a16a-726bfdabdb8a tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/images/884b39f6-5cfa-4879-a0b6-dc72f1975144" status: 200 len: 1427 microversion: 2.1 time: 0.087849 Oct 23 01:26:42.846964 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1987/3931] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:26:42 2022] GET /compute/v2.1/images/884b39f6-5cfa-4879-a0b6-dc72f1975144 => generated 1427 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:42.847106 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a16a88e8-002d-48d8-ac37-30473dcbe84b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:42.854051 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7ed1589f-2718-4902-8048-eb4dea9a5408 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:42.855220 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a16a88e8-002d-48d8-ac37-30473dcbe84b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4" status: 200 len: 1689 microversion: 2.1 time: 0.187255 Oct 23 01:26:42.855916 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7ed1589f-2718-4902-8048-eb4dea9a5408 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] [instance: 36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:42.856408 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1945/3932] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:42 2022] GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4 => generated 1689 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:42.874708 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ed1589f-2718-4902-8048-eb4dea9a5408 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:42.875216 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ed1589f-2718-4902-8048-eb4dea9a5408 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:42.875660 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ed1589f-2718-4902-8048-eb4dea9a5408 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:42.876382 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ed1589f-2718-4902-8048-eb4dea9a5408 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:42.876848 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ed1589f-2718-4902-8048-eb4dea9a5408 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:42.879735 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ed1589f-2718-4902-8048-eb4dea9a5408 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:42.899800 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:26:43.069908 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7ed1589f-2718-4902-8048-eb4dea9a5408 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86e186e88524064b8dca040c1814927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf35beeccb814ce490d2142b21c2b1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:43.078335 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7ed1589f-2718-4902-8048-eb4dea9a5408 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb" status: 200 len: 1317 microversion: 2.1 time: 0.229993 Oct 23 01:26:43.084494 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1988/3933] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:42 2022] GET /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb => generated 1317 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:43.284200 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e71d2a0d-7438-4552-acb4-d1d91a942642 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:43.285278 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e71d2a0d-7438-4552-acb4-d1d91a942642 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:43.291934 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e71d2a0d-7438-4552-acb4-d1d91a942642 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:43.292587 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e71d2a0d-7438-4552-acb4-d1d91a942642 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:43.293080 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e71d2a0d-7438-4552-acb4-d1d91a942642 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:43.293705 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e71d2a0d-7438-4552-acb4-d1d91a942642 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:43.295012 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e71d2a0d-7438-4552-acb4-d1d91a942642 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:43.296108 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e71d2a0d-7438-4552-acb4-d1d91a942642 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:43.339493 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e71d2a0d-7438-4552-acb4-d1d91a942642 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:43.341059 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e71d2a0d-7438-4552-acb4-d1d91a942642 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:43.342267 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e71d2a0d-7438-4552-acb4-d1d91a942642 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:43.342984 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-e71d2a0d-7438-4552-acb4-d1d91a942642 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lazy-loading 'fault' on Instance uuid c48a830d-d375-47f5-8c08-d721f856c8ca {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:26:43.398164 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e71d2a0d-7438-4552-acb4-d1d91a942642 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:43.414878 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e71d2a0d-7438-4552-acb4-d1d91a942642 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 200 len: 1328 microversion: 2.1 time: 0.134436 Oct 23 01:26:43.430922 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1946/3934] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:43 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 1328 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:43.853121 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-05471e7a-c432-4f24-914e-f980f90db187 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '.version_select at 0x7f5cc176ce50>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:43.886539 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-eef67bd4-4753-4039-b892-359104a0abdf tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:43.889639 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-eef67bd4-4753-4039-b892-359104a0abdf tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:43.913059 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-05471e7a-c432-4f24-914e-f980f90db187 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/images/884b39f6-5cfa-4879-a0b6-dc72f1975144" status: 200 len: 1427 microversion: 2.1 time: 0.064107 Oct 23 01:26:43.915150 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1989/3935] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:26:43 2022] GET /compute/v2.1/images/884b39f6-5cfa-4879-a0b6-dc72f1975144 => generated 1427 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:43.918720 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eef67bd4-4753-4039-b892-359104a0abdf tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:43.918720 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eef67bd4-4753-4039-b892-359104a0abdf tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:43.918720 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eef67bd4-4753-4039-b892-359104a0abdf tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:43.918720 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eef67bd4-4753-4039-b892-359104a0abdf tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:43.918720 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eef67bd4-4753-4039-b892-359104a0abdf tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:43.919152 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eef67bd4-4753-4039-b892-359104a0abdf tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:43.966073 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-bfe0b929-5c42-4c60-9217-7b5adb335c0d req-448f0023-c792-4f3e-b928-1a6c4bb3753e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38daa540-d4d0-4644-8ed5-a1f6a4fea4e4", "name": "network-vif-deleted", "tag": "d22e97f1-10e1-4cba-878f-0a05d24b97c0"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:26:43.987427 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-bfe0b929-5c42-4c60-9217-7b5adb335c0d req-448f0023-c792-4f3e-b928-1a6c4bb3753e service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:43.988247 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-bfe0b929-5c42-4c60-9217-7b5adb335c0d req-448f0023-c792-4f3e-b928-1a6c4bb3753e service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:43.988919 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-bfe0b929-5c42-4c60-9217-7b5adb335c0d req-448f0023-c792-4f3e-b928-1a6c4bb3753e service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:44.017692 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-bfe0b929-5c42-4c60-9217-7b5adb335c0d req-448f0023-c792-4f3e-b928-1a6c4bb3753e service nova] Creating event network-vif-deleted:d22e97f1-10e1-4cba-878f-0a05d24b97c0 for instance 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4 on n-h2-master-1 Oct 23 01:26:44.028728 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-eef67bd4-4753-4039-b892-359104a0abdf tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:44.029933 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-bfe0b929-5c42-4c60-9217-7b5adb335c0d req-448f0023-c792-4f3e-b928-1a6c4bb3753e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065321 Oct 23 01:26:44.031921 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1990/3936] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:26:44.044209 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-eef67bd4-4753-4039-b892-359104a0abdf tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4" status: 200 len: 1621 microversion: 2.1 time: 0.167090 Oct 23 01:26:44.044811 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1947/3937] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:43 2022] GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4 => generated 1621 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:44.103349 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-439dd8fb-0fb3-4fb7-86d9-6c7ab4dc518e tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:44.104055 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-439dd8fb-0fb3-4fb7-86d9-6c7ab4dc518e tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] [instance: 36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:44.112241 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-439dd8fb-0fb3-4fb7-86d9-6c7ab4dc518e tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:44.112733 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-439dd8fb-0fb3-4fb7-86d9-6c7ab4dc518e tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:44.113171 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-439dd8fb-0fb3-4fb7-86d9-6c7ab4dc518e tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:44.113875 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-439dd8fb-0fb3-4fb7-86d9-6c7ab4dc518e tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:44.118147 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-439dd8fb-0fb3-4fb7-86d9-6c7ab4dc518e tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:44.118787 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-439dd8fb-0fb3-4fb7-86d9-6c7ab4dc518e tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:44.295037 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-439dd8fb-0fb3-4fb7-86d9-6c7ab4dc518e tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86e186e88524064b8dca040c1814927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf35beeccb814ce490d2142b21c2b1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:44.306648 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-439dd8fb-0fb3-4fb7-86d9-6c7ab4dc518e tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb" status: 200 len: 1317 microversion: 2.1 time: 0.207649 Oct 23 01:26:44.308329 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1991/3938] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:44 2022] GET /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb => generated 1317 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:44.441371 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8290accc-cce7-4201-9159-82f2dff692fd tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:44.442652 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8290accc-cce7-4201-9159-82f2dff692fd tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:44.451948 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8290accc-cce7-4201-9159-82f2dff692fd tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:44.452798 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8290accc-cce7-4201-9159-82f2dff692fd tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:44.453500 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8290accc-cce7-4201-9159-82f2dff692fd tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:44.454503 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8290accc-cce7-4201-9159-82f2dff692fd tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:44.455471 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8290accc-cce7-4201-9159-82f2dff692fd tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:44.456398 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8290accc-cce7-4201-9159-82f2dff692fd tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:44.485636 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-8290accc-cce7-4201-9159-82f2dff692fd tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] HTTP exception thrown: Instance c48a830d-d375-47f5-8c08-d721f856c8ca could not be found. Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8290accc-cce7-4201-9159-82f2dff692fd tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Request method failure captured: Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca HTTP/1.1 Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJdVsAjvToj8KAhlGLVBInaL5ZF6Oz9kbUiy39SUtzwRVhAUzFfzRAcu9YuHjQAPTZfpTnw_wvEsXPB9cLPxlD_JcC7YNRTn2PCLYj1vVfxXgT-BRmb5wQiQPKikItMn-89VG5mfPfEQbGe0P3pcqb-trvm0utVmJxFKI0dt6fSMKwI Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 62a621d00a6b499f921337dda20b66bd Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-AttachVolumeTestJSON-1185041640 Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/62a621d00a6b499f921337dda20b66bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_62a621d00a6b499f921337dda20b66bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/62a621d00a6b499f921337dda20b66bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/62a621d00a6b499f921337dda20b66bd"}]}] Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-AttachVolumeTestJSON-1185041640 Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 62a621d00a6b499f921337dda20b66bd Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1185041640 Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-AttachVolumeTestJSON-1185041640-project Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 4ba4975d23874879b779282e5b9cecb0 Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-AttachVolumeTestJSON-1185041640-project Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: exception: Instance c48a830d-d375-47f5-8c08-d721f856c8ca could not be found. Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'c48a830d-d375-47f5-8c08-d721f856c8ca'} Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c48a830d-d375-47f5-8c08-d721f856c8ca could not be found. Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c48a830d-d375-47f5-8c08-d721f856c8ca could not be found. Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:26:44.487445 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:26:44.491973 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:26:44.491973 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:26:44.491973 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:26:44.491973 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:26:44.491973 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:26:44.491973 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c48a830d-d375-47f5-8c08-d721f856c8ca could not be found. Oct 23 01:26:44.491973 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:26:44.491973 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8290accc-cce7-4201-9159-82f2dff692fd tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Returning 404 to user: Instance c48a830d-d375-47f5-8c08-d721f856c8ca could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:26:44.491973 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8290accc-cce7-4201-9159-82f2dff692fd tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 404 len: 111 microversion: 2.1 time: 0.053975 Oct 23 01:26:44.491973 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1948/3939] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:44 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 01:26:44.499854 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f03ea99c-8126-4f38-8f1d-37ff05bf8df2 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '.version_select at 0x7f5cc0fd6d30>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:44.624197 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f03ea99c-8126-4f38-8f1d-37ff05bf8df2 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1120500951" status: 202 len: 0 microversion: 2.1 time: 0.128546 Oct 23 01:26:44.634458 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1992/3940] 10.222.0.42 () {58 vars in 1221 bytes} [Sun Oct 23 01:26:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1120500951 => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:26:44.937813 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f414a1f5-5c9c-4409-a510-58e6cc0c9df0 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '.version_select at 0x7f5cc6205820>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:45.003254 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f414a1f5-5c9c-4409-a510-58e6cc0c9df0 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/images/884b39f6-5cfa-4879-a0b6-dc72f1975144" status: 200 len: 1427 microversion: 2.1 time: 0.073730 Oct 23 01:26:45.004113 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1949/3941] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:26:44 2022] GET /compute/v2.1/images/884b39f6-5cfa-4879-a0b6-dc72f1975144 => generated 1427 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:26:45.074684 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a4c22040-b885-4671-970c-591d7d197427 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:45.075447 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a4c22040-b885-4671-970c-591d7d197427 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:45.093357 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a4c22040-b885-4671-970c-591d7d197427 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:45.094531 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a4c22040-b885-4671-970c-591d7d197427 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:45.095735 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a4c22040-b885-4671-970c-591d7d197427 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:45.097177 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a4c22040-b885-4671-970c-591d7d197427 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:45.097743 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a4c22040-b885-4671-970c-591d7d197427 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:45.099128 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a4c22040-b885-4671-970c-591d7d197427 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:45.145587 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a4c22040-b885-4671-970c-591d7d197427 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:45.146304 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a4c22040-b885-4671-970c-591d7d197427 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:45.146864 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a4c22040-b885-4671-970c-591d7d197427 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:45.147424 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-a4c22040-b885-4671-970c-591d7d197427 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lazy-loading 'fault' on Instance uuid 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:26:45.194650 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a4c22040-b885-4671-970c-591d7d197427 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:45.203609 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a4c22040-b885-4671-970c-591d7d197427 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4" status: 200 len: 1335 microversion: 2.1 time: 0.136000 Oct 23 01:26:45.214464 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1993/3942] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:45 2022] GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4 => generated 1335 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:45.333509 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d56bf1be-821b-42c5-91fe-b1d3fe9826cf tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:45.334465 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d56bf1be-821b-42c5-91fe-b1d3fe9826cf tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] [instance: 36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:45.346247 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d56bf1be-821b-42c5-91fe-b1d3fe9826cf tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:45.352163 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d56bf1be-821b-42c5-91fe-b1d3fe9826cf tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:45.353131 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d56bf1be-821b-42c5-91fe-b1d3fe9826cf tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:45.354348 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d56bf1be-821b-42c5-91fe-b1d3fe9826cf tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:45.355088 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d56bf1be-821b-42c5-91fe-b1d3fe9826cf tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:45.355729 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d56bf1be-821b-42c5-91fe-b1d3fe9826cf tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:45.533928 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d56bf1be-821b-42c5-91fe-b1d3fe9826cf tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86e186e88524064b8dca040c1814927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf35beeccb814ce490d2142b21c2b1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:45.544032 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d56bf1be-821b-42c5-91fe-b1d3fe9826cf tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb" status: 200 len: 1317 microversion: 2.1 time: 0.215076 Oct 23 01:26:45.550056 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1950/3943] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:45 2022] GET /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb => generated 1317 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:45.984252 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-28cbf8eb-1b4e-4d7d-88d4-78e3f4150cec req-f507f75f-2ac1-4d2a-a235-eeabf4a80138 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d", "name": "network-vif-plugged", "status": "completed", "tag": "007e6906-2969-451c-bd1b-9c4c9e24d5ed"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:26:45.995248 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-28cbf8eb-1b4e-4d7d-88d4-78e3f4150cec req-f507f75f-2ac1-4d2a-a235-eeabf4a80138 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:45.995894 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-28cbf8eb-1b4e-4d7d-88d4-78e3f4150cec req-f507f75f-2ac1-4d2a-a235-eeabf4a80138 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:45.996339 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-28cbf8eb-1b4e-4d7d-88d4-78e3f4150cec req-f507f75f-2ac1-4d2a-a235-eeabf4a80138 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:46.008747 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-28cbf8eb-1b4e-4d7d-88d4-78e3f4150cec req-f507f75f-2ac1-4d2a-a235-eeabf4a80138 service nova] Creating event network-vif-plugged:007e6906-2969-451c-bd1b-9c4c9e24d5ed for instance ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d on n-h1-master-1 Oct 23 01:26:46.014197 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-28cbf8eb-1b4e-4d7d-88d4-78e3f4150cec req-f507f75f-2ac1-4d2a-a235-eeabf4a80138 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037076 Oct 23 01:26:46.014919 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1994/3944] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:26:46.021295 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d426339c-8d5e-4df7-b829-c509e1bf5fa1 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '.version_select at 0x7f5cc1708550>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:46.070799 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d426339c-8d5e-4df7-b829-c509e1bf5fa1 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/images/884b39f6-5cfa-4879-a0b6-dc72f1975144" status: 200 len: 1427 microversion: 2.1 time: 0.053794 Oct 23 01:26:46.080483 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1951/3945] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:26:46 2022] GET /compute/v2.1/images/884b39f6-5cfa-4879-a0b6-dc72f1975144 => generated 1427 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:46.231430 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dc2ef140-1afa-4e63-be0e-1b9e9fa3469b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:46.233666 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-dc2ef140-1afa-4e63-be0e-1b9e9fa3469b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:46.254129 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dc2ef140-1afa-4e63-be0e-1b9e9fa3469b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:46.255571 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dc2ef140-1afa-4e63-be0e-1b9e9fa3469b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:46.256816 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dc2ef140-1afa-4e63-be0e-1b9e9fa3469b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:46.258178 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dc2ef140-1afa-4e63-be0e-1b9e9fa3469b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:46.260146 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dc2ef140-1afa-4e63-be0e-1b9e9fa3469b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:46.261233 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dc2ef140-1afa-4e63-be0e-1b9e9fa3469b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:46.283988 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-dc2ef140-1afa-4e63-be0e-1b9e9fa3469b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] HTTP exception thrown: Instance 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4 could not be found. Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dc2ef140-1afa-4e63-be0e-1b9e9fa3469b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Request method failure captured: Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4 HTTP/1.1 Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJdQk8hX6uPg4qHO6qc2mwusfqzM5L9E46F0sE_pC33qOsFxuj7jBx97KQnGjJpiMRyi7Ccd4qVZLYee5QWMbRFkTPXMBEfS5K72Bw65O1CzepVHWqpUTGTMXTiFqb2LFyp2Lx0G54EC4LTSr0BIWkU_QP9JqR2fGUhTDQevTmiXx40 Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 4c25b4509ad7457bad4a2e5e0bc59add Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1648319695 Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4c25b4509ad7457bad4a2e5e0bc59add"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4c25b4509ad7457bad4a2e5e0bc59add"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4c25b4509ad7457bad4a2e5e0bc59add"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4c25b4509ad7457bad4a2e5e0bc59add"}]}] Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1648319695 Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 4c25b4509ad7457bad4a2e5e0bc59add Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1648319695 Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServerRescueNegativeTestJSON-1648319695-project Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 19bff9f7a4254110b3b89f0cba5d252f Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1648319695-project Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4 could not be found. Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '38daa540-d4d0-4644-8ed5-a1f6a4fea4e4'} Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4 could not be found. Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4 could not be found. Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:26:46.285921 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:26:46.297356 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:26:46.297356 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:26:46.297356 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:26:46.297356 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:26:46.297356 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:26:46.297356 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:26:46.297356 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4 could not be found. Oct 23 01:26:46.297356 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:26:46.297356 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dc2ef140-1afa-4e63-be0e-1b9e9fa3469b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Returning 404 to user: Instance 38daa540-d4d0-4644-8ed5-a1f6a4fea4e4 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:26:46.297356 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-dc2ef140-1afa-4e63-be0e-1b9e9fa3469b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4" status: 404 len: 111 microversion: 2.1 time: 0.061108 Oct 23 01:26:46.297356 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1995/3946] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:46 2022] GET /compute/v2.1/servers/38daa540-d4d0-4644-8ed5-a1f6a4fea4e4 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:26:46.299638 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-78c4951d-9f4c-46cb-b009-554007854e9d tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '.version_select at 0x7f5cc1682550>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:46.359981 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c85d5437-78a1-44b7-89b9-6b5be42a674e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Action: 'create', calling method: .version_select at 0x7f5cc0fea940>, body: {"keypair": {"name": "tempest-keypair-1558656828", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBzXsN/SufoPTiemVM9lMlt0F9ibykNfIMW9eNKHrfrIDjCze+YPC5KiLmXS4SmQQ29v1MnsxzK1EFQrcP3Kx6C9i6lL0YXWGpA3BQ5hgkW9R0HCg4T5af5/p7Sz0uFkRQ=="}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:26:46.377728 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-c85d5437-78a1-44b7-89b9-6b5be42a674e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Getting quotas for project 62a621d00a6b499f921337dda20b66bd. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:26:46.384750 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-c85d5437-78a1-44b7-89b9-6b5be42a674e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Getting quotas for user 4ba4975d23874879b779282e5b9cecb0 and project 62a621d00a6b499f921337dda20b66bd. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:26:46.385406 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-78c4951d-9f4c-46cb-b009-554007854e9d tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2022753251" status: 202 len: 0 microversion: 2.1 time: 0.092418 Oct 23 01:26:46.387008 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1952/3947] 10.222.0.42 () {58 vars in 1221 bytes} [Sun Oct 23 01:26:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2022753251 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:26:46.481287 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c85d5437-78a1-44b7-89b9-6b5be42a674e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.125752 Oct 23 01:26:46.497833 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1996/3948] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 01:26:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:26:46.568603 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9c3c53b1-e6f2-4e5e-baf4-a8ed18877bf2 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:46.569482 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9c3c53b1-e6f2-4e5e-baf4-a8ed18877bf2 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] [instance: 36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:46.576011 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9c3c53b1-e6f2-4e5e-baf4-a8ed18877bf2 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:46.576622 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9c3c53b1-e6f2-4e5e-baf4-a8ed18877bf2 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:46.577118 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9c3c53b1-e6f2-4e5e-baf4-a8ed18877bf2 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:46.577751 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9c3c53b1-e6f2-4e5e-baf4-a8ed18877bf2 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:46.578228 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9c3c53b1-e6f2-4e5e-baf4-a8ed18877bf2 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:46.578648 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9c3c53b1-e6f2-4e5e-baf4-a8ed18877bf2 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:46.844230 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9c3c53b1-e6f2-4e5e-baf4-a8ed18877bf2 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86e186e88524064b8dca040c1814927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf35beeccb814ce490d2142b21c2b1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:46.852909 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9c3c53b1-e6f2-4e5e-baf4-a8ed18877bf2 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb" status: 200 len: 1317 microversion: 2.1 time: 0.288499 Oct 23 01:26:46.854246 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1953/3949] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:46 2022] GET /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb => generated 1317 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:47.088670 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d42e7f67-91c0-4312-bcd6-f26a0524b7bb tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '.version_select at 0x7f5cc0fc6b80>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:47.167644 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d42e7f67-91c0-4312-bcd6-f26a0524b7bb tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/images/884b39f6-5cfa-4879-a0b6-dc72f1975144" status: 200 len: 1427 microversion: 2.1 time: 0.084388 Oct 23 01:26:47.169588 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1997/3950] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:26:47 2022] GET /compute/v2.1/images/884b39f6-5cfa-4879-a0b6-dc72f1975144 => generated 1427 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:47.879041 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d6817590-b4ec-4611-bce7-c3aad8197359 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:47.879714 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d6817590-b4ec-4611-bce7-c3aad8197359 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] [instance: 36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:47.887834 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d6817590-b4ec-4611-bce7-c3aad8197359 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:47.888313 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d6817590-b4ec-4611-bce7-c3aad8197359 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:47.888740 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d6817590-b4ec-4611-bce7-c3aad8197359 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:47.889423 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d6817590-b4ec-4611-bce7-c3aad8197359 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:47.889872 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d6817590-b4ec-4611-bce7-c3aad8197359 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:47.890320 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d6817590-b4ec-4611-bce7-c3aad8197359 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:48.152398 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d6817590-b4ec-4611-bce7-c3aad8197359 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86e186e88524064b8dca040c1814927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf35beeccb814ce490d2142b21c2b1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:48.163182 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d6817590-b4ec-4611-bce7-c3aad8197359 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb" status: 200 len: 1317 microversion: 2.1 time: 0.288964 Oct 23 01:26:48.164067 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1954/3951] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:47 2022] GET /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb => generated 1317 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:26:48.195622 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1381e226-46a1-45cc-8f0c-bfc75796ba6a tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '.version_select at 0x7f5cc11288b0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:48.264155 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1381e226-46a1-45cc-8f0c-bfc75796ba6a tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/images/884b39f6-5cfa-4879-a0b6-dc72f1975144" status: 200 len: 1427 microversion: 2.1 time: 0.075208 Oct 23 01:26:48.272343 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1998/3952] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:26:48 2022] GET /compute/v2.1/images/884b39f6-5cfa-4879-a0b6-dc72f1975144 => generated 1427 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:48.584126 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f831a68a-0ed1-4b21-8286-25331db588f8 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:48.589246 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f831a68a-0ed1-4b21-8286-25331db588f8 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:48.597757 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f831a68a-0ed1-4b21-8286-25331db588f8 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:48.605580 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f831a68a-0ed1-4b21-8286-25331db588f8 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:48.605580 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f831a68a-0ed1-4b21-8286-25331db588f8 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:48.605580 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f831a68a-0ed1-4b21-8286-25331db588f8 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:48.605580 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f831a68a-0ed1-4b21-8286-25331db588f8 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:48.605580 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f831a68a-0ed1-4b21-8286-25331db588f8 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:48.669362 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f831a68a-0ed1-4b21-8286-25331db588f8 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039/ips" status: 200 len: 150 microversion: 2.20 time: 0.095098 Oct 23 01:26:48.670775 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1955/3953] 10.222.0.42 () {60 vars in 1289 bytes} [Sun Oct 23 01:26:48 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039/ips => generated 150 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:26:49.196162 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b247ed61-e68b-45e4-a9d6-145e475582da tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:49.196789 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b247ed61-e68b-45e4-a9d6-145e475582da tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] [instance: 36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:49.204426 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b247ed61-e68b-45e4-a9d6-145e475582da tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:49.204937 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b247ed61-e68b-45e4-a9d6-145e475582da tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:49.205384 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b247ed61-e68b-45e4-a9d6-145e475582da tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:49.206222 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b247ed61-e68b-45e4-a9d6-145e475582da tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:49.206688 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b247ed61-e68b-45e4-a9d6-145e475582da tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:49.207122 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b247ed61-e68b-45e4-a9d6-145e475582da tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:49.280609 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a6aaaf95-be85-4963-8130-678703e211e0 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '.version_select at 0x7f5cc62638b0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:49.356978 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a6aaaf95-be85-4963-8130-678703e211e0 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/images/884b39f6-5cfa-4879-a0b6-dc72f1975144" status: 200 len: 1427 microversion: 2.1 time: 0.080814 Oct 23 01:26:49.361500 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1956/3954] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:26:49 2022] GET /compute/v2.1/images/884b39f6-5cfa-4879-a0b6-dc72f1975144 => generated 1427 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:26:49.475122 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b247ed61-e68b-45e4-a9d6-145e475582da tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86e186e88524064b8dca040c1814927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf35beeccb814ce490d2142b21c2b1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:49.484565 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b247ed61-e68b-45e4-a9d6-145e475582da tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb" status: 200 len: 1467 microversion: 2.1 time: 0.293359 Oct 23 01:26:49.485151 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 1999/3955] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:49 2022] GET /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb => generated 1467 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:49.507968 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ddff2bdf-8294-48dc-b533-45fb00bd1aad tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:49.508681 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ddff2bdf-8294-48dc-b533-45fb00bd1aad tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] [instance: ad46f590-af38-463e-87db-62c442e08669] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:49.515156 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ddff2bdf-8294-48dc-b533-45fb00bd1aad tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:49.517612 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ddff2bdf-8294-48dc-b533-45fb00bd1aad tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:49.517612 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ddff2bdf-8294-48dc-b533-45fb00bd1aad tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:49.517612 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ddff2bdf-8294-48dc-b533-45fb00bd1aad tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:49.517612 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ddff2bdf-8294-48dc-b533-45fb00bd1aad tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:49.518077 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ddff2bdf-8294-48dc-b533-45fb00bd1aad tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:49.717674 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ddff2bdf-8294-48dc-b533-45fb00bd1aad tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86e186e88524064b8dca040c1814927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf35beeccb814ce490d2142b21c2b1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:49.728220 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ddff2bdf-8294-48dc-b533-45fb00bd1aad tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/servers/ad46f590-af38-463e-87db-62c442e08669" status: 200 len: 1467 microversion: 2.1 time: 0.224130 Oct 23 01:26:49.734099 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1957/3956] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:49 2022] GET /compute/v2.1/servers/ad46f590-af38-463e-87db-62c442e08669 => generated 1467 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:49.753523 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c25b8385-f241-44aa-96f4-5e99696c8bba tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-948409587"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:26:49.756756 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c25b8385-f241-44aa-96f4-5e99696c8bba tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] [instance: ad46f590-af38-463e-87db-62c442e08669] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:49.764481 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c25b8385-f241-44aa-96f4-5e99696c8bba tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:49.769687 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c25b8385-f241-44aa-96f4-5e99696c8bba tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:49.769687 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c25b8385-f241-44aa-96f4-5e99696c8bba tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:49.780078 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c25b8385-f241-44aa-96f4-5e99696c8bba tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:49.781016 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c25b8385-f241-44aa-96f4-5e99696c8bba tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:49.781885 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c25b8385-f241-44aa-96f4-5e99696c8bba tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:49.869726 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c6182ea8-2ebf-4f03-b1db-f76ae6f930e3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-307160428", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "03c7c850-f0e3-41ad-b527-7392408bf205"}], "security_groups": [{"name": "tempest-securitygroup--585437804"}], "key_name": "tempest-keypair-1558656828", "user_data": "}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:26:50.195917 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-c6182ea8-2ebf-4f03-b1db-f76ae6f930e3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] validate_networks() for [('03c7c850-f0e3-41ad-b527-7392408bf205', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:26:50.340396 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c25b8385-f241-44aa-96f4-5e99696c8bba tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "POST /compute/v2.1/servers/ad46f590-af38-463e-87db-62c442e08669/action" status: 202 len: 0 microversion: 2.1 time: 0.586176 Oct 23 01:26:50.342659 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2000/3957] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:26:49 2022] POST /compute/v2.1/servers/ad46f590-af38-463e-87db-62c442e08669/action => generated 0 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 23 01:26:50.366406 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2cb2098d-ed13-47dc-82a8-55acb38335d0 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc6109670>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:50.464640 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2cb2098d-ed13-47dc-82a8-55acb38335d0 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images/89659f78-4b73-4b12-9f93-4de7578793dd" status: 200 len: 1452 microversion: 2.1 time: 0.113924 Oct 23 01:26:50.465924 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2001/3958] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:26:50 2022] GET /compute/v2.1/images/89659f78-4b73-4b12-9f93-4de7578793dd => generated 1452 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:50.484284 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-04705db4-5ea1-41e1-bda8-946a2a264705 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '.version_select at 0x7f5cc6109280>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:50.572200 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-04705db4-5ea1-41e1-bda8-946a2a264705 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/images/884b39f6-5cfa-4879-a0b6-dc72f1975144" status: 200 len: 1427 microversion: 2.1 time: 0.103582 Oct 23 01:26:50.573246 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2002/3959] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:26:50 2022] GET /compute/v2.1/images/884b39f6-5cfa-4879-a0b6-dc72f1975144 => generated 1427 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:50.974222 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-c6182ea8-2ebf-4f03-b1db-f76ae6f930e3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:26:50.975376 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-c6182ea8-2ebf-4f03-b1db-f76ae6f930e3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:26:50.976081 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-c6182ea8-2ebf-4f03-b1db-f76ae6f930e3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:26:50.977228 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-c6182ea8-2ebf-4f03-b1db-f76ae6f930e3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:26:50.978540 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-c6182ea8-2ebf-4f03-b1db-f76ae6f930e3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:26:50.999624 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6182ea8-2ebf-4f03-b1db-f76ae6f930e3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:51.000504 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6182ea8-2ebf-4f03-b1db-f76ae6f930e3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:51.001032 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6182ea8-2ebf-4f03-b1db-f76ae6f930e3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:51.001857 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6182ea8-2ebf-4f03-b1db-f76ae6f930e3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:51.002699 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6182ea8-2ebf-4f03-b1db-f76ae6f930e3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:51.003470 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6182ea8-2ebf-4f03-b1db-f76ae6f930e3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:51.026691 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-c6182ea8-2ebf-4f03-b1db-f76ae6f930e3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Getting quotas for project 62a621d00a6b499f921337dda20b66bd. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:26:51.035105 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:26:51.036717 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-c6182ea8-2ebf-4f03-b1db-f76ae6f930e3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Getting quotas for user 4ba4975d23874879b779282e5b9cecb0 and project 62a621d00a6b499f921337dda20b66bd. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:26:51.052464 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c6182ea8-2ebf-4f03-b1db-f76ae6f930e3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:26:51.058121 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c6182ea8-2ebf-4f03-b1db-f76ae6f930e3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: 0fb11dc6-65bc-4c8e-a674-c948f42f1b87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:26:51.333331 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c6182ea8-2ebf-4f03-b1db-f76ae6f930e3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.467870 Oct 23 01:26:51.346362 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1958/3960] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:26:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 1481 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 23 01:26:51.359785 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-14640090-dc03-411c-ac5d-93389959be40 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:51.360657 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-14640090-dc03-411c-ac5d-93389959be40 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: 0fb11dc6-65bc-4c8e-a674-c948f42f1b87] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:51.495058 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-74610a31-79f2-4ac3-9333-c524a63dfe87 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc1682940>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:51.498894 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-14640090-dc03-411c-ac5d-93389959be40 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:51.508677 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-14640090-dc03-411c-ac5d-93389959be40 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87" status: 200 len: 1237 microversion: 2.1 time: 0.162231 Oct 23 01:26:51.511065 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2003/3961] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:51 2022] GET /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87 => generated 1237 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:51.588927 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-91d85ffb-e57c-484e-b4b8-ea5b5c274060 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '.version_select at 0x7f5cc108e040>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:51.609729 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-74610a31-79f2-4ac3-9333-c524a63dfe87 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images/89659f78-4b73-4b12-9f93-4de7578793dd" status: 200 len: 1452 microversion: 2.1 time: 0.130033 Oct 23 01:26:51.617897 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1959/3962] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:26:51 2022] GET /compute/v2.1/images/89659f78-4b73-4b12-9f93-4de7578793dd => generated 1452 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:51.695424 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-91d85ffb-e57c-484e-b4b8-ea5b5c274060 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/images/884b39f6-5cfa-4879-a0b6-dc72f1975144" status: 200 len: 1427 microversion: 2.1 time: 0.110601 Oct 23 01:26:51.696576 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2004/3963] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:26:51 2022] GET /compute/v2.1/images/884b39f6-5cfa-4879-a0b6-dc72f1975144 => generated 1427 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:52.537482 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7cb6271e-9ee5-4459-9ed4-ecda3a221316 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:52.538194 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7cb6271e-9ee5-4459-9ed4-ecda3a221316 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: 0fb11dc6-65bc-4c8e-a674-c948f42f1b87] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:52.539513 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-53bab018-1028-4422-a9ba-2e8e654262c9 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:26:52.540730 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-53bab018-1028-4422-a9ba-2e8e654262c9 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:52.548168 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-53bab018-1028-4422-a9ba-2e8e654262c9 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:52.551624 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-53bab018-1028-4422-a9ba-2e8e654262c9 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:52.551624 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-53bab018-1028-4422-a9ba-2e8e654262c9 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:52.551624 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-53bab018-1028-4422-a9ba-2e8e654262c9 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:52.551624 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-53bab018-1028-4422-a9ba-2e8e654262c9 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:52.551624 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-53bab018-1028-4422-a9ba-2e8e654262c9 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:52.656205 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7cb6271e-9ee5-4459-9ed4-ecda3a221316 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:52.666383 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7cb6271e-9ee5-4459-9ed4-ecda3a221316 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87" status: 200 len: 1237 microversion: 2.1 time: 0.133622 Oct 23 01:26:52.667903 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2005/3964] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:52 2022] GET /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87 => generated 1237 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:26:52.675525 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6e317093-a46d-45fc-93be-325b4427df21 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc105a430>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:52.679658 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-53bab018-1028-4422-a9ba-2e8e654262c9 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lazy-loading 'flavor' on Instance uuid c6eb59b7-d1ee-442c-8142-19a88ad6a039 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:26:52.738670 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6e317093-a46d-45fc-93be-325b4427df21 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images/89659f78-4b73-4b12-9f93-4de7578793dd" status: 200 len: 1452 microversion: 2.1 time: 0.069460 Oct 23 01:26:52.739672 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2006/3965] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:26:52 2022] GET /compute/v2.1/images/89659f78-4b73-4b12-9f93-4de7578793dd => generated 1452 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:52.747282 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d68c1400-c3a4-44aa-8ae7-7d3146d5e674 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '.version_select at 0x7f5cc0f89c10>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:52.806055 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d68c1400-c3a4-44aa-8ae7-7d3146d5e674 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/images/884b39f6-5cfa-4879-a0b6-dc72f1975144" status: 200 len: 1427 microversion: 2.1 time: 0.064447 Oct 23 01:26:52.816366 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2007/3966] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:26:52 2022] GET /compute/v2.1/images/884b39f6-5cfa-4879-a0b6-dc72f1975144 => generated 1427 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:53.491162 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-53bab018-1028-4422-a9ba-2e8e654262c9 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "POST /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039/action" status: 202 len: 0 microversion: 2.20 time: 0.971302 Oct 23 01:26:53.500727 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1a18cffb-c8ef-48df-a897-3d5c77e2f502 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:53.501649 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1a18cffb-c8ef-48df-a897-3d5c77e2f502 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:53.522934 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1960/3967] 10.222.0.42 () {62 vars in 1319 bytes} [Sun Oct 23 01:26:52 2022] POST /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039/action => generated 0 bytes in 1004 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:26:53.527271 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1a18cffb-c8ef-48df-a897-3d5c77e2f502 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:53.530741 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1a18cffb-c8ef-48df-a897-3d5c77e2f502 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:53.532024 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1a18cffb-c8ef-48df-a897-3d5c77e2f502 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:53.533873 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1a18cffb-c8ef-48df-a897-3d5c77e2f502 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:53.534744 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1a18cffb-c8ef-48df-a897-3d5c77e2f502 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:53.535412 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1a18cffb-c8ef-48df-a897-3d5c77e2f502 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:53.695838 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0c0beded-54ce-43ca-8ee7-b651e671dedd tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:53.696548 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0c0beded-54ce-43ca-8ee7-b651e671dedd tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: 0fb11dc6-65bc-4c8e-a674-c948f42f1b87] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:53.729788 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0c0beded-54ce-43ca-8ee7-b651e671dedd tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:53.730328 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0c0beded-54ce-43ca-8ee7-b651e671dedd tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:53.730770 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0c0beded-54ce-43ca-8ee7-b651e671dedd tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:53.741231 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0c0beded-54ce-43ca-8ee7-b651e671dedd tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:53.741763 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0c0beded-54ce-43ca-8ee7-b651e671dedd tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:53.742237 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0c0beded-54ce-43ca-8ee7-b651e671dedd tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:54.029454 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0c0beded-54ce-43ca-8ee7-b651e671dedd tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:54.059549 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0c0beded-54ce-43ca-8ee7-b651e671dedd tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87" status: 200 len: 1289 microversion: 2.1 time: 0.368772 Oct 23 01:26:54.061901 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1961/3968] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:53 2022] GET /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87 => generated 1289 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:54.067897 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-78ffc58c-6579-42ce-baf2-ac4989dfc395 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc2430790>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:54.119667 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1a18cffb-c8ef-48df-a897-3d5c77e2f502 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:54.131520 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1a18cffb-c8ef-48df-a897-3d5c77e2f502 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:54.139573 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1a18cffb-c8ef-48df-a897-3d5c77e2f502 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:54.143784 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1a18cffb-c8ef-48df-a897-3d5c77e2f502 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1721 microversion: 2.20 time: 0.647088 Oct 23 01:26:54.152665 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2008/3969] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:26:53 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1721 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:26:54.164357 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-736af706-0c45-407e-95a3-ae2435f3ae31 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '.version_select at 0x7f5cc105a1f0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:54.182555 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-78ffc58c-6579-42ce-baf2-ac4989dfc395 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images/89659f78-4b73-4b12-9f93-4de7578793dd" status: 200 len: 1452 microversion: 2.1 time: 0.118809 Oct 23 01:26:54.193786 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1962/3970] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:26:54 2022] GET /compute/v2.1/images/89659f78-4b73-4b12-9f93-4de7578793dd => generated 1452 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:54.243081 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-736af706-0c45-407e-95a3-ae2435f3ae31 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/images/884b39f6-5cfa-4879-a0b6-dc72f1975144" status: 200 len: 1427 microversion: 2.1 time: 0.089135 Oct 23 01:26:54.243884 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2009/3971] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:26:54 2022] GET /compute/v2.1/images/884b39f6-5cfa-4879-a0b6-dc72f1975144 => generated 1427 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:55.101879 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6829840d-54e0-4696-84bb-44ff6f734144 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:55.102558 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6829840d-54e0-4696-84bb-44ff6f734144 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: 0fb11dc6-65bc-4c8e-a674-c948f42f1b87] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:55.114735 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6829840d-54e0-4696-84bb-44ff6f734144 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:55.115964 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6829840d-54e0-4696-84bb-44ff6f734144 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:55.116654 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6829840d-54e0-4696-84bb-44ff6f734144 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:55.118152 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6829840d-54e0-4696-84bb-44ff6f734144 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:55.118407 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6829840d-54e0-4696-84bb-44ff6f734144 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:55.119076 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6829840d-54e0-4696-84bb-44ff6f734144 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:55.184782 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-982d7fdb-e7f1-453d-afe4-f85f23b73b3f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:55.186181 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-982d7fdb-e7f1-453d-afe4-f85f23b73b3f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:26:55.208306 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-982d7fdb-e7f1-453d-afe4-f85f23b73b3f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:55.208946 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-982d7fdb-e7f1-453d-afe4-f85f23b73b3f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:55.209402 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-982d7fdb-e7f1-453d-afe4-f85f23b73b3f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:55.210180 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-982d7fdb-e7f1-453d-afe4-f85f23b73b3f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:26:55.210644 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-982d7fdb-e7f1-453d-afe4-f85f23b73b3f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:26:55.211073 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-982d7fdb-e7f1-453d-afe4-f85f23b73b3f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:26:55.256843 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6829840d-54e0-4696-84bb-44ff6f734144 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:55.268699 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6829840d-54e0-4696-84bb-44ff6f734144 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87" status: 200 len: 1307 microversion: 2.1 time: 0.187780 Oct 23 01:26:55.272167 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1963/3972] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:26:55 2022] GET /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87 => generated 1307 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:26:55.303189 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d4064ea4-5eec-418b-a6d6-a1f09c173f28 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc1689280>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:26:55.588854 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-982d7fdb-e7f1-453d-afe4-f85f23b73b3f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:55.604737 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-982d7fdb-e7f1-453d-afe4-f85f23b73b3f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:55.609668 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-982d7fdb-e7f1-453d-afe4-f85f23b73b3f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:26:55.612383 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-982d7fdb-e7f1-453d-afe4-f85f23b73b3f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1721 microversion: 2.20 time: 0.433049 Oct 23 01:26:55.615181 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2010/3973] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:26:55 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1721 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:26:55.630199 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-938fa55f-bd78-467d-b8bb-c75ba8b67666 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '.version_select at 0x7f5cc1128ca0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:01.016672 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:27:01.046501 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=6 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:27:02.710354 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=8 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:27:05.115756 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=12,nova_api:INSERT=3 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:27:05.206044 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:27:05.266785 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:27:05.596771 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:27:09.152791 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d4064ea4-5eec-418b-a6d6-a1f09c173f28 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images/89659f78-4b73-4b12-9f93-4de7578793dd" status: 200 len: 1452 microversion: 2.1 time: 13.867659 Oct 23 01:27:09.160742 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1964/3974] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:26:55 2022] GET /compute/v2.1/images/89659f78-4b73-4b12-9f93-4de7578793dd => generated 1452 bytes in 13876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:27:09.172243 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-005e10c9-45ef-4e65-8bcd-86656318599d tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:09.173230 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-005e10c9-45ef-4e65-8bcd-86656318599d tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: 0fb11dc6-65bc-4c8e-a674-c948f42f1b87] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:09.181082 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-005e10c9-45ef-4e65-8bcd-86656318599d tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:09.181775 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-005e10c9-45ef-4e65-8bcd-86656318599d tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:09.182520 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-005e10c9-45ef-4e65-8bcd-86656318599d tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:09.184241 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-005e10c9-45ef-4e65-8bcd-86656318599d tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:09.185073 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-005e10c9-45ef-4e65-8bcd-86656318599d tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:09.185689 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-005e10c9-45ef-4e65-8bcd-86656318599d tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:09.197336 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-938fa55f-bd78-467d-b8bb-c75ba8b67666 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/images/884b39f6-5cfa-4879-a0b6-dc72f1975144" status: 200 len: 1436 microversion: 2.1 time: 13.580510 Oct 23 01:27:09.198251 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2011/3975] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:26:55 2022] GET /compute/v2.1/images/884b39f6-5cfa-4879-a0b6-dc72f1975144 => generated 1436 bytes in 13582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:27:09.220489 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4a7e7fbe-48d1-44ca-bd1c-82c952ca4d40 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:09.221127 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4a7e7fbe-48d1-44ca-bd1c-82c952ca4d40 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:09.242878 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4a7e7fbe-48d1-44ca-bd1c-82c952ca4d40 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:09.243380 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4a7e7fbe-48d1-44ca-bd1c-82c952ca4d40 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:09.243826 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4a7e7fbe-48d1-44ca-bd1c-82c952ca4d40 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:09.244538 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4a7e7fbe-48d1-44ca-bd1c-82c952ca4d40 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:09.245015 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4a7e7fbe-48d1-44ca-bd1c-82c952ca4d40 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:09.245436 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4a7e7fbe-48d1-44ca-bd1c-82c952ca4d40 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:09.570418 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4a7e7fbe-48d1-44ca-bd1c-82c952ca4d40 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:09.580408 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-005e10c9-45ef-4e65-8bcd-86656318599d tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:09.582073 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4a7e7fbe-48d1-44ca-bd1c-82c952ca4d40 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:09.588257 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4a7e7fbe-48d1-44ca-bd1c-82c952ca4d40 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:09.589731 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4a7e7fbe-48d1-44ca-bd1c-82c952ca4d40 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1721 microversion: 2.20 time: 0.390521 Oct 23 01:27:09.590901 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-005e10c9-45ef-4e65-8bcd-86656318599d tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87" status: 200 len: 1362 microversion: 2.1 time: 0.427026 Oct 23 01:27:09.592286 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1965/3976] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:27:09 2022] GET /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87 => generated 1362 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:27:09.594083 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2012/3977] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:27:09 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1721 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:27:09.598063 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-20aaef20-da77-472f-9a81-409cc8882ee2 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:09.603332 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-20aaef20-da77-472f-9a81-409cc8882ee2 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 79681d58-1364-42d2-99e4-7fe4965bf625] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:09.605994 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-20aaef20-da77-472f-9a81-409cc8882ee2 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:09.607175 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-20aaef20-da77-472f-9a81-409cc8882ee2 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:09.607806 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-20aaef20-da77-472f-9a81-409cc8882ee2 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:09.608690 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-20aaef20-da77-472f-9a81-409cc8882ee2 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:09.609400 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-20aaef20-da77-472f-9a81-409cc8882ee2 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:09.610182 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-20aaef20-da77-472f-9a81-409cc8882ee2 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:09.645769 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-f4f64839-e006-4259-9a03-16a6f338f44a req-232b5fff-9247-416f-8837-b49aba106814 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad46f590-af38-463e-87db-62c442e08669", "name": "network-vif-plugged", "status": "completed", "tag": "d91fdad3-e41c-42ed-88d5-cc3ba6ed68a4"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:27:09.657595 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-f4f64839-e006-4259-9a03-16a6f338f44a req-232b5fff-9247-416f-8837-b49aba106814 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:09.658540 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-f4f64839-e006-4259-9a03-16a6f338f44a req-232b5fff-9247-416f-8837-b49aba106814 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:09.660701 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-f4f64839-e006-4259-9a03-16a6f338f44a req-232b5fff-9247-416f-8837-b49aba106814 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:09.675874 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-f4f64839-e006-4259-9a03-16a6f338f44a req-232b5fff-9247-416f-8837-b49aba106814 service nova] Creating event network-vif-plugged:d91fdad3-e41c-42ed-88d5-cc3ba6ed68a4 for instance ad46f590-af38-463e-87db-62c442e08669 on n-h1-master-1 Oct 23 01:27:09.683525 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-f4f64839-e006-4259-9a03-16a6f338f44a req-232b5fff-9247-416f-8837-b49aba106814 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088196 Oct 23 01:27:09.685753 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2013/3978] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:27:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:27:09.692642 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7315b484-7fe1-4768-80ce-d899bb05f490 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:09.693459 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7315b484-7fe1-4768-80ce-d899bb05f490 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] [instance: d27396ae-9295-4187-9ef7-6d7416ee02b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:09.700757 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7315b484-7fe1-4768-80ce-d899bb05f490 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:09.701607 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7315b484-7fe1-4768-80ce-d899bb05f490 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:09.702850 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7315b484-7fe1-4768-80ce-d899bb05f490 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:09.703105 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-20aaef20-da77-472f-9a81-409cc8882ee2 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 79681d58-1364-42d2-99e4-7fe4965bf625] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:27:09.703956 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7315b484-7fe1-4768-80ce-d899bb05f490 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:09.704590 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7315b484-7fe1-4768-80ce-d899bb05f490 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:09.705367 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7315b484-7fe1-4768-80ce-d899bb05f490 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:09.757722 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7315b484-7fe1-4768-80ce-d899bb05f490 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] [instance: d27396ae-9295-4187-9ef7-6d7416ee02b0] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:27:10.075734 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-20aaef20-da77-472f-9a81-409cc8882ee2 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "DELETE /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625" status: 204 len: 0 microversion: 2.1 time: 0.479786 Oct 23 01:27:10.076696 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1966/3979] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:27:09 2022] DELETE /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:27:10.082936 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-3868b3a1-a023-45d8-b8fb-f43ffaf280f0 req-73c3acd7-8afa-48f2-9bed-547eff6013d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fb11dc6-65bc-4c8e-a674-c948f42f1b87", "tag": "68515858-8d68-4868-b082-cf88ddda8e2c"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:27:10.104950 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-3868b3a1-a023-45d8-b8fb-f43ffaf280f0 req-73c3acd7-8afa-48f2-9bed-547eff6013d6 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:10.108836 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-3868b3a1-a023-45d8-b8fb-f43ffaf280f0 req-73c3acd7-8afa-48f2-9bed-547eff6013d6 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:10.110513 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-3868b3a1-a023-45d8-b8fb-f43ffaf280f0 req-73c3acd7-8afa-48f2-9bed-547eff6013d6 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:10.139587 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-3868b3a1-a023-45d8-b8fb-f43ffaf280f0 req-73c3acd7-8afa-48f2-9bed-547eff6013d6 service nova] Creating event network-changed:68515858-8d68-4868-b082-cf88ddda8e2c for instance 0fb11dc6-65bc-4c8e-a674-c948f42f1b87 on n-h2-master-1 Oct 23 01:27:10.147412 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-3868b3a1-a023-45d8-b8fb-f43ffaf280f0 req-73c3acd7-8afa-48f2-9bed-547eff6013d6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068374 Oct 23 01:27:10.149196 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1967/3980] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:27:10.163375 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-16c72078-8ef4-4f71-95f2-6b8042cab29b tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '.version_select at 0x7f5cc6192280>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:10.185237 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7315b484-7fe1-4768-80ce-d899bb05f490 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d27396ae-9295-4187-9ef7-6d7416ee02b0" status: 204 len: 0 microversion: 2.1 time: 0.497839 Oct 23 01:27:10.186233 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2014/3981] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:27:09 2022] DELETE /compute/v2.1/servers/d27396ae-9295-4187-9ef7-6d7416ee02b0 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:27:10.199739 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-92c3b38b-f158-4758-af8d-42f6c4f7926b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:10.209708 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-92c3b38b-f158-4758-af8d-42f6c4f7926b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 79681d58-1364-42d2-99e4-7fe4965bf625] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:10.234989 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92c3b38b-f158-4758-af8d-42f6c4f7926b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:10.241901 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92c3b38b-f158-4758-af8d-42f6c4f7926b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:10.243399 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92c3b38b-f158-4758-af8d-42f6c4f7926b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:10.246710 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92c3b38b-f158-4758-af8d-42f6c4f7926b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:10.252331 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92c3b38b-f158-4758-af8d-42f6c4f7926b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:10.253036 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92c3b38b-f158-4758-af8d-42f6c4f7926b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:10.263297 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-16c72078-8ef4-4f71-95f2-6b8042cab29b tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/images/884b39f6-5cfa-4879-a0b6-dc72f1975144" status: 200 len: 1436 microversion: 2.1 time: 0.112620 Oct 23 01:27:10.263878 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1968/3982] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:27:10 2022] GET /compute/v2.1/images/884b39f6-5cfa-4879-a0b6-dc72f1975144 => generated 1436 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:27:10.275135 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b73ad3e6-e06d-4776-9cf2-101e12b70e0c tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc16be8b0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:10.367191 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b73ad3e6-e06d-4776-9cf2-101e12b70e0c tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images/89659f78-4b73-4b12-9f93-4de7578793dd" status: 200 len: 1452 microversion: 2.1 time: 0.102271 Oct 23 01:27:10.370404 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1969/3983] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:27:10 2022] GET /compute/v2.1/images/89659f78-4b73-4b12-9f93-4de7578793dd => generated 1452 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:27:10.382425 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-78dcda2f-b79b-42a6-a931-f66775abe44f tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:10.383368 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-78dcda2f-b79b-42a6-a931-f66775abe44f tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] [instance: d27396ae-9295-4187-9ef7-6d7416ee02b0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:10.397538 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78dcda2f-b79b-42a6-a931-f66775abe44f tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:10.398319 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78dcda2f-b79b-42a6-a931-f66775abe44f tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:10.398949 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78dcda2f-b79b-42a6-a931-f66775abe44f tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:10.402618 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78dcda2f-b79b-42a6-a931-f66775abe44f tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:10.406980 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78dcda2f-b79b-42a6-a931-f66775abe44f tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:10.408419 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78dcda2f-b79b-42a6-a931-f66775abe44f tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:10.578118 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-92c3b38b-f158-4758-af8d-42f6c4f7926b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:10.588234 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-92c3b38b-f158-4758-af8d-42f6c4f7926b tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625" status: 200 len: 1507 microversion: 2.1 time: 0.400674 Oct 23 01:27:10.589375 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2015/3984] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:27:10 2022] GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625 => generated 1507 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:27:10.611449 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-872e6f48-d9fa-43fd-bdf5-549488694230 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:10.612457 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-872e6f48-d9fa-43fd-bdf5-549488694230 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] [instance: ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:10.622436 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-872e6f48-d9fa-43fd-bdf5-549488694230 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:10.629672 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-872e6f48-d9fa-43fd-bdf5-549488694230 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:10.631048 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-872e6f48-d9fa-43fd-bdf5-549488694230 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:10.632392 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-872e6f48-d9fa-43fd-bdf5-549488694230 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:10.633073 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-872e6f48-d9fa-43fd-bdf5-549488694230 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:10.633725 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-872e6f48-d9fa-43fd-bdf5-549488694230 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:10.742581 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-78dcda2f-b79b-42a6-a931-f66775abe44f tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb8ce5c15bd4a6199cfdf84c49837ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb23cbc0c142a2a4b7a39df99a7d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:10.758008 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-78dcda2f-b79b-42a6-a931-f66775abe44f tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] 10.222.0.42 "GET /compute/v2.1/servers/d27396ae-9295-4187-9ef7-6d7416ee02b0" status: 200 len: 1665 microversion: 2.1 time: 0.386354 Oct 23 01:27:10.758627 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1970/3985] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:27:10 2022] GET /compute/v2.1/servers/d27396ae-9295-4187-9ef7-6d7416ee02b0 => generated 1665 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:27:10.766456 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4b41c313-70e8-42bf-b3b5-d6c1938ded4e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:10.774187 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4b41c313-70e8-42bf-b3b5-d6c1938ded4e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: 0fb11dc6-65bc-4c8e-a674-c948f42f1b87] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:10.788483 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b41c313-70e8-42bf-b3b5-d6c1938ded4e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:10.793594 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b41c313-70e8-42bf-b3b5-d6c1938ded4e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:10.797715 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b41c313-70e8-42bf-b3b5-d6c1938ded4e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:10.797715 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b41c313-70e8-42bf-b3b5-d6c1938ded4e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:10.797715 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b41c313-70e8-42bf-b3b5-d6c1938ded4e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:10.797715 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b41c313-70e8-42bf-b3b5-d6c1938ded4e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:10.960225 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-872e6f48-d9fa-43fd-bdf5-549488694230 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1fb3cadf09d4d5da19e37b0080a0f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf117bb5bf4e76b3bab3ef518dce11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:10.971629 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-872e6f48-d9fa-43fd-bdf5-549488694230 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/servers/ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d" status: 200 len: 1467 microversion: 2.1 time: 0.371909 Oct 23 01:27:10.982264 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2016/3986] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:27:10 2022] GET /compute/v2.1/servers/ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d => generated 1467 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:27:10.982264 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-04d8e3f4-070a-41be-9040-ea7889a57c22 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:10.982264 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-04d8e3f4-070a-41be-9040-ea7889a57c22 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:10.986253 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-04d8e3f4-070a-41be-9040-ea7889a57c22 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:10.986933 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-04d8e3f4-070a-41be-9040-ea7889a57c22 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:10.988163 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-04d8e3f4-070a-41be-9040-ea7889a57c22 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:10.994028 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-04d8e3f4-070a-41be-9040-ea7889a57c22 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:10.994028 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-04d8e3f4-070a-41be-9040-ea7889a57c22 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:10.994028 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-04d8e3f4-070a-41be-9040-ea7889a57c22 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:11.029858 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4b41c313-70e8-42bf-b3b5-d6c1938ded4e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:11.038968 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4b41c313-70e8-42bf-b3b5-d6c1938ded4e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87" status: 200 len: 1362 microversion: 2.1 time: 0.279042 Oct 23 01:27:11.042040 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1971/3987] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:27:10 2022] GET /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87 => generated 1362 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:27:11.045126 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f1781bd4-82e2-45e0-82ff-2b7cb4530d7a tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '.version_select at 0x7f5cc6263550>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:11.154958 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-04d8e3f4-070a-41be-9040-ea7889a57c22 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:11.154958 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-04d8e3f4-070a-41be-9040-ea7889a57c22 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:11.154958 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-04d8e3f4-070a-41be-9040-ea7889a57c22 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:11.154958 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-04d8e3f4-070a-41be-9040-ea7889a57c22 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1742 microversion: 2.20 time: 0.169744 Oct 23 01:27:11.154958 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2017/3988] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:27:10 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1742 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:27:11.385803 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-95028bd9-cd0e-4d7e-8730-1ddeb54bb26f tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc18700d0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:12.431930 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-95028bd9-cd0e-4d7e-8730-1ddeb54bb26f tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images/89659f78-4b73-4b12-9f93-4de7578793dd" status: 200 len: 1461 microversion: 2.1 time: 1.050390 Oct 23 01:27:12.435671 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2018/3989] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:27:11 2022] GET /compute/v2.1/images/89659f78-4b73-4b12-9f93-4de7578793dd => generated 1461 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:27:12.441616 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c3352ff0-89bc-4349-a48a-dc6b23807c70 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:12.442312 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c3352ff0-89bc-4349-a48a-dc6b23807c70 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 79681d58-1364-42d2-99e4-7fe4965bf625] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:12.460399 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c3352ff0-89bc-4349-a48a-dc6b23807c70 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:12.460920 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c3352ff0-89bc-4349-a48a-dc6b23807c70 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:12.461369 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c3352ff0-89bc-4349-a48a-dc6b23807c70 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:12.462127 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c3352ff0-89bc-4349-a48a-dc6b23807c70 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:12.470621 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c3352ff0-89bc-4349-a48a-dc6b23807c70 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:12.470621 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c3352ff0-89bc-4349-a48a-dc6b23807c70 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:12.611096 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c3352ff0-89bc-4349-a48a-dc6b23807c70 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:12.620547 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c3352ff0-89bc-4349-a48a-dc6b23807c70 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625" status: 200 len: 1507 microversion: 2.1 time: 0.183674 Oct 23 01:27:12.621132 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2019/3990] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:27:12 2022] GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625 => generated 1507 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:27:12.633525 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-cf88bc7d-c038-417c-a6b5-0bdffe1c425c req-8175fdc5-0b37-46e5-92c8-a0b9fe66678b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fb11dc6-65bc-4c8e-a674-c948f42f1b87", "name": "network-vif-plugged", "status": "completed", "tag": "68515858-8d68-4868-b082-cf88ddda8e2c"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:27:12.644670 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-cf88bc7d-c038-417c-a6b5-0bdffe1c425c req-8175fdc5-0b37-46e5-92c8-a0b9fe66678b service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:12.645205 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-cf88bc7d-c038-417c-a6b5-0bdffe1c425c req-8175fdc5-0b37-46e5-92c8-a0b9fe66678b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:12.651792 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-cf88bc7d-c038-417c-a6b5-0bdffe1c425c req-8175fdc5-0b37-46e5-92c8-a0b9fe66678b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:12.658064 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-cf88bc7d-c038-417c-a6b5-0bdffe1c425c req-8175fdc5-0b37-46e5-92c8-a0b9fe66678b service nova] Creating event network-vif-plugged:68515858-8d68-4868-b082-cf88ddda8e2c for instance 0fb11dc6-65bc-4c8e-a674-c948f42f1b87 on n-h2-master-1 Oct 23 01:27:12.662966 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-cf88bc7d-c038-417c-a6b5-0bdffe1c425c req-8175fdc5-0b37-46e5-92c8-a0b9fe66678b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034105 Oct 23 01:27:12.663608 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2020/3991] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:27:12.668822 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3f22ece7-6c0b-4c20-b6ae-65f70e9c4d70 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:12.669581 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3f22ece7-6c0b-4c20-b6ae-65f70e9c4d70 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] [instance: d27396ae-9295-4187-9ef7-6d7416ee02b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:12.675822 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3f22ece7-6c0b-4c20-b6ae-65f70e9c4d70 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:12.676384 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3f22ece7-6c0b-4c20-b6ae-65f70e9c4d70 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:12.676817 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3f22ece7-6c0b-4c20-b6ae-65f70e9c4d70 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:12.677503 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3f22ece7-6c0b-4c20-b6ae-65f70e9c4d70 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:12.677956 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3f22ece7-6c0b-4c20-b6ae-65f70e9c4d70 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:12.678657 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3f22ece7-6c0b-4c20-b6ae-65f70e9c4d70 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:12.739970 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f1781bd4-82e2-45e0-82ff-2b7cb4530d7a tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "DELETE /compute/v2.1/images/884b39f6-5cfa-4879-a0b6-dc72f1975144" status: 204 len: 0 microversion: 2.1 time: 1.698972 Oct 23 01:27:12.741244 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1972/3992] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:27:11 2022] DELETE /compute/v2.1/images/884b39f6-5cfa-4879-a0b6-dc72f1975144 => generated 0 bytes in 1701 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:27:12.748356 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b2ae9eff-1fb8-460b-9962-08a0066d16b1 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:12.749205 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b2ae9eff-1fb8-460b-9962-08a0066d16b1 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: 0fb11dc6-65bc-4c8e-a674-c948f42f1b87] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:12.757093 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b2ae9eff-1fb8-460b-9962-08a0066d16b1 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:12.758059 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b2ae9eff-1fb8-460b-9962-08a0066d16b1 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:12.758570 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b2ae9eff-1fb8-460b-9962-08a0066d16b1 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:12.759356 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b2ae9eff-1fb8-460b-9962-08a0066d16b1 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:12.760049 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b2ae9eff-1fb8-460b-9962-08a0066d16b1 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:12.760743 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b2ae9eff-1fb8-460b-9962-08a0066d16b1 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:13.215761 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3f22ece7-6c0b-4c20-b6ae-65f70e9c4d70 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb8ce5c15bd4a6199cfdf84c49837ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb23cbc0c142a2a4b7a39df99a7d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:13.222825 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b2ae9eff-1fb8-460b-9962-08a0066d16b1 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:13.227897 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3f22ece7-6c0b-4c20-b6ae-65f70e9c4d70 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] 10.222.0.42 "GET /compute/v2.1/servers/d27396ae-9295-4187-9ef7-6d7416ee02b0" status: 200 len: 1665 microversion: 2.1 time: 0.561552 Oct 23 01:27:13.238203 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b2ae9eff-1fb8-460b-9962-08a0066d16b1 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87" status: 200 len: 1362 microversion: 2.1 time: 0.494306 Oct 23 01:27:13.251167 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2021/3993] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:27:12 2022] GET /compute/v2.1/servers/d27396ae-9295-4187-9ef7-6d7416ee02b0 => generated 1665 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:27:13.260224 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c649406e-d339-43e2-957e-3b8781944a6d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:13.260481 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1973/3994] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:27:12 2022] GET /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87 => generated 1362 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:27:13.263825 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c649406e-d339-43e2-957e-3b8781944a6d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:13.263825 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c649406e-d339-43e2-957e-3b8781944a6d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:13.263825 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c649406e-d339-43e2-957e-3b8781944a6d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:13.263825 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c649406e-d339-43e2-957e-3b8781944a6d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:13.264979 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c649406e-d339-43e2-957e-3b8781944a6d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:13.264979 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c649406e-d339-43e2-957e-3b8781944a6d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:13.264979 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c649406e-d339-43e2-957e-3b8781944a6d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:13.266658 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0b52afba-b933-47fe-81e6-f279dd43966e tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc62748b0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:13.329831 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0b52afba-b933-47fe-81e6-f279dd43966e tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images/89659f78-4b73-4b12-9f93-4de7578793dd" status: 200 len: 1461 microversion: 2.1 time: 0.076382 Oct 23 01:27:13.331027 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1974/3995] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:27:13 2022] GET /compute/v2.1/images/89659f78-4b73-4b12-9f93-4de7578793dd => generated 1461 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:27:13.335933 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-028413d6-7545-4fb4-8405-67ff9740c627 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '.version_select at 0x7f5cc16beb80>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:13.361567 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-028413d6-7545-4fb4-8405-67ff9740c627 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] HTTP exception thrown: Image not found. Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-028413d6-7545-4fb4-8405-67ff9740c627 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Request method failure captured: Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/images/cc5e23d8-d864-48d6-b8a1-beb73b289f7b HTTP/1.1 Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJgeiRNhY5TL1HJfq7MfvXXxwFIC1B1X_xQe6JFoUeycgKPlRyoIIoRkRC7wwv6_4ehsCaKPL7GY0lxy2bZxxafXhBo-TYEkwi_iXxPklBGh1dTr8A9PaTyX9awdaO1SCNrsf5xgFRLve4Wkf-sAGkwxB_azvNig0RlkVH-WlSvuPmM Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: badf117bb5bf4e76b3bab3ef518dce11 Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ImagesOneServerTestJSON-327190347 Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/badf117bb5bf4e76b3bab3ef518dce11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_badf117bb5bf4e76b3bab3ef518dce11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/badf117bb5bf4e76b3bab3ef518dce11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/badf117bb5bf4e76b3bab3ef518dce11"}]}] Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ImagesOneServerTestJSON-327190347 Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: badf117bb5bf4e76b3bab3ef518dce11 Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-327190347 Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ImagesOneServerTestJSON-327190347-project Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: c1fb3cadf09d4d5da19e37b0080a0f26 Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ImagesOneServerTestJSON-327190347-project Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: method: Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: exception: Image not found. Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'cc5e23d8-d864-48d6-b8a1-beb73b289f7b'} Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image cc5e23d8-d864-48d6-b8a1-beb73b289f7b to delete Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cc5e23d8-d864-48d6-b8a1-beb73b289f7b could not be found. Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:27:13.363809 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:27:13.368586 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:27:13.368586 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:27:13.368586 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:27:13.368586 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:27:13.368586 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:27:13.368586 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:27:13.368586 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:27:13.368586 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:27:13.368586 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 23 01:27:13.368586 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 23 01:27:13.368586 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 23 01:27:13.368586 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:27:13.368586 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:27:13.368586 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:27:13.368586 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:27:13.368586 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:27:13.368586 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:27:13.368586 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:27:13.368586 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:27:13.368586 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 23 01:27:13.368586 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:27:13.386601 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-028413d6-7545-4fb4-8405-67ff9740c627 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Returning 404 to user: Image not found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:27:13.386601 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-028413d6-7545-4fb4-8405-67ff9740c627 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "DELETE /compute/v2.1/images/cc5e23d8-d864-48d6-b8a1-beb73b289f7b" status: 404 len: 62 microversion: 2.1 time: 0.043692 Oct 23 01:27:13.386601 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1975/3996] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:27:13 2022] DELETE /compute/v2.1/images/cc5e23d8-d864-48d6-b8a1-beb73b289f7b => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:27:13.386601 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e35fc99c-2ed6-411d-8657-18d2bc447533 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:13.386601 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e35fc99c-2ed6-411d-8657-18d2bc447533 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] [instance: ad46f590-af38-463e-87db-62c442e08669] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:13.396072 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e35fc99c-2ed6-411d-8657-18d2bc447533 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:13.396072 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e35fc99c-2ed6-411d-8657-18d2bc447533 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:13.396072 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e35fc99c-2ed6-411d-8657-18d2bc447533 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:13.396330 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e35fc99c-2ed6-411d-8657-18d2bc447533 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:13.396733 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e35fc99c-2ed6-411d-8657-18d2bc447533 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:13.397147 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e35fc99c-2ed6-411d-8657-18d2bc447533 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:13.428045 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c649406e-d339-43e2-957e-3b8781944a6d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:13.447490 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c649406e-d339-43e2-957e-3b8781944a6d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:13.449428 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c649406e-d339-43e2-957e-3b8781944a6d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:13.451108 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c649406e-d339-43e2-957e-3b8781944a6d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1742 microversion: 2.20 time: 0.206211 Oct 23 01:27:13.466091 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2022/3997] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:27:13 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1742 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:27:13.475213 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d6bb39d6-d4ce-4bac-9f42-ed88da284794 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:13.475733 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d6bb39d6-d4ce-4bac-9f42-ed88da284794 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] [instance: ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:13.491406 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d6bb39d6-d4ce-4bac-9f42-ed88da284794 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:13.491915 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d6bb39d6-d4ce-4bac-9f42-ed88da284794 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:13.492351 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d6bb39d6-d4ce-4bac-9f42-ed88da284794 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:13.493336 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d6bb39d6-d4ce-4bac-9f42-ed88da284794 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:13.493739 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d6bb39d6-d4ce-4bac-9f42-ed88da284794 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:13.494360 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d6bb39d6-d4ce-4bac-9f42-ed88da284794 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:13.529501 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d6bb39d6-d4ce-4bac-9f42-ed88da284794 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] [instance: ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:27:13.593227 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e35fc99c-2ed6-411d-8657-18d2bc447533 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86e186e88524064b8dca040c1814927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf35beeccb814ce490d2142b21c2b1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:13.599637 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e35fc99c-2ed6-411d-8657-18d2bc447533 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/servers/ad46f590-af38-463e-87db-62c442e08669" status: 200 len: 1467 microversion: 2.1 time: 0.222222 Oct 23 01:27:13.600384 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1976/3998] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:27:13 2022] GET /compute/v2.1/servers/ad46f590-af38-463e-87db-62c442e08669 => generated 1467 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:27:13.622311 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4c9339df-d413-48cc-9fc3-7f15ed38558f tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1524131246"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:27:13.624752 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4c9339df-d413-48cc-9fc3-7f15ed38558f tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] [instance: 36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:13.630880 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4c9339df-d413-48cc-9fc3-7f15ed38558f tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:13.631370 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4c9339df-d413-48cc-9fc3-7f15ed38558f tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:13.631798 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4c9339df-d413-48cc-9fc3-7f15ed38558f tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:13.632491 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4c9339df-d413-48cc-9fc3-7f15ed38558f tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:13.632937 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4c9339df-d413-48cc-9fc3-7f15ed38558f tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:13.633351 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4c9339df-d413-48cc-9fc3-7f15ed38558f tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:13.876837 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d6bb39d6-d4ce-4bac-9f42-ed88da284794 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d" status: 204 len: 0 microversion: 2.1 time: 0.415816 Oct 23 01:27:13.880430 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2023/3999] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:27:13 2022] DELETE /compute/v2.1/servers/ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:27:13.885879 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c2fa70a4-49db-4c5c-8eae-8dee46bf5278 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:13.886648 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c2fa70a4-49db-4c5c-8eae-8dee46bf5278 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 79681d58-1364-42d2-99e4-7fe4965bf625] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:13.894650 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2fa70a4-49db-4c5c-8eae-8dee46bf5278 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:13.895408 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2fa70a4-49db-4c5c-8eae-8dee46bf5278 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:13.897246 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2fa70a4-49db-4c5c-8eae-8dee46bf5278 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:13.898081 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2fa70a4-49db-4c5c-8eae-8dee46bf5278 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:13.898746 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2fa70a4-49db-4c5c-8eae-8dee46bf5278 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:13.899265 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2fa70a4-49db-4c5c-8eae-8dee46bf5278 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:14.145833 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c2fa70a4-49db-4c5c-8eae-8dee46bf5278 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:14.162157 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c2fa70a4-49db-4c5c-8eae-8dee46bf5278 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625" status: 200 len: 1507 microversion: 2.1 time: 0.281425 Oct 23 01:27:14.163337 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2024/4000] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:27:13 2022] GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625 => generated 1507 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:27:14.170755 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-89811a46-b42a-4bd8-a444-f988302ed2df tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:14.171696 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-89811a46-b42a-4bd8-a444-f988302ed2df tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] [instance: ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:14.179403 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-89811a46-b42a-4bd8-a444-f988302ed2df tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:14.180129 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-89811a46-b42a-4bd8-a444-f988302ed2df tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:14.180765 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-89811a46-b42a-4bd8-a444-f988302ed2df tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:14.181685 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-89811a46-b42a-4bd8-a444-f988302ed2df tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:14.182374 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-89811a46-b42a-4bd8-a444-f988302ed2df tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:14.183034 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-89811a46-b42a-4bd8-a444-f988302ed2df tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:14.200168 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4c9339df-d413-48cc-9fc3-7f15ed38558f tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "POST /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb/action" status: 202 len: 0 microversion: 2.1 time: 0.580824 Oct 23 01:27:14.201923 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1977/4001] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:27:13 2022] POST /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb/action => generated 0 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 23 01:27:14.215967 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f2de45fc-d0c7-48c4-a0b1-f3aa1e795676 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc62051f0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:14.296790 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f2de45fc-d0c7-48c4-a0b1-f3aa1e795676 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images/15656f0b-ee3c-4916-9e79-9548ba759af5" status: 200 len: 1453 microversion: 2.1 time: 0.088041 Oct 23 01:27:14.297383 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1978/4002] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:27:14 2022] GET /compute/v2.1/images/15656f0b-ee3c-4916-9e79-9548ba759af5 => generated 1453 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:27:14.306892 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6db30936-57a9-4b14-b800-3dc4dadd0f50 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:14.308384 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6db30936-57a9-4b14-b800-3dc4dadd0f50 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] [instance: d27396ae-9295-4187-9ef7-6d7416ee02b0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:14.317333 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6db30936-57a9-4b14-b800-3dc4dadd0f50 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:14.318399 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6db30936-57a9-4b14-b800-3dc4dadd0f50 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:14.318399 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6db30936-57a9-4b14-b800-3dc4dadd0f50 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:14.328525 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6db30936-57a9-4b14-b800-3dc4dadd0f50 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:14.329933 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6db30936-57a9-4b14-b800-3dc4dadd0f50 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:14.330772 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6db30936-57a9-4b14-b800-3dc4dadd0f50 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:14.462664 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-89811a46-b42a-4bd8-a444-f988302ed2df tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1fb3cadf09d4d5da19e37b0080a0f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf117bb5bf4e76b3bab3ef518dce11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:14.474786 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-89811a46-b42a-4bd8-a444-f988302ed2df tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/servers/ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d" status: 200 len: 1473 microversion: 2.1 time: 0.310041 Oct 23 01:27:14.477782 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2025/4003] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:27:14 2022] GET /compute/v2.1/servers/ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d => generated 1473 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:27:14.496295 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a84326c4-8856-488e-ae26-1887e601e80a tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:14.497060 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a84326c4-8856-488e-ae26-1887e601e80a tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: 0fb11dc6-65bc-4c8e-a674-c948f42f1b87] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:14.506782 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a84326c4-8856-488e-ae26-1887e601e80a tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:14.510732 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a84326c4-8856-488e-ae26-1887e601e80a tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:14.512297 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a84326c4-8856-488e-ae26-1887e601e80a tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:14.513341 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a84326c4-8856-488e-ae26-1887e601e80a tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:14.514566 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a84326c4-8856-488e-ae26-1887e601e80a tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:14.517541 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a84326c4-8856-488e-ae26-1887e601e80a tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:14.554199 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6db30936-57a9-4b14-b800-3dc4dadd0f50 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb8ce5c15bd4a6199cfdf84c49837ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb23cbc0c142a2a4b7a39df99a7d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:14.565348 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6db30936-57a9-4b14-b800-3dc4dadd0f50 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] 10.222.0.42 "GET /compute/v2.1/servers/d27396ae-9295-4187-9ef7-6d7416ee02b0" status: 200 len: 1665 microversion: 2.1 time: 0.266675 Oct 23 01:27:14.567147 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1979/4004] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:27:14 2022] GET /compute/v2.1/servers/d27396ae-9295-4187-9ef7-6d7416ee02b0 => generated 1665 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:27:14.572482 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-505808b9-307d-4820-947b-9f4d054d4a15 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:14.573084 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-505808b9-307d-4820-947b-9f4d054d4a15 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:14.579691 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-505808b9-307d-4820-947b-9f4d054d4a15 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:14.580404 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-505808b9-307d-4820-947b-9f4d054d4a15 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:14.581581 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-505808b9-307d-4820-947b-9f4d054d4a15 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:14.582479 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-505808b9-307d-4820-947b-9f4d054d4a15 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:14.583097 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-505808b9-307d-4820-947b-9f4d054d4a15 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:14.583665 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-505808b9-307d-4820-947b-9f4d054d4a15 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:14.855437 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a84326c4-8856-488e-ae26-1887e601e80a tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:14.864591 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a84326c4-8856-488e-ae26-1887e601e80a tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87" status: 200 len: 1362 microversion: 2.1 time: 0.381518 Oct 23 01:27:14.870712 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2026/4005] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:27:14 2022] GET /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87 => generated 1362 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:27:14.878617 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-91bce703-9275-4510-9dfd-617b8b8c68f2 req-20c9918e-887d-4e3a-b6e7-7295c8ab0903 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6eb59b7-d1ee-442c-8142-19a88ad6a039", "name": "network-vif-plugged", "status": "completed", "tag": "82e540c0-e210-47a2-a17d-495549fe7222"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:27:14.907101 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-91bce703-9275-4510-9dfd-617b8b8c68f2 req-20c9918e-887d-4e3a-b6e7-7295c8ab0903 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:14.911120 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-91bce703-9275-4510-9dfd-617b8b8c68f2 req-20c9918e-887d-4e3a-b6e7-7295c8ab0903 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:14.911899 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-91bce703-9275-4510-9dfd-617b8b8c68f2 req-20c9918e-887d-4e3a-b6e7-7295c8ab0903 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:14.937273 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-91bce703-9275-4510-9dfd-617b8b8c68f2 req-20c9918e-887d-4e3a-b6e7-7295c8ab0903 service nova] Creating event network-vif-plugged:82e540c0-e210-47a2-a17d-495549fe7222 for instance c6eb59b7-d1ee-442c-8142-19a88ad6a039 on n-h1-master-1 Oct 23 01:27:14.952831 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-91bce703-9275-4510-9dfd-617b8b8c68f2 req-20c9918e-887d-4e3a-b6e7-7295c8ab0903 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079673 Oct 23 01:27:14.956469 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2027/4006] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:27:14.979149 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-505808b9-307d-4820-947b-9f4d054d4a15 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:14.989218 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-505808b9-307d-4820-947b-9f4d054d4a15 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:14.991515 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-505808b9-307d-4820-947b-9f4d054d4a15 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:14.993035 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-505808b9-307d-4820-947b-9f4d054d4a15 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1737 microversion: 2.20 time: 0.424953 Oct 23 01:27:14.994208 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1980/4007] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:27:14 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1737 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:27:15.192084 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3e7898be-eff2-4628-9cf0-6736e6d58d01 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:15.193314 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3e7898be-eff2-4628-9cf0-6736e6d58d01 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 79681d58-1364-42d2-99e4-7fe4965bf625] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:15.202697 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3e7898be-eff2-4628-9cf0-6736e6d58d01 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:15.204229 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3e7898be-eff2-4628-9cf0-6736e6d58d01 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:15.204673 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3e7898be-eff2-4628-9cf0-6736e6d58d01 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:15.205368 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3e7898be-eff2-4628-9cf0-6736e6d58d01 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:15.211678 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3e7898be-eff2-4628-9cf0-6736e6d58d01 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:15.212387 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3e7898be-eff2-4628-9cf0-6736e6d58d01 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:15.296991 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-22647383-1556-42f6-b051-99c684936723 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:15.297892 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-22647383-1556-42f6-b051-99c684936723 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:15.308406 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-22647383-1556-42f6-b051-99c684936723 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:15.319803 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-22647383-1556-42f6-b051-99c684936723 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:15.322626 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-22647383-1556-42f6-b051-99c684936723 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:15.324235 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-22647383-1556-42f6-b051-99c684936723 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:15.335686 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-22647383-1556-42f6-b051-99c684936723 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:15.336563 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-22647383-1556-42f6-b051-99c684936723 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:15.348252 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:27:15.414271 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-22647383-1556-42f6-b051-99c684936723 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:27:15.526628 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3e7898be-eff2-4628-9cf0-6736e6d58d01 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:15.539798 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3e7898be-eff2-4628-9cf0-6736e6d58d01 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625" status: 200 len: 1507 microversion: 2.1 time: 0.348408 Oct 23 01:27:15.540453 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1981/4008] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:27:15 2022] GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625 => generated 1507 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:27:15.547962 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fb9563eb-7a69-484d-9e2f-14fb04d5449b tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc169b3a0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:15.606968 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fb9563eb-7a69-484d-9e2f-14fb04d5449b tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images/15656f0b-ee3c-4916-9e79-9548ba759af5" status: 200 len: 1453 microversion: 2.1 time: 0.064085 Oct 23 01:27:15.608019 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1982/4009] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:27:15 2022] GET /compute/v2.1/images/15656f0b-ee3c-4916-9e79-9548ba759af5 => generated 1453 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:27:15.620655 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-15eba5d0-2d24-41ac-a12a-3933000fb172 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:15.621279 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-15eba5d0-2d24-41ac-a12a-3933000fb172 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] [instance: ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:15.628506 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-15eba5d0-2d24-41ac-a12a-3933000fb172 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:15.629231 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-15eba5d0-2d24-41ac-a12a-3933000fb172 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:15.630062 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-15eba5d0-2d24-41ac-a12a-3933000fb172 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:15.630938 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-15eba5d0-2d24-41ac-a12a-3933000fb172 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:15.631579 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-15eba5d0-2d24-41ac-a12a-3933000fb172 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:15.632174 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-15eba5d0-2d24-41ac-a12a-3933000fb172 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:15.844902 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-15eba5d0-2d24-41ac-a12a-3933000fb172 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1fb3cadf09d4d5da19e37b0080a0f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf117bb5bf4e76b3bab3ef518dce11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:15.854548 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-15eba5d0-2d24-41ac-a12a-3933000fb172 tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/servers/ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d" status: 200 len: 1473 microversion: 2.1 time: 0.245139 Oct 23 01:27:15.855653 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1983/4010] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:27:15 2022] GET /compute/v2.1/servers/ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d => generated 1473 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:27:15.861548 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9aaf2a51-1c65-4ce2-ab95-17f8fa1c6150 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:15.862644 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9aaf2a51-1c65-4ce2-ab95-17f8fa1c6150 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] [instance: d27396ae-9295-4187-9ef7-6d7416ee02b0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:15.871824 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-22647383-1556-42f6-b051-99c684936723 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "DELETE /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 204 len: 0 microversion: 2.42 time: 0.912138 Oct 23 01:27:15.872384 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9aaf2a51-1c65-4ce2-ab95-17f8fa1c6150 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:15.873045 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9aaf2a51-1c65-4ce2-ab95-17f8fa1c6150 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:15.873500 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9aaf2a51-1c65-4ce2-ab95-17f8fa1c6150 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:15.874279 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9aaf2a51-1c65-4ce2-ab95-17f8fa1c6150 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:15.874745 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9aaf2a51-1c65-4ce2-ab95-17f8fa1c6150 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:15.875182 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9aaf2a51-1c65-4ce2-ab95-17f8fa1c6150 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:15.876350 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2028/4011] 10.222.0.42 () {60 vars in 1280 bytes} [Sun Oct 23 01:27:14 2022] DELETE /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 0 bytes in 919 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 23 01:27:15.887717 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4b94be03-a69f-4819-a474-7d60647eca91 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:15.888822 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4b94be03-a69f-4819-a474-7d60647eca91 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:15.900868 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4b94be03-a69f-4819-a474-7d60647eca91 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:15.908131 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4b94be03-a69f-4819-a474-7d60647eca91 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:15.908131 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4b94be03-a69f-4819-a474-7d60647eca91 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:15.908131 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4b94be03-a69f-4819-a474-7d60647eca91 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:15.908131 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4b94be03-a69f-4819-a474-7d60647eca91 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:15.908131 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4b94be03-a69f-4819-a474-7d60647eca91 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:16.270142 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9aaf2a51-1c65-4ce2-ab95-17f8fa1c6150 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb8ce5c15bd4a6199cfdf84c49837ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb23cbc0c142a2a4b7a39df99a7d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:16.280309 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9aaf2a51-1c65-4ce2-ab95-17f8fa1c6150 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] 10.222.0.42 "GET /compute/v2.1/servers/d27396ae-9295-4187-9ef7-6d7416ee02b0" status: 200 len: 1665 microversion: 2.1 time: 0.423264 Oct 23 01:27:16.285543 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1984/4012] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:27:15 2022] GET /compute/v2.1/servers/d27396ae-9295-4187-9ef7-6d7416ee02b0 => generated 1665 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:27:16.289262 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4b94be03-a69f-4819-a474-7d60647eca91 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:16.298546 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bce6b6a6-69cf-4c54-823c-e36999f3bb91 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:16.299487 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-bce6b6a6-69cf-4c54-823c-e36999f3bb91 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: 0fb11dc6-65bc-4c8e-a674-c948f42f1b87] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:16.310433 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bce6b6a6-69cf-4c54-823c-e36999f3bb91 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:16.313721 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bce6b6a6-69cf-4c54-823c-e36999f3bb91 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:16.313721 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bce6b6a6-69cf-4c54-823c-e36999f3bb91 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:16.313949 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4b94be03-a69f-4819-a474-7d60647eca91 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:16.314085 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bce6b6a6-69cf-4c54-823c-e36999f3bb91 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:16.314085 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bce6b6a6-69cf-4c54-823c-e36999f3bb91 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:16.314085 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bce6b6a6-69cf-4c54-823c-e36999f3bb91 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:16.314590 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4b94be03-a69f-4819-a474-7d60647eca91 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:16.319251 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4b94be03-a69f-4819-a474-7d60647eca91 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 2960 microversion: 2.42 time: 0.434774 Oct 23 01:27:16.319859 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2029/4013] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:27:15 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 2960 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:27:16.334668 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-18c0f631-532e-41b2-b221-84016118479d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:16.335562 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-18c0f631-532e-41b2-b221-84016118479d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:16.357495 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18c0f631-532e-41b2-b221-84016118479d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:16.358692 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18c0f631-532e-41b2-b221-84016118479d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:16.359398 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18c0f631-532e-41b2-b221-84016118479d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:16.360331 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18c0f631-532e-41b2-b221-84016118479d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:16.361190 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18c0f631-532e-41b2-b221-84016118479d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:16.366719 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18c0f631-532e-41b2-b221-84016118479d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:16.533110 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bce6b6a6-69cf-4c54-823c-e36999f3bb91 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:16.543096 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bce6b6a6-69cf-4c54-823c-e36999f3bb91 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87" status: 200 len: 1548 microversion: 2.1 time: 0.255835 Oct 23 01:27:16.547947 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1985/4014] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:27:16 2022] GET /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87 => generated 1548 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:27:16.566580 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7b5f5933-fd8f-485f-8371-e04627a003cc tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:16.567555 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7b5f5933-fd8f-485f-8371-e04627a003cc tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 79681d58-1364-42d2-99e4-7fe4965bf625] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:16.583810 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b5f5933-fd8f-485f-8371-e04627a003cc tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:16.587384 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b5f5933-fd8f-485f-8371-e04627a003cc tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:16.588127 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b5f5933-fd8f-485f-8371-e04627a003cc tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:16.589130 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b5f5933-fd8f-485f-8371-e04627a003cc tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:16.589840 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b5f5933-fd8f-485f-8371-e04627a003cc tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:16.592459 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b5f5933-fd8f-485f-8371-e04627a003cc tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:16.602573 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:27:16.688829 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-18c0f631-532e-41b2-b221-84016118479d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:16.698407 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-18c0f631-532e-41b2-b221-84016118479d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:16.706484 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-18c0f631-532e-41b2-b221-84016118479d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:16.711192 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-18c0f631-532e-41b2-b221-84016118479d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1737 microversion: 2.20 time: 0.387255 Oct 23 01:27:16.711883 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2030/4015] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:27:16 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1737 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:27:16.725280 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7b5f5933-fd8f-485f-8371-e04627a003cc tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:16.731927 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c2d03ea9-bdd7-4480-97de-2720da11c500 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:16.733925 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c2d03ea9-bdd7-4480-97de-2720da11c500 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: 0fb11dc6-65bc-4c8e-a674-c948f42f1b87] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:16.739138 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7b5f5933-fd8f-485f-8371-e04627a003cc tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625" status: 200 len: 1465 microversion: 2.1 time: 0.176351 Oct 23 01:27:16.744369 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1986/4016] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:27:16 2022] GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625 => generated 1465 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:27:16.745921 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bc1dcf4e-1798-4682-a84d-104c8ea8da03 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc1689a60>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:16.748822 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2d03ea9-bdd7-4480-97de-2720da11c500 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:16.749335 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2d03ea9-bdd7-4480-97de-2720da11c500 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:16.752079 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2d03ea9-bdd7-4480-97de-2720da11c500 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:16.757208 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2d03ea9-bdd7-4480-97de-2720da11c500 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:16.757208 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2d03ea9-bdd7-4480-97de-2720da11c500 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:16.757208 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2d03ea9-bdd7-4480-97de-2720da11c500 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:16.818313 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bc1dcf4e-1798-4682-a84d-104c8ea8da03 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images/15656f0b-ee3c-4916-9e79-9548ba759af5" status: 200 len: 1453 microversion: 2.1 time: 0.076793 Oct 23 01:27:16.820307 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1987/4017] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:27:16 2022] GET /compute/v2.1/images/15656f0b-ee3c-4916-9e79-9548ba759af5 => generated 1453 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:27:16.826484 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-33a69f45-25b1-42d3-bcfa-760490128777 req-09fa76c2-23ec-4624-ba5c-d9ab010424e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79681d58-1364-42d2-99e4-7fe4965bf625", "name": "network-vif-deleted", "tag": "60e97be3-b803-4c66-9436-f1a9cc2abcdd"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:27:16.839533 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-33a69f45-25b1-42d3-bcfa-760490128777 req-09fa76c2-23ec-4624-ba5c-d9ab010424e3 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:16.840019 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-33a69f45-25b1-42d3-bcfa-760490128777 req-09fa76c2-23ec-4624-ba5c-d9ab010424e3 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:16.840987 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-33a69f45-25b1-42d3-bcfa-760490128777 req-09fa76c2-23ec-4624-ba5c-d9ab010424e3 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:16.854197 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-33a69f45-25b1-42d3-bcfa-760490128777 req-09fa76c2-23ec-4624-ba5c-d9ab010424e3 service nova] Creating event network-vif-deleted:60e97be3-b803-4c66-9436-f1a9cc2abcdd for instance 79681d58-1364-42d2-99e4-7fe4965bf625 on n-h2-master-1 Oct 23 01:27:16.862118 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-33a69f45-25b1-42d3-bcfa-760490128777 req-09fa76c2-23ec-4624-ba5c-d9ab010424e3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040208 Oct 23 01:27:16.863548 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1988/4018] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:27:16.885812 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0216e07a-889a-432e-92fd-4cff4ac409ec tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:16.886831 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0216e07a-889a-432e-92fd-4cff4ac409ec tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] [instance: ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:16.893586 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0216e07a-889a-432e-92fd-4cff4ac409ec tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:16.895156 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0216e07a-889a-432e-92fd-4cff4ac409ec tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:16.895156 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0216e07a-889a-432e-92fd-4cff4ac409ec tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:16.895771 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0216e07a-889a-432e-92fd-4cff4ac409ec tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:16.896482 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0216e07a-889a-432e-92fd-4cff4ac409ec tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:16.897135 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0216e07a-889a-432e-92fd-4cff4ac409ec tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:16.940191 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c2d03ea9-bdd7-4480-97de-2720da11c500 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.225086 Oct 23 01:27:16.941230 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2031/4019] 10.222.0.42 () {58 vars in 1275 bytes} [Sun Oct 23 01:27:16 2022] GET /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87/os-interface => generated 284 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:27:16.980009 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-793e0b85-31ad-4fe1-9655-345918fcd73b req-6e742d8c-819c-484c-aa74-976cb9d2dd48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d", "name": "network-vif-unplugged", "status": "completed", "tag": "007e6906-2969-451c-bd1b-9c4c9e24d5ed"}, {"server_uuid": "ad46f590-af38-463e-87db-62c442e08669", "name": "network-vif-unplugged", "status": "completed", "tag": "d91fdad3-e41c-42ed-88d5-cc3ba6ed68a4"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:27:16.997549 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-793e0b85-31ad-4fe1-9655-345918fcd73b req-6e742d8c-819c-484c-aa74-976cb9d2dd48 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:16.998077 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-793e0b85-31ad-4fe1-9655-345918fcd73b req-6e742d8c-819c-484c-aa74-976cb9d2dd48 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:16.998525 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-793e0b85-31ad-4fe1-9655-345918fcd73b req-6e742d8c-819c-484c-aa74-976cb9d2dd48 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:17.032217 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-793e0b85-31ad-4fe1-9655-345918fcd73b req-6e742d8c-819c-484c-aa74-976cb9d2dd48 service nova] Creating event network-vif-unplugged:007e6906-2969-451c-bd1b-9c4c9e24d5ed for instance ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d on n-h1-master-1 Oct 23 01:27:17.032741 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-793e0b85-31ad-4fe1-9655-345918fcd73b req-6e742d8c-819c-484c-aa74-976cb9d2dd48 service nova] Creating event network-vif-unplugged:d91fdad3-e41c-42ed-88d5-cc3ba6ed68a4 for instance ad46f590-af38-463e-87db-62c442e08669 on n-h1-master-1 Oct 23 01:27:17.047727 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-793e0b85-31ad-4fe1-9655-345918fcd73b req-6e742d8c-819c-484c-aa74-976cb9d2dd48 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.072653 Oct 23 01:27:17.048673 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2032/4020] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:27:17.309422 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ef2ed460-0b04-4542-99db-eb63797b83da tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:17.312571 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0216e07a-889a-432e-92fd-4cff4ac409ec tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1fb3cadf09d4d5da19e37b0080a0f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf117bb5bf4e76b3bab3ef518dce11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:17.313164 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ef2ed460-0b04-4542-99db-eb63797b83da tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] [instance: d27396ae-9295-4187-9ef7-6d7416ee02b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:17.322977 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ef2ed460-0b04-4542-99db-eb63797b83da tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:17.327846 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0216e07a-889a-432e-92fd-4cff4ac409ec tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/servers/ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d" status: 200 len: 1473 microversion: 2.1 time: 0.453319 Oct 23 01:27:17.328778 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1989/4021] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:27:16 2022] GET /compute/v2.1/servers/ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d => generated 1473 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:27:17.334194 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ef2ed460-0b04-4542-99db-eb63797b83da tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:17.336709 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ef2ed460-0b04-4542-99db-eb63797b83da tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:17.340610 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ef2ed460-0b04-4542-99db-eb63797b83da tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:17.341091 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ef2ed460-0b04-4542-99db-eb63797b83da tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:17.341523 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ef2ed460-0b04-4542-99db-eb63797b83da tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:17.353725 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-feec1baf-25c2-43d7-801f-0d6a2dcb9249 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:17.354843 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-feec1baf-25c2-43d7-801f-0d6a2dcb9249 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:17.369771 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-feec1baf-25c2-43d7-801f-0d6a2dcb9249 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:17.370604 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-feec1baf-25c2-43d7-801f-0d6a2dcb9249 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:17.374229 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-feec1baf-25c2-43d7-801f-0d6a2dcb9249 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:17.375347 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-feec1baf-25c2-43d7-801f-0d6a2dcb9249 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:17.376052 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-feec1baf-25c2-43d7-801f-0d6a2dcb9249 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:17.376723 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-feec1baf-25c2-43d7-801f-0d6a2dcb9249 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:17.771033 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ef2ed460-0b04-4542-99db-eb63797b83da tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb8ce5c15bd4a6199cfdf84c49837ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb23cbc0c142a2a4b7a39df99a7d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:17.780863 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ef2ed460-0b04-4542-99db-eb63797b83da tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] 10.222.0.42 "GET /compute/v2.1/servers/d27396ae-9295-4187-9ef7-6d7416ee02b0" status: 200 len: 1665 microversion: 2.1 time: 0.477406 Oct 23 01:27:17.789010 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2033/4022] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:27:17 2022] GET /compute/v2.1/servers/d27396ae-9295-4187-9ef7-6d7416ee02b0 => generated 1665 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:27:17.805850 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8c9a085f-6a0c-40d4-9964-2e5f72712fa8 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:17.817966 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8c9a085f-6a0c-40d4-9964-2e5f72712fa8 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:17.824562 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c9a085f-6a0c-40d4-9964-2e5f72712fa8 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:17.825350 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c9a085f-6a0c-40d4-9964-2e5f72712fa8 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:17.825795 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c9a085f-6a0c-40d4-9964-2e5f72712fa8 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:17.826531 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c9a085f-6a0c-40d4-9964-2e5f72712fa8 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:17.826989 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c9a085f-6a0c-40d4-9964-2e5f72712fa8 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:17.827412 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c9a085f-6a0c-40d4-9964-2e5f72712fa8 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:17.994582 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-feec1baf-25c2-43d7-801f-0d6a2dcb9249 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:18.013682 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-feec1baf-25c2-43d7-801f-0d6a2dcb9249 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:18.015189 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-feec1baf-25c2-43d7-801f-0d6a2dcb9249 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:18.016450 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-feec1baf-25c2-43d7-801f-0d6a2dcb9249 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 2960 microversion: 2.42 time: 0.666794 Oct 23 01:27:18.035742 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1990/4023] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:27:17 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 2960 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:27:18.045290 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-10b42ee9-3c1c-4fb4-b409-40bdc9d7f464 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:18.045290 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-10b42ee9-3c1c-4fb4-b409-40bdc9d7f464 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 79681d58-1364-42d2-99e4-7fe4965bf625] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:18.049946 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10b42ee9-3c1c-4fb4-b409-40bdc9d7f464 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:18.050456 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10b42ee9-3c1c-4fb4-b409-40bdc9d7f464 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:18.051128 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10b42ee9-3c1c-4fb4-b409-40bdc9d7f464 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:18.051779 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10b42ee9-3c1c-4fb4-b409-40bdc9d7f464 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:18.052241 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10b42ee9-3c1c-4fb4-b409-40bdc9d7f464 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:18.052659 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10b42ee9-3c1c-4fb4-b409-40bdc9d7f464 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:18.062145 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8c9a085f-6a0c-40d4-9964-2e5f72712fa8 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:18.087078 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8c9a085f-6a0c-40d4-9964-2e5f72712fa8 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:18.088735 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8c9a085f-6a0c-40d4-9964-2e5f72712fa8 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:18.090652 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8c9a085f-6a0c-40d4-9964-2e5f72712fa8 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1737 microversion: 2.20 time: 0.293546 Oct 23 01:27:18.091242 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2034/4024] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:27:17 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1737 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:27:18.098683 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5edfc912-8c04-4ac1-8aff-bee25f29f871 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc18625e0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:18.188127 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5edfc912-8c04-4ac1-8aff-bee25f29f871 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images/15656f0b-ee3c-4916-9e79-9548ba759af5" status: 200 len: 1453 microversion: 2.1 time: 0.093175 Oct 23 01:27:18.189048 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2035/4025] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:27:18 2022] GET /compute/v2.1/images/15656f0b-ee3c-4916-9e79-9548ba759af5 => generated 1453 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:27:18.243399 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-10b42ee9-3c1c-4fb4-b409-40bdc9d7f464 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:18.259745 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-10b42ee9-3c1c-4fb4-b409-40bdc9d7f464 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625" status: 200 len: 1465 microversion: 2.1 time: 0.222745 Oct 23 01:27:18.260548 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1991/4026] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:27:18 2022] GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625 => generated 1465 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:27:18.351293 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0cc5e98f-cd23-4d7a-bdec-900a025c55da tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:18.352582 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0cc5e98f-cd23-4d7a-bdec-900a025c55da tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] [instance: ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:18.374210 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0cc5e98f-cd23-4d7a-bdec-900a025c55da tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:18.375918 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0cc5e98f-cd23-4d7a-bdec-900a025c55da tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:18.376660 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0cc5e98f-cd23-4d7a-bdec-900a025c55da tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:18.377637 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0cc5e98f-cd23-4d7a-bdec-900a025c55da tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:18.378364 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0cc5e98f-cd23-4d7a-bdec-900a025c55da tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:18.379034 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0cc5e98f-cd23-4d7a-bdec-900a025c55da tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:18.445085 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0cc5e98f-cd23-4d7a-bdec-900a025c55da tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:18.445678 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0cc5e98f-cd23-4d7a-bdec-900a025c55da tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:18.446227 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0cc5e98f-cd23-4d7a-bdec-900a025c55da tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:18.446745 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-0cc5e98f-cd23-4d7a-bdec-900a025c55da tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lazy-loading 'fault' on Instance uuid ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:27:18.550076 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0cc5e98f-cd23-4d7a-bdec-900a025c55da tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1fb3cadf09d4d5da19e37b0080a0f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf117bb5bf4e76b3bab3ef518dce11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:18.564418 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0cc5e98f-cd23-4d7a-bdec-900a025c55da tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/servers/ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d" status: 200 len: 1307 microversion: 2.1 time: 0.216025 Oct 23 01:27:18.579673 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2036/4027] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:27:18 2022] GET /compute/v2.1/servers/ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d => generated 1307 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:27:18.811542 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-96d44c7a-d9fa-4fd2-969f-a43bc742b6da tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:18.812158 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-96d44c7a-d9fa-4fd2-969f-a43bc742b6da tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] [instance: d27396ae-9295-4187-9ef7-6d7416ee02b0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:18.831744 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-96d44c7a-d9fa-4fd2-969f-a43bc742b6da tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:18.834159 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-96d44c7a-d9fa-4fd2-969f-a43bc742b6da tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:18.834159 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-96d44c7a-d9fa-4fd2-969f-a43bc742b6da tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:18.834159 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-96d44c7a-d9fa-4fd2-969f-a43bc742b6da tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:18.834159 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-96d44c7a-d9fa-4fd2-969f-a43bc742b6da tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:18.834597 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-96d44c7a-d9fa-4fd2-969f-a43bc742b6da tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:18.927014 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-b0396556-7282-4b56-a905-2e9af5b64b5b req-3a8759f3-5798-451d-af8d-edae0dc3fda6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d", "name": "network-vif-deleted", "tag": "007e6906-2969-451c-bd1b-9c4c9e24d5ed"}, {"server_uuid": "d27396ae-9295-4187-9ef7-6d7416ee02b0", "name": "network-vif-deleted", "tag": "fc1e5b9c-a069-4fdd-bbaf-44813ca2a747"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:27:18.962362 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-b0396556-7282-4b56-a905-2e9af5b64b5b req-3a8759f3-5798-451d-af8d-edae0dc3fda6 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:18.973534 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-b0396556-7282-4b56-a905-2e9af5b64b5b req-3a8759f3-5798-451d-af8d-edae0dc3fda6 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:18.974001 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-b0396556-7282-4b56-a905-2e9af5b64b5b req-3a8759f3-5798-451d-af8d-edae0dc3fda6 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:19.028304 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-b0396556-7282-4b56-a905-2e9af5b64b5b req-3a8759f3-5798-451d-af8d-edae0dc3fda6 service nova] Creating event network-vif-deleted:007e6906-2969-451c-bd1b-9c4c9e24d5ed for instance ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d on n-h1-master-1 Oct 23 01:27:19.028917 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-b0396556-7282-4b56-a905-2e9af5b64b5b req-3a8759f3-5798-451d-af8d-edae0dc3fda6 service nova] Creating event network-vif-deleted:fc1e5b9c-a069-4fdd-bbaf-44813ca2a747 for instance d27396ae-9295-4187-9ef7-6d7416ee02b0 on n-h2-master-1 Oct 23 01:27:19.046593 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-b0396556-7282-4b56-a905-2e9af5b64b5b req-3a8759f3-5798-451d-af8d-edae0dc3fda6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.123580 Oct 23 01:27:19.051352 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2037/4028] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:27:19.057700 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cf93d3f6-94a7-4605-b89f-daa0ea30ac6d tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:19.058732 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-cf93d3f6-94a7-4605-b89f-daa0ea30ac6d tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:19.066942 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf93d3f6-94a7-4605-b89f-daa0ea30ac6d tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:19.068253 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf93d3f6-94a7-4605-b89f-daa0ea30ac6d tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:19.068909 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf93d3f6-94a7-4605-b89f-daa0ea30ac6d tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:19.069861 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf93d3f6-94a7-4605-b89f-daa0ea30ac6d tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:19.070586 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf93d3f6-94a7-4605-b89f-daa0ea30ac6d tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:19.071243 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf93d3f6-94a7-4605-b89f-daa0ea30ac6d tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:19.101162 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-96d44c7a-d9fa-4fd2-969f-a43bc742b6da tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb8ce5c15bd4a6199cfdf84c49837ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb23cbc0c142a2a4b7a39df99a7d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:19.126293 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-96d44c7a-d9fa-4fd2-969f-a43bc742b6da tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] 10.222.0.42 "GET /compute/v2.1/servers/d27396ae-9295-4187-9ef7-6d7416ee02b0" status: 200 len: 1598 microversion: 2.1 time: 0.319071 Oct 23 01:27:19.129449 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1992/4029] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:27:18 2022] GET /compute/v2.1/servers/d27396ae-9295-4187-9ef7-6d7416ee02b0 => generated 1598 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:27:19.139417 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8e2c4b62-9e38-43da-92c1-7ce15a0892fd tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:19.140816 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8e2c4b62-9e38-43da-92c1-7ce15a0892fd tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:19.151799 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8e2c4b62-9e38-43da-92c1-7ce15a0892fd tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:19.153196 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8e2c4b62-9e38-43da-92c1-7ce15a0892fd tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:19.153929 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8e2c4b62-9e38-43da-92c1-7ce15a0892fd tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:19.155061 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8e2c4b62-9e38-43da-92c1-7ce15a0892fd tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:19.155745 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8e2c4b62-9e38-43da-92c1-7ce15a0892fd tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:19.156395 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8e2c4b62-9e38-43da-92c1-7ce15a0892fd tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:19.717233 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cf93d3f6-94a7-4605-b89f-daa0ea30ac6d tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:19.743113 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cf93d3f6-94a7-4605-b89f-daa0ea30ac6d tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:19.754753 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cf93d3f6-94a7-4605-b89f-daa0ea30ac6d tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:19.756423 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cf93d3f6-94a7-4605-b89f-daa0ea30ac6d tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 2960 microversion: 2.42 time: 0.703871 Oct 23 01:27:19.757212 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2038/4030] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:27:19 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 2960 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:27:19.773420 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8a3c72c1-a2fb-48e8-b6a3-437a1a7448a6 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc0feadc0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:19.851079 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8e2c4b62-9e38-43da-92c1-7ce15a0892fd tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:19.852301 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8a3c72c1-a2fb-48e8-b6a3-437a1a7448a6 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images/15656f0b-ee3c-4916-9e79-9548ba759af5" status: 200 len: 1453 microversion: 2.1 time: 0.093828 Oct 23 01:27:19.853263 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2039/4031] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:27:19 2022] GET /compute/v2.1/images/15656f0b-ee3c-4916-9e79-9548ba759af5 => generated 1453 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:27:19.865525 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-96dd9dff-1952-4a7d-94b5-1e4c32f52335 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:19.866717 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-96dd9dff-1952-4a7d-94b5-1e4c32f52335 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 79681d58-1364-42d2-99e4-7fe4965bf625] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:19.880022 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-96dd9dff-1952-4a7d-94b5-1e4c32f52335 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:19.880525 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-96dd9dff-1952-4a7d-94b5-1e4c32f52335 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:19.881137 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-96dd9dff-1952-4a7d-94b5-1e4c32f52335 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:19.887973 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8e2c4b62-9e38-43da-92c1-7ce15a0892fd tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:19.891740 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8e2c4b62-9e38-43da-92c1-7ce15a0892fd tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:19.894224 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8e2c4b62-9e38-43da-92c1-7ce15a0892fd tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1737 microversion: 2.20 time: 0.763224 Oct 23 01:27:19.895511 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-96dd9dff-1952-4a7d-94b5-1e4c32f52335 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:19.896222 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-96dd9dff-1952-4a7d-94b5-1e4c32f52335 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:19.897030 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1993/4032] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:27:19 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1737 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:27:19.897513 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-96dd9dff-1952-4a7d-94b5-1e4c32f52335 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:19.929831 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-670fce82-1c5d-4439-8b6e-6c73fa3930db tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:19.939463 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-670fce82-1c5d-4439-8b6e-6c73fa3930db tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] [instance: ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:19.962104 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-670fce82-1c5d-4439-8b6e-6c73fa3930db tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:19.964954 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-670fce82-1c5d-4439-8b6e-6c73fa3930db tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:19.967768 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-670fce82-1c5d-4439-8b6e-6c73fa3930db tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:19.971337 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-670fce82-1c5d-4439-8b6e-6c73fa3930db tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:19.972187 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-670fce82-1c5d-4439-8b6e-6c73fa3930db tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:19.975417 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-670fce82-1c5d-4439-8b6e-6c73fa3930db tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:19.979103 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-96dd9dff-1952-4a7d-94b5-1e4c32f52335 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:19.979821 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-96dd9dff-1952-4a7d-94b5-1e4c32f52335 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:19.980445 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-96dd9dff-1952-4a7d-94b5-1e4c32f52335 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:19.982003 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-96dd9dff-1952-4a7d-94b5-1e4c32f52335 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lazy-loading 'fault' on Instance uuid 79681d58-1364-42d2-99e4-7fe4965bf625 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:27:20.015784 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-670fce82-1c5d-4439-8b6e-6c73fa3930db tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] HTTP exception thrown: Instance ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d could not be found. Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-670fce82-1c5d-4439-8b6e-6c73fa3930db tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Request method failure captured: Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d HTTP/1.1 Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJgeiRNhY5TL1HJfq7MfvXXxwFIC1B1X_xQe6JFoUeycgKPlRyoIIoRkRC7wwv6_4ehsCaKPL7GY0lxy2bZxxafXhBo-TYEkwi_iXxPklBGh1dTr8A9PaTyX9awdaO1SCNrsf5xgFRLve4Wkf-sAGkwxB_azvNig0RlkVH-WlSvuPmM Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: badf117bb5bf4e76b3bab3ef518dce11 Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ImagesOneServerTestJSON-327190347 Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/badf117bb5bf4e76b3bab3ef518dce11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_badf117bb5bf4e76b3bab3ef518dce11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/badf117bb5bf4e76b3bab3ef518dce11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/badf117bb5bf4e76b3bab3ef518dce11"}]}] Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ImagesOneServerTestJSON-327190347 Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: badf117bb5bf4e76b3bab3ef518dce11 Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-327190347 Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ImagesOneServerTestJSON-327190347-project Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: c1fb3cadf09d4d5da19e37b0080a0f26 Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ImagesOneServerTestJSON-327190347-project Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: exception: Instance ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d could not be found. Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d'} Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d could not be found. Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d could not be found. Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:27:20.017787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:27:20.023594 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:27:20.023594 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:27:20.023594 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:27:20.023594 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:27:20.023594 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:27:20.023594 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d could not be found. Oct 23 01:27:20.023594 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:27:20.023594 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-670fce82-1c5d-4439-8b6e-6c73fa3930db tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] Returning 404 to user: Instance ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:27:20.023594 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-670fce82-1c5d-4439-8b6e-6c73fa3930db tempest-ImagesOneServerTestJSON-327190347 tempest-ImagesOneServerTestJSON-327190347-project] 10.222.0.42 "GET /compute/v2.1/servers/ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d" status: 404 len: 111 microversion: 2.1 time: 0.107887 Oct 23 01:27:20.025160 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1994/4033] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:27:19 2022] GET /compute/v2.1/servers/ab3e62fe-5ee6-446c-a635-c6bdf18a9f5d => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:27:20.103809 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-96dd9dff-1952-4a7d-94b5-1e4c32f52335 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:20.119794 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-96dd9dff-1952-4a7d-94b5-1e4c32f52335 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625" status: 200 len: 1311 microversion: 2.1 time: 0.265399 Oct 23 01:27:20.123452 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2040/4034] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:27:19 2022] GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625 => generated 1311 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:27:20.153276 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6f977186-c098-442e-9dd3-09e3cc476cea tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:20.154402 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6f977186-c098-442e-9dd3-09e3cc476cea tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] [instance: d27396ae-9295-4187-9ef7-6d7416ee02b0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:20.166321 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6f977186-c098-442e-9dd3-09e3cc476cea tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:20.166838 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6f977186-c098-442e-9dd3-09e3cc476cea tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:20.179123 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6f977186-c098-442e-9dd3-09e3cc476cea tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:20.182152 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6f977186-c098-442e-9dd3-09e3cc476cea tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:20.182587 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6f977186-c098-442e-9dd3-09e3cc476cea tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:20.183815 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6f977186-c098-442e-9dd3-09e3cc476cea tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:20.261704 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6f977186-c098-442e-9dd3-09e3cc476cea tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:20.263961 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6f977186-c098-442e-9dd3-09e3cc476cea tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:20.264918 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6f977186-c098-442e-9dd3-09e3cc476cea tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:20.266666 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-6f977186-c098-442e-9dd3-09e3cc476cea tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lazy-loading 'fault' on Instance uuid d27396ae-9295-4187-9ef7-6d7416ee02b0 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:27:20.347269 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6f977186-c098-442e-9dd3-09e3cc476cea tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb8ce5c15bd4a6199cfdf84c49837ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb23cbc0c142a2a4b7a39df99a7d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:20.396995 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6f977186-c098-442e-9dd3-09e3cc476cea tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] 10.222.0.42 "GET /compute/v2.1/servers/d27396ae-9295-4187-9ef7-6d7416ee02b0" status: 200 len: 1315 microversion: 2.1 time: 0.248123 Oct 23 01:27:20.398256 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1995/4035] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:27:20 2022] GET /compute/v2.1/servers/d27396ae-9295-4187-9ef7-6d7416ee02b0 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:27:20.550181 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-083585bb-52ea-4346-8aee-19e59c9e6b57 req-7007bbe0-94cb-4a80-ae3c-7833b95f741a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fb11dc6-65bc-4c8e-a674-c948f42f1b87", "tag": "68515858-8d68-4868-b082-cf88ddda8e2c"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:27:20.570073 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-083585bb-52ea-4346-8aee-19e59c9e6b57 req-7007bbe0-94cb-4a80-ae3c-7833b95f741a service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:20.573364 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-083585bb-52ea-4346-8aee-19e59c9e6b57 req-7007bbe0-94cb-4a80-ae3c-7833b95f741a service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:20.574545 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-083585bb-52ea-4346-8aee-19e59c9e6b57 req-7007bbe0-94cb-4a80-ae3c-7833b95f741a service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:20.595231 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-083585bb-52ea-4346-8aee-19e59c9e6b57 req-7007bbe0-94cb-4a80-ae3c-7833b95f741a service nova] Creating event network-changed:68515858-8d68-4868-b082-cf88ddda8e2c for instance 0fb11dc6-65bc-4c8e-a674-c948f42f1b87 on n-h2-master-1 Oct 23 01:27:20.600486 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-083585bb-52ea-4346-8aee-19e59c9e6b57 req-7007bbe0-94cb-4a80-ae3c-7833b95f741a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054376 Oct 23 01:27:20.601179 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2041/4036] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:27:20.790375 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2f57e2a4-7255-483e-80ff-429038558528 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:20.795663 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2f57e2a4-7255-483e-80ff-429038558528 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:20.813649 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2f57e2a4-7255-483e-80ff-429038558528 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:20.814462 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2f57e2a4-7255-483e-80ff-429038558528 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:20.820637 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2f57e2a4-7255-483e-80ff-429038558528 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:20.822182 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2f57e2a4-7255-483e-80ff-429038558528 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:20.830149 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2f57e2a4-7255-483e-80ff-429038558528 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:20.832198 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2f57e2a4-7255-483e-80ff-429038558528 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:20.869794 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a9eb45ef-15ae-4617-b93b-6089546f3787 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc0feadc0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:20.958894 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a9eb45ef-15ae-4617-b93b-6089546f3787 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images/15656f0b-ee3c-4916-9e79-9548ba759af5" status: 200 len: 1453 microversion: 2.1 time: 0.093536 Oct 23 01:27:20.959981 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2042/4037] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:27:20 2022] GET /compute/v2.1/images/15656f0b-ee3c-4916-9e79-9548ba759af5 => generated 1453 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:27:20.979913 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-44535d01-4127-4f0e-9954-94ab1a20b0c8 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:20.981482 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-44535d01-4127-4f0e-9954-94ab1a20b0c8 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:20.999204 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-44535d01-4127-4f0e-9954-94ab1a20b0c8 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:21.001206 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-44535d01-4127-4f0e-9954-94ab1a20b0c8 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:21.005054 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-44535d01-4127-4f0e-9954-94ab1a20b0c8 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:21.006127 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-44535d01-4127-4f0e-9954-94ab1a20b0c8 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:21.006825 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-44535d01-4127-4f0e-9954-94ab1a20b0c8 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:21.008037 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-44535d01-4127-4f0e-9954-94ab1a20b0c8 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:22.390445 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2f57e2a4-7255-483e-80ff-429038558528 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:22.412384 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2f57e2a4-7255-483e-80ff-429038558528 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:22.427764 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2f57e2a4-7255-483e-80ff-429038558528 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:22.431750 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2f57e2a4-7255-483e-80ff-429038558528 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 2939 microversion: 2.42 time: 1.644245 Oct 23 01:27:22.449001 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1996/4038] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:27:20 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 2939 bytes in 1649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:27:22.449001 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ce11edde-3ad2-40f1-8f1a-1819c7091fa7 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:22.449001 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ce11edde-3ad2-40f1-8f1a-1819c7091fa7 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 79681d58-1364-42d2-99e4-7fe4965bf625] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:22.452692 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ce11edde-3ad2-40f1-8f1a-1819c7091fa7 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:22.456662 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ce11edde-3ad2-40f1-8f1a-1819c7091fa7 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:22.465065 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ce11edde-3ad2-40f1-8f1a-1819c7091fa7 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:22.466292 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ce11edde-3ad2-40f1-8f1a-1819c7091fa7 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:22.466743 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-44535d01-4127-4f0e-9954-94ab1a20b0c8 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:22.467543 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ce11edde-3ad2-40f1-8f1a-1819c7091fa7 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:22.468165 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ce11edde-3ad2-40f1-8f1a-1819c7091fa7 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:22.481604 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-44535d01-4127-4f0e-9954-94ab1a20b0c8 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:22.483723 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-44535d01-4127-4f0e-9954-94ab1a20b0c8 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:22.486451 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-44535d01-4127-4f0e-9954-94ab1a20b0c8 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1737 microversion: 2.20 time: 1.525336 Oct 23 01:27:22.510866 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2043/4039] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:27:20 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1737 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:27:22.518095 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-ce11edde-3ad2-40f1-8f1a-1819c7091fa7 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] HTTP exception thrown: Instance 79681d58-1364-42d2-99e4-7fe4965bf625 could not be found. Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ce11edde-3ad2-40f1-8f1a-1819c7091fa7 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Request method failure captured: Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625 HTTP/1.1 Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJdQk8hX6uPg4qHO6qc2mwusfqzM5L9E46F0sE_pC33qOsFxuj7jBx97KQnGjJpiMRyi7Ccd4qVZLYee5QWMbRFkTPXMBEfS5K72Bw65O1CzepVHWqpUTGTMXTiFqb2LFyp2Lx0G54EC4LTSr0BIWkU_QP9JqR2fGUhTDQevTmiXx40 Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 4c25b4509ad7457bad4a2e5e0bc59add Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1648319695 Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4c25b4509ad7457bad4a2e5e0bc59add"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4c25b4509ad7457bad4a2e5e0bc59add"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4c25b4509ad7457bad4a2e5e0bc59add"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4c25b4509ad7457bad4a2e5e0bc59add"}]}] Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1648319695 Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 4c25b4509ad7457bad4a2e5e0bc59add Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1648319695 Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServerRescueNegativeTestJSON-1648319695-project Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 19bff9f7a4254110b3b89f0cba5d252f Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1648319695-project Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 79681d58-1364-42d2-99e4-7fe4965bf625 could not be found. Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '79681d58-1364-42d2-99e4-7fe4965bf625'} Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79681d58-1364-42d2-99e4-7fe4965bf625 could not be found. Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79681d58-1364-42d2-99e4-7fe4965bf625 could not be found. Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:27:22.526346 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:27:22.534938 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:27:22.534938 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:27:22.534938 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:27:22.534938 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:27:22.534938 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:27:22.534938 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:27:22.534938 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79681d58-1364-42d2-99e4-7fe4965bf625 could not be found. Oct 23 01:27:22.534938 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:27:22.534938 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ce11edde-3ad2-40f1-8f1a-1819c7091fa7 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Returning 404 to user: Instance 79681d58-1364-42d2-99e4-7fe4965bf625 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:27:22.535992 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0682414a-3153-4b71-a67d-4579bd900356 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:22.535992 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0682414a-3153-4b71-a67d-4579bd900356 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] [instance: d27396ae-9295-4187-9ef7-6d7416ee02b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:22.545666 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ce11edde-3ad2-40f1-8f1a-1819c7091fa7 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625" status: 404 len: 111 microversion: 2.1 time: 0.104876 Oct 23 01:27:22.546684 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1997/4040] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:27:22 2022] GET /compute/v2.1/servers/79681d58-1364-42d2-99e4-7fe4965bf625 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:27:22.567595 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a3c41af9-95e8-4cb5-b7b9-f031a31aa908 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc1678670>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:22.569715 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0682414a-3153-4b71-a67d-4579bd900356 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:22.570593 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0682414a-3153-4b71-a67d-4579bd900356 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:22.575413 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0682414a-3153-4b71-a67d-4579bd900356 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:22.575413 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0682414a-3153-4b71-a67d-4579bd900356 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:22.575413 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0682414a-3153-4b71-a67d-4579bd900356 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:22.575413 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0682414a-3153-4b71-a67d-4579bd900356 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:22.594162 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-0682414a-3153-4b71-a67d-4579bd900356 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] HTTP exception thrown: Instance d27396ae-9295-4187-9ef7-6d7416ee02b0 could not be found. Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0682414a-3153-4b71-a67d-4579bd900356 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Request method failure captured: Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/d27396ae-9295-4187-9ef7-6d7416ee02b0 HTTP/1.1 Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJgfWhRd4r-P5sMWD9KKlXoHgRKmEEdua8P63QLCqqd0MhbhGk4B0WpbyTERLf-156OtuDWTDbXKhKTP2uMfRael8Jm8VEeJIWY8lD4fgw8WubNlsPYJbWkWFZstQyPpdzD8Xf9ELpFzM-Qv2OBq1qV5lRDXbOib2MlXLR8tdHyGX9M Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: a3bb23cbc0c142a2a4b7a39df99a7d4a Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersTestFqdnHostnames-277705324 Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a3bb23cbc0c142a2a4b7a39df99a7d4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a3bb23cbc0c142a2a4b7a39df99a7d4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a3bb23cbc0c142a2a4b7a39df99a7d4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a3bb23cbc0c142a2a4b7a39df99a7d4a"}]}] Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersTestFqdnHostnames-277705324 Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: a3bb23cbc0c142a2a4b7a39df99a7d4a Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-277705324 Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersTestFqdnHostnames-277705324-project Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: fbb8ce5c15bd4a6199cfdf84c49837ef Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersTestFqdnHostnames-277705324-project Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: exception: Instance d27396ae-9295-4187-9ef7-6d7416ee02b0 could not be found. Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'd27396ae-9295-4187-9ef7-6d7416ee02b0'} Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d27396ae-9295-4187-9ef7-6d7416ee02b0 could not be found. Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d27396ae-9295-4187-9ef7-6d7416ee02b0 could not be found. Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:27:22.597330 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:27:22.602914 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:27:22.602914 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:27:22.602914 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:27:22.602914 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:27:22.602914 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:27:22.602914 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d27396ae-9295-4187-9ef7-6d7416ee02b0 could not be found. Oct 23 01:27:22.602914 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:27:22.606644 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0682414a-3153-4b71-a67d-4579bd900356 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Returning 404 to user: Instance d27396ae-9295-4187-9ef7-6d7416ee02b0 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:27:22.611688 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0682414a-3153-4b71-a67d-4579bd900356 tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] 10.222.0.42 "GET /compute/v2.1/servers/d27396ae-9295-4187-9ef7-6d7416ee02b0" status: 404 len: 111 microversion: 2.1 time: 0.094294 Oct 23 01:27:22.611688 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2044/4041] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:27:22 2022] GET /compute/v2.1/servers/d27396ae-9295-4187-9ef7-6d7416ee02b0 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:27:22.619874 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-13a49529-c3fb-4740-bc5f-0e9a4ab9f5c5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:22.620654 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-13a49529-c3fb-4740-bc5f-0e9a4ab9f5c5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 3d9196f6-d696-45e0-b7fc-8d1557498393] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:22.629444 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13a49529-c3fb-4740-bc5f-0e9a4ab9f5c5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:22.630364 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13a49529-c3fb-4740-bc5f-0e9a4ab9f5c5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:22.631169 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13a49529-c3fb-4740-bc5f-0e9a4ab9f5c5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:22.632084 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13a49529-c3fb-4740-bc5f-0e9a4ab9f5c5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:22.632961 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13a49529-c3fb-4740-bc5f-0e9a4ab9f5c5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:22.633559 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13a49529-c3fb-4740-bc5f-0e9a4ab9f5c5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:22.669869 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-13a49529-c3fb-4740-bc5f-0e9a4ab9f5c5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 3d9196f6-d696-45e0-b7fc-8d1557498393] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:27:23.060101 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-13a49529-c3fb-4740-bc5f-0e9a4ab9f5c5 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393" status: 204 len: 0 microversion: 2.1 time: 0.450588 Oct 23 01:27:23.065402 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2045/4042] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:27:22 2022] DELETE /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:27:23.072020 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4e30bb34-a8cb-4f2f-9b3a-fd87513320ed tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] Calling method '.version_select at 0x7f5cc184fa60>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:23.179087 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4e30bb34-a8cb-4f2f-9b3a-fd87513320ed tempest-ServersTestFqdnHostnames-277705324 tempest-ServersTestFqdnHostnames-277705324-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-744068114" status: 202 len: 0 microversion: 2.1 time: 0.111570 Oct 23 01:27:23.179856 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2046/4043] 10.222.0.42 () {58 vars in 1218 bytes} [Sun Oct 23 01:27:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-744068114 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:27:23.189708 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-7e3eacae-ba0a-4456-b951-d26cd7bb925a req-7237e56f-dcd5-457d-8db9-735e632909ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb", "name": "network-vif-plugged", "status": "completed", "tag": "54e7645f-922e-48c7-870d-b18d536be4be"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:27:23.226732 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-7e3eacae-ba0a-4456-b951-d26cd7bb925a req-7237e56f-dcd5-457d-8db9-735e632909ea service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:23.234038 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-7e3eacae-ba0a-4456-b951-d26cd7bb925a req-7237e56f-dcd5-457d-8db9-735e632909ea service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:23.255239 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-7e3eacae-ba0a-4456-b951-d26cd7bb925a req-7237e56f-dcd5-457d-8db9-735e632909ea service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:23.287108 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-7e3eacae-ba0a-4456-b951-d26cd7bb925a req-7237e56f-dcd5-457d-8db9-735e632909ea service nova] Creating event network-vif-plugged:54e7645f-922e-48c7-870d-b18d536be4be for instance 36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb on n-h1-master-1 Oct 23 01:27:23.305444 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-7e3eacae-ba0a-4456-b951-d26cd7bb925a req-7237e56f-dcd5-457d-8db9-735e632909ea service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119935 Oct 23 01:27:23.311042 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2047/4044] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:27:23.319956 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9fb53207-5541-4954-988f-b8ebf56b3fae tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:23.323003 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9fb53207-5541-4954-988f-b8ebf56b3fae tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 3d9196f6-d696-45e0-b7fc-8d1557498393] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:23.340904 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9fb53207-5541-4954-988f-b8ebf56b3fae tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:23.340904 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9fb53207-5541-4954-988f-b8ebf56b3fae tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:23.340904 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9fb53207-5541-4954-988f-b8ebf56b3fae tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:23.342670 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9fb53207-5541-4954-988f-b8ebf56b3fae tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:23.346006 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9fb53207-5541-4954-988f-b8ebf56b3fae tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:23.346673 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9fb53207-5541-4954-988f-b8ebf56b3fae tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:23.409320 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:27:24.394316 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9fb53207-5541-4954-988f-b8ebf56b3fae tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:24.410133 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9fb53207-5541-4954-988f-b8ebf56b3fae tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393" status: 200 len: 1521 microversion: 2.1 time: 1.091741 Oct 23 01:27:24.420789 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2048/4045] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:27:23 2022] GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393 => generated 1521 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:27:24.425374 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3b959db8-8e1f-4d74-a1ec-91f1e7db5a8c tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:24.426011 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3b959db8-8e1f-4d74-a1ec-91f1e7db5a8c tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:24.452298 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3b959db8-8e1f-4d74-a1ec-91f1e7db5a8c tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:24.456141 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3b959db8-8e1f-4d74-a1ec-91f1e7db5a8c tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:24.456141 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3b959db8-8e1f-4d74-a1ec-91f1e7db5a8c tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:24.456141 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3b959db8-8e1f-4d74-a1ec-91f1e7db5a8c tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:24.456141 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3b959db8-8e1f-4d74-a1ec-91f1e7db5a8c tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:24.456141 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3b959db8-8e1f-4d74-a1ec-91f1e7db5a8c tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:24.984117 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3b959db8-8e1f-4d74-a1ec-91f1e7db5a8c tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:25.008064 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3b959db8-8e1f-4d74-a1ec-91f1e7db5a8c tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:25.015622 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3b959db8-8e1f-4d74-a1ec-91f1e7db5a8c tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:25.023339 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3b959db8-8e1f-4d74-a1ec-91f1e7db5a8c tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 2918 microversion: 2.42 time: 0.596696 Oct 23 01:27:25.027132 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2049/4046] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:27:24 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 2918 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:27:25.043792 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-69664217-72f0-4e95-bf47-1200b67b6a7b tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:25.046287 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-69664217-72f0-4e95-bf47-1200b67b6a7b tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:25.055003 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=4,nova_api:DELETE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:27:25.061966 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-69664217-72f0-4e95-bf47-1200b67b6a7b tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:25.067277 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-69664217-72f0-4e95-bf47-1200b67b6a7b tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:25.068128 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-69664217-72f0-4e95-bf47-1200b67b6a7b tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:25.070394 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-69664217-72f0-4e95-bf47-1200b67b6a7b tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:25.072242 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-69664217-72f0-4e95-bf47-1200b67b6a7b tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:25.073734 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-69664217-72f0-4e95-bf47-1200b67b6a7b tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:25.501135 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-69664217-72f0-4e95-bf47-1200b67b6a7b tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:25.517703 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-69664217-72f0-4e95-bf47-1200b67b6a7b tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:25.520024 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-69664217-72f0-4e95-bf47-1200b67b6a7b tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:25.523115 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-69664217-72f0-4e95-bf47-1200b67b6a7b tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1737 microversion: 2.20 time: 0.493204 Oct 23 01:27:25.544644 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2050/4047] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:27:25 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1737 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:27:26.075754 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1da0f68e-1ab8-4503-9c68-e3429abf5c6e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:26.080526 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1da0f68e-1ab8-4503-9c68-e3429abf5c6e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 3d9196f6-d696-45e0-b7fc-8d1557498393] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:26.085920 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1da0f68e-1ab8-4503-9c68-e3429abf5c6e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:26.087170 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1da0f68e-1ab8-4503-9c68-e3429abf5c6e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:26.088166 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1da0f68e-1ab8-4503-9c68-e3429abf5c6e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:26.089169 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1da0f68e-1ab8-4503-9c68-e3429abf5c6e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:26.089888 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1da0f68e-1ab8-4503-9c68-e3429abf5c6e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:26.090764 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1da0f68e-1ab8-4503-9c68-e3429abf5c6e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:26.555239 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1da0f68e-1ab8-4503-9c68-e3429abf5c6e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:26.576043 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1da0f68e-1ab8-4503-9c68-e3429abf5c6e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393" status: 200 len: 1521 microversion: 2.1 time: 1.029878 Oct 23 01:27:26.582406 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2051/4048] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:27:25 2022] GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393 => generated 1521 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:27:26.604271 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-2ce38f6d-328c-47d6-86a5-59b928017f4e req-79e7b6d6-0e31-4f18-a30f-427e777743f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "defa5fbb-f632-4ce7-8e07-e00f6f491d82", "name": "network-vif-unplugged", "status": "completed", "tag": "a101ccc4-13ba-47da-b30f-6a0f1dbe2c91"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:27:26.633228 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-2ce38f6d-328c-47d6-86a5-59b928017f4e req-79e7b6d6-0e31-4f18-a30f-427e777743f4 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:26.635134 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-2ce38f6d-328c-47d6-86a5-59b928017f4e req-79e7b6d6-0e31-4f18-a30f-427e777743f4 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:26.636305 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-2ce38f6d-328c-47d6-86a5-59b928017f4e req-79e7b6d6-0e31-4f18-a30f-427e777743f4 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:26.671294 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-2ce38f6d-328c-47d6-86a5-59b928017f4e req-79e7b6d6-0e31-4f18-a30f-427e777743f4 service nova] Creating event network-vif-unplugged:a101ccc4-13ba-47da-b30f-6a0f1dbe2c91 for instance defa5fbb-f632-4ce7-8e07-e00f6f491d82 on n-h2-master-1 Oct 23 01:27:26.685799 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-2ce38f6d-328c-47d6-86a5-59b928017f4e req-79e7b6d6-0e31-4f18-a30f-427e777743f4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101763 Oct 23 01:27:26.686862 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2052/4049] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:27:26.695059 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d3b9f274-8d89-411b-af74-3a6e1f4d47aa tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:26.698054 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d3b9f274-8d89-411b-af74-3a6e1f4d47aa tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:26.709631 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d3b9f274-8d89-411b-af74-3a6e1f4d47aa tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:26.712372 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d3b9f274-8d89-411b-af74-3a6e1f4d47aa tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:26.713038 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d3b9f274-8d89-411b-af74-3a6e1f4d47aa tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:26.714001 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d3b9f274-8d89-411b-af74-3a6e1f4d47aa tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:26.716418 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d3b9f274-8d89-411b-af74-3a6e1f4d47aa tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:26.717062 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d3b9f274-8d89-411b-af74-3a6e1f4d47aa tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:27.128727 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d3b9f274-8d89-411b-af74-3a6e1f4d47aa tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:27.146381 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d3b9f274-8d89-411b-af74-3a6e1f4d47aa tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:27.150360 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d3b9f274-8d89-411b-af74-3a6e1f4d47aa tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:27.153677 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d3b9f274-8d89-411b-af74-3a6e1f4d47aa tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 2918 microversion: 2.42 time: 0.465435 Oct 23 01:27:27.168546 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2053/4050] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:27:26 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 2918 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:27:27.192176 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b52dfed4-86a6-4f90-918c-be51b35092f3 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:27.197527 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b52dfed4-86a6-4f90-918c-be51b35092f3 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:27.217682 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b52dfed4-86a6-4f90-918c-be51b35092f3 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:27.218151 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b52dfed4-86a6-4f90-918c-be51b35092f3 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:27.218609 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b52dfed4-86a6-4f90-918c-be51b35092f3 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:27.219333 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b52dfed4-86a6-4f90-918c-be51b35092f3 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:27.219799 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b52dfed4-86a6-4f90-918c-be51b35092f3 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:27.220235 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b52dfed4-86a6-4f90-918c-be51b35092f3 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:27.630754 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b52dfed4-86a6-4f90-918c-be51b35092f3 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:27.647659 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b52dfed4-86a6-4f90-918c-be51b35092f3 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:27.649145 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b52dfed4-86a6-4f90-918c-be51b35092f3 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:27.665847 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b52dfed4-86a6-4f90-918c-be51b35092f3 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1737 microversion: 2.20 time: 0.492485 Oct 23 01:27:27.666235 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2054/4051] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:27:27 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1737 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:27:27.680047 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3211226c-7b19-47ce-9341-08d3a1d89d22 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:27.680597 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3211226c-7b19-47ce-9341-08d3a1d89d22 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 3d9196f6-d696-45e0-b7fc-8d1557498393] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:27.713644 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3211226c-7b19-47ce-9341-08d3a1d89d22 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:27.713644 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3211226c-7b19-47ce-9341-08d3a1d89d22 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:27.713644 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3211226c-7b19-47ce-9341-08d3a1d89d22 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:27.717959 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3211226c-7b19-47ce-9341-08d3a1d89d22 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:27.718493 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3211226c-7b19-47ce-9341-08d3a1d89d22 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:27.718950 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3211226c-7b19-47ce-9341-08d3a1d89d22 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:28.063711 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3211226c-7b19-47ce-9341-08d3a1d89d22 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:28.080879 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3211226c-7b19-47ce-9341-08d3a1d89d22 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393" status: 200 len: 1521 microversion: 2.1 time: 0.413341 Oct 23 01:27:28.083194 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2055/4052] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:27:27 2022] GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393 => generated 1521 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:27:28.099229 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-61ad2588-ba36-4802-839d-7117da410999 req-be9f051d-e718-4abe-8fb9-ec7f9aca59ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "defa5fbb-f632-4ce7-8e07-e00f6f491d82", "name": "network-vif-deleted", "tag": "3da8a6c9-ee04-43aa-bcd6-1059a44d5e18"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:27:28.139737 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-61ad2588-ba36-4802-839d-7117da410999 req-be9f051d-e718-4abe-8fb9-ec7f9aca59ef service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:28.140140 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-61ad2588-ba36-4802-839d-7117da410999 req-be9f051d-e718-4abe-8fb9-ec7f9aca59ef service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:28.140607 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-61ad2588-ba36-4802-839d-7117da410999 req-be9f051d-e718-4abe-8fb9-ec7f9aca59ef service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:28.173824 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-61ad2588-ba36-4802-839d-7117da410999 req-be9f051d-e718-4abe-8fb9-ec7f9aca59ef service nova] Creating event network-vif-deleted:3da8a6c9-ee04-43aa-bcd6-1059a44d5e18 for instance defa5fbb-f632-4ce7-8e07-e00f6f491d82 on n-h2-master-1 Oct 23 01:27:28.214062 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-61ad2588-ba36-4802-839d-7117da410999 req-be9f051d-e718-4abe-8fb9-ec7f9aca59ef service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126527 Oct 23 01:27:28.218062 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2056/4053] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:27:28.240090 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5d90584d-8611-4d92-968d-8a1b723e51d8 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:28.240891 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5d90584d-8611-4d92-968d-8a1b723e51d8 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:28.250347 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5d90584d-8611-4d92-968d-8a1b723e51d8 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:28.250872 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5d90584d-8611-4d92-968d-8a1b723e51d8 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:28.251321 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5d90584d-8611-4d92-968d-8a1b723e51d8 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:28.262581 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5d90584d-8611-4d92-968d-8a1b723e51d8 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:28.262581 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5d90584d-8611-4d92-968d-8a1b723e51d8 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:28.262581 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5d90584d-8611-4d92-968d-8a1b723e51d8 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:28.701128 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5d90584d-8611-4d92-968d-8a1b723e51d8 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:28.718171 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5d90584d-8611-4d92-968d-8a1b723e51d8 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:28.720113 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5d90584d-8611-4d92-968d-8a1b723e51d8 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:28.729763 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5d90584d-8611-4d92-968d-8a1b723e51d8 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 2871 microversion: 2.42 time: 0.510150 Oct 23 01:27:28.734864 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2057/4054] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:27:28 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 2871 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:27:28.750422 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-11893669-8eef-47d4-ab78-8507613f3870 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:28.753477 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-11893669-8eef-47d4-ab78-8507613f3870 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:28.773249 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-11893669-8eef-47d4-ab78-8507613f3870 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:28.776374 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-11893669-8eef-47d4-ab78-8507613f3870 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:28.776890 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-11893669-8eef-47d4-ab78-8507613f3870 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:28.780073 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-11893669-8eef-47d4-ab78-8507613f3870 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:28.781919 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-11893669-8eef-47d4-ab78-8507613f3870 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:28.782600 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-11893669-8eef-47d4-ab78-8507613f3870 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:29.293612 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-11893669-8eef-47d4-ab78-8507613f3870 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:29.304148 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-11893669-8eef-47d4-ab78-8507613f3870 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:29.305627 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-11893669-8eef-47d4-ab78-8507613f3870 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:29.325066 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-11893669-8eef-47d4-ab78-8507613f3870 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1737 microversion: 2.20 time: 0.584645 Oct 23 01:27:29.325680 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2058/4055] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:27:28 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1737 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:27:29.332065 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-e69e14a5-a167-4230-8810-cae0b3d961f2 req-0d624bcb-cb7f-45dd-8d9d-a80336d6f260 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "defa5fbb-f632-4ce7-8e07-e00f6f491d82", "name": "network-vif-unplugged", "status": "completed", "tag": "69d49907-1f64-490d-b949-d616f69931f1"}, {"server_uuid": "defa5fbb-f632-4ce7-8e07-e00f6f491d82", "name": "network-vif-unplugged", "status": "completed", "tag": "29c00bf1-c7c4-4e37-8aad-d647f963331c"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:27:29.343472 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-e69e14a5-a167-4230-8810-cae0b3d961f2 req-0d624bcb-cb7f-45dd-8d9d-a80336d6f260 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:29.345631 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-e69e14a5-a167-4230-8810-cae0b3d961f2 req-0d624bcb-cb7f-45dd-8d9d-a80336d6f260 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:29.350524 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-e69e14a5-a167-4230-8810-cae0b3d961f2 req-0d624bcb-cb7f-45dd-8d9d-a80336d6f260 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:29.420116 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-e69e14a5-a167-4230-8810-cae0b3d961f2 req-0d624bcb-cb7f-45dd-8d9d-a80336d6f260 service nova] Creating event network-vif-unplugged:69d49907-1f64-490d-b949-d616f69931f1 for instance defa5fbb-f632-4ce7-8e07-e00f6f491d82 on n-h2-master-1 Oct 23 01:27:29.420116 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-e69e14a5-a167-4230-8810-cae0b3d961f2 req-0d624bcb-cb7f-45dd-8d9d-a80336d6f260 service nova] Creating event network-vif-unplugged:29c00bf1-c7c4-4e37-8aad-d647f963331c for instance defa5fbb-f632-4ce7-8e07-e00f6f491d82 on n-h2-master-1 Oct 23 01:27:29.432992 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-e69e14a5-a167-4230-8810-cae0b3d961f2 req-0d624bcb-cb7f-45dd-8d9d-a80336d6f260 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.104780 Oct 23 01:27:29.438325 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2059/4056] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:27:29.445421 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-60c92d3e-007d-45b0-97cd-f8b708c478a0 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:29.448338 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-60c92d3e-007d-45b0-97cd-f8b708c478a0 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 3d9196f6-d696-45e0-b7fc-8d1557498393] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:29.463139 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-60c92d3e-007d-45b0-97cd-f8b708c478a0 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:29.463734 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-60c92d3e-007d-45b0-97cd-f8b708c478a0 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:29.464234 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-60c92d3e-007d-45b0-97cd-f8b708c478a0 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:29.465619 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-60c92d3e-007d-45b0-97cd-f8b708c478a0 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:29.466102 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-60c92d3e-007d-45b0-97cd-f8b708c478a0 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:29.466780 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-60c92d3e-007d-45b0-97cd-f8b708c478a0 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:29.794085 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-60c92d3e-007d-45b0-97cd-f8b708c478a0 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19bff9f7a4254110b3b89f0cba5d252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c25b4509ad7457bad4a2e5e0bc59add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:29.811492 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-60c92d3e-007d-45b0-97cd-f8b708c478a0 tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393" status: 200 len: 1521 microversion: 2.1 time: 0.371779 Oct 23 01:27:29.834781 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2060/4057] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:27:29 2022] GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393 => generated 1521 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:27:29.840022 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1816561f-c7eb-4811-81f9-a4b1d1b62977 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:29.840943 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1816561f-c7eb-4811-81f9-a4b1d1b62977 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:29.848268 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1816561f-c7eb-4811-81f9-a4b1d1b62977 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:29.849111 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1816561f-c7eb-4811-81f9-a4b1d1b62977 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:29.849781 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1816561f-c7eb-4811-81f9-a4b1d1b62977 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:29.850764 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1816561f-c7eb-4811-81f9-a4b1d1b62977 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:29.851421 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1816561f-c7eb-4811-81f9-a4b1d1b62977 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:29.852025 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1816561f-c7eb-4811-81f9-a4b1d1b62977 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:30.610315 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1816561f-c7eb-4811-81f9-a4b1d1b62977 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:30.624011 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1816561f-c7eb-4811-81f9-a4b1d1b62977 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:30.633731 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1816561f-c7eb-4811-81f9-a4b1d1b62977 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:30.640745 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1816561f-c7eb-4811-81f9-a4b1d1b62977 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 2710 microversion: 2.42 time: 0.802168 Oct 23 01:27:30.646897 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2061/4058] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:27:29 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 2710 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:27:30.698620 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d2b34445-6e2d-491a-a1f6-93849564773c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:30.703052 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d2b34445-6e2d-491a-a1f6-93849564773c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:30.719385 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d2b34445-6e2d-491a-a1f6-93849564773c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:30.720332 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d2b34445-6e2d-491a-a1f6-93849564773c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:30.721309 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d2b34445-6e2d-491a-a1f6-93849564773c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:30.722741 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d2b34445-6e2d-491a-a1f6-93849564773c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:30.730460 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d2b34445-6e2d-491a-a1f6-93849564773c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:30.731525 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d2b34445-6e2d-491a-a1f6-93849564773c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:31.885950 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d2b34445-6e2d-491a-a1f6-93849564773c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:31.897295 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d2b34445-6e2d-491a-a1f6-93849564773c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:31.897295 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d2b34445-6e2d-491a-a1f6-93849564773c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:31.914684 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d2b34445-6e2d-491a-a1f6-93849564773c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1737 microversion: 2.20 time: 1.242465 Oct 23 01:27:31.921144 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2062/4059] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:27:30 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1737 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:27:31.933157 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-8bf9f420-6f50-4c5f-a3e8-496d7de9a856 req-be84aada-af3c-4b63-ac05-28c89d2ac510 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d9196f6-d696-45e0-b7fc-8d1557498393", "name": "network-vif-deleted", "tag": "dae6ca4c-8045-4763-8841-33c56c0c2212"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:27:31.973699 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-8bf9f420-6f50-4c5f-a3e8-496d7de9a856 req-be84aada-af3c-4b63-ac05-28c89d2ac510 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:31.976176 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-8bf9f420-6f50-4c5f-a3e8-496d7de9a856 req-be84aada-af3c-4b63-ac05-28c89d2ac510 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:31.976738 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-8bf9f420-6f50-4c5f-a3e8-496d7de9a856 req-be84aada-af3c-4b63-ac05-28c89d2ac510 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:32.028869 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-8bf9f420-6f50-4c5f-a3e8-496d7de9a856 req-be84aada-af3c-4b63-ac05-28c89d2ac510 service nova] Creating event network-vif-deleted:dae6ca4c-8045-4763-8841-33c56c0c2212 for instance 3d9196f6-d696-45e0-b7fc-8d1557498393 on n-h1-master-1 Oct 23 01:27:32.049319 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-8bf9f420-6f50-4c5f-a3e8-496d7de9a856 req-be84aada-af3c-4b63-ac05-28c89d2ac510 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119208 Oct 23 01:27:32.050513 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2063/4060] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:27:32.056181 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8743f345-47f2-4cea-9d24-ad3cde50367e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:32.072653 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8743f345-47f2-4cea-9d24-ad3cde50367e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] [instance: 3d9196f6-d696-45e0-b7fc-8d1557498393] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:32.088003 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8743f345-47f2-4cea-9d24-ad3cde50367e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:32.090489 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8743f345-47f2-4cea-9d24-ad3cde50367e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:32.091315 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8743f345-47f2-4cea-9d24-ad3cde50367e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:32.092973 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8743f345-47f2-4cea-9d24-ad3cde50367e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:32.093623 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8743f345-47f2-4cea-9d24-ad3cde50367e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:32.094580 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8743f345-47f2-4cea-9d24-ad3cde50367e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:32.119860 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-8743f345-47f2-4cea-9d24-ad3cde50367e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] HTTP exception thrown: Instance 3d9196f6-d696-45e0-b7fc-8d1557498393 could not be found. Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8743f345-47f2-4cea-9d24-ad3cde50367e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Request method failure captured: Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393 HTTP/1.1 Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJdQk8hX6uPg4qHO6qc2mwusfqzM5L9E46F0sE_pC33qOsFxuj7jBx97KQnGjJpiMRyi7Ccd4qVZLYee5QWMbRFkTPXMBEfS5K72Bw65O1CzepVHWqpUTGTMXTiFqb2LFyp2Lx0G54EC4LTSr0BIWkU_QP9JqR2fGUhTDQevTmiXx40 Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 4c25b4509ad7457bad4a2e5e0bc59add Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1648319695 Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4c25b4509ad7457bad4a2e5e0bc59add"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4c25b4509ad7457bad4a2e5e0bc59add"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4c25b4509ad7457bad4a2e5e0bc59add"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4c25b4509ad7457bad4a2e5e0bc59add"}]}] Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1648319695 Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 4c25b4509ad7457bad4a2e5e0bc59add Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1648319695 Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServerRescueNegativeTestJSON-1648319695-project Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 19bff9f7a4254110b3b89f0cba5d252f Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1648319695-project Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 3d9196f6-d696-45e0-b7fc-8d1557498393 could not be found. Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '3d9196f6-d696-45e0-b7fc-8d1557498393'} Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d9196f6-d696-45e0-b7fc-8d1557498393 could not be found. Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d9196f6-d696-45e0-b7fc-8d1557498393 could not be found. Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:27:32.122718 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:27:32.132131 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:27:32.132131 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:27:32.132131 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:27:32.132131 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:27:32.132131 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:27:32.132131 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:27:32.132131 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d9196f6-d696-45e0-b7fc-8d1557498393 could not be found. Oct 23 01:27:32.132131 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:27:32.132131 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8743f345-47f2-4cea-9d24-ad3cde50367e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] Returning 404 to user: Instance 3d9196f6-d696-45e0-b7fc-8d1557498393 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:27:32.132131 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8743f345-47f2-4cea-9d24-ad3cde50367e tempest-ServerRescueNegativeTestJSON-1648319695 tempest-ServerRescueNegativeTestJSON-1648319695-project] 10.222.0.42 "GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393" status: 404 len: 111 microversion: 2.1 time: 0.076847 Oct 23 01:27:32.132131 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2064/4061] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:27:32 2022] GET /compute/v2.1/servers/3d9196f6-d696-45e0-b7fc-8d1557498393 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:27:32.140221 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-49d4b868-1669-4f24-a6e1-63124b4b92fc req-6040bf41-21bf-4047-a967-1d543ab873fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "defa5fbb-f632-4ce7-8e07-e00f6f491d82", "name": "network-vif-unplugged", "status": "completed", "tag": "551d6a08-a233-4348-871c-71fc57b512b8"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:27:32.158826 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-49d4b868-1669-4f24-a6e1-63124b4b92fc req-6040bf41-21bf-4047-a967-1d543ab873fa service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:32.158826 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-49d4b868-1669-4f24-a6e1-63124b4b92fc req-6040bf41-21bf-4047-a967-1d543ab873fa service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:32.158826 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-49d4b868-1669-4f24-a6e1-63124b4b92fc req-6040bf41-21bf-4047-a967-1d543ab873fa service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:32.185471 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-49d4b868-1669-4f24-a6e1-63124b4b92fc req-6040bf41-21bf-4047-a967-1d543ab873fa service nova] Creating event network-vif-unplugged:551d6a08-a233-4348-871c-71fc57b512b8 for instance defa5fbb-f632-4ce7-8e07-e00f6f491d82 on n-h2-master-1 Oct 23 01:27:32.209787 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-49d4b868-1669-4f24-a6e1-63124b4b92fc req-6040bf41-21bf-4047-a967-1d543ab873fa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075296 Oct 23 01:27:32.210982 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2065/4062] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:27:32.218400 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dd4f0256-3a34-4217-b83c-076ea5c83084 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:32.219889 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-dd4f0256-3a34-4217-b83c-076ea5c83084 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:32.229254 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd4f0256-3a34-4217-b83c-076ea5c83084 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:32.230613 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd4f0256-3a34-4217-b83c-076ea5c83084 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:32.231268 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd4f0256-3a34-4217-b83c-076ea5c83084 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:32.232148 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd4f0256-3a34-4217-b83c-076ea5c83084 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:32.232987 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd4f0256-3a34-4217-b83c-076ea5c83084 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:32.233600 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd4f0256-3a34-4217-b83c-076ea5c83084 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:32.452730 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:27:32.481092 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=54 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:27:33.611349 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-dd4f0256-3a34-4217-b83c-076ea5c83084 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:33.644804 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-dd4f0256-3a34-4217-b83c-076ea5c83084 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:33.652749 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-dd4f0256-3a34-4217-b83c-076ea5c83084 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:33.659219 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-dd4f0256-3a34-4217-b83c-076ea5c83084 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 2663 microversion: 2.42 time: 1.446103 Oct 23 01:27:33.661796 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2066/4063] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:27:32 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 2663 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:27:33.675727 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5e9bcfd8-ecaf-4345-9926-4d36b3f8fdd9 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:33.682230 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5e9bcfd8-ecaf-4345-9926-4d36b3f8fdd9 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:33.708858 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5e9bcfd8-ecaf-4345-9926-4d36b3f8fdd9 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:33.709420 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5e9bcfd8-ecaf-4345-9926-4d36b3f8fdd9 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:33.709871 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5e9bcfd8-ecaf-4345-9926-4d36b3f8fdd9 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:33.712205 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5e9bcfd8-ecaf-4345-9926-4d36b3f8fdd9 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:33.712887 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5e9bcfd8-ecaf-4345-9926-4d36b3f8fdd9 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:33.714876 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5e9bcfd8-ecaf-4345-9926-4d36b3f8fdd9 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:35.675092 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5e9bcfd8-ecaf-4345-9926-4d36b3f8fdd9 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:35.687906 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5e9bcfd8-ecaf-4345-9926-4d36b3f8fdd9 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:35.693510 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5e9bcfd8-ecaf-4345-9926-4d36b3f8fdd9 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:35.695123 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5e9bcfd8-ecaf-4345-9926-4d36b3f8fdd9 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1737 microversion: 2.20 time: 2.028635 Oct 23 01:27:35.702793 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2067/4064] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:27:33 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1737 bytes in 2037 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:27:35.708241 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-a0d52ed2-c4d9-483c-a470-25049a393c03 req-25697265-77b9-430d-97af-29cf2d0b8e05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "defa5fbb-f632-4ce7-8e07-e00f6f491d82", "name": "network-vif-deleted", "tag": "69d49907-1f64-490d-b949-d616f69931f1"}, {"server_uuid": "defa5fbb-f632-4ce7-8e07-e00f6f491d82", "name": "network-vif-deleted", "tag": "a101ccc4-13ba-47da-b30f-6a0f1dbe2c91"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:27:35.731526 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-a0d52ed2-c4d9-483c-a470-25049a393c03 req-25697265-77b9-430d-97af-29cf2d0b8e05 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:35.732417 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-a0d52ed2-c4d9-483c-a470-25049a393c03 req-25697265-77b9-430d-97af-29cf2d0b8e05 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:35.733865 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-a0d52ed2-c4d9-483c-a470-25049a393c03 req-25697265-77b9-430d-97af-29cf2d0b8e05 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:35.764773 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-a0d52ed2-c4d9-483c-a470-25049a393c03 req-25697265-77b9-430d-97af-29cf2d0b8e05 service nova] Creating event network-vif-deleted:69d49907-1f64-490d-b949-d616f69931f1 for instance defa5fbb-f632-4ce7-8e07-e00f6f491d82 on n-h2-master-1 Oct 23 01:27:35.765704 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-a0d52ed2-c4d9-483c-a470-25049a393c03 req-25697265-77b9-430d-97af-29cf2d0b8e05 service nova] Creating event network-vif-deleted:a101ccc4-13ba-47da-b30f-6a0f1dbe2c91 for instance defa5fbb-f632-4ce7-8e07-e00f6f491d82 on n-h2-master-1 Oct 23 01:27:35.776094 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-a0d52ed2-c4d9-483c-a470-25049a393c03 req-25697265-77b9-430d-97af-29cf2d0b8e05 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.071343 Oct 23 01:27:35.777537 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2068/4065] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:27:35.783287 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f2e19118-029f-477b-af16-88c9199a27b9 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:35.793663 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f2e19118-029f-477b-af16-88c9199a27b9 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:35.803823 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2e19118-029f-477b-af16-88c9199a27b9 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:35.809916 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2e19118-029f-477b-af16-88c9199a27b9 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:35.810561 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2e19118-029f-477b-af16-88c9199a27b9 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:35.813413 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2e19118-029f-477b-af16-88c9199a27b9 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:35.815192 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2e19118-029f-477b-af16-88c9199a27b9 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:35.815741 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2e19118-029f-477b-af16-88c9199a27b9 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:36.193297 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f2e19118-029f-477b-af16-88c9199a27b9 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:36.197213 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=100 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:27:36.204333 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f2e19118-029f-477b-af16-88c9199a27b9 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:36.219576 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f2e19118-029f-477b-af16-88c9199a27b9 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:36.227036 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f2e19118-029f-477b-af16-88c9199a27b9 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 2616 microversion: 2.42 time: 0.447967 Oct 23 01:27:36.227959 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2069/4066] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:27:35 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 2616 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:27:36.731119 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-aab90e03-12aa-424b-b0ed-3bf51ae56504 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:36.733323 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-aab90e03-12aa-424b-b0ed-3bf51ae56504 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:36.754334 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aab90e03-12aa-424b-b0ed-3bf51ae56504 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:36.764803 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aab90e03-12aa-424b-b0ed-3bf51ae56504 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:36.765376 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aab90e03-12aa-424b-b0ed-3bf51ae56504 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:36.768953 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aab90e03-12aa-424b-b0ed-3bf51ae56504 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:36.770941 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aab90e03-12aa-424b-b0ed-3bf51ae56504 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:36.771466 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aab90e03-12aa-424b-b0ed-3bf51ae56504 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:37.996050 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-aab90e03-12aa-424b-b0ed-3bf51ae56504 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:38.003674 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-aab90e03-12aa-424b-b0ed-3bf51ae56504 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:38.013648 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-aab90e03-12aa-424b-b0ed-3bf51ae56504 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:38.013648 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-aab90e03-12aa-424b-b0ed-3bf51ae56504 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1737 microversion: 2.20 time: 1.285398 Oct 23 01:27:38.013920 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2070/4067] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:27:36 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1737 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:27:38.018969 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8725724a-e3b7-43d9-856f-3cddf08ae87b tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:38.042033 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8725724a-e3b7-43d9-856f-3cddf08ae87b tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:38.055273 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8725724a-e3b7-43d9-856f-3cddf08ae87b tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:38.063979 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8725724a-e3b7-43d9-856f-3cddf08ae87b tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:38.064600 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8725724a-e3b7-43d9-856f-3cddf08ae87b tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:38.065480 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8725724a-e3b7-43d9-856f-3cddf08ae87b tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:38.066102 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8725724a-e3b7-43d9-856f-3cddf08ae87b tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:38.066651 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8725724a-e3b7-43d9-856f-3cddf08ae87b tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:38.479483 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8725724a-e3b7-43d9-856f-3cddf08ae87b tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:38.504033 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8725724a-e3b7-43d9-856f-3cddf08ae87b tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:38.510748 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8725724a-e3b7-43d9-856f-3cddf08ae87b tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:38.534324 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8725724a-e3b7-43d9-856f-3cddf08ae87b tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1603 microversion: 2.42 time: 0.517724 Oct 23 01:27:38.540052 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2071/4068] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:27:38 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1603 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:27:38.559145 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-cd9f5037-f459-4855-88ff-49a89b513f44 req-d647a269-81f3-40aa-a8c3-3f7be88334cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "defa5fbb-f632-4ce7-8e07-e00f6f491d82", "name": "network-vif-deleted", "tag": "551d6a08-a233-4348-871c-71fc57b512b8"}, {"server_uuid": "defa5fbb-f632-4ce7-8e07-e00f6f491d82", "name": "network-vif-deleted", "tag": "29c00bf1-c7c4-4e37-8aad-d647f963331c"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:27:38.597255 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-cd9f5037-f459-4855-88ff-49a89b513f44 req-d647a269-81f3-40aa-a8c3-3f7be88334cb service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:38.603646 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-cd9f5037-f459-4855-88ff-49a89b513f44 req-d647a269-81f3-40aa-a8c3-3f7be88334cb service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:38.607158 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-cd9f5037-f459-4855-88ff-49a89b513f44 req-d647a269-81f3-40aa-a8c3-3f7be88334cb service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:38.656105 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-cd9f5037-f459-4855-88ff-49a89b513f44 req-d647a269-81f3-40aa-a8c3-3f7be88334cb service nova] Creating event network-vif-deleted:551d6a08-a233-4348-871c-71fc57b512b8 for instance defa5fbb-f632-4ce7-8e07-e00f6f491d82 on n-h2-master-1 Oct 23 01:27:38.660890 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-cd9f5037-f459-4855-88ff-49a89b513f44 req-d647a269-81f3-40aa-a8c3-3f7be88334cb service nova] Creating event network-vif-deleted:29c00bf1-c7c4-4e37-8aad-d647f963331c for instance defa5fbb-f632-4ce7-8e07-e00f6f491d82 on n-h2-master-1 Oct 23 01:27:38.686945 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-cd9f5037-f459-4855-88ff-49a89b513f44 req-d647a269-81f3-40aa-a8c3-3f7be88334cb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.145063 Oct 23 01:27:38.693148 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2072/4069] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:27:38.866280 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a3c41af9-95e8-4cb5-b7b9-f031a31aa908 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images/15656f0b-ee3c-4916-9e79-9548ba759af5" status: 200 len: 1453 microversion: 2.1 time: 16.315372 Oct 23 01:27:38.867066 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1998/4070] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:27:22 2022] GET /compute/v2.1/images/15656f0b-ee3c-4916-9e79-9548ba759af5 => generated 1453 bytes in 16319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:27:39.041694 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c94f3938-5a5e-4d9f-b4fa-579ddbb243d7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:39.044903 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c94f3938-5a5e-4d9f-b4fa-579ddbb243d7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:39.068642 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c94f3938-5a5e-4d9f-b4fa-579ddbb243d7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:39.069161 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c94f3938-5a5e-4d9f-b4fa-579ddbb243d7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:39.069791 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c94f3938-5a5e-4d9f-b4fa-579ddbb243d7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:39.071324 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c94f3938-5a5e-4d9f-b4fa-579ddbb243d7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:39.074311 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c94f3938-5a5e-4d9f-b4fa-579ddbb243d7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:39.074772 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c94f3938-5a5e-4d9f-b4fa-579ddbb243d7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:39.569266 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cbb27475-808c-49d0-8001-8a42ce845b17 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:39.570005 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cbb27475-808c-49d0-8001-8a42ce845b17 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:39.582181 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cbb27475-808c-49d0-8001-8a42ce845b17 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:39.582696 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cbb27475-808c-49d0-8001-8a42ce845b17 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:39.583140 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cbb27475-808c-49d0-8001-8a42ce845b17 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:39.591999 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cbb27475-808c-49d0-8001-8a42ce845b17 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:39.598890 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cbb27475-808c-49d0-8001-8a42ce845b17 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:39.605404 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cbb27475-808c-49d0-8001-8a42ce845b17 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:39.826477 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c94f3938-5a5e-4d9f-b4fa-579ddbb243d7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:39.831858 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cbb27475-808c-49d0-8001-8a42ce845b17 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:39.841002 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c94f3938-5a5e-4d9f-b4fa-579ddbb243d7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:39.842125 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cbb27475-808c-49d0-8001-8a42ce845b17 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:39.842525 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c94f3938-5a5e-4d9f-b4fa-579ddbb243d7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:39.843578 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cbb27475-808c-49d0-8001-8a42ce845b17 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:39.843741 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c94f3938-5a5e-4d9f-b4fa-579ddbb243d7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1737 microversion: 2.20 time: 0.806711 Oct 23 01:27:39.844317 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2073/4071] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:27:39 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1737 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:27:39.854900 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cbb27475-808c-49d0-8001-8a42ce845b17 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1603 microversion: 2.42 time: 0.280588 Oct 23 01:27:39.886391 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-57edefea-d995-4afd-b635-50490f08d58d tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc180f1f0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:39.893811 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 1999/4072] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:27:39 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1603 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:27:39.982618 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-57edefea-d995-4afd-b635-50490f08d58d tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images/15656f0b-ee3c-4916-9e79-9548ba759af5" status: 200 len: 1453 microversion: 2.1 time: 0.104288 Oct 23 01:27:39.983223 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2074/4073] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:27:39 2022] GET /compute/v2.1/images/15656f0b-ee3c-4916-9e79-9548ba759af5 => generated 1453 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:27:40.871893 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f42e37c8-d501-441f-a54a-9c2fac9f04a5 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:40.873331 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f42e37c8-d501-441f-a54a-9c2fac9f04a5 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:40.892686 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f42e37c8-d501-441f-a54a-9c2fac9f04a5 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:40.894929 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f42e37c8-d501-441f-a54a-9c2fac9f04a5 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:40.896025 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f42e37c8-d501-441f-a54a-9c2fac9f04a5 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:40.898930 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f42e37c8-d501-441f-a54a-9c2fac9f04a5 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:40.899121 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d5d64153-6650-40c2-b038-126b95932fc9 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:40.900113 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d5d64153-6650-40c2-b038-126b95932fc9 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:40.900840 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f42e37c8-d501-441f-a54a-9c2fac9f04a5 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:40.902244 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f42e37c8-d501-441f-a54a-9c2fac9f04a5 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:40.923297 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d5d64153-6650-40c2-b038-126b95932fc9 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:40.926485 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d5d64153-6650-40c2-b038-126b95932fc9 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:40.929700 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d5d64153-6650-40c2-b038-126b95932fc9 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:40.930903 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d5d64153-6650-40c2-b038-126b95932fc9 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:40.934345 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d5d64153-6650-40c2-b038-126b95932fc9 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:40.935509 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d5d64153-6650-40c2-b038-126b95932fc9 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:41.263352 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d5d64153-6650-40c2-b038-126b95932fc9 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:41.285354 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d5d64153-6650-40c2-b038-126b95932fc9 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:41.290386 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d5d64153-6650-40c2-b038-126b95932fc9 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:41.290941 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d5d64153-6650-40c2-b038-126b95932fc9 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1603 microversion: 2.42 time: 0.396183 Oct 23 01:27:41.294753 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2075/4074] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:27:40 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1603 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:27:41.306769 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-685f66e4-8e9b-4229-b714-9644ef131506 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc0fead30>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:41.386876 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-685f66e4-8e9b-4229-b714-9644ef131506 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images/15656f0b-ee3c-4916-9e79-9548ba759af5" status: 200 len: 1453 microversion: 2.1 time: 0.090796 Oct 23 01:27:41.391303 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2076/4075] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:27:41 2022] GET /compute/v2.1/images/15656f0b-ee3c-4916-9e79-9548ba759af5 => generated 1453 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:27:41.521474 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f42e37c8-d501-441f-a54a-9c2fac9f04a5 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:41.557635 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f42e37c8-d501-441f-a54a-9c2fac9f04a5 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:41.565049 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f42e37c8-d501-441f-a54a-9c2fac9f04a5 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:41.568665 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f42e37c8-d501-441f-a54a-9c2fac9f04a5 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1719 microversion: 2.20 time: 0.702272 Oct 23 01:27:41.593927 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2000/4076] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:27:40 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1719 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:27:42.325378 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9b142a5b-deb1-4c5f-9f7d-7b05e106fae7 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:42.332098 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9b142a5b-deb1-4c5f-9f7d-7b05e106fae7 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:42.342742 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9b142a5b-deb1-4c5f-9f7d-7b05e106fae7 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:42.343514 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9b142a5b-deb1-4c5f-9f7d-7b05e106fae7 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:42.344117 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9b142a5b-deb1-4c5f-9f7d-7b05e106fae7 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:42.345656 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9b142a5b-deb1-4c5f-9f7d-7b05e106fae7 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:42.346464 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9b142a5b-deb1-4c5f-9f7d-7b05e106fae7 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:42.347130 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9b142a5b-deb1-4c5f-9f7d-7b05e106fae7 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:42.405719 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-64f1388e-43b3-4fe6-9cc4-c1115e44e047 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc169bc10>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:42.521132 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-64f1388e-43b3-4fe6-9cc4-c1115e44e047 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images/15656f0b-ee3c-4916-9e79-9548ba759af5" status: 200 len: 1453 microversion: 2.1 time: 0.120028 Oct 23 01:27:42.522062 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2001/4077] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:27:42 2022] GET /compute/v2.1/images/15656f0b-ee3c-4916-9e79-9548ba759af5 => generated 1453 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:27:42.601392 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cf3d6ceb-8c4a-4280-9117-6b1a03ada633 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:42.602493 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cf3d6ceb-8c4a-4280-9117-6b1a03ada633 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:42.624048 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf3d6ceb-8c4a-4280-9117-6b1a03ada633 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:42.636431 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf3d6ceb-8c4a-4280-9117-6b1a03ada633 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:42.637272 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf3d6ceb-8c4a-4280-9117-6b1a03ada633 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:42.644283 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf3d6ceb-8c4a-4280-9117-6b1a03ada633 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:42.645187 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf3d6ceb-8c4a-4280-9117-6b1a03ada633 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:42.645877 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf3d6ceb-8c4a-4280-9117-6b1a03ada633 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:42.923666 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9b142a5b-deb1-4c5f-9f7d-7b05e106fae7 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:42.936032 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9b142a5b-deb1-4c5f-9f7d-7b05e106fae7 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:42.937468 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9b142a5b-deb1-4c5f-9f7d-7b05e106fae7 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:42.967673 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9b142a5b-deb1-4c5f-9f7d-7b05e106fae7 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1603 microversion: 2.42 time: 0.648434 Oct 23 01:27:42.968292 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2077/4078] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:27:42 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1603 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:27:43.347140 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cf3d6ceb-8c4a-4280-9117-6b1a03ada633 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:43.361026 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cf3d6ceb-8c4a-4280-9117-6b1a03ada633 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:43.363097 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cf3d6ceb-8c4a-4280-9117-6b1a03ada633 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:43.364593 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cf3d6ceb-8c4a-4280-9117-6b1a03ada633 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1719 microversion: 2.20 time: 0.767374 Oct 23 01:27:43.389326 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2002/4079] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:27:42 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1719 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:27:43.539190 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3b87220b-cbca-410e-9f74-b03c3241f4e4 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc10643a0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:43.637468 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3b87220b-cbca-410e-9f74-b03c3241f4e4 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images/15656f0b-ee3c-4916-9e79-9548ba759af5" status: 200 len: 1453 microversion: 2.1 time: 0.104346 Oct 23 01:27:43.638621 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2078/4080] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:27:43 2022] GET /compute/v2.1/images/15656f0b-ee3c-4916-9e79-9548ba759af5 => generated 1453 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:27:44.004354 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-45c6586b-c948-455e-b2a4-60651bab3e18 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:44.005710 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-45c6586b-c948-455e-b2a4-60651bab3e18 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:44.026050 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-45c6586b-c948-455e-b2a4-60651bab3e18 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:44.027176 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-45c6586b-c948-455e-b2a4-60651bab3e18 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:44.029746 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-45c6586b-c948-455e-b2a4-60651bab3e18 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:44.030748 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-45c6586b-c948-455e-b2a4-60651bab3e18 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:44.044225 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-45c6586b-c948-455e-b2a4-60651bab3e18 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:44.045959 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-45c6586b-c948-455e-b2a4-60651bab3e18 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:44.407466 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-eae81c2f-9dc5-4ad5-be19-3e7ebf23282b tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:44.408524 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-eae81c2f-9dc5-4ad5-be19-3e7ebf23282b tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:44.417272 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eae81c2f-9dc5-4ad5-be19-3e7ebf23282b tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:44.421797 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eae81c2f-9dc5-4ad5-be19-3e7ebf23282b tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:44.422663 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eae81c2f-9dc5-4ad5-be19-3e7ebf23282b tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:44.424002 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eae81c2f-9dc5-4ad5-be19-3e7ebf23282b tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:44.424700 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eae81c2f-9dc5-4ad5-be19-3e7ebf23282b tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:44.425392 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eae81c2f-9dc5-4ad5-be19-3e7ebf23282b tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:44.821989 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-45c6586b-c948-455e-b2a4-60651bab3e18 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:44.841250 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-45c6586b-c948-455e-b2a4-60651bab3e18 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:44.843383 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-45c6586b-c948-455e-b2a4-60651bab3e18 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:44.847148 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-45c6586b-c948-455e-b2a4-60651bab3e18 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1603 microversion: 2.42 time: 0.849579 Oct 23 01:27:44.848122 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2003/4081] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:27:43 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1603 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:27:44.860161 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-e6096986-03fd-44f3-b7ec-bef03c8b0983 req-9a0feb30-cff2-4167-8df6-5d2b10aeb3fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6eb59b7-d1ee-442c-8142-19a88ad6a039", "name": "network-vif-unplugged", "status": "completed", "tag": "82e540c0-e210-47a2-a17d-495549fe7222"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:27:44.889354 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-e6096986-03fd-44f3-b7ec-bef03c8b0983 req-9a0feb30-cff2-4167-8df6-5d2b10aeb3fa service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:44.892912 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-e6096986-03fd-44f3-b7ec-bef03c8b0983 req-9a0feb30-cff2-4167-8df6-5d2b10aeb3fa service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:44.892912 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-e6096986-03fd-44f3-b7ec-bef03c8b0983 req-9a0feb30-cff2-4167-8df6-5d2b10aeb3fa service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:44.925729 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-e6096986-03fd-44f3-b7ec-bef03c8b0983 req-9a0feb30-cff2-4167-8df6-5d2b10aeb3fa service nova] Creating event network-vif-unplugged:82e540c0-e210-47a2-a17d-495549fe7222 for instance c6eb59b7-d1ee-442c-8142-19a88ad6a039 on n-h1-master-1 Oct 23 01:27:44.940162 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-e6096986-03fd-44f3-b7ec-bef03c8b0983 req-9a0feb30-cff2-4167-8df6-5d2b10aeb3fa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089099 Oct 23 01:27:44.942583 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2004/4082] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:27:44.960770 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-206be4c6-ed09-4702-a298-9f0475faac06 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc16a1700>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:45.057253 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-206be4c6-ed09-4702-a298-9f0475faac06 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images/15656f0b-ee3c-4916-9e79-9548ba759af5" status: 200 len: 1453 microversion: 2.1 time: 0.106636 Oct 23 01:27:45.061335 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2005/4083] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:27:44 2022] GET /compute/v2.1/images/15656f0b-ee3c-4916-9e79-9548ba759af5 => generated 1453 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:27:45.120578 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-eae81c2f-9dc5-4ad5-be19-3e7ebf23282b tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:45.137099 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-eae81c2f-9dc5-4ad5-be19-3e7ebf23282b tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:45.138851 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-eae81c2f-9dc5-4ad5-be19-3e7ebf23282b tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:45.149261 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-eae81c2f-9dc5-4ad5-be19-3e7ebf23282b tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1719 microversion: 2.20 time: 0.746787 Oct 23 01:27:45.152655 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2079/4084] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:27:44 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1719 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:27:45.876684 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d17361ae-8f94-42d7-ba1b-86e81e5ddc54 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:45.877425 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d17361ae-8f94-42d7-ba1b-86e81e5ddc54 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:45.890517 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d17361ae-8f94-42d7-ba1b-86e81e5ddc54 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:45.891462 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d17361ae-8f94-42d7-ba1b-86e81e5ddc54 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:45.892081 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d17361ae-8f94-42d7-ba1b-86e81e5ddc54 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:45.893047 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d17361ae-8f94-42d7-ba1b-86e81e5ddc54 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:45.893718 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d17361ae-8f94-42d7-ba1b-86e81e5ddc54 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:45.896415 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d17361ae-8f94-42d7-ba1b-86e81e5ddc54 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:46.077521 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9b20bcfd-1355-4343-9a11-2fed84dbc7e4 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc0fba700>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:46.125561 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d17361ae-8f94-42d7-ba1b-86e81e5ddc54 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:46.136619 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d17361ae-8f94-42d7-ba1b-86e81e5ddc54 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:46.147486 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d17361ae-8f94-42d7-ba1b-86e81e5ddc54 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:46.155691 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d17361ae-8f94-42d7-ba1b-86e81e5ddc54 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1603 microversion: 2.42 time: 0.282970 Oct 23 01:27:46.156922 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2006/4085] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:27:45 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1603 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:27:46.182145 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-35447ca2-61ef-4552-8bb8-3b78b7b14fe7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:46.183924 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-35447ca2-61ef-4552-8bb8-3b78b7b14fe7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:46.215192 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9b20bcfd-1355-4343-9a11-2fed84dbc7e4 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images/15656f0b-ee3c-4916-9e79-9548ba759af5" status: 200 len: 1453 microversion: 2.1 time: 0.142343 Oct 23 01:27:46.216458 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2080/4086] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:27:46 2022] GET /compute/v2.1/images/15656f0b-ee3c-4916-9e79-9548ba759af5 => generated 1453 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:27:46.218316 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-35447ca2-61ef-4552-8bb8-3b78b7b14fe7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:46.219773 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-35447ca2-61ef-4552-8bb8-3b78b7b14fe7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:46.220397 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-35447ca2-61ef-4552-8bb8-3b78b7b14fe7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:46.221488 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-35447ca2-61ef-4552-8bb8-3b78b7b14fe7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:46.228617 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-35447ca2-61ef-4552-8bb8-3b78b7b14fe7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:46.236149 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-35447ca2-61ef-4552-8bb8-3b78b7b14fe7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:47.025905 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-35447ca2-61ef-4552-8bb8-3b78b7b14fe7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:47.045095 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-35447ca2-61ef-4552-8bb8-3b78b7b14fe7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:47.046873 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-35447ca2-61ef-4552-8bb8-3b78b7b14fe7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:47.048245 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-35447ca2-61ef-4552-8bb8-3b78b7b14fe7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1719 microversion: 2.20 time: 0.871931 Oct 23 01:27:47.051767 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2007/4087] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:27:46 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1719 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:27:47.190396 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0b0a41d8-32cb-4998-91cf-c978b07870e2 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:47.191147 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0b0a41d8-32cb-4998-91cf-c978b07870e2 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:47.214232 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b0a41d8-32cb-4998-91cf-c978b07870e2 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:47.215068 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b0a41d8-32cb-4998-91cf-c978b07870e2 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:47.215630 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b0a41d8-32cb-4998-91cf-c978b07870e2 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:47.218351 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b0a41d8-32cb-4998-91cf-c978b07870e2 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:47.235568 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ab50b134-d3f3-4cce-b47e-96e10119e9b2 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc17321f0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:47.241328 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b0a41d8-32cb-4998-91cf-c978b07870e2 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:47.242145 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b0a41d8-32cb-4998-91cf-c978b07870e2 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:47.316178 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ab50b134-d3f3-4cce-b47e-96e10119e9b2 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images/15656f0b-ee3c-4916-9e79-9548ba759af5" status: 200 len: 1453 microversion: 2.1 time: 0.084380 Oct 23 01:27:47.316950 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2008/4088] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:27:47 2022] GET /compute/v2.1/images/15656f0b-ee3c-4916-9e79-9548ba759af5 => generated 1453 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:27:47.446646 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0b0a41d8-32cb-4998-91cf-c978b07870e2 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:47.455462 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0b0a41d8-32cb-4998-91cf-c978b07870e2 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:47.457163 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0b0a41d8-32cb-4998-91cf-c978b07870e2 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:47.461382 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0b0a41d8-32cb-4998-91cf-c978b07870e2 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1603 microversion: 2.42 time: 0.277618 Oct 23 01:27:47.485541 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2081/4089] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:27:47 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1603 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:27:48.081521 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8e82c1f9-b4a2-445c-8bbd-bad1138a6898 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:48.082513 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8e82c1f9-b4a2-445c-8bbd-bad1138a6898 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:48.090009 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8e82c1f9-b4a2-445c-8bbd-bad1138a6898 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:48.090478 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8e82c1f9-b4a2-445c-8bbd-bad1138a6898 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:48.091067 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8e82c1f9-b4a2-445c-8bbd-bad1138a6898 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:48.091765 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8e82c1f9-b4a2-445c-8bbd-bad1138a6898 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:48.092213 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8e82c1f9-b4a2-445c-8bbd-bad1138a6898 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:48.092640 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8e82c1f9-b4a2-445c-8bbd-bad1138a6898 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:48.249052 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8e82c1f9-b4a2-445c-8bbd-bad1138a6898 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:48.258200 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8e82c1f9-b4a2-445c-8bbd-bad1138a6898 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:48.259641 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8e82c1f9-b4a2-445c-8bbd-bad1138a6898 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:48.261436 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8e82c1f9-b4a2-445c-8bbd-bad1138a6898 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1719 microversion: 2.20 time: 0.184702 Oct 23 01:27:48.262022 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2009/4090] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:27:48 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1719 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:27:48.332411 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0cd77c5a-59bc-453d-adb6-2c806f4ee5db tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc1989dc0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:48.430080 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0cd77c5a-59bc-453d-adb6-2c806f4ee5db tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images/15656f0b-ee3c-4916-9e79-9548ba759af5" status: 200 len: 1453 microversion: 2.1 time: 0.101746 Oct 23 01:27:48.430690 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2082/4091] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:27:48 2022] GET /compute/v2.1/images/15656f0b-ee3c-4916-9e79-9548ba759af5 => generated 1453 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:27:48.494265 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e89511df-7c18-42f0-9d45-3a5078ad3321 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:48.495510 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e89511df-7c18-42f0-9d45-3a5078ad3321 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:48.505803 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e89511df-7c18-42f0-9d45-3a5078ad3321 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:48.506328 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e89511df-7c18-42f0-9d45-3a5078ad3321 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:48.509444 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e89511df-7c18-42f0-9d45-3a5078ad3321 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:48.510278 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e89511df-7c18-42f0-9d45-3a5078ad3321 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:48.515122 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e89511df-7c18-42f0-9d45-3a5078ad3321 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:48.515122 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e89511df-7c18-42f0-9d45-3a5078ad3321 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:48.631872 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e89511df-7c18-42f0-9d45-3a5078ad3321 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:48.660998 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e89511df-7c18-42f0-9d45-3a5078ad3321 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:48.665004 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e89511df-7c18-42f0-9d45-3a5078ad3321 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:48.670038 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e89511df-7c18-42f0-9d45-3a5078ad3321 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1603 microversion: 2.42 time: 0.181551 Oct 23 01:27:48.674129 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2010/4092] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:27:48 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1603 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:27:49.290356 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-67fc8b05-0ff7-4f87-81c4-719d1fe221c0 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:49.290917 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-67fc8b05-0ff7-4f87-81c4-719d1fe221c0 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:49.309989 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-67fc8b05-0ff7-4f87-81c4-719d1fe221c0 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:49.310896 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-67fc8b05-0ff7-4f87-81c4-719d1fe221c0 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:49.311351 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-67fc8b05-0ff7-4f87-81c4-719d1fe221c0 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:49.335518 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-67fc8b05-0ff7-4f87-81c4-719d1fe221c0 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:49.336817 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-67fc8b05-0ff7-4f87-81c4-719d1fe221c0 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:49.340889 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-67fc8b05-0ff7-4f87-81c4-719d1fe221c0 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:49.449416 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3605cb65-d0fe-434a-8e05-1ce7c7c2e52e tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc1732f70>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:49.550352 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3605cb65-d0fe-434a-8e05-1ce7c7c2e52e tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images/15656f0b-ee3c-4916-9e79-9548ba759af5" status: 200 len: 1453 microversion: 2.1 time: 0.105935 Oct 23 01:27:49.550889 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2011/4093] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:27:49 2022] GET /compute/v2.1/images/15656f0b-ee3c-4916-9e79-9548ba759af5 => generated 1453 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:27:49.707702 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-29f51f33-2695-4b6e-927e-554bf5b61872 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:49.708334 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-29f51f33-2695-4b6e-927e-554bf5b61872 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:49.722513 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-67fc8b05-0ff7-4f87-81c4-719d1fe221c0 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:49.725875 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-29f51f33-2695-4b6e-927e-554bf5b61872 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:49.726453 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-29f51f33-2695-4b6e-927e-554bf5b61872 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:49.726901 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-29f51f33-2695-4b6e-927e-554bf5b61872 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:49.727622 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-29f51f33-2695-4b6e-927e-554bf5b61872 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:49.728085 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-29f51f33-2695-4b6e-927e-554bf5b61872 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:49.728516 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-29f51f33-2695-4b6e-927e-554bf5b61872 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:49.734732 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-67fc8b05-0ff7-4f87-81c4-719d1fe221c0 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:49.736236 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-67fc8b05-0ff7-4f87-81c4-719d1fe221c0 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:49.737436 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-67fc8b05-0ff7-4f87-81c4-719d1fe221c0 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1722 microversion: 2.20 time: 0.454496 Oct 23 01:27:49.740471 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2083/4094] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:27:49 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1722 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:27:49.767665 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-73b00db8-8fe0-4ff8-90ed-332300ed475e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "450ee67a-6990-4c35-b23f-a064b20154d9"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:27:49.770557 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-73b00db8-8fe0-4ff8-90ed-332300ed475e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:49.785588 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-73b00db8-8fe0-4ff8-90ed-332300ed475e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:49.787445 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-73b00db8-8fe0-4ff8-90ed-332300ed475e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:49.788863 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-73b00db8-8fe0-4ff8-90ed-332300ed475e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:49.788863 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-73b00db8-8fe0-4ff8-90ed-332300ed475e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:49.792422 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-73b00db8-8fe0-4ff8-90ed-332300ed475e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:49.793832 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-73b00db8-8fe0-4ff8-90ed-332300ed475e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:49.906386 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-29f51f33-2695-4b6e-927e-554bf5b61872 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:49.922396 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-29f51f33-2695-4b6e-927e-554bf5b61872 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:49.923868 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-29f51f33-2695-4b6e-927e-554bf5b61872 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:49.925074 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-29f51f33-2695-4b6e-927e-554bf5b61872 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1603 microversion: 2.42 time: 0.221274 Oct 23 01:27:49.925650 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2012/4095] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:27:49 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1603 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:27:50.645061 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5b599761-b483-4758-a769-1ff6ed151eca tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Action: 'create', calling method: .version_select at 0x7f5cc1732ee0>, body: {"keypair": {"name": "tempest-keypair-1904337469", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHO/3hzfBo+2hB3tnPCOwrsVxLErfC2m+fBbJ8WnzFJU013keg1pwVbzfdHoNX4Pd4o9z0eL82qmjQ58SVtOHMcg81R9hvx/+FPcN8y6yw7JSt7o8k91CuJhndCiPmcGQ=="}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:27:50.675388 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-5b599761-b483-4758-a769-1ff6ed151eca tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Getting quotas for project 2db2a6834ec144418eb2cf222302fdb2. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:27:50.685701 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-5b599761-b483-4758-a769-1ff6ed151eca tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Getting quotas for user a0a8950e247041d8be4fdfda5e2122fa and project 2db2a6834ec144418eb2cf222302fdb2. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:27:50.827902 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5b599761-b483-4758-a769-1ff6ed151eca tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.705094 Oct 23 01:27:50.828554 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2013/4096] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 01:27:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:27:50.839945 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c7b2c0ab-88ea-4661-82e9-e74209b2ace7 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc16af310>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:50.904953 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c7b2c0ab-88ea-4661-82e9-e74209b2ace7 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images/15656f0b-ee3c-4916-9e79-9548ba759af5" status: 200 len: 1462 microversion: 2.1 time: 0.069235 Oct 23 01:27:50.905588 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2014/4097] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:27:50 2022] GET /compute/v2.1/images/15656f0b-ee3c-4916-9e79-9548ba759af5 => generated 1462 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:27:50.936177 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2ba6ae86-b15f-43ad-a306-ef5f3861f897 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc17321f0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:51.052525 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2ba6ae86-b15f-43ad-a306-ef5f3861f897 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images/15656f0b-ee3c-4916-9e79-9548ba759af5" status: 200 len: 1462 microversion: 2.1 time: 0.120915 Oct 23 01:27:51.057057 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2015/4098] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:27:50 2022] GET /compute/v2.1/images/15656f0b-ee3c-4916-9e79-9548ba759af5 => generated 1462 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:27:51.077734 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-15265a26-1fa5-499a-adf7-44f772075b53 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:51.080005 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-15265a26-1fa5-499a-adf7-44f772075b53 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:51.101494 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-15265a26-1fa5-499a-adf7-44f772075b53 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:51.102386 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-15265a26-1fa5-499a-adf7-44f772075b53 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:51.103256 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-15265a26-1fa5-499a-adf7-44f772075b53 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:51.108690 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-15265a26-1fa5-499a-adf7-44f772075b53 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:51.109505 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-15265a26-1fa5-499a-adf7-44f772075b53 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:51.110182 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-15265a26-1fa5-499a-adf7-44f772075b53 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:51.292599 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-15265a26-1fa5-499a-adf7-44f772075b53 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:51.334006 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-15265a26-1fa5-499a-adf7-44f772075b53 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:51.335493 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-15265a26-1fa5-499a-adf7-44f772075b53 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:51.336873 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-15265a26-1fa5-499a-adf7-44f772075b53 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1603 microversion: 2.42 time: 0.277815 Oct 23 01:27:51.337635 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2016/4099] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:27:51 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1603 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:27:51.363821 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7298eea7-4fa6-4cbc-b6b1-b67c581ba41b tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:51.364445 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7298eea7-4fa6-4cbc-b6b1-b67c581ba41b tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] [instance: 36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:51.378887 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7298eea7-4fa6-4cbc-b6b1-b67c581ba41b tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:51.379555 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7298eea7-4fa6-4cbc-b6b1-b67c581ba41b tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:51.381245 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7298eea7-4fa6-4cbc-b6b1-b67c581ba41b tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:51.382140 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7298eea7-4fa6-4cbc-b6b1-b67c581ba41b tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:51.382731 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7298eea7-4fa6-4cbc-b6b1-b67c581ba41b tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:51.383486 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7298eea7-4fa6-4cbc-b6b1-b67c581ba41b tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:51.497588 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-73b00db8-8fe0-4ff8-90ed-332300ed475e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "POST /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.734443 Oct 23 01:27:51.499376 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2084/4100] 10.222.0.42 () {62 vars in 1364 bytes} [Sun Oct 23 01:27:49 2022] POST /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039/os-volume_attachments => generated 188 bytes in 1737 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:27:51.768127 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1f4c2c42-bf65-4a12-ab05-867ab9dfecca tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:27:51.769590 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1f4c2c42-bf65-4a12-ab05-867ab9dfecca tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:51.776153 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f4c2c42-bf65-4a12-ab05-867ab9dfecca tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:51.776848 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f4c2c42-bf65-4a12-ab05-867ab9dfecca tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:51.777432 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f4c2c42-bf65-4a12-ab05-867ab9dfecca tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:51.778315 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f4c2c42-bf65-4a12-ab05-867ab9dfecca tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:51.785415 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f4c2c42-bf65-4a12-ab05-867ab9dfecca tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:51.785415 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f4c2c42-bf65-4a12-ab05-867ab9dfecca tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:51.909099 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7298eea7-4fa6-4cbc-b6b1-b67c581ba41b tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86e186e88524064b8dca040c1814927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf35beeccb814ce490d2142b21c2b1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:51.920559 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7298eea7-4fa6-4cbc-b6b1-b67c581ba41b tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb" status: 200 len: 1467 microversion: 2.1 time: 0.568665 Oct 23 01:27:51.921157 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2017/4101] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:27:51 2022] GET /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb => generated 1467 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:27:51.945293 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4bd68a33-882c-4491-8761-648fbf1a9c37 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-660017231"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:27:51.948162 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4bd68a33-882c-4491-8761-648fbf1a9c37 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] [instance: ad46f590-af38-463e-87db-62c442e08669] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:51.955359 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4bd68a33-882c-4491-8761-648fbf1a9c37 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:51.956172 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4bd68a33-882c-4491-8761-648fbf1a9c37 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:51.956765 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4bd68a33-882c-4491-8761-648fbf1a9c37 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:51.957682 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4bd68a33-882c-4491-8761-648fbf1a9c37 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:51.958830 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4bd68a33-882c-4491-8761-648fbf1a9c37 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:51.959465 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4bd68a33-882c-4491-8761-648fbf1a9c37 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:52.363388 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1f4c2c42-bf65-4a12-ab05-867ab9dfecca tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120944) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 23 01:27:52.709869 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4bd68a33-882c-4491-8761-648fbf1a9c37 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "POST /compute/v2.1/servers/ad46f590-af38-463e-87db-62c442e08669/action" status: 202 len: 0 microversion: 2.1 time: 0.766965 Oct 23 01:27:52.731986 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2018/4102] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:27:51 2022] POST /compute/v2.1/servers/ad46f590-af38-463e-87db-62c442e08669/action => generated 0 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 23 01:27:52.939335 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1f4c2c42-bf65-4a12-ab05-867ab9dfecca tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "POST /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039/action" status: 202 len: 0 microversion: 2.20 time: 1.171445 Oct 23 01:27:52.940345 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2085/4103] 10.222.0.42 () {62 vars in 1319 bytes} [Sun Oct 23 01:27:51 2022] POST /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039/action => generated 0 bytes in 1177 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 23 01:27:52.960961 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-11ab285a-9770-4090-bf45-a02bd257212b tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:52.961587 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-11ab285a-9770-4090-bf45-a02bd257212b tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:52.980456 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-11ab285a-9770-4090-bf45-a02bd257212b tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:52.981305 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-11ab285a-9770-4090-bf45-a02bd257212b tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:52.981900 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-11ab285a-9770-4090-bf45-a02bd257212b tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:52.982920 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-11ab285a-9770-4090-bf45-a02bd257212b tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:52.986640 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-11ab285a-9770-4090-bf45-a02bd257212b tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:52.987084 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-11ab285a-9770-4090-bf45-a02bd257212b tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:53.124446 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1bc869c5-d49f-412b-8e23-4abdc5d90588 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1958016609", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": "none"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:27:53.283872 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-1bc869c5-d49f-412b-8e23-4abdc5d90588 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:27:53.284671 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-1bc869c5-d49f-412b-8e23-4abdc5d90588 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:27:53.286242 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-1bc869c5-d49f-412b-8e23-4abdc5d90588 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:27:53.286968 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-1bc869c5-d49f-412b-8e23-4abdc5d90588 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:27:53.287601 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-1bc869c5-d49f-412b-8e23-4abdc5d90588 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:27:53.295298 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-11ab285a-9770-4090-bf45-a02bd257212b tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:53.305543 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-11ab285a-9770-4090-bf45-a02bd257212b tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:53.307097 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-11ab285a-9770-4090-bf45-a02bd257212b tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:53.309969 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1bc869c5-d49f-412b-8e23-4abdc5d90588 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:53.310811 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1bc869c5-d49f-412b-8e23-4abdc5d90588 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:53.311385 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1bc869c5-d49f-412b-8e23-4abdc5d90588 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:53.313377 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1bc869c5-d49f-412b-8e23-4abdc5d90588 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:53.314089 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1bc869c5-d49f-412b-8e23-4abdc5d90588 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:53.317846 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1bc869c5-d49f-412b-8e23-4abdc5d90588 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:53.339111 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-11ab285a-9770-4090-bf45-a02bd257212b tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1603 microversion: 2.42 time: 0.356191 Oct 23 01:27:53.339790 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2086/4104] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:27:52 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1603 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:27:53.365575 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-1bc869c5-d49f-412b-8e23-4abdc5d90588 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Getting quotas for project f0e82c5d57e54c3ba4d310bcb96b4e2a. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:27:53.369296 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0e5419c6-6356-46fc-bdc8-2a7ae4860698 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc184f430>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:53.375720 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-1bc869c5-d49f-412b-8e23-4abdc5d90588 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Getting quotas for user 9945803bd26745a8b3ccb508f7cd2a38 and project f0e82c5d57e54c3ba4d310bcb96b4e2a. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:27:53.421325 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1bc869c5-d49f-412b-8e23-4abdc5d90588 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:27:53.424434 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1bc869c5-d49f-412b-8e23-4abdc5d90588 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] [instance: ce31e873-63e4-4af4-b33d-5f994553545b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:27:53.481059 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0e5419c6-6356-46fc-bdc8-2a7ae4860698 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images/6f92eb4d-aa9a-45ce-b0c6-6c58ec4bc45b" status: 200 len: 1452 microversion: 2.1 time: 0.125258 Oct 23 01:27:53.481870 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2087/4105] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:27:53 2022] GET /compute/v2.1/images/6f92eb4d-aa9a-45ce-b0c6-6c58ec4bc45b => generated 1452 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:27:53.503139 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-9ad450f9-12a8-40d5-b049-2d9dde239c5f req-458978e7-b83e-4e19-bed7-701819bcfb01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb", "name": "network-vif-unplugged", "status": "completed", "tag": "54e7645f-922e-48c7-870d-b18d536be4be"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:27:53.542933 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-9ad450f9-12a8-40d5-b049-2d9dde239c5f req-458978e7-b83e-4e19-bed7-701819bcfb01 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:53.543827 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-9ad450f9-12a8-40d5-b049-2d9dde239c5f req-458978e7-b83e-4e19-bed7-701819bcfb01 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:53.544614 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-9ad450f9-12a8-40d5-b049-2d9dde239c5f req-458978e7-b83e-4e19-bed7-701819bcfb01 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:53.569033 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-9ad450f9-12a8-40d5-b049-2d9dde239c5f req-458978e7-b83e-4e19-bed7-701819bcfb01 service nova] Creating event network-vif-unplugged:54e7645f-922e-48c7-870d-b18d536be4be for instance 36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb on n-h1-master-1 Oct 23 01:27:53.584558 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-9ad450f9-12a8-40d5-b049-2d9dde239c5f req-458978e7-b83e-4e19-bed7-701819bcfb01 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100998 Oct 23 01:27:53.585614 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2088/4106] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:27:53.592616 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0587bf7d-3b31-4fb4-a4e1-18850d835fe1 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:53.593691 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0587bf7d-3b31-4fb4-a4e1-18850d835fe1 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:53.603419 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0587bf7d-3b31-4fb4-a4e1-18850d835fe1 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:53.604524 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0587bf7d-3b31-4fb4-a4e1-18850d835fe1 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:53.605144 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0587bf7d-3b31-4fb4-a4e1-18850d835fe1 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:53.606198 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0587bf7d-3b31-4fb4-a4e1-18850d835fe1 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:53.606909 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0587bf7d-3b31-4fb4-a4e1-18850d835fe1 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:53.607713 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0587bf7d-3b31-4fb4-a4e1-18850d835fe1 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:53.628052 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1bc869c5-d49f-412b-8e23-4abdc5d90588 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.887554 Oct 23 01:27:53.645897 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2019/4107] 10.222.0.42 () {62 vars in 1188 bytes} [Sun Oct 23 01:27:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 913 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 23 01:27:53.680315 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-49b10ec2-ec89-49a2-9ecc-07df8768bd25 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:53.680315 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-49b10ec2-ec89-49a2-9ecc-07df8768bd25 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] [instance: ce31e873-63e4-4af4-b33d-5f994553545b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:54.011063 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-49b10ec2-ec89-49a2-9ecc-07df8768bd25 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:54.023377 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-49b10ec2-ec89-49a2-9ecc-07df8768bd25 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:54.024843 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-49b10ec2-ec89-49a2-9ecc-07df8768bd25 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:54.039876 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-49b10ec2-ec89-49a2-9ecc-07df8768bd25 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] 10.222.0.42 "GET /compute/v2.1/servers/ce31e873-63e4-4af4-b33d-5f994553545b" status: 200 len: 1278 microversion: 2.47 time: 0.378977 Oct 23 01:27:54.043555 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2020/4108] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:27:53 2022] GET /compute/v2.1/servers/ce31e873-63e4-4af4-b33d-5f994553545b => generated 1278 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:27:54.412629 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c152ea6e-588a-4155-87f9-600a6eb36c9a tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:54.413223 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c152ea6e-588a-4155-87f9-600a6eb36c9a tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: 0fb11dc6-65bc-4c8e-a674-c948f42f1b87] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:54.449301 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c152ea6e-588a-4155-87f9-600a6eb36c9a tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:54.450231 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c152ea6e-588a-4155-87f9-600a6eb36c9a tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:54.452161 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c152ea6e-588a-4155-87f9-600a6eb36c9a tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:54.453026 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c152ea6e-588a-4155-87f9-600a6eb36c9a tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:54.458984 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c152ea6e-588a-4155-87f9-600a6eb36c9a tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:54.460660 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c152ea6e-588a-4155-87f9-600a6eb36c9a tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:54.505316 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0587bf7d-3b31-4fb4-a4e1-18850d835fe1 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:54.515159 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0587bf7d-3b31-4fb4-a4e1-18850d835fe1 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:54.528595 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0587bf7d-3b31-4fb4-a4e1-18850d835fe1 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:54.532920 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0587bf7d-3b31-4fb4-a4e1-18850d835fe1 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1748 microversion: 2.20 time: 0.944417 Oct 23 01:27:54.536131 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2089/4109] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:27:53 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1748 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:27:54.548492 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-824cd608-5788-4674-83b4-37ebecd1ea2f tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-292127453", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": "none"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:27:54.558848 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c152ea6e-588a-4155-87f9-600a6eb36c9a tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87/ips" status: 200 len: 146 microversion: 2.1 time: 0.404989 Oct 23 01:27:54.562436 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2021/4110] 10.222.0.42 () {58 vars in 1248 bytes} [Sun Oct 23 01:27:54 2022] GET /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87/ips => generated 146 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:27:54.580536 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-069cb220-3997-4775-b50e-a33191bd9137 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:54.583071 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-069cb220-3997-4775-b50e-a33191bd9137 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:54.620049 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-069cb220-3997-4775-b50e-a33191bd9137 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:54.624941 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-069cb220-3997-4775-b50e-a33191bd9137 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:54.625438 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-069cb220-3997-4775-b50e-a33191bd9137 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:54.628992 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-069cb220-3997-4775-b50e-a33191bd9137 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:54.632763 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-069cb220-3997-4775-b50e-a33191bd9137 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:54.633391 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-069cb220-3997-4775-b50e-a33191bd9137 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:54.790859 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-824cd608-5788-4674-83b4-37ebecd1ea2f tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:27:54.791512 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-824cd608-5788-4674-83b4-37ebecd1ea2f tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:27:54.792190 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-824cd608-5788-4674-83b4-37ebecd1ea2f tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:27:54.792791 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-824cd608-5788-4674-83b4-37ebecd1ea2f tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:27:54.793366 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-824cd608-5788-4674-83b4-37ebecd1ea2f tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:27:54.809398 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-824cd608-5788-4674-83b4-37ebecd1ea2f tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:54.810270 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-824cd608-5788-4674-83b4-37ebecd1ea2f tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:54.810715 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-824cd608-5788-4674-83b4-37ebecd1ea2f tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:54.811450 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-824cd608-5788-4674-83b4-37ebecd1ea2f tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:54.811972 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-824cd608-5788-4674-83b4-37ebecd1ea2f tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:54.812400 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-824cd608-5788-4674-83b4-37ebecd1ea2f tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:54.821293 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:27:54.834569 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-824cd608-5788-4674-83b4-37ebecd1ea2f tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Getting quotas for project f0e82c5d57e54c3ba4d310bcb96b4e2a. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:27:54.841892 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-824cd608-5788-4674-83b4-37ebecd1ea2f tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Getting quotas for user 9945803bd26745a8b3ccb508f7cd2a38 and project f0e82c5d57e54c3ba4d310bcb96b4e2a. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:27:54.850811 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-069cb220-3997-4775-b50e-a33191bd9137 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:54.876157 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-824cd608-5788-4674-83b4-37ebecd1ea2f tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:27:54.879098 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-824cd608-5788-4674-83b4-37ebecd1ea2f tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] [instance: b527a7c5-fec9-4b19-9bf0-b7f4aafa9748] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:27:54.879276 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-069cb220-3997-4775-b50e-a33191bd9137 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:54.883618 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-069cb220-3997-4775-b50e-a33191bd9137 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:54.888379 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-069cb220-3997-4775-b50e-a33191bd9137 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1603 microversion: 2.42 time: 0.321615 Oct 23 01:27:54.892539 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2022/4111] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:27:54 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1603 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:27:54.919417 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-19f6d7d9-011a-4940-b80f-c5d8866b4381 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc16380d0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:55.038453 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-19f6d7d9-011a-4940-b80f-c5d8866b4381 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images/6f92eb4d-aa9a-45ce-b0c6-6c58ec4bc45b" status: 200 len: 1452 microversion: 2.1 time: 0.140881 Oct 23 01:27:55.049093 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2023/4112] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:27:54 2022] GET /compute/v2.1/images/6f92eb4d-aa9a-45ce-b0c6-6c58ec4bc45b => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:27:55.095407 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-824cd608-5788-4674-83b4-37ebecd1ea2f tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.556640 Oct 23 01:27:55.105622 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2090/4113] 10.222.0.42 () {62 vars in 1188 bytes} [Sun Oct 23 01:27:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 23 01:27:55.110846 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8c712c99-2398-477b-acb2-52fe630b9bbf tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:27:55.113679 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8c712c99-2398-477b-acb2-52fe630b9bbf tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] [instance: b527a7c5-fec9-4b19-9bf0-b7f4aafa9748] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:55.248897 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8c712c99-2398-477b-acb2-52fe630b9bbf tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] 10.222.0.42 "PUT /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748" status: 200 len: 991 microversion: 2.47 time: 0.140880 Oct 23 01:27:55.249898 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2024/4114] 10.222.0.42 () {62 vars in 1297 bytes} [Sun Oct 23 01:27:55 2022] PUT /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748 => generated 991 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:27:55.293885 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0d198c8d-618a-4ded-8c58-5e6b7b5c63bf tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:55.295061 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0d198c8d-618a-4ded-8c58-5e6b7b5c63bf tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] [instance: b527a7c5-fec9-4b19-9bf0-b7f4aafa9748] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:55.492817 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0d198c8d-618a-4ded-8c58-5e6b7b5c63bf tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:55.507546 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0d198c8d-618a-4ded-8c58-5e6b7b5c63bf tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:55.509902 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0d198c8d-618a-4ded-8c58-5e6b7b5c63bf tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:55.526148 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0d198c8d-618a-4ded-8c58-5e6b7b5c63bf tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] 10.222.0.42 "GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748" status: 200 len: 1277 microversion: 2.47 time: 0.238251 Oct 23 01:27:55.526148 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2091/4115] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:27:55 2022] GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748 => generated 1277 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:27:55.563501 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bb469b5d-d6c6-4c28-ad31-585cafa90e7f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:55.565792 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-bb469b5d-d6c6-4c28-ad31-585cafa90e7f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:55.595143 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bb469b5d-d6c6-4c28-ad31-585cafa90e7f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:55.595672 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bb469b5d-d6c6-4c28-ad31-585cafa90e7f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:55.600393 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bb469b5d-d6c6-4c28-ad31-585cafa90e7f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:55.600393 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bb469b5d-d6c6-4c28-ad31-585cafa90e7f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:55.600393 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bb469b5d-d6c6-4c28-ad31-585cafa90e7f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:55.600393 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bb469b5d-d6c6-4c28-ad31-585cafa90e7f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:55.920449 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-52adc923-493f-4ef7-b828-5b8c5d9bc482 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:55.921092 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-52adc923-493f-4ef7-b828-5b8c5d9bc482 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:55.923568 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:27:55.937954 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-52adc923-493f-4ef7-b828-5b8c5d9bc482 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:55.938385 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-52adc923-493f-4ef7-b828-5b8c5d9bc482 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:55.938957 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-52adc923-493f-4ef7-b828-5b8c5d9bc482 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:55.939532 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-52adc923-493f-4ef7-b828-5b8c5d9bc482 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:55.939988 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-52adc923-493f-4ef7-b828-5b8c5d9bc482 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:55.940418 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-52adc923-493f-4ef7-b828-5b8c5d9bc482 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:56.021309 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bb469b5d-d6c6-4c28-ad31-585cafa90e7f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:56.025215 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:27:56.048110 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bb469b5d-d6c6-4c28-ad31-585cafa90e7f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:56.057093 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bb469b5d-d6c6-4c28-ad31-585cafa90e7f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:56.061041 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bb469b5d-d6c6-4c28-ad31-585cafa90e7f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1748 microversion: 2.20 time: 0.502301 Oct 23 01:27:56.080710 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2025/4116] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:27:55 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1748 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:27:56.080710 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0ff5f23b-d2cf-489b-a637-054992ea29e3 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc163fe50>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:56.149518 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-52adc923-493f-4ef7-b828-5b8c5d9bc482 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:56.185829 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-52adc923-493f-4ef7-b828-5b8c5d9bc482 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:56.204166 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0ff5f23b-d2cf-489b-a637-054992ea29e3 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images/6f92eb4d-aa9a-45ce-b0c6-6c58ec4bc45b" status: 200 len: 1452 microversion: 2.1 time: 0.137616 Oct 23 01:27:56.204967 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-52adc923-493f-4ef7-b828-5b8c5d9bc482 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:56.206303 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-52adc923-493f-4ef7-b828-5b8c5d9bc482 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1603 microversion: 2.42 time: 0.289893 Oct 23 01:27:56.212098 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2026/4117] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:27:56 2022] GET /compute/v2.1/images/6f92eb4d-aa9a-45ce-b0c6-6c58ec4bc45b => generated 1452 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:27:56.214112 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2092/4118] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:27:55 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1603 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:27:56.556083 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6dc17f54-cfbb-4dc8-a28b-8e6f5f617c2c tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:56.560221 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6dc17f54-cfbb-4dc8-a28b-8e6f5f617c2c tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] [instance: b527a7c5-fec9-4b19-9bf0-b7f4aafa9748] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:56.568083 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6dc17f54-cfbb-4dc8-a28b-8e6f5f617c2c tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:56.569788 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6dc17f54-cfbb-4dc8-a28b-8e6f5f617c2c tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:56.570511 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6dc17f54-cfbb-4dc8-a28b-8e6f5f617c2c tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:56.571507 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6dc17f54-cfbb-4dc8-a28b-8e6f5f617c2c tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:56.572285 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6dc17f54-cfbb-4dc8-a28b-8e6f5f617c2c tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:56.573371 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6dc17f54-cfbb-4dc8-a28b-8e6f5f617c2c tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:56.781798 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6dc17f54-cfbb-4dc8-a28b-8e6f5f617c2c tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:56.852076 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6dc17f54-cfbb-4dc8-a28b-8e6f5f617c2c tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:56.873635 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6dc17f54-cfbb-4dc8-a28b-8e6f5f617c2c tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:56.877736 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6dc17f54-cfbb-4dc8-a28b-8e6f5f617c2c tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] 10.222.0.42 "GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748" status: 200 len: 1281 microversion: 2.47 time: 0.337455 Oct 23 01:27:56.878383 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2027/4119] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:27:56 2022] GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748 => generated 1281 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:27:57.090227 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-280eb9d1-4cff-4d24-9997-72fec413c92f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:57.090862 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-280eb9d1-4cff-4d24-9997-72fec413c92f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:57.111185 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-280eb9d1-4cff-4d24-9997-72fec413c92f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:57.111694 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-280eb9d1-4cff-4d24-9997-72fec413c92f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:57.112145 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-280eb9d1-4cff-4d24-9997-72fec413c92f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:57.117880 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-280eb9d1-4cff-4d24-9997-72fec413c92f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:57.122633 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-280eb9d1-4cff-4d24-9997-72fec413c92f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:57.123112 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-280eb9d1-4cff-4d24-9997-72fec413c92f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:57.219456 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-45bf462c-ccc9-4b44-a634-85ec8b1629fe tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc163f790>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:57.289716 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-45bf462c-ccc9-4b44-a634-85ec8b1629fe tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images/6f92eb4d-aa9a-45ce-b0c6-6c58ec4bc45b" status: 200 len: 1452 microversion: 2.1 time: 0.074755 Oct 23 01:27:57.298787 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2028/4120] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:27:57 2022] GET /compute/v2.1/images/6f92eb4d-aa9a-45ce-b0c6-6c58ec4bc45b => generated 1452 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:27:57.305030 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a773c528-39f1-47b7-bc35-810a55d2aa73 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:57.305933 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a773c528-39f1-47b7-bc35-810a55d2aa73 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:57.314669 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a773c528-39f1-47b7-bc35-810a55d2aa73 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:57.315851 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a773c528-39f1-47b7-bc35-810a55d2aa73 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:57.316528 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a773c528-39f1-47b7-bc35-810a55d2aa73 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:57.317452 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a773c528-39f1-47b7-bc35-810a55d2aa73 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:57.318164 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a773c528-39f1-47b7-bc35-810a55d2aa73 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:57.318794 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a773c528-39f1-47b7-bc35-810a55d2aa73 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:57.461316 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a773c528-39f1-47b7-bc35-810a55d2aa73 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:57.484200 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a773c528-39f1-47b7-bc35-810a55d2aa73 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:57.487517 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a773c528-39f1-47b7-bc35-810a55d2aa73 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:57.494825 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a773c528-39f1-47b7-bc35-810a55d2aa73 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1603 microversion: 2.42 time: 0.194701 Oct 23 01:27:57.498269 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2029/4121] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:27:57 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1603 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:27:57.577446 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-280eb9d1-4cff-4d24-9997-72fec413c92f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:57.589808 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-280eb9d1-4cff-4d24-9997-72fec413c92f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:57.592324 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-280eb9d1-4cff-4d24-9997-72fec413c92f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:57.594126 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-280eb9d1-4cff-4d24-9997-72fec413c92f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1750 microversion: 2.20 time: 0.509758 Oct 23 01:27:57.594716 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2093/4122] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:27:57 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1750 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:27:57.911238 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-16f35df4-2bab-44b7-ba07-6f4f0adeec9c tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:57.912059 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-16f35df4-2bab-44b7-ba07-6f4f0adeec9c tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] [instance: b527a7c5-fec9-4b19-9bf0-b7f4aafa9748] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:57.968783 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-16f35df4-2bab-44b7-ba07-6f4f0adeec9c tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:57.973583 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-16f35df4-2bab-44b7-ba07-6f4f0adeec9c tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:57.975873 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-16f35df4-2bab-44b7-ba07-6f4f0adeec9c tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:57.979995 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-16f35df4-2bab-44b7-ba07-6f4f0adeec9c tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:57.980573 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-16f35df4-2bab-44b7-ba07-6f4f0adeec9c tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:57.981020 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-16f35df4-2bab-44b7-ba07-6f4f0adeec9c tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:58.208214 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-16f35df4-2bab-44b7-ba07-6f4f0adeec9c tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:58.219886 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-16f35df4-2bab-44b7-ba07-6f4f0adeec9c tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:58.228293 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-16f35df4-2bab-44b7-ba07-6f4f0adeec9c tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:58.230333 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-16f35df4-2bab-44b7-ba07-6f4f0adeec9c tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] 10.222.0.42 "GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748" status: 200 len: 1273 microversion: 2.47 time: 0.324260 Oct 23 01:27:58.232438 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2030/4123] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:27:57 2022] GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748 => generated 1273 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:27:58.306061 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9576a883-4d4f-4acb-a845-22507d2ba8eb tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc18d0c10>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:58.372010 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9576a883-4d4f-4acb-a845-22507d2ba8eb tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images/6f92eb4d-aa9a-45ce-b0c6-6c58ec4bc45b" status: 200 len: 1452 microversion: 2.1 time: 0.069923 Oct 23 01:27:58.375364 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2094/4124] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:27:58 2022] GET /compute/v2.1/images/6f92eb4d-aa9a-45ce-b0c6-6c58ec4bc45b => generated 1452 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:27:58.525548 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4abbedce-6635-4b25-a4c2-e9b7a9327f44 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:58.528909 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4abbedce-6635-4b25-a4c2-e9b7a9327f44 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:58.548310 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4abbedce-6635-4b25-a4c2-e9b7a9327f44 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:58.550343 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4abbedce-6635-4b25-a4c2-e9b7a9327f44 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:58.550973 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4abbedce-6635-4b25-a4c2-e9b7a9327f44 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:58.556547 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-146b8ff9-22c3-46cf-a568-2298d7b066b3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "382887af-33d5-4ee1-a55f-5d267d0dfab0"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:27:58.559811 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-146b8ff9-22c3-46cf-a568-2298d7b066b3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: 0fb11dc6-65bc-4c8e-a674-c948f42f1b87] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:58.563465 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4abbedce-6635-4b25-a4c2-e9b7a9327f44 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:58.572400 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4abbedce-6635-4b25-a4c2-e9b7a9327f44 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:58.574756 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4abbedce-6635-4b25-a4c2-e9b7a9327f44 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:58.581468 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-146b8ff9-22c3-46cf-a568-2298d7b066b3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:58.592515 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-146b8ff9-22c3-46cf-a568-2298d7b066b3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:58.601365 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-146b8ff9-22c3-46cf-a568-2298d7b066b3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:58.602268 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-146b8ff9-22c3-46cf-a568-2298d7b066b3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:58.606470 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-146b8ff9-22c3-46cf-a568-2298d7b066b3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:58.610433 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-146b8ff9-22c3-46cf-a568-2298d7b066b3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:59.100178 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4abbedce-6635-4b25-a4c2-e9b7a9327f44 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:59.115253 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4abbedce-6635-4b25-a4c2-e9b7a9327f44 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:59.117048 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4abbedce-6635-4b25-a4c2-e9b7a9327f44 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:59.126891 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4abbedce-6635-4b25-a4c2-e9b7a9327f44 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1603 microversion: 2.42 time: 0.605382 Oct 23 01:27:59.131814 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2031/4125] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:27:58 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1603 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:27:59.139540 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-95058b3c-a78e-431c-a17e-ecc433743fda tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:59.144243 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-95058b3c-a78e-431c-a17e-ecc433743fda tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:59.179732 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-95058b3c-a78e-431c-a17e-ecc433743fda tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:59.185489 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-95058b3c-a78e-431c-a17e-ecc433743fda tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:59.186098 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-95058b3c-a78e-431c-a17e-ecc433743fda tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:59.191389 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-95058b3c-a78e-431c-a17e-ecc433743fda tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:59.192102 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-95058b3c-a78e-431c-a17e-ecc433743fda tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:59.192559 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-95058b3c-a78e-431c-a17e-ecc433743fda tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:59.880662 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-95058b3c-a78e-431c-a17e-ecc433743fda tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:59.897739 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-95058b3c-a78e-431c-a17e-ecc433743fda tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:59.901370 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-95058b3c-a78e-431c-a17e-ecc433743fda tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:27:59.907593 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-95058b3c-a78e-431c-a17e-ecc433743fda tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1750 microversion: 2.20 time: 0.777381 Oct 23 01:27:59.911397 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2032/4126] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:27:59 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1750 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:27:59.925031 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-42b89356-7576-470f-b1d7-47d4a5f24c27 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:27:59.926609 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-42b89356-7576-470f-b1d7-47d4a5f24c27 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] [instance: b527a7c5-fec9-4b19-9bf0-b7f4aafa9748] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:27:59.957711 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-42b89356-7576-470f-b1d7-47d4a5f24c27 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:59.964143 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-42b89356-7576-470f-b1d7-47d4a5f24c27 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:59.966830 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-42b89356-7576-470f-b1d7-47d4a5f24c27 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:27:59.969911 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-42b89356-7576-470f-b1d7-47d4a5f24c27 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:27:59.972843 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-42b89356-7576-470f-b1d7-47d4a5f24c27 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:27:59.976970 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-42b89356-7576-470f-b1d7-47d4a5f24c27 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:00.317021 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-42b89356-7576-470f-b1d7-47d4a5f24c27 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:00.327157 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-42b89356-7576-470f-b1d7-47d4a5f24c27 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:00.336941 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-42b89356-7576-470f-b1d7-47d4a5f24c27 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:00.344199 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-42b89356-7576-470f-b1d7-47d4a5f24c27 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] 10.222.0.42 "GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748" status: 200 len: 1337 microversion: 2.47 time: 0.429894 Oct 23 01:28:00.348914 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2033/4127] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:27:59 2022] GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748 => generated 1337 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:00.364173 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-70e01c21-5e4a-411b-bcc4-3fce082a443f tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc16af430>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:00.450381 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-70e01c21-5e4a-411b-bcc4-3fce082a443f tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images/6f92eb4d-aa9a-45ce-b0c6-6c58ec4bc45b" status: 200 len: 1452 microversion: 2.1 time: 0.094964 Oct 23 01:28:00.457480 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2034/4128] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:28:00 2022] GET /compute/v2.1/images/6f92eb4d-aa9a-45ce-b0c6-6c58ec4bc45b => generated 1452 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:28:00.469834 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f206308a-f650-460b-8743-f07fea9a80de tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:00.470834 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f206308a-f650-460b-8743-f07fea9a80de tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:00.487745 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f206308a-f650-460b-8743-f07fea9a80de tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:00.488333 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f206308a-f650-460b-8743-f07fea9a80de tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:00.488958 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f206308a-f650-460b-8743-f07fea9a80de tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:00.492320 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f206308a-f650-460b-8743-f07fea9a80de tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:00.492986 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f206308a-f650-460b-8743-f07fea9a80de tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:00.493601 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f206308a-f650-460b-8743-f07fea9a80de tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:00.733603 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f206308a-f650-460b-8743-f07fea9a80de tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:00.744864 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f206308a-f650-460b-8743-f07fea9a80de tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:00.747836 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f206308a-f650-460b-8743-f07fea9a80de tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:00.749284 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f206308a-f650-460b-8743-f07fea9a80de tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1603 microversion: 2.42 time: 0.290511 Oct 23 01:28:00.750399 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2035/4129] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:00 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1603 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:00.830533 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-a03ece26-bb6d-4018-aa94-8fbfc6e8abc0 req-83b1fe3e-526d-486f-b555-9bdb63b8142f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad46f590-af38-463e-87db-62c442e08669", "name": "network-vif-plugged", "status": "completed", "tag": "d91fdad3-e41c-42ed-88d5-cc3ba6ed68a4"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:28:00.849198 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-a03ece26-bb6d-4018-aa94-8fbfc6e8abc0 req-83b1fe3e-526d-486f-b555-9bdb63b8142f service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:00.854552 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-a03ece26-bb6d-4018-aa94-8fbfc6e8abc0 req-83b1fe3e-526d-486f-b555-9bdb63b8142f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:00.855334 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-a03ece26-bb6d-4018-aa94-8fbfc6e8abc0 req-83b1fe3e-526d-486f-b555-9bdb63b8142f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:00.878277 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-a03ece26-bb6d-4018-aa94-8fbfc6e8abc0 req-83b1fe3e-526d-486f-b555-9bdb63b8142f service nova] Creating event network-vif-plugged:d91fdad3-e41c-42ed-88d5-cc3ba6ed68a4 for instance ad46f590-af38-463e-87db-62c442e08669 on n-h1-master-1 Oct 23 01:28:00.891510 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-a03ece26-bb6d-4018-aa94-8fbfc6e8abc0 req-83b1fe3e-526d-486f-b555-9bdb63b8142f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068763 Oct 23 01:28:00.894342 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2036/4130] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:28:00.942788 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d7f755d8-66b3-4f1c-afb9-3301a2fff935 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:00.944090 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d7f755d8-66b3-4f1c-afb9-3301a2fff935 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:00.956376 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d7f755d8-66b3-4f1c-afb9-3301a2fff935 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:00.958652 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d7f755d8-66b3-4f1c-afb9-3301a2fff935 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:00.959159 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d7f755d8-66b3-4f1c-afb9-3301a2fff935 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:00.964018 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d7f755d8-66b3-4f1c-afb9-3301a2fff935 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:00.964018 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d7f755d8-66b3-4f1c-afb9-3301a2fff935 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:00.964018 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d7f755d8-66b3-4f1c-afb9-3301a2fff935 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:01.543003 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d7f755d8-66b3-4f1c-afb9-3301a2fff935 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:01.565061 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d7f755d8-66b3-4f1c-afb9-3301a2fff935 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:01.569324 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d7f755d8-66b3-4f1c-afb9-3301a2fff935 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:01.572906 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d7f755d8-66b3-4f1c-afb9-3301a2fff935 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1750 microversion: 2.20 time: 0.635384 Oct 23 01:28:01.577276 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2037/4131] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:00 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1750 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:28:01.582857 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-07b063ad-06c9-4a64-91f3-2900f6d8f934 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:01.590832 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-07b063ad-06c9-4a64-91f3-2900f6d8f934 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] [instance: b527a7c5-fec9-4b19-9bf0-b7f4aafa9748] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:01.606277 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-07b063ad-06c9-4a64-91f3-2900f6d8f934 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:01.607171 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-07b063ad-06c9-4a64-91f3-2900f6d8f934 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:01.609604 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-07b063ad-06c9-4a64-91f3-2900f6d8f934 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:01.610584 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-07b063ad-06c9-4a64-91f3-2900f6d8f934 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:01.614442 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-07b063ad-06c9-4a64-91f3-2900f6d8f934 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:01.615086 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-07b063ad-06c9-4a64-91f3-2900f6d8f934 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:01.776930 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-07b063ad-06c9-4a64-91f3-2900f6d8f934 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:01.786768 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-07b063ad-06c9-4a64-91f3-2900f6d8f934 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:01.793590 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-07b063ad-06c9-4a64-91f3-2900f6d8f934 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:01.795184 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-07b063ad-06c9-4a64-91f3-2900f6d8f934 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] 10.222.0.42 "GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748" status: 200 len: 1335 microversion: 2.47 time: 0.216169 Oct 23 01:28:01.802324 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2038/4132] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:01 2022] GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748 => generated 1335 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:01.816528 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-57de667a-2b00-49a0-9dba-58c82bc9e6b9 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc163fd30>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:01.889277 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-57de667a-2b00-49a0-9dba-58c82bc9e6b9 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images/6f92eb4d-aa9a-45ce-b0c6-6c58ec4bc45b" status: 200 len: 1452 microversion: 2.1 time: 0.085295 Oct 23 01:28:01.891338 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2039/4133] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:28:01 2022] GET /compute/v2.1/images/6f92eb4d-aa9a-45ce-b0c6-6c58ec4bc45b => generated 1452 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:28:01.904117 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bb3c4941-860d-462b-8492-626c06fb1ccb tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:01.906663 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-bb3c4941-860d-462b-8492-626c06fb1ccb tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:01.922774 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bb3c4941-860d-462b-8492-626c06fb1ccb tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:01.927608 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bb3c4941-860d-462b-8492-626c06fb1ccb tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:01.928761 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bb3c4941-860d-462b-8492-626c06fb1ccb tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:01.929712 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bb3c4941-860d-462b-8492-626c06fb1ccb tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:01.930413 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bb3c4941-860d-462b-8492-626c06fb1ccb tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:01.931058 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bb3c4941-860d-462b-8492-626c06fb1ccb tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:02.060751 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bb3c4941-860d-462b-8492-626c06fb1ccb tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:02.077122 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bb3c4941-860d-462b-8492-626c06fb1ccb tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:02.078741 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bb3c4941-860d-462b-8492-626c06fb1ccb tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:02.083489 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bb3c4941-860d-462b-8492-626c06fb1ccb tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1603 microversion: 2.42 time: 0.190766 Oct 23 01:28:02.102450 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2040/4134] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:01 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1603 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:02.242287 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-049a4a53-99bd-4414-9578-eae15b5c406b tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1014432432", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "b4d92001-277b-4b63-8bfe-16a267b4a373"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:28:02.346114 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-049a4a53-99bd-4414-9578-eae15b5c406b tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] validate_networks() for [('b4d92001-277b-4b63-8bfe-16a267b4a373', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:28:03.353103 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:28:03.903859 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-049a4a53-99bd-4414-9578-eae15b5c406b tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:28:03.907848 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-049a4a53-99bd-4414-9578-eae15b5c406b tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:28:03.907848 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-049a4a53-99bd-4414-9578-eae15b5c406b tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:28:03.907848 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-049a4a53-99bd-4414-9578-eae15b5c406b tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:28:03.907848 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-049a4a53-99bd-4414-9578-eae15b5c406b tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:28:03.910406 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:28:03.924537 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-049a4a53-99bd-4414-9578-eae15b5c406b tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:03.925191 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-049a4a53-99bd-4414-9578-eae15b5c406b tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:03.925779 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-049a4a53-99bd-4414-9578-eae15b5c406b tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:03.926720 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-049a4a53-99bd-4414-9578-eae15b5c406b tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:03.938798 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-049a4a53-99bd-4414-9578-eae15b5c406b tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:03.939478 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-049a4a53-99bd-4414-9578-eae15b5c406b tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:03.976247 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-049a4a53-99bd-4414-9578-eae15b5c406b tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Getting quotas for project bddcdc2e1f98450e8b7a6fbbe5a08b7c. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:28:04.004508 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-049a4a53-99bd-4414-9578-eae15b5c406b tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Getting quotas for user 05ceb97b88e9411abd0d5882bf05027a and project bddcdc2e1f98450e8b7a6fbbe5a08b7c. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:28:04.063539 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-049a4a53-99bd-4414-9578-eae15b5c406b tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:28:04.065906 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-049a4a53-99bd-4414-9578-eae15b5c406b tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] [instance: 81baf1e0-bb30-4349-9f18-61057d045d99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:28:04.271323 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-049a4a53-99bd-4414-9578-eae15b5c406b tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.166472 Oct 23 01:28:04.274091 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2041/4135] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:28:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2170 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:28:04.288902 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-809669cf-3589-49cd-bdb5-1db27c97bb5c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:04.289890 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-809669cf-3589-49cd-bdb5-1db27c97bb5c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:04.318501 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-809669cf-3589-49cd-bdb5-1db27c97bb5c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:04.319034 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-809669cf-3589-49cd-bdb5-1db27c97bb5c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:04.322830 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-809669cf-3589-49cd-bdb5-1db27c97bb5c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:04.323603 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-809669cf-3589-49cd-bdb5-1db27c97bb5c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:04.324088 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-809669cf-3589-49cd-bdb5-1db27c97bb5c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:04.324526 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-809669cf-3589-49cd-bdb5-1db27c97bb5c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:04.574456 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-809669cf-3589-49cd-bdb5-1db27c97bb5c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:04.603232 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-809669cf-3589-49cd-bdb5-1db27c97bb5c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:04.609701 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-809669cf-3589-49cd-bdb5-1db27c97bb5c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:04.613566 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-809669cf-3589-49cd-bdb5-1db27c97bb5c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1750 microversion: 2.20 time: 0.338107 Oct 23 01:28:04.615055 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2042/4136] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:04 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1750 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:04.622227 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2834771c-a9db-4bee-bd46-646785234d8c tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:04.631551 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2834771c-a9db-4bee-bd46-646785234d8c tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] [instance: b527a7c5-fec9-4b19-9bf0-b7f4aafa9748] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:04.631551 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2834771c-a9db-4bee-bd46-646785234d8c tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:04.631551 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2834771c-a9db-4bee-bd46-646785234d8c tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:04.631551 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2834771c-a9db-4bee-bd46-646785234d8c tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:04.633364 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2834771c-a9db-4bee-bd46-646785234d8c tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:04.634199 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2834771c-a9db-4bee-bd46-646785234d8c tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:04.635343 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2834771c-a9db-4bee-bd46-646785234d8c tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:04.772660 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2834771c-a9db-4bee-bd46-646785234d8c tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:04.789024 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2834771c-a9db-4bee-bd46-646785234d8c tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:04.791187 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2834771c-a9db-4bee-bd46-646785234d8c tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:04.792440 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2834771c-a9db-4bee-bd46-646785234d8c tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] 10.222.0.42 "GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748" status: 200 len: 1356 microversion: 2.47 time: 0.176137 Oct 23 01:28:04.821613 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:28:04.822830 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2043/4137] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:04 2022] GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748 => generated 1356 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:04.831344 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3383843c-b182-4e0b-b339-23d2efd170e7 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc17085e0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:04.902810 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3383843c-b182-4e0b-b339-23d2efd170e7 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images/6f92eb4d-aa9a-45ce-b0c6-6c58ec4bc45b" status: 200 len: 1452 microversion: 2.1 time: 0.078652 Oct 23 01:28:04.904344 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2044/4138] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:28:04 2022] GET /compute/v2.1/images/6f92eb4d-aa9a-45ce-b0c6-6c58ec4bc45b => generated 1452 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:28:04.920186 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-51279626-ee95-4cbd-8583-0083e3660895 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:04.920960 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-51279626-ee95-4cbd-8583-0083e3660895 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:04.940785 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-51279626-ee95-4cbd-8583-0083e3660895 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:04.944945 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-51279626-ee95-4cbd-8583-0083e3660895 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:04.946117 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-51279626-ee95-4cbd-8583-0083e3660895 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:04.947090 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-51279626-ee95-4cbd-8583-0083e3660895 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:04.948157 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-51279626-ee95-4cbd-8583-0083e3660895 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:04.948688 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-51279626-ee95-4cbd-8583-0083e3660895 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:05.076534 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-51279626-ee95-4cbd-8583-0083e3660895 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:05.091592 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-51279626-ee95-4cbd-8583-0083e3660895 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:05.093827 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-51279626-ee95-4cbd-8583-0083e3660895 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:05.109280 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-51279626-ee95-4cbd-8583-0083e3660895 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1603 microversion: 2.42 time: 0.202578 Oct 23 01:28:05.112357 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2045/4139] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:04 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1603 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:05.126219 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-17b7af68-6763-4e99-8585-0d7f7320b655 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:05.130282 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-17b7af68-6763-4e99-8585-0d7f7320b655 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] [instance: 81baf1e0-bb30-4349-9f18-61057d045d99] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:05.217207 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-17b7af68-6763-4e99-8585-0d7f7320b655 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ceb97b88e9411abd0d5882bf05027a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddcdc2e1f98450e8b7a6fbbe5a08b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:05.227481 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-17b7af68-6763-4e99-8585-0d7f7320b655 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] 10.222.0.42 "GET /compute/v2.1/servers/81baf1e0-bb30-4349-9f18-61057d045d99" status: 200 len: 1217 microversion: 2.1 time: 0.113758 Oct 23 01:28:05.229104 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2046/4140] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:28:05 2022] GET /compute/v2.1/servers/81baf1e0-bb30-4349-9f18-61057d045d99 => generated 1217 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:28:05.248821 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-54392643-fa34-4ba3-aa0f-54894e14de8f tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:28:05.253273 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-54392643-fa34-4ba3-aa0f-54894e14de8f tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] [instance: b527a7c5-fec9-4b19-9bf0-b7f4aafa9748] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:05.261334 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54392643-fa34-4ba3-aa0f-54894e14de8f tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:05.262061 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54392643-fa34-4ba3-aa0f-54894e14de8f tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:05.262671 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54392643-fa34-4ba3-aa0f-54894e14de8f tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:05.263531 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54392643-fa34-4ba3-aa0f-54894e14de8f tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:05.264131 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54392643-fa34-4ba3-aa0f-54894e14de8f tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:05.264702 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54392643-fa34-4ba3-aa0f-54894e14de8f tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:05.396564 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-54392643-fa34-4ba3-aa0f-54894e14de8f tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:28:05.399101 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-54392643-fa34-4ba3-aa0f-54894e14de8f tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:28:05.413521 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-54392643-fa34-4ba3-aa0f-54894e14de8f tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:28:05.416498 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-54392643-fa34-4ba3-aa0f-54894e14de8f tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:28:05.416498 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-54392643-fa34-4ba3-aa0f-54894e14de8f tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:28:05.505318 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=8 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:28:05.780153 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-54392643-fa34-4ba3-aa0f-54894e14de8f tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] [instance: b527a7c5-fec9-4b19-9bf0-b7f4aafa9748] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:05.817144 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54392643-fa34-4ba3-aa0f-54894e14de8f tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:05.817659 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54392643-fa34-4ba3-aa0f-54894e14de8f tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:05.818134 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54392643-fa34-4ba3-aa0f-54894e14de8f tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:05.818865 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54392643-fa34-4ba3-aa0f-54894e14de8f tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:05.819326 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54392643-fa34-4ba3-aa0f-54894e14de8f tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:05.819754 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54392643-fa34-4ba3-aa0f-54894e14de8f tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:05.853774 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:28:05.867848 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-54392643-fa34-4ba3-aa0f-54894e14de8f tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] 10.222.0.42 "POST /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748/action" status: 202 len: 1078 microversion: 2.47 time: 0.635018 Oct 23 01:28:05.870546 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2047/4141] 10.222.0.42 () {62 vars in 1319 bytes} [Sun Oct 23 01:28:05 2022] POST /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748/action => generated 1078 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 23 01:28:05.875849 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d4bea957-246c-4fed-8d32-5ce57a6c342a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:05.877040 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d4bea957-246c-4fed-8d32-5ce57a6c342a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:05.884320 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4bea957-246c-4fed-8d32-5ce57a6c342a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:05.885730 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4bea957-246c-4fed-8d32-5ce57a6c342a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:05.885834 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4bea957-246c-4fed-8d32-5ce57a6c342a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:05.886656 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4bea957-246c-4fed-8d32-5ce57a6c342a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:05.887404 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4bea957-246c-4fed-8d32-5ce57a6c342a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:05.887976 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4bea957-246c-4fed-8d32-5ce57a6c342a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:06.248264 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d4bea957-246c-4fed-8d32-5ce57a6c342a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:06.267674 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d4bea957-246c-4fed-8d32-5ce57a6c342a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:06.269749 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d4bea957-246c-4fed-8d32-5ce57a6c342a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:06.271324 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d4bea957-246c-4fed-8d32-5ce57a6c342a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1750 microversion: 2.20 time: 0.399644 Oct 23 01:28:06.300072 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2048/4142] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:05 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1750 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:06.317061 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-06fd1842-c707-4ad8-9189-8bc652cfba82 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:06.320681 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-06fd1842-c707-4ad8-9189-8bc652cfba82 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] [instance: b527a7c5-fec9-4b19-9bf0-b7f4aafa9748] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:06.336654 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-06fd1842-c707-4ad8-9189-8bc652cfba82 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:06.338494 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-06fd1842-c707-4ad8-9189-8bc652cfba82 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:06.338950 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-06fd1842-c707-4ad8-9189-8bc652cfba82 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:06.340977 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-06fd1842-c707-4ad8-9189-8bc652cfba82 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:06.341453 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-06fd1842-c707-4ad8-9189-8bc652cfba82 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:06.342541 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-06fd1842-c707-4ad8-9189-8bc652cfba82 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:06.466550 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-06fd1842-c707-4ad8-9189-8bc652cfba82 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:06.477760 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-06fd1842-c707-4ad8-9189-8bc652cfba82 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:06.482768 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-06fd1842-c707-4ad8-9189-8bc652cfba82 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:06.484923 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-06fd1842-c707-4ad8-9189-8bc652cfba82 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] 10.222.0.42 "GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748" status: 200 len: 1365 microversion: 2.47 time: 0.182129 Oct 23 01:28:06.498762 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2049/4143] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:06 2022] GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748 => generated 1365 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:06.515615 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-61d1da41-c1e1-4db6-9001-78757aba1e5e tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc1644f70>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:06.649364 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-61d1da41-c1e1-4db6-9001-78757aba1e5e tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images/6f92eb4d-aa9a-45ce-b0c6-6c58ec4bc45b" status: 200 len: 1452 microversion: 2.1 time: 0.145454 Oct 23 01:28:06.650696 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2050/4144] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:28:06 2022] GET /compute/v2.1/images/6f92eb4d-aa9a-45ce-b0c6-6c58ec4bc45b => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:28:06.676388 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e3bb434f-24fd-4715-8f54-9ef032073cf5 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:06.677020 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e3bb434f-24fd-4715-8f54-9ef032073cf5 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:06.691902 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e3bb434f-24fd-4715-8f54-9ef032073cf5 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:06.692354 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e3bb434f-24fd-4715-8f54-9ef032073cf5 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:06.693840 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e3bb434f-24fd-4715-8f54-9ef032073cf5 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:06.694633 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e3bb434f-24fd-4715-8f54-9ef032073cf5 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:06.695089 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e3bb434f-24fd-4715-8f54-9ef032073cf5 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:06.695571 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e3bb434f-24fd-4715-8f54-9ef032073cf5 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:06.734670 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e3bb434f-24fd-4715-8f54-9ef032073cf5 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:06.735084 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e3bb434f-24fd-4715-8f54-9ef032073cf5 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:06.736346 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e3bb434f-24fd-4715-8f54-9ef032073cf5 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:06.736883 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-e3bb434f-24fd-4715-8f54-9ef032073cf5 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lazy-loading 'fault' on Instance uuid defa5fbb-f632-4ce7-8e07-e00f6f491d82 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:28:06.859543 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e3bb434f-24fd-4715-8f54-9ef032073cf5 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:06.870206 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e3bb434f-24fd-4715-8f54-9ef032073cf5 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:06.871774 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e3bb434f-24fd-4715-8f54-9ef032073cf5 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:06.873442 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e3bb434f-24fd-4715-8f54-9ef032073cf5 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1608 microversion: 2.42 time: 0.221136 Oct 23 01:28:06.891702 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2051/4145] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:06 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1608 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:06.897755 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9a96db94-efbd-4a6e-86f2-63fe19f700bc tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:06.898465 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9a96db94-efbd-4a6e-86f2-63fe19f700bc tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] [instance: 81baf1e0-bb30-4349-9f18-61057d045d99] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:06.905776 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a96db94-efbd-4a6e-86f2-63fe19f700bc tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:06.906794 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a96db94-efbd-4a6e-86f2-63fe19f700bc tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:06.907308 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a96db94-efbd-4a6e-86f2-63fe19f700bc tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:06.908291 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a96db94-efbd-4a6e-86f2-63fe19f700bc tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:06.908836 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a96db94-efbd-4a6e-86f2-63fe19f700bc tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:06.909381 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a96db94-efbd-4a6e-86f2-63fe19f700bc tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:07.040210 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9a96db94-efbd-4a6e-86f2-63fe19f700bc tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ceb97b88e9411abd0d5882bf05027a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddcdc2e1f98450e8b7a6fbbe5a08b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:07.052420 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9a96db94-efbd-4a6e-86f2-63fe19f700bc tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] 10.222.0.42 "GET /compute/v2.1/servers/81baf1e0-bb30-4349-9f18-61057d045d99" status: 200 len: 1213 microversion: 2.1 time: 0.159432 Oct 23 01:28:07.056700 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2052/4146] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:28:06 2022] GET /compute/v2.1/servers/81baf1e0-bb30-4349-9f18-61057d045d99 => generated 1213 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:28:07.338807 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b543f307-ae3d-4352-adc6-127823ed8f65 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:07.339674 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b543f307-ae3d-4352-adc6-127823ed8f65 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:07.347414 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b543f307-ae3d-4352-adc6-127823ed8f65 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:07.348131 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b543f307-ae3d-4352-adc6-127823ed8f65 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:07.348876 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b543f307-ae3d-4352-adc6-127823ed8f65 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:07.350508 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b543f307-ae3d-4352-adc6-127823ed8f65 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:07.351159 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b543f307-ae3d-4352-adc6-127823ed8f65 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:07.352055 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b543f307-ae3d-4352-adc6-127823ed8f65 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:07.756562 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b543f307-ae3d-4352-adc6-127823ed8f65 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:07.784982 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b543f307-ae3d-4352-adc6-127823ed8f65 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:07.793036 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b543f307-ae3d-4352-adc6-127823ed8f65 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:07.796599 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b543f307-ae3d-4352-adc6-127823ed8f65 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1750 microversion: 2.20 time: 0.463106 Oct 23 01:28:07.797533 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2053/4147] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:07 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1750 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:07.809925 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e9ae6b9d-8868-4deb-95c2-90eb92cf7b1d tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:07.811289 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e9ae6b9d-8868-4deb-95c2-90eb92cf7b1d tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] [instance: b527a7c5-fec9-4b19-9bf0-b7f4aafa9748] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:07.819810 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e9ae6b9d-8868-4deb-95c2-90eb92cf7b1d tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:07.820313 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e9ae6b9d-8868-4deb-95c2-90eb92cf7b1d tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:07.820750 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e9ae6b9d-8868-4deb-95c2-90eb92cf7b1d tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:07.821460 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e9ae6b9d-8868-4deb-95c2-90eb92cf7b1d tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:07.822625 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e9ae6b9d-8868-4deb-95c2-90eb92cf7b1d tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:07.823042 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e9ae6b9d-8868-4deb-95c2-90eb92cf7b1d tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:07.939518 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e9ae6b9d-8868-4deb-95c2-90eb92cf7b1d tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:07.949379 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e9ae6b9d-8868-4deb-95c2-90eb92cf7b1d tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:07.951144 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e9ae6b9d-8868-4deb-95c2-90eb92cf7b1d tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:07.952385 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e9ae6b9d-8868-4deb-95c2-90eb92cf7b1d tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] 10.222.0.42 "GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748" status: 200 len: 1365 microversion: 2.47 time: 0.153780 Oct 23 01:28:07.958041 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2054/4148] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:07 2022] GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:07.958041 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-be2dcd3d-c66e-4d49-9922-107014be558c tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc16444c0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:08.033698 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-be2dcd3d-c66e-4d49-9922-107014be558c tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images/6f92eb4d-aa9a-45ce-b0c6-6c58ec4bc45b" status: 200 len: 1452 microversion: 2.1 time: 0.079341 Oct 23 01:28:08.034358 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2055/4149] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:28:07 2022] GET /compute/v2.1/images/6f92eb4d-aa9a-45ce-b0c6-6c58ec4bc45b => generated 1452 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:28:08.039142 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9e3e6e7b-6556-48f8-855c-ffe7d46f21ec tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:08.039785 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9e3e6e7b-6556-48f8-855c-ffe7d46f21ec tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:08.047026 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e3e6e7b-6556-48f8-855c-ffe7d46f21ec tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:08.047522 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e3e6e7b-6556-48f8-855c-ffe7d46f21ec tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:08.047961 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e3e6e7b-6556-48f8-855c-ffe7d46f21ec tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:08.048674 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e3e6e7b-6556-48f8-855c-ffe7d46f21ec tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:08.049754 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e3e6e7b-6556-48f8-855c-ffe7d46f21ec tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:08.050211 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e3e6e7b-6556-48f8-855c-ffe7d46f21ec tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:08.095068 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e3e6e7b-6556-48f8-855c-ffe7d46f21ec tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:08.095553 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e3e6e7b-6556-48f8-855c-ffe7d46f21ec tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:08.096135 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e3e6e7b-6556-48f8-855c-ffe7d46f21ec tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:08.096574 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-9e3e6e7b-6556-48f8-855c-ffe7d46f21ec tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lazy-loading 'fault' on Instance uuid defa5fbb-f632-4ce7-8e07-e00f6f491d82 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:28:08.144906 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9e3e6e7b-6556-48f8-855c-ffe7d46f21ec tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:08.167074 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9e3e6e7b-6556-48f8-855c-ffe7d46f21ec tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:08.176928 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9e3e6e7b-6556-48f8-855c-ffe7d46f21ec tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69bd8aff49524f19ae950f92d46bd44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f4adec8a4749a2bec19e7af0863059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:08.180536 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9e3e6e7b-6556-48f8-855c-ffe7d46f21ec tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 200 len: 1370 microversion: 2.42 time: 0.142910 Oct 23 01:28:08.184332 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2056/4150] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:08 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 1370 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:08.189474 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0d4e074e-033f-4f94-8a98-3af816ea731c tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:08.194461 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0d4e074e-033f-4f94-8a98-3af816ea731c tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] [instance: 81baf1e0-bb30-4349-9f18-61057d045d99] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:08.207913 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d4e074e-033f-4f94-8a98-3af816ea731c tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:08.208413 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d4e074e-033f-4f94-8a98-3af816ea731c tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:08.208851 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d4e074e-033f-4f94-8a98-3af816ea731c tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:08.209569 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d4e074e-033f-4f94-8a98-3af816ea731c tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:08.210053 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d4e074e-033f-4f94-8a98-3af816ea731c tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:08.210484 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d4e074e-033f-4f94-8a98-3af816ea731c tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:08.351838 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0d4e074e-033f-4f94-8a98-3af816ea731c tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ceb97b88e9411abd0d5882bf05027a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddcdc2e1f98450e8b7a6fbbe5a08b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:08.361066 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0d4e074e-033f-4f94-8a98-3af816ea731c tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] 10.222.0.42 "GET /compute/v2.1/servers/81baf1e0-bb30-4349-9f18-61057d045d99" status: 200 len: 1269 microversion: 2.1 time: 0.175496 Oct 23 01:28:08.361748 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2057/4151] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:28:08 2022] GET /compute/v2.1/servers/81baf1e0-bb30-4349-9f18-61057d045d99 => generated 1269 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:28:08.684844 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-146b8ff9-22c3-46cf-a568-2298d7b066b3 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "POST /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 10.132047 Oct 23 01:28:08.687018 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2095/4152] 10.222.0.42 () {60 vars in 1323 bytes} [Sun Oct 23 01:27:58 2022] POST /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87/os-volume_attachments => generated 194 bytes in 10135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:28:08.827722 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5234131b-f1ef-4fed-ba1e-c124ffce66b5 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:08.828576 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5234131b-f1ef-4fed-ba1e-c124ffce66b5 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:08.846129 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5234131b-f1ef-4fed-ba1e-c124ffce66b5 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:08.846708 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5234131b-f1ef-4fed-ba1e-c124ffce66b5 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:08.847156 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5234131b-f1ef-4fed-ba1e-c124ffce66b5 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:08.847871 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5234131b-f1ef-4fed-ba1e-c124ffce66b5 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:08.849446 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5234131b-f1ef-4fed-ba1e-c124ffce66b5 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:08.849893 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5234131b-f1ef-4fed-ba1e-c124ffce66b5 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:08.981133 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c45f58ee-c9c6-42ee-915d-87d7f963cb04 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:08.982182 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c45f58ee-c9c6-42ee-915d-87d7f963cb04 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] [instance: b527a7c5-fec9-4b19-9bf0-b7f4aafa9748] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:08.984254 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=5 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:28:09.016823 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c45f58ee-c9c6-42ee-915d-87d7f963cb04 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:09.021663 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c45f58ee-c9c6-42ee-915d-87d7f963cb04 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:09.023161 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c45f58ee-c9c6-42ee-915d-87d7f963cb04 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:09.026493 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c45f58ee-c9c6-42ee-915d-87d7f963cb04 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:09.032338 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c45f58ee-c9c6-42ee-915d-87d7f963cb04 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:09.038215 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c45f58ee-c9c6-42ee-915d-87d7f963cb04 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:09.282575 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5234131b-f1ef-4fed-ba1e-c124ffce66b5 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:09.305521 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5234131b-f1ef-4fed-ba1e-c124ffce66b5 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:09.312387 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5234131b-f1ef-4fed-ba1e-c124ffce66b5 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:09.316377 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5234131b-f1ef-4fed-ba1e-c124ffce66b5 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1750 microversion: 2.20 time: 0.495864 Oct 23 01:28:09.325203 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2058/4153] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:08 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1750 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:09.342798 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4255869b-0cc0-4198-8dba-8bb17c1dd44d tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc164c550>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:09.440186 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c45f58ee-c9c6-42ee-915d-87d7f963cb04 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:09.450301 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c45f58ee-c9c6-42ee-915d-87d7f963cb04 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:09.465434 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c45f58ee-c9c6-42ee-915d-87d7f963cb04 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:09.466856 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c45f58ee-c9c6-42ee-915d-87d7f963cb04 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] 10.222.0.42 "GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748" status: 200 len: 1365 microversion: 2.47 time: 0.490758 Oct 23 01:28:09.475094 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2096/4154] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:08 2022] GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748 => generated 1365 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:28:09.482533 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9e1b786c-dcc4-4c5f-84a0-0470369d4cb1 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:09.491860 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9e1b786c-dcc4-4c5f-84a0-0470369d4cb1 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:09.507288 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9e1b786c-dcc4-4c5f-84a0-0470369d4cb1 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:09.516332 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9e1b786c-dcc4-4c5f-84a0-0470369d4cb1 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:09.516972 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9e1b786c-dcc4-4c5f-84a0-0470369d4cb1 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:09.517885 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9e1b786c-dcc4-4c5f-84a0-0470369d4cb1 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:09.519069 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9e1b786c-dcc4-4c5f-84a0-0470369d4cb1 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:09.519968 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9e1b786c-dcc4-4c5f-84a0-0470369d4cb1 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:09.543236 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-9e1b786c-dcc4-4c5f-84a0-0470369d4cb1 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] HTTP exception thrown: Instance defa5fbb-f632-4ce7-8e07-e00f6f491d82 could not be found. Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9e1b786c-dcc4-4c5f-84a0-0470369d4cb1 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Request method failure captured: Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 HTTP/1.1 Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJbKcnJywbUj7_T4o_DttRoBDPr3lg1N_CrdcH39XDVVXeyWHwKf_PfHMSA_pyWdDdsOg8D1j-q-coP5m-DBMA5S_Vr2Px01aE3HNdOwPsEd1mTl6sj3yfbqbnTTDQ8kAiGZfSy06P6GBzzbaNjKpPFFkt3kdar7L2q1ON39coVwzOE Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: X-Openstack-Nova-Api-Version: 2.42 Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: a1f4adec8a4749a2bec19e7af0863059 Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1983383763 Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a1f4adec8a4749a2bec19e7af0863059"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a1f4adec8a4749a2bec19e7af0863059"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a1f4adec8a4749a2bec19e7af0863059"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a1f4adec8a4749a2bec19e7af0863059"}]}] Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1983383763 Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: a1f4adec8a4749a2bec19e7af0863059 Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1983383763 Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-TaggedBootDevicesTest_v242-1983383763-project Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 69bd8aff49524f19ae950f92d46bd44b Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1983383763-project Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: exception: Instance defa5fbb-f632-4ce7-8e07-e00f6f491d82 could not be found. Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'defa5fbb-f632-4ce7-8e07-e00f6f491d82'} Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance defa5fbb-f632-4ce7-8e07-e00f6f491d82 could not be found. Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance defa5fbb-f632-4ce7-8e07-e00f6f491d82 could not be found. Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:28:09.546283 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:28:09.550337 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:28:09.550337 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:28:09.550337 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:28:09.550337 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:28:09.550337 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:28:09.550337 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:28:09.550337 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance defa5fbb-f632-4ce7-8e07-e00f6f491d82 could not be found. Oct 23 01:28:09.550337 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:28:09.552191 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9e1b786c-dcc4-4c5f-84a0-0470369d4cb1 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Returning 404 to user: Instance defa5fbb-f632-4ce7-8e07-e00f6f491d82 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:28:09.553471 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9e1b786c-dcc4-4c5f-84a0-0470369d4cb1 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 404 len: 111 microversion: 2.42 time: 0.076901 Oct 23 01:28:09.555083 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2097/4155] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:09 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:28:09.560944 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5b9b0e71-11f8-4d6c-9633-fde38874d3f6 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:09.562115 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5b9b0e71-11f8-4d6c-9633-fde38874d3f6 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] [instance: 81baf1e0-bb30-4349-9f18-61057d045d99] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:09.575604 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b9b0e71-11f8-4d6c-9633-fde38874d3f6 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:09.580113 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b9b0e71-11f8-4d6c-9633-fde38874d3f6 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:09.580781 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b9b0e71-11f8-4d6c-9633-fde38874d3f6 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:09.583340 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b9b0e71-11f8-4d6c-9633-fde38874d3f6 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:09.588756 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b9b0e71-11f8-4d6c-9633-fde38874d3f6 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:09.591377 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b9b0e71-11f8-4d6c-9633-fde38874d3f6 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:09.842394 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5b9b0e71-11f8-4d6c-9633-fde38874d3f6 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ceb97b88e9411abd0d5882bf05027a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddcdc2e1f98450e8b7a6fbbe5a08b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:09.851980 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5b9b0e71-11f8-4d6c-9633-fde38874d3f6 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] 10.222.0.42 "GET /compute/v2.1/servers/81baf1e0-bb30-4349-9f18-61057d045d99" status: 200 len: 1275 microversion: 2.1 time: 0.295555 Oct 23 01:28:09.860487 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2098/4156] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:28:09 2022] GET /compute/v2.1/servers/81baf1e0-bb30-4349-9f18-61057d045d99 => generated 1275 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:28:09.883592 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b24b6d17-5966-4a68-8f66-4ecfc12d8f16 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '.version_select at 0x7f5cc19fe700>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:10.007220 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b24b6d17-5966-4a68-8f66-4ecfc12d8f16 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-990070396" status: 204 len: 0 microversion: 2.42 time: 0.144428 Oct 23 01:28:10.011433 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2099/4157] 10.222.0.42 () {60 vars in 1259 bytes} [Sun Oct 23 01:28:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-990070396 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 23 01:28:10.352742 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cfedc6bd-7ce8-42cb-b27c-654cec6697ea tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:10.354378 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-cfedc6bd-7ce8-42cb-b27c-654cec6697ea tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:10.371691 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cfedc6bd-7ce8-42cb-b27c-654cec6697ea tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:10.383261 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cfedc6bd-7ce8-42cb-b27c-654cec6697ea tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:10.383666 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cfedc6bd-7ce8-42cb-b27c-654cec6697ea tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:10.385004 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cfedc6bd-7ce8-42cb-b27c-654cec6697ea tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:10.385491 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cfedc6bd-7ce8-42cb-b27c-654cec6697ea tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:10.385923 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cfedc6bd-7ce8-42cb-b27c-654cec6697ea tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:11.567888 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cfedc6bd-7ce8-42cb-b27c-654cec6697ea tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:11.577407 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cfedc6bd-7ce8-42cb-b27c-654cec6697ea tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:11.592885 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cfedc6bd-7ce8-42cb-b27c-654cec6697ea tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:11.604086 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cfedc6bd-7ce8-42cb-b27c-654cec6697ea tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1750 microversion: 2.20 time: 1.255243 Oct 23 01:28:11.604686 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2100/4158] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:10 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1750 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:11.621592 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dd8eaea4-ae45-4666-907a-2359b8baf171 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:11.628568 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-dd8eaea4-ae45-4666-907a-2359b8baf171 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] [instance: b527a7c5-fec9-4b19-9bf0-b7f4aafa9748] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:11.665176 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd8eaea4-ae45-4666-907a-2359b8baf171 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:11.666651 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd8eaea4-ae45-4666-907a-2359b8baf171 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:11.667272 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd8eaea4-ae45-4666-907a-2359b8baf171 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:11.668144 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd8eaea4-ae45-4666-907a-2359b8baf171 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:11.668974 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd8eaea4-ae45-4666-907a-2359b8baf171 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:11.669564 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd8eaea4-ae45-4666-907a-2359b8baf171 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:11.884594 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-dd8eaea4-ae45-4666-907a-2359b8baf171 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:11.900466 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-dd8eaea4-ae45-4666-907a-2359b8baf171 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:11.902341 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-dd8eaea4-ae45-4666-907a-2359b8baf171 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:11.904509 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-dd8eaea4-ae45-4666-907a-2359b8baf171 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] 10.222.0.42 "GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748" status: 200 len: 1365 microversion: 2.47 time: 0.288600 Oct 23 01:28:11.908288 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2101/4159] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:11 2022] GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748 => generated 1365 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:11.928329 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7006dcb7-c823-493e-b7ca-003931247f45 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:11.928922 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7006dcb7-c823-493e-b7ca-003931247f45 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] [instance: 81baf1e0-bb30-4349-9f18-61057d045d99] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:11.957681 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7006dcb7-c823-493e-b7ca-003931247f45 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:11.958276 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7006dcb7-c823-493e-b7ca-003931247f45 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:11.958640 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7006dcb7-c823-493e-b7ca-003931247f45 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:11.959347 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7006dcb7-c823-493e-b7ca-003931247f45 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:11.960085 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7006dcb7-c823-493e-b7ca-003931247f45 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:11.960577 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7006dcb7-c823-493e-b7ca-003931247f45 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:12.361473 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7006dcb7-c823-493e-b7ca-003931247f45 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ceb97b88e9411abd0d5882bf05027a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddcdc2e1f98450e8b7a6fbbe5a08b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:12.375836 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7006dcb7-c823-493e-b7ca-003931247f45 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] 10.222.0.42 "GET /compute/v2.1/servers/81baf1e0-bb30-4349-9f18-61057d045d99" status: 200 len: 1317 microversion: 2.1 time: 0.456470 Oct 23 01:28:12.376435 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2102/4160] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:28:11 2022] GET /compute/v2.1/servers/81baf1e0-bb30-4349-9f18-61057d045d99 => generated 1317 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:28:12.631253 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3a1f4542-8b52-476e-a5e4-cf4bf61de87e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:12.632030 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3a1f4542-8b52-476e-a5e4-cf4bf61de87e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:12.647049 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3a1f4542-8b52-476e-a5e4-cf4bf61de87e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:12.647544 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3a1f4542-8b52-476e-a5e4-cf4bf61de87e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:12.652019 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3a1f4542-8b52-476e-a5e4-cf4bf61de87e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:12.654239 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3a1f4542-8b52-476e-a5e4-cf4bf61de87e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:12.655530 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3a1f4542-8b52-476e-a5e4-cf4bf61de87e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:12.658340 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3a1f4542-8b52-476e-a5e4-cf4bf61de87e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:13.343181 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3a1f4542-8b52-476e-a5e4-cf4bf61de87e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:13.364029 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3a1f4542-8b52-476e-a5e4-cf4bf61de87e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:13.365746 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3a1f4542-8b52-476e-a5e4-cf4bf61de87e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:13.367171 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3a1f4542-8b52-476e-a5e4-cf4bf61de87e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1750 microversion: 2.20 time: 0.740240 Oct 23 01:28:13.368259 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2103/4161] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:12 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1750 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:28:13.373938 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-25318384-aa48-406e-9960-8148ba2309f2 req-ad4ac7af-9aa0-4533-9beb-f74bb17b0d2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81baf1e0-bb30-4349-9f18-61057d045d99", "tag": "13f5d20f-6806-4c0f-ba3a-19dc3f195051"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:28:13.402214 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-25318384-aa48-406e-9960-8148ba2309f2 req-ad4ac7af-9aa0-4533-9beb-f74bb17b0d2f service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:13.403537 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-25318384-aa48-406e-9960-8148ba2309f2 req-ad4ac7af-9aa0-4533-9beb-f74bb17b0d2f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:13.419250 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-25318384-aa48-406e-9960-8148ba2309f2 req-ad4ac7af-9aa0-4533-9beb-f74bb17b0d2f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:13.451229 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-25318384-aa48-406e-9960-8148ba2309f2 req-ad4ac7af-9aa0-4533-9beb-f74bb17b0d2f service nova] Creating event network-changed:13f5d20f-6806-4c0f-ba3a-19dc3f195051 for instance 81baf1e0-bb30-4349-9f18-61057d045d99 on n-h1-master-1 Oct 23 01:28:13.457738 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-25318384-aa48-406e-9960-8148ba2309f2 req-ad4ac7af-9aa0-4533-9beb-f74bb17b0d2f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087213 Oct 23 01:28:13.459239 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2104/4162] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:28:13.466592 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-56ea33a0-2e91-4375-b8c3-04e7ec63007a tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:13.468131 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-56ea33a0-2e91-4375-b8c3-04e7ec63007a tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] [instance: b527a7c5-fec9-4b19-9bf0-b7f4aafa9748] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:13.474871 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-56ea33a0-2e91-4375-b8c3-04e7ec63007a tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:13.475632 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-56ea33a0-2e91-4375-b8c3-04e7ec63007a tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:13.476282 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-56ea33a0-2e91-4375-b8c3-04e7ec63007a tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:13.477181 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-56ea33a0-2e91-4375-b8c3-04e7ec63007a tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:13.478371 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-56ea33a0-2e91-4375-b8c3-04e7ec63007a tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:13.478988 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-56ea33a0-2e91-4375-b8c3-04e7ec63007a tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:13.602052 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-56ea33a0-2e91-4375-b8c3-04e7ec63007a tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:13.615651 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-56ea33a0-2e91-4375-b8c3-04e7ec63007a tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:13.620141 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-56ea33a0-2e91-4375-b8c3-04e7ec63007a tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:13.624184 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-56ea33a0-2e91-4375-b8c3-04e7ec63007a tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] 10.222.0.42 "GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748" status: 200 len: 1365 microversion: 2.47 time: 0.163272 Oct 23 01:28:13.626174 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2105/4163] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:13 2022] GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:13.636528 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-af152d45-4add-4872-be96-9e4a71d5ad15 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:13.640512 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-af152d45-4add-4872-be96-9e4a71d5ad15 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] [instance: 81baf1e0-bb30-4349-9f18-61057d045d99] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:13.652811 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-af152d45-4add-4872-be96-9e4a71d5ad15 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:13.658562 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-af152d45-4add-4872-be96-9e4a71d5ad15 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:13.659376 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-af152d45-4add-4872-be96-9e4a71d5ad15 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:13.660374 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-af152d45-4add-4872-be96-9e4a71d5ad15 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:13.661025 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-af152d45-4add-4872-be96-9e4a71d5ad15 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:13.664107 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-af152d45-4add-4872-be96-9e4a71d5ad15 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:13.949442 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:28:14.031009 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-af152d45-4add-4872-be96-9e4a71d5ad15 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ceb97b88e9411abd0d5882bf05027a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddcdc2e1f98450e8b7a6fbbe5a08b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:14.042879 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-af152d45-4add-4872-be96-9e4a71d5ad15 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] 10.222.0.42 "GET /compute/v2.1/servers/81baf1e0-bb30-4349-9f18-61057d045d99" status: 200 len: 1317 microversion: 2.1 time: 0.415361 Oct 23 01:28:14.043487 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2106/4164] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:28:13 2022] GET /compute/v2.1/servers/81baf1e0-bb30-4349-9f18-61057d045d99 => generated 1317 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:28:14.397747 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8b1543f2-8c3a-49d1-9850-388a6a9d05ff tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:14.398333 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8b1543f2-8c3a-49d1-9850-388a6a9d05ff tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:14.416810 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8b1543f2-8c3a-49d1-9850-388a6a9d05ff tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:14.417324 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8b1543f2-8c3a-49d1-9850-388a6a9d05ff tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:14.420414 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8b1543f2-8c3a-49d1-9850-388a6a9d05ff tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:14.420414 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8b1543f2-8c3a-49d1-9850-388a6a9d05ff tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:14.420414 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8b1543f2-8c3a-49d1-9850-388a6a9d05ff tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:14.420414 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8b1543f2-8c3a-49d1-9850-388a6a9d05ff tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:14.766219 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8b1543f2-8c3a-49d1-9850-388a6a9d05ff tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:14.783316 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8b1543f2-8c3a-49d1-9850-388a6a9d05ff tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:14.786508 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8b1543f2-8c3a-49d1-9850-388a6a9d05ff tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:14.791831 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8b1543f2-8c3a-49d1-9850-388a6a9d05ff tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1750 microversion: 2.20 time: 0.401158 Oct 23 01:28:14.792879 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2107/4165] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:14 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1750 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:28:14.800725 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-60114c6f-4e89-4525-a97f-5887fd826520 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:14.801569 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-60114c6f-4e89-4525-a97f-5887fd826520 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] [instance: b527a7c5-fec9-4b19-9bf0-b7f4aafa9748] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:14.809701 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-60114c6f-4e89-4525-a97f-5887fd826520 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:14.810465 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-60114c6f-4e89-4525-a97f-5887fd826520 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:14.811080 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-60114c6f-4e89-4525-a97f-5887fd826520 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:14.812263 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-60114c6f-4e89-4525-a97f-5887fd826520 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:14.812585 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-60114c6f-4e89-4525-a97f-5887fd826520 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:14.813185 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-60114c6f-4e89-4525-a97f-5887fd826520 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:15.090961 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-60114c6f-4e89-4525-a97f-5887fd826520 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:15.107915 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-60114c6f-4e89-4525-a97f-5887fd826520 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:15.109935 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-60114c6f-4e89-4525-a97f-5887fd826520 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:15.126710 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-60114c6f-4e89-4525-a97f-5887fd826520 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] 10.222.0.42 "GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748" status: 200 len: 1365 microversion: 2.47 time: 0.332027 Oct 23 01:28:15.128105 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2108/4166] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:14 2022] GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748 => generated 1365 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:15.133160 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-15b14e4d-fed4-4cc6-8910-e68a2404238c tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:15.152267 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-15b14e4d-fed4-4cc6-8910-e68a2404238c tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] [instance: 81baf1e0-bb30-4349-9f18-61057d045d99] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:15.171810 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15b14e4d-fed4-4cc6-8910-e68a2404238c tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:15.178956 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15b14e4d-fed4-4cc6-8910-e68a2404238c tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:15.179638 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15b14e4d-fed4-4cc6-8910-e68a2404238c tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:15.180529 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15b14e4d-fed4-4cc6-8910-e68a2404238c tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:15.181188 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15b14e4d-fed4-4cc6-8910-e68a2404238c tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:15.181622 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15b14e4d-fed4-4cc6-8910-e68a2404238c tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:15.223583 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=20 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:28:15.772302 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-15b14e4d-fed4-4cc6-8910-e68a2404238c tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ceb97b88e9411abd0d5882bf05027a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddcdc2e1f98450e8b7a6fbbe5a08b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:15.795139 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-15b14e4d-fed4-4cc6-8910-e68a2404238c tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] 10.222.0.42 "GET /compute/v2.1/servers/81baf1e0-bb30-4349-9f18-61057d045d99" status: 200 len: 1317 microversion: 2.1 time: 0.656338 Oct 23 01:28:15.795139 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2109/4167] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:28:15 2022] GET /compute/v2.1/servers/81baf1e0-bb30-4349-9f18-61057d045d99 => generated 1317 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:28:15.833398 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0da541f8-019c-42de-9128-72fd2fd10d3f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:15.834054 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0da541f8-019c-42de-9128-72fd2fd10d3f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:15.848144 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0da541f8-019c-42de-9128-72fd2fd10d3f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:15.850010 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0da541f8-019c-42de-9128-72fd2fd10d3f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:15.856134 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0da541f8-019c-42de-9128-72fd2fd10d3f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:15.857304 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0da541f8-019c-42de-9128-72fd2fd10d3f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:15.857936 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0da541f8-019c-42de-9128-72fd2fd10d3f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:15.858546 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0da541f8-019c-42de-9128-72fd2fd10d3f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:15.940348 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:28:16.298764 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0da541f8-019c-42de-9128-72fd2fd10d3f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:16.310821 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0da541f8-019c-42de-9128-72fd2fd10d3f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:16.513185 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0da541f8-019c-42de-9128-72fd2fd10d3f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:16.513185 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0da541f8-019c-42de-9128-72fd2fd10d3f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1750 microversion: 2.20 time: 0.493178 Oct 23 01:28:16.513185 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2110/4168] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:15 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1750 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:28:16.513185 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ac426a81-ffb5-4dc0-ba11-6367a232c924 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:16.513185 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ac426a81-ffb5-4dc0-ba11-6367a232c924 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] [instance: b527a7c5-fec9-4b19-9bf0-b7f4aafa9748] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:16.513185 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac426a81-ffb5-4dc0-ba11-6367a232c924 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:16.513185 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac426a81-ffb5-4dc0-ba11-6367a232c924 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:16.513185 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac426a81-ffb5-4dc0-ba11-6367a232c924 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:16.513185 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac426a81-ffb5-4dc0-ba11-6367a232c924 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:16.513185 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac426a81-ffb5-4dc0-ba11-6367a232c924 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:16.513185 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac426a81-ffb5-4dc0-ba11-6367a232c924 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:16.513185 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ac426a81-ffb5-4dc0-ba11-6367a232c924 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:16.528165 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ac426a81-ffb5-4dc0-ba11-6367a232c924 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:16.532648 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ac426a81-ffb5-4dc0-ba11-6367a232c924 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:16.535827 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ac426a81-ffb5-4dc0-ba11-6367a232c924 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] 10.222.0.42 "GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748" status: 200 len: 1365 microversion: 2.47 time: 0.212100 Oct 23 01:28:16.560140 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2111/4169] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:16 2022] GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748 => generated 1365 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:16.812452 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-342548fb-dd6e-4723-8efa-7fbe5dec3675 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:16.860220 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-342548fb-dd6e-4723-8efa-7fbe5dec3675 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] [instance: 81baf1e0-bb30-4349-9f18-61057d045d99] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:16.860220 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-342548fb-dd6e-4723-8efa-7fbe5dec3675 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:16.860220 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-342548fb-dd6e-4723-8efa-7fbe5dec3675 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:16.860220 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-342548fb-dd6e-4723-8efa-7fbe5dec3675 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:16.860220 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-342548fb-dd6e-4723-8efa-7fbe5dec3675 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:16.860220 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-342548fb-dd6e-4723-8efa-7fbe5dec3675 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:16.860220 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-342548fb-dd6e-4723-8efa-7fbe5dec3675 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:16.999115 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-342548fb-dd6e-4723-8efa-7fbe5dec3675 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ceb97b88e9411abd0d5882bf05027a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddcdc2e1f98450e8b7a6fbbe5a08b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:17.008001 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-342548fb-dd6e-4723-8efa-7fbe5dec3675 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] 10.222.0.42 "GET /compute/v2.1/servers/81baf1e0-bb30-4349-9f18-61057d045d99" status: 200 len: 1317 microversion: 2.1 time: 0.198856 Oct 23 01:28:17.022261 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2112/4170] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:28:16 2022] GET /compute/v2.1/servers/81baf1e0-bb30-4349-9f18-61057d045d99 => generated 1317 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:28:17.356034 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c10187e7-703b-40f4-bcc3-16f629b11c52 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:17.358313 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c10187e7-703b-40f4-bcc3-16f629b11c52 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:17.377143 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c10187e7-703b-40f4-bcc3-16f629b11c52 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:17.378189 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c10187e7-703b-40f4-bcc3-16f629b11c52 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:17.378808 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c10187e7-703b-40f4-bcc3-16f629b11c52 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:17.380437 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c10187e7-703b-40f4-bcc3-16f629b11c52 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:17.381090 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c10187e7-703b-40f4-bcc3-16f629b11c52 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:17.381687 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c10187e7-703b-40f4-bcc3-16f629b11c52 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:18.012690 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c10187e7-703b-40f4-bcc3-16f629b11c52 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:18.030799 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c10187e7-703b-40f4-bcc3-16f629b11c52 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:18.034811 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c10187e7-703b-40f4-bcc3-16f629b11c52 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:18.037045 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c10187e7-703b-40f4-bcc3-16f629b11c52 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1750 microversion: 2.20 time: 0.691232 Oct 23 01:28:18.064053 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2113/4171] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:17 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1750 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:18.075047 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-073328f1-6467-4f49-a3d5-eb2d93088ed7 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:18.079192 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-073328f1-6467-4f49-a3d5-eb2d93088ed7 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] [instance: b527a7c5-fec9-4b19-9bf0-b7f4aafa9748] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:18.095822 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-073328f1-6467-4f49-a3d5-eb2d93088ed7 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:18.099828 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-073328f1-6467-4f49-a3d5-eb2d93088ed7 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:18.099828 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-073328f1-6467-4f49-a3d5-eb2d93088ed7 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:18.099828 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-073328f1-6467-4f49-a3d5-eb2d93088ed7 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:18.099828 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-073328f1-6467-4f49-a3d5-eb2d93088ed7 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:18.099828 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-073328f1-6467-4f49-a3d5-eb2d93088ed7 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:18.284400 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-073328f1-6467-4f49-a3d5-eb2d93088ed7 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:18.300972 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-073328f1-6467-4f49-a3d5-eb2d93088ed7 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:18.318126 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-073328f1-6467-4f49-a3d5-eb2d93088ed7 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:18.318126 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-073328f1-6467-4f49-a3d5-eb2d93088ed7 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] 10.222.0.42 "GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748" status: 200 len: 1365 microversion: 2.47 time: 0.252255 Oct 23 01:28:18.328196 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2114/4172] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:18 2022] GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748 => generated 1365 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:18.357454 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4ec7fef7-a196-4151-a7ff-7a17a6e21d34 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:18.358543 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4ec7fef7-a196-4151-a7ff-7a17a6e21d34 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] [instance: 81baf1e0-bb30-4349-9f18-61057d045d99] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:18.367010 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4ec7fef7-a196-4151-a7ff-7a17a6e21d34 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:18.367925 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4ec7fef7-a196-4151-a7ff-7a17a6e21d34 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:18.369158 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4ec7fef7-a196-4151-a7ff-7a17a6e21d34 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:18.370163 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4ec7fef7-a196-4151-a7ff-7a17a6e21d34 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:18.371108 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4ec7fef7-a196-4151-a7ff-7a17a6e21d34 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:18.371774 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4ec7fef7-a196-4151-a7ff-7a17a6e21d34 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:18.688494 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4ec7fef7-a196-4151-a7ff-7a17a6e21d34 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ceb97b88e9411abd0d5882bf05027a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddcdc2e1f98450e8b7a6fbbe5a08b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:18.704348 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4ec7fef7-a196-4151-a7ff-7a17a6e21d34 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] 10.222.0.42 "GET /compute/v2.1/servers/81baf1e0-bb30-4349-9f18-61057d045d99" status: 200 len: 1317 microversion: 2.1 time: 0.361866 Oct 23 01:28:18.719431 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2115/4173] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:28:18 2022] GET /compute/v2.1/servers/81baf1e0-bb30-4349-9f18-61057d045d99 => generated 1317 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:28:18.841992 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:28:19.069006 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6766351d-7570-491d-b1f1-32a0673658cc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:19.071375 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6766351d-7570-491d-b1f1-32a0673658cc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:19.084576 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6766351d-7570-491d-b1f1-32a0673658cc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:19.087656 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6766351d-7570-491d-b1f1-32a0673658cc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:19.088816 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6766351d-7570-491d-b1f1-32a0673658cc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:19.091195 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6766351d-7570-491d-b1f1-32a0673658cc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:19.093081 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6766351d-7570-491d-b1f1-32a0673658cc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:19.095085 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6766351d-7570-491d-b1f1-32a0673658cc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:19.287218 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=58 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:28:19.438047 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6766351d-7570-491d-b1f1-32a0673658cc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:19.457882 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6766351d-7570-491d-b1f1-32a0673658cc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:19.460937 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6766351d-7570-491d-b1f1-32a0673658cc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:19.466922 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6766351d-7570-491d-b1f1-32a0673658cc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1750 microversion: 2.20 time: 0.401880 Oct 23 01:28:19.496372 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2116/4174] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:19 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1750 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:19.505094 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4f5e3d0a-3f02-4a08-b07a-b95433ac9a47 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:19.512593 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4f5e3d0a-3f02-4a08-b07a-b95433ac9a47 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] [instance: b527a7c5-fec9-4b19-9bf0-b7f4aafa9748] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:19.522128 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f5e3d0a-3f02-4a08-b07a-b95433ac9a47 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:19.527075 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f5e3d0a-3f02-4a08-b07a-b95433ac9a47 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:19.527722 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f5e3d0a-3f02-4a08-b07a-b95433ac9a47 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:19.532909 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f5e3d0a-3f02-4a08-b07a-b95433ac9a47 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:19.533923 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f5e3d0a-3f02-4a08-b07a-b95433ac9a47 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:19.534829 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f5e3d0a-3f02-4a08-b07a-b95433ac9a47 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:19.827884 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4f5e3d0a-3f02-4a08-b07a-b95433ac9a47 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:19.844859 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4f5e3d0a-3f02-4a08-b07a-b95433ac9a47 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:19.852708 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4f5e3d0a-3f02-4a08-b07a-b95433ac9a47 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:19.854317 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4f5e3d0a-3f02-4a08-b07a-b95433ac9a47 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] 10.222.0.42 "GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748" status: 200 len: 1365 microversion: 2.47 time: 0.356556 Oct 23 01:28:19.860136 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2117/4175] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:19 2022] GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748 => generated 1365 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:19.871361 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0c63d855-023d-43a6-b6e2-96c08abee773 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:19.873152 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0c63d855-023d-43a6-b6e2-96c08abee773 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] [instance: 81baf1e0-bb30-4349-9f18-61057d045d99] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:19.891273 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0c63d855-023d-43a6-b6e2-96c08abee773 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:19.895399 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0c63d855-023d-43a6-b6e2-96c08abee773 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:19.896066 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0c63d855-023d-43a6-b6e2-96c08abee773 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:19.897330 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0c63d855-023d-43a6-b6e2-96c08abee773 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:19.898511 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0c63d855-023d-43a6-b6e2-96c08abee773 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:19.900105 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0c63d855-023d-43a6-b6e2-96c08abee773 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:20.410994 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0c63d855-023d-43a6-b6e2-96c08abee773 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ceb97b88e9411abd0d5882bf05027a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddcdc2e1f98450e8b7a6fbbe5a08b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:20.424497 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0c63d855-023d-43a6-b6e2-96c08abee773 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] 10.222.0.42 "GET /compute/v2.1/servers/81baf1e0-bb30-4349-9f18-61057d045d99" status: 200 len: 1317 microversion: 2.1 time: 0.562591 Oct 23 01:28:20.425641 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2118/4176] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:28:19 2022] GET /compute/v2.1/servers/81baf1e0-bb30-4349-9f18-61057d045d99 => generated 1317 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:28:20.500806 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0aefbdd3-3459-47de-81d4-35d10cc5c67a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:20.501537 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0aefbdd3-3459-47de-81d4-35d10cc5c67a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:20.519378 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0aefbdd3-3459-47de-81d4-35d10cc5c67a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:20.519378 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0aefbdd3-3459-47de-81d4-35d10cc5c67a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:20.519378 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0aefbdd3-3459-47de-81d4-35d10cc5c67a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:20.519378 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0aefbdd3-3459-47de-81d4-35d10cc5c67a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:20.519378 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0aefbdd3-3459-47de-81d4-35d10cc5c67a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:20.519378 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0aefbdd3-3459-47de-81d4-35d10cc5c67a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:21.404830 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0aefbdd3-3459-47de-81d4-35d10cc5c67a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:21.414738 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0aefbdd3-3459-47de-81d4-35d10cc5c67a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:21.416747 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0aefbdd3-3459-47de-81d4-35d10cc5c67a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:21.417952 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0aefbdd3-3459-47de-81d4-35d10cc5c67a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1750 microversion: 2.20 time: 0.921714 Oct 23 01:28:21.442881 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2119/4177] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:20 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1750 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:21.446864 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2c348b24-86af-409a-b26d-4a97011d8662 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:21.447809 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2c348b24-86af-409a-b26d-4a97011d8662 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] [instance: b527a7c5-fec9-4b19-9bf0-b7f4aafa9748] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:21.457119 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2c348b24-86af-409a-b26d-4a97011d8662 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:21.477643 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2c348b24-86af-409a-b26d-4a97011d8662 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:21.478471 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2c348b24-86af-409a-b26d-4a97011d8662 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:21.479732 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2c348b24-86af-409a-b26d-4a97011d8662 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:21.480395 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2c348b24-86af-409a-b26d-4a97011d8662 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:21.481034 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2c348b24-86af-409a-b26d-4a97011d8662 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:21.626314 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2c348b24-86af-409a-b26d-4a97011d8662 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:21.640043 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2c348b24-86af-409a-b26d-4a97011d8662 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:21.641883 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2c348b24-86af-409a-b26d-4a97011d8662 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:21.646341 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2c348b24-86af-409a-b26d-4a97011d8662 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] 10.222.0.42 "GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748" status: 200 len: 1365 microversion: 2.47 time: 0.206589 Oct 23 01:28:21.662383 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2120/4178] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:21 2022] GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748 => generated 1365 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:21.737379 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-e0d73f16-809d-4295-b37e-39b9d5781a8e req-ce3ffa12-c505-4057-86f6-0cbe98faead7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81baf1e0-bb30-4349-9f18-61057d045d99", "name": "network-vif-plugged", "status": "completed", "tag": "13f5d20f-6806-4c0f-ba3a-19dc3f195051"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:28:21.774311 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-e0d73f16-809d-4295-b37e-39b9d5781a8e req-ce3ffa12-c505-4057-86f6-0cbe98faead7 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:21.795763 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-e0d73f16-809d-4295-b37e-39b9d5781a8e req-ce3ffa12-c505-4057-86f6-0cbe98faead7 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:21.795763 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-e0d73f16-809d-4295-b37e-39b9d5781a8e req-ce3ffa12-c505-4057-86f6-0cbe98faead7 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:21.850744 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-e0d73f16-809d-4295-b37e-39b9d5781a8e req-ce3ffa12-c505-4057-86f6-0cbe98faead7 service nova] Creating event network-vif-plugged:13f5d20f-6806-4c0f-ba3a-19dc3f195051 for instance 81baf1e0-bb30-4349-9f18-61057d045d99 on n-h1-master-1 Oct 23 01:28:21.890010 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-e0d73f16-809d-4295-b37e-39b9d5781a8e req-ce3ffa12-c505-4057-86f6-0cbe98faead7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.224564 Oct 23 01:28:21.892434 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2121/4179] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:28:21.904785 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6e1d9534-f6fe-445a-b8c8-33f21ca72b6f tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:21.906207 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6e1d9534-f6fe-445a-b8c8-33f21ca72b6f tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] [instance: 81baf1e0-bb30-4349-9f18-61057d045d99] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:21.924690 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6e1d9534-f6fe-445a-b8c8-33f21ca72b6f tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:21.926030 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6e1d9534-f6fe-445a-b8c8-33f21ca72b6f tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:21.927311 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6e1d9534-f6fe-445a-b8c8-33f21ca72b6f tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:21.929192 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6e1d9534-f6fe-445a-b8c8-33f21ca72b6f tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:21.930062 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6e1d9534-f6fe-445a-b8c8-33f21ca72b6f tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:21.931712 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6e1d9534-f6fe-445a-b8c8-33f21ca72b6f tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:22.209639 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6e1d9534-f6fe-445a-b8c8-33f21ca72b6f tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ceb97b88e9411abd0d5882bf05027a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddcdc2e1f98450e8b7a6fbbe5a08b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:22.242813 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6e1d9534-f6fe-445a-b8c8-33f21ca72b6f tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] 10.222.0.42 "GET /compute/v2.1/servers/81baf1e0-bb30-4349-9f18-61057d045d99" status: 200 len: 1317 microversion: 2.1 time: 0.344897 Oct 23 01:28:22.242813 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2122/4180] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:28:21 2022] GET /compute/v2.1/servers/81baf1e0-bb30-4349-9f18-61057d045d99 => generated 1317 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:28:22.452865 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f0a619eb-128a-4bf8-8b25-fd51144195e8 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:22.453497 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f0a619eb-128a-4bf8-8b25-fd51144195e8 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:22.476375 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f0a619eb-128a-4bf8-8b25-fd51144195e8 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:22.476873 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f0a619eb-128a-4bf8-8b25-fd51144195e8 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:22.477835 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f0a619eb-128a-4bf8-8b25-fd51144195e8 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:22.478575 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f0a619eb-128a-4bf8-8b25-fd51144195e8 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:22.479027 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f0a619eb-128a-4bf8-8b25-fd51144195e8 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:22.479510 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f0a619eb-128a-4bf8-8b25-fd51144195e8 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:22.520129 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-f0a619eb-128a-4bf8-8b25-fd51144195e8 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] HTTP exception thrown: Instance defa5fbb-f632-4ce7-8e07-e00f6f491d82 could not be found. Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f0a619eb-128a-4bf8-8b25-fd51144195e8 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Request method failure captured: Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 HTTP/1.1 Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJbKcnJywbUj7_T4o_DttRoBDPr3lg1N_CrdcH39XDVVXeyWHwKf_PfHMSA_pyWdDdsOg8D1j-q-coP5m-DBMA5S_Vr2Px01aE3HNdOwPsEd1mTl6sj3yfbqbnTTDQ8kAiGZfSy06P6GBzzbaNjKpPFFkt3kdar7L2q1ON39coVwzOE Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: X-Openstack-Nova-Api-Version: 2.42 Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: a1f4adec8a4749a2bec19e7af0863059 Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1983383763 Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a1f4adec8a4749a2bec19e7af0863059"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a1f4adec8a4749a2bec19e7af0863059"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a1f4adec8a4749a2bec19e7af0863059"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a1f4adec8a4749a2bec19e7af0863059"}]}] Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1983383763 Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: a1f4adec8a4749a2bec19e7af0863059 Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1983383763 Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-TaggedBootDevicesTest_v242-1983383763-project Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 69bd8aff49524f19ae950f92d46bd44b Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1983383763-project Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: exception: Instance defa5fbb-f632-4ce7-8e07-e00f6f491d82 could not be found. Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'defa5fbb-f632-4ce7-8e07-e00f6f491d82'} Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance defa5fbb-f632-4ce7-8e07-e00f6f491d82 could not be found. Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:28:22.522528 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:28:22.526514 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance defa5fbb-f632-4ce7-8e07-e00f6f491d82 could not be found. Oct 23 01:28:22.526514 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:28:22.526514 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:28:22.526514 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:28:22.526514 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:28:22.526514 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:28:22.526514 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:28:22.526514 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:28:22.526514 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:28:22.526514 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance defa5fbb-f632-4ce7-8e07-e00f6f491d82 could not be found. Oct 23 01:28:22.526514 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:28:22.537913 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f0a619eb-128a-4bf8-8b25-fd51144195e8 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Returning 404 to user: Instance defa5fbb-f632-4ce7-8e07-e00f6f491d82 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:28:22.539243 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f0a619eb-128a-4bf8-8b25-fd51144195e8 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "DELETE /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 404 len: 111 microversion: 2.42 time: 0.098805 Oct 23 01:28:22.540863 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2123/4181] 10.222.0.42 () {60 vars in 1280 bytes} [Sun Oct 23 01:28:22 2022] DELETE /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:28:22.545959 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-91846952-cc8f-48f0-a8d7-97c09cb35ac5 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:22.546912 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-91846952-cc8f-48f0-a8d7-97c09cb35ac5 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:22.553555 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-91846952-cc8f-48f0-a8d7-97c09cb35ac5 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:22.554435 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-91846952-cc8f-48f0-a8d7-97c09cb35ac5 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:22.559933 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-91846952-cc8f-48f0-a8d7-97c09cb35ac5 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:22.559933 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-91846952-cc8f-48f0-a8d7-97c09cb35ac5 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:22.559933 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-91846952-cc8f-48f0-a8d7-97c09cb35ac5 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:22.559933 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-91846952-cc8f-48f0-a8d7-97c09cb35ac5 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:22.792875 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-91846952-cc8f-48f0-a8d7-97c09cb35ac5 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:22.803324 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-91846952-cc8f-48f0-a8d7-97c09cb35ac5 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:22.805052 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-91846952-cc8f-48f0-a8d7-97c09cb35ac5 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:22.806854 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-91846952-cc8f-48f0-a8d7-97c09cb35ac5 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1806 microversion: 2.20 time: 0.264700 Oct 23 01:28:22.825898 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2124/4182] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:22 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1806 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:22.831096 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5286e3d9-20dc-4a53-bf4c-cf521dba3663 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:22.831739 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5286e3d9-20dc-4a53-bf4c-cf521dba3663 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] [instance: defa5fbb-f632-4ce7-8e07-e00f6f491d82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:22.850622 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5286e3d9-20dc-4a53-bf4c-cf521dba3663 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:22.851129 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5286e3d9-20dc-4a53-bf4c-cf521dba3663 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:22.851577 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5286e3d9-20dc-4a53-bf4c-cf521dba3663 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:22.852332 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5286e3d9-20dc-4a53-bf4c-cf521dba3663 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:22.852800 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5286e3d9-20dc-4a53-bf4c-cf521dba3663 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:22.853264 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5286e3d9-20dc-4a53-bf4c-cf521dba3663 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:22.880417 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-5286e3d9-20dc-4a53-bf4c-cf521dba3663 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] HTTP exception thrown: Instance defa5fbb-f632-4ce7-8e07-e00f6f491d82 could not be found. Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5286e3d9-20dc-4a53-bf4c-cf521dba3663 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Request method failure captured: Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 HTTP/1.1 Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJbKcnJywbUj7_T4o_DttRoBDPr3lg1N_CrdcH39XDVVXeyWHwKf_PfHMSA_pyWdDdsOg8D1j-q-coP5m-DBMA5S_Vr2Px01aE3HNdOwPsEd1mTl6sj3yfbqbnTTDQ8kAiGZfSy06P6GBzzbaNjKpPFFkt3kdar7L2q1ON39coVwzOE Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: X-Openstack-Nova-Api-Version: 2.42 Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: a1f4adec8a4749a2bec19e7af0863059 Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1983383763 Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a1f4adec8a4749a2bec19e7af0863059"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a1f4adec8a4749a2bec19e7af0863059"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a1f4adec8a4749a2bec19e7af0863059"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a1f4adec8a4749a2bec19e7af0863059"}]}] Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1983383763 Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: a1f4adec8a4749a2bec19e7af0863059 Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1983383763 Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-TaggedBootDevicesTest_v242-1983383763-project Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 69bd8aff49524f19ae950f92d46bd44b Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1983383763-project Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: exception: Instance defa5fbb-f632-4ce7-8e07-e00f6f491d82 could not be found. Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'defa5fbb-f632-4ce7-8e07-e00f6f491d82'} Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance defa5fbb-f632-4ce7-8e07-e00f6f491d82 could not be found. Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance defa5fbb-f632-4ce7-8e07-e00f6f491d82 could not be found. Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:28:22.883234 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:28:22.887852 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:28:22.887852 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:28:22.887852 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:28:22.887852 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:28:22.887852 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:28:22.887852 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:28:22.887852 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance defa5fbb-f632-4ce7-8e07-e00f6f491d82 could not be found. Oct 23 01:28:22.887852 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:28:22.887852 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5286e3d9-20dc-4a53-bf4c-cf521dba3663 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] Returning 404 to user: Instance defa5fbb-f632-4ce7-8e07-e00f6f491d82 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:28:22.887852 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5286e3d9-20dc-4a53-bf4c-cf521dba3663 tempest-TaggedBootDevicesTest_v242-1983383763 tempest-TaggedBootDevicesTest_v242-1983383763-project] 10.222.0.42 "GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82" status: 404 len: 111 microversion: 2.42 time: 0.057411 Oct 23 01:28:22.888556 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2125/4183] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:22 2022] GET /compute/v2.1/servers/defa5fbb-f632-4ce7-8e07-e00f6f491d82 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:28:22.893629 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b50ae543-dc09-4aef-85f5-1ba7815ec6f6 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:22.894298 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b50ae543-dc09-4aef-85f5-1ba7815ec6f6 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] [instance: b527a7c5-fec9-4b19-9bf0-b7f4aafa9748] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:22.910658 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b50ae543-dc09-4aef-85f5-1ba7815ec6f6 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:22.910658 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b50ae543-dc09-4aef-85f5-1ba7815ec6f6 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:22.910658 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b50ae543-dc09-4aef-85f5-1ba7815ec6f6 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:22.910658 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b50ae543-dc09-4aef-85f5-1ba7815ec6f6 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:22.910658 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b50ae543-dc09-4aef-85f5-1ba7815ec6f6 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:22.910658 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b50ae543-dc09-4aef-85f5-1ba7815ec6f6 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:23.023194 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b50ae543-dc09-4aef-85f5-1ba7815ec6f6 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:23.039646 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b50ae543-dc09-4aef-85f5-1ba7815ec6f6 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:23.044764 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b50ae543-dc09-4aef-85f5-1ba7815ec6f6 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:23.054240 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b50ae543-dc09-4aef-85f5-1ba7815ec6f6 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] 10.222.0.42 "GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748" status: 200 len: 1365 microversion: 2.47 time: 0.159077 Oct 23 01:28:23.056511 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2126/4184] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:22 2022] GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:23.263720 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-df92a0c9-8eef-478c-98dd-4129ae4f90ff tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:23.264416 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-df92a0c9-8eef-478c-98dd-4129ae4f90ff tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] [instance: 81baf1e0-bb30-4349-9f18-61057d045d99] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:23.286035 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-df92a0c9-8eef-478c-98dd-4129ae4f90ff tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:23.286035 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-df92a0c9-8eef-478c-98dd-4129ae4f90ff tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:23.286035 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-df92a0c9-8eef-478c-98dd-4129ae4f90ff tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:23.286383 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-df92a0c9-8eef-478c-98dd-4129ae4f90ff tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:23.287077 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-df92a0c9-8eef-478c-98dd-4129ae4f90ff tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:23.287194 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-df92a0c9-8eef-478c-98dd-4129ae4f90ff tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:23.905315 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-df92a0c9-8eef-478c-98dd-4129ae4f90ff tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ceb97b88e9411abd0d5882bf05027a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddcdc2e1f98450e8b7a6fbbe5a08b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:23.916533 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-df92a0c9-8eef-478c-98dd-4129ae4f90ff tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] 10.222.0.42 "GET /compute/v2.1/servers/81baf1e0-bb30-4349-9f18-61057d045d99" status: 200 len: 1317 microversion: 2.1 time: 0.657543 Oct 23 01:28:23.921448 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2127/4185] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:28:23 2022] GET /compute/v2.1/servers/81baf1e0-bb30-4349-9f18-61057d045d99 => generated 1317 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:28:23.928721 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-18a4ad76-8969-4c90-b072-342fd55f33fc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:23.933198 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-18a4ad76-8969-4c90-b072-342fd55f33fc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:23.945532 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18a4ad76-8969-4c90-b072-342fd55f33fc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:23.946122 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18a4ad76-8969-4c90-b072-342fd55f33fc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:23.946572 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18a4ad76-8969-4c90-b072-342fd55f33fc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:23.947283 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18a4ad76-8969-4c90-b072-342fd55f33fc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:23.947744 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18a4ad76-8969-4c90-b072-342fd55f33fc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:23.948329 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18a4ad76-8969-4c90-b072-342fd55f33fc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:24.285235 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-18a4ad76-8969-4c90-b072-342fd55f33fc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:24.302663 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-18a4ad76-8969-4c90-b072-342fd55f33fc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:24.309334 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-18a4ad76-8969-4c90-b072-342fd55f33fc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:24.310867 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-18a4ad76-8969-4c90-b072-342fd55f33fc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1806 microversion: 2.20 time: 0.388109 Oct 23 01:28:24.314416 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2128/4186] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:23 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1806 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:24.325909 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7ebe332d-b19a-431b-b997-1ae84914eb72 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:24.327039 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7ebe332d-b19a-431b-b997-1ae84914eb72 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] [instance: b527a7c5-fec9-4b19-9bf0-b7f4aafa9748] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:24.334868 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ebe332d-b19a-431b-b997-1ae84914eb72 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:24.335881 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ebe332d-b19a-431b-b997-1ae84914eb72 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:24.336368 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ebe332d-b19a-431b-b997-1ae84914eb72 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:24.337946 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ebe332d-b19a-431b-b997-1ae84914eb72 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:24.338552 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ebe332d-b19a-431b-b997-1ae84914eb72 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:24.339098 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ebe332d-b19a-431b-b997-1ae84914eb72 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:24.345231 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=100 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:28:24.718025 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7ebe332d-b19a-431b-b997-1ae84914eb72 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:24.732450 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7ebe332d-b19a-431b-b997-1ae84914eb72 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:24.733937 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7ebe332d-b19a-431b-b997-1ae84914eb72 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:24.741237 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7ebe332d-b19a-431b-b997-1ae84914eb72 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] 10.222.0.42 "GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748" status: 200 len: 1365 microversion: 2.47 time: 0.425656 Oct 23 01:28:24.742072 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2129/4187] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:24 2022] GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748 => generated 1365 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:24.947528 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e714e182-fcb7-48d2-8197-df30d581198a tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:24.948206 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e714e182-fcb7-48d2-8197-df30d581198a tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] [instance: 81baf1e0-bb30-4349-9f18-61057d045d99] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:24.959996 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e714e182-fcb7-48d2-8197-df30d581198a tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:24.960575 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e714e182-fcb7-48d2-8197-df30d581198a tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:24.961270 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e714e182-fcb7-48d2-8197-df30d581198a tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:24.968467 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e714e182-fcb7-48d2-8197-df30d581198a tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:24.969008 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e714e182-fcb7-48d2-8197-df30d581198a tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:24.969458 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e714e182-fcb7-48d2-8197-df30d581198a tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:25.240661 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e714e182-fcb7-48d2-8197-df30d581198a tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ceb97b88e9411abd0d5882bf05027a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddcdc2e1f98450e8b7a6fbbe5a08b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:25.253710 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e714e182-fcb7-48d2-8197-df30d581198a tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] 10.222.0.42 "GET /compute/v2.1/servers/81baf1e0-bb30-4349-9f18-61057d045d99" status: 200 len: 1504 microversion: 2.1 time: 0.311155 Oct 23 01:28:25.267681 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2130/4188] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:28:24 2022] GET /compute/v2.1/servers/81baf1e0-bb30-4349-9f18-61057d045d99 => generated 1504 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:28:25.288097 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-974dbd71-d70a-4623-864f-f921e6215bc1 req-19a55157-2cd5-4eeb-ab4c-01cac694df32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6eb59b7-d1ee-442c-8142-19a88ad6a039", "tag": "82e540c0-e210-47a2-a17d-495549fe7222"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:28:25.298994 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-974dbd71-d70a-4623-864f-f921e6215bc1 req-19a55157-2cd5-4eeb-ab4c-01cac694df32 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:25.299487 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-974dbd71-d70a-4623-864f-f921e6215bc1 req-19a55157-2cd5-4eeb-ab4c-01cac694df32 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:25.300215 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-974dbd71-d70a-4623-864f-f921e6215bc1 req-19a55157-2cd5-4eeb-ab4c-01cac694df32 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:25.327977 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-974dbd71-d70a-4623-864f-f921e6215bc1 req-19a55157-2cd5-4eeb-ab4c-01cac694df32 service nova] Creating event network-changed:82e540c0-e210-47a2-a17d-495549fe7222 for instance c6eb59b7-d1ee-442c-8142-19a88ad6a039 on n-h2-master-1 Oct 23 01:28:25.344991 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-974dbd71-d70a-4623-864f-f921e6215bc1 req-19a55157-2cd5-4eeb-ab4c-01cac694df32 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075770 Oct 23 01:28:25.346080 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2131/4189] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:28:25.362689 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3d3a837b-118e-4ff7-a7d9-103201128144 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:25.363292 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3d3a837b-118e-4ff7-a7d9-103201128144 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] [instance: 81baf1e0-bb30-4349-9f18-61057d045d99] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:25.378823 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d3a837b-118e-4ff7-a7d9-103201128144 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:25.379321 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d3a837b-118e-4ff7-a7d9-103201128144 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:25.379913 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d3a837b-118e-4ff7-a7d9-103201128144 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:25.381043 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d3a837b-118e-4ff7-a7d9-103201128144 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:25.381509 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d3a837b-118e-4ff7-a7d9-103201128144 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:25.381942 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d3a837b-118e-4ff7-a7d9-103201128144 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:25.453085 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3d3a837b-118e-4ff7-a7d9-103201128144 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] 10.222.0.42 "GET /compute/v2.1/servers/81baf1e0-bb30-4349-9f18-61057d045d99/ips" status: 200 len: 107 microversion: 2.1 time: 0.104003 Oct 23 01:28:25.461879 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2132/4190] 10.222.0.42 () {58 vars in 1248 bytes} [Sun Oct 23 01:28:25 2022] GET /compute/v2.1/servers/81baf1e0-bb30-4349-9f18-61057d045d99/ips => generated 107 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:28:25.483043 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fe0d3873-648f-4fc5-aa0c-c44e33e8be72 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:25.483679 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fe0d3873-648f-4fc5-aa0c-c44e33e8be72 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:25.503355 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe0d3873-648f-4fc5-aa0c-c44e33e8be72 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:25.507270 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe0d3873-648f-4fc5-aa0c-c44e33e8be72 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:25.514112 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe0d3873-648f-4fc5-aa0c-c44e33e8be72 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:25.514112 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe0d3873-648f-4fc5-aa0c-c44e33e8be72 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:25.514112 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe0d3873-648f-4fc5-aa0c-c44e33e8be72 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:25.514112 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe0d3873-648f-4fc5-aa0c-c44e33e8be72 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:25.870590 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fe0d3873-648f-4fc5-aa0c-c44e33e8be72 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:25.889595 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fe0d3873-648f-4fc5-aa0c-c44e33e8be72 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:25.891907 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fe0d3873-648f-4fc5-aa0c-c44e33e8be72 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:25.895614 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fe0d3873-648f-4fc5-aa0c-c44e33e8be72 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1806 microversion: 2.20 time: 0.432550 Oct 23 01:28:25.898073 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2133/4191] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:25 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1806 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:25.922787 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-87070fce-7cb5-409a-afa3-7dba5215b7fa tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:25.923292 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-87070fce-7cb5-409a-afa3-7dba5215b7fa tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] [instance: 81baf1e0-bb30-4349-9f18-61057d045d99] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:25.930904 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-87070fce-7cb5-409a-afa3-7dba5215b7fa tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:25.933497 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-87070fce-7cb5-409a-afa3-7dba5215b7fa tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:25.933497 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-87070fce-7cb5-409a-afa3-7dba5215b7fa tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:25.933497 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-87070fce-7cb5-409a-afa3-7dba5215b7fa tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:25.933497 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-87070fce-7cb5-409a-afa3-7dba5215b7fa tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:25.933497 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-87070fce-7cb5-409a-afa3-7dba5215b7fa tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:25.990135 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-87070fce-7cb5-409a-afa3-7dba5215b7fa tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] 10.222.0.42 "GET /compute/v2.1/servers/81baf1e0-bb30-4349-9f18-61057d045d99/ips" status: 200 len: 107 microversion: 2.1 time: 0.073961 Oct 23 01:28:25.990135 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2134/4192] 10.222.0.42 () {58 vars in 1248 bytes} [Sun Oct 23 01:28:25 2022] GET /compute/v2.1/servers/81baf1e0-bb30-4349-9f18-61057d045d99/ips => generated 107 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:28:25.997471 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6f664c4a-0db5-40a2-bb2c-50389fa6e3f7 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:26.002339 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6f664c4a-0db5-40a2-bb2c-50389fa6e3f7 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] [instance: b527a7c5-fec9-4b19-9bf0-b7f4aafa9748] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:26.013103 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6f664c4a-0db5-40a2-bb2c-50389fa6e3f7 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:26.013603 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6f664c4a-0db5-40a2-bb2c-50389fa6e3f7 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:26.019344 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6f664c4a-0db5-40a2-bb2c-50389fa6e3f7 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:26.019344 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6f664c4a-0db5-40a2-bb2c-50389fa6e3f7 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:26.019728 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6f664c4a-0db5-40a2-bb2c-50389fa6e3f7 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:26.020175 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6f664c4a-0db5-40a2-bb2c-50389fa6e3f7 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:26.159749 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6f664c4a-0db5-40a2-bb2c-50389fa6e3f7 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:26.180823 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6f664c4a-0db5-40a2-bb2c-50389fa6e3f7 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:26.182497 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6f664c4a-0db5-40a2-bb2c-50389fa6e3f7 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:26.183791 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6f664c4a-0db5-40a2-bb2c-50389fa6e3f7 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] 10.222.0.42 "GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748" status: 200 len: 1365 microversion: 2.47 time: 0.195118 Oct 23 01:28:26.184395 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2135/4193] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:25 2022] GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748 => generated 1365 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:26.192431 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e8f572dc-ac3f-4597-903e-63893547784e tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:26.192935 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e8f572dc-ac3f-4597-903e-63893547784e tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] [instance: 81baf1e0-bb30-4349-9f18-61057d045d99] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:26.212846 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e8f572dc-ac3f-4597-903e-63893547784e tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:26.213357 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e8f572dc-ac3f-4597-903e-63893547784e tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:26.213804 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e8f572dc-ac3f-4597-903e-63893547784e tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:26.214563 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e8f572dc-ac3f-4597-903e-63893547784e tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:26.215026 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e8f572dc-ac3f-4597-903e-63893547784e tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:26.215445 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e8f572dc-ac3f-4597-903e-63893547784e tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:26.284530 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e8f572dc-ac3f-4597-903e-63893547784e tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] 10.222.0.42 "GET /compute/v2.1/servers/81baf1e0-bb30-4349-9f18-61057d045d99/ips/tempest-ServerAddressesTestJSON-30632670-network" status: 200 len: 92 microversion: 2.1 time: 0.099009 Oct 23 01:28:26.294127 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2136/4194] 10.222.0.42 () {58 vars in 1395 bytes} [Sun Oct 23 01:28:26 2022] GET /compute/v2.1/servers/81baf1e0-bb30-4349-9f18-61057d045d99/ips/tempest-ServerAddressesTestJSON-30632670-network => generated 92 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:28:26.309885 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bda067ad-6645-4443-b5b3-4e41bebc4770 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:26.310433 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bda067ad-6645-4443-b5b3-4e41bebc4770 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] [instance: 81baf1e0-bb30-4349-9f18-61057d045d99] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:26.321515 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bda067ad-6645-4443-b5b3-4e41bebc4770 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:26.322336 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bda067ad-6645-4443-b5b3-4e41bebc4770 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:26.322808 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bda067ad-6645-4443-b5b3-4e41bebc4770 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:26.323613 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bda067ad-6645-4443-b5b3-4e41bebc4770 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:26.324518 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bda067ad-6645-4443-b5b3-4e41bebc4770 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:26.324958 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bda067ad-6645-4443-b5b3-4e41bebc4770 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:26.358940 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bda067ad-6645-4443-b5b3-4e41bebc4770 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] [instance: 81baf1e0-bb30-4349-9f18-61057d045d99] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:28:26.836230 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bda067ad-6645-4443-b5b3-4e41bebc4770 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] 10.222.0.42 "DELETE /compute/v2.1/servers/81baf1e0-bb30-4349-9f18-61057d045d99" status: 204 len: 0 microversion: 2.1 time: 0.540635 Oct 23 01:28:26.837134 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2137/4195] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:28:26 2022] DELETE /compute/v2.1/servers/81baf1e0-bb30-4349-9f18-61057d045d99 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:28:26.854986 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9ee1a499-0f82-4e87-90ab-43e89faf6c9a tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:26.859741 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9ee1a499-0f82-4e87-90ab-43e89faf6c9a tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] [instance: 81baf1e0-bb30-4349-9f18-61057d045d99] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:26.872165 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ee1a499-0f82-4e87-90ab-43e89faf6c9a tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:26.875971 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ee1a499-0f82-4e87-90ab-43e89faf6c9a tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:26.875971 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ee1a499-0f82-4e87-90ab-43e89faf6c9a tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:26.875971 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ee1a499-0f82-4e87-90ab-43e89faf6c9a tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:26.875971 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ee1a499-0f82-4e87-90ab-43e89faf6c9a tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:26.875971 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ee1a499-0f82-4e87-90ab-43e89faf6c9a tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:27.436650 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9ee1a499-0f82-4e87-90ab-43e89faf6c9a tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ceb97b88e9411abd0d5882bf05027a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddcdc2e1f98450e8b7a6fbbe5a08b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:27.447132 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9ee1a499-0f82-4e87-90ab-43e89faf6c9a tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] 10.222.0.42 "GET /compute/v2.1/servers/81baf1e0-bb30-4349-9f18-61057d045d99" status: 200 len: 1510 microversion: 2.1 time: 0.604532 Oct 23 01:28:27.453191 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2138/4196] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:28:26 2022] GET /compute/v2.1/servers/81baf1e0-bb30-4349-9f18-61057d045d99 => generated 1510 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:28:27.475570 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-63b5c882-812b-4e3f-8f5d-8a284caad242 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:27.476440 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-63b5c882-812b-4e3f-8f5d-8a284caad242 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:27.483661 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-63b5c882-812b-4e3f-8f5d-8a284caad242 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:27.484396 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-63b5c882-812b-4e3f-8f5d-8a284caad242 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:27.485057 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-63b5c882-812b-4e3f-8f5d-8a284caad242 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:27.486981 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-63b5c882-812b-4e3f-8f5d-8a284caad242 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:27.487612 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-63b5c882-812b-4e3f-8f5d-8a284caad242 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:27.488230 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-63b5c882-812b-4e3f-8f5d-8a284caad242 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:27.696649 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-63b5c882-812b-4e3f-8f5d-8a284caad242 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:27.709420 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-63b5c882-812b-4e3f-8f5d-8a284caad242 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:27.711068 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-63b5c882-812b-4e3f-8f5d-8a284caad242 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:27.713333 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-63b5c882-812b-4e3f-8f5d-8a284caad242 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1806 microversion: 2.20 time: 0.241621 Oct 23 01:28:27.727627 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2139/4197] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:27 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1806 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:27.727627 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c0a01a43-c299-4983-b6ee-5844d734a86c tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:27.727627 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c0a01a43-c299-4983-b6ee-5844d734a86c tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] [instance: b527a7c5-fec9-4b19-9bf0-b7f4aafa9748] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:27.739135 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c0a01a43-c299-4983-b6ee-5844d734a86c tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:27.742002 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c0a01a43-c299-4983-b6ee-5844d734a86c tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:27.742002 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c0a01a43-c299-4983-b6ee-5844d734a86c tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:27.742002 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c0a01a43-c299-4983-b6ee-5844d734a86c tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:27.742002 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c0a01a43-c299-4983-b6ee-5844d734a86c tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:27.742002 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c0a01a43-c299-4983-b6ee-5844d734a86c tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:27.879171 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c0a01a43-c299-4983-b6ee-5844d734a86c tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:27.895606 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c0a01a43-c299-4983-b6ee-5844d734a86c tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:27.897168 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c0a01a43-c299-4983-b6ee-5844d734a86c tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:27.898473 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c0a01a43-c299-4983-b6ee-5844d734a86c tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] 10.222.0.42 "GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748" status: 200 len: 1365 microversion: 2.47 time: 0.183263 Oct 23 01:28:27.914079 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2140/4198] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:27 2022] GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748 => generated 1365 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:28.481393 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cf09081d-2a7b-493d-8ce7-2972a6c3d2bf tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:28.482949 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-cf09081d-2a7b-493d-8ce7-2972a6c3d2bf tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] [instance: 81baf1e0-bb30-4349-9f18-61057d045d99] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:28.493373 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:28:28.498234 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf09081d-2a7b-493d-8ce7-2972a6c3d2bf tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:28.499455 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf09081d-2a7b-493d-8ce7-2972a6c3d2bf tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:28.500062 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf09081d-2a7b-493d-8ce7-2972a6c3d2bf tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:28.500919 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf09081d-2a7b-493d-8ce7-2972a6c3d2bf tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:28.501623 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf09081d-2a7b-493d-8ce7-2972a6c3d2bf tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:28.502232 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf09081d-2a7b-493d-8ce7-2972a6c3d2bf tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:28.732441 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cf09081d-2a7b-493d-8ce7-2972a6c3d2bf tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ceb97b88e9411abd0d5882bf05027a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddcdc2e1f98450e8b7a6fbbe5a08b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:28.758338 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cf09081d-2a7b-493d-8ce7-2972a6c3d2bf tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] 10.222.0.42 "GET /compute/v2.1/servers/81baf1e0-bb30-4349-9f18-61057d045d99" status: 200 len: 1510 microversion: 2.1 time: 0.270720 Oct 23 01:28:28.758338 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2141/4199] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:28:28 2022] GET /compute/v2.1/servers/81baf1e0-bb30-4349-9f18-61057d045d99 => generated 1510 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:28:28.758338 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-46ea6dea-49cc-4cb2-9953-4cb1b5e2e091 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:28.758338 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-46ea6dea-49cc-4cb2-9953-4cb1b5e2e091 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:28.766569 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46ea6dea-49cc-4cb2-9953-4cb1b5e2e091 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:28.767154 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46ea6dea-49cc-4cb2-9953-4cb1b5e2e091 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:28.768609 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46ea6dea-49cc-4cb2-9953-4cb1b5e2e091 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:28.768609 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46ea6dea-49cc-4cb2-9953-4cb1b5e2e091 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:28.769293 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46ea6dea-49cc-4cb2-9953-4cb1b5e2e091 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:28.769793 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46ea6dea-49cc-4cb2-9953-4cb1b5e2e091 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:28.994930 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-46ea6dea-49cc-4cb2-9953-4cb1b5e2e091 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:29.007313 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-46ea6dea-49cc-4cb2-9953-4cb1b5e2e091 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:29.009283 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-46ea6dea-49cc-4cb2-9953-4cb1b5e2e091 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:29.014420 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-46ea6dea-49cc-4cb2-9953-4cb1b5e2e091 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1806 microversion: 2.20 time: 0.261492 Oct 23 01:28:29.019679 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2142/4200] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:28 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1806 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:29.027825 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-423281ab-7e3b-4088-a17e-51b2859117b9 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:29.028508 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-423281ab-7e3b-4088-a17e-51b2859117b9 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] [instance: b527a7c5-fec9-4b19-9bf0-b7f4aafa9748] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:29.038571 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-423281ab-7e3b-4088-a17e-51b2859117b9 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:29.039070 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-423281ab-7e3b-4088-a17e-51b2859117b9 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:29.044747 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-423281ab-7e3b-4088-a17e-51b2859117b9 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:29.045660 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-423281ab-7e3b-4088-a17e-51b2859117b9 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:29.046179 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-423281ab-7e3b-4088-a17e-51b2859117b9 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:29.047997 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-423281ab-7e3b-4088-a17e-51b2859117b9 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:29.181935 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-423281ab-7e3b-4088-a17e-51b2859117b9 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:29.193506 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-423281ab-7e3b-4088-a17e-51b2859117b9 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:29.195549 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-423281ab-7e3b-4088-a17e-51b2859117b9 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:29.214773 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-423281ab-7e3b-4088-a17e-51b2859117b9 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] 10.222.0.42 "GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748" status: 200 len: 1365 microversion: 2.47 time: 0.193933 Oct 23 01:28:29.216631 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2143/4201] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:29 2022] GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748 => generated 1365 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:29.248383 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4255869b-0cc0-4198-8dba-8bb17c1dd44d tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images/6f92eb4d-aa9a-45ce-b0c6-6c58ec4bc45b" status: 200 len: 1461 microversion: 2.1 time: 19.919018 Oct 23 01:28:29.248978 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2059/4202] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:28:09 2022] GET /compute/v2.1/images/6f92eb4d-aa9a-45ce-b0c6-6c58ec4bc45b => generated 1461 bytes in 19920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:28:29.265036 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e07a3232-4a18-445a-b429-677f800536e5 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc1a60d30>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:29.325547 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-103dd84e-1b9c-4c31-be1d-bd7714ad5733 req-c74a789e-f685-4988-a15d-ec44000d25c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81baf1e0-bb30-4349-9f18-61057d045d99", "name": "network-vif-deleted", "tag": "13f5d20f-6806-4c0f-ba3a-19dc3f195051"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:28:29.336732 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-103dd84e-1b9c-4c31-be1d-bd7714ad5733 req-c74a789e-f685-4988-a15d-ec44000d25c0 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:29.338163 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-103dd84e-1b9c-4c31-be1d-bd7714ad5733 req-c74a789e-f685-4988-a15d-ec44000d25c0 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:29.338163 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-103dd84e-1b9c-4c31-be1d-bd7714ad5733 req-c74a789e-f685-4988-a15d-ec44000d25c0 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:29.350480 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-103dd84e-1b9c-4c31-be1d-bd7714ad5733 req-c74a789e-f685-4988-a15d-ec44000d25c0 service nova] Creating event network-vif-deleted:13f5d20f-6806-4c0f-ba3a-19dc3f195051 for instance 81baf1e0-bb30-4349-9f18-61057d045d99 on n-h1-master-1 Oct 23 01:28:29.356840 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-103dd84e-1b9c-4c31-be1d-bd7714ad5733 req-c74a789e-f685-4988-a15d-ec44000d25c0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035404 Oct 23 01:28:29.361080 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2060/4203] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:28:29.773683 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-97e49819-b51d-42bc-aac5-4037b4683570 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:29.778712 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-97e49819-b51d-42bc-aac5-4037b4683570 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] [instance: 81baf1e0-bb30-4349-9f18-61057d045d99] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:29.786703 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-97e49819-b51d-42bc-aac5-4037b4683570 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:29.789759 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-97e49819-b51d-42bc-aac5-4037b4683570 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:29.790577 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-97e49819-b51d-42bc-aac5-4037b4683570 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:29.791247 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-97e49819-b51d-42bc-aac5-4037b4683570 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:29.795161 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-97e49819-b51d-42bc-aac5-4037b4683570 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:29.795878 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-97e49819-b51d-42bc-aac5-4037b4683570 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:29.922888 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-97e49819-b51d-42bc-aac5-4037b4683570 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:29.923647 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-97e49819-b51d-42bc-aac5-4037b4683570 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:29.924264 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-97e49819-b51d-42bc-aac5-4037b4683570 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:29.924951 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-97e49819-b51d-42bc-aac5-4037b4683570 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lazy-loading 'fault' on Instance uuid 81baf1e0-bb30-4349-9f18-61057d045d99 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:28:29.977488 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-97e49819-b51d-42bc-aac5-4037b4683570 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ceb97b88e9411abd0d5882bf05027a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddcdc2e1f98450e8b7a6fbbe5a08b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:29.996149 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-97e49819-b51d-42bc-aac5-4037b4683570 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] 10.222.0.42 "GET /compute/v2.1/servers/81baf1e0-bb30-4349-9f18-61057d045d99" status: 200 len: 1307 microversion: 2.1 time: 0.222588 Oct 23 01:28:29.996149 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2061/4204] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:28:29 2022] GET /compute/v2.1/servers/81baf1e0-bb30-4349-9f18-61057d045d99 => generated 1307 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:28:30.069827 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7007e43b-3ea2-4072-ab6f-34ea8c13cf86 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:30.071216 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7007e43b-3ea2-4072-ab6f-34ea8c13cf86 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:30.084969 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7007e43b-3ea2-4072-ab6f-34ea8c13cf86 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:30.089220 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7007e43b-3ea2-4072-ab6f-34ea8c13cf86 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:30.090139 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7007e43b-3ea2-4072-ab6f-34ea8c13cf86 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:30.091182 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7007e43b-3ea2-4072-ab6f-34ea8c13cf86 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:30.091966 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7007e43b-3ea2-4072-ab6f-34ea8c13cf86 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:30.092614 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7007e43b-3ea2-4072-ab6f-34ea8c13cf86 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:30.482681 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7007e43b-3ea2-4072-ab6f-34ea8c13cf86 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:30.498818 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7007e43b-3ea2-4072-ab6f-34ea8c13cf86 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:30.501748 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7007e43b-3ea2-4072-ab6f-34ea8c13cf86 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:30.503616 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7007e43b-3ea2-4072-ab6f-34ea8c13cf86 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1806 microversion: 2.20 time: 0.438910 Oct 23 01:28:30.504591 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2062/4205] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:30 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1806 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:30.512386 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1ac560af-7cca-484a-88ee-0e2375ae7bac tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:30.513371 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1ac560af-7cca-484a-88ee-0e2375ae7bac tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] [instance: b527a7c5-fec9-4b19-9bf0-b7f4aafa9748] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:30.523029 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1ac560af-7cca-484a-88ee-0e2375ae7bac tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:30.525806 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1ac560af-7cca-484a-88ee-0e2375ae7bac tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:30.527145 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1ac560af-7cca-484a-88ee-0e2375ae7bac tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:30.528787 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1ac560af-7cca-484a-88ee-0e2375ae7bac tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:30.530620 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1ac560af-7cca-484a-88ee-0e2375ae7bac tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:30.531578 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1ac560af-7cca-484a-88ee-0e2375ae7bac tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:30.723994 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1ac560af-7cca-484a-88ee-0e2375ae7bac tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:30.750471 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1ac560af-7cca-484a-88ee-0e2375ae7bac tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:30.755684 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1ac560af-7cca-484a-88ee-0e2375ae7bac tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:30.759712 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1ac560af-7cca-484a-88ee-0e2375ae7bac tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] 10.222.0.42 "GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748" status: 200 len: 1365 microversion: 2.47 time: 0.253686 Oct 23 01:28:30.761262 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2063/4206] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:30 2022] GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748 => generated 1365 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:30.781308 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8d73afb1-9adb-4713-8de5-3c7fdd4f6014 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:30.794685 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8d73afb1-9adb-4713-8de5-3c7fdd4f6014 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: 0fb11dc6-65bc-4c8e-a674-c948f42f1b87] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:30.819550 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d73afb1-9adb-4713-8de5-3c7fdd4f6014 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:30.821141 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d73afb1-9adb-4713-8de5-3c7fdd4f6014 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:30.825116 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d73afb1-9adb-4713-8de5-3c7fdd4f6014 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:30.838919 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d73afb1-9adb-4713-8de5-3c7fdd4f6014 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:30.838919 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d73afb1-9adb-4713-8de5-3c7fdd4f6014 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:30.838919 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d73afb1-9adb-4713-8de5-3c7fdd4f6014 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:30.923222 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8d73afb1-9adb-4713-8de5-3c7fdd4f6014 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.157500 Oct 23 01:28:30.924318 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2064/4207] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:28:30 2022] GET /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87/os-volume_attachments => generated 197 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:28:30.945745 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-926c6825-eafd-4440-9487-f9a83954dc72 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:30.948313 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-926c6825-eafd-4440-9487-f9a83954dc72 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: 0fb11dc6-65bc-4c8e-a674-c948f42f1b87] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:30.965867 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-926c6825-eafd-4440-9487-f9a83954dc72 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:30.967824 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-926c6825-eafd-4440-9487-f9a83954dc72 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:30.969240 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-926c6825-eafd-4440-9487-f9a83954dc72 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:30.971344 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-926c6825-eafd-4440-9487-f9a83954dc72 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:30.972578 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-926c6825-eafd-4440-9487-f9a83954dc72 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:30.973383 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-926c6825-eafd-4440-9487-f9a83954dc72 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:31.027169 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-926c6825-eafd-4440-9487-f9a83954dc72 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87/os-volume_attachments/382887af-33d5-4ee1-a55f-5d267d0dfab0" status: 200 len: 194 microversion: 2.1 time: 0.094499 Oct 23 01:28:31.030024 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2065/4208] 10.222.0.42 () {58 vars in 1413 bytes} [Sun Oct 23 01:28:30 2022] GET /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87/os-volume_attachments/382887af-33d5-4ee1-a55f-5d267d0dfab0 => generated 194 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:28:31.053880 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-254b894b-b1c3-40ff-8952-b0e6aed2ae0c tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:31.066957 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-254b894b-b1c3-40ff-8952-b0e6aed2ae0c tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] [instance: 81baf1e0-bb30-4349-9f18-61057d045d99] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:31.077588 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-254b894b-b1c3-40ff-8952-b0e6aed2ae0c tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:31.078112 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-254b894b-b1c3-40ff-8952-b0e6aed2ae0c tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:31.078555 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-254b894b-b1c3-40ff-8952-b0e6aed2ae0c tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:31.079911 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-254b894b-b1c3-40ff-8952-b0e6aed2ae0c tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:31.080396 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-254b894b-b1c3-40ff-8952-b0e6aed2ae0c tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:31.080900 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-254b894b-b1c3-40ff-8952-b0e6aed2ae0c tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:31.156266 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-254b894b-b1c3-40ff-8952-b0e6aed2ae0c tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:31.161273 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-254b894b-b1c3-40ff-8952-b0e6aed2ae0c tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:31.163178 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-254b894b-b1c3-40ff-8952-b0e6aed2ae0c tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:31.163495 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-254b894b-b1c3-40ff-8952-b0e6aed2ae0c tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lazy-loading 'fault' on Instance uuid 81baf1e0-bb30-4349-9f18-61057d045d99 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:28:31.220208 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-254b894b-b1c3-40ff-8952-b0e6aed2ae0c tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ceb97b88e9411abd0d5882bf05027a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddcdc2e1f98450e8b7a6fbbe5a08b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:31.230961 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-254b894b-b1c3-40ff-8952-b0e6aed2ae0c tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] 10.222.0.42 "GET /compute/v2.1/servers/81baf1e0-bb30-4349-9f18-61057d045d99" status: 200 len: 1307 microversion: 2.1 time: 0.201609 Oct 23 01:28:31.232155 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2066/4209] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:28:31 2022] GET /compute/v2.1/servers/81baf1e0-bb30-4349-9f18-61057d045d99 => generated 1307 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:28:31.534904 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cb11e2d5-cc65-41ba-996b-29b2183b4f58 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:31.537110 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cb11e2d5-cc65-41ba-996b-29b2183b4f58 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:31.551915 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb11e2d5-cc65-41ba-996b-29b2183b4f58 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:31.552412 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb11e2d5-cc65-41ba-996b-29b2183b4f58 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:31.552847 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb11e2d5-cc65-41ba-996b-29b2183b4f58 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:31.553806 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb11e2d5-cc65-41ba-996b-29b2183b4f58 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:31.571089 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb11e2d5-cc65-41ba-996b-29b2183b4f58 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:31.571089 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb11e2d5-cc65-41ba-996b-29b2183b4f58 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:31.879493 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cb11e2d5-cc65-41ba-996b-29b2183b4f58 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:31.888625 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cb11e2d5-cc65-41ba-996b-29b2183b4f58 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:31.890103 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cb11e2d5-cc65-41ba-996b-29b2183b4f58 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:31.891291 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cb11e2d5-cc65-41ba-996b-29b2183b4f58 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1806 microversion: 2.20 time: 0.360472 Oct 23 01:28:31.897845 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2067/4210] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:31 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1806 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:28:31.912399 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1eca9603-739f-4218-b2b7-40e724cc906a tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:31.912399 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1eca9603-739f-4218-b2b7-40e724cc906a tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] [instance: b527a7c5-fec9-4b19-9bf0-b7f4aafa9748] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:31.929201 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1eca9603-739f-4218-b2b7-40e724cc906a tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:31.929697 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1eca9603-739f-4218-b2b7-40e724cc906a tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:31.934383 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1eca9603-739f-4218-b2b7-40e724cc906a tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:31.935686 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1eca9603-739f-4218-b2b7-40e724cc906a tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:31.936178 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1eca9603-739f-4218-b2b7-40e724cc906a tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:31.936919 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1eca9603-739f-4218-b2b7-40e724cc906a tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:32.081321 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1eca9603-739f-4218-b2b7-40e724cc906a tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:32.097662 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1eca9603-739f-4218-b2b7-40e724cc906a tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:32.102592 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1eca9603-739f-4218-b2b7-40e724cc906a tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:32.106500 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1eca9603-739f-4218-b2b7-40e724cc906a tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] 10.222.0.42 "GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748" status: 200 len: 1365 microversion: 2.47 time: 0.207541 Oct 23 01:28:32.122001 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2068/4211] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:31 2022] GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748 => generated 1365 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:32.264510 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0e4ff708-8583-490d-b293-0fe244149f31 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:32.264510 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0e4ff708-8583-490d-b293-0fe244149f31 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] [instance: 81baf1e0-bb30-4349-9f18-61057d045d99] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:32.269559 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0e4ff708-8583-490d-b293-0fe244149f31 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:32.270131 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0e4ff708-8583-490d-b293-0fe244149f31 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:32.270570 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0e4ff708-8583-490d-b293-0fe244149f31 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:32.271279 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0e4ff708-8583-490d-b293-0fe244149f31 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:32.271728 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0e4ff708-8583-490d-b293-0fe244149f31 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:32.272165 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0e4ff708-8583-490d-b293-0fe244149f31 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:32.307742 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-0e4ff708-8583-490d-b293-0fe244149f31 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] HTTP exception thrown: Instance 81baf1e0-bb30-4349-9f18-61057d045d99 could not be found. Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0e4ff708-8583-490d-b293-0fe244149f31 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Request method failure captured: Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/81baf1e0-bb30-4349-9f18-61057d045d99 HTTP/1.1 Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJihtb09anL51DkTrQdusqNM-Ikqv-Ypmhz6xGQFiE24L8-md-qd0VsV8g5z3ZzgQTJL-N-MlkGWZO1a11NzO-aZVQ40wzNgQl-g010YJwEwOtOyXNBganH0C83YEvrPFm1dc4pYwUkdTWBg5vLWNyDaA_lU6nk63IHE4BlKRuBdpns Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: bddcdc2e1f98450e8b7a6fbbe5a08b7c Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServerAddressesTestJSON-683610196 Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bddcdc2e1f98450e8b7a6fbbe5a08b7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bddcdc2e1f98450e8b7a6fbbe5a08b7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bddcdc2e1f98450e8b7a6fbbe5a08b7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bddcdc2e1f98450e8b7a6fbbe5a08b7c"}]}] Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServerAddressesTestJSON-683610196 Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: bddcdc2e1f98450e8b7a6fbbe5a08b7c Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServerAddressesTestJSON-683610196 Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServerAddressesTestJSON-683610196-project Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 05ceb97b88e9411abd0d5882bf05027a Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServerAddressesTestJSON-683610196-project Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 81baf1e0-bb30-4349-9f18-61057d045d99 could not be found. Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '81baf1e0-bb30-4349-9f18-61057d045d99'} Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81baf1e0-bb30-4349-9f18-61057d045d99 could not be found. Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81baf1e0-bb30-4349-9f18-61057d045d99 could not be found. Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:28:32.309428 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:28:32.313960 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:28:32.313960 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:28:32.313960 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:28:32.313960 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:28:32.313960 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:28:32.313960 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81baf1e0-bb30-4349-9f18-61057d045d99 could not be found. Oct 23 01:28:32.313960 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:28:32.313960 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0e4ff708-8583-490d-b293-0fe244149f31 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] Returning 404 to user: Instance 81baf1e0-bb30-4349-9f18-61057d045d99 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:28:32.313960 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0e4ff708-8583-490d-b293-0fe244149f31 tempest-ServerAddressesTestJSON-683610196 tempest-ServerAddressesTestJSON-683610196-project] 10.222.0.42 "GET /compute/v2.1/servers/81baf1e0-bb30-4349-9f18-61057d045d99" status: 404 len: 111 microversion: 2.1 time: 0.057996 Oct 23 01:28:32.313960 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2069/4212] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:28:32 2022] GET /compute/v2.1/servers/81baf1e0-bb30-4349-9f18-61057d045d99 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 01:28:32.921016 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6365858e-f4db-486b-9824-138bc0dcf4f1 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:32.921631 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6365858e-f4db-486b-9824-138bc0dcf4f1 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:32.950794 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6365858e-f4db-486b-9824-138bc0dcf4f1 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:32.953632 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6365858e-f4db-486b-9824-138bc0dcf4f1 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:32.962743 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6365858e-f4db-486b-9824-138bc0dcf4f1 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:32.963909 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6365858e-f4db-486b-9824-138bc0dcf4f1 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:32.976289 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6365858e-f4db-486b-9824-138bc0dcf4f1 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:32.977580 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6365858e-f4db-486b-9824-138bc0dcf4f1 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:33.499152 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6365858e-f4db-486b-9824-138bc0dcf4f1 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:33.522492 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6365858e-f4db-486b-9824-138bc0dcf4f1 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:33.523995 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6365858e-f4db-486b-9824-138bc0dcf4f1 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:33.525196 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6365858e-f4db-486b-9824-138bc0dcf4f1 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1806 microversion: 2.20 time: 0.608101 Oct 23 01:28:33.540932 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2070/4213] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:32 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1806 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:33.555611 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8d5f11c8-5385-49d7-b5c8-96ebbea7d4cc tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:33.560913 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8d5f11c8-5385-49d7-b5c8-96ebbea7d4cc tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] [instance: b527a7c5-fec9-4b19-9bf0-b7f4aafa9748] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:33.590772 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d5f11c8-5385-49d7-b5c8-96ebbea7d4cc tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:33.596040 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d5f11c8-5385-49d7-b5c8-96ebbea7d4cc tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:33.596040 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d5f11c8-5385-49d7-b5c8-96ebbea7d4cc tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:33.596623 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d5f11c8-5385-49d7-b5c8-96ebbea7d4cc tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:33.597094 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d5f11c8-5385-49d7-b5c8-96ebbea7d4cc tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:33.597525 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d5f11c8-5385-49d7-b5c8-96ebbea7d4cc tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:33.876895 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8d5f11c8-5385-49d7-b5c8-96ebbea7d4cc tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:33.890904 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8d5f11c8-5385-49d7-b5c8-96ebbea7d4cc tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:33.892813 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8d5f11c8-5385-49d7-b5c8-96ebbea7d4cc tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:33.898391 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8d5f11c8-5385-49d7-b5c8-96ebbea7d4cc tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] 10.222.0.42 "GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748" status: 200 len: 1365 microversion: 2.47 time: 0.356254 Oct 23 01:28:33.902848 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2071/4214] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:33 2022] GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748 => generated 1365 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:33.989194 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e07a3232-4a18-445a-b429-677f800536e5 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images/6f92eb4d-aa9a-45ce-b0c6-6c58ec4bc45b" status: 200 len: 1461 microversion: 2.1 time: 4.725088 Oct 23 01:28:33.998338 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2144/4215] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:28:29 2022] GET /compute/v2.1/images/6f92eb4d-aa9a-45ce-b0c6-6c58ec4bc45b => generated 1461 bytes in 4738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:28:34.021278 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b9b17351-4b00-4827-b53d-51dfc5d8fd0f tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:34.023080 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b9b17351-4b00-4827-b53d-51dfc5d8fd0f tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] [instance: ad46f590-af38-463e-87db-62c442e08669] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:34.049912 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9b17351-4b00-4827-b53d-51dfc5d8fd0f tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:34.059501 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9b17351-4b00-4827-b53d-51dfc5d8fd0f tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:34.059978 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9b17351-4b00-4827-b53d-51dfc5d8fd0f tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:34.061591 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9b17351-4b00-4827-b53d-51dfc5d8fd0f tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:34.062124 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9b17351-4b00-4827-b53d-51dfc5d8fd0f tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:34.062514 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9b17351-4b00-4827-b53d-51dfc5d8fd0f tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:34.559249 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5f6fb3e7-6e73-40ea-b26c-6c2cc38b40ff tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:34.560264 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5f6fb3e7-6e73-40ea-b26c-6c2cc38b40ff tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:34.588124 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f6fb3e7-6e73-40ea-b26c-6c2cc38b40ff tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:34.591056 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f6fb3e7-6e73-40ea-b26c-6c2cc38b40ff tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:34.591892 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f6fb3e7-6e73-40ea-b26c-6c2cc38b40ff tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:34.597761 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f6fb3e7-6e73-40ea-b26c-6c2cc38b40ff tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:34.599518 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f6fb3e7-6e73-40ea-b26c-6c2cc38b40ff tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:34.600610 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f6fb3e7-6e73-40ea-b26c-6c2cc38b40ff tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:34.667164 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b9b17351-4b00-4827-b53d-51dfc5d8fd0f tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86e186e88524064b8dca040c1814927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf35beeccb814ce490d2142b21c2b1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:34.684668 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b9b17351-4b00-4827-b53d-51dfc5d8fd0f tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/servers/ad46f590-af38-463e-87db-62c442e08669" status: 200 len: 1480 microversion: 2.1 time: 0.676211 Oct 23 01:28:34.687233 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2072/4216] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:28:34 2022] GET /compute/v2.1/servers/ad46f590-af38-463e-87db-62c442e08669 => generated 1480 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:28:34.936889 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-050e0405-23b6-4bce-a832-7fbc70f1dc01 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:34.937515 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-050e0405-23b6-4bce-a832-7fbc70f1dc01 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] [instance: b527a7c5-fec9-4b19-9bf0-b7f4aafa9748] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:34.948653 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-050e0405-23b6-4bce-a832-7fbc70f1dc01 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:34.949057 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-050e0405-23b6-4bce-a832-7fbc70f1dc01 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:34.949672 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-050e0405-23b6-4bce-a832-7fbc70f1dc01 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:34.952624 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-050e0405-23b6-4bce-a832-7fbc70f1dc01 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:34.953415 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-050e0405-23b6-4bce-a832-7fbc70f1dc01 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:34.955712 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-050e0405-23b6-4bce-a832-7fbc70f1dc01 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:35.131560 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-050e0405-23b6-4bce-a832-7fbc70f1dc01 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:35.157118 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-050e0405-23b6-4bce-a832-7fbc70f1dc01 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:35.159517 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-050e0405-23b6-4bce-a832-7fbc70f1dc01 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:35.197314 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-050e0405-23b6-4bce-a832-7fbc70f1dc01 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] 10.222.0.42 "GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748" status: 200 len: 1365 microversion: 2.47 time: 0.228524 Oct 23 01:28:35.201677 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2073/4217] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:34 2022] GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748 => generated 1365 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:28:35.406935 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5f6fb3e7-6e73-40ea-b26c-6c2cc38b40ff tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:35.423255 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5f6fb3e7-6e73-40ea-b26c-6c2cc38b40ff tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:35.438036 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5f6fb3e7-6e73-40ea-b26c-6c2cc38b40ff tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:35.441419 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5f6fb3e7-6e73-40ea-b26c-6c2cc38b40ff tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1806 microversion: 2.20 time: 0.890660 Oct 23 01:28:35.445020 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2145/4218] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:34 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1806 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:28:35.589962 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ef06ce07-e413-41a1-b88e-5e82576ca50d tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e9df6c18-697c-469c-bae0-9fb858b2561c"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:28:35.592502 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ef06ce07-e413-41a1-b88e-5e82576ca50d tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: 0fb11dc6-65bc-4c8e-a674-c948f42f1b87] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:35.602170 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef06ce07-e413-41a1-b88e-5e82576ca50d tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:35.602999 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef06ce07-e413-41a1-b88e-5e82576ca50d tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:35.603557 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef06ce07-e413-41a1-b88e-5e82576ca50d tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:35.606202 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef06ce07-e413-41a1-b88e-5e82576ca50d tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:35.606844 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef06ce07-e413-41a1-b88e-5e82576ca50d tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:35.607426 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef06ce07-e413-41a1-b88e-5e82576ca50d tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:35.712697 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d3d632cd-c509-423b-b68c-45678e1c6374 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:35.714072 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d3d632cd-c509-423b-b68c-45678e1c6374 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] [instance: ad46f590-af38-463e-87db-62c442e08669] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:35.729233 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d3d632cd-c509-423b-b68c-45678e1c6374 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:35.732997 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d3d632cd-c509-423b-b68c-45678e1c6374 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:35.734713 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d3d632cd-c509-423b-b68c-45678e1c6374 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:35.738175 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d3d632cd-c509-423b-b68c-45678e1c6374 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:35.739061 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d3d632cd-c509-423b-b68c-45678e1c6374 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:35.740017 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d3d632cd-c509-423b-b68c-45678e1c6374 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:36.405417 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d3d632cd-c509-423b-b68c-45678e1c6374 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86e186e88524064b8dca040c1814927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf35beeccb814ce490d2142b21c2b1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:36.411109 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:28:36.444234 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d3d632cd-c509-423b-b68c-45678e1c6374 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/servers/ad46f590-af38-463e-87db-62c442e08669" status: 200 len: 1467 microversion: 2.1 time: 0.739938 Oct 23 01:28:36.447327 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2146/4219] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:28:35 2022] GET /compute/v2.1/servers/ad46f590-af38-463e-87db-62c442e08669 => generated 1467 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:28:36.493413 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b99295e3-8944-4679-a226-60a933debeaa tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:36.500632 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b99295e3-8944-4679-a226-60a933debeaa tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] [instance: b527a7c5-fec9-4b19-9bf0-b7f4aafa9748] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:36.521641 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b99295e3-8944-4679-a226-60a933debeaa tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:36.522473 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b99295e3-8944-4679-a226-60a933debeaa tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:36.525666 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b99295e3-8944-4679-a226-60a933debeaa tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:36.529138 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b99295e3-8944-4679-a226-60a933debeaa tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:36.532087 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b99295e3-8944-4679-a226-60a933debeaa tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:36.536072 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b99295e3-8944-4679-a226-60a933debeaa tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:36.729024 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b99295e3-8944-4679-a226-60a933debeaa tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:36.763014 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b99295e3-8944-4679-a226-60a933debeaa tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:36.772997 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b99295e3-8944-4679-a226-60a933debeaa tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:36.784089 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b99295e3-8944-4679-a226-60a933debeaa tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] 10.222.0.42 "GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748" status: 200 len: 1365 microversion: 2.47 time: 0.325880 Oct 23 01:28:36.787209 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2147/4220] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:36 2022] GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748 => generated 1365 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:36.806534 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d4ca84eb-c159-4c41-8f6d-583c7c8417c7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:36.809374 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d4ca84eb-c159-4c41-8f6d-583c7c8417c7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:36.825369 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d4ca84eb-c159-4c41-8f6d-583c7c8417c7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:36.826952 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d4ca84eb-c159-4c41-8f6d-583c7c8417c7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:36.827866 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d4ca84eb-c159-4c41-8f6d-583c7c8417c7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:36.830783 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d4ca84eb-c159-4c41-8f6d-583c7c8417c7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:36.834066 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d4ca84eb-c159-4c41-8f6d-583c7c8417c7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:36.846356 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ef06ce07-e413-41a1-b88e-5e82576ca50d tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "POST /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.259748 Oct 23 01:28:36.848306 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2074/4221] 10.222.0.42 () {60 vars in 1323 bytes} [Sun Oct 23 01:28:35 2022] POST /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87/os-volume_attachments => generated 194 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:28:36.869461 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d4ca84eb-c159-4c41-8f6d-583c7c8417c7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:36.894017 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-076202f0-d9ca-4801-b539-dd8c2cdfc3f7 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc1654700>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:37.237997 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-076202f0-d9ca-4801-b539-dd8c2cdfc3f7 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images?changes-since=2022-10-23T01%3A26%3A21Z" status: 200 len: 1902 microversion: 2.1 time: 0.388000 Oct 23 01:28:37.243197 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2075/4222] 10.222.0.42 () {58 vars in 1199 bytes} [Sun Oct 23 01:28:36 2022] GET /compute/v2.1/images?changes-since=2022-10-23T01%3A26%3A21Z => generated 1902 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:28:37.253532 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fcf39c9e-6bba-4a0b-ad07-7e1d956b4dc0 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc16543a0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:37.381254 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fcf39c9e-6bba-4a0b-ad07-7e1d956b4dc0 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-932851473" status: 200 len: 484 microversion: 2.1 time: 0.130425 Oct 23 01:28:37.384072 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2076/4223] 10.222.0.42 () {58 vars in 1229 bytes} [Sun Oct 23 01:28:37 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-932851473 => generated 484 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:28:37.430946 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-86d2cd6c-7729-4279-be14-79f73db1ed10 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc1639b80>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:37.645581 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d4ca84eb-c159-4c41-8f6d-583c7c8417c7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:37.684995 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d4ca84eb-c159-4c41-8f6d-583c7c8417c7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:37.686887 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d4ca84eb-c159-4c41-8f6d-583c7c8417c7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:37.688101 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d4ca84eb-c159-4c41-8f6d-583c7c8417c7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1806 microversion: 2.20 time: 0.897572 Oct 23 01:28:37.688658 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2148/4224] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:36 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1806 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:37.743931 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-86d2cd6c-7729-4279-be14-79f73db1ed10 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images?server=ad46f590-af38-463e-87db-62c442e08669" status: 200 len: 956 microversion: 2.1 time: 0.344830 Oct 23 01:28:37.751847 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2077/4225] 10.222.0.42 () {58 vars in 1209 bytes} [Sun Oct 23 01:28:37 2022] GET /compute/v2.1/images?server=ad46f590-af38-463e-87db-62c442e08669 => generated 956 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:28:37.756491 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-56885e2c-df85-4cd9-820c-1db014ebb9d7 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc1a09280>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:37.829038 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2869060f-b82d-48f8-bdec-5f852b44cce2 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:37.830097 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2869060f-b82d-48f8-bdec-5f852b44cce2 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] [instance: b527a7c5-fec9-4b19-9bf0-b7f4aafa9748] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:37.863516 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2869060f-b82d-48f8-bdec-5f852b44cce2 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:37.870740 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2869060f-b82d-48f8-bdec-5f852b44cce2 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:37.873804 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2869060f-b82d-48f8-bdec-5f852b44cce2 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:37.874848 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2869060f-b82d-48f8-bdec-5f852b44cce2 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:37.878304 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2869060f-b82d-48f8-bdec-5f852b44cce2 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:37.882138 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2869060f-b82d-48f8-bdec-5f852b44cce2 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:37.951183 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-56885e2c-df85-4cd9-820c-1db014ebb9d7 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.42%2Fcompute%2Fv2.1%2Fservers%2F36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb" status: 200 len: 485 microversion: 2.1 time: 0.198686 Oct 23 01:28:37.952358 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2149/4226] 10.222.0.42 () {58 vars in 1317 bytes} [Sun Oct 23 01:28:37 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.42%2Fcompute%2Fv2.1%2Fservers%2F36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb => generated 485 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:28:37.974244 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b38596df-aac6-4375-914a-98a088cb1174 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc1a1fca0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:38.098936 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b38596df-aac6-4375-914a-98a088cb1174 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.42%2Fcompute%2Fservers%2F36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb" status: 200 len: 485 microversion: 2.1 time: 0.138144 Oct 23 01:28:38.099629 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2150/4227] 10.222.0.42 () {58 vars in 1303 bytes} [Sun Oct 23 01:28:37 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.42%2Fcompute%2Fservers%2F36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb => generated 485 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:28:38.119541 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2869060f-b82d-48f8-bdec-5f852b44cce2 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:38.126156 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:28:38.129766 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-67334aaa-473c-4a6d-9dd2-da574b29e058 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc2396550>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:38.137453 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2869060f-b82d-48f8-bdec-5f852b44cce2 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:38.139058 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2869060f-b82d-48f8-bdec-5f852b44cce2 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:38.145347 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2869060f-b82d-48f8-bdec-5f852b44cce2 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] 10.222.0.42 "GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748" status: 200 len: 1365 microversion: 2.47 time: 0.327471 Oct 23 01:28:38.148045 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2078/4228] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:37 2022] GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748 => generated 1365 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:38.449191 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-67334aaa-473c-4a6d-9dd2-da574b29e058 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3279 microversion: 2.1 time: 0.338896 Oct 23 01:28:38.489650 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c4ee95f0-bc80-4035-870d-098a6749eb88 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc1654790>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:38.491759 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2151/4229] 10.222.0.42 () {58 vars in 1149 bytes} [Sun Oct 23 01:28:38 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3279 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:28:38.721083 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-42e3bcdf-2d89-470f-9cc8-67e567bf6a42 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:38.721702 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-42e3bcdf-2d89-470f-9cc8-67e567bf6a42 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:38.748088 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-42e3bcdf-2d89-470f-9cc8-67e567bf6a42 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:38.748824 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-42e3bcdf-2d89-470f-9cc8-67e567bf6a42 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:38.749282 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-42e3bcdf-2d89-470f-9cc8-67e567bf6a42 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:38.750040 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-42e3bcdf-2d89-470f-9cc8-67e567bf6a42 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:38.750683 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-42e3bcdf-2d89-470f-9cc8-67e567bf6a42 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:38.751272 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-42e3bcdf-2d89-470f-9cc8-67e567bf6a42 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:38.765726 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c4ee95f0-bc80-4035-870d-098a6749eb88 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.287781 Oct 23 01:28:38.788147 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2079/4230] 10.222.0.42 () {58 vars in 1149 bytes} [Sun Oct 23 01:28:38 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:28:38.849890 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e6e5520b-659e-4ebb-bbdb-14e5caa6fb2c tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc1658790>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:39.194540 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e6e5520b-659e-4ebb-bbdb-14e5caa6fb2c tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.402990 Oct 23 01:28:39.196774 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2080/4231] 10.222.0.42 () {58 vars in 1137 bytes} [Sun Oct 23 01:28:38 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:28:39.202954 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-6a1233cb-e271-4ee6-9bb8-516114d31efd req-2c5673aa-74d3-4ddd-a5c2-f92407b058e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad46f590-af38-463e-87db-62c442e08669", "name": "network-vif-unplugged", "status": "completed", "tag": "d91fdad3-e41c-42ed-88d5-cc3ba6ed68a4"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:28:39.215987 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-6a1233cb-e271-4ee6-9bb8-516114d31efd req-2c5673aa-74d3-4ddd-a5c2-f92407b058e2 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:39.216983 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-6a1233cb-e271-4ee6-9bb8-516114d31efd req-2c5673aa-74d3-4ddd-a5c2-f92407b058e2 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:39.230289 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-6a1233cb-e271-4ee6-9bb8-516114d31efd req-2c5673aa-74d3-4ddd-a5c2-f92407b058e2 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:39.282517 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-6a1233cb-e271-4ee6-9bb8-516114d31efd req-2c5673aa-74d3-4ddd-a5c2-f92407b058e2 service nova] Creating event network-vif-unplugged:d91fdad3-e41c-42ed-88d5-cc3ba6ed68a4 for instance ad46f590-af38-463e-87db-62c442e08669 on n-h1-master-1 Oct 23 01:28:39.314001 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-6a1233cb-e271-4ee6-9bb8-516114d31efd req-2c5673aa-74d3-4ddd-a5c2-f92407b058e2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115323 Oct 23 01:28:39.321236 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2081/4232] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:28:39.333774 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f7a703f7-51d3-459a-96e3-97b137323238 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:39.334841 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f7a703f7-51d3-459a-96e3-97b137323238 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] [instance: b527a7c5-fec9-4b19-9bf0-b7f4aafa9748] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:39.357661 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f7a703f7-51d3-459a-96e3-97b137323238 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:39.361819 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f7a703f7-51d3-459a-96e3-97b137323238 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:39.363121 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f7a703f7-51d3-459a-96e3-97b137323238 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:39.373334 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f7a703f7-51d3-459a-96e3-97b137323238 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:39.379181 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f7a703f7-51d3-459a-96e3-97b137323238 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:39.384252 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f7a703f7-51d3-459a-96e3-97b137323238 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:39.487465 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-42e3bcdf-2d89-470f-9cc8-67e567bf6a42 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:39.544995 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-42e3bcdf-2d89-470f-9cc8-67e567bf6a42 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:39.548354 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-42e3bcdf-2d89-470f-9cc8-67e567bf6a42 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:39.550880 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-42e3bcdf-2d89-470f-9cc8-67e567bf6a42 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1806 microversion: 2.20 time: 0.833355 Oct 23 01:28:39.554145 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2152/4233] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:38 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1806 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:39.571664 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-818a1133-d05b-4dec-9db1-decf59c8679d tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc232cee0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:39.658885 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f7a703f7-51d3-459a-96e3-97b137323238 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:39.689272 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f7a703f7-51d3-459a-96e3-97b137323238 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:39.708693 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f7a703f7-51d3-459a-96e3-97b137323238 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:39.710312 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f7a703f7-51d3-459a-96e3-97b137323238 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] 10.222.0.42 "GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748" status: 200 len: 1383 microversion: 2.47 time: 0.387480 Oct 23 01:28:39.714703 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2082/4234] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:39 2022] GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748 => generated 1383 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:39.795241 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-818a1133-d05b-4dec-9db1-decf59c8679d tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images/detail?changes-since=2022-10-23T01%3A26%3A16Z" status: 200 len: 6326 microversion: 2.1 time: 0.239189 Oct 23 01:28:39.822658 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2153/4235] 10.222.0.42 () {58 vars in 1220 bytes} [Sun Oct 23 01:28:39 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-23T01%3A26%3A16Z => generated 6326 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:28:39.823743 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-39e0d7e7-53c4-45e4-b07e-4d39ba437592 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc1658670>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:39.918256 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-39e0d7e7-53c4-45e4-b07e-4d39ba437592 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-932851473" status: 200 len: 664 microversion: 2.1 time: 0.098717 Oct 23 01:28:39.932015 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2083/4236] 10.222.0.42 () {58 vars in 1250 bytes} [Sun Oct 23 01:28:39 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-932851473 => generated 664 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:28:39.937536 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-eb3d3fc8-a833-40df-82ff-8a8d5231f20a tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc18eddc0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:40.012082 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-eb3d3fc8-a833-40df-82ff-8a8d5231f20a tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.42%2Fcompute%2Fv2.1%2Fservers%2F36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb" status: 200 len: 1465 microversion: 2.1 time: 0.078279 Oct 23 01:28:40.024793 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2154/4237] 10.222.0.42 () {58 vars in 1338 bytes} [Sun Oct 23 01:28:39 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.42%2Fcompute%2Fv2.1%2Fservers%2F36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb => generated 1465 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:28:40.036437 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2a78acd9-9d7e-4f18-bf5e-bd949e4a8d58 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc1661670>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:40.153067 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2a78acd9-9d7e-4f18-bf5e-bd949e4a8d58 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.42%2Fcompute%2Fservers%2F36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb" status: 200 len: 1465 microversion: 2.1 time: 0.120497 Oct 23 01:28:40.165502 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2084/4238] 10.222.0.42 () {58 vars in 1324 bytes} [Sun Oct 23 01:28:40 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.42%2Fcompute%2Fservers%2F36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb => generated 1465 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:28:40.180187 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f0b54edf-aada-444f-a476-6a07d49c855b tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc221c280>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:40.335182 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f0b54edf-aada-444f-a476-6a07d49c855b tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7101 microversion: 2.1 time: 0.159479 Oct 23 01:28:40.340410 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2155/4239] 10.222.0.42 () {58 vars in 1170 bytes} [Sun Oct 23 01:28:40 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7101 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:28:40.363120 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-007d3dec-4650-401e-862f-d79d19b8fec5 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc164c550>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:40.515882 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-007d3dec-4650-401e-862f-d79d19b8fec5 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4369 microversion: 2.1 time: 0.151047 Oct 23 01:28:40.530959 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2085/4240] 10.222.0.42 () {58 vars in 1170 bytes} [Sun Oct 23 01:28:40 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4369 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:28:40.541923 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e26af9a6-f893-4223-9abc-5b6f2202e6f6 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc2201040>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:40.586670 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ec3a9c57-58f6-4c05-a84d-38145f775eba tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:40.587294 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ec3a9c57-58f6-4c05-a84d-38145f775eba tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:40.604781 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec3a9c57-58f6-4c05-a84d-38145f775eba tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:40.605350 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec3a9c57-58f6-4c05-a84d-38145f775eba tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:40.605792 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec3a9c57-58f6-4c05-a84d-38145f775eba tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:40.608875 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec3a9c57-58f6-4c05-a84d-38145f775eba tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:40.610278 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec3a9c57-58f6-4c05-a84d-38145f775eba tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:40.610882 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec3a9c57-58f6-4c05-a84d-38145f775eba tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:40.676329 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e26af9a6-f893-4223-9abc-5b6f2202e6f6 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images/446b40bc-db5b-4123-9278-997bd6d04a0d" status: 200 len: 784 microversion: 2.1 time: 0.140059 Oct 23 01:28:40.676921 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2156/4241] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:28:40 2022] GET /compute/v2.1/images/446b40bc-db5b-4123-9278-997bd6d04a0d => generated 784 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:28:40.699260 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8ac39618-d2ac-4673-9e33-05b3420c9f92 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc0fba310>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:40.789885 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8ac39618-d2ac-4673-9e33-05b3420c9f92 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1608 microversion: 2.1 time: 0.101051 Oct 23 01:28:40.801029 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2157/4242] 10.222.0.42 () {58 vars in 1158 bytes} [Sun Oct 23 01:28:40 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1608 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:28:40.808075 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-141c0615-645a-46d5-92d4-eef63b298742 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:40.808668 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-141c0615-645a-46d5-92d4-eef63b298742 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] [instance: b527a7c5-fec9-4b19-9bf0-b7f4aafa9748] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:40.833690 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-141c0615-645a-46d5-92d4-eef63b298742 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:40.834240 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-141c0615-645a-46d5-92d4-eef63b298742 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:40.834691 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-141c0615-645a-46d5-92d4-eef63b298742 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:40.835409 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-141c0615-645a-46d5-92d4-eef63b298742 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:40.843287 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-141c0615-645a-46d5-92d4-eef63b298742 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:40.843960 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-141c0615-645a-46d5-92d4-eef63b298742 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:41.177136 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-141c0615-645a-46d5-92d4-eef63b298742 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:41.225115 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-141c0615-645a-46d5-92d4-eef63b298742 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:41.241496 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-141c0615-645a-46d5-92d4-eef63b298742 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:41.245490 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-141c0615-645a-46d5-92d4-eef63b298742 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] 10.222.0.42 "GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748" status: 200 len: 1371 microversion: 2.47 time: 0.450326 Oct 23 01:28:41.253424 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2158/4243] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:40 2022] GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748 => generated 1371 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:41.280513 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-18ed9748-35d7-4430-aa1f-d7c6ca462b8f tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc2201ca0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:41.427319 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ec3a9c57-58f6-4c05-a84d-38145f775eba tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:41.453237 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ec3a9c57-58f6-4c05-a84d-38145f775eba tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:41.453237 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ec3a9c57-58f6-4c05-a84d-38145f775eba tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:41.479265 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ec3a9c57-58f6-4c05-a84d-38145f775eba tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1806 microversion: 2.20 time: 0.896736 Oct 23 01:28:41.482598 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2086/4244] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:40 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1806 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:42.284254 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-82468ab4-31ae-4bf4-a7ba-aa86c5bb9237 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:42.285399 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-82468ab4-31ae-4bf4-a7ba-aa86c5bb9237 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] [instance: b527a7c5-fec9-4b19-9bf0-b7f4aafa9748] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:42.301795 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-82468ab4-31ae-4bf4-a7ba-aa86c5bb9237 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:42.302528 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-82468ab4-31ae-4bf4-a7ba-aa86c5bb9237 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:42.303332 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-82468ab4-31ae-4bf4-a7ba-aa86c5bb9237 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:42.304151 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-82468ab4-31ae-4bf4-a7ba-aa86c5bb9237 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:42.306529 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-82468ab4-31ae-4bf4-a7ba-aa86c5bb9237 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:42.307939 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-82468ab4-31ae-4bf4-a7ba-aa86c5bb9237 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:42.711542 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-82468ab4-31ae-4bf4-a7ba-aa86c5bb9237 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:42.729005 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-82468ab4-31ae-4bf4-a7ba-aa86c5bb9237 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:42.733480 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-82468ab4-31ae-4bf4-a7ba-aa86c5bb9237 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:42.734724 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-82468ab4-31ae-4bf4-a7ba-aa86c5bb9237 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] 10.222.0.42 "GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748" status: 200 len: 1371 microversion: 2.47 time: 0.454404 Oct 23 01:28:42.746468 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2087/4245] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:42 2022] GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748 => generated 1371 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:42.753776 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f9f0d9bf-eaab-47e1-8c5a-d583c641dde0 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:42.753776 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f9f0d9bf-eaab-47e1-8c5a-d583c641dde0 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:42.778638 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f9f0d9bf-eaab-47e1-8c5a-d583c641dde0 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:42.779152 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f9f0d9bf-eaab-47e1-8c5a-d583c641dde0 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:42.779592 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f9f0d9bf-eaab-47e1-8c5a-d583c641dde0 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:42.782375 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f9f0d9bf-eaab-47e1-8c5a-d583c641dde0 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:42.782375 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f9f0d9bf-eaab-47e1-8c5a-d583c641dde0 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:42.782375 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f9f0d9bf-eaab-47e1-8c5a-d583c641dde0 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:43.330131 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f9f0d9bf-eaab-47e1-8c5a-d583c641dde0 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:43.340442 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f9f0d9bf-eaab-47e1-8c5a-d583c641dde0 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:43.353843 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f9f0d9bf-eaab-47e1-8c5a-d583c641dde0 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:43.353843 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f9f0d9bf-eaab-47e1-8c5a-d583c641dde0 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1806 microversion: 2.20 time: 0.605301 Oct 23 01:28:43.357494 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2088/4246] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:42 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1806 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:43.768792 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f99ef369-1707-45bc-bf3b-14fbef9e0229 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:43.769476 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f99ef369-1707-45bc-bf3b-14fbef9e0229 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] [instance: b527a7c5-fec9-4b19-9bf0-b7f4aafa9748] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:43.782492 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f99ef369-1707-45bc-bf3b-14fbef9e0229 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:43.782989 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f99ef369-1707-45bc-bf3b-14fbef9e0229 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:43.783424 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f99ef369-1707-45bc-bf3b-14fbef9e0229 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:43.784127 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f99ef369-1707-45bc-bf3b-14fbef9e0229 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:43.784573 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f99ef369-1707-45bc-bf3b-14fbef9e0229 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:43.787922 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f99ef369-1707-45bc-bf3b-14fbef9e0229 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:44.066283 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f99ef369-1707-45bc-bf3b-14fbef9e0229 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:44.075577 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f99ef369-1707-45bc-bf3b-14fbef9e0229 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:44.086343 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f99ef369-1707-45bc-bf3b-14fbef9e0229 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:44.115317 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f99ef369-1707-45bc-bf3b-14fbef9e0229 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] 10.222.0.42 "GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748" status: 200 len: 1356 microversion: 2.47 time: 0.350482 Oct 23 01:28:44.122364 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2089/4247] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:43 2022] GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748 => generated 1356 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:44.157361 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ba10c875-57a2-4116-8e2b-79758cf6b33d tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:44.172321 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ba10c875-57a2-4116-8e2b-79758cf6b33d tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:44.175448 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ba10c875-57a2-4116-8e2b-79758cf6b33d tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Searching by: {'deleted': False, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a'} {{(pid=120945) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 23 01:28:44.192570 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ba10c875-57a2-4116-8e2b-79758cf6b33d tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:44.193814 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ba10c875-57a2-4116-8e2b-79758cf6b33d tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:44.195643 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ba10c875-57a2-4116-8e2b-79758cf6b33d tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:44.214126 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ba10c875-57a2-4116-8e2b-79758cf6b33d tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:44.220894 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ba10c875-57a2-4116-8e2b-79758cf6b33d tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:44.222085 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ba10c875-57a2-4116-8e2b-79758cf6b33d tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:44.532455 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.multi_cell_list [None req-ba10c875-57a2-4116-8e2b-79758cf6b33d tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120945) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 23 01:28:44.566143 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-18ed9748-35d7-4430-aa1f-d7c6ca462b8f tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "DELETE /compute/v2.1/images/6f92eb4d-aa9a-45ce-b0c6-6c58ec4bc45b" status: 204 len: 0 microversion: 2.1 time: 3.313440 Oct 23 01:28:44.567448 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2159/4248] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:28:41 2022] DELETE /compute/v2.1/images/6f92eb4d-aa9a-45ce-b0c6-6c58ec4bc45b => generated 0 bytes in 3317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:28:44.573021 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6c5c45d3-75e8-4577-abbc-3e4d093acd18 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:44.573848 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6c5c45d3-75e8-4577-abbc-3e4d093acd18 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:44.592579 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6c5c45d3-75e8-4577-abbc-3e4d093acd18 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:44.595054 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6c5c45d3-75e8-4577-abbc-3e4d093acd18 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:44.595054 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6c5c45d3-75e8-4577-abbc-3e4d093acd18 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:44.595054 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6c5c45d3-75e8-4577-abbc-3e4d093acd18 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:44.595054 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6c5c45d3-75e8-4577-abbc-3e4d093acd18 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:44.595397 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6c5c45d3-75e8-4577-abbc-3e4d093acd18 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:44.751134 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ba10c875-57a2-4116-8e2b-79758cf6b33d tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:44.769448 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ba10c875-57a2-4116-8e2b-79758cf6b33d tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:44.771182 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ba10c875-57a2-4116-8e2b-79758cf6b33d tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:44.771775 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ba10c875-57a2-4116-8e2b-79758cf6b33d tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:44.795135 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ba10c875-57a2-4116-8e2b-79758cf6b33d tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:44.796943 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ba10c875-57a2-4116-8e2b-79758cf6b33d tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:45.042154 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ba10c875-57a2-4116-8e2b-79758cf6b33d tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] 10.222.0.42 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.888823 Oct 23 01:28:45.052330 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2090/4249] 10.222.0.42 () {60 vars in 1187 bytes} [Sun Oct 23 01:28:44 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:28:45.052330 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-09481e0f-86b1-470c-863c-741619e32983 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc16a4790>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:45.183125 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6c5c45d3-75e8-4577-abbc-3e4d093acd18 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:45.227132 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6c5c45d3-75e8-4577-abbc-3e4d093acd18 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:45.252736 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6c5c45d3-75e8-4577-abbc-3e4d093acd18 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:45.255316 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6c5c45d3-75e8-4577-abbc-3e4d093acd18 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1806 microversion: 2.20 time: 0.686225 Oct 23 01:28:45.256014 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2160/4250] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:44 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1806 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:45.306756 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0912988d-9661-4bfa-8c28-c5ef5fbd70fb tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:45.307590 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0912988d-9661-4bfa-8c28-c5ef5fbd70fb tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] [instance: b527a7c5-fec9-4b19-9bf0-b7f4aafa9748] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:45.384393 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0912988d-9661-4bfa-8c28-c5ef5fbd70fb tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:45.385377 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0912988d-9661-4bfa-8c28-c5ef5fbd70fb tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:45.390912 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0912988d-9661-4bfa-8c28-c5ef5fbd70fb tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:45.392080 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0912988d-9661-4bfa-8c28-c5ef5fbd70fb tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:45.392857 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0912988d-9661-4bfa-8c28-c5ef5fbd70fb tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:45.400786 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0912988d-9661-4bfa-8c28-c5ef5fbd70fb tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:45.480664 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0912988d-9661-4bfa-8c28-c5ef5fbd70fb tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] [instance: b527a7c5-fec9-4b19-9bf0-b7f4aafa9748] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:28:47.290920 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0912988d-9661-4bfa-8c28-c5ef5fbd70fb tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748" status: 204 len: 0 microversion: 2.47 time: 2.033138 Oct 23 01:28:47.292679 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2161/4251] 10.222.0.42 () {60 vars in 1280 bytes} [Sun Oct 23 01:28:45 2022] DELETE /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748 => generated 0 bytes in 2036 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 23 01:28:47.298764 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5b96fc1e-9944-440d-bad0-725845481e7a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:47.301872 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5b96fc1e-9944-440d-bad0-725845481e7a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:47.306924 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b96fc1e-9944-440d-bad0-725845481e7a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:47.307612 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b96fc1e-9944-440d-bad0-725845481e7a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:47.308531 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b96fc1e-9944-440d-bad0-725845481e7a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:47.308861 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b96fc1e-9944-440d-bad0-725845481e7a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:47.309176 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b96fc1e-9944-440d-bad0-725845481e7a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:47.309601 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b96fc1e-9944-440d-bad0-725845481e7a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:47.736497 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5b96fc1e-9944-440d-bad0-725845481e7a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:47.757004 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5b96fc1e-9944-440d-bad0-725845481e7a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:47.762042 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5b96fc1e-9944-440d-bad0-725845481e7a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:47.782119 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5b96fc1e-9944-440d-bad0-725845481e7a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1806 microversion: 2.20 time: 0.473629 Oct 23 01:28:47.782119 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2162/4252] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:47 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1806 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:47.782119 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-41557610-8627-4a25-a180-b210206a3ff6 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:47.795331 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-41557610-8627-4a25-a180-b210206a3ff6 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] [instance: b527a7c5-fec9-4b19-9bf0-b7f4aafa9748] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:47.806979 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41557610-8627-4a25-a180-b210206a3ff6 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:47.807798 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41557610-8627-4a25-a180-b210206a3ff6 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:47.808400 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41557610-8627-4a25-a180-b210206a3ff6 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:47.809380 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41557610-8627-4a25-a180-b210206a3ff6 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:47.809901 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41557610-8627-4a25-a180-b210206a3ff6 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:47.810562 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41557610-8627-4a25-a180-b210206a3ff6 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:47.911135 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-41557610-8627-4a25-a180-b210206a3ff6 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:47.925237 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-41557610-8627-4a25-a180-b210206a3ff6 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:47.926737 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-41557610-8627-4a25-a180-b210206a3ff6 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:47.928323 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-41557610-8627-4a25-a180-b210206a3ff6 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] 10.222.0.42 "GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748" status: 200 len: 1362 microversion: 2.47 time: 0.150111 Oct 23 01:28:47.934715 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2163/4253] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:47 2022] GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:48.797197 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b50b9d85-9105-49ac-abc4-7bf8c97f0882 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:48.797931 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b50b9d85-9105-49ac-abc4-7bf8c97f0882 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:48.810222 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b50b9d85-9105-49ac-abc4-7bf8c97f0882 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:48.810723 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b50b9d85-9105-49ac-abc4-7bf8c97f0882 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:48.811169 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b50b9d85-9105-49ac-abc4-7bf8c97f0882 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:48.811887 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b50b9d85-9105-49ac-abc4-7bf8c97f0882 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:48.817440 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b50b9d85-9105-49ac-abc4-7bf8c97f0882 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:48.820967 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b50b9d85-9105-49ac-abc4-7bf8c97f0882 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:49.151598 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b50b9d85-9105-49ac-abc4-7bf8c97f0882 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:49.161032 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b50b9d85-9105-49ac-abc4-7bf8c97f0882 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:49.162560 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b50b9d85-9105-49ac-abc4-7bf8c97f0882 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:49.164383 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b50b9d85-9105-49ac-abc4-7bf8c97f0882 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1806 microversion: 2.20 time: 0.370788 Oct 23 01:28:49.175693 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2164/4254] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:48 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1806 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:49.193613 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9ce4ae1d-14db-4a98-b083-cf87f51fa6be tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:49.194294 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9ce4ae1d-14db-4a98-b083-cf87f51fa6be tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] [instance: b527a7c5-fec9-4b19-9bf0-b7f4aafa9748] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:49.218125 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ce4ae1d-14db-4a98-b083-cf87f51fa6be tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:49.218633 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ce4ae1d-14db-4a98-b083-cf87f51fa6be tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:49.219075 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ce4ae1d-14db-4a98-b083-cf87f51fa6be tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:49.219871 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ce4ae1d-14db-4a98-b083-cf87f51fa6be tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:49.220254 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ce4ae1d-14db-4a98-b083-cf87f51fa6be tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:49.220717 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ce4ae1d-14db-4a98-b083-cf87f51fa6be tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:49.313518 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9ce4ae1d-14db-4a98-b083-cf87f51fa6be tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:49.322916 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9ce4ae1d-14db-4a98-b083-cf87f51fa6be tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:49.324650 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9ce4ae1d-14db-4a98-b083-cf87f51fa6be tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:49.338875 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9ce4ae1d-14db-4a98-b083-cf87f51fa6be tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] 10.222.0.42 "GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748" status: 200 len: 1362 microversion: 2.47 time: 0.144791 Oct 23 01:28:49.338875 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2165/4255] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:49 2022] GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748 => generated 1362 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:50.202212 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-09481e0f-86b1-470c-863c-741619e32983 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "DELETE /compute/v2.1/images/15656f0b-ee3c-4916-9e79-9548ba759af5" status: 204 len: 0 microversion: 2.1 time: 5.157794 Oct 23 01:28:50.208481 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2091/4256] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:28:45 2022] DELETE /compute/v2.1/images/15656f0b-ee3c-4916-9e79-9548ba759af5 => generated 0 bytes in 5159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:28:50.208626 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b83d74fe-8ce0-419a-8f0a-e69f6c01d35f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:50.213405 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2d335228-2897-4fcb-aafc-6657e5fc3d93 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc15ad700>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:50.213966 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b83d74fe-8ce0-419a-8f0a-e69f6c01d35f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:50.228859 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b83d74fe-8ce0-419a-8f0a-e69f6c01d35f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:50.231065 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b83d74fe-8ce0-419a-8f0a-e69f6c01d35f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:50.233388 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b83d74fe-8ce0-419a-8f0a-e69f6c01d35f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:50.234582 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b83d74fe-8ce0-419a-8f0a-e69f6c01d35f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:50.235127 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b83d74fe-8ce0-419a-8f0a-e69f6c01d35f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:50.235564 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b83d74fe-8ce0-419a-8f0a-e69f6c01d35f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:50.592503 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b83d74fe-8ce0-419a-8f0a-e69f6c01d35f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:50.604460 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b83d74fe-8ce0-419a-8f0a-e69f6c01d35f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:50.611059 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b83d74fe-8ce0-419a-8f0a-e69f6c01d35f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:50.613105 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b83d74fe-8ce0-419a-8f0a-e69f6c01d35f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1806 microversion: 2.20 time: 0.421515 Oct 23 01:28:50.623781 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2166/4257] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:50 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1806 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:50.631246 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c83f622b-df33-4ef4-b15d-16802d787d36 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:50.632281 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c83f622b-df33-4ef4-b15d-16802d787d36 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] [instance: b527a7c5-fec9-4b19-9bf0-b7f4aafa9748] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:50.648221 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c83f622b-df33-4ef4-b15d-16802d787d36 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:50.648726 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c83f622b-df33-4ef4-b15d-16802d787d36 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:50.649196 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c83f622b-df33-4ef4-b15d-16802d787d36 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:50.649912 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c83f622b-df33-4ef4-b15d-16802d787d36 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:50.658225 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c83f622b-df33-4ef4-b15d-16802d787d36 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:50.658692 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c83f622b-df33-4ef4-b15d-16802d787d36 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:50.735991 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c83f622b-df33-4ef4-b15d-16802d787d36 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:50.737064 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c83f622b-df33-4ef4-b15d-16802d787d36 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:50.737528 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c83f622b-df33-4ef4-b15d-16802d787d36 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:50.738064 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-c83f622b-df33-4ef4-b15d-16802d787d36 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lazy-loading 'fault' on Instance uuid b527a7c5-fec9-4b19-9bf0-b7f4aafa9748 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:28:50.817670 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c83f622b-df33-4ef4-b15d-16802d787d36 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:50.829655 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c83f622b-df33-4ef4-b15d-16802d787d36 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:50.831660 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c83f622b-df33-4ef4-b15d-16802d787d36 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:50.833437 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c83f622b-df33-4ef4-b15d-16802d787d36 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] 10.222.0.42 "GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748" status: 200 len: 1367 microversion: 2.47 time: 0.218514 Oct 23 01:28:50.834558 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2167/4258] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:50 2022] GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748 => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:51.641413 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-40404d81-91f7-4a28-9508-4cc715ed56bc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:51.642121 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-40404d81-91f7-4a28-9508-4cc715ed56bc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:51.655919 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-40404d81-91f7-4a28-9508-4cc715ed56bc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:51.656495 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-40404d81-91f7-4a28-9508-4cc715ed56bc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:51.657892 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-40404d81-91f7-4a28-9508-4cc715ed56bc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:51.660867 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-40404d81-91f7-4a28-9508-4cc715ed56bc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:51.661549 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-40404d81-91f7-4a28-9508-4cc715ed56bc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:51.662593 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-40404d81-91f7-4a28-9508-4cc715ed56bc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:51.986484 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-40404d81-91f7-4a28-9508-4cc715ed56bc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:52.034673 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-40404d81-91f7-4a28-9508-4cc715ed56bc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:52.045215 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-40404d81-91f7-4a28-9508-4cc715ed56bc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:52.067832 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-40404d81-91f7-4a28-9508-4cc715ed56bc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1806 microversion: 2.20 time: 0.428205 Oct 23 01:28:52.084139 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2168/4259] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:51 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1806 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:52.103642 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9741be84-f5b5-4120-af49-f0dae46c9836 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:52.105734 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9741be84-f5b5-4120-af49-f0dae46c9836 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] [instance: b527a7c5-fec9-4b19-9bf0-b7f4aafa9748] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:52.112029 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9741be84-f5b5-4120-af49-f0dae46c9836 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:52.112734 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9741be84-f5b5-4120-af49-f0dae46c9836 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:52.113458 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9741be84-f5b5-4120-af49-f0dae46c9836 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:52.116766 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9741be84-f5b5-4120-af49-f0dae46c9836 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:52.117458 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9741be84-f5b5-4120-af49-f0dae46c9836 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:52.118514 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9741be84-f5b5-4120-af49-f0dae46c9836 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:52.165733 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9741be84-f5b5-4120-af49-f0dae46c9836 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:52.166684 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9741be84-f5b5-4120-af49-f0dae46c9836 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:52.167283 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9741be84-f5b5-4120-af49-f0dae46c9836 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:52.167890 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-9741be84-f5b5-4120-af49-f0dae46c9836 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lazy-loading 'fault' on Instance uuid b527a7c5-fec9-4b19-9bf0-b7f4aafa9748 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:28:52.239701 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9741be84-f5b5-4120-af49-f0dae46c9836 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:52.248734 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9741be84-f5b5-4120-af49-f0dae46c9836 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:52.250346 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9741be84-f5b5-4120-af49-f0dae46c9836 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:52.251542 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9741be84-f5b5-4120-af49-f0dae46c9836 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] 10.222.0.42 "GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748" status: 200 len: 1367 microversion: 2.47 time: 0.166154 Oct 23 01:28:52.252110 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2169/4260] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:52 2022] GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:52.604690 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2d335228-2897-4fcb-aafc-6657e5fc3d93 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "DELETE /compute/v2.1/images/89659f78-4b73-4b12-9f93-4de7578793dd" status: 204 len: 0 microversion: 2.1 time: 2.396512 Oct 23 01:28:52.605279 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2092/4261] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:28:50 2022] DELETE /compute/v2.1/images/89659f78-4b73-4b12-9f93-4de7578793dd => generated 0 bytes in 2398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:28:52.615468 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5f11d2d9-aadd-4bea-992a-f488d4847d98 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:52.615957 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5f11d2d9-aadd-4bea-992a-f488d4847d98 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] [instance: 36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:52.631859 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f11d2d9-aadd-4bea-992a-f488d4847d98 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:52.634267 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f11d2d9-aadd-4bea-992a-f488d4847d98 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:52.641564 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f11d2d9-aadd-4bea-992a-f488d4847d98 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:52.641564 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f11d2d9-aadd-4bea-992a-f488d4847d98 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:52.646208 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f11d2d9-aadd-4bea-992a-f488d4847d98 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:52.646767 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f11d2d9-aadd-4bea-992a-f488d4847d98 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:52.673754 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:28:52.677439 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5f11d2d9-aadd-4bea-992a-f488d4847d98 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] [instance: 36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:28:53.101871 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e8ff65af-c686-40cb-9343-692f33904634 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:53.102600 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e8ff65af-c686-40cb-9343-692f33904634 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:53.116317 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8ff65af-c686-40cb-9343-692f33904634 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:53.116882 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8ff65af-c686-40cb-9343-692f33904634 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:53.117503 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8ff65af-c686-40cb-9343-692f33904634 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:53.122177 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8ff65af-c686-40cb-9343-692f33904634 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:53.122656 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8ff65af-c686-40cb-9343-692f33904634 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:53.123319 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8ff65af-c686-40cb-9343-692f33904634 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:53.153469 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5f11d2d9-aadd-4bea-992a-f488d4847d98 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "DELETE /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb" status: 204 len: 0 microversion: 2.1 time: 0.543344 Oct 23 01:28:53.154169 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2170/4262] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:28:52 2022] DELETE /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb => generated 0 bytes in 545 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:28:53.171056 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2acfeb2c-d987-40cc-a65f-0e15c065562f tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:53.171883 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2acfeb2c-d987-40cc-a65f-0e15c065562f tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] [instance: 36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:53.179390 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2acfeb2c-d987-40cc-a65f-0e15c065562f tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:53.179909 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2acfeb2c-d987-40cc-a65f-0e15c065562f tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:53.180686 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2acfeb2c-d987-40cc-a65f-0e15c065562f tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:53.182458 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2acfeb2c-d987-40cc-a65f-0e15c065562f tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:53.182946 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2acfeb2c-d987-40cc-a65f-0e15c065562f tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:53.183430 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2acfeb2c-d987-40cc-a65f-0e15c065562f tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:53.414932 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e8ff65af-c686-40cb-9343-692f33904634 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:53.432499 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2acfeb2c-d987-40cc-a65f-0e15c065562f tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86e186e88524064b8dca040c1814927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf35beeccb814ce490d2142b21c2b1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:53.439671 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e8ff65af-c686-40cb-9343-692f33904634 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:53.441320 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e8ff65af-c686-40cb-9343-692f33904634 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:53.442541 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e8ff65af-c686-40cb-9343-692f33904634 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1806 microversion: 2.20 time: 0.346665 Oct 23 01:28:53.447003 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2093/4263] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:53 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1806 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:28:53.448828 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fa2ab82f-c5a3-44b3-ab5d-a742a6b2305a tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:53.449752 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-fa2ab82f-c5a3-44b3-ab5d-a742a6b2305a tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] [instance: b527a7c5-fec9-4b19-9bf0-b7f4aafa9748] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:53.455293 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2acfeb2c-d987-40cc-a65f-0e15c065562f tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb" status: 200 len: 1473 microversion: 2.1 time: 0.295613 Oct 23 01:28:53.455907 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2171/4264] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:28:53 2022] GET /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb => generated 1473 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:28:53.470116 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fa2ab82f-c5a3-44b3-ab5d-a742a6b2305a tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:53.471237 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fa2ab82f-c5a3-44b3-ab5d-a742a6b2305a tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:53.471827 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fa2ab82f-c5a3-44b3-ab5d-a742a6b2305a tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:53.472715 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fa2ab82f-c5a3-44b3-ab5d-a742a6b2305a tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:53.473277 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fa2ab82f-c5a3-44b3-ab5d-a742a6b2305a tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:53.473907 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fa2ab82f-c5a3-44b3-ab5d-a742a6b2305a tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:53.490433 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-fa2ab82f-c5a3-44b3-ab5d-a742a6b2305a tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] HTTP exception thrown: Instance b527a7c5-fec9-4b19-9bf0-b7f4aafa9748 could not be found. Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fa2ab82f-c5a3-44b3-ab5d-a742a6b2305a tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Request method failure captured: Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748 HTTP/1.1 Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJiXZRjiE0IYRCR4iui_DjmTMLnAlTIlIo3pntsPp17L7HxH1-g6g1lC9kDJe4sMvjiRppYBWBWXGZEnFfPfwzjehNNqZaAhxibBzzKOevRvVMpTlj4e6ydsKtNtz7kelAfe4AC8crnl-NUN5IvJv-_YKSrrevBVPVGtVwxKsQYvAmw Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: X-Openstack-Nova-Api-Version: 2.47 Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: f0e82c5d57e54c3ba4d310bcb96b4e2a Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServerShowV247Test-752883117 Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f0e82c5d57e54c3ba4d310bcb96b4e2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f0e82c5d57e54c3ba4d310bcb96b4e2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f0e82c5d57e54c3ba4d310bcb96b4e2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f0e82c5d57e54c3ba4d310bcb96b4e2a"}]}] Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServerShowV247Test-752883117 Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: f0e82c5d57e54c3ba4d310bcb96b4e2a Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServerShowV247Test-752883117 Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServerShowV247Test-752883117-project Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 9945803bd26745a8b3ccb508f7cd2a38 Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServerShowV247Test-752883117-project Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: exception: Instance b527a7c5-fec9-4b19-9bf0-b7f4aafa9748 could not be found. Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'b527a7c5-fec9-4b19-9bf0-b7f4aafa9748'} Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b527a7c5-fec9-4b19-9bf0-b7f4aafa9748 could not be found. Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b527a7c5-fec9-4b19-9bf0-b7f4aafa9748 could not be found. Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:28:53.491784 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:28:53.496345 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:28:53.496345 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:28:53.496345 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:28:53.496345 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:28:53.496345 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:28:53.496345 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b527a7c5-fec9-4b19-9bf0-b7f4aafa9748 could not be found. Oct 23 01:28:53.496345 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:28:53.496345 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fa2ab82f-c5a3-44b3-ab5d-a742a6b2305a tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Returning 404 to user: Instance b527a7c5-fec9-4b19-9bf0-b7f4aafa9748 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:28:53.496345 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fa2ab82f-c5a3-44b3-ab5d-a742a6b2305a tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] 10.222.0.42 "GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748" status: 404 len: 111 microversion: 2.47 time: 0.049028 Oct 23 01:28:53.496345 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2094/4265] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:53 2022] GET /compute/v2.1/servers/b527a7c5-fec9-4b19-9bf0-b7f4aafa9748 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:28:53.503324 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e024deed-6d79-43cf-9dcd-1cb4a5b00a1b tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:53.503924 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e024deed-6d79-43cf-9dcd-1cb4a5b00a1b tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] [instance: ce31e873-63e4-4af4-b33d-5f994553545b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:53.511968 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e024deed-6d79-43cf-9dcd-1cb4a5b00a1b tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:53.512660 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e024deed-6d79-43cf-9dcd-1cb4a5b00a1b tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:53.513104 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e024deed-6d79-43cf-9dcd-1cb4a5b00a1b tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:53.513874 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e024deed-6d79-43cf-9dcd-1cb4a5b00a1b tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:53.514294 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e024deed-6d79-43cf-9dcd-1cb4a5b00a1b tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:53.514730 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e024deed-6d79-43cf-9dcd-1cb4a5b00a1b tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:53.545762 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e024deed-6d79-43cf-9dcd-1cb4a5b00a1b tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] [instance: ce31e873-63e4-4af4-b33d-5f994553545b] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:28:53.964456 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e024deed-6d79-43cf-9dcd-1cb4a5b00a1b tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ce31e873-63e4-4af4-b33d-5f994553545b" status: 204 len: 0 microversion: 2.47 time: 0.465608 Oct 23 01:28:53.969039 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2172/4266] 10.222.0.42 () {60 vars in 1280 bytes} [Sun Oct 23 01:28:53 2022] DELETE /compute/v2.1/servers/ce31e873-63e4-4af4-b33d-5f994553545b => generated 0 bytes in 468 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 23 01:28:53.974619 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9c9b8e8c-0abe-4604-b4e3-8da1da56ec40 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:53.976622 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9c9b8e8c-0abe-4604-b4e3-8da1da56ec40 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] [instance: ce31e873-63e4-4af4-b33d-5f994553545b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:53.983327 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9c9b8e8c-0abe-4604-b4e3-8da1da56ec40 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:53.984085 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9c9b8e8c-0abe-4604-b4e3-8da1da56ec40 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:53.984795 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9c9b8e8c-0abe-4604-b4e3-8da1da56ec40 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:53.985729 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9c9b8e8c-0abe-4604-b4e3-8da1da56ec40 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:53.986432 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9c9b8e8c-0abe-4604-b4e3-8da1da56ec40 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:53.987063 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9c9b8e8c-0abe-4604-b4e3-8da1da56ec40 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:54.075972 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9c9b8e8c-0abe-4604-b4e3-8da1da56ec40 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:54.087373 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9c9b8e8c-0abe-4604-b4e3-8da1da56ec40 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:54.089607 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9c9b8e8c-0abe-4604-b4e3-8da1da56ec40 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:54.091387 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9c9b8e8c-0abe-4604-b4e3-8da1da56ec40 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] 10.222.0.42 "GET /compute/v2.1/servers/ce31e873-63e4-4af4-b33d-5f994553545b" status: 200 len: 1363 microversion: 2.47 time: 0.120990 Oct 23 01:28:54.092155 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2095/4267] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:53 2022] GET /compute/v2.1/servers/ce31e873-63e4-4af4-b33d-5f994553545b => generated 1363 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:54.476282 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:28:54.482752 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-00a744cf-8b78-487d-b0a3-21b2a3f9f04e tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:54.483597 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-00a744cf-8b78-487d-b0a3-21b2a3f9f04e tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] [instance: 36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:54.491323 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-486970f9-2173-49a3-9a05-511b88eff2aa tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:54.492359 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-486970f9-2173-49a3-9a05-511b88eff2aa tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:54.494371 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-00a744cf-8b78-487d-b0a3-21b2a3f9f04e tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:54.494871 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-00a744cf-8b78-487d-b0a3-21b2a3f9f04e tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:54.500437 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-00a744cf-8b78-487d-b0a3-21b2a3f9f04e tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:54.500437 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-00a744cf-8b78-487d-b0a3-21b2a3f9f04e tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:54.500437 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-00a744cf-8b78-487d-b0a3-21b2a3f9f04e tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:54.500437 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-00a744cf-8b78-487d-b0a3-21b2a3f9f04e tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:54.505342 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-486970f9-2173-49a3-9a05-511b88eff2aa tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:54.506266 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-486970f9-2173-49a3-9a05-511b88eff2aa tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:54.507799 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-486970f9-2173-49a3-9a05-511b88eff2aa tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:54.509860 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-486970f9-2173-49a3-9a05-511b88eff2aa tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:54.510900 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-486970f9-2173-49a3-9a05-511b88eff2aa tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:54.512151 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-486970f9-2173-49a3-9a05-511b88eff2aa tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:54.744033 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:28:55.196062 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-486970f9-2173-49a3-9a05-511b88eff2aa tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:55.208117 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-486970f9-2173-49a3-9a05-511b88eff2aa tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:55.210476 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-486970f9-2173-49a3-9a05-511b88eff2aa tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:55.214213 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-486970f9-2173-49a3-9a05-511b88eff2aa tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1806 microversion: 2.20 time: 0.748664 Oct 23 01:28:55.220021 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-00a744cf-8b78-487d-b0a3-21b2a3f9f04e tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86e186e88524064b8dca040c1814927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf35beeccb814ce490d2142b21c2b1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:55.233601 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2173/4268] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:54 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1806 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:55.237896 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-00a744cf-8b78-487d-b0a3-21b2a3f9f04e tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb" status: 200 len: 1473 microversion: 2.1 time: 0.762994 Oct 23 01:28:55.258428 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2096/4269] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:28:54 2022] GET /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb => generated 1473 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:28:55.262250 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-01a7d005-d8fe-4a19-b6e1-9136c43b2298 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:55.263376 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-01a7d005-d8fe-4a19-b6e1-9136c43b2298 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] [instance: ce31e873-63e4-4af4-b33d-5f994553545b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:55.325536 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01a7d005-d8fe-4a19-b6e1-9136c43b2298 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:55.328917 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01a7d005-d8fe-4a19-b6e1-9136c43b2298 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:55.329636 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01a7d005-d8fe-4a19-b6e1-9136c43b2298 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:55.330775 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01a7d005-d8fe-4a19-b6e1-9136c43b2298 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:55.331405 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01a7d005-d8fe-4a19-b6e1-9136c43b2298 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:55.332961 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01a7d005-d8fe-4a19-b6e1-9136c43b2298 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:55.470736 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-01a7d005-d8fe-4a19-b6e1-9136c43b2298 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:55.482772 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-01a7d005-d8fe-4a19-b6e1-9136c43b2298 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:55.484666 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-01a7d005-d8fe-4a19-b6e1-9136c43b2298 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:55.486547 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-01a7d005-d8fe-4a19-b6e1-9136c43b2298 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] 10.222.0.42 "GET /compute/v2.1/servers/ce31e873-63e4-4af4-b33d-5f994553545b" status: 200 len: 1363 microversion: 2.47 time: 0.251232 Oct 23 01:28:55.487692 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2174/4270] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:55 2022] GET /compute/v2.1/servers/ce31e873-63e4-4af4-b33d-5f994553545b => generated 1363 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:56.265678 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-76a0937e-f099-481b-a378-948dc3a620d7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:56.266411 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-76a0937e-f099-481b-a378-948dc3a620d7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:56.268632 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bd1d4038-6811-4ed2-b2f8-0f9065690ef3 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:56.270409 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bd1d4038-6811-4ed2-b2f8-0f9065690ef3 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] [instance: 36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:56.276135 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-76a0937e-f099-481b-a378-948dc3a620d7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:56.276917 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-76a0937e-f099-481b-a378-948dc3a620d7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:56.277516 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-76a0937e-f099-481b-a378-948dc3a620d7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:56.278543 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-76a0937e-f099-481b-a378-948dc3a620d7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:56.279175 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-76a0937e-f099-481b-a378-948dc3a620d7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:56.279774 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-76a0937e-f099-481b-a378-948dc3a620d7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:56.296171 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bd1d4038-6811-4ed2-b2f8-0f9065690ef3 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:56.297408 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bd1d4038-6811-4ed2-b2f8-0f9065690ef3 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:56.298112 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bd1d4038-6811-4ed2-b2f8-0f9065690ef3 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:56.299109 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bd1d4038-6811-4ed2-b2f8-0f9065690ef3 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:56.306996 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bd1d4038-6811-4ed2-b2f8-0f9065690ef3 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:56.310698 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bd1d4038-6811-4ed2-b2f8-0f9065690ef3 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:56.477266 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bd1d4038-6811-4ed2-b2f8-0f9065690ef3 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86e186e88524064b8dca040c1814927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf35beeccb814ce490d2142b21c2b1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:56.502126 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bd1d4038-6811-4ed2-b2f8-0f9065690ef3 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb" status: 200 len: 1431 microversion: 2.1 time: 0.240029 Oct 23 01:28:56.511108 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2175/4271] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:28:56 2022] GET /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb => generated 1431 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:28:56.526330 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-4e6d91a2-fb34-4c41-aab2-d24c411325a3 req-aa799024-e9f2-49f9-b46a-1a03a4a95125 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb", "name": "network-vif-deleted", "tag": "54e7645f-922e-48c7-870d-b18d536be4be"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:28:56.537700 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-4e6d91a2-fb34-4c41-aab2-d24c411325a3 req-aa799024-e9f2-49f9-b46a-1a03a4a95125 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:56.544570 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-4e6d91a2-fb34-4c41-aab2-d24c411325a3 req-aa799024-e9f2-49f9-b46a-1a03a4a95125 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:56.544570 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-4e6d91a2-fb34-4c41-aab2-d24c411325a3 req-aa799024-e9f2-49f9-b46a-1a03a4a95125 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:56.557812 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-4e6d91a2-fb34-4c41-aab2-d24c411325a3 req-aa799024-e9f2-49f9-b46a-1a03a4a95125 service nova] Creating event network-vif-deleted:54e7645f-922e-48c7-870d-b18d536be4be for instance 36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb on n-h1-master-1 Oct 23 01:28:56.566496 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-4e6d91a2-fb34-4c41-aab2-d24c411325a3 req-aa799024-e9f2-49f9-b46a-1a03a4a95125 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053210 Oct 23 01:28:56.567727 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2176/4272] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:28:56.573997 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-523c8ba7-49d1-4314-8f79-28f37c3150d4 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:56.575205 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-523c8ba7-49d1-4314-8f79-28f37c3150d4 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] [instance: ce31e873-63e4-4af4-b33d-5f994553545b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:56.582563 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-523c8ba7-49d1-4314-8f79-28f37c3150d4 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:56.584754 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-523c8ba7-49d1-4314-8f79-28f37c3150d4 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:56.584754 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-523c8ba7-49d1-4314-8f79-28f37c3150d4 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:56.586472 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-523c8ba7-49d1-4314-8f79-28f37c3150d4 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:56.587299 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-523c8ba7-49d1-4314-8f79-28f37c3150d4 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:56.588121 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-523c8ba7-49d1-4314-8f79-28f37c3150d4 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:56.649832 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-523c8ba7-49d1-4314-8f79-28f37c3150d4 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:56.650375 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-523c8ba7-49d1-4314-8f79-28f37c3150d4 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:56.650824 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-523c8ba7-49d1-4314-8f79-28f37c3150d4 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:56.651291 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-523c8ba7-49d1-4314-8f79-28f37c3150d4 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lazy-loading 'fault' on Instance uuid ce31e873-63e4-4af4-b33d-5f994553545b {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:28:56.840429 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-523c8ba7-49d1-4314-8f79-28f37c3150d4 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:56.851933 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-523c8ba7-49d1-4314-8f79-28f37c3150d4 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:56.854058 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-523c8ba7-49d1-4314-8f79-28f37c3150d4 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:56.861190 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-523c8ba7-49d1-4314-8f79-28f37c3150d4 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] 10.222.0.42 "GET /compute/v2.1/servers/ce31e873-63e4-4af4-b33d-5f994553545b" status: 200 len: 1368 microversion: 2.47 time: 0.286413 Oct 23 01:28:56.861190 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2177/4273] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:56 2022] GET /compute/v2.1/servers/ce31e873-63e4-4af4-b33d-5f994553545b => generated 1368 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:56.921894 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-76a0937e-f099-481b-a378-948dc3a620d7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:56.941207 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-76a0937e-f099-481b-a378-948dc3a620d7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:56.943062 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-76a0937e-f099-481b-a378-948dc3a620d7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:56.946364 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-76a0937e-f099-481b-a378-948dc3a620d7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1806 microversion: 2.20 time: 0.685098 Oct 23 01:28:56.947494 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2097/4274] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:56 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1806 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:57.529167 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7a8a17ea-1450-4ee8-a3a1-552a1a457ecc tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:57.529790 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7a8a17ea-1450-4ee8-a3a1-552a1a457ecc tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] [instance: 36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:57.539231 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7a8a17ea-1450-4ee8-a3a1-552a1a457ecc tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:57.539231 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7a8a17ea-1450-4ee8-a3a1-552a1a457ecc tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:57.539231 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7a8a17ea-1450-4ee8-a3a1-552a1a457ecc tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:57.542453 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7a8a17ea-1450-4ee8-a3a1-552a1a457ecc tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:57.543111 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7a8a17ea-1450-4ee8-a3a1-552a1a457ecc tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:57.543692 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7a8a17ea-1450-4ee8-a3a1-552a1a457ecc tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:57.583557 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7a8a17ea-1450-4ee8-a3a1-552a1a457ecc tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:57.584119 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7a8a17ea-1450-4ee8-a3a1-552a1a457ecc tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:57.584495 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7a8a17ea-1450-4ee8-a3a1-552a1a457ecc tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:57.585170 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-7a8a17ea-1450-4ee8-a3a1-552a1a457ecc tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lazy-loading 'fault' on Instance uuid 36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:28:57.676539 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7a8a17ea-1450-4ee8-a3a1-552a1a457ecc tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86e186e88524064b8dca040c1814927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf35beeccb814ce490d2142b21c2b1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:57.690369 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7a8a17ea-1450-4ee8-a3a1-552a1a457ecc tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb" status: 200 len: 1307 microversion: 2.1 time: 0.165013 Oct 23 01:28:57.690982 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2178/4275] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:28:57 2022] GET /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb => generated 1307 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:28:57.882580 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2795ec4f-0786-4af3-84a9-18c62606e370 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:57.883203 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2795ec4f-0786-4af3-84a9-18c62606e370 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] [instance: ce31e873-63e4-4af4-b33d-5f994553545b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:57.896528 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2795ec4f-0786-4af3-84a9-18c62606e370 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:57.897825 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2795ec4f-0786-4af3-84a9-18c62606e370 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:57.899189 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2795ec4f-0786-4af3-84a9-18c62606e370 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:57.900179 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2795ec4f-0786-4af3-84a9-18c62606e370 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:57.900863 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2795ec4f-0786-4af3-84a9-18c62606e370 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:57.901493 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2795ec4f-0786-4af3-84a9-18c62606e370 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:57.979873 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-73fe04eb-7798-4a38-b0c0-edbe41944897 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:57.980918 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-73fe04eb-7798-4a38-b0c0-edbe41944897 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:57.990615 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-73fe04eb-7798-4a38-b0c0-edbe41944897 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:57.991345 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2795ec4f-0786-4af3-84a9-18c62606e370 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:57.991584 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-73fe04eb-7798-4a38-b0c0-edbe41944897 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:57.991878 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2795ec4f-0786-4af3-84a9-18c62606e370 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:57.992366 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2795ec4f-0786-4af3-84a9-18c62606e370 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:57.992741 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-73fe04eb-7798-4a38-b0c0-edbe41944897 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:57.993659 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-73fe04eb-7798-4a38-b0c0-edbe41944897 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:57.994361 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-73fe04eb-7798-4a38-b0c0-edbe41944897 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:57.994991 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-73fe04eb-7798-4a38-b0c0-edbe41944897 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:57.998719 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-2795ec4f-0786-4af3-84a9-18c62606e370 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lazy-loading 'fault' on Instance uuid ce31e873-63e4-4af4-b33d-5f994553545b {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:28:58.222391 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2795ec4f-0786-4af3-84a9-18c62606e370 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:58.235929 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2795ec4f-0786-4af3-84a9-18c62606e370 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:58.237760 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2795ec4f-0786-4af3-84a9-18c62606e370 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9945803bd26745a8b3ccb508f7cd2a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:58.239352 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2795ec4f-0786-4af3-84a9-18c62606e370 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] 10.222.0.42 "GET /compute/v2.1/servers/ce31e873-63e4-4af4-b33d-5f994553545b" status: 200 len: 1368 microversion: 2.47 time: 0.361087 Oct 23 01:28:58.240731 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2098/4276] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:57 2022] GET /compute/v2.1/servers/ce31e873-63e4-4af4-b33d-5f994553545b => generated 1368 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:58.456878 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-73fe04eb-7798-4a38-b0c0-edbe41944897 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:58.468245 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-73fe04eb-7798-4a38-b0c0-edbe41944897 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:58.469725 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-73fe04eb-7798-4a38-b0c0-edbe41944897 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:28:58.470947 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-73fe04eb-7798-4a38-b0c0-edbe41944897 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1806 microversion: 2.20 time: 0.496308 Oct 23 01:28:58.475192 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2179/4277] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:57 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1806 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:28:58.716450 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a81cb0d1-f737-4499-a607-40e96a5c8da1 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:58.717078 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a81cb0d1-f737-4499-a607-40e96a5c8da1 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] [instance: 36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:58.730783 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a81cb0d1-f737-4499-a607-40e96a5c8da1 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:58.731936 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a81cb0d1-f737-4499-a607-40e96a5c8da1 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:58.734486 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a81cb0d1-f737-4499-a607-40e96a5c8da1 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:58.736592 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a81cb0d1-f737-4499-a607-40e96a5c8da1 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:58.737241 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a81cb0d1-f737-4499-a607-40e96a5c8da1 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:58.743884 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a81cb0d1-f737-4499-a607-40e96a5c8da1 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:58.776089 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e5e7089a-c042-47d9-aab1-db0d732e9854 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:58.778754 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e5e7089a-c042-47d9-aab1-db0d732e9854 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: 0fb11dc6-65bc-4c8e-a674-c948f42f1b87] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:58.794207 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e5e7089a-c042-47d9-aab1-db0d732e9854 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:58.795706 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e5e7089a-c042-47d9-aab1-db0d732e9854 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:58.799173 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e5e7089a-c042-47d9-aab1-db0d732e9854 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:58.799173 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e5e7089a-c042-47d9-aab1-db0d732e9854 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:58.799173 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e5e7089a-c042-47d9-aab1-db0d732e9854 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:58.799714 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-a81cb0d1-f737-4499-a607-40e96a5c8da1 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] HTTP exception thrown: Instance 36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb could not be found. Oct 23 01:28:58.801080 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e5e7089a-c042-47d9-aab1-db0d732e9854 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a81cb0d1-f737-4499-a607-40e96a5c8da1 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Request method failure captured: Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb HTTP/1.1 Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJg3NUWnA4wtNnV1fqmWIgTvV7LxviAvrHcLEyNkqW8i63rSdiDSvJSHBEDg1W45rlqwnDugrJ_5pfHBt_fXk5LZ0Zn9rQOy96Qy18jTXA_aOre9e8vyrWP1nc1lG5lQBggWhpLkcyjMZuVplZHtPr1a9zNIPQ9y-PTaVbwYyBLIstI Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: bf35beeccb814ce490d2142b21c2b1c1 Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ListImageFiltersTestJSON-827086142 Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bf35beeccb814ce490d2142b21c2b1c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bf35beeccb814ce490d2142b21c2b1c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bf35beeccb814ce490d2142b21c2b1c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bf35beeccb814ce490d2142b21c2b1c1"}]}] Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ListImageFiltersTestJSON-827086142 Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: bf35beeccb814ce490d2142b21c2b1c1 Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-827086142 Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ListImageFiltersTestJSON-827086142-project Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: f86e186e88524064b8dca040c1814927 Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ListImageFiltersTestJSON-827086142-project Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb could not be found. Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb'} Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb could not be found. Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb could not be found. Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:28:58.811879 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:28:58.815393 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:28:58.815393 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:28:58.815393 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:28:58.815393 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:28:58.815393 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:28:58.815393 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb could not be found. Oct 23 01:28:58.815393 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:28:58.815393 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a81cb0d1-f737-4499-a607-40e96a5c8da1 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Returning 404 to user: Instance 36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:28:58.815393 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a81cb0d1-f737-4499-a607-40e96a5c8da1 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb" status: 404 len: 111 microversion: 2.1 time: 0.103501 Oct 23 01:28:58.820286 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2099/4278] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:28:58 2022] GET /compute/v2.1/servers/36fb1cfe-810b-4f4e-bcb4-fcc5df84b5cb => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:28:58.829725 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-aeae9e36-f451-4479-a36b-088a21741ce9 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:58.830890 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-aeae9e36-f451-4479-a36b-088a21741ce9 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] [instance: ad46f590-af38-463e-87db-62c442e08669] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:58.845040 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aeae9e36-f451-4479-a36b-088a21741ce9 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:58.845537 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aeae9e36-f451-4479-a36b-088a21741ce9 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:58.846065 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aeae9e36-f451-4479-a36b-088a21741ce9 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:58.846714 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aeae9e36-f451-4479-a36b-088a21741ce9 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:58.847155 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aeae9e36-f451-4479-a36b-088a21741ce9 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:58.851890 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aeae9e36-f451-4479-a36b-088a21741ce9 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:58.874234 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e5e7089a-c042-47d9-aab1-db0d732e9854 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.103447 Oct 23 01:28:58.875492 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2180/4279] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:28:58 2022] GET /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87/os-volume_attachments => generated 371 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:28:58.907756 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-aeae9e36-f451-4479-a36b-088a21741ce9 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] [instance: ad46f590-af38-463e-87db-62c442e08669] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:28:59.115327 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-02eb98f5-84a8-40f5-83e6-7e9516d5c648 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:59.115327 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-02eb98f5-84a8-40f5-83e6-7e9516d5c648 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: 0fb11dc6-65bc-4c8e-a674-c948f42f1b87] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:59.143095 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=3 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:28:59.155426 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-02eb98f5-84a8-40f5-83e6-7e9516d5c648 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:59.162469 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-02eb98f5-84a8-40f5-83e6-7e9516d5c648 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:59.163085 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-02eb98f5-84a8-40f5-83e6-7e9516d5c648 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:59.163817 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-02eb98f5-84a8-40f5-83e6-7e9516d5c648 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:59.164975 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=71 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:28:59.172228 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-02eb98f5-84a8-40f5-83e6-7e9516d5c648 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:59.173126 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-02eb98f5-84a8-40f5-83e6-7e9516d5c648 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:59.249871 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-02eb98f5-84a8-40f5-83e6-7e9516d5c648 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87/os-volume_attachments/382887af-33d5-4ee1-a55f-5d267d0dfab0" status: 200 len: 194 microversion: 2.1 time: 0.150948 Oct 23 01:28:59.251551 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2181/4280] 10.222.0.42 () {58 vars in 1413 bytes} [Sun Oct 23 01:28:59 2022] GET /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87/os-volume_attachments/382887af-33d5-4ee1-a55f-5d267d0dfab0 => generated 194 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:28:59.265117 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-01c51d89-cce2-4949-8562-458ad5096ce1 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:59.265933 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-01c51d89-cce2-4949-8562-458ad5096ce1 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: 0fb11dc6-65bc-4c8e-a674-c948f42f1b87] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:59.276281 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01c51d89-cce2-4949-8562-458ad5096ce1 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:59.278059 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01c51d89-cce2-4949-8562-458ad5096ce1 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:59.278739 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01c51d89-cce2-4949-8562-458ad5096ce1 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:59.279666 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01c51d89-cce2-4949-8562-458ad5096ce1 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:59.280345 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01c51d89-cce2-4949-8562-458ad5096ce1 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:59.281514 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01c51d89-cce2-4949-8562-458ad5096ce1 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:59.303687 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-aeae9e36-f451-4479-a36b-088a21741ce9 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ad46f590-af38-463e-87db-62c442e08669" status: 204 len: 0 microversion: 2.1 time: 0.481686 Oct 23 01:28:59.304466 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2100/4281] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:28:58 2022] DELETE /compute/v2.1/servers/ad46f590-af38-463e-87db-62c442e08669 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:28:59.310925 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-52cc9ee5-216f-420c-8e9c-3cde8f013b16 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:59.313596 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-52cc9ee5-216f-420c-8e9c-3cde8f013b16 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] [instance: ce31e873-63e4-4af4-b33d-5f994553545b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:59.333480 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52cc9ee5-216f-420c-8e9c-3cde8f013b16 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:59.333480 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52cc9ee5-216f-420c-8e9c-3cde8f013b16 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:59.333480 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52cc9ee5-216f-420c-8e9c-3cde8f013b16 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:59.337480 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52cc9ee5-216f-420c-8e9c-3cde8f013b16 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:59.338251 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52cc9ee5-216f-420c-8e9c-3cde8f013b16 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:59.342187 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52cc9ee5-216f-420c-8e9c-3cde8f013b16 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:59.381413 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-52cc9ee5-216f-420c-8e9c-3cde8f013b16 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] HTTP exception thrown: Instance ce31e873-63e4-4af4-b33d-5f994553545b could not be found. Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-52cc9ee5-216f-420c-8e9c-3cde8f013b16 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Request method failure captured: Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/ce31e873-63e4-4af4-b33d-5f994553545b HTTP/1.1 Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJiXZRjiE0IYRCR4iui_DjmTMLnAlTIlIo3pntsPp17L7HxH1-g6g1lC9kDJe4sMvjiRppYBWBWXGZEnFfPfwzjehNNqZaAhxibBzzKOevRvVMpTlj4e6ydsKtNtz7kelAfe4AC8crnl-NUN5IvJv-_YKSrrevBVPVGtVwxKsQYvAmw Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: X-Openstack-Nova-Api-Version: 2.47 Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: f0e82c5d57e54c3ba4d310bcb96b4e2a Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServerShowV247Test-752883117 Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f0e82c5d57e54c3ba4d310bcb96b4e2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f0e82c5d57e54c3ba4d310bcb96b4e2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f0e82c5d57e54c3ba4d310bcb96b4e2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f0e82c5d57e54c3ba4d310bcb96b4e2a"}]}] Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServerShowV247Test-752883117 Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: f0e82c5d57e54c3ba4d310bcb96b4e2a Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServerShowV247Test-752883117 Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServerShowV247Test-752883117-project Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 9945803bd26745a8b3ccb508f7cd2a38 Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServerShowV247Test-752883117-project Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: exception: Instance ce31e873-63e4-4af4-b33d-5f994553545b could not be found. Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'ce31e873-63e4-4af4-b33d-5f994553545b'} Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce31e873-63e4-4af4-b33d-5f994553545b could not be found. Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce31e873-63e4-4af4-b33d-5f994553545b could not be found. Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:28:59.384797 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:28:59.388276 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:28:59.388276 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:28:59.388276 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:28:59.388276 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:28:59.388276 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:28:59.388276 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce31e873-63e4-4af4-b33d-5f994553545b could not be found. Oct 23 01:28:59.388276 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:28:59.393650 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-52cc9ee5-216f-420c-8e9c-3cde8f013b16 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] Returning 404 to user: Instance ce31e873-63e4-4af4-b33d-5f994553545b could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:28:59.395973 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-52cc9ee5-216f-420c-8e9c-3cde8f013b16 tempest-ServerShowV247Test-752883117 tempest-ServerShowV247Test-752883117-project] 10.222.0.42 "GET /compute/v2.1/servers/ce31e873-63e4-4af4-b33d-5f994553545b" status: 404 len: 111 microversion: 2.47 time: 0.089350 Oct 23 01:28:59.401374 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2101/4282] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:59 2022] GET /compute/v2.1/servers/ce31e873-63e4-4af4-b33d-5f994553545b => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:28:59.415568 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6a4ade69-e69b-489f-a411-998e3c43fa26 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:28:59.419667 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6a4ade69-e69b-489f-a411-998e3c43fa26 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] [instance: ad46f590-af38-463e-87db-62c442e08669] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:28:59.455950 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6a4ade69-e69b-489f-a411-998e3c43fa26 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:59.458029 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6a4ade69-e69b-489f-a411-998e3c43fa26 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:59.460410 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6a4ade69-e69b-489f-a411-998e3c43fa26 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:59.463754 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6a4ade69-e69b-489f-a411-998e3c43fa26 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:28:59.464307 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6a4ade69-e69b-489f-a411-998e3c43fa26 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:28:59.467684 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6a4ade69-e69b-489f-a411-998e3c43fa26 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:28:59.586305 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-01c51d89-cce2-4949-8562-458ad5096ce1 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lazy-loading 'services' on Instance uuid 0fb11dc6-65bc-4c8e-a674-c948f42f1b87 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:28:59.611639 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:28:59.882637 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:28:59.979079 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-01c51d89-cce2-4949-8562-458ad5096ce1 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87/os-volume_attachments/382887af-33d5-4ee1-a55f-5d267d0dfab0" status: 202 len: 0 microversion: 2.1 time: 0.719313 Oct 23 01:28:59.983841 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2182/4283] 10.222.0.42 () {58 vars in 1416 bytes} [Sun Oct 23 01:28:59 2022] DELETE /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87/os-volume_attachments/382887af-33d5-4ee1-a55f-5d267d0dfab0 => generated 0 bytes in 725 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:29:00.000180 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-eaeab075-205f-407e-aa57-adb31e661095 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:00.001149 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-eaeab075-205f-407e-aa57-adb31e661095 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:00.022006 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eaeab075-205f-407e-aa57-adb31e661095 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:00.022685 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eaeab075-205f-407e-aa57-adb31e661095 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:00.023146 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eaeab075-205f-407e-aa57-adb31e661095 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:00.023902 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eaeab075-205f-407e-aa57-adb31e661095 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:00.024365 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eaeab075-205f-407e-aa57-adb31e661095 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:00.025093 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eaeab075-205f-407e-aa57-adb31e661095 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:00.347207 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6a4ade69-e69b-489f-a411-998e3c43fa26 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86e186e88524064b8dca040c1814927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf35beeccb814ce490d2142b21c2b1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:00.356907 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6a4ade69-e69b-489f-a411-998e3c43fa26 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/servers/ad46f590-af38-463e-87db-62c442e08669" status: 200 len: 1473 microversion: 2.1 time: 0.951411 Oct 23 01:29:00.386349 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2102/4284] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:28:59 2022] GET /compute/v2.1/servers/ad46f590-af38-463e-87db-62c442e08669 => generated 1473 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:00.842564 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-eaeab075-205f-407e-aa57-adb31e661095 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:00.862514 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-eaeab075-205f-407e-aa57-adb31e661095 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:00.867290 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-eaeab075-205f-407e-aa57-adb31e661095 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:00.869324 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-eaeab075-205f-407e-aa57-adb31e661095 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1806 microversion: 2.20 time: 0.884117 Oct 23 01:29:00.872068 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2183/4285] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:28:59 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1806 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:29:01.398267 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-16f07d5a-09b1-4833-ad89-fbb30dbf76b6 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:01.398895 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-16f07d5a-09b1-4833-ad89-fbb30dbf76b6 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] [instance: ad46f590-af38-463e-87db-62c442e08669] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:01.413684 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-16f07d5a-09b1-4833-ad89-fbb30dbf76b6 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:01.419894 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-16f07d5a-09b1-4833-ad89-fbb30dbf76b6 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:01.420399 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-16f07d5a-09b1-4833-ad89-fbb30dbf76b6 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:01.421603 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-16f07d5a-09b1-4833-ad89-fbb30dbf76b6 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:01.421603 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-16f07d5a-09b1-4833-ad89-fbb30dbf76b6 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:01.422086 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-16f07d5a-09b1-4833-ad89-fbb30dbf76b6 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:01.899974 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-889cdc2a-10cf-41eb-9dba-3045be5b6456 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:01.901345 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-889cdc2a-10cf-41eb-9dba-3045be5b6456 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:01.919451 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-889cdc2a-10cf-41eb-9dba-3045be5b6456 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:01.924643 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-889cdc2a-10cf-41eb-9dba-3045be5b6456 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:01.925387 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-889cdc2a-10cf-41eb-9dba-3045be5b6456 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:01.926388 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-889cdc2a-10cf-41eb-9dba-3045be5b6456 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:01.927140 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-889cdc2a-10cf-41eb-9dba-3045be5b6456 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:01.932860 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-889cdc2a-10cf-41eb-9dba-3045be5b6456 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:02.337068 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-16f07d5a-09b1-4833-ad89-fbb30dbf76b6 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86e186e88524064b8dca040c1814927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf35beeccb814ce490d2142b21c2b1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:02.347502 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-16f07d5a-09b1-4833-ad89-fbb30dbf76b6 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/servers/ad46f590-af38-463e-87db-62c442e08669" status: 200 len: 1473 microversion: 2.1 time: 0.959925 Oct 23 01:29:02.348107 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2103/4286] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:01 2022] GET /compute/v2.1/servers/ad46f590-af38-463e-87db-62c442e08669 => generated 1473 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:02.643065 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-85875afe-9593-4959-9544-f37e50fa6a71 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1921711879", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "4b7e0e96-4137-4b62-b78e-56e55cf37641"}], "security_groups": [{"name": "tempest-securitygroup--383933330"}], "key_name": "tempest-keypair-1904337469", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "03202be3-3e76-4da3-a70c-b54dd64e097d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:29:02.668269 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-889cdc2a-10cf-41eb-9dba-3045be5b6456 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:02.684801 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-889cdc2a-10cf-41eb-9dba-3045be5b6456 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:02.690652 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-889cdc2a-10cf-41eb-9dba-3045be5b6456 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:02.692515 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-889cdc2a-10cf-41eb-9dba-3045be5b6456 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1806 microversion: 2.20 time: 0.796685 Oct 23 01:29:02.698765 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2184/4287] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:29:01 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1806 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:29:03.002625 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-85875afe-9593-4959-9544-f37e50fa6a71 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] validate_networks() for [('4b7e0e96-4137-4b62-b78e-56e55cf37641', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:29:03.323088 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-209f90da-cc1d-4263-9515-0d13165e9684 req-896d6136-d6da-4e88-8d57-971f6ede7667 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6eb59b7-d1ee-442c-8142-19a88ad6a039", "name": "network-vif-plugged", "status": "completed", "tag": "82e540c0-e210-47a2-a17d-495549fe7222"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:29:03.359961 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-209f90da-cc1d-4263-9515-0d13165e9684 req-896d6136-d6da-4e88-8d57-971f6ede7667 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:03.360914 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-209f90da-cc1d-4263-9515-0d13165e9684 req-896d6136-d6da-4e88-8d57-971f6ede7667 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:03.361582 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-209f90da-cc1d-4263-9515-0d13165e9684 req-896d6136-d6da-4e88-8d57-971f6ede7667 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:03.379221 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-209f90da-cc1d-4263-9515-0d13165e9684 req-896d6136-d6da-4e88-8d57-971f6ede7667 service nova] Creating event network-vif-plugged:82e540c0-e210-47a2-a17d-495549fe7222 for instance c6eb59b7-d1ee-442c-8142-19a88ad6a039 on n-h2-master-1 Oct 23 01:29:03.387704 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-209f90da-cc1d-4263-9515-0d13165e9684 req-896d6136-d6da-4e88-8d57-971f6ede7667 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069310 Oct 23 01:29:03.391750 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2185/4288] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:29:03.398864 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b1c948a1-bb5d-4c6b-8454-256643e58727 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:03.400048 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b1c948a1-bb5d-4c6b-8454-256643e58727 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] [instance: ad46f590-af38-463e-87db-62c442e08669] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:03.411407 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b1c948a1-bb5d-4c6b-8454-256643e58727 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:03.412233 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b1c948a1-bb5d-4c6b-8454-256643e58727 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:03.413094 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b1c948a1-bb5d-4c6b-8454-256643e58727 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:03.414102 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b1c948a1-bb5d-4c6b-8454-256643e58727 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:03.414849 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b1c948a1-bb5d-4c6b-8454-256643e58727 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:03.415574 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b1c948a1-bb5d-4c6b-8454-256643e58727 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:03.644731 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b1c948a1-bb5d-4c6b-8454-256643e58727 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86e186e88524064b8dca040c1814927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf35beeccb814ce490d2142b21c2b1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:03.665206 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b1c948a1-bb5d-4c6b-8454-256643e58727 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/servers/ad46f590-af38-463e-87db-62c442e08669" status: 200 len: 1431 microversion: 2.1 time: 0.271959 Oct 23 01:29:03.666029 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2186/4289] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:03 2022] GET /compute/v2.1/servers/ad46f590-af38-463e-87db-62c442e08669 => generated 1431 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:03.728130 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cb02290a-b842-4ea9-8085-3126c5c29086 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:03.729053 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-cb02290a-b842-4ea9-8085-3126c5c29086 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:03.746400 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cb02290a-b842-4ea9-8085-3126c5c29086 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:03.746906 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cb02290a-b842-4ea9-8085-3126c5c29086 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:03.747349 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cb02290a-b842-4ea9-8085-3126c5c29086 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:03.750652 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cb02290a-b842-4ea9-8085-3126c5c29086 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:03.750652 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cb02290a-b842-4ea9-8085-3126c5c29086 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:03.750652 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cb02290a-b842-4ea9-8085-3126c5c29086 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:03.995473 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-85875afe-9593-4959-9544-f37e50fa6a71 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Getting quotas for project 2db2a6834ec144418eb2cf222302fdb2. Resources: dict_keys(['metadata_items']) {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:29:04.003107 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-85875afe-9593-4959-9544-f37e50fa6a71 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Getting quotas for user a0a8950e247041d8be4fdfda5e2122fa and project 2db2a6834ec144418eb2cf222302fdb2. Resources: dict_keys(['metadata_items']) {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:29:04.025641 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-85875afe-9593-4959-9544-f37e50fa6a71 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:29:04.026165 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-85875afe-9593-4959-9544-f37e50fa6a71 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:29:04.026758 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-85875afe-9593-4959-9544-f37e50fa6a71 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:29:04.027654 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-85875afe-9593-4959-9544-f37e50fa6a71 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:29:04.028195 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-85875afe-9593-4959-9544-f37e50fa6a71 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:29:04.043043 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-85875afe-9593-4959-9544-f37e50fa6a71 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:04.043899 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-85875afe-9593-4959-9544-f37e50fa6a71 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:04.044496 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-85875afe-9593-4959-9544-f37e50fa6a71 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:04.045851 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-85875afe-9593-4959-9544-f37e50fa6a71 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:04.047286 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-85875afe-9593-4959-9544-f37e50fa6a71 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:04.048215 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-85875afe-9593-4959-9544-f37e50fa6a71 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:04.073518 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-85875afe-9593-4959-9544-f37e50fa6a71 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Getting quotas for project 2db2a6834ec144418eb2cf222302fdb2. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:29:04.077950 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cb02290a-b842-4ea9-8085-3126c5c29086 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:04.079494 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-85875afe-9593-4959-9544-f37e50fa6a71 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Getting quotas for user a0a8950e247041d8be4fdfda5e2122fa and project 2db2a6834ec144418eb2cf222302fdb2. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:29:04.098301 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cb02290a-b842-4ea9-8085-3126c5c29086 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:04.102210 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cb02290a-b842-4ea9-8085-3126c5c29086 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:04.110607 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cb02290a-b842-4ea9-8085-3126c5c29086 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1806 microversion: 2.20 time: 0.384078 Oct 23 01:29:04.112013 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2187/4290] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:29:03 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1806 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:29:04.119745 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-ab8edd28-1ac9-46e0-a5dc-c69a6f82af66 req-643ab66b-78a5-4306-8e24-27b431cb78d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad46f590-af38-463e-87db-62c442e08669", "name": "network-vif-deleted", "tag": "d91fdad3-e41c-42ed-88d5-cc3ba6ed68a4"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:29:04.150514 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-ab8edd28-1ac9-46e0-a5dc-c69a6f82af66 req-643ab66b-78a5-4306-8e24-27b431cb78d5 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:04.156984 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-ab8edd28-1ac9-46e0-a5dc-c69a6f82af66 req-643ab66b-78a5-4306-8e24-27b431cb78d5 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:04.157841 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-ab8edd28-1ac9-46e0-a5dc-c69a6f82af66 req-643ab66b-78a5-4306-8e24-27b431cb78d5 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:04.194864 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-ab8edd28-1ac9-46e0-a5dc-c69a6f82af66 req-643ab66b-78a5-4306-8e24-27b431cb78d5 service nova] Creating event network-vif-deleted:d91fdad3-e41c-42ed-88d5-cc3ba6ed68a4 for instance ad46f590-af38-463e-87db-62c442e08669 on n-h1-master-1 Oct 23 01:29:04.214063 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-ab8edd28-1ac9-46e0-a5dc-c69a6f82af66 req-643ab66b-78a5-4306-8e24-27b431cb78d5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098388 Oct 23 01:29:04.215329 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2188/4291] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:29:04.246471 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-85875afe-9593-4959-9544-f37e50fa6a71 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:29:04.249326 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-85875afe-9593-4959-9544-f37e50fa6a71 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] [instance: 08bd5c17-1a39-4d28-9a01-e93b999bfb61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='03202be3-3e76-4da3-a70c-b54dd64e097d',volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:29:04.711601 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-18126c79-d9e3-4ece-a334-9a589a1e3612 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:04.716059 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-18126c79-d9e3-4ece-a334-9a589a1e3612 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] [instance: ad46f590-af38-463e-87db-62c442e08669] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:04.761090 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18126c79-d9e3-4ece-a334-9a589a1e3612 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:04.761090 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18126c79-d9e3-4ece-a334-9a589a1e3612 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:04.761090 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18126c79-d9e3-4ece-a334-9a589a1e3612 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:04.764427 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18126c79-d9e3-4ece-a334-9a589a1e3612 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:04.765282 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18126c79-d9e3-4ece-a334-9a589a1e3612 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:04.767011 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18126c79-d9e3-4ece-a334-9a589a1e3612 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:04.827320 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18126c79-d9e3-4ece-a334-9a589a1e3612 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:04.828067 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18126c79-d9e3-4ece-a334-9a589a1e3612 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:04.828691 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18126c79-d9e3-4ece-a334-9a589a1e3612 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:04.829302 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-18126c79-d9e3-4ece-a334-9a589a1e3612 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lazy-loading 'fault' on Instance uuid ad46f590-af38-463e-87db-62c442e08669 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:29:04.908770 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-18126c79-d9e3-4ece-a334-9a589a1e3612 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86e186e88524064b8dca040c1814927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf35beeccb814ce490d2142b21c2b1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:04.921411 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-18126c79-d9e3-4ece-a334-9a589a1e3612 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/servers/ad46f590-af38-463e-87db-62c442e08669" status: 200 len: 1308 microversion: 2.1 time: 0.220847 Oct 23 01:29:04.939933 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2189/4292] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:04 2022] GET /compute/v2.1/servers/ad46f590-af38-463e-87db-62c442e08669 => generated 1308 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:04.954332 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-85875afe-9593-4959-9544-f37e50fa6a71 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.314453 Oct 23 01:29:04.963320 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-18126c79-d9e3-4ece-a334-9a589a1e3612 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:04.964601 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-18126c79-d9e3-4ece-a334-9a589a1e3612 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001589 Oct 23 01:29:04.965817 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2104/4293] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:29:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 2328 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 23 01:29:04.966437 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2190/4294] 10.222.0.42 () {56 vars in 886 bytes} [Sun Oct 23 01:29:04 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 23 01:29:04.971413 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-48ab5894-7dd8-4a2a-b2ae-aafdc6c3d49e tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:04.974456 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-48ab5894-7dd8-4a2a-b2ae-aafdc6c3d49e tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] [instance: 08bd5c17-1a39-4d28-9a01-e93b999bfb61] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:04.977318 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-18126c79-d9e3-4ece-a334-9a589a1e3612 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:04.978689 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-18126c79-d9e3-4ece-a334-9a589a1e3612 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001868 Oct 23 01:29:04.979550 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2191/4295] 10.222.0.42 () {54 vars in 1035 bytes} [Sun Oct 23 01:29:04 2022] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 23 01:29:04.987054 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-18126c79-d9e3-4ece-a334-9a589a1e3612 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:04.988356 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-18126c79-d9e3-4ece-a334-9a589a1e3612 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001756 Oct 23 01:29:04.989285 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2192/4296] 10.222.0.42 () {54 vars in 1041 bytes} [Sun Oct 23 01:29:04 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:29:04.998444 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-18126c79-d9e3-4ece-a334-9a589a1e3612 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:05.001387 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-18126c79-d9e3-4ece-a334-9a589a1e3612 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003230 Oct 23 01:29:05.002263 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2193/4297] 10.222.0.42 () {56 vars in 886 bytes} [Sun Oct 23 01:29:04 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Oct 23 01:29:05.146168 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-abaeedd9-4405-4d3f-98f3-f265a7573eca tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:05.147681 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-abaeedd9-4405-4d3f-98f3-f265a7573eca tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:05.157647 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-abaeedd9-4405-4d3f-98f3-f265a7573eca tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:05.162954 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-abaeedd9-4405-4d3f-98f3-f265a7573eca tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:05.162954 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-abaeedd9-4405-4d3f-98f3-f265a7573eca tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:05.162954 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-abaeedd9-4405-4d3f-98f3-f265a7573eca tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:05.162954 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-abaeedd9-4405-4d3f-98f3-f265a7573eca tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:05.162954 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-abaeedd9-4405-4d3f-98f3-f265a7573eca tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:05.391733 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-48ab5894-7dd8-4a2a-b2ae-aafdc6c3d49e tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8950e247041d8be4fdfda5e2122fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db2a6834ec144418eb2cf222302fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:05.399768 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-48ab5894-7dd8-4a2a-b2ae-aafdc6c3d49e tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] 10.222.0.42 "GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61" status: 200 len: 1122 microversion: 2.1 time: 0.432458 Oct 23 01:29:05.400361 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2105/4298] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:04 2022] GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61 => generated 1122 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:05.759963 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-abaeedd9-4405-4d3f-98f3-f265a7573eca tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:05.779162 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-abaeedd9-4405-4d3f-98f3-f265a7573eca tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:05.781596 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-abaeedd9-4405-4d3f-98f3-f265a7573eca tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:05.784402 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-abaeedd9-4405-4d3f-98f3-f265a7573eca tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1806 microversion: 2.20 time: 0.644808 Oct 23 01:29:05.788864 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2194/4299] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:29:05 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1806 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:29:05.946365 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cc85dfe6-557f-443c-9d2d-20e61b6957d1 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:05.947382 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-cc85dfe6-557f-443c-9d2d-20e61b6957d1 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] [instance: ad46f590-af38-463e-87db-62c442e08669] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:05.958335 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cc85dfe6-557f-443c-9d2d-20e61b6957d1 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:05.962752 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cc85dfe6-557f-443c-9d2d-20e61b6957d1 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:05.991589 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cc85dfe6-557f-443c-9d2d-20e61b6957d1 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:05.993638 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cc85dfe6-557f-443c-9d2d-20e61b6957d1 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:05.995456 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cc85dfe6-557f-443c-9d2d-20e61b6957d1 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:05.995909 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cc85dfe6-557f-443c-9d2d-20e61b6957d1 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:06.031180 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-cc85dfe6-557f-443c-9d2d-20e61b6957d1 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] HTTP exception thrown: Instance ad46f590-af38-463e-87db-62c442e08669 could not be found. Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cc85dfe6-557f-443c-9d2d-20e61b6957d1 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Request method failure captured: Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/ad46f590-af38-463e-87db-62c442e08669 HTTP/1.1 Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJg3NUWnA4wtNnV1fqmWIgTvV7LxviAvrHcLEyNkqW8i63rSdiDSvJSHBEDg1W45rlqwnDugrJ_5pfHBt_fXk5LZ0Zn9rQOy96Qy18jTXA_aOre9e8vyrWP1nc1lG5lQBggWhpLkcyjMZuVplZHtPr1a9zNIPQ9y-PTaVbwYyBLIstI Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: bf35beeccb814ce490d2142b21c2b1c1 Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ListImageFiltersTestJSON-827086142 Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bf35beeccb814ce490d2142b21c2b1c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bf35beeccb814ce490d2142b21c2b1c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bf35beeccb814ce490d2142b21c2b1c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bf35beeccb814ce490d2142b21c2b1c1"}]}] Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ListImageFiltersTestJSON-827086142 Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: bf35beeccb814ce490d2142b21c2b1c1 Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-827086142 Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ListImageFiltersTestJSON-827086142-project Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: f86e186e88524064b8dca040c1814927 Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ListImageFiltersTestJSON-827086142-project Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: exception: Instance ad46f590-af38-463e-87db-62c442e08669 could not be found. Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'ad46f590-af38-463e-87db-62c442e08669'} Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad46f590-af38-463e-87db-62c442e08669 could not be found. Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad46f590-af38-463e-87db-62c442e08669 could not be found. Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:29:06.034677 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:29:06.038301 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:29:06.038301 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:29:06.038301 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:29:06.038301 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:29:06.038301 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:29:06.038301 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad46f590-af38-463e-87db-62c442e08669 could not be found. Oct 23 01:29:06.038301 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:29:06.043248 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cc85dfe6-557f-443c-9d2d-20e61b6957d1 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Returning 404 to user: Instance ad46f590-af38-463e-87db-62c442e08669 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:29:06.044305 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cc85dfe6-557f-443c-9d2d-20e61b6957d1 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "GET /compute/v2.1/servers/ad46f590-af38-463e-87db-62c442e08669" status: 404 len: 111 microversion: 2.1 time: 0.102924 Oct 23 01:29:06.047137 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2195/4300] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:05 2022] GET /compute/v2.1/servers/ad46f590-af38-463e-87db-62c442e08669 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 01:29:06.055409 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5dfc65b1-83f5-4d6e-bfa8-98e2ed7d55e7 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc1a099d0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:06.211365 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-44a68226-cfaf-4ecf-b47d-821b412fe625 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-909965998", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "18376ce0-dd48-407b-b196-a3de5fb15583"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:29:07.397162 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5dfc65b1-83f5-4d6e-bfa8-98e2ed7d55e7 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "DELETE /compute/v2.1/images/a32c241c-7c96-4540-ac0c-d8e44c934115" status: 204 len: 0 microversion: 2.1 time: 1.346770 Oct 23 01:29:07.402426 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2196/4301] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:06 2022] DELETE /compute/v2.1/images/a32c241c-7c96-4540-ac0c-d8e44c934115 => generated 0 bytes in 1349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 23 01:29:07.419309 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7fe7c9ec-e200-4eaf-a7c4-fa84ec0c2ab9 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:07.433776 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7fe7c9ec-e200-4eaf-a7c4-fa84ec0c2ab9 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] [instance: 08bd5c17-1a39-4d28-9a01-e93b999bfb61] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:07.478300 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7fe7c9ec-e200-4eaf-a7c4-fa84ec0c2ab9 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:07.479281 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7fe7c9ec-e200-4eaf-a7c4-fa84ec0c2ab9 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:07.497091 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7fe7c9ec-e200-4eaf-a7c4-fa84ec0c2ab9 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:07.500383 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7fe7c9ec-e200-4eaf-a7c4-fa84ec0c2ab9 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:07.503220 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7fe7c9ec-e200-4eaf-a7c4-fa84ec0c2ab9 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:07.505141 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-44a68226-cfaf-4ecf-b47d-821b412fe625 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] validate_networks() for [('18376ce0-dd48-407b-b196-a3de5fb15583', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:29:07.507369 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7fe7c9ec-e200-4eaf-a7c4-fa84ec0c2ab9 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:07.823955 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7fe7c9ec-e200-4eaf-a7c4-fa84ec0c2ab9 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8950e247041d8be4fdfda5e2122fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db2a6834ec144418eb2cf222302fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:07.838150 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7fe7c9ec-e200-4eaf-a7c4-fa84ec0c2ab9 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] 10.222.0.42 "GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61" status: 200 len: 1164 microversion: 2.1 time: 0.430922 Oct 23 01:29:07.839211 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2197/4302] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:07 2022] GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61 => generated 1164 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:07.855040 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-796e3369-ecc1-40a8-aa16-d68c0c1da16b tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:07.896018 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-796e3369-ecc1-40a8-aa16-d68c0c1da16b tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:07.936207 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-796e3369-ecc1-40a8-aa16-d68c0c1da16b tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:07.939438 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-796e3369-ecc1-40a8-aa16-d68c0c1da16b tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:07.944872 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-796e3369-ecc1-40a8-aa16-d68c0c1da16b tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:07.945652 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-796e3369-ecc1-40a8-aa16-d68c0c1da16b tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:07.946718 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-796e3369-ecc1-40a8-aa16-d68c0c1da16b tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:07.950648 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-796e3369-ecc1-40a8-aa16-d68c0c1da16b tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:08.478457 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-796e3369-ecc1-40a8-aa16-d68c0c1da16b tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:08.510759 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-796e3369-ecc1-40a8-aa16-d68c0c1da16b tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:08.516921 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-796e3369-ecc1-40a8-aa16-d68c0c1da16b tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:08.518954 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-796e3369-ecc1-40a8-aa16-d68c0c1da16b tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1806 microversion: 2.20 time: 0.677693 Oct 23 01:29:08.518954 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2198/4303] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:29:07 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1806 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:29:08.525724 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-278656fa-8ad3-487f-96c0-139e611f0cf3 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc1982af0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:08.831925 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-44a68226-cfaf-4ecf-b47d-821b412fe625 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:29:08.831925 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-44a68226-cfaf-4ecf-b47d-821b412fe625 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:29:08.831925 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-44a68226-cfaf-4ecf-b47d-821b412fe625 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:29:08.831925 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-44a68226-cfaf-4ecf-b47d-821b412fe625 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:29:08.831925 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-44a68226-cfaf-4ecf-b47d-821b412fe625 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:29:08.859446 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44a68226-cfaf-4ecf-b47d-821b412fe625 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:08.859446 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44a68226-cfaf-4ecf-b47d-821b412fe625 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:08.859446 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44a68226-cfaf-4ecf-b47d-821b412fe625 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:08.859446 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44a68226-cfaf-4ecf-b47d-821b412fe625 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:08.859446 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44a68226-cfaf-4ecf-b47d-821b412fe625 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:08.861246 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44a68226-cfaf-4ecf-b47d-821b412fe625 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:08.940691 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-44a68226-cfaf-4ecf-b47d-821b412fe625 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Getting quotas for project 064a14adc24641ddbde56bfe3b7f3e0f. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:29:08.949223 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-44a68226-cfaf-4ecf-b47d-821b412fe625 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Getting quotas for user 51d8e34a549c44318a3d328fb2014d20 and project 064a14adc24641ddbde56bfe3b7f3e0f. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:29:08.978710 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-44a68226-cfaf-4ecf-b47d-821b412fe625 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:29:08.981089 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-44a68226-cfaf-4ecf-b47d-821b412fe625 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] [instance: d4135945-6011-4843-9156-74dbc625e78c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:29:09.167049 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-44a68226-cfaf-4ecf-b47d-821b412fe625 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 3.271264 Oct 23 01:29:09.172186 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2106/4304] 10.222.0.42 () {62 vars in 1188 bytes} [Sun Oct 23 01:29:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 3275 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 23 01:29:09.182066 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d7be0ecc-9eb5-487a-8fbf-f390816329fd tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:09.190141 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d7be0ecc-9eb5-487a-8fbf-f390816329fd tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] [instance: 08bd5c17-1a39-4d28-9a01-e93b999bfb61] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:09.207476 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d7be0ecc-9eb5-487a-8fbf-f390816329fd tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:09.208654 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d7be0ecc-9eb5-487a-8fbf-f390816329fd tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:09.210583 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d7be0ecc-9eb5-487a-8fbf-f390816329fd tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:09.212798 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d7be0ecc-9eb5-487a-8fbf-f390816329fd tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:09.214227 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d7be0ecc-9eb5-487a-8fbf-f390816329fd tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:09.216558 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d7be0ecc-9eb5-487a-8fbf-f390816329fd tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:09.502837 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d7be0ecc-9eb5-487a-8fbf-f390816329fd tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8950e247041d8be4fdfda5e2122fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db2a6834ec144418eb2cf222302fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:09.521109 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d7be0ecc-9eb5-487a-8fbf-f390816329fd tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] 10.222.0.42 "GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61" status: 200 len: 1228 microversion: 2.1 time: 0.347843 Oct 23 01:29:09.522602 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2107/4305] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:09 2022] GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61 => generated 1228 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:09.555219 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d1d5ab7b-db89-40e1-a926-61906a593f56 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:09.556205 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d1d5ab7b-db89-40e1-a926-61906a593f56 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] [instance: d4135945-6011-4843-9156-74dbc625e78c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:09.845602 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-278656fa-8ad3-487f-96c0-139e611f0cf3 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "DELETE /compute/v2.1/images/eb5a8a92-5612-4503-b9cd-997d9d49d37b" status: 204 len: 0 microversion: 2.1 time: 1.325647 Oct 23 01:29:09.846674 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2199/4306] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:08 2022] DELETE /compute/v2.1/images/eb5a8a92-5612-4503-b9cd-997d9d49d37b => generated 0 bytes in 1327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:29:09.853102 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-eebc83b5-60b5-4fec-a3c7-049a8e869c31 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:09.853102 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-eebc83b5-60b5-4fec-a3c7-049a8e869c31 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: 0fb11dc6-65bc-4c8e-a674-c948f42f1b87] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:09.888461 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eebc83b5-60b5-4fec-a3c7-049a8e869c31 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:09.888461 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eebc83b5-60b5-4fec-a3c7-049a8e869c31 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:09.888461 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eebc83b5-60b5-4fec-a3c7-049a8e869c31 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:09.888461 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eebc83b5-60b5-4fec-a3c7-049a8e869c31 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:09.888461 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eebc83b5-60b5-4fec-a3c7-049a8e869c31 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:09.888461 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eebc83b5-60b5-4fec-a3c7-049a8e869c31 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:09.907242 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d1d5ab7b-db89-40e1-a926-61906a593f56 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:09.929282 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d1d5ab7b-db89-40e1-a926-61906a593f56 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:09.935420 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d1d5ab7b-db89-40e1-a926-61906a593f56 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:09.948162 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d1d5ab7b-db89-40e1-a926-61906a593f56 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] 10.222.0.42 "GET /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c" status: 200 len: 1261 microversion: 2.26 time: 0.421213 Oct 23 01:29:09.952121 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2108/4307] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:29:09 2022] GET /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c => generated 1261 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:29:09.957022 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-961db0e2-1ac5-4b7a-ae30-5e843f49710a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:09.957577 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-961db0e2-1ac5-4b7a-ae30-5e843f49710a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:09.995944 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-961db0e2-1ac5-4b7a-ae30-5e843f49710a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:09.996467 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-961db0e2-1ac5-4b7a-ae30-5e843f49710a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:09.996894 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-961db0e2-1ac5-4b7a-ae30-5e843f49710a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:10.002379 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-961db0e2-1ac5-4b7a-ae30-5e843f49710a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:10.003104 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-961db0e2-1ac5-4b7a-ae30-5e843f49710a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:10.003553 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-961db0e2-1ac5-4b7a-ae30-5e843f49710a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:10.058279 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-eebc83b5-60b5-4fec-a3c7-049a8e869c31 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87/os-volume_attachments/e9df6c18-697c-469c-bae0-9fb858b2561c" status: 200 len: 194 microversion: 2.1 time: 0.210318 Oct 23 01:29:10.074371 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2200/4308] 10.222.0.42 () {58 vars in 1413 bytes} [Sun Oct 23 01:29:09 2022] GET /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87/os-volume_attachments/e9df6c18-697c-469c-bae0-9fb858b2561c => generated 194 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:29:10.097821 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fda39535-78b0-4617-ab3b-be87c590ea48 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] Calling method '.version_select at 0x7f5cc2201ca0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:10.928626 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-961db0e2-1ac5-4b7a-ae30-5e843f49710a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:10.992385 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-961db0e2-1ac5-4b7a-ae30-5e843f49710a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:10.993863 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-961db0e2-1ac5-4b7a-ae30-5e843f49710a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:10.995430 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-961db0e2-1ac5-4b7a-ae30-5e843f49710a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1793 microversion: 2.20 time: 1.042305 Oct 23 01:29:10.996064 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2109/4309] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:29:09 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1793 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:29:11.016135 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-750c2666-7d59-4036-bcbe-a95232c8fbae tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:11.016637 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-750c2666-7d59-4036-bcbe-a95232c8fbae tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: 0fb11dc6-65bc-4c8e-a674-c948f42f1b87] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:11.051823 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-750c2666-7d59-4036-bcbe-a95232c8fbae tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:11.052330 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-750c2666-7d59-4036-bcbe-a95232c8fbae tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:11.063739 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-750c2666-7d59-4036-bcbe-a95232c8fbae tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:11.064573 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-750c2666-7d59-4036-bcbe-a95232c8fbae tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:11.065058 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-750c2666-7d59-4036-bcbe-a95232c8fbae tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:11.069333 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-750c2666-7d59-4036-bcbe-a95232c8fbae tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:11.298182 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-750c2666-7d59-4036-bcbe-a95232c8fbae tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lazy-loading 'services' on Instance uuid 0fb11dc6-65bc-4c8e-a674-c948f42f1b87 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:29:11.648069 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fda39535-78b0-4617-ab3b-be87c590ea48 tempest-ListImageFiltersTestJSON-827086142 tempest-ListImageFiltersTestJSON-827086142-project] 10.222.0.42 "DELETE /compute/v2.1/images/a06024e3-3441-4336-9669-e39d31cd51ab" status: 204 len: 0 microversion: 2.1 time: 1.568469 Oct 23 01:29:11.649107 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2201/4310] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:10 2022] DELETE /compute/v2.1/images/a06024e3-3441-4336-9669-e39d31cd51ab => generated 0 bytes in 1572 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:29:11.654370 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-85593be2-7c92-473b-bac3-9e7b856e634b tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:11.655027 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-85593be2-7c92-473b-bac3-9e7b856e634b tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] [instance: 08bd5c17-1a39-4d28-9a01-e93b999bfb61] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:11.680118 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-85593be2-7c92-473b-bac3-9e7b856e634b tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:11.683479 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-85593be2-7c92-473b-bac3-9e7b856e634b tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:11.687105 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-85593be2-7c92-473b-bac3-9e7b856e634b tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:11.687997 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-85593be2-7c92-473b-bac3-9e7b856e634b tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:11.688397 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-85593be2-7c92-473b-bac3-9e7b856e634b tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:11.688832 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-85593be2-7c92-473b-bac3-9e7b856e634b tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:11.760399 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-750c2666-7d59-4036-bcbe-a95232c8fbae tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87/os-volume_attachments/e9df6c18-697c-469c-bae0-9fb858b2561c" status: 202 len: 0 microversion: 2.1 time: 0.762851 Oct 23 01:29:11.764879 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2110/4311] 10.222.0.42 () {58 vars in 1416 bytes} [Sun Oct 23 01:29:10 2022] DELETE /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87/os-volume_attachments/e9df6c18-697c-469c-bae0-9fb858b2561c => generated 0 bytes in 768 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:29:11.773217 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7ae0ae9b-2258-41f6-9c57-5f89e412de89 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:11.774256 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7ae0ae9b-2258-41f6-9c57-5f89e412de89 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] [instance: d4135945-6011-4843-9156-74dbc625e78c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:11.796984 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7ae0ae9b-2258-41f6-9c57-5f89e412de89 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:11.796984 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7ae0ae9b-2258-41f6-9c57-5f89e412de89 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:11.796984 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7ae0ae9b-2258-41f6-9c57-5f89e412de89 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:11.796984 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7ae0ae9b-2258-41f6-9c57-5f89e412de89 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:11.797249 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7ae0ae9b-2258-41f6-9c57-5f89e412de89 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:11.797652 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7ae0ae9b-2258-41f6-9c57-5f89e412de89 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:12.029786 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7ae0ae9b-2258-41f6-9c57-5f89e412de89 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:12.045722 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7ae0ae9b-2258-41f6-9c57-5f89e412de89 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:12.050587 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7ae0ae9b-2258-41f6-9c57-5f89e412de89 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:12.054059 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7ae0ae9b-2258-41f6-9c57-5f89e412de89 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] 10.222.0.42 "GET /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c" status: 200 len: 1265 microversion: 2.26 time: 0.286384 Oct 23 01:29:12.070402 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2111/4312] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:29:11 2022] GET /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c => generated 1265 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:29:12.130235 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-85593be2-7c92-473b-bac3-9e7b856e634b tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8950e247041d8be4fdfda5e2122fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db2a6834ec144418eb2cf222302fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:12.147144 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-85593be2-7c92-473b-bac3-9e7b856e634b tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] 10.222.0.42 "GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61" status: 200 len: 1305 microversion: 2.1 time: 0.496146 Oct 23 01:29:12.150449 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2202/4313] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:11 2022] GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61 => generated 1305 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:13.103552 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f1a27bc8-cfa6-4275-acc6-1ec622cf5386 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:13.104337 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f1a27bc8-cfa6-4275-acc6-1ec622cf5386 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] [instance: d4135945-6011-4843-9156-74dbc625e78c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:13.117563 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f1a27bc8-cfa6-4275-acc6-1ec622cf5386 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:13.120320 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f1a27bc8-cfa6-4275-acc6-1ec622cf5386 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:13.121104 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f1a27bc8-cfa6-4275-acc6-1ec622cf5386 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:13.138900 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f1a27bc8-cfa6-4275-acc6-1ec622cf5386 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:13.140208 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f1a27bc8-cfa6-4275-acc6-1ec622cf5386 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:13.140923 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f1a27bc8-cfa6-4275-acc6-1ec622cf5386 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:13.176134 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bb71c852-8ba8-4904-9d7f-54ca4a6aebdc tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:13.176761 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bb71c852-8ba8-4904-9d7f-54ca4a6aebdc tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] [instance: 08bd5c17-1a39-4d28-9a01-e93b999bfb61] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:13.201935 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bb71c852-8ba8-4904-9d7f-54ca4a6aebdc tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:13.202730 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bb71c852-8ba8-4904-9d7f-54ca4a6aebdc tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:13.205366 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bb71c852-8ba8-4904-9d7f-54ca4a6aebdc tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:13.206432 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bb71c852-8ba8-4904-9d7f-54ca4a6aebdc tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:13.207050 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bb71c852-8ba8-4904-9d7f-54ca4a6aebdc tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:13.207883 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bb71c852-8ba8-4904-9d7f-54ca4a6aebdc tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:13.465547 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f1a27bc8-cfa6-4275-acc6-1ec622cf5386 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:13.477778 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f1a27bc8-cfa6-4275-acc6-1ec622cf5386 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:13.479804 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f1a27bc8-cfa6-4275-acc6-1ec622cf5386 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:13.486686 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f1a27bc8-cfa6-4275-acc6-1ec622cf5386 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] 10.222.0.42 "GET /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c" status: 200 len: 1313 microversion: 2.26 time: 0.386652 Oct 23 01:29:13.488977 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2112/4314] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:29:13 2022] GET /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c => generated 1313 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:29:13.738073 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-36779429-e0b3-4ea8-811d-807e119f4867 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1456963514", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "29196e4d-a181-4491-925e-1281f479d093"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:29:13.796808 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bb71c852-8ba8-4904-9d7f-54ca4a6aebdc tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8950e247041d8be4fdfda5e2122fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db2a6834ec144418eb2cf222302fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:13.805927 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bb71c852-8ba8-4904-9d7f-54ca4a6aebdc tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] 10.222.0.42 "GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61" status: 200 len: 1305 microversion: 2.1 time: 0.634019 Oct 23 01:29:13.817843 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-36779429-e0b3-4ea8-811d-807e119f4867 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] validate_networks() for [('29196e4d-a181-4491-925e-1281f479d093', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:29:13.828984 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2203/4315] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:13 2022] GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61 => generated 1305 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:14.519184 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-57c1ff4e-5915-4486-83da-acfa37d890db tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:14.520391 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-57c1ff4e-5915-4486-83da-acfa37d890db tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] [instance: d4135945-6011-4843-9156-74dbc625e78c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:14.533036 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-57c1ff4e-5915-4486-83da-acfa37d890db tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:14.533549 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-57c1ff4e-5915-4486-83da-acfa37d890db tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:14.536249 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-57c1ff4e-5915-4486-83da-acfa37d890db tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:14.539576 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-57c1ff4e-5915-4486-83da-acfa37d890db tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:14.540911 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-57c1ff4e-5915-4486-83da-acfa37d890db tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:14.541545 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-57c1ff4e-5915-4486-83da-acfa37d890db tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:14.633924 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-36779429-e0b3-4ea8-811d-807e119f4867 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:29:14.639276 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-36779429-e0b3-4ea8-811d-807e119f4867 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:29:14.641266 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-36779429-e0b3-4ea8-811d-807e119f4867 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:29:14.642406 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-36779429-e0b3-4ea8-811d-807e119f4867 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:29:14.643505 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-36779429-e0b3-4ea8-811d-807e119f4867 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:29:14.680053 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36779429-e0b3-4ea8-811d-807e119f4867 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:14.684170 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36779429-e0b3-4ea8-811d-807e119f4867 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:14.684821 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36779429-e0b3-4ea8-811d-807e119f4867 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:14.689309 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36779429-e0b3-4ea8-811d-807e119f4867 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:14.691541 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36779429-e0b3-4ea8-811d-807e119f4867 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:14.692453 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36779429-e0b3-4ea8-811d-807e119f4867 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:14.713538 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-57c1ff4e-5915-4486-83da-acfa37d890db tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:14.726082 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-57c1ff4e-5915-4486-83da-acfa37d890db tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:14.729129 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-57c1ff4e-5915-4486-83da-acfa37d890db tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:14.734181 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-57c1ff4e-5915-4486-83da-acfa37d890db tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] 10.222.0.42 "GET /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c" status: 200 len: 1319 microversion: 2.26 time: 0.219332 Oct 23 01:29:14.750165 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2204/4316] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:29:14 2022] GET /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c => generated 1319 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:29:14.768073 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-36779429-e0b3-4ea8-811d-807e119f4867 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Getting quotas for project 9901e62cf4f94f6c9be3ff897caedf19. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:29:14.776662 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-36779429-e0b3-4ea8-811d-807e119f4867 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Getting quotas for user 0a92f307441747f29f583ddf004e8f21 and project 9901e62cf4f94f6c9be3ff897caedf19. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:29:14.797671 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-36779429-e0b3-4ea8-811d-807e119f4867 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:29:14.801336 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-36779429-e0b3-4ea8-811d-807e119f4867 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: e0bb5109-7f58-469c-b403-057248427835] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:29:14.836241 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-42fa5069-5172-48c7-8be3-574983b20d33 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:14.836868 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-42fa5069-5172-48c7-8be3-574983b20d33 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] [instance: 08bd5c17-1a39-4d28-9a01-e93b999bfb61] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:14.844711 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-42fa5069-5172-48c7-8be3-574983b20d33 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:14.845432 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-42fa5069-5172-48c7-8be3-574983b20d33 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:14.846069 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-42fa5069-5172-48c7-8be3-574983b20d33 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:14.855377 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-42fa5069-5172-48c7-8be3-574983b20d33 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:14.857831 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-42fa5069-5172-48c7-8be3-574983b20d33 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:14.858819 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-42fa5069-5172-48c7-8be3-574983b20d33 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:15.017185 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-36779429-e0b3-4ea8-811d-807e119f4867 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.523365 Oct 23 01:29:15.018969 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2113/4317] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:29:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:29:15.091556 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-eb2b5107-9710-4bfe-8b3b-afe83b34dbf0 req-0b513742-885b-4dc2-b6d2-059ddcd64082 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08bd5c17-1a39-4d28-9a01-e93b999bfb61", "tag": "933b406b-4a7e-457e-8b02-404bd679d55e"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:29:15.125121 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-eb2b5107-9710-4bfe-8b3b-afe83b34dbf0 req-0b513742-885b-4dc2-b6d2-059ddcd64082 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:15.133939 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-eb2b5107-9710-4bfe-8b3b-afe83b34dbf0 req-0b513742-885b-4dc2-b6d2-059ddcd64082 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:15.136341 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-eb2b5107-9710-4bfe-8b3b-afe83b34dbf0 req-0b513742-885b-4dc2-b6d2-059ddcd64082 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:15.165096 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-eb2b5107-9710-4bfe-8b3b-afe83b34dbf0 req-0b513742-885b-4dc2-b6d2-059ddcd64082 service nova] Creating event network-changed:933b406b-4a7e-457e-8b02-404bd679d55e for instance 08bd5c17-1a39-4d28-9a01-e93b999bfb61 on n-h1-master-1 Oct 23 01:29:15.183781 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-eb2b5107-9710-4bfe-8b3b-afe83b34dbf0 req-0b513742-885b-4dc2-b6d2-059ddcd64082 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098149 Oct 23 01:29:15.186031 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2114/4318] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:29:15.219414 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-42fa5069-5172-48c7-8be3-574983b20d33 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8950e247041d8be4fdfda5e2122fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db2a6834ec144418eb2cf222302fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:15.232521 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-42fa5069-5172-48c7-8be3-574983b20d33 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] 10.222.0.42 "GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61" status: 200 len: 1305 microversion: 2.1 time: 0.400329 Oct 23 01:29:15.234053 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2205/4319] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:14 2022] GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61 => generated 1305 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:29:15.321776 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b35af92a-65c8-4c24-95d8-95d6320ea483 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1468294531", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "29196e4d-a181-4491-925e-1281f479d093"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:29:15.440383 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-b35af92a-65c8-4c24-95d8-95d6320ea483 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] validate_networks() for [('29196e4d-a181-4491-925e-1281f479d093', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:29:15.770728 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f67aa2b1-d3d5-49fd-bdc8-e364a2e95e00 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:15.775174 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f67aa2b1-d3d5-49fd-bdc8-e364a2e95e00 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] [instance: d4135945-6011-4843-9156-74dbc625e78c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:15.797069 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f67aa2b1-d3d5-49fd-bdc8-e364a2e95e00 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:15.797365 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f67aa2b1-d3d5-49fd-bdc8-e364a2e95e00 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:15.816936 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f67aa2b1-d3d5-49fd-bdc8-e364a2e95e00 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:15.817762 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f67aa2b1-d3d5-49fd-bdc8-e364a2e95e00 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:15.818957 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f67aa2b1-d3d5-49fd-bdc8-e364a2e95e00 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:15.819255 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f67aa2b1-d3d5-49fd-bdc8-e364a2e95e00 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:15.988817 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f67aa2b1-d3d5-49fd-bdc8-e364a2e95e00 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:16.002593 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f67aa2b1-d3d5-49fd-bdc8-e364a2e95e00 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:16.004134 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f67aa2b1-d3d5-49fd-bdc8-e364a2e95e00 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:16.010611 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f67aa2b1-d3d5-49fd-bdc8-e364a2e95e00 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] 10.222.0.42 "GET /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c" status: 200 len: 1319 microversion: 2.26 time: 0.249084 Oct 23 01:29:16.022009 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2206/4320] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:29:15 2022] GET /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c => generated 1319 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:29:16.204080 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-b35af92a-65c8-4c24-95d8-95d6320ea483 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:29:16.205190 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-b35af92a-65c8-4c24-95d8-95d6320ea483 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:29:16.206016 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-b35af92a-65c8-4c24-95d8-95d6320ea483 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:29:16.206650 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-b35af92a-65c8-4c24-95d8-95d6320ea483 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:29:16.207277 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-b35af92a-65c8-4c24-95d8-95d6320ea483 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:29:16.220237 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b35af92a-65c8-4c24-95d8-95d6320ea483 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:16.221323 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b35af92a-65c8-4c24-95d8-95d6320ea483 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:16.222556 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b35af92a-65c8-4c24-95d8-95d6320ea483 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:16.223515 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b35af92a-65c8-4c24-95d8-95d6320ea483 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:16.224301 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b35af92a-65c8-4c24-95d8-95d6320ea483 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:16.224986 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b35af92a-65c8-4c24-95d8-95d6320ea483 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:16.259726 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-53b16859-273a-4a48-9abd-324d6a7a0d60 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:16.260510 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-53b16859-273a-4a48-9abd-324d6a7a0d60 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] [instance: 08bd5c17-1a39-4d28-9a01-e93b999bfb61] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:16.261434 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-b35af92a-65c8-4c24-95d8-95d6320ea483 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Getting quotas for project 9901e62cf4f94f6c9be3ff897caedf19. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:29:16.268297 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-b35af92a-65c8-4c24-95d8-95d6320ea483 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Getting quotas for user 0a92f307441747f29f583ddf004e8f21 and project 9901e62cf4f94f6c9be3ff897caedf19. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:29:16.274857 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-53b16859-273a-4a48-9abd-324d6a7a0d60 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:16.276505 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-53b16859-273a-4a48-9abd-324d6a7a0d60 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:16.276964 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-53b16859-273a-4a48-9abd-324d6a7a0d60 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:16.277677 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-53b16859-273a-4a48-9abd-324d6a7a0d60 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:16.278460 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-53b16859-273a-4a48-9abd-324d6a7a0d60 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:16.278895 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-53b16859-273a-4a48-9abd-324d6a7a0d60 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:16.284003 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:16.285805 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b35af92a-65c8-4c24-95d8-95d6320ea483 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:29:16.289968 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b35af92a-65c8-4c24-95d8-95d6320ea483 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: b4f3e58c-311d-4b8a-b231-67e8fbc8cd3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:29:16.553169 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b35af92a-65c8-4c24-95d8-95d6320ea483 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.236298 Oct 23 01:29:16.554015 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2115/4321] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:29:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1243 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:29:16.652966 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-53b16859-273a-4a48-9abd-324d6a7a0d60 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8950e247041d8be4fdfda5e2122fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db2a6834ec144418eb2cf222302fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:16.665835 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-53b16859-273a-4a48-9abd-324d6a7a0d60 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] 10.222.0.42 "GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61" status: 200 len: 1305 microversion: 2.1 time: 0.412104 Oct 23 01:29:16.666576 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2207/4322] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:16 2022] GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61 => generated 1305 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:16.755188 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-053eb985-78ed-4e36-9758-fe612ccf4192 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-768143996", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "451", "networks": [{"uuid": "29196e4d-a181-4491-925e-1281f479d093"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:29:16.897209 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-053eb985-78ed-4e36-9758-fe612ccf4192 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] validate_networks() for [('29196e4d-a181-4491-925e-1281f479d093', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:29:17.090642 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9bc21a8f-112c-468d-a25c-2dc857762e12 tempest-ListImagesTestJSON-1419054648 tempest-ListImagesTestJSON-1419054648-project] Calling method '.version_select at 0x7f5cc169fee0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:17.165100 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9bc21a8f-112c-468d-a25c-2dc857762e12 tempest-ListImagesTestJSON-1419054648 tempest-ListImagesTestJSON-1419054648-project] 10.222.0.42 "GET /compute/v2.1/images/446b40bc-db5b-4123-9278-997bd6d04a0d" status: 200 len: 784 microversion: 2.1 time: 0.608790 Oct 23 01:29:17.166385 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2116/4323] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:29:16 2022] GET /compute/v2.1/images/446b40bc-db5b-4123-9278-997bd6d04a0d => generated 784 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:29:17.181604 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-dc622edc-b8ff-451f-b3fc-eb32e28373e4 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:17.184704 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-dc622edc-b8ff-451f-b3fc-eb32e28373e4 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] [instance: d4135945-6011-4843-9156-74dbc625e78c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:17.192320 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dc622edc-b8ff-451f-b3fc-eb32e28373e4 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:17.193650 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dc622edc-b8ff-451f-b3fc-eb32e28373e4 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:17.194448 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dc622edc-b8ff-451f-b3fc-eb32e28373e4 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:17.195389 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dc622edc-b8ff-451f-b3fc-eb32e28373e4 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:17.197017 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dc622edc-b8ff-451f-b3fc-eb32e28373e4 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:17.198032 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dc622edc-b8ff-451f-b3fc-eb32e28373e4 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:18.173767 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-dc622edc-b8ff-451f-b3fc-eb32e28373e4 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:18.187372 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-dc622edc-b8ff-451f-b3fc-eb32e28373e4 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:18.191056 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-dc622edc-b8ff-451f-b3fc-eb32e28373e4 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:18.194743 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-dc622edc-b8ff-451f-b3fc-eb32e28373e4 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] 10.222.0.42 "GET /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c" status: 200 len: 1361 microversion: 2.26 time: 1.027057 Oct 23 01:29:18.196071 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2117/4324] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:29:17 2022] GET /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c => generated 1361 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:29:18.241533 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5c3c81d5-a5c3-4c7d-a7dd-5bf3ced246c7 tempest-ListImagesTestJSON-1419054648 tempest-ListImagesTestJSON-1419054648-project] Calling method '.version_select at 0x7f5cc15adca0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:18.331761 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5c3c81d5-a5c3-4c7d-a7dd-5bf3ced246c7 tempest-ListImagesTestJSON-1419054648 tempest-ListImagesTestJSON-1419054648-project] 10.222.0.42 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.133551 Oct 23 01:29:18.337584 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2118/4325] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:29:18 2022] GET /compute/v2.1/images => generated 445 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:29:18.338140 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7ef92b9a-405d-45aa-9ff9-71603a75ad4d tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:18.338978 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7ef92b9a-405d-45aa-9ff9-71603a75ad4d tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] [instance: 08bd5c17-1a39-4d28-9a01-e93b999bfb61] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:18.346033 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7ef92b9a-405d-45aa-9ff9-71603a75ad4d tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:18.346822 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7ef92b9a-405d-45aa-9ff9-71603a75ad4d tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:18.347450 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7ef92b9a-405d-45aa-9ff9-71603a75ad4d tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:18.348336 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7ef92b9a-405d-45aa-9ff9-71603a75ad4d tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:18.349023 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7ef92b9a-405d-45aa-9ff9-71603a75ad4d tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:18.349664 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7ef92b9a-405d-45aa-9ff9-71603a75ad4d tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:18.759934 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7ef92b9a-405d-45aa-9ff9-71603a75ad4d tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8950e247041d8be4fdfda5e2122fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db2a6834ec144418eb2cf222302fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:18.771311 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7ef92b9a-405d-45aa-9ff9-71603a75ad4d tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] 10.222.0.42 "GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61" status: 200 len: 1305 microversion: 2.1 time: 0.437181 Oct 23 01:29:18.771900 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2119/4326] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:18 2022] GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61 => generated 1305 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:18.789257 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1965edce-c825-411f-aaba-5595688ca632 tempest-ListImagesTestJSON-1419054648 tempest-ListImagesTestJSON-1419054648-project] Calling method '.version_select at 0x7f5cc14bf700>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:18.815950 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-053eb985-78ed-4e36-9758-fe612ccf4192 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:29:18.816453 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-053eb985-78ed-4e36-9758-fe612ccf4192 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:29:18.816876 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-053eb985-78ed-4e36-9758-fe612ccf4192 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:29:18.817294 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-053eb985-78ed-4e36-9758-fe612ccf4192 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:29:18.817809 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-053eb985-78ed-4e36-9758-fe612ccf4192 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:29:18.835102 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-053eb985-78ed-4e36-9758-fe612ccf4192 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:18.836469 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-053eb985-78ed-4e36-9758-fe612ccf4192 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:18.838477 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-053eb985-78ed-4e36-9758-fe612ccf4192 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:18.839259 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-053eb985-78ed-4e36-9758-fe612ccf4192 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:18.839735 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-053eb985-78ed-4e36-9758-fe612ccf4192 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:18.840177 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-053eb985-78ed-4e36-9758-fe612ccf4192 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:18.864678 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=100 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:18.878900 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-053eb985-78ed-4e36-9758-fe612ccf4192 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Getting quotas for project 9901e62cf4f94f6c9be3ff897caedf19. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:29:18.885334 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-053eb985-78ed-4e36-9758-fe612ccf4192 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Getting quotas for user 0a92f307441747f29f583ddf004e8f21 and project 9901e62cf4f94f6c9be3ff897caedf19. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:29:18.886433 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1965edce-c825-411f-aaba-5595688ca632 tempest-ListImagesTestJSON-1419054648 tempest-ListImagesTestJSON-1419054648-project] 10.222.0.42 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.113099 Oct 23 01:29:18.888538 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2120/4327] 10.222.0.42 () {58 vars in 1143 bytes} [Sun Oct 23 01:29:18 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:29:18.915835 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-053eb985-78ed-4e36-9758-fe612ccf4192 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:29:18.919008 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-053eb985-78ed-4e36-9758-fe612ccf4192 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: 79b6e08c-f496-40ee-b5ea-34392ac475ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:29:19.087142 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-053eb985-78ed-4e36-9758-fe612ccf4192 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.336555 Oct 23 01:29:19.092860 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2208/4328] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:29:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2345 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 23 01:29:19.105453 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d68d09f0-6fc6-477e-aca2-ec6ea76bca49 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:19.113588 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d68d09f0-6fc6-477e-aca2-ec6ea76bca49 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: 79b6e08c-f496-40ee-b5ea-34392ac475ad] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:19.205235 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d68d09f0-6fc6-477e-aca2-ec6ea76bca49 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:19.213031 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d68d09f0-6fc6-477e-aca2-ec6ea76bca49 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad" status: 200 len: 1220 microversion: 2.1 time: 0.112424 Oct 23 01:29:19.213861 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2121/4329] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:19 2022] GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad => generated 1220 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:19.236847 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-afdf941c-5396-4569-b392-2caf746b3a31 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:19.237521 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-afdf941c-5396-4569-b392-2caf746b3a31 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] [instance: d4135945-6011-4843-9156-74dbc625e78c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:19.252479 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-afdf941c-5396-4569-b392-2caf746b3a31 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:19.253775 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-afdf941c-5396-4569-b392-2caf746b3a31 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:19.254453 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-afdf941c-5396-4569-b392-2caf746b3a31 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:19.257730 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-afdf941c-5396-4569-b392-2caf746b3a31 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:19.258436 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-afdf941c-5396-4569-b392-2caf746b3a31 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:19.259262 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-afdf941c-5396-4569-b392-2caf746b3a31 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:19.646192 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-afdf941c-5396-4569-b392-2caf746b3a31 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:19.664413 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-afdf941c-5396-4569-b392-2caf746b3a31 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:19.669802 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-afdf941c-5396-4569-b392-2caf746b3a31 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:19.671648 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-afdf941c-5396-4569-b392-2caf746b3a31 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] 10.222.0.42 "GET /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c" status: 200 len: 1361 microversion: 2.26 time: 0.450666 Oct 23 01:29:19.676104 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2209/4330] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:29:19 2022] GET /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c => generated 1361 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:29:19.795841 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-62aaad34-d043-4d14-b1f3-8a292a1c4bb4 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:19.796468 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-62aaad34-d043-4d14-b1f3-8a292a1c4bb4 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] [instance: 08bd5c17-1a39-4d28-9a01-e93b999bfb61] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:19.815920 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-62aaad34-d043-4d14-b1f3-8a292a1c4bb4 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:19.816433 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-62aaad34-d043-4d14-b1f3-8a292a1c4bb4 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:19.816890 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-62aaad34-d043-4d14-b1f3-8a292a1c4bb4 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:19.817667 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-62aaad34-d043-4d14-b1f3-8a292a1c4bb4 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:19.818736 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-62aaad34-d043-4d14-b1f3-8a292a1c4bb4 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:19.819170 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-62aaad34-d043-4d14-b1f3-8a292a1c4bb4 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:19.830949 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-00b5c386-b13a-4bbd-9d71-fc629255e14e req-8b06eaf5-80a1-49af-b402-29da021364ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4135945-6011-4843-9156-74dbc625e78c", "tag": "6ef1ef8d-1fbb-471e-a80f-b7a3b541b417"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:29:19.855115 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-00b5c386-b13a-4bbd-9d71-fc629255e14e req-8b06eaf5-80a1-49af-b402-29da021364ec service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:19.859396 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-00b5c386-b13a-4bbd-9d71-fc629255e14e req-8b06eaf5-80a1-49af-b402-29da021364ec service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:19.860719 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-00b5c386-b13a-4bbd-9d71-fc629255e14e req-8b06eaf5-80a1-49af-b402-29da021364ec service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:19.880347 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-00b5c386-b13a-4bbd-9d71-fc629255e14e req-8b06eaf5-80a1-49af-b402-29da021364ec service nova] Creating event network-changed:6ef1ef8d-1fbb-471e-a80f-b7a3b541b417 for instance d4135945-6011-4843-9156-74dbc625e78c on n-h2-master-1 Oct 23 01:29:19.887910 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-00b5c386-b13a-4bbd-9d71-fc629255e14e req-8b06eaf5-80a1-49af-b402-29da021364ec service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061779 Oct 23 01:29:19.888888 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2210/4331] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:29:20.139410 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-62aaad34-d043-4d14-b1f3-8a292a1c4bb4 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8950e247041d8be4fdfda5e2122fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db2a6834ec144418eb2cf222302fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:20.152752 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-62aaad34-d043-4d14-b1f3-8a292a1c4bb4 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] 10.222.0.42 "GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61" status: 200 len: 1305 microversion: 2.1 time: 0.360635 Oct 23 01:29:20.156527 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2122/4332] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:19 2022] GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61 => generated 1305 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:20.241316 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fcb60c88-c16e-464a-ba12-3861805c66ee tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:20.242452 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fcb60c88-c16e-464a-ba12-3861805c66ee tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: 79b6e08c-f496-40ee-b5ea-34392ac475ad] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:20.362735 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fcb60c88-c16e-464a-ba12-3861805c66ee tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:20.377262 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fcb60c88-c16e-464a-ba12-3861805c66ee tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad" status: 200 len: 1220 microversion: 2.1 time: 0.141128 Oct 23 01:29:20.381574 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2211/4333] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:20 2022] GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad => generated 1220 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:20.702879 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-44b50ebe-4f3a-4042-a6b6-2780b6cc5baa tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:20.704095 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-44b50ebe-4f3a-4042-a6b6-2780b6cc5baa tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] [instance: d4135945-6011-4843-9156-74dbc625e78c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:20.722469 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44b50ebe-4f3a-4042-a6b6-2780b6cc5baa tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:20.723108 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44b50ebe-4f3a-4042-a6b6-2780b6cc5baa tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:20.723665 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44b50ebe-4f3a-4042-a6b6-2780b6cc5baa tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:20.724539 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44b50ebe-4f3a-4042-a6b6-2780b6cc5baa tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:20.726908 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44b50ebe-4f3a-4042-a6b6-2780b6cc5baa tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:20.727467 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44b50ebe-4f3a-4042-a6b6-2780b6cc5baa tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:21.022755 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-44b50ebe-4f3a-4042-a6b6-2780b6cc5baa tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:21.036093 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-44b50ebe-4f3a-4042-a6b6-2780b6cc5baa tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:21.037668 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-44b50ebe-4f3a-4042-a6b6-2780b6cc5baa tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:21.041468 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-44b50ebe-4f3a-4042-a6b6-2780b6cc5baa tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] 10.222.0.42 "GET /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c" status: 200 len: 1361 microversion: 2.26 time: 0.344505 Oct 23 01:29:21.042178 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2123/4334] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:29:20 2022] GET /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c => generated 1361 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:29:21.181209 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-19f5c770-5b7b-4d54-9df4-12e0d4a985ea tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:21.182523 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-19f5c770-5b7b-4d54-9df4-12e0d4a985ea tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] [instance: 08bd5c17-1a39-4d28-9a01-e93b999bfb61] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:21.194330 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-19f5c770-5b7b-4d54-9df4-12e0d4a985ea tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:21.198482 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-19f5c770-5b7b-4d54-9df4-12e0d4a985ea tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:21.198482 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-19f5c770-5b7b-4d54-9df4-12e0d4a985ea tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:21.198482 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-19f5c770-5b7b-4d54-9df4-12e0d4a985ea tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:21.198482 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-19f5c770-5b7b-4d54-9df4-12e0d4a985ea tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:21.198925 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-19f5c770-5b7b-4d54-9df4-12e0d4a985ea tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:21.401383 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-235e0444-aaab-42b4-b9fb-399f68f173f7 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:21.403226 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-235e0444-aaab-42b4-b9fb-399f68f173f7 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: 79b6e08c-f496-40ee-b5ea-34392ac475ad] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:21.417580 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-235e0444-aaab-42b4-b9fb-399f68f173f7 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:21.418953 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-235e0444-aaab-42b4-b9fb-399f68f173f7 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:21.423342 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-235e0444-aaab-42b4-b9fb-399f68f173f7 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:21.427850 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-235e0444-aaab-42b4-b9fb-399f68f173f7 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:21.427850 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-235e0444-aaab-42b4-b9fb-399f68f173f7 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:21.427850 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-235e0444-aaab-42b4-b9fb-399f68f173f7 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:21.611154 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-235e0444-aaab-42b4-b9fb-399f68f173f7 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:21.641023 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-235e0444-aaab-42b4-b9fb-399f68f173f7 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad" status: 200 len: 1216 microversion: 2.1 time: 0.243440 Oct 23 01:29:21.653071 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2124/4335] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:21 2022] GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad => generated 1216 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:21.671061 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-19f5c770-5b7b-4d54-9df4-12e0d4a985ea tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8950e247041d8be4fdfda5e2122fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db2a6834ec144418eb2cf222302fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:21.685249 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-19f5c770-5b7b-4d54-9df4-12e0d4a985ea tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] 10.222.0.42 "GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61" status: 200 len: 1305 microversion: 2.1 time: 0.509250 Oct 23 01:29:21.685954 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2212/4336] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:21 2022] GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61 => generated 1305 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:22.073774 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-47cc5bda-351d-4bb1-93c6-187471ae6888 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:22.074515 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-47cc5bda-351d-4bb1-93c6-187471ae6888 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] [instance: d4135945-6011-4843-9156-74dbc625e78c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:22.102461 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-47cc5bda-351d-4bb1-93c6-187471ae6888 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:22.102694 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-47cc5bda-351d-4bb1-93c6-187471ae6888 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:22.104290 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-47cc5bda-351d-4bb1-93c6-187471ae6888 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:22.105845 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-47cc5bda-351d-4bb1-93c6-187471ae6888 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:22.107555 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-47cc5bda-351d-4bb1-93c6-187471ae6888 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:22.109608 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-47cc5bda-351d-4bb1-93c6-187471ae6888 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:22.574480 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-47cc5bda-351d-4bb1-93c6-187471ae6888 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:22.596087 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-47cc5bda-351d-4bb1-93c6-187471ae6888 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:22.612589 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-47cc5bda-351d-4bb1-93c6-187471ae6888 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:22.617004 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-47cc5bda-351d-4bb1-93c6-187471ae6888 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] 10.222.0.42 "GET /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c" status: 200 len: 1361 microversion: 2.26 time: 0.545132 Oct 23 01:29:22.632910 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2125/4337] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:29:22 2022] GET /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c => generated 1361 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:29:22.681646 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9bd8a783-fdc5-412e-9244-3e8f17419da3 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:22.682438 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9bd8a783-fdc5-412e-9244-3e8f17419da3 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: 79b6e08c-f496-40ee-b5ea-34392ac475ad] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:22.694986 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9bd8a783-fdc5-412e-9244-3e8f17419da3 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:22.700855 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9bd8a783-fdc5-412e-9244-3e8f17419da3 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:22.701503 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9bd8a783-fdc5-412e-9244-3e8f17419da3 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:22.702502 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9bd8a783-fdc5-412e-9244-3e8f17419da3 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:22.703086 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9bd8a783-fdc5-412e-9244-3e8f17419da3 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:22.703666 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9bd8a783-fdc5-412e-9244-3e8f17419da3 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:22.718169 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-32acc8ab-c8de-4767-b715-56eed80d7adc tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:22.719818 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-32acc8ab-c8de-4767-b715-56eed80d7adc tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] [instance: 08bd5c17-1a39-4d28-9a01-e93b999bfb61] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:22.745786 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-32acc8ab-c8de-4767-b715-56eed80d7adc tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:22.752749 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-32acc8ab-c8de-4767-b715-56eed80d7adc tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:22.752749 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-32acc8ab-c8de-4767-b715-56eed80d7adc tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:22.752749 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-32acc8ab-c8de-4767-b715-56eed80d7adc tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:22.761492 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-32acc8ab-c8de-4767-b715-56eed80d7adc tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:22.764578 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-32acc8ab-c8de-4767-b715-56eed80d7adc tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:22.861545 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9bd8a783-fdc5-412e-9244-3e8f17419da3 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:22.878112 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9bd8a783-fdc5-412e-9244-3e8f17419da3 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad" status: 200 len: 1272 microversion: 2.1 time: 0.199589 Oct 23 01:29:22.882745 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2213/4338] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:22 2022] GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad => generated 1272 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:23.005795 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fca35dc5-595f-4c18-993b-f04b2b26a482 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:23.012305 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fca35dc5-595f-4c18-993b-f04b2b26a482 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: 0fb11dc6-65bc-4c8e-a674-c948f42f1b87] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:23.019978 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fca35dc5-595f-4c18-993b-f04b2b26a482 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:23.020482 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fca35dc5-595f-4c18-993b-f04b2b26a482 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:23.021449 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fca35dc5-595f-4c18-993b-f04b2b26a482 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:23.027766 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fca35dc5-595f-4c18-993b-f04b2b26a482 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:23.028280 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fca35dc5-595f-4c18-993b-f04b2b26a482 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:23.028723 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fca35dc5-595f-4c18-993b-f04b2b26a482 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:23.115739 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fca35dc5-595f-4c18-993b-f04b2b26a482 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109629 Oct 23 01:29:23.115739 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2214/4339] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:29:22 2022] GET /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:29:23.174333 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-32acc8ab-c8de-4767-b715-56eed80d7adc tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8950e247041d8be4fdfda5e2122fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db2a6834ec144418eb2cf222302fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:23.188380 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-32acc8ab-c8de-4767-b715-56eed80d7adc tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] 10.222.0.42 "GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61" status: 200 len: 1305 microversion: 2.1 time: 0.481637 Oct 23 01:29:23.195723 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2126/4340] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:22 2022] GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61 => generated 1305 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:23.471366 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-54d3b9fd-ca08-45e7-92fd-deae878c2aeb tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] Action: 'create', calling method: .version_select at 0x7f5cc183b1f0>, body: {"keypair": {"name": "tempest-keypair-2003617757", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeFpGiM3nWBrGyP6Gln7rq+yfJKW94eDLZ9JJxcb7S8i6JAt2283M3C8j0KcOxPybUuCArsjioZlR88ndKZre24RdFwLjL4ie6d5is3ZfyXvklhP9UW6hCTPiN5Ue3cdQ=="}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:29:23.503015 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-54d3b9fd-ca08-45e7-92fd-deae878c2aeb tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] Getting quotas for project 329d7cb10dbf46688477ab15172e1133. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:29:23.511355 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-54d3b9fd-ca08-45e7-92fd-deae878c2aeb tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] Getting quotas for user 52f053dcd6da4102a6bdf18c6bd41752 and project 329d7cb10dbf46688477ab15172e1133. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:29:23.631794 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-54d3b9fd-ca08-45e7-92fd-deae878c2aeb tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.346025 Oct 23 01:29:23.633054 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2215/4341] 10.222.0.42 () {62 vars in 1199 bytes} [Sun Oct 23 01:29:23 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 348 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 23 01:29:23.646302 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-245b8ce1-ae87-405d-945a-f98fb706fcfd tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] Calling method '.version_select at 0x7f5cc14bf790>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:23.648733 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6469c905-638d-44ae-8233-0852ab8b1936 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:23.649418 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6469c905-638d-44ae-8233-0852ab8b1936 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] [instance: d4135945-6011-4843-9156-74dbc625e78c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:23.667417 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6469c905-638d-44ae-8233-0852ab8b1936 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:23.667417 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6469c905-638d-44ae-8233-0852ab8b1936 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:23.667417 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6469c905-638d-44ae-8233-0852ab8b1936 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:23.667417 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6469c905-638d-44ae-8233-0852ab8b1936 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:23.667417 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6469c905-638d-44ae-8233-0852ab8b1936 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:23.667417 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6469c905-638d-44ae-8233-0852ab8b1936 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:23.668419 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-245b8ce1-ae87-405d-945a-f98fb706fcfd tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] 10.222.0.42 "GET /compute/v2.1/os-keypairs/tempest-keypair-2003617757" status: 200 len: 513 microversion: 2.2 time: 0.026532 Oct 23 01:29:23.671202 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2127/4342] 10.222.0.42 () {60 vars in 1258 bytes} [Sun Oct 23 01:29:23 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2003617757 => generated 513 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:29:23.687337 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-10dd9811-fa14-4c5f-a7db-058731be94d4 tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] Calling method '.version_select at 0x7f5cc15ad820>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:23.807872 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-10dd9811-fa14-4c5f-a7db-058731be94d4 tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2003617757" status: 204 len: 0 microversion: 2.2 time: 0.126115 Oct 23 01:29:23.820171 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2128/4343] 10.222.0.42 () {60 vars in 1261 bytes} [Sun Oct 23 01:29:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2003617757 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:29:23.825839 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8f2be51c-8a14-48ac-8007-f6cdfa47fdba tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] Action: 'create', calling method: .version_select at 0x7f5cc1644700>, body: {"keypair": {"name": "tempest-keypair-1393318065", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOz5c+MlqqWUf8a7uTYT+qlTCW2epNLfROlSHSze+hQMQyhdFWjoHx64tIxB8+qev/D/R188Tu6j2wkTI1tJ6bFOtwR06XYvA2Zc6vdsVQX/cwP+VXw1dR+EwSSAnBFDOg=="}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:29:23.881184 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-8f2be51c-8a14-48ac-8007-f6cdfa47fdba tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] Getting quotas for project 329d7cb10dbf46688477ab15172e1133. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:29:23.894562 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-8f2be51c-8a14-48ac-8007-f6cdfa47fdba tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] Getting quotas for user 52f053dcd6da4102a6bdf18c6bd41752 and project 329d7cb10dbf46688477ab15172e1133. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:29:23.930908 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6469c905-638d-44ae-8233-0852ab8b1936 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:23.946266 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6469c905-638d-44ae-8233-0852ab8b1936 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:23.948148 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6469c905-638d-44ae-8233-0852ab8b1936 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:23.949737 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6469c905-638d-44ae-8233-0852ab8b1936 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] 10.222.0.42 "GET /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c" status: 200 len: 1361 microversion: 2.26 time: 0.307113 Oct 23 01:29:23.951959 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2216/4344] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:29:23 2022] GET /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c => generated 1361 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:29:23.969058 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-30089911-363c-4801-aefa-cafc720a53bb tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:23.971028 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-30089911-363c-4801-aefa-cafc720a53bb tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: 79b6e08c-f496-40ee-b5ea-34392ac475ad] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:23.983919 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-30089911-363c-4801-aefa-cafc720a53bb tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:23.985208 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-30089911-363c-4801-aefa-cafc720a53bb tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:23.986806 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-30089911-363c-4801-aefa-cafc720a53bb tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:23.988502 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-30089911-363c-4801-aefa-cafc720a53bb tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:23.989401 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-30089911-363c-4801-aefa-cafc720a53bb tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:23.990200 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-30089911-363c-4801-aefa-cafc720a53bb tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:24.051818 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8f2be51c-8a14-48ac-8007-f6cdfa47fdba tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.230218 Oct 23 01:29:24.053172 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2129/4345] 10.222.0.42 () {62 vars in 1199 bytes} [Sun Oct 23 01:29:23 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 232 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 23 01:29:24.070100 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b28bf12f-227c-4312-bd05-40874cb7c8bd tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] Calling method '.version_select at 0x7f5cc14e9790>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:24.130699 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-30089911-363c-4801-aefa-cafc720a53bb tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:24.142796 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-30089911-363c-4801-aefa-cafc720a53bb tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad" status: 200 len: 1280 microversion: 2.1 time: 0.188419 Oct 23 01:29:24.143936 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2217/4346] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:23 2022] GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad => generated 1280 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:24.149935 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5202cc1d-4362-4f5d-bd78-8ef98c00e836 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:24.152666 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5202cc1d-4362-4f5d-bd78-8ef98c00e836 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: 0fb11dc6-65bc-4c8e-a674-c948f42f1b87] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:24.165347 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5202cc1d-4362-4f5d-bd78-8ef98c00e836 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:24.165859 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5202cc1d-4362-4f5d-bd78-8ef98c00e836 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:24.166429 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5202cc1d-4362-4f5d-bd78-8ef98c00e836 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:24.167161 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5202cc1d-4362-4f5d-bd78-8ef98c00e836 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:24.167624 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5202cc1d-4362-4f5d-bd78-8ef98c00e836 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:24.168061 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5202cc1d-4362-4f5d-bd78-8ef98c00e836 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:24.219412 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b28bf12f-227c-4312-bd05-40874cb7c8bd tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1393318065" status: 204 len: 0 microversion: 2.2 time: 0.158793 Oct 23 01:29:24.220006 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2130/4347] 10.222.0.42 () {60 vars in 1261 bytes} [Sun Oct 23 01:29:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1393318065 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:29:24.227227 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-05517df0-88f5-485c-9d03-00ff1abda873 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:24.228089 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-05517df0-88f5-485c-9d03-00ff1abda873 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] [instance: 08bd5c17-1a39-4d28-9a01-e93b999bfb61] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:24.245837 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5202cc1d-4362-4f5d-bd78-8ef98c00e836 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.100509 Oct 23 01:29:24.247732 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2218/4348] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:29:24 2022] GET /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87/os-volume_attachments => generated 25 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:29:24.252359 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-75605999-c339-4cdd-9a34-5a4f13825363 tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] Action: 'create', calling method: .version_select at 0x7f5cc1a60ee0>, body: {"keypair": {"name": "tempest-keypair-985177686", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:29:24.259234 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05517df0-88f5-485c-9d03-00ff1abda873 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:24.261029 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05517df0-88f5-485c-9d03-00ff1abda873 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:24.261601 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05517df0-88f5-485c-9d03-00ff1abda873 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:24.265619 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05517df0-88f5-485c-9d03-00ff1abda873 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:24.266084 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05517df0-88f5-485c-9d03-00ff1abda873 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:24.267628 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05517df0-88f5-485c-9d03-00ff1abda873 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:24.275750 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-75605999-c339-4cdd-9a34-5a4f13825363 tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] Getting quotas for project 329d7cb10dbf46688477ab15172e1133. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:29:24.283787 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-75605999-c339-4cdd-9a34-5a4f13825363 tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] Getting quotas for user 52f053dcd6da4102a6bdf18c6bd41752 and project 329d7cb10dbf46688477ab15172e1133. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:29:24.309958 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:24.398302 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-75605999-c339-4cdd-9a34-5a4f13825363 tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.149640 Oct 23 01:29:24.399720 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2219/4349] 10.222.0.42 () {62 vars in 1199 bytes} [Sun Oct 23 01:29:24 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 152 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 23 01:29:24.411312 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c0f0e2ba-5b25-4776-820a-91af45fb553e tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] Calling method '.version_select at 0x7f5cc254d040>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:24.499938 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-05517df0-88f5-485c-9d03-00ff1abda873 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8950e247041d8be4fdfda5e2122fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db2a6834ec144418eb2cf222302fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:24.506886 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:24.510133 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-05517df0-88f5-485c-9d03-00ff1abda873 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] 10.222.0.42 "GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61" status: 200 len: 1305 microversion: 2.1 time: 0.288959 Oct 23 01:29:24.511344 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2131/4350] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:24 2022] GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61 => generated 1305 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:24.519801 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6589d2f9-adfb-4ffd-897b-2c0ca6c8abb6 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:24.528180 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6589d2f9-adfb-4ffd-897b-2c0ca6c8abb6 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: 0fb11dc6-65bc-4c8e-a674-c948f42f1b87] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:24.538069 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6589d2f9-adfb-4ffd-897b-2c0ca6c8abb6 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:24.538799 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6589d2f9-adfb-4ffd-897b-2c0ca6c8abb6 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:24.540114 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6589d2f9-adfb-4ffd-897b-2c0ca6c8abb6 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:24.541019 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6589d2f9-adfb-4ffd-897b-2c0ca6c8abb6 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:24.541546 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6589d2f9-adfb-4ffd-897b-2c0ca6c8abb6 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:24.542738 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6589d2f9-adfb-4ffd-897b-2c0ca6c8abb6 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:24.564764 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c0f0e2ba-5b25-4776-820a-91af45fb553e tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-985177686" status: 204 len: 0 microversion: 2.2 time: 0.158395 Oct 23 01:29:24.565923 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2220/4351] 10.222.0.42 () {60 vars in 1258 bytes} [Sun Oct 23 01:29:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-985177686 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 23 01:29:24.581455 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-db6fce8f-2c41-4ba4-94b6-7c5e8006e048 tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] Action: 'create', calling method: .version_select at 0x7f5cc1982af0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-741099126", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxpMTw13a7OAw/gwvcw0DX2EJcOsHDSifRdS54a3Om91jgiliyAkjUXAT5UrGjdHs+9m3Ih/rKK6hQxjoCNnd5Zg6DbcUELlkXHdjaCmHGU9mMC2XHJGbP27wrg1QO6yw=="}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:29:24.615143 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6589d2f9-adfb-4ffd-897b-2c0ca6c8abb6 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.102336 Oct 23 01:29:24.620011 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2132/4352] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:29:24 2022] GET /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87/os-volume_attachments => generated 25 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:29:24.621632 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-db6fce8f-2c41-4ba4-94b6-7c5e8006e048 tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] Getting quotas for project 329d7cb10dbf46688477ab15172e1133. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:29:24.628118 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-db6fce8f-2c41-4ba4-94b6-7c5e8006e048 tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] Getting quotas for user 52f053dcd6da4102a6bdf18c6bd41752 and project 329d7cb10dbf46688477ab15172e1133. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:29:24.724732 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7f4b4110-1d03-4c3e-ab99-ee4c07a300a8 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:24.725462 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7f4b4110-1d03-4c3e-ab99-ee4c07a300a8 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: 0fb11dc6-65bc-4c8e-a674-c948f42f1b87] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:24.742222 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f4b4110-1d03-4c3e-ab99-ee4c07a300a8 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:24.743051 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f4b4110-1d03-4c3e-ab99-ee4c07a300a8 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:24.743686 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f4b4110-1d03-4c3e-ab99-ee4c07a300a8 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:24.744598 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f4b4110-1d03-4c3e-ab99-ee4c07a300a8 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:24.745284 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f4b4110-1d03-4c3e-ab99-ee4c07a300a8 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:24.746932 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f4b4110-1d03-4c3e-ab99-ee4c07a300a8 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:24.777075 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-db6fce8f-2c41-4ba4-94b6-7c5e8006e048 tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.200571 Oct 23 01:29:24.785047 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2221/4353] 10.222.0.42 () {62 vars in 1199 bytes} [Sun Oct 23 01:29:24 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 203 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 23 01:29:24.794263 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7f4b4110-1d03-4c3e-ab99-ee4c07a300a8 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: 0fb11dc6-65bc-4c8e-a674-c948f42f1b87] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:29:24.794673 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d23e6567-49d3-48b2-b3c8-81fba6e655ff tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] Action: 'create', calling method: .version_select at 0x7f5cc1c149d0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1322937443", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOfPRM5W/o7DLf299JyGExZ6spdOEJjlAJoW1TmHrvLLXufXZ4qgjvpXPl3nw7v+HFJN6WQesBJRyyQA3h5faC/QRK/rOsSvodBWjIj4vJdNQMBoSXN8uAkVZFwE4nE3yQ=="}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:29:24.839654 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-d23e6567-49d3-48b2-b3c8-81fba6e655ff tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] Getting quotas for project 329d7cb10dbf46688477ab15172e1133. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:29:24.849231 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-d23e6567-49d3-48b2-b3c8-81fba6e655ff tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] Getting quotas for user 52f053dcd6da4102a6bdf18c6bd41752 and project 329d7cb10dbf46688477ab15172e1133. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:29:25.002547 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d23e6567-49d3-48b2-b3c8-81fba6e655ff tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.213658 Oct 23 01:29:25.004395 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2222/4354] 10.222.0.42 () {62 vars in 1199 bytes} [Sun Oct 23 01:29:24 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 217 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 23 01:29:25.017614 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4294709f-369b-4b89-9bbb-8f2ca35d541c tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:25.019115 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4294709f-369b-4b89-9bbb-8f2ca35d541c tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] [instance: d4135945-6011-4843-9156-74dbc625e78c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:25.038845 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4294709f-369b-4b89-9bbb-8f2ca35d541c tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:25.040639 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4294709f-369b-4b89-9bbb-8f2ca35d541c tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:25.041044 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4294709f-369b-4b89-9bbb-8f2ca35d541c tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:25.043710 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4294709f-369b-4b89-9bbb-8f2ca35d541c tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:25.044326 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4294709f-369b-4b89-9bbb-8f2ca35d541c tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:25.044658 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4294709f-369b-4b89-9bbb-8f2ca35d541c tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:25.218987 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7f4b4110-1d03-4c3e-ab99-ee4c07a300a8 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87" status: 204 len: 0 microversion: 2.1 time: 0.501116 Oct 23 01:29:25.223034 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2133/4355] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:29:24 2022] DELETE /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 23 01:29:25.230044 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8f7728a2-a2b7-498b-b59e-72ae888c7153 tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] Action: 'create', calling method: .version_select at 0x7f5cc156ca60>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-218513664", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIV5L9x9KwnMZzYflER7SdOuEIazJMitx8d0qCqO9VJk2Sr/zNHo7/grO2n8aNUuMU1GA6UBqsCgDII6Dq3G5isobXQyKI0APgKyFA0HWCBwLxOmst8PIUq3Vd7g4iTAzA=="}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:29:25.272149 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-8f7728a2-a2b7-498b-b59e-72ae888c7153 tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] Getting quotas for project 329d7cb10dbf46688477ab15172e1133. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:29:25.286256 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-8f7728a2-a2b7-498b-b59e-72ae888c7153 tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] Getting quotas for user 52f053dcd6da4102a6bdf18c6bd41752 and project 329d7cb10dbf46688477ab15172e1133. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:29:25.321621 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4294709f-369b-4b89-9bbb-8f2ca35d541c tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:25.337047 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4294709f-369b-4b89-9bbb-8f2ca35d541c tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:25.338652 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4294709f-369b-4b89-9bbb-8f2ca35d541c tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:25.339887 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4294709f-369b-4b89-9bbb-8f2ca35d541c tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] 10.222.0.42 "GET /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c" status: 200 len: 1361 microversion: 2.26 time: 0.333402 Oct 23 01:29:25.352171 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2223/4356] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:29:25 2022] GET /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c => generated 1361 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:29:25.366533 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7c12dd83-0bfe-4a9c-9b7c-9f4e3d405176 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:25.367259 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7c12dd83-0bfe-4a9c-9b7c-9f4e3d405176 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: 79b6e08c-f496-40ee-b5ea-34392ac475ad] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:25.374403 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c12dd83-0bfe-4a9c-9b7c-9f4e3d405176 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:25.376450 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c12dd83-0bfe-4a9c-9b7c-9f4e3d405176 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:25.377064 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c12dd83-0bfe-4a9c-9b7c-9f4e3d405176 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:25.378042 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c12dd83-0bfe-4a9c-9b7c-9f4e3d405176 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:25.378720 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c12dd83-0bfe-4a9c-9b7c-9f4e3d405176 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:25.379531 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c12dd83-0bfe-4a9c-9b7c-9f4e3d405176 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:25.470573 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8f7728a2-a2b7-498b-b59e-72ae888c7153 tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.243036 Oct 23 01:29:25.472088 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2134/4357] 10.222.0.42 () {62 vars in 1199 bytes} [Sun Oct 23 01:29:25 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 251 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 23 01:29:25.479039 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3d9f47fa-9b44-49c8-8336-02048dea085c tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:25.479777 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3d9f47fa-9b44-49c8-8336-02048dea085c tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: 0fb11dc6-65bc-4c8e-a674-c948f42f1b87] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:25.495741 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3d9f47fa-9b44-49c8-8336-02048dea085c tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:25.498664 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3d9f47fa-9b44-49c8-8336-02048dea085c tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:25.498664 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3d9f47fa-9b44-49c8-8336-02048dea085c tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:25.498664 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3d9f47fa-9b44-49c8-8336-02048dea085c tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:25.498664 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3d9f47fa-9b44-49c8-8336-02048dea085c tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:25.498664 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3d9f47fa-9b44-49c8-8336-02048dea085c tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:25.502036 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7c12dd83-0bfe-4a9c-9b7c-9f4e3d405176 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:25.511126 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7c12dd83-0bfe-4a9c-9b7c-9f4e3d405176 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad" status: 200 len: 1278 microversion: 2.1 time: 0.154914 Oct 23 01:29:25.513092 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2224/4358] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:25 2022] GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad => generated 1278 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:25.518262 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-636c5a78-e75c-429d-925a-e184a5dd97cb tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] Calling method '.version_select at 0x7f5cc21c7160>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:25.532544 n-d-master-1 devstack@n-api.service[120944]: WARNING oslo_db.sqlalchemy.utils [None req-636c5a78-e75c-429d-925a-e184a5dd97cb tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 23 01:29:25.555893 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-636c5a78-e75c-429d-925a-e184a5dd97cb tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] 10.222.0.42 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.041753 Oct 23 01:29:25.562040 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2225/4359] 10.222.0.42 () {60 vars in 1177 bytes} [Sun Oct 23 01:29:25 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:25.570408 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5135a36d-2ebd-476f-a98e-d88f1324f3a5 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:25.573313 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5135a36d-2ebd-476f-a98e-d88f1324f3a5 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] [instance: 08bd5c17-1a39-4d28-9a01-e93b999bfb61] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:25.587478 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5135a36d-2ebd-476f-a98e-d88f1324f3a5 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:25.587987 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5135a36d-2ebd-476f-a98e-d88f1324f3a5 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:25.588431 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5135a36d-2ebd-476f-a98e-d88f1324f3a5 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:25.589148 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5135a36d-2ebd-476f-a98e-d88f1324f3a5 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:25.596330 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5135a36d-2ebd-476f-a98e-d88f1324f3a5 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:25.596330 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5135a36d-2ebd-476f-a98e-d88f1324f3a5 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:25.843588 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3d9f47fa-9b44-49c8-8336-02048dea085c tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:25.876780 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3d9f47fa-9b44-49c8-8336-02048dea085c tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87" status: 200 len: 1673 microversion: 2.1 time: 0.395724 Oct 23 01:29:25.883547 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2135/4360] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:25 2022] GET /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87 => generated 1673 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:25.903850 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-dc3737f9-22a7-4027-9aa8-1aad9b12aea4 tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] Calling method '.version_select at 0x7f5cc14bfdc0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:25.973775 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5135a36d-2ebd-476f-a98e-d88f1324f3a5 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8950e247041d8be4fdfda5e2122fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db2a6834ec144418eb2cf222302fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:26.000305 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-dc3737f9-22a7-4027-9aa8-1aad9b12aea4 tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-218513664" status: 204 len: 0 microversion: 2.2 time: 0.111375 Oct 23 01:29:26.000456 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5135a36d-2ebd-476f-a98e-d88f1324f3a5 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] 10.222.0.42 "GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61" status: 200 len: 1305 microversion: 2.1 time: 0.439855 Oct 23 01:29:26.001582 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2136/4361] 10.222.0.42 () {60 vars in 1318 bytes} [Sun Oct 23 01:29:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-218513664 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:29:26.002049 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2226/4362] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:25 2022] GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61 => generated 1305 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:26.019193 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-37e2f640-1886-4744-a443-331fc3c32c73 tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] Calling method '.version_select at 0x7f5cc1a60ee0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:26.166997 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-37e2f640-1886-4744-a443-331fc3c32c73 tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1322937443" status: 204 len: 0 microversion: 2.2 time: 0.159466 Oct 23 01:29:26.171353 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2227/4363] 10.222.0.42 () {60 vars in 1321 bytes} [Sun Oct 23 01:29:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1322937443 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:29:26.176820 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6788c784-ba7c-49cb-b6d2-10b75218fa5a tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] Calling method '.version_select at 0x7f5cc148e3a0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:26.249954 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=8 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:26.305810 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6788c784-ba7c-49cb-b6d2-10b75218fa5a tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-741099126" status: 204 len: 0 microversion: 2.2 time: 0.132519 Oct 23 01:29:26.307161 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2137/4364] 10.222.0.42 () {60 vars in 1318 bytes} [Sun Oct 23 01:29:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-741099126 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:29:26.320190 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-61d2cb57-e029-47a8-ba2f-fdc42e795d7c tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] Action: 'create', calling method: .version_select at 0x7f5cc1bb61f0>, body: {"keypair": {"name": "tempest-keypair-1630920877", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpVCYwYPYNeS+h+kjkdley+FXQR5Wh+vxjOtXA9J18ztV3LDqb+wkz0zV6jgOht5A5MciL3vPGoktyNLX61xUmc+aFIwzdivyfwoPD3rbmxYy8svGXFBQvT68pF+O/zfQ=="}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:29:26.343178 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-61d2cb57-e029-47a8-ba2f-fdc42e795d7c tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] Getting quotas for project 329d7cb10dbf46688477ab15172e1133. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:29:26.350683 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-61d2cb57-e029-47a8-ba2f-fdc42e795d7c tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] Getting quotas for user 52f053dcd6da4102a6bdf18c6bd41752 and project 329d7cb10dbf46688477ab15172e1133. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:29:26.373674 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a173fdc7-7f11-47ac-8588-9143ef6a09b6 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:26.374737 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a173fdc7-7f11-47ac-8588-9143ef6a09b6 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] [instance: d4135945-6011-4843-9156-74dbc625e78c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:26.381902 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a173fdc7-7f11-47ac-8588-9143ef6a09b6 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:26.382706 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a173fdc7-7f11-47ac-8588-9143ef6a09b6 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:26.383293 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a173fdc7-7f11-47ac-8588-9143ef6a09b6 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:26.384162 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a173fdc7-7f11-47ac-8588-9143ef6a09b6 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:26.384629 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a173fdc7-7f11-47ac-8588-9143ef6a09b6 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:26.385067 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a173fdc7-7f11-47ac-8588-9143ef6a09b6 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:26.506500 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-61d2cb57-e029-47a8-ba2f-fdc42e795d7c tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.183325 Oct 23 01:29:26.506500 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2228/4365] 10.222.0.42 () {62 vars in 1199 bytes} [Sun Oct 23 01:29:26 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 185 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 23 01:29:26.517023 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-821d4561-1fdc-4933-be4f-88692bec6526 tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] Calling method '.version_select at 0x7f5cc172d9d0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:26.527270 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-821d4561-1fdc-4933-be4f-88692bec6526 tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] 10.222.0.42 "GET /compute/v2.1/os-keypairs/tempest-keypair-1630920877" status: 200 len: 513 microversion: 2.2 time: 0.014392 Oct 23 01:29:26.527976 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2229/4366] 10.222.0.42 () {60 vars in 1258 bytes} [Sun Oct 23 01:29:26 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1630920877 => generated 513 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:29:26.537965 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-82cac49a-b2de-48d7-8dad-fa452e3d082a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:26.539062 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-82cac49a-b2de-48d7-8dad-fa452e3d082a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: 79b6e08c-f496-40ee-b5ea-34392ac475ad] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:26.548024 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-82cac49a-b2de-48d7-8dad-fa452e3d082a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:26.548981 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-82cac49a-b2de-48d7-8dad-fa452e3d082a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:26.549638 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-82cac49a-b2de-48d7-8dad-fa452e3d082a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:26.550571 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-82cac49a-b2de-48d7-8dad-fa452e3d082a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:26.551557 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-82cac49a-b2de-48d7-8dad-fa452e3d082a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:26.552398 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-82cac49a-b2de-48d7-8dad-fa452e3d082a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:26.572225 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a173fdc7-7f11-47ac-8588-9143ef6a09b6 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:26.596386 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a173fdc7-7f11-47ac-8588-9143ef6a09b6 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:26.600083 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a173fdc7-7f11-47ac-8588-9143ef6a09b6 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:26.604739 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a173fdc7-7f11-47ac-8588-9143ef6a09b6 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] 10.222.0.42 "GET /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c" status: 200 len: 1361 microversion: 2.26 time: 0.241570 Oct 23 01:29:26.610807 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2138/4367] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:29:26 2022] GET /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c => generated 1361 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:29:26.616619 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ffab16e2-3449-4e21-af89-168e09921b91 tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] Calling method '.version_select at 0x7f5cc14f8a60>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:26.620881 n-d-master-1 devstack@n-api.service[120945]: WARNING oslo_db.sqlalchemy.utils [None req-ffab16e2-3449-4e21-af89-168e09921b91 tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 23 01:29:26.642629 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ffab16e2-3449-4e21-af89-168e09921b91 tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] 10.222.0.42 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.030314 Oct 23 01:29:26.644116 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2139/4368] 10.222.0.42 () {60 vars in 1177 bytes} [Sun Oct 23 01:29:26 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:29:26.655938 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-199e60ed-cefe-4d30-b2b0-8d52c5685fd4 req-6d94f059-8f8c-418d-b61b-ca4fb0d4cae3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0bb5109-7f58-469c-b403-057248427835", "tag": "8636fe04-57e9-4152-a064-e3d98100e595"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:29:26.672657 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-199e60ed-cefe-4d30-b2b0-8d52c5685fd4 req-6d94f059-8f8c-418d-b61b-ca4fb0d4cae3 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:26.673353 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-199e60ed-cefe-4d30-b2b0-8d52c5685fd4 req-6d94f059-8f8c-418d-b61b-ca4fb0d4cae3 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:26.674736 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-199e60ed-cefe-4d30-b2b0-8d52c5685fd4 req-6d94f059-8f8c-418d-b61b-ca4fb0d4cae3 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:26.687306 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-199e60ed-cefe-4d30-b2b0-8d52c5685fd4 req-6d94f059-8f8c-418d-b61b-ca4fb0d4cae3 service nova] Creating event network-changed:8636fe04-57e9-4152-a064-e3d98100e595 for instance e0bb5109-7f58-469c-b403-057248427835 on n-h1-master-1 Oct 23 01:29:26.698339 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-199e60ed-cefe-4d30-b2b0-8d52c5685fd4 req-6d94f059-8f8c-418d-b61b-ca4fb0d4cae3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052476 Oct 23 01:29:26.702763 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2140/4369] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:29:26.704989 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6601c6d6-678d-465e-a9e1-4c5c6ddc1f35 tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] Calling method '.version_select at 0x7f5cc148c3a0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:26.748968 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-82cac49a-b2de-48d7-8dad-fa452e3d082a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:26.771817 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-82cac49a-b2de-48d7-8dad-fa452e3d082a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad" status: 200 len: 1320 microversion: 2.1 time: 0.238616 Oct 23 01:29:26.773224 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2230/4370] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:26 2022] GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad => generated 1320 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:29:26.812246 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6601c6d6-678d-465e-a9e1-4c5c6ddc1f35 tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1630920877" status: 204 len: 0 microversion: 2.2 time: 0.111156 Oct 23 01:29:26.813730 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2141/4371] 10.222.0.42 () {60 vars in 1261 bytes} [Sun Oct 23 01:29:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1630920877 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:29:26.827006 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-430e5612-8b50-45a8-bd7f-67493f1c24ec tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] Action: 'create', calling method: .version_select at 0x7f5cc1e80040>, body: {"keypair": {"name": "tempest-keypair-1123677800", "type": "x509"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:29:26.845560 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-430e5612-8b50-45a8-bd7f-67493f1c24ec tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] Getting quotas for project 329d7cb10dbf46688477ab15172e1133. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:29:26.852606 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-430e5612-8b50-45a8-bd7f-67493f1c24ec tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] Getting quotas for user 52f053dcd6da4102a6bdf18c6bd41752 and project 329d7cb10dbf46688477ab15172e1133. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:29:26.879154 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.processutils [None req-430e5612-8b50-45a8-bd7f-67493f1c24ec tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpgfl62dko/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpgfl62dko/temp.key -subj /CN=52f053dcd6da4102a6bdf18c6bd41752 -extensions v3_req_client {{(pid=120944) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 23 01:29:26.908805 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4b968f34-2d81-4415-bef7-05b748872715 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:26.910207 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4b968f34-2d81-4415-bef7-05b748872715 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: 0fb11dc6-65bc-4c8e-a674-c948f42f1b87] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:26.919931 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b968f34-2d81-4415-bef7-05b748872715 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:26.920937 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b968f34-2d81-4415-bef7-05b748872715 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:26.921595 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b968f34-2d81-4415-bef7-05b748872715 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:26.924370 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b968f34-2d81-4415-bef7-05b748872715 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:26.924370 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b968f34-2d81-4415-bef7-05b748872715 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:26.924370 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b968f34-2d81-4415-bef7-05b748872715 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:27.167205 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4b968f34-2d81-4415-bef7-05b748872715 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:27.176921 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4b968f34-2d81-4415-bef7-05b748872715 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87" status: 200 len: 1673 microversion: 2.1 time: 0.272782 Oct 23 01:29:27.177769 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2142/4372] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:26 2022] GET /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87 => generated 1673 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:29:27.183040 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4b6fc3d0-5dfb-4977-8bd5-e8b15a050823 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:27.183662 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4b6fc3d0-5dfb-4977-8bd5-e8b15a050823 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] [instance: 08bd5c17-1a39-4d28-9a01-e93b999bfb61] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:27.189699 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b6fc3d0-5dfb-4977-8bd5-e8b15a050823 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:27.190419 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b6fc3d0-5dfb-4977-8bd5-e8b15a050823 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:27.190858 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b6fc3d0-5dfb-4977-8bd5-e8b15a050823 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:27.191558 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b6fc3d0-5dfb-4977-8bd5-e8b15a050823 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:27.192016 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b6fc3d0-5dfb-4977-8bd5-e8b15a050823 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:27.192443 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b6fc3d0-5dfb-4977-8bd5-e8b15a050823 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:27.401208 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4b6fc3d0-5dfb-4977-8bd5-e8b15a050823 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8950e247041d8be4fdfda5e2122fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db2a6834ec144418eb2cf222302fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:27.415289 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4b6fc3d0-5dfb-4977-8bd5-e8b15a050823 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] 10.222.0.42 "GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61" status: 200 len: 1293 microversion: 2.1 time: 0.235987 Oct 23 01:29:27.415945 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2143/4373] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:27 2022] GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61 => generated 1293 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:27.424119 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-1c072c5e-a519-4dbe-9a8c-3f91f199fbd2 req-e7813b6b-4470-4f5d-877a-08c5996891e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4135945-6011-4843-9156-74dbc625e78c", "name": "network-vif-plugged", "status": "completed", "tag": "6ef1ef8d-1fbb-471e-a80f-b7a3b541b417"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:29:27.436176 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-1c072c5e-a519-4dbe-9a8c-3f91f199fbd2 req-e7813b6b-4470-4f5d-877a-08c5996891e0 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:27.436738 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-1c072c5e-a519-4dbe-9a8c-3f91f199fbd2 req-e7813b6b-4470-4f5d-877a-08c5996891e0 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:27.443958 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-1c072c5e-a519-4dbe-9a8c-3f91f199fbd2 req-e7813b6b-4470-4f5d-877a-08c5996891e0 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:27.450471 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-1c072c5e-a519-4dbe-9a8c-3f91f199fbd2 req-e7813b6b-4470-4f5d-877a-08c5996891e0 service nova] Creating event network-vif-plugged:6ef1ef8d-1fbb-471e-a80f-b7a3b541b417 for instance d4135945-6011-4843-9156-74dbc625e78c on n-h2-master-1 Oct 23 01:29:27.456749 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-1c072c5e-a519-4dbe-9a8c-3f91f199fbd2 req-e7813b6b-4470-4f5d-877a-08c5996891e0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039586 Oct 23 01:29:27.458235 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2144/4374] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:29:27.589679 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.processutils [None req-430e5612-8b50-45a8-bd7f-67493f1c24ec tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpgfl62dko/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpgfl62dko/temp.key -subj /CN=52f053dcd6da4102a6bdf18c6bd41752 -extensions v3_req_client" returned: 0 in 0.710s {{(pid=120944) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 23 01:29:27.591440 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.processutils [None req-430e5612-8b50-45a8-bd7f-67493f1c24ec tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpgfl62dko/temp.key -password pass: {{(pid=120944) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 23 01:29:27.617212 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.processutils [None req-430e5612-8b50-45a8-bd7f-67493f1c24ec tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpgfl62dko/temp.key -password pass:" returned: 0 in 0.025s {{(pid=120944) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 23 01:29:27.641474 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e305c07a-05c3-4766-b67b-733f4ebdb0ba tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:27.642337 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e305c07a-05c3-4766-b67b-733f4ebdb0ba tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] [instance: d4135945-6011-4843-9156-74dbc625e78c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:27.649283 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e305c07a-05c3-4766-b67b-733f4ebdb0ba tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:27.649942 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e305c07a-05c3-4766-b67b-733f4ebdb0ba tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:27.650636 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e305c07a-05c3-4766-b67b-733f4ebdb0ba tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:27.651447 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e305c07a-05c3-4766-b67b-733f4ebdb0ba tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:27.652011 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e305c07a-05c3-4766-b67b-733f4ebdb0ba tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:27.652580 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e305c07a-05c3-4766-b67b-733f4ebdb0ba tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:27.859336 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-430e5612-8b50-45a8-bd7f-67493f1c24ec tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] Getting quotas for project 329d7cb10dbf46688477ab15172e1133. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:29:27.872948 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-430e5612-8b50-45a8-bd7f-67493f1c24ec tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] Getting quotas for user 52f053dcd6da4102a6bdf18c6bd41752 and project 329d7cb10dbf46688477ab15172e1133. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:29:27.914119 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-430e5612-8b50-45a8-bd7f-67493f1c24ec tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 1.091249 Oct 23 01:29:27.924908 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2231/4375] 10.222.0.42 () {62 vars in 1198 bytes} [Sun Oct 23 01:29:26 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 1103 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:29:27.940473 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-72d452c6-1407-45fb-9f10-284492b62544 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:27.942510 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-72d452c6-1407-45fb-9f10-284492b62544 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: 79b6e08c-f496-40ee-b5ea-34392ac475ad] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:27.959336 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-72d452c6-1407-45fb-9f10-284492b62544 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:27.959990 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-72d452c6-1407-45fb-9f10-284492b62544 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:27.961867 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-72d452c6-1407-45fb-9f10-284492b62544 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:27.961867 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-72d452c6-1407-45fb-9f10-284492b62544 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:27.962957 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-72d452c6-1407-45fb-9f10-284492b62544 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:27.963480 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-72d452c6-1407-45fb-9f10-284492b62544 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:28.458603 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e305c07a-05c3-4766-b67b-733f4ebdb0ba tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:28.472379 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e305c07a-05c3-4766-b67b-733f4ebdb0ba tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:28.475880 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e305c07a-05c3-4766-b67b-733f4ebdb0ba tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:28.477539 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e305c07a-05c3-4766-b67b-733f4ebdb0ba tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] 10.222.0.42 "GET /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c" status: 200 len: 1361 microversion: 2.26 time: 0.840326 Oct 23 01:29:28.479465 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2145/4376] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:29:27 2022] GET /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c => generated 1361 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:29:28.485202 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b88be7e1-de91-4a68-be01-52a3d75aa568 tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] Calling method '.version_select at 0x7f5cc1644790>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:28.499170 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b88be7e1-de91-4a68-be01-52a3d75aa568 tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] 10.222.0.42 "GET /compute/v2.1/os-keypairs/tempest-keypair-1123677800" status: 200 len: 1534 microversion: 2.2 time: 0.017551 Oct 23 01:29:28.500012 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2146/4377] 10.222.0.42 () {60 vars in 1258 bytes} [Sun Oct 23 01:29:28 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1123677800 => generated 1534 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:28.508216 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-928dba43-3b34-4bcc-8b71-e795cd8e9779 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:28.508866 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-928dba43-3b34-4bcc-8b71-e795cd8e9779 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: 0fb11dc6-65bc-4c8e-a674-c948f42f1b87] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:28.513186 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=5,nova_api:DELETE=5,nova_api:UPDATE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:28.517501 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-928dba43-3b34-4bcc-8b71-e795cd8e9779 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:28.518158 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-928dba43-3b34-4bcc-8b71-e795cd8e9779 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:28.518700 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-928dba43-3b34-4bcc-8b71-e795cd8e9779 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:28.519520 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-928dba43-3b34-4bcc-8b71-e795cd8e9779 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:28.520511 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-928dba43-3b34-4bcc-8b71-e795cd8e9779 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:28.521711 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-928dba43-3b34-4bcc-8b71-e795cd8e9779 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:28.538867 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-72d452c6-1407-45fb-9f10-284492b62544 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:28.548745 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-72d452c6-1407-45fb-9f10-284492b62544 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad" status: 200 len: 1320 microversion: 2.1 time: 0.621754 Oct 23 01:29:28.563808 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2232/4378] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:27 2022] GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad => generated 1320 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:28.563808 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-96db1f48-28a8-463b-bb41-52199ecc3e1a tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:28.563808 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-96db1f48-28a8-463b-bb41-52199ecc3e1a tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] [instance: 08bd5c17-1a39-4d28-9a01-e93b999bfb61] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:28.564289 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-96db1f48-28a8-463b-bb41-52199ecc3e1a tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:28.564960 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-96db1f48-28a8-463b-bb41-52199ecc3e1a tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:28.565560 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-96db1f48-28a8-463b-bb41-52199ecc3e1a tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:28.566478 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-96db1f48-28a8-463b-bb41-52199ecc3e1a tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:28.567097 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-96db1f48-28a8-463b-bb41-52199ecc3e1a tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:28.567555 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-96db1f48-28a8-463b-bb41-52199ecc3e1a tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:28.867326 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:28.870109 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-928dba43-3b34-4bcc-8b71-e795cd8e9779 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:28.880057 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-928dba43-3b34-4bcc-8b71-e795cd8e9779 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87" status: 200 len: 1673 microversion: 2.1 time: 0.378843 Oct 23 01:29:28.881553 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2147/4379] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:28 2022] GET /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87 => generated 1673 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:28.886971 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-306c4bb7-13b0-47fd-b0bc-9faa79632233 tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] Calling method '.version_select at 0x7f5cc1562820>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:28.891385 n-d-master-1 devstack@n-api.service[120945]: WARNING oslo_db.sqlalchemy.utils [None req-306c4bb7-13b0-47fd-b0bc-9faa79632233 tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 23 01:29:28.896806 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-306c4bb7-13b0-47fd-b0bc-9faa79632233 tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] 10.222.0.42 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.013760 Oct 23 01:29:28.897364 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2148/4380] 10.222.0.42 () {60 vars in 1177 bytes} [Sun Oct 23 01:29:28 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:28.909321 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-68540007-7483-4f6f-bc66-dcd5ef720ef5 tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] Calling method '.version_select at 0x7f5cc14bf700>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:28.924989 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-96db1f48-28a8-463b-bb41-52199ecc3e1a tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8950e247041d8be4fdfda5e2122fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db2a6834ec144418eb2cf222302fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:28.943330 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-96db1f48-28a8-463b-bb41-52199ecc3e1a tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] 10.222.0.42 "GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61" status: 200 len: 1293 microversion: 2.1 time: 0.390326 Oct 23 01:29:28.943330 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2233/4381] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:28 2022] GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61 => generated 1293 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:29.024050 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-68540007-7483-4f6f-bc66-dcd5ef720ef5 tempest-KeyPairsV22TestJSON-1976601094 tempest-KeyPairsV22TestJSON-1976601094-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1123677800" status: 204 len: 0 microversion: 2.2 time: 0.118764 Oct 23 01:29:29.024756 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2149/4382] 10.222.0.42 () {60 vars in 1261 bytes} [Sun Oct 23 01:29:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1123677800 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:29:29.258543 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-a30944ef-f74b-4532-9265-96b70dd8403e req-2e6a4170-bd67-44a8-9f6c-ad215f681f72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4f3e58c-311d-4b8a-b231-67e8fbc8cd3e", "tag": "44040275-ae3f-48cd-92f2-f889f7ea2654"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:29:29.281600 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-a30944ef-f74b-4532-9265-96b70dd8403e req-2e6a4170-bd67-44a8-9f6c-ad215f681f72 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:29.282190 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-a30944ef-f74b-4532-9265-96b70dd8403e req-2e6a4170-bd67-44a8-9f6c-ad215f681f72 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:29.283205 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-a30944ef-f74b-4532-9265-96b70dd8403e req-2e6a4170-bd67-44a8-9f6c-ad215f681f72 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:29.296462 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-a30944ef-f74b-4532-9265-96b70dd8403e req-2e6a4170-bd67-44a8-9f6c-ad215f681f72 service nova] Creating event network-changed:44040275-ae3f-48cd-92f2-f889f7ea2654 for instance b4f3e58c-311d-4b8a-b231-67e8fbc8cd3e on n-h1-master-1 Oct 23 01:29:29.303848 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-a30944ef-f74b-4532-9265-96b70dd8403e req-2e6a4170-bd67-44a8-9f6c-ad215f681f72 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053266 Oct 23 01:29:29.309249 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2234/4383] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:29:29.517491 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5a38e39f-70ae-4f07-9984-143bfadddcb0 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:29.518879 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5a38e39f-70ae-4f07-9984-143bfadddcb0 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] [instance: d4135945-6011-4843-9156-74dbc625e78c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:29.579931 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-83f6b49d-8268-49f6-88d2-311e7a798e0e tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:29.580646 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-83f6b49d-8268-49f6-88d2-311e7a798e0e tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: 79b6e08c-f496-40ee-b5ea-34392ac475ad] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:29.589353 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5a38e39f-70ae-4f07-9984-143bfadddcb0 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:29.590026 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5a38e39f-70ae-4f07-9984-143bfadddcb0 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.041s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:29.594256 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5a38e39f-70ae-4f07-9984-143bfadddcb0 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:29.595069 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5a38e39f-70ae-4f07-9984-143bfadddcb0 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:29.595545 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5a38e39f-70ae-4f07-9984-143bfadddcb0 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:29.595977 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5a38e39f-70ae-4f07-9984-143bfadddcb0 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:29.613885 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-83f6b49d-8268-49f6-88d2-311e7a798e0e tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:29.614990 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-83f6b49d-8268-49f6-88d2-311e7a798e0e tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:29.619591 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-83f6b49d-8268-49f6-88d2-311e7a798e0e tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:29.620356 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-83f6b49d-8268-49f6-88d2-311e7a798e0e tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:29.620849 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-83f6b49d-8268-49f6-88d2-311e7a798e0e tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:29.621271 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-83f6b49d-8268-49f6-88d2-311e7a798e0e tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:30.066251 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-83f6b49d-8268-49f6-88d2-311e7a798e0e tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:30.078746 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-83f6b49d-8268-49f6-88d2-311e7a798e0e tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad" status: 200 len: 1320 microversion: 2.1 time: 0.505019 Oct 23 01:29:30.079357 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2235/4384] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:29 2022] GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad => generated 1320 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:29:30.086867 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b943f1c8-35b2-47df-818a-d718b1f99059 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:30.087802 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b943f1c8-35b2-47df-818a-d718b1f99059 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: 0fb11dc6-65bc-4c8e-a674-c948f42f1b87] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:30.094922 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b943f1c8-35b2-47df-818a-d718b1f99059 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:30.095783 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b943f1c8-35b2-47df-818a-d718b1f99059 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:30.096432 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b943f1c8-35b2-47df-818a-d718b1f99059 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:30.097354 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b943f1c8-35b2-47df-818a-d718b1f99059 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:30.097827 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b943f1c8-35b2-47df-818a-d718b1f99059 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:30.098291 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b943f1c8-35b2-47df-818a-d718b1f99059 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:30.215454 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5a38e39f-70ae-4f07-9984-143bfadddcb0 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:30.228949 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5a38e39f-70ae-4f07-9984-143bfadddcb0 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:30.235573 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5a38e39f-70ae-4f07-9984-143bfadddcb0 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:30.236825 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5a38e39f-70ae-4f07-9984-143bfadddcb0 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] 10.222.0.42 "GET /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c" status: 200 len: 1361 microversion: 2.26 time: 0.728617 Oct 23 01:29:30.237476 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2150/4385] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:29:29 2022] GET /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c => generated 1361 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:29:30.250193 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ee3506d9-c7e4-4c50-99d1-e4f9880004f7 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:30.255341 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ee3506d9-c7e4-4c50-99d1-e4f9880004f7 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] [instance: 08bd5c17-1a39-4d28-9a01-e93b999bfb61] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:30.269456 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee3506d9-c7e4-4c50-99d1-e4f9880004f7 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:30.270259 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee3506d9-c7e4-4c50-99d1-e4f9880004f7 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:30.272919 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee3506d9-c7e4-4c50-99d1-e4f9880004f7 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:30.276196 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee3506d9-c7e4-4c50-99d1-e4f9880004f7 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:30.276983 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee3506d9-c7e4-4c50-99d1-e4f9880004f7 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:30.281348 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee3506d9-c7e4-4c50-99d1-e4f9880004f7 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:30.299553 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b943f1c8-35b2-47df-818a-d718b1f99059 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:30.314996 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b943f1c8-35b2-47df-818a-d718b1f99059 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87" status: 200 len: 1606 microversion: 2.1 time: 0.233783 Oct 23 01:29:30.316220 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2236/4386] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:30 2022] GET /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87 => generated 1606 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:30.614415 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ee3506d9-c7e4-4c50-99d1-e4f9880004f7 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8950e247041d8be4fdfda5e2122fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db2a6834ec144418eb2cf222302fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:30.627095 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ee3506d9-c7e4-4c50-99d1-e4f9880004f7 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] 10.222.0.42 "GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61" status: 200 len: 1293 microversion: 2.1 time: 0.383315 Oct 23 01:29:30.638015 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2151/4387] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:30 2022] GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61 => generated 1293 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:31.104724 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a76d29f9-d35c-47bf-9baa-522099a86e06 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:31.105388 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a76d29f9-d35c-47bf-9baa-522099a86e06 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: 79b6e08c-f496-40ee-b5ea-34392ac475ad] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:31.117886 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a76d29f9-d35c-47bf-9baa-522099a86e06 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:31.121084 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a76d29f9-d35c-47bf-9baa-522099a86e06 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:31.121355 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a76d29f9-d35c-47bf-9baa-522099a86e06 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:31.123774 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a76d29f9-d35c-47bf-9baa-522099a86e06 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:31.124321 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a76d29f9-d35c-47bf-9baa-522099a86e06 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:31.124766 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a76d29f9-d35c-47bf-9baa-522099a86e06 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:31.267858 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-37f289b2-425c-4201-a10f-cc3b8bfd244c tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:31.268482 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-37f289b2-425c-4201-a10f-cc3b8bfd244c tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] [instance: d4135945-6011-4843-9156-74dbc625e78c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:31.283931 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-37f289b2-425c-4201-a10f-cc3b8bfd244c tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:31.288816 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-37f289b2-425c-4201-a10f-cc3b8bfd244c tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:31.288816 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-37f289b2-425c-4201-a10f-cc3b8bfd244c tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:31.288816 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-37f289b2-425c-4201-a10f-cc3b8bfd244c tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:31.288816 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-37f289b2-425c-4201-a10f-cc3b8bfd244c tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:31.288816 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-37f289b2-425c-4201-a10f-cc3b8bfd244c tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:31.367391 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a76d29f9-d35c-47bf-9baa-522099a86e06 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:31.372832 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=100 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:31.391340 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a76d29f9-d35c-47bf-9baa-522099a86e06 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad" status: 200 len: 1320 microversion: 2.1 time: 0.290360 Oct 23 01:29:31.393591 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2237/4388] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:31 2022] GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad => generated 1320 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:31.415061 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b5ca4d3c-f1eb-4ab0-8b61-94ea64ec9eb0 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:31.416192 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b5ca4d3c-f1eb-4ab0-8b61-94ea64ec9eb0 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: 0fb11dc6-65bc-4c8e-a674-c948f42f1b87] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:31.432238 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5ca4d3c-f1eb-4ab0-8b61-94ea64ec9eb0 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:31.436039 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5ca4d3c-f1eb-4ab0-8b61-94ea64ec9eb0 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:31.440447 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5ca4d3c-f1eb-4ab0-8b61-94ea64ec9eb0 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:31.442752 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5ca4d3c-f1eb-4ab0-8b61-94ea64ec9eb0 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:31.444286 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5ca4d3c-f1eb-4ab0-8b61-94ea64ec9eb0 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:31.447267 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5ca4d3c-f1eb-4ab0-8b61-94ea64ec9eb0 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:31.539193 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5ca4d3c-f1eb-4ab0-8b61-94ea64ec9eb0 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:31.539979 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5ca4d3c-f1eb-4ab0-8b61-94ea64ec9eb0 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:31.543270 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5ca4d3c-f1eb-4ab0-8b61-94ea64ec9eb0 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:31.543270 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-b5ca4d3c-f1eb-4ab0-8b61-94ea64ec9eb0 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lazy-loading 'fault' on Instance uuid 0fb11dc6-65bc-4c8e-a674-c948f42f1b87 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:29:31.610158 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b5ca4d3c-f1eb-4ab0-8b61-94ea64ec9eb0 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba4975d23874879b779282e5b9cecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a621d00a6b499f921337dda20b66bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:31.619393 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b5ca4d3c-f1eb-4ab0-8b61-94ea64ec9eb0 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87" status: 200 len: 1327 microversion: 2.1 time: 0.223923 Oct 23 01:29:31.624225 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2238/4389] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:31 2022] GET /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87 => generated 1327 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:31.629618 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-5912386f-fce2-4e5e-973f-2c7cca5d4c24 req-0cd177d6-008f-4fc5-8d95-9452bc69c974 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79b6e08c-f496-40ee-b5ea-34392ac475ad", "tag": "5149c7c0-3942-4b5e-a00f-1ec25183da19"}, {"server_uuid": "0fb11dc6-65bc-4c8e-a674-c948f42f1b87", "name": "network-vif-deleted", "tag": "68515858-8d68-4868-b082-cf88ddda8e2c"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:29:31.652354 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-5912386f-fce2-4e5e-973f-2c7cca5d4c24 req-0cd177d6-008f-4fc5-8d95-9452bc69c974 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:31.658836 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-37f289b2-425c-4201-a10f-cc3b8bfd244c tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:31.659500 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-5912386f-fce2-4e5e-973f-2c7cca5d4c24 req-0cd177d6-008f-4fc5-8d95-9452bc69c974 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:31.660081 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-5912386f-fce2-4e5e-973f-2c7cca5d4c24 req-0cd177d6-008f-4fc5-8d95-9452bc69c974 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:31.680064 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-5912386f-fce2-4e5e-973f-2c7cca5d4c24 req-0cd177d6-008f-4fc5-8d95-9452bc69c974 service nova] Creating event network-changed:5149c7c0-3942-4b5e-a00f-1ec25183da19 for instance 79b6e08c-f496-40ee-b5ea-34392ac475ad on n-h2-master-1 Oct 23 01:29:31.681311 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-5912386f-fce2-4e5e-973f-2c7cca5d4c24 req-0cd177d6-008f-4fc5-8d95-9452bc69c974 service nova] Creating event network-vif-deleted:68515858-8d68-4868-b082-cf88ddda8e2c for instance 0fb11dc6-65bc-4c8e-a674-c948f42f1b87 on n-h2-master-1 Oct 23 01:29:31.691433 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-5912386f-fce2-4e5e-973f-2c7cca5d4c24 req-0cd177d6-008f-4fc5-8d95-9452bc69c974 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.065446 Oct 23 01:29:31.695757 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2239/4390] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:29:31.710694 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-37f289b2-425c-4201-a10f-cc3b8bfd244c tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:31.712084 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6861830e-0238-49f1-8b04-101c74172963 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:31.712675 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-37f289b2-425c-4201-a10f-cc3b8bfd244c tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:31.713473 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6861830e-0238-49f1-8b04-101c74172963 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] [instance: 08bd5c17-1a39-4d28-9a01-e93b999bfb61] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:31.719179 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-37f289b2-425c-4201-a10f-cc3b8bfd244c tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] 10.222.0.42 "GET /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c" status: 200 len: 1546 microversion: 2.26 time: 0.455179 Oct 23 01:29:31.730092 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2152/4391] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:29:31 2022] GET /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c => generated 1546 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:29:31.744094 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6861830e-0238-49f1-8b04-101c74172963 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:31.744690 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6861830e-0238-49f1-8b04-101c74172963 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:31.745181 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6861830e-0238-49f1-8b04-101c74172963 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:31.745898 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6861830e-0238-49f1-8b04-101c74172963 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:31.746396 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6861830e-0238-49f1-8b04-101c74172963 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:31.746845 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6861830e-0238-49f1-8b04-101c74172963 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:31.764655 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-65db3a67-27a9-44aa-ad24-14eead7e5e3d tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Calling method '.version_select at 0x7f5cc14bfe50>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:31.783535 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-65db3a67-27a9-44aa-ad24-14eead7e5e3d tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:31.784096 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-65db3a67-27a9-44aa-ad24-14eead7e5e3d tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:31.787230 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-65db3a67-27a9-44aa-ad24-14eead7e5e3d tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:31.787230 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-65db3a67-27a9-44aa-ad24-14eead7e5e3d tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] [instance: d4135945-6011-4843-9156-74dbc625e78c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:31.811386 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-65db3a67-27a9-44aa-ad24-14eead7e5e3d tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:31.815970 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-65db3a67-27a9-44aa-ad24-14eead7e5e3d tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:31.815970 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-65db3a67-27a9-44aa-ad24-14eead7e5e3d tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:31.815970 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-65db3a67-27a9-44aa-ad24-14eead7e5e3d tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:31.815970 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-65db3a67-27a9-44aa-ad24-14eead7e5e3d tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:31.815970 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-65db3a67-27a9-44aa-ad24-14eead7e5e3d tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:31.872102 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-65db3a67-27a9-44aa-ad24-14eead7e5e3d tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:31.872747 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-65db3a67-27a9-44aa-ad24-14eead7e5e3d tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:31.873265 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-65db3a67-27a9-44aa-ad24-14eead7e5e3d tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:31.901472 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-65db3a67-27a9-44aa-ad24-14eead7e5e3d tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:31.906618 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-65db3a67-27a9-44aa-ad24-14eead7e5e3d tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:31.909798 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-65db3a67-27a9-44aa-ad24-14eead7e5e3d tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:31.952079 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6861830e-0238-49f1-8b04-101c74172963 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8950e247041d8be4fdfda5e2122fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db2a6834ec144418eb2cf222302fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:31.961993 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6861830e-0238-49f1-8b04-101c74172963 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] 10.222.0.42 "GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61" status: 200 len: 1293 microversion: 2.1 time: 0.264565 Oct 23 01:29:31.963104 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2240/4392] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:31 2022] GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61 => generated 1293 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:32.014718 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-65db3a67-27a9-44aa-ad24-14eead7e5e3d tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lazy-loading 'flavor' on Instance uuid d4135945-6011-4843-9156-74dbc625e78c {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:29:32.041529 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-65db3a67-27a9-44aa-ad24-14eead7e5e3d tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] 10.222.0.42 "PUT /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c/tags/tempest-tag-1424267406" status: 201 len: 0 microversion: 2.26 time: 0.288366 Oct 23 01:29:32.049321 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2153/4393] 10.222.0.42 () {62 vars in 1380 bytes} [Sun Oct 23 01:29:31 2022] PUT /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c/tags/tempest-tag-1424267406 => generated 0 bytes in 299 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 23 01:29:32.053762 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-38b6d33d-97e6-4f71-ae7b-852842cec6ae tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Calling method '.version_select at 0x7f5cc21c7040>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:32.055912 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=93,nova_api:DELETE=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:32.062631 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-38b6d33d-97e6-4f71-ae7b-852842cec6ae tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:32.063411 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-38b6d33d-97e6-4f71-ae7b-852842cec6ae tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:32.063970 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-38b6d33d-97e6-4f71-ae7b-852842cec6ae tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:32.080868 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-38b6d33d-97e6-4f71-ae7b-852842cec6ae tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] 10.222.0.42 "GET /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c/tags/tempest-tag-1424267406" status: 204 len: 0 microversion: 2.26 time: 0.031808 Oct 23 01:29:32.081583 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2241/4394] 10.222.0.42 () {60 vars in 1361 bytes} [Sun Oct 23 01:29:32 2022] GET /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c/tags/tempest-tag-1424267406 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 23 01:29:32.093154 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2f006837-eb88-41c1-86c8-2a76e0960a5e tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Calling method '.version_select at 0x7f5cc156ce50>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:32.102697 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2f006837-eb88-41c1-86c8-2a76e0960a5e tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:32.103176 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2f006837-eb88-41c1-86c8-2a76e0960a5e tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:32.103607 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2f006837-eb88-41c1-86c8-2a76e0960a5e tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:32.104462 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2f006837-eb88-41c1-86c8-2a76e0960a5e tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] [instance: d4135945-6011-4843-9156-74dbc625e78c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:32.110136 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2f006837-eb88-41c1-86c8-2a76e0960a5e tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:32.110626 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2f006837-eb88-41c1-86c8-2a76e0960a5e tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:32.111062 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2f006837-eb88-41c1-86c8-2a76e0960a5e tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:32.111748 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2f006837-eb88-41c1-86c8-2a76e0960a5e tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:32.112370 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2f006837-eb88-41c1-86c8-2a76e0960a5e tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:32.112797 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2f006837-eb88-41c1-86c8-2a76e0960a5e tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:32.129681 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:32.140001 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2f006837-eb88-41c1-86c8-2a76e0960a5e tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:32.141674 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2f006837-eb88-41c1-86c8-2a76e0960a5e tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:32.142320 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2f006837-eb88-41c1-86c8-2a76e0960a5e tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:32.225543 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-2f006837-eb88-41c1-86c8-2a76e0960a5e tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lazy-loading 'flavor' on Instance uuid d4135945-6011-4843-9156-74dbc625e78c {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:29:32.241424 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2f006837-eb88-41c1-86c8-2a76e0960a5e tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c/tags" status: 204 len: 0 microversion: 2.26 time: 0.153737 Oct 23 01:29:32.242079 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2154/4395] 10.222.0.42 () {60 vars in 1295 bytes} [Sun Oct 23 01:29:32 2022] DELETE /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c/tags => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 23 01:29:32.251855 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-805dba66-759b-4f07-9780-70f20bfc4166 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Calling method '.version_select at 0x7f5cc28f4ca0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:32.263091 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-805dba66-759b-4f07-9780-70f20bfc4166 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:32.264657 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-805dba66-759b-4f07-9780-70f20bfc4166 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:32.264657 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-805dba66-759b-4f07-9780-70f20bfc4166 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:32.274686 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-805dba66-759b-4f07-9780-70f20bfc4166 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] 10.222.0.42 "GET /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c/tags" status: 200 len: 12 microversion: 2.26 time: 0.027192 Oct 23 01:29:32.278011 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2242/4396] 10.222.0.42 () {60 vars in 1292 bytes} [Sun Oct 23 01:29:32 2022] GET /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c/tags => generated 12 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:32.287938 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7eaaa521-05c6-4483-8af9-0184b905539f tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Calling method '.version_select at 0x7f5cc14ceee0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:32.300136 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7eaaa521-05c6-4483-8af9-0184b905539f tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:32.306629 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7eaaa521-05c6-4483-8af9-0184b905539f tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:32.307148 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7eaaa521-05c6-4483-8af9-0184b905539f tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:32.307892 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7eaaa521-05c6-4483-8af9-0184b905539f tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] [instance: d4135945-6011-4843-9156-74dbc625e78c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:32.315256 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7eaaa521-05c6-4483-8af9-0184b905539f tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:32.315896 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7eaaa521-05c6-4483-8af9-0184b905539f tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:32.319982 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7eaaa521-05c6-4483-8af9-0184b905539f tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:32.319982 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7eaaa521-05c6-4483-8af9-0184b905539f tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:32.319982 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7eaaa521-05c6-4483-8af9-0184b905539f tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:32.319982 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7eaaa521-05c6-4483-8af9-0184b905539f tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:32.354823 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7eaaa521-05c6-4483-8af9-0184b905539f tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:32.355371 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7eaaa521-05c6-4483-8af9-0184b905539f tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:32.355865 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7eaaa521-05c6-4483-8af9-0184b905539f tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:32.368189 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7eaaa521-05c6-4483-8af9-0184b905539f tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:32.368751 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7eaaa521-05c6-4483-8af9-0184b905539f tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:32.369213 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7eaaa521-05c6-4483-8af9-0184b905539f tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:32.417615 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6e2c1a85-7037-40eb-86fa-f5f2c62315fa tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:32.418437 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6e2c1a85-7037-40eb-86fa-f5f2c62315fa tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: 79b6e08c-f496-40ee-b5ea-34392ac475ad] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:32.426442 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6e2c1a85-7037-40eb-86fa-f5f2c62315fa tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:32.427761 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6e2c1a85-7037-40eb-86fa-f5f2c62315fa tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:32.428193 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6e2c1a85-7037-40eb-86fa-f5f2c62315fa tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:32.429067 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6e2c1a85-7037-40eb-86fa-f5f2c62315fa tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:32.429515 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6e2c1a85-7037-40eb-86fa-f5f2c62315fa tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:32.429940 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6e2c1a85-7037-40eb-86fa-f5f2c62315fa tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:32.471186 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-7eaaa521-05c6-4483-8af9-0184b905539f tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lazy-loading 'flavor' on Instance uuid d4135945-6011-4843-9156-74dbc625e78c {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:29:32.501299 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7eaaa521-05c6-4483-8af9-0184b905539f tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] 10.222.0.42 "PUT /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c/tags/tempest-tag-1656442352" status: 201 len: 0 microversion: 2.26 time: 0.217058 Oct 23 01:29:32.508336 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2155/4397] 10.222.0.42 () {62 vars in 1380 bytes} [Sun Oct 23 01:29:32 2022] PUT /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c/tags/tempest-tag-1656442352 => generated 0 bytes in 226 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 23 01:29:32.516176 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8d5c440c-3949-457e-85b9-678e0564f0bc tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Calling method '.version_select at 0x7f5cc156cee0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:32.528341 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d5c440c-3949-457e-85b9-678e0564f0bc tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:32.529686 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d5c440c-3949-457e-85b9-678e0564f0bc tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:32.530703 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d5c440c-3949-457e-85b9-678e0564f0bc tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:32.545029 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8d5c440c-3949-457e-85b9-678e0564f0bc tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] 10.222.0.42 "GET /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c/tags" status: 200 len: 36 microversion: 2.26 time: 0.034018 Oct 23 01:29:32.546235 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2156/4398] 10.222.0.42 () {60 vars in 1292 bytes} [Sun Oct 23 01:29:32 2022] GET /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c/tags => generated 36 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:32.558620 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6efd216f-2fb5-45aa-b5ba-01e4d523c955 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Calling method '.version_select at 0x7f5cc14ce9d0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:32.568552 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6efd216f-2fb5-45aa-b5ba-01e4d523c955 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:32.569037 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6efd216f-2fb5-45aa-b5ba-01e4d523c955 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:32.569686 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6efd216f-2fb5-45aa-b5ba-01e4d523c955 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:32.570373 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6efd216f-2fb5-45aa-b5ba-01e4d523c955 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] [instance: d4135945-6011-4843-9156-74dbc625e78c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:32.577821 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6efd216f-2fb5-45aa-b5ba-01e4d523c955 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:32.579387 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6efd216f-2fb5-45aa-b5ba-01e4d523c955 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:32.579387 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6efd216f-2fb5-45aa-b5ba-01e4d523c955 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:32.580451 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6efd216f-2fb5-45aa-b5ba-01e4d523c955 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:32.580916 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6efd216f-2fb5-45aa-b5ba-01e4d523c955 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:32.581335 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6efd216f-2fb5-45aa-b5ba-01e4d523c955 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:32.613326 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6efd216f-2fb5-45aa-b5ba-01e4d523c955 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:32.613326 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6efd216f-2fb5-45aa-b5ba-01e4d523c955 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:32.613326 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6efd216f-2fb5-45aa-b5ba-01e4d523c955 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:32.653488 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6e2c1a85-7037-40eb-86fa-f5f2c62315fa tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:32.673555 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6e2c1a85-7037-40eb-86fa-f5f2c62315fa tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad" status: 200 len: 1320 microversion: 2.1 time: 0.260134 Oct 23 01:29:32.674527 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2243/4399] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:32 2022] GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad => generated 1320 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:32.680279 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ba19de9e-f9bf-4c2a-826c-91c48b4c7f9a tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:32.681120 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ba19de9e-f9bf-4c2a-826c-91c48b4c7f9a tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: 0fb11dc6-65bc-4c8e-a674-c948f42f1b87] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:32.688176 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba19de9e-f9bf-4c2a-826c-91c48b4c7f9a tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:32.688971 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba19de9e-f9bf-4c2a-826c-91c48b4c7f9a tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:32.690062 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba19de9e-f9bf-4c2a-826c-91c48b4c7f9a tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:32.691577 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba19de9e-f9bf-4c2a-826c-91c48b4c7f9a tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:32.692280 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba19de9e-f9bf-4c2a-826c-91c48b4c7f9a tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:32.693433 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba19de9e-f9bf-4c2a-826c-91c48b4c7f9a tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:32.711507 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-ba19de9e-f9bf-4c2a-826c-91c48b4c7f9a tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] HTTP exception thrown: Instance 0fb11dc6-65bc-4c8e-a674-c948f42f1b87 could not be found. Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ba19de9e-f9bf-4c2a-826c-91c48b4c7f9a tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Request method failure captured: Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87 HTTP/1.1 Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJdVsAjvToj8KAhlGLVBInaL5ZF6Oz9kbUiy39SUtzwRVhAUzFfzRAcu9YuHjQAPTZfpTnw_wvEsXPB9cLPxlD_JcC7YNRTn2PCLYj1vVfxXgT-BRmb5wQiQPKikItMn-89VG5mfPfEQbGe0P3pcqb-trvm0utVmJxFKI0dt6fSMKwI Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 62a621d00a6b499f921337dda20b66bd Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-AttachVolumeTestJSON-1185041640 Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/62a621d00a6b499f921337dda20b66bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_62a621d00a6b499f921337dda20b66bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/62a621d00a6b499f921337dda20b66bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/62a621d00a6b499f921337dda20b66bd"}]}] Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-AttachVolumeTestJSON-1185041640 Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 62a621d00a6b499f921337dda20b66bd Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1185041640 Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-AttachVolumeTestJSON-1185041640-project Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 4ba4975d23874879b779282e5b9cecb0 Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-AttachVolumeTestJSON-1185041640-project Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 0fb11dc6-65bc-4c8e-a674-c948f42f1b87 could not be found. Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '0fb11dc6-65bc-4c8e-a674-c948f42f1b87'} Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fb11dc6-65bc-4c8e-a674-c948f42f1b87 could not be found. Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fb11dc6-65bc-4c8e-a674-c948f42f1b87 could not be found. Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:29:32.713701 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:29:32.717295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:29:32.717295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:29:32.717295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:29:32.717295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:29:32.717295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:29:32.717295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fb11dc6-65bc-4c8e-a674-c948f42f1b87 could not be found. Oct 23 01:29:32.717295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:29:32.717295 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ba19de9e-f9bf-4c2a-826c-91c48b4c7f9a tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Returning 404 to user: Instance 0fb11dc6-65bc-4c8e-a674-c948f42f1b87 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:29:32.717295 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ba19de9e-f9bf-4c2a-826c-91c48b4c7f9a tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87" status: 404 len: 111 microversion: 2.1 time: 0.039560 Oct 23 01:29:32.719658 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2244/4400] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:32 2022] GET /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:29:32.724716 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-43a4b396-bf88-419a-b3bb-1627aff5fb88 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '.version_select at 0x7f5cc1c14e50>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:32.764431 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-6efd216f-2fb5-45aa-b5ba-01e4d523c955 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lazy-loading 'flavor' on Instance uuid d4135945-6011-4843-9156-74dbc625e78c {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:29:32.780147 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6efd216f-2fb5-45aa-b5ba-01e4d523c955 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c/tags/tempest-tag-1656442352" status: 204 len: 0 microversion: 2.26 time: 0.227944 Oct 23 01:29:32.780881 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2157/4401] 10.222.0.42 () {60 vars in 1364 bytes} [Sun Oct 23 01:29:32 2022] DELETE /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c/tags/tempest-tag-1656442352 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 23 01:29:32.788732 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ff5274d2-9f18-4496-b779-7abde5c4e84d tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Calling method '.version_select at 0x7f5cc14ce280>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:32.798494 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ff5274d2-9f18-4496-b779-7abde5c4e84d tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:32.798979 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ff5274d2-9f18-4496-b779-7abde5c4e84d tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:32.799408 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ff5274d2-9f18-4496-b779-7abde5c4e84d tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:32.808993 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ff5274d2-9f18-4496-b779-7abde5c4e84d tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] 10.222.0.42 "GET /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c/tags" status: 200 len: 12 microversion: 2.26 time: 0.023948 Oct 23 01:29:32.811476 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2158/4402] 10.222.0.42 () {60 vars in 1292 bytes} [Sun Oct 23 01:29:32 2022] GET /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c/tags => generated 12 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:29:32.824064 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-07edc398-ad13-48b9-a608-f15a576794ff tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Calling method '.version_select at 0x7f5cc14bf940>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:32.832009 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-07edc398-ad13-48b9-a608-f15a576794ff tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:32.832501 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-07edc398-ad13-48b9-a608-f15a576794ff tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:32.833500 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-07edc398-ad13-48b9-a608-f15a576794ff tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:32.833999 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-07edc398-ad13-48b9-a608-f15a576794ff tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] [instance: d4135945-6011-4843-9156-74dbc625e78c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:32.839412 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-43a4b396-bf88-419a-b3bb-1627aff5fb88 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1558656828" status: 202 len: 0 microversion: 2.1 time: 0.118500 Oct 23 01:29:32.840478 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-07edc398-ad13-48b9-a608-f15a576794ff tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:32.841144 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-07edc398-ad13-48b9-a608-f15a576794ff tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:32.841736 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-07edc398-ad13-48b9-a608-f15a576794ff tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:32.842257 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2245/4403] 10.222.0.42 () {58 vars in 1221 bytes} [Sun Oct 23 01:29:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1558656828 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:29:32.842778 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-07edc398-ad13-48b9-a608-f15a576794ff tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:32.843377 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-07edc398-ad13-48b9-a608-f15a576794ff tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:32.843804 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-07edc398-ad13-48b9-a608-f15a576794ff tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:32.886811 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-07edc398-ad13-48b9-a608-f15a576794ff tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:32.887297 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-07edc398-ad13-48b9-a608-f15a576794ff tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:32.887728 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-07edc398-ad13-48b9-a608-f15a576794ff tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:32.901747 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-07edc398-ad13-48b9-a608-f15a576794ff tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lazy-loading 'flavor' on Instance uuid d4135945-6011-4843-9156-74dbc625e78c {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:29:32.918773 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-07edc398-ad13-48b9-a608-f15a576794ff tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c/tags" status: 204 len: 0 microversion: 2.26 time: 0.098918 Oct 23 01:29:32.919396 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2159/4404] 10.222.0.42 () {60 vars in 1295 bytes} [Sun Oct 23 01:29:32 2022] DELETE /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c/tags => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 23 01:29:32.934059 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ab87c9ed-3d68-4324-9572-1a4af34e6069 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Calling method '.version_select at 0x7f5cc16eb160>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:32.949329 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab87c9ed-3d68-4324-9572-1a4af34e6069 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:32.950443 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab87c9ed-3d68-4324-9572-1a4af34e6069 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:32.951019 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab87c9ed-3d68-4324-9572-1a4af34e6069 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:32.951786 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ab87c9ed-3d68-4324-9572-1a4af34e6069 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] [instance: d4135945-6011-4843-9156-74dbc625e78c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:32.962998 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab87c9ed-3d68-4324-9572-1a4af34e6069 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:32.962998 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab87c9ed-3d68-4324-9572-1a4af34e6069 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:32.962998 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab87c9ed-3d68-4324-9572-1a4af34e6069 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:32.962998 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab87c9ed-3d68-4324-9572-1a4af34e6069 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:32.963362 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab87c9ed-3d68-4324-9572-1a4af34e6069 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:32.963998 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab87c9ed-3d68-4324-9572-1a4af34e6069 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:32.991261 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-570ac5a8-11b5-474b-a71f-07eab9d3a45b tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:32.992806 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-570ac5a8-11b5-474b-a71f-07eab9d3a45b tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] [instance: 08bd5c17-1a39-4d28-9a01-e93b999bfb61] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:33.004019 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-570ac5a8-11b5-474b-a71f-07eab9d3a45b tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:33.005508 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-570ac5a8-11b5-474b-a71f-07eab9d3a45b tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:33.006645 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-570ac5a8-11b5-474b-a71f-07eab9d3a45b tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:33.007710 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-570ac5a8-11b5-474b-a71f-07eab9d3a45b tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:33.008356 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-570ac5a8-11b5-474b-a71f-07eab9d3a45b tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:33.008962 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-570ac5a8-11b5-474b-a71f-07eab9d3a45b tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:33.036335 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab87c9ed-3d68-4324-9572-1a4af34e6069 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:33.036842 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab87c9ed-3d68-4324-9572-1a4af34e6069 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:33.037417 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab87c9ed-3d68-4324-9572-1a4af34e6069 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:33.058008 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab87c9ed-3d68-4324-9572-1a4af34e6069 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:33.058814 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab87c9ed-3d68-4324-9572-1a4af34e6069 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:33.059129 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab87c9ed-3d68-4324-9572-1a4af34e6069 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:33.165810 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-570ac5a8-11b5-474b-a71f-07eab9d3a45b tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8950e247041d8be4fdfda5e2122fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db2a6834ec144418eb2cf222302fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:33.185860 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-570ac5a8-11b5-474b-a71f-07eab9d3a45b tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] 10.222.0.42 "GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61" status: 200 len: 1293 microversion: 2.1 time: 0.200977 Oct 23 01:29:33.186506 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2160/4405] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:32 2022] GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61 => generated 1293 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:33.198634 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-12195e0c-c7ec-4144-adbc-12129a775a9a req-0fbaee39-0c52-41b7-ac0d-e82ef59f7246 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0bb5109-7f58-469c-b403-057248427835", "name": "network-vif-plugged", "status": "completed", "tag": "8636fe04-57e9-4152-a064-e3d98100e595"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:29:33.223045 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-12195e0c-c7ec-4144-adbc-12129a775a9a req-0fbaee39-0c52-41b7-ac0d-e82ef59f7246 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:33.226200 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-12195e0c-c7ec-4144-adbc-12129a775a9a req-0fbaee39-0c52-41b7-ac0d-e82ef59f7246 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:33.226817 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-12195e0c-c7ec-4144-adbc-12129a775a9a req-0fbaee39-0c52-41b7-ac0d-e82ef59f7246 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:33.229818 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-ab87c9ed-3d68-4324-9572-1a4af34e6069 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lazy-loading 'flavor' on Instance uuid d4135945-6011-4843-9156-74dbc625e78c {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:29:33.252455 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ab87c9ed-3d68-4324-9572-1a4af34e6069 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] 10.222.0.42 "PUT /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c/tags/tempest-tag-927624582" status: 201 len: 0 microversion: 2.26 time: 0.327466 Oct 23 01:29:33.253136 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2246/4406] 10.222.0.42 () {62 vars in 1377 bytes} [Sun Oct 23 01:29:32 2022] PUT /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c/tags/tempest-tag-927624582 => generated 0 bytes in 329 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Oct 23 01:29:33.259333 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-12195e0c-c7ec-4144-adbc-12129a775a9a req-0fbaee39-0c52-41b7-ac0d-e82ef59f7246 service nova] Creating event network-vif-plugged:8636fe04-57e9-4152-a064-e3d98100e595 for instance e0bb5109-7f58-469c-b403-057248427835 on n-h1-master-1 Oct 23 01:29:33.264623 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-03b40af3-9c03-44ac-9f67-784318891602 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Calling method '.version_select at 0x7f5cc6186550>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:33.265296 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-12195e0c-c7ec-4144-adbc-12129a775a9a req-0fbaee39-0c52-41b7-ac0d-e82ef59f7246 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077187 Oct 23 01:29:33.270194 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2161/4407] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:29:33.275109 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-03b40af3-9c03-44ac-9f67-784318891602 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:33.275596 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-03b40af3-9c03-44ac-9f67-784318891602 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:33.276190 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-03b40af3-9c03-44ac-9f67-784318891602 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:33.276839 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-03b40af3-9c03-44ac-9f67-784318891602 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] [instance: d4135945-6011-4843-9156-74dbc625e78c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:33.285412 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-03b40af3-9c03-44ac-9f67-784318891602 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:33.285908 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-03b40af3-9c03-44ac-9f67-784318891602 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:33.290676 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-03b40af3-9c03-44ac-9f67-784318891602 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:33.293366 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-03b40af3-9c03-44ac-9f67-784318891602 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:33.293867 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-03b40af3-9c03-44ac-9f67-784318891602 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:33.295345 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-03b40af3-9c03-44ac-9f67-784318891602 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:33.332575 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-03b40af3-9c03-44ac-9f67-784318891602 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:33.333482 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-03b40af3-9c03-44ac-9f67-784318891602 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:33.334186 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-03b40af3-9c03-44ac-9f67-784318891602 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:33.346144 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-03b40af3-9c03-44ac-9f67-784318891602 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:33.346927 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-03b40af3-9c03-44ac-9f67-784318891602 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:33.352900 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-03b40af3-9c03-44ac-9f67-784318891602 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:33.443443 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-03b40af3-9c03-44ac-9f67-784318891602 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lazy-loading 'flavor' on Instance uuid d4135945-6011-4843-9156-74dbc625e78c {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:29:33.469286 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-03b40af3-9c03-44ac-9f67-784318891602 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] 10.222.0.42 "PUT /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c/tags/tempest-tag-1161733594" status: 201 len: 0 microversion: 2.26 time: 0.209186 Oct 23 01:29:33.474276 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2247/4408] 10.222.0.42 () {62 vars in 1380 bytes} [Sun Oct 23 01:29:33 2022] PUT /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c/tags/tempest-tag-1161733594 => generated 0 bytes in 215 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 23 01:29:33.482414 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-299b99fa-0a6d-4772-884f-6f0e67cdb264 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Calling method '.version_select at 0x7f5cc14a05e0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:33.504461 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-299b99fa-0a6d-4772-884f-6f0e67cdb264 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:33.505516 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-299b99fa-0a6d-4772-884f-6f0e67cdb264 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:33.505960 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-299b99fa-0a6d-4772-884f-6f0e67cdb264 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:33.506565 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-299b99fa-0a6d-4772-884f-6f0e67cdb264 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] [instance: d4135945-6011-4843-9156-74dbc625e78c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:33.512746 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-299b99fa-0a6d-4772-884f-6f0e67cdb264 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:33.513312 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-299b99fa-0a6d-4772-884f-6f0e67cdb264 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:33.513669 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-299b99fa-0a6d-4772-884f-6f0e67cdb264 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:33.514423 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-299b99fa-0a6d-4772-884f-6f0e67cdb264 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:33.514856 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-299b99fa-0a6d-4772-884f-6f0e67cdb264 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:33.515404 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-299b99fa-0a6d-4772-884f-6f0e67cdb264 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:33.539213 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-299b99fa-0a6d-4772-884f-6f0e67cdb264 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:33.539712 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-299b99fa-0a6d-4772-884f-6f0e67cdb264 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:33.540279 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-299b99fa-0a6d-4772-884f-6f0e67cdb264 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:33.666167 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-299b99fa-0a6d-4772-884f-6f0e67cdb264 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lazy-loading 'flavor' on Instance uuid d4135945-6011-4843-9156-74dbc625e78c {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:29:33.688537 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-299b99fa-0a6d-4772-884f-6f0e67cdb264 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c/tags" status: 204 len: 0 microversion: 2.26 time: 0.209854 Oct 23 01:29:33.689966 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2162/4409] 10.222.0.42 () {60 vars in 1295 bytes} [Sun Oct 23 01:29:33 2022] DELETE /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c/tags => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 23 01:29:33.697179 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-64eeb8ed-088c-4cc4-9eee-aab23ada02ca tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:33.699499 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-64eeb8ed-088c-4cc4-9eee-aab23ada02ca tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: 79b6e08c-f496-40ee-b5ea-34392ac475ad] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:33.699945 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0be31aa4-a604-46db-b9f5-8562c8e7078e tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Calling method '.version_select at 0x7f5cc148eca0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:33.711265 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0be31aa4-a604-46db-b9f5-8562c8e7078e tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:33.711903 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0be31aa4-a604-46db-b9f5-8562c8e7078e tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:33.712952 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0be31aa4-a604-46db-b9f5-8562c8e7078e tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:33.714574 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-64eeb8ed-088c-4cc4-9eee-aab23ada02ca tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:33.715260 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-64eeb8ed-088c-4cc4-9eee-aab23ada02ca tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:33.717032 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-64eeb8ed-088c-4cc4-9eee-aab23ada02ca tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:33.719383 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-64eeb8ed-088c-4cc4-9eee-aab23ada02ca tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:33.722102 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-64eeb8ed-088c-4cc4-9eee-aab23ada02ca tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:33.722735 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-64eeb8ed-088c-4cc4-9eee-aab23ada02ca tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:33.724958 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0be31aa4-a604-46db-b9f5-8562c8e7078e tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] 10.222.0.42 "GET /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c/tags" status: 200 len: 12 microversion: 2.26 time: 0.030846 Oct 23 01:29:33.726275 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2163/4410] 10.222.0.42 () {60 vars in 1292 bytes} [Sun Oct 23 01:29:33 2022] GET /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c/tags => generated 12 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:33.736501 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c0b2e720-3840-4055-8bf8-4575b322a55a tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Calling method '.version_select at 0x7f5cc14bf4c0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:33.745872 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c0b2e720-3840-4055-8bf8-4575b322a55a tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:33.746478 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c0b2e720-3840-4055-8bf8-4575b322a55a tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:33.746909 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c0b2e720-3840-4055-8bf8-4575b322a55a tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:33.747927 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c0b2e720-3840-4055-8bf8-4575b322a55a tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] [instance: d4135945-6011-4843-9156-74dbc625e78c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:33.755258 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c0b2e720-3840-4055-8bf8-4575b322a55a tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:33.755806 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c0b2e720-3840-4055-8bf8-4575b322a55a tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:33.756237 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c0b2e720-3840-4055-8bf8-4575b322a55a tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:33.757129 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c0b2e720-3840-4055-8bf8-4575b322a55a tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:33.757613 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c0b2e720-3840-4055-8bf8-4575b322a55a tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:33.758310 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c0b2e720-3840-4055-8bf8-4575b322a55a tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:33.782669 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c0b2e720-3840-4055-8bf8-4575b322a55a tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:33.783312 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c0b2e720-3840-4055-8bf8-4575b322a55a tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:33.783565 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c0b2e720-3840-4055-8bf8-4575b322a55a tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:33.795652 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-c0b2e720-3840-4055-8bf8-4575b322a55a tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lazy-loading 'flavor' on Instance uuid d4135945-6011-4843-9156-74dbc625e78c {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:29:33.814937 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c0b2e720-3840-4055-8bf8-4575b322a55a tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c/tags" status: 204 len: 0 microversion: 2.26 time: 0.082933 Oct 23 01:29:33.820638 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2164/4411] 10.222.0.42 () {60 vars in 1295 bytes} [Sun Oct 23 01:29:33 2022] DELETE /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c/tags => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 23 01:29:33.828159 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-eac342c7-8478-4f65-bb01-e10619dca593 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Calling method '.version_select at 0x7f5cc14a0040>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:33.843296 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eac342c7-8478-4f65-bb01-e10619dca593 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:33.844062 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eac342c7-8478-4f65-bb01-e10619dca593 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:33.844558 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eac342c7-8478-4f65-bb01-e10619dca593 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:33.845035 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-eac342c7-8478-4f65-bb01-e10619dca593 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] [instance: d4135945-6011-4843-9156-74dbc625e78c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:33.852447 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eac342c7-8478-4f65-bb01-e10619dca593 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:33.853253 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eac342c7-8478-4f65-bb01-e10619dca593 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:33.853852 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eac342c7-8478-4f65-bb01-e10619dca593 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:33.854768 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eac342c7-8478-4f65-bb01-e10619dca593 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:33.855433 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eac342c7-8478-4f65-bb01-e10619dca593 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:33.856163 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eac342c7-8478-4f65-bb01-e10619dca593 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:33.890417 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eac342c7-8478-4f65-bb01-e10619dca593 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:33.891510 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eac342c7-8478-4f65-bb01-e10619dca593 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:33.891717 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eac342c7-8478-4f65-bb01-e10619dca593 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:33.902340 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eac342c7-8478-4f65-bb01-e10619dca593 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:33.911787 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eac342c7-8478-4f65-bb01-e10619dca593 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:33.913290 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eac342c7-8478-4f65-bb01-e10619dca593 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:34.016454 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-eac342c7-8478-4f65-bb01-e10619dca593 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lazy-loading 'flavor' on Instance uuid d4135945-6011-4843-9156-74dbc625e78c {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:29:34.033742 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-eac342c7-8478-4f65-bb01-e10619dca593 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] 10.222.0.42 "PUT /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c/tags/tempest-tag-212971405" status: 201 len: 0 microversion: 2.26 time: 0.210366 Oct 23 01:29:34.038946 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-64eeb8ed-088c-4cc4-9eee-aab23ada02ca tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:34.040367 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2165/4412] 10.222.0.42 () {62 vars in 1377 bytes} [Sun Oct 23 01:29:33 2022] PUT /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c/tags/tempest-tag-212971405 => generated 0 bytes in 219 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 23 01:29:34.045639 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7e68ca92-7d8f-4d7c-93fa-58438769ad20 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Calling method '.version_select at 0x7f5cc14f80d0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:34.056094 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-64eeb8ed-088c-4cc4-9eee-aab23ada02ca tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad" status: 200 len: 1320 microversion: 2.1 time: 0.357996 Oct 23 01:29:34.056953 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2248/4413] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:33 2022] GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad => generated 1320 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:34.068489 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7e68ca92-7d8f-4d7c-93fa-58438769ad20 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:34.068972 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7e68ca92-7d8f-4d7c-93fa-58438769ad20 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:34.069405 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7e68ca92-7d8f-4d7c-93fa-58438769ad20 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:34.069878 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7e68ca92-7d8f-4d7c-93fa-58438769ad20 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] [instance: d4135945-6011-4843-9156-74dbc625e78c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:34.081445 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7e68ca92-7d8f-4d7c-93fa-58438769ad20 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:34.081941 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7e68ca92-7d8f-4d7c-93fa-58438769ad20 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:34.082397 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7e68ca92-7d8f-4d7c-93fa-58438769ad20 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:34.083628 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7e68ca92-7d8f-4d7c-93fa-58438769ad20 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:34.085746 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7e68ca92-7d8f-4d7c-93fa-58438769ad20 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:34.085746 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7e68ca92-7d8f-4d7c-93fa-58438769ad20 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:34.126308 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7e68ca92-7d8f-4d7c-93fa-58438769ad20 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:34.127192 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7e68ca92-7d8f-4d7c-93fa-58438769ad20 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:34.127763 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7e68ca92-7d8f-4d7c-93fa-58438769ad20 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:34.138041 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7e68ca92-7d8f-4d7c-93fa-58438769ad20 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:34.138746 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7e68ca92-7d8f-4d7c-93fa-58438769ad20 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:34.139184 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7e68ca92-7d8f-4d7c-93fa-58438769ad20 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:34.217964 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-591c157e-c7c0-43f2-9a99-48a8cd1f82d2 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:34.218831 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-591c157e-c7c0-43f2-9a99-48a8cd1f82d2 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] [instance: 08bd5c17-1a39-4d28-9a01-e93b999bfb61] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:34.232144 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-591c157e-c7c0-43f2-9a99-48a8cd1f82d2 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:34.233898 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-591c157e-c7c0-43f2-9a99-48a8cd1f82d2 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:34.235648 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-591c157e-c7c0-43f2-9a99-48a8cd1f82d2 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:34.236554 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-7e68ca92-7d8f-4d7c-93fa-58438769ad20 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lazy-loading 'flavor' on Instance uuid d4135945-6011-4843-9156-74dbc625e78c {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:29:34.237535 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-591c157e-c7c0-43f2-9a99-48a8cd1f82d2 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:34.239376 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-591c157e-c7c0-43f2-9a99-48a8cd1f82d2 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:34.244812 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-591c157e-c7c0-43f2-9a99-48a8cd1f82d2 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:34.264345 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7e68ca92-7d8f-4d7c-93fa-58438769ad20 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] 10.222.0.42 "PUT /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c/tags/tempest-tag-388993447" status: 201 len: 0 microversion: 2.26 time: 0.222688 Oct 23 01:29:34.265372 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2166/4414] 10.222.0.42 () {62 vars in 1377 bytes} [Sun Oct 23 01:29:34 2022] PUT /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c/tags/tempest-tag-388993447 => generated 0 bytes in 224 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 23 01:29:34.275606 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cd5d016e-b53d-4fdd-8ab7-92714f734ba0 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Action: 'update_all', calling method: .version_select at 0x7f5cc14bfee0>, body: {"tags": ["tempest-tag-1763854375", "tempest-tag-1567122846"]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:29:34.285435 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cd5d016e-b53d-4fdd-8ab7-92714f734ba0 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:34.285850 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cd5d016e-b53d-4fdd-8ab7-92714f734ba0 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:34.286969 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cd5d016e-b53d-4fdd-8ab7-92714f734ba0 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:34.287452 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cd5d016e-b53d-4fdd-8ab7-92714f734ba0 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] [instance: d4135945-6011-4843-9156-74dbc625e78c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:34.294256 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cd5d016e-b53d-4fdd-8ab7-92714f734ba0 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:34.294743 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cd5d016e-b53d-4fdd-8ab7-92714f734ba0 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:34.295181 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cd5d016e-b53d-4fdd-8ab7-92714f734ba0 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:34.295872 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cd5d016e-b53d-4fdd-8ab7-92714f734ba0 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:34.296331 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cd5d016e-b53d-4fdd-8ab7-92714f734ba0 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:34.296751 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cd5d016e-b53d-4fdd-8ab7-92714f734ba0 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:34.321717 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cd5d016e-b53d-4fdd-8ab7-92714f734ba0 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:34.322327 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cd5d016e-b53d-4fdd-8ab7-92714f734ba0 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:34.322829 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cd5d016e-b53d-4fdd-8ab7-92714f734ba0 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:34.412648 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-cd5d016e-b53d-4fdd-8ab7-92714f734ba0 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lazy-loading 'flavor' on Instance uuid d4135945-6011-4843-9156-74dbc625e78c {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:29:34.479602 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cd5d016e-b53d-4fdd-8ab7-92714f734ba0 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] 10.222.0.42 "PUT /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c/tags" status: 200 len: 62 microversion: 2.26 time: 0.206082 Oct 23 01:29:34.487108 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2167/4415] 10.222.0.42 () {62 vars in 1312 bytes} [Sun Oct 23 01:29:34 2022] PUT /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c/tags => generated 62 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:34.496783 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7df5db61-a8ad-444a-8d8e-11adbf539deb tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Calling method '.version_select at 0x7f5cc14ce160>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:34.501662 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-591c157e-c7c0-43f2-9a99-48a8cd1f82d2 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8950e247041d8be4fdfda5e2122fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db2a6834ec144418eb2cf222302fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:34.510287 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7df5db61-a8ad-444a-8d8e-11adbf539deb tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:34.511165 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7df5db61-a8ad-444a-8d8e-11adbf539deb tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:34.512616 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7df5db61-a8ad-444a-8d8e-11adbf539deb tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:34.518082 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-591c157e-c7c0-43f2-9a99-48a8cd1f82d2 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] 10.222.0.42 "GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61" status: 200 len: 1293 microversion: 2.1 time: 0.299953 Oct 23 01:29:34.523971 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2249/4416] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:34 2022] GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61 => generated 1293 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:29:34.532291 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7df5db61-a8ad-444a-8d8e-11adbf539deb tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] 10.222.0.42 "GET /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c/tags" status: 200 len: 62 microversion: 2.26 time: 0.042928 Oct 23 01:29:34.533599 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2168/4417] 10.222.0.42 () {60 vars in 1292 bytes} [Sun Oct 23 01:29:34 2022] GET /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c/tags => generated 62 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:34.546266 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a5082476-ed70-4269-ba42-d44e14fd6ce9 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Calling method '.version_select at 0x7f5cc16ebd30>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:34.562564 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5082476-ed70-4269-ba42-d44e14fd6ce9 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:34.564452 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5082476-ed70-4269-ba42-d44e14fd6ce9 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:34.564452 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5082476-ed70-4269-ba42-d44e14fd6ce9 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:34.566500 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a5082476-ed70-4269-ba42-d44e14fd6ce9 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] [instance: d4135945-6011-4843-9156-74dbc625e78c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:34.580018 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5082476-ed70-4269-ba42-d44e14fd6ce9 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:34.582677 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5082476-ed70-4269-ba42-d44e14fd6ce9 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:34.583461 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5082476-ed70-4269-ba42-d44e14fd6ce9 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:34.584558 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5082476-ed70-4269-ba42-d44e14fd6ce9 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:34.589163 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5082476-ed70-4269-ba42-d44e14fd6ce9 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:34.589793 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5082476-ed70-4269-ba42-d44e14fd6ce9 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:34.632149 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5082476-ed70-4269-ba42-d44e14fd6ce9 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:34.632640 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5082476-ed70-4269-ba42-d44e14fd6ce9 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:34.633254 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5082476-ed70-4269-ba42-d44e14fd6ce9 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:34.819592 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-a5082476-ed70-4269-ba42-d44e14fd6ce9 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lazy-loading 'flavor' on Instance uuid d4135945-6011-4843-9156-74dbc625e78c {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:29:34.841312 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a5082476-ed70-4269-ba42-d44e14fd6ce9 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c/tags" status: 204 len: 0 microversion: 2.26 time: 0.299157 Oct 23 01:29:34.846361 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2250/4418] 10.222.0.42 () {60 vars in 1295 bytes} [Sun Oct 23 01:29:34 2022] DELETE /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c/tags => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 23 01:29:34.852254 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0af2cf49-043f-4d2b-82ae-d161d16a569a tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:34.854817 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0af2cf49-043f-4d2b-82ae-d161d16a569a tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] [instance: d4135945-6011-4843-9156-74dbc625e78c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:34.865783 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0af2cf49-043f-4d2b-82ae-d161d16a569a tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:34.866718 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0af2cf49-043f-4d2b-82ae-d161d16a569a tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:34.868146 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0af2cf49-043f-4d2b-82ae-d161d16a569a tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:34.873146 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0af2cf49-043f-4d2b-82ae-d161d16a569a tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:34.873818 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0af2cf49-043f-4d2b-82ae-d161d16a569a tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:34.876174 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0af2cf49-043f-4d2b-82ae-d161d16a569a tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:34.930807 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0af2cf49-043f-4d2b-82ae-d161d16a569a tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] [instance: d4135945-6011-4843-9156-74dbc625e78c] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:29:35.079194 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7ad542db-61d7-46e5-a6cf-32c037c92f02 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:35.087325 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7ad542db-61d7-46e5-a6cf-32c037c92f02 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: 79b6e08c-f496-40ee-b5ea-34392ac475ad] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:35.097638 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ad542db-61d7-46e5-a6cf-32c037c92f02 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:35.098178 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ad542db-61d7-46e5-a6cf-32c037c92f02 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:35.099202 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ad542db-61d7-46e5-a6cf-32c037c92f02 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:35.099916 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ad542db-61d7-46e5-a6cf-32c037c92f02 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:35.100393 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ad542db-61d7-46e5-a6cf-32c037c92f02 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:35.100814 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ad542db-61d7-46e5-a6cf-32c037c92f02 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:35.294913 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0af2cf49-043f-4d2b-82ae-d161d16a569a tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c" status: 204 len: 0 microversion: 2.26 time: 0.447177 Oct 23 01:29:35.295437 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2169/4419] 10.222.0.42 () {60 vars in 1280 bytes} [Sun Oct 23 01:29:34 2022] DELETE /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 23 01:29:35.312573 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-519d25ec-53c6-4da5-b3de-5b62ce50cd7b tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:35.313572 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-519d25ec-53c6-4da5-b3de-5b62ce50cd7b tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] [instance: d4135945-6011-4843-9156-74dbc625e78c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:35.315751 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=42 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:35.324105 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-519d25ec-53c6-4da5-b3de-5b62ce50cd7b tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:35.326441 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-519d25ec-53c6-4da5-b3de-5b62ce50cd7b tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:35.330488 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-519d25ec-53c6-4da5-b3de-5b62ce50cd7b tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:35.338548 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-519d25ec-53c6-4da5-b3de-5b62ce50cd7b tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:35.338548 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-519d25ec-53c6-4da5-b3de-5b62ce50cd7b tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:35.338548 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-519d25ec-53c6-4da5-b3de-5b62ce50cd7b tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:35.355934 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7ad542db-61d7-46e5-a6cf-32c037c92f02 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:35.369130 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7ad542db-61d7-46e5-a6cf-32c037c92f02 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad" status: 200 len: 1320 microversion: 2.1 time: 0.291135 Oct 23 01:29:35.369791 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2251/4420] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:35 2022] GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad => generated 1320 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:29:35.548139 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e7a11500-cc46-4fad-8dbd-cca93fb8f61a tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:35.549912 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e7a11500-cc46-4fad-8dbd-cca93fb8f61a tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] [instance: 08bd5c17-1a39-4d28-9a01-e93b999bfb61] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:35.559056 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e7a11500-cc46-4fad-8dbd-cca93fb8f61a tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:35.563219 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e7a11500-cc46-4fad-8dbd-cca93fb8f61a tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:35.564494 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e7a11500-cc46-4fad-8dbd-cca93fb8f61a tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:35.565455 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e7a11500-cc46-4fad-8dbd-cca93fb8f61a tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:35.570018 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e7a11500-cc46-4fad-8dbd-cca93fb8f61a tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:35.570887 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e7a11500-cc46-4fad-8dbd-cca93fb8f61a tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:35.652935 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-519d25ec-53c6-4da5-b3de-5b62ce50cd7b tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:35.670553 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-519d25ec-53c6-4da5-b3de-5b62ce50cd7b tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:35.672430 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-519d25ec-53c6-4da5-b3de-5b62ce50cd7b tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:35.673728 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-519d25ec-53c6-4da5-b3de-5b62ce50cd7b tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] 10.222.0.42 "GET /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c" status: 200 len: 1552 microversion: 2.26 time: 0.365665 Oct 23 01:29:35.693143 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2170/4421] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:29:35 2022] GET /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c => generated 1552 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:29:35.903346 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e7a11500-cc46-4fad-8dbd-cca93fb8f61a tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8950e247041d8be4fdfda5e2122fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db2a6834ec144418eb2cf222302fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:35.914139 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e7a11500-cc46-4fad-8dbd-cca93fb8f61a tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] 10.222.0.42 "GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61" status: 200 len: 1293 microversion: 2.1 time: 0.371135 Oct 23 01:29:35.914758 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2252/4422] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:35 2022] GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61 => generated 1293 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:36.398793 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d715526e-8c96-493c-ba1d-033c2cf255a8 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:36.399490 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d715526e-8c96-493c-ba1d-033c2cf255a8 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: 79b6e08c-f496-40ee-b5ea-34392ac475ad] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:36.414612 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d715526e-8c96-493c-ba1d-033c2cf255a8 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:36.415124 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d715526e-8c96-493c-ba1d-033c2cf255a8 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:36.415578 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d715526e-8c96-493c-ba1d-033c2cf255a8 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:36.418919 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d715526e-8c96-493c-ba1d-033c2cf255a8 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:36.420416 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d715526e-8c96-493c-ba1d-033c2cf255a8 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:36.422797 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d715526e-8c96-493c-ba1d-033c2cf255a8 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:36.663937 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d715526e-8c96-493c-ba1d-033c2cf255a8 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:36.676149 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d715526e-8c96-493c-ba1d-033c2cf255a8 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad" status: 200 len: 1320 microversion: 2.1 time: 0.280132 Oct 23 01:29:36.690000 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2171/4423] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:36 2022] GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad => generated 1320 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:29:36.713599 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2ddf135d-79e4-4431-adb3-5beb36f22102 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:36.714144 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2ddf135d-79e4-4431-adb3-5beb36f22102 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] [instance: d4135945-6011-4843-9156-74dbc625e78c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:36.722910 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2ddf135d-79e4-4431-adb3-5beb36f22102 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:36.723542 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2ddf135d-79e4-4431-adb3-5beb36f22102 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:36.724147 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2ddf135d-79e4-4431-adb3-5beb36f22102 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:36.724870 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2ddf135d-79e4-4431-adb3-5beb36f22102 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:36.725439 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2ddf135d-79e4-4431-adb3-5beb36f22102 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:36.727214 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2ddf135d-79e4-4431-adb3-5beb36f22102 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:36.752213 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:36.931345 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2ddf135d-79e4-4431-adb3-5beb36f22102 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:36.946139 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2ddf135d-79e4-4431-adb3-5beb36f22102 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:36.947762 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-26634d5e-8fd9-4bc4-badf-3538a7af3495 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:36.948225 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2ddf135d-79e4-4431-adb3-5beb36f22102 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:36.948862 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-26634d5e-8fd9-4bc4-badf-3538a7af3495 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] [instance: 08bd5c17-1a39-4d28-9a01-e93b999bfb61] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:36.949848 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2ddf135d-79e4-4431-adb3-5beb36f22102 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] 10.222.0.42 "GET /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c" status: 200 len: 1552 microversion: 2.26 time: 0.243510 Oct 23 01:29:36.951234 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2253/4424] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:29:36 2022] GET /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c => generated 1552 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:29:36.975217 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-26634d5e-8fd9-4bc4-badf-3538a7af3495 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:36.975721 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-26634d5e-8fd9-4bc4-badf-3538a7af3495 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:36.976164 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-26634d5e-8fd9-4bc4-badf-3538a7af3495 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:36.976886 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-26634d5e-8fd9-4bc4-badf-3538a7af3495 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:36.977381 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-26634d5e-8fd9-4bc4-badf-3538a7af3495 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:36.977828 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-26634d5e-8fd9-4bc4-badf-3538a7af3495 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:37.196951 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-26634d5e-8fd9-4bc4-badf-3538a7af3495 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8950e247041d8be4fdfda5e2122fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db2a6834ec144418eb2cf222302fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:37.205086 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-26634d5e-8fd9-4bc4-badf-3538a7af3495 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] 10.222.0.42 "GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61" status: 200 len: 1293 microversion: 2.1 time: 0.262141 Oct 23 01:29:37.205501 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2172/4425] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:36 2022] GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61 => generated 1293 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:37.738067 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-09ace95c-54ff-4a28-8030-542f7bce497b req-459b742c-fc69-4a30-a176-df9d8d67756d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08bd5c17-1a39-4d28-9a01-e93b999bfb61", "name": "network-vif-plugged", "status": "completed", "tag": "933b406b-4a7e-457e-8b02-404bd679d55e"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:29:37.740174 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-152fe28f-79de-44c6-86eb-6278b07fc131 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:37.741938 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-152fe28f-79de-44c6-86eb-6278b07fc131 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: 79b6e08c-f496-40ee-b5ea-34392ac475ad] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:37.774187 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-152fe28f-79de-44c6-86eb-6278b07fc131 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:37.778255 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-152fe28f-79de-44c6-86eb-6278b07fc131 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:37.778766 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-152fe28f-79de-44c6-86eb-6278b07fc131 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:37.779506 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-152fe28f-79de-44c6-86eb-6278b07fc131 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:37.779973 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-152fe28f-79de-44c6-86eb-6278b07fc131 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:37.788663 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-152fe28f-79de-44c6-86eb-6278b07fc131 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:37.795191 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-09ace95c-54ff-4a28-8030-542f7bce497b req-459b742c-fc69-4a30-a176-df9d8d67756d service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:37.795707 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-09ace95c-54ff-4a28-8030-542f7bce497b req-459b742c-fc69-4a30-a176-df9d8d67756d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:37.796150 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-09ace95c-54ff-4a28-8030-542f7bce497b req-459b742c-fc69-4a30-a176-df9d8d67756d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:37.836694 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-09ace95c-54ff-4a28-8030-542f7bce497b req-459b742c-fc69-4a30-a176-df9d8d67756d service nova] Creating event network-vif-plugged:933b406b-4a7e-457e-8b02-404bd679d55e for instance 08bd5c17-1a39-4d28-9a01-e93b999bfb61 on n-h1-master-1 Oct 23 01:29:37.847974 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-09ace95c-54ff-4a28-8030-542f7bce497b req-459b742c-fc69-4a30-a176-df9d8d67756d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123026 Oct 23 01:29:37.850147 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2254/4426] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:29:37.975974 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=36 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:37.980658 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-541efb64-3f44-4d15-97f9-af1267ab110a tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:37.981384 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-541efb64-3f44-4d15-97f9-af1267ab110a tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] [instance: d4135945-6011-4843-9156-74dbc625e78c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:38.017498 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-541efb64-3f44-4d15-97f9-af1267ab110a tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:38.028608 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-541efb64-3f44-4d15-97f9-af1267ab110a tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:38.029874 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-541efb64-3f44-4d15-97f9-af1267ab110a tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:38.037765 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-541efb64-3f44-4d15-97f9-af1267ab110a tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:38.039078 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-541efb64-3f44-4d15-97f9-af1267ab110a tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:38.039541 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-541efb64-3f44-4d15-97f9-af1267ab110a tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:38.086161 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-152fe28f-79de-44c6-86eb-6278b07fc131 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:38.100704 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-152fe28f-79de-44c6-86eb-6278b07fc131 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad" status: 200 len: 1320 microversion: 2.1 time: 0.381362 Oct 23 01:29:38.101212 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2173/4427] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:37 2022] GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad => generated 1320 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:38.230270 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f1c45eca-62ab-4d74-8002-8c468d9c746f tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:38.231615 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f1c45eca-62ab-4d74-8002-8c468d9c746f tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] [instance: 08bd5c17-1a39-4d28-9a01-e93b999bfb61] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:38.247514 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f1c45eca-62ab-4d74-8002-8c468d9c746f tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:38.249844 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f1c45eca-62ab-4d74-8002-8c468d9c746f tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:38.249844 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f1c45eca-62ab-4d74-8002-8c468d9c746f tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:38.250763 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f1c45eca-62ab-4d74-8002-8c468d9c746f tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:38.251557 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f1c45eca-62ab-4d74-8002-8c468d9c746f tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:38.252681 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f1c45eca-62ab-4d74-8002-8c468d9c746f tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:38.295470 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-541efb64-3f44-4d15-97f9-af1267ab110a tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:38.311175 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-541efb64-3f44-4d15-97f9-af1267ab110a tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:38.315009 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-541efb64-3f44-4d15-97f9-af1267ab110a tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:38.318667 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-541efb64-3f44-4d15-97f9-af1267ab110a tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] 10.222.0.42 "GET /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c" status: 200 len: 1552 microversion: 2.26 time: 0.343851 Oct 23 01:29:38.334157 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2255/4428] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:29:37 2022] GET /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c => generated 1552 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:29:38.573499 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f1c45eca-62ab-4d74-8002-8c468d9c746f tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8950e247041d8be4fdfda5e2122fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db2a6834ec144418eb2cf222302fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:38.585590 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f1c45eca-62ab-4d74-8002-8c468d9c746f tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] 10.222.0.42 "GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61" status: 200 len: 1293 microversion: 2.1 time: 0.358317 Oct 23 01:29:38.599913 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2174/4429] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:38 2022] GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61 => generated 1293 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:39.136577 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5c442455-557a-4849-879a-69cd6c340d1b tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:39.136577 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5c442455-557a-4849-879a-69cd6c340d1b tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: 79b6e08c-f496-40ee-b5ea-34392ac475ad] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:39.155293 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5c442455-557a-4849-879a-69cd6c340d1b tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:39.156351 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5c442455-557a-4849-879a-69cd6c340d1b tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:39.163114 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5c442455-557a-4849-879a-69cd6c340d1b tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:39.164304 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5c442455-557a-4849-879a-69cd6c340d1b tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:39.165243 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5c442455-557a-4849-879a-69cd6c340d1b tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:39.165706 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5c442455-557a-4849-879a-69cd6c340d1b tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:39.183517 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-98b315d8-472e-4c8b-b2e1-0cb3df8c6a34 req-9254fc44-c774-44f8-82d3-fe1a9b5627c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4135945-6011-4843-9156-74dbc625e78c", "name": "network-vif-deleted", "tag": "6ef1ef8d-1fbb-471e-a80f-b7a3b541b417"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:29:39.197922 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=89,nova_cell1:DELETE=5,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:39.206714 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-98b315d8-472e-4c8b-b2e1-0cb3df8c6a34 req-9254fc44-c774-44f8-82d3-fe1a9b5627c4 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:39.207563 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-98b315d8-472e-4c8b-b2e1-0cb3df8c6a34 req-9254fc44-c774-44f8-82d3-fe1a9b5627c4 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:39.210466 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-98b315d8-472e-4c8b-b2e1-0cb3df8c6a34 req-9254fc44-c774-44f8-82d3-fe1a9b5627c4 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:39.232658 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-98b315d8-472e-4c8b-b2e1-0cb3df8c6a34 req-9254fc44-c774-44f8-82d3-fe1a9b5627c4 service nova] Creating event network-vif-deleted:6ef1ef8d-1fbb-471e-a80f-b7a3b541b417 for instance d4135945-6011-4843-9156-74dbc625e78c on n-h2-master-1 Oct 23 01:29:39.259835 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-98b315d8-472e-4c8b-b2e1-0cb3df8c6a34 req-9254fc44-c774-44f8-82d3-fe1a9b5627c4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070235 Oct 23 01:29:39.265655 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2175/4430] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:29:39.350639 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-288176da-f16e-470f-abb5-7c0f350f480f tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:39.351568 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-288176da-f16e-470f-abb5-7c0f350f480f tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] [instance: d4135945-6011-4843-9156-74dbc625e78c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:39.371629 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5c442455-557a-4849-879a-69cd6c340d1b tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:39.380769 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-288176da-f16e-470f-abb5-7c0f350f480f tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:39.381450 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-288176da-f16e-470f-abb5-7c0f350f480f tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:39.382490 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5c442455-557a-4849-879a-69cd6c340d1b tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad" status: 200 len: 1320 microversion: 2.1 time: 0.260094 Oct 23 01:29:39.388887 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-288176da-f16e-470f-abb5-7c0f350f480f tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:39.390054 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-288176da-f16e-470f-abb5-7c0f350f480f tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:39.394491 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-288176da-f16e-470f-abb5-7c0f350f480f tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:39.395230 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2256/4431] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:39 2022] GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad => generated 1320 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:39.399308 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-288176da-f16e-470f-abb5-7c0f350f480f tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:39.610209 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f8f42958-afc9-492f-ae3f-f4177aa563b2 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:39.610851 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f8f42958-afc9-492f-ae3f-f4177aa563b2 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] [instance: 08bd5c17-1a39-4d28-9a01-e93b999bfb61] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:39.635095 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8f42958-afc9-492f-ae3f-f4177aa563b2 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:39.635782 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8f42958-afc9-492f-ae3f-f4177aa563b2 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:39.636245 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8f42958-afc9-492f-ae3f-f4177aa563b2 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:39.637030 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8f42958-afc9-492f-ae3f-f4177aa563b2 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:39.647916 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8f42958-afc9-492f-ae3f-f4177aa563b2 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:39.648492 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8f42958-afc9-492f-ae3f-f4177aa563b2 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:39.665521 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-288176da-f16e-470f-abb5-7c0f350f480f tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:39.685037 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-288176da-f16e-470f-abb5-7c0f350f480f tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:39.692864 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-288176da-f16e-470f-abb5-7c0f350f480f tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:39.694218 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-288176da-f16e-470f-abb5-7c0f350f480f tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] 10.222.0.42 "GET /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c" status: 200 len: 1346 microversion: 2.26 time: 0.350641 Oct 23 01:29:39.706018 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2176/4432] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:29:39 2022] GET /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c => generated 1346 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:29:39.877821 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-e5736dd1-1a63-42da-ac77-57514498a2e8 req-a21cc71d-451b-4416-a974-0184b5879381 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79b6e08c-f496-40ee-b5ea-34392ac475ad", "name": "network-vif-plugged", "status": "completed", "tag": "5149c7c0-3942-4b5e-a00f-1ec25183da19"}, {"server_uuid": "b4f3e58c-311d-4b8a-b231-67e8fbc8cd3e", "name": "network-vif-plugged", "status": "completed", "tag": "44040275-ae3f-48cd-92f2-f889f7ea2654"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:29:39.897391 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-e5736dd1-1a63-42da-ac77-57514498a2e8 req-a21cc71d-451b-4416-a974-0184b5879381 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:39.903316 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-e5736dd1-1a63-42da-ac77-57514498a2e8 req-a21cc71d-451b-4416-a974-0184b5879381 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:39.904079 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-e5736dd1-1a63-42da-ac77-57514498a2e8 req-a21cc71d-451b-4416-a974-0184b5879381 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:39.924546 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-e5736dd1-1a63-42da-ac77-57514498a2e8 req-a21cc71d-451b-4416-a974-0184b5879381 service nova] Creating event network-vif-plugged:5149c7c0-3942-4b5e-a00f-1ec25183da19 for instance 79b6e08c-f496-40ee-b5ea-34392ac475ad on n-h2-master-1 Oct 23 01:29:39.927000 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-e5736dd1-1a63-42da-ac77-57514498a2e8 req-a21cc71d-451b-4416-a974-0184b5879381 service nova] Creating event network-vif-plugged:44040275-ae3f-48cd-92f2-f889f7ea2654 for instance b4f3e58c-311d-4b8a-b231-67e8fbc8cd3e on n-h1-master-1 Oct 23 01:29:39.936679 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-e5736dd1-1a63-42da-ac77-57514498a2e8 req-a21cc71d-451b-4416-a974-0184b5879381 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.062468 Oct 23 01:29:39.938047 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2177/4433] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:29:40.214007 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f8f42958-afc9-492f-ae3f-f4177aa563b2 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8950e247041d8be4fdfda5e2122fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db2a6834ec144418eb2cf222302fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:40.233824 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f8f42958-afc9-492f-ae3f-f4177aa563b2 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] 10.222.0.42 "GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61" status: 200 len: 1293 microversion: 2.1 time: 0.628721 Oct 23 01:29:40.238183 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2257/4434] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:39 2022] GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61 => generated 1293 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:40.410290 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-37150d15-f52f-4298-8845-5a75406d5bb0 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:40.412133 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-37150d15-f52f-4298-8845-5a75406d5bb0 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: 79b6e08c-f496-40ee-b5ea-34392ac475ad] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:40.436077 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-37150d15-f52f-4298-8845-5a75406d5bb0 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:40.440903 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-37150d15-f52f-4298-8845-5a75406d5bb0 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:40.440903 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-37150d15-f52f-4298-8845-5a75406d5bb0 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:40.445952 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-37150d15-f52f-4298-8845-5a75406d5bb0 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:40.447592 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-37150d15-f52f-4298-8845-5a75406d5bb0 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:40.448811 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-37150d15-f52f-4298-8845-5a75406d5bb0 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:40.726838 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-34053144-2557-437a-ac8e-7c1dd1673b7d tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:40.727756 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-34053144-2557-437a-ac8e-7c1dd1673b7d tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] [instance: d4135945-6011-4843-9156-74dbc625e78c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:40.739754 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-34053144-2557-437a-ac8e-7c1dd1673b7d tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:40.740281 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-34053144-2557-437a-ac8e-7c1dd1673b7d tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:40.740725 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-34053144-2557-437a-ac8e-7c1dd1673b7d tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:40.744679 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-34053144-2557-437a-ac8e-7c1dd1673b7d tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:40.747186 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-34053144-2557-437a-ac8e-7c1dd1673b7d tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:40.747823 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-34053144-2557-437a-ac8e-7c1dd1673b7d tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:40.851984 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-34053144-2557-437a-ac8e-7c1dd1673b7d tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:40.852742 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-34053144-2557-437a-ac8e-7c1dd1673b7d tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:40.853341 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-34053144-2557-437a-ac8e-7c1dd1673b7d tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:40.854028 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-34053144-2557-437a-ac8e-7c1dd1673b7d tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lazy-loading 'fault' on Instance uuid d4135945-6011-4843-9156-74dbc625e78c {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:29:40.995308 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-34053144-2557-437a-ac8e-7c1dd1673b7d tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:41.006693 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-34053144-2557-437a-ac8e-7c1dd1673b7d tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:41.009725 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-34053144-2557-437a-ac8e-7c1dd1673b7d tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51d8e34a549c44318a3d328fb2014d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064a14adc24641ddbde56bfe3b7f3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:41.012372 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-34053144-2557-437a-ac8e-7c1dd1673b7d tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] 10.222.0.42 "GET /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c" status: 200 len: 1351 microversion: 2.26 time: 0.292025 Oct 23 01:29:41.027222 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2258/4435] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:29:40 2022] GET /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c => generated 1351 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:29:41.163785 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-37150d15-f52f-4298-8845-5a75406d5bb0 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:41.175066 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-37150d15-f52f-4298-8845-5a75406d5bb0 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad" status: 200 len: 1320 microversion: 2.1 time: 0.770719 Oct 23 01:29:41.189145 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2178/4436] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:40 2022] GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad => generated 1320 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:41.263435 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9293fab7-9392-48be-b1fd-315fcbef62d2 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:41.264240 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9293fab7-9392-48be-b1fd-315fcbef62d2 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] [instance: 08bd5c17-1a39-4d28-9a01-e93b999bfb61] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:41.274693 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9293fab7-9392-48be-b1fd-315fcbef62d2 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:41.275547 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9293fab7-9392-48be-b1fd-315fcbef62d2 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:41.276188 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9293fab7-9392-48be-b1fd-315fcbef62d2 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:41.277150 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9293fab7-9392-48be-b1fd-315fcbef62d2 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:41.278481 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9293fab7-9392-48be-b1fd-315fcbef62d2 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:41.279075 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9293fab7-9392-48be-b1fd-315fcbef62d2 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:41.497393 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9293fab7-9392-48be-b1fd-315fcbef62d2 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8950e247041d8be4fdfda5e2122fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db2a6834ec144418eb2cf222302fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:41.512129 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9293fab7-9392-48be-b1fd-315fcbef62d2 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] 10.222.0.42 "GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61" status: 200 len: 1484 microversion: 2.1 time: 0.254606 Oct 23 01:29:41.513123 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2259/4437] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:41 2022] GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61 => generated 1484 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:41.549294 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5fe7c592-171d-483e-9b61-0f6d69153cd3 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:41.551496 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5fe7c592-171d-483e-9b61-0f6d69153cd3 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] [instance: 08bd5c17-1a39-4d28-9a01-e93b999bfb61] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:41.569137 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5fe7c592-171d-483e-9b61-0f6d69153cd3 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:41.571431 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5fe7c592-171d-483e-9b61-0f6d69153cd3 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:41.571431 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5fe7c592-171d-483e-9b61-0f6d69153cd3 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:41.573486 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5fe7c592-171d-483e-9b61-0f6d69153cd3 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:41.577803 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5fe7c592-171d-483e-9b61-0f6d69153cd3 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:41.578551 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5fe7c592-171d-483e-9b61-0f6d69153cd3 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:41.749279 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5fe7c592-171d-483e-9b61-0f6d69153cd3 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] 10.222.0.42 "GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.213088 Oct 23 01:29:41.750894 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2179/4438] 10.222.0.42 () {58 vars in 1275 bytes} [Sun Oct 23 01:29:41 2022] GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61/os-interface => generated 285 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:29:42.021380 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-df88fd67-ef49-4ea5-b186-9dd6f3fea1a5 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:42.021934 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-df88fd67-ef49-4ea5-b186-9dd6f3fea1a5 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:42.038523 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-df88fd67-ef49-4ea5-b186-9dd6f3fea1a5 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:42.039816 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-df88fd67-ef49-4ea5-b186-9dd6f3fea1a5 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:42.040677 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-df88fd67-ef49-4ea5-b186-9dd6f3fea1a5 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:42.041729 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-df88fd67-ef49-4ea5-b186-9dd6f3fea1a5 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:42.048626 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-df88fd67-ef49-4ea5-b186-9dd6f3fea1a5 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:42.048626 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-df88fd67-ef49-4ea5-b186-9dd6f3fea1a5 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:42.048835 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-506506f2-b5a9-468f-b083-1a6264a7cee9 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:42.048835 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-506506f2-b5a9-468f-b083-1a6264a7cee9 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] [instance: d4135945-6011-4843-9156-74dbc625e78c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:42.065030 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-506506f2-b5a9-468f-b083-1a6264a7cee9 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:42.065534 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-506506f2-b5a9-468f-b083-1a6264a7cee9 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:42.066519 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-506506f2-b5a9-468f-b083-1a6264a7cee9 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:42.068266 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-506506f2-b5a9-468f-b083-1a6264a7cee9 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:42.072756 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-506506f2-b5a9-468f-b083-1a6264a7cee9 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:42.078607 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-506506f2-b5a9-468f-b083-1a6264a7cee9 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:42.098065 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-506506f2-b5a9-468f-b083-1a6264a7cee9 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] HTTP exception thrown: Instance d4135945-6011-4843-9156-74dbc625e78c could not be found. Oct 23 01:29:42.107245 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-df88fd67-ef49-4ea5-b186-9dd6f3fea1a5 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039/os-volume_attachments/450ee67a-6990-4c35-b23f-a064b20154d9" status: 200 len: 194 microversion: 2.20 time: 0.085402 Oct 23 01:29:42.107245 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2260/4439] 10.222.0.42 () {60 vars in 1454 bytes} [Sun Oct 23 01:29:42 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039/os-volume_attachments/450ee67a-6990-4c35-b23f-a064b20154d9 => generated 194 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-506506f2-b5a9-468f-b083-1a6264a7cee9 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Request method failure captured: Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c HTTP/1.1 Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJjhECYszZFM2F0IQl9d4p7jC7BrYSSltfjHSipu17hp7vld8tLihWXJCAQeejBKiE9q46UO_5TM7mtl15d7Fc5m8UsQue4IpSg4emBPUmTf3zGayRpIvzUizcLgQsMwlm3UovbtCHVx7s8bc756blQ_cHTW22QkZATONa8urRF_37M Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: X-Openstack-Nova-Api-Version: 2.26 Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 064a14adc24641ddbde56bfe3b7f3e0f Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServerTagsTestJSON-840198962 Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/064a14adc24641ddbde56bfe3b7f3e0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_064a14adc24641ddbde56bfe3b7f3e0f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/064a14adc24641ddbde56bfe3b7f3e0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/064a14adc24641ddbde56bfe3b7f3e0f"}]}] Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServerTagsTestJSON-840198962 Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 064a14adc24641ddbde56bfe3b7f3e0f Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServerTagsTestJSON-840198962 Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServerTagsTestJSON-840198962-project Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 51d8e34a549c44318a3d328fb2014d20 Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServerTagsTestJSON-840198962-project Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: exception: Instance d4135945-6011-4843-9156-74dbc625e78c could not be found. Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'd4135945-6011-4843-9156-74dbc625e78c'} Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4135945-6011-4843-9156-74dbc625e78c could not be found. Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4135945-6011-4843-9156-74dbc625e78c could not be found. Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:29:42.133020 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:29:42.139261 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:29:42.139261 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:29:42.139261 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:29:42.139261 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:29:42.139261 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:29:42.139261 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4135945-6011-4843-9156-74dbc625e78c could not be found. Oct 23 01:29:42.139261 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:29:42.139261 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-506506f2-b5a9-468f-b083-1a6264a7cee9 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] Returning 404 to user: Instance d4135945-6011-4843-9156-74dbc625e78c could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:29:42.142147 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-506506f2-b5a9-468f-b083-1a6264a7cee9 tempest-ServerTagsTestJSON-840198962 tempest-ServerTagsTestJSON-840198962-project] 10.222.0.42 "GET /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c" status: 404 len: 111 microversion: 2.26 time: 0.100196 Oct 23 01:29:42.149870 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2180/4440] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:29:42 2022] GET /compute/v2.1/servers/d4135945-6011-4843-9156-74dbc625e78c => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 23 01:29:42.208643 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-321aaab7-4e0f-4f4d-864d-40bb3189dabf tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:42.210129 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-321aaab7-4e0f-4f4d-864d-40bb3189dabf tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: 79b6e08c-f496-40ee-b5ea-34392ac475ad] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:42.230911 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-321aaab7-4e0f-4f4d-864d-40bb3189dabf tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:42.231583 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-321aaab7-4e0f-4f4d-864d-40bb3189dabf tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:42.233198 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-321aaab7-4e0f-4f4d-864d-40bb3189dabf tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:42.234132 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-321aaab7-4e0f-4f4d-864d-40bb3189dabf tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:42.234427 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-321aaab7-4e0f-4f4d-864d-40bb3189dabf tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:42.234861 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-321aaab7-4e0f-4f4d-864d-40bb3189dabf tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:42.296979 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-09f7537d-5364-4c08-8785-232231e50a27 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:42.298198 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-09f7537d-5364-4c08-8785-232231e50a27 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:42.314680 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09f7537d-5364-4c08-8785-232231e50a27 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:42.314680 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09f7537d-5364-4c08-8785-232231e50a27 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:42.314680 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09f7537d-5364-4c08-8785-232231e50a27 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:42.314680 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09f7537d-5364-4c08-8785-232231e50a27 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:42.314680 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09f7537d-5364-4c08-8785-232231e50a27 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:42.314680 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09f7537d-5364-4c08-8785-232231e50a27 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:42.476628 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-09f7537d-5364-4c08-8785-232231e50a27 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lazy-loading 'services' on Instance uuid c6eb59b7-d1ee-442c-8142-19a88ad6a039 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:29:42.823469 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-09f7537d-5364-4c08-8785-232231e50a27 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039/os-volume_attachments/450ee67a-6990-4c35-b23f-a064b20154d9" status: 202 len: 0 microversion: 2.20 time: 0.532393 Oct 23 01:29:42.833396 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2181/4441] 10.222.0.42 () {60 vars in 1457 bytes} [Sun Oct 23 01:29:42 2022] DELETE /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039/os-volume_attachments/450ee67a-6990-4c35-b23f-a064b20154d9 => generated 0 bytes in 543 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 23 01:29:42.851698 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ae607ea3-2b5c-4c4c-85aa-7d8ea423bc0e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:42.855063 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ae607ea3-2b5c-4c4c-85aa-7d8ea423bc0e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:42.881012 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ae607ea3-2b5c-4c4c-85aa-7d8ea423bc0e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:42.881734 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ae607ea3-2b5c-4c4c-85aa-7d8ea423bc0e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:42.883404 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ae607ea3-2b5c-4c4c-85aa-7d8ea423bc0e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:42.884556 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ae607ea3-2b5c-4c4c-85aa-7d8ea423bc0e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:42.886442 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ae607ea3-2b5c-4c4c-85aa-7d8ea423bc0e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:42.888311 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ae607ea3-2b5c-4c4c-85aa-7d8ea423bc0e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:42.960329 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ae607ea3-2b5c-4c4c-85aa-7d8ea423bc0e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.125025 Oct 23 01:29:42.961479 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2182/4442] 10.222.0.42 () {60 vars in 1343 bytes} [Sun Oct 23 01:29:42 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:29:43.301606 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-321aaab7-4e0f-4f4d-864d-40bb3189dabf tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:43.311272 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-321aaab7-4e0f-4f4d-864d-40bb3189dabf tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad" status: 200 len: 1511 microversion: 2.1 time: 1.107712 Oct 23 01:29:43.333955 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2261/4443] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:42 2022] GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad => generated 1511 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:43.344133 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-31770c17-ec04-4f19-af63-469b0869f344 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:43.345438 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-31770c17-ec04-4f19-af63-469b0869f344 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: e0bb5109-7f58-469c-b403-057248427835] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:43.356277 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:43.358758 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-31770c17-ec04-4f19-af63-469b0869f344 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:43.359513 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-31770c17-ec04-4f19-af63-469b0869f344 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:43.360005 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-31770c17-ec04-4f19-af63-469b0869f344 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:43.361419 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-31770c17-ec04-4f19-af63-469b0869f344 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:43.361891 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-31770c17-ec04-4f19-af63-469b0869f344 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:43.368175 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-31770c17-ec04-4f19-af63-469b0869f344 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:43.813190 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-31770c17-ec04-4f19-af63-469b0869f344 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:43.832888 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-31770c17-ec04-4f19-af63-469b0869f344 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835" status: 200 len: 1513 microversion: 2.1 time: 0.487237 Oct 23 01:29:43.835881 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2183/4444] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:43 2022] GET /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835 => generated 1513 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:29:43.864273 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cf67554e-a3c7-44c5-88d1-bad89f82054b tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:43.864967 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-cf67554e-a3c7-44c5-88d1-bad89f82054b tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: b4f3e58c-311d-4b8a-b231-67e8fbc8cd3e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:43.875887 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf67554e-a3c7-44c5-88d1-bad89f82054b tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:43.876385 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf67554e-a3c7-44c5-88d1-bad89f82054b tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:43.878809 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf67554e-a3c7-44c5-88d1-bad89f82054b tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:43.880431 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf67554e-a3c7-44c5-88d1-bad89f82054b tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:43.882516 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf67554e-a3c7-44c5-88d1-bad89f82054b tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:43.883407 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf67554e-a3c7-44c5-88d1-bad89f82054b tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:43.974781 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ca469541-f9ad-4e7d-b4df-372b31ba6c39 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:43.977679 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ca469541-f9ad-4e7d-b4df-372b31ba6c39 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:43.997632 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca469541-f9ad-4e7d-b4df-372b31ba6c39 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:43.999800 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca469541-f9ad-4e7d-b4df-372b31ba6c39 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:44.000265 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca469541-f9ad-4e7d-b4df-372b31ba6c39 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:44.001012 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca469541-f9ad-4e7d-b4df-372b31ba6c39 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:44.006349 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca469541-f9ad-4e7d-b4df-372b31ba6c39 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:44.007094 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca469541-f9ad-4e7d-b4df-372b31ba6c39 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:44.094662 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ca469541-f9ad-4e7d-b4df-372b31ba6c39 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.125494 Oct 23 01:29:44.098605 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2184/4445] 10.222.0.42 () {60 vars in 1343 bytes} [Sun Oct 23 01:29:43 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:29:44.369958 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cf67554e-a3c7-44c5-88d1-bad89f82054b tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:44.381332 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cf67554e-a3c7-44c5-88d1-bad89f82054b tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/b4f3e58c-311d-4b8a-b231-67e8fbc8cd3e" status: 200 len: 1512 microversion: 2.1 time: 0.521495 Oct 23 01:29:44.381933 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2262/4446] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:43 2022] GET /compute/v2.1/servers/b4f3e58c-311d-4b8a-b231-67e8fbc8cd3e => generated 1512 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:44.414012 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ca731939-a663-4428-b1ce-b6e42f8fb4a7 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:44.435721 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ca731939-a663-4428-b1ce-b6e42f8fb4a7 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:44.439738 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ca731939-a663-4428-b1ce-b6e42f8fb4a7 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19'} {{(pid=120945) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 23 01:29:44.464067 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca731939-a663-4428-b1ce-b6e42f8fb4a7 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:44.464478 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca731939-a663-4428-b1ce-b6e42f8fb4a7 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:44.464920 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca731939-a663-4428-b1ce-b6e42f8fb4a7 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:44.479737 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca731939-a663-4428-b1ce-b6e42f8fb4a7 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:44.494394 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca731939-a663-4428-b1ce-b6e42f8fb4a7 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:44.494853 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca731939-a663-4428-b1ce-b6e42f8fb4a7 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:44.496259 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=3,nova_cell1:RELEASE=1,nova_cell1:DELETE=1,nova_cell1:UPDATE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:44.642603 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.multi_cell_list [None req-ca731939-a663-4428-b1ce-b6e42f8fb4a7 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120945) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 23 01:29:44.808864 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ca731939-a663-4428-b1ce-b6e42f8fb4a7 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:44.832679 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca731939-a663-4428-b1ce-b6e42f8fb4a7 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:44.843923 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca731939-a663-4428-b1ce-b6e42f8fb4a7 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:44.843923 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca731939-a663-4428-b1ce-b6e42f8fb4a7 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:45.110046 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-67a2a6f3-1d3a-4350-89ca-d2f5122f21b1 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:45.112472 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-67a2a6f3-1d3a-4350-89ca-d2f5122f21b1 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:45.143514 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-67a2a6f3-1d3a-4350-89ca-d2f5122f21b1 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:45.143976 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-67a2a6f3-1d3a-4350-89ca-d2f5122f21b1 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:45.144433 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-67a2a6f3-1d3a-4350-89ca-d2f5122f21b1 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:45.148747 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-67a2a6f3-1d3a-4350-89ca-d2f5122f21b1 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:45.149241 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-67a2a6f3-1d3a-4350-89ca-d2f5122f21b1 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:45.149693 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-67a2a6f3-1d3a-4350-89ca-d2f5122f21b1 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:45.226452 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-67a2a6f3-1d3a-4350-89ca-d2f5122f21b1 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.121349 Oct 23 01:29:45.229959 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2263/4447] 10.222.0.42 () {60 vars in 1343 bytes} [Sun Oct 23 01:29:45 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 23 01:29:45.313332 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ca731939-a663-4428-b1ce-b6e42f8fb4a7 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.905445 Oct 23 01:29:45.314389 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2185/4448] 10.222.0.42 () {58 vars in 1167 bytes} [Sun Oct 23 01:29:44 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:45.344761 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ef4e0385-15b4-45e8-9c40-64b2c1e6e858 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:45.366498 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ef4e0385-15b4-45e8-9c40-64b2c1e6e858 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:45.367901 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ef4e0385-15b4-45e8-9c40-64b2c1e6e858 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1456963514', 'deleted': False, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19'} {{(pid=120944) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 23 01:29:45.384002 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ef4e0385-15b4-45e8-9c40-64b2c1e6e858 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:45.384558 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ef4e0385-15b4-45e8-9c40-64b2c1e6e858 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:45.384911 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ef4e0385-15b4-45e8-9c40-64b2c1e6e858 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:45.385636 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ef4e0385-15b4-45e8-9c40-64b2c1e6e858 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:45.386122 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ef4e0385-15b4-45e8-9c40-64b2c1e6e858 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:45.386550 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ef4e0385-15b4-45e8-9c40-64b2c1e6e858 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:45.593097 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.multi_cell_list [None req-ef4e0385-15b4-45e8-9c40-64b2c1e6e858 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120944) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 23 01:29:45.809805 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ef4e0385-15b4-45e8-9c40-64b2c1e6e858 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:45.830390 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ef4e0385-15b4-45e8-9c40-64b2c1e6e858 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:45.831332 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ef4e0385-15b4-45e8-9c40-64b2c1e6e858 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:45.832081 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ef4e0385-15b4-45e8-9c40-64b2c1e6e858 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:46.031233 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-dbc13641-9a3b-4f0e-aac5-48fa03337351 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Action: 'create', calling method: .version_select at 0x7f5cc15adc10>, body: {"keypair": {"name": "tempest-keypair-1487923560", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3UPMzGjCxnjiGaXdcVZSJinFbGRnPTL1sJLy3Afm6Zp1P+9PbGmetK5VM8n+FxtWXL0KD2LUoD5o1ERXk1YIus+Fu65swypdDq7I57HbmKwukR/pI2L1bX9QrrpMStuw=="}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:29:46.123176 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-dbc13641-9a3b-4f0e-aac5-48fa03337351 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Getting quotas for project b6df910969eb472b97fb3fe05a3c85d3. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:29:46.151705 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-dbc13641-9a3b-4f0e-aac5-48fa03337351 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Getting quotas for user 3b7f0931fbb64e96868a0044b0c6c557 and project b6df910969eb472b97fb3fe05a3c85d3. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:29:46.217786 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ef4e0385-15b4-45e8-9c40-64b2c1e6e858 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1456963514" status: 200 len: 1516 microversion: 2.1 time: 0.877371 Oct 23 01:29:46.219109 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2264/4449] 10.222.0.42 () {58 vars in 1263 bytes} [Sun Oct 23 01:29:45 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1456963514 => generated 1516 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:46.224717 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-355f9c77-5df1-49b2-a206-8b29cfb0af3b tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:46.225556 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-355f9c77-5df1-49b2-a206-8b29cfb0af3b tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] [instance: 08bd5c17-1a39-4d28-9a01-e93b999bfb61] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:46.251826 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-355f9c77-5df1-49b2-a206-8b29cfb0af3b tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:46.254642 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-355f9c77-5df1-49b2-a206-8b29cfb0af3b tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:46.256186 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-355f9c77-5df1-49b2-a206-8b29cfb0af3b tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:46.260923 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-355f9c77-5df1-49b2-a206-8b29cfb0af3b tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:46.262882 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-355f9c77-5df1-49b2-a206-8b29cfb0af3b tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:46.266154 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-355f9c77-5df1-49b2-a206-8b29cfb0af3b tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:46.281469 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-dbc13641-9a3b-4f0e-aac5-48fa03337351 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.629556 Oct 23 01:29:46.282181 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2186/4450] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 01:29:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:29:46.290868 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-ed88a183-a59a-4958-a6f9-89acbd7fffcb req-7bf257d3-5f57-4937-bfcb-fb6225c0ddaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08bd5c17-1a39-4d28-9a01-e93b999bfb61", "tag": "933b406b-4a7e-457e-8b02-404bd679d55e"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:29:46.326259 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ed88a183-a59a-4958-a6f9-89acbd7fffcb req-7bf257d3-5f57-4937-bfcb-fb6225c0ddaa service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:46.327137 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ed88a183-a59a-4958-a6f9-89acbd7fffcb req-7bf257d3-5f57-4937-bfcb-fb6225c0ddaa service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:46.329557 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ed88a183-a59a-4958-a6f9-89acbd7fffcb req-7bf257d3-5f57-4937-bfcb-fb6225c0ddaa service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:46.358197 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-ed88a183-a59a-4958-a6f9-89acbd7fffcb req-7bf257d3-5f57-4937-bfcb-fb6225c0ddaa service nova] Creating event network-changed:933b406b-4a7e-457e-8b02-404bd679d55e for instance 08bd5c17-1a39-4d28-9a01-e93b999bfb61 on n-h1-master-1 Oct 23 01:29:46.374455 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-ed88a183-a59a-4958-a6f9-89acbd7fffcb req-7bf257d3-5f57-4937-bfcb-fb6225c0ddaa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088064 Oct 23 01:29:46.377178 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2187/4451] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:29:46.392765 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-56a14de5-ef29-4a17-affc-88d28c0a808c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:46.403428 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-56a14de5-ef29-4a17-affc-88d28c0a808c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:46.417049 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-56a14de5-ef29-4a17-affc-88d28c0a808c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:46.420235 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-56a14de5-ef29-4a17-affc-88d28c0a808c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:46.423430 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-56a14de5-ef29-4a17-affc-88d28c0a808c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:46.426645 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-56a14de5-ef29-4a17-affc-88d28c0a808c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:46.427632 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-56a14de5-ef29-4a17-affc-88d28c0a808c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:46.428319 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-56a14de5-ef29-4a17-affc-88d28c0a808c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:46.528220 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-56a14de5-ef29-4a17-affc-88d28c0a808c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.146368 Oct 23 01:29:46.528846 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2188/4452] 10.222.0.42 () {60 vars in 1343 bytes} [Sun Oct 23 01:29:46 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:29:46.544806 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d734c7e5-eb0b-435c-b35f-b2bc00281ae5 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:46.570581 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d734c7e5-eb0b-435c-b35f-b2bc00281ae5 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:46.574543 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d734c7e5-eb0b-435c-b35f-b2bc00281ae5 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19'} {{(pid=120945) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 23 01:29:46.588537 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d734c7e5-eb0b-435c-b35f-b2bc00281ae5 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:46.589862 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d734c7e5-eb0b-435c-b35f-b2bc00281ae5 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:46.591991 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d734c7e5-eb0b-435c-b35f-b2bc00281ae5 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:46.598583 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d734c7e5-eb0b-435c-b35f-b2bc00281ae5 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:46.599414 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d734c7e5-eb0b-435c-b35f-b2bc00281ae5 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:46.599968 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d734c7e5-eb0b-435c-b35f-b2bc00281ae5 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:46.829877 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.multi_cell_list [None req-d734c7e5-eb0b-435c-b35f-b2bc00281ae5 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120945) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 23 01:29:46.856836 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-355f9c77-5df1-49b2-a206-8b29cfb0af3b tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8950e247041d8be4fdfda5e2122fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db2a6834ec144418eb2cf222302fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:46.866417 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-355f9c77-5df1-49b2-a206-8b29cfb0af3b tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] 10.222.0.42 "GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61" status: 200 len: 1603 microversion: 2.1 time: 0.646036 Oct 23 01:29:46.867018 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2265/4453] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:46 2022] GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61 => generated 1603 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:47.057169 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d734c7e5-eb0b-435c-b35f-b2bc00281ae5 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:47.083159 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d734c7e5-eb0b-435c-b35f-b2bc00281ae5 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:47.083652 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d734c7e5-eb0b-435c-b35f-b2bc00281ae5 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:47.084088 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d734c7e5-eb0b-435c-b35f-b2bc00281ae5 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:47.084810 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-57a31008-ddd3-47b6-b5d0-4be0717d3ef1 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:47.085333 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-57a31008-ddd3-47b6-b5d0-4be0717d3ef1 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: 0fb11dc6-65bc-4c8e-a674-c948f42f1b87] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:47.104753 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-57a31008-ddd3-47b6-b5d0-4be0717d3ef1 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:47.105443 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-57a31008-ddd3-47b6-b5d0-4be0717d3ef1 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:47.118756 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-57a31008-ddd3-47b6-b5d0-4be0717d3ef1 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:47.119911 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-57a31008-ddd3-47b6-b5d0-4be0717d3ef1 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:47.125359 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-57a31008-ddd3-47b6-b5d0-4be0717d3ef1 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:47.135784 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-57a31008-ddd3-47b6-b5d0-4be0717d3ef1 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:47.206261 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-57a31008-ddd3-47b6-b5d0-4be0717d3ef1 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] HTTP exception thrown: Instance 0fb11dc6-65bc-4c8e-a674-c948f42f1b87 could not be found. Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-57a31008-ddd3-47b6-b5d0-4be0717d3ef1 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Request method failure captured: Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87 HTTP/1.1 Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJdVsAjvToj8KAhlGLVBInaL5ZF6Oz9kbUiy39SUtzwRVhAUzFfzRAcu9YuHjQAPTZfpTnw_wvEsXPB9cLPxlD_JcC7YNRTn2PCLYj1vVfxXgT-BRmb5wQiQPKikItMn-89VG5mfPfEQbGe0P3pcqb-trvm0utVmJxFKI0dt6fSMKwI Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 62a621d00a6b499f921337dda20b66bd Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-AttachVolumeTestJSON-1185041640 Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/62a621d00a6b499f921337dda20b66bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_62a621d00a6b499f921337dda20b66bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/62a621d00a6b499f921337dda20b66bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/62a621d00a6b499f921337dda20b66bd"}]}] Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-AttachVolumeTestJSON-1185041640 Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 62a621d00a6b499f921337dda20b66bd Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1185041640 Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-AttachVolumeTestJSON-1185041640-project Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 4ba4975d23874879b779282e5b9cecb0 Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-AttachVolumeTestJSON-1185041640-project Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 0fb11dc6-65bc-4c8e-a674-c948f42f1b87 could not be found. Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '0fb11dc6-65bc-4c8e-a674-c948f42f1b87'} Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fb11dc6-65bc-4c8e-a674-c948f42f1b87 could not be found. Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:29:47.212521 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:29:47.216177 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fb11dc6-65bc-4c8e-a674-c948f42f1b87 could not be found. Oct 23 01:29:47.216177 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:29:47.216177 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:29:47.216177 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:29:47.216177 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:29:47.216177 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:29:47.216177 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:29:47.216177 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:29:47.216177 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:29:47.216177 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fb11dc6-65bc-4c8e-a674-c948f42f1b87 could not be found. Oct 23 01:29:47.216177 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:29:47.219711 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-57a31008-ddd3-47b6-b5d0-4be0717d3ef1 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Returning 404 to user: Instance 0fb11dc6-65bc-4c8e-a674-c948f42f1b87 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:29:47.221367 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-57a31008-ddd3-47b6-b5d0-4be0717d3ef1 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87" status: 404 len: 111 microversion: 2.1 time: 0.141252 Oct 23 01:29:47.222152 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2266/4454] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:29:47 2022] DELETE /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:29:47.238363 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-beceadab-b7f1-4185-b0ef-016427fcd83e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:47.239003 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-beceadab-b7f1-4185-b0ef-016427fcd83e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: 0fb11dc6-65bc-4c8e-a674-c948f42f1b87] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:47.263508 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-beceadab-b7f1-4185-b0ef-016427fcd83e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:47.264010 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-beceadab-b7f1-4185-b0ef-016427fcd83e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:47.264460 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-beceadab-b7f1-4185-b0ef-016427fcd83e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:47.265179 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-beceadab-b7f1-4185-b0ef-016427fcd83e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:47.265625 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-beceadab-b7f1-4185-b0ef-016427fcd83e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:47.273618 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-beceadab-b7f1-4185-b0ef-016427fcd83e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-beceadab-b7f1-4185-b0ef-016427fcd83e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] HTTP exception thrown: Instance 0fb11dc6-65bc-4c8e-a674-c948f42f1b87 could not be found. Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-beceadab-b7f1-4185-b0ef-016427fcd83e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Request method failure captured: Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87 HTTP/1.1 Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJdVsAjvToj8KAhlGLVBInaL5ZF6Oz9kbUiy39SUtzwRVhAUzFfzRAcu9YuHjQAPTZfpTnw_wvEsXPB9cLPxlD_JcC7YNRTn2PCLYj1vVfxXgT-BRmb5wQiQPKikItMn-89VG5mfPfEQbGe0P3pcqb-trvm0utVmJxFKI0dt6fSMKwI Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 62a621d00a6b499f921337dda20b66bd Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-AttachVolumeTestJSON-1185041640 Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/62a621d00a6b499f921337dda20b66bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_62a621d00a6b499f921337dda20b66bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/62a621d00a6b499f921337dda20b66bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/62a621d00a6b499f921337dda20b66bd"}]}] Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-AttachVolumeTestJSON-1185041640 Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 62a621d00a6b499f921337dda20b66bd Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1185041640 Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-AttachVolumeTestJSON-1185041640-project Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 4ba4975d23874879b779282e5b9cecb0 Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-AttachVolumeTestJSON-1185041640-project Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 0fb11dc6-65bc-4c8e-a674-c948f42f1b87 could not be found. Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '0fb11dc6-65bc-4c8e-a674-c948f42f1b87'} Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fb11dc6-65bc-4c8e-a674-c948f42f1b87 could not be found. Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:29:47.339569 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:29:47.345287 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fb11dc6-65bc-4c8e-a674-c948f42f1b87 could not be found. Oct 23 01:29:47.345287 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:29:47.345287 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:29:47.345287 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:29:47.345287 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:29:47.345287 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:29:47.345287 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:29:47.345287 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:29:47.345287 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:29:47.345287 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fb11dc6-65bc-4c8e-a674-c948f42f1b87 could not be found. Oct 23 01:29:47.345287 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:29:47.345287 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-beceadab-b7f1-4185-b0ef-016427fcd83e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Returning 404 to user: Instance 0fb11dc6-65bc-4c8e-a674-c948f42f1b87 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:29:47.345287 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-beceadab-b7f1-4185-b0ef-016427fcd83e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87" status: 404 len: 111 microversion: 2.1 time: 0.113954 Oct 23 01:29:47.350488 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2267/4455] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:47 2022] GET /compute/v2.1/servers/0fb11dc6-65bc-4c8e-a674-c948f42f1b87 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:29:47.542011 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-68c969c1-ce27-4df9-bad5-b39fff1ebda2 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:47.545474 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-68c969c1-ce27-4df9-bad5-b39fff1ebda2 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:47.561514 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68c969c1-ce27-4df9-bad5-b39fff1ebda2 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:47.562183 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68c969c1-ce27-4df9-bad5-b39fff1ebda2 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:47.563602 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68c969c1-ce27-4df9-bad5-b39fff1ebda2 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:47.565141 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68c969c1-ce27-4df9-bad5-b39fff1ebda2 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:47.567579 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68c969c1-ce27-4df9-bad5-b39fff1ebda2 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:47.568346 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68c969c1-ce27-4df9-bad5-b39fff1ebda2 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:47.682602 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-68c969c1-ce27-4df9-bad5-b39fff1ebda2 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.144933 Oct 23 01:29:47.689468 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2268/4456] 10.222.0.42 () {60 vars in 1343 bytes} [Sun Oct 23 01:29:47 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 23 01:29:48.307185 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d734c7e5-eb0b-435c-b35f-b2bc00281ae5 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4519 microversion: 2.1 time: 1.773740 Oct 23 01:29:48.307986 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2189/4457] 10.222.0.42 () {58 vars in 1173 bytes} [Sun Oct 23 01:29:46 2022] GET /compute/v2.1/servers/detail?status=active => generated 4519 bytes in 1776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:48.354430 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5378459c-c5d5-4698-a016-d34959243fff tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:48.363081 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5378459c-c5d5-4698-a016-d34959243fff tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:48.365924 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.compute.servers [None req-5378459c-c5d5-4698-a016-d34959243fff tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Removing options 'limit' from query {{(pid=120944) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 23 01:29:48.368179 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5378459c-c5d5-4698-a016-d34959243fff tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Searching by: {'deleted': False, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19'} {{(pid=120944) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 23 01:29:48.385449 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5378459c-c5d5-4698-a016-d34959243fff tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:48.389415 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5378459c-c5d5-4698-a016-d34959243fff tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:48.390111 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5378459c-c5d5-4698-a016-d34959243fff tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:48.391077 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5378459c-c5d5-4698-a016-d34959243fff tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:48.393810 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5378459c-c5d5-4698-a016-d34959243fff tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:48.395551 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5378459c-c5d5-4698-a016-d34959243fff tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:48.498729 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5378459c-c5d5-4698-a016-d34959243fff tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:48.507647 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5378459c-c5d5-4698-a016-d34959243fff tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:48.512978 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5378459c-c5d5-4698-a016-d34959243fff tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:48.512978 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5378459c-c5d5-4698-a016-d34959243fff tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:48.706077 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5a3cfbc9-1950-4577-baf9-d7d9cc53a2e8 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:48.710375 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5a3cfbc9-1950-4577-baf9-d7d9cc53a2e8 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:48.733593 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5a3cfbc9-1950-4577-baf9-d7d9cc53a2e8 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:48.742075 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5a3cfbc9-1950-4577-baf9-d7d9cc53a2e8 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:48.742075 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5a3cfbc9-1950-4577-baf9-d7d9cc53a2e8 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:48.742075 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5a3cfbc9-1950-4577-baf9-d7d9cc53a2e8 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:48.742075 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5a3cfbc9-1950-4577-baf9-d7d9cc53a2e8 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:48.744490 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5a3cfbc9-1950-4577-baf9-d7d9cc53a2e8 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:48.851046 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5a3cfbc9-1950-4577-baf9-d7d9cc53a2e8 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.152429 Oct 23 01:29:48.851667 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2190/4458] 10.222.0.42 () {60 vars in 1343 bytes} [Sun Oct 23 01:29:48 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:29:49.108644 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5378459c-c5d5-4698-a016-d34959243fff tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.690593 Oct 23 01:29:49.108644 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2269/4459] 10.222.0.42 () {58 vars in 1161 bytes} [Sun Oct 23 01:29:48 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:49.109565 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-16ecba6c-a13e-4b5b-84ec-285ced2be56a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:49.109565 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-16ecba6c-a13e-4b5b-84ec-285ced2be56a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:49.109565 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-16ecba6c-a13e-4b5b-84ec-285ced2be56a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19'} {{(pid=120945) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 23 01:29:49.114903 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-16ecba6c-a13e-4b5b-84ec-285ced2be56a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:49.115392 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-16ecba6c-a13e-4b5b-84ec-285ced2be56a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:49.115831 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-16ecba6c-a13e-4b5b-84ec-285ced2be56a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:49.116563 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-16ecba6c-a13e-4b5b-84ec-285ced2be56a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:49.117020 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-16ecba6c-a13e-4b5b-84ec-285ced2be56a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:49.117458 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-16ecba6c-a13e-4b5b-84ec-285ced2be56a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:49.361295 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.multi_cell_list [None req-16ecba6c-a13e-4b5b-84ec-285ced2be56a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120945) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 23 01:29:49.551473 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-16ecba6c-a13e-4b5b-84ec-285ced2be56a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.482258 Oct 23 01:29:49.558436 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2191/4460] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Oct 23 01:29:49 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:49.564967 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-01e7a1aa-338d-4385-a46d-a02891b07a10 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:49.572436 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-01e7a1aa-338d-4385-a46d-a02891b07a10 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:49.576478 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.compute.servers [None req-01e7a1aa-338d-4385-a46d-a02891b07a10 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Removing options 'limit' from query {{(pid=120944) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 23 01:29:49.579711 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-01e7a1aa-338d-4385-a46d-a02891b07a10 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Searching by: {'deleted': False, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19'} {{(pid=120944) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 23 01:29:49.588787 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01e7a1aa-338d-4385-a46d-a02891b07a10 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:49.590047 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01e7a1aa-338d-4385-a46d-a02891b07a10 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:49.590693 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01e7a1aa-338d-4385-a46d-a02891b07a10 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:49.591625 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01e7a1aa-338d-4385-a46d-a02891b07a10 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:49.592288 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01e7a1aa-338d-4385-a46d-a02891b07a10 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:49.592894 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01e7a1aa-338d-4385-a46d-a02891b07a10 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:49.647592 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.multi_cell_list [None req-01e7a1aa-338d-4385-a46d-a02891b07a10 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120944) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 23 01:29:49.717845 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=100 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:49.721326 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-01e7a1aa-338d-4385-a46d-a02891b07a10 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.160253 Oct 23 01:29:49.726839 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2270/4461] 10.222.0.42 () {58 vars in 1150 bytes} [Sun Oct 23 01:29:49 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:49.744322 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6861fc00-5f27-4fe6-85f5-8dc05f6831b2 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:49.746907 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6861fc00-5f27-4fe6-85f5-8dc05f6831b2 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:49.749907 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6861fc00-5f27-4fe6-85f5-8dc05f6831b2 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Searching by: {'deleted': False, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19'} {{(pid=120945) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 23 01:29:49.769442 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6861fc00-5f27-4fe6-85f5-8dc05f6831b2 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:49.778601 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6861fc00-5f27-4fe6-85f5-8dc05f6831b2 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:49.778601 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6861fc00-5f27-4fe6-85f5-8dc05f6831b2 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:49.778601 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6861fc00-5f27-4fe6-85f5-8dc05f6831b2 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:49.778601 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6861fc00-5f27-4fe6-85f5-8dc05f6831b2 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:49.778601 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6861fc00-5f27-4fe6-85f5-8dc05f6831b2 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:49.866276 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4dd64753-e5ad-4d01-9323-edacb38c7777 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:49.867558 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.multi_cell_list [None req-6861fc00-5f27-4fe6-85f5-8dc05f6831b2 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120945) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 23 01:29:49.868746 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4dd64753-e5ad-4d01-9323-edacb38c7777 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:49.906370 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4dd64753-e5ad-4d01-9323-edacb38c7777 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:49.908140 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4dd64753-e5ad-4d01-9323-edacb38c7777 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:49.908607 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4dd64753-e5ad-4d01-9323-edacb38c7777 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:49.913748 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4dd64753-e5ad-4d01-9323-edacb38c7777 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:49.915389 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4dd64753-e5ad-4d01-9323-edacb38c7777 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:49.917759 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4dd64753-e5ad-4d01-9323-edacb38c7777 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:49.999615 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4dd64753-e5ad-4d01-9323-edacb38c7777 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.138110 Oct 23 01:29:50.002988 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2271/4462] 10.222.0.42 () {60 vars in 1343 bytes} [Sun Oct 23 01:29:49 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 23 01:29:50.020448 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6861fc00-5f27-4fe6-85f5-8dc05f6831b2 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.288132 Oct 23 01:29:50.021062 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2192/4463] 10.222.0.42 () {58 vars in 1125 bytes} [Sun Oct 23 01:29:49 2022] GET /compute/v2.1/servers => generated 1011 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:50.037313 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8422655a-d1f3-4759-b392-51cf8bf0bf1b tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:50.051802 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8422655a-d1f3-4759-b392-51cf8bf0bf1b tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:50.058205 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8422655a-d1f3-4759-b392-51cf8bf0bf1b tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19'} {{(pid=120944) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 23 01:29:50.092586 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8422655a-d1f3-4759-b392-51cf8bf0bf1b tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:50.096661 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8422655a-d1f3-4759-b392-51cf8bf0bf1b tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:50.097346 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8422655a-d1f3-4759-b392-51cf8bf0bf1b tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:50.099372 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8422655a-d1f3-4759-b392-51cf8bf0bf1b tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:50.100593 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8422655a-d1f3-4759-b392-51cf8bf0bf1b tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:50.102324 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8422655a-d1f3-4759-b392-51cf8bf0bf1b tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:50.350889 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.multi_cell_list [None req-8422655a-d1f3-4759-b392-51cf8bf0bf1b tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120944) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 23 01:29:50.515145 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8422655a-d1f3-4759-b392-51cf8bf0bf1b tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.481327 Oct 23 01:29:50.519898 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2272/4464] 10.222.0.42 () {58 vars in 1146 bytes} [Sun Oct 23 01:29:50 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:29:50.528801 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a1807eb9-1ed7-4480-b746-3c393ec6cbb0 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:50.533775 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a1807eb9-1ed7-4480-b746-3c393ec6cbb0 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:50.542450 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.compute.servers [None req-a1807eb9-1ed7-4480-b746-3c393ec6cbb0 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Removing options 'limit' from query {{(pid=120945) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 23 01:29:50.543290 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a1807eb9-1ed7-4480-b746-3c393ec6cbb0 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Searching by: {'deleted': False, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19'} {{(pid=120945) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 23 01:29:50.548936 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a1807eb9-1ed7-4480-b746-3c393ec6cbb0 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:50.549427 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a1807eb9-1ed7-4480-b746-3c393ec6cbb0 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:50.549867 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a1807eb9-1ed7-4480-b746-3c393ec6cbb0 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:50.559014 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a1807eb9-1ed7-4480-b746-3c393ec6cbb0 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:50.559014 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a1807eb9-1ed7-4480-b746-3c393ec6cbb0 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:50.559014 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a1807eb9-1ed7-4480-b746-3c393ec6cbb0 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:50.614052 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a1807eb9-1ed7-4480-b746-3c393ec6cbb0 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.088692 Oct 23 01:29:50.615216 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2193/4465] 10.222.0.42 () {58 vars in 1140 bytes} [Sun Oct 23 01:29:50 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:29:50.627998 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3dee2164-5211-4bef-a980-11ba454280d7 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:50.635243 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3dee2164-5211-4bef-a980-11ba454280d7 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:50.651916 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3dee2164-5211-4bef-a980-11ba454280d7 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1456963514', 'deleted': False, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19'} {{(pid=120944) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 23 01:29:50.671934 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3dee2164-5211-4bef-a980-11ba454280d7 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:50.673081 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3dee2164-5211-4bef-a980-11ba454280d7 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:50.674532 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3dee2164-5211-4bef-a980-11ba454280d7 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:50.681094 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3dee2164-5211-4bef-a980-11ba454280d7 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:50.681094 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3dee2164-5211-4bef-a980-11ba454280d7 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:50.681094 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3dee2164-5211-4bef-a980-11ba454280d7 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:50.845524 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.multi_cell_list [None req-3dee2164-5211-4bef-a980-11ba454280d7 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120944) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 23 01:29:50.945717 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3dee2164-5211-4bef-a980-11ba454280d7 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1456963514" status: 200 len: 346 microversion: 2.1 time: 0.320801 Oct 23 01:29:50.948483 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2273/4466] 10.222.0.42 () {58 vars in 1242 bytes} [Sun Oct 23 01:29:50 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1456963514 => generated 346 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:29:50.961150 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8d585575-c05f-400f-b585-ec635cf2dee1 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:29:50.969070 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d585575-c05f-400f-b585-ec635cf2dee1 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:50.975980 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d585575-c05f-400f-b585-ec635cf2dee1 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:50.975980 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d585575-c05f-400f-b585-ec635cf2dee1 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:50.997894 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8d585575-c05f-400f-b585-ec635cf2dee1 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: e0bb5109-7f58-469c-b403-057248427835] Going to try to stop instance {{(pid=120945) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 23 01:29:51.015561 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b71505c7-1fd6-48d0-b491-65b52356894e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:51.018295 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b71505c7-1fd6-48d0-b491-65b52356894e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:51.031786 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b71505c7-1fd6-48d0-b491-65b52356894e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:51.032300 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b71505c7-1fd6-48d0-b491-65b52356894e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:51.035558 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b71505c7-1fd6-48d0-b491-65b52356894e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:51.037261 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b71505c7-1fd6-48d0-b491-65b52356894e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:51.049778 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b71505c7-1fd6-48d0-b491-65b52356894e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:51.051618 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b71505c7-1fd6-48d0-b491-65b52356894e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:51.137490 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b71505c7-1fd6-48d0-b491-65b52356894e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.125767 Oct 23 01:29:51.144493 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2274/4467] 10.222.0.42 () {60 vars in 1343 bytes} [Sun Oct 23 01:29:51 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 23 01:29:51.184974 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8d585575-c05f-400f-b585-ec635cf2dee1 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "POST /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835/action" status: 202 len: 0 microversion: 2.1 time: 0.227220 Oct 23 01:29:51.190951 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2194/4468] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:29:50 2022] POST /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:29:51.195248 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0d06b4d0-7a80-498d-abce-bc2a3c172359 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:51.198602 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0d06b4d0-7a80-498d-abce-bc2a3c172359 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: e0bb5109-7f58-469c-b403-057248427835] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:51.219665 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0d06b4d0-7a80-498d-abce-bc2a3c172359 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:51.225952 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0d06b4d0-7a80-498d-abce-bc2a3c172359 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:51.232852 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0d06b4d0-7a80-498d-abce-bc2a3c172359 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:51.237151 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0d06b4d0-7a80-498d-abce-bc2a3c172359 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:51.239273 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0d06b4d0-7a80-498d-abce-bc2a3c172359 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:51.241692 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0d06b4d0-7a80-498d-abce-bc2a3c172359 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:51.637287 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0d06b4d0-7a80-498d-abce-bc2a3c172359 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:51.643760 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0d06b4d0-7a80-498d-abce-bc2a3c172359 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835" status: 200 len: 1523 microversion: 2.1 time: 0.453368 Oct 23 01:29:51.650609 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2275/4469] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:51 2022] GET /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835 => generated 1523 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:29:52.153569 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-dcf37919-8844-408b-b019-56203b53a391 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:52.157017 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-dcf37919-8844-408b-b019-56203b53a391 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:52.178247 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dcf37919-8844-408b-b019-56203b53a391 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:52.179006 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dcf37919-8844-408b-b019-56203b53a391 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:52.179512 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dcf37919-8844-408b-b019-56203b53a391 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:52.182632 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dcf37919-8844-408b-b019-56203b53a391 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:52.183113 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dcf37919-8844-408b-b019-56203b53a391 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:52.183552 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dcf37919-8844-408b-b019-56203b53a391 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:52.253699 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-dcf37919-8844-408b-b019-56203b53a391 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.104212 Oct 23 01:29:52.254521 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2195/4470] 10.222.0.42 () {60 vars in 1343 bytes} [Sun Oct 23 01:29:52 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:29:52.674400 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f3053b94-1a20-4c58-84d3-8d210eb71268 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:52.675109 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f3053b94-1a20-4c58-84d3-8d210eb71268 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: e0bb5109-7f58-469c-b403-057248427835] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:52.694643 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f3053b94-1a20-4c58-84d3-8d210eb71268 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:52.695092 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f3053b94-1a20-4c58-84d3-8d210eb71268 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:52.695628 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f3053b94-1a20-4c58-84d3-8d210eb71268 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:52.696339 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f3053b94-1a20-4c58-84d3-8d210eb71268 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:52.700788 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f3053b94-1a20-4c58-84d3-8d210eb71268 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:52.709410 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f3053b94-1a20-4c58-84d3-8d210eb71268 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:52.755466 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bc0b4787-af87-4fdd-bb22-58a9c28c617d tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-266154889", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "5d7546f5-bed2-41a6-97dc-61fc79d13290"}], "security_groups": [{"name": "tempest-securitygroup--1047182744"}], "key_name": "tempest-keypair-1487923560", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:29:52.996573 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-bc0b4787-af87-4fdd-bb22-58a9c28c617d tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] validate_networks() for [('5d7546f5-bed2-41a6-97dc-61fc79d13290', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:29:53.147560 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f3053b94-1a20-4c58-84d3-8d210eb71268 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:53.163613 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f3053b94-1a20-4c58-84d3-8d210eb71268 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835" status: 200 len: 1523 microversion: 2.1 time: 0.491935 Oct 23 01:29:53.205128 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2276/4471] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:52 2022] GET /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835 => generated 1523 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:53.269833 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-483b5d6a-1e88-478d-bea1-462c71428a99 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:53.272336 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-483b5d6a-1e88-478d-bea1-462c71428a99 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:53.287156 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-483b5d6a-1e88-478d-bea1-462c71428a99 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:53.291264 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-483b5d6a-1e88-478d-bea1-462c71428a99 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:53.293076 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-483b5d6a-1e88-478d-bea1-462c71428a99 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:53.294485 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-483b5d6a-1e88-478d-bea1-462c71428a99 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:53.298050 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-483b5d6a-1e88-478d-bea1-462c71428a99 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:53.299344 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-483b5d6a-1e88-478d-bea1-462c71428a99 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:53.342775 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-483b5d6a-1e88-478d-bea1-462c71428a99 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.080010 Oct 23 01:29:53.344013 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2277/4472] 10.222.0.42 () {60 vars in 1343 bytes} [Sun Oct 23 01:29:53 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 23 01:29:53.804718 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-bc0b4787-af87-4fdd-bb22-58a9c28c617d tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Getting quotas for project b6df910969eb472b97fb3fe05a3c85d3. Resources: dict_keys(['metadata_items']) {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:29:53.812889 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-bc0b4787-af87-4fdd-bb22-58a9c28c617d tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Getting quotas for user 3b7f0931fbb64e96868a0044b0c6c557 and project b6df910969eb472b97fb3fe05a3c85d3. Resources: dict_keys(['metadata_items']) {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:29:53.832062 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-bc0b4787-af87-4fdd-bb22-58a9c28c617d tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:29:53.832872 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-bc0b4787-af87-4fdd-bb22-58a9c28c617d tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:29:53.833466 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-bc0b4787-af87-4fdd-bb22-58a9c28c617d tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:29:53.834021 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-bc0b4787-af87-4fdd-bb22-58a9c28c617d tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:29:53.834512 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-bc0b4787-af87-4fdd-bb22-58a9c28c617d tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:29:53.843559 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bc0b4787-af87-4fdd-bb22-58a9c28c617d tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:53.844072 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bc0b4787-af87-4fdd-bb22-58a9c28c617d tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:53.844560 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bc0b4787-af87-4fdd-bb22-58a9c28c617d tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:53.845571 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bc0b4787-af87-4fdd-bb22-58a9c28c617d tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:53.846460 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bc0b4787-af87-4fdd-bb22-58a9c28c617d tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:53.846891 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bc0b4787-af87-4fdd-bb22-58a9c28c617d tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:53.870863 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-bc0b4787-af87-4fdd-bb22-58a9c28c617d tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Getting quotas for project b6df910969eb472b97fb3fe05a3c85d3. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:29:53.877796 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-bc0b4787-af87-4fdd-bb22-58a9c28c617d tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Getting quotas for user 3b7f0931fbb64e96868a0044b0c6c557 and project b6df910969eb472b97fb3fe05a3c85d3. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:29:53.905676 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-bc0b4787-af87-4fdd-bb22-58a9c28c617d tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:29:53.908096 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-bc0b4787-af87-4fdd-bb22-58a9c28c617d tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] [instance: 55e557ae-4057-4fb9-a753-45a08c602b71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:29:54.096977 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bc0b4787-af87-4fdd-bb22-58a9c28c617d tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.345806 Oct 23 01:29:54.098326 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2196/4473] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:29:52 2022] POST /compute/v2.1/servers => generated 409 bytes in 1351 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 23 01:29:54.111612 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-66e8629b-5cbe-412c-ac1f-269e0cd195c8 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:54.113854 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-66e8629b-5cbe-412c-ac1f-269e0cd195c8 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] [instance: 55e557ae-4057-4fb9-a753-45a08c602b71] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:54.192652 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-131bcfc1-12e2-4ddd-ab13-800161d8a9d4 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:54.194093 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-131bcfc1-12e2-4ddd-ab13-800161d8a9d4 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: e0bb5109-7f58-469c-b403-057248427835] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:54.205067 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-131bcfc1-12e2-4ddd-ab13-800161d8a9d4 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:54.206089 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-131bcfc1-12e2-4ddd-ab13-800161d8a9d4 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:54.207282 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-131bcfc1-12e2-4ddd-ab13-800161d8a9d4 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:54.208308 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-131bcfc1-12e2-4ddd-ab13-800161d8a9d4 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:54.209012 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-131bcfc1-12e2-4ddd-ab13-800161d8a9d4 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:54.210732 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-131bcfc1-12e2-4ddd-ab13-800161d8a9d4 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:54.267668 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:54.289361 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-66e8629b-5cbe-412c-ac1f-269e0cd195c8 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7f0931fbb64e96868a0044b0c6c557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6df910969eb472b97fb3fe05a3c85d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:54.312763 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-66e8629b-5cbe-412c-ac1f-269e0cd195c8 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] 10.222.0.42 "GET /compute/v2.1/servers/55e557ae-4057-4fb9-a753-45a08c602b71" status: 200 len: 1277 microversion: 2.1 time: 0.190479 Oct 23 01:29:54.320232 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2278/4474] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:54 2022] GET /compute/v2.1/servers/55e557ae-4057-4fb9-a753-45a08c602b71 => generated 1277 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:54.356009 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ba9f8f7f-a8bb-47c7-bc7d-ba4e10ae4960 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:54.364781 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ba9f8f7f-a8bb-47c7-bc7d-ba4e10ae4960 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:54.369470 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba9f8f7f-a8bb-47c7-bc7d-ba4e10ae4960 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:54.370194 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba9f8f7f-a8bb-47c7-bc7d-ba4e10ae4960 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:54.371134 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba9f8f7f-a8bb-47c7-bc7d-ba4e10ae4960 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:54.372017 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba9f8f7f-a8bb-47c7-bc7d-ba4e10ae4960 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:54.372641 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba9f8f7f-a8bb-47c7-bc7d-ba4e10ae4960 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:54.373242 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba9f8f7f-a8bb-47c7-bc7d-ba4e10ae4960 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:54.426125 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ba9f8f7f-a8bb-47c7-bc7d-ba4e10ae4960 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.073980 Oct 23 01:29:54.426738 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2279/4475] 10.222.0.42 () {60 vars in 1343 bytes} [Sun Oct 23 01:29:54 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:29:54.576943 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-52d0cd10-df9f-4af0-baff-994ae0e239f7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:54.578143 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-52d0cd10-df9f-4af0-baff-994ae0e239f7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:54.588925 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-52d0cd10-df9f-4af0-baff-994ae0e239f7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:54.592571 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-52d0cd10-df9f-4af0-baff-994ae0e239f7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:54.595693 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-52d0cd10-df9f-4af0-baff-994ae0e239f7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:54.596424 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-52d0cd10-df9f-4af0-baff-994ae0e239f7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:54.596934 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-52d0cd10-df9f-4af0-baff-994ae0e239f7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:54.600270 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-52d0cd10-df9f-4af0-baff-994ae0e239f7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:54.647773 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-52d0cd10-df9f-4af0-baff-994ae0e239f7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:29:54.667722 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-131bcfc1-12e2-4ddd-ab13-800161d8a9d4 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:54.674898 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-131bcfc1-12e2-4ddd-ab13-800161d8a9d4 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835" status: 200 len: 1523 microversion: 2.1 time: 0.487725 Oct 23 01:29:54.678861 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2197/4476] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:54 2022] GET /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835 => generated 1523 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:29:55.026307 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:55.104513 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-52d0cd10-df9f-4af0-baff-994ae0e239f7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 204 len: 0 microversion: 2.20 time: 0.531958 Oct 23 01:29:55.113732 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2280/4477] 10.222.0.42 () {60 vars in 1280 bytes} [Sun Oct 23 01:29:54 2022] DELETE /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 23 01:29:55.115374 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b988e36e-26c8-45e8-97cf-f060c6aa0eb1 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:55.115998 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b988e36e-26c8-45e8-97cf-f060c6aa0eb1 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:55.134675 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b988e36e-26c8-45e8-97cf-f060c6aa0eb1 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:55.136457 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b988e36e-26c8-45e8-97cf-f060c6aa0eb1 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:55.137697 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b988e36e-26c8-45e8-97cf-f060c6aa0eb1 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:55.139205 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b988e36e-26c8-45e8-97cf-f060c6aa0eb1 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:55.142261 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b988e36e-26c8-45e8-97cf-f060c6aa0eb1 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:55.143196 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b988e36e-26c8-45e8-97cf-f060c6aa0eb1 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:55.331669 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b988e36e-26c8-45e8-97cf-f060c6aa0eb1 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:55.336345 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b988e36e-26c8-45e8-97cf-f060c6aa0eb1 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:55.337155 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-560bdfb1-2a5b-4dad-a198-617c0aae0df6 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:55.337944 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b988e36e-26c8-45e8-97cf-f060c6aa0eb1 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:55.338172 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-560bdfb1-2a5b-4dad-a198-617c0aae0df6 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] [instance: 55e557ae-4057-4fb9-a753-45a08c602b71] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:55.339162 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b988e36e-26c8-45e8-97cf-f060c6aa0eb1 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1721 microversion: 2.20 time: 0.229347 Oct 23 01:29:55.339731 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2198/4478] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:29:55 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1721 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:29:55.406157 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-560bdfb1-2a5b-4dad-a198-617c0aae0df6 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7f0931fbb64e96868a0044b0c6c557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6df910969eb472b97fb3fe05a3c85d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:55.414412 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-560bdfb1-2a5b-4dad-a198-617c0aae0df6 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] 10.222.0.42 "GET /compute/v2.1/servers/55e557ae-4057-4fb9-a753-45a08c602b71" status: 200 len: 1277 microversion: 2.1 time: 0.081671 Oct 23 01:29:55.414993 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2281/4479] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:55 2022] GET /compute/v2.1/servers/55e557ae-4057-4fb9-a753-45a08c602b71 => generated 1277 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:29:55.703040 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ca859cb4-f5b2-4cab-9eef-9031444c7b37 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:55.705523 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ca859cb4-f5b2-4cab-9eef-9031444c7b37 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: e0bb5109-7f58-469c-b403-057248427835] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:55.710103 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca859cb4-f5b2-4cab-9eef-9031444c7b37 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:55.710590 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca859cb4-f5b2-4cab-9eef-9031444c7b37 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:55.711031 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca859cb4-f5b2-4cab-9eef-9031444c7b37 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:55.711720 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca859cb4-f5b2-4cab-9eef-9031444c7b37 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:55.712171 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca859cb4-f5b2-4cab-9eef-9031444c7b37 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:55.712593 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca859cb4-f5b2-4cab-9eef-9031444c7b37 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:55.914948 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ca859cb4-f5b2-4cab-9eef-9031444c7b37 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:55.924883 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ca859cb4-f5b2-4cab-9eef-9031444c7b37 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835" status: 200 len: 1523 microversion: 2.1 time: 0.225885 Oct 23 01:29:55.927680 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2199/4480] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:55 2022] GET /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835 => generated 1523 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:56.364932 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cae0de90-e883-4efd-ab07-07bba4804846 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:56.366200 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-cae0de90-e883-4efd-ab07-07bba4804846 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:56.376271 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cae0de90-e883-4efd-ab07-07bba4804846 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:56.380530 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cae0de90-e883-4efd-ab07-07bba4804846 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:56.382216 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cae0de90-e883-4efd-ab07-07bba4804846 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:56.383067 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cae0de90-e883-4efd-ab07-07bba4804846 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:56.383857 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cae0de90-e883-4efd-ab07-07bba4804846 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:56.385214 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cae0de90-e883-4efd-ab07-07bba4804846 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:56.442642 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-92904e32-b11e-41b9-a168-e0baa9130067 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:56.444568 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-92904e32-b11e-41b9-a168-e0baa9130067 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] [instance: 55e557ae-4057-4fb9-a753-45a08c602b71] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:56.458022 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-92904e32-b11e-41b9-a168-e0baa9130067 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:56.461454 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-92904e32-b11e-41b9-a168-e0baa9130067 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:56.461454 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-92904e32-b11e-41b9-a168-e0baa9130067 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:56.461454 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-92904e32-b11e-41b9-a168-e0baa9130067 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:56.462024 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-92904e32-b11e-41b9-a168-e0baa9130067 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:56.462677 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-92904e32-b11e-41b9-a168-e0baa9130067 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:56.557378 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-92904e32-b11e-41b9-a168-e0baa9130067 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7f0931fbb64e96868a0044b0c6c557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6df910969eb472b97fb3fe05a3c85d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:56.573285 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-92904e32-b11e-41b9-a168-e0baa9130067 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] 10.222.0.42 "GET /compute/v2.1/servers/55e557ae-4057-4fb9-a753-45a08c602b71" status: 200 len: 1281 microversion: 2.1 time: 0.135355 Oct 23 01:29:56.573285 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2200/4481] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:56 2022] GET /compute/v2.1/servers/55e557ae-4057-4fb9-a753-45a08c602b71 => generated 1281 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:56.625849 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cae0de90-e883-4efd-ab07-07bba4804846 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:56.634924 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cae0de90-e883-4efd-ab07-07bba4804846 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:56.636512 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cae0de90-e883-4efd-ab07-07bba4804846 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:56.637792 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cae0de90-e883-4efd-ab07-07bba4804846 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1721 microversion: 2.20 time: 0.276950 Oct 23 01:29:56.638507 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2282/4482] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:29:56 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1721 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:29:56.956197 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-979db4e4-da89-48e0-b223-eed920591984 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:56.957265 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-979db4e4-da89-48e0-b223-eed920591984 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: e0bb5109-7f58-469c-b403-057248427835] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:56.970569 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-979db4e4-da89-48e0-b223-eed920591984 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:56.970830 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-979db4e4-da89-48e0-b223-eed920591984 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:56.971399 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-979db4e4-da89-48e0-b223-eed920591984 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:56.973372 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-979db4e4-da89-48e0-b223-eed920591984 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:56.975472 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-979db4e4-da89-48e0-b223-eed920591984 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:56.976107 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-979db4e4-da89-48e0-b223-eed920591984 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:57.491201 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-979db4e4-da89-48e0-b223-eed920591984 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:57.505319 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-979db4e4-da89-48e0-b223-eed920591984 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835" status: 200 len: 1523 microversion: 2.1 time: 0.554160 Oct 23 01:29:57.510257 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2201/4483] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:56 2022] GET /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835 => generated 1523 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:57.605535 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c29e6cd6-2a17-4ce3-a9f5-2e89be052d5b tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:57.606192 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c29e6cd6-2a17-4ce3-a9f5-2e89be052d5b tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] [instance: 55e557ae-4057-4fb9-a753-45a08c602b71] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:57.621473 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c29e6cd6-2a17-4ce3-a9f5-2e89be052d5b tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:57.627258 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c29e6cd6-2a17-4ce3-a9f5-2e89be052d5b tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:57.627258 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c29e6cd6-2a17-4ce3-a9f5-2e89be052d5b tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:57.627258 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c29e6cd6-2a17-4ce3-a9f5-2e89be052d5b tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:57.627258 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c29e6cd6-2a17-4ce3-a9f5-2e89be052d5b tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:57.627258 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c29e6cd6-2a17-4ce3-a9f5-2e89be052d5b tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:57.664686 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-07037848-e854-4d7e-8f6e-4fdadc2ece80 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:57.665744 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-07037848-e854-4d7e-8f6e-4fdadc2ece80 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:57.675879 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-07037848-e854-4d7e-8f6e-4fdadc2ece80 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:57.677091 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-07037848-e854-4d7e-8f6e-4fdadc2ece80 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:57.677939 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-07037848-e854-4d7e-8f6e-4fdadc2ece80 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:57.679074 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-07037848-e854-4d7e-8f6e-4fdadc2ece80 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:57.679773 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-07037848-e854-4d7e-8f6e-4fdadc2ece80 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:57.680398 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-07037848-e854-4d7e-8f6e-4fdadc2ece80 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:57.784363 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c29e6cd6-2a17-4ce3-a9f5-2e89be052d5b tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7f0931fbb64e96868a0044b0c6c557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6df910969eb472b97fb3fe05a3c85d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:57.793346 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c29e6cd6-2a17-4ce3-a9f5-2e89be052d5b tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] 10.222.0.42 "GET /compute/v2.1/servers/55e557ae-4057-4fb9-a753-45a08c602b71" status: 200 len: 1329 microversion: 2.1 time: 0.193270 Oct 23 01:29:57.793966 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2283/4484] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:57 2022] GET /compute/v2.1/servers/55e557ae-4057-4fb9-a753-45a08c602b71 => generated 1329 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:57.971854 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-07037848-e854-4d7e-8f6e-4fdadc2ece80 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:57.981181 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-07037848-e854-4d7e-8f6e-4fdadc2ece80 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:57.982949 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-07037848-e854-4d7e-8f6e-4fdadc2ece80 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:57.984264 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-07037848-e854-4d7e-8f6e-4fdadc2ece80 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1721 microversion: 2.20 time: 0.324576 Oct 23 01:29:57.991538 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2202/4485] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:29:57 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1721 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:29:58.061157 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b629bd65-2096-4c28-9b8f-f4431cd62e53 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:58.062768 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b629bd65-2096-4c28-9b8f-f4431cd62e53 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:58.074406 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b629bd65-2096-4c28-9b8f-f4431cd62e53 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:58.080919 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b629bd65-2096-4c28-9b8f-f4431cd62e53 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:58.080919 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b629bd65-2096-4c28-9b8f-f4431cd62e53 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:58.080919 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b629bd65-2096-4c28-9b8f-f4431cd62e53 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:58.080919 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b629bd65-2096-4c28-9b8f-f4431cd62e53 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:58.080919 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b629bd65-2096-4c28-9b8f-f4431cd62e53 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:58.102350 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-b629bd65-2096-4c28-9b8f-f4431cd62e53 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] HTTP exception thrown: Instance c48a830d-d375-47f5-8c08-d721f856c8ca could not be found. Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b629bd65-2096-4c28-9b8f-f4431cd62e53 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Request method failure captured: Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca HTTP/1.1 Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJdVsAjvToj8KAhlGLVBInaL5ZF6Oz9kbUiy39SUtzwRVhAUzFfzRAcu9YuHjQAPTZfpTnw_wvEsXPB9cLPxlD_JcC7YNRTn2PCLYj1vVfxXgT-BRmb5wQiQPKikItMn-89VG5mfPfEQbGe0P3pcqb-trvm0utVmJxFKI0dt6fSMKwI Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 62a621d00a6b499f921337dda20b66bd Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-AttachVolumeTestJSON-1185041640 Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/62a621d00a6b499f921337dda20b66bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_62a621d00a6b499f921337dda20b66bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/62a621d00a6b499f921337dda20b66bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/62a621d00a6b499f921337dda20b66bd"}]}] Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-AttachVolumeTestJSON-1185041640 Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 62a621d00a6b499f921337dda20b66bd Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1185041640 Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-AttachVolumeTestJSON-1185041640-project Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 4ba4975d23874879b779282e5b9cecb0 Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-AttachVolumeTestJSON-1185041640-project Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: exception: Instance c48a830d-d375-47f5-8c08-d721f856c8ca could not be found. Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'c48a830d-d375-47f5-8c08-d721f856c8ca'} Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c48a830d-d375-47f5-8c08-d721f856c8ca could not be found. Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:29:58.114062 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:29:58.118947 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c48a830d-d375-47f5-8c08-d721f856c8ca could not be found. Oct 23 01:29:58.118947 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:29:58.118947 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:29:58.118947 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:29:58.118947 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:29:58.118947 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:29:58.118947 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:29:58.118947 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:29:58.118947 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:29:58.118947 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c48a830d-d375-47f5-8c08-d721f856c8ca could not be found. Oct 23 01:29:58.118947 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:29:58.121073 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b629bd65-2096-4c28-9b8f-f4431cd62e53 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Returning 404 to user: Instance c48a830d-d375-47f5-8c08-d721f856c8ca could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:29:58.122167 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b629bd65-2096-4c28-9b8f-f4431cd62e53 tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 404 len: 111 microversion: 2.1 time: 0.065199 Oct 23 01:29:58.123103 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2284/4486] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:29:58 2022] DELETE /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:29:58.133558 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5ec3886d-9129-426e-81ba-1c1cd1f7389e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:58.134397 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5ec3886d-9129-426e-81ba-1c1cd1f7389e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] [instance: c48a830d-d375-47f5-8c08-d721f856c8ca] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:58.140737 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5ec3886d-9129-426e-81ba-1c1cd1f7389e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:58.141245 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5ec3886d-9129-426e-81ba-1c1cd1f7389e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:58.141689 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5ec3886d-9129-426e-81ba-1c1cd1f7389e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:58.142492 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5ec3886d-9129-426e-81ba-1c1cd1f7389e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:58.142954 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5ec3886d-9129-426e-81ba-1c1cd1f7389e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:58.143386 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5ec3886d-9129-426e-81ba-1c1cd1f7389e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:58.173072 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-5ec3886d-9129-426e-81ba-1c1cd1f7389e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] HTTP exception thrown: Instance c48a830d-d375-47f5-8c08-d721f856c8ca could not be found. Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5ec3886d-9129-426e-81ba-1c1cd1f7389e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Request method failure captured: Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca HTTP/1.1 Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJdVsAjvToj8KAhlGLVBInaL5ZF6Oz9kbUiy39SUtzwRVhAUzFfzRAcu9YuHjQAPTZfpTnw_wvEsXPB9cLPxlD_JcC7YNRTn2PCLYj1vVfxXgT-BRmb5wQiQPKikItMn-89VG5mfPfEQbGe0P3pcqb-trvm0utVmJxFKI0dt6fSMKwI Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 62a621d00a6b499f921337dda20b66bd Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-AttachVolumeTestJSON-1185041640 Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/62a621d00a6b499f921337dda20b66bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_62a621d00a6b499f921337dda20b66bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/62a621d00a6b499f921337dda20b66bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/62a621d00a6b499f921337dda20b66bd"}]}] Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-AttachVolumeTestJSON-1185041640 Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 62a621d00a6b499f921337dda20b66bd Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1185041640 Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-AttachVolumeTestJSON-1185041640-project Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 4ba4975d23874879b779282e5b9cecb0 Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-AttachVolumeTestJSON-1185041640-project Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: exception: Instance c48a830d-d375-47f5-8c08-d721f856c8ca could not be found. Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'c48a830d-d375-47f5-8c08-d721f856c8ca'} Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c48a830d-d375-47f5-8c08-d721f856c8ca could not be found. Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c48a830d-d375-47f5-8c08-d721f856c8ca could not be found. Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:29:58.178753 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:29:58.183147 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:29:58.183147 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:29:58.183147 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:29:58.183147 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:29:58.183147 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:29:58.183147 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c48a830d-d375-47f5-8c08-d721f856c8ca could not be found. Oct 23 01:29:58.183147 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:29:58.184478 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5ec3886d-9129-426e-81ba-1c1cd1f7389e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] Returning 404 to user: Instance c48a830d-d375-47f5-8c08-d721f856c8ca could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:29:58.186022 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5ec3886d-9129-426e-81ba-1c1cd1f7389e tempest-AttachVolumeTestJSON-1185041640 tempest-AttachVolumeTestJSON-1185041640-project] 10.222.0.42 "GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca" status: 404 len: 111 microversion: 2.1 time: 0.058356 Oct 23 01:29:58.187272 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2203/4487] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:58 2022] GET /compute/v2.1/servers/c48a830d-d375-47f5-8c08-d721f856c8ca => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:29:58.543476 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-45eb525c-942b-4195-8b7f-4b04e46b4f66 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:58.543476 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-45eb525c-942b-4195-8b7f-4b04e46b4f66 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: e0bb5109-7f58-469c-b403-057248427835] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:58.545833 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-45eb525c-942b-4195-8b7f-4b04e46b4f66 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:58.546539 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-45eb525c-942b-4195-8b7f-4b04e46b4f66 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:58.547154 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-45eb525c-942b-4195-8b7f-4b04e46b4f66 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:58.548002 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-45eb525c-942b-4195-8b7f-4b04e46b4f66 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:58.548618 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-45eb525c-942b-4195-8b7f-4b04e46b4f66 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:58.549034 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-45eb525c-942b-4195-8b7f-4b04e46b4f66 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:58.826734 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-70f61bcd-921d-4a46-bce6-0fba32597927 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:58.829166 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-70f61bcd-921d-4a46-bce6-0fba32597927 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] [instance: 55e557ae-4057-4fb9-a753-45a08c602b71] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:58.837261 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-70f61bcd-921d-4a46-bce6-0fba32597927 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:58.838148 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-70f61bcd-921d-4a46-bce6-0fba32597927 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:58.839330 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-70f61bcd-921d-4a46-bce6-0fba32597927 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:58.840543 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-70f61bcd-921d-4a46-bce6-0fba32597927 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:58.841146 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-70f61bcd-921d-4a46-bce6-0fba32597927 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:58.841916 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-70f61bcd-921d-4a46-bce6-0fba32597927 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:59.028253 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-70f61bcd-921d-4a46-bce6-0fba32597927 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7f0931fbb64e96868a0044b0c6c557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6df910969eb472b97fb3fe05a3c85d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:59.041460 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-70f61bcd-921d-4a46-bce6-0fba32597927 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] 10.222.0.42 "GET /compute/v2.1/servers/55e557ae-4057-4fb9-a753-45a08c602b71" status: 200 len: 1347 microversion: 2.1 time: 0.219997 Oct 23 01:29:59.059851 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2204/4488] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:58 2022] GET /compute/v2.1/servers/55e557ae-4057-4fb9-a753-45a08c602b71 => generated 1347 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:29:59.075592 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3ca76312-98d2-49de-ad27-d2a96ac16b76 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:29:59.076465 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3ca76312-98d2-49de-ad27-d2a96ac16b76 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:29:59.085090 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-45eb525c-942b-4195-8b7f-4b04e46b4f66 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:59.104237 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-45eb525c-942b-4195-8b7f-4b04e46b4f66 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835" status: 200 len: 1523 microversion: 2.1 time: 0.574012 Oct 23 01:29:59.111024 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2285/4489] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:29:58 2022] GET /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835 => generated 1523 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:29:59.124440 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3ca76312-98d2-49de-ad27-d2a96ac16b76 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:59.124945 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3ca76312-98d2-49de-ad27-d2a96ac16b76 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:59.125383 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3ca76312-98d2-49de-ad27-d2a96ac16b76 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:59.132181 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3ca76312-98d2-49de-ad27-d2a96ac16b76 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:59.132773 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3ca76312-98d2-49de-ad27-d2a96ac16b76 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:59.133559 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3ca76312-98d2-49de-ad27-d2a96ac16b76 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:59.327377 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-a3d5aefb-2c76-4a83-b666-f1d3e8cd3e4a req-03c233da-1169-498c-8eb1-a9683873de00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6eb59b7-d1ee-442c-8142-19a88ad6a039", "name": "network-vif-deleted", "tag": "82e540c0-e210-47a2-a17d-495549fe7222"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:29:59.342617 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-a3d5aefb-2c76-4a83-b666-f1d3e8cd3e4a req-03c233da-1169-498c-8eb1-a9683873de00 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:29:59.344012 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-a3d5aefb-2c76-4a83-b666-f1d3e8cd3e4a req-03c233da-1169-498c-8eb1-a9683873de00 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:29:59.344691 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-a3d5aefb-2c76-4a83-b666-f1d3e8cd3e4a req-03c233da-1169-498c-8eb1-a9683873de00 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:29:59.359829 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3ca76312-98d2-49de-ad27-d2a96ac16b76 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:59.376534 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3ca76312-98d2-49de-ad27-d2a96ac16b76 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:59.379495 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-a3d5aefb-2c76-4a83-b666-f1d3e8cd3e4a req-03c233da-1169-498c-8eb1-a9683873de00 service nova] Creating event network-vif-deleted:82e540c0-e210-47a2-a17d-495549fe7222 for instance c6eb59b7-d1ee-442c-8142-19a88ad6a039 on n-h2-master-1 Oct 23 01:29:59.380663 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3ca76312-98d2-49de-ad27-d2a96ac16b76 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:29:59.382011 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3ca76312-98d2-49de-ad27-d2a96ac16b76 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1653 microversion: 2.20 time: 0.320304 Oct 23 01:29:59.384701 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2205/4490] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:29:59 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1653 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:29:59.391032 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-a3d5aefb-2c76-4a83-b666-f1d3e8cd3e4a req-03c233da-1169-498c-8eb1-a9683873de00 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067302 Oct 23 01:29:59.391032 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2286/4491] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:30:00.072695 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f66256ad-298e-48da-bf94-869d8bc7afb0 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:00.074224 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f66256ad-298e-48da-bf94-869d8bc7afb0 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] [instance: 55e557ae-4057-4fb9-a753-45a08c602b71] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:00.083207 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f66256ad-298e-48da-bf94-869d8bc7afb0 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:00.094615 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f66256ad-298e-48da-bf94-869d8bc7afb0 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:00.095470 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f66256ad-298e-48da-bf94-869d8bc7afb0 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:00.096404 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f66256ad-298e-48da-bf94-869d8bc7afb0 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:00.097197 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f66256ad-298e-48da-bf94-869d8bc7afb0 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:00.097858 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f66256ad-298e-48da-bf94-869d8bc7afb0 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:00.138390 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7bca2c86-c788-4224-b4a0-a90bd613a9dd tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:00.139275 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7bca2c86-c788-4224-b4a0-a90bd613a9dd tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: e0bb5109-7f58-469c-b403-057248427835] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:00.148163 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7bca2c86-c788-4224-b4a0-a90bd613a9dd tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:00.159561 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7bca2c86-c788-4224-b4a0-a90bd613a9dd tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:00.160389 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7bca2c86-c788-4224-b4a0-a90bd613a9dd tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:00.162207 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7bca2c86-c788-4224-b4a0-a90bd613a9dd tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:00.162907 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7bca2c86-c788-4224-b4a0-a90bd613a9dd tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:00.164418 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7bca2c86-c788-4224-b4a0-a90bd613a9dd tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:00.586072 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f66256ad-298e-48da-bf94-869d8bc7afb0 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7f0931fbb64e96868a0044b0c6c557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6df910969eb472b97fb3fe05a3c85d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:00.594411 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f66256ad-298e-48da-bf94-869d8bc7afb0 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] 10.222.0.42 "GET /compute/v2.1/servers/55e557ae-4057-4fb9-a753-45a08c602b71" status: 200 len: 1403 microversion: 2.1 time: 0.525482 Oct 23 01:30:00.610380 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2206/4492] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:00 2022] GET /compute/v2.1/servers/55e557ae-4057-4fb9-a753-45a08c602b71 => generated 1403 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:00.615887 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-26b30107-070a-4339-8852-a3cea7b082f7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:00.618476 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-26b30107-070a-4339-8852-a3cea7b082f7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:00.640397 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-26b30107-070a-4339-8852-a3cea7b082f7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:00.640397 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-26b30107-070a-4339-8852-a3cea7b082f7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:00.652329 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-26b30107-070a-4339-8852-a3cea7b082f7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:00.655953 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-26b30107-070a-4339-8852-a3cea7b082f7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:00.657539 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-26b30107-070a-4339-8852-a3cea7b082f7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:00.657539 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-26b30107-070a-4339-8852-a3cea7b082f7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:00.713214 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7bca2c86-c788-4224-b4a0-a90bd613a9dd tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:00.744906 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7bca2c86-c788-4224-b4a0-a90bd613a9dd tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835" status: 200 len: 1523 microversion: 2.1 time: 0.611717 Oct 23 01:30:00.752509 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2287/4493] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:00 2022] GET /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835 => generated 1523 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:30:00.767584 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-26b30107-070a-4339-8852-a3cea7b082f7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:00.783234 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-26b30107-070a-4339-8852-a3cea7b082f7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:00.783911 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-26b30107-070a-4339-8852-a3cea7b082f7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:00.793730 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-26b30107-070a-4339-8852-a3cea7b082f7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lazy-loading 'fault' on Instance uuid c6eb59b7-d1ee-442c-8142-19a88ad6a039 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:30:00.908533 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-26b30107-070a-4339-8852-a3cea7b082f7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:00.937964 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-26b30107-070a-4339-8852-a3cea7b082f7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:00.947131 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-26b30107-070a-4339-8852-a3cea7b082f7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:00.948930 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-26b30107-070a-4339-8852-a3cea7b082f7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 200 len: 1370 microversion: 2.20 time: 0.352922 Oct 23 01:30:00.950018 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2207/4494] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:30:00 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 1370 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:30:01.638451 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=10 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:01.645717 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4456c3bb-5490-4a24-ade4-f4f4cfb1637c tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:01.652125 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4456c3bb-5490-4a24-ade4-f4f4cfb1637c tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] [instance: 55e557ae-4057-4fb9-a753-45a08c602b71] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:01.678597 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4456c3bb-5490-4a24-ade4-f4f4cfb1637c tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:01.681285 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4456c3bb-5490-4a24-ade4-f4f4cfb1637c tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:01.686725 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4456c3bb-5490-4a24-ade4-f4f4cfb1637c tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:01.694504 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4456c3bb-5490-4a24-ade4-f4f4cfb1637c tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:01.696505 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4456c3bb-5490-4a24-ade4-f4f4cfb1637c tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:01.697433 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4456c3bb-5490-4a24-ade4-f4f4cfb1637c tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:01.760968 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:01.789278 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9b1bb211-c175-4938-b857-e09dc68e34f7 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:01.792185 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9b1bb211-c175-4938-b857-e09dc68e34f7 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: e0bb5109-7f58-469c-b403-057248427835] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:01.833876 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b1bb211-c175-4938-b857-e09dc68e34f7 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:01.834988 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b1bb211-c175-4938-b857-e09dc68e34f7 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:01.839308 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b1bb211-c175-4938-b857-e09dc68e34f7 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:01.843592 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b1bb211-c175-4938-b857-e09dc68e34f7 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:01.847819 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b1bb211-c175-4938-b857-e09dc68e34f7 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:01.857708 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b1bb211-c175-4938-b857-e09dc68e34f7 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:02.625003 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9b1bb211-c175-4938-b857-e09dc68e34f7 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:02.635594 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9b1bb211-c175-4938-b857-e09dc68e34f7 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835" status: 200 len: 1523 microversion: 2.1 time: 0.860200 Oct 23 01:30:02.639446 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2208/4495] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:01 2022] GET /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835 => generated 1523 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:30:02.644292 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5512dfa7-cb85-4cca-8a23-92eb235d886f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:02.645118 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5512dfa7-cb85-4cca-8a23-92eb235d886f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:02.655972 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5512dfa7-cb85-4cca-8a23-92eb235d886f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:02.660322 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5512dfa7-cb85-4cca-8a23-92eb235d886f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:02.660322 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5512dfa7-cb85-4cca-8a23-92eb235d886f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:02.660322 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5512dfa7-cb85-4cca-8a23-92eb235d886f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:02.660322 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5512dfa7-cb85-4cca-8a23-92eb235d886f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:02.661255 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5512dfa7-cb85-4cca-8a23-92eb235d886f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-5512dfa7-cb85-4cca-8a23-92eb235d886f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] HTTP exception thrown: Instance c6eb59b7-d1ee-442c-8142-19a88ad6a039 could not be found. Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5512dfa7-cb85-4cca-8a23-92eb235d886f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Request method failure captured: Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 HTTP/1.1 Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJgQM9ac_nigtGLK4LZKApOXoIiTORToGrfCQJAudkDegQhaUBSbLk4jPFxqWvc7WPMryaamEsgoumiKRsUdXg4p2qo9wiVzLKc_z19LEKedgAH8Ey2iIcc4F8p1F8DcpTrJ2hLsEbdK9ktQp2Y5kAAr_EcoR2XwA8yLtIahEXP4IdE Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: X-Openstack-Nova-Api-Version: 2.20 Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 4464938aec13451f910daa714d060e46 Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-517248460 Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4464938aec13451f910daa714d060e46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4464938aec13451f910daa714d060e46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4464938aec13451f910daa714d060e46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4464938aec13451f910daa714d060e46"}]}] Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-AttachVolumeShelveTestJSON-517248460 Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 4464938aec13451f910daa714d060e46 Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-517248460 Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-AttachVolumeShelveTestJSON-517248460-project Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 1864708a7b2f4223bc8f0015c765eb0f Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-AttachVolumeShelveTestJSON-517248460-project Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: exception: Instance c6eb59b7-d1ee-442c-8142-19a88ad6a039 could not be found. Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'c6eb59b7-d1ee-442c-8142-19a88ad6a039'} Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6eb59b7-d1ee-442c-8142-19a88ad6a039 could not be found. Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:30:02.691508 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:30:02.695127 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:30:02.695127 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6eb59b7-d1ee-442c-8142-19a88ad6a039 could not be found. Oct 23 01:30:02.695127 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:30:02.695127 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:30:02.695127 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:30:02.695127 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:30:02.695127 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:30:02.695127 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:30:02.695127 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:30:02.695127 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:30:02.695127 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6eb59b7-d1ee-442c-8142-19a88ad6a039 could not be found. Oct 23 01:30:02.695127 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:30:02.695127 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5512dfa7-cb85-4cca-8a23-92eb235d886f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Returning 404 to user: Instance c6eb59b7-d1ee-442c-8142-19a88ad6a039 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:30:02.695127 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5512dfa7-cb85-4cca-8a23-92eb235d886f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 404 len: 111 microversion: 2.20 time: 0.052021 Oct 23 01:30:02.695127 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2209/4496] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:30:02 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:30:02.703649 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4456c3bb-5490-4a24-ade4-f4f4cfb1637c tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7f0931fbb64e96868a0044b0c6c557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6df910969eb472b97fb3fe05a3c85d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:02.704819 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-8dfeb34f-3f8d-4444-80f8-b3a82added01 req-f2a0b4a3-57be-4f61-959c-006b5af95575 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55e557ae-4057-4fb9-a753-45a08c602b71", "tag": "e7316b18-a085-4766-be3a-3bb9f97ed9a9"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:30:02.713496 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4456c3bb-5490-4a24-ade4-f4f4cfb1637c tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] 10.222.0.42 "GET /compute/v2.1/servers/55e557ae-4057-4fb9-a753-45a08c602b71" status: 200 len: 1403 microversion: 2.1 time: 1.079517 Oct 23 01:30:02.721676 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-8dfeb34f-3f8d-4444-80f8-b3a82added01 req-f2a0b4a3-57be-4f61-959c-006b5af95575 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:02.722548 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-8dfeb34f-3f8d-4444-80f8-b3a82added01 req-f2a0b4a3-57be-4f61-959c-006b5af95575 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:02.725921 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-8dfeb34f-3f8d-4444-80f8-b3a82added01 req-f2a0b4a3-57be-4f61-959c-006b5af95575 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:02.730723 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2288/4497] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:01 2022] GET /compute/v2.1/servers/55e557ae-4057-4fb9-a753-45a08c602b71 => generated 1403 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:02.743984 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-8dfeb34f-3f8d-4444-80f8-b3a82added01 req-f2a0b4a3-57be-4f61-959c-006b5af95575 service nova] Creating event network-changed:e7316b18-a085-4766-be3a-3bb9f97ed9a9 for instance 55e557ae-4057-4fb9-a753-45a08c602b71 on n-h2-master-1 Oct 23 01:30:02.744637 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-652b23b7-3542-4cf3-959b-7e008b596fb4 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '.version_select at 0x7f5cc6151550>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:02.755749 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-8dfeb34f-3f8d-4444-80f8-b3a82added01 req-f2a0b4a3-57be-4f61-959c-006b5af95575 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056197 Oct 23 01:30:02.756899 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2210/4498] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:30:02.839771 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-652b23b7-3542-4cf3-959b-7e008b596fb4 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-690124222" status: 204 len: 0 microversion: 2.20 time: 0.107469 Oct 23 01:30:02.840394 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2289/4499] 10.222.0.42 () {60 vars in 1259 bytes} [Sun Oct 23 01:30:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-690124222 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 23 01:30:03.663017 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e0e57ade-155a-4dd9-aaa6-3db26df83d22 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:03.664373 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e0e57ade-155a-4dd9-aaa6-3db26df83d22 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: e0bb5109-7f58-469c-b403-057248427835] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:03.678982 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e0e57ade-155a-4dd9-aaa6-3db26df83d22 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:03.679731 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e0e57ade-155a-4dd9-aaa6-3db26df83d22 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:03.680325 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e0e57ade-155a-4dd9-aaa6-3db26df83d22 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:03.685578 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e0e57ade-155a-4dd9-aaa6-3db26df83d22 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:03.685578 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e0e57ade-155a-4dd9-aaa6-3db26df83d22 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:03.685578 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e0e57ade-155a-4dd9-aaa6-3db26df83d22 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:03.748616 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9981619a-fb66-4fec-8c6e-7975f57145e8 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:03.748616 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9981619a-fb66-4fec-8c6e-7975f57145e8 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] [instance: 55e557ae-4057-4fb9-a753-45a08c602b71] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:03.762742 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9981619a-fb66-4fec-8c6e-7975f57145e8 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:03.763247 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9981619a-fb66-4fec-8c6e-7975f57145e8 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:03.763691 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9981619a-fb66-4fec-8c6e-7975f57145e8 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:03.764392 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9981619a-fb66-4fec-8c6e-7975f57145e8 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:03.765072 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9981619a-fb66-4fec-8c6e-7975f57145e8 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:03.765664 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9981619a-fb66-4fec-8c6e-7975f57145e8 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:03.859118 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=12 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:03.890401 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=18 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:04.134292 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e0e57ade-155a-4dd9-aaa6-3db26df83d22 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:04.148760 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e0e57ade-155a-4dd9-aaa6-3db26df83d22 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835" status: 200 len: 1523 microversion: 2.1 time: 0.490830 Oct 23 01:30:04.149367 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2211/4500] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:03 2022] GET /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835 => generated 1523 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:04.239319 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9981619a-fb66-4fec-8c6e-7975f57145e8 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7f0931fbb64e96868a0044b0c6c557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6df910969eb472b97fb3fe05a3c85d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:04.254427 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9981619a-fb66-4fec-8c6e-7975f57145e8 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] 10.222.0.42 "GET /compute/v2.1/servers/55e557ae-4057-4fb9-a753-45a08c602b71" status: 200 len: 1403 microversion: 2.1 time: 0.512592 Oct 23 01:30:04.273162 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2290/4501] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:03 2022] GET /compute/v2.1/servers/55e557ae-4057-4fb9-a753-45a08c602b71 => generated 1403 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:05.040351 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4594ac9c-7ea2-4660-8f77-c2f1a8c93495 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Action: 'create', calling method: .version_select at 0x7f5cc163f040>, body: {"keypair": {"name": "tempest-keypair-1020806747", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbHWhaSlHaWHT37xHdvA+BPnZ3hQSbdt6mZxr9qN6oX3/Lv2YIO6SnftpaJQbSaAjDBII0soX6y55uFLgC8ovsaO1vAkeiInqtCk8MibtsvxMpDJnguy/uawJt3ADDzPg=="}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:30:05.048062 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:05.073920 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-4594ac9c-7ea2-4660-8f77-c2f1a8c93495 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Getting quotas for project 4464938aec13451f910daa714d060e46. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:30:05.088483 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-4594ac9c-7ea2-4660-8f77-c2f1a8c93495 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Getting quotas for user 1864708a7b2f4223bc8f0015c765eb0f and project 4464938aec13451f910daa714d060e46. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:30:05.172884 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f77a2945-456a-4f9f-be20-b86fd44010cb tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:05.174336 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f77a2945-456a-4f9f-be20-b86fd44010cb tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: e0bb5109-7f58-469c-b403-057248427835] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:05.186539 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4594ac9c-7ea2-4660-8f77-c2f1a8c93495 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.150057 Oct 23 01:30:05.193422 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2212/4502] 10.222.0.42 () {62 vars in 1200 bytes} [Sun Oct 23 01:30:05 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 152 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 23 01:30:05.195656 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f77a2945-456a-4f9f-be20-b86fd44010cb tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:05.200593 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f77a2945-456a-4f9f-be20-b86fd44010cb tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:05.201235 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f77a2945-456a-4f9f-be20-b86fd44010cb tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:05.209152 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f77a2945-456a-4f9f-be20-b86fd44010cb tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:05.209707 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f77a2945-456a-4f9f-be20-b86fd44010cb tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:05.210198 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f77a2945-456a-4f9f-be20-b86fd44010cb tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:05.285877 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8d249293-b6e2-446f-911b-93417ec064e3 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:05.286828 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8d249293-b6e2-446f-911b-93417ec064e3 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] [instance: 55e557ae-4057-4fb9-a753-45a08c602b71] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:05.304141 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d249293-b6e2-446f-911b-93417ec064e3 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:05.304907 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d249293-b6e2-446f-911b-93417ec064e3 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:05.305520 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d249293-b6e2-446f-911b-93417ec064e3 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:05.306339 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d249293-b6e2-446f-911b-93417ec064e3 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:05.306805 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d249293-b6e2-446f-911b-93417ec064e3 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:05.307235 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d249293-b6e2-446f-911b-93417ec064e3 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:05.410512 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=8 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:06.272682 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f77a2945-456a-4f9f-be20-b86fd44010cb tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:06.287801 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f77a2945-456a-4f9f-be20-b86fd44010cb tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835" status: 200 len: 1523 microversion: 2.1 time: 1.118839 Oct 23 01:30:06.309867 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2291/4503] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:05 2022] GET /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835 => generated 1523 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:30:06.439464 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8d249293-b6e2-446f-911b-93417ec064e3 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7f0931fbb64e96868a0044b0c6c557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6df910969eb472b97fb3fe05a3c85d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:06.454809 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8d249293-b6e2-446f-911b-93417ec064e3 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] 10.222.0.42 "GET /compute/v2.1/servers/55e557ae-4057-4fb9-a753-45a08c602b71" status: 200 len: 1403 microversion: 2.1 time: 1.176163 Oct 23 01:30:06.455645 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2213/4504] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:05 2022] GET /compute/v2.1/servers/55e557ae-4057-4fb9-a753-45a08c602b71 => generated 1403 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:30:07.315351 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5bc77557-d15c-4c06-932c-61c9697c9ac2 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:07.315351 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5bc77557-d15c-4c06-932c-61c9697c9ac2 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: e0bb5109-7f58-469c-b403-057248427835] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:07.334729 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5bc77557-d15c-4c06-932c-61c9697c9ac2 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:07.337863 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5bc77557-d15c-4c06-932c-61c9697c9ac2 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:07.340695 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5bc77557-d15c-4c06-932c-61c9697c9ac2 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:07.341672 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5bc77557-d15c-4c06-932c-61c9697c9ac2 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:07.342447 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5bc77557-d15c-4c06-932c-61c9697c9ac2 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:07.344598 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5bc77557-d15c-4c06-932c-61c9697c9ac2 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:07.481662 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0f67821c-e7f8-4c8b-8895-c079b86b9a24 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:07.482563 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0f67821c-e7f8-4c8b-8895-c079b86b9a24 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] [instance: 55e557ae-4057-4fb9-a753-45a08c602b71] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:07.496189 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0f67821c-e7f8-4c8b-8895-c079b86b9a24 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:07.496797 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0f67821c-e7f8-4c8b-8895-c079b86b9a24 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:07.497475 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0f67821c-e7f8-4c8b-8895-c079b86b9a24 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:07.498472 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0f67821c-e7f8-4c8b-8895-c079b86b9a24 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:07.499148 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0f67821c-e7f8-4c8b-8895-c079b86b9a24 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:07.499777 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0f67821c-e7f8-4c8b-8895-c079b86b9a24 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:07.918633 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5bc77557-d15c-4c06-932c-61c9697c9ac2 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:07.939454 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5bc77557-d15c-4c06-932c-61c9697c9ac2 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835" status: 200 len: 1523 microversion: 2.1 time: 0.631203 Oct 23 01:30:07.956657 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2292/4505] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:07 2022] GET /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835 => generated 1523 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:07.958561 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0f67821c-e7f8-4c8b-8895-c079b86b9a24 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7f0931fbb64e96868a0044b0c6c557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6df910969eb472b97fb3fe05a3c85d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:07.970458 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0f67821c-e7f8-4c8b-8895-c079b86b9a24 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] 10.222.0.42 "GET /compute/v2.1/servers/55e557ae-4057-4fb9-a753-45a08c602b71" status: 200 len: 1403 microversion: 2.1 time: 0.489881 Oct 23 01:30:07.971144 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2214/4506] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:07 2022] GET /compute/v2.1/servers/55e557ae-4057-4fb9-a753-45a08c602b71 => generated 1403 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:08.965929 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7cdad26a-9c2b-4257-a222-8d6c7b47c86a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:08.970002 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7cdad26a-9c2b-4257-a222-8d6c7b47c86a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: e0bb5109-7f58-469c-b403-057248427835] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:08.984505 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7cdad26a-9c2b-4257-a222-8d6c7b47c86a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:08.985754 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7cdad26a-9c2b-4257-a222-8d6c7b47c86a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:08.986627 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7cdad26a-9c2b-4257-a222-8d6c7b47c86a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:08.988612 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7cdad26a-9c2b-4257-a222-8d6c7b47c86a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:08.990124 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7cdad26a-9c2b-4257-a222-8d6c7b47c86a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:08.990124 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7cdad26a-9c2b-4257-a222-8d6c7b47c86a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:08.997074 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-83431cbd-ace9-40e7-b2ef-010095c26e62 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:08.997693 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-83431cbd-ace9-40e7-b2ef-010095c26e62 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] [instance: 55e557ae-4057-4fb9-a753-45a08c602b71] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:09.008333 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83431cbd-ace9-40e7-b2ef-010095c26e62 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:09.011542 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83431cbd-ace9-40e7-b2ef-010095c26e62 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:09.012394 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83431cbd-ace9-40e7-b2ef-010095c26e62 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:09.014522 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83431cbd-ace9-40e7-b2ef-010095c26e62 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:09.017136 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83431cbd-ace9-40e7-b2ef-010095c26e62 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:09.017730 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83431cbd-ace9-40e7-b2ef-010095c26e62 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:09.864290 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-83431cbd-ace9-40e7-b2ef-010095c26e62 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7f0931fbb64e96868a0044b0c6c557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6df910969eb472b97fb3fe05a3c85d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:09.884535 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-83431cbd-ace9-40e7-b2ef-010095c26e62 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] 10.222.0.42 "GET /compute/v2.1/servers/55e557ae-4057-4fb9-a753-45a08c602b71" status: 200 len: 1403 microversion: 2.1 time: 0.882309 Oct 23 01:30:09.891867 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2215/4507] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:08 2022] GET /compute/v2.1/servers/55e557ae-4057-4fb9-a753-45a08c602b71 => generated 1403 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:09.972169 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7cdad26a-9c2b-4257-a222-8d6c7b47c86a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:09.984379 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7cdad26a-9c2b-4257-a222-8d6c7b47c86a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835" status: 200 len: 1523 microversion: 2.1 time: 1.021124 Oct 23 01:30:09.988750 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2293/4508] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:08 2022] GET /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835 => generated 1523 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:10.087829 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-1e673221-a693-4385-b895-5542a4da925b req-371f2bfe-005a-48e9-860a-522818695e13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55e557ae-4057-4fb9-a753-45a08c602b71", "name": "network-vif-plugged", "status": "completed", "tag": "e7316b18-a085-4766-be3a-3bb9f97ed9a9"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:30:10.131190 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-1e673221-a693-4385-b895-5542a4da925b req-371f2bfe-005a-48e9-860a-522818695e13 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:10.134372 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-1e673221-a693-4385-b895-5542a4da925b req-371f2bfe-005a-48e9-860a-522818695e13 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:10.134372 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-1e673221-a693-4385-b895-5542a4da925b req-371f2bfe-005a-48e9-860a-522818695e13 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:10.185083 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-1e673221-a693-4385-b895-5542a4da925b req-371f2bfe-005a-48e9-860a-522818695e13 service nova] Creating event network-vif-plugged:e7316b18-a085-4766-be3a-3bb9f97ed9a9 for instance 55e557ae-4057-4fb9-a753-45a08c602b71 on n-h2-master-1 Oct 23 01:30:10.221291 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-1e673221-a693-4385-b895-5542a4da925b req-371f2bfe-005a-48e9-860a-522818695e13 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146281 Oct 23 01:30:10.225596 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2216/4509] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:30:10.859667 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2a71f07d-6b7d-4502-8190-b9833d764d63 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-358690727", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a8d88ca8-59e1-4c08-ac51-8d1481c432f4"}], "security_groups": [{"name": "tempest-securitygroup--298518010"}], "key_name": "tempest-keypair-1020806747", "user_data": "}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:30:10.917523 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-398fe488-bba0-494c-9705-14acd1fe8000 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:10.918022 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-398fe488-bba0-494c-9705-14acd1fe8000 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] [instance: 55e557ae-4057-4fb9-a753-45a08c602b71] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:10.935224 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-398fe488-bba0-494c-9705-14acd1fe8000 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:10.935857 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-398fe488-bba0-494c-9705-14acd1fe8000 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:10.936402 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-398fe488-bba0-494c-9705-14acd1fe8000 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:10.937215 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-398fe488-bba0-494c-9705-14acd1fe8000 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:10.940988 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-398fe488-bba0-494c-9705-14acd1fe8000 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:10.941562 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-398fe488-bba0-494c-9705-14acd1fe8000 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:10.967065 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=100 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:11.145769 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-2a71f07d-6b7d-4502-8190-b9833d764d63 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] validate_networks() for [('a8d88ca8-59e1-4c08-ac51-8d1481c432f4', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:30:11.265035 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-398fe488-bba0-494c-9705-14acd1fe8000 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7f0931fbb64e96868a0044b0c6c557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6df910969eb472b97fb3fe05a3c85d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:11.273409 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-398fe488-bba0-494c-9705-14acd1fe8000 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] 10.222.0.42 "GET /compute/v2.1/servers/55e557ae-4057-4fb9-a753-45a08c602b71" status: 200 len: 1403 microversion: 2.1 time: 0.361147 Oct 23 01:30:11.274028 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2217/4510] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:10 2022] GET /compute/v2.1/servers/55e557ae-4057-4fb9-a753-45a08c602b71 => generated 1403 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:30:11.546789 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-628b8bef-5f71-4649-899f-b4770f8f751b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-975250633", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "54c8030f-5807-4507-8aa3-283b114a73f4"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:30:11.658446 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-628b8bef-5f71-4649-899f-b4770f8f751b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] validate_networks() for [('54c8030f-5807-4507-8aa3-283b114a73f4', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:30:11.929996 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-2a71f07d-6b7d-4502-8190-b9833d764d63 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:30:11.933738 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-2a71f07d-6b7d-4502-8190-b9833d764d63 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:30:11.933738 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-2a71f07d-6b7d-4502-8190-b9833d764d63 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:30:11.933738 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-2a71f07d-6b7d-4502-8190-b9833d764d63 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:30:11.933738 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-2a71f07d-6b7d-4502-8190-b9833d764d63 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:30:11.946564 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a71f07d-6b7d-4502-8190-b9833d764d63 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:11.947902 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a71f07d-6b7d-4502-8190-b9833d764d63 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:11.948575 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a71f07d-6b7d-4502-8190-b9833d764d63 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:11.950278 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a71f07d-6b7d-4502-8190-b9833d764d63 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:11.951211 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a71f07d-6b7d-4502-8190-b9833d764d63 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:11.956372 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a71f07d-6b7d-4502-8190-b9833d764d63 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:11.987491 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-2a71f07d-6b7d-4502-8190-b9833d764d63 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Getting quotas for project 4464938aec13451f910daa714d060e46. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:30:11.994205 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-2a71f07d-6b7d-4502-8190-b9833d764d63 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Getting quotas for user 1864708a7b2f4223bc8f0015c765eb0f and project 4464938aec13451f910daa714d060e46. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:30:12.008673 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2a71f07d-6b7d-4502-8190-b9833d764d63 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:30:12.011165 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2a71f07d-6b7d-4502-8190-b9833d764d63 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:30:12.253114 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2a71f07d-6b7d-4502-8190-b9833d764d63 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.397889 Oct 23 01:30:12.254236 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2294/4511] 10.222.0.42 () {62 vars in 1188 bytes} [Sun Oct 23 01:30:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 1400 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 23 01:30:12.259377 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cf8916c6-820d-46fd-b900-f99ed9306a55 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:12.260072 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-cf8916c6-820d-46fd-b900-f99ed9306a55 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: e0bb5109-7f58-469c-b403-057248427835] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:12.275267 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf8916c6-820d-46fd-b900-f99ed9306a55 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:12.275995 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf8916c6-820d-46fd-b900-f99ed9306a55 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:12.303963 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf8916c6-820d-46fd-b900-f99ed9306a55 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:12.306800 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf8916c6-820d-46fd-b900-f99ed9306a55 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:12.307472 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf8916c6-820d-46fd-b900-f99ed9306a55 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:12.309760 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf8916c6-820d-46fd-b900-f99ed9306a55 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:12.551007 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-628b8bef-5f71-4649-899f-b4770f8f751b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:30:12.551007 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-628b8bef-5f71-4649-899f-b4770f8f751b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:30:12.551007 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-628b8bef-5f71-4649-899f-b4770f8f751b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:30:12.551007 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-628b8bef-5f71-4649-899f-b4770f8f751b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:30:12.551007 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-628b8bef-5f71-4649-899f-b4770f8f751b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:30:12.568701 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-628b8bef-5f71-4649-899f-b4770f8f751b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:12.569197 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-628b8bef-5f71-4649-899f-b4770f8f751b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:12.569638 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-628b8bef-5f71-4649-899f-b4770f8f751b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:12.575024 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-628b8bef-5f71-4649-899f-b4770f8f751b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:12.575024 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-628b8bef-5f71-4649-899f-b4770f8f751b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:12.575024 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-628b8bef-5f71-4649-899f-b4770f8f751b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:12.623106 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-628b8bef-5f71-4649-899f-b4770f8f751b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Getting quotas for project e2ee2ea8399e42a5a5cd0d0ddeb192b5. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:30:12.635893 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-628b8bef-5f71-4649-899f-b4770f8f751b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Getting quotas for user 77197152ea5040bab602d5381d21341a and project e2ee2ea8399e42a5a5cd0d0ddeb192b5. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:30:12.667306 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-628b8bef-5f71-4649-899f-b4770f8f751b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:30:12.669662 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-628b8bef-5f71-4649-899f-b4770f8f751b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 9540f923-c640-45de-a49a-26008adab3ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:30:12.794902 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cf8916c6-820d-46fd-b900-f99ed9306a55 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:12.803767 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cf8916c6-820d-46fd-b900-f99ed9306a55 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835" status: 200 len: 1500 microversion: 2.1 time: 0.548291 Oct 23 01:30:12.804385 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2295/4512] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:12 2022] GET /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835 => generated 1500 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:12.809158 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3c72ea7d-fe1b-4b81-aa3b-d6643c7a1fa3 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:12.810079 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3c72ea7d-fe1b-4b81-aa3b-d6643c7a1fa3 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:12.916417 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3c72ea7d-fe1b-4b81-aa3b-d6643c7a1fa3 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:12.925005 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3c72ea7d-fe1b-4b81-aa3b-d6643c7a1fa3 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:12.926500 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3c72ea7d-fe1b-4b81-aa3b-d6643c7a1fa3 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:12.928142 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3c72ea7d-fe1b-4b81-aa3b-d6643c7a1fa3 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1281 microversion: 2.20 time: 0.122584 Oct 23 01:30:12.928715 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2296/4513] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:30:12 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1281 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:30:12.948061 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-09ab878e-89eb-44a6-86d3-d507a38f1a09 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:12.948687 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-09ab878e-89eb-44a6-86d3-d507a38f1a09 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] [instance: 55e557ae-4057-4fb9-a753-45a08c602b71] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:12.967201 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-09ab878e-89eb-44a6-86d3-d507a38f1a09 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:12.967921 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-09ab878e-89eb-44a6-86d3-d507a38f1a09 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:12.968535 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-09ab878e-89eb-44a6-86d3-d507a38f1a09 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:12.969234 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-09ab878e-89eb-44a6-86d3-d507a38f1a09 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:12.970109 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-09ab878e-89eb-44a6-86d3-d507a38f1a09 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:12.970762 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-09ab878e-89eb-44a6-86d3-d507a38f1a09 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:13.016300 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-628b8bef-5f71-4649-899f-b4770f8f751b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.723355 Oct 23 01:30:13.032610 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2218/4514] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:30:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:30:13.081709 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bd774ec8-2c0f-42e2-9230-e17a3a66bc77 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:13.103441 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bd774ec8-2c0f-42e2-9230-e17a3a66bc77 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:13.103441 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-bd774ec8-2c0f-42e2-9230-e17a3a66bc77 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19'} {{(pid=120945) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 23 01:30:13.123777 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd774ec8-2c0f-42e2-9230-e17a3a66bc77 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:13.125031 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd774ec8-2c0f-42e2-9230-e17a3a66bc77 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:13.125470 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd774ec8-2c0f-42e2-9230-e17a3a66bc77 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:13.130667 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd774ec8-2c0f-42e2-9230-e17a3a66bc77 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:13.130667 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd774ec8-2c0f-42e2-9230-e17a3a66bc77 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:13.130667 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd774ec8-2c0f-42e2-9230-e17a3a66bc77 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:13.173138 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.multi_cell_list [None req-bd774ec8-2c0f-42e2-9230-e17a3a66bc77 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120945) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 23 01:30:13.212448 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bd774ec8-2c0f-42e2-9230-e17a3a66bc77 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.168618 Oct 23 01:30:13.213613 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2219/4515] 10.222.0.42 () {58 vars in 1154 bytes} [Sun Oct 23 01:30:13 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:30:13.238678 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-23bb2a8c-d546-400a-accb-57c7577f50b4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:13.239573 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-23bb2a8c-d546-400a-accb-57c7577f50b4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 9540f923-c640-45de-a49a-26008adab3ca] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:13.365994 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-23bb2a8c-d546-400a-accb-57c7577f50b4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:13.384521 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-23bb2a8c-d546-400a-accb-57c7577f50b4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/9540f923-c640-45de-a49a-26008adab3ca" status: 200 len: 1192 microversion: 2.1 time: 0.159771 Oct 23 01:30:13.384521 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2220/4516] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:13 2022] GET /compute/v2.1/servers/9540f923-c640-45de-a49a-26008adab3ca => generated 1192 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:13.393044 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-50ecafcd-3fa8-42e7-85e4-9d5d073992d5 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:30:13.412769 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-50ecafcd-3fa8-42e7-85e4-9d5d073992d5 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:13.413624 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-50ecafcd-3fa8-42e7-85e4-9d5d073992d5 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:13.414302 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-50ecafcd-3fa8-42e7-85e4-9d5d073992d5 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:13.432253 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-09ab878e-89eb-44a6-86d3-d507a38f1a09 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7f0931fbb64e96868a0044b0c6c557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6df910969eb472b97fb3fe05a3c85d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:13.445173 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-09ab878e-89eb-44a6-86d3-d507a38f1a09 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] 10.222.0.42 "GET /compute/v2.1/servers/55e557ae-4057-4fb9-a753-45a08c602b71" status: 200 len: 1588 microversion: 2.1 time: 0.500893 Oct 23 01:30:13.464726 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2297/4517] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:12 2022] GET /compute/v2.1/servers/55e557ae-4057-4fb9-a753-45a08c602b71 => generated 1588 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:13.489135 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2364a0bd-ee9c-412c-bb19-44561de4e167 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:13.489779 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2364a0bd-ee9c-412c-bb19-44561de4e167 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] [instance: 55e557ae-4057-4fb9-a753-45a08c602b71] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:13.519771 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2364a0bd-ee9c-412c-bb19-44561de4e167 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:13.524853 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-50ecafcd-3fa8-42e7-85e4-9d5d073992d5 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: e0bb5109-7f58-469c-b403-057248427835] Going to try to start instance {{(pid=120945) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 23 01:30:13.525791 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2364a0bd-ee9c-412c-bb19-44561de4e167 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:13.529091 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2364a0bd-ee9c-412c-bb19-44561de4e167 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:13.530505 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2364a0bd-ee9c-412c-bb19-44561de4e167 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:13.531343 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2364a0bd-ee9c-412c-bb19-44561de4e167 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:13.532089 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2364a0bd-ee9c-412c-bb19-44561de4e167 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:13.864269 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-50ecafcd-3fa8-42e7-85e4-9d5d073992d5 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "POST /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835/action" status: 202 len: 0 microversion: 2.1 time: 0.482416 Oct 23 01:30:13.866081 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2221/4518] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:30:13 2022] POST /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835/action => generated 0 bytes in 486 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:30:13.903529 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ac2dd5a8-419d-45bd-b895-0792ac58d6ce tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:13.903529 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ac2dd5a8-419d-45bd-b895-0792ac58d6ce tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: e0bb5109-7f58-469c-b403-057248427835] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:13.903529 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ac2dd5a8-419d-45bd-b895-0792ac58d6ce tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:13.903529 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ac2dd5a8-419d-45bd-b895-0792ac58d6ce tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:13.903529 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ac2dd5a8-419d-45bd-b895-0792ac58d6ce tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:13.903529 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ac2dd5a8-419d-45bd-b895-0792ac58d6ce tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:13.906007 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ac2dd5a8-419d-45bd-b895-0792ac58d6ce tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:13.909541 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ac2dd5a8-419d-45bd-b895-0792ac58d6ce tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:13.959315 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2364a0bd-ee9c-412c-bb19-44561de4e167 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] 10.222.0.42 "GET /compute/v2.1/servers/55e557ae-4057-4fb9-a753-45a08c602b71/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.492242 Oct 23 01:30:13.960126 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2298/4519] 10.222.0.42 () {58 vars in 1275 bytes} [Sun Oct 23 01:30:13 2022] GET /compute/v2.1/servers/55e557ae-4057-4fb9-a753-45a08c602b71/os-interface => generated 284 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:30:13.965111 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4c355929-84b0-47d8-9118-94231912183e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:13.965961 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4c355929-84b0-47d8-9118-94231912183e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:13.977383 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4c355929-84b0-47d8-9118-94231912183e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:13.979595 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4c355929-84b0-47d8-9118-94231912183e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:13.980070 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4c355929-84b0-47d8-9118-94231912183e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:13.984225 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4c355929-84b0-47d8-9118-94231912183e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:13.984937 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4c355929-84b0-47d8-9118-94231912183e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:13.989044 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4c355929-84b0-47d8-9118-94231912183e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:14.177676 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4c355929-84b0-47d8-9118-94231912183e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:14.186063 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4c355929-84b0-47d8-9118-94231912183e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:14.187518 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4c355929-84b0-47d8-9118-94231912183e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:14.188646 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4c355929-84b0-47d8-9118-94231912183e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1285 microversion: 2.20 time: 0.227271 Oct 23 01:30:14.189209 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2299/4520] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:30:13 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1285 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:30:14.400686 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-026d94c3-4d52-4405-bf28-6b55913440e6 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:14.401385 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-026d94c3-4d52-4405-bf28-6b55913440e6 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 9540f923-c640-45de-a49a-26008adab3ca] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:14.648874 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-026d94c3-4d52-4405-bf28-6b55913440e6 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:14.672570 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-026d94c3-4d52-4405-bf28-6b55913440e6 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/9540f923-c640-45de-a49a-26008adab3ca" status: 200 len: 1192 microversion: 2.1 time: 0.273771 Oct 23 01:30:14.675166 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2300/4521] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:14 2022] GET /compute/v2.1/servers/9540f923-c640-45de-a49a-26008adab3ca => generated 1192 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:14.831120 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ac2dd5a8-419d-45bd-b895-0792ac58d6ce tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:14.847376 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ac2dd5a8-419d-45bd-b895-0792ac58d6ce tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835" status: 200 len: 1509 microversion: 2.1 time: 0.972433 Oct 23 01:30:14.847998 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2222/4522] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:13 2022] GET /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835 => generated 1509 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:15.223903 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-22323d00-4bc8-4ecd-9ada-17ae412386bc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:15.224811 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-22323d00-4bc8-4ecd-9ada-17ae412386bc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:15.239537 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-22323d00-4bc8-4ecd-9ada-17ae412386bc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:15.242604 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-22323d00-4bc8-4ecd-9ada-17ae412386bc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:15.244088 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-22323d00-4bc8-4ecd-9ada-17ae412386bc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:15.246125 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-22323d00-4bc8-4ecd-9ada-17ae412386bc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:15.247897 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-22323d00-4bc8-4ecd-9ada-17ae412386bc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:15.248615 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-22323d00-4bc8-4ecd-9ada-17ae412386bc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:15.481892 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-22323d00-4bc8-4ecd-9ada-17ae412386bc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:15.495707 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-22323d00-4bc8-4ecd-9ada-17ae412386bc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:15.504501 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-22323d00-4bc8-4ecd-9ada-17ae412386bc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:15.505946 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-22323d00-4bc8-4ecd-9ada-17ae412386bc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1333 microversion: 2.20 time: 0.287295 Oct 23 01:30:15.506549 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2301/4523] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:30:15 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1333 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:30:15.702901 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e41e2976-de54-4250-8465-ccabf9ae10ec tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:15.704332 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e41e2976-de54-4250-8465-ccabf9ae10ec tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 9540f923-c640-45de-a49a-26008adab3ca] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:15.716286 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e41e2976-de54-4250-8465-ccabf9ae10ec tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:15.717076 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e41e2976-de54-4250-8465-ccabf9ae10ec tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:15.717686 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e41e2976-de54-4250-8465-ccabf9ae10ec tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:15.718669 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e41e2976-de54-4250-8465-ccabf9ae10ec tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:15.719348 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e41e2976-de54-4250-8465-ccabf9ae10ec tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:15.720213 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e41e2976-de54-4250-8465-ccabf9ae10ec tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:15.853758 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e41e2976-de54-4250-8465-ccabf9ae10ec tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:15.867819 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e41e2976-de54-4250-8465-ccabf9ae10ec tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/9540f923-c640-45de-a49a-26008adab3ca" status: 200 len: 1196 microversion: 2.1 time: 0.171275 Oct 23 01:30:15.868425 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2223/4524] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:15 2022] GET /compute/v2.1/servers/9540f923-c640-45de-a49a-26008adab3ca => generated 1196 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:15.894372 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-83cd8992-27b1-4003-9250-d7e58c180462 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:15.894372 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-83cd8992-27b1-4003-9250-d7e58c180462 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: e0bb5109-7f58-469c-b403-057248427835] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:15.899178 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-83cd8992-27b1-4003-9250-d7e58c180462 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:15.901166 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-83cd8992-27b1-4003-9250-d7e58c180462 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:15.901780 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-83cd8992-27b1-4003-9250-d7e58c180462 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:15.902913 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-83cd8992-27b1-4003-9250-d7e58c180462 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:15.903549 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-83cd8992-27b1-4003-9250-d7e58c180462 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:15.904161 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-83cd8992-27b1-4003-9250-d7e58c180462 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:16.542086 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-83cd8992-27b1-4003-9250-d7e58c180462 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:16.553107 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-89d0921f-b3f8-4e38-9279-fa756864da2a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:16.557385 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-89d0921f-b3f8-4e38-9279-fa756864da2a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:16.569084 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-89d0921f-b3f8-4e38-9279-fa756864da2a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:16.569869 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-89d0921f-b3f8-4e38-9279-fa756864da2a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:16.570486 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-89d0921f-b3f8-4e38-9279-fa756864da2a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:16.571366 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-89d0921f-b3f8-4e38-9279-fa756864da2a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:16.571767 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-83cd8992-27b1-4003-9250-d7e58c180462 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835" status: 200 len: 1509 microversion: 2.1 time: 0.689035 Oct 23 01:30:16.572282 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-89d0921f-b3f8-4e38-9279-fa756864da2a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:16.572407 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2302/4525] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:15 2022] GET /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835 => generated 1509 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:16.572968 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-89d0921f-b3f8-4e38-9279-fa756864da2a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:16.895755 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2bafd905-87b3-49c1-891d-5dc4b4bf4d59 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:16.897039 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2bafd905-87b3-49c1-891d-5dc4b4bf4d59 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 9540f923-c640-45de-a49a-26008adab3ca] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:16.905006 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2bafd905-87b3-49c1-891d-5dc4b4bf4d59 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:16.905764 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2bafd905-87b3-49c1-891d-5dc4b4bf4d59 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:16.906400 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2bafd905-87b3-49c1-891d-5dc4b4bf4d59 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:16.907298 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2bafd905-87b3-49c1-891d-5dc4b4bf4d59 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:16.907927 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2bafd905-87b3-49c1-891d-5dc4b4bf4d59 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:16.908527 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2bafd905-87b3-49c1-891d-5dc4b4bf4d59 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:17.050994 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-89d0921f-b3f8-4e38-9279-fa756864da2a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:17.060753 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-89d0921f-b3f8-4e38-9279-fa756864da2a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:17.062735 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-89d0921f-b3f8-4e38-9279-fa756864da2a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:17.064197 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-89d0921f-b3f8-4e38-9279-fa756864da2a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1351 microversion: 2.20 time: 0.530571 Oct 23 01:30:17.065378 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2224/4526] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:30:16 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1351 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:30:17.145424 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2bafd905-87b3-49c1-891d-5dc4b4bf4d59 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:17.183611 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2bafd905-87b3-49c1-891d-5dc4b4bf4d59 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/9540f923-c640-45de-a49a-26008adab3ca" status: 200 len: 1244 microversion: 2.1 time: 0.284326 Oct 23 01:30:17.198143 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2303/4527] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:16 2022] GET /compute/v2.1/servers/9540f923-c640-45de-a49a-26008adab3ca => generated 1244 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:17.602483 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-92806646-623b-4f99-bc13-827c154db520 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:17.603152 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-92806646-623b-4f99-bc13-827c154db520 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: e0bb5109-7f58-469c-b403-057248427835] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:17.625699 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-92806646-623b-4f99-bc13-827c154db520 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:17.626492 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-92806646-623b-4f99-bc13-827c154db520 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:17.627099 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-92806646-623b-4f99-bc13-827c154db520 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:17.628536 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-92806646-623b-4f99-bc13-827c154db520 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:17.630977 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-92806646-623b-4f99-bc13-827c154db520 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:17.631741 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-92806646-623b-4f99-bc13-827c154db520 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:17.844080 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-421b7767-e8fe-4dde-bfc9-93ea5201bc64 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:17.845265 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-421b7767-e8fe-4dde-bfc9-93ea5201bc64 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] [instance: 55e557ae-4057-4fb9-a753-45a08c602b71] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:17.860323 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-421b7767-e8fe-4dde-bfc9-93ea5201bc64 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:17.861085 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-421b7767-e8fe-4dde-bfc9-93ea5201bc64 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:17.865465 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-421b7767-e8fe-4dde-bfc9-93ea5201bc64 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:17.866872 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-421b7767-e8fe-4dde-bfc9-93ea5201bc64 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:17.868604 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-421b7767-e8fe-4dde-bfc9-93ea5201bc64 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:17.873008 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-421b7767-e8fe-4dde-bfc9-93ea5201bc64 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:18.145361 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-92806646-623b-4f99-bc13-827c154db520 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:18.161317 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-92806646-623b-4f99-bc13-827c154db520 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835" status: 200 len: 1513 microversion: 2.1 time: 0.567013 Oct 23 01:30:18.161953 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2225/4528] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:17 2022] GET /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835 => generated 1513 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:18.172542 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-275adbf8-36be-4b8b-b398-22efa5d68ce8 req-49b582c0-9d97-48d5-aa1a-eacf33da98d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55e557ae-4057-4fb9-a753-45a08c602b71", "tag": "e7316b18-a085-4766-be3a-3bb9f97ed9a9"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:30:18.206984 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-275adbf8-36be-4b8b-b398-22efa5d68ce8 req-49b582c0-9d97-48d5-aa1a-eacf33da98d2 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:18.212199 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-275adbf8-36be-4b8b-b398-22efa5d68ce8 req-49b582c0-9d97-48d5-aa1a-eacf33da98d2 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:18.212974 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-275adbf8-36be-4b8b-b398-22efa5d68ce8 req-49b582c0-9d97-48d5-aa1a-eacf33da98d2 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:18.247259 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-421b7767-e8fe-4dde-bfc9-93ea5201bc64 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7f0931fbb64e96868a0044b0c6c557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6df910969eb472b97fb3fe05a3c85d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:18.260349 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-275adbf8-36be-4b8b-b398-22efa5d68ce8 req-49b582c0-9d97-48d5-aa1a-eacf33da98d2 service nova] Creating event network-changed:e7316b18-a085-4766-be3a-3bb9f97ed9a9 for instance 55e557ae-4057-4fb9-a753-45a08c602b71 on n-h2-master-1 Oct 23 01:30:18.264408 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-421b7767-e8fe-4dde-bfc9-93ea5201bc64 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] 10.222.0.42 "GET /compute/v2.1/servers/55e557ae-4057-4fb9-a753-45a08c602b71" status: 200 len: 1588 microversion: 2.1 time: 0.423868 Oct 23 01:30:18.272856 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-275adbf8-36be-4b8b-b398-22efa5d68ce8 req-49b582c0-9d97-48d5-aa1a-eacf33da98d2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109598 Oct 23 01:30:18.285176 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2226/4530] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:30:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:30:18.285469 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2304/4529] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:17 2022] GET /compute/v2.1/servers/55e557ae-4057-4fb9-a753-45a08c602b71 => generated 1588 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:18.293306 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d531d555-0e26-459f-a9fd-1af1b2d3fbfd tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:18.296187 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d531d555-0e26-459f-a9fd-1af1b2d3fbfd tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:18.311773 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-45663bff-1c66-4dde-8358-c6f119138e50 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:18.314846 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d531d555-0e26-459f-a9fd-1af1b2d3fbfd tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:18.317314 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d531d555-0e26-459f-a9fd-1af1b2d3fbfd tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:18.317928 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d531d555-0e26-459f-a9fd-1af1b2d3fbfd tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:18.322452 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d531d555-0e26-459f-a9fd-1af1b2d3fbfd tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:18.323133 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d531d555-0e26-459f-a9fd-1af1b2d3fbfd tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:18.323751 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d531d555-0e26-459f-a9fd-1af1b2d3fbfd tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:18.326049 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-45663bff-1c66-4dde-8358-c6f119138e50 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:18.329999 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.compute.servers [None req-45663bff-1c66-4dde-8358-c6f119138e50 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Removing options 'limit' from query {{(pid=120944) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 23 01:30:18.331962 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-45663bff-1c66-4dde-8358-c6f119138e50 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Searching by: {'deleted': False, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19'} {{(pid=120944) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 23 01:30:18.333511 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-45663bff-1c66-4dde-8358-c6f119138e50 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:18.345730 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-45663bff-1c66-4dde-8358-c6f119138e50 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:18.350581 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-45663bff-1c66-4dde-8358-c6f119138e50 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:18.351459 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-45663bff-1c66-4dde-8358-c6f119138e50 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:18.351940 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-45663bff-1c66-4dde-8358-c6f119138e50 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:18.352393 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-45663bff-1c66-4dde-8358-c6f119138e50 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:18.357286 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-45663bff-1c66-4dde-8358-c6f119138e50 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.076078 Oct 23 01:30:18.366606 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2305/4531] 10.222.0.42 () {58 vars in 1140 bytes} [Sun Oct 23 01:30:18 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:30:18.374208 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9090b09c-2b9e-4034-8bca-3702a364aebf tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:18.378127 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9090b09c-2b9e-4034-8bca-3702a364aebf tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 9540f923-c640-45de-a49a-26008adab3ca] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:18.383967 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9090b09c-2b9e-4034-8bca-3702a364aebf tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:18.385293 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9090b09c-2b9e-4034-8bca-3702a364aebf tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:18.385956 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9090b09c-2b9e-4034-8bca-3702a364aebf tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:18.387173 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9090b09c-2b9e-4034-8bca-3702a364aebf tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:18.387867 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9090b09c-2b9e-4034-8bca-3702a364aebf tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:18.389109 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9090b09c-2b9e-4034-8bca-3702a364aebf tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:18.682660 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d531d555-0e26-459f-a9fd-1af1b2d3fbfd tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:18.691985 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d531d555-0e26-459f-a9fd-1af1b2d3fbfd tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:18.693703 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d531d555-0e26-459f-a9fd-1af1b2d3fbfd tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:18.694869 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d531d555-0e26-459f-a9fd-1af1b2d3fbfd tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1339 microversion: 2.20 time: 0.416623 Oct 23 01:30:18.695448 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2227/4532] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:30:18 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1339 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:30:18.711091 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fd62f4f7-35ff-4e03-9c71-bbf0eb3ee92e tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:18.713805 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9090b09c-2b9e-4034-8bca-3702a364aebf tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:18.715382 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-fd62f4f7-35ff-4e03-9c71-bbf0eb3ee92e tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: e0bb5109-7f58-469c-b403-057248427835] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:18.727230 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9090b09c-2b9e-4034-8bca-3702a364aebf tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/9540f923-c640-45de-a49a-26008adab3ca" status: 200 len: 1250 microversion: 2.1 time: 0.358707 Oct 23 01:30:18.728253 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fd62f4f7-35ff-4e03-9c71-bbf0eb3ee92e tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:18.730388 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2306/4533] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:18 2022] GET /compute/v2.1/servers/9540f923-c640-45de-a49a-26008adab3ca => generated 1250 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:18.730502 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fd62f4f7-35ff-4e03-9c71-bbf0eb3ee92e tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:18.730502 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fd62f4f7-35ff-4e03-9c71-bbf0eb3ee92e tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:18.743616 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fd62f4f7-35ff-4e03-9c71-bbf0eb3ee92e tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:18.745670 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fd62f4f7-35ff-4e03-9c71-bbf0eb3ee92e tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:18.748628 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fd62f4f7-35ff-4e03-9c71-bbf0eb3ee92e tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:19.026434 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-fd62f4f7-35ff-4e03-9c71-bbf0eb3ee92e tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:19.035558 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fd62f4f7-35ff-4e03-9c71-bbf0eb3ee92e tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835" status: 200 len: 1513 microversion: 2.1 time: 0.330416 Oct 23 01:30:19.052957 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2228/4534] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:18 2022] GET /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835 => generated 1513 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:19.061709 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9efbce48-a669-4ad2-9261-48c6d3a21891 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:19.062276 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9efbce48-a669-4ad2-9261-48c6d3a21891 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: b4f3e58c-311d-4b8a-b231-67e8fbc8cd3e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:19.073386 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9efbce48-a669-4ad2-9261-48c6d3a21891 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:19.073887 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9efbce48-a669-4ad2-9261-48c6d3a21891 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:19.074352 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9efbce48-a669-4ad2-9261-48c6d3a21891 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:19.075062 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9efbce48-a669-4ad2-9261-48c6d3a21891 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:19.075681 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9efbce48-a669-4ad2-9261-48c6d3a21891 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:19.076037 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9efbce48-a669-4ad2-9261-48c6d3a21891 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:19.650232 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9efbce48-a669-4ad2-9261-48c6d3a21891 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:19.666547 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9efbce48-a669-4ad2-9261-48c6d3a21891 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/b4f3e58c-311d-4b8a-b231-67e8fbc8cd3e" status: 200 len: 1512 microversion: 2.1 time: 0.608033 Oct 23 01:30:19.671956 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2307/4535] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:19 2022] GET /compute/v2.1/servers/b4f3e58c-311d-4b8a-b231-67e8fbc8cd3e => generated 1512 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:19.696258 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bb43bea3-2563-4954-8f8d-04d0f65f8f99 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:19.697645 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-bb43bea3-2563-4954-8f8d-04d0f65f8f99 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: 79b6e08c-f496-40ee-b5ea-34392ac475ad] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:19.704694 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bb43bea3-2563-4954-8f8d-04d0f65f8f99 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:19.706038 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bb43bea3-2563-4954-8f8d-04d0f65f8f99 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:19.706641 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bb43bea3-2563-4954-8f8d-04d0f65f8f99 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:19.707545 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bb43bea3-2563-4954-8f8d-04d0f65f8f99 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:19.708160 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bb43bea3-2563-4954-8f8d-04d0f65f8f99 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:19.708765 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bb43bea3-2563-4954-8f8d-04d0f65f8f99 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:19.725390 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1dfaec5a-ea8b-482d-a9f4-e35604c2e269 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:19.726325 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1dfaec5a-ea8b-482d-a9f4-e35604c2e269 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:19.741011 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1dfaec5a-ea8b-482d-a9f4-e35604c2e269 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:19.741602 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1dfaec5a-ea8b-482d-a9f4-e35604c2e269 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:19.742306 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1dfaec5a-ea8b-482d-a9f4-e35604c2e269 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:19.743096 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1dfaec5a-ea8b-482d-a9f4-e35604c2e269 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:19.743691 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1dfaec5a-ea8b-482d-a9f4-e35604c2e269 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:19.744197 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1dfaec5a-ea8b-482d-a9f4-e35604c2e269 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:20.177462 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1dfaec5a-ea8b-482d-a9f4-e35604c2e269 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:20.178921 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bb43bea3-2563-4954-8f8d-04d0f65f8f99 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:20.196776 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1dfaec5a-ea8b-482d-a9f4-e35604c2e269 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:20.198579 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1dfaec5a-ea8b-482d-a9f4-e35604c2e269 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:20.199420 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bb43bea3-2563-4954-8f8d-04d0f65f8f99 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad" status: 200 len: 1511 microversion: 2.1 time: 0.511542 Oct 23 01:30:20.200111 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1dfaec5a-ea8b-482d-a9f4-e35604c2e269 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1406 microversion: 2.20 time: 0.479271 Oct 23 01:30:20.201558 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2308/4536] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:30:19 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1406 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:30:20.202725 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2229/4537] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:19 2022] GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad => generated 1511 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:20.219375 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5e31d3c4-17e9-4d9a-851a-b1e3f8fcaf5c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:20.220307 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5e31d3c4-17e9-4d9a-851a-b1e3f8fcaf5c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 9540f923-c640-45de-a49a-26008adab3ca] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:20.235372 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5e31d3c4-17e9-4d9a-851a-b1e3f8fcaf5c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:20.235658 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-03a0c57f-3129-4226-ad0b-be14a9e6a2e4 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:20.238659 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5e31d3c4-17e9-4d9a-851a-b1e3f8fcaf5c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:20.239980 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5e31d3c4-17e9-4d9a-851a-b1e3f8fcaf5c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:20.240902 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5e31d3c4-17e9-4d9a-851a-b1e3f8fcaf5c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:20.241584 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5e31d3c4-17e9-4d9a-851a-b1e3f8fcaf5c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:20.242228 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5e31d3c4-17e9-4d9a-851a-b1e3f8fcaf5c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:20.243980 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-03a0c57f-3129-4226-ad0b-be14a9e6a2e4 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:20.244988 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-03a0c57f-3129-4226-ad0b-be14a9e6a2e4 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Searching by: {'ip': '172.20.0.10', 'deleted': False, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19'} {{(pid=120945) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 23 01:30:20.699898 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-03a0c57f-3129-4226-ad0b-be14a9e6a2e4 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:20.701509 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-03a0c57f-3129-4226-ad0b-be14a9e6a2e4 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:20.702213 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-03a0c57f-3129-4226-ad0b-be14a9e6a2e4 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:20.703199 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-03a0c57f-3129-4226-ad0b-be14a9e6a2e4 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:20.703969 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-03a0c57f-3129-4226-ad0b-be14a9e6a2e4 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:20.704475 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-03a0c57f-3129-4226-ad0b-be14a9e6a2e4 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:20.830451 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5e31d3c4-17e9-4d9a-851a-b1e3f8fcaf5c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:20.842931 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.multi_cell_list [None req-03a0c57f-3129-4226-ad0b-be14a9e6a2e4 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120945) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 23 01:30:20.851160 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5e31d3c4-17e9-4d9a-851a-b1e3f8fcaf5c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/9540f923-c640-45de-a49a-26008adab3ca" status: 200 len: 1292 microversion: 2.1 time: 0.648178 Oct 23 01:30:20.854086 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2309/4538] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:20 2022] GET /compute/v2.1/servers/9540f923-c640-45de-a49a-26008adab3ca => generated 1292 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:20.913507 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-03a0c57f-3129-4226-ad0b-be14a9e6a2e4 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers?ip=172.20.0.10" status: 200 len: 346 microversion: 2.1 time: 0.682643 Oct 23 01:30:20.919710 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2230/4539] 10.222.0.42 () {58 vars in 1154 bytes} [Sun Oct 23 01:30:20 2022] GET /compute/v2.1/servers?ip=172.20.0.10 => generated 346 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:30:20.941386 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d109ed78-bb19-4af1-880d-f0d025e9e0cd tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:20.942009 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d109ed78-bb19-4af1-880d-f0d025e9e0cd tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: e0bb5109-7f58-469c-b403-057248427835] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:20.954802 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d109ed78-bb19-4af1-880d-f0d025e9e0cd tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:20.955369 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d109ed78-bb19-4af1-880d-f0d025e9e0cd tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:20.955817 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d109ed78-bb19-4af1-880d-f0d025e9e0cd tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:20.956546 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d109ed78-bb19-4af1-880d-f0d025e9e0cd tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:20.957008 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d109ed78-bb19-4af1-880d-f0d025e9e0cd tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:20.957442 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d109ed78-bb19-4af1-880d-f0d025e9e0cd tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:20.970690 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=100 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:21.234234 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d109ed78-bb19-4af1-880d-f0d025e9e0cd tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:21.245272 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2de9248f-713c-4ed3-9732-3507c650f2b6 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:21.245894 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2de9248f-713c-4ed3-9732-3507c650f2b6 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:21.254856 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2de9248f-713c-4ed3-9732-3507c650f2b6 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:21.257665 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2de9248f-713c-4ed3-9732-3507c650f2b6 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:21.258242 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d109ed78-bb19-4af1-880d-f0d025e9e0cd tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835" status: 200 len: 1513 microversion: 2.1 time: 0.322483 Oct 23 01:30:21.258416 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2de9248f-713c-4ed3-9732-3507c650f2b6 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:21.259073 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2de9248f-713c-4ed3-9732-3507c650f2b6 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:21.259538 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2de9248f-713c-4ed3-9732-3507c650f2b6 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:21.259927 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2310/4540] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:20 2022] GET /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835 => generated 1513 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:21.262105 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2de9248f-713c-4ed3-9732-3507c650f2b6 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:21.285251 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4cce4772-c0d0-4615-8efb-efc1c44eae21 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:21.286270 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4cce4772-c0d0-4615-8efb-efc1c44eae21 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: b4f3e58c-311d-4b8a-b231-67e8fbc8cd3e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:21.293436 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4cce4772-c0d0-4615-8efb-efc1c44eae21 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:21.298892 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4cce4772-c0d0-4615-8efb-efc1c44eae21 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:21.298892 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4cce4772-c0d0-4615-8efb-efc1c44eae21 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:21.298892 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4cce4772-c0d0-4615-8efb-efc1c44eae21 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:21.298892 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4cce4772-c0d0-4615-8efb-efc1c44eae21 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:21.298892 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4cce4772-c0d0-4615-8efb-efc1c44eae21 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:21.600331 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2de9248f-713c-4ed3-9732-3507c650f2b6 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:21.609767 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2de9248f-713c-4ed3-9732-3507c650f2b6 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:21.611532 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2de9248f-713c-4ed3-9732-3507c650f2b6 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:21.613532 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2de9248f-713c-4ed3-9732-3507c650f2b6 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1406 microversion: 2.20 time: 0.372836 Oct 23 01:30:21.614032 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2231/4541] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:30:21 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1406 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:30:21.642210 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4cce4772-c0d0-4615-8efb-efc1c44eae21 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:21.648501 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4cce4772-c0d0-4615-8efb-efc1c44eae21 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/b4f3e58c-311d-4b8a-b231-67e8fbc8cd3e" status: 200 len: 1512 microversion: 2.1 time: 0.367947 Oct 23 01:30:21.668444 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2311/4542] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:21 2022] GET /compute/v2.1/servers/b4f3e58c-311d-4b8a-b231-67e8fbc8cd3e => generated 1512 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:30:21.682667 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b82a40de-23aa-4ec4-a24e-8e5286c90023 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:21.683347 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b82a40de-23aa-4ec4-a24e-8e5286c90023 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: 79b6e08c-f496-40ee-b5ea-34392ac475ad] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:21.692906 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b82a40de-23aa-4ec4-a24e-8e5286c90023 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:21.694536 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b82a40de-23aa-4ec4-a24e-8e5286c90023 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:21.694980 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b82a40de-23aa-4ec4-a24e-8e5286c90023 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:21.695753 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b82a40de-23aa-4ec4-a24e-8e5286c90023 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:21.696214 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b82a40de-23aa-4ec4-a24e-8e5286c90023 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:21.696637 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b82a40de-23aa-4ec4-a24e-8e5286c90023 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:21.880928 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4c8de0bf-c16a-4c76-8554-6f8eadee9783 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:21.881709 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4c8de0bf-c16a-4c76-8554-6f8eadee9783 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 9540f923-c640-45de-a49a-26008adab3ca] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:21.894797 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4c8de0bf-c16a-4c76-8554-6f8eadee9783 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:21.896006 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4c8de0bf-c16a-4c76-8554-6f8eadee9783 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:21.896006 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4c8de0bf-c16a-4c76-8554-6f8eadee9783 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:21.896565 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4c8de0bf-c16a-4c76-8554-6f8eadee9783 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:21.897035 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4c8de0bf-c16a-4c76-8554-6f8eadee9783 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:21.897467 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4c8de0bf-c16a-4c76-8554-6f8eadee9783 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:21.974311 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:22.237317 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b82a40de-23aa-4ec4-a24e-8e5286c90023 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:22.252755 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b82a40de-23aa-4ec4-a24e-8e5286c90023 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad" status: 200 len: 1511 microversion: 2.1 time: 0.579090 Oct 23 01:30:22.255373 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2232/4543] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:21 2022] GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad => generated 1511 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:22.275218 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4c8de0bf-c16a-4c76-8554-6f8eadee9783 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:22.293380 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1eec0f32-479f-4d83-84cf-c56811fffd06 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:22.303329 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4c8de0bf-c16a-4c76-8554-6f8eadee9783 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/9540f923-c640-45de-a49a-26008adab3ca" status: 200 len: 1292 microversion: 2.1 time: 0.428776 Oct 23 01:30:22.304713 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2312/4544] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:21 2022] GET /compute/v2.1/servers/9540f923-c640-45de-a49a-26008adab3ca => generated 1292 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:22.313092 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1eec0f32-479f-4d83-84cf-c56811fffd06 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:22.316750 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1eec0f32-479f-4d83-84cf-c56811fffd06 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Searching by: {'deleted': False, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19'} {{(pid=120945) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 23 01:30:22.335083 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1eec0f32-479f-4d83-84cf-c56811fffd06 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:22.337926 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1eec0f32-479f-4d83-84cf-c56811fffd06 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:22.338795 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1eec0f32-479f-4d83-84cf-c56811fffd06 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:22.341574 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1eec0f32-479f-4d83-84cf-c56811fffd06 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:22.343269 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1eec0f32-479f-4d83-84cf-c56811fffd06 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:22.345412 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1eec0f32-479f-4d83-84cf-c56811fffd06 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:22.505446 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.multi_cell_list [None req-1eec0f32-479f-4d83-84cf-c56811fffd06 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120945) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 23 01:30:22.608164 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1eec0f32-479f-4d83-84cf-c56811fffd06 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:22.619906 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1eec0f32-479f-4d83-84cf-c56811fffd06 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:22.620404 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1eec0f32-479f-4d83-84cf-c56811fffd06 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:22.620843 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1eec0f32-479f-4d83-84cf-c56811fffd06 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:22.641148 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-944af19a-c0f4-4016-89cb-6a9b7fe32f8e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:22.642652 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-944af19a-c0f4-4016-89cb-6a9b7fe32f8e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:22.657262 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-944af19a-c0f4-4016-89cb-6a9b7fe32f8e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:22.659306 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-944af19a-c0f4-4016-89cb-6a9b7fe32f8e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:22.659980 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-944af19a-c0f4-4016-89cb-6a9b7fe32f8e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:22.660878 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-944af19a-c0f4-4016-89cb-6a9b7fe32f8e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:22.661532 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-944af19a-c0f4-4016-89cb-6a9b7fe32f8e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:22.662456 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-944af19a-c0f4-4016-89cb-6a9b7fe32f8e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:22.904770 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1eec0f32-479f-4d83-84cf-c56811fffd06 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/detail" status: 200 len: 4519 microversion: 2.1 time: 0.624236 Oct 23 01:30:22.935863 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2233/4545] 10.222.0.42 () {58 vars in 1146 bytes} [Sun Oct 23 01:30:22 2022] GET /compute/v2.1/servers/detail => generated 4519 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:22.950590 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-da2b5764-e2f7-422f-9bfb-c165a9b4c19a req-57327c27-64ac-43ff-9897-ec3cd066f2f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1d0765d-d720-40d2-b168-058e013fab0a", "tag": "9d275317-d5ad-4bae-8215-25b674a45c60"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:30:22.980439 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-da2b5764-e2f7-422f-9bfb-c165a9b4c19a req-57327c27-64ac-43ff-9897-ec3cd066f2f3 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:22.982546 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-da2b5764-e2f7-422f-9bfb-c165a9b4c19a req-57327c27-64ac-43ff-9897-ec3cd066f2f3 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:22.983936 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-da2b5764-e2f7-422f-9bfb-c165a9b4c19a req-57327c27-64ac-43ff-9897-ec3cd066f2f3 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:22.994166 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:23.003466 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-da2b5764-e2f7-422f-9bfb-c165a9b4c19a req-57327c27-64ac-43ff-9897-ec3cd066f2f3 service nova] Creating event network-changed:9d275317-d5ad-4bae-8215-25b674a45c60 for instance b1d0765d-d720-40d2-b168-058e013fab0a on n-h2-master-1 Oct 23 01:30:23.015486 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-da2b5764-e2f7-422f-9bfb-c165a9b4c19a req-57327c27-64ac-43ff-9897-ec3cd066f2f3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076625 Oct 23 01:30:23.016921 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2234/4546] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:30:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:30:23.026202 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-12374f01-c927-4e74-a663-445c126aca81 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:23.039039 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-12374f01-c927-4e74-a663-445c126aca81 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:23.044876 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-12374f01-c927-4e74-a663-445c126aca81 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19'} {{(pid=120945) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 23 01:30:23.057006 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-944af19a-c0f4-4016-89cb-6a9b7fe32f8e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:23.066207 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-944af19a-c0f4-4016-89cb-6a9b7fe32f8e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:23.067661 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-944af19a-c0f4-4016-89cb-6a9b7fe32f8e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:23.073891 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-944af19a-c0f4-4016-89cb-6a9b7fe32f8e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1406 microversion: 2.20 time: 0.437989 Oct 23 01:30:23.090001 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2313/4547] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:30:22 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1406 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:30:23.161669 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-12374f01-c927-4e74-a663-445c126aca81 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:23.162276 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-12374f01-c927-4e74-a663-445c126aca81 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:23.162832 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-12374f01-c927-4e74-a663-445c126aca81 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:23.182962 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-12374f01-c927-4e74-a663-445c126aca81 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:23.183698 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-12374f01-c927-4e74-a663-445c126aca81 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:23.184345 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-12374f01-c927-4e74-a663-445c126aca81 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:23.267744 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.multi_cell_list [None req-12374f01-c927-4e74-a663-445c126aca81 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120945) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 23 01:30:23.307898 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-12374f01-c927-4e74-a663-445c126aca81 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.288302 Oct 23 01:30:23.308825 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2235/4548] 10.222.0.42 () {58 vars in 1150 bytes} [Sun Oct 23 01:30:23 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:23.331171 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-553d453e-cf2c-494b-88fb-45072550b7c1 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:23.344660 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7accb81e-fd61-48f8-aac4-c14a6926f3fe tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:23.344660 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7accb81e-fd61-48f8-aac4-c14a6926f3fe tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 9540f923-c640-45de-a49a-26008adab3ca] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:23.348054 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-553d453e-cf2c-494b-88fb-45072550b7c1 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:23.348765 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-553d453e-cf2c-494b-88fb-45072550b7c1 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19'} {{(pid=120944) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 23 01:30:23.350818 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7accb81e-fd61-48f8-aac4-c14a6926f3fe tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:23.351670 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7accb81e-fd61-48f8-aac4-c14a6926f3fe tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:23.352279 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7accb81e-fd61-48f8-aac4-c14a6926f3fe tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:23.353235 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7accb81e-fd61-48f8-aac4-c14a6926f3fe tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:23.354140 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7accb81e-fd61-48f8-aac4-c14a6926f3fe tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:23.354721 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7accb81e-fd61-48f8-aac4-c14a6926f3fe tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:23.366096 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-553d453e-cf2c-494b-88fb-45072550b7c1 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:23.366593 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-553d453e-cf2c-494b-88fb-45072550b7c1 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:23.367035 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-553d453e-cf2c-494b-88fb-45072550b7c1 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:23.372242 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-553d453e-cf2c-494b-88fb-45072550b7c1 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:23.372796 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-553d453e-cf2c-494b-88fb-45072550b7c1 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:23.373240 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-553d453e-cf2c-494b-88fb-45072550b7c1 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:23.526829 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.multi_cell_list [None req-553d453e-cf2c-494b-88fb-45072550b7c1 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120944) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 23 01:30:23.616301 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-553d453e-cf2c-494b-88fb-45072550b7c1 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.292652 Oct 23 01:30:23.624840 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2314/4549] 10.222.0.42 () {58 vars in 1212 bytes} [Sun Oct 23 01:30:23 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:23.639403 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1253ee55-9212-4ec8-984f-817ec353b8be tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:23.650246 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1253ee55-9212-4ec8-984f-817ec353b8be tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:23.651108 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1253ee55-9212-4ec8-984f-817ec353b8be tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19'} {{(pid=120944) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 23 01:30:23.664805 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1253ee55-9212-4ec8-984f-817ec353b8be tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:23.664805 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1253ee55-9212-4ec8-984f-817ec353b8be tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:23.664805 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1253ee55-9212-4ec8-984f-817ec353b8be tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:23.665628 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1253ee55-9212-4ec8-984f-817ec353b8be tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:23.666381 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1253ee55-9212-4ec8-984f-817ec353b8be tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:23.667052 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1253ee55-9212-4ec8-984f-817ec353b8be tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:23.723191 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7accb81e-fd61-48f8-aac4-c14a6926f3fe tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:23.742402 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7accb81e-fd61-48f8-aac4-c14a6926f3fe tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/9540f923-c640-45de-a49a-26008adab3ca" status: 200 len: 1292 microversion: 2.1 time: 0.413443 Oct 23 01:30:23.744022 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2236/4550] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:23 2022] GET /compute/v2.1/servers/9540f923-c640-45de-a49a-26008adab3ca => generated 1292 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:23.794878 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.multi_cell_list [None req-1253ee55-9212-4ec8-984f-817ec353b8be tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120944) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 23 01:30:23.877636 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1253ee55-9212-4ec8-984f-817ec353b8be tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.242581 Oct 23 01:30:23.879003 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2315/4551] 10.222.0.42 () {58 vars in 1196 bytes} [Sun Oct 23 01:30:23 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:30:23.892025 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8f08fa9c-c5bb-4c91-acbf-ece70627dd44 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:23.898779 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8f08fa9c-c5bb-4c91-acbf-ece70627dd44 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:23.911149 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8f08fa9c-c5bb-4c91-acbf-ece70627dd44 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Searching by: {'name': '1456963514', 'deleted': False, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19'} {{(pid=120945) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 23 01:30:23.925229 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f08fa9c-c5bb-4c91-acbf-ece70627dd44 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:23.926369 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f08fa9c-c5bb-4c91-acbf-ece70627dd44 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:23.931790 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f08fa9c-c5bb-4c91-acbf-ece70627dd44 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:23.933359 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f08fa9c-c5bb-4c91-acbf-ece70627dd44 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:23.934065 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f08fa9c-c5bb-4c91-acbf-ece70627dd44 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:23.934782 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f08fa9c-c5bb-4c91-acbf-ece70627dd44 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:24.049131 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.multi_cell_list [None req-8f08fa9c-c5bb-4c91-acbf-ece70627dd44 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120945) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 23 01:30:24.112160 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1815e47c-15da-4d37-a46f-6b64ed28bb9e tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Action: 'create', calling method: .version_select at 0x7f5cc16dfb80>, body: {"keypair": {"name": "tempest-keypair-223195307", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESlbLVjhwFu3AodkEv288ZK/1q9Rh2lbZvVAjQC9MM/nGU7q4F6+nl0VSA3qLmM2iIfFXKXW/7aRkT0VzXkiSP/k3heJJJmwIes4TdF6xWUwIBZhpskDjiVhDCjqp1BmQ=="}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:30:24.142173 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-1815e47c-15da-4d37-a46f-6b64ed28bb9e tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Getting quotas for project 6edb27d1224244809ecbb55ac953c645. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:30:24.157208 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:24.160980 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-1815e47c-15da-4d37-a46f-6b64ed28bb9e tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Getting quotas for user 0c65e7ab0b544d9ebdac8bc2129d051a and project 6edb27d1224244809ecbb55ac953c645. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:30:24.200869 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8f08fa9c-c5bb-4c91-acbf-ece70627dd44 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers?name=1456963514" status: 200 len: 346 microversion: 2.1 time: 0.313536 Oct 23 01:30:24.206803 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2237/4552] 10.222.0.42 () {58 vars in 1156 bytes} [Sun Oct 23 01:30:23 2022] GET /compute/v2.1/servers?name=1456963514 => generated 346 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:30:24.218368 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d4d5d68c-da14-4972-8b9c-a36f7f724e01 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:24.219304 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d4d5d68c-da14-4972-8b9c-a36f7f724e01 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:24.230929 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4d5d68c-da14-4972-8b9c-a36f7f724e01 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:24.231418 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4d5d68c-da14-4972-8b9c-a36f7f724e01 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:24.232138 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4d5d68c-da14-4972-8b9c-a36f7f724e01 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:24.232588 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4d5d68c-da14-4972-8b9c-a36f7f724e01 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:24.233093 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4d5d68c-da14-4972-8b9c-a36f7f724e01 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:24.233515 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4d5d68c-da14-4972-8b9c-a36f7f724e01 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:24.274501 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1815e47c-15da-4d37-a46f-6b64ed28bb9e tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.260277 Oct 23 01:30:24.275461 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2316/4553] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 01:30:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:30:24.280432 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9c43763b-f53c-4e4a-92a3-5e4977e07189 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:24.289795 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9c43763b-f53c-4e4a-92a3-5e4977e07189 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:24.290321 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9c43763b-f53c-4e4a-92a3-5e4977e07189 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19'} {{(pid=120944) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 23 01:30:24.302524 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9c43763b-f53c-4e4a-92a3-5e4977e07189 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:24.305675 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9c43763b-f53c-4e4a-92a3-5e4977e07189 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:24.305675 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9c43763b-f53c-4e4a-92a3-5e4977e07189 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:24.305675 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9c43763b-f53c-4e4a-92a3-5e4977e07189 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:24.305675 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9c43763b-f53c-4e4a-92a3-5e4977e07189 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:24.305675 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9c43763b-f53c-4e4a-92a3-5e4977e07189 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:24.431432 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.multi_cell_list [None req-9c43763b-f53c-4e4a-92a3-5e4977e07189 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120944) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 23 01:30:24.475406 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d4d5d68c-da14-4972-8b9c-a36f7f724e01 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:24.490926 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d4d5d68c-da14-4972-8b9c-a36f7f724e01 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:24.491664 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d4d5d68c-da14-4972-8b9c-a36f7f724e01 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:24.492799 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d4d5d68c-da14-4972-8b9c-a36f7f724e01 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1406 microversion: 2.20 time: 0.284774 Oct 23 01:30:24.513435 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2238/4554] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:30:24 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1406 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:30:24.536369 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9c43763b-f53c-4e4a-92a3-5e4977e07189 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.259817 Oct 23 01:30:24.537484 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2317/4555] 10.222.0.42 () {58 vars in 1154 bytes} [Sun Oct 23 01:30:24 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:24.557865 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ae07261d-349d-4090-a658-1925abae830b tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:24.565325 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ae07261d-349d-4090-a658-1925abae830b tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:24.569841 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ae07261d-349d-4090-a658-1925abae830b tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-145696351', 'deleted': False, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19'} {{(pid=120945) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 23 01:30:24.571830 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ae07261d-349d-4090-a658-1925abae830b tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:24.572319 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ae07261d-349d-4090-a658-1925abae830b tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:24.572758 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ae07261d-349d-4090-a658-1925abae830b tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:24.573519 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ae07261d-349d-4090-a658-1925abae830b tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:24.573987 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ae07261d-349d-4090-a658-1925abae830b tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:24.574418 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ae07261d-349d-4090-a658-1925abae830b tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:24.683123 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.multi_cell_list [None req-ae07261d-349d-4090-a658-1925abae830b tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120945) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 23 01:30:24.749638 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ae07261d-349d-4090-a658-1925abae830b tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-145696351" status: 200 len: 346 microversion: 2.1 time: 0.198642 Oct 23 01:30:24.750478 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2239/4556] 10.222.0.42 () {58 vars in 1228 bytes} [Sun Oct 23 01:30:24 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-145696351 => generated 346 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:30:24.762667 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dd09c555-5684-44e8-a606-ac2962e170b5 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:24.763207 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-dd09c555-5684-44e8-a606-ac2962e170b5 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: 79b6e08c-f496-40ee-b5ea-34392ac475ad] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:24.768980 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a63e2b57-aa81-46aa-9c4a-808d7ae7d995 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:24.769591 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a63e2b57-aa81-46aa-9c4a-808d7ae7d995 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 9540f923-c640-45de-a49a-26008adab3ca] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:24.772341 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd09c555-5684-44e8-a606-ac2962e170b5 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:24.772831 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd09c555-5684-44e8-a606-ac2962e170b5 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:24.773463 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd09c555-5684-44e8-a606-ac2962e170b5 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:24.773959 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd09c555-5684-44e8-a606-ac2962e170b5 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:24.774435 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd09c555-5684-44e8-a606-ac2962e170b5 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:24.780606 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd09c555-5684-44e8-a606-ac2962e170b5 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:24.780735 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a63e2b57-aa81-46aa-9c4a-808d7ae7d995 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:24.780735 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a63e2b57-aa81-46aa-9c4a-808d7ae7d995 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:24.780735 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a63e2b57-aa81-46aa-9c4a-808d7ae7d995 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:24.780735 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a63e2b57-aa81-46aa-9c4a-808d7ae7d995 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:24.780735 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a63e2b57-aa81-46aa-9c4a-808d7ae7d995 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:24.780735 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a63e2b57-aa81-46aa-9c4a-808d7ae7d995 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:24.801107 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-dd09c555-5684-44e8-a606-ac2962e170b5 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: 79b6e08c-f496-40ee-b5ea-34392ac475ad] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:30:24.937617 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a63e2b57-aa81-46aa-9c4a-808d7ae7d995 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:24.951435 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a63e2b57-aa81-46aa-9c4a-808d7ae7d995 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/9540f923-c640-45de-a49a-26008adab3ca" status: 200 len: 1292 microversion: 2.1 time: 0.185399 Oct 23 01:30:24.952812 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2240/4557] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:24 2022] GET /compute/v2.1/servers/9540f923-c640-45de-a49a-26008adab3ca => generated 1292 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:30:25.037912 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-2ce30e8f-35e5-420b-af3a-a25cbaffffdb req-96ed23f5-37c1-47c9-852b-438a90a8542d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9540f923-c640-45de-a49a-26008adab3ca", "tag": "8258ae4e-b95f-4244-9928-2d8b2203a41f"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:30:25.048248 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-2ce30e8f-35e5-420b-af3a-a25cbaffffdb req-96ed23f5-37c1-47c9-852b-438a90a8542d service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:25.048881 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-2ce30e8f-35e5-420b-af3a-a25cbaffffdb req-96ed23f5-37c1-47c9-852b-438a90a8542d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:25.049700 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-2ce30e8f-35e5-420b-af3a-a25cbaffffdb req-96ed23f5-37c1-47c9-852b-438a90a8542d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:25.061284 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-2ce30e8f-35e5-420b-af3a-a25cbaffffdb req-96ed23f5-37c1-47c9-852b-438a90a8542d service nova] Creating event network-changed:8258ae4e-b95f-4244-9928-2d8b2203a41f for instance 9540f923-c640-45de-a49a-26008adab3ca on n-h2-master-1 Oct 23 01:30:25.066258 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-2ce30e8f-35e5-420b-af3a-a25cbaffffdb req-96ed23f5-37c1-47c9-852b-438a90a8542d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032560 Oct 23 01:30:25.066861 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2241/4558] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:30:25.246401 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-dd09c555-5684-44e8-a606-ac2962e170b5 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "DELETE /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad" status: 204 len: 0 microversion: 2.1 time: 0.485756 Oct 23 01:30:25.250233 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2318/4559] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:30:24 2022] DELETE /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad => generated 0 bytes in 489 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:30:25.258974 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a497860e-e1b9-41be-8b80-7a77b2d49caa tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:25.260199 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a497860e-e1b9-41be-8b80-7a77b2d49caa tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: 79b6e08c-f496-40ee-b5ea-34392ac475ad] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:25.268657 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a497860e-e1b9-41be-8b80-7a77b2d49caa tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:25.269576 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a497860e-e1b9-41be-8b80-7a77b2d49caa tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:25.270292 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a497860e-e1b9-41be-8b80-7a77b2d49caa tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:25.271639 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a497860e-e1b9-41be-8b80-7a77b2d49caa tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:25.272367 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a497860e-e1b9-41be-8b80-7a77b2d49caa tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:25.274033 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a497860e-e1b9-41be-8b80-7a77b2d49caa tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:25.468867 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a497860e-e1b9-41be-8b80-7a77b2d49caa tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:25.476696 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a497860e-e1b9-41be-8b80-7a77b2d49caa tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad" status: 200 len: 1517 microversion: 2.1 time: 0.223580 Oct 23 01:30:25.492783 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2242/4560] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:25 2022] GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad => generated 1517 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:25.525395 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a5449bb1-13e9-4fc4-9d38-c5cd5ade9e0c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:25.526469 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a5449bb1-13e9-4fc4-9d38-c5cd5ade9e0c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:25.532941 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5449bb1-13e9-4fc4-9d38-c5cd5ade9e0c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:25.533682 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5449bb1-13e9-4fc4-9d38-c5cd5ade9e0c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:25.534447 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5449bb1-13e9-4fc4-9d38-c5cd5ade9e0c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:25.535468 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5449bb1-13e9-4fc4-9d38-c5cd5ade9e0c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:25.536146 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5449bb1-13e9-4fc4-9d38-c5cd5ade9e0c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:25.536778 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5449bb1-13e9-4fc4-9d38-c5cd5ade9e0c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:25.713131 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a5449bb1-13e9-4fc4-9d38-c5cd5ade9e0c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:25.725891 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a5449bb1-13e9-4fc4-9d38-c5cd5ade9e0c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:25.729395 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a5449bb1-13e9-4fc4-9d38-c5cd5ade9e0c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:25.731575 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a5449bb1-13e9-4fc4-9d38-c5cd5ade9e0c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1406 microversion: 2.20 time: 0.211362 Oct 23 01:30:25.740127 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2319/4561] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:30:25 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1406 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:30:25.979102 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b8713771-3406-4240-a4bd-a80eadbd2738 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:25.979878 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b8713771-3406-4240-a4bd-a80eadbd2738 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 9540f923-c640-45de-a49a-26008adab3ca] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:25.987495 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b8713771-3406-4240-a4bd-a80eadbd2738 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:25.988091 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b8713771-3406-4240-a4bd-a80eadbd2738 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:25.988756 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b8713771-3406-4240-a4bd-a80eadbd2738 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:25.989681 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b8713771-3406-4240-a4bd-a80eadbd2738 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:25.990416 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b8713771-3406-4240-a4bd-a80eadbd2738 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:25.990938 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b8713771-3406-4240-a4bd-a80eadbd2738 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:26.186604 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b8713771-3406-4240-a4bd-a80eadbd2738 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:26.201968 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b8713771-3406-4240-a4bd-a80eadbd2738 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/9540f923-c640-45de-a49a-26008adab3ca" status: 200 len: 1292 microversion: 2.1 time: 0.227073 Oct 23 01:30:26.202664 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2243/4562] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:25 2022] GET /compute/v2.1/servers/9540f923-c640-45de-a49a-26008adab3ca => generated 1292 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:26.505330 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fe425116-dc09-4f28-a5e6-e0e9f3b7d255 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:26.505775 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fe425116-dc09-4f28-a5e6-e0e9f3b7d255 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: 79b6e08c-f496-40ee-b5ea-34392ac475ad] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:26.512610 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe425116-dc09-4f28-a5e6-e0e9f3b7d255 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:26.519321 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe425116-dc09-4f28-a5e6-e0e9f3b7d255 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:26.519321 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe425116-dc09-4f28-a5e6-e0e9f3b7d255 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:26.519321 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe425116-dc09-4f28-a5e6-e0e9f3b7d255 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:26.519321 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe425116-dc09-4f28-a5e6-e0e9f3b7d255 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:26.519321 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe425116-dc09-4f28-a5e6-e0e9f3b7d255 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:26.754016 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fe425116-dc09-4f28-a5e6-e0e9f3b7d255 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:26.763101 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fec647d6-359b-41d0-8927-e144f97e4f2f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:26.763814 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-fec647d6-359b-41d0-8927-e144f97e4f2f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:26.764452 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fe425116-dc09-4f28-a5e6-e0e9f3b7d255 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad" status: 200 len: 1517 microversion: 2.1 time: 0.267024 Oct 23 01:30:26.765568 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2320/4563] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:26 2022] GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad => generated 1517 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:26.784073 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fec647d6-359b-41d0-8927-e144f97e4f2f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:26.784960 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fec647d6-359b-41d0-8927-e144f97e4f2f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:26.785560 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fec647d6-359b-41d0-8927-e144f97e4f2f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:26.786125 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fec647d6-359b-41d0-8927-e144f97e4f2f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:26.786572 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fec647d6-359b-41d0-8927-e144f97e4f2f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:26.787258 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fec647d6-359b-41d0-8927-e144f97e4f2f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:27.022133 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-fec647d6-359b-41d0-8927-e144f97e4f2f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:27.032354 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-fec647d6-359b-41d0-8927-e144f97e4f2f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:27.033896 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-fec647d6-359b-41d0-8927-e144f97e4f2f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:27.035215 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fec647d6-359b-41d0-8927-e144f97e4f2f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1406 microversion: 2.20 time: 0.281174 Oct 23 01:30:27.035802 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2244/4564] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:30:26 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1406 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:30:27.228764 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f4a488ff-1728-468e-a655-75878726b886 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:27.231055 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f4a488ff-1728-468e-a655-75878726b886 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 9540f923-c640-45de-a49a-26008adab3ca] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:27.242137 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4a488ff-1728-468e-a655-75878726b886 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:27.243594 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4a488ff-1728-468e-a655-75878726b886 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:27.244048 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4a488ff-1728-468e-a655-75878726b886 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:27.245294 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4a488ff-1728-468e-a655-75878726b886 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:27.246462 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4a488ff-1728-468e-a655-75878726b886 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:27.247509 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4a488ff-1728-468e-a655-75878726b886 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:27.519753 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f4a488ff-1728-468e-a655-75878726b886 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:27.529577 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f4a488ff-1728-468e-a655-75878726b886 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/9540f923-c640-45de-a49a-26008adab3ca" status: 200 len: 1292 microversion: 2.1 time: 0.307816 Oct 23 01:30:27.530688 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2321/4565] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:27 2022] GET /compute/v2.1/servers/9540f923-c640-45de-a49a-26008adab3ca => generated 1292 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:27.789315 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2a51c380-ff22-42a7-b5ed-5518a2cb6d43 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:27.790074 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2a51c380-ff22-42a7-b5ed-5518a2cb6d43 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: 79b6e08c-f496-40ee-b5ea-34392ac475ad] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:27.796630 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2a51c380-ff22-42a7-b5ed-5518a2cb6d43 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:27.796840 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2a51c380-ff22-42a7-b5ed-5518a2cb6d43 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:27.803851 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2a51c380-ff22-42a7-b5ed-5518a2cb6d43 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:27.805395 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2a51c380-ff22-42a7-b5ed-5518a2cb6d43 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:27.807768 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2a51c380-ff22-42a7-b5ed-5518a2cb6d43 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:27.811070 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2a51c380-ff22-42a7-b5ed-5518a2cb6d43 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:28.020418 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2a51c380-ff22-42a7-b5ed-5518a2cb6d43 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:28.041475 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2a51c380-ff22-42a7-b5ed-5518a2cb6d43 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad" status: 200 len: 1517 microversion: 2.1 time: 0.246464 Oct 23 01:30:28.041475 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2245/4566] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:27 2022] GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad => generated 1517 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:28.061336 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-279146e3-8803-48d2-a795-0576f5a904dc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:28.064369 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-279146e3-8803-48d2-a795-0576f5a904dc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:28.073961 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-279146e3-8803-48d2-a795-0576f5a904dc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:28.074580 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-279146e3-8803-48d2-a795-0576f5a904dc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:28.075091 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-279146e3-8803-48d2-a795-0576f5a904dc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:28.076080 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-279146e3-8803-48d2-a795-0576f5a904dc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:28.076730 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-279146e3-8803-48d2-a795-0576f5a904dc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:28.077237 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-279146e3-8803-48d2-a795-0576f5a904dc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:28.319865 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9524fb94-7cdd-4da8-8bfc-04f087b3a1c6 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-640402394", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e9d65ec9-a091-4c05-b838-8a651ac0b337"}], "security_groups": [{"name": "tempest-securitygroup--1185475852"}], "key_name": "tempest-keypair-223195307", "user_data": "}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:30:28.537868 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-9524fb94-7cdd-4da8-8bfc-04f087b3a1c6 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] validate_networks() for [('e9d65ec9-a091-4c05-b838-8a651ac0b337', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:30:28.676660 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-279146e3-8803-48d2-a795-0576f5a904dc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:28.690244 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-279146e3-8803-48d2-a795-0576f5a904dc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:28.692656 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-279146e3-8803-48d2-a795-0576f5a904dc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:28.694189 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-279146e3-8803-48d2-a795-0576f5a904dc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1406 microversion: 2.20 time: 0.637119 Oct 23 01:30:28.695268 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2322/4567] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:30:28 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1406 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:30:28.701435 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-462c1feb-2ebd-400c-b20f-5897738296c4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:28.702096 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-462c1feb-2ebd-400c-b20f-5897738296c4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 9540f923-c640-45de-a49a-26008adab3ca] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:28.709830 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-462c1feb-2ebd-400c-b20f-5897738296c4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:28.710606 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-462c1feb-2ebd-400c-b20f-5897738296c4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:28.711033 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-462c1feb-2ebd-400c-b20f-5897738296c4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:28.711883 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-462c1feb-2ebd-400c-b20f-5897738296c4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:28.712490 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-462c1feb-2ebd-400c-b20f-5897738296c4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:28.713075 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-462c1feb-2ebd-400c-b20f-5897738296c4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:29.013766 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-462c1feb-2ebd-400c-b20f-5897738296c4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:29.027684 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-462c1feb-2ebd-400c-b20f-5897738296c4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/9540f923-c640-45de-a49a-26008adab3ca" status: 200 len: 1292 microversion: 2.1 time: 0.330112 Oct 23 01:30:29.028658 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2323/4568] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:28 2022] GET /compute/v2.1/servers/9540f923-c640-45de-a49a-26008adab3ca => generated 1292 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:29.065576 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0e811ecc-295e-469d-a67f-b3cee5aa574f tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:29.066503 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0e811ecc-295e-469d-a67f-b3cee5aa574f tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: 79b6e08c-f496-40ee-b5ea-34392ac475ad] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:29.073364 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0e811ecc-295e-469d-a67f-b3cee5aa574f tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:29.074118 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0e811ecc-295e-469d-a67f-b3cee5aa574f tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:29.074807 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0e811ecc-295e-469d-a67f-b3cee5aa574f tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:29.079012 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0e811ecc-295e-469d-a67f-b3cee5aa574f tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:29.079012 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0e811ecc-295e-469d-a67f-b3cee5aa574f tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:29.079012 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0e811ecc-295e-469d-a67f-b3cee5aa574f tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:29.620112 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-9524fb94-7cdd-4da8-8bfc-04f087b3a1c6 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:30:29.625225 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-9524fb94-7cdd-4da8-8bfc-04f087b3a1c6 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:30:29.626011 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-9524fb94-7cdd-4da8-8bfc-04f087b3a1c6 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:30:29.626605 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-9524fb94-7cdd-4da8-8bfc-04f087b3a1c6 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:30:29.629607 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-9524fb94-7cdd-4da8-8bfc-04f087b3a1c6 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:30:29.647828 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0e811ecc-295e-469d-a67f-b3cee5aa574f tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:29.656379 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0e811ecc-295e-469d-a67f-b3cee5aa574f tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad" status: 200 len: 1517 microversion: 2.1 time: 0.603516 Oct 23 01:30:29.657141 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2324/4569] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:29 2022] GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad => generated 1517 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:29.659138 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9524fb94-7cdd-4da8-8bfc-04f087b3a1c6 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:29.659788 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9524fb94-7cdd-4da8-8bfc-04f087b3a1c6 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:29.660373 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9524fb94-7cdd-4da8-8bfc-04f087b3a1c6 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:29.661660 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9524fb94-7cdd-4da8-8bfc-04f087b3a1c6 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:29.662948 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9524fb94-7cdd-4da8-8bfc-04f087b3a1c6 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:29.663526 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9524fb94-7cdd-4da8-8bfc-04f087b3a1c6 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:29.700453 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-9524fb94-7cdd-4da8-8bfc-04f087b3a1c6 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Getting quotas for project 6edb27d1224244809ecbb55ac953c645. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:30:29.712429 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:29.715744 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-9524fb94-7cdd-4da8-8bfc-04f087b3a1c6 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Getting quotas for user 0c65e7ab0b544d9ebdac8bc2129d051a and project 6edb27d1224244809ecbb55ac953c645. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:30:29.725645 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d6d17d0a-98ba-4828-b761-ce227ab3d174 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:29.726574 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d6d17d0a-98ba-4828-b761-ce227ab3d174 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:29.739425 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9524fb94-7cdd-4da8-8bfc-04f087b3a1c6 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:30:29.742844 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d6d17d0a-98ba-4828-b761-ce227ab3d174 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:29.743410 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d6d17d0a-98ba-4828-b761-ce227ab3d174 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:29.743776 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d6d17d0a-98ba-4828-b761-ce227ab3d174 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:29.744672 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d6d17d0a-98ba-4828-b761-ce227ab3d174 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:29.744821 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9524fb94-7cdd-4da8-8bfc-04f087b3a1c6 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: e96f5e79-d832-4927-aef1-a45a815404b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:30:29.746328 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d6d17d0a-98ba-4828-b761-ce227ab3d174 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:29.752504 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d6d17d0a-98ba-4828-b761-ce227ab3d174 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:29.764703 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:29.907484 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9524fb94-7cdd-4da8-8bfc-04f087b3a1c6 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.594913 Oct 23 01:30:29.909751 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2246/4570] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:30:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 1598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 23 01:30:29.916370 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-8312ae7e-e66b-4eb2-b88c-12beaba03bd6 req-7e9304b4-6fc1-4cd1-b218-8968c19d7392 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1d0765d-d720-40d2-b168-058e013fab0a", "name": "network-vif-plugged", "status": "completed", "tag": "9d275317-d5ad-4bae-8215-25b674a45c60"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:30:29.945912 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-8312ae7e-e66b-4eb2-b88c-12beaba03bd6 req-7e9304b4-6fc1-4cd1-b218-8968c19d7392 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:29.951757 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-8312ae7e-e66b-4eb2-b88c-12beaba03bd6 req-7e9304b4-6fc1-4cd1-b218-8968c19d7392 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:29.952471 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-8312ae7e-e66b-4eb2-b88c-12beaba03bd6 req-7e9304b4-6fc1-4cd1-b218-8968c19d7392 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:29.973491 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-8312ae7e-e66b-4eb2-b88c-12beaba03bd6 req-7e9304b4-6fc1-4cd1-b218-8968c19d7392 service nova] Creating event network-vif-plugged:9d275317-d5ad-4bae-8215-25b674a45c60 for instance b1d0765d-d720-40d2-b168-058e013fab0a on n-h2-master-1 Oct 23 01:30:29.983425 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-8312ae7e-e66b-4eb2-b88c-12beaba03bd6 req-7e9304b4-6fc1-4cd1-b218-8968c19d7392 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072131 Oct 23 01:30:29.984239 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2247/4571] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:30:29.999956 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-af0f730d-87be-4b06-a2b4-45565483ccaf tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:30.000756 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-af0f730d-87be-4b06-a2b4-45565483ccaf tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: e96f5e79-d832-4927-aef1-a45a815404b0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:30.091710 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d6d17d0a-98ba-4828-b761-ce227ab3d174 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:30.103828 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d6d17d0a-98ba-4828-b761-ce227ab3d174 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:30.105304 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d6d17d0a-98ba-4828-b761-ce227ab3d174 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:30.118324 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d6d17d0a-98ba-4828-b761-ce227ab3d174 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1406 microversion: 2.20 time: 0.396551 Oct 23 01:30:30.120742 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2325/4572] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:30:29 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1406 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:30:30.136490 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4bb91d4f-feb0-4eda-af9d-1d90e4ebbc1b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:30.137225 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4bb91d4f-feb0-4eda-af9d-1d90e4ebbc1b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 9540f923-c640-45de-a49a-26008adab3ca] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:30.144489 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4bb91d4f-feb0-4eda-af9d-1d90e4ebbc1b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:30.145313 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4bb91d4f-feb0-4eda-af9d-1d90e4ebbc1b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:30.146285 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4bb91d4f-feb0-4eda-af9d-1d90e4ebbc1b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:30.147519 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4bb91d4f-feb0-4eda-af9d-1d90e4ebbc1b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:30.152538 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4bb91d4f-feb0-4eda-af9d-1d90e4ebbc1b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:30.156843 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-af0f730d-87be-4b06-a2b4-45565483ccaf tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:30.157057 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4bb91d4f-feb0-4eda-af9d-1d90e4ebbc1b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:30.171310 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-af0f730d-87be-4b06-a2b4-45565483ccaf tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0" status: 200 len: 1240 microversion: 2.1 time: 0.185948 Oct 23 01:30:30.172307 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2248/4573] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:29 2022] GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0 => generated 1240 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:30.437529 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4bb91d4f-feb0-4eda-af9d-1d90e4ebbc1b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:30.454265 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4bb91d4f-feb0-4eda-af9d-1d90e4ebbc1b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/9540f923-c640-45de-a49a-26008adab3ca" status: 200 len: 1292 microversion: 2.1 time: 0.330984 Oct 23 01:30:30.454265 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2326/4574] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:30 2022] GET /compute/v2.1/servers/9540f923-c640-45de-a49a-26008adab3ca => generated 1292 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:30.683802 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-578714a0-5ee7-40d8-9d27-21dd07f64013 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:30.684344 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-578714a0-5ee7-40d8-9d27-21dd07f64013 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: 79b6e08c-f496-40ee-b5ea-34392ac475ad] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:30.706197 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-578714a0-5ee7-40d8-9d27-21dd07f64013 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:30.710640 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-578714a0-5ee7-40d8-9d27-21dd07f64013 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:30.711323 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-578714a0-5ee7-40d8-9d27-21dd07f64013 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:30.717446 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-578714a0-5ee7-40d8-9d27-21dd07f64013 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:30.717446 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-578714a0-5ee7-40d8-9d27-21dd07f64013 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:30.717446 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-578714a0-5ee7-40d8-9d27-21dd07f64013 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:30.912091 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-578714a0-5ee7-40d8-9d27-21dd07f64013 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:30.940991 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-578714a0-5ee7-40d8-9d27-21dd07f64013 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad" status: 200 len: 1475 microversion: 2.1 time: 0.257933 Oct 23 01:30:30.942495 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2249/4575] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:30 2022] GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad => generated 1475 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:31.149606 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d706a21b-2b08-43cf-a07c-4ec2b4b41769 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:31.151646 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d706a21b-2b08-43cf-a07c-4ec2b4b41769 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:31.168139 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d706a21b-2b08-43cf-a07c-4ec2b4b41769 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:31.168790 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d706a21b-2b08-43cf-a07c-4ec2b4b41769 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:31.169388 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d706a21b-2b08-43cf-a07c-4ec2b4b41769 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:31.170274 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d706a21b-2b08-43cf-a07c-4ec2b4b41769 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:31.170831 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d706a21b-2b08-43cf-a07c-4ec2b4b41769 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:31.171423 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d706a21b-2b08-43cf-a07c-4ec2b4b41769 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:31.203029 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e81ed515-c5f1-4f0a-a20f-e52d0216254d tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:31.218280 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e81ed515-c5f1-4f0a-a20f-e52d0216254d tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: e96f5e79-d832-4927-aef1-a45a815404b0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:31.326950 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e81ed515-c5f1-4f0a-a20f-e52d0216254d tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:31.337197 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e81ed515-c5f1-4f0a-a20f-e52d0216254d tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0" status: 200 len: 1240 microversion: 2.1 time: 0.141131 Oct 23 01:30:31.341101 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2250/4576] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:31 2022] GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0 => generated 1240 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:31.354951 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-2ad9546d-3fdf-4888-8f0d-700e30670d42 req-e3e21e4e-bd5e-452a-92fc-9fb3f05ae98d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79b6e08c-f496-40ee-b5ea-34392ac475ad", "name": "network-vif-deleted", "tag": "5149c7c0-3942-4b5e-a00f-1ec25183da19"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:30:31.375031 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-2ad9546d-3fdf-4888-8f0d-700e30670d42 req-e3e21e4e-bd5e-452a-92fc-9fb3f05ae98d service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:31.377295 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-2ad9546d-3fdf-4888-8f0d-700e30670d42 req-e3e21e4e-bd5e-452a-92fc-9fb3f05ae98d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:31.377802 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-2ad9546d-3fdf-4888-8f0d-700e30670d42 req-e3e21e4e-bd5e-452a-92fc-9fb3f05ae98d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:31.400925 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-2ad9546d-3fdf-4888-8f0d-700e30670d42 req-e3e21e4e-bd5e-452a-92fc-9fb3f05ae98d service nova] Creating event network-vif-deleted:5149c7c0-3942-4b5e-a00f-1ec25183da19 for instance 79b6e08c-f496-40ee-b5ea-34392ac475ad on n-h2-master-1 Oct 23 01:30:31.414964 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-2ad9546d-3fdf-4888-8f0d-700e30670d42 req-e3e21e4e-bd5e-452a-92fc-9fb3f05ae98d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072229 Oct 23 01:30:31.416427 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2251/4577] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:30:31.478680 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-52d03483-9880-4a0a-80a5-62bb70daedca tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:31.480510 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-52d03483-9880-4a0a-80a5-62bb70daedca tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 9540f923-c640-45de-a49a-26008adab3ca] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:31.493010 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52d03483-9880-4a0a-80a5-62bb70daedca tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:31.493595 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52d03483-9880-4a0a-80a5-62bb70daedca tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:31.494130 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52d03483-9880-4a0a-80a5-62bb70daedca tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:31.495170 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52d03483-9880-4a0a-80a5-62bb70daedca tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:31.495846 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52d03483-9880-4a0a-80a5-62bb70daedca tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:31.496498 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52d03483-9880-4a0a-80a5-62bb70daedca tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:31.575652 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d706a21b-2b08-43cf-a07c-4ec2b4b41769 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:31.585886 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d706a21b-2b08-43cf-a07c-4ec2b4b41769 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:31.587754 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d706a21b-2b08-43cf-a07c-4ec2b4b41769 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:31.589181 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d706a21b-2b08-43cf-a07c-4ec2b4b41769 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1406 microversion: 2.20 time: 0.448588 Oct 23 01:30:31.590096 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2327/4578] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:30:31 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1406 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:30:31.672233 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-52d03483-9880-4a0a-80a5-62bb70daedca tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:31.682425 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-52d03483-9880-4a0a-80a5-62bb70daedca tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/9540f923-c640-45de-a49a-26008adab3ca" status: 200 len: 1292 microversion: 2.1 time: 0.210643 Oct 23 01:30:31.683009 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2252/4579] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:31 2022] GET /compute/v2.1/servers/9540f923-c640-45de-a49a-26008adab3ca => generated 1292 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:30:31.967166 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-418f443b-9e49-4640-841a-12663bffb8f5 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:31.967791 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-418f443b-9e49-4640-841a-12663bffb8f5 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: 79b6e08c-f496-40ee-b5ea-34392ac475ad] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:31.974361 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-418f443b-9e49-4640-841a-12663bffb8f5 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:31.976114 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-418f443b-9e49-4640-841a-12663bffb8f5 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:31.976562 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-418f443b-9e49-4640-841a-12663bffb8f5 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:31.977336 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-418f443b-9e49-4640-841a-12663bffb8f5 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:31.977800 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-418f443b-9e49-4640-841a-12663bffb8f5 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:31.978276 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-418f443b-9e49-4640-841a-12663bffb8f5 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:32.036453 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-c0f5d5f1-6df8-4318-9f7a-f63e9313c0ed req-5a3fff60-7e35-4af3-83a7-4b5b9cbcf5d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9540f923-c640-45de-a49a-26008adab3ca", "name": "network-vif-plugged", "status": "completed", "tag": "8258ae4e-b95f-4244-9928-2d8b2203a41f"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:30:32.063475 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-c0f5d5f1-6df8-4318-9f7a-f63e9313c0ed req-5a3fff60-7e35-4af3-83a7-4b5b9cbcf5d2 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:32.064810 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-c0f5d5f1-6df8-4318-9f7a-f63e9313c0ed req-5a3fff60-7e35-4af3-83a7-4b5b9cbcf5d2 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:32.065475 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-c0f5d5f1-6df8-4318-9f7a-f63e9313c0ed req-5a3fff60-7e35-4af3-83a7-4b5b9cbcf5d2 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:32.082881 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-418f443b-9e49-4640-841a-12663bffb8f5 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:32.088469 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-c0f5d5f1-6df8-4318-9f7a-f63e9313c0ed req-5a3fff60-7e35-4af3-83a7-4b5b9cbcf5d2 service nova] Creating event network-vif-plugged:8258ae4e-b95f-4244-9928-2d8b2203a41f for instance 9540f923-c640-45de-a49a-26008adab3ca on n-h2-master-1 Oct 23 01:30:32.092912 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-418f443b-9e49-4640-841a-12663bffb8f5 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad" status: 200 len: 1305 microversion: 2.1 time: 0.132075 Oct 23 01:30:32.094043 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2328/4580] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:31 2022] GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad => generated 1305 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:32.109862 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-c0f5d5f1-6df8-4318-9f7a-f63e9313c0ed req-5a3fff60-7e35-4af3-83a7-4b5b9cbcf5d2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077607 Oct 23 01:30:32.114558 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2253/4581] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:30:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:30:32.376741 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f01d92b5-bb27-447e-8e89-f938d02450a5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:32.377386 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f01d92b5-bb27-447e-8e89-f938d02450a5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: e96f5e79-d832-4927-aef1-a45a815404b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:32.386898 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f01d92b5-bb27-447e-8e89-f938d02450a5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:32.387645 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f01d92b5-bb27-447e-8e89-f938d02450a5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:32.388279 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f01d92b5-bb27-447e-8e89-f938d02450a5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:32.391769 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f01d92b5-bb27-447e-8e89-f938d02450a5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:32.392512 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f01d92b5-bb27-447e-8e89-f938d02450a5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:32.393822 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f01d92b5-bb27-447e-8e89-f938d02450a5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:32.497683 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f01d92b5-bb27-447e-8e89-f938d02450a5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:32.511433 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f01d92b5-bb27-447e-8e89-f938d02450a5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0" status: 200 len: 1244 microversion: 2.1 time: 0.147182 Oct 23 01:30:32.516684 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2329/4582] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:32 2022] GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0 => generated 1244 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:32.619083 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-519686a6-fbdc-4640-af54-714ba7e56538 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:32.619936 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-519686a6-fbdc-4640-af54-714ba7e56538 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:32.633568 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-519686a6-fbdc-4640-af54-714ba7e56538 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:32.633568 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-519686a6-fbdc-4640-af54-714ba7e56538 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:32.633753 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-519686a6-fbdc-4640-af54-714ba7e56538 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:32.634367 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-519686a6-fbdc-4640-af54-714ba7e56538 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:32.634819 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-519686a6-fbdc-4640-af54-714ba7e56538 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:32.635297 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-519686a6-fbdc-4640-af54-714ba7e56538 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:32.706159 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ffb520f4-cc95-408f-a917-a9bb65b60e1d tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:32.706942 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ffb520f4-cc95-408f-a917-a9bb65b60e1d tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 9540f923-c640-45de-a49a-26008adab3ca] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:32.725750 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ffb520f4-cc95-408f-a917-a9bb65b60e1d tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:32.725900 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ffb520f4-cc95-408f-a917-a9bb65b60e1d tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:32.726568 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ffb520f4-cc95-408f-a917-a9bb65b60e1d tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:32.729061 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ffb520f4-cc95-408f-a917-a9bb65b60e1d tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:32.730126 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ffb520f4-cc95-408f-a917-a9bb65b60e1d tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:32.732653 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ffb520f4-cc95-408f-a917-a9bb65b60e1d tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:32.986953 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-519686a6-fbdc-4640-af54-714ba7e56538 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:33.008854 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-519686a6-fbdc-4640-af54-714ba7e56538 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:33.010619 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-519686a6-fbdc-4640-af54-714ba7e56538 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:33.012074 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-519686a6-fbdc-4640-af54-714ba7e56538 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1597 microversion: 2.20 time: 0.397938 Oct 23 01:30:33.016430 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ffb520f4-cc95-408f-a917-a9bb65b60e1d tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:33.025384 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2254/4583] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:30:32 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1597 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:30:33.028824 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ffb520f4-cc95-408f-a917-a9bb65b60e1d tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/9540f923-c640-45de-a49a-26008adab3ca" status: 200 len: 1292 microversion: 2.1 time: 0.326967 Oct 23 01:30:33.029878 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2330/4584] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:32 2022] GET /compute/v2.1/servers/9540f923-c640-45de-a49a-26008adab3ca => generated 1292 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:33.039484 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3851f1f2-ab0e-4e11-a05c-5baadfe6b919 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:33.040551 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3851f1f2-ab0e-4e11-a05c-5baadfe6b919 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:33.047397 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3851f1f2-ab0e-4e11-a05c-5baadfe6b919 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:33.048151 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3851f1f2-ab0e-4e11-a05c-5baadfe6b919 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:33.049458 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3851f1f2-ab0e-4e11-a05c-5baadfe6b919 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:33.050474 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3851f1f2-ab0e-4e11-a05c-5baadfe6b919 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:33.051179 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3851f1f2-ab0e-4e11-a05c-5baadfe6b919 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:33.051818 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3851f1f2-ab0e-4e11-a05c-5baadfe6b919 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:33.122408 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f9615ee4-245c-4796-92ec-c084b79535c5 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:33.123043 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f9615ee4-245c-4796-92ec-c084b79535c5 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: 79b6e08c-f496-40ee-b5ea-34392ac475ad] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:33.134068 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f9615ee4-245c-4796-92ec-c084b79535c5 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:33.134646 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f9615ee4-245c-4796-92ec-c084b79535c5 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:33.136462 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f9615ee4-245c-4796-92ec-c084b79535c5 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:33.137200 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f9615ee4-245c-4796-92ec-c084b79535c5 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:33.137675 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f9615ee4-245c-4796-92ec-c084b79535c5 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:33.138151 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f9615ee4-245c-4796-92ec-c084b79535c5 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:33.180620 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3851f1f2-ab0e-4e11-a05c-5baadfe6b919 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.145094 Oct 23 01:30:33.194773 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2255/4585] 10.222.0.42 () {60 vars in 1316 bytes} [Sun Oct 23 01:30:33 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a/os-interface => generated 284 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:30:33.216455 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f9615ee4-245c-4796-92ec-c084b79535c5 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:33.217365 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f9615ee4-245c-4796-92ec-c084b79535c5 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:33.218104 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f9615ee4-245c-4796-92ec-c084b79535c5 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:33.218782 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-f9615ee4-245c-4796-92ec-c084b79535c5 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lazy-loading 'fault' on Instance uuid 79b6e08c-f496-40ee-b5ea-34392ac475ad {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:30:33.297243 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f9615ee4-245c-4796-92ec-c084b79535c5 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:33.312139 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f9615ee4-245c-4796-92ec-c084b79535c5 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad" status: 200 len: 1310 microversion: 2.1 time: 0.193825 Oct 23 01:30:33.315902 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2331/4586] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:33 2022] GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad => generated 1310 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:33.543453 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7cbc68ee-799c-4bde-a742-71a23b2c42ed tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:33.547038 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7cbc68ee-799c-4bde-a742-71a23b2c42ed tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: e96f5e79-d832-4927-aef1-a45a815404b0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:33.566588 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7cbc68ee-799c-4bde-a742-71a23b2c42ed tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:33.567089 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7cbc68ee-799c-4bde-a742-71a23b2c42ed tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:33.567524 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7cbc68ee-799c-4bde-a742-71a23b2c42ed tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:33.568234 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7cbc68ee-799c-4bde-a742-71a23b2c42ed tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:33.568681 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7cbc68ee-799c-4bde-a742-71a23b2c42ed tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:33.571189 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7cbc68ee-799c-4bde-a742-71a23b2c42ed tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:33.576545 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=100 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:33.793786 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7cbc68ee-799c-4bde-a742-71a23b2c42ed tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:33.809430 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7cbc68ee-799c-4bde-a742-71a23b2c42ed tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0" status: 200 len: 1292 microversion: 2.1 time: 0.275044 Oct 23 01:30:33.823290 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2256/4587] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:33 2022] GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0 => generated 1292 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:34.056024 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a6d530d7-ab6f-4ac5-86c6-90d5afdeeb1c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:34.056660 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a6d530d7-ab6f-4ac5-86c6-90d5afdeeb1c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 9540f923-c640-45de-a49a-26008adab3ca] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:34.077192 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6d530d7-ab6f-4ac5-86c6-90d5afdeeb1c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:34.077703 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6d530d7-ab6f-4ac5-86c6-90d5afdeeb1c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:34.087301 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6d530d7-ab6f-4ac5-86c6-90d5afdeeb1c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:34.088498 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6d530d7-ab6f-4ac5-86c6-90d5afdeeb1c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:34.090192 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6d530d7-ab6f-4ac5-86c6-90d5afdeeb1c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:34.096611 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6d530d7-ab6f-4ac5-86c6-90d5afdeeb1c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:34.181436 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=14 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:34.335907 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=6 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:34.338051 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-849d136e-1699-4c93-bb72-a651a2b26fbe tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:34.339176 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-849d136e-1699-4c93-bb72-a651a2b26fbe tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: 79b6e08c-f496-40ee-b5ea-34392ac475ad] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:34.351140 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-849d136e-1699-4c93-bb72-a651a2b26fbe tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:34.351878 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-849d136e-1699-4c93-bb72-a651a2b26fbe tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:34.352927 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-849d136e-1699-4c93-bb72-a651a2b26fbe tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:34.353531 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-849d136e-1699-4c93-bb72-a651a2b26fbe tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:34.354185 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-849d136e-1699-4c93-bb72-a651a2b26fbe tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:34.354769 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-849d136e-1699-4c93-bb72-a651a2b26fbe tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:34.425068 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-849d136e-1699-4c93-bb72-a651a2b26fbe tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:34.425951 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-849d136e-1699-4c93-bb72-a651a2b26fbe tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:34.427418 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-849d136e-1699-4c93-bb72-a651a2b26fbe tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:34.429534 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-849d136e-1699-4c93-bb72-a651a2b26fbe tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lazy-loading 'fault' on Instance uuid 79b6e08c-f496-40ee-b5ea-34392ac475ad {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:30:34.588469 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-849d136e-1699-4c93-bb72-a651a2b26fbe tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:34.601131 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-849d136e-1699-4c93-bb72-a651a2b26fbe tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad" status: 200 len: 1310 microversion: 2.1 time: 0.267764 Oct 23 01:30:34.619033 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2257/4588] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:34 2022] GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad => generated 1310 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:34.632087 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a6d530d7-ab6f-4ac5-86c6-90d5afdeeb1c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:34.648572 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a6d530d7-ab6f-4ac5-86c6-90d5afdeeb1c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/9540f923-c640-45de-a49a-26008adab3ca" status: 200 len: 1292 microversion: 2.1 time: 0.596766 Oct 23 01:30:34.651019 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2332/4589] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:34 2022] GET /compute/v2.1/servers/9540f923-c640-45de-a49a-26008adab3ca => generated 1292 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:34.842192 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-576410bb-47dd-4609-97dc-e0e241ed2604 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:34.843221 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-576410bb-47dd-4609-97dc-e0e241ed2604 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: e96f5e79-d832-4927-aef1-a45a815404b0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:34.850951 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-576410bb-47dd-4609-97dc-e0e241ed2604 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:34.851730 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-576410bb-47dd-4609-97dc-e0e241ed2604 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:34.854169 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-576410bb-47dd-4609-97dc-e0e241ed2604 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:34.856350 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-576410bb-47dd-4609-97dc-e0e241ed2604 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:34.856918 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-576410bb-47dd-4609-97dc-e0e241ed2604 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:34.857501 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-576410bb-47dd-4609-97dc-e0e241ed2604 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:34.955311 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-576410bb-47dd-4609-97dc-e0e241ed2604 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:34.978068 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-576410bb-47dd-4609-97dc-e0e241ed2604 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0" status: 200 len: 1298 microversion: 2.1 time: 0.143421 Oct 23 01:30:34.990245 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2258/4590] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:34 2022] GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0 => generated 1298 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:35.030060 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-acb15bc4-e2ba-4f33-b92b-c73d793eeca2 req-14a10d6b-a5af-4892-bcdc-a943feeeebd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1d0765d-d720-40d2-b168-058e013fab0a", "tag": "9d275317-d5ad-4bae-8215-25b674a45c60"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:30:35.048015 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-acb15bc4-e2ba-4f33-b92b-c73d793eeca2 req-14a10d6b-a5af-4892-bcdc-a943feeeebd9 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:35.059470 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-acb15bc4-e2ba-4f33-b92b-c73d793eeca2 req-14a10d6b-a5af-4892-bcdc-a943feeeebd9 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:35.060701 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-acb15bc4-e2ba-4f33-b92b-c73d793eeca2 req-14a10d6b-a5af-4892-bcdc-a943feeeebd9 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:35.083530 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-acb15bc4-e2ba-4f33-b92b-c73d793eeca2 req-14a10d6b-a5af-4892-bcdc-a943feeeebd9 service nova] Creating event network-changed:9d275317-d5ad-4bae-8215-25b674a45c60 for instance b1d0765d-d720-40d2-b168-058e013fab0a on n-h2-master-1 Oct 23 01:30:35.089574 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-acb15bc4-e2ba-4f33-b92b-c73d793eeca2 req-14a10d6b-a5af-4892-bcdc-a943feeeebd9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063393 Oct 23 01:30:35.095072 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2333/4591] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:30:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:30:35.628749 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-955342de-66aa-482a-ac2e-376064c208cf tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:35.630127 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-955342de-66aa-482a-ac2e-376064c208cf tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: 79b6e08c-f496-40ee-b5ea-34392ac475ad] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:35.649124 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-955342de-66aa-482a-ac2e-376064c208cf tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:35.649124 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-955342de-66aa-482a-ac2e-376064c208cf tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:35.649124 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-955342de-66aa-482a-ac2e-376064c208cf tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:35.649124 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-955342de-66aa-482a-ac2e-376064c208cf tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:35.649124 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-955342de-66aa-482a-ac2e-376064c208cf tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:35.649651 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-955342de-66aa-482a-ac2e-376064c208cf tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:35.681513 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2509d113-aabc-425d-9550-bbb08617b88c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:35.682616 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2509d113-aabc-425d-9550-bbb08617b88c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 9540f923-c640-45de-a49a-26008adab3ca] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:35.691748 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2509d113-aabc-425d-9550-bbb08617b88c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:35.696947 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2509d113-aabc-425d-9550-bbb08617b88c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:35.700007 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-955342de-66aa-482a-ac2e-376064c208cf tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] HTTP exception thrown: Instance 79b6e08c-f496-40ee-b5ea-34392ac475ad could not be found. Oct 23 01:30:35.700557 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2509d113-aabc-425d-9550-bbb08617b88c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:35.703917 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2509d113-aabc-425d-9550-bbb08617b88c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-955342de-66aa-482a-ac2e-376064c208cf tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Request method failure captured: Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad HTTP/1.1 Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJjoDrHh3fkd0MkXWzJDILf8Pmt6TgrIp0lCmHYbtJJuP6BekxcNpyaYUlOxFMsQMEeCP54UYanJ-WV-SG8CGbd3fXwivvPS10nnBxElmGtwqWJNx8Tj89wQDU8xVggy4YgKJNfybQDd2cMOq_EpWXI6JFTIW976H7LVcRKfYeVVCVg Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 9901e62cf4f94f6c9be3ff897caedf19 Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ListServerFiltersTestJSON-474025208 Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9901e62cf4f94f6c9be3ff897caedf19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9901e62cf4f94f6c9be3ff897caedf19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9901e62cf4f94f6c9be3ff897caedf19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9901e62cf4f94f6c9be3ff897caedf19"}]}] Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ListServerFiltersTestJSON-474025208 Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 9901e62cf4f94f6c9be3ff897caedf19 Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-474025208 Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ListServerFiltersTestJSON-474025208-project Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 0a92f307441747f29f583ddf004e8f21 Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ListServerFiltersTestJSON-474025208-project Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 79b6e08c-f496-40ee-b5ea-34392ac475ad could not be found. Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '79b6e08c-f496-40ee-b5ea-34392ac475ad'} Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79b6e08c-f496-40ee-b5ea-34392ac475ad could not be found. Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79b6e08c-f496-40ee-b5ea-34392ac475ad could not be found. Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:30:35.704072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:30:35.709302 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:30:35.709302 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:30:35.709302 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:30:35.709302 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:30:35.709302 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:30:35.709302 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79b6e08c-f496-40ee-b5ea-34392ac475ad could not be found. Oct 23 01:30:35.709302 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:30:35.709302 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-955342de-66aa-482a-ac2e-376064c208cf tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Returning 404 to user: Instance 79b6e08c-f496-40ee-b5ea-34392ac475ad could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:30:35.709302 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-955342de-66aa-482a-ac2e-376064c208cf tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad" status: 404 len: 111 microversion: 2.1 time: 0.084681 Oct 23 01:30:35.718520 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2509d113-aabc-425d-9550-bbb08617b88c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:35.718520 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2509d113-aabc-425d-9550-bbb08617b88c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:35.718855 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2259/4592] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:35 2022] GET /compute/v2.1/servers/79b6e08c-f496-40ee-b5ea-34392ac475ad => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:30:35.724792 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f1bc0d1f-b8a9-4794-9125-ef9fae3929a1 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:35.725307 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f1bc0d1f-b8a9-4794-9125-ef9fae3929a1 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: b4f3e58c-311d-4b8a-b231-67e8fbc8cd3e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:35.742439 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f1bc0d1f-b8a9-4794-9125-ef9fae3929a1 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:35.743195 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f1bc0d1f-b8a9-4794-9125-ef9fae3929a1 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:35.750763 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f1bc0d1f-b8a9-4794-9125-ef9fae3929a1 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:35.750763 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f1bc0d1f-b8a9-4794-9125-ef9fae3929a1 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:35.750763 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f1bc0d1f-b8a9-4794-9125-ef9fae3929a1 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:35.750763 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f1bc0d1f-b8a9-4794-9125-ef9fae3929a1 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:35.812379 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f1bc0d1f-b8a9-4794-9125-ef9fae3929a1 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: b4f3e58c-311d-4b8a-b231-67e8fbc8cd3e] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:30:36.039097 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2509d113-aabc-425d-9550-bbb08617b88c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:36.053265 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2509d113-aabc-425d-9550-bbb08617b88c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/9540f923-c640-45de-a49a-26008adab3ca" status: 200 len: 1473 microversion: 2.1 time: 0.376275 Oct 23 01:30:36.066331 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2334/4593] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:35 2022] GET /compute/v2.1/servers/9540f923-c640-45de-a49a-26008adab3ca => generated 1473 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:36.071528 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-91a81824-f8ae-402b-8e3e-1035ace0e1ca tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:36.072415 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-91a81824-f8ae-402b-8e3e-1035ace0e1ca tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: e96f5e79-d832-4927-aef1-a45a815404b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:36.081765 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-91a81824-f8ae-402b-8e3e-1035ace0e1ca tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:36.084347 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-91a81824-f8ae-402b-8e3e-1035ace0e1ca tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:36.085947 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-91a81824-f8ae-402b-8e3e-1035ace0e1ca tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:36.090469 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-91a81824-f8ae-402b-8e3e-1035ace0e1ca tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:36.091229 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-91a81824-f8ae-402b-8e3e-1035ace0e1ca tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:36.091870 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-91a81824-f8ae-402b-8e3e-1035ace0e1ca tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:36.290929 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f1bc0d1f-b8a9-4794-9125-ef9fae3929a1 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b4f3e58c-311d-4b8a-b231-67e8fbc8cd3e" status: 204 len: 0 microversion: 2.1 time: 0.573064 Oct 23 01:30:36.293474 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2260/4594] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:30:35 2022] DELETE /compute/v2.1/servers/b4f3e58c-311d-4b8a-b231-67e8fbc8cd3e => generated 0 bytes in 577 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 23 01:30:36.312972 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f9fcaa64-97f6-43fb-aac8-0cce57f95aaa tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1182829628", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:30:36.427735 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-f9fcaa64-97f6-43fb-aac8-0cce57f95aaa tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] validate_networks() for [('54c8030f-5807-4507-8aa3-283b114a73f4', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:30:36.591248 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-91a81824-f8ae-402b-8e3e-1035ace0e1ca tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:36.600130 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-91a81824-f8ae-402b-8e3e-1035ace0e1ca tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0" status: 200 len: 1366 microversion: 2.1 time: 0.532569 Oct 23 01:30:36.601313 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2335/4595] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:36 2022] GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0 => generated 1366 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:36.606343 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-213d2fd8-44c9-483d-8ade-a8ba3ec13152 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:36.607272 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-213d2fd8-44c9-483d-8ade-a8ba3ec13152 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: b4f3e58c-311d-4b8a-b231-67e8fbc8cd3e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:36.614842 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-213d2fd8-44c9-483d-8ade-a8ba3ec13152 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:36.615623 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-213d2fd8-44c9-483d-8ade-a8ba3ec13152 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:36.616244 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-213d2fd8-44c9-483d-8ade-a8ba3ec13152 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:36.621014 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-213d2fd8-44c9-483d-8ade-a8ba3ec13152 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:36.621014 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-213d2fd8-44c9-483d-8ade-a8ba3ec13152 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:36.621014 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-213d2fd8-44c9-483d-8ade-a8ba3ec13152 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:37.322407 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-213d2fd8-44c9-483d-8ade-a8ba3ec13152 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:37.336059 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-213d2fd8-44c9-483d-8ade-a8ba3ec13152 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/b4f3e58c-311d-4b8a-b231-67e8fbc8cd3e" status: 200 len: 1518 microversion: 2.1 time: 0.733388 Oct 23 01:30:37.346866 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2336/4596] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:36 2022] GET /compute/v2.1/servers/b4f3e58c-311d-4b8a-b231-67e8fbc8cd3e => generated 1518 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:37.628867 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-f9fcaa64-97f6-43fb-aac8-0cce57f95aaa tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:30:37.632235 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-f9fcaa64-97f6-43fb-aac8-0cce57f95aaa tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:30:37.632932 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-f9fcaa64-97f6-43fb-aac8-0cce57f95aaa tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:30:37.634564 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-f9fcaa64-97f6-43fb-aac8-0cce57f95aaa tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:30:37.634981 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-f9fcaa64-97f6-43fb-aac8-0cce57f95aaa tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:30:37.637218 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f86ec2c0-9716-49b5-95e8-3802e7959e6e tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:37.637838 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f86ec2c0-9716-49b5-95e8-3802e7959e6e tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: e96f5e79-d832-4927-aef1-a45a815404b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:37.651640 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f86ec2c0-9716-49b5-95e8-3802e7959e6e tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:37.652710 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=25 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:37.654376 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f9fcaa64-97f6-43fb-aac8-0cce57f95aaa tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:37.654857 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f9fcaa64-97f6-43fb-aac8-0cce57f95aaa tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:37.659192 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f9fcaa64-97f6-43fb-aac8-0cce57f95aaa tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:37.659192 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f9fcaa64-97f6-43fb-aac8-0cce57f95aaa tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:37.659192 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f9fcaa64-97f6-43fb-aac8-0cce57f95aaa tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:37.659192 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f9fcaa64-97f6-43fb-aac8-0cce57f95aaa tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:37.660174 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f86ec2c0-9716-49b5-95e8-3802e7959e6e tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:37.660782 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f86ec2c0-9716-49b5-95e8-3802e7959e6e tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:37.661776 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f86ec2c0-9716-49b5-95e8-3802e7959e6e tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:37.662478 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f86ec2c0-9716-49b5-95e8-3802e7959e6e tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:37.663199 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f86ec2c0-9716-49b5-95e8-3802e7959e6e tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:37.687280 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=17 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:37.712921 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-f9fcaa64-97f6-43fb-aac8-0cce57f95aaa tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Getting quotas for project e2ee2ea8399e42a5a5cd0d0ddeb192b5. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:30:37.723139 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-f9fcaa64-97f6-43fb-aac8-0cce57f95aaa tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Getting quotas for user 77197152ea5040bab602d5381d21341a and project e2ee2ea8399e42a5a5cd0d0ddeb192b5. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:30:37.744030 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f9fcaa64-97f6-43fb-aac8-0cce57f95aaa tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:30:37.747158 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f9fcaa64-97f6-43fb-aac8-0cce57f95aaa tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: a6c0b80d-cedc-4759-9571-9ec63f7a2188] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:30:38.058145 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f9fcaa64-97f6-43fb-aac8-0cce57f95aaa tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.755633 Oct 23 01:30:38.061086 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2261/4597] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:30:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:30:38.085103 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7735ceec-6dff-447b-8b05-0e80854ee199 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:38.086248 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7735ceec-6dff-447b-8b05-0e80854ee199 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: a6c0b80d-cedc-4759-9571-9ec63f7a2188] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:38.141900 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7735ceec-6dff-447b-8b05-0e80854ee199 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: a6c0b80d-cedc-4759-9571-9ec63f7a2188] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:30:38.244118 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f86ec2c0-9716-49b5-95e8-3802e7959e6e tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:38.263383 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f86ec2c0-9716-49b5-95e8-3802e7959e6e tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0" status: 200 len: 1366 microversion: 2.1 time: 0.633790 Oct 23 01:30:38.293362 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2337/4598] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:37 2022] GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0 => generated 1366 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:38.363786 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-97659279-7791-4507-9e7b-9a6f6fdac74d tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:38.363786 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-97659279-7791-4507-9e7b-9a6f6fdac74d tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: b4f3e58c-311d-4b8a-b231-67e8fbc8cd3e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:38.395378 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-97659279-7791-4507-9e7b-9a6f6fdac74d tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:38.399301 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-97659279-7791-4507-9e7b-9a6f6fdac74d tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:38.399301 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-97659279-7791-4507-9e7b-9a6f6fdac74d tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:38.399301 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-97659279-7791-4507-9e7b-9a6f6fdac74d tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:38.401857 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-97659279-7791-4507-9e7b-9a6f6fdac74d tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:38.402820 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-97659279-7791-4507-9e7b-9a6f6fdac74d tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:38.732560 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-97659279-7791-4507-9e7b-9a6f6fdac74d tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:38.746363 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-97659279-7791-4507-9e7b-9a6f6fdac74d tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/b4f3e58c-311d-4b8a-b231-67e8fbc8cd3e" status: 200 len: 1518 microversion: 2.1 time: 0.385331 Oct 23 01:30:38.747313 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2338/4599] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:38 2022] GET /compute/v2.1/servers/b4f3e58c-311d-4b8a-b231-67e8fbc8cd3e => generated 1518 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:30:38.958228 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7735ceec-6dff-447b-8b05-0e80854ee199 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a6c0b80d-cedc-4759-9571-9ec63f7a2188" status: 204 len: 0 microversion: 2.1 time: 0.888706 Oct 23 01:30:38.959559 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2262/4600] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:30:38 2022] DELETE /compute/v2.1/servers/a6c0b80d-cedc-4759-9571-9ec63f7a2188 => generated 0 bytes in 891 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:30:38.985049 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7724cbcd-4d06-4c84-b550-72ae14b53fae tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:38.986809 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7724cbcd-4d06-4c84-b550-72ae14b53fae tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: a6c0b80d-cedc-4759-9571-9ec63f7a2188] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:39.034946 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-7724cbcd-4d06-4c84-b550-72ae14b53fae tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] HTTP exception thrown: Instance a6c0b80d-cedc-4759-9571-9ec63f7a2188 could not be found. Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7724cbcd-4d06-4c84-b550-72ae14b53fae tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Request method failure captured: Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/a6c0b80d-cedc-4759-9571-9ec63f7a2188 HTTP/1.1 Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJkiigL5TCEu6eSSAcyvyVmYwcN25zFDHPVJqRKHbtxzIEn87jCeqAfp7Z9r3Mqhyb3sj4ihzI_o6sMFkrbUwNL-zNG9d9yXVxVjtum4uC7NU-HTDI6Yq0W2nY2ZxVUGKOV2HfdfrtC_JKFgX2qnR1YVSIaIVW5JxazPUN9LbJjq984 Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: e2ee2ea8399e42a5a5cd0d0ddeb192b5 Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersTestJSON-245534565 Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}] Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersTestJSON-245534565 Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: e2ee2ea8399e42a5a5cd0d0ddeb192b5 Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersTestJSON-245534565 Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersTestJSON-245534565-project Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 77197152ea5040bab602d5381d21341a Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersTestJSON-245534565-project Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: exception: Instance a6c0b80d-cedc-4759-9571-9ec63f7a2188 could not be found. Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'a6c0b80d-cedc-4759-9571-9ec63f7a2188'} Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance a6c0b80d-cedc-4759-9571-9ec63f7a2188 Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6c0b80d-cedc-4759-9571-9ec63f7a2188 could not be found. Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:30:39.046612 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:30:39.051688 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:30:39.051688 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:30:39.051688 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:30:39.051688 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:30:39.051688 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:30:39.051688 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:30:39.051688 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:30:39.051688 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:30:39.051688 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:30:39.051688 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:30:39.051688 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6c0b80d-cedc-4759-9571-9ec63f7a2188 could not be found. Oct 23 01:30:39.051688 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:30:39.051688 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:30:39.051688 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:30:39.051688 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:30:39.051688 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:30:39.051688 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:30:39.051688 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:30:39.051688 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:30:39.051688 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6c0b80d-cedc-4759-9571-9ec63f7a2188 could not be found. Oct 23 01:30:39.051688 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:30:39.051688 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7724cbcd-4d06-4c84-b550-72ae14b53fae tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Returning 404 to user: Instance a6c0b80d-cedc-4759-9571-9ec63f7a2188 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:30:39.051688 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7724cbcd-4d06-4c84-b550-72ae14b53fae tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/a6c0b80d-cedc-4759-9571-9ec63f7a2188" status: 404 len: 111 microversion: 2.1 time: 0.075212 Oct 23 01:30:39.051688 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2339/4601] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:38 2022] GET /compute/v2.1/servers/a6c0b80d-cedc-4759-9571-9ec63f7a2188 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:30:39.138573 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-359c4f30-26b4-4901-b5f0-7f0c1ea31a56 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1477847413", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "54c8030f-5807-4507-8aa3-283b114a73f4"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:30:39.228155 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-359c4f30-26b4-4901-b5f0-7f0c1ea31a56 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] validate_networks() for [('54c8030f-5807-4507-8aa3-283b114a73f4', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:30:39.292979 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-831f9c65-d2db-41a3-ae19-49ef8cc976c9 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:39.293606 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-831f9c65-d2db-41a3-ae19-49ef8cc976c9 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: e96f5e79-d832-4927-aef1-a45a815404b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:39.310978 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-831f9c65-d2db-41a3-ae19-49ef8cc976c9 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:39.311482 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-831f9c65-d2db-41a3-ae19-49ef8cc976c9 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:39.311936 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-831f9c65-d2db-41a3-ae19-49ef8cc976c9 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:39.312708 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-831f9c65-d2db-41a3-ae19-49ef8cc976c9 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:39.313189 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-831f9c65-d2db-41a3-ae19-49ef8cc976c9 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:39.321918 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-831f9c65-d2db-41a3-ae19-49ef8cc976c9 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:39.746525 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-831f9c65-d2db-41a3-ae19-49ef8cc976c9 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:39.763041 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-831f9c65-d2db-41a3-ae19-49ef8cc976c9 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0" status: 200 len: 1366 microversion: 2.1 time: 0.472490 Oct 23 01:30:39.765774 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2340/4602] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:39 2022] GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0 => generated 1366 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:39.779134 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4d903b52-9ff1-4996-869e-5c5ecd39ab78 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:39.781804 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4d903b52-9ff1-4996-869e-5c5ecd39ab78 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: b4f3e58c-311d-4b8a-b231-67e8fbc8cd3e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:39.797663 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4d903b52-9ff1-4996-869e-5c5ecd39ab78 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:39.801785 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4d903b52-9ff1-4996-869e-5c5ecd39ab78 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:39.802900 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4d903b52-9ff1-4996-869e-5c5ecd39ab78 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:39.804784 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4d903b52-9ff1-4996-869e-5c5ecd39ab78 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:39.806650 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4d903b52-9ff1-4996-869e-5c5ecd39ab78 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:39.811279 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4d903b52-9ff1-4996-869e-5c5ecd39ab78 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:40.146995 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4d903b52-9ff1-4996-869e-5c5ecd39ab78 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:40.166278 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4d903b52-9ff1-4996-869e-5c5ecd39ab78 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/b4f3e58c-311d-4b8a-b231-67e8fbc8cd3e" status: 200 len: 1476 microversion: 2.1 time: 0.387166 Oct 23 01:30:40.166976 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2341/4603] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:39 2022] GET /compute/v2.1/servers/b4f3e58c-311d-4b8a-b231-67e8fbc8cd3e => generated 1476 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:40.180482 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-7c7a5956-4e70-44a2-b8ae-c58b1e427d3e req-adfbaf54-4d3f-4698-b0a4-b6db0a29a15f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4f3e58c-311d-4b8a-b231-67e8fbc8cd3e", "name": "network-vif-deleted", "tag": "44040275-ae3f-48cd-92f2-f889f7ea2654"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:30:40.211096 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-7c7a5956-4e70-44a2-b8ae-c58b1e427d3e req-adfbaf54-4d3f-4698-b0a4-b6db0a29a15f service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:40.211587 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-7c7a5956-4e70-44a2-b8ae-c58b1e427d3e req-adfbaf54-4d3f-4698-b0a4-b6db0a29a15f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:40.212029 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-7c7a5956-4e70-44a2-b8ae-c58b1e427d3e req-adfbaf54-4d3f-4698-b0a4-b6db0a29a15f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:40.246963 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-7c7a5956-4e70-44a2-b8ae-c58b1e427d3e req-adfbaf54-4d3f-4698-b0a4-b6db0a29a15f service nova] Creating event network-vif-deleted:44040275-ae3f-48cd-92f2-f889f7ea2654 for instance b4f3e58c-311d-4b8a-b231-67e8fbc8cd3e on n-h1-master-1 Oct 23 01:30:40.266137 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-7c7a5956-4e70-44a2-b8ae-c58b1e427d3e req-adfbaf54-4d3f-4698-b0a4-b6db0a29a15f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094650 Oct 23 01:30:40.271076 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2342/4604] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:30:40.271826 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-359c4f30-26b4-4901-b5f0-7f0c1ea31a56 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:30:40.271826 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-359c4f30-26b4-4901-b5f0-7f0c1ea31a56 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:30:40.272718 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-359c4f30-26b4-4901-b5f0-7f0c1ea31a56 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:30:40.273805 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-359c4f30-26b4-4901-b5f0-7f0c1ea31a56 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:30:40.274469 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-359c4f30-26b4-4901-b5f0-7f0c1ea31a56 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:30:40.294504 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-359c4f30-26b4-4901-b5f0-7f0c1ea31a56 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:40.294504 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-359c4f30-26b4-4901-b5f0-7f0c1ea31a56 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:40.297149 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-359c4f30-26b4-4901-b5f0-7f0c1ea31a56 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:40.299849 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-359c4f30-26b4-4901-b5f0-7f0c1ea31a56 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:40.303048 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-359c4f30-26b4-4901-b5f0-7f0c1ea31a56 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:40.304587 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-359c4f30-26b4-4901-b5f0-7f0c1ea31a56 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:40.364015 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-359c4f30-26b4-4901-b5f0-7f0c1ea31a56 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Getting quotas for project e2ee2ea8399e42a5a5cd0d0ddeb192b5. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:30:40.370575 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-359c4f30-26b4-4901-b5f0-7f0c1ea31a56 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Getting quotas for user 77197152ea5040bab602d5381d21341a and project e2ee2ea8399e42a5a5cd0d0ddeb192b5. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:30:40.387798 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-359c4f30-26b4-4901-b5f0-7f0c1ea31a56 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:30:40.390335 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-359c4f30-26b4-4901-b5f0-7f0c1ea31a56 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 9c5de49d-999c-44da-a25c-e79327652449] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:30:40.568913 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-359c4f30-26b4-4901-b5f0-7f0c1ea31a56 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.434436 Oct 23 01:30:40.570770 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2263/4605] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:30:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1437 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:30:40.623446 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1d7a62e3-2cbe-4963-a7d1-79799ae195fd tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:40.632132 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1d7a62e3-2cbe-4963-a7d1-79799ae195fd tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 9c5de49d-999c-44da-a25c-e79327652449] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:40.759602 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1d7a62e3-2cbe-4963-a7d1-79799ae195fd tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:40.768386 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1d7a62e3-2cbe-4963-a7d1-79799ae195fd tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/9c5de49d-999c-44da-a25c-e79327652449" status: 200 len: 1221 microversion: 2.1 time: 0.177061 Oct 23 01:30:40.769723 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2343/4606] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:40 2022] GET /compute/v2.1/servers/9c5de49d-999c-44da-a25c-e79327652449 => generated 1221 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:40.789250 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d092a5d7-3747-45c5-b800-c76126151d36 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:40.789967 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d092a5d7-3747-45c5-b800-c76126151d36 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: e96f5e79-d832-4927-aef1-a45a815404b0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:40.808125 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d092a5d7-3747-45c5-b800-c76126151d36 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:40.808924 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d092a5d7-3747-45c5-b800-c76126151d36 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:40.809053 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d092a5d7-3747-45c5-b800-c76126151d36 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:40.813849 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d092a5d7-3747-45c5-b800-c76126151d36 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:40.814567 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d092a5d7-3747-45c5-b800-c76126151d36 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:40.815146 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d092a5d7-3747-45c5-b800-c76126151d36 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:41.143250 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d092a5d7-3747-45c5-b800-c76126151d36 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:41.154436 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d092a5d7-3747-45c5-b800-c76126151d36 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0" status: 200 len: 1366 microversion: 2.1 time: 0.369101 Oct 23 01:30:41.155318 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2264/4607] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:40 2022] GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0 => generated 1366 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:30:41.195975 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bdaa6127-5493-47b0-b22d-c7e78876d773 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:41.196894 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bdaa6127-5493-47b0-b22d-c7e78876d773 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: b4f3e58c-311d-4b8a-b231-67e8fbc8cd3e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:41.208889 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bdaa6127-5493-47b0-b22d-c7e78876d773 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:41.209754 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bdaa6127-5493-47b0-b22d-c7e78876d773 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:41.210483 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bdaa6127-5493-47b0-b22d-c7e78876d773 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:41.211503 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bdaa6127-5493-47b0-b22d-c7e78876d773 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:41.211961 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bdaa6127-5493-47b0-b22d-c7e78876d773 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:41.212836 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bdaa6127-5493-47b0-b22d-c7e78876d773 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:41.252440 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bdaa6127-5493-47b0-b22d-c7e78876d773 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:41.253202 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bdaa6127-5493-47b0-b22d-c7e78876d773 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:41.255984 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bdaa6127-5493-47b0-b22d-c7e78876d773 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:41.258179 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-bdaa6127-5493-47b0-b22d-c7e78876d773 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lazy-loading 'fault' on Instance uuid b4f3e58c-311d-4b8a-b231-67e8fbc8cd3e {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:30:41.261472 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=100 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:41.338243 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bdaa6127-5493-47b0-b22d-c7e78876d773 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:41.347123 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bdaa6127-5493-47b0-b22d-c7e78876d773 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/b4f3e58c-311d-4b8a-b231-67e8fbc8cd3e" status: 200 len: 1311 microversion: 2.1 time: 0.157408 Oct 23 01:30:41.375128 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2344/4608] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:41 2022] GET /compute/v2.1/servers/b4f3e58c-311d-4b8a-b231-67e8fbc8cd3e => generated 1311 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:41.796578 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-97eb0155-57e1-4d66-b202-728d1f9ae150 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:41.797299 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-97eb0155-57e1-4d66-b202-728d1f9ae150 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 9c5de49d-999c-44da-a25c-e79327652449] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:41.804002 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=9,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:41.903239 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-97eb0155-57e1-4d66-b202-728d1f9ae150 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:41.911330 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-97eb0155-57e1-4d66-b202-728d1f9ae150 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/9c5de49d-999c-44da-a25c-e79327652449" status: 200 len: 1221 microversion: 2.1 time: 0.119246 Oct 23 01:30:41.912096 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2265/4609] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:41 2022] GET /compute/v2.1/servers/9c5de49d-999c-44da-a25c-e79327652449 => generated 1221 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:42.182110 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-caa96383-08ca-4686-b0ab-c16ef49266f7 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:42.183636 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-caa96383-08ca-4686-b0ab-c16ef49266f7 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: e96f5e79-d832-4927-aef1-a45a815404b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:42.195058 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-caa96383-08ca-4686-b0ab-c16ef49266f7 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:42.196068 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-caa96383-08ca-4686-b0ab-c16ef49266f7 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:42.196930 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-caa96383-08ca-4686-b0ab-c16ef49266f7 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:42.198011 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-caa96383-08ca-4686-b0ab-c16ef49266f7 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:42.198582 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-caa96383-08ca-4686-b0ab-c16ef49266f7 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:42.199421 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-caa96383-08ca-4686-b0ab-c16ef49266f7 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:42.285508 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-5d14d458-f6f7-4944-86ed-71dbff7728bf req-599f7f8e-0e7a-4dce-955f-9a5d0241a60f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e96f5e79-d832-4927-aef1-a45a815404b0", "tag": "31d7ea8a-db73-4a69-a6f8-466b312577b1"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:30:42.304124 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-5d14d458-f6f7-4944-86ed-71dbff7728bf req-599f7f8e-0e7a-4dce-955f-9a5d0241a60f service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:42.304809 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-5d14d458-f6f7-4944-86ed-71dbff7728bf req-599f7f8e-0e7a-4dce-955f-9a5d0241a60f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:42.305241 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-5d14d458-f6f7-4944-86ed-71dbff7728bf req-599f7f8e-0e7a-4dce-955f-9a5d0241a60f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:42.325875 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-5d14d458-f6f7-4944-86ed-71dbff7728bf req-599f7f8e-0e7a-4dce-955f-9a5d0241a60f service nova] Creating event network-changed:31d7ea8a-db73-4a69-a6f8-466b312577b1 for instance e96f5e79-d832-4927-aef1-a45a815404b0 on n-h1-master-1 Oct 23 01:30:42.336268 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-5d14d458-f6f7-4944-86ed-71dbff7728bf req-599f7f8e-0e7a-4dce-955f-9a5d0241a60f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054796 Oct 23 01:30:42.337912 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2266/4610] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:30:42.372438 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-77e15ae9-1bc8-4958-8d0e-53b7d74ed87a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:42.373189 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-77e15ae9-1bc8-4958-8d0e-53b7d74ed87a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: b4f3e58c-311d-4b8a-b231-67e8fbc8cd3e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:42.389713 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-77e15ae9-1bc8-4958-8d0e-53b7d74ed87a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:42.389713 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-77e15ae9-1bc8-4958-8d0e-53b7d74ed87a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:42.393028 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-77e15ae9-1bc8-4958-8d0e-53b7d74ed87a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:42.397427 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-77e15ae9-1bc8-4958-8d0e-53b7d74ed87a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:42.399903 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-77e15ae9-1bc8-4958-8d0e-53b7d74ed87a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:42.402090 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-77e15ae9-1bc8-4958-8d0e-53b7d74ed87a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:42.420838 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-caa96383-08ca-4686-b0ab-c16ef49266f7 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:42.429451 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-caa96383-08ca-4686-b0ab-c16ef49266f7 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0" status: 200 len: 1366 microversion: 2.1 time: 0.254021 Oct 23 01:30:42.430417 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2345/4611] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:42 2022] GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0 => generated 1366 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-77e15ae9-1bc8-4958-8d0e-53b7d74ed87a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] HTTP exception thrown: Instance b4f3e58c-311d-4b8a-b231-67e8fbc8cd3e could not be found. Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-77e15ae9-1bc8-4958-8d0e-53b7d74ed87a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Request method failure captured: Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/b4f3e58c-311d-4b8a-b231-67e8fbc8cd3e HTTP/1.1 Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJjoDrHh3fkd0MkXWzJDILf8Pmt6TgrIp0lCmHYbtJJuP6BekxcNpyaYUlOxFMsQMEeCP54UYanJ-WV-SG8CGbd3fXwivvPS10nnBxElmGtwqWJNx8Tj89wQDU8xVggy4YgKJNfybQDd2cMOq_EpWXI6JFTIW976H7LVcRKfYeVVCVg Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 9901e62cf4f94f6c9be3ff897caedf19 Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ListServerFiltersTestJSON-474025208 Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9901e62cf4f94f6c9be3ff897caedf19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9901e62cf4f94f6c9be3ff897caedf19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9901e62cf4f94f6c9be3ff897caedf19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9901e62cf4f94f6c9be3ff897caedf19"}]}] Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ListServerFiltersTestJSON-474025208 Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 9901e62cf4f94f6c9be3ff897caedf19 Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-474025208 Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ListServerFiltersTestJSON-474025208-project Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 0a92f307441747f29f583ddf004e8f21 Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ListServerFiltersTestJSON-474025208-project Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: exception: Instance b4f3e58c-311d-4b8a-b231-67e8fbc8cd3e could not be found. Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'b4f3e58c-311d-4b8a-b231-67e8fbc8cd3e'} Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4f3e58c-311d-4b8a-b231-67e8fbc8cd3e could not be found. Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:30:42.452691 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:30:42.457514 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4f3e58c-311d-4b8a-b231-67e8fbc8cd3e could not be found. Oct 23 01:30:42.457514 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:30:42.457514 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:30:42.457514 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:30:42.457514 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:30:42.457514 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:30:42.457514 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:30:42.457514 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:30:42.457514 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:30:42.457514 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4f3e58c-311d-4b8a-b231-67e8fbc8cd3e could not be found. Oct 23 01:30:42.457514 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:30:42.457514 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-77e15ae9-1bc8-4958-8d0e-53b7d74ed87a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Returning 404 to user: Instance b4f3e58c-311d-4b8a-b231-67e8fbc8cd3e could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:30:42.457514 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-77e15ae9-1bc8-4958-8d0e-53b7d74ed87a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/b4f3e58c-311d-4b8a-b231-67e8fbc8cd3e" status: 404 len: 111 microversion: 2.1 time: 0.082577 Oct 23 01:30:42.457514 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2267/4612] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:42 2022] GET /compute/v2.1/servers/b4f3e58c-311d-4b8a-b231-67e8fbc8cd3e => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 01:30:42.460129 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b5d4ef0f-dd17-4d17-8b38-31427aa8f35a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:42.460638 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b5d4ef0f-dd17-4d17-8b38-31427aa8f35a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: e0bb5109-7f58-469c-b403-057248427835] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:42.472513 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5d4ef0f-dd17-4d17-8b38-31427aa8f35a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:42.474238 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5d4ef0f-dd17-4d17-8b38-31427aa8f35a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:42.474238 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5d4ef0f-dd17-4d17-8b38-31427aa8f35a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:42.474238 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5d4ef0f-dd17-4d17-8b38-31427aa8f35a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:42.474665 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5d4ef0f-dd17-4d17-8b38-31427aa8f35a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:42.475102 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5d4ef0f-dd17-4d17-8b38-31427aa8f35a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:42.509946 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b5d4ef0f-dd17-4d17-8b38-31427aa8f35a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: e0bb5109-7f58-469c-b403-057248427835] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:30:42.935993 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-503ba9f9-933d-4214-a9ae-4c032df4d9b0 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:42.937254 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-503ba9f9-933d-4214-a9ae-4c032df4d9b0 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 9c5de49d-999c-44da-a25c-e79327652449] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:42.944901 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-503ba9f9-933d-4214-a9ae-4c032df4d9b0 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:42.945402 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-503ba9f9-933d-4214-a9ae-4c032df4d9b0 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:42.945941 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-503ba9f9-933d-4214-a9ae-4c032df4d9b0 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:42.953233 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-503ba9f9-933d-4214-a9ae-4c032df4d9b0 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:42.953735 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-503ba9f9-933d-4214-a9ae-4c032df4d9b0 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:42.966724 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-503ba9f9-933d-4214-a9ae-4c032df4d9b0 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:43.057279 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b5d4ef0f-dd17-4d17-8b38-31427aa8f35a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835" status: 204 len: 0 microversion: 2.1 time: 0.599203 Oct 23 01:30:43.058672 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2346/4613] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:30:42 2022] DELETE /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:30:43.073453 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-580283be-e989-46fb-b00d-f8b117f61a6a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:43.074221 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-580283be-e989-46fb-b00d-f8b117f61a6a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: e0bb5109-7f58-469c-b403-057248427835] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:43.082625 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-580283be-e989-46fb-b00d-f8b117f61a6a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:43.083914 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-503ba9f9-933d-4214-a9ae-4c032df4d9b0 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:43.084055 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-580283be-e989-46fb-b00d-f8b117f61a6a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:43.089236 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-580283be-e989-46fb-b00d-f8b117f61a6a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:43.089236 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-580283be-e989-46fb-b00d-f8b117f61a6a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:43.089236 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-580283be-e989-46fb-b00d-f8b117f61a6a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:43.089236 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-580283be-e989-46fb-b00d-f8b117f61a6a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:43.091945 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-503ba9f9-933d-4214-a9ae-4c032df4d9b0 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/9c5de49d-999c-44da-a25c-e79327652449" status: 200 len: 1225 microversion: 2.1 time: 0.160283 Oct 23 01:30:43.107372 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2268/4614] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:42 2022] GET /compute/v2.1/servers/9c5de49d-999c-44da-a25c-e79327652449 => generated 1225 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:30:43.354391 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-580283be-e989-46fb-b00d-f8b117f61a6a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:43.377420 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-580283be-e989-46fb-b00d-f8b117f61a6a tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835" status: 200 len: 1519 microversion: 2.1 time: 0.313585 Oct 23 01:30:43.378658 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2347/4615] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:43 2022] GET /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835 => generated 1519 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:43.453467 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cf1f0c22-4bdb-4a1c-aaf7-68aedd860ba4 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:43.454744 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cf1f0c22-4bdb-4a1c-aaf7-68aedd860ba4 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: e96f5e79-d832-4927-aef1-a45a815404b0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:43.462349 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf1f0c22-4bdb-4a1c-aaf7-68aedd860ba4 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:43.463135 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf1f0c22-4bdb-4a1c-aaf7-68aedd860ba4 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:43.463764 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf1f0c22-4bdb-4a1c-aaf7-68aedd860ba4 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:43.464658 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf1f0c22-4bdb-4a1c-aaf7-68aedd860ba4 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:43.465319 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf1f0c22-4bdb-4a1c-aaf7-68aedd860ba4 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:43.465931 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf1f0c22-4bdb-4a1c-aaf7-68aedd860ba4 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:43.694051 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cf1f0c22-4bdb-4a1c-aaf7-68aedd860ba4 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:43.709163 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cf1f0c22-4bdb-4a1c-aaf7-68aedd860ba4 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0" status: 200 len: 1366 microversion: 2.1 time: 0.259933 Oct 23 01:30:43.716805 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2269/4616] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:43 2022] GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0 => generated 1366 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:44.116301 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2e579ad1-f7a5-4844-a002-86965e6d8a0a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:44.116939 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2e579ad1-f7a5-4844-a002-86965e6d8a0a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 9c5de49d-999c-44da-a25c-e79327652449] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:44.129343 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e579ad1-f7a5-4844-a002-86965e6d8a0a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:44.129852 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e579ad1-f7a5-4844-a002-86965e6d8a0a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:44.130337 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e579ad1-f7a5-4844-a002-86965e6d8a0a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:44.131063 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e579ad1-f7a5-4844-a002-86965e6d8a0a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:44.131530 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e579ad1-f7a5-4844-a002-86965e6d8a0a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:44.131970 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e579ad1-f7a5-4844-a002-86965e6d8a0a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:44.222882 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2e579ad1-f7a5-4844-a002-86965e6d8a0a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:44.231090 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2e579ad1-f7a5-4844-a002-86965e6d8a0a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/9c5de49d-999c-44da-a25c-e79327652449" status: 200 len: 1217 microversion: 2.1 time: 0.118679 Oct 23 01:30:44.233612 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2348/4617] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:44 2022] GET /compute/v2.1/servers/9c5de49d-999c-44da-a25c-e79327652449 => generated 1217 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:44.405863 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f6b8c76d-d5be-443f-aaf9-5dff4adfe03e tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:44.405863 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f6b8c76d-d5be-443f-aaf9-5dff4adfe03e tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: e0bb5109-7f58-469c-b403-057248427835] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:44.415102 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f6b8c76d-d5be-443f-aaf9-5dff4adfe03e tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:44.415691 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f6b8c76d-d5be-443f-aaf9-5dff4adfe03e tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:44.416194 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f6b8c76d-d5be-443f-aaf9-5dff4adfe03e tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:44.416975 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f6b8c76d-d5be-443f-aaf9-5dff4adfe03e tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:44.417498 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f6b8c76d-d5be-443f-aaf9-5dff4adfe03e tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:44.418064 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f6b8c76d-d5be-443f-aaf9-5dff4adfe03e tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:44.615414 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f6b8c76d-d5be-443f-aaf9-5dff4adfe03e tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:44.623029 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f6b8c76d-d5be-443f-aaf9-5dff4adfe03e tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835" status: 200 len: 1519 microversion: 2.1 time: 0.225415 Oct 23 01:30:44.623594 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2270/4618] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:44 2022] GET /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835 => generated 1519 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:44.743190 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d76f34e1-63c2-4ec1-a455-5934cecce240 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:44.743755 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d76f34e1-63c2-4ec1-a455-5934cecce240 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: e96f5e79-d832-4927-aef1-a45a815404b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:44.750173 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d76f34e1-63c2-4ec1-a455-5934cecce240 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:44.750665 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d76f34e1-63c2-4ec1-a455-5934cecce240 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:44.751825 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d76f34e1-63c2-4ec1-a455-5934cecce240 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:44.752713 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d76f34e1-63c2-4ec1-a455-5934cecce240 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:44.753186 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d76f34e1-63c2-4ec1-a455-5934cecce240 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:44.753784 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d76f34e1-63c2-4ec1-a455-5934cecce240 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:44.981281 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d76f34e1-63c2-4ec1-a455-5934cecce240 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:44.990311 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d76f34e1-63c2-4ec1-a455-5934cecce240 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0" status: 200 len: 1366 microversion: 2.1 time: 0.251115 Oct 23 01:30:44.995952 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2349/4619] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:44 2022] GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0 => generated 1366 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:45.255218 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e4b48ff7-e37b-48de-9be8-0fd603852d78 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:45.256331 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e4b48ff7-e37b-48de-9be8-0fd603852d78 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 9c5de49d-999c-44da-a25c-e79327652449] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:45.264940 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e4b48ff7-e37b-48de-9be8-0fd603852d78 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:45.265683 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e4b48ff7-e37b-48de-9be8-0fd603852d78 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:45.266236 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e4b48ff7-e37b-48de-9be8-0fd603852d78 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:45.267045 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e4b48ff7-e37b-48de-9be8-0fd603852d78 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:45.267619 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e4b48ff7-e37b-48de-9be8-0fd603852d78 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:45.268136 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e4b48ff7-e37b-48de-9be8-0fd603852d78 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:45.368235 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e4b48ff7-e37b-48de-9be8-0fd603852d78 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:45.383281 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e4b48ff7-e37b-48de-9be8-0fd603852d78 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/9c5de49d-999c-44da-a25c-e79327652449" status: 200 len: 1273 microversion: 2.1 time: 0.133079 Oct 23 01:30:45.386350 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2271/4620] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:45 2022] GET /compute/v2.1/servers/9c5de49d-999c-44da-a25c-e79327652449 => generated 1273 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:30:45.647242 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2a59d556-f5e2-4152-9fe5-9cf5e6036410 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:45.652771 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2a59d556-f5e2-4152-9fe5-9cf5e6036410 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: e0bb5109-7f58-469c-b403-057248427835] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:45.655111 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a59d556-f5e2-4152-9fe5-9cf5e6036410 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:45.655787 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a59d556-f5e2-4152-9fe5-9cf5e6036410 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:45.656370 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a59d556-f5e2-4152-9fe5-9cf5e6036410 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:45.657783 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a59d556-f5e2-4152-9fe5-9cf5e6036410 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:45.658268 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a59d556-f5e2-4152-9fe5-9cf5e6036410 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:45.658698 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a59d556-f5e2-4152-9fe5-9cf5e6036410 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:45.902125 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-1c1d4b5c-573b-47ec-be5c-e1de931715bd req-3511e0f5-0770-4fef-b913-17174606f454 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0bb5109-7f58-469c-b403-057248427835", "name": "network-vif-deleted", "tag": "8636fe04-57e9-4152-a064-e3d98100e595"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:30:45.928310 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-1c1d4b5c-573b-47ec-be5c-e1de931715bd req-3511e0f5-0770-4fef-b913-17174606f454 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:45.931094 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-1c1d4b5c-573b-47ec-be5c-e1de931715bd req-3511e0f5-0770-4fef-b913-17174606f454 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:45.931661 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-1c1d4b5c-573b-47ec-be5c-e1de931715bd req-3511e0f5-0770-4fef-b913-17174606f454 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:45.949915 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2a59d556-f5e2-4152-9fe5-9cf5e6036410 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:45.956086 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-1c1d4b5c-573b-47ec-be5c-e1de931715bd req-3511e0f5-0770-4fef-b913-17174606f454 service nova] Creating event network-vif-deleted:8636fe04-57e9-4152-a064-e3d98100e595 for instance e0bb5109-7f58-469c-b403-057248427835 on n-h1-master-1 Oct 23 01:30:45.966428 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2a59d556-f5e2-4152-9fe5-9cf5e6036410 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835" status: 200 len: 1519 microversion: 2.1 time: 0.321489 Oct 23 01:30:45.967649 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2350/4621] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:45 2022] GET /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835 => generated 1519 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:45.968524 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-1c1d4b5c-573b-47ec-be5c-e1de931715bd req-3511e0f5-0770-4fef-b913-17174606f454 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070695 Oct 23 01:30:45.980751 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2272/4622] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:30:46.021101 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4d800bd0-8099-4d64-9aa9-0f41d425974e tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:46.021842 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4d800bd0-8099-4d64-9aa9-0f41d425974e tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: e96f5e79-d832-4927-aef1-a45a815404b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:46.032826 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-24ac4e00-e4e3-4f0b-9c68-1d10d9dd9cf6 req-03c9eb4a-f84b-4d2f-9364-e8d4f11ec51b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e96f5e79-d832-4927-aef1-a45a815404b0", "name": "network-vif-plugged", "status": "completed", "tag": "31d7ea8a-db73-4a69-a6f8-466b312577b1"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:30:46.033031 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4d800bd0-8099-4d64-9aa9-0f41d425974e tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:46.033031 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4d800bd0-8099-4d64-9aa9-0f41d425974e tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:46.033629 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4d800bd0-8099-4d64-9aa9-0f41d425974e tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:46.034999 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4d800bd0-8099-4d64-9aa9-0f41d425974e tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:46.035535 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4d800bd0-8099-4d64-9aa9-0f41d425974e tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:46.035984 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4d800bd0-8099-4d64-9aa9-0f41d425974e tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:46.045116 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-24ac4e00-e4e3-4f0b-9c68-1d10d9dd9cf6 req-03c9eb4a-f84b-4d2f-9364-e8d4f11ec51b service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:46.045596 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-24ac4e00-e4e3-4f0b-9c68-1d10d9dd9cf6 req-03c9eb4a-f84b-4d2f-9364-e8d4f11ec51b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:46.046057 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-24ac4e00-e4e3-4f0b-9c68-1d10d9dd9cf6 req-03c9eb4a-f84b-4d2f-9364-e8d4f11ec51b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:46.066633 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-24ac4e00-e4e3-4f0b-9c68-1d10d9dd9cf6 req-03c9eb4a-f84b-4d2f-9364-e8d4f11ec51b service nova] Creating event network-vif-plugged:31d7ea8a-db73-4a69-a6f8-466b312577b1 for instance e96f5e79-d832-4927-aef1-a45a815404b0 on n-h1-master-1 Oct 23 01:30:46.071412 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-24ac4e00-e4e3-4f0b-9c68-1d10d9dd9cf6 req-03c9eb4a-f84b-4d2f-9364-e8d4f11ec51b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046267 Oct 23 01:30:46.072503 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2273/4623] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:30:46.247435 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4d800bd0-8099-4d64-9aa9-0f41d425974e tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:46.260075 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4d800bd0-8099-4d64-9aa9-0f41d425974e tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0" status: 200 len: 1366 microversion: 2.1 time: 0.248057 Oct 23 01:30:46.265293 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2351/4624] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:46 2022] GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0 => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:46.412898 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-099c788b-ae08-4872-a1c3-0cd2fa3854da tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:46.413856 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-099c788b-ae08-4872-a1c3-0cd2fa3854da tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 9c5de49d-999c-44da-a25c-e79327652449] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:46.426078 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-099c788b-ae08-4872-a1c3-0cd2fa3854da tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:46.426794 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-099c788b-ae08-4872-a1c3-0cd2fa3854da tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:46.427574 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-099c788b-ae08-4872-a1c3-0cd2fa3854da tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:46.429174 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-099c788b-ae08-4872-a1c3-0cd2fa3854da tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:46.429916 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-099c788b-ae08-4872-a1c3-0cd2fa3854da tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:46.435455 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-099c788b-ae08-4872-a1c3-0cd2fa3854da tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:46.564680 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-099c788b-ae08-4872-a1c3-0cd2fa3854da tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:46.573264 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-099c788b-ae08-4872-a1c3-0cd2fa3854da tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/9c5de49d-999c-44da-a25c-e79327652449" status: 200 len: 1281 microversion: 2.1 time: 0.169634 Oct 23 01:30:46.574360 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2274/4625] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:46 2022] GET /compute/v2.1/servers/9c5de49d-999c-44da-a25c-e79327652449 => generated 1281 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:47.008184 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8968fca3-d749-4543-b1ce-cdd8d79085c4 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:47.008820 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8968fca3-d749-4543-b1ce-cdd8d79085c4 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: e0bb5109-7f58-469c-b403-057248427835] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:47.027746 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:47.035231 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8968fca3-d749-4543-b1ce-cdd8d79085c4 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:47.035834 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8968fca3-d749-4543-b1ce-cdd8d79085c4 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:47.036367 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8968fca3-d749-4543-b1ce-cdd8d79085c4 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:47.037169 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8968fca3-d749-4543-b1ce-cdd8d79085c4 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:47.037859 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8968fca3-d749-4543-b1ce-cdd8d79085c4 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:47.038547 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8968fca3-d749-4543-b1ce-cdd8d79085c4 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:47.085943 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8968fca3-d749-4543-b1ce-cdd8d79085c4 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:47.086360 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8968fca3-d749-4543-b1ce-cdd8d79085c4 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:47.086812 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8968fca3-d749-4543-b1ce-cdd8d79085c4 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:47.087288 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-8968fca3-d749-4543-b1ce-cdd8d79085c4 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lazy-loading 'fault' on Instance uuid e0bb5109-7f58-469c-b403-057248427835 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:30:47.156208 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8968fca3-d749-4543-b1ce-cdd8d79085c4 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:47.164167 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8968fca3-d749-4543-b1ce-cdd8d79085c4 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835" status: 200 len: 1311 microversion: 2.1 time: 0.178232 Oct 23 01:30:47.164854 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2352/4626] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:46 2022] GET /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835 => generated 1311 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:47.289514 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-74209b35-f9cd-42d9-ac94-ba96cfe9961b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:47.289514 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-74209b35-f9cd-42d9-ac94-ba96cfe9961b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: e96f5e79-d832-4927-aef1-a45a815404b0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:47.304207 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-74209b35-f9cd-42d9-ac94-ba96cfe9961b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:47.304949 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-74209b35-f9cd-42d9-ac94-ba96cfe9961b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:47.306073 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-74209b35-f9cd-42d9-ac94-ba96cfe9961b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:47.309905 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-74209b35-f9cd-42d9-ac94-ba96cfe9961b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:47.310417 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-74209b35-f9cd-42d9-ac94-ba96cfe9961b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:47.310852 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-74209b35-f9cd-42d9-ac94-ba96cfe9961b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:47.597421 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0fd180ec-e516-43e5-b349-fae9f74bfaca tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:47.598066 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0fd180ec-e516-43e5-b349-fae9f74bfaca tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 9c5de49d-999c-44da-a25c-e79327652449] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:47.604642 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0fd180ec-e516-43e5-b349-fae9f74bfaca tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:47.605131 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0fd180ec-e516-43e5-b349-fae9f74bfaca tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:47.605591 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0fd180ec-e516-43e5-b349-fae9f74bfaca tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:47.606299 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0fd180ec-e516-43e5-b349-fae9f74bfaca tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:47.606753 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0fd180ec-e516-43e5-b349-fae9f74bfaca tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:47.607177 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0fd180ec-e516-43e5-b349-fae9f74bfaca tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:48.002276 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-74209b35-f9cd-42d9-ac94-ba96cfe9961b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:48.004110 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0fd180ec-e516-43e5-b349-fae9f74bfaca tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:48.028035 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0fd180ec-e516-43e5-b349-fae9f74bfaca tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/9c5de49d-999c-44da-a25c-e79327652449" status: 200 len: 1321 microversion: 2.1 time: 0.432883 Oct 23 01:30:48.035552 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2353/4627] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:47 2022] GET /compute/v2.1/servers/9c5de49d-999c-44da-a25c-e79327652449 => generated 1321 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:48.039480 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-74209b35-f9cd-42d9-ac94-ba96cfe9961b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0" status: 200 len: 1366 microversion: 2.1 time: 0.754461 Oct 23 01:30:48.054619 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2275/4628] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:47 2022] GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0 => generated 1366 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:48.189591 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-95f7ef20-d4c8-4bfe-ab7d-61be46f1fde6 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:48.190362 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-95f7ef20-d4c8-4bfe-ab7d-61be46f1fde6 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: e0bb5109-7f58-469c-b403-057248427835] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:48.198239 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-95f7ef20-d4c8-4bfe-ab7d-61be46f1fde6 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:48.198733 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-95f7ef20-d4c8-4bfe-ab7d-61be46f1fde6 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:48.199174 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-95f7ef20-d4c8-4bfe-ab7d-61be46f1fde6 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:48.199871 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-95f7ef20-d4c8-4bfe-ab7d-61be46f1fde6 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:48.200329 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-95f7ef20-d4c8-4bfe-ab7d-61be46f1fde6 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:48.200762 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-95f7ef20-d4c8-4bfe-ab7d-61be46f1fde6 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:48.234869 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-95f7ef20-d4c8-4bfe-ab7d-61be46f1fde6 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:48.235995 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-95f7ef20-d4c8-4bfe-ab7d-61be46f1fde6 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:48.236437 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-95f7ef20-d4c8-4bfe-ab7d-61be46f1fde6 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:48.240779 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-95f7ef20-d4c8-4bfe-ab7d-61be46f1fde6 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lazy-loading 'fault' on Instance uuid e0bb5109-7f58-469c-b403-057248427835 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:30:48.293201 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-95f7ef20-d4c8-4bfe-ab7d-61be46f1fde6 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a92f307441747f29f583ddf004e8f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9901e62cf4f94f6c9be3ff897caedf19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:48.302398 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-95f7ef20-d4c8-4bfe-ab7d-61be46f1fde6 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835" status: 200 len: 1311 microversion: 2.1 time: 0.117172 Oct 23 01:30:48.302995 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2354/4629] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:48 2022] GET /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835 => generated 1311 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:49.059082 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8b4f1160-eced-4d5c-803e-5d0c9063f9bc tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:49.061544 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8b4f1160-eced-4d5c-803e-5d0c9063f9bc tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 9c5de49d-999c-44da-a25c-e79327652449] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:49.068529 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-75592638-3e95-4373-8c39-f4eed23019c7 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:49.069217 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-75592638-3e95-4373-8c39-f4eed23019c7 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: e96f5e79-d832-4927-aef1-a45a815404b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:49.079926 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-75592638-3e95-4373-8c39-f4eed23019c7 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:49.083317 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-75592638-3e95-4373-8c39-f4eed23019c7 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:49.088795 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-75592638-3e95-4373-8c39-f4eed23019c7 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:49.089846 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-75592638-3e95-4373-8c39-f4eed23019c7 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:49.090796 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b4f1160-eced-4d5c-803e-5d0c9063f9bc tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:49.091051 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-75592638-3e95-4373-8c39-f4eed23019c7 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:49.091520 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-75592638-3e95-4373-8c39-f4eed23019c7 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:49.092238 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b4f1160-eced-4d5c-803e-5d0c9063f9bc tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:49.093213 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b4f1160-eced-4d5c-803e-5d0c9063f9bc tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:49.097310 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b4f1160-eced-4d5c-803e-5d0c9063f9bc tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:49.098332 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b4f1160-eced-4d5c-803e-5d0c9063f9bc tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:49.098991 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b4f1160-eced-4d5c-803e-5d0c9063f9bc tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:49.362888 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8b4f1160-eced-4d5c-803e-5d0c9063f9bc tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:49.370697 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8b4f1160-eced-4d5c-803e-5d0c9063f9bc tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/9c5de49d-999c-44da-a25c-e79327652449" status: 200 len: 1321 microversion: 2.1 time: 0.319497 Oct 23 01:30:49.371298 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2276/4630] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:49 2022] GET /compute/v2.1/servers/9c5de49d-999c-44da-a25c-e79327652449 => generated 1321 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:49.399795 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-522ab008-fd8f-4b0f-9328-a30f20cf3af3 req-d4bb06ea-b7b4-4979-b448-1c9966b5e811 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c5de49d-999c-44da-a25c-e79327652449", "tag": "62338fc0-27b1-4660-8282-0f858696c808"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:30:49.411438 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-522ab008-fd8f-4b0f-9328-a30f20cf3af3 req-d4bb06ea-b7b4-4979-b448-1c9966b5e811 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:49.412843 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-522ab008-fd8f-4b0f-9328-a30f20cf3af3 req-d4bb06ea-b7b4-4979-b448-1c9966b5e811 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:49.413448 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-522ab008-fd8f-4b0f-9328-a30f20cf3af3 req-d4bb06ea-b7b4-4979-b448-1c9966b5e811 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:49.423347 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-75592638-3e95-4373-8c39-f4eed23019c7 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:49.433422 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-522ab008-fd8f-4b0f-9328-a30f20cf3af3 req-d4bb06ea-b7b4-4979-b448-1c9966b5e811 service nova] Creating event network-changed:62338fc0-27b1-4660-8282-0f858696c808 for instance 9c5de49d-999c-44da-a25c-e79327652449 on n-h1-master-1 Oct 23 01:30:49.433913 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-75592638-3e95-4373-8c39-f4eed23019c7 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0" status: 200 len: 1556 microversion: 2.1 time: 0.369418 Oct 23 01:30:49.450226 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-522ab008-fd8f-4b0f-9328-a30f20cf3af3 req-d4bb06ea-b7b4-4979-b448-1c9966b5e811 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045963 Oct 23 01:30:49.450226 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2277/4631] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:30:49.450226 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5f2d7d85-284c-4cae-b529-27d447da5d04 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:49.450226 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5f2d7d85-284c-4cae-b529-27d447da5d04 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] [instance: e0bb5109-7f58-469c-b403-057248427835] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:49.452471 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2355/4632] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:49 2022] GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0 => generated 1556 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:49.454160 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5f2d7d85-284c-4cae-b529-27d447da5d04 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:49.454857 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5f2d7d85-284c-4cae-b529-27d447da5d04 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:49.455362 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5f2d7d85-284c-4cae-b529-27d447da5d04 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:49.456117 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5f2d7d85-284c-4cae-b529-27d447da5d04 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:49.456633 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5f2d7d85-284c-4cae-b529-27d447da5d04 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:49.457119 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5f2d7d85-284c-4cae-b529-27d447da5d04 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:49.460124 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:49.461469 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cea9778c-9076-42e7-a83b-2c5932e356d5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:49.462786 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-cea9778c-9076-42e7-a83b-2c5932e356d5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: e96f5e79-d832-4927-aef1-a45a815404b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:49.471545 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cea9778c-9076-42e7-a83b-2c5932e356d5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:49.472675 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cea9778c-9076-42e7-a83b-2c5932e356d5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:49.473277 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cea9778c-9076-42e7-a83b-2c5932e356d5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:49.474208 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cea9778c-9076-42e7-a83b-2c5932e356d5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:49.474443 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-5f2d7d85-284c-4cae-b529-27d447da5d04 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] HTTP exception thrown: Instance e0bb5109-7f58-469c-b403-057248427835 could not be found. Oct 23 01:30:49.474726 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cea9778c-9076-42e7-a83b-2c5932e356d5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:49.475169 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cea9778c-9076-42e7-a83b-2c5932e356d5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5f2d7d85-284c-4cae-b529-27d447da5d04 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Request method failure captured: Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835 HTTP/1.1 Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJjoDrHh3fkd0MkXWzJDILf8Pmt6TgrIp0lCmHYbtJJuP6BekxcNpyaYUlOxFMsQMEeCP54UYanJ-WV-SG8CGbd3fXwivvPS10nnBxElmGtwqWJNx8Tj89wQDU8xVggy4YgKJNfybQDd2cMOq_EpWXI6JFTIW976H7LVcRKfYeVVCVg Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 9901e62cf4f94f6c9be3ff897caedf19 Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ListServerFiltersTestJSON-474025208 Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9901e62cf4f94f6c9be3ff897caedf19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9901e62cf4f94f6c9be3ff897caedf19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9901e62cf4f94f6c9be3ff897caedf19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9901e62cf4f94f6c9be3ff897caedf19"}]}] Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ListServerFiltersTestJSON-474025208 Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 9901e62cf4f94f6c9be3ff897caedf19 Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-474025208 Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ListServerFiltersTestJSON-474025208-project Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 0a92f307441747f29f583ddf004e8f21 Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ListServerFiltersTestJSON-474025208-project Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: exception: Instance e0bb5109-7f58-469c-b403-057248427835 could not be found. Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'e0bb5109-7f58-469c-b403-057248427835'} Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0bb5109-7f58-469c-b403-057248427835 could not be found. Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0bb5109-7f58-469c-b403-057248427835 could not be found. Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:30:49.476684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:30:49.481762 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:30:49.481762 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:30:49.481762 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:30:49.481762 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:30:49.481762 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:30:49.481762 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0bb5109-7f58-469c-b403-057248427835 could not be found. Oct 23 01:30:49.481762 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:30:49.483272 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5f2d7d85-284c-4cae-b529-27d447da5d04 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] Returning 404 to user: Instance e0bb5109-7f58-469c-b403-057248427835 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:30:49.486421 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5f2d7d85-284c-4cae-b529-27d447da5d04 tempest-ListServerFiltersTestJSON-474025208 tempest-ListServerFiltersTestJSON-474025208-project] 10.222.0.42 "GET /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835" status: 404 len: 111 microversion: 2.1 time: 0.045584 Oct 23 01:30:49.493738 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2278/4633] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:49 2022] GET /compute/v2.1/servers/e0bb5109-7f58-469c-b403-057248427835 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:30:49.576749 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cea9778c-9076-42e7-a83b-2c5932e356d5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.120399 Oct 23 01:30:49.585835 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2356/4634] 10.222.0.42 () {58 vars in 1275 bytes} [Sun Oct 23 01:30:49 2022] GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0/os-interface => generated 284 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:30:50.405988 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-007d6bd1-fefe-409a-bc9d-0cc15f6a3e9b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:50.410283 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-007d6bd1-fefe-409a-bc9d-0cc15f6a3e9b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 9c5de49d-999c-44da-a25c-e79327652449] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:50.428133 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=3 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:50.431500 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-007d6bd1-fefe-409a-bc9d-0cc15f6a3e9b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:50.432407 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-007d6bd1-fefe-409a-bc9d-0cc15f6a3e9b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:50.433630 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-007d6bd1-fefe-409a-bc9d-0cc15f6a3e9b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:50.434650 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-007d6bd1-fefe-409a-bc9d-0cc15f6a3e9b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:50.435315 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-007d6bd1-fefe-409a-bc9d-0cc15f6a3e9b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:50.436023 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-007d6bd1-fefe-409a-bc9d-0cc15f6a3e9b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:50.738683 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-007d6bd1-fefe-409a-bc9d-0cc15f6a3e9b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:50.765251 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-007d6bd1-fefe-409a-bc9d-0cc15f6a3e9b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/9c5de49d-999c-44da-a25c-e79327652449" status: 200 len: 1321 microversion: 2.1 time: 0.370114 Oct 23 01:30:50.779795 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2279/4635] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:50 2022] GET /compute/v2.1/servers/9c5de49d-999c-44da-a25c-e79327652449 => generated 1321 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:51.109897 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:51.113854 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-799ed841-f167-467c-bfe8-f5413898b262 req-e0e0ae6f-9fc0-44e4-b3db-7738b22c0323 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e96f5e79-d832-4927-aef1-a45a815404b0", "tag": "31d7ea8a-db73-4a69-a6f8-466b312577b1"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:30:51.128835 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-799ed841-f167-467c-bfe8-f5413898b262 req-e0e0ae6f-9fc0-44e4-b3db-7738b22c0323 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:51.129694 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-799ed841-f167-467c-bfe8-f5413898b262 req-e0e0ae6f-9fc0-44e4-b3db-7738b22c0323 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:51.130583 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-799ed841-f167-467c-bfe8-f5413898b262 req-e0e0ae6f-9fc0-44e4-b3db-7738b22c0323 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:51.146416 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-799ed841-f167-467c-bfe8-f5413898b262 req-e0e0ae6f-9fc0-44e4-b3db-7738b22c0323 service nova] Creating event network-changed:31d7ea8a-db73-4a69-a6f8-466b312577b1 for instance e96f5e79-d832-4927-aef1-a45a815404b0 on n-h1-master-1 Oct 23 01:30:51.154847 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-799ed841-f167-467c-bfe8-f5413898b262 req-e0e0ae6f-9fc0-44e4-b3db-7738b22c0323 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046297 Oct 23 01:30:51.181721 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2357/4636] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:30:51.805179 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-735d0838-3b89-45e4-8a3e-71a88b456d70 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:51.813688 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-735d0838-3b89-45e4-8a3e-71a88b456d70 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 9c5de49d-999c-44da-a25c-e79327652449] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:51.827499 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-735d0838-3b89-45e4-8a3e-71a88b456d70 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:51.834135 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-735d0838-3b89-45e4-8a3e-71a88b456d70 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:51.837781 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-735d0838-3b89-45e4-8a3e-71a88b456d70 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:51.838901 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-735d0838-3b89-45e4-8a3e-71a88b456d70 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:51.839527 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-735d0838-3b89-45e4-8a3e-71a88b456d70 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:51.840129 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-735d0838-3b89-45e4-8a3e-71a88b456d70 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:51.930893 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=15 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:52.107377 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-735d0838-3b89-45e4-8a3e-71a88b456d70 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:52.115468 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-735d0838-3b89-45e4-8a3e-71a88b456d70 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/9c5de49d-999c-44da-a25c-e79327652449" status: 200 len: 1321 microversion: 2.1 time: 0.315346 Oct 23 01:30:52.126361 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2280/4637] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:51 2022] GET /compute/v2.1/servers/9c5de49d-999c-44da-a25c-e79327652449 => generated 1321 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:52.268702 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3b64fd23-60c4-4f20-bbf7-137094a5ba4a tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:52.273944 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3b64fd23-60c4-4f20-bbf7-137094a5ba4a tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3b7f0931fbb64e96868a0044b0c6c557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6df910969eb472b97fb3fe05a3c85d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:52.274892 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3b64fd23-60c4-4f20-bbf7-137094a5ba4a tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Searching by: {'deleted': False, 'project_id': 'b6df910969eb472b97fb3fe05a3c85d3'} {{(pid=120944) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 23 01:30:52.282932 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3b64fd23-60c4-4f20-bbf7-137094a5ba4a tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:52.283416 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3b64fd23-60c4-4f20-bbf7-137094a5ba4a tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:52.283852 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3b64fd23-60c4-4f20-bbf7-137094a5ba4a tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:52.284571 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3b64fd23-60c4-4f20-bbf7-137094a5ba4a tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:52.285124 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3b64fd23-60c4-4f20-bbf7-137094a5ba4a tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:52.285553 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3b64fd23-60c4-4f20-bbf7-137094a5ba4a tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:52.314976 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.multi_cell_list [None req-3b64fd23-60c4-4f20-bbf7-137094a5ba4a tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120944) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 23 01:30:52.352332 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3b64fd23-60c4-4f20-bbf7-137094a5ba4a tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.089156 Oct 23 01:30:52.352926 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2358/4638] 10.222.0.42 () {58 vars in 1125 bytes} [Sun Oct 23 01:30:52 2022] GET /compute/v2.1/servers => generated 339 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:30:52.369845 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7d242658-d3b0-4f7d-a0e8-8e96e4cc8eec tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:52.375132 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7d242658-d3b0-4f7d-a0e8-8e96e4cc8eec tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3b7f0931fbb64e96868a0044b0c6c557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6df910969eb472b97fb3fe05a3c85d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:52.376608 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7d242658-d3b0-4f7d-a0e8-8e96e4cc8eec tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Searching by: {'deleted': False, 'project_id': 'b6df910969eb472b97fb3fe05a3c85d3'} {{(pid=120945) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 23 01:30:52.384371 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7d242658-d3b0-4f7d-a0e8-8e96e4cc8eec tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:52.385263 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7d242658-d3b0-4f7d-a0e8-8e96e4cc8eec tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:52.385713 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7d242658-d3b0-4f7d-a0e8-8e96e4cc8eec tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:52.387080 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7d242658-d3b0-4f7d-a0e8-8e96e4cc8eec tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:52.387661 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7d242658-d3b0-4f7d-a0e8-8e96e4cc8eec tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:52.388104 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7d242658-d3b0-4f7d-a0e8-8e96e4cc8eec tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:52.434612 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.multi_cell_list [None req-7d242658-d3b0-4f7d-a0e8-8e96e4cc8eec tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120945) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 23 01:30:52.475147 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7d242658-d3b0-4f7d-a0e8-8e96e4cc8eec tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7f0931fbb64e96868a0044b0c6c557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6df910969eb472b97fb3fe05a3c85d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:52.485665 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7d242658-d3b0-4f7d-a0e8-8e96e4cc8eec tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:52.485665 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7d242658-d3b0-4f7d-a0e8-8e96e4cc8eec tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:52.485665 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7d242658-d3b0-4f7d-a0e8-8e96e4cc8eec tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:52.604979 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7d242658-d3b0-4f7d-a0e8-8e96e4cc8eec tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] 10.222.0.42 "GET /compute/v2.1/servers/detail" status: 200 len: 1709 microversion: 2.1 time: 0.239970 Oct 23 01:30:52.605917 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2281/4639] 10.222.0.42 () {58 vars in 1146 bytes} [Sun Oct 23 01:30:52 2022] GET /compute/v2.1/servers/detail => generated 1709 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:52.629608 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d1eb0610-f942-4924-a9f7-e248d588144e tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:52.642870 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d1eb0610-f942-4924-a9f7-e248d588144e tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] 10.222.0.42 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015852 Oct 23 01:30:52.642870 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2359/4640] 10.222.0.42 () {58 vars in 1137 bytes} [Sun Oct 23 01:30:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:30:53.142937 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-aa977d7d-2fb3-4469-aa3d-9b588a1812d2 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:53.145023 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-aa977d7d-2fb3-4469-aa3d-9b588a1812d2 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 9c5de49d-999c-44da-a25c-e79327652449] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:53.158896 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa977d7d-2fb3-4469-aa3d-9b588a1812d2 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:53.159394 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa977d7d-2fb3-4469-aa3d-9b588a1812d2 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:53.159831 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa977d7d-2fb3-4469-aa3d-9b588a1812d2 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:53.160532 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa977d7d-2fb3-4469-aa3d-9b588a1812d2 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:53.160979 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa977d7d-2fb3-4469-aa3d-9b588a1812d2 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:53.161395 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa977d7d-2fb3-4469-aa3d-9b588a1812d2 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:53.237352 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e4018604-41bb-4414-8512-15e42eab5ced tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:53.238318 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e4018604-41bb-4414-8512-15e42eab5ced tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] [instance: 55e557ae-4057-4fb9-a753-45a08c602b71] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:53.249943 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e4018604-41bb-4414-8512-15e42eab5ced tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:53.254995 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e4018604-41bb-4414-8512-15e42eab5ced tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:53.257080 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e4018604-41bb-4414-8512-15e42eab5ced tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:53.258346 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e4018604-41bb-4414-8512-15e42eab5ced tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:53.259128 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e4018604-41bb-4414-8512-15e42eab5ced tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:53.261083 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e4018604-41bb-4414-8512-15e42eab5ced tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:53.315193 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:53.334018 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e4018604-41bb-4414-8512-15e42eab5ced tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] [instance: 55e557ae-4057-4fb9-a753-45a08c602b71] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:30:53.362989 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-aa977d7d-2fb3-4469-aa3d-9b588a1812d2 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:53.389507 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-aa977d7d-2fb3-4469-aa3d-9b588a1812d2 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/9c5de49d-999c-44da-a25c-e79327652449" status: 200 len: 1321 microversion: 2.1 time: 0.249054 Oct 23 01:30:53.390176 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2282/4641] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:53 2022] GET /compute/v2.1/servers/9c5de49d-999c-44da-a25c-e79327652449 => generated 1321 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:30:53.759056 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e4018604-41bb-4414-8512-15e42eab5ced tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] 10.222.0.42 "DELETE /compute/v2.1/servers/55e557ae-4057-4fb9-a753-45a08c602b71" status: 204 len: 0 microversion: 2.1 time: 0.525371 Oct 23 01:30:53.760389 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2360/4642] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:30:53 2022] DELETE /compute/v2.1/servers/55e557ae-4057-4fb9-a753-45a08c602b71 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:30:53.768639 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-51401473-8e1f-4ee0-8793-f1935263ae0a tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:53.769250 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-51401473-8e1f-4ee0-8793-f1935263ae0a tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] [instance: 55e557ae-4057-4fb9-a753-45a08c602b71] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:53.775389 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-51401473-8e1f-4ee0-8793-f1935263ae0a tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:53.776380 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-51401473-8e1f-4ee0-8793-f1935263ae0a tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:53.776984 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-51401473-8e1f-4ee0-8793-f1935263ae0a tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:53.777841 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-51401473-8e1f-4ee0-8793-f1935263ae0a tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:53.778465 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-51401473-8e1f-4ee0-8793-f1935263ae0a tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:53.779037 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-51401473-8e1f-4ee0-8793-f1935263ae0a tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:54.021683 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-51401473-8e1f-4ee0-8793-f1935263ae0a tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7f0931fbb64e96868a0044b0c6c557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6df910969eb472b97fb3fe05a3c85d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:54.029525 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-51401473-8e1f-4ee0-8793-f1935263ae0a tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] 10.222.0.42 "GET /compute/v2.1/servers/55e557ae-4057-4fb9-a753-45a08c602b71" status: 200 len: 1712 microversion: 2.1 time: 0.265369 Oct 23 01:30:54.030118 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2283/4643] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:53 2022] GET /compute/v2.1/servers/55e557ae-4057-4fb9-a753-45a08c602b71 => generated 1712 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:54.413675 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ee5ee5e1-e1b7-4f79-aeba-34bd1a221136 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:54.414549 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ee5ee5e1-e1b7-4f79-aeba-34bd1a221136 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 9c5de49d-999c-44da-a25c-e79327652449] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:54.422739 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ee5ee5e1-e1b7-4f79-aeba-34bd1a221136 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:54.423301 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ee5ee5e1-e1b7-4f79-aeba-34bd1a221136 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:54.423807 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ee5ee5e1-e1b7-4f79-aeba-34bd1a221136 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:54.424561 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ee5ee5e1-e1b7-4f79-aeba-34bd1a221136 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:54.425081 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ee5ee5e1-e1b7-4f79-aeba-34bd1a221136 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:54.425744 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ee5ee5e1-e1b7-4f79-aeba-34bd1a221136 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:54.582434 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ee5ee5e1-e1b7-4f79-aeba-34bd1a221136 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:54.591627 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ee5ee5e1-e1b7-4f79-aeba-34bd1a221136 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/9c5de49d-999c-44da-a25c-e79327652449" status: 200 len: 1321 microversion: 2.1 time: 0.182196 Oct 23 01:30:54.592778 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2361/4644] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:54 2022] GET /compute/v2.1/servers/9c5de49d-999c-44da-a25c-e79327652449 => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:55.058257 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-55d92723-1dd5-4f8c-b1a9-53aed0004d81 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:55.059037 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-55d92723-1dd5-4f8c-b1a9-53aed0004d81 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] [instance: 55e557ae-4057-4fb9-a753-45a08c602b71] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:55.067108 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-55d92723-1dd5-4f8c-b1a9-53aed0004d81 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:55.067604 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-55d92723-1dd5-4f8c-b1a9-53aed0004d81 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:55.068036 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-55d92723-1dd5-4f8c-b1a9-53aed0004d81 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:55.068733 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-55d92723-1dd5-4f8c-b1a9-53aed0004d81 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:55.069348 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-55d92723-1dd5-4f8c-b1a9-53aed0004d81 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:55.069779 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-55d92723-1dd5-4f8c-b1a9-53aed0004d81 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:55.212148 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-55d92723-1dd5-4f8c-b1a9-53aed0004d81 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7f0931fbb64e96868a0044b0c6c557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6df910969eb472b97fb3fe05a3c85d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:55.228990 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-55d92723-1dd5-4f8c-b1a9-53aed0004d81 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] 10.222.0.42 "GET /compute/v2.1/servers/55e557ae-4057-4fb9-a753-45a08c602b71" status: 200 len: 1712 microversion: 2.1 time: 0.175120 Oct 23 01:30:55.232155 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2284/4645] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:55 2022] GET /compute/v2.1/servers/55e557ae-4057-4fb9-a753-45a08c602b71 => generated 1712 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:55.617524 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8d2d057c-1246-4627-a98d-b88f99104799 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:55.628851 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8d2d057c-1246-4627-a98d-b88f99104799 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 9c5de49d-999c-44da-a25c-e79327652449] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:55.628851 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8d2d057c-1246-4627-a98d-b88f99104799 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:55.628851 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8d2d057c-1246-4627-a98d-b88f99104799 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:55.628851 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8d2d057c-1246-4627-a98d-b88f99104799 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:55.628851 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8d2d057c-1246-4627-a98d-b88f99104799 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:55.628851 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8d2d057c-1246-4627-a98d-b88f99104799 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:55.628851 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8d2d057c-1246-4627-a98d-b88f99104799 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:55.808173 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8d2d057c-1246-4627-a98d-b88f99104799 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:55.826135 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8d2d057c-1246-4627-a98d-b88f99104799 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/9c5de49d-999c-44da-a25c-e79327652449" status: 200 len: 1321 microversion: 2.1 time: 0.213379 Oct 23 01:30:55.826975 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2362/4646] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:55 2022] GET /compute/v2.1/servers/9c5de49d-999c-44da-a25c-e79327652449 => generated 1321 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:56.211042 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-e887823a-1ba6-45c6-bec5-c1911ec796bb req-95a31bf0-5c2d-4f56-b25e-dcb022b6c28d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c5de49d-999c-44da-a25c-e79327652449", "name": "network-vif-plugged", "status": "completed", "tag": "62338fc0-27b1-4660-8282-0f858696c808"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:30:56.226545 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-e887823a-1ba6-45c6-bec5-c1911ec796bb req-95a31bf0-5c2d-4f56-b25e-dcb022b6c28d service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:56.227279 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-e887823a-1ba6-45c6-bec5-c1911ec796bb req-95a31bf0-5c2d-4f56-b25e-dcb022b6c28d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:56.228110 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-e887823a-1ba6-45c6-bec5-c1911ec796bb req-95a31bf0-5c2d-4f56-b25e-dcb022b6c28d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:56.244889 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-e887823a-1ba6-45c6-bec5-c1911ec796bb req-95a31bf0-5c2d-4f56-b25e-dcb022b6c28d service nova] Creating event network-vif-plugged:62338fc0-27b1-4660-8282-0f858696c808 for instance 9c5de49d-999c-44da-a25c-e79327652449 on n-h1-master-1 Oct 23 01:30:56.252262 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-e887823a-1ba6-45c6-bec5-c1911ec796bb req-95a31bf0-5c2d-4f56-b25e-dcb022b6c28d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049390 Oct 23 01:30:56.252688 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2285/4647] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:30:56.255967 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9f0a5bd6-573e-47a9-9d33-e33831928f56 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:56.257864 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9f0a5bd6-573e-47a9-9d33-e33831928f56 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] [instance: 55e557ae-4057-4fb9-a753-45a08c602b71] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:56.269934 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f0a5bd6-573e-47a9-9d33-e33831928f56 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:56.270805 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f0a5bd6-573e-47a9-9d33-e33831928f56 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:56.272350 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f0a5bd6-573e-47a9-9d33-e33831928f56 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:56.274659 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f0a5bd6-573e-47a9-9d33-e33831928f56 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:56.275354 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f0a5bd6-573e-47a9-9d33-e33831928f56 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:56.275951 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f0a5bd6-573e-47a9-9d33-e33831928f56 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:56.852293 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f94993e4-d493-4be5-a112-e897848a4744 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:56.853395 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f94993e4-d493-4be5-a112-e897848a4744 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 9c5de49d-999c-44da-a25c-e79327652449] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:56.863817 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f94993e4-d493-4be5-a112-e897848a4744 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:56.863817 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f94993e4-d493-4be5-a112-e897848a4744 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:56.863817 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f94993e4-d493-4be5-a112-e897848a4744 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:56.864483 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f94993e4-d493-4be5-a112-e897848a4744 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:56.865013 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f94993e4-d493-4be5-a112-e897848a4744 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:56.865436 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f94993e4-d493-4be5-a112-e897848a4744 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:56.881574 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9f0a5bd6-573e-47a9-9d33-e33831928f56 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7f0931fbb64e96868a0044b0c6c557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6df910969eb472b97fb3fe05a3c85d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:56.892027 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9f0a5bd6-573e-47a9-9d33-e33831928f56 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] 10.222.0.42 "GET /compute/v2.1/servers/55e557ae-4057-4fb9-a753-45a08c602b71" status: 200 len: 1712 microversion: 2.1 time: 0.639935 Oct 23 01:30:56.892985 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2363/4648] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:56 2022] GET /compute/v2.1/servers/55e557ae-4057-4fb9-a753-45a08c602b71 => generated 1712 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:57.024203 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-21797baa-d031-47f7-b7e4-c7c5eee454a4 req-9cddc981-08c4-41e7-89b5-024e1c8a12ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55e557ae-4057-4fb9-a753-45a08c602b71", "name": "network-vif-deleted", "tag": "e7316b18-a085-4766-be3a-3bb9f97ed9a9"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:30:57.038344 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-21797baa-d031-47f7-b7e4-c7c5eee454a4 req-9cddc981-08c4-41e7-89b5-024e1c8a12ee service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:57.038835 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-21797baa-d031-47f7-b7e4-c7c5eee454a4 req-9cddc981-08c4-41e7-89b5-024e1c8a12ee service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:57.039555 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-21797baa-d031-47f7-b7e4-c7c5eee454a4 req-9cddc981-08c4-41e7-89b5-024e1c8a12ee service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:57.064552 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-21797baa-d031-47f7-b7e4-c7c5eee454a4 req-9cddc981-08c4-41e7-89b5-024e1c8a12ee service nova] Creating event network-vif-deleted:e7316b18-a085-4766-be3a-3bb9f97ed9a9 for instance 55e557ae-4057-4fb9-a753-45a08c602b71 on n-h2-master-1 Oct 23 01:30:57.076369 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-21797baa-d031-47f7-b7e4-c7c5eee454a4 req-9cddc981-08c4-41e7-89b5-024e1c8a12ee service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062166 Oct 23 01:30:57.078921 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2364/4649] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:30:57.257223 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f94993e4-d493-4be5-a112-e897848a4744 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:57.270510 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f94993e4-d493-4be5-a112-e897848a4744 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/9c5de49d-999c-44da-a25c-e79327652449" status: 200 len: 1321 microversion: 2.1 time: 0.422488 Oct 23 01:30:57.271572 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2286/4650] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:56 2022] GET /compute/v2.1/servers/9c5de49d-999c-44da-a25c-e79327652449 => generated 1321 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:30:57.917589 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a6b4d40f-ae89-466b-920d-a6b17d750ce8 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:57.924970 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a6b4d40f-ae89-466b-920d-a6b17d750ce8 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] [instance: 55e557ae-4057-4fb9-a753-45a08c602b71] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:57.939344 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6b4d40f-ae89-466b-920d-a6b17d750ce8 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:57.955229 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6b4d40f-ae89-466b-920d-a6b17d750ce8 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:57.958943 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6b4d40f-ae89-466b-920d-a6b17d750ce8 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:57.958943 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6b4d40f-ae89-466b-920d-a6b17d750ce8 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:57.958943 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6b4d40f-ae89-466b-920d-a6b17d750ce8 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:57.958943 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6b4d40f-ae89-466b-920d-a6b17d750ce8 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:58.047729 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6b4d40f-ae89-466b-920d-a6b17d750ce8 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:58.048231 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6b4d40f-ae89-466b-920d-a6b17d750ce8 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:58.048680 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a6b4d40f-ae89-466b-920d-a6b17d750ce8 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:58.049145 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-a6b4d40f-ae89-466b-920d-a6b17d750ce8 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lazy-loading 'fault' on Instance uuid 55e557ae-4057-4fb9-a753-45a08c602b71 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:30:58.145387 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a6b4d40f-ae89-466b-920d-a6b17d750ce8 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7f0931fbb64e96868a0044b0c6c557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6df910969eb472b97fb3fe05a3c85d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:58.160371 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a6b4d40f-ae89-466b-920d-a6b17d750ce8 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] 10.222.0.42 "GET /compute/v2.1/servers/55e557ae-4057-4fb9-a753-45a08c602b71" status: 200 len: 1367 microversion: 2.1 time: 0.247763 Oct 23 01:30:58.167306 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2365/4651] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:57 2022] GET /compute/v2.1/servers/55e557ae-4057-4fb9-a753-45a08c602b71 => generated 1367 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:58.293262 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ceaa6a46-e04c-48d1-88b0-8fda477c9e5b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:58.294760 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ceaa6a46-e04c-48d1-88b0-8fda477c9e5b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 9c5de49d-999c-44da-a25c-e79327652449] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:58.310431 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ceaa6a46-e04c-48d1-88b0-8fda477c9e5b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:58.311185 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ceaa6a46-e04c-48d1-88b0-8fda477c9e5b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:58.311806 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ceaa6a46-e04c-48d1-88b0-8fda477c9e5b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:58.314831 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ceaa6a46-e04c-48d1-88b0-8fda477c9e5b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:58.314831 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ceaa6a46-e04c-48d1-88b0-8fda477c9e5b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:58.314831 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ceaa6a46-e04c-48d1-88b0-8fda477c9e5b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:58.591292 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ceaa6a46-e04c-48d1-88b0-8fda477c9e5b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:58.599993 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ceaa6a46-e04c-48d1-88b0-8fda477c9e5b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/9c5de49d-999c-44da-a25c-e79327652449" status: 200 len: 1501 microversion: 2.1 time: 0.311014 Oct 23 01:30:58.600875 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2287/4652] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:58 2022] GET /compute/v2.1/servers/9c5de49d-999c-44da-a25c-e79327652449 => generated 1501 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:58.625776 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a2e8dfeb-f4f0-43ce-8ed1-6f7895df65fe tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:58.626618 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a2e8dfeb-f4f0-43ce-8ed1-6f7895df65fe tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 9c5de49d-999c-44da-a25c-e79327652449] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:58.636253 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a2e8dfeb-f4f0-43ce-8ed1-6f7895df65fe tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:58.636770 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a2e8dfeb-f4f0-43ce-8ed1-6f7895df65fe tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:58.637209 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a2e8dfeb-f4f0-43ce-8ed1-6f7895df65fe tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:58.637929 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a2e8dfeb-f4f0-43ce-8ed1-6f7895df65fe tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:58.639193 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a2e8dfeb-f4f0-43ce-8ed1-6f7895df65fe tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:58.639193 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a2e8dfeb-f4f0-43ce-8ed1-6f7895df65fe tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:58.870661 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a2e8dfeb-f4f0-43ce-8ed1-6f7895df65fe tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:58.893051 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a2e8dfeb-f4f0-43ce-8ed1-6f7895df65fe tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/9c5de49d-999c-44da-a25c-e79327652449" status: 200 len: 1501 microversion: 2.1 time: 0.261446 Oct 23 01:30:58.893966 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2366/4653] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:58 2022] GET /compute/v2.1/servers/9c5de49d-999c-44da-a25c-e79327652449 => generated 1501 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:30:58.919328 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-34f479ec-dd61-4d62-9000-72ffc736e650 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:58.920044 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-34f479ec-dd61-4d62-9000-72ffc736e650 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 9c5de49d-999c-44da-a25c-e79327652449] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:58.930855 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-34f479ec-dd61-4d62-9000-72ffc736e650 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:58.934470 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-34f479ec-dd61-4d62-9000-72ffc736e650 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:58.935099 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-34f479ec-dd61-4d62-9000-72ffc736e650 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:58.940214 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-34f479ec-dd61-4d62-9000-72ffc736e650 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:58.940476 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-34f479ec-dd61-4d62-9000-72ffc736e650 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:58.941148 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-34f479ec-dd61-4d62-9000-72ffc736e650 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:58.984296 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-34f479ec-dd61-4d62-9000-72ffc736e650 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 9c5de49d-999c-44da-a25c-e79327652449] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:30:59.185608 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e333c932-b2e8-4d24-90aa-515088bbe634 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:59.186263 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e333c932-b2e8-4d24-90aa-515088bbe634 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] [instance: 55e557ae-4057-4fb9-a753-45a08c602b71] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:59.202264 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e333c932-b2e8-4d24-90aa-515088bbe634 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:59.203198 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e333c932-b2e8-4d24-90aa-515088bbe634 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:59.204346 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e333c932-b2e8-4d24-90aa-515088bbe634 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:59.205307 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e333c932-b2e8-4d24-90aa-515088bbe634 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:59.206009 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e333c932-b2e8-4d24-90aa-515088bbe634 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:59.206662 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e333c932-b2e8-4d24-90aa-515088bbe634 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:59.222552 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-e333c932-b2e8-4d24-90aa-515088bbe634 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] HTTP exception thrown: Instance 55e557ae-4057-4fb9-a753-45a08c602b71 could not be found. Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e333c932-b2e8-4d24-90aa-515088bbe634 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Request method failure captured: Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/55e557ae-4057-4fb9-a753-45a08c602b71 HTTP/1.1 Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJkJUfuc6ybcGjn6lhEnONBwjyQrp1YeOhN_GO2pc1MGdo4PHWIFfqY1J5Uake_k6bUJjbpuNyj7fEqlyowEyTqR9MlOOS8VAGEWxVLZiJDYHZZ0muvFPEIG_d6WCwEvRDTolbtz1J7Y_tiqHVWukneZSzwBbvKpNcxERJUV_yC8JmU Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: b6df910969eb472b97fb3fe05a3c85d3 Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersTestManualDisk-7660937 Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b6df910969eb472b97fb3fe05a3c85d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b6df910969eb472b97fb3fe05a3c85d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b6df910969eb472b97fb3fe05a3c85d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b6df910969eb472b97fb3fe05a3c85d3"}]}] Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersTestManualDisk-7660937 Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: b6df910969eb472b97fb3fe05a3c85d3 Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersTestManualDisk-7660937 Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersTestManualDisk-7660937-project Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 3b7f0931fbb64e96868a0044b0c6c557 Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersTestManualDisk-7660937-project Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 55e557ae-4057-4fb9-a753-45a08c602b71 could not be found. Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '55e557ae-4057-4fb9-a753-45a08c602b71'} Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55e557ae-4057-4fb9-a753-45a08c602b71 could not be found. Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55e557ae-4057-4fb9-a753-45a08c602b71 could not be found. Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:30:59.224383 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:30:59.229364 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:30:59.229364 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:30:59.229364 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:30:59.229364 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:30:59.229364 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:30:59.229364 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55e557ae-4057-4fb9-a753-45a08c602b71 could not be found. Oct 23 01:30:59.229364 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:30:59.229364 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e333c932-b2e8-4d24-90aa-515088bbe634 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Returning 404 to user: Instance 55e557ae-4057-4fb9-a753-45a08c602b71 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:30:59.230505 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e333c932-b2e8-4d24-90aa-515088bbe634 tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] 10.222.0.42 "GET /compute/v2.1/servers/55e557ae-4057-4fb9-a753-45a08c602b71" status: 404 len: 111 microversion: 2.1 time: 0.048539 Oct 23 01:30:59.231196 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2367/4654] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:59 2022] GET /compute/v2.1/servers/55e557ae-4057-4fb9-a753-45a08c602b71 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 01:30:59.244346 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-652da81e-7470-483d-8ccb-3099d067aeea tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] Calling method '.version_select at 0x7f5cc61863a0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:59.384166 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-652da81e-7470-483d-8ccb-3099d067aeea tempest-ServersTestManualDisk-7660937 tempest-ServersTestManualDisk-7660937-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1487923560" status: 202 len: 0 microversion: 2.1 time: 0.147842 Oct 23 01:30:59.385499 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2368/4655] 10.222.0.42 () {58 vars in 1221 bytes} [Sun Oct 23 01:30:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1487923560 => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 23 01:30:59.418746 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-34f479ec-dd61-4d62-9000-72ffc736e650 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9c5de49d-999c-44da-a25c-e79327652449" status: 204 len: 0 microversion: 2.1 time: 0.503208 Oct 23 01:30:59.422743 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2288/4656] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:30:58 2022] DELETE /compute/v2.1/servers/9c5de49d-999c-44da-a25c-e79327652449 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:30:59.431298 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-51d962ff-6892-43b1-af53-bcb17fec85b8 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:30:59.431933 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-51d962ff-6892-43b1-af53-bcb17fec85b8 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 9c5de49d-999c-44da-a25c-e79327652449] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:30:59.444070 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-51d962ff-6892-43b1-af53-bcb17fec85b8 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:59.444597 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-51d962ff-6892-43b1-af53-bcb17fec85b8 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:59.445070 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-51d962ff-6892-43b1-af53-bcb17fec85b8 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:59.445831 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-51d962ff-6892-43b1-af53-bcb17fec85b8 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:30:59.448191 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-51d962ff-6892-43b1-af53-bcb17fec85b8 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:30:59.455177 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-51d962ff-6892-43b1-af53-bcb17fec85b8 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:30:59.679999 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-51d962ff-6892-43b1-af53-bcb17fec85b8 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:30:59.694728 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-51d962ff-6892-43b1-af53-bcb17fec85b8 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/9c5de49d-999c-44da-a25c-e79327652449" status: 200 len: 1507 microversion: 2.1 time: 0.267293 Oct 23 01:30:59.696124 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2369/4657] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:30:59 2022] GET /compute/v2.1/servers/9c5de49d-999c-44da-a25c-e79327652449 => generated 1507 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:00.720334 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-629dd11d-d480-40eb-b309-ed2346e5554d tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:00.722124 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-629dd11d-d480-40eb-b309-ed2346e5554d tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 9c5de49d-999c-44da-a25c-e79327652449] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:00.731172 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-629dd11d-d480-40eb-b309-ed2346e5554d tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:00.731892 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-629dd11d-d480-40eb-b309-ed2346e5554d tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:00.740563 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-629dd11d-d480-40eb-b309-ed2346e5554d tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:00.740563 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-629dd11d-d480-40eb-b309-ed2346e5554d tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:00.740563 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-629dd11d-d480-40eb-b309-ed2346e5554d tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:00.750591 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-629dd11d-d480-40eb-b309-ed2346e5554d tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:01.063463 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-629dd11d-d480-40eb-b309-ed2346e5554d tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:01.074728 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-629dd11d-d480-40eb-b309-ed2346e5554d tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/9c5de49d-999c-44da-a25c-e79327652449" status: 200 len: 1507 microversion: 2.1 time: 0.359338 Oct 23 01:31:01.096825 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2289/4658] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:00 2022] GET /compute/v2.1/servers/9c5de49d-999c-44da-a25c-e79327652449 => generated 1507 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:02.105769 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-039ac9b0-7603-4f17-8a50-ea14c790edc1 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:02.107486 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-039ac9b0-7603-4f17-8a50-ea14c790edc1 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 9c5de49d-999c-44da-a25c-e79327652449] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:02.116879 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-039ac9b0-7603-4f17-8a50-ea14c790edc1 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:02.117782 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-039ac9b0-7603-4f17-8a50-ea14c790edc1 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:02.118555 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-039ac9b0-7603-4f17-8a50-ea14c790edc1 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:02.119721 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-039ac9b0-7603-4f17-8a50-ea14c790edc1 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:02.120540 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-039ac9b0-7603-4f17-8a50-ea14c790edc1 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:02.122352 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-039ac9b0-7603-4f17-8a50-ea14c790edc1 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:02.297583 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:31:02.408124 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-039ac9b0-7603-4f17-8a50-ea14c790edc1 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:02.433759 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-039ac9b0-7603-4f17-8a50-ea14c790edc1 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/9c5de49d-999c-44da-a25c-e79327652449" status: 200 len: 1465 microversion: 2.1 time: 0.332408 Oct 23 01:31:02.439072 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2370/4659] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:02 2022] GET /compute/v2.1/servers/9c5de49d-999c-44da-a25c-e79327652449 => generated 1465 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:02.904763 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-6ef28351-c3a2-460d-80ec-9f95a63f5b93 req-05e0bdde-ba31-44f7-9c57-c6c1ef7c121e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c5de49d-999c-44da-a25c-e79327652449", "name": "network-vif-deleted", "tag": "62338fc0-27b1-4660-8282-0f858696c808"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:31:02.933788 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:31:02.940677 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-6ef28351-c3a2-460d-80ec-9f95a63f5b93 req-05e0bdde-ba31-44f7-9c57-c6c1ef7c121e service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:02.941669 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-6ef28351-c3a2-460d-80ec-9f95a63f5b93 req-05e0bdde-ba31-44f7-9c57-c6c1ef7c121e service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:02.942371 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-6ef28351-c3a2-460d-80ec-9f95a63f5b93 req-05e0bdde-ba31-44f7-9c57-c6c1ef7c121e service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:02.977998 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-6ef28351-c3a2-460d-80ec-9f95a63f5b93 req-05e0bdde-ba31-44f7-9c57-c6c1ef7c121e service nova] Creating event network-vif-deleted:62338fc0-27b1-4660-8282-0f858696c808 for instance 9c5de49d-999c-44da-a25c-e79327652449 on n-h1-master-1 Oct 23 01:31:02.997062 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-6ef28351-c3a2-460d-80ec-9f95a63f5b93 req-05e0bdde-ba31-44f7-9c57-c6c1ef7c121e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099109 Oct 23 01:31:02.998371 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2290/4660] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:31:03.259907 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f04772ff-fe7d-4953-9bac-d33825d4d776 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:03.268865 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f04772ff-fe7d-4953-9bac-d33825d4d776 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a0a8950e247041d8be4fdfda5e2122fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db2a6834ec144418eb2cf222302fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:03.272296 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f04772ff-fe7d-4953-9bac-d33825d4d776 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Searching by: {'deleted': False, 'project_id': '2db2a6834ec144418eb2cf222302fdb2'} {{(pid=120945) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 23 01:31:03.278718 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:31:03.296440 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f04772ff-fe7d-4953-9bac-d33825d4d776 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:03.300443 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f04772ff-fe7d-4953-9bac-d33825d4d776 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:03.301206 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f04772ff-fe7d-4953-9bac-d33825d4d776 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:03.303709 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f04772ff-fe7d-4953-9bac-d33825d4d776 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:03.305715 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f04772ff-fe7d-4953-9bac-d33825d4d776 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:03.307403 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f04772ff-fe7d-4953-9bac-d33825d4d776 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:03.375946 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.multi_cell_list [None req-f04772ff-fe7d-4953-9bac-d33825d4d776 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120945) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 23 01:31:03.416209 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f04772ff-fe7d-4953-9bac-d33825d4d776 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.162267 Oct 23 01:31:03.442246 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2291/4661] 10.222.0.42 () {58 vars in 1125 bytes} [Sun Oct 23 01:31:03 2022] GET /compute/v2.1/servers => generated 344 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:31:03.442246 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-eb0a7c21-c98a-49be-9c67-0a7f4b5637bf tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:03.442246 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-eb0a7c21-c98a-49be-9c67-0a7f4b5637bf tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a0a8950e247041d8be4fdfda5e2122fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db2a6834ec144418eb2cf222302fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:03.442246 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-eb0a7c21-c98a-49be-9c67-0a7f4b5637bf tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Searching by: {'deleted': False, 'project_id': '2db2a6834ec144418eb2cf222302fdb2'} {{(pid=120945) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 23 01:31:03.446510 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eb0a7c21-c98a-49be-9c67-0a7f4b5637bf tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:03.447144 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eb0a7c21-c98a-49be-9c67-0a7f4b5637bf tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:03.447965 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eb0a7c21-c98a-49be-9c67-0a7f4b5637bf tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:03.448982 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eb0a7c21-c98a-49be-9c67-0a7f4b5637bf tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:03.449602 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eb0a7c21-c98a-49be-9c67-0a7f4b5637bf tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:03.450340 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eb0a7c21-c98a-49be-9c67-0a7f4b5637bf tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:03.471710 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1c02b237-2ac1-41a9-bb83-04a30423da8f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Action: 'create', calling method: .version_select at 0x7f5cc61a5d30>, body: {"keypair": {"name": "tempest-keypair-941449111", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxBBebzbDI5j5sSviddosaEZpu/7OcYJ56eD5yCTuzdRDjnhciZTk+DEGXuuKV08rwtSFh8D0+JEhdpKgbyqwSITCNUoSFdyHXsoh0TGQOPbJe1aKnc+EYlyiTdT5h97A=="}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:31:03.502352 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.multi_cell_list [None req-eb0a7c21-c98a-49be-9c67-0a7f4b5637bf tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120945) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 23 01:31:03.508228 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-1c02b237-2ac1-41a9-bb83-04a30423da8f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Getting quotas for project aa4e3018a6ca477c9a1d7215ad98d9e9. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:31:03.520825 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-1c02b237-2ac1-41a9-bb83-04a30423da8f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Getting quotas for user bb03047092f64e2abbf78e9db1a06e0a and project aa4e3018a6ca477c9a1d7215ad98d9e9. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:31:03.545295 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-eb0a7c21-c98a-49be-9c67-0a7f4b5637bf tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8950e247041d8be4fdfda5e2122fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db2a6834ec144418eb2cf222302fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:03.552267 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eb0a7c21-c98a-49be-9c67-0a7f4b5637bf tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:03.552988 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eb0a7c21-c98a-49be-9c67-0a7f4b5637bf tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:03.556385 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eb0a7c21-c98a-49be-9c67-0a7f4b5637bf tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:03.646489 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1c02b237-2ac1-41a9-bb83-04a30423da8f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.432628 Oct 23 01:31:03.647832 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2371/4662] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 01:31:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:31:03.653011 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-381560d7-22fc-41e4-8a36-a9c6df09e34d tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:03.655052 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-381560d7-22fc-41e4-8a36-a9c6df09e34d tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 9c5de49d-999c-44da-a25c-e79327652449] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:03.661516 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-381560d7-22fc-41e4-8a36-a9c6df09e34d tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:03.662293 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-381560d7-22fc-41e4-8a36-a9c6df09e34d tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:03.662900 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-381560d7-22fc-41e4-8a36-a9c6df09e34d tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:03.664168 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-381560d7-22fc-41e4-8a36-a9c6df09e34d tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:03.664642 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-381560d7-22fc-41e4-8a36-a9c6df09e34d tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:03.665301 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-381560d7-22fc-41e4-8a36-a9c6df09e34d tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:03.724311 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-381560d7-22fc-41e4-8a36-a9c6df09e34d tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:03.725454 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-381560d7-22fc-41e4-8a36-a9c6df09e34d tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:03.726302 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-381560d7-22fc-41e4-8a36-a9c6df09e34d tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:03.728464 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-381560d7-22fc-41e4-8a36-a9c6df09e34d tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lazy-loading 'fault' on Instance uuid 9c5de49d-999c-44da-a25c-e79327652449 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:31:03.775180 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-eb0a7c21-c98a-49be-9c67-0a7f4b5637bf tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] 10.222.0.42 "GET /compute/v2.1/servers/detail" status: 200 len: 1606 microversion: 2.1 time: 0.344593 Oct 23 01:31:03.775956 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2292/4663] 10.222.0.42 () {58 vars in 1146 bytes} [Sun Oct 23 01:31:03 2022] GET /compute/v2.1/servers/detail => generated 1606 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:03.809577 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-93390110-2836-42f8-96e3-550b75fe4b96 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:03.820027 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-93390110-2836-42f8-96e3-550b75fe4b96 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] 10.222.0.42 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014480 Oct 23 01:31:03.821902 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2293/4664] 10.222.0.42 () {58 vars in 1137 bytes} [Sun Oct 23 01:31:03 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:31:03.846062 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-381560d7-22fc-41e4-8a36-a9c6df09e34d tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:03.858978 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-381560d7-22fc-41e4-8a36-a9c6df09e34d tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/9c5de49d-999c-44da-a25c-e79327652449" status: 200 len: 1311 microversion: 2.1 time: 0.209852 Oct 23 01:31:03.860410 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2372/4665] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:03 2022] GET /compute/v2.1/servers/9c5de49d-999c-44da-a25c-e79327652449 => generated 1311 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:04.183445 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6568baf0-4154-409d-973a-5870d038b7b1 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:04.184968 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6568baf0-4154-409d-973a-5870d038b7b1 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] [instance: 08bd5c17-1a39-4d28-9a01-e93b999bfb61] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:04.226356 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6568baf0-4154-409d-973a-5870d038b7b1 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:04.232481 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6568baf0-4154-409d-973a-5870d038b7b1 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:04.233683 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6568baf0-4154-409d-973a-5870d038b7b1 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:04.234889 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6568baf0-4154-409d-973a-5870d038b7b1 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:04.235323 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6568baf0-4154-409d-973a-5870d038b7b1 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:04.235757 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6568baf0-4154-409d-973a-5870d038b7b1 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:04.271539 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:31:04.312192 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6568baf0-4154-409d-973a-5870d038b7b1 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] [instance: 08bd5c17-1a39-4d28-9a01-e93b999bfb61] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:31:04.782510 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6568baf0-4154-409d-973a-5870d038b7b1 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] 10.222.0.42 "DELETE /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61" status: 204 len: 0 microversion: 2.1 time: 0.611198 Oct 23 01:31:04.786022 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2294/4666] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:31:04 2022] DELETE /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:31:04.793902 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-941fbc34-2dfe-4380-9139-beaa982b99ad tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:04.795607 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-941fbc34-2dfe-4380-9139-beaa982b99ad tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] [instance: 08bd5c17-1a39-4d28-9a01-e93b999bfb61] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:04.818112 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-941fbc34-2dfe-4380-9139-beaa982b99ad tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:04.820802 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-941fbc34-2dfe-4380-9139-beaa982b99ad tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:04.822530 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-941fbc34-2dfe-4380-9139-beaa982b99ad tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:04.824447 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-941fbc34-2dfe-4380-9139-beaa982b99ad tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:04.824949 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-941fbc34-2dfe-4380-9139-beaa982b99ad tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:04.826335 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-941fbc34-2dfe-4380-9139-beaa982b99ad tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:04.889967 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bcc08644-4c8b-4eb0-b31e-a028f7b931aa tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:04.891511 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-bcc08644-4c8b-4eb0-b31e-a028f7b931aa tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 9c5de49d-999c-44da-a25c-e79327652449] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:04.908854 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bcc08644-4c8b-4eb0-b31e-a028f7b931aa tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:04.909305 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bcc08644-4c8b-4eb0-b31e-a028f7b931aa tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:04.909741 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bcc08644-4c8b-4eb0-b31e-a028f7b931aa tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:04.932743 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bcc08644-4c8b-4eb0-b31e-a028f7b931aa tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:04.936792 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bcc08644-4c8b-4eb0-b31e-a028f7b931aa tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:04.942862 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bcc08644-4c8b-4eb0-b31e-a028f7b931aa tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:05.006474 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-bcc08644-4c8b-4eb0-b31e-a028f7b931aa tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] HTTP exception thrown: Instance 9c5de49d-999c-44da-a25c-e79327652449 could not be found. Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bcc08644-4c8b-4eb0-b31e-a028f7b931aa tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Request method failure captured: Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/9c5de49d-999c-44da-a25c-e79327652449 HTTP/1.1 Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJkiigL5TCEu6eSSAcyvyVmYwcN25zFDHPVJqRKHbtxzIEn87jCeqAfp7Z9r3Mqhyb3sj4ihzI_o6sMFkrbUwNL-zNG9d9yXVxVjtum4uC7NU-HTDI6Yq0W2nY2ZxVUGKOV2HfdfrtC_JKFgX2qnR1YVSIaIVW5JxazPUN9LbJjq984 Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: e2ee2ea8399e42a5a5cd0d0ddeb192b5 Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServersTestJSON-245534565 Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}] Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServersTestJSON-245534565 Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: e2ee2ea8399e42a5a5cd0d0ddeb192b5 Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServersTestJSON-245534565 Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServersTestJSON-245534565-project Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 77197152ea5040bab602d5381d21341a Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServersTestJSON-245534565-project Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 9c5de49d-999c-44da-a25c-e79327652449 could not be found. Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '9c5de49d-999c-44da-a25c-e79327652449'} Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c5de49d-999c-44da-a25c-e79327652449 could not be found. Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c5de49d-999c-44da-a25c-e79327652449 could not be found. Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:31:05.016393 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:31:05.021897 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:31:05.021897 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:31:05.021897 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:31:05.021897 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:31:05.021897 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c5de49d-999c-44da-a25c-e79327652449 could not be found. Oct 23 01:31:05.021897 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:31:05.021897 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bcc08644-4c8b-4eb0-b31e-a028f7b931aa tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Returning 404 to user: Instance 9c5de49d-999c-44da-a25c-e79327652449 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:31:05.026911 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bcc08644-4c8b-4eb0-b31e-a028f7b931aa tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/9c5de49d-999c-44da-a25c-e79327652449" status: 404 len: 111 microversion: 2.1 time: 0.137300 Oct 23 01:31:05.026911 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2295/4667] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:04 2022] GET /compute/v2.1/servers/9c5de49d-999c-44da-a25c-e79327652449 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:31:05.046350 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f2873c10-0df0-455f-80d1-2bc0084d2540 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Action: 'create', calling method: .version_select at 0x7f5cc62e50d0>, body: {"keypair": {"name": "tempest-key-759453390", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWhPnuwEdYEUsvbDYtoU5KF2TwsgebZ6OeX0g99OfK/cQ/vkF885qlaQSGH+tYAG/IUsmlCMk201KsduFHROiqGEk1jXVEiV/VvyDzV/a5ZRTeSM4bGqBOWXOJA7dKBfw=="}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:31:05.115927 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-f2873c10-0df0-455f-80d1-2bc0084d2540 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Getting quotas for project e2ee2ea8399e42a5a5cd0d0ddeb192b5. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:31:05.138044 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-f2873c10-0df0-455f-80d1-2bc0084d2540 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Getting quotas for user 77197152ea5040bab602d5381d21341a and project e2ee2ea8399e42a5a5cd0d0ddeb192b5. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:31:05.238372 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-941fbc34-2dfe-4380-9139-beaa982b99ad tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8950e247041d8be4fdfda5e2122fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db2a6834ec144418eb2cf222302fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:05.249339 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-941fbc34-2dfe-4380-9139-beaa982b99ad tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] 10.222.0.42 "GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61" status: 200 len: 1609 microversion: 2.1 time: 0.461611 Oct 23 01:31:05.252367 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2373/4668] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:04 2022] GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61 => generated 1609 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:05.310586 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f2873c10-0df0-455f-80d1-2bc0084d2540 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.269309 Oct 23 01:31:05.317181 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2296/4669] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 01:31:05 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:31:05.326369 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-27dea44c-cbcf-44ac-ba11-ccad28349f58 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '.version_select at 0x7f5cc613ed30>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:05.333944 n-d-master-1 devstack@n-api.service[120944]: WARNING oslo_db.sqlalchemy.utils [None req-27dea44c-cbcf-44ac-ba11-ccad28349f58 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 23 01:31:05.348586 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-27dea44c-cbcf-44ac-ba11-ccad28349f58 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.024579 Oct 23 01:31:05.349547 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2374/4670] 10.222.0.42 () {58 vars in 1137 bytes} [Sun Oct 23 01:31:05 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:31:05.494866 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-da1486ed-393d-4560-8f03-58bf0473b207 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1209696544", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "key_name": "tempest-key-759453390", "networks": [{"uuid": "54c8030f-5807-4507-8aa3-283b114a73f4"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:31:05.772250 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-da1486ed-393d-4560-8f03-58bf0473b207 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] validate_networks() for [('54c8030f-5807-4507-8aa3-283b114a73f4', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:31:06.277194 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-896b7d9d-d986-4d60-ada6-cb043bd1b70f tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:06.278064 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-896b7d9d-d986-4d60-ada6-cb043bd1b70f tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] [instance: 08bd5c17-1a39-4d28-9a01-e93b999bfb61] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:06.297178 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-896b7d9d-d986-4d60-ada6-cb043bd1b70f tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:06.304352 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-896b7d9d-d986-4d60-ada6-cb043bd1b70f tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:06.304963 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-896b7d9d-d986-4d60-ada6-cb043bd1b70f tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:06.307939 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-896b7d9d-d986-4d60-ada6-cb043bd1b70f tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:06.310659 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-896b7d9d-d986-4d60-ada6-cb043bd1b70f tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:06.311253 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-896b7d9d-d986-4d60-ada6-cb043bd1b70f tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:06.604982 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-da1486ed-393d-4560-8f03-58bf0473b207 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:31:06.605574 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-da1486ed-393d-4560-8f03-58bf0473b207 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:31:06.607831 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-da1486ed-393d-4560-8f03-58bf0473b207 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:31:06.609637 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-da1486ed-393d-4560-8f03-58bf0473b207 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:31:06.609637 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-da1486ed-393d-4560-8f03-58bf0473b207 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:31:06.646670 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da1486ed-393d-4560-8f03-58bf0473b207 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:06.647862 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da1486ed-393d-4560-8f03-58bf0473b207 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:06.648453 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da1486ed-393d-4560-8f03-58bf0473b207 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:06.649207 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da1486ed-393d-4560-8f03-58bf0473b207 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:06.649672 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da1486ed-393d-4560-8f03-58bf0473b207 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:06.650131 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da1486ed-393d-4560-8f03-58bf0473b207 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:06.759649 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-da1486ed-393d-4560-8f03-58bf0473b207 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Getting quotas for project e2ee2ea8399e42a5a5cd0d0ddeb192b5. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:31:06.781821 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:31:06.800921 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-da1486ed-393d-4560-8f03-58bf0473b207 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Getting quotas for user 77197152ea5040bab602d5381d21341a and project e2ee2ea8399e42a5a5cd0d0ddeb192b5. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:31:06.859679 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-da1486ed-393d-4560-8f03-58bf0473b207 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:31:06.862127 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-da1486ed-393d-4560-8f03-58bf0473b207 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 8e4ff17b-af17-4eec-aad8-966fa0ca835b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:31:07.008218 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-896b7d9d-d986-4d60-ada6-cb043bd1b70f tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8950e247041d8be4fdfda5e2122fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db2a6834ec144418eb2cf222302fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:07.031864 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-896b7d9d-d986-4d60-ada6-cb043bd1b70f tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] 10.222.0.42 "GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61" status: 200 len: 1609 microversion: 2.1 time: 0.759020 Oct 23 01:31:07.054106 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2375/4671] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:06 2022] GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61 => generated 1609 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:07.187047 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-da1486ed-393d-4560-8f03-58bf0473b207 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.696883 Oct 23 01:31:07.189063 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2297/4672] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:31:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:31:07.203217 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5420bf37-e2cc-475e-9ad0-862125b0a2d4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:07.204265 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5420bf37-e2cc-475e-9ad0-862125b0a2d4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 8e4ff17b-af17-4eec-aad8-966fa0ca835b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:07.269285 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5420bf37-e2cc-475e-9ad0-862125b0a2d4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:07.278272 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5420bf37-e2cc-475e-9ad0-862125b0a2d4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/8e4ff17b-af17-4eec-aad8-966fa0ca835b" status: 200 len: 1228 microversion: 2.1 time: 0.079189 Oct 23 01:31:07.279977 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2376/4673] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:07 2022] GET /compute/v2.1/servers/8e4ff17b-af17-4eec-aad8-966fa0ca835b => generated 1228 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:08.066779 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-42270312-864f-490e-ba55-e9adf3828721 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:08.067483 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-42270312-864f-490e-ba55-e9adf3828721 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] [instance: 08bd5c17-1a39-4d28-9a01-e93b999bfb61] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:08.096391 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-42270312-864f-490e-ba55-e9adf3828721 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:08.098870 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-42270312-864f-490e-ba55-e9adf3828721 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:08.101203 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-42270312-864f-490e-ba55-e9adf3828721 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:08.102354 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-42270312-864f-490e-ba55-e9adf3828721 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:08.120987 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-42270312-864f-490e-ba55-e9adf3828721 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:08.120987 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-42270312-864f-490e-ba55-e9adf3828721 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:08.303538 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f6152b3e-19bc-4077-8923-2ba5f4f10016 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:08.304941 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f6152b3e-19bc-4077-8923-2ba5f4f10016 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 8e4ff17b-af17-4eec-aad8-966fa0ca835b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:08.452476 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f6152b3e-19bc-4077-8923-2ba5f4f10016 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:08.464437 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f6152b3e-19bc-4077-8923-2ba5f4f10016 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/8e4ff17b-af17-4eec-aad8-966fa0ca835b" status: 200 len: 1228 microversion: 2.1 time: 0.163999 Oct 23 01:31:08.465416 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2377/4674] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:08 2022] GET /compute/v2.1/servers/8e4ff17b-af17-4eec-aad8-966fa0ca835b => generated 1228 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:31:08.514090 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-42270312-864f-490e-ba55-e9adf3828721 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8950e247041d8be4fdfda5e2122fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db2a6834ec144418eb2cf222302fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:08.531528 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-42270312-864f-490e-ba55-e9adf3828721 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] 10.222.0.42 "GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61" status: 200 len: 1609 microversion: 2.1 time: 0.466205 Oct 23 01:31:08.546005 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2298/4675] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:08 2022] GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61 => generated 1609 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:08.546582 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-32cb3c88-148d-4cb2-8fbe-2539aad6ba36 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1812051704", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bd4b7167-61cf-4f14-9c60-72538a1ed815"}], "security_groups": [{"name": "tempest-securitygroup--592980588"}], "key_name": "tempest-keypair-941449111", "user_data": "}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:31:08.727956 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-32cb3c88-148d-4cb2-8fbe-2539aad6ba36 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] validate_networks() for [('bd4b7167-61cf-4f14-9c60-72538a1ed815', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:31:09.496459 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b133d93f-f4e8-428c-86ea-0aaee1b02e12 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:09.504938 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b133d93f-f4e8-428c-86ea-0aaee1b02e12 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 8e4ff17b-af17-4eec-aad8-966fa0ca835b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:09.516548 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b133d93f-f4e8-428c-86ea-0aaee1b02e12 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:09.520061 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b133d93f-f4e8-428c-86ea-0aaee1b02e12 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:09.521948 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b133d93f-f4e8-428c-86ea-0aaee1b02e12 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:09.524150 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b133d93f-f4e8-428c-86ea-0aaee1b02e12 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:09.524852 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b133d93f-f4e8-428c-86ea-0aaee1b02e12 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:09.525491 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b133d93f-f4e8-428c-86ea-0aaee1b02e12 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:09.698184 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b133d93f-f4e8-428c-86ea-0aaee1b02e12 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:09.708397 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b133d93f-f4e8-428c-86ea-0aaee1b02e12 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/8e4ff17b-af17-4eec-aad8-966fa0ca835b" status: 200 len: 1224 microversion: 2.1 time: 0.216938 Oct 23 01:31:09.730949 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2299/4676] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:09 2022] GET /compute/v2.1/servers/8e4ff17b-af17-4eec-aad8-966fa0ca835b => generated 1224 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:09.744496 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-66bf4555-e039-4302-b408-6aebc591d82d tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:09.748646 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-66bf4555-e039-4302-b408-6aebc591d82d tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] [instance: 08bd5c17-1a39-4d28-9a01-e93b999bfb61] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:09.770205 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-66bf4555-e039-4302-b408-6aebc591d82d tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:09.782359 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-66bf4555-e039-4302-b408-6aebc591d82d tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:09.791782 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-66bf4555-e039-4302-b408-6aebc591d82d tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:09.791782 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-66bf4555-e039-4302-b408-6aebc591d82d tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:09.791782 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-66bf4555-e039-4302-b408-6aebc591d82d tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:09.791782 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-66bf4555-e039-4302-b408-6aebc591d82d tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:10.041570 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-66bf4555-e039-4302-b408-6aebc591d82d tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8950e247041d8be4fdfda5e2122fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db2a6834ec144418eb2cf222302fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:10.057866 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-66bf4555-e039-4302-b408-6aebc591d82d tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] 10.222.0.42 "GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61" status: 200 len: 1542 microversion: 2.1 time: 0.319630 Oct 23 01:31:10.074003 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2300/4677] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:09 2022] GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61 => generated 1542 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:10.131254 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-749cd293-5f89-49d8-9a14-6c10c04c80b3 req-d46c1edc-7466-4daa-accf-8e0b6520a79a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08bd5c17-1a39-4d28-9a01-e93b999bfb61", "name": "network-vif-deleted", "tag": "933b406b-4a7e-457e-8b02-404bd679d55e"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:31:10.164187 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-749cd293-5f89-49d8-9a14-6c10c04c80b3 req-d46c1edc-7466-4daa-accf-8e0b6520a79a service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:10.165839 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-749cd293-5f89-49d8-9a14-6c10c04c80b3 req-d46c1edc-7466-4daa-accf-8e0b6520a79a service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:10.170004 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-749cd293-5f89-49d8-9a14-6c10c04c80b3 req-d46c1edc-7466-4daa-accf-8e0b6520a79a service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:10.211243 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-749cd293-5f89-49d8-9a14-6c10c04c80b3 req-d46c1edc-7466-4daa-accf-8e0b6520a79a service nova] Creating event network-vif-deleted:933b406b-4a7e-457e-8b02-404bd679d55e for instance 08bd5c17-1a39-4d28-9a01-e93b999bfb61 on n-h1-master-1 Oct 23 01:31:10.225042 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-749cd293-5f89-49d8-9a14-6c10c04c80b3 req-d46c1edc-7466-4daa-accf-8e0b6520a79a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095477 Oct 23 01:31:10.225712 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2301/4678] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:31:10.345948 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-32cb3c88-148d-4cb2-8fbe-2539aad6ba36 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:31:10.346552 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-32cb3c88-148d-4cb2-8fbe-2539aad6ba36 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:31:10.347140 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-32cb3c88-148d-4cb2-8fbe-2539aad6ba36 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:31:10.347652 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-32cb3c88-148d-4cb2-8fbe-2539aad6ba36 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:31:10.348167 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-32cb3c88-148d-4cb2-8fbe-2539aad6ba36 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:31:10.360130 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-32cb3c88-148d-4cb2-8fbe-2539aad6ba36 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:10.360883 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-32cb3c88-148d-4cb2-8fbe-2539aad6ba36 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:10.361525 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-32cb3c88-148d-4cb2-8fbe-2539aad6ba36 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:10.362499 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-32cb3c88-148d-4cb2-8fbe-2539aad6ba36 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:10.363200 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-32cb3c88-148d-4cb2-8fbe-2539aad6ba36 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:10.363877 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-32cb3c88-148d-4cb2-8fbe-2539aad6ba36 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:10.395514 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-32cb3c88-148d-4cb2-8fbe-2539aad6ba36 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Getting quotas for project aa4e3018a6ca477c9a1d7215ad98d9e9. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:31:10.441171 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-32cb3c88-148d-4cb2-8fbe-2539aad6ba36 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Getting quotas for user bb03047092f64e2abbf78e9db1a06e0a and project aa4e3018a6ca477c9a1d7215ad98d9e9. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:31:10.486473 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-32cb3c88-148d-4cb2-8fbe-2539aad6ba36 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:31:10.495692 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-32cb3c88-148d-4cb2-8fbe-2539aad6ba36 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:31:10.735831 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4b3c3f97-564f-4e25-bcb4-d1f7aa33a043 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:10.736539 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4b3c3f97-564f-4e25-bcb4-d1f7aa33a043 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 8e4ff17b-af17-4eec-aad8-966fa0ca835b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:10.751791 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b3c3f97-564f-4e25-bcb4-d1f7aa33a043 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:10.752530 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b3c3f97-564f-4e25-bcb4-d1f7aa33a043 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:10.753150 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b3c3f97-564f-4e25-bcb4-d1f7aa33a043 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:10.754048 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b3c3f97-564f-4e25-bcb4-d1f7aa33a043 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:10.759011 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b3c3f97-564f-4e25-bcb4-d1f7aa33a043 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:10.759674 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b3c3f97-564f-4e25-bcb4-d1f7aa33a043 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:10.787746 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-32cb3c88-148d-4cb2-8fbe-2539aad6ba36 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.253067 Oct 23 01:31:10.797824 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2378/4679] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:31:08 2022] POST /compute/v2.1/servers => generated 408 bytes in 2261 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:31:10.808671 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d647445f-3fd4-47fb-932e-1634542cb276 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:10.815632 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d647445f-3fd4-47fb-932e-1634542cb276 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:10.834594 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:31:10.883051 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4b3c3f97-564f-4e25-bcb4-d1f7aa33a043 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:10.891941 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4b3c3f97-564f-4e25-bcb4-d1f7aa33a043 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/8e4ff17b-af17-4eec-aad8-966fa0ca835b" status: 200 len: 1288 microversion: 2.1 time: 0.162076 Oct 23 01:31:10.903474 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2302/4680] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:10 2022] GET /compute/v2.1/servers/8e4ff17b-af17-4eec-aad8-966fa0ca835b => generated 1288 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:10.969903 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d647445f-3fd4-47fb-932e-1634542cb276 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:10.985886 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d647445f-3fd4-47fb-932e-1634542cb276 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1238 microversion: 2.1 time: 0.178838 Oct 23 01:31:10.987894 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2379/4681] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:10 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1238 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:11.084457 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fdf6acb8-0fd3-4fed-a8b4-0d19b3a6f8a8 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:11.085083 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-fdf6acb8-0fd3-4fed-a8b4-0d19b3a6f8a8 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] [instance: 08bd5c17-1a39-4d28-9a01-e93b999bfb61] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:11.101273 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fdf6acb8-0fd3-4fed-a8b4-0d19b3a6f8a8 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:11.101777 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fdf6acb8-0fd3-4fed-a8b4-0d19b3a6f8a8 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:11.102323 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fdf6acb8-0fd3-4fed-a8b4-0d19b3a6f8a8 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:11.103067 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fdf6acb8-0fd3-4fed-a8b4-0d19b3a6f8a8 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:11.103532 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fdf6acb8-0fd3-4fed-a8b4-0d19b3a6f8a8 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:11.103967 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fdf6acb8-0fd3-4fed-a8b4-0d19b3a6f8a8 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:11.344268 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-fdf6acb8-0fd3-4fed-a8b4-0d19b3a6f8a8 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8950e247041d8be4fdfda5e2122fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db2a6834ec144418eb2cf222302fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:11.353109 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fdf6acb8-0fd3-4fed-a8b4-0d19b3a6f8a8 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] 10.222.0.42 "GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61" status: 200 len: 1253 microversion: 2.1 time: 0.272600 Oct 23 01:31:11.353706 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2303/4682] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:11 2022] GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61 => generated 1253 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:11.928118 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f21e839f-a5ce-4807-b206-5e1e8f777e76 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:11.928747 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f21e839f-a5ce-4807-b206-5e1e8f777e76 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 8e4ff17b-af17-4eec-aad8-966fa0ca835b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:11.951073 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f21e839f-a5ce-4807-b206-5e1e8f777e76 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:11.951631 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f21e839f-a5ce-4807-b206-5e1e8f777e76 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:11.952082 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f21e839f-a5ce-4807-b206-5e1e8f777e76 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:11.956287 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f21e839f-a5ce-4807-b206-5e1e8f777e76 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:11.962048 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f21e839f-a5ce-4807-b206-5e1e8f777e76 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:11.962748 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f21e839f-a5ce-4807-b206-5e1e8f777e76 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:12.287263 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-15c3a644-92ee-4d12-bcf2-a15a6e0fc593 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:12.287861 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-15c3a644-92ee-4d12-bcf2-a15a6e0fc593 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:12.322518 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15c3a644-92ee-4d12-bcf2-a15a6e0fc593 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:12.326854 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15c3a644-92ee-4d12-bcf2-a15a6e0fc593 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:12.327823 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15c3a644-92ee-4d12-bcf2-a15a6e0fc593 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:12.328978 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15c3a644-92ee-4d12-bcf2-a15a6e0fc593 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:12.332019 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15c3a644-92ee-4d12-bcf2-a15a6e0fc593 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:12.332827 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15c3a644-92ee-4d12-bcf2-a15a6e0fc593 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:12.410759 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-15c3a644-92ee-4d12-bcf2-a15a6e0fc593 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a/ips" status: 200 len: 151 microversion: 2.20 time: 0.576277 Oct 23 01:31:12.412959 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2380/4683] 10.222.0.42 () {60 vars in 1289 bytes} [Sun Oct 23 01:31:11 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a/ips => generated 151 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:31:12.438934 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bf8eecd8-772b-430e-9bdf-9d22d2a844fe tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:12.440946 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bf8eecd8-772b-430e-9bdf-9d22d2a844fe tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:13.069093 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bf8eecd8-772b-430e-9bdf-9d22d2a844fe tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:13.096064 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bf8eecd8-772b-430e-9bdf-9d22d2a844fe tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1238 microversion: 2.1 time: 0.661974 Oct 23 01:31:13.105467 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2381/4684] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:12 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1238 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:13.123124 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-61ebcf04-24e0-4726-a350-46f905ce2cfd tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:13.123759 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-61ebcf04-24e0-4726-a350-46f905ce2cfd tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] [instance: 08bd5c17-1a39-4d28-9a01-e93b999bfb61] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:13.150891 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-61ebcf04-24e0-4726-a350-46f905ce2cfd tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:13.153484 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-61ebcf04-24e0-4726-a350-46f905ce2cfd tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:13.154496 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-61ebcf04-24e0-4726-a350-46f905ce2cfd tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:13.158002 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-61ebcf04-24e0-4726-a350-46f905ce2cfd tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:13.158659 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-61ebcf04-24e0-4726-a350-46f905ce2cfd tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:13.159292 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-61ebcf04-24e0-4726-a350-46f905ce2cfd tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:13.284426 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f21e839f-a5ce-4807-b206-5e1e8f777e76 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:13.292643 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f21e839f-a5ce-4807-b206-5e1e8f777e76 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/8e4ff17b-af17-4eec-aad8-966fa0ca835b" status: 200 len: 1328 microversion: 2.1 time: 1.368697 Oct 23 01:31:13.293249 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2304/4685] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:11 2022] GET /compute/v2.1/servers/8e4ff17b-af17-4eec-aad8-966fa0ca835b => generated 1328 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:31:13.340572 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-61ebcf04-24e0-4726-a350-46f905ce2cfd tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8950e247041d8be4fdfda5e2122fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db2a6834ec144418eb2cf222302fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:13.350309 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-61ebcf04-24e0-4726-a350-46f905ce2cfd tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] 10.222.0.42 "GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61" status: 200 len: 1253 microversion: 2.1 time: 0.243598 Oct 23 01:31:13.359780 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2382/4686] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:13 2022] GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61 => generated 1253 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:14.132490 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d3f7e8d3-0b8d-46dd-9dc4-188f95434050 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:14.133121 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d3f7e8d3-0b8d-46dd-9dc4-188f95434050 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:14.155854 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d3f7e8d3-0b8d-46dd-9dc4-188f95434050 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:14.156361 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d3f7e8d3-0b8d-46dd-9dc4-188f95434050 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:14.156805 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d3f7e8d3-0b8d-46dd-9dc4-188f95434050 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:14.171085 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d3f7e8d3-0b8d-46dd-9dc4-188f95434050 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:14.172495 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d3f7e8d3-0b8d-46dd-9dc4-188f95434050 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:14.174121 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d3f7e8d3-0b8d-46dd-9dc4-188f95434050 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:14.282295 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d3f7e8d3-0b8d-46dd-9dc4-188f95434050 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:14.303928 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d3f7e8d3-0b8d-46dd-9dc4-188f95434050 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1290 microversion: 2.1 time: 0.175602 Oct 23 01:31:14.316162 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1a970dc8-8ac8-4b7d-b831-3cce1e397de7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:14.316794 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1a970dc8-8ac8-4b7d-b831-3cce1e397de7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 8e4ff17b-af17-4eec-aad8-966fa0ca835b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:14.327072 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2305/4687] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:14 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1290 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:14.345142 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1a970dc8-8ac8-4b7d-b831-3cce1e397de7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:14.345558 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1a970dc8-8ac8-4b7d-b831-3cce1e397de7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:14.347741 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1a970dc8-8ac8-4b7d-b831-3cce1e397de7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:14.354468 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1a970dc8-8ac8-4b7d-b831-3cce1e397de7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:14.355280 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1a970dc8-8ac8-4b7d-b831-3cce1e397de7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:14.358117 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1a970dc8-8ac8-4b7d-b831-3cce1e397de7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:14.387230 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4422eef1-1785-4ef1-9dfd-b8c02fe0d6fb tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:14.392863 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4422eef1-1785-4ef1-9dfd-b8c02fe0d6fb tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] [instance: 08bd5c17-1a39-4d28-9a01-e93b999bfb61] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:14.407205 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4422eef1-1785-4ef1-9dfd-b8c02fe0d6fb tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:14.408862 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4422eef1-1785-4ef1-9dfd-b8c02fe0d6fb tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:14.409576 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4422eef1-1785-4ef1-9dfd-b8c02fe0d6fb tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:14.410646 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4422eef1-1785-4ef1-9dfd-b8c02fe0d6fb tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:14.411294 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4422eef1-1785-4ef1-9dfd-b8c02fe0d6fb tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:14.414434 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4422eef1-1785-4ef1-9dfd-b8c02fe0d6fb tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:14.714472 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4422eef1-1785-4ef1-9dfd-b8c02fe0d6fb tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8950e247041d8be4fdfda5e2122fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db2a6834ec144418eb2cf222302fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:14.722859 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4422eef1-1785-4ef1-9dfd-b8c02fe0d6fb tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] 10.222.0.42 "GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61" status: 200 len: 1253 microversion: 2.1 time: 0.340559 Oct 23 01:31:14.726761 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2306/4688] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:14 2022] GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61 => generated 1253 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:31:14.731721 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-d5f9253b-c874-470c-8aba-a032469ea406 req-a543715e-be35-4ef5-affa-52fbe2110ea0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e4ff17b-af17-4eec-aad8-966fa0ca835b", "tag": "e1ac53d0-c34f-4229-a235-c79c8887b406"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:31:14.761908 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-d5f9253b-c874-470c-8aba-a032469ea406 req-a543715e-be35-4ef5-affa-52fbe2110ea0 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:14.766054 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-d5f9253b-c874-470c-8aba-a032469ea406 req-a543715e-be35-4ef5-affa-52fbe2110ea0 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:14.766054 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-d5f9253b-c874-470c-8aba-a032469ea406 req-a543715e-be35-4ef5-affa-52fbe2110ea0 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:14.791416 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-d5f9253b-c874-470c-8aba-a032469ea406 req-a543715e-be35-4ef5-affa-52fbe2110ea0 service nova] Creating event network-changed:e1ac53d0-c34f-4229-a235-c79c8887b406 for instance 8e4ff17b-af17-4eec-aad8-966fa0ca835b on n-h2-master-1 Oct 23 01:31:14.800365 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-d5f9253b-c874-470c-8aba-a032469ea406 req-a543715e-be35-4ef5-affa-52fbe2110ea0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072093 Oct 23 01:31:14.801523 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2307/4689] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:31:14.860163 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1a970dc8-8ac8-4b7d-b831-3cce1e397de7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:14.869225 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1a970dc8-8ac8-4b7d-b831-3cce1e397de7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/8e4ff17b-af17-4eec-aad8-966fa0ca835b" status: 200 len: 1328 microversion: 2.1 time: 0.557420 Oct 23 01:31:14.886429 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2383/4690] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:14 2022] GET /compute/v2.1/servers/8e4ff17b-af17-4eec-aad8-966fa0ca835b => generated 1328 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:15.355494 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-aa4db626-faaa-4573-9b60-9d871498bae6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:15.361871 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-aa4db626-faaa-4573-9b60-9d871498bae6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:15.379256 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa4db626-faaa-4573-9b60-9d871498bae6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:15.388628 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa4db626-faaa-4573-9b60-9d871498bae6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:15.390068 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa4db626-faaa-4573-9b60-9d871498bae6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:15.395599 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa4db626-faaa-4573-9b60-9d871498bae6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:15.396479 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa4db626-faaa-4573-9b60-9d871498bae6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:15.398650 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa4db626-faaa-4573-9b60-9d871498bae6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:15.544166 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-aa4db626-faaa-4573-9b60-9d871498bae6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:15.554789 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-aa4db626-faaa-4573-9b60-9d871498bae6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1296 microversion: 2.1 time: 0.209610 Oct 23 01:31:15.557263 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2308/4691] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:15 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1296 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:15.759404 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4288c01d-614e-4506-9d65-4bbeb5ba0425 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:15.761150 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4288c01d-614e-4506-9d65-4bbeb5ba0425 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] [instance: 08bd5c17-1a39-4d28-9a01-e93b999bfb61] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:15.774963 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4288c01d-614e-4506-9d65-4bbeb5ba0425 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:15.775516 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4288c01d-614e-4506-9d65-4bbeb5ba0425 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:15.775975 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4288c01d-614e-4506-9d65-4bbeb5ba0425 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:15.776760 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4288c01d-614e-4506-9d65-4bbeb5ba0425 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:15.777260 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4288c01d-614e-4506-9d65-4bbeb5ba0425 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:15.777695 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4288c01d-614e-4506-9d65-4bbeb5ba0425 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:15.821390 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:31:15.894487 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bac8e5c1-5eb0-4b81-bee8-1c8e9bcf6613 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:15.895595 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-bac8e5c1-5eb0-4b81-bee8-1c8e9bcf6613 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 8e4ff17b-af17-4eec-aad8-966fa0ca835b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:15.913595 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bac8e5c1-5eb0-4b81-bee8-1c8e9bcf6613 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:15.917306 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bac8e5c1-5eb0-4b81-bee8-1c8e9bcf6613 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:15.917822 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bac8e5c1-5eb0-4b81-bee8-1c8e9bcf6613 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:15.918650 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bac8e5c1-5eb0-4b81-bee8-1c8e9bcf6613 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:15.919125 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bac8e5c1-5eb0-4b81-bee8-1c8e9bcf6613 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:15.925898 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bac8e5c1-5eb0-4b81-bee8-1c8e9bcf6613 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:15.954967 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4288c01d-614e-4506-9d65-4bbeb5ba0425 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8950e247041d8be4fdfda5e2122fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db2a6834ec144418eb2cf222302fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:15.975086 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4288c01d-614e-4506-9d65-4bbeb5ba0425 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] 10.222.0.42 "GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61" status: 200 len: 1253 microversion: 2.1 time: 0.221440 Oct 23 01:31:15.982364 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2384/4692] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:15 2022] GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61 => generated 1253 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:16.256900 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bac8e5c1-5eb0-4b81-bee8-1c8e9bcf6613 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:16.269120 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bac8e5c1-5eb0-4b81-bee8-1c8e9bcf6613 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/8e4ff17b-af17-4eec-aad8-966fa0ca835b" status: 200 len: 1328 microversion: 2.1 time: 0.380390 Oct 23 01:31:16.285562 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2309/4693] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:15 2022] GET /compute/v2.1/servers/8e4ff17b-af17-4eec-aad8-966fa0ca835b => generated 1328 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:16.582507 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-801adbec-a91d-44ab-8e73-ae8ea6e16c7d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:16.583136 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-801adbec-a91d-44ab-8e73-ae8ea6e16c7d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:16.593455 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-801adbec-a91d-44ab-8e73-ae8ea6e16c7d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:16.594982 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-801adbec-a91d-44ab-8e73-ae8ea6e16c7d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:16.594982 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-801adbec-a91d-44ab-8e73-ae8ea6e16c7d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:16.595179 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-801adbec-a91d-44ab-8e73-ae8ea6e16c7d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:16.595642 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-801adbec-a91d-44ab-8e73-ae8ea6e16c7d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:16.596069 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-801adbec-a91d-44ab-8e73-ae8ea6e16c7d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:17.004748 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-74840466-3d29-45b4-b2ff-f1708fd50138 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:17.006274 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-74840466-3d29-45b4-b2ff-f1708fd50138 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] [instance: 08bd5c17-1a39-4d28-9a01-e93b999bfb61] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:17.017868 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=6 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:31:17.019160 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=12 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:31:17.021671 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-74840466-3d29-45b4-b2ff-f1708fd50138 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:17.022508 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-74840466-3d29-45b4-b2ff-f1708fd50138 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:17.023185 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-74840466-3d29-45b4-b2ff-f1708fd50138 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:17.024215 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-74840466-3d29-45b4-b2ff-f1708fd50138 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:17.024889 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-74840466-3d29-45b4-b2ff-f1708fd50138 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:17.025530 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-74840466-3d29-45b4-b2ff-f1708fd50138 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:17.263702 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-801adbec-a91d-44ab-8e73-ae8ea6e16c7d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:17.274761 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-801adbec-a91d-44ab-8e73-ae8ea6e16c7d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1363 microversion: 2.1 time: 0.696090 Oct 23 01:31:17.279011 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2385/4694] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:16 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1363 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:17.292584 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-28f9f000-4feb-483f-9f4e-0a0e84c9a535 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:17.293522 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-28f9f000-4feb-483f-9f4e-0a0e84c9a535 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 8e4ff17b-af17-4eec-aad8-966fa0ca835b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:17.306942 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-28f9f000-4feb-483f-9f4e-0a0e84c9a535 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:17.307761 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-28f9f000-4feb-483f-9f4e-0a0e84c9a535 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:17.308964 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-28f9f000-4feb-483f-9f4e-0a0e84c9a535 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:17.323082 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-28f9f000-4feb-483f-9f4e-0a0e84c9a535 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:17.323946 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-28f9f000-4feb-483f-9f4e-0a0e84c9a535 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:17.324582 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-28f9f000-4feb-483f-9f4e-0a0e84c9a535 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:17.452616 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-74840466-3d29-45b4-b2ff-f1708fd50138 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8950e247041d8be4fdfda5e2122fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db2a6834ec144418eb2cf222302fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:17.463291 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-74840466-3d29-45b4-b2ff-f1708fd50138 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] 10.222.0.42 "GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61" status: 200 len: 1253 microversion: 2.1 time: 0.462307 Oct 23 01:31:17.474611 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2310/4695] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:16 2022] GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61 => generated 1253 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:31:17.507223 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a3d20179-223a-4fbd-afff-20dad3a96cdf tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:31:17.508218 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a3d20179-223a-4fbd-afff-20dad3a96cdf tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:17.529248 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a3d20179-223a-4fbd-afff-20dad3a96cdf tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:17.530064 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a3d20179-223a-4fbd-afff-20dad3a96cdf tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:17.534400 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a3d20179-223a-4fbd-afff-20dad3a96cdf tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:17.535288 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a3d20179-223a-4fbd-afff-20dad3a96cdf tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:17.535775 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a3d20179-223a-4fbd-afff-20dad3a96cdf tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:17.537343 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a3d20179-223a-4fbd-afff-20dad3a96cdf tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:17.585795 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-a3d20179-223a-4fbd-afff-20dad3a96cdf tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lazy-loading 'flavor' on Instance uuid b1d0765d-d720-40d2-b168-058e013fab0a {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:31:17.762751 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:31:17.769782 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-28f9f000-4feb-483f-9f4e-0a0e84c9a535 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:17.779382 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-28f9f000-4feb-483f-9f4e-0a0e84c9a535 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/8e4ff17b-af17-4eec-aad8-966fa0ca835b" status: 200 len: 1328 microversion: 2.1 time: 0.489830 Oct 23 01:31:17.794281 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2386/4696] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:17 2022] GET /compute/v2.1/servers/8e4ff17b-af17-4eec-aad8-966fa0ca835b => generated 1328 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:31:18.268673 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a3d20179-223a-4fbd-afff-20dad3a96cdf tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "POST /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a/action" status: 202 len: 0 microversion: 2.20 time: 0.792084 Oct 23 01:31:18.269303 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2311/4697] 10.222.0.42 () {62 vars in 1319 bytes} [Sun Oct 23 01:31:17 2022] POST /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a/action => generated 0 bytes in 794 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:31:18.282534 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e1d26f88-649a-4a44-84bc-754aaea52f73 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:18.284496 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e1d26f88-649a-4a44-84bc-754aaea52f73 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:18.302039 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d35be107-4ccb-4beb-9ca1-f5bfe66874b5 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:18.302762 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d35be107-4ccb-4beb-9ca1-f5bfe66874b5 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:18.306723 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e1d26f88-649a-4a44-84bc-754aaea52f73 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:18.316706 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e1d26f88-649a-4a44-84bc-754aaea52f73 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:18.317633 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e1d26f88-649a-4a44-84bc-754aaea52f73 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:18.319275 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e1d26f88-649a-4a44-84bc-754aaea52f73 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:18.320360 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d35be107-4ccb-4beb-9ca1-f5bfe66874b5 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:18.320900 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d35be107-4ccb-4beb-9ca1-f5bfe66874b5 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:18.321189 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e1d26f88-649a-4a44-84bc-754aaea52f73 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:18.321366 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d35be107-4ccb-4beb-9ca1-f5bfe66874b5 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:18.322019 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d35be107-4ccb-4beb-9ca1-f5bfe66874b5 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:18.322426 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e1d26f88-649a-4a44-84bc-754aaea52f73 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:18.322573 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d35be107-4ccb-4beb-9ca1-f5bfe66874b5 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:18.322906 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d35be107-4ccb-4beb-9ca1-f5bfe66874b5 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:18.653311 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e1d26f88-649a-4a44-84bc-754aaea52f73 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:18.661743 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d35be107-4ccb-4beb-9ca1-f5bfe66874b5 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:18.673684 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d35be107-4ccb-4beb-9ca1-f5bfe66874b5 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1363 microversion: 2.1 time: 0.375634 Oct 23 01:31:18.673911 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e1d26f88-649a-4a44-84bc-754aaea52f73 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:18.675351 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2312/4698] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:18 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1363 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:18.676276 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e1d26f88-649a-4a44-84bc-754aaea52f73 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:18.682868 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e1d26f88-649a-4a44-84bc-754aaea52f73 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1722 microversion: 2.20 time: 0.400432 Oct 23 01:31:18.683761 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2387/4699] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:31:18 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1722 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:31:18.684370 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-40f0d56b-c06e-417d-accf-ab40f7661d89 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:18.688087 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-40f0d56b-c06e-417d-accf-ab40f7661d89 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] [instance: 08bd5c17-1a39-4d28-9a01-e93b999bfb61] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:18.693961 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-40f0d56b-c06e-417d-accf-ab40f7661d89 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:18.694862 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-40f0d56b-c06e-417d-accf-ab40f7661d89 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:18.695524 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-40f0d56b-c06e-417d-accf-ab40f7661d89 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:18.696510 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-40f0d56b-c06e-417d-accf-ab40f7661d89 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:18.697519 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-40f0d56b-c06e-417d-accf-ab40f7661d89 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:18.698180 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-40f0d56b-c06e-417d-accf-ab40f7661d89 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:18.782689 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-40f0d56b-c06e-417d-accf-ab40f7661d89 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8950e247041d8be4fdfda5e2122fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db2a6834ec144418eb2cf222302fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:18.800000 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-40f0d56b-c06e-417d-accf-ab40f7661d89 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] 10.222.0.42 "GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61" status: 200 len: 1253 microversion: 2.1 time: 0.120369 Oct 23 01:31:18.802414 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2313/4700] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:18 2022] GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61 => generated 1253 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:18.817909 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4b1837e8-3c51-42f4-9c29-7d83214bd213 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:18.818576 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4b1837e8-3c51-42f4-9c29-7d83214bd213 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 8e4ff17b-af17-4eec-aad8-966fa0ca835b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:18.829492 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4b1837e8-3c51-42f4-9c29-7d83214bd213 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:18.830368 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4b1837e8-3c51-42f4-9c29-7d83214bd213 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:18.833414 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4b1837e8-3c51-42f4-9c29-7d83214bd213 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:18.834560 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4b1837e8-3c51-42f4-9c29-7d83214bd213 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:18.835325 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4b1837e8-3c51-42f4-9c29-7d83214bd213 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:18.835987 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4b1837e8-3c51-42f4-9c29-7d83214bd213 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:19.289123 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4b1837e8-3c51-42f4-9c29-7d83214bd213 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:19.308851 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4b1837e8-3c51-42f4-9c29-7d83214bd213 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/8e4ff17b-af17-4eec-aad8-966fa0ca835b" status: 200 len: 1328 microversion: 2.1 time: 0.500896 Oct 23 01:31:19.310762 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2388/4701] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:18 2022] GET /compute/v2.1/servers/8e4ff17b-af17-4eec-aad8-966fa0ca835b => generated 1328 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:19.700675 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-02910a6f-d9f7-4ed4-8ac9-56d4721ce655 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:19.701289 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-02910a6f-d9f7-4ed4-8ac9-56d4721ce655 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:19.715910 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ebd58ee2-fda1-414a-8c78-8473aaf294be tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:19.716927 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ebd58ee2-fda1-414a-8c78-8473aaf294be tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:19.723637 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ebd58ee2-fda1-414a-8c78-8473aaf294be tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:19.726469 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-02910a6f-d9f7-4ed4-8ac9-56d4721ce655 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:19.734748 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ebd58ee2-fda1-414a-8c78-8473aaf294be tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:19.735583 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-02910a6f-d9f7-4ed4-8ac9-56d4721ce655 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:19.736195 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ebd58ee2-fda1-414a-8c78-8473aaf294be tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:19.736791 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-02910a6f-d9f7-4ed4-8ac9-56d4721ce655 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:19.739866 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ebd58ee2-fda1-414a-8c78-8473aaf294be tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:19.739866 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ebd58ee2-fda1-414a-8c78-8473aaf294be tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:19.739866 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ebd58ee2-fda1-414a-8c78-8473aaf294be tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:19.740975 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-02910a6f-d9f7-4ed4-8ac9-56d4721ce655 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:19.741603 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-02910a6f-d9f7-4ed4-8ac9-56d4721ce655 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:19.742208 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-02910a6f-d9f7-4ed4-8ac9-56d4721ce655 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:20.374533 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:31:20.810330 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-02910a6f-d9f7-4ed4-8ac9-56d4721ce655 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:20.819457 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-02910a6f-d9f7-4ed4-8ac9-56d4721ce655 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1363 microversion: 2.1 time: 1.122523 Oct 23 01:31:20.820620 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2314/4702] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:19 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1363 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:20.825316 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-2c6700b8-3d83-4dcb-8345-4629a2046bf9 req-a31a767c-0251-4b75-bd95-5e3fb7d549ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa616812-f379-45fb-8e7e-fefe7570dc98", "tag": "6de1369a-94d0-42a0-a57f-9deacb90b66f"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:31:20.852549 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-2c6700b8-3d83-4dcb-8345-4629a2046bf9 req-a31a767c-0251-4b75-bd95-5e3fb7d549ef service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:20.853302 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-2c6700b8-3d83-4dcb-8345-4629a2046bf9 req-a31a767c-0251-4b75-bd95-5e3fb7d549ef service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:20.859182 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-2c6700b8-3d83-4dcb-8345-4629a2046bf9 req-a31a767c-0251-4b75-bd95-5e3fb7d549ef service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:20.862166 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ebd58ee2-fda1-414a-8c78-8473aaf294be tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:20.877927 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-2c6700b8-3d83-4dcb-8345-4629a2046bf9 req-a31a767c-0251-4b75-bd95-5e3fb7d549ef service nova] Creating event network-changed:6de1369a-94d0-42a0-a57f-9deacb90b66f for instance fa616812-f379-45fb-8e7e-fefe7570dc98 on n-h1-master-1 Oct 23 01:31:20.880615 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ebd58ee2-fda1-414a-8c78-8473aaf294be tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:20.885306 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-2c6700b8-3d83-4dcb-8345-4629a2046bf9 req-a31a767c-0251-4b75-bd95-5e3fb7d549ef service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063334 Oct 23 01:31:20.886254 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2315/4703] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:31:20.888368 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ebd58ee2-fda1-414a-8c78-8473aaf294be tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:20.892437 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ea0e9495-25ac-4575-8f63-6f7b35b00040 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:20.892875 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ebd58ee2-fda1-414a-8c78-8473aaf294be tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1722 microversion: 2.20 time: 1.180635 Oct 23 01:31:20.894033 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ea0e9495-25ac-4575-8f63-6f7b35b00040 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] [instance: 08bd5c17-1a39-4d28-9a01-e93b999bfb61] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:20.894194 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2389/4704] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:31:19 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1722 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:31:20.915172 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0804aad8-1653-4ec1-af20-d1b13c4f0645 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:20.919350 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ea0e9495-25ac-4575-8f63-6f7b35b00040 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:20.920484 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0804aad8-1653-4ec1-af20-d1b13c4f0645 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 8e4ff17b-af17-4eec-aad8-966fa0ca835b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:20.920669 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ea0e9495-25ac-4575-8f63-6f7b35b00040 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:20.921727 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ea0e9495-25ac-4575-8f63-6f7b35b00040 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:20.922541 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ea0e9495-25ac-4575-8f63-6f7b35b00040 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:20.923082 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ea0e9495-25ac-4575-8f63-6f7b35b00040 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:20.923579 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ea0e9495-25ac-4575-8f63-6f7b35b00040 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:20.939203 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0804aad8-1653-4ec1-af20-d1b13c4f0645 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:20.940805 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0804aad8-1653-4ec1-af20-d1b13c4f0645 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:20.941453 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0804aad8-1653-4ec1-af20-d1b13c4f0645 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:20.943650 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0804aad8-1653-4ec1-af20-d1b13c4f0645 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:20.945592 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0804aad8-1653-4ec1-af20-d1b13c4f0645 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:20.952036 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0804aad8-1653-4ec1-af20-d1b13c4f0645 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:20.952187 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-ea0e9495-25ac-4575-8f63-6f7b35b00040 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] HTTP exception thrown: Instance 08bd5c17-1a39-4d28-9a01-e93b999bfb61 could not be found. Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ea0e9495-25ac-4575-8f63-6f7b35b00040 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Request method failure captured: Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61 HTTP/1.1 Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJiVxGVoZyJMlX4SRwk-mjy28anC6bhh-xy6rC8XMyDCJY6UZBG9pC-yqGdKf-NGl4zmYaC3_mNgV56RmRKoWRLFTcVtkjvvimp9dcJpjd3M2HmpAddS-lqYqq9ZU6GSnFqMZt5m6bmaF4F0NDBSiuADG1yF7XzCyeHkc3rX0Qul5Zs Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 2db2a6834ec144418eb2cf222302fdb2 Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServersTestBootFromVolume-1059960541 Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2db2a6834ec144418eb2cf222302fdb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2db2a6834ec144418eb2cf222302fdb2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2db2a6834ec144418eb2cf222302fdb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2db2a6834ec144418eb2cf222302fdb2"}]}] Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServersTestBootFromVolume-1059960541 Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 2db2a6834ec144418eb2cf222302fdb2 Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1059960541 Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServersTestBootFromVolume-1059960541-project Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: a0a8950e247041d8be4fdfda5e2122fa Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServersTestBootFromVolume-1059960541-project Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 08bd5c17-1a39-4d28-9a01-e93b999bfb61 could not be found. Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '08bd5c17-1a39-4d28-9a01-e93b999bfb61'} Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08bd5c17-1a39-4d28-9a01-e93b999bfb61 could not be found. Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08bd5c17-1a39-4d28-9a01-e93b999bfb61 could not be found. Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:31:20.957718 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:31:20.962691 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:31:20.962691 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:31:20.962691 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:31:20.962691 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:31:20.962691 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:31:20.962691 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08bd5c17-1a39-4d28-9a01-e93b999bfb61 could not be found. Oct 23 01:31:20.962691 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:31:20.962691 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ea0e9495-25ac-4575-8f63-6f7b35b00040 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Returning 404 to user: Instance 08bd5c17-1a39-4d28-9a01-e93b999bfb61 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:31:20.964841 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ea0e9495-25ac-4575-8f63-6f7b35b00040 tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] 10.222.0.42 "GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61" status: 404 len: 111 microversion: 2.1 time: 0.075553 Oct 23 01:31:20.965548 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2316/4705] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:20 2022] GET /compute/v2.1/servers/08bd5c17-1a39-4d28-9a01-e93b999bfb61 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:31:20.975491 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7ca126a3-44b3-4460-9f5c-0476060137ab tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] Calling method '.version_select at 0x7f5cc62e50d0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:21.084774 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7ca126a3-44b3-4460-9f5c-0476060137ab tempest-ServersTestBootFromVolume-1059960541 tempest-ServersTestBootFromVolume-1059960541-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1904337469" status: 202 len: 0 microversion: 2.1 time: 0.113020 Oct 23 01:31:21.085497 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2317/4706] 10.222.0.42 () {58 vars in 1221 bytes} [Sun Oct 23 01:31:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1904337469 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:31:21.236716 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0804aad8-1653-4ec1-af20-d1b13c4f0645 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:21.247674 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0804aad8-1653-4ec1-af20-d1b13c4f0645 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/8e4ff17b-af17-4eec-aad8-966fa0ca835b" status: 200 len: 1328 microversion: 2.1 time: 0.348402 Oct 23 01:31:21.253205 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2390/4707] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:20 2022] GET /compute/v2.1/servers/8e4ff17b-af17-4eec-aad8-966fa0ca835b => generated 1328 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:21.850238 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6122f258-6ffd-4dcf-b4d7-ac4cf0540bb1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:21.851489 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6122f258-6ffd-4dcf-b4d7-ac4cf0540bb1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:21.896032 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6122f258-6ffd-4dcf-b4d7-ac4cf0540bb1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:21.898567 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6122f258-6ffd-4dcf-b4d7-ac4cf0540bb1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:21.899218 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6122f258-6ffd-4dcf-b4d7-ac4cf0540bb1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:21.902539 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6122f258-6ffd-4dcf-b4d7-ac4cf0540bb1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:21.905728 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6122f258-6ffd-4dcf-b4d7-ac4cf0540bb1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:21.908709 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6122f258-6ffd-4dcf-b4d7-ac4cf0540bb1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:21.923997 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-55e9967c-8463-488e-9709-a49eabafa3ba tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:21.924692 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-55e9967c-8463-488e-9709-a49eabafa3ba tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:21.962519 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55e9967c-8463-488e-9709-a49eabafa3ba tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:21.963306 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55e9967c-8463-488e-9709-a49eabafa3ba tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:21.963783 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55e9967c-8463-488e-9709-a49eabafa3ba tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:21.964512 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55e9967c-8463-488e-9709-a49eabafa3ba tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:21.964971 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55e9967c-8463-488e-9709-a49eabafa3ba tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:21.965400 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55e9967c-8463-488e-9709-a49eabafa3ba tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:22.444409 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6122f258-6ffd-4dcf-b4d7-ac4cf0540bb1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:22.456405 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6122f258-6ffd-4dcf-b4d7-ac4cf0540bb1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1363 microversion: 2.1 time: 0.611452 Oct 23 01:31:22.460765 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2318/4708] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:21 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1363 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:22.474593 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-55e9967c-8463-488e-9709-a49eabafa3ba tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:22.487149 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cfb4b4d5-cf93-4b71-94bc-c7826364c960 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:22.490180 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cfb4b4d5-cf93-4b71-94bc-c7826364c960 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 8e4ff17b-af17-4eec-aad8-966fa0ca835b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:22.492152 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-55e9967c-8463-488e-9709-a49eabafa3ba tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:22.500218 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-55e9967c-8463-488e-9709-a49eabafa3ba tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:22.504073 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-55e9967c-8463-488e-9709-a49eabafa3ba tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1722 microversion: 2.20 time: 0.585104 Oct 23 01:31:22.510248 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2391/4709] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:31:21 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1722 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:31:22.512279 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cfb4b4d5-cf93-4b71-94bc-c7826364c960 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:22.529402 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cfb4b4d5-cf93-4b71-94bc-c7826364c960 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:22.531041 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cfb4b4d5-cf93-4b71-94bc-c7826364c960 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:22.532174 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cfb4b4d5-cf93-4b71-94bc-c7826364c960 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:22.532760 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cfb4b4d5-cf93-4b71-94bc-c7826364c960 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:22.533262 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cfb4b4d5-cf93-4b71-94bc-c7826364c960 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:22.847645 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cfb4b4d5-cf93-4b71-94bc-c7826364c960 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:22.873319 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cfb4b4d5-cf93-4b71-94bc-c7826364c960 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/8e4ff17b-af17-4eec-aad8-966fa0ca835b" status: 200 len: 1328 microversion: 2.1 time: 0.411649 Oct 23 01:31:22.882863 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2319/4710] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:22 2022] GET /compute/v2.1/servers/8e4ff17b-af17-4eec-aad8-966fa0ca835b => generated 1328 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:22.929159 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-8fd60166-f63b-4596-a054-99c39f6f6642 req-e59cdfe2-1f5f-4425-aea9-048afe4bfcc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e4ff17b-af17-4eec-aad8-966fa0ca835b", "name": "network-vif-plugged", "status": "completed", "tag": "e1ac53d0-c34f-4229-a235-c79c8887b406"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:31:22.954998 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-8fd60166-f63b-4596-a054-99c39f6f6642 req-e59cdfe2-1f5f-4425-aea9-048afe4bfcc9 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:22.957062 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-8fd60166-f63b-4596-a054-99c39f6f6642 req-e59cdfe2-1f5f-4425-aea9-048afe4bfcc9 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:22.959661 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-8fd60166-f63b-4596-a054-99c39f6f6642 req-e59cdfe2-1f5f-4425-aea9-048afe4bfcc9 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:22.987041 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-8fd60166-f63b-4596-a054-99c39f6f6642 req-e59cdfe2-1f5f-4425-aea9-048afe4bfcc9 service nova] Creating event network-vif-plugged:e1ac53d0-c34f-4229-a235-c79c8887b406 for instance 8e4ff17b-af17-4eec-aad8-966fa0ca835b on n-h2-master-1 Oct 23 01:31:22.993421 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-8fd60166-f63b-4596-a054-99c39f6f6642 req-e59cdfe2-1f5f-4425-aea9-048afe4bfcc9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.335734 Oct 23 01:31:22.995612 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2392/4711] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:31:23.487326 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0a0e1416-e862-43d8-9635-6e3a6bc33bbf tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:23.487785 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0a0e1416-e862-43d8-9635-6e3a6bc33bbf tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:23.510351 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0a0e1416-e862-43d8-9635-6e3a6bc33bbf tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:23.510351 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0a0e1416-e862-43d8-9635-6e3a6bc33bbf tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:23.510590 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0a0e1416-e862-43d8-9635-6e3a6bc33bbf tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:23.511896 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0a0e1416-e862-43d8-9635-6e3a6bc33bbf tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:23.512523 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0a0e1416-e862-43d8-9635-6e3a6bc33bbf tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:23.513176 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0a0e1416-e862-43d8-9635-6e3a6bc33bbf tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:23.529571 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=18 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:31:23.534157 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-538a2a90-09ba-4a75-865b-f18e4dda0bb2 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:23.538801 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-538a2a90-09ba-4a75-865b-f18e4dda0bb2 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:23.542664 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-538a2a90-09ba-4a75-865b-f18e4dda0bb2 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:23.550264 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-538a2a90-09ba-4a75-865b-f18e4dda0bb2 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:23.559864 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-538a2a90-09ba-4a75-865b-f18e4dda0bb2 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:23.560919 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-538a2a90-09ba-4a75-865b-f18e4dda0bb2 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:23.562345 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-538a2a90-09ba-4a75-865b-f18e4dda0bb2 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:23.562949 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-538a2a90-09ba-4a75-865b-f18e4dda0bb2 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:23.995771 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0a0e1416-e862-43d8-9635-6e3a6bc33bbf tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:24.008097 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0a0e1416-e862-43d8-9635-6e3a6bc33bbf tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1363 microversion: 2.1 time: 0.524596 Oct 23 01:31:24.010297 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2320/4712] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:23 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1363 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:24.032894 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9f230543-aa63-49ae-ac2e-19372ad1f07d tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:24.038017 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9f230543-aa63-49ae-ac2e-19372ad1f07d tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 8e4ff17b-af17-4eec-aad8-966fa0ca835b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:24.041145 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f230543-aa63-49ae-ac2e-19372ad1f07d tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:24.041805 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f230543-aa63-49ae-ac2e-19372ad1f07d tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:24.042436 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f230543-aa63-49ae-ac2e-19372ad1f07d tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:24.043428 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f230543-aa63-49ae-ac2e-19372ad1f07d tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:24.044087 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f230543-aa63-49ae-ac2e-19372ad1f07d tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:24.044727 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f230543-aa63-49ae-ac2e-19372ad1f07d tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:24.154689 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-538a2a90-09ba-4a75-865b-f18e4dda0bb2 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:24.167147 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-538a2a90-09ba-4a75-865b-f18e4dda0bb2 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:24.168987 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-538a2a90-09ba-4a75-865b-f18e4dda0bb2 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:24.170334 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-538a2a90-09ba-4a75-865b-f18e4dda0bb2 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1722 microversion: 2.20 time: 0.641662 Oct 23 01:31:24.171843 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2393/4713] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:31:23 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1722 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:31:24.695535 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9f230543-aa63-49ae-ac2e-19372ad1f07d tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:24.705666 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9f230543-aa63-49ae-ac2e-19372ad1f07d tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/8e4ff17b-af17-4eec-aad8-966fa0ca835b" status: 200 len: 1328 microversion: 2.1 time: 0.677013 Oct 23 01:31:24.709167 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2321/4714] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:24 2022] GET /compute/v2.1/servers/8e4ff17b-af17-4eec-aad8-966fa0ca835b => generated 1328 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:25.036148 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-98f3a006-98dc-45f3-9be8-5c8f7e1235b9 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:25.036809 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-98f3a006-98dc-45f3-9be8-5c8f7e1235b9 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:25.045599 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-98f3a006-98dc-45f3-9be8-5c8f7e1235b9 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:25.046871 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-98f3a006-98dc-45f3-9be8-5c8f7e1235b9 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:25.047519 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-98f3a006-98dc-45f3-9be8-5c8f7e1235b9 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:25.048443 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-98f3a006-98dc-45f3-9be8-5c8f7e1235b9 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:25.049075 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-98f3a006-98dc-45f3-9be8-5c8f7e1235b9 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:25.050049 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-98f3a006-98dc-45f3-9be8-5c8f7e1235b9 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:25.197421 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-239f3fb6-04de-4e15-8bd8-39a541a1939e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:25.198301 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-239f3fb6-04de-4e15-8bd8-39a541a1939e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:25.213326 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-239f3fb6-04de-4e15-8bd8-39a541a1939e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:25.215823 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-239f3fb6-04de-4e15-8bd8-39a541a1939e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:25.218448 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-239f3fb6-04de-4e15-8bd8-39a541a1939e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:25.219358 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-239f3fb6-04de-4e15-8bd8-39a541a1939e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:25.219961 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-239f3fb6-04de-4e15-8bd8-39a541a1939e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:25.220501 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-239f3fb6-04de-4e15-8bd8-39a541a1939e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:25.811101 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-239f3fb6-04de-4e15-8bd8-39a541a1939e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:25.873257 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-239f3fb6-04de-4e15-8bd8-39a541a1939e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:25.879376 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-239f3fb6-04de-4e15-8bd8-39a541a1939e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:25.887189 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-239f3fb6-04de-4e15-8bd8-39a541a1939e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1722 microversion: 2.20 time: 0.694006 Oct 23 01:31:25.905828 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2322/4715] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:31:25 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1722 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:31:25.913334 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a61ef232-4cf6-44a4-a065-cb4be6e05779 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:25.916527 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a61ef232-4cf6-44a4-a065-cb4be6e05779 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 8e4ff17b-af17-4eec-aad8-966fa0ca835b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:25.924965 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a61ef232-4cf6-44a4-a065-cb4be6e05779 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:25.926154 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a61ef232-4cf6-44a4-a065-cb4be6e05779 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:25.926154 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a61ef232-4cf6-44a4-a065-cb4be6e05779 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:25.927915 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a61ef232-4cf6-44a4-a065-cb4be6e05779 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:25.928534 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a61ef232-4cf6-44a4-a065-cb4be6e05779 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:25.929062 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a61ef232-4cf6-44a4-a065-cb4be6e05779 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:25.951657 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-98f3a006-98dc-45f3-9be8-5c8f7e1235b9 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:25.961752 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-98f3a006-98dc-45f3-9be8-5c8f7e1235b9 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1363 microversion: 2.1 time: 0.929757 Oct 23 01:31:25.974406 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2394/4716] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:25 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1363 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:26.188821 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a61ef232-4cf6-44a4-a065-cb4be6e05779 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:26.193211 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a61ef232-4cf6-44a4-a065-cb4be6e05779 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/8e4ff17b-af17-4eec-aad8-966fa0ca835b" status: 200 len: 1508 microversion: 2.1 time: 0.290964 Oct 23 01:31:26.200900 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2323/4717] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:25 2022] GET /compute/v2.1/servers/8e4ff17b-af17-4eec-aad8-966fa0ca835b => generated 1508 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:26.219403 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f6edd27f-131d-4a86-8c37-c93e529fb7eb tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:26.220167 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f6edd27f-131d-4a86-8c37-c93e529fb7eb tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 8e4ff17b-af17-4eec-aad8-966fa0ca835b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:26.231491 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f6edd27f-131d-4a86-8c37-c93e529fb7eb tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:26.234592 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f6edd27f-131d-4a86-8c37-c93e529fb7eb tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:26.235252 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f6edd27f-131d-4a86-8c37-c93e529fb7eb tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:26.236356 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f6edd27f-131d-4a86-8c37-c93e529fb7eb tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:26.236998 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f6edd27f-131d-4a86-8c37-c93e529fb7eb tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:26.238719 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f6edd27f-131d-4a86-8c37-c93e529fb7eb tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:26.614323 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f6edd27f-131d-4a86-8c37-c93e529fb7eb tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:26.631251 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f6edd27f-131d-4a86-8c37-c93e529fb7eb tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/8e4ff17b-af17-4eec-aad8-966fa0ca835b" status: 200 len: 1508 microversion: 2.1 time: 0.413815 Oct 23 01:31:26.632606 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2395/4718] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:26 2022] GET /compute/v2.1/servers/8e4ff17b-af17-4eec-aad8-966fa0ca835b => generated 1508 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:26.653736 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-aa584fe7-d8f1-4215-86c5-8153a3aaaa93 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:26.654598 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-aa584fe7-d8f1-4215-86c5-8153a3aaaa93 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 8e4ff17b-af17-4eec-aad8-966fa0ca835b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:26.661839 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa584fe7-d8f1-4215-86c5-8153a3aaaa93 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:26.663903 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa584fe7-d8f1-4215-86c5-8153a3aaaa93 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:26.664658 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa584fe7-d8f1-4215-86c5-8153a3aaaa93 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:26.676504 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa584fe7-d8f1-4215-86c5-8153a3aaaa93 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:26.677464 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa584fe7-d8f1-4215-86c5-8153a3aaaa93 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:26.678134 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa584fe7-d8f1-4215-86c5-8153a3aaaa93 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:26.709769 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-aa584fe7-d8f1-4215-86c5-8153a3aaaa93 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 8e4ff17b-af17-4eec-aad8-966fa0ca835b] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:31:26.922260 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-67ec9dca-958a-46c5-9594-61eb1e45b5c4 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:26.922260 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-67ec9dca-958a-46c5-9594-61eb1e45b5c4 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:26.935597 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-67ec9dca-958a-46c5-9594-61eb1e45b5c4 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:26.936319 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-67ec9dca-958a-46c5-9594-61eb1e45b5c4 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:26.936824 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-67ec9dca-958a-46c5-9594-61eb1e45b5c4 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:26.937689 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-67ec9dca-958a-46c5-9594-61eb1e45b5c4 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:26.938249 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-67ec9dca-958a-46c5-9594-61eb1e45b5c4 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:26.938747 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-67ec9dca-958a-46c5-9594-61eb1e45b5c4 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:27.152693 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-aa584fe7-d8f1-4215-86c5-8153a3aaaa93 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8e4ff17b-af17-4eec-aad8-966fa0ca835b" status: 204 len: 0 microversion: 2.1 time: 0.502385 Oct 23 01:31:27.160593 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2324/4719] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:31:26 2022] DELETE /compute/v2.1/servers/8e4ff17b-af17-4eec-aad8-966fa0ca835b => generated 0 bytes in 504 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:31:27.164714 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c70afc93-fd3b-44c7-9aea-df301e329560 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:27.165430 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c70afc93-fd3b-44c7-9aea-df301e329560 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:27.182768 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c70afc93-fd3b-44c7-9aea-df301e329560 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:27.183270 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c70afc93-fd3b-44c7-9aea-df301e329560 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:27.183713 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c70afc93-fd3b-44c7-9aea-df301e329560 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:27.184437 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c70afc93-fd3b-44c7-9aea-df301e329560 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:27.184898 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c70afc93-fd3b-44c7-9aea-df301e329560 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:27.185320 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c70afc93-fd3b-44c7-9aea-df301e329560 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:27.555270 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-67ec9dca-958a-46c5-9594-61eb1e45b5c4 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:27.566781 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-67ec9dca-958a-46c5-9594-61eb1e45b5c4 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:27.568530 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-67ec9dca-958a-46c5-9594-61eb1e45b5c4 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:27.569924 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-67ec9dca-958a-46c5-9594-61eb1e45b5c4 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1722 microversion: 2.20 time: 0.656011 Oct 23 01:31:27.570828 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2396/4720] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:31:26 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1722 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:31:27.576240 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a92fc039-7731-4ccf-8a71-8e1937949761 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:27.577093 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a92fc039-7731-4ccf-8a71-8e1937949761 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 8e4ff17b-af17-4eec-aad8-966fa0ca835b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:27.583773 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a92fc039-7731-4ccf-8a71-8e1937949761 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:27.584728 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a92fc039-7731-4ccf-8a71-8e1937949761 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:27.585333 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a92fc039-7731-4ccf-8a71-8e1937949761 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:27.586252 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a92fc039-7731-4ccf-8a71-8e1937949761 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:27.586884 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a92fc039-7731-4ccf-8a71-8e1937949761 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:27.587469 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a92fc039-7731-4ccf-8a71-8e1937949761 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:27.736654 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c70afc93-fd3b-44c7-9aea-df301e329560 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:27.770372 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c70afc93-fd3b-44c7-9aea-df301e329560 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1363 microversion: 2.1 time: 0.609815 Oct 23 01:31:27.772123 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2325/4721] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:27 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1363 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:27.797816 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cb9ba85d-a936-466f-afc4-45fdba40ebb0 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:27.798885 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cb9ba85d-a936-466f-afc4-45fdba40ebb0 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: e96f5e79-d832-4927-aef1-a45a815404b0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:27.818190 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb9ba85d-a936-466f-afc4-45fdba40ebb0 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:27.818962 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb9ba85d-a936-466f-afc4-45fdba40ebb0 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:27.819599 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb9ba85d-a936-466f-afc4-45fdba40ebb0 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:27.820480 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb9ba85d-a936-466f-afc4-45fdba40ebb0 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:27.821206 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb9ba85d-a936-466f-afc4-45fdba40ebb0 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:27.822881 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb9ba85d-a936-466f-afc4-45fdba40ebb0 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:27.857645 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cb9ba85d-a936-466f-afc4-45fdba40ebb0 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0/ips" status: 200 len: 150 microversion: 2.1 time: 0.082808 Oct 23 01:31:27.859623 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2326/4722] 10.222.0.42 () {58 vars in 1248 bytes} [Sun Oct 23 01:31:27 2022] GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0/ips => generated 150 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:31:27.997172 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3d16f696-cf5c-42a1-8dcc-7d15c75115cc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-178663905", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "ba696604-5fcc-4b2d-9bf0-ca27f90a0725"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:31:28.144777 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-3d16f696-cf5c-42a1-8dcc-7d15c75115cc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] validate_networks() for [('ba696604-5fcc-4b2d-9bf0-ca27f90a0725', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:31:28.540510 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a92fc039-7731-4ccf-8a71-8e1937949761 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:28.706773 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a92fc039-7731-4ccf-8a71-8e1937949761 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/8e4ff17b-af17-4eec-aad8-966fa0ca835b" status: 200 len: 1514 microversion: 2.1 time: 1.134508 Oct 23 01:31:28.715839 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2397/4723] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:27 2022] GET /compute/v2.1/servers/8e4ff17b-af17-4eec-aad8-966fa0ca835b => generated 1514 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:28.727183 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-31bfd172-5e8c-41b8-bb83-e984e3e7767c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:28.730445 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-31bfd172-5e8c-41b8-bb83-e984e3e7767c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:28.746306 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-31bfd172-5e8c-41b8-bb83-e984e3e7767c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:28.747069 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-31bfd172-5e8c-41b8-bb83-e984e3e7767c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:28.747756 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-31bfd172-5e8c-41b8-bb83-e984e3e7767c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:28.749191 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-31bfd172-5e8c-41b8-bb83-e984e3e7767c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:28.749825 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-31bfd172-5e8c-41b8-bb83-e984e3e7767c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:28.750597 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-31bfd172-5e8c-41b8-bb83-e984e3e7767c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:29.442037 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-31bfd172-5e8c-41b8-bb83-e984e3e7767c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:29.455799 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-31bfd172-5e8c-41b8-bb83-e984e3e7767c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:29.457257 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-31bfd172-5e8c-41b8-bb83-e984e3e7767c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:29.475527 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-31bfd172-5e8c-41b8-bb83-e984e3e7767c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1722 microversion: 2.20 time: 0.758397 Oct 23 01:31:29.499937 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2398/4724] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:31:28 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1722 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:31:29.510543 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-49c39020-8342-45f0-a816-c26994c50c1f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:29.511445 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-49c39020-8342-45f0-a816-c26994c50c1f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:29.518421 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-49c39020-8342-45f0-a816-c26994c50c1f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:29.519117 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-49c39020-8342-45f0-a816-c26994c50c1f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:29.521059 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-49c39020-8342-45f0-a816-c26994c50c1f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:29.521059 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-49c39020-8342-45f0-a816-c26994c50c1f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:29.521059 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-49c39020-8342-45f0-a816-c26994c50c1f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:29.521621 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-49c39020-8342-45f0-a816-c26994c50c1f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:30.582249 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-3d16f696-cf5c-42a1-8dcc-7d15c75115cc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:31:30.582722 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-3d16f696-cf5c-42a1-8dcc-7d15c75115cc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:31:30.583138 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-3d16f696-cf5c-42a1-8dcc-7d15c75115cc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:31:30.583701 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-3d16f696-cf5c-42a1-8dcc-7d15c75115cc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:31:30.584124 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-3d16f696-cf5c-42a1-8dcc-7d15c75115cc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:31:30.593963 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3d16f696-cf5c-42a1-8dcc-7d15c75115cc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:30.594739 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3d16f696-cf5c-42a1-8dcc-7d15c75115cc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:30.595183 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3d16f696-cf5c-42a1-8dcc-7d15c75115cc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:30.595916 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3d16f696-cf5c-42a1-8dcc-7d15c75115cc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:30.596381 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3d16f696-cf5c-42a1-8dcc-7d15c75115cc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:30.597008 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3d16f696-cf5c-42a1-8dcc-7d15c75115cc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:30.615323 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-49c39020-8342-45f0-a816-c26994c50c1f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:30.628012 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-49c39020-8342-45f0-a816-c26994c50c1f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1363 microversion: 2.1 time: 1.126631 Oct 23 01:31:30.631328 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2399/4725] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:29 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1363 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:30.636528 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-3d16f696-cf5c-42a1-8dcc-7d15c75115cc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Getting quotas for project 842dcab8b48c43d7963a538d914b0b22. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:31:30.637249 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-44d0c8db-cfa5-4a93-8b81-fd679836e489 req-f692c5aa-8fb9-4a6e-a84d-c0a66434dff2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa616812-f379-45fb-8e7e-fefe7570dc98", "name": "network-vif-plugged", "status": "completed", "tag": "6de1369a-94d0-42a0-a57f-9deacb90b66f"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:31:30.642129 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-3d16f696-cf5c-42a1-8dcc-7d15c75115cc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Getting quotas for user 634bed7898c24baca6ba00392d49eea1 and project 842dcab8b48c43d7963a538d914b0b22. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:31:30.650128 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-44d0c8db-cfa5-4a93-8b81-fd679836e489 req-f692c5aa-8fb9-4a6e-a84d-c0a66434dff2 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:30.651021 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-44d0c8db-cfa5-4a93-8b81-fd679836e489 req-f692c5aa-8fb9-4a6e-a84d-c0a66434dff2 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:30.652029 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-44d0c8db-cfa5-4a93-8b81-fd679836e489 req-f692c5aa-8fb9-4a6e-a84d-c0a66434dff2 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:30.663503 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3d16f696-cf5c-42a1-8dcc-7d15c75115cc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:31:30.665848 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3d16f696-cf5c-42a1-8dcc-7d15c75115cc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 79444b51-581d-4748-8265-6433d1957885] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:31:30.667558 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-44d0c8db-cfa5-4a93-8b81-fd679836e489 req-f692c5aa-8fb9-4a6e-a84d-c0a66434dff2 service nova] Creating event network-vif-plugged:6de1369a-94d0-42a0-a57f-9deacb90b66f for instance fa616812-f379-45fb-8e7e-fefe7570dc98 on n-h1-master-1 Oct 23 01:31:30.673743 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-44d0c8db-cfa5-4a93-8b81-fd679836e489 req-f692c5aa-8fb9-4a6e-a84d-c0a66434dff2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042406 Oct 23 01:31:30.675815 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2400/4726] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:31:30.686590 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3c85e3a5-b70f-45b6-b9b7-06ffa32c0601 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:30.691134 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3c85e3a5-b70f-45b6-b9b7-06ffa32c0601 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 8e4ff17b-af17-4eec-aad8-966fa0ca835b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:30.700835 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3c85e3a5-b70f-45b6-b9b7-06ffa32c0601 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:30.701496 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3c85e3a5-b70f-45b6-b9b7-06ffa32c0601 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:30.702015 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3c85e3a5-b70f-45b6-b9b7-06ffa32c0601 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:30.702964 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3c85e3a5-b70f-45b6-b9b7-06ffa32c0601 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:30.704037 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3c85e3a5-b70f-45b6-b9b7-06ffa32c0601 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:30.704669 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3c85e3a5-b70f-45b6-b9b7-06ffa32c0601 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:30.806500 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3c85e3a5-b70f-45b6-b9b7-06ffa32c0601 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:30.809665 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3c85e3a5-b70f-45b6-b9b7-06ffa32c0601 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:30.810575 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3c85e3a5-b70f-45b6-b9b7-06ffa32c0601 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:30.811784 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-3c85e3a5-b70f-45b6-b9b7-06ffa32c0601 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lazy-loading 'fault' on Instance uuid 8e4ff17b-af17-4eec-aad8-966fa0ca835b {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:31:30.891201 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3d16f696-cf5c-42a1-8dcc-7d15c75115cc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.029982 Oct 23 01:31:30.904148 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2327/4727] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:31:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 3043 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:31:30.921637 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3c85e3a5-b70f-45b6-b9b7-06ffa32c0601 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:30.933331 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-1a7247ad-ac8c-4ad3-9a86-f6316de4f85f req-c8d7c125-a644-4169-abc6-c1ee2bc26b04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e4ff17b-af17-4eec-aad8-966fa0ca835b", "name": "network-vif-deleted", "tag": "e1ac53d0-c34f-4229-a235-c79c8887b406"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:31:30.943554 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=100 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:31:30.952865 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-1a7247ad-ac8c-4ad3-9a86-f6316de4f85f req-c8d7c125-a644-4169-abc6-c1ee2bc26b04 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:30.953652 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-1a7247ad-ac8c-4ad3-9a86-f6316de4f85f req-c8d7c125-a644-4169-abc6-c1ee2bc26b04 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:30.954263 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-1a7247ad-ac8c-4ad3-9a86-f6316de4f85f req-c8d7c125-a644-4169-abc6-c1ee2bc26b04 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:30.959231 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3c85e3a5-b70f-45b6-b9b7-06ffa32c0601 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/8e4ff17b-af17-4eec-aad8-966fa0ca835b" status: 200 len: 1318 microversion: 2.1 time: 0.281687 Oct 23 01:31:30.970784 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2401/4728] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:30 2022] GET /compute/v2.1/servers/8e4ff17b-af17-4eec-aad8-966fa0ca835b => generated 1318 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:30.971273 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-1a7247ad-ac8c-4ad3-9a86-f6316de4f85f req-c8d7c125-a644-4169-abc6-c1ee2bc26b04 service nova] Creating event network-vif-deleted:e1ac53d0-c34f-4229-a235-c79c8887b406 for instance 8e4ff17b-af17-4eec-aad8-966fa0ca835b on n-h2-master-1 Oct 23 01:31:30.975777 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8a0dcb3d-2c16-408d-a86d-9a068b058830 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:30.980097 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-1a7247ad-ac8c-4ad3-9a86-f6316de4f85f req-c8d7c125-a644-4169-abc6-c1ee2bc26b04 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071409 Oct 23 01:31:30.987810 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2328/4729] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:31:30.994621 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8a0dcb3d-2c16-408d-a86d-9a068b058830 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:31.004910 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-50a9e61b-8395-429f-9c94-da0e5061864b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:31.008321 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-50a9e61b-8395-429f-9c94-da0e5061864b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 79444b51-581d-4748-8265-6433d1957885] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:31.016011 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8a0dcb3d-2c16-408d-a86d-9a068b058830 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:31.017421 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8a0dcb3d-2c16-408d-a86d-9a068b058830 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:31.019949 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8a0dcb3d-2c16-408d-a86d-9a068b058830 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:31.022053 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8a0dcb3d-2c16-408d-a86d-9a068b058830 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:31.024175 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8a0dcb3d-2c16-408d-a86d-9a068b058830 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:31.028622 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8a0dcb3d-2c16-408d-a86d-9a068b058830 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:31.388795 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-50a9e61b-8395-429f-9c94-da0e5061864b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:31.397904 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-50a9e61b-8395-429f-9c94-da0e5061864b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/79444b51-581d-4748-8265-6433d1957885" status: 200 len: 1214 microversion: 2.1 time: 0.406583 Oct 23 01:31:31.403105 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2329/4730] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:30 2022] GET /compute/v2.1/servers/79444b51-581d-4748-8265-6433d1957885 => generated 1214 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:31.660374 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7f06a0bf-b6d3-4a2b-addf-43383f97d620 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:31.662214 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7f06a0bf-b6d3-4a2b-addf-43383f97d620 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:31.671630 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f06a0bf-b6d3-4a2b-addf-43383f97d620 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:31.672865 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f06a0bf-b6d3-4a2b-addf-43383f97d620 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:31.673621 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f06a0bf-b6d3-4a2b-addf-43383f97d620 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:31.674919 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f06a0bf-b6d3-4a2b-addf-43383f97d620 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:31.675795 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f06a0bf-b6d3-4a2b-addf-43383f97d620 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:31.676435 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f06a0bf-b6d3-4a2b-addf-43383f97d620 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:32.007249 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8a0dcb3d-2c16-408d-a86d-9a068b058830 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:32.018495 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8a0dcb3d-2c16-408d-a86d-9a068b058830 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:32.020677 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8a0dcb3d-2c16-408d-a86d-9a068b058830 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:32.022222 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8a0dcb3d-2c16-408d-a86d-9a068b058830 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1743 microversion: 2.20 time: 1.050291 Oct 23 01:31:32.045537 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2402/4731] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:31:30 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1743 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:31:32.053086 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f2d93d18-2100-4672-a3a9-664d11df9007 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:32.059441 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f2d93d18-2100-4672-a3a9-664d11df9007 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 8e4ff17b-af17-4eec-aad8-966fa0ca835b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:32.061915 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2d93d18-2100-4672-a3a9-664d11df9007 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:32.062618 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2d93d18-2100-4672-a3a9-664d11df9007 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:32.063224 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2d93d18-2100-4672-a3a9-664d11df9007 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:32.064187 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2d93d18-2100-4672-a3a9-664d11df9007 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:32.064958 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2d93d18-2100-4672-a3a9-664d11df9007 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:32.065913 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2d93d18-2100-4672-a3a9-664d11df9007 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:32.086126 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-f2d93d18-2100-4672-a3a9-664d11df9007 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] HTTP exception thrown: Instance 8e4ff17b-af17-4eec-aad8-966fa0ca835b could not be found. Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f2d93d18-2100-4672-a3a9-664d11df9007 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Request method failure captured: Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/8e4ff17b-af17-4eec-aad8-966fa0ca835b HTTP/1.1 Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJkiigL5TCEu6eSSAcyvyVmYwcN25zFDHPVJqRKHbtxzIEn87jCeqAfp7Z9r3Mqhyb3sj4ihzI_o6sMFkrbUwNL-zNG9d9yXVxVjtum4uC7NU-HTDI6Yq0W2nY2ZxVUGKOV2HfdfrtC_JKFgX2qnR1YVSIaIVW5JxazPUN9LbJjq984 Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: e2ee2ea8399e42a5a5cd0d0ddeb192b5 Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersTestJSON-245534565 Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}] Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersTestJSON-245534565 Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: e2ee2ea8399e42a5a5cd0d0ddeb192b5 Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersTestJSON-245534565 Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersTestJSON-245534565-project Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 77197152ea5040bab602d5381d21341a Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersTestJSON-245534565-project Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 8e4ff17b-af17-4eec-aad8-966fa0ca835b could not be found. Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '8e4ff17b-af17-4eec-aad8-966fa0ca835b'} Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e4ff17b-af17-4eec-aad8-966fa0ca835b could not be found. Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e4ff17b-af17-4eec-aad8-966fa0ca835b could not be found. Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:31:32.088983 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:31:32.097506 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:31:32.097506 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:31:32.097506 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:31:32.097506 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:31:32.097506 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e4ff17b-af17-4eec-aad8-966fa0ca835b could not be found. Oct 23 01:31:32.097506 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:31:32.099100 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f2d93d18-2100-4672-a3a9-664d11df9007 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Returning 404 to user: Instance 8e4ff17b-af17-4eec-aad8-966fa0ca835b could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:31:32.100188 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f2d93d18-2100-4672-a3a9-664d11df9007 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/8e4ff17b-af17-4eec-aad8-966fa0ca835b" status: 404 len: 111 microversion: 2.1 time: 0.052970 Oct 23 01:31:32.100947 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2403/4732] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:32 2022] GET /compute/v2.1/servers/8e4ff17b-af17-4eec-aad8-966fa0ca835b => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:31:32.111333 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8d030b5b-04e3-49a4-9b0f-c89cbfcc4be0 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '.version_select at 0x7f5cc16ebdc0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:32.145658 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7f06a0bf-b6d3-4a2b-addf-43383f97d620 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:32.164774 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7f06a0bf-b6d3-4a2b-addf-43383f97d620 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1363 microversion: 2.1 time: 0.509773 Oct 23 01:31:32.165414 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2330/4733] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:31 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1363 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:31:32.278510 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c6c90141-c66b-4bbd-8d2a-e5f7653db2d2 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "efba320e-5ace-4838-98e7-5e089aaf6472"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:31:32.284382 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c6c90141-c66b-4bbd-8d2a-e5f7653db2d2 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: e96f5e79-d832-4927-aef1-a45a815404b0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:32.286432 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8d030b5b-04e3-49a4-9b0f-c89cbfcc4be0 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-key-759453390" status: 202 len: 0 microversion: 2.1 time: 0.179541 Oct 23 01:31:32.289958 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2404/4734] 10.222.0.42 () {58 vars in 1206 bytes} [Sun Oct 23 01:31:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-759453390 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:31:32.293550 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:31:32.316351 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6c90141-c66b-4bbd-8d2a-e5f7653db2d2 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:32.316605 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6c90141-c66b-4bbd-8d2a-e5f7653db2d2 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:32.316885 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6c90141-c66b-4bbd-8d2a-e5f7653db2d2 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:32.318467 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6c90141-c66b-4bbd-8d2a-e5f7653db2d2 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:32.324991 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6c90141-c66b-4bbd-8d2a-e5f7653db2d2 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:32.324991 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6c90141-c66b-4bbd-8d2a-e5f7653db2d2 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:32.331601 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:31:32.432820 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8b739818-63c6-4b7a-a06e-f73cee3d9274 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:32.436547 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8b739818-63c6-4b7a-a06e-f73cee3d9274 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 79444b51-581d-4748-8265-6433d1957885] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:32.559956 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8b739818-63c6-4b7a-a06e-f73cee3d9274 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:32.571132 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8b739818-63c6-4b7a-a06e-f73cee3d9274 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/79444b51-581d-4748-8265-6433d1957885" status: 200 len: 1214 microversion: 2.1 time: 0.145926 Oct 23 01:31:32.582067 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2405/4735] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:32 2022] GET /compute/v2.1/servers/79444b51-581d-4748-8265-6433d1957885 => generated 1214 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:32.586385 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6791e3a1-babd-449f-ad2d-63cd12f2496e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-257176732", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "54c8030f-5807-4507-8aa3-283b114a73f4"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:31:32.689737 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-6791e3a1-babd-449f-ad2d-63cd12f2496e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] validate_networks() for [('54c8030f-5807-4507-8aa3-283b114a73f4', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:31:33.730283 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c6c90141-c66b-4bbd-8d2a-e5f7653db2d2 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "POST /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.456074 Oct 23 01:31:33.734431 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2331/4736] 10.222.0.42 () {60 vars in 1323 bytes} [Sun Oct 23 01:31:32 2022] POST /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0/os-volume_attachments => generated 194 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:31:33.748245 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3aad1ea9-f398-4362-b791-20e6106fc444 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:33.750457 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3aad1ea9-f398-4362-b791-20e6106fc444 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:33.767524 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3aad1ea9-f398-4362-b791-20e6106fc444 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:33.768556 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3aad1ea9-f398-4362-b791-20e6106fc444 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:33.769227 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3aad1ea9-f398-4362-b791-20e6106fc444 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:33.770239 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3aad1ea9-f398-4362-b791-20e6106fc444 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:33.771808 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3aad1ea9-f398-4362-b791-20e6106fc444 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:33.773204 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3aad1ea9-f398-4362-b791-20e6106fc444 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:34.021466 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-6791e3a1-babd-449f-ad2d-63cd12f2496e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:31:34.022578 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-6791e3a1-babd-449f-ad2d-63cd12f2496e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:31:34.023228 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-6791e3a1-babd-449f-ad2d-63cd12f2496e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:31:34.023812 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-6791e3a1-babd-449f-ad2d-63cd12f2496e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:31:34.024417 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-6791e3a1-babd-449f-ad2d-63cd12f2496e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:31:34.074882 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6791e3a1-babd-449f-ad2d-63cd12f2496e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:34.075407 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6791e3a1-babd-449f-ad2d-63cd12f2496e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:34.075862 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6791e3a1-babd-449f-ad2d-63cd12f2496e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:34.077179 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6791e3a1-babd-449f-ad2d-63cd12f2496e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:34.077652 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6791e3a1-babd-449f-ad2d-63cd12f2496e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:34.091165 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6791e3a1-babd-449f-ad2d-63cd12f2496e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:34.165832 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-6791e3a1-babd-449f-ad2d-63cd12f2496e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Getting quotas for project e2ee2ea8399e42a5a5cd0d0ddeb192b5. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:31:34.194633 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-6791e3a1-babd-449f-ad2d-63cd12f2496e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Getting quotas for user 77197152ea5040bab602d5381d21341a and project e2ee2ea8399e42a5a5cd0d0ddeb192b5. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:31:34.269133 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6791e3a1-babd-449f-ad2d-63cd12f2496e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:31:34.280192 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6791e3a1-babd-449f-ad2d-63cd12f2496e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: f7ade4c5-7f11-4df8-9775-7e790e4e4435] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:31:34.477853 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3aad1ea9-f398-4362-b791-20e6106fc444 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:34.489270 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3aad1ea9-f398-4362-b791-20e6106fc444 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:34.491335 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3aad1ea9-f398-4362-b791-20e6106fc444 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:34.495249 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3aad1ea9-f398-4362-b791-20e6106fc444 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1738 microversion: 2.20 time: 0.756607 Oct 23 01:31:34.498506 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2332/4737] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:31:33 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1738 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:31:34.512541 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-84489f07-cfeb-42b7-a350-e835ecbfac4b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:34.515145 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-84489f07-cfeb-42b7-a350-e835ecbfac4b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:34.518934 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6791e3a1-babd-449f-ad2d-63cd12f2496e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.943361 Oct 23 01:31:34.526043 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2406/4738] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:31:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1946 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:31:34.529895 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-84489f07-cfeb-42b7-a350-e835ecbfac4b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:34.532112 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-84489f07-cfeb-42b7-a350-e835ecbfac4b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:34.532897 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-84489f07-cfeb-42b7-a350-e835ecbfac4b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:34.533813 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-84489f07-cfeb-42b7-a350-e835ecbfac4b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:34.536331 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-84489f07-cfeb-42b7-a350-e835ecbfac4b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:34.537340 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-84489f07-cfeb-42b7-a350-e835ecbfac4b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:34.572114 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1259a82b-c7a9-417e-8476-ca21fb2c8517 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:34.575204 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1259a82b-c7a9-417e-8476-ca21fb2c8517 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 79444b51-581d-4748-8265-6433d1957885] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:34.594932 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1259a82b-c7a9-417e-8476-ca21fb2c8517 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:34.596567 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1259a82b-c7a9-417e-8476-ca21fb2c8517 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:34.597021 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1259a82b-c7a9-417e-8476-ca21fb2c8517 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:34.597755 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1259a82b-c7a9-417e-8476-ca21fb2c8517 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:34.598255 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1259a82b-c7a9-417e-8476-ca21fb2c8517 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:34.603563 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1259a82b-c7a9-417e-8476-ca21fb2c8517 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:34.848293 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1259a82b-c7a9-417e-8476-ca21fb2c8517 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:34.868413 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1259a82b-c7a9-417e-8476-ca21fb2c8517 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/79444b51-581d-4748-8265-6433d1957885" status: 200 len: 1266 microversion: 2.1 time: 0.321243 Oct 23 01:31:34.890410 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2407/4739] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:34 2022] GET /compute/v2.1/servers/79444b51-581d-4748-8265-6433d1957885 => generated 1266 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:34.907349 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-fd9aba03-3928-4d5a-84d6-425748237f08 req-4363eb3b-cec6-491b-8786-c18b145426a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1d0765d-d720-40d2-b168-058e013fab0a", "name": "network-vif-plugged", "status": "completed", "tag": "9d275317-d5ad-4bae-8215-25b674a45c60"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:31:34.949609 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-fd9aba03-3928-4d5a-84d6-425748237f08 req-4363eb3b-cec6-491b-8786-c18b145426a0 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:34.950815 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-fd9aba03-3928-4d5a-84d6-425748237f08 req-4363eb3b-cec6-491b-8786-c18b145426a0 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:34.951886 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-fd9aba03-3928-4d5a-84d6-425748237f08 req-4363eb3b-cec6-491b-8786-c18b145426a0 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:34.997549 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-fd9aba03-3928-4d5a-84d6-425748237f08 req-4363eb3b-cec6-491b-8786-c18b145426a0 service nova] Creating event network-vif-plugged:9d275317-d5ad-4bae-8215-25b674a45c60 for instance b1d0765d-d720-40d2-b168-058e013fab0a on n-h2-master-1 Oct 23 01:31:35.017437 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-fd9aba03-3928-4d5a-84d6-425748237f08 req-4363eb3b-cec6-491b-8786-c18b145426a0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125389 Oct 23 01:31:35.020798 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2408/4740] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:31:35.033582 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-56c24590-084d-4c72-b4f3-234ebc93076b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:35.037692 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-56c24590-084d-4c72-b4f3-234ebc93076b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: f7ade4c5-7f11-4df8-9775-7e790e4e4435] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:35.475931 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-56c24590-084d-4c72-b4f3-234ebc93076b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:35.483576 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-56c24590-084d-4c72-b4f3-234ebc93076b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/f7ade4c5-7f11-4df8-9775-7e790e4e4435" status: 200 len: 1208 microversion: 2.1 time: 0.461274 Oct 23 01:31:35.484169 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2409/4741] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:35 2022] GET /compute/v2.1/servers/f7ade4c5-7f11-4df8-9775-7e790e4e4435 => generated 1208 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:35.539193 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ad662736-19e0-4aa1-b43d-92637d2ceb91 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:35.540073 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ad662736-19e0-4aa1-b43d-92637d2ceb91 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:35.569364 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ad662736-19e0-4aa1-b43d-92637d2ceb91 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:35.570293 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ad662736-19e0-4aa1-b43d-92637d2ceb91 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:35.571966 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ad662736-19e0-4aa1-b43d-92637d2ceb91 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:35.574509 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ad662736-19e0-4aa1-b43d-92637d2ceb91 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:35.579737 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ad662736-19e0-4aa1-b43d-92637d2ceb91 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:35.581743 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ad662736-19e0-4aa1-b43d-92637d2ceb91 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:35.744998 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-84489f07-cfeb-42b7-a350-e835ecbfac4b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:35.755440 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-84489f07-cfeb-42b7-a350-e835ecbfac4b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1551 microversion: 2.1 time: 1.253788 Oct 23 01:31:35.758187 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2333/4742] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:34 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1551 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:35.786299 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a3c74773-91a3-4505-a6fd-c3a0617d9118 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:35.786877 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a3c74773-91a3-4505-a6fd-c3a0617d9118 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:35.799149 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a3c74773-91a3-4505-a6fd-c3a0617d9118 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:35.801094 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a3c74773-91a3-4505-a6fd-c3a0617d9118 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:35.803073 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a3c74773-91a3-4505-a6fd-c3a0617d9118 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:35.803883 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a3c74773-91a3-4505-a6fd-c3a0617d9118 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:35.805645 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a3c74773-91a3-4505-a6fd-c3a0617d9118 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:35.807377 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a3c74773-91a3-4505-a6fd-c3a0617d9118 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:36.033695 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a3c74773-91a3-4505-a6fd-c3a0617d9118 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.252387 Oct 23 01:31:36.034595 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2334/4743] 10.222.0.42 () {58 vars in 1275 bytes} [Sun Oct 23 01:31:35 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98/os-interface => generated 285 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:31:36.039664 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3666c038-f941-4317-9f65-3b0a6e862ca8 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:36.040554 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3666c038-f941-4317-9f65-3b0a6e862ca8 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 79444b51-581d-4748-8265-6433d1957885] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:36.059081 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3666c038-f941-4317-9f65-3b0a6e862ca8 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:36.064012 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3666c038-f941-4317-9f65-3b0a6e862ca8 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:36.064012 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3666c038-f941-4317-9f65-3b0a6e862ca8 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:36.073425 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3666c038-f941-4317-9f65-3b0a6e862ca8 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:36.073967 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3666c038-f941-4317-9f65-3b0a6e862ca8 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:36.074446 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3666c038-f941-4317-9f65-3b0a6e862ca8 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:36.609693 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3666c038-f941-4317-9f65-3b0a6e862ca8 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:36.623317 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3666c038-f941-4317-9f65-3b0a6e862ca8 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/79444b51-581d-4748-8265-6433d1957885" status: 200 len: 1272 microversion: 2.1 time: 0.586778 Oct 23 01:31:36.623931 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2335/4744] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:36 2022] GET /compute/v2.1/servers/79444b51-581d-4748-8265-6433d1957885 => generated 1272 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:36.644576 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fff02a1b-d900-4373-aa5e-eaae5ce3b2f4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:36.645229 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-fff02a1b-d900-4373-aa5e-eaae5ce3b2f4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: f7ade4c5-7f11-4df8-9775-7e790e4e4435] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:36.665596 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fff02a1b-d900-4373-aa5e-eaae5ce3b2f4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:36.668278 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fff02a1b-d900-4373-aa5e-eaae5ce3b2f4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:36.669173 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fff02a1b-d900-4373-aa5e-eaae5ce3b2f4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:36.670516 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fff02a1b-d900-4373-aa5e-eaae5ce3b2f4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:36.674658 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fff02a1b-d900-4373-aa5e-eaae5ce3b2f4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:36.675320 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fff02a1b-d900-4373-aa5e-eaae5ce3b2f4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:37.112346 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ad662736-19e0-4aa1-b43d-92637d2ceb91 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:37.130305 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ad662736-19e0-4aa1-b43d-92637d2ceb91 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:37.138374 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ad662736-19e0-4aa1-b43d-92637d2ceb91 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:37.146567 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ad662736-19e0-4aa1-b43d-92637d2ceb91 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1738 microversion: 2.20 time: 1.611216 Oct 23 01:31:37.157520 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2410/4745] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:31:35 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1738 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:31:37.383981 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-fff02a1b-d900-4373-aa5e-eaae5ce3b2f4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:37.393060 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fff02a1b-d900-4373-aa5e-eaae5ce3b2f4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/f7ade4c5-7f11-4df8-9775-7e790e4e4435" status: 200 len: 1212 microversion: 2.1 time: 0.767940 Oct 23 01:31:37.393658 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2336/4746] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:36 2022] GET /compute/v2.1/servers/f7ade4c5-7f11-4df8-9775-7e790e4e4435 => generated 1212 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:37.652885 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c2cc0dd7-dd18-4859-b830-8e71f927c04f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:37.653526 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c2cc0dd7-dd18-4859-b830-8e71f927c04f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 79444b51-581d-4748-8265-6433d1957885] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:37.677220 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2cc0dd7-dd18-4859-b830-8e71f927c04f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:37.678558 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2cc0dd7-dd18-4859-b830-8e71f927c04f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:37.680345 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2cc0dd7-dd18-4859-b830-8e71f927c04f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:37.681128 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2cc0dd7-dd18-4859-b830-8e71f927c04f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:37.682761 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2cc0dd7-dd18-4859-b830-8e71f927c04f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:37.683799 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2cc0dd7-dd18-4859-b830-8e71f927c04f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:38.188961 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7f2ac400-36ab-4a18-9fa5-18512afdc15f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:38.188961 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7f2ac400-36ab-4a18-9fa5-18512afdc15f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:38.194307 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f2ac400-36ab-4a18-9fa5-18512afdc15f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:38.195850 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f2ac400-36ab-4a18-9fa5-18512afdc15f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:38.196460 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f2ac400-36ab-4a18-9fa5-18512afdc15f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:38.197489 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f2ac400-36ab-4a18-9fa5-18512afdc15f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:38.198207 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f2ac400-36ab-4a18-9fa5-18512afdc15f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:38.198883 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f2ac400-36ab-4a18-9fa5-18512afdc15f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:39.527572 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7f2ac400-36ab-4a18-9fa5-18512afdc15f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:39.529185 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c2cc0dd7-dd18-4859-b830-8e71f927c04f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:39.542057 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c2cc0dd7-dd18-4859-b830-8e71f927c04f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/79444b51-581d-4748-8265-6433d1957885" status: 200 len: 1314 microversion: 2.1 time: 1.894927 Oct 23 01:31:39.543702 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7f2ac400-36ab-4a18-9fa5-18512afdc15f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:39.553213 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7f2ac400-36ab-4a18-9fa5-18512afdc15f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:39.556637 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2411/4747] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:37 2022] GET /compute/v2.1/servers/79444b51-581d-4748-8265-6433d1957885 => generated 1314 bytes in 1910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:39.559106 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7f2ac400-36ab-4a18-9fa5-18512afdc15f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1738 microversion: 2.20 time: 1.388568 Oct 23 01:31:39.571105 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-38472f74-7545-4ba8-a03d-5ff8ec49f321 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:39.571524 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2337/4748] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:31:38 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1738 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:31:39.573139 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-38472f74-7545-4ba8-a03d-5ff8ec49f321 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: f7ade4c5-7f11-4df8-9775-7e790e4e4435] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:39.590481 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-38472f74-7545-4ba8-a03d-5ff8ec49f321 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:39.592248 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-38472f74-7545-4ba8-a03d-5ff8ec49f321 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:39.597285 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-38472f74-7545-4ba8-a03d-5ff8ec49f321 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:39.599274 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-38472f74-7545-4ba8-a03d-5ff8ec49f321 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:39.601926 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-38472f74-7545-4ba8-a03d-5ff8ec49f321 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:39.601926 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-38472f74-7545-4ba8-a03d-5ff8ec49f321 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:39.789686 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-38472f74-7545-4ba8-a03d-5ff8ec49f321 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:39.808869 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-38472f74-7545-4ba8-a03d-5ff8ec49f321 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/f7ade4c5-7f11-4df8-9775-7e790e4e4435" status: 200 len: 1278 microversion: 2.1 time: 0.246699 Oct 23 01:31:39.811122 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2412/4749] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:39 2022] GET /compute/v2.1/servers/f7ade4c5-7f11-4df8-9775-7e790e4e4435 => generated 1278 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:40.572278 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-94f8378e-1868-4b3f-bb14-0f71925735f2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:40.573015 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-94f8378e-1868-4b3f-bb14-0f71925735f2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 79444b51-581d-4748-8265-6433d1957885] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:40.590566 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-94f8378e-1868-4b3f-bb14-0f71925735f2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:40.591086 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-94f8378e-1868-4b3f-bb14-0f71925735f2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:40.594206 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-94f8378e-1868-4b3f-bb14-0f71925735f2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:40.596318 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-94f8378e-1868-4b3f-bb14-0f71925735f2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:40.602489 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-94f8378e-1868-4b3f-bb14-0f71925735f2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:40.604481 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-94f8378e-1868-4b3f-bb14-0f71925735f2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:40.605317 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:31:40.692841 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-c8d69b7b-a3fd-4454-9e10-8f42f3d036b7 req-b177b72b-aa1a-4969-82b7-16ab5fe6b33b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa616812-f379-45fb-8e7e-fefe7570dc98", "tag": "6de1369a-94d0-42a0-a57f-9deacb90b66f"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:31:40.739940 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-c8d69b7b-a3fd-4454-9e10-8f42f3d036b7 req-b177b72b-aa1a-4969-82b7-16ab5fe6b33b service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:40.740487 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-c8d69b7b-a3fd-4454-9e10-8f42f3d036b7 req-b177b72b-aa1a-4969-82b7-16ab5fe6b33b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:40.740938 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-c8d69b7b-a3fd-4454-9e10-8f42f3d036b7 req-b177b72b-aa1a-4969-82b7-16ab5fe6b33b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:40.790743 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-c8d69b7b-a3fd-4454-9e10-8f42f3d036b7 req-b177b72b-aa1a-4969-82b7-16ab5fe6b33b service nova] Creating event network-changed:6de1369a-94d0-42a0-a57f-9deacb90b66f for instance fa616812-f379-45fb-8e7e-fefe7570dc98 on n-h1-master-1 Oct 23 01:31:40.804439 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-c8d69b7b-a3fd-4454-9e10-8f42f3d036b7 req-b177b72b-aa1a-4969-82b7-16ab5fe6b33b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.490255 Oct 23 01:31:40.805383 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2338/4750] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:31:40.816654 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c6b149ea-de31-479b-ac5b-211782dfd292 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:40.821794 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c6b149ea-de31-479b-ac5b-211782dfd292 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:40.840679 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6b149ea-de31-479b-ac5b-211782dfd292 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:40.844672 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6b149ea-de31-479b-ac5b-211782dfd292 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:40.845334 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6b149ea-de31-479b-ac5b-211782dfd292 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:40.847883 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6b149ea-de31-479b-ac5b-211782dfd292 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:40.851136 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6b149ea-de31-479b-ac5b-211782dfd292 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:40.851764 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6b149ea-de31-479b-ac5b-211782dfd292 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:41.394601 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=8 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:31:41.582098 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-94f8378e-1868-4b3f-bb14-0f71925735f2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:41.611019 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-94f8378e-1868-4b3f-bb14-0f71925735f2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/79444b51-581d-4748-8265-6433d1957885" status: 200 len: 1314 microversion: 2.1 time: 1.042734 Oct 23 01:31:41.611700 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2413/4751] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:40 2022] GET /compute/v2.1/servers/79444b51-581d-4748-8265-6433d1957885 => generated 1314 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:41.639114 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-07d41d2d-b88b-4129-a35c-8472eaab40ff tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:41.646972 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-07d41d2d-b88b-4129-a35c-8472eaab40ff tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: f7ade4c5-7f11-4df8-9775-7e790e4e4435] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:41.664465 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07d41d2d-b88b-4129-a35c-8472eaab40ff tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:41.672587 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07d41d2d-b88b-4129-a35c-8472eaab40ff tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:41.675547 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07d41d2d-b88b-4129-a35c-8472eaab40ff tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:41.676703 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07d41d2d-b88b-4129-a35c-8472eaab40ff tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:41.681173 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07d41d2d-b88b-4129-a35c-8472eaab40ff tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:41.682831 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07d41d2d-b88b-4129-a35c-8472eaab40ff tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:42.047993 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-07d41d2d-b88b-4129-a35c-8472eaab40ff tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:42.062228 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-07d41d2d-b88b-4129-a35c-8472eaab40ff tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/f7ade4c5-7f11-4df8-9775-7e790e4e4435" status: 200 len: 1266 microversion: 2.1 time: 0.441484 Oct 23 01:31:42.063054 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2414/4752] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:41 2022] GET /compute/v2.1/servers/f7ade4c5-7f11-4df8-9775-7e790e4e4435 => generated 1266 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:42.071908 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c6b149ea-de31-479b-ac5b-211782dfd292 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:42.088657 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c6b149ea-de31-479b-ac5b-211782dfd292 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:42.099733 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c6b149ea-de31-479b-ac5b-211782dfd292 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:42.105551 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c6b149ea-de31-479b-ac5b-211782dfd292 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1738 microversion: 2.20 time: 1.297097 Oct 23 01:31:42.107073 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2339/4753] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:31:40 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1738 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:31:42.490821 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-5ea59b17-d274-4717-a285-580949bfdab5 req-86b8a87f-0cd3-479e-8b75-19f2296cd29d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79444b51-581d-4748-8265-6433d1957885", "tag": "82462d8a-4cc2-4dab-875c-00125a680025"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:31:42.533183 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-5ea59b17-d274-4717-a285-580949bfdab5 req-86b8a87f-0cd3-479e-8b75-19f2296cd29d service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:42.537159 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-5ea59b17-d274-4717-a285-580949bfdab5 req-86b8a87f-0cd3-479e-8b75-19f2296cd29d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:42.537774 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-5ea59b17-d274-4717-a285-580949bfdab5 req-86b8a87f-0cd3-479e-8b75-19f2296cd29d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:42.576864 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-5ea59b17-d274-4717-a285-580949bfdab5 req-86b8a87f-0cd3-479e-8b75-19f2296cd29d service nova] Creating event network-changed:82462d8a-4cc2-4dab-875c-00125a680025 for instance 79444b51-581d-4748-8265-6433d1957885 on n-h2-master-1 Oct 23 01:31:42.592785 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-5ea59b17-d274-4717-a285-580949bfdab5 req-86b8a87f-0cd3-479e-8b75-19f2296cd29d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.526659 Oct 23 01:31:42.599437 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2415/4754] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:31:42.638381 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-91175641-537e-4510-9f3c-5e78c9406409 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:42.639151 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-91175641-537e-4510-9f3c-5e78c9406409 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 79444b51-581d-4748-8265-6433d1957885] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:42.648485 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-91175641-537e-4510-9f3c-5e78c9406409 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:42.656728 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-91175641-537e-4510-9f3c-5e78c9406409 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:42.658609 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-91175641-537e-4510-9f3c-5e78c9406409 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:42.659611 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-91175641-537e-4510-9f3c-5e78c9406409 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:42.660279 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-91175641-537e-4510-9f3c-5e78c9406409 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:42.660895 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-91175641-537e-4510-9f3c-5e78c9406409 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:43.049796 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-91175641-537e-4510-9f3c-5e78c9406409 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:43.067268 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-91175641-537e-4510-9f3c-5e78c9406409 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/79444b51-581d-4748-8265-6433d1957885" status: 200 len: 1314 microversion: 2.1 time: 0.433645 Oct 23 01:31:43.070316 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2340/4755] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:42 2022] GET /compute/v2.1/servers/79444b51-581d-4748-8265-6433d1957885 => generated 1314 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:43.101403 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4eec72b3-367a-441f-aa77-ba17ade809b7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:43.101403 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4eec72b3-367a-441f-aa77-ba17ade809b7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: f7ade4c5-7f11-4df8-9775-7e790e4e4435] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:43.113711 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:31:43.116061 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4eec72b3-367a-441f-aa77-ba17ade809b7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:43.116797 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4eec72b3-367a-441f-aa77-ba17ade809b7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:43.118345 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4eec72b3-367a-441f-aa77-ba17ade809b7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:43.119368 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4eec72b3-367a-441f-aa77-ba17ade809b7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:43.120359 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4eec72b3-367a-441f-aa77-ba17ade809b7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:43.121052 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4eec72b3-367a-441f-aa77-ba17ade809b7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:43.142055 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5de47a47-5130-4aa0-98fc-1d0ad8e1944b tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:43.147323 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5de47a47-5130-4aa0-98fc-1d0ad8e1944b tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:43.169170 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5de47a47-5130-4aa0-98fc-1d0ad8e1944b tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:43.177411 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5de47a47-5130-4aa0-98fc-1d0ad8e1944b tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:43.178411 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5de47a47-5130-4aa0-98fc-1d0ad8e1944b tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:43.179408 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5de47a47-5130-4aa0-98fc-1d0ad8e1944b tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:43.180322 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5de47a47-5130-4aa0-98fc-1d0ad8e1944b tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:43.181017 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5de47a47-5130-4aa0-98fc-1d0ad8e1944b tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:44.123583 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:31:44.180282 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5de47a47-5130-4aa0-98fc-1d0ad8e1944b tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:44.193507 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5de47a47-5130-4aa0-98fc-1d0ad8e1944b tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:44.199264 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5de47a47-5130-4aa0-98fc-1d0ad8e1944b tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:44.204337 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5de47a47-5130-4aa0-98fc-1d0ad8e1944b tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1738 microversion: 2.20 time: 1.068968 Oct 23 01:31:44.207343 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2341/4756] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:31:43 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1738 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:31:44.213902 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3a4932ba-b66c-4b35-8a7b-a51f06f1397d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:44.215054 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3a4932ba-b66c-4b35-8a7b-a51f06f1397d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 79444b51-581d-4748-8265-6433d1957885] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:44.238406 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3a4932ba-b66c-4b35-8a7b-a51f06f1397d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:44.242630 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3a4932ba-b66c-4b35-8a7b-a51f06f1397d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:44.246171 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3a4932ba-b66c-4b35-8a7b-a51f06f1397d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:44.248465 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3a4932ba-b66c-4b35-8a7b-a51f06f1397d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:44.251774 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3a4932ba-b66c-4b35-8a7b-a51f06f1397d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:44.257008 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3a4932ba-b66c-4b35-8a7b-a51f06f1397d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:44.282154 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4eec72b3-367a-441f-aa77-ba17ade809b7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:44.305496 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4eec72b3-367a-441f-aa77-ba17ade809b7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/f7ade4c5-7f11-4df8-9775-7e790e4e4435" status: 200 len: 1308 microversion: 2.1 time: 1.206002 Oct 23 01:31:44.306750 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2416/4757] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:43 2022] GET /compute/v2.1/servers/f7ade4c5-7f11-4df8-9775-7e790e4e4435 => generated 1308 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:44.638578 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3a4932ba-b66c-4b35-8a7b-a51f06f1397d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:44.654440 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3a4932ba-b66c-4b35-8a7b-a51f06f1397d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/79444b51-581d-4748-8265-6433d1957885" status: 200 len: 1314 microversion: 2.1 time: 0.445171 Oct 23 01:31:44.656197 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2342/4758] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:44 2022] GET /compute/v2.1/servers/79444b51-581d-4748-8265-6433d1957885 => generated 1314 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:45.240278 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b366b645-c254-43cf-9cc9-36b1d1feb53d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:45.241278 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b366b645-c254-43cf-9cc9-36b1d1feb53d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:45.265075 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b366b645-c254-43cf-9cc9-36b1d1feb53d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:45.266015 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b366b645-c254-43cf-9cc9-36b1d1feb53d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:45.266958 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b366b645-c254-43cf-9cc9-36b1d1feb53d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:45.267914 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b366b645-c254-43cf-9cc9-36b1d1feb53d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:45.268605 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b366b645-c254-43cf-9cc9-36b1d1feb53d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:45.269265 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b366b645-c254-43cf-9cc9-36b1d1feb53d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:45.332711 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b627e230-40f6-4f43-8550-f3132d880abb tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:45.334065 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b627e230-40f6-4f43-8550-f3132d880abb tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: f7ade4c5-7f11-4df8-9775-7e790e4e4435] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:45.344026 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b627e230-40f6-4f43-8550-f3132d880abb tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:45.346044 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b627e230-40f6-4f43-8550-f3132d880abb tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:45.346771 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b627e230-40f6-4f43-8550-f3132d880abb tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:45.349010 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b627e230-40f6-4f43-8550-f3132d880abb tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:45.349769 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b627e230-40f6-4f43-8550-f3132d880abb tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:45.351905 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b627e230-40f6-4f43-8550-f3132d880abb tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:45.483193 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=10 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:31:45.718307 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b366b645-c254-43cf-9cc9-36b1d1feb53d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:45.727692 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b627e230-40f6-4f43-8550-f3132d880abb tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:45.735134 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b366b645-c254-43cf-9cc9-36b1d1feb53d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:45.736894 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b366b645-c254-43cf-9cc9-36b1d1feb53d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:45.741403 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b627e230-40f6-4f43-8550-f3132d880abb tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/f7ade4c5-7f11-4df8-9775-7e790e4e4435" status: 200 len: 1308 microversion: 2.1 time: 0.412385 Oct 23 01:31:45.742549 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2343/4759] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:45 2022] GET /compute/v2.1/servers/f7ade4c5-7f11-4df8-9775-7e790e4e4435 => generated 1308 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:31:45.744098 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b366b645-c254-43cf-9cc9-36b1d1feb53d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1738 microversion: 2.20 time: 0.514121 Oct 23 01:31:45.752828 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2417/4760] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:31:45 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1738 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:31:45.755083 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-53c71403-f6ea-4ab7-9c3c-6a4e49f4439d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:45.758609 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-53c71403-f6ea-4ab7-9c3c-6a4e49f4439d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 79444b51-581d-4748-8265-6433d1957885] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:45.765838 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-53c71403-f6ea-4ab7-9c3c-6a4e49f4439d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:45.766621 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-53c71403-f6ea-4ab7-9c3c-6a4e49f4439d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:45.767245 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-53c71403-f6ea-4ab7-9c3c-6a4e49f4439d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:45.768383 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-53c71403-f6ea-4ab7-9c3c-6a4e49f4439d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:45.769049 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-53c71403-f6ea-4ab7-9c3c-6a4e49f4439d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:45.769626 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-53c71403-f6ea-4ab7-9c3c-6a4e49f4439d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:46.084520 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-53c71403-f6ea-4ab7-9c3c-6a4e49f4439d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:46.095207 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-53c71403-f6ea-4ab7-9c3c-6a4e49f4439d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/79444b51-581d-4748-8265-6433d1957885" status: 200 len: 1314 microversion: 2.1 time: 0.349794 Oct 23 01:31:46.098209 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2344/4761] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:45 2022] GET /compute/v2.1/servers/79444b51-581d-4748-8265-6433d1957885 => generated 1314 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:46.765557 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6bb3ddad-df64-47cb-9df2-158625210a15 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:46.766916 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6bb3ddad-df64-47cb-9df2-158625210a15 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: f7ade4c5-7f11-4df8-9775-7e790e4e4435] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:46.774730 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6bb3ddad-df64-47cb-9df2-158625210a15 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:46.785708 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-63cd01ec-b424-499f-8a57-b80bb226e77e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:46.787056 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6bb3ddad-df64-47cb-9df2-158625210a15 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:46.787283 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-63cd01ec-b424-499f-8a57-b80bb226e77e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:46.787751 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6bb3ddad-df64-47cb-9df2-158625210a15 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:46.788630 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6bb3ddad-df64-47cb-9df2-158625210a15 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:46.789215 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6bb3ddad-df64-47cb-9df2-158625210a15 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:46.797884 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6bb3ddad-df64-47cb-9df2-158625210a15 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:46.802622 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-63cd01ec-b424-499f-8a57-b80bb226e77e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:46.807014 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-63cd01ec-b424-499f-8a57-b80bb226e77e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:46.807670 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-63cd01ec-b424-499f-8a57-b80bb226e77e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:46.808643 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-63cd01ec-b424-499f-8a57-b80bb226e77e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:46.809296 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-63cd01ec-b424-499f-8a57-b80bb226e77e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:46.809923 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-63cd01ec-b424-499f-8a57-b80bb226e77e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:47.514313 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-63cd01ec-b424-499f-8a57-b80bb226e77e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:47.527917 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-63cd01ec-b424-499f-8a57-b80bb226e77e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:47.549929 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-63cd01ec-b424-499f-8a57-b80bb226e77e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:47.555305 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6bb3ddad-df64-47cb-9df2-158625210a15 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:47.564314 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6bb3ddad-df64-47cb-9df2-158625210a15 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/f7ade4c5-7f11-4df8-9775-7e790e4e4435" status: 200 len: 1308 microversion: 2.1 time: 0.803072 Oct 23 01:31:47.566610 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-63cd01ec-b424-499f-8a57-b80bb226e77e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1738 microversion: 2.20 time: 0.786124 Oct 23 01:31:47.569338 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2345/4762] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:31:46 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1738 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:31:47.571774 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2418/4763] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:46 2022] GET /compute/v2.1/servers/f7ade4c5-7f11-4df8-9775-7e790e4e4435 => generated 1308 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:47.576357 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1554db25-474f-4034-a9d8-9c3e66817cc3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:47.577215 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1554db25-474f-4034-a9d8-9c3e66817cc3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 79444b51-581d-4748-8265-6433d1957885] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:47.594481 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1554db25-474f-4034-a9d8-9c3e66817cc3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:47.594481 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1554db25-474f-4034-a9d8-9c3e66817cc3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:47.594481 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1554db25-474f-4034-a9d8-9c3e66817cc3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:47.594481 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1554db25-474f-4034-a9d8-9c3e66817cc3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:47.594481 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1554db25-474f-4034-a9d8-9c3e66817cc3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:47.600359 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1554db25-474f-4034-a9d8-9c3e66817cc3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:47.969686 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-30a776f8-5dc5-42ba-b40d-af3eaa662ca9 req-083b943f-b39c-4f3a-a131-cc46646de7a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7ade4c5-7f11-4df8-9775-7e790e4e4435", "tag": "1d8a3331-8eb4-4bdd-9aef-8f6329fafd67"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:31:47.991353 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-30a776f8-5dc5-42ba-b40d-af3eaa662ca9 req-083b943f-b39c-4f3a-a131-cc46646de7a6 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:48.009339 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-30a776f8-5dc5-42ba-b40d-af3eaa662ca9 req-083b943f-b39c-4f3a-a131-cc46646de7a6 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:48.010030 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-30a776f8-5dc5-42ba-b40d-af3eaa662ca9 req-083b943f-b39c-4f3a-a131-cc46646de7a6 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:48.059189 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-30a776f8-5dc5-42ba-b40d-af3eaa662ca9 req-083b943f-b39c-4f3a-a131-cc46646de7a6 service nova] Creating event network-changed:1d8a3331-8eb4-4bdd-9aef-8f6329fafd67 for instance f7ade4c5-7f11-4df8-9775-7e790e4e4435 on n-h2-master-1 Oct 23 01:31:48.085493 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-30a776f8-5dc5-42ba-b40d-af3eaa662ca9 req-083b943f-b39c-4f3a-a131-cc46646de7a6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120163 Oct 23 01:31:48.086542 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2419/4764] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:31:48.137078 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1554db25-474f-4034-a9d8-9c3e66817cc3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:48.149410 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1554db25-474f-4034-a9d8-9c3e66817cc3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/79444b51-581d-4748-8265-6433d1957885" status: 200 len: 1314 microversion: 2.1 time: 0.578633 Oct 23 01:31:48.150483 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2346/4765] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:47 2022] GET /compute/v2.1/servers/79444b51-581d-4748-8265-6433d1957885 => generated 1314 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:48.598916 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-089d5668-ace0-4878-968a-9f5fddc7d7a1 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:48.599427 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-089d5668-ace0-4878-968a-9f5fddc7d7a1 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: f7ade4c5-7f11-4df8-9775-7e790e4e4435] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:48.605225 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4fb4916e-3f69-437f-8de5-5b90f73d774e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:48.605943 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4fb4916e-3f69-437f-8de5-5b90f73d774e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:48.623709 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-089d5668-ace0-4878-968a-9f5fddc7d7a1 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:48.624210 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-089d5668-ace0-4878-968a-9f5fddc7d7a1 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:48.624655 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-089d5668-ace0-4878-968a-9f5fddc7d7a1 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:48.625373 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-089d5668-ace0-4878-968a-9f5fddc7d7a1 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:48.625832 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-089d5668-ace0-4878-968a-9f5fddc7d7a1 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:48.626283 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-089d5668-ace0-4878-968a-9f5fddc7d7a1 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:48.634150 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4fb4916e-3f69-437f-8de5-5b90f73d774e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:48.634945 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4fb4916e-3f69-437f-8de5-5b90f73d774e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:48.635560 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4fb4916e-3f69-437f-8de5-5b90f73d774e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:48.636434 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4fb4916e-3f69-437f-8de5-5b90f73d774e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:48.637183 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4fb4916e-3f69-437f-8de5-5b90f73d774e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:48.637875 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4fb4916e-3f69-437f-8de5-5b90f73d774e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:48.696782 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:31:49.097499 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4fb4916e-3f69-437f-8de5-5b90f73d774e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:49.116195 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4fb4916e-3f69-437f-8de5-5b90f73d774e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:49.117601 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4fb4916e-3f69-437f-8de5-5b90f73d774e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:49.118886 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4fb4916e-3f69-437f-8de5-5b90f73d774e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1738 microversion: 2.20 time: 0.525321 Oct 23 01:31:49.119458 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2420/4766] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:31:48 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1738 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:31:49.177375 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-756a61fd-5871-40d9-b952-a3b93be0187d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:49.179006 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-756a61fd-5871-40d9-b952-a3b93be0187d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 79444b51-581d-4748-8265-6433d1957885] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:49.190161 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-756a61fd-5871-40d9-b952-a3b93be0187d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:49.190975 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-756a61fd-5871-40d9-b952-a3b93be0187d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:49.195435 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-756a61fd-5871-40d9-b952-a3b93be0187d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:49.196556 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-756a61fd-5871-40d9-b952-a3b93be0187d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:49.197213 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-756a61fd-5871-40d9-b952-a3b93be0187d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:49.197806 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-756a61fd-5871-40d9-b952-a3b93be0187d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:49.367265 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-089d5668-ace0-4878-968a-9f5fddc7d7a1 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:49.379680 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-089d5668-ace0-4878-968a-9f5fddc7d7a1 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/f7ade4c5-7f11-4df8-9775-7e790e4e4435" status: 200 len: 1308 microversion: 2.1 time: 0.784561 Oct 23 01:31:49.396251 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2347/4767] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:48 2022] GET /compute/v2.1/servers/f7ade4c5-7f11-4df8-9775-7e790e4e4435 => generated 1308 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:49.671412 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-756a61fd-5871-40d9-b952-a3b93be0187d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:49.683909 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-756a61fd-5871-40d9-b952-a3b93be0187d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/79444b51-581d-4748-8265-6433d1957885" status: 200 len: 1314 microversion: 2.1 time: 0.510787 Oct 23 01:31:49.686803 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2421/4768] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:49 2022] GET /compute/v2.1/servers/79444b51-581d-4748-8265-6433d1957885 => generated 1314 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:50.150523 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-83ce83ef-495b-4822-8795-5449d9ab2f1c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:50.151554 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-83ce83ef-495b-4822-8795-5449d9ab2f1c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:50.166176 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83ce83ef-495b-4822-8795-5449d9ab2f1c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:50.167424 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83ce83ef-495b-4822-8795-5449d9ab2f1c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:50.169144 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83ce83ef-495b-4822-8795-5449d9ab2f1c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:50.172719 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83ce83ef-495b-4822-8795-5449d9ab2f1c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:50.173452 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83ce83ef-495b-4822-8795-5449d9ab2f1c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:50.192388 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83ce83ef-495b-4822-8795-5449d9ab2f1c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:50.407027 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-808e8cab-dcd9-4d60-a4a5-807189414555 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:50.408259 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-808e8cab-dcd9-4d60-a4a5-807189414555 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: f7ade4c5-7f11-4df8-9775-7e790e4e4435] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:50.422918 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-808e8cab-dcd9-4d60-a4a5-807189414555 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:50.424304 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-808e8cab-dcd9-4d60-a4a5-807189414555 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:50.424977 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-808e8cab-dcd9-4d60-a4a5-807189414555 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:50.425936 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-808e8cab-dcd9-4d60-a4a5-807189414555 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:50.430604 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-808e8cab-dcd9-4d60-a4a5-807189414555 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:50.431377 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-808e8cab-dcd9-4d60-a4a5-807189414555 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:50.934991 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-83ce83ef-495b-4822-8795-5449d9ab2f1c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:50.945890 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-83ce83ef-495b-4822-8795-5449d9ab2f1c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:50.948621 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-83ce83ef-495b-4822-8795-5449d9ab2f1c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:50.950247 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-83ce83ef-495b-4822-8795-5449d9ab2f1c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1738 microversion: 2.20 time: 0.804216 Oct 23 01:31:50.954644 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2348/4769] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:31:50 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1738 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:31:50.957203 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-76445c67-edd4-4546-8edb-cac3c1bbd01e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:50.958068 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-76445c67-edd4-4546-8edb-cac3c1bbd01e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 79444b51-581d-4748-8265-6433d1957885] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:50.966431 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-76445c67-edd4-4546-8edb-cac3c1bbd01e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:50.967103 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-76445c67-edd4-4546-8edb-cac3c1bbd01e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:50.967721 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-76445c67-edd4-4546-8edb-cac3c1bbd01e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:50.968579 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-76445c67-edd4-4546-8edb-cac3c1bbd01e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:50.969177 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-76445c67-edd4-4546-8edb-cac3c1bbd01e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:50.969774 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-76445c67-edd4-4546-8edb-cac3c1bbd01e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:51.167484 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-808e8cab-dcd9-4d60-a4a5-807189414555 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:51.172128 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-808e8cab-dcd9-4d60-a4a5-807189414555 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/f7ade4c5-7f11-4df8-9775-7e790e4e4435" status: 200 len: 1308 microversion: 2.1 time: 0.769505 Oct 23 01:31:51.190715 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2422/4770] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:50 2022] GET /compute/v2.1/servers/f7ade4c5-7f11-4df8-9775-7e790e4e4435 => generated 1308 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:51.560980 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-76445c67-edd4-4546-8edb-cac3c1bbd01e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:51.569150 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-76445c67-edd4-4546-8edb-cac3c1bbd01e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/79444b51-581d-4748-8265-6433d1957885" status: 200 len: 1314 microversion: 2.1 time: 0.616645 Oct 23 01:31:51.570250 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2349/4771] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:50 2022] GET /compute/v2.1/servers/79444b51-581d-4748-8265-6433d1957885 => generated 1314 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:51.980510 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-003ddb52-7549-4389-a040-dea49c082bc9 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:51.981214 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-003ddb52-7549-4389-a040-dea49c082bc9 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:51.989511 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-003ddb52-7549-4389-a040-dea49c082bc9 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:51.990955 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-003ddb52-7549-4389-a040-dea49c082bc9 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:51.991664 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-003ddb52-7549-4389-a040-dea49c082bc9 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:51.992784 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-003ddb52-7549-4389-a040-dea49c082bc9 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:51.993249 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-003ddb52-7549-4389-a040-dea49c082bc9 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:51.993683 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-003ddb52-7549-4389-a040-dea49c082bc9 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:52.121656 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-3897a8e8-ff8d-4287-aced-60f27ae39922 req-9a208c86-5bdd-4e84-9734-825ea2c0add0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79444b51-581d-4748-8265-6433d1957885", "name": "network-vif-plugged", "status": "completed", "tag": "82462d8a-4cc2-4dab-875c-00125a680025"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:31:52.135988 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-3897a8e8-ff8d-4287-aced-60f27ae39922 req-9a208c86-5bdd-4e84-9734-825ea2c0add0 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:52.138187 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-3897a8e8-ff8d-4287-aced-60f27ae39922 req-9a208c86-5bdd-4e84-9734-825ea2c0add0 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:52.138708 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-3897a8e8-ff8d-4287-aced-60f27ae39922 req-9a208c86-5bdd-4e84-9734-825ea2c0add0 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:52.227275 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-3897a8e8-ff8d-4287-aced-60f27ae39922 req-9a208c86-5bdd-4e84-9734-825ea2c0add0 service nova] Creating event network-vif-plugged:82462d8a-4cc2-4dab-875c-00125a680025 for instance 79444b51-581d-4748-8265-6433d1957885 on n-h2-master-1 Oct 23 01:31:52.248016 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-3897a8e8-ff8d-4287-aced-60f27ae39922 req-9a208c86-5bdd-4e84-9734-825ea2c0add0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132873 Oct 23 01:31:52.263887 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2350/4772] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:31:52.291638 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cf08d82c-8161-4e2d-bf66-5d2a9bbe10e4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:52.297829 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cf08d82c-8161-4e2d-bf66-5d2a9bbe10e4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: f7ade4c5-7f11-4df8-9775-7e790e4e4435] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:52.317886 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf08d82c-8161-4e2d-bf66-5d2a9bbe10e4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:52.318508 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf08d82c-8161-4e2d-bf66-5d2a9bbe10e4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:52.319118 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf08d82c-8161-4e2d-bf66-5d2a9bbe10e4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:52.319855 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf08d82c-8161-4e2d-bf66-5d2a9bbe10e4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:52.320320 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf08d82c-8161-4e2d-bf66-5d2a9bbe10e4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:52.320828 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf08d82c-8161-4e2d-bf66-5d2a9bbe10e4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:52.624329 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-003ddb52-7549-4389-a040-dea49c082bc9 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:52.639921 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-003ddb52-7549-4389-a040-dea49c082bc9 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:52.641917 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-003ddb52-7549-4389-a040-dea49c082bc9 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:52.647448 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-003ddb52-7549-4389-a040-dea49c082bc9 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1738 microversion: 2.20 time: 0.671609 Oct 23 01:31:52.650428 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2423/4773] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:31:51 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1738 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:31:52.663806 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-baf716f2-61c1-4975-88c3-291d7d9efd57 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:52.666473 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-baf716f2-61c1-4975-88c3-291d7d9efd57 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 79444b51-581d-4748-8265-6433d1957885] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:52.701305 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-baf716f2-61c1-4975-88c3-291d7d9efd57 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:52.703441 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-baf716f2-61c1-4975-88c3-291d7d9efd57 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:52.705624 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-baf716f2-61c1-4975-88c3-291d7d9efd57 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:52.710273 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-baf716f2-61c1-4975-88c3-291d7d9efd57 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:52.713332 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cf08d82c-8161-4e2d-bf66-5d2a9bbe10e4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:52.714613 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-baf716f2-61c1-4975-88c3-291d7d9efd57 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:52.716025 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-baf716f2-61c1-4975-88c3-291d7d9efd57 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:52.724311 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cf08d82c-8161-4e2d-bf66-5d2a9bbe10e4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/f7ade4c5-7f11-4df8-9775-7e790e4e4435" status: 200 len: 1308 microversion: 2.1 time: 0.459080 Oct 23 01:31:52.724917 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2351/4774] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:52 2022] GET /compute/v2.1/servers/f7ade4c5-7f11-4df8-9775-7e790e4e4435 => generated 1308 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:53.086349 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a198c10a-2c4a-41ba-82b4-e8dc36037ed0 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Action: 'create', calling method: .version_select at 0x7f5cc20b5ca0>, body: {"keypair": {"name": "tempest-keypair-769654282", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAd52gpqaa+odxpFy7tMbmteocEfMm0ChkJnMRrT58r/+NgSgO4CGuOgpiN+/m9/d0PGNApnJIN5YdGtA9Rv2QgbwhXZxURTpT+SaSGrwJLRBZ8XdwzkC4wpEwlLX5/B0w=="}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:31:53.136467 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-a198c10a-2c4a-41ba-82b4-e8dc36037ed0 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Getting quotas for project 6edb27d1224244809ecbb55ac953c645. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:31:53.143917 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-a198c10a-2c4a-41ba-82b4-e8dc36037ed0 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Getting quotas for user 0c65e7ab0b544d9ebdac8bc2129d051a and project 6edb27d1224244809ecbb55ac953c645. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:31:53.159548 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-baf716f2-61c1-4975-88c3-291d7d9efd57 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:53.163358 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=100 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:31:53.168403 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-baf716f2-61c1-4975-88c3-291d7d9efd57 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/79444b51-581d-4748-8265-6433d1957885" status: 200 len: 1314 microversion: 2.1 time: 0.515243 Oct 23 01:31:53.178863 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2424/4775] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:52 2022] GET /compute/v2.1/servers/79444b51-581d-4748-8265-6433d1957885 => generated 1314 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:53.316169 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a198c10a-2c4a-41ba-82b4-e8dc36037ed0 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.230922 Oct 23 01:31:53.316169 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2352/4776] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 01:31:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:31:53.682760 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8ccdd4e6-e0ea-4345-9d86-62422b01b827 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:53.683384 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8ccdd4e6-e0ea-4345-9d86-62422b01b827 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:53.699974 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ccdd4e6-e0ea-4345-9d86-62422b01b827 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:53.704366 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ccdd4e6-e0ea-4345-9d86-62422b01b827 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:53.704366 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ccdd4e6-e0ea-4345-9d86-62422b01b827 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:53.704366 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ccdd4e6-e0ea-4345-9d86-62422b01b827 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:53.704366 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ccdd4e6-e0ea-4345-9d86-62422b01b827 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:53.704366 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ccdd4e6-e0ea-4345-9d86-62422b01b827 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:53.753855 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b68a8f99-d440-41e0-8841-a9336d4f4d14 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:53.754657 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b68a8f99-d440-41e0-8841-a9336d4f4d14 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: f7ade4c5-7f11-4df8-9775-7e790e4e4435] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:53.783427 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b68a8f99-d440-41e0-8841-a9336d4f4d14 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:53.786772 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b68a8f99-d440-41e0-8841-a9336d4f4d14 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:53.791120 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b68a8f99-d440-41e0-8841-a9336d4f4d14 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:53.791120 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b68a8f99-d440-41e0-8841-a9336d4f4d14 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:53.791120 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b68a8f99-d440-41e0-8841-a9336d4f4d14 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:53.792028 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b68a8f99-d440-41e0-8841-a9336d4f4d14 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:54.334866 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8ccdd4e6-e0ea-4345-9d86-62422b01b827 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:54.349455 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8ccdd4e6-e0ea-4345-9d86-62422b01b827 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:54.350926 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8ccdd4e6-e0ea-4345-9d86-62422b01b827 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:54.352406 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8ccdd4e6-e0ea-4345-9d86-62422b01b827 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1738 microversion: 2.20 time: 0.674081 Oct 23 01:31:54.359656 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2425/4777] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:31:53 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1738 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:31:54.364725 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-581bba90-75ea-41db-9bef-870e2e1e454a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:54.365527 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-581bba90-75ea-41db-9bef-870e2e1e454a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 79444b51-581d-4748-8265-6433d1957885] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:54.379596 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-581bba90-75ea-41db-9bef-870e2e1e454a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:54.380107 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-581bba90-75ea-41db-9bef-870e2e1e454a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:54.380553 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-581bba90-75ea-41db-9bef-870e2e1e454a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:54.381262 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-581bba90-75ea-41db-9bef-870e2e1e454a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:54.381722 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-581bba90-75ea-41db-9bef-870e2e1e454a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:54.382199 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-581bba90-75ea-41db-9bef-870e2e1e454a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:54.520778 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b68a8f99-d440-41e0-8841-a9336d4f4d14 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:54.533965 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b68a8f99-d440-41e0-8841-a9336d4f4d14 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/f7ade4c5-7f11-4df8-9775-7e790e4e4435" status: 200 len: 1308 microversion: 2.1 time: 0.785221 Oct 23 01:31:54.547417 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2353/4778] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:53 2022] GET /compute/v2.1/servers/f7ade4c5-7f11-4df8-9775-7e790e4e4435 => generated 1308 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:54.719144 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-581bba90-75ea-41db-9bef-870e2e1e454a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:54.750274 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-581bba90-75ea-41db-9bef-870e2e1e454a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/79444b51-581d-4748-8265-6433d1957885" status: 200 len: 1314 microversion: 2.1 time: 0.389133 Oct 23 01:31:54.755736 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2426/4779] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:54 2022] GET /compute/v2.1/servers/79444b51-581d-4748-8265-6433d1957885 => generated 1314 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:55.385096 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-31bf9d6c-eeab-4cde-8361-32d9b7eb9810 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:55.385724 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-31bf9d6c-eeab-4cde-8361-32d9b7eb9810 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:55.413335 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-31bf9d6c-eeab-4cde-8361-32d9b7eb9810 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:55.424718 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-31bf9d6c-eeab-4cde-8361-32d9b7eb9810 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:55.425134 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-31bf9d6c-eeab-4cde-8361-32d9b7eb9810 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:55.429692 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-31bf9d6c-eeab-4cde-8361-32d9b7eb9810 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:55.430378 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-31bf9d6c-eeab-4cde-8361-32d9b7eb9810 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:55.433721 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-31bf9d6c-eeab-4cde-8361-32d9b7eb9810 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:55.565706 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5b2e6026-5ab9-41cd-9848-e777e2e8e636 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:55.568865 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5b2e6026-5ab9-41cd-9848-e777e2e8e636 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: f7ade4c5-7f11-4df8-9775-7e790e4e4435] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:55.587587 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b2e6026-5ab9-41cd-9848-e777e2e8e636 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:55.592086 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b2e6026-5ab9-41cd-9848-e777e2e8e636 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:55.594703 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b2e6026-5ab9-41cd-9848-e777e2e8e636 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:55.594703 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b2e6026-5ab9-41cd-9848-e777e2e8e636 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:55.594703 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b2e6026-5ab9-41cd-9848-e777e2e8e636 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:55.594703 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b2e6026-5ab9-41cd-9848-e777e2e8e636 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:56.011125 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-31bf9d6c-eeab-4cde-8361-32d9b7eb9810 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:56.016155 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5b2e6026-5ab9-41cd-9848-e777e2e8e636 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:56.024711 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5b2e6026-5ab9-41cd-9848-e777e2e8e636 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/f7ade4c5-7f11-4df8-9775-7e790e4e4435" status: 200 len: 1308 microversion: 2.1 time: 0.463401 Oct 23 01:31:56.025305 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2427/4780] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:55 2022] GET /compute/v2.1/servers/f7ade4c5-7f11-4df8-9775-7e790e4e4435 => generated 1308 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:31:56.034556 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-31bf9d6c-eeab-4cde-8361-32d9b7eb9810 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:56.037959 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-31bf9d6c-eeab-4cde-8361-32d9b7eb9810 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:56.046420 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4b78e501-a43c-4012-a3e3-5c22c9eea6a2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:56.047541 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4b78e501-a43c-4012-a3e3-5c22c9eea6a2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 79444b51-581d-4748-8265-6433d1957885] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:56.055170 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4b78e501-a43c-4012-a3e3-5c22c9eea6a2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:56.059629 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-31bf9d6c-eeab-4cde-8361-32d9b7eb9810 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1738 microversion: 2.20 time: 0.678277 Oct 23 01:31:56.060406 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4b78e501-a43c-4012-a3e3-5c22c9eea6a2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:56.061007 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4b78e501-a43c-4012-a3e3-5c22c9eea6a2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:56.061623 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4b78e501-a43c-4012-a3e3-5c22c9eea6a2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:56.062139 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4b78e501-a43c-4012-a3e3-5c22c9eea6a2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:56.062572 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4b78e501-a43c-4012-a3e3-5c22c9eea6a2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:56.066207 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2354/4781] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:31:55 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1738 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:31:56.434381 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4b78e501-a43c-4012-a3e3-5c22c9eea6a2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:56.445469 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4b78e501-a43c-4012-a3e3-5c22c9eea6a2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/79444b51-581d-4748-8265-6433d1957885" status: 200 len: 1502 microversion: 2.1 time: 0.413753 Oct 23 01:31:56.449195 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2428/4782] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:56 2022] GET /compute/v2.1/servers/79444b51-581d-4748-8265-6433d1957885 => generated 1502 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:56.485884 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-48783960-2398-4323-9a5b-f1a64e25ef5e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:56.485884 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-48783960-2398-4323-9a5b-f1a64e25ef5e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 79444b51-581d-4748-8265-6433d1957885] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:56.495357 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-48783960-2398-4323-9a5b-f1a64e25ef5e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:56.495856 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-48783960-2398-4323-9a5b-f1a64e25ef5e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:56.497025 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-48783960-2398-4323-9a5b-f1a64e25ef5e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:56.497794 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-48783960-2398-4323-9a5b-f1a64e25ef5e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:56.498298 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-48783960-2398-4323-9a5b-f1a64e25ef5e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:56.504415 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-48783960-2398-4323-9a5b-f1a64e25ef5e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:56.527074 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4c86da22-f957-4334-81e9-4b121d27ea81 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Action: 'create', calling method: .version_select at 0x7f5cc20b5700>, body: {"keypair": {"name": "tempest-keypair-994693373", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmGrxeM7P5dxHQC1GAy3Ui6ZGEE+1kWoZPAzTMpaLLNU0rSE8JaLmPsNRDzW7s9DUgSbc7MeJ8xBIrjpeo8G5RzBSln7Yi9jRWgw6/Toq8Gx+O2iBEJDlAbpNXxmxyvAw=="}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:31:56.549626 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-48783960-2398-4323-9a5b-f1a64e25ef5e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 79444b51-581d-4748-8265-6433d1957885] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:31:56.572020 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-4c86da22-f957-4334-81e9-4b121d27ea81 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Getting quotas for project 3b051b0da0ab45ffa64c7b8b32465a20. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:31:56.589651 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-4c86da22-f957-4334-81e9-4b121d27ea81 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Getting quotas for user 96d3d3c6a02244888eebb6e70eaac4ee and project 3b051b0da0ab45ffa64c7b8b32465a20. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:31:56.789940 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4c86da22-f957-4334-81e9-4b121d27ea81 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.722324 Oct 23 01:31:56.799285 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2355/4783] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 01:31:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:31:56.929466 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-29a5cc9b-adac-43db-a72c-7f9ac8196b75 req-3800e562-e4c0-4d3a-bb6a-030c21ab78d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7ade4c5-7f11-4df8-9775-7e790e4e4435", "name": "network-vif-plugged", "status": "completed", "tag": "1d8a3331-8eb4-4bdd-9aef-8f6329fafd67"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:31:56.941124 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-48783960-2398-4323-9a5b-f1a64e25ef5e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "DELETE /compute/v2.1/servers/79444b51-581d-4748-8265-6433d1957885" status: 204 len: 0 microversion: 2.1 time: 0.465396 Oct 23 01:31:56.942444 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2429/4784] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:31:56 2022] DELETE /compute/v2.1/servers/79444b51-581d-4748-8265-6433d1957885 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 23 01:31:56.951259 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-66098883-39c5-495a-9b39-301067f02315 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:56.955787 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-66098883-39c5-495a-9b39-301067f02315 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 79444b51-581d-4748-8265-6433d1957885] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:56.955940 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-29a5cc9b-adac-43db-a72c-7f9ac8196b75 req-3800e562-e4c0-4d3a-bb6a-030c21ab78d2 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:56.955940 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-29a5cc9b-adac-43db-a72c-7f9ac8196b75 req-3800e562-e4c0-4d3a-bb6a-030c21ab78d2 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:56.955940 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-29a5cc9b-adac-43db-a72c-7f9ac8196b75 req-3800e562-e4c0-4d3a-bb6a-030c21ab78d2 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:56.966127 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-66098883-39c5-495a-9b39-301067f02315 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:56.966634 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-66098883-39c5-495a-9b39-301067f02315 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:56.967362 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-66098883-39c5-495a-9b39-301067f02315 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:56.968092 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-66098883-39c5-495a-9b39-301067f02315 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:56.974912 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-66098883-39c5-495a-9b39-301067f02315 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:56.976124 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-66098883-39c5-495a-9b39-301067f02315 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:56.990090 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-29a5cc9b-adac-43db-a72c-7f9ac8196b75 req-3800e562-e4c0-4d3a-bb6a-030c21ab78d2 service nova] Creating event network-vif-plugged:1d8a3331-8eb4-4bdd-9aef-8f6329fafd67 for instance f7ade4c5-7f11-4df8-9775-7e790e4e4435 on n-h2-master-1 Oct 23 01:31:57.001032 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-29a5cc9b-adac-43db-a72c-7f9ac8196b75 req-3800e562-e4c0-4d3a-bb6a-030c21ab78d2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075650 Oct 23 01:31:57.004640 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2356/4785] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:31:57.048805 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-77a3a010-8e4a-4e4c-a8d2-1279705b6bd3 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:57.049591 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-77a3a010-8e4a-4e4c-a8d2-1279705b6bd3 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: f7ade4c5-7f11-4df8-9775-7e790e4e4435] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:57.061184 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-77a3a010-8e4a-4e4c-a8d2-1279705b6bd3 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:57.061757 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-77a3a010-8e4a-4e4c-a8d2-1279705b6bd3 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:57.062548 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-77a3a010-8e4a-4e4c-a8d2-1279705b6bd3 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:57.065483 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-77a3a010-8e4a-4e4c-a8d2-1279705b6bd3 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:57.066329 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-77a3a010-8e4a-4e4c-a8d2-1279705b6bd3 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:57.070167 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-77a3a010-8e4a-4e4c-a8d2-1279705b6bd3 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:57.818183 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-77a3a010-8e4a-4e4c-a8d2-1279705b6bd3 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:57.828671 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-77a3a010-8e4a-4e4c-a8d2-1279705b6bd3 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/f7ade4c5-7f11-4df8-9775-7e790e4e4435" status: 200 len: 1308 microversion: 2.1 time: 0.784015 Oct 23 01:31:57.836048 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2357/4786] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:57 2022] GET /compute/v2.1/servers/f7ade4c5-7f11-4df8-9775-7e790e4e4435 => generated 1308 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:57.845528 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-81606c7e-58e2-4823-a3af-7d75f328358e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:57.846464 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-81606c7e-58e2-4823-a3af-7d75f328358e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:57.855409 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-81606c7e-58e2-4823-a3af-7d75f328358e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:57.859676 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-81606c7e-58e2-4823-a3af-7d75f328358e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:57.863756 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-81606c7e-58e2-4823-a3af-7d75f328358e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:57.868533 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-81606c7e-58e2-4823-a3af-7d75f328358e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:57.870215 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-81606c7e-58e2-4823-a3af-7d75f328358e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:57.871360 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-81606c7e-58e2-4823-a3af-7d75f328358e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:57.941437 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-66098883-39c5-495a-9b39-301067f02315 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:57.958828 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-66098883-39c5-495a-9b39-301067f02315 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/79444b51-581d-4748-8265-6433d1957885" status: 200 len: 1508 microversion: 2.1 time: 1.011727 Oct 23 01:31:57.959437 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2430/4787] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:56 2022] GET /compute/v2.1/servers/79444b51-581d-4748-8265-6433d1957885 => generated 1508 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:31:58.370684 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-81606c7e-58e2-4823-a3af-7d75f328358e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:58.400517 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-81606c7e-58e2-4823-a3af-7d75f328358e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:58.410261 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-81606c7e-58e2-4823-a3af-7d75f328358e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:58.411770 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-81606c7e-58e2-4823-a3af-7d75f328358e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1738 microversion: 2.20 time: 0.574187 Oct 23 01:31:58.414083 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2358/4788] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:31:57 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1738 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:31:58.865129 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c9575828-92f5-4753-87d4-04ee3de1956c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:58.874270 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c9575828-92f5-4753-87d4-04ee3de1956c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: f7ade4c5-7f11-4df8-9775-7e790e4e4435] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:58.886781 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c9575828-92f5-4753-87d4-04ee3de1956c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:58.890098 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c9575828-92f5-4753-87d4-04ee3de1956c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:58.890586 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c9575828-92f5-4753-87d4-04ee3de1956c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:58.891344 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c9575828-92f5-4753-87d4-04ee3de1956c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:58.891819 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c9575828-92f5-4753-87d4-04ee3de1956c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:58.911027 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c9575828-92f5-4753-87d4-04ee3de1956c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:58.983518 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ebc865df-c041-473d-88fe-bebc317ba2ca tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:58.984189 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ebc865df-c041-473d-88fe-bebc317ba2ca tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 79444b51-581d-4748-8265-6433d1957885] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:58.996458 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ebc865df-c041-473d-88fe-bebc317ba2ca tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:58.996991 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ebc865df-c041-473d-88fe-bebc317ba2ca tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:58.997439 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ebc865df-c041-473d-88fe-bebc317ba2ca tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:59.008859 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ebc865df-c041-473d-88fe-bebc317ba2ca tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:59.009749 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ebc865df-c041-473d-88fe-bebc317ba2ca tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:59.010460 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ebc865df-c041-473d-88fe-bebc317ba2ca tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:59.448198 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c9575828-92f5-4753-87d4-04ee3de1956c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:59.465828 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ebc865df-c041-473d-88fe-bebc317ba2ca tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:31:59.474461 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ebc865df-c041-473d-88fe-bebc317ba2ca tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/79444b51-581d-4748-8265-6433d1957885" status: 200 len: 1508 microversion: 2.1 time: 0.495092 Oct 23 01:31:59.475052 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2359/4789] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:58 2022] GET /compute/v2.1/servers/79444b51-581d-4748-8265-6433d1957885 => generated 1508 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:59.480186 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c9575828-92f5-4753-87d4-04ee3de1956c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/f7ade4c5-7f11-4df8-9775-7e790e4e4435" status: 200 len: 1308 microversion: 2.1 time: 0.621076 Oct 23 01:31:59.490676 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2431/4790] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:31:58 2022] GET /compute/v2.1/servers/f7ade4c5-7f11-4df8-9775-7e790e4e4435 => generated 1308 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:31:59.497448 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cc3dfba7-fafa-43a9-a93b-820c9d44b885 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1907846342", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e9d65ec9-a091-4c05-b838-8a651ac0b337"}], "security_groups": [{"name": "tempest-securitygroup--1529201262"}], "key_name": "tempest-keypair-769654282", "user_data": "}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:31:59.504571 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b257c92f-6a80-40a7-9579-cc1720658a0e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:31:59.505413 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b257c92f-6a80-40a7-9579-cc1720658a0e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:31:59.520117 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b257c92f-6a80-40a7-9579-cc1720658a0e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:59.520620 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b257c92f-6a80-40a7-9579-cc1720658a0e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:59.521066 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b257c92f-6a80-40a7-9579-cc1720658a0e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:59.521788 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b257c92f-6a80-40a7-9579-cc1720658a0e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:31:59.522889 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b257c92f-6a80-40a7-9579-cc1720658a0e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:31:59.525768 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b257c92f-6a80-40a7-9579-cc1720658a0e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:31:59.863714 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-cc3dfba7-fafa-43a9-a93b-820c9d44b885 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] validate_networks() for [('e9d65ec9-a091-4c05-b838-8a651ac0b337', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:32:00.176669 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b257c92f-6a80-40a7-9579-cc1720658a0e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:00.193848 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b257c92f-6a80-40a7-9579-cc1720658a0e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:00.198990 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b257c92f-6a80-40a7-9579-cc1720658a0e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:00.202961 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b257c92f-6a80-40a7-9579-cc1720658a0e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1738 microversion: 2.20 time: 0.710315 Oct 23 01:32:00.203546 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2432/4791] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:31:59 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1738 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:32:00.433132 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-2b0f1d7b-fb9d-4327-9263-0474de6bfc48 req-e1c539c4-dcaf-4cd0-9a7c-acb7bff25336 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79444b51-581d-4748-8265-6433d1957885", "name": "network-vif-deleted", "tag": "82462d8a-4cc2-4dab-875c-00125a680025"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:32:00.451922 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-2b0f1d7b-fb9d-4327-9263-0474de6bfc48 req-e1c539c4-dcaf-4cd0-9a7c-acb7bff25336 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:00.463816 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-2b0f1d7b-fb9d-4327-9263-0474de6bfc48 req-e1c539c4-dcaf-4cd0-9a7c-acb7bff25336 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:00.463816 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-2b0f1d7b-fb9d-4327-9263-0474de6bfc48 req-e1c539c4-dcaf-4cd0-9a7c-acb7bff25336 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:00.487217 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-2b0f1d7b-fb9d-4327-9263-0474de6bfc48 req-e1c539c4-dcaf-4cd0-9a7c-acb7bff25336 service nova] Creating event network-vif-deleted:82462d8a-4cc2-4dab-875c-00125a680025 for instance 79444b51-581d-4748-8265-6433d1957885 on n-h2-master-1 Oct 23 01:32:00.497787 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-2b0f1d7b-fb9d-4327-9263-0474de6bfc48 req-e1c539c4-dcaf-4cd0-9a7c-acb7bff25336 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067668 Oct 23 01:32:00.499158 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2433/4792] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:32:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:32:00.508846 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5ad16f29-d62e-4fd2-8042-dc5d9754742e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:00.511722 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5ad16f29-d62e-4fd2-8042-dc5d9754742e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 79444b51-581d-4748-8265-6433d1957885] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:00.522649 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5ad16f29-d62e-4fd2-8042-dc5d9754742e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:00.524206 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5ad16f29-d62e-4fd2-8042-dc5d9754742e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:00.525652 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5ad16f29-d62e-4fd2-8042-dc5d9754742e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:00.526676 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5ad16f29-d62e-4fd2-8042-dc5d9754742e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:00.527714 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5ad16f29-d62e-4fd2-8042-dc5d9754742e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:00.528434 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5ad16f29-d62e-4fd2-8042-dc5d9754742e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:00.733134 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5ad16f29-d62e-4fd2-8042-dc5d9754742e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:00.756801 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5ad16f29-d62e-4fd2-8042-dc5d9754742e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/79444b51-581d-4748-8265-6433d1957885" status: 200 len: 1466 microversion: 2.1 time: 0.247882 Oct 23 01:32:00.770073 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2434/4793] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:00 2022] GET /compute/v2.1/servers/79444b51-581d-4748-8265-6433d1957885 => generated 1466 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:00.781198 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7174ed13-95b1-4d3d-bea9-93c49c77c4a4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:00.781198 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7174ed13-95b1-4d3d-bea9-93c49c77c4a4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: f7ade4c5-7f11-4df8-9775-7e790e4e4435] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:00.796879 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7174ed13-95b1-4d3d-bea9-93c49c77c4a4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:00.797833 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7174ed13-95b1-4d3d-bea9-93c49c77c4a4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:00.799041 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7174ed13-95b1-4d3d-bea9-93c49c77c4a4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:00.801659 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7174ed13-95b1-4d3d-bea9-93c49c77c4a4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:00.803248 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7174ed13-95b1-4d3d-bea9-93c49c77c4a4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:00.807683 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7174ed13-95b1-4d3d-bea9-93c49c77c4a4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:01.510268 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7174ed13-95b1-4d3d-bea9-93c49c77c4a4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:01.521040 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-cc3dfba7-fafa-43a9-a93b-820c9d44b885 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:32:01.522357 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7174ed13-95b1-4d3d-bea9-93c49c77c4a4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/f7ade4c5-7f11-4df8-9775-7e790e4e4435" status: 200 len: 1488 microversion: 2.1 time: 0.762096 Oct 23 01:32:01.522590 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-cc3dfba7-fafa-43a9-a93b-820c9d44b885 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:32:01.523316 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-cc3dfba7-fafa-43a9-a93b-820c9d44b885 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:32:01.523764 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-cc3dfba7-fafa-43a9-a93b-820c9d44b885 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:32:01.524175 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-cc3dfba7-fafa-43a9-a93b-820c9d44b885 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:32:01.525038 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2435/4794] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:00 2022] GET /compute/v2.1/servers/f7ade4c5-7f11-4df8-9775-7e790e4e4435 => generated 1488 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:01.537922 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cc3dfba7-fafa-43a9-a93b-820c9d44b885 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:01.538579 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cc3dfba7-fafa-43a9-a93b-820c9d44b885 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:01.540189 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cc3dfba7-fafa-43a9-a93b-820c9d44b885 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:01.541163 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cc3dfba7-fafa-43a9-a93b-820c9d44b885 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:01.541781 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cc3dfba7-fafa-43a9-a93b-820c9d44b885 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:01.542398 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cc3dfba7-fafa-43a9-a93b-820c9d44b885 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:01.546028 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7f99ec4a-5a53-4157-b485-bec3f32ca628 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:01.546028 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7f99ec4a-5a53-4157-b485-bec3f32ca628 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:01.552351 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f99ec4a-5a53-4157-b485-bec3f32ca628 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:01.553146 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f99ec4a-5a53-4157-b485-bec3f32ca628 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:01.553827 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f99ec4a-5a53-4157-b485-bec3f32ca628 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:01.554765 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f99ec4a-5a53-4157-b485-bec3f32ca628 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:01.558706 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f99ec4a-5a53-4157-b485-bec3f32ca628 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:01.559636 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f99ec4a-5a53-4157-b485-bec3f32ca628 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:01.585058 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-cc3dfba7-fafa-43a9-a93b-820c9d44b885 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Getting quotas for project 6edb27d1224244809ecbb55ac953c645. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:32:01.591540 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-cc3dfba7-fafa-43a9-a93b-820c9d44b885 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Getting quotas for user 0c65e7ab0b544d9ebdac8bc2129d051a and project 6edb27d1224244809ecbb55ac953c645. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:32:01.605353 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cc3dfba7-fafa-43a9-a93b-820c9d44b885 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:32:01.608454 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cc3dfba7-fafa-43a9-a93b-820c9d44b885 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 78708eaa-2dad-44bc-a145-86dcc21ca804] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:32:01.886684 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cc3dfba7-fafa-43a9-a93b-820c9d44b885 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.393923 Oct 23 01:32:01.893988 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2360/4795] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:31:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 2412 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:32:01.893988 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-313b097a-c7f4-47ef-88b4-ba9be0e468ec tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-257176732", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "54c8030f-5807-4507-8aa3-283b114a73f4"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:32:01.990176 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-313b097a-c7f4-47ef-88b4-ba9be0e468ec tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] validate_networks() for [('54c8030f-5807-4507-8aa3-283b114a73f4', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:32:02.241571 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7f99ec4a-5a53-4157-b485-bec3f32ca628 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:02.251819 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7f99ec4a-5a53-4157-b485-bec3f32ca628 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:02.254123 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7f99ec4a-5a53-4157-b485-bec3f32ca628 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:02.254779 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7f99ec4a-5a53-4157-b485-bec3f32ca628 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1738 microversion: 2.20 time: 0.728548 Oct 23 01:32:02.255352 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2436/4796] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:32:01 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1738 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:32:02.261713 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0425768d-2d26-475a-9b0f-5489b605418d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:02.263016 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0425768d-2d26-475a-9b0f-5489b605418d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 79444b51-581d-4748-8265-6433d1957885] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:02.269254 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0425768d-2d26-475a-9b0f-5489b605418d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:02.269742 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0425768d-2d26-475a-9b0f-5489b605418d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:02.270209 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0425768d-2d26-475a-9b0f-5489b605418d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:02.271184 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0425768d-2d26-475a-9b0f-5489b605418d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:02.272236 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0425768d-2d26-475a-9b0f-5489b605418d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:02.272682 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0425768d-2d26-475a-9b0f-5489b605418d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:02.291725 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-0425768d-2d26-475a-9b0f-5489b605418d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] HTTP exception thrown: Instance 79444b51-581d-4748-8265-6433d1957885 could not be found. Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0425768d-2d26-475a-9b0f-5489b605418d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Request method failure captured: Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/79444b51-581d-4748-8265-6433d1957885 HTTP/1.1 Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJlvTfuM9-iirX2FXe8mkTy2eWW7UhgAXbnHf6lceGN18S7lbSlaINo5EbF9-Kmi1tphVBr2Fcj8S4BVPceiAUMjh1Az0xLOZc1N90Wz0wmSyINFoBFx331KJ40smzwK1ZOJLA4k7IFyzBj3SQlZplUyTac5KUYxpNFIDY-5Uus0ZuU Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 842dcab8b48c43d7963a538d914b0b22 Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-DeleteServersTestJSON-654775470 Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/842dcab8b48c43d7963a538d914b0b22"}]}] Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-DeleteServersTestJSON-654775470 Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 842dcab8b48c43d7963a538d914b0b22 Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-DeleteServersTestJSON-654775470 Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-DeleteServersTestJSON-654775470-project Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 634bed7898c24baca6ba00392d49eea1 Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-DeleteServersTestJSON-654775470-project Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 79444b51-581d-4748-8265-6433d1957885 could not be found. Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '79444b51-581d-4748-8265-6433d1957885'} Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79444b51-581d-4748-8265-6433d1957885 could not be found. Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79444b51-581d-4748-8265-6433d1957885 could not be found. Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:32:02.294449 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:32:02.301876 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:32:02.301876 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:32:02.301876 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:32:02.301876 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:32:02.301876 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:32:02.301876 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79444b51-581d-4748-8265-6433d1957885 could not be found. Oct 23 01:32:02.301876 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:32:02.315622 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0425768d-2d26-475a-9b0f-5489b605418d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Returning 404 to user: Instance 79444b51-581d-4748-8265-6433d1957885 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:32:02.322199 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0425768d-2d26-475a-9b0f-5489b605418d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/79444b51-581d-4748-8265-6433d1957885" status: 404 len: 111 microversion: 2.1 time: 0.065650 Oct 23 01:32:02.330222 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2437/4797] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:02 2022] GET /compute/v2.1/servers/79444b51-581d-4748-8265-6433d1957885 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:32:02.330222 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-29bc2c25-073a-4d8c-b8d6-11ffbe7ccd80 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:02.330222 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-29bc2c25-073a-4d8c-b8d6-11ffbe7ccd80 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 78708eaa-2dad-44bc-a145-86dcc21ca804] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:02.450959 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-29bc2c25-073a-4d8c-b8d6-11ffbe7ccd80 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:02.462121 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-29bc2c25-073a-4d8c-b8d6-11ffbe7ccd80 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/78708eaa-2dad-44bc-a145-86dcc21ca804" status: 200 len: 1241 microversion: 2.1 time: 0.135182 Oct 23 01:32:02.463400 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2438/4798] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:02 2022] GET /compute/v2.1/servers/78708eaa-2dad-44bc-a145-86dcc21ca804 => generated 1241 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:02.625261 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c6b9cddd-0f73-4108-87d5-658f23e4f8bc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-804209500", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "ba696604-5fcc-4b2d-9bf0-ca27f90a0725"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:32:02.708457 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-c6b9cddd-0f73-4108-87d5-658f23e4f8bc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] validate_networks() for [('ba696604-5fcc-4b2d-9bf0-ca27f90a0725', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:32:03.016556 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-313b097a-c7f4-47ef-88b4-ba9be0e468ec tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:32:03.018142 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-313b097a-c7f4-47ef-88b4-ba9be0e468ec tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:32:03.018878 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-313b097a-c7f4-47ef-88b4-ba9be0e468ec tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:32:03.019470 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-313b097a-c7f4-47ef-88b4-ba9be0e468ec tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:32:03.020071 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-313b097a-c7f4-47ef-88b4-ba9be0e468ec tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:32:03.034309 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-313b097a-c7f4-47ef-88b4-ba9be0e468ec tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:03.035706 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-313b097a-c7f4-47ef-88b4-ba9be0e468ec tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:03.036360 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-313b097a-c7f4-47ef-88b4-ba9be0e468ec tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:03.037521 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-313b097a-c7f4-47ef-88b4-ba9be0e468ec tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:03.038274 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-313b097a-c7f4-47ef-88b4-ba9be0e468ec tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:03.039021 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-313b097a-c7f4-47ef-88b4-ba9be0e468ec tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:03.056425 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:32:03.062809 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-313b097a-c7f4-47ef-88b4-ba9be0e468ec tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Getting quotas for project e2ee2ea8399e42a5a5cd0d0ddeb192b5. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:32:03.068597 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-313b097a-c7f4-47ef-88b4-ba9be0e468ec tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Getting quotas for user 77197152ea5040bab602d5381d21341a and project e2ee2ea8399e42a5a5cd0d0ddeb192b5. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:32:03.083831 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-313b097a-c7f4-47ef-88b4-ba9be0e468ec tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:32:03.086530 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-313b097a-c7f4-47ef-88b4-ba9be0e468ec tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: bbcf6b9d-5ae8-4241-82bf-53f7f7959760] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:32:03.278481 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-313b097a-c7f4-47ef-88b4-ba9be0e468ec tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.388881 Oct 23 01:32:03.279907 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2361/4799] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:32:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1391 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:32:03.288494 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-71cfb8ad-b716-4732-86f0-dd037b64e071 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2101339365", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "40fca5c9-c915-4a8b-ba5c-1dd2bf153266"}], "security_groups": [{"name": "tempest-securitygroup--810074690"}], "key_name": "tempest-keypair-994693373", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:32:03.492484 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-71cfb8ad-b716-4732-86f0-dd037b64e071 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] validate_networks() for [('40fca5c9-c915-4a8b-ba5c-1dd2bf153266', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:32:03.517831 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-c6b9cddd-0f73-4108-87d5-658f23e4f8bc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:32:03.518298 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-c6b9cddd-0f73-4108-87d5-658f23e4f8bc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:32:03.518814 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-c6b9cddd-0f73-4108-87d5-658f23e4f8bc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:32:03.519265 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-c6b9cddd-0f73-4108-87d5-658f23e4f8bc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:32:03.519692 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-c6b9cddd-0f73-4108-87d5-658f23e4f8bc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:32:03.544620 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c6b9cddd-0f73-4108-87d5-658f23e4f8bc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:03.545122 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c6b9cddd-0f73-4108-87d5-658f23e4f8bc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:03.545573 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c6b9cddd-0f73-4108-87d5-658f23e4f8bc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:03.546386 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c6b9cddd-0f73-4108-87d5-658f23e4f8bc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:03.546858 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c6b9cddd-0f73-4108-87d5-658f23e4f8bc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:03.547298 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c6b9cddd-0f73-4108-87d5-658f23e4f8bc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:03.571931 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-c6b9cddd-0f73-4108-87d5-658f23e4f8bc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Getting quotas for project 842dcab8b48c43d7963a538d914b0b22. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:32:03.578961 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-c6b9cddd-0f73-4108-87d5-658f23e4f8bc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Getting quotas for user 634bed7898c24baca6ba00392d49eea1 and project 842dcab8b48c43d7963a538d914b0b22. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:32:03.598366 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c6b9cddd-0f73-4108-87d5-658f23e4f8bc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:32:03.600742 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c6b9cddd-0f73-4108-87d5-658f23e4f8bc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 9f9af130-5a0c-46f9-8449-fa9021e48953] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:32:03.858665 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c6b9cddd-0f73-4108-87d5-658f23e4f8bc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.238342 Oct 23 01:32:03.859653 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2439/4800] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:32:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1240 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:32:03.864793 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fb86eb93-3daa-4a1a-a6dd-87dd911f354d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:03.870895 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fb86eb93-3daa-4a1a-a6dd-87dd911f354d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:03.883549 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb86eb93-3daa-4a1a-a6dd-87dd911f354d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:03.884054 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb86eb93-3daa-4a1a-a6dd-87dd911f354d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:03.884497 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb86eb93-3daa-4a1a-a6dd-87dd911f354d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:03.885215 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb86eb93-3daa-4a1a-a6dd-87dd911f354d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:03.885681 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb86eb93-3daa-4a1a-a6dd-87dd911f354d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:03.886145 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb86eb93-3daa-4a1a-a6dd-87dd911f354d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:04.156514 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-71cfb8ad-b716-4732-86f0-dd037b64e071 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Getting quotas for project 3b051b0da0ab45ffa64c7b8b32465a20. Resources: dict_keys(['metadata_items']) {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:32:04.164617 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-71cfb8ad-b716-4732-86f0-dd037b64e071 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Getting quotas for user 96d3d3c6a02244888eebb6e70eaac4ee and project 3b051b0da0ab45ffa64c7b8b32465a20. Resources: dict_keys(['metadata_items']) {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:32:04.171244 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fb86eb93-3daa-4a1a-a6dd-87dd911f354d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:04.179417 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-71cfb8ad-b716-4732-86f0-dd037b64e071 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:32:04.179629 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-71cfb8ad-b716-4732-86f0-dd037b64e071 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:32:04.180324 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-71cfb8ad-b716-4732-86f0-dd037b64e071 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:32:04.180737 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-71cfb8ad-b716-4732-86f0-dd037b64e071 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:32:04.181151 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-71cfb8ad-b716-4732-86f0-dd037b64e071 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:32:04.185015 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fb86eb93-3daa-4a1a-a6dd-87dd911f354d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:04.186535 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fb86eb93-3daa-4a1a-a6dd-87dd911f354d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:04.187929 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fb86eb93-3daa-4a1a-a6dd-87dd911f354d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1720 microversion: 2.20 time: 0.327096 Oct 23 01:32:04.188669 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2440/4801] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:32:03 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1720 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:32:04.190807 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-71cfb8ad-b716-4732-86f0-dd037b64e071 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:04.191355 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-71cfb8ad-b716-4732-86f0-dd037b64e071 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:04.217789 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-71cfb8ad-b716-4732-86f0-dd037b64e071 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:04.217789 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-71cfb8ad-b716-4732-86f0-dd037b64e071 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:04.217789 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-71cfb8ad-b716-4732-86f0-dd037b64e071 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:04.218129 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-33170952-cafe-4656-b0a1-63aed2e364b2 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:04.218246 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-71cfb8ad-b716-4732-86f0-dd037b64e071 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:04.218341 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-33170952-cafe-4656-b0a1-63aed2e364b2 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: bbcf6b9d-5ae8-4241-82bf-53f7f7959760] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:04.218429 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-71cfb8ad-b716-4732-86f0-dd037b64e071 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Getting quotas for project 3b051b0da0ab45ffa64c7b8b32465a20. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:32:04.218851 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-71cfb8ad-b716-4732-86f0-dd037b64e071 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Getting quotas for user 96d3d3c6a02244888eebb6e70eaac4ee and project 3b051b0da0ab45ffa64c7b8b32465a20. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:32:04.241309 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-71cfb8ad-b716-4732-86f0-dd037b64e071 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:32:04.244585 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-71cfb8ad-b716-4732-86f0-dd037b64e071 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] [instance: 7181fffe-8915-49c2-826a-0fa8040dc941] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:32:04.267530 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-33170952-cafe-4656-b0a1-63aed2e364b2 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:04.279851 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-33170952-cafe-4656-b0a1-63aed2e364b2 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/bbcf6b9d-5ae8-4241-82bf-53f7f7959760" status: 200 len: 1208 microversion: 2.1 time: 0.089816 Oct 23 01:32:04.280512 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2441/4802] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:04 2022] GET /compute/v2.1/servers/bbcf6b9d-5ae8-4241-82bf-53f7f7959760 => generated 1208 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:04.286109 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f99ce550-29f8-494e-bac9-c47eee1f409f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:04.288049 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f99ce550-29f8-494e-bac9-c47eee1f409f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 78708eaa-2dad-44bc-a145-86dcc21ca804] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:04.298507 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f99ce550-29f8-494e-bac9-c47eee1f409f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:04.299533 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f99ce550-29f8-494e-bac9-c47eee1f409f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:04.300048 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f99ce550-29f8-494e-bac9-c47eee1f409f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:04.301005 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f99ce550-29f8-494e-bac9-c47eee1f409f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:04.301923 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f99ce550-29f8-494e-bac9-c47eee1f409f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:04.302383 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f99ce550-29f8-494e-bac9-c47eee1f409f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:04.380650 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f99ce550-29f8-494e-bac9-c47eee1f409f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:04.390364 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f99ce550-29f8-494e-bac9-c47eee1f409f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/78708eaa-2dad-44bc-a145-86dcc21ca804" status: 200 len: 1293 microversion: 2.1 time: 0.108162 Oct 23 01:32:04.395211 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2442/4803] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:04 2022] GET /compute/v2.1/servers/78708eaa-2dad-44bc-a145-86dcc21ca804 => generated 1293 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:04.406456 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-71cfb8ad-b716-4732-86f0-dd037b64e071 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.124470 Oct 23 01:32:04.409533 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2362/4804] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:32:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 1129 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:32:04.425805 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cba7d34f-6673-4178-9f99-22b83f8fe083 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:04.427436 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cba7d34f-6673-4178-9f99-22b83f8fe083 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] [instance: 7181fffe-8915-49c2-826a-0fa8040dc941] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:04.431253 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-39fe12ed-f7c1-48ba-855f-4e0474236528 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:04.432019 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-39fe12ed-f7c1-48ba-855f-4e0474236528 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 9f9af130-5a0c-46f9-8449-fa9021e48953] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:04.533156 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-39fe12ed-f7c1-48ba-855f-4e0474236528 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:04.542868 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-39fe12ed-f7c1-48ba-855f-4e0474236528 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953" status: 200 len: 1214 microversion: 2.1 time: 0.141653 Oct 23 01:32:04.545142 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2443/4805] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:04 2022] GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953 => generated 1214 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:04.561213 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cba7d34f-6673-4178-9f99-22b83f8fe083 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3d3c6a02244888eebb6e70eaac4ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b051b0da0ab45ffa64c7b8b32465a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:04.568296 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cba7d34f-6673-4178-9f99-22b83f8fe083 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] 10.222.0.42 "GET /compute/v2.1/servers/7181fffe-8915-49c2-826a-0fa8040dc941" status: 200 len: 1269 microversion: 2.1 time: 0.147423 Oct 23 01:32:04.568877 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2363/4806] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:04 2022] GET /compute/v2.1/servers/7181fffe-8915-49c2-826a-0fa8040dc941 => generated 1269 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:32:05.234484 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-75207c6c-9395-4618-9ed8-dff5f418efa6 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:05.235155 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-75207c6c-9395-4618-9ed8-dff5f418efa6 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:05.257953 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-75207c6c-9395-4618-9ed8-dff5f418efa6 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:05.258829 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-75207c6c-9395-4618-9ed8-dff5f418efa6 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:05.259565 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-75207c6c-9395-4618-9ed8-dff5f418efa6 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:05.260532 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-75207c6c-9395-4618-9ed8-dff5f418efa6 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:05.261010 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-75207c6c-9395-4618-9ed8-dff5f418efa6 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:05.261515 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-75207c6c-9395-4618-9ed8-dff5f418efa6 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:05.305007 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cf5fd130-753c-4c5b-80b4-bbafea59ba7c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:05.305906 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cf5fd130-753c-4c5b-80b4-bbafea59ba7c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: bbcf6b9d-5ae8-4241-82bf-53f7f7959760] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:05.315450 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf5fd130-753c-4c5b-80b4-bbafea59ba7c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:05.316186 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf5fd130-753c-4c5b-80b4-bbafea59ba7c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:05.316766 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf5fd130-753c-4c5b-80b4-bbafea59ba7c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:05.317728 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf5fd130-753c-4c5b-80b4-bbafea59ba7c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:05.318203 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf5fd130-753c-4c5b-80b4-bbafea59ba7c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:05.318625 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf5fd130-753c-4c5b-80b4-bbafea59ba7c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:05.429847 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cf5fd130-753c-4c5b-80b4-bbafea59ba7c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:05.443504 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cf5fd130-753c-4c5b-80b4-bbafea59ba7c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/bbcf6b9d-5ae8-4241-82bf-53f7f7959760" status: 200 len: 1204 microversion: 2.1 time: 0.143162 Oct 23 01:32:05.445288 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2364/4807] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:05 2022] GET /compute/v2.1/servers/bbcf6b9d-5ae8-4241-82bf-53f7f7959760 => generated 1204 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:05.451454 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3b666936-08a5-42c7-a2b1-3bf0774161c8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:05.474331 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3b666936-08a5-42c7-a2b1-3bf0774161c8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 78708eaa-2dad-44bc-a145-86dcc21ca804] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:05.482674 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b666936-08a5-42c7-a2b1-3bf0774161c8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:05.483175 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b666936-08a5-42c7-a2b1-3bf0774161c8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:05.483616 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b666936-08a5-42c7-a2b1-3bf0774161c8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:05.486317 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b666936-08a5-42c7-a2b1-3bf0774161c8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:05.486838 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b666936-08a5-42c7-a2b1-3bf0774161c8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:05.487280 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b666936-08a5-42c7-a2b1-3bf0774161c8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:05.550955 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-75207c6c-9395-4618-9ed8-dff5f418efa6 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:05.555342 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:32:05.567141 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-75207c6c-9395-4618-9ed8-dff5f418efa6 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:05.568731 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-75207c6c-9395-4618-9ed8-dff5f418efa6 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:05.575482 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-75207c6c-9395-4618-9ed8-dff5f418efa6 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1720 microversion: 2.20 time: 0.346074 Oct 23 01:32:05.578465 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2444/4808] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:32:05 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1720 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:32:05.589123 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-04620914-fca0-4f54-82a2-b74e967f81b0 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:05.592032 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-04620914-fca0-4f54-82a2-b74e967f81b0 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 9f9af130-5a0c-46f9-8449-fa9021e48953] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:05.599755 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-04620914-fca0-4f54-82a2-b74e967f81b0 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:05.600393 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-04620914-fca0-4f54-82a2-b74e967f81b0 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:05.601197 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-04620914-fca0-4f54-82a2-b74e967f81b0 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:05.602506 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-04620914-fca0-4f54-82a2-b74e967f81b0 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:05.603195 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-04620914-fca0-4f54-82a2-b74e967f81b0 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:05.603819 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-04620914-fca0-4f54-82a2-b74e967f81b0 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:05.633171 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3b666936-08a5-42c7-a2b1-3bf0774161c8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:05.645339 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3b666936-08a5-42c7-a2b1-3bf0774161c8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/78708eaa-2dad-44bc-a145-86dcc21ca804" status: 200 len: 1311 microversion: 2.1 time: 0.197457 Oct 23 01:32:05.645339 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2365/4809] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:05 2022] GET /compute/v2.1/servers/78708eaa-2dad-44bc-a145-86dcc21ca804 => generated 1311 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:05.657218 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c8705848-931a-4184-aff2-615da072b7ed tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:05.659078 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c8705848-931a-4184-aff2-615da072b7ed tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] [instance: 7181fffe-8915-49c2-826a-0fa8040dc941] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:05.697403 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-04620914-fca0-4f54-82a2-b74e967f81b0 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:05.706926 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-04620914-fca0-4f54-82a2-b74e967f81b0 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953" status: 200 len: 1210 microversion: 2.1 time: 0.126036 Oct 23 01:32:05.717106 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2445/4810] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:05 2022] GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953 => generated 1210 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:05.796052 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c8705848-931a-4184-aff2-615da072b7ed tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3d3c6a02244888eebb6e70eaac4ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b051b0da0ab45ffa64c7b8b32465a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:05.805251 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c8705848-931a-4184-aff2-615da072b7ed tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] 10.222.0.42 "GET /compute/v2.1/servers/7181fffe-8915-49c2-826a-0fa8040dc941" status: 200 len: 1269 microversion: 2.1 time: 0.159579 Oct 23 01:32:05.810245 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2366/4811] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:05 2022] GET /compute/v2.1/servers/7181fffe-8915-49c2-826a-0fa8040dc941 => generated 1269 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:06.131424 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-e1dccb8c-bdb3-4755-9451-431f718dfdea req-426c22f0-dc27-4c7a-a04d-dfe0b17f7140 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1d0765d-d720-40d2-b168-058e013fab0a", "name": "network-vif-unplugged", "status": "completed", "tag": "9d275317-d5ad-4bae-8215-25b674a45c60"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:32:06.149162 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-e1dccb8c-bdb3-4755-9451-431f718dfdea req-426c22f0-dc27-4c7a-a04d-dfe0b17f7140 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:06.150104 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-e1dccb8c-bdb3-4755-9451-431f718dfdea req-426c22f0-dc27-4c7a-a04d-dfe0b17f7140 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:06.150717 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-e1dccb8c-bdb3-4755-9451-431f718dfdea req-426c22f0-dc27-4c7a-a04d-dfe0b17f7140 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:06.165356 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-e1dccb8c-bdb3-4755-9451-431f718dfdea req-426c22f0-dc27-4c7a-a04d-dfe0b17f7140 service nova] Creating event network-vif-unplugged:9d275317-d5ad-4bae-8215-25b674a45c60 for instance b1d0765d-d720-40d2-b168-058e013fab0a on n-h2-master-1 Oct 23 01:32:06.173192 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-e1dccb8c-bdb3-4755-9451-431f718dfdea req-426c22f0-dc27-4c7a-a04d-dfe0b17f7140 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045579 Oct 23 01:32:06.175151 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2446/4812] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:32:06.478656 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-26a88121-da7d-48d0-9024-ff08a0e4b577 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:06.479295 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-26a88121-da7d-48d0-9024-ff08a0e4b577 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: bbcf6b9d-5ae8-4241-82bf-53f7f7959760] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:06.504875 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-26a88121-da7d-48d0-9024-ff08a0e4b577 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:06.505391 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-26a88121-da7d-48d0-9024-ff08a0e4b577 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:06.505853 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-26a88121-da7d-48d0-9024-ff08a0e4b577 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:06.506603 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-26a88121-da7d-48d0-9024-ff08a0e4b577 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:06.507064 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-26a88121-da7d-48d0-9024-ff08a0e4b577 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:06.507530 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-26a88121-da7d-48d0-9024-ff08a0e4b577 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:06.607242 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a5828262-f830-44b5-80c4-5b0d1a47b714 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:06.608142 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a5828262-f830-44b5-80c4-5b0d1a47b714 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:06.626162 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5828262-f830-44b5-80c4-5b0d1a47b714 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:06.627493 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5828262-f830-44b5-80c4-5b0d1a47b714 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:06.628311 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5828262-f830-44b5-80c4-5b0d1a47b714 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:06.629881 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5828262-f830-44b5-80c4-5b0d1a47b714 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:06.631550 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5828262-f830-44b5-80c4-5b0d1a47b714 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:06.632233 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5828262-f830-44b5-80c4-5b0d1a47b714 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:06.648837 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-26a88121-da7d-48d0-9024-ff08a0e4b577 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:06.684803 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-26a88121-da7d-48d0-9024-ff08a0e4b577 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/bbcf6b9d-5ae8-4241-82bf-53f7f7959760" status: 200 len: 1260 microversion: 2.1 time: 0.212752 Oct 23 01:32:06.689348 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2367/4813] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:06 2022] GET /compute/v2.1/servers/bbcf6b9d-5ae8-4241-82bf-53f7f7959760 => generated 1260 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:06.706157 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2ebe89a7-b5a8-47d3-bc5c-963934d8be46 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:06.706799 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2ebe89a7-b5a8-47d3-bc5c-963934d8be46 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 78708eaa-2dad-44bc-a145-86dcc21ca804] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:06.733442 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2ebe89a7-b5a8-47d3-bc5c-963934d8be46 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:06.734005 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2ebe89a7-b5a8-47d3-bc5c-963934d8be46 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:06.734462 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2ebe89a7-b5a8-47d3-bc5c-963934d8be46 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:06.735191 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2ebe89a7-b5a8-47d3-bc5c-963934d8be46 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:06.735652 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2ebe89a7-b5a8-47d3-bc5c-963934d8be46 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:06.736087 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2ebe89a7-b5a8-47d3-bc5c-963934d8be46 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:07.174436 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a5828262-f830-44b5-80c4-5b0d1a47b714 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:07.182932 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a5828262-f830-44b5-80c4-5b0d1a47b714 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:07.187780 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a5828262-f830-44b5-80c4-5b0d1a47b714 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:07.190739 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a5828262-f830-44b5-80c4-5b0d1a47b714 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1723 microversion: 2.20 time: 0.589499 Oct 23 01:32:07.194738 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2447/4814] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:32:06 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1723 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:32:07.206018 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-23869e0d-11c7-44e2-8242-b197b80e14a7 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:07.206955 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-23869e0d-11c7-44e2-8242-b197b80e14a7 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 9f9af130-5a0c-46f9-8449-fa9021e48953] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:07.219707 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-23869e0d-11c7-44e2-8242-b197b80e14a7 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:07.220210 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-23869e0d-11c7-44e2-8242-b197b80e14a7 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:07.225067 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-23869e0d-11c7-44e2-8242-b197b80e14a7 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:07.226007 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-23869e0d-11c7-44e2-8242-b197b80e14a7 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:07.226644 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-23869e0d-11c7-44e2-8242-b197b80e14a7 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:07.227230 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-23869e0d-11c7-44e2-8242-b197b80e14a7 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:07.228205 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2ebe89a7-b5a8-47d3-bc5c-963934d8be46 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:07.247101 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2ebe89a7-b5a8-47d3-bc5c-963934d8be46 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/78708eaa-2dad-44bc-a145-86dcc21ca804" status: 200 len: 1367 microversion: 2.1 time: 0.552066 Oct 23 01:32:07.255016 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2368/4815] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:06 2022] GET /compute/v2.1/servers/78708eaa-2dad-44bc-a145-86dcc21ca804 => generated 1367 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:07.271811 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-78c51b85-bcff-4e17-aacb-d617a17016b8 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:07.272675 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-78c51b85-bcff-4e17-aacb-d617a17016b8 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] [instance: 7181fffe-8915-49c2-826a-0fa8040dc941] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:07.280432 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78c51b85-bcff-4e17-aacb-d617a17016b8 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:07.281277 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78c51b85-bcff-4e17-aacb-d617a17016b8 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:07.282093 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78c51b85-bcff-4e17-aacb-d617a17016b8 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:07.283327 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78c51b85-bcff-4e17-aacb-d617a17016b8 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:07.284789 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78c51b85-bcff-4e17-aacb-d617a17016b8 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:07.285404 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78c51b85-bcff-4e17-aacb-d617a17016b8 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:07.303453 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-23869e0d-11c7-44e2-8242-b197b80e14a7 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:07.312381 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-23869e0d-11c7-44e2-8242-b197b80e14a7 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953" status: 200 len: 1266 microversion: 2.1 time: 0.116271 Oct 23 01:32:07.313164 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2448/4816] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:07 2022] GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953 => generated 1266 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:07.318992 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-025aeddf-7fb4-406e-9ba7-f0dd304a9e80 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "53569bef-3400-4fb4-b40e-5cc1cc85503b"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:32:07.321516 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-025aeddf-7fb4-406e-9ba7-f0dd304a9e80 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:07.341011 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-025aeddf-7fb4-406e-9ba7-f0dd304a9e80 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:07.341623 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-025aeddf-7fb4-406e-9ba7-f0dd304a9e80 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:07.342104 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-025aeddf-7fb4-406e-9ba7-f0dd304a9e80 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:07.342988 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-025aeddf-7fb4-406e-9ba7-f0dd304a9e80 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:07.343589 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-025aeddf-7fb4-406e-9ba7-f0dd304a9e80 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:07.344172 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-025aeddf-7fb4-406e-9ba7-f0dd304a9e80 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:07.459765 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-78c51b85-bcff-4e17-aacb-d617a17016b8 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3d3c6a02244888eebb6e70eaac4ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b051b0da0ab45ffa64c7b8b32465a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:07.459765 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-78c51b85-bcff-4e17-aacb-d617a17016b8 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] 10.222.0.42 "GET /compute/v2.1/servers/7181fffe-8915-49c2-826a-0fa8040dc941" status: 200 len: 1321 microversion: 2.1 time: 0.181641 Oct 23 01:32:07.459765 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2369/4817] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:07 2022] GET /compute/v2.1/servers/7181fffe-8915-49c2-826a-0fa8040dc941 => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:07.711293 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-30669257-d1fa-4f8c-bfa0-ccb5ca5bef33 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:07.712313 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-30669257-d1fa-4f8c-bfa0-ccb5ca5bef33 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: bbcf6b9d-5ae8-4241-82bf-53f7f7959760] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:07.726289 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-30669257-d1fa-4f8c-bfa0-ccb5ca5bef33 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:07.726835 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-30669257-d1fa-4f8c-bfa0-ccb5ca5bef33 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:07.727279 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-30669257-d1fa-4f8c-bfa0-ccb5ca5bef33 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:07.728023 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-30669257-d1fa-4f8c-bfa0-ccb5ca5bef33 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:07.728484 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-30669257-d1fa-4f8c-bfa0-ccb5ca5bef33 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:07.728910 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-30669257-d1fa-4f8c-bfa0-ccb5ca5bef33 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:07.814959 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-30669257-d1fa-4f8c-bfa0-ccb5ca5bef33 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:07.826965 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-30669257-d1fa-4f8c-bfa0-ccb5ca5bef33 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/bbcf6b9d-5ae8-4241-82bf-53f7f7959760" status: 200 len: 1266 microversion: 2.1 time: 0.120066 Oct 23 01:32:07.827808 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2370/4818] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:07 2022] GET /compute/v2.1/servers/bbcf6b9d-5ae8-4241-82bf-53f7f7959760 => generated 1266 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:32:08.277701 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f43ff169-0952-469a-b278-e5959ddba044 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:08.278596 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f43ff169-0952-469a-b278-e5959ddba044 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 78708eaa-2dad-44bc-a145-86dcc21ca804] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:08.285742 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f43ff169-0952-469a-b278-e5959ddba044 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:08.286720 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f43ff169-0952-469a-b278-e5959ddba044 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:08.287368 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f43ff169-0952-469a-b278-e5959ddba044 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:08.288477 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f43ff169-0952-469a-b278-e5959ddba044 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:08.289390 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f43ff169-0952-469a-b278-e5959ddba044 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:08.290146 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f43ff169-0952-469a-b278-e5959ddba044 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:08.309958 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=100 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:32:08.452865 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f43ff169-0952-469a-b278-e5959ddba044 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:08.461721 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f43ff169-0952-469a-b278-e5959ddba044 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/78708eaa-2dad-44bc-a145-86dcc21ca804" status: 200 len: 1367 microversion: 2.1 time: 0.188369 Oct 23 01:32:08.473935 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2371/4819] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:08 2022] GET /compute/v2.1/servers/78708eaa-2dad-44bc-a145-86dcc21ca804 => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:08.477741 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cf9e5253-5d97-4af6-b403-2461d3065aa2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:08.486088 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cf9e5253-5d97-4af6-b403-2461d3065aa2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 9f9af130-5a0c-46f9-8449-fa9021e48953] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:08.510629 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf9e5253-5d97-4af6-b403-2461d3065aa2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:08.511186 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf9e5253-5d97-4af6-b403-2461d3065aa2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:08.511638 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf9e5253-5d97-4af6-b403-2461d3065aa2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:08.512404 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf9e5253-5d97-4af6-b403-2461d3065aa2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:08.512858 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf9e5253-5d97-4af6-b403-2461d3065aa2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:08.513277 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf9e5253-5d97-4af6-b403-2461d3065aa2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:08.591832 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cf9e5253-5d97-4af6-b403-2461d3065aa2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:08.600633 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cf9e5253-5d97-4af6-b403-2461d3065aa2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953" status: 200 len: 1272 microversion: 2.1 time: 0.130888 Oct 23 01:32:08.601410 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2372/4820] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:08 2022] GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953 => generated 1272 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:08.606556 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-d91acbb6-e2de-441f-837b-9aea1e844903 req-b8999301-c359-47b7-8ec3-e21dadfaaaca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78708eaa-2dad-44bc-a145-86dcc21ca804", "tag": "e46f5845-095b-423f-ab57-8b5a4b6fda52"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:32:08.627259 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-d91acbb6-e2de-441f-837b-9aea1e844903 req-b8999301-c359-47b7-8ec3-e21dadfaaaca service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:08.628433 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-d91acbb6-e2de-441f-837b-9aea1e844903 req-b8999301-c359-47b7-8ec3-e21dadfaaaca service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:08.628882 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-d91acbb6-e2de-441f-837b-9aea1e844903 req-b8999301-c359-47b7-8ec3-e21dadfaaaca service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:08.650772 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-d91acbb6-e2de-441f-837b-9aea1e844903 req-b8999301-c359-47b7-8ec3-e21dadfaaaca service nova] Creating event network-changed:e46f5845-095b-423f-ab57-8b5a4b6fda52 for instance 78708eaa-2dad-44bc-a145-86dcc21ca804 on n-h1-master-1 Oct 23 01:32:08.658293 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-d91acbb6-e2de-441f-837b-9aea1e844903 req-b8999301-c359-47b7-8ec3-e21dadfaaaca service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055698 Oct 23 01:32:08.660353 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2373/4821] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:32:08.666523 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a0655a69-7981-4ec0-ab63-5916d63185f1 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:08.669338 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a0655a69-7981-4ec0-ab63-5916d63185f1 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] [instance: 7181fffe-8915-49c2-826a-0fa8040dc941] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:08.677691 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a0655a69-7981-4ec0-ab63-5916d63185f1 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:08.678294 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a0655a69-7981-4ec0-ab63-5916d63185f1 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:08.678892 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a0655a69-7981-4ec0-ab63-5916d63185f1 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:08.679625 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a0655a69-7981-4ec0-ab63-5916d63185f1 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:08.680154 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a0655a69-7981-4ec0-ab63-5916d63185f1 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:08.680972 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a0655a69-7981-4ec0-ab63-5916d63185f1 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:08.810485 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a0655a69-7981-4ec0-ab63-5916d63185f1 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3d3c6a02244888eebb6e70eaac4ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b051b0da0ab45ffa64c7b8b32465a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:08.826015 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a0655a69-7981-4ec0-ab63-5916d63185f1 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] 10.222.0.42 "GET /compute/v2.1/servers/7181fffe-8915-49c2-826a-0fa8040dc941" status: 200 len: 1339 microversion: 2.1 time: 0.164410 Oct 23 01:32:08.842679 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2374/4822] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:08 2022] GET /compute/v2.1/servers/7181fffe-8915-49c2-826a-0fa8040dc941 => generated 1339 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:08.853161 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4e056486-2828-4551-84ce-ab427ba95d60 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:08.854164 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4e056486-2828-4551-84ce-ab427ba95d60 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: bbcf6b9d-5ae8-4241-82bf-53f7f7959760] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:08.874262 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4e056486-2828-4551-84ce-ab427ba95d60 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:08.876580 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4e056486-2828-4551-84ce-ab427ba95d60 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:08.879240 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4e056486-2828-4551-84ce-ab427ba95d60 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:08.880297 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4e056486-2828-4551-84ce-ab427ba95d60 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:08.881721 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4e056486-2828-4551-84ce-ab427ba95d60 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:08.883826 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4e056486-2828-4551-84ce-ab427ba95d60 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:08.946136 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-025aeddf-7fb4-406e-9ba7-f0dd304a9e80 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "POST /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.630927 Oct 23 01:32:08.947700 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2449/4823] 10.222.0.42 () {62 vars in 1364 bytes} [Sun Oct 23 01:32:07 2022] POST /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a/os-volume_attachments => generated 188 bytes in 1634 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:32:09.149614 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-79d73b23-66c1-4268-874e-1028c5eb6c0d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:09.158158 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-79d73b23-66c1-4268-874e-1028c5eb6c0d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:09.158511 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4e056486-2828-4551-84ce-ab427ba95d60 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:09.167371 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-79d73b23-66c1-4268-874e-1028c5eb6c0d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:09.167635 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4e056486-2828-4551-84ce-ab427ba95d60 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/bbcf6b9d-5ae8-4241-82bf-53f7f7959760" status: 200 len: 1308 microversion: 2.1 time: 0.318531 Oct 23 01:32:09.192744 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2375/4824] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:08 2022] GET /compute/v2.1/servers/bbcf6b9d-5ae8-4241-82bf-53f7f7959760 => generated 1308 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:32:09.192861 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-79d73b23-66c1-4268-874e-1028c5eb6c0d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:09.192861 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-79d73b23-66c1-4268-874e-1028c5eb6c0d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:09.192861 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-79d73b23-66c1-4268-874e-1028c5eb6c0d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:09.192861 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-79d73b23-66c1-4268-874e-1028c5eb6c0d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:09.192861 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-79d73b23-66c1-4268-874e-1028c5eb6c0d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:09.489253 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3136964e-0b40-461f-9a4e-3d108cd27f6b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:09.493139 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3136964e-0b40-461f-9a4e-3d108cd27f6b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 78708eaa-2dad-44bc-a145-86dcc21ca804] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:09.497754 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3136964e-0b40-461f-9a4e-3d108cd27f6b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:09.498457 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3136964e-0b40-461f-9a4e-3d108cd27f6b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:09.498994 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3136964e-0b40-461f-9a4e-3d108cd27f6b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:09.505236 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3136964e-0b40-461f-9a4e-3d108cd27f6b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:09.506077 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3136964e-0b40-461f-9a4e-3d108cd27f6b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:09.506732 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3136964e-0b40-461f-9a4e-3d108cd27f6b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:09.956590 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3136964e-0b40-461f-9a4e-3d108cd27f6b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:09.970460 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3136964e-0b40-461f-9a4e-3d108cd27f6b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/78708eaa-2dad-44bc-a145-86dcc21ca804" status: 200 len: 1367 microversion: 2.1 time: 0.479697 Oct 23 01:32:09.971653 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2376/4825] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:09 2022] GET /compute/v2.1/servers/78708eaa-2dad-44bc-a145-86dcc21ca804 => generated 1367 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:09.984936 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-af627626-50ec-4ab6-8ff8-1c76be8fa7b2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:09.985820 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-af627626-50ec-4ab6-8ff8-1c76be8fa7b2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 9f9af130-5a0c-46f9-8449-fa9021e48953] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:09.992722 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-af627626-50ec-4ab6-8ff8-1c76be8fa7b2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:09.993223 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-af627626-50ec-4ab6-8ff8-1c76be8fa7b2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:09.993666 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-af627626-50ec-4ab6-8ff8-1c76be8fa7b2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:09.994424 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-af627626-50ec-4ab6-8ff8-1c76be8fa7b2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:09.995065 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-af627626-50ec-4ab6-8ff8-1c76be8fa7b2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:09.995688 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-af627626-50ec-4ab6-8ff8-1c76be8fa7b2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:10.020013 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-79d73b23-66c1-4268-874e-1028c5eb6c0d tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a/os-volume_attachments/53569bef-3400-4fb4-b40e-5cc1cc85503b" status: 202 len: 0 microversion: 2.20 time: 0.874410 Oct 23 01:32:10.021830 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2450/4826] 10.222.0.42 () {60 vars in 1457 bytes} [Sun Oct 23 01:32:09 2022] DELETE /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a/os-volume_attachments/53569bef-3400-4fb4-b40e-5cc1cc85503b => generated 0 bytes in 877 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 23 01:32:10.028508 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-752a5112-6a27-4a0e-9ffb-dac46541c583 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:10.032303 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-752a5112-6a27-4a0e-9ffb-dac46541c583 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] [instance: 7181fffe-8915-49c2-826a-0fa8040dc941] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:10.047180 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-752a5112-6a27-4a0e-9ffb-dac46541c583 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:10.048196 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-752a5112-6a27-4a0e-9ffb-dac46541c583 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:10.048867 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-752a5112-6a27-4a0e-9ffb-dac46541c583 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:10.050767 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-752a5112-6a27-4a0e-9ffb-dac46541c583 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:10.056708 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-752a5112-6a27-4a0e-9ffb-dac46541c583 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:10.058236 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-752a5112-6a27-4a0e-9ffb-dac46541c583 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:10.262098 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-752a5112-6a27-4a0e-9ffb-dac46541c583 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3d3c6a02244888eebb6e70eaac4ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b051b0da0ab45ffa64c7b8b32465a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:10.279711 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-752a5112-6a27-4a0e-9ffb-dac46541c583 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] 10.222.0.42 "GET /compute/v2.1/servers/7181fffe-8915-49c2-826a-0fa8040dc941" status: 200 len: 1327 microversion: 2.1 time: 0.256521 Oct 23 01:32:10.280701 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2451/4827] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:10 2022] GET /compute/v2.1/servers/7181fffe-8915-49c2-826a-0fa8040dc941 => generated 1327 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:10.287814 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bd29e3e7-7318-4c5b-b1b7-5b3ba5200b52 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:32:10.289386 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bd29e3e7-7318-4c5b-b1b7-5b3ba5200b52 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:10.315866 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bd29e3e7-7318-4c5b-b1b7-5b3ba5200b52 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:10.316802 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bd29e3e7-7318-4c5b-b1b7-5b3ba5200b52 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:10.317298 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bd29e3e7-7318-4c5b-b1b7-5b3ba5200b52 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:10.318118 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bd29e3e7-7318-4c5b-b1b7-5b3ba5200b52 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:10.318665 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bd29e3e7-7318-4c5b-b1b7-5b3ba5200b52 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:10.319494 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bd29e3e7-7318-4c5b-b1b7-5b3ba5200b52 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:10.387767 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:32:10.404007 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bd29e3e7-7318-4c5b-b1b7-5b3ba5200b52 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120944) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 23 01:32:10.447909 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-af627626-50ec-4ab6-8ff8-1c76be8fa7b2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:10.462573 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-af627626-50ec-4ab6-8ff8-1c76be8fa7b2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953" status: 200 len: 1314 microversion: 2.1 time: 0.488198 Oct 23 01:32:10.481296 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2377/4828] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:09 2022] GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953 => generated 1314 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:10.515028 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-354c69ff-6cf4-4745-9344-1bf515434d6a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:10.515677 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-354c69ff-6cf4-4745-9344-1bf515434d6a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: bbcf6b9d-5ae8-4241-82bf-53f7f7959760] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:10.526675 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-354c69ff-6cf4-4745-9344-1bf515434d6a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:10.527194 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-354c69ff-6cf4-4745-9344-1bf515434d6a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:10.527729 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-354c69ff-6cf4-4745-9344-1bf515434d6a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:10.528582 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-354c69ff-6cf4-4745-9344-1bf515434d6a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:10.529211 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-354c69ff-6cf4-4745-9344-1bf515434d6a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:10.529793 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-354c69ff-6cf4-4745-9344-1bf515434d6a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:10.726041 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-354c69ff-6cf4-4745-9344-1bf515434d6a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:10.748905 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-354c69ff-6cf4-4745-9344-1bf515434d6a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/bbcf6b9d-5ae8-4241-82bf-53f7f7959760" status: 200 len: 1308 microversion: 2.1 time: 0.265556 Oct 23 01:32:10.750156 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2378/4829] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:10 2022] GET /compute/v2.1/servers/bbcf6b9d-5ae8-4241-82bf-53f7f7959760 => generated 1308 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:10.843574 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0e3b146e-1504-4863-9f28-fd4b99b748b3 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:10.844362 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0e3b146e-1504-4863-9f28-fd4b99b748b3 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:10.868292 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bd29e3e7-7318-4c5b-b1b7-5b3ba5200b52 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "POST /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a/action" status: 202 len: 0 microversion: 2.20 time: 0.586177 Oct 23 01:32:10.873913 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2452/4830] 10.222.0.42 () {62 vars in 1319 bytes} [Sun Oct 23 01:32:10 2022] POST /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a/action => generated 0 bytes in 592 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:32:10.878312 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0e3b146e-1504-4863-9f28-fd4b99b748b3 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:10.881605 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0e3b146e-1504-4863-9f28-fd4b99b748b3 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:10.883205 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0e3b146e-1504-4863-9f28-fd4b99b748b3 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:10.888096 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0e3b146e-1504-4863-9f28-fd4b99b748b3 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:10.889903 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0e3b146e-1504-4863-9f28-fd4b99b748b3 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:10.890467 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0e3b146e-1504-4863-9f28-fd4b99b748b3 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:10.890933 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-240a649c-225e-4276-80f5-c69f9ae20d20 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:10.891577 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-240a649c-225e-4276-80f5-c69f9ae20d20 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:10.903403 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-240a649c-225e-4276-80f5-c69f9ae20d20 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:10.903687 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-240a649c-225e-4276-80f5-c69f9ae20d20 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:10.906486 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-240a649c-225e-4276-80f5-c69f9ae20d20 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:10.908442 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-240a649c-225e-4276-80f5-c69f9ae20d20 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:10.908964 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-240a649c-225e-4276-80f5-c69f9ae20d20 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:10.909437 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-240a649c-225e-4276-80f5-c69f9ae20d20 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:11.749036 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-240a649c-225e-4276-80f5-c69f9ae20d20 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:11.776391 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-240a649c-225e-4276-80f5-c69f9ae20d20 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:11.784331 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-240a649c-225e-4276-80f5-c69f9ae20d20 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:11.785505 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-240a649c-225e-4276-80f5-c69f9ae20d20 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1671 microversion: 2.20 time: 0.907227 Oct 23 01:32:11.793909 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2453/4831] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:32:10 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1671 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:32:11.793909 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b4f0a7d3-747a-48d0-acab-65df676aef43 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:11.794160 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0e3b146e-1504-4863-9f28-fd4b99b748b3 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:11.794610 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b4f0a7d3-747a-48d0-acab-65df676aef43 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 78708eaa-2dad-44bc-a145-86dcc21ca804] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:11.803868 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0e3b146e-1504-4863-9f28-fd4b99b748b3 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1669 microversion: 2.1 time: 0.961257 Oct 23 01:32:11.804656 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2379/4832] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:10 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1669 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:32:11.816864 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b4f0a7d3-747a-48d0-acab-65df676aef43 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:11.817372 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b4f0a7d3-747a-48d0-acab-65df676aef43 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:11.817920 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b4f0a7d3-747a-48d0-acab-65df676aef43 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:11.818660 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b4f0a7d3-747a-48d0-acab-65df676aef43 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:11.819127 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b4f0a7d3-747a-48d0-acab-65df676aef43 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:11.822223 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-72d17382-e4cb-4038-adc3-f53677afdb61 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:11.822848 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-72d17382-e4cb-4038-adc3-f53677afdb61 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] [instance: 7181fffe-8915-49c2-826a-0fa8040dc941] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:11.828861 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b4f0a7d3-747a-48d0-acab-65df676aef43 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:11.842361 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-72d17382-e4cb-4038-adc3-f53677afdb61 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:11.842853 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-72d17382-e4cb-4038-adc3-f53677afdb61 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:11.843286 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-72d17382-e4cb-4038-adc3-f53677afdb61 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:11.843983 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-72d17382-e4cb-4038-adc3-f53677afdb61 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:11.844423 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-72d17382-e4cb-4038-adc3-f53677afdb61 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:11.844857 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-72d17382-e4cb-4038-adc3-f53677afdb61 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:12.280833 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-72d17382-e4cb-4038-adc3-f53677afdb61 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3d3c6a02244888eebb6e70eaac4ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b051b0da0ab45ffa64c7b8b32465a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:12.290598 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-72d17382-e4cb-4038-adc3-f53677afdb61 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] 10.222.0.42 "GET /compute/v2.1/servers/7181fffe-8915-49c2-826a-0fa8040dc941" status: 200 len: 1394 microversion: 2.1 time: 0.485061 Oct 23 01:32:12.307174 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2380/4833] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:11 2022] GET /compute/v2.1/servers/7181fffe-8915-49c2-826a-0fa8040dc941 => generated 1394 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:12.325629 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-616b523d-78d5-4632-b359-e526b103f430 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:12.330508 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-616b523d-78d5-4632-b359-e526b103f430 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 9f9af130-5a0c-46f9-8449-fa9021e48953] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:12.351415 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-616b523d-78d5-4632-b359-e526b103f430 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:12.352316 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-616b523d-78d5-4632-b359-e526b103f430 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:12.352976 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-616b523d-78d5-4632-b359-e526b103f430 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:12.355936 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-616b523d-78d5-4632-b359-e526b103f430 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:12.357687 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-616b523d-78d5-4632-b359-e526b103f430 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:12.360487 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-616b523d-78d5-4632-b359-e526b103f430 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:12.416321 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b4f0a7d3-747a-48d0-acab-65df676aef43 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:12.435154 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b4f0a7d3-747a-48d0-acab-65df676aef43 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/78708eaa-2dad-44bc-a145-86dcc21ca804" status: 200 len: 1367 microversion: 2.1 time: 0.644451 Oct 23 01:32:12.442302 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2454/4834] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:11 2022] GET /compute/v2.1/servers/78708eaa-2dad-44bc-a145-86dcc21ca804 => generated 1367 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:12.454108 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a8685b9a-6dbf-4a9a-a978-9e49d2b34661 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:12.454878 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a8685b9a-6dbf-4a9a-a978-9e49d2b34661 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: bbcf6b9d-5ae8-4241-82bf-53f7f7959760] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:12.494697 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a8685b9a-6dbf-4a9a-a978-9e49d2b34661 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:12.495283 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a8685b9a-6dbf-4a9a-a978-9e49d2b34661 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:12.495833 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a8685b9a-6dbf-4a9a-a978-9e49d2b34661 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:12.498325 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a8685b9a-6dbf-4a9a-a978-9e49d2b34661 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:12.501277 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a8685b9a-6dbf-4a9a-a978-9e49d2b34661 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:12.502418 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a8685b9a-6dbf-4a9a-a978-9e49d2b34661 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:12.845235 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-616b523d-78d5-4632-b359-e526b103f430 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:12.854970 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-616b523d-78d5-4632-b359-e526b103f430 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953" status: 200 len: 1314 microversion: 2.1 time: 0.546413 Oct 23 01:32:12.858660 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2381/4835] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:12 2022] GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953 => generated 1314 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:12.869336 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-25bd5749-d70d-4585-ba9e-2bc4256607ef tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:12.870213 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-25bd5749-d70d-4585-ba9e-2bc4256607ef tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:12.886464 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25bd5749-d70d-4585-ba9e-2bc4256607ef tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:12.887846 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25bd5749-d70d-4585-ba9e-2bc4256607ef tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:12.888443 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25bd5749-d70d-4585-ba9e-2bc4256607ef tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:12.889312 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25bd5749-d70d-4585-ba9e-2bc4256607ef tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:12.889918 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25bd5749-d70d-4585-ba9e-2bc4256607ef tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:12.890515 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25bd5749-d70d-4585-ba9e-2bc4256607ef tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:12.929732 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a8685b9a-6dbf-4a9a-a978-9e49d2b34661 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:12.938788 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a8685b9a-6dbf-4a9a-a978-9e49d2b34661 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/bbcf6b9d-5ae8-4241-82bf-53f7f7959760" status: 200 len: 1308 microversion: 2.1 time: 0.495180 Oct 23 01:32:12.944531 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2455/4836] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:12 2022] GET /compute/v2.1/servers/bbcf6b9d-5ae8-4241-82bf-53f7f7959760 => generated 1308 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:12.960344 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-16875d30-4dfa-4f6d-871b-853ddf602e04 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:12.961358 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-16875d30-4dfa-4f6d-871b-853ddf602e04 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:12.971450 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-16875d30-4dfa-4f6d-871b-853ddf602e04 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:12.972560 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-16875d30-4dfa-4f6d-871b-853ddf602e04 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:12.973244 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-16875d30-4dfa-4f6d-871b-853ddf602e04 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:12.976929 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-16875d30-4dfa-4f6d-871b-853ddf602e04 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:12.977645 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-16875d30-4dfa-4f6d-871b-853ddf602e04 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:12.978339 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-16875d30-4dfa-4f6d-871b-853ddf602e04 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:12.988987 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=6,nova_cell1:UPDATE=9 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:32:13.206116 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-25bd5749-d70d-4585-ba9e-2bc4256607ef tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:13.227356 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-25bd5749-d70d-4585-ba9e-2bc4256607ef tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1669 microversion: 2.1 time: 0.356708 Oct 23 01:32:13.237424 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2382/4837] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:12 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1669 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:13.247144 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-44e9ad3e-8075-4689-bf8c-771ae58f5f66 req-626300e5-9d3a-425c-8fe1-18763c859bfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f9af130-5a0c-46f9-8449-fa9021e48953", "tag": "7253ced9-380e-48f5-bf48-cfbb43aded05"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:32:13.270138 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-44e9ad3e-8075-4689-bf8c-771ae58f5f66 req-626300e5-9d3a-425c-8fe1-18763c859bfa service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:13.270936 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-44e9ad3e-8075-4689-bf8c-771ae58f5f66 req-626300e5-9d3a-425c-8fe1-18763c859bfa service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:13.271550 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-44e9ad3e-8075-4689-bf8c-771ae58f5f66 req-626300e5-9d3a-425c-8fe1-18763c859bfa service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:13.300252 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-44e9ad3e-8075-4689-bf8c-771ae58f5f66 req-626300e5-9d3a-425c-8fe1-18763c859bfa service nova] Creating event network-changed:7253ced9-380e-48f5-bf48-cfbb43aded05 for instance 9f9af130-5a0c-46f9-8449-fa9021e48953 on n-h1-master-1 Oct 23 01:32:13.325785 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-44e9ad3e-8075-4689-bf8c-771ae58f5f66 req-626300e5-9d3a-425c-8fe1-18763c859bfa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075237 Oct 23 01:32:13.326812 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2383/4838] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:32:13.331995 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e988c493-6c43-4b61-90ab-622797ed6e8c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:13.337098 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e988c493-6c43-4b61-90ab-622797ed6e8c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:13.354331 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e988c493-6c43-4b61-90ab-622797ed6e8c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:13.357537 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e988c493-6c43-4b61-90ab-622797ed6e8c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:13.358195 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e988c493-6c43-4b61-90ab-622797ed6e8c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:13.359713 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e988c493-6c43-4b61-90ab-622797ed6e8c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:13.364016 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e988c493-6c43-4b61-90ab-622797ed6e8c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:13.364480 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e988c493-6c43-4b61-90ab-622797ed6e8c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:13.559686 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:32:13.613341 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-16875d30-4dfa-4f6d-871b-853ddf602e04 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:13.622742 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-16875d30-4dfa-4f6d-871b-853ddf602e04 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:13.624763 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-16875d30-4dfa-4f6d-871b-853ddf602e04 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:13.626249 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-16875d30-4dfa-4f6d-871b-853ddf602e04 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1671 microversion: 2.20 time: 0.679498 Oct 23 01:32:13.654978 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2456/4839] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:32:12 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1671 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:32:13.660462 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4c556eca-5331-48c4-8f73-9ae5be772bd3 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:13.661394 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4c556eca-5331-48c4-8f73-9ae5be772bd3 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] [instance: 7181fffe-8915-49c2-826a-0fa8040dc941] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:13.672582 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4c556eca-5331-48c4-8f73-9ae5be772bd3 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:13.673399 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4c556eca-5331-48c4-8f73-9ae5be772bd3 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:13.674083 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4c556eca-5331-48c4-8f73-9ae5be772bd3 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:13.675020 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4c556eca-5331-48c4-8f73-9ae5be772bd3 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:13.675687 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4c556eca-5331-48c4-8f73-9ae5be772bd3 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:13.676583 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4c556eca-5331-48c4-8f73-9ae5be772bd3 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:13.798163 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e988c493-6c43-4b61-90ab-622797ed6e8c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:13.822989 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e988c493-6c43-4b61-90ab-622797ed6e8c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1669 microversion: 2.1 time: 0.494886 Oct 23 01:32:13.827353 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2384/4840] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:13 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1669 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:13.837756 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4b79b62a-b957-4a66-81a5-2bad173d83b6 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:13.838818 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4b79b62a-b957-4a66-81a5-2bad173d83b6 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 78708eaa-2dad-44bc-a145-86dcc21ca804] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:13.853808 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b79b62a-b957-4a66-81a5-2bad173d83b6 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:13.857816 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b79b62a-b957-4a66-81a5-2bad173d83b6 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:13.858586 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b79b62a-b957-4a66-81a5-2bad173d83b6 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:13.863028 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b79b62a-b957-4a66-81a5-2bad173d83b6 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:13.864895 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b79b62a-b957-4a66-81a5-2bad173d83b6 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:13.866130 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b79b62a-b957-4a66-81a5-2bad173d83b6 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:14.203155 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=6 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:32:14.278683 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4c556eca-5331-48c4-8f73-9ae5be772bd3 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3d3c6a02244888eebb6e70eaac4ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b051b0da0ab45ffa64c7b8b32465a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:14.293132 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4c556eca-5331-48c4-8f73-9ae5be772bd3 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] 10.222.0.42 "GET /compute/v2.1/servers/7181fffe-8915-49c2-826a-0fa8040dc941" status: 200 len: 1394 microversion: 2.1 time: 0.633603 Oct 23 01:32:14.299961 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4b79b62a-b957-4a66-81a5-2bad173d83b6 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:14.302198 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2457/4841] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:13 2022] GET /compute/v2.1/servers/7181fffe-8915-49c2-826a-0fa8040dc941 => generated 1394 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:14.307158 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-36caacef-9708-4013-98f1-35543ce11ba6 req-fa3dbace-d180-4055-9692-dcf8fe7b5129 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbcf6b9d-5ae8-4241-82bf-53f7f7959760", "tag": "ba8ae4f3-2b75-4e12-be27-d652921b4240"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:32:14.315490 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4b79b62a-b957-4a66-81a5-2bad173d83b6 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/78708eaa-2dad-44bc-a145-86dcc21ca804" status: 200 len: 1367 microversion: 2.1 time: 0.486666 Oct 23 01:32:14.321099 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2385/4842] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:13 2022] GET /compute/v2.1/servers/78708eaa-2dad-44bc-a145-86dcc21ca804 => generated 1367 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:14.344806 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-36caacef-9708-4013-98f1-35543ce11ba6 req-fa3dbace-d180-4055-9692-dcf8fe7b5129 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:14.345473 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e7f2ce9c-4766-42df-8676-46010b124709 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1026708040"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:32:14.349937 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e7f2ce9c-4766-42df-8676-46010b124709 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:14.357534 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-36caacef-9708-4013-98f1-35543ce11ba6 req-fa3dbace-d180-4055-9692-dcf8fe7b5129 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:14.358385 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-36caacef-9708-4013-98f1-35543ce11ba6 req-fa3dbace-d180-4055-9692-dcf8fe7b5129 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:14.376877 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e7f2ce9c-4766-42df-8676-46010b124709 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:14.382670 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e7f2ce9c-4766-42df-8676-46010b124709 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:14.383408 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e7f2ce9c-4766-42df-8676-46010b124709 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:14.384376 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e7f2ce9c-4766-42df-8676-46010b124709 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:14.384500 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-36caacef-9708-4013-98f1-35543ce11ba6 req-fa3dbace-d180-4055-9692-dcf8fe7b5129 service nova] Creating event network-changed:ba8ae4f3-2b75-4e12-be27-d652921b4240 for instance bbcf6b9d-5ae8-4241-82bf-53f7f7959760 on n-h1-master-1 Oct 23 01:32:14.385202 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e7f2ce9c-4766-42df-8676-46010b124709 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:14.385846 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e7f2ce9c-4766-42df-8676-46010b124709 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:14.398776 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-36caacef-9708-4013-98f1-35543ce11ba6 req-fa3dbace-d180-4055-9692-dcf8fe7b5129 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095168 Oct 23 01:32:14.399528 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2458/4843] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:32:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:32:14.407215 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ab415e80-95e2-4d52-bc54-0f0ee5f092e8 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:14.413144 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ab415e80-95e2-4d52-bc54-0f0ee5f092e8 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 9f9af130-5a0c-46f9-8449-fa9021e48953] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:14.428648 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab415e80-95e2-4d52-bc54-0f0ee5f092e8 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:14.429550 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab415e80-95e2-4d52-bc54-0f0ee5f092e8 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:14.430303 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab415e80-95e2-4d52-bc54-0f0ee5f092e8 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:14.432004 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab415e80-95e2-4d52-bc54-0f0ee5f092e8 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:14.434062 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab415e80-95e2-4d52-bc54-0f0ee5f092e8 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:14.436609 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab415e80-95e2-4d52-bc54-0f0ee5f092e8 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:14.539570 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=12 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:32:14.690214 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ab415e80-95e2-4d52-bc54-0f0ee5f092e8 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:14.698552 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ab415e80-95e2-4d52-bc54-0f0ee5f092e8 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953" status: 200 len: 1314 microversion: 2.1 time: 0.297265 Oct 23 01:32:14.699206 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2459/4844] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:14 2022] GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953 => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:14.714339 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-287f848d-fdb1-45f1-b503-9145ff9e41a9 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:14.715096 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-287f848d-fdb1-45f1-b503-9145ff9e41a9 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: bbcf6b9d-5ae8-4241-82bf-53f7f7959760] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:14.724089 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-287f848d-fdb1-45f1-b503-9145ff9e41a9 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:14.724565 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-287f848d-fdb1-45f1-b503-9145ff9e41a9 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:14.725011 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-287f848d-fdb1-45f1-b503-9145ff9e41a9 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:14.725722 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-287f848d-fdb1-45f1-b503-9145ff9e41a9 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:14.726712 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-287f848d-fdb1-45f1-b503-9145ff9e41a9 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:14.735269 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-287f848d-fdb1-45f1-b503-9145ff9e41a9 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:14.898554 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-287f848d-fdb1-45f1-b503-9145ff9e41a9 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:14.916224 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-287f848d-fdb1-45f1-b503-9145ff9e41a9 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/bbcf6b9d-5ae8-4241-82bf-53f7f7959760" status: 200 len: 1308 microversion: 2.1 time: 0.209306 Oct 23 01:32:14.932520 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2460/4845] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:14 2022] GET /compute/v2.1/servers/bbcf6b9d-5ae8-4241-82bf-53f7f7959760 => generated 1308 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:14.932520 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5d2e7d22-7309-4bd7-b24e-23f012994fbf tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:14.932520 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5d2e7d22-7309-4bd7-b24e-23f012994fbf tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:14.934980 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5d2e7d22-7309-4bd7-b24e-23f012994fbf tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:14.936082 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5d2e7d22-7309-4bd7-b24e-23f012994fbf tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:14.936548 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5d2e7d22-7309-4bd7-b24e-23f012994fbf tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:14.937386 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5d2e7d22-7309-4bd7-b24e-23f012994fbf tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:14.937911 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5d2e7d22-7309-4bd7-b24e-23f012994fbf tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:14.938425 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5d2e7d22-7309-4bd7-b24e-23f012994fbf tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:15.081847 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e7f2ce9c-4766-42df-8676-46010b124709 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "POST /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98/action" status: 202 len: 0 microversion: 2.1 time: 0.758548 Oct 23 01:32:15.082677 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2386/4846] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:32:14 2022] POST /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98/action => generated 0 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 23 01:32:15.124437 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5d2e7d22-7309-4bd7-b24e-23f012994fbf tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:15.133886 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5d2e7d22-7309-4bd7-b24e-23f012994fbf tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:15.135464 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5d2e7d22-7309-4bd7-b24e-23f012994fbf tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:15.137257 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5d2e7d22-7309-4bd7-b24e-23f012994fbf tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1729 microversion: 2.20 time: 0.213895 Oct 23 01:32:15.137855 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2461/4847] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:32:14 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1729 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:32:15.353751 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-805c917c-fe68-49eb-8d22-8f413e001eb1 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:15.359764 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-805c917c-fe68-49eb-8d22-8f413e001eb1 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] [instance: 7181fffe-8915-49c2-826a-0fa8040dc941] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:15.368315 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e4a61900-3654-4754-9314-1feaff373f0c tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:15.368951 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e4a61900-3654-4754-9314-1feaff373f0c tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 78708eaa-2dad-44bc-a145-86dcc21ca804] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:15.385146 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-805c917c-fe68-49eb-8d22-8f413e001eb1 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:15.386523 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-805c917c-fe68-49eb-8d22-8f413e001eb1 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:15.386792 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e4a61900-3654-4754-9314-1feaff373f0c tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:15.387295 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e4a61900-3654-4754-9314-1feaff373f0c tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:15.391902 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e4a61900-3654-4754-9314-1feaff373f0c tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:15.392034 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-805c917c-fe68-49eb-8d22-8f413e001eb1 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:15.392125 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e4a61900-3654-4754-9314-1feaff373f0c tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:15.392125 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e4a61900-3654-4754-9314-1feaff373f0c tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:15.392488 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-805c917c-fe68-49eb-8d22-8f413e001eb1 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:15.392599 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e4a61900-3654-4754-9314-1feaff373f0c tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:15.392683 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-805c917c-fe68-49eb-8d22-8f413e001eb1 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:15.392683 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-805c917c-fe68-49eb-8d22-8f413e001eb1 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:15.610833 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e4a61900-3654-4754-9314-1feaff373f0c tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:15.621430 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e4a61900-3654-4754-9314-1feaff373f0c tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/78708eaa-2dad-44bc-a145-86dcc21ca804" status: 200 len: 1367 microversion: 2.1 time: 0.262900 Oct 23 01:32:15.622809 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2462/4848] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:15 2022] GET /compute/v2.1/servers/78708eaa-2dad-44bc-a145-86dcc21ca804 => generated 1367 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:32:15.624936 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-805c917c-fe68-49eb-8d22-8f413e001eb1 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3d3c6a02244888eebb6e70eaac4ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b051b0da0ab45ffa64c7b8b32465a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:15.635170 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-805c917c-fe68-49eb-8d22-8f413e001eb1 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] 10.222.0.42 "GET /compute/v2.1/servers/7181fffe-8915-49c2-826a-0fa8040dc941" status: 200 len: 1394 microversion: 2.1 time: 0.285722 Oct 23 01:32:15.635779 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2387/4849] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:15 2022] GET /compute/v2.1/servers/7181fffe-8915-49c2-826a-0fa8040dc941 => generated 1394 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:15.722512 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3c8346c2-e07b-4eb0-872c-c0ab55544748 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:15.723524 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3c8346c2-e07b-4eb0-872c-c0ab55544748 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 9f9af130-5a0c-46f9-8449-fa9021e48953] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:15.732164 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3c8346c2-e07b-4eb0-872c-c0ab55544748 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:15.732663 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3c8346c2-e07b-4eb0-872c-c0ab55544748 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:15.733104 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3c8346c2-e07b-4eb0-872c-c0ab55544748 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:15.733836 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3c8346c2-e07b-4eb0-872c-c0ab55544748 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:15.734344 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3c8346c2-e07b-4eb0-872c-c0ab55544748 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:15.734769 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3c8346c2-e07b-4eb0-872c-c0ab55544748 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:15.890992 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3c8346c2-e07b-4eb0-872c-c0ab55544748 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:15.899932 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3c8346c2-e07b-4eb0-872c-c0ab55544748 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953" status: 200 len: 1314 microversion: 2.1 time: 0.181566 Oct 23 01:32:15.900755 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2463/4850] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:15 2022] GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:15.945166 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a867ffe4-aac8-4e6a-affb-436478c389d9 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:15.945778 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a867ffe4-aac8-4e6a-affb-436478c389d9 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: bbcf6b9d-5ae8-4241-82bf-53f7f7959760] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:15.948594 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=34 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:32:15.954288 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a867ffe4-aac8-4e6a-affb-436478c389d9 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:15.954767 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a867ffe4-aac8-4e6a-affb-436478c389d9 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:15.955195 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a867ffe4-aac8-4e6a-affb-436478c389d9 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:15.955909 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a867ffe4-aac8-4e6a-affb-436478c389d9 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:15.956322 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a867ffe4-aac8-4e6a-affb-436478c389d9 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:15.956954 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a867ffe4-aac8-4e6a-affb-436478c389d9 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:15.959925 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:32:16.131038 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a867ffe4-aac8-4e6a-affb-436478c389d9 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:16.139377 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a867ffe4-aac8-4e6a-affb-436478c389d9 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/bbcf6b9d-5ae8-4241-82bf-53f7f7959760" status: 200 len: 1308 microversion: 2.1 time: 0.198246 Oct 23 01:32:16.140298 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2388/4851] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:15 2022] GET /compute/v2.1/servers/bbcf6b9d-5ae8-4241-82bf-53f7f7959760 => generated 1308 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:16.165222 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-05b09c22-82f8-4936-9bab-aeeda6ac0496 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:16.165939 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-05b09c22-82f8-4936-9bab-aeeda6ac0496 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:16.172837 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-05b09c22-82f8-4936-9bab-aeeda6ac0496 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:16.173333 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-05b09c22-82f8-4936-9bab-aeeda6ac0496 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:16.173802 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-05b09c22-82f8-4936-9bab-aeeda6ac0496 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:16.179022 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-05b09c22-82f8-4936-9bab-aeeda6ac0496 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:16.179540 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-05b09c22-82f8-4936-9bab-aeeda6ac0496 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:16.182473 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-05b09c22-82f8-4936-9bab-aeeda6ac0496 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:16.391545 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-05b09c22-82f8-4936-9bab-aeeda6ac0496 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:16.400905 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-05b09c22-82f8-4936-9bab-aeeda6ac0496 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:16.403137 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-05b09c22-82f8-4936-9bab-aeeda6ac0496 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:16.404551 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-05b09c22-82f8-4936-9bab-aeeda6ac0496 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1729 microversion: 2.20 time: 0.245038 Oct 23 01:32:16.405279 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2464/4852] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:32:16 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1729 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:32:16.458882 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-06b3073f-c440-45b4-b76f-849d12c4ed6c req-1ce2b947-187b-451b-b7cb-af7df4f6aa26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7181fffe-8915-49c2-826a-0fa8040dc941", "tag": "29153efe-3a7e-443e-80e2-bbce0757b30a"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:32:16.488244 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-06b3073f-c440-45b4-b76f-849d12c4ed6c req-1ce2b947-187b-451b-b7cb-af7df4f6aa26 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:16.492075 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-06b3073f-c440-45b4-b76f-849d12c4ed6c req-1ce2b947-187b-451b-b7cb-af7df4f6aa26 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:16.492075 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-06b3073f-c440-45b4-b76f-849d12c4ed6c req-1ce2b947-187b-451b-b7cb-af7df4f6aa26 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:16.518697 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-06b3073f-c440-45b4-b76f-849d12c4ed6c req-1ce2b947-187b-451b-b7cb-af7df4f6aa26 service nova] Creating event network-changed:29153efe-3a7e-443e-80e2-bbce0757b30a for instance 7181fffe-8915-49c2-826a-0fa8040dc941 on n-h2-master-1 Oct 23 01:32:16.525857 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-06b3073f-c440-45b4-b76f-849d12c4ed6c req-1ce2b947-187b-451b-b7cb-af7df4f6aa26 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074482 Oct 23 01:32:16.529019 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2389/4853] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:32:16.659688 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-31c4c664-bb30-45eb-a41c-5d605c37f2f8 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:16.660395 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-31c4c664-bb30-45eb-a41c-5d605c37f2f8 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] [instance: 7181fffe-8915-49c2-826a-0fa8040dc941] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:16.662200 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ec9a1f36-2aa8-4094-996a-e93b453663e8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:16.662960 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ec9a1f36-2aa8-4094-996a-e93b453663e8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 78708eaa-2dad-44bc-a145-86dcc21ca804] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:16.676626 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ec9a1f36-2aa8-4094-996a-e93b453663e8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:16.676626 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ec9a1f36-2aa8-4094-996a-e93b453663e8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:16.676626 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ec9a1f36-2aa8-4094-996a-e93b453663e8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:16.676626 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ec9a1f36-2aa8-4094-996a-e93b453663e8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:16.677049 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ec9a1f36-2aa8-4094-996a-e93b453663e8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:16.677049 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ec9a1f36-2aa8-4094-996a-e93b453663e8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:16.680149 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-31c4c664-bb30-45eb-a41c-5d605c37f2f8 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:16.680638 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-31c4c664-bb30-45eb-a41c-5d605c37f2f8 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:16.681268 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-31c4c664-bb30-45eb-a41c-5d605c37f2f8 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:16.682166 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-31c4c664-bb30-45eb-a41c-5d605c37f2f8 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:16.682772 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-31c4c664-bb30-45eb-a41c-5d605c37f2f8 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:16.683893 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-31c4c664-bb30-45eb-a41c-5d605c37f2f8 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:16.981568 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ec9a1f36-2aa8-4094-996a-e93b453663e8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:16.989388 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ec9a1f36-2aa8-4094-996a-e93b453663e8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/78708eaa-2dad-44bc-a145-86dcc21ca804" status: 200 len: 1367 microversion: 2.1 time: 0.340513 Oct 23 01:32:17.008864 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2465/4854] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:16 2022] GET /compute/v2.1/servers/78708eaa-2dad-44bc-a145-86dcc21ca804 => generated 1367 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:17.018024 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-31c4c664-bb30-45eb-a41c-5d605c37f2f8 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3d3c6a02244888eebb6e70eaac4ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b051b0da0ab45ffa64c7b8b32465a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:17.018905 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-901de617-4091-4d69-9fd8-59b262ca2b5f req-51d9754f-1957-4d28-9312-fdae3555ea40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78708eaa-2dad-44bc-a145-86dcc21ca804", "name": "network-vif-plugged", "status": "completed", "tag": "e46f5845-095b-423f-ab57-8b5a4b6fda52"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:32:17.026178 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-31c4c664-bb30-45eb-a41c-5d605c37f2f8 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] 10.222.0.42 "GET /compute/v2.1/servers/7181fffe-8915-49c2-826a-0fa8040dc941" status: 200 len: 1394 microversion: 2.1 time: 0.370493 Oct 23 01:32:17.027557 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2390/4855] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:16 2022] GET /compute/v2.1/servers/7181fffe-8915-49c2-826a-0fa8040dc941 => generated 1394 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:32:17.034482 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-352144ed-4476-49b6-abf0-60584f3e8f7e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:17.035341 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-352144ed-4476-49b6-abf0-60584f3e8f7e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 9f9af130-5a0c-46f9-8449-fa9021e48953] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:17.038868 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-901de617-4091-4d69-9fd8-59b262ca2b5f req-51d9754f-1957-4d28-9312-fdae3555ea40 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:17.039553 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-901de617-4091-4d69-9fd8-59b262ca2b5f req-51d9754f-1957-4d28-9312-fdae3555ea40 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:17.040176 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-901de617-4091-4d69-9fd8-59b262ca2b5f req-51d9754f-1957-4d28-9312-fdae3555ea40 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:17.041749 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-352144ed-4476-49b6-abf0-60584f3e8f7e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:17.042376 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-352144ed-4476-49b6-abf0-60584f3e8f7e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:17.042937 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-352144ed-4476-49b6-abf0-60584f3e8f7e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:17.043728 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-352144ed-4476-49b6-abf0-60584f3e8f7e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:17.044279 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-352144ed-4476-49b6-abf0-60584f3e8f7e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:17.044800 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-352144ed-4476-49b6-abf0-60584f3e8f7e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:17.064955 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-901de617-4091-4d69-9fd8-59b262ca2b5f req-51d9754f-1957-4d28-9312-fdae3555ea40 service nova] Creating event network-vif-plugged:e46f5845-095b-423f-ab57-8b5a4b6fda52 for instance 78708eaa-2dad-44bc-a145-86dcc21ca804 on n-h1-master-1 Oct 23 01:32:17.073209 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-901de617-4091-4d69-9fd8-59b262ca2b5f req-51d9754f-1957-4d28-9312-fdae3555ea40 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062623 Oct 23 01:32:17.074207 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2466/4856] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:32:17.164875 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3b701355-cc74-4650-815b-bb9e41b93c4a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:17.165586 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3b701355-cc74-4650-815b-bb9e41b93c4a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: bbcf6b9d-5ae8-4241-82bf-53f7f7959760] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:17.175860 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3b701355-cc74-4650-815b-bb9e41b93c4a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:17.176631 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3b701355-cc74-4650-815b-bb9e41b93c4a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:17.178321 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3b701355-cc74-4650-815b-bb9e41b93c4a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:17.185043 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3b701355-cc74-4650-815b-bb9e41b93c4a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:17.185043 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3b701355-cc74-4650-815b-bb9e41b93c4a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:17.185043 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3b701355-cc74-4650-815b-bb9e41b93c4a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:17.611438 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-352144ed-4476-49b6-abf0-60584f3e8f7e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:17.629855 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-352144ed-4476-49b6-abf0-60584f3e8f7e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953" status: 200 len: 1314 microversion: 2.1 time: 0.598858 Oct 23 01:32:17.630851 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2391/4857] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:17 2022] GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953 => generated 1314 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:17.644108 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-31340c9c-9542-40c3-8f52-e9758eb87fa4 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:17.645151 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-31340c9c-9542-40c3-8f52-e9758eb87fa4 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:17.651340 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:32:17.653891 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-31340c9c-9542-40c3-8f52-e9758eb87fa4 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:17.654677 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-31340c9c-9542-40c3-8f52-e9758eb87fa4 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:17.655370 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-31340c9c-9542-40c3-8f52-e9758eb87fa4 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:17.656201 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-31340c9c-9542-40c3-8f52-e9758eb87fa4 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:17.656745 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-31340c9c-9542-40c3-8f52-e9758eb87fa4 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:17.657383 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-31340c9c-9542-40c3-8f52-e9758eb87fa4 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:17.672434 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3b701355-cc74-4650-815b-bb9e41b93c4a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:17.688759 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3b701355-cc74-4650-815b-bb9e41b93c4a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/bbcf6b9d-5ae8-4241-82bf-53f7f7959760" status: 200 len: 1308 microversion: 2.1 time: 0.528452 Oct 23 01:32:17.689552 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2467/4858] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:17 2022] GET /compute/v2.1/servers/bbcf6b9d-5ae8-4241-82bf-53f7f7959760 => generated 1308 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:18.017054 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f5cf245f-7495-4b54-9aea-7bbb968ba422 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:18.018050 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f5cf245f-7495-4b54-9aea-7bbb968ba422 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 78708eaa-2dad-44bc-a145-86dcc21ca804] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:18.030928 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f5cf245f-7495-4b54-9aea-7bbb968ba422 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:18.034052 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f5cf245f-7495-4b54-9aea-7bbb968ba422 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:18.034815 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f5cf245f-7495-4b54-9aea-7bbb968ba422 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:18.037626 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f5cf245f-7495-4b54-9aea-7bbb968ba422 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:18.038336 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f5cf245f-7495-4b54-9aea-7bbb968ba422 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:18.040029 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f5cf245f-7495-4b54-9aea-7bbb968ba422 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:18.063476 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-31340c9c-9542-40c3-8f52-e9758eb87fa4 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:18.080454 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-31340c9c-9542-40c3-8f52-e9758eb87fa4 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:18.086917 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-31340c9c-9542-40c3-8f52-e9758eb87fa4 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:18.090237 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-31340c9c-9542-40c3-8f52-e9758eb87fa4 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1729 microversion: 2.20 time: 0.455240 Oct 23 01:32:18.092889 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2392/4859] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:32:17 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1729 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:32:18.108844 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2850065f-0256-4371-979f-57dbf9b51455 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:18.110965 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2850065f-0256-4371-979f-57dbf9b51455 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] [instance: 7181fffe-8915-49c2-826a-0fa8040dc941] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:18.123675 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2850065f-0256-4371-979f-57dbf9b51455 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:18.124169 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2850065f-0256-4371-979f-57dbf9b51455 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:18.124800 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2850065f-0256-4371-979f-57dbf9b51455 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:18.125688 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2850065f-0256-4371-979f-57dbf9b51455 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:18.126367 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2850065f-0256-4371-979f-57dbf9b51455 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:18.126950 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2850065f-0256-4371-979f-57dbf9b51455 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:19.405851 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2850065f-0256-4371-979f-57dbf9b51455 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3d3c6a02244888eebb6e70eaac4ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b051b0da0ab45ffa64c7b8b32465a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:19.416890 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2850065f-0256-4371-979f-57dbf9b51455 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] 10.222.0.42 "GET /compute/v2.1/servers/7181fffe-8915-49c2-826a-0fa8040dc941" status: 200 len: 1394 microversion: 2.1 time: 1.321666 Oct 23 01:32:19.432998 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2393/4860] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:18 2022] GET /compute/v2.1/servers/7181fffe-8915-49c2-826a-0fa8040dc941 => generated 1394 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:19.442354 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b6489537-fc49-4e38-a265-6360c9974d8b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:19.446749 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f5cf245f-7495-4b54-9aea-7bbb968ba422 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:19.457062 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b6489537-fc49-4e38-a265-6360c9974d8b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 9f9af130-5a0c-46f9-8449-fa9021e48953] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:19.469525 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f5cf245f-7495-4b54-9aea-7bbb968ba422 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/78708eaa-2dad-44bc-a145-86dcc21ca804" status: 200 len: 1367 microversion: 2.1 time: 1.455578 Oct 23 01:32:19.472270 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2468/4861] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:18 2022] GET /compute/v2.1/servers/78708eaa-2dad-44bc-a145-86dcc21ca804 => generated 1367 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:32:19.477492 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b6489537-fc49-4e38-a265-6360c9974d8b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:19.490300 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b6489537-fc49-4e38-a265-6360c9974d8b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:19.490300 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b6489537-fc49-4e38-a265-6360c9974d8b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:19.490300 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b6489537-fc49-4e38-a265-6360c9974d8b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:19.490300 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b6489537-fc49-4e38-a265-6360c9974d8b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:19.490675 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-41ba1647-d64e-4ff4-9146-6f9dfb79fc35 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:19.490675 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-41ba1647-d64e-4ff4-9146-6f9dfb79fc35 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: bbcf6b9d-5ae8-4241-82bf-53f7f7959760] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:19.491391 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b6489537-fc49-4e38-a265-6360c9974d8b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:19.504773 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41ba1647-d64e-4ff4-9146-6f9dfb79fc35 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:19.505263 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41ba1647-d64e-4ff4-9146-6f9dfb79fc35 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:19.510766 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41ba1647-d64e-4ff4-9146-6f9dfb79fc35 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:19.512833 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41ba1647-d64e-4ff4-9146-6f9dfb79fc35 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:19.513311 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41ba1647-d64e-4ff4-9146-6f9dfb79fc35 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:19.513798 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41ba1647-d64e-4ff4-9146-6f9dfb79fc35 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:20.083497 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b6489537-fc49-4e38-a265-6360c9974d8b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:20.093837 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b6489537-fc49-4e38-a265-6360c9974d8b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953" status: 200 len: 1314 microversion: 2.1 time: 0.658031 Oct 23 01:32:20.093837 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2394/4862] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:19 2022] GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953 => generated 1314 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:20.114947 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d9e980f8-d565-4cff-8ac3-2e8fdd167dea tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:20.117238 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d9e980f8-d565-4cff-8ac3-2e8fdd167dea tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:20.138412 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9e980f8-d565-4cff-8ac3-2e8fdd167dea tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:20.138917 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9e980f8-d565-4cff-8ac3-2e8fdd167dea tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:20.139362 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9e980f8-d565-4cff-8ac3-2e8fdd167dea tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:20.140077 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9e980f8-d565-4cff-8ac3-2e8fdd167dea tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:20.140643 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9e980f8-d565-4cff-8ac3-2e8fdd167dea tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:20.141181 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9e980f8-d565-4cff-8ac3-2e8fdd167dea tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:20.178938 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-41ba1647-d64e-4ff4-9146-6f9dfb79fc35 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:20.207960 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-41ba1647-d64e-4ff4-9146-6f9dfb79fc35 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/bbcf6b9d-5ae8-4241-82bf-53f7f7959760" status: 200 len: 1308 microversion: 2.1 time: 0.730796 Oct 23 01:32:20.217438 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2469/4863] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:19 2022] GET /compute/v2.1/servers/bbcf6b9d-5ae8-4241-82bf-53f7f7959760 => generated 1308 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:20.415952 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d9e980f8-d565-4cff-8ac3-2e8fdd167dea tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:20.429293 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d9e980f8-d565-4cff-8ac3-2e8fdd167dea tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:20.431110 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d9e980f8-d565-4cff-8ac3-2e8fdd167dea tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:20.432592 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d9e980f8-d565-4cff-8ac3-2e8fdd167dea tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1729 microversion: 2.20 time: 0.326436 Oct 23 01:32:20.433207 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2395/4864] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:32:20 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1729 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:32:20.449151 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e0569479-4113-45aa-bd88-e4eeea1b258c tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:20.453381 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e0569479-4113-45aa-bd88-e4eeea1b258c tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] [instance: 7181fffe-8915-49c2-826a-0fa8040dc941] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:20.460924 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0569479-4113-45aa-bd88-e4eeea1b258c tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:20.461785 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0569479-4113-45aa-bd88-e4eeea1b258c tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:20.462496 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0569479-4113-45aa-bd88-e4eeea1b258c tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:20.463875 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0569479-4113-45aa-bd88-e4eeea1b258c tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:20.465612 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0569479-4113-45aa-bd88-e4eeea1b258c tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:20.466464 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0569479-4113-45aa-bd88-e4eeea1b258c tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:20.495488 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-77815e3b-e1a8-4b4c-b228-3bb950c3b0e5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:20.496334 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-77815e3b-e1a8-4b4c-b228-3bb950c3b0e5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 78708eaa-2dad-44bc-a145-86dcc21ca804] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:20.509093 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-77815e3b-e1a8-4b4c-b228-3bb950c3b0e5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:20.512597 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-77815e3b-e1a8-4b4c-b228-3bb950c3b0e5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:20.514238 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-77815e3b-e1a8-4b4c-b228-3bb950c3b0e5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:20.515459 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-77815e3b-e1a8-4b4c-b228-3bb950c3b0e5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:20.516243 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-77815e3b-e1a8-4b4c-b228-3bb950c3b0e5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:20.516852 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-77815e3b-e1a8-4b4c-b228-3bb950c3b0e5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:20.832208 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e0569479-4113-45aa-bd88-e4eeea1b258c tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3d3c6a02244888eebb6e70eaac4ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b051b0da0ab45ffa64c7b8b32465a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:20.841793 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e0569479-4113-45aa-bd88-e4eeea1b258c tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] 10.222.0.42 "GET /compute/v2.1/servers/7181fffe-8915-49c2-826a-0fa8040dc941" status: 200 len: 1394 microversion: 2.1 time: 0.397220 Oct 23 01:32:20.846719 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2470/4865] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:20 2022] GET /compute/v2.1/servers/7181fffe-8915-49c2-826a-0fa8040dc941 => generated 1394 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:20.885295 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-77815e3b-e1a8-4b4c-b228-3bb950c3b0e5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:20.899987 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-77815e3b-e1a8-4b4c-b228-3bb950c3b0e5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/78708eaa-2dad-44bc-a145-86dcc21ca804" status: 200 len: 1558 microversion: 2.1 time: 0.408764 Oct 23 01:32:20.914875 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2396/4866] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:20 2022] GET /compute/v2.1/servers/78708eaa-2dad-44bc-a145-86dcc21ca804 => generated 1558 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:20.926857 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f27a854f-d5e9-4f60-b013-bc1e281cfa55 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:20.927730 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f27a854f-d5e9-4f60-b013-bc1e281cfa55 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 78708eaa-2dad-44bc-a145-86dcc21ca804] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:20.933848 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f27a854f-d5e9-4f60-b013-bc1e281cfa55 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:20.934962 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f27a854f-d5e9-4f60-b013-bc1e281cfa55 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:20.935670 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f27a854f-d5e9-4f60-b013-bc1e281cfa55 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:20.936664 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f27a854f-d5e9-4f60-b013-bc1e281cfa55 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:20.937352 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f27a854f-d5e9-4f60-b013-bc1e281cfa55 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:20.938002 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f27a854f-d5e9-4f60-b013-bc1e281cfa55 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:21.079211 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f27a854f-d5e9-4f60-b013-bc1e281cfa55 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/78708eaa-2dad-44bc-a145-86dcc21ca804/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.156984 Oct 23 01:32:21.080178 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2471/4867] 10.222.0.42 () {58 vars in 1275 bytes} [Sun Oct 23 01:32:20 2022] GET /compute/v2.1/servers/78708eaa-2dad-44bc-a145-86dcc21ca804/os-interface => generated 285 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:32:21.124249 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-10d84d9a-709c-45d6-97b4-fe721270b325 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:21.125089 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-10d84d9a-709c-45d6-97b4-fe721270b325 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 9f9af130-5a0c-46f9-8449-fa9021e48953] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:21.137581 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10d84d9a-709c-45d6-97b4-fe721270b325 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:21.138016 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10d84d9a-709c-45d6-97b4-fe721270b325 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:21.143430 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10d84d9a-709c-45d6-97b4-fe721270b325 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:21.144420 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10d84d9a-709c-45d6-97b4-fe721270b325 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:21.145111 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10d84d9a-709c-45d6-97b4-fe721270b325 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:21.146772 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10d84d9a-709c-45d6-97b4-fe721270b325 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:21.241732 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-829a1d70-3dd7-41d6-a545-1bdf605e9a3b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:21.242803 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-829a1d70-3dd7-41d6-a545-1bdf605e9a3b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: bbcf6b9d-5ae8-4241-82bf-53f7f7959760] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:21.283947 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-829a1d70-3dd7-41d6-a545-1bdf605e9a3b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:21.284522 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-829a1d70-3dd7-41d6-a545-1bdf605e9a3b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:21.284983 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-829a1d70-3dd7-41d6-a545-1bdf605e9a3b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:21.295546 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-829a1d70-3dd7-41d6-a545-1bdf605e9a3b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:21.296138 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-829a1d70-3dd7-41d6-a545-1bdf605e9a3b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:21.296598 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-829a1d70-3dd7-41d6-a545-1bdf605e9a3b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:21.691623 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-10d84d9a-709c-45d6-97b4-fe721270b325 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:21.706718 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-10d84d9a-709c-45d6-97b4-fe721270b325 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953" status: 200 len: 1314 microversion: 2.1 time: 0.586813 Oct 23 01:32:21.738117 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2397/4868] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:21 2022] GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953 => generated 1314 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:21.758434 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9ab05e95-260e-47ba-a1c9-123a69468354 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:21.765358 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9ab05e95-260e-47ba-a1c9-123a69468354 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:21.780584 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9ab05e95-260e-47ba-a1c9-123a69468354 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:21.781491 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9ab05e95-260e-47ba-a1c9-123a69468354 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:21.785488 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9ab05e95-260e-47ba-a1c9-123a69468354 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:21.786542 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9ab05e95-260e-47ba-a1c9-123a69468354 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:21.787276 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9ab05e95-260e-47ba-a1c9-123a69468354 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:21.788008 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9ab05e95-260e-47ba-a1c9-123a69468354 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:21.838061 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-829a1d70-3dd7-41d6-a545-1bdf605e9a3b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:21.853870 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-829a1d70-3dd7-41d6-a545-1bdf605e9a3b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/bbcf6b9d-5ae8-4241-82bf-53f7f7959760" status: 200 len: 1308 microversion: 2.1 time: 0.616722 Oct 23 01:32:21.904381 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2472/4869] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:21 2022] GET /compute/v2.1/servers/bbcf6b9d-5ae8-4241-82bf-53f7f7959760 => generated 1308 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:32:21.910464 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-23c20e0b-d335-4270-8c94-137b7801de56 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:21.911162 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-23c20e0b-d335-4270-8c94-137b7801de56 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] [instance: 7181fffe-8915-49c2-826a-0fa8040dc941] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:21.942604 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-23c20e0b-d335-4270-8c94-137b7801de56 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:21.946144 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-23c20e0b-d335-4270-8c94-137b7801de56 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:21.946788 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-23c20e0b-d335-4270-8c94-137b7801de56 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:21.947692 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-23c20e0b-d335-4270-8c94-137b7801de56 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:21.948306 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-23c20e0b-d335-4270-8c94-137b7801de56 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:21.949967 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-23c20e0b-d335-4270-8c94-137b7801de56 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:22.469722 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-23c20e0b-d335-4270-8c94-137b7801de56 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3d3c6a02244888eebb6e70eaac4ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b051b0da0ab45ffa64c7b8b32465a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:22.490845 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-23c20e0b-d335-4270-8c94-137b7801de56 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] 10.222.0.42 "GET /compute/v2.1/servers/7181fffe-8915-49c2-826a-0fa8040dc941" status: 200 len: 1394 microversion: 2.1 time: 0.585123 Oct 23 01:32:22.493759 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2473/4870] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:21 2022] GET /compute/v2.1/servers/7181fffe-8915-49c2-826a-0fa8040dc941 => generated 1394 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:22.552786 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9ab05e95-260e-47ba-a1c9-123a69468354 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:22.569647 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9ab05e95-260e-47ba-a1c9-123a69468354 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:22.584907 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9ab05e95-260e-47ba-a1c9-123a69468354 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:22.593857 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9ab05e95-260e-47ba-a1c9-123a69468354 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1729 microversion: 2.20 time: 0.848863 Oct 23 01:32:22.597651 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2398/4871] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:32:21 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1729 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:32:22.745117 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c27a192a-704c-4240-955d-3e4319453c15 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:22.746430 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c27a192a-704c-4240-955d-3e4319453c15 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 9f9af130-5a0c-46f9-8449-fa9021e48953] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:22.757340 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c27a192a-704c-4240-955d-3e4319453c15 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:22.757848 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c27a192a-704c-4240-955d-3e4319453c15 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:22.758803 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c27a192a-704c-4240-955d-3e4319453c15 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:22.760933 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c27a192a-704c-4240-955d-3e4319453c15 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:22.761650 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c27a192a-704c-4240-955d-3e4319453c15 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:22.762844 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c27a192a-704c-4240-955d-3e4319453c15 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:22.806501 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=100 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:32:22.897599 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e8676044-00fe-4b53-89fb-a8d602106b2b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:22.898296 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e8676044-00fe-4b53-89fb-a8d602106b2b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: bbcf6b9d-5ae8-4241-82bf-53f7f7959760] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:22.908193 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8676044-00fe-4b53-89fb-a8d602106b2b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:22.915165 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8676044-00fe-4b53-89fb-a8d602106b2b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:22.915640 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8676044-00fe-4b53-89fb-a8d602106b2b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:22.916397 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8676044-00fe-4b53-89fb-a8d602106b2b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:22.916869 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8676044-00fe-4b53-89fb-a8d602106b2b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:22.917821 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8676044-00fe-4b53-89fb-a8d602106b2b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:23.716184 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c27a192a-704c-4240-955d-3e4319453c15 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:23.738843 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c27a192a-704c-4240-955d-3e4319453c15 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953" status: 200 len: 1314 microversion: 2.1 time: 0.996290 Oct 23 01:32:23.764302 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2474/4872] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:22 2022] GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953 => generated 1314 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:23.787065 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5d4fecaf-57c1-409c-a794-635564f574ff tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:23.790179 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5d4fecaf-57c1-409c-a794-635564f574ff tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] [instance: 7181fffe-8915-49c2-826a-0fa8040dc941] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:23.806863 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5d4fecaf-57c1-409c-a794-635564f574ff tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:23.807846 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5d4fecaf-57c1-409c-a794-635564f574ff tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:23.809026 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5d4fecaf-57c1-409c-a794-635564f574ff tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:23.810953 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5d4fecaf-57c1-409c-a794-635564f574ff tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:23.811994 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5d4fecaf-57c1-409c-a794-635564f574ff tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:23.816163 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5d4fecaf-57c1-409c-a794-635564f574ff tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:24.065409 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e8676044-00fe-4b53-89fb-a8d602106b2b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:24.065409 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e8676044-00fe-4b53-89fb-a8d602106b2b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/bbcf6b9d-5ae8-4241-82bf-53f7f7959760" status: 200 len: 1308 microversion: 2.1 time: 1.158436 Oct 23 01:32:24.065409 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2399/4873] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:22 2022] GET /compute/v2.1/servers/bbcf6b9d-5ae8-4241-82bf-53f7f7959760 => generated 1308 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:24.065409 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f24c01f9-2620-41c2-aeda-94d096042dfe tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:24.065409 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f24c01f9-2620-41c2-aeda-94d096042dfe tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:24.074988 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f24c01f9-2620-41c2-aeda-94d096042dfe tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:24.076175 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f24c01f9-2620-41c2-aeda-94d096042dfe tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:24.077125 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f24c01f9-2620-41c2-aeda-94d096042dfe tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:24.078158 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f24c01f9-2620-41c2-aeda-94d096042dfe tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:24.078900 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f24c01f9-2620-41c2-aeda-94d096042dfe tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:24.079580 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f24c01f9-2620-41c2-aeda-94d096042dfe tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:24.945899 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5d4fecaf-57c1-409c-a794-635564f574ff tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3d3c6a02244888eebb6e70eaac4ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b051b0da0ab45ffa64c7b8b32465a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:24.963300 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5d4fecaf-57c1-409c-a794-635564f574ff tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] 10.222.0.42 "GET /compute/v2.1/servers/7181fffe-8915-49c2-826a-0fa8040dc941" status: 200 len: 1394 microversion: 2.1 time: 1.197405 Oct 23 01:32:24.970036 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2475/4874] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:23 2022] GET /compute/v2.1/servers/7181fffe-8915-49c2-826a-0fa8040dc941 => generated 1394 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:24.975339 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-e85464aa-dd39-45ab-908c-1ce934693a47 req-96a17179-5908-4468-b85e-cc1a7358e8b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbcf6b9d-5ae8-4241-82bf-53f7f7959760", "name": "network-vif-plugged", "status": "completed", "tag": "ba8ae4f3-2b75-4e12-be27-d652921b4240"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:32:25.017838 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-e85464aa-dd39-45ab-908c-1ce934693a47 req-96a17179-5908-4468-b85e-cc1a7358e8b4 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:25.024468 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-e85464aa-dd39-45ab-908c-1ce934693a47 req-96a17179-5908-4468-b85e-cc1a7358e8b4 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:25.025278 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-e85464aa-dd39-45ab-908c-1ce934693a47 req-96a17179-5908-4468-b85e-cc1a7358e8b4 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:25.034228 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f24c01f9-2620-41c2-aeda-94d096042dfe tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:25.061726 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f24c01f9-2620-41c2-aeda-94d096042dfe tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:25.065224 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f24c01f9-2620-41c2-aeda-94d096042dfe tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:25.069699 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f24c01f9-2620-41c2-aeda-94d096042dfe tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1729 microversion: 2.20 time: 1.012119 Oct 23 01:32:25.078468 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2400/4875] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:32:24 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1729 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:32:25.078653 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-e85464aa-dd39-45ab-908c-1ce934693a47 req-96a17179-5908-4468-b85e-cc1a7358e8b4 service nova] Creating event network-vif-plugged:ba8ae4f3-2b75-4e12-be27-d652921b4240 for instance bbcf6b9d-5ae8-4241-82bf-53f7f7959760 on n-h1-master-1 Oct 23 01:32:25.088480 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d75b6cae-48a7-4769-9361-c41b53fae3d0 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:25.093099 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-e85464aa-dd39-45ab-908c-1ce934693a47 req-96a17179-5908-4468-b85e-cc1a7358e8b4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121488 Oct 23 01:32:25.093749 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2476/4876] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:32:25.097792 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d75b6cae-48a7-4769-9361-c41b53fae3d0 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 9f9af130-5a0c-46f9-8449-fa9021e48953] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:25.112073 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d75b6cae-48a7-4769-9361-c41b53fae3d0 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:25.116824 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d75b6cae-48a7-4769-9361-c41b53fae3d0 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:25.116824 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d75b6cae-48a7-4769-9361-c41b53fae3d0 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:25.123007 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d75b6cae-48a7-4769-9361-c41b53fae3d0 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:25.125371 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d75b6cae-48a7-4769-9361-c41b53fae3d0 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:25.127470 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d75b6cae-48a7-4769-9361-c41b53fae3d0 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:25.141229 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cdaf31f0-5a78-4567-99af-6b8e747ec676 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:25.142026 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-cdaf31f0-5a78-4567-99af-6b8e747ec676 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: bbcf6b9d-5ae8-4241-82bf-53f7f7959760] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:25.218664 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cdaf31f0-5a78-4567-99af-6b8e747ec676 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:25.220847 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cdaf31f0-5a78-4567-99af-6b8e747ec676 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:25.222278 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cdaf31f0-5a78-4567-99af-6b8e747ec676 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:25.224348 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cdaf31f0-5a78-4567-99af-6b8e747ec676 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:25.231816 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cdaf31f0-5a78-4567-99af-6b8e747ec676 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:25.233334 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cdaf31f0-5a78-4567-99af-6b8e747ec676 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:26.595670 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d75b6cae-48a7-4769-9361-c41b53fae3d0 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:26.608187 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d75b6cae-48a7-4769-9361-c41b53fae3d0 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953" status: 200 len: 1314 microversion: 2.1 time: 1.536702 Oct 23 01:32:26.634409 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2401/4877] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:25 2022] GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953 => generated 1314 bytes in 1563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:26.641111 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f2a7eb8e-7755-493b-812f-e3381f8312d5 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:26.643184 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f2a7eb8e-7755-493b-812f-e3381f8312d5 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] [instance: 7181fffe-8915-49c2-826a-0fa8040dc941] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:26.662536 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f2a7eb8e-7755-493b-812f-e3381f8312d5 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:26.663336 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f2a7eb8e-7755-493b-812f-e3381f8312d5 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:26.663960 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f2a7eb8e-7755-493b-812f-e3381f8312d5 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:26.664877 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f2a7eb8e-7755-493b-812f-e3381f8312d5 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:26.665534 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f2a7eb8e-7755-493b-812f-e3381f8312d5 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:26.666142 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f2a7eb8e-7755-493b-812f-e3381f8312d5 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:27.028557 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cdaf31f0-5a78-4567-99af-6b8e747ec676 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:27.051731 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cdaf31f0-5a78-4567-99af-6b8e747ec676 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/bbcf6b9d-5ae8-4241-82bf-53f7f7959760" status: 200 len: 1308 microversion: 2.1 time: 1.944851 Oct 23 01:32:27.054277 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2477/4878] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:25 2022] GET /compute/v2.1/servers/bbcf6b9d-5ae8-4241-82bf-53f7f7959760 => generated 1308 bytes in 1948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:27.069313 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-df739b3f-69d7-4784-b98c-2dbd75a4910f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:27.073833 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-df739b3f-69d7-4784-b98c-2dbd75a4910f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:27.096158 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-df739b3f-69d7-4784-b98c-2dbd75a4910f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:27.101099 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-df739b3f-69d7-4784-b98c-2dbd75a4910f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:27.111648 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-df739b3f-69d7-4784-b98c-2dbd75a4910f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:27.111648 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-df739b3f-69d7-4784-b98c-2dbd75a4910f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:27.111648 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-df739b3f-69d7-4784-b98c-2dbd75a4910f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:27.111648 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-df739b3f-69d7-4784-b98c-2dbd75a4910f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:27.250747 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f2a7eb8e-7755-493b-812f-e3381f8312d5 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3d3c6a02244888eebb6e70eaac4ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b051b0da0ab45ffa64c7b8b32465a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:27.264943 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f2a7eb8e-7755-493b-812f-e3381f8312d5 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] 10.222.0.42 "GET /compute/v2.1/servers/7181fffe-8915-49c2-826a-0fa8040dc941" status: 200 len: 1394 microversion: 2.1 time: 0.628892 Oct 23 01:32:27.271091 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2402/4879] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:26 2022] GET /compute/v2.1/servers/7181fffe-8915-49c2-826a-0fa8040dc941 => generated 1394 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:27.284268 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-cbbbfb71-587d-47a2-8fd4-d69ca9ab872f req-70c63564-b96f-4f76-89e0-5480fcb33b12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78708eaa-2dad-44bc-a145-86dcc21ca804", "tag": "e46f5845-095b-423f-ab57-8b5a4b6fda52"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:32:27.316395 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-cbbbfb71-587d-47a2-8fd4-d69ca9ab872f req-70c63564-b96f-4f76-89e0-5480fcb33b12 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:27.318267 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-cbbbfb71-587d-47a2-8fd4-d69ca9ab872f req-70c63564-b96f-4f76-89e0-5480fcb33b12 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:27.321253 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-cbbbfb71-587d-47a2-8fd4-d69ca9ab872f req-70c63564-b96f-4f76-89e0-5480fcb33b12 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:27.388178 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-cbbbfb71-587d-47a2-8fd4-d69ca9ab872f req-70c63564-b96f-4f76-89e0-5480fcb33b12 service nova] Creating event network-changed:e46f5845-095b-423f-ab57-8b5a4b6fda52 for instance 78708eaa-2dad-44bc-a145-86dcc21ca804 on n-h1-master-1 Oct 23 01:32:27.408380 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-cbbbfb71-587d-47a2-8fd4-d69ca9ab872f req-70c63564-b96f-4f76-89e0-5480fcb33b12 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135159 Oct 23 01:32:27.409452 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2403/4880] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:32:27.430094 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-9252181a-5600-497e-9c02-c532e13b165e req-901d5ff1-5367-4b10-b541-efb8b9ac6449 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7181fffe-8915-49c2-826a-0fa8040dc941", "name": "network-vif-plugged", "status": "completed", "tag": "29153efe-3a7e-443e-80e2-bbce0757b30a"}, {"server_uuid": "9f9af130-5a0c-46f9-8449-fa9021e48953", "name": "network-vif-plugged", "status": "completed", "tag": "7253ced9-380e-48f5-bf48-cfbb43aded05"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:32:27.484881 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-9252181a-5600-497e-9c02-c532e13b165e req-901d5ff1-5367-4b10-b541-efb8b9ac6449 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:27.486509 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-9252181a-5600-497e-9c02-c532e13b165e req-901d5ff1-5367-4b10-b541-efb8b9ac6449 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:27.487171 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-9252181a-5600-497e-9c02-c532e13b165e req-901d5ff1-5367-4b10-b541-efb8b9ac6449 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:27.512749 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-9252181a-5600-497e-9c02-c532e13b165e req-901d5ff1-5367-4b10-b541-efb8b9ac6449 service nova] Creating event network-vif-plugged:29153efe-3a7e-443e-80e2-bbce0757b30a for instance 7181fffe-8915-49c2-826a-0fa8040dc941 on n-h2-master-1 Oct 23 01:32:27.518636 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-9252181a-5600-497e-9c02-c532e13b165e req-901d5ff1-5367-4b10-b541-efb8b9ac6449 service nova] Creating event network-vif-plugged:7253ced9-380e-48f5-bf48-cfbb43aded05 for instance 9f9af130-5a0c-46f9-8449-fa9021e48953 on n-h1-master-1 Oct 23 01:32:27.540116 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-9252181a-5600-497e-9c02-c532e13b165e req-901d5ff1-5367-4b10-b541-efb8b9ac6449 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.128832 Oct 23 01:32:27.541390 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2404/4881] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:32:27.637003 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-16c7173c-097b-4fe5-943d-196ab8d3a095 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:27.641314 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-16c7173c-097b-4fe5-943d-196ab8d3a095 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 9f9af130-5a0c-46f9-8449-fa9021e48953] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:27.649820 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-16c7173c-097b-4fe5-943d-196ab8d3a095 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:27.664596 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-16c7173c-097b-4fe5-943d-196ab8d3a095 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:27.664596 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-16c7173c-097b-4fe5-943d-196ab8d3a095 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:27.664596 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-16c7173c-097b-4fe5-943d-196ab8d3a095 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:27.664596 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-16c7173c-097b-4fe5-943d-196ab8d3a095 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:27.664596 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-16c7173c-097b-4fe5-943d-196ab8d3a095 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:27.698220 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-df739b3f-69d7-4784-b98c-2dbd75a4910f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:27.724247 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-df739b3f-69d7-4784-b98c-2dbd75a4910f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:27.737531 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-df739b3f-69d7-4784-b98c-2dbd75a4910f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:27.747833 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-df739b3f-69d7-4784-b98c-2dbd75a4910f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1729 microversion: 2.20 time: 0.687679 Oct 23 01:32:27.754112 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2478/4882] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:32:27 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1729 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:32:28.083199 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cd7cf761-d3fb-49e9-b2a3-7d21c9d9e4c9 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:28.083854 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-cd7cf761-d3fb-49e9-b2a3-7d21c9d9e4c9 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: bbcf6b9d-5ae8-4241-82bf-53f7f7959760] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:28.111123 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cd7cf761-d3fb-49e9-b2a3-7d21c9d9e4c9 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:28.113516 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cd7cf761-d3fb-49e9-b2a3-7d21c9d9e4c9 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:28.119611 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cd7cf761-d3fb-49e9-b2a3-7d21c9d9e4c9 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:28.120736 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cd7cf761-d3fb-49e9-b2a3-7d21c9d9e4c9 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:28.123868 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cd7cf761-d3fb-49e9-b2a3-7d21c9d9e4c9 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:28.125141 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cd7cf761-d3fb-49e9-b2a3-7d21c9d9e4c9 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:28.286539 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-16c7173c-097b-4fe5-943d-196ab8d3a095 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:28.300105 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-16c7173c-097b-4fe5-943d-196ab8d3a095 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953" status: 200 len: 1314 microversion: 2.1 time: 0.668377 Oct 23 01:32:28.300699 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2405/4883] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:27 2022] GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953 => generated 1314 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:32:28.306584 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b6bf4b8a-68fa-4659-9aed-c0695381d23b tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:28.307367 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b6bf4b8a-68fa-4659-9aed-c0695381d23b tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] [instance: 7181fffe-8915-49c2-826a-0fa8040dc941] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:28.314372 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b6bf4b8a-68fa-4659-9aed-c0695381d23b tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:28.315292 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b6bf4b8a-68fa-4659-9aed-c0695381d23b tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:28.315865 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b6bf4b8a-68fa-4659-9aed-c0695381d23b tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:28.316798 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b6bf4b8a-68fa-4659-9aed-c0695381d23b tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:28.317426 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b6bf4b8a-68fa-4659-9aed-c0695381d23b tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:28.318105 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b6bf4b8a-68fa-4659-9aed-c0695381d23b tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:28.383457 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cd7cf761-d3fb-49e9-b2a3-7d21c9d9e4c9 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:28.392422 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cd7cf761-d3fb-49e9-b2a3-7d21c9d9e4c9 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/bbcf6b9d-5ae8-4241-82bf-53f7f7959760" status: 200 len: 1308 microversion: 2.1 time: 0.313667 Oct 23 01:32:28.402255 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2479/4884] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:28 2022] GET /compute/v2.1/servers/bbcf6b9d-5ae8-4241-82bf-53f7f7959760 => generated 1308 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:28.508789 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b6bf4b8a-68fa-4659-9aed-c0695381d23b tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3d3c6a02244888eebb6e70eaac4ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b051b0da0ab45ffa64c7b8b32465a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:28.511575 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=100 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:32:28.525529 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b6bf4b8a-68fa-4659-9aed-c0695381d23b tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] 10.222.0.42 "GET /compute/v2.1/servers/7181fffe-8915-49c2-826a-0fa8040dc941" status: 200 len: 1394 microversion: 2.1 time: 0.223309 Oct 23 01:32:28.530160 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2406/4885] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:28 2022] GET /compute/v2.1/servers/7181fffe-8915-49c2-826a-0fa8040dc941 => generated 1394 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:28.779088 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-85238767-72d9-4fef-b31b-710939610677 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:28.779934 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-85238767-72d9-4fef-b31b-710939610677 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:28.787507 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-85238767-72d9-4fef-b31b-710939610677 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:28.788259 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-85238767-72d9-4fef-b31b-710939610677 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:28.788935 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-85238767-72d9-4fef-b31b-710939610677 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:28.789818 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-85238767-72d9-4fef-b31b-710939610677 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:28.790483 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-85238767-72d9-4fef-b31b-710939610677 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:28.791071 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-85238767-72d9-4fef-b31b-710939610677 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:29.143565 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-85238767-72d9-4fef-b31b-710939610677 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:29.165663 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-85238767-72d9-4fef-b31b-710939610677 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:29.176354 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-85238767-72d9-4fef-b31b-710939610677 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:29.184385 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-85238767-72d9-4fef-b31b-710939610677 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1729 microversion: 2.20 time: 0.403610 Oct 23 01:32:29.186685 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2480/4886] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:32:28 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1729 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:32:29.326501 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9369c4f9-472c-4de8-8287-aa741a637d3d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:29.327124 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9369c4f9-472c-4de8-8287-aa741a637d3d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 9f9af130-5a0c-46f9-8449-fa9021e48953] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:29.354032 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9369c4f9-472c-4de8-8287-aa741a637d3d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:29.366065 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9369c4f9-472c-4de8-8287-aa741a637d3d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:29.366065 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9369c4f9-472c-4de8-8287-aa741a637d3d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:29.366065 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9369c4f9-472c-4de8-8287-aa741a637d3d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:29.366065 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9369c4f9-472c-4de8-8287-aa741a637d3d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:29.366065 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9369c4f9-472c-4de8-8287-aa741a637d3d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:29.436454 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-63ac55b5-fc51-4a19-8023-24950df6d833 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:29.437153 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-63ac55b5-fc51-4a19-8023-24950df6d833 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: bbcf6b9d-5ae8-4241-82bf-53f7f7959760] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:29.467740 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-63ac55b5-fc51-4a19-8023-24950df6d833 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:29.477391 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-63ac55b5-fc51-4a19-8023-24950df6d833 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:29.481684 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-63ac55b5-fc51-4a19-8023-24950df6d833 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:29.489662 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-63ac55b5-fc51-4a19-8023-24950df6d833 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:29.496231 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-63ac55b5-fc51-4a19-8023-24950df6d833 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:29.498169 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-63ac55b5-fc51-4a19-8023-24950df6d833 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:30.018278 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9369c4f9-472c-4de8-8287-aa741a637d3d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:30.035053 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9369c4f9-472c-4de8-8287-aa741a637d3d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953" status: 200 len: 1314 microversion: 2.1 time: 0.713387 Oct 23 01:32:30.045708 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2407/4887] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:29 2022] GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953 => generated 1314 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:30.045708 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-397abd5d-ab68-44ec-987f-0ca045cd5835 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:30.045708 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-397abd5d-ab68-44ec-987f-0ca045cd5835 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] [instance: 7181fffe-8915-49c2-826a-0fa8040dc941] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:30.059109 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-397abd5d-ab68-44ec-987f-0ca045cd5835 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:30.059609 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-397abd5d-ab68-44ec-987f-0ca045cd5835 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:30.060051 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-397abd5d-ab68-44ec-987f-0ca045cd5835 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:30.060764 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-397abd5d-ab68-44ec-987f-0ca045cd5835 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:30.061220 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-397abd5d-ab68-44ec-987f-0ca045cd5835 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:30.061651 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-397abd5d-ab68-44ec-987f-0ca045cd5835 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:30.146575 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-63ac55b5-fc51-4a19-8023-24950df6d833 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:30.166945 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-63ac55b5-fc51-4a19-8023-24950df6d833 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/bbcf6b9d-5ae8-4241-82bf-53f7f7959760" status: 200 len: 1488 microversion: 2.1 time: 0.742587 Oct 23 01:32:30.179989 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2481/4888] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:29 2022] GET /compute/v2.1/servers/bbcf6b9d-5ae8-4241-82bf-53f7f7959760 => generated 1488 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:30.193276 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-2fb53e45-378c-4c0e-9c60-35bef1c0f9e0 req-18a2d548-97d1-48c4-bb4c-7a83ad45bda2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa616812-f379-45fb-8e7e-fefe7570dc98", "name": "network-vif-plugged", "status": "completed", "tag": "6de1369a-94d0-42a0-a57f-9deacb90b66f"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:32:30.215654 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-2fb53e45-378c-4c0e-9c60-35bef1c0f9e0 req-18a2d548-97d1-48c4-bb4c-7a83ad45bda2 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:30.216516 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-2fb53e45-378c-4c0e-9c60-35bef1c0f9e0 req-18a2d548-97d1-48c4-bb4c-7a83ad45bda2 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:30.217284 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-2fb53e45-378c-4c0e-9c60-35bef1c0f9e0 req-18a2d548-97d1-48c4-bb4c-7a83ad45bda2 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:30.241797 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-2fb53e45-378c-4c0e-9c60-35bef1c0f9e0 req-18a2d548-97d1-48c4-bb4c-7a83ad45bda2 service nova] Creating event network-vif-plugged:6de1369a-94d0-42a0-a57f-9deacb90b66f for instance fa616812-f379-45fb-8e7e-fefe7570dc98 on n-h1-master-1 Oct 23 01:32:30.255702 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-2fb53e45-378c-4c0e-9c60-35bef1c0f9e0 req-18a2d548-97d1-48c4-bb4c-7a83ad45bda2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075497 Oct 23 01:32:30.261703 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2482/4889] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:32:30.283890 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0cc79313-90e6-4da7-8007-cb3e3dee70e5 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:30.295449 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0cc79313-90e6-4da7-8007-cb3e3dee70e5 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: f7ade4c5-7f11-4df8-9775-7e790e4e4435] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:30.313358 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0cc79313-90e6-4da7-8007-cb3e3dee70e5 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:30.314342 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0cc79313-90e6-4da7-8007-cb3e3dee70e5 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:30.315489 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0cc79313-90e6-4da7-8007-cb3e3dee70e5 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:30.319879 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0cc79313-90e6-4da7-8007-cb3e3dee70e5 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:30.320734 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0cc79313-90e6-4da7-8007-cb3e3dee70e5 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:30.321822 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0cc79313-90e6-4da7-8007-cb3e3dee70e5 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:30.648732 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-397abd5d-ab68-44ec-987f-0ca045cd5835 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3d3c6a02244888eebb6e70eaac4ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b051b0da0ab45ffa64c7b8b32465a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:30.660532 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-397abd5d-ab68-44ec-987f-0ca045cd5835 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] 10.222.0.42 "GET /compute/v2.1/servers/7181fffe-8915-49c2-826a-0fa8040dc941" status: 200 len: 1574 microversion: 2.1 time: 0.623059 Oct 23 01:32:30.661159 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2408/4890] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:30 2022] GET /compute/v2.1/servers/7181fffe-8915-49c2-826a-0fa8040dc941 => generated 1574 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:30.681560 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9e5700f1-1d86-430f-b748-296a1fdf33e8 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:30.683250 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9e5700f1-1d86-430f-b748-296a1fdf33e8 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:30.700647 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e5700f1-1d86-430f-b748-296a1fdf33e8 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:30.701580 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e5700f1-1d86-430f-b748-296a1fdf33e8 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:30.702327 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e5700f1-1d86-430f-b748-296a1fdf33e8 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:30.707148 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e5700f1-1d86-430f-b748-296a1fdf33e8 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:30.707324 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e5700f1-1d86-430f-b748-296a1fdf33e8 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:30.707749 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e5700f1-1d86-430f-b748-296a1fdf33e8 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:30.982048 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0cc79313-90e6-4da7-8007-cb3e3dee70e5 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:31.000303 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0cc79313-90e6-4da7-8007-cb3e3dee70e5 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/f7ade4c5-7f11-4df8-9775-7e790e4e4435" status: 200 len: 1488 microversion: 2.1 time: 0.732336 Oct 23 01:32:31.010936 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2483/4891] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:30 2022] GET /compute/v2.1/servers/f7ade4c5-7f11-4df8-9775-7e790e4e4435 => generated 1488 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:31.016023 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c49181c7-d24e-4933-b32c-55da4b1cedca tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:31.016522 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c49181c7-d24e-4933-b32c-55da4b1cedca tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] [instance: 7181fffe-8915-49c2-826a-0fa8040dc941] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:31.043319 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c49181c7-d24e-4933-b32c-55da4b1cedca tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:31.043827 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c49181c7-d24e-4933-b32c-55da4b1cedca tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:31.044276 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c49181c7-d24e-4933-b32c-55da4b1cedca tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:31.044989 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c49181c7-d24e-4933-b32c-55da4b1cedca tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:31.045467 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c49181c7-d24e-4933-b32c-55da4b1cedca tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:31.045884 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c49181c7-d24e-4933-b32c-55da4b1cedca tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:31.157309 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9e5700f1-1d86-430f-b748-296a1fdf33e8 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:31.171254 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9e5700f1-1d86-430f-b748-296a1fdf33e8 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:31.178346 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9e5700f1-1d86-430f-b748-296a1fdf33e8 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:31.179701 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9e5700f1-1d86-430f-b748-296a1fdf33e8 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1729 microversion: 2.20 time: 0.513312 Oct 23 01:32:31.181050 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2409/4892] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:32:30 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1729 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:32:31.190648 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-54d9696f-f26a-4e11-b5af-75a420622264 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:31.191750 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-54d9696f-f26a-4e11-b5af-75a420622264 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: bbcf6b9d-5ae8-4241-82bf-53f7f7959760] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:31.221065 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54d9696f-f26a-4e11-b5af-75a420622264 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:31.221720 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54d9696f-f26a-4e11-b5af-75a420622264 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:31.222196 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54d9696f-f26a-4e11-b5af-75a420622264 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:31.223072 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54d9696f-f26a-4e11-b5af-75a420622264 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:31.223556 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54d9696f-f26a-4e11-b5af-75a420622264 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:31.223946 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54d9696f-f26a-4e11-b5af-75a420622264 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:31.303611 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c49181c7-d24e-4933-b32c-55da4b1cedca tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] 10.222.0.42 "GET /compute/v2.1/servers/7181fffe-8915-49c2-826a-0fa8040dc941/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.291381 Oct 23 01:32:31.304223 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2484/4893] 10.222.0.42 () {58 vars in 1275 bytes} [Sun Oct 23 01:32:31 2022] GET /compute/v2.1/servers/7181fffe-8915-49c2-826a-0fa8040dc941/os-interface => generated 284 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:32:31.312930 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9d57db7c-c8b7-4748-a549-0fee1eaace71 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:31.312930 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9d57db7c-c8b7-4748-a549-0fee1eaace71 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 9f9af130-5a0c-46f9-8449-fa9021e48953] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:31.330415 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9d57db7c-c8b7-4748-a549-0fee1eaace71 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:31.332173 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9d57db7c-c8b7-4748-a549-0fee1eaace71 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:31.332173 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9d57db7c-c8b7-4748-a549-0fee1eaace71 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:31.332173 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9d57db7c-c8b7-4748-a549-0fee1eaace71 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:31.332961 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9d57db7c-c8b7-4748-a549-0fee1eaace71 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:31.333063 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9d57db7c-c8b7-4748-a549-0fee1eaace71 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:31.824348 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9d57db7c-c8b7-4748-a549-0fee1eaace71 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:31.834162 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9d57db7c-c8b7-4748-a549-0fee1eaace71 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953" status: 200 len: 1501 microversion: 2.1 time: 0.528352 Oct 23 01:32:31.835455 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2485/4894] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:31 2022] GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953 => generated 1501 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:31.893018 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-54d9696f-f26a-4e11-b5af-75a420622264 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:31.911743 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-54d9696f-f26a-4e11-b5af-75a420622264 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/bbcf6b9d-5ae8-4241-82bf-53f7f7959760" status: 200 len: 1488 microversion: 2.1 time: 0.729393 Oct 23 01:32:31.913430 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2410/4895] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:31 2022] GET /compute/v2.1/servers/bbcf6b9d-5ae8-4241-82bf-53f7f7959760 => generated 1488 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:31.966902 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-25844013-04db-444c-9d10-8889e3df9292 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:31.967858 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-25844013-04db-444c-9d10-8889e3df9292 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: bbcf6b9d-5ae8-4241-82bf-53f7f7959760] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:31.990946 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25844013-04db-444c-9d10-8889e3df9292 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:32.004815 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25844013-04db-444c-9d10-8889e3df9292 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:32.005282 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25844013-04db-444c-9d10-8889e3df9292 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:32.006062 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25844013-04db-444c-9d10-8889e3df9292 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:32.006528 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25844013-04db-444c-9d10-8889e3df9292 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:32.006958 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25844013-04db-444c-9d10-8889e3df9292 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:32.207504 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-25844013-04db-444c-9d10-8889e3df9292 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: bbcf6b9d-5ae8-4241-82bf-53f7f7959760] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:32:32.210458 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9e686cc7-7367-457a-a44b-f8b18fb16305 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:32.211279 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9e686cc7-7367-457a-a44b-f8b18fb16305 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:32.218250 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e686cc7-7367-457a-a44b-f8b18fb16305 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:32.230810 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e686cc7-7367-457a-a44b-f8b18fb16305 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:32.231539 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e686cc7-7367-457a-a44b-f8b18fb16305 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:32.232496 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e686cc7-7367-457a-a44b-f8b18fb16305 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:32.235001 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e686cc7-7367-457a-a44b-f8b18fb16305 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:32.235531 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e686cc7-7367-457a-a44b-f8b18fb16305 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:32.687277 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9e686cc7-7367-457a-a44b-f8b18fb16305 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:32.698324 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9e686cc7-7367-457a-a44b-f8b18fb16305 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:32.700427 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9e686cc7-7367-457a-a44b-f8b18fb16305 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:32.702056 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9e686cc7-7367-457a-a44b-f8b18fb16305 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1729 microversion: 2.20 time: 0.497977 Oct 23 01:32:32.725411 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2411/4896] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:32:32 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1729 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:32:33.094015 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-25844013-04db-444c-9d10-8889e3df9292 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bbcf6b9d-5ae8-4241-82bf-53f7f7959760" status: 204 len: 0 microversion: 2.1 time: 1.144739 Oct 23 01:32:33.103203 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2486/4897] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:32:31 2022] DELETE /compute/v2.1/servers/bbcf6b9d-5ae8-4241-82bf-53f7f7959760 => generated 0 bytes in 1148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:32:33.109448 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a9821a4f-a81a-49d8-a57f-46b24dec281c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:33.109448 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a9821a4f-a81a-49d8-a57f-46b24dec281c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: bbcf6b9d-5ae8-4241-82bf-53f7f7959760] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:33.119478 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9821a4f-a81a-49d8-a57f-46b24dec281c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:33.121157 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9821a4f-a81a-49d8-a57f-46b24dec281c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:33.123705 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9821a4f-a81a-49d8-a57f-46b24dec281c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:33.124650 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9821a4f-a81a-49d8-a57f-46b24dec281c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:33.125420 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9821a4f-a81a-49d8-a57f-46b24dec281c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:33.129810 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9821a4f-a81a-49d8-a57f-46b24dec281c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:33.464561 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a9821a4f-a81a-49d8-a57f-46b24dec281c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:33.479963 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a9821a4f-a81a-49d8-a57f-46b24dec281c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/bbcf6b9d-5ae8-4241-82bf-53f7f7959760" status: 200 len: 1494 microversion: 2.1 time: 0.378638 Oct 23 01:32:33.504933 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2412/4898] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:33 2022] GET /compute/v2.1/servers/bbcf6b9d-5ae8-4241-82bf-53f7f7959760 => generated 1494 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:33.740699 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f9beb80f-47b3-4cf8-aa84-b62995d6224e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:33.744178 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f9beb80f-47b3-4cf8-aa84-b62995d6224e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:33.770208 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f9beb80f-47b3-4cf8-aa84-b62995d6224e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:33.770716 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f9beb80f-47b3-4cf8-aa84-b62995d6224e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:33.771075 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f9beb80f-47b3-4cf8-aa84-b62995d6224e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:33.781093 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f9beb80f-47b3-4cf8-aa84-b62995d6224e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:33.783057 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f9beb80f-47b3-4cf8-aa84-b62995d6224e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:33.786863 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f9beb80f-47b3-4cf8-aa84-b62995d6224e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:34.254883 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-11b8b041-f5e4-46e1-b324-fdf61f10399d tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:34.256413 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-11b8b041-f5e4-46e1-b324-fdf61f10399d tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] [instance: 7181fffe-8915-49c2-826a-0fa8040dc941] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:34.288758 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-11b8b041-f5e4-46e1-b324-fdf61f10399d tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:34.289652 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-11b8b041-f5e4-46e1-b324-fdf61f10399d tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:34.290220 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-11b8b041-f5e4-46e1-b324-fdf61f10399d tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:34.291088 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-11b8b041-f5e4-46e1-b324-fdf61f10399d tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:34.292186 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-11b8b041-f5e4-46e1-b324-fdf61f10399d tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:34.298862 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-11b8b041-f5e4-46e1-b324-fdf61f10399d tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:34.572239 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f9beb80f-47b3-4cf8-aa84-b62995d6224e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:34.598469 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f9beb80f-47b3-4cf8-aa84-b62995d6224e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:34.601532 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f9beb80f-47b3-4cf8-aa84-b62995d6224e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:34.613853 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f9beb80f-47b3-4cf8-aa84-b62995d6224e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1729 microversion: 2.20 time: 0.884845 Oct 23 01:32:34.614366 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2487/4899] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:32:33 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1729 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:32:34.633921 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-00f70c18-a218-4301-9224-4d519c82ecd6 req-fbbb4348-d17d-4618-99f7-064735d35994 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7181fffe-8915-49c2-826a-0fa8040dc941", "tag": "29153efe-3a7e-443e-80e2-bbce0757b30a"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:32:34.676171 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-00f70c18-a218-4301-9224-4d519c82ecd6 req-fbbb4348-d17d-4618-99f7-064735d35994 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:34.676671 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-00f70c18-a218-4301-9224-4d519c82ecd6 req-fbbb4348-d17d-4618-99f7-064735d35994 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:34.677327 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-00f70c18-a218-4301-9224-4d519c82ecd6 req-fbbb4348-d17d-4618-99f7-064735d35994 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:34.720921 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-00f70c18-a218-4301-9224-4d519c82ecd6 req-fbbb4348-d17d-4618-99f7-064735d35994 service nova] Creating event network-changed:29153efe-3a7e-443e-80e2-bbce0757b30a for instance 7181fffe-8915-49c2-826a-0fa8040dc941 on n-h2-master-1 Oct 23 01:32:34.735780 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-00f70c18-a218-4301-9224-4d519c82ecd6 req-fbbb4348-d17d-4618-99f7-064735d35994 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118871 Oct 23 01:32:34.744006 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2488/4900] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:32:34.758793 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ceb0ef03-195a-4026-9cec-f95928cbff2c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:34.760841 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ceb0ef03-195a-4026-9cec-f95928cbff2c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: bbcf6b9d-5ae8-4241-82bf-53f7f7959760] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:34.797198 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ceb0ef03-195a-4026-9cec-f95928cbff2c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:34.797847 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ceb0ef03-195a-4026-9cec-f95928cbff2c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:34.798440 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ceb0ef03-195a-4026-9cec-f95928cbff2c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:34.802661 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ceb0ef03-195a-4026-9cec-f95928cbff2c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:34.804492 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ceb0ef03-195a-4026-9cec-f95928cbff2c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:34.811099 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ceb0ef03-195a-4026-9cec-f95928cbff2c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:35.223976 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ceb0ef03-195a-4026-9cec-f95928cbff2c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:35.240002 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ceb0ef03-195a-4026-9cec-f95928cbff2c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/bbcf6b9d-5ae8-4241-82bf-53f7f7959760" status: 200 len: 1494 microversion: 2.1 time: 0.487799 Oct 23 01:32:35.240945 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2489/4901] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:34 2022] GET /compute/v2.1/servers/bbcf6b9d-5ae8-4241-82bf-53f7f7959760 => generated 1494 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:35.534125 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-11b8b041-f5e4-46e1-b324-fdf61f10399d tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3d3c6a02244888eebb6e70eaac4ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b051b0da0ab45ffa64c7b8b32465a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:35.548577 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-11b8b041-f5e4-46e1-b324-fdf61f10399d tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] 10.222.0.42 "GET /compute/v2.1/servers/7181fffe-8915-49c2-826a-0fa8040dc941" status: 200 len: 1574 microversion: 2.1 time: 1.296985 Oct 23 01:32:35.569399 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2413/4902] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:34 2022] GET /compute/v2.1/servers/7181fffe-8915-49c2-826a-0fa8040dc941 => generated 1574 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:32:35.643082 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a45b231c-a354-4eee-adda-d831c4d191e4 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:35.643730 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a45b231c-a354-4eee-adda-d831c4d191e4 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:35.651034 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a45b231c-a354-4eee-adda-d831c4d191e4 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:35.672219 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a45b231c-a354-4eee-adda-d831c4d191e4 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:35.672219 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a45b231c-a354-4eee-adda-d831c4d191e4 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:35.673651 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a45b231c-a354-4eee-adda-d831c4d191e4 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:35.674312 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a45b231c-a354-4eee-adda-d831c4d191e4 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:35.674793 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a45b231c-a354-4eee-adda-d831c4d191e4 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:36.199151 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-973b652f-94ab-41fb-b071-fdeca33e52ed req-656139a6-6987-402f-9aee-dbdfd8856a47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbcf6b9d-5ae8-4241-82bf-53f7f7959760", "name": "network-vif-deleted", "tag": "ba8ae4f3-2b75-4e12-be27-d652921b4240"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:32:36.212455 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a45b231c-a354-4eee-adda-d831c4d191e4 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:36.244026 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-973b652f-94ab-41fb-b071-fdeca33e52ed req-656139a6-6987-402f-9aee-dbdfd8856a47 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:36.244026 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-973b652f-94ab-41fb-b071-fdeca33e52ed req-656139a6-6987-402f-9aee-dbdfd8856a47 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:36.244292 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a45b231c-a354-4eee-adda-d831c4d191e4 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:36.244415 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-973b652f-94ab-41fb-b071-fdeca33e52ed req-656139a6-6987-402f-9aee-dbdfd8856a47 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:36.247206 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a45b231c-a354-4eee-adda-d831c4d191e4 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:36.268138 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a45b231c-a354-4eee-adda-d831c4d191e4 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1729 microversion: 2.20 time: 0.627045 Oct 23 01:32:36.276321 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2490/4903] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:32:35 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1729 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:32:36.285828 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-973b652f-94ab-41fb-b071-fdeca33e52ed req-656139a6-6987-402f-9aee-dbdfd8856a47 service nova] Creating event network-vif-deleted:ba8ae4f3-2b75-4e12-be27-d652921b4240 for instance bbcf6b9d-5ae8-4241-82bf-53f7f7959760 on n-h1-master-1 Oct 23 01:32:36.293462 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9f0d464f-6e2d-4b79-9be1-18b46c1bbb2b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:36.305220 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9f0d464f-6e2d-4b79-9be1-18b46c1bbb2b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: bbcf6b9d-5ae8-4241-82bf-53f7f7959760] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:36.306062 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-973b652f-94ab-41fb-b071-fdeca33e52ed req-656139a6-6987-402f-9aee-dbdfd8856a47 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110468 Oct 23 01:32:36.312676 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2414/4904] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:32:36.330010 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f0d464f-6e2d-4b79-9be1-18b46c1bbb2b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:36.335788 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f0d464f-6e2d-4b79-9be1-18b46c1bbb2b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:36.336840 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f0d464f-6e2d-4b79-9be1-18b46c1bbb2b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:36.337851 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f0d464f-6e2d-4b79-9be1-18b46c1bbb2b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:36.349760 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f0d464f-6e2d-4b79-9be1-18b46c1bbb2b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:36.353666 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f0d464f-6e2d-4b79-9be1-18b46c1bbb2b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:36.529554 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9f0d464f-6e2d-4b79-9be1-18b46c1bbb2b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:36.532955 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:32:36.543770 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9f0d464f-6e2d-4b79-9be1-18b46c1bbb2b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/bbcf6b9d-5ae8-4241-82bf-53f7f7959760" status: 200 len: 1293 microversion: 2.1 time: 0.265915 Oct 23 01:32:36.545478 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2491/4905] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:36 2022] GET /compute/v2.1/servers/bbcf6b9d-5ae8-4241-82bf-53f7f7959760 => generated 1293 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:37.134904 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9cb9acff-b96a-4024-a72d-183a281d9b30 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "698a0c56-0e36-483c-9cb9-6ac130f6547c"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:32:37.138705 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9cb9acff-b96a-4024-a72d-183a281d9b30 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 9f9af130-5a0c-46f9-8449-fa9021e48953] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:37.186270 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9cb9acff-b96a-4024-a72d-183a281d9b30 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:37.190947 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9cb9acff-b96a-4024-a72d-183a281d9b30 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:37.192193 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9cb9acff-b96a-4024-a72d-183a281d9b30 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:37.193041 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9cb9acff-b96a-4024-a72d-183a281d9b30 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:37.193514 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9cb9acff-b96a-4024-a72d-183a281d9b30 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:37.193948 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9cb9acff-b96a-4024-a72d-183a281d9b30 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:37.303830 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-02eea4cc-b2b5-47ab-961e-1d6a68cfc5f2 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:37.304549 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-02eea4cc-b2b5-47ab-961e-1d6a68cfc5f2 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:37.316710 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-02eea4cc-b2b5-47ab-961e-1d6a68cfc5f2 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:37.320039 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-02eea4cc-b2b5-47ab-961e-1d6a68cfc5f2 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:37.320683 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-02eea4cc-b2b5-47ab-961e-1d6a68cfc5f2 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:37.324441 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-02eea4cc-b2b5-47ab-961e-1d6a68cfc5f2 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:37.325078 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-02eea4cc-b2b5-47ab-961e-1d6a68cfc5f2 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:37.325703 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-02eea4cc-b2b5-47ab-961e-1d6a68cfc5f2 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:37.729855 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-02eea4cc-b2b5-47ab-961e-1d6a68cfc5f2 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:37.745338 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-02eea4cc-b2b5-47ab-961e-1d6a68cfc5f2 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:37.759596 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-02eea4cc-b2b5-47ab-961e-1d6a68cfc5f2 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:37.762390 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-02eea4cc-b2b5-47ab-961e-1d6a68cfc5f2 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1729 microversion: 2.20 time: 0.467334 Oct 23 01:32:37.763551 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2492/4906] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:32:37 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1729 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:32:37.768260 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-59912dbe-a1e8-4456-9ebe-0f6b4b3143a1 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:37.769062 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-59912dbe-a1e8-4456-9ebe-0f6b4b3143a1 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: bbcf6b9d-5ae8-4241-82bf-53f7f7959760] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:37.776370 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-59912dbe-a1e8-4456-9ebe-0f6b4b3143a1 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:37.777035 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-59912dbe-a1e8-4456-9ebe-0f6b4b3143a1 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:37.777650 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-59912dbe-a1e8-4456-9ebe-0f6b4b3143a1 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:37.778553 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-59912dbe-a1e8-4456-9ebe-0f6b4b3143a1 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:37.779172 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-59912dbe-a1e8-4456-9ebe-0f6b4b3143a1 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:37.779781 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-59912dbe-a1e8-4456-9ebe-0f6b4b3143a1 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:37.831491 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-59912dbe-a1e8-4456-9ebe-0f6b4b3143a1 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:37.832245 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-59912dbe-a1e8-4456-9ebe-0f6b4b3143a1 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:37.832899 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-59912dbe-a1e8-4456-9ebe-0f6b4b3143a1 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:37.833543 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-59912dbe-a1e8-4456-9ebe-0f6b4b3143a1 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lazy-loading 'fault' on Instance uuid bbcf6b9d-5ae8-4241-82bf-53f7f7959760 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:32:37.889447 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-59912dbe-a1e8-4456-9ebe-0f6b4b3143a1 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:37.899258 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-59912dbe-a1e8-4456-9ebe-0f6b4b3143a1 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/bbcf6b9d-5ae8-4241-82bf-53f7f7959760" status: 200 len: 1298 microversion: 2.1 time: 0.134661 Oct 23 01:32:37.900035 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2493/4907] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:37 2022] GET /compute/v2.1/servers/bbcf6b9d-5ae8-4241-82bf-53f7f7959760 => generated 1298 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:38.348923 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9cb9acff-b96a-4024-a72d-183a281d9b30 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "POST /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.219577 Oct 23 01:32:38.351202 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2415/4908] 10.222.0.42 () {60 vars in 1323 bytes} [Sun Oct 23 01:32:37 2022] POST /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953/os-volume_attachments => generated 194 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:32:38.791047 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-930e08d3-5474-40f1-928c-3ab87df8fb22 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:38.792228 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-930e08d3-5474-40f1-928c-3ab87df8fb22 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:38.804865 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-930e08d3-5474-40f1-928c-3ab87df8fb22 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:38.805593 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-930e08d3-5474-40f1-928c-3ab87df8fb22 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:38.806254 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-930e08d3-5474-40f1-928c-3ab87df8fb22 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:38.807988 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-930e08d3-5474-40f1-928c-3ab87df8fb22 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:38.809418 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-930e08d3-5474-40f1-928c-3ab87df8fb22 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:38.810057 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-930e08d3-5474-40f1-928c-3ab87df8fb22 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:38.927026 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0d5c0676-c0cc-4a16-a376-9ad64592c56e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:38.929862 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0d5c0676-c0cc-4a16-a376-9ad64592c56e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: bbcf6b9d-5ae8-4241-82bf-53f7f7959760] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:38.943979 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d5c0676-c0cc-4a16-a376-9ad64592c56e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:38.944476 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d5c0676-c0cc-4a16-a376-9ad64592c56e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:38.949949 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d5c0676-c0cc-4a16-a376-9ad64592c56e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:38.950979 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d5c0676-c0cc-4a16-a376-9ad64592c56e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:38.951615 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d5c0676-c0cc-4a16-a376-9ad64592c56e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:38.952200 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d5c0676-c0cc-4a16-a376-9ad64592c56e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:39.038992 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-0d5c0676-c0cc-4a16-a376-9ad64592c56e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] HTTP exception thrown: Instance bbcf6b9d-5ae8-4241-82bf-53f7f7959760 could not be found. Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0d5c0676-c0cc-4a16-a376-9ad64592c56e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Request method failure captured: Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/bbcf6b9d-5ae8-4241-82bf-53f7f7959760 HTTP/1.1 Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJkiigL5TCEu6eSSAcyvyVmYwcN25zFDHPVJqRKHbtxzIEn87jCeqAfp7Z9r3Mqhyb3sj4ihzI_o6sMFkrbUwNL-zNG9d9yXVxVjtum4uC7NU-HTDI6Yq0W2nY2ZxVUGKOV2HfdfrtC_JKFgX2qnR1YVSIaIVW5JxazPUN9LbJjq984 Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: e2ee2ea8399e42a5a5cd0d0ddeb192b5 Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServersTestJSON-245534565 Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}] Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServersTestJSON-245534565 Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: e2ee2ea8399e42a5a5cd0d0ddeb192b5 Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServersTestJSON-245534565 Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServersTestJSON-245534565-project Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 77197152ea5040bab602d5381d21341a Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServersTestJSON-245534565-project Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: exception: Instance bbcf6b9d-5ae8-4241-82bf-53f7f7959760 could not be found. Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'bbcf6b9d-5ae8-4241-82bf-53f7f7959760'} Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbcf6b9d-5ae8-4241-82bf-53f7f7959760 could not be found. Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbcf6b9d-5ae8-4241-82bf-53f7f7959760 could not be found. Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:32:39.041000 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:32:39.046311 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:32:39.046311 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:32:39.046311 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:32:39.046311 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:32:39.046311 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbcf6b9d-5ae8-4241-82bf-53f7f7959760 could not be found. Oct 23 01:32:39.046311 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:32:39.049832 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0d5c0676-c0cc-4a16-a376-9ad64592c56e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Returning 404 to user: Instance bbcf6b9d-5ae8-4241-82bf-53f7f7959760 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:32:39.051206 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0d5c0676-c0cc-4a16-a376-9ad64592c56e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/bbcf6b9d-5ae8-4241-82bf-53f7f7959760" status: 404 len: 111 microversion: 2.1 time: 0.128947 Oct 23 01:32:39.055828 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2416/4909] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:38 2022] GET /compute/v2.1/servers/bbcf6b9d-5ae8-4241-82bf-53f7f7959760 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:32:39.061769 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f86831f2-07fa-4f35-9d9e-beab6c2af382 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:39.075238 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f86831f2-07fa-4f35-9d9e-beab6c2af382 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: f7ade4c5-7f11-4df8-9775-7e790e4e4435] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:39.088709 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f86831f2-07fa-4f35-9d9e-beab6c2af382 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:39.088709 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f86831f2-07fa-4f35-9d9e-beab6c2af382 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:39.088709 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f86831f2-07fa-4f35-9d9e-beab6c2af382 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:39.088709 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f86831f2-07fa-4f35-9d9e-beab6c2af382 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:39.088709 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f86831f2-07fa-4f35-9d9e-beab6c2af382 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:39.089189 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f86831f2-07fa-4f35-9d9e-beab6c2af382 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:39.147395 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f86831f2-07fa-4f35-9d9e-beab6c2af382 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: f7ade4c5-7f11-4df8-9775-7e790e4e4435] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:32:39.281834 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-930e08d3-5474-40f1-928c-3ab87df8fb22 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:39.300672 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-930e08d3-5474-40f1-928c-3ab87df8fb22 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:39.302562 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-930e08d3-5474-40f1-928c-3ab87df8fb22 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:39.307958 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-930e08d3-5474-40f1-928c-3ab87df8fb22 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1729 microversion: 2.20 time: 0.517040 Oct 23 01:32:39.307958 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2494/4910] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:32:38 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1729 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:32:39.584948 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f86831f2-07fa-4f35-9d9e-beab6c2af382 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f7ade4c5-7f11-4df8-9775-7e790e4e4435" status: 204 len: 0 microversion: 2.1 time: 0.526747 Oct 23 01:32:39.591379 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2417/4911] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:32:39 2022] DELETE /compute/v2.1/servers/f7ade4c5-7f11-4df8-9775-7e790e4e4435 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:32:39.598478 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0db8145a-e920-4f1b-ba97-07f2b6e36ea1 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:39.599246 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0db8145a-e920-4f1b-ba97-07f2b6e36ea1 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: f7ade4c5-7f11-4df8-9775-7e790e4e4435] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:39.611997 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0db8145a-e920-4f1b-ba97-07f2b6e36ea1 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:39.626422 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0db8145a-e920-4f1b-ba97-07f2b6e36ea1 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:39.630772 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0db8145a-e920-4f1b-ba97-07f2b6e36ea1 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:39.632155 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0db8145a-e920-4f1b-ba97-07f2b6e36ea1 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:39.636330 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0db8145a-e920-4f1b-ba97-07f2b6e36ea1 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:39.638880 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0db8145a-e920-4f1b-ba97-07f2b6e36ea1 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:39.992454 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0db8145a-e920-4f1b-ba97-07f2b6e36ea1 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:40.007221 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0db8145a-e920-4f1b-ba97-07f2b6e36ea1 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/f7ade4c5-7f11-4df8-9775-7e790e4e4435" status: 200 len: 1494 microversion: 2.1 time: 0.412570 Oct 23 01:32:40.007828 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2495/4912] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:39 2022] GET /compute/v2.1/servers/f7ade4c5-7f11-4df8-9775-7e790e4e4435 => generated 1494 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:40.336202 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f8377730-d82b-40a2-9a0b-2310b551164f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:40.337186 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f8377730-d82b-40a2-9a0b-2310b551164f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:40.354851 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f8377730-d82b-40a2-9a0b-2310b551164f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:40.358454 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f8377730-d82b-40a2-9a0b-2310b551164f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:40.359270 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f8377730-d82b-40a2-9a0b-2310b551164f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:40.364951 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f8377730-d82b-40a2-9a0b-2310b551164f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:40.367494 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f8377730-d82b-40a2-9a0b-2310b551164f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:40.368235 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f8377730-d82b-40a2-9a0b-2310b551164f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:40.819523 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f8377730-d82b-40a2-9a0b-2310b551164f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:40.828997 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f8377730-d82b-40a2-9a0b-2310b551164f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:40.830633 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f8377730-d82b-40a2-9a0b-2310b551164f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:40.831817 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f8377730-d82b-40a2-9a0b-2310b551164f tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1729 microversion: 2.20 time: 0.501301 Oct 23 01:32:40.845998 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2418/4913] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:32:40 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1729 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:32:41.035647 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-56508330-0486-443c-bb05-794881639cd7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:41.036279 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-56508330-0486-443c-bb05-794881639cd7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: f7ade4c5-7f11-4df8-9775-7e790e4e4435] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:41.059859 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:32:41.088723 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-56508330-0486-443c-bb05-794881639cd7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:41.097262 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-56508330-0486-443c-bb05-794881639cd7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:41.098265 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-56508330-0486-443c-bb05-794881639cd7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:41.099672 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-56508330-0486-443c-bb05-794881639cd7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:41.100514 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-56508330-0486-443c-bb05-794881639cd7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:41.113640 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-56508330-0486-443c-bb05-794881639cd7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:41.436671 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-56508330-0486-443c-bb05-794881639cd7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:41.454287 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-56508330-0486-443c-bb05-794881639cd7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/f7ade4c5-7f11-4df8-9775-7e790e4e4435" status: 200 len: 1494 microversion: 2.1 time: 0.422922 Oct 23 01:32:41.501551 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2496/4914] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:41 2022] GET /compute/v2.1/servers/f7ade4c5-7f11-4df8-9775-7e790e4e4435 => generated 1494 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:41.861386 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d64660e1-1155-40a8-bd52-f47d7eb68f15 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:41.872143 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d64660e1-1155-40a8-bd52-f47d7eb68f15 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:41.882295 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d64660e1-1155-40a8-bd52-f47d7eb68f15 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:41.882883 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d64660e1-1155-40a8-bd52-f47d7eb68f15 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:41.883328 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d64660e1-1155-40a8-bd52-f47d7eb68f15 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:41.884092 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d64660e1-1155-40a8-bd52-f47d7eb68f15 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:41.884955 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d64660e1-1155-40a8-bd52-f47d7eb68f15 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:41.885393 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d64660e1-1155-40a8-bd52-f47d7eb68f15 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:42.185295 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-45929619-24df-46fd-8b3a-3af7ebbd445e req-e3f79200-ef55-4816-ad6d-e3692f0ac716 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7ade4c5-7f11-4df8-9775-7e790e4e4435", "name": "network-vif-deleted", "tag": "1d8a3331-8eb4-4bdd-9aef-8f6329fafd67"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:32:42.217628 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-45929619-24df-46fd-8b3a-3af7ebbd445e req-e3f79200-ef55-4816-ad6d-e3692f0ac716 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:42.219987 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-45929619-24df-46fd-8b3a-3af7ebbd445e req-e3f79200-ef55-4816-ad6d-e3692f0ac716 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:42.222220 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-45929619-24df-46fd-8b3a-3af7ebbd445e req-e3f79200-ef55-4816-ad6d-e3692f0ac716 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:42.283994 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-45929619-24df-46fd-8b3a-3af7ebbd445e req-e3f79200-ef55-4816-ad6d-e3692f0ac716 service nova] Creating event network-vif-deleted:1d8a3331-8eb4-4bdd-9aef-8f6329fafd67 for instance f7ade4c5-7f11-4df8-9775-7e790e4e4435 on n-h2-master-1 Oct 23 01:32:42.303230 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-45929619-24df-46fd-8b3a-3af7ebbd445e req-e3f79200-ef55-4816-ad6d-e3692f0ac716 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122940 Oct 23 01:32:42.309476 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2497/4915] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:32:42.310717 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d64660e1-1155-40a8-bd52-f47d7eb68f15 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:42.319854 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d64660e1-1155-40a8-bd52-f47d7eb68f15 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:42.321320 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d64660e1-1155-40a8-bd52-f47d7eb68f15 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:42.323074 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d64660e1-1155-40a8-bd52-f47d7eb68f15 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1729 microversion: 2.20 time: 0.469726 Oct 23 01:32:42.323648 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2419/4916] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:32:41 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1729 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:32:42.496008 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ebedd004-7f46-4863-a8ba-13a8fcf3259a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:42.497048 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ebedd004-7f46-4863-a8ba-13a8fcf3259a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: f7ade4c5-7f11-4df8-9775-7e790e4e4435] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:42.508243 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ebedd004-7f46-4863-a8ba-13a8fcf3259a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:42.509179 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ebedd004-7f46-4863-a8ba-13a8fcf3259a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:42.517326 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ebedd004-7f46-4863-a8ba-13a8fcf3259a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:42.518446 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ebedd004-7f46-4863-a8ba-13a8fcf3259a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:42.519240 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ebedd004-7f46-4863-a8ba-13a8fcf3259a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:42.519930 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ebedd004-7f46-4863-a8ba-13a8fcf3259a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:42.703723 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ebedd004-7f46-4863-a8ba-13a8fcf3259a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:42.714060 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ebedd004-7f46-4863-a8ba-13a8fcf3259a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/f7ade4c5-7f11-4df8-9775-7e790e4e4435" status: 200 len: 1293 microversion: 2.1 time: 0.224023 Oct 23 01:32:42.730157 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2498/4917] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:42 2022] GET /compute/v2.1/servers/f7ade4c5-7f11-4df8-9775-7e790e4e4435 => generated 1293 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:42.932418 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-b0879fed-469c-432a-a109-27260f1115cf req-625f9740-ae57-4c5b-85b0-2a727c2c47de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1d0765d-d720-40d2-b168-058e013fab0a", "name": "network-vif-plugged", "status": "completed", "tag": "9d275317-d5ad-4bae-8215-25b674a45c60"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:32:42.961676 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-b0879fed-469c-432a-a109-27260f1115cf req-625f9740-ae57-4c5b-85b0-2a727c2c47de service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:42.961676 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-b0879fed-469c-432a-a109-27260f1115cf req-625f9740-ae57-4c5b-85b0-2a727c2c47de service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:42.962428 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-b0879fed-469c-432a-a109-27260f1115cf req-625f9740-ae57-4c5b-85b0-2a727c2c47de service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:42.997858 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-b0879fed-469c-432a-a109-27260f1115cf req-625f9740-ae57-4c5b-85b0-2a727c2c47de service nova] Creating event network-vif-plugged:9d275317-d5ad-4bae-8215-25b674a45c60 for instance b1d0765d-d720-40d2-b168-058e013fab0a on n-h2-master-1 Oct 23 01:32:43.004214 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-b0879fed-469c-432a-a109-27260f1115cf req-625f9740-ae57-4c5b-85b0-2a727c2c47de service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076905 Oct 23 01:32:43.005447 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2420/4918] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:32:43.353310 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7617eee2-dee5-413f-b655-d72c6141b825 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:43.355200 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7617eee2-dee5-413f-b655-d72c6141b825 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:43.365508 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7617eee2-dee5-413f-b655-d72c6141b825 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:43.373402 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7617eee2-dee5-413f-b655-d72c6141b825 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:43.373866 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7617eee2-dee5-413f-b655-d72c6141b825 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:43.374645 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7617eee2-dee5-413f-b655-d72c6141b825 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:43.375208 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7617eee2-dee5-413f-b655-d72c6141b825 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:43.375657 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7617eee2-dee5-413f-b655-d72c6141b825 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:43.745353 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-29e319f4-12dd-439e-8668-5d762dcea65f tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:43.746232 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-29e319f4-12dd-439e-8668-5d762dcea65f tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: f7ade4c5-7f11-4df8-9775-7e790e4e4435] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:43.763377 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-29e319f4-12dd-439e-8668-5d762dcea65f tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:43.768882 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-29e319f4-12dd-439e-8668-5d762dcea65f tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:43.772151 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-29e319f4-12dd-439e-8668-5d762dcea65f tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:43.773300 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-29e319f4-12dd-439e-8668-5d762dcea65f tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:43.776273 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-29e319f4-12dd-439e-8668-5d762dcea65f tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:43.779337 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-29e319f4-12dd-439e-8668-5d762dcea65f tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:43.951735 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-29e319f4-12dd-439e-8668-5d762dcea65f tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:43.952424 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-29e319f4-12dd-439e-8668-5d762dcea65f tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:43.961105 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-29e319f4-12dd-439e-8668-5d762dcea65f tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:43.964425 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-29e319f4-12dd-439e-8668-5d762dcea65f tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lazy-loading 'fault' on Instance uuid f7ade4c5-7f11-4df8-9775-7e790e4e4435 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:32:44.519961 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-29e319f4-12dd-439e-8668-5d762dcea65f tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:44.528492 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-29e319f4-12dd-439e-8668-5d762dcea65f tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/f7ade4c5-7f11-4df8-9775-7e790e4e4435" status: 200 len: 1298 microversion: 2.1 time: 0.787934 Oct 23 01:32:44.531344 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2421/4919] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:43 2022] GET /compute/v2.1/servers/f7ade4c5-7f11-4df8-9775-7e790e4e4435 => generated 1298 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:32:44.608349 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7617eee2-dee5-413f-b655-d72c6141b825 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:44.624599 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7617eee2-dee5-413f-b655-d72c6141b825 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:44.626626 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7617eee2-dee5-413f-b655-d72c6141b825 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:44.628066 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7617eee2-dee5-413f-b655-d72c6141b825 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1729 microversion: 2.20 time: 1.279043 Oct 23 01:32:44.635293 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2499/4920] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:32:43 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1729 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:32:45.561386 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a014e908-5568-4a74-a3d6-823f19e18c2a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:45.564217 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a014e908-5568-4a74-a3d6-823f19e18c2a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: f7ade4c5-7f11-4df8-9775-7e790e4e4435] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:45.577363 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a014e908-5568-4a74-a3d6-823f19e18c2a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:45.578831 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a014e908-5568-4a74-a3d6-823f19e18c2a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:45.580451 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a014e908-5568-4a74-a3d6-823f19e18c2a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:45.581268 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a014e908-5568-4a74-a3d6-823f19e18c2a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:45.587143 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a014e908-5568-4a74-a3d6-823f19e18c2a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:45.588215 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a014e908-5568-4a74-a3d6-823f19e18c2a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:45.596557 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:32:45.619545 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-a014e908-5568-4a74-a3d6-823f19e18c2a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] HTTP exception thrown: Instance f7ade4c5-7f11-4df8-9775-7e790e4e4435 could not be found. Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a014e908-5568-4a74-a3d6-823f19e18c2a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Request method failure captured: Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/f7ade4c5-7f11-4df8-9775-7e790e4e4435 HTTP/1.1 Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJkiigL5TCEu6eSSAcyvyVmYwcN25zFDHPVJqRKHbtxzIEn87jCeqAfp7Z9r3Mqhyb3sj4ihzI_o6sMFkrbUwNL-zNG9d9yXVxVjtum4uC7NU-HTDI6Yq0W2nY2ZxVUGKOV2HfdfrtC_JKFgX2qnR1YVSIaIVW5JxazPUN9LbJjq984 Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: e2ee2ea8399e42a5a5cd0d0ddeb192b5 Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServersTestJSON-245534565 Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}] Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServersTestJSON-245534565 Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: e2ee2ea8399e42a5a5cd0d0ddeb192b5 Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServersTestJSON-245534565 Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServersTestJSON-245534565-project Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 77197152ea5040bab602d5381d21341a Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServersTestJSON-245534565-project Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: exception: Instance f7ade4c5-7f11-4df8-9775-7e790e4e4435 could not be found. Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'f7ade4c5-7f11-4df8-9775-7e790e4e4435'} Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7ade4c5-7f11-4df8-9775-7e790e4e4435 could not be found. Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7ade4c5-7f11-4df8-9775-7e790e4e4435 could not be found. Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:32:45.628471 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:32:45.633042 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:32:45.633042 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:32:45.633042 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:32:45.633042 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:32:45.633042 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7ade4c5-7f11-4df8-9775-7e790e4e4435 could not be found. Oct 23 01:32:45.633042 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:32:45.635118 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a014e908-5568-4a74-a3d6-823f19e18c2a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Returning 404 to user: Instance f7ade4c5-7f11-4df8-9775-7e790e4e4435 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:32:45.636293 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a014e908-5568-4a74-a3d6-823f19e18c2a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/f7ade4c5-7f11-4df8-9775-7e790e4e4435" status: 404 len: 111 microversion: 2.1 time: 0.079978 Oct 23 01:32:45.637441 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2422/4921] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:45 2022] GET /compute/v2.1/servers/f7ade4c5-7f11-4df8-9775-7e790e4e4435 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:32:45.658738 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-12f5f921-2aad-4dbf-a154-22ac052899dc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:45.659361 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-12f5f921-2aad-4dbf-a154-22ac052899dc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:45.677380 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-12f5f921-2aad-4dbf-a154-22ac052899dc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:45.677881 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-12f5f921-2aad-4dbf-a154-22ac052899dc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:45.678346 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-12f5f921-2aad-4dbf-a154-22ac052899dc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:45.690928 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-12f5f921-2aad-4dbf-a154-22ac052899dc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:45.691651 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-12f5f921-2aad-4dbf-a154-22ac052899dc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:45.692315 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-12f5f921-2aad-4dbf-a154-22ac052899dc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:45.789691 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-83c0e4cb-291f-4ed4-b6c3-773202732371 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1250832653", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "54c8030f-5807-4507-8aa3-283b114a73f4"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:32:45.865916 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-83c0e4cb-291f-4ed4-b6c3-773202732371 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] validate_networks() for [('54c8030f-5807-4507-8aa3-283b114a73f4', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:32:46.008915 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-12f5f921-2aad-4dbf-a154-22ac052899dc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:46.021444 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-12f5f921-2aad-4dbf-a154-22ac052899dc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:46.024296 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-12f5f921-2aad-4dbf-a154-22ac052899dc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:46.030764 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-12f5f921-2aad-4dbf-a154-22ac052899dc tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1729 microversion: 2.20 time: 0.375774 Oct 23 01:32:46.034858 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2500/4922] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:32:45 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1729 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:32:46.040206 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c48e0e80-5f07-4339-a84a-272b5e11f10e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:46.041075 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c48e0e80-5f07-4339-a84a-272b5e11f10e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:46.050094 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c48e0e80-5f07-4339-a84a-272b5e11f10e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:46.055116 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c48e0e80-5f07-4339-a84a-272b5e11f10e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:46.060710 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c48e0e80-5f07-4339-a84a-272b5e11f10e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:46.060710 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c48e0e80-5f07-4339-a84a-272b5e11f10e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:46.061310 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c48e0e80-5f07-4339-a84a-272b5e11f10e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:46.061909 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c48e0e80-5f07-4339-a84a-272b5e11f10e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:46.379522 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c48e0e80-5f07-4339-a84a-272b5e11f10e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:46.393109 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c48e0e80-5f07-4339-a84a-272b5e11f10e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1682 microversion: 2.1 time: 0.360464 Oct 23 01:32:46.395765 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2501/4923] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:46 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1682 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:46.568312 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-83c0e4cb-291f-4ed4-b6c3-773202732371 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:32:46.568772 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-83c0e4cb-291f-4ed4-b6c3-773202732371 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:32:46.569513 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-83c0e4cb-291f-4ed4-b6c3-773202732371 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:32:46.570493 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-83c0e4cb-291f-4ed4-b6c3-773202732371 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:32:46.570978 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-83c0e4cb-291f-4ed4-b6c3-773202732371 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:32:46.601379 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83c0e4cb-291f-4ed4-b6c3-773202732371 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:46.601379 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83c0e4cb-291f-4ed4-b6c3-773202732371 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:46.601379 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83c0e4cb-291f-4ed4-b6c3-773202732371 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:46.601379 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83c0e4cb-291f-4ed4-b6c3-773202732371 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:46.601379 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83c0e4cb-291f-4ed4-b6c3-773202732371 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:46.601379 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83c0e4cb-291f-4ed4-b6c3-773202732371 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:46.641782 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-83c0e4cb-291f-4ed4-b6c3-773202732371 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Getting quotas for project e2ee2ea8399e42a5a5cd0d0ddeb192b5. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:32:46.649553 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-83c0e4cb-291f-4ed4-b6c3-773202732371 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Getting quotas for user 77197152ea5040bab602d5381d21341a and project e2ee2ea8399e42a5a5cd0d0ddeb192b5. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:32:46.667213 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-83c0e4cb-291f-4ed4-b6c3-773202732371 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:32:46.670458 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-83c0e4cb-291f-4ed4-b6c3-773202732371 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: c8eed771-da93-492d-bb34-5020c379fb63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:32:46.958168 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-83c0e4cb-291f-4ed4-b6c3-773202732371 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.169076 Oct 23 01:32:46.962382 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2423/4924] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:32:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1178 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 23 01:32:46.981480 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b858b9b5-a42d-4559-8a2a-56369757d019 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:46.982173 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b858b9b5-a42d-4559-8a2a-56369757d019 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: c8eed771-da93-492d-bb34-5020c379fb63] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:47.060796 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-57714aa1-c719-4e63-8ee8-389cd8cc12da tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:47.061865 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-57714aa1-c719-4e63-8ee8-389cd8cc12da tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:47.079082 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-57714aa1-c719-4e63-8ee8-389cd8cc12da tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:47.079082 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-57714aa1-c719-4e63-8ee8-389cd8cc12da tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:47.079082 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-57714aa1-c719-4e63-8ee8-389cd8cc12da tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:47.079082 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-57714aa1-c719-4e63-8ee8-389cd8cc12da tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:47.080761 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-57714aa1-c719-4e63-8ee8-389cd8cc12da tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:47.082043 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-57714aa1-c719-4e63-8ee8-389cd8cc12da tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:47.163471 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b858b9b5-a42d-4559-8a2a-56369757d019 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:47.171944 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b858b9b5-a42d-4559-8a2a-56369757d019 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/c8eed771-da93-492d-bb34-5020c379fb63" status: 200 len: 1209 microversion: 2.1 time: 0.204332 Oct 23 01:32:47.173538 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2502/4925] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:46 2022] GET /compute/v2.1/servers/c8eed771-da93-492d-bb34-5020c379fb63 => generated 1209 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:32:47.422361 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-22fa621e-8ea9-42cd-ae50-a3541f1caab7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:47.424165 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-22fa621e-8ea9-42cd-ae50-a3541f1caab7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:47.432497 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-22fa621e-8ea9-42cd-ae50-a3541f1caab7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:47.432998 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-22fa621e-8ea9-42cd-ae50-a3541f1caab7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:47.433436 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-22fa621e-8ea9-42cd-ae50-a3541f1caab7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:47.445073 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-22fa621e-8ea9-42cd-ae50-a3541f1caab7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:47.447644 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-22fa621e-8ea9-42cd-ae50-a3541f1caab7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:47.447644 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-22fa621e-8ea9-42cd-ae50-a3541f1caab7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:47.682264 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-57714aa1-c719-4e63-8ee8-389cd8cc12da tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:47.710604 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-57714aa1-c719-4e63-8ee8-389cd8cc12da tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:47.716045 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-57714aa1-c719-4e63-8ee8-389cd8cc12da tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:47.719421 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-57714aa1-c719-4e63-8ee8-389cd8cc12da tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1729 microversion: 2.20 time: 0.662399 Oct 23 01:32:47.720010 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2424/4926] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:32:47 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1729 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:32:47.858109 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-22fa621e-8ea9-42cd-ae50-a3541f1caab7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:47.869644 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-22fa621e-8ea9-42cd-ae50-a3541f1caab7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1669 microversion: 2.1 time: 0.451998 Oct 23 01:32:47.870331 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2503/4927] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:47 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1669 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:32:47.895871 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c198e627-ce32-43a7-9b4a-f6035e69f037 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1196346431"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:32:47.898527 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c198e627-ce32-43a7-9b4a-f6035e69f037 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:47.905310 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c198e627-ce32-43a7-9b4a-f6035e69f037 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:47.905805 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c198e627-ce32-43a7-9b4a-f6035e69f037 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:47.906435 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c198e627-ce32-43a7-9b4a-f6035e69f037 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:47.907136 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c198e627-ce32-43a7-9b4a-f6035e69f037 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:47.907599 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c198e627-ce32-43a7-9b4a-f6035e69f037 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:47.908023 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c198e627-ce32-43a7-9b4a-f6035e69f037 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:48.200445 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5d45c1ff-d674-4d9a-86fa-7a4bd9b0e893 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:48.201158 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5d45c1ff-d674-4d9a-86fa-7a4bd9b0e893 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: c8eed771-da93-492d-bb34-5020c379fb63] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:48.294802 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5d45c1ff-d674-4d9a-86fa-7a4bd9b0e893 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:48.303612 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5d45c1ff-d674-4d9a-86fa-7a4bd9b0e893 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/c8eed771-da93-492d-bb34-5020c379fb63" status: 200 len: 1209 microversion: 2.1 time: 0.109425 Oct 23 01:32:48.325045 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2504/4928] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:48 2022] GET /compute/v2.1/servers/c8eed771-da93-492d-bb34-5020c379fb63 => generated 1209 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:48.554618 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c198e627-ce32-43a7-9b4a-f6035e69f037 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "POST /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98/action" status: 202 len: 0 microversion: 2.1 time: 0.663005 Oct 23 01:32:48.569557 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2425/4929] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:32:47 2022] POST /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98/action => generated 0 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 23 01:32:48.748949 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2e45cb7e-66b8-4d33-b65d-a50a8bb20528 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:48.749573 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2e45cb7e-66b8-4d33-b65d-a50a8bb20528 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:48.761661 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e45cb7e-66b8-4d33-b65d-a50a8bb20528 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:48.767896 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e45cb7e-66b8-4d33-b65d-a50a8bb20528 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:48.768375 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e45cb7e-66b8-4d33-b65d-a50a8bb20528 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:48.769141 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e45cb7e-66b8-4d33-b65d-a50a8bb20528 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:48.769619 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e45cb7e-66b8-4d33-b65d-a50a8bb20528 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:48.770699 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e45cb7e-66b8-4d33-b65d-a50a8bb20528 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:48.970869 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2e45cb7e-66b8-4d33-b65d-a50a8bb20528 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:48.980546 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2e45cb7e-66b8-4d33-b65d-a50a8bb20528 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:48.982326 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2e45cb7e-66b8-4d33-b65d-a50a8bb20528 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:48.983911 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2e45cb7e-66b8-4d33-b65d-a50a8bb20528 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1716 microversion: 2.20 time: 0.239099 Oct 23 01:32:48.984961 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2505/4930] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:32:48 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1716 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:32:49.336150 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-27420dbd-f7da-4080-8c90-cfc24b26e466 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:49.340110 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-27420dbd-f7da-4080-8c90-cfc24b26e466 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: c8eed771-da93-492d-bb34-5020c379fb63] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:49.343634 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:32:49.345665 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-27420dbd-f7da-4080-8c90-cfc24b26e466 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:49.346249 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-27420dbd-f7da-4080-8c90-cfc24b26e466 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:49.349700 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-27420dbd-f7da-4080-8c90-cfc24b26e466 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:49.349700 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-27420dbd-f7da-4080-8c90-cfc24b26e466 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:49.349700 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-27420dbd-f7da-4080-8c90-cfc24b26e466 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:49.349700 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-27420dbd-f7da-4080-8c90-cfc24b26e466 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:49.449035 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-27420dbd-f7da-4080-8c90-cfc24b26e466 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:49.458057 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-27420dbd-f7da-4080-8c90-cfc24b26e466 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/c8eed771-da93-492d-bb34-5020c379fb63" status: 200 len: 1261 microversion: 2.1 time: 0.126893 Oct 23 01:32:49.459492 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2426/4931] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:49 2022] GET /compute/v2.1/servers/c8eed771-da93-492d-bb34-5020c379fb63 => generated 1261 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:50.485384 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2c13afa5-f16e-43f8-81dc-25202b2adabe tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:50.486176 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2c13afa5-f16e-43f8-81dc-25202b2adabe tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: c8eed771-da93-492d-bb34-5020c379fb63] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:50.492994 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2c13afa5-f16e-43f8-81dc-25202b2adabe tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:50.493509 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2c13afa5-f16e-43f8-81dc-25202b2adabe tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:50.494007 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2c13afa5-f16e-43f8-81dc-25202b2adabe tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:50.494697 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2c13afa5-f16e-43f8-81dc-25202b2adabe tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:50.495332 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2c13afa5-f16e-43f8-81dc-25202b2adabe tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:50.495787 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2c13afa5-f16e-43f8-81dc-25202b2adabe tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:50.561025 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2c13afa5-f16e-43f8-81dc-25202b2adabe tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:50.569086 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2c13afa5-f16e-43f8-81dc-25202b2adabe tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/c8eed771-da93-492d-bb34-5020c379fb63" status: 200 len: 1267 microversion: 2.1 time: 0.087801 Oct 23 01:32:50.569657 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2506/4932] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:50 2022] GET /compute/v2.1/servers/c8eed771-da93-492d-bb34-5020c379fb63 => generated 1267 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:51.356892 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-822311a7-f9c2-479a-9789-345d4cb17531 req-037e4ce6-9c48-4caf-8f5e-d21ea2e0f52b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa616812-f379-45fb-8e7e-fefe7570dc98", "name": "network-vif-unplugged", "status": "completed", "tag": "6de1369a-94d0-42a0-a57f-9deacb90b66f"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:32:51.375461 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-822311a7-f9c2-479a-9789-345d4cb17531 req-037e4ce6-9c48-4caf-8f5e-d21ea2e0f52b service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:51.375997 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-822311a7-f9c2-479a-9789-345d4cb17531 req-037e4ce6-9c48-4caf-8f5e-d21ea2e0f52b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:51.376613 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-822311a7-f9c2-479a-9789-345d4cb17531 req-037e4ce6-9c48-4caf-8f5e-d21ea2e0f52b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:51.392221 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-822311a7-f9c2-479a-9789-345d4cb17531 req-037e4ce6-9c48-4caf-8f5e-d21ea2e0f52b service nova] Creating event network-vif-unplugged:6de1369a-94d0-42a0-a57f-9deacb90b66f for instance fa616812-f379-45fb-8e7e-fefe7570dc98 on n-h1-master-1 Oct 23 01:32:51.404531 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-822311a7-f9c2-479a-9789-345d4cb17531 req-037e4ce6-9c48-4caf-8f5e-d21ea2e0f52b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052583 Oct 23 01:32:51.405176 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2427/4933] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:32:51.593216 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3bd49d4f-71b2-45cb-9b2e-0baca86dad37 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:51.593961 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3bd49d4f-71b2-45cb-9b2e-0baca86dad37 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: c8eed771-da93-492d-bb34-5020c379fb63] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:51.601120 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3bd49d4f-71b2-45cb-9b2e-0baca86dad37 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:51.601694 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3bd49d4f-71b2-45cb-9b2e-0baca86dad37 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:51.602256 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3bd49d4f-71b2-45cb-9b2e-0baca86dad37 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:51.603139 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3bd49d4f-71b2-45cb-9b2e-0baca86dad37 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:51.604158 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3bd49d4f-71b2-45cb-9b2e-0baca86dad37 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:51.604677 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3bd49d4f-71b2-45cb-9b2e-0baca86dad37 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:51.813305 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3bd49d4f-71b2-45cb-9b2e-0baca86dad37 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:51.823347 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3bd49d4f-71b2-45cb-9b2e-0baca86dad37 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/c8eed771-da93-492d-bb34-5020c379fb63" status: 200 len: 1309 microversion: 2.1 time: 0.233844 Oct 23 01:32:51.838829 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2507/4934] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:51 2022] GET /compute/v2.1/servers/c8eed771-da93-492d-bb34-5020c379fb63 => generated 1309 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:52.849727 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1b8a1e4d-6857-47e3-a682-70fdc73496e8 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:52.850461 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1b8a1e4d-6857-47e3-a682-70fdc73496e8 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: c8eed771-da93-492d-bb34-5020c379fb63] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:52.856864 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b8a1e4d-6857-47e3-a682-70fdc73496e8 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:52.872651 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b8a1e4d-6857-47e3-a682-70fdc73496e8 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:52.872651 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b8a1e4d-6857-47e3-a682-70fdc73496e8 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:52.872651 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b8a1e4d-6857-47e3-a682-70fdc73496e8 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:52.872651 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b8a1e4d-6857-47e3-a682-70fdc73496e8 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:52.872651 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b8a1e4d-6857-47e3-a682-70fdc73496e8 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:53.002790 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1b8a1e4d-6857-47e3-a682-70fdc73496e8 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:53.012123 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1b8a1e4d-6857-47e3-a682-70fdc73496e8 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/c8eed771-da93-492d-bb34-5020c379fb63" status: 200 len: 1309 microversion: 2.1 time: 0.168106 Oct 23 01:32:53.012952 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2428/4935] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:52 2022] GET /compute/v2.1/servers/c8eed771-da93-492d-bb34-5020c379fb63 => generated 1309 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:53.057185 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-e5dbd3ce-cd71-4bb7-bf04-b6caefea3649 req-aa20096e-febe-41d0-878f-777b90657165 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8eed771-da93-492d-bb34-5020c379fb63", "tag": "c0135a51-bdc6-4e37-9a5d-9058378ead80"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:32:53.071277 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-e5dbd3ce-cd71-4bb7-bf04-b6caefea3649 req-aa20096e-febe-41d0-878f-777b90657165 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:53.072413 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-e5dbd3ce-cd71-4bb7-bf04-b6caefea3649 req-aa20096e-febe-41d0-878f-777b90657165 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:53.072963 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-e5dbd3ce-cd71-4bb7-bf04-b6caefea3649 req-aa20096e-febe-41d0-878f-777b90657165 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:53.084812 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-e5dbd3ce-cd71-4bb7-bf04-b6caefea3649 req-aa20096e-febe-41d0-878f-777b90657165 service nova] Creating event network-changed:c0135a51-bdc6-4e37-9a5d-9058378ead80 for instance c8eed771-da93-492d-bb34-5020c379fb63 on n-h2-master-1 Oct 23 01:32:53.093729 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-e5dbd3ce-cd71-4bb7-bf04-b6caefea3649 req-aa20096e-febe-41d0-878f-777b90657165 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039947 Oct 23 01:32:53.093729 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2508/4936] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:32:54.039777 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9f8ff424-58d1-4c74-927a-3bc197a7c062 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:54.041033 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9f8ff424-58d1-4c74-927a-3bc197a7c062 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: c8eed771-da93-492d-bb34-5020c379fb63] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:54.052774 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f8ff424-58d1-4c74-927a-3bc197a7c062 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:54.055408 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f8ff424-58d1-4c74-927a-3bc197a7c062 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:54.055408 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f8ff424-58d1-4c74-927a-3bc197a7c062 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:54.058918 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f8ff424-58d1-4c74-927a-3bc197a7c062 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:54.059401 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f8ff424-58d1-4c74-927a-3bc197a7c062 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:54.059839 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f8ff424-58d1-4c74-927a-3bc197a7c062 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:54.208600 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9f8ff424-58d1-4c74-927a-3bc197a7c062 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:54.217072 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9f8ff424-58d1-4c74-927a-3bc197a7c062 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/c8eed771-da93-492d-bb34-5020c379fb63" status: 200 len: 1309 microversion: 2.1 time: 0.181962 Oct 23 01:32:54.217657 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2429/4937] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:54 2022] GET /compute/v2.1/servers/c8eed771-da93-492d-bb34-5020c379fb63 => generated 1309 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:54.386868 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-224367b5-a407-4d8d-8d22-21877ce62f6b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:54.388056 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-224367b5-a407-4d8d-8d22-21877ce62f6b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 9f9af130-5a0c-46f9-8449-fa9021e48953] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:54.395188 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-224367b5-a407-4d8d-8d22-21877ce62f6b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:54.395681 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-224367b5-a407-4d8d-8d22-21877ce62f6b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:54.396144 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-224367b5-a407-4d8d-8d22-21877ce62f6b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:54.396959 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-224367b5-a407-4d8d-8d22-21877ce62f6b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:54.398091 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-224367b5-a407-4d8d-8d22-21877ce62f6b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:54.398534 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-224367b5-a407-4d8d-8d22-21877ce62f6b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:54.426590 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-224367b5-a407-4d8d-8d22-21877ce62f6b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 9f9af130-5a0c-46f9-8449-fa9021e48953] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:32:54.541880 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:32:54.731710 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-224367b5-a407-4d8d-8d22-21877ce62f6b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953" status: 204 len: 0 microversion: 2.1 time: 0.349303 Oct 23 01:32:54.732316 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2509/4938] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:32:54 2022] DELETE /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:32:54.741567 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c8cd4010-e3c2-4ee2-aef6-1d1a4f53799f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:54.742259 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c8cd4010-e3c2-4ee2-aef6-1d1a4f53799f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 9f9af130-5a0c-46f9-8449-fa9021e48953] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:54.749802 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c8cd4010-e3c2-4ee2-aef6-1d1a4f53799f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:54.750392 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c8cd4010-e3c2-4ee2-aef6-1d1a4f53799f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:54.750832 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c8cd4010-e3c2-4ee2-aef6-1d1a4f53799f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:54.751537 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c8cd4010-e3c2-4ee2-aef6-1d1a4f53799f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:54.751990 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c8cd4010-e3c2-4ee2-aef6-1d1a4f53799f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:54.752410 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c8cd4010-e3c2-4ee2-aef6-1d1a4f53799f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:54.892741 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c8cd4010-e3c2-4ee2-aef6-1d1a4f53799f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:54.901436 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c8cd4010-e3c2-4ee2-aef6-1d1a4f53799f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953" status: 200 len: 1553 microversion: 2.1 time: 0.164159 Oct 23 01:32:54.902050 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2430/4939] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:54 2022] GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953 => generated 1553 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:32:55.241947 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-32d3a10e-0cf5-4ea4-919c-ceb2db2b8f87 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:55.243047 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-32d3a10e-0cf5-4ea4-919c-ceb2db2b8f87 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: c8eed771-da93-492d-bb34-5020c379fb63] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:55.250595 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-32d3a10e-0cf5-4ea4-919c-ceb2db2b8f87 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:55.251083 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-32d3a10e-0cf5-4ea4-919c-ceb2db2b8f87 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:55.251522 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-32d3a10e-0cf5-4ea4-919c-ceb2db2b8f87 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:55.252215 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-32d3a10e-0cf5-4ea4-919c-ceb2db2b8f87 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:55.252968 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-32d3a10e-0cf5-4ea4-919c-ceb2db2b8f87 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:55.253392 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-32d3a10e-0cf5-4ea4-919c-ceb2db2b8f87 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:55.270101 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-c1bc57bd-c1f9-41f0-b06e-f17842139f5a req-f51b6ba7-0b32-4a08-854e-a73bffa6dc7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa616812-f379-45fb-8e7e-fefe7570dc98", "name": "network-vif-plugged", "status": "completed", "tag": "6de1369a-94d0-42a0-a57f-9deacb90b66f"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:32:55.297846 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-c1bc57bd-c1f9-41f0-b06e-f17842139f5a req-f51b6ba7-0b32-4a08-854e-a73bffa6dc7b service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:55.298384 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-c1bc57bd-c1f9-41f0-b06e-f17842139f5a req-f51b6ba7-0b32-4a08-854e-a73bffa6dc7b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:55.299324 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-c1bc57bd-c1f9-41f0-b06e-f17842139f5a req-f51b6ba7-0b32-4a08-854e-a73bffa6dc7b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:55.317707 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-c1bc57bd-c1f9-41f0-b06e-f17842139f5a req-f51b6ba7-0b32-4a08-854e-a73bffa6dc7b service nova] Creating event network-vif-plugged:6de1369a-94d0-42a0-a57f-9deacb90b66f for instance fa616812-f379-45fb-8e7e-fefe7570dc98 on n-h1-master-1 Oct 23 01:32:55.323252 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-c1bc57bd-c1f9-41f0-b06e-f17842139f5a req-f51b6ba7-0b32-4a08-854e-a73bffa6dc7b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058311 Oct 23 01:32:55.323866 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2431/4940] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:32:55.454265 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-32d3a10e-0cf5-4ea4-919c-ceb2db2b8f87 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:55.466022 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-32d3a10e-0cf5-4ea4-919c-ceb2db2b8f87 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/c8eed771-da93-492d-bb34-5020c379fb63" status: 200 len: 1309 microversion: 2.1 time: 0.228765 Oct 23 01:32:55.466899 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2510/4941] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:55 2022] GET /compute/v2.1/servers/c8eed771-da93-492d-bb34-5020c379fb63 => generated 1309 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:55.926588 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-991f844a-da16-4b8e-809b-967cfe49268b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:55.927286 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-991f844a-da16-4b8e-809b-967cfe49268b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 9f9af130-5a0c-46f9-8449-fa9021e48953] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:55.933603 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-991f844a-da16-4b8e-809b-967cfe49268b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:55.934188 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-991f844a-da16-4b8e-809b-967cfe49268b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:55.934626 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-991f844a-da16-4b8e-809b-967cfe49268b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:55.935315 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-991f844a-da16-4b8e-809b-967cfe49268b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:55.935764 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-991f844a-da16-4b8e-809b-967cfe49268b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:55.936501 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-991f844a-da16-4b8e-809b-967cfe49268b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:56.117735 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-991f844a-da16-4b8e-809b-967cfe49268b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:56.127521 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-991f844a-da16-4b8e-809b-967cfe49268b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953" status: 200 len: 1553 microversion: 2.1 time: 0.205623 Oct 23 01:32:56.128098 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2432/4942] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:55 2022] GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953 => generated 1553 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:56.491349 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6304daaf-91ed-47cf-ae30-065d0f48b186 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:56.491726 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6304daaf-91ed-47cf-ae30-065d0f48b186 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: c8eed771-da93-492d-bb34-5020c379fb63] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:56.502115 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6304daaf-91ed-47cf-ae30-065d0f48b186 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:56.502622 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6304daaf-91ed-47cf-ae30-065d0f48b186 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:56.503070 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6304daaf-91ed-47cf-ae30-065d0f48b186 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:56.505673 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6304daaf-91ed-47cf-ae30-065d0f48b186 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:56.507584 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6304daaf-91ed-47cf-ae30-065d0f48b186 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:56.508135 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6304daaf-91ed-47cf-ae30-065d0f48b186 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:56.731251 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6304daaf-91ed-47cf-ae30-065d0f48b186 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:56.747871 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6304daaf-91ed-47cf-ae30-065d0f48b186 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/c8eed771-da93-492d-bb34-5020c379fb63" status: 200 len: 1309 microversion: 2.1 time: 0.260950 Oct 23 01:32:56.751611 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2511/4943] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:56 2022] GET /compute/v2.1/servers/c8eed771-da93-492d-bb34-5020c379fb63 => generated 1309 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:57.154142 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f596a219-6c51-4063-b502-bac28c7fce26 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:57.155099 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f596a219-6c51-4063-b502-bac28c7fce26 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 9f9af130-5a0c-46f9-8449-fa9021e48953] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:57.168054 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:32:57.170784 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=6 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:32:57.173730 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f596a219-6c51-4063-b502-bac28c7fce26 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:57.174394 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f596a219-6c51-4063-b502-bac28c7fce26 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:57.174889 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f596a219-6c51-4063-b502-bac28c7fce26 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:57.176247 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f596a219-6c51-4063-b502-bac28c7fce26 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:57.176712 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f596a219-6c51-4063-b502-bac28c7fce26 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:57.177218 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f596a219-6c51-4063-b502-bac28c7fce26 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:57.492020 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f596a219-6c51-4063-b502-bac28c7fce26 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:57.510233 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f596a219-6c51-4063-b502-bac28c7fce26 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953" status: 200 len: 1553 microversion: 2.1 time: 0.353392 Oct 23 01:32:57.527525 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2433/4944] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:57 2022] GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953 => generated 1553 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:57.772054 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d7579010-a747-4b19-a56e-37f723508c99 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:57.772708 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d7579010-a747-4b19-a56e-37f723508c99 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: c8eed771-da93-492d-bb34-5020c379fb63] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:57.781833 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d7579010-a747-4b19-a56e-37f723508c99 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:57.782730 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d7579010-a747-4b19-a56e-37f723508c99 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:57.783651 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d7579010-a747-4b19-a56e-37f723508c99 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:57.784621 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d7579010-a747-4b19-a56e-37f723508c99 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:57.785340 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d7579010-a747-4b19-a56e-37f723508c99 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:57.786014 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d7579010-a747-4b19-a56e-37f723508c99 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:58.014686 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-de2cb5c5-2ebc-4d9e-911b-ba0657b08523 req-0b8ab2de-8734-4bd2-9baf-a19e08c18c54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f9af130-5a0c-46f9-8449-fa9021e48953", "name": "network-vif-deleted", "tag": "7253ced9-380e-48f5-bf48-cfbb43aded05"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:32:58.039168 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-de2cb5c5-2ebc-4d9e-911b-ba0657b08523 req-0b8ab2de-8734-4bd2-9baf-a19e08c18c54 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:58.039762 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-de2cb5c5-2ebc-4d9e-911b-ba0657b08523 req-0b8ab2de-8734-4bd2-9baf-a19e08c18c54 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:58.040240 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-de2cb5c5-2ebc-4d9e-911b-ba0657b08523 req-0b8ab2de-8734-4bd2-9baf-a19e08c18c54 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:58.066236 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-de2cb5c5-2ebc-4d9e-911b-ba0657b08523 req-0b8ab2de-8734-4bd2-9baf-a19e08c18c54 service nova] Creating event network-vif-deleted:7253ced9-380e-48f5-bf48-cfbb43aded05 for instance 9f9af130-5a0c-46f9-8449-fa9021e48953 on n-h1-master-1 Oct 23 01:32:58.105921 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-de2cb5c5-2ebc-4d9e-911b-ba0657b08523 req-0b8ab2de-8734-4bd2-9baf-a19e08c18c54 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093291 Oct 23 01:32:58.106621 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2434/4945] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:32:58.299876 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=4 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:32:58.501864 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d7579010-a747-4b19-a56e-37f723508c99 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:58.512825 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d7579010-a747-4b19-a56e-37f723508c99 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/c8eed771-da93-492d-bb34-5020c379fb63" status: 200 len: 1309 microversion: 2.1 time: 0.745636 Oct 23 01:32:58.516596 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2512/4946] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:57 2022] GET /compute/v2.1/servers/c8eed771-da93-492d-bb34-5020c379fb63 => generated 1309 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:58.537486 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8f0e237c-c1a7-4392-b9b6-764e65c40a91 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:58.538194 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8f0e237c-c1a7-4392-b9b6-764e65c40a91 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 9f9af130-5a0c-46f9-8449-fa9021e48953] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:58.550539 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f0e237c-c1a7-4392-b9b6-764e65c40a91 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:58.551786 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f0e237c-c1a7-4392-b9b6-764e65c40a91 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:58.552413 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f0e237c-c1a7-4392-b9b6-764e65c40a91 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:58.553754 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f0e237c-c1a7-4392-b9b6-764e65c40a91 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:58.554821 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f0e237c-c1a7-4392-b9b6-764e65c40a91 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:58.559014 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f0e237c-c1a7-4392-b9b6-764e65c40a91 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:58.648305 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8f0e237c-c1a7-4392-b9b6-764e65c40a91 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:32:58.660074 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8f0e237c-c1a7-4392-b9b6-764e65c40a91 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953" status: 200 len: 1345 microversion: 2.1 time: 0.129059 Oct 23 01:32:58.661772 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2435/4947] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:58 2022] GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953 => generated 1345 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:32:59.034268 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-cd42a6ac-c5c6-41eb-9b47-e5fb1d0ffec7 req-b69e9203-f477-4c73-86ac-4990555055c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8eed771-da93-492d-bb34-5020c379fb63", "name": "network-vif-plugged", "status": "completed", "tag": "c0135a51-bdc6-4e37-9a5d-9058378ead80"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:32:59.052562 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-cd42a6ac-c5c6-41eb-9b47-e5fb1d0ffec7 req-b69e9203-f477-4c73-86ac-4990555055c4 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:59.053341 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-cd42a6ac-c5c6-41eb-9b47-e5fb1d0ffec7 req-b69e9203-f477-4c73-86ac-4990555055c4 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:59.062428 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-cd42a6ac-c5c6-41eb-9b47-e5fb1d0ffec7 req-b69e9203-f477-4c73-86ac-4990555055c4 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:59.092841 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-cd42a6ac-c5c6-41eb-9b47-e5fb1d0ffec7 req-b69e9203-f477-4c73-86ac-4990555055c4 service nova] Creating event network-vif-plugged:c0135a51-bdc6-4e37-9a5d-9058378ead80 for instance c8eed771-da93-492d-bb34-5020c379fb63 on n-h2-master-1 Oct 23 01:32:59.098831 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-cd42a6ac-c5c6-41eb-9b47-e5fb1d0ffec7 req-b69e9203-f477-4c73-86ac-4990555055c4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068460 Oct 23 01:32:59.102115 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2513/4948] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:32:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:32:59.543257 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fd0e7a96-0a51-46b7-9710-7afafb4e9807 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:59.543866 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-fd0e7a96-0a51-46b7-9710-7afafb4e9807 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: c8eed771-da93-492d-bb34-5020c379fb63] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:59.571088 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fd0e7a96-0a51-46b7-9710-7afafb4e9807 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:59.572287 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fd0e7a96-0a51-46b7-9710-7afafb4e9807 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:59.574088 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fd0e7a96-0a51-46b7-9710-7afafb4e9807 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:59.575079 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fd0e7a96-0a51-46b7-9710-7afafb4e9807 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:59.575542 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fd0e7a96-0a51-46b7-9710-7afafb4e9807 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:59.578598 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fd0e7a96-0a51-46b7-9710-7afafb4e9807 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:59.687909 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-13bd8977-0143-44d7-a90c-53048f300e9e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:32:59.688602 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-13bd8977-0143-44d7-a90c-53048f300e9e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 9f9af130-5a0c-46f9-8449-fa9021e48953] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:32:59.707288 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13bd8977-0143-44d7-a90c-53048f300e9e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:59.708159 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13bd8977-0143-44d7-a90c-53048f300e9e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:59.712187 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13bd8977-0143-44d7-a90c-53048f300e9e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:32:59.712187 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13bd8977-0143-44d7-a90c-53048f300e9e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:32:59.712187 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13bd8977-0143-44d7-a90c-53048f300e9e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:32:59.712187 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13bd8977-0143-44d7-a90c-53048f300e9e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:00.092341 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-13bd8977-0143-44d7-a90c-53048f300e9e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:00.111079 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-13bd8977-0143-44d7-a90c-53048f300e9e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953" status: 200 len: 1345 microversion: 2.1 time: 0.428645 Oct 23 01:33:00.112036 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2514/4949] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:59 2022] GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953 => generated 1345 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:00.117562 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-46661c35-ab48-4808-88f3-06f7a7bbf863 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:00.118628 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-46661c35-ab48-4808-88f3-06f7a7bbf863 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 78708eaa-2dad-44bc-a145-86dcc21ca804] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:00.139638 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46661c35-ab48-4808-88f3-06f7a7bbf863 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:00.140151 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46661c35-ab48-4808-88f3-06f7a7bbf863 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:00.144330 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46661c35-ab48-4808-88f3-06f7a7bbf863 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:00.144330 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46661c35-ab48-4808-88f3-06f7a7bbf863 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:00.144330 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46661c35-ab48-4808-88f3-06f7a7bbf863 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:00.144330 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46661c35-ab48-4808-88f3-06f7a7bbf863 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:00.216426 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-46661c35-ab48-4808-88f3-06f7a7bbf863 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/78708eaa-2dad-44bc-a145-86dcc21ca804/ips" status: 200 len: 149 microversion: 2.1 time: 0.103065 Oct 23 01:33:00.223594 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2515/4950] 10.222.0.42 () {58 vars in 1248 bytes} [Sun Oct 23 01:33:00 2022] GET /compute/v2.1/servers/78708eaa-2dad-44bc-a145-86dcc21ca804/ips => generated 149 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:33:00.230068 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7d0ccf17-e140-429e-b5a0-3984fc930e94 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "efba320e-5ace-4838-98e7-5e089aaf6472"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:33:00.234893 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7d0ccf17-e140-429e-b5a0-3984fc930e94 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 78708eaa-2dad-44bc-a145-86dcc21ca804] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:00.248322 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d0ccf17-e140-429e-b5a0-3984fc930e94 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:00.249081 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d0ccf17-e140-429e-b5a0-3984fc930e94 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:00.251027 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d0ccf17-e140-429e-b5a0-3984fc930e94 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:00.251956 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d0ccf17-e140-429e-b5a0-3984fc930e94 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:00.252582 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d0ccf17-e140-429e-b5a0-3984fc930e94 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:00.253178 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d0ccf17-e140-429e-b5a0-3984fc930e94 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:00.403792 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-7d0ccf17-e140-429e-b5a0-3984fc930e94 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] HTTP exception thrown: Invalid volume: volume efba320e-5ace-4838-98e7-5e089aaf6472 is already attached to instances: e96f5e79-d832-4927-aef1-a45a815404b0 Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7d0ccf17-e140-429e-b5a0-3984fc930e94 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Request method failure captured: Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/servers/78708eaa-2dad-44bc-a145-86dcc21ca804/os-volume_attachments HTTP/1.1 Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 74 Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJkvYHBhNP-ngrp3-t9b3JEvPymaCLxveQy3RHlcnEhTQOwrgKm_FYFqgl1O3oBP9pMRjY52nNZb_Q0xi9HfDiuiJB7SCfmksRniHRxHyItsbztYyPUcQD1NZfU4JeOPY635AaAApWVr1Jjx20AyHyGm3ekhiRFvnH_BMldZWZd5QMc Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 6edb27d1224244809ecbb55ac953c645 Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-AttachVolumeNegativeTest-742145495 Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6edb27d1224244809ecbb55ac953c645"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6edb27d1224244809ecbb55ac953c645"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6edb27d1224244809ecbb55ac953c645"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6edb27d1224244809ecbb55ac953c645"}]}] Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-AttachVolumeNegativeTest-742145495 Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 6edb27d1224244809ecbb55ac953c645 Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-742145495 Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-AttachVolumeNegativeTest-742145495-project Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 0c65e7ab0b544d9ebdac8bc2129d051a Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-AttachVolumeNegativeTest-742145495-project Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: {"volumeAttachment": {"volumeId": "efba320e-5ace-4838-98e7-5e089aaf6472"}} Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: exception: Invalid volume: volume efba320e-5ace-4838-98e7-5e089aaf6472 is already attached to instances: e96f5e79-d832-4927-aef1-a45a815404b0 Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: action_args: {'server_id': '78708eaa-2dad-44bc-a145-86dcc21ca804', 'body': {'volumeAttachment': {'volumeId': 'efba320e-5ace-4838-98e7-5e089aaf6472'}}} Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume efba320e-5ace-4838-98e7-5e089aaf6472 is already attached to instances: e96f5e79-d832-4927-aef1-a45a815404b0 Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:33:00.405894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:33:00.411355 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:33:00.411355 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:33:00.411355 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 23 01:33:00.411355 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 23 01:33:00.411355 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume efba320e-5ace-4838-98e7-5e089aaf6472 is already attached to instances: e96f5e79-d832-4927-aef1-a45a815404b0 Oct 23 01:33:00.411355 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:33:00.411355 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:33:00.411355 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:33:00.411355 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:33:00.411355 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:33:00.411355 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:33:00.411355 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:33:00.411355 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:33:00.411355 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume efba320e-5ace-4838-98e7-5e089aaf6472 is already attached to instances: e96f5e79-d832-4927-aef1-a45a815404b0 Oct 23 01:33:00.411355 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:33:00.414186 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7d0ccf17-e140-429e-b5a0-3984fc930e94 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Returning 400 to user: Invalid volume: volume efba320e-5ace-4838-98e7-5e089aaf6472 is already attached to instances: e96f5e79-d832-4927-aef1-a45a815404b0 {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:33:00.415798 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7d0ccf17-e140-429e-b5a0-3984fc930e94 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "POST /compute/v2.1/servers/78708eaa-2dad-44bc-a145-86dcc21ca804/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.190397 Oct 23 01:33:00.421672 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2516/4951] 10.222.0.42 () {60 vars in 1323 bytes} [Sun Oct 23 01:33:00 2022] POST /compute/v2.1/servers/78708eaa-2dad-44bc-a145-86dcc21ca804/os-volume_attachments => generated 174 bytes in 192 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:33:00.425535 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c1838724-cadf-4193-a0dd-29d7409feb81 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:00.427153 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c1838724-cadf-4193-a0dd-29d7409feb81 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 78708eaa-2dad-44bc-a145-86dcc21ca804] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:00.439084 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c1838724-cadf-4193-a0dd-29d7409feb81 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:00.444826 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c1838724-cadf-4193-a0dd-29d7409feb81 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:00.444826 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c1838724-cadf-4193-a0dd-29d7409feb81 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:00.444826 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c1838724-cadf-4193-a0dd-29d7409feb81 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:00.444826 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c1838724-cadf-4193-a0dd-29d7409feb81 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:00.444826 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c1838724-cadf-4193-a0dd-29d7409feb81 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:00.488718 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c1838724-cadf-4193-a0dd-29d7409feb81 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 78708eaa-2dad-44bc-a145-86dcc21ca804] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:33:00.592060 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-fd0e7a96-0a51-46b7-9710-7afafb4e9807 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:00.599288 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fd0e7a96-0a51-46b7-9710-7afafb4e9807 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/c8eed771-da93-492d-bb34-5020c379fb63" status: 200 len: 1309 microversion: 2.1 time: 1.060006 Oct 23 01:33:00.634915 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2436/4952] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:32:59 2022] GET /compute/v2.1/servers/c8eed771-da93-492d-bb34-5020c379fb63 => generated 1309 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:00.955726 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c1838724-cadf-4193-a0dd-29d7409feb81 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "DELETE /compute/v2.1/servers/78708eaa-2dad-44bc-a145-86dcc21ca804" status: 204 len: 0 microversion: 2.1 time: 0.532256 Oct 23 01:33:00.960035 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2517/4953] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:33:00 2022] DELETE /compute/v2.1/servers/78708eaa-2dad-44bc-a145-86dcc21ca804 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:33:00.967778 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d2cb04a3-2b3f-4095-9b92-bd10b389d1bb tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:00.968917 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d2cb04a3-2b3f-4095-9b92-bd10b389d1bb tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 78708eaa-2dad-44bc-a145-86dcc21ca804] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:00.981067 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d2cb04a3-2b3f-4095-9b92-bd10b389d1bb tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:00.986618 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d2cb04a3-2b3f-4095-9b92-bd10b389d1bb tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:00.986618 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d2cb04a3-2b3f-4095-9b92-bd10b389d1bb tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:00.988953 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d2cb04a3-2b3f-4095-9b92-bd10b389d1bb tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:00.989597 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d2cb04a3-2b3f-4095-9b92-bd10b389d1bb tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:00.999617 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d2cb04a3-2b3f-4095-9b92-bd10b389d1bb tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:01.141442 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bb6c277d-4228-435b-84a6-29eaff395809 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:01.142701 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bb6c277d-4228-435b-84a6-29eaff395809 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 9f9af130-5a0c-46f9-8449-fa9021e48953] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:01.156493 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bb6c277d-4228-435b-84a6-29eaff395809 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:01.166179 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bb6c277d-4228-435b-84a6-29eaff395809 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:01.168215 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bb6c277d-4228-435b-84a6-29eaff395809 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:01.170060 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bb6c277d-4228-435b-84a6-29eaff395809 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:01.173523 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bb6c277d-4228-435b-84a6-29eaff395809 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:01.176945 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bb6c277d-4228-435b-84a6-29eaff395809 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:01.387631 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d2cb04a3-2b3f-4095-9b92-bd10b389d1bb tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:01.409505 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d2cb04a3-2b3f-4095-9b92-bd10b389d1bb tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/78708eaa-2dad-44bc-a145-86dcc21ca804" status: 200 len: 1681 microversion: 2.1 time: 0.446198 Oct 23 01:33:01.410706 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2437/4954] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:00 2022] GET /compute/v2.1/servers/78708eaa-2dad-44bc-a145-86dcc21ca804 => generated 1681 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:01.497569 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bb6c277d-4228-435b-84a6-29eaff395809 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:01.511863 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bb6c277d-4228-435b-84a6-29eaff395809 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953" status: 200 len: 1345 microversion: 2.1 time: 0.374603 Oct 23 01:33:01.528911 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2518/4955] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:01 2022] GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953 => generated 1345 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:33:01.623614 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4746fa5e-815b-4817-826e-f43d92fdf277 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:01.624402 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4746fa5e-815b-4817-826e-f43d92fdf277 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: c8eed771-da93-492d-bb34-5020c379fb63] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:01.635476 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4746fa5e-815b-4817-826e-f43d92fdf277 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:01.636297 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4746fa5e-815b-4817-826e-f43d92fdf277 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:01.646698 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4746fa5e-815b-4817-826e-f43d92fdf277 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:01.646698 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4746fa5e-815b-4817-826e-f43d92fdf277 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:01.646698 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4746fa5e-815b-4817-826e-f43d92fdf277 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:01.646698 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4746fa5e-815b-4817-826e-f43d92fdf277 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:02.438279 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ced42b44-b32a-4544-8826-df13806065d3 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:02.439771 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ced42b44-b32a-4544-8826-df13806065d3 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 78708eaa-2dad-44bc-a145-86dcc21ca804] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:02.448820 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ced42b44-b32a-4544-8826-df13806065d3 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:02.452756 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ced42b44-b32a-4544-8826-df13806065d3 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:02.455552 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ced42b44-b32a-4544-8826-df13806065d3 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:02.456623 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ced42b44-b32a-4544-8826-df13806065d3 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:02.457486 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ced42b44-b32a-4544-8826-df13806065d3 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:02.460247 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ced42b44-b32a-4544-8826-df13806065d3 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:02.513968 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4746fa5e-815b-4817-826e-f43d92fdf277 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:02.530438 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4746fa5e-815b-4817-826e-f43d92fdf277 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/c8eed771-da93-492d-bb34-5020c379fb63" status: 200 len: 1489 microversion: 2.1 time: 0.907338 Oct 23 01:33:02.534400 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2438/4956] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:01 2022] GET /compute/v2.1/servers/c8eed771-da93-492d-bb34-5020c379fb63 => generated 1489 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:33:02.541206 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-41c1058c-4783-4978-a672-4966ac45939f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:02.554242 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-41c1058c-4783-4978-a672-4966ac45939f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 9f9af130-5a0c-46f9-8449-fa9021e48953] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:02.565214 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-41c1058c-4783-4978-a672-4966ac45939f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:02.565725 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-41c1058c-4783-4978-a672-4966ac45939f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:02.566198 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-41c1058c-4783-4978-a672-4966ac45939f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:02.567430 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-41c1058c-4783-4978-a672-4966ac45939f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:02.567899 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-41c1058c-4783-4978-a672-4966ac45939f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:02.568831 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-41c1058c-4783-4978-a672-4966ac45939f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:02.874254 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-41c1058c-4783-4978-a672-4966ac45939f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:02.884958 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-41c1058c-4783-4978-a672-4966ac45939f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953" status: 200 len: 1345 microversion: 2.1 time: 0.349098 Oct 23 01:33:02.885556 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2439/4957] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:02 2022] GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953 => generated 1345 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:02.900661 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c27e6984-49e6-43a1-b968-766eee7457a2 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:33:02.908040 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c27e6984-49e6-43a1-b968-766eee7457a2 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: c8eed771-da93-492d-bb34-5020c379fb63] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:02.923252 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c27e6984-49e6-43a1-b968-766eee7457a2 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:02.924891 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c27e6984-49e6-43a1-b968-766eee7457a2 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:02.925347 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c27e6984-49e6-43a1-b968-766eee7457a2 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:02.926354 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c27e6984-49e6-43a1-b968-766eee7457a2 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:02.926815 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c27e6984-49e6-43a1-b968-766eee7457a2 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:02.927237 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c27e6984-49e6-43a1-b968-766eee7457a2 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:03.012248 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:33:03.114926 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ced42b44-b32a-4544-8826-df13806065d3 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:03.140698 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c27e6984-49e6-43a1-b968-766eee7457a2 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "PUT /compute/v2.1/servers/c8eed771-da93-492d-bb34-5020c379fb63" status: 200 len: 1084 microversion: 2.1 time: 0.249368 Oct 23 01:33:03.140872 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2440/4958] 10.222.0.42 () {60 vars in 1256 bytes} [Sun Oct 23 01:33:02 2022] PUT /compute/v2.1/servers/c8eed771-da93-492d-bb34-5020c379fb63 => generated 1084 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:03.141713 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ced42b44-b32a-4544-8826-df13806065d3 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/78708eaa-2dad-44bc-a145-86dcc21ca804" status: 200 len: 1681 microversion: 2.1 time: 0.708739 Oct 23 01:33:03.142863 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2519/4959] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:02 2022] GET /compute/v2.1/servers/78708eaa-2dad-44bc-a145-86dcc21ca804 => generated 1681 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:03.176763 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b29e1021-54ea-4478-826d-2374558fb336 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:03.177765 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b29e1021-54ea-4478-826d-2374558fb336 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: c8eed771-da93-492d-bb34-5020c379fb63] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:03.185310 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b29e1021-54ea-4478-826d-2374558fb336 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:03.185840 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b29e1021-54ea-4478-826d-2374558fb336 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:03.186338 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b29e1021-54ea-4478-826d-2374558fb336 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:03.188565 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b29e1021-54ea-4478-826d-2374558fb336 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:03.189043 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b29e1021-54ea-4478-826d-2374558fb336 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:03.189960 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b29e1021-54ea-4478-826d-2374558fb336 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:03.510790 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b29e1021-54ea-4478-826d-2374558fb336 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:03.525103 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b29e1021-54ea-4478-826d-2374558fb336 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/c8eed771-da93-492d-bb34-5020c379fb63" status: 200 len: 1510 microversion: 2.1 time: 0.367551 Oct 23 01:33:03.525724 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2441/4960] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:03 2022] GET /compute/v2.1/servers/c8eed771-da93-492d-bb34-5020c379fb63 => generated 1510 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:03.588322 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-21514221-5158-4c49-91d9-aeae38ad4af3 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:03.591857 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-21514221-5158-4c49-91d9-aeae38ad4af3 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: c8eed771-da93-492d-bb34-5020c379fb63] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:03.640236 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-21514221-5158-4c49-91d9-aeae38ad4af3 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:03.640236 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-21514221-5158-4c49-91d9-aeae38ad4af3 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:03.640236 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-21514221-5158-4c49-91d9-aeae38ad4af3 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:03.640236 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-21514221-5158-4c49-91d9-aeae38ad4af3 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:03.640236 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-21514221-5158-4c49-91d9-aeae38ad4af3 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:03.640236 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-21514221-5158-4c49-91d9-aeae38ad4af3 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:03.912067 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-40d7e49d-fc8d-4628-a103-d11c6ad45bbe tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:03.913023 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-40d7e49d-fc8d-4628-a103-d11c6ad45bbe tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 9f9af130-5a0c-46f9-8449-fa9021e48953] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:03.922771 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-40d7e49d-fc8d-4628-a103-d11c6ad45bbe tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:03.927667 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-40d7e49d-fc8d-4628-a103-d11c6ad45bbe tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:03.931930 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-40d7e49d-fc8d-4628-a103-d11c6ad45bbe tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:03.931930 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-40d7e49d-fc8d-4628-a103-d11c6ad45bbe tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:03.931930 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-40d7e49d-fc8d-4628-a103-d11c6ad45bbe tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:03.950988 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-40d7e49d-fc8d-4628-a103-d11c6ad45bbe tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:04.503132 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-40d7e49d-fc8d-4628-a103-d11c6ad45bbe tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:04.513694 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-40d7e49d-fc8d-4628-a103-d11c6ad45bbe tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953" status: 200 len: 1345 microversion: 2.1 time: 0.606767 Oct 23 01:33:04.514570 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2442/4961] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:03 2022] GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953 => generated 1345 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:33:04.521101 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-668386c8-3704-48d9-b441-7aa6de7db5e0 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:04.522065 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-668386c8-3704-48d9-b441-7aa6de7db5e0 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 78708eaa-2dad-44bc-a145-86dcc21ca804] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:04.529776 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-668386c8-3704-48d9-b441-7aa6de7db5e0 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:04.530314 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-668386c8-3704-48d9-b441-7aa6de7db5e0 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:04.530757 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-668386c8-3704-48d9-b441-7aa6de7db5e0 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:04.531468 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-668386c8-3704-48d9-b441-7aa6de7db5e0 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:04.531944 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-668386c8-3704-48d9-b441-7aa6de7db5e0 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:04.532613 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-668386c8-3704-48d9-b441-7aa6de7db5e0 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:04.620438 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-21514221-5158-4c49-91d9-aeae38ad4af3 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:04.630370 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-21514221-5158-4c49-91d9-aeae38ad4af3 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/c8eed771-da93-492d-bb34-5020c379fb63" status: 200 len: 1510 microversion: 2.1 time: 1.083884 Oct 23 01:33:04.643171 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2520/4962] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:03 2022] GET /compute/v2.1/servers/c8eed771-da93-492d-bb34-5020c379fb63 => generated 1510 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:04.660050 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-776f37b0-f8c4-44c2-9fd7-d3c15ea696a8 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:04.660796 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-776f37b0-f8c4-44c2-9fd7-d3c15ea696a8 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: c8eed771-da93-492d-bb34-5020c379fb63] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:04.670531 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-776f37b0-f8c4-44c2-9fd7-d3c15ea696a8 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:04.671237 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-776f37b0-f8c4-44c2-9fd7-d3c15ea696a8 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:04.671873 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-776f37b0-f8c4-44c2-9fd7-d3c15ea696a8 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:04.673216 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-776f37b0-f8c4-44c2-9fd7-d3c15ea696a8 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:04.674059 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-776f37b0-f8c4-44c2-9fd7-d3c15ea696a8 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:04.674905 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-776f37b0-f8c4-44c2-9fd7-d3c15ea696a8 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:04.785190 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-668386c8-3704-48d9-b441-7aa6de7db5e0 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:04.793692 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-668386c8-3704-48d9-b441-7aa6de7db5e0 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/78708eaa-2dad-44bc-a145-86dcc21ca804" status: 200 len: 1681 microversion: 2.1 time: 0.277889 Oct 23 01:33:04.794310 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2443/4963] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:04 2022] GET /compute/v2.1/servers/78708eaa-2dad-44bc-a145-86dcc21ca804 => generated 1681 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:04.795528 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-776f37b0-f8c4-44c2-9fd7-d3c15ea696a8 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: c8eed771-da93-492d-bb34-5020c379fb63] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:33:05.236976 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-776f37b0-f8c4-44c2-9fd7-d3c15ea696a8 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c8eed771-da93-492d-bb34-5020c379fb63" status: 204 len: 0 microversion: 2.1 time: 0.582751 Oct 23 01:33:05.237579 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2521/4964] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:33:04 2022] DELETE /compute/v2.1/servers/c8eed771-da93-492d-bb34-5020c379fb63 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:33:05.251203 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a2446407-6a9a-4c1e-b726-412338117901 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:05.251819 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a2446407-6a9a-4c1e-b726-412338117901 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: c8eed771-da93-492d-bb34-5020c379fb63] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:05.259251 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a2446407-6a9a-4c1e-b726-412338117901 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:05.278527 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a2446407-6a9a-4c1e-b726-412338117901 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:05.279290 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a2446407-6a9a-4c1e-b726-412338117901 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:05.281633 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a2446407-6a9a-4c1e-b726-412338117901 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:05.282131 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a2446407-6a9a-4c1e-b726-412338117901 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:05.282572 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a2446407-6a9a-4c1e-b726-412338117901 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:05.546780 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cefc6a0a-339e-40d5-ac9c-8bc5b2e2e591 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:05.547500 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-cefc6a0a-339e-40d5-ac9c-8bc5b2e2e591 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 9f9af130-5a0c-46f9-8449-fa9021e48953] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:05.558363 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cefc6a0a-339e-40d5-ac9c-8bc5b2e2e591 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:05.571765 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cefc6a0a-339e-40d5-ac9c-8bc5b2e2e591 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:05.572510 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cefc6a0a-339e-40d5-ac9c-8bc5b2e2e591 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:05.573466 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cefc6a0a-339e-40d5-ac9c-8bc5b2e2e591 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:05.574164 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cefc6a0a-339e-40d5-ac9c-8bc5b2e2e591 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:05.574783 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cefc6a0a-339e-40d5-ac9c-8bc5b2e2e591 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:05.825221 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cefc6a0a-339e-40d5-ac9c-8bc5b2e2e591 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:05.833821 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cefc6a0a-339e-40d5-ac9c-8bc5b2e2e591 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953" status: 200 len: 1345 microversion: 2.1 time: 0.291381 Oct 23 01:33:05.834453 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2522/4965] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:05 2022] GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953 => generated 1345 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:33:05.848924 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-24a53f72-6bf4-4b28-8f17-b123fe71e856 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:05.854796 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-24a53f72-6bf4-4b28-8f17-b123fe71e856 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 78708eaa-2dad-44bc-a145-86dcc21ca804] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:05.869501 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-24a53f72-6bf4-4b28-8f17-b123fe71e856 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:05.870032 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-24a53f72-6bf4-4b28-8f17-b123fe71e856 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:05.870490 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-24a53f72-6bf4-4b28-8f17-b123fe71e856 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:05.871220 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-24a53f72-6bf4-4b28-8f17-b123fe71e856 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:05.871682 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-24a53f72-6bf4-4b28-8f17-b123fe71e856 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:05.872124 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-24a53f72-6bf4-4b28-8f17-b123fe71e856 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:06.111498 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-24a53f72-6bf4-4b28-8f17-b123fe71e856 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:06.121075 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-24a53f72-6bf4-4b28-8f17-b123fe71e856 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/78708eaa-2dad-44bc-a145-86dcc21ca804" status: 200 len: 1613 microversion: 2.1 time: 0.285017 Oct 23 01:33:06.122590 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2523/4966] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:05 2022] GET /compute/v2.1/servers/78708eaa-2dad-44bc-a145-86dcc21ca804 => generated 1613 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:06.130271 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-b80f5254-a423-489c-8fa7-daef11555211 req-8b62c8cb-6893-4c81-b3dc-548254082790 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78708eaa-2dad-44bc-a145-86dcc21ca804", "name": "network-vif-deleted", "tag": "e46f5845-095b-423f-ab57-8b5a4b6fda52"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:33:06.140861 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-b80f5254-a423-489c-8fa7-daef11555211 req-8b62c8cb-6893-4c81-b3dc-548254082790 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:06.141639 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-b80f5254-a423-489c-8fa7-daef11555211 req-8b62c8cb-6893-4c81-b3dc-548254082790 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:06.142287 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-b80f5254-a423-489c-8fa7-daef11555211 req-8b62c8cb-6893-4c81-b3dc-548254082790 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:06.153142 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=95,nova_cell1:UPDATE=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:33:06.157814 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-b80f5254-a423-489c-8fa7-daef11555211 req-8b62c8cb-6893-4c81-b3dc-548254082790 service nova] Creating event network-vif-deleted:e46f5845-095b-423f-ab57-8b5a4b6fda52 for instance 78708eaa-2dad-44bc-a145-86dcc21ca804 on n-h1-master-1 Oct 23 01:33:06.168303 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-b80f5254-a423-489c-8fa7-daef11555211 req-8b62c8cb-6893-4c81-b3dc-548254082790 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044274 Oct 23 01:33:06.173701 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2524/4967] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:33:06.471416 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a2446407-6a9a-4c1e-b726-412338117901 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:06.483479 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a2446407-6a9a-4c1e-b726-412338117901 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/c8eed771-da93-492d-bb34-5020c379fb63" status: 200 len: 1516 microversion: 2.1 time: 1.236045 Oct 23 01:33:06.484908 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2444/4968] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:05 2022] GET /compute/v2.1/servers/c8eed771-da93-492d-bb34-5020c379fb63 => generated 1516 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:06.870979 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bc50d04e-f6fb-4b01-8928-5dfd57af773c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:06.872521 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bc50d04e-f6fb-4b01-8928-5dfd57af773c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 9f9af130-5a0c-46f9-8449-fa9021e48953] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:06.898859 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc50d04e-f6fb-4b01-8928-5dfd57af773c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:06.902086 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc50d04e-f6fb-4b01-8928-5dfd57af773c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:06.906315 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc50d04e-f6fb-4b01-8928-5dfd57af773c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:06.907453 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc50d04e-f6fb-4b01-8928-5dfd57af773c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:06.908313 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc50d04e-f6fb-4b01-8928-5dfd57af773c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:06.908934 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc50d04e-f6fb-4b01-8928-5dfd57af773c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:07.040510 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bc50d04e-f6fb-4b01-8928-5dfd57af773c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:07.055075 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bc50d04e-f6fb-4b01-8928-5dfd57af773c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953" status: 200 len: 1345 microversion: 2.1 time: 0.195895 Oct 23 01:33:07.084598 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2525/4969] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:06 2022] GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953 => generated 1345 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:07.151193 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4636dc31-0fa0-48c2-9e87-8143d6591012 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:07.152320 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4636dc31-0fa0-48c2-9e87-8143d6591012 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 78708eaa-2dad-44bc-a145-86dcc21ca804] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:07.162819 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4636dc31-0fa0-48c2-9e87-8143d6591012 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:07.163607 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4636dc31-0fa0-48c2-9e87-8143d6591012 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:07.165355 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4636dc31-0fa0-48c2-9e87-8143d6591012 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:07.166403 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4636dc31-0fa0-48c2-9e87-8143d6591012 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:07.167533 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4636dc31-0fa0-48c2-9e87-8143d6591012 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:07.168192 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4636dc31-0fa0-48c2-9e87-8143d6591012 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:07.243930 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4636dc31-0fa0-48c2-9e87-8143d6591012 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:07.250830 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4636dc31-0fa0-48c2-9e87-8143d6591012 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:07.251653 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4636dc31-0fa0-48c2-9e87-8143d6591012 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:07.252353 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-4636dc31-0fa0-48c2-9e87-8143d6591012 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lazy-loading 'fault' on Instance uuid 78708eaa-2dad-44bc-a145-86dcc21ca804 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:33:07.377763 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4636dc31-0fa0-48c2-9e87-8143d6591012 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:07.393805 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4636dc31-0fa0-48c2-9e87-8143d6591012 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/78708eaa-2dad-44bc-a145-86dcc21ca804" status: 200 len: 1331 microversion: 2.1 time: 0.246334 Oct 23 01:33:07.397849 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2445/4970] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:07 2022] GET /compute/v2.1/servers/78708eaa-2dad-44bc-a145-86dcc21ca804 => generated 1331 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:07.506450 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-147f4d2b-ac1e-4a67-96fe-89d3e87ead4a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:07.507817 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-147f4d2b-ac1e-4a67-96fe-89d3e87ead4a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: c8eed771-da93-492d-bb34-5020c379fb63] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:07.529906 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-147f4d2b-ac1e-4a67-96fe-89d3e87ead4a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:07.542041 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-147f4d2b-ac1e-4a67-96fe-89d3e87ead4a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:07.548152 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-147f4d2b-ac1e-4a67-96fe-89d3e87ead4a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:07.548152 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-147f4d2b-ac1e-4a67-96fe-89d3e87ead4a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:07.548152 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-147f4d2b-ac1e-4a67-96fe-89d3e87ead4a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:07.549382 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-147f4d2b-ac1e-4a67-96fe-89d3e87ead4a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:07.836494 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-147f4d2b-ac1e-4a67-96fe-89d3e87ead4a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:07.844698 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-147f4d2b-ac1e-4a67-96fe-89d3e87ead4a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/c8eed771-da93-492d-bb34-5020c379fb63" status: 200 len: 1516 microversion: 2.1 time: 0.342190 Oct 23 01:33:07.862492 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2526/4971] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:07 2022] GET /compute/v2.1/servers/c8eed771-da93-492d-bb34-5020c379fb63 => generated 1516 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:08.084893 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-80f4de3b-5a87-4445-a8a9-e80754590286 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:08.084893 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-80f4de3b-5a87-4445-a8a9-e80754590286 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 9f9af130-5a0c-46f9-8449-fa9021e48953] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:08.098598 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-80f4de3b-5a87-4445-a8a9-e80754590286 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:08.099103 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-80f4de3b-5a87-4445-a8a9-e80754590286 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:08.099590 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-80f4de3b-5a87-4445-a8a9-e80754590286 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:08.112720 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-80f4de3b-5a87-4445-a8a9-e80754590286 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:08.113340 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-80f4de3b-5a87-4445-a8a9-e80754590286 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:08.116966 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-80f4de3b-5a87-4445-a8a9-e80754590286 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:08.200965 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-80f4de3b-5a87-4445-a8a9-e80754590286 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:08.201247 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-80f4de3b-5a87-4445-a8a9-e80754590286 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:08.201796 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-80f4de3b-5a87-4445-a8a9-e80754590286 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:08.202387 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-80f4de3b-5a87-4445-a8a9-e80754590286 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lazy-loading 'fault' on Instance uuid 9f9af130-5a0c-46f9-8449-fa9021e48953 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:33:08.285158 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-80f4de3b-5a87-4445-a8a9-e80754590286 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:08.298747 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-80f4de3b-5a87-4445-a8a9-e80754590286 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953" status: 200 len: 1350 microversion: 2.1 time: 0.220348 Oct 23 01:33:08.306629 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2446/4972] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:08 2022] GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953 => generated 1350 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:08.426127 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-18d02485-b801-439d-b644-ebad07e9e5f8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:08.427437 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-18d02485-b801-439d-b644-ebad07e9e5f8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 78708eaa-2dad-44bc-a145-86dcc21ca804] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:08.439373 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18d02485-b801-439d-b644-ebad07e9e5f8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:08.442673 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18d02485-b801-439d-b644-ebad07e9e5f8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:08.442673 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18d02485-b801-439d-b644-ebad07e9e5f8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:08.442673 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18d02485-b801-439d-b644-ebad07e9e5f8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:08.446530 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18d02485-b801-439d-b644-ebad07e9e5f8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:08.447116 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18d02485-b801-439d-b644-ebad07e9e5f8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:08.482483 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-18d02485-b801-439d-b644-ebad07e9e5f8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] HTTP exception thrown: Instance 78708eaa-2dad-44bc-a145-86dcc21ca804 could not be found. Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-18d02485-b801-439d-b644-ebad07e9e5f8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Request method failure captured: Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/78708eaa-2dad-44bc-a145-86dcc21ca804 HTTP/1.1 Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJkvYHBhNP-ngrp3-t9b3JEvPymaCLxveQy3RHlcnEhTQOwrgKm_FYFqgl1O3oBP9pMRjY52nNZb_Q0xi9HfDiuiJB7SCfmksRniHRxHyItsbztYyPUcQD1NZfU4JeOPY635AaAApWVr1Jjx20AyHyGm3ekhiRFvnH_BMldZWZd5QMc Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 6edb27d1224244809ecbb55ac953c645 Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-AttachVolumeNegativeTest-742145495 Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6edb27d1224244809ecbb55ac953c645"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6edb27d1224244809ecbb55ac953c645"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6edb27d1224244809ecbb55ac953c645"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6edb27d1224244809ecbb55ac953c645"}]}] Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-AttachVolumeNegativeTest-742145495 Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 6edb27d1224244809ecbb55ac953c645 Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-742145495 Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-AttachVolumeNegativeTest-742145495-project Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 0c65e7ab0b544d9ebdac8bc2129d051a Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-AttachVolumeNegativeTest-742145495-project Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 78708eaa-2dad-44bc-a145-86dcc21ca804 could not be found. Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '78708eaa-2dad-44bc-a145-86dcc21ca804'} Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78708eaa-2dad-44bc-a145-86dcc21ca804 could not be found. Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78708eaa-2dad-44bc-a145-86dcc21ca804 could not be found. Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:33:08.490475 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:33:08.501677 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:33:08.501677 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:33:08.501677 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:33:08.501677 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:33:08.501677 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:33:08.501677 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78708eaa-2dad-44bc-a145-86dcc21ca804 could not be found. Oct 23 01:33:08.501677 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:33:08.501677 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-18d02485-b801-439d-b644-ebad07e9e5f8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Returning 404 to user: Instance 78708eaa-2dad-44bc-a145-86dcc21ca804 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:33:08.508539 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-18d02485-b801-439d-b644-ebad07e9e5f8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/78708eaa-2dad-44bc-a145-86dcc21ca804" status: 404 len: 111 microversion: 2.1 time: 0.078017 Oct 23 01:33:08.509416 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2527/4973] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:08 2022] GET /compute/v2.1/servers/78708eaa-2dad-44bc-a145-86dcc21ca804 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:33:08.520223 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-45819fba-57ed-497f-ab4b-63931c6c666c tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '.version_select at 0x7f5cc16ca670>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:08.656910 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-45819fba-57ed-497f-ab4b-63931c6c666c tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-769654282" status: 202 len: 0 microversion: 2.1 time: 0.141428 Oct 23 01:33:08.659425 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2447/4974] 10.222.0.42 () {58 vars in 1218 bytes} [Sun Oct 23 01:33:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-769654282 => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:33:08.873573 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0e95999f-7fe6-4cde-a379-1fc9d67ebdd1 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:08.874237 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0e95999f-7fe6-4cde-a379-1fc9d67ebdd1 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: c8eed771-da93-492d-bb34-5020c379fb63] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:08.891807 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0e95999f-7fe6-4cde-a379-1fc9d67ebdd1 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:08.894702 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0e95999f-7fe6-4cde-a379-1fc9d67ebdd1 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:08.895363 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0e95999f-7fe6-4cde-a379-1fc9d67ebdd1 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:08.896315 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0e95999f-7fe6-4cde-a379-1fc9d67ebdd1 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:08.899783 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0e95999f-7fe6-4cde-a379-1fc9d67ebdd1 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:08.900414 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0e95999f-7fe6-4cde-a379-1fc9d67ebdd1 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:08.985420 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-747c027e-aa1a-412d-b96f-cf775bd5d5d4 req-6055bc92-714a-4557-9bd3-51fd4680d06d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8eed771-da93-492d-bb34-5020c379fb63", "name": "network-vif-deleted", "tag": "c0135a51-bdc6-4e37-9a5d-9058378ead80"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:33:09.015379 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-747c027e-aa1a-412d-b96f-cf775bd5d5d4 req-6055bc92-714a-4557-9bd3-51fd4680d06d service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:09.021040 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-747c027e-aa1a-412d-b96f-cf775bd5d5d4 req-6055bc92-714a-4557-9bd3-51fd4680d06d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:09.021767 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-747c027e-aa1a-412d-b96f-cf775bd5d5d4 req-6055bc92-714a-4557-9bd3-51fd4680d06d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:09.067298 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-747c027e-aa1a-412d-b96f-cf775bd5d5d4 req-6055bc92-714a-4557-9bd3-51fd4680d06d service nova] Creating event network-vif-deleted:c0135a51-bdc6-4e37-9a5d-9058378ead80 for instance c8eed771-da93-492d-bb34-5020c379fb63 on n-h2-master-1 Oct 23 01:33:09.098996 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-747c027e-aa1a-412d-b96f-cf775bd5d5d4 req-6055bc92-714a-4557-9bd3-51fd4680d06d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117133 Oct 23 01:33:09.102922 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2448/4975] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:33:09.183037 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0e95999f-7fe6-4cde-a379-1fc9d67ebdd1 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:09.196422 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0e95999f-7fe6-4cde-a379-1fc9d67ebdd1 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/c8eed771-da93-492d-bb34-5020c379fb63" status: 200 len: 1474 microversion: 2.1 time: 0.326460 Oct 23 01:33:09.197118 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2528/4976] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:08 2022] GET /compute/v2.1/servers/c8eed771-da93-492d-bb34-5020c379fb63 => generated 1474 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:09.336576 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fa188de9-a9fc-4684-9cb4-609b466d4f20 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:09.338074 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-fa188de9-a9fc-4684-9cb4-609b466d4f20 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 9f9af130-5a0c-46f9-8449-fa9021e48953] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:09.349893 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fa188de9-a9fc-4684-9cb4-609b466d4f20 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:09.350420 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fa188de9-a9fc-4684-9cb4-609b466d4f20 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:09.351052 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fa188de9-a9fc-4684-9cb4-609b466d4f20 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:09.362495 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fa188de9-a9fc-4684-9cb4-609b466d4f20 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:09.363165 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fa188de9-a9fc-4684-9cb4-609b466d4f20 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:09.363687 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fa188de9-a9fc-4684-9cb4-609b466d4f20 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:09.383444 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-fa188de9-a9fc-4684-9cb4-609b466d4f20 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] HTTP exception thrown: Instance 9f9af130-5a0c-46f9-8449-fa9021e48953 could not be found. Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fa188de9-a9fc-4684-9cb4-609b466d4f20 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Request method failure captured: Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953 HTTP/1.1 Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJlvTfuM9-iirX2FXe8mkTy2eWW7UhgAXbnHf6lceGN18S7lbSlaINo5EbF9-Kmi1tphVBr2Fcj8S4BVPceiAUMjh1Az0xLOZc1N90Wz0wmSyINFoBFx331KJ40smzwK1ZOJLA4k7IFyzBj3SQlZplUyTac5KUYxpNFIDY-5Uus0ZuU Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 842dcab8b48c43d7963a538d914b0b22 Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-DeleteServersTestJSON-654775470 Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/842dcab8b48c43d7963a538d914b0b22"}]}] Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-DeleteServersTestJSON-654775470 Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 842dcab8b48c43d7963a538d914b0b22 Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-DeleteServersTestJSON-654775470 Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-DeleteServersTestJSON-654775470-project Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 634bed7898c24baca6ba00392d49eea1 Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-DeleteServersTestJSON-654775470-project Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 9f9af130-5a0c-46f9-8449-fa9021e48953 could not be found. Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '9f9af130-5a0c-46f9-8449-fa9021e48953'} Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f9af130-5a0c-46f9-8449-fa9021e48953 could not be found. Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f9af130-5a0c-46f9-8449-fa9021e48953 could not be found. Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:33:09.385351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:33:09.390150 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:33:09.390150 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:33:09.390150 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:33:09.390150 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:33:09.390150 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:33:09.390150 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f9af130-5a0c-46f9-8449-fa9021e48953 could not be found. Oct 23 01:33:09.390150 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:33:09.390150 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fa188de9-a9fc-4684-9cb4-609b466d4f20 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Returning 404 to user: Instance 9f9af130-5a0c-46f9-8449-fa9021e48953 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:33:09.390150 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fa188de9-a9fc-4684-9cb4-609b466d4f20 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953" status: 404 len: 111 microversion: 2.1 time: 0.059108 Oct 23 01:33:09.391280 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2449/4977] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:09 2022] GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:33:09.641870 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e22f2a42-5d1f-49f2-9323-7e63f637013d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:09.645158 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e22f2a42-5d1f-49f2-9323-7e63f637013d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 9f9af130-5a0c-46f9-8449-fa9021e48953] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:09.662789 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e22f2a42-5d1f-49f2-9323-7e63f637013d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:09.663748 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e22f2a42-5d1f-49f2-9323-7e63f637013d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:09.664405 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e22f2a42-5d1f-49f2-9323-7e63f637013d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:09.665936 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e22f2a42-5d1f-49f2-9323-7e63f637013d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:09.667010 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e22f2a42-5d1f-49f2-9323-7e63f637013d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:09.667664 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e22f2a42-5d1f-49f2-9323-7e63f637013d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:09.692090 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-e22f2a42-5d1f-49f2-9323-7e63f637013d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] HTTP exception thrown: Instance 9f9af130-5a0c-46f9-8449-fa9021e48953 could not be found. Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e22f2a42-5d1f-49f2-9323-7e63f637013d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Request method failure captured: Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953/os-volume_attachments HTTP/1.1 Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJlvTfuM9-iirX2FXe8mkTy2eWW7UhgAXbnHf6lceGN18S7lbSlaINo5EbF9-Kmi1tphVBr2Fcj8S4BVPceiAUMjh1Az0xLOZc1N90Wz0wmSyINFoBFx331KJ40smzwK1ZOJLA4k7IFyzBj3SQlZplUyTac5KUYxpNFIDY-5Uus0ZuU Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 842dcab8b48c43d7963a538d914b0b22 Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-DeleteServersTestJSON-654775470 Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/842dcab8b48c43d7963a538d914b0b22"}]}] Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-DeleteServersTestJSON-654775470 Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 842dcab8b48c43d7963a538d914b0b22 Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-DeleteServersTestJSON-654775470 Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-DeleteServersTestJSON-654775470-project Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 634bed7898c24baca6ba00392d49eea1 Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-DeleteServersTestJSON-654775470-project Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 9f9af130-5a0c-46f9-8449-fa9021e48953 could not be found. Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: action_args: {'server_id': '9f9af130-5a0c-46f9-8449-fa9021e48953'} Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f9af130-5a0c-46f9-8449-fa9021e48953 could not be found. Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:33:09.704761 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:33:09.709078 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f9af130-5a0c-46f9-8449-fa9021e48953 could not be found. Oct 23 01:33:09.709078 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:33:09.709078 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:33:09.709078 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:33:09.709078 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:33:09.709078 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:33:09.709078 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:33:09.709078 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:33:09.709078 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:33:09.709078 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f9af130-5a0c-46f9-8449-fa9021e48953 could not be found. Oct 23 01:33:09.709078 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:33:09.711918 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e22f2a42-5d1f-49f2-9323-7e63f637013d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Returning 404 to user: Instance 9f9af130-5a0c-46f9-8449-fa9021e48953 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:33:09.713026 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e22f2a42-5d1f-49f2-9323-7e63f637013d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.075285 Oct 23 01:33:09.714209 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2529/4978] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:33:09 2022] GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953/os-volume_attachments => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:33:10.036382 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-08f43f9b-7357-4e6e-b45a-f7c5226f3da0 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1017583544", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "ba696604-5fcc-4b2d-9bf0-ca27f90a0725"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:33:10.142415 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-08f43f9b-7357-4e6e-b45a-f7c5226f3da0 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] validate_networks() for [('ba696604-5fcc-4b2d-9bf0-ca27f90a0725', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:33:10.221308 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1f1078fe-cd7b-4458-aee5-8f32cebd88a3 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:10.232282 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1f1078fe-cd7b-4458-aee5-8f32cebd88a3 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: c8eed771-da93-492d-bb34-5020c379fb63] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:10.255086 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f1078fe-cd7b-4458-aee5-8f32cebd88a3 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:10.261584 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f1078fe-cd7b-4458-aee5-8f32cebd88a3 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:10.261584 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f1078fe-cd7b-4458-aee5-8f32cebd88a3 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:10.261584 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f1078fe-cd7b-4458-aee5-8f32cebd88a3 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:10.263726 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f1078fe-cd7b-4458-aee5-8f32cebd88a3 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:10.265303 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f1078fe-cd7b-4458-aee5-8f32cebd88a3 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:10.360285 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f1078fe-cd7b-4458-aee5-8f32cebd88a3 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:10.360919 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f1078fe-cd7b-4458-aee5-8f32cebd88a3 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:10.361470 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f1078fe-cd7b-4458-aee5-8f32cebd88a3 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:10.372434 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-1f1078fe-cd7b-4458-aee5-8f32cebd88a3 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lazy-loading 'fault' on Instance uuid c8eed771-da93-492d-bb34-5020c379fb63 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:33:10.563770 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1f1078fe-cd7b-4458-aee5-8f32cebd88a3 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:10.604308 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1f1078fe-cd7b-4458-aee5-8f32cebd88a3 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/c8eed771-da93-492d-bb34-5020c379fb63" status: 200 len: 1320 microversion: 2.1 time: 0.388147 Oct 23 01:33:10.619123 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2530/4979] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:10 2022] GET /compute/v2.1/servers/c8eed771-da93-492d-bb34-5020c379fb63 => generated 1320 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:33:10.656702 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-275c4a65-ce1b-40bc-93c8-63c54c9870bd tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:10.687269 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-275c4a65-ce1b-40bc-93c8-63c54c9870bd tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '96d3d3c6a02244888eebb6e70eaac4ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b051b0da0ab45ffa64c7b8b32465a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:10.688088 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-275c4a65-ce1b-40bc-93c8-63c54c9870bd tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Searching by: {'deleted': False, 'project_id': '3b051b0da0ab45ffa64c7b8b32465a20'} {{(pid=120944) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 23 01:33:10.713410 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-275c4a65-ce1b-40bc-93c8-63c54c9870bd tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:10.716801 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-275c4a65-ce1b-40bc-93c8-63c54c9870bd tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:10.718680 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-275c4a65-ce1b-40bc-93c8-63c54c9870bd tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:10.719765 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-275c4a65-ce1b-40bc-93c8-63c54c9870bd tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:10.722181 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-275c4a65-ce1b-40bc-93c8-63c54c9870bd tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:10.723796 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-275c4a65-ce1b-40bc-93c8-63c54c9870bd tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:10.794266 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.multi_cell_list [None req-275c4a65-ce1b-40bc-93c8-63c54c9870bd tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120944) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 23 01:33:10.882591 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-275c4a65-ce1b-40bc-93c8-63c54c9870bd tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.266577 Oct 23 01:33:10.889293 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2531/4980] 10.222.0.42 () {58 vars in 1125 bytes} [Sun Oct 23 01:33:10 2022] GET /compute/v2.1/servers => generated 334 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:33:10.897656 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0a7c739b-d56f-430f-8f8d-c29cac60abc8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:10.902680 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0a7c739b-d56f-430f-8f8d-c29cac60abc8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: e96f5e79-d832-4927-aef1-a45a815404b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:10.922666 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0a7c739b-d56f-430f-8f8d-c29cac60abc8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:10.924903 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0a7c739b-d56f-430f-8f8d-c29cac60abc8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:10.925900 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0a7c739b-d56f-430f-8f8d-c29cac60abc8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:10.926903 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0a7c739b-d56f-430f-8f8d-c29cac60abc8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:10.927588 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0a7c739b-d56f-430f-8f8d-c29cac60abc8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:10.928271 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0a7c739b-d56f-430f-8f8d-c29cac60abc8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:11.096387 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-0a7c739b-d56f-430f-8f8d-c29cac60abc8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lazy-loading 'services' on Instance uuid e96f5e79-d832-4927-aef1-a45a815404b0 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:33:11.316586 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-08f43f9b-7357-4e6e-b45a-f7c5226f3da0 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:33:11.317077 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-08f43f9b-7357-4e6e-b45a-f7c5226f3da0 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:33:11.317507 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-08f43f9b-7357-4e6e-b45a-f7c5226f3da0 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:33:11.317938 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-08f43f9b-7357-4e6e-b45a-f7c5226f3da0 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:33:11.318379 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-08f43f9b-7357-4e6e-b45a-f7c5226f3da0 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:33:11.338792 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-08f43f9b-7357-4e6e-b45a-f7c5226f3da0 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:11.339296 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-08f43f9b-7357-4e6e-b45a-f7c5226f3da0 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:11.339941 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-08f43f9b-7357-4e6e-b45a-f7c5226f3da0 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:11.340722 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-08f43f9b-7357-4e6e-b45a-f7c5226f3da0 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:11.341243 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-08f43f9b-7357-4e6e-b45a-f7c5226f3da0 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:11.341683 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-08f43f9b-7357-4e6e-b45a-f7c5226f3da0 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:11.364147 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-08f43f9b-7357-4e6e-b45a-f7c5226f3da0 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Getting quotas for project 842dcab8b48c43d7963a538d914b0b22. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:33:11.371963 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-08f43f9b-7357-4e6e-b45a-f7c5226f3da0 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Getting quotas for user 634bed7898c24baca6ba00392d49eea1 and project 842dcab8b48c43d7963a538d914b0b22. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:33:11.385963 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-08f43f9b-7357-4e6e-b45a-f7c5226f3da0 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:33:11.390625 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-08f43f9b-7357-4e6e-b45a-f7c5226f3da0 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: da5e83e9-fa65-44ef-a14b-102221ce876a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:33:11.417554 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0a7c739b-d56f-430f-8f8d-c29cac60abc8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0/os-volume_attachments/efba320e-5ace-4838-98e7-5e089aaf6472" status: 202 len: 0 microversion: 2.1 time: 0.526470 Oct 23 01:33:11.418875 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2532/4981] 10.222.0.42 () {58 vars in 1416 bytes} [Sun Oct 23 01:33:10 2022] DELETE /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0/os-volume_attachments/efba320e-5ace-4838-98e7-5e089aaf6472 => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:33:11.440834 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-605a55a1-99fd-428d-8ec1-90bf99d790fc tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:11.453895 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-605a55a1-99fd-428d-8ec1-90bf99d790fc tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '96d3d3c6a02244888eebb6e70eaac4ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b051b0da0ab45ffa64c7b8b32465a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:11.458107 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-605a55a1-99fd-428d-8ec1-90bf99d790fc tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Searching by: {'deleted': False, 'project_id': '3b051b0da0ab45ffa64c7b8b32465a20'} {{(pid=120944) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 23 01:33:11.479471 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-605a55a1-99fd-428d-8ec1-90bf99d790fc tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:11.488371 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-605a55a1-99fd-428d-8ec1-90bf99d790fc tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:11.489342 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-605a55a1-99fd-428d-8ec1-90bf99d790fc tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:11.490267 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-605a55a1-99fd-428d-8ec1-90bf99d790fc tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:11.495185 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-605a55a1-99fd-428d-8ec1-90bf99d790fc tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:11.496030 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-605a55a1-99fd-428d-8ec1-90bf99d790fc tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:11.546798 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.multi_cell_list [None req-605a55a1-99fd-428d-8ec1-90bf99d790fc tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120944) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 23 01:33:11.629500 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-605a55a1-99fd-428d-8ec1-90bf99d790fc tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3d3c6a02244888eebb6e70eaac4ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b051b0da0ab45ffa64c7b8b32465a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:11.648727 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:33:11.649369 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-08f43f9b-7357-4e6e-b45a-f7c5226f3da0 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.615253 Oct 23 01:33:11.651633 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2450/4982] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:33:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 23 01:33:11.658743 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-605a55a1-99fd-428d-8ec1-90bf99d790fc tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:11.658743 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-605a55a1-99fd-428d-8ec1-90bf99d790fc tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:11.658743 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-605a55a1-99fd-428d-8ec1-90bf99d790fc tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:11.681808 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fb7e4112-6bb6-45ef-8b5e-29494601019e tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:11.690294 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-fb7e4112-6bb6-45ef-8b5e-29494601019e tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: e96f5e79-d832-4927-aef1-a45a815404b0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:11.701950 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fb7e4112-6bb6-45ef-8b5e-29494601019e tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:11.702590 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fb7e4112-6bb6-45ef-8b5e-29494601019e tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:11.703197 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fb7e4112-6bb6-45ef-8b5e-29494601019e tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:11.704306 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fb7e4112-6bb6-45ef-8b5e-29494601019e tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:11.704946 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fb7e4112-6bb6-45ef-8b5e-29494601019e tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:11.705705 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fb7e4112-6bb6-45ef-8b5e-29494601019e tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:11.749442 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fb7e4112-6bb6-45ef-8b5e-29494601019e tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077318 Oct 23 01:33:11.750819 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2451/4983] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:33:11 2022] GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:33:11.764045 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-072f0cc9-e2b7-45b5-90b7-a2f29f751c17 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:11.765092 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-072f0cc9-e2b7-45b5-90b7-a2f29f751c17 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: c8eed771-da93-492d-bb34-5020c379fb63] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:11.773704 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-072f0cc9-e2b7-45b5-90b7-a2f29f751c17 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:11.774321 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-072f0cc9-e2b7-45b5-90b7-a2f29f751c17 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:11.774935 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-072f0cc9-e2b7-45b5-90b7-a2f29f751c17 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:11.777294 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-072f0cc9-e2b7-45b5-90b7-a2f29f751c17 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:11.778269 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-072f0cc9-e2b7-45b5-90b7-a2f29f751c17 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:11.779036 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-072f0cc9-e2b7-45b5-90b7-a2f29f751c17 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:11.806580 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-072f0cc9-e2b7-45b5-90b7-a2f29f751c17 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] HTTP exception thrown: Instance c8eed771-da93-492d-bb34-5020c379fb63 could not be found. Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-072f0cc9-e2b7-45b5-90b7-a2f29f751c17 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Request method failure captured: Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/c8eed771-da93-492d-bb34-5020c379fb63 HTTP/1.1 Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJkiigL5TCEu6eSSAcyvyVmYwcN25zFDHPVJqRKHbtxzIEn87jCeqAfp7Z9r3Mqhyb3sj4ihzI_o6sMFkrbUwNL-zNG9d9yXVxVjtum4uC7NU-HTDI6Yq0W2nY2ZxVUGKOV2HfdfrtC_JKFgX2qnR1YVSIaIVW5JxazPUN9LbJjq984 Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: e2ee2ea8399e42a5a5cd0d0ddeb192b5 Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServersTestJSON-245534565 Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}] Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServersTestJSON-245534565 Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: e2ee2ea8399e42a5a5cd0d0ddeb192b5 Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServersTestJSON-245534565 Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServersTestJSON-245534565-project Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 77197152ea5040bab602d5381d21341a Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServersTestJSON-245534565-project Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: exception: Instance c8eed771-da93-492d-bb34-5020c379fb63 could not be found. Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'c8eed771-da93-492d-bb34-5020c379fb63'} Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8eed771-da93-492d-bb34-5020c379fb63 could not be found. Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8eed771-da93-492d-bb34-5020c379fb63 could not be found. Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:33:11.809163 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:33:11.815523 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:33:11.815523 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:33:11.815523 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:33:11.815523 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:33:11.815523 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8eed771-da93-492d-bb34-5020c379fb63 could not be found. Oct 23 01:33:11.815523 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:33:11.819110 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-072f0cc9-e2b7-45b5-90b7-a2f29f751c17 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Returning 404 to user: Instance c8eed771-da93-492d-bb34-5020c379fb63 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:33:11.820666 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-072f0cc9-e2b7-45b5-90b7-a2f29f751c17 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/c8eed771-da93-492d-bb34-5020c379fb63" status: 404 len: 111 microversion: 2.1 time: 0.068266 Oct 23 01:33:11.821868 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2452/4984] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:11 2022] GET /compute/v2.1/servers/c8eed771-da93-492d-bb34-5020c379fb63 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:33:11.831431 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d17b8928-12c6-4315-888b-7fea25f67df1 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:11.834744 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d17b8928-12c6-4315-888b-7fea25f67df1 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: da5e83e9-fa65-44ef-a14b-102221ce876a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:12.119686 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d17b8928-12c6-4315-888b-7fea25f67df1 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:12.137218 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d17b8928-12c6-4315-888b-7fea25f67df1 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/da5e83e9-fa65-44ef-a14b-102221ce876a" status: 200 len: 1215 microversion: 2.1 time: 0.313980 Oct 23 01:33:12.138004 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2453/4985] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:11 2022] GET /compute/v2.1/servers/da5e83e9-fa65-44ef-a14b-102221ce876a => generated 1215 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:12.149566 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-055ca113-f17b-4742-9aff-d3a28ab15905 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1851470855", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "54c8030f-5807-4507-8aa3-283b114a73f4"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:33:12.231075 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-605a55a1-99fd-428d-8ec1-90bf99d790fc tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] 10.222.0.42 "GET /compute/v2.1/servers/detail" status: 200 len: 1695 microversion: 2.1 time: 0.806445 Oct 23 01:33:12.231075 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2533/4986] 10.222.0.42 () {58 vars in 1146 bytes} [Sun Oct 23 01:33:11 2022] GET /compute/v2.1/servers/detail => generated 1695 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:12.235078 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fcf51a11-4536-4a4e-a17d-f5ab894b2491 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:12.235851 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fcf51a11-4536-4a4e-a17d-f5ab894b2491 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: da5e83e9-fa65-44ef-a14b-102221ce876a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:12.289629 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fcf51a11-4536-4a4e-a17d-f5ab894b2491 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: da5e83e9-fa65-44ef-a14b-102221ce876a] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:33:12.323380 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-055ca113-f17b-4742-9aff-d3a28ab15905 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] validate_networks() for [('54c8030f-5807-4507-8aa3-283b114a73f4', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:33:13.249231 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-055ca113-f17b-4742-9aff-d3a28ab15905 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:33:13.249999 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-055ca113-f17b-4742-9aff-d3a28ab15905 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:33:13.250559 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-055ca113-f17b-4742-9aff-d3a28ab15905 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:33:13.250988 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-055ca113-f17b-4742-9aff-d3a28ab15905 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:33:13.251408 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-055ca113-f17b-4742-9aff-d3a28ab15905 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:33:13.267266 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-055ca113-f17b-4742-9aff-d3a28ab15905 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:13.271428 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-055ca113-f17b-4742-9aff-d3a28ab15905 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:13.271428 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-055ca113-f17b-4742-9aff-d3a28ab15905 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:13.276650 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-055ca113-f17b-4742-9aff-d3a28ab15905 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:13.277439 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-055ca113-f17b-4742-9aff-d3a28ab15905 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:13.281119 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-055ca113-f17b-4742-9aff-d3a28ab15905 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:13.296521 n-d-master-1 devstack@n-api.service[120944]: INFO nova.scheduler.client.report [None req-fcf51a11-4536-4a4e-a17d-f5ab894b2491 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Deleted allocations for instance da5e83e9-fa65-44ef-a14b-102221ce876a Oct 23 01:33:13.335849 n-d-master-1 devstack@n-api.service[120944]: INFO nova.compute.api [None req-fcf51a11-4536-4a4e-a17d-f5ab894b2491 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: da5e83e9-fa65-44ef-a14b-102221ce876a] Instance Mapping does not exist while attempting local delete cleanup. Oct 23 01:33:13.342807 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fcf51a11-4536-4a4e-a17d-f5ab894b2491 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "DELETE /compute/v2.1/servers/da5e83e9-fa65-44ef-a14b-102221ce876a" status: 204 len: 0 microversion: 2.1 time: 1.113076 Oct 23 01:33:13.346195 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2534/4987] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:33:12 2022] DELETE /compute/v2.1/servers/da5e83e9-fa65-44ef-a14b-102221ce876a => generated 0 bytes in 1118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:33:13.360738 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1d2543e3-d37c-44cd-aa13-dcd70187aa21 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:13.360890 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-055ca113-f17b-4742-9aff-d3a28ab15905 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Getting quotas for project e2ee2ea8399e42a5a5cd0d0ddeb192b5. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:33:13.390567 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1d2543e3-d37c-44cd-aa13-dcd70187aa21 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] 10.222.0.42 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.040810 Oct 23 01:33:13.393665 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-055ca113-f17b-4742-9aff-d3a28ab15905 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Getting quotas for user 77197152ea5040bab602d5381d21341a and project e2ee2ea8399e42a5a5cd0d0ddeb192b5. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:33:13.410551 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2535/4988] 10.222.0.42 () {58 vars in 1137 bytes} [Sun Oct 23 01:33:13 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:33:13.438011 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8ae28c34-fa29-4e75-aa10-779bafbde35f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:13.441320 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8ae28c34-fa29-4e75-aa10-779bafbde35f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: e96f5e79-d832-4927-aef1-a45a815404b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:13.454442 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-055ca113-f17b-4742-9aff-d3a28ab15905 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:33:13.462482 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ae28c34-fa29-4e75-aa10-779bafbde35f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:13.464145 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-055ca113-f17b-4742-9aff-d3a28ab15905 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 7878a5d1-1349-4cb6-abd1-519f61b97eef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:33:13.466084 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ae28c34-fa29-4e75-aa10-779bafbde35f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:13.474895 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ae28c34-fa29-4e75-aa10-779bafbde35f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:13.477164 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ae28c34-fa29-4e75-aa10-779bafbde35f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:13.478273 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ae28c34-fa29-4e75-aa10-779bafbde35f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:13.480575 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ae28c34-fa29-4e75-aa10-779bafbde35f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:13.571383 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8ae28c34-fa29-4e75-aa10-779bafbde35f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.151790 Oct 23 01:33:13.577660 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2536/4989] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:33:13 2022] GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:33:13.582940 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e899d094-a317-4287-aabc-b251dd58b890 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:13.583619 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e899d094-a317-4287-aabc-b251dd58b890 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: da5e83e9-fa65-44ef-a14b-102221ce876a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:13.590670 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-e899d094-a317-4287-aabc-b251dd58b890 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] HTTP exception thrown: Instance da5e83e9-fa65-44ef-a14b-102221ce876a could not be found. Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e899d094-a317-4287-aabc-b251dd58b890 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Request method failure captured: Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/da5e83e9-fa65-44ef-a14b-102221ce876a HTTP/1.1 Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJlvTfuM9-iirX2FXe8mkTy2eWW7UhgAXbnHf6lceGN18S7lbSlaINo5EbF9-Kmi1tphVBr2Fcj8S4BVPceiAUMjh1Az0xLOZc1N90Wz0wmSyINFoBFx331KJ40smzwK1ZOJLA4k7IFyzBj3SQlZplUyTac5KUYxpNFIDY-5Uus0ZuU Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 842dcab8b48c43d7963a538d914b0b22 Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-DeleteServersTestJSON-654775470 Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/842dcab8b48c43d7963a538d914b0b22"}]}] Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-DeleteServersTestJSON-654775470 Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 842dcab8b48c43d7963a538d914b0b22 Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-DeleteServersTestJSON-654775470 Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-DeleteServersTestJSON-654775470-project Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 634bed7898c24baca6ba00392d49eea1 Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-DeleteServersTestJSON-654775470-project Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: exception: Instance da5e83e9-fa65-44ef-a14b-102221ce876a could not be found. Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'da5e83e9-fa65-44ef-a14b-102221ce876a'} Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da5e83e9-fa65-44ef-a14b-102221ce876a could not be found. Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da5e83e9-fa65-44ef-a14b-102221ce876a could not be found. Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:33:13.592372 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:33:13.607069 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:33:13.607069 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:33:13.607069 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:33:13.607069 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da5e83e9-fa65-44ef-a14b-102221ce876a could not be found. Oct 23 01:33:13.607069 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:33:13.607069 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e899d094-a317-4287-aabc-b251dd58b890 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Returning 404 to user: Instance da5e83e9-fa65-44ef-a14b-102221ce876a could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:33:13.607069 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e899d094-a317-4287-aabc-b251dd58b890 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/da5e83e9-fa65-44ef-a14b-102221ce876a" status: 404 len: 111 microversion: 2.1 time: 0.015105 Oct 23 01:33:13.607069 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2537/4990] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:13 2022] GET /compute/v2.1/servers/da5e83e9-fa65-44ef-a14b-102221ce876a => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:33:13.693177 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-055ca113-f17b-4742-9aff-d3a28ab15905 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.550187 Oct 23 01:33:13.694423 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2454/4991] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:33:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:33:13.706385 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-543bbaab-6329-4d85-bfed-5a521076cb86 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:13.707469 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-543bbaab-6329-4d85-bfed-5a521076cb86 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 7878a5d1-1349-4cb6-abd1-519f61b97eef] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:13.735756 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-78d1dc6a-04f7-4592-a0f8-46a047ba86af tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:13.736384 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-78d1dc6a-04f7-4592-a0f8-46a047ba86af tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] [instance: 7181fffe-8915-49c2-826a-0fa8040dc941] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:13.748089 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78d1dc6a-04f7-4592-a0f8-46a047ba86af tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:13.748591 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78d1dc6a-04f7-4592-a0f8-46a047ba86af tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:13.749035 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78d1dc6a-04f7-4592-a0f8-46a047ba86af tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:13.756260 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78d1dc6a-04f7-4592-a0f8-46a047ba86af tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:13.756773 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78d1dc6a-04f7-4592-a0f8-46a047ba86af tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:13.757221 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78d1dc6a-04f7-4592-a0f8-46a047ba86af tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:13.876531 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-543bbaab-6329-4d85-bfed-5a521076cb86 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:13.887291 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-543bbaab-6329-4d85-bfed-5a521076cb86 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef" status: 200 len: 1209 microversion: 2.1 time: 0.184969 Oct 23 01:33:13.907122 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2538/4992] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:13 2022] GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef => generated 1209 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:13.914825 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-78d1dc6a-04f7-4592-a0f8-46a047ba86af tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] [instance: 7181fffe-8915-49c2-826a-0fa8040dc941] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:33:13.953295 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-108c75ee-8eb3-4637-9004-cc45a8081aa2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1782314931", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "ba696604-5fcc-4b2d-9bf0-ca27f90a0725"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:33:14.068332 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-108c75ee-8eb3-4637-9004-cc45a8081aa2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] validate_networks() for [('ba696604-5fcc-4b2d-9bf0-ca27f90a0725', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:33:14.268065 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:33:14.373256 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-78d1dc6a-04f7-4592-a0f8-46a047ba86af tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7181fffe-8915-49c2-826a-0fa8040dc941" status: 204 len: 0 microversion: 2.1 time: 0.642295 Oct 23 01:33:14.377295 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2455/4993] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:33:13 2022] DELETE /compute/v2.1/servers/7181fffe-8915-49c2-826a-0fa8040dc941 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 23 01:33:14.388930 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-dcac23e2-1677-4f0d-84ff-da73999b34f1 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:14.389502 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-dcac23e2-1677-4f0d-84ff-da73999b34f1 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] [instance: 7181fffe-8915-49c2-826a-0fa8040dc941] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:14.407502 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dcac23e2-1677-4f0d-84ff-da73999b34f1 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:14.408911 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dcac23e2-1677-4f0d-84ff-da73999b34f1 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:14.408911 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dcac23e2-1677-4f0d-84ff-da73999b34f1 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:14.409143 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dcac23e2-1677-4f0d-84ff-da73999b34f1 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:14.414908 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dcac23e2-1677-4f0d-84ff-da73999b34f1 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:14.415677 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dcac23e2-1677-4f0d-84ff-da73999b34f1 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:15.116689 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-dcac23e2-1677-4f0d-84ff-da73999b34f1 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3d3c6a02244888eebb6e70eaac4ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b051b0da0ab45ffa64c7b8b32465a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:15.126621 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-dcac23e2-1677-4f0d-84ff-da73999b34f1 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] 10.222.0.42 "GET /compute/v2.1/servers/7181fffe-8915-49c2-826a-0fa8040dc941" status: 200 len: 1698 microversion: 2.1 time: 0.747976 Oct 23 01:33:15.127437 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2456/4994] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:14 2022] GET /compute/v2.1/servers/7181fffe-8915-49c2-826a-0fa8040dc941 => generated 1698 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:15.141869 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d6ec91f1-e4ab-4663-bc21-6894dde11ddd tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:15.144218 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d6ec91f1-e4ab-4663-bc21-6894dde11ddd tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: e96f5e79-d832-4927-aef1-a45a815404b0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:15.153605 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d6ec91f1-e4ab-4663-bc21-6894dde11ddd tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:15.154130 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d6ec91f1-e4ab-4663-bc21-6894dde11ddd tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:15.154572 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d6ec91f1-e4ab-4663-bc21-6894dde11ddd tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:15.157866 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d6ec91f1-e4ab-4663-bc21-6894dde11ddd tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:15.157866 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d6ec91f1-e4ab-4663-bc21-6894dde11ddd tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:15.157866 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d6ec91f1-e4ab-4663-bc21-6894dde11ddd tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:15.228645 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d6ec91f1-e4ab-4663-bc21-6894dde11ddd tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100355 Oct 23 01:33:15.229937 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2457/4995] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:33:15 2022] GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:33:15.234591 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d4dceb10-fd03-4763-ae82-ec43eeda6c2c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:15.250094 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d4dceb10-fd03-4763-ae82-ec43eeda6c2c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 7878a5d1-1349-4cb6-abd1-519f61b97eef] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:15.352358 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d4dceb10-fd03-4763-ae82-ec43eeda6c2c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:15.361189 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d4dceb10-fd03-4763-ae82-ec43eeda6c2c tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef" status: 200 len: 1209 microversion: 2.1 time: 0.130336 Oct 23 01:33:15.362378 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2458/4996] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:15 2022] GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef => generated 1209 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:15.599414 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-108c75ee-8eb3-4637-9004-cc45a8081aa2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:33:15.601040 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-108c75ee-8eb3-4637-9004-cc45a8081aa2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:33:15.602363 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-108c75ee-8eb3-4637-9004-cc45a8081aa2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:33:15.603247 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-108c75ee-8eb3-4637-9004-cc45a8081aa2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:33:15.603897 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-108c75ee-8eb3-4637-9004-cc45a8081aa2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:33:15.615643 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-108c75ee-8eb3-4637-9004-cc45a8081aa2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:15.616541 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-108c75ee-8eb3-4637-9004-cc45a8081aa2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:15.617288 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-108c75ee-8eb3-4637-9004-cc45a8081aa2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:15.618326 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-108c75ee-8eb3-4637-9004-cc45a8081aa2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:15.619078 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-108c75ee-8eb3-4637-9004-cc45a8081aa2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:15.619707 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-108c75ee-8eb3-4637-9004-cc45a8081aa2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:15.672846 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-108c75ee-8eb3-4637-9004-cc45a8081aa2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Getting quotas for project 842dcab8b48c43d7963a538d914b0b22. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:33:15.708408 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-108c75ee-8eb3-4637-9004-cc45a8081aa2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Getting quotas for user 634bed7898c24baca6ba00392d49eea1 and project 842dcab8b48c43d7963a538d914b0b22. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:33:15.725880 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-108c75ee-8eb3-4637-9004-cc45a8081aa2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:33:15.729024 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-108c75ee-8eb3-4637-9004-cc45a8081aa2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: e3bb9493-45f6-4889-8655-222a1284b4bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:33:15.979275 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-108c75ee-8eb3-4637-9004-cc45a8081aa2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.034758 Oct 23 01:33:15.986069 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2539/4997] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:33:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2040 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:33:15.997588 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-00c18c1a-52ce-4d9e-83df-b530c3b89c34 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:15.997588 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-00c18c1a-52ce-4d9e-83df-b530c3b89c34 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: e3bb9493-45f6-4889-8655-222a1284b4bf] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:16.158896 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-59d97b96-017f-47a8-9e97-988665a87111 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:16.162137 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-59d97b96-017f-47a8-9e97-988665a87111 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] [instance: 7181fffe-8915-49c2-826a-0fa8040dc941] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:16.183949 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-00c18c1a-52ce-4d9e-83df-b530c3b89c34 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:16.195871 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-00c18c1a-52ce-4d9e-83df-b530c3b89c34 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/e3bb9493-45f6-4889-8655-222a1284b4bf" status: 200 len: 1215 microversion: 2.1 time: 0.202487 Oct 23 01:33:16.196751 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-59d97b96-017f-47a8-9e97-988665a87111 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:16.198636 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-59d97b96-017f-47a8-9e97-988665a87111 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:16.199091 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-59d97b96-017f-47a8-9e97-988665a87111 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:16.199846 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2459/4998] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:15 2022] GET /compute/v2.1/servers/e3bb9493-45f6-4889-8655-222a1284b4bf => generated 1215 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:16.203665 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-59d97b96-017f-47a8-9e97-988665a87111 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:16.205001 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-59d97b96-017f-47a8-9e97-988665a87111 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:16.206629 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-59d97b96-017f-47a8-9e97-988665a87111 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:16.243236 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0a033551-f9a2-406b-b9d9-82e83a87298f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:16.246021 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0a033551-f9a2-406b-b9d9-82e83a87298f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: e96f5e79-d832-4927-aef1-a45a815404b0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:16.261934 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0a033551-f9a2-406b-b9d9-82e83a87298f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:16.274214 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0a033551-f9a2-406b-b9d9-82e83a87298f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:16.275268 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0a033551-f9a2-406b-b9d9-82e83a87298f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:16.276046 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0a033551-f9a2-406b-b9d9-82e83a87298f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:16.276526 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0a033551-f9a2-406b-b9d9-82e83a87298f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:16.281133 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0a033551-f9a2-406b-b9d9-82e83a87298f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:16.384955 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0a033551-f9a2-406b-b9d9-82e83a87298f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137639 Oct 23 01:33:16.389965 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2460/4999] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:33:16 2022] GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:33:16.404732 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d64a040b-4b5e-4c31-957a-0e6a395f0268 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:16.405367 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d64a040b-4b5e-4c31-957a-0e6a395f0268 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 7878a5d1-1349-4cb6-abd1-519f61b97eef] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:16.417324 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d64a040b-4b5e-4c31-957a-0e6a395f0268 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:16.417717 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d64a040b-4b5e-4c31-957a-0e6a395f0268 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:16.423421 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d64a040b-4b5e-4c31-957a-0e6a395f0268 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:16.426114 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d64a040b-4b5e-4c31-957a-0e6a395f0268 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:16.427291 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d64a040b-4b5e-4c31-957a-0e6a395f0268 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:16.428591 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d64a040b-4b5e-4c31-957a-0e6a395f0268 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:16.606011 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-59d97b96-017f-47a8-9e97-988665a87111 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3d3c6a02244888eebb6e70eaac4ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b051b0da0ab45ffa64c7b8b32465a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:16.636621 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d64a040b-4b5e-4c31-957a-0e6a395f0268 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:16.641154 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:33:16.659875 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-59d97b96-017f-47a8-9e97-988665a87111 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] 10.222.0.42 "GET /compute/v2.1/servers/7181fffe-8915-49c2-826a-0fa8040dc941" status: 200 len: 1698 microversion: 2.1 time: 0.476538 Oct 23 01:33:16.664981 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2540/5000] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:16 2022] GET /compute/v2.1/servers/7181fffe-8915-49c2-826a-0fa8040dc941 => generated 1698 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:16.680055 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d64a040b-4b5e-4c31-957a-0e6a395f0268 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef" status: 200 len: 1205 microversion: 2.1 time: 0.286354 Oct 23 01:33:16.680979 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2461/5001] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:16 2022] GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef => generated 1205 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:17.224940 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-adcd633e-f445-4cb8-8a27-bb53f6096868 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:17.225643 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-adcd633e-f445-4cb8-8a27-bb53f6096868 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: e3bb9493-45f6-4889-8655-222a1284b4bf] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:17.418436 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-adcd633e-f445-4cb8-8a27-bb53f6096868 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:17.424476 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2f973047-b18b-48ba-96b9-133304200b75 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:17.438271 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2f973047-b18b-48ba-96b9-133304200b75 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: e96f5e79-d832-4927-aef1-a45a815404b0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:17.445101 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-adcd633e-f445-4cb8-8a27-bb53f6096868 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/e3bb9493-45f6-4889-8655-222a1284b4bf" status: 200 len: 1215 microversion: 2.1 time: 0.222298 Oct 23 01:33:17.449615 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2541/5002] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:17 2022] GET /compute/v2.1/servers/e3bb9493-45f6-4889-8655-222a1284b4bf => generated 1215 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:17.469715 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2f973047-b18b-48ba-96b9-133304200b75 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:17.469715 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2f973047-b18b-48ba-96b9-133304200b75 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:17.469715 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2f973047-b18b-48ba-96b9-133304200b75 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:17.469715 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2f973047-b18b-48ba-96b9-133304200b75 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:17.469715 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2f973047-b18b-48ba-96b9-133304200b75 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:17.469715 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2f973047-b18b-48ba-96b9-133304200b75 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:17.529792 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2f973047-b18b-48ba-96b9-133304200b75 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132340 Oct 23 01:33:17.536060 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2462/5003] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:33:17 2022] GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:33:17.694574 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2d24ea4f-e760-4877-9401-6752786be3a0 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:17.696218 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2d24ea4f-e760-4877-9401-6752786be3a0 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] [instance: 7181fffe-8915-49c2-826a-0fa8040dc941] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:17.708372 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-64bd5fd8-628c-4b56-8156-05669fded4d4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:17.714367 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-64bd5fd8-628c-4b56-8156-05669fded4d4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 7878a5d1-1349-4cb6-abd1-519f61b97eef] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:17.719521 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64bd5fd8-628c-4b56-8156-05669fded4d4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:17.723550 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64bd5fd8-628c-4b56-8156-05669fded4d4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:17.727150 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64bd5fd8-628c-4b56-8156-05669fded4d4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:17.729448 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64bd5fd8-628c-4b56-8156-05669fded4d4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:17.730129 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64bd5fd8-628c-4b56-8156-05669fded4d4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:17.734204 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64bd5fd8-628c-4b56-8156-05669fded4d4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:17.741073 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2d24ea4f-e760-4877-9401-6752786be3a0 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:17.745952 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2d24ea4f-e760-4877-9401-6752786be3a0 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:17.745952 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2d24ea4f-e760-4877-9401-6752786be3a0 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:17.745952 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2d24ea4f-e760-4877-9401-6752786be3a0 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:17.746306 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2d24ea4f-e760-4877-9401-6752786be3a0 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:17.746548 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2d24ea4f-e760-4877-9401-6752786be3a0 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:18.136759 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-64bd5fd8-628c-4b56-8156-05669fded4d4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:18.147005 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-64bd5fd8-628c-4b56-8156-05669fded4d4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef" status: 200 len: 1269 microversion: 2.1 time: 0.442501 Oct 23 01:33:18.154596 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2463/5004] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:17 2022] GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef => generated 1269 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:18.403438 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2d24ea4f-e760-4877-9401-6752786be3a0 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3d3c6a02244888eebb6e70eaac4ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b051b0da0ab45ffa64c7b8b32465a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:18.412122 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2d24ea4f-e760-4877-9401-6752786be3a0 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] 10.222.0.42 "GET /compute/v2.1/servers/7181fffe-8915-49c2-826a-0fa8040dc941" status: 200 len: 1698 microversion: 2.1 time: 0.730460 Oct 23 01:33:18.426227 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2542/5005] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:17 2022] GET /compute/v2.1/servers/7181fffe-8915-49c2-826a-0fa8040dc941 => generated 1698 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:18.484756 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9255f22f-90fe-49c0-beb7-702b1f63b0fe tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:18.486015 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9255f22f-90fe-49c0-beb7-702b1f63b0fe tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: e3bb9493-45f6-4889-8655-222a1284b4bf] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:18.497249 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9255f22f-90fe-49c0-beb7-702b1f63b0fe tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:18.498006 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9255f22f-90fe-49c0-beb7-702b1f63b0fe tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:18.498718 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9255f22f-90fe-49c0-beb7-702b1f63b0fe tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:18.499662 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9255f22f-90fe-49c0-beb7-702b1f63b0fe tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:18.500272 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9255f22f-90fe-49c0-beb7-702b1f63b0fe tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:18.500858 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9255f22f-90fe-49c0-beb7-702b1f63b0fe tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:18.544497 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a0fedba4-1d43-4af7-b510-70b346e96523 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:18.546915 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a0fedba4-1d43-4af7-b510-70b346e96523 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: e96f5e79-d832-4927-aef1-a45a815404b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:18.575464 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a0fedba4-1d43-4af7-b510-70b346e96523 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:18.576077 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a0fedba4-1d43-4af7-b510-70b346e96523 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:18.576568 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a0fedba4-1d43-4af7-b510-70b346e96523 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:18.577422 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a0fedba4-1d43-4af7-b510-70b346e96523 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:18.578284 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a0fedba4-1d43-4af7-b510-70b346e96523 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:18.590364 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a0fedba4-1d43-4af7-b510-70b346e96523 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:18.675219 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a0fedba4-1d43-4af7-b510-70b346e96523 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127610 Oct 23 01:33:18.676624 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2543/5006] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:33:18 2022] GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:33:18.694698 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9255f22f-90fe-49c0-beb7-702b1f63b0fe tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:18.707969 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9255f22f-90fe-49c0-beb7-702b1f63b0fe tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/e3bb9493-45f6-4889-8655-222a1284b4bf" status: 200 len: 1267 microversion: 2.1 time: 0.227704 Oct 23 01:33:18.716106 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2464/5007] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:18 2022] GET /compute/v2.1/servers/e3bb9493-45f6-4889-8655-222a1284b4bf => generated 1267 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:19.191682 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2adcffdf-2ca0-4f69-8d1f-828a6baf2e8e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:19.192990 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2adcffdf-2ca0-4f69-8d1f-828a6baf2e8e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 7878a5d1-1349-4cb6-abd1-519f61b97eef] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:19.206228 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2adcffdf-2ca0-4f69-8d1f-828a6baf2e8e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:19.215165 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2adcffdf-2ca0-4f69-8d1f-828a6baf2e8e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:19.216444 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2adcffdf-2ca0-4f69-8d1f-828a6baf2e8e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:19.217426 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2adcffdf-2ca0-4f69-8d1f-828a6baf2e8e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:19.218188 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2adcffdf-2ca0-4f69-8d1f-828a6baf2e8e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:19.219016 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2adcffdf-2ca0-4f69-8d1f-828a6baf2e8e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:19.327124 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-3608a7ad-6e70-46ed-b650-5748f8010d29 req-df0e9d26-c976-46e3-bc01-af81185dd530 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7181fffe-8915-49c2-826a-0fa8040dc941", "name": "network-vif-deleted", "tag": "29153efe-3a7e-443e-80e2-bbce0757b30a"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:33:19.346418 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-3608a7ad-6e70-46ed-b650-5748f8010d29 req-df0e9d26-c976-46e3-bc01-af81185dd530 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:19.346919 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-3608a7ad-6e70-46ed-b650-5748f8010d29 req-df0e9d26-c976-46e3-bc01-af81185dd530 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:19.349930 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-3608a7ad-6e70-46ed-b650-5748f8010d29 req-df0e9d26-c976-46e3-bc01-af81185dd530 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:19.420002 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-3608a7ad-6e70-46ed-b650-5748f8010d29 req-df0e9d26-c976-46e3-bc01-af81185dd530 service nova] Creating event network-vif-deleted:29153efe-3a7e-443e-80e2-bbce0757b30a for instance 7181fffe-8915-49c2-826a-0fa8040dc941 on n-h2-master-1 Oct 23 01:33:19.449720 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-3608a7ad-6e70-46ed-b650-5748f8010d29 req-df0e9d26-c976-46e3-bc01-af81185dd530 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132350 Oct 23 01:33:19.455321 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2465/5008] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:33:19.479591 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2adcffdf-2ca0-4f69-8d1f-828a6baf2e8e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:19.486523 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d950463b-c977-4125-8bd3-bf880a785853 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:19.495426 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d950463b-c977-4125-8bd3-bf880a785853 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] [instance: 7181fffe-8915-49c2-826a-0fa8040dc941] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:19.500197 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2adcffdf-2ca0-4f69-8d1f-828a6baf2e8e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef" status: 200 len: 1267 microversion: 2.1 time: 0.312538 Oct 23 01:33:19.501099 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2544/5009] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:19 2022] GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef => generated 1267 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:19.536904 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d950463b-c977-4125-8bd3-bf880a785853 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:19.539916 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d950463b-c977-4125-8bd3-bf880a785853 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:19.541690 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d950463b-c977-4125-8bd3-bf880a785853 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:19.542854 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d950463b-c977-4125-8bd3-bf880a785853 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:19.551659 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d950463b-c977-4125-8bd3-bf880a785853 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:19.552881 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d950463b-c977-4125-8bd3-bf880a785853 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:19.688475 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-acc4406d-0963-440a-b930-b44da4c19031 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:19.690821 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-acc4406d-0963-440a-b930-b44da4c19031 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: e96f5e79-d832-4927-aef1-a45a815404b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:19.713170 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-acc4406d-0963-440a-b930-b44da4c19031 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:19.717035 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-acc4406d-0963-440a-b930-b44da4c19031 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:19.718279 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-acc4406d-0963-440a-b930-b44da4c19031 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:19.719527 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-acc4406d-0963-440a-b930-b44da4c19031 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:19.720102 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-acc4406d-0963-440a-b930-b44da4c19031 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:19.722747 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-acc4406d-0963-440a-b930-b44da4c19031 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:19.813044 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-acc4406d-0963-440a-b930-b44da4c19031 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128870 Oct 23 01:33:19.813647 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2545/5010] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:33:19 2022] GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:33:19.829658 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dbb1ccd8-9e77-4719-a921-e410a8e15f46 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:19.830335 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-dbb1ccd8-9e77-4719-a921-e410a8e15f46 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: e3bb9493-45f6-4889-8655-222a1284b4bf] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:19.848192 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dbb1ccd8-9e77-4719-a921-e410a8e15f46 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:19.850133 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dbb1ccd8-9e77-4719-a921-e410a8e15f46 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:19.852013 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dbb1ccd8-9e77-4719-a921-e410a8e15f46 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:19.852968 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dbb1ccd8-9e77-4719-a921-e410a8e15f46 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:19.853518 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dbb1ccd8-9e77-4719-a921-e410a8e15f46 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:19.854045 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dbb1ccd8-9e77-4719-a921-e410a8e15f46 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:19.893429 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:33:19.904135 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d950463b-c977-4125-8bd3-bf880a785853 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3d3c6a02244888eebb6e70eaac4ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b051b0da0ab45ffa64c7b8b32465a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:19.912813 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d950463b-c977-4125-8bd3-bf880a785853 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] 10.222.0.42 "GET /compute/v2.1/servers/7181fffe-8915-49c2-826a-0fa8040dc941" status: 200 len: 1354 microversion: 2.1 time: 0.451430 Oct 23 01:33:19.938975 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2466/5011] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:19 2022] GET /compute/v2.1/servers/7181fffe-8915-49c2-826a-0fa8040dc941 => generated 1354 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:20.037563 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-dbb1ccd8-9e77-4719-a921-e410a8e15f46 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:20.049143 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-dbb1ccd8-9e77-4719-a921-e410a8e15f46 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/e3bb9493-45f6-4889-8655-222a1284b4bf" status: 200 len: 1285 microversion: 2.1 time: 0.234375 Oct 23 01:33:20.054225 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2546/5012] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:19 2022] GET /compute/v2.1/servers/e3bb9493-45f6-4889-8655-222a1284b4bf => generated 1285 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:20.526157 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8a4d130d-8827-45cc-8df5-1d19ad53394a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:20.526964 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8a4d130d-8827-45cc-8df5-1d19ad53394a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 7878a5d1-1349-4cb6-abd1-519f61b97eef] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:20.540056 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a4d130d-8827-45cc-8df5-1d19ad53394a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:20.543568 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a4d130d-8827-45cc-8df5-1d19ad53394a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:20.544418 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a4d130d-8827-45cc-8df5-1d19ad53394a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:20.545572 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a4d130d-8827-45cc-8df5-1d19ad53394a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:20.547702 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a4d130d-8827-45cc-8df5-1d19ad53394a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:20.548371 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a4d130d-8827-45cc-8df5-1d19ad53394a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:20.825492 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e6311f08-3503-4006-af58-7efc09b9a76c tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:20.828427 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e6311f08-3503-4006-af58-7efc09b9a76c tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: e96f5e79-d832-4927-aef1-a45a815404b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:20.846276 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e6311f08-3503-4006-af58-7efc09b9a76c tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:20.866805 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e6311f08-3503-4006-af58-7efc09b9a76c tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:20.867555 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e6311f08-3503-4006-af58-7efc09b9a76c tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:20.868837 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e6311f08-3503-4006-af58-7efc09b9a76c tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:20.869519 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e6311f08-3503-4006-af58-7efc09b9a76c tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:20.870322 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e6311f08-3503-4006-af58-7efc09b9a76c tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:20.952042 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e6311f08-3503-4006-af58-7efc09b9a76c tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128411 Oct 23 01:33:20.953384 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2547/5013] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:33:20 2022] GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:33:20.963582 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a5f52e65-da9c-450c-93b8-9e244b9b0520 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:20.966834 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a5f52e65-da9c-450c-93b8-9e244b9b0520 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] [instance: 7181fffe-8915-49c2-826a-0fa8040dc941] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:20.992462 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5f52e65-da9c-450c-93b8-9e244b9b0520 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:20.997085 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5f52e65-da9c-450c-93b8-9e244b9b0520 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:20.997085 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5f52e65-da9c-450c-93b8-9e244b9b0520 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:20.998548 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5f52e65-da9c-450c-93b8-9e244b9b0520 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:21.000148 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5f52e65-da9c-450c-93b8-9e244b9b0520 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:21.003352 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5f52e65-da9c-450c-93b8-9e244b9b0520 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:21.079904 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5f52e65-da9c-450c-93b8-9e244b9b0520 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:21.080477 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5f52e65-da9c-450c-93b8-9e244b9b0520 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:21.081960 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5f52e65-da9c-450c-93b8-9e244b9b0520 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:21.083069 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-a5f52e65-da9c-450c-93b8-9e244b9b0520 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lazy-loading 'fault' on Instance uuid 7181fffe-8915-49c2-826a-0fa8040dc941 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:33:21.241006 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a5f52e65-da9c-450c-93b8-9e244b9b0520 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3d3c6a02244888eebb6e70eaac4ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b051b0da0ab45ffa64c7b8b32465a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:21.258619 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a5f52e65-da9c-450c-93b8-9e244b9b0520 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] 10.222.0.42 "GET /compute/v2.1/servers/7181fffe-8915-49c2-826a-0fa8040dc941" status: 200 len: 1359 microversion: 2.1 time: 0.302136 Oct 23 01:33:21.260796 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2548/5014] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:20 2022] GET /compute/v2.1/servers/7181fffe-8915-49c2-826a-0fa8040dc941 => generated 1359 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:21.266594 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fc60c15c-7fd2-447e-b91c-d4fdc51748c8 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:21.267944 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fc60c15c-7fd2-447e-b91c-d4fdc51748c8 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: e3bb9493-45f6-4889-8655-222a1284b4bf] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:21.281191 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fc60c15c-7fd2-447e-b91c-d4fdc51748c8 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:21.282101 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fc60c15c-7fd2-447e-b91c-d4fdc51748c8 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:21.284802 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fc60c15c-7fd2-447e-b91c-d4fdc51748c8 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:21.284802 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fc60c15c-7fd2-447e-b91c-d4fdc51748c8 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:21.284802 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fc60c15c-7fd2-447e-b91c-d4fdc51748c8 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:21.285581 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fc60c15c-7fd2-447e-b91c-d4fdc51748c8 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:21.405897 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8a4d130d-8827-45cc-8df5-1d19ad53394a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:21.434367 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8a4d130d-8827-45cc-8df5-1d19ad53394a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef" status: 200 len: 1309 microversion: 2.1 time: 0.900646 Oct 23 01:33:21.435769 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2467/5015] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:20 2022] GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef => generated 1309 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:21.873075 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4d37fd0b-1bac-4e7a-a2ef-7d7717b02f79 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:21.891152 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4d37fd0b-1bac-4e7a-a2ef-7d7717b02f79 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:21.906007 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4d37fd0b-1bac-4e7a-a2ef-7d7717b02f79 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:21.908666 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4d37fd0b-1bac-4e7a-a2ef-7d7717b02f79 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:21.909883 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4d37fd0b-1bac-4e7a-a2ef-7d7717b02f79 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:21.923147 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4d37fd0b-1bac-4e7a-a2ef-7d7717b02f79 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:21.925357 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4d37fd0b-1bac-4e7a-a2ef-7d7717b02f79 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:21.925357 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4d37fd0b-1bac-4e7a-a2ef-7d7717b02f79 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:22.017747 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fc60c15c-7fd2-447e-b91c-d4fdc51748c8 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:22.034361 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fc60c15c-7fd2-447e-b91c-d4fdc51748c8 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/e3bb9493-45f6-4889-8655-222a1284b4bf" status: 200 len: 1315 microversion: 2.1 time: 0.772055 Oct 23 01:33:22.035634 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2549/5016] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:21 2022] GET /compute/v2.1/servers/e3bb9493-45f6-4889-8655-222a1284b4bf => generated 1315 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:22.053060 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f7f486d9-733d-4b12-b3c1-7d3d448d5805 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:22.056051 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f7f486d9-733d-4b12-b3c1-7d3d448d5805 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: e96f5e79-d832-4927-aef1-a45a815404b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:22.073107 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f7f486d9-733d-4b12-b3c1-7d3d448d5805 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:22.075272 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f7f486d9-733d-4b12-b3c1-7d3d448d5805 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:22.076410 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f7f486d9-733d-4b12-b3c1-7d3d448d5805 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:22.077527 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f7f486d9-733d-4b12-b3c1-7d3d448d5805 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:22.080228 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f7f486d9-733d-4b12-b3c1-7d3d448d5805 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:22.084298 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f7f486d9-733d-4b12-b3c1-7d3d448d5805 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:22.091255 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4d37fd0b-1bac-4e7a-a2ef-7d7717b02f79 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.223604 Oct 23 01:33:22.095032 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2468/5017] 10.222.0.42 () {60 vars in 1343 bytes} [Sun Oct 23 01:33:21 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a/os-volume_attachments => generated 25 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:33:22.141461 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f7f486d9-733d-4b12-b3c1-7d3d448d5805 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.103704 Oct 23 01:33:22.142589 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2550/5018] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:33:22 2022] GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0/os-volume_attachments => generated 25 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:33:22.232295 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e8b0676e-81af-4651-a5f6-afdbf08e5aa7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:22.233435 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e8b0676e-81af-4651-a5f6-afdbf08e5aa7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:22.241620 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8b0676e-81af-4651-a5f6-afdbf08e5aa7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:22.243237 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8b0676e-81af-4651-a5f6-afdbf08e5aa7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:22.243879 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8b0676e-81af-4651-a5f6-afdbf08e5aa7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:22.246810 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8b0676e-81af-4651-a5f6-afdbf08e5aa7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:22.247570 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8b0676e-81af-4651-a5f6-afdbf08e5aa7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:22.248425 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8b0676e-81af-4651-a5f6-afdbf08e5aa7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:22.285013 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-06c3f43a-9ce2-486e-bceb-d850298dd7e1 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:22.286936 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-06c3f43a-9ce2-486e-bceb-d850298dd7e1 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] [instance: 7181fffe-8915-49c2-826a-0fa8040dc941] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:22.314708 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e8b0676e-81af-4651-a5f6-afdbf08e5aa7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:33:22.315974 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-06c3f43a-9ce2-486e-bceb-d850298dd7e1 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:22.319771 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-06c3f43a-9ce2-486e-bceb-d850298dd7e1 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:22.323037 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-06c3f43a-9ce2-486e-bceb-d850298dd7e1 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:22.323459 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-06c3f43a-9ce2-486e-bceb-d850298dd7e1 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:22.325319 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-06c3f43a-9ce2-486e-bceb-d850298dd7e1 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:22.328453 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-06c3f43a-9ce2-486e-bceb-d850298dd7e1 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:22.375133 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-06c3f43a-9ce2-486e-bceb-d850298dd7e1 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] HTTP exception thrown: Instance 7181fffe-8915-49c2-826a-0fa8040dc941 could not be found. Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-06c3f43a-9ce2-486e-bceb-d850298dd7e1 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Request method failure captured: Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/7181fffe-8915-49c2-826a-0fa8040dc941 HTTP/1.1 Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJmLma5h8miKS0WfUGKOCX_yHa9RmJOwcM2Y84ypePety88Gq_Kicz-c8TarEHTJA7YfznMAfVKPqVV4I9_Vrvrc0qYMW1VOJxENPbsuvXm4OJ0iYJT4htAXdqZdOaG2Wmcyv3pLZ9kbSe7Wqc51JZP5N1Jiy0dEudbwNnsCf1y_cyM Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 3b051b0da0ab45ffa64c7b8b32465a20 Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersTestJSON-1933465501 Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3b051b0da0ab45ffa64c7b8b32465a20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3b051b0da0ab45ffa64c7b8b32465a20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3b051b0da0ab45ffa64c7b8b32465a20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3b051b0da0ab45ffa64c7b8b32465a20"}]}] Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersTestJSON-1933465501 Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 3b051b0da0ab45ffa64c7b8b32465a20 Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersTestJSON-1933465501 Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersTestJSON-1933465501-project Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 96d3d3c6a02244888eebb6e70eaac4ee Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersTestJSON-1933465501-project Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 7181fffe-8915-49c2-826a-0fa8040dc941 could not be found. Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '7181fffe-8915-49c2-826a-0fa8040dc941'} Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7181fffe-8915-49c2-826a-0fa8040dc941 could not be found. Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7181fffe-8915-49c2-826a-0fa8040dc941 could not be found. Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:33:22.388707 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:33:22.393183 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:33:22.393183 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:33:22.393183 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:33:22.393183 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:33:22.393183 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:33:22.393183 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7181fffe-8915-49c2-826a-0fa8040dc941 could not be found. Oct 23 01:33:22.393183 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:33:22.395036 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-06c3f43a-9ce2-486e-bceb-d850298dd7e1 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Returning 404 to user: Instance 7181fffe-8915-49c2-826a-0fa8040dc941 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:33:22.396112 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-06c3f43a-9ce2-486e-bceb-d850298dd7e1 tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] 10.222.0.42 "GET /compute/v2.1/servers/7181fffe-8915-49c2-826a-0fa8040dc941" status: 404 len: 111 microversion: 2.1 time: 0.117339 Oct 23 01:33:22.396881 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2551/5019] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:22 2022] GET /compute/v2.1/servers/7181fffe-8915-49c2-826a-0fa8040dc941 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:33:22.409352 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a3930e3e-127b-4417-add1-e3e119cdbd79 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:22.410244 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a3930e3e-127b-4417-add1-e3e119cdbd79 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: e96f5e79-d832-4927-aef1-a45a815404b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:22.421487 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a3930e3e-127b-4417-add1-e3e119cdbd79 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:22.432314 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a3930e3e-127b-4417-add1-e3e119cdbd79 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:22.432314 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a3930e3e-127b-4417-add1-e3e119cdbd79 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:22.432314 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a3930e3e-127b-4417-add1-e3e119cdbd79 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:22.432314 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a3930e3e-127b-4417-add1-e3e119cdbd79 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:22.434068 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a3930e3e-127b-4417-add1-e3e119cdbd79 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:22.511264 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a3930e3e-127b-4417-add1-e3e119cdbd79 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: e96f5e79-d832-4927-aef1-a45a815404b0] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:33:23.080758 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e8b0676e-81af-4651-a5f6-afdbf08e5aa7 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 204 len: 0 microversion: 2.20 time: 0.852946 Oct 23 01:33:23.081760 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2469/5020] 10.222.0.42 () {60 vars in 1280 bytes} [Sun Oct 23 01:33:22 2022] DELETE /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 0 bytes in 856 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 23 01:33:23.088396 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-06fb3acb-ef38-4fbd-9c1d-aae4486363ca tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] Calling method '.version_select at 0x7f5cc17a1dc0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:23.205414 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-06fb3acb-ef38-4fbd-9c1d-aae4486363ca tempest-ServersTestJSON-1933465501 tempest-ServersTestJSON-1933465501-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-994693373" status: 202 len: 0 microversion: 2.1 time: 0.118837 Oct 23 01:33:23.214125 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2470/5021] 10.222.0.42 () {58 vars in 1218 bytes} [Sun Oct 23 01:33:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-994693373 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:33:23.228716 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-898bd620-277f-4248-9fb0-35a2d23f6e57 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:23.229480 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-898bd620-277f-4248-9fb0-35a2d23f6e57 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 7878a5d1-1349-4cb6-abd1-519f61b97eef] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:23.248564 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-898bd620-277f-4248-9fb0-35a2d23f6e57 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:23.252076 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-898bd620-277f-4248-9fb0-35a2d23f6e57 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:23.252540 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-898bd620-277f-4248-9fb0-35a2d23f6e57 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:23.256086 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-898bd620-277f-4248-9fb0-35a2d23f6e57 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:23.256569 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-898bd620-277f-4248-9fb0-35a2d23f6e57 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:23.259137 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-898bd620-277f-4248-9fb0-35a2d23f6e57 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:23.281992 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a3930e3e-127b-4417-add1-e3e119cdbd79 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0" status: 204 len: 0 microversion: 2.1 time: 0.883512 Oct 23 01:33:23.282657 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2552/5022] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:33:22 2022] DELETE /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0 => generated 0 bytes in 885 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:33:23.302298 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-654b545e-e5f0-47a6-b477-989cd87a68aa tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:23.312781 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-654b545e-e5f0-47a6-b477-989cd87a68aa tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: e3bb9493-45f6-4889-8655-222a1284b4bf] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:23.330013 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=4 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:33:23.333124 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-654b545e-e5f0-47a6-b477-989cd87a68aa tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:23.336642 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-654b545e-e5f0-47a6-b477-989cd87a68aa tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:23.337101 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-654b545e-e5f0-47a6-b477-989cd87a68aa tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:23.339325 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-654b545e-e5f0-47a6-b477-989cd87a68aa tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:23.339809 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-654b545e-e5f0-47a6-b477-989cd87a68aa tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:23.340253 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-654b545e-e5f0-47a6-b477-989cd87a68aa tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:23.761734 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-654b545e-e5f0-47a6-b477-989cd87a68aa tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:23.784032 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-654b545e-e5f0-47a6-b477-989cd87a68aa tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/e3bb9493-45f6-4889-8655-222a1284b4bf" status: 200 len: 1315 microversion: 2.1 time: 0.489736 Oct 23 01:33:23.785026 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2553/5023] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:23 2022] GET /compute/v2.1/servers/e3bb9493-45f6-4889-8655-222a1284b4bf => generated 1315 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:23.797510 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-898bd620-277f-4248-9fb0-35a2d23f6e57 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:23.798087 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9f81a3ee-e238-47a4-a88d-fe318bc023ee tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:23.805033 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9f81a3ee-e238-47a4-a88d-fe318bc023ee tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:23.809105 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-898bd620-277f-4248-9fb0-35a2d23f6e57 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef" status: 200 len: 1309 microversion: 2.1 time: 0.593800 Oct 23 01:33:23.814064 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f81a3ee-e238-47a4-a88d-fe318bc023ee tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:23.814305 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2471/5024] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:23 2022] GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef => generated 1309 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:23.816772 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f81a3ee-e238-47a4-a88d-fe318bc023ee tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:23.817471 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f81a3ee-e238-47a4-a88d-fe318bc023ee tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:23.819058 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f81a3ee-e238-47a4-a88d-fe318bc023ee tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:23.822544 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f81a3ee-e238-47a4-a88d-fe318bc023ee tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:23.823221 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f81a3ee-e238-47a4-a88d-fe318bc023ee tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:23.839270 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-57053c01-240d-43bb-bcb4-ee29313606aa tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:23.839948 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-57053c01-240d-43bb-bcb4-ee29313606aa tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: e96f5e79-d832-4927-aef1-a45a815404b0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:23.885590 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-57053c01-240d-43bb-bcb4-ee29313606aa tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:23.887455 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-57053c01-240d-43bb-bcb4-ee29313606aa tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:23.887976 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-57053c01-240d-43bb-bcb4-ee29313606aa tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:23.899739 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-57053c01-240d-43bb-bcb4-ee29313606aa tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:23.901379 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-57053c01-240d-43bb-bcb4-ee29313606aa tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:23.903022 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-57053c01-240d-43bb-bcb4-ee29313606aa tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:24.389146 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9f81a3ee-e238-47a4-a88d-fe318bc023ee tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:24.391637 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-57053c01-240d-43bb-bcb4-ee29313606aa tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:24.405892 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-57053c01-240d-43bb-bcb4-ee29313606aa tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0" status: 200 len: 1681 microversion: 2.1 time: 0.590293 Oct 23 01:33:24.407209 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2472/5025] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:23 2022] GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0 => generated 1681 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:24.409726 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9f81a3ee-e238-47a4-a88d-fe318bc023ee tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:24.415781 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9f81a3ee-e238-47a4-a88d-fe318bc023ee tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:24.416160 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-124ba38f-75db-4ee6-8352-05a6f64847f9 req-6ba88b41-278c-4ee7-a4c2-4dfdbf24fece service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7878a5d1-1349-4cb6-abd1-519f61b97eef", "tag": "1a7030fd-87ce-41ea-ab45-62f0f99f4568"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:33:24.418851 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9f81a3ee-e238-47a4-a88d-fe318bc023ee tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1722 microversion: 2.20 time: 0.632602 Oct 23 01:33:24.422054 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2554/5026] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:33:23 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1722 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:33:24.445568 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-124ba38f-75db-4ee6-8352-05a6f64847f9 req-6ba88b41-278c-4ee7-a4c2-4dfdbf24fece service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:24.446119 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-124ba38f-75db-4ee6-8352-05a6f64847f9 req-6ba88b41-278c-4ee7-a4c2-4dfdbf24fece service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:24.446554 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-124ba38f-75db-4ee6-8352-05a6f64847f9 req-6ba88b41-278c-4ee7-a4c2-4dfdbf24fece service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:24.460970 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-124ba38f-75db-4ee6-8352-05a6f64847f9 req-6ba88b41-278c-4ee7-a4c2-4dfdbf24fece service nova] Creating event network-changed:1a7030fd-87ce-41ea-ab45-62f0f99f4568 for instance 7878a5d1-1349-4cb6-abd1-519f61b97eef on n-h2-master-1 Oct 23 01:33:24.463991 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-124ba38f-75db-4ee6-8352-05a6f64847f9 req-6ba88b41-278c-4ee7-a4c2-4dfdbf24fece service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055137 Oct 23 01:33:24.464800 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2473/5027] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:33:24.812136 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-edafcaa7-cfd8-4d21-9f44-53e45a71d419 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:24.812942 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-edafcaa7-cfd8-4d21-9f44-53e45a71d419 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: e3bb9493-45f6-4889-8655-222a1284b4bf] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:24.825074 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-edafcaa7-cfd8-4d21-9f44-53e45a71d419 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:24.825734 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-edafcaa7-cfd8-4d21-9f44-53e45a71d419 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:24.826492 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-edafcaa7-cfd8-4d21-9f44-53e45a71d419 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:24.827515 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-edafcaa7-cfd8-4d21-9f44-53e45a71d419 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:24.828042 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-edafcaa7-cfd8-4d21-9f44-53e45a71d419 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:24.828774 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-edafcaa7-cfd8-4d21-9f44-53e45a71d419 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:24.837945 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a634b80e-f0f3-4a2f-b7fa-603bd0df1544 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:24.838777 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a634b80e-f0f3-4a2f-b7fa-603bd0df1544 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 7878a5d1-1349-4cb6-abd1-519f61b97eef] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:24.845920 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a634b80e-f0f3-4a2f-b7fa-603bd0df1544 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:24.846580 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a634b80e-f0f3-4a2f-b7fa-603bd0df1544 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:24.847107 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a634b80e-f0f3-4a2f-b7fa-603bd0df1544 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:24.847941 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a634b80e-f0f3-4a2f-b7fa-603bd0df1544 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:24.848483 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a634b80e-f0f3-4a2f-b7fa-603bd0df1544 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:24.849742 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a634b80e-f0f3-4a2f-b7fa-603bd0df1544 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:25.089117 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a634b80e-f0f3-4a2f-b7fa-603bd0df1544 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:25.096800 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-edafcaa7-cfd8-4d21-9f44-53e45a71d419 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:25.106658 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a634b80e-f0f3-4a2f-b7fa-603bd0df1544 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef" status: 200 len: 1309 microversion: 2.1 time: 0.266540 Oct 23 01:33:25.119431 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2474/5028] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:24 2022] GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef => generated 1309 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:25.122240 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-edafcaa7-cfd8-4d21-9f44-53e45a71d419 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/e3bb9493-45f6-4889-8655-222a1284b4bf" status: 200 len: 1315 microversion: 2.1 time: 0.315592 Oct 23 01:33:25.123022 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2555/5029] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:24 2022] GET /compute/v2.1/servers/e3bb9493-45f6-4889-8655-222a1284b4bf => generated 1315 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:25.433192 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7fe2bb66-c890-42f4-9182-d1d969991c28 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:25.435107 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7fe2bb66-c890-42f4-9182-d1d969991c28 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: e96f5e79-d832-4927-aef1-a45a815404b0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:25.443160 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7fe2bb66-c890-42f4-9182-d1d969991c28 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:25.443160 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7fe2bb66-c890-42f4-9182-d1d969991c28 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:25.443735 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7fe2bb66-c890-42f4-9182-d1d969991c28 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:25.444718 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7fe2bb66-c890-42f4-9182-d1d969991c28 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:25.445612 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7fe2bb66-c890-42f4-9182-d1d969991c28 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:25.446261 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7fe2bb66-c890-42f4-9182-d1d969991c28 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:25.450808 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1bfea7b1-582f-437b-886a-794d4f75465a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:25.451430 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1bfea7b1-582f-437b-886a-794d4f75465a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:25.461567 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1bfea7b1-582f-437b-886a-794d4f75465a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:25.464589 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1bfea7b1-582f-437b-886a-794d4f75465a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:25.465608 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1bfea7b1-582f-437b-886a-794d4f75465a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:25.468888 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1bfea7b1-582f-437b-886a-794d4f75465a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:25.469392 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1bfea7b1-582f-437b-886a-794d4f75465a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:25.469844 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1bfea7b1-582f-437b-886a-794d4f75465a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:25.644846 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=6 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:33:25.833742 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7fe2bb66-c890-42f4-9182-d1d969991c28 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:25.845364 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7fe2bb66-c890-42f4-9182-d1d969991c28 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0" status: 200 len: 1681 microversion: 2.1 time: 0.417469 Oct 23 01:33:25.853092 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2475/5030] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:25 2022] GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0 => generated 1681 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:25.863774 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1bfea7b1-582f-437b-886a-794d4f75465a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:25.877742 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1bfea7b1-582f-437b-886a-794d4f75465a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:25.880171 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1bfea7b1-582f-437b-886a-794d4f75465a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:25.881385 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1bfea7b1-582f-437b-886a-794d4f75465a tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1722 microversion: 2.20 time: 0.434929 Oct 23 01:33:25.884925 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2556/5031] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:33:25 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1722 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:33:26.134466 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7f4253ba-60ce-4b22-a74c-823cb8617350 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:26.135087 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7f4253ba-60ce-4b22-a74c-823cb8617350 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 7878a5d1-1349-4cb6-abd1-519f61b97eef] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:26.148104 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f4253ba-60ce-4b22-a74c-823cb8617350 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:26.149359 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f4253ba-60ce-4b22-a74c-823cb8617350 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:26.149805 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f4253ba-60ce-4b22-a74c-823cb8617350 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:26.151677 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-19c5ab14-3256-4a22-bb4c-96605c347849 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:26.152556 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-19c5ab14-3256-4a22-bb4c-96605c347849 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: e3bb9493-45f6-4889-8655-222a1284b4bf] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:26.153261 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f4253ba-60ce-4b22-a74c-823cb8617350 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:26.155248 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f4253ba-60ce-4b22-a74c-823cb8617350 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:26.155859 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f4253ba-60ce-4b22-a74c-823cb8617350 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:26.166987 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-19c5ab14-3256-4a22-bb4c-96605c347849 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:26.175707 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-19c5ab14-3256-4a22-bb4c-96605c347849 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:26.175707 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-19c5ab14-3256-4a22-bb4c-96605c347849 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:26.175707 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-19c5ab14-3256-4a22-bb4c-96605c347849 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:26.175707 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-19c5ab14-3256-4a22-bb4c-96605c347849 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:26.175707 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-19c5ab14-3256-4a22-bb4c-96605c347849 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:26.190599 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=18 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:33:26.912836 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7f4253ba-60ce-4b22-a74c-823cb8617350 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:26.926509 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7f4253ba-60ce-4b22-a74c-823cb8617350 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef" status: 200 len: 1309 microversion: 2.1 time: 0.795417 Oct 23 01:33:26.928124 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2476/5032] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:26 2022] GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef => generated 1309 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:26.946851 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-19c5ab14-3256-4a22-bb4c-96605c347849 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:26.969144 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-19c5ab14-3256-4a22-bb4c-96605c347849 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/e3bb9493-45f6-4889-8655-222a1284b4bf" status: 200 len: 1315 microversion: 2.1 time: 0.819594 Oct 23 01:33:26.969670 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-84999631-8874-4265-a5c7-3bdc776f3671 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:26.984226 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2557/5033] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:26 2022] GET /compute/v2.1/servers/e3bb9493-45f6-4889-8655-222a1284b4bf => generated 1315 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:26.985176 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-84999631-8874-4265-a5c7-3bdc776f3671 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:27.004126 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-84999631-8874-4265-a5c7-3bdc776f3671 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:27.004126 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-84999631-8874-4265-a5c7-3bdc776f3671 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:27.004126 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-84999631-8874-4265-a5c7-3bdc776f3671 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:27.004126 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-84999631-8874-4265-a5c7-3bdc776f3671 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:27.004126 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-84999631-8874-4265-a5c7-3bdc776f3671 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:27.004126 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-84999631-8874-4265-a5c7-3bdc776f3671 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:27.027175 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-313087d3-6fd5-42d3-b64b-cff03b67c4a6 req-4dcad8c4-5cbf-475e-8517-c61cc68ef3e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3bb9493-45f6-4889-8655-222a1284b4bf", "tag": "92f0adc4-9d2b-4e74-9511-4e7cccff6235"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:33:27.047265 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-313087d3-6fd5-42d3-b64b-cff03b67c4a6 req-4dcad8c4-5cbf-475e-8517-c61cc68ef3e0 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:27.047976 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-313087d3-6fd5-42d3-b64b-cff03b67c4a6 req-4dcad8c4-5cbf-475e-8517-c61cc68ef3e0 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:27.048611 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-313087d3-6fd5-42d3-b64b-cff03b67c4a6 req-4dcad8c4-5cbf-475e-8517-c61cc68ef3e0 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:27.070781 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-313087d3-6fd5-42d3-b64b-cff03b67c4a6 req-4dcad8c4-5cbf-475e-8517-c61cc68ef3e0 service nova] Creating event network-changed:92f0adc4-9d2b-4e74-9511-4e7cccff6235 for instance e3bb9493-45f6-4889-8655-222a1284b4bf on n-h2-master-1 Oct 23 01:33:27.076199 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-313087d3-6fd5-42d3-b64b-cff03b67c4a6 req-4dcad8c4-5cbf-475e-8517-c61cc68ef3e0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090594 Oct 23 01:33:27.077098 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2558/5034] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:33:27.084823 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0eb601ee-1046-42f1-a9ce-94a3f771d531 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:27.085880 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0eb601ee-1046-42f1-a9ce-94a3f771d531 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: e96f5e79-d832-4927-aef1-a45a815404b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:27.092847 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0eb601ee-1046-42f1-a9ce-94a3f771d531 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:27.093660 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0eb601ee-1046-42f1-a9ce-94a3f771d531 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:27.094392 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0eb601ee-1046-42f1-a9ce-94a3f771d531 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:27.095280 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0eb601ee-1046-42f1-a9ce-94a3f771d531 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:27.095911 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0eb601ee-1046-42f1-a9ce-94a3f771d531 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:27.096509 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0eb601ee-1046-42f1-a9ce-94a3f771d531 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:27.244678 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0eb601ee-1046-42f1-a9ce-94a3f771d531 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:27.261051 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0eb601ee-1046-42f1-a9ce-94a3f771d531 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0" status: 200 len: 1613 microversion: 2.1 time: 0.181876 Oct 23 01:33:27.274288 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2559/5035] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:27 2022] GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0 => generated 1613 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:27.290281 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-56fa8bc8-1193-4cd3-b22a-6079015f8a4e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:27.290281 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-56fa8bc8-1193-4cd3-b22a-6079015f8a4e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:27.290281 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-56fa8bc8-1193-4cd3-b22a-6079015f8a4e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:27.290533 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-56fa8bc8-1193-4cd3-b22a-6079015f8a4e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:27.290854 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-56fa8bc8-1193-4cd3-b22a-6079015f8a4e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:27.291715 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-56fa8bc8-1193-4cd3-b22a-6079015f8a4e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:27.292294 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-56fa8bc8-1193-4cd3-b22a-6079015f8a4e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:27.292731 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-56fa8bc8-1193-4cd3-b22a-6079015f8a4e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:27.443455 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-56fa8bc8-1193-4cd3-b22a-6079015f8a4e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:27.447810 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=14 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:33:27.457168 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-56fa8bc8-1193-4cd3-b22a-6079015f8a4e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:27.460202 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-56fa8bc8-1193-4cd3-b22a-6079015f8a4e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:27.462120 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-56fa8bc8-1193-4cd3-b22a-6079015f8a4e tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1655 microversion: 2.20 time: 0.199360 Oct 23 01:33:27.473083 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2560/5036] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:33:27 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1655 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:33:27.502680 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-84999631-8874-4265-a5c7-3bdc776f3671 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:27.514627 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-84999631-8874-4265-a5c7-3bdc776f3671 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1669 microversion: 2.1 time: 0.585114 Oct 23 01:33:27.515473 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2477/5037] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:26 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1669 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:27.516362 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-047ad6e7-eb35-4751-b51a-7733f9f7a0cd req-7a284f79-a21a-4b68-8eb5-5332b0042372 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e96f5e79-d832-4927-aef1-a45a815404b0", "name": "network-vif-deleted", "tag": "31d7ea8a-db73-4a69-a6f8-466b312577b1"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:33:27.532087 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-047ad6e7-eb35-4751-b51a-7733f9f7a0cd req-7a284f79-a21a-4b68-8eb5-5332b0042372 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:27.532940 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-047ad6e7-eb35-4751-b51a-7733f9f7a0cd req-7a284f79-a21a-4b68-8eb5-5332b0042372 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:27.533583 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-047ad6e7-eb35-4751-b51a-7733f9f7a0cd req-7a284f79-a21a-4b68-8eb5-5332b0042372 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:27.543744 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5b3dbbc0-79e2-45a5-9934-08dc4b419fc7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1293479988"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:33:27.546551 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5b3dbbc0-79e2-45a5-9934-08dc4b419fc7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:27.550914 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-047ad6e7-eb35-4751-b51a-7733f9f7a0cd req-7a284f79-a21a-4b68-8eb5-5332b0042372 service nova] Creating event network-vif-deleted:31d7ea8a-db73-4a69-a6f8-466b312577b1 for instance e96f5e79-d832-4927-aef1-a45a815404b0 on n-h1-master-1 Oct 23 01:33:27.559063 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5b3dbbc0-79e2-45a5-9934-08dc4b419fc7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:27.559889 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5b3dbbc0-79e2-45a5-9934-08dc4b419fc7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:27.565412 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5b3dbbc0-79e2-45a5-9934-08dc4b419fc7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:27.565597 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-047ad6e7-eb35-4751-b51a-7733f9f7a0cd req-7a284f79-a21a-4b68-8eb5-5332b0042372 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062426 Oct 23 01:33:27.566451 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2561/5038] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:33:27.566907 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5b3dbbc0-79e2-45a5-9934-08dc4b419fc7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:27.567580 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5b3dbbc0-79e2-45a5-9934-08dc4b419fc7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:27.568407 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5b3dbbc0-79e2-45a5-9934-08dc4b419fc7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:27.953513 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0394e2dd-6f2f-4101-b8d5-644291d26c07 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:27.954308 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0394e2dd-6f2f-4101-b8d5-644291d26c07 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 7878a5d1-1349-4cb6-abd1-519f61b97eef] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:27.975297 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0394e2dd-6f2f-4101-b8d5-644291d26c07 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:27.978643 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0394e2dd-6f2f-4101-b8d5-644291d26c07 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:27.979251 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0394e2dd-6f2f-4101-b8d5-644291d26c07 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:27.980075 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0394e2dd-6f2f-4101-b8d5-644291d26c07 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:27.987152 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0394e2dd-6f2f-4101-b8d5-644291d26c07 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:27.990878 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0394e2dd-6f2f-4101-b8d5-644291d26c07 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:28.254612 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:33:28.326031 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0394e2dd-6f2f-4101-b8d5-644291d26c07 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:28.336584 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0394e2dd-6f2f-4101-b8d5-644291d26c07 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef" status: 200 len: 1309 microversion: 2.1 time: 0.387953 Oct 23 01:33:28.343347 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2562/5039] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:27 2022] GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef => generated 1309 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:28.348628 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-221a3c08-ae51-4813-964f-ba21fd3cd86a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:28.349909 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-221a3c08-ae51-4813-964f-ba21fd3cd86a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: e3bb9493-45f6-4889-8655-222a1284b4bf] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:28.365289 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-221a3c08-ae51-4813-964f-ba21fd3cd86a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:28.368751 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-221a3c08-ae51-4813-964f-ba21fd3cd86a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:28.380896 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-221a3c08-ae51-4813-964f-ba21fd3cd86a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:28.384448 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-221a3c08-ae51-4813-964f-ba21fd3cd86a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:28.385025 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-221a3c08-ae51-4813-964f-ba21fd3cd86a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:28.385559 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-221a3c08-ae51-4813-964f-ba21fd3cd86a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:28.392512 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:33:28.518826 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5b3dbbc0-79e2-45a5-9934-08dc4b419fc7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "POST /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98/action" status: 202 len: 0 microversion: 2.1 time: 0.982251 Oct 23 01:33:28.519584 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2478/5040] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:33:27 2022] POST /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98/action => generated 0 bytes in 984 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Oct 23 01:33:28.526832 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-05a071b6-edc8-4fe1-a1c2-1b7a784c599d tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:28.527762 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-05a071b6-edc8-4fe1-a1c2-1b7a784c599d tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: e96f5e79-d832-4927-aef1-a45a815404b0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:28.558828 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05a071b6-edc8-4fe1-a1c2-1b7a784c599d tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:28.560188 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05a071b6-edc8-4fe1-a1c2-1b7a784c599d tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:28.561243 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05a071b6-edc8-4fe1-a1c2-1b7a784c599d tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:28.562564 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05a071b6-edc8-4fe1-a1c2-1b7a784c599d tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:28.565866 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05a071b6-edc8-4fe1-a1c2-1b7a784c599d tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:28.567198 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05a071b6-edc8-4fe1-a1c2-1b7a784c599d tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:28.690881 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05a071b6-edc8-4fe1-a1c2-1b7a784c599d tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:28.690881 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05a071b6-edc8-4fe1-a1c2-1b7a784c599d tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:28.690881 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05a071b6-edc8-4fe1-a1c2-1b7a784c599d tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:28.690881 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-05a071b6-edc8-4fe1-a1c2-1b7a784c599d tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lazy-loading 'fault' on Instance uuid e96f5e79-d832-4927-aef1-a45a815404b0 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:33:28.963184 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-05a071b6-edc8-4fe1-a1c2-1b7a784c599d tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:28.980349 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-05a071b6-edc8-4fe1-a1c2-1b7a784c599d tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0" status: 200 len: 1330 microversion: 2.1 time: 0.458801 Oct 23 01:33:28.980692 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2479/5041] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:28 2022] GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0 => generated 1330 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:29.010840 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a342a2af-c4ec-4fd0-a6da-3da66df461e2 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:29.012303 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a342a2af-c4ec-4fd0-a6da-3da66df461e2 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:29.039280 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a342a2af-c4ec-4fd0-a6da-3da66df461e2 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:29.041050 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a342a2af-c4ec-4fd0-a6da-3da66df461e2 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:29.046150 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a342a2af-c4ec-4fd0-a6da-3da66df461e2 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:29.047264 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a342a2af-c4ec-4fd0-a6da-3da66df461e2 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:29.048887 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a342a2af-c4ec-4fd0-a6da-3da66df461e2 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:29.050964 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a342a2af-c4ec-4fd0-a6da-3da66df461e2 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:29.124228 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-221a3c08-ae51-4813-964f-ba21fd3cd86a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:29.131959 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-221a3c08-ae51-4813-964f-ba21fd3cd86a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/e3bb9493-45f6-4889-8655-222a1284b4bf" status: 200 len: 1315 microversion: 2.1 time: 0.785604 Oct 23 01:33:29.134161 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2563/5042] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:28 2022] GET /compute/v2.1/servers/e3bb9493-45f6-4889-8655-222a1284b4bf => generated 1315 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:29.169820 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d1870801-8f48-44ec-b266-dcf21380fa68 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:29.173594 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d1870801-8f48-44ec-b266-dcf21380fa68 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:29.177816 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a342a2af-c4ec-4fd0-a6da-3da66df461e2 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:29.183392 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a342a2af-c4ec-4fd0-a6da-3da66df461e2 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:29.183890 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a342a2af-c4ec-4fd0-a6da-3da66df461e2 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:29.184373 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-a342a2af-c4ec-4fd0-a6da-3da66df461e2 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lazy-loading 'fault' on Instance uuid b1d0765d-d720-40d2-b168-058e013fab0a {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:33:29.204525 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d1870801-8f48-44ec-b266-dcf21380fa68 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:29.205322 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d1870801-8f48-44ec-b266-dcf21380fa68 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:29.205986 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d1870801-8f48-44ec-b266-dcf21380fa68 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:29.207487 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d1870801-8f48-44ec-b266-dcf21380fa68 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:29.209479 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d1870801-8f48-44ec-b266-dcf21380fa68 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:29.210256 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d1870801-8f48-44ec-b266-dcf21380fa68 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:29.273454 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a342a2af-c4ec-4fd0-a6da-3da66df461e2 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:29.285750 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a342a2af-c4ec-4fd0-a6da-3da66df461e2 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:29.287274 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a342a2af-c4ec-4fd0-a6da-3da66df461e2 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1864708a7b2f4223bc8f0015c765eb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464938aec13451f910daa714d060e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:29.295034 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a342a2af-c4ec-4fd0-a6da-3da66df461e2 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 200 len: 1371 microversion: 2.20 time: 0.298543 Oct 23 01:33:29.298723 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2480/5043] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:33:28 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 1371 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:33:29.332444 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-dfda1196-0da5-4b37-9ba8-9ca8ab25ef45 req-0d480169-a203-4a7a-a759-0d09f6745806 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1d0765d-d720-40d2-b168-058e013fab0a", "name": "network-vif-deleted", "tag": "9d275317-d5ad-4bae-8215-25b674a45c60"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:33:29.376814 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-dfda1196-0da5-4b37-9ba8-9ca8ab25ef45 req-0d480169-a203-4a7a-a759-0d09f6745806 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:29.379256 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-dfda1196-0da5-4b37-9ba8-9ca8ab25ef45 req-0d480169-a203-4a7a-a759-0d09f6745806 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:29.379586 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-dfda1196-0da5-4b37-9ba8-9ca8ab25ef45 req-0d480169-a203-4a7a-a759-0d09f6745806 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:29.431818 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-dfda1196-0da5-4b37-9ba8-9ca8ab25ef45 req-0d480169-a203-4a7a-a759-0d09f6745806 service nova] Creating event network-vif-deleted:9d275317-d5ad-4bae-8215-25b674a45c60 for instance b1d0765d-d720-40d2-b168-058e013fab0a on n-h2-master-1 Oct 23 01:33:29.439251 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-dfda1196-0da5-4b37-9ba8-9ca8ab25ef45 req-0d480169-a203-4a7a-a759-0d09f6745806 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138997 Oct 23 01:33:29.446569 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2481/5044] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:33:29.466559 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8d57b702-3f49-4306-b0be-a54ad7c6263b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:29.471233 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8d57b702-3f49-4306-b0be-a54ad7c6263b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 7878a5d1-1349-4cb6-abd1-519f61b97eef] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:29.491784 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d57b702-3f49-4306-b0be-a54ad7c6263b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:29.492396 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d57b702-3f49-4306-b0be-a54ad7c6263b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:29.492937 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d57b702-3f49-4306-b0be-a54ad7c6263b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:29.494327 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d57b702-3f49-4306-b0be-a54ad7c6263b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:29.495958 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d57b702-3f49-4306-b0be-a54ad7c6263b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:29.496595 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d57b702-3f49-4306-b0be-a54ad7c6263b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:29.657617 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d1870801-8f48-44ec-b266-dcf21380fa68 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:29.674811 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d1870801-8f48-44ec-b266-dcf21380fa68 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1679 microversion: 2.1 time: 0.523167 Oct 23 01:33:29.675687 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2564/5045] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:29 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1679 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:29.844885 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8d57b702-3f49-4306-b0be-a54ad7c6263b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:29.857052 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8d57b702-3f49-4306-b0be-a54ad7c6263b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef" status: 200 len: 1309 microversion: 2.1 time: 0.408883 Oct 23 01:33:29.871899 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2482/5046] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:29 2022] GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef => generated 1309 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:30.011045 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0c0b597b-c83c-4588-85bd-b33688e7e56a tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:30.012289 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0c0b597b-c83c-4588-85bd-b33688e7e56a tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: e96f5e79-d832-4927-aef1-a45a815404b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:30.019342 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:33:30.022843 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0c0b597b-c83c-4588-85bd-b33688e7e56a tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:30.026090 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0c0b597b-c83c-4588-85bd-b33688e7e56a tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:30.028046 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0c0b597b-c83c-4588-85bd-b33688e7e56a tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:30.029573 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0c0b597b-c83c-4588-85bd-b33688e7e56a tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:30.030521 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0c0b597b-c83c-4588-85bd-b33688e7e56a tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:30.031209 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0c0b597b-c83c-4588-85bd-b33688e7e56a tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:30.055754 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-0c0b597b-c83c-4588-85bd-b33688e7e56a tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] HTTP exception thrown: Instance e96f5e79-d832-4927-aef1-a45a815404b0 could not be found. Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0c0b597b-c83c-4588-85bd-b33688e7e56a tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Request method failure captured: Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0 HTTP/1.1 Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJkvYHBhNP-ngrp3-t9b3JEvPymaCLxveQy3RHlcnEhTQOwrgKm_FYFqgl1O3oBP9pMRjY52nNZb_Q0xi9HfDiuiJB7SCfmksRniHRxHyItsbztYyPUcQD1NZfU4JeOPY635AaAApWVr1Jjx20AyHyGm3ekhiRFvnH_BMldZWZd5QMc Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 6edb27d1224244809ecbb55ac953c645 Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-AttachVolumeNegativeTest-742145495 Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6edb27d1224244809ecbb55ac953c645"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6edb27d1224244809ecbb55ac953c645"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6edb27d1224244809ecbb55ac953c645"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6edb27d1224244809ecbb55ac953c645"}]}] Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-AttachVolumeNegativeTest-742145495 Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 6edb27d1224244809ecbb55ac953c645 Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-742145495 Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-AttachVolumeNegativeTest-742145495-project Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 0c65e7ab0b544d9ebdac8bc2129d051a Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-AttachVolumeNegativeTest-742145495-project Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: exception: Instance e96f5e79-d832-4927-aef1-a45a815404b0 could not be found. Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'e96f5e79-d832-4927-aef1-a45a815404b0'} Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e96f5e79-d832-4927-aef1-a45a815404b0 could not be found. Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e96f5e79-d832-4927-aef1-a45a815404b0 could not be found. Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:33:30.058107 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:33:30.064644 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:33:30.064644 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:33:30.064644 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:33:30.064644 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:33:30.064644 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:33:30.064644 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e96f5e79-d832-4927-aef1-a45a815404b0 could not be found. Oct 23 01:33:30.064644 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:33:30.072547 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0c0b597b-c83c-4588-85bd-b33688e7e56a tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Returning 404 to user: Instance e96f5e79-d832-4927-aef1-a45a815404b0 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:33:30.075394 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0c0b597b-c83c-4588-85bd-b33688e7e56a tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0" status: 404 len: 111 microversion: 2.1 time: 0.072601 Oct 23 01:33:30.078909 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2565/5047] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:30 2022] GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:33:30.088260 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-97c476e6-f39e-499a-98ec-f7589d23e813 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '.version_select at 0x7f5cc148c4c0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:30.163849 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d97299aa-bb64-483c-921a-e0f5de917b72 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:30.165252 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d97299aa-bb64-483c-921a-e0f5de917b72 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: e3bb9493-45f6-4889-8655-222a1284b4bf] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:30.172059 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d97299aa-bb64-483c-921a-e0f5de917b72 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:30.173109 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d97299aa-bb64-483c-921a-e0f5de917b72 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:30.173813 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d97299aa-bb64-483c-921a-e0f5de917b72 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:30.174819 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d97299aa-bb64-483c-921a-e0f5de917b72 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:30.175771 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d97299aa-bb64-483c-921a-e0f5de917b72 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:30.176435 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d97299aa-bb64-483c-921a-e0f5de917b72 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:30.212142 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-97c476e6-f39e-499a-98ec-f7589d23e813 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-223195307" status: 202 len: 0 microversion: 2.1 time: 0.128920 Oct 23 01:33:30.215286 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2483/5048] 10.222.0.42 () {58 vars in 1218 bytes} [Sun Oct 23 01:33:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-223195307 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:33:30.332773 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c316f539-64ba-4f9d-beb8-28e591f9b119 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:30.333399 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c316f539-64ba-4f9d-beb8-28e591f9b119 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:30.349478 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c316f539-64ba-4f9d-beb8-28e591f9b119 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:30.350023 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c316f539-64ba-4f9d-beb8-28e591f9b119 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:30.350455 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c316f539-64ba-4f9d-beb8-28e591f9b119 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:30.351943 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c316f539-64ba-4f9d-beb8-28e591f9b119 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:30.352740 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c316f539-64ba-4f9d-beb8-28e591f9b119 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:30.353354 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c316f539-64ba-4f9d-beb8-28e591f9b119 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:30.388927 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-c316f539-64ba-4f9d-beb8-28e591f9b119 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] HTTP exception thrown: Instance b1d0765d-d720-40d2-b168-058e013fab0a could not be found. Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c316f539-64ba-4f9d-beb8-28e591f9b119 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Request method failure captured: Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a HTTP/1.1 Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJgQM9ac_nigtGLK4LZKApOXoIiTORToGrfCQJAudkDegQhaUBSbLk4jPFxqWvc7WPMryaamEsgoumiKRsUdXg4p2qo9wiVzLKc_z19LEKedgAH8Ey2iIcc4F8p1F8DcpTrJ2hLsEbdK9ktQp2Y5kAAr_EcoR2XwA8yLtIahEXP4IdE Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: X-Openstack-Nova-Api-Version: 2.20 Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 4464938aec13451f910daa714d060e46 Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-517248460 Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4464938aec13451f910daa714d060e46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4464938aec13451f910daa714d060e46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4464938aec13451f910daa714d060e46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4464938aec13451f910daa714d060e46"}]}] Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-AttachVolumeShelveTestJSON-517248460 Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 4464938aec13451f910daa714d060e46 Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-517248460 Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-AttachVolumeShelveTestJSON-517248460-project Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 1864708a7b2f4223bc8f0015c765eb0f Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-AttachVolumeShelveTestJSON-517248460-project Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: exception: Instance b1d0765d-d720-40d2-b168-058e013fab0a could not be found. Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'b1d0765d-d720-40d2-b168-058e013fab0a'} Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1d0765d-d720-40d2-b168-058e013fab0a could not be found. Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1d0765d-d720-40d2-b168-058e013fab0a could not be found. Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:33:30.395351 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:33:30.399612 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:33:30.399612 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:33:30.399612 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:33:30.399612 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:33:30.399612 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:33:30.399612 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:33:30.399612 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1d0765d-d720-40d2-b168-058e013fab0a could not be found. Oct 23 01:33:30.399612 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:33:30.403272 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c316f539-64ba-4f9d-beb8-28e591f9b119 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Returning 404 to user: Instance b1d0765d-d720-40d2-b168-058e013fab0a could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:33:30.413898 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c316f539-64ba-4f9d-beb8-28e591f9b119 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 404 len: 111 microversion: 2.20 time: 0.075479 Oct 23 01:33:30.413898 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2484/5049] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:33:30 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 23 01:33:30.417802 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ace646ef-09d0-48c8-a408-d440e9f8a890 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '.version_select at 0x7f5cc173f160>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:30.595607 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ace646ef-09d0-48c8-a408-d440e9f8a890 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1020806747" status: 204 len: 0 microversion: 2.20 time: 0.184543 Oct 23 01:33:30.597031 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2485/5050] 10.222.0.42 () {60 vars in 1262 bytes} [Sun Oct 23 01:33:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1020806747 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 23 01:33:30.611254 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-5a171736-8c6b-4895-93a3-37813ff78845 req-6d8d30e0-f601-43a5-aa1e-c2398f2baeee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa616812-f379-45fb-8e7e-fefe7570dc98", "name": "network-vif-unplugged", "status": "completed", "tag": "6de1369a-94d0-42a0-a57f-9deacb90b66f"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:33:30.645171 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-5a171736-8c6b-4895-93a3-37813ff78845 req-6d8d30e0-f601-43a5-aa1e-c2398f2baeee service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:30.646011 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-5a171736-8c6b-4895-93a3-37813ff78845 req-6d8d30e0-f601-43a5-aa1e-c2398f2baeee service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:30.649030 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-5a171736-8c6b-4895-93a3-37813ff78845 req-6d8d30e0-f601-43a5-aa1e-c2398f2baeee service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:30.682910 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-5a171736-8c6b-4895-93a3-37813ff78845 req-6d8d30e0-f601-43a5-aa1e-c2398f2baeee service nova] Creating event network-vif-unplugged:6de1369a-94d0-42a0-a57f-9deacb90b66f for instance fa616812-f379-45fb-8e7e-fefe7570dc98 on n-h1-master-1 Oct 23 01:33:30.693213 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-5a171736-8c6b-4895-93a3-37813ff78845 req-6d8d30e0-f601-43a5-aa1e-c2398f2baeee service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089866 Oct 23 01:33:30.694068 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2486/5051] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:33:30.707854 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bf4447e7-9f34-4158-b2b3-9bc00e915f4a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:30.711466 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-bf4447e7-9f34-4158-b2b3-9bc00e915f4a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:30.719111 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bf4447e7-9f34-4158-b2b3-9bc00e915f4a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:30.720502 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bf4447e7-9f34-4158-b2b3-9bc00e915f4a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:30.721165 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bf4447e7-9f34-4158-b2b3-9bc00e915f4a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:30.722103 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bf4447e7-9f34-4158-b2b3-9bc00e915f4a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:30.723753 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bf4447e7-9f34-4158-b2b3-9bc00e915f4a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:30.724553 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bf4447e7-9f34-4158-b2b3-9bc00e915f4a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:30.892098 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d97299aa-bb64-483c-921a-e0f5de917b72 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:30.900527 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d97299aa-bb64-483c-921a-e0f5de917b72 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/e3bb9493-45f6-4889-8655-222a1284b4bf" status: 200 len: 1315 microversion: 2.1 time: 0.742340 Oct 23 01:33:30.901112 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2566/5052] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:30 2022] GET /compute/v2.1/servers/e3bb9493-45f6-4889-8655-222a1284b4bf => generated 1315 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:33:30.922235 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0c1d0826-b7cd-40e8-9be0-0dcca590a6c7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:30.922958 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0c1d0826-b7cd-40e8-9be0-0dcca590a6c7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 7878a5d1-1349-4cb6-abd1-519f61b97eef] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:30.929646 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0c1d0826-b7cd-40e8-9be0-0dcca590a6c7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:30.930178 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0c1d0826-b7cd-40e8-9be0-0dcca590a6c7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:30.930829 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0c1d0826-b7cd-40e8-9be0-0dcca590a6c7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:30.932276 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0c1d0826-b7cd-40e8-9be0-0dcca590a6c7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:30.932912 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0c1d0826-b7cd-40e8-9be0-0dcca590a6c7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:30.933528 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0c1d0826-b7cd-40e8-9be0-0dcca590a6c7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:31.287629 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bf4447e7-9f34-4158-b2b3-9bc00e915f4a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:31.298944 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bf4447e7-9f34-4158-b2b3-9bc00e915f4a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1687 microversion: 2.1 time: 0.598275 Oct 23 01:33:31.312479 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2487/5053] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:30 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1687 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:31.454488 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0c1d0826-b7cd-40e8-9be0-0dcca590a6c7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:31.465223 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0c1d0826-b7cd-40e8-9be0-0dcca590a6c7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef" status: 200 len: 1309 microversion: 2.1 time: 0.553659 Oct 23 01:33:31.465830 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2567/5054] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:30 2022] GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef => generated 1309 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:31.925922 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d6e3cf17-94e8-49bf-9cc0-e8c4e7b050e6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:31.926611 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d6e3cf17-94e8-49bf-9cc0-e8c4e7b050e6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: e3bb9493-45f6-4889-8655-222a1284b4bf] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:31.936982 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d6e3cf17-94e8-49bf-9cc0-e8c4e7b050e6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:31.938587 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d6e3cf17-94e8-49bf-9cc0-e8c4e7b050e6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:31.939294 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d6e3cf17-94e8-49bf-9cc0-e8c4e7b050e6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:31.940356 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d6e3cf17-94e8-49bf-9cc0-e8c4e7b050e6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:31.944085 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d6e3cf17-94e8-49bf-9cc0-e8c4e7b050e6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:31.944944 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d6e3cf17-94e8-49bf-9cc0-e8c4e7b050e6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:32.328815 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d2e23beb-d80a-4684-b83f-710a8196a6d9 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:32.330593 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d2e23beb-d80a-4684-b83f-710a8196a6d9 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:32.343058 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d2e23beb-d80a-4684-b83f-710a8196a6d9 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:32.343574 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d2e23beb-d80a-4684-b83f-710a8196a6d9 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:32.344025 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d2e23beb-d80a-4684-b83f-710a8196a6d9 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:32.344753 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d2e23beb-d80a-4684-b83f-710a8196a6d9 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:32.345221 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d2e23beb-d80a-4684-b83f-710a8196a6d9 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:32.345651 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d2e23beb-d80a-4684-b83f-710a8196a6d9 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:32.640295 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d6e3cf17-94e8-49bf-9cc0-e8c4e7b050e6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:32.653169 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d6e3cf17-94e8-49bf-9cc0-e8c4e7b050e6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/e3bb9493-45f6-4889-8655-222a1284b4bf" status: 200 len: 1315 microversion: 2.1 time: 0.731716 Oct 23 01:33:32.655452 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2488/5055] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:31 2022] GET /compute/v2.1/servers/e3bb9493-45f6-4889-8655-222a1284b4bf => generated 1315 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:32.662623 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-47ef1afe-e1a5-4591-9425-59123c960a73 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:32.664291 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-47ef1afe-e1a5-4591-9425-59123c960a73 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 7878a5d1-1349-4cb6-abd1-519f61b97eef] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:32.671561 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-47ef1afe-e1a5-4591-9425-59123c960a73 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:32.672529 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-47ef1afe-e1a5-4591-9425-59123c960a73 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:32.673481 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-47ef1afe-e1a5-4591-9425-59123c960a73 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:32.674578 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-47ef1afe-e1a5-4591-9425-59123c960a73 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:32.675256 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-47ef1afe-e1a5-4591-9425-59123c960a73 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:32.676342 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-47ef1afe-e1a5-4591-9425-59123c960a73 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:32.814346 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d2e23beb-d80a-4684-b83f-710a8196a6d9 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:32.830377 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d2e23beb-d80a-4684-b83f-710a8196a6d9 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1687 microversion: 2.1 time: 0.500614 Oct 23 01:33:32.854317 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2568/5056] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:32 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1687 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:33:33.128941 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4019a50c-8beb-4d82-82e6-a16c1a6d06f3 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Action: 'create', calling method: .version_select at 0x7f5cc183bc10>, body: {"keypair": {"name": "tempest-keypair-45247929", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDlUktZSImDePFa6y7p1ao7pRrH87xr+IWb28wWgXfsfM1yBxS6eQ/6KTscohlYN2BMo4Zf/WeYzcPLXnk3EnT3R0/GKGo9kGttSXlTizHW3/W+bsUop4q/F6Pw/IoeP2Q=="}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:33:33.134622 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-47ef1afe-e1a5-4591-9425-59123c960a73 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:33.146798 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-4019a50c-8beb-4d82-82e6-a16c1a6d06f3 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Getting quotas for project 6edb27d1224244809ecbb55ac953c645. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:33:33.148986 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-47ef1afe-e1a5-4591-9425-59123c960a73 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef" status: 200 len: 1309 microversion: 2.1 time: 0.490143 Oct 23 01:33:33.150885 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2489/5057] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:32 2022] GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef => generated 1309 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:33.154369 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-4019a50c-8beb-4d82-82e6-a16c1a6d06f3 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Getting quotas for user 0c65e7ab0b544d9ebdac8bc2129d051a and project 6edb27d1224244809ecbb55ac953c645. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:33:33.205436 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-46f887fb-acda-47f4-bd4c-44a912922f0b req-bd008910-da68-4870-9ae6-54c2227796bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7878a5d1-1349-4cb6-abd1-519f61b97eef", "name": "network-vif-plugged", "status": "completed", "tag": "1a7030fd-87ce-41ea-ab45-62f0f99f4568"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:33:33.223646 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-46f887fb-acda-47f4-bd4c-44a912922f0b req-bd008910-da68-4870-9ae6-54c2227796bd service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:33.224133 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-46f887fb-acda-47f4-bd4c-44a912922f0b req-bd008910-da68-4870-9ae6-54c2227796bd service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:33.224580 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-46f887fb-acda-47f4-bd4c-44a912922f0b req-bd008910-da68-4870-9ae6-54c2227796bd service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:33.265700 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-46f887fb-acda-47f4-bd4c-44a912922f0b req-bd008910-da68-4870-9ae6-54c2227796bd service nova] Creating event network-vif-plugged:1a7030fd-87ce-41ea-ab45-62f0f99f4568 for instance 7878a5d1-1349-4cb6-abd1-519f61b97eef on n-h2-master-1 Oct 23 01:33:33.268771 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-46f887fb-acda-47f4-bd4c-44a912922f0b req-bd008910-da68-4870-9ae6-54c2227796bd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064687 Oct 23 01:33:33.269427 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2490/5058] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:33:33.329099 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4019a50c-8beb-4d82-82e6-a16c1a6d06f3 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.201861 Oct 23 01:33:33.329099 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2569/5059] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 01:33:33 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:33:33.681003 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-25893831-b1ea-4482-bcae-a686b1b3ea5c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:33.682160 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-25893831-b1ea-4482-bcae-a686b1b3ea5c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: e3bb9493-45f6-4889-8655-222a1284b4bf] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:33.700607 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25893831-b1ea-4482-bcae-a686b1b3ea5c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:33.701103 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25893831-b1ea-4482-bcae-a686b1b3ea5c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:33.701543 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25893831-b1ea-4482-bcae-a686b1b3ea5c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:33.707842 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25893831-b1ea-4482-bcae-a686b1b3ea5c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:33.708394 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25893831-b1ea-4482-bcae-a686b1b3ea5c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:33.709030 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25893831-b1ea-4482-bcae-a686b1b3ea5c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:33.869760 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b0191b74-90ab-42d7-a9a1-07ff8ea292a9 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:33.870427 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b0191b74-90ab-42d7-a9a1-07ff8ea292a9 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:33.888198 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b0191b74-90ab-42d7-a9a1-07ff8ea292a9 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:33.888960 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b0191b74-90ab-42d7-a9a1-07ff8ea292a9 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:33.889411 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b0191b74-90ab-42d7-a9a1-07ff8ea292a9 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:33.890764 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b0191b74-90ab-42d7-a9a1-07ff8ea292a9 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:33.891256 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b0191b74-90ab-42d7-a9a1-07ff8ea292a9 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:33.891689 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b0191b74-90ab-42d7-a9a1-07ff8ea292a9 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:34.432452 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-25893831-b1ea-4482-bcae-a686b1b3ea5c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:34.445832 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-25893831-b1ea-4482-bcae-a686b1b3ea5c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/e3bb9493-45f6-4889-8655-222a1284b4bf" status: 200 len: 1315 microversion: 2.1 time: 0.770931 Oct 23 01:33:34.451847 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2491/5060] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:33 2022] GET /compute/v2.1/servers/e3bb9493-45f6-4889-8655-222a1284b4bf => generated 1315 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:34.464245 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-31e3ab4a-3304-4bff-a9f6-ff526b501f73 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:34.465056 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-31e3ab4a-3304-4bff-a9f6-ff526b501f73 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 7878a5d1-1349-4cb6-abd1-519f61b97eef] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:34.481203 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-31e3ab4a-3304-4bff-a9f6-ff526b501f73 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:34.482036 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-31e3ab4a-3304-4bff-a9f6-ff526b501f73 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:34.482728 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-31e3ab4a-3304-4bff-a9f6-ff526b501f73 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:34.488802 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-31e3ab4a-3304-4bff-a9f6-ff526b501f73 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:34.489611 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-31e3ab4a-3304-4bff-a9f6-ff526b501f73 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:34.490888 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-31e3ab4a-3304-4bff-a9f6-ff526b501f73 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:34.541931 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b0191b74-90ab-42d7-a9a1-07ff8ea292a9 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:34.552026 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b0191b74-90ab-42d7-a9a1-07ff8ea292a9 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1682 microversion: 2.1 time: 0.689446 Oct 23 01:33:34.557071 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2570/5061] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:33 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1682 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:33:34.756278 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-31e3ab4a-3304-4bff-a9f6-ff526b501f73 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:34.767268 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-31e3ab4a-3304-4bff-a9f6-ff526b501f73 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef" status: 200 len: 1309 microversion: 2.1 time: 0.313893 Oct 23 01:33:34.767852 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2492/5062] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:34 2022] GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef => generated 1309 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:35.481907 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c5f0089c-bb59-4a88-9d3a-74548964abd6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:35.482504 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c5f0089c-bb59-4a88-9d3a-74548964abd6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: e3bb9493-45f6-4889-8655-222a1284b4bf] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:35.507872 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c5f0089c-bb59-4a88-9d3a-74548964abd6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:35.508676 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c5f0089c-bb59-4a88-9d3a-74548964abd6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:35.509330 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c5f0089c-bb59-4a88-9d3a-74548964abd6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:35.510345 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c5f0089c-bb59-4a88-9d3a-74548964abd6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:35.511029 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c5f0089c-bb59-4a88-9d3a-74548964abd6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:35.511662 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c5f0089c-bb59-4a88-9d3a-74548964abd6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:35.580650 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ec9d542e-a1c4-4017-9b61-45263bc30dde tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:35.582068 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ec9d542e-a1c4-4017-9b61-45263bc30dde tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:35.589153 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec9d542e-a1c4-4017-9b61-45263bc30dde tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:35.594708 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec9d542e-a1c4-4017-9b61-45263bc30dde tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:35.595452 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec9d542e-a1c4-4017-9b61-45263bc30dde tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:35.596398 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec9d542e-a1c4-4017-9b61-45263bc30dde tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:35.606718 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec9d542e-a1c4-4017-9b61-45263bc30dde tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:35.610635 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec9d542e-a1c4-4017-9b61-45263bc30dde tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:36.259647 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ec9d542e-a1c4-4017-9b61-45263bc30dde tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:36.272519 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c5f0089c-bb59-4a88-9d3a-74548964abd6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:36.299537 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ec9d542e-a1c4-4017-9b61-45263bc30dde tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1682 microversion: 2.1 time: 0.716427 Oct 23 01:33:36.303695 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2493/5063] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:35 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1682 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:33:36.305675 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c5f0089c-bb59-4a88-9d3a-74548964abd6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/e3bb9493-45f6-4889-8655-222a1284b4bf" status: 200 len: 1315 microversion: 2.1 time: 0.821129 Oct 23 01:33:36.311767 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2571/5064] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:35 2022] GET /compute/v2.1/servers/e3bb9493-45f6-4889-8655-222a1284b4bf => generated 1315 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:36.331943 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7390b425-c4f2-40f8-9893-b70b8cfacc74 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:36.337658 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-9111c988-5dde-4c5a-89cf-d4a50f3b3d8d req-9c64e420-6a3e-44bf-8fcd-83abe09029cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3bb9493-45f6-4889-8655-222a1284b4bf", "name": "network-vif-plugged", "status": "completed", "tag": "92f0adc4-9d2b-4e74-9511-4e7cccff6235"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:33:36.338672 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7390b425-c4f2-40f8-9893-b70b8cfacc74 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 7878a5d1-1349-4cb6-abd1-519f61b97eef] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:36.379747 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7390b425-c4f2-40f8-9893-b70b8cfacc74 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:36.380691 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7390b425-c4f2-40f8-9893-b70b8cfacc74 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:36.384133 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7390b425-c4f2-40f8-9893-b70b8cfacc74 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:36.387700 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7390b425-c4f2-40f8-9893-b70b8cfacc74 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:36.389181 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7390b425-c4f2-40f8-9893-b70b8cfacc74 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:36.392566 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7390b425-c4f2-40f8-9893-b70b8cfacc74 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:36.393417 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-9111c988-5dde-4c5a-89cf-d4a50f3b3d8d req-9c64e420-6a3e-44bf-8fcd-83abe09029cf service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:36.398744 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-9111c988-5dde-4c5a-89cf-d4a50f3b3d8d req-9c64e420-6a3e-44bf-8fcd-83abe09029cf service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:36.399801 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-9111c988-5dde-4c5a-89cf-d4a50f3b3d8d req-9c64e420-6a3e-44bf-8fcd-83abe09029cf service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:36.456049 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-9111c988-5dde-4c5a-89cf-d4a50f3b3d8d req-9c64e420-6a3e-44bf-8fcd-83abe09029cf service nova] Creating event network-vif-plugged:92f0adc4-9d2b-4e74-9511-4e7cccff6235 for instance e3bb9493-45f6-4889-8655-222a1284b4bf on n-h2-master-1 Oct 23 01:33:36.485631 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-9111c988-5dde-4c5a-89cf-d4a50f3b3d8d req-9c64e420-6a3e-44bf-8fcd-83abe09029cf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167995 Oct 23 01:33:36.493823 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2572/5065] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:33:36.875314 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7390b425-c4f2-40f8-9893-b70b8cfacc74 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:36.891140 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7390b425-c4f2-40f8-9893-b70b8cfacc74 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef" status: 200 len: 1489 microversion: 2.1 time: 0.582362 Oct 23 01:33:36.892231 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2494/5066] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:36 2022] GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef => generated 1489 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:36.917185 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f1b7c321-6fd1-4dcd-a6c0-caded18ea93e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1280289409"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:33:36.922360 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f1b7c321-6fd1-4dcd-a6c0-caded18ea93e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 7878a5d1-1349-4cb6-abd1-519f61b97eef] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:36.943119 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1b7c321-6fd1-4dcd-a6c0-caded18ea93e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:36.944065 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1b7c321-6fd1-4dcd-a6c0-caded18ea93e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:36.945759 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1b7c321-6fd1-4dcd-a6c0-caded18ea93e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:36.946730 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1b7c321-6fd1-4dcd-a6c0-caded18ea93e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:36.950124 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1b7c321-6fd1-4dcd-a6c0-caded18ea93e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:36.951376 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1b7c321-6fd1-4dcd-a6c0-caded18ea93e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:37.190276 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f1b7c321-6fd1-4dcd-a6c0-caded18ea93e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "PUT /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef" status: 200 len: 1074 microversion: 2.1 time: 0.278679 Oct 23 01:33:37.191658 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2573/5067] 10.222.0.42 () {60 vars in 1256 bytes} [Sun Oct 23 01:33:36 2022] PUT /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef => generated 1074 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:37.215011 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a695d39b-c581-40af-a8e9-d7224e2783f6 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:37.215928 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a695d39b-c581-40af-a8e9-d7224e2783f6 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 7878a5d1-1349-4cb6-abd1-519f61b97eef] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:37.235651 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:33:37.247429 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a695d39b-c581-40af-a8e9-d7224e2783f6 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:37.247940 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a695d39b-c581-40af-a8e9-d7224e2783f6 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:37.248391 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a695d39b-c581-40af-a8e9-d7224e2783f6 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:37.249401 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a695d39b-c581-40af-a8e9-d7224e2783f6 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:37.249818 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a695d39b-c581-40af-a8e9-d7224e2783f6 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:37.250296 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a695d39b-c581-40af-a8e9-d7224e2783f6 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:37.331735 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-187ffc11-f8c7-4ec1-bd4e-3973825dd920 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:37.332594 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-187ffc11-f8c7-4ec1-bd4e-3973825dd920 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: e3bb9493-45f6-4889-8655-222a1284b4bf] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:37.349243 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-187ffc11-f8c7-4ec1-bd4e-3973825dd920 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:37.349758 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-187ffc11-f8c7-4ec1-bd4e-3973825dd920 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:37.352360 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-187ffc11-f8c7-4ec1-bd4e-3973825dd920 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:37.353105 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-187ffc11-f8c7-4ec1-bd4e-3973825dd920 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:37.353582 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-187ffc11-f8c7-4ec1-bd4e-3973825dd920 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:37.355755 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-187ffc11-f8c7-4ec1-bd4e-3973825dd920 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:38.629562 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a695d39b-c581-40af-a8e9-d7224e2783f6 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:38.640786 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a695d39b-c581-40af-a8e9-d7224e2783f6 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef" status: 200 len: 1500 microversion: 2.1 time: 1.434409 Oct 23 01:33:38.642469 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-187ffc11-f8c7-4ec1-bd4e-3973825dd920 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:38.645063 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2495/5068] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:37 2022] GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef => generated 1500 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:38.652611 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-187ffc11-f8c7-4ec1-bd4e-3973825dd920 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/e3bb9493-45f6-4889-8655-222a1284b4bf" status: 200 len: 1315 microversion: 2.1 time: 1.326339 Oct 23 01:33:38.655936 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ba9ddb99-35ba-48fa-b4a3-920b58a5339e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:38.656558 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ba9ddb99-35ba-48fa-b4a3-920b58a5339e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:38.661260 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2574/5069] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:37 2022] GET /compute/v2.1/servers/e3bb9493-45f6-4889-8655-222a1284b4bf => generated 1315 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:33:38.672945 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ba9ddb99-35ba-48fa-b4a3-920b58a5339e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:38.672945 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ba9ddb99-35ba-48fa-b4a3-920b58a5339e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:38.672945 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ba9ddb99-35ba-48fa-b4a3-920b58a5339e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:38.678213 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ba9ddb99-35ba-48fa-b4a3-920b58a5339e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:38.679494 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ba9ddb99-35ba-48fa-b4a3-920b58a5339e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:38.680091 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ba9ddb99-35ba-48fa-b4a3-920b58a5339e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:38.687374 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f721239a-3f01-4d93-887d-80f425826692 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:38.691424 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f721239a-3f01-4d93-887d-80f425826692 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:38.721710 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f721239a-3f01-4d93-887d-80f425826692 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:38.722297 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f721239a-3f01-4d93-887d-80f425826692 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:38.722755 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f721239a-3f01-4d93-887d-80f425826692 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:38.728919 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f721239a-3f01-4d93-887d-80f425826692 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:38.732339 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f721239a-3f01-4d93-887d-80f425826692 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:38.734991 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f721239a-3f01-4d93-887d-80f425826692 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:38.790216 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-f721239a-3f01-4d93-887d-80f425826692 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] HTTP exception thrown: Instance b1d0765d-d720-40d2-b168-058e013fab0a could not be found. Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f721239a-3f01-4d93-887d-80f425826692 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Request method failure captured: Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a HTTP/1.1 Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJgQM9ac_nigtGLK4LZKApOXoIiTORToGrfCQJAudkDegQhaUBSbLk4jPFxqWvc7WPMryaamEsgoumiKRsUdXg4p2qo9wiVzLKc_z19LEKedgAH8Ey2iIcc4F8p1F8DcpTrJ2hLsEbdK9ktQp2Y5kAAr_EcoR2XwA8yLtIahEXP4IdE Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: X-Openstack-Nova-Api-Version: 2.20 Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 4464938aec13451f910daa714d060e46 Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-517248460 Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4464938aec13451f910daa714d060e46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4464938aec13451f910daa714d060e46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4464938aec13451f910daa714d060e46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4464938aec13451f910daa714d060e46"}]}] Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-AttachVolumeShelveTestJSON-517248460 Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 4464938aec13451f910daa714d060e46 Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-517248460 Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-AttachVolumeShelveTestJSON-517248460-project Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 1864708a7b2f4223bc8f0015c765eb0f Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-AttachVolumeShelveTestJSON-517248460-project Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: exception: Instance b1d0765d-d720-40d2-b168-058e013fab0a could not be found. Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'b1d0765d-d720-40d2-b168-058e013fab0a'} Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1d0765d-d720-40d2-b168-058e013fab0a could not be found. Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:33:38.796090 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:33:38.804335 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1d0765d-d720-40d2-b168-058e013fab0a could not be found. Oct 23 01:33:38.804335 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:33:38.804335 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:33:38.804335 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:33:38.804335 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:33:38.804335 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:33:38.804335 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:33:38.804335 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:33:38.804335 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:33:38.804335 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1d0765d-d720-40d2-b168-058e013fab0a could not be found. Oct 23 01:33:38.804335 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:33:38.804335 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f721239a-3f01-4d93-887d-80f425826692 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Returning 404 to user: Instance b1d0765d-d720-40d2-b168-058e013fab0a could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:33:38.806832 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f721239a-3f01-4d93-887d-80f425826692 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 404 len: 111 microversion: 2.20 time: 0.144447 Oct 23 01:33:38.809941 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2575/5070] 10.222.0.42 () {60 vars in 1280 bytes} [Sun Oct 23 01:33:38 2022] DELETE /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:33:38.828665 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-bb8da402-1a1b-42e7-87fc-a63e06b685f6 req-5b8830b2-d183-49da-9b8d-74f68feac782 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa616812-f379-45fb-8e7e-fefe7570dc98", "name": "network-vif-plugged", "status": "completed", "tag": "6de1369a-94d0-42a0-a57f-9deacb90b66f"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:33:38.872860 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-bb8da402-1a1b-42e7-87fc-a63e06b685f6 req-5b8830b2-d183-49da-9b8d-74f68feac782 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:38.879028 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-bb8da402-1a1b-42e7-87fc-a63e06b685f6 req-5b8830b2-d183-49da-9b8d-74f68feac782 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:38.882316 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-bb8da402-1a1b-42e7-87fc-a63e06b685f6 req-5b8830b2-d183-49da-9b8d-74f68feac782 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:38.927918 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-bb8da402-1a1b-42e7-87fc-a63e06b685f6 req-5b8830b2-d183-49da-9b8d-74f68feac782 service nova] Creating event network-vif-plugged:6de1369a-94d0-42a0-a57f-9deacb90b66f for instance fa616812-f379-45fb-8e7e-fefe7570dc98 on n-h1-master-1 Oct 23 01:33:38.964886 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-bb8da402-1a1b-42e7-87fc-a63e06b685f6 req-5b8830b2-d183-49da-9b8d-74f68feac782 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147382 Oct 23 01:33:38.968566 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2576/5071] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:33:38.994884 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ebaf5682-44cb-460b-be75-d0e1a7f19bb6 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:38.999985 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ebaf5682-44cb-460b-be75-d0e1a7f19bb6 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 7878a5d1-1349-4cb6-abd1-519f61b97eef] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:39.032823 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ebaf5682-44cb-460b-be75-d0e1a7f19bb6 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:39.037146 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ebaf5682-44cb-460b-be75-d0e1a7f19bb6 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:39.043540 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ebaf5682-44cb-460b-be75-d0e1a7f19bb6 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:39.043540 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ebaf5682-44cb-460b-be75-d0e1a7f19bb6 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:39.043540 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ebaf5682-44cb-460b-be75-d0e1a7f19bb6 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:39.043540 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ebaf5682-44cb-460b-be75-d0e1a7f19bb6 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:39.445602 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ba9ddb99-35ba-48fa-b4a3-920b58a5339e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:39.453961 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ba9ddb99-35ba-48fa-b4a3-920b58a5339e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1682 microversion: 2.1 time: 0.802893 Oct 23 01:33:39.459507 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2496/5072] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:38 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1682 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:39.477599 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-68ba4e60-1865-4603-be90-3286bf0a0152 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:39.478785 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-68ba4e60-1865-4603-be90-3286bf0a0152 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: b1d0765d-d720-40d2-b168-058e013fab0a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:39.505736 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-68ba4e60-1865-4603-be90-3286bf0a0152 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:39.510106 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-68ba4e60-1865-4603-be90-3286bf0a0152 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:39.510870 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-68ba4e60-1865-4603-be90-3286bf0a0152 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:39.511796 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-68ba4e60-1865-4603-be90-3286bf0a0152 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:39.512433 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-68ba4e60-1865-4603-be90-3286bf0a0152 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:39.513044 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-68ba4e60-1865-4603-be90-3286bf0a0152 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:39.550913 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-68ba4e60-1865-4603-be90-3286bf0a0152 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] HTTP exception thrown: Instance b1d0765d-d720-40d2-b168-058e013fab0a could not be found. Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-68ba4e60-1865-4603-be90-3286bf0a0152 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Request method failure captured: Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a HTTP/1.1 Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJgQM9ac_nigtGLK4LZKApOXoIiTORToGrfCQJAudkDegQhaUBSbLk4jPFxqWvc7WPMryaamEsgoumiKRsUdXg4p2qo9wiVzLKc_z19LEKedgAH8Ey2iIcc4F8p1F8DcpTrJ2hLsEbdK9ktQp2Y5kAAr_EcoR2XwA8yLtIahEXP4IdE Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: X-Openstack-Nova-Api-Version: 2.20 Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 4464938aec13451f910daa714d060e46 Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-517248460 Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4464938aec13451f910daa714d060e46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4464938aec13451f910daa714d060e46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4464938aec13451f910daa714d060e46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4464938aec13451f910daa714d060e46"}]}] Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-AttachVolumeShelveTestJSON-517248460 Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 4464938aec13451f910daa714d060e46 Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-517248460 Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-AttachVolumeShelveTestJSON-517248460-project Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 1864708a7b2f4223bc8f0015c765eb0f Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-AttachVolumeShelveTestJSON-517248460-project Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: exception: Instance b1d0765d-d720-40d2-b168-058e013fab0a could not be found. Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'b1d0765d-d720-40d2-b168-058e013fab0a'} Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1d0765d-d720-40d2-b168-058e013fab0a could not be found. Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1d0765d-d720-40d2-b168-058e013fab0a could not be found. Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:33:39.556476 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:33:39.562791 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:33:39.562791 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:33:39.562791 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:33:39.562791 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:33:39.562791 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:33:39.562791 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:33:39.562791 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1d0765d-d720-40d2-b168-058e013fab0a could not be found. Oct 23 01:33:39.562791 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:33:39.565747 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-68ba4e60-1865-4603-be90-3286bf0a0152 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Returning 404 to user: Instance b1d0765d-d720-40d2-b168-058e013fab0a could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:33:39.574877 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-68ba4e60-1865-4603-be90-3286bf0a0152 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a" status: 404 len: 111 microversion: 2.20 time: 0.112259 Oct 23 01:33:39.579059 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2497/5073] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:33:39 2022] GET /compute/v2.1/servers/b1d0765d-d720-40d2-b168-058e013fab0a => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:33:39.699668 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4f116823-e963-4d9f-a10e-44cd61ea0541 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:39.701643 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4f116823-e963-4d9f-a10e-44cd61ea0541 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: e3bb9493-45f6-4889-8655-222a1284b4bf] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:39.719329 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f116823-e963-4d9f-a10e-44cd61ea0541 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:39.719822 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f116823-e963-4d9f-a10e-44cd61ea0541 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:39.720264 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f116823-e963-4d9f-a10e-44cd61ea0541 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:39.720969 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f116823-e963-4d9f-a10e-44cd61ea0541 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:39.721419 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f116823-e963-4d9f-a10e-44cd61ea0541 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:39.721838 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f116823-e963-4d9f-a10e-44cd61ea0541 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:39.784169 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ebaf5682-44cb-460b-be75-d0e1a7f19bb6 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:39.807579 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ebaf5682-44cb-460b-be75-d0e1a7f19bb6 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef" status: 200 len: 1500 microversion: 2.1 time: 0.834472 Oct 23 01:33:39.811809 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2577/5074] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:38 2022] GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef => generated 1500 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:39.838527 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-df87e745-f1a6-4db6-afcd-70c0be91ac3a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:33:39.879772 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-df87e745-f1a6-4db6-afcd-70c0be91ac3a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:39.886138 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-df87e745-f1a6-4db6-afcd-70c0be91ac3a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:39.886774 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-df87e745-f1a6-4db6-afcd-70c0be91ac3a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:39.985162 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-df87e745-f1a6-4db6-afcd-70c0be91ac3a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 7878a5d1-1349-4cb6-abd1-519f61b97eef] Going to try to stop instance {{(pid=120944) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 23 01:33:40.259771 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-df87e745-f1a6-4db6-afcd-70c0be91ac3a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "POST /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef/action" status: 202 len: 0 microversion: 2.1 time: 0.425601 Oct 23 01:33:40.261105 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2578/5075] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:33:39 2022] POST /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef/action => generated 0 bytes in 428 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:33:40.275261 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b75aed57-076d-4e6b-95d9-91a65977e542 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:40.288738 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b75aed57-076d-4e6b-95d9-91a65977e542 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 7878a5d1-1349-4cb6-abd1-519f61b97eef] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:40.309762 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b75aed57-076d-4e6b-95d9-91a65977e542 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:40.310759 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b75aed57-076d-4e6b-95d9-91a65977e542 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:40.311471 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b75aed57-076d-4e6b-95d9-91a65977e542 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:40.313662 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b75aed57-076d-4e6b-95d9-91a65977e542 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:40.314777 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b75aed57-076d-4e6b-95d9-91a65977e542 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:40.316984 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b75aed57-076d-4e6b-95d9-91a65977e542 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:40.705216 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4f116823-e963-4d9f-a10e-44cd61ea0541 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:40.722875 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4f116823-e963-4d9f-a10e-44cd61ea0541 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/e3bb9493-45f6-4889-8655-222a1284b4bf" status: 200 len: 1502 microversion: 2.1 time: 1.028103 Oct 23 01:33:40.724377 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2498/5076] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:39 2022] GET /compute/v2.1/servers/e3bb9493-45f6-4889-8655-222a1284b4bf => generated 1502 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:33:40.732635 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b9abb724-a167-4e8c-b3e5-3089cbfb73b0 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:40.735884 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b9abb724-a167-4e8c-b3e5-3089cbfb73b0 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:40.748252 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9abb724-a167-4e8c-b3e5-3089cbfb73b0 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:40.750582 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9abb724-a167-4e8c-b3e5-3089cbfb73b0 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:40.754479 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9abb724-a167-4e8c-b3e5-3089cbfb73b0 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:40.768125 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9abb724-a167-4e8c-b3e5-3089cbfb73b0 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:40.769635 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9abb724-a167-4e8c-b3e5-3089cbfb73b0 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:40.770299 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9abb724-a167-4e8c-b3e5-3089cbfb73b0 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:40.776105 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:33:41.505119 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b75aed57-076d-4e6b-95d9-91a65977e542 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:41.515924 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b75aed57-076d-4e6b-95d9-91a65977e542 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef" status: 200 len: 1510 microversion: 2.1 time: 1.245442 Oct 23 01:33:41.516506 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2579/5077] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:40 2022] GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef => generated 1510 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:41.550616 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-28fa5832-f975-476e-892e-61daeffbb9e5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:33:41.552647 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-28fa5832-f975-476e-892e-61daeffbb9e5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: e3bb9493-45f6-4889-8655-222a1284b4bf] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:41.565643 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-28fa5832-f975-476e-892e-61daeffbb9e5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:41.566627 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-28fa5832-f975-476e-892e-61daeffbb9e5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:41.567261 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-28fa5832-f975-476e-892e-61daeffbb9e5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:41.568190 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-28fa5832-f975-476e-892e-61daeffbb9e5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:41.569029 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-28fa5832-f975-476e-892e-61daeffbb9e5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:41.569631 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-28fa5832-f975-476e-892e-61daeffbb9e5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:41.696241 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b9abb724-a167-4e8c-b3e5-3089cbfb73b0 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:41.715931 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b9abb724-a167-4e8c-b3e5-3089cbfb73b0 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1682 microversion: 2.1 time: 0.987944 Oct 23 01:33:41.720483 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2499/5078] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:40 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1682 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:41.792690 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:33:41.877644 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-28fa5832-f975-476e-892e-61daeffbb9e5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "POST /compute/v2.1/servers/e3bb9493-45f6-4889-8655-222a1284b4bf/action" status: 202 len: 0 microversion: 2.1 time: 0.346699 Oct 23 01:33:41.881103 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2580/5079] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:33:41 2022] POST /compute/v2.1/servers/e3bb9493-45f6-4889-8655-222a1284b4bf/action => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:33:41.896676 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-33f290d4-d8b1-4620-8574-26b27f0b0cf0 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:41.899671 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-33f290d4-d8b1-4620-8574-26b27f0b0cf0 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: e3bb9493-45f6-4889-8655-222a1284b4bf] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:41.917461 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-33f290d4-d8b1-4620-8574-26b27f0b0cf0 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:41.922307 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-33f290d4-d8b1-4620-8574-26b27f0b0cf0 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:41.923149 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-33f290d4-d8b1-4620-8574-26b27f0b0cf0 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:41.924949 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-33f290d4-d8b1-4620-8574-26b27f0b0cf0 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:41.928393 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-33f290d4-d8b1-4620-8574-26b27f0b0cf0 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:41.929081 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-33f290d4-d8b1-4620-8574-26b27f0b0cf0 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:42.358513 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-34b1490c-ca45-465c-9140-7553bdf0a509 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-905545106", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e9d65ec9-a091-4c05-b838-8a651ac0b337"}], "security_groups": [{"name": "tempest-securitygroup--1526085144"}], "key_name": "tempest-keypair-45247929", "user_data": "}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:33:42.524493 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-33f290d4-d8b1-4620-8574-26b27f0b0cf0 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:42.533777 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-33f290d4-d8b1-4620-8574-26b27f0b0cf0 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/e3bb9493-45f6-4889-8655-222a1284b4bf" status: 200 len: 1507 microversion: 2.1 time: 0.650915 Oct 23 01:33:42.546670 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2500/5080] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:41 2022] GET /compute/v2.1/servers/e3bb9493-45f6-4889-8655-222a1284b4bf => generated 1507 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:42.565531 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8b6c9415-1c65-4448-9595-f00ac838acb4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:42.567595 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8b6c9415-1c65-4448-9595-f00ac838acb4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 7878a5d1-1349-4cb6-abd1-519f61b97eef] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:42.585726 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b6c9415-1c65-4448-9595-f00ac838acb4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:42.586265 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b6c9415-1c65-4448-9595-f00ac838acb4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:42.586702 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b6c9415-1c65-4448-9595-f00ac838acb4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:42.590067 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b6c9415-1c65-4448-9595-f00ac838acb4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:42.593947 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b6c9415-1c65-4448-9595-f00ac838acb4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:42.595579 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b6c9415-1c65-4448-9595-f00ac838acb4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:43.008048 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-34b1490c-ca45-465c-9140-7553bdf0a509 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] validate_networks() for [('e9d65ec9-a091-4c05-b838-8a651ac0b337', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:33:43.166792 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=4 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:33:43.396324 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8b6c9415-1c65-4448-9595-f00ac838acb4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:43.408256 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8b6c9415-1c65-4448-9595-f00ac838acb4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef" status: 200 len: 1510 microversion: 2.1 time: 0.860234 Oct 23 01:33:43.412510 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2501/5081] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:42 2022] GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef => generated 1510 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:43.424059 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0b3c80a4-2f17-456f-b303-201c1ed554f5 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:43.428910 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0b3c80a4-2f17-456f-b303-201c1ed554f5 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:43.447602 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b3c80a4-2f17-456f-b303-201c1ed554f5 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:43.449394 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b3c80a4-2f17-456f-b303-201c1ed554f5 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:43.452131 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b3c80a4-2f17-456f-b303-201c1ed554f5 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:43.454052 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b3c80a4-2f17-456f-b303-201c1ed554f5 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:43.454710 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b3c80a4-2f17-456f-b303-201c1ed554f5 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:43.455865 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b3c80a4-2f17-456f-b303-201c1ed554f5 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:44.103834 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0b3c80a4-2f17-456f-b303-201c1ed554f5 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:44.133397 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0b3c80a4-2f17-456f-b303-201c1ed554f5 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1682 microversion: 2.1 time: 0.718420 Oct 23 01:33:44.135274 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2502/5082] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:43 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1682 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:44.145095 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-85c8180a-d9df-4531-8ef7-4b6fe36222e3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:44.145095 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-85c8180a-d9df-4531-8ef7-4b6fe36222e3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: e3bb9493-45f6-4889-8655-222a1284b4bf] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:44.162301 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-85c8180a-d9df-4531-8ef7-4b6fe36222e3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:44.164047 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-85c8180a-d9df-4531-8ef7-4b6fe36222e3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:44.164563 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-85c8180a-d9df-4531-8ef7-4b6fe36222e3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:44.165349 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-85c8180a-d9df-4531-8ef7-4b6fe36222e3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:44.169261 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-85c8180a-d9df-4531-8ef7-4b6fe36222e3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:44.169640 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-85c8180a-d9df-4531-8ef7-4b6fe36222e3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:44.333060 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-34b1490c-ca45-465c-9140-7553bdf0a509 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:33:44.334425 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-34b1490c-ca45-465c-9140-7553bdf0a509 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:33:44.335090 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-34b1490c-ca45-465c-9140-7553bdf0a509 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:33:44.335676 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-34b1490c-ca45-465c-9140-7553bdf0a509 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:33:44.336273 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-34b1490c-ca45-465c-9140-7553bdf0a509 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:33:44.359020 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-34b1490c-ca45-465c-9140-7553bdf0a509 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:44.359704 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-34b1490c-ca45-465c-9140-7553bdf0a509 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:44.360789 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-34b1490c-ca45-465c-9140-7553bdf0a509 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:44.361805 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-34b1490c-ca45-465c-9140-7553bdf0a509 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:44.362653 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-34b1490c-ca45-465c-9140-7553bdf0a509 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:44.363346 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-34b1490c-ca45-465c-9140-7553bdf0a509 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:44.402820 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-34b1490c-ca45-465c-9140-7553bdf0a509 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Getting quotas for project 6edb27d1224244809ecbb55ac953c645. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:33:44.411930 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-34b1490c-ca45-465c-9140-7553bdf0a509 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Getting quotas for user 0c65e7ab0b544d9ebdac8bc2129d051a and project 6edb27d1224244809ecbb55ac953c645. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:33:44.460773 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-34b1490c-ca45-465c-9140-7553bdf0a509 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:33:44.464987 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-34b1490c-ca45-465c-9140-7553bdf0a509 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 697bf9a9-687f-4d5f-a459-9ff304289577] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:33:44.726561 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-34b1490c-ca45-465c-9140-7553bdf0a509 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.374818 Oct 23 01:33:44.730403 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2581/5083] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:33:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 2379 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 23 01:33:44.744996 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-767ec74f-01ee-46d7-bc0a-e127f59ebe39 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:44.747582 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-767ec74f-01ee-46d7-bc0a-e127f59ebe39 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 7878a5d1-1349-4cb6-abd1-519f61b97eef] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:44.758692 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-767ec74f-01ee-46d7-bc0a-e127f59ebe39 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:44.759636 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-767ec74f-01ee-46d7-bc0a-e127f59ebe39 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:44.762934 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-767ec74f-01ee-46d7-bc0a-e127f59ebe39 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:44.768338 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-767ec74f-01ee-46d7-bc0a-e127f59ebe39 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:44.769306 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-767ec74f-01ee-46d7-bc0a-e127f59ebe39 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:44.777836 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-767ec74f-01ee-46d7-bc0a-e127f59ebe39 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:45.261504 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-767ec74f-01ee-46d7-bc0a-e127f59ebe39 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:45.272377 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-767ec74f-01ee-46d7-bc0a-e127f59ebe39 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef" status: 200 len: 1510 microversion: 2.1 time: 0.540617 Oct 23 01:33:45.301407 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2582/5084] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:44 2022] GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef => generated 1510 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:45.322573 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6736af60-c88b-4079-b81b-b7773d94538f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:45.325917 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6736af60-c88b-4079-b81b-b7773d94538f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 697bf9a9-687f-4d5f-a459-9ff304289577] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:45.395238 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-85c8180a-d9df-4531-8ef7-4b6fe36222e3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:45.411847 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-85c8180a-d9df-4531-8ef7-4b6fe36222e3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/e3bb9493-45f6-4889-8655-222a1284b4bf" status: 200 len: 1487 microversion: 2.1 time: 1.267683 Oct 23 01:33:45.413402 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2503/5085] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:44 2022] GET /compute/v2.1/servers/e3bb9493-45f6-4889-8655-222a1284b4bf => generated 1487 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:45.438214 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-da7efacd-7aed-42eb-b70a-bf4c68f34d22 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:45.441176 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-da7efacd-7aed-42eb-b70a-bf4c68f34d22 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:45.474224 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da7efacd-7aed-42eb-b70a-bf4c68f34d22 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:45.474224 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da7efacd-7aed-42eb-b70a-bf4c68f34d22 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:45.474224 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da7efacd-7aed-42eb-b70a-bf4c68f34d22 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:45.474224 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da7efacd-7aed-42eb-b70a-bf4c68f34d22 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:45.474224 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da7efacd-7aed-42eb-b70a-bf4c68f34d22 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:45.474224 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da7efacd-7aed-42eb-b70a-bf4c68f34d22 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:45.633610 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6736af60-c88b-4079-b81b-b7773d94538f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:45.644136 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6736af60-c88b-4079-b81b-b7773d94538f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577" status: 200 len: 1239 microversion: 2.1 time: 0.349433 Oct 23 01:33:45.648219 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2583/5086] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:45 2022] GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577 => generated 1239 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:45.672832 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1c13f1fa-48c8-489a-9b23-df0104514d23 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:45.677805 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1c13f1fa-48c8-489a-9b23-df0104514d23 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: e3bb9493-45f6-4889-8655-222a1284b4bf] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:45.721150 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1c13f1fa-48c8-489a-9b23-df0104514d23 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:45.721687 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1c13f1fa-48c8-489a-9b23-df0104514d23 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:45.722189 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1c13f1fa-48c8-489a-9b23-df0104514d23 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:45.722982 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1c13f1fa-48c8-489a-9b23-df0104514d23 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:45.723463 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1c13f1fa-48c8-489a-9b23-df0104514d23 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:45.723895 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1c13f1fa-48c8-489a-9b23-df0104514d23 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:45.928149 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1c13f1fa-48c8-489a-9b23-df0104514d23 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: e3bb9493-45f6-4889-8655-222a1284b4bf] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:33:46.205239 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-da7efacd-7aed-42eb-b70a-bf4c68f34d22 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:46.218249 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-da7efacd-7aed-42eb-b70a-bf4c68f34d22 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1682 microversion: 2.1 time: 0.800892 Oct 23 01:33:46.221180 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2504/5087] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:45 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1682 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:46.305868 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-612330d8-9546-4689-99cb-7c1d27f2595e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:46.306869 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-612330d8-9546-4689-99cb-7c1d27f2595e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 7878a5d1-1349-4cb6-abd1-519f61b97eef] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:46.316775 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-612330d8-9546-4689-99cb-7c1d27f2595e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:46.320350 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-612330d8-9546-4689-99cb-7c1d27f2595e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:46.320350 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-612330d8-9546-4689-99cb-7c1d27f2595e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:46.321960 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-612330d8-9546-4689-99cb-7c1d27f2595e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:46.322666 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-612330d8-9546-4689-99cb-7c1d27f2595e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:46.324101 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-612330d8-9546-4689-99cb-7c1d27f2595e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:46.445184 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1c13f1fa-48c8-489a-9b23-df0104514d23 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e3bb9493-45f6-4889-8655-222a1284b4bf" status: 204 len: 0 microversion: 2.1 time: 0.780113 Oct 23 01:33:46.446168 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2584/5088] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:33:45 2022] DELETE /compute/v2.1/servers/e3bb9493-45f6-4889-8655-222a1284b4bf => generated 0 bytes in 782 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:33:46.456532 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-48ddb4e3-5545-4f56-b278-6fc3c4830949 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:46.457243 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-48ddb4e3-5545-4f56-b278-6fc3c4830949 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: e3bb9493-45f6-4889-8655-222a1284b4bf] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:46.470108 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-48ddb4e3-5545-4f56-b278-6fc3c4830949 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:46.473865 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-48ddb4e3-5545-4f56-b278-6fc3c4830949 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:46.482527 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-48ddb4e3-5545-4f56-b278-6fc3c4830949 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:46.484381 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-48ddb4e3-5545-4f56-b278-6fc3c4830949 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:46.485043 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-48ddb4e3-5545-4f56-b278-6fc3c4830949 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:46.485658 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-48ddb4e3-5545-4f56-b278-6fc3c4830949 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:47.790828 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-612330d8-9546-4689-99cb-7c1d27f2595e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:47.804507 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-612330d8-9546-4689-99cb-7c1d27f2595e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef" status: 200 len: 1510 microversion: 2.1 time: 1.503384 Oct 23 01:33:47.825610 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2505/5089] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:46 2022] GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef => generated 1510 bytes in 1525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:33:47.860254 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c9658aa4-0926-40db-a829-ed9b81aa8d36 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:47.863036 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c9658aa4-0926-40db-a829-ed9b81aa8d36 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 697bf9a9-687f-4d5f-a459-9ff304289577] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:47.875499 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c9658aa4-0926-40db-a829-ed9b81aa8d36 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:47.876303 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c9658aa4-0926-40db-a829-ed9b81aa8d36 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:47.876910 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c9658aa4-0926-40db-a829-ed9b81aa8d36 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:47.878548 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c9658aa4-0926-40db-a829-ed9b81aa8d36 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:47.879311 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c9658aa4-0926-40db-a829-ed9b81aa8d36 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:47.880767 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c9658aa4-0926-40db-a829-ed9b81aa8d36 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:48.178986 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c9658aa4-0926-40db-a829-ed9b81aa8d36 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:48.194174 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c9658aa4-0926-40db-a829-ed9b81aa8d36 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577" status: 200 len: 1291 microversion: 2.1 time: 0.365521 Oct 23 01:33:48.195851 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2506/5090] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:47 2022] GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577 => generated 1291 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:48.212118 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-83a0cb9c-78c7-4737-ba41-6abd4730f30c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:48.214736 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-83a0cb9c-78c7-4737-ba41-6abd4730f30c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:48.235320 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-48ddb4e3-5545-4f56-b278-6fc3c4830949 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:48.242548 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83a0cb9c-78c7-4737-ba41-6abd4730f30c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:48.243068 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83a0cb9c-78c7-4737-ba41-6abd4730f30c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:48.243513 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83a0cb9c-78c7-4737-ba41-6abd4730f30c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:48.247348 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83a0cb9c-78c7-4737-ba41-6abd4730f30c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:48.251152 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83a0cb9c-78c7-4737-ba41-6abd4730f30c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:48.255570 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83a0cb9c-78c7-4737-ba41-6abd4730f30c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:48.259892 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-48ddb4e3-5545-4f56-b278-6fc3c4830949 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/e3bb9493-45f6-4889-8655-222a1284b4bf" status: 200 len: 1493 microversion: 2.1 time: 1.797292 Oct 23 01:33:48.259892 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2585/5091] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:46 2022] GET /compute/v2.1/servers/e3bb9493-45f6-4889-8655-222a1284b4bf => generated 1493 bytes in 1807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:48.277471 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dbccefee-a65c-4071-a09e-5640792e7ca2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:48.279984 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-dbccefee-a65c-4071-a09e-5640792e7ca2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:48.309740 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-83a0cb9c-78c7-4737-ba41-6abd4730f30c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] HTTP exception thrown: Instance c6eb59b7-d1ee-442c-8142-19a88ad6a039 could not be found. Oct 23 01:33:48.320287 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dbccefee-a65c-4071-a09e-5640792e7ca2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-83a0cb9c-78c7-4737-ba41-6abd4730f30c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Request method failure captured: Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 HTTP/1.1 Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJgQM9ac_nigtGLK4LZKApOXoIiTORToGrfCQJAudkDegQhaUBSbLk4jPFxqWvc7WPMryaamEsgoumiKRsUdXg4p2qo9wiVzLKc_z19LEKedgAH8Ey2iIcc4F8p1F8DcpTrJ2hLsEbdK9ktQp2Y5kAAr_EcoR2XwA8yLtIahEXP4IdE Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: X-Openstack-Nova-Api-Version: 2.20 Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 4464938aec13451f910daa714d060e46 Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-517248460 Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4464938aec13451f910daa714d060e46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4464938aec13451f910daa714d060e46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4464938aec13451f910daa714d060e46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4464938aec13451f910daa714d060e46"}]}] Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-AttachVolumeShelveTestJSON-517248460 Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 4464938aec13451f910daa714d060e46 Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-517248460 Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-AttachVolumeShelveTestJSON-517248460-project Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 1864708a7b2f4223bc8f0015c765eb0f Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-AttachVolumeShelveTestJSON-517248460-project Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: exception: Instance c6eb59b7-d1ee-442c-8142-19a88ad6a039 could not be found. Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'c6eb59b7-d1ee-442c-8142-19a88ad6a039'} Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6eb59b7-d1ee-442c-8142-19a88ad6a039 could not be found. Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:33:48.321385 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:33:48.329928 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6eb59b7-d1ee-442c-8142-19a88ad6a039 could not be found. Oct 23 01:33:48.329928 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:33:48.329928 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:33:48.329928 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:33:48.329928 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:33:48.329928 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:33:48.329928 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:33:48.329928 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:33:48.329928 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:33:48.329928 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6eb59b7-d1ee-442c-8142-19a88ad6a039 could not be found. Oct 23 01:33:48.329928 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:33:48.329928 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-83a0cb9c-78c7-4737-ba41-6abd4730f30c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Returning 404 to user: Instance c6eb59b7-d1ee-442c-8142-19a88ad6a039 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:33:48.329928 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-83a0cb9c-78c7-4737-ba41-6abd4730f30c tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 404 len: 111 microversion: 2.20 time: 0.125779 Oct 23 01:33:48.331851 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dbccefee-a65c-4071-a09e-5640792e7ca2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:48.334948 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dbccefee-a65c-4071-a09e-5640792e7ca2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:48.338702 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dbccefee-a65c-4071-a09e-5640792e7ca2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:48.341082 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2507/5092] 10.222.0.42 () {60 vars in 1280 bytes} [Sun Oct 23 01:33:48 2022] DELETE /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:33:48.341822 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dbccefee-a65c-4071-a09e-5640792e7ca2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:48.342568 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dbccefee-a65c-4071-a09e-5640792e7ca2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:48.358214 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a4b8347c-3fd5-434c-9802-d625eb9aa247 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:48.358214 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a4b8347c-3fd5-434c-9802-d625eb9aa247 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] [instance: c6eb59b7-d1ee-442c-8142-19a88ad6a039] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:48.379773 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a4b8347c-3fd5-434c-9802-d625eb9aa247 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:48.380310 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a4b8347c-3fd5-434c-9802-d625eb9aa247 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:48.380703 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a4b8347c-3fd5-434c-9802-d625eb9aa247 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:48.392768 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a4b8347c-3fd5-434c-9802-d625eb9aa247 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:48.393680 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a4b8347c-3fd5-434c-9802-d625eb9aa247 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:48.396207 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a4b8347c-3fd5-434c-9802-d625eb9aa247 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:48.453088 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-a4b8347c-3fd5-434c-9802-d625eb9aa247 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] HTTP exception thrown: Instance c6eb59b7-d1ee-442c-8142-19a88ad6a039 could not be found. Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a4b8347c-3fd5-434c-9802-d625eb9aa247 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Request method failure captured: Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 HTTP/1.1 Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJgQM9ac_nigtGLK4LZKApOXoIiTORToGrfCQJAudkDegQhaUBSbLk4jPFxqWvc7WPMryaamEsgoumiKRsUdXg4p2qo9wiVzLKc_z19LEKedgAH8Ey2iIcc4F8p1F8DcpTrJ2hLsEbdK9ktQp2Y5kAAr_EcoR2XwA8yLtIahEXP4IdE Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: X-Openstack-Nova-Api-Version: 2.20 Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 4464938aec13451f910daa714d060e46 Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-517248460 Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4464938aec13451f910daa714d060e46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4464938aec13451f910daa714d060e46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4464938aec13451f910daa714d060e46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4464938aec13451f910daa714d060e46"}]}] Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-AttachVolumeShelveTestJSON-517248460 Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 4464938aec13451f910daa714d060e46 Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-517248460 Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-AttachVolumeShelveTestJSON-517248460-project Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 1864708a7b2f4223bc8f0015c765eb0f Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-AttachVolumeShelveTestJSON-517248460-project Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: exception: Instance c6eb59b7-d1ee-442c-8142-19a88ad6a039 could not be found. Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'c6eb59b7-d1ee-442c-8142-19a88ad6a039'} Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6eb59b7-d1ee-442c-8142-19a88ad6a039 could not be found. Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6eb59b7-d1ee-442c-8142-19a88ad6a039 could not be found. Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:33:48.456191 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:33:48.461653 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:33:48.461653 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:33:48.461653 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:33:48.461653 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:33:48.461653 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:33:48.461653 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:33:48.461653 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6eb59b7-d1ee-442c-8142-19a88ad6a039 could not be found. Oct 23 01:33:48.461653 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:33:48.465912 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a4b8347c-3fd5-434c-9802-d625eb9aa247 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] Returning 404 to user: Instance c6eb59b7-d1ee-442c-8142-19a88ad6a039 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:33:48.470241 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a4b8347c-3fd5-434c-9802-d625eb9aa247 tempest-AttachVolumeShelveTestJSON-517248460 tempest-AttachVolumeShelveTestJSON-517248460-project] 10.222.0.42 "GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039" status: 404 len: 111 microversion: 2.20 time: 0.127473 Oct 23 01:33:48.488984 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2508/5093] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:33:48 2022] GET /compute/v2.1/servers/c6eb59b7-d1ee-442c-8142-19a88ad6a039 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:33:48.835341 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-830167ec-0c2c-4de0-93cf-d6052fb6f30b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:48.837551 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-830167ec-0c2c-4de0-93cf-d6052fb6f30b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 7878a5d1-1349-4cb6-abd1-519f61b97eef] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:48.856630 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-830167ec-0c2c-4de0-93cf-d6052fb6f30b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:48.857448 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-830167ec-0c2c-4de0-93cf-d6052fb6f30b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:48.861754 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-830167ec-0c2c-4de0-93cf-d6052fb6f30b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:48.862766 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-830167ec-0c2c-4de0-93cf-d6052fb6f30b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:48.863395 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-830167ec-0c2c-4de0-93cf-d6052fb6f30b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:48.863976 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-830167ec-0c2c-4de0-93cf-d6052fb6f30b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:49.828645 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-dbccefee-a65c-4071-a09e-5640792e7ca2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:49.837057 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-dbccefee-a65c-4071-a09e-5640792e7ca2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1682 microversion: 2.1 time: 1.576103 Oct 23 01:33:49.847792 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2586/5094] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:48 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1682 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:49.853217 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-13f4a199-4c25-49dc-9513-f4f26b5f7088 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:49.853993 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-13f4a199-4c25-49dc-9513-f4f26b5f7088 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 697bf9a9-687f-4d5f-a459-9ff304289577] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:49.864915 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13f4a199-4c25-49dc-9513-f4f26b5f7088 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:49.870057 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13f4a199-4c25-49dc-9513-f4f26b5f7088 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:49.870664 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13f4a199-4c25-49dc-9513-f4f26b5f7088 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:49.871521 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13f4a199-4c25-49dc-9513-f4f26b5f7088 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:49.872238 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13f4a199-4c25-49dc-9513-f4f26b5f7088 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:49.872979 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13f4a199-4c25-49dc-9513-f4f26b5f7088 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:50.209856 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-13f4a199-4c25-49dc-9513-f4f26b5f7088 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:50.217926 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-13f4a199-4c25-49dc-9513-f4f26b5f7088 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577" status: 200 len: 1297 microversion: 2.1 time: 0.373181 Oct 23 01:33:50.222636 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2587/5095] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:49 2022] GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577 => generated 1297 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:50.225510 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-830167ec-0c2c-4de0-93cf-d6052fb6f30b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:50.230779 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fbc4a8ce-7c47-40be-884b-8355f858ab4b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:50.233917 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fbc4a8ce-7c47-40be-884b-8355f858ab4b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: e3bb9493-45f6-4889-8655-222a1284b4bf] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:50.241631 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-830167ec-0c2c-4de0-93cf-d6052fb6f30b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef" status: 200 len: 1510 microversion: 2.1 time: 1.411734 Oct 23 01:33:50.245266 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fbc4a8ce-7c47-40be-884b-8355f858ab4b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:50.247927 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fbc4a8ce-7c47-40be-884b-8355f858ab4b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:50.248496 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fbc4a8ce-7c47-40be-884b-8355f858ab4b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:50.258909 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fbc4a8ce-7c47-40be-884b-8355f858ab4b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:50.259565 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fbc4a8ce-7c47-40be-884b-8355f858ab4b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:50.260076 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fbc4a8ce-7c47-40be-884b-8355f858ab4b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:50.261678 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2509/5096] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:48 2022] GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef => generated 1510 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:50.868634 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fb35a7ee-d523-4f75-8cab-fd30364a1284 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:50.869508 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-fb35a7ee-d523-4f75-8cab-fd30364a1284 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:50.884164 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fb35a7ee-d523-4f75-8cab-fd30364a1284 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:50.886510 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fb35a7ee-d523-4f75-8cab-fd30364a1284 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:50.892224 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fb35a7ee-d523-4f75-8cab-fd30364a1284 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:50.901340 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fb35a7ee-d523-4f75-8cab-fd30364a1284 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:50.901340 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fb35a7ee-d523-4f75-8cab-fd30364a1284 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:50.901340 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fb35a7ee-d523-4f75-8cab-fd30364a1284 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:51.382889 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fbc4a8ce-7c47-40be-884b-8355f858ab4b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:51.408189 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fbc4a8ce-7c47-40be-884b-8355f858ab4b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/e3bb9493-45f6-4889-8655-222a1284b4bf" status: 200 len: 1493 microversion: 2.1 time: 1.172302 Oct 23 01:33:51.408887 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2588/5097] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:50 2022] GET /compute/v2.1/servers/e3bb9493-45f6-4889-8655-222a1284b4bf => generated 1493 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:51.434174 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d7e7c069-2a07-406c-9a83-d9edfc860e58 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:51.435196 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d7e7c069-2a07-406c-9a83-d9edfc860e58 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 697bf9a9-687f-4d5f-a459-9ff304289577] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:51.443009 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d7e7c069-2a07-406c-9a83-d9edfc860e58 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:51.444219 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d7e7c069-2a07-406c-9a83-d9edfc860e58 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:51.445089 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d7e7c069-2a07-406c-9a83-d9edfc860e58 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:51.446084 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d7e7c069-2a07-406c-9a83-d9edfc860e58 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:51.446824 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d7e7c069-2a07-406c-9a83-d9edfc860e58 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:51.448867 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d7e7c069-2a07-406c-9a83-d9edfc860e58 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:51.815404 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d7e7c069-2a07-406c-9a83-d9edfc860e58 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:51.848638 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d7e7c069-2a07-406c-9a83-d9edfc860e58 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577" status: 200 len: 1297 microversion: 2.1 time: 0.435119 Oct 23 01:33:51.867862 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2589/5098] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:51 2022] GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577 => generated 1297 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:51.873359 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1a67c549-7fb1-4ab1-9313-8f8848aec321 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:51.874315 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1a67c549-7fb1-4ab1-9313-8f8848aec321 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 7878a5d1-1349-4cb6-abd1-519f61b97eef] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:51.901500 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1a67c549-7fb1-4ab1-9313-8f8848aec321 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:51.902044 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1a67c549-7fb1-4ab1-9313-8f8848aec321 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:51.903942 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1a67c549-7fb1-4ab1-9313-8f8848aec321 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:51.905180 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1a67c549-7fb1-4ab1-9313-8f8848aec321 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:51.907197 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1a67c549-7fb1-4ab1-9313-8f8848aec321 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:51.910805 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1a67c549-7fb1-4ab1-9313-8f8848aec321 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:51.931243 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-fb35a7ee-d523-4f75-8cab-fd30364a1284 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:51.949600 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fb35a7ee-d523-4f75-8cab-fd30364a1284 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1682 microversion: 2.1 time: 1.085540 Oct 23 01:33:51.954358 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2510/5099] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:50 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1682 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:33:51.975709 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-f05f9b51-e92c-4170-b82e-55c28cd293f6 req-704a9ab2-71d8-4ad0-ac7c-785e07b72860 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3bb9493-45f6-4889-8655-222a1284b4bf", "name": "network-vif-deleted", "tag": "92f0adc4-9d2b-4e74-9511-4e7cccff6235"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:33:51.997786 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-f05f9b51-e92c-4170-b82e-55c28cd293f6 req-704a9ab2-71d8-4ad0-ac7c-785e07b72860 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:51.998567 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-f05f9b51-e92c-4170-b82e-55c28cd293f6 req-704a9ab2-71d8-4ad0-ac7c-785e07b72860 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:51.999184 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-f05f9b51-e92c-4170-b82e-55c28cd293f6 req-704a9ab2-71d8-4ad0-ac7c-785e07b72860 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:52.012865 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-f05f9b51-e92c-4170-b82e-55c28cd293f6 req-704a9ab2-71d8-4ad0-ac7c-785e07b72860 service nova] Creating event network-vif-deleted:92f0adc4-9d2b-4e74-9511-4e7cccff6235 for instance e3bb9493-45f6-4889-8655-222a1284b4bf on n-h2-master-1 Oct 23 01:33:52.019126 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-f05f9b51-e92c-4170-b82e-55c28cd293f6 req-704a9ab2-71d8-4ad0-ac7c-785e07b72860 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063151 Oct 23 01:33:52.020490 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2511/5100] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:33:52.438985 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ca09fa11-334d-4344-b75c-734f9d7ba841 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:52.439840 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ca09fa11-334d-4344-b75c-734f9d7ba841 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: e3bb9493-45f6-4889-8655-222a1284b4bf] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:52.480734 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca09fa11-334d-4344-b75c-734f9d7ba841 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:52.487045 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca09fa11-334d-4344-b75c-734f9d7ba841 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:52.491199 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca09fa11-334d-4344-b75c-734f9d7ba841 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:52.494100 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca09fa11-334d-4344-b75c-734f9d7ba841 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:52.502249 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca09fa11-334d-4344-b75c-734f9d7ba841 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:52.508936 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca09fa11-334d-4344-b75c-734f9d7ba841 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:52.596158 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca09fa11-334d-4344-b75c-734f9d7ba841 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:52.596677 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca09fa11-334d-4344-b75c-734f9d7ba841 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:52.597125 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca09fa11-334d-4344-b75c-734f9d7ba841 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:52.597648 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-ca09fa11-334d-4344-b75c-734f9d7ba841 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lazy-loading 'fault' on Instance uuid e3bb9493-45f6-4889-8655-222a1284b4bf {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:33:53.407280 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ca09fa11-334d-4344-b75c-734f9d7ba841 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:53.429674 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ca09fa11-334d-4344-b75c-734f9d7ba841 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/e3bb9493-45f6-4889-8655-222a1284b4bf" status: 200 len: 1305 microversion: 2.1 time: 0.985604 Oct 23 01:33:53.443842 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2512/5101] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:52 2022] GET /compute/v2.1/servers/e3bb9493-45f6-4889-8655-222a1284b4bf => generated 1305 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:53.443842 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b6b5a0fe-4886-480b-baa4-d5868b68f051 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:53.450963 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b6b5a0fe-4886-480b-baa4-d5868b68f051 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 697bf9a9-687f-4d5f-a459-9ff304289577] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:53.472681 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b6b5a0fe-4886-480b-baa4-d5868b68f051 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:53.473591 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b6b5a0fe-4886-480b-baa4-d5868b68f051 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:53.474296 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b6b5a0fe-4886-480b-baa4-d5868b68f051 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:53.475732 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b6b5a0fe-4886-480b-baa4-d5868b68f051 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:53.477755 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b6b5a0fe-4886-480b-baa4-d5868b68f051 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:53.479124 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b6b5a0fe-4886-480b-baa4-d5868b68f051 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:53.597829 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1a67c549-7fb1-4ab1-9313-8f8848aec321 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:53.617326 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1a67c549-7fb1-4ab1-9313-8f8848aec321 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef" status: 200 len: 1510 microversion: 2.1 time: 1.745653 Oct 23 01:33:53.618923 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2590/5102] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:51 2022] GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef => generated 1510 bytes in 1750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:53.630399 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3dcacb9b-be3a-4933-a6c7-3afc3ac70e32 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:53.633494 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3dcacb9b-be3a-4933-a6c7-3afc3ac70e32 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:53.634441 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b6b5a0fe-4886-480b-baa4-d5868b68f051 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:53.648916 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3dcacb9b-be3a-4933-a6c7-3afc3ac70e32 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:53.656143 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3dcacb9b-be3a-4933-a6c7-3afc3ac70e32 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:53.656298 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b6b5a0fe-4886-480b-baa4-d5868b68f051 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577" status: 200 len: 1297 microversion: 2.1 time: 0.222809 Oct 23 01:33:53.656414 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2513/5103] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:53 2022] GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577 => generated 1297 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:53.656674 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3dcacb9b-be3a-4933-a6c7-3afc3ac70e32 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:53.657593 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3dcacb9b-be3a-4933-a6c7-3afc3ac70e32 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:53.658141 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3dcacb9b-be3a-4933-a6c7-3afc3ac70e32 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:53.659035 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3dcacb9b-be3a-4933-a6c7-3afc3ac70e32 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:54.389389 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:33:54.460056 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3f374b3c-8710-47e0-bdf3-aaee7ab34d2c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:54.461496 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3f374b3c-8710-47e0-bdf3-aaee7ab34d2c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: e3bb9493-45f6-4889-8655-222a1284b4bf] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:54.483054 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3f374b3c-8710-47e0-bdf3-aaee7ab34d2c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:54.484710 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3f374b3c-8710-47e0-bdf3-aaee7ab34d2c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:54.491584 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3f374b3c-8710-47e0-bdf3-aaee7ab34d2c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:54.505117 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3f374b3c-8710-47e0-bdf3-aaee7ab34d2c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:54.514746 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3f374b3c-8710-47e0-bdf3-aaee7ab34d2c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:54.515392 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3f374b3c-8710-47e0-bdf3-aaee7ab34d2c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:54.572083 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-3f374b3c-8710-47e0-bdf3-aaee7ab34d2c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] HTTP exception thrown: Instance e3bb9493-45f6-4889-8655-222a1284b4bf could not be found. Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3f374b3c-8710-47e0-bdf3-aaee7ab34d2c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Request method failure captured: Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/e3bb9493-45f6-4889-8655-222a1284b4bf HTTP/1.1 Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJlvTfuM9-iirX2FXe8mkTy2eWW7UhgAXbnHf6lceGN18S7lbSlaINo5EbF9-Kmi1tphVBr2Fcj8S4BVPceiAUMjh1Az0xLOZc1N90Wz0wmSyINFoBFx331KJ40smzwK1ZOJLA4k7IFyzBj3SQlZplUyTac5KUYxpNFIDY-5Uus0ZuU Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 842dcab8b48c43d7963a538d914b0b22 Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-DeleteServersTestJSON-654775470 Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/842dcab8b48c43d7963a538d914b0b22"}]}] Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-DeleteServersTestJSON-654775470 Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 842dcab8b48c43d7963a538d914b0b22 Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-DeleteServersTestJSON-654775470 Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-DeleteServersTestJSON-654775470-project Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 634bed7898c24baca6ba00392d49eea1 Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-DeleteServersTestJSON-654775470-project Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: exception: Instance e3bb9493-45f6-4889-8655-222a1284b4bf could not be found. Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'e3bb9493-45f6-4889-8655-222a1284b4bf'} Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3bb9493-45f6-4889-8655-222a1284b4bf could not be found. Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3bb9493-45f6-4889-8655-222a1284b4bf could not be found. Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:33:54.580705 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:33:54.585669 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:33:54.585669 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:33:54.585669 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:33:54.585669 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:33:54.585669 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:33:54.585669 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3bb9493-45f6-4889-8655-222a1284b4bf could not be found. Oct 23 01:33:54.585669 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:33:54.585669 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3f374b3c-8710-47e0-bdf3-aaee7ab34d2c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Returning 404 to user: Instance e3bb9493-45f6-4889-8655-222a1284b4bf could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:33:54.591104 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3f374b3c-8710-47e0-bdf3-aaee7ab34d2c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/e3bb9493-45f6-4889-8655-222a1284b4bf" status: 404 len: 111 microversion: 2.1 time: 0.138139 Oct 23 01:33:54.592801 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2514/5104] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:54 2022] GET /compute/v2.1/servers/e3bb9493-45f6-4889-8655-222a1284b4bf => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:33:54.642724 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-abfa2719-9f5b-4dbe-9bf1-6f0aadf4d0d4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:54.643353 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-abfa2719-9f5b-4dbe-9bf1-6f0aadf4d0d4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 7878a5d1-1349-4cb6-abd1-519f61b97eef] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:54.656705 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-abfa2719-9f5b-4dbe-9bf1-6f0aadf4d0d4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:54.657215 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-abfa2719-9f5b-4dbe-9bf1-6f0aadf4d0d4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:54.657654 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-abfa2719-9f5b-4dbe-9bf1-6f0aadf4d0d4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:54.666961 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-abfa2719-9f5b-4dbe-9bf1-6f0aadf4d0d4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:54.670696 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-abfa2719-9f5b-4dbe-9bf1-6f0aadf4d0d4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:54.670696 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-abfa2719-9f5b-4dbe-9bf1-6f0aadf4d0d4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:54.838263 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3dcacb9b-be3a-4933-a6c7-3afc3ac70e32 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:54.855403 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3dcacb9b-be3a-4933-a6c7-3afc3ac70e32 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1682 microversion: 2.1 time: 1.233913 Oct 23 01:33:54.856134 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2591/5105] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:53 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1682 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:54.873874 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-92bac96c-fe97-4e4d-903b-cfe3ba676faa tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:54.874820 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-92bac96c-fe97-4e4d-903b-cfe3ba676faa tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 697bf9a9-687f-4d5f-a459-9ff304289577] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:54.895736 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92bac96c-fe97-4e4d-903b-cfe3ba676faa tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:54.895736 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92bac96c-fe97-4e4d-903b-cfe3ba676faa tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:54.895736 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92bac96c-fe97-4e4d-903b-cfe3ba676faa tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:54.895736 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92bac96c-fe97-4e4d-903b-cfe3ba676faa tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:54.895736 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92bac96c-fe97-4e4d-903b-cfe3ba676faa tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:54.895736 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92bac96c-fe97-4e4d-903b-cfe3ba676faa tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:55.643004 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=8 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:33:55.885533 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-92bac96c-fe97-4e4d-903b-cfe3ba676faa tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:55.899959 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-92bac96c-fe97-4e4d-903b-cfe3ba676faa tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577" status: 200 len: 1365 microversion: 2.1 time: 1.039814 Oct 23 01:33:55.902643 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2592/5106] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:54 2022] GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577 => generated 1365 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:55.924622 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-80f07e91-ea9f-4393-8eba-7d2c326923c1 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1666622504", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "ba696604-5fcc-4b2d-9bf0-ca27f90a0725"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:33:56.010977 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-80f07e91-ea9f-4393-8eba-7d2c326923c1 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] validate_networks() for [('ba696604-5fcc-4b2d-9bf0-ca27f90a0725', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:33:56.047968 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-abfa2719-9f5b-4dbe-9bf1-6f0aadf4d0d4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:56.076038 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-abfa2719-9f5b-4dbe-9bf1-6f0aadf4d0d4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef" status: 200 len: 1510 microversion: 2.1 time: 1.436730 Oct 23 01:33:56.077423 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2515/5107] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:54 2022] GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef => generated 1510 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:56.091107 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fea2d622-d41b-4301-ae14-9b44f5d08782 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:56.096532 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-fea2d622-d41b-4301-ae14-9b44f5d08782 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:56.118794 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fea2d622-d41b-4301-ae14-9b44f5d08782 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:56.119330 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fea2d622-d41b-4301-ae14-9b44f5d08782 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:56.125078 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fea2d622-d41b-4301-ae14-9b44f5d08782 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:56.126946 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fea2d622-d41b-4301-ae14-9b44f5d08782 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:56.127444 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fea2d622-d41b-4301-ae14-9b44f5d08782 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:56.133567 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fea2d622-d41b-4301-ae14-9b44f5d08782 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:56.862328 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-fea2d622-d41b-4301-ae14-9b44f5d08782 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:56.878057 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fea2d622-d41b-4301-ae14-9b44f5d08782 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1682 microversion: 2.1 time: 0.798496 Oct 23 01:33:56.879029 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2516/5108] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:56 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1682 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:56.936754 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-22a8c665-5e0e-478e-aa32-4cfe8f092970 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:56.937823 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-22a8c665-5e0e-478e-aa32-4cfe8f092970 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 697bf9a9-687f-4d5f-a459-9ff304289577] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:56.954518 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-22a8c665-5e0e-478e-aa32-4cfe8f092970 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:56.955941 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-22a8c665-5e0e-478e-aa32-4cfe8f092970 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:56.957143 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-22a8c665-5e0e-478e-aa32-4cfe8f092970 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:56.960324 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-22a8c665-5e0e-478e-aa32-4cfe8f092970 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:56.961006 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-22a8c665-5e0e-478e-aa32-4cfe8f092970 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:56.965936 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-22a8c665-5e0e-478e-aa32-4cfe8f092970 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:58.247982 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-22a8c665-5e0e-478e-aa32-4cfe8f092970 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:58.267004 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-22a8c665-5e0e-478e-aa32-4cfe8f092970 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577" status: 200 len: 1365 microversion: 2.1 time: 1.337586 Oct 23 01:33:58.285450 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2517/5109] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:56 2022] GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577 => generated 1365 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:58.298178 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e3adb6bd-867f-47dd-8498-846c137877b6 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:58.304843 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e3adb6bd-867f-47dd-8498-846c137877b6 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 7878a5d1-1349-4cb6-abd1-519f61b97eef] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:58.328888 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e3adb6bd-867f-47dd-8498-846c137877b6 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:58.331910 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e3adb6bd-867f-47dd-8498-846c137877b6 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:58.333134 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e3adb6bd-867f-47dd-8498-846c137877b6 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:58.337117 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e3adb6bd-867f-47dd-8498-846c137877b6 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:58.342180 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e3adb6bd-867f-47dd-8498-846c137877b6 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:58.342923 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e3adb6bd-867f-47dd-8498-846c137877b6 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:58.400494 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=100 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:33:58.530358 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-80f07e91-ea9f-4393-8eba-7d2c326923c1 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:33:58.530952 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-80f07e91-ea9f-4393-8eba-7d2c326923c1 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:33:58.531293 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-80f07e91-ea9f-4393-8eba-7d2c326923c1 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:33:58.531705 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-80f07e91-ea9f-4393-8eba-7d2c326923c1 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:33:58.532127 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-80f07e91-ea9f-4393-8eba-7d2c326923c1 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:33:58.549787 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-80f07e91-ea9f-4393-8eba-7d2c326923c1 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:58.550584 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-80f07e91-ea9f-4393-8eba-7d2c326923c1 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:58.551026 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-80f07e91-ea9f-4393-8eba-7d2c326923c1 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:58.554896 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-80f07e91-ea9f-4393-8eba-7d2c326923c1 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:58.555383 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-80f07e91-ea9f-4393-8eba-7d2c326923c1 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:58.556220 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-80f07e91-ea9f-4393-8eba-7d2c326923c1 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:58.604505 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-80f07e91-ea9f-4393-8eba-7d2c326923c1 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Getting quotas for project 842dcab8b48c43d7963a538d914b0b22. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:33:58.633720 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-80f07e91-ea9f-4393-8eba-7d2c326923c1 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Getting quotas for user 634bed7898c24baca6ba00392d49eea1 and project 842dcab8b48c43d7963a538d914b0b22. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:33:58.636729 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:33:58.640721 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-80f07e91-ea9f-4393-8eba-7d2c326923c1 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:33:58.650022 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-80f07e91-ea9f-4393-8eba-7d2c326923c1 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:33:58.929508 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-80f07e91-ea9f-4393-8eba-7d2c326923c1 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.014699 Oct 23 01:33:58.930774 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2593/5110] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:33:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 3017 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:33:58.941539 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7fb57082-d58e-4ff8-af5c-8f6c3cd60a3e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:58.948713 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7fb57082-d58e-4ff8-af5c-8f6c3cd60a3e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:58.961261 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7fb57082-d58e-4ff8-af5c-8f6c3cd60a3e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:58.961760 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7fb57082-d58e-4ff8-af5c-8f6c3cd60a3e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:58.962229 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7fb57082-d58e-4ff8-af5c-8f6c3cd60a3e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:58.962938 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7fb57082-d58e-4ff8-af5c-8f6c3cd60a3e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:58.963395 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7fb57082-d58e-4ff8-af5c-8f6c3cd60a3e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:58.963821 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7fb57082-d58e-4ff8-af5c-8f6c3cd60a3e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:59.219144 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e3adb6bd-867f-47dd-8498-846c137877b6 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:59.232073 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e3adb6bd-867f-47dd-8498-846c137877b6 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef" status: 200 len: 1510 microversion: 2.1 time: 0.945058 Oct 23 01:33:59.246468 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2518/5111] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:58 2022] GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef => generated 1510 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:59.258878 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7a413e38-5d79-4cd3-b383-0e11c25e9de4 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:59.260817 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7a413e38-5d79-4cd3-b383-0e11c25e9de4 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:59.426313 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7a413e38-5d79-4cd3-b383-0e11c25e9de4 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:59.434079 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7a413e38-5d79-4cd3-b383-0e11c25e9de4 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 200 len: 1215 microversion: 2.1 time: 0.186160 Oct 23 01:33:59.435278 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2519/5112] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:59 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 1215 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:33:59.440479 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1ee5d3dd-5064-494b-9136-22a16ea12414 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:33:59.449047 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1ee5d3dd-5064-494b-9136-22a16ea12414 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 697bf9a9-687f-4d5f-a459-9ff304289577] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:33:59.457641 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1ee5d3dd-5064-494b-9136-22a16ea12414 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:59.463437 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1ee5d3dd-5064-494b-9136-22a16ea12414 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:59.464129 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1ee5d3dd-5064-494b-9136-22a16ea12414 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:59.465057 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1ee5d3dd-5064-494b-9136-22a16ea12414 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:33:59.475109 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1ee5d3dd-5064-494b-9136-22a16ea12414 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:33:59.475934 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1ee5d3dd-5064-494b-9136-22a16ea12414 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:33:59.907162 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7fb57082-d58e-4ff8-af5c-8f6c3cd60a3e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:33:59.923284 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7fb57082-d58e-4ff8-af5c-8f6c3cd60a3e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1682 microversion: 2.1 time: 0.986845 Oct 23 01:33:59.924221 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2594/5113] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:58 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1682 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:00.083904 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1ee5d3dd-5064-494b-9136-22a16ea12414 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:00.093230 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1ee5d3dd-5064-494b-9136-22a16ea12414 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577" status: 200 len: 1365 microversion: 2.1 time: 0.656678 Oct 23 01:34:00.097627 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2520/5114] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:33:59 2022] GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577 => generated 1365 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:00.157547 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-184f62d6-fa07-4ed4-ae62-0bcd28d24ad4 req-ffb5a78e-9c4e-4c15-ae65-9b0551a3a373 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "697bf9a9-687f-4d5f-a459-9ff304289577", "tag": "a3a4e1b5-5224-4f9b-857b-863bfc9c13e0"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:34:00.180728 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-184f62d6-fa07-4ed4-ae62-0bcd28d24ad4 req-ffb5a78e-9c4e-4c15-ae65-9b0551a3a373 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:00.192791 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-184f62d6-fa07-4ed4-ae62-0bcd28d24ad4 req-ffb5a78e-9c4e-4c15-ae65-9b0551a3a373 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:00.201256 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-184f62d6-fa07-4ed4-ae62-0bcd28d24ad4 req-ffb5a78e-9c4e-4c15-ae65-9b0551a3a373 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:00.236492 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-184f62d6-fa07-4ed4-ae62-0bcd28d24ad4 req-ffb5a78e-9c4e-4c15-ae65-9b0551a3a373 service nova] Creating event network-changed:a3a4e1b5-5224-4f9b-857b-863bfc9c13e0 for instance 697bf9a9-687f-4d5f-a459-9ff304289577 on n-h1-master-1 Oct 23 01:34:00.254212 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-184f62d6-fa07-4ed4-ae62-0bcd28d24ad4 req-ffb5a78e-9c4e-4c15-ae65-9b0551a3a373 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100179 Oct 23 01:34:00.260249 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-52c06e8c-3dd3-4e84-b546-31fc8afdd1e4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:00.261470 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-52c06e8c-3dd3-4e84-b546-31fc8afdd1e4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 7878a5d1-1349-4cb6-abd1-519f61b97eef] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:00.265139 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2595/5115] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:34:00.270971 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52c06e8c-3dd3-4e84-b546-31fc8afdd1e4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:00.278386 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52c06e8c-3dd3-4e84-b546-31fc8afdd1e4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:00.279094 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52c06e8c-3dd3-4e84-b546-31fc8afdd1e4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:00.280009 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52c06e8c-3dd3-4e84-b546-31fc8afdd1e4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:00.280627 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52c06e8c-3dd3-4e84-b546-31fc8afdd1e4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:00.281209 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52c06e8c-3dd3-4e84-b546-31fc8afdd1e4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:00.463136 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e9f8881f-0e00-45ad-ab51-8ec8e0878a36 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:00.463764 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e9f8881f-0e00-45ad-ab51-8ec8e0878a36 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:00.476812 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9f8881f-0e00-45ad-ab51-8ec8e0878a36 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:00.481429 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9f8881f-0e00-45ad-ab51-8ec8e0878a36 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:00.481429 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9f8881f-0e00-45ad-ab51-8ec8e0878a36 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:00.481429 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9f8881f-0e00-45ad-ab51-8ec8e0878a36 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:00.481429 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9f8881f-0e00-45ad-ab51-8ec8e0878a36 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:00.481429 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9f8881f-0e00-45ad-ab51-8ec8e0878a36 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:01.245247 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e9f8881f-0e00-45ad-ab51-8ec8e0878a36 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:01.257310 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e9f8881f-0e00-45ad-ab51-8ec8e0878a36 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 200 len: 1219 microversion: 2.1 time: 0.798483 Oct 23 01:34:01.278427 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2596/5116] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:00 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 1219 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:01.283680 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-88a8cfb0-74dd-4d9d-ba1e-0960ba8272e3 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:01.284591 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-88a8cfb0-74dd-4d9d-ba1e-0960ba8272e3 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:01.293212 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-88a8cfb0-74dd-4d9d-ba1e-0960ba8272e3 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:01.294142 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-88a8cfb0-74dd-4d9d-ba1e-0960ba8272e3 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:01.294748 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-88a8cfb0-74dd-4d9d-ba1e-0960ba8272e3 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:01.297314 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-88a8cfb0-74dd-4d9d-ba1e-0960ba8272e3 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:01.298055 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-88a8cfb0-74dd-4d9d-ba1e-0960ba8272e3 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:01.298658 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-88a8cfb0-74dd-4d9d-ba1e-0960ba8272e3 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:01.815846 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-52c06e8c-3dd3-4e84-b546-31fc8afdd1e4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:01.815846 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-52c06e8c-3dd3-4e84-b546-31fc8afdd1e4 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef" status: 200 len: 1510 microversion: 2.1 time: 1.386538 Oct 23 01:34:01.815846 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2521/5117] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:00 2022] GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef => generated 1510 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:01.815846 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fcfe7441-ebba-46d9-9dfe-9bfffd71059b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:01.815846 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-fcfe7441-ebba-46d9-9dfe-9bfffd71059b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 697bf9a9-687f-4d5f-a459-9ff304289577] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:01.815846 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fcfe7441-ebba-46d9-9dfe-9bfffd71059b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:01.815846 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fcfe7441-ebba-46d9-9dfe-9bfffd71059b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:01.815846 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fcfe7441-ebba-46d9-9dfe-9bfffd71059b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:01.815846 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fcfe7441-ebba-46d9-9dfe-9bfffd71059b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:01.815846 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fcfe7441-ebba-46d9-9dfe-9bfffd71059b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:01.815846 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fcfe7441-ebba-46d9-9dfe-9bfffd71059b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:01.924361 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-88a8cfb0-74dd-4d9d-ba1e-0960ba8272e3 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:01.934816 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-88a8cfb0-74dd-4d9d-ba1e-0960ba8272e3 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1682 microversion: 2.1 time: 0.654946 Oct 23 01:34:01.950002 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2597/5118] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:01 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1682 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:01.986754 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-fcfe7441-ebba-46d9-9dfe-9bfffd71059b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:01.997089 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fcfe7441-ebba-46d9-9dfe-9bfffd71059b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577" status: 200 len: 1365 microversion: 2.1 time: 0.346682 Oct 23 01:34:01.998307 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2522/5119] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:01 2022] GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577 => generated 1365 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:02.287198 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2b46c517-3217-4599-9f1c-f58f5c98966a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:02.287922 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2b46c517-3217-4599-9f1c-f58f5c98966a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:02.298989 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2b46c517-3217-4599-9f1c-f58f5c98966a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:02.299382 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2b46c517-3217-4599-9f1c-f58f5c98966a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:02.300913 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2b46c517-3217-4599-9f1c-f58f5c98966a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:02.303597 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2b46c517-3217-4599-9f1c-f58f5c98966a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:02.305128 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2b46c517-3217-4599-9f1c-f58f5c98966a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:02.306725 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2b46c517-3217-4599-9f1c-f58f5c98966a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:02.459386 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2b46c517-3217-4599-9f1c-f58f5c98966a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:02.467127 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:34:02.478436 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2b46c517-3217-4599-9f1c-f58f5c98966a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 200 len: 1267 microversion: 2.1 time: 0.186465 Oct 23 01:34:02.481755 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2598/5120] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:02 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 1267 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:02.675767 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a0c5c0ab-3676-4647-b365-bea5e125f840 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:02.676559 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a0c5c0ab-3676-4647-b365-bea5e125f840 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 7878a5d1-1349-4cb6-abd1-519f61b97eef] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:02.690274 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a0c5c0ab-3676-4647-b365-bea5e125f840 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:02.691340 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a0c5c0ab-3676-4647-b365-bea5e125f840 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:02.698675 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a0c5c0ab-3676-4647-b365-bea5e125f840 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:02.698675 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a0c5c0ab-3676-4647-b365-bea5e125f840 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:02.700047 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a0c5c0ab-3676-4647-b365-bea5e125f840 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:02.700047 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a0c5c0ab-3676-4647-b365-bea5e125f840 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:02.963565 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9f1e7280-e96d-4170-9cac-87da11ec6fde tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:02.964374 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9f1e7280-e96d-4170-9cac-87da11ec6fde tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:02.987357 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f1e7280-e96d-4170-9cac-87da11ec6fde tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:02.987885 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f1e7280-e96d-4170-9cac-87da11ec6fde tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:02.988375 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f1e7280-e96d-4170-9cac-87da11ec6fde tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:02.994682 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f1e7280-e96d-4170-9cac-87da11ec6fde tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:02.995254 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f1e7280-e96d-4170-9cac-87da11ec6fde tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:02.995941 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f1e7280-e96d-4170-9cac-87da11ec6fde tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:03.907157 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a0c5c0ab-3676-4647-b365-bea5e125f840 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:03.922952 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a0c5c0ab-3676-4647-b365-bea5e125f840 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef" status: 200 len: 1510 microversion: 2.1 time: 1.250115 Oct 23 01:34:03.923598 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2523/5121] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:02 2022] GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef => generated 1510 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:03.957151 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b945deb5-5e2b-4168-953a-bb6fd5a57191 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:03.957930 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b945deb5-5e2b-4168-953a-bb6fd5a57191 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 697bf9a9-687f-4d5f-a459-9ff304289577] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:03.996662 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b945deb5-5e2b-4168-953a-bb6fd5a57191 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:04.004144 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b945deb5-5e2b-4168-953a-bb6fd5a57191 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:04.004144 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b945deb5-5e2b-4168-953a-bb6fd5a57191 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:04.004144 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b945deb5-5e2b-4168-953a-bb6fd5a57191 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:04.004144 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b945deb5-5e2b-4168-953a-bb6fd5a57191 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:04.004144 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b945deb5-5e2b-4168-953a-bb6fd5a57191 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:04.703763 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9f1e7280-e96d-4170-9cac-87da11ec6fde tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:04.713707 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9f1e7280-e96d-4170-9cac-87da11ec6fde tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1682 microversion: 2.1 time: 1.758508 Oct 23 01:34:04.718588 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2599/5122] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:02 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1682 bytes in 1764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:34:04.750299 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ccc5c501-0a5e-4b3c-bcef-db959bf19cc8 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:04.756170 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ccc5c501-0a5e-4b3c-bcef-db959bf19cc8 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:04.773222 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ccc5c501-0a5e-4b3c-bcef-db959bf19cc8 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:04.775198 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ccc5c501-0a5e-4b3c-bcef-db959bf19cc8 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:04.776183 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ccc5c501-0a5e-4b3c-bcef-db959bf19cc8 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:04.780967 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ccc5c501-0a5e-4b3c-bcef-db959bf19cc8 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:04.786970 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ccc5c501-0a5e-4b3c-bcef-db959bf19cc8 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:04.786970 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ccc5c501-0a5e-4b3c-bcef-db959bf19cc8 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:04.842871 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b945deb5-5e2b-4168-953a-bb6fd5a57191 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:04.854790 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b945deb5-5e2b-4168-953a-bb6fd5a57191 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577" status: 200 len: 1365 microversion: 2.1 time: 0.930077 Oct 23 01:34:04.865585 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2524/5123] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:03 2022] GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577 => generated 1365 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:04.950070 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9ebe477c-3bce-45b0-8ef5-88da5e518f3f tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:04.956657 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9ebe477c-3bce-45b0-8ef5-88da5e518f3f tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 7878a5d1-1349-4cb6-abd1-519f61b97eef] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:04.966549 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9ebe477c-3bce-45b0-8ef5-88da5e518f3f tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:04.967312 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9ebe477c-3bce-45b0-8ef5-88da5e518f3f tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:04.968085 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9ebe477c-3bce-45b0-8ef5-88da5e518f3f tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:04.969180 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9ebe477c-3bce-45b0-8ef5-88da5e518f3f tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:04.969933 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9ebe477c-3bce-45b0-8ef5-88da5e518f3f tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:04.970505 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9ebe477c-3bce-45b0-8ef5-88da5e518f3f tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:05.162722 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ccc5c501-0a5e-4b3c-bcef-db959bf19cc8 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:05.178195 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ccc5c501-0a5e-4b3c-bcef-db959bf19cc8 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 200 len: 1273 microversion: 2.1 time: 0.456829 Oct 23 01:34:05.181534 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2600/5124] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:04 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 1273 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:05.748049 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-345fe3d3-7eb9-49f9-a649-be7ac59aff47 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:05.748714 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-345fe3d3-7eb9-49f9-a649-be7ac59aff47 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:05.760531 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-345fe3d3-7eb9-49f9-a649-be7ac59aff47 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:05.768291 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-345fe3d3-7eb9-49f9-a649-be7ac59aff47 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:05.768291 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-345fe3d3-7eb9-49f9-a649-be7ac59aff47 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:05.768291 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-345fe3d3-7eb9-49f9-a649-be7ac59aff47 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:05.768291 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-345fe3d3-7eb9-49f9-a649-be7ac59aff47 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:05.768291 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-345fe3d3-7eb9-49f9-a649-be7ac59aff47 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:05.768812 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9ebe477c-3bce-45b0-8ef5-88da5e518f3f tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:05.777089 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9ebe477c-3bce-45b0-8ef5-88da5e518f3f tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef" status: 200 len: 1510 microversion: 2.1 time: 0.831719 Oct 23 01:34:05.786057 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2525/5125] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:04 2022] GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef => generated 1510 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:05.894006 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ee85161e-a86c-4f6a-ba2a-ef382583577a tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:05.900286 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ee85161e-a86c-4f6a-ba2a-ef382583577a tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 697bf9a9-687f-4d5f-a459-9ff304289577] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:05.904688 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee85161e-a86c-4f6a-ba2a-ef382583577a tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:05.910694 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee85161e-a86c-4f6a-ba2a-ef382583577a tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:05.911857 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee85161e-a86c-4f6a-ba2a-ef382583577a tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:05.912734 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee85161e-a86c-4f6a-ba2a-ef382583577a tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:05.918745 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee85161e-a86c-4f6a-ba2a-ef382583577a tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:05.919347 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee85161e-a86c-4f6a-ba2a-ef382583577a tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:07.359445 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ee85161e-a86c-4f6a-ba2a-ef382583577a tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:07.387687 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ee85161e-a86c-4f6a-ba2a-ef382583577a tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577" status: 200 len: 1365 microversion: 2.1 time: 1.504173 Oct 23 01:34:07.388822 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2526/5126] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:05 2022] GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577 => generated 1365 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:07.394639 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-96ff7e67-1065-44e1-b150-8cd957ee3ea7 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:07.395499 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-96ff7e67-1065-44e1-b150-8cd957ee3ea7 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:07.410392 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-96ff7e67-1065-44e1-b150-8cd957ee3ea7 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:07.411847 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-96ff7e67-1065-44e1-b150-8cd957ee3ea7 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:07.413093 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-96ff7e67-1065-44e1-b150-8cd957ee3ea7 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:07.414473 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-96ff7e67-1065-44e1-b150-8cd957ee3ea7 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:07.415439 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-96ff7e67-1065-44e1-b150-8cd957ee3ea7 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:07.416087 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-96ff7e67-1065-44e1-b150-8cd957ee3ea7 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:07.432296 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-345fe3d3-7eb9-49f9-a649-be7ac59aff47 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:07.443185 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-345fe3d3-7eb9-49f9-a649-be7ac59aff47 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1682 microversion: 2.1 time: 1.699587 Oct 23 01:34:07.457836 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2601/5127] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:05 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1682 bytes in 1715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:34:07.472087 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e8706148-2242-4338-9d71-0d2d7311fb12 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:07.474325 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e8706148-2242-4338-9d71-0d2d7311fb12 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 7878a5d1-1349-4cb6-abd1-519f61b97eef] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:07.487772 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e8706148-2242-4338-9d71-0d2d7311fb12 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:07.487772 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e8706148-2242-4338-9d71-0d2d7311fb12 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:07.487772 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e8706148-2242-4338-9d71-0d2d7311fb12 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:07.487772 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e8706148-2242-4338-9d71-0d2d7311fb12 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:07.487772 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e8706148-2242-4338-9d71-0d2d7311fb12 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:07.487772 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e8706148-2242-4338-9d71-0d2d7311fb12 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:07.930723 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-96ff7e67-1065-44e1-b150-8cd957ee3ea7 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:07.947484 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-96ff7e67-1065-44e1-b150-8cd957ee3ea7 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 200 len: 1315 microversion: 2.1 time: 0.556178 Oct 23 01:34:07.947484 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2527/5128] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:07 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 1315 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:07.954040 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e8706148-2242-4338-9d71-0d2d7311fb12 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:07.963446 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e8706148-2242-4338-9d71-0d2d7311fb12 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef" status: 200 len: 1487 microversion: 2.1 time: 0.504108 Oct 23 01:34:07.975201 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2602/5129] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:07 2022] GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef => generated 1487 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:07.976823 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-c45b9349-1ac2-423e-9f1a-be0fe078902a req-972dde90-5572-418a-9ecd-0155c1fbffba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "697bf9a9-687f-4d5f-a459-9ff304289577", "name": "network-vif-plugged", "status": "completed", "tag": "a3a4e1b5-5224-4f9b-857b-863bfc9c13e0"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:34:07.991815 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=70 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:34:07.999765 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-deb4269b-e3b6-490e-bebe-87553e393735 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-56491393"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:34:08.002489 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-deb4269b-e3b6-490e-bebe-87553e393735 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 7878a5d1-1349-4cb6-abd1-519f61b97eef] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:08.007468 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-c45b9349-1ac2-423e-9f1a-be0fe078902a req-972dde90-5572-418a-9ecd-0155c1fbffba service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:08.010589 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-c45b9349-1ac2-423e-9f1a-be0fe078902a req-972dde90-5572-418a-9ecd-0155c1fbffba service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:08.014165 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-c45b9349-1ac2-423e-9f1a-be0fe078902a req-972dde90-5572-418a-9ecd-0155c1fbffba service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:08.022178 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-deb4269b-e3b6-490e-bebe-87553e393735 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:08.029687 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-deb4269b-e3b6-490e-bebe-87553e393735 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:08.030358 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-deb4269b-e3b6-490e-bebe-87553e393735 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:08.038357 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-deb4269b-e3b6-490e-bebe-87553e393735 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:08.038863 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-deb4269b-e3b6-490e-bebe-87553e393735 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:08.039301 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-deb4269b-e3b6-490e-bebe-87553e393735 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:08.083817 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-c45b9349-1ac2-423e-9f1a-be0fe078902a req-972dde90-5572-418a-9ecd-0155c1fbffba service nova] Creating event network-vif-plugged:a3a4e1b5-5224-4f9b-857b-863bfc9c13e0 for instance 697bf9a9-687f-4d5f-a459-9ff304289577 on n-h1-master-1 Oct 23 01:34:08.093456 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-c45b9349-1ac2-423e-9f1a-be0fe078902a req-972dde90-5572-418a-9ecd-0155c1fbffba service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144879 Oct 23 01:34:08.094840 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2528/5130] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:34:08.276290 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-deb4269b-e3b6-490e-bebe-87553e393735 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "PUT /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef" status: 200 len: 1058 microversion: 2.1 time: 0.281204 Oct 23 01:34:08.280364 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2603/5131] 10.222.0.42 () {60 vars in 1256 bytes} [Sun Oct 23 01:34:07 2022] PUT /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef => generated 1058 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:34:08.302244 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-abbc5a20-efb3-45ed-b3ea-32d7046d00cf tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:08.303895 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-abbc5a20-efb3-45ed-b3ea-32d7046d00cf tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 7878a5d1-1349-4cb6-abd1-519f61b97eef] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:08.324366 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-abbc5a20-efb3-45ed-b3ea-32d7046d00cf tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:08.324876 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-abbc5a20-efb3-45ed-b3ea-32d7046d00cf tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:08.325322 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-abbc5a20-efb3-45ed-b3ea-32d7046d00cf tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:08.326068 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-abbc5a20-efb3-45ed-b3ea-32d7046d00cf tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:08.326540 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-abbc5a20-efb3-45ed-b3ea-32d7046d00cf tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:08.326971 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-abbc5a20-efb3-45ed-b3ea-32d7046d00cf tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:08.417345 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7c62868f-c801-41a6-b093-2f4efeb7de44 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:08.418210 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7c62868f-c801-41a6-b093-2f4efeb7de44 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 697bf9a9-687f-4d5f-a459-9ff304289577] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:08.431228 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c62868f-c801-41a6-b093-2f4efeb7de44 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:08.431708 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c62868f-c801-41a6-b093-2f4efeb7de44 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:08.432879 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c62868f-c801-41a6-b093-2f4efeb7de44 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:08.437690 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c62868f-c801-41a6-b093-2f4efeb7de44 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:08.438100 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c62868f-c801-41a6-b093-2f4efeb7de44 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:08.438730 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c62868f-c801-41a6-b093-2f4efeb7de44 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:08.575344 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:34:08.634674 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=6 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:34:08.812952 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-abbc5a20-efb3-45ed-b3ea-32d7046d00cf tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:08.823842 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-abbc5a20-efb3-45ed-b3ea-32d7046d00cf tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef" status: 200 len: 1485 microversion: 2.1 time: 0.527478 Oct 23 01:34:08.853061 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2529/5132] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:08 2022] GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef => generated 1485 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:08.858725 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-90c95649-2830-4f17-a88a-ed6125215694 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:08.859596 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-90c95649-2830-4f17-a88a-ed6125215694 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:08.872895 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-90c95649-2830-4f17-a88a-ed6125215694 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:08.875394 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-90c95649-2830-4f17-a88a-ed6125215694 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:08.880483 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-90c95649-2830-4f17-a88a-ed6125215694 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:08.881712 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-90c95649-2830-4f17-a88a-ed6125215694 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:08.882438 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-90c95649-2830-4f17-a88a-ed6125215694 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:08.883083 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-90c95649-2830-4f17-a88a-ed6125215694 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:09.089847 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7c62868f-c801-41a6-b093-2f4efeb7de44 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:09.122835 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7c62868f-c801-41a6-b093-2f4efeb7de44 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577" status: 200 len: 1365 microversion: 2.1 time: 0.709330 Oct 23 01:34:09.126116 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2604/5133] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:08 2022] GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577 => generated 1365 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:34:09.138327 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-301d0346-02f8-40e2-830e-a9479d8dd9a9 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:09.144253 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-301d0346-02f8-40e2-830e-a9479d8dd9a9 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 7878a5d1-1349-4cb6-abd1-519f61b97eef] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:09.164519 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-301d0346-02f8-40e2-830e-a9479d8dd9a9 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:09.165929 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-301d0346-02f8-40e2-830e-a9479d8dd9a9 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:09.166503 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-301d0346-02f8-40e2-830e-a9479d8dd9a9 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:09.167424 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-301d0346-02f8-40e2-830e-a9479d8dd9a9 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:09.167968 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-301d0346-02f8-40e2-830e-a9479d8dd9a9 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:09.168484 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-301d0346-02f8-40e2-830e-a9479d8dd9a9 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:09.267255 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-90c95649-2830-4f17-a88a-ed6125215694 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:09.279203 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-90c95649-2830-4f17-a88a-ed6125215694 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1669 microversion: 2.1 time: 0.434636 Oct 23 01:34:09.280301 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2530/5134] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:08 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1669 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:09.297574 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-627d39bc-c64c-4a76-b515-e5ede29e84bc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:09.300515 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-627d39bc-c64c-4a76-b515-e5ede29e84bc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:09.316751 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-627d39bc-c64c-4a76-b515-e5ede29e84bc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:09.327081 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-627d39bc-c64c-4a76-b515-e5ede29e84bc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:09.327081 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-627d39bc-c64c-4a76-b515-e5ede29e84bc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:09.327081 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-627d39bc-c64c-4a76-b515-e5ede29e84bc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:09.332142 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-627d39bc-c64c-4a76-b515-e5ede29e84bc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:09.332538 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-627d39bc-c64c-4a76-b515-e5ede29e84bc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:09.430615 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:34:09.632729 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-301d0346-02f8-40e2-830e-a9479d8dd9a9 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:09.646679 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-301d0346-02f8-40e2-830e-a9479d8dd9a9 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef" status: 200 len: 1485 microversion: 2.1 time: 0.519094 Oct 23 01:34:09.662651 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2605/5135] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:09 2022] GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef => generated 1485 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:09.676153 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2eeb2b94-4126-4df5-b766-2e66fd833c9c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:09.685131 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2eeb2b94-4126-4df5-b766-2e66fd833c9c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:09.685131 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2eeb2b94-4126-4df5-b766-2e66fd833c9c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:09.685131 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2eeb2b94-4126-4df5-b766-2e66fd833c9c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:09.685131 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2eeb2b94-4126-4df5-b766-2e66fd833c9c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:09.685131 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2eeb2b94-4126-4df5-b766-2e66fd833c9c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:09.685677 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2eeb2b94-4126-4df5-b766-2e66fd833c9c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:09.686044 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2eeb2b94-4126-4df5-b766-2e66fd833c9c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:10.098777 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-627d39bc-c64c-4a76-b515-e5ede29e84bc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:10.109621 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-627d39bc-c64c-4a76-b515-e5ede29e84bc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 200 len: 1315 microversion: 2.1 time: 0.827661 Oct 23 01:34:10.114410 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2531/5136] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:09 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 1315 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:10.163111 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2eeb2b94-4126-4df5-b766-2e66fd833c9c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:10.175199 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2eeb2b94-4126-4df5-b766-2e66fd833c9c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1669 microversion: 2.1 time: 0.510505 Oct 23 01:34:10.177851 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2606/5137] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:09 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1669 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:10.185457 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-89857d68-f4d2-4839-9135-f86db8d2efde tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:10.186293 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-89857d68-f4d2-4839-9135-f86db8d2efde tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 7878a5d1-1349-4cb6-abd1-519f61b97eef] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:10.196024 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-89857d68-f4d2-4839-9135-f86db8d2efde tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:10.196968 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-89857d68-f4d2-4839-9135-f86db8d2efde tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:10.197409 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-89857d68-f4d2-4839-9135-f86db8d2efde tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:10.198540 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-89857d68-f4d2-4839-9135-f86db8d2efde tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:10.199592 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-89857d68-f4d2-4839-9135-f86db8d2efde tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:10.200315 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-89857d68-f4d2-4839-9135-f86db8d2efde tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:10.233587 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-89857d68-f4d2-4839-9135-f86db8d2efde tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 7878a5d1-1349-4cb6-abd1-519f61b97eef] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:34:10.426762 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0976a6b6-cd9c-4a0b-94bd-5c286e79fcc2 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-971112726", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "35be2f98-b266-42eb-b453-4314c116d4a7"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:34:10.621645 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-0976a6b6-cd9c-4a0b-94bd-5c286e79fcc2 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] validate_networks() for [('35be2f98-b266-42eb-b453-4314c116d4a7', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:34:10.741139 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-89857d68-f4d2-4839-9135-f86db8d2efde tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef" status: 204 len: 0 microversion: 2.1 time: 0.561352 Oct 23 01:34:10.741863 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2607/5138] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:34:10 2022] DELETE /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef => generated 0 bytes in 563 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:34:11.211158 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-33114bb6-d31c-4e11-b044-11f3b90e2fc8 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Action: 'create', calling method: .version_select at 0x7f5cc107a280>, body: {"keypair": {"name": "tempest-TestServerBasicOps-878408985", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGm2L/dbV0vbSkeujIjQCCgbmmruL4gsMxpSoN+HKjMOpRFk3c0pxEd/15AelUl0RAB+XM0qkBv0dJ0gTbFVx1ZNZgLPeERW5Ybq1TUsvqpV4uGPKXokZmTkeGtOEuDMuQ=="}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:34:11.256580 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-33114bb6-d31c-4e11-b044-11f3b90e2fc8 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Getting quotas for project ef4c34c1a48140f8ae5a69fa0abb2bc7. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:34:11.263957 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-33114bb6-d31c-4e11-b044-11f3b90e2fc8 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Getting quotas for user be1759290b0b4034ad9d312abb95ef46 and project ef4c34c1a48140f8ae5a69fa0abb2bc7. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:34:11.417989 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-33114bb6-d31c-4e11-b044-11f3b90e2fc8 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.674700 Oct 23 01:34:11.446070 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2608/5139] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 01:34:10 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:34:11.450625 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-b9b259d9-9ca3-496e-8d2d-36007f45f66e req-e469fb29-27db-44c6-98a5-9dcf14b1b698 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71362f74-5a83-466a-b7be-de2a87253559", "tag": "f30f4cf4-1b9d-4bf3-af09-74938e70131b"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:34:11.461557 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-b9b259d9-9ca3-496e-8d2d-36007f45f66e req-e469fb29-27db-44c6-98a5-9dcf14b1b698 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:11.462346 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-b9b259d9-9ca3-496e-8d2d-36007f45f66e req-e469fb29-27db-44c6-98a5-9dcf14b1b698 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:11.463005 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-b9b259d9-9ca3-496e-8d2d-36007f45f66e req-e469fb29-27db-44c6-98a5-9dcf14b1b698 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:11.494597 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-b9b259d9-9ca3-496e-8d2d-36007f45f66e req-e469fb29-27db-44c6-98a5-9dcf14b1b698 service nova] Creating event network-changed:f30f4cf4-1b9d-4bf3-af09-74938e70131b for instance 71362f74-5a83-466a-b7be-de2a87253559 on n-h2-master-1 Oct 23 01:34:11.500085 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-b9b259d9-9ca3-496e-8d2d-36007f45f66e req-e469fb29-27db-44c6-98a5-9dcf14b1b698 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053792 Oct 23 01:34:11.504441 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2609/5140] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:34:11.510429 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a9c87cc8-faf9-4aa0-94ca-572bc495fb12 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:11.521183 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a9c87cc8-faf9-4aa0-94ca-572bc495fb12 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 697bf9a9-687f-4d5f-a459-9ff304289577] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:11.521183 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a9c87cc8-faf9-4aa0-94ca-572bc495fb12 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:11.521183 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a9c87cc8-faf9-4aa0-94ca-572bc495fb12 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:11.521183 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a9c87cc8-faf9-4aa0-94ca-572bc495fb12 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:11.521183 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a9c87cc8-faf9-4aa0-94ca-572bc495fb12 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:11.521183 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a9c87cc8-faf9-4aa0-94ca-572bc495fb12 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:11.521183 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a9c87cc8-faf9-4aa0-94ca-572bc495fb12 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:12.229794 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a9c87cc8-faf9-4aa0-94ca-572bc495fb12 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:12.251952 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a9c87cc8-faf9-4aa0-94ca-572bc495fb12 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577" status: 200 len: 1556 microversion: 2.1 time: 0.745550 Oct 23 01:34:12.256252 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2610/5141] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:11 2022] GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577 => generated 1556 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:12.267283 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-1cbf951f-de2b-4ff1-8a56-4f98c080594e req-2068e649-85b2-45e7-914a-d762d8156011 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa616812-f379-45fb-8e7e-fefe7570dc98", "name": "network-vif-unplugged", "status": "completed", "tag": "6de1369a-94d0-42a0-a57f-9deacb90b66f"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:34:12.295815 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-1cbf951f-de2b-4ff1-8a56-4f98c080594e req-2068e649-85b2-45e7-914a-d762d8156011 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:12.296313 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-1cbf951f-de2b-4ff1-8a56-4f98c080594e req-2068e649-85b2-45e7-914a-d762d8156011 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:12.298948 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-1cbf951f-de2b-4ff1-8a56-4f98c080594e req-2068e649-85b2-45e7-914a-d762d8156011 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:12.356803 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-1cbf951f-de2b-4ff1-8a56-4f98c080594e req-2068e649-85b2-45e7-914a-d762d8156011 service nova] Creating event network-vif-unplugged:6de1369a-94d0-42a0-a57f-9deacb90b66f for instance fa616812-f379-45fb-8e7e-fefe7570dc98 on n-h1-master-1 Oct 23 01:34:12.375545 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-1cbf951f-de2b-4ff1-8a56-4f98c080594e req-2068e649-85b2-45e7-914a-d762d8156011 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.117209 Oct 23 01:34:12.381764 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2611/5142] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:34:12.396351 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fa96a24d-385f-4431-8a34-5564f3544c0f tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:12.398566 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fa96a24d-385f-4431-8a34-5564f3544c0f tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 7878a5d1-1349-4cb6-abd1-519f61b97eef] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:12.420290 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fa96a24d-385f-4431-8a34-5564f3544c0f tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:12.422542 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fa96a24d-385f-4431-8a34-5564f3544c0f tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:12.423381 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fa96a24d-385f-4431-8a34-5564f3544c0f tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:12.425993 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fa96a24d-385f-4431-8a34-5564f3544c0f tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:12.429127 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fa96a24d-385f-4431-8a34-5564f3544c0f tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:12.429923 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fa96a24d-385f-4431-8a34-5564f3544c0f tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:12.881309 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-0976a6b6-cd9c-4a0b-94bd-5c286e79fcc2 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:34:12.881782 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-0976a6b6-cd9c-4a0b-94bd-5c286e79fcc2 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:34:12.884186 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-0976a6b6-cd9c-4a0b-94bd-5c286e79fcc2 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:34:12.886535 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-0976a6b6-cd9c-4a0b-94bd-5c286e79fcc2 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:34:12.887232 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-0976a6b6-cd9c-4a0b-94bd-5c286e79fcc2 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:34:12.897835 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0976a6b6-cd9c-4a0b-94bd-5c286e79fcc2 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:12.898549 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0976a6b6-cd9c-4a0b-94bd-5c286e79fcc2 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:12.899440 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0976a6b6-cd9c-4a0b-94bd-5c286e79fcc2 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:12.900407 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0976a6b6-cd9c-4a0b-94bd-5c286e79fcc2 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:12.901557 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0976a6b6-cd9c-4a0b-94bd-5c286e79fcc2 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:12.902575 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0976a6b6-cd9c-4a0b-94bd-5c286e79fcc2 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:12.967511 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-0976a6b6-cd9c-4a0b-94bd-5c286e79fcc2 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Getting quotas for project 7defb846e6a24a0aadb9de6de5439b8a. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:34:12.982226 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fa96a24d-385f-4431-8a34-5564f3544c0f tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:13.007032 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fa96a24d-385f-4431-8a34-5564f3544c0f tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef" status: 200 len: 1491 microversion: 2.1 time: 0.623214 Oct 23 01:34:13.008202 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2612/5143] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:12 2022] GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef => generated 1491 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:13.026280 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-44c2dd8e-3465-4dd1-a0aa-87d9277b3770 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:13.031398 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-44c2dd8e-3465-4dd1-a0aa-87d9277b3770 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:13.031986 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-0976a6b6-cd9c-4a0b-94bd-5c286e79fcc2 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Getting quotas for user b118116bb0734e8496aaa1446e871d7e and project 7defb846e6a24a0aadb9de6de5439b8a. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:34:13.048749 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-44c2dd8e-3465-4dd1-a0aa-87d9277b3770 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:13.050749 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-44c2dd8e-3465-4dd1-a0aa-87d9277b3770 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:13.052165 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-44c2dd8e-3465-4dd1-a0aa-87d9277b3770 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:13.055436 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-44c2dd8e-3465-4dd1-a0aa-87d9277b3770 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:13.055943 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-44c2dd8e-3465-4dd1-a0aa-87d9277b3770 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:13.056386 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-44c2dd8e-3465-4dd1-a0aa-87d9277b3770 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:13.071981 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0976a6b6-cd9c-4a0b-94bd-5c286e79fcc2 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:34:13.071981 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0976a6b6-cd9c-4a0b-94bd-5c286e79fcc2 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] [instance: 51f5cae8-033b-466b-99b8-465ea87d2b0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:34:13.349101 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-44c2dd8e-3465-4dd1-a0aa-87d9277b3770 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:13.359445 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-44c2dd8e-3465-4dd1-a0aa-87d9277b3770 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 200 len: 1315 microversion: 2.1 time: 0.350054 Oct 23 01:34:13.359930 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0976a6b6-cd9c-4a0b-94bd-5c286e79fcc2 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 3.230476 Oct 23 01:34:13.375512 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2613/5144] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:13 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 1315 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:13.375683 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2532/5145] 10.222.0.42 () {62 vars in 1188 bytes} [Sun Oct 23 01:34:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 3251 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 23 01:34:13.382696 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5eda903f-7924-4cf8-afc6-c74b17d3b0e3 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:13.385288 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-73441ccb-be05-41fb-ace0-cc8a7ec2fadf tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:13.386006 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5eda903f-7924-4cf8-afc6-c74b17d3b0e3 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 697bf9a9-687f-4d5f-a459-9ff304289577] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:13.390320 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-73441ccb-be05-41fb-ace0-cc8a7ec2fadf tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] [instance: 51f5cae8-033b-466b-99b8-465ea87d2b0e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:13.401131 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5eda903f-7924-4cf8-afc6-c74b17d3b0e3 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:13.401891 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5eda903f-7924-4cf8-afc6-c74b17d3b0e3 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:13.403189 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5eda903f-7924-4cf8-afc6-c74b17d3b0e3 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:13.411202 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5eda903f-7924-4cf8-afc6-c74b17d3b0e3 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:13.412243 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5eda903f-7924-4cf8-afc6-c74b17d3b0e3 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:13.412876 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5eda903f-7924-4cf8-afc6-c74b17d3b0e3 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:13.576021 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-73441ccb-be05-41fb-ace0-cc8a7ec2fadf tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b118116bb0734e8496aaa1446e871d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7defb846e6a24a0aadb9de6de5439b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:13.592814 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-73441ccb-be05-41fb-ace0-cc8a7ec2fadf tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b118116bb0734e8496aaa1446e871d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7defb846e6a24a0aadb9de6de5439b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:13.595313 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-73441ccb-be05-41fb-ace0-cc8a7ec2fadf tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b118116bb0734e8496aaa1446e871d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7defb846e6a24a0aadb9de6de5439b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:13.597687 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-73441ccb-be05-41fb-ace0-cc8a7ec2fadf tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] 10.222.0.42 "GET /compute/v2.1/servers/51f5cae8-033b-466b-99b8-465ea87d2b0e" status: 200 len: 1258 microversion: 2.21 time: 0.220782 Oct 23 01:34:13.600304 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2533/5146] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:34:13 2022] GET /compute/v2.1/servers/51f5cae8-033b-466b-99b8-465ea87d2b0e => generated 1258 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:34:13.700913 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5eda903f-7924-4cf8-afc6-c74b17d3b0e3 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.338693 Oct 23 01:34:13.701659 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2614/5147] 10.222.0.42 () {58 vars in 1275 bytes} [Sun Oct 23 01:34:13 2022] GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577/os-interface => generated 285 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:34:14.030742 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-02b074f6-8a3c-408b-90d6-9924f9942c23 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:14.031993 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-02b074f6-8a3c-408b-90d6-9924f9942c23 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 7878a5d1-1349-4cb6-abd1-519f61b97eef] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:14.042406 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-02b074f6-8a3c-408b-90d6-9924f9942c23 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:14.042905 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-02b074f6-8a3c-408b-90d6-9924f9942c23 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:14.043347 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-02b074f6-8a3c-408b-90d6-9924f9942c23 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:14.044055 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-02b074f6-8a3c-408b-90d6-9924f9942c23 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:14.044505 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-02b074f6-8a3c-408b-90d6-9924f9942c23 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:14.045098 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-02b074f6-8a3c-408b-90d6-9924f9942c23 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:14.123465 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a5c6571f-c358-4323-93e4-ef5a629b5202 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:14.124088 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a5c6571f-c358-4323-93e4-ef5a629b5202 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:14.138425 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5c6571f-c358-4323-93e4-ef5a629b5202 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:14.138961 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5c6571f-c358-4323-93e4-ef5a629b5202 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:14.139407 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5c6571f-c358-4323-93e4-ef5a629b5202 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:14.142487 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5c6571f-c358-4323-93e4-ef5a629b5202 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:14.147211 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5c6571f-c358-4323-93e4-ef5a629b5202 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:14.148650 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5c6571f-c358-4323-93e4-ef5a629b5202 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:14.196948 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-02b074f6-8a3c-408b-90d6-9924f9942c23 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:14.215253 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-02b074f6-8a3c-408b-90d6-9924f9942c23 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef" status: 200 len: 1449 microversion: 2.1 time: 0.188196 Oct 23 01:34:14.216128 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2534/5148] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:14 2022] GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef => generated 1449 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:14.392888 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-44c15add-8fe7-4362-a180-2ed981615a3d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:14.392888 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-44c15add-8fe7-4362-a180-2ed981615a3d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:14.400453 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44c15add-8fe7-4362-a180-2ed981615a3d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:14.401031 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44c15add-8fe7-4362-a180-2ed981615a3d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:14.401471 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44c15add-8fe7-4362-a180-2ed981615a3d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:14.402248 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44c15add-8fe7-4362-a180-2ed981615a3d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:14.402887 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44c15add-8fe7-4362-a180-2ed981615a3d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:14.410720 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44c15add-8fe7-4362-a180-2ed981615a3d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:14.634134 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a5c6571f-c358-4323-93e4-ef5a629b5202 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:14.634134 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:34:14.634134 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a5c6571f-c358-4323-93e4-ef5a629b5202 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1669 microversion: 2.1 time: 0.515754 Oct 23 01:34:14.634134 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2615/5149] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:14 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1669 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:14.660392 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cea28f05-27d8-4b9e-a2ca-e2cad7210847 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:14.661051 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-cea28f05-27d8-4b9e-a2ca-e2cad7210847 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] [instance: 51f5cae8-033b-466b-99b8-465ea87d2b0e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:14.832378 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cea28f05-27d8-4b9e-a2ca-e2cad7210847 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b118116bb0734e8496aaa1446e871d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7defb846e6a24a0aadb9de6de5439b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:14.846440 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cea28f05-27d8-4b9e-a2ca-e2cad7210847 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b118116bb0734e8496aaa1446e871d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7defb846e6a24a0aadb9de6de5439b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:14.849177 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cea28f05-27d8-4b9e-a2ca-e2cad7210847 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b118116bb0734e8496aaa1446e871d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7defb846e6a24a0aadb9de6de5439b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:14.850585 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cea28f05-27d8-4b9e-a2ca-e2cad7210847 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] 10.222.0.42 "GET /compute/v2.1/servers/51f5cae8-033b-466b-99b8-465ea87d2b0e" status: 200 len: 1258 microversion: 2.21 time: 0.203011 Oct 23 01:34:14.855238 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2616/5150] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:34:14 2022] GET /compute/v2.1/servers/51f5cae8-033b-466b-99b8-465ea87d2b0e => generated 1258 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:34:14.866215 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-12f963a1-2877-4ba9-913e-88b5d7a27ffe tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:14.866215 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-12f963a1-2877-4ba9-913e-88b5d7a27ffe tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:14.898532 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-12f963a1-2877-4ba9-913e-88b5d7a27ffe tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:14.902692 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-12f963a1-2877-4ba9-913e-88b5d7a27ffe tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:14.904420 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-12f963a1-2877-4ba9-913e-88b5d7a27ffe tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:14.912054 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-12f963a1-2877-4ba9-913e-88b5d7a27ffe tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:14.913047 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-12f963a1-2877-4ba9-913e-88b5d7a27ffe tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:14.913804 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-12f963a1-2877-4ba9-913e-88b5d7a27ffe tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:15.303884 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-44c15add-8fe7-4362-a180-2ed981615a3d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:15.333833 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-44c15add-8fe7-4362-a180-2ed981615a3d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 200 len: 1315 microversion: 2.1 time: 0.946338 Oct 23 01:34:15.337214 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2535/5151] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:14 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 1315 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:34:15.352205 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-3f85e00a-1b64-4364-9a8e-b365935785e0 req-e38360e5-d964-4dd0-99b3-1031113bdcfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7878a5d1-1349-4cb6-abd1-519f61b97eef", "name": "network-vif-deleted", "tag": "1a7030fd-87ce-41ea-ab45-62f0f99f4568"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:34:15.378336 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-3f85e00a-1b64-4364-9a8e-b365935785e0 req-e38360e5-d964-4dd0-99b3-1031113bdcfa service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:15.379917 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-3f85e00a-1b64-4364-9a8e-b365935785e0 req-e38360e5-d964-4dd0-99b3-1031113bdcfa service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:15.380447 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-3f85e00a-1b64-4364-9a8e-b365935785e0 req-e38360e5-d964-4dd0-99b3-1031113bdcfa service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:15.398132 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-3f85e00a-1b64-4364-9a8e-b365935785e0 req-e38360e5-d964-4dd0-99b3-1031113bdcfa service nova] Creating event network-vif-deleted:1a7030fd-87ce-41ea-ab45-62f0f99f4568 for instance 7878a5d1-1349-4cb6-abd1-519f61b97eef on n-h2-master-1 Oct 23 01:34:15.409471 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-3f85e00a-1b64-4364-9a8e-b365935785e0 req-e38360e5-d964-4dd0-99b3-1031113bdcfa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069204 Oct 23 01:34:15.412556 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2536/5152] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:34:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:34:15.419565 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-42ac3fa0-53b8-4ba2-9813-eb96ba1bec4f tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:15.421041 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-42ac3fa0-53b8-4ba2-9813-eb96ba1bec4f tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 7878a5d1-1349-4cb6-abd1-519f61b97eef] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:15.428835 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-42ac3fa0-53b8-4ba2-9813-eb96ba1bec4f tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:15.429591 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-42ac3fa0-53b8-4ba2-9813-eb96ba1bec4f tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:15.430277 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-42ac3fa0-53b8-4ba2-9813-eb96ba1bec4f tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:15.431542 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-42ac3fa0-53b8-4ba2-9813-eb96ba1bec4f tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:15.432174 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-42ac3fa0-53b8-4ba2-9813-eb96ba1bec4f tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:15.432774 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-42ac3fa0-53b8-4ba2-9813-eb96ba1bec4f tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:15.506412 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-42ac3fa0-53b8-4ba2-9813-eb96ba1bec4f tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:15.507090 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-42ac3fa0-53b8-4ba2-9813-eb96ba1bec4f tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:15.507530 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-42ac3fa0-53b8-4ba2-9813-eb96ba1bec4f tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:15.510881 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-42ac3fa0-53b8-4ba2-9813-eb96ba1bec4f tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lazy-loading 'fault' on Instance uuid 7878a5d1-1349-4cb6-abd1-519f61b97eef {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:34:15.550622 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-12f963a1-2877-4ba9-913e-88b5d7a27ffe tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:15.574041 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-12f963a1-2877-4ba9-913e-88b5d7a27ffe tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1669 microversion: 2.1 time: 0.713236 Oct 23 01:34:15.574041 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2617/5153] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:14 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1669 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:15.594296 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-05861340-cf83-4370-a2cd-655318ab4973 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:15.595651 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-05861340-cf83-4370-a2cd-655318ab4973 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:15.596405 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-42ac3fa0-53b8-4ba2-9813-eb96ba1bec4f tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:15.603242 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-05861340-cf83-4370-a2cd-655318ab4973 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:15.608682 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-05861340-cf83-4370-a2cd-655318ab4973 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:15.608682 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-05861340-cf83-4370-a2cd-655318ab4973 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:15.608682 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-05861340-cf83-4370-a2cd-655318ab4973 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:15.608682 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-05861340-cf83-4370-a2cd-655318ab4973 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:15.608682 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-05861340-cf83-4370-a2cd-655318ab4973 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:15.612877 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-42ac3fa0-53b8-4ba2-9813-eb96ba1bec4f tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef" status: 200 len: 1308 microversion: 2.1 time: 0.199196 Oct 23 01:34:15.622913 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2537/5154] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:15 2022] GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef => generated 1308 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:15.885005 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bb209ac8-06d3-4421-a8f5-0b48cfd910df tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:15.886160 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-bb209ac8-06d3-4421-a8f5-0b48cfd910df tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] [instance: 51f5cae8-033b-466b-99b8-465ea87d2b0e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:15.894710 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bb209ac8-06d3-4421-a8f5-0b48cfd910df tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:15.895183 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bb209ac8-06d3-4421-a8f5-0b48cfd910df tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:15.895640 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bb209ac8-06d3-4421-a8f5-0b48cfd910df tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:15.896867 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bb209ac8-06d3-4421-a8f5-0b48cfd910df tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:15.897399 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bb209ac8-06d3-4421-a8f5-0b48cfd910df tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:15.897829 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bb209ac8-06d3-4421-a8f5-0b48cfd910df tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:15.918401 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=100 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:34:16.089344 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bb209ac8-06d3-4421-a8f5-0b48cfd910df tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b118116bb0734e8496aaa1446e871d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7defb846e6a24a0aadb9de6de5439b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:16.111457 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bb209ac8-06d3-4421-a8f5-0b48cfd910df tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b118116bb0734e8496aaa1446e871d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7defb846e6a24a0aadb9de6de5439b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:16.117483 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-05861340-cf83-4370-a2cd-655318ab4973 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:16.127811 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bb209ac8-06d3-4421-a8f5-0b48cfd910df tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b118116bb0734e8496aaa1446e871d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7defb846e6a24a0aadb9de6de5439b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:16.132028 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bb209ac8-06d3-4421-a8f5-0b48cfd910df tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] 10.222.0.42 "GET /compute/v2.1/servers/51f5cae8-033b-466b-99b8-465ea87d2b0e" status: 200 len: 1262 microversion: 2.21 time: 0.252680 Oct 23 01:34:16.132894 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-05861340-cf83-4370-a2cd-655318ab4973 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1669 microversion: 2.1 time: 0.542409 Oct 23 01:34:16.135323 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2538/5155] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:34:15 2022] GET /compute/v2.1/servers/51f5cae8-033b-466b-99b8-465ea87d2b0e => generated 1262 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:34:16.150308 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2618/5156] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:15 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1669 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:16.163192 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3e491d55-d730-47f8-8b33-4e5199f9c517 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:34:16.166034 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3e491d55-d730-47f8-8b33-4e5199f9c517 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:16.172962 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3e491d55-d730-47f8-8b33-4e5199f9c517 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:16.173582 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3e491d55-d730-47f8-8b33-4e5199f9c517 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:16.178240 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3e491d55-d730-47f8-8b33-4e5199f9c517 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:16.179301 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3e491d55-d730-47f8-8b33-4e5199f9c517 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:16.179889 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3e491d55-d730-47f8-8b33-4e5199f9c517 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:16.180482 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3e491d55-d730-47f8-8b33-4e5199f9c517 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:16.362849 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7d05cf71-f343-42e7-a248-03a352c5394f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:16.363650 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7d05cf71-f343-42e7-a248-03a352c5394f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:16.376428 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7d05cf71-f343-42e7-a248-03a352c5394f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:16.376929 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7d05cf71-f343-42e7-a248-03a352c5394f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:16.381751 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7d05cf71-f343-42e7-a248-03a352c5394f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:16.387897 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7d05cf71-f343-42e7-a248-03a352c5394f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:16.387897 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7d05cf71-f343-42e7-a248-03a352c5394f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:16.389609 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7d05cf71-f343-42e7-a248-03a352c5394f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:16.540877 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3e491d55-d730-47f8-8b33-4e5199f9c517 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "POST /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98/action" status: 202 len: 0 microversion: 2.1 time: 0.364137 Oct 23 01:34:16.545108 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2619/5157] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:34:16 2022] POST /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98/action => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:34:16.560541 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c0dff8ca-828f-473b-8541-ca8529de858d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:16.562675 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c0dff8ca-828f-473b-8541-ca8529de858d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:16.577011 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c0dff8ca-828f-473b-8541-ca8529de858d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:16.577777 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c0dff8ca-828f-473b-8541-ca8529de858d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:16.578518 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c0dff8ca-828f-473b-8541-ca8529de858d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:16.579419 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c0dff8ca-828f-473b-8541-ca8529de858d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:16.580036 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c0dff8ca-828f-473b-8541-ca8529de858d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:16.580664 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c0dff8ca-828f-473b-8541-ca8529de858d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:16.902904 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7d05cf71-f343-42e7-a248-03a352c5394f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:16.910433 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7d05cf71-f343-42e7-a248-03a352c5394f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 200 len: 1315 microversion: 2.1 time: 0.551601 Oct 23 01:34:16.911896 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2539/5158] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:16 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 1315 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:34:16.927117 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6c55cd16-cd47-4c94-b08e-ff46b77f2449 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:16.927117 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6c55cd16-cd47-4c94-b08e-ff46b77f2449 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 7878a5d1-1349-4cb6-abd1-519f61b97eef] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:16.933631 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6c55cd16-cd47-4c94-b08e-ff46b77f2449 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:16.934165 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6c55cd16-cd47-4c94-b08e-ff46b77f2449 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:16.934815 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6c55cd16-cd47-4c94-b08e-ff46b77f2449 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:16.936029 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6c55cd16-cd47-4c94-b08e-ff46b77f2449 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:16.936655 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6c55cd16-cd47-4c94-b08e-ff46b77f2449 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:16.937245 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6c55cd16-cd47-4c94-b08e-ff46b77f2449 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:16.955772 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-6c55cd16-cd47-4c94-b08e-ff46b77f2449 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] HTTP exception thrown: Instance 7878a5d1-1349-4cb6-abd1-519f61b97eef could not be found. Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6c55cd16-cd47-4c94-b08e-ff46b77f2449 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Request method failure captured: Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef HTTP/1.1 Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJkiigL5TCEu6eSSAcyvyVmYwcN25zFDHPVJqRKHbtxzIEn87jCeqAfp7Z9r3Mqhyb3sj4ihzI_o6sMFkrbUwNL-zNG9d9yXVxVjtum4uC7NU-HTDI6Yq0W2nY2ZxVUGKOV2HfdfrtC_JKFgX2qnR1YVSIaIVW5JxazPUN9LbJjq984 Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: e2ee2ea8399e42a5a5cd0d0ddeb192b5 Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServersTestJSON-245534565 Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}] Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServersTestJSON-245534565 Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: e2ee2ea8399e42a5a5cd0d0ddeb192b5 Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServersTestJSON-245534565 Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServersTestJSON-245534565-project Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 77197152ea5040bab602d5381d21341a Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServersTestJSON-245534565-project Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 7878a5d1-1349-4cb6-abd1-519f61b97eef could not be found. Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '7878a5d1-1349-4cb6-abd1-519f61b97eef'} Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7878a5d1-1349-4cb6-abd1-519f61b97eef could not be found. Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7878a5d1-1349-4cb6-abd1-519f61b97eef could not be found. Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:16.958535 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:16.976152 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:34:16.976152 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:34:16.976152 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:34:16.976152 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:34:16.976152 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7878a5d1-1349-4cb6-abd1-519f61b97eef could not be found. Oct 23 01:34:16.976152 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:16.976152 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6c55cd16-cd47-4c94-b08e-ff46b77f2449 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Returning 404 to user: Instance 7878a5d1-1349-4cb6-abd1-519f61b97eef could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:34:16.976152 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6c55cd16-cd47-4c94-b08e-ff46b77f2449 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef" status: 404 len: 111 microversion: 2.1 time: 0.041304 Oct 23 01:34:16.976152 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2540/5159] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:16 2022] GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:34:16.982812 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cd5287f5-af04-41ce-8fb1-37bc1c8eac6b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:16.984763 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cd5287f5-af04-41ce-8fb1-37bc1c8eac6b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 7878a5d1-1349-4cb6-abd1-519f61b97eef] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:16.991846 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cd5287f5-af04-41ce-8fb1-37bc1c8eac6b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:16.995711 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cd5287f5-af04-41ce-8fb1-37bc1c8eac6b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:16.995711 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cd5287f5-af04-41ce-8fb1-37bc1c8eac6b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:16.995711 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cd5287f5-af04-41ce-8fb1-37bc1c8eac6b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:16.995711 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cd5287f5-af04-41ce-8fb1-37bc1c8eac6b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:16.995711 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cd5287f5-af04-41ce-8fb1-37bc1c8eac6b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:17.013595 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-cd5287f5-af04-41ce-8fb1-37bc1c8eac6b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] HTTP exception thrown: Instance 7878a5d1-1349-4cb6-abd1-519f61b97eef could not be found. Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cd5287f5-af04-41ce-8fb1-37bc1c8eac6b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Request method failure captured: Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef HTTP/1.1 Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJkiigL5TCEu6eSSAcyvyVmYwcN25zFDHPVJqRKHbtxzIEn87jCeqAfp7Z9r3Mqhyb3sj4ihzI_o6sMFkrbUwNL-zNG9d9yXVxVjtum4uC7NU-HTDI6Yq0W2nY2ZxVUGKOV2HfdfrtC_JKFgX2qnR1YVSIaIVW5JxazPUN9LbJjq984 Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: e2ee2ea8399e42a5a5cd0d0ddeb192b5 Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServersTestJSON-245534565 Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}] Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServersTestJSON-245534565 Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: e2ee2ea8399e42a5a5cd0d0ddeb192b5 Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServersTestJSON-245534565 Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServersTestJSON-245534565-project Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 77197152ea5040bab602d5381d21341a Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServersTestJSON-245534565-project Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 7878a5d1-1349-4cb6-abd1-519f61b97eef could not be found. Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '7878a5d1-1349-4cb6-abd1-519f61b97eef'} Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7878a5d1-1349-4cb6-abd1-519f61b97eef could not be found. Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:34:17.015615 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7878a5d1-1349-4cb6-abd1-519f61b97eef could not be found. Oct 23 01:34:17.024522 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.024522 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:34:17.024522 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.024522 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:17.024522 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:34:17.024522 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:34:17.024522 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:34:17.024522 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:34:17.024522 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7878a5d1-1349-4cb6-abd1-519f61b97eef could not be found. Oct 23 01:34:17.024522 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.024522 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cd5287f5-af04-41ce-8fb1-37bc1c8eac6b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Returning 404 to user: Instance 7878a5d1-1349-4cb6-abd1-519f61b97eef could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:34:17.024522 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cd5287f5-af04-41ce-8fb1-37bc1c8eac6b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef" status: 404 len: 111 microversion: 2.1 time: 0.038403 Oct 23 01:34:17.024522 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2541/5160] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:34:16 2022] DELETE /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:34:17.027985 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-736af339-9c3a-44dd-9426-f5d0a8a30120 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:17.028741 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-736af339-9c3a-44dd-9426-f5d0a8a30120 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 7878a5d1-1349-4cb6-abd1-519f61b97eef] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:17.036814 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-736af339-9c3a-44dd-9426-f5d0a8a30120 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:17.037707 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-736af339-9c3a-44dd-9426-f5d0a8a30120 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:17.038508 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-736af339-9c3a-44dd-9426-f5d0a8a30120 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:17.039427 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-736af339-9c3a-44dd-9426-f5d0a8a30120 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:17.040056 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-736af339-9c3a-44dd-9426-f5d0a8a30120 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:17.040694 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-736af339-9c3a-44dd-9426-f5d0a8a30120 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:17.074649 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-736af339-9c3a-44dd-9426-f5d0a8a30120 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] HTTP exception thrown: Instance 7878a5d1-1349-4cb6-abd1-519f61b97eef could not be found. Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-736af339-9c3a-44dd-9426-f5d0a8a30120 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Request method failure captured: Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef HTTP/1.1 Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJkiigL5TCEu6eSSAcyvyVmYwcN25zFDHPVJqRKHbtxzIEn87jCeqAfp7Z9r3Mqhyb3sj4ihzI_o6sMFkrbUwNL-zNG9d9yXVxVjtum4uC7NU-HTDI6Yq0W2nY2ZxVUGKOV2HfdfrtC_JKFgX2qnR1YVSIaIVW5JxazPUN9LbJjq984 Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: e2ee2ea8399e42a5a5cd0d0ddeb192b5 Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServersTestJSON-245534565 Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}] Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServersTestJSON-245534565 Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: e2ee2ea8399e42a5a5cd0d0ddeb192b5 Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServersTestJSON-245534565 Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServersTestJSON-245534565-project Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 77197152ea5040bab602d5381d21341a Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServersTestJSON-245534565-project Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 7878a5d1-1349-4cb6-abd1-519f61b97eef could not be found. Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '7878a5d1-1349-4cb6-abd1-519f61b97eef'} Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7878a5d1-1349-4cb6-abd1-519f61b97eef could not be found. Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7878a5d1-1349-4cb6-abd1-519f61b97eef could not be found. Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.076259 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:17.085059 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:34:17.085059 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:34:17.085059 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:34:17.085059 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:34:17.085059 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7878a5d1-1349-4cb6-abd1-519f61b97eef could not be found. Oct 23 01:34:17.085059 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.085059 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-736af339-9c3a-44dd-9426-f5d0a8a30120 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Returning 404 to user: Instance 7878a5d1-1349-4cb6-abd1-519f61b97eef could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:34:17.085059 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-736af339-9c3a-44dd-9426-f5d0a8a30120 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef" status: 404 len: 111 microversion: 2.1 time: 0.054170 Oct 23 01:34:17.085059 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2542/5161] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:17 2022] GET /compute/v2.1/servers/7878a5d1-1349-4cb6-abd1-519f61b97eef => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:34:17.092319 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3a7ee8d5-b5ce-4db8-bef8-433328bdfea7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:17.092833 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3a7ee8d5-b5ce-4db8-bef8-433328bdfea7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: c8eed771-da93-492d-bb34-5020c379fb63] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:17.100946 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3a7ee8d5-b5ce-4db8-bef8-433328bdfea7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:17.103069 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3a7ee8d5-b5ce-4db8-bef8-433328bdfea7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:17.103526 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3a7ee8d5-b5ce-4db8-bef8-433328bdfea7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:17.104286 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3a7ee8d5-b5ce-4db8-bef8-433328bdfea7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:17.104787 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3a7ee8d5-b5ce-4db8-bef8-433328bdfea7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:17.105432 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3a7ee8d5-b5ce-4db8-bef8-433328bdfea7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:17.126256 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-3a7ee8d5-b5ce-4db8-bef8-433328bdfea7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] HTTP exception thrown: Instance c8eed771-da93-492d-bb34-5020c379fb63 could not be found. Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3a7ee8d5-b5ce-4db8-bef8-433328bdfea7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Request method failure captured: Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/servers/c8eed771-da93-492d-bb34-5020c379fb63 HTTP/1.1 Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJkiigL5TCEu6eSSAcyvyVmYwcN25zFDHPVJqRKHbtxzIEn87jCeqAfp7Z9r3Mqhyb3sj4ihzI_o6sMFkrbUwNL-zNG9d9yXVxVjtum4uC7NU-HTDI6Yq0W2nY2ZxVUGKOV2HfdfrtC_JKFgX2qnR1YVSIaIVW5JxazPUN9LbJjq984 Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: e2ee2ea8399e42a5a5cd0d0ddeb192b5 Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServersTestJSON-245534565 Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}] Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServersTestJSON-245534565 Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: e2ee2ea8399e42a5a5cd0d0ddeb192b5 Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServersTestJSON-245534565 Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServersTestJSON-245534565-project Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 77197152ea5040bab602d5381d21341a Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServersTestJSON-245534565-project Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: exception: Instance c8eed771-da93-492d-bb34-5020c379fb63 could not be found. Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'c8eed771-da93-492d-bb34-5020c379fb63'} Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8eed771-da93-492d-bb34-5020c379fb63 could not be found. Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:34:17.129314 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8eed771-da93-492d-bb34-5020c379fb63 could not be found. Oct 23 01:34:17.139861 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.139861 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:34:17.139861 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.139861 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:17.139861 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:34:17.139861 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:34:17.139861 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:34:17.139861 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:34:17.139861 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8eed771-da93-492d-bb34-5020c379fb63 could not be found. Oct 23 01:34:17.139861 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.139861 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3a7ee8d5-b5ce-4db8-bef8-433328bdfea7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Returning 404 to user: Instance c8eed771-da93-492d-bb34-5020c379fb63 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:34:17.139861 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3a7ee8d5-b5ce-4db8-bef8-433328bdfea7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c8eed771-da93-492d-bb34-5020c379fb63" status: 404 len: 111 microversion: 2.1 time: 0.052352 Oct 23 01:34:17.141871 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2543/5162] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:34:17 2022] DELETE /compute/v2.1/servers/c8eed771-da93-492d-bb34-5020c379fb63 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:34:17.156815 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-52f2b01c-0d9b-4982-9f94-d7fe3c7fb010 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:17.157444 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-52f2b01c-0d9b-4982-9f94-d7fe3c7fb010 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: c8eed771-da93-492d-bb34-5020c379fb63] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:17.162965 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c0dff8ca-828f-473b-8541-ca8529de858d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:17.165926 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52f2b01c-0d9b-4982-9f94-d7fe3c7fb010 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:17.166682 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52f2b01c-0d9b-4982-9f94-d7fe3c7fb010 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:17.167454 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52f2b01c-0d9b-4982-9f94-d7fe3c7fb010 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:17.168349 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52f2b01c-0d9b-4982-9f94-d7fe3c7fb010 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:17.169338 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52f2b01c-0d9b-4982-9f94-d7fe3c7fb010 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:17.170023 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52f2b01c-0d9b-4982-9f94-d7fe3c7fb010 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:17.170929 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c0dff8ca-828f-473b-8541-ca8529de858d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1671 microversion: 2.1 time: 0.622672 Oct 23 01:34:17.171649 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2620/5163] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:16 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1671 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:17.190373 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-52f2b01c-0d9b-4982-9f94-d7fe3c7fb010 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] HTTP exception thrown: Instance c8eed771-da93-492d-bb34-5020c379fb63 could not be found. Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-52f2b01c-0d9b-4982-9f94-d7fe3c7fb010 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Request method failure captured: Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/c8eed771-da93-492d-bb34-5020c379fb63 HTTP/1.1 Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJkiigL5TCEu6eSSAcyvyVmYwcN25zFDHPVJqRKHbtxzIEn87jCeqAfp7Z9r3Mqhyb3sj4ihzI_o6sMFkrbUwNL-zNG9d9yXVxVjtum4uC7NU-HTDI6Yq0W2nY2ZxVUGKOV2HfdfrtC_JKFgX2qnR1YVSIaIVW5JxazPUN9LbJjq984 Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: e2ee2ea8399e42a5a5cd0d0ddeb192b5 Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServersTestJSON-245534565 Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}] Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServersTestJSON-245534565 Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: e2ee2ea8399e42a5a5cd0d0ddeb192b5 Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServersTestJSON-245534565 Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServersTestJSON-245534565-project Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 77197152ea5040bab602d5381d21341a Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServersTestJSON-245534565-project Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: exception: Instance c8eed771-da93-492d-bb34-5020c379fb63 could not be found. Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'c8eed771-da93-492d-bb34-5020c379fb63'} Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8eed771-da93-492d-bb34-5020c379fb63 could not be found. Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8eed771-da93-492d-bb34-5020c379fb63 could not be found. Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.192739 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:17.197746 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:34:17.197746 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:34:17.197746 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:34:17.197746 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:34:17.197746 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8eed771-da93-492d-bb34-5020c379fb63 could not be found. Oct 23 01:34:17.197746 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.197746 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-52f2b01c-0d9b-4982-9f94-d7fe3c7fb010 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Returning 404 to user: Instance c8eed771-da93-492d-bb34-5020c379fb63 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:34:17.197746 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-52f2b01c-0d9b-4982-9f94-d7fe3c7fb010 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/c8eed771-da93-492d-bb34-5020c379fb63" status: 404 len: 111 microversion: 2.1 time: 0.051886 Oct 23 01:34:17.199292 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2544/5164] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:17 2022] GET /compute/v2.1/servers/c8eed771-da93-492d-bb34-5020c379fb63 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:34:17.205048 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-59790aef-3eec-4395-af91-0d5f4e8ccb06 req-f5af7b66-be5c-48db-96b9-7d910500c221 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "697bf9a9-687f-4d5f-a459-9ff304289577", "tag": "a3a4e1b5-5224-4f9b-857b-863bfc9c13e0"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:34:17.206823 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a605f786-198a-4a0d-807b-d8894edd9a35 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:17.207520 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a605f786-198a-4a0d-807b-d8894edd9a35 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] [instance: 51f5cae8-033b-466b-99b8-465ea87d2b0e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:17.215891 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a605f786-198a-4a0d-807b-d8894edd9a35 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:17.216403 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a605f786-198a-4a0d-807b-d8894edd9a35 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:17.216746 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-59790aef-3eec-4395-af91-0d5f4e8ccb06 req-f5af7b66-be5c-48db-96b9-7d910500c221 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:17.217238 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-59790aef-3eec-4395-af91-0d5f4e8ccb06 req-f5af7b66-be5c-48db-96b9-7d910500c221 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:17.217562 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a605f786-198a-4a0d-807b-d8894edd9a35 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:17.217710 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-59790aef-3eec-4395-af91-0d5f4e8ccb06 req-f5af7b66-be5c-48db-96b9-7d910500c221 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:17.218377 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a605f786-198a-4a0d-807b-d8894edd9a35 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:17.219108 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a605f786-198a-4a0d-807b-d8894edd9a35 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:17.219627 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a605f786-198a-4a0d-807b-d8894edd9a35 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:17.233815 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-59790aef-3eec-4395-af91-0d5f4e8ccb06 req-f5af7b66-be5c-48db-96b9-7d910500c221 service nova] Creating event network-changed:a3a4e1b5-5224-4f9b-857b-863bfc9c13e0 for instance 697bf9a9-687f-4d5f-a459-9ff304289577 on n-h1-master-1 Oct 23 01:34:17.241532 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-59790aef-3eec-4395-af91-0d5f4e8ccb06 req-f5af7b66-be5c-48db-96b9-7d910500c221 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043188 Oct 23 01:34:17.243717 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2621/5165] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:34:17.251791 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b25bdfd0-3e3f-4157-969c-1b768000a9a3 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:17.252654 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b25bdfd0-3e3f-4157-969c-1b768000a9a3 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: bbcf6b9d-5ae8-4241-82bf-53f7f7959760] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:17.261019 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b25bdfd0-3e3f-4157-969c-1b768000a9a3 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:17.261852 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b25bdfd0-3e3f-4157-969c-1b768000a9a3 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:17.262328 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b25bdfd0-3e3f-4157-969c-1b768000a9a3 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:17.263062 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b25bdfd0-3e3f-4157-969c-1b768000a9a3 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:17.263519 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b25bdfd0-3e3f-4157-969c-1b768000a9a3 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:17.263942 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b25bdfd0-3e3f-4157-969c-1b768000a9a3 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:17.295270 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a605f786-198a-4a0d-807b-d8894edd9a35 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b118116bb0734e8496aaa1446e871d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7defb846e6a24a0aadb9de6de5439b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:17.301111 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-b25bdfd0-3e3f-4157-969c-1b768000a9a3 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] HTTP exception thrown: Instance bbcf6b9d-5ae8-4241-82bf-53f7f7959760 could not be found. Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b25bdfd0-3e3f-4157-969c-1b768000a9a3 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Request method failure captured: Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/servers/bbcf6b9d-5ae8-4241-82bf-53f7f7959760 HTTP/1.1 Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJkiigL5TCEu6eSSAcyvyVmYwcN25zFDHPVJqRKHbtxzIEn87jCeqAfp7Z9r3Mqhyb3sj4ihzI_o6sMFkrbUwNL-zNG9d9yXVxVjtum4uC7NU-HTDI6Yq0W2nY2ZxVUGKOV2HfdfrtC_JKFgX2qnR1YVSIaIVW5JxazPUN9LbJjq984 Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: e2ee2ea8399e42a5a5cd0d0ddeb192b5 Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersTestJSON-245534565 Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}] Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersTestJSON-245534565 Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: e2ee2ea8399e42a5a5cd0d0ddeb192b5 Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersTestJSON-245534565 Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersTestJSON-245534565-project Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 77197152ea5040bab602d5381d21341a Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersTestJSON-245534565-project Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: exception: Instance bbcf6b9d-5ae8-4241-82bf-53f7f7959760 could not be found. Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'bbcf6b9d-5ae8-4241-82bf-53f7f7959760'} Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbcf6b9d-5ae8-4241-82bf-53f7f7959760 could not be found. Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:34:17.304074 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbcf6b9d-5ae8-4241-82bf-53f7f7959760 could not be found. Oct 23 01:34:17.309294 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.309294 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:34:17.309294 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.309294 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:17.309294 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:34:17.309294 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:34:17.309294 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:34:17.309294 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:34:17.309294 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbcf6b9d-5ae8-4241-82bf-53f7f7959760 could not be found. Oct 23 01:34:17.309294 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.312937 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b25bdfd0-3e3f-4157-969c-1b768000a9a3 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Returning 404 to user: Instance bbcf6b9d-5ae8-4241-82bf-53f7f7959760 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:34:17.314916 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b25bdfd0-3e3f-4157-969c-1b768000a9a3 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bbcf6b9d-5ae8-4241-82bf-53f7f7959760" status: 404 len: 111 microversion: 2.1 time: 0.069411 Oct 23 01:34:17.318293 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2622/5166] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:34:17 2022] DELETE /compute/v2.1/servers/bbcf6b9d-5ae8-4241-82bf-53f7f7959760 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:34:17.319132 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a605f786-198a-4a0d-807b-d8894edd9a35 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b118116bb0734e8496aaa1446e871d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7defb846e6a24a0aadb9de6de5439b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:17.324415 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a605f786-198a-4a0d-807b-d8894edd9a35 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b118116bb0734e8496aaa1446e871d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7defb846e6a24a0aadb9de6de5439b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:17.329678 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-262210a7-4d96-4c82-aeb4-f4273c1ecd45 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:17.330680 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a605f786-198a-4a0d-807b-d8894edd9a35 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] 10.222.0.42 "GET /compute/v2.1/servers/51f5cae8-033b-466b-99b8-465ea87d2b0e" status: 200 len: 1310 microversion: 2.21 time: 0.130567 Oct 23 01:34:17.332273 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2545/5167] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:34:17 2022] GET /compute/v2.1/servers/51f5cae8-033b-466b-99b8-465ea87d2b0e => generated 1310 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:34:17.333791 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-262210a7-4d96-4c82-aeb4-f4273c1ecd45 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: bbcf6b9d-5ae8-4241-82bf-53f7f7959760] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:17.354952 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-262210a7-4d96-4c82-aeb4-f4273c1ecd45 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:17.356274 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-262210a7-4d96-4c82-aeb4-f4273c1ecd45 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:17.356716 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-262210a7-4d96-4c82-aeb4-f4273c1ecd45 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:17.357433 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-262210a7-4d96-4c82-aeb4-f4273c1ecd45 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:17.357944 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-262210a7-4d96-4c82-aeb4-f4273c1ecd45 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:17.358416 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-262210a7-4d96-4c82-aeb4-f4273c1ecd45 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:17.387769 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-262210a7-4d96-4c82-aeb4-f4273c1ecd45 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] HTTP exception thrown: Instance bbcf6b9d-5ae8-4241-82bf-53f7f7959760 could not be found. Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-262210a7-4d96-4c82-aeb4-f4273c1ecd45 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Request method failure captured: Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/bbcf6b9d-5ae8-4241-82bf-53f7f7959760 HTTP/1.1 Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJkiigL5TCEu6eSSAcyvyVmYwcN25zFDHPVJqRKHbtxzIEn87jCeqAfp7Z9r3Mqhyb3sj4ihzI_o6sMFkrbUwNL-zNG9d9yXVxVjtum4uC7NU-HTDI6Yq0W2nY2ZxVUGKOV2HfdfrtC_JKFgX2qnR1YVSIaIVW5JxazPUN9LbJjq984 Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: e2ee2ea8399e42a5a5cd0d0ddeb192b5 Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersTestJSON-245534565 Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}] Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersTestJSON-245534565 Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: e2ee2ea8399e42a5a5cd0d0ddeb192b5 Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersTestJSON-245534565 Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersTestJSON-245534565-project Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 77197152ea5040bab602d5381d21341a Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersTestJSON-245534565-project Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: exception: Instance bbcf6b9d-5ae8-4241-82bf-53f7f7959760 could not be found. Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'bbcf6b9d-5ae8-4241-82bf-53f7f7959760'} Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbcf6b9d-5ae8-4241-82bf-53f7f7959760 could not be found. Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbcf6b9d-5ae8-4241-82bf-53f7f7959760 could not be found. Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.390962 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:17.399520 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:34:17.399520 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:34:17.399520 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:34:17.399520 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:34:17.399520 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbcf6b9d-5ae8-4241-82bf-53f7f7959760 could not be found. Oct 23 01:34:17.399520 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.399520 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-262210a7-4d96-4c82-aeb4-f4273c1ecd45 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Returning 404 to user: Instance bbcf6b9d-5ae8-4241-82bf-53f7f7959760 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:34:17.399520 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-262210a7-4d96-4c82-aeb4-f4273c1ecd45 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/bbcf6b9d-5ae8-4241-82bf-53f7f7959760" status: 404 len: 111 microversion: 2.1 time: 0.072350 Oct 23 01:34:17.399520 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2623/5168] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:17 2022] GET /compute/v2.1/servers/bbcf6b9d-5ae8-4241-82bf-53f7f7959760 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:34:17.402826 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0b9e4759-c4a1-4273-aae4-1b307919ccc7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:17.403389 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0b9e4759-c4a1-4273-aae4-1b307919ccc7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: f7ade4c5-7f11-4df8-9775-7e790e4e4435] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:17.409780 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b9e4759-c4a1-4273-aae4-1b307919ccc7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:17.410346 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b9e4759-c4a1-4273-aae4-1b307919ccc7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:17.411227 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b9e4759-c4a1-4273-aae4-1b307919ccc7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:17.411933 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b9e4759-c4a1-4273-aae4-1b307919ccc7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:17.412412 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b9e4759-c4a1-4273-aae4-1b307919ccc7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:17.412962 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b9e4759-c4a1-4273-aae4-1b307919ccc7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:17.437955 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2a7e894d-136f-4110-9c20-8a46b54eb312 tempest-VolumesTestJSON-690560218 tempest-VolumesTestJSON-690560218-project] Calling method '.version_select at 0x7f5cc0fc6ca0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:17.451504 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-0b9e4759-c4a1-4273-aae4-1b307919ccc7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] HTTP exception thrown: Instance f7ade4c5-7f11-4df8-9775-7e790e4e4435 could not be found. Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0b9e4759-c4a1-4273-aae4-1b307919ccc7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Request method failure captured: Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/servers/f7ade4c5-7f11-4df8-9775-7e790e4e4435 HTTP/1.1 Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJkiigL5TCEu6eSSAcyvyVmYwcN25zFDHPVJqRKHbtxzIEn87jCeqAfp7Z9r3Mqhyb3sj4ihzI_o6sMFkrbUwNL-zNG9d9yXVxVjtum4uC7NU-HTDI6Yq0W2nY2ZxVUGKOV2HfdfrtC_JKFgX2qnR1YVSIaIVW5JxazPUN9LbJjq984 Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: e2ee2ea8399e42a5a5cd0d0ddeb192b5 Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServersTestJSON-245534565 Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}] Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServersTestJSON-245534565 Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: e2ee2ea8399e42a5a5cd0d0ddeb192b5 Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServersTestJSON-245534565 Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServersTestJSON-245534565-project Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 77197152ea5040bab602d5381d21341a Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServersTestJSON-245534565-project Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: exception: Instance f7ade4c5-7f11-4df8-9775-7e790e4e4435 could not be found. Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'f7ade4c5-7f11-4df8-9775-7e790e4e4435'} Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7ade4c5-7f11-4df8-9775-7e790e4e4435 could not be found. Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:34:17.454360 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7ade4c5-7f11-4df8-9775-7e790e4e4435 could not be found. Oct 23 01:34:17.468261 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.468261 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:34:17.468261 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.468261 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:17.468261 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:34:17.468261 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:34:17.468261 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:34:17.468261 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:34:17.468261 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7ade4c5-7f11-4df8-9775-7e790e4e4435 could not be found. Oct 23 01:34:17.468261 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.468261 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0b9e4759-c4a1-4273-aae4-1b307919ccc7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Returning 404 to user: Instance f7ade4c5-7f11-4df8-9775-7e790e4e4435 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:34:17.468261 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0b9e4759-c4a1-4273-aae4-1b307919ccc7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f7ade4c5-7f11-4df8-9775-7e790e4e4435" status: 404 len: 111 microversion: 2.1 time: 0.061980 Oct 23 01:34:17.468261 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2546/5169] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:34:17 2022] DELETE /compute/v2.1/servers/f7ade4c5-7f11-4df8-9775-7e790e4e4435 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:34:17.479737 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3864eca2-49ac-4b78-a728-1b5acd1a4f7a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:17.480381 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3864eca2-49ac-4b78-a728-1b5acd1a4f7a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: f7ade4c5-7f11-4df8-9775-7e790e4e4435] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:17.489533 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3864eca2-49ac-4b78-a728-1b5acd1a4f7a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:17.490251 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3864eca2-49ac-4b78-a728-1b5acd1a4f7a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:17.496322 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3864eca2-49ac-4b78-a728-1b5acd1a4f7a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:17.496322 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3864eca2-49ac-4b78-a728-1b5acd1a4f7a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:17.496322 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3864eca2-49ac-4b78-a728-1b5acd1a4f7a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:17.496322 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3864eca2-49ac-4b78-a728-1b5acd1a4f7a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:17.518691 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-3864eca2-49ac-4b78-a728-1b5acd1a4f7a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] HTTP exception thrown: Instance f7ade4c5-7f11-4df8-9775-7e790e4e4435 could not be found. Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3864eca2-49ac-4b78-a728-1b5acd1a4f7a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Request method failure captured: Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/f7ade4c5-7f11-4df8-9775-7e790e4e4435 HTTP/1.1 Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJkiigL5TCEu6eSSAcyvyVmYwcN25zFDHPVJqRKHbtxzIEn87jCeqAfp7Z9r3Mqhyb3sj4ihzI_o6sMFkrbUwNL-zNG9d9yXVxVjtum4uC7NU-HTDI6Yq0W2nY2ZxVUGKOV2HfdfrtC_JKFgX2qnR1YVSIaIVW5JxazPUN9LbJjq984 Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: e2ee2ea8399e42a5a5cd0d0ddeb192b5 Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServersTestJSON-245534565 Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}] Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServersTestJSON-245534565 Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: e2ee2ea8399e42a5a5cd0d0ddeb192b5 Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServersTestJSON-245534565 Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServersTestJSON-245534565-project Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 77197152ea5040bab602d5381d21341a Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServersTestJSON-245534565-project Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: exception: Instance f7ade4c5-7f11-4df8-9775-7e790e4e4435 could not be found. Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'f7ade4c5-7f11-4df8-9775-7e790e4e4435'} Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7ade4c5-7f11-4df8-9775-7e790e4e4435 could not be found. Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7ade4c5-7f11-4df8-9775-7e790e4e4435 could not be found. Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.525072 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:17.531053 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:34:17.531053 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:34:17.531053 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:34:17.531053 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:34:17.531053 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7ade4c5-7f11-4df8-9775-7e790e4e4435 could not be found. Oct 23 01:34:17.531053 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.531053 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3864eca2-49ac-4b78-a728-1b5acd1a4f7a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Returning 404 to user: Instance f7ade4c5-7f11-4df8-9775-7e790e4e4435 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:34:17.531053 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3864eca2-49ac-4b78-a728-1b5acd1a4f7a tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/f7ade4c5-7f11-4df8-9775-7e790e4e4435" status: 404 len: 111 microversion: 2.1 time: 0.051497 Oct 23 01:34:17.531053 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2547/5170] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:17 2022] GET /compute/v2.1/servers/f7ade4c5-7f11-4df8-9775-7e790e4e4435 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:34:17.532207 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2a7e894d-136f-4110-9c20-8a46b54eb312 tempest-VolumesTestJSON-690560218 tempest-VolumesTestJSON-690560218-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/b83150e4-2a2e-44ce-a18a-eac95a508b94" status: 200 len: 350 microversion: 2.1 time: 0.096033 Oct 23 01:34:17.532207 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2624/5171] 10.222.0.42 () {58 vars in 1245 bytes} [Sun Oct 23 01:34:17 2022] GET /compute/v2.1/os-volumes/b83150e4-2a2e-44ce-a18a-eac95a508b94 => generated 350 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:34:17.535549 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f1aa0958-5296-4701-9329-5fe7e83b68e7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:17.536335 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f1aa0958-5296-4701-9329-5fe7e83b68e7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 8e4ff17b-af17-4eec-aad8-966fa0ca835b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:17.544713 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f1aa0958-5296-4701-9329-5fe7e83b68e7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:17.545583 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f1aa0958-5296-4701-9329-5fe7e83b68e7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:17.546261 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f1aa0958-5296-4701-9329-5fe7e83b68e7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:17.547190 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f1aa0958-5296-4701-9329-5fe7e83b68e7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:17.548268 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f1aa0958-5296-4701-9329-5fe7e83b68e7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:17.549389 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f1aa0958-5296-4701-9329-5fe7e83b68e7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:17.572129 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-f1aa0958-5296-4701-9329-5fe7e83b68e7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] HTTP exception thrown: Instance 8e4ff17b-af17-4eec-aad8-966fa0ca835b could not be found. Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f1aa0958-5296-4701-9329-5fe7e83b68e7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Request method failure captured: Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/servers/8e4ff17b-af17-4eec-aad8-966fa0ca835b HTTP/1.1 Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJkiigL5TCEu6eSSAcyvyVmYwcN25zFDHPVJqRKHbtxzIEn87jCeqAfp7Z9r3Mqhyb3sj4ihzI_o6sMFkrbUwNL-zNG9d9yXVxVjtum4uC7NU-HTDI6Yq0W2nY2ZxVUGKOV2HfdfrtC_JKFgX2qnR1YVSIaIVW5JxazPUN9LbJjq984 Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: e2ee2ea8399e42a5a5cd0d0ddeb192b5 Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServersTestJSON-245534565 Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}] Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServersTestJSON-245534565 Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: e2ee2ea8399e42a5a5cd0d0ddeb192b5 Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServersTestJSON-245534565 Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServersTestJSON-245534565-project Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 77197152ea5040bab602d5381d21341a Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServersTestJSON-245534565-project Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 8e4ff17b-af17-4eec-aad8-966fa0ca835b could not be found. Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '8e4ff17b-af17-4eec-aad8-966fa0ca835b'} Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e4ff17b-af17-4eec-aad8-966fa0ca835b could not be found. Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:34:17.574451 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e4ff17b-af17-4eec-aad8-966fa0ca835b could not be found. Oct 23 01:34:17.579571 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.579571 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:34:17.579571 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.579571 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:17.579571 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:34:17.579571 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:34:17.579571 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:34:17.579571 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:34:17.579571 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e4ff17b-af17-4eec-aad8-966fa0ca835b could not be found. Oct 23 01:34:17.579571 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.579571 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f1aa0958-5296-4701-9329-5fe7e83b68e7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Returning 404 to user: Instance 8e4ff17b-af17-4eec-aad8-966fa0ca835b could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:34:17.579571 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f1aa0958-5296-4701-9329-5fe7e83b68e7 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8e4ff17b-af17-4eec-aad8-966fa0ca835b" status: 404 len: 111 microversion: 2.1 time: 0.047138 Oct 23 01:34:17.581553 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2548/5172] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:34:17 2022] DELETE /compute/v2.1/servers/8e4ff17b-af17-4eec-aad8-966fa0ca835b => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:34:17.586114 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-21bd3dc5-5345-4ef6-8417-d0b1fb95db96 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:17.588228 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-21bd3dc5-5345-4ef6-8417-d0b1fb95db96 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 8e4ff17b-af17-4eec-aad8-966fa0ca835b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:17.596798 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-21bd3dc5-5345-4ef6-8417-d0b1fb95db96 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:17.597315 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-21bd3dc5-5345-4ef6-8417-d0b1fb95db96 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:17.597760 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-21bd3dc5-5345-4ef6-8417-d0b1fb95db96 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:17.602631 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-21bd3dc5-5345-4ef6-8417-d0b1fb95db96 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:17.605415 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-21bd3dc5-5345-4ef6-8417-d0b1fb95db96 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:17.605900 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-21bd3dc5-5345-4ef6-8417-d0b1fb95db96 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:17.628030 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-21bd3dc5-5345-4ef6-8417-d0b1fb95db96 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] HTTP exception thrown: Instance 8e4ff17b-af17-4eec-aad8-966fa0ca835b could not be found. Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-21bd3dc5-5345-4ef6-8417-d0b1fb95db96 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Request method failure captured: Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/8e4ff17b-af17-4eec-aad8-966fa0ca835b HTTP/1.1 Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJkiigL5TCEu6eSSAcyvyVmYwcN25zFDHPVJqRKHbtxzIEn87jCeqAfp7Z9r3Mqhyb3sj4ihzI_o6sMFkrbUwNL-zNG9d9yXVxVjtum4uC7NU-HTDI6Yq0W2nY2ZxVUGKOV2HfdfrtC_JKFgX2qnR1YVSIaIVW5JxazPUN9LbJjq984 Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: e2ee2ea8399e42a5a5cd0d0ddeb192b5 Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersTestJSON-245534565 Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}] Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersTestJSON-245534565 Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: e2ee2ea8399e42a5a5cd0d0ddeb192b5 Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersTestJSON-245534565 Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersTestJSON-245534565-project Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 77197152ea5040bab602d5381d21341a Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersTestJSON-245534565-project Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 8e4ff17b-af17-4eec-aad8-966fa0ca835b could not be found. Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '8e4ff17b-af17-4eec-aad8-966fa0ca835b'} Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e4ff17b-af17-4eec-aad8-966fa0ca835b could not be found. Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e4ff17b-af17-4eec-aad8-966fa0ca835b could not be found. Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.649377 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:17.653857 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:34:17.653857 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:34:17.653857 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:34:17.653857 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:34:17.653857 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e4ff17b-af17-4eec-aad8-966fa0ca835b could not be found. Oct 23 01:34:17.653857 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.653857 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-21bd3dc5-5345-4ef6-8417-d0b1fb95db96 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Returning 404 to user: Instance 8e4ff17b-af17-4eec-aad8-966fa0ca835b could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:34:17.653857 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-21bd3dc5-5345-4ef6-8417-d0b1fb95db96 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/8e4ff17b-af17-4eec-aad8-966fa0ca835b" status: 404 len: 111 microversion: 2.1 time: 0.070825 Oct 23 01:34:17.656229 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2625/5173] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:17 2022] GET /compute/v2.1/servers/8e4ff17b-af17-4eec-aad8-966fa0ca835b => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:34:17.664736 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c03e6512-35ed-4881-923e-bdbda7b86bfb tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:17.665075 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c03e6512-35ed-4881-923e-bdbda7b86bfb tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 9c5de49d-999c-44da-a25c-e79327652449] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:17.671864 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c03e6512-35ed-4881-923e-bdbda7b86bfb tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:17.672511 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c03e6512-35ed-4881-923e-bdbda7b86bfb tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:17.672957 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c03e6512-35ed-4881-923e-bdbda7b86bfb tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:17.673667 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c03e6512-35ed-4881-923e-bdbda7b86bfb tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:17.674524 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c03e6512-35ed-4881-923e-bdbda7b86bfb tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:17.675219 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c03e6512-35ed-4881-923e-bdbda7b86bfb tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:17.692716 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-c03e6512-35ed-4881-923e-bdbda7b86bfb tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] HTTP exception thrown: Instance 9c5de49d-999c-44da-a25c-e79327652449 could not be found. Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c03e6512-35ed-4881-923e-bdbda7b86bfb tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Request method failure captured: Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/servers/9c5de49d-999c-44da-a25c-e79327652449 HTTP/1.1 Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJkiigL5TCEu6eSSAcyvyVmYwcN25zFDHPVJqRKHbtxzIEn87jCeqAfp7Z9r3Mqhyb3sj4ihzI_o6sMFkrbUwNL-zNG9d9yXVxVjtum4uC7NU-HTDI6Yq0W2nY2ZxVUGKOV2HfdfrtC_JKFgX2qnR1YVSIaIVW5JxazPUN9LbJjq984 Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: e2ee2ea8399e42a5a5cd0d0ddeb192b5 Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServersTestJSON-245534565 Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}] Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServersTestJSON-245534565 Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: e2ee2ea8399e42a5a5cd0d0ddeb192b5 Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServersTestJSON-245534565 Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServersTestJSON-245534565-project Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 77197152ea5040bab602d5381d21341a Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServersTestJSON-245534565-project Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 9c5de49d-999c-44da-a25c-e79327652449 could not be found. Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '9c5de49d-999c-44da-a25c-e79327652449'} Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c5de49d-999c-44da-a25c-e79327652449 could not be found. Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:34:17.696693 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c5de49d-999c-44da-a25c-e79327652449 could not be found. Oct 23 01:34:17.701472 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.701472 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:34:17.701472 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.701472 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:17.701472 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:34:17.701472 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:34:17.701472 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:34:17.701472 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:34:17.701472 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c5de49d-999c-44da-a25c-e79327652449 could not be found. Oct 23 01:34:17.701472 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.701472 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c03e6512-35ed-4881-923e-bdbda7b86bfb tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Returning 404 to user: Instance 9c5de49d-999c-44da-a25c-e79327652449 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:34:17.701472 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c03e6512-35ed-4881-923e-bdbda7b86bfb tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9c5de49d-999c-44da-a25c-e79327652449" status: 404 len: 111 microversion: 2.1 time: 0.038940 Oct 23 01:34:17.703609 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2549/5174] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:34:17 2022] DELETE /compute/v2.1/servers/9c5de49d-999c-44da-a25c-e79327652449 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:34:17.710008 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-80b26ee2-bcfd-41e8-a065-cf812ff1674e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:17.711047 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-80b26ee2-bcfd-41e8-a065-cf812ff1674e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 9c5de49d-999c-44da-a25c-e79327652449] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:17.722283 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-80b26ee2-bcfd-41e8-a065-cf812ff1674e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:17.726249 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-80b26ee2-bcfd-41e8-a065-cf812ff1674e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:17.728355 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-80b26ee2-bcfd-41e8-a065-cf812ff1674e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:17.729533 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-80b26ee2-bcfd-41e8-a065-cf812ff1674e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:17.731678 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-80b26ee2-bcfd-41e8-a065-cf812ff1674e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:17.732395 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-80b26ee2-bcfd-41e8-a065-cf812ff1674e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:17.752949 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-80b26ee2-bcfd-41e8-a065-cf812ff1674e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] HTTP exception thrown: Instance 9c5de49d-999c-44da-a25c-e79327652449 could not be found. Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-80b26ee2-bcfd-41e8-a065-cf812ff1674e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Request method failure captured: Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/9c5de49d-999c-44da-a25c-e79327652449 HTTP/1.1 Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJkiigL5TCEu6eSSAcyvyVmYwcN25zFDHPVJqRKHbtxzIEn87jCeqAfp7Z9r3Mqhyb3sj4ihzI_o6sMFkrbUwNL-zNG9d9yXVxVjtum4uC7NU-HTDI6Yq0W2nY2ZxVUGKOV2HfdfrtC_JKFgX2qnR1YVSIaIVW5JxazPUN9LbJjq984 Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: e2ee2ea8399e42a5a5cd0d0ddeb192b5 Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersTestJSON-245534565 Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}] Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersTestJSON-245534565 Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: e2ee2ea8399e42a5a5cd0d0ddeb192b5 Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersTestJSON-245534565 Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersTestJSON-245534565-project Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 77197152ea5040bab602d5381d21341a Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersTestJSON-245534565-project Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 9c5de49d-999c-44da-a25c-e79327652449 could not be found. Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '9c5de49d-999c-44da-a25c-e79327652449'} Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c5de49d-999c-44da-a25c-e79327652449 could not be found. Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c5de49d-999c-44da-a25c-e79327652449 could not be found. Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.755661 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:17.760390 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:34:17.760390 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:34:17.760390 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:34:17.760390 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:34:17.760390 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c5de49d-999c-44da-a25c-e79327652449 could not be found. Oct 23 01:34:17.760390 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.762690 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-80b26ee2-bcfd-41e8-a065-cf812ff1674e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Returning 404 to user: Instance 9c5de49d-999c-44da-a25c-e79327652449 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:34:17.764356 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-80b26ee2-bcfd-41e8-a065-cf812ff1674e tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/9c5de49d-999c-44da-a25c-e79327652449" status: 404 len: 111 microversion: 2.1 time: 0.056307 Oct 23 01:34:17.766778 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2626/5175] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:17 2022] GET /compute/v2.1/servers/9c5de49d-999c-44da-a25c-e79327652449 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:34:17.774883 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-731f56a3-3c63-402b-83b4-fe38e0704ba6 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:17.780814 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-731f56a3-3c63-402b-83b4-fe38e0704ba6 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: a6c0b80d-cedc-4759-9571-9ec63f7a2188] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:17.781006 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-731f56a3-3c63-402b-83b4-fe38e0704ba6 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] HTTP exception thrown: Instance a6c0b80d-cedc-4759-9571-9ec63f7a2188 could not be found. Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-731f56a3-3c63-402b-83b4-fe38e0704ba6 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Request method failure captured: Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/servers/a6c0b80d-cedc-4759-9571-9ec63f7a2188 HTTP/1.1 Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJkiigL5TCEu6eSSAcyvyVmYwcN25zFDHPVJqRKHbtxzIEn87jCeqAfp7Z9r3Mqhyb3sj4ihzI_o6sMFkrbUwNL-zNG9d9yXVxVjtum4uC7NU-HTDI6Yq0W2nY2ZxVUGKOV2HfdfrtC_JKFgX2qnR1YVSIaIVW5JxazPUN9LbJjq984 Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: e2ee2ea8399e42a5a5cd0d0ddeb192b5 Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServersTestJSON-245534565 Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}] Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServersTestJSON-245534565 Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: e2ee2ea8399e42a5a5cd0d0ddeb192b5 Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServersTestJSON-245534565 Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServersTestJSON-245534565-project Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 77197152ea5040bab602d5381d21341a Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServersTestJSON-245534565-project Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: exception: Instance a6c0b80d-cedc-4759-9571-9ec63f7a2188 could not be found. Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'a6c0b80d-cedc-4759-9571-9ec63f7a2188'} Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6c0b80d-cedc-4759-9571-9ec63f7a2188 could not be found. Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6c0b80d-cedc-4759-9571-9ec63f7a2188 could not be found. Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:34:17.782935 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.791451 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:17.791451 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:34:17.791451 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:34:17.791451 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:34:17.791451 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:34:17.791451 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6c0b80d-cedc-4759-9571-9ec63f7a2188 could not be found. Oct 23 01:34:17.791451 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.791451 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-731f56a3-3c63-402b-83b4-fe38e0704ba6 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Returning 404 to user: Instance a6c0b80d-cedc-4759-9571-9ec63f7a2188 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:34:17.791451 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-731f56a3-3c63-402b-83b4-fe38e0704ba6 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a6c0b80d-cedc-4759-9571-9ec63f7a2188" status: 404 len: 111 microversion: 2.1 time: 0.013230 Oct 23 01:34:17.793524 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6891973f-9c70-44a9-a623-a97cf4fadc35 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:17.794192 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6891973f-9c70-44a9-a623-a97cf4fadc35 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: a6c0b80d-cedc-4759-9571-9ec63f7a2188] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:17.798169 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2550/5176] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:34:17 2022] DELETE /compute/v2.1/servers/a6c0b80d-cedc-4759-9571-9ec63f7a2188 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:34:17.805394 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-6891973f-9c70-44a9-a623-a97cf4fadc35 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] HTTP exception thrown: Instance a6c0b80d-cedc-4759-9571-9ec63f7a2188 could not be found. Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6891973f-9c70-44a9-a623-a97cf4fadc35 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Request method failure captured: Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/a6c0b80d-cedc-4759-9571-9ec63f7a2188 HTTP/1.1 Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJkiigL5TCEu6eSSAcyvyVmYwcN25zFDHPVJqRKHbtxzIEn87jCeqAfp7Z9r3Mqhyb3sj4ihzI_o6sMFkrbUwNL-zNG9d9yXVxVjtum4uC7NU-HTDI6Yq0W2nY2ZxVUGKOV2HfdfrtC_JKFgX2qnR1YVSIaIVW5JxazPUN9LbJjq984 Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: e2ee2ea8399e42a5a5cd0d0ddeb192b5 Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersTestJSON-245534565 Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}] Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersTestJSON-245534565 Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: e2ee2ea8399e42a5a5cd0d0ddeb192b5 Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersTestJSON-245534565 Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersTestJSON-245534565-project Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 77197152ea5040bab602d5381d21341a Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersTestJSON-245534565-project Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: exception: Instance a6c0b80d-cedc-4759-9571-9ec63f7a2188 could not be found. Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'a6c0b80d-cedc-4759-9571-9ec63f7a2188'} Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6c0b80d-cedc-4759-9571-9ec63f7a2188 could not be found. Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6c0b80d-cedc-4759-9571-9ec63f7a2188 could not be found. Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:34:17.809053 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:34:17.815478 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:34:17.815478 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:34:17.815478 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6c0b80d-cedc-4759-9571-9ec63f7a2188 could not be found. Oct 23 01:34:17.815478 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:34:17.817044 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6891973f-9c70-44a9-a623-a97cf4fadc35 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Returning 404 to user: Instance a6c0b80d-cedc-4759-9571-9ec63f7a2188 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:34:17.818390 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6891973f-9c70-44a9-a623-a97cf4fadc35 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/a6c0b80d-cedc-4759-9571-9ec63f7a2188" status: 404 len: 111 microversion: 2.1 time: 0.028581 Oct 23 01:34:17.825203 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2627/5177] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:17 2022] GET /compute/v2.1/servers/a6c0b80d-cedc-4759-9571-9ec63f7a2188 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:34:17.831686 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d648dac4-c898-45b2-9afe-b212efda8f35 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:17.833156 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d648dac4-c898-45b2-9afe-b212efda8f35 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 9540f923-c640-45de-a49a-26008adab3ca] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:17.846130 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d648dac4-c898-45b2-9afe-b212efda8f35 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:17.846855 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d648dac4-c898-45b2-9afe-b212efda8f35 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:17.847496 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d648dac4-c898-45b2-9afe-b212efda8f35 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:17.849146 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d648dac4-c898-45b2-9afe-b212efda8f35 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:17.849828 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d648dac4-c898-45b2-9afe-b212efda8f35 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:17.850484 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d648dac4-c898-45b2-9afe-b212efda8f35 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:17.885842 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d648dac4-c898-45b2-9afe-b212efda8f35 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 9540f923-c640-45de-a49a-26008adab3ca] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:34:17.940016 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6b238f4a-7880-4aa9-9902-cc0e39a57942 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:17.943458 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6b238f4a-7880-4aa9-9902-cc0e39a57942 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:17.959803 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b238f4a-7880-4aa9-9902-cc0e39a57942 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:17.960317 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b238f4a-7880-4aa9-9902-cc0e39a57942 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:17.960764 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b238f4a-7880-4aa9-9902-cc0e39a57942 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:17.963664 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b238f4a-7880-4aa9-9902-cc0e39a57942 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:17.966839 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b238f4a-7880-4aa9-9902-cc0e39a57942 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:17.966839 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b238f4a-7880-4aa9-9902-cc0e39a57942 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:18.246315 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d648dac4-c898-45b2-9afe-b212efda8f35 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9540f923-c640-45de-a49a-26008adab3ca" status: 204 len: 0 microversion: 2.1 time: 0.420401 Oct 23 01:34:18.250764 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2551/5178] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:34:17 2022] DELETE /compute/v2.1/servers/9540f923-c640-45de-a49a-26008adab3ca => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:34:18.269404 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b18f1588-2c90-4682-a2ac-223ea569c90f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:18.272844 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b18f1588-2c90-4682-a2ac-223ea569c90f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:18.281552 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b18f1588-2c90-4682-a2ac-223ea569c90f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:18.283081 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b18f1588-2c90-4682-a2ac-223ea569c90f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:18.283628 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b18f1588-2c90-4682-a2ac-223ea569c90f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:18.284493 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6b238f4a-7880-4aa9-9902-cc0e39a57942 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:18.284991 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b18f1588-2c90-4682-a2ac-223ea569c90f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:18.285127 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b18f1588-2c90-4682-a2ac-223ea569c90f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:18.286248 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b18f1588-2c90-4682-a2ac-223ea569c90f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:18.295252 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6b238f4a-7880-4aa9-9902-cc0e39a57942 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 200 len: 1315 microversion: 2.1 time: 0.361796 Oct 23 01:34:18.298461 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2628/5179] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:17 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 1315 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:18.307430 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-06f9fafc-6b58-43ff-baf0-449b412257fb tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:18.309910 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-06f9fafc-6b58-43ff-baf0-449b412257fb tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 9540f923-c640-45de-a49a-26008adab3ca] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:18.325338 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-06f9fafc-6b58-43ff-baf0-449b412257fb tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:18.326170 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-06f9fafc-6b58-43ff-baf0-449b412257fb tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:18.326828 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-06f9fafc-6b58-43ff-baf0-449b412257fb tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:18.327862 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-06f9fafc-6b58-43ff-baf0-449b412257fb tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:18.328521 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-06f9fafc-6b58-43ff-baf0-449b412257fb tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:18.329179 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-06f9fafc-6b58-43ff-baf0-449b412257fb tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:18.689888 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-06f9fafc-6b58-43ff-baf0-449b412257fb tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:18.693914 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b18f1588-2c90-4682-a2ac-223ea569c90f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:18.703705 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b18f1588-2c90-4682-a2ac-223ea569c90f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1671 microversion: 2.1 time: 0.449647 Oct 23 01:34:18.718717 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2552/5180] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:18 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1671 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:18.721718 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-06f9fafc-6b58-43ff-baf0-449b412257fb tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/9540f923-c640-45de-a49a-26008adab3ca" status: 200 len: 1479 microversion: 2.1 time: 0.421549 Oct 23 01:34:18.727619 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2629/5181] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:18 2022] GET /compute/v2.1/servers/9540f923-c640-45de-a49a-26008adab3ca => generated 1479 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:18.730696 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-cb8a0c5f-d27c-4779-afae-bf0b97ae9451 req-bfd89910-41b7-46d5-b6ed-d173ce6201fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71362f74-5a83-466a-b7be-de2a87253559", "name": "network-vif-plugged", "status": "completed", "tag": "f30f4cf4-1b9d-4bf3-af09-74938e70131b"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:34:18.732603 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-91612082-268e-4a43-9257-bcf585463a35 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:18.733874 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-91612082-268e-4a43-9257-bcf585463a35 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] [instance: 51f5cae8-033b-466b-99b8-465ea87d2b0e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:18.745354 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-cb8a0c5f-d27c-4779-afae-bf0b97ae9451 req-bfd89910-41b7-46d5-b6ed-d173ce6201fe service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:18.746294 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-cb8a0c5f-d27c-4779-afae-bf0b97ae9451 req-bfd89910-41b7-46d5-b6ed-d173ce6201fe service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:18.746957 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-cb8a0c5f-d27c-4779-afae-bf0b97ae9451 req-bfd89910-41b7-46d5-b6ed-d173ce6201fe service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:18.747245 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-91612082-268e-4a43-9257-bcf585463a35 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:18.748555 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-91612082-268e-4a43-9257-bcf585463a35 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:18.749156 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-91612082-268e-4a43-9257-bcf585463a35 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:18.749882 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-91612082-268e-4a43-9257-bcf585463a35 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:18.750434 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-91612082-268e-4a43-9257-bcf585463a35 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:18.750869 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-91612082-268e-4a43-9257-bcf585463a35 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:18.763397 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-cb8a0c5f-d27c-4779-afae-bf0b97ae9451 req-bfd89910-41b7-46d5-b6ed-d173ce6201fe service nova] Creating event network-vif-plugged:f30f4cf4-1b9d-4bf3-af09-74938e70131b for instance 71362f74-5a83-466a-b7be-de2a87253559 on n-h2-master-1 Oct 23 01:34:18.769461 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-cb8a0c5f-d27c-4779-afae-bf0b97ae9451 req-bfd89910-41b7-46d5-b6ed-d173ce6201fe service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049336 Oct 23 01:34:18.770909 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2553/5182] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:34:18.842956 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-91612082-268e-4a43-9257-bcf585463a35 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b118116bb0734e8496aaa1446e871d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7defb846e6a24a0aadb9de6de5439b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:18.853071 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-91612082-268e-4a43-9257-bcf585463a35 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b118116bb0734e8496aaa1446e871d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7defb846e6a24a0aadb9de6de5439b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:18.855117 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-91612082-268e-4a43-9257-bcf585463a35 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b118116bb0734e8496aaa1446e871d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7defb846e6a24a0aadb9de6de5439b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:18.857197 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-91612082-268e-4a43-9257-bcf585463a35 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] 10.222.0.42 "GET /compute/v2.1/servers/51f5cae8-033b-466b-99b8-465ea87d2b0e" status: 200 len: 1316 microversion: 2.21 time: 0.132267 Oct 23 01:34:18.858706 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2630/5183] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:34:18 2022] GET /compute/v2.1/servers/51f5cae8-033b-466b-99b8-465ea87d2b0e => generated 1316 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:34:19.323655 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b0a4f850-0344-4825-b3e2-eb14de4cc5e9 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:19.323655 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b0a4f850-0344-4825-b3e2-eb14de4cc5e9 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:19.328620 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a5871f1a-8384-470d-80ca-834141a2c017 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1201598645", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-878408985", "security_groups": [{"name": "tempest-secgroup-smoke-625706892"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "6c1f1de9-dc60-471b-af63-8ce2ae2d9c3f"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:34:19.340296 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b0a4f850-0344-4825-b3e2-eb14de4cc5e9 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:19.340802 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b0a4f850-0344-4825-b3e2-eb14de4cc5e9 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:19.341248 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b0a4f850-0344-4825-b3e2-eb14de4cc5e9 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:19.342469 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b0a4f850-0344-4825-b3e2-eb14de4cc5e9 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:19.342469 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b0a4f850-0344-4825-b3e2-eb14de4cc5e9 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:19.342859 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b0a4f850-0344-4825-b3e2-eb14de4cc5e9 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:19.628144 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-a5871f1a-8384-470d-80ca-834141a2c017 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] validate_networks() for [('6c1f1de9-dc60-471b-af63-8ce2ae2d9c3f', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:34:19.748329 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b0a4f850-0344-4825-b3e2-eb14de4cc5e9 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:19.764993 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b0a4f850-0344-4825-b3e2-eb14de4cc5e9 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 200 len: 1315 microversion: 2.1 time: 0.445251 Oct 23 01:34:19.767637 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2631/5184] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:19 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 1315 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:19.773522 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-31e48fa1-b8bf-458c-8d90-113d4bfd656b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:19.786616 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-31e48fa1-b8bf-458c-8d90-113d4bfd656b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:19.798401 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-31e48fa1-b8bf-458c-8d90-113d4bfd656b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:19.798565 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-31e48fa1-b8bf-458c-8d90-113d4bfd656b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:19.799332 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-31e48fa1-b8bf-458c-8d90-113d4bfd656b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:19.805888 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-31e48fa1-b8bf-458c-8d90-113d4bfd656b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:19.806751 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-31e48fa1-b8bf-458c-8d90-113d4bfd656b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:19.807286 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-31e48fa1-b8bf-458c-8d90-113d4bfd656b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:20.136801 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-31e48fa1-b8bf-458c-8d90-113d4bfd656b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:20.147415 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-31e48fa1-b8bf-458c-8d90-113d4bfd656b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1669 microversion: 2.1 time: 0.378175 Oct 23 01:34:20.148797 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2632/5185] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:19 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1669 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:20.165402 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ccfee1ce-e7d3-4f0e-b911-fc89b0da406b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:20.172269 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ccfee1ce-e7d3-4f0e-b911-fc89b0da406b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 9540f923-c640-45de-a49a-26008adab3ca] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:20.182001 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:34:20.183907 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ccfee1ce-e7d3-4f0e-b911-fc89b0da406b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:20.184657 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ccfee1ce-e7d3-4f0e-b911-fc89b0da406b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:20.185521 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ccfee1ce-e7d3-4f0e-b911-fc89b0da406b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:20.186481 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ccfee1ce-e7d3-4f0e-b911-fc89b0da406b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:20.187141 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ccfee1ce-e7d3-4f0e-b911-fc89b0da406b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:20.187784 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ccfee1ce-e7d3-4f0e-b911-fc89b0da406b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:20.427650 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-a5871f1a-8384-470d-80ca-834141a2c017 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Getting quotas for project ef4c34c1a48140f8ae5a69fa0abb2bc7. Resources: dict_keys(['metadata_items']) {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:34:20.436064 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-a5871f1a-8384-470d-80ca-834141a2c017 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Getting quotas for user be1759290b0b4034ad9d312abb95ef46 and project ef4c34c1a48140f8ae5a69fa0abb2bc7. Resources: dict_keys(['metadata_items']) {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:34:20.436408 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ccfee1ce-e7d3-4f0e-b911-fc89b0da406b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:20.445535 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ccfee1ce-e7d3-4f0e-b911-fc89b0da406b tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/9540f923-c640-45de-a49a-26008adab3ca" status: 200 len: 1479 microversion: 2.1 time: 0.295503 Oct 23 01:34:20.446174 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2633/5186] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:20 2022] GET /compute/v2.1/servers/9540f923-c640-45de-a49a-26008adab3ca => generated 1479 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:20.458353 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-a5871f1a-8384-470d-80ca-834141a2c017 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:34:20.458919 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-a5871f1a-8384-470d-80ca-834141a2c017 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:34:20.459267 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-a5871f1a-8384-470d-80ca-834141a2c017 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:34:20.459684 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-a5871f1a-8384-470d-80ca-834141a2c017 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:34:20.460103 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-a5871f1a-8384-470d-80ca-834141a2c017 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:34:20.462720 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-17c6b372-f35e-4458-9768-fd209611a156 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:20.463331 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-17c6b372-f35e-4458-9768-fd209611a156 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] [instance: 51f5cae8-033b-466b-99b8-465ea87d2b0e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:20.470293 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-17c6b372-f35e-4458-9768-fd209611a156 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:20.477668 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-17c6b372-f35e-4458-9768-fd209611a156 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:20.477668 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-17c6b372-f35e-4458-9768-fd209611a156 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:20.477668 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-17c6b372-f35e-4458-9768-fd209611a156 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:20.477668 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-17c6b372-f35e-4458-9768-fd209611a156 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:20.477668 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-17c6b372-f35e-4458-9768-fd209611a156 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:20.478193 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a5871f1a-8384-470d-80ca-834141a2c017 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:20.478193 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a5871f1a-8384-470d-80ca-834141a2c017 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:20.478193 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a5871f1a-8384-470d-80ca-834141a2c017 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:20.478193 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a5871f1a-8384-470d-80ca-834141a2c017 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:20.478193 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a5871f1a-8384-470d-80ca-834141a2c017 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:20.478193 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a5871f1a-8384-470d-80ca-834141a2c017 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:20.499779 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-a5871f1a-8384-470d-80ca-834141a2c017 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Getting quotas for project ef4c34c1a48140f8ae5a69fa0abb2bc7. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:34:20.509115 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-a5871f1a-8384-470d-80ca-834141a2c017 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Getting quotas for user be1759290b0b4034ad9d312abb95ef46 and project ef4c34c1a48140f8ae5a69fa0abb2bc7. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:34:20.519379 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a5871f1a-8384-470d-80ca-834141a2c017 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:34:20.522706 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a5871f1a-8384-470d-80ca-834141a2c017 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] [instance: bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:34:20.568481 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:34:20.642498 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-17c6b372-f35e-4458-9768-fd209611a156 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b118116bb0734e8496aaa1446e871d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7defb846e6a24a0aadb9de6de5439b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:20.651841 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-17c6b372-f35e-4458-9768-fd209611a156 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b118116bb0734e8496aaa1446e871d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7defb846e6a24a0aadb9de6de5439b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:20.655130 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-17c6b372-f35e-4458-9768-fd209611a156 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b118116bb0734e8496aaa1446e871d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7defb846e6a24a0aadb9de6de5439b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:20.656293 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-17c6b372-f35e-4458-9768-fd209611a156 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] 10.222.0.42 "GET /compute/v2.1/servers/51f5cae8-033b-466b-99b8-465ea87d2b0e" status: 200 len: 1358 microversion: 2.21 time: 0.209158 Oct 23 01:34:20.656926 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2634/5187] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:34:20 2022] GET /compute/v2.1/servers/51f5cae8-033b-466b-99b8-465ea87d2b0e => generated 1358 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:34:20.662929 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2ccad69d-2363-4be7-970a-e9653c56e32a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:34:20.665358 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2ccad69d-2363-4be7-970a-e9653c56e32a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:20.671696 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2ccad69d-2363-4be7-970a-e9653c56e32a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:20.672467 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2ccad69d-2363-4be7-970a-e9653c56e32a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:20.673114 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2ccad69d-2363-4be7-970a-e9653c56e32a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:20.673805 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2ccad69d-2363-4be7-970a-e9653c56e32a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:20.674529 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2ccad69d-2363-4be7-970a-e9653c56e32a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:20.675274 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2ccad69d-2363-4be7-970a-e9653c56e32a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:20.700473 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a5871f1a-8384-470d-80ca-834141a2c017 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.393643 Oct 23 01:34:20.701787 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2554/5188] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:34:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 1396 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:34:20.707416 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-93e65563-d830-4e84-b707-c7e800aa826a tempest-VolumesTestJSON-690560218 tempest-VolumesTestJSON-690560218-project] Calling method '.version_select at 0x7f5cc18210d0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:20.744949 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2ccad69d-2363-4be7-970a-e9653c56e32a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "POST /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98/action" status: 200 len: 322 microversion: 2.1 time: 0.086144 Oct 23 01:34:20.751476 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2635/5189] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:34:20 2022] POST /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98/action => generated 322 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:34:20.759104 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-27261118-1251-42ec-abd3-55154957c7aa tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:20.759104 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-27261118-1251-42ec-abd3-55154957c7aa tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] [instance: bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:20.794067 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-93e65563-d830-4e84-b707-c7e800aa826a tempest-VolumesTestJSON-690560218 tempest-VolumesTestJSON-690560218-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/cb9e64b8-76c6-4290-89ca-474b8603b462" status: 200 len: 349 microversion: 2.1 time: 0.090941 Oct 23 01:34:20.794706 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2555/5190] 10.222.0.42 () {58 vars in 1245 bytes} [Sun Oct 23 01:34:20 2022] GET /compute/v2.1/os-volumes/cb9e64b8-76c6-4290-89ca-474b8603b462 => generated 349 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:34:20.800822 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e1631e21-f0ab-4c98-a127-366e5c1b9466 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:20.803018 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e1631e21-f0ab-4c98-a127-366e5c1b9466 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:20.813771 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e1631e21-f0ab-4c98-a127-366e5c1b9466 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:20.813771 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e1631e21-f0ab-4c98-a127-366e5c1b9466 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:20.813771 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e1631e21-f0ab-4c98-a127-366e5c1b9466 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:20.814071 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e1631e21-f0ab-4c98-a127-366e5c1b9466 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:20.814914 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e1631e21-f0ab-4c98-a127-366e5c1b9466 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:20.815355 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e1631e21-f0ab-4c98-a127-366e5c1b9466 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:20.844596 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-27261118-1251-42ec-abd3-55154957c7aa tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1759290b0b4034ad9d312abb95ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4c34c1a48140f8ae5a69fa0abb2bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:20.853968 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-27261118-1251-42ec-abd3-55154957c7aa tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] 10.222.0.42 "GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12" status: 200 len: 1302 microversion: 2.1 time: 0.101030 Oct 23 01:34:20.873664 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2636/5191] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:20 2022] GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12 => generated 1302 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:20.888426 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-eb053d8b-abac-4380-b08f-dff16f704a9c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:20.892873 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-eb053d8b-abac-4380-b08f-dff16f704a9c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:20.902737 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb053d8b-abac-4380-b08f-dff16f704a9c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:20.903279 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb053d8b-abac-4380-b08f-dff16f704a9c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:20.903704 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb053d8b-abac-4380-b08f-dff16f704a9c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:20.904421 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb053d8b-abac-4380-b08f-dff16f704a9c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:20.905098 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb053d8b-abac-4380-b08f-dff16f704a9c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:20.906048 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb053d8b-abac-4380-b08f-dff16f704a9c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:21.102227 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e1631e21-f0ab-4c98-a127-366e5c1b9466 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:21.112679 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e1631e21-f0ab-4c98-a127-366e5c1b9466 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1669 microversion: 2.1 time: 0.316672 Oct 23 01:34:21.114116 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2556/5192] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:20 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1669 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:21.162236 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-eb053d8b-abac-4380-b08f-dff16f704a9c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:21.172329 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-eb053d8b-abac-4380-b08f-dff16f704a9c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 200 len: 1315 microversion: 2.1 time: 0.295518 Oct 23 01:34:21.173141 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2637/5193] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:20 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 1315 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:21.208919 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4875af35-fe19-4d0f-a2a5-2f004eb6ae59 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:21.209551 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4875af35-fe19-4d0f-a2a5-2f004eb6ae59 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:21.215481 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4875af35-fe19-4d0f-a2a5-2f004eb6ae59 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:21.215965 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4875af35-fe19-4d0f-a2a5-2f004eb6ae59 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:21.216392 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4875af35-fe19-4d0f-a2a5-2f004eb6ae59 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:21.217268 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4875af35-fe19-4d0f-a2a5-2f004eb6ae59 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:21.217900 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4875af35-fe19-4d0f-a2a5-2f004eb6ae59 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:21.218343 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4875af35-fe19-4d0f-a2a5-2f004eb6ae59 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:21.387812 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-57a244cf-3e7b-47c8-9bbb-9d43361017c0 req-33565d86-f201-4807-b1a2-a9a37b7514f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9540f923-c640-45de-a49a-26008adab3ca", "name": "network-vif-deleted", "tag": "8258ae4e-b95f-4244-9928-2d8b2203a41f"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:34:21.407703 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4875af35-fe19-4d0f-a2a5-2f004eb6ae59 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:21.416767 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-57a244cf-3e7b-47c8-9bbb-9d43361017c0 req-33565d86-f201-4807-b1a2-a9a37b7514f7 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:21.417253 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-57a244cf-3e7b-47c8-9bbb-9d43361017c0 req-33565d86-f201-4807-b1a2-a9a37b7514f7 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:21.418264 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-57a244cf-3e7b-47c8-9bbb-9d43361017c0 req-33565d86-f201-4807-b1a2-a9a37b7514f7 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:21.418698 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4875af35-fe19-4d0f-a2a5-2f004eb6ae59 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1669 microversion: 2.1 time: 0.213009 Oct 23 01:34:21.419838 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2557/5194] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:21 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1669 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:21.440597 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-57a244cf-3e7b-47c8-9bbb-9d43361017c0 req-33565d86-f201-4807-b1a2-a9a37b7514f7 service nova] Creating event network-vif-deleted:8258ae4e-b95f-4244-9928-2d8b2203a41f for instance 9540f923-c640-45de-a49a-26008adab3ca on n-h2-master-1 Oct 23 01:34:21.444061 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4b5fbc4f-6216-47c3-bcd1-8789e8f20be4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:21.444509 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4b5fbc4f-6216-47c3-bcd1-8789e8f20be4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:21.450350 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-57a244cf-3e7b-47c8-9bbb-9d43361017c0 req-33565d86-f201-4807-b1a2-a9a37b7514f7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071379 Oct 23 01:34:21.450675 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b5fbc4f-6216-47c3-bcd1-8789e8f20be4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:21.451189 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2638/5195] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:34:21.451495 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b5fbc4f-6216-47c3-bcd1-8789e8f20be4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:21.451952 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b5fbc4f-6216-47c3-bcd1-8789e8f20be4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:21.452710 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b5fbc4f-6216-47c3-bcd1-8789e8f20be4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:21.453097 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b5fbc4f-6216-47c3-bcd1-8789e8f20be4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:21.453520 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b5fbc4f-6216-47c3-bcd1-8789e8f20be4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:21.472647 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-49b80849-08fd-4ad5-b6a7-98e9174d5829 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:21.474583 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-49b80849-08fd-4ad5-b6a7-98e9174d5829 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 9540f923-c640-45de-a49a-26008adab3ca] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:21.484086 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-49b80849-08fd-4ad5-b6a7-98e9174d5829 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:21.498256 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-49b80849-08fd-4ad5-b6a7-98e9174d5829 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:21.499241 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-49b80849-08fd-4ad5-b6a7-98e9174d5829 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:21.502194 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-49b80849-08fd-4ad5-b6a7-98e9174d5829 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:21.504999 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-49b80849-08fd-4ad5-b6a7-98e9174d5829 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:21.505634 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-49b80849-08fd-4ad5-b6a7-98e9174d5829 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:21.627010 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-49b80849-08fd-4ad5-b6a7-98e9174d5829 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77197152ea5040bab602d5381d21341a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:21.629942 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:34:21.639679 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-49b80849-08fd-4ad5-b6a7-98e9174d5829 tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/9540f923-c640-45de-a49a-26008adab3ca" status: 200 len: 1437 microversion: 2.1 time: 0.173121 Oct 23 01:34:21.641286 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2639/5196] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:21 2022] GET /compute/v2.1/servers/9540f923-c640-45de-a49a-26008adab3ca => generated 1437 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:21.696315 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c5024fb6-3626-4109-b02b-9a1a4551d28f tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:21.697054 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c5024fb6-3626-4109-b02b-9a1a4551d28f tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] [instance: 51f5cae8-033b-466b-99b8-465ea87d2b0e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:21.707162 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c5024fb6-3626-4109-b02b-9a1a4551d28f tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:21.708222 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c5024fb6-3626-4109-b02b-9a1a4551d28f tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:21.708668 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c5024fb6-3626-4109-b02b-9a1a4551d28f tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:21.709434 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c5024fb6-3626-4109-b02b-9a1a4551d28f tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:21.710055 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c5024fb6-3626-4109-b02b-9a1a4551d28f tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:21.710626 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c5024fb6-3626-4109-b02b-9a1a4551d28f tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:21.861103 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4b5fbc4f-6216-47c3-bcd1-8789e8f20be4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:21.873938 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4b5fbc4f-6216-47c3-bcd1-8789e8f20be4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1669 microversion: 2.1 time: 0.435133 Oct 23 01:34:21.877209 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2558/5197] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:21 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1669 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:34:21.886927 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2843c103-688d-4a51-9114-3d7d4dd257d2 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:21.898916 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2843c103-688d-4a51-9114-3d7d4dd257d2 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] [instance: bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:21.989494 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2843c103-688d-4a51-9114-3d7d4dd257d2 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1759290b0b4034ad9d312abb95ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4c34c1a48140f8ae5a69fa0abb2bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:22.001811 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c5024fb6-3626-4109-b02b-9a1a4551d28f tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b118116bb0734e8496aaa1446e871d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7defb846e6a24a0aadb9de6de5439b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:22.007870 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2843c103-688d-4a51-9114-3d7d4dd257d2 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] 10.222.0.42 "GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12" status: 200 len: 1302 microversion: 2.1 time: 0.129109 Oct 23 01:34:22.012354 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c5024fb6-3626-4109-b02b-9a1a4551d28f tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b118116bb0734e8496aaa1446e871d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7defb846e6a24a0aadb9de6de5439b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:22.012912 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2559/5198] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:21 2022] GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12 => generated 1302 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:22.015003 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c5024fb6-3626-4109-b02b-9a1a4551d28f tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b118116bb0734e8496aaa1446e871d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7defb846e6a24a0aadb9de6de5439b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:22.017313 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c5024fb6-3626-4109-b02b-9a1a4551d28f tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] 10.222.0.42 "GET /compute/v2.1/servers/51f5cae8-033b-466b-99b8-465ea87d2b0e" status: 200 len: 1358 microversion: 2.21 time: 0.328606 Oct 23 01:34:22.030626 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-03a64cae-96e5-42e5-b08b-63a7bba95a39 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:22.031768 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2640/5199] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:34:21 2022] GET /compute/v2.1/servers/51f5cae8-033b-466b-99b8-465ea87d2b0e => generated 1358 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:34:22.036674 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-03a64cae-96e5-42e5-b08b-63a7bba95a39 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:22.047686 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-03a64cae-96e5-42e5-b08b-63a7bba95a39 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:22.048187 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-03a64cae-96e5-42e5-b08b-63a7bba95a39 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:22.048628 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-03a64cae-96e5-42e5-b08b-63a7bba95a39 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:22.049342 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-03a64cae-96e5-42e5-b08b-63a7bba95a39 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:22.050083 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-03a64cae-96e5-42e5-b08b-63a7bba95a39 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:22.050512 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-03a64cae-96e5-42e5-b08b-63a7bba95a39 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:22.200891 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2f374cf3-e7d3-4191-9ca0-11f71b0021d4 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:22.202685 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2f374cf3-e7d3-4191-9ca0-11f71b0021d4 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:22.218260 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f374cf3-e7d3-4191-9ca0-11f71b0021d4 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:22.219468 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f374cf3-e7d3-4191-9ca0-11f71b0021d4 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:22.220007 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f374cf3-e7d3-4191-9ca0-11f71b0021d4 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:22.221685 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f374cf3-e7d3-4191-9ca0-11f71b0021d4 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:22.222411 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f374cf3-e7d3-4191-9ca0-11f71b0021d4 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:22.223546 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f374cf3-e7d3-4191-9ca0-11f71b0021d4 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:22.260642 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-03a64cae-96e5-42e5-b08b-63a7bba95a39 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:22.271436 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-03a64cae-96e5-42e5-b08b-63a7bba95a39 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1669 microversion: 2.1 time: 0.256676 Oct 23 01:34:22.272259 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2560/5200] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:22 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1669 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:22.403471 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f9c816e7-9a46-4fc3-90f6-f3133e517462 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1711230202", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "bd4b7167-61cf-4f14-9c60-72538a1ed815"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:34:22.514347 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2f374cf3-e7d3-4191-9ca0-11f71b0021d4 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:22.527844 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2f374cf3-e7d3-4191-9ca0-11f71b0021d4 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 200 len: 1503 microversion: 2.1 time: 0.334380 Oct 23 01:34:22.535067 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-f9c816e7-9a46-4fc3-90f6-f3133e517462 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] validate_networks() for [('bd4b7167-61cf-4f14-9c60-72538a1ed815', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:34:22.539241 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2641/5201] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:22 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 1503 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:34:22.567929 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ab39e529-11a4-45ee-b2a1-5c4c00e8bb25 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:34:22.568478 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ab39e529-11a4-45ee-b2a1-5c4c00e8bb25 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:22.586134 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab39e529-11a4-45ee-b2a1-5c4c00e8bb25 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:22.589782 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab39e529-11a4-45ee-b2a1-5c4c00e8bb25 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:22.590415 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab39e529-11a4-45ee-b2a1-5c4c00e8bb25 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:22.591788 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab39e529-11a4-45ee-b2a1-5c4c00e8bb25 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:22.592904 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab39e529-11a4-45ee-b2a1-5c4c00e8bb25 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:22.593139 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab39e529-11a4-45ee-b2a1-5c4c00e8bb25 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:22.643575 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-ab39e529-11a4-45ee-b2a1-5c4c00e8bb25 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lazy-loading 'flavor' on Instance uuid 71362f74-5a83-466a-b7be-de2a87253559 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:34:23.459654 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ab39e529-11a4-45ee-b2a1-5c4c00e8bb25 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "POST /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559/action" status: 202 len: 0 microversion: 2.1 time: 0.902377 Oct 23 01:34:23.460647 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2642/5202] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:34:22 2022] POST /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559/action => generated 0 bytes in 911 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:34:23.466569 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4f338b3d-feee-44c6-9f5a-e738d1feb7aa tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:23.467275 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4f338b3d-feee-44c6-9f5a-e738d1feb7aa tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] [instance: 9540f923-c640-45de-a49a-26008adab3ca] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:23.474440 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f338b3d-feee-44c6-9f5a-e738d1feb7aa tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:23.475236 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f338b3d-feee-44c6-9f5a-e738d1feb7aa tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:23.475854 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f338b3d-feee-44c6-9f5a-e738d1feb7aa tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:23.476824 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f338b3d-feee-44c6-9f5a-e738d1feb7aa tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:23.477473 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f338b3d-feee-44c6-9f5a-e738d1feb7aa tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:23.478176 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f338b3d-feee-44c6-9f5a-e738d1feb7aa tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:23.496008 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-4f338b3d-feee-44c6-9f5a-e738d1feb7aa tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] HTTP exception thrown: Instance 9540f923-c640-45de-a49a-26008adab3ca could not be found. Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4f338b3d-feee-44c6-9f5a-e738d1feb7aa tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Request method failure captured: Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/9540f923-c640-45de-a49a-26008adab3ca HTTP/1.1 Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJkiigL5TCEu6eSSAcyvyVmYwcN25zFDHPVJqRKHbtxzIEn87jCeqAfp7Z9r3Mqhyb3sj4ihzI_o6sMFkrbUwNL-zNG9d9yXVxVjtum4uC7NU-HTDI6Yq0W2nY2ZxVUGKOV2HfdfrtC_JKFgX2qnR1YVSIaIVW5JxazPUN9LbJjq984 Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: e2ee2ea8399e42a5a5cd0d0ddeb192b5 Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersTestJSON-245534565 Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ee2ea8399e42a5a5cd0d0ddeb192b5"}]}] Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersTestJSON-245534565 Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: e2ee2ea8399e42a5a5cd0d0ddeb192b5 Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersTestJSON-245534565 Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersTestJSON-245534565-project Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 77197152ea5040bab602d5381d21341a Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersTestJSON-245534565-project Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 9540f923-c640-45de-a49a-26008adab3ca could not be found. Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '9540f923-c640-45de-a49a-26008adab3ca'} Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9540f923-c640-45de-a49a-26008adab3ca could not be found. Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9540f923-c640-45de-a49a-26008adab3ca could not be found. Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:34:23.497736 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:23.503412 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:34:23.503412 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:34:23.503412 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:34:23.503412 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:34:23.503412 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9540f923-c640-45de-a49a-26008adab3ca could not be found. Oct 23 01:34:23.503412 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:34:23.503412 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4f338b3d-feee-44c6-9f5a-e738d1feb7aa tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] Returning 404 to user: Instance 9540f923-c640-45de-a49a-26008adab3ca could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:34:23.503412 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4f338b3d-feee-44c6-9f5a-e738d1feb7aa tempest-ServersTestJSON-245534565 tempest-ServersTestJSON-245534565-project] 10.222.0.42 "GET /compute/v2.1/servers/9540f923-c640-45de-a49a-26008adab3ca" status: 404 len: 111 microversion: 2.1 time: 0.037268 Oct 23 01:34:23.503412 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2643/5203] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:23 2022] GET /compute/v2.1/servers/9540f923-c640-45de-a49a-26008adab3ca => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:34:23.509232 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-30d94142-2d73-4ef1-86b5-a9707e0e42a3 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:23.510139 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-30d94142-2d73-4ef1-86b5-a9707e0e42a3 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] [instance: bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:23.517047 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-30d94142-2d73-4ef1-86b5-a9707e0e42a3 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:23.518281 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-30d94142-2d73-4ef1-86b5-a9707e0e42a3 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:23.518875 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-30d94142-2d73-4ef1-86b5-a9707e0e42a3 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:23.520355 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-30d94142-2d73-4ef1-86b5-a9707e0e42a3 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:23.520977 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-30d94142-2d73-4ef1-86b5-a9707e0e42a3 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:23.521564 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-30d94142-2d73-4ef1-86b5-a9707e0e42a3 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:23.533190 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-f9c816e7-9a46-4fc3-90f6-f3133e517462 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:34:23.533694 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-f9c816e7-9a46-4fc3-90f6-f3133e517462 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:34:23.534205 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-f9c816e7-9a46-4fc3-90f6-f3133e517462 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:34:23.534829 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-f9c816e7-9a46-4fc3-90f6-f3133e517462 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:34:23.535314 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-f9c816e7-9a46-4fc3-90f6-f3133e517462 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:34:23.555636 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f9c816e7-9a46-4fc3-90f6-f3133e517462 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:23.556458 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f9c816e7-9a46-4fc3-90f6-f3133e517462 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:23.557080 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f9c816e7-9a46-4fc3-90f6-f3133e517462 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:23.558087 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f9c816e7-9a46-4fc3-90f6-f3133e517462 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:23.558711 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f9c816e7-9a46-4fc3-90f6-f3133e517462 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:23.559318 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f9c816e7-9a46-4fc3-90f6-f3133e517462 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:23.588208 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-f9c816e7-9a46-4fc3-90f6-f3133e517462 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Getting quotas for project aa4e3018a6ca477c9a1d7215ad98d9e9. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:34:23.599937 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-f9c816e7-9a46-4fc3-90f6-f3133e517462 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Getting quotas for user bb03047092f64e2abbf78e9db1a06e0a and project aa4e3018a6ca477c9a1d7215ad98d9e9. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:34:23.619318 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f9c816e7-9a46-4fc3-90f6-f3133e517462 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:34:23.622176 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f9c816e7-9a46-4fc3-90f6-f3133e517462 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 740c5d14-9669-45e2-9ba9-723926f774ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:34:23.673605 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-30d94142-2d73-4ef1-86b5-a9707e0e42a3 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1759290b0b4034ad9d312abb95ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4c34c1a48140f8ae5a69fa0abb2bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:23.688783 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-30d94142-2d73-4ef1-86b5-a9707e0e42a3 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] 10.222.0.42 "GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12" status: 200 len: 1354 microversion: 2.1 time: 0.179142 Oct 23 01:34:23.688783 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2644/5204] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:23 2022] GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12 => generated 1354 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:23.693759 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4b315784-497c-42bf-ab66-93e3a422bc09 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:23.694465 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4b315784-497c-42bf-ab66-93e3a422bc09 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] [instance: 51f5cae8-033b-466b-99b8-465ea87d2b0e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:23.702274 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4b315784-497c-42bf-ab66-93e3a422bc09 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:23.703042 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4b315784-497c-42bf-ab66-93e3a422bc09 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:23.703666 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4b315784-497c-42bf-ab66-93e3a422bc09 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:23.704698 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4b315784-497c-42bf-ab66-93e3a422bc09 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:23.705604 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4b315784-497c-42bf-ab66-93e3a422bc09 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:23.706288 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4b315784-497c-42bf-ab66-93e3a422bc09 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:23.811371 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f9c816e7-9a46-4fc3-90f6-f3133e517462 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.411887 Oct 23 01:34:23.812344 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2561/5205] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:34:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1414 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:34:23.823025 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a98db508-55bc-44e8-a2b7-32928d267a84 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:23.824321 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a98db508-55bc-44e8-a2b7-32928d267a84 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:23.836014 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a98db508-55bc-44e8-a2b7-32928d267a84 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:23.836867 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a98db508-55bc-44e8-a2b7-32928d267a84 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:23.838869 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a98db508-55bc-44e8-a2b7-32928d267a84 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:23.840794 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a98db508-55bc-44e8-a2b7-32928d267a84 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:23.841502 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a98db508-55bc-44e8-a2b7-32928d267a84 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:23.842192 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a98db508-55bc-44e8-a2b7-32928d267a84 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:23.993010 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4b315784-497c-42bf-ab66-93e3a422bc09 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b118116bb0734e8496aaa1446e871d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7defb846e6a24a0aadb9de6de5439b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:24.020010 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4b315784-497c-42bf-ab66-93e3a422bc09 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b118116bb0734e8496aaa1446e871d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7defb846e6a24a0aadb9de6de5439b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:24.020010 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4b315784-497c-42bf-ab66-93e3a422bc09 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b118116bb0734e8496aaa1446e871d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7defb846e6a24a0aadb9de6de5439b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:24.020010 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4b315784-497c-42bf-ab66-93e3a422bc09 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] 10.222.0.42 "GET /compute/v2.1/servers/51f5cae8-033b-466b-99b8-465ea87d2b0e" status: 200 len: 1358 microversion: 2.21 time: 0.329178 Oct 23 01:34:24.020010 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2645/5206] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:34:23 2022] GET /compute/v2.1/servers/51f5cae8-033b-466b-99b8-465ea87d2b0e => generated 1358 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:34:24.039935 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-a700beef-ff6b-47e2-b910-53cc25bf6c01 req-b1a9417f-c79e-4eb6-ab26-7cbf004c1f1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51f5cae8-033b-466b-99b8-465ea87d2b0e", "tag": "405ad75e-86e5-40f3-9630-b16d294a1173"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:34:24.068742 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-a700beef-ff6b-47e2-b910-53cc25bf6c01 req-b1a9417f-c79e-4eb6-ab26-7cbf004c1f1d service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:24.069234 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-a700beef-ff6b-47e2-b910-53cc25bf6c01 req-b1a9417f-c79e-4eb6-ab26-7cbf004c1f1d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:24.073372 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-a700beef-ff6b-47e2-b910-53cc25bf6c01 req-b1a9417f-c79e-4eb6-ab26-7cbf004c1f1d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:24.096261 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-a700beef-ff6b-47e2-b910-53cc25bf6c01 req-b1a9417f-c79e-4eb6-ab26-7cbf004c1f1d service nova] Creating event network-changed:405ad75e-86e5-40f3-9630-b16d294a1173 for instance 51f5cae8-033b-466b-99b8-465ea87d2b0e on n-h1-master-1 Oct 23 01:34:24.103127 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-a700beef-ff6b-47e2-b910-53cc25bf6c01 req-b1a9417f-c79e-4eb6-ab26-7cbf004c1f1d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071349 Oct 23 01:34:24.104478 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2646/5207] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:34:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:34:24.110074 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-674cfc8b-e226-4299-b615-ac0739fb9249 tempest-VolumesTestJSON-690560218 tempest-VolumesTestJSON-690560218-project] Calling method '.version_select at 0x7f5cc108e280>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:24.167190 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a98db508-55bc-44e8-a2b7-32928d267a84 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:24.175422 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a98db508-55bc-44e8-a2b7-32928d267a84 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 200 len: 1509 microversion: 2.1 time: 0.361443 Oct 23 01:34:24.190480 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2562/5208] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:23 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 1509 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:24.194848 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-674cfc8b-e226-4299-b615-ac0739fb9249 tempest-VolumesTestJSON-690560218 tempest-VolumesTestJSON-690560218-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/6fd1713e-c6f6-4240-95f1-3f716d305800" status: 200 len: 349 microversion: 2.1 time: 0.088829 Oct 23 01:34:24.195546 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2647/5209] 10.222.0.42 () {58 vars in 1245 bytes} [Sun Oct 23 01:34:24 2022] GET /compute/v2.1/os-volumes/6fd1713e-c6f6-4240-95f1-3f716d305800 => generated 349 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:34:24.204175 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6da47e4e-d463-4c7e-a943-f88798ac0ea6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:24.206317 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6da47e4e-d463-4c7e-a943-f88798ac0ea6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 740c5d14-9669-45e2-9ba9-723926f774ab] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:24.210557 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-83272fa1-e0ba-4626-be89-62fcbc8937fc tempest-VolumesTestJSON-690560218 tempest-VolumesTestJSON-690560218-project] Calling method '.version_select at 0x7f5cc61b11f0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:24.333109 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-83272fa1-e0ba-4626-be89-62fcbc8937fc tempest-VolumesTestJSON-690560218 tempest-VolumesTestJSON-690560218-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1031 microversion: 2.1 time: 0.127134 Oct 23 01:34:24.334111 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2648/5210] 10.222.0.42 () {58 vars in 1134 bytes} [Sun Oct 23 01:34:24 2022] GET /compute/v2.1/os-volumes => generated 1031 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:34:24.334294 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6da47e4e-d463-4c7e-a943-f88798ac0ea6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:24.358536 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6da47e4e-d463-4c7e-a943-f88798ac0ea6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab" status: 200 len: 1215 microversion: 2.1 time: 0.161447 Oct 23 01:34:24.358536 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2563/5211] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:24 2022] GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab => generated 1215 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:24.364581 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-af007a99-5931-4caf-b7eb-a2688070733c tempest-VolumesTestJSON-690560218 tempest-VolumesTestJSON-690560218-project] Calling method '.version_select at 0x7f5cc0fba310>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:24.492789 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-af007a99-5931-4caf-b7eb-a2688070733c tempest-VolumesTestJSON-690560218 tempest-VolumesTestJSON-690560218-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 691 microversion: 2.1 time: 0.147469 Oct 23 01:34:24.493656 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2649/5212] 10.222.0.42 () {58 vars in 1149 bytes} [Sun Oct 23 01:34:24 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 691 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:34:24.520823 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8f0b249a-46d8-4053-83f8-de1c13b10363 tempest-VolumesTestJSON-690560218 tempest-VolumesTestJSON-690560218-project] Calling method '.version_select at 0x7f5cc1f12c10>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:24.641427 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8f0b249a-46d8-4053-83f8-de1c13b10363 tempest-VolumesTestJSON-690560218 tempest-VolumesTestJSON-690560218-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1031 microversion: 2.1 time: 0.133720 Oct 23 01:34:24.642431 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2564/5213] 10.222.0.42 () {58 vars in 1134 bytes} [Sun Oct 23 01:34:24 2022] GET /compute/v2.1/os-volumes => generated 1031 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:24.657497 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bf5837d2-9abf-418d-bd44-305d60a5ed76 tempest-VolumesTestJSON-690560218 tempest-VolumesTestJSON-690560218-project] Calling method '.version_select at 0x7f5cc0fbaee0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:24.712972 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b195911a-c357-4951-a4c6-d3d3382a88aa tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:24.714018 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b195911a-c357-4951-a4c6-d3d3382a88aa tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] [instance: bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:24.727325 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b195911a-c357-4951-a4c6-d3d3382a88aa tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:24.728455 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b195911a-c357-4951-a4c6-d3d3382a88aa tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:24.729156 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b195911a-c357-4951-a4c6-d3d3382a88aa tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:24.730182 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b195911a-c357-4951-a4c6-d3d3382a88aa tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:24.732628 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b195911a-c357-4951-a4c6-d3d3382a88aa tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:24.733330 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b195911a-c357-4951-a4c6-d3d3382a88aa tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:24.830912 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bf5837d2-9abf-418d-bd44-305d60a5ed76 tempest-VolumesTestJSON-690560218 tempest-VolumesTestJSON-690560218-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.177676 Oct 23 01:34:24.831800 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2650/5214] 10.222.0.42 () {58 vars in 1167 bytes} [Sun Oct 23 01:34:24 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 352 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:34:24.845668 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-29247157-2355-4efc-bc86-fe5c02baa6f4 tempest-VolumesTestJSON-690560218 tempest-VolumesTestJSON-690560218-project] Calling method '.version_select at 0x7f5cc184f0d0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:24.971826 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-29247157-2355-4efc-bc86-fe5c02baa6f4 tempest-VolumesTestJSON-690560218 tempest-VolumesTestJSON-690560218-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 691 microversion: 2.1 time: 0.129966 Oct 23 01:34:24.982464 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2651/5215] 10.222.0.42 () {58 vars in 1170 bytes} [Sun Oct 23 01:34:24 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 691 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:34:24.989709 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e0a5947e-30f4-45e7-8652-794d0da25d2d tempest-VolumesTestJSON-690560218 tempest-VolumesTestJSON-690560218-project] Calling method '.version_select at 0x7f5cc6218670>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:25.125809 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e0a5947e-30f4-45e7-8652-794d0da25d2d tempest-VolumesTestJSON-690560218 tempest-VolumesTestJSON-690560218-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1031 microversion: 2.1 time: 0.140867 Oct 23 01:34:25.135474 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2652/5216] 10.222.0.42 () {58 vars in 1155 bytes} [Sun Oct 23 01:34:24 2022] GET /compute/v2.1/os-volumes/detail => generated 1031 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:34:25.141735 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e28eb16e-53a7-4bdd-a3d1-321c51d429ff tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:25.143090 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e28eb16e-53a7-4bdd-a3d1-321c51d429ff tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] [instance: 51f5cae8-033b-466b-99b8-465ea87d2b0e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:25.156259 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e28eb16e-53a7-4bdd-a3d1-321c51d429ff tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:25.156758 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e28eb16e-53a7-4bdd-a3d1-321c51d429ff tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:25.157596 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e28eb16e-53a7-4bdd-a3d1-321c51d429ff tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:25.162052 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e28eb16e-53a7-4bdd-a3d1-321c51d429ff tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:25.162558 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e28eb16e-53a7-4bdd-a3d1-321c51d429ff tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:25.163191 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e28eb16e-53a7-4bdd-a3d1-321c51d429ff tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:25.307265 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b195911a-c357-4951-a4c6-d3d3382a88aa tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1759290b0b4034ad9d312abb95ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4c34c1a48140f8ae5a69fa0abb2bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:25.333015 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b195911a-c357-4951-a4c6-d3d3382a88aa tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] 10.222.0.42 "GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12" status: 200 len: 1360 microversion: 2.1 time: 0.618906 Oct 23 01:34:25.334023 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2565/5217] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:24 2022] GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12 => generated 1360 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:34:25.351244 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e8fedd8b-1714-4a67-bcd7-8928e8a33756 tempest-VolumesTestJSON-690560218 tempest-VolumesTestJSON-690560218-project] Calling method '.version_select at 0x7f5cc1708ca0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:25.505966 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e8fedd8b-1714-4a67-bcd7-8928e8a33756 tempest-VolumesTestJSON-690560218 tempest-VolumesTestJSON-690560218-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.167820 Oct 23 01:34:25.506846 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2566/5218] 10.222.0.42 () {58 vars in 1188 bytes} [Sun Oct 23 01:34:25 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 352 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:34:25.510000 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e28eb16e-53a7-4bdd-a3d1-321c51d429ff tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b118116bb0734e8496aaa1446e871d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7defb846e6a24a0aadb9de6de5439b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:25.527693 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e28eb16e-53a7-4bdd-a3d1-321c51d429ff tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b118116bb0734e8496aaa1446e871d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7defb846e6a24a0aadb9de6de5439b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:25.531612 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-25b93b6e-d7fc-496a-8889-d1023a4c8e96 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:25.533857 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-25b93b6e-d7fc-496a-8889-d1023a4c8e96 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:25.545420 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e28eb16e-53a7-4bdd-a3d1-321c51d429ff tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b118116bb0734e8496aaa1446e871d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7defb846e6a24a0aadb9de6de5439b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:25.546943 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e28eb16e-53a7-4bdd-a3d1-321c51d429ff tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] 10.222.0.42 "GET /compute/v2.1/servers/51f5cae8-033b-466b-99b8-465ea87d2b0e" status: 200 len: 1358 microversion: 2.21 time: 0.409873 Oct 23 01:34:25.547876 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2653/5219] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:34:25 2022] GET /compute/v2.1/servers/51f5cae8-033b-466b-99b8-465ea87d2b0e => generated 1358 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:34:25.551028 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25b93b6e-d7fc-496a-8889-d1023a4c8e96 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:25.553220 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25b93b6e-d7fc-496a-8889-d1023a4c8e96 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:25.553829 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dec3ba99-5c87-4c74-b603-2d762f2d12bb tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:25.554130 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25b93b6e-d7fc-496a-8889-d1023a4c8e96 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:25.554508 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-dec3ba99-5c87-4c74-b603-2d762f2d12bb tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 740c5d14-9669-45e2-9ba9-723926f774ab] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:25.556036 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25b93b6e-d7fc-496a-8889-d1023a4c8e96 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:25.556954 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25b93b6e-d7fc-496a-8889-d1023a4c8e96 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:25.557778 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25b93b6e-d7fc-496a-8889-d1023a4c8e96 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:25.562171 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dec3ba99-5c87-4c74-b603-2d762f2d12bb tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:25.562682 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dec3ba99-5c87-4c74-b603-2d762f2d12bb tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:25.565356 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dec3ba99-5c87-4c74-b603-2d762f2d12bb tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:25.565356 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dec3ba99-5c87-4c74-b603-2d762f2d12bb tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:25.565356 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dec3ba99-5c87-4c74-b603-2d762f2d12bb tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:25.565356 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dec3ba99-5c87-4c74-b603-2d762f2d12bb tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:25.592605 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:34:25.678587 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-dec3ba99-5c87-4c74-b603-2d762f2d12bb tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:25.700546 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-dec3ba99-5c87-4c74-b603-2d762f2d12bb tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab" status: 200 len: 1211 microversion: 2.1 time: 0.151060 Oct 23 01:34:25.702576 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2654/5220] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:25 2022] GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab => generated 1211 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:25.712830 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-34f3b7f5-fe1f-4db1-9665-1fc6fa1ee07d tempest-VolumesTestJSON-690560218 tempest-VolumesTestJSON-690560218-project] Calling method '.version_select at 0x7f5cc0f89a60>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:25.922929 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-34f3b7f5-fe1f-4db1-9665-1fc6fa1ee07d tempest-VolumesTestJSON-690560218 tempest-VolumesTestJSON-690560218-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1031 microversion: 2.1 time: 0.218953 Oct 23 01:34:25.933324 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2655/5221] 10.222.0.42 () {58 vars in 1155 bytes} [Sun Oct 23 01:34:25 2022] GET /compute/v2.1/os-volumes/detail => generated 1031 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:26.005052 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-25b93b6e-d7fc-496a-8889-d1023a4c8e96 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:26.013321 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-25b93b6e-d7fc-496a-8889-d1023a4c8e96 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 200 len: 1509 microversion: 2.1 time: 0.505087 Oct 23 01:34:26.013926 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2567/5222] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:25 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 1509 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:26.360414 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-66727ec4-e44f-463d-86de-8f786326bd60 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:26.361291 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-66727ec4-e44f-463d-86de-8f786326bd60 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] [instance: bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:26.376631 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-66727ec4-e44f-463d-86de-8f786326bd60 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:26.382032 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-66727ec4-e44f-463d-86de-8f786326bd60 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:26.382606 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-66727ec4-e44f-463d-86de-8f786326bd60 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:26.383384 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-66727ec4-e44f-463d-86de-8f786326bd60 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:26.384977 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-66727ec4-e44f-463d-86de-8f786326bd60 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:26.385095 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-66727ec4-e44f-463d-86de-8f786326bd60 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:26.534826 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-66727ec4-e44f-463d-86de-8f786326bd60 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1759290b0b4034ad9d312abb95ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4c34c1a48140f8ae5a69fa0abb2bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:26.548416 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-66727ec4-e44f-463d-86de-8f786326bd60 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] 10.222.0.42 "GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12" status: 200 len: 1360 microversion: 2.1 time: 0.192622 Oct 23 01:34:26.549029 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2656/5223] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:26 2022] GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12 => generated 1360 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:26.580244 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-09f6434d-3492-42be-9d39-b51a2ba582f0 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:26.581014 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-09f6434d-3492-42be-9d39-b51a2ba582f0 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] [instance: 51f5cae8-033b-466b-99b8-465ea87d2b0e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:26.590372 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09f6434d-3492-42be-9d39-b51a2ba582f0 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:26.591221 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09f6434d-3492-42be-9d39-b51a2ba582f0 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:26.592073 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09f6434d-3492-42be-9d39-b51a2ba582f0 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:26.593072 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09f6434d-3492-42be-9d39-b51a2ba582f0 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:26.593786 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09f6434d-3492-42be-9d39-b51a2ba582f0 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:26.594586 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09f6434d-3492-42be-9d39-b51a2ba582f0 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:26.732816 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-68f4523b-590c-4637-802b-3ca1100e820a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:26.733444 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-68f4523b-590c-4637-802b-3ca1100e820a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 740c5d14-9669-45e2-9ba9-723926f774ab] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:26.746359 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68f4523b-590c-4637-802b-3ca1100e820a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:26.747117 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68f4523b-590c-4637-802b-3ca1100e820a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:26.748291 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68f4523b-590c-4637-802b-3ca1100e820a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:26.751106 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68f4523b-590c-4637-802b-3ca1100e820a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:26.751801 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68f4523b-590c-4637-802b-3ca1100e820a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:26.753149 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68f4523b-590c-4637-802b-3ca1100e820a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:26.884309 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-09f6434d-3492-42be-9d39-b51a2ba582f0 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b118116bb0734e8496aaa1446e871d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7defb846e6a24a0aadb9de6de5439b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:26.896424 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-09f6434d-3492-42be-9d39-b51a2ba582f0 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b118116bb0734e8496aaa1446e871d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7defb846e6a24a0aadb9de6de5439b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:26.899790 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-09f6434d-3492-42be-9d39-b51a2ba582f0 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b118116bb0734e8496aaa1446e871d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7defb846e6a24a0aadb9de6de5439b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:26.903311 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-09f6434d-3492-42be-9d39-b51a2ba582f0 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] 10.222.0.42 "GET /compute/v2.1/servers/51f5cae8-033b-466b-99b8-465ea87d2b0e" status: 200 len: 1358 microversion: 2.21 time: 0.330680 Oct 23 01:34:26.906584 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2568/5224] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:34:26 2022] GET /compute/v2.1/servers/51f5cae8-033b-466b-99b8-465ea87d2b0e => generated 1358 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:34:26.966911 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-68f4523b-590c-4637-802b-3ca1100e820a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:26.982719 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-68f4523b-590c-4637-802b-3ca1100e820a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab" status: 200 len: 1275 microversion: 2.1 time: 0.251827 Oct 23 01:34:26.987190 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2657/5225] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:26 2022] GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab => generated 1275 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:27.038576 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-51e76c57-20ac-4c9d-b9c0-42faa02491f6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:27.039420 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-51e76c57-20ac-4c9d-b9c0-42faa02491f6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:27.058904 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-51e76c57-20ac-4c9d-b9c0-42faa02491f6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:27.059414 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-51e76c57-20ac-4c9d-b9c0-42faa02491f6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:27.069777 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-51e76c57-20ac-4c9d-b9c0-42faa02491f6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:27.070646 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-51e76c57-20ac-4c9d-b9c0-42faa02491f6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:27.075353 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-51e76c57-20ac-4c9d-b9c0-42faa02491f6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:27.075859 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-51e76c57-20ac-4c9d-b9c0-42faa02491f6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:27.563110 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-51e76c57-20ac-4c9d-b9c0-42faa02491f6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:27.575015 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-71435f2c-b6ab-4d55-95a8-684a9f4d6f80 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:27.575735 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-71435f2c-b6ab-4d55-95a8-684a9f4d6f80 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] [instance: bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:27.579797 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-51e76c57-20ac-4c9d-b9c0-42faa02491f6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 200 len: 1509 microversion: 2.1 time: 0.545337 Oct 23 01:34:27.588141 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-71435f2c-b6ab-4d55-95a8-684a9f4d6f80 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:27.589099 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-71435f2c-b6ab-4d55-95a8-684a9f4d6f80 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:27.590049 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-71435f2c-b6ab-4d55-95a8-684a9f4d6f80 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:27.591072 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-71435f2c-b6ab-4d55-95a8-684a9f4d6f80 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:27.591777 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-71435f2c-b6ab-4d55-95a8-684a9f4d6f80 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:27.592426 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-71435f2c-b6ab-4d55-95a8-684a9f4d6f80 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:27.599008 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2569/5226] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:27 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 1509 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:27.862102 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-71435f2c-b6ab-4d55-95a8-684a9f4d6f80 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1759290b0b4034ad9d312abb95ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4c34c1a48140f8ae5a69fa0abb2bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:27.877331 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-71435f2c-b6ab-4d55-95a8-684a9f4d6f80 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] 10.222.0.42 "GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12" status: 200 len: 1427 microversion: 2.1 time: 0.301730 Oct 23 01:34:27.877331 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2658/5227] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:27 2022] GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12 => generated 1427 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:27.938485 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3e4d00cc-c06b-4be7-8fd6-230780846391 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:27.939519 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3e4d00cc-c06b-4be7-8fd6-230780846391 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] [instance: 51f5cae8-033b-466b-99b8-465ea87d2b0e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:27.947109 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3e4d00cc-c06b-4be7-8fd6-230780846391 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:27.947937 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3e4d00cc-c06b-4be7-8fd6-230780846391 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:27.948848 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3e4d00cc-c06b-4be7-8fd6-230780846391 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:27.949783 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3e4d00cc-c06b-4be7-8fd6-230780846391 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:27.950638 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3e4d00cc-c06b-4be7-8fd6-230780846391 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:27.951311 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3e4d00cc-c06b-4be7-8fd6-230780846391 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:28.015021 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4f5d8e2c-ef3c-468e-8a60-a88b7c288093 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:28.016119 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4f5d8e2c-ef3c-468e-8a60-a88b7c288093 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 740c5d14-9669-45e2-9ba9-723926f774ab] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:28.034424 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f5d8e2c-ef3c-468e-8a60-a88b7c288093 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:28.037157 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f5d8e2c-ef3c-468e-8a60-a88b7c288093 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:28.037882 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f5d8e2c-ef3c-468e-8a60-a88b7c288093 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:28.040047 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f5d8e2c-ef3c-468e-8a60-a88b7c288093 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:28.042281 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f5d8e2c-ef3c-468e-8a60-a88b7c288093 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:28.043091 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f5d8e2c-ef3c-468e-8a60-a88b7c288093 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:28.329736 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4f5d8e2c-ef3c-468e-8a60-a88b7c288093 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:28.382746 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4f5d8e2c-ef3c-468e-8a60-a88b7c288093 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab" status: 200 len: 1273 microversion: 2.1 time: 0.374325 Oct 23 01:34:28.390372 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2659/5228] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:28 2022] GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab => generated 1273 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:34:28.401700 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-4140af31-7a0e-4367-a2a7-dd0f220f285e req-429e9f65-4257-40e8-a15e-11ffbb64de91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51f5cae8-033b-466b-99b8-465ea87d2b0e", "name": "network-vif-plugged", "status": "completed", "tag": "405ad75e-86e5-40f3-9630-b16d294a1173"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:34:28.435158 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-4140af31-7a0e-4367-a2a7-dd0f220f285e req-429e9f65-4257-40e8-a15e-11ffbb64de91 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:28.435931 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-4140af31-7a0e-4367-a2a7-dd0f220f285e req-429e9f65-4257-40e8-a15e-11ffbb64de91 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:28.436558 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-4140af31-7a0e-4367-a2a7-dd0f220f285e req-429e9f65-4257-40e8-a15e-11ffbb64de91 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:28.479509 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-4140af31-7a0e-4367-a2a7-dd0f220f285e req-429e9f65-4257-40e8-a15e-11ffbb64de91 service nova] Creating event network-vif-plugged:405ad75e-86e5-40f3-9630-b16d294a1173 for instance 51f5cae8-033b-466b-99b8-465ea87d2b0e on n-h1-master-1 Oct 23 01:34:28.482051 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-4140af31-7a0e-4367-a2a7-dd0f220f285e req-429e9f65-4257-40e8-a15e-11ffbb64de91 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088244 Oct 23 01:34:28.483416 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2660/5229] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:34:28.608744 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c69b27d0-7577-4f38-8319-b81df4144067 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:28.609717 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c69b27d0-7577-4f38-8319-b81df4144067 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:28.617785 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c69b27d0-7577-4f38-8319-b81df4144067 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:28.618773 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c69b27d0-7577-4f38-8319-b81df4144067 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:28.621888 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c69b27d0-7577-4f38-8319-b81df4144067 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:28.622875 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c69b27d0-7577-4f38-8319-b81df4144067 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:28.623553 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c69b27d0-7577-4f38-8319-b81df4144067 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:28.624226 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c69b27d0-7577-4f38-8319-b81df4144067 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:28.651769 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3e4d00cc-c06b-4be7-8fd6-230780846391 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b118116bb0734e8496aaa1446e871d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7defb846e6a24a0aadb9de6de5439b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:28.669591 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3e4d00cc-c06b-4be7-8fd6-230780846391 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b118116bb0734e8496aaa1446e871d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7defb846e6a24a0aadb9de6de5439b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:28.671407 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3e4d00cc-c06b-4be7-8fd6-230780846391 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b118116bb0734e8496aaa1446e871d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7defb846e6a24a0aadb9de6de5439b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:28.673923 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3e4d00cc-c06b-4be7-8fd6-230780846391 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] 10.222.0.42 "GET /compute/v2.1/servers/51f5cae8-033b-466b-99b8-465ea87d2b0e" status: 200 len: 1358 microversion: 2.21 time: 0.742248 Oct 23 01:34:28.676802 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2570/5230] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:34:27 2022] GET /compute/v2.1/servers/51f5cae8-033b-466b-99b8-465ea87d2b0e => generated 1358 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:34:28.896931 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1ebe966f-9527-448a-8e89-4e0c6f883e95 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:28.897624 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1ebe966f-9527-448a-8e89-4e0c6f883e95 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] [instance: bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:28.904445 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1ebe966f-9527-448a-8e89-4e0c6f883e95 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:28.904944 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1ebe966f-9527-448a-8e89-4e0c6f883e95 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:28.905378 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1ebe966f-9527-448a-8e89-4e0c6f883e95 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:28.905782 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c69b27d0-7577-4f38-8319-b81df4144067 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:28.906364 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1ebe966f-9527-448a-8e89-4e0c6f883e95 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:28.906731 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1ebe966f-9527-448a-8e89-4e0c6f883e95 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:28.907163 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1ebe966f-9527-448a-8e89-4e0c6f883e95 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:28.914994 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c69b27d0-7577-4f38-8319-b81df4144067 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 200 len: 1509 microversion: 2.1 time: 0.312651 Oct 23 01:34:28.945839 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2661/5231] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:28 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 1509 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:29.202396 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1ebe966f-9527-448a-8e89-4e0c6f883e95 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1759290b0b4034ad9d312abb95ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4c34c1a48140f8ae5a69fa0abb2bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:29.214303 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1ebe966f-9527-448a-8e89-4e0c6f883e95 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] 10.222.0.42 "GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12" status: 200 len: 1427 microversion: 2.1 time: 0.322126 Oct 23 01:34:29.215717 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2571/5232] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:28 2022] GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12 => generated 1427 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:34:29.414390 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-04c4b24b-5c6d-4411-a35f-0f7c0e054a57 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:29.415395 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-04c4b24b-5c6d-4411-a35f-0f7c0e054a57 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 740c5d14-9669-45e2-9ba9-723926f774ab] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:29.428569 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-04c4b24b-5c6d-4411-a35f-0f7c0e054a57 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:29.429359 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-04c4b24b-5c6d-4411-a35f-0f7c0e054a57 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:29.430025 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-04c4b24b-5c6d-4411-a35f-0f7c0e054a57 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:29.435279 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-04c4b24b-5c6d-4411-a35f-0f7c0e054a57 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:29.435945 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-04c4b24b-5c6d-4411-a35f-0f7c0e054a57 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:29.436396 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-04c4b24b-5c6d-4411-a35f-0f7c0e054a57 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:29.701437 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2a60ac37-3292-463c-9474-7339b91d0902 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:29.702800 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2a60ac37-3292-463c-9474-7339b91d0902 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] [instance: 51f5cae8-033b-466b-99b8-465ea87d2b0e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:29.714408 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2a60ac37-3292-463c-9474-7339b91d0902 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:29.715933 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2a60ac37-3292-463c-9474-7339b91d0902 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:29.717529 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2a60ac37-3292-463c-9474-7339b91d0902 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:29.720597 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2a60ac37-3292-463c-9474-7339b91d0902 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:29.721364 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2a60ac37-3292-463c-9474-7339b91d0902 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:29.728330 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2a60ac37-3292-463c-9474-7339b91d0902 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:29.742864 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-04c4b24b-5c6d-4411-a35f-0f7c0e054a57 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:29.753018 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-04c4b24b-5c6d-4411-a35f-0f7c0e054a57 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab" status: 200 len: 1315 microversion: 2.1 time: 0.343928 Oct 23 01:34:29.769145 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2662/5233] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:29 2022] GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab => generated 1315 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:29.940521 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-855c070a-be8d-43df-ba45-719a791d6eb2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:29.941248 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-855c070a-be8d-43df-ba45-719a791d6eb2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:29.958553 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-855c070a-be8d-43df-ba45-719a791d6eb2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:29.959082 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-855c070a-be8d-43df-ba45-719a791d6eb2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:29.959520 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-855c070a-be8d-43df-ba45-719a791d6eb2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:29.960225 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-855c070a-be8d-43df-ba45-719a791d6eb2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:29.960684 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-855c070a-be8d-43df-ba45-719a791d6eb2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:29.961118 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-855c070a-be8d-43df-ba45-719a791d6eb2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:29.984821 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:34:30.249510 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2a60ac37-3292-463c-9474-7339b91d0902 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b118116bb0734e8496aaa1446e871d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7defb846e6a24a0aadb9de6de5439b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:30.270618 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2a60ac37-3292-463c-9474-7339b91d0902 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b118116bb0734e8496aaa1446e871d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7defb846e6a24a0aadb9de6de5439b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:30.276365 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2a60ac37-3292-463c-9474-7339b91d0902 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b118116bb0734e8496aaa1446e871d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7defb846e6a24a0aadb9de6de5439b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:30.277706 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2a60ac37-3292-463c-9474-7339b91d0902 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] 10.222.0.42 "GET /compute/v2.1/servers/51f5cae8-033b-466b-99b8-465ea87d2b0e" status: 200 len: 1358 microversion: 2.21 time: 0.580780 Oct 23 01:34:30.290959 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2572/5234] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:34:29 2022] GET /compute/v2.1/servers/51f5cae8-033b-466b-99b8-465ea87d2b0e => generated 1358 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:34:30.304621 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-576cf582-91db-4c3e-b908-5cc970b9a583 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:30.305263 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-576cf582-91db-4c3e-b908-5cc970b9a583 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] [instance: bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:30.313606 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-576cf582-91db-4c3e-b908-5cc970b9a583 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:30.314170 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-576cf582-91db-4c3e-b908-5cc970b9a583 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:30.314615 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-576cf582-91db-4c3e-b908-5cc970b9a583 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:30.315673 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-576cf582-91db-4c3e-b908-5cc970b9a583 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:30.316184 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-576cf582-91db-4c3e-b908-5cc970b9a583 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:30.316620 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-576cf582-91db-4c3e-b908-5cc970b9a583 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:30.709842 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-855c070a-be8d-43df-ba45-719a791d6eb2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:30.727223 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-855c070a-be8d-43df-ba45-719a791d6eb2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 200 len: 1509 microversion: 2.1 time: 0.790022 Oct 23 01:34:30.728624 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2663/5235] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:29 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 1509 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:34:30.776490 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-40e06cf9-cb4f-41f7-9e51-1f1a76dde367 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:30.777532 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-40e06cf9-cb4f-41f7-9e51-1f1a76dde367 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 740c5d14-9669-45e2-9ba9-723926f774ab] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:30.789467 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-40e06cf9-cb4f-41f7-9e51-1f1a76dde367 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:30.790295 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-40e06cf9-cb4f-41f7-9e51-1f1a76dde367 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:30.790907 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-40e06cf9-cb4f-41f7-9e51-1f1a76dde367 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:30.791825 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-40e06cf9-cb4f-41f7-9e51-1f1a76dde367 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:30.794211 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-40e06cf9-cb4f-41f7-9e51-1f1a76dde367 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:30.794842 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-40e06cf9-cb4f-41f7-9e51-1f1a76dde367 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:30.840912 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-576cf582-91db-4c3e-b908-5cc970b9a583 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1759290b0b4034ad9d312abb95ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4c34c1a48140f8ae5a69fa0abb2bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:30.860023 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-576cf582-91db-4c3e-b908-5cc970b9a583 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] 10.222.0.42 "GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12" status: 200 len: 1427 microversion: 2.1 time: 0.562846 Oct 23 01:34:30.864636 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=8 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:34:30.874368 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2573/5236] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:30 2022] GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12 => generated 1427 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:31.006691 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-be91220c-51b6-45ca-b8cd-6f9c68b2813d req-dd78f3f1-700a-432d-a790-16895d22cc4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12", "tag": "b43f6b89-f0c2-46ea-b574-0ac7c429416c"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:34:31.031766 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-be91220c-51b6-45ca-b8cd-6f9c68b2813d req-dd78f3f1-700a-432d-a790-16895d22cc4c service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:31.037084 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-be91220c-51b6-45ca-b8cd-6f9c68b2813d req-dd78f3f1-700a-432d-a790-16895d22cc4c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:31.039761 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-be91220c-51b6-45ca-b8cd-6f9c68b2813d req-dd78f3f1-700a-432d-a790-16895d22cc4c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:31.075225 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-be91220c-51b6-45ca-b8cd-6f9c68b2813d req-dd78f3f1-700a-432d-a790-16895d22cc4c service nova] Creating event network-changed:b43f6b89-f0c2-46ea-b574-0ac7c429416c for instance bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12 on n-h2-master-1 Oct 23 01:34:31.105841 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-be91220c-51b6-45ca-b8cd-6f9c68b2813d req-dd78f3f1-700a-432d-a790-16895d22cc4c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108755 Oct 23 01:34:31.107220 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2574/5237] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:34:31.310333 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7e285062-cd04-4e3b-a1ff-ac1756762cea tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:31.311423 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7e285062-cd04-4e3b-a1ff-ac1756762cea tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] [instance: 51f5cae8-033b-466b-99b8-465ea87d2b0e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:31.328296 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7e285062-cd04-4e3b-a1ff-ac1756762cea tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:31.328960 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7e285062-cd04-4e3b-a1ff-ac1756762cea tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:31.329510 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7e285062-cd04-4e3b-a1ff-ac1756762cea tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:31.330385 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7e285062-cd04-4e3b-a1ff-ac1756762cea tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:31.330948 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7e285062-cd04-4e3b-a1ff-ac1756762cea tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:31.331490 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7e285062-cd04-4e3b-a1ff-ac1756762cea tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:31.710724 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-40e06cf9-cb4f-41f7-9e51-1f1a76dde367 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:31.719636 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-40e06cf9-cb4f-41f7-9e51-1f1a76dde367 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab" status: 200 len: 1315 microversion: 2.1 time: 0.947635 Oct 23 01:34:31.739595 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2664/5238] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:30 2022] GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab => generated 1315 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:31.755842 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-eadc0bd7-d24c-41d8-8450-1d87bee16c2f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:31.756536 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-eadc0bd7-d24c-41d8-8450-1d87bee16c2f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:31.763720 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eadc0bd7-d24c-41d8-8450-1d87bee16c2f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:31.764224 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eadc0bd7-d24c-41d8-8450-1d87bee16c2f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:31.764666 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eadc0bd7-d24c-41d8-8450-1d87bee16c2f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:31.765574 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eadc0bd7-d24c-41d8-8450-1d87bee16c2f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:31.766054 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eadc0bd7-d24c-41d8-8450-1d87bee16c2f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:31.766530 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eadc0bd7-d24c-41d8-8450-1d87bee16c2f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:31.812873 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7e285062-cd04-4e3b-a1ff-ac1756762cea tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b118116bb0734e8496aaa1446e871d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7defb846e6a24a0aadb9de6de5439b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:31.828986 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7e285062-cd04-4e3b-a1ff-ac1756762cea tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b118116bb0734e8496aaa1446e871d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7defb846e6a24a0aadb9de6de5439b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:31.830876 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7e285062-cd04-4e3b-a1ff-ac1756762cea tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b118116bb0734e8496aaa1446e871d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7defb846e6a24a0aadb9de6de5439b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:31.832371 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7e285062-cd04-4e3b-a1ff-ac1756762cea tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] 10.222.0.42 "GET /compute/v2.1/servers/51f5cae8-033b-466b-99b8-465ea87d2b0e" status: 200 len: 1551 microversion: 2.21 time: 0.527511 Oct 23 01:34:31.838079 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2575/5239] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:34:31 2022] GET /compute/v2.1/servers/51f5cae8-033b-466b-99b8-465ea87d2b0e => generated 1551 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:34:31.865090 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ee9db037-6b98-4561-b434-2bba4f5f1748 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:31.865731 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ee9db037-6b98-4561-b434-2bba4f5f1748 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] [instance: 51f5cae8-033b-466b-99b8-465ea87d2b0e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:31.882606 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee9db037-6b98-4561-b434-2bba4f5f1748 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:31.884408 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee9db037-6b98-4561-b434-2bba4f5f1748 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:31.884957 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee9db037-6b98-4561-b434-2bba4f5f1748 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:31.885825 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee9db037-6b98-4561-b434-2bba4f5f1748 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:31.887027 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee9db037-6b98-4561-b434-2bba4f5f1748 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:31.887403 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee9db037-6b98-4561-b434-2bba4f5f1748 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:31.930792 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ee9db037-6b98-4561-b434-2bba4f5f1748 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] [instance: 51f5cae8-033b-466b-99b8-465ea87d2b0e] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:34:32.225019 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-eadc0bd7-d24c-41d8-8450-1d87bee16c2f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:32.237210 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-eadc0bd7-d24c-41d8-8450-1d87bee16c2f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 200 len: 1509 microversion: 2.1 time: 0.485636 Oct 23 01:34:32.258753 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2665/5240] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:31 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 1509 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:34:32.264853 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-42fb264d-f777-4629-8d56-80e248be18a4 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:32.265767 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-42fb264d-f777-4629-8d56-80e248be18a4 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] [instance: bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:32.273406 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-42fb264d-f777-4629-8d56-80e248be18a4 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:32.276433 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-42fb264d-f777-4629-8d56-80e248be18a4 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:32.276433 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-42fb264d-f777-4629-8d56-80e248be18a4 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:32.276433 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-42fb264d-f777-4629-8d56-80e248be18a4 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:32.277166 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-42fb264d-f777-4629-8d56-80e248be18a4 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:32.277839 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-42fb264d-f777-4629-8d56-80e248be18a4 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:32.348975 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ee9db037-6b98-4561-b434-2bba4f5f1748 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] 10.222.0.42 "DELETE /compute/v2.1/servers/51f5cae8-033b-466b-99b8-465ea87d2b0e" status: 204 len: 0 microversion: 2.21 time: 0.491737 Oct 23 01:34:32.350124 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2576/5241] 10.222.0.42 () {60 vars in 1280 bytes} [Sun Oct 23 01:34:31 2022] DELETE /compute/v2.1/servers/51f5cae8-033b-466b-99b8-465ea87d2b0e => generated 0 bytes in 495 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 23 01:34:32.361995 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e1caae26-2a59-4e34-a70d-2f97b6b0e7a5 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:32.363073 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e1caae26-2a59-4e34-a70d-2f97b6b0e7a5 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] [instance: 51f5cae8-033b-466b-99b8-465ea87d2b0e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:32.377292 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e1caae26-2a59-4e34-a70d-2f97b6b0e7a5 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:32.385582 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e1caae26-2a59-4e34-a70d-2f97b6b0e7a5 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:32.385582 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e1caae26-2a59-4e34-a70d-2f97b6b0e7a5 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:32.385582 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e1caae26-2a59-4e34-a70d-2f97b6b0e7a5 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:32.385582 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e1caae26-2a59-4e34-a70d-2f97b6b0e7a5 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:32.385582 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e1caae26-2a59-4e34-a70d-2f97b6b0e7a5 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:32.646950 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-42fb264d-f777-4629-8d56-80e248be18a4 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1759290b0b4034ad9d312abb95ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4c34c1a48140f8ae5a69fa0abb2bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:32.664621 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-42fb264d-f777-4629-8d56-80e248be18a4 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] 10.222.0.42 "GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12" status: 200 len: 1427 microversion: 2.1 time: 0.403736 Oct 23 01:34:32.665404 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2666/5242] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:32 2022] GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12 => generated 1427 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:32.724916 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e1caae26-2a59-4e34-a70d-2f97b6b0e7a5 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b118116bb0734e8496aaa1446e871d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7defb846e6a24a0aadb9de6de5439b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:32.733967 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e1caae26-2a59-4e34-a70d-2f97b6b0e7a5 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b118116bb0734e8496aaa1446e871d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7defb846e6a24a0aadb9de6de5439b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:32.744134 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e1caae26-2a59-4e34-a70d-2f97b6b0e7a5 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b118116bb0734e8496aaa1446e871d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7defb846e6a24a0aadb9de6de5439b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:32.745683 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e1caae26-2a59-4e34-a70d-2f97b6b0e7a5 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] 10.222.0.42 "GET /compute/v2.1/servers/51f5cae8-033b-466b-99b8-465ea87d2b0e" status: 200 len: 1557 microversion: 2.21 time: 0.391318 Oct 23 01:34:32.753874 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d0434dda-4b34-4c10-993f-5ddfeecf07df tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:32.755123 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d0434dda-4b34-4c10-993f-5ddfeecf07df tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 740c5d14-9669-45e2-9ba9-723926f774ab] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:32.758519 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2577/5243] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:34:32 2022] GET /compute/v2.1/servers/51f5cae8-033b-466b-99b8-465ea87d2b0e => generated 1557 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:34:32.771150 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d0434dda-4b34-4c10-993f-5ddfeecf07df tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:32.771809 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d0434dda-4b34-4c10-993f-5ddfeecf07df tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:32.772634 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d0434dda-4b34-4c10-993f-5ddfeecf07df tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:32.773514 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d0434dda-4b34-4c10-993f-5ddfeecf07df tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:32.774141 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d0434dda-4b34-4c10-993f-5ddfeecf07df tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:32.774687 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d0434dda-4b34-4c10-993f-5ddfeecf07df tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:32.999445 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d0434dda-4b34-4c10-993f-5ddfeecf07df tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:33.008283 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d0434dda-4b34-4c10-993f-5ddfeecf07df tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab" status: 200 len: 1315 microversion: 2.1 time: 0.259171 Oct 23 01:34:33.008886 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2667/5244] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:32 2022] GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab => generated 1315 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:33.205733 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-232cdc56-e22c-4ac8-bc4b-d367d4f341a1 req-e78fadf2-4165-412b-aea5-6fa515db27b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "740c5d14-9669-45e2-9ba9-723926f774ab", "tag": "f9f5f6e7-a37b-43ef-b9e5-85882f8c1cf7"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:34:33.248686 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-232cdc56-e22c-4ac8-bc4b-d367d4f341a1 req-e78fadf2-4165-412b-aea5-6fa515db27b0 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:33.252183 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-232cdc56-e22c-4ac8-bc4b-d367d4f341a1 req-e78fadf2-4165-412b-aea5-6fa515db27b0 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:33.253224 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-232cdc56-e22c-4ac8-bc4b-d367d4f341a1 req-e78fadf2-4165-412b-aea5-6fa515db27b0 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:33.270363 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fdb24789-6d1a-4440-8d14-7369128e4645 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:33.271688 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fdb24789-6d1a-4440-8d14-7369128e4645 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:33.278488 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-232cdc56-e22c-4ac8-bc4b-d367d4f341a1 req-e78fadf2-4165-412b-aea5-6fa515db27b0 service nova] Creating event network-changed:f9f5f6e7-a37b-43ef-b9e5-85882f8c1cf7 for instance 740c5d14-9669-45e2-9ba9-723926f774ab on n-h2-master-1 Oct 23 01:34:33.284109 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fdb24789-6d1a-4440-8d14-7369128e4645 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:33.286237 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fdb24789-6d1a-4440-8d14-7369128e4645 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:33.286893 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fdb24789-6d1a-4440-8d14-7369128e4645 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:33.289145 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fdb24789-6d1a-4440-8d14-7369128e4645 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:33.289777 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fdb24789-6d1a-4440-8d14-7369128e4645 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:33.290643 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-232cdc56-e22c-4ac8-bc4b-d367d4f341a1 req-e78fadf2-4165-412b-aea5-6fa515db27b0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098439 Oct 23 01:34:33.296274 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fdb24789-6d1a-4440-8d14-7369128e4645 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:33.296418 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2578/5245] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:34:33.519611 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fdb24789-6d1a-4440-8d14-7369128e4645 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:33.537724 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fdb24789-6d1a-4440-8d14-7369128e4645 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 200 len: 1509 microversion: 2.1 time: 0.272546 Oct 23 01:34:33.556989 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2668/5246] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:33 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 1509 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:33.696352 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3422c9fc-20bc-4f1b-ac92-0a1554b53902 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:33.698548 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3422c9fc-20bc-4f1b-ac92-0a1554b53902 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] [instance: bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:33.708144 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=6 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:34:33.710437 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3422c9fc-20bc-4f1b-ac92-0a1554b53902 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:33.711272 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3422c9fc-20bc-4f1b-ac92-0a1554b53902 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:33.711877 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3422c9fc-20bc-4f1b-ac92-0a1554b53902 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:33.712818 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3422c9fc-20bc-4f1b-ac92-0a1554b53902 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:33.714452 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3422c9fc-20bc-4f1b-ac92-0a1554b53902 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:33.715106 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3422c9fc-20bc-4f1b-ac92-0a1554b53902 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:33.776687 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bab9717d-5240-4c2a-bf16-d227d72b63cf tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:33.778104 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bab9717d-5240-4c2a-bf16-d227d72b63cf tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] [instance: 51f5cae8-033b-466b-99b8-465ea87d2b0e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:33.793808 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bab9717d-5240-4c2a-bf16-d227d72b63cf tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:33.794769 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bab9717d-5240-4c2a-bf16-d227d72b63cf tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:33.798398 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bab9717d-5240-4c2a-bf16-d227d72b63cf tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:33.798398 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bab9717d-5240-4c2a-bf16-d227d72b63cf tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:33.798398 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bab9717d-5240-4c2a-bf16-d227d72b63cf tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:33.799304 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bab9717d-5240-4c2a-bf16-d227d72b63cf tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:34.289667 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3422c9fc-20bc-4f1b-ac92-0a1554b53902 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1759290b0b4034ad9d312abb95ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4c34c1a48140f8ae5a69fa0abb2bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:34.301868 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3422c9fc-20bc-4f1b-ac92-0a1554b53902 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] 10.222.0.42 "GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12" status: 200 len: 1427 microversion: 2.1 time: 0.616729 Oct 23 01:34:34.314814 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2579/5247] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:33 2022] GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12 => generated 1427 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:34.324694 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bab9717d-5240-4c2a-bf16-d227d72b63cf tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b118116bb0734e8496aaa1446e871d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7defb846e6a24a0aadb9de6de5439b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:34.325900 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-be8c9126-0fa2-4dc1-8d3c-7d8408fec63a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:34.326772 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-be8c9126-0fa2-4dc1-8d3c-7d8408fec63a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 740c5d14-9669-45e2-9ba9-723926f774ab] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:34.333703 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-be8c9126-0fa2-4dc1-8d3c-7d8408fec63a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:34.334638 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-be8c9126-0fa2-4dc1-8d3c-7d8408fec63a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:34.335397 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-be8c9126-0fa2-4dc1-8d3c-7d8408fec63a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:34.335649 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bab9717d-5240-4c2a-bf16-d227d72b63cf tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b118116bb0734e8496aaa1446e871d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7defb846e6a24a0aadb9de6de5439b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:34.336452 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-be8c9126-0fa2-4dc1-8d3c-7d8408fec63a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:34.337074 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-be8c9126-0fa2-4dc1-8d3c-7d8408fec63a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:34.337387 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bab9717d-5240-4c2a-bf16-d227d72b63cf tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b118116bb0734e8496aaa1446e871d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7defb846e6a24a0aadb9de6de5439b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:34.337881 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-be8c9126-0fa2-4dc1-8d3c-7d8408fec63a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:34.340380 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bab9717d-5240-4c2a-bf16-d227d72b63cf tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] 10.222.0.42 "GET /compute/v2.1/servers/51f5cae8-033b-466b-99b8-465ea87d2b0e" status: 200 len: 1557 microversion: 2.21 time: 0.569126 Oct 23 01:34:34.341450 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2669/5248] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:34:33 2022] GET /compute/v2.1/servers/51f5cae8-033b-466b-99b8-465ea87d2b0e => generated 1557 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:34:34.369024 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=28 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:34:34.567399 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-95f408d9-210a-4dba-b141-3c9fc8614d5c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:34.567399 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-95f408d9-210a-4dba-b141-3c9fc8614d5c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:34.580245 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-95f408d9-210a-4dba-b141-3c9fc8614d5c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:34.580935 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-95f408d9-210a-4dba-b141-3c9fc8614d5c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:34.584647 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-95f408d9-210a-4dba-b141-3c9fc8614d5c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:34.585551 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-95f408d9-210a-4dba-b141-3c9fc8614d5c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:34.586718 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-95f408d9-210a-4dba-b141-3c9fc8614d5c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:34.586885 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-95f408d9-210a-4dba-b141-3c9fc8614d5c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:34.614117 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-be8c9126-0fa2-4dc1-8d3c-7d8408fec63a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:34.629310 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-be8c9126-0fa2-4dc1-8d3c-7d8408fec63a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab" status: 200 len: 1315 microversion: 2.1 time: 0.307600 Oct 23 01:34:34.629997 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2580/5249] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:34 2022] GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab => generated 1315 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:34.865442 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-95f408d9-210a-4dba-b141-3c9fc8614d5c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:34.882912 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-95f408d9-210a-4dba-b141-3c9fc8614d5c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 200 len: 1509 microversion: 2.1 time: 0.322083 Oct 23 01:34:34.883505 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2670/5250] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:34 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 1509 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:34:35.332134 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cfd71d0d-e49e-4616-96d9-7db4d97e0d4b tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:35.333657 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cfd71d0d-e49e-4616-96d9-7db4d97e0d4b tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] [instance: bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:35.348833 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cfd71d0d-e49e-4616-96d9-7db4d97e0d4b tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:35.349819 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cfd71d0d-e49e-4616-96d9-7db4d97e0d4b tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:35.352493 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cfd71d0d-e49e-4616-96d9-7db4d97e0d4b tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:35.354695 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cfd71d0d-e49e-4616-96d9-7db4d97e0d4b tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:35.356133 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cfd71d0d-e49e-4616-96d9-7db4d97e0d4b tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:35.356804 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cfd71d0d-e49e-4616-96d9-7db4d97e0d4b tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:35.372816 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-da09b531-8c86-4591-af90-48092349ae80 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:35.374462 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-da09b531-8c86-4591-af90-48092349ae80 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] [instance: 51f5cae8-033b-466b-99b8-465ea87d2b0e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:35.387588 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-da09b531-8c86-4591-af90-48092349ae80 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:35.388201 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-da09b531-8c86-4591-af90-48092349ae80 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:35.388910 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-da09b531-8c86-4591-af90-48092349ae80 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:35.389960 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-da09b531-8c86-4591-af90-48092349ae80 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:35.390670 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-da09b531-8c86-4591-af90-48092349ae80 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:35.391206 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-da09b531-8c86-4591-af90-48092349ae80 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:35.693545 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-da09b531-8c86-4591-af90-48092349ae80 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b118116bb0734e8496aaa1446e871d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7defb846e6a24a0aadb9de6de5439b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:35.706431 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-da09b531-8c86-4591-af90-48092349ae80 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b118116bb0734e8496aaa1446e871d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7defb846e6a24a0aadb9de6de5439b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:35.708227 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-da09b531-8c86-4591-af90-48092349ae80 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b118116bb0734e8496aaa1446e871d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7defb846e6a24a0aadb9de6de5439b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:35.709666 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-da09b531-8c86-4591-af90-48092349ae80 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] 10.222.0.42 "GET /compute/v2.1/servers/51f5cae8-033b-466b-99b8-465ea87d2b0e" status: 200 len: 1557 microversion: 2.21 time: 0.343779 Oct 23 01:34:35.736755 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2671/5251] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:34:35 2022] GET /compute/v2.1/servers/51f5cae8-033b-466b-99b8-465ea87d2b0e => generated 1557 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:34:35.745215 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a5781b63-de9b-41c3-8331-c3d282e54bd4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:35.745842 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a5781b63-de9b-41c3-8331-c3d282e54bd4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 740c5d14-9669-45e2-9ba9-723926f774ab] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:35.759634 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5781b63-de9b-41c3-8331-c3d282e54bd4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:35.760135 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5781b63-de9b-41c3-8331-c3d282e54bd4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:35.760584 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5781b63-de9b-41c3-8331-c3d282e54bd4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:35.761292 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5781b63-de9b-41c3-8331-c3d282e54bd4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:35.764552 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5781b63-de9b-41c3-8331-c3d282e54bd4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:35.770324 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a5781b63-de9b-41c3-8331-c3d282e54bd4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:35.785241 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cfd71d0d-e49e-4616-96d9-7db4d97e0d4b tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1759290b0b4034ad9d312abb95ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4c34c1a48140f8ae5a69fa0abb2bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:35.796268 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cfd71d0d-e49e-4616-96d9-7db4d97e0d4b tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] 10.222.0.42 "GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12" status: 200 len: 1427 microversion: 2.1 time: 0.470397 Oct 23 01:34:35.797526 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2581/5252] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:35 2022] GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12 => generated 1427 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:35.911535 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fb690b10-6d22-40ee-ad8f-91e975fdacbf tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:35.913902 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-fb690b10-6d22-40ee-ad8f-91e975fdacbf tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:35.921421 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fb690b10-6d22-40ee-ad8f-91e975fdacbf tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:35.922278 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fb690b10-6d22-40ee-ad8f-91e975fdacbf tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:35.923317 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fb690b10-6d22-40ee-ad8f-91e975fdacbf tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:35.924231 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fb690b10-6d22-40ee-ad8f-91e975fdacbf tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:35.925818 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fb690b10-6d22-40ee-ad8f-91e975fdacbf tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:35.926564 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fb690b10-6d22-40ee-ad8f-91e975fdacbf tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:36.075028 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a5781b63-de9b-41c3-8331-c3d282e54bd4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:36.087400 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a5781b63-de9b-41c3-8331-c3d282e54bd4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab" status: 200 len: 1315 microversion: 2.1 time: 0.346161 Oct 23 01:34:36.088567 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2672/5253] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:35 2022] GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:36.155535 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-1047c12a-5cba-463c-bb2a-24e5d3ab1bad req-885f1bfb-9e60-4f0e-bfa5-1d4f41c9b146 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51f5cae8-033b-466b-99b8-465ea87d2b0e", "name": "network-vif-deleted", "tag": "405ad75e-86e5-40f3-9630-b16d294a1173"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:34:36.179347 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-1047c12a-5cba-463c-bb2a-24e5d3ab1bad req-885f1bfb-9e60-4f0e-bfa5-1d4f41c9b146 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:36.180063 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-1047c12a-5cba-463c-bb2a-24e5d3ab1bad req-885f1bfb-9e60-4f0e-bfa5-1d4f41c9b146 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:36.185349 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-1047c12a-5cba-463c-bb2a-24e5d3ab1bad req-885f1bfb-9e60-4f0e-bfa5-1d4f41c9b146 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:36.204109 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-fb690b10-6d22-40ee-ad8f-91e975fdacbf tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:36.219991 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fb690b10-6d22-40ee-ad8f-91e975fdacbf tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 200 len: 1509 microversion: 2.1 time: 0.311207 Oct 23 01:34:36.222901 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2582/5254] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:35 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 1509 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:36.223855 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-1047c12a-5cba-463c-bb2a-24e5d3ab1bad req-885f1bfb-9e60-4f0e-bfa5-1d4f41c9b146 service nova] Creating event network-vif-deleted:405ad75e-86e5-40f3-9630-b16d294a1173 for instance 51f5cae8-033b-466b-99b8-465ea87d2b0e on n-h1-master-1 Oct 23 01:34:36.235030 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-1047c12a-5cba-463c-bb2a-24e5d3ab1bad req-885f1bfb-9e60-4f0e-bfa5-1d4f41c9b146 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083540 Oct 23 01:34:36.238417 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2673/5255] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:34:36.745175 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-752e61ee-0042-43e2-89eb-d6b1626d2933 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:36.746039 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-752e61ee-0042-43e2-89eb-d6b1626d2933 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] [instance: 51f5cae8-033b-466b-99b8-465ea87d2b0e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:36.759391 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-752e61ee-0042-43e2-89eb-d6b1626d2933 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:36.762068 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-752e61ee-0042-43e2-89eb-d6b1626d2933 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:36.763216 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-752e61ee-0042-43e2-89eb-d6b1626d2933 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:36.765563 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-752e61ee-0042-43e2-89eb-d6b1626d2933 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:36.766315 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-752e61ee-0042-43e2-89eb-d6b1626d2933 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:36.770247 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-752e61ee-0042-43e2-89eb-d6b1626d2933 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:36.825090 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-66903bb4-4490-4687-96be-93836d5a9a4d tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:36.825803 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-66903bb4-4490-4687-96be-93836d5a9a4d tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] [instance: bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:36.837805 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-752e61ee-0042-43e2-89eb-d6b1626d2933 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:36.838741 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-66903bb4-4490-4687-96be-93836d5a9a4d tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:36.838741 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-66903bb4-4490-4687-96be-93836d5a9a4d tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:36.838741 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-66903bb4-4490-4687-96be-93836d5a9a4d tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:36.839179 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-752e61ee-0042-43e2-89eb-d6b1626d2933 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:36.839429 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-66903bb4-4490-4687-96be-93836d5a9a4d tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:36.839835 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-752e61ee-0042-43e2-89eb-d6b1626d2933 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:36.839963 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-66903bb4-4490-4687-96be-93836d5a9a4d tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:36.840294 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-66903bb4-4490-4687-96be-93836d5a9a4d tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:36.840596 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-752e61ee-0042-43e2-89eb-d6b1626d2933 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lazy-loading 'fault' on Instance uuid 51f5cae8-033b-466b-99b8-465ea87d2b0e {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:34:36.843834 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:34:36.895695 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-752e61ee-0042-43e2-89eb-d6b1626d2933 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b118116bb0734e8496aaa1446e871d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7defb846e6a24a0aadb9de6de5439b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:36.915284 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-752e61ee-0042-43e2-89eb-d6b1626d2933 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b118116bb0734e8496aaa1446e871d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7defb846e6a24a0aadb9de6de5439b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:36.917507 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-752e61ee-0042-43e2-89eb-d6b1626d2933 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b118116bb0734e8496aaa1446e871d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7defb846e6a24a0aadb9de6de5439b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:36.920881 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-752e61ee-0042-43e2-89eb-d6b1626d2933 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] 10.222.0.42 "GET /compute/v2.1/servers/51f5cae8-033b-466b-99b8-465ea87d2b0e" status: 200 len: 1348 microversion: 2.21 time: 0.180004 Oct 23 01:34:36.921747 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2583/5256] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:34:36 2022] GET /compute/v2.1/servers/51f5cae8-033b-466b-99b8-465ea87d2b0e => generated 1348 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:34:37.084712 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-66903bb4-4490-4687-96be-93836d5a9a4d tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1759290b0b4034ad9d312abb95ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4c34c1a48140f8ae5a69fa0abb2bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:37.106588 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-66903bb4-4490-4687-96be-93836d5a9a4d tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] 10.222.0.42 "GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12" status: 200 len: 1427 microversion: 2.1 time: 0.282150 Oct 23 01:34:37.116197 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c76dcd5d-abb1-4cc3-b4ed-29856e5fdcd2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:37.116462 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2674/5257] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:36 2022] GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12 => generated 1427 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:34:37.117258 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c76dcd5d-abb1-4cc3-b4ed-29856e5fdcd2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 740c5d14-9669-45e2-9ba9-723926f774ab] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:37.125530 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c76dcd5d-abb1-4cc3-b4ed-29856e5fdcd2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:37.129644 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c76dcd5d-abb1-4cc3-b4ed-29856e5fdcd2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:37.129644 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c76dcd5d-abb1-4cc3-b4ed-29856e5fdcd2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:37.129644 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c76dcd5d-abb1-4cc3-b4ed-29856e5fdcd2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:37.129644 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c76dcd5d-abb1-4cc3-b4ed-29856e5fdcd2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:37.129644 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c76dcd5d-abb1-4cc3-b4ed-29856e5fdcd2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:37.249573 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a4619419-2294-4434-91d7-2cb2135afc4d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:37.250525 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a4619419-2294-4434-91d7-2cb2135afc4d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:37.257547 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a4619419-2294-4434-91d7-2cb2135afc4d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:37.258391 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a4619419-2294-4434-91d7-2cb2135afc4d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:37.259041 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a4619419-2294-4434-91d7-2cb2135afc4d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:37.259750 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a4619419-2294-4434-91d7-2cb2135afc4d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:37.260205 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a4619419-2294-4434-91d7-2cb2135afc4d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:37.260642 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a4619419-2294-4434-91d7-2cb2135afc4d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:37.344469 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c76dcd5d-abb1-4cc3-b4ed-29856e5fdcd2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:37.354990 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c76dcd5d-abb1-4cc3-b4ed-29856e5fdcd2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab" status: 200 len: 1315 microversion: 2.1 time: 0.243428 Oct 23 01:34:37.355968 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2584/5258] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:37 2022] GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:37.562451 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-30ed84d6-7a67-470d-9795-5437893741eb req-f6004ab5-68f2-4f18-a91e-e56ccdc0fdea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12", "name": "network-vif-plugged", "status": "completed", "tag": "b43f6b89-f0c2-46ea-b574-0ac7c429416c"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:34:37.584490 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-30ed84d6-7a67-470d-9795-5437893741eb req-f6004ab5-68f2-4f18-a91e-e56ccdc0fdea service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:37.585322 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-30ed84d6-7a67-470d-9795-5437893741eb req-f6004ab5-68f2-4f18-a91e-e56ccdc0fdea service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:37.586162 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-30ed84d6-7a67-470d-9795-5437893741eb req-f6004ab5-68f2-4f18-a91e-e56ccdc0fdea service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:37.603683 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-30ed84d6-7a67-470d-9795-5437893741eb req-f6004ab5-68f2-4f18-a91e-e56ccdc0fdea service nova] Creating event network-vif-plugged:b43f6b89-f0c2-46ea-b574-0ac7c429416c for instance bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12 on n-h2-master-1 Oct 23 01:34:37.611375 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-30ed84d6-7a67-470d-9795-5437893741eb req-f6004ab5-68f2-4f18-a91e-e56ccdc0fdea service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052038 Oct 23 01:34:37.613392 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2585/5259] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:34:37.635913 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a4619419-2294-4434-91d7-2cb2135afc4d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:37.653168 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a4619419-2294-4434-91d7-2cb2135afc4d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 200 len: 1509 microversion: 2.1 time: 0.407132 Oct 23 01:34:37.654103 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2675/5260] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:37 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 1509 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:34:37.952185 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2fa53dca-4cc9-4485-a439-970680b507d9 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:37.952906 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2fa53dca-4cc9-4485-a439-970680b507d9 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] [instance: 51f5cae8-033b-466b-99b8-465ea87d2b0e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:37.967530 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2fa53dca-4cc9-4485-a439-970680b507d9 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:37.969898 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2fa53dca-4cc9-4485-a439-970680b507d9 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:37.976960 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2fa53dca-4cc9-4485-a439-970680b507d9 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:37.978856 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2fa53dca-4cc9-4485-a439-970680b507d9 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:37.979555 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2fa53dca-4cc9-4485-a439-970680b507d9 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:37.980529 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2fa53dca-4cc9-4485-a439-970680b507d9 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:38.020433 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2fa53dca-4cc9-4485-a439-970680b507d9 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:38.021191 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2fa53dca-4cc9-4485-a439-970680b507d9 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:38.021820 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2fa53dca-4cc9-4485-a439-970680b507d9 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:38.022535 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-2fa53dca-4cc9-4485-a439-970680b507d9 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lazy-loading 'fault' on Instance uuid 51f5cae8-033b-466b-99b8-465ea87d2b0e {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:34:38.113445 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2fa53dca-4cc9-4485-a439-970680b507d9 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b118116bb0734e8496aaa1446e871d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7defb846e6a24a0aadb9de6de5439b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:38.123988 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2fa53dca-4cc9-4485-a439-970680b507d9 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b118116bb0734e8496aaa1446e871d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7defb846e6a24a0aadb9de6de5439b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:38.125741 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2fa53dca-4cc9-4485-a439-970680b507d9 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b118116bb0734e8496aaa1446e871d7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7defb846e6a24a0aadb9de6de5439b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:38.127031 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2fa53dca-4cc9-4485-a439-970680b507d9 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] 10.222.0.42 "GET /compute/v2.1/servers/51f5cae8-033b-466b-99b8-465ea87d2b0e" status: 200 len: 1348 microversion: 2.21 time: 0.183179 Oct 23 01:34:38.127596 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2586/5261] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:34:37 2022] GET /compute/v2.1/servers/51f5cae8-033b-466b-99b8-465ea87d2b0e => generated 1348 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:34:38.129439 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3739ed1d-9f12-47a9-9d6b-e96d340d4801 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:38.130076 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3739ed1d-9f12-47a9-9d6b-e96d340d4801 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] [instance: bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:38.137484 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3739ed1d-9f12-47a9-9d6b-e96d340d4801 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:38.138008 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3739ed1d-9f12-47a9-9d6b-e96d340d4801 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:38.138449 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3739ed1d-9f12-47a9-9d6b-e96d340d4801 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:38.144102 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3739ed1d-9f12-47a9-9d6b-e96d340d4801 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:38.144102 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3739ed1d-9f12-47a9-9d6b-e96d340d4801 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:38.144102 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3739ed1d-9f12-47a9-9d6b-e96d340d4801 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:38.381915 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fa85f04d-0a14-4070-84b2-6cbeefdfb767 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:38.382808 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-fa85f04d-0a14-4070-84b2-6cbeefdfb767 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 740c5d14-9669-45e2-9ba9-723926f774ab] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:38.410998 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fa85f04d-0a14-4070-84b2-6cbeefdfb767 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:38.411514 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fa85f04d-0a14-4070-84b2-6cbeefdfb767 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:38.412023 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fa85f04d-0a14-4070-84b2-6cbeefdfb767 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:38.412748 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fa85f04d-0a14-4070-84b2-6cbeefdfb767 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:38.413214 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fa85f04d-0a14-4070-84b2-6cbeefdfb767 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:38.417033 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fa85f04d-0a14-4070-84b2-6cbeefdfb767 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:38.498366 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3739ed1d-9f12-47a9-9d6b-e96d340d4801 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1759290b0b4034ad9d312abb95ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4c34c1a48140f8ae5a69fa0abb2bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:38.508794 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3739ed1d-9f12-47a9-9d6b-e96d340d4801 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] 10.222.0.42 "GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12" status: 200 len: 1427 microversion: 2.1 time: 0.383633 Oct 23 01:34:38.525607 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2676/5262] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:38 2022] GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12 => generated 1427 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:34:38.684434 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-34b88198-a56d-4f05-aaf5-3b956deea98a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:38.685220 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-34b88198-a56d-4f05-aaf5-3b956deea98a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:38.700574 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-34b88198-a56d-4f05-aaf5-3b956deea98a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:38.703772 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-34b88198-a56d-4f05-aaf5-3b956deea98a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:38.704522 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-34b88198-a56d-4f05-aaf5-3b956deea98a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:38.709792 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-34b88198-a56d-4f05-aaf5-3b956deea98a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:38.711775 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-34b88198-a56d-4f05-aaf5-3b956deea98a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:38.712237 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-34b88198-a56d-4f05-aaf5-3b956deea98a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:38.812017 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-fa85f04d-0a14-4070-84b2-6cbeefdfb767 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:38.825151 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fa85f04d-0a14-4070-84b2-6cbeefdfb767 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab" status: 200 len: 1315 microversion: 2.1 time: 0.448142 Oct 23 01:34:38.825435 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2587/5263] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:38 2022] GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab => generated 1315 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:38.969334 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-34b88198-a56d-4f05-aaf5-3b956deea98a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:38.981482 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-34b88198-a56d-4f05-aaf5-3b956deea98a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 200 len: 1509 microversion: 2.1 time: 0.302939 Oct 23 01:34:38.982770 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2677/5264] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:38 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 1509 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:34:39.155330 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-dae79844-4a45-4dfc-b6e1-c93dd176ca58 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:39.156704 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-dae79844-4a45-4dfc-b6e1-c93dd176ca58 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] [instance: 51f5cae8-033b-466b-99b8-465ea87d2b0e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:39.166671 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dae79844-4a45-4dfc-b6e1-c93dd176ca58 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:39.168327 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dae79844-4a45-4dfc-b6e1-c93dd176ca58 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:39.171095 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dae79844-4a45-4dfc-b6e1-c93dd176ca58 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:39.171095 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dae79844-4a45-4dfc-b6e1-c93dd176ca58 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:39.171095 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dae79844-4a45-4dfc-b6e1-c93dd176ca58 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:39.171095 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dae79844-4a45-4dfc-b6e1-c93dd176ca58 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:39.204808 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-dae79844-4a45-4dfc-b6e1-c93dd176ca58 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] HTTP exception thrown: Instance 51f5cae8-033b-466b-99b8-465ea87d2b0e could not be found. Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-dae79844-4a45-4dfc-b6e1-c93dd176ca58 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Request method failure captured: Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/51f5cae8-033b-466b-99b8-465ea87d2b0e HTTP/1.1 Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJoRvsl2U8OohbrBMyuKgBYLKDKbM3AMp0JDVCPDyBtEpqlkOGxLIqTZQdZsSwdtWs05spwQFuh0c2U31goT3bTNt_jp4wo4JbPIyUKGHyjob6IifUcYC1mney1CtNbrVVyIVDUwEDzstpZQEH6BBYxFnPCyXeKiPZ9vpEUAO-KUOQw Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: X-Openstack-Nova-Api-Version: 2.21 Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 7defb846e6a24a0aadb9de6de5439b8a Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-InstanceActionsV221TestJSON-743343850 Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7defb846e6a24a0aadb9de6de5439b8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7defb846e6a24a0aadb9de6de5439b8a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7defb846e6a24a0aadb9de6de5439b8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7defb846e6a24a0aadb9de6de5439b8a"}]}] Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-InstanceActionsV221TestJSON-743343850 Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 7defb846e6a24a0aadb9de6de5439b8a Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-743343850 Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-InstanceActionsV221TestJSON-743343850-project Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: b118116bb0734e8496aaa1446e871d7e Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-InstanceActionsV221TestJSON-743343850-project Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 51f5cae8-033b-466b-99b8-465ea87d2b0e could not be found. Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '51f5cae8-033b-466b-99b8-465ea87d2b0e'} Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51f5cae8-033b-466b-99b8-465ea87d2b0e could not be found. Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51f5cae8-033b-466b-99b8-465ea87d2b0e could not be found. Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:39.220843 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:34:39.225946 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:39.225946 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:39.225946 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:34:39.225946 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:34:39.225946 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:34:39.225946 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:34:39.225946 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51f5cae8-033b-466b-99b8-465ea87d2b0e could not be found. Oct 23 01:34:39.225946 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:39.225946 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-dae79844-4a45-4dfc-b6e1-c93dd176ca58 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Returning 404 to user: Instance 51f5cae8-033b-466b-99b8-465ea87d2b0e could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:34:39.225946 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-dae79844-4a45-4dfc-b6e1-c93dd176ca58 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] 10.222.0.42 "GET /compute/v2.1/servers/51f5cae8-033b-466b-99b8-465ea87d2b0e" status: 404 len: 111 microversion: 2.21 time: 0.076718 Oct 23 01:34:39.227690 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2588/5265] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:34:39 2022] GET /compute/v2.1/servers/51f5cae8-033b-466b-99b8-465ea87d2b0e => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:34:39.236637 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8e0c754c-af3d-4e29-90ce-9db79f7ee83a tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Calling method '.version_select at 0x7f5cc6218280>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:39.238121 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8e0c754c-af3d-4e29-90ce-9db79f7ee83a tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] [instance: 51f5cae8-033b-466b-99b8-465ea87d2b0e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:39.245664 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8e0c754c-af3d-4e29-90ce-9db79f7ee83a tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:39.246803 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8e0c754c-af3d-4e29-90ce-9db79f7ee83a tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:39.247465 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8e0c754c-af3d-4e29-90ce-9db79f7ee83a tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:39.251513 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8e0c754c-af3d-4e29-90ce-9db79f7ee83a tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:39.251513 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8e0c754c-af3d-4e29-90ce-9db79f7ee83a tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:39.251513 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8e0c754c-af3d-4e29-90ce-9db79f7ee83a tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:39.346415 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8e0c754c-af3d-4e29-90ce-9db79f7ee83a tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] 10.222.0.42 "GET /compute/v2.1/servers/51f5cae8-033b-466b-99b8-465ea87d2b0e/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.114168 Oct 23 01:34:39.351454 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2678/5266] 10.222.0.42 () {60 vars in 1337 bytes} [Sun Oct 23 01:34:39 2022] GET /compute/v2.1/servers/51f5cae8-033b-466b-99b8-465ea87d2b0e/os-instance-actions => generated 611 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:34:39.364235 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9c5a6100-ab10-43ed-8a25-54529fe7a57c tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:39.365107 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9c5a6100-ab10-43ed-8a25-54529fe7a57c tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] [instance: 51f5cae8-033b-466b-99b8-465ea87d2b0e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:39.371857 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9c5a6100-ab10-43ed-8a25-54529fe7a57c tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:39.372654 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9c5a6100-ab10-43ed-8a25-54529fe7a57c tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:39.373285 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9c5a6100-ab10-43ed-8a25-54529fe7a57c tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:39.374219 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9c5a6100-ab10-43ed-8a25-54529fe7a57c tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:39.374868 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9c5a6100-ab10-43ed-8a25-54529fe7a57c tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:39.375486 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9c5a6100-ab10-43ed-8a25-54529fe7a57c tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:39.390601 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-9c5a6100-ab10-43ed-8a25-54529fe7a57c tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] HTTP exception thrown: Instance 51f5cae8-033b-466b-99b8-465ea87d2b0e could not be found. Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9c5a6100-ab10-43ed-8a25-54529fe7a57c tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Request method failure captured: Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/servers/51f5cae8-033b-466b-99b8-465ea87d2b0e HTTP/1.1 Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJoRvsl2U8OohbrBMyuKgBYLKDKbM3AMp0JDVCPDyBtEpqlkOGxLIqTZQdZsSwdtWs05spwQFuh0c2U31goT3bTNt_jp4wo4JbPIyUKGHyjob6IifUcYC1mney1CtNbrVVyIVDUwEDzstpZQEH6BBYxFnPCyXeKiPZ9vpEUAO-KUOQw Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: X-Openstack-Nova-Api-Version: 2.21 Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 7defb846e6a24a0aadb9de6de5439b8a Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-InstanceActionsV221TestJSON-743343850 Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7defb846e6a24a0aadb9de6de5439b8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7defb846e6a24a0aadb9de6de5439b8a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7defb846e6a24a0aadb9de6de5439b8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7defb846e6a24a0aadb9de6de5439b8a"}]}] Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-InstanceActionsV221TestJSON-743343850 Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 7defb846e6a24a0aadb9de6de5439b8a Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-743343850 Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-InstanceActionsV221TestJSON-743343850-project Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: b118116bb0734e8496aaa1446e871d7e Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-InstanceActionsV221TestJSON-743343850-project Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 51f5cae8-033b-466b-99b8-465ea87d2b0e could not be found. Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '51f5cae8-033b-466b-99b8-465ea87d2b0e'} Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51f5cae8-033b-466b-99b8-465ea87d2b0e could not be found. Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:34:39.392498 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:34:39.396889 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51f5cae8-033b-466b-99b8-465ea87d2b0e could not be found. Oct 23 01:34:39.396889 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:39.396889 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:34:39.396889 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:39.396889 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:39.396889 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:34:39.396889 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:34:39.396889 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:34:39.396889 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:34:39.396889 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51f5cae8-033b-466b-99b8-465ea87d2b0e could not be found. Oct 23 01:34:39.396889 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:34:39.410051 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9c5a6100-ab10-43ed-8a25-54529fe7a57c tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Returning 404 to user: Instance 51f5cae8-033b-466b-99b8-465ea87d2b0e could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:34:39.410051 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9c5a6100-ab10-43ed-8a25-54529fe7a57c tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] 10.222.0.42 "DELETE /compute/v2.1/servers/51f5cae8-033b-466b-99b8-465ea87d2b0e" status: 404 len: 111 microversion: 2.21 time: 0.040462 Oct 23 01:34:39.410051 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2589/5267] 10.222.0.42 () {60 vars in 1280 bytes} [Sun Oct 23 01:34:39 2022] DELETE /compute/v2.1/servers/51f5cae8-033b-466b-99b8-465ea87d2b0e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:34:39.410626 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6193c4df-23ce-460f-8166-3f38876b2300 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:39.411233 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6193c4df-23ce-460f-8166-3f38876b2300 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] [instance: 51f5cae8-033b-466b-99b8-465ea87d2b0e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:39.417495 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6193c4df-23ce-460f-8166-3f38876b2300 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:39.418049 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6193c4df-23ce-460f-8166-3f38876b2300 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:39.418528 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6193c4df-23ce-460f-8166-3f38876b2300 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:39.419323 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6193c4df-23ce-460f-8166-3f38876b2300 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:39.419790 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6193c4df-23ce-460f-8166-3f38876b2300 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:39.420363 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6193c4df-23ce-460f-8166-3f38876b2300 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:39.443163 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-6193c4df-23ce-460f-8166-3f38876b2300 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] HTTP exception thrown: Instance 51f5cae8-033b-466b-99b8-465ea87d2b0e could not be found. Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6193c4df-23ce-460f-8166-3f38876b2300 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Request method failure captured: Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/51f5cae8-033b-466b-99b8-465ea87d2b0e HTTP/1.1 Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJoRvsl2U8OohbrBMyuKgBYLKDKbM3AMp0JDVCPDyBtEpqlkOGxLIqTZQdZsSwdtWs05spwQFuh0c2U31goT3bTNt_jp4wo4JbPIyUKGHyjob6IifUcYC1mney1CtNbrVVyIVDUwEDzstpZQEH6BBYxFnPCyXeKiPZ9vpEUAO-KUOQw Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: X-Openstack-Nova-Api-Version: 2.21 Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 7defb846e6a24a0aadb9de6de5439b8a Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-InstanceActionsV221TestJSON-743343850 Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7defb846e6a24a0aadb9de6de5439b8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7defb846e6a24a0aadb9de6de5439b8a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7defb846e6a24a0aadb9de6de5439b8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7defb846e6a24a0aadb9de6de5439b8a"}]}] Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-InstanceActionsV221TestJSON-743343850 Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 7defb846e6a24a0aadb9de6de5439b8a Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-743343850 Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-InstanceActionsV221TestJSON-743343850-project Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: b118116bb0734e8496aaa1446e871d7e Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-InstanceActionsV221TestJSON-743343850-project Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 51f5cae8-033b-466b-99b8-465ea87d2b0e could not be found. Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '51f5cae8-033b-466b-99b8-465ea87d2b0e'} Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51f5cae8-033b-466b-99b8-465ea87d2b0e could not be found. Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51f5cae8-033b-466b-99b8-465ea87d2b0e could not be found. Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:34:39.450401 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:34:39.455153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:34:39.455153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:34:39.455153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:34:39.455153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:34:39.455153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:34:39.455153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:34:39.455153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51f5cae8-033b-466b-99b8-465ea87d2b0e could not be found. Oct 23 01:34:39.455153 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:34:39.455153 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6193c4df-23ce-460f-8166-3f38876b2300 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] Returning 404 to user: Instance 51f5cae8-033b-466b-99b8-465ea87d2b0e could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:34:39.455153 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6193c4df-23ce-460f-8166-3f38876b2300 tempest-InstanceActionsV221TestJSON-743343850 tempest-InstanceActionsV221TestJSON-743343850-project] 10.222.0.42 "GET /compute/v2.1/servers/51f5cae8-033b-466b-99b8-465ea87d2b0e" status: 404 len: 111 microversion: 2.21 time: 0.041850 Oct 23 01:34:39.455153 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2679/5268] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:34:39 2022] GET /compute/v2.1/servers/51f5cae8-033b-466b-99b8-465ea87d2b0e => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:34:39.532575 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-07405671-7f6e-45ee-8d3b-f3c190176ef1 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:39.533478 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-07405671-7f6e-45ee-8d3b-f3c190176ef1 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] [instance: bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:39.545390 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-07405671-7f6e-45ee-8d3b-f3c190176ef1 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:39.549277 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-07405671-7f6e-45ee-8d3b-f3c190176ef1 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:39.551021 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-07405671-7f6e-45ee-8d3b-f3c190176ef1 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:39.552316 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-07405671-7f6e-45ee-8d3b-f3c190176ef1 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:39.552434 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-07405671-7f6e-45ee-8d3b-f3c190176ef1 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:39.552858 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-07405671-7f6e-45ee-8d3b-f3c190176ef1 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:39.848816 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-eaa8f832-8c69-454d-b208-9b52cec5ac14 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:39.849890 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-eaa8f832-8c69-454d-b208-9b52cec5ac14 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 740c5d14-9669-45e2-9ba9-723926f774ab] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:39.858267 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eaa8f832-8c69-454d-b208-9b52cec5ac14 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:39.859082 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eaa8f832-8c69-454d-b208-9b52cec5ac14 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:39.864026 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eaa8f832-8c69-454d-b208-9b52cec5ac14 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:39.865094 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eaa8f832-8c69-454d-b208-9b52cec5ac14 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:39.865791 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eaa8f832-8c69-454d-b208-9b52cec5ac14 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:39.867054 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eaa8f832-8c69-454d-b208-9b52cec5ac14 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:40.496594 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-eaa8f832-8c69-454d-b208-9b52cec5ac14 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:40.511657 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-eaa8f832-8c69-454d-b208-9b52cec5ac14 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab" status: 200 len: 1315 microversion: 2.1 time: 0.666869 Oct 23 01:34:40.512275 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2680/5269] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:39 2022] GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab => generated 1315 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:34:40.519854 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dd1d3aa6-c719-4500-8517-cc6d3981cb9b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:40.530394 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-dd1d3aa6-c719-4500-8517-cc6d3981cb9b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:40.544144 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd1d3aa6-c719-4500-8517-cc6d3981cb9b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:40.545447 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd1d3aa6-c719-4500-8517-cc6d3981cb9b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:40.546354 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd1d3aa6-c719-4500-8517-cc6d3981cb9b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:40.547849 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd1d3aa6-c719-4500-8517-cc6d3981cb9b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:40.549108 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd1d3aa6-c719-4500-8517-cc6d3981cb9b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:40.550291 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd1d3aa6-c719-4500-8517-cc6d3981cb9b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:40.595166 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=100 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:34:40.632540 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-07405671-7f6e-45ee-8d3b-f3c190176ef1 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1759290b0b4034ad9d312abb95ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4c34c1a48140f8ae5a69fa0abb2bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:40.655054 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-07405671-7f6e-45ee-8d3b-f3c190176ef1 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] 10.222.0.42 "GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12" status: 200 len: 1427 microversion: 2.1 time: 1.126643 Oct 23 01:34:40.660398 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2590/5270] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:39 2022] GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12 => generated 1427 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:41.027759 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-dd1d3aa6-c719-4500-8517-cc6d3981cb9b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:41.040899 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-dd1d3aa6-c719-4500-8517-cc6d3981cb9b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 200 len: 1509 microversion: 2.1 time: 0.524657 Oct 23 01:34:41.064147 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2681/5271] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:40 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 1509 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:41.543845 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0f9e6a44-c9d9-42f8-9a9e-637965a58871 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:41.545806 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0f9e6a44-c9d9-42f8-9a9e-637965a58871 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 740c5d14-9669-45e2-9ba9-723926f774ab] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:41.554779 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0f9e6a44-c9d9-42f8-9a9e-637965a58871 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:41.555623 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0f9e6a44-c9d9-42f8-9a9e-637965a58871 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:41.556308 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0f9e6a44-c9d9-42f8-9a9e-637965a58871 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:41.557566 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0f9e6a44-c9d9-42f8-9a9e-637965a58871 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:41.558326 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0f9e6a44-c9d9-42f8-9a9e-637965a58871 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:41.558992 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0f9e6a44-c9d9-42f8-9a9e-637965a58871 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:41.683664 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2ad7adcb-473c-4775-aad3-0e4276cab4f3 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:41.684203 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2ad7adcb-473c-4775-aad3-0e4276cab4f3 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] [instance: bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:41.692714 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2ad7adcb-473c-4775-aad3-0e4276cab4f3 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:41.693224 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2ad7adcb-473c-4775-aad3-0e4276cab4f3 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:41.701310 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2ad7adcb-473c-4775-aad3-0e4276cab4f3 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:41.701310 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2ad7adcb-473c-4775-aad3-0e4276cab4f3 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:41.701310 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2ad7adcb-473c-4775-aad3-0e4276cab4f3 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:41.701310 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2ad7adcb-473c-4775-aad3-0e4276cab4f3 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:42.126381 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0f9e6a44-c9d9-42f8-9a9e-637965a58871 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:42.140946 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0f9e6a44-c9d9-42f8-9a9e-637965a58871 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab" status: 200 len: 1315 microversion: 2.1 time: 0.604111 Oct 23 01:34:42.143882 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2591/5272] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:41 2022] GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab => generated 1315 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:42.182085 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-09462c9f-be01-4f5b-a021-729dfb661513 req-9613c707-a476-4b50-bf86-6ac6fe7493ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "740c5d14-9669-45e2-9ba9-723926f774ab", "name": "network-vif-plugged", "status": "completed", "tag": "f9f5f6e7-a37b-43ef-b9e5-85882f8c1cf7"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:34:42.217746 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-09462c9f-be01-4f5b-a021-729dfb661513 req-9613c707-a476-4b50-bf86-6ac6fe7493ed service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:42.222855 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-09462c9f-be01-4f5b-a021-729dfb661513 req-9613c707-a476-4b50-bf86-6ac6fe7493ed service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:42.225920 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-09462c9f-be01-4f5b-a021-729dfb661513 req-9613c707-a476-4b50-bf86-6ac6fe7493ed service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:42.245598 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2ad7adcb-473c-4775-aad3-0e4276cab4f3 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1759290b0b4034ad9d312abb95ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4c34c1a48140f8ae5a69fa0abb2bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:42.255431 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2ad7adcb-473c-4775-aad3-0e4276cab4f3 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] 10.222.0.42 "GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12" status: 200 len: 1608 microversion: 2.1 time: 0.575739 Oct 23 01:34:42.264900 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2682/5273] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:41 2022] GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12 => generated 1608 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:34:42.285126 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-09462c9f-be01-4f5b-a021-729dfb661513 req-9613c707-a476-4b50-bf86-6ac6fe7493ed service nova] Creating event network-vif-plugged:f9f5f6e7-a37b-43ef-b9e5-85882f8c1cf7 for instance 740c5d14-9669-45e2-9ba9-723926f774ab on n-h2-master-1 Oct 23 01:34:42.288397 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bc712a19-b803-4444-a06b-541363b2177e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:42.289317 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bc712a19-b803-4444-a06b-541363b2177e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:42.313741 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc712a19-b803-4444-a06b-541363b2177e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:42.314302 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc712a19-b803-4444-a06b-541363b2177e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:42.314747 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc712a19-b803-4444-a06b-541363b2177e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:42.315499 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc712a19-b803-4444-a06b-541363b2177e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:42.315957 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc712a19-b803-4444-a06b-541363b2177e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:42.316389 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc712a19-b803-4444-a06b-541363b2177e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:42.321593 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-09462c9f-be01-4f5b-a021-729dfb661513 req-9613c707-a476-4b50-bf86-6ac6fe7493ed service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146555 Oct 23 01:34:42.326082 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2592/5274] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:34:42.336677 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-25525109-d58c-422c-954e-94a49b210a31 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:42.340523 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-25525109-d58c-422c-954e-94a49b210a31 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] [instance: bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:42.364246 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:34:42.370868 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25525109-d58c-422c-954e-94a49b210a31 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:42.371577 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25525109-d58c-422c-954e-94a49b210a31 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:42.372321 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25525109-d58c-422c-954e-94a49b210a31 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:42.378416 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25525109-d58c-422c-954e-94a49b210a31 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:42.380007 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25525109-d58c-422c-954e-94a49b210a31 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:42.381993 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25525109-d58c-422c-954e-94a49b210a31 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:42.968429 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bc712a19-b803-4444-a06b-541363b2177e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:42.980590 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bc712a19-b803-4444-a06b-541363b2177e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 200 len: 1509 microversion: 2.1 time: 0.714520 Oct 23 01:34:42.981438 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2683/5275] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:42 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 1509 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:42.999786 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-25525109-d58c-422c-954e-94a49b210a31 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1759290b0b4034ad9d312abb95ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4c34c1a48140f8ae5a69fa0abb2bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:43.016189 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-25525109-d58c-422c-954e-94a49b210a31 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] 10.222.0.42 "GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12" status: 200 len: 1608 microversion: 2.1 time: 0.688623 Oct 23 01:34:43.038401 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2593/5276] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:42 2022] GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12 => generated 1608 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:43.049233 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c2403877-5c1c-4f93-83ce-3bd9a7f2b855 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:43.050684 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c2403877-5c1c-4f93-83ce-3bd9a7f2b855 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] [instance: bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:43.063201 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2403877-5c1c-4f93-83ce-3bd9a7f2b855 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:43.063618 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2403877-5c1c-4f93-83ce-3bd9a7f2b855 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:43.064057 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2403877-5c1c-4f93-83ce-3bd9a7f2b855 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:43.064760 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2403877-5c1c-4f93-83ce-3bd9a7f2b855 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:43.065222 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2403877-5c1c-4f93-83ce-3bd9a7f2b855 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:43.067203 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2403877-5c1c-4f93-83ce-3bd9a7f2b855 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:43.173993 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cee890c2-77cb-42cc-b713-870c8b886ee6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:43.176119 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cee890c2-77cb-42cc-b713-870c8b886ee6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 740c5d14-9669-45e2-9ba9-723926f774ab] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:43.187246 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cee890c2-77cb-42cc-b713-870c8b886ee6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:43.190169 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cee890c2-77cb-42cc-b713-870c8b886ee6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:43.190857 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cee890c2-77cb-42cc-b713-870c8b886ee6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:43.191768 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cee890c2-77cb-42cc-b713-870c8b886ee6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:43.194189 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cee890c2-77cb-42cc-b713-870c8b886ee6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:43.194813 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cee890c2-77cb-42cc-b713-870c8b886ee6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:43.457481 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c2403877-5c1c-4f93-83ce-3bd9a7f2b855 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1759290b0b4034ad9d312abb95ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4c34c1a48140f8ae5a69fa0abb2bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:43.492176 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c2403877-5c1c-4f93-83ce-3bd9a7f2b855 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] 10.222.0.42 "GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12" status: 200 len: 1608 microversion: 2.1 time: 0.431479 Oct 23 01:34:43.492176 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2684/5277] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:43 2022] GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12 => generated 1608 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:43.692406 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cee890c2-77cb-42cc-b713-870c8b886ee6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:43.702745 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cee890c2-77cb-42cc-b713-870c8b886ee6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab" status: 200 len: 1315 microversion: 2.1 time: 0.534594 Oct 23 01:34:43.703680 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2594/5278] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:43 2022] GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab => generated 1315 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:34:44.008897 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ac032532-9c32-42aa-a362-fd7d44b80e28 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:44.009527 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ac032532-9c32-42aa-a362-fd7d44b80e28 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:44.019686 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac032532-9c32-42aa-a362-fd7d44b80e28 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:44.024363 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac032532-9c32-42aa-a362-fd7d44b80e28 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:44.025660 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac032532-9c32-42aa-a362-fd7d44b80e28 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:44.030127 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac032532-9c32-42aa-a362-fd7d44b80e28 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:44.030902 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac032532-9c32-42aa-a362-fd7d44b80e28 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:44.031507 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac032532-9c32-42aa-a362-fd7d44b80e28 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:44.458559 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ac032532-9c32-42aa-a362-fd7d44b80e28 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:44.482751 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ac032532-9c32-42aa-a362-fd7d44b80e28 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 200 len: 1509 microversion: 2.1 time: 0.477853 Oct 23 01:34:44.487316 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2685/5279] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:44 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 1509 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:44.726123 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5299bf5c-db44-4ac9-b3dd-4395d68d5679 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:44.727437 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5299bf5c-db44-4ac9-b3dd-4395d68d5679 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 740c5d14-9669-45e2-9ba9-723926f774ab] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:44.741088 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5299bf5c-db44-4ac9-b3dd-4395d68d5679 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:44.743073 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5299bf5c-db44-4ac9-b3dd-4395d68d5679 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:44.744976 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5299bf5c-db44-4ac9-b3dd-4395d68d5679 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:44.747525 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5299bf5c-db44-4ac9-b3dd-4395d68d5679 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:44.748105 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5299bf5c-db44-4ac9-b3dd-4395d68d5679 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:44.750192 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5299bf5c-db44-4ac9-b3dd-4395d68d5679 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:45.001282 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5299bf5c-db44-4ac9-b3dd-4395d68d5679 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:45.016611 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5299bf5c-db44-4ac9-b3dd-4395d68d5679 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab" status: 200 len: 1503 microversion: 2.1 time: 0.295062 Oct 23 01:34:45.017799 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2595/5280] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:44 2022] GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab => generated 1503 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:45.047759 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-360af866-3a67-4c0a-b8a2-0094cbb40d56 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:34:45.059890 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-360af866-3a67-4c0a-b8a2-0094cbb40d56 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:45.060809 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-360af866-3a67-4c0a-b8a2-0094cbb40d56 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:45.064176 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-360af866-3a67-4c0a-b8a2-0094cbb40d56 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:45.131661 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-360af866-3a67-4c0a-b8a2-0094cbb40d56 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 740c5d14-9669-45e2-9ba9-723926f774ab] Going to try to stop instance {{(pid=120944) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 23 01:34:45.397328 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-360af866-3a67-4c0a-b8a2-0094cbb40d56 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "POST /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab/action" status: 202 len: 0 microversion: 2.1 time: 0.356230 Oct 23 01:34:45.398649 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2686/5281] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:34:45 2022] POST /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab/action => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:34:45.407402 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-828f5420-6f32-4270-a716-62c2c44079b8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:45.408022 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-828f5420-6f32-4270-a716-62c2c44079b8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 740c5d14-9669-45e2-9ba9-723926f774ab] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:45.423207 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-828f5420-6f32-4270-a716-62c2c44079b8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:45.428869 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-828f5420-6f32-4270-a716-62c2c44079b8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:45.429461 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-828f5420-6f32-4270-a716-62c2c44079b8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:45.432859 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-828f5420-6f32-4270-a716-62c2c44079b8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:45.435503 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-828f5420-6f32-4270-a716-62c2c44079b8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:45.436108 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-828f5420-6f32-4270-a716-62c2c44079b8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:45.512434 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8678a122-cd99-42c1-8833-4e0c3c9a112e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:45.513149 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8678a122-cd99-42c1-8833-4e0c3c9a112e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:45.524868 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8678a122-cd99-42c1-8833-4e0c3c9a112e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:45.525563 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8678a122-cd99-42c1-8833-4e0c3c9a112e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:45.531689 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8678a122-cd99-42c1-8833-4e0c3c9a112e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:45.532667 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8678a122-cd99-42c1-8833-4e0c3c9a112e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:45.533307 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8678a122-cd99-42c1-8833-4e0c3c9a112e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:45.534759 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8678a122-cd99-42c1-8833-4e0c3c9a112e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:46.293001 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-828f5420-6f32-4270-a716-62c2c44079b8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:46.312347 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8678a122-cd99-42c1-8833-4e0c3c9a112e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:46.350250 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-828f5420-6f32-4270-a716-62c2c44079b8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab" status: 200 len: 1513 microversion: 2.1 time: 0.938272 Oct 23 01:34:46.353197 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8678a122-cd99-42c1-8833-4e0c3c9a112e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 200 len: 1509 microversion: 2.1 time: 0.843215 Oct 23 01:34:46.354765 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2596/5282] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:45 2022] GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab => generated 1513 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:46.355947 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2687/5283] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:45 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 1509 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:47.377409 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b61f774a-2216-44da-a4cd-4b9c74194f01 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:47.379020 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b61f774a-2216-44da-a4cd-4b9c74194f01 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 740c5d14-9669-45e2-9ba9-723926f774ab] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:47.382580 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2110b1c1-c993-4883-a34d-a9cccea93ce9 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:47.383591 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2110b1c1-c993-4883-a34d-a9cccea93ce9 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:47.391800 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b61f774a-2216-44da-a4cd-4b9c74194f01 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:47.397333 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b61f774a-2216-44da-a4cd-4b9c74194f01 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:47.397736 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2110b1c1-c993-4883-a34d-a9cccea93ce9 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:47.398419 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b61f774a-2216-44da-a4cd-4b9c74194f01 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:47.398588 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2110b1c1-c993-4883-a34d-a9cccea93ce9 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:47.399963 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2110b1c1-c993-4883-a34d-a9cccea93ce9 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:47.403716 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2110b1c1-c993-4883-a34d-a9cccea93ce9 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:47.404513 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2110b1c1-c993-4883-a34d-a9cccea93ce9 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:47.405170 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2110b1c1-c993-4883-a34d-a9cccea93ce9 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:47.408136 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b61f774a-2216-44da-a4cd-4b9c74194f01 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:47.408685 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b61f774a-2216-44da-a4cd-4b9c74194f01 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:47.416033 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b61f774a-2216-44da-a4cd-4b9c74194f01 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:47.869039 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2110b1c1-c993-4883-a34d-a9cccea93ce9 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:47.881374 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2110b1c1-c993-4883-a34d-a9cccea93ce9 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 200 len: 1509 microversion: 2.1 time: 0.504562 Oct 23 01:34:47.882772 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2688/5284] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:47 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 1509 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:34:47.963281 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b61f774a-2216-44da-a4cd-4b9c74194f01 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:47.993353 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b61f774a-2216-44da-a4cd-4b9c74194f01 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab" status: 200 len: 1513 microversion: 2.1 time: 0.619992 Oct 23 01:34:47.998870 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2597/5285] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:47 2022] GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab => generated 1513 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:48.906727 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d4c56212-3adb-4e4b-aa20-3f6da245987c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:48.907321 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d4c56212-3adb-4e4b-aa20-3f6da245987c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:48.931617 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=100 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:34:48.943883 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d4c56212-3adb-4e4b-aa20-3f6da245987c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:48.944387 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d4c56212-3adb-4e4b-aa20-3f6da245987c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:48.944828 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d4c56212-3adb-4e4b-aa20-3f6da245987c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:48.951031 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d4c56212-3adb-4e4b-aa20-3f6da245987c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:48.951692 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d4c56212-3adb-4e4b-aa20-3f6da245987c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:48.952143 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d4c56212-3adb-4e4b-aa20-3f6da245987c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:49.023411 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-455c470e-15ad-4fcd-9498-05a2baff5a9b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:49.023980 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-455c470e-15ad-4fcd-9498-05a2baff5a9b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 740c5d14-9669-45e2-9ba9-723926f774ab] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:49.044665 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-455c470e-15ad-4fcd-9498-05a2baff5a9b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:49.045166 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-455c470e-15ad-4fcd-9498-05a2baff5a9b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:49.045606 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-455c470e-15ad-4fcd-9498-05a2baff5a9b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:49.052873 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-455c470e-15ad-4fcd-9498-05a2baff5a9b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:49.053235 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-455c470e-15ad-4fcd-9498-05a2baff5a9b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:49.053676 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-455c470e-15ad-4fcd-9498-05a2baff5a9b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:49.704469 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d4c56212-3adb-4e4b-aa20-3f6da245987c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:49.716235 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d4c56212-3adb-4e4b-aa20-3f6da245987c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 200 len: 1509 microversion: 2.1 time: 0.811288 Oct 23 01:34:49.731463 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2689/5286] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:48 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 1509 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:49.732769 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-455c470e-15ad-4fcd-9498-05a2baff5a9b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:49.739437 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6574d19c-744e-4d70-ac15-bb6dfe5bf0c6 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:49.744154 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6574d19c-744e-4d70-ac15-bb6dfe5bf0c6 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 697bf9a9-687f-4d5f-a459-9ff304289577] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:49.744307 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-455c470e-15ad-4fcd-9498-05a2baff5a9b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab" status: 200 len: 1513 microversion: 2.1 time: 0.724024 Oct 23 01:34:49.744307 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2598/5287] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:49 2022] GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab => generated 1513 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:49.748131 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6574d19c-744e-4d70-ac15-bb6dfe5bf0c6 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:49.749317 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6574d19c-744e-4d70-ac15-bb6dfe5bf0c6 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:49.750011 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6574d19c-744e-4d70-ac15-bb6dfe5bf0c6 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:49.752658 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6574d19c-744e-4d70-ac15-bb6dfe5bf0c6 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:49.755395 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6574d19c-744e-4d70-ac15-bb6dfe5bf0c6 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:49.755974 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6574d19c-744e-4d70-ac15-bb6dfe5bf0c6 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:49.803307 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6574d19c-744e-4d70-ac15-bb6dfe5bf0c6 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577/ips" status: 200 len: 151 microversion: 2.1 time: 0.070171 Oct 23 01:34:49.804220 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2690/5288] 10.222.0.42 () {58 vars in 1248 bytes} [Sun Oct 23 01:34:49 2022] GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577/ips => generated 151 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:34:50.124829 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-1c032ce2-2273-43ef-9d8e-f702a0d962bc req-c3a2a8ff-7fea-4b8c-9bb2-515afee5b90e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12", "tag": "b43f6b89-f0c2-46ea-b574-0ac7c429416c"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:34:50.153258 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-1c032ce2-2273-43ef-9d8e-f702a0d962bc req-c3a2a8ff-7fea-4b8c-9bb2-515afee5b90e service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:50.165494 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-1c032ce2-2273-43ef-9d8e-f702a0d962bc req-c3a2a8ff-7fea-4b8c-9bb2-515afee5b90e service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:50.166023 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-1c032ce2-2273-43ef-9d8e-f702a0d962bc req-c3a2a8ff-7fea-4b8c-9bb2-515afee5b90e service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:50.208154 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-1c032ce2-2273-43ef-9d8e-f702a0d962bc req-c3a2a8ff-7fea-4b8c-9bb2-515afee5b90e service nova] Creating event network-changed:b43f6b89-f0c2-46ea-b574-0ac7c429416c for instance bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12 on n-h2-master-1 Oct 23 01:34:50.233584 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-1c032ce2-2273-43ef-9d8e-f702a0d962bc req-c3a2a8ff-7fea-4b8c-9bb2-515afee5b90e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123570 Oct 23 01:34:50.249114 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2599/5289] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:34:50.740364 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b8a6c8a4-b581-4ced-802a-47ff87e9448e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:50.742837 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b8a6c8a4-b581-4ced-802a-47ff87e9448e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:50.757288 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b8a6c8a4-b581-4ced-802a-47ff87e9448e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:50.758497 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b8a6c8a4-b581-4ced-802a-47ff87e9448e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:50.760165 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b8a6c8a4-b581-4ced-802a-47ff87e9448e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:50.761615 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b8a6c8a4-b581-4ced-802a-47ff87e9448e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:50.763048 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b8a6c8a4-b581-4ced-802a-47ff87e9448e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:50.766539 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b8a6c8a4-b581-4ced-802a-47ff87e9448e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:50.773170 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5468a8fa-7d1b-4b9b-951a-efc6ff5f54e4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:50.774002 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5468a8fa-7d1b-4b9b-951a-efc6ff5f54e4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 740c5d14-9669-45e2-9ba9-723926f774ab] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:50.789085 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5468a8fa-7d1b-4b9b-951a-efc6ff5f54e4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:50.793006 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5468a8fa-7d1b-4b9b-951a-efc6ff5f54e4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:50.807569 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5468a8fa-7d1b-4b9b-951a-efc6ff5f54e4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:50.808951 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5468a8fa-7d1b-4b9b-951a-efc6ff5f54e4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:50.810137 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5468a8fa-7d1b-4b9b-951a-efc6ff5f54e4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:50.810950 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5468a8fa-7d1b-4b9b-951a-efc6ff5f54e4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:52.019396 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b8a6c8a4-b581-4ced-802a-47ff87e9448e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:52.035625 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b8a6c8a4-b581-4ced-802a-47ff87e9448e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 200 len: 1530 microversion: 2.1 time: 1.301171 Oct 23 01:34:52.041697 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2691/5290] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:50 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 1530 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:52.043224 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b8a6c8a4-b581-4ced-802a-47ff87e9448e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:52.047344 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b8a6c8a4-b581-4ced-802a-47ff87e9448e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute//" status: 200 len: 377 microversion: - time: 0.004407 Oct 23 01:34:52.049698 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2692/5291] 10.222.0.42 () {56 vars in 886 bytes} [Sun Oct 23 01:34:52 2022] GET /compute/ => generated 377 bytes in 7 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 23 01:34:52.429938 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5468a8fa-7d1b-4b9b-951a-efc6ff5f54e4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:52.438134 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5468a8fa-7d1b-4b9b-951a-efc6ff5f54e4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab" status: 200 len: 1513 microversion: 2.1 time: 1.665083 Oct 23 01:34:52.440656 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2600/5292] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:50 2022] GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab => generated 1513 bytes in 1673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:53.079822 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8c1f523b-ae9f-49cd-bc30-aa05d15bfb9e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:53.081345 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8c1f523b-ae9f-49cd-bc30-aa05d15bfb9e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:53.092611 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c1f523b-ae9f-49cd-bc30-aa05d15bfb9e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:53.097187 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c1f523b-ae9f-49cd-bc30-aa05d15bfb9e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:53.104442 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c1f523b-ae9f-49cd-bc30-aa05d15bfb9e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:53.105443 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c1f523b-ae9f-49cd-bc30-aa05d15bfb9e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:53.106269 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c1f523b-ae9f-49cd-bc30-aa05d15bfb9e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:53.107021 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c1f523b-ae9f-49cd-bc30-aa05d15bfb9e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:53.467079 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-94cf84b3-bf64-432e-b3a3-7d4830af76a1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:53.467636 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-94cf84b3-bf64-432e-b3a3-7d4830af76a1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 740c5d14-9669-45e2-9ba9-723926f774ab] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:53.481587 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94cf84b3-bf64-432e-b3a3-7d4830af76a1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:53.486469 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94cf84b3-bf64-432e-b3a3-7d4830af76a1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:53.486469 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94cf84b3-bf64-432e-b3a3-7d4830af76a1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:53.487005 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94cf84b3-bf64-432e-b3a3-7d4830af76a1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:53.487116 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94cf84b3-bf64-432e-b3a3-7d4830af76a1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:53.487856 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94cf84b3-bf64-432e-b3a3-7d4830af76a1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:53.549223 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8c1f523b-ae9f-49cd-bc30-aa05d15bfb9e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:53.557927 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8c1f523b-ae9f-49cd-bc30-aa05d15bfb9e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 200 len: 1525 microversion: 2.1 time: 0.485510 Oct 23 01:34:53.570259 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2693/5293] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:53 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 1525 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:53.851284 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-94cf84b3-bf64-432e-b3a3-7d4830af76a1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:53.874462 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-94cf84b3-bf64-432e-b3a3-7d4830af76a1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab" status: 200 len: 1513 microversion: 2.1 time: 0.411463 Oct 23 01:34:53.875596 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2601/5294] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:53 2022] GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab => generated 1513 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:34:54.100408 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fe38ab09-33cc-4c68-a934-291e2963e02d tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "392fabb8-72fc-4a48-9fb8-e52fec506e67"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:34:54.103108 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fe38ab09-33cc-4c68-a934-291e2963e02d tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 697bf9a9-687f-4d5f-a459-9ff304289577] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:54.128909 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe38ab09-33cc-4c68-a934-291e2963e02d tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:54.129359 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe38ab09-33cc-4c68-a934-291e2963e02d tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:54.129813 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe38ab09-33cc-4c68-a934-291e2963e02d tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:54.137063 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe38ab09-33cc-4c68-a934-291e2963e02d tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:54.138386 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe38ab09-33cc-4c68-a934-291e2963e02d tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:54.138386 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe38ab09-33cc-4c68-a934-291e2963e02d tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:54.590711 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-86da16d1-0662-410a-a7a1-8432feb85b2d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:54.591346 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-86da16d1-0662-410a-a7a1-8432feb85b2d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:54.615832 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-86da16d1-0662-410a-a7a1-8432feb85b2d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:54.616653 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-86da16d1-0662-410a-a7a1-8432feb85b2d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:54.619604 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-86da16d1-0662-410a-a7a1-8432feb85b2d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:54.622861 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-86da16d1-0662-410a-a7a1-8432feb85b2d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:54.632505 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-86da16d1-0662-410a-a7a1-8432feb85b2d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:54.654289 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-86da16d1-0662-410a-a7a1-8432feb85b2d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:55.176987 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-86da16d1-0662-410a-a7a1-8432feb85b2d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:55.185659 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-86da16d1-0662-410a-a7a1-8432feb85b2d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 200 len: 1525 microversion: 2.1 time: 0.600605 Oct 23 01:34:55.186365 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2602/5295] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:54 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 1525 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:55.211616 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-317d027b-0a54-4d23-ade6-76b901c62cbd tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:55.213138 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-317d027b-0a54-4d23-ade6-76b901c62cbd tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 740c5d14-9669-45e2-9ba9-723926f774ab] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:55.246689 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-317d027b-0a54-4d23-ade6-76b901c62cbd tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:55.247465 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-317d027b-0a54-4d23-ade6-76b901c62cbd tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:55.248182 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-317d027b-0a54-4d23-ade6-76b901c62cbd tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:55.249167 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-317d027b-0a54-4d23-ade6-76b901c62cbd tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:55.249952 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-317d027b-0a54-4d23-ade6-76b901c62cbd tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:55.250945 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-317d027b-0a54-4d23-ade6-76b901c62cbd tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:55.289143 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fe38ab09-33cc-4c68-a934-291e2963e02d tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "POST /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.192702 Oct 23 01:34:55.289806 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2694/5296] 10.222.0.42 () {60 vars in 1323 bytes} [Sun Oct 23 01:34:54 2022] POST /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577/os-volume_attachments => generated 194 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:34:55.363807 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=100 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:34:56.019264 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-317d027b-0a54-4d23-ade6-76b901c62cbd tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:56.030565 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-317d027b-0a54-4d23-ade6-76b901c62cbd tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab" status: 200 len: 1513 microversion: 2.1 time: 0.836864 Oct 23 01:34:56.033603 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2603/5297] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:55 2022] GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab => generated 1513 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:56.210126 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ce8e91fb-3665-4784-a845-4a3392464aa3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:56.210815 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ce8e91fb-3665-4784-a845-4a3392464aa3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:56.230620 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce8e91fb-3665-4784-a845-4a3392464aa3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:56.231135 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce8e91fb-3665-4784-a845-4a3392464aa3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:56.231590 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce8e91fb-3665-4784-a845-4a3392464aa3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:56.232317 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce8e91fb-3665-4784-a845-4a3392464aa3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:56.245464 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce8e91fb-3665-4784-a845-4a3392464aa3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:56.263083 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce8e91fb-3665-4784-a845-4a3392464aa3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:56.801715 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ce8e91fb-3665-4784-a845-4a3392464aa3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:56.824379 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ce8e91fb-3665-4784-a845-4a3392464aa3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 200 len: 1525 microversion: 2.1 time: 0.616512 Oct 23 01:34:56.828413 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2695/5298] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:56 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 1525 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:57.057292 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f49995e7-cdcc-46fc-b7bd-49cbf8b55736 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:57.059117 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f49995e7-cdcc-46fc-b7bd-49cbf8b55736 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 740c5d14-9669-45e2-9ba9-723926f774ab] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:57.076451 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f49995e7-cdcc-46fc-b7bd-49cbf8b55736 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:57.076927 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f49995e7-cdcc-46fc-b7bd-49cbf8b55736 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:57.077376 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f49995e7-cdcc-46fc-b7bd-49cbf8b55736 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:57.078137 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f49995e7-cdcc-46fc-b7bd-49cbf8b55736 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:57.078606 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f49995e7-cdcc-46fc-b7bd-49cbf8b55736 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:57.082286 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f49995e7-cdcc-46fc-b7bd-49cbf8b55736 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:57.729839 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f49995e7-cdcc-46fc-b7bd-49cbf8b55736 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:57.741810 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f49995e7-cdcc-46fc-b7bd-49cbf8b55736 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab" status: 200 len: 1513 microversion: 2.1 time: 0.689054 Oct 23 01:34:57.744718 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2604/5299] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:57 2022] GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab => generated 1513 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:57.854684 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e24eceaa-7acb-4457-946f-934707de7bca tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:57.855303 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e24eceaa-7acb-4457-946f-934707de7bca tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:57.875789 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e24eceaa-7acb-4457-946f-934707de7bca tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:57.876321 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e24eceaa-7acb-4457-946f-934707de7bca tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:57.882423 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e24eceaa-7acb-4457-946f-934707de7bca tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:57.883304 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e24eceaa-7acb-4457-946f-934707de7bca tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:57.883790 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e24eceaa-7acb-4457-946f-934707de7bca tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:57.884237 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e24eceaa-7acb-4457-946f-934707de7bca tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:58.610798 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e24eceaa-7acb-4457-946f-934707de7bca tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:58.624021 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e24eceaa-7acb-4457-946f-934707de7bca tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 200 len: 1525 microversion: 2.1 time: 0.773332 Oct 23 01:34:58.628027 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2696/5300] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:57 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 1525 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:58.769128 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-79d8e920-da64-40ca-a88f-57a232789b4b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:58.769817 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-79d8e920-da64-40ca-a88f-57a232789b4b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 740c5d14-9669-45e2-9ba9-723926f774ab] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:58.781646 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-79d8e920-da64-40ca-a88f-57a232789b4b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:58.782168 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-79d8e920-da64-40ca-a88f-57a232789b4b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:58.787911 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-79d8e920-da64-40ca-a88f-57a232789b4b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:58.789368 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-79d8e920-da64-40ca-a88f-57a232789b4b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:58.789845 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-79d8e920-da64-40ca-a88f-57a232789b4b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:58.790305 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-79d8e920-da64-40ca-a88f-57a232789b4b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:58.833080 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-08624a57-e9f4-48af-b19c-40868c4aece6 req-39e63fb9-01ed-45f8-849a-bca537270a67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71362f74-5a83-466a-b7be-de2a87253559", "name": "network-vif-plugged", "status": "completed", "tag": "f30f4cf4-1b9d-4bf3-af09-74938e70131b"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:34:58.852316 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-08624a57-e9f4-48af-b19c-40868c4aece6 req-39e63fb9-01ed-45f8-849a-bca537270a67 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:58.862635 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-08624a57-e9f4-48af-b19c-40868c4aece6 req-39e63fb9-01ed-45f8-849a-bca537270a67 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:58.863883 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-08624a57-e9f4-48af-b19c-40868c4aece6 req-39e63fb9-01ed-45f8-849a-bca537270a67 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:58.888493 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:34:58.891808 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-08624a57-e9f4-48af-b19c-40868c4aece6 req-39e63fb9-01ed-45f8-849a-bca537270a67 service nova] Creating event network-vif-plugged:f30f4cf4-1b9d-4bf3-af09-74938e70131b for instance 71362f74-5a83-466a-b7be-de2a87253559 on n-h2-master-1 Oct 23 01:34:58.918850 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-08624a57-e9f4-48af-b19c-40868c4aece6 req-39e63fb9-01ed-45f8-849a-bca537270a67 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085006 Oct 23 01:34:58.919782 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2697/5301] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:34:59.246201 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-79d8e920-da64-40ca-a88f-57a232789b4b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:34:59.262703 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-79d8e920-da64-40ca-a88f-57a232789b4b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab" status: 200 len: 1513 microversion: 2.1 time: 0.494550 Oct 23 01:34:59.286563 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2605/5302] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:58 2022] GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab => generated 1513 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:34:59.654418 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-869a3c48-1d74-4c56-9929-4eb676673d18 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:34:59.655144 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-869a3c48-1d74-4c56-9929-4eb676673d18 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:34:59.669054 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-869a3c48-1d74-4c56-9929-4eb676673d18 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:59.669558 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-869a3c48-1d74-4c56-9929-4eb676673d18 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:59.691033 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-869a3c48-1d74-4c56-9929-4eb676673d18 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:34:59.692089 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-869a3c48-1d74-4c56-9929-4eb676673d18 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:34:59.692749 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-869a3c48-1d74-4c56-9929-4eb676673d18 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:34:59.693363 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-869a3c48-1d74-4c56-9929-4eb676673d18 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:00.290716 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b93a2b65-a5dd-4568-8ad9-5b5942e36898 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:00.291569 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b93a2b65-a5dd-4568-8ad9-5b5942e36898 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 740c5d14-9669-45e2-9ba9-723926f774ab] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:00.311825 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b93a2b65-a5dd-4568-8ad9-5b5942e36898 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:00.312644 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b93a2b65-a5dd-4568-8ad9-5b5942e36898 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:00.313443 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b93a2b65-a5dd-4568-8ad9-5b5942e36898 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:00.314781 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b93a2b65-a5dd-4568-8ad9-5b5942e36898 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:00.315483 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b93a2b65-a5dd-4568-8ad9-5b5942e36898 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:00.316088 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b93a2b65-a5dd-4568-8ad9-5b5942e36898 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:00.422168 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-869a3c48-1d74-4c56-9929-4eb676673d18 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:00.441902 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-869a3c48-1d74-4c56-9929-4eb676673d18 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 200 len: 1525 microversion: 2.1 time: 0.792281 Oct 23 01:35:00.444349 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2698/5303] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:34:59 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 1525 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:00.682042 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b93a2b65-a5dd-4568-8ad9-5b5942e36898 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:00.696623 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b93a2b65-a5dd-4568-8ad9-5b5942e36898 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab" status: 200 len: 1513 microversion: 2.1 time: 0.413318 Oct 23 01:35:00.702152 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2606/5304] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:00 2022] GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab => generated 1513 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:35:01.482091 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d624f62c-4ff8-49b0-b294-35dde2bb5c48 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:01.483407 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d624f62c-4ff8-49b0-b294-35dde2bb5c48 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:01.504035 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d624f62c-4ff8-49b0-b294-35dde2bb5c48 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:01.504035 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d624f62c-4ff8-49b0-b294-35dde2bb5c48 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:01.504035 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d624f62c-4ff8-49b0-b294-35dde2bb5c48 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:01.504035 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d624f62c-4ff8-49b0-b294-35dde2bb5c48 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:01.504035 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d624f62c-4ff8-49b0-b294-35dde2bb5c48 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:01.510733 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d624f62c-4ff8-49b0-b294-35dde2bb5c48 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:01.721909 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ecee7a0b-d7cc-4409-8dfb-eacd8d3ff64b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:01.722650 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ecee7a0b-d7cc-4409-8dfb-eacd8d3ff64b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 740c5d14-9669-45e2-9ba9-723926f774ab] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:01.739636 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ecee7a0b-d7cc-4409-8dfb-eacd8d3ff64b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:01.740229 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ecee7a0b-d7cc-4409-8dfb-eacd8d3ff64b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:01.740865 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ecee7a0b-d7cc-4409-8dfb-eacd8d3ff64b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:01.742288 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ecee7a0b-d7cc-4409-8dfb-eacd8d3ff64b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:01.743140 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ecee7a0b-d7cc-4409-8dfb-eacd8d3ff64b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:01.744239 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ecee7a0b-d7cc-4409-8dfb-eacd8d3ff64b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:01.810165 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d624f62c-4ff8-49b0-b294-35dde2bb5c48 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:01.822488 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d624f62c-4ff8-49b0-b294-35dde2bb5c48 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 200 len: 1525 microversion: 2.1 time: 0.351032 Oct 23 01:35:01.840722 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2699/5305] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:01 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 1525 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:02.189153 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ecee7a0b-d7cc-4409-8dfb-eacd8d3ff64b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:02.199762 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ecee7a0b-d7cc-4409-8dfb-eacd8d3ff64b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab" status: 200 len: 1513 microversion: 2.1 time: 0.482821 Oct 23 01:35:02.207858 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2607/5306] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:01 2022] GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab => generated 1513 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:02.851716 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-abc08056-ed79-4775-990f-cbfba8c80441 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:02.852323 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-abc08056-ed79-4775-990f-cbfba8c80441 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:02.875346 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-abc08056-ed79-4775-990f-cbfba8c80441 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:02.875838 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-abc08056-ed79-4775-990f-cbfba8c80441 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:02.876278 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-abc08056-ed79-4775-990f-cbfba8c80441 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:02.891851 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-abc08056-ed79-4775-990f-cbfba8c80441 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:02.892425 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-abc08056-ed79-4775-990f-cbfba8c80441 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:02.892883 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-abc08056-ed79-4775-990f-cbfba8c80441 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:03.230684 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a4fd0b09-5b2a-48af-af94-aad5deabe3be tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:03.232006 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a4fd0b09-5b2a-48af-af94-aad5deabe3be tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 740c5d14-9669-45e2-9ba9-723926f774ab] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:03.271349 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a4fd0b09-5b2a-48af-af94-aad5deabe3be tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:03.271863 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a4fd0b09-5b2a-48af-af94-aad5deabe3be tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:03.276451 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a4fd0b09-5b2a-48af-af94-aad5deabe3be tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:03.277226 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a4fd0b09-5b2a-48af-af94-aad5deabe3be tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:03.279726 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a4fd0b09-5b2a-48af-af94-aad5deabe3be tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:03.289644 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a4fd0b09-5b2a-48af-af94-aad5deabe3be tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:03.609824 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-abc08056-ed79-4775-990f-cbfba8c80441 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:03.632619 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-abc08056-ed79-4775-990f-cbfba8c80441 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 200 len: 1525 microversion: 2.1 time: 0.781795 Oct 23 01:35:03.634908 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2700/5307] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:02 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 1525 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:03.800591 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a4fd0b09-5b2a-48af-af94-aad5deabe3be tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:03.818957 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a4fd0b09-5b2a-48af-af94-aad5deabe3be tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab" status: 200 len: 1513 microversion: 2.1 time: 0.592821 Oct 23 01:35:03.820819 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2608/5308] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:03 2022] GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab => generated 1513 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:35:04.668618 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d63c4bb5-813f-433d-b110-a4d2e14c1af5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:04.669245 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d63c4bb5-813f-433d-b110-a4d2e14c1af5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:04.692294 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d63c4bb5-813f-433d-b110-a4d2e14c1af5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:04.704569 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d63c4bb5-813f-433d-b110-a4d2e14c1af5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:04.709763 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d63c4bb5-813f-433d-b110-a4d2e14c1af5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:04.710853 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d63c4bb5-813f-433d-b110-a4d2e14c1af5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:04.714034 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d63c4bb5-813f-433d-b110-a4d2e14c1af5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:04.714724 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d63c4bb5-813f-433d-b110-a4d2e14c1af5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:04.844762 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-26320efd-0b23-4a11-bd77-1163a2498042 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:04.845941 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-26320efd-0b23-4a11-bd77-1163a2498042 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 740c5d14-9669-45e2-9ba9-723926f774ab] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:04.875730 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-26320efd-0b23-4a11-bd77-1163a2498042 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:04.876698 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-26320efd-0b23-4a11-bd77-1163a2498042 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:04.877363 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-26320efd-0b23-4a11-bd77-1163a2498042 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:04.880272 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-26320efd-0b23-4a11-bd77-1163a2498042 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:04.881715 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-26320efd-0b23-4a11-bd77-1163a2498042 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:04.884163 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-26320efd-0b23-4a11-bd77-1163a2498042 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:05.537766 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-26320efd-0b23-4a11-bd77-1163a2498042 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:05.551655 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-26320efd-0b23-4a11-bd77-1163a2498042 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab" status: 200 len: 1513 microversion: 2.1 time: 0.711591 Oct 23 01:35:05.558071 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2609/5309] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:04 2022] GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab => generated 1513 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:05.984860 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d63c4bb5-813f-433d-b110-a4d2e14c1af5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:06.005491 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d63c4bb5-813f-433d-b110-a4d2e14c1af5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 200 len: 1525 microversion: 2.1 time: 1.341331 Oct 23 01:35:06.007537 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2701/5310] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:04 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 1525 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:06.581333 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-503cf3d7-3f8e-44c9-873b-d7affb74c5b6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:06.582570 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-503cf3d7-3f8e-44c9-873b-d7affb74c5b6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 740c5d14-9669-45e2-9ba9-723926f774ab] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:06.601309 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-503cf3d7-3f8e-44c9-873b-d7affb74c5b6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:06.606402 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-503cf3d7-3f8e-44c9-873b-d7affb74c5b6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:06.609476 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-503cf3d7-3f8e-44c9-873b-d7affb74c5b6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:06.610484 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-503cf3d7-3f8e-44c9-873b-d7affb74c5b6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:06.611627 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-503cf3d7-3f8e-44c9-873b-d7affb74c5b6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:06.616028 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-503cf3d7-3f8e-44c9-873b-d7affb74c5b6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:07.033234 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-532e4954-b6da-4917-a9fa-a999c6725d11 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:07.034265 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-532e4954-b6da-4917-a9fa-a999c6725d11 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:07.056634 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-532e4954-b6da-4917-a9fa-a999c6725d11 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:07.057148 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-532e4954-b6da-4917-a9fa-a999c6725d11 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:07.061949 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-532e4954-b6da-4917-a9fa-a999c6725d11 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:07.062760 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-532e4954-b6da-4917-a9fa-a999c6725d11 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:07.063262 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-532e4954-b6da-4917-a9fa-a999c6725d11 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:07.073509 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-532e4954-b6da-4917-a9fa-a999c6725d11 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:07.711199 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-503cf3d7-3f8e-44c9-873b-d7affb74c5b6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:07.724876 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-503cf3d7-3f8e-44c9-873b-d7affb74c5b6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab" status: 200 len: 1513 microversion: 2.1 time: 1.145693 Oct 23 01:35:07.725965 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2610/5311] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:06 2022] GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab => generated 1513 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:07.761289 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-532e4954-b6da-4917-a9fa-a999c6725d11 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:07.785061 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-532e4954-b6da-4917-a9fa-a999c6725d11 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 200 len: 1525 microversion: 2.1 time: 0.756341 Oct 23 01:35:07.786303 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2702/5312] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:07 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 1525 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:35:08.750709 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-281ec4f6-dd23-4e82-9230-a6576bc2f17b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:08.753092 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-281ec4f6-dd23-4e82-9230-a6576bc2f17b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 740c5d14-9669-45e2-9ba9-723926f774ab] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:08.763955 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-281ec4f6-dd23-4e82-9230-a6576bc2f17b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:08.764811 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-281ec4f6-dd23-4e82-9230-a6576bc2f17b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:08.765415 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-281ec4f6-dd23-4e82-9230-a6576bc2f17b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:08.767119 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-281ec4f6-dd23-4e82-9230-a6576bc2f17b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:08.768401 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-281ec4f6-dd23-4e82-9230-a6576bc2f17b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:08.769008 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-281ec4f6-dd23-4e82-9230-a6576bc2f17b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:08.818858 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-00c6ca2b-7f7f-42bc-96ca-f09a161e31db tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:08.818858 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-00c6ca2b-7f7f-42bc-96ca-f09a161e31db tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:08.837830 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-00c6ca2b-7f7f-42bc-96ca-f09a161e31db tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:08.838836 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-00c6ca2b-7f7f-42bc-96ca-f09a161e31db tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:08.840263 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-00c6ca2b-7f7f-42bc-96ca-f09a161e31db tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:08.844024 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-00c6ca2b-7f7f-42bc-96ca-f09a161e31db tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:08.844913 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-00c6ca2b-7f7f-42bc-96ca-f09a161e31db tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:08.848230 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-00c6ca2b-7f7f-42bc-96ca-f09a161e31db tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:09.089276 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-281ec4f6-dd23-4e82-9230-a6576bc2f17b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:09.097204 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-281ec4f6-dd23-4e82-9230-a6576bc2f17b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab" status: 200 len: 1513 microversion: 2.1 time: 0.350574 Oct 23 01:35:09.103389 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2611/5313] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:08 2022] GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab => generated 1513 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:09.533211 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-00c6ca2b-7f7f-42bc-96ca-f09a161e31db tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:09.552517 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-00c6ca2b-7f7f-42bc-96ca-f09a161e31db tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 200 len: 1525 microversion: 2.1 time: 0.745066 Oct 23 01:35:09.553776 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2703/5314] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:08 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 1525 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:35:10.125076 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-193ae949-3fb8-42da-ac28-bf015f7451e7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:10.126070 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-193ae949-3fb8-42da-ac28-bf015f7451e7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 740c5d14-9669-45e2-9ba9-723926f774ab] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:10.149332 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-193ae949-3fb8-42da-ac28-bf015f7451e7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:10.159290 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-193ae949-3fb8-42da-ac28-bf015f7451e7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:10.159290 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-193ae949-3fb8-42da-ac28-bf015f7451e7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:10.161021 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-193ae949-3fb8-42da-ac28-bf015f7451e7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:10.162478 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-193ae949-3fb8-42da-ac28-bf015f7451e7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:10.165284 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-193ae949-3fb8-42da-ac28-bf015f7451e7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:10.582683 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6e6e9abc-20f5-4422-82b2-98604f02eb6c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:10.582683 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6e6e9abc-20f5-4422-82b2-98604f02eb6c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:10.610357 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6e6e9abc-20f5-4422-82b2-98604f02eb6c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:10.615650 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6e6e9abc-20f5-4422-82b2-98604f02eb6c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:10.615650 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6e6e9abc-20f5-4422-82b2-98604f02eb6c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:10.615650 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6e6e9abc-20f5-4422-82b2-98604f02eb6c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:10.615650 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6e6e9abc-20f5-4422-82b2-98604f02eb6c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:10.615650 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6e6e9abc-20f5-4422-82b2-98604f02eb6c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:10.725171 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-193ae949-3fb8-42da-ac28-bf015f7451e7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:10.738256 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-193ae949-3fb8-42da-ac28-bf015f7451e7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab" status: 200 len: 1513 microversion: 2.1 time: 0.618685 Oct 23 01:35:10.739293 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2612/5315] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:10 2022] GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab => generated 1513 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:10.945846 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6e6e9abc-20f5-4422-82b2-98604f02eb6c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:10.958080 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6e6e9abc-20f5-4422-82b2-98604f02eb6c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 200 len: 1525 microversion: 2.1 time: 0.383936 Oct 23 01:35:10.959000 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2704/5316] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:10 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 1525 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:11.765269 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1879794b-92bf-4cbf-9af5-8a1f73a620e7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:11.766815 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1879794b-92bf-4cbf-9af5-8a1f73a620e7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 740c5d14-9669-45e2-9ba9-723926f774ab] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:11.778706 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1879794b-92bf-4cbf-9af5-8a1f73a620e7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:11.780938 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1879794b-92bf-4cbf-9af5-8a1f73a620e7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:11.781958 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1879794b-92bf-4cbf-9af5-8a1f73a620e7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:11.786776 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1879794b-92bf-4cbf-9af5-8a1f73a620e7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:11.799755 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1879794b-92bf-4cbf-9af5-8a1f73a620e7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:11.799755 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1879794b-92bf-4cbf-9af5-8a1f73a620e7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:12.091766 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1879794b-92bf-4cbf-9af5-8a1f73a620e7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:12.109817 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1879794b-92bf-4cbf-9af5-8a1f73a620e7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab" status: 200 len: 1513 microversion: 2.1 time: 0.348037 Oct 23 01:35:12.112742 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2705/5317] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:11 2022] GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab => generated 1513 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:12.151208 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d72d2ce3-ac09-49f3-af61-d9c5da1cb4c4 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:12.152706 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d72d2ce3-ac09-49f3-af61-d9c5da1cb4c4 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:12.154869 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c62f58ab-30f2-40f7-a8e2-47a3854aadcf tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1367693380", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "9abcf23c-c41a-484e-bce8-a9b20add4f0c"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:35:12.160792 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d72d2ce3-ac09-49f3-af61-d9c5da1cb4c4 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:12.163158 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d72d2ce3-ac09-49f3-af61-d9c5da1cb4c4 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:12.175060 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d72d2ce3-ac09-49f3-af61-d9c5da1cb4c4 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:12.177757 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d72d2ce3-ac09-49f3-af61-d9c5da1cb4c4 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:12.178589 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d72d2ce3-ac09-49f3-af61-d9c5da1cb4c4 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:12.181238 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d72d2ce3-ac09-49f3-af61-d9c5da1cb4c4 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:12.307924 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-c62f58ab-30f2-40f7-a8e2-47a3854aadcf tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] validate_networks() for [('9abcf23c-c41a-484e-bce8-a9b20add4f0c', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:35:12.859380 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d72d2ce3-ac09-49f3-af61-d9c5da1cb4c4 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:12.873190 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d72d2ce3-ac09-49f3-af61-d9c5da1cb4c4 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 200 len: 1525 microversion: 2.1 time: 0.757306 Oct 23 01:35:12.875375 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2706/5318] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:12 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 1525 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:12.959388 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-92a6e1f4-dbc9-476e-9e71-0e33bc046f8f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "392fabb8-72fc-4a48-9fb8-e52fec506e67"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:35:12.964137 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-92a6e1f4-dbc9-476e-9e71-0e33bc046f8f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 697bf9a9-687f-4d5f-a459-9ff304289577] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:12.977759 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92a6e1f4-dbc9-476e-9e71-0e33bc046f8f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:12.979565 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92a6e1f4-dbc9-476e-9e71-0e33bc046f8f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:12.980190 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92a6e1f4-dbc9-476e-9e71-0e33bc046f8f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:12.981905 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92a6e1f4-dbc9-476e-9e71-0e33bc046f8f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:12.983611 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92a6e1f4-dbc9-476e-9e71-0e33bc046f8f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:12.984246 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92a6e1f4-dbc9-476e-9e71-0e33bc046f8f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:13.195926 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-92a6e1f4-dbc9-476e-9e71-0e33bc046f8f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] HTTP exception thrown: Invalid volume: volume 392fabb8-72fc-4a48-9fb8-e52fec506e67 is already attached to instances: 697bf9a9-687f-4d5f-a459-9ff304289577 Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-92a6e1f4-dbc9-476e-9e71-0e33bc046f8f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Request method failure captured: Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577/os-volume_attachments HTTP/1.1 Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 74 Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJkvYHBhNP-ngrp3-t9b3JEvPymaCLxveQy3RHlcnEhTQOwrgKm_FYFqgl1O3oBP9pMRjY52nNZb_Q0xi9HfDiuiJB7SCfmksRniHRxHyItsbztYyPUcQD1NZfU4JeOPY635AaAApWVr1Jjx20AyHyGm3ekhiRFvnH_BMldZWZd5QMc Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 6edb27d1224244809ecbb55ac953c645 Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-AttachVolumeNegativeTest-742145495 Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6edb27d1224244809ecbb55ac953c645"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6edb27d1224244809ecbb55ac953c645"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6edb27d1224244809ecbb55ac953c645"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6edb27d1224244809ecbb55ac953c645"}]}] Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-AttachVolumeNegativeTest-742145495 Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 6edb27d1224244809ecbb55ac953c645 Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-742145495 Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-AttachVolumeNegativeTest-742145495-project Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 0c65e7ab0b544d9ebdac8bc2129d051a Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-AttachVolumeNegativeTest-742145495-project Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: {"volumeAttachment": {"volumeId": "392fabb8-72fc-4a48-9fb8-e52fec506e67"}} Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: exception: Invalid volume: volume 392fabb8-72fc-4a48-9fb8-e52fec506e67 is already attached to instances: 697bf9a9-687f-4d5f-a459-9ff304289577 Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: action_args: {'server_id': '697bf9a9-687f-4d5f-a459-9ff304289577', 'body': {'volumeAttachment': {'volumeId': '392fabb8-72fc-4a48-9fb8-e52fec506e67'}}} Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 392fabb8-72fc-4a48-9fb8-e52fec506e67 is already attached to instances: 697bf9a9-687f-4d5f-a459-9ff304289577 Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:35:13.197470 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:35:13.203839 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:35:13.203839 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:35:13.203839 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 23 01:35:13.203839 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 23 01:35:13.203839 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 392fabb8-72fc-4a48-9fb8-e52fec506e67 is already attached to instances: 697bf9a9-687f-4d5f-a459-9ff304289577 Oct 23 01:35:13.203839 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:35:13.203839 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:35:13.203839 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:35:13.203839 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:35:13.203839 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:35:13.203839 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:35:13.203839 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:35:13.203839 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:35:13.203839 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 392fabb8-72fc-4a48-9fb8-e52fec506e67 is already attached to instances: 697bf9a9-687f-4d5f-a459-9ff304289577 Oct 23 01:35:13.203839 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:35:13.203839 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-92a6e1f4-dbc9-476e-9e71-0e33bc046f8f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Returning 400 to user: Invalid volume: volume 392fabb8-72fc-4a48-9fb8-e52fec506e67 is already attached to instances: 697bf9a9-687f-4d5f-a459-9ff304289577 {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:35:13.203839 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-92a6e1f4-dbc9-476e-9e71-0e33bc046f8f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "POST /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.252620 Oct 23 01:35:13.219064 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2707/5319] 10.222.0.42 () {60 vars in 1323 bytes} [Sun Oct 23 01:35:12 2022] POST /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577/os-volume_attachments => generated 174 bytes in 273 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:35:13.252813 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b4a0fc65-c7d8-4b78-8446-8eab7d3104e4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:13.253442 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b4a0fc65-c7d8-4b78-8446-8eab7d3104e4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 740c5d14-9669-45e2-9ba9-723926f774ab] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:13.283605 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b4a0fc65-c7d8-4b78-8446-8eab7d3104e4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:13.284115 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b4a0fc65-c7d8-4b78-8446-8eab7d3104e4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:13.286792 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b4a0fc65-c7d8-4b78-8446-8eab7d3104e4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:13.289826 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b4a0fc65-c7d8-4b78-8446-8eab7d3104e4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:13.291949 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b4a0fc65-c7d8-4b78-8446-8eab7d3104e4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:13.293969 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b4a0fc65-c7d8-4b78-8446-8eab7d3104e4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:13.803812 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-c62f58ab-30f2-40f7-a8e2-47a3854aadcf tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:35:13.803812 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-c62f58ab-30f2-40f7-a8e2-47a3854aadcf tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:35:13.803812 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-c62f58ab-30f2-40f7-a8e2-47a3854aadcf tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:35:13.804530 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-c62f58ab-30f2-40f7-a8e2-47a3854aadcf tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:35:13.804801 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-c62f58ab-30f2-40f7-a8e2-47a3854aadcf tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:35:13.832916 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c62f58ab-30f2-40f7-a8e2-47a3854aadcf tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:13.835021 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c62f58ab-30f2-40f7-a8e2-47a3854aadcf tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:13.835487 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c62f58ab-30f2-40f7-a8e2-47a3854aadcf tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:13.840982 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b4a0fc65-c7d8-4b78-8446-8eab7d3104e4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:13.842435 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c62f58ab-30f2-40f7-a8e2-47a3854aadcf tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:13.843044 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c62f58ab-30f2-40f7-a8e2-47a3854aadcf tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:13.844317 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c62f58ab-30f2-40f7-a8e2-47a3854aadcf tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:13.854128 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b4a0fc65-c7d8-4b78-8446-8eab7d3104e4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab" status: 200 len: 1513 microversion: 2.1 time: 0.610667 Oct 23 01:35:13.855113 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2708/5320] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:13 2022] GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab => generated 1513 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:13.862684 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-15fa9fb5-3a47-48fa-a163-8b4dca64ee83 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:13.864001 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-15fa9fb5-3a47-48fa-a163-8b4dca64ee83 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 697bf9a9-687f-4d5f-a459-9ff304289577] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:13.894490 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-c62f58ab-30f2-40f7-a8e2-47a3854aadcf tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Getting quotas for project 566c1cfeb26f4afb83ef844be75073d8. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:35:13.896118 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15fa9fb5-3a47-48fa-a163-8b4dca64ee83 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:13.900932 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15fa9fb5-3a47-48fa-a163-8b4dca64ee83 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:13.902832 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15fa9fb5-3a47-48fa-a163-8b4dca64ee83 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:13.903889 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15fa9fb5-3a47-48fa-a163-8b4dca64ee83 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:13.910103 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-c62f58ab-30f2-40f7-a8e2-47a3854aadcf tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Getting quotas for user bcaf572331dd405995c4c62d2f63b7f3 and project 566c1cfeb26f4afb83ef844be75073d8. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:35:13.911361 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15fa9fb5-3a47-48fa-a163-8b4dca64ee83 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:13.911813 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15fa9fb5-3a47-48fa-a163-8b4dca64ee83 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:13.941482 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c62f58ab-30f2-40f7-a8e2-47a3854aadcf tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:35:13.948150 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c62f58ab-30f2-40f7-a8e2-47a3854aadcf tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] [instance: ed5481ee-bbe1-466f-a04e-53b8333c2f93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:35:14.143660 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c62f58ab-30f2-40f7-a8e2-47a3854aadcf tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.764566 Oct 23 01:35:14.152113 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2613/5321] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:35:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:35:14.169642 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-15fa9fb5-3a47-48fa-a163-8b4dca64ee83 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lazy-loading 'services' on Instance uuid 697bf9a9-687f-4d5f-a459-9ff304289577 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:35:14.170381 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8868556c-6a90-43b2-8119-037e79960268 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:14.172484 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8868556c-6a90-43b2-8119-037e79960268 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:14.209109 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8868556c-6a90-43b2-8119-037e79960268 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:14.210609 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8868556c-6a90-43b2-8119-037e79960268 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:14.226873 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8868556c-6a90-43b2-8119-037e79960268 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:14.229513 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8868556c-6a90-43b2-8119-037e79960268 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:14.229957 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8868556c-6a90-43b2-8119-037e79960268 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:14.238746 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8868556c-6a90-43b2-8119-037e79960268 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:14.619684 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-15fa9fb5-3a47-48fa-a163-8b4dca64ee83 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "DELETE /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577/os-volume_attachments/392fabb8-72fc-4a48-9fb8-e52fec506e67" status: 202 len: 0 microversion: 2.1 time: 0.762717 Oct 23 01:35:14.620490 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2709/5322] 10.222.0.42 () {58 vars in 1416 bytes} [Sun Oct 23 01:35:13 2022] DELETE /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577/os-volume_attachments/392fabb8-72fc-4a48-9fb8-e52fec506e67 => generated 0 bytes in 764 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:35:14.625370 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d6bdd91e-c8e7-42b8-9261-623d9bec15f5 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:14.638300 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d6bdd91e-c8e7-42b8-9261-623d9bec15f5 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] [instance: ed5481ee-bbe1-466f-a04e-53b8333c2f93] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:14.807983 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d6bdd91e-c8e7-42b8-9261-623d9bec15f5 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaf572331dd405995c4c62d2f63b7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566c1cfeb26f4afb83ef844be75073d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:14.817624 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d6bdd91e-c8e7-42b8-9261-623d9bec15f5 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5481ee-bbe1-466f-a04e-53b8333c2f93" status: 200 len: 1225 microversion: 2.1 time: 0.195932 Oct 23 01:35:14.821553 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2710/5323] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:14 2022] GET /compute/v2.1/servers/ed5481ee-bbe1-466f-a04e-53b8333c2f93 => generated 1225 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:14.853042 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0fc8e591-443e-4b7b-b9f6-9212b38c9ee9 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:14.863346 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0fc8e591-443e-4b7b-b9f6-9212b38c9ee9 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 697bf9a9-687f-4d5f-a459-9ff304289577] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:14.896071 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0fc8e591-443e-4b7b-b9f6-9212b38c9ee9 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:14.898833 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0fc8e591-443e-4b7b-b9f6-9212b38c9ee9 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:14.902652 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0fc8e591-443e-4b7b-b9f6-9212b38c9ee9 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:14.913175 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0fc8e591-443e-4b7b-b9f6-9212b38c9ee9 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:14.913175 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0fc8e591-443e-4b7b-b9f6-9212b38c9ee9 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:14.913175 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0fc8e591-443e-4b7b-b9f6-9212b38c9ee9 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:14.931012 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8868556c-6a90-43b2-8119-037e79960268 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:14.943329 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8868556c-6a90-43b2-8119-037e79960268 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 200 len: 1525 microversion: 2.1 time: 0.789690 Oct 23 01:35:14.979581 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2614/5324] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:14 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 1525 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:14.983381 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0fc8e591-443e-4b7b-b9f6-9212b38c9ee9 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.151877 Oct 23 01:35:14.983910 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2711/5325] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:35:14 2022] GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577/os-volume_attachments => generated 197 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:35:14.994043 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-82f93c2a-d712-4e4d-b5af-293a78661627 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:14.994673 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-82f93c2a-d712-4e4d-b5af-293a78661627 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 740c5d14-9669-45e2-9ba9-723926f774ab] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:14.997683 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:15.023815 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-82f93c2a-d712-4e4d-b5af-293a78661627 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:15.024312 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-82f93c2a-d712-4e4d-b5af-293a78661627 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:15.024754 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-82f93c2a-d712-4e4d-b5af-293a78661627 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:15.027583 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-82f93c2a-d712-4e4d-b5af-293a78661627 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:15.028245 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-82f93c2a-d712-4e4d-b5af-293a78661627 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:15.031360 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-82f93c2a-d712-4e4d-b5af-293a78661627 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:15.650774 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-82f93c2a-d712-4e4d-b5af-293a78661627 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:15.667587 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-82f93c2a-d712-4e4d-b5af-293a78661627 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab" status: 200 len: 1513 microversion: 2.1 time: 0.686658 Oct 23 01:35:15.674115 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2615/5326] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:14 2022] GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab => generated 1513 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:15.850599 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-308caf9f-253f-43fb-97df-c2ddb505a7fd tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:15.850599 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-308caf9f-253f-43fb-97df-c2ddb505a7fd tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] [instance: ed5481ee-bbe1-466f-a04e-53b8333c2f93] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:15.976830 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-74d4c4de-98c3-43e6-9af7-c696e5c142ca tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:15.976830 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-74d4c4de-98c3-43e6-9af7-c696e5c142ca tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:15.996483 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-74d4c4de-98c3-43e6-9af7-c696e5c142ca tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:16.007778 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-74d4c4de-98c3-43e6-9af7-c696e5c142ca tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:16.007778 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-74d4c4de-98c3-43e6-9af7-c696e5c142ca tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:16.007778 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-74d4c4de-98c3-43e6-9af7-c696e5c142ca tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:16.007778 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-74d4c4de-98c3-43e6-9af7-c696e5c142ca tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:16.018987 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-308caf9f-253f-43fb-97df-c2ddb505a7fd tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaf572331dd405995c4c62d2f63b7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566c1cfeb26f4afb83ef844be75073d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:16.029512 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-74d4c4de-98c3-43e6-9af7-c696e5c142ca tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:16.035724 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-308caf9f-253f-43fb-97df-c2ddb505a7fd tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5481ee-bbe1-466f-a04e-53b8333c2f93" status: 200 len: 1225 microversion: 2.1 time: 0.191487 Oct 23 01:35:16.036674 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2712/5327] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:15 2022] GET /compute/v2.1/servers/ed5481ee-bbe1-466f-a04e-53b8333c2f93 => generated 1225 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:16.068198 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-90eb1bfd-9c2e-498d-8cda-f7668423e71d tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:16.074451 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-90eb1bfd-9c2e-498d-8cda-f7668423e71d tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 697bf9a9-687f-4d5f-a459-9ff304289577] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:16.109597 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-90eb1bfd-9c2e-498d-8cda-f7668423e71d tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:16.110136 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-90eb1bfd-9c2e-498d-8cda-f7668423e71d tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:16.116247 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-90eb1bfd-9c2e-498d-8cda-f7668423e71d tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:16.117185 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-90eb1bfd-9c2e-498d-8cda-f7668423e71d tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:16.117688 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-90eb1bfd-9c2e-498d-8cda-f7668423e71d tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:16.123350 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-90eb1bfd-9c2e-498d-8cda-f7668423e71d tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:16.227460 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-90eb1bfd-9c2e-498d-8cda-f7668423e71d tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.179866 Oct 23 01:35:16.228672 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2713/5328] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:35:16 2022] GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577/os-volume_attachments => generated 197 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:35:16.697894 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-88f5ec59-7ab2-4a7a-bd62-92f5fd4f6a2b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:16.699593 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-88f5ec59-7ab2-4a7a-bd62-92f5fd4f6a2b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 740c5d14-9669-45e2-9ba9-723926f774ab] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:16.729365 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-88f5ec59-7ab2-4a7a-bd62-92f5fd4f6a2b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:16.733699 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-88f5ec59-7ab2-4a7a-bd62-92f5fd4f6a2b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:16.736235 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-88f5ec59-7ab2-4a7a-bd62-92f5fd4f6a2b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:16.746160 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-88f5ec59-7ab2-4a7a-bd62-92f5fd4f6a2b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:16.747020 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-88f5ec59-7ab2-4a7a-bd62-92f5fd4f6a2b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:16.747721 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-88f5ec59-7ab2-4a7a-bd62-92f5fd4f6a2b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:18.189495 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-74d4c4de-98c3-43e6-9af7-c696e5c142ca tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:18.213020 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-74d4c4de-98c3-43e6-9af7-c696e5c142ca tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 200 len: 1525 microversion: 2.1 time: 2.239186 Oct 23 01:35:18.213853 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2616/5329] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:15 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 1525 bytes in 2244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:35:18.225917 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fd1d2866-6e58-4fb0-ba3f-53fb90d99652 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:18.235020 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-fd1d2866-6e58-4fb0-ba3f-53fb90d99652 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] [instance: ed5481ee-bbe1-466f-a04e-53b8333c2f93] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:18.257738 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fd1d2866-6e58-4fb0-ba3f-53fb90d99652 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:18.263056 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fd1d2866-6e58-4fb0-ba3f-53fb90d99652 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:18.263787 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fd1d2866-6e58-4fb0-ba3f-53fb90d99652 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:18.266902 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fd1d2866-6e58-4fb0-ba3f-53fb90d99652 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:18.267617 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fd1d2866-6e58-4fb0-ba3f-53fb90d99652 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:18.268289 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fd1d2866-6e58-4fb0-ba3f-53fb90d99652 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:18.299620 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-88f5ec59-7ab2-4a7a-bd62-92f5fd4f6a2b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:18.315681 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-88f5ec59-7ab2-4a7a-bd62-92f5fd4f6a2b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab" status: 200 len: 1490 microversion: 2.1 time: 1.625420 Oct 23 01:35:18.325879 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2714/5330] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:16 2022] GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab => generated 1490 bytes in 1631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:18.355194 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b5c5db6e-acf8-4f29-bfb4-8eed3cf67ee5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:18.368159 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b5c5db6e-acf8-4f29-bfb4-8eed3cf67ee5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 697bf9a9-687f-4d5f-a459-9ff304289577] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:18.381217 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5c5db6e-acf8-4f29-bfb4-8eed3cf67ee5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:18.381727 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5c5db6e-acf8-4f29-bfb4-8eed3cf67ee5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:18.382241 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5c5db6e-acf8-4f29-bfb4-8eed3cf67ee5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:18.382957 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5c5db6e-acf8-4f29-bfb4-8eed3cf67ee5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:18.404303 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5c5db6e-acf8-4f29-bfb4-8eed3cf67ee5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:18.404991 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5c5db6e-acf8-4f29-bfb4-8eed3cf67ee5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:18.499042 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:18.509080 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b5c5db6e-acf8-4f29-bfb4-8eed3cf67ee5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.186959 Oct 23 01:35:18.511829 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2715/5331] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:35:18 2022] GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577/os-volume_attachments => generated 197 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:35:18.523577 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-55962d15-c8ae-4ca9-b0c6-4ec1bc83d703 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:35:18.527002 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-55962d15-c8ae-4ca9-b0c6-4ec1bc83d703 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:18.540627 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55962d15-c8ae-4ca9-b0c6-4ec1bc83d703 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:18.541452 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55962d15-c8ae-4ca9-b0c6-4ec1bc83d703 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:18.542185 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55962d15-c8ae-4ca9-b0c6-4ec1bc83d703 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:18.543377 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55962d15-c8ae-4ca9-b0c6-4ec1bc83d703 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:18.548914 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55962d15-c8ae-4ca9-b0c6-4ec1bc83d703 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:18.554347 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55962d15-c8ae-4ca9-b0c6-4ec1bc83d703 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:18.644064 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-fd1d2866-6e58-4fb0-ba3f-53fb90d99652 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaf572331dd405995c4c62d2f63b7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566c1cfeb26f4afb83ef844be75073d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:18.652479 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fd1d2866-6e58-4fb0-ba3f-53fb90d99652 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5481ee-bbe1-466f-a04e-53b8333c2f93" status: 200 len: 1285 microversion: 2.1 time: 0.436843 Oct 23 01:35:18.659814 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2617/5332] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:18 2022] GET /compute/v2.1/servers/ed5481ee-bbe1-466f-a04e-53b8333c2f93 => generated 1285 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:18.697420 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-55962d15-c8ae-4ca9-b0c6-4ec1bc83d703 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "POST /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98/action" status: 200 len: 156 microversion: 2.1 time: 0.183498 Oct 23 01:35:18.698121 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2716/5333] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:35:18 2022] POST /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98/action => generated 156 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:35:18.715077 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4dcea6cf-e71c-4705-bc39-abe6cf136173 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:18.715077 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4dcea6cf-e71c-4705-bc39-abe6cf136173 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:18.759651 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4dcea6cf-e71c-4705-bc39-abe6cf136173 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:18.760147 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4dcea6cf-e71c-4705-bc39-abe6cf136173 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:18.774323 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4dcea6cf-e71c-4705-bc39-abe6cf136173 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:18.783896 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4dcea6cf-e71c-4705-bc39-abe6cf136173 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:18.786211 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4dcea6cf-e71c-4705-bc39-abe6cf136173 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:18.786865 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4dcea6cf-e71c-4705-bc39-abe6cf136173 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:19.163473 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4dcea6cf-e71c-4705-bc39-abe6cf136173 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:19.172475 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4dcea6cf-e71c-4705-bc39-abe6cf136173 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1669 microversion: 2.1 time: 0.468691 Oct 23 01:35:19.184074 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2618/5334] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:18 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1669 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:19.227365 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6189f1ee-c682-47a1-bb09-3082ebfbd588 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:19.228405 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6189f1ee-c682-47a1-bb09-3082ebfbd588 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:19.241332 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3b911122-39b5-4bb8-9d27-3b715f1b3fca tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:19.242640 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3b911122-39b5-4bb8-9d27-3b715f1b3fca tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:19.262083 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6189f1ee-c682-47a1-bb09-3082ebfbd588 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:19.262892 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6189f1ee-c682-47a1-bb09-3082ebfbd588 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:19.263501 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6189f1ee-c682-47a1-bb09-3082ebfbd588 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:19.264161 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b911122-39b5-4bb8-9d27-3b715f1b3fca tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:19.264693 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6189f1ee-c682-47a1-bb09-3082ebfbd588 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:19.265186 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b911122-39b5-4bb8-9d27-3b715f1b3fca tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:19.265827 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6189f1ee-c682-47a1-bb09-3082ebfbd588 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:19.266809 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b911122-39b5-4bb8-9d27-3b715f1b3fca tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:19.268340 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6189f1ee-c682-47a1-bb09-3082ebfbd588 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:19.270149 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b911122-39b5-4bb8-9d27-3b715f1b3fca tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:19.270757 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b911122-39b5-4bb8-9d27-3b715f1b3fca tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:19.275404 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b911122-39b5-4bb8-9d27-3b715f1b3fca tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:19.616667 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6189f1ee-c682-47a1-bb09-3082ebfbd588 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:19.655289 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6189f1ee-c682-47a1-bb09-3082ebfbd588 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1669 microversion: 2.1 time: 0.428021 Oct 23 01:35:19.659534 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2717/5335] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:19 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1669 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:19.680307 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c587257c-43e9-45e7-9ea7-520542c791b3 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:19.693560 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c587257c-43e9-45e7-9ea7-520542c791b3 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 697bf9a9-687f-4d5f-a459-9ff304289577] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:19.696077 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3b911122-39b5-4bb8-9d27-3b715f1b3fca tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:19.712003 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3b911122-39b5-4bb8-9d27-3b715f1b3fca tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 200 len: 1525 microversion: 2.1 time: 0.472337 Oct 23 01:35:19.713308 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2619/5336] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:19 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 1525 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:19.716600 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c587257c-43e9-45e7-9ea7-520542c791b3 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:19.717833 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c587257c-43e9-45e7-9ea7-520542c791b3 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:19.720340 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c587257c-43e9-45e7-9ea7-520542c791b3 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:19.724054 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c587257c-43e9-45e7-9ea7-520542c791b3 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:19.724874 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c587257c-43e9-45e7-9ea7-520542c791b3 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:19.725862 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4bf12967-cd57-4f8a-a851-ff1bf4ddd349 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:19.726570 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4bf12967-cd57-4f8a-a851-ff1bf4ddd349 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] [instance: ed5481ee-bbe1-466f-a04e-53b8333c2f93] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:19.727916 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c587257c-43e9-45e7-9ea7-520542c791b3 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:19.751071 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4bf12967-cd57-4f8a-a851-ff1bf4ddd349 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:19.751971 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4bf12967-cd57-4f8a-a851-ff1bf4ddd349 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:19.753435 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4bf12967-cd57-4f8a-a851-ff1bf4ddd349 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:19.757215 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4bf12967-cd57-4f8a-a851-ff1bf4ddd349 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:19.758369 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4bf12967-cd57-4f8a-a851-ff1bf4ddd349 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:19.759731 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4bf12967-cd57-4f8a-a851-ff1bf4ddd349 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:19.824220 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=100 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:19.833136 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c587257c-43e9-45e7-9ea7-520542c791b3 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.168129 Oct 23 01:35:19.833796 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2718/5337] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:35:19 2022] GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577/os-volume_attachments => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:35:19.848616 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6eb7d869-be72-441a-a44f-bea15a78b41f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:19.850829 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6eb7d869-be72-441a-a44f-bea15a78b41f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:19.860816 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=61 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:19.881181 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6eb7d869-be72-441a-a44f-bea15a78b41f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:19.882029 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6eb7d869-be72-441a-a44f-bea15a78b41f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:19.883501 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6eb7d869-be72-441a-a44f-bea15a78b41f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:19.885221 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6eb7d869-be72-441a-a44f-bea15a78b41f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:19.888559 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6eb7d869-be72-441a-a44f-bea15a78b41f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:19.891122 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6eb7d869-be72-441a-a44f-bea15a78b41f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:19.909477 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4bf12967-cd57-4f8a-a851-ff1bf4ddd349 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaf572331dd405995c4c62d2f63b7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566c1cfeb26f4afb83ef844be75073d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:19.917418 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4bf12967-cd57-4f8a-a851-ff1bf4ddd349 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5481ee-bbe1-466f-a04e-53b8333c2f93" status: 200 len: 1283 microversion: 2.1 time: 0.201507 Oct 23 01:35:19.918556 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2620/5338] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:19 2022] GET /compute/v2.1/servers/ed5481ee-bbe1-466f-a04e-53b8333c2f93 => generated 1283 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:20.220524 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6eb7d869-be72-441a-a44f-bea15a78b41f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:20.229022 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6eb7d869-be72-441a-a44f-bea15a78b41f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1669 microversion: 2.1 time: 0.394163 Oct 23 01:35:20.229620 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2719/5339] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:19 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1669 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:20.254851 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-244bbbbd-12b0-4fb5-8e46-aa09cff48409 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:20.255585 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-244bbbbd-12b0-4fb5-8e46-aa09cff48409 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:20.274233 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-244bbbbd-12b0-4fb5-8e46-aa09cff48409 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:20.276882 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-244bbbbd-12b0-4fb5-8e46-aa09cff48409 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:20.279602 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-244bbbbd-12b0-4fb5-8e46-aa09cff48409 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:20.284781 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-244bbbbd-12b0-4fb5-8e46-aa09cff48409 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:20.290563 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-244bbbbd-12b0-4fb5-8e46-aa09cff48409 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:20.290563 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-244bbbbd-12b0-4fb5-8e46-aa09cff48409 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:20.700649 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-244bbbbd-12b0-4fb5-8e46-aa09cff48409 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:20.712663 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-244bbbbd-12b0-4fb5-8e46-aa09cff48409 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1669 microversion: 2.1 time: 0.463393 Oct 23 01:35:20.732448 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2621/5340] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:20 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1669 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:20.752773 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d63f3646-656b-49cd-9ee2-d81425e8a132 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:20.753320 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d63f3646-656b-49cd-9ee2-d81425e8a132 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:20.780089 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d63f3646-656b-49cd-9ee2-d81425e8a132 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:20.783862 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d63f3646-656b-49cd-9ee2-d81425e8a132 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:20.787059 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d63f3646-656b-49cd-9ee2-d81425e8a132 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:20.795045 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d63f3646-656b-49cd-9ee2-d81425e8a132 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:20.795889 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d63f3646-656b-49cd-9ee2-d81425e8a132 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:20.796691 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d63f3646-656b-49cd-9ee2-d81425e8a132 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:20.847601 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b36097a4-1338-4077-b432-97f213893fc7 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:20.850005 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b36097a4-1338-4077-b432-97f213893fc7 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 697bf9a9-687f-4d5f-a459-9ff304289577] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:20.885405 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b36097a4-1338-4077-b432-97f213893fc7 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:20.885924 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b36097a4-1338-4077-b432-97f213893fc7 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:20.886406 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b36097a4-1338-4077-b432-97f213893fc7 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:20.893813 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b36097a4-1338-4077-b432-97f213893fc7 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:20.894512 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b36097a4-1338-4077-b432-97f213893fc7 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:20.894793 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b36097a4-1338-4077-b432-97f213893fc7 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:21.041399 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b36097a4-1338-4077-b432-97f213893fc7 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.199526 Oct 23 01:35:21.042346 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2622/5341] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:35:20 2022] GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577/os-volume_attachments => generated 197 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:35:21.048800 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9701a845-34c7-46eb-b29b-67b2acb87eaa tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-554392159", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "bd4b7167-61cf-4f14-9c60-72538a1ed815"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:35:21.119068 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-9701a845-34c7-46eb-b29b-67b2acb87eaa tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] validate_networks() for [('bd4b7167-61cf-4f14-9c60-72538a1ed815', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:35:21.658367 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d63f3646-656b-49cd-9ee2-d81425e8a132 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:21.671653 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d63f3646-656b-49cd-9ee2-d81425e8a132 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 200 len: 1525 microversion: 2.1 time: 0.923590 Oct 23 01:35:21.675052 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2720/5342] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:20 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 1525 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:21.686573 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1c743ee0-3f6c-4867-a690-84a666de3f26 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:21.690744 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1c743ee0-3f6c-4867-a690-84a666de3f26 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] [instance: ed5481ee-bbe1-466f-a04e-53b8333c2f93] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:21.711261 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1c743ee0-3f6c-4867-a690-84a666de3f26 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:21.715055 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1c743ee0-3f6c-4867-a690-84a666de3f26 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:21.715815 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1c743ee0-3f6c-4867-a690-84a666de3f26 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:21.720820 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1c743ee0-3f6c-4867-a690-84a666de3f26 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:21.721680 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1c743ee0-3f6c-4867-a690-84a666de3f26 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:21.722403 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1c743ee0-3f6c-4867-a690-84a666de3f26 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:21.986437 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1c743ee0-3f6c-4867-a690-84a666de3f26 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaf572331dd405995c4c62d2f63b7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566c1cfeb26f4afb83ef844be75073d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:21.997499 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1c743ee0-3f6c-4867-a690-84a666de3f26 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5481ee-bbe1-466f-a04e-53b8333c2f93" status: 200 len: 1283 microversion: 2.1 time: 0.318318 Oct 23 01:35:22.001914 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2721/5343] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:21 2022] GET /compute/v2.1/servers/ed5481ee-bbe1-466f-a04e-53b8333c2f93 => generated 1283 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:22.062816 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-917b76ca-cfed-43f6-9600-49ac4b5dbbf5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:22.066049 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-917b76ca-cfed-43f6-9600-49ac4b5dbbf5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 697bf9a9-687f-4d5f-a459-9ff304289577] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:22.080035 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-917b76ca-cfed-43f6-9600-49ac4b5dbbf5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:22.081805 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-917b76ca-cfed-43f6-9600-49ac4b5dbbf5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:22.082953 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-917b76ca-cfed-43f6-9600-49ac4b5dbbf5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:22.089157 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-917b76ca-cfed-43f6-9600-49ac4b5dbbf5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:22.089799 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-917b76ca-cfed-43f6-9600-49ac4b5dbbf5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:22.090324 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-917b76ca-cfed-43f6-9600-49ac4b5dbbf5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:22.206848 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-917b76ca-cfed-43f6-9600-49ac4b5dbbf5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.156159 Oct 23 01:35:22.212169 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2722/5344] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:35:22 2022] GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577/os-volume_attachments => generated 197 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:35:22.551289 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-9701a845-34c7-46eb-b29b-67b2acb87eaa tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:35:22.552293 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-9701a845-34c7-46eb-b29b-67b2acb87eaa tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:35:22.553003 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-9701a845-34c7-46eb-b29b-67b2acb87eaa tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:35:22.553623 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-9701a845-34c7-46eb-b29b-67b2acb87eaa tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:35:22.554468 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-9701a845-34c7-46eb-b29b-67b2acb87eaa tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:35:22.572601 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9701a845-34c7-46eb-b29b-67b2acb87eaa tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:22.573490 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9701a845-34c7-46eb-b29b-67b2acb87eaa tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:22.574159 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9701a845-34c7-46eb-b29b-67b2acb87eaa tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:22.581423 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9701a845-34c7-46eb-b29b-67b2acb87eaa tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:22.581423 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9701a845-34c7-46eb-b29b-67b2acb87eaa tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:22.581423 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9701a845-34c7-46eb-b29b-67b2acb87eaa tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:22.620368 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-9701a845-34c7-46eb-b29b-67b2acb87eaa tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Getting quotas for project aa4e3018a6ca477c9a1d7215ad98d9e9. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:35:22.632452 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-9701a845-34c7-46eb-b29b-67b2acb87eaa tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Getting quotas for user bb03047092f64e2abbf78e9db1a06e0a and project aa4e3018a6ca477c9a1d7215ad98d9e9. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:35:22.678810 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9701a845-34c7-46eb-b29b-67b2acb87eaa tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:35:22.686596 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9701a845-34c7-46eb-b29b-67b2acb87eaa tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: b23efb32-6be3-4a79-90c0-fea6c5f2dd65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:35:22.710906 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dfdedf6b-e3bc-4261-8396-998e21054200 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:22.711997 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-dfdedf6b-e3bc-4261-8396-998e21054200 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:22.730774 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dfdedf6b-e3bc-4261-8396-998e21054200 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:22.730774 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dfdedf6b-e3bc-4261-8396-998e21054200 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:22.735292 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dfdedf6b-e3bc-4261-8396-998e21054200 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:22.741680 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dfdedf6b-e3bc-4261-8396-998e21054200 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:22.742644 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dfdedf6b-e3bc-4261-8396-998e21054200 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:22.743616 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dfdedf6b-e3bc-4261-8396-998e21054200 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:22.909354 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9701a845-34c7-46eb-b29b-67b2acb87eaa tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.864933 Oct 23 01:35:22.911959 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2623/5345] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:35:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1869 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:35:22.929877 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-43735fde-4bbf-4550-b615-7784fdd454ba tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:22.930859 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-43735fde-4bbf-4550-b615-7784fdd454ba tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: b23efb32-6be3-4a79-90c0-fea6c5f2dd65] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:23.183849 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-43735fde-4bbf-4550-b615-7784fdd454ba tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:23.196995 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-43735fde-4bbf-4550-b615-7784fdd454ba tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65" status: 200 len: 1214 microversion: 2.1 time: 0.272934 Oct 23 01:35:23.206025 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2624/5346] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:22 2022] GET /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65 => generated 1214 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:35:23.235683 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c5a1aa52-2807-44d7-9b50-f39d6641d7c3 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:23.238091 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c5a1aa52-2807-44d7-9b50-f39d6641d7c3 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] [instance: ed5481ee-bbe1-466f-a04e-53b8333c2f93] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:23.267611 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c5a1aa52-2807-44d7-9b50-f39d6641d7c3 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:23.269493 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c5a1aa52-2807-44d7-9b50-f39d6641d7c3 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:23.273490 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c5a1aa52-2807-44d7-9b50-f39d6641d7c3 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:23.274947 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c5a1aa52-2807-44d7-9b50-f39d6641d7c3 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:23.278902 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c5a1aa52-2807-44d7-9b50-f39d6641d7c3 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:23.285456 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c5a1aa52-2807-44d7-9b50-f39d6641d7c3 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:23.415458 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-dfdedf6b-e3bc-4261-8396-998e21054200 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:23.430397 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-dfdedf6b-e3bc-4261-8396-998e21054200 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 200 len: 1525 microversion: 2.1 time: 0.724087 Oct 23 01:35:23.455121 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2723/5347] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:22 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 1525 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:23.474377 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-36ef225d-bd15-4de9-ac50-7042cddb7201 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:23.474377 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-36ef225d-bd15-4de9-ac50-7042cddb7201 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 697bf9a9-687f-4d5f-a459-9ff304289577] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:23.499711 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36ef225d-bd15-4de9-ac50-7042cddb7201 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:23.501216 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36ef225d-bd15-4de9-ac50-7042cddb7201 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:23.502465 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36ef225d-bd15-4de9-ac50-7042cddb7201 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:23.510317 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36ef225d-bd15-4de9-ac50-7042cddb7201 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:23.511018 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36ef225d-bd15-4de9-ac50-7042cddb7201 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:23.513925 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36ef225d-bd15-4de9-ac50-7042cddb7201 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:23.639023 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-36ef225d-bd15-4de9-ac50-7042cddb7201 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.184828 Oct 23 01:35:23.641954 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2724/5348] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:35:23 2022] GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577/os-volume_attachments => generated 197 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:35:23.705063 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c5a1aa52-2807-44d7-9b50-f39d6641d7c3 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaf572331dd405995c4c62d2f63b7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566c1cfeb26f4afb83ef844be75073d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:23.727336 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c5a1aa52-2807-44d7-9b50-f39d6641d7c3 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5481ee-bbe1-466f-a04e-53b8333c2f93" status: 200 len: 1325 microversion: 2.1 time: 0.518536 Oct 23 01:35:23.742961 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2625/5349] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:23 2022] GET /compute/v2.1/servers/ed5481ee-bbe1-466f-a04e-53b8333c2f93 => generated 1325 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:24.233303 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a6618733-fa9a-432a-94c4-38b3ae8a94a9 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:24.234428 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a6618733-fa9a-432a-94c4-38b3ae8a94a9 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: b23efb32-6be3-4a79-90c0-fea6c5f2dd65] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:24.318273 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a6618733-fa9a-432a-94c4-38b3ae8a94a9 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:24.328306 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a6618733-fa9a-432a-94c4-38b3ae8a94a9 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65" status: 200 len: 1214 microversion: 2.1 time: 0.100264 Oct 23 01:35:24.335552 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2725/5350] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:24 2022] GET /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65 => generated 1214 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:24.464414 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ff90050b-96ea-46c0-992f-5042e6cf91bb tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:24.471007 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ff90050b-96ea-46c0-992f-5042e6cf91bb tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:24.487762 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ff90050b-96ea-46c0-992f-5042e6cf91bb tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:24.499772 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ff90050b-96ea-46c0-992f-5042e6cf91bb tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:24.500244 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ff90050b-96ea-46c0-992f-5042e6cf91bb tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:24.501564 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ff90050b-96ea-46c0-992f-5042e6cf91bb tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:24.506696 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ff90050b-96ea-46c0-992f-5042e6cf91bb tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:24.507150 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ff90050b-96ea-46c0-992f-5042e6cf91bb tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:24.796637 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ff90050b-96ea-46c0-992f-5042e6cf91bb tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:24.820458 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ff90050b-96ea-46c0-992f-5042e6cf91bb tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 200 len: 1525 microversion: 2.1 time: 0.360013 Oct 23 01:35:24.841415 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2626/5351] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:24 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 1525 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:24.863612 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-387f440f-92e3-4c1e-bfb7-e13428e4c87e tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:24.864707 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-387f440f-92e3-4c1e-bfb7-e13428e4c87e tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] [instance: ed5481ee-bbe1-466f-a04e-53b8333c2f93] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:24.876050 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-387f440f-92e3-4c1e-bfb7-e13428e4c87e tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:24.876811 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-387f440f-92e3-4c1e-bfb7-e13428e4c87e tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:24.877441 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-387f440f-92e3-4c1e-bfb7-e13428e4c87e tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:24.878644 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-387f440f-92e3-4c1e-bfb7-e13428e4c87e tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:24.879280 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-387f440f-92e3-4c1e-bfb7-e13428e4c87e tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:24.879954 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-387f440f-92e3-4c1e-bfb7-e13428e4c87e tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:25.158457 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-387f440f-92e3-4c1e-bfb7-e13428e4c87e tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaf572331dd405995c4c62d2f63b7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566c1cfeb26f4afb83ef844be75073d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:25.172245 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-387f440f-92e3-4c1e-bfb7-e13428e4c87e tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5481ee-bbe1-466f-a04e-53b8333c2f93" status: 200 len: 1325 microversion: 2.1 time: 0.322452 Oct 23 01:35:25.196979 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2627/5352] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:24 2022] GET /compute/v2.1/servers/ed5481ee-bbe1-466f-a04e-53b8333c2f93 => generated 1325 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:25.330445 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-751bcdb9-1ddc-4c05-8c98-8ac02327152d tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:25.334730 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-751bcdb9-1ddc-4c05-8c98-8ac02327152d tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 697bf9a9-687f-4d5f-a459-9ff304289577] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:25.359217 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-751bcdb9-1ddc-4c05-8c98-8ac02327152d tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:25.364443 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-dd6622f9-cbad-431a-aa30-20a3e872b734 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:25.365853 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-dd6622f9-cbad-431a-aa30-20a3e872b734 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: b23efb32-6be3-4a79-90c0-fea6c5f2dd65] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:25.370268 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-751bcdb9-1ddc-4c05-8c98-8ac02327152d tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:25.370794 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-751bcdb9-1ddc-4c05-8c98-8ac02327152d tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:25.379211 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-751bcdb9-1ddc-4c05-8c98-8ac02327152d tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:25.380188 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-751bcdb9-1ddc-4c05-8c98-8ac02327152d tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:25.380827 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-751bcdb9-1ddc-4c05-8c98-8ac02327152d tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:25.383897 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dd6622f9-cbad-431a-aa30-20a3e872b734 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:25.392090 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dd6622f9-cbad-431a-aa30-20a3e872b734 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:25.392090 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dd6622f9-cbad-431a-aa30-20a3e872b734 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:25.392090 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dd6622f9-cbad-431a-aa30-20a3e872b734 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:25.392910 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dd6622f9-cbad-431a-aa30-20a3e872b734 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:25.392910 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dd6622f9-cbad-431a-aa30-20a3e872b734 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:25.543634 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-751bcdb9-1ddc-4c05-8c98-8ac02327152d tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.894443 Oct 23 01:35:25.553141 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2726/5353] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:35:24 2022] GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577/os-volume_attachments => generated 197 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:35:25.580072 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-dd6622f9-cbad-431a-aa30-20a3e872b734 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:25.589882 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-dd6622f9-cbad-431a-aa30-20a3e872b734 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65" status: 200 len: 1210 microversion: 2.1 time: 0.232487 Oct 23 01:35:25.596206 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2628/5354] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:25 2022] GET /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65 => generated 1210 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:35:25.854255 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5ab712ce-c3f4-42ae-9397-e64d40fc3088 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:25.855353 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5ab712ce-c3f4-42ae-9397-e64d40fc3088 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:25.871148 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5ab712ce-c3f4-42ae-9397-e64d40fc3088 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:25.871788 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5ab712ce-c3f4-42ae-9397-e64d40fc3088 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:25.873517 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5ab712ce-c3f4-42ae-9397-e64d40fc3088 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:25.874386 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5ab712ce-c3f4-42ae-9397-e64d40fc3088 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:25.877233 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5ab712ce-c3f4-42ae-9397-e64d40fc3088 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:25.877766 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5ab712ce-c3f4-42ae-9397-e64d40fc3088 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:26.154783 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5ab712ce-c3f4-42ae-9397-e64d40fc3088 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:26.171799 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5ab712ce-c3f4-42ae-9397-e64d40fc3088 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 200 len: 1525 microversion: 2.1 time: 0.316885 Oct 23 01:35:26.171799 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2727/5355] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:25 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 1525 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:26.211968 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d3dddb0f-df49-4662-8400-f6e881bf023f tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:26.211968 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d3dddb0f-df49-4662-8400-f6e881bf023f tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] [instance: ed5481ee-bbe1-466f-a04e-53b8333c2f93] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:26.218729 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d3dddb0f-df49-4662-8400-f6e881bf023f tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:26.219531 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d3dddb0f-df49-4662-8400-f6e881bf023f tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:26.220438 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d3dddb0f-df49-4662-8400-f6e881bf023f tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:26.221642 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d3dddb0f-df49-4662-8400-f6e881bf023f tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:26.223034 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d3dddb0f-df49-4662-8400-f6e881bf023f tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:26.223707 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d3dddb0f-df49-4662-8400-f6e881bf023f tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:26.502547 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d3dddb0f-df49-4662-8400-f6e881bf023f tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaf572331dd405995c4c62d2f63b7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566c1cfeb26f4afb83ef844be75073d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:26.535017 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d3dddb0f-df49-4662-8400-f6e881bf023f tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5481ee-bbe1-466f-a04e-53b8333c2f93" status: 200 len: 1325 microversion: 2.1 time: 0.337038 Oct 23 01:35:26.544013 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2629/5356] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:26 2022] GET /compute/v2.1/servers/ed5481ee-bbe1-466f-a04e-53b8333c2f93 => generated 1325 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:26.564917 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ba583915-b46a-422b-8840-99918eb96461 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:26.569002 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ba583915-b46a-422b-8840-99918eb96461 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 697bf9a9-687f-4d5f-a459-9ff304289577] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:26.590489 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba583915-b46a-422b-8840-99918eb96461 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:26.592782 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba583915-b46a-422b-8840-99918eb96461 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:26.597212 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba583915-b46a-422b-8840-99918eb96461 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:26.598641 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba583915-b46a-422b-8840-99918eb96461 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:26.602347 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba583915-b46a-422b-8840-99918eb96461 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:26.607911 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba583915-b46a-422b-8840-99918eb96461 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:26.630241 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-72413a85-47a7-4580-b575-5f93f5004cc7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:26.631786 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-72413a85-47a7-4580-b575-5f93f5004cc7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: b23efb32-6be3-4a79-90c0-fea6c5f2dd65] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:26.655155 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-72413a85-47a7-4580-b575-5f93f5004cc7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:26.657247 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-72413a85-47a7-4580-b575-5f93f5004cc7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:26.657884 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-72413a85-47a7-4580-b575-5f93f5004cc7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:26.658990 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-72413a85-47a7-4580-b575-5f93f5004cc7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:26.659631 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-72413a85-47a7-4580-b575-5f93f5004cc7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:26.660402 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-72413a85-47a7-4580-b575-5f93f5004cc7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:26.758487 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ba583915-b46a-422b-8840-99918eb96461 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.203922 Oct 23 01:35:26.774576 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2728/5357] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:35:26 2022] GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577/os-volume_attachments => generated 25 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:35:26.847008 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-72413a85-47a7-4580-b575-5f93f5004cc7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:26.857738 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-72413a85-47a7-4580-b575-5f93f5004cc7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65" status: 200 len: 1266 microversion: 2.1 time: 0.237424 Oct 23 01:35:26.859420 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-33e9455a-026e-4d7a-b923-2f1825a230a8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:26.860053 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-33e9455a-026e-4d7a-b923-2f1825a230a8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 697bf9a9-687f-4d5f-a459-9ff304289577] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:26.860394 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2630/5358] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:26 2022] GET /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65 => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:26.868660 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-33e9455a-026e-4d7a-b923-2f1825a230a8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:26.874833 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-33e9455a-026e-4d7a-b923-2f1825a230a8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:26.874833 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-33e9455a-026e-4d7a-b923-2f1825a230a8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:26.874833 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-33e9455a-026e-4d7a-b923-2f1825a230a8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:26.874833 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-33e9455a-026e-4d7a-b923-2f1825a230a8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:26.874833 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-33e9455a-026e-4d7a-b923-2f1825a230a8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:26.983836 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-33e9455a-026e-4d7a-b923-2f1825a230a8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 697bf9a9-687f-4d5f-a459-9ff304289577] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:35:27.064119 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cd4c311a-614f-4b4c-9a1d-fe4e9a5d50cf tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:27.064632 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cd4c311a-614f-4b4c-9a1d-fe4e9a5d50cf tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] [instance: bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:27.081470 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cd4c311a-614f-4b4c-9a1d-fe4e9a5d50cf tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:27.082734 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cd4c311a-614f-4b4c-9a1d-fe4e9a5d50cf tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:27.088255 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cd4c311a-614f-4b4c-9a1d-fe4e9a5d50cf tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:27.089197 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cd4c311a-614f-4b4c-9a1d-fe4e9a5d50cf tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:27.089686 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cd4c311a-614f-4b4c-9a1d-fe4e9a5d50cf tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:27.093594 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cd4c311a-614f-4b4c-9a1d-fe4e9a5d50cf tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:27.182782 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cd4c311a-614f-4b4c-9a1d-fe4e9a5d50cf tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] 10.222.0.42 "GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.121121 Oct 23 01:35:27.185234 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2631/5359] 10.222.0.42 () {58 vars in 1293 bytes} [Sun Oct 23 01:35:27 2022] GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12/os-server-password => generated 116 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:35:27.197027 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-80ebc124-2447-4306-8f44-642de1f89865 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:27.198559 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-80ebc124-2447-4306-8f44-642de1f89865 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:27.224322 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-80ebc124-2447-4306-8f44-642de1f89865 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:27.225227 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-80ebc124-2447-4306-8f44-642de1f89865 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:27.230851 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-80ebc124-2447-4306-8f44-642de1f89865 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:27.231752 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-80ebc124-2447-4306-8f44-642de1f89865 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:27.236290 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-80ebc124-2447-4306-8f44-642de1f89865 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:27.236858 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-80ebc124-2447-4306-8f44-642de1f89865 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:27.425565 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-33e9455a-026e-4d7a-b923-2f1825a230a8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "DELETE /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577" status: 204 len: 0 microversion: 2.1 time: 0.570366 Oct 23 01:35:27.426746 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2729/5360] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:35:26 2022] DELETE /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:35:27.443701 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ba85dd25-61be-4ca2-bf78-1a28956c3103 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:27.443701 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ba85dd25-61be-4ca2-bf78-1a28956c3103 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 697bf9a9-687f-4d5f-a459-9ff304289577] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:27.457189 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba85dd25-61be-4ca2-bf78-1a28956c3103 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:27.458220 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba85dd25-61be-4ca2-bf78-1a28956c3103 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:27.459887 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba85dd25-61be-4ca2-bf78-1a28956c3103 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:27.464940 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba85dd25-61be-4ca2-bf78-1a28956c3103 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:27.467095 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba85dd25-61be-4ca2-bf78-1a28956c3103 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:27.468667 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba85dd25-61be-4ca2-bf78-1a28956c3103 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:27.547752 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-80ebc124-2447-4306-8f44-642de1f89865 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:27.559767 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-80ebc124-2447-4306-8f44-642de1f89865 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 200 len: 1525 microversion: 2.1 time: 0.366889 Oct 23 01:35:27.560864 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2632/5361] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:27 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 1525 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:27.580642 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-45ea5475-8626-4e0b-801f-6aab082b247c tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:27.581703 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-45ea5475-8626-4e0b-801f-6aab082b247c tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] [instance: ed5481ee-bbe1-466f-a04e-53b8333c2f93] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:27.591667 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-45ea5475-8626-4e0b-801f-6aab082b247c tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:27.594792 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-45ea5475-8626-4e0b-801f-6aab082b247c tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:27.596258 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-45ea5475-8626-4e0b-801f-6aab082b247c tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:27.599225 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-45ea5475-8626-4e0b-801f-6aab082b247c tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:27.599724 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-45ea5475-8626-4e0b-801f-6aab082b247c tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:27.600166 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-45ea5475-8626-4e0b-801f-6aab082b247c tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:27.839422 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ba85dd25-61be-4ca2-bf78-1a28956c3103 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:27.847735 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ba85dd25-61be-4ca2-bf78-1a28956c3103 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577" status: 200 len: 1681 microversion: 2.1 time: 0.416475 Oct 23 01:35:27.857812 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2730/5362] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:27 2022] GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577 => generated 1681 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:27.869583 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-45ea5475-8626-4e0b-801f-6aab082b247c tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaf572331dd405995c4c62d2f63b7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566c1cfeb26f4afb83ef844be75073d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:27.883555 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-45ea5475-8626-4e0b-801f-6aab082b247c tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5481ee-bbe1-466f-a04e-53b8333c2f93" status: 200 len: 1325 microversion: 2.1 time: 0.317636 Oct 23 01:35:27.888075 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2633/5363] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:27 2022] GET /compute/v2.1/servers/ed5481ee-bbe1-466f-a04e-53b8333c2f93 => generated 1325 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:27.892583 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-70bc627b-1b1d-4d48-b067-65cd823b7c11 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:27.893437 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-70bc627b-1b1d-4d48-b067-65cd823b7c11 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: b23efb32-6be3-4a79-90c0-fea6c5f2dd65] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:27.901737 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-70bc627b-1b1d-4d48-b067-65cd823b7c11 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:27.901737 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-70bc627b-1b1d-4d48-b067-65cd823b7c11 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:27.901737 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-70bc627b-1b1d-4d48-b067-65cd823b7c11 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:27.902129 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-70bc627b-1b1d-4d48-b067-65cd823b7c11 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:27.902280 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-70bc627b-1b1d-4d48-b067-65cd823b7c11 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:27.902709 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-70bc627b-1b1d-4d48-b067-65cd823b7c11 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:27.988517 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-70bc627b-1b1d-4d48-b067-65cd823b7c11 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:27.996388 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-70bc627b-1b1d-4d48-b067-65cd823b7c11 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65" status: 200 len: 1272 microversion: 2.1 time: 0.113901 Oct 23 01:35:28.011685 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2731/5364] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:27 2022] GET /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65 => generated 1272 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:28.568012 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-caa2cd5b-f890-4787-94a7-da6fefb9e6b8 req-723bbf15-1d5e-43d6-bb61-95c6871dc8a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed5481ee-bbe1-466f-a04e-53b8333c2f93", "tag": "5ab7abbd-f102-4872-b907-868b4a72b107"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:35:28.584951 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-561d4fa5-776a-464a-9eca-5be6ca3d39d6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:28.589223 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-561d4fa5-776a-464a-9eca-5be6ca3d39d6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:28.594216 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-caa2cd5b-f890-4787-94a7-da6fefb9e6b8 req-723bbf15-1d5e-43d6-bb61-95c6871dc8a3 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:28.597867 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-caa2cd5b-f890-4787-94a7-da6fefb9e6b8 req-723bbf15-1d5e-43d6-bb61-95c6871dc8a3 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:28.598685 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-caa2cd5b-f890-4787-94a7-da6fefb9e6b8 req-723bbf15-1d5e-43d6-bb61-95c6871dc8a3 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:28.599694 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-561d4fa5-776a-464a-9eca-5be6ca3d39d6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:28.602458 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-561d4fa5-776a-464a-9eca-5be6ca3d39d6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:28.603503 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-561d4fa5-776a-464a-9eca-5be6ca3d39d6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:28.607825 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-561d4fa5-776a-464a-9eca-5be6ca3d39d6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:28.612501 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-561d4fa5-776a-464a-9eca-5be6ca3d39d6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:28.613547 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-561d4fa5-776a-464a-9eca-5be6ca3d39d6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:28.626130 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:28.634665 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-caa2cd5b-f890-4787-94a7-da6fefb9e6b8 req-723bbf15-1d5e-43d6-bb61-95c6871dc8a3 service nova] Creating event network-changed:5ab7abbd-f102-4872-b907-868b4a72b107 for instance ed5481ee-bbe1-466f-a04e-53b8333c2f93 on n-h1-master-1 Oct 23 01:35:28.645760 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-caa2cd5b-f890-4787-94a7-da6fefb9e6b8 req-723bbf15-1d5e-43d6-bb61-95c6871dc8a3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084536 Oct 23 01:35:28.647232 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2634/5365] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:35:28.874542 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ed129c72-3bed-43da-b773-8b3c0f491f66 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:28.875291 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ed129c72-3bed-43da-b773-8b3c0f491f66 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 697bf9a9-687f-4d5f-a459-9ff304289577] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:28.900439 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ed129c72-3bed-43da-b773-8b3c0f491f66 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:28.905700 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ed129c72-3bed-43da-b773-8b3c0f491f66 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:28.906245 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ed129c72-3bed-43da-b773-8b3c0f491f66 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:28.912009 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ed129c72-3bed-43da-b773-8b3c0f491f66 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:28.917162 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ed129c72-3bed-43da-b773-8b3c0f491f66 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:28.917696 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ed129c72-3bed-43da-b773-8b3c0f491f66 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:28.965140 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-561d4fa5-776a-464a-9eca-5be6ca3d39d6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:28.977546 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-561d4fa5-776a-464a-9eca-5be6ca3d39d6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 200 len: 1525 microversion: 2.1 time: 0.394980 Oct 23 01:35:28.980411 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2732/5366] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:28 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 1525 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:29.002942 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-32ec88ae-c121-45f6-84b6-679f5c0d6200 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:29.008802 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-32ec88ae-c121-45f6-84b6-679f5c0d6200 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] [instance: ed5481ee-bbe1-466f-a04e-53b8333c2f93] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:29.021855 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-32ec88ae-c121-45f6-84b6-679f5c0d6200 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:29.023847 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-32ec88ae-c121-45f6-84b6-679f5c0d6200 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:29.024389 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-32ec88ae-c121-45f6-84b6-679f5c0d6200 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:29.026168 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-32ec88ae-c121-45f6-84b6-679f5c0d6200 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:29.030734 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-32ec88ae-c121-45f6-84b6-679f5c0d6200 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:29.031638 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-32ec88ae-c121-45f6-84b6-679f5c0d6200 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:29.252778 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ed129c72-3bed-43da-b773-8b3c0f491f66 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:29.267735 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ed129c72-3bed-43da-b773-8b3c0f491f66 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577" status: 200 len: 1681 microversion: 2.1 time: 0.398627 Oct 23 01:35:29.282018 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2635/5367] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:28 2022] GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577 => generated 1681 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:29.284284 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c2056b0f-af07-45d3-a3a1-3b380291ca03 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:29.286227 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c2056b0f-af07-45d3-a3a1-3b380291ca03 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: b23efb32-6be3-4a79-90c0-fea6c5f2dd65] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:29.294346 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c2056b0f-af07-45d3-a3a1-3b380291ca03 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:29.301796 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-32ec88ae-c121-45f6-84b6-679f5c0d6200 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaf572331dd405995c4c62d2f63b7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566c1cfeb26f4afb83ef844be75073d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:29.302001 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c2056b0f-af07-45d3-a3a1-3b380291ca03 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:29.302001 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c2056b0f-af07-45d3-a3a1-3b380291ca03 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:29.302001 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c2056b0f-af07-45d3-a3a1-3b380291ca03 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:29.302001 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c2056b0f-af07-45d3-a3a1-3b380291ca03 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:29.302001 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c2056b0f-af07-45d3-a3a1-3b380291ca03 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:29.308959 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-32ec88ae-c121-45f6-84b6-679f5c0d6200 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5481ee-bbe1-466f-a04e-53b8333c2f93" status: 200 len: 1325 microversion: 2.1 time: 0.316448 Oct 23 01:35:29.309624 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2733/5368] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:28 2022] GET /compute/v2.1/servers/ed5481ee-bbe1-466f-a04e-53b8333c2f93 => generated 1325 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:29.511993 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c2056b0f-af07-45d3-a3a1-3b380291ca03 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:29.526611 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c2056b0f-af07-45d3-a3a1-3b380291ca03 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65" status: 200 len: 1272 microversion: 2.1 time: 0.252270 Oct 23 01:35:29.528649 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2636/5369] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:29 2022] GET /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65 => generated 1272 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:30.005338 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-846408a4-3577-40d0-8ae7-518457bbf77b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:30.006095 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-846408a4-3577-40d0-8ae7-518457bbf77b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:30.028794 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-846408a4-3577-40d0-8ae7-518457bbf77b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:30.029723 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-846408a4-3577-40d0-8ae7-518457bbf77b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:30.032670 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-846408a4-3577-40d0-8ae7-518457bbf77b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:30.042326 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-846408a4-3577-40d0-8ae7-518457bbf77b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:30.043184 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-846408a4-3577-40d0-8ae7-518457bbf77b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:30.044193 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-846408a4-3577-40d0-8ae7-518457bbf77b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:30.299328 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0bf71b73-72da-4268-9696-4a7b9d17d7ab tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:30.300622 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0bf71b73-72da-4268-9696-4a7b9d17d7ab tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 697bf9a9-687f-4d5f-a459-9ff304289577] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:30.315571 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0bf71b73-72da-4268-9696-4a7b9d17d7ab tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:30.324965 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0bf71b73-72da-4268-9696-4a7b9d17d7ab tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:30.325515 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0bf71b73-72da-4268-9696-4a7b9d17d7ab tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:30.326375 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0bf71b73-72da-4268-9696-4a7b9d17d7ab tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:30.328213 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0bf71b73-72da-4268-9696-4a7b9d17d7ab tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:30.329671 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0bf71b73-72da-4268-9696-4a7b9d17d7ab tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:30.500514 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-846408a4-3577-40d0-8ae7-518457bbf77b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:30.511335 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-846408a4-3577-40d0-8ae7-518457bbf77b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 200 len: 1507 microversion: 2.1 time: 0.509927 Oct 23 01:35:30.515913 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2734/5370] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:29 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 1507 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:30.534104 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9fa08be6-334b-4b58-aa31-faa1e72726d0 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:30.536117 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9fa08be6-334b-4b58-aa31-faa1e72726d0 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] [instance: ed5481ee-bbe1-466f-a04e-53b8333c2f93] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:30.550487 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9fa08be6-334b-4b58-aa31-faa1e72726d0 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:30.551294 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9fa08be6-334b-4b58-aa31-faa1e72726d0 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:30.551995 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9fa08be6-334b-4b58-aa31-faa1e72726d0 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:30.553140 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9fa08be6-334b-4b58-aa31-faa1e72726d0 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:30.553838 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9fa08be6-334b-4b58-aa31-faa1e72726d0 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:30.554546 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9fa08be6-334b-4b58-aa31-faa1e72726d0 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:30.828369 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0bf71b73-72da-4268-9696-4a7b9d17d7ab tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:30.842857 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0bf71b73-72da-4268-9696-4a7b9d17d7ab tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577" status: 200 len: 1681 microversion: 2.1 time: 0.550034 Oct 23 01:35:30.843986 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2637/5371] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:30 2022] GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577 => generated 1681 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:30.850237 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3dabbcb9-6e5e-42e1-b0e0-20ab65ba9401 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:30.857900 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3dabbcb9-6e5e-42e1-b0e0-20ab65ba9401 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: b23efb32-6be3-4a79-90c0-fea6c5f2dd65] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:30.867178 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3dabbcb9-6e5e-42e1-b0e0-20ab65ba9401 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:30.868055 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3dabbcb9-6e5e-42e1-b0e0-20ab65ba9401 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:30.869116 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3dabbcb9-6e5e-42e1-b0e0-20ab65ba9401 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:30.870443 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3dabbcb9-6e5e-42e1-b0e0-20ab65ba9401 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:30.871106 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3dabbcb9-6e5e-42e1-b0e0-20ab65ba9401 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:30.871739 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3dabbcb9-6e5e-42e1-b0e0-20ab65ba9401 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:30.873796 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9fa08be6-334b-4b58-aa31-faa1e72726d0 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaf572331dd405995c4c62d2f63b7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566c1cfeb26f4afb83ef844be75073d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:30.883866 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9fa08be6-334b-4b58-aa31-faa1e72726d0 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5481ee-bbe1-466f-a04e-53b8333c2f93" status: 200 len: 1325 microversion: 2.1 time: 0.366787 Oct 23 01:35:30.890550 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2735/5372] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:30 2022] GET /compute/v2.1/servers/ed5481ee-bbe1-466f-a04e-53b8333c2f93 => generated 1325 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:31.144822 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3dabbcb9-6e5e-42e1-b0e0-20ab65ba9401 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:31.152617 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3dabbcb9-6e5e-42e1-b0e0-20ab65ba9401 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65" status: 200 len: 1314 microversion: 2.1 time: 0.307446 Oct 23 01:35:31.153209 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2638/5373] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:30 2022] GET /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65 => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:31.542808 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bd5c537e-982c-4ad8-8cf0-00ef0511e17f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:31.542808 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bd5c537e-982c-4ad8-8cf0-00ef0511e17f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:31.574249 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bd5c537e-982c-4ad8-8cf0-00ef0511e17f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:31.575589 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bd5c537e-982c-4ad8-8cf0-00ef0511e17f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:31.576405 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bd5c537e-982c-4ad8-8cf0-00ef0511e17f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:31.577345 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bd5c537e-982c-4ad8-8cf0-00ef0511e17f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:31.578481 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bd5c537e-982c-4ad8-8cf0-00ef0511e17f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:31.581325 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bd5c537e-982c-4ad8-8cf0-00ef0511e17f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:31.800249 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-1dd92d8a-ab79-45b3-a5ef-8f0156c60792 req-dcaab8e4-f1eb-4711-bf2f-03bee37ecc7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71362f74-5a83-466a-b7be-de2a87253559", "name": "network-vif-unplugged", "status": "completed", "tag": "f30f4cf4-1b9d-4bf3-af09-74938e70131b"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:35:31.823647 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-1dd92d8a-ab79-45b3-a5ef-8f0156c60792 req-dcaab8e4-f1eb-4711-bf2f-03bee37ecc7b service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:31.825117 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-1dd92d8a-ab79-45b3-a5ef-8f0156c60792 req-dcaab8e4-f1eb-4711-bf2f-03bee37ecc7b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:31.826874 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-1dd92d8a-ab79-45b3-a5ef-8f0156c60792 req-dcaab8e4-f1eb-4711-bf2f-03bee37ecc7b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:31.857783 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-1dd92d8a-ab79-45b3-a5ef-8f0156c60792 req-dcaab8e4-f1eb-4711-bf2f-03bee37ecc7b service nova] Creating event network-vif-unplugged:f30f4cf4-1b9d-4bf3-af09-74938e70131b for instance 71362f74-5a83-466a-b7be-de2a87253559 on n-h2-master-1 Oct 23 01:35:31.873394 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-1dd92d8a-ab79-45b3-a5ef-8f0156c60792 req-dcaab8e4-f1eb-4711-bf2f-03bee37ecc7b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077617 Oct 23 01:35:31.878808 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2639/5374] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:35:31.884842 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-256cdeb6-b646-448f-8c77-9fbda600e93c tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:31.885936 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-256cdeb6-b646-448f-8c77-9fbda600e93c tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 697bf9a9-687f-4d5f-a459-9ff304289577] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:31.893938 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-256cdeb6-b646-448f-8c77-9fbda600e93c tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:31.894891 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-256cdeb6-b646-448f-8c77-9fbda600e93c tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:31.895591 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-256cdeb6-b646-448f-8c77-9fbda600e93c tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:31.896549 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-256cdeb6-b646-448f-8c77-9fbda600e93c tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:31.897425 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-256cdeb6-b646-448f-8c77-9fbda600e93c tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:31.898105 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-256cdeb6-b646-448f-8c77-9fbda600e93c tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:31.918892 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=100 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:32.061456 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-256cdeb6-b646-448f-8c77-9fbda600e93c tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:32.072058 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-256cdeb6-b646-448f-8c77-9fbda600e93c tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577" status: 200 len: 1613 microversion: 2.1 time: 0.191596 Oct 23 01:35:32.074570 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2640/5375] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:31 2022] GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577 => generated 1613 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:32.101069 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-86a92bdd-24f1-4a7e-bf61-7521efbda030 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:32.101816 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-86a92bdd-24f1-4a7e-bf61-7521efbda030 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] [instance: ed5481ee-bbe1-466f-a04e-53b8333c2f93] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:32.114374 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-86a92bdd-24f1-4a7e-bf61-7521efbda030 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:32.120024 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-86a92bdd-24f1-4a7e-bf61-7521efbda030 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:32.121704 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-86a92bdd-24f1-4a7e-bf61-7521efbda030 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:32.122819 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-86a92bdd-24f1-4a7e-bf61-7521efbda030 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:32.125614 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-86a92bdd-24f1-4a7e-bf61-7521efbda030 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:32.132101 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-86a92bdd-24f1-4a7e-bf61-7521efbda030 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:32.498384 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-86a92bdd-24f1-4a7e-bf61-7521efbda030 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaf572331dd405995c4c62d2f63b7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566c1cfeb26f4afb83ef844be75073d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:32.511846 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-86a92bdd-24f1-4a7e-bf61-7521efbda030 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5481ee-bbe1-466f-a04e-53b8333c2f93" status: 200 len: 1325 microversion: 2.1 time: 0.433645 Oct 23 01:35:32.512966 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2641/5376] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:32 2022] GET /compute/v2.1/servers/ed5481ee-bbe1-466f-a04e-53b8333c2f93 => generated 1325 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:32.532784 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5890386a-cf9e-4a19-bfaf-ac42c8d6de52 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:32.533940 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5890386a-cf9e-4a19-bfaf-ac42c8d6de52 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: b23efb32-6be3-4a79-90c0-fea6c5f2dd65] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:32.564351 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5890386a-cf9e-4a19-bfaf-ac42c8d6de52 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:32.564857 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5890386a-cf9e-4a19-bfaf-ac42c8d6de52 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:32.565303 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5890386a-cf9e-4a19-bfaf-ac42c8d6de52 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:32.566451 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5890386a-cf9e-4a19-bfaf-ac42c8d6de52 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:32.566910 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5890386a-cf9e-4a19-bfaf-ac42c8d6de52 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:32.567339 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5890386a-cf9e-4a19-bfaf-ac42c8d6de52 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:32.601168 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=4 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:32.822806 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bd5c537e-982c-4ad8-8cf0-00ef0511e17f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:32.838736 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bd5c537e-982c-4ad8-8cf0-00ef0511e17f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 200 len: 1507 microversion: 2.1 time: 1.301108 Oct 23 01:35:32.844611 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2736/5377] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:31 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 1507 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:32.859638 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-3126aa2a-e79a-4407-8838-6430e19c42ea req-8f85646a-328a-42fa-82f0-088f2fd35c37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "697bf9a9-687f-4d5f-a459-9ff304289577", "name": "network-vif-deleted", "tag": "a3a4e1b5-5224-4f9b-857b-863bfc9c13e0"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:35:32.880174 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-3126aa2a-e79a-4407-8838-6430e19c42ea req-8f85646a-328a-42fa-82f0-088f2fd35c37 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:32.881473 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-3126aa2a-e79a-4407-8838-6430e19c42ea req-8f85646a-328a-42fa-82f0-088f2fd35c37 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:32.882252 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-3126aa2a-e79a-4407-8838-6430e19c42ea req-8f85646a-328a-42fa-82f0-088f2fd35c37 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:32.902279 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-3126aa2a-e79a-4407-8838-6430e19c42ea req-8f85646a-328a-42fa-82f0-088f2fd35c37 service nova] Creating event network-vif-deleted:a3a4e1b5-5224-4f9b-857b-863bfc9c13e0 for instance 697bf9a9-687f-4d5f-a459-9ff304289577 on n-h1-master-1 Oct 23 01:35:32.909598 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-3126aa2a-e79a-4407-8838-6430e19c42ea req-8f85646a-328a-42fa-82f0-088f2fd35c37 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067075 Oct 23 01:35:32.911024 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2737/5378] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:35:32.934388 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5890386a-cf9e-4a19-bfaf-ac42c8d6de52 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:32.951936 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5890386a-cf9e-4a19-bfaf-ac42c8d6de52 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65" status: 200 len: 1314 microversion: 2.1 time: 0.437408 Oct 23 01:35:32.952855 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2642/5379] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:32 2022] GET /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65 => generated 1314 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:33.099529 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-83b3034d-785c-43e8-9858-62b01ff76390 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:33.100261 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-83b3034d-785c-43e8-9858-62b01ff76390 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 697bf9a9-687f-4d5f-a459-9ff304289577] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:33.108747 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-83b3034d-785c-43e8-9858-62b01ff76390 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:33.115396 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-83b3034d-785c-43e8-9858-62b01ff76390 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:33.116246 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-83b3034d-785c-43e8-9858-62b01ff76390 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:33.117235 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-83b3034d-785c-43e8-9858-62b01ff76390 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:33.120514 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-83b3034d-785c-43e8-9858-62b01ff76390 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:33.120973 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-83b3034d-785c-43e8-9858-62b01ff76390 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:33.203430 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-83b3034d-785c-43e8-9858-62b01ff76390 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:33.206671 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-83b3034d-785c-43e8-9858-62b01ff76390 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:33.212523 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-83b3034d-785c-43e8-9858-62b01ff76390 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:33.213320 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-83b3034d-785c-43e8-9858-62b01ff76390 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lazy-loading 'fault' on Instance uuid 697bf9a9-687f-4d5f-a459-9ff304289577 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:35:33.442326 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-83b3034d-785c-43e8-9858-62b01ff76390 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:33.450847 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-83b3034d-785c-43e8-9858-62b01ff76390 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577" status: 200 len: 1329 microversion: 2.1 time: 0.355883 Oct 23 01:35:33.455017 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2738/5380] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:33 2022] GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577 => generated 1329 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:33.537960 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f81abc42-2917-463a-a62b-4b30ba9a2053 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:33.539180 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f81abc42-2917-463a-a62b-4b30ba9a2053 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] [instance: ed5481ee-bbe1-466f-a04e-53b8333c2f93] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:33.541236 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=14 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:33.563003 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f81abc42-2917-463a-a62b-4b30ba9a2053 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:33.564140 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f81abc42-2917-463a-a62b-4b30ba9a2053 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:33.564603 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f81abc42-2917-463a-a62b-4b30ba9a2053 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:33.570444 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f81abc42-2917-463a-a62b-4b30ba9a2053 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:33.572125 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f81abc42-2917-463a-a62b-4b30ba9a2053 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:33.572577 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f81abc42-2917-463a-a62b-4b30ba9a2053 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:33.872436 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-08b9de1f-898c-4866-b410-f7cfc8c6f9eb tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:33.873325 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-08b9de1f-898c-4866-b410-f7cfc8c6f9eb tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:33.886722 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-08b9de1f-898c-4866-b410-f7cfc8c6f9eb tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:33.888160 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-08b9de1f-898c-4866-b410-f7cfc8c6f9eb tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:33.889262 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-08b9de1f-898c-4866-b410-f7cfc8c6f9eb tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:33.893411 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-08b9de1f-898c-4866-b410-f7cfc8c6f9eb tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:33.894644 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-08b9de1f-898c-4866-b410-f7cfc8c6f9eb tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:33.895382 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-08b9de1f-898c-4866-b410-f7cfc8c6f9eb tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:34.254878 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-08b9de1f-898c-4866-b410-f7cfc8c6f9eb tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:34.270509 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-08b9de1f-898c-4866-b410-f7cfc8c6f9eb tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 200 len: 1510 microversion: 2.1 time: 0.402517 Oct 23 01:35:34.299416 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2739/5381] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:33 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 1510 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:34.306823 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e007d564-bc4f-451f-9d6f-b87cebb27489 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:34.314811 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e007d564-bc4f-451f-9d6f-b87cebb27489 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: b23efb32-6be3-4a79-90c0-fea6c5f2dd65] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:34.345434 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=6 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:34.362256 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e007d564-bc4f-451f-9d6f-b87cebb27489 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:34.362256 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e007d564-bc4f-451f-9d6f-b87cebb27489 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:34.362256 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e007d564-bc4f-451f-9d6f-b87cebb27489 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:34.362256 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e007d564-bc4f-451f-9d6f-b87cebb27489 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:34.362256 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e007d564-bc4f-451f-9d6f-b87cebb27489 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:34.362256 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e007d564-bc4f-451f-9d6f-b87cebb27489 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:34.649322 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f81abc42-2917-463a-a62b-4b30ba9a2053 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaf572331dd405995c4c62d2f63b7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566c1cfeb26f4afb83ef844be75073d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:34.665947 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f81abc42-2917-463a-a62b-4b30ba9a2053 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5481ee-bbe1-466f-a04e-53b8333c2f93" status: 200 len: 1325 microversion: 2.1 time: 1.133107 Oct 23 01:35:34.666492 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2643/5382] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:33 2022] GET /compute/v2.1/servers/ed5481ee-bbe1-466f-a04e-53b8333c2f93 => generated 1325 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:34.671407 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2edc40d6-29cc-4e53-a61a-622411bd17c3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:34.672161 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2edc40d6-29cc-4e53-a61a-622411bd17c3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:34.681310 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2edc40d6-29cc-4e53-a61a-622411bd17c3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:34.685287 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2edc40d6-29cc-4e53-a61a-622411bd17c3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:34.689014 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2edc40d6-29cc-4e53-a61a-622411bd17c3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:34.690159 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2edc40d6-29cc-4e53-a61a-622411bd17c3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:34.690815 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2edc40d6-29cc-4e53-a61a-622411bd17c3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:34.691415 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2edc40d6-29cc-4e53-a61a-622411bd17c3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:34.744292 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e007d564-bc4f-451f-9d6f-b87cebb27489 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:34.758555 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e007d564-bc4f-451f-9d6f-b87cebb27489 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65" status: 200 len: 1314 microversion: 2.1 time: 0.461854 Oct 23 01:35:34.782142 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2740/5383] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:34 2022] GET /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65 => generated 1314 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:34.782142 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3bfc49da-c93d-4afb-8f88-42a4b7ac50b7 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:34.782142 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3bfc49da-c93d-4afb-8f88-42a4b7ac50b7 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 697bf9a9-687f-4d5f-a459-9ff304289577] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:34.787625 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2edc40d6-29cc-4e53-a61a-622411bd17c3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:35:34.800014 n-d-master-1 devstack@n-api.service[120945]: INFO nova.compute.api [None req-2edc40d6-29cc-4e53-a61a-622411bd17c3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Working on deleting snapshot 0d4bae79-07b7-46ee-889c-3043f726bec9 from shelved instance... Oct 23 01:35:34.802182 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3bfc49da-c93d-4afb-8f88-42a4b7ac50b7 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:34.802959 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3bfc49da-c93d-4afb-8f88-42a4b7ac50b7 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:34.803562 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3bfc49da-c93d-4afb-8f88-42a4b7ac50b7 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:34.804445 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3bfc49da-c93d-4afb-8f88-42a4b7ac50b7 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:34.811262 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3bfc49da-c93d-4afb-8f88-42a4b7ac50b7 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:34.811988 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3bfc49da-c93d-4afb-8f88-42a4b7ac50b7 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:34.831368 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-3bfc49da-c93d-4afb-8f88-42a4b7ac50b7 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] HTTP exception thrown: Instance 697bf9a9-687f-4d5f-a459-9ff304289577 could not be found. Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3bfc49da-c93d-4afb-8f88-42a4b7ac50b7 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Request method failure captured: Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577 HTTP/1.1 Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJkvYHBhNP-ngrp3-t9b3JEvPymaCLxveQy3RHlcnEhTQOwrgKm_FYFqgl1O3oBP9pMRjY52nNZb_Q0xi9HfDiuiJB7SCfmksRniHRxHyItsbztYyPUcQD1NZfU4JeOPY635AaAApWVr1Jjx20AyHyGm3ekhiRFvnH_BMldZWZd5QMc Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 6edb27d1224244809ecbb55ac953c645 Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-AttachVolumeNegativeTest-742145495 Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6edb27d1224244809ecbb55ac953c645"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6edb27d1224244809ecbb55ac953c645"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6edb27d1224244809ecbb55ac953c645"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6edb27d1224244809ecbb55ac953c645"}]}] Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-AttachVolumeNegativeTest-742145495 Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 6edb27d1224244809ecbb55ac953c645 Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-742145495 Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-AttachVolumeNegativeTest-742145495-project Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 0c65e7ab0b544d9ebdac8bc2129d051a Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-AttachVolumeNegativeTest-742145495-project Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 697bf9a9-687f-4d5f-a459-9ff304289577 could not be found. Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '697bf9a9-687f-4d5f-a459-9ff304289577'} Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 697bf9a9-687f-4d5f-a459-9ff304289577 could not be found. Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 697bf9a9-687f-4d5f-a459-9ff304289577 could not be found. Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:35:34.833316 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:35:34.838748 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:35:34.838748 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:35:34.838748 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:35:34.838748 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:35:34.838748 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:35:34.838748 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 697bf9a9-687f-4d5f-a459-9ff304289577 could not be found. Oct 23 01:35:34.838748 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:35:34.840262 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3bfc49da-c93d-4afb-8f88-42a4b7ac50b7 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Returning 404 to user: Instance 697bf9a9-687f-4d5f-a459-9ff304289577 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:35:34.841319 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3bfc49da-c93d-4afb-8f88-42a4b7ac50b7 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577" status: 404 len: 111 microversion: 2.1 time: 0.079784 Oct 23 01:35:34.842110 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2741/5384] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:34 2022] GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:35:34.870307 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-59bff041-166b-4d29-8ed7-478770f610d5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '.version_select at 0x7f5cc174f8b0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:34.992348 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-59bff041-166b-4d29-8ed7-478770f610d5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-45247929" status: 202 len: 0 microversion: 2.1 time: 0.143837 Oct 23 01:35:34.994891 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2742/5385] 10.222.0.42 () {58 vars in 1215 bytes} [Sun Oct 23 01:35:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-45247929 => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:35:35.001961 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-a21f2898-49d6-4470-84bb-a6ec4f9e31a0 req-b47fae89-21ac-48d4-8232-cfbbbfb60580 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b23efb32-6be3-4a79-90c0-fea6c5f2dd65", "tag": "22263c5c-a955-4784-bea4-6e244eed9069"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:35:35.035041 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-a21f2898-49d6-4470-84bb-a6ec4f9e31a0 req-b47fae89-21ac-48d4-8232-cfbbbfb60580 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:35.038620 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-a21f2898-49d6-4470-84bb-a6ec4f9e31a0 req-b47fae89-21ac-48d4-8232-cfbbbfb60580 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:35.039635 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-a21f2898-49d6-4470-84bb-a6ec4f9e31a0 req-b47fae89-21ac-48d4-8232-cfbbbfb60580 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:35.077483 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-a21f2898-49d6-4470-84bb-a6ec4f9e31a0 req-b47fae89-21ac-48d4-8232-cfbbbfb60580 service nova] Creating event network-changed:22263c5c-a955-4784-bea4-6e244eed9069 for instance b23efb32-6be3-4a79-90c0-fea6c5f2dd65 on n-h2-master-1 Oct 23 01:35:35.095021 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-a21f2898-49d6-4470-84bb-a6ec4f9e31a0 req-b47fae89-21ac-48d4-8232-cfbbbfb60580 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096890 Oct 23 01:35:35.097863 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2743/5386] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:35:35.710227 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d51d186c-d905-410a-8d43-853b9474701f tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:35.710227 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d51d186c-d905-410a-8d43-853b9474701f tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] [instance: ed5481ee-bbe1-466f-a04e-53b8333c2f93] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:35.713759 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d51d186c-d905-410a-8d43-853b9474701f tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:35.714916 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d51d186c-d905-410a-8d43-853b9474701f tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:35.715530 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d51d186c-d905-410a-8d43-853b9474701f tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:35.716342 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d51d186c-d905-410a-8d43-853b9474701f tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:35.717114 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d51d186c-d905-410a-8d43-853b9474701f tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:35.717514 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d51d186c-d905-410a-8d43-853b9474701f tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:36.093875 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d51d186c-d905-410a-8d43-853b9474701f tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaf572331dd405995c4c62d2f63b7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566c1cfeb26f4afb83ef844be75073d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:36.105214 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d51d186c-d905-410a-8d43-853b9474701f tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5481ee-bbe1-466f-a04e-53b8333c2f93" status: 200 len: 1325 microversion: 2.1 time: 0.420055 Oct 23 01:35:36.105822 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2744/5387] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:35 2022] GET /compute/v2.1/servers/ed5481ee-bbe1-466f-a04e-53b8333c2f93 => generated 1325 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:35:36.115604 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8d4341d6-34da-4604-9b55-e54e07430297 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:36.116260 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8d4341d6-34da-4604-9b55-e54e07430297 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: b23efb32-6be3-4a79-90c0-fea6c5f2dd65] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:36.158728 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8d4341d6-34da-4604-9b55-e54e07430297 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:36.159243 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8d4341d6-34da-4604-9b55-e54e07430297 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:36.161026 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8d4341d6-34da-4604-9b55-e54e07430297 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:36.162653 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8d4341d6-34da-4604-9b55-e54e07430297 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:36.164060 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8d4341d6-34da-4604-9b55-e54e07430297 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:36.164891 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8d4341d6-34da-4604-9b55-e54e07430297 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:36.585867 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8d4341d6-34da-4604-9b55-e54e07430297 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:36.598830 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8d4341d6-34da-4604-9b55-e54e07430297 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65" status: 200 len: 1314 microversion: 2.1 time: 0.491901 Oct 23 01:35:36.603392 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2745/5388] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:36 2022] GET /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65 => generated 1314 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:36.818837 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2dfbc6f1-5bf7-4385-a04f-434482c3647f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Action: 'create', calling method: .version_select at 0x7f5cc0ad93a0>, body: {"keypair": {"name": "tempest-keypair-613011138", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJd8DcHH3xExx5VlWqzIgKTvSZPFV64kZBGMzauCpHNY1Mv+ob0hngo4S3T9NsJ2z9mtS3zjC8kkJCI9geMpSxlGOPrc0TDVlJl2O/6DFYSL1nhdEgmBpgaQF95HbSq2jg=="}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:35:36.851258 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-2dfbc6f1-5bf7-4385-a04f-434482c3647f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Getting quotas for project 6edb27d1224244809ecbb55ac953c645. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:35:36.859960 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-2dfbc6f1-5bf7-4385-a04f-434482c3647f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Getting quotas for user 0c65e7ab0b544d9ebdac8bc2129d051a and project 6edb27d1224244809ecbb55ac953c645. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:35:36.871274 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2edc40d6-29cc-4e53-a61a-622411bd17c3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Doing local delete in cell 8efa99f7-1ff1-40c2-a97e-acbc153fb79d(cell1) {{(pid=120945) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 23 01:35:36.872928 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2edc40d6-29cc-4e53-a61a-622411bd17c3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:36.874144 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2edc40d6-29cc-4e53-a61a-622411bd17c3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:36.875753 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2edc40d6-29cc-4e53-a61a-622411bd17c3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:36.876827 n-d-master-1 devstack@n-api.service[120945]: INFO nova.compute.api [None req-2edc40d6-29cc-4e53-a61a-622411bd17c3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 23 01:35:36.895442 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-2edc40d6-29cc-4e53-a61a-622411bd17c3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] deallocate_for_instance() {{(pid=120945) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 23 01:35:36.974864 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2dfbc6f1-5bf7-4385-a04f-434482c3647f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.160091 Oct 23 01:35:36.977795 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2746/5389] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 01:35:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:35:37.132757 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b0bf6d0a-321c-4aa5-866d-83478cce98eb tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:37.140035 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b0bf6d0a-321c-4aa5-866d-83478cce98eb tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] [instance: ed5481ee-bbe1-466f-a04e-53b8333c2f93] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:37.150762 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b0bf6d0a-321c-4aa5-866d-83478cce98eb tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:37.154458 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b0bf6d0a-321c-4aa5-866d-83478cce98eb tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:37.156243 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b0bf6d0a-321c-4aa5-866d-83478cce98eb tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:37.158685 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b0bf6d0a-321c-4aa5-866d-83478cce98eb tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:37.159269 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b0bf6d0a-321c-4aa5-866d-83478cce98eb tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:37.159715 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b0bf6d0a-321c-4aa5-866d-83478cce98eb tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:37.490048 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b0bf6d0a-321c-4aa5-866d-83478cce98eb tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaf572331dd405995c4c62d2f63b7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566c1cfeb26f4afb83ef844be75073d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:37.509081 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b0bf6d0a-321c-4aa5-866d-83478cce98eb tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5481ee-bbe1-466f-a04e-53b8333c2f93" status: 200 len: 1325 microversion: 2.1 time: 0.378479 Oct 23 01:35:37.509081 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2747/5390] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:37 2022] GET /compute/v2.1/servers/ed5481ee-bbe1-466f-a04e-53b8333c2f93 => generated 1325 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:35:37.629545 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fb194b2d-4785-4103-882a-9d9fe3180c0c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:37.630573 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fb194b2d-4785-4103-882a-9d9fe3180c0c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: b23efb32-6be3-4a79-90c0-fea6c5f2dd65] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:37.636702 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb194b2d-4785-4103-882a-9d9fe3180c0c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:37.637194 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb194b2d-4785-4103-882a-9d9fe3180c0c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:37.637635 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb194b2d-4785-4103-882a-9d9fe3180c0c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:37.638508 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb194b2d-4785-4103-882a-9d9fe3180c0c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:37.639147 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb194b2d-4785-4103-882a-9d9fe3180c0c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:37.639884 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb194b2d-4785-4103-882a-9d9fe3180c0c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:38.295522 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fb194b2d-4785-4103-882a-9d9fe3180c0c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:38.305267 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fb194b2d-4785-4103-882a-9d9fe3180c0c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65" status: 200 len: 1314 microversion: 2.1 time: 0.679509 Oct 23 01:35:38.306238 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2748/5391] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:37 2022] GET /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65 => generated 1314 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:35:38.310612 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-83d7bdaf-7406-4b40-a424-0900d4c17542 req-2eb33102-62f7-4bdf-bf33-d6662b2a4915 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed5481ee-bbe1-466f-a04e-53b8333c2f93", "name": "network-vif-plugged", "status": "completed", "tag": "5ab7abbd-f102-4872-b907-868b4a72b107"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:35:38.319982 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-83d7bdaf-7406-4b40-a424-0900d4c17542 req-2eb33102-62f7-4bdf-bf33-d6662b2a4915 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:38.320480 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-83d7bdaf-7406-4b40-a424-0900d4c17542 req-2eb33102-62f7-4bdf-bf33-d6662b2a4915 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:38.322968 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-83d7bdaf-7406-4b40-a424-0900d4c17542 req-2eb33102-62f7-4bdf-bf33-d6662b2a4915 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:38.333542 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-83d7bdaf-7406-4b40-a424-0900d4c17542 req-2eb33102-62f7-4bdf-bf33-d6662b2a4915 service nova] Creating event network-vif-plugged:5ab7abbd-f102-4872-b907-868b4a72b107 for instance ed5481ee-bbe1-466f-a04e-53b8333c2f93 on n-h1-master-1 Oct 23 01:35:38.340987 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-83d7bdaf-7406-4b40-a424-0900d4c17542 req-2eb33102-62f7-4bdf-bf33-d6662b2a4915 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033608 Oct 23 01:35:38.341623 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2749/5392] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:35:38.510600 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-2ad901a1-d75c-48b7-94d1-3e1a83a6d8bd req-49557c3f-49b3-4b56-b7a4-e789ff67618f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71362f74-5a83-466a-b7be-de2a87253559", "name": "network-vif-deleted", "tag": "f30f4cf4-1b9d-4bf3-af09-74938e70131b"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:35:38.540066 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-2ad901a1-d75c-48b7-94d1-3e1a83a6d8bd req-49557c3f-49b3-4b56-b7a4-e789ff67618f service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:38.540552 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-2ad901a1-d75c-48b7-94d1-3e1a83a6d8bd req-49557c3f-49b3-4b56-b7a4-e789ff67618f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:38.544875 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-2ad901a1-d75c-48b7-94d1-3e1a83a6d8bd req-49557c3f-49b3-4b56-b7a4-e789ff67618f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:38.581234 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.compute.server_external_events [req-2ad901a1-d75c-48b7-94d1-3e1a83a6d8bd req-49557c3f-49b3-4b56-b7a4-e789ff67618f service nova] Unable to find a host for instance 71362f74-5a83-466a-b7be-de2a87253559. Dropping event network-vif-deleted {{(pid=120944) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 23 01:35:38.585814 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-2ad901a1-d75c-48b7-94d1-3e1a83a6d8bd req-49557c3f-49b3-4b56-b7a4-e789ff67618f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.079623 Oct 23 01:35:38.587155 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2750/5393] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 82 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 23 01:35:38.600452 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-2edc40d6-29cc-4e53-a61a-622411bd17c3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Updating instance_info_cache with network_info: [] {{(pid=120945) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 23 01:35:38.614536 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dbc76d6b-8287-40fc-9a6b-6eb0fee085a4 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:38.616471 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-dbc76d6b-8287-40fc-9a6b-6eb0fee085a4 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] [instance: ed5481ee-bbe1-466f-a04e-53b8333c2f93] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:38.624619 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dbc76d6b-8287-40fc-9a6b-6eb0fee085a4 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:38.625559 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dbc76d6b-8287-40fc-9a6b-6eb0fee085a4 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:38.626287 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dbc76d6b-8287-40fc-9a6b-6eb0fee085a4 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:38.627273 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dbc76d6b-8287-40fc-9a6b-6eb0fee085a4 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:38.628523 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dbc76d6b-8287-40fc-9a6b-6eb0fee085a4 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:38.629152 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dbc76d6b-8287-40fc-9a6b-6eb0fee085a4 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:39.042550 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-dbc76d6b-8287-40fc-9a6b-6eb0fee085a4 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaf572331dd405995c4c62d2f63b7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566c1cfeb26f4afb83ef844be75073d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:39.051243 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-dbc76d6b-8287-40fc-9a6b-6eb0fee085a4 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5481ee-bbe1-466f-a04e-53b8333c2f93" status: 200 len: 1325 microversion: 2.1 time: 0.462368 Oct 23 01:35:39.054912 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2751/5394] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:38 2022] GET /compute/v2.1/servers/ed5481ee-bbe1-466f-a04e-53b8333c2f93 => generated 1325 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:39.328780 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2d215be7-9689-4588-870b-a31b5cb8d208 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:39.332700 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2d215be7-9689-4588-870b-a31b5cb8d208 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: b23efb32-6be3-4a79-90c0-fea6c5f2dd65] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:39.341896 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2d215be7-9689-4588-870b-a31b5cb8d208 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:39.345545 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2d215be7-9689-4588-870b-a31b5cb8d208 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:39.346318 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2d215be7-9689-4588-870b-a31b5cb8d208 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:39.349261 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2d215be7-9689-4588-870b-a31b5cb8d208 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:39.349762 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2d215be7-9689-4588-870b-a31b5cb8d208 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:39.353241 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2d215be7-9689-4588-870b-a31b5cb8d208 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:39.691894 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2d215be7-9689-4588-870b-a31b5cb8d208 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:39.699797 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2d215be7-9689-4588-870b-a31b5cb8d208 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65" status: 200 len: 1314 microversion: 2.1 time: 0.375095 Oct 23 01:35:39.705965 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2752/5395] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:39 2022] GET /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65 => generated 1314 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:35:40.066381 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2edc40d6-29cc-4e53-a61a-622411bd17c3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "DELETE /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 204 len: 0 microversion: 2.1 time: 5.398463 Oct 23 01:35:40.077611 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0acc8ef3-1d5b-4d6a-a0ed-4d83ae80008e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:40.078865 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2644/5396] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:35:34 2022] DELETE /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 0 bytes in 5400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:35:40.079805 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0acc8ef3-1d5b-4d6a-a0ed-4d83ae80008e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:40.092597 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b2821e48-ea51-4932-9fc9-92f544e29858 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:40.096922 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b2821e48-ea51-4932-9fc9-92f544e29858 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] [instance: ed5481ee-bbe1-466f-a04e-53b8333c2f93] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:40.097232 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0acc8ef3-1d5b-4d6a-a0ed-4d83ae80008e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:40.097232 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0acc8ef3-1d5b-4d6a-a0ed-4d83ae80008e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:40.097455 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0acc8ef3-1d5b-4d6a-a0ed-4d83ae80008e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:40.098154 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0acc8ef3-1d5b-4d6a-a0ed-4d83ae80008e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:40.098617 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0acc8ef3-1d5b-4d6a-a0ed-4d83ae80008e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:40.108151 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0acc8ef3-1d5b-4d6a-a0ed-4d83ae80008e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:40.117892 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b2821e48-ea51-4932-9fc9-92f544e29858 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:40.118418 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b2821e48-ea51-4932-9fc9-92f544e29858 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:40.118857 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b2821e48-ea51-4932-9fc9-92f544e29858 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:40.119570 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b2821e48-ea51-4932-9fc9-92f544e29858 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:40.120018 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b2821e48-ea51-4932-9fc9-92f544e29858 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:40.120441 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b2821e48-ea51-4932-9fc9-92f544e29858 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:40.144526 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-0acc8ef3-1d5b-4d6a-a0ed-4d83ae80008e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] HTTP exception thrown: Instance 71362f74-5a83-466a-b7be-de2a87253559 could not be found. Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0acc8ef3-1d5b-4d6a-a0ed-4d83ae80008e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Request method failure captured: Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 HTTP/1.1 Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJlvTfuM9-iirX2FXe8mkTy2eWW7UhgAXbnHf6lceGN18S7lbSlaINo5EbF9-Kmi1tphVBr2Fcj8S4BVPceiAUMjh1Az0xLOZc1N90Wz0wmSyINFoBFx331KJ40smzwK1ZOJLA4k7IFyzBj3SQlZplUyTac5KUYxpNFIDY-5Uus0ZuU Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 842dcab8b48c43d7963a538d914b0b22 Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-DeleteServersTestJSON-654775470 Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/842dcab8b48c43d7963a538d914b0b22"}]}] Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-DeleteServersTestJSON-654775470 Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 842dcab8b48c43d7963a538d914b0b22 Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-DeleteServersTestJSON-654775470 Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-DeleteServersTestJSON-654775470-project Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 634bed7898c24baca6ba00392d49eea1 Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-DeleteServersTestJSON-654775470-project Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 71362f74-5a83-466a-b7be-de2a87253559 could not be found. Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '71362f74-5a83-466a-b7be-de2a87253559'} Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71362f74-5a83-466a-b7be-de2a87253559 could not be found. Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71362f74-5a83-466a-b7be-de2a87253559 could not be found. Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:35:40.146611 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:35:40.151866 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:35:40.151866 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:35:40.151866 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:35:40.151866 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:35:40.151866 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:35:40.151866 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71362f74-5a83-466a-b7be-de2a87253559 could not be found. Oct 23 01:35:40.151866 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:35:40.155032 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0acc8ef3-1d5b-4d6a-a0ed-4d83ae80008e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Returning 404 to user: Instance 71362f74-5a83-466a-b7be-de2a87253559 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:35:40.155032 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0acc8ef3-1d5b-4d6a-a0ed-4d83ae80008e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 404 len: 111 microversion: 2.1 time: 0.083037 Oct 23 01:35:40.159813 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2753/5397] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:40 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:35:40.408866 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b803ec3e-ccf5-46d2-9528-1c6e0ef16f99 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-912325508", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "ba696604-5fcc-4b2d-9bf0-ca27f90a0725"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:35:40.507211 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-b803ec3e-ccf5-46d2-9528-1c6e0ef16f99 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] validate_networks() for [('ba696604-5fcc-4b2d-9bf0-ca27f90a0725', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:35:40.516209 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b2821e48-ea51-4932-9fc9-92f544e29858 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaf572331dd405995c4c62d2f63b7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566c1cfeb26f4afb83ef844be75073d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:40.526339 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b2821e48-ea51-4932-9fc9-92f544e29858 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5481ee-bbe1-466f-a04e-53b8333c2f93" status: 200 len: 1325 microversion: 2.1 time: 0.446259 Oct 23 01:35:40.528541 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2645/5398] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:40 2022] GET /compute/v2.1/servers/ed5481ee-bbe1-466f-a04e-53b8333c2f93 => generated 1325 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:40.541285 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-a58016d6-14b0-4f8f-bdac-234889c818b8 req-c2aa8fa0-62c8-4752-b303-db8fb1c594c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b23efb32-6be3-4a79-90c0-fea6c5f2dd65", "name": "network-vif-plugged", "status": "completed", "tag": "22263c5c-a955-4784-bea4-6e244eed9069"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:35:40.578931 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-a58016d6-14b0-4f8f-bdac-234889c818b8 req-c2aa8fa0-62c8-4752-b303-db8fb1c594c5 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:40.579477 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-a58016d6-14b0-4f8f-bdac-234889c818b8 req-c2aa8fa0-62c8-4752-b303-db8fb1c594c5 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:40.579927 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-a58016d6-14b0-4f8f-bdac-234889c818b8 req-c2aa8fa0-62c8-4752-b303-db8fb1c594c5 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:40.610438 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-a58016d6-14b0-4f8f-bdac-234889c818b8 req-c2aa8fa0-62c8-4752-b303-db8fb1c594c5 service nova] Creating event network-vif-plugged:22263c5c-a955-4784-bea4-6e244eed9069 for instance b23efb32-6be3-4a79-90c0-fea6c5f2dd65 on n-h2-master-1 Oct 23 01:35:40.637807 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-a58016d6-14b0-4f8f-bdac-234889c818b8 req-c2aa8fa0-62c8-4752-b303-db8fb1c594c5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103514 Oct 23 01:35:40.639984 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2646/5399] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:35:40.735562 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fec994cd-5be4-430d-9b13-0c3052766d04 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:40.736597 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-fec994cd-5be4-430d-9b13-0c3052766d04 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: b23efb32-6be3-4a79-90c0-fea6c5f2dd65] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:40.746760 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fec994cd-5be4-430d-9b13-0c3052766d04 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:40.747259 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fec994cd-5be4-430d-9b13-0c3052766d04 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:40.747702 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fec994cd-5be4-430d-9b13-0c3052766d04 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:40.748871 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fec994cd-5be4-430d-9b13-0c3052766d04 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:40.749337 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fec994cd-5be4-430d-9b13-0c3052766d04 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:40.749813 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fec994cd-5be4-430d-9b13-0c3052766d04 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:41.157110 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-fec994cd-5be4-430d-9b13-0c3052766d04 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:41.165236 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fec994cd-5be4-430d-9b13-0c3052766d04 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65" status: 200 len: 1314 microversion: 2.1 time: 0.435833 Oct 23 01:35:41.165747 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2647/5400] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:40 2022] GET /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65 => generated 1314 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:41.181202 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7dfba1bd-642b-404d-8545-d047a6a0b2f1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-322735111", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e9d65ec9-a091-4c05-b838-8a651ac0b337"}], "security_groups": [{"name": "tempest-securitygroup--471904582"}], "key_name": "tempest-keypair-613011138", "user_data": "}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:35:41.483988 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-7dfba1bd-642b-404d-8545-d047a6a0b2f1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] validate_networks() for [('e9d65ec9-a091-4c05-b838-8a651ac0b337', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:35:41.680731 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-b803ec3e-ccf5-46d2-9528-1c6e0ef16f99 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:35:41.681190 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-b803ec3e-ccf5-46d2-9528-1c6e0ef16f99 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:35:41.681693 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-b803ec3e-ccf5-46d2-9528-1c6e0ef16f99 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:35:41.682346 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-b803ec3e-ccf5-46d2-9528-1c6e0ef16f99 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:35:41.682941 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-b803ec3e-ccf5-46d2-9528-1c6e0ef16f99 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:35:41.694691 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b803ec3e-ccf5-46d2-9528-1c6e0ef16f99 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:41.695390 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b803ec3e-ccf5-46d2-9528-1c6e0ef16f99 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:41.696275 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b803ec3e-ccf5-46d2-9528-1c6e0ef16f99 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:41.697193 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b803ec3e-ccf5-46d2-9528-1c6e0ef16f99 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:41.697828 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b803ec3e-ccf5-46d2-9528-1c6e0ef16f99 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:41.698477 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b803ec3e-ccf5-46d2-9528-1c6e0ef16f99 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:41.728058 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-b803ec3e-ccf5-46d2-9528-1c6e0ef16f99 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Getting quotas for project 842dcab8b48c43d7963a538d914b0b22. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:35:41.736219 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-b803ec3e-ccf5-46d2-9528-1c6e0ef16f99 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Getting quotas for user 634bed7898c24baca6ba00392d49eea1 and project 842dcab8b48c43d7963a538d914b0b22. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:35:41.741474 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:41.758737 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b803ec3e-ccf5-46d2-9528-1c6e0ef16f99 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:35:41.761731 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b803ec3e-ccf5-46d2-9528-1c6e0ef16f99 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 124d4efd-fa7d-468c-a512-78a550b75c89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:35:41.899207 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b803ec3e-ccf5-46d2-9528-1c6e0ef16f99 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.495986 Oct 23 01:35:41.901772 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2754/5401] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:35:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 23 01:35:41.919572 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-512a9df8-d27d-4018-ad5c-72b75964bd5f tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:41.921476 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-512a9df8-d27d-4018-ad5c-72b75964bd5f tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] [instance: ed5481ee-bbe1-466f-a04e-53b8333c2f93] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:41.929833 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-512a9df8-d27d-4018-ad5c-72b75964bd5f tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:41.930686 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-512a9df8-d27d-4018-ad5c-72b75964bd5f tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:41.931418 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-512a9df8-d27d-4018-ad5c-72b75964bd5f tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:41.932705 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-512a9df8-d27d-4018-ad5c-72b75964bd5f tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:41.933536 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-512a9df8-d27d-4018-ad5c-72b75964bd5f tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:41.934614 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-512a9df8-d27d-4018-ad5c-72b75964bd5f tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:41.955365 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=100 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:42.251392 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-512a9df8-d27d-4018-ad5c-72b75964bd5f tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaf572331dd405995c4c62d2f63b7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566c1cfeb26f4afb83ef844be75073d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:42.263351 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-512a9df8-d27d-4018-ad5c-72b75964bd5f tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5481ee-bbe1-466f-a04e-53b8333c2f93" status: 200 len: 1522 microversion: 2.1 time: 0.347807 Oct 23 01:35:42.278513 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2755/5402] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:41 2022] GET /compute/v2.1/servers/ed5481ee-bbe1-466f-a04e-53b8333c2f93 => generated 1522 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:42.290086 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-7dfba1bd-642b-404d-8545-d047a6a0b2f1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:35:42.290544 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-7dfba1bd-642b-404d-8545-d047a6a0b2f1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:35:42.291040 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-7dfba1bd-642b-404d-8545-d047a6a0b2f1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:35:42.291459 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-7dfba1bd-642b-404d-8545-d047a6a0b2f1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:35:42.291592 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0d1e340d-b1f5-4d4a-8571-2497b8e07a7d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:42.292040 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-7dfba1bd-642b-404d-8545-d047a6a0b2f1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:35:42.292402 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0d1e340d-b1f5-4d4a-8571-2497b8e07a7d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 124d4efd-fa7d-468c-a512-78a550b75c89] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:42.322476 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7dfba1bd-642b-404d-8545-d047a6a0b2f1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:42.322983 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7dfba1bd-642b-404d-8545-d047a6a0b2f1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:42.323615 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7dfba1bd-642b-404d-8545-d047a6a0b2f1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:42.325504 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7dfba1bd-642b-404d-8545-d047a6a0b2f1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:42.326570 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7dfba1bd-642b-404d-8545-d047a6a0b2f1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:42.327912 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7dfba1bd-642b-404d-8545-d047a6a0b2f1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:42.355064 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-7dfba1bd-642b-404d-8545-d047a6a0b2f1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Getting quotas for project 6edb27d1224244809ecbb55ac953c645. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:35:42.362281 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0d1e340d-b1f5-4d4a-8571-2497b8e07a7d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:42.363193 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-7dfba1bd-642b-404d-8545-d047a6a0b2f1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Getting quotas for user 0c65e7ab0b544d9ebdac8bc2129d051a and project 6edb27d1224244809ecbb55ac953c645. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:35:42.368382 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:42.373816 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0d1e340d-b1f5-4d4a-8571-2497b8e07a7d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89" status: 200 len: 1214 microversion: 2.1 time: 0.093290 Oct 23 01:35:42.376390 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2756/5403] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:42 2022] GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89 => generated 1214 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:42.380620 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d440af1f-24fc-4c6a-93d1-3c425ab8de1f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:42.381512 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d440af1f-24fc-4c6a-93d1-3c425ab8de1f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: b23efb32-6be3-4a79-90c0-fea6c5f2dd65] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:42.382279 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7dfba1bd-642b-404d-8545-d047a6a0b2f1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:35:42.384997 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7dfba1bd-642b-404d-8545-d047a6a0b2f1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 5e817a84-2969-413e-b36b-96798e94b306] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:35:42.388466 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d440af1f-24fc-4c6a-93d1-3c425ab8de1f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:42.389297 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d440af1f-24fc-4c6a-93d1-3c425ab8de1f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:42.389865 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d440af1f-24fc-4c6a-93d1-3c425ab8de1f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:42.391055 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d440af1f-24fc-4c6a-93d1-3c425ab8de1f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:42.391628 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d440af1f-24fc-4c6a-93d1-3c425ab8de1f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:42.394269 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d440af1f-24fc-4c6a-93d1-3c425ab8de1f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:42.600462 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7dfba1bd-642b-404d-8545-d047a6a0b2f1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.423720 Oct 23 01:35:42.601537 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2648/5404] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:35:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 1426 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:35:42.609933 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d440af1f-24fc-4c6a-93d1-3c425ab8de1f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:42.622940 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d440af1f-24fc-4c6a-93d1-3c425ab8de1f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65" status: 200 len: 1501 microversion: 2.1 time: 0.246726 Oct 23 01:35:42.626100 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2757/5405] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:42 2022] GET /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65 => generated 1501 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:42.627851 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b52cec17-cd16-4f34-9822-ea8e12602125 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:42.628582 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b52cec17-cd16-4f34-9822-ea8e12602125 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] [instance: ed5481ee-bbe1-466f-a04e-53b8333c2f93] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:42.633396 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-98e2c381-ffde-4ad3-b27d-ecf0c24b017e tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:42.634766 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-98e2c381-ffde-4ad3-b27d-ecf0c24b017e tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 5e817a84-2969-413e-b36b-96798e94b306] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:42.639878 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b52cec17-cd16-4f34-9822-ea8e12602125 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:42.640924 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b52cec17-cd16-4f34-9822-ea8e12602125 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:42.641370 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b52cec17-cd16-4f34-9822-ea8e12602125 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:42.646330 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b52cec17-cd16-4f34-9822-ea8e12602125 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:42.646877 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b52cec17-cd16-4f34-9822-ea8e12602125 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:42.647322 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b52cec17-cd16-4f34-9822-ea8e12602125 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:42.705240 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-b52cec17-cd16-4f34-9822-ea8e12602125 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] HTTP exception thrown: Action 999 not found Oct 23 01:35:42.712675 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b52cec17-cd16-4f34-9822-ea8e12602125 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Request method failure captured: Oct 23 01:35:42.712675 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/ed5481ee-bbe1-466f-a04e-53b8333c2f93/os-instance-actions/999 HTTP/1.1 Oct 23 01:35:42.712675 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:35:42.712675 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:35:42.712675 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:35:42.712675 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:35:42.712675 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:35:42.712675 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:35:42.712675 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:35:42.712675 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:35:42.712675 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJpOBg7tIBIWDrlvk-dxjV0Rp6262_jVdB7cj5eCyw9v743ib3RarGLx2ozahPq-bbD6a0aqPIfU9PyDP03wy6OdksX_MrxITM0o8QLo2qjSgz-7ROORO-MrHvUx9chLtxEI6qbl1DE9qgdVBWLnS9dkIpvz0qkQWLzCH5KPjKhRnFY Oct 23 01:35:42.712675 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:35:42.712675 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:35:42.712675 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:35:42.712675 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:35:42.712675 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:35:42.712675 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:35:42.712675 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 566c1cfeb26f4afb83ef844be75073d8 Oct 23 01:35:42.712675 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1109482669 Oct 23 01:35:42.712675 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:35:42.712675 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:35:42.712675 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/566c1cfeb26f4afb83ef844be75073d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_566c1cfeb26f4afb83ef844be75073d8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/566c1cfeb26f4afb83ef844be75073d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/566c1cfeb26f4afb83ef844be75073d8"}]}] Oct 23 01:35:42.712675 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1109482669 Oct 23 01:35:42.712675 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 566c1cfeb26f4afb83ef844be75073d8 Oct 23 01:35:42.712675 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1109482669 Oct 23 01:35:42.712675 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-InstanceActionsNegativeTestJSON-1109482669-project Oct 23 01:35:42.712675 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:35:42.712675 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:35:42.712675 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: bcaf572331dd405995c4c62d2f63b7f3 Oct 23 01:35:42.712675 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1109482669-project Oct 23 01:35:42.712675 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:35:42.712675 n-d-master-1 devstack@n-api.service[120945]: exception: Action 999 not found Oct 23 01:35:42.712675 n-d-master-1 devstack@n-api.service[120945]: action_args: {'server_id': 'ed5481ee-bbe1-466f-a04e-53b8333c2f93', 'id': '999'} Oct 23 01:35:42.712675 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:35:42.712675 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:35:42.712675 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:35:42.712675 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:35:42.712675 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:35:42.712675 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:35:42.712675 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:35:42.712675 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:35:42.712675 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 23 01:35:42.712675 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 23 01:35:42.712675 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 23 01:35:42.712675 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:35:42.712675 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:35:42.712675 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:35:42.712675 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:35:42.712675 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:35:42.712675 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:35:42.712675 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:35:42.712675 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:35:42.712675 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 23 01:35:42.712675 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:35:42.717405 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b52cec17-cd16-4f34-9822-ea8e12602125 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Returning 404 to user: Action 999 not found {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:35:42.717405 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b52cec17-cd16-4f34-9822-ea8e12602125 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5481ee-bbe1-466f-a04e-53b8333c2f93/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.111260 Oct 23 01:35:42.717405 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2649/5406] 10.222.0.42 () {58 vars in 1308 bytes} [Sun Oct 23 01:35:42 2022] GET /compute/v2.1/servers/ed5481ee-bbe1-466f-a04e-53b8333c2f93/os-instance-actions/999 => generated 66 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:35:42.722870 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-19db311e-b386-4ff5-b069-439949e73843 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:35:42.725180 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-19db311e-b386-4ff5-b069-439949e73843 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: b23efb32-6be3-4a79-90c0-fea6c5f2dd65] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:42.741844 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-19db311e-b386-4ff5-b069-439949e73843 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:42.742367 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-19db311e-b386-4ff5-b069-439949e73843 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:42.742815 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-19db311e-b386-4ff5-b069-439949e73843 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:42.743500 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-19db311e-b386-4ff5-b069-439949e73843 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:42.744154 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-19db311e-b386-4ff5-b069-439949e73843 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:42.744865 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-19db311e-b386-4ff5-b069-439949e73843 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:42.748632 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-98e2c381-ffde-4ad3-b27d-ecf0c24b017e tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:42.761950 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-98e2c381-ffde-4ad3-b27d-ecf0c24b017e tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306" status: 200 len: 1240 microversion: 2.1 time: 0.133018 Oct 23 01:35:42.774237 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2758/5407] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:42 2022] GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306 => generated 1240 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:42.783537 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-aa51db3f-0503-4f2d-b95d-a0e0370534e4 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Calling method '.version_select at 0x7f5cc0a81700>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:42.786108 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-aa51db3f-0503-4f2d-b95d-a0e0370534e4 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] [instance: 1f7fde1b-2ccf-4811-9d93-f30c1b556754] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:42.804161 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-aa51db3f-0503-4f2d-b95d-a0e0370534e4 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] HTTP exception thrown: Instance 1f7fde1b-2ccf-4811-9d93-f30c1b556754 could not be found. Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-aa51db3f-0503-4f2d-b95d-a0e0370534e4 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Request method failure captured: Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/1f7fde1b-2ccf-4811-9d93-f30c1b556754/os-instance-actions HTTP/1.1 Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJpOBg7tIBIWDrlvk-dxjV0Rp6262_jVdB7cj5eCyw9v743ib3RarGLx2ozahPq-bbD6a0aqPIfU9PyDP03wy6OdksX_MrxITM0o8QLo2qjSgz-7ROORO-MrHvUx9chLtxEI6qbl1DE9qgdVBWLnS9dkIpvz0qkQWLzCH5KPjKhRnFY Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 566c1cfeb26f4afb83ef844be75073d8 Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1109482669 Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/566c1cfeb26f4afb83ef844be75073d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_566c1cfeb26f4afb83ef844be75073d8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/566c1cfeb26f4afb83ef844be75073d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/566c1cfeb26f4afb83ef844be75073d8"}]}] Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1109482669 Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 566c1cfeb26f4afb83ef844be75073d8 Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1109482669 Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-InstanceActionsNegativeTestJSON-1109482669-project Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: bcaf572331dd405995c4c62d2f63b7f3 Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1109482669-project Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: method: Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 1f7fde1b-2ccf-4811-9d93-f30c1b556754 could not be found. Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: action_args: {'server_id': '1f7fde1b-2ccf-4811-9d93-f30c1b556754'} Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f7fde1b-2ccf-4811-9d93-f30c1b556754 could not be found. Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:35:42.806049 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:35:42.810426 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f7fde1b-2ccf-4811-9d93-f30c1b556754 could not be found. Oct 23 01:35:42.810426 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:35:42.810426 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:35:42.810426 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:35:42.810426 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:35:42.810426 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:35:42.810426 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:35:42.810426 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:35:42.810426 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:35:42.810426 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f7fde1b-2ccf-4811-9d93-f30c1b556754 could not be found. Oct 23 01:35:42.810426 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:35:42.810426 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-aa51db3f-0503-4f2d-b95d-a0e0370534e4 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Returning 404 to user: Instance 1f7fde1b-2ccf-4811-9d93-f30c1b556754 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:35:42.815035 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-aa51db3f-0503-4f2d-b95d-a0e0370534e4 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] 10.222.0.42 "GET /compute/v2.1/servers/1f7fde1b-2ccf-4811-9d93-f30c1b556754/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.033532 Oct 23 01:35:42.820704 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2759/5408] 10.222.0.42 () {58 vars in 1296 bytes} [Sun Oct 23 01:35:42 2022] GET /compute/v2.1/servers/1f7fde1b-2ccf-4811-9d93-f30c1b556754/os-instance-actions => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:35:42.826095 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9d671da8-8498-4599-bf49-2af7d5cb2d72 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:42.826607 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9d671da8-8498-4599-bf49-2af7d5cb2d72 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] [instance: ed5481ee-bbe1-466f-a04e-53b8333c2f93] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:42.834774 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-19db311e-b386-4ff5-b069-439949e73843 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "POST /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65/action" status: 200 len: 14 microversion: 2.1 time: 0.110495 Oct 23 01:35:42.834774 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2650/5409] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:35:42 2022] POST /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:35:42.843340 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9d671da8-8498-4599-bf49-2af7d5cb2d72 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:42.843855 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9d671da8-8498-4599-bf49-2af7d5cb2d72 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:42.844304 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9d671da8-8498-4599-bf49-2af7d5cb2d72 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:42.845024 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9d671da8-8498-4599-bf49-2af7d5cb2d72 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:42.846611 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9d671da8-8498-4599-bf49-2af7d5cb2d72 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:42.847120 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9d671da8-8498-4599-bf49-2af7d5cb2d72 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:42.931030 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9d671da8-8498-4599-bf49-2af7d5cb2d72 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] [instance: ed5481ee-bbe1-466f-a04e-53b8333c2f93] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:35:43.275698 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9d671da8-8498-4599-bf49-2af7d5cb2d72 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ed5481ee-bbe1-466f-a04e-53b8333c2f93" status: 204 len: 0 microversion: 2.1 time: 0.453327 Oct 23 01:35:43.283794 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2760/5410] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:35:42 2022] DELETE /compute/v2.1/servers/ed5481ee-bbe1-466f-a04e-53b8333c2f93 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:35:43.295370 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-92a46f4c-424e-40b7-a284-662151ac1f9b tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:43.300181 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-92a46f4c-424e-40b7-a284-662151ac1f9b tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] [instance: ed5481ee-bbe1-466f-a04e-53b8333c2f93] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:43.313656 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-92a46f4c-424e-40b7-a284-662151ac1f9b tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:43.314223 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-92a46f4c-424e-40b7-a284-662151ac1f9b tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:43.314627 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-92a46f4c-424e-40b7-a284-662151ac1f9b tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:43.315303 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-92a46f4c-424e-40b7-a284-662151ac1f9b tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:43.315767 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-92a46f4c-424e-40b7-a284-662151ac1f9b tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:43.316199 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-92a46f4c-424e-40b7-a284-662151ac1f9b tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:43.400050 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c01e1e04-dbc0-419d-8368-03d4837f025b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:43.400769 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c01e1e04-dbc0-419d-8368-03d4837f025b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 124d4efd-fa7d-468c-a512-78a550b75c89] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:43.413110 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c01e1e04-dbc0-419d-8368-03d4837f025b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:43.413679 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c01e1e04-dbc0-419d-8368-03d4837f025b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:43.414329 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c01e1e04-dbc0-419d-8368-03d4837f025b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:43.415074 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c01e1e04-dbc0-419d-8368-03d4837f025b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:43.416732 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c01e1e04-dbc0-419d-8368-03d4837f025b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:43.416732 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c01e1e04-dbc0-419d-8368-03d4837f025b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:43.538687 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c01e1e04-dbc0-419d-8368-03d4837f025b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:43.550513 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c01e1e04-dbc0-419d-8368-03d4837f025b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89" status: 200 len: 1218 microversion: 2.1 time: 0.154553 Oct 23 01:35:43.551101 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2761/5411] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:43 2022] GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89 => generated 1218 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:35:43.581588 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-92a46f4c-424e-40b7-a284-662151ac1f9b tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaf572331dd405995c4c62d2f63b7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566c1cfeb26f4afb83ef844be75073d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:43.590132 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-92a46f4c-424e-40b7-a284-662151ac1f9b tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5481ee-bbe1-466f-a04e-53b8333c2f93" status: 200 len: 1528 microversion: 2.1 time: 0.301695 Oct 23 01:35:43.591121 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2651/5412] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:43 2022] GET /compute/v2.1/servers/ed5481ee-bbe1-466f-a04e-53b8333c2f93 => generated 1528 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:43.791777 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f58cc634-7c54-4931-a110-bbfd33251a28 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:43.793024 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f58cc634-7c54-4931-a110-bbfd33251a28 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 5e817a84-2969-413e-b36b-96798e94b306] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:43.799802 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f58cc634-7c54-4931-a110-bbfd33251a28 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:43.800288 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f58cc634-7c54-4931-a110-bbfd33251a28 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:43.800723 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f58cc634-7c54-4931-a110-bbfd33251a28 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:43.801412 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f58cc634-7c54-4931-a110-bbfd33251a28 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:43.801865 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f58cc634-7c54-4931-a110-bbfd33251a28 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:43.804495 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f58cc634-7c54-4931-a110-bbfd33251a28 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:43.842638 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4da8bfe1-b2a6-4bda-951a-f66e6c0b0e6e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:35:43.852368 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4da8bfe1-b2a6-4bda-951a-f66e6c0b0e6e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: b23efb32-6be3-4a79-90c0-fea6c5f2dd65] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:43.864961 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4da8bfe1-b2a6-4bda-951a-f66e6c0b0e6e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:43.865458 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4da8bfe1-b2a6-4bda-951a-f66e6c0b0e6e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:43.871888 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4da8bfe1-b2a6-4bda-951a-f66e6c0b0e6e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:43.873020 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4da8bfe1-b2a6-4bda-951a-f66e6c0b0e6e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:43.873670 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4da8bfe1-b2a6-4bda-951a-f66e6c0b0e6e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:43.874868 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4da8bfe1-b2a6-4bda-951a-f66e6c0b0e6e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:43.906578 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f58cc634-7c54-4931-a110-bbfd33251a28 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:43.918969 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f58cc634-7c54-4931-a110-bbfd33251a28 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306" status: 200 len: 1244 microversion: 2.1 time: 0.128225 Oct 23 01:35:43.919527 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2762/5413] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:43 2022] GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306 => generated 1244 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:43.928515 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:43.983678 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4da8bfe1-b2a6-4bda-951a-f66e6c0b0e6e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "POST /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65/action" status: 200 len: 14 microversion: 2.1 time: 0.144574 Oct 23 01:35:43.988025 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2652/5414] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:35:43 2022] POST /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65/action => generated 14 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:35:44.584132 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-372fdecb-318a-457d-9bfa-fb799e87ebda tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:44.584971 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-372fdecb-318a-457d-9bfa-fb799e87ebda tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 124d4efd-fa7d-468c-a512-78a550b75c89] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:44.601068 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-372fdecb-318a-457d-9bfa-fb799e87ebda tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:44.601687 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-372fdecb-318a-457d-9bfa-fb799e87ebda tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:44.602225 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-372fdecb-318a-457d-9bfa-fb799e87ebda tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:44.602919 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-372fdecb-318a-457d-9bfa-fb799e87ebda tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:44.603377 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-372fdecb-318a-457d-9bfa-fb799e87ebda tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:44.606017 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-372fdecb-318a-457d-9bfa-fb799e87ebda tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:44.615000 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0062b952-b3c5-4b3b-a9cc-f9a1888b962b tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:44.616315 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0062b952-b3c5-4b3b-a9cc-f9a1888b962b tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] [instance: ed5481ee-bbe1-466f-a04e-53b8333c2f93] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:44.640522 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0062b952-b3c5-4b3b-a9cc-f9a1888b962b tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:44.641012 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0062b952-b3c5-4b3b-a9cc-f9a1888b962b tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:44.641444 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0062b952-b3c5-4b3b-a9cc-f9a1888b962b tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:44.642189 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0062b952-b3c5-4b3b-a9cc-f9a1888b962b tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:44.642639 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0062b952-b3c5-4b3b-a9cc-f9a1888b962b tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:44.643059 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0062b952-b3c5-4b3b-a9cc-f9a1888b962b tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:44.810911 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-372fdecb-318a-457d-9bfa-fb799e87ebda tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:44.825916 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-372fdecb-318a-457d-9bfa-fb799e87ebda tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89" status: 200 len: 1218 microversion: 2.1 time: 0.250889 Oct 23 01:35:44.829195 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2763/5415] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:44 2022] GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89 => generated 1218 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:44.945023 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f60cac4a-ae28-4d19-9d4f-739e4f653506 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:44.945935 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f60cac4a-ae28-4d19-9d4f-739e4f653506 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 5e817a84-2969-413e-b36b-96798e94b306] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:44.956598 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f60cac4a-ae28-4d19-9d4f-739e4f653506 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:44.957489 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f60cac4a-ae28-4d19-9d4f-739e4f653506 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:44.962486 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f60cac4a-ae28-4d19-9d4f-739e4f653506 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:44.964312 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f60cac4a-ae28-4d19-9d4f-739e4f653506 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:44.965092 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f60cac4a-ae28-4d19-9d4f-739e4f653506 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:44.966977 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f60cac4a-ae28-4d19-9d4f-739e4f653506 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:45.008224 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0062b952-b3c5-4b3b-a9cc-f9a1888b962b tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaf572331dd405995c4c62d2f63b7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566c1cfeb26f4afb83ef844be75073d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:45.032729 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0062b952-b3c5-4b3b-a9cc-f9a1888b962b tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5481ee-bbe1-466f-a04e-53b8333c2f93" status: 200 len: 1528 microversion: 2.1 time: 0.421785 Oct 23 01:35:45.035682 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2653/5416] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:44 2022] GET /compute/v2.1/servers/ed5481ee-bbe1-466f-a04e-53b8333c2f93 => generated 1528 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:35:45.051224 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5b32746a-8a82-4a81-a4fb-298fd8ee083b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:35:45.065119 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5b32746a-8a82-4a81-a4fb-298fd8ee083b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: b23efb32-6be3-4a79-90c0-fea6c5f2dd65] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:45.081434 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5b32746a-8a82-4a81-a4fb-298fd8ee083b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:45.081937 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5b32746a-8a82-4a81-a4fb-298fd8ee083b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:45.082415 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5b32746a-8a82-4a81-a4fb-298fd8ee083b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:45.083128 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5b32746a-8a82-4a81-a4fb-298fd8ee083b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:45.083585 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5b32746a-8a82-4a81-a4fb-298fd8ee083b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:45.084012 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5b32746a-8a82-4a81-a4fb-298fd8ee083b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:45.129280 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f60cac4a-ae28-4d19-9d4f-739e4f653506 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:45.146416 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f60cac4a-ae28-4d19-9d4f-739e4f653506 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306" status: 200 len: 1236 microversion: 2.1 time: 0.208122 Oct 23 01:35:45.148505 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2764/5417] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:44 2022] GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306 => generated 1236 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:35:45.201935 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5b32746a-8a82-4a81-a4fb-298fd8ee083b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "POST /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65/action" status: 200 len: 14 microversion: 2.1 time: 0.164030 Oct 23 01:35:45.205719 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2654/5418] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:35:45 2022] POST /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65/action => generated 14 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:35:45.781535 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-bbb1177f-6cb1-4d8e-83b6-a3c02887708d req-7fa0e177-6db3-424b-b2eb-279e0b5d28ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed5481ee-bbe1-466f-a04e-53b8333c2f93", "name": "network-vif-deleted", "tag": "5ab7abbd-f102-4872-b907-868b4a72b107"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:35:45.809137 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-bbb1177f-6cb1-4d8e-83b6-a3c02887708d req-7fa0e177-6db3-424b-b2eb-279e0b5d28ec service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:45.811756 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-bbb1177f-6cb1-4d8e-83b6-a3c02887708d req-7fa0e177-6db3-424b-b2eb-279e0b5d28ec service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:45.811756 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-bbb1177f-6cb1-4d8e-83b6-a3c02887708d req-7fa0e177-6db3-424b-b2eb-279e0b5d28ec service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:45.824829 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-bbb1177f-6cb1-4d8e-83b6-a3c02887708d req-7fa0e177-6db3-424b-b2eb-279e0b5d28ec service nova] Creating event network-vif-deleted:5ab7abbd-f102-4872-b907-868b4a72b107 for instance ed5481ee-bbe1-466f-a04e-53b8333c2f93 on n-h1-master-1 Oct 23 01:35:45.834385 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-bbb1177f-6cb1-4d8e-83b6-a3c02887708d req-7fa0e177-6db3-424b-b2eb-279e0b5d28ec service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054914 Oct 23 01:35:45.834385 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2765/5419] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:35:45.853759 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c9622753-9ca9-477e-8830-f64331b8cacb tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:45.854502 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c9622753-9ca9-477e-8830-f64331b8cacb tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 124d4efd-fa7d-468c-a512-78a550b75c89] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:45.864536 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c9622753-9ca9-477e-8830-f64331b8cacb tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:45.865058 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c9622753-9ca9-477e-8830-f64331b8cacb tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:45.865695 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c9622753-9ca9-477e-8830-f64331b8cacb tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:45.866426 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c9622753-9ca9-477e-8830-f64331b8cacb tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:45.867074 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c9622753-9ca9-477e-8830-f64331b8cacb tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:45.867672 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c9622753-9ca9-477e-8830-f64331b8cacb tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:45.986590 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c9622753-9ca9-477e-8830-f64331b8cacb tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:45.994985 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c9622753-9ca9-477e-8830-f64331b8cacb tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89" status: 200 len: 1210 microversion: 2.1 time: 0.145793 Oct 23 01:35:45.995579 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2655/5420] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:45 2022] GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89 => generated 1210 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:46.064103 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e0351fbb-8d25-4a45-9c98-f0f7506fb18e tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:46.065059 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e0351fbb-8d25-4a45-9c98-f0f7506fb18e tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] [instance: ed5481ee-bbe1-466f-a04e-53b8333c2f93] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:46.072294 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0351fbb-8d25-4a45-9c98-f0f7506fb18e tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:46.072871 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0351fbb-8d25-4a45-9c98-f0f7506fb18e tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:46.073383 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0351fbb-8d25-4a45-9c98-f0f7506fb18e tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:46.074208 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0351fbb-8d25-4a45-9c98-f0f7506fb18e tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:46.074767 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0351fbb-8d25-4a45-9c98-f0f7506fb18e tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:46.075261 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0351fbb-8d25-4a45-9c98-f0f7506fb18e tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:46.173535 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-085ca03d-0cc2-458b-8154-cc78edccb6bb tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:46.174725 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-085ca03d-0cc2-458b-8154-cc78edccb6bb tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 5e817a84-2969-413e-b36b-96798e94b306] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:46.190028 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-085ca03d-0cc2-458b-8154-cc78edccb6bb tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:46.197222 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-085ca03d-0cc2-458b-8154-cc78edccb6bb tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:46.199813 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-085ca03d-0cc2-458b-8154-cc78edccb6bb tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:46.200763 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-085ca03d-0cc2-458b-8154-cc78edccb6bb tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:46.203781 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-085ca03d-0cc2-458b-8154-cc78edccb6bb tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:46.204449 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-085ca03d-0cc2-458b-8154-cc78edccb6bb tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:46.546870 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-085ca03d-0cc2-458b-8154-cc78edccb6bb tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:46.557809 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-085ca03d-0cc2-458b-8154-cc78edccb6bb tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306" status: 200 len: 1300 microversion: 2.1 time: 0.389330 Oct 23 01:35:46.558672 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2656/5421] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:46 2022] GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306 => generated 1300 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:35:46.563723 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-279e7c79-4183-42a5-b120-64d154904ce1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:35:46.566276 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-279e7c79-4183-42a5-b120-64d154904ce1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: b23efb32-6be3-4a79-90c0-fea6c5f2dd65] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:46.624246 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-279e7c79-4183-42a5-b120-64d154904ce1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:46.624745 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-279e7c79-4183-42a5-b120-64d154904ce1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:46.631608 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-279e7c79-4183-42a5-b120-64d154904ce1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:46.631608 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-279e7c79-4183-42a5-b120-64d154904ce1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:46.631608 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-279e7c79-4183-42a5-b120-64d154904ce1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:46.631608 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-279e7c79-4183-42a5-b120-64d154904ce1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:46.632051 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e0351fbb-8d25-4a45-9c98-f0f7506fb18e tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaf572331dd405995c4c62d2f63b7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566c1cfeb26f4afb83ef844be75073d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:46.648771 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e0351fbb-8d25-4a45-9c98-f0f7506fb18e tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5481ee-bbe1-466f-a04e-53b8333c2f93" status: 200 len: 1310 microversion: 2.1 time: 0.589226 Oct 23 01:35:46.656166 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2766/5422] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:46 2022] GET /compute/v2.1/servers/ed5481ee-bbe1-466f-a04e-53b8333c2f93 => generated 1310 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:46.716001 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-279e7c79-4183-42a5-b120-64d154904ce1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "POST /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65/action" status: 200 len: 14 microversion: 2.1 time: 0.156047 Oct 23 01:35:46.718064 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2657/5423] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:35:46 2022] POST /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65/action => generated 14 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:35:47.017827 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a1d53e90-c6f5-4bd3-b577-b15c58fa8a1d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:47.018474 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a1d53e90-c6f5-4bd3-b577-b15c58fa8a1d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 124d4efd-fa7d-468c-a512-78a550b75c89] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:47.036705 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a1d53e90-c6f5-4bd3-b577-b15c58fa8a1d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:47.037219 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a1d53e90-c6f5-4bd3-b577-b15c58fa8a1d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:47.037671 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a1d53e90-c6f5-4bd3-b577-b15c58fa8a1d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:47.038461 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a1d53e90-c6f5-4bd3-b577-b15c58fa8a1d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:47.039140 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a1d53e90-c6f5-4bd3-b577-b15c58fa8a1d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:47.039750 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a1d53e90-c6f5-4bd3-b577-b15c58fa8a1d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:47.127251 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a1d53e90-c6f5-4bd3-b577-b15c58fa8a1d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:47.137796 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a1d53e90-c6f5-4bd3-b577-b15c58fa8a1d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89" status: 200 len: 1266 microversion: 2.1 time: 0.124375 Oct 23 01:35:47.142983 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2767/5424] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:47 2022] GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89 => generated 1266 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:47.583545 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e8f7ee20-3201-47bd-bc80-c6ecb6a0d2ba tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:47.584382 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e8f7ee20-3201-47bd-bc80-c6ecb6a0d2ba tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 5e817a84-2969-413e-b36b-96798e94b306] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:47.592735 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8f7ee20-3201-47bd-bc80-c6ecb6a0d2ba tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:47.593238 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8f7ee20-3201-47bd-bc80-c6ecb6a0d2ba tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:47.593674 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8f7ee20-3201-47bd-bc80-c6ecb6a0d2ba tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:47.594396 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8f7ee20-3201-47bd-bc80-c6ecb6a0d2ba tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:47.594965 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8f7ee20-3201-47bd-bc80-c6ecb6a0d2ba tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:47.595389 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8f7ee20-3201-47bd-bc80-c6ecb6a0d2ba tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:47.689244 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8bc79357-8e4f-44e1-831f-94422d14fadd tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:47.690171 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8bc79357-8e4f-44e1-831f-94422d14fadd tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] [instance: ed5481ee-bbe1-466f-a04e-53b8333c2f93] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:47.710376 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8bc79357-8e4f-44e1-831f-94422d14fadd tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:47.711287 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8bc79357-8e4f-44e1-831f-94422d14fadd tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:47.714151 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8bc79357-8e4f-44e1-831f-94422d14fadd tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:47.714151 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8bc79357-8e4f-44e1-831f-94422d14fadd tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:47.723491 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8bc79357-8e4f-44e1-831f-94422d14fadd tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:47.723970 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8bc79357-8e4f-44e1-831f-94422d14fadd tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:47.801891 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8bc79357-8e4f-44e1-831f-94422d14fadd tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:47.802309 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8bc79357-8e4f-44e1-831f-94422d14fadd tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:47.802761 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8bc79357-8e4f-44e1-831f-94422d14fadd tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:47.803226 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-8bc79357-8e4f-44e1-831f-94422d14fadd tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lazy-loading 'fault' on Instance uuid ed5481ee-bbe1-466f-a04e-53b8333c2f93 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:35:47.904295 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8bc79357-8e4f-44e1-831f-94422d14fadd tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaf572331dd405995c4c62d2f63b7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566c1cfeb26f4afb83ef844be75073d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:47.919517 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8bc79357-8e4f-44e1-831f-94422d14fadd tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5481ee-bbe1-466f-a04e-53b8333c2f93" status: 200 len: 1315 microversion: 2.1 time: 0.241361 Oct 23 01:35:47.920454 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2768/5425] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:47 2022] GET /compute/v2.1/servers/ed5481ee-bbe1-466f-a04e-53b8333c2f93 => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:35:47.934692 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-96908c22-cdbb-498d-b1d0-ea918e52eb35 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:35:47.937260 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-96908c22-cdbb-498d-b1d0-ea918e52eb35 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: b23efb32-6be3-4a79-90c0-fea6c5f2dd65] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:47.956456 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-96908c22-cdbb-498d-b1d0-ea918e52eb35 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:47.956963 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-96908c22-cdbb-498d-b1d0-ea918e52eb35 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:47.957409 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-96908c22-cdbb-498d-b1d0-ea918e52eb35 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:47.958156 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-96908c22-cdbb-498d-b1d0-ea918e52eb35 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:47.958617 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-96908c22-cdbb-498d-b1d0-ea918e52eb35 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:47.959983 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-96908c22-cdbb-498d-b1d0-ea918e52eb35 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:48.026704 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e8f7ee20-3201-47bd-bc80-c6ecb6a0d2ba tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:48.034799 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e8f7ee20-3201-47bd-bc80-c6ecb6a0d2ba tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306" status: 200 len: 1365 microversion: 2.1 time: 0.455940 Oct 23 01:35:48.035371 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2658/5426] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:47 2022] GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306 => generated 1365 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:48.042211 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-96908c22-cdbb-498d-b1d0-ea918e52eb35 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "POST /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65/action" status: 200 len: 14 microversion: 2.1 time: 0.120383 Oct 23 01:35:48.047967 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2769/5427] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:35:47 2022] POST /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:35:48.164747 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ba6d6ae6-7b95-4c7b-b9f1-c56ee61d8677 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:48.165357 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ba6d6ae6-7b95-4c7b-b9f1-c56ee61d8677 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 124d4efd-fa7d-468c-a512-78a550b75c89] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:48.172587 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ba6d6ae6-7b95-4c7b-b9f1-c56ee61d8677 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:48.173208 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ba6d6ae6-7b95-4c7b-b9f1-c56ee61d8677 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:48.173483 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ba6d6ae6-7b95-4c7b-b9f1-c56ee61d8677 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:48.174705 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ba6d6ae6-7b95-4c7b-b9f1-c56ee61d8677 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:48.175338 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ba6d6ae6-7b95-4c7b-b9f1-c56ee61d8677 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:48.175760 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ba6d6ae6-7b95-4c7b-b9f1-c56ee61d8677 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:48.291005 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ba6d6ae6-7b95-4c7b-b9f1-c56ee61d8677 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:48.303998 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ba6d6ae6-7b95-4c7b-b9f1-c56ee61d8677 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89" status: 200 len: 1272 microversion: 2.1 time: 0.143032 Oct 23 01:35:48.305696 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2659/5428] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:48 2022] GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89 => generated 1272 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:48.944365 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-253fc1f9-8dc9-4044-ab4d-87a25ca8aa62 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:48.945072 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-253fc1f9-8dc9-4044-ab4d-87a25ca8aa62 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] [instance: ed5481ee-bbe1-466f-a04e-53b8333c2f93] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:48.954228 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-253fc1f9-8dc9-4044-ab4d-87a25ca8aa62 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:48.955004 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-253fc1f9-8dc9-4044-ab4d-87a25ca8aa62 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:48.955458 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-253fc1f9-8dc9-4044-ab4d-87a25ca8aa62 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:48.956347 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-253fc1f9-8dc9-4044-ab4d-87a25ca8aa62 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:48.957350 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-253fc1f9-8dc9-4044-ab4d-87a25ca8aa62 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:48.958236 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-253fc1f9-8dc9-4044-ab4d-87a25ca8aa62 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:48.989648 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-253fc1f9-8dc9-4044-ab4d-87a25ca8aa62 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] HTTP exception thrown: Instance ed5481ee-bbe1-466f-a04e-53b8333c2f93 could not be found. Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-253fc1f9-8dc9-4044-ab4d-87a25ca8aa62 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Request method failure captured: Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/ed5481ee-bbe1-466f-a04e-53b8333c2f93 HTTP/1.1 Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJpOBg7tIBIWDrlvk-dxjV0Rp6262_jVdB7cj5eCyw9v743ib3RarGLx2ozahPq-bbD6a0aqPIfU9PyDP03wy6OdksX_MrxITM0o8QLo2qjSgz-7ROORO-MrHvUx9chLtxEI6qbl1DE9qgdVBWLnS9dkIpvz0qkQWLzCH5KPjKhRnFY Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 566c1cfeb26f4afb83ef844be75073d8 Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1109482669 Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/566c1cfeb26f4afb83ef844be75073d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_566c1cfeb26f4afb83ef844be75073d8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/566c1cfeb26f4afb83ef844be75073d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/566c1cfeb26f4afb83ef844be75073d8"}]}] Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1109482669 Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 566c1cfeb26f4afb83ef844be75073d8 Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1109482669 Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-InstanceActionsNegativeTestJSON-1109482669-project Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: bcaf572331dd405995c4c62d2f63b7f3 Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1109482669-project Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: exception: Instance ed5481ee-bbe1-466f-a04e-53b8333c2f93 could not be found. Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'ed5481ee-bbe1-466f-a04e-53b8333c2f93'} Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed5481ee-bbe1-466f-a04e-53b8333c2f93 could not be found. Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed5481ee-bbe1-466f-a04e-53b8333c2f93 could not be found. Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:35:48.991584 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:35:48.999844 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:35:48.999844 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:35:48.999844 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:35:48.999844 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:35:48.999844 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:35:48.999844 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:35:48.999844 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed5481ee-bbe1-466f-a04e-53b8333c2f93 could not be found. Oct 23 01:35:48.999844 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:35:48.999844 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-253fc1f9-8dc9-4044-ab4d-87a25ca8aa62 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] Returning 404 to user: Instance ed5481ee-bbe1-466f-a04e-53b8333c2f93 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:35:48.999844 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-253fc1f9-8dc9-4044-ab4d-87a25ca8aa62 tempest-InstanceActionsNegativeTestJSON-1109482669 tempest-InstanceActionsNegativeTestJSON-1109482669-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5481ee-bbe1-466f-a04e-53b8333c2f93" status: 404 len: 111 microversion: 2.1 time: 0.053090 Oct 23 01:35:48.999844 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2770/5429] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:48 2022] GET /compute/v2.1/servers/ed5481ee-bbe1-466f-a04e-53b8333c2f93 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:35:49.056028 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-90ecf2aa-227d-4694-ba6d-714c1eccab9e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:35:49.058623 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-90ecf2aa-227d-4694-ba6d-714c1eccab9e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: b23efb32-6be3-4a79-90c0-fea6c5f2dd65] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:49.064176 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1faadac8-4168-47c3-a0a8-634e40790a01 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:49.065839 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1faadac8-4168-47c3-a0a8-634e40790a01 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 5e817a84-2969-413e-b36b-96798e94b306] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:49.068536 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-90ecf2aa-227d-4694-ba6d-714c1eccab9e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:49.069306 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-90ecf2aa-227d-4694-ba6d-714c1eccab9e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:49.069999 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-90ecf2aa-227d-4694-ba6d-714c1eccab9e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:49.071369 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-90ecf2aa-227d-4694-ba6d-714c1eccab9e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:49.072113 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-90ecf2aa-227d-4694-ba6d-714c1eccab9e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:49.072772 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-90ecf2aa-227d-4694-ba6d-714c1eccab9e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:49.076407 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1faadac8-4168-47c3-a0a8-634e40790a01 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:49.076935 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1faadac8-4168-47c3-a0a8-634e40790a01 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:49.078467 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1faadac8-4168-47c3-a0a8-634e40790a01 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:49.079588 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1faadac8-4168-47c3-a0a8-634e40790a01 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:49.080688 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1faadac8-4168-47c3-a0a8-634e40790a01 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:49.081326 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1faadac8-4168-47c3-a0a8-634e40790a01 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:49.144881 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-90ecf2aa-227d-4694-ba6d-714c1eccab9e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "POST /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65/action" status: 200 len: 14 microversion: 2.1 time: 0.092997 Oct 23 01:35:49.145534 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2660/5430] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:35:49 2022] POST /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:35:49.335968 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-dae02113-ba1a-448b-93c1-17ac51a2f87f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:49.336679 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-dae02113-ba1a-448b-93c1-17ac51a2f87f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 124d4efd-fa7d-468c-a512-78a550b75c89] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:49.345197 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dae02113-ba1a-448b-93c1-17ac51a2f87f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:49.345689 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dae02113-ba1a-448b-93c1-17ac51a2f87f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:49.346396 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dae02113-ba1a-448b-93c1-17ac51a2f87f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:49.347157 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dae02113-ba1a-448b-93c1-17ac51a2f87f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:49.347618 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dae02113-ba1a-448b-93c1-17ac51a2f87f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:49.348646 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dae02113-ba1a-448b-93c1-17ac51a2f87f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:49.359357 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1faadac8-4168-47c3-a0a8-634e40790a01 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:49.388121 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1faadac8-4168-47c3-a0a8-634e40790a01 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306" status: 200 len: 1365 microversion: 2.1 time: 0.332062 Oct 23 01:35:49.392175 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2771/5431] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:49 2022] GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306 => generated 1365 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:49.504834 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-dae02113-ba1a-448b-93c1-17ac51a2f87f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:49.521121 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-dae02113-ba1a-448b-93c1-17ac51a2f87f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89" status: 200 len: 1272 microversion: 2.1 time: 0.190004 Oct 23 01:35:49.535145 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2661/5432] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:49 2022] GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89 => generated 1272 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:35:50.157083 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7bb6f5b5-95ac-4bed-96d8-b442f7be63f2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:35:50.161891 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7bb6f5b5-95ac-4bed-96d8-b442f7be63f2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: b23efb32-6be3-4a79-90c0-fea6c5f2dd65] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:50.176801 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7bb6f5b5-95ac-4bed-96d8-b442f7be63f2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:50.179994 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7bb6f5b5-95ac-4bed-96d8-b442f7be63f2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:50.182082 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7bb6f5b5-95ac-4bed-96d8-b442f7be63f2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:50.185583 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7bb6f5b5-95ac-4bed-96d8-b442f7be63f2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:50.187263 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7bb6f5b5-95ac-4bed-96d8-b442f7be63f2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:50.188019 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7bb6f5b5-95ac-4bed-96d8-b442f7be63f2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:50.258853 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7bb6f5b5-95ac-4bed-96d8-b442f7be63f2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "POST /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65/action" status: 200 len: 14 microversion: 2.1 time: 0.105971 Oct 23 01:35:50.260647 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2772/5433] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:35:50 2022] POST /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:35:50.413758 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e914c468-d003-4eb0-8767-f174a998036f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:50.414524 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e914c468-d003-4eb0-8767-f174a998036f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 5e817a84-2969-413e-b36b-96798e94b306] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:50.434187 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e914c468-d003-4eb0-8767-f174a998036f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:50.435729 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e914c468-d003-4eb0-8767-f174a998036f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:50.436945 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e914c468-d003-4eb0-8767-f174a998036f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:50.437918 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e914c468-d003-4eb0-8767-f174a998036f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:50.438815 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e914c468-d003-4eb0-8767-f174a998036f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:50.439829 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e914c468-d003-4eb0-8767-f174a998036f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:50.551890 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-80df34aa-2f5d-47c5-8dca-2d93701f377b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:50.558417 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-80df34aa-2f5d-47c5-8dca-2d93701f377b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 124d4efd-fa7d-468c-a512-78a550b75c89] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:50.573497 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-80df34aa-2f5d-47c5-8dca-2d93701f377b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:50.574416 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-80df34aa-2f5d-47c5-8dca-2d93701f377b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:50.575036 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-80df34aa-2f5d-47c5-8dca-2d93701f377b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:50.580128 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-80df34aa-2f5d-47c5-8dca-2d93701f377b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:50.580613 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-80df34aa-2f5d-47c5-8dca-2d93701f377b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:50.581989 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-80df34aa-2f5d-47c5-8dca-2d93701f377b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:50.897041 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e914c468-d003-4eb0-8767-f174a998036f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:50.918834 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e914c468-d003-4eb0-8767-f174a998036f tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306" status: 200 len: 1365 microversion: 2.1 time: 0.507529 Oct 23 01:35:50.920117 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2662/5434] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:50 2022] GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306 => generated 1365 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:51.013908 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-80df34aa-2f5d-47c5-8dca-2d93701f377b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:51.027019 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-80df34aa-2f5d-47c5-8dca-2d93701f377b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89" status: 200 len: 1314 microversion: 2.1 time: 0.479202 Oct 23 01:35:51.029733 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2773/5435] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:50 2022] GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89 => generated 1314 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:35:51.193161 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-4d1667df-cea1-4c1e-944e-b6f5225844c7 req-fa66cd0e-bd86-4b34-bd4d-e5ccc3f08d05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e817a84-2969-413e-b36b-96798e94b306", "tag": "534551ee-86d7-4973-bb51-3acbd26169dc"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:35:51.226854 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-4d1667df-cea1-4c1e-944e-b6f5225844c7 req-fa66cd0e-bd86-4b34-bd4d-e5ccc3f08d05 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:51.226854 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-4d1667df-cea1-4c1e-944e-b6f5225844c7 req-fa66cd0e-bd86-4b34-bd4d-e5ccc3f08d05 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:51.229960 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-4d1667df-cea1-4c1e-944e-b6f5225844c7 req-fa66cd0e-bd86-4b34-bd4d-e5ccc3f08d05 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:51.252410 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-4d1667df-cea1-4c1e-944e-b6f5225844c7 req-fa66cd0e-bd86-4b34-bd4d-e5ccc3f08d05 service nova] Creating event network-changed:534551ee-86d7-4973-bb51-3acbd26169dc for instance 5e817a84-2969-413e-b36b-96798e94b306 on n-h1-master-1 Oct 23 01:35:51.265028 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-4d1667df-cea1-4c1e-944e-b6f5225844c7 req-fa66cd0e-bd86-4b34-bd4d-e5ccc3f08d05 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082896 Oct 23 01:35:51.267170 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2663/5436] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:35:51.272648 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6cd9af3e-7315-4c95-b16c-6162d22ba665 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:35:51.275280 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6cd9af3e-7315-4c95-b16c-6162d22ba665 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: b23efb32-6be3-4a79-90c0-fea6c5f2dd65] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:51.291309 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6cd9af3e-7315-4c95-b16c-6162d22ba665 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:51.294868 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6cd9af3e-7315-4c95-b16c-6162d22ba665 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:51.294868 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6cd9af3e-7315-4c95-b16c-6162d22ba665 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:51.298221 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6cd9af3e-7315-4c95-b16c-6162d22ba665 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:51.299182 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6cd9af3e-7315-4c95-b16c-6162d22ba665 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:51.309517 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6cd9af3e-7315-4c95-b16c-6162d22ba665 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:51.396841 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6cd9af3e-7315-4c95-b16c-6162d22ba665 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "POST /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65/action" status: 200 len: 14 microversion: 2.1 time: 0.128423 Oct 23 01:35:51.397841 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2774/5437] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:35:51 2022] POST /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:35:51.946930 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d5443f0d-a603-4686-863e-9cdba467a3a1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:51.948208 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d5443f0d-a603-4686-863e-9cdba467a3a1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 5e817a84-2969-413e-b36b-96798e94b306] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:51.955709 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d5443f0d-a603-4686-863e-9cdba467a3a1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:51.956425 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d5443f0d-a603-4686-863e-9cdba467a3a1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:51.957085 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d5443f0d-a603-4686-863e-9cdba467a3a1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:51.958598 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d5443f0d-a603-4686-863e-9cdba467a3a1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:51.959237 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d5443f0d-a603-4686-863e-9cdba467a3a1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:51.964766 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d5443f0d-a603-4686-863e-9cdba467a3a1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:52.054507 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f23f0e42-4f19-4bdc-9bfc-3e3dbb816621 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:52.058648 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f23f0e42-4f19-4bdc-9bfc-3e3dbb816621 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 124d4efd-fa7d-468c-a512-78a550b75c89] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:52.065192 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:52.067627 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f23f0e42-4f19-4bdc-9bfc-3e3dbb816621 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:52.068474 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f23f0e42-4f19-4bdc-9bfc-3e3dbb816621 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:52.069080 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f23f0e42-4f19-4bdc-9bfc-3e3dbb816621 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:52.069997 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f23f0e42-4f19-4bdc-9bfc-3e3dbb816621 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:52.070510 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f23f0e42-4f19-4bdc-9bfc-3e3dbb816621 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:52.070941 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f23f0e42-4f19-4bdc-9bfc-3e3dbb816621 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:52.075793 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:52.346388 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:52.375349 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=6 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:52.603793 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d5443f0d-a603-4686-863e-9cdba467a3a1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:52.628668 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d5443f0d-a603-4686-863e-9cdba467a3a1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306" status: 200 len: 1365 microversion: 2.1 time: 0.685034 Oct 23 01:35:52.631029 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2664/5438] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:51 2022] GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306 => generated 1365 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:52.645814 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6ab99b20-77ed-490c-a6ce-14d8354a0610 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:35:52.652573 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6ab99b20-77ed-490c-a6ce-14d8354a0610 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: b23efb32-6be3-4a79-90c0-fea6c5f2dd65] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:52.668688 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6ab99b20-77ed-490c-a6ce-14d8354a0610 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:52.673088 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6ab99b20-77ed-490c-a6ce-14d8354a0610 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:52.678070 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6ab99b20-77ed-490c-a6ce-14d8354a0610 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:52.678951 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6ab99b20-77ed-490c-a6ce-14d8354a0610 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:52.680603 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6ab99b20-77ed-490c-a6ce-14d8354a0610 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:52.681200 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6ab99b20-77ed-490c-a6ce-14d8354a0610 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:52.689225 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f23f0e42-4f19-4bdc-9bfc-3e3dbb816621 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:52.721223 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f23f0e42-4f19-4bdc-9bfc-3e3dbb816621 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89" status: 200 len: 1314 microversion: 2.1 time: 0.662624 Oct 23 01:35:52.734151 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2775/5439] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:52 2022] GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89 => generated 1314 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:35:52.767895 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6ab99b20-77ed-490c-a6ce-14d8354a0610 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "POST /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65/action" status: 200 len: 14 microversion: 2.1 time: 0.134958 Oct 23 01:35:52.768635 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2665/5440] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:35:52 2022] POST /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65/action => generated 14 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:35:53.327557 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-60417557-3e86-4f4e-8495-26c3375615fe req-265bb66e-dc11-4d68-8195-37af6c430fc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "124d4efd-fa7d-468c-a512-78a550b75c89", "tag": "9e3b7c05-2566-412b-8518-c63d724d92ea"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:35:53.347029 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=14 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:53.349854 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-60417557-3e86-4f4e-8495-26c3375615fe req-265bb66e-dc11-4d68-8195-37af6c430fc1 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:53.350371 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-60417557-3e86-4f4e-8495-26c3375615fe req-265bb66e-dc11-4d68-8195-37af6c430fc1 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:53.353424 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-60417557-3e86-4f4e-8495-26c3375615fe req-265bb66e-dc11-4d68-8195-37af6c430fc1 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:53.378539 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-60417557-3e86-4f4e-8495-26c3375615fe req-265bb66e-dc11-4d68-8195-37af6c430fc1 service nova] Creating event network-changed:9e3b7c05-2566-412b-8518-c63d724d92ea for instance 124d4efd-fa7d-468c-a512-78a550b75c89 on n-h1-master-1 Oct 23 01:35:53.391287 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-60417557-3e86-4f4e-8495-26c3375615fe req-265bb66e-dc11-4d68-8195-37af6c430fc1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069638 Oct 23 01:35:53.402178 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2776/5441] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:35:53.658282 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b9296d81-d793-4e25-80d4-36d3ae3a1b0b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:53.658899 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b9296d81-d793-4e25-80d4-36d3ae3a1b0b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 5e817a84-2969-413e-b36b-96798e94b306] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:53.672598 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9296d81-d793-4e25-80d4-36d3ae3a1b0b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:53.673100 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9296d81-d793-4e25-80d4-36d3ae3a1b0b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:53.675403 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9296d81-d793-4e25-80d4-36d3ae3a1b0b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:53.691960 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9296d81-d793-4e25-80d4-36d3ae3a1b0b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:53.692501 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9296d81-d793-4e25-80d4-36d3ae3a1b0b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:53.692927 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9296d81-d793-4e25-80d4-36d3ae3a1b0b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:53.752089 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-10a66b6f-438b-4841-9ed3-793a68df57fc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:53.752802 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-10a66b6f-438b-4841-9ed3-793a68df57fc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 124d4efd-fa7d-468c-a512-78a550b75c89] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:53.770391 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-10a66b6f-438b-4841-9ed3-793a68df57fc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:53.771976 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-10a66b6f-438b-4841-9ed3-793a68df57fc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:53.774713 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-10a66b6f-438b-4841-9ed3-793a68df57fc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:53.775927 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-10a66b6f-438b-4841-9ed3-793a68df57fc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:53.777763 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-10a66b6f-438b-4841-9ed3-793a68df57fc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:53.780788 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-10a66b6f-438b-4841-9ed3-793a68df57fc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:54.006782 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b9296d81-d793-4e25-80d4-36d3ae3a1b0b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:54.016722 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-10a66b6f-438b-4841-9ed3-793a68df57fc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:54.017274 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b9296d81-d793-4e25-80d4-36d3ae3a1b0b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306" status: 200 len: 1365 microversion: 2.1 time: 0.364250 Oct 23 01:35:54.017880 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2666/5442] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:53 2022] GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306 => generated 1365 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:54.027157 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-10a66b6f-438b-4841-9ed3-793a68df57fc tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89" status: 200 len: 1314 microversion: 2.1 time: 0.281592 Oct 23 01:35:54.028298 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2777/5443] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:53 2022] GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89 => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:54.046528 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bcbf722f-dd03-470a-bf08-1823998ad8cd tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:35:54.050829 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-bcbf722f-dd03-470a-bf08-1823998ad8cd tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: b23efb32-6be3-4a79-90c0-fea6c5f2dd65] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:54.065635 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bcbf722f-dd03-470a-bf08-1823998ad8cd tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:54.066170 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bcbf722f-dd03-470a-bf08-1823998ad8cd tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:54.069915 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bcbf722f-dd03-470a-bf08-1823998ad8cd tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:54.070712 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bcbf722f-dd03-470a-bf08-1823998ad8cd tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:54.071189 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bcbf722f-dd03-470a-bf08-1823998ad8cd tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:54.071632 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bcbf722f-dd03-470a-bf08-1823998ad8cd tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:54.137176 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bcbf722f-dd03-470a-bf08-1823998ad8cd tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "POST /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65/action" status: 200 len: 14 microversion: 2.1 time: 0.102949 Oct 23 01:35:54.138028 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2667/5444] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:35:54 2022] POST /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:35:55.046374 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0defcf2d-6227-4838-805f-abfb62bfeeb2 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:55.047956 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0defcf2d-6227-4838-805f-abfb62bfeeb2 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 5e817a84-2969-413e-b36b-96798e94b306] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:55.052834 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f9b4ca47-bf2a-4c6d-b8fe-19aa60931fec tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:55.053563 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f9b4ca47-bf2a-4c6d-b8fe-19aa60931fec tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 124d4efd-fa7d-468c-a512-78a550b75c89] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:55.063939 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0defcf2d-6227-4838-805f-abfb62bfeeb2 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:55.065335 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0defcf2d-6227-4838-805f-abfb62bfeeb2 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:55.066047 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0defcf2d-6227-4838-805f-abfb62bfeeb2 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:55.067125 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0defcf2d-6227-4838-805f-abfb62bfeeb2 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:55.067775 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0defcf2d-6227-4838-805f-abfb62bfeeb2 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:55.069171 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0defcf2d-6227-4838-805f-abfb62bfeeb2 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:55.070056 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f9b4ca47-bf2a-4c6d-b8fe-19aa60931fec tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:55.072081 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f9b4ca47-bf2a-4c6d-b8fe-19aa60931fec tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:55.072839 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f9b4ca47-bf2a-4c6d-b8fe-19aa60931fec tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:55.074849 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f9b4ca47-bf2a-4c6d-b8fe-19aa60931fec tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:55.075324 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f9b4ca47-bf2a-4c6d-b8fe-19aa60931fec tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:55.075781 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f9b4ca47-bf2a-4c6d-b8fe-19aa60931fec tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:55.406856 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0defcf2d-6227-4838-805f-abfb62bfeeb2 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:55.416985 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f9b4ca47-bf2a-4c6d-b8fe-19aa60931fec tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:55.419791 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0defcf2d-6227-4838-805f-abfb62bfeeb2 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306" status: 200 len: 1365 microversion: 2.1 time: 0.382886 Oct 23 01:35:55.423118 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2778/5445] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:55 2022] GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306 => generated 1365 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:55.442027 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f9b4ca47-bf2a-4c6d-b8fe-19aa60931fec tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89" status: 200 len: 1314 microversion: 2.1 time: 0.389297 Oct 23 01:35:55.442027 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2668/5446] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:55 2022] GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89 => generated 1314 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:35:55.442370 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-df92c0c3-1520-44f8-b737-6d65c0e81345 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:35:55.442370 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-df92c0c3-1520-44f8-b737-6d65c0e81345 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: b23efb32-6be3-4a79-90c0-fea6c5f2dd65] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:55.447960 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-df92c0c3-1520-44f8-b737-6d65c0e81345 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:55.448599 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-df92c0c3-1520-44f8-b737-6d65c0e81345 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:55.449374 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-df92c0c3-1520-44f8-b737-6d65c0e81345 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:55.450135 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-df92c0c3-1520-44f8-b737-6d65c0e81345 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:55.450594 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-df92c0c3-1520-44f8-b737-6d65c0e81345 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:55.451106 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-df92c0c3-1520-44f8-b737-6d65c0e81345 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:55.529256 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-df92c0c3-1520-44f8-b737-6d65c0e81345 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "POST /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65/action" status: 200 len: 8206 microversion: 2.1 time: 0.104804 Oct 23 01:35:55.530894 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2779/5447] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:35:55 2022] POST /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65/action => generated 8206 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:55.554230 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8f698724-5473-40a6-8566-70b5d4279693 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:55.555034 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8f698724-5473-40a6-8566-70b5d4279693 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:55.564810 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f698724-5473-40a6-8566-70b5d4279693 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:55.566070 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f698724-5473-40a6-8566-70b5d4279693 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:55.566812 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f698724-5473-40a6-8566-70b5d4279693 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:55.568891 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f698724-5473-40a6-8566-70b5d4279693 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:55.569697 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f698724-5473-40a6-8566-70b5d4279693 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:55.570402 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f698724-5473-40a6-8566-70b5d4279693 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:55.834699 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8f698724-5473-40a6-8566-70b5d4279693 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:55.847843 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8f698724-5473-40a6-8566-70b5d4279693 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1669 microversion: 2.1 time: 0.308258 Oct 23 01:35:55.849334 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2669/5448] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:55 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1669 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:55.875850 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e6489335-d7ba-4310-af6e-c851736147cd tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:55.876559 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e6489335-d7ba-4310-af6e-c851736147cd tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:55.885456 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e6489335-d7ba-4310-af6e-c851736147cd tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:55.886235 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e6489335-d7ba-4310-af6e-c851736147cd tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:55.886851 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e6489335-d7ba-4310-af6e-c851736147cd tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:55.887808 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e6489335-d7ba-4310-af6e-c851736147cd tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:55.888737 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e6489335-d7ba-4310-af6e-c851736147cd tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:55.889492 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e6489335-d7ba-4310-af6e-c851736147cd tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:56.087919 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e6489335-d7ba-4310-af6e-c851736147cd tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:56.098963 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e6489335-d7ba-4310-af6e-c851736147cd tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1669 microversion: 2.1 time: 0.227315 Oct 23 01:35:56.100898 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2780/5449] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:55 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1669 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:56.122928 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6dcc21ad-1867-4629-aa0a-c40298539cfc tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:56.124880 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6dcc21ad-1867-4629-aa0a-c40298539cfc tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:56.134415 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6dcc21ad-1867-4629-aa0a-c40298539cfc tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:56.135752 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6dcc21ad-1867-4629-aa0a-c40298539cfc tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:56.136369 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6dcc21ad-1867-4629-aa0a-c40298539cfc tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:56.137293 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6dcc21ad-1867-4629-aa0a-c40298539cfc tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:56.137917 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6dcc21ad-1867-4629-aa0a-c40298539cfc tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:56.138531 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6dcc21ad-1867-4629-aa0a-c40298539cfc tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:56.444932 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-06d83e4b-88bb-45f8-b21f-8e316f923bc3 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:56.445512 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-06d83e4b-88bb-45f8-b21f-8e316f923bc3 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 5e817a84-2969-413e-b36b-96798e94b306] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:56.452998 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-06d83e4b-88bb-45f8-b21f-8e316f923bc3 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:56.453373 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-06d83e4b-88bb-45f8-b21f-8e316f923bc3 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:56.453806 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-06d83e4b-88bb-45f8-b21f-8e316f923bc3 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:56.454529 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-06d83e4b-88bb-45f8-b21f-8e316f923bc3 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:56.454981 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-06d83e4b-88bb-45f8-b21f-8e316f923bc3 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:56.455396 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-06d83e4b-88bb-45f8-b21f-8e316f923bc3 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:56.921321 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6dcc21ad-1867-4629-aa0a-c40298539cfc tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:56.930243 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6dcc21ad-1867-4629-aa0a-c40298539cfc tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1669 microversion: 2.1 time: 0.811457 Oct 23 01:35:56.933145 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2670/5450] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:56 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1669 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:56.938508 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f31f1d4a-ae80-467b-8c85-b4fd3a669c5b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:56.939261 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f31f1d4a-ae80-467b-8c85-b4fd3a669c5b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 124d4efd-fa7d-468c-a512-78a550b75c89] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:56.959531 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f31f1d4a-ae80-467b-8c85-b4fd3a669c5b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:56.962854 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f31f1d4a-ae80-467b-8c85-b4fd3a669c5b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:56.963420 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f31f1d4a-ae80-467b-8c85-b4fd3a669c5b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:56.965781 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f31f1d4a-ae80-467b-8c85-b4fd3a669c5b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:56.974237 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f31f1d4a-ae80-467b-8c85-b4fd3a669c5b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:56.974237 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f31f1d4a-ae80-467b-8c85-b4fd3a669c5b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:56.984819 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-06d83e4b-88bb-45f8-b21f-8e316f923bc3 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:56.999927 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-06d83e4b-88bb-45f8-b21f-8e316f923bc3 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306" status: 200 len: 1365 microversion: 2.1 time: 0.557733 Oct 23 01:35:57.011629 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2781/5451] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:56 2022] GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306 => generated 1365 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:57.024977 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9308092c-af76-4f1c-9bc9-de9127d2bd34 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:57.025608 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9308092c-af76-4f1c-9bc9-de9127d2bd34 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:57.033242 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9308092c-af76-4f1c-9bc9-de9127d2bd34 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:57.033742 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9308092c-af76-4f1c-9bc9-de9127d2bd34 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:57.034276 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9308092c-af76-4f1c-9bc9-de9127d2bd34 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:57.035001 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9308092c-af76-4f1c-9bc9-de9127d2bd34 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:57.035451 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9308092c-af76-4f1c-9bc9-de9127d2bd34 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:57.035931 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9308092c-af76-4f1c-9bc9-de9127d2bd34 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:57.413001 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9308092c-af76-4f1c-9bc9-de9127d2bd34 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:57.421992 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9308092c-af76-4f1c-9bc9-de9127d2bd34 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1669 microversion: 2.1 time: 0.402096 Oct 23 01:35:57.423391 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2782/5452] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:57 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1669 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:57.439495 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f31f1d4a-ae80-467b-8c85-b4fd3a669c5b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:57.442932 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=100 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:57.451674 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f31f1d4a-ae80-467b-8c85-b4fd3a669c5b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89" status: 200 len: 1314 microversion: 2.1 time: 0.517338 Oct 23 01:35:57.452818 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2671/5453] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:56 2022] GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89 => generated 1314 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:57.456205 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0b09a2b4-974f-42e1-a0f8-3f935871d751 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:35:57.456810 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0b09a2b4-974f-42e1-a0f8-3f935871d751 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:57.463716 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b09a2b4-974f-42e1-a0f8-3f935871d751 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:57.464218 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b09a2b4-974f-42e1-a0f8-3f935871d751 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:57.464645 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b09a2b4-974f-42e1-a0f8-3f935871d751 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:57.465349 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b09a2b4-974f-42e1-a0f8-3f935871d751 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:57.465847 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b09a2b4-974f-42e1-a0f8-3f935871d751 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:57.466429 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b09a2b4-974f-42e1-a0f8-3f935871d751 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:57.753654 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0b09a2b4-974f-42e1-a0f8-3f935871d751 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Locking {{(pid=120944) lock /opt/stack/nova/nova/compute/api.py:4845}} Oct 23 01:35:58.018272 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0b09a2b4-974f-42e1-a0f8-3f935871d751 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "POST /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98/action" status: 202 len: 0 microversion: 2.1 time: 0.570987 Oct 23 01:35:58.021400 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2783/5454] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:35:57 2022] POST /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98/action => generated 0 bytes in 573 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:35:58.026452 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5a15b58a-68b8-4941-b0bd-d03385e4ff56 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:58.027068 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5a15b58a-68b8-4941-b0bd-d03385e4ff56 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 5e817a84-2969-413e-b36b-96798e94b306] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:58.033115 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9440cb6d-f8eb-4d2a-b454-059c735ae384 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:58.033115 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9440cb6d-f8eb-4d2a-b454-059c735ae384 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:58.038197 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5a15b58a-68b8-4941-b0bd-d03385e4ff56 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:58.038755 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5a15b58a-68b8-4941-b0bd-d03385e4ff56 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:58.039386 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5a15b58a-68b8-4941-b0bd-d03385e4ff56 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:58.039904 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5a15b58a-68b8-4941-b0bd-d03385e4ff56 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:58.043576 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9440cb6d-f8eb-4d2a-b454-059c735ae384 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:58.043750 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5a15b58a-68b8-4941-b0bd-d03385e4ff56 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:58.044091 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5a15b58a-68b8-4941-b0bd-d03385e4ff56 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:58.046854 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9440cb6d-f8eb-4d2a-b454-059c735ae384 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:58.047413 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9440cb6d-f8eb-4d2a-b454-059c735ae384 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:58.048238 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9440cb6d-f8eb-4d2a-b454-059c735ae384 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:58.049728 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9440cb6d-f8eb-4d2a-b454-059c735ae384 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:58.051868 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9440cb6d-f8eb-4d2a-b454-059c735ae384 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:58.273339 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5a15b58a-68b8-4941-b0bd-d03385e4ff56 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:58.286740 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5a15b58a-68b8-4941-b0bd-d03385e4ff56 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306" status: 200 len: 1365 microversion: 2.1 time: 0.264387 Oct 23 01:35:58.291773 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2672/5455] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:58 2022] GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306 => generated 1365 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:58.319718 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-749a66bc-26f5-4145-a56d-b71757015d89 req-ec751c38-7539-477e-af74-4f6f88a06016 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e817a84-2969-413e-b36b-96798e94b306", "name": "network-vif-plugged", "status": "completed", "tag": "534551ee-86d7-4973-bb51-3acbd26169dc"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:35:58.321430 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9440cb6d-f8eb-4d2a-b454-059c735ae384 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:58.335332 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9440cb6d-f8eb-4d2a-b454-059c735ae384 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1669 microversion: 2.1 time: 0.311297 Oct 23 01:35:58.336233 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2784/5456] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:58 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1669 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:35:58.353597 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-749a66bc-26f5-4145-a56d-b71757015d89 req-ec751c38-7539-477e-af74-4f6f88a06016 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:58.359516 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-749a66bc-26f5-4145-a56d-b71757015d89 req-ec751c38-7539-477e-af74-4f6f88a06016 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:58.360428 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-749a66bc-26f5-4145-a56d-b71757015d89 req-ec751c38-7539-477e-af74-4f6f88a06016 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:58.364573 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f1fb923d-29da-439a-87c2-ea5ea21abe29 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:35:58.376051 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1fb923d-29da-439a-87c2-ea5ea21abe29 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:58.377190 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1fb923d-29da-439a-87c2-ea5ea21abe29 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:58.378418 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1fb923d-29da-439a-87c2-ea5ea21abe29 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:58.378653 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-749a66bc-26f5-4145-a56d-b71757015d89 req-ec751c38-7539-477e-af74-4f6f88a06016 service nova] Creating event network-vif-plugged:534551ee-86d7-4973-bb51-3acbd26169dc for instance 5e817a84-2969-413e-b36b-96798e94b306 on n-h1-master-1 Oct 23 01:35:58.391526 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-749a66bc-26f5-4145-a56d-b71757015d89 req-ec751c38-7539-477e-af74-4f6f88a06016 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074844 Oct 23 01:35:58.392787 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2673/5457] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:35:58.433496 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-f1fb923d-29da-439a-87c2-ea5ea21abe29 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] HTTP exception thrown: Instance fa616812-f379-45fb-8e7e-fefe7570dc98 is locked Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f1fb923d-29da-439a-87c2-ea5ea21abe29 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Request method failure captured: Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98/action HTTP/1.1 Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 15 Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJlXoIbKMNvA25YGQumrqoImspVHuLOUfoRmRPwWLxDcq7fsPtAFy81tjfSaLwjwvx2BxTkWPFCI5j4ehQFfit79dYKsAdSxV9xkhbHmIt2kWQXztVbC6m8EepFiVRbJzbhnCNQVWDwdnvsGEsySDgHPULZl6m0PSSbaKhzaMZDKOHE Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: aa4e3018a6ca477c9a1d7215ad98d9e9 Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServerActionsTestJSON-893303043 Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/aa4e3018a6ca477c9a1d7215ad98d9e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_aa4e3018a6ca477c9a1d7215ad98d9e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/aa4e3018a6ca477c9a1d7215ad98d9e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/aa4e3018a6ca477c9a1d7215ad98d9e9"}]}] Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServerActionsTestJSON-893303043 Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: aa4e3018a6ca477c9a1d7215ad98d9e9 Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServerActionsTestJSON-893303043 Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServerActionsTestJSON-893303043-project Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: bb03047092f64e2abbf78e9db1a06e0a Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServerActionsTestJSON-893303043-project Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: {"os-stop": {}} Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: exception: Instance fa616812-f379-45fb-8e7e-fefe7570dc98 is locked Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'fa616812-f379-45fb-8e7e-fefe7570dc98', 'body': {'os-stop': {}}} Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance fa616812-f379-45fb-8e7e-fefe7570dc98 is locked Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance fa616812-f379-45fb-8e7e-fefe7570dc98 is locked Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa616812-f379-45fb-8e7e-fefe7570dc98 is locked Oct 23 01:35:58.436094 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:35:58.452760 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f1fb923d-29da-439a-87c2-ea5ea21abe29 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Returning 409 to user: Instance fa616812-f379-45fb-8e7e-fefe7570dc98 is locked {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:35:58.452760 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f1fb923d-29da-439a-87c2-ea5ea21abe29 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "POST /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98/action" status: 409 len: 107 microversion: 2.1 time: 0.078448 Oct 23 01:35:58.452760 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2785/5458] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:35:58 2022] POST /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98/action => generated 107 bytes in 81 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:35:58.453046 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-571a32ff-719e-49af-9cf3-050597ba803a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:35:58.453046 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-571a32ff-719e-49af-9cf3-050597ba803a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:58.459493 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-571a32ff-719e-49af-9cf3-050597ba803a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:58.460056 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-571a32ff-719e-49af-9cf3-050597ba803a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:58.461196 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-571a32ff-719e-49af-9cf3-050597ba803a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:58.462253 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-571a32ff-719e-49af-9cf3-050597ba803a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:58.462952 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-571a32ff-719e-49af-9cf3-050597ba803a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:58.463396 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-571a32ff-719e-49af-9cf3-050597ba803a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:58.484649 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-74981aa2-9a9b-4096-abae-b50148f18f85 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:58.485300 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-74981aa2-9a9b-4096-abae-b50148f18f85 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 124d4efd-fa7d-468c-a512-78a550b75c89] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:58.505571 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-74981aa2-9a9b-4096-abae-b50148f18f85 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:58.505571 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-74981aa2-9a9b-4096-abae-b50148f18f85 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:58.505571 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-74981aa2-9a9b-4096-abae-b50148f18f85 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:58.505571 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-74981aa2-9a9b-4096-abae-b50148f18f85 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:58.505571 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-74981aa2-9a9b-4096-abae-b50148f18f85 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:58.515974 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-74981aa2-9a9b-4096-abae-b50148f18f85 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:58.821020 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-74981aa2-9a9b-4096-abae-b50148f18f85 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:58.833758 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-571a32ff-719e-49af-9cf3-050597ba803a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Unlocking {{(pid=120945) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 23 01:35:58.834496 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-74981aa2-9a9b-4096-abae-b50148f18f85 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89" status: 200 len: 1314 microversion: 2.1 time: 0.352130 Oct 23 01:35:58.841790 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2786/5459] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:58 2022] GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89 => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:35:59.097363 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-571a32ff-719e-49af-9cf3-050597ba803a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "POST /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98/action" status: 202 len: 0 microversion: 2.1 time: 0.652939 Oct 23 01:35:59.097999 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2674/5460] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:35:58 2022] POST /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98/action => generated 0 bytes in 655 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 23 01:35:59.110296 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-94cfb1bc-e2c4-42f3-aea2-d7f49ef7ae36 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:35:59.117288 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-94cfb1bc-e2c4-42f3-aea2-d7f49ef7ae36 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:59.118173 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-94cfb1bc-e2c4-42f3-aea2-d7f49ef7ae36 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:59.118690 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-94cfb1bc-e2c4-42f3-aea2-d7f49ef7ae36 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:59.142274 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-94cfb1bc-e2c4-42f3-aea2-d7f49ef7ae36 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Going to try to stop instance {{(pid=120944) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 23 01:35:59.316536 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0781e5c5-c23c-43b8-88cb-8cc16141d6e1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:59.317277 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0781e5c5-c23c-43b8-88cb-8cc16141d6e1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 5e817a84-2969-413e-b36b-96798e94b306] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:59.326621 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0781e5c5-c23c-43b8-88cb-8cc16141d6e1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:59.329460 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0781e5c5-c23c-43b8-88cb-8cc16141d6e1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:59.333077 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0781e5c5-c23c-43b8-88cb-8cc16141d6e1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:59.333653 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0781e5c5-c23c-43b8-88cb-8cc16141d6e1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:59.334165 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0781e5c5-c23c-43b8-88cb-8cc16141d6e1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:59.334599 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0781e5c5-c23c-43b8-88cb-8cc16141d6e1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:59.346220 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-94cfb1bc-e2c4-42f3-aea2-d7f49ef7ae36 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "POST /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98/action" status: 202 len: 0 microversion: 2.1 time: 0.243657 Oct 23 01:35:59.354507 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2787/5461] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:35:59 2022] POST /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 23 01:35:59.364126 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b8b7af40-921f-47d4-acf6-01132f3a9382 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:59.365379 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b8b7af40-921f-47d4-acf6-01132f3a9382 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:59.376885 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b8b7af40-921f-47d4-acf6-01132f3a9382 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:59.377807 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b8b7af40-921f-47d4-acf6-01132f3a9382 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:59.378568 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b8b7af40-921f-47d4-acf6-01132f3a9382 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:59.383703 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b8b7af40-921f-47d4-acf6-01132f3a9382 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:59.383703 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b8b7af40-921f-47d4-acf6-01132f3a9382 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:59.383703 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b8b7af40-921f-47d4-acf6-01132f3a9382 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:59.704061 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0781e5c5-c23c-43b8-88cb-8cc16141d6e1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:59.713945 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0781e5c5-c23c-43b8-88cb-8cc16141d6e1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306" status: 200 len: 1365 microversion: 2.1 time: 0.401369 Oct 23 01:35:59.714566 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2675/5462] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:59 2022] GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306 => generated 1365 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:59.727351 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b8b7af40-921f-47d4-acf6-01132f3a9382 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:35:59.740353 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b8b7af40-921f-47d4-acf6-01132f3a9382 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1679 microversion: 2.1 time: 0.383376 Oct 23 01:35:59.746799 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2788/5463] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:59 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1679 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:35:59.860351 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-636c1307-aab7-4b58-8cec-42832eff4d45 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:35:59.861231 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-636c1307-aab7-4b58-8cec-42832eff4d45 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 124d4efd-fa7d-468c-a512-78a550b75c89] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:35:59.868166 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-636c1307-aab7-4b58-8cec-42832eff4d45 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:59.868912 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-636c1307-aab7-4b58-8cec-42832eff4d45 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:59.869514 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-636c1307-aab7-4b58-8cec-42832eff4d45 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:35:59.870415 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-636c1307-aab7-4b58-8cec-42832eff4d45 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:35:59.871032 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-636c1307-aab7-4b58-8cec-42832eff4d45 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:35:59.871608 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-636c1307-aab7-4b58-8cec-42832eff4d45 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:00.091019 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-636c1307-aab7-4b58-8cec-42832eff4d45 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:00.099547 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-636c1307-aab7-4b58-8cec-42832eff4d45 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89" status: 200 len: 1314 microversion: 2.1 time: 0.243892 Oct 23 01:36:00.100139 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2676/5464] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:35:59 2022] GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:36:00.425870 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-0d0917c2-afd1-4481-832e-0eb39b3d62f8 req-01eccd75-2287-4643-a288-27eab0f0d0dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "124d4efd-fa7d-468c-a512-78a550b75c89", "name": "network-vif-plugged", "status": "completed", "tag": "9e3b7c05-2566-412b-8518-c63d724d92ea"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:36:00.469963 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-0d0917c2-afd1-4481-832e-0eb39b3d62f8 req-01eccd75-2287-4643-a288-27eab0f0d0dd service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:00.470472 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-0d0917c2-afd1-4481-832e-0eb39b3d62f8 req-01eccd75-2287-4643-a288-27eab0f0d0dd service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:00.470919 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-0d0917c2-afd1-4481-832e-0eb39b3d62f8 req-01eccd75-2287-4643-a288-27eab0f0d0dd service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:00.491809 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-0d0917c2-afd1-4481-832e-0eb39b3d62f8 req-01eccd75-2287-4643-a288-27eab0f0d0dd service nova] Creating event network-vif-plugged:9e3b7c05-2566-412b-8518-c63d724d92ea for instance 124d4efd-fa7d-468c-a512-78a550b75c89 on n-h1-master-1 Oct 23 01:36:00.497905 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-0d0917c2-afd1-4481-832e-0eb39b3d62f8 req-01eccd75-2287-4643-a288-27eab0f0d0dd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078791 Oct 23 01:36:00.499192 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2677/5465] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:36:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:36:00.595135 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-738cd28a-06c0-4031-9625-504d837ac548 tempest-MultipleCreateNegativeTestJSON-1050876951 tempest-MultipleCreateNegativeTestJSON-1050876951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-691527543", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:36:00.599012 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-738cd28a-06c0-4031-9625-504d837ac548 tempest-MultipleCreateNegativeTestJSON-1050876951 tempest-MultipleCreateNegativeTestJSON-1050876951-project] HTTP exception thrown: min_count must be <= max_count Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-738cd28a-06c0-4031-9625-504d837ac548 tempest-MultipleCreateNegativeTestJSON-1050876951 tempest-MultipleCreateNegativeTestJSON-1050876951-project] Request method failure captured: Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 183 Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJqAUwaaWa-oQAog4BPGfsOBX9jYX1cNNsLy9_KZOtjCPKwrTWaLpaxnYwyNsuWS-X3fF-iYDwN1DqLCA9xitPeM8hWMDU721b_Mf9ArOZZI2fFKL18MPpPxrIi_gvDkjxG5PpHm2fH0cwcWav7H8lVBnEW3xzsxRtZXSnJ_w-5l_Yw Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 02f62c0c345c4470b5807a1861dbe2e0 Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1050876951 Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/02f62c0c345c4470b5807a1861dbe2e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_02f62c0c345c4470b5807a1861dbe2e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/02f62c0c345c4470b5807a1861dbe2e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/02f62c0c345c4470b5807a1861dbe2e0"}]}] Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1050876951 Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 02f62c0c345c4470b5807a1861dbe2e0 Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1050876951 Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-MultipleCreateNegativeTestJSON-1050876951-project Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 7ac32dce0cd9402d9480285f1e69c143 Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1050876951-project Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-691527543", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: exception: min_count must be <= max_count Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-691527543', 'imageRef': '446b40bc-db5b-4123-9278-997bd6d04a0d', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 23 01:36:00.600923 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:36:00.607729 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-738cd28a-06c0-4031-9625-504d837ac548 tempest-MultipleCreateNegativeTestJSON-1050876951 tempest-MultipleCreateNegativeTestJSON-1050876951-project] Returning 400 to user: min_count must be <= max_count {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:36:00.608831 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-738cd28a-06c0-4031-9625-504d837ac548 tempest-MultipleCreateNegativeTestJSON-1050876951 tempest-MultipleCreateNegativeTestJSON-1050876951-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.226818 Oct 23 01:36:00.610221 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2789/5466] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:36:00 2022] POST /compute/v2.1/servers => generated 74 bytes in 229 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 23 01:36:00.724371 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0ab8ba0e-976b-473e-8e29-df1755f01efa tempest-MultipleCreateNegativeTestJSON-1050876951 tempest-MultipleCreateNegativeTestJSON-1050876951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-522587780", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "max_count": 0}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0ab8ba0e-976b-473e-8e29-df1755f01efa tempest-MultipleCreateNegativeTestJSON-1050876951 tempest-MultipleCreateNegativeTestJSON-1050876951-project] Request method failure captured: Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 167 Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJqAUwaaWa-oQAog4BPGfsOBX9jYX1cNNsLy9_KZOtjCPKwrTWaLpaxnYwyNsuWS-X3fF-iYDwN1DqLCA9xitPeM8hWMDU721b_Mf9ArOZZI2fFKL18MPpPxrIi_gvDkjxG5PpHm2fH0cwcWav7H8lVBnEW3xzsxRtZXSnJ_w-5l_Yw Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 02f62c0c345c4470b5807a1861dbe2e0 Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1050876951 Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/02f62c0c345c4470b5807a1861dbe2e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_02f62c0c345c4470b5807a1861dbe2e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/02f62c0c345c4470b5807a1861dbe2e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/02f62c0c345c4470b5807a1861dbe2e0"}]}] Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1050876951 Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 02f62c0c345c4470b5807a1861dbe2e0 Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1050876951 Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-MultipleCreateNegativeTestJSON-1050876951-project Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 7ac32dce0cd9402d9480285f1e69c143 Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1050876951-project Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-522587780", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "max_count": 0}} Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-522587780', 'imageRef': '446b40bc-db5b-4123-9278-997bd6d04a0d', 'flavorRef': '452', 'max_count': 0}}} Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise error Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 0 Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 23 01:36:00.729948 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 23 01:36:00.737830 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 23 01:36:00.737830 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 23 01:36:00.737830 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 23 01:36:00.737830 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 23 01:36:00.737830 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 23 01:36:00.737830 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:36:00.737830 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:36:00.737830 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:36:00.737830 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:36:00.737830 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:36:00.737830 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:36:00.737830 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 23 01:36:00.737830 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 23 01:36:00.737830 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 23 01:36:00.737830 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:36:00.744268 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6f05222d-ea49-487a-8ee1-976dba83bbb9 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:00.745467 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6f05222d-ea49-487a-8ee1-976dba83bbb9 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 5e817a84-2969-413e-b36b-96798e94b306] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:00.761452 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0ab8ba0e-976b-473e-8e29-df1755f01efa tempest-MultipleCreateNegativeTestJSON-1050876951 tempest-MultipleCreateNegativeTestJSON-1050876951-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:36:00.761452 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0ab8ba0e-976b-473e-8e29-df1755f01efa tempest-MultipleCreateNegativeTestJSON-1050876951 tempest-MultipleCreateNegativeTestJSON-1050876951-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.031107 Oct 23 01:36:00.761452 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2678/5467] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:36:00 2022] POST /compute/v2.1/servers => generated 130 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:36:00.768191 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6f05222d-ea49-487a-8ee1-976dba83bbb9 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:00.768467 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e1444802-8238-4a1f-bd34-2e031965127a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:00.768883 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6f05222d-ea49-487a-8ee1-976dba83bbb9 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:00.769534 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6f05222d-ea49-487a-8ee1-976dba83bbb9 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:00.769667 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e1444802-8238-4a1f-bd34-2e031965127a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:00.770442 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6f05222d-ea49-487a-8ee1-976dba83bbb9 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:00.771168 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6f05222d-ea49-487a-8ee1-976dba83bbb9 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:00.771541 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6f05222d-ea49-487a-8ee1-976dba83bbb9 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:00.786203 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e1444802-8238-4a1f-bd34-2e031965127a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:00.786763 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e1444802-8238-4a1f-bd34-2e031965127a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:00.787770 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e1444802-8238-4a1f-bd34-2e031965127a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:00.788576 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e1444802-8238-4a1f-bd34-2e031965127a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:00.789052 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e1444802-8238-4a1f-bd34-2e031965127a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:00.789490 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e1444802-8238-4a1f-bd34-2e031965127a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:00.817188 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:01.141243 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6f05222d-ea49-487a-8ee1-976dba83bbb9 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:01.150329 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e1444802-8238-4a1f-bd34-2e031965127a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:01.152305 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6f05222d-ea49-487a-8ee1-976dba83bbb9 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306" status: 200 len: 1556 microversion: 2.1 time: 0.416040 Oct 23 01:36:01.153124 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2790/5468] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:00 2022] GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306 => generated 1556 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:36:01.158259 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-70ba042b-5760-4e68-a4e1-79bc3dbe01f7 tempest-MultipleCreateNegativeTestJSON-1050876951 tempest-MultipleCreateNegativeTestJSON-1050876951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-762591737", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "max_count": 2.5}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-70ba042b-5760-4e68-a4e1-79bc3dbe01f7 tempest-MultipleCreateNegativeTestJSON-1050876951 tempest-MultipleCreateNegativeTestJSON-1050876951-project] Request method failure captured: Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 169 Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJqAUwaaWa-oQAog4BPGfsOBX9jYX1cNNsLy9_KZOtjCPKwrTWaLpaxnYwyNsuWS-X3fF-iYDwN1DqLCA9xitPeM8hWMDU721b_Mf9ArOZZI2fFKL18MPpPxrIi_gvDkjxG5PpHm2fH0cwcWav7H8lVBnEW3xzsxRtZXSnJ_w-5l_Yw Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 02f62c0c345c4470b5807a1861dbe2e0 Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1050876951 Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/02f62c0c345c4470b5807a1861dbe2e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_02f62c0c345c4470b5807a1861dbe2e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/02f62c0c345c4470b5807a1861dbe2e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/02f62c0c345c4470b5807a1861dbe2e0"}]}] Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1050876951 Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 02f62c0c345c4470b5807a1861dbe2e0 Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1050876951 Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-MultipleCreateNegativeTestJSON-1050876951-project Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 7ac32dce0cd9402d9480285f1e69c143 Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1050876951-project Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-762591737", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "max_count": 2.5}} Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-762591737', 'imageRef': '446b40bc-db5b-4123-9278-997bd6d04a0d', 'flavorRef': '452', 'max_count': 2.5}}} Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise error Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi 2.5 Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 23 01:36:01.162353 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 23 01:36:01.167679 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 23 01:36:01.167679 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 23 01:36:01.167679 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 23 01:36:01.167679 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 23 01:36:01.167679 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 23 01:36:01.167679 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:36:01.167679 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:36:01.167679 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:36:01.167679 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:36:01.167679 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:36:01.167679 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:36:01.167679 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 23 01:36:01.167679 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 23 01:36:01.167679 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 23 01:36:01.167679 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:36:01.167679 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-70ba042b-5760-4e68-a4e1-79bc3dbe01f7 tempest-MultipleCreateNegativeTestJSON-1050876951 tempest-MultipleCreateNegativeTestJSON-1050876951-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:36:01.167679 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-70ba042b-5760-4e68-a4e1-79bc3dbe01f7 tempest-MultipleCreateNegativeTestJSON-1050876951 tempest-MultipleCreateNegativeTestJSON-1050876951-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.009660 Oct 23 01:36:01.167679 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2791/5469] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:36:01 2022] POST /compute/v2.1/servers => generated 139 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:36:01.176060 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e1444802-8238-4a1f-bd34-2e031965127a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1679 microversion: 2.1 time: 0.411227 Oct 23 01:36:01.177807 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2679/5470] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:00 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1679 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:36:01.188643 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-db100296-24d5-4eb9-92e1-94a4d0ec05e8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:01.190588 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-db100296-24d5-4eb9-92e1-94a4d0ec05e8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 5e817a84-2969-413e-b36b-96798e94b306] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:01.198229 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3cf5f3d8-76d6-4f84-bea7-7cbcce9052ff tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:01.200056 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3cf5f3d8-76d6-4f84-bea7-7cbcce9052ff tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 124d4efd-fa7d-468c-a512-78a550b75c89] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:01.206097 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-db100296-24d5-4eb9-92e1-94a4d0ec05e8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:01.211347 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-db100296-24d5-4eb9-92e1-94a4d0ec05e8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:01.211347 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-db100296-24d5-4eb9-92e1-94a4d0ec05e8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:01.211347 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-db100296-24d5-4eb9-92e1-94a4d0ec05e8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:01.211347 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-db100296-24d5-4eb9-92e1-94a4d0ec05e8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:01.214382 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-db100296-24d5-4eb9-92e1-94a4d0ec05e8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:01.235918 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3cf5f3d8-76d6-4f84-bea7-7cbcce9052ff tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:01.236836 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3cf5f3d8-76d6-4f84-bea7-7cbcce9052ff tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:01.236836 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3cf5f3d8-76d6-4f84-bea7-7cbcce9052ff tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:01.237541 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3cf5f3d8-76d6-4f84-bea7-7cbcce9052ff tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:01.238084 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3cf5f3d8-76d6-4f84-bea7-7cbcce9052ff tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:01.238516 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3cf5f3d8-76d6-4f84-bea7-7cbcce9052ff tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:01.377639 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-db100296-24d5-4eb9-92e1-94a4d0ec05e8 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.198375 Oct 23 01:36:01.379190 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2680/5471] 10.222.0.42 () {58 vars in 1275 bytes} [Sun Oct 23 01:36:01 2022] GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306/os-interface => generated 285 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:36:01.386262 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a750144b-99c8-4a6c-8695-340c6e5f1dd5 tempest-MultipleCreateNegativeTestJSON-1050876951 tempest-MultipleCreateNegativeTestJSON-1050876951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-925172625", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "min_count": 0}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a750144b-99c8-4a6c-8695-340c6e5f1dd5 tempest-MultipleCreateNegativeTestJSON-1050876951 tempest-MultipleCreateNegativeTestJSON-1050876951-project] Request method failure captured: Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 167 Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJqAUwaaWa-oQAog4BPGfsOBX9jYX1cNNsLy9_KZOtjCPKwrTWaLpaxnYwyNsuWS-X3fF-iYDwN1DqLCA9xitPeM8hWMDU721b_Mf9ArOZZI2fFKL18MPpPxrIi_gvDkjxG5PpHm2fH0cwcWav7H8lVBnEW3xzsxRtZXSnJ_w-5l_Yw Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 02f62c0c345c4470b5807a1861dbe2e0 Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1050876951 Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/02f62c0c345c4470b5807a1861dbe2e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_02f62c0c345c4470b5807a1861dbe2e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/02f62c0c345c4470b5807a1861dbe2e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/02f62c0c345c4470b5807a1861dbe2e0"}]}] Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1050876951 Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 02f62c0c345c4470b5807a1861dbe2e0 Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1050876951 Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-MultipleCreateNegativeTestJSON-1050876951-project Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 7ac32dce0cd9402d9480285f1e69c143 Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1050876951-project Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-925172625", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "min_count": 0}} Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-925172625', 'imageRef': '446b40bc-db5b-4123-9278-997bd6d04a0d', 'flavorRef': '452', 'min_count': 0}}} Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise error Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 0 Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 23 01:36:01.396102 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 23 01:36:01.413790 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 23 01:36:01.413790 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 23 01:36:01.413790 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 23 01:36:01.413790 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 23 01:36:01.413790 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 23 01:36:01.413790 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:36:01.413790 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:36:01.413790 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:36:01.413790 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:36:01.413790 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:36:01.413790 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:36:01.413790 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 23 01:36:01.413790 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 23 01:36:01.413790 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 23 01:36:01.413790 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:36:01.413790 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a750144b-99c8-4a6c-8695-340c6e5f1dd5 tempest-MultipleCreateNegativeTestJSON-1050876951 tempest-MultipleCreateNegativeTestJSON-1050876951-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:36:01.413790 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a750144b-99c8-4a6c-8695-340c6e5f1dd5 tempest-MultipleCreateNegativeTestJSON-1050876951 tempest-MultipleCreateNegativeTestJSON-1050876951-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.019022 Oct 23 01:36:01.413790 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2681/5472] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:36:01 2022] POST /compute/v2.1/servers => generated 130 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:36:01.543430 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3cf5f3d8-76d6-4f84-bea7-7cbcce9052ff tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:01.557102 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3cf5f3d8-76d6-4f84-bea7-7cbcce9052ff tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89" status: 200 len: 1314 microversion: 2.1 time: 0.391587 Oct 23 01:36:01.562570 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2792/5473] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:01 2022] GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89 => generated 1314 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:36:01.648177 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d57ad598-3188-4040-8f90-9277a98322ff tempest-MultipleCreateNegativeTestJSON-1050876951 tempest-MultipleCreateNegativeTestJSON-1050876951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1705017947", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "min_count": 2.5}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d57ad598-3188-4040-8f90-9277a98322ff tempest-MultipleCreateNegativeTestJSON-1050876951 tempest-MultipleCreateNegativeTestJSON-1050876951-project] Request method failure captured: Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 170 Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJqAUwaaWa-oQAog4BPGfsOBX9jYX1cNNsLy9_KZOtjCPKwrTWaLpaxnYwyNsuWS-X3fF-iYDwN1DqLCA9xitPeM8hWMDU721b_Mf9ArOZZI2fFKL18MPpPxrIi_gvDkjxG5PpHm2fH0cwcWav7H8lVBnEW3xzsxRtZXSnJ_w-5l_Yw Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 02f62c0c345c4470b5807a1861dbe2e0 Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1050876951 Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/02f62c0c345c4470b5807a1861dbe2e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_02f62c0c345c4470b5807a1861dbe2e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/02f62c0c345c4470b5807a1861dbe2e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/02f62c0c345c4470b5807a1861dbe2e0"}]}] Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1050876951 Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 02f62c0c345c4470b5807a1861dbe2e0 Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1050876951 Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-MultipleCreateNegativeTestJSON-1050876951-project Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 7ac32dce0cd9402d9480285f1e69c143 Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1050876951-project Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1705017947", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "min_count": 2.5}} Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1705017947', 'imageRef': '446b40bc-db5b-4123-9278-997bd6d04a0d', 'flavorRef': '452', 'min_count': 2.5}}} Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise error Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 2.5 Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 23 01:36:01.653287 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 23 01:36:01.659706 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 23 01:36:01.659706 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 23 01:36:01.659706 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 23 01:36:01.659706 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 23 01:36:01.659706 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 23 01:36:01.659706 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:36:01.659706 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:36:01.659706 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:36:01.659706 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:36:01.659706 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:36:01.659706 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:36:01.659706 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 23 01:36:01.659706 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 23 01:36:01.659706 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 23 01:36:01.659706 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:36:01.661590 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d57ad598-3188-4040-8f90-9277a98322ff tempest-MultipleCreateNegativeTestJSON-1050876951 tempest-MultipleCreateNegativeTestJSON-1050876951-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:36:01.662016 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d57ad598-3188-4040-8f90-9277a98322ff tempest-MultipleCreateNegativeTestJSON-1050876951 tempest-MultipleCreateNegativeTestJSON-1050876951-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.019544 Oct 23 01:36:01.674206 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2682/5474] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:36:01 2022] POST /compute/v2.1/servers => generated 139 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:36:02.209396 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e219281d-32e2-43af-bdbf-202f46c23a36 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:02.210183 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e219281d-32e2-43af-bdbf-202f46c23a36 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:02.236430 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e219281d-32e2-43af-bdbf-202f46c23a36 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:02.239496 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e219281d-32e2-43af-bdbf-202f46c23a36 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:02.240855 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e219281d-32e2-43af-bdbf-202f46c23a36 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:02.243304 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e219281d-32e2-43af-bdbf-202f46c23a36 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:02.245400 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e219281d-32e2-43af-bdbf-202f46c23a36 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:02.246118 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e219281d-32e2-43af-bdbf-202f46c23a36 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:02.587832 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-58a4bea5-f22e-4333-8f03-b54817dc3528 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:02.588975 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-58a4bea5-f22e-4333-8f03-b54817dc3528 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 124d4efd-fa7d-468c-a512-78a550b75c89] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:02.604984 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-58a4bea5-f22e-4333-8f03-b54817dc3528 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:02.608526 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-58a4bea5-f22e-4333-8f03-b54817dc3528 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:02.611733 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-58a4bea5-f22e-4333-8f03-b54817dc3528 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:02.613593 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-58a4bea5-f22e-4333-8f03-b54817dc3528 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:02.616328 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-58a4bea5-f22e-4333-8f03-b54817dc3528 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:02.618458 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-58a4bea5-f22e-4333-8f03-b54817dc3528 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:02.657357 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e219281d-32e2-43af-bdbf-202f46c23a36 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:02.671192 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e219281d-32e2-43af-bdbf-202f46c23a36 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1679 microversion: 2.1 time: 0.467185 Oct 23 01:36:02.676864 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2793/5475] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:02 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1679 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:36:03.071915 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-58a4bea5-f22e-4333-8f03-b54817dc3528 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:03.079928 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-58a4bea5-f22e-4333-8f03-b54817dc3528 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89" status: 200 len: 1501 microversion: 2.1 time: 0.498988 Oct 23 01:36:03.080600 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2683/5476] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:02 2022] GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89 => generated 1501 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:36:03.102856 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4635dfcd-0af2-4c93-b90d-3209813cbcd6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:36:03.109864 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4635dfcd-0af2-4c93-b90d-3209813cbcd6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:03.110483 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4635dfcd-0af2-4c93-b90d-3209813cbcd6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:03.111007 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4635dfcd-0af2-4c93-b90d-3209813cbcd6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:03.134650 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4635dfcd-0af2-4c93-b90d-3209813cbcd6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 124d4efd-fa7d-468c-a512-78a550b75c89] Going to try to stop instance {{(pid=120944) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 23 01:36:03.593451 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4635dfcd-0af2-4c93-b90d-3209813cbcd6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "POST /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89/action" status: 202 len: 0 microversion: 2.1 time: 0.494361 Oct 23 01:36:03.600230 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2794/5477] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:36:03 2022] POST /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89/action => generated 0 bytes in 498 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:36:03.610058 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-236b8b8a-8d57-456c-b036-a968d132faba tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:03.611336 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-236b8b8a-8d57-456c-b036-a968d132faba tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 124d4efd-fa7d-468c-a512-78a550b75c89] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:03.624270 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-236b8b8a-8d57-456c-b036-a968d132faba tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:03.627019 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-236b8b8a-8d57-456c-b036-a968d132faba tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:03.627242 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-236b8b8a-8d57-456c-b036-a968d132faba tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:03.628090 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-236b8b8a-8d57-456c-b036-a968d132faba tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:03.628863 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-236b8b8a-8d57-456c-b036-a968d132faba tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:03.635139 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-236b8b8a-8d57-456c-b036-a968d132faba tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:04.067284 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-db932021-c612-49ae-990d-fd9fff02ae99 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:04.068073 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-db932021-c612-49ae-990d-fd9fff02ae99 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:04.081047 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-db932021-c612-49ae-990d-fd9fff02ae99 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:04.081592 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-db932021-c612-49ae-990d-fd9fff02ae99 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:04.082065 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-db932021-c612-49ae-990d-fd9fff02ae99 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:04.082790 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-db932021-c612-49ae-990d-fd9fff02ae99 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:04.087451 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-db932021-c612-49ae-990d-fd9fff02ae99 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:04.087939 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-db932021-c612-49ae-990d-fd9fff02ae99 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:04.227707 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-236b8b8a-8d57-456c-b036-a968d132faba tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:04.256048 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-236b8b8a-8d57-456c-b036-a968d132faba tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89" status: 200 len: 1511 microversion: 2.1 time: 0.639947 Oct 23 01:36:04.256048 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2684/5478] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:03 2022] GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89 => generated 1511 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:36:04.256048 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-e5aa7604-81ee-47a8-8e53-aeebbb7b5312 req-cbb632ff-e656-4521-a5de-aad632f3fccc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e817a84-2969-413e-b36b-96798e94b306", "tag": "534551ee-86d7-4973-bb51-3acbd26169dc"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:36:04.273012 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-e5aa7604-81ee-47a8-8e53-aeebbb7b5312 req-cbb632ff-e656-4521-a5de-aad632f3fccc service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:04.273012 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-e5aa7604-81ee-47a8-8e53-aeebbb7b5312 req-cbb632ff-e656-4521-a5de-aad632f3fccc service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:04.273012 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-e5aa7604-81ee-47a8-8e53-aeebbb7b5312 req-cbb632ff-e656-4521-a5de-aad632f3fccc service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:04.293161 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-e5aa7604-81ee-47a8-8e53-aeebbb7b5312 req-cbb632ff-e656-4521-a5de-aad632f3fccc service nova] Creating event network-changed:534551ee-86d7-4973-bb51-3acbd26169dc for instance 5e817a84-2969-413e-b36b-96798e94b306 on n-h1-master-1 Oct 23 01:36:04.299989 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-e5aa7604-81ee-47a8-8e53-aeebbb7b5312 req-cbb632ff-e656-4521-a5de-aad632f3fccc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055915 Oct 23 01:36:04.300846 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2685/5479] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:36:04.645788 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-db932021-c612-49ae-990d-fd9fff02ae99 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:04.659033 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-db932021-c612-49ae-990d-fd9fff02ae99 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1679 microversion: 2.1 time: 0.965575 Oct 23 01:36:04.679306 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2795/5480] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:03 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1679 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:36:05.273403 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c6b38ff2-a370-4aba-b3cd-b0ceacd3c839 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:05.274440 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c6b38ff2-a370-4aba-b3cd-b0ceacd3c839 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 124d4efd-fa7d-468c-a512-78a550b75c89] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:05.288465 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6b38ff2-a370-4aba-b3cd-b0ceacd3c839 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:05.289114 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6b38ff2-a370-4aba-b3cd-b0ceacd3c839 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:05.293203 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6b38ff2-a370-4aba-b3cd-b0ceacd3c839 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:05.295982 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6b38ff2-a370-4aba-b3cd-b0ceacd3c839 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:05.296711 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6b38ff2-a370-4aba-b3cd-b0ceacd3c839 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:05.298891 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6b38ff2-a370-4aba-b3cd-b0ceacd3c839 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:05.673588 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c6b38ff2-a370-4aba-b3cd-b0ceacd3c839 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:05.673588 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c6b38ff2-a370-4aba-b3cd-b0ceacd3c839 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89" status: 200 len: 1511 microversion: 2.1 time: 0.321188 Oct 23 01:36:05.673588 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2686/5481] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:05 2022] GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89 => generated 1511 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:36:05.690491 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1ac28b53-115b-4e46-a339-502aea01f708 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:05.691867 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1ac28b53-115b-4e46-a339-502aea01f708 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:05.703944 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1ac28b53-115b-4e46-a339-502aea01f708 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:05.706843 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1ac28b53-115b-4e46-a339-502aea01f708 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:05.710915 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1ac28b53-115b-4e46-a339-502aea01f708 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:05.710915 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1ac28b53-115b-4e46-a339-502aea01f708 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:05.710915 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1ac28b53-115b-4e46-a339-502aea01f708 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:05.710915 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1ac28b53-115b-4e46-a339-502aea01f708 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:05.918266 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1ac28b53-115b-4e46-a339-502aea01f708 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:05.930503 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1ac28b53-115b-4e46-a339-502aea01f708 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1679 microversion: 2.1 time: 0.248372 Oct 23 01:36:05.943530 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2796/5482] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:05 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1679 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:36:06.618267 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-de698f67-2ef4-4a7a-9199-0995430db020 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:06.619604 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-de698f67-2ef4-4a7a-9199-0995430db020 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 124d4efd-fa7d-468c-a512-78a550b75c89] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:06.628323 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-de698f67-2ef4-4a7a-9199-0995430db020 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:06.629303 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-de698f67-2ef4-4a7a-9199-0995430db020 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:06.630112 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-de698f67-2ef4-4a7a-9199-0995430db020 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:06.631093 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-de698f67-2ef4-4a7a-9199-0995430db020 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:06.632019 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-de698f67-2ef4-4a7a-9199-0995430db020 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:06.632542 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-de698f67-2ef4-4a7a-9199-0995430db020 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:06.814782 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-de698f67-2ef4-4a7a-9199-0995430db020 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:06.824578 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-de698f67-2ef4-4a7a-9199-0995430db020 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89" status: 200 len: 1511 microversion: 2.1 time: 0.211555 Oct 23 01:36:06.835169 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2687/5483] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:06 2022] GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89 => generated 1511 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:36:06.965945 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cada6089-8f5b-4c49-bd4f-3f363d35f916 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:06.965945 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-cada6089-8f5b-4c49-bd4f-3f363d35f916 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:06.969787 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:06.971630 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cada6089-8f5b-4c49-bd4f-3f363d35f916 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:06.972363 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cada6089-8f5b-4c49-bd4f-3f363d35f916 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:06.973012 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cada6089-8f5b-4c49-bd4f-3f363d35f916 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:06.974672 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cada6089-8f5b-4c49-bd4f-3f363d35f916 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:06.975563 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cada6089-8f5b-4c49-bd4f-3f363d35f916 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:06.976808 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cada6089-8f5b-4c49-bd4f-3f363d35f916 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:07.149216 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cada6089-8f5b-4c49-bd4f-3f363d35f916 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:07.158007 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cada6089-8f5b-4c49-bd4f-3f363d35f916 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1679 microversion: 2.1 time: 0.203350 Oct 23 01:36:07.170615 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2797/5484] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:06 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1679 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:36:07.417876 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-55f672d4-e3ae-49b1-9884-665cee3e5c94 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-979099284", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": "none"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:36:07.513270 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-55f672d4-e3ae-49b1-9884-665cee3e5c94 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:36:07.513570 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-55f672d4-e3ae-49b1-9884-665cee3e5c94 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:36:07.513891 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-55f672d4-e3ae-49b1-9884-665cee3e5c94 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:36:07.514323 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-55f672d4-e3ae-49b1-9884-665cee3e5c94 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:36:07.514918 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-55f672d4-e3ae-49b1-9884-665cee3e5c94 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:36:07.530263 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-55f672d4-e3ae-49b1-9884-665cee3e5c94 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:07.530961 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-55f672d4-e3ae-49b1-9884-665cee3e5c94 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:07.531613 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-55f672d4-e3ae-49b1-9884-665cee3e5c94 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:07.532835 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-55f672d4-e3ae-49b1-9884-665cee3e5c94 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:07.533474 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-55f672d4-e3ae-49b1-9884-665cee3e5c94 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:07.535280 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-55f672d4-e3ae-49b1-9884-665cee3e5c94 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:07.563756 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-55f672d4-e3ae-49b1-9884-665cee3e5c94 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Getting quotas for project b9976c39e9d94256be3fba141c1ebd97. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:36:07.570414 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-55f672d4-e3ae-49b1-9884-665cee3e5c94 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Getting quotas for user 803c776e416a49e3aa689f37bd24740a and project b9976c39e9d94256be3fba141c1ebd97. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:36:07.586113 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-55f672d4-e3ae-49b1-9884-665cee3e5c94 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:36:07.589040 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-55f672d4-e3ae-49b1-9884-665cee3e5c94 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] [instance: d643b34d-8491-45fb-b0b7-44444af0c463] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:36:07.724777 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-55f672d4-e3ae-49b1-9884-665cee3e5c94 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.461049 Oct 23 01:36:07.727212 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2688/5485] 10.222.0.42 () {62 vars in 1188 bytes} [Sun Oct 23 01:36:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 464 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 23 01:36:07.747238 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d3ac6452-eaf8-443d-9d54-d45dd20dc83e tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:07.747887 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d3ac6452-eaf8-443d-9d54-d45dd20dc83e tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] [instance: d643b34d-8491-45fb-b0b7-44444af0c463] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:07.849828 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8033d4dc-e882-4c16-a1ca-c915a25ee1a2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:07.850905 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8033d4dc-e882-4c16-a1ca-c915a25ee1a2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 124d4efd-fa7d-468c-a512-78a550b75c89] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:07.860054 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d3ac6452-eaf8-443d-9d54-d45dd20dc83e tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:07.880880 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d3ac6452-eaf8-443d-9d54-d45dd20dc83e tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:07.882426 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d3ac6452-eaf8-443d-9d54-d45dd20dc83e tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:07.883592 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d3ac6452-eaf8-443d-9d54-d45dd20dc83e tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] 10.222.0.42 "GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463" status: 200 len: 1277 microversion: 2.54 time: 0.140265 Oct 23 01:36:07.896884 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8033d4dc-e882-4c16-a1ca-c915a25ee1a2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:07.898023 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8033d4dc-e882-4c16-a1ca-c915a25ee1a2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:07.898990 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8033d4dc-e882-4c16-a1ca-c915a25ee1a2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:07.899863 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2798/5486] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:36:07 2022] GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463 => generated 1277 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:36:07.900938 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8033d4dc-e882-4c16-a1ca-c915a25ee1a2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:07.901916 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8033d4dc-e882-4c16-a1ca-c915a25ee1a2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:07.902763 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8033d4dc-e882-4c16-a1ca-c915a25ee1a2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:08.084366 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8033d4dc-e882-4c16-a1ca-c915a25ee1a2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:08.095102 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8033d4dc-e882-4c16-a1ca-c915a25ee1a2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89" status: 200 len: 1511 microversion: 2.1 time: 0.249436 Oct 23 01:36:08.095876 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2689/5487] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:07 2022] GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89 => generated 1511 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:36:08.205271 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1e5eb829-7c6e-4438-afa9-48661fb28c13 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:08.205271 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1e5eb829-7c6e-4438-afa9-48661fb28c13 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:08.205271 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1e5eb829-7c6e-4438-afa9-48661fb28c13 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:08.205271 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1e5eb829-7c6e-4438-afa9-48661fb28c13 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:08.205271 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1e5eb829-7c6e-4438-afa9-48661fb28c13 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:08.205271 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1e5eb829-7c6e-4438-afa9-48661fb28c13 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:08.205271 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1e5eb829-7c6e-4438-afa9-48661fb28c13 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:08.205271 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1e5eb829-7c6e-4438-afa9-48661fb28c13 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:08.350904 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1e5eb829-7c6e-4438-afa9-48661fb28c13 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:08.362665 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1e5eb829-7c6e-4438-afa9-48661fb28c13 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1679 microversion: 2.1 time: 0.183370 Oct 23 01:36:08.374335 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2799/5488] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:08 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1679 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:36:08.910092 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-390b28ab-549e-4de1-acae-abe51198ae81 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:08.910765 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-390b28ab-549e-4de1-acae-abe51198ae81 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] [instance: d643b34d-8491-45fb-b0b7-44444af0c463] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:08.941211 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:09.014901 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-390b28ab-549e-4de1-acae-abe51198ae81 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:09.023608 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-390b28ab-549e-4de1-acae-abe51198ae81 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:09.025057 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-390b28ab-549e-4de1-acae-abe51198ae81 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:09.026348 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-390b28ab-549e-4de1-acae-abe51198ae81 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] 10.222.0.42 "GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463" status: 200 len: 1277 microversion: 2.54 time: 0.120405 Oct 23 01:36:09.026810 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2690/5489] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:36:08 2022] GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463 => generated 1277 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:36:09.121543 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-24e30043-c03f-4a4f-b32b-a391fa3dd078 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:09.122213 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-24e30043-c03f-4a4f-b32b-a391fa3dd078 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 124d4efd-fa7d-468c-a512-78a550b75c89] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:09.129458 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-24e30043-c03f-4a4f-b32b-a391fa3dd078 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:09.136398 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-24e30043-c03f-4a4f-b32b-a391fa3dd078 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:09.136398 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-24e30043-c03f-4a4f-b32b-a391fa3dd078 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:09.136398 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-24e30043-c03f-4a4f-b32b-a391fa3dd078 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:09.136398 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-24e30043-c03f-4a4f-b32b-a391fa3dd078 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:09.136398 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-24e30043-c03f-4a4f-b32b-a391fa3dd078 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:09.329846 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-24e30043-c03f-4a4f-b32b-a391fa3dd078 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:09.339729 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-24e30043-c03f-4a4f-b32b-a391fa3dd078 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89" status: 200 len: 1511 microversion: 2.1 time: 0.223531 Oct 23 01:36:09.340927 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2800/5490] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:09 2022] GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89 => generated 1511 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:36:09.387504 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-09230559-2bad-4b29-aa1d-8a2d6af79afe tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:09.388143 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-09230559-2bad-4b29-aa1d-8a2d6af79afe tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:09.407742 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09230559-2bad-4b29-aa1d-8a2d6af79afe tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:09.416308 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09230559-2bad-4b29-aa1d-8a2d6af79afe tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:09.416818 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09230559-2bad-4b29-aa1d-8a2d6af79afe tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:09.417583 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09230559-2bad-4b29-aa1d-8a2d6af79afe tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:09.418096 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09230559-2bad-4b29-aa1d-8a2d6af79afe tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:09.418540 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09230559-2bad-4b29-aa1d-8a2d6af79afe tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:09.734355 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-09230559-2bad-4b29-aa1d-8a2d6af79afe tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:09.748553 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-09230559-2bad-4b29-aa1d-8a2d6af79afe tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1679 microversion: 2.1 time: 0.362426 Oct 23 01:36:09.748553 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2691/5491] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:09 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1679 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:36:10.056809 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7832fa88-2c3e-456a-8bc6-783b2c02b541 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:10.056809 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7832fa88-2c3e-456a-8bc6-783b2c02b541 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] [instance: d643b34d-8491-45fb-b0b7-44444af0c463] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:10.064814 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7832fa88-2c3e-456a-8bc6-783b2c02b541 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:10.066939 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7832fa88-2c3e-456a-8bc6-783b2c02b541 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:10.067627 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7832fa88-2c3e-456a-8bc6-783b2c02b541 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:10.072154 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7832fa88-2c3e-456a-8bc6-783b2c02b541 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:10.072913 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7832fa88-2c3e-456a-8bc6-783b2c02b541 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:10.073631 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7832fa88-2c3e-456a-8bc6-783b2c02b541 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:10.228409 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7832fa88-2c3e-456a-8bc6-783b2c02b541 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:10.236778 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7832fa88-2c3e-456a-8bc6-783b2c02b541 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:10.238707 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7832fa88-2c3e-456a-8bc6-783b2c02b541 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:10.241230 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7832fa88-2c3e-456a-8bc6-783b2c02b541 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] 10.222.0.42 "GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463" status: 200 len: 1273 microversion: 2.54 time: 0.192693 Oct 23 01:36:10.265732 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2801/5492] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:36:10 2022] GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463 => generated 1273 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:36:10.364152 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d8b16938-2c3f-441b-a713-00c99c6ac0b1 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:10.371853 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d8b16938-2c3f-441b-a713-00c99c6ac0b1 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 124d4efd-fa7d-468c-a512-78a550b75c89] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:10.379109 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d8b16938-2c3f-441b-a713-00c99c6ac0b1 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:10.381866 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d8b16938-2c3f-441b-a713-00c99c6ac0b1 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:10.382692 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d8b16938-2c3f-441b-a713-00c99c6ac0b1 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:10.383453 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d8b16938-2c3f-441b-a713-00c99c6ac0b1 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:10.385351 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d8b16938-2c3f-441b-a713-00c99c6ac0b1 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:10.385814 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d8b16938-2c3f-441b-a713-00c99c6ac0b1 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:10.676024 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d8b16938-2c3f-441b-a713-00c99c6ac0b1 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:10.683525 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:10.687689 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d8b16938-2c3f-441b-a713-00c99c6ac0b1 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89" status: 200 len: 1511 microversion: 2.1 time: 0.327748 Oct 23 01:36:10.689218 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2692/5493] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:10 2022] GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89 => generated 1511 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:36:10.772234 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-474f458e-7d6b-4f5a-970c-0ca2b3ef6ce6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:10.774402 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-474f458e-7d6b-4f5a-970c-0ca2b3ef6ce6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:10.786100 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-474f458e-7d6b-4f5a-970c-0ca2b3ef6ce6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:10.787145 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-474f458e-7d6b-4f5a-970c-0ca2b3ef6ce6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:10.788047 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-474f458e-7d6b-4f5a-970c-0ca2b3ef6ce6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:10.789031 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-474f458e-7d6b-4f5a-970c-0ca2b3ef6ce6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:10.790720 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-474f458e-7d6b-4f5a-970c-0ca2b3ef6ce6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:10.791387 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-474f458e-7d6b-4f5a-970c-0ca2b3ef6ce6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:11.031998 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-474f458e-7d6b-4f5a-970c-0ca2b3ef6ce6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:11.055584 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-474f458e-7d6b-4f5a-970c-0ca2b3ef6ce6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1656 microversion: 2.1 time: 0.287889 Oct 23 01:36:11.062032 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2802/5494] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:10 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1656 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:36:11.085265 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2fa6ee08-c089-4a5f-9827-1ccc0bf3ef18 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:36:11.096362 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2fa6ee08-c089-4a5f-9827-1ccc0bf3ef18 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:11.096470 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2fa6ee08-c089-4a5f-9827-1ccc0bf3ef18 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:11.096952 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2fa6ee08-c089-4a5f-9827-1ccc0bf3ef18 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:11.133272 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2fa6ee08-c089-4a5f-9827-1ccc0bf3ef18 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Going to try to start instance {{(pid=120945) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 23 01:36:11.281381 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-938079ab-f512-4b68-80c7-4674ba24a9ad tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:11.282559 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-938079ab-f512-4b68-80c7-4674ba24a9ad tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] [instance: d643b34d-8491-45fb-b0b7-44444af0c463] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:11.295962 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-938079ab-f512-4b68-80c7-4674ba24a9ad tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:11.300096 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-938079ab-f512-4b68-80c7-4674ba24a9ad tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:11.300697 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-938079ab-f512-4b68-80c7-4674ba24a9ad tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:11.307031 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-938079ab-f512-4b68-80c7-4674ba24a9ad tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:11.308465 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-938079ab-f512-4b68-80c7-4674ba24a9ad tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:11.309205 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-938079ab-f512-4b68-80c7-4674ba24a9ad tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:11.340713 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2fa6ee08-c089-4a5f-9827-1ccc0bf3ef18 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "POST /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98/action" status: 202 len: 0 microversion: 2.1 time: 0.260936 Oct 23 01:36:11.353488 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2693/5495] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:36:11 2022] POST /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:36:11.361863 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8167dd81-38a4-42f3-b555-d3c106f276ed tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:11.362620 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8167dd81-38a4-42f3-b555-d3c106f276ed tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:11.378817 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8167dd81-38a4-42f3-b555-d3c106f276ed tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:11.382191 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8167dd81-38a4-42f3-b555-d3c106f276ed tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:11.382191 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8167dd81-38a4-42f3-b555-d3c106f276ed tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:11.383333 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8167dd81-38a4-42f3-b555-d3c106f276ed tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:11.383982 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8167dd81-38a4-42f3-b555-d3c106f276ed tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:11.384603 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8167dd81-38a4-42f3-b555-d3c106f276ed tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:11.444469 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-938079ab-f512-4b68-80c7-4674ba24a9ad tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:11.455501 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-938079ab-f512-4b68-80c7-4674ba24a9ad tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:11.475261 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-938079ab-f512-4b68-80c7-4674ba24a9ad tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:11.476911 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-938079ab-f512-4b68-80c7-4674ba24a9ad tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] 10.222.0.42 "GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463" status: 200 len: 1337 microversion: 2.54 time: 0.199339 Oct 23 01:36:11.494531 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2803/5496] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:36:11 2022] GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463 => generated 1337 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:36:11.684701 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8167dd81-38a4-42f3-b555-d3c106f276ed tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:11.697485 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8167dd81-38a4-42f3-b555-d3c106f276ed tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1665 microversion: 2.1 time: 0.340669 Oct 23 01:36:11.698108 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2694/5497] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:11 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1665 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:36:11.715658 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-00657f8a-6051-4fb4-a275-0c40faebab34 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:11.716451 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-00657f8a-6051-4fb4-a275-0c40faebab34 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 124d4efd-fa7d-468c-a512-78a550b75c89] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:11.733042 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-00657f8a-6051-4fb4-a275-0c40faebab34 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:11.737494 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-00657f8a-6051-4fb4-a275-0c40faebab34 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:11.737494 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-00657f8a-6051-4fb4-a275-0c40faebab34 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:11.737494 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-00657f8a-6051-4fb4-a275-0c40faebab34 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:11.737494 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-00657f8a-6051-4fb4-a275-0c40faebab34 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:11.737494 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-00657f8a-6051-4fb4-a275-0c40faebab34 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:12.261568 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-00657f8a-6051-4fb4-a275-0c40faebab34 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:12.271812 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-00657f8a-6051-4fb4-a275-0c40faebab34 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89" status: 200 len: 1511 microversion: 2.1 time: 0.560167 Oct 23 01:36:12.296586 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2804/5498] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:11 2022] GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89 => generated 1511 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:36:12.508920 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f964145d-ceb4-4cfc-82bc-1bed48a4e6c9 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:12.510358 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f964145d-ceb4-4cfc-82bc-1bed48a4e6c9 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] [instance: d643b34d-8491-45fb-b0b7-44444af0c463] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:12.520225 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f964145d-ceb4-4cfc-82bc-1bed48a4e6c9 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:12.522461 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f964145d-ceb4-4cfc-82bc-1bed48a4e6c9 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:12.522461 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f964145d-ceb4-4cfc-82bc-1bed48a4e6c9 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:12.522461 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f964145d-ceb4-4cfc-82bc-1bed48a4e6c9 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:12.523148 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f964145d-ceb4-4cfc-82bc-1bed48a4e6c9 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:12.523941 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f964145d-ceb4-4cfc-82bc-1bed48a4e6c9 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:12.644318 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f964145d-ceb4-4cfc-82bc-1bed48a4e6c9 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:12.656935 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f964145d-ceb4-4cfc-82bc-1bed48a4e6c9 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:12.659131 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f964145d-ceb4-4cfc-82bc-1bed48a4e6c9 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:12.660797 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f964145d-ceb4-4cfc-82bc-1bed48a4e6c9 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] 10.222.0.42 "GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463" status: 200 len: 1335 microversion: 2.54 time: 0.155989 Oct 23 01:36:12.663450 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2695/5499] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:36:12 2022] GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463 => generated 1335 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:36:12.723147 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fe6ca122-28b2-4c5a-9ace-ed6086644226 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:12.723708 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fe6ca122-28b2-4c5a-9ace-ed6086644226 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:12.731495 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe6ca122-28b2-4c5a-9ace-ed6086644226 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:12.732504 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe6ca122-28b2-4c5a-9ace-ed6086644226 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:12.733178 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe6ca122-28b2-4c5a-9ace-ed6086644226 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:12.734192 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe6ca122-28b2-4c5a-9ace-ed6086644226 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:12.734857 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe6ca122-28b2-4c5a-9ace-ed6086644226 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:12.735358 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe6ca122-28b2-4c5a-9ace-ed6086644226 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:13.141953 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fe6ca122-28b2-4c5a-9ace-ed6086644226 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:13.151902 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fe6ca122-28b2-4c5a-9ace-ed6086644226 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1665 microversion: 2.1 time: 0.432939 Oct 23 01:36:13.152511 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2805/5500] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:12 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1665 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:36:13.297369 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-dc1323f1-7f4e-4dc3-ab60-8b17abbb60f3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:13.298002 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-dc1323f1-7f4e-4dc3-ab60-8b17abbb60f3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 124d4efd-fa7d-468c-a512-78a550b75c89] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:13.304614 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dc1323f1-7f4e-4dc3-ab60-8b17abbb60f3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:13.305105 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dc1323f1-7f4e-4dc3-ab60-8b17abbb60f3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:13.305688 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dc1323f1-7f4e-4dc3-ab60-8b17abbb60f3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:13.306424 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dc1323f1-7f4e-4dc3-ab60-8b17abbb60f3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:13.306912 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dc1323f1-7f4e-4dc3-ab60-8b17abbb60f3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:13.318342 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dc1323f1-7f4e-4dc3-ab60-8b17abbb60f3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:13.590676 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-dc1323f1-7f4e-4dc3-ab60-8b17abbb60f3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:13.596957 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-dc1323f1-7f4e-4dc3-ab60-8b17abbb60f3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89" status: 200 len: 1511 microversion: 2.1 time: 0.304008 Oct 23 01:36:13.597673 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2696/5501] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:13 2022] GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89 => generated 1511 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:36:13.697833 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7e72803c-c396-4aef-b588-899085821411 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:13.700034 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7e72803c-c396-4aef-b588-899085821411 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] [instance: d643b34d-8491-45fb-b0b7-44444af0c463] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:13.744685 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e72803c-c396-4aef-b588-899085821411 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:13.746611 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e72803c-c396-4aef-b588-899085821411 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:13.747118 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e72803c-c396-4aef-b588-899085821411 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:13.747866 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e72803c-c396-4aef-b588-899085821411 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:13.748359 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e72803c-c396-4aef-b588-899085821411 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:13.748792 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e72803c-c396-4aef-b588-899085821411 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:13.834118 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7e72803c-c396-4aef-b588-899085821411 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:13.843820 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7e72803c-c396-4aef-b588-899085821411 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:13.845294 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7e72803c-c396-4aef-b588-899085821411 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:13.846608 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7e72803c-c396-4aef-b588-899085821411 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] 10.222.0.42 "GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463" status: 200 len: 1335 microversion: 2.54 time: 0.157900 Oct 23 01:36:13.847180 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2806/5502] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:36:13 2022] GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463 => generated 1335 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:36:14.177830 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ddb16006-4dc4-4686-961e-7fb92bd8ec93 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:14.178778 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ddb16006-4dc4-4686-961e-7fb92bd8ec93 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:14.198772 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ddb16006-4dc4-4686-961e-7fb92bd8ec93 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:14.198772 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ddb16006-4dc4-4686-961e-7fb92bd8ec93 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:14.198772 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ddb16006-4dc4-4686-961e-7fb92bd8ec93 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:14.198772 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ddb16006-4dc4-4686-961e-7fb92bd8ec93 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:14.198772 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ddb16006-4dc4-4686-961e-7fb92bd8ec93 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:14.198772 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ddb16006-4dc4-4686-961e-7fb92bd8ec93 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:14.395921 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ddb16006-4dc4-4686-961e-7fb92bd8ec93 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:14.405374 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ddb16006-4dc4-4686-961e-7fb92bd8ec93 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1669 microversion: 2.1 time: 0.232865 Oct 23 01:36:14.418550 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2697/5503] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:14 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1669 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:36:14.429733 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5f4de47c-dadf-4df3-bd12-b4302d73eeab tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:14.435632 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5f4de47c-dadf-4df3-bd12-b4302d73eeab tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:14.457943 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f4de47c-dadf-4df3-bd12-b4302d73eeab tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:14.458491 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f4de47c-dadf-4df3-bd12-b4302d73eeab tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:14.458948 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f4de47c-dadf-4df3-bd12-b4302d73eeab tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:14.459665 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f4de47c-dadf-4df3-bd12-b4302d73eeab tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:14.465647 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f4de47c-dadf-4df3-bd12-b4302d73eeab tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:14.472392 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f4de47c-dadf-4df3-bd12-b4302d73eeab tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:14.621069 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b004c517-d6a3-430a-9282-bad474c1865a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:14.621922 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b004c517-d6a3-430a-9282-bad474c1865a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 124d4efd-fa7d-468c-a512-78a550b75c89] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:14.632753 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b004c517-d6a3-430a-9282-bad474c1865a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:14.633614 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b004c517-d6a3-430a-9282-bad474c1865a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:14.634941 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b004c517-d6a3-430a-9282-bad474c1865a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:14.636791 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b004c517-d6a3-430a-9282-bad474c1865a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:14.637598 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b004c517-d6a3-430a-9282-bad474c1865a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:14.638425 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b004c517-d6a3-430a-9282-bad474c1865a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:14.686342 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5f4de47c-dadf-4df3-bd12-b4302d73eeab tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:14.706498 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5f4de47c-dadf-4df3-bd12-b4302d73eeab tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1669 microversion: 2.1 time: 0.277512 Oct 23 01:36:14.730090 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2807/5504] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:14 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1669 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:36:14.743704 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-99100bb6-6391-4599-acc9-f0aab9a009b8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:36:14.745497 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-99100bb6-6391-4599-acc9-f0aab9a009b8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:14.761090 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-99100bb6-6391-4599-acc9-f0aab9a009b8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:14.764442 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-99100bb6-6391-4599-acc9-f0aab9a009b8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:14.767528 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-99100bb6-6391-4599-acc9-f0aab9a009b8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:14.768294 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-99100bb6-6391-4599-acc9-f0aab9a009b8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:14.771171 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-99100bb6-6391-4599-acc9-f0aab9a009b8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:14.772342 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-99100bb6-6391-4599-acc9-f0aab9a009b8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:14.785427 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:14.868658 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b004c517-d6a3-430a-9282-bad474c1865a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:14.876943 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b004c517-d6a3-430a-9282-bad474c1865a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89" status: 200 len: 1511 microversion: 2.1 time: 0.260122 Oct 23 01:36:14.877965 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2698/5505] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:14 2022] GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89 => generated 1511 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:36:14.882839 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2684488b-9190-496c-aa23-c5d26679381e tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:14.883459 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2684488b-9190-496c-aa23-c5d26679381e tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] [instance: d643b34d-8491-45fb-b0b7-44444af0c463] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:14.889745 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2684488b-9190-496c-aa23-c5d26679381e tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:14.890266 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2684488b-9190-496c-aa23-c5d26679381e tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:14.890705 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2684488b-9190-496c-aa23-c5d26679381e tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:14.891392 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2684488b-9190-496c-aa23-c5d26679381e tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:14.892041 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2684488b-9190-496c-aa23-c5d26679381e tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:14.892466 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2684488b-9190-496c-aa23-c5d26679381e tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:14.974681 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2684488b-9190-496c-aa23-c5d26679381e tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:14.985596 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2684488b-9190-496c-aa23-c5d26679381e tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:14.987699 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2684488b-9190-496c-aa23-c5d26679381e tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:14.989098 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2684488b-9190-496c-aa23-c5d26679381e tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] 10.222.0.42 "GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463" status: 200 len: 1356 microversion: 2.54 time: 0.110039 Oct 23 01:36:14.994112 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2699/5506] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:36:14 2022] GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463 => generated 1356 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:36:15.017325 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-eab1700d-918e-4821-bdbb-231f10e0c82f tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Action: 'create', calling method: .version_select at 0x7f5cc248e5e0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1425002763", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGswviN9aAfGYvbICPuW98ZY2FcHGIBZwtKwo4XE0w8yDeqBQrOvMXutaSJRbP63yWO6ltaHMO0E5daowNXVNYZ71AbAdXMQgg3QWqLEJbTJHTk5nKMMOXYGOb/aNRcGMg=="}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:36:15.021758 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-99100bb6-6391-4599-acc9-f0aab9a009b8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Unlocking {{(pid=120944) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 23 01:36:15.033507 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-eab1700d-918e-4821-bdbb-231f10e0c82f tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Getting quotas for project b9976c39e9d94256be3fba141c1ebd97. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:36:15.038944 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-eab1700d-918e-4821-bdbb-231f10e0c82f tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Getting quotas for user 803c776e416a49e3aa689f37bd24740a and project b9976c39e9d94256be3fba141c1ebd97. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:36:15.143569 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-eab1700d-918e-4821-bdbb-231f10e0c82f tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.129441 Oct 23 01:36:15.152103 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2700/5507] 10.222.0.42 () {62 vars in 1200 bytes} [Sun Oct 23 01:36:15 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 139 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 23 01:36:15.158836 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5fc11983-d45b-4f5d-a036-05608a820f61 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1425002763", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:36:15.161713 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5fc11983-d45b-4f5d-a036-05608a820f61 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] [instance: d643b34d-8491-45fb-b0b7-44444af0c463] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:15.169944 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5fc11983-d45b-4f5d-a036-05608a820f61 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:15.170451 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5fc11983-d45b-4f5d-a036-05608a820f61 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:15.170876 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5fc11983-d45b-4f5d-a036-05608a820f61 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:15.174054 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5fc11983-d45b-4f5d-a036-05608a820f61 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:15.174054 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5fc11983-d45b-4f5d-a036-05608a820f61 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:15.174054 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5fc11983-d45b-4f5d-a036-05608a820f61 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:15.256925 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-99100bb6-6391-4599-acc9-f0aab9a009b8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "POST /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98/action" status: 202 len: 0 microversion: 2.1 time: 0.525324 Oct 23 01:36:15.257650 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2808/5508] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:36:14 2022] POST /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98/action => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:36:15.261394 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-5fc11983-d45b-4f5d-a036-05608a820f61 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:36:15.262288 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-5fc11983-d45b-4f5d-a036-05608a820f61 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:36:15.262968 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-5fc11983-d45b-4f5d-a036-05608a820f61 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:36:15.266012 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-5fc11983-d45b-4f5d-a036-05608a820f61 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:36:15.266012 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-5fc11983-d45b-4f5d-a036-05608a820f61 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:36:15.271560 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9680ae1b-b8d8-45e4-b88a-d358f15d77ac tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:15.272461 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9680ae1b-b8d8-45e4-b88a-d358f15d77ac tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:15.279744 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9680ae1b-b8d8-45e4-b88a-d358f15d77ac tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:15.280662 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9680ae1b-b8d8-45e4-b88a-d358f15d77ac tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:15.281624 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9680ae1b-b8d8-45e4-b88a-d358f15d77ac tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:15.282843 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9680ae1b-b8d8-45e4-b88a-d358f15d77ac tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:15.283523 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9680ae1b-b8d8-45e4-b88a-d358f15d77ac tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:15.284349 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9680ae1b-b8d8-45e4-b88a-d358f15d77ac tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:15.434111 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9680ae1b-b8d8-45e4-b88a-d358f15d77ac tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:15.440785 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9680ae1b-b8d8-45e4-b88a-d358f15d77ac tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1669 microversion: 2.1 time: 0.173072 Oct 23 01:36:15.441423 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2809/5509] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:15 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1669 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:36:15.463683 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5c2c5ed0-8ede-4e4b-b3e4-d0cf93cd9410 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:15.464316 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5c2c5ed0-8ede-4e4b-b3e4-d0cf93cd9410 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:15.471543 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5c2c5ed0-8ede-4e4b-b3e4-d0cf93cd9410 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:15.472473 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5c2c5ed0-8ede-4e4b-b3e4-d0cf93cd9410 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:15.473103 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5c2c5ed0-8ede-4e4b-b3e4-d0cf93cd9410 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:15.474046 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5c2c5ed0-8ede-4e4b-b3e4-d0cf93cd9410 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:15.474706 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5c2c5ed0-8ede-4e4b-b3e4-d0cf93cd9410 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:15.475315 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5c2c5ed0-8ede-4e4b-b3e4-d0cf93cd9410 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:15.605674 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5fc11983-d45b-4f5d-a036-05608a820f61 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] [instance: d643b34d-8491-45fb-b0b7-44444af0c463] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:15.626338 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5fc11983-d45b-4f5d-a036-05608a820f61 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:15.627484 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5fc11983-d45b-4f5d-a036-05608a820f61 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:15.628098 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5fc11983-d45b-4f5d-a036-05608a820f61 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:15.629017 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5fc11983-d45b-4f5d-a036-05608a820f61 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:15.629714 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5fc11983-d45b-4f5d-a036-05608a820f61 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:15.630340 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5fc11983-d45b-4f5d-a036-05608a820f61 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:15.632216 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5c2c5ed0-8ede-4e4b-b3e4-d0cf93cd9410 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:15.642260 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5c2c5ed0-8ede-4e4b-b3e4-d0cf93cd9410 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1669 microversion: 2.1 time: 0.182470 Oct 23 01:36:15.643487 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2810/5510] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:15 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1669 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:36:15.667152 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8c27ac76-bc83-4964-8362-f77873434483 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:15.668089 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8c27ac76-bc83-4964-8362-f77873434483 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:15.674906 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5fc11983-d45b-4f5d-a036-05608a820f61 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] 10.222.0.42 "POST /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463/action" status: 202 len: 1139 microversion: 2.54 time: 0.521343 Oct 23 01:36:15.675287 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c27ac76-bc83-4964-8362-f77873434483 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:15.675784 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c27ac76-bc83-4964-8362-f77873434483 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:15.676442 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c27ac76-bc83-4964-8362-f77873434483 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:15.677398 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c27ac76-bc83-4964-8362-f77873434483 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:15.678257 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c27ac76-bc83-4964-8362-f77873434483 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:15.678867 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8c27ac76-bc83-4964-8362-f77873434483 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:15.682453 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2701/5511] 10.222.0.42 () {62 vars in 1320 bytes} [Sun Oct 23 01:36:15 2022] POST /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463/action => generated 1139 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 23 01:36:15.697769 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-48c1c4ea-688d-45d5-b8b2-fd127b031c29 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:15.698686 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-48c1c4ea-688d-45d5-b8b2-fd127b031c29 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] [instance: d643b34d-8491-45fb-b0b7-44444af0c463] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:15.704929 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-48c1c4ea-688d-45d5-b8b2-fd127b031c29 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:15.705407 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-48c1c4ea-688d-45d5-b8b2-fd127b031c29 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:15.710933 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-48c1c4ea-688d-45d5-b8b2-fd127b031c29 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:15.710933 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-48c1c4ea-688d-45d5-b8b2-fd127b031c29 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:15.710933 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-48c1c4ea-688d-45d5-b8b2-fd127b031c29 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:15.710933 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-48c1c4ea-688d-45d5-b8b2-fd127b031c29 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:15.786704 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-48c1c4ea-688d-45d5-b8b2-fd127b031c29 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:15.803259 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-48c1c4ea-688d-45d5-b8b2-fd127b031c29 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:15.805138 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-48c1c4ea-688d-45d5-b8b2-fd127b031c29 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:15.806915 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-48c1c4ea-688d-45d5-b8b2-fd127b031c29 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] 10.222.0.42 "GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463" status: 200 len: 1408 microversion: 2.54 time: 0.112987 Oct 23 01:36:15.807650 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2702/5512] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:36:15 2022] GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463 => generated 1408 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:36:15.860892 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8c27ac76-bc83-4964-8362-f77873434483 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:15.868618 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8c27ac76-bc83-4964-8362-f77873434483 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1669 microversion: 2.1 time: 0.205564 Oct 23 01:36:15.869197 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2811/5513] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:15 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1669 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:36:15.892176 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6c306386-2b5c-4c5c-a2e2-ceb6e0edb1a4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:36:15.892713 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6c306386-2b5c-4c5c-a2e2-ceb6e0edb1a4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:15.899155 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6c306386-2b5c-4c5c-a2e2-ceb6e0edb1a4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:15.899801 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6c306386-2b5c-4c5c-a2e2-ceb6e0edb1a4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:15.899801 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6c306386-2b5c-4c5c-a2e2-ceb6e0edb1a4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:15.901128 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-54fef356-fddc-4dcb-bbeb-7e2b4f9fb879 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:15.901751 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-54fef356-fddc-4dcb-bbeb-7e2b4f9fb879 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 124d4efd-fa7d-468c-a512-78a550b75c89] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:15.908461 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6c306386-2b5c-4c5c-a2e2-ceb6e0edb1a4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:15.908769 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-54fef356-fddc-4dcb-bbeb-7e2b4f9fb879 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:15.914553 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-54fef356-fddc-4dcb-bbeb-7e2b4f9fb879 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:15.914553 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-54fef356-fddc-4dcb-bbeb-7e2b4f9fb879 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:15.914950 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6c306386-2b5c-4c5c-a2e2-ceb6e0edb1a4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:15.915168 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-54fef356-fddc-4dcb-bbeb-7e2b4f9fb879 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:15.915274 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6c306386-2b5c-4c5c-a2e2-ceb6e0edb1a4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:15.915392 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-54fef356-fddc-4dcb-bbeb-7e2b4f9fb879 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:15.915392 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-54fef356-fddc-4dcb-bbeb-7e2b4f9fb879 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:16.193167 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-54fef356-fddc-4dcb-bbeb-7e2b4f9fb879 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:16.203521 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-54fef356-fddc-4dcb-bbeb-7e2b4f9fb879 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89" status: 200 len: 1511 microversion: 2.1 time: 0.306789 Oct 23 01:36:16.204211 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2812/5514] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:15 2022] GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89 => generated 1511 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:36:16.234040 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6c306386-2b5c-4c5c-a2e2-ceb6e0edb1a4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "POST /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98/action" status: 202 len: 0 microversion: 2.1 time: 0.346149 Oct 23 01:36:16.235117 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2703/5515] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:36:15 2022] POST /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98/action => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 23 01:36:16.257601 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bafb5b65-740b-45b2-a24c-fdf4156bff66 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:16.258382 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bafb5b65-740b-45b2-a24c-fdf4156bff66 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:16.266675 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bafb5b65-740b-45b2-a24c-fdf4156bff66 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:16.267529 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bafb5b65-740b-45b2-a24c-fdf4156bff66 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:16.268402 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bafb5b65-740b-45b2-a24c-fdf4156bff66 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:16.269340 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bafb5b65-740b-45b2-a24c-fdf4156bff66 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:16.270411 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bafb5b65-740b-45b2-a24c-fdf4156bff66 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:16.271058 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bafb5b65-740b-45b2-a24c-fdf4156bff66 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:16.532534 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bafb5b65-740b-45b2-a24c-fdf4156bff66 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:16.545313 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bafb5b65-740b-45b2-a24c-fdf4156bff66 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1674 microversion: 2.1 time: 0.298849 Oct 23 01:36:16.545907 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2813/5516] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:16 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1674 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:36:16.834036 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5f6773b4-13d0-45c2-a243-7eec5972a914 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:16.834864 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5f6773b4-13d0-45c2-a243-7eec5972a914 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] [instance: d643b34d-8491-45fb-b0b7-44444af0c463] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:16.843299 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5f6773b4-13d0-45c2-a243-7eec5972a914 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:16.844017 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5f6773b4-13d0-45c2-a243-7eec5972a914 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:16.844556 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5f6773b4-13d0-45c2-a243-7eec5972a914 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:16.845335 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5f6773b4-13d0-45c2-a243-7eec5972a914 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:16.845800 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5f6773b4-13d0-45c2-a243-7eec5972a914 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:16.846255 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5f6773b4-13d0-45c2-a243-7eec5972a914 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:16.925864 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5f6773b4-13d0-45c2-a243-7eec5972a914 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:16.939275 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5f6773b4-13d0-45c2-a243-7eec5972a914 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:16.940981 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5f6773b4-13d0-45c2-a243-7eec5972a914 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:16.943654 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5f6773b4-13d0-45c2-a243-7eec5972a914 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] 10.222.0.42 "GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463" status: 200 len: 1408 microversion: 2.54 time: 0.114208 Oct 23 01:36:16.944703 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2704/5517] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:36:16 2022] GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463 => generated 1408 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:36:17.227753 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a321e6f3-05e1-46a0-bc94-23c71da0c445 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:17.228987 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a321e6f3-05e1-46a0-bc94-23c71da0c445 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 124d4efd-fa7d-468c-a512-78a550b75c89] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:17.236566 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a321e6f3-05e1-46a0-bc94-23c71da0c445 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:17.237128 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a321e6f3-05e1-46a0-bc94-23c71da0c445 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:17.237645 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a321e6f3-05e1-46a0-bc94-23c71da0c445 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:17.238451 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a321e6f3-05e1-46a0-bc94-23c71da0c445 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:17.238978 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a321e6f3-05e1-46a0-bc94-23c71da0c445 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:17.239495 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a321e6f3-05e1-46a0-bc94-23c71da0c445 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:17.387521 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a321e6f3-05e1-46a0-bc94-23c71da0c445 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:17.395276 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a321e6f3-05e1-46a0-bc94-23c71da0c445 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89" status: 200 len: 1511 microversion: 2.1 time: 0.171734 Oct 23 01:36:17.396715 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2814/5518] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:17 2022] GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89 => generated 1511 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:36:17.578055 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-45a5b2df-efc6-4008-bebb-07f79cdcb432 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:17.579022 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-45a5b2df-efc6-4008-bebb-07f79cdcb432 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:17.582385 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:17.589821 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-45a5b2df-efc6-4008-bebb-07f79cdcb432 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:17.590474 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-45a5b2df-efc6-4008-bebb-07f79cdcb432 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:17.591633 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-45a5b2df-efc6-4008-bebb-07f79cdcb432 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:17.592442 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-45a5b2df-efc6-4008-bebb-07f79cdcb432 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:17.593558 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-45a5b2df-efc6-4008-bebb-07f79cdcb432 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:17.594159 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-45a5b2df-efc6-4008-bebb-07f79cdcb432 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:17.831375 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-45a5b2df-efc6-4008-bebb-07f79cdcb432 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:17.848701 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-45a5b2df-efc6-4008-bebb-07f79cdcb432 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1654 microversion: 2.1 time: 0.278539 Oct 23 01:36:17.850092 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2705/5519] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:17 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1654 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:36:17.883327 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2e8adc3f-c493-427b-8961-a9f197b4c1d2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:36:17.884364 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2e8adc3f-c493-427b-8961-a9f197b4c1d2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:17.886809 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:17.894135 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e8adc3f-c493-427b-8961-a9f197b4c1d2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:17.894712 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e8adc3f-c493-427b-8961-a9f197b4c1d2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:17.895224 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e8adc3f-c493-427b-8961-a9f197b4c1d2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:17.896319 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e8adc3f-c493-427b-8961-a9f197b4c1d2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:17.896883 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e8adc3f-c493-427b-8961-a9f197b4c1d2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:17.897402 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e8adc3f-c493-427b-8961-a9f197b4c1d2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:17.971781 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0213ad70-89e8-413c-9ceb-91125f31c802 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:17.972928 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0213ad70-89e8-413c-9ceb-91125f31c802 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] [instance: d643b34d-8491-45fb-b0b7-44444af0c463] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:17.984777 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0213ad70-89e8-413c-9ceb-91125f31c802 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:17.985860 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0213ad70-89e8-413c-9ceb-91125f31c802 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:17.986341 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0213ad70-89e8-413c-9ceb-91125f31c802 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:17.987352 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0213ad70-89e8-413c-9ceb-91125f31c802 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:17.987741 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0213ad70-89e8-413c-9ceb-91125f31c802 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:17.988349 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0213ad70-89e8-413c-9ceb-91125f31c802 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:18.010490 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:18.094175 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2e8adc3f-c493-427b-8961-a9f197b4c1d2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "POST /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98/action" status: 202 len: 0 microversion: 2.1 time: 0.222035 Oct 23 01:36:18.097141 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2815/5520] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:36:17 2022] POST /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:36:18.111740 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a7581d2b-298c-4efa-b114-f467914c566f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:18.113826 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a7581d2b-298c-4efa-b114-f467914c566f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:18.121025 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a7581d2b-298c-4efa-b114-f467914c566f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:18.121526 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a7581d2b-298c-4efa-b114-f467914c566f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:18.121964 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a7581d2b-298c-4efa-b114-f467914c566f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:18.123235 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a7581d2b-298c-4efa-b114-f467914c566f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:18.123700 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a7581d2b-298c-4efa-b114-f467914c566f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:18.124129 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a7581d2b-298c-4efa-b114-f467914c566f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:18.140004 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0213ad70-89e8-413c-9ceb-91125f31c802 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:18.160076 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0213ad70-89e8-413c-9ceb-91125f31c802 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:18.165440 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0213ad70-89e8-413c-9ceb-91125f31c802 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:18.167762 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0213ad70-89e8-413c-9ceb-91125f31c802 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] 10.222.0.42 "GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463" status: 200 len: 1408 microversion: 2.54 time: 0.200039 Oct 23 01:36:18.169197 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2706/5521] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:36:17 2022] GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463 => generated 1408 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:36:18.415040 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a7581d2b-298c-4efa-b114-f467914c566f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:18.418626 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d259b57d-6f1f-4176-a9d8-51a648814da6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:18.419523 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d259b57d-6f1f-4176-a9d8-51a648814da6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 124d4efd-fa7d-468c-a512-78a550b75c89] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:18.427498 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a7581d2b-298c-4efa-b114-f467914c566f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1661 microversion: 2.1 time: 0.323022 Oct 23 01:36:18.431401 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d259b57d-6f1f-4176-a9d8-51a648814da6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:18.432131 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d259b57d-6f1f-4176-a9d8-51a648814da6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:18.432811 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d259b57d-6f1f-4176-a9d8-51a648814da6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:18.433864 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d259b57d-6f1f-4176-a9d8-51a648814da6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:18.434515 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d259b57d-6f1f-4176-a9d8-51a648814da6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:18.435645 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d259b57d-6f1f-4176-a9d8-51a648814da6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:18.445865 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2816/5522] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:18 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1661 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:36:18.659238 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d259b57d-6f1f-4176-a9d8-51a648814da6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:18.667339 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d259b57d-6f1f-4176-a9d8-51a648814da6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89" status: 200 len: 1511 microversion: 2.1 time: 0.252572 Oct 23 01:36:18.668312 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2707/5523] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:18 2022] GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89 => generated 1511 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:36:19.196229 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7d5e12ca-07d2-4da6-bd25-d3243da91035 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:19.196855 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7d5e12ca-07d2-4da6-bd25-d3243da91035 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] [instance: d643b34d-8491-45fb-b0b7-44444af0c463] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:19.204478 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d5e12ca-07d2-4da6-bd25-d3243da91035 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:19.205216 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d5e12ca-07d2-4da6-bd25-d3243da91035 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:19.205862 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d5e12ca-07d2-4da6-bd25-d3243da91035 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:19.206602 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d5e12ca-07d2-4da6-bd25-d3243da91035 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:19.209315 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d5e12ca-07d2-4da6-bd25-d3243da91035 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:19.209315 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d5e12ca-07d2-4da6-bd25-d3243da91035 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:19.456763 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f1b3080d-0282-491b-b50d-452143676c35 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:19.458076 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f1b3080d-0282-491b-b50d-452143676c35 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:19.465304 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f1b3080d-0282-491b-b50d-452143676c35 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:19.466739 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f1b3080d-0282-491b-b50d-452143676c35 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:19.472179 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f1b3080d-0282-491b-b50d-452143676c35 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:19.472179 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f1b3080d-0282-491b-b50d-452143676c35 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:19.472179 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f1b3080d-0282-491b-b50d-452143676c35 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:19.472179 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f1b3080d-0282-491b-b50d-452143676c35 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:19.715286 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7d5e12ca-07d2-4da6-bd25-d3243da91035 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:19.725859 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7d5e12ca-07d2-4da6-bd25-d3243da91035 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:19.727405 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7d5e12ca-07d2-4da6-bd25-d3243da91035 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:19.728594 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7d5e12ca-07d2-4da6-bd25-d3243da91035 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] 10.222.0.42 "GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463" status: 200 len: 1408 microversion: 2.54 time: 0.536456 Oct 23 01:36:19.729502 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2817/5524] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:36:19 2022] GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463 => generated 1408 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:36:19.742138 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4ca2ab35-e5f2-4b4b-a337-61f50a191c73 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:19.743046 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4ca2ab35-e5f2-4b4b-a337-61f50a191c73 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 124d4efd-fa7d-468c-a512-78a550b75c89] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:19.751694 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4ca2ab35-e5f2-4b4b-a337-61f50a191c73 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:19.752512 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4ca2ab35-e5f2-4b4b-a337-61f50a191c73 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:19.753152 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4ca2ab35-e5f2-4b4b-a337-61f50a191c73 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:19.754051 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4ca2ab35-e5f2-4b4b-a337-61f50a191c73 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:19.755049 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4ca2ab35-e5f2-4b4b-a337-61f50a191c73 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:19.755680 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4ca2ab35-e5f2-4b4b-a337-61f50a191c73 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:19.943022 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f1b3080d-0282-491b-b50d-452143676c35 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:19.954422 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f1b3080d-0282-491b-b50d-452143676c35 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1669 microversion: 2.1 time: 0.506005 Oct 23 01:36:19.955283 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2708/5525] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:19 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1669 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:36:19.982558 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f2fc36d6-9865-47e5-8db4-b731a001bb83 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:19.983189 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f2fc36d6-9865-47e5-8db4-b731a001bb83 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:20.000103 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f2fc36d6-9865-47e5-8db4-b731a001bb83 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:20.000582 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f2fc36d6-9865-47e5-8db4-b731a001bb83 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:20.005311 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f2fc36d6-9865-47e5-8db4-b731a001bb83 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:20.006197 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f2fc36d6-9865-47e5-8db4-b731a001bb83 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:20.006782 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f2fc36d6-9865-47e5-8db4-b731a001bb83 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:20.007224 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f2fc36d6-9865-47e5-8db4-b731a001bb83 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:20.034858 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4ca2ab35-e5f2-4b4b-a337-61f50a191c73 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:20.050548 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4ca2ab35-e5f2-4b4b-a337-61f50a191c73 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89" status: 200 len: 1511 microversion: 2.1 time: 0.314873 Oct 23 01:36:20.050896 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2818/5526] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:19 2022] GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89 => generated 1511 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:36:20.266733 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f2fc36d6-9865-47e5-8db4-b731a001bb83 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:20.284246 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f2fc36d6-9865-47e5-8db4-b731a001bb83 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1669 microversion: 2.1 time: 0.306389 Oct 23 01:36:20.299016 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2709/5527] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:19 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1669 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:36:20.318012 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-44db84e1-374e-4a23-8e3a-a53a802f6109 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:20.318637 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-44db84e1-374e-4a23-8e3a-a53a802f6109 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:20.327726 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-44db84e1-374e-4a23-8e3a-a53a802f6109 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:20.328319 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-44db84e1-374e-4a23-8e3a-a53a802f6109 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:20.328773 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-44db84e1-374e-4a23-8e3a-a53a802f6109 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:20.329476 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-44db84e1-374e-4a23-8e3a-a53a802f6109 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:20.329939 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-44db84e1-374e-4a23-8e3a-a53a802f6109 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:20.330549 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-44db84e1-374e-4a23-8e3a-a53a802f6109 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:20.607502 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-44db84e1-374e-4a23-8e3a-a53a802f6109 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:20.619262 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-44db84e1-374e-4a23-8e3a-a53a802f6109 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1669 microversion: 2.1 time: 0.305471 Oct 23 01:36:20.619875 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2819/5528] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:20 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1669 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:36:20.647345 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8b63d254-95c9-4f18-a4a7-3eac2820a546 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:20.648256 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8b63d254-95c9-4f18-a4a7-3eac2820a546 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:20.655641 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b63d254-95c9-4f18-a4a7-3eac2820a546 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:20.656468 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b63d254-95c9-4f18-a4a7-3eac2820a546 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:20.656984 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b63d254-95c9-4f18-a4a7-3eac2820a546 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:20.658511 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b63d254-95c9-4f18-a4a7-3eac2820a546 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:20.659653 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b63d254-95c9-4f18-a4a7-3eac2820a546 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:20.660292 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b63d254-95c9-4f18-a4a7-3eac2820a546 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:20.755872 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-17dd6a55-1445-4d39-9666-553ce1216359 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:20.757363 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-17dd6a55-1445-4d39-9666-553ce1216359 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] [instance: d643b34d-8491-45fb-b0b7-44444af0c463] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:20.765306 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-17dd6a55-1445-4d39-9666-553ce1216359 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:20.766448 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-17dd6a55-1445-4d39-9666-553ce1216359 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:20.767204 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-17dd6a55-1445-4d39-9666-553ce1216359 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:20.768055 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-17dd6a55-1445-4d39-9666-553ce1216359 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:20.770055 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-17dd6a55-1445-4d39-9666-553ce1216359 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:20.770810 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-17dd6a55-1445-4d39-9666-553ce1216359 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:20.896786 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-17dd6a55-1445-4d39-9666-553ce1216359 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:20.902575 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8b63d254-95c9-4f18-a4a7-3eac2820a546 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:20.909648 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-17dd6a55-1445-4d39-9666-553ce1216359 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:20.923216 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-17dd6a55-1445-4d39-9666-553ce1216359 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:20.923795 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8b63d254-95c9-4f18-a4a7-3eac2820a546 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1669 microversion: 2.1 time: 0.269261 Oct 23 01:36:20.923932 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-17dd6a55-1445-4d39-9666-553ce1216359 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] 10.222.0.42 "GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463" status: 200 len: 1408 microversion: 2.54 time: 0.162149 Oct 23 01:36:20.923932 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2820/5529] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:36:20 2022] GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463 => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:36:20.924151 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2710/5530] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:20 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1669 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:36:20.942534 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-74cb3776-5ba2-4fd6-9871-d26c8b67e832 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:20.952445 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-74cb3776-5ba2-4fd6-9871-d26c8b67e832 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:20.953776 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-74cb3776-5ba2-4fd6-9871-d26c8b67e832 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:20.954500 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-74cb3776-5ba2-4fd6-9871-d26c8b67e832 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:20.955113 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-74cb3776-5ba2-4fd6-9871-d26c8b67e832 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:20.956031 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-74cb3776-5ba2-4fd6-9871-d26c8b67e832 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:20.956548 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-74cb3776-5ba2-4fd6-9871-d26c8b67e832 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:20.956986 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-74cb3776-5ba2-4fd6-9871-d26c8b67e832 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:20.979136 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:21.077375 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b192fe69-5d35-429a-a278-15c4b6e4d7e6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:21.078110 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b192fe69-5d35-429a-a278-15c4b6e4d7e6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 124d4efd-fa7d-468c-a512-78a550b75c89] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:21.086615 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b192fe69-5d35-429a-a278-15c4b6e4d7e6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:21.087129 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b192fe69-5d35-429a-a278-15c4b6e4d7e6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:21.087563 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b192fe69-5d35-429a-a278-15c4b6e4d7e6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:21.088495 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b192fe69-5d35-429a-a278-15c4b6e4d7e6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:21.088822 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b192fe69-5d35-429a-a278-15c4b6e4d7e6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:21.089384 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b192fe69-5d35-429a-a278-15c4b6e4d7e6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:21.249127 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-74cb3776-5ba2-4fd6-9871-d26c8b67e832 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:21.258309 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-74cb3776-5ba2-4fd6-9871-d26c8b67e832 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1669 microversion: 2.1 time: 0.324468 Oct 23 01:36:21.259373 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2821/5531] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:20 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1669 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:36:21.283211 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8e077ac2-3a21-4f55-bbe5-3454ad525407 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:21.284069 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8e077ac2-3a21-4f55-bbe5-3454ad525407 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:21.291436 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8e077ac2-3a21-4f55-bbe5-3454ad525407 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:21.305108 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8e077ac2-3a21-4f55-bbe5-3454ad525407 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:21.305108 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8e077ac2-3a21-4f55-bbe5-3454ad525407 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:21.305108 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8e077ac2-3a21-4f55-bbe5-3454ad525407 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:21.305108 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8e077ac2-3a21-4f55-bbe5-3454ad525407 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:21.305108 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8e077ac2-3a21-4f55-bbe5-3454ad525407 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:21.321438 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b192fe69-5d35-429a-a278-15c4b6e4d7e6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:21.331444 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b192fe69-5d35-429a-a278-15c4b6e4d7e6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89" status: 200 len: 1511 microversion: 2.1 time: 0.258227 Oct 23 01:36:21.338210 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2711/5532] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:21 2022] GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89 => generated 1511 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:36:21.480412 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8e077ac2-3a21-4f55-bbe5-3454ad525407 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:21.495821 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8e077ac2-3a21-4f55-bbe5-3454ad525407 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1669 microversion: 2.1 time: 0.217149 Oct 23 01:36:21.498827 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2822/5533] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:21 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1669 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:36:21.945452 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-340c649c-87d1-466c-b97b-6db43e252093 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:21.946456 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-340c649c-87d1-466c-b97b-6db43e252093 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] [instance: d643b34d-8491-45fb-b0b7-44444af0c463] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:21.960920 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-340c649c-87d1-466c-b97b-6db43e252093 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:21.962521 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-340c649c-87d1-466c-b97b-6db43e252093 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:21.963044 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-340c649c-87d1-466c-b97b-6db43e252093 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:21.963771 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-340c649c-87d1-466c-b97b-6db43e252093 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:21.964234 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-340c649c-87d1-466c-b97b-6db43e252093 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:21.964729 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-340c649c-87d1-466c-b97b-6db43e252093 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:22.058480 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-340c649c-87d1-466c-b97b-6db43e252093 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:22.067724 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-340c649c-87d1-466c-b97b-6db43e252093 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:22.069188 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-340c649c-87d1-466c-b97b-6db43e252093 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:22.070411 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-340c649c-87d1-466c-b97b-6db43e252093 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] 10.222.0.42 "GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463" status: 200 len: 1408 microversion: 2.54 time: 0.130676 Oct 23 01:36:22.070987 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2712/5534] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:36:21 2022] GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463 => generated 1408 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:36:22.354518 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e15e2d2c-91f9-4f9b-afb0-4863ab3b713b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:22.355130 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e15e2d2c-91f9-4f9b-afb0-4863ab3b713b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 124d4efd-fa7d-468c-a512-78a550b75c89] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:22.363492 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e15e2d2c-91f9-4f9b-afb0-4863ab3b713b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:22.364240 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e15e2d2c-91f9-4f9b-afb0-4863ab3b713b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:22.364863 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e15e2d2c-91f9-4f9b-afb0-4863ab3b713b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:22.365861 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e15e2d2c-91f9-4f9b-afb0-4863ab3b713b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:22.366580 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e15e2d2c-91f9-4f9b-afb0-4863ab3b713b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:22.367207 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e15e2d2c-91f9-4f9b-afb0-4863ab3b713b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:22.547465 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e15e2d2c-91f9-4f9b-afb0-4863ab3b713b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:22.556740 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e15e2d2c-91f9-4f9b-afb0-4863ab3b713b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89" status: 200 len: 1511 microversion: 2.1 time: 0.205832 Oct 23 01:36:22.558213 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2823/5535] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:22 2022] GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89 => generated 1511 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:36:23.097114 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0aa81464-cc2e-409a-b071-1ad5474f5d3c tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:23.097744 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0aa81464-cc2e-409a-b071-1ad5474f5d3c tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] [instance: d643b34d-8491-45fb-b0b7-44444af0c463] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:23.104608 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0aa81464-cc2e-409a-b071-1ad5474f5d3c tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:23.105023 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0aa81464-cc2e-409a-b071-1ad5474f5d3c tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:23.105463 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0aa81464-cc2e-409a-b071-1ad5474f5d3c tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:23.106195 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0aa81464-cc2e-409a-b071-1ad5474f5d3c tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:23.107351 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0aa81464-cc2e-409a-b071-1ad5474f5d3c tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:23.107782 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0aa81464-cc2e-409a-b071-1ad5474f5d3c tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:23.177890 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0aa81464-cc2e-409a-b071-1ad5474f5d3c tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:23.196767 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0aa81464-cc2e-409a-b071-1ad5474f5d3c tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:23.203237 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0aa81464-cc2e-409a-b071-1ad5474f5d3c tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:23.204548 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0aa81464-cc2e-409a-b071-1ad5474f5d3c tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] 10.222.0.42 "GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463" status: 200 len: 1408 microversion: 2.54 time: 0.112215 Oct 23 01:36:23.222687 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2713/5536] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:36:23 2022] GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463 => generated 1408 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:36:23.582009 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e8fde3c5-00e6-41e0-a95b-829b9474f2a3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:23.582520 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e8fde3c5-00e6-41e0-a95b-829b9474f2a3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 124d4efd-fa7d-468c-a512-78a550b75c89] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:23.595820 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e8fde3c5-00e6-41e0-a95b-829b9474f2a3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:23.596926 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e8fde3c5-00e6-41e0-a95b-829b9474f2a3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:23.597736 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e8fde3c5-00e6-41e0-a95b-829b9474f2a3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:23.599781 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e8fde3c5-00e6-41e0-a95b-829b9474f2a3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:23.600601 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e8fde3c5-00e6-41e0-a95b-829b9474f2a3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:23.601296 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e8fde3c5-00e6-41e0-a95b-829b9474f2a3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:23.784224 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e8fde3c5-00e6-41e0-a95b-829b9474f2a3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:23.806849 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e8fde3c5-00e6-41e0-a95b-829b9474f2a3 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89" status: 200 len: 1511 microversion: 2.1 time: 0.228670 Oct 23 01:36:23.807461 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2824/5537] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:23 2022] GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89 => generated 1511 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:36:24.240989 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8e953faa-f899-481e-b486-3efc6686a265 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:24.242281 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8e953faa-f899-481e-b486-3efc6686a265 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] [instance: d643b34d-8491-45fb-b0b7-44444af0c463] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:24.249134 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8e953faa-f899-481e-b486-3efc6686a265 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:24.249619 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8e953faa-f899-481e-b486-3efc6686a265 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:24.250146 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8e953faa-f899-481e-b486-3efc6686a265 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:24.250777 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8e953faa-f899-481e-b486-3efc6686a265 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:24.251442 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8e953faa-f899-481e-b486-3efc6686a265 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:24.252034 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8e953faa-f899-481e-b486-3efc6686a265 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:24.329668 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8e953faa-f899-481e-b486-3efc6686a265 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:24.339943 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8e953faa-f899-481e-b486-3efc6686a265 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:24.342685 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8e953faa-f899-481e-b486-3efc6686a265 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:24.344456 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8e953faa-f899-481e-b486-3efc6686a265 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] 10.222.0.42 "GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463" status: 200 len: 1408 microversion: 2.54 time: 0.107931 Oct 23 01:36:24.345525 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2714/5538] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:36:24 2022] GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463 => generated 1408 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:36:24.831098 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5b617beb-0eb6-433f-9545-fb78bbd9f447 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:24.832208 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5b617beb-0eb6-433f-9545-fb78bbd9f447 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 124d4efd-fa7d-468c-a512-78a550b75c89] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:24.842012 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b617beb-0eb6-433f-9545-fb78bbd9f447 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:24.843441 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b617beb-0eb6-433f-9545-fb78bbd9f447 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:24.844072 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b617beb-0eb6-433f-9545-fb78bbd9f447 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:24.846688 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b617beb-0eb6-433f-9545-fb78bbd9f447 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:24.847356 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b617beb-0eb6-433f-9545-fb78bbd9f447 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:24.847965 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b617beb-0eb6-433f-9545-fb78bbd9f447 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:25.107875 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5b617beb-0eb6-433f-9545-fb78bbd9f447 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:25.122604 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5b617beb-0eb6-433f-9545-fb78bbd9f447 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89" status: 200 len: 1511 microversion: 2.1 time: 0.295554 Oct 23 01:36:25.124811 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2825/5539] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:24 2022] GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89 => generated 1511 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:36:25.381398 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7de3d7e4-e04f-42dd-9570-f84d50304bc7 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:25.382928 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7de3d7e4-e04f-42dd-9570-f84d50304bc7 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] [instance: d643b34d-8491-45fb-b0b7-44444af0c463] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:25.386667 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=12 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:25.407175 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7de3d7e4-e04f-42dd-9570-f84d50304bc7 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:25.410157 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7de3d7e4-e04f-42dd-9570-f84d50304bc7 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:25.411292 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7de3d7e4-e04f-42dd-9570-f84d50304bc7 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:25.412960 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7de3d7e4-e04f-42dd-9570-f84d50304bc7 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:25.414092 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7de3d7e4-e04f-42dd-9570-f84d50304bc7 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:25.414533 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7de3d7e4-e04f-42dd-9570-f84d50304bc7 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:25.542045 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7de3d7e4-e04f-42dd-9570-f84d50304bc7 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:25.551063 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7de3d7e4-e04f-42dd-9570-f84d50304bc7 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:25.552521 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7de3d7e4-e04f-42dd-9570-f84d50304bc7 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:25.553696 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7de3d7e4-e04f-42dd-9570-f84d50304bc7 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] 10.222.0.42 "GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463" status: 200 len: 1408 microversion: 2.54 time: 0.180857 Oct 23 01:36:25.554311 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2715/5540] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:36:25 2022] GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463 => generated 1408 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:36:26.147040 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8d34637e-4c14-4519-9b5e-a5f0ccf6d5ec tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:26.147850 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8d34637e-4c14-4519-9b5e-a5f0ccf6d5ec tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 124d4efd-fa7d-468c-a512-78a550b75c89] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:26.155011 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8d34637e-4c14-4519-9b5e-a5f0ccf6d5ec tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:26.155597 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8d34637e-4c14-4519-9b5e-a5f0ccf6d5ec tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:26.156102 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8d34637e-4c14-4519-9b5e-a5f0ccf6d5ec tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:26.156797 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8d34637e-4c14-4519-9b5e-a5f0ccf6d5ec tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:26.157253 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8d34637e-4c14-4519-9b5e-a5f0ccf6d5ec tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:26.157697 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8d34637e-4c14-4519-9b5e-a5f0ccf6d5ec tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:26.388634 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8d34637e-4c14-4519-9b5e-a5f0ccf6d5ec tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:26.396715 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8d34637e-4c14-4519-9b5e-a5f0ccf6d5ec tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89" status: 200 len: 1511 microversion: 2.1 time: 0.253615 Oct 23 01:36:26.397720 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2826/5541] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:26 2022] GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89 => generated 1511 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:36:26.488790 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-aa860c1b-a898-4cb8-bb37-fcc743342f14 tempest-PortsAdminExtendedAttrsTestJSON-814332379 tempest-PortsAdminExtendedAttrsTestJSON-814332379-project-admin] Calling method '.version_select at 0x7f5cc0ecbb80>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:26.490750 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa860c1b-a898-4cb8-bb37-fcc743342f14 tempest-PortsAdminExtendedAttrsTestJSON-814332379 tempest-PortsAdminExtendedAttrsTestJSON-814332379-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:26.491648 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa860c1b-a898-4cb8-bb37-fcc743342f14 tempest-PortsAdminExtendedAttrsTestJSON-814332379 tempest-PortsAdminExtendedAttrsTestJSON-814332379-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:26.492094 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa860c1b-a898-4cb8-bb37-fcc743342f14 tempest-PortsAdminExtendedAttrsTestJSON-814332379 tempest-PortsAdminExtendedAttrsTestJSON-814332379-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:26.513026 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa860c1b-a898-4cb8-bb37-fcc743342f14 tempest-PortsAdminExtendedAttrsTestJSON-814332379 tempest-PortsAdminExtendedAttrsTestJSON-814332379-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:26.513716 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa860c1b-a898-4cb8-bb37-fcc743342f14 tempest-PortsAdminExtendedAttrsTestJSON-814332379 tempest-PortsAdminExtendedAttrsTestJSON-814332379-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:26.514144 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa860c1b-a898-4cb8-bb37-fcc743342f14 tempest-PortsAdminExtendedAttrsTestJSON-814332379 tempest-PortsAdminExtendedAttrsTestJSON-814332379-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:26.525916 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa860c1b-a898-4cb8-bb37-fcc743342f14 tempest-PortsAdminExtendedAttrsTestJSON-814332379 tempest-PortsAdminExtendedAttrsTestJSON-814332379-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:26.526784 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa860c1b-a898-4cb8-bb37-fcc743342f14 tempest-PortsAdminExtendedAttrsTestJSON-814332379 tempest-PortsAdminExtendedAttrsTestJSON-814332379-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:26.527400 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa860c1b-a898-4cb8-bb37-fcc743342f14 tempest-PortsAdminExtendedAttrsTestJSON-814332379 tempest-PortsAdminExtendedAttrsTestJSON-814332379-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:26.534838 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-aa860c1b-a898-4cb8-bb37-fcc743342f14 tempest-PortsAdminExtendedAttrsTestJSON-814332379 tempest-PortsAdminExtendedAttrsTestJSON-814332379-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.279181 Oct 23 01:36:26.538135 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2716/5542] 10.222.0.42 () {58 vars in 1146 bytes} [Sun Oct 23 01:36:26 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:36:26.584344 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e31fbda1-1ea3-410f-a446-3e6e9bc5a9b8 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:26.585865 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e31fbda1-1ea3-410f-a446-3e6e9bc5a9b8 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] [instance: d643b34d-8491-45fb-b0b7-44444af0c463] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:26.596525 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e31fbda1-1ea3-410f-a446-3e6e9bc5a9b8 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:26.597138 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e31fbda1-1ea3-410f-a446-3e6e9bc5a9b8 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:26.597882 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e31fbda1-1ea3-410f-a446-3e6e9bc5a9b8 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:26.598903 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e31fbda1-1ea3-410f-a446-3e6e9bc5a9b8 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:26.601078 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e31fbda1-1ea3-410f-a446-3e6e9bc5a9b8 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:26.601861 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e31fbda1-1ea3-410f-a446-3e6e9bc5a9b8 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:26.683265 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e31fbda1-1ea3-410f-a446-3e6e9bc5a9b8 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:26.693251 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e31fbda1-1ea3-410f-a446-3e6e9bc5a9b8 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:26.695034 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e31fbda1-1ea3-410f-a446-3e6e9bc5a9b8 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:26.696496 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e31fbda1-1ea3-410f-a446-3e6e9bc5a9b8 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] 10.222.0.42 "GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463" status: 200 len: 1408 microversion: 2.54 time: 0.117786 Oct 23 01:36:26.697446 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2827/5543] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:36:26 2022] GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463 => generated 1408 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:36:27.423169 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d5b2fac7-e6f4-4673-9519-f31eb1f9e47b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:27.432064 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d5b2fac7-e6f4-4673-9519-f31eb1f9e47b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 124d4efd-fa7d-468c-a512-78a550b75c89] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:27.453087 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d5b2fac7-e6f4-4673-9519-f31eb1f9e47b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:27.470261 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d5b2fac7-e6f4-4673-9519-f31eb1f9e47b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:27.472485 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d5b2fac7-e6f4-4673-9519-f31eb1f9e47b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:27.473422 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d5b2fac7-e6f4-4673-9519-f31eb1f9e47b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:27.482813 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d5b2fac7-e6f4-4673-9519-f31eb1f9e47b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:27.484594 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d5b2fac7-e6f4-4673-9519-f31eb1f9e47b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:27.717409 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d5b2fac7-e6f4-4673-9519-f31eb1f9e47b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:27.725786 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b158214f-d8bb-440b-a3a8-d4f424cce0c6 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:27.727227 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b158214f-d8bb-440b-a3a8-d4f424cce0c6 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] [instance: d643b34d-8491-45fb-b0b7-44444af0c463] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:27.727816 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d5b2fac7-e6f4-4673-9519-f31eb1f9e47b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89" status: 200 len: 1511 microversion: 2.1 time: 0.309057 Oct 23 01:36:27.729335 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2717/5544] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:27 2022] GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89 => generated 1511 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:36:27.747096 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b158214f-d8bb-440b-a3a8-d4f424cce0c6 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:27.748100 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b158214f-d8bb-440b-a3a8-d4f424cce0c6 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:27.748549 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b158214f-d8bb-440b-a3a8-d4f424cce0c6 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:27.749271 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b158214f-d8bb-440b-a3a8-d4f424cce0c6 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:27.749737 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b158214f-d8bb-440b-a3a8-d4f424cce0c6 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:27.750229 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b158214f-d8bb-440b-a3a8-d4f424cce0c6 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:27.828685 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b158214f-d8bb-440b-a3a8-d4f424cce0c6 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:27.837519 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b158214f-d8bb-440b-a3a8-d4f424cce0c6 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:27.842586 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b158214f-d8bb-440b-a3a8-d4f424cce0c6 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:27.842586 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b158214f-d8bb-440b-a3a8-d4f424cce0c6 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] 10.222.0.42 "GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463" status: 200 len: 1408 microversion: 2.54 time: 0.119981 Oct 23 01:36:27.842586 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2828/5545] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:36:27 2022] GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463 => generated 1408 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:36:28.867529 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8d8c2f27-bdc9-4769-b876-ca6526d83c82 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:28.868542 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8d8c2f27-bdc9-4769-b876-ca6526d83c82 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] [instance: d643b34d-8491-45fb-b0b7-44444af0c463] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:28.885869 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8d8c2f27-bdc9-4769-b876-ca6526d83c82 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:28.886310 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8d8c2f27-bdc9-4769-b876-ca6526d83c82 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:28.886965 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8d8c2f27-bdc9-4769-b876-ca6526d83c82 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:28.891668 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8d8c2f27-bdc9-4769-b876-ca6526d83c82 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:28.893135 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8d8c2f27-bdc9-4769-b876-ca6526d83c82 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:28.893759 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8d8c2f27-bdc9-4769-b876-ca6526d83c82 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:28.994443 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8d8c2f27-bdc9-4769-b876-ca6526d83c82 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:29.011025 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8d8c2f27-bdc9-4769-b876-ca6526d83c82 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:29.014157 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8d8c2f27-bdc9-4769-b876-ca6526d83c82 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:29.015571 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8d8c2f27-bdc9-4769-b876-ca6526d83c82 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] 10.222.0.42 "GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463" status: 200 len: 1408 microversion: 2.54 time: 0.152628 Oct 23 01:36:29.017093 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2829/5546] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:36:28 2022] GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:36:29.078433 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-514c3ee7-98ce-4032-8d5b-128fb4002ee2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:29.079752 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-514c3ee7-98ce-4032-8d5b-128fb4002ee2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 124d4efd-fa7d-468c-a512-78a550b75c89] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:29.091560 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-514c3ee7-98ce-4032-8d5b-128fb4002ee2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:29.092116 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-514c3ee7-98ce-4032-8d5b-128fb4002ee2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:29.092554 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-514c3ee7-98ce-4032-8d5b-128fb4002ee2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:29.097370 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-514c3ee7-98ce-4032-8d5b-128fb4002ee2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:29.098060 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-514c3ee7-98ce-4032-8d5b-128fb4002ee2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:29.098574 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-514c3ee7-98ce-4032-8d5b-128fb4002ee2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:29.379454 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-514c3ee7-98ce-4032-8d5b-128fb4002ee2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:29.394519 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-514c3ee7-98ce-4032-8d5b-128fb4002ee2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89" status: 200 len: 1511 microversion: 2.1 time: 0.646765 Oct 23 01:36:29.412537 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2718/5547] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:28 2022] GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89 => generated 1511 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:36:30.053769 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e5d43482-aa72-46a6-941f-4b1e4aa53914 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:30.053769 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e5d43482-aa72-46a6-941f-4b1e4aa53914 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] [instance: d643b34d-8491-45fb-b0b7-44444af0c463] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:30.068702 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e5d43482-aa72-46a6-941f-4b1e4aa53914 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:30.069368 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e5d43482-aa72-46a6-941f-4b1e4aa53914 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:30.069814 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e5d43482-aa72-46a6-941f-4b1e4aa53914 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:30.070853 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e5d43482-aa72-46a6-941f-4b1e4aa53914 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:30.071599 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e5d43482-aa72-46a6-941f-4b1e4aa53914 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:30.072552 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e5d43482-aa72-46a6-941f-4b1e4aa53914 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:30.231602 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e5d43482-aa72-46a6-941f-4b1e4aa53914 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:30.256522 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e5d43482-aa72-46a6-941f-4b1e4aa53914 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:30.258299 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e5d43482-aa72-46a6-941f-4b1e4aa53914 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:30.260009 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e5d43482-aa72-46a6-941f-4b1e4aa53914 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] 10.222.0.42 "GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463" status: 200 len: 1408 microversion: 2.54 time: 0.221967 Oct 23 01:36:30.275477 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2830/5548] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:36:30 2022] GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463 => generated 1408 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:36:30.420572 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a8f17d5f-073e-4968-930c-5564e60d7415 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:30.421116 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a8f17d5f-073e-4968-930c-5564e60d7415 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 124d4efd-fa7d-468c-a512-78a550b75c89] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:30.436704 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a8f17d5f-073e-4968-930c-5564e60d7415 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:30.437285 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a8f17d5f-073e-4968-930c-5564e60d7415 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:30.437812 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a8f17d5f-073e-4968-930c-5564e60d7415 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:30.438651 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a8f17d5f-073e-4968-930c-5564e60d7415 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:30.439184 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a8f17d5f-073e-4968-930c-5564e60d7415 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:30.442159 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a8f17d5f-073e-4968-930c-5564e60d7415 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:30.659442 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a8f17d5f-073e-4968-930c-5564e60d7415 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:30.671279 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a8f17d5f-073e-4968-930c-5564e60d7415 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89" status: 200 len: 1511 microversion: 2.1 time: 0.255445 Oct 23 01:36:30.672335 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2719/5549] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:30 2022] GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89 => generated 1511 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:36:31.295198 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3505e3ae-65e0-478f-ac26-77d88feab4ce tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:31.295815 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3505e3ae-65e0-478f-ac26-77d88feab4ce tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] [instance: d643b34d-8491-45fb-b0b7-44444af0c463] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:31.302931 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3505e3ae-65e0-478f-ac26-77d88feab4ce tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:31.307506 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3505e3ae-65e0-478f-ac26-77d88feab4ce tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:31.307506 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3505e3ae-65e0-478f-ac26-77d88feab4ce tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:31.307506 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3505e3ae-65e0-478f-ac26-77d88feab4ce tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:31.307506 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3505e3ae-65e0-478f-ac26-77d88feab4ce tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:31.307506 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3505e3ae-65e0-478f-ac26-77d88feab4ce tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:31.404054 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3505e3ae-65e0-478f-ac26-77d88feab4ce tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:31.412819 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3505e3ae-65e0-478f-ac26-77d88feab4ce tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:31.414308 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3505e3ae-65e0-478f-ac26-77d88feab4ce tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:31.415614 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3505e3ae-65e0-478f-ac26-77d88feab4ce tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] 10.222.0.42 "GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463" status: 200 len: 1408 microversion: 2.54 time: 0.125118 Oct 23 01:36:31.416196 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2831/5550] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:36:31 2022] GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463 => generated 1408 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:36:31.700238 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b5c050c6-c92f-4725-a70f-a91002310845 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:31.701877 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b5c050c6-c92f-4725-a70f-a91002310845 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 124d4efd-fa7d-468c-a512-78a550b75c89] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:31.708761 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b5c050c6-c92f-4725-a70f-a91002310845 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:31.709347 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b5c050c6-c92f-4725-a70f-a91002310845 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:31.709857 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b5c050c6-c92f-4725-a70f-a91002310845 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:31.710658 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b5c050c6-c92f-4725-a70f-a91002310845 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:31.711315 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b5c050c6-c92f-4725-a70f-a91002310845 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:31.712082 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b5c050c6-c92f-4725-a70f-a91002310845 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:32.057615 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b5c050c6-c92f-4725-a70f-a91002310845 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:32.066102 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b5c050c6-c92f-4725-a70f-a91002310845 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89" status: 200 len: 1511 microversion: 2.1 time: 0.371588 Oct 23 01:36:32.066699 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2720/5551] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:31 2022] GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89 => generated 1511 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:36:32.442452 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7a7e6d72-fa41-4748-80cf-d4548b07660d tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:32.443764 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7a7e6d72-fa41-4748-80cf-d4548b07660d tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] [instance: d643b34d-8491-45fb-b0b7-44444af0c463] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:32.451494 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7a7e6d72-fa41-4748-80cf-d4548b07660d tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:32.452246 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7a7e6d72-fa41-4748-80cf-d4548b07660d tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:32.453151 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7a7e6d72-fa41-4748-80cf-d4548b07660d tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:32.454120 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7a7e6d72-fa41-4748-80cf-d4548b07660d tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:32.454759 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7a7e6d72-fa41-4748-80cf-d4548b07660d tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:32.455362 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7a7e6d72-fa41-4748-80cf-d4548b07660d tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:32.582076 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7a7e6d72-fa41-4748-80cf-d4548b07660d tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:32.595260 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7a7e6d72-fa41-4748-80cf-d4548b07660d tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:32.596985 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7a7e6d72-fa41-4748-80cf-d4548b07660d tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:32.598392 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7a7e6d72-fa41-4748-80cf-d4548b07660d tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] 10.222.0.42 "GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463" status: 200 len: 1408 microversion: 2.54 time: 0.159853 Oct 23 01:36:32.615019 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2832/5552] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:36:32 2022] GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463 => generated 1408 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:36:33.092611 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-12c0b6cf-ae39-4844-be96-bffec30aeb32 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:33.093768 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-12c0b6cf-ae39-4844-be96-bffec30aeb32 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 124d4efd-fa7d-468c-a512-78a550b75c89] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:33.101160 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-12c0b6cf-ae39-4844-be96-bffec30aeb32 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:33.109622 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-12c0b6cf-ae39-4844-be96-bffec30aeb32 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:33.109622 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-12c0b6cf-ae39-4844-be96-bffec30aeb32 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:33.109622 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-12c0b6cf-ae39-4844-be96-bffec30aeb32 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:33.109622 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-12c0b6cf-ae39-4844-be96-bffec30aeb32 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:33.109622 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-12c0b6cf-ae39-4844-be96-bffec30aeb32 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:33.437181 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-12c0b6cf-ae39-4844-be96-bffec30aeb32 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:33.456920 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-12c0b6cf-ae39-4844-be96-bffec30aeb32 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89" status: 200 len: 1511 microversion: 2.1 time: 0.370169 Oct 23 01:36:33.457604 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2721/5553] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:33 2022] GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89 => generated 1511 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:36:33.629835 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9bce86c9-9190-40b6-a4a5-6109099e9432 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:33.630629 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9bce86c9-9190-40b6-a4a5-6109099e9432 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] [instance: d643b34d-8491-45fb-b0b7-44444af0c463] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:33.643882 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9bce86c9-9190-40b6-a4a5-6109099e9432 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:33.646112 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9bce86c9-9190-40b6-a4a5-6109099e9432 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:33.647071 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9bce86c9-9190-40b6-a4a5-6109099e9432 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:33.648275 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9bce86c9-9190-40b6-a4a5-6109099e9432 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:33.649108 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9bce86c9-9190-40b6-a4a5-6109099e9432 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:33.649902 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9bce86c9-9190-40b6-a4a5-6109099e9432 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:33.792964 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9bce86c9-9190-40b6-a4a5-6109099e9432 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:33.811190 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9bce86c9-9190-40b6-a4a5-6109099e9432 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:33.814501 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9bce86c9-9190-40b6-a4a5-6109099e9432 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:33.816395 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9bce86c9-9190-40b6-a4a5-6109099e9432 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] 10.222.0.42 "GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463" status: 200 len: 1408 microversion: 2.54 time: 0.192055 Oct 23 01:36:33.817731 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2833/5554] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:36:33 2022] GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463 => generated 1408 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:36:34.484804 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b41ac89b-3294-4098-bf27-5c80f73ac7d2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:34.485495 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b41ac89b-3294-4098-bf27-5c80f73ac7d2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 124d4efd-fa7d-468c-a512-78a550b75c89] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:34.495220 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b41ac89b-3294-4098-bf27-5c80f73ac7d2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:34.499962 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b41ac89b-3294-4098-bf27-5c80f73ac7d2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:34.499962 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b41ac89b-3294-4098-bf27-5c80f73ac7d2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:34.499962 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b41ac89b-3294-4098-bf27-5c80f73ac7d2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:34.499962 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b41ac89b-3294-4098-bf27-5c80f73ac7d2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:34.499962 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b41ac89b-3294-4098-bf27-5c80f73ac7d2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:34.719262 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b41ac89b-3294-4098-bf27-5c80f73ac7d2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:34.724391 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=100 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:34.731891 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b41ac89b-3294-4098-bf27-5c80f73ac7d2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89" status: 200 len: 1488 microversion: 2.1 time: 0.249876 Oct 23 01:36:34.734011 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2722/5555] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:34 2022] GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89 => generated 1488 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:36:34.761742 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9897af41-b59f-477f-89d3-75498cce72da tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:34.763004 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9897af41-b59f-477f-89d3-75498cce72da tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 124d4efd-fa7d-468c-a512-78a550b75c89] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:34.774812 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9897af41-b59f-477f-89d3-75498cce72da tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:34.775787 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9897af41-b59f-477f-89d3-75498cce72da tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:34.781341 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9897af41-b59f-477f-89d3-75498cce72da tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:34.784315 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9897af41-b59f-477f-89d3-75498cce72da tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:34.785157 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9897af41-b59f-477f-89d3-75498cce72da tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:34.785808 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9897af41-b59f-477f-89d3-75498cce72da tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:34.825126 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9897af41-b59f-477f-89d3-75498cce72da tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 124d4efd-fa7d-468c-a512-78a550b75c89] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:36:34.852092 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0352cf7f-3e64-4fb8-b89e-9122fe122ca7 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:34.852951 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0352cf7f-3e64-4fb8-b89e-9122fe122ca7 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] [instance: d643b34d-8491-45fb-b0b7-44444af0c463] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:34.871734 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0352cf7f-3e64-4fb8-b89e-9122fe122ca7 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:34.871734 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0352cf7f-3e64-4fb8-b89e-9122fe122ca7 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:34.871734 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0352cf7f-3e64-4fb8-b89e-9122fe122ca7 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:34.871734 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0352cf7f-3e64-4fb8-b89e-9122fe122ca7 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:34.871734 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0352cf7f-3e64-4fb8-b89e-9122fe122ca7 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:34.871734 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0352cf7f-3e64-4fb8-b89e-9122fe122ca7 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:34.995146 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0352cf7f-3e64-4fb8-b89e-9122fe122ca7 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:35.004854 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0352cf7f-3e64-4fb8-b89e-9122fe122ca7 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:35.006702 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0352cf7f-3e64-4fb8-b89e-9122fe122ca7 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:35.007982 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0352cf7f-3e64-4fb8-b89e-9122fe122ca7 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] 10.222.0.42 "GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463" status: 200 len: 1408 microversion: 2.54 time: 0.163098 Oct 23 01:36:35.009134 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2723/5556] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:36:34 2022] GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463 => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:36:35.193277 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9897af41-b59f-477f-89d3-75498cce72da tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "DELETE /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89" status: 204 len: 0 microversion: 2.1 time: 0.435269 Oct 23 01:36:35.194032 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2834/5557] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:36:34 2022] DELETE /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:36:35.202498 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6ae37e58-1eb8-4178-951c-0d21523d091e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:35.203843 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6ae37e58-1eb8-4178-951c-0d21523d091e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 124d4efd-fa7d-468c-a512-78a550b75c89] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:35.209354 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6ae37e58-1eb8-4178-951c-0d21523d091e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:35.209834 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6ae37e58-1eb8-4178-951c-0d21523d091e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:35.210333 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6ae37e58-1eb8-4178-951c-0d21523d091e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:35.211052 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6ae37e58-1eb8-4178-951c-0d21523d091e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:35.211499 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6ae37e58-1eb8-4178-951c-0d21523d091e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:35.211915 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6ae37e58-1eb8-4178-951c-0d21523d091e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:35.422413 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6ae37e58-1eb8-4178-951c-0d21523d091e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:35.430909 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6ae37e58-1eb8-4178-951c-0d21523d091e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89" status: 200 len: 1494 microversion: 2.1 time: 0.232167 Oct 23 01:36:35.431825 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2724/5558] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:35 2022] GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89 => generated 1494 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:36:36.035548 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-49138dde-586f-4a1f-8039-2cb4a3db266e tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:36.036306 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-49138dde-586f-4a1f-8039-2cb4a3db266e tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] [instance: d643b34d-8491-45fb-b0b7-44444af0c463] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:36.043979 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-49138dde-586f-4a1f-8039-2cb4a3db266e tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:36.044462 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-49138dde-586f-4a1f-8039-2cb4a3db266e tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:36.044892 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-49138dde-586f-4a1f-8039-2cb4a3db266e tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:36.045582 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-49138dde-586f-4a1f-8039-2cb4a3db266e tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:36.046061 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-49138dde-586f-4a1f-8039-2cb4a3db266e tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:36.046487 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-49138dde-586f-4a1f-8039-2cb4a3db266e tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:36.152314 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-49138dde-586f-4a1f-8039-2cb4a3db266e tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:36.161550 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-49138dde-586f-4a1f-8039-2cb4a3db266e tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:36.163037 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-49138dde-586f-4a1f-8039-2cb4a3db266e tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:36.164259 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-49138dde-586f-4a1f-8039-2cb4a3db266e tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] 10.222.0.42 "GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463" status: 200 len: 1408 microversion: 2.54 time: 0.133164 Oct 23 01:36:36.164829 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2835/5559] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:36:36 2022] GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463 => generated 1408 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:36:36.457379 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e264433f-1cf0-498f-9cf5-49877f8b868f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:36.458904 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e264433f-1cf0-498f-9cf5-49877f8b868f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 124d4efd-fa7d-468c-a512-78a550b75c89] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:36.466168 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e264433f-1cf0-498f-9cf5-49877f8b868f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:36.470287 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e264433f-1cf0-498f-9cf5-49877f8b868f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:36.470287 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e264433f-1cf0-498f-9cf5-49877f8b868f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:36.470287 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e264433f-1cf0-498f-9cf5-49877f8b868f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:36.470287 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e264433f-1cf0-498f-9cf5-49877f8b868f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:36.470287 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e264433f-1cf0-498f-9cf5-49877f8b868f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:36.680365 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e264433f-1cf0-498f-9cf5-49877f8b868f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:36.705185 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e264433f-1cf0-498f-9cf5-49877f8b868f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89" status: 200 len: 1494 microversion: 2.1 time: 0.250134 Oct 23 01:36:36.705185 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2725/5560] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:36 2022] GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89 => generated 1494 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:36:37.190288 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8ffa3866-036e-40b0-93d0-15e618a64e14 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:37.191122 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8ffa3866-036e-40b0-93d0-15e618a64e14 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] [instance: d643b34d-8491-45fb-b0b7-44444af0c463] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:37.198290 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ffa3866-036e-40b0-93d0-15e618a64e14 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:37.198893 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ffa3866-036e-40b0-93d0-15e618a64e14 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:37.199968 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ffa3866-036e-40b0-93d0-15e618a64e14 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:37.200683 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ffa3866-036e-40b0-93d0-15e618a64e14 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:37.201256 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ffa3866-036e-40b0-93d0-15e618a64e14 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:37.202005 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ffa3866-036e-40b0-93d0-15e618a64e14 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:37.227295 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:37.660375 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8ffa3866-036e-40b0-93d0-15e618a64e14 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:37.671130 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8ffa3866-036e-40b0-93d0-15e618a64e14 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:37.674656 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8ffa3866-036e-40b0-93d0-15e618a64e14 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:37.676744 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8ffa3866-036e-40b0-93d0-15e618a64e14 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] 10.222.0.42 "GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463" status: 200 len: 1408 microversion: 2.54 time: 0.490944 Oct 23 01:36:37.682720 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2836/5561] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:36:37 2022] GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463 => generated 1408 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:36:37.726318 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d2b09774-e451-4c61-9637-14d8729eb693 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:37.727546 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d2b09774-e451-4c61-9637-14d8729eb693 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 124d4efd-fa7d-468c-a512-78a550b75c89] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:37.735278 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d2b09774-e451-4c61-9637-14d8729eb693 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:37.736128 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d2b09774-e451-4c61-9637-14d8729eb693 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:37.736890 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d2b09774-e451-4c61-9637-14d8729eb693 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:37.737840 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d2b09774-e451-4c61-9637-14d8729eb693 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:37.738394 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d2b09774-e451-4c61-9637-14d8729eb693 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:37.738871 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d2b09774-e451-4c61-9637-14d8729eb693 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:38.027018 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d2b09774-e451-4c61-9637-14d8729eb693 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:38.039983 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d2b09774-e451-4c61-9637-14d8729eb693 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89" status: 200 len: 1494 microversion: 2.1 time: 0.317314 Oct 23 01:36:38.044704 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2726/5562] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:37 2022] GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89 => generated 1494 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:36:38.056691 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-dbb58236-48ca-4322-b231-2dbcffb23338 req-77264427-971e-4420-a652-4c7fb9b09a26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "124d4efd-fa7d-468c-a512-78a550b75c89", "name": "network-vif-deleted", "tag": "9e3b7c05-2566-412b-8518-c63d724d92ea"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:36:38.069591 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-dbb58236-48ca-4322-b231-2dbcffb23338 req-77264427-971e-4420-a652-4c7fb9b09a26 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:38.072154 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-dbb58236-48ca-4322-b231-2dbcffb23338 req-77264427-971e-4420-a652-4c7fb9b09a26 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:38.074951 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-dbb58236-48ca-4322-b231-2dbcffb23338 req-77264427-971e-4420-a652-4c7fb9b09a26 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:38.089208 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-dbb58236-48ca-4322-b231-2dbcffb23338 req-77264427-971e-4420-a652-4c7fb9b09a26 service nova] Creating event network-vif-deleted:9e3b7c05-2566-412b-8518-c63d724d92ea for instance 124d4efd-fa7d-468c-a512-78a550b75c89 on n-h1-master-1 Oct 23 01:36:38.095434 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-dbb58236-48ca-4322-b231-2dbcffb23338 req-77264427-971e-4420-a652-4c7fb9b09a26 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043604 Oct 23 01:36:38.098875 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2837/5563] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:36:38.726027 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-37658069-8894-4848-bb64-8beae39f91a7 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:38.728615 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-37658069-8894-4848-bb64-8beae39f91a7 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] [instance: d643b34d-8491-45fb-b0b7-44444af0c463] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:38.740368 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-37658069-8894-4848-bb64-8beae39f91a7 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:38.741782 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-37658069-8894-4848-bb64-8beae39f91a7 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:38.743198 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-37658069-8894-4848-bb64-8beae39f91a7 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:38.743988 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-37658069-8894-4848-bb64-8beae39f91a7 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:38.744649 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-37658069-8894-4848-bb64-8beae39f91a7 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:38.745344 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-37658069-8894-4848-bb64-8beae39f91a7 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:38.835634 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-389f61c6-5504-463b-9418-3bb9a874f258 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:38.836928 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-389f61c6-5504-463b-9418-3bb9a874f258 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 5e817a84-2969-413e-b36b-96798e94b306] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:38.848016 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-37658069-8894-4848-bb64-8beae39f91a7 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:38.852156 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-389f61c6-5504-463b-9418-3bb9a874f258 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:38.852156 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-389f61c6-5504-463b-9418-3bb9a874f258 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:38.852156 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-389f61c6-5504-463b-9418-3bb9a874f258 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:38.852156 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-389f61c6-5504-463b-9418-3bb9a874f258 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:38.852156 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-389f61c6-5504-463b-9418-3bb9a874f258 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:38.852156 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-389f61c6-5504-463b-9418-3bb9a874f258 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:38.862258 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-37658069-8894-4848-bb64-8beae39f91a7 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:38.866820 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-37658069-8894-4848-bb64-8beae39f91a7 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:38.869642 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-37658069-8894-4848-bb64-8beae39f91a7 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] 10.222.0.42 "GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463" status: 200 len: 1408 microversion: 2.54 time: 0.159841 Oct 23 01:36:38.872726 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2727/5564] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:36:38 2022] GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463 => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:36:38.921728 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-389f61c6-5504-463b-9418-3bb9a874f258 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306/ips" status: 200 len: 151 microversion: 2.1 time: 0.092069 Oct 23 01:36:38.922767 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2838/5565] 10.222.0.42 () {58 vars in 1248 bytes} [Sun Oct 23 01:36:38 2022] GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306/ips => generated 151 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:36:39.067597 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2a1ce00f-4a8f-4ea4-91eb-a99fea973edb tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:39.068595 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2a1ce00f-4a8f-4ea4-91eb-a99fea973edb tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 124d4efd-fa7d-468c-a512-78a550b75c89] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:39.077073 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2a1ce00f-4a8f-4ea4-91eb-a99fea973edb tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:39.079215 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2a1ce00f-4a8f-4ea4-91eb-a99fea973edb tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:39.084262 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2a1ce00f-4a8f-4ea4-91eb-a99fea973edb tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:39.085542 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2a1ce00f-4a8f-4ea4-91eb-a99fea973edb tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:39.086043 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2a1ce00f-4a8f-4ea4-91eb-a99fea973edb tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:39.086478 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2a1ce00f-4a8f-4ea4-91eb-a99fea973edb tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:39.148373 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2a1ce00f-4a8f-4ea4-91eb-a99fea973edb tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:39.148858 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2a1ce00f-4a8f-4ea4-91eb-a99fea973edb tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:39.149298 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2a1ce00f-4a8f-4ea4-91eb-a99fea973edb tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:39.149944 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-2a1ce00f-4a8f-4ea4-91eb-a99fea973edb tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lazy-loading 'fault' on Instance uuid 124d4efd-fa7d-468c-a512-78a550b75c89 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:36:39.217418 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2a1ce00f-4a8f-4ea4-91eb-a99fea973edb tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:39.225139 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2a1ce00f-4a8f-4ea4-91eb-a99fea973edb tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89" status: 200 len: 1304 microversion: 2.1 time: 0.162032 Oct 23 01:36:39.225703 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2728/5566] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:39 2022] GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89 => generated 1304 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:36:39.906855 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bdbecfc6-292c-4674-9f57-01900fa6de92 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:39.908052 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bdbecfc6-292c-4674-9f57-01900fa6de92 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] [instance: d643b34d-8491-45fb-b0b7-44444af0c463] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:39.910925 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:39.925626 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bdbecfc6-292c-4674-9f57-01900fa6de92 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:39.925626 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bdbecfc6-292c-4674-9f57-01900fa6de92 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:39.925626 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bdbecfc6-292c-4674-9f57-01900fa6de92 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:39.935681 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bdbecfc6-292c-4674-9f57-01900fa6de92 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:39.936501 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bdbecfc6-292c-4674-9f57-01900fa6de92 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:39.937679 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bdbecfc6-292c-4674-9f57-01900fa6de92 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:40.094207 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bdbecfc6-292c-4674-9f57-01900fa6de92 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:40.105590 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bdbecfc6-292c-4674-9f57-01900fa6de92 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:40.108421 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bdbecfc6-292c-4674-9f57-01900fa6de92 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:40.109809 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bdbecfc6-292c-4674-9f57-01900fa6de92 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] 10.222.0.42 "GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463" status: 200 len: 1408 microversion: 2.54 time: 0.209064 Oct 23 01:36:40.124747 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2839/5567] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:36:39 2022] GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463 => generated 1408 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:36:40.250617 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8397ac58-0fbc-48ba-94a3-313f761f0c38 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:40.251949 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8397ac58-0fbc-48ba-94a3-313f761f0c38 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 124d4efd-fa7d-468c-a512-78a550b75c89] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:40.258422 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:40.260147 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8397ac58-0fbc-48ba-94a3-313f761f0c38 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:40.261022 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8397ac58-0fbc-48ba-94a3-313f761f0c38 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:40.262369 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8397ac58-0fbc-48ba-94a3-313f761f0c38 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:40.263364 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8397ac58-0fbc-48ba-94a3-313f761f0c38 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:40.264071 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8397ac58-0fbc-48ba-94a3-313f761f0c38 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:40.264713 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8397ac58-0fbc-48ba-94a3-313f761f0c38 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:40.280361 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-8397ac58-0fbc-48ba-94a3-313f761f0c38 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] HTTP exception thrown: Instance 124d4efd-fa7d-468c-a512-78a550b75c89 could not be found. Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8397ac58-0fbc-48ba-94a3-313f761f0c38 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Request method failure captured: Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89 HTTP/1.1 Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJlvTfuM9-iirX2FXe8mkTy2eWW7UhgAXbnHf6lceGN18S7lbSlaINo5EbF9-Kmi1tphVBr2Fcj8S4BVPceiAUMjh1Az0xLOZc1N90Wz0wmSyINFoBFx331KJ40smzwK1ZOJLA4k7IFyzBj3SQlZplUyTac5KUYxpNFIDY-5Uus0ZuU Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 842dcab8b48c43d7963a538d914b0b22 Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-DeleteServersTestJSON-654775470 Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/842dcab8b48c43d7963a538d914b0b22"}]}] Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-DeleteServersTestJSON-654775470 Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 842dcab8b48c43d7963a538d914b0b22 Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-DeleteServersTestJSON-654775470 Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-DeleteServersTestJSON-654775470-project Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 634bed7898c24baca6ba00392d49eea1 Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-DeleteServersTestJSON-654775470-project Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 124d4efd-fa7d-468c-a512-78a550b75c89 could not be found. Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '124d4efd-fa7d-468c-a512-78a550b75c89'} Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 124d4efd-fa7d-468c-a512-78a550b75c89 could not be found. Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 124d4efd-fa7d-468c-a512-78a550b75c89 could not be found. Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:36:40.282586 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:36:40.289502 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:36:40.289502 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:36:40.289502 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:36:40.289502 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:36:40.289502 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:36:40.289502 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 124d4efd-fa7d-468c-a512-78a550b75c89 could not be found. Oct 23 01:36:40.289502 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:36:40.291986 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8397ac58-0fbc-48ba-94a3-313f761f0c38 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Returning 404 to user: Instance 124d4efd-fa7d-468c-a512-78a550b75c89 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:36:40.293138 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8397ac58-0fbc-48ba-94a3-313f761f0c38 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89" status: 404 len: 111 microversion: 2.1 time: 0.048050 Oct 23 01:36:40.297630 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2729/5568] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:40 2022] GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:36:40.429356 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3703e3a9-d6ce-4666-b715-a6b54d84b643 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-99792536", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "ba696604-5fcc-4b2d-9bf0-ca27f90a0725"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:36:40.506241 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-3703e3a9-d6ce-4666-b715-a6b54d84b643 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] validate_networks() for [('ba696604-5fcc-4b2d-9bf0-ca27f90a0725', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:36:41.032340 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-3703e3a9-d6ce-4666-b715-a6b54d84b643 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:36:41.033041 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-3703e3a9-d6ce-4666-b715-a6b54d84b643 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:36:41.033557 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-3703e3a9-d6ce-4666-b715-a6b54d84b643 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:36:41.034133 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-3703e3a9-d6ce-4666-b715-a6b54d84b643 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:36:41.034657 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-3703e3a9-d6ce-4666-b715-a6b54d84b643 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:36:41.046542 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3703e3a9-d6ce-4666-b715-a6b54d84b643 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:41.047249 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3703e3a9-d6ce-4666-b715-a6b54d84b643 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:41.047869 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3703e3a9-d6ce-4666-b715-a6b54d84b643 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:41.049493 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3703e3a9-d6ce-4666-b715-a6b54d84b643 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:41.050875 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3703e3a9-d6ce-4666-b715-a6b54d84b643 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:41.051559 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3703e3a9-d6ce-4666-b715-a6b54d84b643 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:41.074507 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-3703e3a9-d6ce-4666-b715-a6b54d84b643 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Getting quotas for project 842dcab8b48c43d7963a538d914b0b22. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:36:41.081271 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-3703e3a9-d6ce-4666-b715-a6b54d84b643 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Getting quotas for user 634bed7898c24baca6ba00392d49eea1 and project 842dcab8b48c43d7963a538d914b0b22. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:36:41.096088 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3703e3a9-d6ce-4666-b715-a6b54d84b643 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:36:41.098460 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3703e3a9-d6ce-4666-b715-a6b54d84b643 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: cee7dc56-efc1-4f64-8c5d-205414537c2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:36:41.141933 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ff930db9-4672-4335-850c-5a55550a1cb2 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:41.142809 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ff930db9-4672-4335-850c-5a55550a1cb2 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] [instance: d643b34d-8491-45fb-b0b7-44444af0c463] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:41.149443 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ff930db9-4672-4335-850c-5a55550a1cb2 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:41.150872 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ff930db9-4672-4335-850c-5a55550a1cb2 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:41.150872 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ff930db9-4672-4335-850c-5a55550a1cb2 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:41.151178 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ff930db9-4672-4335-850c-5a55550a1cb2 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:41.151543 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ff930db9-4672-4335-850c-5a55550a1cb2 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:41.151958 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ff930db9-4672-4335-850c-5a55550a1cb2 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:41.221459 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ff930db9-4672-4335-850c-5a55550a1cb2 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:41.230973 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ff930db9-4672-4335-850c-5a55550a1cb2 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:41.233156 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ff930db9-4672-4335-850c-5a55550a1cb2 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:41.234647 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ff930db9-4672-4335-850c-5a55550a1cb2 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] 10.222.0.42 "GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463" status: 200 len: 1408 microversion: 2.54 time: 0.098531 Oct 23 01:36:41.236234 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2730/5569] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:36:41 2022] GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463 => generated 1408 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:36:41.254579 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3703e3a9-d6ce-4666-b715-a6b54d84b643 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.831403 Oct 23 01:36:41.255541 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2840/5570] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:36:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:36:41.270366 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7e08a9a5-7d70-4d39-9c24-dcbbe1a7c0a8 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:41.271620 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7e08a9a5-7d70-4d39-9c24-dcbbe1a7c0a8 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: cee7dc56-efc1-4f64-8c5d-205414537c2a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:41.336994 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7e08a9a5-7d70-4d39-9c24-dcbbe1a7c0a8 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:41.345074 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7e08a9a5-7d70-4d39-9c24-dcbbe1a7c0a8 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/cee7dc56-efc1-4f64-8c5d-205414537c2a" status: 200 len: 1213 microversion: 2.1 time: 0.078576 Oct 23 01:36:41.350123 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2731/5571] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:41 2022] GET /compute/v2.1/servers/cee7dc56-efc1-4f64-8c5d-205414537c2a => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:36:41.854273 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0ff4d4f1-188e-4c98-9bcf-766edcfdbc73 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f5e02a3d-8409-4c7d-bd64-4377bfaf2353"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:36:41.857004 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0ff4d4f1-188e-4c98-9bcf-766edcfdbc73 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 5e817a84-2969-413e-b36b-96798e94b306] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:41.866438 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0ff4d4f1-188e-4c98-9bcf-766edcfdbc73 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:41.867021 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0ff4d4f1-188e-4c98-9bcf-766edcfdbc73 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:41.867470 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0ff4d4f1-188e-4c98-9bcf-766edcfdbc73 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:41.868169 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0ff4d4f1-188e-4c98-9bcf-766edcfdbc73 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:41.868630 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0ff4d4f1-188e-4c98-9bcf-766edcfdbc73 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:41.869057 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0ff4d4f1-188e-4c98-9bcf-766edcfdbc73 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:42.264124 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-26de7b3f-5aa3-4c70-8df4-375380b305ed tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:42.264905 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-26de7b3f-5aa3-4c70-8df4-375380b305ed tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] [instance: d643b34d-8491-45fb-b0b7-44444af0c463] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:42.278179 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-26de7b3f-5aa3-4c70-8df4-375380b305ed tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:42.278179 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-26de7b3f-5aa3-4c70-8df4-375380b305ed tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:42.278789 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-26de7b3f-5aa3-4c70-8df4-375380b305ed tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:42.279567 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-26de7b3f-5aa3-4c70-8df4-375380b305ed tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:42.280288 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-26de7b3f-5aa3-4c70-8df4-375380b305ed tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:42.280780 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-26de7b3f-5aa3-4c70-8df4-375380b305ed tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:42.412480 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-26de7b3f-5aa3-4c70-8df4-375380b305ed tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:42.427284 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-26de7b3f-5aa3-4c70-8df4-375380b305ed tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:42.429079 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-26de7b3f-5aa3-4c70-8df4-375380b305ed tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:42.431804 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-26de7b3f-5aa3-4c70-8df4-375380b305ed tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] 10.222.0.42 "GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463" status: 200 len: 1408 microversion: 2.54 time: 0.171846 Oct 23 01:36:42.433107 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2732/5572] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:36:42 2022] GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463 => generated 1408 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:36:42.443173 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-27bc3592-bba8-4a0a-9a9d-1d7d16f3b2d4 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:42.444839 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-27bc3592-bba8-4a0a-9a9d-1d7d16f3b2d4 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: cee7dc56-efc1-4f64-8c5d-205414537c2a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:42.517382 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-27bc3592-bba8-4a0a-9a9d-1d7d16f3b2d4 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:42.525620 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-27bc3592-bba8-4a0a-9a9d-1d7d16f3b2d4 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/cee7dc56-efc1-4f64-8c5d-205414537c2a" status: 200 len: 1213 microversion: 2.1 time: 0.090909 Oct 23 01:36:42.526328 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2733/5573] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:42 2022] GET /compute/v2.1/servers/cee7dc56-efc1-4f64-8c5d-205414537c2a => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:36:42.872747 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0ff4d4f1-188e-4c98-9bcf-766edcfdbc73 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "POST /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.021956 Oct 23 01:36:42.874006 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2841/5574] 10.222.0.42 () {60 vars in 1323 bytes} [Sun Oct 23 01:36:41 2022] POST /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306/os-volume_attachments => generated 194 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:36:43.459169 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5b13872b-47b7-4cf5-bbc4-d9abe42534f7 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:43.459858 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5b13872b-47b7-4cf5-bbc4-d9abe42534f7 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] [instance: d643b34d-8491-45fb-b0b7-44444af0c463] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:43.472265 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5b13872b-47b7-4cf5-bbc4-d9abe42534f7 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:43.479168 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5b13872b-47b7-4cf5-bbc4-d9abe42534f7 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:43.479637 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5b13872b-47b7-4cf5-bbc4-d9abe42534f7 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:43.480927 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5b13872b-47b7-4cf5-bbc4-d9abe42534f7 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:43.481391 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5b13872b-47b7-4cf5-bbc4-d9abe42534f7 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:43.481879 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5b13872b-47b7-4cf5-bbc4-d9abe42534f7 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:43.550636 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-50cbc74d-9f7b-495e-8ae5-1245bcc32c0d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:43.551575 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-50cbc74d-9f7b-495e-8ae5-1245bcc32c0d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: cee7dc56-efc1-4f64-8c5d-205414537c2a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:43.567233 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-50cbc74d-9f7b-495e-8ae5-1245bcc32c0d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:43.568079 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-50cbc74d-9f7b-495e-8ae5-1245bcc32c0d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:43.569055 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-50cbc74d-9f7b-495e-8ae5-1245bcc32c0d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:43.570718 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-50cbc74d-9f7b-495e-8ae5-1245bcc32c0d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:43.574667 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-50cbc74d-9f7b-495e-8ae5-1245bcc32c0d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:43.575561 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-50cbc74d-9f7b-495e-8ae5-1245bcc32c0d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:43.655701 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5b13872b-47b7-4cf5-bbc4-d9abe42534f7 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:43.666764 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5b13872b-47b7-4cf5-bbc4-d9abe42534f7 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:43.668956 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5b13872b-47b7-4cf5-bbc4-d9abe42534f7 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:43.670259 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5b13872b-47b7-4cf5-bbc4-d9abe42534f7 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] 10.222.0.42 "GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463" status: 200 len: 1426 microversion: 2.54 time: 0.215147 Oct 23 01:36:43.670978 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2734/5575] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:36:43 2022] GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463 => generated 1426 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:36:43.725586 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-50cbc74d-9f7b-495e-8ae5-1245bcc32c0d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:43.735186 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-50cbc74d-9f7b-495e-8ae5-1245bcc32c0d tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/cee7dc56-efc1-4f64-8c5d-205414537c2a" status: 200 len: 1265 microversion: 2.1 time: 0.189119 Oct 23 01:36:43.736322 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2842/5576] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:43 2022] GET /compute/v2.1/servers/cee7dc56-efc1-4f64-8c5d-205414537c2a => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:36:44.698736 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3beb7aea-ab3e-405e-a513-9a4af07fd5c6 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:44.700793 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3beb7aea-ab3e-405e-a513-9a4af07fd5c6 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] [instance: d643b34d-8491-45fb-b0b7-44444af0c463] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:44.709455 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3beb7aea-ab3e-405e-a513-9a4af07fd5c6 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:44.713708 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3beb7aea-ab3e-405e-a513-9a4af07fd5c6 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:44.713708 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3beb7aea-ab3e-405e-a513-9a4af07fd5c6 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:44.713708 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3beb7aea-ab3e-405e-a513-9a4af07fd5c6 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:44.713708 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3beb7aea-ab3e-405e-a513-9a4af07fd5c6 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:44.713708 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3beb7aea-ab3e-405e-a513-9a4af07fd5c6 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:44.763680 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7c89ba76-8f33-4ba5-aae7-637cf5268793 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:44.765029 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7c89ba76-8f33-4ba5-aae7-637cf5268793 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: cee7dc56-efc1-4f64-8c5d-205414537c2a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:44.773151 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c89ba76-8f33-4ba5-aae7-637cf5268793 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:44.786816 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c89ba76-8f33-4ba5-aae7-637cf5268793 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:44.787673 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c89ba76-8f33-4ba5-aae7-637cf5268793 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:44.788703 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c89ba76-8f33-4ba5-aae7-637cf5268793 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:44.789419 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c89ba76-8f33-4ba5-aae7-637cf5268793 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:44.790153 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c89ba76-8f33-4ba5-aae7-637cf5268793 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:44.951260 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3beb7aea-ab3e-405e-a513-9a4af07fd5c6 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:44.961509 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3beb7aea-ab3e-405e-a513-9a4af07fd5c6 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:44.962974 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3beb7aea-ab3e-405e-a513-9a4af07fd5c6 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:44.964229 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7c89ba76-8f33-4ba5-aae7-637cf5268793 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:44.970930 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3beb7aea-ab3e-405e-a513-9a4af07fd5c6 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] 10.222.0.42 "GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463" status: 200 len: 1414 microversion: 2.54 time: 0.277244 Oct 23 01:36:44.975054 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7c89ba76-8f33-4ba5-aae7-637cf5268793 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/cee7dc56-efc1-4f64-8c5d-205414537c2a" status: 200 len: 1271 microversion: 2.1 time: 0.215827 Oct 23 01:36:44.978661 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2843/5578] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:44 2022] GET /compute/v2.1/servers/cee7dc56-efc1-4f64-8c5d-205414537c2a => generated 1271 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:36:44.982561 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2735/5578] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:36:44 2022] GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463 => generated 1414 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:36:46.002365 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b797a737-a0a2-4c4a-99c5-b71a222e5c04 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:46.007171 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b797a737-a0a2-4c4a-99c5-b71a222e5c04 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] [instance: d643b34d-8491-45fb-b0b7-44444af0c463] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:46.007312 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2367aa49-cbef-4160-9785-1fb4630c1207 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:46.007802 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2367aa49-cbef-4160-9785-1fb4630c1207 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: cee7dc56-efc1-4f64-8c5d-205414537c2a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:46.019716 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b797a737-a0a2-4c4a-99c5-b71a222e5c04 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:46.021814 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b797a737-a0a2-4c4a-99c5-b71a222e5c04 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:46.025909 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2367aa49-cbef-4160-9785-1fb4630c1207 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:46.028284 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2367aa49-cbef-4160-9785-1fb4630c1207 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:46.028806 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b797a737-a0a2-4c4a-99c5-b71a222e5c04 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:46.029870 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b797a737-a0a2-4c4a-99c5-b71a222e5c04 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:46.032619 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b797a737-a0a2-4c4a-99c5-b71a222e5c04 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:46.032619 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b797a737-a0a2-4c4a-99c5-b71a222e5c04 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:46.052398 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2367aa49-cbef-4160-9785-1fb4630c1207 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:46.053633 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2367aa49-cbef-4160-9785-1fb4630c1207 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:46.055154 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2367aa49-cbef-4160-9785-1fb4630c1207 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:46.057535 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2367aa49-cbef-4160-9785-1fb4630c1207 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:46.464174 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b797a737-a0a2-4c4a-99c5-b71a222e5c04 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:46.483846 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b797a737-a0a2-4c4a-99c5-b71a222e5c04 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:46.487050 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b797a737-a0a2-4c4a-99c5-b71a222e5c04 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:46.491296 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b797a737-a0a2-4c4a-99c5-b71a222e5c04 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] 10.222.0.42 "GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463" status: 200 len: 1414 microversion: 2.54 time: 0.490708 Oct 23 01:36:46.495906 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2844/5579] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:36:45 2022] GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463 => generated 1414 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:36:46.816946 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2367aa49-cbef-4160-9785-1fb4630c1207 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:46.830225 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2367aa49-cbef-4160-9785-1fb4630c1207 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/cee7dc56-efc1-4f64-8c5d-205414537c2a" status: 200 len: 1313 microversion: 2.1 time: 0.823862 Oct 23 01:36:46.847962 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2736/5580] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:46 2022] GET /compute/v2.1/servers/cee7dc56-efc1-4f64-8c5d-205414537c2a => generated 1313 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:36:47.527263 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b7d2843a-d774-41b8-96a9-f733779c6e6c tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:47.528506 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b7d2843a-d774-41b8-96a9-f733779c6e6c tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] [instance: d643b34d-8491-45fb-b0b7-44444af0c463] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:47.549120 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b7d2843a-d774-41b8-96a9-f733779c6e6c tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:47.555565 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b7d2843a-d774-41b8-96a9-f733779c6e6c tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:47.560181 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b7d2843a-d774-41b8-96a9-f733779c6e6c tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:47.561243 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b7d2843a-d774-41b8-96a9-f733779c6e6c tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:47.561939 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b7d2843a-d774-41b8-96a9-f733779c6e6c tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:47.563140 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b7d2843a-d774-41b8-96a9-f733779c6e6c tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:47.771601 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b7d2843a-d774-41b8-96a9-f733779c6e6c tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:47.783773 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b7d2843a-d774-41b8-96a9-f733779c6e6c tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:47.790425 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b7d2843a-d774-41b8-96a9-f733779c6e6c tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:47.791693 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b7d2843a-d774-41b8-96a9-f733779c6e6c tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] 10.222.0.42 "GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463" status: 200 len: 1399 microversion: 2.54 time: 0.270370 Oct 23 01:36:47.792303 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2845/5581] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:36:47 2022] GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463 => generated 1399 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:36:47.828028 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cfa92d59-a2b6-4a7c-b99f-e4d1ea76e6ab tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Calling method '.version_select at 0x7f5cc0ec4430>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:47.855050 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0d394736-189e-42d4-bcea-d2f9fec985be tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:47.855685 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0d394736-189e-42d4-bcea-d2f9fec985be tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: cee7dc56-efc1-4f64-8c5d-205414537c2a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:47.872225 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0d394736-189e-42d4-bcea-d2f9fec985be tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:47.873199 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0d394736-189e-42d4-bcea-d2f9fec985be tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:47.873859 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0d394736-189e-42d4-bcea-d2f9fec985be tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:47.874814 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0d394736-189e-42d4-bcea-d2f9fec985be tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:47.875481 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0d394736-189e-42d4-bcea-d2f9fec985be tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:47.876114 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0d394736-189e-42d4-bcea-d2f9fec985be tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:47.950045 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cfa92d59-a2b6-4a7c-b99f-e4d1ea76e6ab tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1425002763" status: 204 len: 0 microversion: 2.54 time: 0.126839 Oct 23 01:36:47.955099 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2737/5582] 10.222.0.42 () {60 vars in 1319 bytes} [Sun Oct 23 01:36:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1425002763 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 23 01:36:47.971881 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1dd811b9-aaca-49a4-9f09-34c799a55101 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:47.972724 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1dd811b9-aaca-49a4-9f09-34c799a55101 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] [instance: d643b34d-8491-45fb-b0b7-44444af0c463] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:47.990320 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1dd811b9-aaca-49a4-9f09-34c799a55101 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:47.991466 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1dd811b9-aaca-49a4-9f09-34c799a55101 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:47.993005 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1dd811b9-aaca-49a4-9f09-34c799a55101 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:47.998766 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1dd811b9-aaca-49a4-9f09-34c799a55101 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:47.999735 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1dd811b9-aaca-49a4-9f09-34c799a55101 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:48.001581 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1dd811b9-aaca-49a4-9f09-34c799a55101 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:48.078042 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1dd811b9-aaca-49a4-9f09-34c799a55101 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] [instance: d643b34d-8491-45fb-b0b7-44444af0c463] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:36:48.525936 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1dd811b9-aaca-49a4-9f09-34c799a55101 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463" status: 204 len: 0 microversion: 2.54 time: 0.559631 Oct 23 01:36:48.527917 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2738/5583] 10.222.0.42 () {60 vars in 1280 bytes} [Sun Oct 23 01:36:47 2022] DELETE /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 23 01:36:48.743783 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0d394736-189e-42d4-bcea-d2f9fec985be tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:48.772314 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0d394736-189e-42d4-bcea-d2f9fec985be tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/cee7dc56-efc1-4f64-8c5d-205414537c2a" status: 200 len: 1313 microversion: 2.1 time: 0.921123 Oct 23 01:36:48.782387 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2846/5584] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:47 2022] GET /compute/v2.1/servers/cee7dc56-efc1-4f64-8c5d-205414537c2a => generated 1313 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:36:48.795940 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e7f3c1f9-565c-45b2-a747-b317cb14faf4 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:48.796588 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e7f3c1f9-565c-45b2-a747-b317cb14faf4 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] [instance: d643b34d-8491-45fb-b0b7-44444af0c463] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:48.831580 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e7f3c1f9-565c-45b2-a747-b317cb14faf4 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:48.832433 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e7f3c1f9-565c-45b2-a747-b317cb14faf4 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:48.832886 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e7f3c1f9-565c-45b2-a747-b317cb14faf4 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:48.833609 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e7f3c1f9-565c-45b2-a747-b317cb14faf4 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:48.834097 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e7f3c1f9-565c-45b2-a747-b317cb14faf4 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:48.834533 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e7f3c1f9-565c-45b2-a747-b317cb14faf4 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:48.966404 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-37d4afa4-947e-4aee-893e-b0494c064a8b req-070cddd7-8070-42c1-80d6-060707e94af7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cee7dc56-efc1-4f64-8c5d-205414537c2a", "tag": "58ca4614-775f-4258-8ff3-83dc18b6fa76"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:36:48.993540 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-37d4afa4-947e-4aee-893e-b0494c064a8b req-070cddd7-8070-42c1-80d6-060707e94af7 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:48.993540 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-37d4afa4-947e-4aee-893e-b0494c064a8b req-070cddd7-8070-42c1-80d6-060707e94af7 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:48.993540 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-37d4afa4-947e-4aee-893e-b0494c064a8b req-070cddd7-8070-42c1-80d6-060707e94af7 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:49.009611 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-37d4afa4-947e-4aee-893e-b0494c064a8b req-070cddd7-8070-42c1-80d6-060707e94af7 service nova] Creating event network-changed:58ca4614-775f-4258-8ff3-83dc18b6fa76 for instance cee7dc56-efc1-4f64-8c5d-205414537c2a on n-h1-master-1 Oct 23 01:36:49.019831 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-37d4afa4-947e-4aee-893e-b0494c064a8b req-070cddd7-8070-42c1-80d6-060707e94af7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.490151 Oct 23 01:36:49.038712 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2739/5585] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:36:49.103343 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e7f3c1f9-565c-45b2-a747-b317cb14faf4 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:49.119073 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e7f3c1f9-565c-45b2-a747-b317cb14faf4 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:49.121093 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e7f3c1f9-565c-45b2-a747-b317cb14faf4 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:49.122346 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e7f3c1f9-565c-45b2-a747-b317cb14faf4 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] 10.222.0.42 "GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463" status: 200 len: 1405 microversion: 2.54 time: 0.338829 Oct 23 01:36:49.123335 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2847/5586] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:36:48 2022] GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463 => generated 1405 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:36:49.802980 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3ac61980-1ca1-4c30-b16d-7bebf725a7b2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:49.806635 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3ac61980-1ca1-4c30-b16d-7bebf725a7b2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: cee7dc56-efc1-4f64-8c5d-205414537c2a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:49.818587 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3ac61980-1ca1-4c30-b16d-7bebf725a7b2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:49.819568 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3ac61980-1ca1-4c30-b16d-7bebf725a7b2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:49.820339 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3ac61980-1ca1-4c30-b16d-7bebf725a7b2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:49.821177 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3ac61980-1ca1-4c30-b16d-7bebf725a7b2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:49.821759 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3ac61980-1ca1-4c30-b16d-7bebf725a7b2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:49.822717 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3ac61980-1ca1-4c30-b16d-7bebf725a7b2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:50.149068 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-662c0dd9-beb0-449d-8ce6-57e91fe8ae05 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:50.149851 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-662c0dd9-beb0-449d-8ce6-57e91fe8ae05 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] [instance: d643b34d-8491-45fb-b0b7-44444af0c463] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:50.164773 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-662c0dd9-beb0-449d-8ce6-57e91fe8ae05 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:50.165878 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-662c0dd9-beb0-449d-8ce6-57e91fe8ae05 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:50.166443 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-662c0dd9-beb0-449d-8ce6-57e91fe8ae05 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:50.168257 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-662c0dd9-beb0-449d-8ce6-57e91fe8ae05 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:50.171126 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-662c0dd9-beb0-449d-8ce6-57e91fe8ae05 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:50.172522 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-662c0dd9-beb0-449d-8ce6-57e91fe8ae05 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:50.597055 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-662c0dd9-beb0-449d-8ce6-57e91fe8ae05 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:50.606158 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-662c0dd9-beb0-449d-8ce6-57e91fe8ae05 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:50.609695 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-662c0dd9-beb0-449d-8ce6-57e91fe8ae05 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:50.609695 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-662c0dd9-beb0-449d-8ce6-57e91fe8ae05 tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] 10.222.0.42 "GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463" status: 200 len: 1405 microversion: 2.54 time: 0.464700 Oct 23 01:36:50.611103 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2848/5587] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:36:50 2022] GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463 => generated 1405 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:36:50.691102 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3ac61980-1ca1-4c30-b16d-7bebf725a7b2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:50.700102 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3ac61980-1ca1-4c30-b16d-7bebf725a7b2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/cee7dc56-efc1-4f64-8c5d-205414537c2a" status: 200 len: 1313 microversion: 2.1 time: 0.903974 Oct 23 01:36:50.717054 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2740/5588] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:49 2022] GET /compute/v2.1/servers/cee7dc56-efc1-4f64-8c5d-205414537c2a => generated 1313 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:36:51.638863 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-369a36f3-e6e0-48cc-bbf6-7ff60031210b tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:51.639645 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-369a36f3-e6e0-48cc-bbf6-7ff60031210b tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] [instance: d643b34d-8491-45fb-b0b7-44444af0c463] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:51.649760 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:51.652810 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=6 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:51.654797 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-369a36f3-e6e0-48cc-bbf6-7ff60031210b tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:51.655401 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-369a36f3-e6e0-48cc-bbf6-7ff60031210b tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:51.656202 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-369a36f3-e6e0-48cc-bbf6-7ff60031210b tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:51.657197 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-369a36f3-e6e0-48cc-bbf6-7ff60031210b tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:51.658442 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-369a36f3-e6e0-48cc-bbf6-7ff60031210b tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:51.659150 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-369a36f3-e6e0-48cc-bbf6-7ff60031210b tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:51.712226 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-369a36f3-e6e0-48cc-bbf6-7ff60031210b tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:51.713195 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-369a36f3-e6e0-48cc-bbf6-7ff60031210b tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:51.713866 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-369a36f3-e6e0-48cc-bbf6-7ff60031210b tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:51.714705 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-369a36f3-e6e0-48cc-bbf6-7ff60031210b tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lazy-loading 'fault' on Instance uuid d643b34d-8491-45fb-b0b7-44444af0c463 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:36:51.723731 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7289e413-d897-4698-a68e-05f7da869dc6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:51.724344 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7289e413-d897-4698-a68e-05f7da869dc6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: cee7dc56-efc1-4f64-8c5d-205414537c2a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:51.738398 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7289e413-d897-4698-a68e-05f7da869dc6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:51.738970 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7289e413-d897-4698-a68e-05f7da869dc6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:51.739421 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7289e413-d897-4698-a68e-05f7da869dc6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:51.740806 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7289e413-d897-4698-a68e-05f7da869dc6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:51.741337 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7289e413-d897-4698-a68e-05f7da869dc6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:51.745022 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7289e413-d897-4698-a68e-05f7da869dc6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:51.773213 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-369a36f3-e6e0-48cc-bbf6-7ff60031210b tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:51.784577 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-369a36f3-e6e0-48cc-bbf6-7ff60031210b tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:51.787590 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-369a36f3-e6e0-48cc-bbf6-7ff60031210b tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803c776e416a49e3aa689f37bd24740a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9976c39e9d94256be3fba141c1ebd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:51.789558 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-369a36f3-e6e0-48cc-bbf6-7ff60031210b tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] 10.222.0.42 "GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463" status: 200 len: 1410 microversion: 2.54 time: 0.155401 Oct 23 01:36:51.791987 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2849/5589] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:36:51 2022] GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463 => generated 1410 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:36:52.106873 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7289e413-d897-4698-a68e-05f7da869dc6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:52.112008 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:52.121786 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7289e413-d897-4698-a68e-05f7da869dc6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/cee7dc56-efc1-4f64-8c5d-205414537c2a" status: 200 len: 1313 microversion: 2.1 time: 0.401791 Oct 23 01:36:52.123038 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2741/5590] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:51 2022] GET /compute/v2.1/servers/cee7dc56-efc1-4f64-8c5d-205414537c2a => generated 1313 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:36:52.328152 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5d1af13f-8b05-483d-a988-f8565d90e85c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:36:52.336727 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5d1af13f-8b05-483d-a988-f8565d90e85c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:52.352500 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5d1af13f-8b05-483d-a988-f8565d90e85c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:52.352999 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5d1af13f-8b05-483d-a988-f8565d90e85c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:52.355438 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5d1af13f-8b05-483d-a988-f8565d90e85c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:52.356191 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5d1af13f-8b05-483d-a988-f8565d90e85c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:52.357242 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5d1af13f-8b05-483d-a988-f8565d90e85c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:52.357690 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5d1af13f-8b05-483d-a988-f8565d90e85c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:52.579535 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5d1af13f-8b05-483d-a988-f8565d90e85c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "POST /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98/action" status: 202 len: 0 microversion: 2.1 time: 0.257520 Oct 23 01:36:52.580451 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2850/5591] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:36:52 2022] POST /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:36:52.591423 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9f68945f-41df-4875-b59a-eebe8153a8c8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:52.593864 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9f68945f-41df-4875-b59a-eebe8153a8c8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:52.616779 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=4 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:52.621097 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f68945f-41df-4875-b59a-eebe8153a8c8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:52.621097 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f68945f-41df-4875-b59a-eebe8153a8c8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:52.622365 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f68945f-41df-4875-b59a-eebe8153a8c8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:52.623204 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f68945f-41df-4875-b59a-eebe8153a8c8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:52.623675 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f68945f-41df-4875-b59a-eebe8153a8c8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:52.624284 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f68945f-41df-4875-b59a-eebe8153a8c8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:52.828604 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b457e741-ace8-4b31-9214-4b7dbe835bfd tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:52.829524 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b457e741-ace8-4b31-9214-4b7dbe835bfd tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] [instance: d643b34d-8491-45fb-b0b7-44444af0c463] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:52.847317 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b457e741-ace8-4b31-9214-4b7dbe835bfd tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:52.849638 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b457e741-ace8-4b31-9214-4b7dbe835bfd tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:52.850345 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b457e741-ace8-4b31-9214-4b7dbe835bfd tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:52.860851 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b457e741-ace8-4b31-9214-4b7dbe835bfd tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:52.861543 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b457e741-ace8-4b31-9214-4b7dbe835bfd tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:52.862089 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b457e741-ace8-4b31-9214-4b7dbe835bfd tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:52.890501 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-b457e741-ace8-4b31-9214-4b7dbe835bfd tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] HTTP exception thrown: Instance d643b34d-8491-45fb-b0b7-44444af0c463 could not be found. Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b457e741-ace8-4b31-9214-4b7dbe835bfd tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Request method failure captured: Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463 HTTP/1.1 Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJqH2aebtqgDtN7acj3_Fx6ZNnQh13XIYrIqxyyOcI53_ZKWlw5OKHbjOlQg6NBy3QyLQkyjfRQp3_M1HyGPa9hwQpU6tZ5qD7fGooQAhJcCc6ne--wqgmJYpNH51-RoB8wLd1LVwJNMqfDToEv3XQ9qUnnQDlq6ppvRpj9PKwbzeA4 Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: X-Openstack-Nova-Api-Version: 2.54 Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: b9976c39e9d94256be3fba141c1ebd97 Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServerShowV254Test-1758453762 Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b9976c39e9d94256be3fba141c1ebd97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b9976c39e9d94256be3fba141c1ebd97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b9976c39e9d94256be3fba141c1ebd97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b9976c39e9d94256be3fba141c1ebd97"}]}] Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServerShowV254Test-1758453762 Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: b9976c39e9d94256be3fba141c1ebd97 Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServerShowV254Test-1758453762 Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServerShowV254Test-1758453762-project Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 803c776e416a49e3aa689f37bd24740a Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServerShowV254Test-1758453762-project Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: exception: Instance d643b34d-8491-45fb-b0b7-44444af0c463 could not be found. Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'd643b34d-8491-45fb-b0b7-44444af0c463'} Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d643b34d-8491-45fb-b0b7-44444af0c463 could not be found. Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d643b34d-8491-45fb-b0b7-44444af0c463 could not be found. Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:36:52.892019 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:36:52.903423 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:36:52.903423 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:36:52.903423 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:36:52.903423 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:36:52.903423 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:36:52.903423 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d643b34d-8491-45fb-b0b7-44444af0c463 could not be found. Oct 23 01:36:52.903423 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:36:52.903423 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b457e741-ace8-4b31-9214-4b7dbe835bfd tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] Returning 404 to user: Instance d643b34d-8491-45fb-b0b7-44444af0c463 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:36:52.903423 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b457e741-ace8-4b31-9214-4b7dbe835bfd tempest-ServerShowV254Test-1758453762 tempest-ServerShowV254Test-1758453762-project] 10.222.0.42 "GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463" status: 404 len: 111 microversion: 2.54 time: 0.072089 Oct 23 01:36:52.903423 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2851/5592] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:36:52 2022] GET /compute/v2.1/servers/d643b34d-8491-45fb-b0b7-44444af0c463 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:36:53.144777 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-eb5f291a-14f0-4086-a7fc-d01f0c5d7c8b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:53.145832 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-eb5f291a-14f0-4086-a7fc-d01f0c5d7c8b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: cee7dc56-efc1-4f64-8c5d-205414537c2a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:53.154907 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb5f291a-14f0-4086-a7fc-d01f0c5d7c8b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:53.157257 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb5f291a-14f0-4086-a7fc-d01f0c5d7c8b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:53.160709 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb5f291a-14f0-4086-a7fc-d01f0c5d7c8b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:53.161467 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb5f291a-14f0-4086-a7fc-d01f0c5d7c8b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:53.161938 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb5f291a-14f0-4086-a7fc-d01f0c5d7c8b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:53.170522 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb5f291a-14f0-4086-a7fc-d01f0c5d7c8b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:53.352098 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9f68945f-41df-4875-b59a-eebe8153a8c8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:53.365288 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9f68945f-41df-4875-b59a-eebe8153a8c8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1671 microversion: 2.1 time: 0.779989 Oct 23 01:36:53.366647 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2742/5593] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:52 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1671 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:36:53.495533 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-eb5f291a-14f0-4086-a7fc-d01f0c5d7c8b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:53.501377 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:53.505460 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-eb5f291a-14f0-4086-a7fc-d01f0c5d7c8b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/cee7dc56-efc1-4f64-8c5d-205414537c2a" status: 200 len: 1313 microversion: 2.1 time: 0.364658 Oct 23 01:36:53.523622 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2852/5594] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:53 2022] GET /compute/v2.1/servers/cee7dc56-efc1-4f64-8c5d-205414537c2a => generated 1313 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:36:54.391791 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4b9a3757-a9b2-4988-97d6-3f7c6d703c0c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:54.395677 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4b9a3757-a9b2-4988-97d6-3f7c6d703c0c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:54.425507 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b9a3757-a9b2-4988-97d6-3f7c6d703c0c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:54.426006 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b9a3757-a9b2-4988-97d6-3f7c6d703c0c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:54.429989 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b9a3757-a9b2-4988-97d6-3f7c6d703c0c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:54.431201 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b9a3757-a9b2-4988-97d6-3f7c6d703c0c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:54.431938 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b9a3757-a9b2-4988-97d6-3f7c6d703c0c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:54.433041 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b9a3757-a9b2-4988-97d6-3f7c6d703c0c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:54.677905 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4b9a3757-a9b2-4988-97d6-3f7c6d703c0c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:54.688147 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4b9a3757-a9b2-4988-97d6-3f7c6d703c0c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1676 microversion: 2.1 time: 0.299453 Oct 23 01:36:54.688816 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2743/5595] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:54 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1676 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:36:54.695278 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-387c8277-6f41-4564-b4cb-6038afaa2002 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:54.696249 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-387c8277-6f41-4564-b4cb-6038afaa2002 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: cee7dc56-efc1-4f64-8c5d-205414537c2a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:54.697147 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-5715755a-ec4d-4295-a114-f6bdd19f222b req-13d17eaa-3ccf-4cac-854b-e1a794dadc37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cee7dc56-efc1-4f64-8c5d-205414537c2a", "name": "network-vif-plugged", "status": "completed", "tag": "58ca4614-775f-4258-8ff3-83dc18b6fa76"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:36:54.703296 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-387c8277-6f41-4564-b4cb-6038afaa2002 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:54.704003 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-387c8277-6f41-4564-b4cb-6038afaa2002 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:54.717926 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-387c8277-6f41-4564-b4cb-6038afaa2002 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:54.717926 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-387c8277-6f41-4564-b4cb-6038afaa2002 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:54.717926 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-387c8277-6f41-4564-b4cb-6038afaa2002 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:54.717926 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-387c8277-6f41-4564-b4cb-6038afaa2002 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:54.719075 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-5715755a-ec4d-4295-a114-f6bdd19f222b req-13d17eaa-3ccf-4cac-854b-e1a794dadc37 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:54.719075 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-5715755a-ec4d-4295-a114-f6bdd19f222b req-13d17eaa-3ccf-4cac-854b-e1a794dadc37 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:54.719318 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-5715755a-ec4d-4295-a114-f6bdd19f222b req-13d17eaa-3ccf-4cac-854b-e1a794dadc37 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:54.765711 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-5715755a-ec4d-4295-a114-f6bdd19f222b req-13d17eaa-3ccf-4cac-854b-e1a794dadc37 service nova] Creating event network-vif-plugged:58ca4614-775f-4258-8ff3-83dc18b6fa76 for instance cee7dc56-efc1-4f64-8c5d-205414537c2a on n-h1-master-1 Oct 23 01:36:54.778510 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-5715755a-ec4d-4295-a114-f6bdd19f222b req-13d17eaa-3ccf-4cac-854b-e1a794dadc37 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.329335 Oct 23 01:36:54.778810 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2853/5596] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:36:55.027431 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-387c8277-6f41-4564-b4cb-6038afaa2002 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:55.038776 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-387c8277-6f41-4564-b4cb-6038afaa2002 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/cee7dc56-efc1-4f64-8c5d-205414537c2a" status: 200 len: 1313 microversion: 2.1 time: 0.348893 Oct 23 01:36:55.054367 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2744/5597] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:54 2022] GET /compute/v2.1/servers/cee7dc56-efc1-4f64-8c5d-205414537c2a => generated 1313 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:36:55.715868 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-449b2008-4a2e-4a58-87cb-9de32d46d278 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:55.716606 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-449b2008-4a2e-4a58-87cb-9de32d46d278 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:55.740251 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-449b2008-4a2e-4a58-87cb-9de32d46d278 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:55.741082 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-449b2008-4a2e-4a58-87cb-9de32d46d278 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:55.741718 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-449b2008-4a2e-4a58-87cb-9de32d46d278 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:55.751014 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-449b2008-4a2e-4a58-87cb-9de32d46d278 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:55.754602 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-449b2008-4a2e-4a58-87cb-9de32d46d278 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:55.754602 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-449b2008-4a2e-4a58-87cb-9de32d46d278 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:56.064356 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-06194129-8c09-41f1-91d6-2fc1168cd50a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:56.064982 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-06194129-8c09-41f1-91d6-2fc1168cd50a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: cee7dc56-efc1-4f64-8c5d-205414537c2a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:56.085519 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-06194129-8c09-41f1-91d6-2fc1168cd50a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:56.087317 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-06194129-8c09-41f1-91d6-2fc1168cd50a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:56.088041 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-06194129-8c09-41f1-91d6-2fc1168cd50a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:56.092687 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-06194129-8c09-41f1-91d6-2fc1168cd50a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:56.092687 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-06194129-8c09-41f1-91d6-2fc1168cd50a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:56.092687 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-06194129-8c09-41f1-91d6-2fc1168cd50a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:56.110859 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-449b2008-4a2e-4a58-87cb-9de32d46d278 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:56.132658 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-449b2008-4a2e-4a58-87cb-9de32d46d278 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1669 microversion: 2.1 time: 0.420069 Oct 23 01:36:56.148091 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2854/5598] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:55 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1669 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:36:56.413046 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-06194129-8c09-41f1-91d6-2fc1168cd50a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:56.422221 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-06194129-8c09-41f1-91d6-2fc1168cd50a tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/cee7dc56-efc1-4f64-8c5d-205414537c2a" status: 200 len: 1313 microversion: 2.1 time: 0.361725 Oct 23 01:36:56.428038 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2745/5599] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:56 2022] GET /compute/v2.1/servers/cee7dc56-efc1-4f64-8c5d-205414537c2a => generated 1313 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:36:56.628862 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-11cd1136-3c1d-4448-b41c-ee75834ba708 tempest-QuotasTestJSON-1043960788 tempest-QuotasTestJSON-1043960788-project] Calling method '.version_select at 0x7f5cc0a30550>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:56.691900 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-11cd1136-3c1d-4448-b41c-ee75834ba708 tempest-QuotasTestJSON-1043960788 tempest-QuotasTestJSON-1043960788-project] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/45346836c7a34f269b42e6796262cc0b/defaults" status: 200 len: 371 microversion: 2.1 time: 0.223186 Oct 23 01:36:56.692490 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2855/5600] 10.222.0.42 () {58 vars in 1269 bytes} [Sun Oct 23 01:36:56 2022] GET /compute/v2.1/os-quota-sets/45346836c7a34f269b42e6796262cc0b/defaults => generated 371 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:36:56.704873 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7f51fec0-df9c-4bda-b8a9-92820cfb9020 tempest-QuotasTestJSON-1043960788 tempest-QuotasTestJSON-1043960788-project] Calling method '.version_select at 0x7f5cc14e9550>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:56.779891 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7f51fec0-df9c-4bda-b8a9-92820cfb9020 tempest-QuotasTestJSON-1043960788 tempest-QuotasTestJSON-1043960788-project] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/45346836c7a34f269b42e6796262cc0b" status: 200 len: 371 microversion: 2.1 time: 0.078892 Oct 23 01:36:56.780740 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2746/5601] 10.222.0.42 () {58 vars in 1242 bytes} [Sun Oct 23 01:36:56 2022] GET /compute/v2.1/os-quota-sets/45346836c7a34f269b42e6796262cc0b => generated 371 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:36:56.795332 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d48b54bc-82f3-49b8-a7b4-05cd15c0295d tempest-QuotasTestJSON-1043960788 tempest-QuotasTestJSON-1043960788-project] Calling method '.version_select at 0x7f5cc0aa5d30>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:56.863399 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d48b54bc-82f3-49b8-a7b4-05cd15c0295d tempest-QuotasTestJSON-1043960788 tempest-QuotasTestJSON-1043960788-project] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/45346836c7a34f269b42e6796262cc0b/defaults" status: 200 len: 371 microversion: 2.1 time: 0.072619 Oct 23 01:36:56.864550 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2856/5602] 10.222.0.42 () {58 vars in 1269 bytes} [Sun Oct 23 01:36:56 2022] GET /compute/v2.1/os-quota-sets/45346836c7a34f269b42e6796262cc0b/defaults => generated 371 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:36:56.883772 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7795ee1a-a5e7-4c01-8776-898b52fc0420 tempest-QuotasTestJSON-1043960788 tempest-QuotasTestJSON-1043960788-project] Calling method '.version_select at 0x7f5cc0ec4ee0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:56.958608 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7795ee1a-a5e7-4c01-8776-898b52fc0420 tempest-QuotasTestJSON-1043960788 tempest-QuotasTestJSON-1043960788-project] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/45346836c7a34f269b42e6796262cc0b" status: 200 len: 371 microversion: 2.1 time: 0.080579 Oct 23 01:36:56.959436 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2747/5603] 10.222.0.42 () {58 vars in 1242 bytes} [Sun Oct 23 01:36:56 2022] GET /compute/v2.1/os-quota-sets/45346836c7a34f269b42e6796262cc0b => generated 371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:36:56.972961 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-33a03d56-c8b8-4d80-8b64-8a053c8cf62a tempest-QuotasTestJSON-1043960788 tempest-QuotasTestJSON-1043960788-project] Calling method '.version_select at 0x7f5cc0a30ee0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:57.050319 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-33a03d56-c8b8-4d80-8b64-8a053c8cf62a tempest-QuotasTestJSON-1043960788 tempest-QuotasTestJSON-1043960788-project] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/45346836c7a34f269b42e6796262cc0b?user_id=2e5a65b87242437d86b126ebfe5f26ec" status: 200 len: 371 microversion: 2.1 time: 0.081130 Oct 23 01:36:57.052326 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2857/5604] 10.222.0.42 () {58 vars in 1323 bytes} [Sun Oct 23 01:36:56 2022] GET /compute/v2.1/os-quota-sets/45346836c7a34f269b42e6796262cc0b?user_id=2e5a65b87242437d86b126ebfe5f26ec => generated 371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:36:57.455731 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-aecd795b-f550-47ef-acc1-c5cdfbacb663 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:57.721310 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-aecd795b-f550-47ef-acc1-c5cdfbacb663 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: cee7dc56-efc1-4f64-8c5d-205414537c2a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:57.721310 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aecd795b-f550-47ef-acc1-c5cdfbacb663 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:57.721310 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aecd795b-f550-47ef-acc1-c5cdfbacb663 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:57.721310 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aecd795b-f550-47ef-acc1-c5cdfbacb663 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:57.721310 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aecd795b-f550-47ef-acc1-c5cdfbacb663 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:57.721310 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aecd795b-f550-47ef-acc1-c5cdfbacb663 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:57.721310 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aecd795b-f550-47ef-acc1-c5cdfbacb663 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:57.724467 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2c370760-6376-410a-a2fd-45172d5c07e1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:57.724467 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2c370760-6376-410a-a2fd-45172d5c07e1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 5e817a84-2969-413e-b36b-96798e94b306] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:57.724467 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2c370760-6376-410a-a2fd-45172d5c07e1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:57.724467 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2c370760-6376-410a-a2fd-45172d5c07e1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:57.724467 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2c370760-6376-410a-a2fd-45172d5c07e1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:57.724467 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2c370760-6376-410a-a2fd-45172d5c07e1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:57.724467 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2c370760-6376-410a-a2fd-45172d5c07e1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:57.724467 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2c370760-6376-410a-a2fd-45172d5c07e1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:57.724467 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-2c370760-6376-410a-a2fd-45172d5c07e1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lazy-loading 'services' on Instance uuid 5e817a84-2969-413e-b36b-96798e94b306 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:36:58.009449 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2c370760-6376-410a-a2fd-45172d5c07e1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306/os-volume_attachments/f5e02a3d-8409-4c7d-bd64-4377bfaf2353" status: 202 len: 0 microversion: 2.1 time: 0.510972 Oct 23 01:36:58.026735 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2858/5605] 10.222.0.42 () {58 vars in 1416 bytes} [Sun Oct 23 01:36:57 2022] DELETE /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306/os-volume_attachments/f5e02a3d-8409-4c7d-bd64-4377bfaf2353 => generated 0 bytes in 529 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:36:58.034534 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ea65cb11-a201-4528-a7bc-079ba45cf81b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:58.037580 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ea65cb11-a201-4528-a7bc-079ba45cf81b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 5e817a84-2969-413e-b36b-96798e94b306] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:58.046241 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ea65cb11-a201-4528-a7bc-079ba45cf81b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:58.046962 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ea65cb11-a201-4528-a7bc-079ba45cf81b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:58.047633 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ea65cb11-a201-4528-a7bc-079ba45cf81b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:58.049270 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ea65cb11-a201-4528-a7bc-079ba45cf81b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:58.049952 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ea65cb11-a201-4528-a7bc-079ba45cf81b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:58.050642 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ea65cb11-a201-4528-a7bc-079ba45cf81b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:58.092536 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ea65cb11-a201-4528-a7bc-079ba45cf81b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064008 Oct 23 01:36:58.093307 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2859/5606] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:36:58 2022] GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:36:58.199956 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-aecd795b-f550-47ef-acc1-c5cdfbacb663 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:58.210228 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-aecd795b-f550-47ef-acc1-c5cdfbacb663 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/cee7dc56-efc1-4f64-8c5d-205414537c2a" status: 200 len: 1500 microversion: 2.1 time: 0.762346 Oct 23 01:36:58.210840 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2748/5607] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:57 2022] GET /compute/v2.1/servers/cee7dc56-efc1-4f64-8c5d-205414537c2a => generated 1500 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:36:58.238931 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6604a22b-247a-4b82-8281-01229ac5df5e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:36:58.240298 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6604a22b-247a-4b82-8281-01229ac5df5e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: cee7dc56-efc1-4f64-8c5d-205414537c2a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:58.250302 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6604a22b-247a-4b82-8281-01229ac5df5e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:58.251555 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6604a22b-247a-4b82-8281-01229ac5df5e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:58.254319 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6604a22b-247a-4b82-8281-01229ac5df5e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:58.256372 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6604a22b-247a-4b82-8281-01229ac5df5e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:58.257097 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6604a22b-247a-4b82-8281-01229ac5df5e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:58.258615 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6604a22b-247a-4b82-8281-01229ac5df5e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:58.284890 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-6604a22b-247a-4b82-8281-01229ac5df5e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lazy-loading 'flavor' on Instance uuid cee7dc56-efc1-4f64-8c5d-205414537c2a {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:36:58.581964 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6604a22b-247a-4b82-8281-01229ac5df5e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "POST /compute/v2.1/servers/cee7dc56-efc1-4f64-8c5d-205414537c2a/action" status: 202 len: 0 microversion: 2.1 time: 0.350015 Oct 23 01:36:58.582716 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2860/5608] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:36:58 2022] POST /compute/v2.1/servers/cee7dc56-efc1-4f64-8c5d-205414537c2a/action => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:36:58.591267 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5a5935a8-4bed-4bdc-af9f-8d93faa16450 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:58.591886 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5a5935a8-4bed-4bdc-af9f-8d93faa16450 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: cee7dc56-efc1-4f64-8c5d-205414537c2a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:58.598820 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5a5935a8-4bed-4bdc-af9f-8d93faa16450 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:58.599315 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5a5935a8-4bed-4bdc-af9f-8d93faa16450 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:58.599752 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5a5935a8-4bed-4bdc-af9f-8d93faa16450 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:58.606298 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5a5935a8-4bed-4bdc-af9f-8d93faa16450 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:58.606785 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5a5935a8-4bed-4bdc-af9f-8d93faa16450 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:58.607241 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5a5935a8-4bed-4bdc-af9f-8d93faa16450 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:58.939154 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5a5935a8-4bed-4bdc-af9f-8d93faa16450 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:36:58.948510 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5a5935a8-4bed-4bdc-af9f-8d93faa16450 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/cee7dc56-efc1-4f64-8c5d-205414537c2a" status: 200 len: 1508 microversion: 2.1 time: 0.360982 Oct 23 01:36:58.950525 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2749/5609] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:58 2022] GET /compute/v2.1/servers/cee7dc56-efc1-4f64-8c5d-205414537c2a => generated 1508 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:36:59.107045 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-abca1ea7-6ff4-4f5a-9481-0296110eb7b0 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:59.109953 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-abca1ea7-6ff4-4f5a-9481-0296110eb7b0 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 5e817a84-2969-413e-b36b-96798e94b306] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:59.122132 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-abca1ea7-6ff4-4f5a-9481-0296110eb7b0 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:59.123677 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-abca1ea7-6ff4-4f5a-9481-0296110eb7b0 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:59.124881 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-abca1ea7-6ff4-4f5a-9481-0296110eb7b0 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:59.126268 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-abca1ea7-6ff4-4f5a-9481-0296110eb7b0 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:59.130990 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-abca1ea7-6ff4-4f5a-9481-0296110eb7b0 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:59.132339 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-abca1ea7-6ff4-4f5a-9481-0296110eb7b0 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:59.183087 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-abca1ea7-6ff4-4f5a-9481-0296110eb7b0 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081249 Oct 23 01:36:59.183986 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2861/5610] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:36:59 2022] GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:36:59.973245 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0c166e9f-3adf-47a3-9db9-e6eea7dec7e2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:36:59.973865 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0c166e9f-3adf-47a3-9db9-e6eea7dec7e2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: cee7dc56-efc1-4f64-8c5d-205414537c2a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:36:59.982697 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0c166e9f-3adf-47a3-9db9-e6eea7dec7e2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:59.983472 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0c166e9f-3adf-47a3-9db9-e6eea7dec7e2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:59.984104 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0c166e9f-3adf-47a3-9db9-e6eea7dec7e2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:36:59.985086 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0c166e9f-3adf-47a3-9db9-e6eea7dec7e2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:36:59.985685 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0c166e9f-3adf-47a3-9db9-e6eea7dec7e2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:36:59.986363 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0c166e9f-3adf-47a3-9db9-e6eea7dec7e2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:00.199916 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-01f2b60d-b0fc-486d-877f-b583f671d247 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:00.199916 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-01f2b60d-b0fc-486d-877f-b583f671d247 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 5e817a84-2969-413e-b36b-96798e94b306] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:00.213104 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01f2b60d-b0fc-486d-877f-b583f671d247 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:00.215373 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01f2b60d-b0fc-486d-877f-b583f671d247 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:00.216492 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01f2b60d-b0fc-486d-877f-b583f671d247 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:00.218524 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01f2b60d-b0fc-486d-877f-b583f671d247 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:00.220556 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01f2b60d-b0fc-486d-877f-b583f671d247 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:00.221768 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01f2b60d-b0fc-486d-877f-b583f671d247 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:00.282288 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-01f2b60d-b0fc-486d-877f-b583f671d247 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090436 Oct 23 01:37:00.283465 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2862/5611] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:37:00 2022] GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:37:00.429383 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0c166e9f-3adf-47a3-9db9-e6eea7dec7e2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:37:00.442314 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0c166e9f-3adf-47a3-9db9-e6eea7dec7e2 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/cee7dc56-efc1-4f64-8c5d-205414537c2a" status: 200 len: 1491 microversion: 2.1 time: 0.472564 Oct 23 01:37:00.444660 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2750/5612] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:36:59 2022] GET /compute/v2.1/servers/cee7dc56-efc1-4f64-8c5d-205414537c2a => generated 1491 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:37:00.475111 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7a0be954-f81f-484f-972f-b9f9f67d9106 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:00.475389 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7a0be954-f81f-484f-972f-b9f9f67d9106 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: cee7dc56-efc1-4f64-8c5d-205414537c2a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:00.492604 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a0be954-f81f-484f-972f-b9f9f67d9106 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:00.494232 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a0be954-f81f-484f-972f-b9f9f67d9106 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:00.498563 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a0be954-f81f-484f-972f-b9f9f67d9106 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:00.499463 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a0be954-f81f-484f-972f-b9f9f67d9106 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:00.504888 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a0be954-f81f-484f-972f-b9f9f67d9106 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:00.504888 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a0be954-f81f-484f-972f-b9f9f67d9106 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:00.549253 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7a0be954-f81f-484f-972f-b9f9f67d9106 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: cee7dc56-efc1-4f64-8c5d-205414537c2a] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:37:00.736735 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b91cda8a-3afc-4492-99d2-39f69b044cd9 tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] Action: 'create', calling method: .version_select at 0x7f5cc0a2d700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-312373772"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:37:01.032691 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7a0be954-f81f-484f-972f-b9f9f67d9106 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "DELETE /compute/v2.1/servers/cee7dc56-efc1-4f64-8c5d-205414537c2a" status: 204 len: 0 microversion: 2.1 time: 0.566876 Oct 23 01:37:01.033863 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2751/5613] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:37:00 2022] DELETE /compute/v2.1/servers/cee7dc56-efc1-4f64-8c5d-205414537c2a => generated 0 bytes in 570 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:37:01.047421 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5bf2733c-8673-48a3-9235-bafd68960697 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:01.048766 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5bf2733c-8673-48a3-9235-bafd68960697 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: cee7dc56-efc1-4f64-8c5d-205414537c2a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:01.071744 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5bf2733c-8673-48a3-9235-bafd68960697 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:01.073423 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5bf2733c-8673-48a3-9235-bafd68960697 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:01.073898 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5bf2733c-8673-48a3-9235-bafd68960697 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:01.076973 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5bf2733c-8673-48a3-9235-bafd68960697 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:01.078253 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5bf2733c-8673-48a3-9235-bafd68960697 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:01.079982 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5bf2733c-8673-48a3-9235-bafd68960697 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:01.488784 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5bf2733c-8673-48a3-9235-bafd68960697 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:37:01.499266 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5bf2733c-8673-48a3-9235-bafd68960697 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/cee7dc56-efc1-4f64-8c5d-205414537c2a" status: 200 len: 1497 microversion: 2.1 time: 0.460305 Oct 23 01:37:01.500388 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2752/5614] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:37:01 2022] GET /compute/v2.1/servers/cee7dc56-efc1-4f64-8c5d-205414537c2a => generated 1497 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:37:01.506162 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d1930f89-3768-4061-94a7-900e411a8075 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:01.508549 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d1930f89-3768-4061-94a7-900e411a8075 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 5e817a84-2969-413e-b36b-96798e94b306] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:01.515404 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d1930f89-3768-4061-94a7-900e411a8075 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:01.516387 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d1930f89-3768-4061-94a7-900e411a8075 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:01.516960 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d1930f89-3768-4061-94a7-900e411a8075 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:01.517965 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d1930f89-3768-4061-94a7-900e411a8075 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:01.518751 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d1930f89-3768-4061-94a7-900e411a8075 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:01.519363 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d1930f89-3768-4061-94a7-900e411a8075 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:01.567967 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d1930f89-3768-4061-94a7-900e411a8075 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066135 Oct 23 01:37:01.568729 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2753/5615] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:37:01 2022] GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:37:01.591931 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b91cda8a-3afc-4492-99d2-39f69b044cd9 tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.307177 Oct 23 01:37:01.592921 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2863/5616] 10.222.0.42 () {60 vars in 1155 bytes} [Sun Oct 23 01:37:00 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1309 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 23 01:37:01.610562 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-faaa1ae4-c293-4edb-bad7-fa9ee462f2bc tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] Calling method '.version_select at 0x7f5cc62c4550>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:01.683603 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-faaa1ae4-c293-4edb-bad7-fa9ee462f2bc tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/18a9cb0e-7e06-41eb-a5ba-daaad516dac1" status: 200 len: 344 microversion: 2.1 time: 0.076947 Oct 23 01:37:01.690699 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2754/5617] 10.222.0.42 () {58 vars in 1245 bytes} [Sun Oct 23 01:37:01 2022] GET /compute/v2.1/os-volumes/18a9cb0e-7e06-41eb-a5ba-daaad516dac1 => generated 344 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:37:02.528775 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f9e0d8f1-b823-4d36-a38b-e3f29e466f2e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:02.529355 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f9e0d8f1-b823-4d36-a38b-e3f29e466f2e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: cee7dc56-efc1-4f64-8c5d-205414537c2a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:02.541673 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f9e0d8f1-b823-4d36-a38b-e3f29e466f2e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:02.542043 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f9e0d8f1-b823-4d36-a38b-e3f29e466f2e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:02.542486 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f9e0d8f1-b823-4d36-a38b-e3f29e466f2e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:02.543196 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f9e0d8f1-b823-4d36-a38b-e3f29e466f2e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:02.557623 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f9e0d8f1-b823-4d36-a38b-e3f29e466f2e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:02.558446 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f9e0d8f1-b823-4d36-a38b-e3f29e466f2e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:02.582958 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5848e5b0-211e-4ea7-9678-6991f687755b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:02.585290 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5848e5b0-211e-4ea7-9678-6991f687755b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 5e817a84-2969-413e-b36b-96798e94b306] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:02.610322 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5848e5b0-211e-4ea7-9678-6991f687755b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:02.614837 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5848e5b0-211e-4ea7-9678-6991f687755b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:02.615433 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5848e5b0-211e-4ea7-9678-6991f687755b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:02.616197 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5848e5b0-211e-4ea7-9678-6991f687755b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:02.616665 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5848e5b0-211e-4ea7-9678-6991f687755b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:02.617087 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5848e5b0-211e-4ea7-9678-6991f687755b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:02.704662 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5848e5b0-211e-4ea7-9678-6991f687755b tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126059 Oct 23 01:37:02.704662 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2755/5618] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:37:02 2022] GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:37:02.712221 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-aa691579-a9f6-4618-8f28-f73de59f0089 tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] Calling method '.version_select at 0x7f5cc0ec49d0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:02.841535 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-aa691579-a9f6-4618-8f28-f73de59f0089 tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/18a9cb0e-7e06-41eb-a5ba-daaad516dac1" status: 200 len: 344 microversion: 2.1 time: 0.136472 Oct 23 01:37:02.842148 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2756/5619] 10.222.0.42 () {58 vars in 1245 bytes} [Sun Oct 23 01:37:02 2022] GET /compute/v2.1/os-volumes/18a9cb0e-7e06-41eb-a5ba-daaad516dac1 => generated 344 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:37:03.385653 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f9e0d8f1-b823-4d36-a38b-e3f29e466f2e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:37:03.396194 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f9e0d8f1-b823-4d36-a38b-e3f29e466f2e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/cee7dc56-efc1-4f64-8c5d-205414537c2a" status: 200 len: 1497 microversion: 2.1 time: 0.872427 Oct 23 01:37:03.401934 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2864/5620] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:37:02 2022] GET /compute/v2.1/servers/cee7dc56-efc1-4f64-8c5d-205414537c2a => generated 1497 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:37:03.718149 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ccf82482-bf2e-4624-b82a-ff2f2e879e5a tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:03.720879 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ccf82482-bf2e-4624-b82a-ff2f2e879e5a tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 5e817a84-2969-413e-b36b-96798e94b306] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:03.742331 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ccf82482-bf2e-4624-b82a-ff2f2e879e5a tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:03.742829 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ccf82482-bf2e-4624-b82a-ff2f2e879e5a tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:03.743272 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ccf82482-bf2e-4624-b82a-ff2f2e879e5a tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:03.748019 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ccf82482-bf2e-4624-b82a-ff2f2e879e5a tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:03.748514 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ccf82482-bf2e-4624-b82a-ff2f2e879e5a tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:03.748954 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ccf82482-bf2e-4624-b82a-ff2f2e879e5a tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:03.803283 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ccf82482-bf2e-4624-b82a-ff2f2e879e5a tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091117 Oct 23 01:37:03.804235 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2757/5621] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:37:03 2022] GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:37:03.856721 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2947996e-680e-462e-ac78-c5b8013f4f90 tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] Calling method '.version_select at 0x7f5cc09f5ca0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:03.930620 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2947996e-680e-462e-ac78-c5b8013f4f90 tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/18a9cb0e-7e06-41eb-a5ba-daaad516dac1" status: 200 len: 345 microversion: 2.1 time: 0.078405 Oct 23 01:37:03.931593 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2865/5622] 10.222.0.42 () {58 vars in 1245 bytes} [Sun Oct 23 01:37:03 2022] GET /compute/v2.1/os-volumes/18a9cb0e-7e06-41eb-a5ba-daaad516dac1 => generated 345 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:37:03.945320 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1a9fa2f2-e272-4c28-ac78-326327e1a538 tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] Action: 'create', calling method: .version_select at 0x7f5cc0f22820>, body: {"snapshot": {"volume_id": "18a9cb0e-7e06-41eb-a5ba-daaad516dac1", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-412069895"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:37:04.431101 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2f204338-62c0-4f78-a98a-5f95105bbb34 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:04.432027 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2f204338-62c0-4f78-a98a-5f95105bbb34 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: cee7dc56-efc1-4f64-8c5d-205414537c2a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:04.451299 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f204338-62c0-4f78-a98a-5f95105bbb34 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:04.452352 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f204338-62c0-4f78-a98a-5f95105bbb34 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:04.454736 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f204338-62c0-4f78-a98a-5f95105bbb34 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:04.455717 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f204338-62c0-4f78-a98a-5f95105bbb34 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:04.456536 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f204338-62c0-4f78-a98a-5f95105bbb34 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:04.457867 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f204338-62c0-4f78-a98a-5f95105bbb34 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:04.555261 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1a9fa2f2-e272-4c28-ac78-326327e1a538 tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] 10.222.0.42 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.613795 Oct 23 01:37:04.555947 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2758/5623] 10.222.0.42 () {60 vars in 1162 bytes} [Sun Oct 23 01:37:03 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:37:04.572086 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1f5c0bf7-cd24-460b-af9c-707c44701166 tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] Calling method '.version_select at 0x7f5cc0ec4940>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:04.644299 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1f5c0bf7-cd24-460b-af9c-707c44701166 tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/2f45a5f2-4782-4c77-aebc-278c3a1bb8d9" status: 200 len: 286 microversion: 2.1 time: 0.080508 Oct 23 01:37:04.651642 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2759/5624] 10.222.0.42 () {58 vars in 1251 bytes} [Sun Oct 23 01:37:04 2022] GET /compute/v2.1/os-snapshots/2f45a5f2-4782-4c77-aebc-278c3a1bb8d9 => generated 286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:37:04.669164 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5f96ad15-34d9-4705-aedd-89002f070e09 tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] Calling method '.version_select at 0x7f5cc14e9f70>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:04.695808 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2f204338-62c0-4f78-a98a-5f95105bbb34 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:37:04.710888 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2f204338-62c0-4f78-a98a-5f95105bbb34 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/cee7dc56-efc1-4f64-8c5d-205414537c2a" status: 200 len: 1455 microversion: 2.1 time: 0.280565 Oct 23 01:37:04.711485 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2866/5625] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:37:04 2022] GET /compute/v2.1/servers/cee7dc56-efc1-4f64-8c5d-205414537c2a => generated 1455 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:37:04.732813 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-b296db53-b1bc-4349-8843-2fb4abcad7fb req-66d3aa01-b6e6-4315-8dfd-f6402975406f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cee7dc56-efc1-4f64-8c5d-205414537c2a", "name": "network-vif-deleted", "tag": "58ca4614-775f-4258-8ff3-83dc18b6fa76"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:37:04.739017 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5f96ad15-34d9-4705-aedd-89002f070e09 tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.085552 Oct 23 01:37:04.739689 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2760/5626] 10.222.0.42 () {58 vars in 1140 bytes} [Sun Oct 23 01:37:04 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:37:04.758933 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bc4a9c0d-fb20-4b54-a86b-3abba9f51004 tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] Calling method '.version_select at 0x7f5cc0ec4ca0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:04.772184 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-b296db53-b1bc-4349-8843-2fb4abcad7fb req-66d3aa01-b6e6-4315-8dfd-f6402975406f service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:04.772940 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-b296db53-b1bc-4349-8843-2fb4abcad7fb req-66d3aa01-b6e6-4315-8dfd-f6402975406f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:04.773892 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-b296db53-b1bc-4349-8843-2fb4abcad7fb req-66d3aa01-b6e6-4315-8dfd-f6402975406f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:04.788105 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-b296db53-b1bc-4349-8843-2fb4abcad7fb req-66d3aa01-b6e6-4315-8dfd-f6402975406f service nova] Creating event network-vif-deleted:58ca4614-775f-4258-8ff3-83dc18b6fa76 for instance cee7dc56-efc1-4f64-8c5d-205414537c2a on n-h1-master-1 Oct 23 01:37:04.794149 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-b296db53-b1bc-4349-8843-2fb4abcad7fb req-66d3aa01-b6e6-4315-8dfd-f6402975406f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074713 Oct 23 01:37:04.794955 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2867/5627] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:37:04.818453 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ff66b32b-2fa5-45b6-9dd2-cf93d5bf4bf5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:04.821251 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ff66b32b-2fa5-45b6-9dd2-cf93d5bf4bf5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 5e817a84-2969-413e-b36b-96798e94b306] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:04.830987 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ff66b32b-2fa5-45b6-9dd2-cf93d5bf4bf5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:04.830987 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ff66b32b-2fa5-45b6-9dd2-cf93d5bf4bf5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:04.831435 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ff66b32b-2fa5-45b6-9dd2-cf93d5bf4bf5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:04.832432 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ff66b32b-2fa5-45b6-9dd2-cf93d5bf4bf5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:04.833041 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ff66b32b-2fa5-45b6-9dd2-cf93d5bf4bf5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:04.833613 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ff66b32b-2fa5-45b6-9dd2-cf93d5bf4bf5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:04.851385 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bc4a9c0d-fb20-4b54-a86b-3abba9f51004 tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/2f45a5f2-4782-4c77-aebc-278c3a1bb8d9" status: 200 len: 286 microversion: 2.1 time: 0.103178 Oct 23 01:37:04.862466 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2761/5628] 10.222.0.42 () {58 vars in 1251 bytes} [Sun Oct 23 01:37:04 2022] GET /compute/v2.1/os-snapshots/2f45a5f2-4782-4c77-aebc-278c3a1bb8d9 => generated 286 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:37:04.915165 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ff66b32b-2fa5-45b6-9dd2-cf93d5bf4bf5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102286 Oct 23 01:37:04.915767 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2868/5629] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:37:04 2022] GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:37:05.740296 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-343d289d-865a-4f63-b83e-d78cc2cf8aa5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:05.741095 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-343d289d-865a-4f63-b83e-d78cc2cf8aa5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: cee7dc56-efc1-4f64-8c5d-205414537c2a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:05.749260 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-343d289d-865a-4f63-b83e-d78cc2cf8aa5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:05.749752 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-343d289d-865a-4f63-b83e-d78cc2cf8aa5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:05.750219 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-343d289d-865a-4f63-b83e-d78cc2cf8aa5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:05.751262 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-343d289d-865a-4f63-b83e-d78cc2cf8aa5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:05.751716 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-343d289d-865a-4f63-b83e-d78cc2cf8aa5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:05.752144 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-343d289d-865a-4f63-b83e-d78cc2cf8aa5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:05.790097 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-343d289d-865a-4f63-b83e-d78cc2cf8aa5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:05.790790 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-343d289d-865a-4f63-b83e-d78cc2cf8aa5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:05.791997 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-343d289d-865a-4f63-b83e-d78cc2cf8aa5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:05.792589 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-343d289d-865a-4f63-b83e-d78cc2cf8aa5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lazy-loading 'fault' on Instance uuid cee7dc56-efc1-4f64-8c5d-205414537c2a {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:37:05.870692 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-343d289d-865a-4f63-b83e-d78cc2cf8aa5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634bed7898c24baca6ba00392d49eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842dcab8b48c43d7963a538d914b0b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:37:05.870901 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7ea0fcc7-cb20-4bd2-ab8f-8b6d6cca5a94 tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] Calling method '.version_select at 0x7f5cc09f5040>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:05.889376 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-343d289d-865a-4f63-b83e-d78cc2cf8aa5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/cee7dc56-efc1-4f64-8c5d-205414537c2a" status: 200 len: 1303 microversion: 2.1 time: 0.150068 Oct 23 01:37:05.906349 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2762/5630] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:37:05 2022] GET /compute/v2.1/servers/cee7dc56-efc1-4f64-8c5d-205414537c2a => generated 1303 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:37:05.929076 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-08e5d398-7316-4889-adeb-f1dae61e957d tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:05.931644 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-08e5d398-7316-4889-adeb-f1dae61e957d tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 5e817a84-2969-413e-b36b-96798e94b306] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:05.936941 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7ea0fcc7-cb20-4bd2-ab8f-8b6d6cca5a94 tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/2f45a5f2-4782-4c77-aebc-278c3a1bb8d9" status: 200 len: 286 microversion: 2.1 time: 0.070478 Oct 23 01:37:05.938303 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2869/5631] 10.222.0.42 () {58 vars in 1251 bytes} [Sun Oct 23 01:37:05 2022] GET /compute/v2.1/os-snapshots/2f45a5f2-4782-4c77-aebc-278c3a1bb8d9 => generated 286 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:37:05.943260 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-08e5d398-7316-4889-adeb-f1dae61e957d tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:05.946393 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-08e5d398-7316-4889-adeb-f1dae61e957d tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:05.946936 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-08e5d398-7316-4889-adeb-f1dae61e957d tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:05.948218 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-08e5d398-7316-4889-adeb-f1dae61e957d tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:05.948690 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-08e5d398-7316-4889-adeb-f1dae61e957d tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:05.949130 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-08e5d398-7316-4889-adeb-f1dae61e957d tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:06.054968 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-08e5d398-7316-4889-adeb-f1dae61e957d tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.130110 Oct 23 01:37:06.058071 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2763/5632] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:37:05 2022] GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306/os-volume_attachments => generated 25 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:37:06.154845 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-74b5872f-bf33-4715-8702-75cc2c041901 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:06.155293 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-74b5872f-bf33-4715-8702-75cc2c041901 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 5e817a84-2969-413e-b36b-96798e94b306] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:06.165751 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-74b5872f-bf33-4715-8702-75cc2c041901 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:06.166806 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-74b5872f-bf33-4715-8702-75cc2c041901 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:06.167248 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-74b5872f-bf33-4715-8702-75cc2c041901 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:06.167955 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-74b5872f-bf33-4715-8702-75cc2c041901 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:06.168409 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-74b5872f-bf33-4715-8702-75cc2c041901 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:06.168836 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-74b5872f-bf33-4715-8702-75cc2c041901 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:06.225537 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-74b5872f-bf33-4715-8702-75cc2c041901 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 5e817a84-2969-413e-b36b-96798e94b306] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:37:06.662390 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-74b5872f-bf33-4715-8702-75cc2c041901 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306" status: 204 len: 0 microversion: 2.1 time: 0.511423 Oct 23 01:37:06.663734 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2870/5633] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:37:06 2022] DELETE /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:37:06.673847 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-55b02c68-9b02-4634-bcc7-6b16c633130a tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:06.675987 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-55b02c68-9b02-4634-bcc7-6b16c633130a tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 5e817a84-2969-413e-b36b-96798e94b306] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:06.688076 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-55b02c68-9b02-4634-bcc7-6b16c633130a tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:06.688573 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-55b02c68-9b02-4634-bcc7-6b16c633130a tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:06.699993 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-55b02c68-9b02-4634-bcc7-6b16c633130a tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:06.700760 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-55b02c68-9b02-4634-bcc7-6b16c633130a tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:06.701286 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-55b02c68-9b02-4634-bcc7-6b16c633130a tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:06.701644 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-55b02c68-9b02-4634-bcc7-6b16c633130a tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:06.826754 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:06.916098 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f2563562-310e-48a4-9c61-418dfb02245c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:06.916868 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f2563562-310e-48a4-9c61-418dfb02245c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: cee7dc56-efc1-4f64-8c5d-205414537c2a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:06.932880 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2563562-310e-48a4-9c61-418dfb02245c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:06.933376 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2563562-310e-48a4-9c61-418dfb02245c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:06.934029 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2563562-310e-48a4-9c61-418dfb02245c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:06.934916 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2563562-310e-48a4-9c61-418dfb02245c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:06.935527 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2563562-310e-48a4-9c61-418dfb02245c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:06.936137 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2563562-310e-48a4-9c61-418dfb02245c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:06.951064 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=4 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:06.972298 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-f2563562-310e-48a4-9c61-418dfb02245c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] HTTP exception thrown: Instance cee7dc56-efc1-4f64-8c5d-205414537c2a could not be found. Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f2563562-310e-48a4-9c61-418dfb02245c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Request method failure captured: Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/cee7dc56-efc1-4f64-8c5d-205414537c2a HTTP/1.1 Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJlvTfuM9-iirX2FXe8mkTy2eWW7UhgAXbnHf6lceGN18S7lbSlaINo5EbF9-Kmi1tphVBr2Fcj8S4BVPceiAUMjh1Az0xLOZc1N90Wz0wmSyINFoBFx331KJ40smzwK1ZOJLA4k7IFyzBj3SQlZplUyTac5KUYxpNFIDY-5Uus0ZuU Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 842dcab8b48c43d7963a538d914b0b22 Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-DeleteServersTestJSON-654775470 Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/842dcab8b48c43d7963a538d914b0b22"}]}] Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-DeleteServersTestJSON-654775470 Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 842dcab8b48c43d7963a538d914b0b22 Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-DeleteServersTestJSON-654775470 Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-DeleteServersTestJSON-654775470-project Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 634bed7898c24baca6ba00392d49eea1 Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-DeleteServersTestJSON-654775470-project Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: exception: Instance cee7dc56-efc1-4f64-8c5d-205414537c2a could not be found. Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'cee7dc56-efc1-4f64-8c5d-205414537c2a'} Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cee7dc56-efc1-4f64-8c5d-205414537c2a could not be found. Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cee7dc56-efc1-4f64-8c5d-205414537c2a could not be found. Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:06.982342 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:06.985780 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:06.985780 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:06.985780 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:06.985780 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:37:06.985780 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:37:06.985780 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cee7dc56-efc1-4f64-8c5d-205414537c2a could not be found. Oct 23 01:37:06.985780 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:06.985780 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f2563562-310e-48a4-9c61-418dfb02245c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Returning 404 to user: Instance cee7dc56-efc1-4f64-8c5d-205414537c2a could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:37:06.985780 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f2563562-310e-48a4-9c61-418dfb02245c tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/cee7dc56-efc1-4f64-8c5d-205414537c2a" status: 404 len: 111 microversion: 2.1 time: 0.072821 Oct 23 01:37:06.985780 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2871/5634] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:37:06 2022] GET /compute/v2.1/servers/cee7dc56-efc1-4f64-8c5d-205414537c2a => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:37:07.001057 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7cccad6c-0465-4071-94e8-2668ed28b589 tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] Calling method '.version_select at 0x7f5cc0a213a0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:07.044099 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=4 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:07.077935 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7cccad6c-0465-4071-94e8-2668ed28b589 tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/2f45a5f2-4782-4c77-aebc-278c3a1bb8d9" status: 200 len: 286 microversion: 2.1 time: 0.091928 Oct 23 01:37:07.078543 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2872/5635] 10.222.0.42 () {58 vars in 1251 bytes} [Sun Oct 23 01:37:06 2022] GET /compute/v2.1/os-snapshots/2f45a5f2-4782-4c77-aebc-278c3a1bb8d9 => generated 286 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:37:07.083171 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4efd7cba-1602-40c8-93ad-62f5fb5ebcf5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:07.086167 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4efd7cba-1602-40c8-93ad-62f5fb5ebcf5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: cee7dc56-efc1-4f64-8c5d-205414537c2a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:07.110246 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4efd7cba-1602-40c8-93ad-62f5fb5ebcf5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:07.111663 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4efd7cba-1602-40c8-93ad-62f5fb5ebcf5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:07.113570 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4efd7cba-1602-40c8-93ad-62f5fb5ebcf5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:07.114572 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4efd7cba-1602-40c8-93ad-62f5fb5ebcf5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:07.116608 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4efd7cba-1602-40c8-93ad-62f5fb5ebcf5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:07.123192 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4efd7cba-1602-40c8-93ad-62f5fb5ebcf5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:07.139771 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-4efd7cba-1602-40c8-93ad-62f5fb5ebcf5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] HTTP exception thrown: Instance cee7dc56-efc1-4f64-8c5d-205414537c2a could not be found. Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4efd7cba-1602-40c8-93ad-62f5fb5ebcf5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Request method failure captured: Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/servers/cee7dc56-efc1-4f64-8c5d-205414537c2a HTTP/1.1 Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJlvTfuM9-iirX2FXe8mkTy2eWW7UhgAXbnHf6lceGN18S7lbSlaINo5EbF9-Kmi1tphVBr2Fcj8S4BVPceiAUMjh1Az0xLOZc1N90Wz0wmSyINFoBFx331KJ40smzwK1ZOJLA4k7IFyzBj3SQlZplUyTac5KUYxpNFIDY-5Uus0ZuU Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 842dcab8b48c43d7963a538d914b0b22 Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-DeleteServersTestJSON-654775470 Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/842dcab8b48c43d7963a538d914b0b22"}]}] Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-DeleteServersTestJSON-654775470 Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 842dcab8b48c43d7963a538d914b0b22 Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-DeleteServersTestJSON-654775470 Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-DeleteServersTestJSON-654775470-project Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 634bed7898c24baca6ba00392d49eea1 Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-DeleteServersTestJSON-654775470-project Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: exception: Instance cee7dc56-efc1-4f64-8c5d-205414537c2a could not be found. Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'cee7dc56-efc1-4f64-8c5d-205414537c2a'} Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cee7dc56-efc1-4f64-8c5d-205414537c2a could not be found. Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:37:07.141675 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:37:07.152170 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cee7dc56-efc1-4f64-8c5d-205414537c2a could not be found. Oct 23 01:37:07.152170 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:07.152170 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:07.152170 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:07.152170 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:07.152170 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:07.152170 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:07.152170 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:37:07.152170 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:37:07.152170 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cee7dc56-efc1-4f64-8c5d-205414537c2a could not be found. Oct 23 01:37:07.152170 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:07.152170 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4efd7cba-1602-40c8-93ad-62f5fb5ebcf5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Returning 404 to user: Instance cee7dc56-efc1-4f64-8c5d-205414537c2a could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:37:07.152170 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4efd7cba-1602-40c8-93ad-62f5fb5ebcf5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "DELETE /compute/v2.1/servers/cee7dc56-efc1-4f64-8c5d-205414537c2a" status: 404 len: 111 microversion: 2.1 time: 0.065393 Oct 23 01:37:07.152170 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2873/5636] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:37:07 2022] DELETE /compute/v2.1/servers/cee7dc56-efc1-4f64-8c5d-205414537c2a => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:37:07.165164 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-afe1b833-cc55-49ef-a3e2-6bc259719b40 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:07.166100 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-afe1b833-cc55-49ef-a3e2-6bc259719b40 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: cee7dc56-efc1-4f64-8c5d-205414537c2a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:07.173590 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-afe1b833-cc55-49ef-a3e2-6bc259719b40 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:07.174356 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-afe1b833-cc55-49ef-a3e2-6bc259719b40 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:07.175149 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-afe1b833-cc55-49ef-a3e2-6bc259719b40 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:07.176078 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-afe1b833-cc55-49ef-a3e2-6bc259719b40 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:07.176760 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-afe1b833-cc55-49ef-a3e2-6bc259719b40 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:07.178079 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-afe1b833-cc55-49ef-a3e2-6bc259719b40 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:07.193430 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-afe1b833-cc55-49ef-a3e2-6bc259719b40 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] HTTP exception thrown: Instance cee7dc56-efc1-4f64-8c5d-205414537c2a could not be found. Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-afe1b833-cc55-49ef-a3e2-6bc259719b40 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Request method failure captured: Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/cee7dc56-efc1-4f64-8c5d-205414537c2a HTTP/1.1 Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJlvTfuM9-iirX2FXe8mkTy2eWW7UhgAXbnHf6lceGN18S7lbSlaINo5EbF9-Kmi1tphVBr2Fcj8S4BVPceiAUMjh1Az0xLOZc1N90Wz0wmSyINFoBFx331KJ40smzwK1ZOJLA4k7IFyzBj3SQlZplUyTac5KUYxpNFIDY-5Uus0ZuU Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 842dcab8b48c43d7963a538d914b0b22 Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-DeleteServersTestJSON-654775470 Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/842dcab8b48c43d7963a538d914b0b22"}]}] Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-DeleteServersTestJSON-654775470 Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 842dcab8b48c43d7963a538d914b0b22 Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-DeleteServersTestJSON-654775470 Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-DeleteServersTestJSON-654775470-project Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 634bed7898c24baca6ba00392d49eea1 Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-DeleteServersTestJSON-654775470-project Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: exception: Instance cee7dc56-efc1-4f64-8c5d-205414537c2a could not be found. Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'cee7dc56-efc1-4f64-8c5d-205414537c2a'} Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cee7dc56-efc1-4f64-8c5d-205414537c2a could not be found. Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cee7dc56-efc1-4f64-8c5d-205414537c2a could not be found. Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:07.203953 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:07.212673 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:07.212673 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:07.212673 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:07.212673 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:37:07.212673 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:37:07.212673 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cee7dc56-efc1-4f64-8c5d-205414537c2a could not be found. Oct 23 01:37:07.212673 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:07.212673 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-afe1b833-cc55-49ef-a3e2-6bc259719b40 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Returning 404 to user: Instance cee7dc56-efc1-4f64-8c5d-205414537c2a could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:37:07.212673 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-afe1b833-cc55-49ef-a3e2-6bc259719b40 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/cee7dc56-efc1-4f64-8c5d-205414537c2a" status: 404 len: 111 microversion: 2.1 time: 0.050246 Oct 23 01:37:07.212673 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2874/5637] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:37:07 2022] GET /compute/v2.1/servers/cee7dc56-efc1-4f64-8c5d-205414537c2a => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:37:07.221712 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-65329d74-0062-48b2-b6bf-ef1a79443475 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:07.222464 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-65329d74-0062-48b2-b6bf-ef1a79443475 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 124d4efd-fa7d-468c-a512-78a550b75c89] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:07.229889 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-65329d74-0062-48b2-b6bf-ef1a79443475 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:07.230732 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-65329d74-0062-48b2-b6bf-ef1a79443475 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:07.231231 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-65329d74-0062-48b2-b6bf-ef1a79443475 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:07.232051 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-65329d74-0062-48b2-b6bf-ef1a79443475 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:07.232550 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-65329d74-0062-48b2-b6bf-ef1a79443475 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:07.232984 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-65329d74-0062-48b2-b6bf-ef1a79443475 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:07.251278 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-65329d74-0062-48b2-b6bf-ef1a79443475 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] HTTP exception thrown: Instance 124d4efd-fa7d-468c-a512-78a550b75c89 could not be found. Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-65329d74-0062-48b2-b6bf-ef1a79443475 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Request method failure captured: Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89 HTTP/1.1 Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJlvTfuM9-iirX2FXe8mkTy2eWW7UhgAXbnHf6lceGN18S7lbSlaINo5EbF9-Kmi1tphVBr2Fcj8S4BVPceiAUMjh1Az0xLOZc1N90Wz0wmSyINFoBFx331KJ40smzwK1ZOJLA4k7IFyzBj3SQlZplUyTac5KUYxpNFIDY-5Uus0ZuU Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 842dcab8b48c43d7963a538d914b0b22 Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-DeleteServersTestJSON-654775470 Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/842dcab8b48c43d7963a538d914b0b22"}]}] Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-DeleteServersTestJSON-654775470 Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 842dcab8b48c43d7963a538d914b0b22 Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-DeleteServersTestJSON-654775470 Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-DeleteServersTestJSON-654775470-project Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 634bed7898c24baca6ba00392d49eea1 Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-DeleteServersTestJSON-654775470-project Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 124d4efd-fa7d-468c-a512-78a550b75c89 could not be found. Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '124d4efd-fa7d-468c-a512-78a550b75c89'} Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 124d4efd-fa7d-468c-a512-78a550b75c89 could not be found. Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:37:07.252894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:37:07.259592 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 124d4efd-fa7d-468c-a512-78a550b75c89 could not be found. Oct 23 01:37:07.259592 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:07.259592 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:07.259592 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:07.259592 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:07.259592 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:07.259592 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:07.259592 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:37:07.259592 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:37:07.259592 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 124d4efd-fa7d-468c-a512-78a550b75c89 could not be found. Oct 23 01:37:07.259592 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:07.259592 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-65329d74-0062-48b2-b6bf-ef1a79443475 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Returning 404 to user: Instance 124d4efd-fa7d-468c-a512-78a550b75c89 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:37:07.259592 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-65329d74-0062-48b2-b6bf-ef1a79443475 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "DELETE /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89" status: 404 len: 111 microversion: 2.1 time: 0.039198 Oct 23 01:37:07.259592 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2875/5638] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:37:07 2022] DELETE /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:37:07.263324 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0e2941dc-67a9-4410-bb00-d5991aa0e72e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:07.263947 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0e2941dc-67a9-4410-bb00-d5991aa0e72e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 124d4efd-fa7d-468c-a512-78a550b75c89] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:07.276153 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0e2941dc-67a9-4410-bb00-d5991aa0e72e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:07.276153 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0e2941dc-67a9-4410-bb00-d5991aa0e72e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:07.276153 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0e2941dc-67a9-4410-bb00-d5991aa0e72e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:07.276153 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0e2941dc-67a9-4410-bb00-d5991aa0e72e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:07.276153 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0e2941dc-67a9-4410-bb00-d5991aa0e72e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:07.276153 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0e2941dc-67a9-4410-bb00-d5991aa0e72e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:07.299319 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-0e2941dc-67a9-4410-bb00-d5991aa0e72e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] HTTP exception thrown: Instance 124d4efd-fa7d-468c-a512-78a550b75c89 could not be found. Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0e2941dc-67a9-4410-bb00-d5991aa0e72e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Request method failure captured: Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89 HTTP/1.1 Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJlvTfuM9-iirX2FXe8mkTy2eWW7UhgAXbnHf6lceGN18S7lbSlaINo5EbF9-Kmi1tphVBr2Fcj8S4BVPceiAUMjh1Az0xLOZc1N90Wz0wmSyINFoBFx331KJ40smzwK1ZOJLA4k7IFyzBj3SQlZplUyTac5KUYxpNFIDY-5Uus0ZuU Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 842dcab8b48c43d7963a538d914b0b22 Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-DeleteServersTestJSON-654775470 Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/842dcab8b48c43d7963a538d914b0b22"}]}] Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-DeleteServersTestJSON-654775470 Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 842dcab8b48c43d7963a538d914b0b22 Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-DeleteServersTestJSON-654775470 Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-DeleteServersTestJSON-654775470-project Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 634bed7898c24baca6ba00392d49eea1 Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-DeleteServersTestJSON-654775470-project Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 124d4efd-fa7d-468c-a512-78a550b75c89 could not be found. Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '124d4efd-fa7d-468c-a512-78a550b75c89'} Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 124d4efd-fa7d-468c-a512-78a550b75c89 could not be found. Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 124d4efd-fa7d-468c-a512-78a550b75c89 could not be found. Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:07.302119 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:07.308029 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:07.308029 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:07.308029 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:07.308029 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:37:07.308029 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:37:07.308029 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 124d4efd-fa7d-468c-a512-78a550b75c89 could not be found. Oct 23 01:37:07.308029 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:07.308029 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0e2941dc-67a9-4410-bb00-d5991aa0e72e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Returning 404 to user: Instance 124d4efd-fa7d-468c-a512-78a550b75c89 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:37:07.308029 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0e2941dc-67a9-4410-bb00-d5991aa0e72e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89" status: 404 len: 111 microversion: 2.1 time: 0.044406 Oct 23 01:37:07.308029 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2876/5639] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:37:07 2022] GET /compute/v2.1/servers/124d4efd-fa7d-468c-a512-78a550b75c89 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 01:37:07.314271 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-15ff99d4-cf75-43f8-9e4a-4d3f3ce4f2a4 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:07.314914 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-15ff99d4-cf75-43f8-9e4a-4d3f3ce4f2a4 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:07.323570 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15ff99d4-cf75-43f8-9e4a-4d3f3ce4f2a4 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:07.324221 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15ff99d4-cf75-43f8-9e4a-4d3f3ce4f2a4 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:07.324772 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15ff99d4-cf75-43f8-9e4a-4d3f3ce4f2a4 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:07.325801 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15ff99d4-cf75-43f8-9e4a-4d3f3ce4f2a4 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:07.326421 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15ff99d4-cf75-43f8-9e4a-4d3f3ce4f2a4 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:07.326913 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15ff99d4-cf75-43f8-9e4a-4d3f3ce4f2a4 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:07.337078 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:07.348352 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-15ff99d4-cf75-43f8-9e4a-4d3f3ce4f2a4 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] HTTP exception thrown: Instance 71362f74-5a83-466a-b7be-de2a87253559 could not be found. Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-15ff99d4-cf75-43f8-9e4a-4d3f3ce4f2a4 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Request method failure captured: Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 HTTP/1.1 Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJlvTfuM9-iirX2FXe8mkTy2eWW7UhgAXbnHf6lceGN18S7lbSlaINo5EbF9-Kmi1tphVBr2Fcj8S4BVPceiAUMjh1Az0xLOZc1N90Wz0wmSyINFoBFx331KJ40smzwK1ZOJLA4k7IFyzBj3SQlZplUyTac5KUYxpNFIDY-5Uus0ZuU Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 842dcab8b48c43d7963a538d914b0b22 Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-DeleteServersTestJSON-654775470 Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/842dcab8b48c43d7963a538d914b0b22"}]}] Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-DeleteServersTestJSON-654775470 Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 842dcab8b48c43d7963a538d914b0b22 Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-DeleteServersTestJSON-654775470 Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-DeleteServersTestJSON-654775470-project Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 634bed7898c24baca6ba00392d49eea1 Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-DeleteServersTestJSON-654775470-project Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 71362f74-5a83-466a-b7be-de2a87253559 could not be found. Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '71362f74-5a83-466a-b7be-de2a87253559'} Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71362f74-5a83-466a-b7be-de2a87253559 could not be found. Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:37:07.350295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:37:07.359180 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71362f74-5a83-466a-b7be-de2a87253559 could not be found. Oct 23 01:37:07.359180 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:07.359180 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:07.359180 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:07.359180 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:07.359180 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:07.359180 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:07.359180 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:37:07.359180 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:37:07.359180 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71362f74-5a83-466a-b7be-de2a87253559 could not be found. Oct 23 01:37:07.359180 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:07.359180 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-15ff99d4-cf75-43f8-9e4a-4d3f3ce4f2a4 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Returning 404 to user: Instance 71362f74-5a83-466a-b7be-de2a87253559 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:37:07.359180 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-15ff99d4-cf75-43f8-9e4a-4d3f3ce4f2a4 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "DELETE /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 404 len: 111 microversion: 2.1 time: 0.041944 Oct 23 01:37:07.359180 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2877/5640] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:37:07 2022] DELETE /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:37:07.362594 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-44523562-b677-40fc-8cf0-6a07530b0b7e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:07.363297 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-44523562-b677-40fc-8cf0-6a07530b0b7e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 71362f74-5a83-466a-b7be-de2a87253559] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:07.370332 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-44523562-b677-40fc-8cf0-6a07530b0b7e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:07.371113 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-44523562-b677-40fc-8cf0-6a07530b0b7e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:07.371956 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-44523562-b677-40fc-8cf0-6a07530b0b7e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:07.373080 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-44523562-b677-40fc-8cf0-6a07530b0b7e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:07.379608 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-44523562-b677-40fc-8cf0-6a07530b0b7e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:07.379608 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-44523562-b677-40fc-8cf0-6a07530b0b7e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:07.380711 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-55b02c68-9b02-4634-bcc7-6b16c633130a tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:37:07.389346 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-55b02c68-9b02-4634-bcc7-6b16c633130a tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306" status: 200 len: 1681 microversion: 2.1 time: 0.720740 Oct 23 01:37:07.394029 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2764/5641] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:37:06 2022] GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306 => generated 1681 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:37:07.399228 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-44523562-b677-40fc-8cf0-6a07530b0b7e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] HTTP exception thrown: Instance 71362f74-5a83-466a-b7be-de2a87253559 could not be found. Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-44523562-b677-40fc-8cf0-6a07530b0b7e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Request method failure captured: Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 HTTP/1.1 Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJlvTfuM9-iirX2FXe8mkTy2eWW7UhgAXbnHf6lceGN18S7lbSlaINo5EbF9-Kmi1tphVBr2Fcj8S4BVPceiAUMjh1Az0xLOZc1N90Wz0wmSyINFoBFx331KJ40smzwK1ZOJLA4k7IFyzBj3SQlZplUyTac5KUYxpNFIDY-5Uus0ZuU Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 842dcab8b48c43d7963a538d914b0b22 Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-DeleteServersTestJSON-654775470 Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/842dcab8b48c43d7963a538d914b0b22"}]}] Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-DeleteServersTestJSON-654775470 Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 842dcab8b48c43d7963a538d914b0b22 Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-DeleteServersTestJSON-654775470 Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-DeleteServersTestJSON-654775470-project Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 634bed7898c24baca6ba00392d49eea1 Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-DeleteServersTestJSON-654775470-project Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 71362f74-5a83-466a-b7be-de2a87253559 could not be found. Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '71362f74-5a83-466a-b7be-de2a87253559'} Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71362f74-5a83-466a-b7be-de2a87253559 could not be found. Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71362f74-5a83-466a-b7be-de2a87253559 could not be found. Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:07.401295 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:07.404463 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:07.404463 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:07.404463 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:07.404463 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:37:07.404463 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:37:07.404463 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71362f74-5a83-466a-b7be-de2a87253559 could not be found. Oct 23 01:37:07.404463 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:07.404463 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-44523562-b677-40fc-8cf0-6a07530b0b7e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Returning 404 to user: Instance 71362f74-5a83-466a-b7be-de2a87253559 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:37:07.404463 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-44523562-b677-40fc-8cf0-6a07530b0b7e tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559" status: 404 len: 111 microversion: 2.1 time: 0.046040 Oct 23 01:37:07.407159 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2878/5642] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:37:07 2022] GET /compute/v2.1/servers/71362f74-5a83-466a-b7be-de2a87253559 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 01:37:07.412546 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ec77bc6e-6116-4efc-acba-981f53d6714b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:07.413301 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ec77bc6e-6116-4efc-acba-981f53d6714b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: e3bb9493-45f6-4889-8655-222a1284b4bf] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:07.421557 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec77bc6e-6116-4efc-acba-981f53d6714b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:07.422340 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec77bc6e-6116-4efc-acba-981f53d6714b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:07.423257 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec77bc6e-6116-4efc-acba-981f53d6714b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:07.424143 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec77bc6e-6116-4efc-acba-981f53d6714b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:07.429004 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec77bc6e-6116-4efc-acba-981f53d6714b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:07.429004 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec77bc6e-6116-4efc-acba-981f53d6714b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:07.440961 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-ec77bc6e-6116-4efc-acba-981f53d6714b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] HTTP exception thrown: Instance e3bb9493-45f6-4889-8655-222a1284b4bf could not be found. Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ec77bc6e-6116-4efc-acba-981f53d6714b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Request method failure captured: Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/servers/e3bb9493-45f6-4889-8655-222a1284b4bf HTTP/1.1 Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJlvTfuM9-iirX2FXe8mkTy2eWW7UhgAXbnHf6lceGN18S7lbSlaINo5EbF9-Kmi1tphVBr2Fcj8S4BVPceiAUMjh1Az0xLOZc1N90Wz0wmSyINFoBFx331KJ40smzwK1ZOJLA4k7IFyzBj3SQlZplUyTac5KUYxpNFIDY-5Uus0ZuU Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 842dcab8b48c43d7963a538d914b0b22 Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-DeleteServersTestJSON-654775470 Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/842dcab8b48c43d7963a538d914b0b22"}]}] Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-DeleteServersTestJSON-654775470 Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 842dcab8b48c43d7963a538d914b0b22 Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-DeleteServersTestJSON-654775470 Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-DeleteServersTestJSON-654775470-project Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 634bed7898c24baca6ba00392d49eea1 Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-DeleteServersTestJSON-654775470-project Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: exception: Instance e3bb9493-45f6-4889-8655-222a1284b4bf could not be found. Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'e3bb9493-45f6-4889-8655-222a1284b4bf'} Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3bb9493-45f6-4889-8655-222a1284b4bf could not be found. Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:37:07.443505 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:37:07.448234 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3bb9493-45f6-4889-8655-222a1284b4bf could not be found. Oct 23 01:37:07.448234 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:07.448234 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:07.448234 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:07.448234 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:07.448234 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:07.448234 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:07.448234 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:37:07.448234 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:37:07.448234 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3bb9493-45f6-4889-8655-222a1284b4bf could not be found. Oct 23 01:37:07.448234 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:07.464446 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ec77bc6e-6116-4efc-acba-981f53d6714b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Returning 404 to user: Instance e3bb9493-45f6-4889-8655-222a1284b4bf could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:37:07.465645 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ec77bc6e-6116-4efc-acba-981f53d6714b tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e3bb9493-45f6-4889-8655-222a1284b4bf" status: 404 len: 111 microversion: 2.1 time: 0.057733 Oct 23 01:37:07.472516 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2765/5643] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:37:07 2022] DELETE /compute/v2.1/servers/e3bb9493-45f6-4889-8655-222a1284b4bf => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 01:37:07.485350 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bac2e8b5-2820-4e01-a31b-86cb6e4349e6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:07.486314 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bac2e8b5-2820-4e01-a31b-86cb6e4349e6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: e3bb9493-45f6-4889-8655-222a1284b4bf] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:07.498853 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bac2e8b5-2820-4e01-a31b-86cb6e4349e6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:07.499681 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bac2e8b5-2820-4e01-a31b-86cb6e4349e6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:07.500389 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bac2e8b5-2820-4e01-a31b-86cb6e4349e6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:07.501557 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bac2e8b5-2820-4e01-a31b-86cb6e4349e6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:07.502267 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bac2e8b5-2820-4e01-a31b-86cb6e4349e6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:07.502955 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bac2e8b5-2820-4e01-a31b-86cb6e4349e6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:07.523473 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-bac2e8b5-2820-4e01-a31b-86cb6e4349e6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] HTTP exception thrown: Instance e3bb9493-45f6-4889-8655-222a1284b4bf could not be found. Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bac2e8b5-2820-4e01-a31b-86cb6e4349e6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Request method failure captured: Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/e3bb9493-45f6-4889-8655-222a1284b4bf HTTP/1.1 Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJlvTfuM9-iirX2FXe8mkTy2eWW7UhgAXbnHf6lceGN18S7lbSlaINo5EbF9-Kmi1tphVBr2Fcj8S4BVPceiAUMjh1Az0xLOZc1N90Wz0wmSyINFoBFx331KJ40smzwK1ZOJLA4k7IFyzBj3SQlZplUyTac5KUYxpNFIDY-5Uus0ZuU Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 842dcab8b48c43d7963a538d914b0b22 Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-DeleteServersTestJSON-654775470 Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/842dcab8b48c43d7963a538d914b0b22"}]}] Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-DeleteServersTestJSON-654775470 Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 842dcab8b48c43d7963a538d914b0b22 Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-DeleteServersTestJSON-654775470 Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-DeleteServersTestJSON-654775470-project Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 634bed7898c24baca6ba00392d49eea1 Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-DeleteServersTestJSON-654775470-project Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: exception: Instance e3bb9493-45f6-4889-8655-222a1284b4bf could not be found. Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'e3bb9493-45f6-4889-8655-222a1284b4bf'} Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3bb9493-45f6-4889-8655-222a1284b4bf could not be found. Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3bb9493-45f6-4889-8655-222a1284b4bf could not be found. Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:07.525109 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:07.530314 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:07.530314 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:07.530314 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:07.530314 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:37:07.530314 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:37:07.530314 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3bb9493-45f6-4889-8655-222a1284b4bf could not be found. Oct 23 01:37:07.530314 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:07.532265 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bac2e8b5-2820-4e01-a31b-86cb6e4349e6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Returning 404 to user: Instance e3bb9493-45f6-4889-8655-222a1284b4bf could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:37:07.533403 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bac2e8b5-2820-4e01-a31b-86cb6e4349e6 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/e3bb9493-45f6-4889-8655-222a1284b4bf" status: 404 len: 111 microversion: 2.1 time: 0.054716 Oct 23 01:37:07.537609 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2879/5644] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:37:07 2022] GET /compute/v2.1/servers/e3bb9493-45f6-4889-8655-222a1284b4bf => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:37:07.544672 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b3d38c90-d87d-465e-91ff-22376b5b16d7 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:07.547021 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b3d38c90-d87d-465e-91ff-22376b5b16d7 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: da5e83e9-fa65-44ef-a14b-102221ce876a] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:07.556142 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-b3d38c90-d87d-465e-91ff-22376b5b16d7 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] HTTP exception thrown: Instance da5e83e9-fa65-44ef-a14b-102221ce876a could not be found. Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b3d38c90-d87d-465e-91ff-22376b5b16d7 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Request method failure captured: Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/servers/da5e83e9-fa65-44ef-a14b-102221ce876a HTTP/1.1 Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJlvTfuM9-iirX2FXe8mkTy2eWW7UhgAXbnHf6lceGN18S7lbSlaINo5EbF9-Kmi1tphVBr2Fcj8S4BVPceiAUMjh1Az0xLOZc1N90Wz0wmSyINFoBFx331KJ40smzwK1ZOJLA4k7IFyzBj3SQlZplUyTac5KUYxpNFIDY-5Uus0ZuU Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 842dcab8b48c43d7963a538d914b0b22 Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-DeleteServersTestJSON-654775470 Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/842dcab8b48c43d7963a538d914b0b22"}]}] Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-DeleteServersTestJSON-654775470 Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 842dcab8b48c43d7963a538d914b0b22 Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-DeleteServersTestJSON-654775470 Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-DeleteServersTestJSON-654775470-project Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 634bed7898c24baca6ba00392d49eea1 Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-DeleteServersTestJSON-654775470-project Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: exception: Instance da5e83e9-fa65-44ef-a14b-102221ce876a could not be found. Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'da5e83e9-fa65-44ef-a14b-102221ce876a'} Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da5e83e9-fa65-44ef-a14b-102221ce876a could not be found. Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da5e83e9-fa65-44ef-a14b-102221ce876a could not be found. Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:07.567193 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:07.570395 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:07.570395 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:07.570395 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:07.570395 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:37:07.570395 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:37:07.570395 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da5e83e9-fa65-44ef-a14b-102221ce876a could not be found. Oct 23 01:37:07.570395 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:07.571554 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b3d38c90-d87d-465e-91ff-22376b5b16d7 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Returning 404 to user: Instance da5e83e9-fa65-44ef-a14b-102221ce876a could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:37:07.573746 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b3d38c90-d87d-465e-91ff-22376b5b16d7 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "DELETE /compute/v2.1/servers/da5e83e9-fa65-44ef-a14b-102221ce876a" status: 404 len: 111 microversion: 2.1 time: 0.035201 Oct 23 01:37:07.577282 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2766/5645] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:37:07 2022] DELETE /compute/v2.1/servers/da5e83e9-fa65-44ef-a14b-102221ce876a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 01:37:07.585602 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1dd1a382-4412-424a-a87e-1f5ee455d9b8 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:07.586264 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1dd1a382-4412-424a-a87e-1f5ee455d9b8 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: da5e83e9-fa65-44ef-a14b-102221ce876a] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:07.588750 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:07.603947 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-1dd1a382-4412-424a-a87e-1f5ee455d9b8 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] HTTP exception thrown: Instance da5e83e9-fa65-44ef-a14b-102221ce876a could not be found. Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1dd1a382-4412-424a-a87e-1f5ee455d9b8 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Request method failure captured: Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/da5e83e9-fa65-44ef-a14b-102221ce876a HTTP/1.1 Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJlvTfuM9-iirX2FXe8mkTy2eWW7UhgAXbnHf6lceGN18S7lbSlaINo5EbF9-Kmi1tphVBr2Fcj8S4BVPceiAUMjh1Az0xLOZc1N90Wz0wmSyINFoBFx331KJ40smzwK1ZOJLA4k7IFyzBj3SQlZplUyTac5KUYxpNFIDY-5Uus0ZuU Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 842dcab8b48c43d7963a538d914b0b22 Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-DeleteServersTestJSON-654775470 Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/842dcab8b48c43d7963a538d914b0b22"}]}] Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-DeleteServersTestJSON-654775470 Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 842dcab8b48c43d7963a538d914b0b22 Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-DeleteServersTestJSON-654775470 Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-DeleteServersTestJSON-654775470-project Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 634bed7898c24baca6ba00392d49eea1 Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-DeleteServersTestJSON-654775470-project Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: exception: Instance da5e83e9-fa65-44ef-a14b-102221ce876a could not be found. Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'da5e83e9-fa65-44ef-a14b-102221ce876a'} Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da5e83e9-fa65-44ef-a14b-102221ce876a could not be found. Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da5e83e9-fa65-44ef-a14b-102221ce876a could not be found. Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:07.605489 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:07.608729 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:07.608729 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:37:07.608729 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:37:07.608729 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da5e83e9-fa65-44ef-a14b-102221ce876a could not be found. Oct 23 01:37:07.608729 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:07.608729 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1dd1a382-4412-424a-a87e-1f5ee455d9b8 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Returning 404 to user: Instance da5e83e9-fa65-44ef-a14b-102221ce876a could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:37:07.608729 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1dd1a382-4412-424a-a87e-1f5ee455d9b8 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/da5e83e9-fa65-44ef-a14b-102221ce876a" status: 404 len: 111 microversion: 2.1 time: 0.025400 Oct 23 01:37:07.608729 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2880/5646] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:37:07 2022] GET /compute/v2.1/servers/da5e83e9-fa65-44ef-a14b-102221ce876a => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:37:08.091537 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-46caf657-1760-406e-92a3-7914bc924123 tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] Calling method '.version_select at 0x7f5cc61925e0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:08.162843 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-46caf657-1760-406e-92a3-7914bc924123 tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/2f45a5f2-4782-4c77-aebc-278c3a1bb8d9" status: 200 len: 287 microversion: 2.1 time: 0.075890 Oct 23 01:37:08.164086 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2767/5647] 10.222.0.42 () {58 vars in 1251 bytes} [Sun Oct 23 01:37:08 2022] GET /compute/v2.1/os-snapshots/2f45a5f2-4782-4c77-aebc-278c3a1bb8d9 => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:37:08.177012 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e14c5dd0-d198-482e-88fe-e6a20c22aa18 tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] Calling method '.version_select at 0x7f5cc0a30b80>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:08.423707 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7cb26866-01a2-4cd6-938d-870c19406801 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:08.425287 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7cb26866-01a2-4cd6-938d-870c19406801 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 5e817a84-2969-413e-b36b-96798e94b306] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:08.440451 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7cb26866-01a2-4cd6-938d-870c19406801 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:08.441199 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7cb26866-01a2-4cd6-938d-870c19406801 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:08.441854 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7cb26866-01a2-4cd6-938d-870c19406801 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:08.442934 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7cb26866-01a2-4cd6-938d-870c19406801 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:08.443710 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7cb26866-01a2-4cd6-938d-870c19406801 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:08.444342 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7cb26866-01a2-4cd6-938d-870c19406801 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:08.476351 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e14c5dd0-d198-482e-88fe-e6a20c22aa18 tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] 10.222.0.42 "DELETE /compute/v2.1/os-snapshots/2f45a5f2-4782-4c77-aebc-278c3a1bb8d9" status: 202 len: 0 microversion: 2.1 time: 0.305062 Oct 23 01:37:08.478665 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2881/5648] 10.222.0.42 () {58 vars in 1254 bytes} [Sun Oct 23 01:37:08 2022] DELETE /compute/v2.1/os-snapshots/2f45a5f2-4782-4c77-aebc-278c3a1bb8d9 => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:37:08.492170 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ae3e50ba-16ca-48e4-aa1c-9afae32ca464 tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] Calling method '.version_select at 0x7f5cc0a30e50>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:08.580108 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ae3e50ba-16ca-48e4-aa1c-9afae32ca464 tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/2f45a5f2-4782-4c77-aebc-278c3a1bb8d9" status: 200 len: 286 microversion: 2.1 time: 0.098833 Oct 23 01:37:08.581091 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2882/5649] 10.222.0.42 () {58 vars in 1251 bytes} [Sun Oct 23 01:37:08 2022] GET /compute/v2.1/os-snapshots/2f45a5f2-4782-4c77-aebc-278c3a1bb8d9 => generated 286 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:37:09.597615 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7bf9d698-27d9-4b21-9c17-b71e758622aa tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] Calling method '.version_select at 0x7f5cc09f55e0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:09.662494 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7bf9d698-27d9-4b21-9c17-b71e758622aa tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/2f45a5f2-4782-4c77-aebc-278c3a1bb8d9" status: 200 len: 286 microversion: 2.1 time: 0.072818 Oct 23 01:37:09.663652 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2883/5650] 10.222.0.42 () {58 vars in 1251 bytes} [Sun Oct 23 01:37:09 2022] GET /compute/v2.1/os-snapshots/2f45a5f2-4782-4c77-aebc-278c3a1bb8d9 => generated 286 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:37:09.896983 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7cb26866-01a2-4cd6-938d-870c19406801 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:37:09.910505 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7cb26866-01a2-4cd6-938d-870c19406801 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306" status: 200 len: 1681 microversion: 2.1 time: 1.498990 Oct 23 01:37:09.911254 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2768/5651] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:37:08 2022] GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306 => generated 1681 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:37:10.678524 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5aed61d8-7ab6-47d0-8a2c-dbb854f6d394 tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] Calling method '.version_select at 0x7f5cc0a68280>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:10.759928 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5aed61d8-7ab6-47d0-8a2c-dbb854f6d394 tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/2f45a5f2-4782-4c77-aebc-278c3a1bb8d9" status: 200 len: 286 microversion: 2.1 time: 0.087831 Oct 23 01:37:10.760557 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2884/5652] 10.222.0.42 () {58 vars in 1251 bytes} [Sun Oct 23 01:37:10 2022] GET /compute/v2.1/os-snapshots/2f45a5f2-4782-4c77-aebc-278c3a1bb8d9 => generated 286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:37:10.934755 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8353026e-a416-4ff9-8828-6cbb36c033fd tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:10.936327 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8353026e-a416-4ff9-8828-6cbb36c033fd tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 5e817a84-2969-413e-b36b-96798e94b306] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:10.949752 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8353026e-a416-4ff9-8828-6cbb36c033fd tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:10.950987 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8353026e-a416-4ff9-8828-6cbb36c033fd tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:10.951620 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8353026e-a416-4ff9-8828-6cbb36c033fd tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:10.954982 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8353026e-a416-4ff9-8828-6cbb36c033fd tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:10.955738 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8353026e-a416-4ff9-8828-6cbb36c033fd tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:10.956956 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8353026e-a416-4ff9-8828-6cbb36c033fd tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:11.364957 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8353026e-a416-4ff9-8828-6cbb36c033fd tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:37:11.381414 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8353026e-a416-4ff9-8828-6cbb36c033fd tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306" status: 200 len: 1681 microversion: 2.1 time: 0.451137 Oct 23 01:37:11.382035 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2769/5653] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:37:10 2022] GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306 => generated 1681 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:37:11.773234 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e67dcc84-e376-4f7f-9b30-3788a1543685 tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] Calling method '.version_select at 0x7f5cc09f5dc0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:11.808575 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-e67dcc84-e376-4f7f-9b30-3788a1543685 tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] HTTP exception thrown: Snapshot 2f45a5f2-4782-4c77-aebc-278c3a1bb8d9 could not be found. Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e67dcc84-e376-4f7f-9b30-3788a1543685 tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] Request method failure captured: Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/os-snapshots/2f45a5f2-4782-4c77-aebc-278c3a1bb8d9 HTTP/1.1 Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJq8Neh2-G7Pn5Tjh7uiDC8RwmTRbaWgW1NQiMAp7DjfQ-ZEwBMXkHBx6uRATkMPLQEHEHJaJN3sftCnxFbeKKufeZzIwWxJWyrT1exbpDOniXdBpIJ5ZV80RA3V4NDSara6Zz9D9mnbI2gN3MPkkOqsdesAVpFvwfAFJwTNZSAy4yE Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 68dabe2cafd046fea4cb35076787f899 Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-825083434 Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/68dabe2cafd046fea4cb35076787f899"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_68dabe2cafd046fea4cb35076787f899"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/68dabe2cafd046fea4cb35076787f899"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/68dabe2cafd046fea4cb35076787f899"}]}] Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-VolumesSnapshotsTestJSON-825083434 Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 68dabe2cafd046fea4cb35076787f899 Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-825083434 Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-VolumesSnapshotsTestJSON-825083434-project Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: cedcdb82756b4512b9cd7db2649e8435 Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-VolumesSnapshotsTestJSON-825083434-project Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: method: Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: exception: Snapshot 2f45a5f2-4782-4c77-aebc-278c3a1bb8d9 could not be found. Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '2f45a5f2-4782-4c77-aebc-278c3a1bb8d9'} Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 2f45a5f2-4782-4c77-aebc-278c3a1bb8d9 could not be found. (HTTP 404) (Request-ID: req-450cde42-51e2-4874-bb73-8cbefb02324c) Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 23 01:37:11.818301 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 23 01:37:11.821606 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 23 01:37:11.821606 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 23 01:37:11.821606 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 23 01:37:11.821606 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 23 01:37:11.821606 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 23 01:37:11.821606 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 23 01:37:11.821606 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 23 01:37:11.821606 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 23 01:37:11.821606 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 23 01:37:11.821606 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 23 01:37:11.821606 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 01:37:11.821606 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 01:37:11.821606 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 01:37:11.821606 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 01:37:11.821606 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 2f45a5f2-4782-4c77-aebc-278c3a1bb8d9 could not be found. Oct 23 01:37:11.821606 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:11.821606 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:11.821606 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:11.821606 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:11.821606 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:11.821606 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:11.821606 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:37:11.821606 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:37:11.821606 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:37:11.821606 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:37:11.821606 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:37:11.821606 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:37:11.821606 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 23 01:37:11.821606 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:37:11.821606 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 2f45a5f2-4782-4c77-aebc-278c3a1bb8d9 could not be found. Oct 23 01:37:11.821606 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:11.821606 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:11.821606 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:11.821606 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:11.821606 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:11.821606 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:11.821606 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:37:11.821606 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:37:11.821606 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 2f45a5f2-4782-4c77-aebc-278c3a1bb8d9 could not be found. Oct 23 01:37:11.821606 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:11.829696 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e67dcc84-e376-4f7f-9b30-3788a1543685 tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] Returning 404 to user: Snapshot 2f45a5f2-4782-4c77-aebc-278c3a1bb8d9 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:37:11.831169 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e67dcc84-e376-4f7f-9b30-3788a1543685 tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/2f45a5f2-4782-4c77-aebc-278c3a1bb8d9" status: 404 len: 111 microversion: 2.1 time: 0.061875 Oct 23 01:37:11.835768 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2885/5654] 10.222.0.42 () {58 vars in 1251 bytes} [Sun Oct 23 01:37:11 2022] GET /compute/v2.1/os-snapshots/2f45a5f2-4782-4c77-aebc-278c3a1bb8d9 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:37:11.840864 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f82a3db8-f195-45d0-95e2-490865ddc72f tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] Calling method '.version_select at 0x7f5cc62861f0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:12.080487 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f82a3db8-f195-45d0-95e2-490865ddc72f tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/18a9cb0e-7e06-41eb-a5ba-daaad516dac1" status: 202 len: 0 microversion: 2.1 time: 0.244026 Oct 23 01:37:12.082194 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2770/5655] 10.222.0.42 () {58 vars in 1248 bytes} [Sun Oct 23 01:37:11 2022] DELETE /compute/v2.1/os-volumes/18a9cb0e-7e06-41eb-a5ba-daaad516dac1 => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 23 01:37:12.090412 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1d22b202-aba4-45b8-8ec7-8b38e32f3b9d tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] Calling method '.version_select at 0x7f5cc0fba550>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:12.223378 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1d22b202-aba4-45b8-8ec7-8b38e32f3b9d tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/18a9cb0e-7e06-41eb-a5ba-daaad516dac1" status: 200 len: 344 microversion: 2.1 time: 0.137064 Oct 23 01:37:12.224214 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2886/5656] 10.222.0.42 () {58 vars in 1245 bytes} [Sun Oct 23 01:37:12 2022] GET /compute/v2.1/os-volumes/18a9cb0e-7e06-41eb-a5ba-daaad516dac1 => generated 344 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:37:12.410134 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b9d41f44-b35c-4301-9991-73457426d713 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:12.410958 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b9d41f44-b35c-4301-9991-73457426d713 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 5e817a84-2969-413e-b36b-96798e94b306] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:12.423925 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:12.427922 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9d41f44-b35c-4301-9991-73457426d713 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:12.429137 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9d41f44-b35c-4301-9991-73457426d713 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:12.430973 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9d41f44-b35c-4301-9991-73457426d713 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:12.433498 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9d41f44-b35c-4301-9991-73457426d713 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:12.436260 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9d41f44-b35c-4301-9991-73457426d713 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:12.436849 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9d41f44-b35c-4301-9991-73457426d713 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:12.677570 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b9d41f44-b35c-4301-9991-73457426d713 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:37:12.691345 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b9d41f44-b35c-4301-9991-73457426d713 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306" status: 200 len: 1614 microversion: 2.1 time: 0.287330 Oct 23 01:37:12.701246 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2771/5657] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:37:12 2022] GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306 => generated 1614 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:37:12.730824 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-3582aaf6-7fcd-4bef-85b4-6be96a63abcd req-8eb8f881-8d02-4e24-8403-d13a3ad1a7b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e817a84-2969-413e-b36b-96798e94b306", "name": "network-vif-deleted", "tag": "534551ee-86d7-4973-bb51-3acbd26169dc"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:37:12.760635 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-3582aaf6-7fcd-4bef-85b4-6be96a63abcd req-8eb8f881-8d02-4e24-8403-d13a3ad1a7b5 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:12.762779 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-3582aaf6-7fcd-4bef-85b4-6be96a63abcd req-8eb8f881-8d02-4e24-8403-d13a3ad1a7b5 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:12.765344 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-3582aaf6-7fcd-4bef-85b4-6be96a63abcd req-8eb8f881-8d02-4e24-8403-d13a3ad1a7b5 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:12.801567 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-3582aaf6-7fcd-4bef-85b4-6be96a63abcd req-8eb8f881-8d02-4e24-8403-d13a3ad1a7b5 service nova] Creating event network-vif-deleted:534551ee-86d7-4973-bb51-3acbd26169dc for instance 5e817a84-2969-413e-b36b-96798e94b306 on n-h1-master-1 Oct 23 01:37:12.814161 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-3582aaf6-7fcd-4bef-85b4-6be96a63abcd req-8eb8f881-8d02-4e24-8403-d13a3ad1a7b5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090019 Oct 23 01:37:12.814770 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2887/5658] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:37:13.238609 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d8ba20cc-b958-45d3-94d6-a468e1033559 tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] Calling method '.version_select at 0x7f5cc15628b0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:13.323469 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d8ba20cc-b958-45d3-94d6-a468e1033559 tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/18a9cb0e-7e06-41eb-a5ba-daaad516dac1" status: 200 len: 344 microversion: 2.1 time: 0.088844 Oct 23 01:37:13.324356 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2772/5659] 10.222.0.42 () {58 vars in 1245 bytes} [Sun Oct 23 01:37:13 2022] GET /compute/v2.1/os-volumes/18a9cb0e-7e06-41eb-a5ba-daaad516dac1 => generated 344 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:37:13.540903 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-41d39f06-1016-4951-b8e6-757d8ffec089 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:13.541610 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-41d39f06-1016-4951-b8e6-757d8ffec089 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 9f9af130-5a0c-46f9-8449-fa9021e48953] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:13.562528 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41d39f06-1016-4951-b8e6-757d8ffec089 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:13.563516 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41d39f06-1016-4951-b8e6-757d8ffec089 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:13.563988 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41d39f06-1016-4951-b8e6-757d8ffec089 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:13.572960 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41d39f06-1016-4951-b8e6-757d8ffec089 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:13.573678 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41d39f06-1016-4951-b8e6-757d8ffec089 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:13.574316 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41d39f06-1016-4951-b8e6-757d8ffec089 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:13.626080 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-41d39f06-1016-4951-b8e6-757d8ffec089 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] HTTP exception thrown: Instance 9f9af130-5a0c-46f9-8449-fa9021e48953 could not be found. Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-41d39f06-1016-4951-b8e6-757d8ffec089 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Request method failure captured: Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953 HTTP/1.1 Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJlvTfuM9-iirX2FXe8mkTy2eWW7UhgAXbnHf6lceGN18S7lbSlaINo5EbF9-Kmi1tphVBr2Fcj8S4BVPceiAUMjh1Az0xLOZc1N90Wz0wmSyINFoBFx331KJ40smzwK1ZOJLA4k7IFyzBj3SQlZplUyTac5KUYxpNFIDY-5Uus0ZuU Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 842dcab8b48c43d7963a538d914b0b22 Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-DeleteServersTestJSON-654775470 Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/842dcab8b48c43d7963a538d914b0b22"}]}] Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-DeleteServersTestJSON-654775470 Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 842dcab8b48c43d7963a538d914b0b22 Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-DeleteServersTestJSON-654775470 Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-DeleteServersTestJSON-654775470-project Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 634bed7898c24baca6ba00392d49eea1 Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-DeleteServersTestJSON-654775470-project Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 9f9af130-5a0c-46f9-8449-fa9021e48953 could not be found. Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '9f9af130-5a0c-46f9-8449-fa9021e48953'} Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f9af130-5a0c-46f9-8449-fa9021e48953 could not be found. Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:37:13.627800 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:37:13.631669 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f9af130-5a0c-46f9-8449-fa9021e48953 could not be found. Oct 23 01:37:13.631669 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:13.631669 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:13.631669 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:13.631669 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:13.631669 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:13.631669 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:13.631669 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:37:13.631669 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:37:13.631669 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f9af130-5a0c-46f9-8449-fa9021e48953 could not be found. Oct 23 01:37:13.631669 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:13.638775 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-41d39f06-1016-4951-b8e6-757d8ffec089 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Returning 404 to user: Instance 9f9af130-5a0c-46f9-8449-fa9021e48953 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:37:13.640042 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-41d39f06-1016-4951-b8e6-757d8ffec089 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953" status: 404 len: 111 microversion: 2.1 time: 0.105561 Oct 23 01:37:13.643392 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2888/5660] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:37:13 2022] DELETE /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:37:13.655027 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f183d01d-78bd-4866-a0f4-98c5f22e366f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:13.655863 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f183d01d-78bd-4866-a0f4-98c5f22e366f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 9f9af130-5a0c-46f9-8449-fa9021e48953] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:13.670838 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f183d01d-78bd-4866-a0f4-98c5f22e366f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:13.671567 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f183d01d-78bd-4866-a0f4-98c5f22e366f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:13.672163 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f183d01d-78bd-4866-a0f4-98c5f22e366f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:13.673830 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f183d01d-78bd-4866-a0f4-98c5f22e366f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:13.676287 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f183d01d-78bd-4866-a0f4-98c5f22e366f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:13.677327 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f183d01d-78bd-4866-a0f4-98c5f22e366f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:13.717603 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-f183d01d-78bd-4866-a0f4-98c5f22e366f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] HTTP exception thrown: Instance 9f9af130-5a0c-46f9-8449-fa9021e48953 could not be found. Oct 23 01:37:13.723225 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9ac77330-c927-43a4-85f0-43ced690d6d1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:13.724104 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9ac77330-c927-43a4-85f0-43ced690d6d1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 5e817a84-2969-413e-b36b-96798e94b306] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f183d01d-78bd-4866-a0f4-98c5f22e366f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Request method failure captured: Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953 HTTP/1.1 Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJlvTfuM9-iirX2FXe8mkTy2eWW7UhgAXbnHf6lceGN18S7lbSlaINo5EbF9-Kmi1tphVBr2Fcj8S4BVPceiAUMjh1Az0xLOZc1N90Wz0wmSyINFoBFx331KJ40smzwK1ZOJLA4k7IFyzBj3SQlZplUyTac5KUYxpNFIDY-5Uus0ZuU Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 842dcab8b48c43d7963a538d914b0b22 Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-DeleteServersTestJSON-654775470 Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/842dcab8b48c43d7963a538d914b0b22"}]}] Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-DeleteServersTestJSON-654775470 Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 842dcab8b48c43d7963a538d914b0b22 Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-DeleteServersTestJSON-654775470 Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-DeleteServersTestJSON-654775470-project Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 634bed7898c24baca6ba00392d49eea1 Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-DeleteServersTestJSON-654775470-project Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 9f9af130-5a0c-46f9-8449-fa9021e48953 could not be found. Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '9f9af130-5a0c-46f9-8449-fa9021e48953'} Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f9af130-5a0c-46f9-8449-fa9021e48953 could not be found. Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f9af130-5a0c-46f9-8449-fa9021e48953 could not be found. Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:13.737585 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:13.741243 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:13.741243 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:13.741243 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:13.741243 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:37:13.741243 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:37:13.741243 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f9af130-5a0c-46f9-8449-fa9021e48953 could not be found. Oct 23 01:37:13.741243 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:13.741243 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f183d01d-78bd-4866-a0f4-98c5f22e366f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Returning 404 to user: Instance 9f9af130-5a0c-46f9-8449-fa9021e48953 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:37:13.741243 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f183d01d-78bd-4866-a0f4-98c5f22e366f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953" status: 404 len: 111 microversion: 2.1 time: 0.091621 Oct 23 01:37:13.741781 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ac77330-c927-43a4-85f0-43ced690d6d1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:13.741781 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ac77330-c927-43a4-85f0-43ced690d6d1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:13.741930 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ac77330-c927-43a4-85f0-43ced690d6d1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:13.750853 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ac77330-c927-43a4-85f0-43ced690d6d1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:13.751365 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ac77330-c927-43a4-85f0-43ced690d6d1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:13.752146 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2773/5661] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:37:13 2022] GET /compute/v2.1/servers/9f9af130-5a0c-46f9-8449-fa9021e48953 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:37:13.754797 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ac77330-c927-43a4-85f0-43ced690d6d1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:13.771270 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4a8b4ad9-9c7d-448e-a45d-601811b9915f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:13.772472 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4a8b4ad9-9c7d-448e-a45d-601811b9915f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 79444b51-581d-4748-8265-6433d1957885] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:13.788452 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4a8b4ad9-9c7d-448e-a45d-601811b9915f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:13.789237 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4a8b4ad9-9c7d-448e-a45d-601811b9915f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:13.799108 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4a8b4ad9-9c7d-448e-a45d-601811b9915f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:13.799108 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4a8b4ad9-9c7d-448e-a45d-601811b9915f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:13.799108 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4a8b4ad9-9c7d-448e-a45d-601811b9915f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:13.800010 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4a8b4ad9-9c7d-448e-a45d-601811b9915f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:13.850688 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-4a8b4ad9-9c7d-448e-a45d-601811b9915f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] HTTP exception thrown: Instance 79444b51-581d-4748-8265-6433d1957885 could not be found. Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4a8b4ad9-9c7d-448e-a45d-601811b9915f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Request method failure captured: Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/servers/79444b51-581d-4748-8265-6433d1957885 HTTP/1.1 Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJlvTfuM9-iirX2FXe8mkTy2eWW7UhgAXbnHf6lceGN18S7lbSlaINo5EbF9-Kmi1tphVBr2Fcj8S4BVPceiAUMjh1Az0xLOZc1N90Wz0wmSyINFoBFx331KJ40smzwK1ZOJLA4k7IFyzBj3SQlZplUyTac5KUYxpNFIDY-5Uus0ZuU Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 842dcab8b48c43d7963a538d914b0b22 Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-DeleteServersTestJSON-654775470 Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/842dcab8b48c43d7963a538d914b0b22"}]}] Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-DeleteServersTestJSON-654775470 Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 842dcab8b48c43d7963a538d914b0b22 Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-DeleteServersTestJSON-654775470 Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-DeleteServersTestJSON-654775470-project Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 634bed7898c24baca6ba00392d49eea1 Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-DeleteServersTestJSON-654775470-project Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 79444b51-581d-4748-8265-6433d1957885 could not be found. Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '79444b51-581d-4748-8265-6433d1957885'} Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79444b51-581d-4748-8265-6433d1957885 could not be found. Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:37:13.858939 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:37:13.865678 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79444b51-581d-4748-8265-6433d1957885 could not be found. Oct 23 01:37:13.865678 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:13.865678 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:13.865678 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:13.865678 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:13.865678 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:13.865678 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:13.865678 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:37:13.865678 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:37:13.865678 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79444b51-581d-4748-8265-6433d1957885 could not be found. Oct 23 01:37:13.865678 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:13.868662 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4a8b4ad9-9c7d-448e-a45d-601811b9915f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Returning 404 to user: Instance 79444b51-581d-4748-8265-6433d1957885 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:37:13.870423 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ac77330-c927-43a4-85f0-43ced690d6d1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:13.872480 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4a8b4ad9-9c7d-448e-a45d-601811b9915f tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "DELETE /compute/v2.1/servers/79444b51-581d-4748-8265-6433d1957885" status: 404 len: 111 microversion: 2.1 time: 0.119228 Oct 23 01:37:13.873071 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2774/5662] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:37:13 2022] DELETE /compute/v2.1/servers/79444b51-581d-4748-8265-6433d1957885 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:37:13.873552 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ac77330-c927-43a4-85f0-43ced690d6d1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:13.875808 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ac77330-c927-43a4-85f0-43ced690d6d1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:13.876504 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-9ac77330-c927-43a4-85f0-43ced690d6d1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lazy-loading 'fault' on Instance uuid 5e817a84-2969-413e-b36b-96798e94b306 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:37:13.902094 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-205d1273-686d-4e9b-8acc-7de5901da9a5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:13.903120 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-205d1273-686d-4e9b-8acc-7de5901da9a5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] [instance: 79444b51-581d-4748-8265-6433d1957885] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:13.912210 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-205d1273-686d-4e9b-8acc-7de5901da9a5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:13.912941 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-205d1273-686d-4e9b-8acc-7de5901da9a5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:13.913662 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-205d1273-686d-4e9b-8acc-7de5901da9a5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:13.914564 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-205d1273-686d-4e9b-8acc-7de5901da9a5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:13.915162 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-205d1273-686d-4e9b-8acc-7de5901da9a5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:13.915786 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-205d1273-686d-4e9b-8acc-7de5901da9a5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:13.934298 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-205d1273-686d-4e9b-8acc-7de5901da9a5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] HTTP exception thrown: Instance 79444b51-581d-4748-8265-6433d1957885 could not be found. Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-205d1273-686d-4e9b-8acc-7de5901da9a5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Request method failure captured: Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/79444b51-581d-4748-8265-6433d1957885 HTTP/1.1 Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJlvTfuM9-iirX2FXe8mkTy2eWW7UhgAXbnHf6lceGN18S7lbSlaINo5EbF9-Kmi1tphVBr2Fcj8S4BVPceiAUMjh1Az0xLOZc1N90Wz0wmSyINFoBFx331KJ40smzwK1ZOJLA4k7IFyzBj3SQlZplUyTac5KUYxpNFIDY-5Uus0ZuU Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 842dcab8b48c43d7963a538d914b0b22 Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-DeleteServersTestJSON-654775470 Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/842dcab8b48c43d7963a538d914b0b22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/842dcab8b48c43d7963a538d914b0b22"}]}] Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-DeleteServersTestJSON-654775470 Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 842dcab8b48c43d7963a538d914b0b22 Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-DeleteServersTestJSON-654775470 Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-DeleteServersTestJSON-654775470-project Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 634bed7898c24baca6ba00392d49eea1 Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-DeleteServersTestJSON-654775470-project Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 79444b51-581d-4748-8265-6433d1957885 could not be found. Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '79444b51-581d-4748-8265-6433d1957885'} Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79444b51-581d-4748-8265-6433d1957885 could not be found. Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79444b51-581d-4748-8265-6433d1957885 could not be found. Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:13.936075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:13.939406 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:13.939406 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:13.939406 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:13.939406 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:37:13.939406 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:37:13.939406 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79444b51-581d-4748-8265-6433d1957885 could not be found. Oct 23 01:37:13.939406 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:13.942071 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-205d1273-686d-4e9b-8acc-7de5901da9a5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] Returning 404 to user: Instance 79444b51-581d-4748-8265-6433d1957885 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:37:13.943144 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-205d1273-686d-4e9b-8acc-7de5901da9a5 tempest-DeleteServersTestJSON-654775470 tempest-DeleteServersTestJSON-654775470-project] 10.222.0.42 "GET /compute/v2.1/servers/79444b51-581d-4748-8265-6433d1957885" status: 404 len: 111 microversion: 2.1 time: 0.064303 Oct 23 01:37:13.944459 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2775/5663] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:37:13 2022] GET /compute/v2.1/servers/79444b51-581d-4748-8265-6433d1957885 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:37:13.977396 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9ac77330-c927-43a4-85f0-43ced690d6d1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c65e7ab0b544d9ebdac8bc2129d051a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edb27d1224244809ecbb55ac953c645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:37:13.999790 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9ac77330-c927-43a4-85f0-43ced690d6d1 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306" status: 200 len: 1330 microversion: 2.1 time: 0.278062 Oct 23 01:37:14.003160 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2889/5664] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:37:13 2022] GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306 => generated 1330 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:37:14.340024 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-41166a2f-2f2e-4a01-b7c7-fabf49c5d327 tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] Calling method '.version_select at 0x7f5cc0ec44c0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:14.459955 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-41166a2f-2f2e-4a01-b7c7-fabf49c5d327 tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/18a9cb0e-7e06-41eb-a5ba-daaad516dac1" status: 200 len: 344 microversion: 2.1 time: 0.126045 Oct 23 01:37:14.461102 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2776/5665] 10.222.0.42 () {58 vars in 1245 bytes} [Sun Oct 23 01:37:14 2022] GET /compute/v2.1/os-volumes/18a9cb0e-7e06-41eb-a5ba-daaad516dac1 => generated 344 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:37:15.028873 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-333e9a81-7c90-482a-8117-601ea29165e7 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:15.029421 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-333e9a81-7c90-482a-8117-601ea29165e7 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 5e817a84-2969-413e-b36b-96798e94b306] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:15.043655 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-333e9a81-7c90-482a-8117-601ea29165e7 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:15.044378 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-333e9a81-7c90-482a-8117-601ea29165e7 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:15.044979 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-333e9a81-7c90-482a-8117-601ea29165e7 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:15.046040 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-333e9a81-7c90-482a-8117-601ea29165e7 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:15.046673 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-333e9a81-7c90-482a-8117-601ea29165e7 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:15.054721 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-333e9a81-7c90-482a-8117-601ea29165e7 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:15.098097 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-333e9a81-7c90-482a-8117-601ea29165e7 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] HTTP exception thrown: Instance 5e817a84-2969-413e-b36b-96798e94b306 could not be found. Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-333e9a81-7c90-482a-8117-601ea29165e7 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Request method failure captured: Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306 HTTP/1.1 Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJkvYHBhNP-ngrp3-t9b3JEvPymaCLxveQy3RHlcnEhTQOwrgKm_FYFqgl1O3oBP9pMRjY52nNZb_Q0xi9HfDiuiJB7SCfmksRniHRxHyItsbztYyPUcQD1NZfU4JeOPY635AaAApWVr1Jjx20AyHyGm3ekhiRFvnH_BMldZWZd5QMc Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 6edb27d1224244809ecbb55ac953c645 Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-AttachVolumeNegativeTest-742145495 Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6edb27d1224244809ecbb55ac953c645"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6edb27d1224244809ecbb55ac953c645"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6edb27d1224244809ecbb55ac953c645"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6edb27d1224244809ecbb55ac953c645"}]}] Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-AttachVolumeNegativeTest-742145495 Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 6edb27d1224244809ecbb55ac953c645 Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-742145495 Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-AttachVolumeNegativeTest-742145495-project Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 0c65e7ab0b544d9ebdac8bc2129d051a Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-AttachVolumeNegativeTest-742145495-project Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 5e817a84-2969-413e-b36b-96798e94b306 could not be found. Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '5e817a84-2969-413e-b36b-96798e94b306'} Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e817a84-2969-413e-b36b-96798e94b306 could not be found. Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e817a84-2969-413e-b36b-96798e94b306 could not be found. Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:15.099690 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:15.104233 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:15.104233 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:15.104233 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:15.104233 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:37:15.104233 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:37:15.104233 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e817a84-2969-413e-b36b-96798e94b306 could not be found. Oct 23 01:37:15.104233 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:15.105332 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-333e9a81-7c90-482a-8117-601ea29165e7 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Returning 404 to user: Instance 5e817a84-2969-413e-b36b-96798e94b306 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:37:15.106887 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-333e9a81-7c90-482a-8117-601ea29165e7 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306" status: 404 len: 111 microversion: 2.1 time: 0.081971 Oct 23 01:37:15.109275 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2890/5666] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:37:15 2022] GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:37:15.124840 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3cdfd229-b8da-49d2-94a5-61b9d9296218 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '.version_select at 0x7f5cc0f22820>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:15.221396 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3cdfd229-b8da-49d2-94a5-61b9d9296218 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-613011138" status: 202 len: 0 microversion: 2.1 time: 0.107282 Oct 23 01:37:15.222278 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2777/5667] 10.222.0.42 () {58 vars in 1218 bytes} [Sun Oct 23 01:37:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-613011138 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:37:15.474908 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b3867ecf-19c9-4c7e-adb5-fc5c6db42648 tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] Calling method '.version_select at 0x7f5cc0a420d0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:15.589408 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b3867ecf-19c9-4c7e-adb5-fc5c6db42648 tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/18a9cb0e-7e06-41eb-a5ba-daaad516dac1" status: 200 len: 344 microversion: 2.1 time: 0.118214 Oct 23 01:37:15.589991 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2891/5668] 10.222.0.42 () {58 vars in 1245 bytes} [Sun Oct 23 01:37:15 2022] GET /compute/v2.1/os-volumes/18a9cb0e-7e06-41eb-a5ba-daaad516dac1 => generated 344 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:37:16.605294 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a67ab81d-30ab-4fc2-8293-ad1f7f2bea33 tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] Calling method '.version_select at 0x7f5cc1732040>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:16.649314 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-a67ab81d-30ab-4fc2-8293-ad1f7f2bea33 tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] HTTP exception thrown: Volume 18a9cb0e-7e06-41eb-a5ba-daaad516dac1 could not be found. Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a67ab81d-30ab-4fc2-8293-ad1f7f2bea33 tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] Request method failure captured: Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/os-volumes/18a9cb0e-7e06-41eb-a5ba-daaad516dac1 HTTP/1.1 Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJq8Neh2-G7Pn5Tjh7uiDC8RwmTRbaWgW1NQiMAp7DjfQ-ZEwBMXkHBx6uRATkMPLQEHEHJaJN3sftCnxFbeKKufeZzIwWxJWyrT1exbpDOniXdBpIJ5ZV80RA3V4NDSara6Zz9D9mnbI2gN3MPkkOqsdesAVpFvwfAFJwTNZSAy4yE Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 68dabe2cafd046fea4cb35076787f899 Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-825083434 Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/68dabe2cafd046fea4cb35076787f899"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_68dabe2cafd046fea4cb35076787f899"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/68dabe2cafd046fea4cb35076787f899"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/68dabe2cafd046fea4cb35076787f899"}]}] Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-VolumesSnapshotsTestJSON-825083434 Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 68dabe2cafd046fea4cb35076787f899 Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-825083434 Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-VolumesSnapshotsTestJSON-825083434-project Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: cedcdb82756b4512b9cd7db2649e8435 Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-VolumesSnapshotsTestJSON-825083434-project Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: method: Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: exception: Volume 18a9cb0e-7e06-41eb-a5ba-daaad516dac1 could not be found. Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '18a9cb0e-7e06-41eb-a5ba-daaad516dac1'} Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 18a9cb0e-7e06-41eb-a5ba-daaad516dac1 could not be found. (HTTP 404) (Request-ID: req-d89c9755-09d4-4104-b149-7e3137a336eb) Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 23 01:37:16.652046 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 01:37:16.656048 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 01:37:16.656048 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 23 01:37:16.656048 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 23 01:37:16.656048 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 23 01:37:16.656048 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 23 01:37:16.656048 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 23 01:37:16.656048 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 23 01:37:16.656048 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 23 01:37:16.656048 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 23 01:37:16.656048 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 01:37:16.656048 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 01:37:16.656048 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 01:37:16.656048 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 01:37:16.656048 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 18a9cb0e-7e06-41eb-a5ba-daaad516dac1 could not be found. Oct 23 01:37:16.656048 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:16.656048 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:16.656048 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:16.656048 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:16.656048 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:16.656048 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:16.656048 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:37:16.656048 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:37:16.656048 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:37:16.656048 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:37:16.656048 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:37:16.656048 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:37:16.656048 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 23 01:37:16.656048 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:37:16.656048 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 18a9cb0e-7e06-41eb-a5ba-daaad516dac1 could not be found. Oct 23 01:37:16.656048 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:16.656048 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:16.656048 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:16.656048 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:16.656048 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:16.656048 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:16.656048 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:37:16.656048 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:37:16.656048 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 18a9cb0e-7e06-41eb-a5ba-daaad516dac1 could not be found. Oct 23 01:37:16.656048 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:16.656048 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a67ab81d-30ab-4fc2-8293-ad1f7f2bea33 tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] Returning 404 to user: Volume 18a9cb0e-7e06-41eb-a5ba-daaad516dac1 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:37:16.656048 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a67ab81d-30ab-4fc2-8293-ad1f7f2bea33 tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/18a9cb0e-7e06-41eb-a5ba-daaad516dac1" status: 404 len: 109 microversion: 2.1 time: 0.053836 Oct 23 01:37:16.656048 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2778/5669] 10.222.0.42 () {58 vars in 1245 bytes} [Sun Oct 23 01:37:16 2022] GET /compute/v2.1/os-volumes/18a9cb0e-7e06-41eb-a5ba-daaad516dac1 => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:37:16.665954 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6b19dddc-805a-4549-868d-9bdc3c1e0925 tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] Calling method '.version_select at 0x7f5cc09d9550>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:16.722539 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-6b19dddc-805a-4549-868d-9bdc3c1e0925 tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] HTTP exception thrown: Volume 18a9cb0e-7e06-41eb-a5ba-daaad516dac1 could not be found. Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6b19dddc-805a-4549-868d-9bdc3c1e0925 tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] Request method failure captured: Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/os-volumes/18a9cb0e-7e06-41eb-a5ba-daaad516dac1 HTTP/1.1 Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJq8Neh2-G7Pn5Tjh7uiDC8RwmTRbaWgW1NQiMAp7DjfQ-ZEwBMXkHBx6uRATkMPLQEHEHJaJN3sftCnxFbeKKufeZzIwWxJWyrT1exbpDOniXdBpIJ5ZV80RA3V4NDSara6Zz9D9mnbI2gN3MPkkOqsdesAVpFvwfAFJwTNZSAy4yE Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 68dabe2cafd046fea4cb35076787f899 Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-825083434 Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/68dabe2cafd046fea4cb35076787f899"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_68dabe2cafd046fea4cb35076787f899"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/68dabe2cafd046fea4cb35076787f899"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/68dabe2cafd046fea4cb35076787f899"}]}] Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-VolumesSnapshotsTestJSON-825083434 Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 68dabe2cafd046fea4cb35076787f899 Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-825083434 Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-VolumesSnapshotsTestJSON-825083434-project Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: cedcdb82756b4512b9cd7db2649e8435 Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-VolumesSnapshotsTestJSON-825083434-project Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: method: Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: exception: Volume 18a9cb0e-7e06-41eb-a5ba-daaad516dac1 could not be found. Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '18a9cb0e-7e06-41eb-a5ba-daaad516dac1'} Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 18a9cb0e-7e06-41eb-a5ba-daaad516dac1 could not be found. (HTTP 404) (Request-ID: req-90f5e640-1a14-424c-8580-59530e8f4f0d) Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 23 01:37:16.724520 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 01:37:16.736179 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 01:37:16.736179 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 23 01:37:16.736179 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 23 01:37:16.736179 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 23 01:37:16.736179 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 23 01:37:16.736179 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 23 01:37:16.736179 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 23 01:37:16.736179 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 23 01:37:16.736179 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 23 01:37:16.736179 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 01:37:16.736179 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 01:37:16.736179 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 01:37:16.736179 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 01:37:16.736179 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 18a9cb0e-7e06-41eb-a5ba-daaad516dac1 could not be found. Oct 23 01:37:16.736179 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:16.736179 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:16.736179 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:16.736179 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:16.736179 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:16.736179 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:16.736179 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:37:16.736179 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:37:16.736179 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:37:16.736179 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:37:16.736179 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:37:16.736179 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:37:16.736179 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 23 01:37:16.736179 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:37:16.736179 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 18a9cb0e-7e06-41eb-a5ba-daaad516dac1 could not be found. Oct 23 01:37:16.736179 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:16.736179 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:16.736179 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:16.736179 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:16.736179 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:16.736179 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:16.736179 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:37:16.736179 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:37:16.736179 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 18a9cb0e-7e06-41eb-a5ba-daaad516dac1 could not be found. Oct 23 01:37:16.736179 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:16.736179 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6b19dddc-805a-4549-868d-9bdc3c1e0925 tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] Returning 404 to user: Volume 18a9cb0e-7e06-41eb-a5ba-daaad516dac1 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:37:16.736179 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6b19dddc-805a-4549-868d-9bdc3c1e0925 tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/18a9cb0e-7e06-41eb-a5ba-daaad516dac1" status: 404 len: 109 microversion: 2.1 time: 0.065409 Oct 23 01:37:16.736179 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2892/5670] 10.222.0.42 () {58 vars in 1248 bytes} [Sun Oct 23 01:37:16 2022] DELETE /compute/v2.1/os-volumes/18a9cb0e-7e06-41eb-a5ba-daaad516dac1 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:37:16.739721 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7e1c8bd3-2bd3-4002-8925-90e70135b40c tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] Calling method '.version_select at 0x7f5cc14e90d0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:16.778116 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-7e1c8bd3-2bd3-4002-8925-90e70135b40c tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] HTTP exception thrown: Volume 18a9cb0e-7e06-41eb-a5ba-daaad516dac1 could not be found. Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7e1c8bd3-2bd3-4002-8925-90e70135b40c tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] Request method failure captured: Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/os-volumes/18a9cb0e-7e06-41eb-a5ba-daaad516dac1 HTTP/1.1 Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJq8Neh2-G7Pn5Tjh7uiDC8RwmTRbaWgW1NQiMAp7DjfQ-ZEwBMXkHBx6uRATkMPLQEHEHJaJN3sftCnxFbeKKufeZzIwWxJWyrT1exbpDOniXdBpIJ5ZV80RA3V4NDSara6Zz9D9mnbI2gN3MPkkOqsdesAVpFvwfAFJwTNZSAy4yE Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 68dabe2cafd046fea4cb35076787f899 Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-825083434 Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/68dabe2cafd046fea4cb35076787f899"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_68dabe2cafd046fea4cb35076787f899"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/68dabe2cafd046fea4cb35076787f899"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/68dabe2cafd046fea4cb35076787f899"}]}] Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-VolumesSnapshotsTestJSON-825083434 Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 68dabe2cafd046fea4cb35076787f899 Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-825083434 Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-VolumesSnapshotsTestJSON-825083434-project Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: cedcdb82756b4512b9cd7db2649e8435 Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-VolumesSnapshotsTestJSON-825083434-project Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: method: Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: exception: Volume 18a9cb0e-7e06-41eb-a5ba-daaad516dac1 could not be found. Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '18a9cb0e-7e06-41eb-a5ba-daaad516dac1'} Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 18a9cb0e-7e06-41eb-a5ba-daaad516dac1 could not be found. (HTTP 404) (Request-ID: req-c4c28a65-1f58-4cf4-b707-d4573407637f) Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 23 01:37:16.780390 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 01:37:16.784025 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 01:37:16.784025 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 23 01:37:16.784025 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 23 01:37:16.784025 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 23 01:37:16.784025 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 23 01:37:16.784025 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 23 01:37:16.784025 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 23 01:37:16.784025 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 23 01:37:16.784025 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 23 01:37:16.784025 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 01:37:16.784025 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 01:37:16.784025 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 01:37:16.784025 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 01:37:16.784025 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 18a9cb0e-7e06-41eb-a5ba-daaad516dac1 could not be found. Oct 23 01:37:16.784025 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:16.784025 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:16.784025 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:16.784025 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:16.784025 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:16.784025 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:16.784025 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:37:16.784025 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:37:16.784025 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:37:16.784025 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:37:16.784025 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:37:16.784025 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:37:16.784025 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 23 01:37:16.784025 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:37:16.784025 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 18a9cb0e-7e06-41eb-a5ba-daaad516dac1 could not be found. Oct 23 01:37:16.784025 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:16.784025 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:16.784025 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:16.784025 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:16.784025 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:16.784025 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:16.784025 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:37:16.784025 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:37:16.784025 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 18a9cb0e-7e06-41eb-a5ba-daaad516dac1 could not be found. Oct 23 01:37:16.784025 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:16.784025 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7e1c8bd3-2bd3-4002-8925-90e70135b40c tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] Returning 404 to user: Volume 18a9cb0e-7e06-41eb-a5ba-daaad516dac1 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:37:16.784025 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7e1c8bd3-2bd3-4002-8925-90e70135b40c tempest-VolumesSnapshotsTestJSON-825083434 tempest-VolumesSnapshotsTestJSON-825083434-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/18a9cb0e-7e06-41eb-a5ba-daaad516dac1" status: 404 len: 109 microversion: 2.1 time: 0.051113 Oct 23 01:37:16.784025 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2779/5671] 10.222.0.42 () {58 vars in 1245 bytes} [Sun Oct 23 01:37:16 2022] GET /compute/v2.1/os-volumes/18a9cb0e-7e06-41eb-a5ba-daaad516dac1 => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 01:37:24.037256 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cf81a4fa-92c0-48d6-ab23-f63c6af30ab5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:24.041442 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-cf81a4fa-92c0-48d6-ab23-f63c6af30ab5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 5e817a84-2969-413e-b36b-96798e94b306] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:24.099626 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf81a4fa-92c0-48d6-ab23-f63c6af30ab5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:24.104503 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf81a4fa-92c0-48d6-ab23-f63c6af30ab5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:24.108652 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf81a4fa-92c0-48d6-ab23-f63c6af30ab5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:24.118975 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf81a4fa-92c0-48d6-ab23-f63c6af30ab5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:24.123878 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf81a4fa-92c0-48d6-ab23-f63c6af30ab5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:24.132200 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf81a4fa-92c0-48d6-ab23-f63c6af30ab5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:24.194409 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-cf81a4fa-92c0-48d6-ab23-f63c6af30ab5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] HTTP exception thrown: Instance 5e817a84-2969-413e-b36b-96798e94b306 could not be found. Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cf81a4fa-92c0-48d6-ab23-f63c6af30ab5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Request method failure captured: Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306 HTTP/1.1 Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJkvYHBhNP-ngrp3-t9b3JEvPymaCLxveQy3RHlcnEhTQOwrgKm_FYFqgl1O3oBP9pMRjY52nNZb_Q0xi9HfDiuiJB7SCfmksRniHRxHyItsbztYyPUcQD1NZfU4JeOPY635AaAApWVr1Jjx20AyHyGm3ekhiRFvnH_BMldZWZd5QMc Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 6edb27d1224244809ecbb55ac953c645 Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-AttachVolumeNegativeTest-742145495 Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6edb27d1224244809ecbb55ac953c645"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6edb27d1224244809ecbb55ac953c645"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6edb27d1224244809ecbb55ac953c645"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6edb27d1224244809ecbb55ac953c645"}]}] Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-AttachVolumeNegativeTest-742145495 Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 6edb27d1224244809ecbb55ac953c645 Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-742145495 Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-AttachVolumeNegativeTest-742145495-project Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 0c65e7ab0b544d9ebdac8bc2129d051a Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-AttachVolumeNegativeTest-742145495-project Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 5e817a84-2969-413e-b36b-96798e94b306 could not be found. Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '5e817a84-2969-413e-b36b-96798e94b306'} Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e817a84-2969-413e-b36b-96798e94b306 could not be found. Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:37:24.200422 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:37:24.203692 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e817a84-2969-413e-b36b-96798e94b306 could not be found. Oct 23 01:37:24.203692 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:24.203692 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:24.203692 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:24.203692 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:24.203692 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:24.203692 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:24.203692 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:37:24.203692 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:37:24.203692 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e817a84-2969-413e-b36b-96798e94b306 could not be found. Oct 23 01:37:24.203692 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:24.208696 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cf81a4fa-92c0-48d6-ab23-f63c6af30ab5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Returning 404 to user: Instance 5e817a84-2969-413e-b36b-96798e94b306 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:37:24.214432 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cf81a4fa-92c0-48d6-ab23-f63c6af30ab5 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306" status: 404 len: 111 microversion: 2.1 time: 0.187069 Oct 23 01:37:24.223497 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=28 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:24.235210 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-36ab0520-5e51-4cd1-bbe9-021d7af41d26 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:24.236133 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-36ab0520-5e51-4cd1-bbe9-021d7af41d26 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 5e817a84-2969-413e-b36b-96798e94b306] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:24.238542 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2893/5672] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:37:24 2022] DELETE /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306 => generated 111 bytes in 211 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:37:24.269136 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36ab0520-5e51-4cd1-bbe9-021d7af41d26 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:24.270214 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36ab0520-5e51-4cd1-bbe9-021d7af41d26 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:24.276033 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36ab0520-5e51-4cd1-bbe9-021d7af41d26 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:24.277192 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36ab0520-5e51-4cd1-bbe9-021d7af41d26 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:24.280082 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36ab0520-5e51-4cd1-bbe9-021d7af41d26 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:24.282139 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36ab0520-5e51-4cd1-bbe9-021d7af41d26 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:24.332237 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-36ab0520-5e51-4cd1-bbe9-021d7af41d26 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] HTTP exception thrown: Instance 5e817a84-2969-413e-b36b-96798e94b306 could not be found. Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-36ab0520-5e51-4cd1-bbe9-021d7af41d26 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Request method failure captured: Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306 HTTP/1.1 Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJkvYHBhNP-ngrp3-t9b3JEvPymaCLxveQy3RHlcnEhTQOwrgKm_FYFqgl1O3oBP9pMRjY52nNZb_Q0xi9HfDiuiJB7SCfmksRniHRxHyItsbztYyPUcQD1NZfU4JeOPY635AaAApWVr1Jjx20AyHyGm3ekhiRFvnH_BMldZWZd5QMc Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 6edb27d1224244809ecbb55ac953c645 Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-AttachVolumeNegativeTest-742145495 Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6edb27d1224244809ecbb55ac953c645"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6edb27d1224244809ecbb55ac953c645"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6edb27d1224244809ecbb55ac953c645"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6edb27d1224244809ecbb55ac953c645"}]}] Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-AttachVolumeNegativeTest-742145495 Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 6edb27d1224244809ecbb55ac953c645 Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-742145495 Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-AttachVolumeNegativeTest-742145495-project Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 0c65e7ab0b544d9ebdac8bc2129d051a Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-AttachVolumeNegativeTest-742145495-project Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 5e817a84-2969-413e-b36b-96798e94b306 could not be found. Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '5e817a84-2969-413e-b36b-96798e94b306'} Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e817a84-2969-413e-b36b-96798e94b306 could not be found. Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e817a84-2969-413e-b36b-96798e94b306 could not be found. Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:24.335619 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:24.339608 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:24.339608 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:24.339608 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:24.339608 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:37:24.339608 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:37:24.339608 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e817a84-2969-413e-b36b-96798e94b306 could not be found. Oct 23 01:37:24.339608 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:24.339608 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-36ab0520-5e51-4cd1-bbe9-021d7af41d26 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Returning 404 to user: Instance 5e817a84-2969-413e-b36b-96798e94b306 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:37:24.340067 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-36ab0520-5e51-4cd1-bbe9-021d7af41d26 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306" status: 404 len: 111 microversion: 2.1 time: 0.118568 Oct 23 01:37:24.341908 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2780/5673] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:37:24 2022] GET /compute/v2.1/servers/5e817a84-2969-413e-b36b-96798e94b306 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 01:37:29.096746 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f4a2f88a-d29d-4a95-9b20-e3074b34217d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:29.097381 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f4a2f88a-d29d-4a95-9b20-e3074b34217d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:29.114180 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4a2f88a-d29d-4a95-9b20-e3074b34217d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:29.118749 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4a2f88a-d29d-4a95-9b20-e3074b34217d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:29.119861 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4a2f88a-d29d-4a95-9b20-e3074b34217d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:29.122272 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4a2f88a-d29d-4a95-9b20-e3074b34217d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:29.123405 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4a2f88a-d29d-4a95-9b20-e3074b34217d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:29.125389 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4a2f88a-d29d-4a95-9b20-e3074b34217d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:29.755647 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f4a2f88a-d29d-4a95-9b20-e3074b34217d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:37:29.766564 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f4a2f88a-d29d-4a95-9b20-e3074b34217d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1669 microversion: 2.1 time: 0.673692 Oct 23 01:37:29.768731 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2894/5674] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:37:29 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1669 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:37:29.795517 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-00b4831c-3b3c-49d8-a5f9-e99d41953ce0 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:29.796143 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-00b4831c-3b3c-49d8-a5f9-e99d41953ce0 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:29.824334 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-00b4831c-3b3c-49d8-a5f9-e99d41953ce0 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:29.829934 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-00b4831c-3b3c-49d8-a5f9-e99d41953ce0 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:29.829934 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-00b4831c-3b3c-49d8-a5f9-e99d41953ce0 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:29.829934 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-00b4831c-3b3c-49d8-a5f9-e99d41953ce0 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:29.829934 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-00b4831c-3b3c-49d8-a5f9-e99d41953ce0 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:29.829934 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-00b4831c-3b3c-49d8-a5f9-e99d41953ce0 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:30.369696 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b6d891d0-3ef8-47ea-aa21-9fdf47ffe690 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:30.371083 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b6d891d0-3ef8-47ea-aa21-9fdf47ffe690 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 697bf9a9-687f-4d5f-a459-9ff304289577] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:30.462794 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b6d891d0-3ef8-47ea-aa21-9fdf47ffe690 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:30.462794 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b6d891d0-3ef8-47ea-aa21-9fdf47ffe690 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:30.462794 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b6d891d0-3ef8-47ea-aa21-9fdf47ffe690 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:30.462794 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b6d891d0-3ef8-47ea-aa21-9fdf47ffe690 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:30.462794 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b6d891d0-3ef8-47ea-aa21-9fdf47ffe690 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:30.462794 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b6d891d0-3ef8-47ea-aa21-9fdf47ffe690 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:30.463714 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-00b4831c-3b3c-49d8-a5f9-e99d41953ce0 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:37:30.463714 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-00b4831c-3b3c-49d8-a5f9-e99d41953ce0 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1669 microversion: 2.1 time: 0.626006 Oct 23 01:37:30.463714 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2781/5675] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:37:29 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1669 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-b6d891d0-3ef8-47ea-aa21-9fdf47ffe690 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] HTTP exception thrown: Instance 697bf9a9-687f-4d5f-a459-9ff304289577 could not be found. Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b6d891d0-3ef8-47ea-aa21-9fdf47ffe690 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Request method failure captured: Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577 HTTP/1.1 Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJkvYHBhNP-ngrp3-t9b3JEvPymaCLxveQy3RHlcnEhTQOwrgKm_FYFqgl1O3oBP9pMRjY52nNZb_Q0xi9HfDiuiJB7SCfmksRniHRxHyItsbztYyPUcQD1NZfU4JeOPY635AaAApWVr1Jjx20AyHyGm3ekhiRFvnH_BMldZWZd5QMc Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 6edb27d1224244809ecbb55ac953c645 Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-AttachVolumeNegativeTest-742145495 Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6edb27d1224244809ecbb55ac953c645"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6edb27d1224244809ecbb55ac953c645"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6edb27d1224244809ecbb55ac953c645"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6edb27d1224244809ecbb55ac953c645"}]}] Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-AttachVolumeNegativeTest-742145495 Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 6edb27d1224244809ecbb55ac953c645 Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-742145495 Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-AttachVolumeNegativeTest-742145495-project Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 0c65e7ab0b544d9ebdac8bc2129d051a Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-AttachVolumeNegativeTest-742145495-project Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 697bf9a9-687f-4d5f-a459-9ff304289577 could not be found. Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '697bf9a9-687f-4d5f-a459-9ff304289577'} Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 697bf9a9-687f-4d5f-a459-9ff304289577 could not be found. Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:37:30.464087 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:37:30.468100 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:37:30.468100 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:37:30.468100 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:37:30.468100 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 697bf9a9-687f-4d5f-a459-9ff304289577 could not be found. Oct 23 01:37:30.468100 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:30.468100 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:30.468100 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:30.468100 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:30.468100 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:30.468100 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:30.468100 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:37:30.468100 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:37:30.468100 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 697bf9a9-687f-4d5f-a459-9ff304289577 could not be found. Oct 23 01:37:30.468100 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:30.468100 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b6d891d0-3ef8-47ea-aa21-9fdf47ffe690 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Returning 404 to user: Instance 697bf9a9-687f-4d5f-a459-9ff304289577 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:37:30.468100 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b6d891d0-3ef8-47ea-aa21-9fdf47ffe690 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "DELETE /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577" status: 404 len: 111 microversion: 2.1 time: 0.087355 Oct 23 01:37:30.468100 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2895/5676] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:37:30 2022] DELETE /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:37:30.476418 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d9cabe6e-119c-462f-b4a8-c23c8d908b21 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:30.478210 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d9cabe6e-119c-462f-b4a8-c23c8d908b21 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 697bf9a9-687f-4d5f-a459-9ff304289577] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:30.493263 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-457351ee-d1c9-4158-86bb-0b5bc749835e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:30.496366 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-457351ee-d1c9-4158-86bb-0b5bc749835e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:30.501927 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9cabe6e-119c-462f-b4a8-c23c8d908b21 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:30.502688 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9cabe6e-119c-462f-b4a8-c23c8d908b21 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:30.505295 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9cabe6e-119c-462f-b4a8-c23c8d908b21 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:30.507049 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9cabe6e-119c-462f-b4a8-c23c8d908b21 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:30.507579 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9cabe6e-119c-462f-b4a8-c23c8d908b21 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:30.511417 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9cabe6e-119c-462f-b4a8-c23c8d908b21 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:30.516543 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-457351ee-d1c9-4158-86bb-0b5bc749835e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:30.517063 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-457351ee-d1c9-4158-86bb-0b5bc749835e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:30.517743 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-457351ee-d1c9-4158-86bb-0b5bc749835e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:30.519420 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-457351ee-d1c9-4158-86bb-0b5bc749835e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:30.527977 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-457351ee-d1c9-4158-86bb-0b5bc749835e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:30.527977 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-457351ee-d1c9-4158-86bb-0b5bc749835e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:30.554468 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-d9cabe6e-119c-462f-b4a8-c23c8d908b21 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] HTTP exception thrown: Instance 697bf9a9-687f-4d5f-a459-9ff304289577 could not be found. Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d9cabe6e-119c-462f-b4a8-c23c8d908b21 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Request method failure captured: Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577 HTTP/1.1 Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJkvYHBhNP-ngrp3-t9b3JEvPymaCLxveQy3RHlcnEhTQOwrgKm_FYFqgl1O3oBP9pMRjY52nNZb_Q0xi9HfDiuiJB7SCfmksRniHRxHyItsbztYyPUcQD1NZfU4JeOPY635AaAApWVr1Jjx20AyHyGm3ekhiRFvnH_BMldZWZd5QMc Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 6edb27d1224244809ecbb55ac953c645 Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-AttachVolumeNegativeTest-742145495 Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6edb27d1224244809ecbb55ac953c645"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6edb27d1224244809ecbb55ac953c645"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6edb27d1224244809ecbb55ac953c645"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6edb27d1224244809ecbb55ac953c645"}]}] Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-AttachVolumeNegativeTest-742145495 Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 6edb27d1224244809ecbb55ac953c645 Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-742145495 Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-AttachVolumeNegativeTest-742145495-project Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 0c65e7ab0b544d9ebdac8bc2129d051a Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-AttachVolumeNegativeTest-742145495-project Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 697bf9a9-687f-4d5f-a459-9ff304289577 could not be found. Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '697bf9a9-687f-4d5f-a459-9ff304289577'} Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 697bf9a9-687f-4d5f-a459-9ff304289577 could not be found. Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 697bf9a9-687f-4d5f-a459-9ff304289577 could not be found. Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:30.565180 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:30.570303 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:30.570303 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:30.570303 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:30.570303 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:37:30.570303 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:37:30.570303 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 697bf9a9-687f-4d5f-a459-9ff304289577 could not be found. Oct 23 01:37:30.570303 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:30.573391 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d9cabe6e-119c-462f-b4a8-c23c8d908b21 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Returning 404 to user: Instance 697bf9a9-687f-4d5f-a459-9ff304289577 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:37:30.577398 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d9cabe6e-119c-462f-b4a8-c23c8d908b21 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577" status: 404 len: 111 microversion: 2.1 time: 0.105494 Oct 23 01:37:30.580835 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2782/5677] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:37:30 2022] GET /compute/v2.1/servers/697bf9a9-687f-4d5f-a459-9ff304289577 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:37:30.596069 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-db360e2a-be02-403b-b7bb-0c2bfa02917e tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:30.597967 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-db360e2a-be02-403b-b7bb-0c2bfa02917e tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 78708eaa-2dad-44bc-a145-86dcc21ca804] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:30.620979 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-db360e2a-be02-403b-b7bb-0c2bfa02917e tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:30.620979 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-db360e2a-be02-403b-b7bb-0c2bfa02917e tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:30.620979 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-db360e2a-be02-403b-b7bb-0c2bfa02917e tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:30.620979 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-db360e2a-be02-403b-b7bb-0c2bfa02917e tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:30.620979 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-db360e2a-be02-403b-b7bb-0c2bfa02917e tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:30.620979 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-db360e2a-be02-403b-b7bb-0c2bfa02917e tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:30.655596 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-db360e2a-be02-403b-b7bb-0c2bfa02917e tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] HTTP exception thrown: Instance 78708eaa-2dad-44bc-a145-86dcc21ca804 could not be found. Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-db360e2a-be02-403b-b7bb-0c2bfa02917e tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Request method failure captured: Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/servers/78708eaa-2dad-44bc-a145-86dcc21ca804 HTTP/1.1 Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJkvYHBhNP-ngrp3-t9b3JEvPymaCLxveQy3RHlcnEhTQOwrgKm_FYFqgl1O3oBP9pMRjY52nNZb_Q0xi9HfDiuiJB7SCfmksRniHRxHyItsbztYyPUcQD1NZfU4JeOPY635AaAApWVr1Jjx20AyHyGm3ekhiRFvnH_BMldZWZd5QMc Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 6edb27d1224244809ecbb55ac953c645 Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-AttachVolumeNegativeTest-742145495 Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6edb27d1224244809ecbb55ac953c645"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6edb27d1224244809ecbb55ac953c645"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6edb27d1224244809ecbb55ac953c645"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6edb27d1224244809ecbb55ac953c645"}]}] Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-AttachVolumeNegativeTest-742145495 Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 6edb27d1224244809ecbb55ac953c645 Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-742145495 Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-AttachVolumeNegativeTest-742145495-project Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 0c65e7ab0b544d9ebdac8bc2129d051a Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-AttachVolumeNegativeTest-742145495-project Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 78708eaa-2dad-44bc-a145-86dcc21ca804 could not be found. Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '78708eaa-2dad-44bc-a145-86dcc21ca804'} Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78708eaa-2dad-44bc-a145-86dcc21ca804 could not be found. Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:37:30.657185 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:37:30.660484 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78708eaa-2dad-44bc-a145-86dcc21ca804 could not be found. Oct 23 01:37:30.660484 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:30.660484 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:30.660484 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:30.660484 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:30.660484 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:30.660484 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:30.660484 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:37:30.660484 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:37:30.660484 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78708eaa-2dad-44bc-a145-86dcc21ca804 could not be found. Oct 23 01:37:30.660484 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:30.660484 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-db360e2a-be02-403b-b7bb-0c2bfa02917e tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Returning 404 to user: Instance 78708eaa-2dad-44bc-a145-86dcc21ca804 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:37:30.661223 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-db360e2a-be02-403b-b7bb-0c2bfa02917e tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "DELETE /compute/v2.1/servers/78708eaa-2dad-44bc-a145-86dcc21ca804" status: 404 len: 111 microversion: 2.1 time: 0.078158 Oct 23 01:37:30.662410 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2783/5678] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:37:30 2022] DELETE /compute/v2.1/servers/78708eaa-2dad-44bc-a145-86dcc21ca804 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:37:30.674640 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ca3dcb36-c2d9-4353-a455-0e9a13b9a735 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:30.675646 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ca3dcb36-c2d9-4353-a455-0e9a13b9a735 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: 78708eaa-2dad-44bc-a145-86dcc21ca804] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:30.683858 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca3dcb36-c2d9-4353-a455-0e9a13b9a735 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:30.685173 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca3dcb36-c2d9-4353-a455-0e9a13b9a735 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:30.686403 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca3dcb36-c2d9-4353-a455-0e9a13b9a735 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:30.687315 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca3dcb36-c2d9-4353-a455-0e9a13b9a735 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:30.688579 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca3dcb36-c2d9-4353-a455-0e9a13b9a735 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:30.689391 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca3dcb36-c2d9-4353-a455-0e9a13b9a735 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:30.708650 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-ca3dcb36-c2d9-4353-a455-0e9a13b9a735 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] HTTP exception thrown: Instance 78708eaa-2dad-44bc-a145-86dcc21ca804 could not be found. Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ca3dcb36-c2d9-4353-a455-0e9a13b9a735 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Request method failure captured: Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/78708eaa-2dad-44bc-a145-86dcc21ca804 HTTP/1.1 Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJkvYHBhNP-ngrp3-t9b3JEvPymaCLxveQy3RHlcnEhTQOwrgKm_FYFqgl1O3oBP9pMRjY52nNZb_Q0xi9HfDiuiJB7SCfmksRniHRxHyItsbztYyPUcQD1NZfU4JeOPY635AaAApWVr1Jjx20AyHyGm3ekhiRFvnH_BMldZWZd5QMc Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 6edb27d1224244809ecbb55ac953c645 Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-AttachVolumeNegativeTest-742145495 Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6edb27d1224244809ecbb55ac953c645"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6edb27d1224244809ecbb55ac953c645"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6edb27d1224244809ecbb55ac953c645"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6edb27d1224244809ecbb55ac953c645"}]}] Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-AttachVolumeNegativeTest-742145495 Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 6edb27d1224244809ecbb55ac953c645 Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-742145495 Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-AttachVolumeNegativeTest-742145495-project Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 0c65e7ab0b544d9ebdac8bc2129d051a Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-AttachVolumeNegativeTest-742145495-project Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 78708eaa-2dad-44bc-a145-86dcc21ca804 could not be found. Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '78708eaa-2dad-44bc-a145-86dcc21ca804'} Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78708eaa-2dad-44bc-a145-86dcc21ca804 could not be found. Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78708eaa-2dad-44bc-a145-86dcc21ca804 could not be found. Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:30.716725 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:30.722124 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:30.722124 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:30.722124 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:30.722124 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:37:30.722124 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:37:30.722124 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78708eaa-2dad-44bc-a145-86dcc21ca804 could not be found. Oct 23 01:37:30.722124 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:30.726613 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ca3dcb36-c2d9-4353-a455-0e9a13b9a735 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Returning 404 to user: Instance 78708eaa-2dad-44bc-a145-86dcc21ca804 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:37:30.728490 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ca3dcb36-c2d9-4353-a455-0e9a13b9a735 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/78708eaa-2dad-44bc-a145-86dcc21ca804" status: 404 len: 111 microversion: 2.1 time: 0.059582 Oct 23 01:37:30.729648 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2784/5679] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:37:30 2022] GET /compute/v2.1/servers/78708eaa-2dad-44bc-a145-86dcc21ca804 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 01:37:31.229217 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-457351ee-d1c9-4158-86bb-0b5bc749835e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:37:31.243817 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-457351ee-d1c9-4158-86bb-0b5bc749835e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1669 microversion: 2.1 time: 0.761626 Oct 23 01:37:31.249562 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2896/5680] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:37:30 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1669 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:37:31.282993 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-78b9eb9c-a844-417d-81a1-6e3bdaa3026a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:31.284904 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-78b9eb9c-a844-417d-81a1-6e3bdaa3026a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:31.301887 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78b9eb9c-a844-417d-81a1-6e3bdaa3026a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:31.302461 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78b9eb9c-a844-417d-81a1-6e3bdaa3026a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:31.302906 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78b9eb9c-a844-417d-81a1-6e3bdaa3026a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:31.303654 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78b9eb9c-a844-417d-81a1-6e3bdaa3026a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:31.304160 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78b9eb9c-a844-417d-81a1-6e3bdaa3026a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:31.304526 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78b9eb9c-a844-417d-81a1-6e3bdaa3026a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:32.380506 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-78b9eb9c-a844-417d-81a1-6e3bdaa3026a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:37:32.393518 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-78b9eb9c-a844-417d-81a1-6e3bdaa3026a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1669 microversion: 2.1 time: 1.121009 Oct 23 01:37:32.399069 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2785/5681] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:37:31 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1669 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:37:32.781482 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c3d65720-a75b-4472-8933-45262cd8de0f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1667771401", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "bd4b7167-61cf-4f14-9c60-72538a1ed815"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:37:32.892155 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-c3d65720-a75b-4472-8933-45262cd8de0f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] validate_networks() for [('bd4b7167-61cf-4f14-9c60-72538a1ed815', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:37:34.875308 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-c3d65720-a75b-4472-8933-45262cd8de0f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:37:34.880335 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-c3d65720-a75b-4472-8933-45262cd8de0f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:37:34.880335 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-c3d65720-a75b-4472-8933-45262cd8de0f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:37:34.880335 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-c3d65720-a75b-4472-8933-45262cd8de0f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:37:34.880335 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-c3d65720-a75b-4472-8933-45262cd8de0f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:37:34.896017 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c3d65720-a75b-4472-8933-45262cd8de0f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:34.904157 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c3d65720-a75b-4472-8933-45262cd8de0f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:34.904618 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c3d65720-a75b-4472-8933-45262cd8de0f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:34.905440 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c3d65720-a75b-4472-8933-45262cd8de0f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:34.910455 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c3d65720-a75b-4472-8933-45262cd8de0f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:34.910986 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c3d65720-a75b-4472-8933-45262cd8de0f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:34.945506 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-c3d65720-a75b-4472-8933-45262cd8de0f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Getting quotas for project aa4e3018a6ca477c9a1d7215ad98d9e9. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:37:34.954139 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-c3d65720-a75b-4472-8933-45262cd8de0f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Getting quotas for user bb03047092f64e2abbf78e9db1a06e0a and project aa4e3018a6ca477c9a1d7215ad98d9e9. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:37:34.977372 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c3d65720-a75b-4472-8933-45262cd8de0f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:37:34.986411 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c3d65720-a75b-4472-8933-45262cd8de0f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 919bbefe-5433-4860-be39-88514bab1dd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:37:35.135181 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c3d65720-a75b-4472-8933-45262cd8de0f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.354000 Oct 23 01:37:35.137724 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2897/5682] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:37:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2362 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:37:35.148662 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f96d4ba5-72b5-492e-a012-00955f9f8299 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:35.149368 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f96d4ba5-72b5-492e-a012-00955f9f8299 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 919bbefe-5433-4860-be39-88514bab1dd3] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:35.353673 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f96d4ba5-72b5-492e-a012-00955f9f8299 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:37:35.363865 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f96d4ba5-72b5-492e-a012-00955f9f8299 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/919bbefe-5433-4860-be39-88514bab1dd3" status: 200 len: 1215 microversion: 2.1 time: 0.219156 Oct 23 01:37:35.369513 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2786/5683] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:37:35 2022] GET /compute/v2.1/servers/919bbefe-5433-4860-be39-88514bab1dd3 => generated 1215 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:37:36.393025 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-35e3360a-61e7-43e3-a739-3b02047ddf3f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:36.394432 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-35e3360a-61e7-43e3-a739-3b02047ddf3f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 919bbefe-5433-4860-be39-88514bab1dd3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:36.540338 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-35e3360a-61e7-43e3-a739-3b02047ddf3f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:37:36.565282 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-35e3360a-61e7-43e3-a739-3b02047ddf3f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/919bbefe-5433-4860-be39-88514bab1dd3" status: 200 len: 1215 microversion: 2.1 time: 0.175020 Oct 23 01:37:36.566604 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2898/5684] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:37:36 2022] GET /compute/v2.1/servers/919bbefe-5433-4860-be39-88514bab1dd3 => generated 1215 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:37:36.618379 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-07740485-3118-4850-ae12-b28c711d13f4 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:36.619506 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-07740485-3118-4850-ae12-b28c711d13f4 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: e96f5e79-d832-4927-aef1-a45a815404b0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:36.627839 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-07740485-3118-4850-ae12-b28c711d13f4 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:36.628529 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-07740485-3118-4850-ae12-b28c711d13f4 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:36.629511 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-07740485-3118-4850-ae12-b28c711d13f4 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:36.630618 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-07740485-3118-4850-ae12-b28c711d13f4 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:36.631504 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-07740485-3118-4850-ae12-b28c711d13f4 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:36.632126 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-07740485-3118-4850-ae12-b28c711d13f4 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:36.653600 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-07740485-3118-4850-ae12-b28c711d13f4 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] HTTP exception thrown: Instance e96f5e79-d832-4927-aef1-a45a815404b0 could not be found. Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-07740485-3118-4850-ae12-b28c711d13f4 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Request method failure captured: Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0 HTTP/1.1 Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJkvYHBhNP-ngrp3-t9b3JEvPymaCLxveQy3RHlcnEhTQOwrgKm_FYFqgl1O3oBP9pMRjY52nNZb_Q0xi9HfDiuiJB7SCfmksRniHRxHyItsbztYyPUcQD1NZfU4JeOPY635AaAApWVr1Jjx20AyHyGm3ekhiRFvnH_BMldZWZd5QMc Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 6edb27d1224244809ecbb55ac953c645 Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-AttachVolumeNegativeTest-742145495 Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6edb27d1224244809ecbb55ac953c645"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6edb27d1224244809ecbb55ac953c645"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6edb27d1224244809ecbb55ac953c645"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6edb27d1224244809ecbb55ac953c645"}]}] Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-AttachVolumeNegativeTest-742145495 Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 6edb27d1224244809ecbb55ac953c645 Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-742145495 Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-AttachVolumeNegativeTest-742145495-project Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 0c65e7ab0b544d9ebdac8bc2129d051a Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-AttachVolumeNegativeTest-742145495-project Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: exception: Instance e96f5e79-d832-4927-aef1-a45a815404b0 could not be found. Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'e96f5e79-d832-4927-aef1-a45a815404b0'} Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e96f5e79-d832-4927-aef1-a45a815404b0 could not be found. Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:37:36.658075 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:37:36.662138 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e96f5e79-d832-4927-aef1-a45a815404b0 could not be found. Oct 23 01:37:36.662138 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:36.662138 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:36.662138 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:36.662138 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:36.662138 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:36.662138 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:36.662138 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:37:36.662138 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:37:36.662138 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e96f5e79-d832-4927-aef1-a45a815404b0 could not be found. Oct 23 01:37:36.662138 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:36.662138 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-07740485-3118-4850-ae12-b28c711d13f4 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Returning 404 to user: Instance e96f5e79-d832-4927-aef1-a45a815404b0 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:37:36.663089 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-07740485-3118-4850-ae12-b28c711d13f4 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0" status: 404 len: 111 microversion: 2.1 time: 0.045225 Oct 23 01:37:36.666244 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2787/5685] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:37:36 2022] DELETE /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:37:36.675149 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-62005eda-fc30-4a61-864d-34b123e57333 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:36.681372 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-62005eda-fc30-4a61-864d-34b123e57333 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] [instance: e96f5e79-d832-4927-aef1-a45a815404b0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:36.715832 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-62005eda-fc30-4a61-864d-34b123e57333 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:36.716818 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-62005eda-fc30-4a61-864d-34b123e57333 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:36.717529 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-62005eda-fc30-4a61-864d-34b123e57333 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:36.719129 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-62005eda-fc30-4a61-864d-34b123e57333 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:36.719990 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-62005eda-fc30-4a61-864d-34b123e57333 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:36.720584 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-62005eda-fc30-4a61-864d-34b123e57333 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:36.756977 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-62005eda-fc30-4a61-864d-34b123e57333 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] HTTP exception thrown: Instance e96f5e79-d832-4927-aef1-a45a815404b0 could not be found. Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-62005eda-fc30-4a61-864d-34b123e57333 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Request method failure captured: Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0 HTTP/1.1 Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJkvYHBhNP-ngrp3-t9b3JEvPymaCLxveQy3RHlcnEhTQOwrgKm_FYFqgl1O3oBP9pMRjY52nNZb_Q0xi9HfDiuiJB7SCfmksRniHRxHyItsbztYyPUcQD1NZfU4JeOPY635AaAApWVr1Jjx20AyHyGm3ekhiRFvnH_BMldZWZd5QMc Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 6edb27d1224244809ecbb55ac953c645 Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-AttachVolumeNegativeTest-742145495 Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6edb27d1224244809ecbb55ac953c645"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6edb27d1224244809ecbb55ac953c645"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6edb27d1224244809ecbb55ac953c645"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6edb27d1224244809ecbb55ac953c645"}]}] Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-AttachVolumeNegativeTest-742145495 Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 6edb27d1224244809ecbb55ac953c645 Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-742145495 Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-AttachVolumeNegativeTest-742145495-project Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 0c65e7ab0b544d9ebdac8bc2129d051a Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-AttachVolumeNegativeTest-742145495-project Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: exception: Instance e96f5e79-d832-4927-aef1-a45a815404b0 could not be found. Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'e96f5e79-d832-4927-aef1-a45a815404b0'} Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e96f5e79-d832-4927-aef1-a45a815404b0 could not be found. Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e96f5e79-d832-4927-aef1-a45a815404b0 could not be found. Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:36.758929 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:36.763169 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:36.763169 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:36.763169 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:36.763169 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:37:36.763169 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:37:36.763169 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e96f5e79-d832-4927-aef1-a45a815404b0 could not be found. Oct 23 01:37:36.763169 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:36.765306 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-62005eda-fc30-4a61-864d-34b123e57333 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] Returning 404 to user: Instance e96f5e79-d832-4927-aef1-a45a815404b0 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:37:36.773658 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-62005eda-fc30-4a61-864d-34b123e57333 tempest-AttachVolumeNegativeTest-742145495 tempest-AttachVolumeNegativeTest-742145495-project] 10.222.0.42 "GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0" status: 404 len: 111 microversion: 2.1 time: 0.096469 Oct 23 01:37:36.773658 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2899/5686] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:37:36 2022] GET /compute/v2.1/servers/e96f5e79-d832-4927-aef1-a45a815404b0 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:37:37.592385 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7e6a7b37-dc5e-42a0-a73a-9243ede1d509 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:37.593448 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7e6a7b37-dc5e-42a0-a73a-9243ede1d509 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 919bbefe-5433-4860-be39-88514bab1dd3] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:37.643654 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7e6a7b37-dc5e-42a0-a73a-9243ede1d509 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:37.645770 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7e6a7b37-dc5e-42a0-a73a-9243ede1d509 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:37.648940 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7e6a7b37-dc5e-42a0-a73a-9243ede1d509 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:37.652101 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7e6a7b37-dc5e-42a0-a73a-9243ede1d509 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:37.652718 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7e6a7b37-dc5e-42a0-a73a-9243ede1d509 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:37.654672 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7e6a7b37-dc5e-42a0-a73a-9243ede1d509 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:37.918207 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7e6a7b37-dc5e-42a0-a73a-9243ede1d509 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:37:37.950733 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7e6a7b37-dc5e-42a0-a73a-9243ede1d509 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/919bbefe-5433-4860-be39-88514bab1dd3" status: 200 len: 1267 microversion: 2.1 time: 0.363447 Oct 23 01:37:37.951353 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2788/5687] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:37:37 2022] GET /compute/v2.1/servers/919bbefe-5433-4860-be39-88514bab1dd3 => generated 1267 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:37:38.987294 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7b0a95f0-b0f8-4c7f-bef4-d2f210929cc7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:38.988563 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7b0a95f0-b0f8-4c7f-bef4-d2f210929cc7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 919bbefe-5433-4860-be39-88514bab1dd3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:39.000039 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b0a95f0-b0f8-4c7f-bef4-d2f210929cc7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:39.007501 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b0a95f0-b0f8-4c7f-bef4-d2f210929cc7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:39.008980 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b0a95f0-b0f8-4c7f-bef4-d2f210929cc7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:39.011512 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b0a95f0-b0f8-4c7f-bef4-d2f210929cc7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:39.013370 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b0a95f0-b0f8-4c7f-bef4-d2f210929cc7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:39.014110 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b0a95f0-b0f8-4c7f-bef4-d2f210929cc7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:39.150575 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7b0a95f0-b0f8-4c7f-bef4-d2f210929cc7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:37:39.168491 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7b0a95f0-b0f8-4c7f-bef4-d2f210929cc7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/919bbefe-5433-4860-be39-88514bab1dd3" status: 200 len: 1273 microversion: 2.1 time: 0.181206 Oct 23 01:37:39.169139 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2900/5688] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:37:38 2022] GET /compute/v2.1/servers/919bbefe-5433-4860-be39-88514bab1dd3 => generated 1273 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:37:40.193213 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cf977d73-e158-4eec-942d-9963c10431a0 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:40.193921 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cf977d73-e158-4eec-942d-9963c10431a0 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 919bbefe-5433-4860-be39-88514bab1dd3] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:40.209643 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf977d73-e158-4eec-942d-9963c10431a0 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:40.210188 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf977d73-e158-4eec-942d-9963c10431a0 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:40.214277 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf977d73-e158-4eec-942d-9963c10431a0 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:40.215137 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf977d73-e158-4eec-942d-9963c10431a0 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:40.215629 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf977d73-e158-4eec-942d-9963c10431a0 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:40.216077 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf977d73-e158-4eec-942d-9963c10431a0 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:40.738661 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cf977d73-e158-4eec-942d-9963c10431a0 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:37:40.747453 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cf977d73-e158-4eec-942d-9963c10431a0 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/919bbefe-5433-4860-be39-88514bab1dd3" status: 200 len: 1273 microversion: 2.1 time: 0.558093 Oct 23 01:37:40.762770 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2789/5689] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:37:40 2022] GET /compute/v2.1/servers/919bbefe-5433-4860-be39-88514bab1dd3 => generated 1273 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:37:41.771758 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-003679ec-769f-45b9-82da-734cc4e5c418 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:41.772986 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-003679ec-769f-45b9-82da-734cc4e5c418 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 919bbefe-5433-4860-be39-88514bab1dd3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:41.777818 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:41.788821 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-003679ec-769f-45b9-82da-734cc4e5c418 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:41.790011 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-003679ec-769f-45b9-82da-734cc4e5c418 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:41.790462 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-003679ec-769f-45b9-82da-734cc4e5c418 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:41.791171 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-003679ec-769f-45b9-82da-734cc4e5c418 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:41.791637 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-003679ec-769f-45b9-82da-734cc4e5c418 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:41.792066 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-003679ec-769f-45b9-82da-734cc4e5c418 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:41.795001 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=46 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:42.027350 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-003679ec-769f-45b9-82da-734cc4e5c418 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:37:42.037518 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-003679ec-769f-45b9-82da-734cc4e5c418 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/919bbefe-5433-4860-be39-88514bab1dd3" status: 200 len: 1273 microversion: 2.1 time: 0.269482 Oct 23 01:37:42.041579 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2901/5690] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:37:41 2022] GET /compute/v2.1/servers/919bbefe-5433-4860-be39-88514bab1dd3 => generated 1273 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:37:43.064723 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-722eb848-3b65-4bd8-ad61-25b670c2f3f9 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:43.065372 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-722eb848-3b65-4bd8-ad61-25b670c2f3f9 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 919bbefe-5433-4860-be39-88514bab1dd3] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:43.074858 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-722eb848-3b65-4bd8-ad61-25b670c2f3f9 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:43.075053 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-722eb848-3b65-4bd8-ad61-25b670c2f3f9 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:43.075698 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-722eb848-3b65-4bd8-ad61-25b670c2f3f9 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:43.077364 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-722eb848-3b65-4bd8-ad61-25b670c2f3f9 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:43.078140 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-722eb848-3b65-4bd8-ad61-25b670c2f3f9 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:43.078958 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-722eb848-3b65-4bd8-ad61-25b670c2f3f9 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:43.842535 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-722eb848-3b65-4bd8-ad61-25b670c2f3f9 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:37:43.858635 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-722eb848-3b65-4bd8-ad61-25b670c2f3f9 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/919bbefe-5433-4860-be39-88514bab1dd3" status: 200 len: 1315 microversion: 2.1 time: 0.797731 Oct 23 01:37:43.868439 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2790/5691] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:37:43 2022] GET /compute/v2.1/servers/919bbefe-5433-4860-be39-88514bab1dd3 => generated 1315 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:37:44.894366 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-16e914ec-a191-4e02-b7e3-15541a8a862c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:44.895975 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-16e914ec-a191-4e02-b7e3-15541a8a862c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 919bbefe-5433-4860-be39-88514bab1dd3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:44.905132 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-16e914ec-a191-4e02-b7e3-15541a8a862c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:44.906146 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-16e914ec-a191-4e02-b7e3-15541a8a862c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:44.906748 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-16e914ec-a191-4e02-b7e3-15541a8a862c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:44.907651 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-16e914ec-a191-4e02-b7e3-15541a8a862c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:44.908291 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-16e914ec-a191-4e02-b7e3-15541a8a862c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:44.908880 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-16e914ec-a191-4e02-b7e3-15541a8a862c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:44.954595 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:45.903358 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-16e914ec-a191-4e02-b7e3-15541a8a862c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:37:45.920284 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-16e914ec-a191-4e02-b7e3-15541a8a862c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/919bbefe-5433-4860-be39-88514bab1dd3" status: 200 len: 1315 microversion: 2.1 time: 1.031050 Oct 23 01:37:45.921261 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2902/5692] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:37:44 2022] GET /compute/v2.1/servers/919bbefe-5433-4860-be39-88514bab1dd3 => generated 1315 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:37:46.925602 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-92e9949b-4c88-4644-bbd2-50664e1e2905 req-ded16e05-fbd7-4a6b-914f-77fcb1d9dd8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "919bbefe-5433-4860-be39-88514bab1dd3", "tag": "e935c720-10f0-4a23-b278-03b16f6f0e8e"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:37:46.944529 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-78b63698-5ede-4f8c-87f9-85b53404b834 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:46.946397 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-78b63698-5ede-4f8c-87f9-85b53404b834 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 919bbefe-5433-4860-be39-88514bab1dd3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:46.956613 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=8 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:46.959525 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:46.961203 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:46.967851 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-92e9949b-4c88-4644-bbd2-50664e1e2905 req-ded16e05-fbd7-4a6b-914f-77fcb1d9dd8f service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:46.969178 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-78b63698-5ede-4f8c-87f9-85b53404b834 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:46.969178 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-78b63698-5ede-4f8c-87f9-85b53404b834 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:46.970099 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-78b63698-5ede-4f8c-87f9-85b53404b834 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:46.971004 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-78b63698-5ede-4f8c-87f9-85b53404b834 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:46.971684 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-92e9949b-4c88-4644-bbd2-50664e1e2905 req-ded16e05-fbd7-4a6b-914f-77fcb1d9dd8f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:46.973466 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-92e9949b-4c88-4644-bbd2-50664e1e2905 req-ded16e05-fbd7-4a6b-914f-77fcb1d9dd8f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:46.975052 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-78b63698-5ede-4f8c-87f9-85b53404b834 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:46.978053 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-78b63698-5ede-4f8c-87f9-85b53404b834 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:47.016162 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-92e9949b-4c88-4644-bbd2-50664e1e2905 req-ded16e05-fbd7-4a6b-914f-77fcb1d9dd8f service nova] Creating event network-changed:e935c720-10f0-4a23-b278-03b16f6f0e8e for instance 919bbefe-5433-4860-be39-88514bab1dd3 on n-h1-master-1 Oct 23 01:37:47.033128 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-92e9949b-4c88-4644-bbd2-50664e1e2905 req-ded16e05-fbd7-4a6b-914f-77fcb1d9dd8f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113085 Oct 23 01:37:47.042390 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2791/5693] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:37:47.568498 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-78b63698-5ede-4f8c-87f9-85b53404b834 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:37:47.586710 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-78b63698-5ede-4f8c-87f9-85b53404b834 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/919bbefe-5433-4860-be39-88514bab1dd3" status: 200 len: 1315 microversion: 2.1 time: 0.641061 Oct 23 01:37:47.587712 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2903/5694] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:37:46 2022] GET /compute/v2.1/servers/919bbefe-5433-4860-be39-88514bab1dd3 => generated 1315 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:37:48.617960 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-304ca05b-0fe5-4639-9507-1b450b213944 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:48.619733 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-304ca05b-0fe5-4639-9507-1b450b213944 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 919bbefe-5433-4860-be39-88514bab1dd3] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:48.633679 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-304ca05b-0fe5-4639-9507-1b450b213944 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:48.634790 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-304ca05b-0fe5-4639-9507-1b450b213944 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:48.635556 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-304ca05b-0fe5-4639-9507-1b450b213944 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:48.636455 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-304ca05b-0fe5-4639-9507-1b450b213944 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:48.637118 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-304ca05b-0fe5-4639-9507-1b450b213944 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:48.637720 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-304ca05b-0fe5-4639-9507-1b450b213944 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:49.429401 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-304ca05b-0fe5-4639-9507-1b450b213944 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:37:49.443258 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-304ca05b-0fe5-4639-9507-1b450b213944 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/919bbefe-5433-4860-be39-88514bab1dd3" status: 200 len: 1315 microversion: 2.1 time: 0.830873 Oct 23 01:37:49.447062 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2792/5695] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:37:48 2022] GET /compute/v2.1/servers/919bbefe-5433-4860-be39-88514bab1dd3 => generated 1315 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:37:50.473388 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-47955924-1544-4c7c-8113-66d12f8ac30e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:50.474040 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-47955924-1544-4c7c-8113-66d12f8ac30e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 919bbefe-5433-4860-be39-88514bab1dd3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:50.502744 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-47955924-1544-4c7c-8113-66d12f8ac30e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:50.503286 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-47955924-1544-4c7c-8113-66d12f8ac30e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:50.503911 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-47955924-1544-4c7c-8113-66d12f8ac30e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:50.504814 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-47955924-1544-4c7c-8113-66d12f8ac30e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:50.505718 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-47955924-1544-4c7c-8113-66d12f8ac30e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:50.506432 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-47955924-1544-4c7c-8113-66d12f8ac30e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:51.328821 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-47955924-1544-4c7c-8113-66d12f8ac30e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:37:51.343803 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-47955924-1544-4c7c-8113-66d12f8ac30e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/919bbefe-5433-4860-be39-88514bab1dd3" status: 200 len: 1315 microversion: 2.1 time: 0.870908 Oct 23 01:37:51.358554 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2904/5696] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:37:50 2022] GET /compute/v2.1/servers/919bbefe-5433-4860-be39-88514bab1dd3 => generated 1315 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:37:52.379367 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-56c97d0e-69fb-44a3-bf20-041e4a03186e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:52.380074 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-56c97d0e-69fb-44a3-bf20-041e4a03186e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 919bbefe-5433-4860-be39-88514bab1dd3] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:52.403856 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-56c97d0e-69fb-44a3-bf20-041e4a03186e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:52.404359 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-56c97d0e-69fb-44a3-bf20-041e4a03186e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:52.404812 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-56c97d0e-69fb-44a3-bf20-041e4a03186e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:52.405524 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-56c97d0e-69fb-44a3-bf20-041e4a03186e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:52.406011 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-56c97d0e-69fb-44a3-bf20-041e4a03186e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:52.406433 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-56c97d0e-69fb-44a3-bf20-041e4a03186e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:52.831646 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-56c97d0e-69fb-44a3-bf20-041e4a03186e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:37:52.840685 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-56c97d0e-69fb-44a3-bf20-041e4a03186e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/919bbefe-5433-4860-be39-88514bab1dd3" status: 200 len: 1315 microversion: 2.1 time: 0.468140 Oct 23 01:37:52.842553 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2793/5697] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:37:52 2022] GET /compute/v2.1/servers/919bbefe-5433-4860-be39-88514bab1dd3 => generated 1315 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:37:53.864789 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dcaa528a-613b-447d-86f0-d2f49a041e8a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:53.866060 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-dcaa528a-613b-447d-86f0-d2f49a041e8a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 919bbefe-5433-4860-be39-88514bab1dd3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:53.874525 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dcaa528a-613b-447d-86f0-d2f49a041e8a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:53.875248 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dcaa528a-613b-447d-86f0-d2f49a041e8a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:53.875849 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dcaa528a-613b-447d-86f0-d2f49a041e8a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:53.876704 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dcaa528a-613b-447d-86f0-d2f49a041e8a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:53.877337 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dcaa528a-613b-447d-86f0-d2f49a041e8a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:53.877922 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dcaa528a-613b-447d-86f0-d2f49a041e8a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:55.017195 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-dcaa528a-613b-447d-86f0-d2f49a041e8a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:37:55.030573 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-dcaa528a-613b-447d-86f0-d2f49a041e8a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/919bbefe-5433-4860-be39-88514bab1dd3" status: 200 len: 1315 microversion: 2.1 time: 1.165331 Oct 23 01:37:55.031692 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2905/5698] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:37:53 2022] GET /compute/v2.1/servers/919bbefe-5433-4860-be39-88514bab1dd3 => generated 1315 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:37:55.345941 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-ab2b67f2-b5e0-4d50-9583-d1e631780a0a req-b59e41bb-91df-437d-8b48-da0b9f60efb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "919bbefe-5433-4860-be39-88514bab1dd3", "name": "network-vif-plugged", "status": "completed", "tag": "e935c720-10f0-4a23-b278-03b16f6f0e8e"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:37:55.363572 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-ab2b67f2-b5e0-4d50-9583-d1e631780a0a req-b59e41bb-91df-437d-8b48-da0b9f60efb5 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:55.364063 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-ab2b67f2-b5e0-4d50-9583-d1e631780a0a req-b59e41bb-91df-437d-8b48-da0b9f60efb5 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:55.364491 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-ab2b67f2-b5e0-4d50-9583-d1e631780a0a req-b59e41bb-91df-437d-8b48-da0b9f60efb5 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:55.385596 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-ab2b67f2-b5e0-4d50-9583-d1e631780a0a req-b59e41bb-91df-437d-8b48-da0b9f60efb5 service nova] Creating event network-vif-plugged:e935c720-10f0-4a23-b278-03b16f6f0e8e for instance 919bbefe-5433-4860-be39-88514bab1dd3 on n-h1-master-1 Oct 23 01:37:55.391916 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-ab2b67f2-b5e0-4d50-9583-d1e631780a0a req-b59e41bb-91df-437d-8b48-da0b9f60efb5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050263 Oct 23 01:37:55.393035 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2906/5699] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:37:55.880270 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-21fb9e33-ea2d-4ff4-ac16-a0ddca7feeed tempest-VolumesNegativeTest-1534321761 tempest-VolumesNegativeTest-1534321761-project] Action: 'create', calling method: .version_select at 0x7f5cc175b3a0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1456483421", "metadata": {"Type": "work"}}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-21fb9e33-ea2d-4ff4-ac16-a0ddca7feeed tempest-VolumesNegativeTest-1534321761 tempest-VolumesNegativeTest-1534321761-project] Request method failure captured: Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 122 Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJrz1TYEACIBk6Rp5YwWOJi5BEX5MiTxyQN9FHYgQPnppJzPBp6ucDPcHzeU8KiUSDaecTkzmR9l8m5YIXwXnCO2E-ACnykOdwLdnsNknSGLdQ3yXxhVeuW7EKkp6ak3Kr77p0L9hZqEZoDcMHIel4Zus563-ruAhliRdd3Q_ymDwK4 Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 99f75a43268a4f51a730755ec5ee380b Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-VolumesNegativeTest-1534321761 Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/99f75a43268a4f51a730755ec5ee380b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_99f75a43268a4f51a730755ec5ee380b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/99f75a43268a4f51a730755ec5ee380b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/99f75a43268a4f51a730755ec5ee380b"}]}] Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-VolumesNegativeTest-1534321761 Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 99f75a43268a4f51a730755ec5ee380b Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-VolumesNegativeTest-1534321761 Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-VolumesNegativeTest-1534321761-project Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 95e71874d1f642eea36ca4dcfbe59be2 Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-VolumesNegativeTest-1534321761-project Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1456483421", "metadata": {"Type": "work"}}} Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: method: Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1456483421', 'metadata': {'Type': 'work'}}}} Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise error Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi '#$%' Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 23 01:37:55.895482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 23 01:37:55.900340 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 23 01:37:55.900340 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:55.900340 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:55.900340 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:55.900340 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:55.900340 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:55.900340 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:55.900340 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 23 01:37:55.900340 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 23 01:37:55.900340 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 23 01:37:55.900340 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:55.900340 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-21fb9e33-ea2d-4ff4-ac16-a0ddca7feeed tempest-VolumesNegativeTest-1534321761 tempest-VolumesNegativeTest-1534321761-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:37:55.900340 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-21fb9e33-ea2d-4ff4-ac16-a0ddca7feeed tempest-VolumesNegativeTest-1534321761 tempest-VolumesNegativeTest-1534321761-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.600699 Oct 23 01:37:55.903028 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2794/5700] 10.222.0.42 () {60 vars in 1156 bytes} [Sun Oct 23 01:37:55 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 610 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 23 01:37:55.927310 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f8bbcaf1-3bd8-4531-a191-88dbf80621bd tempest-VolumesNegativeTest-1534321761 tempest-VolumesNegativeTest-1534321761-project] Action: 'create', calling method: .version_select at 0x7f5cc0a211f0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-925320059", "metadata": {"Type": "work"}}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f8bbcaf1-3bd8-4531-a191-88dbf80621bd tempest-VolumesNegativeTest-1534321761 tempest-VolumesNegativeTest-1534321761-project] Request method failure captured: Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 119 Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJrz1TYEACIBk6Rp5YwWOJi5BEX5MiTxyQN9FHYgQPnppJzPBp6ucDPcHzeU8KiUSDaecTkzmR9l8m5YIXwXnCO2E-ACnykOdwLdnsNknSGLdQ3yXxhVeuW7EKkp6ak3Kr77p0L9hZqEZoDcMHIel4Zus563-ruAhliRdd3Q_ymDwK4 Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 99f75a43268a4f51a730755ec5ee380b Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-VolumesNegativeTest-1534321761 Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/99f75a43268a4f51a730755ec5ee380b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_99f75a43268a4f51a730755ec5ee380b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/99f75a43268a4f51a730755ec5ee380b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/99f75a43268a4f51a730755ec5ee380b"}]}] Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-VolumesNegativeTest-1534321761 Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 99f75a43268a4f51a730755ec5ee380b Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-VolumesNegativeTest-1534321761 Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-VolumesNegativeTest-1534321761-project Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 95e71874d1f642eea36ca4dcfbe59be2 Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-VolumesNegativeTest-1534321761-project Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-925320059", "metadata": {"Type": "work"}}} Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: method: Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-925320059', 'metadata': {'Type': 'work'}}}} Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise error Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi '0' Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 23 01:37:55.934672 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 23 01:37:55.938947 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 23 01:37:55.938947 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:55.938947 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:55.938947 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:55.938947 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:55.938947 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:55.938947 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:55.938947 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 23 01:37:55.938947 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 23 01:37:55.938947 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 23 01:37:55.938947 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:55.941549 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f8bbcaf1-3bd8-4531-a191-88dbf80621bd tempest-VolumesNegativeTest-1534321761 tempest-VolumesNegativeTest-1534321761-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:37:55.942749 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f8bbcaf1-3bd8-4531-a191-88dbf80621bd tempest-VolumesNegativeTest-1534321761 tempest-VolumesNegativeTest-1534321761-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.033520 Oct 23 01:37:55.944285 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2907/5701] 10.222.0.42 () {60 vars in 1156 bytes} [Sun Oct 23 01:37:55 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:37:55.956422 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ce747d28-491f-4045-b7cb-096f7fd729bb tempest-VolumesNegativeTest-1534321761 tempest-VolumesNegativeTest-1534321761-project] Action: 'create', calling method: .version_select at 0x7f5cc0e83670>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-57148075", "metadata": {"Type": "work"}}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ce747d28-491f-4045-b7cb-096f7fd729bb tempest-VolumesNegativeTest-1534321761 tempest-VolumesNegativeTest-1534321761-project] Request method failure captured: Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 117 Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJrz1TYEACIBk6Rp5YwWOJi5BEX5MiTxyQN9FHYgQPnppJzPBp6ucDPcHzeU8KiUSDaecTkzmR9l8m5YIXwXnCO2E-ACnykOdwLdnsNknSGLdQ3yXxhVeuW7EKkp6ak3Kr77p0L9hZqEZoDcMHIel4Zus563-ruAhliRdd3Q_ymDwK4 Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 99f75a43268a4f51a730755ec5ee380b Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-VolumesNegativeTest-1534321761 Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/99f75a43268a4f51a730755ec5ee380b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_99f75a43268a4f51a730755ec5ee380b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/99f75a43268a4f51a730755ec5ee380b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/99f75a43268a4f51a730755ec5ee380b"}]}] Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-VolumesNegativeTest-1534321761 Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 99f75a43268a4f51a730755ec5ee380b Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-VolumesNegativeTest-1534321761 Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-VolumesNegativeTest-1534321761-project Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 95e71874d1f642eea36ca4dcfbe59be2 Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-VolumesNegativeTest-1534321761-project Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-57148075", "metadata": {"Type": "work"}}} Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: method: Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-57148075', 'metadata': {'Type': 'work'}}}} Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise error Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi '' Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 23 01:37:55.960579 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 23 01:37:55.965176 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 23 01:37:55.965176 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:55.965176 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:55.965176 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:55.965176 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:55.965176 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:55.965176 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:55.965176 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 23 01:37:55.965176 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 23 01:37:55.965176 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 23 01:37:55.965176 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:55.971091 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ce747d28-491f-4045-b7cb-096f7fd729bb tempest-VolumesNegativeTest-1534321761 tempest-VolumesNegativeTest-1534321761-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:37:55.974987 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ce747d28-491f-4045-b7cb-096f7fd729bb tempest-VolumesNegativeTest-1534321761 tempest-VolumesNegativeTest-1534321761-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.024231 Oct 23 01:37:55.976043 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2795/5702] 10.222.0.42 () {60 vars in 1156 bytes} [Sun Oct 23 01:37:55 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:37:55.990628 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-29787d69-4e1e-40cd-9ade-39c397a9f864 tempest-VolumesNegativeTest-1534321761 tempest-VolumesNegativeTest-1534321761-project] Calling method '.version_select at 0x7f5cc0aa5700>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:56.034093 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-29787d69-4e1e-40cd-9ade-39c397a9f864 tempest-VolumesNegativeTest-1534321761 tempest-VolumesNegativeTest-1534321761-project] HTTP exception thrown: Volume tempest-invalid-1965084778 could not be found. Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-29787d69-4e1e-40cd-9ade-39c397a9f864 tempest-VolumesNegativeTest-1534321761 tempest-VolumesNegativeTest-1534321761-project] Request method failure captured: Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1965084778 HTTP/1.1 Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJrz1TYEACIBk6Rp5YwWOJi5BEX5MiTxyQN9FHYgQPnppJzPBp6ucDPcHzeU8KiUSDaecTkzmR9l8m5YIXwXnCO2E-ACnykOdwLdnsNknSGLdQ3yXxhVeuW7EKkp6ak3Kr77p0L9hZqEZoDcMHIel4Zus563-ruAhliRdd3Q_ymDwK4 Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 99f75a43268a4f51a730755ec5ee380b Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-VolumesNegativeTest-1534321761 Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/99f75a43268a4f51a730755ec5ee380b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_99f75a43268a4f51a730755ec5ee380b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/99f75a43268a4f51a730755ec5ee380b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/99f75a43268a4f51a730755ec5ee380b"}]}] Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-VolumesNegativeTest-1534321761 Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 99f75a43268a4f51a730755ec5ee380b Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-VolumesNegativeTest-1534321761 Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-VolumesNegativeTest-1534321761-project Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 95e71874d1f642eea36ca4dcfbe59be2 Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-VolumesNegativeTest-1534321761-project Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: method: Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: exception: Volume tempest-invalid-1965084778 could not be found. Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'tempest-invalid-1965084778'} Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1965084778 could not be found. (HTTP 404) (Request-ID: req-7212c1a9-dbbc-46f4-baec-bcf29c20d7a8) Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 23 01:37:56.036374 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 01:37:56.041365 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 01:37:56.041365 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 23 01:37:56.041365 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 23 01:37:56.041365 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 23 01:37:56.041365 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 23 01:37:56.041365 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 23 01:37:56.041365 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 23 01:37:56.041365 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 23 01:37:56.041365 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 23 01:37:56.041365 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 01:37:56.041365 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 01:37:56.041365 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 01:37:56.041365 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 01:37:56.041365 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1965084778 could not be found. Oct 23 01:37:56.041365 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:56.041365 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:56.041365 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:56.041365 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:56.041365 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:56.041365 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:56.041365 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:37:56.041365 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:37:56.041365 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:37:56.041365 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:37:56.041365 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:37:56.041365 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:37:56.041365 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 23 01:37:56.041365 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:37:56.041365 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1965084778 could not be found. Oct 23 01:37:56.041365 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:56.041365 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:56.041365 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:56.041365 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:56.041365 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:56.041365 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:56.041365 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:37:56.041365 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:37:56.041365 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1965084778 could not be found. Oct 23 01:37:56.041365 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:37:56.041365 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-29787d69-4e1e-40cd-9ade-39c397a9f864 tempest-VolumesNegativeTest-1534321761 tempest-VolumesNegativeTest-1534321761-project] Returning 404 to user: Volume tempest-invalid-1965084778 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:37:56.041365 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-29787d69-4e1e-40cd-9ade-39c397a9f864 tempest-VolumesNegativeTest-1534321761 tempest-VolumesNegativeTest-1534321761-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1965084778" status: 404 len: 99 microversion: 2.1 time: 0.052389 Oct 23 01:37:56.045009 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2908/5703] 10.222.0.42 () {58 vars in 1218 bytes} [Sun Oct 23 01:37:55 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1965084778 => generated 99 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 23 01:37:56.051316 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d43d6ab2-b5e1-49f3-b1a3-18fc09914c98 tempest-VolumesNegativeTest-1534321761 tempest-VolumesNegativeTest-1534321761-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004812 Oct 23 01:37:56.052464 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2796/5704] 10.222.0.42 () {58 vars in 1140 bytes} [Sun Oct 23 01:37:56 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 23 01:37:56.064920 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8de8a2fd-bb6a-4293-ba88-3c80e7c70c2a tempest-VolumesNegativeTest-1534321761 tempest-VolumesNegativeTest-1534321761-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004004 Oct 23 01:37:56.065506 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2797/5705] 10.222.0.42 () {58 vars in 1137 bytes} [Sun Oct 23 01:37:56 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 23 01:37:56.076733 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2c4cbaeb-0d2c-46da-b921-4c72d504a8b5 tempest-VolumesNegativeTest-1534321761 tempest-VolumesNegativeTest-1534321761-project] Calling method '.version_select at 0x7f5cc0ec4e50>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:56.076947 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e0edb74c-2315-4d83-b9b7-25a971fc6d94 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:56.077615 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e0edb74c-2315-4d83-b9b7-25a971fc6d94 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 919bbefe-5433-4860-be39-88514bab1dd3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:56.112346 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0edb74c-2315-4d83-b9b7-25a971fc6d94 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:56.113088 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0edb74c-2315-4d83-b9b7-25a971fc6d94 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:56.114431 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0edb74c-2315-4d83-b9b7-25a971fc6d94 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:56.117036 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0edb74c-2315-4d83-b9b7-25a971fc6d94 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:56.118566 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0edb74c-2315-4d83-b9b7-25a971fc6d94 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:56.119758 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0edb74c-2315-4d83-b9b7-25a971fc6d94 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:56.123156 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-2c4cbaeb-0d2c-46da-b921-4c72d504a8b5 tempest-VolumesNegativeTest-1534321761 tempest-VolumesNegativeTest-1534321761-project] HTTP exception thrown: Volume 243d28f8-af4c-4cf1-9b88-4d3e62c2c87f could not be found. Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2c4cbaeb-0d2c-46da-b921-4c72d504a8b5 tempest-VolumesNegativeTest-1534321761 tempest-VolumesNegativeTest-1534321761-project] Request method failure captured: Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/os-volumes/243d28f8-af4c-4cf1-9b88-4d3e62c2c87f HTTP/1.1 Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJrz1TYEACIBk6Rp5YwWOJi5BEX5MiTxyQN9FHYgQPnppJzPBp6ucDPcHzeU8KiUSDaecTkzmR9l8m5YIXwXnCO2E-ACnykOdwLdnsNknSGLdQ3yXxhVeuW7EKkp6ak3Kr77p0L9hZqEZoDcMHIel4Zus563-ruAhliRdd3Q_ymDwK4 Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 99f75a43268a4f51a730755ec5ee380b Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-VolumesNegativeTest-1534321761 Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/99f75a43268a4f51a730755ec5ee380b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_99f75a43268a4f51a730755ec5ee380b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/99f75a43268a4f51a730755ec5ee380b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/99f75a43268a4f51a730755ec5ee380b"}]}] Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-VolumesNegativeTest-1534321761 Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 99f75a43268a4f51a730755ec5ee380b Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-VolumesNegativeTest-1534321761 Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-VolumesNegativeTest-1534321761-project Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 95e71874d1f642eea36ca4dcfbe59be2 Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-VolumesNegativeTest-1534321761-project Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: method: Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: exception: Volume 243d28f8-af4c-4cf1-9b88-4d3e62c2c87f could not be found. Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '243d28f8-af4c-4cf1-9b88-4d3e62c2c87f'} Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 243d28f8-af4c-4cf1-9b88-4d3e62c2c87f could not be found. (HTTP 404) (Request-ID: req-cdd83dc2-04ce-459b-ae53-4c6b8e229a15) Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 23 01:37:56.127394 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 01:37:56.133801 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 01:37:56.133801 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 23 01:37:56.133801 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 23 01:37:56.133801 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 23 01:37:56.133801 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 23 01:37:56.133801 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 23 01:37:56.133801 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 23 01:37:56.133801 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 23 01:37:56.133801 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 23 01:37:56.133801 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 01:37:56.133801 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 01:37:56.133801 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 01:37:56.133801 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 01:37:56.133801 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 243d28f8-af4c-4cf1-9b88-4d3e62c2c87f could not be found. Oct 23 01:37:56.133801 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:56.133801 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:56.133801 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:56.133801 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:56.133801 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:56.133801 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:56.133801 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:37:56.133801 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:37:56.133801 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:37:56.133801 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:37:56.133801 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:37:56.133801 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:37:56.133801 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 23 01:37:56.133801 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:37:56.133801 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 243d28f8-af4c-4cf1-9b88-4d3e62c2c87f could not be found. Oct 23 01:37:56.133801 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:56.133801 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:56.133801 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:56.133801 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:56.133801 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:56.133801 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:56.133801 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:37:56.133801 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:37:56.133801 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 243d28f8-af4c-4cf1-9b88-4d3e62c2c87f could not be found. Oct 23 01:37:56.133801 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:56.133801 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2c4cbaeb-0d2c-46da-b921-4c72d504a8b5 tempest-VolumesNegativeTest-1534321761 tempest-VolumesNegativeTest-1534321761-project] Returning 404 to user: Volume 243d28f8-af4c-4cf1-9b88-4d3e62c2c87f could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:37:56.133801 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2c4cbaeb-0d2c-46da-b921-4c72d504a8b5 tempest-VolumesNegativeTest-1534321761 tempest-VolumesNegativeTest-1534321761-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/243d28f8-af4c-4cf1-9b88-4d3e62c2c87f" status: 404 len: 109 microversion: 2.1 time: 0.059506 Oct 23 01:37:56.137667 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2798/5706] 10.222.0.42 () {58 vars in 1248 bytes} [Sun Oct 23 01:37:56 2022] DELETE /compute/v2.1/os-volumes/243d28f8-af4c-4cf1-9b88-4d3e62c2c87f => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:37:56.145883 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6984a9d7-0f6d-4659-990c-3830b11919fd tempest-VolumesNegativeTest-1534321761 tempest-VolumesNegativeTest-1534321761-project] Calling method '.version_select at 0x7f5cc1654670>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:56.237418 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-6984a9d7-0f6d-4659-990c-3830b11919fd tempest-VolumesNegativeTest-1534321761 tempest-VolumesNegativeTest-1534321761-project] HTTP exception thrown: Volume 6bf814b7-3e8c-4272-83b9-5958e544912c could not be found. Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6984a9d7-0f6d-4659-990c-3830b11919fd tempest-VolumesNegativeTest-1534321761 tempest-VolumesNegativeTest-1534321761-project] Request method failure captured: Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/os-volumes/6bf814b7-3e8c-4272-83b9-5958e544912c HTTP/1.1 Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJrz1TYEACIBk6Rp5YwWOJi5BEX5MiTxyQN9FHYgQPnppJzPBp6ucDPcHzeU8KiUSDaecTkzmR9l8m5YIXwXnCO2E-ACnykOdwLdnsNknSGLdQ3yXxhVeuW7EKkp6ak3Kr77p0L9hZqEZoDcMHIel4Zus563-ruAhliRdd3Q_ymDwK4 Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 99f75a43268a4f51a730755ec5ee380b Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-VolumesNegativeTest-1534321761 Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/99f75a43268a4f51a730755ec5ee380b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_99f75a43268a4f51a730755ec5ee380b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/99f75a43268a4f51a730755ec5ee380b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/99f75a43268a4f51a730755ec5ee380b"}]}] Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-VolumesNegativeTest-1534321761 Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 99f75a43268a4f51a730755ec5ee380b Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-VolumesNegativeTest-1534321761 Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-VolumesNegativeTest-1534321761-project Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 95e71874d1f642eea36ca4dcfbe59be2 Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-VolumesNegativeTest-1534321761-project Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: method: Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: exception: Volume 6bf814b7-3e8c-4272-83b9-5958e544912c could not be found. Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '6bf814b7-3e8c-4272-83b9-5958e544912c'} Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6bf814b7-3e8c-4272-83b9-5958e544912c could not be found. (HTTP 404) (Request-ID: req-87e57b9a-4c6c-423c-8600-d8c0ca031e09) Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 23 01:37:56.241912 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 01:37:56.246035 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 01:37:56.246035 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 23 01:37:56.246035 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 23 01:37:56.246035 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 23 01:37:56.246035 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 23 01:37:56.246035 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 23 01:37:56.246035 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 23 01:37:56.246035 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 23 01:37:56.246035 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 23 01:37:56.246035 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 01:37:56.246035 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 01:37:56.246035 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 01:37:56.246035 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 01:37:56.246035 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6bf814b7-3e8c-4272-83b9-5958e544912c could not be found. Oct 23 01:37:56.246035 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:56.246035 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:56.246035 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:56.246035 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:56.246035 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:56.246035 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:56.246035 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:37:56.246035 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:37:56.246035 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 01:37:56.246035 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 01:37:56.246035 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:37:56.246035 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:37:56.246035 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 23 01:37:56.246035 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:37:56.246035 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6bf814b7-3e8c-4272-83b9-5958e544912c could not be found. Oct 23 01:37:56.246035 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:56.246035 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:37:56.246035 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:56.246035 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:37:56.246035 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:37:56.246035 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:37:56.246035 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:37:56.246035 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:37:56.246035 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6bf814b7-3e8c-4272-83b9-5958e544912c could not be found. Oct 23 01:37:56.246035 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:37:56.257655 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6984a9d7-0f6d-4659-990c-3830b11919fd tempest-VolumesNegativeTest-1534321761 tempest-VolumesNegativeTest-1534321761-project] Returning 404 to user: Volume 6bf814b7-3e8c-4272-83b9-5958e544912c could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:37:56.259619 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6984a9d7-0f6d-4659-990c-3830b11919fd tempest-VolumesNegativeTest-1534321761 tempest-VolumesNegativeTest-1534321761-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/6bf814b7-3e8c-4272-83b9-5958e544912c" status: 404 len: 109 microversion: 2.1 time: 0.120463 Oct 23 01:37:56.261144 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2799/5707] 10.222.0.42 () {58 vars in 1245 bytes} [Sun Oct 23 01:37:56 2022] GET /compute/v2.1/os-volumes/6bf814b7-3e8c-4272-83b9-5958e544912c => generated 109 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:37:56.657731 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e0edb74c-2315-4d83-b9b7-25a971fc6d94 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:37:56.672132 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e0edb74c-2315-4d83-b9b7-25a971fc6d94 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/919bbefe-5433-4860-be39-88514bab1dd3" status: 200 len: 1315 microversion: 2.1 time: 0.622059 Oct 23 01:37:56.682630 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2909/5708] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:37:56 2022] GET /compute/v2.1/servers/919bbefe-5433-4860-be39-88514bab1dd3 => generated 1315 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:37:57.704071 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4f860038-7051-47d7-8276-b7717e07290b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:57.705396 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4f860038-7051-47d7-8276-b7717e07290b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 919bbefe-5433-4860-be39-88514bab1dd3] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:57.714351 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f860038-7051-47d7-8276-b7717e07290b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:57.717444 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f860038-7051-47d7-8276-b7717e07290b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:57.721946 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f860038-7051-47d7-8276-b7717e07290b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:57.725243 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f860038-7051-47d7-8276-b7717e07290b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:57.727862 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f860038-7051-47d7-8276-b7717e07290b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:57.729880 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f860038-7051-47d7-8276-b7717e07290b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:58.181081 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4f860038-7051-47d7-8276-b7717e07290b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:37:58.196241 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4f860038-7051-47d7-8276-b7717e07290b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/919bbefe-5433-4860-be39-88514bab1dd3" status: 200 len: 1503 microversion: 2.1 time: 0.498279 Oct 23 01:37:58.197262 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2800/5709] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:37:57 2022] GET /compute/v2.1/servers/919bbefe-5433-4860-be39-88514bab1dd3 => generated 1503 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:37:58.230190 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e6873b6d-b64f-4c76-97da-c73a67ec1730 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:37:58.231433 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e6873b6d-b64f-4c76-97da-c73a67ec1730 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 919bbefe-5433-4860-be39-88514bab1dd3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:58.250381 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e6873b6d-b64f-4c76-97da-c73a67ec1730 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:58.251295 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e6873b6d-b64f-4c76-97da-c73a67ec1730 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:58.252287 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e6873b6d-b64f-4c76-97da-c73a67ec1730 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:58.254835 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e6873b6d-b64f-4c76-97da-c73a67ec1730 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:58.255571 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e6873b6d-b64f-4c76-97da-c73a67ec1730 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:58.256447 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e6873b6d-b64f-4c76-97da-c73a67ec1730 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:58.613362 n-d-master-1 devstack@n-api.service[120944]: INFO nova.network.security_group_api [None req-e6873b6d-b64f-4c76-97da-c73a67ec1730 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Removing security group cdedade1-3b30-49e1-8ff0-ae587d682cce from port e935c720-10f0-4a23-b278-03b16f6f0e8e Oct 23 01:37:59.669262 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e6873b6d-b64f-4c76-97da-c73a67ec1730 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "POST /compute/v2.1/servers/919bbefe-5433-4860-be39-88514bab1dd3/action" status: 202 len: 0 microversion: 2.1 time: 1.443152 Oct 23 01:37:59.670333 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2910/5710] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:37:58 2022] POST /compute/v2.1/servers/919bbefe-5433-4860-be39-88514bab1dd3/action => generated 0 bytes in 1445 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:37:59.683075 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1be006f9-8afa-44f1-b300-4a11d2246573 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:37:59.683687 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1be006f9-8afa-44f1-b300-4a11d2246573 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 919bbefe-5433-4860-be39-88514bab1dd3] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:37:59.685596 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-6ee5ecbd-eec8-4dac-b672-ad7bbe967b76 req-fccea43d-313a-42fc-891b-78dc2cc2f5da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "919bbefe-5433-4860-be39-88514bab1dd3", "tag": "e935c720-10f0-4a23-b278-03b16f6f0e8e"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:37:59.707835 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1be006f9-8afa-44f1-b300-4a11d2246573 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:59.709260 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1be006f9-8afa-44f1-b300-4a11d2246573 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:59.710942 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1be006f9-8afa-44f1-b300-4a11d2246573 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:59.711850 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1be006f9-8afa-44f1-b300-4a11d2246573 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:59.714360 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1be006f9-8afa-44f1-b300-4a11d2246573 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:59.718201 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1be006f9-8afa-44f1-b300-4a11d2246573 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:59.728060 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-6ee5ecbd-eec8-4dac-b672-ad7bbe967b76 req-fccea43d-313a-42fc-891b-78dc2cc2f5da service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:37:59.728545 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-6ee5ecbd-eec8-4dac-b672-ad7bbe967b76 req-fccea43d-313a-42fc-891b-78dc2cc2f5da service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:37:59.728978 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-6ee5ecbd-eec8-4dac-b672-ad7bbe967b76 req-fccea43d-313a-42fc-891b-78dc2cc2f5da service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:37:59.770505 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-6ee5ecbd-eec8-4dac-b672-ad7bbe967b76 req-fccea43d-313a-42fc-891b-78dc2cc2f5da service nova] Creating event network-changed:e935c720-10f0-4a23-b278-03b16f6f0e8e for instance 919bbefe-5433-4860-be39-88514bab1dd3 on n-h1-master-1 Oct 23 01:37:59.785635 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-6ee5ecbd-eec8-4dac-b672-ad7bbe967b76 req-fccea43d-313a-42fc-891b-78dc2cc2f5da service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106421 Oct 23 01:37:59.795943 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2911/5711] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:38:00.168441 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1be006f9-8afa-44f1-b300-4a11d2246573 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:38:00.170870 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=65 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:00.182744 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1be006f9-8afa-44f1-b300-4a11d2246573 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/919bbefe-5433-4860-be39-88514bab1dd3" status: 200 len: 1461 microversion: 2.1 time: 0.508234 Oct 23 01:38:00.213204 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-48af3740-5e8f-47e9-9213-a832d2d75255 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:38:00.214217 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-48af3740-5e8f-47e9-9213-a832d2d75255 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:38:00.217447 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2801/5712] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:37:59 2022] GET /compute/v2.1/servers/919bbefe-5433-4860-be39-88514bab1dd3 => generated 1461 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:38:00.221265 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-48af3740-5e8f-47e9-9213-a832d2d75255 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:00.222365 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-48af3740-5e8f-47e9-9213-a832d2d75255 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:00.223028 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-48af3740-5e8f-47e9-9213-a832d2d75255 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:00.223914 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-48af3740-5e8f-47e9-9213-a832d2d75255 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:00.226843 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-48af3740-5e8f-47e9-9213-a832d2d75255 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:00.228712 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-48af3740-5e8f-47e9-9213-a832d2d75255 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:00.771792 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-48af3740-5e8f-47e9-9213-a832d2d75255 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:38:00.796931 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-48af3740-5e8f-47e9-9213-a832d2d75255 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1669 microversion: 2.1 time: 0.578713 Oct 23 01:38:00.799101 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2912/5713] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:38:00 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1669 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:38:00.826622 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-621c116c-b2c0-40bd-b7a8-852532fa9f1e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:38:00.827290 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-621c116c-b2c0-40bd-b7a8-852532fa9f1e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:38:00.846250 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-621c116c-b2c0-40bd-b7a8-852532fa9f1e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:00.846804 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-621c116c-b2c0-40bd-b7a8-852532fa9f1e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:00.847243 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-621c116c-b2c0-40bd-b7a8-852532fa9f1e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:00.848120 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-621c116c-b2c0-40bd-b7a8-852532fa9f1e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:00.848577 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-621c116c-b2c0-40bd-b7a8-852532fa9f1e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:00.849306 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-621c116c-b2c0-40bd-b7a8-852532fa9f1e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:01.960382 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-621c116c-b2c0-40bd-b7a8-852532fa9f1e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:38:01.970809 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-621c116c-b2c0-40bd-b7a8-852532fa9f1e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1669 microversion: 2.1 time: 1.148303 Oct 23 01:38:01.975940 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2802/5714] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:38:00 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1669 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:38:01.995577 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8224e003-6e87-47e0-a5c8-996db0c1a424 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:38:01.996201 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8224e003-6e87-47e0-a5c8-996db0c1a424 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:38:02.003734 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8224e003-6e87-47e0-a5c8-996db0c1a424 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:02.005771 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8224e003-6e87-47e0-a5c8-996db0c1a424 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:02.005771 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8224e003-6e87-47e0-a5c8-996db0c1a424 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:02.005771 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8224e003-6e87-47e0-a5c8-996db0c1a424 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:02.006163 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8224e003-6e87-47e0-a5c8-996db0c1a424 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:02.006606 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8224e003-6e87-47e0-a5c8-996db0c1a424 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:02.470652 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8224e003-6e87-47e0-a5c8-996db0c1a424 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:38:02.482612 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8224e003-6e87-47e0-a5c8-996db0c1a424 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1669 microversion: 2.1 time: 0.491577 Oct 23 01:38:02.498004 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2913/5715] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:38:01 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1669 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:38:02.512193 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-060005f0-0307-4835-9203-7bb3ac9ec3ff tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:38:02.512815 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-060005f0-0307-4835-9203-7bb3ac9ec3ff tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:38:02.525532 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-060005f0-0307-4835-9203-7bb3ac9ec3ff tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:02.526109 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-060005f0-0307-4835-9203-7bb3ac9ec3ff tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:02.526500 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-060005f0-0307-4835-9203-7bb3ac9ec3ff tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:02.527209 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-060005f0-0307-4835-9203-7bb3ac9ec3ff tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:02.527665 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-060005f0-0307-4835-9203-7bb3ac9ec3ff tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:02.530668 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-060005f0-0307-4835-9203-7bb3ac9ec3ff tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:03.102563 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-060005f0-0307-4835-9203-7bb3ac9ec3ff tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:38:03.115391 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-060005f0-0307-4835-9203-7bb3ac9ec3ff tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1669 microversion: 2.1 time: 0.605881 Oct 23 01:38:03.117840 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2803/5716] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:38:02 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1669 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:38:03.496056 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dd61aad9-f1a3-4be4-97ae-ca8c06415455 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1466962150", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "bd4b7167-61cf-4f14-9c60-72538a1ed815"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:38:03.646861 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-dd61aad9-f1a3-4be4-97ae-ca8c06415455 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] validate_networks() for [('bd4b7167-61cf-4f14-9c60-72538a1ed815', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:38:04.696706 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-dd61aad9-f1a3-4be4-97ae-ca8c06415455 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:38:04.697903 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-dd61aad9-f1a3-4be4-97ae-ca8c06415455 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:38:04.698502 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-dd61aad9-f1a3-4be4-97ae-ca8c06415455 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:38:04.699517 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-dd61aad9-f1a3-4be4-97ae-ca8c06415455 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:38:04.700085 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-dd61aad9-f1a3-4be4-97ae-ca8c06415455 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:38:04.722074 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd61aad9-f1a3-4be4-97ae-ca8c06415455 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:04.724776 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd61aad9-f1a3-4be4-97ae-ca8c06415455 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:04.726513 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd61aad9-f1a3-4be4-97ae-ca8c06415455 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:04.727488 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd61aad9-f1a3-4be4-97ae-ca8c06415455 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:04.732261 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd61aad9-f1a3-4be4-97ae-ca8c06415455 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:04.734177 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd61aad9-f1a3-4be4-97ae-ca8c06415455 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:04.803254 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-dd61aad9-f1a3-4be4-97ae-ca8c06415455 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Getting quotas for project aa4e3018a6ca477c9a1d7215ad98d9e9. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:38:04.816134 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-dd61aad9-f1a3-4be4-97ae-ca8c06415455 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Getting quotas for user bb03047092f64e2abbf78e9db1a06e0a and project aa4e3018a6ca477c9a1d7215ad98d9e9. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:38:04.873853 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-dd61aad9-f1a3-4be4-97ae-ca8c06415455 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:38:04.878557 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-dd61aad9-f1a3-4be4-97ae-ca8c06415455 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 232f6a09-92a9-4e68-93af-404f72ffe620] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:38:05.121435 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-dd61aad9-f1a3-4be4-97ae-ca8c06415455 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.632352 Oct 23 01:38:05.122641 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2914/5717] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:38:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:38:05.135057 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d386414d-e9b6-4cb7-85a8-609a7b67132e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:38:05.135650 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d386414d-e9b6-4cb7-85a8-609a7b67132e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 232f6a09-92a9-4e68-93af-404f72ffe620] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:38:05.335635 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d386414d-e9b6-4cb7-85a8-609a7b67132e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:38:05.343298 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d386414d-e9b6-4cb7-85a8-609a7b67132e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620" status: 200 len: 1215 microversion: 2.1 time: 0.212440 Oct 23 01:38:05.343749 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2804/5718] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:38:05 2022] GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620 => generated 1215 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:38:06.372641 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4c6b6cb7-ed6d-44f8-bfb7-6377a4d38d01 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:38:06.374873 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4c6b6cb7-ed6d-44f8-bfb7-6377a4d38d01 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 232f6a09-92a9-4e68-93af-404f72ffe620] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:38:06.589939 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4c6b6cb7-ed6d-44f8-bfb7-6377a4d38d01 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:38:06.603335 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4c6b6cb7-ed6d-44f8-bfb7-6377a4d38d01 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620" status: 200 len: 1215 microversion: 2.1 time: 0.236791 Oct 23 01:38:06.629309 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2915/5719] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:38:06 2022] GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620 => generated 1215 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:38:07.658041 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4efa56bd-9eb6-490f-b354-e25fc6c2b0f4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:38:07.658673 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4efa56bd-9eb6-490f-b354-e25fc6c2b0f4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 232f6a09-92a9-4e68-93af-404f72ffe620] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:38:07.673857 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4efa56bd-9eb6-490f-b354-e25fc6c2b0f4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:07.674468 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4efa56bd-9eb6-490f-b354-e25fc6c2b0f4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:07.680184 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4efa56bd-9eb6-490f-b354-e25fc6c2b0f4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:07.682058 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4efa56bd-9eb6-490f-b354-e25fc6c2b0f4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:07.682990 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4efa56bd-9eb6-490f-b354-e25fc6c2b0f4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:07.683718 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4efa56bd-9eb6-490f-b354-e25fc6c2b0f4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:07.853387 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4efa56bd-9eb6-490f-b354-e25fc6c2b0f4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:38:07.873177 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4efa56bd-9eb6-490f-b354-e25fc6c2b0f4 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620" status: 200 len: 1267 microversion: 2.1 time: 0.217616 Oct 23 01:38:07.873801 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2805/5720] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:38:07 2022] GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620 => generated 1267 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:38:08.902784 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ff2b6176-ab61-4183-b954-bdfbf27f69cc tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:38:08.904013 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ff2b6176-ab61-4183-b954-bdfbf27f69cc tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 232f6a09-92a9-4e68-93af-404f72ffe620] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:38:08.931866 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ff2b6176-ab61-4183-b954-bdfbf27f69cc tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:08.933166 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ff2b6176-ab61-4183-b954-bdfbf27f69cc tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:08.933846 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ff2b6176-ab61-4183-b954-bdfbf27f69cc tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:08.938317 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ff2b6176-ab61-4183-b954-bdfbf27f69cc tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:08.938971 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ff2b6176-ab61-4183-b954-bdfbf27f69cc tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:08.942809 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ff2b6176-ab61-4183-b954-bdfbf27f69cc tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:09.408279 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ff2b6176-ab61-4183-b954-bdfbf27f69cc tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:38:09.423358 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ff2b6176-ab61-4183-b954-bdfbf27f69cc tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620" status: 200 len: 1275 microversion: 2.1 time: 0.524728 Oct 23 01:38:09.426962 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2916/5721] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:38:08 2022] GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620 => generated 1275 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:38:10.457124 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c614e43c-72f1-4405-b6ea-41e12aed0110 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:38:10.457124 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c614e43c-72f1-4405-b6ea-41e12aed0110 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 232f6a09-92a9-4e68-93af-404f72ffe620] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:38:10.471377 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c614e43c-72f1-4405-b6ea-41e12aed0110 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:10.480513 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c614e43c-72f1-4405-b6ea-41e12aed0110 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:10.492408 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c614e43c-72f1-4405-b6ea-41e12aed0110 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:10.492408 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c614e43c-72f1-4405-b6ea-41e12aed0110 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:10.492408 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c614e43c-72f1-4405-b6ea-41e12aed0110 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:10.492408 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c614e43c-72f1-4405-b6ea-41e12aed0110 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:11.084561 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c614e43c-72f1-4405-b6ea-41e12aed0110 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:38:11.092535 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c614e43c-72f1-4405-b6ea-41e12aed0110 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620" status: 200 len: 1315 microversion: 2.1 time: 0.641442 Oct 23 01:38:11.093672 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2806/5722] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:38:10 2022] GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620 => generated 1315 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:38:12.117629 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a445cbaf-641d-4914-aead-c12715f42a82 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:38:12.119210 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a445cbaf-641d-4914-aead-c12715f42a82 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 232f6a09-92a9-4e68-93af-404f72ffe620] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:38:12.147543 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a445cbaf-641d-4914-aead-c12715f42a82 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:12.148423 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a445cbaf-641d-4914-aead-c12715f42a82 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:12.152739 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a445cbaf-641d-4914-aead-c12715f42a82 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:12.153917 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a445cbaf-641d-4914-aead-c12715f42a82 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:12.160550 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a445cbaf-641d-4914-aead-c12715f42a82 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:12.164257 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a445cbaf-641d-4914-aead-c12715f42a82 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:12.547312 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a445cbaf-641d-4914-aead-c12715f42a82 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:38:12.565824 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a445cbaf-641d-4914-aead-c12715f42a82 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620" status: 200 len: 1315 microversion: 2.1 time: 0.452795 Oct 23 01:38:12.567037 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2917/5723] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:38:12 2022] GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620 => generated 1315 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:38:12.997353 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-4009ed92-3f55-4eb8-8663-ecfe597ed885 req-03c41500-e79a-4861-a975-9af988721445 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "232f6a09-92a9-4e68-93af-404f72ffe620", "tag": "d907bb94-e15e-405b-ad8a-f9448d3eab65"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:38:13.017413 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-4009ed92-3f55-4eb8-8663-ecfe597ed885 req-03c41500-e79a-4861-a975-9af988721445 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:13.018279 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-4009ed92-3f55-4eb8-8663-ecfe597ed885 req-03c41500-e79a-4861-a975-9af988721445 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:13.018715 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-4009ed92-3f55-4eb8-8663-ecfe597ed885 req-03c41500-e79a-4861-a975-9af988721445 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:13.048738 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-4009ed92-3f55-4eb8-8663-ecfe597ed885 req-03c41500-e79a-4861-a975-9af988721445 service nova] Creating event network-changed:d907bb94-e15e-405b-ad8a-f9448d3eab65 for instance 232f6a09-92a9-4e68-93af-404f72ffe620 on n-h2-master-1 Oct 23 01:38:13.065304 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-4009ed92-3f55-4eb8-8663-ecfe597ed885 req-03c41500-e79a-4861-a975-9af988721445 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.362549 Oct 23 01:38:13.074301 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2807/5724] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:38:13.591444 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a3cb75dd-a3d8-4695-bd62-484acd97d8c0 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:38:13.592749 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a3cb75dd-a3d8-4695-bd62-484acd97d8c0 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 232f6a09-92a9-4e68-93af-404f72ffe620] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:38:13.611296 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a3cb75dd-a3d8-4695-bd62-484acd97d8c0 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:13.614438 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a3cb75dd-a3d8-4695-bd62-484acd97d8c0 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:13.615361 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a3cb75dd-a3d8-4695-bd62-484acd97d8c0 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:13.620759 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a3cb75dd-a3d8-4695-bd62-484acd97d8c0 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:13.621543 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a3cb75dd-a3d8-4695-bd62-484acd97d8c0 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:13.624783 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a3cb75dd-a3d8-4695-bd62-484acd97d8c0 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:14.048455 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a3cb75dd-a3d8-4695-bd62-484acd97d8c0 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:38:14.048455 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a3cb75dd-a3d8-4695-bd62-484acd97d8c0 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620" status: 200 len: 1315 microversion: 2.1 time: 0.446846 Oct 23 01:38:14.048455 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2918/5725] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:38:13 2022] GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620 => generated 1315 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:38:15.062185 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-928788f0-f14a-4743-9dfb-084e301d5e81 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:38:15.066985 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-928788f0-f14a-4743-9dfb-084e301d5e81 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 232f6a09-92a9-4e68-93af-404f72ffe620] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:38:15.078974 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-928788f0-f14a-4743-9dfb-084e301d5e81 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:15.079850 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-928788f0-f14a-4743-9dfb-084e301d5e81 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:15.080460 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-928788f0-f14a-4743-9dfb-084e301d5e81 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:15.081347 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-928788f0-f14a-4743-9dfb-084e301d5e81 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:15.081805 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-928788f0-f14a-4743-9dfb-084e301d5e81 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:15.082255 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-928788f0-f14a-4743-9dfb-084e301d5e81 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:15.341207 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:15.503873 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-928788f0-f14a-4743-9dfb-084e301d5e81 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:38:15.515686 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-928788f0-f14a-4743-9dfb-084e301d5e81 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620" status: 200 len: 1315 microversion: 2.1 time: 0.458437 Oct 23 01:38:15.518907 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2808/5726] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:38:15 2022] GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620 => generated 1315 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:38:16.541952 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f8377c05-d1b3-4f5c-ab33-df519f4f4d48 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:38:16.542589 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f8377c05-d1b3-4f5c-ab33-df519f4f4d48 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 232f6a09-92a9-4e68-93af-404f72ffe620] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:38:16.552961 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:16.565160 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:16.566878 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8377c05-d1b3-4f5c-ab33-df519f4f4d48 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:16.567370 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8377c05-d1b3-4f5c-ab33-df519f4f4d48 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:16.567821 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8377c05-d1b3-4f5c-ab33-df519f4f4d48 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:16.569086 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8377c05-d1b3-4f5c-ab33-df519f4f4d48 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:16.574181 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8377c05-d1b3-4f5c-ab33-df519f4f4d48 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:16.574673 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8377c05-d1b3-4f5c-ab33-df519f4f4d48 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:16.626197 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=76 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:16.629532 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=8 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:16.946905 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f8377c05-d1b3-4f5c-ab33-df519f4f4d48 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:38:16.955961 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f8377c05-d1b3-4f5c-ab33-df519f4f4d48 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620" status: 200 len: 1315 microversion: 2.1 time: 0.417812 Oct 23 01:38:16.965479 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2919/5727] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:38:16 2022] GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620 => generated 1315 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:38:17.988943 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9f2c4a28-ced4-473a-bf07-0a0ac27bc550 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:38:17.990049 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9f2c4a28-ced4-473a-bf07-0a0ac27bc550 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 232f6a09-92a9-4e68-93af-404f72ffe620] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:38:18.007928 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f2c4a28-ced4-473a-bf07-0a0ac27bc550 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:18.008431 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f2c4a28-ced4-473a-bf07-0a0ac27bc550 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:18.009430 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f2c4a28-ced4-473a-bf07-0a0ac27bc550 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:18.010693 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f2c4a28-ced4-473a-bf07-0a0ac27bc550 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:18.011238 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f2c4a28-ced4-473a-bf07-0a0ac27bc550 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:18.011572 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f2c4a28-ced4-473a-bf07-0a0ac27bc550 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:18.231858 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9f2c4a28-ced4-473a-bf07-0a0ac27bc550 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:38:18.243308 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9f2c4a28-ced4-473a-bf07-0a0ac27bc550 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620" status: 200 len: 1315 microversion: 2.1 time: 0.258307 Oct 23 01:38:18.244832 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2809/5728] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:38:17 2022] GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620 => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:38:18.738879 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-5865be0a-b9ab-4814-af43-a28aebf79405 req-9407ceb8-2133-4eea-a218-ebf107c41cec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "232f6a09-92a9-4e68-93af-404f72ffe620", "name": "network-vif-plugged", "status": "completed", "tag": "d907bb94-e15e-405b-ad8a-f9448d3eab65"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:38:18.750506 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-5865be0a-b9ab-4814-af43-a28aebf79405 req-9407ceb8-2133-4eea-a218-ebf107c41cec service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:18.750998 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-5865be0a-b9ab-4814-af43-a28aebf79405 req-9407ceb8-2133-4eea-a218-ebf107c41cec service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:18.751441 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-5865be0a-b9ab-4814-af43-a28aebf79405 req-9407ceb8-2133-4eea-a218-ebf107c41cec service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:18.766043 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-5865be0a-b9ab-4814-af43-a28aebf79405 req-9407ceb8-2133-4eea-a218-ebf107c41cec service nova] Creating event network-vif-plugged:d907bb94-e15e-405b-ad8a-f9448d3eab65 for instance 232f6a09-92a9-4e68-93af-404f72ffe620 on n-h2-master-1 Oct 23 01:38:18.772214 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-5865be0a-b9ab-4814-af43-a28aebf79405 req-9407ceb8-2133-4eea-a218-ebf107c41cec service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037821 Oct 23 01:38:18.773614 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2920/5729] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:38:19.266888 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b25bd969-eaaf-4b07-8530-7b95a188c75c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:38:19.267671 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b25bd969-eaaf-4b07-8530-7b95a188c75c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 232f6a09-92a9-4e68-93af-404f72ffe620] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:38:19.280099 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=28 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:19.280099 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b25bd969-eaaf-4b07-8530-7b95a188c75c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:19.280099 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b25bd969-eaaf-4b07-8530-7b95a188c75c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:19.280099 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b25bd969-eaaf-4b07-8530-7b95a188c75c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:19.280099 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b25bd969-eaaf-4b07-8530-7b95a188c75c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:19.280099 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b25bd969-eaaf-4b07-8530-7b95a188c75c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:19.280099 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b25bd969-eaaf-4b07-8530-7b95a188c75c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:19.457545 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b25bd969-eaaf-4b07-8530-7b95a188c75c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:38:19.483081 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b25bd969-eaaf-4b07-8530-7b95a188c75c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620" status: 200 len: 1315 microversion: 2.1 time: 0.216644 Oct 23 01:38:19.486771 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2810/5730] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:38:19 2022] GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:38:20.515974 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fcd01620-f50d-4ac0-a23c-badf93d668b8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:38:20.516746 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fcd01620-f50d-4ac0-a23c-badf93d668b8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 232f6a09-92a9-4e68-93af-404f72ffe620] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:38:20.539654 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fcd01620-f50d-4ac0-a23c-badf93d668b8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:20.541754 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fcd01620-f50d-4ac0-a23c-badf93d668b8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:20.545026 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fcd01620-f50d-4ac0-a23c-badf93d668b8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:20.548575 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fcd01620-f50d-4ac0-a23c-badf93d668b8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:20.548575 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fcd01620-f50d-4ac0-a23c-badf93d668b8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:20.551497 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fcd01620-f50d-4ac0-a23c-badf93d668b8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:20.844035 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fcd01620-f50d-4ac0-a23c-badf93d668b8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:38:20.853914 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fcd01620-f50d-4ac0-a23c-badf93d668b8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620" status: 200 len: 1502 microversion: 2.1 time: 0.342930 Oct 23 01:38:20.876430 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2921/5731] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:38:20 2022] GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620 => generated 1502 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:38:20.890616 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2cf6d442-2595-4516-b5eb-85bc66ca9579 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:38:20.891764 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2cf6d442-2595-4516-b5eb-85bc66ca9579 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 232f6a09-92a9-4e68-93af-404f72ffe620] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:38:20.901485 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2cf6d442-2595-4516-b5eb-85bc66ca9579 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:20.902287 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2cf6d442-2595-4516-b5eb-85bc66ca9579 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:20.903116 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2cf6d442-2595-4516-b5eb-85bc66ca9579 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:20.904165 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2cf6d442-2595-4516-b5eb-85bc66ca9579 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:20.904843 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2cf6d442-2595-4516-b5eb-85bc66ca9579 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:20.905734 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2cf6d442-2595-4516-b5eb-85bc66ca9579 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:21.158455 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2cf6d442-2595-4516-b5eb-85bc66ca9579 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "POST /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620/action" status: 202 len: 0 microversion: 2.1 time: 0.272037 Oct 23 01:38:21.159702 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2811/5732] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:38:20 2022] POST /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:38:21.169919 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-123c6818-1d9b-4571-a56a-8ab32c6c9365 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:38:21.170865 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-123c6818-1d9b-4571-a56a-8ab32c6c9365 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 232f6a09-92a9-4e68-93af-404f72ffe620] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:38:21.180332 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-123c6818-1d9b-4571-a56a-8ab32c6c9365 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:21.180925 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-123c6818-1d9b-4571-a56a-8ab32c6c9365 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:21.181436 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-123c6818-1d9b-4571-a56a-8ab32c6c9365 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:21.182407 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-123c6818-1d9b-4571-a56a-8ab32c6c9365 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:21.187744 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-123c6818-1d9b-4571-a56a-8ab32c6c9365 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:21.187744 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-123c6818-1d9b-4571-a56a-8ab32c6c9365 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:21.431167 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-123c6818-1d9b-4571-a56a-8ab32c6c9365 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:38:21.458071 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-123c6818-1d9b-4571-a56a-8ab32c6c9365 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620" status: 200 len: 1507 microversion: 2.1 time: 0.293747 Oct 23 01:38:21.459467 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2922/5733] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:38:21 2022] GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620 => generated 1507 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:38:22.486828 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ffa3587a-d81f-4851-98d1-b14a13963383 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:38:22.488250 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ffa3587a-d81f-4851-98d1-b14a13963383 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 232f6a09-92a9-4e68-93af-404f72ffe620] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:38:22.503520 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ffa3587a-d81f-4851-98d1-b14a13963383 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:22.504015 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ffa3587a-d81f-4851-98d1-b14a13963383 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:22.508518 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ffa3587a-d81f-4851-98d1-b14a13963383 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:22.510216 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ffa3587a-d81f-4851-98d1-b14a13963383 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:22.510903 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ffa3587a-d81f-4851-98d1-b14a13963383 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:22.511751 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ffa3587a-d81f-4851-98d1-b14a13963383 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:22.765849 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ffa3587a-d81f-4851-98d1-b14a13963383 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:38:22.776077 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ffa3587a-d81f-4851-98d1-b14a13963383 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620" status: 200 len: 1487 microversion: 2.1 time: 0.295677 Oct 23 01:38:22.782598 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2812/5734] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:38:22 2022] GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620 => generated 1487 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:38:22.801363 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6522402b-b36e-4840-b94a-c17f7df8358e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:38:22.801988 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6522402b-b36e-4840-b94a-c17f7df8358e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 232f6a09-92a9-4e68-93af-404f72ffe620] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:38:22.814121 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6522402b-b36e-4840-b94a-c17f7df8358e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:22.814121 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6522402b-b36e-4840-b94a-c17f7df8358e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:22.814121 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6522402b-b36e-4840-b94a-c17f7df8358e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:22.814121 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6522402b-b36e-4840-b94a-c17f7df8358e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:22.814121 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6522402b-b36e-4840-b94a-c17f7df8358e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:22.814121 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6522402b-b36e-4840-b94a-c17f7df8358e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:22.841811 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-6522402b-b36e-4840-b94a-c17f7df8358e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lazy-loading 'flavor' on Instance uuid 232f6a09-92a9-4e68-93af-404f72ffe620 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:38:23.543851 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6522402b-b36e-4840-b94a-c17f7df8358e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "POST /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620/action" status: 202 len: 0 microversion: 2.1 time: 0.746650 Oct 23 01:38:23.546439 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2923/5735] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:38:22 2022] POST /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620/action => generated 0 bytes in 750 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:38:23.563347 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0d7e0215-22f4-4900-877f-08f9959f8dea tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:38:23.567479 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0d7e0215-22f4-4900-877f-08f9959f8dea tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 232f6a09-92a9-4e68-93af-404f72ffe620] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:38:23.585271 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d7e0215-22f4-4900-877f-08f9959f8dea tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:23.588054 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d7e0215-22f4-4900-877f-08f9959f8dea tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:23.588314 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d7e0215-22f4-4900-877f-08f9959f8dea tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:23.590665 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d7e0215-22f4-4900-877f-08f9959f8dea tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:23.595289 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d7e0215-22f4-4900-877f-08f9959f8dea tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:23.595754 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d7e0215-22f4-4900-877f-08f9959f8dea tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:23.824008 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0d7e0215-22f4-4900-877f-08f9959f8dea tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:38:23.833003 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0d7e0215-22f4-4900-877f-08f9959f8dea tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620" status: 200 len: 1493 microversion: 2.1 time: 0.282813 Oct 23 01:38:23.835744 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2813/5736] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:38:23 2022] GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620 => generated 1493 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:38:24.861312 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-20917fb0-8817-4420-bc12-53eaf9985784 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:38:24.862763 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-20917fb0-8817-4420-bc12-53eaf9985784 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 232f6a09-92a9-4e68-93af-404f72ffe620] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:38:24.873831 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20917fb0-8817-4420-bc12-53eaf9985784 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:24.874862 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20917fb0-8817-4420-bc12-53eaf9985784 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:24.875457 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20917fb0-8817-4420-bc12-53eaf9985784 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:24.877155 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20917fb0-8817-4420-bc12-53eaf9985784 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:24.878489 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20917fb0-8817-4420-bc12-53eaf9985784 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:24.878922 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20917fb0-8817-4420-bc12-53eaf9985784 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:25.123939 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-20917fb0-8817-4420-bc12-53eaf9985784 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:38:25.139578 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-20917fb0-8817-4420-bc12-53eaf9985784 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620" status: 200 len: 1514 microversion: 2.1 time: 0.284353 Oct 23 01:38:25.140806 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2924/5737] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:38:24 2022] GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620 => generated 1514 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:38:26.164809 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-05f64cc2-4f92-4c1f-a538-412a6a834f10 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:38:26.165431 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-05f64cc2-4f92-4c1f-a538-412a6a834f10 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 232f6a09-92a9-4e68-93af-404f72ffe620] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:38:26.180049 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05f64cc2-4f92-4c1f-a538-412a6a834f10 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:26.180781 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05f64cc2-4f92-4c1f-a538-412a6a834f10 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:26.181377 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05f64cc2-4f92-4c1f-a538-412a6a834f10 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:26.182264 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05f64cc2-4f92-4c1f-a538-412a6a834f10 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:26.182871 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05f64cc2-4f92-4c1f-a538-412a6a834f10 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:26.183511 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05f64cc2-4f92-4c1f-a538-412a6a834f10 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:26.392387 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-05f64cc2-4f92-4c1f-a538-412a6a834f10 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:38:26.402046 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-05f64cc2-4f92-4c1f-a538-412a6a834f10 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620" status: 200 len: 1514 microversion: 2.1 time: 0.241010 Oct 23 01:38:26.403253 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2814/5738] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:38:26 2022] GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620 => generated 1514 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:38:26.755936 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-aa92a43c-6f12-43d0-a470-b213d33a6024 req-47e74d01-eca8-4021-b746-d6161129c6d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "232f6a09-92a9-4e68-93af-404f72ffe620", "name": "network-vif-plugged", "status": "completed", "tag": "d907bb94-e15e-405b-ad8a-f9448d3eab65"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:38:26.778557 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-aa92a43c-6f12-43d0-a470-b213d33a6024 req-47e74d01-eca8-4021-b746-d6161129c6d8 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:26.783955 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-aa92a43c-6f12-43d0-a470-b213d33a6024 req-47e74d01-eca8-4021-b746-d6161129c6d8 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:26.783955 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-aa92a43c-6f12-43d0-a470-b213d33a6024 req-47e74d01-eca8-4021-b746-d6161129c6d8 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:26.807109 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-aa92a43c-6f12-43d0-a470-b213d33a6024 req-47e74d01-eca8-4021-b746-d6161129c6d8 service nova] Creating event network-vif-plugged:d907bb94-e15e-405b-ad8a-f9448d3eab65 for instance 232f6a09-92a9-4e68-93af-404f72ffe620 on n-h2-master-1 Oct 23 01:38:26.818732 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-aa92a43c-6f12-43d0-a470-b213d33a6024 req-47e74d01-eca8-4021-b746-d6161129c6d8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067763 Oct 23 01:38:26.824037 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2925/5739] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:38:27.429925 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-95a1ffd8-3520-4c9e-a90f-6ba5e9ad1164 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:38:27.431768 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-95a1ffd8-3520-4c9e-a90f-6ba5e9ad1164 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 232f6a09-92a9-4e68-93af-404f72ffe620] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:38:27.439162 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-95a1ffd8-3520-4c9e-a90f-6ba5e9ad1164 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:27.440023 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-95a1ffd8-3520-4c9e-a90f-6ba5e9ad1164 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:27.440632 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-95a1ffd8-3520-4c9e-a90f-6ba5e9ad1164 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:27.441345 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-95a1ffd8-3520-4c9e-a90f-6ba5e9ad1164 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:27.441805 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-95a1ffd8-3520-4c9e-a90f-6ba5e9ad1164 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:27.442644 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-95a1ffd8-3520-4c9e-a90f-6ba5e9ad1164 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:27.660644 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-95a1ffd8-3520-4c9e-a90f-6ba5e9ad1164 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:38:27.670555 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-95a1ffd8-3520-4c9e-a90f-6ba5e9ad1164 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620" status: 200 len: 1509 microversion: 2.1 time: 0.243623 Oct 23 01:38:27.670649 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2815/5740] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:38:27 2022] GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620 => generated 1509 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:38:28.697795 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-95889c4e-2e75-49ca-bb41-b2f9df6e0d23 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:38:28.698978 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-95889c4e-2e75-49ca-bb41-b2f9df6e0d23 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 232f6a09-92a9-4e68-93af-404f72ffe620] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:38:28.705399 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-95889c4e-2e75-49ca-bb41-b2f9df6e0d23 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:28.706065 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-95889c4e-2e75-49ca-bb41-b2f9df6e0d23 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:28.706452 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-95889c4e-2e75-49ca-bb41-b2f9df6e0d23 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:28.707196 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-95889c4e-2e75-49ca-bb41-b2f9df6e0d23 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:28.707196 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-95889c4e-2e75-49ca-bb41-b2f9df6e0d23 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:28.708735 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-95889c4e-2e75-49ca-bb41-b2f9df6e0d23 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:28.934794 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-95889c4e-2e75-49ca-bb41-b2f9df6e0d23 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:38:28.953247 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-95889c4e-2e75-49ca-bb41-b2f9df6e0d23 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620" status: 200 len: 1509 microversion: 2.1 time: 0.260916 Oct 23 01:38:28.969704 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2926/5741] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:38:28 2022] GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620 => generated 1509 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:38:29.977232 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d3af337b-25b2-4ca7-b979-18d15484d518 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:38:29.977842 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d3af337b-25b2-4ca7-b979-18d15484d518 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 232f6a09-92a9-4e68-93af-404f72ffe620] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:38:29.992535 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d3af337b-25b2-4ca7-b979-18d15484d518 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:29.993389 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d3af337b-25b2-4ca7-b979-18d15484d518 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:29.994704 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d3af337b-25b2-4ca7-b979-18d15484d518 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:29.995661 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d3af337b-25b2-4ca7-b979-18d15484d518 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:29.996330 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d3af337b-25b2-4ca7-b979-18d15484d518 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:29.996962 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d3af337b-25b2-4ca7-b979-18d15484d518 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:30.336499 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d3af337b-25b2-4ca7-b979-18d15484d518 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:38:30.353112 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d3af337b-25b2-4ca7-b979-18d15484d518 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620" status: 200 len: 1509 microversion: 2.1 time: 0.374802 Oct 23 01:38:30.353112 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2816/5742] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:38:29 2022] GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620 => generated 1509 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:38:31.377964 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6d75b048-ac08-4c1b-80a3-490b2e784d01 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:38:31.379333 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6d75b048-ac08-4c1b-80a3-490b2e784d01 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 232f6a09-92a9-4e68-93af-404f72ffe620] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:38:31.389827 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6d75b048-ac08-4c1b-80a3-490b2e784d01 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:31.391032 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6d75b048-ac08-4c1b-80a3-490b2e784d01 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:31.391801 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6d75b048-ac08-4c1b-80a3-490b2e784d01 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:31.393059 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6d75b048-ac08-4c1b-80a3-490b2e784d01 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:31.393758 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6d75b048-ac08-4c1b-80a3-490b2e784d01 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:31.394481 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6d75b048-ac08-4c1b-80a3-490b2e784d01 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:31.729765 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6d75b048-ac08-4c1b-80a3-490b2e784d01 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:38:31.740113 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6d75b048-ac08-4c1b-80a3-490b2e784d01 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620" status: 200 len: 1509 microversion: 2.1 time: 0.367171 Oct 23 01:38:31.757089 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2927/5743] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:38:31 2022] GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620 => generated 1509 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:38:32.772695 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4bc17545-024b-483a-b188-09ef427082c7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:38:32.773570 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4bc17545-024b-483a-b188-09ef427082c7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 232f6a09-92a9-4e68-93af-404f72ffe620] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:38:32.788339 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4bc17545-024b-483a-b188-09ef427082c7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:32.788339 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4bc17545-024b-483a-b188-09ef427082c7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:32.788339 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4bc17545-024b-483a-b188-09ef427082c7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:32.788339 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4bc17545-024b-483a-b188-09ef427082c7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:32.788339 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4bc17545-024b-483a-b188-09ef427082c7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:32.788339 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4bc17545-024b-483a-b188-09ef427082c7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:32.790763 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:33.120615 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4bc17545-024b-483a-b188-09ef427082c7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:38:33.126963 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4bc17545-024b-483a-b188-09ef427082c7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620" status: 200 len: 1509 microversion: 2.1 time: 0.359725 Oct 23 01:38:33.138359 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2817/5744] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:38:32 2022] GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620 => generated 1509 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:38:34.152666 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b796d541-fe3d-4762-87a1-4555742f84c2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:38:34.154868 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b796d541-fe3d-4762-87a1-4555742f84c2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 232f6a09-92a9-4e68-93af-404f72ffe620] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:38:34.170755 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b796d541-fe3d-4762-87a1-4555742f84c2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:34.171257 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b796d541-fe3d-4762-87a1-4555742f84c2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:34.172187 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b796d541-fe3d-4762-87a1-4555742f84c2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:34.173013 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b796d541-fe3d-4762-87a1-4555742f84c2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:34.173529 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b796d541-fe3d-4762-87a1-4555742f84c2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:34.173963 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b796d541-fe3d-4762-87a1-4555742f84c2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:34.625149 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b796d541-fe3d-4762-87a1-4555742f84c2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:38:34.664344 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b796d541-fe3d-4762-87a1-4555742f84c2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620" status: 200 len: 1509 microversion: 2.1 time: 0.510786 Oct 23 01:38:34.677724 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2928/5745] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:38:34 2022] GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620 => generated 1509 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:38:35.691532 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1f0f6398-0b58-4ba2-a317-c0e12cc1b993 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:38:35.693495 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1f0f6398-0b58-4ba2-a317-c0e12cc1b993 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 232f6a09-92a9-4e68-93af-404f72ffe620] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:38:35.751375 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1f0f6398-0b58-4ba2-a317-c0e12cc1b993 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:35.759539 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1f0f6398-0b58-4ba2-a317-c0e12cc1b993 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:35.766911 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1f0f6398-0b58-4ba2-a317-c0e12cc1b993 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:35.768978 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1f0f6398-0b58-4ba2-a317-c0e12cc1b993 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:35.773594 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1f0f6398-0b58-4ba2-a317-c0e12cc1b993 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:35.776684 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1f0f6398-0b58-4ba2-a317-c0e12cc1b993 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:36.330702 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1f0f6398-0b58-4ba2-a317-c0e12cc1b993 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:38:36.344556 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1f0f6398-0b58-4ba2-a317-c0e12cc1b993 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620" status: 200 len: 1509 microversion: 2.1 time: 0.659986 Oct 23 01:38:36.345161 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2818/5746] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:38:35 2022] GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620 => generated 1509 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:38:37.376994 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-846417ce-f937-48cb-9086-8cf93fe62876 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:38:37.387730 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-846417ce-f937-48cb-9086-8cf93fe62876 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 232f6a09-92a9-4e68-93af-404f72ffe620] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:38:37.410924 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-846417ce-f937-48cb-9086-8cf93fe62876 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:37.412811 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-846417ce-f937-48cb-9086-8cf93fe62876 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:37.418404 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-846417ce-f937-48cb-9086-8cf93fe62876 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:37.419488 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-846417ce-f937-48cb-9086-8cf93fe62876 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:37.420311 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-846417ce-f937-48cb-9086-8cf93fe62876 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:37.421271 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-846417ce-f937-48cb-9086-8cf93fe62876 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:37.772622 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-846417ce-f937-48cb-9086-8cf93fe62876 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:38:37.803750 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-846417ce-f937-48cb-9086-8cf93fe62876 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620" status: 200 len: 1509 microversion: 2.1 time: 0.434031 Oct 23 01:38:37.834305 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2929/5747] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:38:37 2022] GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620 => generated 1509 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:38:38.857234 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8cb7c70c-d813-435d-a405-dd7061ae93ce tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:38:38.858647 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8cb7c70c-d813-435d-a405-dd7061ae93ce tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 232f6a09-92a9-4e68-93af-404f72ffe620] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:38:38.873556 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8cb7c70c-d813-435d-a405-dd7061ae93ce tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:38.880622 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8cb7c70c-d813-435d-a405-dd7061ae93ce tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:38.882724 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8cb7c70c-d813-435d-a405-dd7061ae93ce tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:38.887967 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8cb7c70c-d813-435d-a405-dd7061ae93ce tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:38.891589 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8cb7c70c-d813-435d-a405-dd7061ae93ce tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:38.892928 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8cb7c70c-d813-435d-a405-dd7061ae93ce tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:39.168158 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8cb7c70c-d813-435d-a405-dd7061ae93ce tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:38:39.177648 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8cb7c70c-d813-435d-a405-dd7061ae93ce tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620" status: 200 len: 1509 microversion: 2.1 time: 0.324583 Oct 23 01:38:39.191724 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2819/5748] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:38:38 2022] GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620 => generated 1509 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:38:40.204153 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-529989ff-82fd-4236-bd06-50710dbb2322 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:38:40.204718 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-529989ff-82fd-4236-bd06-50710dbb2322 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 232f6a09-92a9-4e68-93af-404f72ffe620] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:38:40.213789 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-529989ff-82fd-4236-bd06-50710dbb2322 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:40.214427 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-529989ff-82fd-4236-bd06-50710dbb2322 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:40.214946 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-529989ff-82fd-4236-bd06-50710dbb2322 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:40.216359 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-529989ff-82fd-4236-bd06-50710dbb2322 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:40.216930 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-529989ff-82fd-4236-bd06-50710dbb2322 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:40.217433 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-529989ff-82fd-4236-bd06-50710dbb2322 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:40.515873 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-529989ff-82fd-4236-bd06-50710dbb2322 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:38:40.526016 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-529989ff-82fd-4236-bd06-50710dbb2322 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620" status: 200 len: 1509 microversion: 2.1 time: 0.326138 Oct 23 01:38:40.527421 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2930/5749] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:38:40 2022] GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620 => generated 1509 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:38:41.549466 n-d-master-1 devstack@n-api.service[120945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 23 01:38:41.549466 n-d-master-1 devstack@n-api.service[120945]: Sun Oct 23 01:38:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620 (ip 10.222.0.42) !!! Oct 23 01:38:41.553787 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5d3a0650-8b58-4efb-bbc1-a60de84314c7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:38:41.554815 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5d3a0650-8b58-4efb-bbc1-a60de84314c7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 232f6a09-92a9-4e68-93af-404f72ffe620] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:38:41.580111 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5d3a0650-8b58-4efb-bbc1-a60de84314c7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:41.580706 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5d3a0650-8b58-4efb-bbc1-a60de84314c7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:41.581155 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5d3a0650-8b58-4efb-bbc1-a60de84314c7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:41.581905 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5d3a0650-8b58-4efb-bbc1-a60de84314c7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:41.582943 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5d3a0650-8b58-4efb-bbc1-a60de84314c7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:41.583383 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5d3a0650-8b58-4efb-bbc1-a60de84314c7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:41.926915 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5d3a0650-8b58-4efb-bbc1-a60de84314c7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:38:41.945552 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5d3a0650-8b58-4efb-bbc1-a60de84314c7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620" status: 200 len: 1509 microversion: 2.1 time: 0.399073 Oct 23 01:38:41.958330 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2820/5750] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:38:41 2022] GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620 => generated 1509 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:38:42.984643 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ab204d31-963f-4a15-b3c1-cc1208ee9c51 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:38:42.985313 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ab204d31-963f-4a15-b3c1-cc1208ee9c51 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 232f6a09-92a9-4e68-93af-404f72ffe620] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:38:42.989299 n-d-master-1 devstack@n-api.service[120944]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 23 01:38:42.989473 n-d-master-1 devstack@n-api.service[120944]: Sun Oct 23 01:38:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620 (ip 10.222.0.42) !!! Oct 23 01:38:43.005478 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab204d31-963f-4a15-b3c1-cc1208ee9c51 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:43.006055 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab204d31-963f-4a15-b3c1-cc1208ee9c51 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:43.006529 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab204d31-963f-4a15-b3c1-cc1208ee9c51 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:43.020489 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab204d31-963f-4a15-b3c1-cc1208ee9c51 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:43.021682 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab204d31-963f-4a15-b3c1-cc1208ee9c51 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:43.022511 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab204d31-963f-4a15-b3c1-cc1208ee9c51 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:43.244894 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ab204d31-963f-4a15-b3c1-cc1208ee9c51 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:38:43.258304 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ab204d31-963f-4a15-b3c1-cc1208ee9c51 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620" status: 200 len: 1509 microversion: 2.1 time: 0.277373 Oct 23 01:38:43.259706 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2931/5751] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:38:42 2022] GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620 => generated 1509 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:38:44.285100 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-39f375dd-77e5-4029-8d6c-e1476c70430a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:38:44.287850 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-39f375dd-77e5-4029-8d6c-e1476c70430a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 232f6a09-92a9-4e68-93af-404f72ffe620] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:38:44.306254 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-39f375dd-77e5-4029-8d6c-e1476c70430a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:44.306861 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-39f375dd-77e5-4029-8d6c-e1476c70430a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:44.308227 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-39f375dd-77e5-4029-8d6c-e1476c70430a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:44.310505 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-39f375dd-77e5-4029-8d6c-e1476c70430a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:44.311858 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-39f375dd-77e5-4029-8d6c-e1476c70430a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:44.315726 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-39f375dd-77e5-4029-8d6c-e1476c70430a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:44.580727 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-39f375dd-77e5-4029-8d6c-e1476c70430a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:38:44.591516 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-39f375dd-77e5-4029-8d6c-e1476c70430a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620" status: 200 len: 1509 microversion: 2.1 time: 0.312252 Oct 23 01:38:44.592275 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2821/5752] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:38:44 2022] GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620 => generated 1509 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:38:45.616051 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5420b03c-bc10-497d-aa1d-15d7a1893209 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:38:45.616677 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5420b03c-bc10-497d-aa1d-15d7a1893209 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 232f6a09-92a9-4e68-93af-404f72ffe620] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:38:45.631850 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5420b03c-bc10-497d-aa1d-15d7a1893209 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:45.636989 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5420b03c-bc10-497d-aa1d-15d7a1893209 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:45.636989 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5420b03c-bc10-497d-aa1d-15d7a1893209 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:45.636989 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5420b03c-bc10-497d-aa1d-15d7a1893209 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:45.636989 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5420b03c-bc10-497d-aa1d-15d7a1893209 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:45.636989 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5420b03c-bc10-497d-aa1d-15d7a1893209 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:46.014060 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5420b03c-bc10-497d-aa1d-15d7a1893209 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:38:46.035946 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5420b03c-bc10-497d-aa1d-15d7a1893209 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620" status: 200 len: 1509 microversion: 2.1 time: 0.423629 Oct 23 01:38:46.039560 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2932/5753] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:38:45 2022] GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620 => generated 1509 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:38:47.064469 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fbbef219-24c2-4447-a8d1-8fdafed147f8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:38:47.065064 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-fbbef219-24c2-4447-a8d1-8fdafed147f8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 232f6a09-92a9-4e68-93af-404f72ffe620] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:38:47.075729 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fbbef219-24c2-4447-a8d1-8fdafed147f8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:47.076234 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fbbef219-24c2-4447-a8d1-8fdafed147f8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:47.076729 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fbbef219-24c2-4447-a8d1-8fdafed147f8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:47.077445 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fbbef219-24c2-4447-a8d1-8fdafed147f8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:47.081181 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fbbef219-24c2-4447-a8d1-8fdafed147f8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:47.081299 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fbbef219-24c2-4447-a8d1-8fdafed147f8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:47.339837 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-fbbef219-24c2-4447-a8d1-8fdafed147f8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:38:47.348689 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fbbef219-24c2-4447-a8d1-8fdafed147f8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620" status: 200 len: 1509 microversion: 2.1 time: 0.288300 Oct 23 01:38:47.349803 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2822/5754] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:38:47 2022] GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620 => generated 1509 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:38:48.372085 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bd05ea88-1bdc-47ee-86f2-cf891a17d9b2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:38:48.372699 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bd05ea88-1bdc-47ee-86f2-cf891a17d9b2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 232f6a09-92a9-4e68-93af-404f72ffe620] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:38:48.379659 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bd05ea88-1bdc-47ee-86f2-cf891a17d9b2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:48.380140 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bd05ea88-1bdc-47ee-86f2-cf891a17d9b2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:48.381147 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bd05ea88-1bdc-47ee-86f2-cf891a17d9b2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:48.381263 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bd05ea88-1bdc-47ee-86f2-cf891a17d9b2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:48.381686 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bd05ea88-1bdc-47ee-86f2-cf891a17d9b2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:48.382205 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bd05ea88-1bdc-47ee-86f2-cf891a17d9b2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:48.386111 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:48.545696 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bd05ea88-1bdc-47ee-86f2-cf891a17d9b2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:38:48.554092 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bd05ea88-1bdc-47ee-86f2-cf891a17d9b2 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620" status: 200 len: 1509 microversion: 2.1 time: 0.185881 Oct 23 01:38:48.554685 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2933/5755] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:38:48 2022] GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620 => generated 1509 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:38:49.577674 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6ea8ae2c-74e8-4a02-b2b8-0d83d5920002 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:38:49.578322 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6ea8ae2c-74e8-4a02-b2b8-0d83d5920002 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 232f6a09-92a9-4e68-93af-404f72ffe620] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:38:49.581230 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=26 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:49.588514 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6ea8ae2c-74e8-4a02-b2b8-0d83d5920002 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:49.589032 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6ea8ae2c-74e8-4a02-b2b8-0d83d5920002 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:49.589447 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6ea8ae2c-74e8-4a02-b2b8-0d83d5920002 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:49.590192 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6ea8ae2c-74e8-4a02-b2b8-0d83d5920002 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:49.590653 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6ea8ae2c-74e8-4a02-b2b8-0d83d5920002 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:49.591126 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6ea8ae2c-74e8-4a02-b2b8-0d83d5920002 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:49.757478 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6ea8ae2c-74e8-4a02-b2b8-0d83d5920002 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:38:49.780912 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6ea8ae2c-74e8-4a02-b2b8-0d83d5920002 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620" status: 200 len: 1506 microversion: 2.1 time: 0.207048 Oct 23 01:38:49.789220 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2823/5756] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:38:49 2022] GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620 => generated 1506 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:38:50.815672 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b67157c6-154e-4c55-b80f-3edd972844ca tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:38:50.817739 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b67157c6-154e-4c55-b80f-3edd972844ca tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 232f6a09-92a9-4e68-93af-404f72ffe620] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:38:50.822677 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=30 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:50.834341 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b67157c6-154e-4c55-b80f-3edd972844ca tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:50.837553 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b67157c6-154e-4c55-b80f-3edd972844ca tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:50.838107 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b67157c6-154e-4c55-b80f-3edd972844ca tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:50.838828 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b67157c6-154e-4c55-b80f-3edd972844ca tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:50.839289 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b67157c6-154e-4c55-b80f-3edd972844ca tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:50.839721 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b67157c6-154e-4c55-b80f-3edd972844ca tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:51.064417 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b67157c6-154e-4c55-b80f-3edd972844ca tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:38:51.076657 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b67157c6-154e-4c55-b80f-3edd972844ca tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620" status: 200 len: 1506 microversion: 2.1 time: 0.264988 Oct 23 01:38:51.077500 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2934/5757] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:38:50 2022] GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620 => generated 1506 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:38:52.069614 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-52d5e96a-9777-47f2-bf6d-00dd0dc8b2a6 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1798123549", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "9b44e1df-af44-4033-823d-e74d9138a83d"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:38:52.109854 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5066234e-25f7-44a7-b1f1-d6b698fc9289 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:38:52.122561 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5066234e-25f7-44a7-b1f1-d6b698fc9289 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 232f6a09-92a9-4e68-93af-404f72ffe620] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:38:52.158677 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5066234e-25f7-44a7-b1f1-d6b698fc9289 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:52.163753 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5066234e-25f7-44a7-b1f1-d6b698fc9289 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:52.164232 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5066234e-25f7-44a7-b1f1-d6b698fc9289 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:52.164983 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5066234e-25f7-44a7-b1f1-d6b698fc9289 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:52.165461 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5066234e-25f7-44a7-b1f1-d6b698fc9289 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:52.165908 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5066234e-25f7-44a7-b1f1-d6b698fc9289 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:52.244799 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-52d5e96a-9777-47f2-bf6d-00dd0dc8b2a6 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] validate_networks() for [('9b44e1df-af44-4033-823d-e74d9138a83d', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:38:52.690896 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5066234e-25f7-44a7-b1f1-d6b698fc9289 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:38:52.717965 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5066234e-25f7-44a7-b1f1-d6b698fc9289 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620" status: 200 len: 1509 microversion: 2.1 time: 0.615683 Oct 23 01:38:52.721319 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2935/5758] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:38:52 2022] GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620 => generated 1509 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:38:52.747972 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-737ac8af-ce09-424c-be77-61d8965dab04 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:38:52.748604 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-737ac8af-ce09-424c-be77-61d8965dab04 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:38:52.761592 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-737ac8af-ce09-424c-be77-61d8965dab04 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:52.763013 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-737ac8af-ce09-424c-be77-61d8965dab04 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:52.763673 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-737ac8af-ce09-424c-be77-61d8965dab04 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:52.764615 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-737ac8af-ce09-424c-be77-61d8965dab04 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:52.765250 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-737ac8af-ce09-424c-be77-61d8965dab04 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:52.766289 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-737ac8af-ce09-424c-be77-61d8965dab04 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:53.203893 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-737ac8af-ce09-424c-be77-61d8965dab04 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:38:53.212119 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-737ac8af-ce09-424c-be77-61d8965dab04 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1669 microversion: 2.1 time: 0.468245 Oct 23 01:38:53.224205 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2936/5759] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:38:52 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1669 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:38:53.237790 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-d4e71002-bc21-4f19-9c6a-7bef3cadbe61 req-45ad7b9a-10ae-43b6-912b-a9c53af9b67b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "232f6a09-92a9-4e68-93af-404f72ffe620", "name": "network-vif-unplugged", "status": "completed", "tag": "d907bb94-e15e-405b-ad8a-f9448d3eab65"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:38:53.273371 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-d4e71002-bc21-4f19-9c6a-7bef3cadbe61 req-45ad7b9a-10ae-43b6-912b-a9c53af9b67b service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:53.274938 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-d4e71002-bc21-4f19-9c6a-7bef3cadbe61 req-45ad7b9a-10ae-43b6-912b-a9c53af9b67b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:53.275549 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-d4e71002-bc21-4f19-9c6a-7bef3cadbe61 req-45ad7b9a-10ae-43b6-912b-a9c53af9b67b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:53.289792 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.compute.server_external_events [req-d4e71002-bc21-4f19-9c6a-7bef3cadbe61 req-45ad7b9a-10ae-43b6-912b-a9c53af9b67b service nova] Unable to find a host for instance 232f6a09-92a9-4e68-93af-404f72ffe620. Dropping event network-vif-unplugged {{(pid=120944) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 23 01:38:53.291004 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-d4e71002-bc21-4f19-9c6a-7bef3cadbe61 req-45ad7b9a-10ae-43b6-912b-a9c53af9b67b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.065567 Oct 23 01:38:53.292987 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2937/5760] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 68 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 23 01:38:53.299559 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ab8c3ec2-d952-46e8-9a53-8a1c6b939200 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:38:53.303947 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ab8c3ec2-d952-46e8-9a53-8a1c6b939200 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:38:53.312648 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab8c3ec2-d952-46e8-9a53-8a1c6b939200 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:53.321263 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab8c3ec2-d952-46e8-9a53-8a1c6b939200 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:53.321263 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab8c3ec2-d952-46e8-9a53-8a1c6b939200 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:53.321263 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab8c3ec2-d952-46e8-9a53-8a1c6b939200 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:53.321263 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab8c3ec2-d952-46e8-9a53-8a1c6b939200 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:53.321263 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab8c3ec2-d952-46e8-9a53-8a1c6b939200 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:53.799909 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ab8c3ec2-d952-46e8-9a53-8a1c6b939200 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:38:53.811508 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ab8c3ec2-d952-46e8-9a53-8a1c6b939200 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1669 microversion: 2.1 time: 0.517129 Oct 23 01:38:53.812405 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2938/5761] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:38:53 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1669 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:38:53.853897 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-94117bcb-860d-4a62-ae48-a2ec22f7d982 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:38:53.855459 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-94117bcb-860d-4a62-ae48-a2ec22f7d982 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:38:53.875838 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-94117bcb-860d-4a62-ae48-a2ec22f7d982 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:53.877171 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-94117bcb-860d-4a62-ae48-a2ec22f7d982 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:53.877841 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-94117bcb-860d-4a62-ae48-a2ec22f7d982 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:53.880302 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-94117bcb-860d-4a62-ae48-a2ec22f7d982 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:53.881711 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-94117bcb-860d-4a62-ae48-a2ec22f7d982 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:53.882931 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-94117bcb-860d-4a62-ae48-a2ec22f7d982 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:54.114615 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-52d5e96a-9777-47f2-bf6d-00dd0dc8b2a6 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:38:54.115138 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-52d5e96a-9777-47f2-bf6d-00dd0dc8b2a6 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:38:54.116143 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-52d5e96a-9777-47f2-bf6d-00dd0dc8b2a6 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:38:54.116143 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-52d5e96a-9777-47f2-bf6d-00dd0dc8b2a6 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:38:54.116492 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-52d5e96a-9777-47f2-bf6d-00dd0dc8b2a6 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:38:54.149498 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52d5e96a-9777-47f2-bf6d-00dd0dc8b2a6 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:54.150153 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52d5e96a-9777-47f2-bf6d-00dd0dc8b2a6 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:54.150589 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52d5e96a-9777-47f2-bf6d-00dd0dc8b2a6 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:54.152110 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52d5e96a-9777-47f2-bf6d-00dd0dc8b2a6 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:54.152270 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52d5e96a-9777-47f2-bf6d-00dd0dc8b2a6 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:54.152891 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52d5e96a-9777-47f2-bf6d-00dd0dc8b2a6 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:54.180721 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-52d5e96a-9777-47f2-bf6d-00dd0dc8b2a6 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Getting quotas for project d53e92891fa74db68db5554878af0adf. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:38:54.188251 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-52d5e96a-9777-47f2-bf6d-00dd0dc8b2a6 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Getting quotas for user 6e9f6fbfc6484cbfb60167b73e87a768 and project d53e92891fa74db68db5554878af0adf. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:38:54.209008 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-52d5e96a-9777-47f2-bf6d-00dd0dc8b2a6 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:38:54.211978 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-52d5e96a-9777-47f2-bf6d-00dd0dc8b2a6 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] [instance: 8d1b907b-f4d6-42b7-8ace-4541cac25828] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:38:54.266686 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-94117bcb-860d-4a62-ae48-a2ec22f7d982 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:38:54.280152 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-94117bcb-860d-4a62-ae48-a2ec22f7d982 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1669 microversion: 2.1 time: 0.440694 Oct 23 01:38:54.287035 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2939/5762] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:38:53 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1669 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:38:54.310311 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-11ba65a0-5c6d-475e-8f9f-790ac0e5611d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:38:54.311181 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-11ba65a0-5c6d-475e-8f9f-790ac0e5611d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:38:54.318270 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-11ba65a0-5c6d-475e-8f9f-790ac0e5611d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:54.319013 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-11ba65a0-5c6d-475e-8f9f-790ac0e5611d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:54.319618 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-11ba65a0-5c6d-475e-8f9f-790ac0e5611d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:54.320493 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-11ba65a0-5c6d-475e-8f9f-790ac0e5611d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:54.321112 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-11ba65a0-5c6d-475e-8f9f-790ac0e5611d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:54.321705 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-11ba65a0-5c6d-475e-8f9f-790ac0e5611d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:54.353096 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-52d5e96a-9777-47f2-bf6d-00dd0dc8b2a6 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.522992 Oct 23 01:38:54.354649 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2824/5763] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:38:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2525 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:38:54.367219 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-dff248f1-1a27-4ea0-985a-9c070e08fb84 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:38:54.372669 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-dff248f1-1a27-4ea0-985a-9c070e08fb84 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] [instance: 8d1b907b-f4d6-42b7-8ace-4541cac25828] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:38:54.481634 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-dff248f1-1a27-4ea0-985a-9c070e08fb84 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9f6fbfc6484cbfb60167b73e87a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53e92891fa74db68db5554878af0adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:38:54.496364 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-dff248f1-1a27-4ea0-985a-9c070e08fb84 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] 10.222.0.42 "GET /compute/v2.1/servers/8d1b907b-f4d6-42b7-8ace-4541cac25828" status: 200 len: 1214 microversion: 2.1 time: 0.133777 Oct 23 01:38:54.497194 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2825/5764] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:38:54 2022] GET /compute/v2.1/servers/8d1b907b-f4d6-42b7-8ace-4541cac25828 => generated 1214 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:38:54.929378 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-11ba65a0-5c6d-475e-8f9f-790ac0e5611d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:38:54.966355 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-11ba65a0-5c6d-475e-8f9f-790ac0e5611d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1669 microversion: 2.1 time: 0.659659 Oct 23 01:38:54.968303 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2940/5765] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:38:54 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1669 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:38:54.998295 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d8b8b6b5-9255-456b-ae64-070ece3dff8c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:38:55.010590 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d8b8b6b5-9255-456b-ae64-070ece3dff8c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:55.014916 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d8b8b6b5-9255-456b-ae64-070ece3dff8c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:55.014916 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d8b8b6b5-9255-456b-ae64-070ece3dff8c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:55.060786 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d8b8b6b5-9255-456b-ae64-070ece3dff8c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Going to try to stop instance {{(pid=120945) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 23 01:38:55.330214 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d8b8b6b5-9255-456b-ae64-070ece3dff8c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "POST /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98/action" status: 202 len: 0 microversion: 2.1 time: 0.336806 Oct 23 01:38:55.335219 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2826/5766] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:38:54 2022] POST /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98/action => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:38:55.340019 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a0ded6d7-8d3b-45ff-b700-dc9496a1e9b0 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:38:55.340652 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a0ded6d7-8d3b-45ff-b700-dc9496a1e9b0 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:38:55.356976 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a0ded6d7-8d3b-45ff-b700-dc9496a1e9b0 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:55.357478 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a0ded6d7-8d3b-45ff-b700-dc9496a1e9b0 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:55.362426 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a0ded6d7-8d3b-45ff-b700-dc9496a1e9b0 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:55.371610 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a0ded6d7-8d3b-45ff-b700-dc9496a1e9b0 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:55.371610 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a0ded6d7-8d3b-45ff-b700-dc9496a1e9b0 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:55.371610 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a0ded6d7-8d3b-45ff-b700-dc9496a1e9b0 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:55.524232 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-585735a5-9d35-4a99-9e85-13babdf6f3ef tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:38:55.529234 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-585735a5-9d35-4a99-9e85-13babdf6f3ef tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] [instance: 8d1b907b-f4d6-42b7-8ace-4541cac25828] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:38:55.658058 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-585735a5-9d35-4a99-9e85-13babdf6f3ef tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9f6fbfc6484cbfb60167b73e87a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53e92891fa74db68db5554878af0adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:38:55.671234 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-585735a5-9d35-4a99-9e85-13babdf6f3ef tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] 10.222.0.42 "GET /compute/v2.1/servers/8d1b907b-f4d6-42b7-8ace-4541cac25828" status: 200 len: 1214 microversion: 2.1 time: 0.147312 Oct 23 01:38:55.672862 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2827/5767] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:38:55 2022] GET /compute/v2.1/servers/8d1b907b-f4d6-42b7-8ace-4541cac25828 => generated 1214 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:38:55.770487 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a0ded6d7-8d3b-45ff-b700-dc9496a1e9b0 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:38:55.784440 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a0ded6d7-8d3b-45ff-b700-dc9496a1e9b0 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1679 microversion: 2.1 time: 0.448009 Oct 23 01:38:55.794483 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2941/5768] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:38:55 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1679 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:38:56.700055 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c34b8fa7-6152-46aa-bdaa-72bece737f7c tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:38:56.701312 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c34b8fa7-6152-46aa-bdaa-72bece737f7c tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] [instance: 8d1b907b-f4d6-42b7-8ace-4541cac25828] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:38:56.714453 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c34b8fa7-6152-46aa-bdaa-72bece737f7c tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:56.715009 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c34b8fa7-6152-46aa-bdaa-72bece737f7c tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:56.715395 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c34b8fa7-6152-46aa-bdaa-72bece737f7c tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:56.716116 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c34b8fa7-6152-46aa-bdaa-72bece737f7c tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:56.716568 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c34b8fa7-6152-46aa-bdaa-72bece737f7c tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:56.723692 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c34b8fa7-6152-46aa-bdaa-72bece737f7c tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:56.822130 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3840260a-8fa9-44dd-bff7-ae84c565292e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:38:56.823122 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3840260a-8fa9-44dd-bff7-ae84c565292e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:38:56.843126 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3840260a-8fa9-44dd-bff7-ae84c565292e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:56.852042 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3840260a-8fa9-44dd-bff7-ae84c565292e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:56.852042 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3840260a-8fa9-44dd-bff7-ae84c565292e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:56.854463 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3840260a-8fa9-44dd-bff7-ae84c565292e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:56.858282 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3840260a-8fa9-44dd-bff7-ae84c565292e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:56.858813 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3840260a-8fa9-44dd-bff7-ae84c565292e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:57.020767 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c34b8fa7-6152-46aa-bdaa-72bece737f7c tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9f6fbfc6484cbfb60167b73e87a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53e92891fa74db68db5554878af0adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:38:57.032464 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c34b8fa7-6152-46aa-bdaa-72bece737f7c tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] 10.222.0.42 "GET /compute/v2.1/servers/8d1b907b-f4d6-42b7-8ace-4541cac25828" status: 200 len: 1218 microversion: 2.1 time: 0.336504 Oct 23 01:38:57.035445 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2828/5769] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:38:56 2022] GET /compute/v2.1/servers/8d1b907b-f4d6-42b7-8ace-4541cac25828 => generated 1218 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:38:57.853331 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3840260a-8fa9-44dd-bff7-ae84c565292e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:38:57.877589 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3840260a-8fa9-44dd-bff7-ae84c565292e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1679 microversion: 2.1 time: 1.060128 Oct 23 01:38:57.880580 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2942/5770] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:38:56 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1679 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:38:58.060577 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6cd44f99-7158-41ec-9934-77acc08966e3 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:38:58.064394 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6cd44f99-7158-41ec-9934-77acc08966e3 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] [instance: 8d1b907b-f4d6-42b7-8ace-4541cac25828] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:38:58.079759 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6cd44f99-7158-41ec-9934-77acc08966e3 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:58.080361 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6cd44f99-7158-41ec-9934-77acc08966e3 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:58.083100 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6cd44f99-7158-41ec-9934-77acc08966e3 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:58.084025 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6cd44f99-7158-41ec-9934-77acc08966e3 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:58.086371 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6cd44f99-7158-41ec-9934-77acc08966e3 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:58.087070 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6cd44f99-7158-41ec-9934-77acc08966e3 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:58.319012 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6cd44f99-7158-41ec-9934-77acc08966e3 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9f6fbfc6484cbfb60167b73e87a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53e92891fa74db68db5554878af0adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:38:58.338529 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6cd44f99-7158-41ec-9934-77acc08966e3 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] 10.222.0.42 "GET /compute/v2.1/servers/8d1b907b-f4d6-42b7-8ace-4541cac25828" status: 200 len: 1274 microversion: 2.1 time: 0.281932 Oct 23 01:38:58.359026 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2829/5771] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:38:58 2022] GET /compute/v2.1/servers/8d1b907b-f4d6-42b7-8ace-4541cac25828 => generated 1274 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:38:58.912879 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-334e3d37-d521-4f22-85f5-e57addda826c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:38:58.914207 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-334e3d37-d521-4f22-85f5-e57addda826c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:38:58.941615 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-334e3d37-d521-4f22-85f5-e57addda826c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:58.949769 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-334e3d37-d521-4f22-85f5-e57addda826c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:58.950406 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-334e3d37-d521-4f22-85f5-e57addda826c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:58.951264 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-334e3d37-d521-4f22-85f5-e57addda826c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:58.952000 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-334e3d37-d521-4f22-85f5-e57addda826c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:58.954535 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-334e3d37-d521-4f22-85f5-e57addda826c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:59.369347 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-82d2a98b-cbe3-45ff-b7cc-2cad098c9e4a tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:38:59.369965 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-82d2a98b-cbe3-45ff-b7cc-2cad098c9e4a tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] [instance: 8d1b907b-f4d6-42b7-8ace-4541cac25828] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:38:59.381789 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-82d2a98b-cbe3-45ff-b7cc-2cad098c9e4a tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:59.382324 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-82d2a98b-cbe3-45ff-b7cc-2cad098c9e4a tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:59.382766 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-82d2a98b-cbe3-45ff-b7cc-2cad098c9e4a tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:59.383478 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-82d2a98b-cbe3-45ff-b7cc-2cad098c9e4a tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:38:59.383936 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-82d2a98b-cbe3-45ff-b7cc-2cad098c9e4a tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:38:59.390663 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-82d2a98b-cbe3-45ff-b7cc-2cad098c9e4a tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:38:59.500219 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-334e3d37-d521-4f22-85f5-e57addda826c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:38:59.524434 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-334e3d37-d521-4f22-85f5-e57addda826c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1679 microversion: 2.1 time: 0.617764 Oct 23 01:38:59.525875 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2943/5772] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:38:58 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1679 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:38:59.892559 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-82d2a98b-cbe3-45ff-b7cc-2cad098c9e4a tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9f6fbfc6484cbfb60167b73e87a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53e92891fa74db68db5554878af0adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:38:59.904430 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-82d2a98b-cbe3-45ff-b7cc-2cad098c9e4a tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] 10.222.0.42 "GET /compute/v2.1/servers/8d1b907b-f4d6-42b7-8ace-4541cac25828" status: 200 len: 1272 microversion: 2.1 time: 0.538862 Oct 23 01:38:59.906065 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2830/5773] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:38:59 2022] GET /compute/v2.1/servers/8d1b907b-f4d6-42b7-8ace-4541cac25828 => generated 1272 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:39:00.551340 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-104d69f4-10d2-4556-9bd7-0b2cc46fdd59 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:00.552617 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-104d69f4-10d2-4556-9bd7-0b2cc46fdd59 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:00.583407 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-104d69f4-10d2-4556-9bd7-0b2cc46fdd59 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:00.583945 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-104d69f4-10d2-4556-9bd7-0b2cc46fdd59 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:00.584403 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-104d69f4-10d2-4556-9bd7-0b2cc46fdd59 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:00.588451 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-104d69f4-10d2-4556-9bd7-0b2cc46fdd59 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:00.589168 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-104d69f4-10d2-4556-9bd7-0b2cc46fdd59 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:00.592670 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-104d69f4-10d2-4556-9bd7-0b2cc46fdd59 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:00.933521 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1d8db64c-5c83-45b9-81d1-678cd6600a4a tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:00.934194 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1d8db64c-5c83-45b9-81d1-678cd6600a4a tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] [instance: 8d1b907b-f4d6-42b7-8ace-4541cac25828] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:00.954243 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1d8db64c-5c83-45b9-81d1-678cd6600a4a tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:00.954243 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1d8db64c-5c83-45b9-81d1-678cd6600a4a tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:00.954243 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1d8db64c-5c83-45b9-81d1-678cd6600a4a tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:00.954243 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1d8db64c-5c83-45b9-81d1-678cd6600a4a tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:00.954243 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1d8db64c-5c83-45b9-81d1-678cd6600a4a tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:00.954908 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1d8db64c-5c83-45b9-81d1-678cd6600a4a tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:01.754729 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-104d69f4-10d2-4556-9bd7-0b2cc46fdd59 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:01.764959 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-104d69f4-10d2-4556-9bd7-0b2cc46fdd59 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1679 microversion: 2.1 time: 1.219317 Oct 23 01:39:01.767924 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2944/5774] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:00 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1679 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:39:01.908468 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1d8db64c-5c83-45b9-81d1-678cd6600a4a tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9f6fbfc6484cbfb60167b73e87a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53e92891fa74db68db5554878af0adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:01.919721 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1d8db64c-5c83-45b9-81d1-678cd6600a4a tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] 10.222.0.42 "GET /compute/v2.1/servers/8d1b907b-f4d6-42b7-8ace-4541cac25828" status: 200 len: 1314 microversion: 2.1 time: 0.995057 Oct 23 01:39:01.920330 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2831/5775] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:00 2022] GET /compute/v2.1/servers/8d1b907b-f4d6-42b7-8ace-4541cac25828 => generated 1314 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:39:02.792212 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2347ea22-8690-4489-a3bd-3aa176d86ba1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:02.792838 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2347ea22-8690-4489-a3bd-3aa176d86ba1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:02.805146 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2347ea22-8690-4489-a3bd-3aa176d86ba1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:02.805648 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2347ea22-8690-4489-a3bd-3aa176d86ba1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:02.806299 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2347ea22-8690-4489-a3bd-3aa176d86ba1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:02.824139 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2347ea22-8690-4489-a3bd-3aa176d86ba1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:02.824803 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2347ea22-8690-4489-a3bd-3aa176d86ba1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:02.826496 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2347ea22-8690-4489-a3bd-3aa176d86ba1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:02.951060 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-02868975-ef65-46ae-b3d4-aec716571b21 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:02.951755 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-02868975-ef65-46ae-b3d4-aec716571b21 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] [instance: 8d1b907b-f4d6-42b7-8ace-4541cac25828] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:02.968539 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-02868975-ef65-46ae-b3d4-aec716571b21 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:02.969415 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-02868975-ef65-46ae-b3d4-aec716571b21 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:02.972220 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-02868975-ef65-46ae-b3d4-aec716571b21 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:02.981943 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-02868975-ef65-46ae-b3d4-aec716571b21 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:02.984427 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-02868975-ef65-46ae-b3d4-aec716571b21 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:02.985615 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-02868975-ef65-46ae-b3d4-aec716571b21 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:03.519084 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2347ea22-8690-4489-a3bd-3aa176d86ba1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:03.551759 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2347ea22-8690-4489-a3bd-3aa176d86ba1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1679 microversion: 2.1 time: 0.763281 Oct 23 01:39:03.556369 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2945/5776] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:02 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1679 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:39:03.758893 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-02868975-ef65-46ae-b3d4-aec716571b21 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9f6fbfc6484cbfb60167b73e87a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53e92891fa74db68db5554878af0adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:03.775106 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-02868975-ef65-46ae-b3d4-aec716571b21 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] 10.222.0.42 "GET /compute/v2.1/servers/8d1b907b-f4d6-42b7-8ace-4541cac25828" status: 200 len: 1314 microversion: 2.1 time: 0.829545 Oct 23 01:39:03.795258 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2832/5777] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:02 2022] GET /compute/v2.1/servers/8d1b907b-f4d6-42b7-8ace-4541cac25828 => generated 1314 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:39:04.098963 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-6c7a4a30-b521-4c53-b4dc-4a0b60f621b2 req-73c65d90-b99a-43f0-aecc-5df8efdddc46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d1b907b-f4d6-42b7-8ace-4541cac25828", "tag": "7db9fe11-1ca3-4c66-9a73-2b4c4d39e0a1"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:39:04.117067 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-6c7a4a30-b521-4c53-b4dc-4a0b60f621b2 req-73c65d90-b99a-43f0-aecc-5df8efdddc46 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:04.117878 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-6c7a4a30-b521-4c53-b4dc-4a0b60f621b2 req-73c65d90-b99a-43f0-aecc-5df8efdddc46 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:04.118574 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-6c7a4a30-b521-4c53-b4dc-4a0b60f621b2 req-73c65d90-b99a-43f0-aecc-5df8efdddc46 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:04.157511 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-6c7a4a30-b521-4c53-b4dc-4a0b60f621b2 req-73c65d90-b99a-43f0-aecc-5df8efdddc46 service nova] Creating event network-changed:7db9fe11-1ca3-4c66-9a73-2b4c4d39e0a1 for instance 8d1b907b-f4d6-42b7-8ace-4541cac25828 on n-h1-master-1 Oct 23 01:39:04.199023 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-6c7a4a30-b521-4c53-b4dc-4a0b60f621b2 req-73c65d90-b99a-43f0-aecc-5df8efdddc46 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101465 Oct 23 01:39:04.202412 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2946/5778] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:39:04.584488 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0e2f125e-33ad-4007-a8af-5cac6abd31d6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:04.584488 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0e2f125e-33ad-4007-a8af-5cac6abd31d6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:04.593945 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:04.605809 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0e2f125e-33ad-4007-a8af-5cac6abd31d6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:04.607649 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0e2f125e-33ad-4007-a8af-5cac6abd31d6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:04.609174 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0e2f125e-33ad-4007-a8af-5cac6abd31d6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:04.609761 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0e2f125e-33ad-4007-a8af-5cac6abd31d6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:04.610924 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0e2f125e-33ad-4007-a8af-5cac6abd31d6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:04.612144 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0e2f125e-33ad-4007-a8af-5cac6abd31d6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:04.759212 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8e6c537e-8504-49c3-8cf8-a8a47131b9de tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Action: 'create', calling method: .version_select at 0x7f5cc0b10c10>, body: {"keypair": {"name": "tempest-keypair-1944038034", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2GO89tTjfZZjGWkq4vuITRSp2pVNHyjZY6OMBzNEWndcWuC2+w/lVqbV3QEXnWOWNbW6KisVcycr9FwR/IFYynZC8j0xuBvI+yknTjg3+TeBLccQRVm4AvlyyKGB+lKg=="}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:39:04.809741 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-8e6c537e-8504-49c3-8cf8-a8a47131b9de tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Getting quotas for project a2532e029d7c483bbcf901c75023e59f. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:39:04.827572 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-8e6c537e-8504-49c3-8cf8-a8a47131b9de tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Getting quotas for user 2ceec980f06b45a989a5cd6cbca9d5d1 and project a2532e029d7c483bbcf901c75023e59f. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:39:04.982672 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8e6c537e-8504-49c3-8cf8-a8a47131b9de tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.229180 Oct 23 01:39:04.983609 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2947/5779] 10.222.0.42 () {62 vars in 1200 bytes} [Sun Oct 23 01:39:04 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 231 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 23 01:39:04.988973 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-78c91253-a229-47cf-8805-ad1ec626602b tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:04.989728 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-78c91253-a229-47cf-8805-ad1ec626602b tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] [instance: 8d1b907b-f4d6-42b7-8ace-4541cac25828] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:04.997229 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-78c91253-a229-47cf-8805-ad1ec626602b tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:04.997737 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-78c91253-a229-47cf-8805-ad1ec626602b tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:04.998219 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-78c91253-a229-47cf-8805-ad1ec626602b tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:04.999032 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-78c91253-a229-47cf-8805-ad1ec626602b tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:04.999724 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-78c91253-a229-47cf-8805-ad1ec626602b tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:05.000163 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-78c91253-a229-47cf-8805-ad1ec626602b tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:05.663104 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=10 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:05.846736 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0e2f125e-33ad-4007-a8af-5cac6abd31d6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:05.848698 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-78c91253-a229-47cf-8805-ad1ec626602b tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9f6fbfc6484cbfb60167b73e87a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53e92891fa74db68db5554878af0adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:05.864672 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-78c91253-a229-47cf-8805-ad1ec626602b tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] 10.222.0.42 "GET /compute/v2.1/servers/8d1b907b-f4d6-42b7-8ace-4541cac25828" status: 200 len: 1314 microversion: 2.1 time: 0.879853 Oct 23 01:39:05.865278 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2948/5780] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:04 2022] GET /compute/v2.1/servers/8d1b907b-f4d6-42b7-8ace-4541cac25828 => generated 1314 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:39:05.892904 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0e2f125e-33ad-4007-a8af-5cac6abd31d6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1679 microversion: 2.1 time: 1.308190 Oct 23 01:39:05.892904 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2833/5781] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:04 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1679 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:39:06.897753 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-afaef35d-36f1-4faa-b58e-bab96d41dd11 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:06.898392 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-afaef35d-36f1-4faa-b58e-bab96d41dd11 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] [instance: 8d1b907b-f4d6-42b7-8ace-4541cac25828] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:06.922217 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-92efd8c2-2715-49e7-afd0-9a895c7bb25b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:06.923588 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-92efd8c2-2715-49e7-afd0-9a895c7bb25b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:06.961644 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-afaef35d-36f1-4faa-b58e-bab96d41dd11 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:06.962194 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-afaef35d-36f1-4faa-b58e-bab96d41dd11 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:06.962638 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-afaef35d-36f1-4faa-b58e-bab96d41dd11 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:06.963354 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-afaef35d-36f1-4faa-b58e-bab96d41dd11 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:06.963816 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-afaef35d-36f1-4faa-b58e-bab96d41dd11 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:06.964245 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-afaef35d-36f1-4faa-b58e-bab96d41dd11 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:06.965243 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-92efd8c2-2715-49e7-afd0-9a895c7bb25b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:06.970745 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-92efd8c2-2715-49e7-afd0-9a895c7bb25b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:06.974340 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-92efd8c2-2715-49e7-afd0-9a895c7bb25b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:06.978561 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-92efd8c2-2715-49e7-afd0-9a895c7bb25b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:06.979631 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-92efd8c2-2715-49e7-afd0-9a895c7bb25b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:06.980945 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-92efd8c2-2715-49e7-afd0-9a895c7bb25b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:07.062345 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:07.407699 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-92efd8c2-2715-49e7-afd0-9a895c7bb25b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:07.419103 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-92efd8c2-2715-49e7-afd0-9a895c7bb25b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1656 microversion: 2.1 time: 0.504866 Oct 23 01:39:07.420150 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2834/5782] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:06 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1656 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:39:07.448974 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-951b25aa-fb11-4741-8bb1-dce971cce327 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:39:07.459578 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-951b25aa-fb11-4741-8bb1-dce971cce327 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:07.464930 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-951b25aa-fb11-4741-8bb1-dce971cce327 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:07.465837 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-951b25aa-fb11-4741-8bb1-dce971cce327 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:07.545787 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-951b25aa-fb11-4741-8bb1-dce971cce327 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Going to try to start instance {{(pid=120945) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 23 01:39:07.775719 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-afaef35d-36f1-4faa-b58e-bab96d41dd11 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9f6fbfc6484cbfb60167b73e87a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53e92891fa74db68db5554878af0adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:07.788416 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-afaef35d-36f1-4faa-b58e-bab96d41dd11 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] 10.222.0.42 "GET /compute/v2.1/servers/8d1b907b-f4d6-42b7-8ace-4541cac25828" status: 200 len: 1314 microversion: 2.1 time: 0.898843 Oct 23 01:39:07.789332 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2949/5783] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:06 2022] GET /compute/v2.1/servers/8d1b907b-f4d6-42b7-8ace-4541cac25828 => generated 1314 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:39:07.868055 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-951b25aa-fb11-4741-8bb1-dce971cce327 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "POST /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98/action" status: 202 len: 0 microversion: 2.1 time: 0.423455 Oct 23 01:39:07.872675 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2835/5784] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:39:07 2022] POST /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98/action => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:39:07.879919 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2d12c884-2739-4cae-b22b-014edacbea7a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:07.881852 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2d12c884-2739-4cae-b22b-014edacbea7a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:07.897332 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2d12c884-2739-4cae-b22b-014edacbea7a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:07.901804 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2d12c884-2739-4cae-b22b-014edacbea7a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:07.903551 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2d12c884-2739-4cae-b22b-014edacbea7a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:07.904702 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2d12c884-2739-4cae-b22b-014edacbea7a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:07.906565 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2d12c884-2739-4cae-b22b-014edacbea7a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:07.908953 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2d12c884-2739-4cae-b22b-014edacbea7a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:08.780914 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2d12c884-2739-4cae-b22b-014edacbea7a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:08.815704 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2d12c884-2739-4cae-b22b-014edacbea7a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1665 microversion: 2.1 time: 0.937340 Oct 23 01:39:08.817324 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-17ef2bc0-f91c-4f57-9229-ce4d13d065ad tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:08.818068 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-17ef2bc0-f91c-4f57-9229-ce4d13d065ad tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] [instance: 8d1b907b-f4d6-42b7-8ace-4541cac25828] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:08.819319 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2950/5785] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:07 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1665 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:39:08.838669 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-17ef2bc0-f91c-4f57-9229-ce4d13d065ad tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:08.841144 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-17ef2bc0-f91c-4f57-9229-ce4d13d065ad tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:08.842424 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-17ef2bc0-f91c-4f57-9229-ce4d13d065ad tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:08.845559 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-17ef2bc0-f91c-4f57-9229-ce4d13d065ad tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:08.848767 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-17ef2bc0-f91c-4f57-9229-ce4d13d065ad tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:08.850482 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-17ef2bc0-f91c-4f57-9229-ce4d13d065ad tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:09.102055 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-17ef2bc0-f91c-4f57-9229-ce4d13d065ad tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9f6fbfc6484cbfb60167b73e87a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53e92891fa74db68db5554878af0adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:09.140869 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-17ef2bc0-f91c-4f57-9229-ce4d13d065ad tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] 10.222.0.42 "GET /compute/v2.1/servers/8d1b907b-f4d6-42b7-8ace-4541cac25828" status: 200 len: 1314 microversion: 2.1 time: 0.321900 Oct 23 01:39:09.142463 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2836/5786] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:08 2022] GET /compute/v2.1/servers/8d1b907b-f4d6-42b7-8ace-4541cac25828 => generated 1314 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:39:09.846143 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-29dcb1b4-b445-45a6-b13c-85dc4a5a6e7e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:09.847729 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-29dcb1b4-b445-45a6-b13c-85dc4a5a6e7e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:09.868441 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-29dcb1b4-b445-45a6-b13c-85dc4a5a6e7e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:09.870506 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-29dcb1b4-b445-45a6-b13c-85dc4a5a6e7e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:09.870964 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-29dcb1b4-b445-45a6-b13c-85dc4a5a6e7e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:09.871712 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-29dcb1b4-b445-45a6-b13c-85dc4a5a6e7e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:09.872174 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-29dcb1b4-b445-45a6-b13c-85dc4a5a6e7e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:09.872607 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-29dcb1b4-b445-45a6-b13c-85dc4a5a6e7e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:10.170925 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cb6cee46-a1ca-487c-a628-9f9b3de75590 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:10.172697 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cb6cee46-a1ca-487c-a628-9f9b3de75590 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] [instance: 8d1b907b-f4d6-42b7-8ace-4541cac25828] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:10.185540 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb6cee46-a1ca-487c-a628-9f9b3de75590 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:10.193602 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb6cee46-a1ca-487c-a628-9f9b3de75590 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:10.196858 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb6cee46-a1ca-487c-a628-9f9b3de75590 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:10.199410 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb6cee46-a1ca-487c-a628-9f9b3de75590 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:10.206792 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb6cee46-a1ca-487c-a628-9f9b3de75590 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:10.207880 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb6cee46-a1ca-487c-a628-9f9b3de75590 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:10.591555 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-29dcb1b4-b445-45a6-b13c-85dc4a5a6e7e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:10.614436 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-29dcb1b4-b445-45a6-b13c-85dc4a5a6e7e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1665 microversion: 2.1 time: 0.765168 Oct 23 01:39:10.617266 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2951/5787] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:09 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1665 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:39:10.740696 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cb6cee46-a1ca-487c-a628-9f9b3de75590 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9f6fbfc6484cbfb60167b73e87a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53e92891fa74db68db5554878af0adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:10.777808 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cb6cee46-a1ca-487c-a628-9f9b3de75590 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] 10.222.0.42 "GET /compute/v2.1/servers/8d1b907b-f4d6-42b7-8ace-4541cac25828" status: 200 len: 1314 microversion: 2.1 time: 0.607670 Oct 23 01:39:10.784603 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2837/5788] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:10 2022] GET /compute/v2.1/servers/8d1b907b-f4d6-42b7-8ace-4541cac25828 => generated 1314 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:39:11.663735 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3125d5c3-34e5-4c65-83e8-6b4c0d176238 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:11.667446 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3125d5c3-34e5-4c65-83e8-6b4c0d176238 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:11.700932 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3125d5c3-34e5-4c65-83e8-6b4c0d176238 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:11.700932 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3125d5c3-34e5-4c65-83e8-6b4c0d176238 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:11.701755 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3125d5c3-34e5-4c65-83e8-6b4c0d176238 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:11.704827 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3125d5c3-34e5-4c65-83e8-6b4c0d176238 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:11.710468 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3125d5c3-34e5-4c65-83e8-6b4c0d176238 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:11.711580 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3125d5c3-34e5-4c65-83e8-6b4c0d176238 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:11.725679 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=100 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:11.810667 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e3c86060-06fa-45ca-bb84-7672d32a04cf tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:11.811464 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e3c86060-06fa-45ca-bb84-7672d32a04cf tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] [instance: 8d1b907b-f4d6-42b7-8ace-4541cac25828] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:11.825584 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e3c86060-06fa-45ca-bb84-7672d32a04cf tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:11.834714 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e3c86060-06fa-45ca-bb84-7672d32a04cf tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:11.835707 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e3c86060-06fa-45ca-bb84-7672d32a04cf tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:11.841800 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e3c86060-06fa-45ca-bb84-7672d32a04cf tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:11.841800 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e3c86060-06fa-45ca-bb84-7672d32a04cf tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:11.841800 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e3c86060-06fa-45ca-bb84-7672d32a04cf tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:12.862654 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e3c86060-06fa-45ca-bb84-7672d32a04cf tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9f6fbfc6484cbfb60167b73e87a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53e92891fa74db68db5554878af0adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:12.874698 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e3c86060-06fa-45ca-bb84-7672d32a04cf tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] 10.222.0.42 "GET /compute/v2.1/servers/8d1b907b-f4d6-42b7-8ace-4541cac25828" status: 200 len: 1314 microversion: 2.1 time: 1.068041 Oct 23 01:39:12.888272 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2838/5789] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:11 2022] GET /compute/v2.1/servers/8d1b907b-f4d6-42b7-8ace-4541cac25828 => generated 1314 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:39:12.888272 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-d6d35709-0261-4414-8a6a-6d9f159f7f7e req-2c3ff023-301e-4f69-86ea-2e0636b36978 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d1b907b-f4d6-42b7-8ace-4541cac25828", "name": "network-vif-plugged", "status": "completed", "tag": "7db9fe11-1ca3-4c66-9a73-2b4c4d39e0a1"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:39:12.924924 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-d6d35709-0261-4414-8a6a-6d9f159f7f7e req-2c3ff023-301e-4f69-86ea-2e0636b36978 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:12.927577 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-d6d35709-0261-4414-8a6a-6d9f159f7f7e req-2c3ff023-301e-4f69-86ea-2e0636b36978 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:12.927577 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-d6d35709-0261-4414-8a6a-6d9f159f7f7e req-2c3ff023-301e-4f69-86ea-2e0636b36978 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:12.944119 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3125d5c3-34e5-4c65-83e8-6b4c0d176238 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:12.953162 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-d6d35709-0261-4414-8a6a-6d9f159f7f7e req-2c3ff023-301e-4f69-86ea-2e0636b36978 service nova] Creating event network-vif-plugged:7db9fe11-1ca3-4c66-9a73-2b4c4d39e0a1 for instance 8d1b907b-f4d6-42b7-8ace-4541cac25828 on n-h1-master-1 Oct 23 01:39:12.960187 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3125d5c3-34e5-4c65-83e8-6b4c0d176238 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1665 microversion: 2.1 time: 1.304820 Oct 23 01:39:12.961378 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2952/5790] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:11 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1665 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:39:12.973699 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-d6d35709-0261-4414-8a6a-6d9f159f7f7e req-2c3ff023-301e-4f69-86ea-2e0636b36978 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097110 Oct 23 01:39:12.974590 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2839/5791] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:39:13.008429 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-edb5a851-fb02-4068-9111-a3d9f031cbcc tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1635252606", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "3f171e8d-6609-4ef4-95d6-8df43de98934"}, {"port": "fec59d18-4586-4075-a7ad-b238f66cb30f", "tag": "port-1"}, {"port": "58e7a908-4248-4827-9552-0efabdaaf107", "tag": "port-2"}, {"uuid": "44782758-9ae8-47be-ab8b-440067ece722", "tag": "net-1"}, {"uuid": "44782758-9ae8-47be-ab8b-440067ece722"}, {"uuid": "5c76af43-404c-447a-a238-f938d5b1c476", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "5c76af43-404c-447a-a238-f938d5b1c476", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "5ea96173-047c-403d-b616-8c266bf6962c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "5f3086c2-b042-489c-b391-e617d0d94b08", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "48d14bab-4d06-47b4-bae8-902f48277f3a", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--131514551"}], "key_name": "tempest-keypair-1944038034", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:39:13.164675 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-edb5a851-fb02-4068-9111-a3d9f031cbcc tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] validate_networks() for [('3f171e8d-6609-4ef4-95d6-8df43de98934', None, None, None, None, None), (None, None, 'fec59d18-4586-4075-a7ad-b238f66cb30f', None, None, None), (None, None, '58e7a908-4248-4827-9552-0efabdaaf107', None, None, None), ('44782758-9ae8-47be-ab8b-440067ece722', None, None, None, None, None), ('44782758-9ae8-47be-ab8b-440067ece722', None, None, None, None, None), ('5c76af43-404c-447a-a238-f938d5b1c476', '10.2.2.100', None, None, None, None), ('5c76af43-404c-447a-a238-f938d5b1c476', '10.2.2.200', None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:39:13.907120 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f493d686-1067-418b-ba90-96e7da45c87a tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:13.909228 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f493d686-1067-418b-ba90-96e7da45c87a tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] [instance: 8d1b907b-f4d6-42b7-8ace-4541cac25828] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:13.927937 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f493d686-1067-418b-ba90-96e7da45c87a tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:13.931211 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f493d686-1067-418b-ba90-96e7da45c87a tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:13.933744 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f493d686-1067-418b-ba90-96e7da45c87a tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:13.933744 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f493d686-1067-418b-ba90-96e7da45c87a tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:13.935765 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f493d686-1067-418b-ba90-96e7da45c87a tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:13.937171 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f493d686-1067-418b-ba90-96e7da45c87a tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:14.452338 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f493d686-1067-418b-ba90-96e7da45c87a tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9f6fbfc6484cbfb60167b73e87a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53e92891fa74db68db5554878af0adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:14.461456 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f493d686-1067-418b-ba90-96e7da45c87a tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] 10.222.0.42 "GET /compute/v2.1/servers/8d1b907b-f4d6-42b7-8ace-4541cac25828" status: 200 len: 1314 microversion: 2.1 time: 0.558579 Oct 23 01:39:14.461954 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2840/5792] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:13 2022] GET /compute/v2.1/servers/8d1b907b-f4d6-42b7-8ace-4541cac25828 => generated 1314 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:39:14.482578 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2e834e70-4595-4c47-8dc3-06de6b3c8dfa tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:14.483530 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2e834e70-4595-4c47-8dc3-06de6b3c8dfa tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:14.499937 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2e834e70-4595-4c47-8dc3-06de6b3c8dfa tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:14.504777 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2e834e70-4595-4c47-8dc3-06de6b3c8dfa tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:14.506232 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2e834e70-4595-4c47-8dc3-06de6b3c8dfa tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:14.507151 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2e834e70-4595-4c47-8dc3-06de6b3c8dfa tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:14.509267 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2e834e70-4595-4c47-8dc3-06de6b3c8dfa tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:14.510378 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2e834e70-4595-4c47-8dc3-06de6b3c8dfa tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:14.848757 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=4 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:15.346919 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2e834e70-4595-4c47-8dc3-06de6b3c8dfa tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:15.357782 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2e834e70-4595-4c47-8dc3-06de6b3c8dfa tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1669 microversion: 2.1 time: 0.890303 Oct 23 01:39:15.367819 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2841/5793] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:14 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1669 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:39:15.393397 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7b79802d-3f05-4223-a6b1-236e83740b1d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:15.396581 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7b79802d-3f05-4223-a6b1-236e83740b1d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:15.403544 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b79802d-3f05-4223-a6b1-236e83740b1d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:15.404671 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b79802d-3f05-4223-a6b1-236e83740b1d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:15.405493 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b79802d-3f05-4223-a6b1-236e83740b1d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:15.406450 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b79802d-3f05-4223-a6b1-236e83740b1d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:15.407167 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b79802d-3f05-4223-a6b1-236e83740b1d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:15.411944 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b79802d-3f05-4223-a6b1-236e83740b1d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:15.948559 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7b79802d-3f05-4223-a6b1-236e83740b1d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:15.965891 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7b79802d-3f05-4223-a6b1-236e83740b1d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1669 microversion: 2.1 time: 0.582113 Oct 23 01:39:15.973194 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2842/5794] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:15 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1669 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:39:15.989726 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-87ae2dca-66bc-44ec-a3ab-195b5fba9983 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:15.990654 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-87ae2dca-66bc-44ec-a3ab-195b5fba9983 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] [instance: 8d1b907b-f4d6-42b7-8ace-4541cac25828] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:16.008781 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-87ae2dca-66bc-44ec-a3ab-195b5fba9983 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:16.010770 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-87ae2dca-66bc-44ec-a3ab-195b5fba9983 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:16.015229 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-87ae2dca-66bc-44ec-a3ab-195b5fba9983 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:16.016209 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-87ae2dca-66bc-44ec-a3ab-195b5fba9983 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:16.018683 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-87ae2dca-66bc-44ec-a3ab-195b5fba9983 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:16.019300 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-87ae2dca-66bc-44ec-a3ab-195b5fba9983 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:16.490227 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-87ae2dca-66bc-44ec-a3ab-195b5fba9983 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9f6fbfc6484cbfb60167b73e87a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53e92891fa74db68db5554878af0adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:16.501233 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-87ae2dca-66bc-44ec-a3ab-195b5fba9983 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] 10.222.0.42 "GET /compute/v2.1/servers/8d1b907b-f4d6-42b7-8ace-4541cac25828" status: 200 len: 1498 microversion: 2.1 time: 0.526611 Oct 23 01:39:16.502360 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2843/5795] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:15 2022] GET /compute/v2.1/servers/8d1b907b-f4d6-42b7-8ace-4541cac25828 => generated 1498 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:39:16.510058 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1d86365e-e78b-4b91-9255-2e48f29bc4c1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:16.510880 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1d86365e-e78b-4b91-9255-2e48f29bc4c1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:16.520365 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1d86365e-e78b-4b91-9255-2e48f29bc4c1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:16.521065 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1d86365e-e78b-4b91-9255-2e48f29bc4c1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:16.521935 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1d86365e-e78b-4b91-9255-2e48f29bc4c1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:16.523484 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1d86365e-e78b-4b91-9255-2e48f29bc4c1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:16.524645 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1d86365e-e78b-4b91-9255-2e48f29bc4c1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:16.525902 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1d86365e-e78b-4b91-9255-2e48f29bc4c1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:16.994527 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1d86365e-e78b-4b91-9255-2e48f29bc4c1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:17.006431 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1d86365e-e78b-4b91-9255-2e48f29bc4c1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1669 microversion: 2.1 time: 0.502676 Oct 23 01:39:17.007025 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2844/5796] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:16 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1669 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:39:17.036360 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b57e2a24-7578-4dca-a500-6bfd6a57c76d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:17.042763 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b57e2a24-7578-4dca-a500-6bfd6a57c76d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:17.051840 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b57e2a24-7578-4dca-a500-6bfd6a57c76d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:17.052351 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b57e2a24-7578-4dca-a500-6bfd6a57c76d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:17.052798 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b57e2a24-7578-4dca-a500-6bfd6a57c76d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:17.053525 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b57e2a24-7578-4dca-a500-6bfd6a57c76d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:17.053999 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b57e2a24-7578-4dca-a500-6bfd6a57c76d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:17.056878 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b57e2a24-7578-4dca-a500-6bfd6a57c76d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:17.379774 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b57e2a24-7578-4dca-a500-6bfd6a57c76d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:17.388537 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b57e2a24-7578-4dca-a500-6bfd6a57c76d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1669 microversion: 2.1 time: 0.357401 Oct 23 01:39:17.394409 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2845/5797] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:17 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1669 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:39:17.421556 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1b263df2-3cd8-45c7-a339-cda9d35b5460 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:17.422659 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1b263df2-3cd8-45c7-a339-cda9d35b5460 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:17.429736 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b263df2-3cd8-45c7-a339-cda9d35b5460 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:17.430503 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b263df2-3cd8-45c7-a339-cda9d35b5460 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:17.431110 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b263df2-3cd8-45c7-a339-cda9d35b5460 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:17.431980 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b263df2-3cd8-45c7-a339-cda9d35b5460 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:17.432734 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b263df2-3cd8-45c7-a339-cda9d35b5460 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:17.433356 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b263df2-3cd8-45c7-a339-cda9d35b5460 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:17.887232 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1b263df2-3cd8-45c7-a339-cda9d35b5460 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:17.904247 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1b263df2-3cd8-45c7-a339-cda9d35b5460 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1669 microversion: 2.1 time: 0.488903 Oct 23 01:39:17.906187 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2846/5798] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:17 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1669 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:39:17.935037 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-43bb4751-cd11-424f-98db-8234491cc283 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:39:17.935702 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-43bb4751-cd11-424f-98db-8234491cc283 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:17.946340 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-43bb4751-cd11-424f-98db-8234491cc283 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:17.949477 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-43bb4751-cd11-424f-98db-8234491cc283 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:17.949477 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-43bb4751-cd11-424f-98db-8234491cc283 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:17.949477 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-43bb4751-cd11-424f-98db-8234491cc283 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:17.949477 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-43bb4751-cd11-424f-98db-8234491cc283 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:17.949477 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-43bb4751-cd11-424f-98db-8234491cc283 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:17.978694 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-43bb4751-cd11-424f-98db-8234491cc283 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lazy-loading 'flavor' on Instance uuid fa616812-f379-45fb-8e7e-fefe7570dc98 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:39:18.283133 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-43bb4751-cd11-424f-98db-8234491cc283 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "POST /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98/action" status: 202 len: 0 microversion: 2.1 time: 0.356857 Oct 23 01:39:18.287490 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2847/5799] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:39:17 2022] POST /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98/action => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:39:18.303150 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-985782c9-f3c3-40d1-b974-33cd85811d1c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:18.311106 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-985782c9-f3c3-40d1-b974-33cd85811d1c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:18.328249 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-985782c9-f3c3-40d1-b974-33cd85811d1c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:18.330677 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-985782c9-f3c3-40d1-b974-33cd85811d1c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:18.332443 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-985782c9-f3c3-40d1-b974-33cd85811d1c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:18.334805 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-985782c9-f3c3-40d1-b974-33cd85811d1c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:18.335587 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-985782c9-f3c3-40d1-b974-33cd85811d1c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:18.344131 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-985782c9-f3c3-40d1-b974-33cd85811d1c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:18.626452 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-edb5a851-fb02-4068-9111-a3d9f031cbcc tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:39:18.627508 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-edb5a851-fb02-4068-9111-a3d9f031cbcc tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:39:18.628083 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-edb5a851-fb02-4068-9111-a3d9f031cbcc tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:39:18.628513 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-edb5a851-fb02-4068-9111-a3d9f031cbcc tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:39:18.628944 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-edb5a851-fb02-4068-9111-a3d9f031cbcc tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:39:18.639105 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-edb5a851-fb02-4068-9111-a3d9f031cbcc tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:18.639885 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-edb5a851-fb02-4068-9111-a3d9f031cbcc tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:18.644709 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-edb5a851-fb02-4068-9111-a3d9f031cbcc tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:18.644709 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-edb5a851-fb02-4068-9111-a3d9f031cbcc tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:18.644709 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-edb5a851-fb02-4068-9111-a3d9f031cbcc tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:18.644709 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-edb5a851-fb02-4068-9111-a3d9f031cbcc tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:18.720526 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-edb5a851-fb02-4068-9111-a3d9f031cbcc tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Getting quotas for project a2532e029d7c483bbcf901c75023e59f. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:39:18.739836 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-edb5a851-fb02-4068-9111-a3d9f031cbcc tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Getting quotas for user 2ceec980f06b45a989a5cd6cbca9d5d1 and project a2532e029d7c483bbcf901c75023e59f. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:39:18.810047 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-985782c9-f3c3-40d1-b974-33cd85811d1c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:18.813033 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:18.839454 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-985782c9-f3c3-40d1-b974-33cd85811d1c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1677 microversion: 2.1 time: 0.542560 Oct 23 01:39:18.857550 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2848/5800] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:18 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1677 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:39:19.122862 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-edb5a851-fb02-4068-9111-a3d9f031cbcc tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:39:19.126441 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-edb5a851-fb02-4068-9111-a3d9f031cbcc tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='5ea96173-047c-403d-b616-8c266bf6962c',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='5f3086c2-b042-489c-b391-e617d0d94b08',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='48d14bab-4d06-47b4-bae8-902f48277f3a',volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:39:19.944426 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8386977d-f03d-4b33-b4d7-dd3354547d3b tempest-TestAggregatesBasicOps-789231675 tempest-TestAggregatesBasicOps-789231675-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-845779106", "availability_zone": "foo_zone"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:39:19.955704 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.aggregate [None req-8386977d-f03d-4b33-b4d7-dd3354547d3b tempest-TestAggregatesBasicOps-789231675 tempest-TestAggregatesBasicOps-789231675-project-admin] Generated uuid f6a152f4-469c-4239-8edb-02e2d6fc55bb for aggregate {{(pid=120945) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 23 01:39:19.965665 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:20.074238 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8386977d-f03d-4b33-b4d7-dd3354547d3b tempest-TestAggregatesBasicOps-789231675 tempest-TestAggregatesBasicOps-789231675-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.372514 Oct 23 01:39:20.076029 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2849/5801] 10.222.0.42 () {60 vars in 1164 bytes} [Sun Oct 23 01:39:19 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:39:20.091812 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bed8ea39-0a37-4f40-b8ae-9af41bd54bdc tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:20.092569 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-bed8ea39-0a37-4f40-b8ae-9af41bd54bdc tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:20.101543 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bed8ea39-0a37-4f40-b8ae-9af41bd54bdc tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:20.102182 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bed8ea39-0a37-4f40-b8ae-9af41bd54bdc tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:20.102731 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bed8ea39-0a37-4f40-b8ae-9af41bd54bdc tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:20.103571 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bed8ea39-0a37-4f40-b8ae-9af41bd54bdc tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:20.104098 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bed8ea39-0a37-4f40-b8ae-9af41bd54bdc tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:20.105544 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bed8ea39-0a37-4f40-b8ae-9af41bd54bdc tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:20.327406 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bed8ea39-0a37-4f40-b8ae-9af41bd54bdc tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:20.327937 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-edb5a851-fb02-4068-9111-a3d9f031cbcc tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 7.323009 Oct 23 01:39:20.339458 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2953/5802] 10.222.0.42 () {62 vars in 1189 bytes} [Sun Oct 23 01:39:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 7335 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 23 01:39:20.352539 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6b73f36c-df59-42ee-b466-0808ec613a4a tempest-TestAggregatesBasicOps-789231675 tempest-TestAggregatesBasicOps-789231675-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:39:20.353679 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bed8ea39-0a37-4f40-b8ae-9af41bd54bdc tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1660 microversion: 2.1 time: 0.274858 Oct 23 01:39:20.354757 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2850/5803] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:20 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1660 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:39:20.378936 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5b7c9cbb-55a9-4e4c-84d0-4cf677f11c46 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:20.380180 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5b7c9cbb-55a9-4e4c-84d0-4cf677f11c46 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:20.518172 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6b73f36c-df59-42ee-b466-0808ec613a4a tempest-TestAggregatesBasicOps-789231675 tempest-TestAggregatesBasicOps-789231675-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.177213 Oct 23 01:39:20.518798 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5b7c9cbb-55a9-4e4c-84d0-4cf677f11c46 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:20.519121 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2954/5804] 10.222.0.42 () {60 vars in 1194 bytes} [Sun Oct 23 01:39:20 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:39:20.534828 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5b7c9cbb-55a9-4e4c-84d0-4cf677f11c46 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:20.536275 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5b7c9cbb-55a9-4e4c-84d0-4cf677f11c46 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:20.537690 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5b7c9cbb-55a9-4e4c-84d0-4cf677f11c46 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1286 microversion: 2.32 time: 0.181603 Oct 23 01:39:20.538282 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2851/5805] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:39:20 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1286 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:39:20.541359 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9bb73ed1-a274-4262-849d-695919dba12b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:39:20.541945 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9bb73ed1-a274-4262-849d-695919dba12b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:20.567255 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9bb73ed1-a274-4262-849d-695919dba12b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:20.568030 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9bb73ed1-a274-4262-849d-695919dba12b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:20.568809 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9bb73ed1-a274-4262-849d-695919dba12b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:20.569692 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9bb73ed1-a274-4262-849d-695919dba12b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:20.570237 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9bb73ed1-a274-4262-849d-695919dba12b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:20.571432 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-52964fe7-ba38-4c5f-8c5e-eded420e1de5 tempest-TestAggregatesBasicOps-789231675 tempest-TestAggregatesBasicOps-789231675-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:20.572088 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9bb73ed1-a274-4262-849d-695919dba12b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:20.584457 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52964fe7-ba38-4c5f-8c5e-eded420e1de5 tempest-TestAggregatesBasicOps-789231675 tempest-TestAggregatesBasicOps-789231675-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:20.585094 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52964fe7-ba38-4c5f-8c5e-eded420e1de5 tempest-TestAggregatesBasicOps-789231675 tempest-TestAggregatesBasicOps-789231675-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:20.588116 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52964fe7-ba38-4c5f-8c5e-eded420e1de5 tempest-TestAggregatesBasicOps-789231675 tempest-TestAggregatesBasicOps-789231675-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:20.589286 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52964fe7-ba38-4c5f-8c5e-eded420e1de5 tempest-TestAggregatesBasicOps-789231675 tempest-TestAggregatesBasicOps-789231675-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:20.592898 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52964fe7-ba38-4c5f-8c5e-eded420e1de5 tempest-TestAggregatesBasicOps-789231675 tempest-TestAggregatesBasicOps-789231675-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:20.593550 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52964fe7-ba38-4c5f-8c5e-eded420e1de5 tempest-TestAggregatesBasicOps-789231675 tempest-TestAggregatesBasicOps-789231675-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:20.662524 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-52964fe7-ba38-4c5f-8c5e-eded420e1de5 tempest-TestAggregatesBasicOps-789231675 tempest-TestAggregatesBasicOps-789231675-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.122929 Oct 23 01:39:20.674571 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2852/5806] 10.222.0.42 () {58 vars in 1176 bytes} [Sun Oct 23 01:39:20 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:39:20.685135 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f2e87a5b-98f2-400d-a840-93967231d15d tempest-TestAggregatesBasicOps-789231675 tempest-TestAggregatesBasicOps-789231675-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:20.701348 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f2e87a5b-98f2-400d-a840-93967231d15d tempest-TestAggregatesBasicOps-789231675 tempest-TestAggregatesBasicOps-789231675-project-admin] 10.222.0.42 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.024471 Oct 23 01:39:20.702059 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2853/5807] 10.222.0.42 () {58 vars in 1143 bytes} [Sun Oct 23 01:39:20 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:39:20.716919 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2894bbb7-63dc-4e91-a26a-055eceb1e729 tempest-TestAggregatesBasicOps-789231675 tempest-TestAggregatesBasicOps-789231675-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:39:20.731760 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2894bbb7-63dc-4e91-a26a-055eceb1e729 tempest-TestAggregatesBasicOps-789231675 tempest-TestAggregatesBasicOps-789231675-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:20.733112 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2894bbb7-63dc-4e91-a26a-055eceb1e729 tempest-TestAggregatesBasicOps-789231675 tempest-TestAggregatesBasicOps-789231675-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:20.737122 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2894bbb7-63dc-4e91-a26a-055eceb1e729 tempest-TestAggregatesBasicOps-789231675 tempest-TestAggregatesBasicOps-789231675-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:20.887751 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9bb73ed1-a274-4262-849d-695919dba12b tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "POST /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98/action" status: 202 len: 0 microversion: 2.1 time: 0.366692 Oct 23 01:39:20.888406 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2955/5808] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:39:20 2022] POST /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98/action => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:39:20.901189 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9687a913-c9e8-4200-a7c7-528e3aceb087 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:20.902387 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9687a913-c9e8-4200-a7c7-528e3aceb087 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:20.926718 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9687a913-c9e8-4200-a7c7-528e3aceb087 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:20.927204 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9687a913-c9e8-4200-a7c7-528e3aceb087 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:20.927654 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9687a913-c9e8-4200-a7c7-528e3aceb087 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:20.928366 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9687a913-c9e8-4200-a7c7-528e3aceb087 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:20.938702 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9687a913-c9e8-4200-a7c7-528e3aceb087 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:20.942347 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9687a913-c9e8-4200-a7c7-528e3aceb087 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:21.160068 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2894bbb7-63dc-4e91-a26a-055eceb1e729 tempest-TestAggregatesBasicOps-789231675 tempest-TestAggregatesBasicOps-789231675-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.439604 Oct 23 01:39:21.160743 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2854/5809] 10.222.0.42 () {60 vars in 1194 bytes} [Sun Oct 23 01:39:20 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:39:21.214382 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-90ef0122-3271-4357-b57b-c2ff11e781a1 tempest-TestAggregatesBasicOps-789231675 tempest-TestAggregatesBasicOps-789231675-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:21.249693 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-90ef0122-3271-4357-b57b-c2ff11e781a1 tempest-TestAggregatesBasicOps-789231675 tempest-TestAggregatesBasicOps-789231675-project-admin] 10.222.0.42 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.073423 Oct 23 01:39:21.251921 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2855/5810] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Oct 23 01:39:21 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:39:21.279332 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0666ecf3-9612-4628-8410-a207bb6362f2 tempest-TestAggregatesBasicOps-789231675 tempest-TestAggregatesBasicOps-789231675-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1596413142", "availability_zone": "foo_zone"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:39:21.305799 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9687a913-c9e8-4200-a7c7-528e3aceb087 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:21.315430 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9687a913-c9e8-4200-a7c7-528e3aceb087 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1666 microversion: 2.1 time: 0.422657 Oct 23 01:39:21.320017 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2956/5811] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:20 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1666 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:39:21.464835 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0666ecf3-9612-4628-8410-a207bb6362f2 tempest-TestAggregatesBasicOps-789231675 tempest-TestAggregatesBasicOps-789231675-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.202816 Oct 23 01:39:21.466615 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2856/5812] 10.222.0.42 () {60 vars in 1173 bytes} [Sun Oct 23 01:39:21 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:39:21.479046 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-069a7415-cd7d-4455-ba2a-38da347fd993 tempest-TestAggregatesBasicOps-789231675 tempest-TestAggregatesBasicOps-789231675-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:39:21.585879 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0b2a50a8-1773-4307-a775-ed9068f70a69 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:21.585879 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0b2a50a8-1773-4307-a775-ed9068f70a69 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:21.679407 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-069a7415-cd7d-4455-ba2a-38da347fd993 tempest-TestAggregatesBasicOps-789231675 tempest-TestAggregatesBasicOps-789231675-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.204385 Oct 23 01:39:21.680792 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2957/5813] 10.222.0.42 () {60 vars in 1194 bytes} [Sun Oct 23 01:39:21 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:39:21.691009 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0b2a50a8-1773-4307-a775-ed9068f70a69 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:21.695075 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f305070d-f0ad-4294-9d40-f53465c67190 tempest-TestAggregatesBasicOps-789231675 tempest-TestAggregatesBasicOps-789231675-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:21.700013 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0b2a50a8-1773-4307-a775-ed9068f70a69 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:21.706267 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0b2a50a8-1773-4307-a775-ed9068f70a69 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:21.709398 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0b2a50a8-1773-4307-a775-ed9068f70a69 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1286 microversion: 2.32 time: 0.136460 Oct 23 01:39:21.713254 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2857/5814] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:39:21 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1286 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:39:21.731718 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f305070d-f0ad-4294-9d40-f53465c67190 tempest-TestAggregatesBasicOps-789231675 tempest-TestAggregatesBasicOps-789231675-project-admin] 10.222.0.42 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.043764 Oct 23 01:39:21.733110 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2958/5815] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Oct 23 01:39:21 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:39:21.745275 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1d6e4e8f-a059-42d3-adc1-383dcc61a7e8 tempest-TestAggregatesBasicOps-789231675 tempest-TestAggregatesBasicOps-789231675-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:39:21.759753 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1d6e4e8f-a059-42d3-adc1-383dcc61a7e8 tempest-TestAggregatesBasicOps-789231675 tempest-TestAggregatesBasicOps-789231675-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:21.761049 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1d6e4e8f-a059-42d3-adc1-383dcc61a7e8 tempest-TestAggregatesBasicOps-789231675 tempest-TestAggregatesBasicOps-789231675-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:21.761640 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1d6e4e8f-a059-42d3-adc1-383dcc61a7e8 tempest-TestAggregatesBasicOps-789231675 tempest-TestAggregatesBasicOps-789231675-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:22.138171 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1d6e4e8f-a059-42d3-adc1-383dcc61a7e8 tempest-TestAggregatesBasicOps-789231675 tempest-TestAggregatesBasicOps-789231675-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.396590 Oct 23 01:39:22.141415 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2858/5816] 10.222.0.42 () {60 vars in 1194 bytes} [Sun Oct 23 01:39:21 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:39:22.153543 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d7adab0d-ca15-447d-b2cd-121c5b2880b9 tempest-TestAggregatesBasicOps-789231675 tempest-TestAggregatesBasicOps-789231675-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:22.194665 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=6 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:22.270886 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d7adab0d-ca15-447d-b2cd-121c5b2880b9 tempest-TestAggregatesBasicOps-789231675 tempest-TestAggregatesBasicOps-789231675-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.121444 Oct 23 01:39:22.276864 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2959/5817] 10.222.0.42 () {58 vars in 1155 bytes} [Sun Oct 23 01:39:22 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 23 01:39:22.349438 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-946451d9-512a-4af4-bde7-ffdc66aa2b64 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:22.351090 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-946451d9-512a-4af4-bde7-ffdc66aa2b64 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:22.365232 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-946451d9-512a-4af4-bde7-ffdc66aa2b64 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:22.368877 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-946451d9-512a-4af4-bde7-ffdc66aa2b64 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:22.369682 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-946451d9-512a-4af4-bde7-ffdc66aa2b64 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:22.370633 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-946451d9-512a-4af4-bde7-ffdc66aa2b64 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:22.372865 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-946451d9-512a-4af4-bde7-ffdc66aa2b64 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:22.376473 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-946451d9-512a-4af4-bde7-ffdc66aa2b64 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:22.379380 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cd67b1f5-6c73-4e8c-be20-58e8018d0f5c tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:22.380973 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cd67b1f5-6c73-4e8c-be20-58e8018d0f5c tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] [instance: 8d1b907b-f4d6-42b7-8ace-4541cac25828] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:22.406353 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cd67b1f5-6c73-4e8c-be20-58e8018d0f5c tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:22.409963 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cd67b1f5-6c73-4e8c-be20-58e8018d0f5c tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:22.412134 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cd67b1f5-6c73-4e8c-be20-58e8018d0f5c tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:22.412890 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cd67b1f5-6c73-4e8c-be20-58e8018d0f5c tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:22.413359 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cd67b1f5-6c73-4e8c-be20-58e8018d0f5c tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:22.413823 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cd67b1f5-6c73-4e8c-be20-58e8018d0f5c tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:22.520413 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cd67b1f5-6c73-4e8c-be20-58e8018d0f5c tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] [instance: 8d1b907b-f4d6-42b7-8ace-4541cac25828] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:39:22.969873 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cd67b1f5-6c73-4e8c-be20-58e8018d0f5c tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8d1b907b-f4d6-42b7-8ace-4541cac25828" status: 204 len: 0 microversion: 2.1 time: 0.622298 Oct 23 01:39:22.974803 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2859/5818] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:39:22 2022] DELETE /compute/v2.1/servers/8d1b907b-f4d6-42b7-8ace-4541cac25828 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:39:22.981279 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d0175b9e-02dc-48bc-a9f9-b5b4d114f867 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:22.982053 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d0175b9e-02dc-48bc-a9f9-b5b4d114f867 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:23.000070 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0175b9e-02dc-48bc-a9f9-b5b4d114f867 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:23.000596 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0175b9e-02dc-48bc-a9f9-b5b4d114f867 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:23.003836 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0175b9e-02dc-48bc-a9f9-b5b4d114f867 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:23.004890 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0175b9e-02dc-48bc-a9f9-b5b4d114f867 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:23.005763 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0175b9e-02dc-48bc-a9f9-b5b4d114f867 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:23.007306 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0175b9e-02dc-48bc-a9f9-b5b4d114f867 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:23.193112 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d0175b9e-02dc-48bc-a9f9-b5b4d114f867 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:23.214547 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d0175b9e-02dc-48bc-a9f9-b5b4d114f867 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:23.221206 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d0175b9e-02dc-48bc-a9f9-b5b4d114f867 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:23.221206 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d0175b9e-02dc-48bc-a9f9-b5b4d114f867 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1528 microversion: 2.32 time: 0.241833 Oct 23 01:39:23.221206 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2860/5819] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:39:22 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1528 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:39:23.225909 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-38945df8-77cb-4a8a-a3b7-0ad44b4e4067 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:23.226564 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-38945df8-77cb-4a8a-a3b7-0ad44b4e4067 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] [instance: 8d1b907b-f4d6-42b7-8ace-4541cac25828] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:23.242919 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-38945df8-77cb-4a8a-a3b7-0ad44b4e4067 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:23.243617 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-38945df8-77cb-4a8a-a3b7-0ad44b4e4067 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:23.244207 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-38945df8-77cb-4a8a-a3b7-0ad44b4e4067 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:23.245129 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-38945df8-77cb-4a8a-a3b7-0ad44b4e4067 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:23.245737 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-38945df8-77cb-4a8a-a3b7-0ad44b4e4067 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:23.246515 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-38945df8-77cb-4a8a-a3b7-0ad44b4e4067 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:23.441253 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-946451d9-512a-4af4-bde7-ffdc66aa2b64 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:23.451598 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-946451d9-512a-4af4-bde7-ffdc66aa2b64 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1666 microversion: 2.1 time: 1.105628 Oct 23 01:39:23.451598 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2960/5820] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:22 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1666 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:39:23.582486 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-38945df8-77cb-4a8a-a3b7-0ad44b4e4067 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9f6fbfc6484cbfb60167b73e87a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53e92891fa74db68db5554878af0adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:23.598977 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-38945df8-77cb-4a8a-a3b7-0ad44b4e4067 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] 10.222.0.42 "GET /compute/v2.1/servers/8d1b907b-f4d6-42b7-8ace-4541cac25828" status: 200 len: 1504 microversion: 2.1 time: 0.375612 Oct 23 01:39:23.600833 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2861/5821] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:23 2022] GET /compute/v2.1/servers/8d1b907b-f4d6-42b7-8ace-4541cac25828 => generated 1504 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:39:24.257498 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3330901c-09b1-4d2b-b30a-0f575e00f06e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:24.272643 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3330901c-09b1-4d2b-b30a-0f575e00f06e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:24.303446 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3330901c-09b1-4d2b-b30a-0f575e00f06e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:24.303947 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3330901c-09b1-4d2b-b30a-0f575e00f06e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:24.304391 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3330901c-09b1-4d2b-b30a-0f575e00f06e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:24.310084 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3330901c-09b1-4d2b-b30a-0f575e00f06e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:24.315002 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3330901c-09b1-4d2b-b30a-0f575e00f06e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:24.315002 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3330901c-09b1-4d2b-b30a-0f575e00f06e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:24.430423 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3330901c-09b1-4d2b-b30a-0f575e00f06e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:24.455087 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3330901c-09b1-4d2b-b30a-0f575e00f06e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:24.459478 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3330901c-09b1-4d2b-b30a-0f575e00f06e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:24.466144 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3330901c-09b1-4d2b-b30a-0f575e00f06e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1576 microversion: 2.32 time: 0.218275 Oct 23 01:39:24.466144 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2961/5822] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:39:24 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1576 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:39:24.487778 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-691fddcd-b197-423a-b032-3bb0e50bb28f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:24.492716 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-691fddcd-b197-423a-b032-3bb0e50bb28f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:24.496416 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-691fddcd-b197-423a-b032-3bb0e50bb28f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:24.497071 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-691fddcd-b197-423a-b032-3bb0e50bb28f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:24.497612 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-691fddcd-b197-423a-b032-3bb0e50bb28f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:24.498547 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-691fddcd-b197-423a-b032-3bb0e50bb28f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:24.499064 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-691fddcd-b197-423a-b032-3bb0e50bb28f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:24.499771 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-691fddcd-b197-423a-b032-3bb0e50bb28f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:24.624498 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-93494b50-75f6-4ead-8f76-95d3f5e22940 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:24.625139 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-93494b50-75f6-4ead-8f76-95d3f5e22940 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] [instance: 8d1b907b-f4d6-42b7-8ace-4541cac25828] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:24.634483 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-93494b50-75f6-4ead-8f76-95d3f5e22940 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:24.634993 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-93494b50-75f6-4ead-8f76-95d3f5e22940 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:24.637612 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-93494b50-75f6-4ead-8f76-95d3f5e22940 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:24.638384 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-93494b50-75f6-4ead-8f76-95d3f5e22940 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:24.640032 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-93494b50-75f6-4ead-8f76-95d3f5e22940 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:24.641426 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-93494b50-75f6-4ead-8f76-95d3f5e22940 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:24.881826 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-691fddcd-b197-423a-b032-3bb0e50bb28f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:24.908732 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-93494b50-75f6-4ead-8f76-95d3f5e22940 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9f6fbfc6484cbfb60167b73e87a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53e92891fa74db68db5554878af0adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:24.910290 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-691fddcd-b197-423a-b032-3bb0e50bb28f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1666 microversion: 2.1 time: 0.435045 Oct 23 01:39:24.914236 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2862/5823] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:24 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1666 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:39:24.936864 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-93494b50-75f6-4ead-8f76-95d3f5e22940 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] 10.222.0.42 "GET /compute/v2.1/servers/8d1b907b-f4d6-42b7-8ace-4541cac25828" status: 200 len: 1504 microversion: 2.1 time: 0.317550 Oct 23 01:39:24.938143 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2962/5824] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:24 2022] GET /compute/v2.1/servers/8d1b907b-f4d6-42b7-8ace-4541cac25828 => generated 1504 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:39:25.491843 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-09ed35eb-7bf7-4e2f-8f10-d7e954c05b63 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:25.492470 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-09ed35eb-7bf7-4e2f-8f10-d7e954c05b63 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:25.519855 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09ed35eb-7bf7-4e2f-8f10-d7e954c05b63 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:25.523607 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09ed35eb-7bf7-4e2f-8f10-d7e954c05b63 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:25.524152 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09ed35eb-7bf7-4e2f-8f10-d7e954c05b63 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:25.525007 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09ed35eb-7bf7-4e2f-8f10-d7e954c05b63 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:25.525487 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09ed35eb-7bf7-4e2f-8f10-d7e954c05b63 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:25.525915 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09ed35eb-7bf7-4e2f-8f10-d7e954c05b63 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:25.693921 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-09ed35eb-7bf7-4e2f-8f10-d7e954c05b63 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:25.703477 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-09ed35eb-7bf7-4e2f-8f10-d7e954c05b63 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:25.705713 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-09ed35eb-7bf7-4e2f-8f10-d7e954c05b63 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:25.707110 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-09ed35eb-7bf7-4e2f-8f10-d7e954c05b63 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1584 microversion: 2.32 time: 0.219995 Oct 23 01:39:25.708158 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2863/5825] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:39:25 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1584 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:39:25.935232 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ea6e70dd-9d20-46d3-91e8-f3eff0e2d4c5 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:25.942816 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ea6e70dd-9d20-46d3-91e8-f3eff0e2d4c5 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:25.958125 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ea6e70dd-9d20-46d3-91e8-f3eff0e2d4c5 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:25.958667 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ea6e70dd-9d20-46d3-91e8-f3eff0e2d4c5 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:25.965091 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-eea97996-4f71-495d-b786-347d989d28e9 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:25.965767 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-eea97996-4f71-495d-b786-347d989d28e9 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] [instance: 8d1b907b-f4d6-42b7-8ace-4541cac25828] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:25.968090 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ea6e70dd-9d20-46d3-91e8-f3eff0e2d4c5 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:25.972594 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ea6e70dd-9d20-46d3-91e8-f3eff0e2d4c5 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:25.977792 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eea97996-4f71-495d-b786-347d989d28e9 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:25.978317 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ea6e70dd-9d20-46d3-91e8-f3eff0e2d4c5 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:25.979144 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ea6e70dd-9d20-46d3-91e8-f3eff0e2d4c5 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:25.983128 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eea97996-4f71-495d-b786-347d989d28e9 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:25.984868 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eea97996-4f71-495d-b786-347d989d28e9 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:25.986451 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eea97996-4f71-495d-b786-347d989d28e9 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:25.986893 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eea97996-4f71-495d-b786-347d989d28e9 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:25.987329 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eea97996-4f71-495d-b786-347d989d28e9 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:26.436431 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ea6e70dd-9d20-46d3-91e8-f3eff0e2d4c5 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:26.447868 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ea6e70dd-9d20-46d3-91e8-f3eff0e2d4c5 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1669 microversion: 2.1 time: 0.516554 Oct 23 01:39:26.451557 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2963/5826] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:25 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1669 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:39:26.477376 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1dcd0201-c0cf-4697-8a92-4cf900997d09 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:26.478577 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1dcd0201-c0cf-4697-8a92-4cf900997d09 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:26.485510 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1dcd0201-c0cf-4697-8a92-4cf900997d09 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:26.487693 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1dcd0201-c0cf-4697-8a92-4cf900997d09 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:26.488655 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1dcd0201-c0cf-4697-8a92-4cf900997d09 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:26.495071 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1dcd0201-c0cf-4697-8a92-4cf900997d09 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:26.499529 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1dcd0201-c0cf-4697-8a92-4cf900997d09 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:26.502434 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1dcd0201-c0cf-4697-8a92-4cf900997d09 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:26.923123 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-eea97996-4f71-495d-b786-347d989d28e9 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9f6fbfc6484cbfb60167b73e87a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53e92891fa74db68db5554878af0adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:26.934427 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-eea97996-4f71-495d-b786-347d989d28e9 tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] 10.222.0.42 "GET /compute/v2.1/servers/8d1b907b-f4d6-42b7-8ace-4541cac25828" status: 200 len: 1504 microversion: 2.1 time: 0.973358 Oct 23 01:39:26.951202 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2864/5827] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:25 2022] GET /compute/v2.1/servers/8d1b907b-f4d6-42b7-8ace-4541cac25828 => generated 1504 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:39:26.974896 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-751cd188-a9ce-4c32-a157-74e6603c74d3 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:26.975549 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-751cd188-a9ce-4c32-a157-74e6603c74d3 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:26.993117 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-751cd188-a9ce-4c32-a157-74e6603c74d3 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:26.993658 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-751cd188-a9ce-4c32-a157-74e6603c74d3 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:26.994135 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-751cd188-a9ce-4c32-a157-74e6603c74d3 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:26.994849 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-751cd188-a9ce-4c32-a157-74e6603c74d3 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:26.995569 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-751cd188-a9ce-4c32-a157-74e6603c74d3 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:27.001309 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-751cd188-a9ce-4c32-a157-74e6603c74d3 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:27.108712 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1dcd0201-c0cf-4697-8a92-4cf900997d09 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:27.122407 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1dcd0201-c0cf-4697-8a92-4cf900997d09 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1669 microversion: 2.1 time: 0.649212 Oct 23 01:39:27.123838 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2964/5828] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:26 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1669 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:39:27.150537 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-91fd9471-1201-4a4a-8804-48cb20cc5de6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:27.150918 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-91fd9471-1201-4a4a-8804-48cb20cc5de6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 232f6a09-92a9-4e68-93af-404f72ffe620] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:27.165502 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-91fd9471-1201-4a4a-8804-48cb20cc5de6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:27.167260 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-91fd9471-1201-4a4a-8804-48cb20cc5de6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:27.170852 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-91fd9471-1201-4a4a-8804-48cb20cc5de6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:27.170852 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-91fd9471-1201-4a4a-8804-48cb20cc5de6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:27.170852 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-91fd9471-1201-4a4a-8804-48cb20cc5de6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:27.170852 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-91fd9471-1201-4a4a-8804-48cb20cc5de6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:27.205287 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-751cd188-a9ce-4c32-a157-74e6603c74d3 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:27.219383 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-751cd188-a9ce-4c32-a157-74e6603c74d3 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:27.221601 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-751cd188-a9ce-4c32-a157-74e6603c74d3 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:27.222837 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-751cd188-a9ce-4c32-a157-74e6603c74d3 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1594 microversion: 2.32 time: 0.269823 Oct 23 01:39:27.226771 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2865/5829] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:39:26 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1594 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:39:27.252505 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-91fd9471-1201-4a4a-8804-48cb20cc5de6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 232f6a09-92a9-4e68-93af-404f72ffe620] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:39:27.260708 n-d-master-1 devstack@n-api.service[120944]: INFO nova.compute.api [None req-91fd9471-1201-4a4a-8804-48cb20cc5de6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 232f6a09-92a9-4e68-93af-404f72ffe620] Working on deleting snapshot b12c8a2c-a905-491d-b084-f88d5b0a3d77 from shelved instance... Oct 23 01:39:27.275796 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-a3add1fb-f4f4-4ea3-a3c6-4e6ee9f6062d req-92a0bd52-44aa-4daf-9bd8-9d58a69957a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d1b907b-f4d6-42b7-8ace-4541cac25828", "name": "network-vif-deleted", "tag": "7db9fe11-1ca3-4c66-9a73-2b4c4d39e0a1"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:39:27.291374 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-a3add1fb-f4f4-4ea3-a3c6-4e6ee9f6062d req-92a0bd52-44aa-4daf-9bd8-9d58a69957a9 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:27.292193 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-a3add1fb-f4f4-4ea3-a3c6-4e6ee9f6062d req-92a0bd52-44aa-4daf-9bd8-9d58a69957a9 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:27.292824 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-a3add1fb-f4f4-4ea3-a3c6-4e6ee9f6062d req-92a0bd52-44aa-4daf-9bd8-9d58a69957a9 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:27.313454 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-a3add1fb-f4f4-4ea3-a3c6-4e6ee9f6062d req-92a0bd52-44aa-4daf-9bd8-9d58a69957a9 service nova] Creating event network-vif-deleted:7db9fe11-1ca3-4c66-9a73-2b4c4d39e0a1 for instance 8d1b907b-f4d6-42b7-8ace-4541cac25828 on n-h1-master-1 Oct 23 01:39:27.328948 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-a3add1fb-f4f4-4ea3-a3c6-4e6ee9f6062d req-92a0bd52-44aa-4daf-9bd8-9d58a69957a9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057950 Oct 23 01:39:27.335096 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2866/5830] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:39:27.964123 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ddbd6b3a-2aaf-431e-8d21-90673c878efe tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:27.966395 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ddbd6b3a-2aaf-431e-8d21-90673c878efe tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] [instance: 8d1b907b-f4d6-42b7-8ace-4541cac25828] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:27.980499 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ddbd6b3a-2aaf-431e-8d21-90673c878efe tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:27.989094 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ddbd6b3a-2aaf-431e-8d21-90673c878efe tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:27.989094 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ddbd6b3a-2aaf-431e-8d21-90673c878efe tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:27.989094 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ddbd6b3a-2aaf-431e-8d21-90673c878efe tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:27.989094 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ddbd6b3a-2aaf-431e-8d21-90673c878efe tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:27.989094 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ddbd6b3a-2aaf-431e-8d21-90673c878efe tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:28.041759 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ddbd6b3a-2aaf-431e-8d21-90673c878efe tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:28.042433 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ddbd6b3a-2aaf-431e-8d21-90673c878efe tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:28.042974 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ddbd6b3a-2aaf-431e-8d21-90673c878efe tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:28.043538 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-ddbd6b3a-2aaf-431e-8d21-90673c878efe tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lazy-loading 'fault' on Instance uuid 8d1b907b-f4d6-42b7-8ace-4541cac25828 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:39:28.360491 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ddbd6b3a-2aaf-431e-8d21-90673c878efe tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9f6fbfc6484cbfb60167b73e87a768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53e92891fa74db68db5554878af0adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:28.371627 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ddbd6b3a-2aaf-431e-8d21-90673c878efe tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] 10.222.0.42 "GET /compute/v2.1/servers/8d1b907b-f4d6-42b7-8ace-4541cac25828" status: 200 len: 1304 microversion: 2.1 time: 0.411848 Oct 23 01:39:28.378234 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2867/5831] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:27 2022] GET /compute/v2.1/servers/8d1b907b-f4d6-42b7-8ace-4541cac25828 => generated 1304 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:39:28.394130 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c97bd23c-5708-4e56-a2c3-8f989de5c891 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:28.398918 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c97bd23c-5708-4e56-a2c3-8f989de5c891 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:28.407785 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c97bd23c-5708-4e56-a2c3-8f989de5c891 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:28.411097 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c97bd23c-5708-4e56-a2c3-8f989de5c891 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:28.413879 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c97bd23c-5708-4e56-a2c3-8f989de5c891 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:28.414907 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c97bd23c-5708-4e56-a2c3-8f989de5c891 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:28.417234 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c97bd23c-5708-4e56-a2c3-8f989de5c891 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:28.417912 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c97bd23c-5708-4e56-a2c3-8f989de5c891 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:28.652768 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:28.757037 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=6 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:28.875842 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c97bd23c-5708-4e56-a2c3-8f989de5c891 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:28.894518 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c97bd23c-5708-4e56-a2c3-8f989de5c891 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:28.896409 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c97bd23c-5708-4e56-a2c3-8f989de5c891 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:28.899405 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c97bd23c-5708-4e56-a2c3-8f989de5c891 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1661 microversion: 2.32 time: 0.519741 Oct 23 01:39:28.901107 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2868/5832] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:39:28 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1661 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:39:29.379921 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-91fd9471-1201-4a4a-8804-48cb20cc5de6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 232f6a09-92a9-4e68-93af-404f72ffe620] Doing local delete in cell 8efa99f7-1ff1-40c2-a97e-acbc153fb79d(cell1) {{(pid=120944) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 23 01:39:29.382310 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-91fd9471-1201-4a4a-8804-48cb20cc5de6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:29.384178 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-91fd9471-1201-4a4a-8804-48cb20cc5de6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:29.385927 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-91fd9471-1201-4a4a-8804-48cb20cc5de6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:29.390089 n-d-master-1 devstack@n-api.service[120944]: INFO nova.compute.api [None req-91fd9471-1201-4a4a-8804-48cb20cc5de6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 232f6a09-92a9-4e68-93af-404f72ffe620] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 23 01:39:29.403530 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-91fd9471-1201-4a4a-8804-48cb20cc5de6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 232f6a09-92a9-4e68-93af-404f72ffe620] deallocate_for_instance() {{(pid=120944) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 23 01:39:29.403973 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-93e23095-dd00-49a9-9e7c-87f874126bff tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:29.405136 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-93e23095-dd00-49a9-9e7c-87f874126bff tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] [instance: 8d1b907b-f4d6-42b7-8ace-4541cac25828] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:29.434792 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-93e23095-dd00-49a9-9e7c-87f874126bff tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:29.435304 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-93e23095-dd00-49a9-9e7c-87f874126bff tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:29.435749 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-93e23095-dd00-49a9-9e7c-87f874126bff tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:29.436470 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-93e23095-dd00-49a9-9e7c-87f874126bff tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:29.436922 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-93e23095-dd00-49a9-9e7c-87f874126bff tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:29.437345 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-93e23095-dd00-49a9-9e7c-87f874126bff tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:29.460296 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-93e23095-dd00-49a9-9e7c-87f874126bff tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] HTTP exception thrown: Instance 8d1b907b-f4d6-42b7-8ace-4541cac25828 could not be found. Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-93e23095-dd00-49a9-9e7c-87f874126bff tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Request method failure captured: Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/8d1b907b-f4d6-42b7-8ace-4541cac25828 HTTP/1.1 Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJsnrqeZFTwvnCgPdj1acq8baOX2Bs-d-OIDJexbS2A5ZC6DiEpCgKcixcyf8w-nomtiAuEaqG6ispPVzsJpGk6p9MuyVIsMcYL1lFer4NnwrL5CSMKeiaVyph8t8zItlpHIYeiQp9kqVPk74Qxs883WG6DUj8el_dLnMB8dNy51_gU Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: d53e92891fa74db68db5554878af0adf Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-VolumesActionsTest-295086569 Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d53e92891fa74db68db5554878af0adf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d53e92891fa74db68db5554878af0adf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d53e92891fa74db68db5554878af0adf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d53e92891fa74db68db5554878af0adf"}]}] Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-VolumesActionsTest-295086569 Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: d53e92891fa74db68db5554878af0adf Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-VolumesActionsTest-295086569 Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-VolumesActionsTest-295086569-project Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 6e9f6fbfc6484cbfb60167b73e87a768 Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-VolumesActionsTest-295086569-project Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 8d1b907b-f4d6-42b7-8ace-4541cac25828 could not be found. Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '8d1b907b-f4d6-42b7-8ace-4541cac25828'} Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d1b907b-f4d6-42b7-8ace-4541cac25828 could not be found. Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d1b907b-f4d6-42b7-8ace-4541cac25828 could not be found. Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:39:29.461963 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:39:29.467879 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:39:29.467879 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:39:29.467879 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:39:29.467879 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:39:29.467879 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:39:29.467879 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d1b907b-f4d6-42b7-8ace-4541cac25828 could not be found. Oct 23 01:39:29.467879 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:39:29.467879 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-93e23095-dd00-49a9-9e7c-87f874126bff tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] Returning 404 to user: Instance 8d1b907b-f4d6-42b7-8ace-4541cac25828 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:39:29.467879 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-93e23095-dd00-49a9-9e7c-87f874126bff tempest-VolumesActionsTest-295086569 tempest-VolumesActionsTest-295086569-project] 10.222.0.42 "GET /compute/v2.1/servers/8d1b907b-f4d6-42b7-8ace-4541cac25828" status: 404 len: 111 microversion: 2.1 time: 0.065113 Oct 23 01:39:29.467879 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2869/5833] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:29 2022] GET /compute/v2.1/servers/8d1b907b-f4d6-42b7-8ace-4541cac25828 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 01:39:29.931441 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e08ed6b1-8afc-40db-8251-6d155905edfb tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:29.932461 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e08ed6b1-8afc-40db-8251-6d155905edfb tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:29.944433 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e08ed6b1-8afc-40db-8251-6d155905edfb tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:29.945327 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e08ed6b1-8afc-40db-8251-6d155905edfb tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:29.946781 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e08ed6b1-8afc-40db-8251-6d155905edfb tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:29.947772 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e08ed6b1-8afc-40db-8251-6d155905edfb tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:29.948446 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e08ed6b1-8afc-40db-8251-6d155905edfb tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:29.949106 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e08ed6b1-8afc-40db-8251-6d155905edfb tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:30.616039 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:30.814455 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e08ed6b1-8afc-40db-8251-6d155905edfb tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:30.826287 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e08ed6b1-8afc-40db-8251-6d155905edfb tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:30.834087 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e08ed6b1-8afc-40db-8251-6d155905edfb tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:30.835440 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e08ed6b1-8afc-40db-8251-6d155905edfb tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1661 microversion: 2.32 time: 0.910202 Oct 23 01:39:30.836417 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2870/5834] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:39:29 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1661 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:39:31.236917 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0a2e698a-5af3-4f1c-a02e-3669f820a3c8 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:31.237643 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0a2e698a-5af3-4f1c-a02e-3669f820a3c8 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] [instance: bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:31.249488 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0a2e698a-5af3-4f1c-a02e-3669f820a3c8 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:31.258861 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0a2e698a-5af3-4f1c-a02e-3669f820a3c8 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:31.258861 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0a2e698a-5af3-4f1c-a02e-3669f820a3c8 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:31.258861 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0a2e698a-5af3-4f1c-a02e-3669f820a3c8 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:31.264914 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0a2e698a-5af3-4f1c-a02e-3669f820a3c8 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:31.265714 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0a2e698a-5af3-4f1c-a02e-3669f820a3c8 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:31.306832 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0a2e698a-5af3-4f1c-a02e-3669f820a3c8 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] [instance: bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:39:31.344717 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:31.696531 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=4 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:31.731623 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0a2e698a-5af3-4f1c-a02e-3669f820a3c8 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12" status: 204 len: 0 microversion: 2.1 time: 0.874534 Oct 23 01:39:31.732211 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2871/5835] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:39:30 2022] DELETE /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12 => generated 0 bytes in 876 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:39:31.742231 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-2dbd866c-7ffd-4b79-b4fa-0ce5402a30e3 req-3b54bb1e-e707-45d6-8f0d-4bdeff22aa9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "232f6a09-92a9-4e68-93af-404f72ffe620", "name": "network-vif-deleted", "tag": "d907bb94-e15e-405b-ad8a-f9448d3eab65"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:39:31.757000 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-91fd9471-1201-4a4a-8804-48cb20cc5de6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 232f6a09-92a9-4e68-93af-404f72ffe620] Updating instance_info_cache with network_info: [] {{(pid=120944) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 23 01:39:31.773433 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-2dbd866c-7ffd-4b79-b4fa-0ce5402a30e3 req-3b54bb1e-e707-45d6-8f0d-4bdeff22aa9e service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:31.778495 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-2dbd866c-7ffd-4b79-b4fa-0ce5402a30e3 req-3b54bb1e-e707-45d6-8f0d-4bdeff22aa9e service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:31.779569 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-2dbd866c-7ffd-4b79-b4fa-0ce5402a30e3 req-3b54bb1e-e707-45d6-8f0d-4bdeff22aa9e service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:31.832672 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.compute.server_external_events [req-2dbd866c-7ffd-4b79-b4fa-0ce5402a30e3 req-3b54bb1e-e707-45d6-8f0d-4bdeff22aa9e service nova] Unable to find a host for instance 232f6a09-92a9-4e68-93af-404f72ffe620. Dropping event network-vif-deleted {{(pid=120945) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 23 01:39:31.840066 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-2dbd866c-7ffd-4b79-b4fa-0ce5402a30e3 req-3b54bb1e-e707-45d6-8f0d-4bdeff22aa9e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.101723 Oct 23 01:39:31.841178 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2872/5836] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 108 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 23 01:39:31.859586 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-35e6bfd4-55b6-4a9e-a7ed-dd53cf3d4b2f tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:31.859586 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-35e6bfd4-55b6-4a9e-a7ed-dd53cf3d4b2f tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] [instance: bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:31.870385 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-35e6bfd4-55b6-4a9e-a7ed-dd53cf3d4b2f tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:31.874635 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-35e6bfd4-55b6-4a9e-a7ed-dd53cf3d4b2f tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:31.875185 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-35e6bfd4-55b6-4a9e-a7ed-dd53cf3d4b2f tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:31.875989 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-35e6bfd4-55b6-4a9e-a7ed-dd53cf3d4b2f tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:31.876574 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-35e6bfd4-55b6-4a9e-a7ed-dd53cf3d4b2f tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:31.877070 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-35e6bfd4-55b6-4a9e-a7ed-dd53cf3d4b2f tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:32.062221 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-35e6bfd4-55b6-4a9e-a7ed-dd53cf3d4b2f tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1759290b0b4034ad9d312abb95ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4c34c1a48140f8ae5a69fa0abb2bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:32.074967 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-35e6bfd4-55b6-4a9e-a7ed-dd53cf3d4b2f tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] 10.222.0.42 "GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12" status: 200 len: 1732 microversion: 2.1 time: 0.232315 Oct 23 01:39:32.076061 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2873/5837] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:31 2022] GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12 => generated 1732 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:39:32.081137 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-eee12e3f-2e08-4d0d-b03f-0e7ca6000c1e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:32.082032 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-eee12e3f-2e08-4d0d-b03f-0e7ca6000c1e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:32.100498 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:32.108812 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eee12e3f-2e08-4d0d-b03f-0e7ca6000c1e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:32.109703 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eee12e3f-2e08-4d0d-b03f-0e7ca6000c1e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:32.110566 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eee12e3f-2e08-4d0d-b03f-0e7ca6000c1e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:32.112139 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eee12e3f-2e08-4d0d-b03f-0e7ca6000c1e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:32.112876 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eee12e3f-2e08-4d0d-b03f-0e7ca6000c1e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:32.113916 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eee12e3f-2e08-4d0d-b03f-0e7ca6000c1e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:32.425399 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-eee12e3f-2e08-4d0d-b03f-0e7ca6000c1e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:32.435884 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-eee12e3f-2e08-4d0d-b03f-0e7ca6000c1e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:32.444295 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-eee12e3f-2e08-4d0d-b03f-0e7ca6000c1e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:32.446175 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-eee12e3f-2e08-4d0d-b03f-0e7ca6000c1e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1707 microversion: 2.32 time: 0.368864 Oct 23 01:39:32.447646 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2874/5838] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:39:32 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1707 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:39:32.546920 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-91fd9471-1201-4a4a-8804-48cb20cc5de6 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "DELETE /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620" status: 204 len: 0 microversion: 2.1 time: 5.400710 Oct 23 01:39:32.548827 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2965/5839] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:39:27 2022] DELETE /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620 => generated 0 bytes in 5404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:39:32.557187 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c896b33b-87ad-428f-91fd-9fc79932660f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:32.558147 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c896b33b-87ad-428f-91fd-9fc79932660f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 232f6a09-92a9-4e68-93af-404f72ffe620] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:32.566274 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c896b33b-87ad-428f-91fd-9fc79932660f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:32.567306 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c896b33b-87ad-428f-91fd-9fc79932660f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:32.567918 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c896b33b-87ad-428f-91fd-9fc79932660f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:32.568797 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c896b33b-87ad-428f-91fd-9fc79932660f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:32.572935 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c896b33b-87ad-428f-91fd-9fc79932660f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:32.572935 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c896b33b-87ad-428f-91fd-9fc79932660f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:32.586598 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-c896b33b-87ad-428f-91fd-9fc79932660f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] HTTP exception thrown: Instance 232f6a09-92a9-4e68-93af-404f72ffe620 could not be found. Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c896b33b-87ad-428f-91fd-9fc79932660f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Request method failure captured: Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620 HTTP/1.1 Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJlXoIbKMNvA25YGQumrqoImspVHuLOUfoRmRPwWLxDcq7fsPtAFy81tjfSaLwjwvx2BxTkWPFCI5j4ehQFfit79dYKsAdSxV9xkhbHmIt2kWQXztVbC6m8EepFiVRbJzbhnCNQVWDwdnvsGEsySDgHPULZl6m0PSSbaKhzaMZDKOHE Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: aa4e3018a6ca477c9a1d7215ad98d9e9 Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServerActionsTestJSON-893303043 Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/aa4e3018a6ca477c9a1d7215ad98d9e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_aa4e3018a6ca477c9a1d7215ad98d9e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/aa4e3018a6ca477c9a1d7215ad98d9e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/aa4e3018a6ca477c9a1d7215ad98d9e9"}]}] Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServerActionsTestJSON-893303043 Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: aa4e3018a6ca477c9a1d7215ad98d9e9 Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServerActionsTestJSON-893303043 Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServerActionsTestJSON-893303043-project Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: bb03047092f64e2abbf78e9db1a06e0a Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServerActionsTestJSON-893303043-project Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 232f6a09-92a9-4e68-93af-404f72ffe620 could not be found. Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '232f6a09-92a9-4e68-93af-404f72ffe620'} Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 232f6a09-92a9-4e68-93af-404f72ffe620 could not be found. Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 232f6a09-92a9-4e68-93af-404f72ffe620 could not be found. Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:39:32.588543 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:39:32.593495 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:39:32.593495 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:39:32.593495 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:39:32.593495 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:39:32.593495 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:39:32.593495 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 232f6a09-92a9-4e68-93af-404f72ffe620 could not be found. Oct 23 01:39:32.593495 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:39:32.595754 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c896b33b-87ad-428f-91fd-9fc79932660f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Returning 404 to user: Instance 232f6a09-92a9-4e68-93af-404f72ffe620 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:39:32.601604 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c896b33b-87ad-428f-91fd-9fc79932660f tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620" status: 404 len: 111 microversion: 2.1 time: 0.043937 Oct 23 01:39:32.608090 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-209f2506-d7af-4edb-a18c-97383881c867 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:32.608977 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-209f2506-d7af-4edb-a18c-97383881c867 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 919bbefe-5433-4860-be39-88514bab1dd3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:32.612913 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2875/5840] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:32 2022] GET /compute/v2.1/servers/232f6a09-92a9-4e68-93af-404f72ffe620 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:39:32.616349 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-209f2506-d7af-4edb-a18c-97383881c867 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:32.617100 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-209f2506-d7af-4edb-a18c-97383881c867 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:32.617773 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-209f2506-d7af-4edb-a18c-97383881c867 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:32.618847 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-209f2506-d7af-4edb-a18c-97383881c867 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:32.619548 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-209f2506-d7af-4edb-a18c-97383881c867 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:32.620147 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-209f2506-d7af-4edb-a18c-97383881c867 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:32.625537 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:32.649724 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-209f2506-d7af-4edb-a18c-97383881c867 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 919bbefe-5433-4860-be39-88514bab1dd3] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:39:33.048719 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-209f2506-d7af-4edb-a18c-97383881c867 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "DELETE /compute/v2.1/servers/919bbefe-5433-4860-be39-88514bab1dd3" status: 204 len: 0 microversion: 2.1 time: 0.445080 Oct 23 01:39:33.049749 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2966/5841] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:39:32 2022] DELETE /compute/v2.1/servers/919bbefe-5433-4860-be39-88514bab1dd3 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:39:33.059529 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ca017a22-6aea-4c31-9572-9b7ed488fe72 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:33.060696 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ca017a22-6aea-4c31-9572-9b7ed488fe72 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 919bbefe-5433-4860-be39-88514bab1dd3] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:33.074474 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca017a22-6aea-4c31-9572-9b7ed488fe72 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:33.077567 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca017a22-6aea-4c31-9572-9b7ed488fe72 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:33.080491 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca017a22-6aea-4c31-9572-9b7ed488fe72 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:33.081130 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca017a22-6aea-4c31-9572-9b7ed488fe72 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:33.082441 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca017a22-6aea-4c31-9572-9b7ed488fe72 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:33.085463 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca017a22-6aea-4c31-9572-9b7ed488fe72 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:33.101813 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e9d3c611-a2ca-4a8c-9181-b4770a8b5b5d tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:33.102654 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e9d3c611-a2ca-4a8c-9181-b4770a8b5b5d tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] [instance: bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:33.110267 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9d3c611-a2ca-4a8c-9181-b4770a8b5b5d tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:33.111702 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9d3c611-a2ca-4a8c-9181-b4770a8b5b5d tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:33.112388 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9d3c611-a2ca-4a8c-9181-b4770a8b5b5d tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:33.113342 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9d3c611-a2ca-4a8c-9181-b4770a8b5b5d tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:33.114063 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9d3c611-a2ca-4a8c-9181-b4770a8b5b5d tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:33.114824 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9d3c611-a2ca-4a8c-9181-b4770a8b5b5d tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:33.373727 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ca017a22-6aea-4c31-9572-9b7ed488fe72 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:33.387737 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ca017a22-6aea-4c31-9572-9b7ed488fe72 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/919bbefe-5433-4860-be39-88514bab1dd3" status: 200 len: 1467 microversion: 2.1 time: 0.333835 Oct 23 01:39:33.388637 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2876/5842] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:33 2022] GET /compute/v2.1/servers/919bbefe-5433-4860-be39-88514bab1dd3 => generated 1467 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:39:33.474183 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ed616d56-bab1-4c9f-8fc5-1be0ef039e00 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:33.474725 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ed616d56-bab1-4c9f-8fc5-1be0ef039e00 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:33.486833 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ed616d56-bab1-4c9f-8fc5-1be0ef039e00 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:33.486833 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ed616d56-bab1-4c9f-8fc5-1be0ef039e00 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:33.486833 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ed616d56-bab1-4c9f-8fc5-1be0ef039e00 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:33.487146 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ed616d56-bab1-4c9f-8fc5-1be0ef039e00 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:33.487446 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ed616d56-bab1-4c9f-8fc5-1be0ef039e00 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:33.487859 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ed616d56-bab1-4c9f-8fc5-1be0ef039e00 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:33.525207 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e9d3c611-a2ca-4a8c-9181-b4770a8b5b5d tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1759290b0b4034ad9d312abb95ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4c34c1a48140f8ae5a69fa0abb2bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:33.537090 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e9d3c611-a2ca-4a8c-9181-b4770a8b5b5d tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] 10.222.0.42 "GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12" status: 200 len: 1732 microversion: 2.1 time: 0.439534 Oct 23 01:39:33.556911 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2967/5843] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:33 2022] GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12 => generated 1732 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:39:33.863780 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ed616d56-bab1-4c9f-8fc5-1be0ef039e00 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:33.894350 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ed616d56-bab1-4c9f-8fc5-1be0ef039e00 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:33.895809 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ed616d56-bab1-4c9f-8fc5-1be0ef039e00 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:33.904427 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ed616d56-bab1-4c9f-8fc5-1be0ef039e00 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1707 microversion: 2.32 time: 0.432009 Oct 23 01:39:33.921607 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2877/5844] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:39:33 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1707 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:39:34.413487 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-54e7ed14-1983-4c05-8d84-ceee996d49e9 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:34.414680 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-54e7ed14-1983-4c05-8d84-ceee996d49e9 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 919bbefe-5433-4860-be39-88514bab1dd3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:34.434113 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-54e7ed14-1983-4c05-8d84-ceee996d49e9 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:34.435100 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-54e7ed14-1983-4c05-8d84-ceee996d49e9 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:34.441105 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-54e7ed14-1983-4c05-8d84-ceee996d49e9 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:34.442139 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-54e7ed14-1983-4c05-8d84-ceee996d49e9 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:34.442781 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-54e7ed14-1983-4c05-8d84-ceee996d49e9 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:34.443369 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-54e7ed14-1983-4c05-8d84-ceee996d49e9 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:34.565304 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1c8ff28a-d404-4839-b0a9-8eb986be169e tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:34.566615 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1c8ff28a-d404-4839-b0a9-8eb986be169e tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] [instance: bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:34.579807 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c8ff28a-d404-4839-b0a9-8eb986be169e tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:34.586640 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c8ff28a-d404-4839-b0a9-8eb986be169e tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:34.587332 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c8ff28a-d404-4839-b0a9-8eb986be169e tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:34.588260 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c8ff28a-d404-4839-b0a9-8eb986be169e tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:34.588916 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c8ff28a-d404-4839-b0a9-8eb986be169e tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:34.589556 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c8ff28a-d404-4839-b0a9-8eb986be169e tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:34.602388 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-54e7ed14-1983-4c05-8d84-ceee996d49e9 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:34.619286 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-54e7ed14-1983-4c05-8d84-ceee996d49e9 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/919bbefe-5433-4860-be39-88514bab1dd3" status: 200 len: 1467 microversion: 2.1 time: 0.209461 Oct 23 01:39:34.630560 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2968/5845] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:34 2022] GET /compute/v2.1/servers/919bbefe-5433-4860-be39-88514bab1dd3 => generated 1467 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:39:34.781007 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1c8ff28a-d404-4839-b0a9-8eb986be169e tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1759290b0b4034ad9d312abb95ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4c34c1a48140f8ae5a69fa0abb2bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:34.789990 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1c8ff28a-d404-4839-b0a9-8eb986be169e tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] 10.222.0.42 "GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12" status: 200 len: 1732 microversion: 2.1 time: 0.229199 Oct 23 01:39:34.791503 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2878/5846] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:34 2022] GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12 => generated 1732 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:39:34.940573 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-831038ac-4127-4e2e-b483-b01aacc19b7b tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:34.941817 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-831038ac-4127-4e2e-b483-b01aacc19b7b tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:34.950875 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-831038ac-4127-4e2e-b483-b01aacc19b7b tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:34.951915 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-831038ac-4127-4e2e-b483-b01aacc19b7b tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:34.952524 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-831038ac-4127-4e2e-b483-b01aacc19b7b tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:34.953597 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-831038ac-4127-4e2e-b483-b01aacc19b7b tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:34.954429 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-831038ac-4127-4e2e-b483-b01aacc19b7b tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:34.959725 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-831038ac-4127-4e2e-b483-b01aacc19b7b tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:35.194970 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-831038ac-4127-4e2e-b483-b01aacc19b7b tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:35.217176 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-831038ac-4127-4e2e-b483-b01aacc19b7b tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:35.219163 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-831038ac-4127-4e2e-b483-b01aacc19b7b tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:35.223335 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-831038ac-4127-4e2e-b483-b01aacc19b7b tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1753 microversion: 2.32 time: 0.289376 Oct 23 01:39:35.232110 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2969/5847] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:39:34 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1753 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:39:35.652771 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-12621d58-3f25-4262-80a0-340bae2ee199 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:35.654172 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-12621d58-3f25-4262-80a0-340bae2ee199 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 919bbefe-5433-4860-be39-88514bab1dd3] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:35.671928 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-12621d58-3f25-4262-80a0-340bae2ee199 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:35.673057 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-12621d58-3f25-4262-80a0-340bae2ee199 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:35.674518 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-12621d58-3f25-4262-80a0-340bae2ee199 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:35.675363 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-12621d58-3f25-4262-80a0-340bae2ee199 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:35.677283 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-12621d58-3f25-4262-80a0-340bae2ee199 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:35.679873 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-12621d58-3f25-4262-80a0-340bae2ee199 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:35.817272 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0340163c-1f2e-4959-9c66-93dea14271dc tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:35.818629 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0340163c-1f2e-4959-9c66-93dea14271dc tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] [instance: bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:35.826114 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0340163c-1f2e-4959-9c66-93dea14271dc tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:35.826831 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0340163c-1f2e-4959-9c66-93dea14271dc tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:35.831123 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0340163c-1f2e-4959-9c66-93dea14271dc tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:35.831123 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0340163c-1f2e-4959-9c66-93dea14271dc tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:35.831123 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0340163c-1f2e-4959-9c66-93dea14271dc tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:35.831123 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0340163c-1f2e-4959-9c66-93dea14271dc tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:35.930800 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-12621d58-3f25-4262-80a0-340bae2ee199 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:35.940970 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-12621d58-3f25-4262-80a0-340bae2ee199 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/919bbefe-5433-4860-be39-88514bab1dd3" status: 200 len: 1467 microversion: 2.1 time: 0.292628 Oct 23 01:39:35.946964 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2879/5848] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:35 2022] GET /compute/v2.1/servers/919bbefe-5433-4860-be39-88514bab1dd3 => generated 1467 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:39:36.097309 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0340163c-1f2e-4959-9c66-93dea14271dc tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1759290b0b4034ad9d312abb95ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4c34c1a48140f8ae5a69fa0abb2bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:36.108598 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0340163c-1f2e-4959-9c66-93dea14271dc tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] 10.222.0.42 "GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12" status: 200 len: 1732 microversion: 2.1 time: 0.297551 Oct 23 01:39:36.117843 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2970/5849] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:35 2022] GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12 => generated 1732 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:39:36.258109 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-09d9dcbf-ee8c-4994-b459-b34e05f2713e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:36.258946 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-09d9dcbf-ee8c-4994-b459-b34e05f2713e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:36.272094 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09d9dcbf-ee8c-4994-b459-b34e05f2713e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:36.272600 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09d9dcbf-ee8c-4994-b459-b34e05f2713e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:36.276179 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09d9dcbf-ee8c-4994-b459-b34e05f2713e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:36.276924 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09d9dcbf-ee8c-4994-b459-b34e05f2713e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:36.293062 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09d9dcbf-ee8c-4994-b459-b34e05f2713e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:36.293635 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09d9dcbf-ee8c-4994-b459-b34e05f2713e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:36.727278 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-09d9dcbf-ee8c-4994-b459-b34e05f2713e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:36.745860 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-09d9dcbf-ee8c-4994-b459-b34e05f2713e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:36.745860 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-09d9dcbf-ee8c-4994-b459-b34e05f2713e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:36.751752 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-09d9dcbf-ee8c-4994-b459-b34e05f2713e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1753 microversion: 2.32 time: 0.501595 Oct 23 01:39:36.752765 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2880/5850] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:39:36 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1753 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:39:36.984988 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6be97dc0-8a58-45c9-bb7e-0838e9d7edae tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:36.987111 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6be97dc0-8a58-45c9-bb7e-0838e9d7edae tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 919bbefe-5433-4860-be39-88514bab1dd3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:36.996372 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6be97dc0-8a58-45c9-bb7e-0838e9d7edae tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:36.997733 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6be97dc0-8a58-45c9-bb7e-0838e9d7edae tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:36.998623 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6be97dc0-8a58-45c9-bb7e-0838e9d7edae tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:36.999602 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6be97dc0-8a58-45c9-bb7e-0838e9d7edae tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:37.000267 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6be97dc0-8a58-45c9-bb7e-0838e9d7edae tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:37.000993 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6be97dc0-8a58-45c9-bb7e-0838e9d7edae tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:37.137692 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7ef38fd7-0fcf-4d9d-94d6-05f2dd29ba00 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:37.138336 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7ef38fd7-0fcf-4d9d-94d6-05f2dd29ba00 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] [instance: bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:37.155723 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7ef38fd7-0fcf-4d9d-94d6-05f2dd29ba00 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:37.158968 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7ef38fd7-0fcf-4d9d-94d6-05f2dd29ba00 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:37.160167 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7ef38fd7-0fcf-4d9d-94d6-05f2dd29ba00 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:37.162710 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7ef38fd7-0fcf-4d9d-94d6-05f2dd29ba00 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:37.163989 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7ef38fd7-0fcf-4d9d-94d6-05f2dd29ba00 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:37.165956 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7ef38fd7-0fcf-4d9d-94d6-05f2dd29ba00 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:37.229948 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6be97dc0-8a58-45c9-bb7e-0838e9d7edae tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:37.243450 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6be97dc0-8a58-45c9-bb7e-0838e9d7edae tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/919bbefe-5433-4860-be39-88514bab1dd3" status: 200 len: 1467 microversion: 2.1 time: 0.264060 Oct 23 01:39:37.244041 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2971/5851] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:36 2022] GET /compute/v2.1/servers/919bbefe-5433-4860-be39-88514bab1dd3 => generated 1467 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:39:37.363403 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7ef38fd7-0fcf-4d9d-94d6-05f2dd29ba00 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1759290b0b4034ad9d312abb95ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4c34c1a48140f8ae5a69fa0abb2bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:37.374163 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7ef38fd7-0fcf-4d9d-94d6-05f2dd29ba00 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] 10.222.0.42 "GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12" status: 200 len: 1665 microversion: 2.1 time: 0.240212 Oct 23 01:39:37.375737 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2881/5852] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:37 2022] GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12 => generated 1665 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:39:37.798658 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c59f1ff7-bb08-43c7-a3db-5401d5698e5a tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:37.803311 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c59f1ff7-bb08-43c7-a3db-5401d5698e5a tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:37.824598 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c59f1ff7-bb08-43c7-a3db-5401d5698e5a tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:37.824963 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c59f1ff7-bb08-43c7-a3db-5401d5698e5a tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:37.827880 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c59f1ff7-bb08-43c7-a3db-5401d5698e5a tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:37.831388 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c59f1ff7-bb08-43c7-a3db-5401d5698e5a tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:37.832941 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c59f1ff7-bb08-43c7-a3db-5401d5698e5a tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:37.836392 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c59f1ff7-bb08-43c7-a3db-5401d5698e5a tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:38.273543 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cb546f99-561f-4885-9415-3ac2c255c081 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:38.274399 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cb546f99-561f-4885-9415-3ac2c255c081 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 919bbefe-5433-4860-be39-88514bab1dd3] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:38.290009 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb546f99-561f-4885-9415-3ac2c255c081 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:38.290857 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb546f99-561f-4885-9415-3ac2c255c081 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:38.293247 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb546f99-561f-4885-9415-3ac2c255c081 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:38.295723 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb546f99-561f-4885-9415-3ac2c255c081 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:38.297334 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb546f99-561f-4885-9415-3ac2c255c081 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:38.299295 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb546f99-561f-4885-9415-3ac2c255c081 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:38.571706 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cb546f99-561f-4885-9415-3ac2c255c081 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:38.580796 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cb546f99-561f-4885-9415-3ac2c255c081 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/919bbefe-5433-4860-be39-88514bab1dd3" status: 200 len: 1467 microversion: 2.1 time: 0.313175 Oct 23 01:39:38.584002 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2882/5853] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:38 2022] GET /compute/v2.1/servers/919bbefe-5433-4860-be39-88514bab1dd3 => generated 1467 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:39:38.587665 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-248b4616-3679-49fa-bbe8-2cf121993297 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:38.588539 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-248b4616-3679-49fa-bbe8-2cf121993297 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] [instance: bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:38.597072 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-248b4616-3679-49fa-bbe8-2cf121993297 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:38.597887 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-248b4616-3679-49fa-bbe8-2cf121993297 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:38.598596 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-248b4616-3679-49fa-bbe8-2cf121993297 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:38.599509 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-248b4616-3679-49fa-bbe8-2cf121993297 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:38.600166 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-248b4616-3679-49fa-bbe8-2cf121993297 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:38.600812 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-248b4616-3679-49fa-bbe8-2cf121993297 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:38.909691 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c59f1ff7-bb08-43c7-a3db-5401d5698e5a tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:38.926861 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c59f1ff7-bb08-43c7-a3db-5401d5698e5a tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:38.946341 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c59f1ff7-bb08-43c7-a3db-5401d5698e5a tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:38.946341 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c59f1ff7-bb08-43c7-a3db-5401d5698e5a tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1753 microversion: 2.32 time: 1.153370 Oct 23 01:39:38.947456 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2972/5854] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:39:37 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1753 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:39:38.958114 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-02de3b24-bf0c-4514-a9e8-373be9ecc7a7 req-0e49492f-e8b1-4239-b67f-8b438d418d34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12", "name": "network-vif-deleted", "tag": "b43f6b89-f0c2-46ea-b574-0ac7c429416c"}, {"server_uuid": "919bbefe-5433-4860-be39-88514bab1dd3", "name": "network-vif-deleted", "tag": "e935c720-10f0-4a23-b278-03b16f6f0e8e"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:39:38.982018 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-02de3b24-bf0c-4514-a9e8-373be9ecc7a7 req-0e49492f-e8b1-4239-b67f-8b438d418d34 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:38.985937 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-02de3b24-bf0c-4514-a9e8-373be9ecc7a7 req-0e49492f-e8b1-4239-b67f-8b438d418d34 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:38.986499 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-02de3b24-bf0c-4514-a9e8-373be9ecc7a7 req-0e49492f-e8b1-4239-b67f-8b438d418d34 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:39.027779 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-02de3b24-bf0c-4514-a9e8-373be9ecc7a7 req-0e49492f-e8b1-4239-b67f-8b438d418d34 service nova] Creating event network-vif-deleted:b43f6b89-f0c2-46ea-b574-0ac7c429416c for instance bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12 on n-h2-master-1 Oct 23 01:39:39.028464 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-02de3b24-bf0c-4514-a9e8-373be9ecc7a7 req-0e49492f-e8b1-4239-b67f-8b438d418d34 service nova] Creating event network-vif-deleted:e935c720-10f0-4a23-b278-03b16f6f0e8e for instance 919bbefe-5433-4860-be39-88514bab1dd3 on n-h1-master-1 Oct 23 01:39:39.049679 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-02de3b24-bf0c-4514-a9e8-373be9ecc7a7 req-0e49492f-e8b1-4239-b67f-8b438d418d34 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.099810 Oct 23 01:39:39.052232 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2973/5855] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:39:39.061753 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-248b4616-3679-49fa-bbe8-2cf121993297 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1759290b0b4034ad9d312abb95ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4c34c1a48140f8ae5a69fa0abb2bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:39.075935 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-248b4616-3679-49fa-bbe8-2cf121993297 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] 10.222.0.42 "GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12" status: 200 len: 1665 microversion: 2.1 time: 0.491715 Oct 23 01:39:39.077714 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2883/5856] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:38 2022] GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12 => generated 1665 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:39:39.607225 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1d855f1e-a04f-4808-b523-0c13a3e56200 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:39.608221 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1d855f1e-a04f-4808-b523-0c13a3e56200 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 919bbefe-5433-4860-be39-88514bab1dd3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:39.622500 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1d855f1e-a04f-4808-b523-0c13a3e56200 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:39.628265 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1d855f1e-a04f-4808-b523-0c13a3e56200 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:39.628751 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1d855f1e-a04f-4808-b523-0c13a3e56200 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:39.629568 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1d855f1e-a04f-4808-b523-0c13a3e56200 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:39.630088 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1d855f1e-a04f-4808-b523-0c13a3e56200 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:39.630402 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1d855f1e-a04f-4808-b523-0c13a3e56200 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:39.771171 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1d855f1e-a04f-4808-b523-0c13a3e56200 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:39.771689 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1d855f1e-a04f-4808-b523-0c13a3e56200 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:39.772136 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1d855f1e-a04f-4808-b523-0c13a3e56200 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:39.772599 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-1d855f1e-a04f-4808-b523-0c13a3e56200 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lazy-loading 'fault' on Instance uuid 919bbefe-5433-4860-be39-88514bab1dd3 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:39:39.871729 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1d855f1e-a04f-4808-b523-0c13a3e56200 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:39.903281 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1d855f1e-a04f-4808-b523-0c13a3e56200 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/919bbefe-5433-4860-be39-88514bab1dd3" status: 200 len: 1305 microversion: 2.1 time: 0.300830 Oct 23 01:39:39.908728 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2974/5857] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:39 2022] GET /compute/v2.1/servers/919bbefe-5433-4860-be39-88514bab1dd3 => generated 1305 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:39:39.982895 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-73a51b26-23f2-48e6-8d35-fc730edb22a8 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:39.983869 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-73a51b26-23f2-48e6-8d35-fc730edb22a8 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:39.994442 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-73a51b26-23f2-48e6-8d35-fc730edb22a8 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:39.997441 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-73a51b26-23f2-48e6-8d35-fc730edb22a8 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:40.000163 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-73a51b26-23f2-48e6-8d35-fc730edb22a8 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:40.001844 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-73a51b26-23f2-48e6-8d35-fc730edb22a8 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:40.002347 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-73a51b26-23f2-48e6-8d35-fc730edb22a8 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:40.012878 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-73a51b26-23f2-48e6-8d35-fc730edb22a8 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:40.106702 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-484e0f6b-73dd-4d01-a943-db7f4a515190 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:40.107696 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-484e0f6b-73dd-4d01-a943-db7f4a515190 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] [instance: bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:40.171375 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-484e0f6b-73dd-4d01-a943-db7f4a515190 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:40.176499 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-484e0f6b-73dd-4d01-a943-db7f4a515190 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:40.177001 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-484e0f6b-73dd-4d01-a943-db7f4a515190 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:40.177797 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-484e0f6b-73dd-4d01-a943-db7f4a515190 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:40.184876 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-484e0f6b-73dd-4d01-a943-db7f4a515190 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:40.185478 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-484e0f6b-73dd-4d01-a943-db7f4a515190 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:40.452416 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-484e0f6b-73dd-4d01-a943-db7f4a515190 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:40.458709 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-484e0f6b-73dd-4d01-a943-db7f4a515190 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:40.460398 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-484e0f6b-73dd-4d01-a943-db7f4a515190 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:40.465341 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-484e0f6b-73dd-4d01-a943-db7f4a515190 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lazy-loading 'fault' on Instance uuid bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:39:40.632099 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-484e0f6b-73dd-4d01-a943-db7f4a515190 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1759290b0b4034ad9d312abb95ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4c34c1a48140f8ae5a69fa0abb2bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:40.635474 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-73a51b26-23f2-48e6-8d35-fc730edb22a8 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:40.645302 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-484e0f6b-73dd-4d01-a943-db7f4a515190 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] 10.222.0.42 "GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12" status: 200 len: 1388 microversion: 2.1 time: 0.544211 Oct 23 01:39:40.645931 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2975/5858] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:40 2022] GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12 => generated 1388 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:39:40.660551 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-73a51b26-23f2-48e6-8d35-fc730edb22a8 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:40.662415 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-73a51b26-23f2-48e6-8d35-fc730edb22a8 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:40.697249 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-73a51b26-23f2-48e6-8d35-fc730edb22a8 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1753 microversion: 2.32 time: 0.718796 Oct 23 01:39:40.697874 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2884/5859] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:39:39 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1753 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:39:40.934221 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8d4a2682-5b12-4918-86a7-39f266b316f7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:40.934952 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8d4a2682-5b12-4918-86a7-39f266b316f7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 919bbefe-5433-4860-be39-88514bab1dd3] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:40.950644 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8d4a2682-5b12-4918-86a7-39f266b316f7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:40.961075 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8d4a2682-5b12-4918-86a7-39f266b316f7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:40.961075 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8d4a2682-5b12-4918-86a7-39f266b316f7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:40.961075 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8d4a2682-5b12-4918-86a7-39f266b316f7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:40.961075 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8d4a2682-5b12-4918-86a7-39f266b316f7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:40.961075 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8d4a2682-5b12-4918-86a7-39f266b316f7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:41.005085 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-8d4a2682-5b12-4918-86a7-39f266b316f7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] HTTP exception thrown: Instance 919bbefe-5433-4860-be39-88514bab1dd3 could not be found. Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8d4a2682-5b12-4918-86a7-39f266b316f7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Request method failure captured: Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/919bbefe-5433-4860-be39-88514bab1dd3 HTTP/1.1 Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJlXoIbKMNvA25YGQumrqoImspVHuLOUfoRmRPwWLxDcq7fsPtAFy81tjfSaLwjwvx2BxTkWPFCI5j4ehQFfit79dYKsAdSxV9xkhbHmIt2kWQXztVbC6m8EepFiVRbJzbhnCNQVWDwdnvsGEsySDgHPULZl6m0PSSbaKhzaMZDKOHE Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: aa4e3018a6ca477c9a1d7215ad98d9e9 Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServerActionsTestJSON-893303043 Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/aa4e3018a6ca477c9a1d7215ad98d9e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_aa4e3018a6ca477c9a1d7215ad98d9e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/aa4e3018a6ca477c9a1d7215ad98d9e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/aa4e3018a6ca477c9a1d7215ad98d9e9"}]}] Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServerActionsTestJSON-893303043 Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: aa4e3018a6ca477c9a1d7215ad98d9e9 Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServerActionsTestJSON-893303043 Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServerActionsTestJSON-893303043-project Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: bb03047092f64e2abbf78e9db1a06e0a Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServerActionsTestJSON-893303043-project Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 919bbefe-5433-4860-be39-88514bab1dd3 could not be found. Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '919bbefe-5433-4860-be39-88514bab1dd3'} Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 919bbefe-5433-4860-be39-88514bab1dd3 could not be found. Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 919bbefe-5433-4860-be39-88514bab1dd3 could not be found. Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:39:41.009851 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:39:41.014982 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:39:41.014982 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:39:41.014982 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:39:41.014982 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:39:41.014982 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:39:41.014982 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 919bbefe-5433-4860-be39-88514bab1dd3 could not be found. Oct 23 01:39:41.014982 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:39:41.016686 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8d4a2682-5b12-4918-86a7-39f266b316f7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Returning 404 to user: Instance 919bbefe-5433-4860-be39-88514bab1dd3 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:39:41.019335 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8d4a2682-5b12-4918-86a7-39f266b316f7 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/919bbefe-5433-4860-be39-88514bab1dd3" status: 404 len: 111 microversion: 2.1 time: 0.088249 Oct 23 01:39:41.023521 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2976/5860] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:40 2022] GET /compute/v2.1/servers/919bbefe-5433-4860-be39-88514bab1dd3 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:39:41.028531 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3d79a1f4-3a05-44fc-a1d7-937672be826a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:41.029175 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3d79a1f4-3a05-44fc-a1d7-937672be826a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: b23efb32-6be3-4a79-90c0-fea6c5f2dd65] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:41.052059 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3d79a1f4-3a05-44fc-a1d7-937672be826a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:41.053127 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3d79a1f4-3a05-44fc-a1d7-937672be826a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:41.054341 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3d79a1f4-3a05-44fc-a1d7-937672be826a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:41.056640 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3d79a1f4-3a05-44fc-a1d7-937672be826a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:41.057829 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3d79a1f4-3a05-44fc-a1d7-937672be826a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:41.059260 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3d79a1f4-3a05-44fc-a1d7-937672be826a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:41.129221 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3d79a1f4-3a05-44fc-a1d7-937672be826a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: b23efb32-6be3-4a79-90c0-fea6c5f2dd65] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:39:41.523470 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3d79a1f4-3a05-44fc-a1d7-937672be826a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65" status: 204 len: 0 microversion: 2.1 time: 0.498709 Oct 23 01:39:41.524073 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2885/5861] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:39:41 2022] DELETE /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 23 01:39:41.539627 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9f0367c9-faa8-41b7-9cbc-2fc2182bd20e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:41.541222 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9f0367c9-faa8-41b7-9cbc-2fc2182bd20e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: b23efb32-6be3-4a79-90c0-fea6c5f2dd65] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:41.566761 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f0367c9-faa8-41b7-9cbc-2fc2182bd20e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:41.567728 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f0367c9-faa8-41b7-9cbc-2fc2182bd20e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:41.570165 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f0367c9-faa8-41b7-9cbc-2fc2182bd20e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:41.573055 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f0367c9-faa8-41b7-9cbc-2fc2182bd20e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:41.574122 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f0367c9-faa8-41b7-9cbc-2fc2182bd20e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:41.576077 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f0367c9-faa8-41b7-9cbc-2fc2182bd20e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:41.669155 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-61df4be8-f179-4e64-b668-4bea0b9756e5 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:41.674016 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-61df4be8-f179-4e64-b668-4bea0b9756e5 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] [instance: bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:41.683698 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61df4be8-f179-4e64-b668-4bea0b9756e5 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:41.689442 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61df4be8-f179-4e64-b668-4bea0b9756e5 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:41.690140 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61df4be8-f179-4e64-b668-4bea0b9756e5 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:41.691044 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61df4be8-f179-4e64-b668-4bea0b9756e5 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:41.698715 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61df4be8-f179-4e64-b668-4bea0b9756e5 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:41.709255 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61df4be8-f179-4e64-b668-4bea0b9756e5 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:41.743899 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-61df4be8-f179-4e64-b668-4bea0b9756e5 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] HTTP exception thrown: Instance bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12 could not be found. Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-61df4be8-f179-4e64-b668-4bea0b9756e5 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Request method failure captured: Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12 HTTP/1.1 Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJn8uakEKb6yhu-FLWuJDKR2LeQonCdhzSHM-nkFJI36qksWwUQMcoqloR9aqHunZamXNEOeW-6zoqDM7BpztBD-TL-ZjBC3Bhp586Sea7WesDq0j5vCVn7wCu8FYMHv4fMyCnQNKSj1c9fyt2ZC8QgV7LFP7qos41rNvD_wCbueDmI Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: ef4c34c1a48140f8ae5a69fa0abb2bc7 Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-TestServerBasicOps-1335340584 Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ef4c34c1a48140f8ae5a69fa0abb2bc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ef4c34c1a48140f8ae5a69fa0abb2bc7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ef4c34c1a48140f8ae5a69fa0abb2bc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ef4c34c1a48140f8ae5a69fa0abb2bc7"}]}] Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-TestServerBasicOps-1335340584 Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: ef4c34c1a48140f8ae5a69fa0abb2bc7 Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-TestServerBasicOps-1335340584 Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-TestServerBasicOps-1335340584-project Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: be1759290b0b4034ad9d312abb95ef46 Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-TestServerBasicOps-1335340584-project Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: exception: Instance bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12 could not be found. Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12'} Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12 could not be found. Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12 could not be found. Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:39:41.747420 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:39:41.752374 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:39:41.752374 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:39:41.752374 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:39:41.752374 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:39:41.752374 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:39:41.752374 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12 could not be found. Oct 23 01:39:41.752374 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:39:41.752374 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-61df4be8-f179-4e64-b668-4bea0b9756e5 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Returning 404 to user: Instance bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:39:41.753948 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-61df4be8-f179-4e64-b668-4bea0b9756e5 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] 10.222.0.42 "GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12" status: 404 len: 111 microversion: 2.1 time: 0.089031 Oct 23 01:39:41.755162 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2886/5862] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:41 2022] GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 01:39:41.764869 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c645ed99-c481-4542-b53e-5f903b37cae6 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:41.765589 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c645ed99-c481-4542-b53e-5f903b37cae6 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:41.787374 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c645ed99-c481-4542-b53e-5f903b37cae6 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:41.787906 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c645ed99-c481-4542-b53e-5f903b37cae6 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:41.791564 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c645ed99-c481-4542-b53e-5f903b37cae6 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:41.792459 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c645ed99-c481-4542-b53e-5f903b37cae6 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:41.793179 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c645ed99-c481-4542-b53e-5f903b37cae6 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:41.794022 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c645ed99-c481-4542-b53e-5f903b37cae6 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:41.862463 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:42.090491 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9f0367c9-faa8-41b7-9cbc-2fc2182bd20e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:42.105452 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9f0367c9-faa8-41b7-9cbc-2fc2182bd20e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65" status: 200 len: 1507 microversion: 2.1 time: 0.569429 Oct 23 01:39:42.106510 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2977/5863] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:41 2022] GET /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65 => generated 1507 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:39:42.369336 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c645ed99-c481-4542-b53e-5f903b37cae6 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:42.386904 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c645ed99-c481-4542-b53e-5f903b37cae6 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:42.388845 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c645ed99-c481-4542-b53e-5f903b37cae6 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:42.396294 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c645ed99-c481-4542-b53e-5f903b37cae6 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1753 microversion: 2.32 time: 0.637836 Oct 23 01:39:42.401156 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2887/5864] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:39:41 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1753 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:39:43.130858 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4ce7825a-880c-4888-a8eb-bd7ee7496480 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:43.131489 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4ce7825a-880c-4888-a8eb-bd7ee7496480 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: b23efb32-6be3-4a79-90c0-fea6c5f2dd65] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:43.147186 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4ce7825a-880c-4888-a8eb-bd7ee7496480 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:43.147877 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4ce7825a-880c-4888-a8eb-bd7ee7496480 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:43.155464 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4ce7825a-880c-4888-a8eb-bd7ee7496480 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:43.155464 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4ce7825a-880c-4888-a8eb-bd7ee7496480 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:43.160501 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4ce7825a-880c-4888-a8eb-bd7ee7496480 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:43.161438 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4ce7825a-880c-4888-a8eb-bd7ee7496480 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:43.428538 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f40810b6-f247-49ce-9f6a-4887be804532 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:43.435411 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f40810b6-f247-49ce-9f6a-4887be804532 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:43.444413 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f40810b6-f247-49ce-9f6a-4887be804532 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:43.444911 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f40810b6-f247-49ce-9f6a-4887be804532 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:43.445350 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f40810b6-f247-49ce-9f6a-4887be804532 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:43.446078 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f40810b6-f247-49ce-9f6a-4887be804532 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:43.446529 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f40810b6-f247-49ce-9f6a-4887be804532 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:43.446951 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f40810b6-f247-49ce-9f6a-4887be804532 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:43.620047 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4ce7825a-880c-4888-a8eb-bd7ee7496480 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:43.633926 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4ce7825a-880c-4888-a8eb-bd7ee7496480 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65" status: 200 len: 1507 microversion: 2.1 time: 0.506861 Oct 23 01:39:43.642722 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2978/5865] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:43 2022] GET /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65 => generated 1507 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:39:44.002977 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5c8053c5-1fea-41e6-b620-bfdb40ffa9f3 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:44.003492 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5c8053c5-1fea-41e6-b620-bfdb40ffa9f3 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] [instance: bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:44.021577 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5c8053c5-1fea-41e6-b620-bfdb40ffa9f3 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:44.022098 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5c8053c5-1fea-41e6-b620-bfdb40ffa9f3 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:44.022544 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5c8053c5-1fea-41e6-b620-bfdb40ffa9f3 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:44.023259 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5c8053c5-1fea-41e6-b620-bfdb40ffa9f3 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:44.023719 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5c8053c5-1fea-41e6-b620-bfdb40ffa9f3 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:44.024154 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5c8053c5-1fea-41e6-b620-bfdb40ffa9f3 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:44.075091 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f40810b6-f247-49ce-9f6a-4887be804532 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:44.075737 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-5c8053c5-1fea-41e6-b620-bfdb40ffa9f3 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] HTTP exception thrown: Instance bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12 could not be found. Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5c8053c5-1fea-41e6-b620-bfdb40ffa9f3 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Request method failure captured: Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12 HTTP/1.1 Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJn8uakEKb6yhu-FLWuJDKR2LeQonCdhzSHM-nkFJI36qksWwUQMcoqloR9aqHunZamXNEOeW-6zoqDM7BpztBD-TL-ZjBC3Bhp586Sea7WesDq0j5vCVn7wCu8FYMHv4fMyCnQNKSj1c9fyt2ZC8QgV7LFP7qos41rNvD_wCbueDmI Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: ef4c34c1a48140f8ae5a69fa0abb2bc7 Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-TestServerBasicOps-1335340584 Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ef4c34c1a48140f8ae5a69fa0abb2bc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ef4c34c1a48140f8ae5a69fa0abb2bc7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ef4c34c1a48140f8ae5a69fa0abb2bc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ef4c34c1a48140f8ae5a69fa0abb2bc7"}]}] Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-TestServerBasicOps-1335340584 Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: ef4c34c1a48140f8ae5a69fa0abb2bc7 Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-TestServerBasicOps-1335340584 Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-TestServerBasicOps-1335340584-project Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: be1759290b0b4034ad9d312abb95ef46 Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-TestServerBasicOps-1335340584-project Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: exception: Instance bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12 could not be found. Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12'} Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12 could not be found. Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:39:44.078666 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:39:44.083570 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12 could not be found. Oct 23 01:39:44.083570 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:39:44.083570 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:39:44.083570 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:39:44.083570 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:39:44.083570 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:39:44.083570 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:39:44.083570 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:39:44.083570 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:39:44.083570 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12 could not be found. Oct 23 01:39:44.083570 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:39:44.088753 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5c8053c5-1fea-41e6-b620-bfdb40ffa9f3 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Returning 404 to user: Instance bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:39:44.089874 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5c8053c5-1fea-41e6-b620-bfdb40ffa9f3 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12" status: 404 len: 111 microversion: 2.1 time: 0.094575 Oct 23 01:39:44.093800 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2979/5866] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:39:43 2022] DELETE /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 01:39:44.096402 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f40810b6-f247-49ce-9f6a-4887be804532 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:44.098975 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f40810b6-f247-49ce-9f6a-4887be804532 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:44.105488 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2794171a-1ab5-4600-90a6-2e2e21755afb tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:44.106350 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2794171a-1ab5-4600-90a6-2e2e21755afb tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] [instance: bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:44.108910 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f40810b6-f247-49ce-9f6a-4887be804532 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1799 microversion: 2.32 time: 0.684098 Oct 23 01:39:44.118867 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2794171a-1ab5-4600-90a6-2e2e21755afb tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:44.119635 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2794171a-1ab5-4600-90a6-2e2e21755afb tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:44.120246 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2794171a-1ab5-4600-90a6-2e2e21755afb tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:44.122811 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2794171a-1ab5-4600-90a6-2e2e21755afb tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:44.123439 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2794171a-1ab5-4600-90a6-2e2e21755afb tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:44.126676 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2794171a-1ab5-4600-90a6-2e2e21755afb tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:44.128530 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2888/5867] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:39:43 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1799 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:39:44.156718 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-2794171a-1ab5-4600-90a6-2e2e21755afb tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] HTTP exception thrown: Instance bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12 could not be found. Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2794171a-1ab5-4600-90a6-2e2e21755afb tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Request method failure captured: Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12 HTTP/1.1 Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJn8uakEKb6yhu-FLWuJDKR2LeQonCdhzSHM-nkFJI36qksWwUQMcoqloR9aqHunZamXNEOeW-6zoqDM7BpztBD-TL-ZjBC3Bhp586Sea7WesDq0j5vCVn7wCu8FYMHv4fMyCnQNKSj1c9fyt2ZC8QgV7LFP7qos41rNvD_wCbueDmI Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: ef4c34c1a48140f8ae5a69fa0abb2bc7 Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-TestServerBasicOps-1335340584 Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ef4c34c1a48140f8ae5a69fa0abb2bc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ef4c34c1a48140f8ae5a69fa0abb2bc7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ef4c34c1a48140f8ae5a69fa0abb2bc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ef4c34c1a48140f8ae5a69fa0abb2bc7"}]}] Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-TestServerBasicOps-1335340584 Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: ef4c34c1a48140f8ae5a69fa0abb2bc7 Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-TestServerBasicOps-1335340584 Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-TestServerBasicOps-1335340584-project Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: be1759290b0b4034ad9d312abb95ef46 Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-TestServerBasicOps-1335340584-project Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: exception: Instance bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12 could not be found. Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12'} Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12 could not be found. Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12 could not be found. Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:39:44.158447 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:39:44.163321 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:39:44.163321 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:39:44.163321 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:39:44.163321 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:39:44.163321 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:39:44.163321 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12 could not be found. Oct 23 01:39:44.163321 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:39:44.163321 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2794171a-1ab5-4600-90a6-2e2e21755afb tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Returning 404 to user: Instance bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:39:44.163321 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2794171a-1ab5-4600-90a6-2e2e21755afb tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] 10.222.0.42 "GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12" status: 404 len: 111 microversion: 2.1 time: 0.061730 Oct 23 01:39:44.163321 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2980/5868] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:44 2022] GET /compute/v2.1/servers/bb9525b2-0a67-4ef8-aa1e-2afb66ee5f12 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 01:39:44.669786 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1e5ddc7f-716c-4b0d-8536-6357a26f2ca8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:44.670548 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1e5ddc7f-716c-4b0d-8536-6357a26f2ca8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: b23efb32-6be3-4a79-90c0-fea6c5f2dd65] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:44.684885 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1e5ddc7f-716c-4b0d-8536-6357a26f2ca8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:44.685432 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1e5ddc7f-716c-4b0d-8536-6357a26f2ca8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:44.685908 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1e5ddc7f-716c-4b0d-8536-6357a26f2ca8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:44.689799 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1e5ddc7f-716c-4b0d-8536-6357a26f2ca8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:44.690332 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1e5ddc7f-716c-4b0d-8536-6357a26f2ca8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:44.690784 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1e5ddc7f-716c-4b0d-8536-6357a26f2ca8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:44.711368 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1dc43840-0154-41c0-9780-1bf541890bd5 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] Calling method '.version_select at 0x7f5cc10e3ee0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:44.809759 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1dc43840-0154-41c0-9780-1bf541890bd5 tempest-TestServerBasicOps-1335340584 tempest-TestServerBasicOps-1335340584-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-878408985" status: 202 len: 0 microversion: 2.1 time: 0.102749 Oct 23 01:39:44.810931 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2981/5869] 10.222.0.42 () {58 vars in 1251 bytes} [Sun Oct 23 01:39:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-878408985 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:39:45.046448 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1e5ddc7f-716c-4b0d-8536-6357a26f2ca8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:45.062552 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1e5ddc7f-716c-4b0d-8536-6357a26f2ca8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65" status: 200 len: 1507 microversion: 2.1 time: 0.402923 Oct 23 01:39:45.065313 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2889/5870] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:44 2022] GET /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65 => generated 1507 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:39:45.136957 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3f5d3f98-4ecc-4f28-a5b2-8486d2cf2024 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:45.137881 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3f5d3f98-4ecc-4f28-a5b2-8486d2cf2024 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:45.152305 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3f5d3f98-4ecc-4f28-a5b2-8486d2cf2024 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:45.153093 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3f5d3f98-4ecc-4f28-a5b2-8486d2cf2024 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:45.153696 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3f5d3f98-4ecc-4f28-a5b2-8486d2cf2024 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:45.154606 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3f5d3f98-4ecc-4f28-a5b2-8486d2cf2024 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:45.155223 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3f5d3f98-4ecc-4f28-a5b2-8486d2cf2024 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:45.158639 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3f5d3f98-4ecc-4f28-a5b2-8486d2cf2024 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:45.904908 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3f5d3f98-4ecc-4f28-a5b2-8486d2cf2024 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:45.928438 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3f5d3f98-4ecc-4f28-a5b2-8486d2cf2024 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:45.940485 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3f5d3f98-4ecc-4f28-a5b2-8486d2cf2024 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:45.942344 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3f5d3f98-4ecc-4f28-a5b2-8486d2cf2024 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1799 microversion: 2.32 time: 0.809130 Oct 23 01:39:45.949844 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2982/5871] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:39:45 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1799 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:39:46.097654 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9b6f4fbb-7e13-4259-9a2a-c75853112b2d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:46.100472 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9b6f4fbb-7e13-4259-9a2a-c75853112b2d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: b23efb32-6be3-4a79-90c0-fea6c5f2dd65] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:46.122308 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b6f4fbb-7e13-4259-9a2a-c75853112b2d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:46.122308 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b6f4fbb-7e13-4259-9a2a-c75853112b2d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:46.123591 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b6f4fbb-7e13-4259-9a2a-c75853112b2d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:46.124113 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b6f4fbb-7e13-4259-9a2a-c75853112b2d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:46.124832 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b6f4fbb-7e13-4259-9a2a-c75853112b2d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:46.127096 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b6f4fbb-7e13-4259-9a2a-c75853112b2d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:46.941105 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-dc7fc95e-cd95-4d89-ae18-c8c4dced6b0d req-cff8c6a2-344e-49ba-ba45-68bdfb539a01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b23efb32-6be3-4a79-90c0-fea6c5f2dd65", "name": "network-vif-deleted", "tag": "22263c5c-a955-4784-bea4-6e244eed9069"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:39:46.973057 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-dc7fc95e-cd95-4d89-ae18-c8c4dced6b0d req-cff8c6a2-344e-49ba-ba45-68bdfb539a01 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:46.975658 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-dc7fc95e-cd95-4d89-ae18-c8c4dced6b0d req-cff8c6a2-344e-49ba-ba45-68bdfb539a01 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:46.976289 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-dc7fc95e-cd95-4d89-ae18-c8c4dced6b0d req-cff8c6a2-344e-49ba-ba45-68bdfb539a01 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:46.982084 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9b6f4fbb-7e13-4259-9a2a-c75853112b2d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:46.994446 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9b6f4fbb-7e13-4259-9a2a-c75853112b2d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65" status: 200 len: 1507 microversion: 2.1 time: 0.909811 Oct 23 01:39:46.995905 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2890/5872] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:46 2022] GET /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65 => generated 1507 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:39:47.006681 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-dc7fc95e-cd95-4d89-ae18-c8c4dced6b0d req-cff8c6a2-344e-49ba-ba45-68bdfb539a01 service nova] Creating event network-vif-deleted:22263c5c-a955-4784-bea4-6e244eed9069 for instance b23efb32-6be3-4a79-90c0-fea6c5f2dd65 on n-h2-master-1 Oct 23 01:39:47.010915 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-dc7fc95e-cd95-4d89-ae18-c8c4dced6b0d req-cff8c6a2-344e-49ba-ba45-68bdfb539a01 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075032 Oct 23 01:39:47.012632 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2983/5873] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:39:47.025399 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3727820b-d3e3-42cb-b044-007a2d571742 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:47.029638 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3727820b-d3e3-42cb-b044-007a2d571742 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:47.053818 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3727820b-d3e3-42cb-b044-007a2d571742 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:47.054896 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3727820b-d3e3-42cb-b044-007a2d571742 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:47.083188 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3727820b-d3e3-42cb-b044-007a2d571742 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:47.087130 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3727820b-d3e3-42cb-b044-007a2d571742 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:47.089478 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3727820b-d3e3-42cb-b044-007a2d571742 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:47.099217 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3727820b-d3e3-42cb-b044-007a2d571742 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:48.022297 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f4aa35d3-9357-465c-b08f-5d41082203e5 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:48.022920 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f4aa35d3-9357-465c-b08f-5d41082203e5 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: b23efb32-6be3-4a79-90c0-fea6c5f2dd65] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:48.040581 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f4aa35d3-9357-465c-b08f-5d41082203e5 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:48.043682 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f4aa35d3-9357-465c-b08f-5d41082203e5 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:48.046767 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f4aa35d3-9357-465c-b08f-5d41082203e5 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:48.050571 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f4aa35d3-9357-465c-b08f-5d41082203e5 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:48.050571 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f4aa35d3-9357-465c-b08f-5d41082203e5 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:48.050571 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f4aa35d3-9357-465c-b08f-5d41082203e5 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:48.158324 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f4aa35d3-9357-465c-b08f-5d41082203e5 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:48.158816 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f4aa35d3-9357-465c-b08f-5d41082203e5 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:48.159249 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f4aa35d3-9357-465c-b08f-5d41082203e5 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:48.159706 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-f4aa35d3-9357-465c-b08f-5d41082203e5 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lazy-loading 'fault' on Instance uuid b23efb32-6be3-4a79-90c0-fea6c5f2dd65 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:39:48.750802 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3727820b-d3e3-42cb-b044-007a2d571742 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:48.759641 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:48.763910 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3727820b-d3e3-42cb-b044-007a2d571742 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:48.768943 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3727820b-d3e3-42cb-b044-007a2d571742 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:48.768943 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3727820b-d3e3-42cb-b044-007a2d571742 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1799 microversion: 2.32 time: 1.753402 Oct 23 01:39:48.769134 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f4aa35d3-9357-465c-b08f-5d41082203e5 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:48.777735 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f4aa35d3-9357-465c-b08f-5d41082203e5 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65" status: 200 len: 1304 microversion: 2.1 time: 0.759332 Oct 23 01:39:48.782172 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2891/5874] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:48 2022] GET /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65 => generated 1304 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:39:48.824041 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2984/5875] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:39:47 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1799 bytes in 1810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:39:49.800590 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-56dd5a5d-07b3-44fa-96dc-3eb564e7308b tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:49.801208 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-56dd5a5d-07b3-44fa-96dc-3eb564e7308b tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:49.808011 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-eb573f20-7cee-4e06-9fe8-7cbc00c93820 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:49.809240 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-eb573f20-7cee-4e06-9fe8-7cbc00c93820 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: b23efb32-6be3-4a79-90c0-fea6c5f2dd65] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:49.817636 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-56dd5a5d-07b3-44fa-96dc-3eb564e7308b tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:49.827157 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-56dd5a5d-07b3-44fa-96dc-3eb564e7308b tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:49.830489 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-56dd5a5d-07b3-44fa-96dc-3eb564e7308b tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:49.831858 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb573f20-7cee-4e06-9fe8-7cbc00c93820 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:49.834936 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb573f20-7cee-4e06-9fe8-7cbc00c93820 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:49.839031 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-56dd5a5d-07b3-44fa-96dc-3eb564e7308b tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:49.839523 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-56dd5a5d-07b3-44fa-96dc-3eb564e7308b tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:49.840145 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-56dd5a5d-07b3-44fa-96dc-3eb564e7308b tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:49.845178 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb573f20-7cee-4e06-9fe8-7cbc00c93820 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:49.845178 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb573f20-7cee-4e06-9fe8-7cbc00c93820 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:49.845178 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb573f20-7cee-4e06-9fe8-7cbc00c93820 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:49.845178 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb573f20-7cee-4e06-9fe8-7cbc00c93820 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:49.893647 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-eb573f20-7cee-4e06-9fe8-7cbc00c93820 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] HTTP exception thrown: Instance b23efb32-6be3-4a79-90c0-fea6c5f2dd65 could not be found. Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-eb573f20-7cee-4e06-9fe8-7cbc00c93820 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Request method failure captured: Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65 HTTP/1.1 Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJlXoIbKMNvA25YGQumrqoImspVHuLOUfoRmRPwWLxDcq7fsPtAFy81tjfSaLwjwvx2BxTkWPFCI5j4ehQFfit79dYKsAdSxV9xkhbHmIt2kWQXztVbC6m8EepFiVRbJzbhnCNQVWDwdnvsGEsySDgHPULZl6m0PSSbaKhzaMZDKOHE Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: aa4e3018a6ca477c9a1d7215ad98d9e9 Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServerActionsTestJSON-893303043 Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/aa4e3018a6ca477c9a1d7215ad98d9e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_aa4e3018a6ca477c9a1d7215ad98d9e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/aa4e3018a6ca477c9a1d7215ad98d9e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/aa4e3018a6ca477c9a1d7215ad98d9e9"}]}] Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServerActionsTestJSON-893303043 Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: aa4e3018a6ca477c9a1d7215ad98d9e9 Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServerActionsTestJSON-893303043 Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServerActionsTestJSON-893303043-project Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: bb03047092f64e2abbf78e9db1a06e0a Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServerActionsTestJSON-893303043-project Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: exception: Instance b23efb32-6be3-4a79-90c0-fea6c5f2dd65 could not be found. Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'b23efb32-6be3-4a79-90c0-fea6c5f2dd65'} Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b23efb32-6be3-4a79-90c0-fea6c5f2dd65 could not be found. Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b23efb32-6be3-4a79-90c0-fea6c5f2dd65 could not be found. Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:39:49.903039 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:39:49.909394 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:39:49.909394 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:39:49.909394 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:39:49.909394 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:39:49.909394 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:39:49.909394 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b23efb32-6be3-4a79-90c0-fea6c5f2dd65 could not be found. Oct 23 01:39:49.909394 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:39:49.909394 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-eb573f20-7cee-4e06-9fe8-7cbc00c93820 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Returning 404 to user: Instance b23efb32-6be3-4a79-90c0-fea6c5f2dd65 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:39:49.910189 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-eb573f20-7cee-4e06-9fe8-7cbc00c93820 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65" status: 404 len: 111 microversion: 2.1 time: 0.106535 Oct 23 01:39:49.914696 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2985/5876] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:49 2022] GET /compute/v2.1/servers/b23efb32-6be3-4a79-90c0-fea6c5f2dd65 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:39:49.921634 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-21dd9a91-0d59-42dc-b3b0-a538e791ce56 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:49.926817 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-21dd9a91-0d59-42dc-b3b0-a538e791ce56 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 740c5d14-9669-45e2-9ba9-723926f774ab] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:49.941306 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-21dd9a91-0d59-42dc-b3b0-a538e791ce56 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:49.943756 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-21dd9a91-0d59-42dc-b3b0-a538e791ce56 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:49.945405 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-21dd9a91-0d59-42dc-b3b0-a538e791ce56 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:49.947409 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-21dd9a91-0d59-42dc-b3b0-a538e791ce56 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:49.948154 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-21dd9a91-0d59-42dc-b3b0-a538e791ce56 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:49.951911 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-21dd9a91-0d59-42dc-b3b0-a538e791ce56 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:50.046525 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-21dd9a91-0d59-42dc-b3b0-a538e791ce56 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 740c5d14-9669-45e2-9ba9-723926f774ab] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:39:50.370690 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-56dd5a5d-07b3-44fa-96dc-3eb564e7308b tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:50.385262 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-56dd5a5d-07b3-44fa-96dc-3eb564e7308b tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:50.386775 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-56dd5a5d-07b3-44fa-96dc-3eb564e7308b tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:50.388002 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-56dd5a5d-07b3-44fa-96dc-3eb564e7308b tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1845 microversion: 2.32 time: 0.591289 Oct 23 01:39:50.388580 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2892/5877] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:39:49 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1845 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:39:50.630186 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-21dd9a91-0d59-42dc-b3b0-a538e791ce56 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "DELETE /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab" status: 204 len: 0 microversion: 2.1 time: 0.707072 Oct 23 01:39:50.630186 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2986/5878] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:39:49 2022] DELETE /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab => generated 0 bytes in 711 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:39:50.634960 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f2f0bcad-ded0-4a28-a5ab-c4f54fa141e3 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:50.635576 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f2f0bcad-ded0-4a28-a5ab-c4f54fa141e3 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 740c5d14-9669-45e2-9ba9-723926f774ab] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:50.651311 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f2f0bcad-ded0-4a28-a5ab-c4f54fa141e3 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:50.652024 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f2f0bcad-ded0-4a28-a5ab-c4f54fa141e3 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:50.654009 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f2f0bcad-ded0-4a28-a5ab-c4f54fa141e3 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:50.654892 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f2f0bcad-ded0-4a28-a5ab-c4f54fa141e3 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:50.658596 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f2f0bcad-ded0-4a28-a5ab-c4f54fa141e3 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:50.659253 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f2f0bcad-ded0-4a28-a5ab-c4f54fa141e3 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:51.426647 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f6168225-0490-4b6c-8c5f-3da3e986ed21 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:51.428400 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f6168225-0490-4b6c-8c5f-3da3e986ed21 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:51.446561 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f6168225-0490-4b6c-8c5f-3da3e986ed21 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:51.447066 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f6168225-0490-4b6c-8c5f-3da3e986ed21 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:51.447515 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f6168225-0490-4b6c-8c5f-3da3e986ed21 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:51.448244 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f6168225-0490-4b6c-8c5f-3da3e986ed21 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:51.448709 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f6168225-0490-4b6c-8c5f-3da3e986ed21 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:51.449140 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f6168225-0490-4b6c-8c5f-3da3e986ed21 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:51.993322 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f2f0bcad-ded0-4a28-a5ab-c4f54fa141e3 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:52.009885 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f2f0bcad-ded0-4a28-a5ab-c4f54fa141e3 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab" status: 200 len: 1496 microversion: 2.1 time: 1.374101 Oct 23 01:39:52.030422 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2893/5879] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:50 2022] GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab => generated 1496 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:39:52.591177 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f6168225-0490-4b6c-8c5f-3da3e986ed21 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:52.606872 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f6168225-0490-4b6c-8c5f-3da3e986ed21 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:52.608854 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f6168225-0490-4b6c-8c5f-3da3e986ed21 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:52.614735 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f6168225-0490-4b6c-8c5f-3da3e986ed21 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1845 microversion: 2.32 time: 1.197508 Oct 23 01:39:52.614735 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2987/5880] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:39:51 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1845 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:39:53.037297 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a58bb1f1-5a4a-40be-aa84-4892d4666930 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:53.037991 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a58bb1f1-5a4a-40be-aa84-4892d4666930 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 740c5d14-9669-45e2-9ba9-723926f774ab] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:53.066570 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a58bb1f1-5a4a-40be-aa84-4892d4666930 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:53.067083 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a58bb1f1-5a4a-40be-aa84-4892d4666930 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:53.067530 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a58bb1f1-5a4a-40be-aa84-4892d4666930 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:53.068251 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a58bb1f1-5a4a-40be-aa84-4892d4666930 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:53.068712 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a58bb1f1-5a4a-40be-aa84-4892d4666930 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:53.069144 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a58bb1f1-5a4a-40be-aa84-4892d4666930 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:53.362566 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-d302b681-0ad4-49cb-a271-c8a0bb675a89 req-7fe7af8d-3c3d-4d39-8cfd-ae13e1d0185d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f47e3006-cfbb-48bb-ae86-b018486c5e21", "tag": "b17738dd-6229-4e82-a18e-fbfd14792442"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:39:53.381849 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=3,nova_api:UPDATE=3 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:53.389279 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-d302b681-0ad4-49cb-a271-c8a0bb675a89 req-7fe7af8d-3c3d-4d39-8cfd-ae13e1d0185d service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:53.392258 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-d302b681-0ad4-49cb-a271-c8a0bb675a89 req-7fe7af8d-3c3d-4d39-8cfd-ae13e1d0185d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:53.394130 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-d302b681-0ad4-49cb-a271-c8a0bb675a89 req-7fe7af8d-3c3d-4d39-8cfd-ae13e1d0185d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:53.430769 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-d302b681-0ad4-49cb-a271-c8a0bb675a89 req-7fe7af8d-3c3d-4d39-8cfd-ae13e1d0185d service nova] Creating event network-changed:b17738dd-6229-4e82-a18e-fbfd14792442 for instance f47e3006-cfbb-48bb-ae86-b018486c5e21 on n-h2-master-1 Oct 23 01:39:53.446614 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-d302b681-0ad4-49cb-a271-c8a0bb675a89 req-7fe7af8d-3c3d-4d39-8cfd-ae13e1d0185d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088478 Oct 23 01:39:53.449819 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2988/5881] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:39:53.466750 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a58bb1f1-5a4a-40be-aa84-4892d4666930 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:53.479952 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a58bb1f1-5a4a-40be-aa84-4892d4666930 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab" status: 200 len: 1454 microversion: 2.1 time: 0.446948 Oct 23 01:39:53.481228 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2894/5882] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:53 2022] GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab => generated 1454 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:39:53.651467 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-38e5eb1e-6afa-4f98-a1f2-717acda4b618 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:53.652310 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-38e5eb1e-6afa-4f98-a1f2-717acda4b618 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:53.671412 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-38e5eb1e-6afa-4f98-a1f2-717acda4b618 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:53.672299 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-38e5eb1e-6afa-4f98-a1f2-717acda4b618 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:53.674204 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-38e5eb1e-6afa-4f98-a1f2-717acda4b618 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:53.684416 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-38e5eb1e-6afa-4f98-a1f2-717acda4b618 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:53.691874 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-38e5eb1e-6afa-4f98-a1f2-717acda4b618 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:53.691874 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-38e5eb1e-6afa-4f98-a1f2-717acda4b618 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:54.515749 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-19417e15-4dbf-49bb-8077-6fcf70227c30 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:54.517391 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-19417e15-4dbf-49bb-8077-6fcf70227c30 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 740c5d14-9669-45e2-9ba9-723926f774ab] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:54.528520 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-19417e15-4dbf-49bb-8077-6fcf70227c30 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:54.529448 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-19417e15-4dbf-49bb-8077-6fcf70227c30 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:54.532477 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-19417e15-4dbf-49bb-8077-6fcf70227c30 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:54.532477 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-19417e15-4dbf-49bb-8077-6fcf70227c30 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:54.532477 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-19417e15-4dbf-49bb-8077-6fcf70227c30 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:54.533130 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-19417e15-4dbf-49bb-8077-6fcf70227c30 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:54.617326 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-19417e15-4dbf-49bb-8077-6fcf70227c30 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:54.618261 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-19417e15-4dbf-49bb-8077-6fcf70227c30 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:54.618895 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-19417e15-4dbf-49bb-8077-6fcf70227c30 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:54.619510 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-19417e15-4dbf-49bb-8077-6fcf70227c30 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lazy-loading 'fault' on Instance uuid 740c5d14-9669-45e2-9ba9-723926f774ab {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:39:54.846254 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-38e5eb1e-6afa-4f98-a1f2-717acda4b618 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:54.852868 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-19417e15-4dbf-49bb-8077-6fcf70227c30 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:54.862083 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-19417e15-4dbf-49bb-8077-6fcf70227c30 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab" status: 200 len: 1305 microversion: 2.1 time: 0.351859 Oct 23 01:39:54.870511 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2895/5883] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:54 2022] GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab => generated 1305 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:39:54.886217 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-38e5eb1e-6afa-4f98-a1f2-717acda4b618 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:54.892401 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-38e5eb1e-6afa-4f98-a1f2-717acda4b618 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:54.896485 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-38e5eb1e-6afa-4f98-a1f2-717acda4b618 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1845 microversion: 2.32 time: 1.253027 Oct 23 01:39:54.899109 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2989/5884] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:39:53 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1845 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:39:55.492758 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-1ac3c95e-f156-4266-91c6-d41cc204bf39 req-1f226053-b1b6-4f36-a9ae-9be6d920cb4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "740c5d14-9669-45e2-9ba9-723926f774ab", "name": "network-vif-deleted", "tag": "f9f5f6e7-a37b-43ef-b9e5-85882f8c1cf7"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:39:55.506695 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-1ac3c95e-f156-4266-91c6-d41cc204bf39 req-1f226053-b1b6-4f36-a9ae-9be6d920cb4a service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:55.529492 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-1ac3c95e-f156-4266-91c6-d41cc204bf39 req-1f226053-b1b6-4f36-a9ae-9be6d920cb4a service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:55.530732 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-1ac3c95e-f156-4266-91c6-d41cc204bf39 req-1f226053-b1b6-4f36-a9ae-9be6d920cb4a service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:55.555234 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-1ac3c95e-f156-4266-91c6-d41cc204bf39 req-1f226053-b1b6-4f36-a9ae-9be6d920cb4a service nova] Creating event network-vif-deleted:f9f5f6e7-a37b-43ef-b9e5-85882f8c1cf7 for instance 740c5d14-9669-45e2-9ba9-723926f774ab on n-h2-master-1 Oct 23 01:39:55.568436 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-1ac3c95e-f156-4266-91c6-d41cc204bf39 req-1f226053-b1b6-4f36-a9ae-9be6d920cb4a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088028 Oct 23 01:39:55.569704 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2896/5885] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:39:55.900115 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4a61292c-70b0-4c99-bd13-2ee4066bff1c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:55.900797 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4a61292c-70b0-4c99-bd13-2ee4066bff1c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: 740c5d14-9669-45e2-9ba9-723926f774ab] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:55.923094 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4a61292c-70b0-4c99-bd13-2ee4066bff1c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:55.926625 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4a61292c-70b0-4c99-bd13-2ee4066bff1c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:55.928720 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4a61292c-70b0-4c99-bd13-2ee4066bff1c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:55.929594 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4a61292c-70b0-4c99-bd13-2ee4066bff1c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:55.930699 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0da32c3e-e62a-4eac-9c54-9833e4e7f5d2 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:55.931572 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0da32c3e-e62a-4eac-9c54-9833e4e7f5d2 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:55.933531 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4a61292c-70b0-4c99-bd13-2ee4066bff1c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:55.936453 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4a61292c-70b0-4c99-bd13-2ee4066bff1c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:55.950210 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0da32c3e-e62a-4eac-9c54-9833e4e7f5d2 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:55.955002 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0da32c3e-e62a-4eac-9c54-9833e4e7f5d2 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:55.956881 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0da32c3e-e62a-4eac-9c54-9833e4e7f5d2 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:55.962346 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0da32c3e-e62a-4eac-9c54-9833e4e7f5d2 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:55.969606 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0da32c3e-e62a-4eac-9c54-9833e4e7f5d2 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:55.970494 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0da32c3e-e62a-4eac-9c54-9833e4e7f5d2 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:56.001298 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-4a61292c-70b0-4c99-bd13-2ee4066bff1c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] HTTP exception thrown: Instance 740c5d14-9669-45e2-9ba9-723926f774ab could not be found. Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4a61292c-70b0-4c99-bd13-2ee4066bff1c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Request method failure captured: Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab HTTP/1.1 Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJlXoIbKMNvA25YGQumrqoImspVHuLOUfoRmRPwWLxDcq7fsPtAFy81tjfSaLwjwvx2BxTkWPFCI5j4ehQFfit79dYKsAdSxV9xkhbHmIt2kWQXztVbC6m8EepFiVRbJzbhnCNQVWDwdnvsGEsySDgHPULZl6m0PSSbaKhzaMZDKOHE Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: aa4e3018a6ca477c9a1d7215ad98d9e9 Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServerActionsTestJSON-893303043 Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/aa4e3018a6ca477c9a1d7215ad98d9e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_aa4e3018a6ca477c9a1d7215ad98d9e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/aa4e3018a6ca477c9a1d7215ad98d9e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/aa4e3018a6ca477c9a1d7215ad98d9e9"}]}] Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServerActionsTestJSON-893303043 Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: aa4e3018a6ca477c9a1d7215ad98d9e9 Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServerActionsTestJSON-893303043 Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServerActionsTestJSON-893303043-project Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: bb03047092f64e2abbf78e9db1a06e0a Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServerActionsTestJSON-893303043-project Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 740c5d14-9669-45e2-9ba9-723926f774ab could not be found. Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '740c5d14-9669-45e2-9ba9-723926f774ab'} Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 740c5d14-9669-45e2-9ba9-723926f774ab could not be found. Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 740c5d14-9669-45e2-9ba9-723926f774ab could not be found. Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:39:56.019254 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:39:56.023830 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:39:56.023830 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:39:56.023830 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:39:56.023830 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:39:56.023830 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:39:56.023830 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 740c5d14-9669-45e2-9ba9-723926f774ab could not be found. Oct 23 01:39:56.023830 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:39:56.023830 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4a61292c-70b0-4c99-bd13-2ee4066bff1c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Returning 404 to user: Instance 740c5d14-9669-45e2-9ba9-723926f774ab could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:39:56.023830 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4a61292c-70b0-4c99-bd13-2ee4066bff1c tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab" status: 404 len: 111 microversion: 2.1 time: 0.127267 Oct 23 01:39:56.033749 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2990/5886] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:55 2022] GET /compute/v2.1/servers/740c5d14-9669-45e2-9ba9-723926f774ab => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:39:56.042828 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ff16dab2-38f6-48cd-aaa1-281e500038e8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:56.043404 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ff16dab2-38f6-48cd-aaa1-281e500038e8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:56.051609 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ff16dab2-38f6-48cd-aaa1-281e500038e8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:56.052107 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ff16dab2-38f6-48cd-aaa1-281e500038e8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:56.052640 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ff16dab2-38f6-48cd-aaa1-281e500038e8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:56.053445 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ff16dab2-38f6-48cd-aaa1-281e500038e8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:56.053905 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ff16dab2-38f6-48cd-aaa1-281e500038e8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:56.054503 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ff16dab2-38f6-48cd-aaa1-281e500038e8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:56.164266 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ff16dab2-38f6-48cd-aaa1-281e500038e8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:39:56.648680 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ff16dab2-38f6-48cd-aaa1-281e500038e8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "DELETE /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 204 len: 0 microversion: 2.1 time: 0.612385 Oct 23 01:39:56.649286 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2991/5887] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:39:56 2022] DELETE /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:39:56.658400 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4bb3addb-adb3-4eff-bbcc-9a783064a7e1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:56.659498 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4bb3addb-adb3-4eff-bbcc-9a783064a7e1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:56.672903 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4bb3addb-adb3-4eff-bbcc-9a783064a7e1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:56.673663 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4bb3addb-adb3-4eff-bbcc-9a783064a7e1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:56.674373 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4bb3addb-adb3-4eff-bbcc-9a783064a7e1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:56.675270 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4bb3addb-adb3-4eff-bbcc-9a783064a7e1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:56.679165 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4bb3addb-adb3-4eff-bbcc-9a783064a7e1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:56.679956 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4bb3addb-adb3-4eff-bbcc-9a783064a7e1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:57.579764 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0da32c3e-e62a-4eac-9c54-9833e4e7f5d2 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:57.603878 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0da32c3e-e62a-4eac-9c54-9833e4e7f5d2 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:57.605402 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0da32c3e-e62a-4eac-9c54-9833e4e7f5d2 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:57.606725 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0da32c3e-e62a-4eac-9c54-9833e4e7f5d2 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1866 microversion: 2.32 time: 1.681497 Oct 23 01:39:57.623026 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2897/5888] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:39:55 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1866 bytes in 1683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:39:57.668762 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-c703ae98-b479-4647-8f9e-bcf4ba3e8b24 req-6fbd2838-1063-441d-8a27-abab78df0875 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f47e3006-cfbb-48bb-ae86-b018486c5e21", "tag": "fec59d18-4586-4075-a7ad-b238f66cb30f"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:39:57.687770 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-c703ae98-b479-4647-8f9e-bcf4ba3e8b24 req-6fbd2838-1063-441d-8a27-abab78df0875 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:57.691419 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-c703ae98-b479-4647-8f9e-bcf4ba3e8b24 req-6fbd2838-1063-441d-8a27-abab78df0875 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:57.693831 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-c703ae98-b479-4647-8f9e-bcf4ba3e8b24 req-6fbd2838-1063-441d-8a27-abab78df0875 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:57.708124 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-c703ae98-b479-4647-8f9e-bcf4ba3e8b24 req-6fbd2838-1063-441d-8a27-abab78df0875 service nova] Creating event network-changed:fec59d18-4586-4075-a7ad-b238f66cb30f for instance f47e3006-cfbb-48bb-ae86-b018486c5e21 on n-h2-master-1 Oct 23 01:39:57.716033 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-c703ae98-b479-4647-8f9e-bcf4ba3e8b24 req-6fbd2838-1063-441d-8a27-abab78df0875 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050844 Oct 23 01:39:57.716741 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2898/5889] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:39:57.755492 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4bb3addb-adb3-4eff-bbcc-9a783064a7e1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:57.782608 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4bb3addb-adb3-4eff-bbcc-9a783064a7e1 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1675 microversion: 2.1 time: 1.124291 Oct 23 01:39:57.796049 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2992/5890] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:56 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1675 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:39:58.642308 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-81a885a2-0663-420f-b7ef-71b36aacd98b tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:58.646230 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-81a885a2-0663-420f-b7ef-71b36aacd98b tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:58.656688 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-81a885a2-0663-420f-b7ef-71b36aacd98b tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:58.657192 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-81a885a2-0663-420f-b7ef-71b36aacd98b tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:58.657641 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-81a885a2-0663-420f-b7ef-71b36aacd98b tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:58.658390 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-81a885a2-0663-420f-b7ef-71b36aacd98b tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:58.658855 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-81a885a2-0663-420f-b7ef-71b36aacd98b tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:58.659288 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-81a885a2-0663-420f-b7ef-71b36aacd98b tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:58.810561 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e0e336ea-379b-4156-9bd6-6dbde9acb69e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:39:58.812112 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e0e336ea-379b-4156-9bd6-6dbde9acb69e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:39:58.834989 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0e336ea-379b-4156-9bd6-6dbde9acb69e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:58.837793 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0e336ea-379b-4156-9bd6-6dbde9acb69e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:58.838264 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0e336ea-379b-4156-9bd6-6dbde9acb69e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:58.839475 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0e336ea-379b-4156-9bd6-6dbde9acb69e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:39:58.840104 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0e336ea-379b-4156-9bd6-6dbde9acb69e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:39:58.840707 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0e336ea-379b-4156-9bd6-6dbde9acb69e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:39:59.322375 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e0e336ea-379b-4156-9bd6-6dbde9acb69e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:59.335054 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e0e336ea-379b-4156-9bd6-6dbde9acb69e tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1675 microversion: 2.1 time: 0.527843 Oct 23 01:39:59.335591 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2993/5891] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:39:58 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1675 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:39:59.449783 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-81a885a2-0663-420f-b7ef-71b36aacd98b tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:59.460651 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-81a885a2-0663-420f-b7ef-71b36aacd98b tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:59.462146 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-81a885a2-0663-420f-b7ef-71b36aacd98b tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:39:59.463505 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-81a885a2-0663-420f-b7ef-71b36aacd98b tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1887 microversion: 2.32 time: 0.826200 Oct 23 01:39:59.465257 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2899/5892] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:39:58 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1887 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:40:00.213337 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-e2eb04da-3d3a-478e-a929-b7ec40caf992 req-b567cfbd-b82a-4b3d-960d-f43aa38daea3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f47e3006-cfbb-48bb-ae86-b018486c5e21", "tag": "58e7a908-4248-4827-9552-0efabdaaf107"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:40:00.245851 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-e2eb04da-3d3a-478e-a929-b7ec40caf992 req-b567cfbd-b82a-4b3d-960d-f43aa38daea3 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:00.245851 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-e2eb04da-3d3a-478e-a929-b7ec40caf992 req-b567cfbd-b82a-4b3d-960d-f43aa38daea3 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:00.245851 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-e2eb04da-3d3a-478e-a929-b7ec40caf992 req-b567cfbd-b82a-4b3d-960d-f43aa38daea3 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:00.278689 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-e2eb04da-3d3a-478e-a929-b7ec40caf992 req-b567cfbd-b82a-4b3d-960d-f43aa38daea3 service nova] Creating event network-changed:58e7a908-4248-4827-9552-0efabdaaf107 for instance f47e3006-cfbb-48bb-ae86-b018486c5e21 on n-h2-master-1 Oct 23 01:40:00.288048 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-e2eb04da-3d3a-478e-a929-b7ec40caf992 req-b567cfbd-b82a-4b3d-960d-f43aa38daea3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079154 Oct 23 01:40:00.294741 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2994/5893] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:40:00.377233 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4c84f115-e4c5-48bb-b09f-5d2ab10529f8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:00.380896 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4c84f115-e4c5-48bb-b09f-5d2ab10529f8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:00.389838 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4c84f115-e4c5-48bb-b09f-5d2ab10529f8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:00.391169 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4c84f115-e4c5-48bb-b09f-5d2ab10529f8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:00.391808 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4c84f115-e4c5-48bb-b09f-5d2ab10529f8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:00.392741 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4c84f115-e4c5-48bb-b09f-5d2ab10529f8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:00.393917 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4c84f115-e4c5-48bb-b09f-5d2ab10529f8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:00.394682 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4c84f115-e4c5-48bb-b09f-5d2ab10529f8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:00.502739 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0770cad6-817c-4d52-97c7-c54c6de3c905 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:00.504404 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0770cad6-817c-4d52-97c7-c54c6de3c905 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:00.519970 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0770cad6-817c-4d52-97c7-c54c6de3c905 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:00.520688 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0770cad6-817c-4d52-97c7-c54c6de3c905 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:00.521441 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0770cad6-817c-4d52-97c7-c54c6de3c905 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:00.523381 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0770cad6-817c-4d52-97c7-c54c6de3c905 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:00.525157 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0770cad6-817c-4d52-97c7-c54c6de3c905 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:00.527715 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0770cad6-817c-4d52-97c7-c54c6de3c905 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:01.106386 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0770cad6-817c-4d52-97c7-c54c6de3c905 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:01.126322 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0770cad6-817c-4d52-97c7-c54c6de3c905 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:01.131876 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0770cad6-817c-4d52-97c7-c54c6de3c905 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:01.136764 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0770cad6-817c-4d52-97c7-c54c6de3c905 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1875 microversion: 2.32 time: 0.644429 Oct 23 01:40:01.139293 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2995/5894] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:40:00 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1875 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:40:01.236823 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4c84f115-e4c5-48bb-b09f-5d2ab10529f8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:01.251700 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4c84f115-e4c5-48bb-b09f-5d2ab10529f8 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1675 microversion: 2.1 time: 0.893757 Oct 23 01:40:01.258021 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2900/5895] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:40:00 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1675 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:40:02.173143 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7da120e2-3795-4a71-b1b5-e438702613cb tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:02.173919 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7da120e2-3795-4a71-b1b5-e438702613cb tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:02.186443 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7da120e2-3795-4a71-b1b5-e438702613cb tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:02.187775 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7da120e2-3795-4a71-b1b5-e438702613cb tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:02.188743 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7da120e2-3795-4a71-b1b5-e438702613cb tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:02.190572 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7da120e2-3795-4a71-b1b5-e438702613cb tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:02.193157 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7da120e2-3795-4a71-b1b5-e438702613cb tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:02.195025 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7da120e2-3795-4a71-b1b5-e438702613cb tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:02.278370 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fc4f1453-e537-4f71-a59f-4dba884212af tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:02.280845 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-fc4f1453-e537-4f71-a59f-4dba884212af tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:02.314544 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc4f1453-e537-4f71-a59f-4dba884212af tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:02.315098 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc4f1453-e537-4f71-a59f-4dba884212af tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:02.315537 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc4f1453-e537-4f71-a59f-4dba884212af tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:02.321197 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc4f1453-e537-4f71-a59f-4dba884212af tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:02.327122 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc4f1453-e537-4f71-a59f-4dba884212af tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:02.328359 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc4f1453-e537-4f71-a59f-4dba884212af tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:02.523602 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-fc4f1453-e537-4f71-a59f-4dba884212af tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:02.539715 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fc4f1453-e537-4f71-a59f-4dba884212af tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1323 microversion: 2.1 time: 0.266649 Oct 23 01:40:02.560546 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2901/5896] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:40:02 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1323 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:40:02.568511 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-d431ac40-f5d2-496c-b878-8069d4f2f70e req-8da12d2e-f9d4-44ec-993d-6424f317ca2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa616812-f379-45fb-8e7e-fefe7570dc98", "name": "network-vif-deleted", "tag": "6de1369a-94d0-42a0-a57f-9deacb90b66f"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:40:02.584098 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-d431ac40-f5d2-496c-b878-8069d4f2f70e req-8da12d2e-f9d4-44ec-993d-6424f317ca2e service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:02.585726 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-d431ac40-f5d2-496c-b878-8069d4f2f70e req-8da12d2e-f9d4-44ec-993d-6424f317ca2e service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:02.586338 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-d431ac40-f5d2-496c-b878-8069d4f2f70e req-8da12d2e-f9d4-44ec-993d-6424f317ca2e service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:02.603032 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-d431ac40-f5d2-496c-b878-8069d4f2f70e req-8da12d2e-f9d4-44ec-993d-6424f317ca2e service nova] Creating event network-vif-deleted:6de1369a-94d0-42a0-a57f-9deacb90b66f for instance fa616812-f379-45fb-8e7e-fefe7570dc98 on n-h1-master-1 Oct 23 01:40:02.609607 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-d431ac40-f5d2-496c-b878-8069d4f2f70e req-8da12d2e-f9d4-44ec-993d-6424f317ca2e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047351 Oct 23 01:40:02.610919 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2902/5897] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:40:03.045117 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7da120e2-3795-4a71-b1b5-e438702613cb tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:03.059149 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7da120e2-3795-4a71-b1b5-e438702613cb tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:03.062518 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7da120e2-3795-4a71-b1b5-e438702613cb tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:03.063930 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7da120e2-3795-4a71-b1b5-e438702613cb tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1875 microversion: 2.32 time: 0.896423 Oct 23 01:40:03.064801 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2996/5898] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:40:02 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1875 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:40:03.574207 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-64b0eb16-33f6-47e0-ba0d-cc934b958d4a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:03.575044 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-64b0eb16-33f6-47e0-ba0d-cc934b958d4a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:03.580718 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:03.597218 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64b0eb16-33f6-47e0-ba0d-cc934b958d4a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:03.598280 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64b0eb16-33f6-47e0-ba0d-cc934b958d4a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:03.599101 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64b0eb16-33f6-47e0-ba0d-cc934b958d4a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:03.600208 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64b0eb16-33f6-47e0-ba0d-cc934b958d4a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:03.600907 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64b0eb16-33f6-47e0-ba0d-cc934b958d4a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:03.601550 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64b0eb16-33f6-47e0-ba0d-cc934b958d4a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:03.680443 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64b0eb16-33f6-47e0-ba0d-cc934b958d4a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:03.680443 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64b0eb16-33f6-47e0-ba0d-cc934b958d4a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:03.680443 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64b0eb16-33f6-47e0-ba0d-cc934b958d4a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:03.680443 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-64b0eb16-33f6-47e0-ba0d-cc934b958d4a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lazy-loading 'fault' on Instance uuid fa616812-f379-45fb-8e7e-fefe7570dc98 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:40:04.099470 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-767d9035-3de9-4bf1-a0fb-bf803deedf35 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:04.100917 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-767d9035-3de9-4bf1-a0fb-bf803deedf35 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:04.104149 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-64b0eb16-33f6-47e0-ba0d-cc934b958d4a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb03047092f64e2abbf78e9db1a06e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:04.112804 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-64b0eb16-33f6-47e0-ba0d-cc934b958d4a tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 200 len: 1328 microversion: 2.1 time: 0.545949 Oct 23 01:40:04.113454 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-767d9035-3de9-4bf1-a0fb-bf803deedf35 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:04.115733 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-767d9035-3de9-4bf1-a0fb-bf803deedf35 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:04.116318 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-767d9035-3de9-4bf1-a0fb-bf803deedf35 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:04.116822 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2903/5899] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:40:03 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 1328 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:40:04.117632 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-767d9035-3de9-4bf1-a0fb-bf803deedf35 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:04.119509 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-767d9035-3de9-4bf1-a0fb-bf803deedf35 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:04.121798 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-767d9035-3de9-4bf1-a0fb-bf803deedf35 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:04.612612 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-767d9035-3de9-4bf1-a0fb-bf803deedf35 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:04.634306 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-767d9035-3de9-4bf1-a0fb-bf803deedf35 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:04.635880 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-767d9035-3de9-4bf1-a0fb-bf803deedf35 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:04.637071 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-767d9035-3de9-4bf1-a0fb-bf803deedf35 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1875 microversion: 2.32 time: 0.542006 Oct 23 01:40:04.637675 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2997/5900] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:40:04 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1875 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:40:04.659637 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-5a8dd7fd-c568-47f9-91ff-240815724275 req-53c90b76-614e-4ebd-8586-12cc06f6c490 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f47e3006-cfbb-48bb-ae86-b018486c5e21", "tag": "345a0e13-1a42-4284-a64e-2fa1f828e62c"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:40:04.677419 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-5a8dd7fd-c568-47f9-91ff-240815724275 req-53c90b76-614e-4ebd-8586-12cc06f6c490 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:04.682475 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-5a8dd7fd-c568-47f9-91ff-240815724275 req-53c90b76-614e-4ebd-8586-12cc06f6c490 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:04.683117 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-5a8dd7fd-c568-47f9-91ff-240815724275 req-53c90b76-614e-4ebd-8586-12cc06f6c490 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:04.710556 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-5a8dd7fd-c568-47f9-91ff-240815724275 req-53c90b76-614e-4ebd-8586-12cc06f6c490 service nova] Creating event network-changed:345a0e13-1a42-4284-a64e-2fa1f828e62c for instance f47e3006-cfbb-48bb-ae86-b018486c5e21 on n-h2-master-1 Oct 23 01:40:04.718992 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-5a8dd7fd-c568-47f9-91ff-240815724275 req-53c90b76-614e-4ebd-8586-12cc06f6c490 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061827 Oct 23 01:40:04.722507 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2904/5901] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:40:05.148336 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a784ffe6-ce9d-4ec0-8b7e-78441cf0ba3d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:05.150552 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a784ffe6-ce9d-4ec0-8b7e-78441cf0ba3d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] [instance: fa616812-f379-45fb-8e7e-fefe7570dc98] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:05.177155 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a784ffe6-ce9d-4ec0-8b7e-78441cf0ba3d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:05.178266 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a784ffe6-ce9d-4ec0-8b7e-78441cf0ba3d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:05.178871 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a784ffe6-ce9d-4ec0-8b7e-78441cf0ba3d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:05.179968 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a784ffe6-ce9d-4ec0-8b7e-78441cf0ba3d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:05.180654 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a784ffe6-ce9d-4ec0-8b7e-78441cf0ba3d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:05.181418 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a784ffe6-ce9d-4ec0-8b7e-78441cf0ba3d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:05.220890 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-a784ffe6-ce9d-4ec0-8b7e-78441cf0ba3d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] HTTP exception thrown: Instance fa616812-f379-45fb-8e7e-fefe7570dc98 could not be found. Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a784ffe6-ce9d-4ec0-8b7e-78441cf0ba3d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Request method failure captured: Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 HTTP/1.1 Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJlXoIbKMNvA25YGQumrqoImspVHuLOUfoRmRPwWLxDcq7fsPtAFy81tjfSaLwjwvx2BxTkWPFCI5j4ehQFfit79dYKsAdSxV9xkhbHmIt2kWQXztVbC6m8EepFiVRbJzbhnCNQVWDwdnvsGEsySDgHPULZl6m0PSSbaKhzaMZDKOHE Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: aa4e3018a6ca477c9a1d7215ad98d9e9 Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServerActionsTestJSON-893303043 Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/aa4e3018a6ca477c9a1d7215ad98d9e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_aa4e3018a6ca477c9a1d7215ad98d9e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/aa4e3018a6ca477c9a1d7215ad98d9e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/aa4e3018a6ca477c9a1d7215ad98d9e9"}]}] Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServerActionsTestJSON-893303043 Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: aa4e3018a6ca477c9a1d7215ad98d9e9 Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServerActionsTestJSON-893303043 Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServerActionsTestJSON-893303043-project Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: bb03047092f64e2abbf78e9db1a06e0a Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServerActionsTestJSON-893303043-project Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: exception: Instance fa616812-f379-45fb-8e7e-fefe7570dc98 could not be found. Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'fa616812-f379-45fb-8e7e-fefe7570dc98'} Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa616812-f379-45fb-8e7e-fefe7570dc98 could not be found. Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa616812-f379-45fb-8e7e-fefe7570dc98 could not be found. Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:40:05.225541 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:40:05.233230 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:40:05.233230 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:40:05.233230 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:40:05.233230 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:40:05.233230 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:40:05.233230 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa616812-f379-45fb-8e7e-fefe7570dc98 could not be found. Oct 23 01:40:05.233230 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:40:05.238434 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a784ffe6-ce9d-4ec0-8b7e-78441cf0ba3d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Returning 404 to user: Instance fa616812-f379-45fb-8e7e-fefe7570dc98 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:40:05.239668 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a784ffe6-ce9d-4ec0-8b7e-78441cf0ba3d tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98" status: 404 len: 111 microversion: 2.1 time: 0.099893 Oct 23 01:40:05.244076 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2998/5902] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:40:05 2022] GET /compute/v2.1/servers/fa616812-f379-45fb-8e7e-fefe7570dc98 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:40:05.249593 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-23e54be2-cebb-406d-84ba-53a061a450c3 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] Calling method '.version_select at 0x7f5cc0d98a60>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:05.375074 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-23e54be2-cebb-406d-84ba-53a061a450c3 tempest-ServerActionsTestJSON-893303043 tempest-ServerActionsTestJSON-893303043-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-941449111" status: 202 len: 0 microversion: 2.1 time: 0.129627 Oct 23 01:40:05.379898 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2905/5903] 10.222.0.42 () {58 vars in 1218 bytes} [Sun Oct 23 01:40:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-941449111 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:40:05.669761 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e5afe110-7b03-4197-94af-951fbf6c5800 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:05.670961 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e5afe110-7b03-4197-94af-951fbf6c5800 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:05.682860 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e5afe110-7b03-4197-94af-951fbf6c5800 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:05.683617 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e5afe110-7b03-4197-94af-951fbf6c5800 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:05.686612 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e5afe110-7b03-4197-94af-951fbf6c5800 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:05.687637 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e5afe110-7b03-4197-94af-951fbf6c5800 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:05.690474 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e5afe110-7b03-4197-94af-951fbf6c5800 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:05.691154 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e5afe110-7b03-4197-94af-951fbf6c5800 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:06.726553 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e5afe110-7b03-4197-94af-951fbf6c5800 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:06.738815 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e5afe110-7b03-4197-94af-951fbf6c5800 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:06.744375 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e5afe110-7b03-4197-94af-951fbf6c5800 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:06.744375 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e5afe110-7b03-4197-94af-951fbf6c5800 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1875 microversion: 2.32 time: 1.076916 Oct 23 01:40:06.758945 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-277450b3-885f-4b50-95e8-ca18e1d42d9e req-d6757e52-eb2c-4ac4-8917-b817d82573f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f47e3006-cfbb-48bb-ae86-b018486c5e21", "tag": "020cb08c-2e13-452d-aab8-e6b34a8be515"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:40:06.759436 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 2999/5904] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:40:05 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1875 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:40:06.774019 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-277450b3-885f-4b50-95e8-ca18e1d42d9e req-d6757e52-eb2c-4ac4-8917-b817d82573f5 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:06.774566 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-277450b3-885f-4b50-95e8-ca18e1d42d9e req-d6757e52-eb2c-4ac4-8917-b817d82573f5 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:06.774999 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-277450b3-885f-4b50-95e8-ca18e1d42d9e req-d6757e52-eb2c-4ac4-8917-b817d82573f5 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:06.786932 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-277450b3-885f-4b50-95e8-ca18e1d42d9e req-d6757e52-eb2c-4ac4-8917-b817d82573f5 service nova] Creating event network-changed:020cb08c-2e13-452d-aab8-e6b34a8be515 for instance f47e3006-cfbb-48bb-ae86-b018486c5e21 on n-h2-master-1 Oct 23 01:40:06.800542 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-277450b3-885f-4b50-95e8-ca18e1d42d9e req-d6757e52-eb2c-4ac4-8917-b817d82573f5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046293 Oct 23 01:40:06.801905 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2906/5905] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:40:07.773198 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0d49bb29-4adc-4959-a04a-0acf92ae8916 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:07.774629 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0d49bb29-4adc-4959-a04a-0acf92ae8916 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:07.791767 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0d49bb29-4adc-4959-a04a-0acf92ae8916 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:07.792478 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0d49bb29-4adc-4959-a04a-0acf92ae8916 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:07.793084 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0d49bb29-4adc-4959-a04a-0acf92ae8916 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:07.794054 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0d49bb29-4adc-4959-a04a-0acf92ae8916 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:07.794686 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0d49bb29-4adc-4959-a04a-0acf92ae8916 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:07.795278 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0d49bb29-4adc-4959-a04a-0acf92ae8916 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:08.357731 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0d49bb29-4adc-4959-a04a-0acf92ae8916 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:08.376899 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0d49bb29-4adc-4959-a04a-0acf92ae8916 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:08.379094 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0d49bb29-4adc-4959-a04a-0acf92ae8916 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:08.380529 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0d49bb29-4adc-4959-a04a-0acf92ae8916 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1875 microversion: 2.32 time: 0.612262 Oct 23 01:40:08.383021 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3000/5906] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:40:07 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1875 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:40:09.416192 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cb83a2a9-79cb-49ff-ab64-7b47d50ccbac tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:09.417000 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cb83a2a9-79cb-49ff-ab64-7b47d50ccbac tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:09.433896 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb83a2a9-79cb-49ff-ab64-7b47d50ccbac tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:09.434425 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb83a2a9-79cb-49ff-ab64-7b47d50ccbac tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:09.434866 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb83a2a9-79cb-49ff-ab64-7b47d50ccbac tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:09.435579 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb83a2a9-79cb-49ff-ab64-7b47d50ccbac tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:09.442540 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb83a2a9-79cb-49ff-ab64-7b47d50ccbac tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:09.443301 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb83a2a9-79cb-49ff-ab64-7b47d50ccbac tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:09.497390 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=100 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:09.995676 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cb83a2a9-79cb-49ff-ab64-7b47d50ccbac tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:10.022331 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cb83a2a9-79cb-49ff-ab64-7b47d50ccbac tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:10.026891 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cb83a2a9-79cb-49ff-ab64-7b47d50ccbac tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:10.045249 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cb83a2a9-79cb-49ff-ab64-7b47d50ccbac tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1875 microversion: 2.32 time: 0.632571 Oct 23 01:40:10.067971 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2907/5907] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:40:09 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1875 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:40:10.461524 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-283f7a9d-2180-4739-b60d-7775b7ddd7cc req-429fa580-cefa-4698-aae4-0d1b0ad77ba6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f47e3006-cfbb-48bb-ae86-b018486c5e21", "tag": "7f192cbc-e5eb-416b-ba58-875c5f887eb7"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:40:10.478984 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-283f7a9d-2180-4739-b60d-7775b7ddd7cc req-429fa580-cefa-4698-aae4-0d1b0ad77ba6 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:10.478984 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-283f7a9d-2180-4739-b60d-7775b7ddd7cc req-429fa580-cefa-4698-aae4-0d1b0ad77ba6 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:10.479299 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-283f7a9d-2180-4739-b60d-7775b7ddd7cc req-429fa580-cefa-4698-aae4-0d1b0ad77ba6 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:10.527962 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-283f7a9d-2180-4739-b60d-7775b7ddd7cc req-429fa580-cefa-4698-aae4-0d1b0ad77ba6 service nova] Creating event network-changed:7f192cbc-e5eb-416b-ba58-875c5f887eb7 for instance f47e3006-cfbb-48bb-ae86-b018486c5e21 on n-h2-master-1 Oct 23 01:40:10.539227 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-283f7a9d-2180-4739-b60d-7775b7ddd7cc req-429fa580-cefa-4698-aae4-0d1b0ad77ba6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078867 Oct 23 01:40:10.546364 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3001/5908] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:40:11.086386 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b39311e0-875c-4698-bb1f-c401a6439be6 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:11.087762 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b39311e0-875c-4698-bb1f-c401a6439be6 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:11.107560 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b39311e0-875c-4698-bb1f-c401a6439be6 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:11.109405 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b39311e0-875c-4698-bb1f-c401a6439be6 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:11.117279 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b39311e0-875c-4698-bb1f-c401a6439be6 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:11.118442 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b39311e0-875c-4698-bb1f-c401a6439be6 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:11.120063 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b39311e0-875c-4698-bb1f-c401a6439be6 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:11.120927 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b39311e0-875c-4698-bb1f-c401a6439be6 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:12.141295 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b39311e0-875c-4698-bb1f-c401a6439be6 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:12.149847 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b39311e0-875c-4698-bb1f-c401a6439be6 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:12.155057 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b39311e0-875c-4698-bb1f-c401a6439be6 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:12.156396 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b39311e0-875c-4698-bb1f-c401a6439be6 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1875 microversion: 2.32 time: 1.074296 Oct 23 01:40:12.159223 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2908/5909] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:40:11 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1875 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:40:13.188701 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-213806a9-4e20-45d6-b8ba-72b433b321ec tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:13.189504 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-213806a9-4e20-45d6-b8ba-72b433b321ec tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:13.198433 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-213806a9-4e20-45d6-b8ba-72b433b321ec tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:13.199322 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-213806a9-4e20-45d6-b8ba-72b433b321ec tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:13.199982 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-213806a9-4e20-45d6-b8ba-72b433b321ec tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:13.201102 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-213806a9-4e20-45d6-b8ba-72b433b321ec tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:13.201811 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-213806a9-4e20-45d6-b8ba-72b433b321ec tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:13.202932 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-213806a9-4e20-45d6-b8ba-72b433b321ec tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:13.209311 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:13.636006 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-213806a9-4e20-45d6-b8ba-72b433b321ec tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:13.649294 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-213806a9-4e20-45d6-b8ba-72b433b321ec tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:13.650792 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-213806a9-4e20-45d6-b8ba-72b433b321ec tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:13.652029 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-213806a9-4e20-45d6-b8ba-72b433b321ec tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1875 microversion: 2.32 time: 0.467841 Oct 23 01:40:13.652782 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3002/5910] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:40:13 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1875 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:40:14.683456 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-faaaf0dd-8479-45b2-b376-6ddae1af6eb1 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:14.684697 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-faaaf0dd-8479-45b2-b376-6ddae1af6eb1 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:14.699046 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-faaaf0dd-8479-45b2-b376-6ddae1af6eb1 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:14.701106 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-faaaf0dd-8479-45b2-b376-6ddae1af6eb1 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:14.701772 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-faaaf0dd-8479-45b2-b376-6ddae1af6eb1 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:14.704030 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-faaaf0dd-8479-45b2-b376-6ddae1af6eb1 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:14.708612 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-faaaf0dd-8479-45b2-b376-6ddae1af6eb1 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:14.709347 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-faaaf0dd-8479-45b2-b376-6ddae1af6eb1 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:15.487805 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-faaaf0dd-8479-45b2-b376-6ddae1af6eb1 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:15.509287 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-faaaf0dd-8479-45b2-b376-6ddae1af6eb1 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:15.515111 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-faaaf0dd-8479-45b2-b376-6ddae1af6eb1 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:15.519163 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-faaaf0dd-8479-45b2-b376-6ddae1af6eb1 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1875 microversion: 2.32 time: 0.838883 Oct 23 01:40:15.539569 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2909/5911] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:40:14 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1875 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:40:16.345465 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-b68782a5-b427-4089-8c8a-b7c4b0bd388b req-25342f01-2212-48ce-8767-8a55c3e93079 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f47e3006-cfbb-48bb-ae86-b018486c5e21", "tag": "ee70f73c-88ff-4855-a82e-88caa393f0fc"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:40:16.376279 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-b68782a5-b427-4089-8c8a-b7c4b0bd388b req-25342f01-2212-48ce-8767-8a55c3e93079 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:16.380113 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-b68782a5-b427-4089-8c8a-b7c4b0bd388b req-25342f01-2212-48ce-8767-8a55c3e93079 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:16.380843 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-b68782a5-b427-4089-8c8a-b7c4b0bd388b req-25342f01-2212-48ce-8767-8a55c3e93079 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:16.409264 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-b68782a5-b427-4089-8c8a-b7c4b0bd388b req-25342f01-2212-48ce-8767-8a55c3e93079 service nova] Creating event network-changed:ee70f73c-88ff-4855-a82e-88caa393f0fc for instance f47e3006-cfbb-48bb-ae86-b018486c5e21 on n-h2-master-1 Oct 23 01:40:16.430199 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-b68782a5-b427-4089-8c8a-b7c4b0bd388b req-25342f01-2212-48ce-8767-8a55c3e93079 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089708 Oct 23 01:40:16.431161 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3003/5912] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:40:16.555682 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0bb15d09-fbf1-4de6-ba18-d101ac37414e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:16.556351 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0bb15d09-fbf1-4de6-ba18-d101ac37414e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:16.572365 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0bb15d09-fbf1-4de6-ba18-d101ac37414e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:16.586772 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0bb15d09-fbf1-4de6-ba18-d101ac37414e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:16.590209 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0bb15d09-fbf1-4de6-ba18-d101ac37414e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:16.594864 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0bb15d09-fbf1-4de6-ba18-d101ac37414e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:16.595656 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0bb15d09-fbf1-4de6-ba18-d101ac37414e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:16.597396 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0bb15d09-fbf1-4de6-ba18-d101ac37414e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:17.744732 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0bb15d09-fbf1-4de6-ba18-d101ac37414e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:17.773262 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0bb15d09-fbf1-4de6-ba18-d101ac37414e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:17.778409 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0bb15d09-fbf1-4de6-ba18-d101ac37414e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:17.781511 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0bb15d09-fbf1-4de6-ba18-d101ac37414e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1875 microversion: 2.32 time: 1.229064 Oct 23 01:40:17.782408 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2910/5913] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:40:16 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1875 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:40:18.809445 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-25a510a9-151b-4b69-a7de-f2c9bd86e500 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:18.812210 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-25a510a9-151b-4b69-a7de-f2c9bd86e500 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:18.825601 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25a510a9-151b-4b69-a7de-f2c9bd86e500 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:18.831134 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25a510a9-151b-4b69-a7de-f2c9bd86e500 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:18.831803 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25a510a9-151b-4b69-a7de-f2c9bd86e500 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:18.841312 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25a510a9-151b-4b69-a7de-f2c9bd86e500 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:18.843916 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25a510a9-151b-4b69-a7de-f2c9bd86e500 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:18.846424 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25a510a9-151b-4b69-a7de-f2c9bd86e500 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:19.782529 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-25a510a9-151b-4b69-a7de-f2c9bd86e500 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:19.814918 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-25a510a9-151b-4b69-a7de-f2c9bd86e500 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:19.823874 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-25a510a9-151b-4b69-a7de-f2c9bd86e500 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:19.832483 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-25a510a9-151b-4b69-a7de-f2c9bd86e500 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1875 microversion: 2.32 time: 1.023304 Oct 23 01:40:19.843575 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3004/5914] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:40:18 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1875 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:40:20.862149 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-58dd596b-3a58-4572-8f7b-f2356086a7ba tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:20.863763 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-58dd596b-3a58-4572-8f7b-f2356086a7ba tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:20.881543 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-58dd596b-3a58-4572-8f7b-f2356086a7ba tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:20.882629 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-58dd596b-3a58-4572-8f7b-f2356086a7ba tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:20.883496 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-58dd596b-3a58-4572-8f7b-f2356086a7ba tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:20.884452 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-58dd596b-3a58-4572-8f7b-f2356086a7ba tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:20.886454 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-58dd596b-3a58-4572-8f7b-f2356086a7ba tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:20.889441 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-58dd596b-3a58-4572-8f7b-f2356086a7ba tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:21.715915 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-58dd596b-3a58-4572-8f7b-f2356086a7ba tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:21.753268 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-58dd596b-3a58-4572-8f7b-f2356086a7ba tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:21.756533 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-58dd596b-3a58-4572-8f7b-f2356086a7ba tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:21.757775 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-58dd596b-3a58-4572-8f7b-f2356086a7ba tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1875 microversion: 2.32 time: 0.900854 Oct 23 01:40:21.762292 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2911/5915] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:40:20 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1875 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:40:22.788410 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-62239274-4b77-4908-8469-23c4b8b89b20 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:22.789249 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-62239274-4b77-4908-8469-23c4b8b89b20 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:22.800803 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-62239274-4b77-4908-8469-23c4b8b89b20 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:22.820393 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-62239274-4b77-4908-8469-23c4b8b89b20 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:22.821283 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-62239274-4b77-4908-8469-23c4b8b89b20 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:22.831177 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-62239274-4b77-4908-8469-23c4b8b89b20 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:22.832068 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-62239274-4b77-4908-8469-23c4b8b89b20 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:22.832634 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-62239274-4b77-4908-8469-23c4b8b89b20 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:23.944599 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-62239274-4b77-4908-8469-23c4b8b89b20 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:23.967697 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-62239274-4b77-4908-8469-23c4b8b89b20 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:23.976261 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-62239274-4b77-4908-8469-23c4b8b89b20 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:23.977578 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-62239274-4b77-4908-8469-23c4b8b89b20 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1875 microversion: 2.32 time: 1.194006 Oct 23 01:40:24.000097 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3005/5916] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:40:22 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1875 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:40:25.036111 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9a525e7f-5abd-46a8-a4f6-9f2d1603c9c9 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:25.036743 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9a525e7f-5abd-46a8-a4f6-9f2d1603c9c9 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:25.049322 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a525e7f-5abd-46a8-a4f6-9f2d1603c9c9 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:25.049825 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a525e7f-5abd-46a8-a4f6-9f2d1603c9c9 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:25.050300 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a525e7f-5abd-46a8-a4f6-9f2d1603c9c9 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:25.051017 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a525e7f-5abd-46a8-a4f6-9f2d1603c9c9 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:25.051471 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a525e7f-5abd-46a8-a4f6-9f2d1603c9c9 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:25.056078 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a525e7f-5abd-46a8-a4f6-9f2d1603c9c9 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:25.669677 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9a525e7f-5abd-46a8-a4f6-9f2d1603c9c9 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:25.687706 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9a525e7f-5abd-46a8-a4f6-9f2d1603c9c9 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:25.697084 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9a525e7f-5abd-46a8-a4f6-9f2d1603c9c9 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:25.698938 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9a525e7f-5abd-46a8-a4f6-9f2d1603c9c9 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1875 microversion: 2.32 time: 0.667169 Oct 23 01:40:25.704410 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2912/5917] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:40:25 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1875 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:40:26.737624 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b3306735-b971-46f1-8e71-43dae9e3662f tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:26.738280 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b3306735-b971-46f1-8e71-43dae9e3662f tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:26.745058 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:26.752593 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b3306735-b971-46f1-8e71-43dae9e3662f tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:26.753865 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b3306735-b971-46f1-8e71-43dae9e3662f tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:26.754594 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b3306735-b971-46f1-8e71-43dae9e3662f tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:26.755851 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b3306735-b971-46f1-8e71-43dae9e3662f tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:26.756524 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b3306735-b971-46f1-8e71-43dae9e3662f tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:26.757136 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b3306735-b971-46f1-8e71-43dae9e3662f tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:27.299827 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b3306735-b971-46f1-8e71-43dae9e3662f tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:27.317391 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b3306735-b971-46f1-8e71-43dae9e3662f tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:27.323297 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b3306735-b971-46f1-8e71-43dae9e3662f tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:27.333777 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b3306735-b971-46f1-8e71-43dae9e3662f tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1875 microversion: 2.32 time: 0.596816 Oct 23 01:40:27.334980 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3006/5918] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:40:26 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1875 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:40:28.375295 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-90369582-dda9-41da-ab2d-bc6113cd182f tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:28.375949 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-90369582-dda9-41da-ab2d-bc6113cd182f tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:28.396463 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-90369582-dda9-41da-ab2d-bc6113cd182f tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:28.398315 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-90369582-dda9-41da-ab2d-bc6113cd182f tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:28.399506 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-90369582-dda9-41da-ab2d-bc6113cd182f tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:28.402897 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-90369582-dda9-41da-ab2d-bc6113cd182f tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:28.406751 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-90369582-dda9-41da-ab2d-bc6113cd182f tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:28.410704 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-90369582-dda9-41da-ab2d-bc6113cd182f tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:28.889503 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-90369582-dda9-41da-ab2d-bc6113cd182f tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:28.923068 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-90369582-dda9-41da-ab2d-bc6113cd182f tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:28.929106 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-90369582-dda9-41da-ab2d-bc6113cd182f tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:28.932017 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-90369582-dda9-41da-ab2d-bc6113cd182f tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1875 microversion: 2.32 time: 0.561961 Oct 23 01:40:28.932604 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2913/5919] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:40:28 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1875 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:40:29.974776 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-41dd8ca8-0c2b-4929-96d2-5552331059ff tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:29.975411 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-41dd8ca8-0c2b-4929-96d2-5552331059ff tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:29.996433 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41dd8ca8-0c2b-4929-96d2-5552331059ff tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:29.998868 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41dd8ca8-0c2b-4929-96d2-5552331059ff tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:29.999741 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41dd8ca8-0c2b-4929-96d2-5552331059ff tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:30.004670 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41dd8ca8-0c2b-4929-96d2-5552331059ff tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:30.005322 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41dd8ca8-0c2b-4929-96d2-5552331059ff tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:30.005935 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41dd8ca8-0c2b-4929-96d2-5552331059ff tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:30.400033 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-41dd8ca8-0c2b-4929-96d2-5552331059ff tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:30.416247 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-41dd8ca8-0c2b-4929-96d2-5552331059ff tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:30.416247 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-41dd8ca8-0c2b-4929-96d2-5552331059ff tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:30.416247 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-41dd8ca8-0c2b-4929-96d2-5552331059ff tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1875 microversion: 2.32 time: 0.443982 Oct 23 01:40:30.416630 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3007/5920] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:40:29 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1875 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:40:31.446386 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7b17bee7-aef9-4b80-aee2-29e58fb3d5cb tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:31.447254 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7b17bee7-aef9-4b80-aee2-29e58fb3d5cb tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:31.455694 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b17bee7-aef9-4b80-aee2-29e58fb3d5cb tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:31.457165 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b17bee7-aef9-4b80-aee2-29e58fb3d5cb tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:31.457830 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b17bee7-aef9-4b80-aee2-29e58fb3d5cb tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:31.458857 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b17bee7-aef9-4b80-aee2-29e58fb3d5cb tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:31.459422 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b17bee7-aef9-4b80-aee2-29e58fb3d5cb tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:31.460090 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b17bee7-aef9-4b80-aee2-29e58fb3d5cb tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:31.838859 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7b17bee7-aef9-4b80-aee2-29e58fb3d5cb tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:31.858341 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7b17bee7-aef9-4b80-aee2-29e58fb3d5cb tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:31.869567 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7b17bee7-aef9-4b80-aee2-29e58fb3d5cb tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:31.871187 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7b17bee7-aef9-4b80-aee2-29e58fb3d5cb tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1875 microversion: 2.32 time: 0.428935 Oct 23 01:40:31.874128 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2914/5921] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:40:31 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1875 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:40:32.911549 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2139403f-76ee-43b2-b987-53dd96bbcc41 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:32.911549 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2139403f-76ee-43b2-b987-53dd96bbcc41 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:32.922292 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2139403f-76ee-43b2-b987-53dd96bbcc41 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:32.922931 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2139403f-76ee-43b2-b987-53dd96bbcc41 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:32.923633 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2139403f-76ee-43b2-b987-53dd96bbcc41 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:32.937893 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2139403f-76ee-43b2-b987-53dd96bbcc41 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:32.939330 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2139403f-76ee-43b2-b987-53dd96bbcc41 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:32.940030 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2139403f-76ee-43b2-b987-53dd96bbcc41 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:33.519052 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2139403f-76ee-43b2-b987-53dd96bbcc41 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:33.529826 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2139403f-76ee-43b2-b987-53dd96bbcc41 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:33.533936 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2139403f-76ee-43b2-b987-53dd96bbcc41 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:33.535219 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2139403f-76ee-43b2-b987-53dd96bbcc41 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1875 microversion: 2.32 time: 0.636831 Oct 23 01:40:33.535812 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3008/5922] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:40:32 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1875 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:40:34.568977 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0316c5a5-4e12-47d8-8166-2e8a0c6dc7f7 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:34.570478 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0316c5a5-4e12-47d8-8166-2e8a0c6dc7f7 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:34.581141 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:34.583434 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0316c5a5-4e12-47d8-8166-2e8a0c6dc7f7 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:34.584046 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0316c5a5-4e12-47d8-8166-2e8a0c6dc7f7 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:34.584585 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0316c5a5-4e12-47d8-8166-2e8a0c6dc7f7 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:34.585532 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0316c5a5-4e12-47d8-8166-2e8a0c6dc7f7 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:34.586262 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0316c5a5-4e12-47d8-8166-2e8a0c6dc7f7 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:34.586977 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0316c5a5-4e12-47d8-8166-2e8a0c6dc7f7 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:35.049160 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0316c5a5-4e12-47d8-8166-2e8a0c6dc7f7 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:35.059060 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0316c5a5-4e12-47d8-8166-2e8a0c6dc7f7 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:35.060666 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0316c5a5-4e12-47d8-8166-2e8a0c6dc7f7 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:35.061835 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0316c5a5-4e12-47d8-8166-2e8a0c6dc7f7 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1875 microversion: 2.32 time: 0.502811 Oct 23 01:40:35.062624 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2915/5923] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:40:34 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1875 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:40:36.088663 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-42e7c9a3-f803-47f7-962c-a041280de8b9 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:36.089638 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-42e7c9a3-f803-47f7-962c-a041280de8b9 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:36.099214 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-42e7c9a3-f803-47f7-962c-a041280de8b9 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:36.100012 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-42e7c9a3-f803-47f7-962c-a041280de8b9 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:36.100728 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-42e7c9a3-f803-47f7-962c-a041280de8b9 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:36.101739 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-42e7c9a3-f803-47f7-962c-a041280de8b9 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:36.102448 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-42e7c9a3-f803-47f7-962c-a041280de8b9 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:36.103111 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-42e7c9a3-f803-47f7-962c-a041280de8b9 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:36.502993 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-42e7c9a3-f803-47f7-962c-a041280de8b9 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:36.514535 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-42e7c9a3-f803-47f7-962c-a041280de8b9 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:36.519901 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-42e7c9a3-f803-47f7-962c-a041280de8b9 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:36.521162 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-42e7c9a3-f803-47f7-962c-a041280de8b9 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1875 microversion: 2.32 time: 0.436769 Oct 23 01:40:36.538155 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3009/5924] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:40:36 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1875 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:40:37.550350 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4729643d-a573-47f7-a38e-ae0c807216ff tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:37.550961 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4729643d-a573-47f7-a38e-ae0c807216ff tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:37.559516 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4729643d-a573-47f7-a38e-ae0c807216ff tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:37.563725 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4729643d-a573-47f7-a38e-ae0c807216ff tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:37.563725 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4729643d-a573-47f7-a38e-ae0c807216ff tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:37.563725 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4729643d-a573-47f7-a38e-ae0c807216ff tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:37.563725 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4729643d-a573-47f7-a38e-ae0c807216ff tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:37.563725 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4729643d-a573-47f7-a38e-ae0c807216ff tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:37.968945 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4729643d-a573-47f7-a38e-ae0c807216ff tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:37.979139 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4729643d-a573-47f7-a38e-ae0c807216ff tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:37.980590 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4729643d-a573-47f7-a38e-ae0c807216ff tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:37.983485 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4729643d-a573-47f7-a38e-ae0c807216ff tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1875 microversion: 2.32 time: 0.438158 Oct 23 01:40:37.984082 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2916/5925] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:40:37 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1875 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:40:39.010286 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1f5198d8-53ae-40c1-88dc-30d734a473ff tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:39.011719 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1f5198d8-53ae-40c1-88dc-30d734a473ff tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:39.020550 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f5198d8-53ae-40c1-88dc-30d734a473ff tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:39.021775 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f5198d8-53ae-40c1-88dc-30d734a473ff tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:39.022495 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f5198d8-53ae-40c1-88dc-30d734a473ff tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:39.023420 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f5198d8-53ae-40c1-88dc-30d734a473ff tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:39.024054 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f5198d8-53ae-40c1-88dc-30d734a473ff tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:39.027540 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f5198d8-53ae-40c1-88dc-30d734a473ff tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:39.340585 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1f5198d8-53ae-40c1-88dc-30d734a473ff tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:39.360307 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1f5198d8-53ae-40c1-88dc-30d734a473ff tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:39.362972 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1f5198d8-53ae-40c1-88dc-30d734a473ff tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:39.365048 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1f5198d8-53ae-40c1-88dc-30d734a473ff tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1875 microversion: 2.32 time: 0.360209 Oct 23 01:40:39.379235 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3010/5926] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:40:39 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1875 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:40:39.965098 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-01af3992-63b6-4235-ab1b-b7456eb0a0a7 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1641296845", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:40:40.085044 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-01af3992-63b6-4235-ab1b-b7456eb0a0a7 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] validate_networks() for [('8f995532-969c-4716-8140-223d9849f25a', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:40:40.393821 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f6fb6ad9-caa7-4ba4-b5d9-8db24b0dada2 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:40.394465 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f6fb6ad9-caa7-4ba4-b5d9-8db24b0dada2 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:40.417152 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f6fb6ad9-caa7-4ba4-b5d9-8db24b0dada2 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:40.417152 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f6fb6ad9-caa7-4ba4-b5d9-8db24b0dada2 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:40.417152 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f6fb6ad9-caa7-4ba4-b5d9-8db24b0dada2 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:40.419878 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f6fb6ad9-caa7-4ba4-b5d9-8db24b0dada2 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:40.420834 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f6fb6ad9-caa7-4ba4-b5d9-8db24b0dada2 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:40.421268 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f6fb6ad9-caa7-4ba4-b5d9-8db24b0dada2 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:40.770888 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-01af3992-63b6-4235-ab1b-b7456eb0a0a7 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:40:40.771544 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-01af3992-63b6-4235-ab1b-b7456eb0a0a7 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:40:40.772021 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-01af3992-63b6-4235-ab1b-b7456eb0a0a7 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:40:40.772433 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-01af3992-63b6-4235-ab1b-b7456eb0a0a7 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:40:40.772843 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-01af3992-63b6-4235-ab1b-b7456eb0a0a7 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:40:40.783352 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-01af3992-63b6-4235-ab1b-b7456eb0a0a7 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:40.783834 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-01af3992-63b6-4235-ab1b-b7456eb0a0a7 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:40.784268 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-01af3992-63b6-4235-ab1b-b7456eb0a0a7 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:40.784987 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-01af3992-63b6-4235-ab1b-b7456eb0a0a7 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:40.785829 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-01af3992-63b6-4235-ab1b-b7456eb0a0a7 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:40.786505 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-01af3992-63b6-4235-ab1b-b7456eb0a0a7 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:40.799233 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=58 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:40.813697 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-01af3992-63b6-4235-ab1b-b7456eb0a0a7 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Getting quotas for project c36e0a78b98040598bfa5fac4fe95cf8. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:40:40.820475 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-01af3992-63b6-4235-ab1b-b7456eb0a0a7 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Getting quotas for user 85e367cf6f3b4259902ac1f5f9918391 and project c36e0a78b98040598bfa5fac4fe95cf8. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:40:40.835138 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f6fb6ad9-caa7-4ba4-b5d9-8db24b0dada2 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:40.836653 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-01af3992-63b6-4235-ab1b-b7456eb0a0a7 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:40:40.839115 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-01af3992-63b6-4235-ab1b-b7456eb0a0a7 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] [instance: 79d4067a-0e2c-4089-9572-79a43e5d650b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:40:40.846781 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f6fb6ad9-caa7-4ba4-b5d9-8db24b0dada2 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:40.848949 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f6fb6ad9-caa7-4ba4-b5d9-8db24b0dada2 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:40.850281 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f6fb6ad9-caa7-4ba4-b5d9-8db24b0dada2 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1875 microversion: 2.32 time: 0.460667 Oct 23 01:40:40.860337 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3011/5927] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:40:40 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1875 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:40:41.006546 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-01af3992-63b6-4235-ab1b-b7456eb0a0a7 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.360862 Oct 23 01:40:41.007241 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2917/5928] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:40:39 2022] POST /compute/v2.1/servers => generated 383 bytes in 1365 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:40:41.019327 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-900b08b9-b9de-41ad-9786-3d5fb4237a3c tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:41.019951 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-900b08b9-b9de-41ad-9786-3d5fb4237a3c tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] [instance: 79d4067a-0e2c-4089-9572-79a43e5d650b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:41.111719 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-900b08b9-b9de-41ad-9786-3d5fb4237a3c tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e367cf6f3b4259902ac1f5f9918391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0a78b98040598bfa5fac4fe95cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:41.121417 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-900b08b9-b9de-41ad-9786-3d5fb4237a3c tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] 10.222.0.42 "GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b" status: 200 len: 1223 microversion: 2.1 time: 0.106045 Oct 23 01:40:41.122080 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3012/5929] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:40:41 2022] GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b => generated 1223 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:40:41.877556 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-504e75d2-2f93-47cc-939e-84234d83be5f tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:41.878625 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-504e75d2-2f93-47cc-939e-84234d83be5f tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:41.890052 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-504e75d2-2f93-47cc-939e-84234d83be5f tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:41.890802 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-504e75d2-2f93-47cc-939e-84234d83be5f tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:41.891309 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-504e75d2-2f93-47cc-939e-84234d83be5f tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:41.892085 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-504e75d2-2f93-47cc-939e-84234d83be5f tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:41.892739 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-504e75d2-2f93-47cc-939e-84234d83be5f tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:41.893235 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-504e75d2-2f93-47cc-939e-84234d83be5f tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:42.121320 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-504e75d2-2f93-47cc-939e-84234d83be5f tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:42.139684 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-504e75d2-2f93-47cc-939e-84234d83be5f tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:42.150079 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-504e75d2-2f93-47cc-939e-84234d83be5f tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:42.150398 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8a2059c8-0f4b-4bc3-b620-3da5f4a49e35 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:42.150398 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8a2059c8-0f4b-4bc3-b620-3da5f4a49e35 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] [instance: 79d4067a-0e2c-4089-9572-79a43e5d650b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:42.161422 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-504e75d2-2f93-47cc-939e-84234d83be5f tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1875 microversion: 2.32 time: 0.287669 Oct 23 01:40:42.181164 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2918/5930] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:40:41 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1875 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:40:42.290236 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8a2059c8-0f4b-4bc3-b620-3da5f4a49e35 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e367cf6f3b4259902ac1f5f9918391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0a78b98040598bfa5fac4fe95cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:42.306303 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8a2059c8-0f4b-4bc3-b620-3da5f4a49e35 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] 10.222.0.42 "GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b" status: 200 len: 1223 microversion: 2.1 time: 0.162488 Oct 23 01:40:42.309901 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3013/5931] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:40:42 2022] GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b => generated 1223 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:40:43.199743 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fc61a4a0-3b7b-4b63-8c2d-c752a6fe8dc9 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:43.202341 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-fc61a4a0-3b7b-4b63-8c2d-c752a6fe8dc9 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:43.213928 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc61a4a0-3b7b-4b63-8c2d-c752a6fe8dc9 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:43.216313 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc61a4a0-3b7b-4b63-8c2d-c752a6fe8dc9 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:43.216313 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc61a4a0-3b7b-4b63-8c2d-c752a6fe8dc9 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:43.217199 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc61a4a0-3b7b-4b63-8c2d-c752a6fe8dc9 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:43.217672 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc61a4a0-3b7b-4b63-8c2d-c752a6fe8dc9 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:43.218322 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc61a4a0-3b7b-4b63-8c2d-c752a6fe8dc9 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:43.334368 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c38e9a8c-800c-427c-a71c-810045206108 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:43.335205 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c38e9a8c-800c-427c-a71c-810045206108 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] [instance: 79d4067a-0e2c-4089-9572-79a43e5d650b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:43.345026 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c38e9a8c-800c-427c-a71c-810045206108 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:43.347701 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c38e9a8c-800c-427c-a71c-810045206108 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:43.349647 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c38e9a8c-800c-427c-a71c-810045206108 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:43.352474 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c38e9a8c-800c-427c-a71c-810045206108 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:43.354934 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c38e9a8c-800c-427c-a71c-810045206108 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:43.355725 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c38e9a8c-800c-427c-a71c-810045206108 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:43.551759 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c38e9a8c-800c-427c-a71c-810045206108 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e367cf6f3b4259902ac1f5f9918391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0a78b98040598bfa5fac4fe95cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:43.560633 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c38e9a8c-800c-427c-a71c-810045206108 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] 10.222.0.42 "GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b" status: 200 len: 1275 microversion: 2.1 time: 0.230500 Oct 23 01:40:43.561228 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3014/5932] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:40:43 2022] GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b => generated 1275 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:40:43.595225 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-fc61a4a0-3b7b-4b63-8c2d-c752a6fe8dc9 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:43.607398 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-fc61a4a0-3b7b-4b63-8c2d-c752a6fe8dc9 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:43.609168 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-fc61a4a0-3b7b-4b63-8c2d-c752a6fe8dc9 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:43.610388 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fc61a4a0-3b7b-4b63-8c2d-c752a6fe8dc9 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1875 microversion: 2.32 time: 0.419095 Oct 23 01:40:43.610962 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2919/5933] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:40:43 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1875 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:40:44.587437 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e9cf2358-c8c6-4891-927c-557db8cf5062 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:44.587437 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e9cf2358-c8c6-4891-927c-557db8cf5062 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] [instance: 79d4067a-0e2c-4089-9572-79a43e5d650b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:44.608010 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9cf2358-c8c6-4891-927c-557db8cf5062 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:44.608010 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9cf2358-c8c6-4891-927c-557db8cf5062 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:44.617185 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9cf2358-c8c6-4891-927c-557db8cf5062 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:44.637557 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-63d3a2db-e02c-4600-af27-17429a559077 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:44.640124 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-63d3a2db-e02c-4600-af27-17429a559077 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:44.644179 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9cf2358-c8c6-4891-927c-557db8cf5062 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:44.644764 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9cf2358-c8c6-4891-927c-557db8cf5062 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:44.645225 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9cf2358-c8c6-4891-927c-557db8cf5062 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:44.656214 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-63d3a2db-e02c-4600-af27-17429a559077 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:44.659279 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-63d3a2db-e02c-4600-af27-17429a559077 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:44.661653 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-63d3a2db-e02c-4600-af27-17429a559077 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:44.665009 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-63d3a2db-e02c-4600-af27-17429a559077 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:44.665867 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-63d3a2db-e02c-4600-af27-17429a559077 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:44.668239 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-63d3a2db-e02c-4600-af27-17429a559077 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:44.801777 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e9cf2358-c8c6-4891-927c-557db8cf5062 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e367cf6f3b4259902ac1f5f9918391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0a78b98040598bfa5fac4fe95cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:44.811062 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e9cf2358-c8c6-4891-927c-557db8cf5062 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] 10.222.0.42 "GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b" status: 200 len: 1281 microversion: 2.1 time: 0.230007 Oct 23 01:40:44.814220 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3015/5934] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:40:44 2022] GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b => generated 1281 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:40:45.148001 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-63d3a2db-e02c-4600-af27-17429a559077 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:45.158415 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-63d3a2db-e02c-4600-af27-17429a559077 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:45.160486 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-63d3a2db-e02c-4600-af27-17429a559077 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:45.161671 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-63d3a2db-e02c-4600-af27-17429a559077 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1875 microversion: 2.32 time: 0.528862 Oct 23 01:40:45.162705 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2920/5935] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:40:44 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1875 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:40:45.843717 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-961dc3bf-ba42-4216-8b34-dac8d8c2f41a tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:45.844412 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-961dc3bf-ba42-4216-8b34-dac8d8c2f41a tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] [instance: 79d4067a-0e2c-4089-9572-79a43e5d650b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:45.851471 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-961dc3bf-ba42-4216-8b34-dac8d8c2f41a tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:45.851894 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-961dc3bf-ba42-4216-8b34-dac8d8c2f41a tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:45.852878 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-961dc3bf-ba42-4216-8b34-dac8d8c2f41a tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:45.853089 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-961dc3bf-ba42-4216-8b34-dac8d8c2f41a tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:45.853553 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-961dc3bf-ba42-4216-8b34-dac8d8c2f41a tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:45.854063 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-961dc3bf-ba42-4216-8b34-dac8d8c2f41a tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:46.049834 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-961dc3bf-ba42-4216-8b34-dac8d8c2f41a tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e367cf6f3b4259902ac1f5f9918391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0a78b98040598bfa5fac4fe95cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:46.059511 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-961dc3bf-ba42-4216-8b34-dac8d8c2f41a tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] 10.222.0.42 "GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b" status: 200 len: 1323 microversion: 2.1 time: 0.220069 Oct 23 01:40:46.060118 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3016/5936] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:40:45 2022] GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b => generated 1323 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:40:46.189242 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f19e14bf-2d1e-4e1c-96ad-f1436c7250dd tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:46.190178 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f19e14bf-2d1e-4e1c-96ad-f1436c7250dd tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:46.201482 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f19e14bf-2d1e-4e1c-96ad-f1436c7250dd tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:46.203488 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f19e14bf-2d1e-4e1c-96ad-f1436c7250dd tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:46.204020 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f19e14bf-2d1e-4e1c-96ad-f1436c7250dd tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:46.205965 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f19e14bf-2d1e-4e1c-96ad-f1436c7250dd tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:46.206800 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f19e14bf-2d1e-4e1c-96ad-f1436c7250dd tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:46.210047 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f19e14bf-2d1e-4e1c-96ad-f1436c7250dd tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:46.578188 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f19e14bf-2d1e-4e1c-96ad-f1436c7250dd tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:46.592774 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f19e14bf-2d1e-4e1c-96ad-f1436c7250dd tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:46.594332 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f19e14bf-2d1e-4e1c-96ad-f1436c7250dd tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:46.600492 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f19e14bf-2d1e-4e1c-96ad-f1436c7250dd tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1875 microversion: 2.32 time: 0.410484 Oct 23 01:40:46.612627 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2921/5937] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:40:46 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1875 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:40:47.087154 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-752e6917-749a-4d7a-9b60-3d36cf811de4 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:47.087938 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-752e6917-749a-4d7a-9b60-3d36cf811de4 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] [instance: 79d4067a-0e2c-4089-9572-79a43e5d650b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:47.095965 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-752e6917-749a-4d7a-9b60-3d36cf811de4 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:47.096599 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-752e6917-749a-4d7a-9b60-3d36cf811de4 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:47.097147 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-752e6917-749a-4d7a-9b60-3d36cf811de4 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:47.097959 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-752e6917-749a-4d7a-9b60-3d36cf811de4 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:47.098549 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-752e6917-749a-4d7a-9b60-3d36cf811de4 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:47.099101 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-752e6917-749a-4d7a-9b60-3d36cf811de4 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:47.289484 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-752e6917-749a-4d7a-9b60-3d36cf811de4 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e367cf6f3b4259902ac1f5f9918391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0a78b98040598bfa5fac4fe95cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:47.299103 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-752e6917-749a-4d7a-9b60-3d36cf811de4 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] 10.222.0.42 "GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b" status: 200 len: 1323 microversion: 2.1 time: 0.216172 Oct 23 01:40:47.300466 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3017/5938] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:40:47 2022] GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b => generated 1323 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:40:47.504731 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-7daecf5a-2a90-40ae-a131-c8668b2d704d req-01a6f1ce-e359-4cfc-a3fb-40a88621dbcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79d4067a-0e2c-4089-9572-79a43e5d650b", "tag": "0f175258-b6ad-4021-8464-00a06d78ab14"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:40:47.521769 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-7daecf5a-2a90-40ae-a131-c8668b2d704d req-01a6f1ce-e359-4cfc-a3fb-40a88621dbcb service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:47.523264 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-7daecf5a-2a90-40ae-a131-c8668b2d704d req-01a6f1ce-e359-4cfc-a3fb-40a88621dbcb service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:47.523915 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-7daecf5a-2a90-40ae-a131-c8668b2d704d req-01a6f1ce-e359-4cfc-a3fb-40a88621dbcb service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:47.541881 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-7daecf5a-2a90-40ae-a131-c8668b2d704d req-01a6f1ce-e359-4cfc-a3fb-40a88621dbcb service nova] Creating event network-changed:0f175258-b6ad-4021-8464-00a06d78ab14 for instance 79d4067a-0e2c-4089-9572-79a43e5d650b on n-h1-master-1 Oct 23 01:40:47.548604 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-7daecf5a-2a90-40ae-a131-c8668b2d704d req-01a6f1ce-e359-4cfc-a3fb-40a88621dbcb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050704 Oct 23 01:40:47.550943 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2922/5939] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:40:47.625428 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-af093f31-b4c6-471e-87c5-5b123d9be547 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:47.626633 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-af093f31-b4c6-471e-87c5-5b123d9be547 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:47.642009 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-af093f31-b4c6-471e-87c5-5b123d9be547 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:47.642985 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-af093f31-b4c6-471e-87c5-5b123d9be547 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:47.644005 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-af093f31-b4c6-471e-87c5-5b123d9be547 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:47.647070 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-af093f31-b4c6-471e-87c5-5b123d9be547 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:47.647714 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-af093f31-b4c6-471e-87c5-5b123d9be547 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:47.651814 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-af093f31-b4c6-471e-87c5-5b123d9be547 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:48.034145 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-af093f31-b4c6-471e-87c5-5b123d9be547 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:48.050224 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-af093f31-b4c6-471e-87c5-5b123d9be547 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:48.053872 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-af093f31-b4c6-471e-87c5-5b123d9be547 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:48.055187 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-af093f31-b4c6-471e-87c5-5b123d9be547 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1875 microversion: 2.32 time: 0.434739 Oct 23 01:40:48.058744 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3018/5940] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:40:47 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1875 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:40:48.328812 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-836cefef-d053-44a5-a03c-f3a3c20686d5 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:48.331052 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-836cefef-d053-44a5-a03c-f3a3c20686d5 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] [instance: 79d4067a-0e2c-4089-9572-79a43e5d650b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:48.349810 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-836cefef-d053-44a5-a03c-f3a3c20686d5 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:48.350836 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-836cefef-d053-44a5-a03c-f3a3c20686d5 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:48.351355 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-836cefef-d053-44a5-a03c-f3a3c20686d5 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:48.352417 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-836cefef-d053-44a5-a03c-f3a3c20686d5 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:48.352985 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-836cefef-d053-44a5-a03c-f3a3c20686d5 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:48.353490 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-836cefef-d053-44a5-a03c-f3a3c20686d5 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:48.617025 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-836cefef-d053-44a5-a03c-f3a3c20686d5 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e367cf6f3b4259902ac1f5f9918391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0a78b98040598bfa5fac4fe95cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:48.629157 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-836cefef-d053-44a5-a03c-f3a3c20686d5 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] 10.222.0.42 "GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b" status: 200 len: 1323 microversion: 2.1 time: 0.308472 Oct 23 01:40:48.633302 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2923/5941] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:40:48 2022] GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b => generated 1323 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:40:49.088682 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-70848808-6dd9-4354-b867-7675e518a05d tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:49.089911 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-70848808-6dd9-4354-b867-7675e518a05d tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:49.097320 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-70848808-6dd9-4354-b867-7675e518a05d tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:49.097801 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-70848808-6dd9-4354-b867-7675e518a05d tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:49.098277 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-70848808-6dd9-4354-b867-7675e518a05d tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:49.104254 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-70848808-6dd9-4354-b867-7675e518a05d tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:49.107092 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-70848808-6dd9-4354-b867-7675e518a05d tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:49.107563 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-70848808-6dd9-4354-b867-7675e518a05d tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:49.131614 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=86 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:49.365202 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-70848808-6dd9-4354-b867-7675e518a05d tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:49.381635 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-70848808-6dd9-4354-b867-7675e518a05d tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:49.383896 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-70848808-6dd9-4354-b867-7675e518a05d tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:49.385328 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-70848808-6dd9-4354-b867-7675e518a05d tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1875 microversion: 2.32 time: 0.300696 Oct 23 01:40:49.386576 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3019/5942] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:40:49 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1875 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:40:49.664564 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1c805fb0-37ea-4d81-bb22-304983995720 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:49.669560 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1c805fb0-37ea-4d81-bb22-304983995720 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] [instance: 79d4067a-0e2c-4089-9572-79a43e5d650b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:49.687881 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c805fb0-37ea-4d81-bb22-304983995720 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:49.688471 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c805fb0-37ea-4d81-bb22-304983995720 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:49.688918 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c805fb0-37ea-4d81-bb22-304983995720 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:49.698985 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c805fb0-37ea-4d81-bb22-304983995720 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:49.698985 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c805fb0-37ea-4d81-bb22-304983995720 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:49.698985 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c805fb0-37ea-4d81-bb22-304983995720 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:50.417665 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bdde3711-a358-408b-b10d-f19b88512540 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:50.436446 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bdde3711-a358-408b-b10d-f19b88512540 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:50.459441 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bdde3711-a358-408b-b10d-f19b88512540 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:50.461639 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bdde3711-a358-408b-b10d-f19b88512540 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:50.462384 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bdde3711-a358-408b-b10d-f19b88512540 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:50.463359 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bdde3711-a358-408b-b10d-f19b88512540 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:50.464100 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bdde3711-a358-408b-b10d-f19b88512540 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:50.464896 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bdde3711-a358-408b-b10d-f19b88512540 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:50.603039 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1c805fb0-37ea-4d81-bb22-304983995720 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e367cf6f3b4259902ac1f5f9918391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0a78b98040598bfa5fac4fe95cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:50.622321 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1c805fb0-37ea-4d81-bb22-304983995720 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] 10.222.0.42 "GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b" status: 200 len: 1323 microversion: 2.1 time: 0.969784 Oct 23 01:40:50.625857 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2924/5943] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:40:49 2022] GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b => generated 1323 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:40:50.791997 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bdde3711-a358-408b-b10d-f19b88512540 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:50.808048 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bdde3711-a358-408b-b10d-f19b88512540 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:50.810492 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bdde3711-a358-408b-b10d-f19b88512540 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:50.812017 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bdde3711-a358-408b-b10d-f19b88512540 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1875 microversion: 2.32 time: 0.400497 Oct 23 01:40:50.813123 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3020/5944] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:40:50 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1875 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:40:51.649145 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ac483309-c175-4bcc-83a6-0cb5971740ba tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:51.649682 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ac483309-c175-4bcc-83a6-0cb5971740ba tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] [instance: 79d4067a-0e2c-4089-9572-79a43e5d650b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:51.663159 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:51.666552 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=6 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:51.672990 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ac483309-c175-4bcc-83a6-0cb5971740ba tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:51.673549 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ac483309-c175-4bcc-83a6-0cb5971740ba tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:51.677237 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ac483309-c175-4bcc-83a6-0cb5971740ba tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:51.684547 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ac483309-c175-4bcc-83a6-0cb5971740ba tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:51.685307 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ac483309-c175-4bcc-83a6-0cb5971740ba tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:51.685784 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ac483309-c175-4bcc-83a6-0cb5971740ba tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:51.843564 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cb763e5f-8ea1-4a02-a4b7-06f568466f5c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:51.847959 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-cb763e5f-8ea1-4a02-a4b7-06f568466f5c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:51.882067 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cb763e5f-8ea1-4a02-a4b7-06f568466f5c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:51.888858 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cb763e5f-8ea1-4a02-a4b7-06f568466f5c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:51.889704 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cb763e5f-8ea1-4a02-a4b7-06f568466f5c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:51.890474 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cb763e5f-8ea1-4a02-a4b7-06f568466f5c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:51.891061 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cb763e5f-8ea1-4a02-a4b7-06f568466f5c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:51.891606 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cb763e5f-8ea1-4a02-a4b7-06f568466f5c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:52.251140 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ac483309-c175-4bcc-83a6-0cb5971740ba tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e367cf6f3b4259902ac1f5f9918391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0a78b98040598bfa5fac4fe95cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:52.264599 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ac483309-c175-4bcc-83a6-0cb5971740ba tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] 10.222.0.42 "GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b" status: 200 len: 1323 microversion: 2.1 time: 0.619550 Oct 23 01:40:52.265749 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2925/5945] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:40:51 2022] GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b => generated 1323 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:40:52.303551 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=4 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:52.398293 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cb763e5f-8ea1-4a02-a4b7-06f568466f5c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:52.412597 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cb763e5f-8ea1-4a02-a4b7-06f568466f5c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:52.414877 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cb763e5f-8ea1-4a02-a4b7-06f568466f5c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:52.420615 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cb763e5f-8ea1-4a02-a4b7-06f568466f5c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1875 microversion: 2.32 time: 0.581809 Oct 23 01:40:52.421764 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3021/5946] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:40:51 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1875 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:40:52.785821 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-88606fb4-b1a7-4457-9874-b4552ccbe1ab req-4d7738f1-e8d4-4228-a9ea-2dc57eee793f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f47e3006-cfbb-48bb-ae86-b018486c5e21", "name": "network-vif-plugged", "status": "completed", "tag": "58e7a908-4248-4827-9552-0efabdaaf107"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:40:52.809019 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-88606fb4-b1a7-4457-9874-b4552ccbe1ab req-4d7738f1-e8d4-4228-a9ea-2dc57eee793f service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:52.809502 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-88606fb4-b1a7-4457-9874-b4552ccbe1ab req-4d7738f1-e8d4-4228-a9ea-2dc57eee793f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:52.809931 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-88606fb4-b1a7-4457-9874-b4552ccbe1ab req-4d7738f1-e8d4-4228-a9ea-2dc57eee793f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:52.841788 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-88606fb4-b1a7-4457-9874-b4552ccbe1ab req-4d7738f1-e8d4-4228-a9ea-2dc57eee793f service nova] Creating event network-vif-plugged:58e7a908-4248-4827-9552-0efabdaaf107 for instance f47e3006-cfbb-48bb-ae86-b018486c5e21 on n-h2-master-1 Oct 23 01:40:52.847986 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-88606fb4-b1a7-4457-9874-b4552ccbe1ab req-4d7738f1-e8d4-4228-a9ea-2dc57eee793f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066576 Oct 23 01:40:52.848718 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2926/5947] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:40:53.289196 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f5a53e7b-4c0a-4a11-aa49-fcb25c357f7a tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:53.290822 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f5a53e7b-4c0a-4a11-aa49-fcb25c357f7a tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] [instance: 79d4067a-0e2c-4089-9572-79a43e5d650b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:53.310362 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f5a53e7b-4c0a-4a11-aa49-fcb25c357f7a tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:53.311071 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f5a53e7b-4c0a-4a11-aa49-fcb25c357f7a tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:53.311516 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f5a53e7b-4c0a-4a11-aa49-fcb25c357f7a tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:53.312346 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f5a53e7b-4c0a-4a11-aa49-fcb25c357f7a tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:53.312816 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f5a53e7b-4c0a-4a11-aa49-fcb25c357f7a tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:53.313238 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f5a53e7b-4c0a-4a11-aa49-fcb25c357f7a tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:53.452994 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-548ab282-1e39-4582-9be8-63fba97dc716 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:53.454607 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-548ab282-1e39-4582-9be8-63fba97dc716 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:53.472916 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-548ab282-1e39-4582-9be8-63fba97dc716 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:53.474165 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-548ab282-1e39-4582-9be8-63fba97dc716 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:53.474165 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-548ab282-1e39-4582-9be8-63fba97dc716 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:53.474681 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-548ab282-1e39-4582-9be8-63fba97dc716 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:53.475142 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-548ab282-1e39-4582-9be8-63fba97dc716 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:53.475573 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-548ab282-1e39-4582-9be8-63fba97dc716 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:53.535744 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f5a53e7b-4c0a-4a11-aa49-fcb25c357f7a tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e367cf6f3b4259902ac1f5f9918391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0a78b98040598bfa5fac4fe95cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:53.544694 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f5a53e7b-4c0a-4a11-aa49-fcb25c357f7a tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] 10.222.0.42 "GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b" status: 200 len: 1323 microversion: 2.1 time: 0.260064 Oct 23 01:40:53.554574 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3022/5948] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:40:53 2022] GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b => generated 1323 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:40:53.787900 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-548ab282-1e39-4582-9be8-63fba97dc716 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:53.801772 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-548ab282-1e39-4582-9be8-63fba97dc716 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:53.804201 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-548ab282-1e39-4582-9be8-63fba97dc716 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:53.805998 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-548ab282-1e39-4582-9be8-63fba97dc716 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1875 microversion: 2.32 time: 0.358793 Oct 23 01:40:53.807394 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2927/5949] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:40:53 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1875 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:40:54.572134 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c8647701-1887-43f7-8bdb-e6b2ce4d4e4d tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:54.573545 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c8647701-1887-43f7-8bdb-e6b2ce4d4e4d tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] [instance: 79d4067a-0e2c-4089-9572-79a43e5d650b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:54.587350 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c8647701-1887-43f7-8bdb-e6b2ce4d4e4d tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:54.587855 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c8647701-1887-43f7-8bdb-e6b2ce4d4e4d tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:54.588706 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c8647701-1887-43f7-8bdb-e6b2ce4d4e4d tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:54.595053 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c8647701-1887-43f7-8bdb-e6b2ce4d4e4d tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:54.596121 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c8647701-1887-43f7-8bdb-e6b2ce4d4e4d tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:54.597314 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c8647701-1887-43f7-8bdb-e6b2ce4d4e4d tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:54.837834 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0aa139d0-05a2-4877-8e81-48acb9fece37 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:54.838492 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0aa139d0-05a2-4877-8e81-48acb9fece37 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:54.866556 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0aa139d0-05a2-4877-8e81-48acb9fece37 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:54.867163 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0aa139d0-05a2-4877-8e81-48acb9fece37 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:54.868696 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0aa139d0-05a2-4877-8e81-48acb9fece37 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:54.869721 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0aa139d0-05a2-4877-8e81-48acb9fece37 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:54.870497 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0aa139d0-05a2-4877-8e81-48acb9fece37 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:54.871082 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0aa139d0-05a2-4877-8e81-48acb9fece37 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:54.880555 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c8647701-1887-43f7-8bdb-e6b2ce4d4e4d tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e367cf6f3b4259902ac1f5f9918391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0a78b98040598bfa5fac4fe95cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:54.892831 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c8647701-1887-43f7-8bdb-e6b2ce4d4e4d tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] 10.222.0.42 "GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b" status: 200 len: 1323 microversion: 2.1 time: 0.325348 Oct 23 01:40:54.912863 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3023/5950] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:40:54 2022] GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b => generated 1323 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:40:55.144973 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0aa139d0-05a2-4877-8e81-48acb9fece37 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:55.157755 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0aa139d0-05a2-4877-8e81-48acb9fece37 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:55.162078 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0aa139d0-05a2-4877-8e81-48acb9fece37 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:55.173200 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0aa139d0-05a2-4877-8e81-48acb9fece37 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1875 microversion: 2.32 time: 0.334747 Oct 23 01:40:55.173200 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2928/5951] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:40:54 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1875 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:40:55.922491 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1cac7f17-f8fa-431d-9224-9ec393c9bff3 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:55.924013 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1cac7f17-f8fa-431d-9224-9ec393c9bff3 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] [instance: 79d4067a-0e2c-4089-9572-79a43e5d650b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:55.932323 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1cac7f17-f8fa-431d-9224-9ec393c9bff3 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:55.933144 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1cac7f17-f8fa-431d-9224-9ec393c9bff3 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:55.934500 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1cac7f17-f8fa-431d-9224-9ec393c9bff3 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:55.935766 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1cac7f17-f8fa-431d-9224-9ec393c9bff3 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:55.936477 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1cac7f17-f8fa-431d-9224-9ec393c9bff3 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:55.937291 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1cac7f17-f8fa-431d-9224-9ec393c9bff3 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:56.111265 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-dcc1d7e2-d71a-42c0-a0e4-fdffad9fcd95 req-5d3c029c-23b3-4343-b690-11e1dfaad193 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79d4067a-0e2c-4089-9572-79a43e5d650b", "name": "network-vif-plugged", "status": "completed", "tag": "0f175258-b6ad-4021-8464-00a06d78ab14"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:40:56.125510 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-dcc1d7e2-d71a-42c0-a0e4-fdffad9fcd95 req-5d3c029c-23b3-4343-b690-11e1dfaad193 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:56.126224 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-dcc1d7e2-d71a-42c0-a0e4-fdffad9fcd95 req-5d3c029c-23b3-4343-b690-11e1dfaad193 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:56.130158 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-dcc1d7e2-d71a-42c0-a0e4-fdffad9fcd95 req-5d3c029c-23b3-4343-b690-11e1dfaad193 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:56.178233 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-dcc1d7e2-d71a-42c0-a0e4-fdffad9fcd95 req-5d3c029c-23b3-4343-b690-11e1dfaad193 service nova] Creating event network-vif-plugged:0f175258-b6ad-4021-8464-00a06d78ab14 for instance 79d4067a-0e2c-4089-9572-79a43e5d650b on n-h1-master-1 Oct 23 01:40:56.188620 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-dcc1d7e2-d71a-42c0-a0e4-fdffad9fcd95 req-5d3c029c-23b3-4343-b690-11e1dfaad193 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089443 Oct 23 01:40:56.190683 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2929/5952] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:40:56.211120 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-97d70b82-0601-4374-b342-7774c494f2c6 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:56.212482 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-97d70b82-0601-4374-b342-7774c494f2c6 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:56.231453 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-97d70b82-0601-4374-b342-7774c494f2c6 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:56.235680 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-97d70b82-0601-4374-b342-7774c494f2c6 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:56.238809 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-97d70b82-0601-4374-b342-7774c494f2c6 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:56.239584 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1cac7f17-f8fa-431d-9224-9ec393c9bff3 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e367cf6f3b4259902ac1f5f9918391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0a78b98040598bfa5fac4fe95cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:56.243011 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-97d70b82-0601-4374-b342-7774c494f2c6 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:56.243744 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-97d70b82-0601-4374-b342-7774c494f2c6 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:56.244927 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-97d70b82-0601-4374-b342-7774c494f2c6 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:56.262542 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1cac7f17-f8fa-431d-9224-9ec393c9bff3 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] 10.222.0.42 "GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b" status: 200 len: 1323 microversion: 2.1 time: 0.344766 Oct 23 01:40:56.263162 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3024/5953] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:40:55 2022] GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b => generated 1323 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:40:56.656909 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-97d70b82-0601-4374-b342-7774c494f2c6 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:56.669281 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-97d70b82-0601-4374-b342-7774c494f2c6 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:56.671673 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-97d70b82-0601-4374-b342-7774c494f2c6 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:56.673137 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-97d70b82-0601-4374-b342-7774c494f2c6 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1875 microversion: 2.32 time: 0.479004 Oct 23 01:40:56.674045 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2930/5954] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:40:56 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1875 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:40:57.292100 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a750b89e-3628-4c95-8846-847e4cfaf50a tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:57.292730 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a750b89e-3628-4c95-8846-847e4cfaf50a tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] [instance: 79d4067a-0e2c-4089-9572-79a43e5d650b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:57.302569 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a750b89e-3628-4c95-8846-847e4cfaf50a tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:57.303313 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a750b89e-3628-4c95-8846-847e4cfaf50a tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:57.303752 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a750b89e-3628-4c95-8846-847e4cfaf50a tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:57.304648 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a750b89e-3628-4c95-8846-847e4cfaf50a tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:57.305156 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a750b89e-3628-4c95-8846-847e4cfaf50a tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:57.305783 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a750b89e-3628-4c95-8846-847e4cfaf50a tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:57.523839 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a750b89e-3628-4c95-8846-847e4cfaf50a tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e367cf6f3b4259902ac1f5f9918391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0a78b98040598bfa5fac4fe95cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:57.532073 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a750b89e-3628-4c95-8846-847e4cfaf50a tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] 10.222.0.42 "GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b" status: 200 len: 1323 microversion: 2.1 time: 0.244943 Oct 23 01:40:57.532875 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3025/5955] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:40:57 2022] GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b => generated 1323 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:40:57.699938 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6877ed2b-7297-4fa9-a025-448f1b13219a tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:57.701348 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6877ed2b-7297-4fa9-a025-448f1b13219a tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:57.719160 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6877ed2b-7297-4fa9-a025-448f1b13219a tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:57.719985 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6877ed2b-7297-4fa9-a025-448f1b13219a tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:57.720577 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6877ed2b-7297-4fa9-a025-448f1b13219a tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:57.721443 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6877ed2b-7297-4fa9-a025-448f1b13219a tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:57.722076 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6877ed2b-7297-4fa9-a025-448f1b13219a tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:57.722649 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6877ed2b-7297-4fa9-a025-448f1b13219a tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:58.128217 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6877ed2b-7297-4fa9-a025-448f1b13219a tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:58.138237 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6877ed2b-7297-4fa9-a025-448f1b13219a tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:58.139695 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6877ed2b-7297-4fa9-a025-448f1b13219a tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:58.141252 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6877ed2b-7297-4fa9-a025-448f1b13219a tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1875 microversion: 2.32 time: 0.445131 Oct 23 01:40:58.155308 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2931/5956] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:40:57 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1875 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:40:58.209172 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-76a54cef-11ad-41e8-8ad1-d9558fdd1e65 req-bd11515b-6f83-4cc8-8739-58079fc8c54c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f47e3006-cfbb-48bb-ae86-b018486c5e21", "name": "network-vif-plugged", "status": "completed", "tag": "345a0e13-1a42-4284-a64e-2fa1f828e62c"}, {"server_uuid": "f47e3006-cfbb-48bb-ae86-b018486c5e21", "name": "network-vif-plugged", "status": "completed", "tag": "7f192cbc-e5eb-416b-ba58-875c5f887eb7"}, {"server_uuid": "f47e3006-cfbb-48bb-ae86-b018486c5e21", "name": "network-vif-plugged", "status": "completed", "tag": "ee70f73c-88ff-4855-a82e-88caa393f0fc"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:40:58.238346 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-76a54cef-11ad-41e8-8ad1-d9558fdd1e65 req-bd11515b-6f83-4cc8-8739-58079fc8c54c service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:58.240927 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-76a54cef-11ad-41e8-8ad1-d9558fdd1e65 req-bd11515b-6f83-4cc8-8739-58079fc8c54c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:58.241458 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-76a54cef-11ad-41e8-8ad1-d9558fdd1e65 req-bd11515b-6f83-4cc8-8739-58079fc8c54c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:58.267826 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-76a54cef-11ad-41e8-8ad1-d9558fdd1e65 req-bd11515b-6f83-4cc8-8739-58079fc8c54c service nova] Creating event network-vif-plugged:345a0e13-1a42-4284-a64e-2fa1f828e62c for instance f47e3006-cfbb-48bb-ae86-b018486c5e21 on n-h2-master-1 Oct 23 01:40:58.268518 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-76a54cef-11ad-41e8-8ad1-d9558fdd1e65 req-bd11515b-6f83-4cc8-8739-58079fc8c54c service nova] Creating event network-vif-plugged:7f192cbc-e5eb-416b-ba58-875c5f887eb7 for instance f47e3006-cfbb-48bb-ae86-b018486c5e21 on n-h2-master-1 Oct 23 01:40:58.269436 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-76a54cef-11ad-41e8-8ad1-d9558fdd1e65 req-bd11515b-6f83-4cc8-8739-58079fc8c54c service nova] Creating event network-vif-plugged:ee70f73c-88ff-4855-a82e-88caa393f0fc for instance f47e3006-cfbb-48bb-ae86-b018486c5e21 on n-h2-master-1 Oct 23 01:40:58.278108 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-76a54cef-11ad-41e8-8ad1-d9558fdd1e65 req-bd11515b-6f83-4cc8-8739-58079fc8c54c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.074283 Oct 23 01:40:58.280147 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3026/5957] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:40:58.557055 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0f131288-c270-4a18-bc29-54fb515c6859 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:58.558163 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0f131288-c270-4a18-bc29-54fb515c6859 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] [instance: 79d4067a-0e2c-4089-9572-79a43e5d650b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:58.569790 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0f131288-c270-4a18-bc29-54fb515c6859 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:58.570326 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0f131288-c270-4a18-bc29-54fb515c6859 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:58.570839 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0f131288-c270-4a18-bc29-54fb515c6859 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:58.576034 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0f131288-c270-4a18-bc29-54fb515c6859 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:58.576777 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0f131288-c270-4a18-bc29-54fb515c6859 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:58.577410 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0f131288-c270-4a18-bc29-54fb515c6859 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:58.921500 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0f131288-c270-4a18-bc29-54fb515c6859 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e367cf6f3b4259902ac1f5f9918391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0a78b98040598bfa5fac4fe95cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:58.934283 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0f131288-c270-4a18-bc29-54fb515c6859 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] 10.222.0.42 "GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b" status: 200 len: 1518 microversion: 2.1 time: 0.382332 Oct 23 01:40:58.935309 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2932/5958] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:40:58 2022] GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b => generated 1518 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:40:58.959735 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-50368bc2-d4b6-40d0-8ca7-0ef2a4c592b6 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:40:58.962468 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-50368bc2-d4b6-40d0-8ca7-0ef2a4c592b6 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] [instance: 79d4067a-0e2c-4089-9572-79a43e5d650b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:58.970698 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8b8948c7-f77f-4aa2-8e55-2d7544080785 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Action: 'create', calling method: .version_select at 0x7f5cc19ea310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1414212698", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMx/OEq3TDl9Y/rFmaDSt5Ak5Km1AaYfaJQVxoOZg6cfGzfsWDTR/LcEmpkQjqTiI/DdRclGkZXhOgcLteScNtI+KW60mPcJvZDB31X5DeS7KAiTErpoZBeY5FScE9ZPjg=="}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:40:58.972634 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-50368bc2-d4b6-40d0-8ca7-0ef2a4c592b6 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:58.973829 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-50368bc2-d4b6-40d0-8ca7-0ef2a4c592b6 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:58.974565 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-50368bc2-d4b6-40d0-8ca7-0ef2a4c592b6 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:58.975500 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-50368bc2-d4b6-40d0-8ca7-0ef2a4c592b6 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:58.976203 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-50368bc2-d4b6-40d0-8ca7-0ef2a4c592b6 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:58.976953 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-50368bc2-d4b6-40d0-8ca7-0ef2a4c592b6 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:59.008527 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-8b8948c7-f77f-4aa2-8e55-2d7544080785 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Getting quotas for project 0c7f734a12da437e806e4c791d27d615. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:40:59.016525 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-50368bc2-d4b6-40d0-8ca7-0ef2a4c592b6 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lazy-loading 'flavor' on Instance uuid 79d4067a-0e2c-4089-9572-79a43e5d650b {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:40:59.018117 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-8b8948c7-f77f-4aa2-8e55-2d7544080785 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Getting quotas for user 037ed342980a4de9a2dfc8d576293aba and project 0c7f734a12da437e806e4c791d27d615. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:40:59.182272 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8b8948c7-f77f-4aa2-8e55-2d7544080785 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.520746 Oct 23 01:40:59.183264 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3027/5959] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 01:40:58 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:40:59.192823 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-92940ae6-24f3-451d-a0de-ea40a6bdc96a tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:59.193710 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-92940ae6-24f3-451d-a0de-ea40a6bdc96a tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:59.211188 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92940ae6-24f3-451d-a0de-ea40a6bdc96a tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:59.211807 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92940ae6-24f3-451d-a0de-ea40a6bdc96a tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:59.212944 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92940ae6-24f3-451d-a0de-ea40a6bdc96a tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:59.213736 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92940ae6-24f3-451d-a0de-ea40a6bdc96a tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:59.220157 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92940ae6-24f3-451d-a0de-ea40a6bdc96a tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:59.220968 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92940ae6-24f3-451d-a0de-ea40a6bdc96a tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:59.412693 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-50368bc2-d4b6-40d0-8ca7-0ef2a4c592b6 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] 10.222.0.42 "POST /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b/action" status: 200 len: 32 microversion: 2.1 time: 0.458243 Oct 23 01:40:59.413461 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2933/5960] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:40:58 2022] POST /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b/action => generated 32 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:40:59.424933 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e3fe6484-4275-40ea-bd37-ba6f046ae673 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:40:59.430963 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e3fe6484-4275-40ea-bd37-ba6f046ae673 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] [instance: 79d4067a-0e2c-4089-9572-79a43e5d650b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:40:59.447996 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e3fe6484-4275-40ea-bd37-ba6f046ae673 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:59.449849 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e3fe6484-4275-40ea-bd37-ba6f046ae673 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:59.450539 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e3fe6484-4275-40ea-bd37-ba6f046ae673 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:59.454406 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e3fe6484-4275-40ea-bd37-ba6f046ae673 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:40:59.457238 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e3fe6484-4275-40ea-bd37-ba6f046ae673 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:40:59.457921 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e3fe6484-4275-40ea-bd37-ba6f046ae673 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:40:59.502862 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:59.811789 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e3fe6484-4275-40ea-bd37-ba6f046ae673 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e367cf6f3b4259902ac1f5f9918391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0a78b98040598bfa5fac4fe95cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:59.825006 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e3fe6484-4275-40ea-bd37-ba6f046ae673 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] 10.222.0.42 "GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b" status: 200 len: 1524 microversion: 2.1 time: 0.399626 Oct 23 01:40:59.825168 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2934/5961] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:40:59 2022] GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b => generated 1524 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:40:59.836025 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-92940ae6-24f3-451d-a0de-ea40a6bdc96a tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:59.847677 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-92940ae6-24f3-451d-a0de-ea40a6bdc96a tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:59.849413 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-92940ae6-24f3-451d-a0de-ea40a6bdc96a tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:40:59.850895 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-92940ae6-24f3-451d-a0de-ea40a6bdc96a tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1875 microversion: 2.32 time: 0.666328 Oct 23 01:40:59.871943 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3028/5962] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:40:59 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1875 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:41:00.314078 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-c740553a-c497-4a52-80fb-c386da6f1d47 req-9f89a844-732f-4b36-9432-1500a8c0d256 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f47e3006-cfbb-48bb-ae86-b018486c5e21", "name": "network-vif-plugged", "status": "completed", "tag": "fec59d18-4586-4075-a7ad-b238f66cb30f"}, {"server_uuid": "f47e3006-cfbb-48bb-ae86-b018486c5e21", "name": "network-vif-plugged", "status": "completed", "tag": "b17738dd-6229-4e82-a18e-fbfd14792442"}, {"server_uuid": "f47e3006-cfbb-48bb-ae86-b018486c5e21", "name": "network-vif-plugged", "status": "completed", "tag": "020cb08c-2e13-452d-aab8-e6b34a8be515"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:41:00.325675 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-c740553a-c497-4a52-80fb-c386da6f1d47 req-9f89a844-732f-4b36-9432-1500a8c0d256 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:00.326413 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-c740553a-c497-4a52-80fb-c386da6f1d47 req-9f89a844-732f-4b36-9432-1500a8c0d256 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:00.326991 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-c740553a-c497-4a52-80fb-c386da6f1d47 req-9f89a844-732f-4b36-9432-1500a8c0d256 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:00.340194 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-c740553a-c497-4a52-80fb-c386da6f1d47 req-9f89a844-732f-4b36-9432-1500a8c0d256 service nova] Creating event network-vif-plugged:fec59d18-4586-4075-a7ad-b238f66cb30f for instance f47e3006-cfbb-48bb-ae86-b018486c5e21 on n-h2-master-1 Oct 23 01:41:00.340987 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-c740553a-c497-4a52-80fb-c386da6f1d47 req-9f89a844-732f-4b36-9432-1500a8c0d256 service nova] Creating event network-vif-plugged:b17738dd-6229-4e82-a18e-fbfd14792442 for instance f47e3006-cfbb-48bb-ae86-b018486c5e21 on n-h2-master-1 Oct 23 01:41:00.341484 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-c740553a-c497-4a52-80fb-c386da6f1d47 req-9f89a844-732f-4b36-9432-1500a8c0d256 service nova] Creating event network-vif-plugged:020cb08c-2e13-452d-aab8-e6b34a8be515 for instance f47e3006-cfbb-48bb-ae86-b018486c5e21 on n-h2-master-1 Oct 23 01:41:00.350145 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-c740553a-c497-4a52-80fb-c386da6f1d47 req-9f89a844-732f-4b36-9432-1500a8c0d256 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.037729 Oct 23 01:41:00.350145 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2935/5963] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:41:00.847108 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-aff7fa38-225f-4293-a119-9b799bfa0d6f tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:41:00.847839 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-aff7fa38-225f-4293-a119-9b799bfa0d6f tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] [instance: 79d4067a-0e2c-4089-9572-79a43e5d650b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:41:00.851787 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:41:00.865756 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aff7fa38-225f-4293-a119-9b799bfa0d6f tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:00.867277 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aff7fa38-225f-4293-a119-9b799bfa0d6f tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:00.869001 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aff7fa38-225f-4293-a119-9b799bfa0d6f tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:00.869756 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aff7fa38-225f-4293-a119-9b799bfa0d6f tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:00.870291 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aff7fa38-225f-4293-a119-9b799bfa0d6f tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:00.870756 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aff7fa38-225f-4293-a119-9b799bfa0d6f tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:00.881296 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-122d133a-2c32-45c8-ae28-dfb554fb8cea tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:41:00.883857 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-122d133a-2c32-45c8-ae28-dfb554fb8cea tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:41:00.888984 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-122d133a-2c32-45c8-ae28-dfb554fb8cea tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:00.889482 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-122d133a-2c32-45c8-ae28-dfb554fb8cea tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:00.890585 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-122d133a-2c32-45c8-ae28-dfb554fb8cea tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:00.892056 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-122d133a-2c32-45c8-ae28-dfb554fb8cea tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:00.892609 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-122d133a-2c32-45c8-ae28-dfb554fb8cea tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:00.893122 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-122d133a-2c32-45c8-ae28-dfb554fb8cea tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:01.198958 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-aff7fa38-225f-4293-a119-9b799bfa0d6f tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e367cf6f3b4259902ac1f5f9918391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0a78b98040598bfa5fac4fe95cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:41:01.206936 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-aff7fa38-225f-4293-a119-9b799bfa0d6f tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] 10.222.0.42 "GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b" status: 200 len: 1524 microversion: 2.1 time: 0.363896 Oct 23 01:41:01.207522 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3029/5964] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:41:00 2022] GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b => generated 1524 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:41:01.222862 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-122d133a-2c32-45c8-ae28-dfb554fb8cea tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:41:01.233595 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-122d133a-2c32-45c8-ae28-dfb554fb8cea tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:41:01.235515 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-122d133a-2c32-45c8-ae28-dfb554fb8cea tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:41:01.237102 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-122d133a-2c32-45c8-ae28-dfb554fb8cea tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1875 microversion: 2.32 time: 0.361294 Oct 23 01:41:01.242894 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2936/5965] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:41:00 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1875 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:41:02.232275 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-84ca6a6e-df60-499f-b955-4f89d2a2df04 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:41:02.232959 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-84ca6a6e-df60-499f-b955-4f89d2a2df04 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] [instance: 79d4067a-0e2c-4089-9572-79a43e5d650b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:41:02.247960 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-84ca6a6e-df60-499f-b955-4f89d2a2df04 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:02.248403 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-84ca6a6e-df60-499f-b955-4f89d2a2df04 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:02.248853 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-84ca6a6e-df60-499f-b955-4f89d2a2df04 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:02.249577 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-84ca6a6e-df60-499f-b955-4f89d2a2df04 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:02.254069 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-84ca6a6e-df60-499f-b955-4f89d2a2df04 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:02.254843 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-84ca6a6e-df60-499f-b955-4f89d2a2df04 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:02.264323 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ec4c43b3-a33b-401c-bf27-56296b170dd9 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:41:02.265513 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ec4c43b3-a33b-401c-bf27-56296b170dd9 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:41:02.287610 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec4c43b3-a33b-401c-bf27-56296b170dd9 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:02.288633 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec4c43b3-a33b-401c-bf27-56296b170dd9 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:02.291231 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec4c43b3-a33b-401c-bf27-56296b170dd9 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:02.292277 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec4c43b3-a33b-401c-bf27-56296b170dd9 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:02.295446 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec4c43b3-a33b-401c-bf27-56296b170dd9 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:02.296099 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec4c43b3-a33b-401c-bf27-56296b170dd9 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:02.602459 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-84ca6a6e-df60-499f-b955-4f89d2a2df04 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e367cf6f3b4259902ac1f5f9918391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0a78b98040598bfa5fac4fe95cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:41:02.614410 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-84ca6a6e-df60-499f-b955-4f89d2a2df04 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] 10.222.0.42 "GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b" status: 200 len: 1524 microversion: 2.1 time: 0.385723 Oct 23 01:41:02.618211 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3030/5966] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:41:02 2022] GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b => generated 1524 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:41:02.707488 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ec4c43b3-a33b-401c-bf27-56296b170dd9 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:41:02.723866 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ec4c43b3-a33b-401c-bf27-56296b170dd9 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:41:02.725601 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ec4c43b3-a33b-401c-bf27-56296b170dd9 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:41:02.727955 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ec4c43b3-a33b-401c-bf27-56296b170dd9 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1875 microversion: 2.32 time: 0.468234 Oct 23 01:41:02.731695 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2937/5967] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:41:02 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1875 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:41:03.644580 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4ac17e07-646b-4522-a975-e265e5ef4600 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:41:03.645201 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4ac17e07-646b-4522-a975-e265e5ef4600 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] [instance: 79d4067a-0e2c-4089-9572-79a43e5d650b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:41:03.653135 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4ac17e07-646b-4522-a975-e265e5ef4600 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:03.653675 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4ac17e07-646b-4522-a975-e265e5ef4600 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:03.654136 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4ac17e07-646b-4522-a975-e265e5ef4600 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:03.654868 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4ac17e07-646b-4522-a975-e265e5ef4600 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:03.655326 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4ac17e07-646b-4522-a975-e265e5ef4600 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:03.655748 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4ac17e07-646b-4522-a975-e265e5ef4600 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:03.757647 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f1701944-7f81-49e3-8341-dab9327bc75a tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:41:03.759337 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f1701944-7f81-49e3-8341-dab9327bc75a tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:41:03.770700 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f1701944-7f81-49e3-8341-dab9327bc75a tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:03.771189 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f1701944-7f81-49e3-8341-dab9327bc75a tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:03.772520 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f1701944-7f81-49e3-8341-dab9327bc75a tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:03.774696 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f1701944-7f81-49e3-8341-dab9327bc75a tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:03.775316 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f1701944-7f81-49e3-8341-dab9327bc75a tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:03.778068 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f1701944-7f81-49e3-8341-dab9327bc75a tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:04.002232 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4ac17e07-646b-4522-a975-e265e5ef4600 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e367cf6f3b4259902ac1f5f9918391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0a78b98040598bfa5fac4fe95cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:41:04.010716 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4ac17e07-646b-4522-a975-e265e5ef4600 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] 10.222.0.42 "GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b" status: 200 len: 1524 microversion: 2.1 time: 0.371040 Oct 23 01:41:04.012642 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3031/5968] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:41:03 2022] GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b => generated 1524 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:41:04.525894 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f1701944-7f81-49e3-8341-dab9327bc75a tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:41:04.543032 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f1701944-7f81-49e3-8341-dab9327bc75a tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:41:04.544493 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f1701944-7f81-49e3-8341-dab9327bc75a tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:41:04.550860 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f1701944-7f81-49e3-8341-dab9327bc75a tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 2823 microversion: 2.32 time: 0.797270 Oct 23 01:41:04.574238 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2938/5969] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:41:03 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 2823 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:41:04.592114 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-08ca53ce-bcac-44b4-a145-b53f459747c3 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:41:04.593039 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-08ca53ce-bcac-44b4-a145-b53f459747c3 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:41:04.608383 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-08ca53ce-bcac-44b4-a145-b53f459747c3 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:04.608383 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-08ca53ce-bcac-44b4-a145-b53f459747c3 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:04.608383 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-08ca53ce-bcac-44b4-a145-b53f459747c3 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:04.608383 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-08ca53ce-bcac-44b4-a145-b53f459747c3 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:04.608383 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-08ca53ce-bcac-44b4-a145-b53f459747c3 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:04.608383 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-08ca53ce-bcac-44b4-a145-b53f459747c3 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:04.741960 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-08ca53ce-bcac-44b4-a145-b53f459747c3 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21/os-interface" status: 200 len: 1828 microversion: 2.32 time: 0.159662 Oct 23 01:41:04.742775 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3032/5970] 10.222.0.42 () {60 vars in 1316 bytes} [Sun Oct 23 01:41:04 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21/os-interface => generated 1828 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:41:05.036853 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-69dbd292-25a6-4088-adbb-578ee019d2a2 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:41:05.037781 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-69dbd292-25a6-4088-adbb-578ee019d2a2 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] [instance: 79d4067a-0e2c-4089-9572-79a43e5d650b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:41:05.047347 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-69dbd292-25a6-4088-adbb-578ee019d2a2 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:05.047979 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-69dbd292-25a6-4088-adbb-578ee019d2a2 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:05.048519 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-69dbd292-25a6-4088-adbb-578ee019d2a2 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:05.049472 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-69dbd292-25a6-4088-adbb-578ee019d2a2 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:05.050189 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-69dbd292-25a6-4088-adbb-578ee019d2a2 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:05.050820 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-69dbd292-25a6-4088-adbb-578ee019d2a2 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:05.496037 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-69dbd292-25a6-4088-adbb-578ee019d2a2 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e367cf6f3b4259902ac1f5f9918391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0a78b98040598bfa5fac4fe95cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:41:05.513110 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-69dbd292-25a6-4088-adbb-578ee019d2a2 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] 10.222.0.42 "GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b" status: 200 len: 1524 microversion: 2.1 time: 0.481676 Oct 23 01:41:05.514093 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2939/5971] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:41:05 2022] GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b => generated 1524 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:41:06.392668 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-43d73608-47e1-4671-b695-0a9984030b0f req-4fb5892a-deca-4e25-ae95-a855a4ee968b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f47e3006-cfbb-48bb-ae86-b018486c5e21", "tag": "b17738dd-6229-4e82-a18e-fbfd14792442"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:41:06.406512 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-43d73608-47e1-4671-b695-0a9984030b0f req-4fb5892a-deca-4e25-ae95-a855a4ee968b service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:06.407004 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-43d73608-47e1-4671-b695-0a9984030b0f req-4fb5892a-deca-4e25-ae95-a855a4ee968b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:06.408049 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-43d73608-47e1-4671-b695-0a9984030b0f req-4fb5892a-deca-4e25-ae95-a855a4ee968b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:06.423184 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-43d73608-47e1-4671-b695-0a9984030b0f req-4fb5892a-deca-4e25-ae95-a855a4ee968b service nova] Creating event network-changed:b17738dd-6229-4e82-a18e-fbfd14792442 for instance f47e3006-cfbb-48bb-ae86-b018486c5e21 on n-h2-master-1 Oct 23 01:41:06.429073 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-43d73608-47e1-4671-b695-0a9984030b0f req-4fb5892a-deca-4e25-ae95-a855a4ee968b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045351 Oct 23 01:41:06.429758 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3033/5972] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:41:06.536963 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ffcb8dbf-78d0-4319-8ede-9299a2f1baa4 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:41:06.538415 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ffcb8dbf-78d0-4319-8ede-9299a2f1baa4 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] [instance: 79d4067a-0e2c-4089-9572-79a43e5d650b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:41:06.549465 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ffcb8dbf-78d0-4319-8ede-9299a2f1baa4 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:06.551485 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ffcb8dbf-78d0-4319-8ede-9299a2f1baa4 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:06.551729 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ffcb8dbf-78d0-4319-8ede-9299a2f1baa4 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:06.552629 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ffcb8dbf-78d0-4319-8ede-9299a2f1baa4 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:06.553264 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ffcb8dbf-78d0-4319-8ede-9299a2f1baa4 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:06.554161 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ffcb8dbf-78d0-4319-8ede-9299a2f1baa4 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:06.859105 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ffcb8dbf-78d0-4319-8ede-9299a2f1baa4 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e367cf6f3b4259902ac1f5f9918391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0a78b98040598bfa5fac4fe95cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:41:06.871772 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ffcb8dbf-78d0-4319-8ede-9299a2f1baa4 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] 10.222.0.42 "GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b" status: 200 len: 1524 microversion: 2.1 time: 0.338129 Oct 23 01:41:06.877565 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2940/5973] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:41:06 2022] GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b => generated 1524 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:41:07.910884 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-65458113-69fb-42fa-b67e-a95a826a1e07 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:41:07.911619 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-65458113-69fb-42fa-b67e-a95a826a1e07 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] [instance: 79d4067a-0e2c-4089-9572-79a43e5d650b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:41:07.953309 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-65458113-69fb-42fa-b67e-a95a826a1e07 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:07.957003 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-65458113-69fb-42fa-b67e-a95a826a1e07 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:07.958897 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-65458113-69fb-42fa-b67e-a95a826a1e07 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:07.962890 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-65458113-69fb-42fa-b67e-a95a826a1e07 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:07.963693 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-65458113-69fb-42fa-b67e-a95a826a1e07 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:07.965928 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-65458113-69fb-42fa-b67e-a95a826a1e07 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:08.257185 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-65458113-69fb-42fa-b67e-a95a826a1e07 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e367cf6f3b4259902ac1f5f9918391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0a78b98040598bfa5fac4fe95cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:41:08.267685 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-65458113-69fb-42fa-b67e-a95a826a1e07 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] 10.222.0.42 "GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b" status: 200 len: 1524 microversion: 2.1 time: 0.372511 Oct 23 01:41:08.284777 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3034/5974] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:41:07 2022] GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b => generated 1524 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:41:09.294175 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6a717e65-8890-45bc-b5b0-dd327080e4d5 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:41:09.295047 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6a717e65-8890-45bc-b5b0-dd327080e4d5 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] [instance: 79d4067a-0e2c-4089-9572-79a43e5d650b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:41:09.304948 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:41:09.316836 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6a717e65-8890-45bc-b5b0-dd327080e4d5 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:09.318254 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6a717e65-8890-45bc-b5b0-dd327080e4d5 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:09.318254 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6a717e65-8890-45bc-b5b0-dd327080e4d5 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:09.321587 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6a717e65-8890-45bc-b5b0-dd327080e4d5 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:09.323471 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6a717e65-8890-45bc-b5b0-dd327080e4d5 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:09.334219 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6a717e65-8890-45bc-b5b0-dd327080e4d5 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:09.604994 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6a717e65-8890-45bc-b5b0-dd327080e4d5 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e367cf6f3b4259902ac1f5f9918391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0a78b98040598bfa5fac4fe95cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:41:09.616725 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6a717e65-8890-45bc-b5b0-dd327080e4d5 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] 10.222.0.42 "GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b" status: 200 len: 1524 microversion: 2.1 time: 0.328101 Oct 23 01:41:09.633147 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2941/5975] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:41:09 2022] GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b => generated 1524 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:41:10.643418 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-40ad66c6-4a91-46c5-9dcb-d09c94620427 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:41:10.646502 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-40ad66c6-4a91-46c5-9dcb-d09c94620427 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] [instance: 79d4067a-0e2c-4089-9572-79a43e5d650b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:41:10.649476 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=4 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:41:10.662510 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-40ad66c6-4a91-46c5-9dcb-d09c94620427 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:10.663022 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-40ad66c6-4a91-46c5-9dcb-d09c94620427 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:10.663475 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-40ad66c6-4a91-46c5-9dcb-d09c94620427 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:10.664208 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-40ad66c6-4a91-46c5-9dcb-d09c94620427 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:10.664675 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-40ad66c6-4a91-46c5-9dcb-d09c94620427 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:10.684903 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-40ad66c6-4a91-46c5-9dcb-d09c94620427 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:11.237042 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-40ad66c6-4a91-46c5-9dcb-d09c94620427 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e367cf6f3b4259902ac1f5f9918391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0a78b98040598bfa5fac4fe95cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:41:11.249050 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-40ad66c6-4a91-46c5-9dcb-d09c94620427 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] 10.222.0.42 "GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b" status: 200 len: 1524 microversion: 2.1 time: 0.610416 Oct 23 01:41:11.249745 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3035/5976] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:41:10 2022] GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b => generated 1524 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:41:12.274692 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-57e2b8ce-d4ba-42d0-8776-1bf5e223cfde tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:41:12.275363 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-57e2b8ce-d4ba-42d0-8776-1bf5e223cfde tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] [instance: 79d4067a-0e2c-4089-9572-79a43e5d650b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:41:12.285374 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-57e2b8ce-d4ba-42d0-8776-1bf5e223cfde tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:12.286637 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-57e2b8ce-d4ba-42d0-8776-1bf5e223cfde tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:12.287081 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-57e2b8ce-d4ba-42d0-8776-1bf5e223cfde tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:12.287784 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-57e2b8ce-d4ba-42d0-8776-1bf5e223cfde tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:12.290624 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-57e2b8ce-d4ba-42d0-8776-1bf5e223cfde tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:12.296515 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-57e2b8ce-d4ba-42d0-8776-1bf5e223cfde tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:12.712955 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-57e2b8ce-d4ba-42d0-8776-1bf5e223cfde tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e367cf6f3b4259902ac1f5f9918391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0a78b98040598bfa5fac4fe95cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:41:12.712955 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-57e2b8ce-d4ba-42d0-8776-1bf5e223cfde tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] 10.222.0.42 "GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b" status: 200 len: 1524 microversion: 2.1 time: 0.421540 Oct 23 01:41:12.712955 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2942/5977] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:41:12 2022] GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b => generated 1524 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:41:13.750647 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-37936795-0776-437d-9967-0cb577f80e00 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:41:13.751293 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-37936795-0776-437d-9967-0cb577f80e00 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] [instance: 79d4067a-0e2c-4089-9572-79a43e5d650b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:41:13.768105 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-37936795-0776-437d-9967-0cb577f80e00 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:13.768964 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-37936795-0776-437d-9967-0cb577f80e00 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:13.770396 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-37936795-0776-437d-9967-0cb577f80e00 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:13.774733 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-37936795-0776-437d-9967-0cb577f80e00 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:13.775841 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-37936795-0776-437d-9967-0cb577f80e00 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:13.777565 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-37936795-0776-437d-9967-0cb577f80e00 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:14.148206 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-37936795-0776-437d-9967-0cb577f80e00 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e367cf6f3b4259902ac1f5f9918391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0a78b98040598bfa5fac4fe95cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:41:14.167521 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-37936795-0776-437d-9967-0cb577f80e00 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] 10.222.0.42 "GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b" status: 200 len: 1524 microversion: 2.1 time: 0.421790 Oct 23 01:41:14.184012 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3036/5978] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:41:13 2022] GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b => generated 1524 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:41:14.572016 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9092c180-da2b-460e-95f0-60adba91eca5 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1856712752", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "1d03e02c-6ab6-4595-939c-1475ed68def5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1414212698", "security_groups": [{"name": "tempest-secgroup-smoke-874419095"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:41:14.757996 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-9092c180-da2b-460e-95f0-60adba91eca5 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] validate_networks() for [('1d03e02c-6ab6-4595-939c-1475ed68def5', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:41:15.194044 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3d40259f-c44b-421c-a168-e5e69aa40cf3 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:41:15.195367 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3d40259f-c44b-421c-a168-e5e69aa40cf3 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] [instance: 79d4067a-0e2c-4089-9572-79a43e5d650b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:41:15.211934 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d40259f-c44b-421c-a168-e5e69aa40cf3 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:15.214400 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d40259f-c44b-421c-a168-e5e69aa40cf3 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:15.216202 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d40259f-c44b-421c-a168-e5e69aa40cf3 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:15.218189 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d40259f-c44b-421c-a168-e5e69aa40cf3 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:15.223907 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d40259f-c44b-421c-a168-e5e69aa40cf3 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:15.224718 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d40259f-c44b-421c-a168-e5e69aa40cf3 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:15.779723 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3d40259f-c44b-421c-a168-e5e69aa40cf3 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e367cf6f3b4259902ac1f5f9918391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0a78b98040598bfa5fac4fe95cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:41:15.795897 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3d40259f-c44b-421c-a168-e5e69aa40cf3 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] 10.222.0.42 "GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b" status: 200 len: 1524 microversion: 2.1 time: 0.604741 Oct 23 01:41:15.802128 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3037/5979] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:41:15 2022] GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b => generated 1524 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:41:15.822352 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-9092c180-da2b-460e-95f0-60adba91eca5 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:41:15.822827 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-9092c180-da2b-460e-95f0-60adba91eca5 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:41:15.823760 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-9092c180-da2b-460e-95f0-60adba91eca5 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:41:15.824169 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-9092c180-da2b-460e-95f0-60adba91eca5 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:41:15.824574 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-9092c180-da2b-460e-95f0-60adba91eca5 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:41:15.846431 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9092c180-da2b-460e-95f0-60adba91eca5 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:15.847449 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9092c180-da2b-460e-95f0-60adba91eca5 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:15.847887 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9092c180-da2b-460e-95f0-60adba91eca5 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:15.848615 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9092c180-da2b-460e-95f0-60adba91eca5 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:15.849067 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9092c180-da2b-460e-95f0-60adba91eca5 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:15.849500 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9092c180-da2b-460e-95f0-60adba91eca5 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:15.887894 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-9092c180-da2b-460e-95f0-60adba91eca5 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Getting quotas for project 0c7f734a12da437e806e4c791d27d615. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:41:15.893775 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-9092c180-da2b-460e-95f0-60adba91eca5 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Getting quotas for user 037ed342980a4de9a2dfc8d576293aba and project 0c7f734a12da437e806e4c791d27d615. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:41:15.910604 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9092c180-da2b-460e-95f0-60adba91eca5 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:41:15.915419 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9092c180-da2b-460e-95f0-60adba91eca5 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 53409afc-6907-43b2-96e7-92536059a476] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:41:16.171821 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9092c180-da2b-460e-95f0-60adba91eca5 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.601865 Oct 23 01:41:16.184984 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e7cde080-8066-4bc7-9f58-94c34a2825d4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:41:16.185623 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e7cde080-8066-4bc7-9f58-94c34a2825d4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 53409afc-6907-43b2-96e7-92536059a476] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:41:16.191600 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2943/5980] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:41:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 1625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 23 01:41:16.297914 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e7cde080-8066-4bc7-9f58-94c34a2825d4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:41:16.309881 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e7cde080-8066-4bc7-9f58-94c34a2825d4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476" status: 200 len: 1267 microversion: 2.1 time: 0.127096 Oct 23 01:41:16.310533 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3038/5981] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:41:16 2022] GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476 => generated 1267 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:41:16.830592 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5aee890e-29c3-4cc5-8208-2e54c0c25fdf tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:41:16.832632 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5aee890e-29c3-4cc5-8208-2e54c0c25fdf tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] [instance: 79d4067a-0e2c-4089-9572-79a43e5d650b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:41:16.841622 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5aee890e-29c3-4cc5-8208-2e54c0c25fdf tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:16.842624 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5aee890e-29c3-4cc5-8208-2e54c0c25fdf tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:16.843284 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5aee890e-29c3-4cc5-8208-2e54c0c25fdf tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:16.844220 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5aee890e-29c3-4cc5-8208-2e54c0c25fdf tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:16.846481 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5aee890e-29c3-4cc5-8208-2e54c0c25fdf tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:16.847631 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5aee890e-29c3-4cc5-8208-2e54c0c25fdf tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:17.062395 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5aee890e-29c3-4cc5-8208-2e54c0c25fdf tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e367cf6f3b4259902ac1f5f9918391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0a78b98040598bfa5fac4fe95cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:41:17.073622 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5aee890e-29c3-4cc5-8208-2e54c0c25fdf tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] 10.222.0.42 "GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b" status: 200 len: 1524 microversion: 2.1 time: 0.248159 Oct 23 01:41:17.075716 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2944/5982] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:41:16 2022] GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b => generated 1524 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:41:17.333115 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5bb79688-9874-4ac1-aaa7-7ee91f4bebd3 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:41:17.336107 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5bb79688-9874-4ac1-aaa7-7ee91f4bebd3 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 53409afc-6907-43b2-96e7-92536059a476] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:41:17.433962 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5bb79688-9874-4ac1-aaa7-7ee91f4bebd3 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:41:17.442809 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5bb79688-9874-4ac1-aaa7-7ee91f4bebd3 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476" status: 200 len: 1267 microversion: 2.1 time: 0.113522 Oct 23 01:41:17.444057 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3039/5983] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:41:17 2022] GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476 => generated 1267 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:41:18.098465 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-57edb46c-2d70-41e5-b039-d77d9b9847af tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:41:18.100289 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-57edb46c-2d70-41e5-b039-d77d9b9847af tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] [instance: 79d4067a-0e2c-4089-9572-79a43e5d650b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:41:18.123281 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-57edb46c-2d70-41e5-b039-d77d9b9847af tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:18.124280 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-57edb46c-2d70-41e5-b039-d77d9b9847af tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:18.125528 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-57edb46c-2d70-41e5-b039-d77d9b9847af tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:18.126472 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-57edb46c-2d70-41e5-b039-d77d9b9847af tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:18.127096 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-57edb46c-2d70-41e5-b039-d77d9b9847af tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:18.127706 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-57edb46c-2d70-41e5-b039-d77d9b9847af tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:18.369435 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-57edb46c-2d70-41e5-b039-d77d9b9847af tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e367cf6f3b4259902ac1f5f9918391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0a78b98040598bfa5fac4fe95cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:41:18.383029 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-57edb46c-2d70-41e5-b039-d77d9b9847af tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] 10.222.0.42 "GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b" status: 200 len: 1524 microversion: 2.1 time: 0.287293 Oct 23 01:41:18.384854 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2945/5984] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:41:18 2022] GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b => generated 1524 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:41:18.472132 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-656c8da1-093b-407e-b71d-bc49132a5fae tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:41:18.473715 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-656c8da1-093b-407e-b71d-bc49132a5fae tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 53409afc-6907-43b2-96e7-92536059a476] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:41:18.485610 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-656c8da1-093b-407e-b71d-bc49132a5fae tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:18.486887 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-656c8da1-093b-407e-b71d-bc49132a5fae tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:18.487638 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-656c8da1-093b-407e-b71d-bc49132a5fae tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:18.491039 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-656c8da1-093b-407e-b71d-bc49132a5fae tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:18.491730 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-656c8da1-093b-407e-b71d-bc49132a5fae tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:18.492266 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-656c8da1-093b-407e-b71d-bc49132a5fae tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:18.515157 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=100 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:41:18.591320 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-656c8da1-093b-407e-b71d-bc49132a5fae tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:41:18.601273 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-656c8da1-093b-407e-b71d-bc49132a5fae tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476" status: 200 len: 1263 microversion: 2.1 time: 0.133111 Oct 23 01:41:18.602230 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3040/5985] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:41:18 2022] GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476 => generated 1263 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:41:19.408437 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-51bd5737-6472-4dea-be88-5cea7c480299 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:41:19.410354 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-51bd5737-6472-4dea-be88-5cea7c480299 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] [instance: 79d4067a-0e2c-4089-9572-79a43e5d650b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:41:19.424586 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-51bd5737-6472-4dea-be88-5cea7c480299 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:19.425877 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-51bd5737-6472-4dea-be88-5cea7c480299 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:19.426830 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-51bd5737-6472-4dea-be88-5cea7c480299 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:19.427978 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-51bd5737-6472-4dea-be88-5cea7c480299 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:19.428927 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-51bd5737-6472-4dea-be88-5cea7c480299 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:19.429709 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-51bd5737-6472-4dea-be88-5cea7c480299 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:19.632411 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5cd8ec04-ba0b-4ac0-86fd-a77b7328e9e3 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:41:19.633027 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5cd8ec04-ba0b-4ac0-86fd-a77b7328e9e3 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 53409afc-6907-43b2-96e7-92536059a476] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:41:19.641563 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5cd8ec04-ba0b-4ac0-86fd-a77b7328e9e3 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:19.642445 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5cd8ec04-ba0b-4ac0-86fd-a77b7328e9e3 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:19.652101 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5cd8ec04-ba0b-4ac0-86fd-a77b7328e9e3 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:19.654084 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5cd8ec04-ba0b-4ac0-86fd-a77b7328e9e3 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:19.657969 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5cd8ec04-ba0b-4ac0-86fd-a77b7328e9e3 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:19.660354 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5cd8ec04-ba0b-4ac0-86fd-a77b7328e9e3 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:19.702024 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-51bd5737-6472-4dea-be88-5cea7c480299 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e367cf6f3b4259902ac1f5f9918391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0a78b98040598bfa5fac4fe95cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:41:19.723672 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-51bd5737-6472-4dea-be88-5cea7c480299 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] 10.222.0.42 "GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b" status: 200 len: 1524 microversion: 2.1 time: 0.317510 Oct 23 01:41:19.742592 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2946/5986] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:41:19 2022] GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b => generated 1524 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:41:19.845449 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5cd8ec04-ba0b-4ac0-86fd-a77b7328e9e3 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:41:19.858247 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5cd8ec04-ba0b-4ac0-86fd-a77b7328e9e3 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476" status: 200 len: 1327 microversion: 2.1 time: 0.229681 Oct 23 01:41:19.874338 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3041/5987] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:41:19 2022] GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476 => generated 1327 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:41:20.755090 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8a589171-07dd-40be-b8db-979ae0fd2467 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:41:20.758731 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8a589171-07dd-40be-b8db-979ae0fd2467 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] [instance: 79d4067a-0e2c-4089-9572-79a43e5d650b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:41:20.779532 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a589171-07dd-40be-b8db-979ae0fd2467 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:20.781064 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a589171-07dd-40be-b8db-979ae0fd2467 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:20.781824 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a589171-07dd-40be-b8db-979ae0fd2467 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:20.782758 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a589171-07dd-40be-b8db-979ae0fd2467 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:20.783386 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a589171-07dd-40be-b8db-979ae0fd2467 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:20.783979 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a589171-07dd-40be-b8db-979ae0fd2467 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:20.895115 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-35e9696a-5f10-4564-96d4-7f3928406369 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:41:20.897312 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-35e9696a-5f10-4564-96d4-7f3928406369 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 53409afc-6907-43b2-96e7-92536059a476] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:41:20.907753 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-35e9696a-5f10-4564-96d4-7f3928406369 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:20.908777 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-35e9696a-5f10-4564-96d4-7f3928406369 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:20.909726 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-35e9696a-5f10-4564-96d4-7f3928406369 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:20.911556 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-35e9696a-5f10-4564-96d4-7f3928406369 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:20.912287 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-35e9696a-5f10-4564-96d4-7f3928406369 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:20.912911 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-35e9696a-5f10-4564-96d4-7f3928406369 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:21.141956 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8a589171-07dd-40be-b8db-979ae0fd2467 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e367cf6f3b4259902ac1f5f9918391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0a78b98040598bfa5fac4fe95cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:41:21.170508 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8a589171-07dd-40be-b8db-979ae0fd2467 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] 10.222.0.42 "GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b" status: 200 len: 1524 microversion: 2.1 time: 0.422596 Oct 23 01:41:21.171927 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2947/5988] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:41:20 2022] GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b => generated 1524 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:41:21.190730 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-35e9696a-5f10-4564-96d4-7f3928406369 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:41:21.211063 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-35e9696a-5f10-4564-96d4-7f3928406369 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476" status: 200 len: 1392 microversion: 2.1 time: 0.320916 Oct 23 01:41:21.214640 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3042/5989] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:41:20 2022] GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476 => generated 1392 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:41:22.197417 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f21b6910-93ee-4cf5-9905-73716de9524a tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:41:22.199517 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f21b6910-93ee-4cf5-9905-73716de9524a tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] [instance: 79d4067a-0e2c-4089-9572-79a43e5d650b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:41:22.210998 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f21b6910-93ee-4cf5-9905-73716de9524a tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:22.217161 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f21b6910-93ee-4cf5-9905-73716de9524a tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:22.217161 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f21b6910-93ee-4cf5-9905-73716de9524a tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:22.217161 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f21b6910-93ee-4cf5-9905-73716de9524a tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:22.217161 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f21b6910-93ee-4cf5-9905-73716de9524a tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:22.217161 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f21b6910-93ee-4cf5-9905-73716de9524a tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:22.239607 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1b1435a1-58fe-45c6-a02b-203b0b7b8b42 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:41:22.241023 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1b1435a1-58fe-45c6-a02b-203b0b7b8b42 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 53409afc-6907-43b2-96e7-92536059a476] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:41:22.251647 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1b1435a1-58fe-45c6-a02b-203b0b7b8b42 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:22.253178 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1b1435a1-58fe-45c6-a02b-203b0b7b8b42 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:22.255016 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1b1435a1-58fe-45c6-a02b-203b0b7b8b42 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:22.257360 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1b1435a1-58fe-45c6-a02b-203b0b7b8b42 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:22.257360 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1b1435a1-58fe-45c6-a02b-203b0b7b8b42 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:22.258843 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1b1435a1-58fe-45c6-a02b-203b0b7b8b42 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:22.751632 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f21b6910-93ee-4cf5-9905-73716de9524a tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e367cf6f3b4259902ac1f5f9918391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0a78b98040598bfa5fac4fe95cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:41:22.771562 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f21b6910-93ee-4cf5-9905-73716de9524a tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] 10.222.0.42 "GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b" status: 200 len: 1524 microversion: 2.1 time: 0.579429 Oct 23 01:41:22.773105 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2948/5990] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:41:22 2022] GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b => generated 1524 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:41:22.847866 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-319c103c-9f31-43fb-9115-aa247d7096cf req-7e48d484-29e3-4aa4-b099-1248c0cb3157 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53409afc-6907-43b2-96e7-92536059a476", "tag": "0c5af7a9-f38f-4c93-82d4-99a58fe2c63d"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:41:22.869061 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-319c103c-9f31-43fb-9115-aa247d7096cf req-7e48d484-29e3-4aa4-b099-1248c0cb3157 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:22.870610 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-319c103c-9f31-43fb-9115-aa247d7096cf req-7e48d484-29e3-4aa4-b099-1248c0cb3157 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:22.871747 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-319c103c-9f31-43fb-9115-aa247d7096cf req-7e48d484-29e3-4aa4-b099-1248c0cb3157 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:22.922499 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-319c103c-9f31-43fb-9115-aa247d7096cf req-7e48d484-29e3-4aa4-b099-1248c0cb3157 service nova] Creating event network-changed:0c5af7a9-f38f-4c93-82d4-99a58fe2c63d for instance 53409afc-6907-43b2-96e7-92536059a476 on n-h2-master-1 Oct 23 01:41:22.937146 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-319c103c-9f31-43fb-9115-aa247d7096cf req-7e48d484-29e3-4aa4-b099-1248c0cb3157 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094922 Oct 23 01:41:22.940653 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2949/5991] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:41:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:41:22.965150 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1b1435a1-58fe-45c6-a02b-203b0b7b8b42 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:41:22.989268 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1b1435a1-58fe-45c6-a02b-203b0b7b8b42 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476" status: 200 len: 1392 microversion: 2.1 time: 0.753747 Oct 23 01:41:22.993939 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3043/5992] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:41:22 2022] GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476 => generated 1392 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:41:23.798932 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8443837e-13f8-4c80-90d3-848c70cffe99 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:41:23.800265 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8443837e-13f8-4c80-90d3-848c70cffe99 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] [instance: 79d4067a-0e2c-4089-9572-79a43e5d650b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:41:23.811034 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8443837e-13f8-4c80-90d3-848c70cffe99 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:23.811786 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8443837e-13f8-4c80-90d3-848c70cffe99 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:23.812403 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8443837e-13f8-4c80-90d3-848c70cffe99 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:23.813453 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8443837e-13f8-4c80-90d3-848c70cffe99 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:23.814091 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8443837e-13f8-4c80-90d3-848c70cffe99 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:23.814672 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8443837e-13f8-4c80-90d3-848c70cffe99 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:24.014615 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-74ef8ffc-e45b-49c6-95ae-c3157f2c598b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:41:24.016291 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-74ef8ffc-e45b-49c6-95ae-c3157f2c598b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 53409afc-6907-43b2-96e7-92536059a476] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:41:24.026272 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-74ef8ffc-e45b-49c6-95ae-c3157f2c598b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:24.027309 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-74ef8ffc-e45b-49c6-95ae-c3157f2c598b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:24.027934 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-74ef8ffc-e45b-49c6-95ae-c3157f2c598b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:24.028669 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-74ef8ffc-e45b-49c6-95ae-c3157f2c598b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:24.029134 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-74ef8ffc-e45b-49c6-95ae-c3157f2c598b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:24.029745 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-74ef8ffc-e45b-49c6-95ae-c3157f2c598b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:24.197018 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8443837e-13f8-4c80-90d3-848c70cffe99 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e367cf6f3b4259902ac1f5f9918391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0a78b98040598bfa5fac4fe95cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:41:24.210763 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8443837e-13f8-4c80-90d3-848c70cffe99 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] 10.222.0.42 "GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b" status: 200 len: 1524 microversion: 2.1 time: 0.416243 Oct 23 01:41:24.211722 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2950/5993] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:41:23 2022] GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b => generated 1524 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:41:24.302700 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-74ef8ffc-e45b-49c6-95ae-c3157f2c598b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:41:24.315007 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-74ef8ffc-e45b-49c6-95ae-c3157f2c598b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476" status: 200 len: 1392 microversion: 2.1 time: 0.303649 Oct 23 01:41:24.330970 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3044/5994] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:41:24 2022] GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476 => generated 1392 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:41:25.235627 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d0da83fa-9dfd-438d-9db3-806e9df869fb tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:41:25.236393 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d0da83fa-9dfd-438d-9db3-806e9df869fb tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] [instance: 79d4067a-0e2c-4089-9572-79a43e5d650b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:41:25.248503 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0da83fa-9dfd-438d-9db3-806e9df869fb tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:25.249240 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0da83fa-9dfd-438d-9db3-806e9df869fb tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:25.249692 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0da83fa-9dfd-438d-9db3-806e9df869fb tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:25.254677 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0da83fa-9dfd-438d-9db3-806e9df869fb tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:25.255809 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0da83fa-9dfd-438d-9db3-806e9df869fb tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:25.257169 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0da83fa-9dfd-438d-9db3-806e9df869fb tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:25.341964 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9e42f1b6-2d7c-45c4-892e-065a80c83f62 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:41:25.343777 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9e42f1b6-2d7c-45c4-892e-065a80c83f62 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 53409afc-6907-43b2-96e7-92536059a476] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:41:25.364231 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9e42f1b6-2d7c-45c4-892e-065a80c83f62 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:25.366405 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9e42f1b6-2d7c-45c4-892e-065a80c83f62 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:25.368355 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9e42f1b6-2d7c-45c4-892e-065a80c83f62 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:25.370775 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9e42f1b6-2d7c-45c4-892e-065a80c83f62 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:25.371610 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9e42f1b6-2d7c-45c4-892e-065a80c83f62 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:25.373612 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9e42f1b6-2d7c-45c4-892e-065a80c83f62 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:25.629912 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9e42f1b6-2d7c-45c4-892e-065a80c83f62 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:41:25.642986 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9e42f1b6-2d7c-45c4-892e-065a80c83f62 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476" status: 200 len: 1392 microversion: 2.1 time: 0.305659 Oct 23 01:41:25.645586 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3045/5995] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:41:25 2022] GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476 => generated 1392 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:41:25.875980 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:41:25.903696 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=6 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:41:25.979357 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d0da83fa-9dfd-438d-9db3-806e9df869fb tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e367cf6f3b4259902ac1f5f9918391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0a78b98040598bfa5fac4fe95cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:41:25.993845 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d0da83fa-9dfd-438d-9db3-806e9df869fb tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] 10.222.0.42 "GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b" status: 200 len: 1524 microversion: 2.1 time: 0.762164 Oct 23 01:41:26.002212 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2951/5996] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:41:25 2022] GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b => generated 1524 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:41:26.668040 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2e9c4ac9-dbf1-4655-933a-d55390784f03 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:41:26.669137 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2e9c4ac9-dbf1-4655-933a-d55390784f03 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 53409afc-6907-43b2-96e7-92536059a476] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:41:26.676924 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e9c4ac9-dbf1-4655-933a-d55390784f03 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:26.678289 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e9c4ac9-dbf1-4655-933a-d55390784f03 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:26.679092 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e9c4ac9-dbf1-4655-933a-d55390784f03 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:26.680050 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e9c4ac9-dbf1-4655-933a-d55390784f03 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:26.680715 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e9c4ac9-dbf1-4655-933a-d55390784f03 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:26.681364 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e9c4ac9-dbf1-4655-933a-d55390784f03 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:27.026055 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5210ad35-1191-4f13-848d-009ede950c0d tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:41:27.029866 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5210ad35-1191-4f13-848d-009ede950c0d tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] [instance: 79d4067a-0e2c-4089-9572-79a43e5d650b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:41:27.042170 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5210ad35-1191-4f13-848d-009ede950c0d tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:27.042707 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5210ad35-1191-4f13-848d-009ede950c0d tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:27.043102 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5210ad35-1191-4f13-848d-009ede950c0d tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:27.043822 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5210ad35-1191-4f13-848d-009ede950c0d tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:27.045805 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2e9c4ac9-dbf1-4655-933a-d55390784f03 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:41:27.045969 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5210ad35-1191-4f13-848d-009ede950c0d tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:27.047665 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5210ad35-1191-4f13-848d-009ede950c0d tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:27.057412 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2e9c4ac9-dbf1-4655-933a-d55390784f03 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476" status: 200 len: 1392 microversion: 2.1 time: 0.392951 Oct 23 01:41:27.058752 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3046/5997] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:41:26 2022] GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476 => generated 1392 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:41:27.360308 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5210ad35-1191-4f13-848d-009ede950c0d tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e367cf6f3b4259902ac1f5f9918391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0a78b98040598bfa5fac4fe95cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:41:27.369790 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5210ad35-1191-4f13-848d-009ede950c0d tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] 10.222.0.42 "GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b" status: 200 len: 1524 microversion: 2.1 time: 0.348440 Oct 23 01:41:27.383285 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2952/5998] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:41:27 2022] GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b => generated 1524 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:41:28.085036 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7c21f35f-bcde-46d3-95bd-a2eece046cdd tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:41:28.085666 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7c21f35f-bcde-46d3-95bd-a2eece046cdd tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 53409afc-6907-43b2-96e7-92536059a476] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:41:28.100795 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=4 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:41:28.104697 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c21f35f-bcde-46d3-95bd-a2eece046cdd tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:28.105203 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c21f35f-bcde-46d3-95bd-a2eece046cdd tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:28.105681 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c21f35f-bcde-46d3-95bd-a2eece046cdd tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:28.106417 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c21f35f-bcde-46d3-95bd-a2eece046cdd tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:28.112600 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c21f35f-bcde-46d3-95bd-a2eece046cdd tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:28.113612 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c21f35f-bcde-46d3-95bd-a2eece046cdd tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:28.395765 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-157c87f5-ef6d-4bd9-b4e6-9b836305cce3 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:41:28.397187 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-157c87f5-ef6d-4bd9-b4e6-9b836305cce3 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] [instance: 79d4067a-0e2c-4089-9572-79a43e5d650b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:41:28.415869 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7c21f35f-bcde-46d3-95bd-a2eece046cdd tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:41:28.427373 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-157c87f5-ef6d-4bd9-b4e6-9b836305cce3 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:28.427679 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7c21f35f-bcde-46d3-95bd-a2eece046cdd tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476" status: 200 len: 1392 microversion: 2.1 time: 0.346706 Oct 23 01:41:28.428507 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3047/5999] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:41:28 2022] GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476 => generated 1392 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:41:28.442265 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-157c87f5-ef6d-4bd9-b4e6-9b836305cce3 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:28.442265 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-157c87f5-ef6d-4bd9-b4e6-9b836305cce3 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:28.442265 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-157c87f5-ef6d-4bd9-b4e6-9b836305cce3 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:28.442265 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-157c87f5-ef6d-4bd9-b4e6-9b836305cce3 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:28.442265 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-157c87f5-ef6d-4bd9-b4e6-9b836305cce3 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:28.453382 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=100 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:41:28.668533 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-157c87f5-ef6d-4bd9-b4e6-9b836305cce3 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e367cf6f3b4259902ac1f5f9918391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0a78b98040598bfa5fac4fe95cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:41:28.681343 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-157c87f5-ef6d-4bd9-b4e6-9b836305cce3 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] 10.222.0.42 "GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b" status: 200 len: 1504 microversion: 2.1 time: 0.289837 Oct 23 01:41:28.682873 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2953/6000] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:41:28 2022] GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b => generated 1504 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:41:28.714862 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6cb8a9d5-8ef3-4d43-8654-dc835a696624 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Action: 'create', calling method: .version_select at 0x7f5cc0fd6430>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-2127235723", "description": "tempest-description-484252757"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:41:29.182618 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6cb8a9d5-8ef3-4d43-8654-dc835a696624 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.477134 Oct 23 01:41:29.192355 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3048/6001] 10.222.0.42 () {60 vars in 1180 bytes} [Sun Oct 23 01:41:28 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:41:29.198817 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-020f5044-64cf-4aa0-9549-6b3e9985dccb tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-2127235723"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:41:29.199825 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-020f5044-64cf-4aa0-9549-6b3e9985dccb tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] [instance: 79d4067a-0e2c-4089-9572-79a43e5d650b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:41:29.207770 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-020f5044-64cf-4aa0-9549-6b3e9985dccb tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:29.208459 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-020f5044-64cf-4aa0-9549-6b3e9985dccb tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:29.209037 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-020f5044-64cf-4aa0-9549-6b3e9985dccb tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:29.210221 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-020f5044-64cf-4aa0-9549-6b3e9985dccb tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:29.210928 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-020f5044-64cf-4aa0-9549-6b3e9985dccb tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:29.211537 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-020f5044-64cf-4aa0-9549-6b3e9985dccb tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:29.247021 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-85c34a25-57cf-40d5-9033-54e0edf9ff76 req-ee4304c1-dea6-4aee-b92e-95426d3b8d72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53409afc-6907-43b2-96e7-92536059a476", "name": "network-vif-plugged", "status": "completed", "tag": "0c5af7a9-f38f-4c93-82d4-99a58fe2c63d"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:41:29.299143 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-85c34a25-57cf-40d5-9033-54e0edf9ff76 req-ee4304c1-dea6-4aee-b92e-95426d3b8d72 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:29.318067 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-85c34a25-57cf-40d5-9033-54e0edf9ff76 req-ee4304c1-dea6-4aee-b92e-95426d3b8d72 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:29.318980 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-85c34a25-57cf-40d5-9033-54e0edf9ff76 req-ee4304c1-dea6-4aee-b92e-95426d3b8d72 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:29.345055 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-85c34a25-57cf-40d5-9033-54e0edf9ff76 req-ee4304c1-dea6-4aee-b92e-95426d3b8d72 service nova] Creating event network-vif-plugged:0c5af7a9-f38f-4c93-82d4-99a58fe2c63d for instance 53409afc-6907-43b2-96e7-92536059a476 on n-h2-master-1 Oct 23 01:41:29.367695 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-85c34a25-57cf-40d5-9033-54e0edf9ff76 req-ee4304c1-dea6-4aee-b92e-95426d3b8d72 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126985 Oct 23 01:41:29.368533 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3049/6002] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:41:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:41:29.457269 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-506103c4-1e89-4aee-874a-4ea632a8de45 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:41:29.458093 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-506103c4-1e89-4aee-874a-4ea632a8de45 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 53409afc-6907-43b2-96e7-92536059a476] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:41:29.461330 n-d-master-1 devstack@n-api.service[120945]: INFO nova.network.security_group_api [None req-020f5044-64cf-4aa0-9549-6b3e9985dccb tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Adding security group 63754172-e1f2-496d-b427-3fea57b82ec5 to port 0f175258-b6ad-4021-8464-00a06d78ab14 Oct 23 01:41:29.474809 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-506103c4-1e89-4aee-874a-4ea632a8de45 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:29.475315 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-506103c4-1e89-4aee-874a-4ea632a8de45 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:29.476192 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-506103c4-1e89-4aee-874a-4ea632a8de45 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:29.477237 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-506103c4-1e89-4aee-874a-4ea632a8de45 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:29.477951 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-506103c4-1e89-4aee-874a-4ea632a8de45 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:29.478625 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-506103c4-1e89-4aee-874a-4ea632a8de45 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:29.731793 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-506103c4-1e89-4aee-874a-4ea632a8de45 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:41:29.740303 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-506103c4-1e89-4aee-874a-4ea632a8de45 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476" status: 200 len: 1392 microversion: 2.1 time: 0.287619 Oct 23 01:41:29.740889 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3050/6003] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:41:29 2022] GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476 => generated 1392 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:41:30.178692 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-020f5044-64cf-4aa0-9549-6b3e9985dccb tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] 10.222.0.42 "POST /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b/action" status: 202 len: 0 microversion: 2.1 time: 0.985557 Oct 23 01:41:30.183032 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2954/6004] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:41:29 2022] POST /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b/action => generated 0 bytes in 987 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 23 01:41:30.189153 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a1b775e4-796a-489e-bc28-e316d569bbf3 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-2127235723"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:41:30.189815 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a1b775e4-796a-489e-bc28-e316d569bbf3 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] [instance: 79d4067a-0e2c-4089-9572-79a43e5d650b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:41:30.191832 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-d1456224-6bfa-4807-b499-d570c6b395a6 req-4b060c86-4fea-419a-8a60-9ce03a9f924f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79d4067a-0e2c-4089-9572-79a43e5d650b", "tag": "0f175258-b6ad-4021-8464-00a06d78ab14"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:41:30.199700 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a1b775e4-796a-489e-bc28-e316d569bbf3 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:30.242041 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a1b775e4-796a-489e-bc28-e316d569bbf3 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:30.242041 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a1b775e4-796a-489e-bc28-e316d569bbf3 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:30.242041 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a1b775e4-796a-489e-bc28-e316d569bbf3 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:30.242041 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a1b775e4-796a-489e-bc28-e316d569bbf3 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:30.242041 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a1b775e4-796a-489e-bc28-e316d569bbf3 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:30.243111 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-d1456224-6bfa-4807-b499-d570c6b395a6 req-4b060c86-4fea-419a-8a60-9ce03a9f924f service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:30.243111 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-d1456224-6bfa-4807-b499-d570c6b395a6 req-4b060c86-4fea-419a-8a60-9ce03a9f924f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:30.243111 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-d1456224-6bfa-4807-b499-d570c6b395a6 req-4b060c86-4fea-419a-8a60-9ce03a9f924f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:30.249202 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-d1456224-6bfa-4807-b499-d570c6b395a6 req-4b060c86-4fea-419a-8a60-9ce03a9f924f service nova] Creating event network-changed:0f175258-b6ad-4021-8464-00a06d78ab14 for instance 79d4067a-0e2c-4089-9572-79a43e5d650b on n-h1-master-1 Oct 23 01:41:30.257108 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-d1456224-6bfa-4807-b499-d570c6b395a6 req-4b060c86-4fea-419a-8a60-9ce03a9f924f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071236 Oct 23 01:41:30.257560 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3051/6005] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:41:30.406895 n-d-master-1 devstack@n-api.service[120945]: INFO nova.network.security_group_api [None req-a1b775e4-796a-489e-bc28-e316d569bbf3 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Removing security group 63754172-e1f2-496d-b427-3fea57b82ec5 from port 0f175258-b6ad-4021-8464-00a06d78ab14 Oct 23 01:41:30.764843 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b19b94dc-eab4-43e9-8164-f0119b391e1f tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:41:30.765906 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b19b94dc-eab4-43e9-8164-f0119b391e1f tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 53409afc-6907-43b2-96e7-92536059a476] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:41:30.772948 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b19b94dc-eab4-43e9-8164-f0119b391e1f tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:30.773447 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b19b94dc-eab4-43e9-8164-f0119b391e1f tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:30.773884 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b19b94dc-eab4-43e9-8164-f0119b391e1f tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:30.774622 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b19b94dc-eab4-43e9-8164-f0119b391e1f tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:30.775079 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b19b94dc-eab4-43e9-8164-f0119b391e1f tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:30.775539 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b19b94dc-eab4-43e9-8164-f0119b391e1f tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:31.099838 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b19b94dc-eab4-43e9-8164-f0119b391e1f tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:41:31.109397 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b19b94dc-eab4-43e9-8164-f0119b391e1f tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476" status: 200 len: 1392 microversion: 2.1 time: 0.348858 Oct 23 01:41:31.110182 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3052/6006] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:41:30 2022] GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476 => generated 1392 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:41:31.190627 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a1b775e4-796a-489e-bc28-e316d569bbf3 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] 10.222.0.42 "POST /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b/action" status: 202 len: 0 microversion: 2.1 time: 1.005699 Oct 23 01:41:31.195166 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2955/6007] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:41:30 2022] POST /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b/action => generated 0 bytes in 1007 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:41:31.200512 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7ee995a5-283e-493f-af79-6bd24b089906 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Action: 'create', calling method: .version_select at 0x7f5cc2439700>, body: {"pool": null} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:41:32.135249 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-103c32bd-51d8-4be9-b1fb-0cafb87cc061 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:41:32.135833 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-103c32bd-51d8-4be9-b1fb-0cafb87cc061 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 53409afc-6907-43b2-96e7-92536059a476] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:41:32.150947 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-103c32bd-51d8-4be9-b1fb-0cafb87cc061 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:32.151421 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-103c32bd-51d8-4be9-b1fb-0cafb87cc061 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:32.151879 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-103c32bd-51d8-4be9-b1fb-0cafb87cc061 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:32.152631 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-103c32bd-51d8-4be9-b1fb-0cafb87cc061 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:32.154409 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-103c32bd-51d8-4be9-b1fb-0cafb87cc061 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:32.154860 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-103c32bd-51d8-4be9-b1fb-0cafb87cc061 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:32.656734 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-103c32bd-51d8-4be9-b1fb-0cafb87cc061 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:41:32.669069 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-103c32bd-51d8-4be9-b1fb-0cafb87cc061 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476" status: 200 len: 1564 microversion: 2.1 time: 0.539879 Oct 23 01:41:32.671608 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2956/6008] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:41:32 2022] GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476 => generated 1564 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:41:32.676565 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-00dfeb30-d9b3-4cff-90de-dfcb286df8e7 req-a82f5f5d-3768-4d45-b943-ca02ce053692 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79d4067a-0e2c-4089-9572-79a43e5d650b", "tag": "0f175258-b6ad-4021-8464-00a06d78ab14"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:41:32.702511 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-00dfeb30-d9b3-4cff-90de-dfcb286df8e7 req-a82f5f5d-3768-4d45-b943-ca02ce053692 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:32.703305 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-00dfeb30-d9b3-4cff-90de-dfcb286df8e7 req-a82f5f5d-3768-4d45-b943-ca02ce053692 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:32.705647 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-00dfeb30-d9b3-4cff-90de-dfcb286df8e7 req-a82f5f5d-3768-4d45-b943-ca02ce053692 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:32.737820 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-00dfeb30-d9b3-4cff-90de-dfcb286df8e7 req-a82f5f5d-3768-4d45-b943-ca02ce053692 service nova] Creating event network-changed:0f175258-b6ad-4021-8464-00a06d78ab14 for instance 79d4067a-0e2c-4089-9572-79a43e5d650b on n-h1-master-1 Oct 23 01:41:32.753086 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-00dfeb30-d9b3-4cff-90de-dfcb286df8e7 req-a82f5f5d-3768-4d45-b943-ca02ce053692 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077832 Oct 23 01:41:32.754399 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2957/6009] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:41:32.765340 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-34c75cf1-1f75-45ca-99b6-0b855fb78b81 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:41:32.768858 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-34c75cf1-1f75-45ca-99b6-0b855fb78b81 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 53409afc-6907-43b2-96e7-92536059a476] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:41:32.782695 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-34c75cf1-1f75-45ca-99b6-0b855fb78b81 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:32.793516 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-34c75cf1-1f75-45ca-99b6-0b855fb78b81 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:32.794018 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-34c75cf1-1f75-45ca-99b6-0b855fb78b81 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:32.795027 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-34c75cf1-1f75-45ca-99b6-0b855fb78b81 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:32.795496 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-34c75cf1-1f75-45ca-99b6-0b855fb78b81 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:32.795942 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-34c75cf1-1f75-45ca-99b6-0b855fb78b81 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:33.032768 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-34c75cf1-1f75-45ca-99b6-0b855fb78b81 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:41:33.044662 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-34c75cf1-1f75-45ca-99b6-0b855fb78b81 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476" status: 200 len: 1564 microversion: 2.1 time: 0.288509 Oct 23 01:41:33.062344 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2958/6010] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:41:32 2022] GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476 => generated 1564 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:41:34.263066 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7ee995a5-283e-493f-af79-6bd24b089906 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] 10.222.0.42 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.066534 Oct 23 01:41:34.263890 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3053/6011] 10.222.0.42 () {60 vars in 1170 bytes} [Sun Oct 23 01:41:31 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3068 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:41:34.278312 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1f9301f4-de52-4717-ac32-961a0e32ca94 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.6.77"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:41:34.281548 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1f9301f4-de52-4717-ac32-961a0e32ca94 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] [instance: 79d4067a-0e2c-4089-9572-79a43e5d650b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:41:34.296265 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1f9301f4-de52-4717-ac32-961a0e32ca94 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:34.296761 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1f9301f4-de52-4717-ac32-961a0e32ca94 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:34.297199 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1f9301f4-de52-4717-ac32-961a0e32ca94 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:34.300129 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1f9301f4-de52-4717-ac32-961a0e32ca94 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:34.302629 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1f9301f4-de52-4717-ac32-961a0e32ca94 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:34.303076 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1f9301f4-de52-4717-ac32-961a0e32ca94 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:34.344516 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1f9301f4-de52-4717-ac32-961a0e32ca94 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "refresh_cache-79d4067a-0e2c-4089-9572-79a43e5d650b" {{(pid=120945) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 23 01:41:34.345170 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1f9301f4-de52-4717-ac32-961a0e32ca94 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquired lock "refresh_cache-79d4067a-0e2c-4089-9572-79a43e5d650b" {{(pid=120945) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 23 01:41:36.201093 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-1f9301f4-de52-4717-ac32-961a0e32ca94 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] [instance: 79d4067a-0e2c-4089-9572-79a43e5d650b] Building network info cache for instance {{(pid=120945) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 23 01:41:36.237307 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-bcfcf7ac-4446-4456-8e6e-140e88e6dfef req-a801a2e5-ff2c-48e6-ac03-c47dd239816b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79d4067a-0e2c-4089-9572-79a43e5d650b", "tag": "0f175258-b6ad-4021-8464-00a06d78ab14"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:41:36.261596 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=50 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:41:36.268193 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-bcfcf7ac-4446-4456-8e6e-140e88e6dfef req-a801a2e5-ff2c-48e6-ac03-c47dd239816b service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:36.268966 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-bcfcf7ac-4446-4456-8e6e-140e88e6dfef req-a801a2e5-ff2c-48e6-ac03-c47dd239816b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:36.271179 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-bcfcf7ac-4446-4456-8e6e-140e88e6dfef req-a801a2e5-ff2c-48e6-ac03-c47dd239816b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:36.309703 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-bcfcf7ac-4446-4456-8e6e-140e88e6dfef req-a801a2e5-ff2c-48e6-ac03-c47dd239816b service nova] Creating event network-changed:0f175258-b6ad-4021-8464-00a06d78ab14 for instance 79d4067a-0e2c-4089-9572-79a43e5d650b on n-h1-master-1 Oct 23 01:41:36.323788 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-bcfcf7ac-4446-4456-8e6e-140e88e6dfef req-a801a2e5-ff2c-48e6-ac03-c47dd239816b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092137 Oct 23 01:41:36.326902 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3054/6012] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:41:37.178718 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-1f9301f4-de52-4717-ac32-961a0e32ca94 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] [instance: 79d4067a-0e2c-4089-9572-79a43e5d650b] Updating instance_info_cache with network_info: [{"id": "0f175258-b6ad-4021-8464-00a06d78ab14", "address": "fa:16:3e:6b:83:9d", "network": {"id": "8f995532-969c-4716-8140-223d9849f25a", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1979239073-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.6.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c36e0a78b98040598bfa5fac4fe95cf8", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap0f175258-b6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120945) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 23 01:41:37.302057 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1f9301f4-de52-4717-ac32-961a0e32ca94 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Releasing lock "refresh_cache-79d4067a-0e2c-4089-9572-79a43e5d650b" {{(pid=120945) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 23 01:41:37.304716 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1f9301f4-de52-4717-ac32-961a0e32ca94 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] 10.222.0.42 "POST /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b/action" status: 202 len: 0 microversion: 2.1 time: 3.031836 Oct 23 01:41:37.309245 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2959/6013] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:41:34 2022] POST /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b/action => generated 0 bytes in 3037 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 23 01:41:37.318390 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-92dd9bae-a4d5-4ba0-bd24-fb3a0789a69b tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.6.77"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:41:37.614059 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-92dd9bae-a4d5-4ba0-bd24-fb3a0789a69b tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] [instance: 79d4067a-0e2c-4089-9572-79a43e5d650b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:41:37.624071 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92dd9bae-a4d5-4ba0-bd24-fb3a0789a69b tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:37.625323 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92dd9bae-a4d5-4ba0-bd24-fb3a0789a69b tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:37.626123 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92dd9bae-a4d5-4ba0-bd24-fb3a0789a69b tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:37.627769 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92dd9bae-a4d5-4ba0-bd24-fb3a0789a69b tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:37.628787 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92dd9bae-a4d5-4ba0-bd24-fb3a0789a69b tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:37.629680 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92dd9bae-a4d5-4ba0-bd24-fb3a0789a69b tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:37.948663 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92dd9bae-a4d5-4ba0-bd24-fb3a0789a69b tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "refresh_cache-79d4067a-0e2c-4089-9572-79a43e5d650b" {{(pid=120944) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 23 01:41:37.948663 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92dd9bae-a4d5-4ba0-bd24-fb3a0789a69b tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquired lock "refresh_cache-79d4067a-0e2c-4089-9572-79a43e5d650b" {{(pid=120944) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 23 01:41:39.437479 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2c5506b7-857c-4432-b131-0e48a8a3677c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:41:39.437479 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2c5506b7-857c-4432-b131-0e48a8a3677c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 53409afc-6907-43b2-96e7-92536059a476] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:41:39.456074 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:41:39.457818 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2c5506b7-857c-4432-b131-0e48a8a3677c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:39.458443 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2c5506b7-857c-4432-b131-0e48a8a3677c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:39.459054 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2c5506b7-857c-4432-b131-0e48a8a3677c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:39.460161 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2c5506b7-857c-4432-b131-0e48a8a3677c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:39.460807 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2c5506b7-857c-4432-b131-0e48a8a3677c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:39.461469 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2c5506b7-857c-4432-b131-0e48a8a3677c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:39.748483 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2c5506b7-857c-4432-b131-0e48a8a3677c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:41:39.761124 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2c5506b7-857c-4432-b131-0e48a8a3677c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476" status: 200 len: 1564 microversion: 2.1 time: 0.330130 Oct 23 01:41:39.774001 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2960/6014] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:41:39 2022] GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476 => generated 1564 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:41:39.774001 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-52942f8f-c954-4de1-b3c5-c9952a99ffc0 req-550c1c5b-231b-47f8-964c-6b4e72ade511 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53409afc-6907-43b2-96e7-92536059a476", "tag": "0c5af7a9-f38f-4c93-82d4-99a58fe2c63d"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:41:39.789519 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-52942f8f-c954-4de1-b3c5-c9952a99ffc0 req-550c1c5b-231b-47f8-964c-6b4e72ade511 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:39.793734 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-52942f8f-c954-4de1-b3c5-c9952a99ffc0 req-550c1c5b-231b-47f8-964c-6b4e72ade511 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:39.800796 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-52942f8f-c954-4de1-b3c5-c9952a99ffc0 req-550c1c5b-231b-47f8-964c-6b4e72ade511 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:39.826545 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-52942f8f-c954-4de1-b3c5-c9952a99ffc0 req-550c1c5b-231b-47f8-964c-6b4e72ade511 service nova] Creating event network-changed:0c5af7a9-f38f-4c93-82d4-99a58fe2c63d for instance 53409afc-6907-43b2-96e7-92536059a476 on n-h2-master-1 Oct 23 01:41:39.835232 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-52942f8f-c954-4de1-b3c5-c9952a99ffc0 req-550c1c5b-231b-47f8-964c-6b4e72ade511 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069036 Oct 23 01:41:39.835453 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2961/6015] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:41:39.959315 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-92dd9bae-a4d5-4ba0-bd24-fb3a0789a69b tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] [instance: 79d4067a-0e2c-4089-9572-79a43e5d650b] Building network info cache for instance {{(pid=120944) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 23 01:41:40.004897 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-dc0ffa74-90b5-4957-ac0a-ad146d9d20ee req-a5663650-a591-4bdc-acdb-9bada726003e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79d4067a-0e2c-4089-9572-79a43e5d650b", "tag": "0f175258-b6ad-4021-8464-00a06d78ab14"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:41:40.046824 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-dc0ffa74-90b5-4957-ac0a-ad146d9d20ee req-a5663650-a591-4bdc-acdb-9bada726003e service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:40.047324 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-dc0ffa74-90b5-4957-ac0a-ad146d9d20ee req-a5663650-a591-4bdc-acdb-9bada726003e service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:40.047755 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-dc0ffa74-90b5-4957-ac0a-ad146d9d20ee req-a5663650-a591-4bdc-acdb-9bada726003e service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:40.078717 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-dc0ffa74-90b5-4957-ac0a-ad146d9d20ee req-a5663650-a591-4bdc-acdb-9bada726003e service nova] Creating event network-changed:0f175258-b6ad-4021-8464-00a06d78ab14 for instance 79d4067a-0e2c-4089-9572-79a43e5d650b on n-h1-master-1 Oct 23 01:41:40.088428 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-dc0ffa74-90b5-4957-ac0a-ad146d9d20ee req-a5663650-a591-4bdc-acdb-9bada726003e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090921 Oct 23 01:41:40.089647 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2962/6016] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:41:40.885166 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-92dd9bae-a4d5-4ba0-bd24-fb3a0789a69b tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] [instance: 79d4067a-0e2c-4089-9572-79a43e5d650b] Updating instance_info_cache with network_info: [{"id": "0f175258-b6ad-4021-8464-00a06d78ab14", "address": "fa:16:3e:6b:83:9d", "network": {"id": "8f995532-969c-4716-8140-223d9849f25a", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1979239073-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c36e0a78b98040598bfa5fac4fe95cf8", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap0f175258-b6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120944) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 23 01:41:41.032774 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92dd9bae-a4d5-4ba0-bd24-fb3a0789a69b tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Releasing lock "refresh_cache-79d4067a-0e2c-4089-9572-79a43e5d650b" {{(pid=120944) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 23 01:41:41.034522 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-92dd9bae-a4d5-4ba0-bd24-fb3a0789a69b tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] 10.222.0.42 "POST /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b/action" status: 202 len: 0 microversion: 2.1 time: 3.720584 Oct 23 01:41:41.035706 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3055/6017] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:41:37 2022] POST /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b/action => generated 0 bytes in 3722 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 23 01:41:41.047209 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f7717e08-b5cb-475d-be44-dbdcff779236 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Calling method '.version_select at 0x7f5cc0cfe430>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:41:42.396594 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f7717e08-b5cb-475d-be44-dbdcff779236 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] 10.222.0.42 "DELETE /compute/v2.1/os-floating-ips/871c32d7-b3f5-4d1f-925e-1afb5e108556" status: 202 len: 0 microversion: 2.1 time: 1.356213 Oct 23 01:41:42.398022 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2963/6018] 10.222.0.42 () {58 vars in 1263 bytes} [Sun Oct 23 01:41:41 2022] DELETE /compute/v2.1/os-floating-ips/871c32d7-b3f5-4d1f-925e-1afb5e108556 => generated 0 bytes in 1359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:41:42.409556 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e4edcc43-6dd9-433e-bb13-fe067fa65bb5 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Calling method '.version_select at 0x7f5cc24399d0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:41:42.817177 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e4edcc43-6dd9-433e-bb13-fe067fa65bb5 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/63754172-e1f2-496d-b427-3fea57b82ec5" status: 202 len: 0 microversion: 2.1 time: 0.412634 Oct 23 01:41:42.818534 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3056/6019] 10.222.0.42 () {58 vars in 1272 bytes} [Sun Oct 23 01:41:42 2022] DELETE /compute/v2.1/os-security-groups/63754172-e1f2-496d-b427-3fea57b82ec5 => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:41:42.829252 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-78faf831-53e4-4f57-b980-50b9117bb4b2 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:41:42.830322 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-78faf831-53e4-4f57-b980-50b9117bb4b2 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] [instance: 79d4067a-0e2c-4089-9572-79a43e5d650b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:41:42.847181 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78faf831-53e4-4f57-b980-50b9117bb4b2 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:42.850904 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78faf831-53e4-4f57-b980-50b9117bb4b2 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:42.851675 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78faf831-53e4-4f57-b980-50b9117bb4b2 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:42.853253 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78faf831-53e4-4f57-b980-50b9117bb4b2 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:42.854045 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78faf831-53e4-4f57-b980-50b9117bb4b2 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:42.856035 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78faf831-53e4-4f57-b980-50b9117bb4b2 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:42.889467 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-78faf831-53e4-4f57-b980-50b9117bb4b2 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] [instance: 79d4067a-0e2c-4089-9572-79a43e5d650b] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:41:43.307579 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-78faf831-53e4-4f57-b980-50b9117bb4b2 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] 10.222.0.42 "DELETE /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b" status: 204 len: 0 microversion: 2.1 time: 0.483337 Oct 23 01:41:43.308184 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2964/6020] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:41:42 2022] DELETE /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b => generated 0 bytes in 486 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:41:43.316787 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3d6fc3f5-4ab7-471d-b5ca-bf3762432404 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:41:43.317530 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3d6fc3f5-4ab7-471d-b5ca-bf3762432404 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] [instance: 79d4067a-0e2c-4089-9572-79a43e5d650b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:41:43.326545 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d6fc3f5-4ab7-471d-b5ca-bf3762432404 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:43.326974 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d6fc3f5-4ab7-471d-b5ca-bf3762432404 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:43.327418 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d6fc3f5-4ab7-471d-b5ca-bf3762432404 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:43.328125 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d6fc3f5-4ab7-471d-b5ca-bf3762432404 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:43.328637 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d6fc3f5-4ab7-471d-b5ca-bf3762432404 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:43.329047 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d6fc3f5-4ab7-471d-b5ca-bf3762432404 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:43.577644 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3d6fc3f5-4ab7-471d-b5ca-bf3762432404 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e367cf6f3b4259902ac1f5f9918391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0a78b98040598bfa5fac4fe95cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:41:43.586660 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3d6fc3f5-4ab7-471d-b5ca-bf3762432404 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] 10.222.0.42 "GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b" status: 200 len: 1510 microversion: 2.1 time: 0.273901 Oct 23 01:41:43.587926 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3057/6021] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:41:43 2022] GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b => generated 1510 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:41:44.613167 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5de1fdeb-8ac2-4063-8154-dc95d4a2fe6d tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:41:44.614240 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5de1fdeb-8ac2-4063-8154-dc95d4a2fe6d tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] [instance: 79d4067a-0e2c-4089-9572-79a43e5d650b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:41:44.625334 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5de1fdeb-8ac2-4063-8154-dc95d4a2fe6d tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:44.625909 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5de1fdeb-8ac2-4063-8154-dc95d4a2fe6d tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:44.626379 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5de1fdeb-8ac2-4063-8154-dc95d4a2fe6d tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:44.627093 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5de1fdeb-8ac2-4063-8154-dc95d4a2fe6d tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:44.627589 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5de1fdeb-8ac2-4063-8154-dc95d4a2fe6d tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:44.631165 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5de1fdeb-8ac2-4063-8154-dc95d4a2fe6d tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:44.796623 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5de1fdeb-8ac2-4063-8154-dc95d4a2fe6d tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e367cf6f3b4259902ac1f5f9918391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0a78b98040598bfa5fac4fe95cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:41:44.802623 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5de1fdeb-8ac2-4063-8154-dc95d4a2fe6d tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] 10.222.0.42 "GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b" status: 200 len: 1510 microversion: 2.1 time: 0.192220 Oct 23 01:41:44.822621 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2965/6022] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:41:44 2022] GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b => generated 1510 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:41:45.831041 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-010d1066-5907-45f4-be37-08c584b959a4 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:41:45.831653 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-010d1066-5907-45f4-be37-08c584b959a4 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] [instance: 79d4067a-0e2c-4089-9572-79a43e5d650b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:41:45.839641 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-010d1066-5907-45f4-be37-08c584b959a4 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:45.840132 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-010d1066-5907-45f4-be37-08c584b959a4 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:45.840570 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-010d1066-5907-45f4-be37-08c584b959a4 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:45.841260 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-010d1066-5907-45f4-be37-08c584b959a4 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:45.842126 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-010d1066-5907-45f4-be37-08c584b959a4 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:45.842501 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-010d1066-5907-45f4-be37-08c584b959a4 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:45.990351 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-010d1066-5907-45f4-be37-08c584b959a4 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e367cf6f3b4259902ac1f5f9918391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0a78b98040598bfa5fac4fe95cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:41:45.998763 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-010d1066-5907-45f4-be37-08c584b959a4 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] 10.222.0.42 "GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b" status: 200 len: 1510 microversion: 2.1 time: 0.171599 Oct 23 01:41:45.999358 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3058/6023] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:41:45 2022] GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b => generated 1510 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:41:46.939188 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-5387ac46-679b-4ec8-ac86-3694563fbc7c req-ade270da-5b49-41e2-a1ac-885bc4d6c785 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79d4067a-0e2c-4089-9572-79a43e5d650b", "name": "network-vif-deleted", "tag": "0f175258-b6ad-4021-8464-00a06d78ab14"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:41:46.950818 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-5387ac46-679b-4ec8-ac86-3694563fbc7c req-ade270da-5b49-41e2-a1ac-885bc4d6c785 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:46.951526 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-5387ac46-679b-4ec8-ac86-3694563fbc7c req-ade270da-5b49-41e2-a1ac-885bc4d6c785 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:47.001237 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-5387ac46-679b-4ec8-ac86-3694563fbc7c req-ade270da-5b49-41e2-a1ac-885bc4d6c785 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:47.001237 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-5387ac46-679b-4ec8-ac86-3694563fbc7c req-ade270da-5b49-41e2-a1ac-885bc4d6c785 service nova] Creating event network-vif-deleted:0f175258-b6ad-4021-8464-00a06d78ab14 for instance 79d4067a-0e2c-4089-9572-79a43e5d650b on n-h1-master-1 Oct 23 01:41:47.001237 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-5387ac46-679b-4ec8-ac86-3694563fbc7c req-ade270da-5b49-41e2-a1ac-885bc4d6c785 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036955 Oct 23 01:41:47.001237 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2966/6024] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:41:47.025445 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bfeafd75-e054-438c-8f0e-ceb7fdbfc4cf tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:41:47.031539 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bfeafd75-e054-438c-8f0e-ceb7fdbfc4cf tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] [instance: 79d4067a-0e2c-4089-9572-79a43e5d650b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:41:47.033041 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bfeafd75-e054-438c-8f0e-ceb7fdbfc4cf tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:47.033543 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bfeafd75-e054-438c-8f0e-ceb7fdbfc4cf tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:47.034040 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bfeafd75-e054-438c-8f0e-ceb7fdbfc4cf tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:47.034754 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bfeafd75-e054-438c-8f0e-ceb7fdbfc4cf tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:47.035218 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bfeafd75-e054-438c-8f0e-ceb7fdbfc4cf tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:47.035647 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bfeafd75-e054-438c-8f0e-ceb7fdbfc4cf tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:47.101172 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bfeafd75-e054-438c-8f0e-ceb7fdbfc4cf tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e367cf6f3b4259902ac1f5f9918391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0a78b98040598bfa5fac4fe95cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:41:47.109109 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bfeafd75-e054-438c-8f0e-ceb7fdbfc4cf tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] 10.222.0.42 "GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b" status: 200 len: 1468 microversion: 2.1 time: 0.088308 Oct 23 01:41:47.109683 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3059/6025] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:41:47 2022] GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b => generated 1468 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:41:48.135524 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-764c091e-ca88-407b-adb2-d91121b4c791 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:41:48.136237 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-764c091e-ca88-407b-adb2-d91121b4c791 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] [instance: 79d4067a-0e2c-4089-9572-79a43e5d650b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:41:48.142781 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-764c091e-ca88-407b-adb2-d91121b4c791 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:48.143328 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-764c091e-ca88-407b-adb2-d91121b4c791 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:48.143751 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-764c091e-ca88-407b-adb2-d91121b4c791 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:48.148825 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-764c091e-ca88-407b-adb2-d91121b4c791 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:48.148825 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-764c091e-ca88-407b-adb2-d91121b4c791 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:48.148825 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-764c091e-ca88-407b-adb2-d91121b4c791 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:48.178625 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-764c091e-ca88-407b-adb2-d91121b4c791 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:48.179160 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-764c091e-ca88-407b-adb2-d91121b4c791 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:48.179602 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-764c091e-ca88-407b-adb2-d91121b4c791 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:48.180063 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-764c091e-ca88-407b-adb2-d91121b4c791 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lazy-loading 'fault' on Instance uuid 79d4067a-0e2c-4089-9572-79a43e5d650b {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:41:48.225261 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-764c091e-ca88-407b-adb2-d91121b4c791 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e367cf6f3b4259902ac1f5f9918391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36e0a78b98040598bfa5fac4fe95cf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:41:48.233945 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-764c091e-ca88-407b-adb2-d91121b4c791 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] 10.222.0.42 "GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b" status: 200 len: 1313 microversion: 2.1 time: 0.104964 Oct 23 01:41:48.234827 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2967/6026] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:41:48 2022] GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b => generated 1313 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:41:49.259154 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f4b5b15d-9caf-4291-9df3-e173ebd7a6a7 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:41:49.259899 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f4b5b15d-9caf-4291-9df3-e173ebd7a6a7 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] [instance: 79d4067a-0e2c-4089-9572-79a43e5d650b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:41:49.267703 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4b5b15d-9caf-4291-9df3-e173ebd7a6a7 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:49.268195 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4b5b15d-9caf-4291-9df3-e173ebd7a6a7 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:49.268640 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4b5b15d-9caf-4291-9df3-e173ebd7a6a7 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:49.269343 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4b5b15d-9caf-4291-9df3-e173ebd7a6a7 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:49.269823 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4b5b15d-9caf-4291-9df3-e173ebd7a6a7 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:49.270282 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4b5b15d-9caf-4291-9df3-e173ebd7a6a7 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:49.286285 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-f4b5b15d-9caf-4291-9df3-e173ebd7a6a7 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] HTTP exception thrown: Instance 79d4067a-0e2c-4089-9572-79a43e5d650b could not be found. Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f4b5b15d-9caf-4291-9df3-e173ebd7a6a7 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Request method failure captured: Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b HTTP/1.1 Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJuXbIVZRQ2A_sZHeInnT7Ktn9QH8HJ3Tn_cMcW-3fiH13riGCfPw_UTUeYJQNsf2mDureFzQv_rrh5f4uW-kjJfyL8uKtFNplfufWx03zXiutZ0b-_ffc_8dvPtl1_jpYTRwa5FMUomOnS-FILONyROO0Sw4Og-PyxjPlU33jBWaqo Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: c36e0a78b98040598bfa5fac4fe95cf8 Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1656913232 Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c36e0a78b98040598bfa5fac4fe95cf8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c36e0a78b98040598bfa5fac4fe95cf8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c36e0a78b98040598bfa5fac4fe95cf8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c36e0a78b98040598bfa5fac4fe95cf8"}]}] Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1656913232 Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: c36e0a78b98040598bfa5fac4fe95cf8 Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1656913232 Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServerRescueTestJSONUnderV235-1656913232-project Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 85e367cf6f3b4259902ac1f5f9918391 Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1656913232-project Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 79d4067a-0e2c-4089-9572-79a43e5d650b could not be found. Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '79d4067a-0e2c-4089-9572-79a43e5d650b'} Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79d4067a-0e2c-4089-9572-79a43e5d650b could not be found. Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79d4067a-0e2c-4089-9572-79a43e5d650b could not be found. Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:41:49.288697 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:41:49.292960 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:41:49.292960 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:41:49.292960 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:41:49.292960 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:41:49.292960 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:41:49.292960 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:41:49.292960 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79d4067a-0e2c-4089-9572-79a43e5d650b could not be found. Oct 23 01:41:49.292960 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:41:49.292960 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f4b5b15d-9caf-4291-9df3-e173ebd7a6a7 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] Returning 404 to user: Instance 79d4067a-0e2c-4089-9572-79a43e5d650b could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:41:49.292960 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f4b5b15d-9caf-4291-9df3-e173ebd7a6a7 tempest-ServerRescueTestJSONUnderV235-1656913232 tempest-ServerRescueTestJSONUnderV235-1656913232-project] 10.222.0.42 "GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b" status: 404 len: 111 microversion: 2.1 time: 0.035076 Oct 23 01:41:49.292960 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3060/6027] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:41:49 2022] GET /compute/v2.1/servers/79d4067a-0e2c-4089-9572-79a43e5d650b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:41:58.578457 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1ffe6e4f-5906-4b9c-9456-6f5ba6584c2d tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:41:58.582175 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1ffe6e4f-5906-4b9c-9456-6f5ba6584c2d tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 53409afc-6907-43b2-96e7-92536059a476] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:41:58.591632 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:41:58.592531 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=75,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:41:58.598871 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1ffe6e4f-5906-4b9c-9456-6f5ba6584c2d tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:58.599915 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1ffe6e4f-5906-4b9c-9456-6f5ba6584c2d tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:58.600541 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1ffe6e4f-5906-4b9c-9456-6f5ba6584c2d tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:58.601452 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1ffe6e4f-5906-4b9c-9456-6f5ba6584c2d tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:41:58.602682 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1ffe6e4f-5906-4b9c-9456-6f5ba6584c2d tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:41:58.603312 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1ffe6e4f-5906-4b9c-9456-6f5ba6584c2d tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:41:58.695407 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1ffe6e4f-5906-4b9c-9456-6f5ba6584c2d tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "POST /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476/action" status: 200 len: 24556 microversion: 2.1 time: 0.121135 Oct 23 01:41:58.696986 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2968/6028] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:41:58 2022] POST /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476/action => generated 24556 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:42:09.625174 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-abbbba5d-0169-47f2-a6b3-56da477c63e6 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:42:09.634997 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-abbbba5d-0169-47f2-a6b3-56da477c63e6 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] [instance: 53409afc-6907-43b2-96e7-92536059a476] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:09.652723 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=11 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:09.658613 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:09.700248 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-abbbba5d-0169-47f2-a6b3-56da477c63e6 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:09.700787 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-abbbba5d-0169-47f2-a6b3-56da477c63e6 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:09.707725 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-abbbba5d-0169-47f2-a6b3-56da477c63e6 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:09.708527 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-abbbba5d-0169-47f2-a6b3-56da477c63e6 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:09.709014 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-abbbba5d-0169-47f2-a6b3-56da477c63e6 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:09.709958 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-abbbba5d-0169-47f2-a6b3-56da477c63e6 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:10.594711 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-abbbba5d-0169-47f2-a6b3-56da477c63e6 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476" status: 200 len: 1833 microversion: 2.1 time: 0.978858 Oct 23 01:42:10.598305 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3061/6029] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:42:09 2022] GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476 => generated 1833 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:42:10.626480 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4d294ef6-fe5b-4f60-835e-f612b71a987f tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:42:10.627314 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4d294ef6-fe5b-4f60-835e-f612b71a987f tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 53409afc-6907-43b2-96e7-92536059a476] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:10.642238 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4d294ef6-fe5b-4f60-835e-f612b71a987f tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:10.646110 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4d294ef6-fe5b-4f60-835e-f612b71a987f tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:10.647285 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4d294ef6-fe5b-4f60-835e-f612b71a987f tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:10.653181 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4d294ef6-fe5b-4f60-835e-f612b71a987f tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:10.653881 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4d294ef6-fe5b-4f60-835e-f612b71a987f tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:10.656341 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4d294ef6-fe5b-4f60-835e-f612b71a987f tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:11.173675 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4d294ef6-fe5b-4f60-835e-f612b71a987f tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:42:11.184456 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4d294ef6-fe5b-4f60-835e-f612b71a987f tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476" status: 200 len: 1682 microversion: 2.1 time: 0.563044 Oct 23 01:42:11.185008 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2969/6030] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:42:10 2022] GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476 => generated 1682 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:42:11.368073 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5f3b9751-5e87-4a28-b08e-98f92563d887 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:42:11.370563 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5f3b9751-5e87-4a28-b08e-98f92563d887 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 53409afc-6907-43b2-96e7-92536059a476] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:11.391773 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f3b9751-5e87-4a28-b08e-98f92563d887 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:11.392296 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f3b9751-5e87-4a28-b08e-98f92563d887 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:11.392747 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f3b9751-5e87-4a28-b08e-98f92563d887 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:11.393473 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f3b9751-5e87-4a28-b08e-98f92563d887 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:11.394126 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f3b9751-5e87-4a28-b08e-98f92563d887 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:11.394575 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f3b9751-5e87-4a28-b08e-98f92563d887 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:11.504135 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5f3b9751-5e87-4a28-b08e-98f92563d887 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "POST /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476/action" status: 200 len: 32631 microversion: 2.1 time: 0.141145 Oct 23 01:42:11.505273 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3062/6031] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:42:11 2022] POST /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476/action => generated 32631 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:42:11.681152 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-516b096a-0c07-4ff6-90b4-b4b4f826c1d5 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:42:11.684916 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-516b096a-0c07-4ff6-90b4-b4b4f826c1d5 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] [instance: 53409afc-6907-43b2-96e7-92536059a476] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:11.698167 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-516b096a-0c07-4ff6-90b4-b4b4f826c1d5 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:11.698692 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-516b096a-0c07-4ff6-90b4-b4b4f826c1d5 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:11.699115 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-516b096a-0c07-4ff6-90b4-b4b4f826c1d5 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:11.699836 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-516b096a-0c07-4ff6-90b4-b4b4f826c1d5 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:11.700319 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-516b096a-0c07-4ff6-90b4-b4b4f826c1d5 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:11.700749 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-516b096a-0c07-4ff6-90b4-b4b4f826c1d5 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:11.860718 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-516b096a-0c07-4ff6-90b4-b4b4f826c1d5 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'd72ce81cad3c4014b4071ed5660e0ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a93c06024b4898ba981e02f9874d43', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:42:11.861409 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-516b096a-0c07-4ff6-90b4-b4b4f826c1d5 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] [instance: 53409afc-6907-43b2-96e7-92536059a476] flavor_id is None. Assuming migration. {{(pid=120945) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 23 01:42:11.861845 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-516b096a-0c07-4ff6-90b4-b4b4f826c1d5 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] [instance: 53409afc-6907-43b2-96e7-92536059a476] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120945) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 23 01:42:12.604998 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-516b096a-0c07-4ff6-90b4-b4b4f826c1d5 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476/action" status: 202 len: 0 microversion: 2.1 time: 0.928811 Oct 23 01:42:12.607717 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2970/6032] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:42:11 2022] POST /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476/action => generated 0 bytes in 931 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:42:12.614646 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4cdbdc77-e720-4f1d-a371-fa3b6f458310 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:42:12.615364 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4cdbdc77-e720-4f1d-a371-fa3b6f458310 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 53409afc-6907-43b2-96e7-92536059a476] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:12.646018 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4cdbdc77-e720-4f1d-a371-fa3b6f458310 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:12.646552 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4cdbdc77-e720-4f1d-a371-fa3b6f458310 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:12.647657 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4cdbdc77-e720-4f1d-a371-fa3b6f458310 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:12.648816 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4cdbdc77-e720-4f1d-a371-fa3b6f458310 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:12.655666 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4cdbdc77-e720-4f1d-a371-fa3b6f458310 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:12.656673 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4cdbdc77-e720-4f1d-a371-fa3b6f458310 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:12.964017 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4cdbdc77-e720-4f1d-a371-fa3b6f458310 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:42:12.979818 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4cdbdc77-e720-4f1d-a371-fa3b6f458310 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476" status: 200 len: 1691 microversion: 2.1 time: 0.369885 Oct 23 01:42:12.983818 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3063/6033] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:42:12 2022] GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476 => generated 1691 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:42:14.009403 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b343be10-d16f-4641-a298-26bddf9cd8d5 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:42:14.013000 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b343be10-d16f-4641-a298-26bddf9cd8d5 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 53409afc-6907-43b2-96e7-92536059a476] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:14.020492 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b343be10-d16f-4641-a298-26bddf9cd8d5 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:14.020995 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b343be10-d16f-4641-a298-26bddf9cd8d5 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:14.021646 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b343be10-d16f-4641-a298-26bddf9cd8d5 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:14.022390 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b343be10-d16f-4641-a298-26bddf9cd8d5 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:14.023544 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b343be10-d16f-4641-a298-26bddf9cd8d5 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:14.023977 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b343be10-d16f-4641-a298-26bddf9cd8d5 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:14.341584 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b343be10-d16f-4641-a298-26bddf9cd8d5 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:42:14.349676 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b343be10-d16f-4641-a298-26bddf9cd8d5 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476" status: 200 len: 1691 microversion: 2.1 time: 0.346918 Oct 23 01:42:14.350549 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2971/6034] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:42:14 2022] GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476 => generated 1691 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:42:15.009618 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-04dc0628-8eef-4e69-8338-96f36754fc12 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-67970987", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "fcdd684d-361a-43e2-bdd8-c04b8ef6b743"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:42:15.115878 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-04dc0628-8eef-4e69-8338-96f36754fc12 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] validate_networks() for [('fcdd684d-361a-43e2-bdd8-c04b8ef6b743', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:42:15.375314 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b3775fff-8413-4bfb-a34d-19b9a169ae8b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:42:15.375943 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b3775fff-8413-4bfb-a34d-19b9a169ae8b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 53409afc-6907-43b2-96e7-92536059a476] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:15.388523 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b3775fff-8413-4bfb-a34d-19b9a169ae8b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:15.389176 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b3775fff-8413-4bfb-a34d-19b9a169ae8b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:15.389806 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b3775fff-8413-4bfb-a34d-19b9a169ae8b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:15.393898 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b3775fff-8413-4bfb-a34d-19b9a169ae8b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:15.394563 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b3775fff-8413-4bfb-a34d-19b9a169ae8b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:15.412408 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b3775fff-8413-4bfb-a34d-19b9a169ae8b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:15.749849 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b3775fff-8413-4bfb-a34d-19b9a169ae8b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:42:15.760086 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b3775fff-8413-4bfb-a34d-19b9a169ae8b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476" status: 200 len: 1691 microversion: 2.1 time: 0.388618 Oct 23 01:42:15.766057 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2972/6035] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:42:15 2022] GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476 => generated 1691 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:42:15.921134 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-04dc0628-8eef-4e69-8338-96f36754fc12 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:42:15.921557 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-04dc0628-8eef-4e69-8338-96f36754fc12 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:42:15.922062 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-04dc0628-8eef-4e69-8338-96f36754fc12 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:42:15.922716 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-04dc0628-8eef-4e69-8338-96f36754fc12 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:42:15.923290 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-04dc0628-8eef-4e69-8338-96f36754fc12 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:42:15.934848 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-04dc0628-8eef-4e69-8338-96f36754fc12 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:15.940346 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-04dc0628-8eef-4e69-8338-96f36754fc12 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:15.940346 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-04dc0628-8eef-4e69-8338-96f36754fc12 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:15.940346 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-04dc0628-8eef-4e69-8338-96f36754fc12 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:15.940346 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-04dc0628-8eef-4e69-8338-96f36754fc12 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:15.940346 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-04dc0628-8eef-4e69-8338-96f36754fc12 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:15.960401 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-04dc0628-8eef-4e69-8338-96f36754fc12 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Getting quotas for project 4459f3c837db4fcaafc0e4aaed1600e0. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:42:15.968922 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-04dc0628-8eef-4e69-8338-96f36754fc12 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Getting quotas for user b094df884baf43a0824d210dfe6e8d26 and project 4459f3c837db4fcaafc0e4aaed1600e0. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:42:15.981581 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-04dc0628-8eef-4e69-8338-96f36754fc12 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:42:15.984631 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-04dc0628-8eef-4e69-8338-96f36754fc12 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] [instance: b7114201-4fdf-4ef8-9269-68e47288e353] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:42:16.434338 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-04dc0628-8eef-4e69-8338-96f36754fc12 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.730291 Oct 23 01:42:16.446835 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ad8c0b58-cc15-48dd-9526-b3422bbda5a0 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:42:16.447564 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ad8c0b58-cc15-48dd-9526-b3422bbda5a0 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] [instance: b7114201-4fdf-4ef8-9269-68e47288e353] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:16.458188 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3064/6036] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:42:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 23 01:42:16.582964 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ad8c0b58-cc15-48dd-9526-b3422bbda5a0 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b094df884baf43a0824d210dfe6e8d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459f3c837db4fcaafc0e4aaed1600e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:42:16.590812 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ad8c0b58-cc15-48dd-9526-b3422bbda5a0 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] 10.222.0.42 "GET /compute/v2.1/servers/b7114201-4fdf-4ef8-9269-68e47288e353" status: 200 len: 1226 microversion: 2.1 time: 0.147868 Oct 23 01:42:16.608473 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2973/6037] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:42:16 2022] GET /compute/v2.1/servers/b7114201-4fdf-4ef8-9269-68e47288e353 => generated 1226 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:42:16.794713 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-71f29aae-9860-4a19-b122-f401aba1a269 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:42:16.795037 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-71f29aae-9860-4a19-b122-f401aba1a269 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 53409afc-6907-43b2-96e7-92536059a476] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:16.807964 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-71f29aae-9860-4a19-b122-f401aba1a269 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:16.808465 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-71f29aae-9860-4a19-b122-f401aba1a269 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:16.808907 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-71f29aae-9860-4a19-b122-f401aba1a269 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:16.809618 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-71f29aae-9860-4a19-b122-f401aba1a269 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:16.810109 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-71f29aae-9860-4a19-b122-f401aba1a269 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:16.810545 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-71f29aae-9860-4a19-b122-f401aba1a269 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:17.077315 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-71f29aae-9860-4a19-b122-f401aba1a269 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:42:17.086576 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-71f29aae-9860-4a19-b122-f401aba1a269 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476" status: 200 len: 1691 microversion: 2.1 time: 0.296968 Oct 23 01:42:17.087177 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3065/6038] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:42:16 2022] GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476 => generated 1691 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:42:17.621121 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-269e3054-5172-4bd5-81be-2d1624c725e2 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:42:17.621845 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-269e3054-5172-4bd5-81be-2d1624c725e2 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] [instance: b7114201-4fdf-4ef8-9269-68e47288e353] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:17.719014 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-269e3054-5172-4bd5-81be-2d1624c725e2 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b094df884baf43a0824d210dfe6e8d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459f3c837db4fcaafc0e4aaed1600e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:42:17.726088 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-269e3054-5172-4bd5-81be-2d1624c725e2 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] 10.222.0.42 "GET /compute/v2.1/servers/b7114201-4fdf-4ef8-9269-68e47288e353" status: 200 len: 1226 microversion: 2.1 time: 0.110242 Oct 23 01:42:17.726692 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2974/6039] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:42:17 2022] GET /compute/v2.1/servers/b7114201-4fdf-4ef8-9269-68e47288e353 => generated 1226 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:42:18.109593 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e88ecff1-dca1-4a23-8740-ec2d52d3ec6a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:42:18.111116 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e88ecff1-dca1-4a23-8740-ec2d52d3ec6a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 53409afc-6907-43b2-96e7-92536059a476] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:18.120794 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e88ecff1-dca1-4a23-8740-ec2d52d3ec6a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:18.121398 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e88ecff1-dca1-4a23-8740-ec2d52d3ec6a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:18.122243 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e88ecff1-dca1-4a23-8740-ec2d52d3ec6a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:18.123361 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e88ecff1-dca1-4a23-8740-ec2d52d3ec6a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:18.124001 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e88ecff1-dca1-4a23-8740-ec2d52d3ec6a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:18.124438 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e88ecff1-dca1-4a23-8740-ec2d52d3ec6a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:18.317685 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e88ecff1-dca1-4a23-8740-ec2d52d3ec6a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:42:18.326762 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e88ecff1-dca1-4a23-8740-ec2d52d3ec6a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476" status: 200 len: 1691 microversion: 2.1 time: 0.221441 Oct 23 01:42:18.330350 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3066/6040] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:42:18 2022] GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476 => generated 1691 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:42:18.755112 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-34bca5aa-1d22-4dc2-b7ea-f63c3726b353 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:42:18.755736 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-34bca5aa-1d22-4dc2-b7ea-f63c3726b353 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] [instance: b7114201-4fdf-4ef8-9269-68e47288e353] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:18.768235 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-34bca5aa-1d22-4dc2-b7ea-f63c3726b353 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:18.773688 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-34bca5aa-1d22-4dc2-b7ea-f63c3726b353 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:18.774173 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-34bca5aa-1d22-4dc2-b7ea-f63c3726b353 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:18.774930 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-34bca5aa-1d22-4dc2-b7ea-f63c3726b353 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:18.775396 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-34bca5aa-1d22-4dc2-b7ea-f63c3726b353 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:18.775829 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-34bca5aa-1d22-4dc2-b7ea-f63c3726b353 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:18.911055 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-34bca5aa-1d22-4dc2-b7ea-f63c3726b353 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b094df884baf43a0824d210dfe6e8d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459f3c837db4fcaafc0e4aaed1600e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:42:18.942558 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-34bca5aa-1d22-4dc2-b7ea-f63c3726b353 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] 10.222.0.42 "GET /compute/v2.1/servers/b7114201-4fdf-4ef8-9269-68e47288e353" status: 200 len: 1222 microversion: 2.1 time: 0.192375 Oct 23 01:42:18.946464 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2975/6041] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:42:18 2022] GET /compute/v2.1/servers/b7114201-4fdf-4ef8-9269-68e47288e353 => generated 1222 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:42:19.352693 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bc87be45-4b91-41dc-8c9f-e897650f1bc0 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:42:19.353323 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bc87be45-4b91-41dc-8c9f-e897650f1bc0 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 53409afc-6907-43b2-96e7-92536059a476] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:19.367241 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc87be45-4b91-41dc-8c9f-e897650f1bc0 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:19.368044 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc87be45-4b91-41dc-8c9f-e897650f1bc0 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:19.368852 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc87be45-4b91-41dc-8c9f-e897650f1bc0 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:19.369734 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc87be45-4b91-41dc-8c9f-e897650f1bc0 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:19.370380 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc87be45-4b91-41dc-8c9f-e897650f1bc0 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:19.375930 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc87be45-4b91-41dc-8c9f-e897650f1bc0 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:19.556719 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bc87be45-4b91-41dc-8c9f-e897650f1bc0 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:42:19.589377 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bc87be45-4b91-41dc-8c9f-e897650f1bc0 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476" status: 200 len: 1696 microversion: 2.1 time: 0.241302 Oct 23 01:42:19.590654 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3067/6042] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:42:19 2022] GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476 => generated 1696 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:42:19.971057 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-79b436d1-ff53-462b-bd35-c610f6cf5b9f tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:42:19.971853 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-79b436d1-ff53-462b-bd35-c610f6cf5b9f tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] [instance: b7114201-4fdf-4ef8-9269-68e47288e353] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:19.982166 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-79b436d1-ff53-462b-bd35-c610f6cf5b9f tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:19.983651 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-79b436d1-ff53-462b-bd35-c610f6cf5b9f tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:19.983651 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-79b436d1-ff53-462b-bd35-c610f6cf5b9f tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:19.985008 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-79b436d1-ff53-462b-bd35-c610f6cf5b9f tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:19.985478 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-79b436d1-ff53-462b-bd35-c610f6cf5b9f tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:19.985938 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-79b436d1-ff53-462b-bd35-c610f6cf5b9f tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:20.064230 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-79b436d1-ff53-462b-bd35-c610f6cf5b9f tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b094df884baf43a0824d210dfe6e8d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459f3c837db4fcaafc0e4aaed1600e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:42:20.073625 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-79b436d1-ff53-462b-bd35-c610f6cf5b9f tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] 10.222.0.42 "GET /compute/v2.1/servers/b7114201-4fdf-4ef8-9269-68e47288e353" status: 200 len: 1286 microversion: 2.1 time: 0.106522 Oct 23 01:42:20.075957 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2976/6043] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:42:19 2022] GET /compute/v2.1/servers/b7114201-4fdf-4ef8-9269-68e47288e353 => generated 1286 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:42:20.623101 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0daf4140-a39f-4b74-af4c-5d5ced4d53c4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:42:20.632503 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0daf4140-a39f-4b74-af4c-5d5ced4d53c4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 53409afc-6907-43b2-96e7-92536059a476] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:20.650317 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0daf4140-a39f-4b74-af4c-5d5ced4d53c4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:20.650818 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0daf4140-a39f-4b74-af4c-5d5ced4d53c4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:20.651259 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0daf4140-a39f-4b74-af4c-5d5ced4d53c4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:20.651968 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0daf4140-a39f-4b74-af4c-5d5ced4d53c4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:20.652596 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0daf4140-a39f-4b74-af4c-5d5ced4d53c4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:20.653187 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0daf4140-a39f-4b74-af4c-5d5ced4d53c4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:20.921695 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0daf4140-a39f-4b74-af4c-5d5ced4d53c4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:42:20.923971 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0daf4140-a39f-4b74-af4c-5d5ced4d53c4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476" status: 200 len: 1696 microversion: 2.1 time: 0.310408 Oct 23 01:42:20.924632 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3068/6044] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:42:20 2022] GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476 => generated 1696 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:42:21.099611 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-52dae85b-80dd-4b20-8b03-9be6a43a89bb tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:42:21.105144 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-52dae85b-80dd-4b20-8b03-9be6a43a89bb tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] [instance: b7114201-4fdf-4ef8-9269-68e47288e353] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:21.117265 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52dae85b-80dd-4b20-8b03-9be6a43a89bb tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:21.117768 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52dae85b-80dd-4b20-8b03-9be6a43a89bb tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:21.118435 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52dae85b-80dd-4b20-8b03-9be6a43a89bb tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:21.119176 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52dae85b-80dd-4b20-8b03-9be6a43a89bb tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:21.119792 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52dae85b-80dd-4b20-8b03-9be6a43a89bb tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:21.129458 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-52dae85b-80dd-4b20-8b03-9be6a43a89bb tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:21.399758 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-52dae85b-80dd-4b20-8b03-9be6a43a89bb tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b094df884baf43a0824d210dfe6e8d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459f3c837db4fcaafc0e4aaed1600e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:42:21.408006 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-52dae85b-80dd-4b20-8b03-9be6a43a89bb tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] 10.222.0.42 "GET /compute/v2.1/servers/b7114201-4fdf-4ef8-9269-68e47288e353" status: 200 len: 1326 microversion: 2.1 time: 0.313337 Oct 23 01:42:21.408737 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2977/6045] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:42:21 2022] GET /compute/v2.1/servers/b7114201-4fdf-4ef8-9269-68e47288e353 => generated 1326 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:42:21.954910 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4512717f-1e33-41a3-b2a9-8f63e28bcde4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:42:21.956373 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4512717f-1e33-41a3-b2a9-8f63e28bcde4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 53409afc-6907-43b2-96e7-92536059a476] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:21.968687 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4512717f-1e33-41a3-b2a9-8f63e28bcde4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:21.969727 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4512717f-1e33-41a3-b2a9-8f63e28bcde4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:21.970628 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4512717f-1e33-41a3-b2a9-8f63e28bcde4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:21.972121 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4512717f-1e33-41a3-b2a9-8f63e28bcde4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:21.972960 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4512717f-1e33-41a3-b2a9-8f63e28bcde4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:21.973796 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4512717f-1e33-41a3-b2a9-8f63e28bcde4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:22.167958 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4512717f-1e33-41a3-b2a9-8f63e28bcde4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:42:22.176551 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4512717f-1e33-41a3-b2a9-8f63e28bcde4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476" status: 200 len: 1696 microversion: 2.1 time: 0.230094 Oct 23 01:42:22.178378 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3069/6046] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:42:21 2022] GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476 => generated 1696 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:42:22.437692 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8397ba8e-6436-49b0-a889-8585ad131efb tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:42:22.445356 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8397ba8e-6436-49b0-a889-8585ad131efb tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] [instance: b7114201-4fdf-4ef8-9269-68e47288e353] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:22.462791 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8397ba8e-6436-49b0-a889-8585ad131efb tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:22.469094 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8397ba8e-6436-49b0-a889-8585ad131efb tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:22.478415 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8397ba8e-6436-49b0-a889-8585ad131efb tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:22.479349 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8397ba8e-6436-49b0-a889-8585ad131efb tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:22.480304 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8397ba8e-6436-49b0-a889-8585ad131efb tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:22.480892 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8397ba8e-6436-49b0-a889-8585ad131efb tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:22.558975 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-556ff58b-3adc-4783-a624-c2dcbd48ab16 req-2a6ebd25-4d7e-44e5-9721-e56f9a315175 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7114201-4fdf-4ef8-9269-68e47288e353", "tag": "3818f5ae-5f31-4b25-97b4-e86aefc2bce0"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:42:22.578766 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-556ff58b-3adc-4783-a624-c2dcbd48ab16 req-2a6ebd25-4d7e-44e5-9721-e56f9a315175 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:22.581863 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-556ff58b-3adc-4783-a624-c2dcbd48ab16 req-2a6ebd25-4d7e-44e5-9721-e56f9a315175 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:22.582390 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-556ff58b-3adc-4783-a624-c2dcbd48ab16 req-2a6ebd25-4d7e-44e5-9721-e56f9a315175 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:22.605607 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-556ff58b-3adc-4783-a624-c2dcbd48ab16 req-2a6ebd25-4d7e-44e5-9721-e56f9a315175 service nova] Creating event network-changed:3818f5ae-5f31-4b25-97b4-e86aefc2bce0 for instance b7114201-4fdf-4ef8-9269-68e47288e353 on n-h1-master-1 Oct 23 01:42:22.619794 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-556ff58b-3adc-4783-a624-c2dcbd48ab16 req-2a6ebd25-4d7e-44e5-9721-e56f9a315175 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064717 Oct 23 01:42:22.626532 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3070/6047] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:42:22.738622 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8397ba8e-6436-49b0-a889-8585ad131efb tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b094df884baf43a0824d210dfe6e8d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459f3c837db4fcaafc0e4aaed1600e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:42:22.751244 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8397ba8e-6436-49b0-a889-8585ad131efb tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] 10.222.0.42 "GET /compute/v2.1/servers/b7114201-4fdf-4ef8-9269-68e47288e353" status: 200 len: 1326 microversion: 2.1 time: 0.318484 Oct 23 01:42:22.751855 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2978/6048] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:42:22 2022] GET /compute/v2.1/servers/b7114201-4fdf-4ef8-9269-68e47288e353 => generated 1326 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:42:23.204329 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ce5fa3e0-f27f-4c56-98be-d67cb9594fd6 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:42:23.206333 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ce5fa3e0-f27f-4c56-98be-d67cb9594fd6 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 53409afc-6907-43b2-96e7-92536059a476] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:23.235367 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce5fa3e0-f27f-4c56-98be-d67cb9594fd6 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:23.236401 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce5fa3e0-f27f-4c56-98be-d67cb9594fd6 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:23.237049 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce5fa3e0-f27f-4c56-98be-d67cb9594fd6 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:23.238425 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce5fa3e0-f27f-4c56-98be-d67cb9594fd6 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:23.238946 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce5fa3e0-f27f-4c56-98be-d67cb9594fd6 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:23.240036 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce5fa3e0-f27f-4c56-98be-d67cb9594fd6 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:23.544977 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ce5fa3e0-f27f-4c56-98be-d67cb9594fd6 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:42:23.565850 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ce5fa3e0-f27f-4c56-98be-d67cb9594fd6 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476" status: 200 len: 1696 microversion: 2.1 time: 0.367950 Oct 23 01:42:23.567400 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3071/6049] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:42:23 2022] GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476 => generated 1696 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:42:23.775656 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0052bc70-3bae-4a06-89d4-0f5ece15ab7a tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:42:23.777012 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0052bc70-3bae-4a06-89d4-0f5ece15ab7a tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] [instance: b7114201-4fdf-4ef8-9269-68e47288e353] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:23.784489 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0052bc70-3bae-4a06-89d4-0f5ece15ab7a tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:23.785341 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0052bc70-3bae-4a06-89d4-0f5ece15ab7a tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:23.786024 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0052bc70-3bae-4a06-89d4-0f5ece15ab7a tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:23.787023 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0052bc70-3bae-4a06-89d4-0f5ece15ab7a tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:23.787883 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0052bc70-3bae-4a06-89d4-0f5ece15ab7a tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:23.788487 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0052bc70-3bae-4a06-89d4-0f5ece15ab7a tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:23.993420 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0052bc70-3bae-4a06-89d4-0f5ece15ab7a tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b094df884baf43a0824d210dfe6e8d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459f3c837db4fcaafc0e4aaed1600e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:42:24.003296 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0052bc70-3bae-4a06-89d4-0f5ece15ab7a tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] 10.222.0.42 "GET /compute/v2.1/servers/b7114201-4fdf-4ef8-9269-68e47288e353" status: 200 len: 1326 microversion: 2.1 time: 0.231741 Oct 23 01:42:24.003814 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2979/6050] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:42:23 2022] GET /compute/v2.1/servers/b7114201-4fdf-4ef8-9269-68e47288e353 => generated 1326 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:42:24.614423 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d39597d4-b430-490b-a686-c4160b23afc2 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:42:24.614423 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d39597d4-b430-490b-a686-c4160b23afc2 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 53409afc-6907-43b2-96e7-92536059a476] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:24.621053 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d39597d4-b430-490b-a686-c4160b23afc2 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:24.621571 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d39597d4-b430-490b-a686-c4160b23afc2 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:24.622094 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d39597d4-b430-490b-a686-c4160b23afc2 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:24.624521 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d39597d4-b430-490b-a686-c4160b23afc2 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:24.625041 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d39597d4-b430-490b-a686-c4160b23afc2 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:24.625485 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d39597d4-b430-490b-a686-c4160b23afc2 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:24.810266 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d39597d4-b430-490b-a686-c4160b23afc2 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:42:24.825526 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d39597d4-b430-490b-a686-c4160b23afc2 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476" status: 200 len: 1696 microversion: 2.1 time: 0.225767 Oct 23 01:42:24.842707 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3072/6051] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:42:24 2022] GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476 => generated 1696 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:42:25.031089 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e6d1b25f-2311-4bc9-8098-ebc364120e2a tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:42:25.031655 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e6d1b25f-2311-4bc9-8098-ebc364120e2a tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] [instance: b7114201-4fdf-4ef8-9269-68e47288e353] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:25.044384 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6d1b25f-2311-4bc9-8098-ebc364120e2a tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:25.044884 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6d1b25f-2311-4bc9-8098-ebc364120e2a tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:25.045323 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6d1b25f-2311-4bc9-8098-ebc364120e2a tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:25.049218 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6d1b25f-2311-4bc9-8098-ebc364120e2a tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:25.050001 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6d1b25f-2311-4bc9-8098-ebc364120e2a tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:25.054296 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6d1b25f-2311-4bc9-8098-ebc364120e2a tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:25.329154 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e6d1b25f-2311-4bc9-8098-ebc364120e2a tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b094df884baf43a0824d210dfe6e8d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459f3c837db4fcaafc0e4aaed1600e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:42:25.338819 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e6d1b25f-2311-4bc9-8098-ebc364120e2a tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] 10.222.0.42 "GET /compute/v2.1/servers/b7114201-4fdf-4ef8-9269-68e47288e353" status: 200 len: 1326 microversion: 2.1 time: 0.311790 Oct 23 01:42:25.339836 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2980/6052] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:42:25 2022] GET /compute/v2.1/servers/b7114201-4fdf-4ef8-9269-68e47288e353 => generated 1326 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:42:25.850016 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6301d416-d896-4478-ae73-fc38be356e18 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:42:25.851285 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6301d416-d896-4478-ae73-fc38be356e18 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 53409afc-6907-43b2-96e7-92536059a476] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:25.864677 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6301d416-d896-4478-ae73-fc38be356e18 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:25.865311 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6301d416-d896-4478-ae73-fc38be356e18 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:25.866505 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6301d416-d896-4478-ae73-fc38be356e18 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:25.867272 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6301d416-d896-4478-ae73-fc38be356e18 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:25.867742 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6301d416-d896-4478-ae73-fc38be356e18 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:25.868180 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6301d416-d896-4478-ae73-fc38be356e18 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:25.949542 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:25.975648 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=6 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:26.071822 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6301d416-d896-4478-ae73-fc38be356e18 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:42:26.090591 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6301d416-d896-4478-ae73-fc38be356e18 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476" status: 200 len: 1696 microversion: 2.1 time: 0.244903 Oct 23 01:42:26.094423 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3073/6053] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:42:25 2022] GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476 => generated 1696 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:42:26.363944 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-719c511d-6152-4080-a922-7a1375ec754b tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:42:26.364610 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-719c511d-6152-4080-a922-7a1375ec754b tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] [instance: b7114201-4fdf-4ef8-9269-68e47288e353] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:26.374250 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-719c511d-6152-4080-a922-7a1375ec754b tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:26.374748 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-719c511d-6152-4080-a922-7a1375ec754b tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:26.375355 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-719c511d-6152-4080-a922-7a1375ec754b tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:26.376162 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-719c511d-6152-4080-a922-7a1375ec754b tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:26.376797 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-719c511d-6152-4080-a922-7a1375ec754b tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:26.377222 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-719c511d-6152-4080-a922-7a1375ec754b tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:27.069100 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-719c511d-6152-4080-a922-7a1375ec754b tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b094df884baf43a0824d210dfe6e8d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459f3c837db4fcaafc0e4aaed1600e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:42:27.081068 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-719c511d-6152-4080-a922-7a1375ec754b tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] 10.222.0.42 "GET /compute/v2.1/servers/b7114201-4fdf-4ef8-9269-68e47288e353" status: 200 len: 1326 microversion: 2.1 time: 0.720904 Oct 23 01:42:27.081844 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2981/6054] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:42:26 2022] GET /compute/v2.1/servers/b7114201-4fdf-4ef8-9269-68e47288e353 => generated 1326 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:42:27.120309 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-caffea8e-5147-4748-9016-f161a3f355ad tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:42:27.120309 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-caffea8e-5147-4748-9016-f161a3f355ad tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 53409afc-6907-43b2-96e7-92536059a476] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:27.125732 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-caffea8e-5147-4748-9016-f161a3f355ad tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:27.126684 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-caffea8e-5147-4748-9016-f161a3f355ad tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:27.127267 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-caffea8e-5147-4748-9016-f161a3f355ad tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:27.128125 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-caffea8e-5147-4748-9016-f161a3f355ad tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:27.128660 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-caffea8e-5147-4748-9016-f161a3f355ad tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:27.129205 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-caffea8e-5147-4748-9016-f161a3f355ad tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:27.462731 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-caffea8e-5147-4748-9016-f161a3f355ad tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:42:27.473189 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-caffea8e-5147-4748-9016-f161a3f355ad tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476" status: 200 len: 1696 microversion: 2.1 time: 0.362441 Oct 23 01:42:27.489609 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3074/6055] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:42:27 2022] GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476 => generated 1696 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:42:28.106275 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d445938f-49e3-4313-a9de-7c233e60e61b tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:42:28.107811 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d445938f-49e3-4313-a9de-7c233e60e61b tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] [instance: b7114201-4fdf-4ef8-9269-68e47288e353] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:28.114821 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=4 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:28.117264 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d445938f-49e3-4313-a9de-7c233e60e61b tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:28.118031 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d445938f-49e3-4313-a9de-7c233e60e61b tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:28.118666 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d445938f-49e3-4313-a9de-7c233e60e61b tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:28.119671 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d445938f-49e3-4313-a9de-7c233e60e61b tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:28.120423 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d445938f-49e3-4313-a9de-7c233e60e61b tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:28.121076 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d445938f-49e3-4313-a9de-7c233e60e61b tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:28.326818 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d445938f-49e3-4313-a9de-7c233e60e61b tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b094df884baf43a0824d210dfe6e8d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459f3c837db4fcaafc0e4aaed1600e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:42:28.338386 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d445938f-49e3-4313-a9de-7c233e60e61b tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] 10.222.0.42 "GET /compute/v2.1/servers/b7114201-4fdf-4ef8-9269-68e47288e353" status: 200 len: 1326 microversion: 2.1 time: 0.237603 Oct 23 01:42:28.347005 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2982/6056] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:42:28 2022] GET /compute/v2.1/servers/b7114201-4fdf-4ef8-9269-68e47288e353 => generated 1326 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:42:28.501614 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-95cb1e8e-8f91-44f5-aec8-7d27db3ab8e4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:42:28.502189 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-95cb1e8e-8f91-44f5-aec8-7d27db3ab8e4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 53409afc-6907-43b2-96e7-92536059a476] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:28.530271 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-95cb1e8e-8f91-44f5-aec8-7d27db3ab8e4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:28.531092 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-95cb1e8e-8f91-44f5-aec8-7d27db3ab8e4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:28.531732 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-95cb1e8e-8f91-44f5-aec8-7d27db3ab8e4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:28.532663 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-95cb1e8e-8f91-44f5-aec8-7d27db3ab8e4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:28.533300 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-95cb1e8e-8f91-44f5-aec8-7d27db3ab8e4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:28.533901 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-95cb1e8e-8f91-44f5-aec8-7d27db3ab8e4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:28.714861 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-95cb1e8e-8f91-44f5-aec8-7d27db3ab8e4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:42:28.722776 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-95cb1e8e-8f91-44f5-aec8-7d27db3ab8e4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476" status: 200 len: 1696 microversion: 2.1 time: 0.228143 Oct 23 01:42:28.723362 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3075/6057] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:42:28 2022] GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476 => generated 1696 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:42:29.368929 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9f284497-3bcd-491c-b056-3521b605a0f4 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:42:29.369575 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9f284497-3bcd-491c-b056-3521b605a0f4 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] [instance: b7114201-4fdf-4ef8-9269-68e47288e353] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:29.382051 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f284497-3bcd-491c-b056-3521b605a0f4 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:29.382422 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f284497-3bcd-491c-b056-3521b605a0f4 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:29.383054 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f284497-3bcd-491c-b056-3521b605a0f4 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:29.383758 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f284497-3bcd-491c-b056-3521b605a0f4 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:29.384487 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f284497-3bcd-491c-b056-3521b605a0f4 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:29.384643 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f284497-3bcd-491c-b056-3521b605a0f4 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:29.564705 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9f284497-3bcd-491c-b056-3521b605a0f4 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b094df884baf43a0824d210dfe6e8d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459f3c837db4fcaafc0e4aaed1600e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:42:29.577628 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9f284497-3bcd-491c-b056-3521b605a0f4 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] 10.222.0.42 "GET /compute/v2.1/servers/b7114201-4fdf-4ef8-9269-68e47288e353" status: 200 len: 1326 microversion: 2.1 time: 0.212583 Oct 23 01:42:29.578392 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2983/6058] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:42:29 2022] GET /compute/v2.1/servers/b7114201-4fdf-4ef8-9269-68e47288e353 => generated 1326 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:42:29.747849 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7a7a9218-7c7d-4bf2-8544-accf471b2231 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:42:29.748686 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7a7a9218-7c7d-4bf2-8544-accf471b2231 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 53409afc-6907-43b2-96e7-92536059a476] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:29.755866 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7a7a9218-7c7d-4bf2-8544-accf471b2231 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:29.756990 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7a7a9218-7c7d-4bf2-8544-accf471b2231 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:29.757431 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7a7a9218-7c7d-4bf2-8544-accf471b2231 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:29.758210 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7a7a9218-7c7d-4bf2-8544-accf471b2231 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:29.758669 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7a7a9218-7c7d-4bf2-8544-accf471b2231 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:29.759096 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7a7a9218-7c7d-4bf2-8544-accf471b2231 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:29.933680 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7a7a9218-7c7d-4bf2-8544-accf471b2231 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:42:29.941942 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7a7a9218-7c7d-4bf2-8544-accf471b2231 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476" status: 200 len: 1696 microversion: 2.1 time: 0.198148 Oct 23 01:42:29.942550 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3076/6059] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:42:29 2022] GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476 => generated 1696 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:42:30.508773 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-3880eb79-3869-4ff4-8218-ada298a72eb4 req-c5768ca6-c64c-42f9-acfb-35a429562667 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7114201-4fdf-4ef8-9269-68e47288e353", "name": "network-vif-plugged", "status": "completed", "tag": "3818f5ae-5f31-4b25-97b4-e86aefc2bce0"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:42:30.522258 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-3880eb79-3869-4ff4-8218-ada298a72eb4 req-c5768ca6-c64c-42f9-acfb-35a429562667 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:30.523342 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-3880eb79-3869-4ff4-8218-ada298a72eb4 req-c5768ca6-c64c-42f9-acfb-35a429562667 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:30.524883 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-3880eb79-3869-4ff4-8218-ada298a72eb4 req-c5768ca6-c64c-42f9-acfb-35a429562667 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:30.538583 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-3880eb79-3869-4ff4-8218-ada298a72eb4 req-c5768ca6-c64c-42f9-acfb-35a429562667 service nova] Creating event network-vif-plugged:3818f5ae-5f31-4b25-97b4-e86aefc2bce0 for instance b7114201-4fdf-4ef8-9269-68e47288e353 on n-h1-master-1 Oct 23 01:42:30.548524 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-3880eb79-3869-4ff4-8218-ada298a72eb4 req-c5768ca6-c64c-42f9-acfb-35a429562667 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.209280 Oct 23 01:42:30.548524 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2984/6060] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:42:30.606520 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-82cb9859-a132-4ab9-ad5e-daaaa181a68a tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:42:30.607183 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-82cb9859-a132-4ab9-ad5e-daaaa181a68a tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] [instance: b7114201-4fdf-4ef8-9269-68e47288e353] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:30.614708 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-82cb9859-a132-4ab9-ad5e-daaaa181a68a tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:30.615372 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-82cb9859-a132-4ab9-ad5e-daaaa181a68a tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:30.615831 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-82cb9859-a132-4ab9-ad5e-daaaa181a68a tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:30.616732 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-82cb9859-a132-4ab9-ad5e-daaaa181a68a tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:30.617260 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-82cb9859-a132-4ab9-ad5e-daaaa181a68a tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:30.619467 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-82cb9859-a132-4ab9-ad5e-daaaa181a68a tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:30.805103 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-82cb9859-a132-4ab9-ad5e-daaaa181a68a tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b094df884baf43a0824d210dfe6e8d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459f3c837db4fcaafc0e4aaed1600e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:42:30.813665 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-82cb9859-a132-4ab9-ad5e-daaaa181a68a tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] 10.222.0.42 "GET /compute/v2.1/servers/b7114201-4fdf-4ef8-9269-68e47288e353" status: 200 len: 1326 microversion: 2.1 time: 0.213697 Oct 23 01:42:30.814875 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3077/6061] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:42:30 2022] GET /compute/v2.1/servers/b7114201-4fdf-4ef8-9269-68e47288e353 => generated 1326 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:42:30.968432 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b21fdc09-183d-40a6-94fd-69c890fde4bc tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:42:30.969291 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b21fdc09-183d-40a6-94fd-69c890fde4bc tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 53409afc-6907-43b2-96e7-92536059a476] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:30.978988 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b21fdc09-183d-40a6-94fd-69c890fde4bc tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:30.979900 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b21fdc09-183d-40a6-94fd-69c890fde4bc tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:30.980936 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b21fdc09-183d-40a6-94fd-69c890fde4bc tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:30.983131 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b21fdc09-183d-40a6-94fd-69c890fde4bc tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:30.983856 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b21fdc09-183d-40a6-94fd-69c890fde4bc tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:30.984531 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b21fdc09-183d-40a6-94fd-69c890fde4bc tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:31.180983 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b21fdc09-183d-40a6-94fd-69c890fde4bc tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:42:31.188177 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:31.195220 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b21fdc09-183d-40a6-94fd-69c890fde4bc tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476" status: 200 len: 1696 microversion: 2.1 time: 0.228481 Oct 23 01:42:31.195220 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2985/6062] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:42:30 2022] GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476 => generated 1696 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:42:31.838177 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0185d9e6-a818-44bc-a4d7-818b0f09cf71 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:42:31.839564 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0185d9e6-a818-44bc-a4d7-818b0f09cf71 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] [instance: b7114201-4fdf-4ef8-9269-68e47288e353] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:31.858537 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0185d9e6-a818-44bc-a4d7-818b0f09cf71 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:31.859905 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0185d9e6-a818-44bc-a4d7-818b0f09cf71 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:31.860686 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0185d9e6-a818-44bc-a4d7-818b0f09cf71 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:31.866364 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0185d9e6-a818-44bc-a4d7-818b0f09cf71 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:31.867195 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0185d9e6-a818-44bc-a4d7-818b0f09cf71 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:31.868193 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0185d9e6-a818-44bc-a4d7-818b0f09cf71 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:32.120119 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0185d9e6-a818-44bc-a4d7-818b0f09cf71 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b094df884baf43a0824d210dfe6e8d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459f3c837db4fcaafc0e4aaed1600e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:42:32.131631 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0185d9e6-a818-44bc-a4d7-818b0f09cf71 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] 10.222.0.42 "GET /compute/v2.1/servers/b7114201-4fdf-4ef8-9269-68e47288e353" status: 200 len: 1326 microversion: 2.1 time: 0.297640 Oct 23 01:42:32.136390 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3078/6063] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:42:31 2022] GET /compute/v2.1/servers/b7114201-4fdf-4ef8-9269-68e47288e353 => generated 1326 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:42:32.218047 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3ac64b09-abe4-4618-a631-34efcebdcbbf tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:42:32.218711 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3ac64b09-abe4-4618-a631-34efcebdcbbf tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 53409afc-6907-43b2-96e7-92536059a476] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:32.226795 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3ac64b09-abe4-4618-a631-34efcebdcbbf tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:32.227288 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3ac64b09-abe4-4618-a631-34efcebdcbbf tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:32.227730 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3ac64b09-abe4-4618-a631-34efcebdcbbf tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:32.228438 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3ac64b09-abe4-4618-a631-34efcebdcbbf tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:32.228889 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3ac64b09-abe4-4618-a631-34efcebdcbbf tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:32.229521 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3ac64b09-abe4-4618-a631-34efcebdcbbf tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:32.420145 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3ac64b09-abe4-4618-a631-34efcebdcbbf tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:42:32.429895 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3ac64b09-abe4-4618-a631-34efcebdcbbf tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476" status: 200 len: 1696 microversion: 2.1 time: 0.216640 Oct 23 01:42:32.442001 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2986/6064] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:42:32 2022] GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476 => generated 1696 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:42:33.156376 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7acdd787-33af-4da4-a0a3-0267551ffb1c tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:42:33.157151 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7acdd787-33af-4da4-a0a3-0267551ffb1c tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] [instance: b7114201-4fdf-4ef8-9269-68e47288e353] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:33.165738 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7acdd787-33af-4da4-a0a3-0267551ffb1c tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:33.170074 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7acdd787-33af-4da4-a0a3-0267551ffb1c tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:33.171715 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7acdd787-33af-4da4-a0a3-0267551ffb1c tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:33.173580 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7acdd787-33af-4da4-a0a3-0267551ffb1c tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:33.175297 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7acdd787-33af-4da4-a0a3-0267551ffb1c tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:33.175931 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7acdd787-33af-4da4-a0a3-0267551ffb1c tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:33.188105 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=100 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:33.456700 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2255b5eb-7ecd-4b9c-ad93-3e611c9d587e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:42:33.457326 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2255b5eb-7ecd-4b9c-ad93-3e611c9d587e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 53409afc-6907-43b2-96e7-92536059a476] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:33.469348 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2255b5eb-7ecd-4b9c-ad93-3e611c9d587e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:33.469852 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2255b5eb-7ecd-4b9c-ad93-3e611c9d587e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:33.470333 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2255b5eb-7ecd-4b9c-ad93-3e611c9d587e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:33.471063 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2255b5eb-7ecd-4b9c-ad93-3e611c9d587e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:33.471590 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2255b5eb-7ecd-4b9c-ad93-3e611c9d587e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:33.472015 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2255b5eb-7ecd-4b9c-ad93-3e611c9d587e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:33.493639 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7acdd787-33af-4da4-a0a3-0267551ffb1c tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b094df884baf43a0824d210dfe6e8d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459f3c837db4fcaafc0e4aaed1600e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:42:33.514760 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7acdd787-33af-4da4-a0a3-0267551ffb1c tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] 10.222.0.42 "GET /compute/v2.1/servers/b7114201-4fdf-4ef8-9269-68e47288e353" status: 200 len: 1527 microversion: 2.1 time: 0.362322 Oct 23 01:42:33.520461 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3079/6065] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:42:33 2022] GET /compute/v2.1/servers/b7114201-4fdf-4ef8-9269-68e47288e353 => generated 1527 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:42:33.550642 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8658b1d9-6ecd-407a-8f80-29dbb9b7a436 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:42:33.555672 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8658b1d9-6ecd-407a-8f80-29dbb9b7a436 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] [instance: b7114201-4fdf-4ef8-9269-68e47288e353] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:33.563964 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8658b1d9-6ecd-407a-8f80-29dbb9b7a436 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:33.565381 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8658b1d9-6ecd-407a-8f80-29dbb9b7a436 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:33.566356 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8658b1d9-6ecd-407a-8f80-29dbb9b7a436 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:33.567500 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8658b1d9-6ecd-407a-8f80-29dbb9b7a436 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:33.569363 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8658b1d9-6ecd-407a-8f80-29dbb9b7a436 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:33.570324 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8658b1d9-6ecd-407a-8f80-29dbb9b7a436 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:33.916602 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8658b1d9-6ecd-407a-8f80-29dbb9b7a436 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b094df884baf43a0824d210dfe6e8d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459f3c837db4fcaafc0e4aaed1600e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:42:33.923724 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2255b5eb-7ecd-4b9c-ad93-3e611c9d587e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:42:33.927524 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8658b1d9-6ecd-407a-8f80-29dbb9b7a436 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] 10.222.0.42 "GET /compute/v2.1/servers/b7114201-4fdf-4ef8-9269-68e47288e353" status: 200 len: 1527 microversion: 2.1 time: 0.384996 Oct 23 01:42:33.934529 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2255b5eb-7ecd-4b9c-ad93-3e611c9d587e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476" status: 200 len: 1696 microversion: 2.1 time: 0.482340 Oct 23 01:42:33.939384 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3080/6066] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:42:33 2022] GET /compute/v2.1/servers/b7114201-4fdf-4ef8-9269-68e47288e353 => generated 1527 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:42:33.957003 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2987/6067] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:42:33 2022] GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476 => generated 1696 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:42:34.208685 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-00004b06-b05e-44df-b35f-3db18cfba31a tempest-ServersNegativeTestMultiTenantJSON-978786380 tempest-ServersNegativeTestMultiTenantJSON-978786380-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:42:34.215154 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-00004b06-b05e-44df-b35f-3db18cfba31a tempest-ServersNegativeTestMultiTenantJSON-978786380 tempest-ServersNegativeTestMultiTenantJSON-978786380-project] [instance: b7114201-4fdf-4ef8-9269-68e47288e353] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:34.216929 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-00004b06-b05e-44df-b35f-3db18cfba31a tempest-ServersNegativeTestMultiTenantJSON-978786380 tempest-ServersNegativeTestMultiTenantJSON-978786380-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:34.217583 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-00004b06-b05e-44df-b35f-3db18cfba31a tempest-ServersNegativeTestMultiTenantJSON-978786380 tempest-ServersNegativeTestMultiTenantJSON-978786380-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:34.218212 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-00004b06-b05e-44df-b35f-3db18cfba31a tempest-ServersNegativeTestMultiTenantJSON-978786380 tempest-ServersNegativeTestMultiTenantJSON-978786380-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:34.219088 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-00004b06-b05e-44df-b35f-3db18cfba31a tempest-ServersNegativeTestMultiTenantJSON-978786380 tempest-ServersNegativeTestMultiTenantJSON-978786380-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:34.219628 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-00004b06-b05e-44df-b35f-3db18cfba31a tempest-ServersNegativeTestMultiTenantJSON-978786380 tempest-ServersNegativeTestMultiTenantJSON-978786380-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:34.220126 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-00004b06-b05e-44df-b35f-3db18cfba31a tempest-ServersNegativeTestMultiTenantJSON-978786380 tempest-ServersNegativeTestMultiTenantJSON-978786380-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:34.247365 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-00004b06-b05e-44df-b35f-3db18cfba31a tempest-ServersNegativeTestMultiTenantJSON-978786380 tempest-ServersNegativeTestMultiTenantJSON-978786380-project] HTTP exception thrown: Instance b7114201-4fdf-4ef8-9269-68e47288e353 could not be found. Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-00004b06-b05e-44df-b35f-3db18cfba31a tempest-ServersNegativeTestMultiTenantJSON-978786380 tempest-ServersNegativeTestMultiTenantJSON-978786380-project] Request method failure captured: Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/servers/b7114201-4fdf-4ef8-9269-68e47288e353 HTTP/1.1 Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJv2bexn9pSI5CGaSMc31LnBByX4r_rRTtm1O_XWehbp45vbc5c7v4CKMYZcNMi99Ulk0a6onOsFidvHwg8V7j4pA3Of6Xo4lBHUvTiYLLesuAK4CBgg-tnkpcQdCH2NA6rZ2DCCCx1Z_o1obPkdUP0O464lg6GGW5-voISsUft7qK4 Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 6208791d12e94925923ed1a1a75bbd42 Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-978786380 Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6208791d12e94925923ed1a1a75bbd42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6208791d12e94925923ed1a1a75bbd42"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6208791d12e94925923ed1a1a75bbd42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6208791d12e94925923ed1a1a75bbd42"}]}] Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-978786380 Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 6208791d12e94925923ed1a1a75bbd42 Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-978786380 Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersNegativeTestMultiTenantJSON-978786380-project Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 10c2f508584f4c41bed50c0dd477fe02 Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-978786380-project Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: exception: Instance b7114201-4fdf-4ef8-9269-68e47288e353 could not be found. Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'b7114201-4fdf-4ef8-9269-68e47288e353'} Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7114201-4fdf-4ef8-9269-68e47288e353 could not be found. Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:42:34.254613 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:42:34.263341 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7114201-4fdf-4ef8-9269-68e47288e353 could not be found. Oct 23 01:42:34.263341 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:42:34.263341 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:42:34.263341 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:42:34.263341 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:42:34.263341 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:42:34.263341 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:42:34.263341 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:42:34.263341 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:42:34.263341 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7114201-4fdf-4ef8-9269-68e47288e353 could not be found. Oct 23 01:42:34.263341 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:42:34.273544 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-00004b06-b05e-44df-b35f-3db18cfba31a tempest-ServersNegativeTestMultiTenantJSON-978786380 tempest-ServersNegativeTestMultiTenantJSON-978786380-project] Returning 404 to user: Instance b7114201-4fdf-4ef8-9269-68e47288e353 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:42:34.276112 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-00004b06-b05e-44df-b35f-3db18cfba31a tempest-ServersNegativeTestMultiTenantJSON-978786380 tempest-ServersNegativeTestMultiTenantJSON-978786380-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b7114201-4fdf-4ef8-9269-68e47288e353" status: 404 len: 111 microversion: 2.1 time: 0.326299 Oct 23 01:42:34.277576 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3081/6068] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:42:33 2022] DELETE /compute/v2.1/servers/b7114201-4fdf-4ef8-9269-68e47288e353 => generated 111 bytes in 329 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 01:42:34.287717 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d251bb33-9e12-4ed8-83aa-789646601a77 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:42:34.288552 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d251bb33-9e12-4ed8-83aa-789646601a77 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] [instance: b7114201-4fdf-4ef8-9269-68e47288e353] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:34.296112 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d251bb33-9e12-4ed8-83aa-789646601a77 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:34.296856 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d251bb33-9e12-4ed8-83aa-789646601a77 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:34.297399 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d251bb33-9e12-4ed8-83aa-789646601a77 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:34.298717 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d251bb33-9e12-4ed8-83aa-789646601a77 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:34.299282 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d251bb33-9e12-4ed8-83aa-789646601a77 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:34.299833 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d251bb33-9e12-4ed8-83aa-789646601a77 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:34.457359 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d251bb33-9e12-4ed8-83aa-789646601a77 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b094df884baf43a0824d210dfe6e8d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459f3c837db4fcaafc0e4aaed1600e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:42:34.465745 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d251bb33-9e12-4ed8-83aa-789646601a77 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] 10.222.0.42 "GET /compute/v2.1/servers/b7114201-4fdf-4ef8-9269-68e47288e353" status: 200 len: 1527 microversion: 2.1 time: 0.183467 Oct 23 01:42:34.466596 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2988/6069] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:42:34 2022] GET /compute/v2.1/servers/b7114201-4fdf-4ef8-9269-68e47288e353 => generated 1527 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:42:34.498596 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c9fca16c-5ea9-4682-9437-c4eeb50bdc7a tempest-ServersNegativeTestMultiTenantJSON-978786380 tempest-ServersNegativeTestMultiTenantJSON-978786380-project] Action: 'update', calling method: >, body: {"server": {"name": "b7114201-4fdf-4ef8-9269-68e47288e353_new"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:42:34.500650 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c9fca16c-5ea9-4682-9437-c4eeb50bdc7a tempest-ServersNegativeTestMultiTenantJSON-978786380 tempest-ServersNegativeTestMultiTenantJSON-978786380-project] [instance: b7114201-4fdf-4ef8-9269-68e47288e353] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:34.507556 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c9fca16c-5ea9-4682-9437-c4eeb50bdc7a tempest-ServersNegativeTestMultiTenantJSON-978786380 tempest-ServersNegativeTestMultiTenantJSON-978786380-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:34.508156 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c9fca16c-5ea9-4682-9437-c4eeb50bdc7a tempest-ServersNegativeTestMultiTenantJSON-978786380 tempest-ServersNegativeTestMultiTenantJSON-978786380-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:34.508789 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c9fca16c-5ea9-4682-9437-c4eeb50bdc7a tempest-ServersNegativeTestMultiTenantJSON-978786380 tempest-ServersNegativeTestMultiTenantJSON-978786380-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:34.509705 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c9fca16c-5ea9-4682-9437-c4eeb50bdc7a tempest-ServersNegativeTestMultiTenantJSON-978786380 tempest-ServersNegativeTestMultiTenantJSON-978786380-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:34.510251 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c9fca16c-5ea9-4682-9437-c4eeb50bdc7a tempest-ServersNegativeTestMultiTenantJSON-978786380 tempest-ServersNegativeTestMultiTenantJSON-978786380-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:34.510692 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c9fca16c-5ea9-4682-9437-c4eeb50bdc7a tempest-ServersNegativeTestMultiTenantJSON-978786380 tempest-ServersNegativeTestMultiTenantJSON-978786380-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:34.526869 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-c9fca16c-5ea9-4682-9437-c4eeb50bdc7a tempest-ServersNegativeTestMultiTenantJSON-978786380 tempest-ServersNegativeTestMultiTenantJSON-978786380-project] HTTP exception thrown: Instance b7114201-4fdf-4ef8-9269-68e47288e353 could not be found. Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c9fca16c-5ea9-4682-9437-c4eeb50bdc7a tempest-ServersNegativeTestMultiTenantJSON-978786380 tempest-ServersNegativeTestMultiTenantJSON-978786380-project] Request method failure captured: Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: request: PUT /compute/v2.1/servers/b7114201-4fdf-4ef8-9269-68e47288e353 HTTP/1.1 Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 64 Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJv2bexn9pSI5CGaSMc31LnBByX4r_rRTtm1O_XWehbp45vbc5c7v4CKMYZcNMi99Ulk0a6onOsFidvHwg8V7j4pA3Of6Xo4lBHUvTiYLLesuAK4CBgg-tnkpcQdCH2NA6rZ2DCCCx1Z_o1obPkdUP0O464lg6GGW5-voISsUft7qK4 Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 6208791d12e94925923ed1a1a75bbd42 Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-978786380 Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6208791d12e94925923ed1a1a75bbd42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6208791d12e94925923ed1a1a75bbd42"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6208791d12e94925923ed1a1a75bbd42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6208791d12e94925923ed1a1a75bbd42"}]}] Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-978786380 Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 6208791d12e94925923ed1a1a75bbd42 Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-978786380 Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersNegativeTestMultiTenantJSON-978786380-project Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 10c2f508584f4c41bed50c0dd477fe02 Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-978786380-project Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: {"server": {"name": "b7114201-4fdf-4ef8-9269-68e47288e353_new"}} Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: exception: Instance b7114201-4fdf-4ef8-9269-68e47288e353 could not be found. Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'b7114201-4fdf-4ef8-9269-68e47288e353', 'body': {'server': {'name': 'b7114201-4fdf-4ef8-9269-68e47288e353_new'}}} Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7114201-4fdf-4ef8-9269-68e47288e353 could not be found. Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:42:34.531821 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 23 01:42:34.536182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 23 01:42:34.536182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 23 01:42:34.536182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:42:34.536182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:42:34.536182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:42:34.536182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:42:34.536182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7114201-4fdf-4ef8-9269-68e47288e353 could not be found. Oct 23 01:42:34.536182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:42:34.536182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:42:34.536182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:42:34.536182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:42:34.536182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:42:34.536182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:42:34.536182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:42:34.536182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:42:34.536182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7114201-4fdf-4ef8-9269-68e47288e353 could not be found. Oct 23 01:42:34.536182 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:42:34.536182 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c9fca16c-5ea9-4682-9437-c4eeb50bdc7a tempest-ServersNegativeTestMultiTenantJSON-978786380 tempest-ServersNegativeTestMultiTenantJSON-978786380-project] Returning 404 to user: Instance b7114201-4fdf-4ef8-9269-68e47288e353 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:42:34.540820 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c9fca16c-5ea9-4682-9437-c4eeb50bdc7a tempest-ServersNegativeTestMultiTenantJSON-978786380 tempest-ServersNegativeTestMultiTenantJSON-978786380-project] 10.222.0.42 "PUT /compute/v2.1/servers/b7114201-4fdf-4ef8-9269-68e47288e353" status: 404 len: 111 microversion: 2.1 time: 0.049549 Oct 23 01:42:34.540820 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3082/6070] 10.222.0.42 () {60 vars in 1256 bytes} [Sun Oct 23 01:42:34 2022] PUT /compute/v2.1/servers/b7114201-4fdf-4ef8-9269-68e47288e353 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:42:34.551327 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-66c72f2f-dd43-4e0a-965e-28e7d945993a tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:42:34.551925 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-66c72f2f-dd43-4e0a-965e-28e7d945993a tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] [instance: b7114201-4fdf-4ef8-9269-68e47288e353] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:34.561493 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-66c72f2f-dd43-4e0a-965e-28e7d945993a tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:34.562105 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-66c72f2f-dd43-4e0a-965e-28e7d945993a tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:34.562720 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-66c72f2f-dd43-4e0a-965e-28e7d945993a tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:34.563740 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-66c72f2f-dd43-4e0a-965e-28e7d945993a tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:34.564403 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-66c72f2f-dd43-4e0a-965e-28e7d945993a tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:34.565119 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-66c72f2f-dd43-4e0a-965e-28e7d945993a tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:34.600528 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-66c72f2f-dd43-4e0a-965e-28e7d945993a tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] [instance: b7114201-4fdf-4ef8-9269-68e47288e353] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:42:34.963299 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2a2645de-41db-423c-9645-01fb7f42abfb tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:42:34.963924 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2a2645de-41db-423c-9645-01fb7f42abfb tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 53409afc-6907-43b2-96e7-92536059a476] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:34.970052 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a2645de-41db-423c-9645-01fb7f42abfb tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:34.975197 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a2645de-41db-423c-9645-01fb7f42abfb tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:34.975197 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a2645de-41db-423c-9645-01fb7f42abfb tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:34.975197 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a2645de-41db-423c-9645-01fb7f42abfb tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:34.975197 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a2645de-41db-423c-9645-01fb7f42abfb tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:34.975197 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a2645de-41db-423c-9645-01fb7f42abfb tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:35.059321 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-66c72f2f-dd43-4e0a-965e-28e7d945993a tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b7114201-4fdf-4ef8-9269-68e47288e353" status: 204 len: 0 microversion: 2.1 time: 0.514069 Oct 23 01:42:35.060202 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2989/6071] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:42:34 2022] DELETE /compute/v2.1/servers/b7114201-4fdf-4ef8-9269-68e47288e353 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:42:35.071219 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bf081eb7-4824-4fa2-95a8-29fd6df9b8f0 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:42:35.072047 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-bf081eb7-4824-4fa2-95a8-29fd6df9b8f0 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] [instance: b7114201-4fdf-4ef8-9269-68e47288e353] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:35.078676 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bf081eb7-4824-4fa2-95a8-29fd6df9b8f0 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:35.079179 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bf081eb7-4824-4fa2-95a8-29fd6df9b8f0 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:35.080774 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bf081eb7-4824-4fa2-95a8-29fd6df9b8f0 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:35.081725 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bf081eb7-4824-4fa2-95a8-29fd6df9b8f0 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:35.082295 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bf081eb7-4824-4fa2-95a8-29fd6df9b8f0 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:35.082801 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bf081eb7-4824-4fa2-95a8-29fd6df9b8f0 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:35.205112 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2a2645de-41db-423c-9645-01fb7f42abfb tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:42:35.214424 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2a2645de-41db-423c-9645-01fb7f42abfb tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476" status: 200 len: 1696 microversion: 2.1 time: 0.255529 Oct 23 01:42:35.226932 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3083/6072] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:42:34 2022] GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476 => generated 1696 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:42:35.259359 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bf081eb7-4824-4fa2-95a8-29fd6df9b8f0 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b094df884baf43a0824d210dfe6e8d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459f3c837db4fcaafc0e4aaed1600e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:42:35.269895 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bf081eb7-4824-4fa2-95a8-29fd6df9b8f0 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] 10.222.0.42 "GET /compute/v2.1/servers/b7114201-4fdf-4ef8-9269-68e47288e353" status: 200 len: 1533 microversion: 2.1 time: 0.204347 Oct 23 01:42:35.270581 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2990/6073] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:42:35 2022] GET /compute/v2.1/servers/b7114201-4fdf-4ef8-9269-68e47288e353 => generated 1533 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:42:36.240576 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4a9f9e3d-6be1-4301-860f-4ee76d3da1b6 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:42:36.241379 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4a9f9e3d-6be1-4301-860f-4ee76d3da1b6 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 53409afc-6907-43b2-96e7-92536059a476] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:36.249031 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4a9f9e3d-6be1-4301-860f-4ee76d3da1b6 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:36.249513 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4a9f9e3d-6be1-4301-860f-4ee76d3da1b6 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:36.249960 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4a9f9e3d-6be1-4301-860f-4ee76d3da1b6 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:36.250689 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4a9f9e3d-6be1-4301-860f-4ee76d3da1b6 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:36.251149 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4a9f9e3d-6be1-4301-860f-4ee76d3da1b6 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:36.251580 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4a9f9e3d-6be1-4301-860f-4ee76d3da1b6 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:36.296649 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ed16e660-200a-49d0-90be-e2ea7abae084 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:42:36.297402 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ed16e660-200a-49d0-90be-e2ea7abae084 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] [instance: b7114201-4fdf-4ef8-9269-68e47288e353] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:36.308390 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ed16e660-200a-49d0-90be-e2ea7abae084 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:36.309269 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ed16e660-200a-49d0-90be-e2ea7abae084 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:36.309837 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ed16e660-200a-49d0-90be-e2ea7abae084 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:36.310647 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ed16e660-200a-49d0-90be-e2ea7abae084 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:36.311199 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ed16e660-200a-49d0-90be-e2ea7abae084 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:36.311689 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ed16e660-200a-49d0-90be-e2ea7abae084 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:36.944332 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4a9f9e3d-6be1-4301-860f-4ee76d3da1b6 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:42:36.977173 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ed16e660-200a-49d0-90be-e2ea7abae084 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b094df884baf43a0824d210dfe6e8d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459f3c837db4fcaafc0e4aaed1600e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:42:36.977298 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4a9f9e3d-6be1-4301-860f-4ee76d3da1b6 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476" status: 200 len: 1695 microversion: 2.1 time: 0.722567 Oct 23 01:42:36.977298 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3084/6074] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:42:36 2022] GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476 => generated 1695 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:42:36.995250 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ed16e660-200a-49d0-90be-e2ea7abae084 tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] 10.222.0.42 "GET /compute/v2.1/servers/b7114201-4fdf-4ef8-9269-68e47288e353" status: 200 len: 1533 microversion: 2.1 time: 0.702833 Oct 23 01:42:37.002652 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2991/6075] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:42:36 2022] GET /compute/v2.1/servers/b7114201-4fdf-4ef8-9269-68e47288e353 => generated 1533 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:42:37.088328 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-aa361e78-f1bc-477b-8b85-354b6a44004f req-ec97633e-a11a-401c-83f7-a81a31539df2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53409afc-6907-43b2-96e7-92536059a476", "name": "network-vif-unplugged", "status": "completed", "tag": "0c5af7a9-f38f-4c93-82d4-99a58fe2c63d"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:42:37.106331 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-aa361e78-f1bc-477b-8b85-354b6a44004f req-ec97633e-a11a-401c-83f7-a81a31539df2 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:37.106331 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-aa361e78-f1bc-477b-8b85-354b6a44004f req-ec97633e-a11a-401c-83f7-a81a31539df2 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:37.106331 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-aa361e78-f1bc-477b-8b85-354b6a44004f req-ec97633e-a11a-401c-83f7-a81a31539df2 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:37.115320 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-aa361e78-f1bc-477b-8b85-354b6a44004f req-ec97633e-a11a-401c-83f7-a81a31539df2 service nova] Creating event network-vif-unplugged:0c5af7a9-f38f-4c93-82d4-99a58fe2c63d for instance 53409afc-6907-43b2-96e7-92536059a476 on n-h1-master-1 Oct 23 01:42:37.122140 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [req-aa361e78-f1bc-477b-8b85-354b6a44004f req-ec97633e-a11a-401c-83f7-a81a31539df2 service nova] Instance 53409afc-6907-43b2-96e7-92536059a476 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120944) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 23 01:42:37.139778 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-aa361e78-f1bc-477b-8b85-354b6a44004f req-ec97633e-a11a-401c-83f7-a81a31539df2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060124 Oct 23 01:42:37.140387 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3085/6076] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:42:37.851012 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-e53d6034-9edc-4fb0-ae9a-218b29328777 req-a97f5e78-1685-468c-b3b2-df4804d58d55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7114201-4fdf-4ef8-9269-68e47288e353", "name": "network-vif-deleted", "tag": "3818f5ae-5f31-4b25-97b4-e86aefc2bce0"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:42:37.863653 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-e53d6034-9edc-4fb0-ae9a-218b29328777 req-a97f5e78-1685-468c-b3b2-df4804d58d55 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:37.864189 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-e53d6034-9edc-4fb0-ae9a-218b29328777 req-a97f5e78-1685-468c-b3b2-df4804d58d55 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:37.864725 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-e53d6034-9edc-4fb0-ae9a-218b29328777 req-a97f5e78-1685-468c-b3b2-df4804d58d55 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:37.885004 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-e53d6034-9edc-4fb0-ae9a-218b29328777 req-a97f5e78-1685-468c-b3b2-df4804d58d55 service nova] Creating event network-vif-deleted:3818f5ae-5f31-4b25-97b4-e86aefc2bce0 for instance b7114201-4fdf-4ef8-9269-68e47288e353 on n-h1-master-1 Oct 23 01:42:37.894274 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-e53d6034-9edc-4fb0-ae9a-218b29328777 req-a97f5e78-1685-468c-b3b2-df4804d58d55 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.402255 Oct 23 01:42:37.894946 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2992/6077] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:42:37.993008 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-59e18df6-5a55-47af-99ba-8a5f23b45029 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:42:37.993862 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-59e18df6-5a55-47af-99ba-8a5f23b45029 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 53409afc-6907-43b2-96e7-92536059a476] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:38.001141 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-59e18df6-5a55-47af-99ba-8a5f23b45029 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:38.001640 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-59e18df6-5a55-47af-99ba-8a5f23b45029 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:38.002543 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-59e18df6-5a55-47af-99ba-8a5f23b45029 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:38.003260 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-59e18df6-5a55-47af-99ba-8a5f23b45029 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:38.006679 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-59e18df6-5a55-47af-99ba-8a5f23b45029 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:38.007038 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-59e18df6-5a55-47af-99ba-8a5f23b45029 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:38.032456 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-048c9077-aff2-498a-9424-09672abe887c tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:42:38.033845 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-048c9077-aff2-498a-9424-09672abe887c tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] [instance: b7114201-4fdf-4ef8-9269-68e47288e353] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:38.061375 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-048c9077-aff2-498a-9424-09672abe887c tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:38.062161 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-048c9077-aff2-498a-9424-09672abe887c tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:38.062797 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-048c9077-aff2-498a-9424-09672abe887c tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:38.063722 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-048c9077-aff2-498a-9424-09672abe887c tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:38.064377 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-048c9077-aff2-498a-9424-09672abe887c tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:38.065001 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-048c9077-aff2-498a-9424-09672abe887c tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:38.126844 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-048c9077-aff2-498a-9424-09672abe887c tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:38.127596 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-048c9077-aff2-498a-9424-09672abe887c tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:38.128363 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-048c9077-aff2-498a-9424-09672abe887c tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:38.128972 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-048c9077-aff2-498a-9424-09672abe887c tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lazy-loading 'fault' on Instance uuid b7114201-4fdf-4ef8-9269-68e47288e353 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:42:38.252534 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-048c9077-aff2-498a-9424-09672abe887c tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b094df884baf43a0824d210dfe6e8d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459f3c837db4fcaafc0e4aaed1600e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:42:38.268357 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-048c9077-aff2-498a-9424-09672abe887c tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] 10.222.0.42 "GET /compute/v2.1/servers/b7114201-4fdf-4ef8-9269-68e47288e353" status: 200 len: 1316 microversion: 2.1 time: 0.244570 Oct 23 01:42:38.282238 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2993/6078] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:42:38 2022] GET /compute/v2.1/servers/b7114201-4fdf-4ef8-9269-68e47288e353 => generated 1316 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:42:38.348886 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-59e18df6-5a55-47af-99ba-8a5f23b45029 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:42:38.368144 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-59e18df6-5a55-47af-99ba-8a5f23b45029 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476" status: 200 len: 1695 microversion: 2.1 time: 0.379332 Oct 23 01:42:38.369053 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3086/6079] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:42:37 2022] GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476 => generated 1695 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:42:39.294337 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6d82bff9-1e85-4997-b0e4-52aaa43d04ff tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:42:39.294969 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6d82bff9-1e85-4997-b0e4-52aaa43d04ff tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] [instance: b7114201-4fdf-4ef8-9269-68e47288e353] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:39.309443 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6d82bff9-1e85-4997-b0e4-52aaa43d04ff tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:39.309829 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6d82bff9-1e85-4997-b0e4-52aaa43d04ff tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:39.310288 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6d82bff9-1e85-4997-b0e4-52aaa43d04ff tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:39.311237 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6d82bff9-1e85-4997-b0e4-52aaa43d04ff tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:39.311864 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6d82bff9-1e85-4997-b0e4-52aaa43d04ff tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:39.312458 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6d82bff9-1e85-4997-b0e4-52aaa43d04ff tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:39.339964 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-6d82bff9-1e85-4997-b0e4-52aaa43d04ff tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] HTTP exception thrown: Instance b7114201-4fdf-4ef8-9269-68e47288e353 could not be found. Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6d82bff9-1e85-4997-b0e4-52aaa43d04ff tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Request method failure captured: Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/b7114201-4fdf-4ef8-9269-68e47288e353 HTTP/1.1 Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJvr6zA2JQsxeALccsV0hfTKrp2IFuOdv8Ox5AS-bn3-mZn8RDa4LJpM6zfzgfnJU3cKNxDghN_6oujljUAFq8Uf8yiZiv9EuVxHkCsGDOHj7wBnr75VyCxi8abUjPsC9gvkpcEB0VFjDzn-dqVbd5QVWGfXKCjJYGT1hs0_pFLVJ58 Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 4459f3c837db4fcaafc0e4aaed1600e0 Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-2116238611 Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4459f3c837db4fcaafc0e4aaed1600e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4459f3c837db4fcaafc0e4aaed1600e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4459f3c837db4fcaafc0e4aaed1600e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4459f3c837db4fcaafc0e4aaed1600e0"}]}] Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-2116238611 Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 4459f3c837db4fcaafc0e4aaed1600e0 Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-2116238611 Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServersNegativeTestMultiTenantJSON-2116238611-project Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: b094df884baf43a0824d210dfe6e8d26 Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-2116238611-project Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: exception: Instance b7114201-4fdf-4ef8-9269-68e47288e353 could not be found. Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'b7114201-4fdf-4ef8-9269-68e47288e353'} Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7114201-4fdf-4ef8-9269-68e47288e353 could not be found. Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7114201-4fdf-4ef8-9269-68e47288e353 could not be found. Oct 23 01:42:39.342684 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:42:39.348159 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:42:39.348159 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:42:39.348159 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:42:39.348159 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:42:39.348159 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:42:39.348159 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:42:39.348159 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:42:39.348159 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7114201-4fdf-4ef8-9269-68e47288e353 could not be found. Oct 23 01:42:39.348159 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:42:39.358439 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6d82bff9-1e85-4997-b0e4-52aaa43d04ff tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] Returning 404 to user: Instance b7114201-4fdf-4ef8-9269-68e47288e353 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:42:39.359622 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6d82bff9-1e85-4997-b0e4-52aaa43d04ff tempest-ServersNegativeTestMultiTenantJSON-2116238611 tempest-ServersNegativeTestMultiTenantJSON-2116238611-project] 10.222.0.42 "GET /compute/v2.1/servers/b7114201-4fdf-4ef8-9269-68e47288e353" status: 404 len: 111 microversion: 2.1 time: 0.069466 Oct 23 01:42:39.360339 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2994/6080] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:42:39 2022] GET /compute/v2.1/servers/b7114201-4fdf-4ef8-9269-68e47288e353 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:42:39.393724 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-abf4f539-0cd7-4474-93ad-c11582c82c6c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:42:39.394529 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-abf4f539-0cd7-4474-93ad-c11582c82c6c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 53409afc-6907-43b2-96e7-92536059a476] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:39.402383 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-abf4f539-0cd7-4474-93ad-c11582c82c6c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:39.403186 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-abf4f539-0cd7-4474-93ad-c11582c82c6c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:39.403856 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-abf4f539-0cd7-4474-93ad-c11582c82c6c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:39.404778 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-abf4f539-0cd7-4474-93ad-c11582c82c6c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:39.405423 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-abf4f539-0cd7-4474-93ad-c11582c82c6c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:39.406339 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-abf4f539-0cd7-4474-93ad-c11582c82c6c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:39.467602 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-0f3eaa9a-94b1-47e0-898b-2d44eac7743e req-d581e0d6-7730-4e01-a17f-43e7023cbc3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53409afc-6907-43b2-96e7-92536059a476", "tag": "0c5af7a9-f38f-4c93-82d4-99a58fe2c63d"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:42:39.484551 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-0f3eaa9a-94b1-47e0-898b-2d44eac7743e req-d581e0d6-7730-4e01-a17f-43e7023cbc3d service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:39.485520 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-0f3eaa9a-94b1-47e0-898b-2d44eac7743e req-d581e0d6-7730-4e01-a17f-43e7023cbc3d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:39.486473 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-0f3eaa9a-94b1-47e0-898b-2d44eac7743e req-d581e0d6-7730-4e01-a17f-43e7023cbc3d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:39.502321 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-0f3eaa9a-94b1-47e0-898b-2d44eac7743e req-d581e0d6-7730-4e01-a17f-43e7023cbc3d service nova] Creating event network-changed:0c5af7a9-f38f-4c93-82d4-99a58fe2c63d for instance 53409afc-6907-43b2-96e7-92536059a476 on n-h1-master-1 Oct 23 01:42:39.512672 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [req-0f3eaa9a-94b1-47e0-898b-2d44eac7743e req-d581e0d6-7730-4e01-a17f-43e7023cbc3d service nova] Instance 53409afc-6907-43b2-96e7-92536059a476 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120945) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 23 01:42:39.529351 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-0f3eaa9a-94b1-47e0-898b-2d44eac7743e req-d581e0d6-7730-4e01-a17f-43e7023cbc3d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068298 Oct 23 01:42:39.530447 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2995/6081] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:42:39.899828 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-abf4f539-0cd7-4474-93ad-c11582c82c6c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:42:39.910541 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-abf4f539-0cd7-4474-93ad-c11582c82c6c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476" status: 200 len: 1695 microversion: 2.1 time: 0.522045 Oct 23 01:42:39.930009 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3087/6082] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:42:39 2022] GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476 => generated 1695 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:42:40.946777 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0205921a-411f-49b5-9516-4dcf80cc902b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:42:40.947491 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0205921a-411f-49b5-9516-4dcf80cc902b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 53409afc-6907-43b2-96e7-92536059a476] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:40.968299 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0205921a-411f-49b5-9516-4dcf80cc902b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:40.973324 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0205921a-411f-49b5-9516-4dcf80cc902b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:40.977144 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0205921a-411f-49b5-9516-4dcf80cc902b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:40.979891 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0205921a-411f-49b5-9516-4dcf80cc902b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:40.982002 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0205921a-411f-49b5-9516-4dcf80cc902b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:40.982863 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0205921a-411f-49b5-9516-4dcf80cc902b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:41.276256 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0205921a-411f-49b5-9516-4dcf80cc902b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:42:41.287524 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0205921a-411f-49b5-9516-4dcf80cc902b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476" status: 200 len: 1693 microversion: 2.1 time: 0.343838 Oct 23 01:42:41.303762 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2996/6083] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:42:40 2022] GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476 => generated 1693 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:42:42.311855 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fd244687-918c-41e5-bf8d-3aa0f0e1a057 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:42:42.313107 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fd244687-918c-41e5-bf8d-3aa0f0e1a057 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 53409afc-6907-43b2-96e7-92536059a476] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:42.316192 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:42.336277 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fd244687-918c-41e5-bf8d-3aa0f0e1a057 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:42.338597 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fd244687-918c-41e5-bf8d-3aa0f0e1a057 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:42.338920 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fd244687-918c-41e5-bf8d-3aa0f0e1a057 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:42.341520 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fd244687-918c-41e5-bf8d-3aa0f0e1a057 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:42.354860 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fd244687-918c-41e5-bf8d-3aa0f0e1a057 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:42.359002 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fd244687-918c-41e5-bf8d-3aa0f0e1a057 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:42.794610 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fd244687-918c-41e5-bf8d-3aa0f0e1a057 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:42:42.819851 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fd244687-918c-41e5-bf8d-3aa0f0e1a057 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476" status: 200 len: 1690 microversion: 2.1 time: 0.511985 Oct 23 01:42:42.830415 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3088/6084] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:42:42 2022] GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476 => generated 1690 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:42:42.849469 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bd313c8c-7c28-403c-84f8-872c0bd78450 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:42:42.850252 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-bd313c8c-7c28-403c-84f8-872c0bd78450 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 53409afc-6907-43b2-96e7-92536059a476] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:42.853017 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:42.874488 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd313c8c-7c28-403c-84f8-872c0bd78450 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:42.878051 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd313c8c-7c28-403c-84f8-872c0bd78450 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:42.879782 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd313c8c-7c28-403c-84f8-872c0bd78450 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:42.881333 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd313c8c-7c28-403c-84f8-872c0bd78450 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:42.885217 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd313c8c-7c28-403c-84f8-872c0bd78450 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:42.890724 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd313c8c-7c28-403c-84f8-872c0bd78450 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:43.275343 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bd313c8c-7c28-403c-84f8-872c0bd78450 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "POST /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476/action" status: 204 len: 0 microversion: 2.1 time: 0.430451 Oct 23 01:42:43.276401 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2997/6085] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:42:42 2022] POST /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476/action => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:42:43.284729 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cc1db7ab-fc27-4af4-8473-2935c74ba732 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:42:43.285273 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-cc1db7ab-fc27-4af4-8473-2935c74ba732 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 53409afc-6907-43b2-96e7-92536059a476] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:43.296574 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cc1db7ab-fc27-4af4-8473-2935c74ba732 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:43.297085 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cc1db7ab-fc27-4af4-8473-2935c74ba732 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:43.297584 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cc1db7ab-fc27-4af4-8473-2935c74ba732 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:43.308125 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cc1db7ab-fc27-4af4-8473-2935c74ba732 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:43.309241 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cc1db7ab-fc27-4af4-8473-2935c74ba732 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:43.309964 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cc1db7ab-fc27-4af4-8473-2935c74ba732 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:43.636991 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cc1db7ab-fc27-4af4-8473-2935c74ba732 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:42:43.648049 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cc1db7ab-fc27-4af4-8473-2935c74ba732 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476" status: 200 len: 1690 microversion: 2.1 time: 0.367242 Oct 23 01:42:43.649139 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3089/6086] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:42:43 2022] GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476 => generated 1690 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:42:44.674302 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f93d4528-542b-4a3d-9227-20002f11c5e5 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:42:44.675205 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f93d4528-542b-4a3d-9227-20002f11c5e5 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 53409afc-6907-43b2-96e7-92536059a476] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:44.690814 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f93d4528-542b-4a3d-9227-20002f11c5e5 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:44.691332 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f93d4528-542b-4a3d-9227-20002f11c5e5 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:44.691831 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f93d4528-542b-4a3d-9227-20002f11c5e5 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:44.692544 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f93d4528-542b-4a3d-9227-20002f11c5e5 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:44.693530 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f93d4528-542b-4a3d-9227-20002f11c5e5 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:44.693951 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f93d4528-542b-4a3d-9227-20002f11c5e5 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:45.511757 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f93d4528-542b-4a3d-9227-20002f11c5e5 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:42:45.522739 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f93d4528-542b-4a3d-9227-20002f11c5e5 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476" status: 200 len: 1690 microversion: 2.1 time: 0.853902 Oct 23 01:42:45.523551 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2998/6087] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:42:44 2022] GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476 => generated 1690 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:42:46.360545 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-dba90d03-dd4f-497d-b3d2-3310ffd856a3 req-8d6ed9e8-4ea0-4153-9be3-c39e4e5cf992 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53409afc-6907-43b2-96e7-92536059a476", "name": "network-vif-plugged", "status": "completed", "tag": "0c5af7a9-f38f-4c93-82d4-99a58fe2c63d"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:42:46.379456 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-dba90d03-dd4f-497d-b3d2-3310ffd856a3 req-8d6ed9e8-4ea0-4153-9be3-c39e4e5cf992 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:46.379951 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-dba90d03-dd4f-497d-b3d2-3310ffd856a3 req-8d6ed9e8-4ea0-4153-9be3-c39e4e5cf992 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:46.380390 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-dba90d03-dd4f-497d-b3d2-3310ffd856a3 req-8d6ed9e8-4ea0-4153-9be3-c39e4e5cf992 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:46.406978 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-dba90d03-dd4f-497d-b3d2-3310ffd856a3 req-8d6ed9e8-4ea0-4153-9be3-c39e4e5cf992 service nova] Creating event network-vif-plugged:0c5af7a9-f38f-4c93-82d4-99a58fe2c63d for instance 53409afc-6907-43b2-96e7-92536059a476 on n-h1-master-1 Oct 23 01:42:46.414135 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-dba90d03-dd4f-497d-b3d2-3310ffd856a3 req-8d6ed9e8-4ea0-4153-9be3-c39e4e5cf992 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058205 Oct 23 01:42:46.415147 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3090/6088] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:42:46.548780 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-66b7037b-831e-40bb-bfda-2ccf7db5c821 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:42:46.549216 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-66b7037b-831e-40bb-bfda-2ccf7db5c821 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 53409afc-6907-43b2-96e7-92536059a476] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:46.579459 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-66b7037b-831e-40bb-bfda-2ccf7db5c821 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:46.579960 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-66b7037b-831e-40bb-bfda-2ccf7db5c821 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:46.580408 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-66b7037b-831e-40bb-bfda-2ccf7db5c821 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:46.581125 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-66b7037b-831e-40bb-bfda-2ccf7db5c821 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:46.581767 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-66b7037b-831e-40bb-bfda-2ccf7db5c821 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:46.588911 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-66b7037b-831e-40bb-bfda-2ccf7db5c821 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:46.822954 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-66b7037b-831e-40bb-bfda-2ccf7db5c821 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:42:46.835022 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-66b7037b-831e-40bb-bfda-2ccf7db5c821 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476" status: 200 len: 1682 microversion: 2.1 time: 0.291966 Oct 23 01:42:46.836993 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 2999/6089] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:42:46 2022] GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476 => generated 1682 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:42:49.343623 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-67310e9d-6369-4cad-8025-69a4b23d52c8 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:42:49.344412 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-67310e9d-6369-4cad-8025-69a4b23d52c8 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:49.358127 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-67310e9d-6369-4cad-8025-69a4b23d52c8 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:49.358127 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-67310e9d-6369-4cad-8025-69a4b23d52c8 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:49.358127 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-67310e9d-6369-4cad-8025-69a4b23d52c8 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:49.358127 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-67310e9d-6369-4cad-8025-69a4b23d52c8 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:49.358127 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-67310e9d-6369-4cad-8025-69a4b23d52c8 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:49.358127 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-67310e9d-6369-4cad-8025-69a4b23d52c8 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:49.717118 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-67310e9d-6369-4cad-8025-69a4b23d52c8 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:42:49.731506 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-67310e9d-6369-4cad-8025-69a4b23d52c8 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:42:49.733868 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-67310e9d-6369-4cad-8025-69a4b23d52c8 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:42:49.738550 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-67310e9d-6369-4cad-8025-69a4b23d52c8 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 2941 microversion: 2.32 time: 0.403756 Oct 23 01:42:49.741009 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3091/6090] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:42:49 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 2941 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:42:49.769816 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-250f06db-905d-4e25-8167-453dec321a46 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:42:49.771588 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-250f06db-905d-4e25-8167-453dec321a46 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:42:49.778519 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-250f06db-905d-4e25-8167-453dec321a46 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:49.779244 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-250f06db-905d-4e25-8167-453dec321a46 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:49.779862 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-250f06db-905d-4e25-8167-453dec321a46 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:49.780582 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-250f06db-905d-4e25-8167-453dec321a46 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:42:49.781084 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-250f06db-905d-4e25-8167-453dec321a46 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:42:49.781511 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-250f06db-905d-4e25-8167-453dec321a46 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:42:49.951360 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-250f06db-905d-4e25-8167-453dec321a46 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21/os-interface" status: 200 len: 1828 microversion: 2.32 time: 0.185935 Oct 23 01:42:49.954979 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3000/6091] 10.222.0.42 () {60 vars in 1316 bytes} [Sun Oct 23 01:42:49 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21/os-interface => generated 1828 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:42:55.853469 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5021c322-c8d9-45a8-9c80-150c7135d6e5 tempest-ComputeTenantNetworksTest-1637264263 tempest-ComputeTenantNetworksTest-1637264263-project] Calling method '.version_select at 0x7f5cc0f89a60>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:42:56.031325 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5021c322-c8d9-45a8-9c80-150c7135d6e5 tempest-ComputeTenantNetworksTest-1637264263 tempest-ComputeTenantNetworksTest-1637264263-project] 10.222.0.42 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.357151 Oct 23 01:42:56.033242 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3092/6092] 10.222.0.42 () {58 vars in 1158 bytes} [Sun Oct 23 01:42:55 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:42:56.047641 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-60a8dbeb-0260-4971-b9da-0ba060603e40 tempest-ComputeTenantNetworksTest-1637264263 tempest-ComputeTenantNetworksTest-1637264263-project] Calling method '.version_select at 0x7f5cc1812790>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:42:56.178531 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-60a8dbeb-0260-4971-b9da-0ba060603e40 tempest-ComputeTenantNetworksTest-1637264263 tempest-ComputeTenantNetworksTest-1637264263-project] 10.222.0.42 "GET /compute/v2.1/os-tenant-networks/b9799650-efea-4657-9e71-d63b6b2e82b2" status: 200 len: 140 microversion: 2.1 time: 0.128992 Oct 23 01:42:56.178531 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3001/6093] 10.222.0.42 () {58 vars in 1269 bytes} [Sun Oct 23 01:42:56 2022] GET /compute/v2.1/os-tenant-networks/b9799650-efea-4657-9e71-d63b6b2e82b2 => generated 140 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:43:09.037810 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=7 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:09.037810 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=62 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:09.041594 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-671f757b-b078-4440-aa09-24c60b32bc7a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:43:09.046338 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-671f757b-b078-4440-aa09-24c60b32bc7a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 53409afc-6907-43b2-96e7-92536059a476] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:43:09.055905 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-671f757b-b078-4440-aa09-24c60b32bc7a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:43:09.056641 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-671f757b-b078-4440-aa09-24c60b32bc7a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:43:09.057285 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-671f757b-b078-4440-aa09-24c60b32bc7a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:43:09.058250 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-671f757b-b078-4440-aa09-24c60b32bc7a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:43:09.058879 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-671f757b-b078-4440-aa09-24c60b32bc7a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:43:09.059481 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-671f757b-b078-4440-aa09-24c60b32bc7a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:43:09.153263 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-671f757b-b078-4440-aa09-24c60b32bc7a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "POST /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476/action" status: 200 len: 24574 microversion: 2.1 time: 0.118103 Oct 23 01:43:09.153863 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3093/6094] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:43:09 2022] POST /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476/action => generated 24574 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:43:15.532877 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=7 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:15.533571 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:15.537741 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-988c6bca-be9a-430e-b0ce-778b8a096cb1 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:43:15.538391 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-988c6bca-be9a-430e-b0ce-778b8a096cb1 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] [instance: 53409afc-6907-43b2-96e7-92536059a476] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:43:15.545669 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-988c6bca-be9a-430e-b0ce-778b8a096cb1 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:43:15.546195 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-988c6bca-be9a-430e-b0ce-778b8a096cb1 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:43:15.546629 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-988c6bca-be9a-430e-b0ce-778b8a096cb1 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:43:15.547311 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-988c6bca-be9a-430e-b0ce-778b8a096cb1 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:43:15.547761 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-988c6bca-be9a-430e-b0ce-778b8a096cb1 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:43:15.548265 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-988c6bca-be9a-430e-b0ce-778b8a096cb1 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:43:15.688039 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-988c6bca-be9a-430e-b0ce-778b8a096cb1 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476" status: 200 len: 1833 microversion: 2.1 time: 0.157215 Oct 23 01:43:15.688671 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3002/6095] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:43:15 2022] GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476 => generated 1833 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:43:16.878119 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-86b578e9-b773-4a75-a6ce-61e214cf0c4d tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:43:16.887769 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-76597808-7e12-470d-b23a-a39f44c6ac5f req-64ec69b4-d210-4866-ba35-24999cbf1918 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53409afc-6907-43b2-96e7-92536059a476", "tag": "0c5af7a9-f38f-4c93-82d4-99a58fe2c63d"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:43:16.890977 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-86b578e9-b773-4a75-a6ce-61e214cf0c4d tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 53409afc-6907-43b2-96e7-92536059a476] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:43:16.908665 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-86b578e9-b773-4a75-a6ce-61e214cf0c4d tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:43:16.909124 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-86b578e9-b773-4a75-a6ce-61e214cf0c4d tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:43:16.909639 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-86b578e9-b773-4a75-a6ce-61e214cf0c4d tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:43:16.910383 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-86b578e9-b773-4a75-a6ce-61e214cf0c4d tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:43:16.910848 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-86b578e9-b773-4a75-a6ce-61e214cf0c4d tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:43:16.911281 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-86b578e9-b773-4a75-a6ce-61e214cf0c4d tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:43:16.917572 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-76597808-7e12-470d-b23a-a39f44c6ac5f req-64ec69b4-d210-4866-ba35-24999cbf1918 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:43:16.918358 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-76597808-7e12-470d-b23a-a39f44c6ac5f req-64ec69b4-d210-4866-ba35-24999cbf1918 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:43:16.918779 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-76597808-7e12-470d-b23a-a39f44c6ac5f req-64ec69b4-d210-4866-ba35-24999cbf1918 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:43:16.935231 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-76597808-7e12-470d-b23a-a39f44c6ac5f req-64ec69b4-d210-4866-ba35-24999cbf1918 service nova] Creating event network-changed:0c5af7a9-f38f-4c93-82d4-99a58fe2c63d for instance 53409afc-6907-43b2-96e7-92536059a476 on n-h1-master-1 Oct 23 01:43:16.951769 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-76597808-7e12-470d-b23a-a39f44c6ac5f req-64ec69b4-d210-4866-ba35-24999cbf1918 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071033 Oct 23 01:43:16.955754 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3003/6096] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:43:16.975821 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-86b578e9-b773-4a75-a6ce-61e214cf0c4d tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 53409afc-6907-43b2-96e7-92536059a476] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:43:17.591178 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-86b578e9-b773-4a75-a6ce-61e214cf0c4d tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "DELETE /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476" status: 204 len: 0 microversion: 2.1 time: 0.716751 Oct 23 01:43:17.591864 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3094/6097] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:43:16 2022] DELETE /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476 => generated 0 bytes in 719 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:43:17.608161 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-572dc46c-a7f7-4a83-bbe2-83ab7c1df6dc tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:43:17.608883 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-572dc46c-a7f7-4a83-bbe2-83ab7c1df6dc tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 53409afc-6907-43b2-96e7-92536059a476] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:43:17.618035 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-572dc46c-a7f7-4a83-bbe2-83ab7c1df6dc tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:43:17.618533 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-572dc46c-a7f7-4a83-bbe2-83ab7c1df6dc tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:43:17.618976 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-572dc46c-a7f7-4a83-bbe2-83ab7c1df6dc tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:43:17.619695 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-572dc46c-a7f7-4a83-bbe2-83ab7c1df6dc tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:43:17.620152 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-572dc46c-a7f7-4a83-bbe2-83ab7c1df6dc tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:43:17.620583 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-572dc46c-a7f7-4a83-bbe2-83ab7c1df6dc tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:43:17.885288 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-572dc46c-a7f7-4a83-bbe2-83ab7c1df6dc tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:43:17.899004 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-572dc46c-a7f7-4a83-bbe2-83ab7c1df6dc tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476" status: 200 len: 1688 microversion: 2.1 time: 0.297031 Oct 23 01:43:17.902283 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3004/6098] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:43:17 2022] GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476 => generated 1688 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:43:18.926210 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-68887055-de46-4524-aefe-10f62ed9e4e4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:43:18.926853 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-68887055-de46-4524-aefe-10f62ed9e4e4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 53409afc-6907-43b2-96e7-92536059a476] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:43:18.935435 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68887055-de46-4524-aefe-10f62ed9e4e4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:43:18.936113 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68887055-de46-4524-aefe-10f62ed9e4e4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:43:18.936559 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68887055-de46-4524-aefe-10f62ed9e4e4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:43:18.937326 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68887055-de46-4524-aefe-10f62ed9e4e4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:43:18.938029 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68887055-de46-4524-aefe-10f62ed9e4e4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:43:18.938428 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68887055-de46-4524-aefe-10f62ed9e4e4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:43:19.149289 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-68887055-de46-4524-aefe-10f62ed9e4e4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:43:19.164528 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-68887055-de46-4524-aefe-10f62ed9e4e4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476" status: 200 len: 1688 microversion: 2.1 time: 0.243002 Oct 23 01:43:19.182003 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3095/6099] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:43:18 2022] GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476 => generated 1688 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:43:20.195491 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-78158544-f167-453c-be3d-a16279351b32 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:43:20.196126 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-78158544-f167-453c-be3d-a16279351b32 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 53409afc-6907-43b2-96e7-92536059a476] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:43:20.207055 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-78158544-f167-453c-be3d-a16279351b32 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:43:20.207055 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-78158544-f167-453c-be3d-a16279351b32 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:43:20.207055 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-78158544-f167-453c-be3d-a16279351b32 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:43:20.207055 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-78158544-f167-453c-be3d-a16279351b32 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:43:20.207583 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-78158544-f167-453c-be3d-a16279351b32 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:43:20.208097 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-78158544-f167-453c-be3d-a16279351b32 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:43:20.290953 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-78158544-f167-453c-be3d-a16279351b32 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:43:20.296270 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-78158544-f167-453c-be3d-a16279351b32 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476" status: 200 len: 1503 microversion: 2.1 time: 0.109855 Oct 23 01:43:20.297087 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3096/6100] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:43:20 2022] GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476 => generated 1503 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:43:20.610581 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-a577c7f2-f49e-459d-8b87-ee3eec6b1a43 req-9aba8e13-7d76-4ce4-8dad-db695da740a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53409afc-6907-43b2-96e7-92536059a476", "name": "network-vif-deleted", "tag": "0c5af7a9-f38f-4c93-82d4-99a58fe2c63d"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:43:20.621589 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-a577c7f2-f49e-459d-8b87-ee3eec6b1a43 req-9aba8e13-7d76-4ce4-8dad-db695da740a5 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:43:20.622105 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-a577c7f2-f49e-459d-8b87-ee3eec6b1a43 req-9aba8e13-7d76-4ce4-8dad-db695da740a5 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:43:20.622763 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-a577c7f2-f49e-459d-8b87-ee3eec6b1a43 req-9aba8e13-7d76-4ce4-8dad-db695da740a5 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:43:20.636465 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-a577c7f2-f49e-459d-8b87-ee3eec6b1a43 req-9aba8e13-7d76-4ce4-8dad-db695da740a5 service nova] Creating event network-vif-deleted:0c5af7a9-f38f-4c93-82d4-99a58fe2c63d for instance 53409afc-6907-43b2-96e7-92536059a476 on n-h1-master-1 Oct 23 01:43:20.641881 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-a577c7f2-f49e-459d-8b87-ee3eec6b1a43 req-9aba8e13-7d76-4ce4-8dad-db695da740a5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.681696 Oct 23 01:43:20.643149 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3005/6101] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:43:21.320501 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-86b72f0b-ff73-4363-821f-edcad8775d26 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:43:21.321139 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-86b72f0b-ff73-4363-821f-edcad8775d26 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 53409afc-6907-43b2-96e7-92536059a476] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:43:21.334853 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-86b72f0b-ff73-4363-821f-edcad8775d26 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:43:21.335263 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-86b72f0b-ff73-4363-821f-edcad8775d26 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:43:21.335723 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-86b72f0b-ff73-4363-821f-edcad8775d26 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:43:21.339706 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-86b72f0b-ff73-4363-821f-edcad8775d26 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:43:21.340294 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-86b72f0b-ff73-4363-821f-edcad8775d26 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:43:21.340617 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-86b72f0b-ff73-4363-821f-edcad8775d26 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:43:21.390569 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-86b72f0b-ff73-4363-821f-edcad8775d26 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:43:21.391158 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-86b72f0b-ff73-4363-821f-edcad8775d26 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:43:21.391799 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-86b72f0b-ff73-4363-821f-edcad8775d26 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:43:21.392613 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-86b72f0b-ff73-4363-821f-edcad8775d26 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lazy-loading 'fault' on Instance uuid 53409afc-6907-43b2-96e7-92536059a476 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:43:21.442091 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-86b72f0b-ff73-4363-821f-edcad8775d26 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:43:21.450460 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-86b72f0b-ff73-4363-821f-edcad8775d26 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476" status: 200 len: 1357 microversion: 2.1 time: 0.135105 Oct 23 01:43:21.451278 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3097/6102] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:43:21 2022] GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476 => generated 1357 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:43:22.475450 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-763e8e17-d28d-420e-a55a-62a4334aaf23 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:43:22.476763 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-763e8e17-d28d-420e-a55a-62a4334aaf23 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 53409afc-6907-43b2-96e7-92536059a476] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:43:22.484426 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-763e8e17-d28d-420e-a55a-62a4334aaf23 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:43:22.484805 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-763e8e17-d28d-420e-a55a-62a4334aaf23 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:43:22.485245 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-763e8e17-d28d-420e-a55a-62a4334aaf23 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:43:22.486081 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-763e8e17-d28d-420e-a55a-62a4334aaf23 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:43:22.486546 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-763e8e17-d28d-420e-a55a-62a4334aaf23 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:43:22.486974 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-763e8e17-d28d-420e-a55a-62a4334aaf23 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:43:22.503946 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-763e8e17-d28d-420e-a55a-62a4334aaf23 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] HTTP exception thrown: Instance 53409afc-6907-43b2-96e7-92536059a476 could not be found. Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-763e8e17-d28d-420e-a55a-62a4334aaf23 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Request method failure captured: Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476 HTTP/1.1 Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJup1TkLYyR4X_VSgIMIuQv0hYOz5hZ00J3cGF_2O4wHY26fogeH_hyoq33KQnC7sGTAyVlSot7AI095PrC5yb0EkSKzvICR_X35mdfKcclD_xEhLj-4l-9yI3Uz12kHgYqfGCiZb_uaRrbVi38t5LJjIbY00U1LXQx5VmGP9DMKFZ0 Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 0c7f734a12da437e806e4c791d27d615 Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-878522496 Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/0c7f734a12da437e806e4c791d27d615"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_0c7f734a12da437e806e4c791d27d615"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0c7f734a12da437e806e4c791d27d615"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0c7f734a12da437e806e4c791d27d615"}]}] Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-TestNetworkAdvancedServerOps-878522496 Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 0c7f734a12da437e806e4c791d27d615 Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-878522496 Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-TestNetworkAdvancedServerOps-878522496-project Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 037ed342980a4de9a2dfc8d576293aba Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-TestNetworkAdvancedServerOps-878522496-project Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 53409afc-6907-43b2-96e7-92536059a476 could not be found. Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '53409afc-6907-43b2-96e7-92536059a476'} Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53409afc-6907-43b2-96e7-92536059a476 could not be found. Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53409afc-6907-43b2-96e7-92536059a476 could not be found. Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:43:22.506106 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:43:22.510547 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:43:22.510547 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:43:22.510547 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:43:22.510547 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:43:22.510547 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:43:22.510547 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:43:22.510547 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53409afc-6907-43b2-96e7-92536059a476 could not be found. Oct 23 01:43:22.510547 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:43:22.512307 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-763e8e17-d28d-420e-a55a-62a4334aaf23 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Returning 404 to user: Instance 53409afc-6907-43b2-96e7-92536059a476 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:43:22.513334 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-763e8e17-d28d-420e-a55a-62a4334aaf23 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476" status: 404 len: 111 microversion: 2.1 time: 0.042634 Oct 23 01:43:22.514074 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3006/6103] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:43:22 2022] GET /compute/v2.1/servers/53409afc-6907-43b2-96e7-92536059a476 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:43:28.121128 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3c1fff23-82b1-4006-a475-0c6cbb0b5d3d tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '.version_select at 0x7f5cc0f895e0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:43:28.311150 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3c1fff23-82b1-4006-a475-0c6cbb0b5d3d tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1414212698" status: 202 len: 0 microversion: 2.1 time: 0.194731 Oct 23 01:43:28.311965 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3098/6104] 10.222.0.42 () {58 vars in 1284 bytes} [Sun Oct 23 01:43:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1414212698 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:43:28.351347 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-08675630-f057-48a7-a764-987c00649dfe tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Action: 'create', calling method: .version_select at 0x7f5cc222e700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1350726475", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+AFkU0yWGoZ7S+zs6I87w+osZVyhffJReihbfc9VIh2dYe58pGK94WtR0+9aRvBvoZ9G0rvNrTFh0geBKwFVY70UsFslbbOJb1kEIbac3sWB6HUlmklCfSjrRodqSikQ=="}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:43:28.375265 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-08675630-f057-48a7-a764-987c00649dfe tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Getting quotas for project 0c7f734a12da437e806e4c791d27d615. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:43:28.394958 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-08675630-f057-48a7-a764-987c00649dfe tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Getting quotas for user 037ed342980a4de9a2dfc8d576293aba and project 0c7f734a12da437e806e4c791d27d615. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:43:28.550706 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-08675630-f057-48a7-a764-987c00649dfe tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.206281 Oct 23 01:43:28.551311 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3007/6105] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 01:43:28 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:43:40.833055 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fb35e318-c220-4e53-b008-6b3685e8f582 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1705687320", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "d8e370f3-426c-4198-87ee-94570e2e9bb1"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1350726475", "security_groups": [{"name": "tempest-secgroup-smoke-1493772270"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:43:40.926241 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:40.928897 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:41.099094 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-fb35e318-c220-4e53-b008-6b3685e8f582 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] validate_networks() for [('d8e370f3-426c-4198-87ee-94570e2e9bb1', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:43:42.088644 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-fb35e318-c220-4e53-b008-6b3685e8f582 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:43:42.089228 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-fb35e318-c220-4e53-b008-6b3685e8f582 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:43:42.089548 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-fb35e318-c220-4e53-b008-6b3685e8f582 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:43:42.090255 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-fb35e318-c220-4e53-b008-6b3685e8f582 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:43:42.092817 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-fb35e318-c220-4e53-b008-6b3685e8f582 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:43:42.105105 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb35e318-c220-4e53-b008-6b3685e8f582 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:43:42.105604 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb35e318-c220-4e53-b008-6b3685e8f582 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:43:42.106301 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb35e318-c220-4e53-b008-6b3685e8f582 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:43:42.107041 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb35e318-c220-4e53-b008-6b3685e8f582 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:43:42.107510 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb35e318-c220-4e53-b008-6b3685e8f582 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:43:42.107986 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb35e318-c220-4e53-b008-6b3685e8f582 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:43:42.130012 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-fb35e318-c220-4e53-b008-6b3685e8f582 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Getting quotas for project 0c7f734a12da437e806e4c791d27d615. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:43:42.136551 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-fb35e318-c220-4e53-b008-6b3685e8f582 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Getting quotas for user 037ed342980a4de9a2dfc8d576293aba and project 0c7f734a12da437e806e4c791d27d615. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:43:42.151026 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fb35e318-c220-4e53-b008-6b3685e8f582 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:43:42.153734 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fb35e318-c220-4e53-b008-6b3685e8f582 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:43:42.292323 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fb35e318-c220-4e53-b008-6b3685e8f582 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.463808 Oct 23 01:43:42.293950 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3099/6106] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:43:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 1467 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:43:42.303421 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=18 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:42.304672 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=4 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:42.305503 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:42.310154 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-97400250-7a5a-4d34-85c3-ad21b83487cd tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:43:42.312624 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-97400250-7a5a-4d34-85c3-ad21b83487cd tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:43:42.496040 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-97400250-7a5a-4d34-85c3-ad21b83487cd tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:43:42.506167 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-97400250-7a5a-4d34-85c3-ad21b83487cd tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1267 microversion: 2.1 time: 0.204801 Oct 23 01:43:42.510060 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3008/6107] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:43:42 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1267 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:43:43.534287 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-643b3a3b-4438-4ca9-ab2e-5e291d9735ec tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:43:43.534912 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-643b3a3b-4438-4ca9-ab2e-5e291d9735ec tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:43:43.652637 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-643b3a3b-4438-4ca9-ab2e-5e291d9735ec tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:43:43.669567 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-643b3a3b-4438-4ca9-ab2e-5e291d9735ec tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1267 microversion: 2.1 time: 0.141807 Oct 23 01:43:43.695550 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3100/6108] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:43:43 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:43:44.704176 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8a507821-22e8-4519-945d-39e586105888 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:43:44.704800 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8a507821-22e8-4519-945d-39e586105888 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:43:44.728383 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a507821-22e8-4519-945d-39e586105888 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:43:44.728942 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a507821-22e8-4519-945d-39e586105888 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:43:44.729396 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a507821-22e8-4519-945d-39e586105888 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:43:44.730170 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a507821-22e8-4519-945d-39e586105888 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:43:44.730644 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a507821-22e8-4519-945d-39e586105888 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:43:44.731078 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a507821-22e8-4519-945d-39e586105888 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:43:44.809285 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8a507821-22e8-4519-945d-39e586105888 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:43:44.819891 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8a507821-22e8-4519-945d-39e586105888 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1319 microversion: 2.1 time: 0.119433 Oct 23 01:43:44.820992 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3009/6109] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:43:44 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1319 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:43:45.845426 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e09949dd-76fd-4261-8d04-39ca8b574f56 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:43:45.849924 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e09949dd-76fd-4261-8d04-39ca8b574f56 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:43:45.869285 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e09949dd-76fd-4261-8d04-39ca8b574f56 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:43:45.869882 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e09949dd-76fd-4261-8d04-39ca8b574f56 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:43:45.873133 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e09949dd-76fd-4261-8d04-39ca8b574f56 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:43:45.873931 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e09949dd-76fd-4261-8d04-39ca8b574f56 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:43:45.874452 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e09949dd-76fd-4261-8d04-39ca8b574f56 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:43:45.874894 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e09949dd-76fd-4261-8d04-39ca8b574f56 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:43:46.005187 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e09949dd-76fd-4261-8d04-39ca8b574f56 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:43:46.015922 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e09949dd-76fd-4261-8d04-39ca8b574f56 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1337 microversion: 2.1 time: 0.174760 Oct 23 01:43:46.016874 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3101/6110] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:43:45 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1337 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:43:47.054275 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a3f8622b-f9a6-4933-b471-ec8b534ae955 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:43:47.055638 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a3f8622b-f9a6-4933-b471-ec8b534ae955 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:43:47.070956 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a3f8622b-f9a6-4933-b471-ec8b534ae955 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:43:47.071975 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a3f8622b-f9a6-4933-b471-ec8b534ae955 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:43:47.072657 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a3f8622b-f9a6-4933-b471-ec8b534ae955 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:43:47.073727 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a3f8622b-f9a6-4933-b471-ec8b534ae955 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:43:47.074503 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a3f8622b-f9a6-4933-b471-ec8b534ae955 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:43:47.075188 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a3f8622b-f9a6-4933-b471-ec8b534ae955 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:43:47.311225 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a3f8622b-f9a6-4933-b471-ec8b534ae955 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:43:47.338499 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a3f8622b-f9a6-4933-b471-ec8b534ae955 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1393 microversion: 2.1 time: 0.290041 Oct 23 01:43:47.355772 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3010/6111] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:43:47 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1393 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:43:48.368092 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bd4e6480-fcfd-42a3-bfa3-7a37afdb2cee tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:43:48.369351 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bd4e6480-fcfd-42a3-bfa3-7a37afdb2cee tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:43:48.380037 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bd4e6480-fcfd-42a3-bfa3-7a37afdb2cee tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:43:48.380911 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bd4e6480-fcfd-42a3-bfa3-7a37afdb2cee tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:43:48.381583 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bd4e6480-fcfd-42a3-bfa3-7a37afdb2cee tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:43:48.383405 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bd4e6480-fcfd-42a3-bfa3-7a37afdb2cee tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:43:48.384052 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bd4e6480-fcfd-42a3-bfa3-7a37afdb2cee tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:43:48.384685 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bd4e6480-fcfd-42a3-bfa3-7a37afdb2cee tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:43:48.517356 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-2e1b3ea1-6f42-4890-b465-cc4cc8ece1aa req-9cbaddf7-289e-48ad-a8cb-18aef31539e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ebee1b1-ea00-4a5a-8da7-f2520e296848", "tag": "c4e81e83-9fd2-4b8a-bdd8-c2f017a9b1bd"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:43:48.530884 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-2e1b3ea1-6f42-4890-b465-cc4cc8ece1aa req-9cbaddf7-289e-48ad-a8cb-18aef31539e2 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:43:48.547519 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-2e1b3ea1-6f42-4890-b465-cc4cc8ece1aa req-9cbaddf7-289e-48ad-a8cb-18aef31539e2 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:43:48.550553 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-2e1b3ea1-6f42-4890-b465-cc4cc8ece1aa req-9cbaddf7-289e-48ad-a8cb-18aef31539e2 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:43:48.585360 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-2e1b3ea1-6f42-4890-b465-cc4cc8ece1aa req-9cbaddf7-289e-48ad-a8cb-18aef31539e2 service nova] Creating event network-changed:c4e81e83-9fd2-4b8a-bdd8-c2f017a9b1bd for instance 7ebee1b1-ea00-4a5a-8da7-f2520e296848 on n-h1-master-1 Oct 23 01:43:48.592086 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-2e1b3ea1-6f42-4890-b465-cc4cc8ece1aa req-9cbaddf7-289e-48ad-a8cb-18aef31539e2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078923 Oct 23 01:43:48.595772 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3011/6112] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:43:48.660800 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bd4e6480-fcfd-42a3-bfa3-7a37afdb2cee tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:43:48.669270 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bd4e6480-fcfd-42a3-bfa3-7a37afdb2cee tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1393 microversion: 2.1 time: 0.306079 Oct 23 01:43:48.674663 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3102/6113] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:43:48 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1393 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:43:49.694249 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-10451bc8-1e15-4bd3-b1e3-2b85896df9ad tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:43:49.695769 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-10451bc8-1e15-4bd3-b1e3-2b85896df9ad tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:43:49.703921 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10451bc8-1e15-4bd3-b1e3-2b85896df9ad tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:43:49.704660 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10451bc8-1e15-4bd3-b1e3-2b85896df9ad tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:43:49.705798 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10451bc8-1e15-4bd3-b1e3-2b85896df9ad tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:43:49.707212 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10451bc8-1e15-4bd3-b1e3-2b85896df9ad tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:43:49.707851 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10451bc8-1e15-4bd3-b1e3-2b85896df9ad tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:43:49.708452 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10451bc8-1e15-4bd3-b1e3-2b85896df9ad tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:43:49.937863 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-10451bc8-1e15-4bd3-b1e3-2b85896df9ad tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:43:49.947262 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-10451bc8-1e15-4bd3-b1e3-2b85896df9ad tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1393 microversion: 2.1 time: 0.258778 Oct 23 01:43:49.947902 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3012/6114] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:43:49 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1393 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:43:50.971544 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-27d6d7a8-3de3-410f-b864-89bfd0a1e9f7 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:43:50.972215 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-27d6d7a8-3de3-410f-b864-89bfd0a1e9f7 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:43:50.979853 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-27d6d7a8-3de3-410f-b864-89bfd0a1e9f7 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:43:50.980547 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-27d6d7a8-3de3-410f-b864-89bfd0a1e9f7 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:43:50.980999 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-27d6d7a8-3de3-410f-b864-89bfd0a1e9f7 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:43:50.981906 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-27d6d7a8-3de3-410f-b864-89bfd0a1e9f7 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:43:50.982458 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-27d6d7a8-3de3-410f-b864-89bfd0a1e9f7 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:43:50.982895 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-27d6d7a8-3de3-410f-b864-89bfd0a1e9f7 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:43:51.148034 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-27d6d7a8-3de3-410f-b864-89bfd0a1e9f7 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:43:51.179284 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-27d6d7a8-3de3-410f-b864-89bfd0a1e9f7 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1393 microversion: 2.1 time: 0.199831 Oct 23 01:43:51.179284 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3103/6115] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:43:50 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1393 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:43:52.192967 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-56a1eebe-fad5-467b-ab8c-2094aa9f48c8 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:43:52.193584 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-56a1eebe-fad5-467b-ab8c-2094aa9f48c8 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:43:52.206899 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-56a1eebe-fad5-467b-ab8c-2094aa9f48c8 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:43:52.207389 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-56a1eebe-fad5-467b-ab8c-2094aa9f48c8 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:43:52.207828 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-56a1eebe-fad5-467b-ab8c-2094aa9f48c8 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:43:52.211867 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-56a1eebe-fad5-467b-ab8c-2094aa9f48c8 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:43:52.212568 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-56a1eebe-fad5-467b-ab8c-2094aa9f48c8 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:43:52.213203 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-56a1eebe-fad5-467b-ab8c-2094aa9f48c8 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:43:52.489052 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-56a1eebe-fad5-467b-ab8c-2094aa9f48c8 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:43:52.498765 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-56a1eebe-fad5-467b-ab8c-2094aa9f48c8 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1393 microversion: 2.1 time: 0.309188 Oct 23 01:43:52.503702 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3013/6116] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:43:52 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1393 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:43:53.536254 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f80671e3-81f4-44e0-b24b-5305e3691d49 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:43:53.537298 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f80671e3-81f4-44e0-b24b-5305e3691d49 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:43:53.540098 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:53.545540 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f80671e3-81f4-44e0-b24b-5305e3691d49 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:43:53.546064 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f80671e3-81f4-44e0-b24b-5305e3691d49 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:43:53.546508 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f80671e3-81f4-44e0-b24b-5305e3691d49 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:43:53.547214 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f80671e3-81f4-44e0-b24b-5305e3691d49 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:43:53.547672 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f80671e3-81f4-44e0-b24b-5305e3691d49 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:43:53.548105 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f80671e3-81f4-44e0-b24b-5305e3691d49 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:43:53.674595 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=8 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:53.725060 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f80671e3-81f4-44e0-b24b-5305e3691d49 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:43:53.735835 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f80671e3-81f4-44e0-b24b-5305e3691d49 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1393 microversion: 2.1 time: 0.204291 Oct 23 01:43:53.761175 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3104/6117] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:43:53 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1393 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:43:54.766655 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ff28727e-6769-45bd-b754-94dcce6336b9 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:43:54.771805 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ff28727e-6769-45bd-b754-94dcce6336b9 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:43:54.790675 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:54.793519 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ff28727e-6769-45bd-b754-94dcce6336b9 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:43:54.795545 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ff28727e-6769-45bd-b754-94dcce6336b9 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:43:54.795998 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ff28727e-6769-45bd-b754-94dcce6336b9 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:43:54.796743 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ff28727e-6769-45bd-b754-94dcce6336b9 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:43:54.800503 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ff28727e-6769-45bd-b754-94dcce6336b9 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:43:54.802217 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ff28727e-6769-45bd-b754-94dcce6336b9 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:43:54.919225 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-83e8a94a-b731-4dbb-bb62-65218b430070 req-b05dd7e7-c666-46d4-8a31-3967d197cd3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ebee1b1-ea00-4a5a-8da7-f2520e296848", "name": "network-vif-plugged", "status": "completed", "tag": "c4e81e83-9fd2-4b8a-bdd8-c2f017a9b1bd"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:43:54.954380 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-83e8a94a-b731-4dbb-bb62-65218b430070 req-b05dd7e7-c666-46d4-8a31-3967d197cd3f service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:43:54.954636 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-83e8a94a-b731-4dbb-bb62-65218b430070 req-b05dd7e7-c666-46d4-8a31-3967d197cd3f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:43:54.957419 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-83e8a94a-b731-4dbb-bb62-65218b430070 req-b05dd7e7-c666-46d4-8a31-3967d197cd3f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:43:54.998568 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-83e8a94a-b731-4dbb-bb62-65218b430070 req-b05dd7e7-c666-46d4-8a31-3967d197cd3f service nova] Creating event network-vif-plugged:c4e81e83-9fd2-4b8a-bdd8-c2f017a9b1bd for instance 7ebee1b1-ea00-4a5a-8da7-f2520e296848 on n-h1-master-1 Oct 23 01:43:55.011639 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ff28727e-6769-45bd-b754-94dcce6336b9 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:43:55.018370 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-83e8a94a-b731-4dbb-bb62-65218b430070 req-b05dd7e7-c666-46d4-8a31-3967d197cd3f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102745 Oct 23 01:43:55.018370 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3105/6118] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:43:55.039373 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ff28727e-6769-45bd-b754-94dcce6336b9 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1393 microversion: 2.1 time: 0.276746 Oct 23 01:43:55.043268 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3014/6119] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:43:54 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1393 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:43:56.067488 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d1de57db-0840-4eaa-9e63-a10d149da566 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:43:56.068281 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d1de57db-0840-4eaa-9e63-a10d149da566 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:43:56.076394 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d1de57db-0840-4eaa-9e63-a10d149da566 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:43:56.076918 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d1de57db-0840-4eaa-9e63-a10d149da566 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:43:56.077485 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d1de57db-0840-4eaa-9e63-a10d149da566 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:43:56.078297 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d1de57db-0840-4eaa-9e63-a10d149da566 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:43:56.078834 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d1de57db-0840-4eaa-9e63-a10d149da566 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:43:56.079334 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d1de57db-0840-4eaa-9e63-a10d149da566 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:43:56.223675 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d1de57db-0840-4eaa-9e63-a10d149da566 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:43:56.231570 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d1de57db-0840-4eaa-9e63-a10d149da566 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1393 microversion: 2.1 time: 0.169530 Oct 23 01:43:56.232137 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3106/6120] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:43:56 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1393 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:43:57.254882 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-69d7124a-a563-4449-8dcc-c6dd142ad880 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:43:57.258105 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-69d7124a-a563-4449-8dcc-c6dd142ad880 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:43:57.263845 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-69d7124a-a563-4449-8dcc-c6dd142ad880 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:43:57.264494 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-69d7124a-a563-4449-8dcc-c6dd142ad880 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:43:57.265238 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-69d7124a-a563-4449-8dcc-c6dd142ad880 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:43:57.266250 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-69d7124a-a563-4449-8dcc-c6dd142ad880 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:43:57.267057 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-69d7124a-a563-4449-8dcc-c6dd142ad880 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:43:57.268257 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-69d7124a-a563-4449-8dcc-c6dd142ad880 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:43:57.552997 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-69d7124a-a563-4449-8dcc-c6dd142ad880 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:43:57.567066 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-69d7124a-a563-4449-8dcc-c6dd142ad880 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1565 microversion: 2.1 time: 0.316391 Oct 23 01:43:57.570555 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3015/6121] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:43:57 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1565 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:43:57.596774 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c7480612-bb42-4dcf-9730-0538019be15c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:43:57.598671 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c7480612-bb42-4dcf-9730-0538019be15c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:43:57.609575 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c7480612-bb42-4dcf-9730-0538019be15c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:43:57.610979 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c7480612-bb42-4dcf-9730-0538019be15c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:43:57.612864 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c7480612-bb42-4dcf-9730-0538019be15c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:43:57.614297 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c7480612-bb42-4dcf-9730-0538019be15c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:43:57.614945 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c7480612-bb42-4dcf-9730-0538019be15c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:43:57.615615 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c7480612-bb42-4dcf-9730-0538019be15c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:43:57.792763 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c7480612-bb42-4dcf-9730-0538019be15c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:43:57.804550 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c7480612-bb42-4dcf-9730-0538019be15c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1565 microversion: 2.1 time: 0.213323 Oct 23 01:43:57.806081 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3107/6122] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:43:57 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1565 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:44:01.159407 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-19771ace-aafe-4b9b-856d-0ae7adbbc619 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:44:01.160663 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-19771ace-aafe-4b9b-856d-0ae7adbbc619 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:01.169109 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-feb93e5a-dc58-4a57-8486-0874e54de756 req-a63e97df-337e-430b-87ac-02ad1c3fc9af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ebee1b1-ea00-4a5a-8da7-f2520e296848", "tag": "c4e81e83-9fd2-4b8a-bdd8-c2f017a9b1bd"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:44:01.180441 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-19771ace-aafe-4b9b-856d-0ae7adbbc619 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:01.182354 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-19771ace-aafe-4b9b-856d-0ae7adbbc619 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:01.183761 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-19771ace-aafe-4b9b-856d-0ae7adbbc619 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:01.191867 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-feb93e5a-dc58-4a57-8486-0874e54de756 req-a63e97df-337e-430b-87ac-02ad1c3fc9af service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:01.197987 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-feb93e5a-dc58-4a57-8486-0874e54de756 req-a63e97df-337e-430b-87ac-02ad1c3fc9af service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:01.198452 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-19771ace-aafe-4b9b-856d-0ae7adbbc619 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:01.199023 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-feb93e5a-dc58-4a57-8486-0874e54de756 req-a63e97df-337e-430b-87ac-02ad1c3fc9af service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:01.202700 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-19771ace-aafe-4b9b-856d-0ae7adbbc619 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:01.203704 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-19771ace-aafe-4b9b-856d-0ae7adbbc619 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:01.231962 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-feb93e5a-dc58-4a57-8486-0874e54de756 req-a63e97df-337e-430b-87ac-02ad1c3fc9af service nova] Creating event network-changed:c4e81e83-9fd2-4b8a-bdd8-c2f017a9b1bd for instance 7ebee1b1-ea00-4a5a-8da7-f2520e296848 on n-h1-master-1 Oct 23 01:44:01.237988 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-feb93e5a-dc58-4a57-8486-0874e54de756 req-a63e97df-337e-430b-87ac-02ad1c3fc9af service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072746 Oct 23 01:44:01.238903 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3108/6123] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:44:01.488249 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-19771ace-aafe-4b9b-856d-0ae7adbbc619 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:01.506308 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-19771ace-aafe-4b9b-856d-0ae7adbbc619 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1565 microversion: 2.1 time: 0.351800 Oct 23 01:44:01.507556 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3016/6124] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:44:01 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1565 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:44:22.133946 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7dfdcc02-32fd-4dc9-ad13-cc986d17b33f tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:44:22.136492 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7dfdcc02-32fd-4dc9-ad13-cc986d17b33f tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:22.140220 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:22.140943 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=42 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:22.146815 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7dfdcc02-32fd-4dc9-ad13-cc986d17b33f tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:22.147342 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7dfdcc02-32fd-4dc9-ad13-cc986d17b33f tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:22.147742 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7dfdcc02-32fd-4dc9-ad13-cc986d17b33f tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:22.148459 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7dfdcc02-32fd-4dc9-ad13-cc986d17b33f tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:22.148931 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7dfdcc02-32fd-4dc9-ad13-cc986d17b33f tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:22.149355 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7dfdcc02-32fd-4dc9-ad13-cc986d17b33f tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:22.226711 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7dfdcc02-32fd-4dc9-ad13-cc986d17b33f tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "POST /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848/action" status: 200 len: 24574 microversion: 2.1 time: 0.096680 Oct 23 01:44:22.227596 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3109/6125] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:44:22 2022] POST /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848/action => generated 24574 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:44:30.307611 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fb3d44a0-e089-4594-965d-b831787e4b2e tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1474953828", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "a97c4616-6100-44a1-a188-6648685b4781"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:44:30.316267 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=20 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:30.316929 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=44 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:30.364199 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-fb3d44a0-e089-4594-965d-b831787e4b2e tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] validate_networks() for [('a97c4616-6100-44a1-a188-6648685b4781', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:44:30.817667 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-fb3d44a0-e089-4594-965d-b831787e4b2e tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:44:30.820387 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-fb3d44a0-e089-4594-965d-b831787e4b2e tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:44:30.820387 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-fb3d44a0-e089-4594-965d-b831787e4b2e tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:44:30.820387 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-fb3d44a0-e089-4594-965d-b831787e4b2e tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:44:30.820387 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-fb3d44a0-e089-4594-965d-b831787e4b2e tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:44:30.830351 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fb3d44a0-e089-4594-965d-b831787e4b2e tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:30.830836 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fb3d44a0-e089-4594-965d-b831787e4b2e tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:30.831332 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fb3d44a0-e089-4594-965d-b831787e4b2e tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:30.832056 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fb3d44a0-e089-4594-965d-b831787e4b2e tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:30.832572 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fb3d44a0-e089-4594-965d-b831787e4b2e tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:30.832989 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fb3d44a0-e089-4594-965d-b831787e4b2e tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:30.850601 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-fb3d44a0-e089-4594-965d-b831787e4b2e tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Getting quotas for project 3c6377f05e21462b8a374170ec06a211. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:44:30.857187 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-fb3d44a0-e089-4594-965d-b831787e4b2e tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Getting quotas for user b2985f6e7b7c4e91ac80db47d1f2dff4 and project 3c6377f05e21462b8a374170ec06a211. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:44:30.871326 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-fb3d44a0-e089-4594-965d-b831787e4b2e tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:44:30.874014 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-fb3d44a0-e089-4594-965d-b831787e4b2e tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] [instance: cfbb11ae-1650-4257-a543-ca43743048e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:44:30.984285 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fb3d44a0-e089-4594-965d-b831787e4b2e tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.680717 Oct 23 01:44:30.985034 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3017/6126] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:44:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:44:30.997495 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fdd13917-8919-41bd-8bff-3774e3989a40 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:44:30.998546 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fdd13917-8919-41bd-8bff-3774e3989a40 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] [instance: cfbb11ae-1650-4257-a543-ca43743048e4] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:31.093685 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fdd13917-8919-41bd-8bff-3774e3989a40 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2985f6e7b7c4e91ac80db47d1f2dff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6377f05e21462b8a374170ec06a211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:31.112869 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fdd13917-8919-41bd-8bff-3774e3989a40 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbb11ae-1650-4257-a543-ca43743048e4" status: 200 len: 1214 microversion: 2.1 time: 0.115822 Oct 23 01:44:31.114095 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3110/6127] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:44:30 2022] GET /compute/v2.1/servers/cfbb11ae-1650-4257-a543-ca43743048e4 => generated 1214 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:44:32.137115 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-80f30760-d76b-47c0-9a59-3979ebecba8d tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:44:32.137889 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-80f30760-d76b-47c0-9a59-3979ebecba8d tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] [instance: cfbb11ae-1650-4257-a543-ca43743048e4] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:32.228803 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-80f30760-d76b-47c0-9a59-3979ebecba8d tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2985f6e7b7c4e91ac80db47d1f2dff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6377f05e21462b8a374170ec06a211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:32.234547 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-80f30760-d76b-47c0-9a59-3979ebecba8d tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbb11ae-1650-4257-a543-ca43743048e4" status: 200 len: 1214 microversion: 2.1 time: 0.101172 Oct 23 01:44:32.235442 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3018/6128] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:44:32 2022] GET /compute/v2.1/servers/cfbb11ae-1650-4257-a543-ca43743048e4 => generated 1214 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:44:33.124706 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c0977707-1a29-4f4c-9bbf-d198f6f08c85 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:44:33.125330 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c0977707-1a29-4f4c-9bbf-d198f6f08c85 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:33.140730 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c0977707-1a29-4f4c-9bbf-d198f6f08c85 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:33.140730 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c0977707-1a29-4f4c-9bbf-d198f6f08c85 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:33.140730 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c0977707-1a29-4f4c-9bbf-d198f6f08c85 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:33.140730 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c0977707-1a29-4f4c-9bbf-d198f6f08c85 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:33.140730 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c0977707-1a29-4f4c-9bbf-d198f6f08c85 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:33.140730 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c0977707-1a29-4f4c-9bbf-d198f6f08c85 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:33.256835 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a9c76174-3e79-4f12-bfba-7ddd34d37ce2 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:44:33.257957 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a9c76174-3e79-4f12-bfba-7ddd34d37ce2 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] [instance: cfbb11ae-1650-4257-a543-ca43743048e4] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:33.267993 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c0977707-1a29-4f4c-9bbf-d198f6f08c85 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1834 microversion: 2.1 time: 0.147130 Oct 23 01:44:33.268575 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3111/6129] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:44:33 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1834 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:44:33.292856 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8301ddb8-7c71-43c3-8581-f7423606e890 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:44:33.293816 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8301ddb8-7c71-43c3-8581-f7423606e890 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:33.300643 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8301ddb8-7c71-43c3-8581-f7423606e890 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:33.301084 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8301ddb8-7c71-43c3-8581-f7423606e890 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:33.301636 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8301ddb8-7c71-43c3-8581-f7423606e890 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:33.302490 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8301ddb8-7c71-43c3-8581-f7423606e890 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:33.302959 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8301ddb8-7c71-43c3-8581-f7423606e890 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:33.303393 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8301ddb8-7c71-43c3-8581-f7423606e890 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:33.314932 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a9c76174-3e79-4f12-bfba-7ddd34d37ce2 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2985f6e7b7c4e91ac80db47d1f2dff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6377f05e21462b8a374170ec06a211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:33.324299 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a9c76174-3e79-4f12-bfba-7ddd34d37ce2 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbb11ae-1650-4257-a543-ca43743048e4" status: 200 len: 1214 microversion: 2.1 time: 0.070702 Oct 23 01:44:33.324898 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3019/6130] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:44:33 2022] GET /compute/v2.1/servers/cfbb11ae-1650-4257-a543-ca43743048e4 => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:44:33.459812 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8301ddb8-7c71-43c3-8581-f7423606e890 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:33.468275 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8301ddb8-7c71-43c3-8581-f7423606e890 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1683 microversion: 2.1 time: 0.179569 Oct 23 01:44:33.469471 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3112/6131] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:44:33 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1683 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:44:33.631808 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f723c2a9-20bf-4ee9-b169-09370ab05778 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:44:33.633638 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f723c2a9-20bf-4ee9-b169-09370ab05778 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:33.641254 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f723c2a9-20bf-4ee9-b169-09370ab05778 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:33.643325 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f723c2a9-20bf-4ee9-b169-09370ab05778 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:33.644012 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f723c2a9-20bf-4ee9-b169-09370ab05778 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:33.644942 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f723c2a9-20bf-4ee9-b169-09370ab05778 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:33.645631 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f723c2a9-20bf-4ee9-b169-09370ab05778 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:33.646335 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f723c2a9-20bf-4ee9-b169-09370ab05778 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:33.728999 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f723c2a9-20bf-4ee9-b169-09370ab05778 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "POST /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848/action" status: 200 len: 32648 microversion: 2.1 time: 0.101637 Oct 23 01:44:33.729926 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3020/6132] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:44:33 2022] POST /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848/action => generated 32648 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:44:33.912618 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-99733b7f-47fa-42b2-985c-5d3de2ef6cfd tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:44:33.913210 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-99733b7f-47fa-42b2-985c-5d3de2ef6cfd tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:33.920667 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-99733b7f-47fa-42b2-985c-5d3de2ef6cfd tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:33.921176 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-99733b7f-47fa-42b2-985c-5d3de2ef6cfd tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:33.921606 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-99733b7f-47fa-42b2-985c-5d3de2ef6cfd tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:33.922342 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-99733b7f-47fa-42b2-985c-5d3de2ef6cfd tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:33.923521 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-99733b7f-47fa-42b2-985c-5d3de2ef6cfd tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:33.927974 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-99733b7f-47fa-42b2-985c-5d3de2ef6cfd tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:34.035678 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-99733b7f-47fa-42b2-985c-5d3de2ef6cfd tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'd72ce81cad3c4014b4071ed5660e0ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a93c06024b4898ba981e02f9874d43', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:34.040034 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-99733b7f-47fa-42b2-985c-5d3de2ef6cfd tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] flavor_id is None. Assuming migration. {{(pid=120944) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 23 01:44:34.040034 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-99733b7f-47fa-42b2-985c-5d3de2ef6cfd tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120944) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 23 01:44:34.348857 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8368e22c-637a-4b37-a59d-9981501cb538 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:44:34.349832 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8368e22c-637a-4b37-a59d-9981501cb538 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] [instance: cfbb11ae-1650-4257-a543-ca43743048e4] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:34.409845 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8368e22c-637a-4b37-a59d-9981501cb538 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2985f6e7b7c4e91ac80db47d1f2dff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6377f05e21462b8a374170ec06a211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:34.417928 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8368e22c-637a-4b37-a59d-9981501cb538 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbb11ae-1650-4257-a543-ca43743048e4" status: 200 len: 1214 microversion: 2.1 time: 0.073766 Oct 23 01:44:34.418810 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3021/6133] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:44:34 2022] GET /compute/v2.1/servers/cfbb11ae-1650-4257-a543-ca43743048e4 => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:44:34.505220 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-99733b7f-47fa-42b2-985c-5d3de2ef6cfd tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848/action" status: 202 len: 0 microversion: 2.1 time: 0.596523 Oct 23 01:44:34.506028 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3113/6134] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:44:33 2022] POST /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848/action => generated 0 bytes in 598 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:44:34.514515 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2e182b8f-b2e7-4243-97d1-75ae570a31db tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:44:34.515144 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2e182b8f-b2e7-4243-97d1-75ae570a31db tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:34.523194 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2e182b8f-b2e7-4243-97d1-75ae570a31db tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:34.523683 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2e182b8f-b2e7-4243-97d1-75ae570a31db tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:34.535664 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2e182b8f-b2e7-4243-97d1-75ae570a31db tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:34.535664 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2e182b8f-b2e7-4243-97d1-75ae570a31db tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:34.535664 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2e182b8f-b2e7-4243-97d1-75ae570a31db tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:34.535664 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2e182b8f-b2e7-4243-97d1-75ae570a31db tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:34.680498 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2e182b8f-b2e7-4243-97d1-75ae570a31db tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:34.689423 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2e182b8f-b2e7-4243-97d1-75ae570a31db tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1692 microversion: 2.1 time: 0.178870 Oct 23 01:44:34.690034 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3022/6135] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:44:34 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1692 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:44:35.442662 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-20204c8d-7505-489c-be36-7ead175b0fc8 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:44:35.443374 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-20204c8d-7505-489c-be36-7ead175b0fc8 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] [instance: cfbb11ae-1650-4257-a543-ca43743048e4] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:35.456821 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20204c8d-7505-489c-be36-7ead175b0fc8 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:35.458614 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20204c8d-7505-489c-be36-7ead175b0fc8 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:35.459184 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20204c8d-7505-489c-be36-7ead175b0fc8 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:35.470768 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20204c8d-7505-489c-be36-7ead175b0fc8 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:35.471275 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20204c8d-7505-489c-be36-7ead175b0fc8 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:35.471854 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20204c8d-7505-489c-be36-7ead175b0fc8 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:35.560757 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-20204c8d-7505-489c-be36-7ead175b0fc8 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2985f6e7b7c4e91ac80db47d1f2dff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6377f05e21462b8a374170ec06a211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:35.569927 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-20204c8d-7505-489c-be36-7ead175b0fc8 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbb11ae-1650-4257-a543-ca43743048e4" status: 200 len: 1266 microversion: 2.1 time: 0.132804 Oct 23 01:44:35.570528 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3114/6136] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:44:35 2022] GET /compute/v2.1/servers/cfbb11ae-1650-4257-a543-ca43743048e4 => generated 1266 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:44:35.714178 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e4c19418-3b14-4a3e-b3fe-75224e66ddaa tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:44:35.714701 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e4c19418-3b14-4a3e-b3fe-75224e66ddaa tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:35.724509 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e4c19418-3b14-4a3e-b3fe-75224e66ddaa tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:35.725001 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e4c19418-3b14-4a3e-b3fe-75224e66ddaa tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:35.726782 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e4c19418-3b14-4a3e-b3fe-75224e66ddaa tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:35.727703 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e4c19418-3b14-4a3e-b3fe-75224e66ddaa tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:35.728481 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e4c19418-3b14-4a3e-b3fe-75224e66ddaa tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:35.729076 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e4c19418-3b14-4a3e-b3fe-75224e66ddaa tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:35.898410 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e4c19418-3b14-4a3e-b3fe-75224e66ddaa tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:35.907527 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e4c19418-3b14-4a3e-b3fe-75224e66ddaa tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1692 microversion: 2.1 time: 0.197097 Oct 23 01:44:35.908394 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3023/6137] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:44:35 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1692 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:44:36.598072 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e655a0a5-3188-49a0-8bc8-a41d60b3bfe2 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:44:36.599744 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e655a0a5-3188-49a0-8bc8-a41d60b3bfe2 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] [instance: cfbb11ae-1650-4257-a543-ca43743048e4] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:36.618823 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e655a0a5-3188-49a0-8bc8-a41d60b3bfe2 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:36.621813 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e655a0a5-3188-49a0-8bc8-a41d60b3bfe2 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:36.624017 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e655a0a5-3188-49a0-8bc8-a41d60b3bfe2 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:36.627004 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e655a0a5-3188-49a0-8bc8-a41d60b3bfe2 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:36.629103 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e655a0a5-3188-49a0-8bc8-a41d60b3bfe2 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:36.629872 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e655a0a5-3188-49a0-8bc8-a41d60b3bfe2 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:36.716335 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e655a0a5-3188-49a0-8bc8-a41d60b3bfe2 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2985f6e7b7c4e91ac80db47d1f2dff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6377f05e21462b8a374170ec06a211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:36.725694 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e655a0a5-3188-49a0-8bc8-a41d60b3bfe2 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbb11ae-1650-4257-a543-ca43743048e4" status: 200 len: 1274 microversion: 2.1 time: 0.134213 Oct 23 01:44:36.726333 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3115/6138] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:44:36 2022] GET /compute/v2.1/servers/cfbb11ae-1650-4257-a543-ca43743048e4 => generated 1274 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:44:36.932794 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-44d0eaf5-2e25-4a95-94fd-7cc1b0115b65 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:44:36.933458 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-44d0eaf5-2e25-4a95-94fd-7cc1b0115b65 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:36.941276 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44d0eaf5-2e25-4a95-94fd-7cc1b0115b65 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:36.941769 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44d0eaf5-2e25-4a95-94fd-7cc1b0115b65 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:36.942268 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44d0eaf5-2e25-4a95-94fd-7cc1b0115b65 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:36.943014 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44d0eaf5-2e25-4a95-94fd-7cc1b0115b65 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:36.943518 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44d0eaf5-2e25-4a95-94fd-7cc1b0115b65 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:36.943996 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44d0eaf5-2e25-4a95-94fd-7cc1b0115b65 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:37.191244 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-44d0eaf5-2e25-4a95-94fd-7cc1b0115b65 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:37.201135 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-44d0eaf5-2e25-4a95-94fd-7cc1b0115b65 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1692 microversion: 2.1 time: 0.272822 Oct 23 01:44:37.204277 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3024/6139] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:44:36 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1692 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:44:37.752942 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6b07d1f8-4c36-4018-83eb-74d0c7b47a05 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:44:37.753712 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6b07d1f8-4c36-4018-83eb-74d0c7b47a05 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] [instance: cfbb11ae-1650-4257-a543-ca43743048e4] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:37.760744 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b07d1f8-4c36-4018-83eb-74d0c7b47a05 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:37.767367 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b07d1f8-4c36-4018-83eb-74d0c7b47a05 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:37.767367 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b07d1f8-4c36-4018-83eb-74d0c7b47a05 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:37.767367 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b07d1f8-4c36-4018-83eb-74d0c7b47a05 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:37.767367 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b07d1f8-4c36-4018-83eb-74d0c7b47a05 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:37.767367 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b07d1f8-4c36-4018-83eb-74d0c7b47a05 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:37.928411 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6b07d1f8-4c36-4018-83eb-74d0c7b47a05 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2985f6e7b7c4e91ac80db47d1f2dff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6377f05e21462b8a374170ec06a211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:37.938811 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6b07d1f8-4c36-4018-83eb-74d0c7b47a05 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbb11ae-1650-4257-a543-ca43743048e4" status: 200 len: 1314 microversion: 2.1 time: 0.189879 Oct 23 01:44:37.939401 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3116/6140] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:44:37 2022] GET /compute/v2.1/servers/cfbb11ae-1650-4257-a543-ca43743048e4 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:44:38.227284 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ebe4a87e-81f6-44cf-9279-3cb4a7f4c700 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:44:38.228430 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ebe4a87e-81f6-44cf-9279-3cb4a7f4c700 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:38.235127 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ebe4a87e-81f6-44cf-9279-3cb4a7f4c700 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:38.235617 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ebe4a87e-81f6-44cf-9279-3cb4a7f4c700 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:38.236055 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ebe4a87e-81f6-44cf-9279-3cb4a7f4c700 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:38.236755 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ebe4a87e-81f6-44cf-9279-3cb4a7f4c700 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:38.237314 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ebe4a87e-81f6-44cf-9279-3cb4a7f4c700 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:38.237679 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ebe4a87e-81f6-44cf-9279-3cb4a7f4c700 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:38.415839 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ebe4a87e-81f6-44cf-9279-3cb4a7f4c700 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:38.429165 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ebe4a87e-81f6-44cf-9279-3cb4a7f4c700 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1692 microversion: 2.1 time: 0.201501 Oct 23 01:44:38.429165 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3025/6141] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:44:38 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1692 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:44:38.967126 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bf1e8410-648e-4316-b8ca-3798f1bfa49b tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:44:38.968205 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bf1e8410-648e-4316-b8ca-3798f1bfa49b tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] [instance: cfbb11ae-1650-4257-a543-ca43743048e4] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:38.975930 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf1e8410-648e-4316-b8ca-3798f1bfa49b tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:38.976620 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf1e8410-648e-4316-b8ca-3798f1bfa49b tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:38.977275 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf1e8410-648e-4316-b8ca-3798f1bfa49b tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:38.978296 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf1e8410-648e-4316-b8ca-3798f1bfa49b tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:38.978854 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf1e8410-648e-4316-b8ca-3798f1bfa49b tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:38.979381 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf1e8410-648e-4316-b8ca-3798f1bfa49b tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:39.123855 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-e4eebb89-a734-4b13-bfa9-4e948662f509 req-fbffe917-9c84-4773-8d38-9215e450f193 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfbb11ae-1650-4257-a543-ca43743048e4", "tag": "526427c3-4ed5-4473-85f3-cd3bb0435a94"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:44:39.155034 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-e4eebb89-a734-4b13-bfa9-4e948662f509 req-fbffe917-9c84-4773-8d38-9215e450f193 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:39.159929 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-e4eebb89-a734-4b13-bfa9-4e948662f509 req-fbffe917-9c84-4773-8d38-9215e450f193 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:39.159929 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-e4eebb89-a734-4b13-bfa9-4e948662f509 req-fbffe917-9c84-4773-8d38-9215e450f193 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:39.173343 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-e4eebb89-a734-4b13-bfa9-4e948662f509 req-fbffe917-9c84-4773-8d38-9215e450f193 service nova] Creating event network-changed:526427c3-4ed5-4473-85f3-cd3bb0435a94 for instance cfbb11ae-1650-4257-a543-ca43743048e4 on n-h2-master-1 Oct 23 01:44:39.180320 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-e4eebb89-a734-4b13-bfa9-4e948662f509 req-fbffe917-9c84-4773-8d38-9215e450f193 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060783 Oct 23 01:44:39.184168 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3026/6142] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:44:39.185888 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bf1e8410-648e-4316-b8ca-3798f1bfa49b tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2985f6e7b7c4e91ac80db47d1f2dff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6377f05e21462b8a374170ec06a211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:39.194254 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bf1e8410-648e-4316-b8ca-3798f1bfa49b tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbb11ae-1650-4257-a543-ca43743048e4" status: 200 len: 1314 microversion: 2.1 time: 0.234368 Oct 23 01:44:39.195279 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3117/6143] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:44:38 2022] GET /compute/v2.1/servers/cfbb11ae-1650-4257-a543-ca43743048e4 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:44:39.450841 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e63b1b21-c52f-4640-8778-b05fb2095842 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:44:39.451748 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e63b1b21-c52f-4640-8778-b05fb2095842 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:39.460193 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e63b1b21-c52f-4640-8778-b05fb2095842 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:39.465568 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e63b1b21-c52f-4640-8778-b05fb2095842 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:39.465568 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e63b1b21-c52f-4640-8778-b05fb2095842 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:39.465568 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e63b1b21-c52f-4640-8778-b05fb2095842 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:39.465568 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e63b1b21-c52f-4640-8778-b05fb2095842 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:39.465568 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e63b1b21-c52f-4640-8778-b05fb2095842 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:39.633003 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e63b1b21-c52f-4640-8778-b05fb2095842 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:39.642492 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e63b1b21-c52f-4640-8778-b05fb2095842 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1697 microversion: 2.1 time: 0.197306 Oct 23 01:44:39.643475 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3027/6144] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:44:39 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1697 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:44:40.231237 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a3cf2fc4-86a6-4d4f-b450-3b007a99a792 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:44:40.231883 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a3cf2fc4-86a6-4d4f-b450-3b007a99a792 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] [instance: cfbb11ae-1650-4257-a543-ca43743048e4] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:40.239286 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a3cf2fc4-86a6-4d4f-b450-3b007a99a792 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:40.240921 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a3cf2fc4-86a6-4d4f-b450-3b007a99a792 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:40.240921 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a3cf2fc4-86a6-4d4f-b450-3b007a99a792 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:40.241248 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a3cf2fc4-86a6-4d4f-b450-3b007a99a792 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:40.241666 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a3cf2fc4-86a6-4d4f-b450-3b007a99a792 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:40.242134 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a3cf2fc4-86a6-4d4f-b450-3b007a99a792 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:40.392291 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a3cf2fc4-86a6-4d4f-b450-3b007a99a792 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2985f6e7b7c4e91ac80db47d1f2dff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6377f05e21462b8a374170ec06a211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:40.402795 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a3cf2fc4-86a6-4d4f-b450-3b007a99a792 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbb11ae-1650-4257-a543-ca43743048e4" status: 200 len: 1314 microversion: 2.1 time: 0.187714 Oct 23 01:44:40.403401 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3118/6145] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:44:40 2022] GET /compute/v2.1/servers/cfbb11ae-1650-4257-a543-ca43743048e4 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:44:40.672844 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cf118836-22d4-44e3-96ad-599576536b3e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:44:40.673473 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cf118836-22d4-44e3-96ad-599576536b3e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:40.681245 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf118836-22d4-44e3-96ad-599576536b3e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:40.684120 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf118836-22d4-44e3-96ad-599576536b3e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:40.684120 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf118836-22d4-44e3-96ad-599576536b3e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:40.684120 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf118836-22d4-44e3-96ad-599576536b3e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:40.684120 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf118836-22d4-44e3-96ad-599576536b3e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:40.684120 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cf118836-22d4-44e3-96ad-599576536b3e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:40.824685 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cf118836-22d4-44e3-96ad-599576536b3e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:40.832789 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cf118836-22d4-44e3-96ad-599576536b3e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1697 microversion: 2.1 time: 0.164573 Oct 23 01:44:40.833369 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3028/6146] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:44:40 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1697 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:44:41.430824 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2c83b1b9-dc8a-4aec-ba83-471a5f16b48f tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:44:41.431531 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2c83b1b9-dc8a-4aec-ba83-471a5f16b48f tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] [instance: cfbb11ae-1650-4257-a543-ca43743048e4] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:41.433703 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:41.439527 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2c83b1b9-dc8a-4aec-ba83-471a5f16b48f tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:41.440028 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2c83b1b9-dc8a-4aec-ba83-471a5f16b48f tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:41.440685 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2c83b1b9-dc8a-4aec-ba83-471a5f16b48f tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:41.441396 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2c83b1b9-dc8a-4aec-ba83-471a5f16b48f tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:41.441864 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2c83b1b9-dc8a-4aec-ba83-471a5f16b48f tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:41.442348 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2c83b1b9-dc8a-4aec-ba83-471a5f16b48f tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:41.599903 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2c83b1b9-dc8a-4aec-ba83-471a5f16b48f tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2985f6e7b7c4e91ac80db47d1f2dff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6377f05e21462b8a374170ec06a211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:41.608420 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2c83b1b9-dc8a-4aec-ba83-471a5f16b48f tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbb11ae-1650-4257-a543-ca43743048e4" status: 200 len: 1314 microversion: 2.1 time: 0.181338 Oct 23 01:44:41.609380 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3119/6147] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:44:41 2022] GET /compute/v2.1/servers/cfbb11ae-1650-4257-a543-ca43743048e4 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:44:41.855250 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fb1399eb-daf4-4aca-a6ca-4b8f45104535 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:44:41.855876 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-fb1399eb-daf4-4aca-a6ca-4b8f45104535 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:41.857891 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:41.864798 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fb1399eb-daf4-4aca-a6ca-4b8f45104535 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:41.865211 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fb1399eb-daf4-4aca-a6ca-4b8f45104535 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:41.865652 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fb1399eb-daf4-4aca-a6ca-4b8f45104535 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:41.866391 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fb1399eb-daf4-4aca-a6ca-4b8f45104535 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:41.866994 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fb1399eb-daf4-4aca-a6ca-4b8f45104535 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:41.867428 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fb1399eb-daf4-4aca-a6ca-4b8f45104535 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:42.030387 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-fb1399eb-daf4-4aca-a6ca-4b8f45104535 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:42.040793 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fb1399eb-daf4-4aca-a6ca-4b8f45104535 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1697 microversion: 2.1 time: 0.189423 Oct 23 01:44:42.041416 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3029/6148] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:44:41 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1697 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:44:42.639122 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-96cabc51-6105-43dd-a908-335f2cda2f96 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:44:42.640944 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-96cabc51-6105-43dd-a908-335f2cda2f96 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] [instance: cfbb11ae-1650-4257-a543-ca43743048e4] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:42.647004 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-96cabc51-6105-43dd-a908-335f2cda2f96 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:42.647541 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-96cabc51-6105-43dd-a908-335f2cda2f96 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:42.647979 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-96cabc51-6105-43dd-a908-335f2cda2f96 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:42.648704 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-96cabc51-6105-43dd-a908-335f2cda2f96 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:42.649164 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-96cabc51-6105-43dd-a908-335f2cda2f96 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:42.649591 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-96cabc51-6105-43dd-a908-335f2cda2f96 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:42.787521 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-96cabc51-6105-43dd-a908-335f2cda2f96 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2985f6e7b7c4e91ac80db47d1f2dff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6377f05e21462b8a374170ec06a211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:42.795889 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-96cabc51-6105-43dd-a908-335f2cda2f96 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbb11ae-1650-4257-a543-ca43743048e4" status: 200 len: 1314 microversion: 2.1 time: 0.160863 Oct 23 01:44:42.796489 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3120/6149] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:44:42 2022] GET /compute/v2.1/servers/cfbb11ae-1650-4257-a543-ca43743048e4 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:44:43.064675 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6f45df9c-ec74-4d48-ba55-5b036fd66a6c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:44:43.065429 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6f45df9c-ec74-4d48-ba55-5b036fd66a6c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:43.072548 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6f45df9c-ec74-4d48-ba55-5b036fd66a6c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:43.073257 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6f45df9c-ec74-4d48-ba55-5b036fd66a6c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:43.073700 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6f45df9c-ec74-4d48-ba55-5b036fd66a6c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:43.074446 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6f45df9c-ec74-4d48-ba55-5b036fd66a6c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:43.074906 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6f45df9c-ec74-4d48-ba55-5b036fd66a6c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:43.075332 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6f45df9c-ec74-4d48-ba55-5b036fd66a6c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:43.216096 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6f45df9c-ec74-4d48-ba55-5b036fd66a6c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:43.224586 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6f45df9c-ec74-4d48-ba55-5b036fd66a6c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1697 microversion: 2.1 time: 0.163844 Oct 23 01:44:43.225167 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3030/6150] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:44:43 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1697 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:44:43.819792 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fedc6777-feff-4dc4-b36e-72bae1fd65cf tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:44:43.821093 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fedc6777-feff-4dc4-b36e-72bae1fd65cf tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] [instance: cfbb11ae-1650-4257-a543-ca43743048e4] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:43.830228 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fedc6777-feff-4dc4-b36e-72bae1fd65cf tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:43.830721 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fedc6777-feff-4dc4-b36e-72bae1fd65cf tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:43.831344 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fedc6777-feff-4dc4-b36e-72bae1fd65cf tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:43.834837 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fedc6777-feff-4dc4-b36e-72bae1fd65cf tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:43.834837 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fedc6777-feff-4dc4-b36e-72bae1fd65cf tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:43.834837 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fedc6777-feff-4dc4-b36e-72bae1fd65cf tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:43.965709 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fedc6777-feff-4dc4-b36e-72bae1fd65cf tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2985f6e7b7c4e91ac80db47d1f2dff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6377f05e21462b8a374170ec06a211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:43.974179 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fedc6777-feff-4dc4-b36e-72bae1fd65cf tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbb11ae-1650-4257-a543-ca43743048e4" status: 200 len: 1314 microversion: 2.1 time: 0.158501 Oct 23 01:44:43.974753 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3121/6151] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:44:43 2022] GET /compute/v2.1/servers/cfbb11ae-1650-4257-a543-ca43743048e4 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:44:44.247981 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-429f760c-1ac4-453e-abf2-25144f1e236e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:44:44.248596 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-429f760c-1ac4-453e-abf2-25144f1e236e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:44.255588 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-429f760c-1ac4-453e-abf2-25144f1e236e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:44.256073 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-429f760c-1ac4-453e-abf2-25144f1e236e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:44.258597 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-429f760c-1ac4-453e-abf2-25144f1e236e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:44.258597 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-429f760c-1ac4-453e-abf2-25144f1e236e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:44.258597 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-429f760c-1ac4-453e-abf2-25144f1e236e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:44.258597 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-429f760c-1ac4-453e-abf2-25144f1e236e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:44.405573 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-429f760c-1ac4-453e-abf2-25144f1e236e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:44.419605 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-429f760c-1ac4-453e-abf2-25144f1e236e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1697 microversion: 2.1 time: 0.173428 Oct 23 01:44:44.419605 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3031/6152] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:44:44 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1697 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:44:44.998018 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6c89198a-0645-41ed-bb16-dbc0bf8844c4 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:44:44.999422 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6c89198a-0645-41ed-bb16-dbc0bf8844c4 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] [instance: cfbb11ae-1650-4257-a543-ca43743048e4] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:45.006821 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6c89198a-0645-41ed-bb16-dbc0bf8844c4 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:45.007298 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6c89198a-0645-41ed-bb16-dbc0bf8844c4 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:45.007921 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6c89198a-0645-41ed-bb16-dbc0bf8844c4 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:45.008821 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6c89198a-0645-41ed-bb16-dbc0bf8844c4 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:45.009968 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6c89198a-0645-41ed-bb16-dbc0bf8844c4 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:45.009968 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6c89198a-0645-41ed-bb16-dbc0bf8844c4 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:45.155036 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6c89198a-0645-41ed-bb16-dbc0bf8844c4 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2985f6e7b7c4e91ac80db47d1f2dff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6377f05e21462b8a374170ec06a211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:45.161321 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6c89198a-0645-41ed-bb16-dbc0bf8844c4 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbb11ae-1650-4257-a543-ca43743048e4" status: 200 len: 1314 microversion: 2.1 time: 0.167350 Oct 23 01:44:45.161909 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3122/6153] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:44:44 2022] GET /compute/v2.1/servers/cfbb11ae-1650-4257-a543-ca43743048e4 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:44:45.442059 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ddf427b6-4b5b-40f0-bf0d-3bde97c4e93c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:44:45.443269 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ddf427b6-4b5b-40f0-bf0d-3bde97c4e93c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:45.446293 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=12 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:45.450620 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ddf427b6-4b5b-40f0-bf0d-3bde97c4e93c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:45.451103 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ddf427b6-4b5b-40f0-bf0d-3bde97c4e93c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:45.451539 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ddf427b6-4b5b-40f0-bf0d-3bde97c4e93c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:45.452230 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ddf427b6-4b5b-40f0-bf0d-3bde97c4e93c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:45.453770 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ddf427b6-4b5b-40f0-bf0d-3bde97c4e93c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:45.454258 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ddf427b6-4b5b-40f0-bf0d-3bde97c4e93c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:45.603502 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ddf427b6-4b5b-40f0-bf0d-3bde97c4e93c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:45.611979 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ddf427b6-4b5b-40f0-bf0d-3bde97c4e93c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1697 microversion: 2.1 time: 0.175153 Oct 23 01:44:45.618669 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3032/6154] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:44:45 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1697 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:44:45.923477 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-a0927515-04e8-42d7-a1d7-8054d6c29e34 req-fdbd0e3b-ddb1-444f-8413-3fa15f624aa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfbb11ae-1650-4257-a543-ca43743048e4", "name": "network-vif-plugged", "status": "completed", "tag": "526427c3-4ed5-4473-85f3-cd3bb0435a94"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:44:45.934253 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-a0927515-04e8-42d7-a1d7-8054d6c29e34 req-fdbd0e3b-ddb1-444f-8413-3fa15f624aa3 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:45.934750 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-a0927515-04e8-42d7-a1d7-8054d6c29e34 req-fdbd0e3b-ddb1-444f-8413-3fa15f624aa3 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:45.935188 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-a0927515-04e8-42d7-a1d7-8054d6c29e34 req-fdbd0e3b-ddb1-444f-8413-3fa15f624aa3 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:45.949322 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-a0927515-04e8-42d7-a1d7-8054d6c29e34 req-fdbd0e3b-ddb1-444f-8413-3fa15f624aa3 service nova] Creating event network-vif-plugged:526427c3-4ed5-4473-85f3-cd3bb0435a94 for instance cfbb11ae-1650-4257-a543-ca43743048e4 on n-h2-master-1 Oct 23 01:44:45.953022 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-a0927515-04e8-42d7-a1d7-8054d6c29e34 req-fdbd0e3b-ddb1-444f-8413-3fa15f624aa3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033557 Oct 23 01:44:45.955717 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3123/6155] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:44:46.185467 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ec4f9e63-e3e1-42fc-8ae6-3fde2bc92b11 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:44:46.186307 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ec4f9e63-e3e1-42fc-8ae6-3fde2bc92b11 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] [instance: cfbb11ae-1650-4257-a543-ca43743048e4] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:46.193224 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec4f9e63-e3e1-42fc-8ae6-3fde2bc92b11 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:46.194533 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec4f9e63-e3e1-42fc-8ae6-3fde2bc92b11 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:46.194995 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec4f9e63-e3e1-42fc-8ae6-3fde2bc92b11 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:46.195728 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec4f9e63-e3e1-42fc-8ae6-3fde2bc92b11 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:46.196203 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec4f9e63-e3e1-42fc-8ae6-3fde2bc92b11 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:46.196638 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec4f9e63-e3e1-42fc-8ae6-3fde2bc92b11 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:46.367733 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ec4f9e63-e3e1-42fc-8ae6-3fde2bc92b11 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2985f6e7b7c4e91ac80db47d1f2dff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6377f05e21462b8a374170ec06a211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:46.383706 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ec4f9e63-e3e1-42fc-8ae6-3fde2bc92b11 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbb11ae-1650-4257-a543-ca43743048e4" status: 200 len: 1314 microversion: 2.1 time: 0.195826 Oct 23 01:44:46.383706 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3033/6156] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:44:46 2022] GET /compute/v2.1/servers/cfbb11ae-1650-4257-a543-ca43743048e4 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:44:46.642602 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8b5f5f7f-5a55-472f-8401-bace5ba8629f tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:44:46.643368 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8b5f5f7f-5a55-472f-8401-bace5ba8629f tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:46.651329 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8b5f5f7f-5a55-472f-8401-bace5ba8629f tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:46.652098 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8b5f5f7f-5a55-472f-8401-bace5ba8629f tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:46.652557 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8b5f5f7f-5a55-472f-8401-bace5ba8629f tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:46.653515 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8b5f5f7f-5a55-472f-8401-bace5ba8629f tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:46.654183 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8b5f5f7f-5a55-472f-8401-bace5ba8629f tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:46.654773 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8b5f5f7f-5a55-472f-8401-bace5ba8629f tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:46.838027 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8b5f5f7f-5a55-472f-8401-bace5ba8629f tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:46.848149 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8b5f5f7f-5a55-472f-8401-bace5ba8629f tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1697 microversion: 2.1 time: 0.211187 Oct 23 01:44:46.848740 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3124/6157] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:44:46 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1697 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:44:47.399015 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bc519d6f-4d30-4f31-9de8-31c5e5d7765a tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:44:47.400645 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-bc519d6f-4d30-4f31-9de8-31c5e5d7765a tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] [instance: cfbb11ae-1650-4257-a543-ca43743048e4] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:47.409695 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bc519d6f-4d30-4f31-9de8-31c5e5d7765a tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:47.410381 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bc519d6f-4d30-4f31-9de8-31c5e5d7765a tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:47.410978 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bc519d6f-4d30-4f31-9de8-31c5e5d7765a tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:47.411873 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bc519d6f-4d30-4f31-9de8-31c5e5d7765a tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:47.412578 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bc519d6f-4d30-4f31-9de8-31c5e5d7765a tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:47.413490 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bc519d6f-4d30-4f31-9de8-31c5e5d7765a tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:47.594377 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bc519d6f-4d30-4f31-9de8-31c5e5d7765a tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2985f6e7b7c4e91ac80db47d1f2dff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6377f05e21462b8a374170ec06a211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:47.603093 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bc519d6f-4d30-4f31-9de8-31c5e5d7765a tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbb11ae-1650-4257-a543-ca43743048e4" status: 200 len: 1314 microversion: 2.1 time: 0.207995 Oct 23 01:44:47.603672 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3034/6158] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:44:47 2022] GET /compute/v2.1/servers/cfbb11ae-1650-4257-a543-ca43743048e4 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:44:47.871953 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6e0547b3-7781-4c8a-83af-e3d115e2bbd3 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:44:47.872656 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6e0547b3-7781-4c8a-83af-e3d115e2bbd3 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:47.880239 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6e0547b3-7781-4c8a-83af-e3d115e2bbd3 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:47.881078 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6e0547b3-7781-4c8a-83af-e3d115e2bbd3 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:47.881961 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6e0547b3-7781-4c8a-83af-e3d115e2bbd3 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:47.884173 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6e0547b3-7781-4c8a-83af-e3d115e2bbd3 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:47.884807 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6e0547b3-7781-4c8a-83af-e3d115e2bbd3 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:47.885693 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6e0547b3-7781-4c8a-83af-e3d115e2bbd3 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:48.037947 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6e0547b3-7781-4c8a-83af-e3d115e2bbd3 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:48.041846 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:48.061455 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6e0547b3-7781-4c8a-83af-e3d115e2bbd3 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1697 microversion: 2.1 time: 0.180841 Oct 23 01:44:48.069582 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3125/6159] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:44:47 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1697 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:44:48.627929 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6a100e7f-d038-42e4-a927-84e384b88659 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:44:48.628540 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6a100e7f-d038-42e4-a927-84e384b88659 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] [instance: cfbb11ae-1650-4257-a543-ca43743048e4] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:48.635619 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6a100e7f-d038-42e4-a927-84e384b88659 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:48.636099 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6a100e7f-d038-42e4-a927-84e384b88659 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:48.636534 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6a100e7f-d038-42e4-a927-84e384b88659 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:48.641254 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6a100e7f-d038-42e4-a927-84e384b88659 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:48.641254 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6a100e7f-d038-42e4-a927-84e384b88659 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:48.641254 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6a100e7f-d038-42e4-a927-84e384b88659 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:48.792984 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6a100e7f-d038-42e4-a927-84e384b88659 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2985f6e7b7c4e91ac80db47d1f2dff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6377f05e21462b8a374170ec06a211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:48.802460 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6a100e7f-d038-42e4-a927-84e384b88659 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbb11ae-1650-4257-a543-ca43743048e4" status: 200 len: 1497 microversion: 2.1 time: 0.179188 Oct 23 01:44:48.803278 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3035/6160] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:44:48 2022] GET /compute/v2.1/servers/cfbb11ae-1650-4257-a543-ca43743048e4 => generated 1497 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:44:49.087358 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9a01f6ee-a20f-4339-b506-fe63884f70ec tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:44:49.087904 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9a01f6ee-a20f-4339-b506-fe63884f70ec tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:49.096307 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9a01f6ee-a20f-4339-b506-fe63884f70ec tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:49.096848 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9a01f6ee-a20f-4339-b506-fe63884f70ec tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:49.097284 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9a01f6ee-a20f-4339-b506-fe63884f70ec tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:49.097964 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9a01f6ee-a20f-4339-b506-fe63884f70ec tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:49.098451 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9a01f6ee-a20f-4339-b506-fe63884f70ec tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:49.098883 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9a01f6ee-a20f-4339-b506-fe63884f70ec tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:49.257179 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9a01f6ee-a20f-4339-b506-fe63884f70ec tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:49.265524 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9a01f6ee-a20f-4339-b506-fe63884f70ec tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1697 microversion: 2.1 time: 0.182112 Oct 23 01:44:49.266627 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3126/6161] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:44:49 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1697 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:44:49.768939 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-91fea407-426e-486a-87c9-42e2214c7284 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:44:49.770049 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-91fea407-426e-486a-87c9-42e2214c7284 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] [instance: cfbb11ae-1650-4257-a543-ca43743048e4] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:49.778168 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-91fea407-426e-486a-87c9-42e2214c7284 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:49.778818 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-91fea407-426e-486a-87c9-42e2214c7284 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:49.779254 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-91fea407-426e-486a-87c9-42e2214c7284 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:49.784713 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-91fea407-426e-486a-87c9-42e2214c7284 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:49.784713 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-91fea407-426e-486a-87c9-42e2214c7284 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:49.784713 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-91fea407-426e-486a-87c9-42e2214c7284 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:49.815851 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-91fea407-426e-486a-87c9-42e2214c7284 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] [instance: cfbb11ae-1650-4257-a543-ca43743048e4] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:44:49.926091 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:50.138495 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-91fea407-426e-486a-87c9-42e2214c7284 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] 10.222.0.42 "DELETE /compute/v2.1/servers/cfbb11ae-1650-4257-a543-ca43743048e4" status: 204 len: 0 microversion: 2.1 time: 0.371551 Oct 23 01:44:50.138495 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3036/6162] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:44:49 2022] DELETE /compute/v2.1/servers/cfbb11ae-1650-4257-a543-ca43743048e4 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:44:50.151978 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c8f6a97c-fac2-4ec8-8a90-14c0d8c8c4dd tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:44:50.160837 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c8f6a97c-fac2-4ec8-8a90-14c0d8c8c4dd tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] [instance: cfbb11ae-1650-4257-a543-ca43743048e4] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:50.168413 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c8f6a97c-fac2-4ec8-8a90-14c0d8c8c4dd tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:50.169122 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c8f6a97c-fac2-4ec8-8a90-14c0d8c8c4dd tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:50.169566 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c8f6a97c-fac2-4ec8-8a90-14c0d8c8c4dd tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:50.170303 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c8f6a97c-fac2-4ec8-8a90-14c0d8c8c4dd tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:50.170841 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c8f6a97c-fac2-4ec8-8a90-14c0d8c8c4dd tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:50.171279 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c8f6a97c-fac2-4ec8-8a90-14c0d8c8c4dd tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:50.290212 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f702523d-6d16-473c-a43d-80f00f8ed9c9 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:44:50.290994 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f702523d-6d16-473c-a43d-80f00f8ed9c9 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:50.297530 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f702523d-6d16-473c-a43d-80f00f8ed9c9 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:50.298054 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f702523d-6d16-473c-a43d-80f00f8ed9c9 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:50.300038 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f702523d-6d16-473c-a43d-80f00f8ed9c9 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:50.300760 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f702523d-6d16-473c-a43d-80f00f8ed9c9 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:50.301228 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f702523d-6d16-473c-a43d-80f00f8ed9c9 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:50.301661 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f702523d-6d16-473c-a43d-80f00f8ed9c9 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:50.306798 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c8f6a97c-fac2-4ec8-8a90-14c0d8c8c4dd tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2985f6e7b7c4e91ac80db47d1f2dff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6377f05e21462b8a374170ec06a211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:50.315290 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c8f6a97c-fac2-4ec8-8a90-14c0d8c8c4dd tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbb11ae-1650-4257-a543-ca43743048e4" status: 200 len: 1503 microversion: 2.1 time: 0.170082 Oct 23 01:44:50.316091 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3127/6163] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:44:50 2022] GET /compute/v2.1/servers/cfbb11ae-1650-4257-a543-ca43743048e4 => generated 1503 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:44:50.478654 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f702523d-6d16-473c-a43d-80f00f8ed9c9 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:50.492528 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f702523d-6d16-473c-a43d-80f00f8ed9c9 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1697 microversion: 2.1 time: 0.206611 Oct 23 01:44:50.493335 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3037/6164] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:44:50 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1697 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:44:51.340558 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c01c9817-c0f0-4fe2-901f-4b5e424fd500 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:44:51.341194 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c01c9817-c0f0-4fe2-901f-4b5e424fd500 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] [instance: cfbb11ae-1650-4257-a543-ca43743048e4] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:51.348301 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c01c9817-c0f0-4fe2-901f-4b5e424fd500 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:51.349348 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c01c9817-c0f0-4fe2-901f-4b5e424fd500 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:51.349793 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c01c9817-c0f0-4fe2-901f-4b5e424fd500 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:51.350525 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c01c9817-c0f0-4fe2-901f-4b5e424fd500 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:51.350995 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c01c9817-c0f0-4fe2-901f-4b5e424fd500 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:51.351432 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c01c9817-c0f0-4fe2-901f-4b5e424fd500 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:51.489661 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c01c9817-c0f0-4fe2-901f-4b5e424fd500 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2985f6e7b7c4e91ac80db47d1f2dff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6377f05e21462b8a374170ec06a211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:51.497685 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c01c9817-c0f0-4fe2-901f-4b5e424fd500 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbb11ae-1650-4257-a543-ca43743048e4" status: 200 len: 1503 microversion: 2.1 time: 0.161129 Oct 23 01:44:51.498331 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3128/6165] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:44:51 2022] GET /compute/v2.1/servers/cfbb11ae-1650-4257-a543-ca43743048e4 => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:44:51.517055 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-60fbad51-0f07-4b37-8ae0-a47dabd1a621 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:44:51.517675 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-60fbad51-0f07-4b37-8ae0-a47dabd1a621 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:51.524742 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-60fbad51-0f07-4b37-8ae0-a47dabd1a621 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:51.525326 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-60fbad51-0f07-4b37-8ae0-a47dabd1a621 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:51.525664 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-60fbad51-0f07-4b37-8ae0-a47dabd1a621 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:51.526414 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-60fbad51-0f07-4b37-8ae0-a47dabd1a621 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:51.526893 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-60fbad51-0f07-4b37-8ae0-a47dabd1a621 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:51.527331 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-60fbad51-0f07-4b37-8ae0-a47dabd1a621 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:51.673656 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-60fbad51-0f07-4b37-8ae0-a47dabd1a621 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:51.682399 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-60fbad51-0f07-4b37-8ae0-a47dabd1a621 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1697 microversion: 2.1 time: 0.169754 Oct 23 01:44:51.683209 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3038/6166] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:44:51 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1697 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:44:52.366126 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-e78878e4-972f-4c57-b640-27da956db5d4 req-de7d208f-1616-4b01-bb5b-ccf8e38ca1a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfbb11ae-1650-4257-a543-ca43743048e4", "name": "network-vif-deleted", "tag": "526427c3-4ed5-4473-85f3-cd3bb0435a94"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:44:52.378930 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-e78878e4-972f-4c57-b640-27da956db5d4 req-de7d208f-1616-4b01-bb5b-ccf8e38ca1a2 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:52.382674 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-e78878e4-972f-4c57-b640-27da956db5d4 req-de7d208f-1616-4b01-bb5b-ccf8e38ca1a2 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:52.382674 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-e78878e4-972f-4c57-b640-27da956db5d4 req-de7d208f-1616-4b01-bb5b-ccf8e38ca1a2 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:52.403246 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-e78878e4-972f-4c57-b640-27da956db5d4 req-de7d208f-1616-4b01-bb5b-ccf8e38ca1a2 service nova] Creating event network-vif-deleted:526427c3-4ed5-4473-85f3-cd3bb0435a94 for instance cfbb11ae-1650-4257-a543-ca43743048e4 on n-h2-master-1 Oct 23 01:44:52.409471 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-e78878e4-972f-4c57-b640-27da956db5d4 req-de7d208f-1616-4b01-bb5b-ccf8e38ca1a2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047857 Oct 23 01:44:52.413944 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3129/6167] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:44:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:44:52.521172 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6edfe542-f525-4d7b-abce-27bb0f8870a7 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:44:52.521796 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6edfe542-f525-4d7b-abce-27bb0f8870a7 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] [instance: cfbb11ae-1650-4257-a543-ca43743048e4] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:52.534305 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6edfe542-f525-4d7b-abce-27bb0f8870a7 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:52.534884 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6edfe542-f525-4d7b-abce-27bb0f8870a7 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:52.535383 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6edfe542-f525-4d7b-abce-27bb0f8870a7 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:52.536223 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6edfe542-f525-4d7b-abce-27bb0f8870a7 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:52.536781 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6edfe542-f525-4d7b-abce-27bb0f8870a7 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:52.542633 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6edfe542-f525-4d7b-abce-27bb0f8870a7 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:52.608358 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6edfe542-f525-4d7b-abce-27bb0f8870a7 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2985f6e7b7c4e91ac80db47d1f2dff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6377f05e21462b8a374170ec06a211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:52.617713 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6edfe542-f525-4d7b-abce-27bb0f8870a7 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbb11ae-1650-4257-a543-ca43743048e4" status: 200 len: 1299 microversion: 2.1 time: 0.100437 Oct 23 01:44:52.618998 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3039/6168] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:44:52 2022] GET /compute/v2.1/servers/cfbb11ae-1650-4257-a543-ca43743048e4 => generated 1299 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:44:52.707559 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0619a76b-943a-4489-9318-25c215865e03 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:44:52.708511 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0619a76b-943a-4489-9318-25c215865e03 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:52.719998 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0619a76b-943a-4489-9318-25c215865e03 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:52.719998 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0619a76b-943a-4489-9318-25c215865e03 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:52.719998 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0619a76b-943a-4489-9318-25c215865e03 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:52.719998 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0619a76b-943a-4489-9318-25c215865e03 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:52.719998 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0619a76b-943a-4489-9318-25c215865e03 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:52.719998 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0619a76b-943a-4489-9318-25c215865e03 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:52.869679 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0619a76b-943a-4489-9318-25c215865e03 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:52.880578 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0619a76b-943a-4489-9318-25c215865e03 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1697 microversion: 2.1 time: 0.177531 Oct 23 01:44:52.881335 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3130/6169] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:44:52 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1697 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:44:53.641363 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-14800e97-e0d3-4cf4-a28f-0191e4e21444 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:44:53.642182 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-14800e97-e0d3-4cf4-a28f-0191e4e21444 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] [instance: cfbb11ae-1650-4257-a543-ca43743048e4] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:53.649295 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-14800e97-e0d3-4cf4-a28f-0191e4e21444 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:53.650134 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-14800e97-e0d3-4cf4-a28f-0191e4e21444 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:53.650649 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-14800e97-e0d3-4cf4-a28f-0191e4e21444 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:53.651427 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-14800e97-e0d3-4cf4-a28f-0191e4e21444 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:53.651960 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-14800e97-e0d3-4cf4-a28f-0191e4e21444 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:53.652624 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-14800e97-e0d3-4cf4-a28f-0191e4e21444 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:53.686041 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-14800e97-e0d3-4cf4-a28f-0191e4e21444 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:53.686565 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-14800e97-e0d3-4cf4-a28f-0191e4e21444 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:53.687019 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-14800e97-e0d3-4cf4-a28f-0191e4e21444 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:53.687983 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-14800e97-e0d3-4cf4-a28f-0191e4e21444 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lazy-loading 'fault' on Instance uuid cfbb11ae-1650-4257-a543-ca43743048e4 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:44:53.735542 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-14800e97-e0d3-4cf4-a28f-0191e4e21444 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2985f6e7b7c4e91ac80db47d1f2dff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6377f05e21462b8a374170ec06a211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:53.743383 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-14800e97-e0d3-4cf4-a28f-0191e4e21444 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbb11ae-1650-4257-a543-ca43743048e4" status: 200 len: 1304 microversion: 2.1 time: 0.106362 Oct 23 01:44:53.754546 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3040/6170] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:44:53 2022] GET /compute/v2.1/servers/cfbb11ae-1650-4257-a543-ca43743048e4 => generated 1304 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:44:53.904855 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6b1f6c9d-3dee-4c7d-9548-f34f2b66854b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:44:53.905613 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6b1f6c9d-3dee-4c7d-9548-f34f2b66854b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:53.913897 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b1f6c9d-3dee-4c7d-9548-f34f2b66854b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:53.914526 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b1f6c9d-3dee-4c7d-9548-f34f2b66854b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:53.915259 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b1f6c9d-3dee-4c7d-9548-f34f2b66854b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:53.916195 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b1f6c9d-3dee-4c7d-9548-f34f2b66854b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:53.916984 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b1f6c9d-3dee-4c7d-9548-f34f2b66854b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:53.917547 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b1f6c9d-3dee-4c7d-9548-f34f2b66854b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:54.089096 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6b1f6c9d-3dee-4c7d-9548-f34f2b66854b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:54.099691 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6b1f6c9d-3dee-4c7d-9548-f34f2b66854b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1697 microversion: 2.1 time: 0.199191 Oct 23 01:44:54.107513 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3131/6171] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:44:53 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1697 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:44:54.454668 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0ab47aec-78f1-40f2-80ba-313840a7098c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:44:54.460398 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0ab47aec-78f1-40f2-80ba-313840a7098c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:54.461619 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0ab47aec-78f1-40f2-80ba-313840a7098c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:54.462059 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0ab47aec-78f1-40f2-80ba-313840a7098c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:54.462487 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0ab47aec-78f1-40f2-80ba-313840a7098c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:54.463181 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0ab47aec-78f1-40f2-80ba-313840a7098c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:54.463641 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0ab47aec-78f1-40f2-80ba-313840a7098c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:54.464062 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0ab47aec-78f1-40f2-80ba-313840a7098c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:54.502223 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0ab47aec-78f1-40f2-80ba-313840a7098c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:44:54.767827 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-85ba80b2-984c-498d-9eee-f487c3038d63 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:44:54.770679 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-85ba80b2-984c-498d-9eee-f487c3038d63 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] [instance: cfbb11ae-1650-4257-a543-ca43743048e4] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:54.784089 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-85ba80b2-984c-498d-9eee-f487c3038d63 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:54.784602 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-85ba80b2-984c-498d-9eee-f487c3038d63 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:54.785552 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-85ba80b2-984c-498d-9eee-f487c3038d63 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:54.786333 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-85ba80b2-984c-498d-9eee-f487c3038d63 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:54.786797 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-85ba80b2-984c-498d-9eee-f487c3038d63 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:54.787225 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-85ba80b2-984c-498d-9eee-f487c3038d63 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:54.815029 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-85ba80b2-984c-498d-9eee-f487c3038d63 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] HTTP exception thrown: Instance cfbb11ae-1650-4257-a543-ca43743048e4 could not be found. Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-85ba80b2-984c-498d-9eee-f487c3038d63 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Request method failure captured: Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/cfbb11ae-1650-4257-a543-ca43743048e4 HTTP/1.1 Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJx7OhwyJlzCeTfTdtFyQFUgj48cbZxLB8LRbLGNenrE1ZeafbgQ6J8XSm2fDjEnykrh-rcYvUgLzTN405V9qSFiDrf1xYNdOS0Q1X4oucoGYddHZ2EUub0NVRpNRjBUoRIgvrb8EshmxNhrsc2m6rh-Eti-Khp1TUGSjvPnVv83H04 Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 3c6377f05e21462b8a374170ec06a211 Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-VolumesActionsTest-1676684440 Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3c6377f05e21462b8a374170ec06a211"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3c6377f05e21462b8a374170ec06a211"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3c6377f05e21462b8a374170ec06a211"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3c6377f05e21462b8a374170ec06a211"}]}] Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-VolumesActionsTest-1676684440 Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 3c6377f05e21462b8a374170ec06a211 Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-VolumesActionsTest-1676684440 Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-VolumesActionsTest-1676684440-project Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: b2985f6e7b7c4e91ac80db47d1f2dff4 Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-VolumesActionsTest-1676684440-project Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: exception: Instance cfbb11ae-1650-4257-a543-ca43743048e4 could not be found. Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'cfbb11ae-1650-4257-a543-ca43743048e4'} Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfbb11ae-1650-4257-a543-ca43743048e4 could not be found. Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfbb11ae-1650-4257-a543-ca43743048e4 could not be found. Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:44:54.816959 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:44:54.824312 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:44:54.824312 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:44:54.824312 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:44:54.824312 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:44:54.824312 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:44:54.824312 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfbb11ae-1650-4257-a543-ca43743048e4 could not be found. Oct 23 01:44:54.824312 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:44:54.824312 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-85ba80b2-984c-498d-9eee-f487c3038d63 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Returning 404 to user: Instance cfbb11ae-1650-4257-a543-ca43743048e4 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:44:54.824312 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-85ba80b2-984c-498d-9eee-f487c3038d63 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbb11ae-1650-4257-a543-ca43743048e4" status: 404 len: 111 microversion: 2.1 time: 0.056346 Oct 23 01:44:54.824312 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3132/6172] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:44:54 2022] GET /compute/v2.1/servers/cfbb11ae-1650-4257-a543-ca43743048e4 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 01:44:54.934960 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0ab47aec-78f1-40f2-80ba-313840a7098c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 204 len: 0 microversion: 2.32 time: 0.785835 Oct 23 01:44:54.940684 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3041/6173] 10.222.0.42 () {60 vars in 1280 bytes} [Sun Oct 23 01:44:54 2022] DELETE /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 0 bytes in 788 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 23 01:44:54.946227 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-999e4d5d-76be-497f-9902-98baa9fb8506 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-122849119", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "a97c4616-6100-44a1-a188-6648685b4781"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:44:54.957304 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f61a48b4-e14e-4d0c-a4dd-4e171f780c09 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:44:54.958606 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f61a48b4-e14e-4d0c-a4dd-4e171f780c09 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:54.967041 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f61a48b4-e14e-4d0c-a4dd-4e171f780c09 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:54.967969 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f61a48b4-e14e-4d0c-a4dd-4e171f780c09 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:54.969638 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f61a48b4-e14e-4d0c-a4dd-4e171f780c09 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:54.970754 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f61a48b4-e14e-4d0c-a4dd-4e171f780c09 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:54.971308 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f61a48b4-e14e-4d0c-a4dd-4e171f780c09 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:54.972531 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f61a48b4-e14e-4d0c-a4dd-4e171f780c09 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:55.033944 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-999e4d5d-76be-497f-9902-98baa9fb8506 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] validate_networks() for [('a97c4616-6100-44a1-a188-6648685b4781', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:44:55.263148 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f61a48b4-e14e-4d0c-a4dd-4e171f780c09 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:55.276648 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f61a48b4-e14e-4d0c-a4dd-4e171f780c09 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:55.276648 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f61a48b4-e14e-4d0c-a4dd-4e171f780c09 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:55.278803 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f61a48b4-e14e-4d0c-a4dd-4e171f780c09 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 2947 microversion: 2.32 time: 0.336529 Oct 23 01:44:55.280517 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3042/6174] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:44:54 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 2947 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:44:55.285238 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4b6da50d-7312-4bce-88f2-085ebd5ee125 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:44:55.286691 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4b6da50d-7312-4bce-88f2-085ebd5ee125 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:55.303217 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b6da50d-7312-4bce-88f2-085ebd5ee125 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:55.303710 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b6da50d-7312-4bce-88f2-085ebd5ee125 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:55.304491 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b6da50d-7312-4bce-88f2-085ebd5ee125 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:55.305208 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b6da50d-7312-4bce-88f2-085ebd5ee125 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:55.305665 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b6da50d-7312-4bce-88f2-085ebd5ee125 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:55.306124 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b6da50d-7312-4bce-88f2-085ebd5ee125 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:55.559494 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4b6da50d-7312-4bce-88f2-085ebd5ee125 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:55.567950 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4b6da50d-7312-4bce-88f2-085ebd5ee125 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1697 microversion: 2.1 time: 0.286127 Oct 23 01:44:55.568662 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3043/6175] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:44:55 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1697 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:44:55.638548 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-999e4d5d-76be-497f-9902-98baa9fb8506 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:44:55.638980 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-999e4d5d-76be-497f-9902-98baa9fb8506 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:44:55.639463 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-999e4d5d-76be-497f-9902-98baa9fb8506 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:44:55.639880 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-999e4d5d-76be-497f-9902-98baa9fb8506 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:44:55.640480 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-999e4d5d-76be-497f-9902-98baa9fb8506 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:44:55.649406 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-999e4d5d-76be-497f-9902-98baa9fb8506 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:55.649897 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-999e4d5d-76be-497f-9902-98baa9fb8506 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:55.650407 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-999e4d5d-76be-497f-9902-98baa9fb8506 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:55.651113 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-999e4d5d-76be-497f-9902-98baa9fb8506 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:55.651572 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-999e4d5d-76be-497f-9902-98baa9fb8506 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:55.652190 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-999e4d5d-76be-497f-9902-98baa9fb8506 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:55.669763 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-999e4d5d-76be-497f-9902-98baa9fb8506 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Getting quotas for project 3c6377f05e21462b8a374170ec06a211. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:44:55.675636 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-999e4d5d-76be-497f-9902-98baa9fb8506 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Getting quotas for user b2985f6e7b7c4e91ac80db47d1f2dff4 and project 3c6377f05e21462b8a374170ec06a211. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:44:55.690473 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-999e4d5d-76be-497f-9902-98baa9fb8506 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:44:55.692810 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-999e4d5d-76be-497f-9902-98baa9fb8506 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] [instance: b9d9cd93-7e56-49b2-8b42-71ea75da9053] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:44:55.855515 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-999e4d5d-76be-497f-9902-98baa9fb8506 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.915293 Oct 23 01:44:55.856189 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3133/6176] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:44:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 917 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 23 01:44:55.867552 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-18a76b3c-5d05-42cf-a994-ccb7aa175ffe tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:44:55.868204 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-18a76b3c-5d05-42cf-a994-ccb7aa175ffe tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] [instance: b9d9cd93-7e56-49b2-8b42-71ea75da9053] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:55.928080 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-18a76b3c-5d05-42cf-a994-ccb7aa175ffe tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2985f6e7b7c4e91ac80db47d1f2dff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6377f05e21462b8a374170ec06a211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:55.936212 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-18a76b3c-5d05-42cf-a994-ccb7aa175ffe tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] 10.222.0.42 "GET /compute/v2.1/servers/b9d9cd93-7e56-49b2-8b42-71ea75da9053" status: 200 len: 1213 microversion: 2.1 time: 0.072714 Oct 23 01:44:55.950656 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3044/6177] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:44:55 2022] GET /compute/v2.1/servers/b9d9cd93-7e56-49b2-8b42-71ea75da9053 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:44:56.312927 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-41501139-3c42-4c98-87f9-a151a58a7e84 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:44:56.312927 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-41501139-3c42-4c98-87f9-a151a58a7e84 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:56.317360 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41501139-3c42-4c98-87f9-a151a58a7e84 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:56.317856 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41501139-3c42-4c98-87f9-a151a58a7e84 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:56.318327 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41501139-3c42-4c98-87f9-a151a58a7e84 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:56.319036 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41501139-3c42-4c98-87f9-a151a58a7e84 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:56.319527 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41501139-3c42-4c98-87f9-a151a58a7e84 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:56.319961 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41501139-3c42-4c98-87f9-a151a58a7e84 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:56.578410 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-41501139-3c42-4c98-87f9-a151a58a7e84 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:56.594180 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-41501139-3c42-4c98-87f9-a151a58a7e84 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:56.595200 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f79a493a-6bd7-4423-aec6-dcdd129a102a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:44:56.595830 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f79a493a-6bd7-4423-aec6-dcdd129a102a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:56.596443 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-41501139-3c42-4c98-87f9-a151a58a7e84 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:56.598193 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-41501139-3c42-4c98-87f9-a151a58a7e84 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 2947 microversion: 2.32 time: 0.293653 Oct 23 01:44:56.609903 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3134/6178] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:44:56 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 2947 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:44:56.613868 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f79a493a-6bd7-4423-aec6-dcdd129a102a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:56.614677 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f79a493a-6bd7-4423-aec6-dcdd129a102a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:56.622180 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f79a493a-6bd7-4423-aec6-dcdd129a102a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:56.622180 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f79a493a-6bd7-4423-aec6-dcdd129a102a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:56.622180 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f79a493a-6bd7-4423-aec6-dcdd129a102a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:56.622180 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f79a493a-6bd7-4423-aec6-dcdd129a102a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:56.783598 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f79a493a-6bd7-4423-aec6-dcdd129a102a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:56.798706 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f79a493a-6bd7-4423-aec6-dcdd129a102a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1697 microversion: 2.1 time: 0.207719 Oct 23 01:44:56.799348 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3045/6179] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:44:56 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1697 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:44:56.972437 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f2950516-c401-4545-8d8d-545126c66a38 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:44:56.972437 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f2950516-c401-4545-8d8d-545126c66a38 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] [instance: b9d9cd93-7e56-49b2-8b42-71ea75da9053] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:56.981781 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2950516-c401-4545-8d8d-545126c66a38 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:56.982432 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2950516-c401-4545-8d8d-545126c66a38 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:56.982963 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2950516-c401-4545-8d8d-545126c66a38 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:56.984928 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2950516-c401-4545-8d8d-545126c66a38 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:56.989086 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2950516-c401-4545-8d8d-545126c66a38 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:56.989702 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2950516-c401-4545-8d8d-545126c66a38 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:57.087470 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f2950516-c401-4545-8d8d-545126c66a38 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2985f6e7b7c4e91ac80db47d1f2dff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6377f05e21462b8a374170ec06a211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:57.099887 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f2950516-c401-4545-8d8d-545126c66a38 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] 10.222.0.42 "GET /compute/v2.1/servers/b9d9cd93-7e56-49b2-8b42-71ea75da9053" status: 200 len: 1217 microversion: 2.1 time: 0.142624 Oct 23 01:44:57.100486 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3135/6180] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:44:56 2022] GET /compute/v2.1/servers/b9d9cd93-7e56-49b2-8b42-71ea75da9053 => generated 1217 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:44:57.628712 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-67554c19-8c77-4c16-a8e1-74bc8cf35147 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:44:57.629325 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-67554c19-8c77-4c16-a8e1-74bc8cf35147 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:57.636410 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-67554c19-8c77-4c16-a8e1-74bc8cf35147 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:57.636909 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-67554c19-8c77-4c16-a8e1-74bc8cf35147 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:57.637787 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-67554c19-8c77-4c16-a8e1-74bc8cf35147 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:57.638917 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-67554c19-8c77-4c16-a8e1-74bc8cf35147 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:57.639560 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-67554c19-8c77-4c16-a8e1-74bc8cf35147 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:57.640029 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-67554c19-8c77-4c16-a8e1-74bc8cf35147 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:57.824040 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d425de1b-7404-4b45-95c9-7f639cd22ccc tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:44:57.827146 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d425de1b-7404-4b45-95c9-7f639cd22ccc tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:57.840020 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d425de1b-7404-4b45-95c9-7f639cd22ccc tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:57.840899 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d425de1b-7404-4b45-95c9-7f639cd22ccc tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:57.841555 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d425de1b-7404-4b45-95c9-7f639cd22ccc tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:57.842596 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d425de1b-7404-4b45-95c9-7f639cd22ccc tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:57.844070 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d425de1b-7404-4b45-95c9-7f639cd22ccc tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:57.845238 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d425de1b-7404-4b45-95c9-7f639cd22ccc tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:57.855702 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-67554c19-8c77-4c16-a8e1-74bc8cf35147 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:57.867367 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-67554c19-8c77-4c16-a8e1-74bc8cf35147 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:57.870867 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-67554c19-8c77-4c16-a8e1-74bc8cf35147 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:57.872545 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-67554c19-8c77-4c16-a8e1-74bc8cf35147 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 2947 microversion: 2.32 time: 0.249499 Oct 23 01:44:57.873119 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3046/6181] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:44:57 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 2947 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:44:58.089134 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d425de1b-7404-4b45-95c9-7f639cd22ccc tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:58.101640 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d425de1b-7404-4b45-95c9-7f639cd22ccc tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1696 microversion: 2.1 time: 0.282847 Oct 23 01:44:58.102287 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3136/6182] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:44:57 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1696 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:44:58.124668 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0f1ba103-6ecf-4b95-8b80-8e23f4606879 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:44:58.125708 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0f1ba103-6ecf-4b95-8b80-8e23f4606879 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] [instance: b9d9cd93-7e56-49b2-8b42-71ea75da9053] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:58.135953 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0f1ba103-6ecf-4b95-8b80-8e23f4606879 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:58.136443 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0f1ba103-6ecf-4b95-8b80-8e23f4606879 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:58.137892 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0f1ba103-6ecf-4b95-8b80-8e23f4606879 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:58.139687 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0f1ba103-6ecf-4b95-8b80-8e23f4606879 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:58.141108 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0f1ba103-6ecf-4b95-8b80-8e23f4606879 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:58.141581 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0f1ba103-6ecf-4b95-8b80-8e23f4606879 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:58.216267 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0f1ba103-6ecf-4b95-8b80-8e23f4606879 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2985f6e7b7c4e91ac80db47d1f2dff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6377f05e21462b8a374170ec06a211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:58.225134 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0f1ba103-6ecf-4b95-8b80-8e23f4606879 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] 10.222.0.42 "GET /compute/v2.1/servers/b9d9cd93-7e56-49b2-8b42-71ea75da9053" status: 200 len: 1209 microversion: 2.1 time: 0.104335 Oct 23 01:44:58.225767 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3047/6183] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:44:58 2022] GET /compute/v2.1/servers/b9d9cd93-7e56-49b2-8b42-71ea75da9053 => generated 1209 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:44:58.608444 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-a2bb5ec1-ae54-4cb2-8c18-c9134df3be5b req-f29a112c-afe4-402d-89b7-cd0aa7cffe1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ebee1b1-ea00-4a5a-8da7-f2520e296848", "name": "network-vif-unplugged", "status": "completed", "tag": "c4e81e83-9fd2-4b8a-bdd8-c2f017a9b1bd"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:44:58.628428 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-a2bb5ec1-ae54-4cb2-8c18-c9134df3be5b req-f29a112c-afe4-402d-89b7-cd0aa7cffe1e service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:58.632758 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-a2bb5ec1-ae54-4cb2-8c18-c9134df3be5b req-f29a112c-afe4-402d-89b7-cd0aa7cffe1e service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:58.633511 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-a2bb5ec1-ae54-4cb2-8c18-c9134df3be5b req-f29a112c-afe4-402d-89b7-cd0aa7cffe1e service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:58.655713 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-a2bb5ec1-ae54-4cb2-8c18-c9134df3be5b req-f29a112c-afe4-402d-89b7-cd0aa7cffe1e service nova] Creating event network-vif-unplugged:c4e81e83-9fd2-4b8a-bdd8-c2f017a9b1bd for instance 7ebee1b1-ea00-4a5a-8da7-f2520e296848 on n-h2-master-1 Oct 23 01:44:58.662258 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [req-a2bb5ec1-ae54-4cb2-8c18-c9134df3be5b req-f29a112c-afe4-402d-89b7-cd0aa7cffe1e service nova] Instance 7ebee1b1-ea00-4a5a-8da7-f2520e296848 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120944) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 23 01:44:58.676864 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-a2bb5ec1-ae54-4cb2-8c18-c9134df3be5b req-f29a112c-afe4-402d-89b7-cd0aa7cffe1e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076732 Oct 23 01:44:58.678277 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3137/6184] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:44:58.910925 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6f13dec1-5778-4243-a4d1-4f0a188d9590 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:44:58.921575 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6f13dec1-5778-4243-a4d1-4f0a188d9590 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:58.939999 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:58.943183 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6f13dec1-5778-4243-a4d1-4f0a188d9590 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:58.943693 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6f13dec1-5778-4243-a4d1-4f0a188d9590 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:58.944143 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6f13dec1-5778-4243-a4d1-4f0a188d9590 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:58.949403 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6f13dec1-5778-4243-a4d1-4f0a188d9590 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:58.949403 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6f13dec1-5778-4243-a4d1-4f0a188d9590 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:58.949403 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6f13dec1-5778-4243-a4d1-4f0a188d9590 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:59.133630 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e046dfcd-ae94-48c8-898c-ee7535291346 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:44:59.134644 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e046dfcd-ae94-48c8-898c-ee7535291346 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:59.149164 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e046dfcd-ae94-48c8-898c-ee7535291346 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:59.154630 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e046dfcd-ae94-48c8-898c-ee7535291346 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:59.155992 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e046dfcd-ae94-48c8-898c-ee7535291346 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:59.156844 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e046dfcd-ae94-48c8-898c-ee7535291346 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:59.157418 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e046dfcd-ae94-48c8-898c-ee7535291346 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:59.158474 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e046dfcd-ae94-48c8-898c-ee7535291346 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:59.224654 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6f13dec1-5778-4243-a4d1-4f0a188d9590 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:59.235290 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6f13dec1-5778-4243-a4d1-4f0a188d9590 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:59.242196 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6f13dec1-5778-4243-a4d1-4f0a188d9590 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:59.242196 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6f13dec1-5778-4243-a4d1-4f0a188d9590 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 2947 microversion: 2.32 time: 0.341012 Oct 23 01:44:59.242196 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3048/6185] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:44:58 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 2947 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:44:59.258567 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-486f5c75-c949-4429-bfe3-8051cd5ee40d tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:44:59.259221 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-486f5c75-c949-4429-bfe3-8051cd5ee40d tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] [instance: b9d9cd93-7e56-49b2-8b42-71ea75da9053] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:44:59.269929 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-486f5c75-c949-4429-bfe3-8051cd5ee40d tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:59.271026 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-486f5c75-c949-4429-bfe3-8051cd5ee40d tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:59.271637 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-486f5c75-c949-4429-bfe3-8051cd5ee40d tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:59.272548 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-486f5c75-c949-4429-bfe3-8051cd5ee40d tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:44:59.273169 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-486f5c75-c949-4429-bfe3-8051cd5ee40d tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:44:59.273762 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-486f5c75-c949-4429-bfe3-8051cd5ee40d tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:44:59.401268 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-486f5c75-c949-4429-bfe3-8051cd5ee40d tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2985f6e7b7c4e91ac80db47d1f2dff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6377f05e21462b8a374170ec06a211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:59.418866 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e046dfcd-ae94-48c8-898c-ee7535291346 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:44:59.429869 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e046dfcd-ae94-48c8-898c-ee7535291346 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1696 microversion: 2.1 time: 0.300588 Oct 23 01:44:59.430892 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3138/6186] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:44:59 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1696 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:44:59.440261 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-486f5c75-c949-4429-bfe3-8051cd5ee40d tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] 10.222.0.42 "GET /compute/v2.1/servers/b9d9cd93-7e56-49b2-8b42-71ea75da9053" status: 200 len: 1265 microversion: 2.1 time: 0.189503 Oct 23 01:44:59.440865 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3049/6187] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:44:59 2022] GET /compute/v2.1/servers/b9d9cd93-7e56-49b2-8b42-71ea75da9053 => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:45:00.273468 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-70d94c25-05f0-407b-8628-63dec045f023 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:00.278569 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-70d94c25-05f0-407b-8628-63dec045f023 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:00.287766 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-70d94c25-05f0-407b-8628-63dec045f023 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:00.288257 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-70d94c25-05f0-407b-8628-63dec045f023 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:00.288704 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-70d94c25-05f0-407b-8628-63dec045f023 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:00.289413 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-70d94c25-05f0-407b-8628-63dec045f023 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:00.289904 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-70d94c25-05f0-407b-8628-63dec045f023 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:00.290326 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-70d94c25-05f0-407b-8628-63dec045f023 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:00.455203 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3ccaf6bb-a645-4f30-a5ea-f068f971d78c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:00.456563 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3ccaf6bb-a645-4f30-a5ea-f068f971d78c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:00.469231 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3ccaf6bb-a645-4f30-a5ea-f068f971d78c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:00.470240 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3ccaf6bb-a645-4f30-a5ea-f068f971d78c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:00.470936 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3ccaf6bb-a645-4f30-a5ea-f068f971d78c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:00.472518 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3ccaf6bb-a645-4f30-a5ea-f068f971d78c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:00.473222 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3ccaf6bb-a645-4f30-a5ea-f068f971d78c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:00.473919 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3ccaf6bb-a645-4f30-a5ea-f068f971d78c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:00.720422 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-70d94c25-05f0-407b-8628-63dec045f023 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:00.732865 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-70d94c25-05f0-407b-8628-63dec045f023 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:00.734265 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-70d94c25-05f0-407b-8628-63dec045f023 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:00.735607 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-70d94c25-05f0-407b-8628-63dec045f023 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 2926 microversion: 2.32 time: 0.466412 Oct 23 01:45:00.736752 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3139/6188] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:45:00 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 2926 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:45:00.742116 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d03a0387-ac39-4e52-b329-3cc08563d9f5 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:00.742265 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3ccaf6bb-a645-4f30-a5ea-f068f971d78c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:00.743162 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d03a0387-ac39-4e52-b329-3cc08563d9f5 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] [instance: b9d9cd93-7e56-49b2-8b42-71ea75da9053] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:00.750307 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d03a0387-ac39-4e52-b329-3cc08563d9f5 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:00.751585 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d03a0387-ac39-4e52-b329-3cc08563d9f5 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:00.752295 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d03a0387-ac39-4e52-b329-3cc08563d9f5 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:00.753266 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d03a0387-ac39-4e52-b329-3cc08563d9f5 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:00.754014 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d03a0387-ac39-4e52-b329-3cc08563d9f5 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:00.754688 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d03a0387-ac39-4e52-b329-3cc08563d9f5 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:00.764287 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3ccaf6bb-a645-4f30-a5ea-f068f971d78c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1696 microversion: 2.1 time: 0.312936 Oct 23 01:45:00.766006 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3050/6189] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:45:00 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1696 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:45:00.770623 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-37b96a50-1739-43d7-9eaf-52b9fb05a29a req-fe79f789-6ef4-4546-b7dc-1e21b820338b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ebee1b1-ea00-4a5a-8da7-f2520e296848", "tag": "c4e81e83-9fd2-4b8a-bdd8-c2f017a9b1bd"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:45:00.780213 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-37b96a50-1739-43d7-9eaf-52b9fb05a29a req-fe79f789-6ef4-4546-b7dc-1e21b820338b service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:00.780998 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-37b96a50-1739-43d7-9eaf-52b9fb05a29a req-fe79f789-6ef4-4546-b7dc-1e21b820338b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:00.781595 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-37b96a50-1739-43d7-9eaf-52b9fb05a29a req-fe79f789-6ef4-4546-b7dc-1e21b820338b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:00.795102 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-37b96a50-1739-43d7-9eaf-52b9fb05a29a req-fe79f789-6ef4-4546-b7dc-1e21b820338b service nova] Creating event network-changed:c4e81e83-9fd2-4b8a-bdd8-c2f017a9b1bd for instance 7ebee1b1-ea00-4a5a-8da7-f2520e296848 on n-h2-master-1 Oct 23 01:45:00.806452 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [req-37b96a50-1739-43d7-9eaf-52b9fb05a29a req-fe79f789-6ef4-4546-b7dc-1e21b820338b service nova] Instance 7ebee1b1-ea00-4a5a-8da7-f2520e296848 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120945) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 23 01:45:00.823845 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-37b96a50-1739-43d7-9eaf-52b9fb05a29a req-fe79f789-6ef4-4546-b7dc-1e21b820338b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056569 Oct 23 01:45:00.825603 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3051/6190] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:45:00.836467 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d03a0387-ac39-4e52-b329-3cc08563d9f5 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2985f6e7b7c4e91ac80db47d1f2dff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6377f05e21462b8a374170ec06a211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:00.850724 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d03a0387-ac39-4e52-b329-3cc08563d9f5 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] 10.222.0.42 "GET /compute/v2.1/servers/b9d9cd93-7e56-49b2-8b42-71ea75da9053" status: 200 len: 1283 microversion: 2.1 time: 0.112808 Oct 23 01:45:00.855454 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3140/6191] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:45:00 2022] GET /compute/v2.1/servers/b9d9cd93-7e56-49b2-8b42-71ea75da9053 => generated 1283 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:45:01.769221 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9886046c-145c-4ab6-884e-84f89e289407 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:01.769872 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9886046c-145c-4ab6-884e-84f89e289407 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:01.781780 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9886046c-145c-4ab6-884e-84f89e289407 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:01.782309 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9886046c-145c-4ab6-884e-84f89e289407 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:01.782755 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9886046c-145c-4ab6-884e-84f89e289407 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:01.792321 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-678d9899-d666-493f-8b64-30ae625df4ab tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:01.793622 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-678d9899-d666-493f-8b64-30ae625df4ab tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:01.798317 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:45:01.800928 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9886046c-145c-4ab6-884e-84f89e289407 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:01.805290 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9886046c-145c-4ab6-884e-84f89e289407 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:01.809722 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-678d9899-d666-493f-8b64-30ae625df4ab tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:01.812433 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-678d9899-d666-493f-8b64-30ae625df4ab tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:01.812569 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9886046c-145c-4ab6-884e-84f89e289407 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:01.817168 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-678d9899-d666-493f-8b64-30ae625df4ab tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:01.818298 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-678d9899-d666-493f-8b64-30ae625df4ab tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:01.820438 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-678d9899-d666-493f-8b64-30ae625df4ab tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:01.822218 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-678d9899-d666-493f-8b64-30ae625df4ab tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:01.876057 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:45:02.198721 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-678d9899-d666-493f-8b64-30ae625df4ab tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:02.209380 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-678d9899-d666-493f-8b64-30ae625df4ab tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1696 microversion: 2.1 time: 0.423368 Oct 23 01:45:02.210214 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3141/6192] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:45:01 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1696 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:45:02.216066 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-579c5a95-edf6-46e5-837a-c4db87d08def tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:02.217129 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-579c5a95-edf6-46e5-837a-c4db87d08def tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] [instance: b9d9cd93-7e56-49b2-8b42-71ea75da9053] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:02.225751 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-579c5a95-edf6-46e5-837a-c4db87d08def tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:02.227261 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-579c5a95-edf6-46e5-837a-c4db87d08def tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:02.233083 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-579c5a95-edf6-46e5-837a-c4db87d08def tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:02.235106 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-579c5a95-edf6-46e5-837a-c4db87d08def tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:02.236468 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-579c5a95-edf6-46e5-837a-c4db87d08def tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:02.237444 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-579c5a95-edf6-46e5-837a-c4db87d08def tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:02.269209 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9886046c-145c-4ab6-884e-84f89e289407 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:02.284746 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9886046c-145c-4ab6-884e-84f89e289407 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:02.286227 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9886046c-145c-4ab6-884e-84f89e289407 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:02.293214 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9886046c-145c-4ab6-884e-84f89e289407 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 2905 microversion: 2.32 time: 0.527598 Oct 23 01:45:02.296842 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3052/6193] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:45:01 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 2905 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:45:02.304072 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-177f49d5-521e-42db-a3af-944f584e4785 req-3e9db19f-ac0d-4b88-a569-61f828ae0edf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f47e3006-cfbb-48bb-ae86-b018486c5e21", "name": "network-vif-unplugged", "status": "completed", "tag": "345a0e13-1a42-4284-a64e-2fa1f828e62c"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:45:02.325205 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-177f49d5-521e-42db-a3af-944f584e4785 req-3e9db19f-ac0d-4b88-a569-61f828ae0edf service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:02.325699 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-177f49d5-521e-42db-a3af-944f584e4785 req-3e9db19f-ac0d-4b88-a569-61f828ae0edf service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:02.328883 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-177f49d5-521e-42db-a3af-944f584e4785 req-3e9db19f-ac0d-4b88-a569-61f828ae0edf service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:02.345932 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-579c5a95-edf6-46e5-837a-c4db87d08def tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2985f6e7b7c4e91ac80db47d1f2dff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6377f05e21462b8a374170ec06a211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:02.360016 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-579c5a95-edf6-46e5-837a-c4db87d08def tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] 10.222.0.42 "GET /compute/v2.1/servers/b9d9cd93-7e56-49b2-8b42-71ea75da9053" status: 200 len: 1271 microversion: 2.1 time: 0.148533 Oct 23 01:45:02.370009 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3142/6194] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:45:02 2022] GET /compute/v2.1/servers/b9d9cd93-7e56-49b2-8b42-71ea75da9053 => generated 1271 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:45:02.370485 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-177f49d5-521e-42db-a3af-944f584e4785 req-3e9db19f-ac0d-4b88-a569-61f828ae0edf service nova] Creating event network-vif-unplugged:345a0e13-1a42-4284-a64e-2fa1f828e62c for instance f47e3006-cfbb-48bb-ae86-b018486c5e21 on n-h2-master-1 Oct 23 01:45:02.370485 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-177f49d5-521e-42db-a3af-944f584e4785 req-3e9db19f-ac0d-4b88-a569-61f828ae0edf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070711 Oct 23 01:45:02.370485 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3053/6195] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:45:03.241434 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e60575f6-237d-4dfa-b507-c9c531301dd9 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:03.242779 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e60575f6-237d-4dfa-b507-c9c531301dd9 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:03.250364 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e60575f6-237d-4dfa-b507-c9c531301dd9 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:03.251813 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e60575f6-237d-4dfa-b507-c9c531301dd9 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:03.252540 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e60575f6-237d-4dfa-b507-c9c531301dd9 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:03.253365 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e60575f6-237d-4dfa-b507-c9c531301dd9 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:03.253935 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e60575f6-237d-4dfa-b507-c9c531301dd9 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:03.254495 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e60575f6-237d-4dfa-b507-c9c531301dd9 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:03.332750 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-41baa0a0-8eda-4b4e-a56b-9865ebfd2e7c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:03.333479 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-41baa0a0-8eda-4b4e-a56b-9865ebfd2e7c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:03.349697 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-41baa0a0-8eda-4b4e-a56b-9865ebfd2e7c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:03.350227 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-41baa0a0-8eda-4b4e-a56b-9865ebfd2e7c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:03.352268 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-41baa0a0-8eda-4b4e-a56b-9865ebfd2e7c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:03.355704 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-41baa0a0-8eda-4b4e-a56b-9865ebfd2e7c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:03.356319 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-41baa0a0-8eda-4b4e-a56b-9865ebfd2e7c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:03.357068 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-41baa0a0-8eda-4b4e-a56b-9865ebfd2e7c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:03.604553 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e60575f6-237d-4dfa-b507-c9c531301dd9 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:03.618790 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e60575f6-237d-4dfa-b507-c9c531301dd9 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1694 microversion: 2.1 time: 0.381891 Oct 23 01:45:03.632514 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3143/6196] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:45:03 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1694 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:45:03.641339 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-924512a7-ef1a-46ce-8e2f-b7b8d6ea13c0 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:03.641992 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-924512a7-ef1a-46ce-8e2f-b7b8d6ea13c0 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] [instance: b9d9cd93-7e56-49b2-8b42-71ea75da9053] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:03.657755 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-924512a7-ef1a-46ce-8e2f-b7b8d6ea13c0 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:03.664226 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-924512a7-ef1a-46ce-8e2f-b7b8d6ea13c0 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:03.664715 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-924512a7-ef1a-46ce-8e2f-b7b8d6ea13c0 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:03.665461 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-924512a7-ef1a-46ce-8e2f-b7b8d6ea13c0 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:03.665935 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-924512a7-ef1a-46ce-8e2f-b7b8d6ea13c0 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:03.666654 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-924512a7-ef1a-46ce-8e2f-b7b8d6ea13c0 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:03.709766 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-41baa0a0-8eda-4b4e-a56b-9865ebfd2e7c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:03.725715 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-41baa0a0-8eda-4b4e-a56b-9865ebfd2e7c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:03.735114 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-41baa0a0-8eda-4b4e-a56b-9865ebfd2e7c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:03.736626 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-41baa0a0-8eda-4b4e-a56b-9865ebfd2e7c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 2905 microversion: 2.32 time: 0.411588 Oct 23 01:45:03.737216 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3054/6197] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:45:03 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 2905 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:45:03.865696 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-924512a7-ef1a-46ce-8e2f-b7b8d6ea13c0 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2985f6e7b7c4e91ac80db47d1f2dff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6377f05e21462b8a374170ec06a211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:03.884660 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=100 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:45:03.889818 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-924512a7-ef1a-46ce-8e2f-b7b8d6ea13c0 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] 10.222.0.42 "GET /compute/v2.1/servers/b9d9cd93-7e56-49b2-8b42-71ea75da9053" status: 200 len: 1313 microversion: 2.1 time: 0.269352 Oct 23 01:45:03.890457 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3144/6198] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:45:03 2022] GET /compute/v2.1/servers/b9d9cd93-7e56-49b2-8b42-71ea75da9053 => generated 1313 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:45:04.402368 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-e0b81418-6350-432e-b258-dfa5a65b436e req-4cc26a3f-db52-486a-8b79-8f5997581cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f47e3006-cfbb-48bb-ae86-b018486c5e21", "name": "network-vif-unplugged", "status": "completed", "tag": "7f192cbc-e5eb-416b-ba58-875c5f887eb7"}, {"server_uuid": "f47e3006-cfbb-48bb-ae86-b018486c5e21", "name": "network-vif-unplugged", "status": "completed", "tag": "ee70f73c-88ff-4855-a82e-88caa393f0fc"}, {"server_uuid": "f47e3006-cfbb-48bb-ae86-b018486c5e21", "name": "network-vif-unplugged", "status": "completed", "tag": "020cb08c-2e13-452d-aab8-e6b34a8be515"}, {"server_uuid": "f47e3006-cfbb-48bb-ae86-b018486c5e21", "name": "network-vif-unplugged", "status": "completed", "tag": "b17738dd-6229-4e82-a18e-fbfd14792442"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:45:04.414432 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-e0b81418-6350-432e-b258-dfa5a65b436e req-4cc26a3f-db52-486a-8b79-8f5997581cb3 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:04.415560 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-e0b81418-6350-432e-b258-dfa5a65b436e req-4cc26a3f-db52-486a-8b79-8f5997581cb3 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:04.416100 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-e0b81418-6350-432e-b258-dfa5a65b436e req-4cc26a3f-db52-486a-8b79-8f5997581cb3 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:04.428952 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-e0b81418-6350-432e-b258-dfa5a65b436e req-4cc26a3f-db52-486a-8b79-8f5997581cb3 service nova] Creating event network-vif-unplugged:7f192cbc-e5eb-416b-ba58-875c5f887eb7 for instance f47e3006-cfbb-48bb-ae86-b018486c5e21 on n-h2-master-1 Oct 23 01:45:04.429546 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-e0b81418-6350-432e-b258-dfa5a65b436e req-4cc26a3f-db52-486a-8b79-8f5997581cb3 service nova] Creating event network-vif-unplugged:ee70f73c-88ff-4855-a82e-88caa393f0fc for instance f47e3006-cfbb-48bb-ae86-b018486c5e21 on n-h2-master-1 Oct 23 01:45:04.430166 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-e0b81418-6350-432e-b258-dfa5a65b436e req-4cc26a3f-db52-486a-8b79-8f5997581cb3 service nova] Creating event network-vif-unplugged:020cb08c-2e13-452d-aab8-e6b34a8be515 for instance f47e3006-cfbb-48bb-ae86-b018486c5e21 on n-h2-master-1 Oct 23 01:45:04.430729 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-e0b81418-6350-432e-b258-dfa5a65b436e req-4cc26a3f-db52-486a-8b79-8f5997581cb3 service nova] Creating event network-vif-unplugged:b17738dd-6229-4e82-a18e-fbfd14792442 for instance f47e3006-cfbb-48bb-ae86-b018486c5e21 on n-h2-master-1 Oct 23 01:45:04.438197 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-e0b81418-6350-432e-b258-dfa5a65b436e req-4cc26a3f-db52-486a-8b79-8f5997581cb3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.042615 Oct 23 01:45:04.438873 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3055/6199] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:45:04 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:45:04.643925 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f8813dd0-0f03-4cb4-ab4a-0c36b1ef9a78 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:04.644555 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f8813dd0-0f03-4cb4-ab4a-0c36b1ef9a78 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:04.652741 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8813dd0-0f03-4cb4-ab4a-0c36b1ef9a78 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:04.653581 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8813dd0-0f03-4cb4-ab4a-0c36b1ef9a78 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:04.654081 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8813dd0-0f03-4cb4-ab4a-0c36b1ef9a78 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:04.654800 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8813dd0-0f03-4cb4-ab4a-0c36b1ef9a78 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:04.655301 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8813dd0-0f03-4cb4-ab4a-0c36b1ef9a78 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:04.655743 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8813dd0-0f03-4cb4-ab4a-0c36b1ef9a78 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:04.767987 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-58046056-376f-4c0c-8359-bfdebb700cdc tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:04.768688 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-58046056-376f-4c0c-8359-bfdebb700cdc tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:04.782828 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-58046056-376f-4c0c-8359-bfdebb700cdc tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:04.783361 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-58046056-376f-4c0c-8359-bfdebb700cdc tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:04.785273 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-58046056-376f-4c0c-8359-bfdebb700cdc tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:04.786012 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-58046056-376f-4c0c-8359-bfdebb700cdc tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:04.786478 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-58046056-376f-4c0c-8359-bfdebb700cdc tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:04.786909 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-58046056-376f-4c0c-8359-bfdebb700cdc tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:04.863877 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f8813dd0-0f03-4cb4-ab4a-0c36b1ef9a78 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:04.882572 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f8813dd0-0f03-4cb4-ab4a-0c36b1ef9a78 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1691 microversion: 2.1 time: 0.233413 Oct 23 01:45:04.884132 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3145/6200] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:45:04 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1691 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:45:04.907496 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e2fdd2cd-a8fc-4c75-9b09-0882571e30fb tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:45:04.908684 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e2fdd2cd-a8fc-4c75-9b09-0882571e30fb tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:04.927583 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e2fdd2cd-a8fc-4c75-9b09-0882571e30fb tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:04.933525 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e2fdd2cd-a8fc-4c75-9b09-0882571e30fb tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:04.934103 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e2fdd2cd-a8fc-4c75-9b09-0882571e30fb tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:04.934935 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e2fdd2cd-a8fc-4c75-9b09-0882571e30fb tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:04.935484 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e2fdd2cd-a8fc-4c75-9b09-0882571e30fb tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:04.936222 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e2fdd2cd-a8fc-4c75-9b09-0882571e30fb tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:05.006832 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-58046056-376f-4c0c-8359-bfdebb700cdc tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:05.017859 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-58046056-376f-4c0c-8359-bfdebb700cdc tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:05.019360 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-58046056-376f-4c0c-8359-bfdebb700cdc tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:05.020625 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-58046056-376f-4c0c-8359-bfdebb700cdc tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 2905 microversion: 2.32 time: 0.257743 Oct 23 01:45:05.030969 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3056/6201] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:45:04 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 2905 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:45:05.030969 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0cfc96a4-8030-4e91-b157-f8ec384c3489 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:05.030969 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0cfc96a4-8030-4e91-b157-f8ec384c3489 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] [instance: b9d9cd93-7e56-49b2-8b42-71ea75da9053] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:05.034736 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0cfc96a4-8030-4e91-b157-f8ec384c3489 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:05.035719 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0cfc96a4-8030-4e91-b157-f8ec384c3489 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:05.036329 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0cfc96a4-8030-4e91-b157-f8ec384c3489 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:05.037199 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0cfc96a4-8030-4e91-b157-f8ec384c3489 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:05.037838 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0cfc96a4-8030-4e91-b157-f8ec384c3489 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:05.038452 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0cfc96a4-8030-4e91-b157-f8ec384c3489 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:05.245120 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0cfc96a4-8030-4e91-b157-f8ec384c3489 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2985f6e7b7c4e91ac80db47d1f2dff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6377f05e21462b8a374170ec06a211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:05.259291 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0cfc96a4-8030-4e91-b157-f8ec384c3489 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] 10.222.0.42 "GET /compute/v2.1/servers/b9d9cd93-7e56-49b2-8b42-71ea75da9053" status: 200 len: 1313 microversion: 2.1 time: 0.236245 Oct 23 01:45:05.259890 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3057/6202] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:45:05 2022] GET /compute/v2.1/servers/b9d9cd93-7e56-49b2-8b42-71ea75da9053 => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:45:05.265954 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-7ad4de02-d6d6-422e-a212-b7f9b6ff4c61 req-b4c10200-9ad9-49fa-8865-2e2c8e18e7c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9d9cd93-7e56-49b2-8b42-71ea75da9053", "tag": "4382116f-8309-46d1-8d66-700369b79501"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:45:05.277092 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-7ad4de02-d6d6-422e-a212-b7f9b6ff4c61 req-b4c10200-9ad9-49fa-8865-2e2c8e18e7c4 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:05.278110 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-7ad4de02-d6d6-422e-a212-b7f9b6ff4c61 req-b4c10200-9ad9-49fa-8865-2e2c8e18e7c4 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:05.278817 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-7ad4de02-d6d6-422e-a212-b7f9b6ff4c61 req-b4c10200-9ad9-49fa-8865-2e2c8e18e7c4 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:05.293550 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-7ad4de02-d6d6-422e-a212-b7f9b6ff4c61 req-b4c10200-9ad9-49fa-8865-2e2c8e18e7c4 service nova] Creating event network-changed:4382116f-8309-46d1-8d66-700369b79501 for instance b9d9cd93-7e56-49b2-8b42-71ea75da9053 on n-h1-master-1 Oct 23 01:45:05.299274 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-7ad4de02-d6d6-422e-a212-b7f9b6ff4c61 req-b4c10200-9ad9-49fa-8865-2e2c8e18e7c4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037943 Oct 23 01:45:05.300426 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3058/6203] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:45:05.380702 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e2fdd2cd-a8fc-4c75-9b09-0882571e30fb tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "POST /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848/action" status: 202 len: 0 microversion: 2.1 time: 0.477245 Oct 23 01:45:05.387826 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3146/6204] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:45:04 2022] POST /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848/action => generated 0 bytes in 484 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 23 01:45:05.393504 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-54c8ae6d-b3be-41c4-aec6-037f944d2b6e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:05.394270 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-54c8ae6d-b3be-41c4-aec6-037f944d2b6e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:05.411169 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54c8ae6d-b3be-41c4-aec6-037f944d2b6e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:05.411835 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54c8ae6d-b3be-41c4-aec6-037f944d2b6e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:05.412121 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54c8ae6d-b3be-41c4-aec6-037f944d2b6e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:05.412845 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54c8ae6d-b3be-41c4-aec6-037f944d2b6e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:05.413307 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54c8ae6d-b3be-41c4-aec6-037f944d2b6e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:05.413738 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54c8ae6d-b3be-41c4-aec6-037f944d2b6e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:05.616401 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-54c8ae6d-b3be-41c4-aec6-037f944d2b6e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:05.624855 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-54c8ae6d-b3be-41c4-aec6-037f944d2b6e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1690 microversion: 2.1 time: 0.237947 Oct 23 01:45:05.625442 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3059/6205] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:45:05 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1690 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:45:06.057853 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-04fc4c17-f874-4dd7-8792-ccf2f4e07c19 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:06.064685 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-04fc4c17-f874-4dd7-8792-ccf2f4e07c19 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:06.071271 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:45:06.072808 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=6 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:45:06.093895 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-04fc4c17-f874-4dd7-8792-ccf2f4e07c19 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:06.093895 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-04fc4c17-f874-4dd7-8792-ccf2f4e07c19 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:06.095469 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-04fc4c17-f874-4dd7-8792-ccf2f4e07c19 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:06.096248 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-04fc4c17-f874-4dd7-8792-ccf2f4e07c19 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:06.096721 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-04fc4c17-f874-4dd7-8792-ccf2f4e07c19 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:06.097191 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-04fc4c17-f874-4dd7-8792-ccf2f4e07c19 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:06.285680 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fc87806d-6b37-4e08-a83a-33a6b74048b7 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:06.286330 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-fc87806d-6b37-4e08-a83a-33a6b74048b7 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] [instance: b9d9cd93-7e56-49b2-8b42-71ea75da9053] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:06.288575 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:45:06.297276 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc87806d-6b37-4e08-a83a-33a6b74048b7 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:06.297772 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc87806d-6b37-4e08-a83a-33a6b74048b7 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:06.308783 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc87806d-6b37-4e08-a83a-33a6b74048b7 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:06.312679 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc87806d-6b37-4e08-a83a-33a6b74048b7 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:06.313174 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc87806d-6b37-4e08-a83a-33a6b74048b7 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:06.313609 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fc87806d-6b37-4e08-a83a-33a6b74048b7 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:06.574723 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-04fc4c17-f874-4dd7-8792-ccf2f4e07c19 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:06.633213 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-04fc4c17-f874-4dd7-8792-ccf2f4e07c19 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:06.643424 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-04fc4c17-f874-4dd7-8792-ccf2f4e07c19 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:06.658290 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-04fc4c17-f874-4dd7-8792-ccf2f4e07c19 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 2859 microversion: 2.32 time: 0.596453 Oct 23 01:45:06.658290 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3147/6206] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:45:06 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 2859 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:45:06.687347 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ff03b102-5447-415c-8b34-6d3f29b78da8 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:06.695373 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ff03b102-5447-415c-8b34-6d3f29b78da8 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:06.709644 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ff03b102-5447-415c-8b34-6d3f29b78da8 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:06.713267 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ff03b102-5447-415c-8b34-6d3f29b78da8 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:06.713838 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ff03b102-5447-415c-8b34-6d3f29b78da8 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:06.714798 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ff03b102-5447-415c-8b34-6d3f29b78da8 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:06.715541 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ff03b102-5447-415c-8b34-6d3f29b78da8 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:06.718674 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ff03b102-5447-415c-8b34-6d3f29b78da8 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:06.811973 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-fc87806d-6b37-4e08-a83a-33a6b74048b7 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2985f6e7b7c4e91ac80db47d1f2dff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6377f05e21462b8a374170ec06a211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:06.822952 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fc87806d-6b37-4e08-a83a-33a6b74048b7 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] 10.222.0.42 "GET /compute/v2.1/servers/b9d9cd93-7e56-49b2-8b42-71ea75da9053" status: 200 len: 1313 microversion: 2.1 time: 0.541069 Oct 23 01:45:06.825290 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3060/6207] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:45:06 2022] GET /compute/v2.1/servers/b9d9cd93-7e56-49b2-8b42-71ea75da9053 => generated 1313 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:45:07.070282 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ff03b102-5447-415c-8b34-6d3f29b78da8 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:07.083750 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ff03b102-5447-415c-8b34-6d3f29b78da8 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1690 microversion: 2.1 time: 0.430006 Oct 23 01:45:07.104744 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3148/6208] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:45:06 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1690 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:45:07.347316 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-5c1cc9b8-a749-4b9b-9f38-22f06fa1bfa1 req-58ee0af5-49e8-49c5-b269-8aaffaa3858d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f47e3006-cfbb-48bb-ae86-b018486c5e21", "name": "network-vif-deleted", "tag": "b17738dd-6229-4e82-a18e-fbfd14792442"}, {"server_uuid": "f47e3006-cfbb-48bb-ae86-b018486c5e21", "name": "network-vif-deleted", "tag": "7f192cbc-e5eb-416b-ba58-875c5f887eb7"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:45:07.386936 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-5c1cc9b8-a749-4b9b-9f38-22f06fa1bfa1 req-58ee0af5-49e8-49c5-b269-8aaffaa3858d service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:07.387455 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-5c1cc9b8-a749-4b9b-9f38-22f06fa1bfa1 req-58ee0af5-49e8-49c5-b269-8aaffaa3858d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:07.388477 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-5c1cc9b8-a749-4b9b-9f38-22f06fa1bfa1 req-58ee0af5-49e8-49c5-b269-8aaffaa3858d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:07.424202 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-5c1cc9b8-a749-4b9b-9f38-22f06fa1bfa1 req-58ee0af5-49e8-49c5-b269-8aaffaa3858d service nova] Creating event network-vif-deleted:b17738dd-6229-4e82-a18e-fbfd14792442 for instance f47e3006-cfbb-48bb-ae86-b018486c5e21 on n-h2-master-1 Oct 23 01:45:07.424741 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-5c1cc9b8-a749-4b9b-9f38-22f06fa1bfa1 req-58ee0af5-49e8-49c5-b269-8aaffaa3858d service nova] Creating event network-vif-deleted:7f192cbc-e5eb-416b-ba58-875c5f887eb7 for instance f47e3006-cfbb-48bb-ae86-b018486c5e21 on n-h2-master-1 Oct 23 01:45:07.437255 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-5c1cc9b8-a749-4b9b-9f38-22f06fa1bfa1 req-58ee0af5-49e8-49c5-b269-8aaffaa3858d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.108079 Oct 23 01:45:07.440933 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3061/6209] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:45:07.683695 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5adf7cb9-8083-4784-b68e-54b0f28fee18 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:07.684303 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5adf7cb9-8083-4784-b68e-54b0f28fee18 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:07.705506 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5adf7cb9-8083-4784-b68e-54b0f28fee18 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:07.706267 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5adf7cb9-8083-4784-b68e-54b0f28fee18 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:07.706874 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5adf7cb9-8083-4784-b68e-54b0f28fee18 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:07.707791 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5adf7cb9-8083-4784-b68e-54b0f28fee18 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:07.708404 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5adf7cb9-8083-4784-b68e-54b0f28fee18 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:07.709012 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5adf7cb9-8083-4784-b68e-54b0f28fee18 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:07.852849 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c92e59d8-ab57-44d4-b381-72445e88b0dc tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:07.855405 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c92e59d8-ab57-44d4-b381-72445e88b0dc tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] [instance: b9d9cd93-7e56-49b2-8b42-71ea75da9053] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:07.881175 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c92e59d8-ab57-44d4-b381-72445e88b0dc tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:07.895100 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c92e59d8-ab57-44d4-b381-72445e88b0dc tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:07.895100 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c92e59d8-ab57-44d4-b381-72445e88b0dc tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:07.895100 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c92e59d8-ab57-44d4-b381-72445e88b0dc tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:07.895100 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c92e59d8-ab57-44d4-b381-72445e88b0dc tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:07.897456 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c92e59d8-ab57-44d4-b381-72445e88b0dc tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:08.170196 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5adf7cb9-8083-4784-b68e-54b0f28fee18 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:08.192328 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5adf7cb9-8083-4784-b68e-54b0f28fee18 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:08.194556 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5adf7cb9-8083-4784-b68e-54b0f28fee18 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:08.197592 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5adf7cb9-8083-4784-b68e-54b0f28fee18 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 2528 microversion: 2.32 time: 0.516270 Oct 23 01:45:08.198050 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3149/6210] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:45:07 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 2528 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:45:08.205763 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5ba8fa6b-7777-4e3d-ac36-5355c70dc33a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:08.206647 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5ba8fa6b-7777-4e3d-ac36-5355c70dc33a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:08.217956 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5ba8fa6b-7777-4e3d-ac36-5355c70dc33a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:08.220821 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5ba8fa6b-7777-4e3d-ac36-5355c70dc33a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:08.221448 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5ba8fa6b-7777-4e3d-ac36-5355c70dc33a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:08.223634 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5ba8fa6b-7777-4e3d-ac36-5355c70dc33a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:08.225445 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5ba8fa6b-7777-4e3d-ac36-5355c70dc33a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:08.240327 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5ba8fa6b-7777-4e3d-ac36-5355c70dc33a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:08.366439 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c92e59d8-ab57-44d4-b381-72445e88b0dc tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2985f6e7b7c4e91ac80db47d1f2dff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6377f05e21462b8a374170ec06a211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:08.382241 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c92e59d8-ab57-44d4-b381-72445e88b0dc tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] 10.222.0.42 "GET /compute/v2.1/servers/b9d9cd93-7e56-49b2-8b42-71ea75da9053" status: 200 len: 1313 microversion: 2.1 time: 0.530538 Oct 23 01:45:08.385048 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3062/6211] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:45:07 2022] GET /compute/v2.1/servers/b9d9cd93-7e56-49b2-8b42-71ea75da9053 => generated 1313 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:45:08.604538 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5ba8fa6b-7777-4e3d-ac36-5355c70dc33a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:08.615005 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5ba8fa6b-7777-4e3d-ac36-5355c70dc33a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1690 microversion: 2.1 time: 0.415690 Oct 23 01:45:08.617700 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3150/6212] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:45:08 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1690 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:45:09.230454 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-709d3179-f83e-477e-9db1-4308fef5ad25 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:09.231101 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-709d3179-f83e-477e-9db1-4308fef5ad25 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:09.241289 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-709d3179-f83e-477e-9db1-4308fef5ad25 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:09.241924 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-709d3179-f83e-477e-9db1-4308fef5ad25 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:09.242857 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-709d3179-f83e-477e-9db1-4308fef5ad25 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:09.244793 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-709d3179-f83e-477e-9db1-4308fef5ad25 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:09.245838 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-709d3179-f83e-477e-9db1-4308fef5ad25 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:09.246520 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-709d3179-f83e-477e-9db1-4308fef5ad25 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:09.409151 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fe62c3bf-1ea3-4acc-8e95-735f8b35eb3a tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:09.409691 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fe62c3bf-1ea3-4acc-8e95-735f8b35eb3a tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] [instance: b9d9cd93-7e56-49b2-8b42-71ea75da9053] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:09.421781 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe62c3bf-1ea3-4acc-8e95-735f8b35eb3a tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:09.423796 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe62c3bf-1ea3-4acc-8e95-735f8b35eb3a tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:09.424245 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe62c3bf-1ea3-4acc-8e95-735f8b35eb3a tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:09.424982 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe62c3bf-1ea3-4acc-8e95-735f8b35eb3a tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:09.425442 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe62c3bf-1ea3-4acc-8e95-735f8b35eb3a tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:09.428898 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe62c3bf-1ea3-4acc-8e95-735f8b35eb3a tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:09.434244 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-709d3179-f83e-477e-9db1-4308fef5ad25 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:09.451507 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-709d3179-f83e-477e-9db1-4308fef5ad25 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:09.453503 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-709d3179-f83e-477e-9db1-4308fef5ad25 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:09.458878 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-709d3179-f83e-477e-9db1-4308fef5ad25 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 2368 microversion: 2.32 time: 0.234051 Oct 23 01:45:09.490473 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3063/6213] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:45:09 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 2368 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:45:09.495880 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-d39dd399-5e56-4747-897f-a3f522245d90 req-7ace9e34-2051-4b32-be02-6c7ecbf80616 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f47e3006-cfbb-48bb-ae86-b018486c5e21", "name": "network-vif-deleted", "tag": "020cb08c-2e13-452d-aab8-e6b34a8be515"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:45:09.507083 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-d39dd399-5e56-4747-897f-a3f522245d90 req-7ace9e34-2051-4b32-be02-6c7ecbf80616 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:09.508071 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-d39dd399-5e56-4747-897f-a3f522245d90 req-7ace9e34-2051-4b32-be02-6c7ecbf80616 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:09.510966 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-d39dd399-5e56-4747-897f-a3f522245d90 req-7ace9e34-2051-4b32-be02-6c7ecbf80616 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:09.538053 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-d39dd399-5e56-4747-897f-a3f522245d90 req-7ace9e34-2051-4b32-be02-6c7ecbf80616 service nova] Creating event network-vif-deleted:020cb08c-2e13-452d-aab8-e6b34a8be515 for instance f47e3006-cfbb-48bb-ae86-b018486c5e21 on n-h2-master-1 Oct 23 01:45:09.549358 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-d39dd399-5e56-4747-897f-a3f522245d90 req-7ace9e34-2051-4b32-be02-6c7ecbf80616 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057309 Oct 23 01:45:09.553602 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3064/6214] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:45:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:45:09.616085 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fe62c3bf-1ea3-4acc-8e95-735f8b35eb3a tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2985f6e7b7c4e91ac80db47d1f2dff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6377f05e21462b8a374170ec06a211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:09.625650 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fe62c3bf-1ea3-4acc-8e95-735f8b35eb3a tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] 10.222.0.42 "GET /compute/v2.1/servers/b9d9cd93-7e56-49b2-8b42-71ea75da9053" status: 200 len: 1313 microversion: 2.1 time: 0.221415 Oct 23 01:45:09.630350 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3151/6215] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:45:09 2022] GET /compute/v2.1/servers/b9d9cd93-7e56-49b2-8b42-71ea75da9053 => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:45:09.647589 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3457f8ba-4255-4b9f-bfbb-9b24e1d63e41 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:09.648597 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3457f8ba-4255-4b9f-bfbb-9b24e1d63e41 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:09.656889 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3457f8ba-4255-4b9f-bfbb-9b24e1d63e41 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:09.660154 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3457f8ba-4255-4b9f-bfbb-9b24e1d63e41 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:09.666126 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3457f8ba-4255-4b9f-bfbb-9b24e1d63e41 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:09.666126 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3457f8ba-4255-4b9f-bfbb-9b24e1d63e41 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:09.666126 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3457f8ba-4255-4b9f-bfbb-9b24e1d63e41 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:09.666126 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3457f8ba-4255-4b9f-bfbb-9b24e1d63e41 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:09.878970 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3457f8ba-4255-4b9f-bfbb-9b24e1d63e41 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:09.906831 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3457f8ba-4255-4b9f-bfbb-9b24e1d63e41 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1690 microversion: 2.1 time: 0.267302 Oct 23 01:45:09.930774 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3065/6216] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:45:09 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1690 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:45:10.207356 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-c1b50c9b-3dae-4cd8-940b-2fd84a2dbe58 req-4c6c75ce-379d-45c6-ad72-fe9fb3442cd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ebee1b1-ea00-4a5a-8da7-f2520e296848", "name": "network-vif-plugged", "status": "completed", "tag": "c4e81e83-9fd2-4b8a-bdd8-c2f017a9b1bd"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:45:10.234501 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-c1b50c9b-3dae-4cd8-940b-2fd84a2dbe58 req-4c6c75ce-379d-45c6-ad72-fe9fb3442cd3 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:10.242648 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-c1b50c9b-3dae-4cd8-940b-2fd84a2dbe58 req-4c6c75ce-379d-45c6-ad72-fe9fb3442cd3 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:10.242648 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-c1b50c9b-3dae-4cd8-940b-2fd84a2dbe58 req-4c6c75ce-379d-45c6-ad72-fe9fb3442cd3 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:10.251621 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-c1b50c9b-3dae-4cd8-940b-2fd84a2dbe58 req-4c6c75ce-379d-45c6-ad72-fe9fb3442cd3 service nova] Creating event network-vif-plugged:c4e81e83-9fd2-4b8a-bdd8-c2f017a9b1bd for instance 7ebee1b1-ea00-4a5a-8da7-f2520e296848 on n-h2-master-1 Oct 23 01:45:10.265617 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [req-c1b50c9b-3dae-4cd8-940b-2fd84a2dbe58 req-4c6c75ce-379d-45c6-ad72-fe9fb3442cd3 service nova] Instance 7ebee1b1-ea00-4a5a-8da7-f2520e296848 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120944) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 23 01:45:10.277825 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-c1b50c9b-3dae-4cd8-940b-2fd84a2dbe58 req-4c6c75ce-379d-45c6-ad72-fe9fb3442cd3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097932 Oct 23 01:45:10.278717 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3152/6217] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:45:10.495061 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d44ea2c0-ed78-4d30-a1d4-5752aea98a0e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:10.495775 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d44ea2c0-ed78-4d30-a1d4-5752aea98a0e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:10.513539 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d44ea2c0-ed78-4d30-a1d4-5752aea98a0e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:10.514497 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d44ea2c0-ed78-4d30-a1d4-5752aea98a0e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:10.515192 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d44ea2c0-ed78-4d30-a1d4-5752aea98a0e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:10.516153 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d44ea2c0-ed78-4d30-a1d4-5752aea98a0e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:10.516831 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d44ea2c0-ed78-4d30-a1d4-5752aea98a0e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:10.517756 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d44ea2c0-ed78-4d30-a1d4-5752aea98a0e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:10.656098 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a47c275d-794e-4044-90f7-8f5f9893dfc9 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:10.682579 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a47c275d-794e-4044-90f7-8f5f9893dfc9 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] [instance: b9d9cd93-7e56-49b2-8b42-71ea75da9053] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:10.717915 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a47c275d-794e-4044-90f7-8f5f9893dfc9 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:10.722750 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a47c275d-794e-4044-90f7-8f5f9893dfc9 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:10.724969 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a47c275d-794e-4044-90f7-8f5f9893dfc9 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:10.726011 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a47c275d-794e-4044-90f7-8f5f9893dfc9 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:10.729050 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a47c275d-794e-4044-90f7-8f5f9893dfc9 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:10.729773 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a47c275d-794e-4044-90f7-8f5f9893dfc9 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:10.823031 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d44ea2c0-ed78-4d30-a1d4-5752aea98a0e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:10.840832 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d44ea2c0-ed78-4d30-a1d4-5752aea98a0e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:10.848105 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d44ea2c0-ed78-4d30-a1d4-5752aea98a0e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:10.854370 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d44ea2c0-ed78-4d30-a1d4-5752aea98a0e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 2255 microversion: 2.32 time: 0.358562 Oct 23 01:45:10.855536 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3066/6218] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:45:10 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 2255 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:45:10.941760 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a15035dd-429f-4262-822b-8794fd0d84a4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:10.942673 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a15035dd-429f-4262-822b-8794fd0d84a4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:10.951552 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a15035dd-429f-4262-822b-8794fd0d84a4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:10.953282 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a15035dd-429f-4262-822b-8794fd0d84a4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:10.953901 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a15035dd-429f-4262-822b-8794fd0d84a4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:10.954866 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a15035dd-429f-4262-822b-8794fd0d84a4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:10.955545 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a15035dd-429f-4262-822b-8794fd0d84a4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:10.956584 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a15035dd-429f-4262-822b-8794fd0d84a4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:11.108446 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a47c275d-794e-4044-90f7-8f5f9893dfc9 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2985f6e7b7c4e91ac80db47d1f2dff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6377f05e21462b8a374170ec06a211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:11.121498 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a47c275d-794e-4044-90f7-8f5f9893dfc9 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] 10.222.0.42 "GET /compute/v2.1/servers/b9d9cd93-7e56-49b2-8b42-71ea75da9053" status: 200 len: 1313 microversion: 2.1 time: 0.468800 Oct 23 01:45:11.121498 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3153/6219] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:45:10 2022] GET /compute/v2.1/servers/b9d9cd93-7e56-49b2-8b42-71ea75da9053 => generated 1313 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:45:11.306860 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a15035dd-429f-4262-822b-8794fd0d84a4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:11.336145 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a15035dd-429f-4262-822b-8794fd0d84a4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1690 microversion: 2.1 time: 0.400396 Oct 23 01:45:11.342478 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3067/6220] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:45:10 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1690 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:45:11.565071 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-a2a47472-276a-46d9-8186-c7a55df47967 req-2f1c6981-3884-4d27-91e8-db4c12d9d936 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f47e3006-cfbb-48bb-ae86-b018486c5e21", "name": "network-vif-deleted", "tag": "345a0e13-1a42-4284-a64e-2fa1f828e62c"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:45:11.574898 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-a2a47472-276a-46d9-8186-c7a55df47967 req-2f1c6981-3884-4d27-91e8-db4c12d9d936 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:11.575371 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-a2a47472-276a-46d9-8186-c7a55df47967 req-2f1c6981-3884-4d27-91e8-db4c12d9d936 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:11.575798 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-a2a47472-276a-46d9-8186-c7a55df47967 req-2f1c6981-3884-4d27-91e8-db4c12d9d936 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:11.588524 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-a2a47472-276a-46d9-8186-c7a55df47967 req-2f1c6981-3884-4d27-91e8-db4c12d9d936 service nova] Creating event network-vif-deleted:345a0e13-1a42-4284-a64e-2fa1f828e62c for instance f47e3006-cfbb-48bb-ae86-b018486c5e21 on n-h2-master-1 Oct 23 01:45:11.595581 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-a2a47472-276a-46d9-8186-c7a55df47967 req-2f1c6981-3884-4d27-91e8-db4c12d9d936 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034681 Oct 23 01:45:11.596507 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3154/6221] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:45:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:45:11.884863 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9d1503d5-1221-4ef0-92ee-e80912a2a9ae tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:11.886868 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9d1503d5-1221-4ef0-92ee-e80912a2a9ae tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:11.895764 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d1503d5-1221-4ef0-92ee-e80912a2a9ae tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:11.896254 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d1503d5-1221-4ef0-92ee-e80912a2a9ae tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:11.896695 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d1503d5-1221-4ef0-92ee-e80912a2a9ae tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:11.903312 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d1503d5-1221-4ef0-92ee-e80912a2a9ae tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:11.903845 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d1503d5-1221-4ef0-92ee-e80912a2a9ae tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:11.904291 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d1503d5-1221-4ef0-92ee-e80912a2a9ae tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:11.980364 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9d1503d5-1221-4ef0-92ee-e80912a2a9ae tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:11.994007 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9d1503d5-1221-4ef0-92ee-e80912a2a9ae tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:11.997725 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9d1503d5-1221-4ef0-92ee-e80912a2a9ae tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:11.997725 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9d1503d5-1221-4ef0-92ee-e80912a2a9ae tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 2029 microversion: 2.32 time: 0.116538 Oct 23 01:45:11.999356 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3068/6222] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:45:11 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 2029 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:45:12.148669 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-73576086-081f-4c14-b182-c00980e9b305 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:12.150568 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-73576086-081f-4c14-b182-c00980e9b305 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] [instance: b9d9cd93-7e56-49b2-8b42-71ea75da9053] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:12.171082 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-73576086-081f-4c14-b182-c00980e9b305 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:12.172163 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-73576086-081f-4c14-b182-c00980e9b305 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:12.172796 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-73576086-081f-4c14-b182-c00980e9b305 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:12.173757 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-73576086-081f-4c14-b182-c00980e9b305 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:12.176937 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-73576086-081f-4c14-b182-c00980e9b305 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:12.178174 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-73576086-081f-4c14-b182-c00980e9b305 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:12.364303 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9965fd28-b101-4cde-895b-c17860e3ceae tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:12.364933 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9965fd28-b101-4cde-895b-c17860e3ceae tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:12.381497 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9965fd28-b101-4cde-895b-c17860e3ceae tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:12.382079 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9965fd28-b101-4cde-895b-c17860e3ceae tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:12.382531 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9965fd28-b101-4cde-895b-c17860e3ceae tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:12.383265 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9965fd28-b101-4cde-895b-c17860e3ceae tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:12.388012 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9965fd28-b101-4cde-895b-c17860e3ceae tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:12.388768 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9965fd28-b101-4cde-895b-c17860e3ceae tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:12.736127 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-73576086-081f-4c14-b182-c00980e9b305 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2985f6e7b7c4e91ac80db47d1f2dff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6377f05e21462b8a374170ec06a211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:12.763373 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-73576086-081f-4c14-b182-c00980e9b305 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] 10.222.0.42 "GET /compute/v2.1/servers/b9d9cd93-7e56-49b2-8b42-71ea75da9053" status: 200 len: 1313 microversion: 2.1 time: 0.618106 Oct 23 01:45:12.765669 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3155/6223] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:45:12 2022] GET /compute/v2.1/servers/b9d9cd93-7e56-49b2-8b42-71ea75da9053 => generated 1313 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:45:12.774745 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9965fd28-b101-4cde-895b-c17860e3ceae tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:12.785736 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9965fd28-b101-4cde-895b-c17860e3ceae tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1690 microversion: 2.1 time: 0.425226 Oct 23 01:45:12.788008 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3069/6224] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:45:12 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1690 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:45:13.025237 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a520388a-1111-4fcc-8cd7-c22d6cf34c49 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:13.026262 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a520388a-1111-4fcc-8cd7-c22d6cf34c49 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:13.044912 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a520388a-1111-4fcc-8cd7-c22d6cf34c49 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:13.046114 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a520388a-1111-4fcc-8cd7-c22d6cf34c49 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:13.047049 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a520388a-1111-4fcc-8cd7-c22d6cf34c49 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:13.050556 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a520388a-1111-4fcc-8cd7-c22d6cf34c49 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:13.051997 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a520388a-1111-4fcc-8cd7-c22d6cf34c49 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:13.054354 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a520388a-1111-4fcc-8cd7-c22d6cf34c49 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:13.202404 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a520388a-1111-4fcc-8cd7-c22d6cf34c49 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:13.220949 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a520388a-1111-4fcc-8cd7-c22d6cf34c49 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:13.222463 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a520388a-1111-4fcc-8cd7-c22d6cf34c49 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:13.223694 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a520388a-1111-4fcc-8cd7-c22d6cf34c49 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1605 microversion: 2.32 time: 0.202820 Oct 23 01:45:13.224260 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3156/6225] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:45:13 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1605 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:45:13.391438 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-201e5770-3758-4101-8bd9-f6450e198cf3 req-99e62a48-2209-423f-b3d7-05926a7a84aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9d9cd93-7e56-49b2-8b42-71ea75da9053", "name": "network-vif-plugged", "status": "completed", "tag": "4382116f-8309-46d1-8d66-700369b79501"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:45:13.422586 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-201e5770-3758-4101-8bd9-f6450e198cf3 req-99e62a48-2209-423f-b3d7-05926a7a84aa service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:13.423164 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-201e5770-3758-4101-8bd9-f6450e198cf3 req-99e62a48-2209-423f-b3d7-05926a7a84aa service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:13.423616 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-201e5770-3758-4101-8bd9-f6450e198cf3 req-99e62a48-2209-423f-b3d7-05926a7a84aa service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:13.457090 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-201e5770-3758-4101-8bd9-f6450e198cf3 req-99e62a48-2209-423f-b3d7-05926a7a84aa service nova] Creating event network-vif-plugged:4382116f-8309-46d1-8d66-700369b79501 for instance b9d9cd93-7e56-49b2-8b42-71ea75da9053 on n-h1-master-1 Oct 23 01:45:13.462675 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-201e5770-3758-4101-8bd9-f6450e198cf3 req-99e62a48-2209-423f-b3d7-05926a7a84aa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075176 Oct 23 01:45:13.467928 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3070/6226] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:45:13.622293 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-26839b5d-a1e2-4471-9db7-010063a678fd req-f3437ead-2136-46fa-be88-eb34532c23a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f47e3006-cfbb-48bb-ae86-b018486c5e21", "name": "network-vif-deleted", "tag": "ee70f73c-88ff-4855-a82e-88caa393f0fc"}, {"server_uuid": "7ebee1b1-ea00-4a5a-8da7-f2520e296848", "name": "network-vif-unplugged", "status": "completed", "tag": "c4e81e83-9fd2-4b8a-bdd8-c2f017a9b1bd"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:45:13.659134 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-26839b5d-a1e2-4471-9db7-010063a678fd req-f3437ead-2136-46fa-be88-eb34532c23a1 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:13.659310 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-26839b5d-a1e2-4471-9db7-010063a678fd req-f3437ead-2136-46fa-be88-eb34532c23a1 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:13.662225 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-26839b5d-a1e2-4471-9db7-010063a678fd req-f3437ead-2136-46fa-be88-eb34532c23a1 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:13.691784 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-26839b5d-a1e2-4471-9db7-010063a678fd req-f3437ead-2136-46fa-be88-eb34532c23a1 service nova] Creating event network-vif-deleted:ee70f73c-88ff-4855-a82e-88caa393f0fc for instance f47e3006-cfbb-48bb-ae86-b018486c5e21 on n-h2-master-1 Oct 23 01:45:13.692327 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-26839b5d-a1e2-4471-9db7-010063a678fd req-f3437ead-2136-46fa-be88-eb34532c23a1 service nova] Creating event network-vif-unplugged:c4e81e83-9fd2-4b8a-bdd8-c2f017a9b1bd for instance 7ebee1b1-ea00-4a5a-8da7-f2520e296848 on n-h1-master-1 Oct 23 01:45:13.702426 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [req-26839b5d-a1e2-4471-9db7-010063a678fd req-f3437ead-2136-46fa-be88-eb34532c23a1 service nova] Instance 7ebee1b1-ea00-4a5a-8da7-f2520e296848 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120944) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 23 01:45:13.739430 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-26839b5d-a1e2-4471-9db7-010063a678fd req-f3437ead-2136-46fa-be88-eb34532c23a1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.119586 Oct 23 01:45:13.741920 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3157/6227] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:45:13.789000 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-46c468d7-e046-4b18-b5d1-5a9c24959371 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:13.790097 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-46c468d7-e046-4b18-b5d1-5a9c24959371 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] [instance: b9d9cd93-7e56-49b2-8b42-71ea75da9053] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:13.802307 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46c468d7-e046-4b18-b5d1-5a9c24959371 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:13.802812 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46c468d7-e046-4b18-b5d1-5a9c24959371 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:13.803997 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46c468d7-e046-4b18-b5d1-5a9c24959371 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:13.804724 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46c468d7-e046-4b18-b5d1-5a9c24959371 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:13.807295 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46c468d7-e046-4b18-b5d1-5a9c24959371 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:13.807790 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46c468d7-e046-4b18-b5d1-5a9c24959371 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:13.818231 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-83406a48-9ac0-4baa-86c1-7f1158f9aace tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:13.819035 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-83406a48-9ac0-4baa-86c1-7f1158f9aace tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:13.832317 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-83406a48-9ac0-4baa-86c1-7f1158f9aace tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:13.833084 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-83406a48-9ac0-4baa-86c1-7f1158f9aace tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:13.833837 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-83406a48-9ac0-4baa-86c1-7f1158f9aace tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:13.834783 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-83406a48-9ac0-4baa-86c1-7f1158f9aace tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:13.835423 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-83406a48-9ac0-4baa-86c1-7f1158f9aace tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:13.836024 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-83406a48-9ac0-4baa-86c1-7f1158f9aace tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:14.157730 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-46c468d7-e046-4b18-b5d1-5a9c24959371 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2985f6e7b7c4e91ac80db47d1f2dff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6377f05e21462b8a374170ec06a211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:14.169238 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-46c468d7-e046-4b18-b5d1-5a9c24959371 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] 10.222.0.42 "GET /compute/v2.1/servers/b9d9cd93-7e56-49b2-8b42-71ea75da9053" status: 200 len: 1313 microversion: 2.1 time: 0.384295 Oct 23 01:45:14.171165 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3071/6228] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:45:13 2022] GET /compute/v2.1/servers/b9d9cd93-7e56-49b2-8b42-71ea75da9053 => generated 1313 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:45:14.251388 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c5c3fbb5-d48d-49a3-97d2-8b123cff8b10 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:14.252008 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c5c3fbb5-d48d-49a3-97d2-8b123cff8b10 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:14.261135 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c5c3fbb5-d48d-49a3-97d2-8b123cff8b10 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:14.266901 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c5c3fbb5-d48d-49a3-97d2-8b123cff8b10 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:14.266901 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c5c3fbb5-d48d-49a3-97d2-8b123cff8b10 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:14.268308 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c5c3fbb5-d48d-49a3-97d2-8b123cff8b10 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:14.268794 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c5c3fbb5-d48d-49a3-97d2-8b123cff8b10 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:14.269235 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c5c3fbb5-d48d-49a3-97d2-8b123cff8b10 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:14.317562 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-83406a48-9ac0-4baa-86c1-7f1158f9aace tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:14.334342 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-83406a48-9ac0-4baa-86c1-7f1158f9aace tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1690 microversion: 2.1 time: 0.518270 Oct 23 01:45:14.339722 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3158/6229] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:45:13 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1690 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:45:14.364029 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c5c3fbb5-d48d-49a3-97d2-8b123cff8b10 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:14.373909 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c5c3fbb5-d48d-49a3-97d2-8b123cff8b10 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:14.375653 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c5c3fbb5-d48d-49a3-97d2-8b123cff8b10 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:14.377016 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c5c3fbb5-d48d-49a3-97d2-8b123cff8b10 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1605 microversion: 2.32 time: 0.129621 Oct 23 01:45:14.378010 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3072/6230] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:45:14 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1605 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:45:15.198929 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-02a05e85-af14-4014-bb29-5943b935bee3 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:15.200050 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-02a05e85-af14-4014-bb29-5943b935bee3 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] [instance: b9d9cd93-7e56-49b2-8b42-71ea75da9053] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:15.231823 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-02a05e85-af14-4014-bb29-5943b935bee3 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:15.232508 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-02a05e85-af14-4014-bb29-5943b935bee3 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:15.234731 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-02a05e85-af14-4014-bb29-5943b935bee3 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:15.240756 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-02a05e85-af14-4014-bb29-5943b935bee3 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:15.240756 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-02a05e85-af14-4014-bb29-5943b935bee3 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:15.240756 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-02a05e85-af14-4014-bb29-5943b935bee3 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:15.364609 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1b52e989-bfde-4f41-b2a0-3af301d326f4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:15.365235 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1b52e989-bfde-4f41-b2a0-3af301d326f4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:15.381306 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b52e989-bfde-4f41-b2a0-3af301d326f4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:15.383986 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b52e989-bfde-4f41-b2a0-3af301d326f4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:15.384539 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b52e989-bfde-4f41-b2a0-3af301d326f4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:15.386189 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b52e989-bfde-4f41-b2a0-3af301d326f4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:15.386672 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b52e989-bfde-4f41-b2a0-3af301d326f4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:15.387103 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1b52e989-bfde-4f41-b2a0-3af301d326f4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:15.402902 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=100 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:45:15.507647 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-02a05e85-af14-4014-bb29-5943b935bee3 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2985f6e7b7c4e91ac80db47d1f2dff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6377f05e21462b8a374170ec06a211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:15.522549 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-02a05e85-af14-4014-bb29-5943b935bee3 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] 10.222.0.42 "GET /compute/v2.1/servers/b9d9cd93-7e56-49b2-8b42-71ea75da9053" status: 200 len: 1313 microversion: 2.1 time: 0.329952 Oct 23 01:45:15.538436 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3159/6231] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:45:15 2022] GET /compute/v2.1/servers/b9d9cd93-7e56-49b2-8b42-71ea75da9053 => generated 1313 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:45:15.543768 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fc2d8cdb-a661-454b-af10-8268845baba4 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:15.544432 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fc2d8cdb-a661-454b-af10-8268845baba4 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:15.559811 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fc2d8cdb-a661-454b-af10-8268845baba4 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:15.570497 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fc2d8cdb-a661-454b-af10-8268845baba4 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:15.571133 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fc2d8cdb-a661-454b-af10-8268845baba4 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:15.572130 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fc2d8cdb-a661-454b-af10-8268845baba4 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:15.572763 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fc2d8cdb-a661-454b-af10-8268845baba4 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:15.573358 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fc2d8cdb-a661-454b-af10-8268845baba4 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:15.691793 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1b52e989-bfde-4f41-b2a0-3af301d326f4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:15.700759 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1b52e989-bfde-4f41-b2a0-3af301d326f4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1690 microversion: 2.1 time: 0.340140 Oct 23 01:45:15.700967 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fc2d8cdb-a661-454b-af10-8268845baba4 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:15.702696 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3073/6232] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:45:15 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1690 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:45:15.729472 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fc2d8cdb-a661-454b-af10-8268845baba4 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:15.732380 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fc2d8cdb-a661-454b-af10-8268845baba4 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:15.734053 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fc2d8cdb-a661-454b-af10-8268845baba4 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1605 microversion: 2.32 time: 0.194510 Oct 23 01:45:15.735733 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3160/6233] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:45:15 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1605 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:45:15.760634 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-7ac5299e-0056-4845-838d-ee180be34cf3 req-d06d6f2b-a57c-4ca1-b53a-c0c3127f8857 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ebee1b1-ea00-4a5a-8da7-f2520e296848", "tag": "c4e81e83-9fd2-4b8a-bdd8-c2f017a9b1bd"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:45:15.774745 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-7ac5299e-0056-4845-838d-ee180be34cf3 req-d06d6f2b-a57c-4ca1-b53a-c0c3127f8857 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:15.775841 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-7ac5299e-0056-4845-838d-ee180be34cf3 req-d06d6f2b-a57c-4ca1-b53a-c0c3127f8857 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:15.776998 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-7ac5299e-0056-4845-838d-ee180be34cf3 req-d06d6f2b-a57c-4ca1-b53a-c0c3127f8857 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:15.805259 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-7ac5299e-0056-4845-838d-ee180be34cf3 req-d06d6f2b-a57c-4ca1-b53a-c0c3127f8857 service nova] Creating event network-changed:c4e81e83-9fd2-4b8a-bdd8-c2f017a9b1bd for instance 7ebee1b1-ea00-4a5a-8da7-f2520e296848 on n-h1-master-1 Oct 23 01:45:15.813054 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [req-7ac5299e-0056-4845-838d-ee180be34cf3 req-d06d6f2b-a57c-4ca1-b53a-c0c3127f8857 service nova] Instance 7ebee1b1-ea00-4a5a-8da7-f2520e296848 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120945) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 23 01:45:15.830817 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-7ac5299e-0056-4845-838d-ee180be34cf3 req-d06d6f2b-a57c-4ca1-b53a-c0c3127f8857 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076108 Oct 23 01:45:15.831778 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3074/6234] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:45:16.544896 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3ca69e39-6abc-414c-908c-7bb7c1ad3e4d tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:16.547202 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3ca69e39-6abc-414c-908c-7bb7c1ad3e4d tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] [instance: b9d9cd93-7e56-49b2-8b42-71ea75da9053] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:16.558467 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3ca69e39-6abc-414c-908c-7bb7c1ad3e4d tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:16.565374 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3ca69e39-6abc-414c-908c-7bb7c1ad3e4d tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:16.565920 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3ca69e39-6abc-414c-908c-7bb7c1ad3e4d tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:16.566794 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3ca69e39-6abc-414c-908c-7bb7c1ad3e4d tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:16.567334 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3ca69e39-6abc-414c-908c-7bb7c1ad3e4d tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:16.567826 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3ca69e39-6abc-414c-908c-7bb7c1ad3e4d tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:16.572660 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:45:16.726980 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e2fab193-8cab-45a7-a045-cfefa32ff579 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:16.729113 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e2fab193-8cab-45a7-a045-cfefa32ff579 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:16.740117 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e2fab193-8cab-45a7-a045-cfefa32ff579 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:16.740854 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e2fab193-8cab-45a7-a045-cfefa32ff579 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:16.741501 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e2fab193-8cab-45a7-a045-cfefa32ff579 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:16.742823 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e2fab193-8cab-45a7-a045-cfefa32ff579 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:16.743588 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e2fab193-8cab-45a7-a045-cfefa32ff579 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:16.744331 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e2fab193-8cab-45a7-a045-cfefa32ff579 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:16.969589 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3ca69e39-6abc-414c-908c-7bb7c1ad3e4d tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2985f6e7b7c4e91ac80db47d1f2dff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6377f05e21462b8a374170ec06a211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:16.981707 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3ca69e39-6abc-414c-908c-7bb7c1ad3e4d tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] 10.222.0.42 "GET /compute/v2.1/servers/b9d9cd93-7e56-49b2-8b42-71ea75da9053" status: 200 len: 1496 microversion: 2.1 time: 0.440846 Oct 23 01:45:16.982608 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3161/6235] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:45:16 2022] GET /compute/v2.1/servers/b9d9cd93-7e56-49b2-8b42-71ea75da9053 => generated 1496 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:45:16.988898 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f8893e5b-785b-47dd-bdba-c5f76be15879 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:16.989525 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f8893e5b-785b-47dd-bdba-c5f76be15879 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:17.004702 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8893e5b-785b-47dd-bdba-c5f76be15879 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:17.005211 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8893e5b-785b-47dd-bdba-c5f76be15879 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:17.005668 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8893e5b-785b-47dd-bdba-c5f76be15879 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:17.006825 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8893e5b-785b-47dd-bdba-c5f76be15879 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:17.007133 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8893e5b-785b-47dd-bdba-c5f76be15879 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:17.007742 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8893e5b-785b-47dd-bdba-c5f76be15879 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:17.174806 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e2fab193-8cab-45a7-a045-cfefa32ff579 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:17.189497 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e2fab193-8cab-45a7-a045-cfefa32ff579 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1690 microversion: 2.1 time: 0.464863 Oct 23 01:45:17.191492 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3075/6236] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:45:16 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1690 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:45:17.203777 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f8893e5b-785b-47dd-bdba-c5f76be15879 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:17.215846 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f8893e5b-785b-47dd-bdba-c5f76be15879 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:17.218526 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f8893e5b-785b-47dd-bdba-c5f76be15879 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:17.220155 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f8893e5b-785b-47dd-bdba-c5f76be15879 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1605 microversion: 2.32 time: 0.236518 Oct 23 01:45:17.221440 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3162/6237] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:45:16 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1605 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:45:18.215720 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d5a9f540-4a49-4a8c-81bc-82cf79d432ac tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:18.218009 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d5a9f540-4a49-4a8c-81bc-82cf79d432ac tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:18.229020 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d5a9f540-4a49-4a8c-81bc-82cf79d432ac tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:18.230050 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d5a9f540-4a49-4a8c-81bc-82cf79d432ac tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:18.230908 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d5a9f540-4a49-4a8c-81bc-82cf79d432ac tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:18.232251 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d5a9f540-4a49-4a8c-81bc-82cf79d432ac tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:18.234499 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d5a9f540-4a49-4a8c-81bc-82cf79d432ac tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:18.235516 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d5a9f540-4a49-4a8c-81bc-82cf79d432ac tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:18.251808 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ed077543-ae9a-45c9-acc7-54214efe8b3e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:18.252429 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ed077543-ae9a-45c9-acc7-54214efe8b3e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:18.261754 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ed077543-ae9a-45c9-acc7-54214efe8b3e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:18.262554 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ed077543-ae9a-45c9-acc7-54214efe8b3e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:18.263438 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ed077543-ae9a-45c9-acc7-54214efe8b3e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:18.279024 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ed077543-ae9a-45c9-acc7-54214efe8b3e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:18.279024 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ed077543-ae9a-45c9-acc7-54214efe8b3e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:18.279024 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ed077543-ae9a-45c9-acc7-54214efe8b3e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:18.408986 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ed077543-ae9a-45c9-acc7-54214efe8b3e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:18.422207 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ed077543-ae9a-45c9-acc7-54214efe8b3e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:18.430513 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ed077543-ae9a-45c9-acc7-54214efe8b3e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:18.432335 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ed077543-ae9a-45c9-acc7-54214efe8b3e tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1605 microversion: 2.32 time: 0.187182 Oct 23 01:45:18.434925 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3163/6238] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:45:18 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1605 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 01:45:18.499353 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d5a9f540-4a49-4a8c-81bc-82cf79d432ac tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:18.508807 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d5a9f540-4a49-4a8c-81bc-82cf79d432ac tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1683 microversion: 2.1 time: 0.299345 Oct 23 01:45:18.509938 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3076/6239] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:45:18 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1683 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:45:18.772465 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d230af25-c3d7-4c4e-a0a7-41cf16b903ea tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:18.773020 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d230af25-c3d7-4c4e-a0a7-41cf16b903ea tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] [instance: b9d9cd93-7e56-49b2-8b42-71ea75da9053] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:18.786729 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d230af25-c3d7-4c4e-a0a7-41cf16b903ea tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:18.788166 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d230af25-c3d7-4c4e-a0a7-41cf16b903ea tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:18.788789 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d230af25-c3d7-4c4e-a0a7-41cf16b903ea tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:18.789680 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d230af25-c3d7-4c4e-a0a7-41cf16b903ea tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:18.790344 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d230af25-c3d7-4c4e-a0a7-41cf16b903ea tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:18.791655 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d230af25-c3d7-4c4e-a0a7-41cf16b903ea tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:18.838419 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d230af25-c3d7-4c4e-a0a7-41cf16b903ea tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] [instance: b9d9cd93-7e56-49b2-8b42-71ea75da9053] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:45:19.237872 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d230af25-c3d7-4c4e-a0a7-41cf16b903ea tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b9d9cd93-7e56-49b2-8b42-71ea75da9053" status: 204 len: 0 microversion: 2.1 time: 0.473285 Oct 23 01:45:19.238582 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3164/6240] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:45:18 2022] DELETE /compute/v2.1/servers/b9d9cd93-7e56-49b2-8b42-71ea75da9053 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:45:19.251894 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6a70d117-e5d8-476d-8bdf-c0b535b02e14 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:19.253182 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6a70d117-e5d8-476d-8bdf-c0b535b02e14 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] [instance: b9d9cd93-7e56-49b2-8b42-71ea75da9053] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:19.266307 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6a70d117-e5d8-476d-8bdf-c0b535b02e14 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:19.269088 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6a70d117-e5d8-476d-8bdf-c0b535b02e14 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:19.269540 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6a70d117-e5d8-476d-8bdf-c0b535b02e14 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:19.270386 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6a70d117-e5d8-476d-8bdf-c0b535b02e14 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:19.271027 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6a70d117-e5d8-476d-8bdf-c0b535b02e14 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:19.271647 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6a70d117-e5d8-476d-8bdf-c0b535b02e14 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:19.425197 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6a70d117-e5d8-476d-8bdf-c0b535b02e14 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2985f6e7b7c4e91ac80db47d1f2dff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6377f05e21462b8a374170ec06a211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:19.433767 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6a70d117-e5d8-476d-8bdf-c0b535b02e14 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] 10.222.0.42 "GET /compute/v2.1/servers/b9d9cd93-7e56-49b2-8b42-71ea75da9053" status: 200 len: 1502 microversion: 2.1 time: 0.189158 Oct 23 01:45:19.434694 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3077/6241] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:45:19 2022] GET /compute/v2.1/servers/b9d9cd93-7e56-49b2-8b42-71ea75da9053 => generated 1502 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:45:19.465152 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-eb86e7d9-f4ab-4ed2-8ccb-2322ff6541de tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:19.465862 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-eb86e7d9-f4ab-4ed2-8ccb-2322ff6541de tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:19.495426 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb86e7d9-f4ab-4ed2-8ccb-2322ff6541de tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:19.495930 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb86e7d9-f4ab-4ed2-8ccb-2322ff6541de tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:19.496454 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb86e7d9-f4ab-4ed2-8ccb-2322ff6541de tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:19.497088 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb86e7d9-f4ab-4ed2-8ccb-2322ff6541de tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:19.497790 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb86e7d9-f4ab-4ed2-8ccb-2322ff6541de tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:19.498521 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb86e7d9-f4ab-4ed2-8ccb-2322ff6541de tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:19.589359 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-eb86e7d9-f4ab-4ed2-8ccb-2322ff6541de tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:19.602583 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-eb86e7d9-f4ab-4ed2-8ccb-2322ff6541de tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:19.604737 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-eb86e7d9-f4ab-4ed2-8ccb-2322ff6541de tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:19.606270 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-eb86e7d9-f4ab-4ed2-8ccb-2322ff6541de tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1605 microversion: 2.32 time: 0.145163 Oct 23 01:45:19.607127 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3165/6242] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:45:19 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1605 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:45:20.463708 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bff8c50d-243c-4073-83dd-22ba5414e600 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:20.464438 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-bff8c50d-243c-4073-83dd-22ba5414e600 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] [instance: b9d9cd93-7e56-49b2-8b42-71ea75da9053] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:20.487827 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bff8c50d-243c-4073-83dd-22ba5414e600 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:20.488796 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bff8c50d-243c-4073-83dd-22ba5414e600 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:20.489479 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bff8c50d-243c-4073-83dd-22ba5414e600 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:20.490485 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bff8c50d-243c-4073-83dd-22ba5414e600 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:20.491451 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bff8c50d-243c-4073-83dd-22ba5414e600 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:20.492103 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bff8c50d-243c-4073-83dd-22ba5414e600 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:20.633032 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-81cdb250-60f5-469c-a6f8-289ea4378b01 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:20.641693 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-81cdb250-60f5-469c-a6f8-289ea4378b01 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:20.668604 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-81cdb250-60f5-469c-a6f8-289ea4378b01 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:20.671395 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bff8c50d-243c-4073-83dd-22ba5414e600 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2985f6e7b7c4e91ac80db47d1f2dff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6377f05e21462b8a374170ec06a211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:20.672563 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-81cdb250-60f5-469c-a6f8-289ea4378b01 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:20.673048 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-81cdb250-60f5-469c-a6f8-289ea4378b01 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:20.673805 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-81cdb250-60f5-469c-a6f8-289ea4378b01 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:20.674330 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-81cdb250-60f5-469c-a6f8-289ea4378b01 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:20.679087 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-81cdb250-60f5-469c-a6f8-289ea4378b01 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:20.680653 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bff8c50d-243c-4073-83dd-22ba5414e600 tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] 10.222.0.42 "GET /compute/v2.1/servers/b9d9cd93-7e56-49b2-8b42-71ea75da9053" status: 200 len: 1502 microversion: 2.1 time: 0.220714 Oct 23 01:45:20.694302 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3078/6243] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:45:20 2022] GET /compute/v2.1/servers/b9d9cd93-7e56-49b2-8b42-71ea75da9053 => generated 1502 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:45:20.772641 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-81cdb250-60f5-469c-a6f8-289ea4378b01 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:20.784957 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-81cdb250-60f5-469c-a6f8-289ea4378b01 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:20.788583 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-81cdb250-60f5-469c-a6f8-289ea4378b01 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:20.790407 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-81cdb250-60f5-469c-a6f8-289ea4378b01 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1605 microversion: 2.32 time: 0.161401 Oct 23 01:45:20.792214 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3166/6244] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:45:20 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1605 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:45:21.185940 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-4cf09671-84bf-404c-a029-4e54a862a22d req-73af94d3-8039-46a4-ae51-5ce12091b0d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ebee1b1-ea00-4a5a-8da7-f2520e296848", "name": "network-vif-plugged", "status": "completed", "tag": "c4e81e83-9fd2-4b8a-bdd8-c2f017a9b1bd"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:45:21.196064 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-4cf09671-84bf-404c-a029-4e54a862a22d req-73af94d3-8039-46a4-ae51-5ce12091b0d2 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:21.196540 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-4cf09671-84bf-404c-a029-4e54a862a22d req-73af94d3-8039-46a4-ae51-5ce12091b0d2 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:21.197218 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-4cf09671-84bf-404c-a029-4e54a862a22d req-73af94d3-8039-46a4-ae51-5ce12091b0d2 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:21.211521 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-4cf09671-84bf-404c-a029-4e54a862a22d req-73af94d3-8039-46a4-ae51-5ce12091b0d2 service nova] Creating event network-vif-plugged:c4e81e83-9fd2-4b8a-bdd8-c2f017a9b1bd for instance 7ebee1b1-ea00-4a5a-8da7-f2520e296848 on n-h1-master-1 Oct 23 01:45:21.219426 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-4cf09671-84bf-404c-a029-4e54a862a22d req-73af94d3-8039-46a4-ae51-5ce12091b0d2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038076 Oct 23 01:45:21.224054 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3079/6245] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:45:21.525026 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-f8b6baa4-e8c1-4927-b74c-670da12091d8 req-ac79b94f-de3c-4e19-9eb7-5ee3b82b75ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9d9cd93-7e56-49b2-8b42-71ea75da9053", "name": "network-vif-deleted", "tag": "4382116f-8309-46d1-8d66-700369b79501"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:45:21.536728 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-f8b6baa4-e8c1-4927-b74c-670da12091d8 req-ac79b94f-de3c-4e19-9eb7-5ee3b82b75ee service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:21.537225 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-f8b6baa4-e8c1-4927-b74c-670da12091d8 req-ac79b94f-de3c-4e19-9eb7-5ee3b82b75ee service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:21.538032 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-f8b6baa4-e8c1-4927-b74c-670da12091d8 req-ac79b94f-de3c-4e19-9eb7-5ee3b82b75ee service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:21.551166 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-f8b6baa4-e8c1-4927-b74c-670da12091d8 req-ac79b94f-de3c-4e19-9eb7-5ee3b82b75ee service nova] Creating event network-vif-deleted:4382116f-8309-46d1-8d66-700369b79501 for instance b9d9cd93-7e56-49b2-8b42-71ea75da9053 on n-h1-master-1 Oct 23 01:45:21.556939 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-f8b6baa4-e8c1-4927-b74c-670da12091d8 req-ac79b94f-de3c-4e19-9eb7-5ee3b82b75ee service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036376 Oct 23 01:45:21.558187 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3167/6246] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:45:21.709939 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-05d19da4-d931-466e-a9c4-1cb467b86a8f tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:21.714307 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-05d19da4-d931-466e-a9c4-1cb467b86a8f tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] [instance: b9d9cd93-7e56-49b2-8b42-71ea75da9053] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:21.746788 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05d19da4-d931-466e-a9c4-1cb467b86a8f tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:21.747454 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05d19da4-d931-466e-a9c4-1cb467b86a8f tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:21.749315 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05d19da4-d931-466e-a9c4-1cb467b86a8f tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:21.750296 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05d19da4-d931-466e-a9c4-1cb467b86a8f tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:21.750773 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05d19da4-d931-466e-a9c4-1cb467b86a8f tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:21.751207 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05d19da4-d931-466e-a9c4-1cb467b86a8f tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:21.823327 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7ef07376-a52d-4574-b17b-ee0e4f4629b0 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:21.825115 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7ef07376-a52d-4574-b17b-ee0e4f4629b0 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:21.835216 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ef07376-a52d-4574-b17b-ee0e4f4629b0 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:21.836008 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ef07376-a52d-4574-b17b-ee0e4f4629b0 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:21.836621 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ef07376-a52d-4574-b17b-ee0e4f4629b0 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:21.837636 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ef07376-a52d-4574-b17b-ee0e4f4629b0 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:21.838318 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ef07376-a52d-4574-b17b-ee0e4f4629b0 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:21.838930 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ef07376-a52d-4574-b17b-ee0e4f4629b0 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:21.878145 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-05d19da4-d931-466e-a9c4-1cb467b86a8f tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2985f6e7b7c4e91ac80db47d1f2dff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6377f05e21462b8a374170ec06a211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:21.902332 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-05d19da4-d931-466e-a9c4-1cb467b86a8f tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] 10.222.0.42 "GET /compute/v2.1/servers/b9d9cd93-7e56-49b2-8b42-71ea75da9053" status: 200 len: 1298 microversion: 2.1 time: 0.200652 Oct 23 01:45:21.903324 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3080/6247] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:45:21 2022] GET /compute/v2.1/servers/b9d9cd93-7e56-49b2-8b42-71ea75da9053 => generated 1298 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:45:22.024971 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7ef07376-a52d-4574-b17b-ee0e4f4629b0 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:22.036685 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7ef07376-a52d-4574-b17b-ee0e4f4629b0 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:22.038841 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7ef07376-a52d-4574-b17b-ee0e4f4629b0 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:22.040493 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7ef07376-a52d-4574-b17b-ee0e4f4629b0 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1605 microversion: 2.32 time: 0.221883 Oct 23 01:45:22.041617 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3168/6248] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:45:21 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1605 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:45:22.926999 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-78bc9d22-55e6-4382-9dd8-704c61c503bb tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:22.928583 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-78bc9d22-55e6-4382-9dd8-704c61c503bb tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] [instance: b9d9cd93-7e56-49b2-8b42-71ea75da9053] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:22.937352 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78bc9d22-55e6-4382-9dd8-704c61c503bb tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:22.938302 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78bc9d22-55e6-4382-9dd8-704c61c503bb tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:22.938969 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78bc9d22-55e6-4382-9dd8-704c61c503bb tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:22.939941 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78bc9d22-55e6-4382-9dd8-704c61c503bb tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:22.940422 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78bc9d22-55e6-4382-9dd8-704c61c503bb tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:22.941101 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78bc9d22-55e6-4382-9dd8-704c61c503bb tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:22.966966 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-78bc9d22-55e6-4382-9dd8-704c61c503bb tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] HTTP exception thrown: Instance b9d9cd93-7e56-49b2-8b42-71ea75da9053 could not be found. Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-78bc9d22-55e6-4382-9dd8-704c61c503bb tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Request method failure captured: Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/b9d9cd93-7e56-49b2-8b42-71ea75da9053 HTTP/1.1 Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJx7OhwyJlzCeTfTdtFyQFUgj48cbZxLB8LRbLGNenrE1ZeafbgQ6J8XSm2fDjEnykrh-rcYvUgLzTN405V9qSFiDrf1xYNdOS0Q1X4oucoGYddHZ2EUub0NVRpNRjBUoRIgvrb8EshmxNhrsc2m6rh-Eti-Khp1TUGSjvPnVv83H04 Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 3c6377f05e21462b8a374170ec06a211 Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-VolumesActionsTest-1676684440 Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3c6377f05e21462b8a374170ec06a211"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3c6377f05e21462b8a374170ec06a211"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3c6377f05e21462b8a374170ec06a211"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3c6377f05e21462b8a374170ec06a211"}]}] Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-VolumesActionsTest-1676684440 Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 3c6377f05e21462b8a374170ec06a211 Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-VolumesActionsTest-1676684440 Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-VolumesActionsTest-1676684440-project Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: b2985f6e7b7c4e91ac80db47d1f2dff4 Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-VolumesActionsTest-1676684440-project Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: exception: Instance b9d9cd93-7e56-49b2-8b42-71ea75da9053 could not be found. Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'b9d9cd93-7e56-49b2-8b42-71ea75da9053'} Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9d9cd93-7e56-49b2-8b42-71ea75da9053 could not be found. Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9d9cd93-7e56-49b2-8b42-71ea75da9053 could not be found. Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:45:22.973044 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:45:22.983207 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:45:22.983207 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:45:22.983207 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:45:22.983207 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:45:22.983207 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:45:22.983207 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9d9cd93-7e56-49b2-8b42-71ea75da9053 could not be found. Oct 23 01:45:22.983207 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:45:22.983207 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-78bc9d22-55e6-4382-9dd8-704c61c503bb tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] Returning 404 to user: Instance b9d9cd93-7e56-49b2-8b42-71ea75da9053 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:45:22.983207 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-78bc9d22-55e6-4382-9dd8-704c61c503bb tempest-VolumesActionsTest-1676684440 tempest-VolumesActionsTest-1676684440-project] 10.222.0.42 "GET /compute/v2.1/servers/b9d9cd93-7e56-49b2-8b42-71ea75da9053" status: 404 len: 111 microversion: 2.1 time: 0.057272 Oct 23 01:45:22.983207 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3081/6249] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:45:22 2022] GET /compute/v2.1/servers/b9d9cd93-7e56-49b2-8b42-71ea75da9053 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:45:23.070587 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-85362345-232b-4e8a-86ee-8ec0a4023f5c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:23.071224 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-85362345-232b-4e8a-86ee-8ec0a4023f5c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:23.079534 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-85362345-232b-4e8a-86ee-8ec0a4023f5c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:23.080037 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-85362345-232b-4e8a-86ee-8ec0a4023f5c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:23.080595 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-85362345-232b-4e8a-86ee-8ec0a4023f5c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:23.081322 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-85362345-232b-4e8a-86ee-8ec0a4023f5c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:23.081785 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-85362345-232b-4e8a-86ee-8ec0a4023f5c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:23.082245 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-85362345-232b-4e8a-86ee-8ec0a4023f5c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:23.174018 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-85362345-232b-4e8a-86ee-8ec0a4023f5c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:23.187787 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-85362345-232b-4e8a-86ee-8ec0a4023f5c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:23.189914 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-85362345-232b-4e8a-86ee-8ec0a4023f5c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:23.191374 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-85362345-232b-4e8a-86ee-8ec0a4023f5c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1605 microversion: 2.32 time: 0.125016 Oct 23 01:45:23.192527 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3169/6250] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:45:23 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1605 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:45:24.231270 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-927043bf-2e82-4ce8-83c0-ecbc0c7044ab tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:24.232601 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-927043bf-2e82-4ce8-83c0-ecbc0c7044ab tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:24.242134 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-927043bf-2e82-4ce8-83c0-ecbc0c7044ab tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:24.246408 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-927043bf-2e82-4ce8-83c0-ecbc0c7044ab tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:24.247489 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-927043bf-2e82-4ce8-83c0-ecbc0c7044ab tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:24.249407 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-927043bf-2e82-4ce8-83c0-ecbc0c7044ab tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:24.250311 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-927043bf-2e82-4ce8-83c0-ecbc0c7044ab tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:24.251579 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-927043bf-2e82-4ce8-83c0-ecbc0c7044ab tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:24.375603 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-927043bf-2e82-4ce8-83c0-ecbc0c7044ab tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:24.385728 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-927043bf-2e82-4ce8-83c0-ecbc0c7044ab tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:24.387326 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-927043bf-2e82-4ce8-83c0-ecbc0c7044ab tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:24.389240 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-927043bf-2e82-4ce8-83c0-ecbc0c7044ab tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1605 microversion: 2.32 time: 0.162522 Oct 23 01:45:24.390040 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3082/6251] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:45:24 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1605 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:45:25.416319 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-54cbd14c-8805-4910-bc20-c5304b82d077 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:25.417755 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-54cbd14c-8805-4910-bc20-c5304b82d077 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:25.430032 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-54cbd14c-8805-4910-bc20-c5304b82d077 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:25.430800 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-54cbd14c-8805-4910-bc20-c5304b82d077 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:25.432589 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-54cbd14c-8805-4910-bc20-c5304b82d077 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:25.439654 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-54cbd14c-8805-4910-bc20-c5304b82d077 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:25.440801 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-54cbd14c-8805-4910-bc20-c5304b82d077 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:25.442458 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-54cbd14c-8805-4910-bc20-c5304b82d077 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:25.567464 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-54cbd14c-8805-4910-bc20-c5304b82d077 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:25.583179 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-54cbd14c-8805-4910-bc20-c5304b82d077 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:25.586247 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-54cbd14c-8805-4910-bc20-c5304b82d077 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:25.586247 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-54cbd14c-8805-4910-bc20-c5304b82d077 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1605 microversion: 2.32 time: 0.174258 Oct 23 01:45:25.586942 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3170/6252] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:45:25 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1605 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:45:26.613648 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d0b14aa8-185e-4be7-892c-2965eb78ff82 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:26.615356 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d0b14aa8-185e-4be7-892c-2965eb78ff82 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:26.628190 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0b14aa8-185e-4be7-892c-2965eb78ff82 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:26.630738 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0b14aa8-185e-4be7-892c-2965eb78ff82 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:26.631434 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0b14aa8-185e-4be7-892c-2965eb78ff82 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:26.632425 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0b14aa8-185e-4be7-892c-2965eb78ff82 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:26.633063 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0b14aa8-185e-4be7-892c-2965eb78ff82 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:26.633736 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0b14aa8-185e-4be7-892c-2965eb78ff82 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:26.732490 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d0b14aa8-185e-4be7-892c-2965eb78ff82 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:26.743986 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d0b14aa8-185e-4be7-892c-2965eb78ff82 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:26.745665 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d0b14aa8-185e-4be7-892c-2965eb78ff82 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:26.755324 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d0b14aa8-185e-4be7-892c-2965eb78ff82 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1605 microversion: 2.32 time: 0.145801 Oct 23 01:45:26.760808 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3083/6253] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:45:26 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1605 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:45:27.791873 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0a568f34-7607-4464-b8fd-91ac993077f3 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:27.792807 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0a568f34-7607-4464-b8fd-91ac993077f3 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:27.813246 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0a568f34-7607-4464-b8fd-91ac993077f3 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:27.813929 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0a568f34-7607-4464-b8fd-91ac993077f3 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:27.814543 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0a568f34-7607-4464-b8fd-91ac993077f3 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:27.815408 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0a568f34-7607-4464-b8fd-91ac993077f3 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:27.815988 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0a568f34-7607-4464-b8fd-91ac993077f3 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:27.816529 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0a568f34-7607-4464-b8fd-91ac993077f3 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:27.908751 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0a568f34-7607-4464-b8fd-91ac993077f3 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:27.919178 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0a568f34-7607-4464-b8fd-91ac993077f3 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:27.921474 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0a568f34-7607-4464-b8fd-91ac993077f3 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:27.922717 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0a568f34-7607-4464-b8fd-91ac993077f3 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1605 microversion: 2.32 time: 0.135076 Oct 23 01:45:27.923987 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3171/6254] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:45:27 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1605 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:45:28.948743 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f81bddb0-e903-4e1d-af82-54bfb4a62785 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:28.949374 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f81bddb0-e903-4e1d-af82-54bfb4a62785 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:28.957074 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f81bddb0-e903-4e1d-af82-54bfb4a62785 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:28.957568 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f81bddb0-e903-4e1d-af82-54bfb4a62785 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:28.959206 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f81bddb0-e903-4e1d-af82-54bfb4a62785 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:28.964242 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f81bddb0-e903-4e1d-af82-54bfb4a62785 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:28.966010 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f81bddb0-e903-4e1d-af82-54bfb4a62785 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:28.968050 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f81bddb0-e903-4e1d-af82-54bfb4a62785 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:29.066018 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f81bddb0-e903-4e1d-af82-54bfb4a62785 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:29.076903 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f81bddb0-e903-4e1d-af82-54bfb4a62785 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:29.080142 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f81bddb0-e903-4e1d-af82-54bfb4a62785 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:29.081995 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f81bddb0-e903-4e1d-af82-54bfb4a62785 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1605 microversion: 2.32 time: 0.137172 Oct 23 01:45:29.100054 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3084/6255] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:45:28 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1605 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:45:30.111151 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-05e37dd8-c5c3-45ee-a4b3-f86369d13d7c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:30.111775 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-05e37dd8-c5c3-45ee-a4b3-f86369d13d7c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:30.121141 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-05e37dd8-c5c3-45ee-a4b3-f86369d13d7c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:30.121866 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-05e37dd8-c5c3-45ee-a4b3-f86369d13d7c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:30.123730 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-05e37dd8-c5c3-45ee-a4b3-f86369d13d7c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:30.124660 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-05e37dd8-c5c3-45ee-a4b3-f86369d13d7c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:30.125289 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-05e37dd8-c5c3-45ee-a4b3-f86369d13d7c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:30.125884 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-05e37dd8-c5c3-45ee-a4b3-f86369d13d7c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:30.217838 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-05e37dd8-c5c3-45ee-a4b3-f86369d13d7c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:30.234315 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-05e37dd8-c5c3-45ee-a4b3-f86369d13d7c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:30.236241 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-05e37dd8-c5c3-45ee-a4b3-f86369d13d7c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:30.237645 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-05e37dd8-c5c3-45ee-a4b3-f86369d13d7c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1605 microversion: 2.32 time: 0.131473 Oct 23 01:45:30.238788 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3172/6256] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:45:30 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1605 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:45:31.277502 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1ab822cc-8fe3-440e-ba19-222e0d75ebed tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:31.279504 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1ab822cc-8fe3-440e-ba19-222e0d75ebed tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:31.289739 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=73 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:45:31.297242 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1ab822cc-8fe3-440e-ba19-222e0d75ebed tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:31.299691 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1ab822cc-8fe3-440e-ba19-222e0d75ebed tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:31.301522 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1ab822cc-8fe3-440e-ba19-222e0d75ebed tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:31.302503 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1ab822cc-8fe3-440e-ba19-222e0d75ebed tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:31.304003 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1ab822cc-8fe3-440e-ba19-222e0d75ebed tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:31.308010 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1ab822cc-8fe3-440e-ba19-222e0d75ebed tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:31.346728 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1ab822cc-8fe3-440e-ba19-222e0d75ebed tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:31.347641 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1ab822cc-8fe3-440e-ba19-222e0d75ebed tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:31.347982 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1ab822cc-8fe3-440e-ba19-222e0d75ebed tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:31.348436 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-1ab822cc-8fe3-440e-ba19-222e0d75ebed tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lazy-loading 'fault' on Instance uuid f47e3006-cfbb-48bb-ae86-b018486c5e21 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:45:31.394954 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1ab822cc-8fe3-440e-ba19-222e0d75ebed tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:31.408931 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1ab822cc-8fe3-440e-ba19-222e0d75ebed tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:31.410773 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1ab822cc-8fe3-440e-ba19-222e0d75ebed tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ceec980f06b45a989a5cd6cbca9d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2532e029d7c483bbcf901c75023e59f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:31.412520 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1ab822cc-8fe3-440e-ba19-222e0d75ebed tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 200 len: 1610 microversion: 2.32 time: 0.148362 Oct 23 01:45:31.413606 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3085/6257] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:45:31 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 1610 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 01:45:32.354783 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9435ca5a-cc80-429d-a8a4-decc48d038fc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1494504334 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1494504334-project-admin] Calling method '.version_select at 0x7f5cc0c143a0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:32.358099 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9435ca5a-cc80-429d-a8a4-decc48d038fc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1494504334 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1494504334-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:32.358832 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9435ca5a-cc80-429d-a8a4-decc48d038fc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1494504334 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1494504334-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:32.359529 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9435ca5a-cc80-429d-a8a4-decc48d038fc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1494504334 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1494504334-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:32.380484 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9435ca5a-cc80-429d-a8a4-decc48d038fc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1494504334 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1494504334-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:32.381547 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9435ca5a-cc80-429d-a8a4-decc48d038fc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1494504334 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1494504334-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:32.382288 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9435ca5a-cc80-429d-a8a4-decc48d038fc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1494504334 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1494504334-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:32.394089 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9435ca5a-cc80-429d-a8a4-decc48d038fc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1494504334 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1494504334-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:32.394921 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9435ca5a-cc80-429d-a8a4-decc48d038fc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1494504334 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1494504334-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:32.395585 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9435ca5a-cc80-429d-a8a4-decc48d038fc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1494504334 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1494504334-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:32.402423 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9435ca5a-cc80-429d-a8a4-decc48d038fc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1494504334 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1494504334-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.276403 Oct 23 01:45:32.404071 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3173/6258] 10.222.0.42 () {58 vars in 1146 bytes} [Sun Oct 23 01:45:32 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:45:32.443138 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-76e135c1-cf24-4193-a762-157815750d60 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:32.443768 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-76e135c1-cf24-4193-a762-157815750d60 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:32.461833 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-76e135c1-cf24-4193-a762-157815750d60 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:32.462656 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-76e135c1-cf24-4193-a762-157815750d60 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:32.463259 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-76e135c1-cf24-4193-a762-157815750d60 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:32.464237 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-76e135c1-cf24-4193-a762-157815750d60 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:32.464717 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-76e135c1-cf24-4193-a762-157815750d60 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:32.465187 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-76e135c1-cf24-4193-a762-157815750d60 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:32.483062 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-76e135c1-cf24-4193-a762-157815750d60 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] HTTP exception thrown: Instance f47e3006-cfbb-48bb-ae86-b018486c5e21 could not be found. Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-76e135c1-cf24-4193-a762-157815750d60 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Request method failure captured: Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 HTTP/1.1 Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJrqsg47BnlPks5_3AA-I_Uon5Q7mj3zYboShCdZ_IRuyKMmKwEox6QUodlv26nJak37QDGJD22h5GMu-3MpZ3woJHwshI6lLzoGPb71KhTJbyKzr1N2tr9VcuOZ_qDtRddIiBpH5JR5IHU5cJuNqZheC-BUI6VQyJkgAY-0RrBZDcU Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: X-Openstack-Nova-Api-Version: 2.32 Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: a2532e029d7c483bbcf901c75023e59f Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-TaggedBootDevicesTest-101764966 Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a2532e029d7c483bbcf901c75023e59f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a2532e029d7c483bbcf901c75023e59f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a2532e029d7c483bbcf901c75023e59f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a2532e029d7c483bbcf901c75023e59f"}]}] Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-TaggedBootDevicesTest-101764966 Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: a2532e029d7c483bbcf901c75023e59f Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-TaggedBootDevicesTest-101764966 Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-TaggedBootDevicesTest-101764966-project Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 2ceec980f06b45a989a5cd6cbca9d5d1 Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-TaggedBootDevicesTest-101764966-project Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: exception: Instance f47e3006-cfbb-48bb-ae86-b018486c5e21 could not be found. Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'f47e3006-cfbb-48bb-ae86-b018486c5e21'} Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f47e3006-cfbb-48bb-ae86-b018486c5e21 could not be found. Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f47e3006-cfbb-48bb-ae86-b018486c5e21 could not be found. Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:45:32.484903 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:45:32.494079 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:45:32.494079 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:45:32.494079 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:45:32.494079 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:45:32.494079 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:45:32.494079 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f47e3006-cfbb-48bb-ae86-b018486c5e21 could not be found. Oct 23 01:45:32.494079 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:45:32.494079 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-76e135c1-cf24-4193-a762-157815750d60 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Returning 404 to user: Instance f47e3006-cfbb-48bb-ae86-b018486c5e21 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:45:32.496873 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-76e135c1-cf24-4193-a762-157815750d60 tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 404 len: 111 microversion: 2.32 time: 0.057692 Oct 23 01:45:32.503440 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3086/6259] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:45:32 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:45:32.508903 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d0f1edd5-2b28-4fc3-94a3-4766776d1d5c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '.version_select at 0x7f5cc1a09f70>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:32.653232 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d0f1edd5-2b28-4fc3-94a3-4766776d1d5c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1944038034" status: 204 len: 0 microversion: 2.32 time: 0.148994 Oct 23 01:45:32.654724 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3174/6260] 10.222.0.42 () {60 vars in 1262 bytes} [Sun Oct 23 01:45:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1944038034 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 23 01:45:40.008215 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d587ec9e-e7ea-42ed-bc21-6511994219ef tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:40.008738 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d587ec9e-e7ea-42ed-bc21-6511994219ef tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:40.025259 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d587ec9e-e7ea-42ed-bc21-6511994219ef tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:40.027121 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d587ec9e-e7ea-42ed-bc21-6511994219ef tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:40.032438 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d587ec9e-e7ea-42ed-bc21-6511994219ef tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:40.033744 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d587ec9e-e7ea-42ed-bc21-6511994219ef tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:40.034271 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d587ec9e-e7ea-42ed-bc21-6511994219ef tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:40.034717 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d587ec9e-e7ea-42ed-bc21-6511994219ef tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:40.102171 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-d587ec9e-e7ea-42ed-bc21-6511994219ef tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] HTTP exception thrown: Instance f47e3006-cfbb-48bb-ae86-b018486c5e21 could not be found. Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d587ec9e-e7ea-42ed-bc21-6511994219ef tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Request method failure captured: Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 HTTP/1.1 Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJrqsg47BnlPks5_3AA-I_Uon5Q7mj3zYboShCdZ_IRuyKMmKwEox6QUodlv26nJak37QDGJD22h5GMu-3MpZ3woJHwshI6lLzoGPb71KhTJbyKzr1N2tr9VcuOZ_qDtRddIiBpH5JR5IHU5cJuNqZheC-BUI6VQyJkgAY-0RrBZDcU Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: X-Openstack-Nova-Api-Version: 2.32 Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: a2532e029d7c483bbcf901c75023e59f Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-TaggedBootDevicesTest-101764966 Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a2532e029d7c483bbcf901c75023e59f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a2532e029d7c483bbcf901c75023e59f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a2532e029d7c483bbcf901c75023e59f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a2532e029d7c483bbcf901c75023e59f"}]}] Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-TaggedBootDevicesTest-101764966 Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: a2532e029d7c483bbcf901c75023e59f Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-TaggedBootDevicesTest-101764966 Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-TaggedBootDevicesTest-101764966-project Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 2ceec980f06b45a989a5cd6cbca9d5d1 Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-TaggedBootDevicesTest-101764966-project Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: exception: Instance f47e3006-cfbb-48bb-ae86-b018486c5e21 could not be found. Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'f47e3006-cfbb-48bb-ae86-b018486c5e21'} Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f47e3006-cfbb-48bb-ae86-b018486c5e21 could not be found. Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:45:40.106645 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:45:40.115066 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f47e3006-cfbb-48bb-ae86-b018486c5e21 could not be found. Oct 23 01:45:40.115066 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:45:40.115066 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:45:40.115066 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:45:40.115066 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:45:40.115066 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:45:40.115066 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:45:40.115066 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:45:40.115066 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:45:40.115066 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f47e3006-cfbb-48bb-ae86-b018486c5e21 could not be found. Oct 23 01:45:40.115066 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:45:40.115066 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d587ec9e-e7ea-42ed-bc21-6511994219ef tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Returning 404 to user: Instance f47e3006-cfbb-48bb-ae86-b018486c5e21 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:45:40.115066 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d587ec9e-e7ea-42ed-bc21-6511994219ef tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 404 len: 111 microversion: 2.32 time: 0.118431 Oct 23 01:45:40.115066 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3087/6261] 10.222.0.42 () {60 vars in 1280 bytes} [Sun Oct 23 01:45:39 2022] DELETE /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 23 01:45:40.122242 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-457b7a5e-3379-48e9-b03d-fa072246f82c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:40.123631 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-457b7a5e-3379-48e9-b03d-fa072246f82c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] [instance: f47e3006-cfbb-48bb-ae86-b018486c5e21] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:40.136322 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:45:40.430423 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-457b7a5e-3379-48e9-b03d-fa072246f82c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:40.430423 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-457b7a5e-3379-48e9-b03d-fa072246f82c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:40.430423 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-457b7a5e-3379-48e9-b03d-fa072246f82c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:40.430423 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-457b7a5e-3379-48e9-b03d-fa072246f82c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:40.430423 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-457b7a5e-3379-48e9-b03d-fa072246f82c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:40.430423 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-457b7a5e-3379-48e9-b03d-fa072246f82c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:40.430423 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-457b7a5e-3379-48e9-b03d-fa072246f82c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] HTTP exception thrown: Instance f47e3006-cfbb-48bb-ae86-b018486c5e21 could not be found. Oct 23 01:45:40.430423 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-457b7a5e-3379-48e9-b03d-fa072246f82c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Request method failure captured: Oct 23 01:45:40.430423 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 HTTP/1.1 Oct 23 01:45:40.430423 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:45:40.430423 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:45:40.430423 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:45:40.430423 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:45:40.430423 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:45:40.430423 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:45:40.430423 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:45:40.430423 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:45:40.430423 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJrqsg47BnlPks5_3AA-I_Uon5Q7mj3zYboShCdZ_IRuyKMmKwEox6QUodlv26nJak37QDGJD22h5GMu-3MpZ3woJHwshI6lLzoGPb71KhTJbyKzr1N2tr9VcuOZ_qDtRddIiBpH5JR5IHU5cJuNqZheC-BUI6VQyJkgAY-0RrBZDcU Oct 23 01:45:40.430423 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:45:40.430423 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:45:40.430423 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:45:40.430423 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:45:40.430423 n-d-master-1 devstack@n-api.service[120944]: X-Openstack-Nova-Api-Version: 2.32 Oct 23 01:45:40.430423 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:45:40.430423 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:45:40.430423 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: a2532e029d7c483bbcf901c75023e59f Oct 23 01:45:40.430423 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-TaggedBootDevicesTest-101764966 Oct 23 01:45:40.430423 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:45:40.430423 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:45:40.430423 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a2532e029d7c483bbcf901c75023e59f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a2532e029d7c483bbcf901c75023e59f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a2532e029d7c483bbcf901c75023e59f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a2532e029d7c483bbcf901c75023e59f"}]}] Oct 23 01:45:40.430423 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-TaggedBootDevicesTest-101764966 Oct 23 01:45:40.430423 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: a2532e029d7c483bbcf901c75023e59f Oct 23 01:45:40.430423 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-TaggedBootDevicesTest-101764966 Oct 23 01:45:40.430423 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-TaggedBootDevicesTest-101764966-project Oct 23 01:45:40.430423 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:45:40.430423 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:45:40.430423 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 2ceec980f06b45a989a5cd6cbca9d5d1 Oct 23 01:45:40.430423 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-TaggedBootDevicesTest-101764966-project Oct 23 01:45:40.430423 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:45:40.445143 n-d-master-1 devstack@n-api.service[120944]: exception: Instance f47e3006-cfbb-48bb-ae86-b018486c5e21 could not be found. Oct 23 01:45:40.445143 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'f47e3006-cfbb-48bb-ae86-b018486c5e21'} Oct 23 01:45:40.445143 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:45:40.445143 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:45:40.445143 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:45:40.445143 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:45:40.445143 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:45:40.445143 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:45:40.445143 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:45:40.445143 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:45:40.445143 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:45:40.445143 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:45:40.445143 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f47e3006-cfbb-48bb-ae86-b018486c5e21 could not be found. Oct 23 01:45:40.445143 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:45:40.445143 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:45:40.445143 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:45:40.445143 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:45:40.445143 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:45:40.445143 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:45:40.445143 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:45:40.445143 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:45:40.445143 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:45:40.445143 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:45:40.445143 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:45:40.445143 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:45:40.445143 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:45:40.445143 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:45:40.445143 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:45:40.445143 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:45:40.445143 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f47e3006-cfbb-48bb-ae86-b018486c5e21 could not be found. Oct 23 01:45:40.445143 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:45:40.445143 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:45:40.445143 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:45:40.445143 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:45:40.445143 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:45:40.445143 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:45:40.445143 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:45:40.445143 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:45:40.445143 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f47e3006-cfbb-48bb-ae86-b018486c5e21 could not be found. Oct 23 01:45:40.445143 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:45:40.445143 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-457b7a5e-3379-48e9-b03d-fa072246f82c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] Returning 404 to user: Instance f47e3006-cfbb-48bb-ae86-b018486c5e21 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:45:40.445143 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-457b7a5e-3379-48e9-b03d-fa072246f82c tempest-TaggedBootDevicesTest-101764966 tempest-TaggedBootDevicesTest-101764966-project] 10.222.0.42 "GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21" status: 404 len: 111 microversion: 2.32 time: 0.070946 Oct 23 01:45:40.445143 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3175/6262] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Oct 23 01:45:40 2022] GET /compute/v2.1/servers/f47e3006-cfbb-48bb-ae86-b018486c5e21 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:45:44.740260 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6422427b-91e0-45dd-9864-0cf126bf8b0e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:45:44.743638 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6422427b-91e0-45dd-9864-0cf126bf8b0e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:44.753432 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6422427b-91e0-45dd-9864-0cf126bf8b0e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:44.754434 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6422427b-91e0-45dd-9864-0cf126bf8b0e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:44.755117 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6422427b-91e0-45dd-9864-0cf126bf8b0e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:44.756058 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6422427b-91e0-45dd-9864-0cf126bf8b0e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:44.756803 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6422427b-91e0-45dd-9864-0cf126bf8b0e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:44.757480 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6422427b-91e0-45dd-9864-0cf126bf8b0e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:44.885771 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6422427b-91e0-45dd-9864-0cf126bf8b0e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "POST /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848/action" status: 200 len: 63208 microversion: 2.1 time: 0.150115 Oct 23 01:45:44.896313 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3088/6263] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:45:44 2022] POST /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848/action => generated 63208 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:45:51.275343 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-727ee3f8-b53d-4ed2-9474-3aba3d3f9427 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:51.276546 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-727ee3f8-b53d-4ed2-9474-3aba3d3f9427 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:51.283953 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:45:51.287873 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-727ee3f8-b53d-4ed2-9474-3aba3d3f9427 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:51.289505 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-727ee3f8-b53d-4ed2-9474-3aba3d3f9427 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:51.291044 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-727ee3f8-b53d-4ed2-9474-3aba3d3f9427 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:51.291966 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-727ee3f8-b53d-4ed2-9474-3aba3d3f9427 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:51.292569 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-727ee3f8-b53d-4ed2-9474-3aba3d3f9427 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:51.293713 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-727ee3f8-b53d-4ed2-9474-3aba3d3f9427 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:51.966813 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-727ee3f8-b53d-4ed2-9474-3aba3d3f9427 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1834 microversion: 2.1 time: 0.696942 Oct 23 01:45:51.971954 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3176/6264] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:45:51 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1834 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:45:54.092474 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-991a2f33-af59-44ba-9dc5-e90d2c910f2b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:54.093187 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-991a2f33-af59-44ba-9dc5-e90d2c910f2b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:54.119783 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-cd2fe468-6e7e-4b0b-ad35-819e07604c09 req-34d78f07-95f3-4ccb-93eb-395cfa0d5ed0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ebee1b1-ea00-4a5a-8da7-f2520e296848", "tag": "c4e81e83-9fd2-4b8a-bdd8-c2f017a9b1bd"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:45:54.138924 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-991a2f33-af59-44ba-9dc5-e90d2c910f2b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:54.140143 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-991a2f33-af59-44ba-9dc5-e90d2c910f2b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:54.140724 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-991a2f33-af59-44ba-9dc5-e90d2c910f2b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:54.141574 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-991a2f33-af59-44ba-9dc5-e90d2c910f2b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:54.142590 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-cd2fe468-6e7e-4b0b-ad35-819e07604c09 req-34d78f07-95f3-4ccb-93eb-395cfa0d5ed0 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:54.144667 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-991a2f33-af59-44ba-9dc5-e90d2c910f2b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:54.145666 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-cd2fe468-6e7e-4b0b-ad35-819e07604c09 req-34d78f07-95f3-4ccb-93eb-395cfa0d5ed0 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:54.146222 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-991a2f33-af59-44ba-9dc5-e90d2c910f2b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:54.148479 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-cd2fe468-6e7e-4b0b-ad35-819e07604c09 req-34d78f07-95f3-4ccb-93eb-395cfa0d5ed0 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:54.200780 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-cd2fe468-6e7e-4b0b-ad35-819e07604c09 req-34d78f07-95f3-4ccb-93eb-395cfa0d5ed0 service nova] Creating event network-changed:c4e81e83-9fd2-4b8a-bdd8-c2f017a9b1bd for instance 7ebee1b1-ea00-4a5a-8da7-f2520e296848 on n-h1-master-1 Oct 23 01:45:54.227881 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-cd2fe468-6e7e-4b0b-ad35-819e07604c09 req-34d78f07-95f3-4ccb-93eb-395cfa0d5ed0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111559 Oct 23 01:45:54.250650 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3177/6265] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:45:54.253645 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=77 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:45:54.285002 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-991a2f33-af59-44ba-9dc5-e90d2c910f2b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:45:54.756284 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-991a2f33-af59-44ba-9dc5-e90d2c910f2b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 204 len: 0 microversion: 2.1 time: 0.667475 Oct 23 01:45:54.757101 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3089/6266] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:45:54 2022] DELETE /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 0 bytes in 670 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:45:54.766761 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d15ea82e-6052-4813-a4e6-00a793639c87 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:54.767855 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d15ea82e-6052-4813-a4e6-00a793639c87 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:54.789477 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d15ea82e-6052-4813-a4e6-00a793639c87 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:54.791739 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d15ea82e-6052-4813-a4e6-00a793639c87 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:54.795231 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d15ea82e-6052-4813-a4e6-00a793639c87 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:54.799754 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d15ea82e-6052-4813-a4e6-00a793639c87 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:54.803717 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d15ea82e-6052-4813-a4e6-00a793639c87 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:54.807371 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d15ea82e-6052-4813-a4e6-00a793639c87 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:55.909067 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d15ea82e-6052-4813-a4e6-00a793639c87 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:55.954517 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d15ea82e-6052-4813-a4e6-00a793639c87 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1689 microversion: 2.1 time: 1.186692 Oct 23 01:45:55.956523 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3178/6267] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:45:54 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1689 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:45:56.980414 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8aa22679-5fdf-4306-ad1f-c5d699a3be83 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:56.982016 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8aa22679-5fdf-4306-ad1f-c5d699a3be83 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:56.989345 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8aa22679-5fdf-4306-ad1f-c5d699a3be83 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:56.990066 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8aa22679-5fdf-4306-ad1f-c5d699a3be83 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:56.990651 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8aa22679-5fdf-4306-ad1f-c5d699a3be83 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:56.991497 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8aa22679-5fdf-4306-ad1f-c5d699a3be83 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:56.992089 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8aa22679-5fdf-4306-ad1f-c5d699a3be83 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:56.992680 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8aa22679-5fdf-4306-ad1f-c5d699a3be83 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:57.578775 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8aa22679-5fdf-4306-ad1f-c5d699a3be83 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:57.587965 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8aa22679-5fdf-4306-ad1f-c5d699a3be83 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1571 microversion: 2.1 time: 0.611773 Oct 23 01:45:57.590017 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3090/6268] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:45:56 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1571 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:45:57.679498 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-76afe10e-9ecd-4039-a271-b16fc8dfd04c tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-546230431", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "4267c63d-19e1-47bc-b372-e7b59e0af6d2"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:45:57.748618 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-3ebf7271-6034-4c27-8c4d-d3b399933d4a req-a79fbffd-dccf-49c9-9220-01904db90a4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ebee1b1-ea00-4a5a-8da7-f2520e296848", "name": "network-vif-deleted", "tag": "c4e81e83-9fd2-4b8a-bdd8-c2f017a9b1bd"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:45:57.764463 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-3ebf7271-6034-4c27-8c4d-d3b399933d4a req-a79fbffd-dccf-49c9-9220-01904db90a4b service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:57.764954 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-3ebf7271-6034-4c27-8c4d-d3b399933d4a req-a79fbffd-dccf-49c9-9220-01904db90a4b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:57.765393 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-3ebf7271-6034-4c27-8c4d-d3b399933d4a req-a79fbffd-dccf-49c9-9220-01904db90a4b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:57.785167 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-3ebf7271-6034-4c27-8c4d-d3b399933d4a req-a79fbffd-dccf-49c9-9220-01904db90a4b service nova] Creating event network-vif-deleted:c4e81e83-9fd2-4b8a-bdd8-c2f017a9b1bd for instance 7ebee1b1-ea00-4a5a-8da7-f2520e296848 on n-h1-master-1 Oct 23 01:45:57.793052 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-3ebf7271-6034-4c27-8c4d-d3b399933d4a req-a79fbffd-dccf-49c9-9220-01904db90a4b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048201 Oct 23 01:45:57.793052 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3091/6269] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:45:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:45:57.793514 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-76afe10e-9ecd-4039-a271-b16fc8dfd04c tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] validate_networks() for [('4267c63d-19e1-47bc-b372-e7b59e0af6d2', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:45:58.383435 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-76afe10e-9ecd-4039-a271-b16fc8dfd04c tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:45:58.384508 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-76afe10e-9ecd-4039-a271-b16fc8dfd04c tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:45:58.384899 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-76afe10e-9ecd-4039-a271-b16fc8dfd04c tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:45:58.385411 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-76afe10e-9ecd-4039-a271-b16fc8dfd04c tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:45:58.385922 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-76afe10e-9ecd-4039-a271-b16fc8dfd04c tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:45:58.406665 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-76afe10e-9ecd-4039-a271-b16fc8dfd04c tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:58.413871 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-76afe10e-9ecd-4039-a271-b16fc8dfd04c tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:58.413871 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-76afe10e-9ecd-4039-a271-b16fc8dfd04c tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:58.413871 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-76afe10e-9ecd-4039-a271-b16fc8dfd04c tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:58.413871 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-76afe10e-9ecd-4039-a271-b16fc8dfd04c tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:58.413871 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-76afe10e-9ecd-4039-a271-b16fc8dfd04c tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:58.447390 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-76afe10e-9ecd-4039-a271-b16fc8dfd04c tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Getting quotas for project 7e64fd5446d541da9d10af97a24ea037. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:45:58.460232 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-76afe10e-9ecd-4039-a271-b16fc8dfd04c tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Getting quotas for user 2630e3eda1df4f698cad1eda511ad76a and project 7e64fd5446d541da9d10af97a24ea037. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:45:58.483430 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-76afe10e-9ecd-4039-a271-b16fc8dfd04c tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:45:58.490527 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-76afe10e-9ecd-4039-a271-b16fc8dfd04c tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] [instance: 56d08053-cd34-464a-ba73-ef113a24140d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:45:58.618808 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d6501275-d595-4de3-8807-949cb7a4b2fb tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:58.619562 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d6501275-d595-4de3-8807-949cb7a4b2fb tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:58.627020 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d6501275-d595-4de3-8807-949cb7a4b2fb tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:58.627514 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d6501275-d595-4de3-8807-949cb7a4b2fb tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:58.628103 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d6501275-d595-4de3-8807-949cb7a4b2fb tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:58.628801 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d6501275-d595-4de3-8807-949cb7a4b2fb tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:58.629252 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d6501275-d595-4de3-8807-949cb7a4b2fb tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:58.629672 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d6501275-d595-4de3-8807-949cb7a4b2fb tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:58.667289 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d6501275-d595-4de3-8807-949cb7a4b2fb tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:45:58.667836 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d6501275-d595-4de3-8807-949cb7a4b2fb tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:45:58.668273 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d6501275-d595-4de3-8807-949cb7a4b2fb tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:45:58.668893 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-d6501275-d595-4de3-8807-949cb7a4b2fb tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lazy-loading 'fault' on Instance uuid 7ebee1b1-ea00-4a5a-8da7-f2520e296848 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:45:58.751080 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d6501275-d595-4de3-8807-949cb7a4b2fb tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:58.787452 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-76afe10e-9ecd-4039-a271-b16fc8dfd04c tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.111350 Oct 23 01:45:58.789297 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3179/6270] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:45:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1116 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:45:58.803745 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d6501275-d595-4de3-8807-949cb7a4b2fb tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 200 len: 1357 microversion: 2.1 time: 0.190615 Oct 23 01:45:58.812026 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3092/6271] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:45:58 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 1357 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:45:58.812257 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8ab1f5ab-9886-46f1-b62f-e1e3115b21fe tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:58.813206 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8ab1f5ab-9886-46f1-b62f-e1e3115b21fe tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] [instance: 56d08053-cd34-464a-ba73-ef113a24140d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:45:58.897271 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8ab1f5ab-9886-46f1-b62f-e1e3115b21fe tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2630e3eda1df4f698cad1eda511ad76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e64fd5446d541da9d10af97a24ea037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:45:58.905842 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8ab1f5ab-9886-46f1-b62f-e1e3115b21fe tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] 10.222.0.42 "GET /compute/v2.1/servers/56d08053-cd34-464a-ba73-ef113a24140d" status: 200 len: 1218 microversion: 2.1 time: 0.103499 Oct 23 01:45:58.910159 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3180/6272] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:45:58 2022] GET /compute/v2.1/servers/56d08053-cd34-464a-ba73-ef113a24140d => generated 1218 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:45:59.936352 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8968c877-2818-46d7-bd3c-2f34e9b9e937 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:45:59.936981 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8968c877-2818-46d7-bd3c-2f34e9b9e937 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] [instance: 56d08053-cd34-464a-ba73-ef113a24140d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:46:00.005143 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8662158f-4219-4cbd-846b-59fa39f56fae tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:46:00.005759 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8662158f-4219-4cbd-846b-59fa39f56fae tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 7ebee1b1-ea00-4a5a-8da7-f2520e296848] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:46:00.020328 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8968c877-2818-46d7-bd3c-2f34e9b9e937 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2630e3eda1df4f698cad1eda511ad76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e64fd5446d541da9d10af97a24ea037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:46:00.020786 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8662158f-4219-4cbd-846b-59fa39f56fae tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:00.021454 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8662158f-4219-4cbd-846b-59fa39f56fae tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:00.022088 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8662158f-4219-4cbd-846b-59fa39f56fae tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:00.022990 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8662158f-4219-4cbd-846b-59fa39f56fae tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:00.023619 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8662158f-4219-4cbd-846b-59fa39f56fae tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:00.024246 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8662158f-4219-4cbd-846b-59fa39f56fae tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:00.062722 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8968c877-2818-46d7-bd3c-2f34e9b9e937 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] 10.222.0.42 "GET /compute/v2.1/servers/56d08053-cd34-464a-ba73-ef113a24140d" status: 200 len: 1218 microversion: 2.1 time: 0.119282 Oct 23 01:46:00.062722 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3181/6273] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:45:59 2022] GET /compute/v2.1/servers/56d08053-cd34-464a-ba73-ef113a24140d => generated 1218 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-8662158f-4219-4cbd-846b-59fa39f56fae tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] HTTP exception thrown: Instance 7ebee1b1-ea00-4a5a-8da7-f2520e296848 could not be found. Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8662158f-4219-4cbd-846b-59fa39f56fae tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Request method failure captured: Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 HTTP/1.1 Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJup1TkLYyR4X_VSgIMIuQv0hYOz5hZ00J3cGF_2O4wHY26fogeH_hyoq33KQnC7sGTAyVlSot7AI095PrC5yb0EkSKzvICR_X35mdfKcclD_xEhLj-4l-9yI3Uz12kHgYqfGCiZb_uaRrbVi38t5LJjIbY00U1LXQx5VmGP9DMKFZ0 Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 0c7f734a12da437e806e4c791d27d615 Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-878522496 Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/0c7f734a12da437e806e4c791d27d615"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_0c7f734a12da437e806e4c791d27d615"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0c7f734a12da437e806e4c791d27d615"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0c7f734a12da437e806e4c791d27d615"}]}] Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-TestNetworkAdvancedServerOps-878522496 Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 0c7f734a12da437e806e4c791d27d615 Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-878522496 Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-TestNetworkAdvancedServerOps-878522496-project Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 037ed342980a4de9a2dfc8d576293aba Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-TestNetworkAdvancedServerOps-878522496-project Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 7ebee1b1-ea00-4a5a-8da7-f2520e296848 could not be found. Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '7ebee1b1-ea00-4a5a-8da7-f2520e296848'} Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ebee1b1-ea00-4a5a-8da7-f2520e296848 could not be found. Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:46:00.062860 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:46:00.070180 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:46:00.070180 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ebee1b1-ea00-4a5a-8da7-f2520e296848 could not be found. Oct 23 01:46:00.070180 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:46:00.070180 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:46:00.070180 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:46:00.070180 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:46:00.070180 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:46:00.070180 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:46:00.070180 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:46:00.070180 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:46:00.070180 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ebee1b1-ea00-4a5a-8da7-f2520e296848 could not be found. Oct 23 01:46:00.070180 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:46:00.070180 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8662158f-4219-4cbd-846b-59fa39f56fae tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Returning 404 to user: Instance 7ebee1b1-ea00-4a5a-8da7-f2520e296848 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:46:00.070180 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8662158f-4219-4cbd-846b-59fa39f56fae tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848" status: 404 len: 111 microversion: 2.1 time: 0.224647 Oct 23 01:46:00.070180 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3093/6274] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:45:59 2022] GET /compute/v2.1/servers/7ebee1b1-ea00-4a5a-8da7-f2520e296848 => generated 111 bytes in 230 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:46:01.085315 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5168d5cc-ff41-41b0-9c11-657960bd2b0b tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:46:01.086638 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5168d5cc-ff41-41b0-9c11-657960bd2b0b tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] [instance: 56d08053-cd34-464a-ba73-ef113a24140d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:46:01.094607 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5168d5cc-ff41-41b0-9c11-657960bd2b0b tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:01.095110 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5168d5cc-ff41-41b0-9c11-657960bd2b0b tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:01.095650 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5168d5cc-ff41-41b0-9c11-657960bd2b0b tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:01.096367 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5168d5cc-ff41-41b0-9c11-657960bd2b0b tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:01.096995 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5168d5cc-ff41-41b0-9c11-657960bd2b0b tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:01.097577 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5168d5cc-ff41-41b0-9c11-657960bd2b0b tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:01.267940 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5168d5cc-ff41-41b0-9c11-657960bd2b0b tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2630e3eda1df4f698cad1eda511ad76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e64fd5446d541da9d10af97a24ea037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:46:01.283661 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5168d5cc-ff41-41b0-9c11-657960bd2b0b tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] 10.222.0.42 "GET /compute/v2.1/servers/56d08053-cd34-464a-ba73-ef113a24140d" status: 200 len: 1222 microversion: 2.1 time: 0.197516 Oct 23 01:46:01.284116 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3182/6275] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:46:01 2022] GET /compute/v2.1/servers/56d08053-cd34-464a-ba73-ef113a24140d => generated 1222 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:46:02.312262 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6a08e014-99fb-4a42-bb98-6ce57f6b5446 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:46:02.312895 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6a08e014-99fb-4a42-bb98-6ce57f6b5446 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] [instance: 56d08053-cd34-464a-ba73-ef113a24140d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:46:02.318911 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:46:02.328995 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6a08e014-99fb-4a42-bb98-6ce57f6b5446 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:02.332707 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6a08e014-99fb-4a42-bb98-6ce57f6b5446 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:02.333331 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6a08e014-99fb-4a42-bb98-6ce57f6b5446 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:02.334237 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6a08e014-99fb-4a42-bb98-6ce57f6b5446 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:02.334855 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6a08e014-99fb-4a42-bb98-6ce57f6b5446 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:02.335449 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6a08e014-99fb-4a42-bb98-6ce57f6b5446 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:02.583581 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6a08e014-99fb-4a42-bb98-6ce57f6b5446 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2630e3eda1df4f698cad1eda511ad76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e64fd5446d541da9d10af97a24ea037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:46:02.593593 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6a08e014-99fb-4a42-bb98-6ce57f6b5446 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] 10.222.0.42 "GET /compute/v2.1/servers/56d08053-cd34-464a-ba73-ef113a24140d" status: 200 len: 1278 microversion: 2.1 time: 0.285848 Oct 23 01:46:02.594574 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3094/6276] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:46:02 2022] GET /compute/v2.1/servers/56d08053-cd34-464a-ba73-ef113a24140d => generated 1278 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:46:03.620968 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b4e4dadd-dd2e-40cc-9e0f-15b23461d131 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:46:03.629321 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b4e4dadd-dd2e-40cc-9e0f-15b23461d131 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] [instance: 56d08053-cd34-464a-ba73-ef113a24140d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:46:03.665157 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b4e4dadd-dd2e-40cc-9e0f-15b23461d131 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:03.666294 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b4e4dadd-dd2e-40cc-9e0f-15b23461d131 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:03.666980 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b4e4dadd-dd2e-40cc-9e0f-15b23461d131 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:03.668766 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b4e4dadd-dd2e-40cc-9e0f-15b23461d131 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:03.669660 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b4e4dadd-dd2e-40cc-9e0f-15b23461d131 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:03.670456 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b4e4dadd-dd2e-40cc-9e0f-15b23461d131 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:04.152600 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b4e4dadd-dd2e-40cc-9e0f-15b23461d131 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2630e3eda1df4f698cad1eda511ad76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e64fd5446d541da9d10af97a24ea037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:46:04.168376 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b4e4dadd-dd2e-40cc-9e0f-15b23461d131 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] 10.222.0.42 "GET /compute/v2.1/servers/56d08053-cd34-464a-ba73-ef113a24140d" status: 200 len: 1318 microversion: 2.1 time: 0.551899 Oct 23 01:46:04.171353 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3183/6277] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:46:03 2022] GET /compute/v2.1/servers/56d08053-cd34-464a-ba73-ef113a24140d => generated 1318 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:46:05.197921 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d7f5cd42-adfb-4a25-bde7-70929acba577 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:46:05.199246 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d7f5cd42-adfb-4a25-bde7-70929acba577 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] [instance: 56d08053-cd34-464a-ba73-ef113a24140d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:46:05.216948 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d7f5cd42-adfb-4a25-bde7-70929acba577 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:05.218124 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d7f5cd42-adfb-4a25-bde7-70929acba577 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:05.218457 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d7f5cd42-adfb-4a25-bde7-70929acba577 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:05.225058 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d7f5cd42-adfb-4a25-bde7-70929acba577 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:05.225596 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d7f5cd42-adfb-4a25-bde7-70929acba577 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:05.226071 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d7f5cd42-adfb-4a25-bde7-70929acba577 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:05.408502 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-a28ba746-01c9-431b-a77a-90f25a7347d3 req-9c06e3e7-5b9e-4191-ab66-f36e6becdccd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56d08053-cd34-464a-ba73-ef113a24140d", "tag": "cef38fc4-7dde-4470-8321-82f548b4d443"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:46:05.435975 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-a28ba746-01c9-431b-a77a-90f25a7347d3 req-9c06e3e7-5b9e-4191-ab66-f36e6becdccd service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:05.436459 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-a28ba746-01c9-431b-a77a-90f25a7347d3 req-9c06e3e7-5b9e-4191-ab66-f36e6becdccd service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:05.436889 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-a28ba746-01c9-431b-a77a-90f25a7347d3 req-9c06e3e7-5b9e-4191-ab66-f36e6becdccd service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:05.475365 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-a28ba746-01c9-431b-a77a-90f25a7347d3 req-9c06e3e7-5b9e-4191-ab66-f36e6becdccd service nova] Creating event network-changed:cef38fc4-7dde-4470-8321-82f548b4d443 for instance 56d08053-cd34-464a-ba73-ef113a24140d on n-h2-master-1 Oct 23 01:46:05.489500 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-a28ba746-01c9-431b-a77a-90f25a7347d3 req-9c06e3e7-5b9e-4191-ab66-f36e6becdccd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085628 Oct 23 01:46:05.491650 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3184/6278] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:46:06.053651 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d7f5cd42-adfb-4a25-bde7-70929acba577 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2630e3eda1df4f698cad1eda511ad76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e64fd5446d541da9d10af97a24ea037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:46:06.096691 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d7f5cd42-adfb-4a25-bde7-70929acba577 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] 10.222.0.42 "GET /compute/v2.1/servers/56d08053-cd34-464a-ba73-ef113a24140d" status: 200 len: 1318 microversion: 2.1 time: 0.905797 Oct 23 01:46:06.097574 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3095/6279] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:46:05 2022] GET /compute/v2.1/servers/56d08053-cd34-464a-ba73-ef113a24140d => generated 1318 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:46:07.133161 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5fe072c3-1736-4ea9-9f2d-466873f9ff9f tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:46:07.134330 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5fe072c3-1736-4ea9-9f2d-466873f9ff9f tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] [instance: 56d08053-cd34-464a-ba73-ef113a24140d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:46:07.159895 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5fe072c3-1736-4ea9-9f2d-466873f9ff9f tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:07.160428 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5fe072c3-1736-4ea9-9f2d-466873f9ff9f tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:07.161387 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5fe072c3-1736-4ea9-9f2d-466873f9ff9f tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:07.181946 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5fe072c3-1736-4ea9-9f2d-466873f9ff9f tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:07.181946 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5fe072c3-1736-4ea9-9f2d-466873f9ff9f tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:07.181946 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5fe072c3-1736-4ea9-9f2d-466873f9ff9f tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:08.034369 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5fe072c3-1736-4ea9-9f2d-466873f9ff9f tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2630e3eda1df4f698cad1eda511ad76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e64fd5446d541da9d10af97a24ea037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:46:08.053955 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5fe072c3-1736-4ea9-9f2d-466873f9ff9f tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] 10.222.0.42 "GET /compute/v2.1/servers/56d08053-cd34-464a-ba73-ef113a24140d" status: 200 len: 1318 microversion: 2.1 time: 0.933583 Oct 23 01:46:08.059102 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3185/6280] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:46:07 2022] GET /compute/v2.1/servers/56d08053-cd34-464a-ba73-ef113a24140d => generated 1318 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:46:09.085469 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-af645905-73b5-4a2a-a2d5-037de900ea70 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:46:09.086914 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-af645905-73b5-4a2a-a2d5-037de900ea70 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] [instance: 56d08053-cd34-464a-ba73-ef113a24140d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:46:09.100674 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-af645905-73b5-4a2a-a2d5-037de900ea70 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:09.102766 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-af645905-73b5-4a2a-a2d5-037de900ea70 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:09.110685 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-af645905-73b5-4a2a-a2d5-037de900ea70 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:09.111607 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-af645905-73b5-4a2a-a2d5-037de900ea70 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:09.112328 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-af645905-73b5-4a2a-a2d5-037de900ea70 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:09.113015 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-af645905-73b5-4a2a-a2d5-037de900ea70 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:09.641204 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-af645905-73b5-4a2a-a2d5-037de900ea70 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2630e3eda1df4f698cad1eda511ad76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e64fd5446d541da9d10af97a24ea037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:46:09.658275 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-af645905-73b5-4a2a-a2d5-037de900ea70 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] 10.222.0.42 "GET /compute/v2.1/servers/56d08053-cd34-464a-ba73-ef113a24140d" status: 200 len: 1318 microversion: 2.1 time: 0.579126 Oct 23 01:46:09.659427 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3096/6281] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:46:09 2022] GET /compute/v2.1/servers/56d08053-cd34-464a-ba73-ef113a24140d => generated 1318 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:46:10.684061 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1aa6b943-99d2-4c4e-969b-a9ca534377ed tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:46:10.684688 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1aa6b943-99d2-4c4e-969b-a9ca534377ed tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] [instance: 56d08053-cd34-464a-ba73-ef113a24140d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:46:10.698452 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:46:10.699403 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=10 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:46:10.701738 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1aa6b943-99d2-4c4e-969b-a9ca534377ed tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:10.702277 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1aa6b943-99d2-4c4e-969b-a9ca534377ed tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:10.702724 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1aa6b943-99d2-4c4e-969b-a9ca534377ed tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:10.703529 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1aa6b943-99d2-4c4e-969b-a9ca534377ed tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:10.703894 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1aa6b943-99d2-4c4e-969b-a9ca534377ed tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:10.704320 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1aa6b943-99d2-4c4e-969b-a9ca534377ed tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:11.076442 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1aa6b943-99d2-4c4e-969b-a9ca534377ed tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2630e3eda1df4f698cad1eda511ad76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e64fd5446d541da9d10af97a24ea037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:46:11.096577 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1aa6b943-99d2-4c4e-969b-a9ca534377ed tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] 10.222.0.42 "GET /compute/v2.1/servers/56d08053-cd34-464a-ba73-ef113a24140d" status: 200 len: 1318 microversion: 2.1 time: 0.417651 Oct 23 01:46:11.098412 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3186/6282] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:46:10 2022] GET /compute/v2.1/servers/56d08053-cd34-464a-ba73-ef113a24140d => generated 1318 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:46:11.745770 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1d1ddb22-1136-47b0-82bc-8b368cd7862e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '.version_select at 0x7f5cc14a8af0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:46:11.944710 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1d1ddb22-1136-47b0-82bc-8b368cd7862e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1350726475" status: 202 len: 0 microversion: 2.1 time: 0.203598 Oct 23 01:46:11.946023 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3097/6283] 10.222.0.42 () {58 vars in 1284 bytes} [Sun Oct 23 01:46:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1350726475 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 23 01:46:11.993673 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4670ec26-6a20-4950-8007-25cfdd2e0af1 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Action: 'create', calling method: .version_select at 0x7f5cc10e2c10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2109170609", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8pfh03HMfJJOna9A7Xu6DsJha+WYFlpIdbxiLevw0z/cKEvE/c7lB1XoC82PGl8Jk/JZhwB7g6UKzR1zSYTOGcCaX5aTX6FlGmRdiuKcWysto5S/7rZL1zHfat+a1oPA=="}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:46:12.018246 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-4670ec26-6a20-4950-8007-25cfdd2e0af1 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Getting quotas for project 0c7f734a12da437e806e4c791d27d615. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:46:12.025765 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-4670ec26-6a20-4950-8007-25cfdd2e0af1 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Getting quotas for user 037ed342980a4de9a2dfc8d576293aba and project 0c7f734a12da437e806e4c791d27d615. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:46:12.125496 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3d718211-8153-4741-b23d-71ab4b18e9cb tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:46:12.126592 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3d718211-8153-4741-b23d-71ab4b18e9cb tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] [instance: 56d08053-cd34-464a-ba73-ef113a24140d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:46:12.134408 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3d718211-8153-4741-b23d-71ab4b18e9cb tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:12.134408 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3d718211-8153-4741-b23d-71ab4b18e9cb tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:12.138012 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3d718211-8153-4741-b23d-71ab4b18e9cb tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:12.138012 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3d718211-8153-4741-b23d-71ab4b18e9cb tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:12.138012 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3d718211-8153-4741-b23d-71ab4b18e9cb tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:12.138012 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3d718211-8153-4741-b23d-71ab4b18e9cb tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:12.162263 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4670ec26-6a20-4950-8007-25cfdd2e0af1 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.172597 Oct 23 01:46:12.173194 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3187/6284] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 01:46:11 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:46:12.509720 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3d718211-8153-4741-b23d-71ab4b18e9cb tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2630e3eda1df4f698cad1eda511ad76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e64fd5446d541da9d10af97a24ea037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:46:12.522141 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3d718211-8153-4741-b23d-71ab4b18e9cb tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] 10.222.0.42 "GET /compute/v2.1/servers/56d08053-cd34-464a-ba73-ef113a24140d" status: 200 len: 1318 microversion: 2.1 time: 0.398572 Oct 23 01:46:12.522994 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3098/6285] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:46:12 2022] GET /compute/v2.1/servers/56d08053-cd34-464a-ba73-ef113a24140d => generated 1318 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:46:13.548179 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-49448344-ccb2-4282-a414-7d0739402570 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:46:13.549454 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-49448344-ccb2-4282-a414-7d0739402570 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] [instance: 56d08053-cd34-464a-ba73-ef113a24140d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:46:13.560208 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-49448344-ccb2-4282-a414-7d0739402570 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:13.561133 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-49448344-ccb2-4282-a414-7d0739402570 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:13.561810 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-49448344-ccb2-4282-a414-7d0739402570 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:13.562754 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-49448344-ccb2-4282-a414-7d0739402570 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:13.563455 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-49448344-ccb2-4282-a414-7d0739402570 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:13.564108 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-49448344-ccb2-4282-a414-7d0739402570 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:13.792078 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-49448344-ccb2-4282-a414-7d0739402570 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2630e3eda1df4f698cad1eda511ad76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e64fd5446d541da9d10af97a24ea037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:46:13.808051 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-49448344-ccb2-4282-a414-7d0739402570 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] 10.222.0.42 "GET /compute/v2.1/servers/56d08053-cd34-464a-ba73-ef113a24140d" status: 200 len: 1318 microversion: 2.1 time: 0.258689 Oct 23 01:46:13.808051 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3188/6286] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:46:13 2022] GET /compute/v2.1/servers/56d08053-cd34-464a-ba73-ef113a24140d => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:46:14.700817 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-6b28ebbe-8090-4d70-a59d-a588ec0d9a45 req-e4a14382-a7f4-4e29-92cf-56328e3ce97d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56d08053-cd34-464a-ba73-ef113a24140d", "name": "network-vif-plugged", "status": "completed", "tag": "cef38fc4-7dde-4470-8321-82f548b4d443"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:46:14.723943 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-6b28ebbe-8090-4d70-a59d-a588ec0d9a45 req-e4a14382-a7f4-4e29-92cf-56328e3ce97d service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:14.723943 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-6b28ebbe-8090-4d70-a59d-a588ec0d9a45 req-e4a14382-a7f4-4e29-92cf-56328e3ce97d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:14.723943 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-6b28ebbe-8090-4d70-a59d-a588ec0d9a45 req-e4a14382-a7f4-4e29-92cf-56328e3ce97d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:14.745915 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-6b28ebbe-8090-4d70-a59d-a588ec0d9a45 req-e4a14382-a7f4-4e29-92cf-56328e3ce97d service nova] Creating event network-vif-plugged:cef38fc4-7dde-4470-8321-82f548b4d443 for instance 56d08053-cd34-464a-ba73-ef113a24140d on n-h2-master-1 Oct 23 01:46:14.754412 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-6b28ebbe-8090-4d70-a59d-a588ec0d9a45 req-e4a14382-a7f4-4e29-92cf-56328e3ce97d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058383 Oct 23 01:46:14.758385 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3099/6287] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:46:14.835011 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-14156d4a-dce8-4960-90fe-80929a024a55 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:46:14.840980 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-14156d4a-dce8-4960-90fe-80929a024a55 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] [instance: 56d08053-cd34-464a-ba73-ef113a24140d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:46:14.872675 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-14156d4a-dce8-4960-90fe-80929a024a55 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:14.873210 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-14156d4a-dce8-4960-90fe-80929a024a55 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:14.873669 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-14156d4a-dce8-4960-90fe-80929a024a55 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:14.882914 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-14156d4a-dce8-4960-90fe-80929a024a55 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:14.883564 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-14156d4a-dce8-4960-90fe-80929a024a55 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:14.884031 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-14156d4a-dce8-4960-90fe-80929a024a55 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:15.284741 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-14156d4a-dce8-4960-90fe-80929a024a55 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2630e3eda1df4f698cad1eda511ad76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e64fd5446d541da9d10af97a24ea037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:46:15.296145 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-14156d4a-dce8-4960-90fe-80929a024a55 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] 10.222.0.42 "GET /compute/v2.1/servers/56d08053-cd34-464a-ba73-ef113a24140d" status: 200 len: 1318 microversion: 2.1 time: 0.469041 Oct 23 01:46:15.297230 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3189/6288] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:46:14 2022] GET /compute/v2.1/servers/56d08053-cd34-464a-ba73-ef113a24140d => generated 1318 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:46:16.325062 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e1cdda95-5d17-43a5-8031-5ec1567a76b8 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:46:16.326545 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e1cdda95-5d17-43a5-8031-5ec1567a76b8 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] [instance: 56d08053-cd34-464a-ba73-ef113a24140d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:46:16.339791 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e1cdda95-5d17-43a5-8031-5ec1567a76b8 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:16.340790 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e1cdda95-5d17-43a5-8031-5ec1567a76b8 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:16.341376 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e1cdda95-5d17-43a5-8031-5ec1567a76b8 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:16.342868 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e1cdda95-5d17-43a5-8031-5ec1567a76b8 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:16.344582 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e1cdda95-5d17-43a5-8031-5ec1567a76b8 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:16.345277 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e1cdda95-5d17-43a5-8031-5ec1567a76b8 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:16.694480 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e1cdda95-5d17-43a5-8031-5ec1567a76b8 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2630e3eda1df4f698cad1eda511ad76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e64fd5446d541da9d10af97a24ea037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:46:16.703015 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e1cdda95-5d17-43a5-8031-5ec1567a76b8 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] 10.222.0.42 "GET /compute/v2.1/servers/56d08053-cd34-464a-ba73-ef113a24140d" status: 200 len: 1318 microversion: 2.1 time: 0.384041 Oct 23 01:46:16.716655 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3100/6289] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:46:16 2022] GET /compute/v2.1/servers/56d08053-cd34-464a-ba73-ef113a24140d => generated 1318 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:46:17.728593 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f63d8a6c-8802-4bb3-9c85-51f6d3b4daf1 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:46:17.729875 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f63d8a6c-8802-4bb3-9c85-51f6d3b4daf1 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] [instance: 56d08053-cd34-464a-ba73-ef113a24140d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:46:17.740066 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f63d8a6c-8802-4bb3-9c85-51f6d3b4daf1 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:17.742879 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f63d8a6c-8802-4bb3-9c85-51f6d3b4daf1 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:17.743763 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f63d8a6c-8802-4bb3-9c85-51f6d3b4daf1 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:17.746610 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f63d8a6c-8802-4bb3-9c85-51f6d3b4daf1 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:17.747425 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f63d8a6c-8802-4bb3-9c85-51f6d3b4daf1 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:17.748011 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f63d8a6c-8802-4bb3-9c85-51f6d3b4daf1 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:18.023793 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f63d8a6c-8802-4bb3-9c85-51f6d3b4daf1 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2630e3eda1df4f698cad1eda511ad76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e64fd5446d541da9d10af97a24ea037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:46:18.045186 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f63d8a6c-8802-4bb3-9c85-51f6d3b4daf1 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] 10.222.0.42 "GET /compute/v2.1/servers/56d08053-cd34-464a-ba73-ef113a24140d" status: 200 len: 1506 microversion: 2.1 time: 0.321033 Oct 23 01:46:18.073279 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3190/6290] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:46:17 2022] GET /compute/v2.1/servers/56d08053-cd34-464a-ba73-ef113a24140d => generated 1506 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:46:30.080909 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-000e8fae-0e47-4a24-a3f1-3650749d8255 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1330778730", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "4d5009fb-a5d6-497b-bab0-2c3b19cc7170"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2109170609", "security_groups": [{"name": "tempest-secgroup-smoke-1209700406"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:46:30.144565 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:46:30.146980 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:46:30.651808 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-000e8fae-0e47-4a24-a3f1-3650749d8255 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] validate_networks() for [('4d5009fb-a5d6-497b-bab0-2c3b19cc7170', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:46:32.506736 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-000e8fae-0e47-4a24-a3f1-3650749d8255 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:46:32.507452 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-000e8fae-0e47-4a24-a3f1-3650749d8255 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:46:32.507766 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-000e8fae-0e47-4a24-a3f1-3650749d8255 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:46:32.508490 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-000e8fae-0e47-4a24-a3f1-3650749d8255 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:46:32.510145 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-000e8fae-0e47-4a24-a3f1-3650749d8255 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:46:32.538577 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-000e8fae-0e47-4a24-a3f1-3650749d8255 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:32.539505 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-000e8fae-0e47-4a24-a3f1-3650749d8255 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:32.541391 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-000e8fae-0e47-4a24-a3f1-3650749d8255 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:32.546125 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-000e8fae-0e47-4a24-a3f1-3650749d8255 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:32.548368 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-000e8fae-0e47-4a24-a3f1-3650749d8255 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:32.549921 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-000e8fae-0e47-4a24-a3f1-3650749d8255 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:32.641523 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-000e8fae-0e47-4a24-a3f1-3650749d8255 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Getting quotas for project 0c7f734a12da437e806e4c791d27d615. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:46:32.672885 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-000e8fae-0e47-4a24-a3f1-3650749d8255 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Getting quotas for user 037ed342980a4de9a2dfc8d576293aba and project 0c7f734a12da437e806e4c791d27d615. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:46:32.724105 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-000e8fae-0e47-4a24-a3f1-3650749d8255 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:46:32.732831 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-000e8fae-0e47-4a24-a3f1-3650749d8255 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 74513e84-5d69-4d3b-aeed-5f4a45b6317e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:46:33.079778 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-000e8fae-0e47-4a24-a3f1-3650749d8255 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.001677 Oct 23 01:46:33.080473 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3101/6291] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:46:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 3004 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:46:33.099865 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ffab2659-08cd-41b5-8095-3fd5c8b0d55c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:46:33.099865 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ffab2659-08cd-41b5-8095-3fd5c8b0d55c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 74513e84-5d69-4d3b-aeed-5f4a45b6317e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:46:33.113714 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=4 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:46:33.122167 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=4 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:46:33.153394 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=60 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:46:33.338670 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ffab2659-08cd-41b5-8095-3fd5c8b0d55c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:46:33.346352 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ffab2659-08cd-41b5-8095-3fd5c8b0d55c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e" status: 200 len: 1267 microversion: 2.1 time: 0.255365 Oct 23 01:46:33.373910 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3191/6292] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:46:33 2022] GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e => generated 1267 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:46:33.966667 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e7797eff-d76f-40de-85f7-22918c82e6cb tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-676443199", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "8892c3c5-5a6d-429a-9efd-7a6db609f2a0"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:46:34.117460 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-e7797eff-d76f-40de-85f7-22918c82e6cb tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] validate_networks() for [('8892c3c5-5a6d-429a-9efd-7a6db609f2a0', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:46:34.374584 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-272046c8-6b66-456e-a6fc-3774cfa22e3a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:46:34.375211 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-272046c8-6b66-456e-a6fc-3774cfa22e3a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 74513e84-5d69-4d3b-aeed-5f4a45b6317e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:46:34.567403 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-272046c8-6b66-456e-a6fc-3774cfa22e3a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:46:34.594587 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-272046c8-6b66-456e-a6fc-3774cfa22e3a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e" status: 200 len: 1267 microversion: 2.1 time: 0.227881 Oct 23 01:46:34.595203 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3192/6293] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:46:34 2022] GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e => generated 1267 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:46:35.621890 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bc0dc2af-9cf4-4088-a183-9bf93d6da1c0 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:46:35.626607 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bc0dc2af-9cf4-4088-a183-9bf93d6da1c0 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 74513e84-5d69-4d3b-aeed-5f4a45b6317e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:46:35.646323 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc0dc2af-9cf4-4088-a183-9bf93d6da1c0 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:35.647180 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc0dc2af-9cf4-4088-a183-9bf93d6da1c0 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:35.647819 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc0dc2af-9cf4-4088-a183-9bf93d6da1c0 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:35.648732 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc0dc2af-9cf4-4088-a183-9bf93d6da1c0 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:35.649349 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc0dc2af-9cf4-4088-a183-9bf93d6da1c0 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:35.650734 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc0dc2af-9cf4-4088-a183-9bf93d6da1c0 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:35.826491 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bc0dc2af-9cf4-4088-a183-9bf93d6da1c0 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:46:35.875916 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bc0dc2af-9cf4-4088-a183-9bf93d6da1c0 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e" status: 200 len: 1271 microversion: 2.1 time: 0.258847 Oct 23 01:46:35.877249 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3193/6294] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:46:35 2022] GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e => generated 1271 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:46:35.968276 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-e7797eff-d76f-40de-85f7-22918c82e6cb tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:46:35.969292 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-e7797eff-d76f-40de-85f7-22918c82e6cb tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:46:35.970206 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-e7797eff-d76f-40de-85f7-22918c82e6cb tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:46:35.970924 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-e7797eff-d76f-40de-85f7-22918c82e6cb tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:46:35.975033 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-e7797eff-d76f-40de-85f7-22918c82e6cb tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:46:35.986706 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e7797eff-d76f-40de-85f7-22918c82e6cb tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:35.990087 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e7797eff-d76f-40de-85f7-22918c82e6cb tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:35.990775 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e7797eff-d76f-40de-85f7-22918c82e6cb tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:35.992324 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e7797eff-d76f-40de-85f7-22918c82e6cb tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:35.995449 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e7797eff-d76f-40de-85f7-22918c82e6cb tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:35.996385 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e7797eff-d76f-40de-85f7-22918c82e6cb tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:36.072470 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-e7797eff-d76f-40de-85f7-22918c82e6cb tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Getting quotas for project 13757f6a5da74eb494f5097be6a70823. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:46:36.103255 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-e7797eff-d76f-40de-85f7-22918c82e6cb tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Getting quotas for user 69b44fee007d4e098a34f71c2530f6f2 and project 13757f6a5da74eb494f5097be6a70823. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:46:36.137291 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e7797eff-d76f-40de-85f7-22918c82e6cb tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Going to run 3 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:46:36.141433 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e7797eff-d76f-40de-85f7-22918c82e6cb tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] [instance: 0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:46:36.278302 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e7797eff-d76f-40de-85f7-22918c82e6cb tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] [instance: 91d10bf0-72e1-48bf-9c76-f13e3e4cd27b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:46:36.455580 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e7797eff-d76f-40de-85f7-22918c82e6cb tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] [instance: 1a7da380-db15-4dd3-ac05-3788924a92c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=91d10bf0-72e1-48bf-9c76-f13e3e4cd27b,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:46:36.905421 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c5545572-ea70-40f1-8623-53efbaaa32f8 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:46:36.906786 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c5545572-ea70-40f1-8623-53efbaaa32f8 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 74513e84-5d69-4d3b-aeed-5f4a45b6317e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:46:36.923117 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c5545572-ea70-40f1-8623-53efbaaa32f8 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:36.924666 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c5545572-ea70-40f1-8623-53efbaaa32f8 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:36.926701 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c5545572-ea70-40f1-8623-53efbaaa32f8 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:36.927625 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c5545572-ea70-40f1-8623-53efbaaa32f8 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:36.928808 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c5545572-ea70-40f1-8623-53efbaaa32f8 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:36.930501 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c5545572-ea70-40f1-8623-53efbaaa32f8 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:37.032905 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e7797eff-d76f-40de-85f7-22918c82e6cb tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.517444 Oct 23 01:46:37.045990 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3102/6295] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:46:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 3531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:46:37.069806 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7a8db861-f65e-49be-958c-124cd80a9478 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:46:37.101918 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c5545572-ea70-40f1-8623-53efbaaa32f8 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:46:37.105648 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7a8db861-f65e-49be-958c-124cd80a9478 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '69b44fee007d4e098a34f71c2530f6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13757f6a5da74eb494f5097be6a70823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:46:37.110332 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7a8db861-f65e-49be-958c-124cd80a9478 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Searching by: {'deleted': False, 'project_id': '13757f6a5da74eb494f5097be6a70823'} {{(pid=120945) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 23 01:46:37.119904 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c5545572-ea70-40f1-8623-53efbaaa32f8 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e" status: 200 len: 1319 microversion: 2.1 time: 0.223283 Oct 23 01:46:37.121252 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3194/6296] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:46:36 2022] GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:46:37.162545 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a8db861-f65e-49be-958c-124cd80a9478 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:37.163371 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a8db861-f65e-49be-958c-124cd80a9478 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:37.163976 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a8db861-f65e-49be-958c-124cd80a9478 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:37.165261 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a8db861-f65e-49be-958c-124cd80a9478 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:37.165876 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a8db861-f65e-49be-958c-124cd80a9478 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:37.168893 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a8db861-f65e-49be-958c-124cd80a9478 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:37.204796 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7a8db861-f65e-49be-958c-124cd80a9478 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.153489 Oct 23 01:46:37.204796 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3103/6297] 10.222.0.42 () {58 vars in 1125 bytes} [Sun Oct 23 01:46:37 2022] GET /compute/v2.1/servers => generated 1015 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:46:37.217552 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-717ea422-01b6-4705-8b5e-83aea3330751 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:46:37.218538 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-717ea422-01b6-4705-8b5e-83aea3330751 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] [instance: 1a7da380-db15-4dd3-ac05-3788924a92c5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:46:37.533747 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-717ea422-01b6-4705-8b5e-83aea3330751 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b44fee007d4e098a34f71c2530f6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13757f6a5da74eb494f5097be6a70823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:46:37.544276 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-717ea422-01b6-4705-8b5e-83aea3330751 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] 10.222.0.42 "GET /compute/v2.1/servers/1a7da380-db15-4dd3-ac05-3788924a92c5" status: 200 len: 1222 microversion: 2.1 time: 0.331824 Oct 23 01:46:37.550438 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3195/6298] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:46:37 2022] GET /compute/v2.1/servers/1a7da380-db15-4dd3-ac05-3788924a92c5 => generated 1222 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:46:38.148025 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ade19061-5a71-4e22-af2c-5e176f8f4641 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:46:38.149295 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ade19061-5a71-4e22-af2c-5e176f8f4641 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 74513e84-5d69-4d3b-aeed-5f4a45b6317e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:46:38.159018 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ade19061-5a71-4e22-af2c-5e176f8f4641 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:38.159557 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ade19061-5a71-4e22-af2c-5e176f8f4641 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:38.160547 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ade19061-5a71-4e22-af2c-5e176f8f4641 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:38.162080 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ade19061-5a71-4e22-af2c-5e176f8f4641 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:38.165637 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ade19061-5a71-4e22-af2c-5e176f8f4641 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:38.168615 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ade19061-5a71-4e22-af2c-5e176f8f4641 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:38.270337 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ade19061-5a71-4e22-af2c-5e176f8f4641 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:46:38.281250 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ade19061-5a71-4e22-af2c-5e176f8f4641 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e" status: 200 len: 1325 microversion: 2.1 time: 0.136129 Oct 23 01:46:38.283936 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3104/6299] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:46:38 2022] GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e => generated 1325 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:46:38.578720 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-433bdb0a-79f7-47be-9c57-bcfecb85ace7 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:46:38.579336 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-433bdb0a-79f7-47be-9c57-bcfecb85ace7 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] [instance: 1a7da380-db15-4dd3-ac05-3788924a92c5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:46:38.692533 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-433bdb0a-79f7-47be-9c57-bcfecb85ace7 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b44fee007d4e098a34f71c2530f6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13757f6a5da74eb494f5097be6a70823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:46:38.702487 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-433bdb0a-79f7-47be-9c57-bcfecb85ace7 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] 10.222.0.42 "GET /compute/v2.1/servers/1a7da380-db15-4dd3-ac05-3788924a92c5" status: 200 len: 1222 microversion: 2.1 time: 0.127596 Oct 23 01:46:38.703139 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3196/6300] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:46:38 2022] GET /compute/v2.1/servers/1a7da380-db15-4dd3-ac05-3788924a92c5 => generated 1222 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:46:39.315271 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7f8f5949-3760-4019-9b55-151edfcb3a2b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:46:39.317443 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7f8f5949-3760-4019-9b55-151edfcb3a2b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 74513e84-5d69-4d3b-aeed-5f4a45b6317e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:46:39.325961 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f8f5949-3760-4019-9b55-151edfcb3a2b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:39.326858 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f8f5949-3760-4019-9b55-151edfcb3a2b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:39.327779 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f8f5949-3760-4019-9b55-151edfcb3a2b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:39.328799 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f8f5949-3760-4019-9b55-151edfcb3a2b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:39.330436 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f8f5949-3760-4019-9b55-151edfcb3a2b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:39.331249 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f8f5949-3760-4019-9b55-151edfcb3a2b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:39.731101 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5439ec71-6ea6-4b18-b9cd-0a56eb6ea900 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:46:39.732130 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5439ec71-6ea6-4b18-b9cd-0a56eb6ea900 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] [instance: 1a7da380-db15-4dd3-ac05-3788924a92c5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:46:40.486390 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5439ec71-6ea6-4b18-b9cd-0a56eb6ea900 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b44fee007d4e098a34f71c2530f6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13757f6a5da74eb494f5097be6a70823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:46:40.497659 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5439ec71-6ea6-4b18-b9cd-0a56eb6ea900 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] 10.222.0.42 "GET /compute/v2.1/servers/1a7da380-db15-4dd3-ac05-3788924a92c5" status: 200 len: 1222 microversion: 2.1 time: 0.772076 Oct 23 01:46:40.512778 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3197/6301] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:46:39 2022] GET /compute/v2.1/servers/1a7da380-db15-4dd3-ac05-3788924a92c5 => generated 1222 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:46:40.806760 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7f8f5949-3760-4019-9b55-151edfcb3a2b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:46:40.823313 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7f8f5949-3760-4019-9b55-151edfcb3a2b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e" status: 200 len: 1393 microversion: 2.1 time: 1.513330 Oct 23 01:46:40.824009 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3105/6302] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:46:39 2022] GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e => generated 1393 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:46:41.524553 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9b02629a-d276-4804-b3f1-6842544333a1 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:46:41.525165 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9b02629a-d276-4804-b3f1-6842544333a1 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] [instance: 1a7da380-db15-4dd3-ac05-3788924a92c5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:46:41.616452 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9b02629a-d276-4804-b3f1-6842544333a1 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b44fee007d4e098a34f71c2530f6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13757f6a5da74eb494f5097be6a70823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:46:41.632796 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9b02629a-d276-4804-b3f1-6842544333a1 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] 10.222.0.42 "GET /compute/v2.1/servers/1a7da380-db15-4dd3-ac05-3788924a92c5" status: 200 len: 1222 microversion: 2.1 time: 0.112466 Oct 23 01:46:41.633723 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3198/6303] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:46:41 2022] GET /compute/v2.1/servers/1a7da380-db15-4dd3-ac05-3788924a92c5 => generated 1222 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:46:41.856367 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-78ccde0d-abe6-42da-b2fc-194e6d81a816 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:46:41.857627 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-78ccde0d-abe6-42da-b2fc-194e6d81a816 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 74513e84-5d69-4d3b-aeed-5f4a45b6317e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:46:41.865369 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78ccde0d-abe6-42da-b2fc-194e6d81a816 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:41.865865 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78ccde0d-abe6-42da-b2fc-194e6d81a816 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:41.866735 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78ccde0d-abe6-42da-b2fc-194e6d81a816 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:41.867981 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78ccde0d-abe6-42da-b2fc-194e6d81a816 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:41.868628 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78ccde0d-abe6-42da-b2fc-194e6d81a816 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:41.869069 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-78ccde0d-abe6-42da-b2fc-194e6d81a816 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:42.021283 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-78ccde0d-abe6-42da-b2fc-194e6d81a816 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:46:42.033029 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-78ccde0d-abe6-42da-b2fc-194e6d81a816 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e" status: 200 len: 1393 microversion: 2.1 time: 0.185389 Oct 23 01:46:42.033029 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3106/6304] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:46:41 2022] GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e => generated 1393 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:46:42.673244 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-def5875f-a1d4-4968-a24d-c76ed9519fe5 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:46:42.673244 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-def5875f-a1d4-4968-a24d-c76ed9519fe5 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] [instance: 1a7da380-db15-4dd3-ac05-3788924a92c5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:46:42.676487 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-def5875f-a1d4-4968-a24d-c76ed9519fe5 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:42.677201 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-def5875f-a1d4-4968-a24d-c76ed9519fe5 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:42.677873 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-def5875f-a1d4-4968-a24d-c76ed9519fe5 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:42.678983 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-def5875f-a1d4-4968-a24d-c76ed9519fe5 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:42.679864 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-def5875f-a1d4-4968-a24d-c76ed9519fe5 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:42.681133 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-def5875f-a1d4-4968-a24d-c76ed9519fe5 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:42.883416 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-def5875f-a1d4-4968-a24d-c76ed9519fe5 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b44fee007d4e098a34f71c2530f6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13757f6a5da74eb494f5097be6a70823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:46:42.893232 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-def5875f-a1d4-4968-a24d-c76ed9519fe5 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] 10.222.0.42 "GET /compute/v2.1/servers/1a7da380-db15-4dd3-ac05-3788924a92c5" status: 200 len: 1226 microversion: 2.1 time: 0.233642 Oct 23 01:46:42.898772 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3199/6305] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:46:42 2022] GET /compute/v2.1/servers/1a7da380-db15-4dd3-ac05-3788924a92c5 => generated 1226 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:46:43.060617 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-99248332-4de3-455d-80d4-562a8291ed6a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:46:43.061245 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-99248332-4de3-455d-80d4-562a8291ed6a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 74513e84-5d69-4d3b-aeed-5f4a45b6317e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:46:43.076830 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-99248332-4de3-455d-80d4-562a8291ed6a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:43.077365 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-99248332-4de3-455d-80d4-562a8291ed6a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:43.077804 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-99248332-4de3-455d-80d4-562a8291ed6a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:43.078556 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-99248332-4de3-455d-80d4-562a8291ed6a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:43.087535 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-99248332-4de3-455d-80d4-562a8291ed6a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:43.095383 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-99248332-4de3-455d-80d4-562a8291ed6a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:43.230365 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-7070009b-efc6-448d-b5fe-2f6154470218 req-a9af0b65-fb19-4b14-9b7a-841005854a50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74513e84-5d69-4d3b-aeed-5f4a45b6317e", "tag": "e6543d72-1e98-4648-a366-e7651509bade"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:46:43.253216 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-7070009b-efc6-448d-b5fe-2f6154470218 req-a9af0b65-fb19-4b14-9b7a-841005854a50 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:43.255365 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-7070009b-efc6-448d-b5fe-2f6154470218 req-a9af0b65-fb19-4b14-9b7a-841005854a50 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:43.255966 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-7070009b-efc6-448d-b5fe-2f6154470218 req-a9af0b65-fb19-4b14-9b7a-841005854a50 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:43.299267 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-7070009b-efc6-448d-b5fe-2f6154470218 req-a9af0b65-fb19-4b14-9b7a-841005854a50 service nova] Creating event network-changed:e6543d72-1e98-4648-a366-e7651509bade for instance 74513e84-5d69-4d3b-aeed-5f4a45b6317e on n-h1-master-1 Oct 23 01:46:43.319232 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-7070009b-efc6-448d-b5fe-2f6154470218 req-a9af0b65-fb19-4b14-9b7a-841005854a50 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086598 Oct 23 01:46:43.320415 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3200/6306] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:46:43.453193 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-99248332-4de3-455d-80d4-562a8291ed6a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:46:43.475710 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-99248332-4de3-455d-80d4-562a8291ed6a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e" status: 200 len: 1393 microversion: 2.1 time: 0.419472 Oct 23 01:46:43.481502 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3107/6307] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:46:43 2022] GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e => generated 1393 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:46:43.930887 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-625a565a-6c6f-4b62-8c0c-64ca43f70846 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:46:43.933048 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-625a565a-6c6f-4b62-8c0c-64ca43f70846 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] [instance: 1a7da380-db15-4dd3-ac05-3788924a92c5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:46:43.944100 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-625a565a-6c6f-4b62-8c0c-64ca43f70846 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:43.948839 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-625a565a-6c6f-4b62-8c0c-64ca43f70846 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:43.948839 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-625a565a-6c6f-4b62-8c0c-64ca43f70846 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:43.950884 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-625a565a-6c6f-4b62-8c0c-64ca43f70846 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:43.952882 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-625a565a-6c6f-4b62-8c0c-64ca43f70846 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:43.954587 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-625a565a-6c6f-4b62-8c0c-64ca43f70846 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:44.327351 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-625a565a-6c6f-4b62-8c0c-64ca43f70846 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b44fee007d4e098a34f71c2530f6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13757f6a5da74eb494f5097be6a70823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:46:44.338956 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-625a565a-6c6f-4b62-8c0c-64ca43f70846 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] 10.222.0.42 "GET /compute/v2.1/servers/1a7da380-db15-4dd3-ac05-3788924a92c5" status: 200 len: 1274 microversion: 2.1 time: 0.412449 Oct 23 01:46:44.341532 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3201/6308] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:46:43 2022] GET /compute/v2.1/servers/1a7da380-db15-4dd3-ac05-3788924a92c5 => generated 1274 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:46:44.543212 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-726084fa-37b9-4de3-98c6-607354c56518 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:46:44.549077 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-726084fa-37b9-4de3-98c6-607354c56518 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 74513e84-5d69-4d3b-aeed-5f4a45b6317e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:46:44.561476 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-726084fa-37b9-4de3-98c6-607354c56518 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:44.562297 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-726084fa-37b9-4de3-98c6-607354c56518 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:44.563194 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-726084fa-37b9-4de3-98c6-607354c56518 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:44.564123 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-726084fa-37b9-4de3-98c6-607354c56518 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:44.576650 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-726084fa-37b9-4de3-98c6-607354c56518 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:44.579027 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-726084fa-37b9-4de3-98c6-607354c56518 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:45.234555 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-726084fa-37b9-4de3-98c6-607354c56518 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:46:45.247882 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-726084fa-37b9-4de3-98c6-607354c56518 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e" status: 200 len: 1393 microversion: 2.1 time: 0.744324 Oct 23 01:46:45.252564 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3108/6309] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:46:44 2022] GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e => generated 1393 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:46:45.365742 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ccc65631-3077-4f9a-987f-85d188f63436 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:46:45.366719 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ccc65631-3077-4f9a-987f-85d188f63436 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] [instance: 1a7da380-db15-4dd3-ac05-3788924a92c5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:46:45.383008 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ccc65631-3077-4f9a-987f-85d188f63436 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:45.383008 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ccc65631-3077-4f9a-987f-85d188f63436 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:45.383008 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ccc65631-3077-4f9a-987f-85d188f63436 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:45.383008 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ccc65631-3077-4f9a-987f-85d188f63436 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:45.383008 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ccc65631-3077-4f9a-987f-85d188f63436 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:45.384827 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ccc65631-3077-4f9a-987f-85d188f63436 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:45.497915 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ccc65631-3077-4f9a-987f-85d188f63436 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b44fee007d4e098a34f71c2530f6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13757f6a5da74eb494f5097be6a70823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:46:45.511129 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ccc65631-3077-4f9a-987f-85d188f63436 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] 10.222.0.42 "GET /compute/v2.1/servers/1a7da380-db15-4dd3-ac05-3788924a92c5" status: 200 len: 1280 microversion: 2.1 time: 0.149845 Oct 23 01:46:45.530526 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3202/6310] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:46:45 2022] GET /compute/v2.1/servers/1a7da380-db15-4dd3-ac05-3788924a92c5 => generated 1280 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:46:46.277357 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-39dea1c1-d161-421d-b5fc-cbbaf31409c8 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:46:46.277357 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-39dea1c1-d161-421d-b5fc-cbbaf31409c8 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 74513e84-5d69-4d3b-aeed-5f4a45b6317e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:46:46.283316 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=12 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:46:46.290670 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-39dea1c1-d161-421d-b5fc-cbbaf31409c8 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:46.291857 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-39dea1c1-d161-421d-b5fc-cbbaf31409c8 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:46.292558 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-39dea1c1-d161-421d-b5fc-cbbaf31409c8 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:46.294625 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-39dea1c1-d161-421d-b5fc-cbbaf31409c8 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:46.296301 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-39dea1c1-d161-421d-b5fc-cbbaf31409c8 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:46.297016 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-39dea1c1-d161-421d-b5fc-cbbaf31409c8 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:46.546231 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-39dea1c1-d161-421d-b5fc-cbbaf31409c8 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:46:46.551808 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ebb703e8-ed98-4a83-ab9e-5db070f05350 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:46:46.551808 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ebb703e8-ed98-4a83-ab9e-5db070f05350 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] [instance: 1a7da380-db15-4dd3-ac05-3788924a92c5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:46:46.566880 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-39dea1c1-d161-421d-b5fc-cbbaf31409c8 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e" status: 200 len: 1393 microversion: 2.1 time: 0.298037 Oct 23 01:46:46.578251 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ebb703e8-ed98-4a83-ab9e-5db070f05350 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:46.582956 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ebb703e8-ed98-4a83-ab9e-5db070f05350 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:46.582956 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ebb703e8-ed98-4a83-ab9e-5db070f05350 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:46.584093 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3109/6311] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:46:46 2022] GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e => generated 1393 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:46:46.588605 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ebb703e8-ed98-4a83-ab9e-5db070f05350 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:46.589198 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ebb703e8-ed98-4a83-ab9e-5db070f05350 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:46.591900 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ebb703e8-ed98-4a83-ab9e-5db070f05350 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:46.748382 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ebb703e8-ed98-4a83-ab9e-5db070f05350 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b44fee007d4e098a34f71c2530f6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13757f6a5da74eb494f5097be6a70823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:46:46.761802 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ebb703e8-ed98-4a83-ab9e-5db070f05350 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] 10.222.0.42 "GET /compute/v2.1/servers/1a7da380-db15-4dd3-ac05-3788924a92c5" status: 200 len: 1280 microversion: 2.1 time: 0.222614 Oct 23 01:46:46.766661 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3203/6312] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:46:46 2022] GET /compute/v2.1/servers/1a7da380-db15-4dd3-ac05-3788924a92c5 => generated 1280 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:46:47.594866 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-41e83783-36fd-454e-ad48-1699837f1010 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:46:47.595496 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-41e83783-36fd-454e-ad48-1699837f1010 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 74513e84-5d69-4d3b-aeed-5f4a45b6317e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:46:47.601104 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=6 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:46:47.616758 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-41e83783-36fd-454e-ad48-1699837f1010 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:47.617566 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-41e83783-36fd-454e-ad48-1699837f1010 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:47.618310 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-41e83783-36fd-454e-ad48-1699837f1010 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:47.638873 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-41e83783-36fd-454e-ad48-1699837f1010 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:47.639609 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-41e83783-36fd-454e-ad48-1699837f1010 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:47.640367 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-41e83783-36fd-454e-ad48-1699837f1010 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:47.789633 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-766c0c4b-ee79-4f31-8aae-4062119a00f6 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:46:47.791250 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-766c0c4b-ee79-4f31-8aae-4062119a00f6 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] [instance: 1a7da380-db15-4dd3-ac05-3788924a92c5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:46:47.802025 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-766c0c4b-ee79-4f31-8aae-4062119a00f6 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:47.805888 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-766c0c4b-ee79-4f31-8aae-4062119a00f6 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:47.809461 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-766c0c4b-ee79-4f31-8aae-4062119a00f6 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:47.810459 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-766c0c4b-ee79-4f31-8aae-4062119a00f6 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:47.811677 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-766c0c4b-ee79-4f31-8aae-4062119a00f6 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:47.813120 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-766c0c4b-ee79-4f31-8aae-4062119a00f6 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:47.999850 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-766c0c4b-ee79-4f31-8aae-4062119a00f6 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b44fee007d4e098a34f71c2530f6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13757f6a5da74eb494f5097be6a70823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:46:48.026154 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-766c0c4b-ee79-4f31-8aae-4062119a00f6 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] 10.222.0.42 "GET /compute/v2.1/servers/1a7da380-db15-4dd3-ac05-3788924a92c5" status: 200 len: 1280 microversion: 2.1 time: 0.240309 Oct 23 01:46:48.026778 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3204/6313] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:46:47 2022] GET /compute/v2.1/servers/1a7da380-db15-4dd3-ac05-3788924a92c5 => generated 1280 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:46:48.108195 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-41e83783-36fd-454e-ad48-1699837f1010 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:46:48.117731 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-41e83783-36fd-454e-ad48-1699837f1010 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e" status: 200 len: 1393 microversion: 2.1 time: 0.527844 Oct 23 01:46:48.118595 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3110/6314] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:46:47 2022] GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e => generated 1393 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:46:49.058105 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-89be9b6b-59b1-41bc-accf-50460ab2b0fc tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:46:49.058747 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-89be9b6b-59b1-41bc-accf-50460ab2b0fc tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] [instance: 1a7da380-db15-4dd3-ac05-3788924a92c5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:46:49.066694 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-89be9b6b-59b1-41bc-accf-50460ab2b0fc tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:49.067465 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-89be9b6b-59b1-41bc-accf-50460ab2b0fc tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:49.068360 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-89be9b6b-59b1-41bc-accf-50460ab2b0fc tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:49.069758 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-89be9b6b-59b1-41bc-accf-50460ab2b0fc tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:49.070992 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-89be9b6b-59b1-41bc-accf-50460ab2b0fc tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:49.071579 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-89be9b6b-59b1-41bc-accf-50460ab2b0fc tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:49.143711 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-302e3b91-cd7c-4941-9c69-3335f61779bd tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:46:49.145079 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-302e3b91-cd7c-4941-9c69-3335f61779bd tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 74513e84-5d69-4d3b-aeed-5f4a45b6317e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:46:49.162790 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-302e3b91-cd7c-4941-9c69-3335f61779bd tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:49.164155 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-302e3b91-cd7c-4941-9c69-3335f61779bd tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:49.165764 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-302e3b91-cd7c-4941-9c69-3335f61779bd tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:49.167391 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-302e3b91-cd7c-4941-9c69-3335f61779bd tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:49.168703 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-302e3b91-cd7c-4941-9c69-3335f61779bd tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:49.170074 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-302e3b91-cd7c-4941-9c69-3335f61779bd tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:49.634582 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-302e3b91-cd7c-4941-9c69-3335f61779bd tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:46:49.652274 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-89be9b6b-59b1-41bc-accf-50460ab2b0fc tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b44fee007d4e098a34f71c2530f6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13757f6a5da74eb494f5097be6a70823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:46:49.653724 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-302e3b91-cd7c-4941-9c69-3335f61779bd tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e" status: 200 len: 1393 microversion: 2.1 time: 0.514315 Oct 23 01:46:49.654723 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3111/6315] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:46:49 2022] GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e => generated 1393 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:46:49.679202 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-89be9b6b-59b1-41bc-accf-50460ab2b0fc tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] 10.222.0.42 "GET /compute/v2.1/servers/1a7da380-db15-4dd3-ac05-3788924a92c5" status: 200 len: 1322 microversion: 2.1 time: 0.628917 Oct 23 01:46:49.683514 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3205/6316] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:46:49 2022] GET /compute/v2.1/servers/1a7da380-db15-4dd3-ac05-3788924a92c5 => generated 1322 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:46:50.677584 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e7a99cf4-908f-4ba3-9aa0-69176af4be88 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:46:50.678469 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e7a99cf4-908f-4ba3-9aa0-69176af4be88 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 74513e84-5d69-4d3b-aeed-5f4a45b6317e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:46:50.697922 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e7a99cf4-908f-4ba3-9aa0-69176af4be88 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:50.699650 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e7a99cf4-908f-4ba3-9aa0-69176af4be88 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:50.699650 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e7a99cf4-908f-4ba3-9aa0-69176af4be88 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:50.706397 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7852f966-9b15-4c12-8942-f68384d630d1 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:46:50.706397 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7852f966-9b15-4c12-8942-f68384d630d1 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] [instance: 1a7da380-db15-4dd3-ac05-3788924a92c5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:46:50.714831 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e7a99cf4-908f-4ba3-9aa0-69176af4be88 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:50.715455 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e7a99cf4-908f-4ba3-9aa0-69176af4be88 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:50.715909 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e7a99cf4-908f-4ba3-9aa0-69176af4be88 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:50.727784 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7852f966-9b15-4c12-8942-f68384d630d1 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:50.731821 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7852f966-9b15-4c12-8942-f68384d630d1 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:50.739499 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7852f966-9b15-4c12-8942-f68384d630d1 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:50.744748 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7852f966-9b15-4c12-8942-f68384d630d1 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:50.745267 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7852f966-9b15-4c12-8942-f68384d630d1 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:50.745720 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7852f966-9b15-4c12-8942-f68384d630d1 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:51.175386 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e7a99cf4-908f-4ba3-9aa0-69176af4be88 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:46:51.185109 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e7a99cf4-908f-4ba3-9aa0-69176af4be88 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e" status: 200 len: 1393 microversion: 2.1 time: 0.512202 Oct 23 01:46:51.189001 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7852f966-9b15-4c12-8942-f68384d630d1 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b44fee007d4e098a34f71c2530f6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13757f6a5da74eb494f5097be6a70823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:46:51.212371 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3112/6317] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:46:50 2022] GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e => generated 1393 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:46:51.214449 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7852f966-9b15-4c12-8942-f68384d630d1 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] 10.222.0.42 "GET /compute/v2.1/servers/1a7da380-db15-4dd3-ac05-3788924a92c5" status: 200 len: 1322 microversion: 2.1 time: 0.508598 Oct 23 01:46:51.218763 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3206/6318] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:46:50 2022] GET /compute/v2.1/servers/1a7da380-db15-4dd3-ac05-3788924a92c5 => generated 1322 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:46:51.238721 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-5888b3c2-5c72-4046-91e3-aa123db26594 req-e8998482-b749-4ade-823e-a3eb225f6956 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb", "tag": "49559226-e40a-4b3a-acd7-f3797eb13a1d"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:46:51.264138 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-5888b3c2-5c72-4046-91e3-aa123db26594 req-e8998482-b749-4ade-823e-a3eb225f6956 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:51.264886 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-5888b3c2-5c72-4046-91e3-aa123db26594 req-e8998482-b749-4ade-823e-a3eb225f6956 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:51.269215 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-5888b3c2-5c72-4046-91e3-aa123db26594 req-e8998482-b749-4ade-823e-a3eb225f6956 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:51.299240 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-5888b3c2-5c72-4046-91e3-aa123db26594 req-e8998482-b749-4ade-823e-a3eb225f6956 service nova] Creating event network-changed:49559226-e40a-4b3a-acd7-f3797eb13a1d for instance 0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb on n-h2-master-1 Oct 23 01:46:51.311697 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-5888b3c2-5c72-4046-91e3-aa123db26594 req-e8998482-b749-4ade-823e-a3eb225f6956 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092236 Oct 23 01:46:51.317919 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3113/6319] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:46:52.245174 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5c3e9c34-4238-4fce-9349-ec2557867d6e tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:46:52.250277 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9d58975b-cdc0-4d87-87c9-ffb9beccbb34 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:46:52.251242 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9d58975b-cdc0-4d87-87c9-ffb9beccbb34 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 74513e84-5d69-4d3b-aeed-5f4a45b6317e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:46:52.255750 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5c3e9c34-4238-4fce-9349-ec2557867d6e tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] [instance: 1a7da380-db15-4dd3-ac05-3788924a92c5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:46:52.261494 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=12 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:46:52.266116 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5c3e9c34-4238-4fce-9349-ec2557867d6e tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:52.266911 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5c3e9c34-4238-4fce-9349-ec2557867d6e tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:52.267538 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5c3e9c34-4238-4fce-9349-ec2557867d6e tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:52.268557 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5c3e9c34-4238-4fce-9349-ec2557867d6e tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:52.270788 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5c3e9c34-4238-4fce-9349-ec2557867d6e tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:52.270952 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9d58975b-cdc0-4d87-87c9-ffb9beccbb34 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:52.272213 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5c3e9c34-4238-4fce-9349-ec2557867d6e tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:52.272352 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9d58975b-cdc0-4d87-87c9-ffb9beccbb34 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:52.272802 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9d58975b-cdc0-4d87-87c9-ffb9beccbb34 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:52.273595 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9d58975b-cdc0-4d87-87c9-ffb9beccbb34 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:52.274361 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9d58975b-cdc0-4d87-87c9-ffb9beccbb34 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:52.280909 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9d58975b-cdc0-4d87-87c9-ffb9beccbb34 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:52.839323 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5c3e9c34-4238-4fce-9349-ec2557867d6e tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b44fee007d4e098a34f71c2530f6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13757f6a5da74eb494f5097be6a70823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:46:52.880820 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5c3e9c34-4238-4fce-9349-ec2557867d6e tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] 10.222.0.42 "GET /compute/v2.1/servers/1a7da380-db15-4dd3-ac05-3788924a92c5" status: 200 len: 1322 microversion: 2.1 time: 0.636260 Oct 23 01:46:52.882294 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3114/6320] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:46:52 2022] GET /compute/v2.1/servers/1a7da380-db15-4dd3-ac05-3788924a92c5 => generated 1322 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:46:52.896256 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9d58975b-cdc0-4d87-87c9-ffb9beccbb34 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:46:52.903630 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9d58975b-cdc0-4d87-87c9-ffb9beccbb34 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e" status: 200 len: 1393 microversion: 2.1 time: 0.668340 Oct 23 01:46:52.907483 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3207/6321] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:46:52 2022] GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e => generated 1393 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:46:53.374999 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-4ae9b69a-288e-4b71-a6ce-22d44645d9fd req-9addbc58-3360-407e-abf3-cb2086b6e982 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91d10bf0-72e1-48bf-9c76-f13e3e4cd27b", "tag": "1c77708b-7d5e-4e9d-9b03-0b5e99a2f97f"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:46:53.414491 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-4ae9b69a-288e-4b71-a6ce-22d44645d9fd req-9addbc58-3360-407e-abf3-cb2086b6e982 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:53.419730 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-4ae9b69a-288e-4b71-a6ce-22d44645d9fd req-9addbc58-3360-407e-abf3-cb2086b6e982 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:53.420282 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-4ae9b69a-288e-4b71-a6ce-22d44645d9fd req-9addbc58-3360-407e-abf3-cb2086b6e982 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:53.452746 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-4ae9b69a-288e-4b71-a6ce-22d44645d9fd req-9addbc58-3360-407e-abf3-cb2086b6e982 service nova] Creating event network-changed:1c77708b-7d5e-4e9d-9b03-0b5e99a2f97f for instance 91d10bf0-72e1-48bf-9c76-f13e3e4cd27b on n-h1-master-1 Oct 23 01:46:53.470230 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-4ae9b69a-288e-4b71-a6ce-22d44645d9fd req-9addbc58-3360-407e-abf3-cb2086b6e982 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106553 Oct 23 01:46:53.471370 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3115/6322] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:46:53.842798 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-85bf82e9-7cb7-4a15-8364-e764c670c189 req-1ace6b42-c7de-4ee6-8850-a6e51c9cba8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74513e84-5d69-4d3b-aeed-5f4a45b6317e", "name": "network-vif-plugged", "status": "completed", "tag": "e6543d72-1e98-4648-a366-e7651509bade"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:46:53.856152 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-85bf82e9-7cb7-4a15-8364-e764c670c189 req-1ace6b42-c7de-4ee6-8850-a6e51c9cba8e service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:53.857003 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-85bf82e9-7cb7-4a15-8364-e764c670c189 req-1ace6b42-c7de-4ee6-8850-a6e51c9cba8e service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:53.857646 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-85bf82e9-7cb7-4a15-8364-e764c670c189 req-1ace6b42-c7de-4ee6-8850-a6e51c9cba8e service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:53.881341 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-85bf82e9-7cb7-4a15-8364-e764c670c189 req-1ace6b42-c7de-4ee6-8850-a6e51c9cba8e service nova] Creating event network-vif-plugged:e6543d72-1e98-4648-a366-e7651509bade for instance 74513e84-5d69-4d3b-aeed-5f4a45b6317e on n-h1-master-1 Oct 23 01:46:53.911785 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1615b048-bb96-47a9-a3a6-4bbf0bd48e65 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:46:53.912558 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-85bf82e9-7cb7-4a15-8364-e764c670c189 req-1ace6b42-c7de-4ee6-8850-a6e51c9cba8e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073800 Oct 23 01:46:53.912976 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1615b048-bb96-47a9-a3a6-4bbf0bd48e65 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] [instance: 1a7da380-db15-4dd3-ac05-3788924a92c5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:46:53.920270 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3208/6323] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:46:53.931668 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1615b048-bb96-47a9-a3a6-4bbf0bd48e65 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:53.932376 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1615b048-bb96-47a9-a3a6-4bbf0bd48e65 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:53.933054 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-13700bf2-56fd-4ae7-89b9-e6084d5091ba tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:46:53.934762 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-13700bf2-56fd-4ae7-89b9-e6084d5091ba tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 74513e84-5d69-4d3b-aeed-5f4a45b6317e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:46:53.935234 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1615b048-bb96-47a9-a3a6-4bbf0bd48e65 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:53.938531 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1615b048-bb96-47a9-a3a6-4bbf0bd48e65 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:53.939201 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1615b048-bb96-47a9-a3a6-4bbf0bd48e65 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:53.945228 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1615b048-bb96-47a9-a3a6-4bbf0bd48e65 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:53.948106 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13700bf2-56fd-4ae7-89b9-e6084d5091ba tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:53.952244 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13700bf2-56fd-4ae7-89b9-e6084d5091ba tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:53.958225 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13700bf2-56fd-4ae7-89b9-e6084d5091ba tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:53.962297 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13700bf2-56fd-4ae7-89b9-e6084d5091ba tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:53.963035 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13700bf2-56fd-4ae7-89b9-e6084d5091ba tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:53.963695 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13700bf2-56fd-4ae7-89b9-e6084d5091ba tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:54.519906 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1615b048-bb96-47a9-a3a6-4bbf0bd48e65 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b44fee007d4e098a34f71c2530f6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13757f6a5da74eb494f5097be6a70823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:46:54.535310 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1615b048-bb96-47a9-a3a6-4bbf0bd48e65 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] 10.222.0.42 "GET /compute/v2.1/servers/1a7da380-db15-4dd3-ac05-3788924a92c5" status: 200 len: 1322 microversion: 2.1 time: 0.629588 Oct 23 01:46:54.536172 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3116/6324] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:46:53 2022] GET /compute/v2.1/servers/1a7da380-db15-4dd3-ac05-3788924a92c5 => generated 1322 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:46:54.584897 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-13700bf2-56fd-4ae7-89b9-e6084d5091ba tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:46:54.596159 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-13700bf2-56fd-4ae7-89b9-e6084d5091ba tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e" status: 200 len: 1393 microversion: 2.1 time: 0.668835 Oct 23 01:46:54.598035 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3209/6325] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:46:53 2022] GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e => generated 1393 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:46:55.562389 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-acd29997-4a64-434e-9179-c24dd304e112 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:46:55.562389 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-acd29997-4a64-434e-9179-c24dd304e112 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] [instance: 1a7da380-db15-4dd3-ac05-3788924a92c5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:46:55.569639 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-1e58ce92-588b-4b84-aeb4-c62b0bc29516 req-e3629415-7bd6-42e7-9203-639e17b02446 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a7da380-db15-4dd3-ac05-3788924a92c5", "tag": "cbb0ad81-5591-4b13-b6b1-64fa8310acf9"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:46:55.584418 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-acd29997-4a64-434e-9179-c24dd304e112 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:55.584418 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-acd29997-4a64-434e-9179-c24dd304e112 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:55.596501 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-acd29997-4a64-434e-9179-c24dd304e112 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:55.596501 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-acd29997-4a64-434e-9179-c24dd304e112 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:55.596501 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-acd29997-4a64-434e-9179-c24dd304e112 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:55.596501 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-acd29997-4a64-434e-9179-c24dd304e112 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:55.596942 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-1e58ce92-588b-4b84-aeb4-c62b0bc29516 req-e3629415-7bd6-42e7-9203-639e17b02446 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:55.596942 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-1e58ce92-588b-4b84-aeb4-c62b0bc29516 req-e3629415-7bd6-42e7-9203-639e17b02446 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:55.596942 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-1e58ce92-588b-4b84-aeb4-c62b0bc29516 req-e3629415-7bd6-42e7-9203-639e17b02446 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:55.607991 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-1e58ce92-588b-4b84-aeb4-c62b0bc29516 req-e3629415-7bd6-42e7-9203-639e17b02446 service nova] Creating event network-changed:cbb0ad81-5591-4b13-b6b1-64fa8310acf9 for instance 1a7da380-db15-4dd3-ac05-3788924a92c5 on n-h2-master-1 Oct 23 01:46:55.616955 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-1e58ce92-588b-4b84-aeb4-c62b0bc29516 req-e3629415-7bd6-42e7-9203-639e17b02446 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048504 Oct 23 01:46:55.618475 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3210/6326] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:46:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:46:55.624758 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-017d2b83-0b14-4875-83ee-a3b3210dacef tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:46:55.625460 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-017d2b83-0b14-4875-83ee-a3b3210dacef tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 74513e84-5d69-4d3b-aeed-5f4a45b6317e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:46:55.639177 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-017d2b83-0b14-4875-83ee-a3b3210dacef tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:55.639671 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-017d2b83-0b14-4875-83ee-a3b3210dacef tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:55.640303 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-017d2b83-0b14-4875-83ee-a3b3210dacef tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:55.642102 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-017d2b83-0b14-4875-83ee-a3b3210dacef tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:55.642751 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-017d2b83-0b14-4875-83ee-a3b3210dacef tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:55.643357 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-017d2b83-0b14-4875-83ee-a3b3210dacef tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:55.942199 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-acd29997-4a64-434e-9179-c24dd304e112 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b44fee007d4e098a34f71c2530f6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13757f6a5da74eb494f5097be6a70823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:46:55.952999 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-acd29997-4a64-434e-9179-c24dd304e112 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] 10.222.0.42 "GET /compute/v2.1/servers/1a7da380-db15-4dd3-ac05-3788924a92c5" status: 200 len: 1322 microversion: 2.1 time: 0.395383 Oct 23 01:46:55.953594 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3117/6327] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:46:55 2022] GET /compute/v2.1/servers/1a7da380-db15-4dd3-ac05-3788924a92c5 => generated 1322 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:46:55.958458 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-017d2b83-0b14-4875-83ee-a3b3210dacef tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:46:55.969216 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-017d2b83-0b14-4875-83ee-a3b3210dacef tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e" status: 200 len: 1393 microversion: 2.1 time: 0.348538 Oct 23 01:46:55.969813 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3211/6328] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:46:55 2022] GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e => generated 1393 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:46:56.977093 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-79521434-11df-47c9-b043-37ba36ec145e tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:46:56.977707 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-79521434-11df-47c9-b043-37ba36ec145e tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] [instance: 1a7da380-db15-4dd3-ac05-3788924a92c5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:46:57.008290 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-07dee093-17ed-4910-9b41-be426ae4cb18 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:46:57.008290 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-07dee093-17ed-4910-9b41-be426ae4cb18 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 74513e84-5d69-4d3b-aeed-5f4a45b6317e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:46:57.009137 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-79521434-11df-47c9-b043-37ba36ec145e tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:57.009137 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-79521434-11df-47c9-b043-37ba36ec145e tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:57.009137 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-79521434-11df-47c9-b043-37ba36ec145e tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:57.009137 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-79521434-11df-47c9-b043-37ba36ec145e tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:57.009137 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-79521434-11df-47c9-b043-37ba36ec145e tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:57.009137 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-79521434-11df-47c9-b043-37ba36ec145e tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:57.015041 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07dee093-17ed-4910-9b41-be426ae4cb18 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:57.015554 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07dee093-17ed-4910-9b41-be426ae4cb18 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:57.017190 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07dee093-17ed-4910-9b41-be426ae4cb18 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:57.020063 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07dee093-17ed-4910-9b41-be426ae4cb18 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:57.022880 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07dee093-17ed-4910-9b41-be426ae4cb18 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:57.025141 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-07dee093-17ed-4910-9b41-be426ae4cb18 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:57.629060 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-07dee093-17ed-4910-9b41-be426ae4cb18 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:46:57.642054 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-07dee093-17ed-4910-9b41-be426ae4cb18 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e" status: 200 len: 1566 microversion: 2.1 time: 0.650214 Oct 23 01:46:57.643007 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-79521434-11df-47c9-b043-37ba36ec145e tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b44fee007d4e098a34f71c2530f6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13757f6a5da74eb494f5097be6a70823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:46:57.644050 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3212/6329] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:46:56 2022] GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e => generated 1566 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:46:57.652742 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-79521434-11df-47c9-b043-37ba36ec145e tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] 10.222.0.42 "GET /compute/v2.1/servers/1a7da380-db15-4dd3-ac05-3788924a92c5" status: 200 len: 1322 microversion: 2.1 time: 0.679718 Oct 23 01:46:57.666595 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3118/6330] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:46:56 2022] GET /compute/v2.1/servers/1a7da380-db15-4dd3-ac05-3788924a92c5 => generated 1322 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:46:57.693774 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bcb18d75-263a-4b57-a5c7-3dab7f9ab4dd tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:46:57.705748 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bcb18d75-263a-4b57-a5c7-3dab7f9ab4dd tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 74513e84-5d69-4d3b-aeed-5f4a45b6317e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:46:57.721685 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bcb18d75-263a-4b57-a5c7-3dab7f9ab4dd tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:57.725273 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bcb18d75-263a-4b57-a5c7-3dab7f9ab4dd tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:57.731158 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bcb18d75-263a-4b57-a5c7-3dab7f9ab4dd tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:57.731158 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bcb18d75-263a-4b57-a5c7-3dab7f9ab4dd tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:57.731158 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bcb18d75-263a-4b57-a5c7-3dab7f9ab4dd tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:57.731158 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bcb18d75-263a-4b57-a5c7-3dab7f9ab4dd tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:58.037694 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bcb18d75-263a-4b57-a5c7-3dab7f9ab4dd tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:46:58.064059 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bcb18d75-263a-4b57-a5c7-3dab7f9ab4dd tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e" status: 200 len: 1566 microversion: 2.1 time: 0.381509 Oct 23 01:46:58.071756 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3213/6331] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:46:57 2022] GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e => generated 1566 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:46:58.693000 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0f9b0f2b-5ea8-4179-9cbd-e62782c97547 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:46:58.693698 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0f9b0f2b-5ea8-4179-9cbd-e62782c97547 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] [instance: 1a7da380-db15-4dd3-ac05-3788924a92c5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:46:58.715238 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0f9b0f2b-5ea8-4179-9cbd-e62782c97547 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:58.715741 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0f9b0f2b-5ea8-4179-9cbd-e62782c97547 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:58.716243 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0f9b0f2b-5ea8-4179-9cbd-e62782c97547 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:58.716950 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0f9b0f2b-5ea8-4179-9cbd-e62782c97547 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:58.717470 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0f9b0f2b-5ea8-4179-9cbd-e62782c97547 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:58.717905 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0f9b0f2b-5ea8-4179-9cbd-e62782c97547 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:58.961738 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0f9b0f2b-5ea8-4179-9cbd-e62782c97547 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b44fee007d4e098a34f71c2530f6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13757f6a5da74eb494f5097be6a70823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:46:58.996055 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0f9b0f2b-5ea8-4179-9cbd-e62782c97547 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] 10.222.0.42 "GET /compute/v2.1/servers/1a7da380-db15-4dd3-ac05-3788924a92c5" status: 200 len: 1322 microversion: 2.1 time: 0.305803 Oct 23 01:46:58.996055 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3119/6332] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:46:58 2022] GET /compute/v2.1/servers/1a7da380-db15-4dd3-ac05-3788924a92c5 => generated 1322 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:46:59.135035 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-cc57d48b-5333-451c-87d1-d4a9bfbdfcca req-560f5c86-9180-4203-b03b-2d4f73336775 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb", "name": "network-vif-plugged", "status": "completed", "tag": "49559226-e40a-4b3a-acd7-f3797eb13a1d"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:46:59.145796 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-cc57d48b-5333-451c-87d1-d4a9bfbdfcca req-560f5c86-9180-4203-b03b-2d4f73336775 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:46:59.151831 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-cc57d48b-5333-451c-87d1-d4a9bfbdfcca req-560f5c86-9180-4203-b03b-2d4f73336775 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:46:59.152348 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-cc57d48b-5333-451c-87d1-d4a9bfbdfcca req-560f5c86-9180-4203-b03b-2d4f73336775 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:46:59.165578 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-cc57d48b-5333-451c-87d1-d4a9bfbdfcca req-560f5c86-9180-4203-b03b-2d4f73336775 service nova] Creating event network-vif-plugged:49559226-e40a-4b3a-acd7-f3797eb13a1d for instance 0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb on n-h2-master-1 Oct 23 01:46:59.170585 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-cc57d48b-5333-451c-87d1-d4a9bfbdfcca req-560f5c86-9180-4203-b03b-2d4f73336775 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040343 Oct 23 01:46:59.171187 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3214/6333] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:47:00.018519 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3c33e3b8-70f8-4334-9e4d-708800e49f2c tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:00.019286 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3c33e3b8-70f8-4334-9e4d-708800e49f2c tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] [instance: 1a7da380-db15-4dd3-ac05-3788924a92c5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:47:00.028463 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c33e3b8-70f8-4334-9e4d-708800e49f2c tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:00.029274 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c33e3b8-70f8-4334-9e4d-708800e49f2c tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:00.029956 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c33e3b8-70f8-4334-9e4d-708800e49f2c tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:00.035014 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c33e3b8-70f8-4334-9e4d-708800e49f2c tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:00.035947 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c33e3b8-70f8-4334-9e4d-708800e49f2c tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:00.036651 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c33e3b8-70f8-4334-9e4d-708800e49f2c tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:00.579155 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3c33e3b8-70f8-4334-9e4d-708800e49f2c tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b44fee007d4e098a34f71c2530f6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13757f6a5da74eb494f5097be6a70823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:47:00.584747 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=100 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:47:00.591405 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3c33e3b8-70f8-4334-9e4d-708800e49f2c tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] 10.222.0.42 "GET /compute/v2.1/servers/1a7da380-db15-4dd3-ac05-3788924a92c5" status: 200 len: 1322 microversion: 2.1 time: 0.577019 Oct 23 01:47:00.592422 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3120/6334] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:47:00 2022] GET /compute/v2.1/servers/1a7da380-db15-4dd3-ac05-3788924a92c5 => generated 1322 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:47:01.191245 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-743e9697-7680-40af-a2dc-54316e7c0cb9 req-25a4d356-9eeb-4289-b039-25f85cd2a478 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91d10bf0-72e1-48bf-9c76-f13e3e4cd27b", "name": "network-vif-plugged", "status": "completed", "tag": "1c77708b-7d5e-4e9d-9b03-0b5e99a2f97f"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:47:01.206148 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-743e9697-7680-40af-a2dc-54316e7c0cb9 req-25a4d356-9eeb-4289-b039-25f85cd2a478 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:01.206499 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-743e9697-7680-40af-a2dc-54316e7c0cb9 req-25a4d356-9eeb-4289-b039-25f85cd2a478 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:01.207017 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-743e9697-7680-40af-a2dc-54316e7c0cb9 req-25a4d356-9eeb-4289-b039-25f85cd2a478 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:01.223439 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-743e9697-7680-40af-a2dc-54316e7c0cb9 req-25a4d356-9eeb-4289-b039-25f85cd2a478 service nova] Creating event network-vif-plugged:1c77708b-7d5e-4e9d-9b03-0b5e99a2f97f for instance 91d10bf0-72e1-48bf-9c76-f13e3e4cd27b on n-h1-master-1 Oct 23 01:47:01.229003 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-743e9697-7680-40af-a2dc-54316e7c0cb9 req-25a4d356-9eeb-4289-b039-25f85cd2a478 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043480 Oct 23 01:47:01.229939 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3215/6335] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:47:01.623928 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2555acd8-7f1b-4bb0-91ae-343fdec7688b tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:01.635580 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2555acd8-7f1b-4bb0-91ae-343fdec7688b tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] [instance: 1a7da380-db15-4dd3-ac05-3788924a92c5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:47:01.642623 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=12 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:47:01.667237 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2555acd8-7f1b-4bb0-91ae-343fdec7688b tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:01.674240 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2555acd8-7f1b-4bb0-91ae-343fdec7688b tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:01.674706 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2555acd8-7f1b-4bb0-91ae-343fdec7688b tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:01.675456 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2555acd8-7f1b-4bb0-91ae-343fdec7688b tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:01.676096 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2555acd8-7f1b-4bb0-91ae-343fdec7688b tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:01.676535 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2555acd8-7f1b-4bb0-91ae-343fdec7688b tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:02.161187 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2555acd8-7f1b-4bb0-91ae-343fdec7688b tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b44fee007d4e098a34f71c2530f6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13757f6a5da74eb494f5097be6a70823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:47:02.172120 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2555acd8-7f1b-4bb0-91ae-343fdec7688b tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] 10.222.0.42 "GET /compute/v2.1/servers/1a7da380-db15-4dd3-ac05-3788924a92c5" status: 200 len: 1322 microversion: 2.1 time: 0.558727 Oct 23 01:47:02.194954 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3121/6336] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:47:01 2022] GET /compute/v2.1/servers/1a7da380-db15-4dd3-ac05-3788924a92c5 => generated 1322 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:47:03.207932 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1a9b9e00-312f-4da0-900a-2eb1b207c166 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:03.208681 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1a9b9e00-312f-4da0-900a-2eb1b207c166 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] [instance: 1a7da380-db15-4dd3-ac05-3788924a92c5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:47:03.220903 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1a9b9e00-312f-4da0-900a-2eb1b207c166 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:03.227381 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1a9b9e00-312f-4da0-900a-2eb1b207c166 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:03.228289 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1a9b9e00-312f-4da0-900a-2eb1b207c166 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:03.233137 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1a9b9e00-312f-4da0-900a-2eb1b207c166 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:03.235146 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1a9b9e00-312f-4da0-900a-2eb1b207c166 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:03.236225 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1a9b9e00-312f-4da0-900a-2eb1b207c166 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:03.440965 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1a9b9e00-312f-4da0-900a-2eb1b207c166 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b44fee007d4e098a34f71c2530f6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13757f6a5da74eb494f5097be6a70823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:47:03.452712 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-ac04f619-09ef-49f7-a9d7-4e58d563a32a req-992942ed-f01d-48b3-9668-4ff11a7dc145 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a7da380-db15-4dd3-ac05-3788924a92c5", "name": "network-vif-plugged", "status": "completed", "tag": "cbb0ad81-5591-4b13-b6b1-64fa8310acf9"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:47:03.462109 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=100 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:47:03.503631 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1a9b9e00-312f-4da0-900a-2eb1b207c166 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] 10.222.0.42 "GET /compute/v2.1/servers/1a7da380-db15-4dd3-ac05-3788924a92c5" status: 200 len: 1322 microversion: 2.1 time: 0.297251 Oct 23 01:47:03.506076 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3216/6337] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:47:03 2022] GET /compute/v2.1/servers/1a7da380-db15-4dd3-ac05-3788924a92c5 => generated 1322 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:47:03.512569 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ac04f619-09ef-49f7-a9d7-4e58d563a32a req-992942ed-f01d-48b3-9668-4ff11a7dc145 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:03.517656 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ac04f619-09ef-49f7-a9d7-4e58d563a32a req-992942ed-f01d-48b3-9668-4ff11a7dc145 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:03.518449 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ac04f619-09ef-49f7-a9d7-4e58d563a32a req-992942ed-f01d-48b3-9668-4ff11a7dc145 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:03.559200 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-ac04f619-09ef-49f7-a9d7-4e58d563a32a req-992942ed-f01d-48b3-9668-4ff11a7dc145 service nova] Creating event network-vif-plugged:cbb0ad81-5591-4b13-b6b1-64fa8310acf9 for instance 1a7da380-db15-4dd3-ac05-3788924a92c5 on n-h2-master-1 Oct 23 01:47:03.570431 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-ac04f619-09ef-49f7-a9d7-4e58d563a32a req-992942ed-f01d-48b3-9668-4ff11a7dc145 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126667 Oct 23 01:47:03.575728 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3122/6338] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:47:03.616093 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-e0693d8a-f0ce-4c79-8bf7-d29a5e88cdd2 req-32d8a7fe-ec8f-4e15-915d-4e60075a004d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74513e84-5d69-4d3b-aeed-5f4a45b6317e", "tag": "e6543d72-1e98-4648-a366-e7651509bade"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:47:03.620877 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0a490d91-2d71-458d-932e-51ab5287a75d tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:03.625413 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0a490d91-2d71-458d-932e-51ab5287a75d tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 74513e84-5d69-4d3b-aeed-5f4a45b6317e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:47:03.647565 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0a490d91-2d71-458d-932e-51ab5287a75d tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:03.648390 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0a490d91-2d71-458d-932e-51ab5287a75d tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:03.648585 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-e0693d8a-f0ce-4c79-8bf7-d29a5e88cdd2 req-32d8a7fe-ec8f-4e15-915d-4e60075a004d service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:03.648981 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-e0693d8a-f0ce-4c79-8bf7-d29a5e88cdd2 req-32d8a7fe-ec8f-4e15-915d-4e60075a004d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:03.649699 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0a490d91-2d71-458d-932e-51ab5287a75d tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:03.649840 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-e0693d8a-f0ce-4c79-8bf7-d29a5e88cdd2 req-32d8a7fe-ec8f-4e15-915d-4e60075a004d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:03.650994 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0a490d91-2d71-458d-932e-51ab5287a75d tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:03.652463 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0a490d91-2d71-458d-932e-51ab5287a75d tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:03.653735 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0a490d91-2d71-458d-932e-51ab5287a75d tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:03.687377 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-e0693d8a-f0ce-4c79-8bf7-d29a5e88cdd2 req-32d8a7fe-ec8f-4e15-915d-4e60075a004d service nova] Creating event network-changed:e6543d72-1e98-4648-a366-e7651509bade for instance 74513e84-5d69-4d3b-aeed-5f4a45b6317e on n-h1-master-1 Oct 23 01:47:03.715291 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-e0693d8a-f0ce-4c79-8bf7-d29a5e88cdd2 req-32d8a7fe-ec8f-4e15-915d-4e60075a004d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097132 Oct 23 01:47:03.715291 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3123/6339] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:47:04.168245 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0a490d91-2d71-458d-932e-51ab5287a75d tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:47:04.182863 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0a490d91-2d71-458d-932e-51ab5287a75d tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e" status: 200 len: 1566 microversion: 2.1 time: 0.570243 Oct 23 01:47:04.204926 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3217/6340] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:47:03 2022] GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e => generated 1566 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:47:04.532000 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f6319353-e9dc-404d-9804-08424b961c70 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:04.533308 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f6319353-e9dc-404d-9804-08424b961c70 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] [instance: 1a7da380-db15-4dd3-ac05-3788924a92c5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:47:04.557350 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f6319353-e9dc-404d-9804-08424b961c70 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:04.558263 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f6319353-e9dc-404d-9804-08424b961c70 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:04.558888 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f6319353-e9dc-404d-9804-08424b961c70 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:04.559949 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f6319353-e9dc-404d-9804-08424b961c70 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:04.560554 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f6319353-e9dc-404d-9804-08424b961c70 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:04.561151 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f6319353-e9dc-404d-9804-08424b961c70 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:04.946840 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f6319353-e9dc-404d-9804-08424b961c70 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b44fee007d4e098a34f71c2530f6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13757f6a5da74eb494f5097be6a70823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:47:04.962800 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f6319353-e9dc-404d-9804-08424b961c70 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] 10.222.0.42 "GET /compute/v2.1/servers/1a7da380-db15-4dd3-ac05-3788924a92c5" status: 200 len: 1322 microversion: 2.1 time: 0.435696 Oct 23 01:47:04.964460 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3124/6341] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:47:04 2022] GET /compute/v2.1/servers/1a7da380-db15-4dd3-ac05-3788924a92c5 => generated 1322 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:47:05.995420 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f6eff86c-5224-41c4-b87b-71781b6b9825 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:05.996831 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f6eff86c-5224-41c4-b87b-71781b6b9825 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] [instance: 1a7da380-db15-4dd3-ac05-3788924a92c5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:47:06.024646 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=67 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:47:06.027574 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f6eff86c-5224-41c4-b87b-71781b6b9825 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:06.028110 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f6eff86c-5224-41c4-b87b-71781b6b9825 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:06.032705 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f6eff86c-5224-41c4-b87b-71781b6b9825 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:06.035065 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f6eff86c-5224-41c4-b87b-71781b6b9825 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:06.035748 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f6eff86c-5224-41c4-b87b-71781b6b9825 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:06.041175 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f6eff86c-5224-41c4-b87b-71781b6b9825 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:06.290272 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f6eff86c-5224-41c4-b87b-71781b6b9825 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b44fee007d4e098a34f71c2530f6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13757f6a5da74eb494f5097be6a70823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:47:06.300279 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f6eff86c-5224-41c4-b87b-71781b6b9825 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] 10.222.0.42 "GET /compute/v2.1/servers/1a7da380-db15-4dd3-ac05-3788924a92c5" status: 200 len: 1516 microversion: 2.1 time: 0.313133 Oct 23 01:47:06.301354 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3218/6342] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:47:05 2022] GET /compute/v2.1/servers/1a7da380-db15-4dd3-ac05-3788924a92c5 => generated 1516 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:47:06.359934 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-932de5c7-ece4-457a-b274-1ddaeea3bba0 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:06.360562 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-932de5c7-ece4-457a-b274-1ddaeea3bba0 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] [instance: 91d10bf0-72e1-48bf-9c76-f13e3e4cd27b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:47:06.369389 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-932de5c7-ece4-457a-b274-1ddaeea3bba0 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:06.369892 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-932de5c7-ece4-457a-b274-1ddaeea3bba0 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:06.373649 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-932de5c7-ece4-457a-b274-1ddaeea3bba0 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:06.373649 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-932de5c7-ece4-457a-b274-1ddaeea3bba0 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:06.373649 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-932de5c7-ece4-457a-b274-1ddaeea3bba0 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:06.373649 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-932de5c7-ece4-457a-b274-1ddaeea3bba0 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:06.531428 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-932de5c7-ece4-457a-b274-1ddaeea3bba0 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b44fee007d4e098a34f71c2530f6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13757f6a5da74eb494f5097be6a70823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:47:06.543856 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-932de5c7-ece4-457a-b274-1ddaeea3bba0 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] 10.222.0.42 "GET /compute/v2.1/servers/91d10bf0-72e1-48bf-9c76-f13e3e4cd27b" status: 200 len: 1515 microversion: 2.1 time: 0.194196 Oct 23 01:47:06.545739 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3125/6343] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:47:06 2022] GET /compute/v2.1/servers/91d10bf0-72e1-48bf-9c76-f13e3e4cd27b => generated 1515 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:47:06.570958 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-aebd76fa-e6bd-4077-b13e-cd8a8f157eab tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:06.572077 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-aebd76fa-e6bd-4077-b13e-cd8a8f157eab tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] [instance: 0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:47:06.584136 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aebd76fa-e6bd-4077-b13e-cd8a8f157eab tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:06.587471 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aebd76fa-e6bd-4077-b13e-cd8a8f157eab tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:06.588213 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aebd76fa-e6bd-4077-b13e-cd8a8f157eab tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:06.596480 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aebd76fa-e6bd-4077-b13e-cd8a8f157eab tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:06.596480 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aebd76fa-e6bd-4077-b13e-cd8a8f157eab tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:06.596480 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aebd76fa-e6bd-4077-b13e-cd8a8f157eab tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:06.873670 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-aebd76fa-e6bd-4077-b13e-cd8a8f157eab tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b44fee007d4e098a34f71c2530f6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13757f6a5da74eb494f5097be6a70823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:47:06.884242 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-aebd76fa-e6bd-4077-b13e-cd8a8f157eab tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] 10.222.0.42 "GET /compute/v2.1/servers/0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb" status: 200 len: 1516 microversion: 2.1 time: 0.317430 Oct 23 01:47:06.885540 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3219/6344] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:47:06 2022] GET /compute/v2.1/servers/0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb => generated 1516 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:47:06.908695 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7a00a3e4-eba5-4ce4-aca0-7bbe4dba4bc1 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:06.909671 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7a00a3e4-eba5-4ce4-aca0-7bbe4dba4bc1 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] [instance: 0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:47:06.917431 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a00a3e4-eba5-4ce4-aca0-7bbe4dba4bc1 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:06.918037 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a00a3e4-eba5-4ce4-aca0-7bbe4dba4bc1 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:06.918554 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a00a3e4-eba5-4ce4-aca0-7bbe4dba4bc1 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:06.919627 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a00a3e4-eba5-4ce4-aca0-7bbe4dba4bc1 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:06.920261 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a00a3e4-eba5-4ce4-aca0-7bbe4dba4bc1 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:06.920759 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a00a3e4-eba5-4ce4-aca0-7bbe4dba4bc1 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:06.962659 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7a00a3e4-eba5-4ce4-aca0-7bbe4dba4bc1 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] [instance: 0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:47:07.368266 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7a00a3e4-eba5-4ce4-aca0-7bbe4dba4bc1 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb" status: 204 len: 0 microversion: 2.1 time: 0.444286 Oct 23 01:47:07.368266 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3126/6345] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:47:06 2022] DELETE /compute/v2.1/servers/0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:47:07.369480 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-43a8c749-534e-4fbe-a413-79489acd64ab tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:07.369480 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-43a8c749-534e-4fbe-a413-79489acd64ab tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] [instance: 0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:47:07.390976 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-43a8c749-534e-4fbe-a413-79489acd64ab tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:07.391531 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-43a8c749-534e-4fbe-a413-79489acd64ab tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:07.394667 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-43a8c749-534e-4fbe-a413-79489acd64ab tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:07.395809 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-43a8c749-534e-4fbe-a413-79489acd64ab tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:07.398336 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-43a8c749-534e-4fbe-a413-79489acd64ab tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:07.399646 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-43a8c749-534e-4fbe-a413-79489acd64ab tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:07.917568 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-43a8c749-534e-4fbe-a413-79489acd64ab tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b44fee007d4e098a34f71c2530f6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13757f6a5da74eb494f5097be6a70823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:47:07.925727 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-43a8c749-534e-4fbe-a413-79489acd64ab tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] 10.222.0.42 "GET /compute/v2.1/servers/0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb" status: 200 len: 1522 microversion: 2.1 time: 0.571038 Oct 23 01:47:07.926443 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3220/6346] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:47:07 2022] GET /compute/v2.1/servers/0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb => generated 1522 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:47:08.543805 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-aa41a809-7b65-49c5-a027-2529dae9b9d0 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eff2e89a-c498-423e-aab9-8cbcfffba742", "device": "/dev/sdb"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:47:08.546829 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-aa41a809-7b65-49c5-a027-2529dae9b9d0 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] [instance: 56d08053-cd34-464a-ba73-ef113a24140d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:47:08.554673 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa41a809-7b65-49c5-a027-2529dae9b9d0 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:08.555196 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa41a809-7b65-49c5-a027-2529dae9b9d0 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:08.555634 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa41a809-7b65-49c5-a027-2529dae9b9d0 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:08.556332 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa41a809-7b65-49c5-a027-2529dae9b9d0 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:08.556785 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa41a809-7b65-49c5-a027-2529dae9b9d0 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:08.557208 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa41a809-7b65-49c5-a027-2529dae9b9d0 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:08.950855 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-82e3622c-c107-44ca-b0cd-591ed6b534d3 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:08.952142 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-82e3622c-c107-44ca-b0cd-591ed6b534d3 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] [instance: 0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:47:08.961231 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-82e3622c-c107-44ca-b0cd-591ed6b534d3 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:08.961995 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-82e3622c-c107-44ca-b0cd-591ed6b534d3 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:08.962760 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-82e3622c-c107-44ca-b0cd-591ed6b534d3 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:08.963689 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-82e3622c-c107-44ca-b0cd-591ed6b534d3 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:08.965125 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-82e3622c-c107-44ca-b0cd-591ed6b534d3 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:08.965718 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-82e3622c-c107-44ca-b0cd-591ed6b534d3 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:09.157492 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-82e3622c-c107-44ca-b0cd-591ed6b534d3 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b44fee007d4e098a34f71c2530f6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13757f6a5da74eb494f5097be6a70823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:47:09.168356 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-82e3622c-c107-44ca-b0cd-591ed6b534d3 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] 10.222.0.42 "GET /compute/v2.1/servers/0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb" status: 200 len: 1522 microversion: 2.1 time: 0.223006 Oct 23 01:47:09.169545 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3221/6347] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:47:08 2022] GET /compute/v2.1/servers/0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:47:09.730665 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-3396a04d-3c42-4ecf-b926-bfb4bc5285d3 req-86e16b7d-66e6-4fec-aeb3-cd55c45d049f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb", "name": "network-vif-deleted", "tag": "49559226-e40a-4b3a-acd7-f3797eb13a1d"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:47:09.752168 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-3396a04d-3c42-4ecf-b926-bfb4bc5285d3 req-86e16b7d-66e6-4fec-aeb3-cd55c45d049f service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:09.752848 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-3396a04d-3c42-4ecf-b926-bfb4bc5285d3 req-86e16b7d-66e6-4fec-aeb3-cd55c45d049f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:09.754438 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-3396a04d-3c42-4ecf-b926-bfb4bc5285d3 req-86e16b7d-66e6-4fec-aeb3-cd55c45d049f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:09.771932 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-3396a04d-3c42-4ecf-b926-bfb4bc5285d3 req-86e16b7d-66e6-4fec-aeb3-cd55c45d049f service nova] Creating event network-vif-deleted:49559226-e40a-4b3a-acd7-f3797eb13a1d for instance 0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb on n-h2-master-1 Oct 23 01:47:09.785897 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-3396a04d-3c42-4ecf-b926-bfb4bc5285d3 req-86e16b7d-66e6-4fec-aeb3-cd55c45d049f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059722 Oct 23 01:47:09.788037 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3222/6348] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:47:09.881106 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-aa41a809-7b65-49c5-a027-2529dae9b9d0 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] 10.222.0.42 "POST /compute/v2.1/servers/56d08053-cd34-464a-ba73-ef113a24140d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.341793 Oct 23 01:47:09.882110 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3127/6349] 10.222.0.42 () {60 vars in 1323 bytes} [Sun Oct 23 01:47:08 2022] POST /compute/v2.1/servers/56d08053-cd34-464a-ba73-ef113a24140d/os-volume_attachments => generated 194 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:47:10.197577 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-268db56d-726c-42b3-94cb-e4d97f150987 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:10.198365 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-268db56d-726c-42b3-94cb-e4d97f150987 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] [instance: 0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:47:10.211300 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-268db56d-726c-42b3-94cb-e4d97f150987 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:10.212342 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-268db56d-726c-42b3-94cb-e4d97f150987 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:10.212791 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-268db56d-726c-42b3-94cb-e4d97f150987 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:10.219085 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-268db56d-726c-42b3-94cb-e4d97f150987 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:10.219599 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-268db56d-726c-42b3-94cb-e4d97f150987 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:10.220033 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-268db56d-726c-42b3-94cb-e4d97f150987 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:10.266553 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-268db56d-726c-42b3-94cb-e4d97f150987 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:10.267049 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-268db56d-726c-42b3-94cb-e4d97f150987 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:10.267777 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-268db56d-726c-42b3-94cb-e4d97f150987 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:10.267936 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-268db56d-726c-42b3-94cb-e4d97f150987 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lazy-loading 'fault' on Instance uuid 0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:47:10.341016 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-268db56d-726c-42b3-94cb-e4d97f150987 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b44fee007d4e098a34f71c2530f6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13757f6a5da74eb494f5097be6a70823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:47:10.351094 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-268db56d-726c-42b3-94cb-e4d97f150987 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] 10.222.0.42 "GET /compute/v2.1/servers/0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb" status: 200 len: 1312 microversion: 2.1 time: 0.159062 Oct 23 01:47:10.352315 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3223/6350] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:47:10 2022] GET /compute/v2.1/servers/0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb => generated 1312 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:47:11.377326 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a785ecd5-d0e9-4e4f-a9fa-972f700c3154 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:11.377326 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a785ecd5-d0e9-4e4f-a9fa-972f700c3154 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] [instance: 0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:47:11.383970 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a785ecd5-d0e9-4e4f-a9fa-972f700c3154 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:11.384469 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a785ecd5-d0e9-4e4f-a9fa-972f700c3154 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:11.384910 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a785ecd5-d0e9-4e4f-a9fa-972f700c3154 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:11.385619 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a785ecd5-d0e9-4e4f-a9fa-972f700c3154 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:11.386108 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a785ecd5-d0e9-4e4f-a9fa-972f700c3154 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:11.386540 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a785ecd5-d0e9-4e4f-a9fa-972f700c3154 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:11.422138 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a785ecd5-d0e9-4e4f-a9fa-972f700c3154 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:11.422625 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a785ecd5-d0e9-4e4f-a9fa-972f700c3154 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:11.423066 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a785ecd5-d0e9-4e4f-a9fa-972f700c3154 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:11.423524 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-a785ecd5-d0e9-4e4f-a9fa-972f700c3154 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lazy-loading 'fault' on Instance uuid 0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:47:11.473546 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a785ecd5-d0e9-4e4f-a9fa-972f700c3154 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b44fee007d4e098a34f71c2530f6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13757f6a5da74eb494f5097be6a70823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:47:11.485538 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a785ecd5-d0e9-4e4f-a9fa-972f700c3154 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] 10.222.0.42 "GET /compute/v2.1/servers/0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb" status: 200 len: 1312 microversion: 2.1 time: 0.114104 Oct 23 01:47:11.486679 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3128/6351] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:47:11 2022] GET /compute/v2.1/servers/0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb => generated 1312 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:47:12.509941 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f750865e-1bbe-4e6a-a27f-7ebd548e394e tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:12.510786 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f750865e-1bbe-4e6a-a27f-7ebd548e394e tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] [instance: 0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:47:12.523454 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f750865e-1bbe-4e6a-a27f-7ebd548e394e tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:12.536003 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f750865e-1bbe-4e6a-a27f-7ebd548e394e tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:12.536003 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f750865e-1bbe-4e6a-a27f-7ebd548e394e tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:12.536003 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f750865e-1bbe-4e6a-a27f-7ebd548e394e tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:12.536003 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f750865e-1bbe-4e6a-a27f-7ebd548e394e tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:12.536003 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f750865e-1bbe-4e6a-a27f-7ebd548e394e tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:12.544614 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-f750865e-1bbe-4e6a-a27f-7ebd548e394e tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] HTTP exception thrown: Instance 0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb could not be found. Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f750865e-1bbe-4e6a-a27f-7ebd548e394e tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Request method failure captured: Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb HTTP/1.1 Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJz52nYbC8ykmQ37oOrrB9_uYYDyGlv3jER4E4t2rnI6FXpYWGVtn8Y9lvMIB48TrthpENO5wgtbA8DhCqEAg30KMAmv_BfeHeKk41YlCRbUW2oqK9ZbjA0BFKfxVOkEYJHPmApjhcMx9oQ9mWGeYtzNR8zsh9LwUuHFNHh5hLRRycY Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 13757f6a5da74eb494f5097be6a70823 Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ListServersNegativeTestJSON-1396773786 Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/13757f6a5da74eb494f5097be6a70823"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_13757f6a5da74eb494f5097be6a70823"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/13757f6a5da74eb494f5097be6a70823"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/13757f6a5da74eb494f5097be6a70823"}]}] Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ListServersNegativeTestJSON-1396773786 Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 13757f6a5da74eb494f5097be6a70823 Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1396773786 Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ListServersNegativeTestJSON-1396773786-project Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 69b44fee007d4e098a34f71c2530f6f2 Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ListServersNegativeTestJSON-1396773786-project Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb could not be found. Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb'} Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb could not be found. Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb could not be found. Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:47:12.546601 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:47:12.550957 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:47:12.550957 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:47:12.550957 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:47:12.550957 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:47:12.550957 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:47:12.550957 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:47:12.550957 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb could not be found. Oct 23 01:47:12.550957 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:47:12.550957 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f750865e-1bbe-4e6a-a27f-7ebd548e394e tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Returning 404 to user: Instance 0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:47:12.552655 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f750865e-1bbe-4e6a-a27f-7ebd548e394e tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] 10.222.0.42 "GET /compute/v2.1/servers/0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb" status: 404 len: 111 microversion: 2.1 time: 0.047806 Oct 23 01:47:12.554141 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3224/6352] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:47:12 2022] GET /compute/v2.1/servers/0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:47:12.565433 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-09b459bb-42a5-4b52-b153-cfa047e6f0e7 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:12.571511 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-09b459bb-42a5-4b52-b153-cfa047e6f0e7 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '69b44fee007d4e098a34f71c2530f6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13757f6a5da74eb494f5097be6a70823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:47:12.573804 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-09b459bb-42a5-4b52-b153-cfa047e6f0e7 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '13757f6a5da74eb494f5097be6a70823'} {{(pid=120945) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 23 01:47:12.587623 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09b459bb-42a5-4b52-b153-cfa047e6f0e7 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:12.587623 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09b459bb-42a5-4b52-b153-cfa047e6f0e7 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:12.587623 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09b459bb-42a5-4b52-b153-cfa047e6f0e7 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:12.588488 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09b459bb-42a5-4b52-b153-cfa047e6f0e7 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:12.588785 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09b459bb-42a5-4b52-b153-cfa047e6f0e7 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:12.590775 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09b459bb-42a5-4b52-b153-cfa047e6f0e7 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:12.732380 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-09b459bb-42a5-4b52-b153-cfa047e6f0e7 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] 10.222.0.42 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.172827 Oct 23 01:47:12.733254 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3129/6353] 10.222.0.42 () {58 vars in 1230 bytes} [Sun Oct 23 01:47:12 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:47:12.748281 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2fbba549-f3f8-4490-83bf-e8d43957493d tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2fbba549-f3f8-4490-83bf-e8d43957493d tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Request method failure captured: Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJz52nYbC8ykmQ37oOrrB9_uYYDyGlv3jER4E4t2rnI6FXpYWGVtn8Y9lvMIB48TrthpENO5wgtbA8DhCqEAg30KMAmv_BfeHeKk41YlCRbUW2oqK9ZbjA0BFKfxVOkEYJHPmApjhcMx9oQ9mWGeYtzNR8zsh9LwUuHFNHh5hLRRycY Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 13757f6a5da74eb494f5097be6a70823 Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ListServersNegativeTestJSON-1396773786 Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/13757f6a5da74eb494f5097be6a70823"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_13757f6a5da74eb494f5097be6a70823"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/13757f6a5da74eb494f5097be6a70823"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/13757f6a5da74eb494f5097be6a70823"}]}] Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ListServersNegativeTestJSON-1396773786 Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 13757f6a5da74eb494f5097be6a70823 Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1396773786 Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ListServersNegativeTestJSON-1396773786-project Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 69b44fee007d4e098a34f71c2530f6f2 Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ListServersNegativeTestJSON-1396773786-project Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: action_args: {} Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise error Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 23 01:47:12.769159 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 23 01:47:12.784658 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 23 01:47:12.784658 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 23 01:47:12.784658 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 23 01:47:12.784658 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 23 01:47:12.784658 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:47:12.784658 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:47:12.784658 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:47:12.784658 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:47:12.784658 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:47:12.784658 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:47:12.784658 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 23 01:47:12.784658 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 23 01:47:12.784658 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 23 01:47:12.784658 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:47:12.784658 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2fbba549-f3f8-4490-83bf-e8d43957493d tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:47:12.784658 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2fbba549-f3f8-4490-83bf-e8d43957493d tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] 10.222.0.42 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.027196 Oct 23 01:47:12.784658 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3225/6354] 10.222.0.42 () {58 vars in 1182 bytes} [Sun Oct 23 01:47:12 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:47:12.791664 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-72a6d644-7651-4216-bb99-8873675aa780 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:12.799024 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-72a6d644-7651-4216-bb99-8873675aa780 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '69b44fee007d4e098a34f71c2530f6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13757f6a5da74eb494f5097be6a70823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:47:12.799930 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-72a6d644-7651-4216-bb99-8873675aa780 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Searching by: {'deleted': False, 'project_id': '13757f6a5da74eb494f5097be6a70823'} {{(pid=120945) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 23 01:47:12.806692 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-72a6d644-7651-4216-bb99-8873675aa780 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:12.807519 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-72a6d644-7651-4216-bb99-8873675aa780 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:12.808133 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-72a6d644-7651-4216-bb99-8873675aa780 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:12.815730 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-72a6d644-7651-4216-bb99-8873675aa780 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:12.815730 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-72a6d644-7651-4216-bb99-8873675aa780 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:12.815730 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-72a6d644-7651-4216-bb99-8873675aa780 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:12.843911 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.multi_cell_list [None req-72a6d644-7651-4216-bb99-8873675aa780 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120945) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 23 01:47:12.896228 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-72a6d644-7651-4216-bb99-8873675aa780 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.099231 Oct 23 01:47:12.896228 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3130/6355] 10.222.0.42 () {58 vars in 1125 bytes} [Sun Oct 23 01:47:12 2022] GET /compute/v2.1/servers => generated 681 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:47:12.904492 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f76bce90-0588-4489-8c98-221bb4215ff7 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:12.910511 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f76bce90-0588-4489-8c98-221bb4215ff7 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '69b44fee007d4e098a34f71c2530f6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13757f6a5da74eb494f5097be6a70823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:47:12.911327 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.compute.servers [None req-f76bce90-0588-4489-8c98-221bb4215ff7 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Removing options 'limit' from query {{(pid=120944) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 23 01:47:12.913381 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f76bce90-0588-4489-8c98-221bb4215ff7 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Searching by: {'deleted': False, 'project_id': '13757f6a5da74eb494f5097be6a70823'} {{(pid=120944) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 23 01:47:12.920687 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f76bce90-0588-4489-8c98-221bb4215ff7 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:12.921789 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f76bce90-0588-4489-8c98-221bb4215ff7 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:12.922474 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f76bce90-0588-4489-8c98-221bb4215ff7 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:12.924501 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f76bce90-0588-4489-8c98-221bb4215ff7 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:12.925167 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f76bce90-0588-4489-8c98-221bb4215ff7 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:12.925839 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f76bce90-0588-4489-8c98-221bb4215ff7 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:12.959592 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.multi_cell_list [None req-f76bce90-0588-4489-8c98-221bb4215ff7 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=120944) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 23 01:47:12.993849 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f76bce90-0588-4489-8c98-221bb4215ff7 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] 10.222.0.42 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.092982 Oct 23 01:47:13.008071 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3226/6356] 10.222.0.42 () {58 vars in 1144 bytes} [Sun Oct 23 01:47:12 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-65246295-0275-4c57-8993-8e3e73d05c70 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-65246295-0275-4c57-8993-8e3e73d05c70 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Request method failure captured: Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJz52nYbC8ykmQ37oOrrB9_uYYDyGlv3jER4E4t2rnI6FXpYWGVtn8Y9lvMIB48TrthpENO5wgtbA8DhCqEAg30KMAmv_BfeHeKk41YlCRbUW2oqK9ZbjA0BFKfxVOkEYJHPmApjhcMx9oQ9mWGeYtzNR8zsh9LwUuHFNHh5hLRRycY Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 13757f6a5da74eb494f5097be6a70823 Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ListServersNegativeTestJSON-1396773786 Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/13757f6a5da74eb494f5097be6a70823"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_13757f6a5da74eb494f5097be6a70823"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/13757f6a5da74eb494f5097be6a70823"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/13757f6a5da74eb494f5097be6a70823"}]}] Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ListServersNegativeTestJSON-1396773786 Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 13757f6a5da74eb494f5097be6a70823 Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1396773786 Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ListServersNegativeTestJSON-1396773786-project Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 69b44fee007d4e098a34f71c2530f6f2 Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ListServersNegativeTestJSON-1396773786-project Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: action_args: {} Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise error Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi '-1' Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 23 01:47:13.016350 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:47:13.020365 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 23 01:47:13.020365 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:47:13.020365 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 23 01:47:13.020365 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 23 01:47:13.020365 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 23 01:47:13.020365 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 23 01:47:13.020365 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 23 01:47:13.020365 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 23 01:47:13.020365 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 23 01:47:13.020365 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 23 01:47:13.020365 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:47:13.020365 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:47:13.020365 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:47:13.020365 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:47:13.020365 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:47:13.020365 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:47:13.020365 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 23 01:47:13.020365 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 23 01:47:13.020365 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 23 01:47:13.020365 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:47:13.020365 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-65246295-0275-4c57-8993-8e3e73d05c70 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:47:13.020365 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-65246295-0275-4c57-8993-8e3e73d05c70 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] 10.222.0.42 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.012233 Oct 23 01:47:13.020365 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3131/6357] 10.222.0.42 () {58 vars in 1142 bytes} [Sun Oct 23 01:47:13 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:47:13.027193 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-67fac1e5-196e-45f9-937b-326fa23dd5f1 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-67fac1e5-196e-45f9-937b-326fa23dd5f1 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Request method failure captured: Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJz52nYbC8ykmQ37oOrrB9_uYYDyGlv3jER4E4t2rnI6FXpYWGVtn8Y9lvMIB48TrthpENO5wgtbA8DhCqEAg30KMAmv_BfeHeKk41YlCRbUW2oqK9ZbjA0BFKfxVOkEYJHPmApjhcMx9oQ9mWGeYtzNR8zsh9LwUuHFNHh5hLRRycY Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 13757f6a5da74eb494f5097be6a70823 Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ListServersNegativeTestJSON-1396773786 Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/13757f6a5da74eb494f5097be6a70823"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_13757f6a5da74eb494f5097be6a70823"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/13757f6a5da74eb494f5097be6a70823"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/13757f6a5da74eb494f5097be6a70823"}]}] Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ListServersNegativeTestJSON-1396773786 Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 13757f6a5da74eb494f5097be6a70823 Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1396773786 Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ListServersNegativeTestJSON-1396773786-project Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 69b44fee007d4e098a34f71c2530f6f2 Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ListServersNegativeTestJSON-1396773786-project Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: action_args: {} Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise error Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi 'testing' Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 23 01:47:13.031289 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 23 01:47:13.035366 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 23 01:47:13.035366 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 23 01:47:13.035366 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 23 01:47:13.035366 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 23 01:47:13.035366 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 23 01:47:13.035366 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:47:13.035366 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:47:13.035366 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:47:13.035366 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:47:13.035366 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:47:13.035366 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:47:13.035366 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 23 01:47:13.035366 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 23 01:47:13.035366 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 23 01:47:13.035366 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:47:13.037526 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-67fac1e5-196e-45f9-937b-326fa23dd5f1 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:47:13.040841 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-67fac1e5-196e-45f9-937b-326fa23dd5f1 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] 10.222.0.42 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.017210 Oct 23 01:47:13.051074 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3d0acba3-c1f8-437c-a8cb-980737a0ef52 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:13.057932 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3227/6358] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Oct 23 01:47:13 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:47:13.058606 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3d0acba3-c1f8-437c-a8cb-980737a0ef52 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '69b44fee007d4e098a34f71c2530f6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13757f6a5da74eb494f5097be6a70823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:47:13.060116 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3d0acba3-c1f8-437c-a8cb-980737a0ef52 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '13757f6a5da74eb494f5097be6a70823'} {{(pid=120945) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 23 01:47:13.069021 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.compute.servers [None req-3d0acba3-c1f8-437c-a8cb-980737a0ef52 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Flavor 'non_existing_flavor' could not be found {{(pid=120945) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 23 01:47:13.071066 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3d0acba3-c1f8-437c-a8cb-980737a0ef52 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] 10.222.0.42 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.023725 Oct 23 01:47:13.072208 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3132/6359] 10.222.0.42 () {58 vars in 1178 bytes} [Sun Oct 23 01:47:13 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:47:13.086372 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6d23a560-dfa1-4c67-9693-229466d86eb5 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:13.091957 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6d23a560-dfa1-4c67-9693-229466d86eb5 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '69b44fee007d4e098a34f71c2530f6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13757f6a5da74eb494f5097be6a70823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:47:13.092631 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6d23a560-dfa1-4c67-9693-229466d86eb5 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '13757f6a5da74eb494f5097be6a70823'} {{(pid=120944) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 23 01:47:13.100066 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6d23a560-dfa1-4c67-9693-229466d86eb5 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:13.100480 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6d23a560-dfa1-4c67-9693-229466d86eb5 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:13.100920 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6d23a560-dfa1-4c67-9693-229466d86eb5 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:13.101638 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6d23a560-dfa1-4c67-9693-229466d86eb5 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:13.102978 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6d23a560-dfa1-4c67-9693-229466d86eb5 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:13.103414 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6d23a560-dfa1-4c67-9693-229466d86eb5 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:13.193337 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6d23a560-dfa1-4c67-9693-229466d86eb5 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] 10.222.0.42 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.110710 Oct 23 01:47:13.194513 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3228/6360] 10.222.0.42 () {58 vars in 1174 bytes} [Sun Oct 23 01:47:13 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:47:13.210279 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-783fc666-5db2-44fb-bfb1-4faa7ab4ec2d tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:13.217167 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-783fc666-5db2-44fb-bfb1-4faa7ab4ec2d tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '69b44fee007d4e098a34f71c2530f6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13757f6a5da74eb494f5097be6a70823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:47:13.218343 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-783fc666-5db2-44fb-bfb1-4faa7ab4ec2d tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '13757f6a5da74eb494f5097be6a70823'} {{(pid=120945) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 23 01:47:13.230264 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-783fc666-5db2-44fb-bfb1-4faa7ab4ec2d tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:13.230264 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-783fc666-5db2-44fb-bfb1-4faa7ab4ec2d tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:13.230264 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-783fc666-5db2-44fb-bfb1-4faa7ab4ec2d tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:13.230264 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-783fc666-5db2-44fb-bfb1-4faa7ab4ec2d tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:13.230264 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-783fc666-5db2-44fb-bfb1-4faa7ab4ec2d tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:13.230264 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-783fc666-5db2-44fb-bfb1-4faa7ab4ec2d tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:13.502079 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-783fc666-5db2-44fb-bfb1-4faa7ab4ec2d tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] 10.222.0.42 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.296569 Oct 23 01:47:13.505729 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3133/6361] 10.222.0.42 () {58 vars in 1184 bytes} [Sun Oct 23 01:47:13 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 01:47:13.519417 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-40ab0b3f-78ab-47e7-a956-c0672cb45050 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:13.535730 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-40ab0b3f-78ab-47e7-a956-c0672cb45050 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '69b44fee007d4e098a34f71c2530f6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13757f6a5da74eb494f5097be6a70823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:47:13.538914 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-40ab0b3f-78ab-47e7-a956-c0672cb45050 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Searching by: {'deleted': False, 'project_id': '13757f6a5da74eb494f5097be6a70823'} {{(pid=120944) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 23 01:47:13.560606 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-40ab0b3f-78ab-47e7-a956-c0672cb45050 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:13.560606 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-40ab0b3f-78ab-47e7-a956-c0672cb45050 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:13.560606 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-40ab0b3f-78ab-47e7-a956-c0672cb45050 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:13.560606 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-40ab0b3f-78ab-47e7-a956-c0672cb45050 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:13.566680 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-40ab0b3f-78ab-47e7-a956-c0672cb45050 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:13.567324 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-40ab0b3f-78ab-47e7-a956-c0672cb45050 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:13.612082 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.multi_cell_list [None req-40ab0b3f-78ab-47e7-a956-c0672cb45050 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120944) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 23 01:47:13.659645 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-40ab0b3f-78ab-47e7-a956-c0672cb45050 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b44fee007d4e098a34f71c2530f6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13757f6a5da74eb494f5097be6a70823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:47:13.669887 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-40ab0b3f-78ab-47e7-a956-c0672cb45050 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:13.670577 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-40ab0b3f-78ab-47e7-a956-c0672cb45050 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:13.673076 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-40ab0b3f-78ab-47e7-a956-c0672cb45050 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:13.887704 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-40ab0b3f-78ab-47e7-a956-c0672cb45050 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] 10.222.0.42 "GET /compute/v2.1/servers/detail" status: 200 len: 3024 microversion: 2.1 time: 0.372807 Oct 23 01:47:13.888625 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3229/6362] 10.222.0.42 () {58 vars in 1146 bytes} [Sun Oct 23 01:47:13 2022] GET /compute/v2.1/servers/detail => generated 3024 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:47:13.917490 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5afe6eb4-1e88-40cd-baf2-1ef0e0d00784 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:13.922782 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5afe6eb4-1e88-40cd-baf2-1ef0e0d00784 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '69b44fee007d4e098a34f71c2530f6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13757f6a5da74eb494f5097be6a70823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:47:13.923841 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5afe6eb4-1e88-40cd-baf2-1ef0e0d00784 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] 10.222.0.42 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.011413 Oct 23 01:47:13.928252 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3134/6363] 10.222.0.42 () {58 vars in 1178 bytes} [Sun Oct 23 01:47:13 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 23 01:47:13.937590 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-869b2029-bc31-4f6b-b75a-de9be05e2c44 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:13.943362 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-869b2029-bc31-4f6b-b75a-de9be05e2c44 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '69b44fee007d4e098a34f71c2530f6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13757f6a5da74eb494f5097be6a70823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:47:13.944025 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-869b2029-bc31-4f6b-b75a-de9be05e2c44 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Searching by: {'deleted': False, 'project_id': '13757f6a5da74eb494f5097be6a70823'} {{(pid=120944) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 23 01:47:13.957113 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-869b2029-bc31-4f6b-b75a-de9be05e2c44 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:13.957826 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-869b2029-bc31-4f6b-b75a-de9be05e2c44 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:13.958454 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-869b2029-bc31-4f6b-b75a-de9be05e2c44 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:13.959360 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-869b2029-bc31-4f6b-b75a-de9be05e2c44 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:13.960000 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-869b2029-bc31-4f6b-b75a-de9be05e2c44 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:13.960573 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-869b2029-bc31-4f6b-b75a-de9be05e2c44 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:14.004136 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.multi_cell_list [None req-869b2029-bc31-4f6b-b75a-de9be05e2c44 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120944) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 23 01:47:14.040601 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-869b2029-bc31-4f6b-b75a-de9be05e2c44 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.106708 Oct 23 01:47:14.041893 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3230/6364] 10.222.0.42 () {58 vars in 1125 bytes} [Sun Oct 23 01:47:13 2022] GET /compute/v2.1/servers => generated 681 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:47:14.056537 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-08f75e3e-83b9-4206-bb08-53b584d4847e tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:14.057738 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-08f75e3e-83b9-4206-bb08-53b584d4847e tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] [instance: 0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:47:14.065886 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-08f75e3e-83b9-4206-bb08-53b584d4847e tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:14.066708 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-08f75e3e-83b9-4206-bb08-53b584d4847e tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:14.067319 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-08f75e3e-83b9-4206-bb08-53b584d4847e tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:14.068541 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-08f75e3e-83b9-4206-bb08-53b584d4847e tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:14.069387 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-08f75e3e-83b9-4206-bb08-53b584d4847e tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:14.070213 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-08f75e3e-83b9-4206-bb08-53b584d4847e tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:14.105927 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-08f75e3e-83b9-4206-bb08-53b584d4847e tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] HTTP exception thrown: Instance 0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb could not be found. Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-08f75e3e-83b9-4206-bb08-53b584d4847e tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Request method failure captured: Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/servers/0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb HTTP/1.1 Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJz52nYbC8ykmQ37oOrrB9_uYYDyGlv3jER4E4t2rnI6FXpYWGVtn8Y9lvMIB48TrthpENO5wgtbA8DhCqEAg30KMAmv_BfeHeKk41YlCRbUW2oqK9ZbjA0BFKfxVOkEYJHPmApjhcMx9oQ9mWGeYtzNR8zsh9LwUuHFNHh5hLRRycY Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 13757f6a5da74eb494f5097be6a70823 Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ListServersNegativeTestJSON-1396773786 Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/13757f6a5da74eb494f5097be6a70823"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_13757f6a5da74eb494f5097be6a70823"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/13757f6a5da74eb494f5097be6a70823"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/13757f6a5da74eb494f5097be6a70823"}]}] Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ListServersNegativeTestJSON-1396773786 Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 13757f6a5da74eb494f5097be6a70823 Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1396773786 Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ListServersNegativeTestJSON-1396773786-project Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 69b44fee007d4e098a34f71c2530f6f2 Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ListServersNegativeTestJSON-1396773786-project Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb could not be found. Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb'} Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb could not be found. Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:47:14.108154 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:47:14.112109 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb could not be found. Oct 23 01:47:14.112109 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:47:14.112109 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:47:14.112109 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:47:14.112109 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:47:14.112109 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:47:14.112109 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:47:14.112109 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:47:14.112109 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:47:14.112109 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb could not be found. Oct 23 01:47:14.112109 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:47:14.114114 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-08f75e3e-83b9-4206-bb08-53b584d4847e tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Returning 404 to user: Instance 0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:47:14.115161 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-08f75e3e-83b9-4206-bb08-53b584d4847e tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb" status: 404 len: 111 microversion: 2.1 time: 0.064130 Oct 23 01:47:14.116108 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3135/6365] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:47:14 2022] DELETE /compute/v2.1/servers/0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:47:14.124919 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5446feb2-c469-4141-87b0-80dd85808f20 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:14.125825 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5446feb2-c469-4141-87b0-80dd85808f20 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] [instance: 91d10bf0-72e1-48bf-9c76-f13e3e4cd27b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:47:14.132452 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5446feb2-c469-4141-87b0-80dd85808f20 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:14.133041 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5446feb2-c469-4141-87b0-80dd85808f20 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:14.135414 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5446feb2-c469-4141-87b0-80dd85808f20 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:14.136262 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5446feb2-c469-4141-87b0-80dd85808f20 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:14.136983 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5446feb2-c469-4141-87b0-80dd85808f20 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:14.137610 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5446feb2-c469-4141-87b0-80dd85808f20 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:14.173767 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5446feb2-c469-4141-87b0-80dd85808f20 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] [instance: 91d10bf0-72e1-48bf-9c76-f13e3e4cd27b] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:47:14.690262 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5446feb2-c469-4141-87b0-80dd85808f20 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] 10.222.0.42 "DELETE /compute/v2.1/servers/91d10bf0-72e1-48bf-9c76-f13e3e4cd27b" status: 204 len: 0 microversion: 2.1 time: 0.568474 Oct 23 01:47:14.690262 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3231/6366] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:47:14 2022] DELETE /compute/v2.1/servers/91d10bf0-72e1-48bf-9c76-f13e3e4cd27b => generated 0 bytes in 570 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:47:14.710488 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-36e3f245-98e8-4323-9a30-3cf79f9ded91 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:14.711405 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-36e3f245-98e8-4323-9a30-3cf79f9ded91 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] [instance: 1a7da380-db15-4dd3-ac05-3788924a92c5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:47:14.719491 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36e3f245-98e8-4323-9a30-3cf79f9ded91 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:14.720351 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36e3f245-98e8-4323-9a30-3cf79f9ded91 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:14.720990 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36e3f245-98e8-4323-9a30-3cf79f9ded91 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:14.722092 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36e3f245-98e8-4323-9a30-3cf79f9ded91 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:14.722904 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36e3f245-98e8-4323-9a30-3cf79f9ded91 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:14.723525 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36e3f245-98e8-4323-9a30-3cf79f9ded91 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:14.758024 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-36e3f245-98e8-4323-9a30-3cf79f9ded91 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] [instance: 1a7da380-db15-4dd3-ac05-3788924a92c5] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:47:15.274720 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-36e3f245-98e8-4323-9a30-3cf79f9ded91 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1a7da380-db15-4dd3-ac05-3788924a92c5" status: 204 len: 0 microversion: 2.1 time: 0.573674 Oct 23 01:47:15.276122 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3136/6367] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:47:14 2022] DELETE /compute/v2.1/servers/1a7da380-db15-4dd3-ac05-3788924a92c5 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 23 01:47:15.285087 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-41937bcc-34f0-486e-aec8-b3bad1ece741 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:15.285912 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-41937bcc-34f0-486e-aec8-b3bad1ece741 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] [instance: 0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:47:15.294634 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41937bcc-34f0-486e-aec8-b3bad1ece741 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:15.295240 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41937bcc-34f0-486e-aec8-b3bad1ece741 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:15.295762 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41937bcc-34f0-486e-aec8-b3bad1ece741 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:15.296556 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41937bcc-34f0-486e-aec8-b3bad1ece741 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:15.297098 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41937bcc-34f0-486e-aec8-b3bad1ece741 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:15.297684 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41937bcc-34f0-486e-aec8-b3bad1ece741 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:15.314025 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-41937bcc-34f0-486e-aec8-b3bad1ece741 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] HTTP exception thrown: Instance 0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb could not be found. Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-41937bcc-34f0-486e-aec8-b3bad1ece741 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Request method failure captured: Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb HTTP/1.1 Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJz52nYbC8ykmQ37oOrrB9_uYYDyGlv3jER4E4t2rnI6FXpYWGVtn8Y9lvMIB48TrthpENO5wgtbA8DhCqEAg30KMAmv_BfeHeKk41YlCRbUW2oqK9ZbjA0BFKfxVOkEYJHPmApjhcMx9oQ9mWGeYtzNR8zsh9LwUuHFNHh5hLRRycY Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 13757f6a5da74eb494f5097be6a70823 Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ListServersNegativeTestJSON-1396773786 Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/13757f6a5da74eb494f5097be6a70823"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_13757f6a5da74eb494f5097be6a70823"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/13757f6a5da74eb494f5097be6a70823"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/13757f6a5da74eb494f5097be6a70823"}]}] Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ListServersNegativeTestJSON-1396773786 Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 13757f6a5da74eb494f5097be6a70823 Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1396773786 Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ListServersNegativeTestJSON-1396773786-project Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 69b44fee007d4e098a34f71c2530f6f2 Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ListServersNegativeTestJSON-1396773786-project Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb could not be found. Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb'} Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb could not be found. Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb could not be found. Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:47:15.316121 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:47:15.322511 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:47:15.322511 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:47:15.322511 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:47:15.322511 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:47:15.322511 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:47:15.322511 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:47:15.322511 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb could not be found. Oct 23 01:47:15.322511 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:47:15.322511 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-41937bcc-34f0-486e-aec8-b3bad1ece741 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Returning 404 to user: Instance 0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:47:15.322511 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-41937bcc-34f0-486e-aec8-b3bad1ece741 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] 10.222.0.42 "GET /compute/v2.1/servers/0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb" status: 404 len: 111 microversion: 2.1 time: 0.037061 Oct 23 01:47:15.322511 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3232/6368] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:47:15 2022] GET /compute/v2.1/servers/0b3bc863-0b3e-49d3-bef6-6e94b99fd8cb => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:47:15.328534 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-289302f6-f39d-4860-9443-6b6a9116250f tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:15.329351 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-289302f6-f39d-4860-9443-6b6a9116250f tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] [instance: 91d10bf0-72e1-48bf-9c76-f13e3e4cd27b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:47:15.336424 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-289302f6-f39d-4860-9443-6b6a9116250f tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:15.336961 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-289302f6-f39d-4860-9443-6b6a9116250f tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:15.337404 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-289302f6-f39d-4860-9443-6b6a9116250f tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:15.338471 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-289302f6-f39d-4860-9443-6b6a9116250f tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:15.339001 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-289302f6-f39d-4860-9443-6b6a9116250f tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:15.339399 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-289302f6-f39d-4860-9443-6b6a9116250f tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:15.742066 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-289302f6-f39d-4860-9443-6b6a9116250f tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b44fee007d4e098a34f71c2530f6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13757f6a5da74eb494f5097be6a70823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:47:15.779242 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-289302f6-f39d-4860-9443-6b6a9116250f tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] 10.222.0.42 "GET /compute/v2.1/servers/91d10bf0-72e1-48bf-9c76-f13e3e4cd27b" status: 200 len: 1521 microversion: 2.1 time: 0.435711 Oct 23 01:47:15.779242 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3137/6369] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:47:15 2022] GET /compute/v2.1/servers/91d10bf0-72e1-48bf-9c76-f13e3e4cd27b => generated 1521 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:47:16.795515 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-70212958-5f34-4fe3-8479-4e03e07d1263 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:16.796668 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-70212958-5f34-4fe3-8479-4e03e07d1263 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] [instance: 91d10bf0-72e1-48bf-9c76-f13e3e4cd27b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:47:16.810145 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-70212958-5f34-4fe3-8479-4e03e07d1263 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:16.810654 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-70212958-5f34-4fe3-8479-4e03e07d1263 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:16.811098 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-70212958-5f34-4fe3-8479-4e03e07d1263 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:16.812111 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-70212958-5f34-4fe3-8479-4e03e07d1263 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:16.812574 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-70212958-5f34-4fe3-8479-4e03e07d1263 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:16.813181 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-70212958-5f34-4fe3-8479-4e03e07d1263 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:17.246597 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-70212958-5f34-4fe3-8479-4e03e07d1263 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b44fee007d4e098a34f71c2530f6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13757f6a5da74eb494f5097be6a70823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:47:17.257877 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-70212958-5f34-4fe3-8479-4e03e07d1263 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] 10.222.0.42 "GET /compute/v2.1/servers/91d10bf0-72e1-48bf-9c76-f13e3e4cd27b" status: 200 len: 1521 microversion: 2.1 time: 0.466674 Oct 23 01:47:17.269999 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3233/6370] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:47:16 2022] GET /compute/v2.1/servers/91d10bf0-72e1-48bf-9c76-f13e3e4cd27b => generated 1521 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:47:17.801427 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-a8b284fc-04c7-4bb9-ba46-c5c58125e038 req-8b6643b4-3569-4d7c-b0e7-ef5de19c3046 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91d10bf0-72e1-48bf-9c76-f13e3e4cd27b", "name": "network-vif-deleted", "tag": "1c77708b-7d5e-4e9d-9b03-0b5e99a2f97f"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:47:17.802177 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-2a1748a0-c3e6-4ebb-8c75-5935347eb1aa req-e13f3e33-f446-4b16-a86d-3628d23064f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a7da380-db15-4dd3-ac05-3788924a92c5", "name": "network-vif-deleted", "tag": "cbb0ad81-5591-4b13-b6b1-64fa8310acf9"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:47:17.823777 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-2a1748a0-c3e6-4ebb-8c75-5935347eb1aa req-e13f3e33-f446-4b16-a86d-3628d23064f3 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:17.828610 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-a8b284fc-04c7-4bb9-ba46-c5c58125e038 req-8b6643b4-3569-4d7c-b0e7-ef5de19c3046 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:17.829363 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-2a1748a0-c3e6-4ebb-8c75-5935347eb1aa req-e13f3e33-f446-4b16-a86d-3628d23064f3 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:17.830031 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-2a1748a0-c3e6-4ebb-8c75-5935347eb1aa req-e13f3e33-f446-4b16-a86d-3628d23064f3 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:17.837248 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-a8b284fc-04c7-4bb9-ba46-c5c58125e038 req-8b6643b4-3569-4d7c-b0e7-ef5de19c3046 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:17.838267 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-a8b284fc-04c7-4bb9-ba46-c5c58125e038 req-8b6643b4-3569-4d7c-b0e7-ef5de19c3046 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:17.855359 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-a8b284fc-04c7-4bb9-ba46-c5c58125e038 req-8b6643b4-3569-4d7c-b0e7-ef5de19c3046 service nova] Creating event network-vif-deleted:1c77708b-7d5e-4e9d-9b03-0b5e99a2f97f for instance 91d10bf0-72e1-48bf-9c76-f13e3e4cd27b on n-h1-master-1 Oct 23 01:47:17.863378 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-a8b284fc-04c7-4bb9-ba46-c5c58125e038 req-8b6643b4-3569-4d7c-b0e7-ef5de19c3046 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063723 Oct 23 01:47:17.864219 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3138/6371] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:47:17.870243 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-2a1748a0-c3e6-4ebb-8c75-5935347eb1aa req-e13f3e33-f446-4b16-a86d-3628d23064f3 service nova] Creating event network-vif-deleted:cbb0ad81-5591-4b13-b6b1-64fa8310acf9 for instance 1a7da380-db15-4dd3-ac05-3788924a92c5 on n-h2-master-1 Oct 23 01:47:17.878620 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-2a1748a0-c3e6-4ebb-8c75-5935347eb1aa req-e13f3e33-f446-4b16-a86d-3628d23064f3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079971 Oct 23 01:47:17.879203 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3234/6372] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:47:18.307172 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4b63bdc1-0c05-4627-b7de-23d75ace1d2a tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:18.308263 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4b63bdc1-0c05-4627-b7de-23d75ace1d2a tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] [instance: 91d10bf0-72e1-48bf-9c76-f13e3e4cd27b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:47:18.314845 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b63bdc1-0c05-4627-b7de-23d75ace1d2a tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:18.315334 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b63bdc1-0c05-4627-b7de-23d75ace1d2a tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:18.315948 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b63bdc1-0c05-4627-b7de-23d75ace1d2a tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:18.316814 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b63bdc1-0c05-4627-b7de-23d75ace1d2a tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:18.317965 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b63bdc1-0c05-4627-b7de-23d75ace1d2a tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:18.318864 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b63bdc1-0c05-4627-b7de-23d75ace1d2a tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:18.325827 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:47:18.354702 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b63bdc1-0c05-4627-b7de-23d75ace1d2a tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:18.355283 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b63bdc1-0c05-4627-b7de-23d75ace1d2a tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:18.356622 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b63bdc1-0c05-4627-b7de-23d75ace1d2a tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:18.357289 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-4b63bdc1-0c05-4627-b7de-23d75ace1d2a tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lazy-loading 'fault' on Instance uuid 91d10bf0-72e1-48bf-9c76-f13e3e4cd27b {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:47:18.435642 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4b63bdc1-0c05-4627-b7de-23d75ace1d2a tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b44fee007d4e098a34f71c2530f6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13757f6a5da74eb494f5097be6a70823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:47:18.445199 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4b63bdc1-0c05-4627-b7de-23d75ace1d2a tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] 10.222.0.42 "GET /compute/v2.1/servers/91d10bf0-72e1-48bf-9c76-f13e3e4cd27b" status: 200 len: 1312 microversion: 2.1 time: 0.151366 Oct 23 01:47:18.447511 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3139/6373] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:47:18 2022] GET /compute/v2.1/servers/91d10bf0-72e1-48bf-9c76-f13e3e4cd27b => generated 1312 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:47:19.472569 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-76b31728-1033-456a-b9bb-681f0c141ce4 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:19.473214 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-76b31728-1033-456a-b9bb-681f0c141ce4 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] [instance: 91d10bf0-72e1-48bf-9c76-f13e3e4cd27b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:47:19.480309 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-76b31728-1033-456a-b9bb-681f0c141ce4 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:19.480810 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-76b31728-1033-456a-b9bb-681f0c141ce4 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:19.481230 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-76b31728-1033-456a-b9bb-681f0c141ce4 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:19.481931 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-76b31728-1033-456a-b9bb-681f0c141ce4 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:19.483721 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-76b31728-1033-456a-b9bb-681f0c141ce4 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:19.484301 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-76b31728-1033-456a-b9bb-681f0c141ce4 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:19.506746 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:47:19.521233 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-76b31728-1033-456a-b9bb-681f0c141ce4 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:19.521901 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-76b31728-1033-456a-b9bb-681f0c141ce4 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:19.522373 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-76b31728-1033-456a-b9bb-681f0c141ce4 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:19.522829 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-76b31728-1033-456a-b9bb-681f0c141ce4 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lazy-loading 'fault' on Instance uuid 91d10bf0-72e1-48bf-9c76-f13e3e4cd27b {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:47:19.585013 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-76b31728-1033-456a-b9bb-681f0c141ce4 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b44fee007d4e098a34f71c2530f6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13757f6a5da74eb494f5097be6a70823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:47:19.605082 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-76b31728-1033-456a-b9bb-681f0c141ce4 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] 10.222.0.42 "GET /compute/v2.1/servers/91d10bf0-72e1-48bf-9c76-f13e3e4cd27b" status: 200 len: 1312 microversion: 2.1 time: 0.135218 Oct 23 01:47:19.606340 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3235/6374] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:47:19 2022] GET /compute/v2.1/servers/91d10bf0-72e1-48bf-9c76-f13e3e4cd27b => generated 1312 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:47:20.631724 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e5cf6ce3-091a-4048-b753-3825dc15bfc0 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:20.632490 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e5cf6ce3-091a-4048-b753-3825dc15bfc0 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] [instance: 91d10bf0-72e1-48bf-9c76-f13e3e4cd27b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:47:20.640320 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e5cf6ce3-091a-4048-b753-3825dc15bfc0 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:20.640823 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e5cf6ce3-091a-4048-b753-3825dc15bfc0 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:20.641421 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e5cf6ce3-091a-4048-b753-3825dc15bfc0 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:20.642162 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e5cf6ce3-091a-4048-b753-3825dc15bfc0 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:20.642767 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e5cf6ce3-091a-4048-b753-3825dc15bfc0 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:20.643200 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e5cf6ce3-091a-4048-b753-3825dc15bfc0 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:20.662751 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-e5cf6ce3-091a-4048-b753-3825dc15bfc0 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] HTTP exception thrown: Instance 91d10bf0-72e1-48bf-9c76-f13e3e4cd27b could not be found. Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e5cf6ce3-091a-4048-b753-3825dc15bfc0 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Request method failure captured: Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/91d10bf0-72e1-48bf-9c76-f13e3e4cd27b HTTP/1.1 Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJz52nYbC8ykmQ37oOrrB9_uYYDyGlv3jER4E4t2rnI6FXpYWGVtn8Y9lvMIB48TrthpENO5wgtbA8DhCqEAg30KMAmv_BfeHeKk41YlCRbUW2oqK9ZbjA0BFKfxVOkEYJHPmApjhcMx9oQ9mWGeYtzNR8zsh9LwUuHFNHh5hLRRycY Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 13757f6a5da74eb494f5097be6a70823 Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ListServersNegativeTestJSON-1396773786 Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/13757f6a5da74eb494f5097be6a70823"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_13757f6a5da74eb494f5097be6a70823"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/13757f6a5da74eb494f5097be6a70823"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/13757f6a5da74eb494f5097be6a70823"}]}] Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ListServersNegativeTestJSON-1396773786 Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 13757f6a5da74eb494f5097be6a70823 Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1396773786 Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ListServersNegativeTestJSON-1396773786-project Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 69b44fee007d4e098a34f71c2530f6f2 Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ListServersNegativeTestJSON-1396773786-project Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 91d10bf0-72e1-48bf-9c76-f13e3e4cd27b could not be found. Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '91d10bf0-72e1-48bf-9c76-f13e3e4cd27b'} Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91d10bf0-72e1-48bf-9c76-f13e3e4cd27b could not be found. Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91d10bf0-72e1-48bf-9c76-f13e3e4cd27b could not be found. Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:47:20.664591 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:47:20.672107 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:47:20.672107 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:47:20.672107 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:47:20.672107 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:47:20.672107 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:47:20.672107 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:47:20.672107 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91d10bf0-72e1-48bf-9c76-f13e3e4cd27b could not be found. Oct 23 01:47:20.672107 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:47:20.672107 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e5cf6ce3-091a-4048-b753-3825dc15bfc0 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Returning 404 to user: Instance 91d10bf0-72e1-48bf-9c76-f13e3e4cd27b could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:47:20.672107 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e5cf6ce3-091a-4048-b753-3825dc15bfc0 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] 10.222.0.42 "GET /compute/v2.1/servers/91d10bf0-72e1-48bf-9c76-f13e3e4cd27b" status: 404 len: 111 microversion: 2.1 time: 0.039214 Oct 23 01:47:20.672107 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3140/6375] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:47:20 2022] GET /compute/v2.1/servers/91d10bf0-72e1-48bf-9c76-f13e3e4cd27b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:47:20.675976 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bc3a27b2-8b20-4da9-86e2-52862103e514 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:20.676557 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bc3a27b2-8b20-4da9-86e2-52862103e514 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] [instance: 1a7da380-db15-4dd3-ac05-3788924a92c5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:47:20.684990 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc3a27b2-8b20-4da9-86e2-52862103e514 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:20.689473 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc3a27b2-8b20-4da9-86e2-52862103e514 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:20.689473 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc3a27b2-8b20-4da9-86e2-52862103e514 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:20.689473 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc3a27b2-8b20-4da9-86e2-52862103e514 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:20.689473 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc3a27b2-8b20-4da9-86e2-52862103e514 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:20.689473 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc3a27b2-8b20-4da9-86e2-52862103e514 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:20.702624 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-bc3a27b2-8b20-4da9-86e2-52862103e514 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] HTTP exception thrown: Instance 1a7da380-db15-4dd3-ac05-3788924a92c5 could not be found. Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bc3a27b2-8b20-4da9-86e2-52862103e514 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Request method failure captured: Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/1a7da380-db15-4dd3-ac05-3788924a92c5 HTTP/1.1 Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJz52nYbC8ykmQ37oOrrB9_uYYDyGlv3jER4E4t2rnI6FXpYWGVtn8Y9lvMIB48TrthpENO5wgtbA8DhCqEAg30KMAmv_BfeHeKk41YlCRbUW2oqK9ZbjA0BFKfxVOkEYJHPmApjhcMx9oQ9mWGeYtzNR8zsh9LwUuHFNHh5hLRRycY Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 13757f6a5da74eb494f5097be6a70823 Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ListServersNegativeTestJSON-1396773786 Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/13757f6a5da74eb494f5097be6a70823"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_13757f6a5da74eb494f5097be6a70823"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/13757f6a5da74eb494f5097be6a70823"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/13757f6a5da74eb494f5097be6a70823"}]}] Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ListServersNegativeTestJSON-1396773786 Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 13757f6a5da74eb494f5097be6a70823 Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1396773786 Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ListServersNegativeTestJSON-1396773786-project Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 69b44fee007d4e098a34f71c2530f6f2 Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ListServersNegativeTestJSON-1396773786-project Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 1a7da380-db15-4dd3-ac05-3788924a92c5 could not be found. Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '1a7da380-db15-4dd3-ac05-3788924a92c5'} Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a7da380-db15-4dd3-ac05-3788924a92c5 could not be found. Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a7da380-db15-4dd3-ac05-3788924a92c5 could not be found. Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:47:20.704560 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:47:20.707940 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:47:20.707940 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:47:20.707940 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:47:20.707940 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:47:20.707940 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:47:20.707940 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:47:20.707940 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a7da380-db15-4dd3-ac05-3788924a92c5 could not be found. Oct 23 01:47:20.707940 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:47:20.712342 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bc3a27b2-8b20-4da9-86e2-52862103e514 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] Returning 404 to user: Instance 1a7da380-db15-4dd3-ac05-3788924a92c5 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:47:20.713591 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bc3a27b2-8b20-4da9-86e2-52862103e514 tempest-ListServersNegativeTestJSON-1396773786 tempest-ListServersNegativeTestJSON-1396773786-project] 10.222.0.42 "GET /compute/v2.1/servers/1a7da380-db15-4dd3-ac05-3788924a92c5" status: 404 len: 111 microversion: 2.1 time: 0.041743 Oct 23 01:47:20.715983 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3236/6376] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:47:20 2022] GET /compute/v2.1/servers/1a7da380-db15-4dd3-ac05-3788924a92c5 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 01:47:22.853860 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e2ea9717-fb34-48ee-91b3-730c206130a9 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:47:22.857224 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e2ea9717-fb34-48ee-91b3-730c206130a9 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 74513e84-5d69-4d3b-aeed-5f4a45b6317e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:47:22.884750 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e2ea9717-fb34-48ee-91b3-730c206130a9 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:22.897842 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e2ea9717-fb34-48ee-91b3-730c206130a9 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:22.898353 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e2ea9717-fb34-48ee-91b3-730c206130a9 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:22.904855 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e2ea9717-fb34-48ee-91b3-730c206130a9 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:22.905343 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e2ea9717-fb34-48ee-91b3-730c206130a9 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:22.906525 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e2ea9717-fb34-48ee-91b3-730c206130a9 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:23.021088 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e2ea9717-fb34-48ee-91b3-730c206130a9 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "POST /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e/action" status: 200 len: 24560 microversion: 2.1 time: 0.171568 Oct 23 01:47:23.022382 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3141/6377] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:47:22 2022] POST /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e/action => generated 24560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 23 01:47:33.974247 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-63c1c1f0-a901-4fd8-a51b-b29d2b09a3af tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:33.974869 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-63c1c1f0-a901-4fd8-a51b-b29d2b09a3af tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 74513e84-5d69-4d3b-aeed-5f4a45b6317e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:47:33.980538 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:47:33.981250 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=8 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:47:33.982173 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:47:34.033957 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-63c1c1f0-a901-4fd8-a51b-b29d2b09a3af tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:34.034495 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-63c1c1f0-a901-4fd8-a51b-b29d2b09a3af tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:34.037262 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-63c1c1f0-a901-4fd8-a51b-b29d2b09a3af tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:34.038049 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-63c1c1f0-a901-4fd8-a51b-b29d2b09a3af tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:34.038526 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-63c1c1f0-a901-4fd8-a51b-b29d2b09a3af tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:34.042071 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-63c1c1f0-a901-4fd8-a51b-b29d2b09a3af tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:34.642004 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-63c1c1f0-a901-4fd8-a51b-b29d2b09a3af tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:47:34.650783 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-63c1c1f0-a901-4fd8-a51b-b29d2b09a3af tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e" status: 200 len: 1685 microversion: 2.1 time: 0.681010 Oct 23 01:47:34.658964 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3237/6378] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:47:33 2022] GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e => generated 1685 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:47:34.845507 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5f399592-27bf-4197-86ca-f0ffaf252d68 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:47:34.848472 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5f399592-27bf-4197-86ca-f0ffaf252d68 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 74513e84-5d69-4d3b-aeed-5f4a45b6317e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:47:34.873212 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=6 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:47:34.873212 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:47:34.875122 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5f399592-27bf-4197-86ca-f0ffaf252d68 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:34.879437 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5f399592-27bf-4197-86ca-f0ffaf252d68 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:34.880224 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5f399592-27bf-4197-86ca-f0ffaf252d68 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:34.881199 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5f399592-27bf-4197-86ca-f0ffaf252d68 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:34.881876 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5f399592-27bf-4197-86ca-f0ffaf252d68 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:34.882579 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5f399592-27bf-4197-86ca-f0ffaf252d68 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:35.024696 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5f399592-27bf-4197-86ca-f0ffaf252d68 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "POST /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e/action" status: 200 len: 32624 microversion: 2.1 time: 0.184731 Oct 23 01:47:35.026115 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3142/6379] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:47:34 2022] POST /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e/action => generated 32624 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:47:35.190701 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6722697e-1927-46da-a2a8-6d7325a99a26 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:35.192131 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6722697e-1927-46da-a2a8-6d7325a99a26 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] [instance: 74513e84-5d69-4d3b-aeed-5f4a45b6317e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:47:35.214512 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6722697e-1927-46da-a2a8-6d7325a99a26 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:35.215584 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6722697e-1927-46da-a2a8-6d7325a99a26 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:35.216347 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6722697e-1927-46da-a2a8-6d7325a99a26 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:35.217415 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6722697e-1927-46da-a2a8-6d7325a99a26 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:35.219691 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6722697e-1927-46da-a2a8-6d7325a99a26 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:35.220372 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6722697e-1927-46da-a2a8-6d7325a99a26 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:35.784493 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6722697e-1927-46da-a2a8-6d7325a99a26 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e" status: 200 len: 1836 microversion: 2.1 time: 0.597499 Oct 23 01:47:35.786400 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3238/6380] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:47:35 2022] GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e => generated 1836 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:47:35.828558 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a6b902ef-7623-4060-a042-72ac6828fa35 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:47:35.831817 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a6b902ef-7623-4060-a042-72ac6828fa35 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] [instance: 74513e84-5d69-4d3b-aeed-5f4a45b6317e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:47:35.842927 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a6b902ef-7623-4060-a042-72ac6828fa35 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:35.845213 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a6b902ef-7623-4060-a042-72ac6828fa35 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:35.846681 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a6b902ef-7623-4060-a042-72ac6828fa35 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:35.848248 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a6b902ef-7623-4060-a042-72ac6828fa35 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:35.848917 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a6b902ef-7623-4060-a042-72ac6828fa35 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:35.849774 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a6b902ef-7623-4060-a042-72ac6828fa35 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:35.884694 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-a6b902ef-7623-4060-a042-72ac6828fa35 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Lazy-loading 'flavor' on Instance uuid 74513e84-5d69-4d3b-aeed-5f4a45b6317e {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:47:35.912461 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a6b902ef-7623-4060-a042-72ac6828fa35 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] [instance: 74513e84-5d69-4d3b-aeed-5f4a45b6317e] Going to try to live migrate instance to another host {{(pid=120945) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 23 01:47:40.639381 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ab0915cd-0f78-45bf-9a6e-c6a423ff7489 tempest-ServerGroup264TestJSON-1293063655 tempest-ServerGroup264TestJSON-1293063655-project] Action: 'create', calling method: .version_select at 0x7f5cc0acaaf0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:47:40.671802 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-ab0915cd-0f78-45bf-9a6e-c6a423ff7489 tempest-ServerGroup264TestJSON-1293063655 tempest-ServerGroup264TestJSON-1293063655-project] Getting quotas for project 4b044ba72fb644d2b4cc6c5232016332. Resources: {'server_groups'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:47:40.688067 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-ab0915cd-0f78-45bf-9a6e-c6a423ff7489 tempest-ServerGroup264TestJSON-1293063655 tempest-ServerGroup264TestJSON-1293063655-project] Getting quotas for user 9c08981b4a544ced88daf9da9e9e8d21 and project 4b044ba72fb644d2b4cc6c5232016332. Resources: {'server_groups'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:47:40.872059 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-ab0915cd-0f78-45bf-9a6e-c6a423ff7489 tempest-ServerGroup264TestJSON-1293063655 tempest-ServerGroup264TestJSON-1293063655-project] Getting quotas for project 4b044ba72fb644d2b4cc6c5232016332. Resources: {'server_groups'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:47:40.893598 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-ab0915cd-0f78-45bf-9a6e-c6a423ff7489 tempest-ServerGroup264TestJSON-1293063655 tempest-ServerGroup264TestJSON-1293063655-project] Getting quotas for user 9c08981b4a544ced88daf9da9e9e8d21 and project 4b044ba72fb644d2b4cc6c5232016332. Resources: {'server_groups'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:47:40.920808 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ab0915cd-0f78-45bf-9a6e-c6a423ff7489 tempest-ServerGroup264TestJSON-1293063655 tempest-ServerGroup264TestJSON-1293063655-project] 10.222.0.42 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.416572 Oct 23 01:47:40.921614 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3239/6381] 10.222.0.42 () {62 vars in 1214 bytes} [Sun Oct 23 01:47:40 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:47:40.953154 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6a8c72e9-d86e-44f3-940f-8c4afd631343 tempest-ServerGroup264TestJSON-1293063655 tempest-ServerGroup264TestJSON-1293063655-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:40.980127 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6a8c72e9-d86e-44f3-940f-8c4afd631343 tempest-ServerGroup264TestJSON-1293063655 tempest-ServerGroup264TestJSON-1293063655-project] 10.222.0.42 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.037289 Oct 23 01:47:40.983278 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3240/6382] 10.222.0.42 () {60 vars in 1193 bytes} [Sun Oct 23 01:47:40 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:47:41.008320 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3719e127-f0be-42c1-91e6-a035589f1f9c tempest-ServerGroup264TestJSON-1293063655 tempest-ServerGroup264TestJSON-1293063655-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:41.031812 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3719e127-f0be-42c1-91e6-a035589f1f9c tempest-ServerGroup264TestJSON-1293063655 tempest-ServerGroup264TestJSON-1293063655-project] 10.222.0.42 "GET /compute/v2.1/os-server-groups/4aa9333b-4ed1-4f29-ab2e-354864f490eb" status: 200 len: 235 microversion: 2.64 time: 0.042136 Oct 23 01:47:41.038792 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3241/6383] 10.222.0.42 () {60 vars in 1304 bytes} [Sun Oct 23 01:47:40 2022] GET /compute/v2.1/os-server-groups/4aa9333b-4ed1-4f29-ab2e-354864f490eb => generated 235 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:47:41.046484 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e8b4ec5c-8f46-4ba1-b964-b1b9137e5b0a tempest-ServerGroup264TestJSON-1293063655 tempest-ServerGroup264TestJSON-1293063655-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:41.220560 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e8b4ec5c-8f46-4ba1-b964-b1b9137e5b0a tempest-ServerGroup264TestJSON-1293063655 tempest-ServerGroup264TestJSON-1293063655-project] 10.222.0.42 "DELETE /compute/v2.1/os-server-groups/4aa9333b-4ed1-4f29-ab2e-354864f490eb" status: 204 len: 0 microversion: 2.64 time: 0.179740 Oct 23 01:47:41.225034 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3242/6384] 10.222.0.42 () {60 vars in 1307 bytes} [Sun Oct 23 01:47:41 2022] DELETE /compute/v2.1/os-server-groups/4aa9333b-4ed1-4f29-ab2e-354864f490eb => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 23 01:47:41.237035 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e99c37b1-fb66-4c55-a978-65b994b9fe4a tempest-ServerGroup264TestJSON-1293063655 tempest-ServerGroup264TestJSON-1293063655-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:41.253334 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-e99c37b1-fb66-4c55-a978-65b994b9fe4a tempest-ServerGroup264TestJSON-1293063655 tempest-ServerGroup264TestJSON-1293063655-project] HTTP exception thrown: Instance group 4aa9333b-4ed1-4f29-ab2e-354864f490eb could not be found. Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e99c37b1-fb66-4c55-a978-65b994b9fe4a tempest-ServerGroup264TestJSON-1293063655 tempest-ServerGroup264TestJSON-1293063655-project] Request method failure captured: Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/os-server-groups/4aa9333b-4ed1-4f29-ab2e-354864f490eb HTTP/1.1 Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJ08F9o8QWbNKZ8Ut_jxVjcv2f3GqdWfuqnFKXqfGqtPK7P7vP4Ob7Z-NhZsfcyT2_Fcs8v6YIP24Ci3l2Tc2bGyxr4oPNaVRtMtsgNUt2pQO5pfjIXWR5MfUkfZZ9Tk_NxUjFsENtfn4OSsVLLzOH_IZXJiikSodCTvDXQDigzpaDs Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: X-Openstack-Nova-Api-Version: 2.64 Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 4b044ba72fb644d2b4cc6c5232016332 Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServerGroup264TestJSON-1293063655 Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4b044ba72fb644d2b4cc6c5232016332"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4b044ba72fb644d2b4cc6c5232016332"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b044ba72fb644d2b4cc6c5232016332"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4b044ba72fb644d2b4cc6c5232016332"}]}] Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServerGroup264TestJSON-1293063655 Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 4b044ba72fb644d2b4cc6c5232016332 Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1293063655 Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServerGroup264TestJSON-1293063655-project Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 9c08981b4a544ced88daf9da9e9e8d21 Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServerGroup264TestJSON-1293063655-project Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: exception: Instance group 4aa9333b-4ed1-4f29-ab2e-354864f490eb could not be found. Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '4aa9333b-4ed1-4f29-ab2e-354864f490eb'} Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 4aa9333b-4ed1-4f29-ab2e-354864f490eb could not be found. Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 4aa9333b-4ed1-4f29-ab2e-354864f490eb could not be found. Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:47:41.261676 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:47:41.268283 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:47:41.268283 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:47:41.268283 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:47:41.268283 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:47:41.268283 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 4aa9333b-4ed1-4f29-ab2e-354864f490eb could not be found. Oct 23 01:47:41.268283 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:47:41.268283 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e99c37b1-fb66-4c55-a978-65b994b9fe4a tempest-ServerGroup264TestJSON-1293063655 tempest-ServerGroup264TestJSON-1293063655-project] Returning 404 to user: Instance group 4aa9333b-4ed1-4f29-ab2e-354864f490eb could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:47:41.268283 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e99c37b1-fb66-4c55-a978-65b994b9fe4a tempest-ServerGroup264TestJSON-1293063655 tempest-ServerGroup264TestJSON-1293063655-project] 10.222.0.42 "DELETE /compute/v2.1/os-server-groups/4aa9333b-4ed1-4f29-ab2e-354864f490eb" status: 404 len: 117 microversion: 2.64 time: 0.037220 Oct 23 01:47:41.268283 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3243/6385] 10.222.0.42 () {60 vars in 1307 bytes} [Sun Oct 23 01:47:41 2022] DELETE /compute/v2.1/os-server-groups/4aa9333b-4ed1-4f29-ab2e-354864f490eb => generated 117 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 23 01:47:41.571681 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a6b902ef-7623-4060-a042-72ac6828fa35 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e/action" status: 202 len: 0 microversion: 2.1 time: 5.751294 Oct 23 01:47:41.572419 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3143/6386] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:47:35 2022] POST /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e/action => generated 0 bytes in 5754 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:47:41.581756 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9585f903-eab5-4581-b018-6799a78d04f9 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:41.582649 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9585f903-eab5-4581-b018-6799a78d04f9 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 74513e84-5d69-4d3b-aeed-5f4a45b6317e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:47:41.590648 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9585f903-eab5-4581-b018-6799a78d04f9 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:41.591384 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9585f903-eab5-4581-b018-6799a78d04f9 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:41.591980 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9585f903-eab5-4581-b018-6799a78d04f9 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:41.592912 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9585f903-eab5-4581-b018-6799a78d04f9 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:41.593552 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9585f903-eab5-4581-b018-6799a78d04f9 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:41.594189 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9585f903-eab5-4581-b018-6799a78d04f9 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:41.935505 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9585f903-eab5-4581-b018-6799a78d04f9 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:47:41.958439 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9585f903-eab5-4581-b018-6799a78d04f9 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e" status: 200 len: 1695 microversion: 2.1 time: 0.380938 Oct 23 01:47:41.970009 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3244/6387] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:47:41 2022] GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e => generated 1695 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:47:43.001124 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6169fd6d-dc6a-41d4-8a8f-1af403284519 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:43.008681 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6169fd6d-dc6a-41d4-8a8f-1af403284519 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 74513e84-5d69-4d3b-aeed-5f4a45b6317e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:47:43.022872 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6169fd6d-dc6a-41d4-8a8f-1af403284519 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:43.023452 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6169fd6d-dc6a-41d4-8a8f-1af403284519 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:43.023890 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6169fd6d-dc6a-41d4-8a8f-1af403284519 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:43.024601 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6169fd6d-dc6a-41d4-8a8f-1af403284519 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:43.025056 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6169fd6d-dc6a-41d4-8a8f-1af403284519 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:43.026147 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6169fd6d-dc6a-41d4-8a8f-1af403284519 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:43.318784 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6169fd6d-dc6a-41d4-8a8f-1af403284519 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:47:43.328094 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6169fd6d-dc6a-41d4-8a8f-1af403284519 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e" status: 200 len: 1695 microversion: 2.1 time: 0.336338 Oct 23 01:47:43.328693 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3144/6388] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:47:42 2022] GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e => generated 1695 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:47:44.353104 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-469df704-6417-4f07-9329-a42405204371 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:44.362591 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-469df704-6417-4f07-9329-a42405204371 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 74513e84-5d69-4d3b-aeed-5f4a45b6317e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:47:44.376109 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-469df704-6417-4f07-9329-a42405204371 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:44.376866 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-469df704-6417-4f07-9329-a42405204371 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:44.377562 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-469df704-6417-4f07-9329-a42405204371 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:44.378509 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-469df704-6417-4f07-9329-a42405204371 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:44.379158 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-469df704-6417-4f07-9329-a42405204371 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:44.380181 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-469df704-6417-4f07-9329-a42405204371 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:44.582010 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-469df704-6417-4f07-9329-a42405204371 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:47:44.595746 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-469df704-6417-4f07-9329-a42405204371 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e" status: 200 len: 1695 microversion: 2.1 time: 0.246765 Oct 23 01:47:44.596717 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3245/6389] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:47:44 2022] GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e => generated 1695 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:47:45.628075 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d688b062-38f6-4b30-af9e-e38089ce992b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:45.632633 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d688b062-38f6-4b30-af9e-e38089ce992b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 74513e84-5d69-4d3b-aeed-5f4a45b6317e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:47:45.659281 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d688b062-38f6-4b30-af9e-e38089ce992b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:45.666919 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d688b062-38f6-4b30-af9e-e38089ce992b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:45.667466 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d688b062-38f6-4b30-af9e-e38089ce992b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:45.668550 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d688b062-38f6-4b30-af9e-e38089ce992b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:45.672754 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d688b062-38f6-4b30-af9e-e38089ce992b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:45.685340 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d688b062-38f6-4b30-af9e-e38089ce992b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:46.231470 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-3b82923a-a386-4e9f-8f71-62c7da0b2b5e req-a4aeddda-0e21-44d4-a51a-2f52d83651de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74513e84-5d69-4d3b-aeed-5f4a45b6317e", "name": "network-vif-unplugged", "status": "completed", "tag": "e6543d72-1e98-4648-a366-e7651509bade"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:47:46.250929 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-3b82923a-a386-4e9f-8f71-62c7da0b2b5e req-a4aeddda-0e21-44d4-a51a-2f52d83651de service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:46.251689 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-3b82923a-a386-4e9f-8f71-62c7da0b2b5e req-a4aeddda-0e21-44d4-a51a-2f52d83651de service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:46.252282 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-3b82923a-a386-4e9f-8f71-62c7da0b2b5e req-a4aeddda-0e21-44d4-a51a-2f52d83651de service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:46.269578 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-3b82923a-a386-4e9f-8f71-62c7da0b2b5e req-a4aeddda-0e21-44d4-a51a-2f52d83651de service nova] Creating event network-vif-unplugged:e6543d72-1e98-4648-a366-e7651509bade for instance 74513e84-5d69-4d3b-aeed-5f4a45b6317e on n-h1-master-1 Oct 23 01:47:46.301584 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-3b82923a-a386-4e9f-8f71-62c7da0b2b5e req-a4aeddda-0e21-44d4-a51a-2f52d83651de service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059007 Oct 23 01:47:46.304190 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3246/6390] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:47:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:47:46.318318 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d688b062-38f6-4b30-af9e-e38089ce992b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:47:46.339391 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d688b062-38f6-4b30-af9e-e38089ce992b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e" status: 200 len: 1695 microversion: 2.1 time: 0.716222 Oct 23 01:47:46.343194 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3145/6391] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:47:45 2022] GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e => generated 1695 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:47:47.384718 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-64cbd695-359b-4d1d-b915-dd19935213db tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:47.388475 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-64cbd695-359b-4d1d-b915-dd19935213db tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 74513e84-5d69-4d3b-aeed-5f4a45b6317e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:47:47.418931 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-64cbd695-359b-4d1d-b915-dd19935213db tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:47.422864 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-64cbd695-359b-4d1d-b915-dd19935213db tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:47.423531 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-64cbd695-359b-4d1d-b915-dd19935213db tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:47.424320 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-64cbd695-359b-4d1d-b915-dd19935213db tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:47.424783 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-64cbd695-359b-4d1d-b915-dd19935213db tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:47.425239 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-64cbd695-359b-4d1d-b915-dd19935213db tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:47.718095 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-64cbd695-359b-4d1d-b915-dd19935213db tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:47:47.726941 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-64cbd695-359b-4d1d-b915-dd19935213db tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e" status: 200 len: 1695 microversion: 2.1 time: 0.349408 Oct 23 01:47:47.760294 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3247/6392] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:47:47 2022] GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e => generated 1695 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:47:48.325194 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-c3bc5acf-f179-4eed-9e62-65df8b2fb187 req-c4dd90cc-f8cd-4d27-a054-40e869b8de90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74513e84-5d69-4d3b-aeed-5f4a45b6317e", "tag": "e6543d72-1e98-4648-a366-e7651509bade"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:47:48.335797 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-c3bc5acf-f179-4eed-9e62-65df8b2fb187 req-c4dd90cc-f8cd-4d27-a054-40e869b8de90 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:48.336574 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-c3bc5acf-f179-4eed-9e62-65df8b2fb187 req-c4dd90cc-f8cd-4d27-a054-40e869b8de90 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:48.337210 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-c3bc5acf-f179-4eed-9e62-65df8b2fb187 req-c4dd90cc-f8cd-4d27-a054-40e869b8de90 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:48.352890 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-c3bc5acf-f179-4eed-9e62-65df8b2fb187 req-c4dd90cc-f8cd-4d27-a054-40e869b8de90 service nova] Creating event network-changed:e6543d72-1e98-4648-a366-e7651509bade for instance 74513e84-5d69-4d3b-aeed-5f4a45b6317e on n-h1-master-1 Oct 23 01:47:48.359076 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-c3bc5acf-f179-4eed-9e62-65df8b2fb187 req-c4dd90cc-f8cd-4d27-a054-40e869b8de90 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037756 Oct 23 01:47:48.359642 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3146/6393] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:47:48.471983 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-87602763-b93b-4d6f-b2e5-08937a7f4b9f tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:48.472491 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-87602763-b93b-4d6f-b2e5-08937a7f4b9f tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] [instance: 56d08053-cd34-464a-ba73-ef113a24140d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:47:48.479977 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-87602763-b93b-4d6f-b2e5-08937a7f4b9f tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:48.480744 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-87602763-b93b-4d6f-b2e5-08937a7f4b9f tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:48.481358 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-87602763-b93b-4d6f-b2e5-08937a7f4b9f tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:48.482314 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-87602763-b93b-4d6f-b2e5-08937a7f4b9f tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:48.483002 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-87602763-b93b-4d6f-b2e5-08937a7f4b9f tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:48.483606 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-87602763-b93b-4d6f-b2e5-08937a7f4b9f tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:48.639695 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-87602763-b93b-4d6f-b2e5-08937a7f4b9f tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lazy-loading 'services' on Instance uuid 56d08053-cd34-464a-ba73-ef113a24140d {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:47:48.755426 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e6810acf-013d-44c3-b0ce-be9c04bacfae tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:48.758507 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e6810acf-013d-44c3-b0ce-be9c04bacfae tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 74513e84-5d69-4d3b-aeed-5f4a45b6317e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:47:48.768522 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6810acf-013d-44c3-b0ce-be9c04bacfae tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:48.770669 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6810acf-013d-44c3-b0ce-be9c04bacfae tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:48.771381 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6810acf-013d-44c3-b0ce-be9c04bacfae tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:48.775437 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6810acf-013d-44c3-b0ce-be9c04bacfae tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:48.775951 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6810acf-013d-44c3-b0ce-be9c04bacfae tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:48.776396 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6810acf-013d-44c3-b0ce-be9c04bacfae tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:48.991267 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e6810acf-013d-44c3-b0ce-be9c04bacfae tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:47:49.004694 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e6810acf-013d-44c3-b0ce-be9c04bacfae tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e" status: 200 len: 1695 microversion: 2.1 time: 0.252993 Oct 23 01:47:49.007246 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3147/6394] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:47:48 2022] GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e => generated 1695 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:47:49.023652 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-87602763-b93b-4d6f-b2e5-08937a7f4b9f tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] 10.222.0.42 "DELETE /compute/v2.1/servers/56d08053-cd34-464a-ba73-ef113a24140d/os-volume_attachments/eff2e89a-c498-423e-aab9-8cbcfffba742" status: 202 len: 0 microversion: 2.1 time: 0.539197 Oct 23 01:47:49.027868 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3248/6395] 10.222.0.42 () {58 vars in 1416 bytes} [Sun Oct 23 01:47:48 2022] DELETE /compute/v2.1/servers/56d08053-cd34-464a-ba73-ef113a24140d/os-volume_attachments/eff2e89a-c498-423e-aab9-8cbcfffba742 => generated 0 bytes in 560 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:47:50.035208 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6a670ac1-6f21-42f6-8a83-da71db5bb28d tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:50.037917 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6a670ac1-6f21-42f6-8a83-da71db5bb28d tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 74513e84-5d69-4d3b-aeed-5f4a45b6317e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:47:50.075016 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6a670ac1-6f21-42f6-8a83-da71db5bb28d tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:50.075892 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6a670ac1-6f21-42f6-8a83-da71db5bb28d tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:50.076918 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6a670ac1-6f21-42f6-8a83-da71db5bb28d tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:50.082780 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6a670ac1-6f21-42f6-8a83-da71db5bb28d tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:50.084319 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6a670ac1-6f21-42f6-8a83-da71db5bb28d tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:50.089803 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6a670ac1-6f21-42f6-8a83-da71db5bb28d tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:50.455713 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6a670ac1-6f21-42f6-8a83-da71db5bb28d tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:47:50.464820 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6a670ac1-6f21-42f6-8a83-da71db5bb28d tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e" status: 200 len: 1695 microversion: 2.1 time: 0.434158 Oct 23 01:47:50.465422 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3148/6396] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:47:50 2022] GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e => generated 1695 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:47:51.489872 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=8 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:47:51.496648 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4cb86169-33a6-4204-ab82-9ef380b73173 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:51.497573 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4cb86169-33a6-4204-ab82-9ef380b73173 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 74513e84-5d69-4d3b-aeed-5f4a45b6317e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:47:51.504862 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4cb86169-33a6-4204-ab82-9ef380b73173 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:51.505361 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4cb86169-33a6-4204-ab82-9ef380b73173 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:51.513278 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4cb86169-33a6-4204-ab82-9ef380b73173 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:51.513278 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4cb86169-33a6-4204-ab82-9ef380b73173 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:51.513278 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4cb86169-33a6-4204-ab82-9ef380b73173 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:51.513278 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4cb86169-33a6-4204-ab82-9ef380b73173 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:51.749803 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4cb86169-33a6-4204-ab82-9ef380b73173 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:47:51.759060 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4cb86169-33a6-4204-ab82-9ef380b73173 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e" status: 200 len: 1695 microversion: 2.1 time: 0.271841 Oct 23 01:47:51.767458 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3249/6397] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:47:51 2022] GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e => generated 1695 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:47:52.788497 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-977faa0d-ae19-4f9a-9cfc-e05e238f91bc tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:52.791909 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-977faa0d-ae19-4f9a-9cfc-e05e238f91bc tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 74513e84-5d69-4d3b-aeed-5f4a45b6317e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:47:52.807693 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-977faa0d-ae19-4f9a-9cfc-e05e238f91bc tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:52.808483 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-977faa0d-ae19-4f9a-9cfc-e05e238f91bc tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:52.809439 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-977faa0d-ae19-4f9a-9cfc-e05e238f91bc tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:52.810515 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-977faa0d-ae19-4f9a-9cfc-e05e238f91bc tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:52.824834 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-977faa0d-ae19-4f9a-9cfc-e05e238f91bc tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:52.825569 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-977faa0d-ae19-4f9a-9cfc-e05e238f91bc tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:53.242344 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-977faa0d-ae19-4f9a-9cfc-e05e238f91bc tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:47:53.251975 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-977faa0d-ae19-4f9a-9cfc-e05e238f91bc tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e" status: 200 len: 1695 microversion: 2.1 time: 0.468302 Oct 23 01:47:53.255734 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3149/6398] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:47:52 2022] GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e => generated 1695 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:47:54.284126 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ed99117a-c9da-4562-a2b4-11a02ed33cda tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:54.284759 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ed99117a-c9da-4562-a2b4-11a02ed33cda tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 74513e84-5d69-4d3b-aeed-5f4a45b6317e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:47:54.297009 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ed99117a-c9da-4562-a2b4-11a02ed33cda tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:54.297807 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ed99117a-c9da-4562-a2b4-11a02ed33cda tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:54.298471 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ed99117a-c9da-4562-a2b4-11a02ed33cda tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:54.299427 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ed99117a-c9da-4562-a2b4-11a02ed33cda tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:54.300271 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ed99117a-c9da-4562-a2b4-11a02ed33cda tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:54.300927 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ed99117a-c9da-4562-a2b4-11a02ed33cda tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:54.629716 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ed99117a-c9da-4562-a2b4-11a02ed33cda tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:47:54.654281 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ed99117a-c9da-4562-a2b4-11a02ed33cda tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e" status: 200 len: 1695 microversion: 2.1 time: 0.372342 Oct 23 01:47:54.656413 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3250/6399] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:47:54 2022] GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e => generated 1695 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:47:55.681229 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ab76d8f5-712f-435b-81ac-48584da880eb tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:55.691182 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ab76d8f5-712f-435b-81ac-48584da880eb tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 74513e84-5d69-4d3b-aeed-5f4a45b6317e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:47:55.715072 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ab76d8f5-712f-435b-81ac-48584da880eb tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:55.715580 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ab76d8f5-712f-435b-81ac-48584da880eb tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:55.716088 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ab76d8f5-712f-435b-81ac-48584da880eb tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:55.717248 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ab76d8f5-712f-435b-81ac-48584da880eb tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:55.717726 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ab76d8f5-712f-435b-81ac-48584da880eb tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:55.718189 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ab76d8f5-712f-435b-81ac-48584da880eb tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:55.915089 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6b3c6def-c587-4630-8646-49fa45dccc65 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:55.916246 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6b3c6def-c587-4630-8646-49fa45dccc65 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] [instance: 56d08053-cd34-464a-ba73-ef113a24140d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:47:55.924874 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b3c6def-c587-4630-8646-49fa45dccc65 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:55.925773 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b3c6def-c587-4630-8646-49fa45dccc65 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:55.926680 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b3c6def-c587-4630-8646-49fa45dccc65 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:55.931079 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b3c6def-c587-4630-8646-49fa45dccc65 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:55.931079 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b3c6def-c587-4630-8646-49fa45dccc65 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:55.931079 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b3c6def-c587-4630-8646-49fa45dccc65 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:55.974011 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6b3c6def-c587-4630-8646-49fa45dccc65 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] [instance: 56d08053-cd34-464a-ba73-ef113a24140d] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:47:56.040727 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ab76d8f5-712f-435b-81ac-48584da880eb tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:47:56.050053 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ab76d8f5-712f-435b-81ac-48584da880eb tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e" status: 200 len: 1695 microversion: 2.1 time: 0.374464 Oct 23 01:47:56.051196 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3150/6400] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:47:55 2022] GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e => generated 1695 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:47:56.381803 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6b3c6def-c587-4630-8646-49fa45dccc65 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] 10.222.0.42 "DELETE /compute/v2.1/servers/56d08053-cd34-464a-ba73-ef113a24140d" status: 204 len: 0 microversion: 2.1 time: 0.470486 Oct 23 01:47:56.388643 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3251/6401] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:47:55 2022] DELETE /compute/v2.1/servers/56d08053-cd34-464a-ba73-ef113a24140d => generated 0 bytes in 478 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:47:56.396877 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d06fab7b-4b14-4417-b9aa-77362a507784 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:56.397502 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d06fab7b-4b14-4417-b9aa-77362a507784 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] [instance: 56d08053-cd34-464a-ba73-ef113a24140d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:47:56.408488 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d06fab7b-4b14-4417-b9aa-77362a507784 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:56.408998 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d06fab7b-4b14-4417-b9aa-77362a507784 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:56.409436 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d06fab7b-4b14-4417-b9aa-77362a507784 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:56.410190 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d06fab7b-4b14-4417-b9aa-77362a507784 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:56.410836 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d06fab7b-4b14-4417-b9aa-77362a507784 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:56.411071 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d06fab7b-4b14-4417-b9aa-77362a507784 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:56.563774 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d06fab7b-4b14-4417-b9aa-77362a507784 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2630e3eda1df4f698cad1eda511ad76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e64fd5446d541da9d10af97a24ea037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:47:56.574004 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d06fab7b-4b14-4417-b9aa-77362a507784 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] 10.222.0.42 "GET /compute/v2.1/servers/56d08053-cd34-464a-ba73-ef113a24140d" status: 200 len: 1512 microversion: 2.1 time: 0.181042 Oct 23 01:47:56.574852 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3151/6402] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:47:56 2022] GET /compute/v2.1/servers/56d08053-cd34-464a-ba73-ef113a24140d => generated 1512 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:47:57.076735 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1c91b6e0-1b65-44e3-91ea-3b87227dd092 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:57.078180 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1c91b6e0-1b65-44e3-91ea-3b87227dd092 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 74513e84-5d69-4d3b-aeed-5f4a45b6317e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:47:57.086841 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1c91b6e0-1b65-44e3-91ea-3b87227dd092 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:57.090360 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1c91b6e0-1b65-44e3-91ea-3b87227dd092 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:57.094314 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1c91b6e0-1b65-44e3-91ea-3b87227dd092 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:57.094314 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1c91b6e0-1b65-44e3-91ea-3b87227dd092 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:57.094314 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1c91b6e0-1b65-44e3-91ea-3b87227dd092 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:57.094314 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1c91b6e0-1b65-44e3-91ea-3b87227dd092 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:57.384262 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1c91b6e0-1b65-44e3-91ea-3b87227dd092 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:47:57.414295 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1c91b6e0-1b65-44e3-91ea-3b87227dd092 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e" status: 200 len: 1695 microversion: 2.1 time: 0.342828 Oct 23 01:47:57.417733 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3252/6403] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:47:57 2022] GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e => generated 1695 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:47:57.599104 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3eb1e86e-f5ca-4840-ae36-2474a9d2411e tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:57.599697 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3eb1e86e-f5ca-4840-ae36-2474a9d2411e tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] [instance: 56d08053-cd34-464a-ba73-ef113a24140d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:47:57.612874 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3eb1e86e-f5ca-4840-ae36-2474a9d2411e tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:57.613372 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3eb1e86e-f5ca-4840-ae36-2474a9d2411e tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:57.613816 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3eb1e86e-f5ca-4840-ae36-2474a9d2411e tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:57.617118 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3eb1e86e-f5ca-4840-ae36-2474a9d2411e tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:57.618812 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3eb1e86e-f5ca-4840-ae36-2474a9d2411e tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:57.619580 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3eb1e86e-f5ca-4840-ae36-2474a9d2411e tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:57.820327 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3eb1e86e-f5ca-4840-ae36-2474a9d2411e tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2630e3eda1df4f698cad1eda511ad76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e64fd5446d541da9d10af97a24ea037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:47:57.831066 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3eb1e86e-f5ca-4840-ae36-2474a9d2411e tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] 10.222.0.42 "GET /compute/v2.1/servers/56d08053-cd34-464a-ba73-ef113a24140d" status: 200 len: 1512 microversion: 2.1 time: 0.236295 Oct 23 01:47:57.831669 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3152/6404] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:47:57 2022] GET /compute/v2.1/servers/56d08053-cd34-464a-ba73-ef113a24140d => generated 1512 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:47:58.442935 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c708d8a6-4b1b-4213-ad44-ec88041ba826 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:58.443781 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c708d8a6-4b1b-4213-ad44-ec88041ba826 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 74513e84-5d69-4d3b-aeed-5f4a45b6317e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:47:58.456781 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c708d8a6-4b1b-4213-ad44-ec88041ba826 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:58.457280 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c708d8a6-4b1b-4213-ad44-ec88041ba826 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:58.457725 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c708d8a6-4b1b-4213-ad44-ec88041ba826 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:58.458454 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c708d8a6-4b1b-4213-ad44-ec88041ba826 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:58.458913 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c708d8a6-4b1b-4213-ad44-ec88041ba826 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:58.459339 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c708d8a6-4b1b-4213-ad44-ec88041ba826 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:58.856153 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7b55fbff-01f0-4a51-9066-d41edd04a3c1 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:47:58.856770 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7b55fbff-01f0-4a51-9066-d41edd04a3c1 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] [instance: 56d08053-cd34-464a-ba73-ef113a24140d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:47:58.864295 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b55fbff-01f0-4a51-9066-d41edd04a3c1 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:58.865018 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b55fbff-01f0-4a51-9066-d41edd04a3c1 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:58.865602 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b55fbff-01f0-4a51-9066-d41edd04a3c1 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:58.866483 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b55fbff-01f0-4a51-9066-d41edd04a3c1 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:47:58.867084 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b55fbff-01f0-4a51-9066-d41edd04a3c1 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:47:58.867661 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b55fbff-01f0-4a51-9066-d41edd04a3c1 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:47:59.167076 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c708d8a6-4b1b-4213-ad44-ec88041ba826 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:47:59.175225 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c708d8a6-4b1b-4213-ad44-ec88041ba826 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e" status: 200 len: 1695 microversion: 2.1 time: 0.737266 Oct 23 01:47:59.176014 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3253/6405] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:47:58 2022] GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e => generated 1695 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:47:59.220621 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7b55fbff-01f0-4a51-9066-d41edd04a3c1 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2630e3eda1df4f698cad1eda511ad76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e64fd5446d541da9d10af97a24ea037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:47:59.228343 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7b55fbff-01f0-4a51-9066-d41edd04a3c1 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] 10.222.0.42 "GET /compute/v2.1/servers/56d08053-cd34-464a-ba73-ef113a24140d" status: 200 len: 1512 microversion: 2.1 time: 0.376162 Oct 23 01:47:59.228919 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3153/6406] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:47:58 2022] GET /compute/v2.1/servers/56d08053-cd34-464a-ba73-ef113a24140d => generated 1512 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:48:00.202271 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4069d437-dafd-462c-a1f6-1164cc5588cd tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:00.203100 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4069d437-dafd-462c-a1f6-1164cc5588cd tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 74513e84-5d69-4d3b-aeed-5f4a45b6317e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:00.223910 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4069d437-dafd-462c-a1f6-1164cc5588cd tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:00.226740 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4069d437-dafd-462c-a1f6-1164cc5588cd tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:00.228200 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4069d437-dafd-462c-a1f6-1164cc5588cd tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:00.238078 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4069d437-dafd-462c-a1f6-1164cc5588cd tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:00.238078 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4069d437-dafd-462c-a1f6-1164cc5588cd tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:00.238078 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4069d437-dafd-462c-a1f6-1164cc5588cd tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:00.252825 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0ea41eed-d2c5-4c58-9c4c-845068438c6c tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:00.253456 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0ea41eed-d2c5-4c58-9c4c-845068438c6c tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] [instance: 56d08053-cd34-464a-ba73-ef113a24140d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:00.266025 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0ea41eed-d2c5-4c58-9c4c-845068438c6c tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:00.266546 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0ea41eed-d2c5-4c58-9c4c-845068438c6c tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:00.266971 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0ea41eed-d2c5-4c58-9c4c-845068438c6c tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:00.267679 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0ea41eed-d2c5-4c58-9c4c-845068438c6c tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:00.272961 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0ea41eed-d2c5-4c58-9c4c-845068438c6c tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:00.273726 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0ea41eed-d2c5-4c58-9c4c-845068438c6c tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:00.482158 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0ea41eed-d2c5-4c58-9c4c-845068438c6c tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2630e3eda1df4f698cad1eda511ad76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e64fd5446d541da9d10af97a24ea037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:00.515927 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0ea41eed-d2c5-4c58-9c4c-845068438c6c tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] 10.222.0.42 "GET /compute/v2.1/servers/56d08053-cd34-464a-ba73-ef113a24140d" status: 200 len: 1470 microversion: 2.1 time: 0.268438 Oct 23 01:48:00.523863 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3154/6407] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:00 2022] GET /compute/v2.1/servers/56d08053-cd34-464a-ba73-ef113a24140d => generated 1470 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:48:00.537947 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-b8ae7aab-ea97-4708-bf13-2d4613da1550 req-f73186c6-780d-49b5-a749-53f8fd338c53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56d08053-cd34-464a-ba73-ef113a24140d", "name": "network-vif-deleted", "tag": "cef38fc4-7dde-4470-8321-82f548b4d443"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:48:00.579569 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-b8ae7aab-ea97-4708-bf13-2d4613da1550 req-f73186c6-780d-49b5-a749-53f8fd338c53 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:00.579920 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-b8ae7aab-ea97-4708-bf13-2d4613da1550 req-f73186c6-780d-49b5-a749-53f8fd338c53 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:00.580355 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-b8ae7aab-ea97-4708-bf13-2d4613da1550 req-f73186c6-780d-49b5-a749-53f8fd338c53 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:00.619295 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-b8ae7aab-ea97-4708-bf13-2d4613da1550 req-f73186c6-780d-49b5-a749-53f8fd338c53 service nova] Creating event network-vif-deleted:cef38fc4-7dde-4470-8321-82f548b4d443 for instance 56d08053-cd34-464a-ba73-ef113a24140d on n-h2-master-1 Oct 23 01:48:00.630271 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-b8ae7aab-ea97-4708-bf13-2d4613da1550 req-f73186c6-780d-49b5-a749-53f8fd338c53 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104818 Oct 23 01:48:00.634322 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3155/6408] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:48:00.789707 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4069d437-dafd-462c-a1f6-1164cc5588cd tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:00.805701 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4069d437-dafd-462c-a1f6-1164cc5588cd tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e" status: 200 len: 1685 microversion: 2.1 time: 0.609967 Oct 23 01:48:00.806349 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3254/6409] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:00 2022] GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e => generated 1685 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:48:00.839940 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b471282a-8376-42df-b9dc-386b24034de2 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:00.840756 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b471282a-8376-42df-b9dc-386b24034de2 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] [instance: 74513e84-5d69-4d3b-aeed-5f4a45b6317e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:00.847955 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b471282a-8376-42df-b9dc-386b24034de2 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:00.848474 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b471282a-8376-42df-b9dc-386b24034de2 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:00.848962 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b471282a-8376-42df-b9dc-386b24034de2 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:00.849959 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b471282a-8376-42df-b9dc-386b24034de2 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:00.850604 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b471282a-8376-42df-b9dc-386b24034de2 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:00.851894 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b471282a-8376-42df-b9dc-386b24034de2 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:00.872872 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:01.417767 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b471282a-8376-42df-b9dc-386b24034de2 tempest-TestNetworkAdvancedServerOps-1860289430 tempest-TestNetworkAdvancedServerOps-1860289430-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e" status: 200 len: 1836 microversion: 2.1 time: 0.571387 Oct 23 01:48:01.422080 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3156/6410] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:00 2022] GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e => generated 1836 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:48:01.457431 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a2f0180b-6836-4882-8e27-2bb1dd20b63e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:01.459279 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a2f0180b-6836-4882-8e27-2bb1dd20b63e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 74513e84-5d69-4d3b-aeed-5f4a45b6317e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:01.469062 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a2f0180b-6836-4882-8e27-2bb1dd20b63e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:01.469889 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a2f0180b-6836-4882-8e27-2bb1dd20b63e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:01.470579 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a2f0180b-6836-4882-8e27-2bb1dd20b63e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:01.471504 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a2f0180b-6836-4882-8e27-2bb1dd20b63e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:01.472273 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a2f0180b-6836-4882-8e27-2bb1dd20b63e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:01.474611 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a2f0180b-6836-4882-8e27-2bb1dd20b63e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:01.550626 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f67d3a76-7a86-4406-ae80-9b6cb75eb7d5 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:01.551151 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f67d3a76-7a86-4406-ae80-9b6cb75eb7d5 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] [instance: 56d08053-cd34-464a-ba73-ef113a24140d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:01.569663 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f67d3a76-7a86-4406-ae80-9b6cb75eb7d5 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:01.571509 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f67d3a76-7a86-4406-ae80-9b6cb75eb7d5 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:01.571774 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f67d3a76-7a86-4406-ae80-9b6cb75eb7d5 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:01.574847 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f67d3a76-7a86-4406-ae80-9b6cb75eb7d5 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:01.578201 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f67d3a76-7a86-4406-ae80-9b6cb75eb7d5 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:01.578683 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f67d3a76-7a86-4406-ae80-9b6cb75eb7d5 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:01.700330 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f67d3a76-7a86-4406-ae80-9b6cb75eb7d5 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:01.716875 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f67d3a76-7a86-4406-ae80-9b6cb75eb7d5 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:01.718298 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f67d3a76-7a86-4406-ae80-9b6cb75eb7d5 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:01.721265 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-f67d3a76-7a86-4406-ae80-9b6cb75eb7d5 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lazy-loading 'fault' on Instance uuid 56d08053-cd34-464a-ba73-ef113a24140d {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:48:01.940350 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f67d3a76-7a86-4406-ae80-9b6cb75eb7d5 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2630e3eda1df4f698cad1eda511ad76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e64fd5446d541da9d10af97a24ea037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:01.958696 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f67d3a76-7a86-4406-ae80-9b6cb75eb7d5 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] 10.222.0.42 "GET /compute/v2.1/servers/56d08053-cd34-464a-ba73-ef113a24140d" status: 200 len: 1308 microversion: 2.1 time: 0.403736 Oct 23 01:48:01.962112 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3157/6411] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:01 2022] GET /compute/v2.1/servers/56d08053-cd34-464a-ba73-ef113a24140d => generated 1308 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:48:02.011538 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a2f0180b-6836-4882-8e27-2bb1dd20b63e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:02.036318 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:02.044523 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a2f0180b-6836-4882-8e27-2bb1dd20b63e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e" status: 200 len: 1685 microversion: 2.1 time: 0.591567 Oct 23 01:48:02.046967 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3255/6412] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:01 2022] GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e => generated 1685 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:48:02.246337 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bb0d203d-d6e0-44ec-a9af-7c7ebee5d183 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:48:02.249929 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-bb0d203d-d6e0-44ec-a9af-7c7ebee5d183 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 74513e84-5d69-4d3b-aeed-5f4a45b6317e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:02.289125 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bb0d203d-d6e0-44ec-a9af-7c7ebee5d183 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:02.289939 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bb0d203d-d6e0-44ec-a9af-7c7ebee5d183 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:02.292361 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bb0d203d-d6e0-44ec-a9af-7c7ebee5d183 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:02.295467 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bb0d203d-d6e0-44ec-a9af-7c7ebee5d183 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:02.297707 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bb0d203d-d6e0-44ec-a9af-7c7ebee5d183 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:02.298359 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bb0d203d-d6e0-44ec-a9af-7c7ebee5d183 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:02.443672 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bb0d203d-d6e0-44ec-a9af-7c7ebee5d183 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "POST /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e/action" status: 200 len: 38620 microversion: 2.1 time: 0.204493 Oct 23 01:48:02.446052 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3158/6413] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:48:02 2022] POST /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e/action => generated 38620 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:48:02.988028 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9a302296-f9dd-4f9a-ae57-68253c971bda tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:02.988598 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9a302296-f9dd-4f9a-ae57-68253c971bda tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] [instance: 56d08053-cd34-464a-ba73-ef113a24140d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:03.015088 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9a302296-f9dd-4f9a-ae57-68253c971bda tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:03.015866 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9a302296-f9dd-4f9a-ae57-68253c971bda tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:03.019245 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9a302296-f9dd-4f9a-ae57-68253c971bda tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:03.033115 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9a302296-f9dd-4f9a-ae57-68253c971bda tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:03.033536 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9a302296-f9dd-4f9a-ae57-68253c971bda tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:03.036324 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9a302296-f9dd-4f9a-ae57-68253c971bda tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:03.079205 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-9a302296-f9dd-4f9a-ae57-68253c971bda tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] HTTP exception thrown: Instance 56d08053-cd34-464a-ba73-ef113a24140d could not be found. Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9a302296-f9dd-4f9a-ae57-68253c971bda tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Request method failure captured: Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/56d08053-cd34-464a-ba73-ef113a24140d HTTP/1.1 Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJxhs_L4DmDeHIMP1SI3XdqhiKg-Dq-fRILyy1xjkV9srg-xe-2rVhAoTTiJJUpCRh8ER3JIyfnK4vNIX_NUTws0pTfFbA6XX5jhDaivEZxseQWiIY1TirY-XvhydCxNxLKNV7Pt5A1EV2vWdu7DsFmlN9Tvq_zDdNbKl-QEW9jzvKs Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 7e64fd5446d541da9d10af97a24ea037 Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2010952756 Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7e64fd5446d541da9d10af97a24ea037"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7e64fd5446d541da9d10af97a24ea037"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7e64fd5446d541da9d10af97a24ea037"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7e64fd5446d541da9d10af97a24ea037"}]}] Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-VolumesSnapshotTestJSON-2010952756 Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 7e64fd5446d541da9d10af97a24ea037 Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2010952756 Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-VolumesSnapshotTestJSON-2010952756-project Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 2630e3eda1df4f698cad1eda511ad76a Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-VolumesSnapshotTestJSON-2010952756-project Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 56d08053-cd34-464a-ba73-ef113a24140d could not be found. Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '56d08053-cd34-464a-ba73-ef113a24140d'} Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56d08053-cd34-464a-ba73-ef113a24140d could not be found. Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56d08053-cd34-464a-ba73-ef113a24140d could not be found. Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:48:03.086165 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:48:03.249649 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:48:03.249649 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:48:03.249649 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:48:03.249649 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:48:03.249649 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:48:03.249649 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56d08053-cd34-464a-ba73-ef113a24140d could not be found. Oct 23 01:48:03.249649 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:48:03.249649 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9a302296-f9dd-4f9a-ae57-68253c971bda tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Returning 404 to user: Instance 56d08053-cd34-464a-ba73-ef113a24140d could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:48:03.249649 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9a302296-f9dd-4f9a-ae57-68253c971bda tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] 10.222.0.42 "GET /compute/v2.1/servers/56d08053-cd34-464a-ba73-ef113a24140d" status: 404 len: 111 microversion: 2.1 time: 0.107064 Oct 23 01:48:03.249649 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3256/6414] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:02 2022] GET /compute/v2.1/servers/56d08053-cd34-464a-ba73-ef113a24140d => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:48:04.852128 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e3a283e4-c93c-4de3-8e2a-178b6e516b1c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:04.852723 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e3a283e4-c93c-4de3-8e2a-178b6e516b1c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 74513e84-5d69-4d3b-aeed-5f4a45b6317e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:04.868394 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e3a283e4-c93c-4de3-8e2a-178b6e516b1c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:04.868895 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e3a283e4-c93c-4de3-8e2a-178b6e516b1c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:04.869333 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e3a283e4-c93c-4de3-8e2a-178b6e516b1c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:04.880889 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e3a283e4-c93c-4de3-8e2a-178b6e516b1c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:04.881316 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-b90364d1-43ba-4425-9d90-b687f116a576 req-2b4a60ee-8b66-4fea-af77-f0c3936a4a7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74513e84-5d69-4d3b-aeed-5f4a45b6317e", "tag": "e6543d72-1e98-4648-a366-e7651509bade"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:48:04.881768 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e3a283e4-c93c-4de3-8e2a-178b6e516b1c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:04.881768 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e3a283e4-c93c-4de3-8e2a-178b6e516b1c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:04.888493 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=2,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:04.909097 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-b90364d1-43ba-4425-9d90-b687f116a576 req-2b4a60ee-8b66-4fea-af77-f0c3936a4a7b service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:04.911165 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-b90364d1-43ba-4425-9d90-b687f116a576 req-2b4a60ee-8b66-4fea-af77-f0c3936a4a7b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:04.924994 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-b90364d1-43ba-4425-9d90-b687f116a576 req-2b4a60ee-8b66-4fea-af77-f0c3936a4a7b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:04.937272 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-b90364d1-43ba-4425-9d90-b687f116a576 req-2b4a60ee-8b66-4fea-af77-f0c3936a4a7b service nova] Creating event network-changed:e6543d72-1e98-4648-a366-e7651509bade for instance 74513e84-5d69-4d3b-aeed-5f4a45b6317e on n-h2-master-1 Oct 23 01:48:04.969502 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e3a283e4-c93c-4de3-8e2a-178b6e516b1c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 74513e84-5d69-4d3b-aeed-5f4a45b6317e] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:48:04.980356 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-b90364d1-43ba-4425-9d90-b687f116a576 req-2b4a60ee-8b66-4fea-af77-f0c3936a4a7b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114458 Oct 23 01:48:04.981040 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3257/6415] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:48:05.543939 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e3a283e4-c93c-4de3-8e2a-178b6e516b1c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "DELETE /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e" status: 204 len: 0 microversion: 2.1 time: 0.696650 Oct 23 01:48:05.544873 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3159/6416] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:48:04 2022] DELETE /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e => generated 0 bytes in 698 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:48:05.557029 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-73430eca-028d-48fa-962c-e2ae21f80147 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:05.557781 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-73430eca-028d-48fa-962c-e2ae21f80147 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 74513e84-5d69-4d3b-aeed-5f4a45b6317e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:05.575992 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-73430eca-028d-48fa-962c-e2ae21f80147 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:05.576505 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-73430eca-028d-48fa-962c-e2ae21f80147 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:05.576956 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-73430eca-028d-48fa-962c-e2ae21f80147 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:05.577679 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-73430eca-028d-48fa-962c-e2ae21f80147 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:05.578199 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-73430eca-028d-48fa-962c-e2ae21f80147 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:05.578643 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-73430eca-028d-48fa-962c-e2ae21f80147 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:06.263320 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-73430eca-028d-48fa-962c-e2ae21f80147 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:06.273593 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-73430eca-028d-48fa-962c-e2ae21f80147 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e" status: 200 len: 1691 microversion: 2.1 time: 0.723586 Oct 23 01:48:06.279340 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3258/6417] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:05 2022] GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e => generated 1691 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:48:07.301718 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-75cafcde-8661-41fe-9599-5bb8799bf25f tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:07.303078 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-75cafcde-8661-41fe-9599-5bb8799bf25f tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 74513e84-5d69-4d3b-aeed-5f4a45b6317e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:07.324236 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:07.328296 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-75cafcde-8661-41fe-9599-5bb8799bf25f tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:07.328296 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-75cafcde-8661-41fe-9599-5bb8799bf25f tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:07.328296 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-75cafcde-8661-41fe-9599-5bb8799bf25f tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:07.328296 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-75cafcde-8661-41fe-9599-5bb8799bf25f tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:07.328296 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-75cafcde-8661-41fe-9599-5bb8799bf25f tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:07.329165 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-75cafcde-8661-41fe-9599-5bb8799bf25f tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:07.934793 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-75cafcde-8661-41fe-9599-5bb8799bf25f tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:07.942866 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-75cafcde-8661-41fe-9599-5bb8799bf25f tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e" status: 200 len: 1691 microversion: 2.1 time: 0.645346 Oct 23 01:48:07.943459 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3160/6418] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:07 2022] GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e => generated 1691 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:48:08.233289 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-6d59cce7-a32c-4c4d-8e84-8a47e2c56ea4 req-b702ba84-6834-429d-b09e-541b0ce2ef50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74513e84-5d69-4d3b-aeed-5f4a45b6317e", "name": "network-vif-deleted", "tag": "e6543d72-1e98-4648-a366-e7651509bade"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:48:08.250723 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-6d59cce7-a32c-4c4d-8e84-8a47e2c56ea4 req-b702ba84-6834-429d-b09e-541b0ce2ef50 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:08.251214 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-6d59cce7-a32c-4c4d-8e84-8a47e2c56ea4 req-b702ba84-6834-429d-b09e-541b0ce2ef50 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:08.251641 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-6d59cce7-a32c-4c4d-8e84-8a47e2c56ea4 req-b702ba84-6834-429d-b09e-541b0ce2ef50 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:08.289402 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-6d59cce7-a32c-4c4d-8e84-8a47e2c56ea4 req-b702ba84-6834-429d-b09e-541b0ce2ef50 service nova] Creating event network-vif-deleted:e6543d72-1e98-4648-a366-e7651509bade for instance 74513e84-5d69-4d3b-aeed-5f4a45b6317e on n-h2-master-1 Oct 23 01:48:08.298175 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-6d59cce7-a32c-4c4d-8e84-8a47e2c56ea4 req-b702ba84-6834-429d-b09e-541b0ce2ef50 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068717 Oct 23 01:48:08.299007 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3259/6419] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:48:08.974466 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-671a38c5-0fd3-4e58-9322-0a16f4d74075 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:08.975660 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-671a38c5-0fd3-4e58-9322-0a16f4d74075 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 74513e84-5d69-4d3b-aeed-5f4a45b6317e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:08.989678 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-671a38c5-0fd3-4e58-9322-0a16f4d74075 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:08.994367 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-671a38c5-0fd3-4e58-9322-0a16f4d74075 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:08.995169 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-671a38c5-0fd3-4e58-9322-0a16f4d74075 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:08.996293 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-671a38c5-0fd3-4e58-9322-0a16f4d74075 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:09.000562 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-671a38c5-0fd3-4e58-9322-0a16f4d74075 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:09.000562 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-671a38c5-0fd3-4e58-9322-0a16f4d74075 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:09.067280 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-671a38c5-0fd3-4e58-9322-0a16f4d74075 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:09.070600 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-671a38c5-0fd3-4e58-9322-0a16f4d74075 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:09.071326 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-671a38c5-0fd3-4e58-9322-0a16f4d74075 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:09.072045 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-671a38c5-0fd3-4e58-9322-0a16f4d74075 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lazy-loading 'fault' on Instance uuid 74513e84-5d69-4d3b-aeed-5f4a45b6317e {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:48:09.211192 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-671a38c5-0fd3-4e58-9322-0a16f4d74075 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:09.235768 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-671a38c5-0fd3-4e58-9322-0a16f4d74075 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e" status: 200 len: 1357 microversion: 2.1 time: 0.265543 Oct 23 01:48:09.236383 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3161/6420] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:08 2022] GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e => generated 1357 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:48:10.265677 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-133a00cc-eb7a-4eb4-b1ae-7a2c92f0d99a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:10.266605 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-133a00cc-eb7a-4eb4-b1ae-7a2c92f0d99a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 74513e84-5d69-4d3b-aeed-5f4a45b6317e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:10.282719 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-133a00cc-eb7a-4eb4-b1ae-7a2c92f0d99a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:10.283373 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-133a00cc-eb7a-4eb4-b1ae-7a2c92f0d99a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:10.286606 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-133a00cc-eb7a-4eb4-b1ae-7a2c92f0d99a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:10.287520 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-133a00cc-eb7a-4eb4-b1ae-7a2c92f0d99a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:10.288119 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-133a00cc-eb7a-4eb4-b1ae-7a2c92f0d99a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:10.288665 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-133a00cc-eb7a-4eb4-b1ae-7a2c92f0d99a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:10.333562 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-133a00cc-eb7a-4eb4-b1ae-7a2c92f0d99a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] HTTP exception thrown: Instance 74513e84-5d69-4d3b-aeed-5f4a45b6317e could not be found. Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-133a00cc-eb7a-4eb4-b1ae-7a2c92f0d99a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Request method failure captured: Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e HTTP/1.1 Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJup1TkLYyR4X_VSgIMIuQv0hYOz5hZ00J3cGF_2O4wHY26fogeH_hyoq33KQnC7sGTAyVlSot7AI095PrC5yb0EkSKzvICR_X35mdfKcclD_xEhLj-4l-9yI3Uz12kHgYqfGCiZb_uaRrbVi38t5LJjIbY00U1LXQx5VmGP9DMKFZ0 Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 0c7f734a12da437e806e4c791d27d615 Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-878522496 Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/0c7f734a12da437e806e4c791d27d615"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_0c7f734a12da437e806e4c791d27d615"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0c7f734a12da437e806e4c791d27d615"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0c7f734a12da437e806e4c791d27d615"}]}] Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-TestNetworkAdvancedServerOps-878522496 Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 0c7f734a12da437e806e4c791d27d615 Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-878522496 Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-TestNetworkAdvancedServerOps-878522496-project Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 037ed342980a4de9a2dfc8d576293aba Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-TestNetworkAdvancedServerOps-878522496-project Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 74513e84-5d69-4d3b-aeed-5f4a45b6317e could not be found. Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '74513e84-5d69-4d3b-aeed-5f4a45b6317e'} Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74513e84-5d69-4d3b-aeed-5f4a45b6317e could not be found. Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74513e84-5d69-4d3b-aeed-5f4a45b6317e could not be found. Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:48:10.339225 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:48:10.343671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:48:10.343671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:48:10.343671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:48:10.343671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:48:10.343671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:48:10.343671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:48:10.343671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74513e84-5d69-4d3b-aeed-5f4a45b6317e could not be found. Oct 23 01:48:10.343671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:48:10.348512 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-133a00cc-eb7a-4eb4-b1ae-7a2c92f0d99a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Returning 404 to user: Instance 74513e84-5d69-4d3b-aeed-5f4a45b6317e could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:48:10.349594 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-133a00cc-eb7a-4eb4-b1ae-7a2c92f0d99a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e" status: 404 len: 111 microversion: 2.1 time: 0.089486 Oct 23 01:48:10.350356 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3260/6421] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:10 2022] GET /compute/v2.1/servers/74513e84-5d69-4d3b-aeed-5f4a45b6317e => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:48:17.475325 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4ed83215-3594-4d87-9f4d-47bcc3bd512b tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1636055223", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:48:17.638955 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-4ed83215-3594-4d87-9f4d-47bcc3bd512b tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] validate_networks() for None {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:48:18.441766 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-af7dfa32-a4f1-42cd-82e0-c2add39ec809 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1147429134", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "4267c63d-19e1-47bc-b372-e7b59e0af6d2"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:48:18.592517 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-af7dfa32-a4f1-42cd-82e0-c2add39ec809 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] validate_networks() for [('4267c63d-19e1-47bc-b372-e7b59e0af6d2', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:48:18.775445 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-4ed83215-3594-4d87-9f4d-47bcc3bd512b tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:48:18.775881 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-4ed83215-3594-4d87-9f4d-47bcc3bd512b tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:48:18.776334 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-4ed83215-3594-4d87-9f4d-47bcc3bd512b tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:48:18.776778 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-4ed83215-3594-4d87-9f4d-47bcc3bd512b tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:48:18.777199 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-4ed83215-3594-4d87-9f4d-47bcc3bd512b tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:48:18.795700 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4ed83215-3594-4d87-9f4d-47bcc3bd512b tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:18.796195 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4ed83215-3594-4d87-9f4d-47bcc3bd512b tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:18.796631 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4ed83215-3594-4d87-9f4d-47bcc3bd512b tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:18.797626 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4ed83215-3594-4d87-9f4d-47bcc3bd512b tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:18.798118 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4ed83215-3594-4d87-9f4d-47bcc3bd512b tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:18.798545 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4ed83215-3594-4d87-9f4d-47bcc3bd512b tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:18.848805 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-4ed83215-3594-4d87-9f4d-47bcc3bd512b tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Getting quotas for project cddd64f7c80a4e869e77648648102c6d. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:48:18.859903 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-4ed83215-3594-4d87-9f4d-47bcc3bd512b tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Getting quotas for user b4039f0940ed4cb2a3f5de1ba80c2d15 and project cddd64f7c80a4e869e77648648102c6d. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:48:18.879045 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4ed83215-3594-4d87-9f4d-47bcc3bd512b tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:48:18.882332 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4ed83215-3594-4d87-9f4d-47bcc3bd512b tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] [instance: f8d253e4-979f-4be7-ac3e-51f935ac99e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:48:19.054166 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4ed83215-3594-4d87-9f4d-47bcc3bd512b tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.574060 Oct 23 01:48:19.055672 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3162/6422] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:48:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:48:19.066848 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bd759aa0-bd14-47ea-a239-76fed5543626 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:19.067708 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-bd759aa0-bd14-47ea-a239-76fed5543626 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] [instance: f8d253e4-979f-4be7-ac3e-51f935ac99e9] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:19.339892 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bd759aa0-bd14-47ea-a239-76fed5543626 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4039f0940ed4cb2a3f5de1ba80c2d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddd64f7c80a4e869e77648648102c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:19.356841 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bd759aa0-bd14-47ea-a239-76fed5543626 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] 10.222.0.42 "GET /compute/v2.1/servers/f8d253e4-979f-4be7-ac3e-51f935ac99e9" status: 200 len: 1215 microversion: 2.1 time: 0.293759 Oct 23 01:48:19.362880 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3163/6423] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:19 2022] GET /compute/v2.1/servers/f8d253e4-979f-4be7-ac3e-51f935ac99e9 => generated 1215 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:48:20.209526 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-af7dfa32-a4f1-42cd-82e0-c2add39ec809 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:48:20.210650 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-af7dfa32-a4f1-42cd-82e0-c2add39ec809 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:48:20.211297 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-af7dfa32-a4f1-42cd-82e0-c2add39ec809 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:48:20.211862 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-af7dfa32-a4f1-42cd-82e0-c2add39ec809 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:48:20.212512 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-af7dfa32-a4f1-42cd-82e0-c2add39ec809 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:48:20.226108 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-af7dfa32-a4f1-42cd-82e0-c2add39ec809 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:20.226937 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-af7dfa32-a4f1-42cd-82e0-c2add39ec809 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:20.227876 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-af7dfa32-a4f1-42cd-82e0-c2add39ec809 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:20.228881 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-af7dfa32-a4f1-42cd-82e0-c2add39ec809 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:20.230107 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-af7dfa32-a4f1-42cd-82e0-c2add39ec809 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:20.237377 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-af7dfa32-a4f1-42cd-82e0-c2add39ec809 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:20.259005 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-af7dfa32-a4f1-42cd-82e0-c2add39ec809 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Getting quotas for project 7e64fd5446d541da9d10af97a24ea037. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:48:20.266298 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-af7dfa32-a4f1-42cd-82e0-c2add39ec809 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Getting quotas for user 2630e3eda1df4f698cad1eda511ad76a and project 7e64fd5446d541da9d10af97a24ea037. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:48:20.282693 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-af7dfa32-a4f1-42cd-82e0-c2add39ec809 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:48:20.292998 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-af7dfa32-a4f1-42cd-82e0-c2add39ec809 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] [instance: 3e32a61e-2dd1-458a-bced-55e7d351a60c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:48:20.384373 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a38aa481-b360-44bd-9ef8-d2dbce23468c tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:20.384998 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a38aa481-b360-44bd-9ef8-d2dbce23468c tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] [instance: f8d253e4-979f-4be7-ac3e-51f935ac99e9] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:20.443371 n-d-master-1 devstack@n-api.service[120944]: ERROR oslo.messaging._drivers.impl_rabbit [None req-af7dfa32-a4f1-42cd-82e0-c2add39ec809 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] [a6d2fe48-37d0-41ec-8e5c-c9e301dbd2d8] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 23 01:48:20.486680 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a38aa481-b360-44bd-9ef8-d2dbce23468c tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4039f0940ed4cb2a3f5de1ba80c2d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddd64f7c80a4e869e77648648102c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:20.514925 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a38aa481-b360-44bd-9ef8-d2dbce23468c tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] 10.222.0.42 "GET /compute/v2.1/servers/f8d253e4-979f-4be7-ac3e-51f935ac99e9" status: 200 len: 1215 microversion: 2.1 time: 0.124223 Oct 23 01:48:20.515605 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3164/6424] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:20 2022] GET /compute/v2.1/servers/f8d253e4-979f-4be7-ac3e-51f935ac99e9 => generated 1215 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:48:20.534243 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-80d94e36-a284-4b7a-9202-03da3846a7f5 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '.version_select at 0x7f5cc63351f0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:20.632369 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-80d94e36-a284-4b7a-9202-03da3846a7f5 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2109170609" status: 202 len: 0 microversion: 2.1 time: 0.115115 Oct 23 01:48:20.633059 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3165/6425] 10.222.0.42 () {58 vars in 1284 bytes} [Sun Oct 23 01:48:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2109170609 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:48:20.664478 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bc006e1d-e346-481f-8cfb-38e3246dfb76 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Action: 'create', calling method: .version_select at 0x7f5cc1ec7b80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2134032002", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDduNGm/s+Q0qjFEWY/Xsd6ZiaaxD1gLoo8EFb9HxPQI27jQBlJZeKvd8ME53acMwqosr8S5huo0S8H42midPcoxclNaDJvyVuboKnZ/MdrAn+of0e5o6ainEZbNS3pP1g=="}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:48:20.695578 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-bc006e1d-e346-481f-8cfb-38e3246dfb76 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Getting quotas for project 0c7f734a12da437e806e4c791d27d615. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:48:20.702730 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-bc006e1d-e346-481f-8cfb-38e3246dfb76 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Getting quotas for user 037ed342980a4de9a2dfc8d576293aba and project 0c7f734a12da437e806e4c791d27d615. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:48:20.806079 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bc006e1d-e346-481f-8cfb-38e3246dfb76 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.145387 Oct 23 01:48:20.812560 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3166/6426] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 01:48:20 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:48:21.452853 n-d-master-1 devstack@n-api.service[120944]: INFO oslo.messaging._drivers.impl_rabbit [None req-af7dfa32-a4f1-42cd-82e0-c2add39ec809 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] [a6d2fe48-37d0-41ec-8e5c-c9e301dbd2d8] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 48996. Oct 23 01:48:21.462785 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-af7dfa32-a4f1-42cd-82e0-c2add39ec809 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.025635 Oct 23 01:48:21.463396 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3261/6427] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:48:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 3027 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:48:21.477550 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8b314d06-1926-4735-a95f-fa73b6b9a6bc tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:21.479167 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8b314d06-1926-4735-a95f-fa73b6b9a6bc tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] [instance: 3e32a61e-2dd1-458a-bced-55e7d351a60c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:21.539515 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-62efcf36-4b3d-42cd-be51-c75676ffd812 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:21.540197 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-62efcf36-4b3d-42cd-be51-c75676ffd812 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] [instance: f8d253e4-979f-4be7-ac3e-51f935ac99e9] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:21.552961 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-62efcf36-4b3d-42cd-be51-c75676ffd812 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:21.554396 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-62efcf36-4b3d-42cd-be51-c75676ffd812 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:21.558725 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-62efcf36-4b3d-42cd-be51-c75676ffd812 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:21.559660 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-62efcf36-4b3d-42cd-be51-c75676ffd812 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:21.560284 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-62efcf36-4b3d-42cd-be51-c75676ffd812 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:21.561069 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-62efcf36-4b3d-42cd-be51-c75676ffd812 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:21.646579 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8b314d06-1926-4735-a95f-fa73b6b9a6bc tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2630e3eda1df4f698cad1eda511ad76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e64fd5446d541da9d10af97a24ea037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:21.656658 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8b314d06-1926-4735-a95f-fa73b6b9a6bc tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] 10.222.0.42 "GET /compute/v2.1/servers/3e32a61e-2dd1-458a-bced-55e7d351a60c" status: 200 len: 1219 microversion: 2.1 time: 0.184651 Oct 23 01:48:21.664164 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3167/6428] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:21 2022] GET /compute/v2.1/servers/3e32a61e-2dd1-458a-bced-55e7d351a60c => generated 1219 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:48:21.777791 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-62efcf36-4b3d-42cd-be51-c75676ffd812 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4039f0940ed4cb2a3f5de1ba80c2d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddd64f7c80a4e869e77648648102c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:21.790955 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-62efcf36-4b3d-42cd-be51-c75676ffd812 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] 10.222.0.42 "GET /compute/v2.1/servers/f8d253e4-979f-4be7-ac3e-51f935ac99e9" status: 200 len: 1267 microversion: 2.1 time: 0.256526 Oct 23 01:48:21.794411 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3262/6429] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:21 2022] GET /compute/v2.1/servers/f8d253e4-979f-4be7-ac3e-51f935ac99e9 => generated 1267 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:48:22.692197 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b32d6ee5-cbe5-4517-bab5-e1fde54a03f9 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:22.692893 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b32d6ee5-cbe5-4517-bab5-e1fde54a03f9 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] [instance: 3e32a61e-2dd1-458a-bced-55e7d351a60c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:22.824769 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-47b42240-15fc-4e81-b394-bf45eef54bd1 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:22.824769 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-47b42240-15fc-4e81-b394-bf45eef54bd1 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] [instance: f8d253e4-979f-4be7-ac3e-51f935ac99e9] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:22.827703 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-47b42240-15fc-4e81-b394-bf45eef54bd1 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:22.828212 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-47b42240-15fc-4e81-b394-bf45eef54bd1 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:22.828665 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-47b42240-15fc-4e81-b394-bf45eef54bd1 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:22.829379 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-47b42240-15fc-4e81-b394-bf45eef54bd1 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:22.829847 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-47b42240-15fc-4e81-b394-bf45eef54bd1 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:22.830300 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-47b42240-15fc-4e81-b394-bf45eef54bd1 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:22.833495 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b32d6ee5-cbe5-4517-bab5-e1fde54a03f9 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2630e3eda1df4f698cad1eda511ad76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e64fd5446d541da9d10af97a24ea037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:22.846180 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b32d6ee5-cbe5-4517-bab5-e1fde54a03f9 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] 10.222.0.42 "GET /compute/v2.1/servers/3e32a61e-2dd1-458a-bced-55e7d351a60c" status: 200 len: 1219 microversion: 2.1 time: 0.157761 Oct 23 01:48:22.847772 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3168/6430] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:22 2022] GET /compute/v2.1/servers/3e32a61e-2dd1-458a-bced-55e7d351a60c => generated 1219 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:48:22.928212 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-47b42240-15fc-4e81-b394-bf45eef54bd1 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4039f0940ed4cb2a3f5de1ba80c2d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddd64f7c80a4e869e77648648102c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:22.954852 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-47b42240-15fc-4e81-b394-bf45eef54bd1 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] 10.222.0.42 "GET /compute/v2.1/servers/f8d253e4-979f-4be7-ac3e-51f935ac99e9" status: 200 len: 1273 microversion: 2.1 time: 0.124995 Oct 23 01:48:22.954852 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3263/6431] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:22 2022] GET /compute/v2.1/servers/f8d253e4-979f-4be7-ac3e-51f935ac99e9 => generated 1273 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:48:23.869198 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fbce2e3a-9766-4d33-ac0d-6c770f279b19 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:23.870632 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-fbce2e3a-9766-4d33-ac0d-6c770f279b19 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] [instance: 3e32a61e-2dd1-458a-bced-55e7d351a60c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:23.880734 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fbce2e3a-9766-4d33-ac0d-6c770f279b19 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:23.883249 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fbce2e3a-9766-4d33-ac0d-6c770f279b19 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:23.883911 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fbce2e3a-9766-4d33-ac0d-6c770f279b19 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:23.885623 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fbce2e3a-9766-4d33-ac0d-6c770f279b19 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:23.886010 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fbce2e3a-9766-4d33-ac0d-6c770f279b19 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:23.886638 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fbce2e3a-9766-4d33-ac0d-6c770f279b19 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:23.968809 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2c74e006-f85e-4ce8-9980-3df7211c53a3 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:23.970032 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2c74e006-f85e-4ce8-9980-3df7211c53a3 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] [instance: f8d253e4-979f-4be7-ac3e-51f935ac99e9] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:23.985253 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2c74e006-f85e-4ce8-9980-3df7211c53a3 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:23.986314 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2c74e006-f85e-4ce8-9980-3df7211c53a3 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:23.987280 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2c74e006-f85e-4ce8-9980-3df7211c53a3 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:23.992171 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2c74e006-f85e-4ce8-9980-3df7211c53a3 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:23.992823 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2c74e006-f85e-4ce8-9980-3df7211c53a3 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:23.993749 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2c74e006-f85e-4ce8-9980-3df7211c53a3 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:23.999727 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-fbce2e3a-9766-4d33-ac0d-6c770f279b19 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2630e3eda1df4f698cad1eda511ad76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e64fd5446d541da9d10af97a24ea037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:24.028340 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fbce2e3a-9766-4d33-ac0d-6c770f279b19 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] 10.222.0.42 "GET /compute/v2.1/servers/3e32a61e-2dd1-458a-bced-55e7d351a60c" status: 200 len: 1271 microversion: 2.1 time: 0.155370 Oct 23 01:48:24.031071 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3169/6432] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:23 2022] GET /compute/v2.1/servers/3e32a61e-2dd1-458a-bced-55e7d351a60c => generated 1271 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:48:24.161732 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2c74e006-f85e-4ce8-9980-3df7211c53a3 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4039f0940ed4cb2a3f5de1ba80c2d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddd64f7c80a4e869e77648648102c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:24.170561 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2c74e006-f85e-4ce8-9980-3df7211c53a3 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] 10.222.0.42 "GET /compute/v2.1/servers/f8d253e4-979f-4be7-ac3e-51f935ac99e9" status: 200 len: 1273 microversion: 2.1 time: 0.206271 Oct 23 01:48:24.170987 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3264/6433] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:23 2022] GET /compute/v2.1/servers/f8d253e4-979f-4be7-ac3e-51f935ac99e9 => generated 1273 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:48:25.063592 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a05341f0-0578-4b24-a922-7786b2ee9cc0 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:25.065576 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a05341f0-0578-4b24-a922-7786b2ee9cc0 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] [instance: 3e32a61e-2dd1-458a-bced-55e7d351a60c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:25.073029 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a05341f0-0578-4b24-a922-7786b2ee9cc0 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:25.073686 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a05341f0-0578-4b24-a922-7786b2ee9cc0 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:25.074738 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a05341f0-0578-4b24-a922-7786b2ee9cc0 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:25.075531 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a05341f0-0578-4b24-a922-7786b2ee9cc0 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:25.076102 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a05341f0-0578-4b24-a922-7786b2ee9cc0 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:25.078392 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a05341f0-0578-4b24-a922-7786b2ee9cc0 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:25.194536 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-056aaec7-f321-422a-9389-03429562e003 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:25.195868 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-056aaec7-f321-422a-9389-03429562e003 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] [instance: f8d253e4-979f-4be7-ac3e-51f935ac99e9] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:25.213582 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-056aaec7-f321-422a-9389-03429562e003 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:25.215048 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-056aaec7-f321-422a-9389-03429562e003 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:25.215733 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-056aaec7-f321-422a-9389-03429562e003 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:25.216738 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-056aaec7-f321-422a-9389-03429562e003 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:25.217530 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-056aaec7-f321-422a-9389-03429562e003 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:25.218463 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-056aaec7-f321-422a-9389-03429562e003 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:26.221142 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a05341f0-0578-4b24-a922-7786b2ee9cc0 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2630e3eda1df4f698cad1eda511ad76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e64fd5446d541da9d10af97a24ea037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:26.246247 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a05341f0-0578-4b24-a922-7786b2ee9cc0 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] 10.222.0.42 "GET /compute/v2.1/servers/3e32a61e-2dd1-458a-bced-55e7d351a60c" status: 200 len: 1277 microversion: 2.1 time: 1.188668 Oct 23 01:48:26.254149 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3170/6434] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:25 2022] GET /compute/v2.1/servers/3e32a61e-2dd1-458a-bced-55e7d351a60c => generated 1277 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:48:26.465566 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-056aaec7-f321-422a-9389-03429562e003 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4039f0940ed4cb2a3f5de1ba80c2d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddd64f7c80a4e869e77648648102c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:26.475341 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-056aaec7-f321-422a-9389-03429562e003 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] 10.222.0.42 "GET /compute/v2.1/servers/f8d253e4-979f-4be7-ac3e-51f935ac99e9" status: 200 len: 1315 microversion: 2.1 time: 1.284647 Oct 23 01:48:26.476251 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3265/6435] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:25 2022] GET /compute/v2.1/servers/f8d253e4-979f-4be7-ac3e-51f935ac99e9 => generated 1315 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:48:27.274944 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c1ddcd71-194f-46b4-a423-2a92ceace826 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:27.274944 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c1ddcd71-194f-46b4-a423-2a92ceace826 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] [instance: 3e32a61e-2dd1-458a-bced-55e7d351a60c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:27.284963 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c1ddcd71-194f-46b4-a423-2a92ceace826 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:27.292134 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c1ddcd71-194f-46b4-a423-2a92ceace826 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:27.293438 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c1ddcd71-194f-46b4-a423-2a92ceace826 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:27.295124 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c1ddcd71-194f-46b4-a423-2a92ceace826 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:27.295850 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c1ddcd71-194f-46b4-a423-2a92ceace826 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:27.296529 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c1ddcd71-194f-46b4-a423-2a92ceace826 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:27.421117 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-ec239ad3-207a-4102-ae2d-a4326181dad9 req-bcb9be1f-bf25-4b54-8399-7ae42e56a16d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8d253e4-979f-4be7-ac3e-51f935ac99e9", "tag": "41bbb2ad-6d02-4ca1-8906-070f0d64012c"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:48:27.444515 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ec239ad3-207a-4102-ae2d-a4326181dad9 req-bcb9be1f-bf25-4b54-8399-7ae42e56a16d service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:27.445312 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ec239ad3-207a-4102-ae2d-a4326181dad9 req-bcb9be1f-bf25-4b54-8399-7ae42e56a16d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:27.447137 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ec239ad3-207a-4102-ae2d-a4326181dad9 req-bcb9be1f-bf25-4b54-8399-7ae42e56a16d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:27.475545 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-ec239ad3-207a-4102-ae2d-a4326181dad9 req-bcb9be1f-bf25-4b54-8399-7ae42e56a16d service nova] Creating event network-changed:41bbb2ad-6d02-4ca1-8906-070f0d64012c for instance f8d253e4-979f-4be7-ac3e-51f935ac99e9 on n-h1-master-1 Oct 23 01:48:27.483668 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-ec239ad3-207a-4102-ae2d-a4326181dad9 req-bcb9be1f-bf25-4b54-8399-7ae42e56a16d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.388143 Oct 23 01:48:27.487974 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3171/6436] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:48:27.499459 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-087cd85f-1a20-4660-a98b-7e08423fd7b5 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:27.501447 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-087cd85f-1a20-4660-a98b-7e08423fd7b5 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] [instance: f8d253e4-979f-4be7-ac3e-51f935ac99e9] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:27.513764 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-087cd85f-1a20-4660-a98b-7e08423fd7b5 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:27.519877 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-087cd85f-1a20-4660-a98b-7e08423fd7b5 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:27.520744 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-087cd85f-1a20-4660-a98b-7e08423fd7b5 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:27.521650 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-087cd85f-1a20-4660-a98b-7e08423fd7b5 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:27.522301 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-087cd85f-1a20-4660-a98b-7e08423fd7b5 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:27.522881 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-087cd85f-1a20-4660-a98b-7e08423fd7b5 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:27.771071 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c1ddcd71-194f-46b4-a423-2a92ceace826 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2630e3eda1df4f698cad1eda511ad76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e64fd5446d541da9d10af97a24ea037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:27.793090 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c1ddcd71-194f-46b4-a423-2a92ceace826 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] 10.222.0.42 "GET /compute/v2.1/servers/3e32a61e-2dd1-458a-bced-55e7d351a60c" status: 200 len: 1319 microversion: 2.1 time: 0.523340 Oct 23 01:48:27.813516 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3266/6437] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:27 2022] GET /compute/v2.1/servers/3e32a61e-2dd1-458a-bced-55e7d351a60c => generated 1319 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:48:27.839124 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-087cd85f-1a20-4660-a98b-7e08423fd7b5 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4039f0940ed4cb2a3f5de1ba80c2d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddd64f7c80a4e869e77648648102c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:27.865464 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-087cd85f-1a20-4660-a98b-7e08423fd7b5 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] 10.222.0.42 "GET /compute/v2.1/servers/f8d253e4-979f-4be7-ac3e-51f935ac99e9" status: 200 len: 1315 microversion: 2.1 time: 0.360669 Oct 23 01:48:27.869023 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3172/6438] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:27 2022] GET /compute/v2.1/servers/f8d253e4-979f-4be7-ac3e-51f935ac99e9 => generated 1315 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:48:28.825234 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-49d89d24-942b-4fcc-80b2-01576edb9e7a tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:28.825861 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-49d89d24-942b-4fcc-80b2-01576edb9e7a tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] [instance: 3e32a61e-2dd1-458a-bced-55e7d351a60c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:28.828781 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:28.840372 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-49d89d24-942b-4fcc-80b2-01576edb9e7a tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:28.840372 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-49d89d24-942b-4fcc-80b2-01576edb9e7a tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:28.840372 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-49d89d24-942b-4fcc-80b2-01576edb9e7a tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:28.840372 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-49d89d24-942b-4fcc-80b2-01576edb9e7a tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:28.840372 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-49d89d24-942b-4fcc-80b2-01576edb9e7a tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:28.840372 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-49d89d24-942b-4fcc-80b2-01576edb9e7a tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:28.876561 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-3c64da0e-7a55-47d9-acb0-5db63658a70b req-1a574049-e6ac-4c76-80e8-745de7e5c2a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e32a61e-2dd1-458a-bced-55e7d351a60c", "tag": "9ca46fa1-462e-4477-84c0-54d235a36037"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:48:28.898737 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-3c64da0e-7a55-47d9-acb0-5db63658a70b req-1a574049-e6ac-4c76-80e8-745de7e5c2a8 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:28.907042 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-3c64da0e-7a55-47d9-acb0-5db63658a70b req-1a574049-e6ac-4c76-80e8-745de7e5c2a8 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:28.907556 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-3c64da0e-7a55-47d9-acb0-5db63658a70b req-1a574049-e6ac-4c76-80e8-745de7e5c2a8 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:28.939448 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-3c64da0e-7a55-47d9-acb0-5db63658a70b req-1a574049-e6ac-4c76-80e8-745de7e5c2a8 service nova] Creating event network-changed:9ca46fa1-462e-4477-84c0-54d235a36037 for instance 3e32a61e-2dd1-458a-bced-55e7d351a60c on n-h2-master-1 Oct 23 01:48:28.950930 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-3c64da0e-7a55-47d9-acb0-5db63658a70b req-1a574049-e6ac-4c76-80e8-745de7e5c2a8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.472336 Oct 23 01:48:28.952150 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3267/6439] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:48:28.959278 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-409e279e-0f17-4457-8c17-00a0af36fc85 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:28.960513 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-409e279e-0f17-4457-8c17-00a0af36fc85 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] [instance: f8d253e4-979f-4be7-ac3e-51f935ac99e9] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:28.969524 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-409e279e-0f17-4457-8c17-00a0af36fc85 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:28.970410 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-409e279e-0f17-4457-8c17-00a0af36fc85 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:28.971069 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-409e279e-0f17-4457-8c17-00a0af36fc85 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:28.971940 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-409e279e-0f17-4457-8c17-00a0af36fc85 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:28.972556 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-409e279e-0f17-4457-8c17-00a0af36fc85 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:28.973166 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-409e279e-0f17-4457-8c17-00a0af36fc85 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:29.234428 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-49d89d24-942b-4fcc-80b2-01576edb9e7a tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2630e3eda1df4f698cad1eda511ad76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e64fd5446d541da9d10af97a24ea037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:29.247387 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-49d89d24-942b-4fcc-80b2-01576edb9e7a tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] 10.222.0.42 "GET /compute/v2.1/servers/3e32a61e-2dd1-458a-bced-55e7d351a60c" status: 200 len: 1319 microversion: 2.1 time: 0.427177 Oct 23 01:48:29.254902 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3173/6440] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:28 2022] GET /compute/v2.1/servers/3e32a61e-2dd1-458a-bced-55e7d351a60c => generated 1319 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:48:29.366293 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-409e279e-0f17-4457-8c17-00a0af36fc85 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4039f0940ed4cb2a3f5de1ba80c2d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddd64f7c80a4e869e77648648102c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:29.378881 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-409e279e-0f17-4457-8c17-00a0af36fc85 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] 10.222.0.42 "GET /compute/v2.1/servers/f8d253e4-979f-4be7-ac3e-51f935ac99e9" status: 200 len: 1315 microversion: 2.1 time: 0.425323 Oct 23 01:48:29.383088 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3268/6441] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:28 2022] GET /compute/v2.1/servers/f8d253e4-979f-4be7-ac3e-51f935ac99e9 => generated 1315 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:48:30.278132 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3a2fa455-10ce-42aa-9d13-f0186b4ee4a3 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:30.278818 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3a2fa455-10ce-42aa-9d13-f0186b4ee4a3 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] [instance: 3e32a61e-2dd1-458a-bced-55e7d351a60c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:30.286369 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3a2fa455-10ce-42aa-9d13-f0186b4ee4a3 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:30.291326 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3a2fa455-10ce-42aa-9d13-f0186b4ee4a3 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:30.292083 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3a2fa455-10ce-42aa-9d13-f0186b4ee4a3 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:30.297375 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3a2fa455-10ce-42aa-9d13-f0186b4ee4a3 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:30.298294 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3a2fa455-10ce-42aa-9d13-f0186b4ee4a3 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:30.300144 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3a2fa455-10ce-42aa-9d13-f0186b4ee4a3 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:30.406733 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:30.407518 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=6 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:30.411648 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-066da7c2-96e4-4521-8cb3-671d0d66b859 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:30.412289 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-066da7c2-96e4-4521-8cb3-671d0d66b859 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] [instance: f8d253e4-979f-4be7-ac3e-51f935ac99e9] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:30.424933 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-066da7c2-96e4-4521-8cb3-671d0d66b859 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:30.425470 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-066da7c2-96e4-4521-8cb3-671d0d66b859 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:30.429471 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-066da7c2-96e4-4521-8cb3-671d0d66b859 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:30.430260 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-066da7c2-96e4-4521-8cb3-671d0d66b859 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:30.430743 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-066da7c2-96e4-4521-8cb3-671d0d66b859 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:30.431183 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-066da7c2-96e4-4521-8cb3-671d0d66b859 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:30.694501 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3a2fa455-10ce-42aa-9d13-f0186b4ee4a3 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2630e3eda1df4f698cad1eda511ad76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e64fd5446d541da9d10af97a24ea037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:30.708231 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3a2fa455-10ce-42aa-9d13-f0186b4ee4a3 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] 10.222.0.42 "GET /compute/v2.1/servers/3e32a61e-2dd1-458a-bced-55e7d351a60c" status: 200 len: 1319 microversion: 2.1 time: 0.435299 Oct 23 01:48:30.709106 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3174/6442] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:30 2022] GET /compute/v2.1/servers/3e32a61e-2dd1-458a-bced-55e7d351a60c => generated 1319 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:48:30.877798 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-066da7c2-96e4-4521-8cb3-671d0d66b859 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4039f0940ed4cb2a3f5de1ba80c2d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddd64f7c80a4e869e77648648102c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:30.888403 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-066da7c2-96e4-4521-8cb3-671d0d66b859 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] 10.222.0.42 "GET /compute/v2.1/servers/f8d253e4-979f-4be7-ac3e-51f935ac99e9" status: 200 len: 1315 microversion: 2.1 time: 0.483278 Oct 23 01:48:30.890851 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3269/6443] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:30 2022] GET /compute/v2.1/servers/f8d253e4-979f-4be7-ac3e-51f935ac99e9 => generated 1315 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:48:31.736580 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1385859c-b837-4071-9711-0d9cea81d57f tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:31.737615 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1385859c-b837-4071-9711-0d9cea81d57f tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] [instance: 3e32a61e-2dd1-458a-bced-55e7d351a60c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:31.749474 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1385859c-b837-4071-9711-0d9cea81d57f tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:31.754582 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1385859c-b837-4071-9711-0d9cea81d57f tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:31.755183 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1385859c-b837-4071-9711-0d9cea81d57f tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:31.757325 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1385859c-b837-4071-9711-0d9cea81d57f tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:31.758524 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1385859c-b837-4071-9711-0d9cea81d57f tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:31.760227 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1385859c-b837-4071-9711-0d9cea81d57f tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:31.929441 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7b805108-622c-4ea1-b69b-1ae5100068bf tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:31.929441 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7b805108-622c-4ea1-b69b-1ae5100068bf tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] [instance: f8d253e4-979f-4be7-ac3e-51f935ac99e9] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:31.941377 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b805108-622c-4ea1-b69b-1ae5100068bf tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:31.941983 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b805108-622c-4ea1-b69b-1ae5100068bf tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:31.942605 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b805108-622c-4ea1-b69b-1ae5100068bf tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:31.943336 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b805108-622c-4ea1-b69b-1ae5100068bf tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:31.943808 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b805108-622c-4ea1-b69b-1ae5100068bf tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:31.944339 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b805108-622c-4ea1-b69b-1ae5100068bf tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:32.282585 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1385859c-b837-4071-9711-0d9cea81d57f tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2630e3eda1df4f698cad1eda511ad76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e64fd5446d541da9d10af97a24ea037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:32.289319 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1385859c-b837-4071-9711-0d9cea81d57f tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] 10.222.0.42 "GET /compute/v2.1/servers/3e32a61e-2dd1-458a-bced-55e7d351a60c" status: 200 len: 1319 microversion: 2.1 time: 0.560699 Oct 23 01:48:32.289913 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3175/6444] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:31 2022] GET /compute/v2.1/servers/3e32a61e-2dd1-458a-bced-55e7d351a60c => generated 1319 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:48:32.334622 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7b805108-622c-4ea1-b69b-1ae5100068bf tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4039f0940ed4cb2a3f5de1ba80c2d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddd64f7c80a4e869e77648648102c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:32.352440 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7b805108-622c-4ea1-b69b-1ae5100068bf tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] 10.222.0.42 "GET /compute/v2.1/servers/f8d253e4-979f-4be7-ac3e-51f935ac99e9" status: 200 len: 1315 microversion: 2.1 time: 0.436269 Oct 23 01:48:32.356305 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3270/6445] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:31 2022] GET /compute/v2.1/servers/f8d253e4-979f-4be7-ac3e-51f935ac99e9 => generated 1315 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:48:32.845728 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=18 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:32.914492 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-6a005300-8752-4a15-bee5-5dbc4e9770c0 req-e0b31838-e71a-49be-939b-c5b0f600c441 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8d253e4-979f-4be7-ac3e-51f935ac99e9", "name": "network-vif-plugged", "status": "completed", "tag": "41bbb2ad-6d02-4ca1-8906-070f0d64012c"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:48:32.926219 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-6a005300-8752-4a15-bee5-5dbc4e9770c0 req-e0b31838-e71a-49be-939b-c5b0f600c441 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:32.930492 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-6a005300-8752-4a15-bee5-5dbc4e9770c0 req-e0b31838-e71a-49be-939b-c5b0f600c441 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:32.931406 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-6a005300-8752-4a15-bee5-5dbc4e9770c0 req-e0b31838-e71a-49be-939b-c5b0f600c441 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:32.944804 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-6a005300-8752-4a15-bee5-5dbc4e9770c0 req-e0b31838-e71a-49be-939b-c5b0f600c441 service nova] Creating event network-vif-plugged:41bbb2ad-6d02-4ca1-8906-070f0d64012c for instance f8d253e4-979f-4be7-ac3e-51f935ac99e9 on n-h1-master-1 Oct 23 01:48:32.956947 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-6a005300-8752-4a15-bee5-5dbc4e9770c0 req-e0b31838-e71a-49be-939b-c5b0f600c441 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.378819 Oct 23 01:48:32.959803 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3176/6446] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:48:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:48:33.317427 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-378e038a-bead-4db8-aac0-690151909c46 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:33.319394 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-378e038a-bead-4db8-aac0-690151909c46 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] [instance: 3e32a61e-2dd1-458a-bced-55e7d351a60c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:33.332888 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-378e038a-bead-4db8-aac0-690151909c46 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:33.333419 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-378e038a-bead-4db8-aac0-690151909c46 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:33.333868 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-378e038a-bead-4db8-aac0-690151909c46 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:33.334635 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-378e038a-bead-4db8-aac0-690151909c46 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:33.335096 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-378e038a-bead-4db8-aac0-690151909c46 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:33.335526 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-378e038a-bead-4db8-aac0-690151909c46 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:33.379928 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-eaa88d72-1c80-429e-b954-2cb935ee6c0f tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:33.380843 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-eaa88d72-1c80-429e-b954-2cb935ee6c0f tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] [instance: f8d253e4-979f-4be7-ac3e-51f935ac99e9] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:33.399594 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eaa88d72-1c80-429e-b954-2cb935ee6c0f tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:33.400846 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eaa88d72-1c80-429e-b954-2cb935ee6c0f tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:33.401446 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eaa88d72-1c80-429e-b954-2cb935ee6c0f tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:33.402940 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eaa88d72-1c80-429e-b954-2cb935ee6c0f tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:33.403705 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eaa88d72-1c80-429e-b954-2cb935ee6c0f tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:33.404296 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eaa88d72-1c80-429e-b954-2cb935ee6c0f tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:33.793493 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-378e038a-bead-4db8-aac0-690151909c46 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2630e3eda1df4f698cad1eda511ad76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e64fd5446d541da9d10af97a24ea037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:33.802906 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-378e038a-bead-4db8-aac0-690151909c46 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] 10.222.0.42 "GET /compute/v2.1/servers/3e32a61e-2dd1-458a-bced-55e7d351a60c" status: 200 len: 1319 microversion: 2.1 time: 0.489479 Oct 23 01:48:33.806740 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3271/6447] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:33 2022] GET /compute/v2.1/servers/3e32a61e-2dd1-458a-bced-55e7d351a60c => generated 1319 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:48:34.263633 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-eaa88d72-1c80-429e-b954-2cb935ee6c0f tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4039f0940ed4cb2a3f5de1ba80c2d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddd64f7c80a4e869e77648648102c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:34.501425 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-eaa88d72-1c80-429e-b954-2cb935ee6c0f tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] 10.222.0.42 "GET /compute/v2.1/servers/f8d253e4-979f-4be7-ac3e-51f935ac99e9" status: 200 len: 1315 microversion: 2.1 time: 0.906073 Oct 23 01:48:34.501425 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3177/6448] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:33 2022] GET /compute/v2.1/servers/f8d253e4-979f-4be7-ac3e-51f935ac99e9 => generated 1315 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:48:34.841301 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ee230e62-75fb-4a0a-b400-78f3a91c70f2 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:34.842072 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ee230e62-75fb-4a0a-b400-78f3a91c70f2 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] [instance: 3e32a61e-2dd1-458a-bced-55e7d351a60c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:34.859874 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ee230e62-75fb-4a0a-b400-78f3a91c70f2 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:34.863303 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ee230e62-75fb-4a0a-b400-78f3a91c70f2 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:34.863303 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ee230e62-75fb-4a0a-b400-78f3a91c70f2 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:34.863303 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ee230e62-75fb-4a0a-b400-78f3a91c70f2 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:34.863303 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ee230e62-75fb-4a0a-b400-78f3a91c70f2 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:34.863303 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ee230e62-75fb-4a0a-b400-78f3a91c70f2 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:35.143230 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ee230e62-75fb-4a0a-b400-78f3a91c70f2 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2630e3eda1df4f698cad1eda511ad76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e64fd5446d541da9d10af97a24ea037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:35.158890 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ee230e62-75fb-4a0a-b400-78f3a91c70f2 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] 10.222.0.42 "GET /compute/v2.1/servers/3e32a61e-2dd1-458a-bced-55e7d351a60c" status: 200 len: 1319 microversion: 2.1 time: 0.329910 Oct 23 01:48:35.166616 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3272/6449] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:34 2022] GET /compute/v2.1/servers/3e32a61e-2dd1-458a-bced-55e7d351a60c => generated 1319 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:48:35.520845 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1fdf3490-1c06-4679-a113-4f38bc4ef118 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:35.524375 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1fdf3490-1c06-4679-a113-4f38bc4ef118 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] [instance: f8d253e4-979f-4be7-ac3e-51f935ac99e9] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:35.557918 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1fdf3490-1c06-4679-a113-4f38bc4ef118 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:35.558607 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1fdf3490-1c06-4679-a113-4f38bc4ef118 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:35.559586 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1fdf3490-1c06-4679-a113-4f38bc4ef118 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:35.567714 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1fdf3490-1c06-4679-a113-4f38bc4ef118 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:35.568237 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1fdf3490-1c06-4679-a113-4f38bc4ef118 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:35.568695 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1fdf3490-1c06-4679-a113-4f38bc4ef118 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:35.573420 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:36.028009 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1fdf3490-1c06-4679-a113-4f38bc4ef118 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4039f0940ed4cb2a3f5de1ba80c2d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddd64f7c80a4e869e77648648102c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:36.037066 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1fdf3490-1c06-4679-a113-4f38bc4ef118 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] 10.222.0.42 "GET /compute/v2.1/servers/f8d253e4-979f-4be7-ac3e-51f935ac99e9" status: 200 len: 1465 microversion: 2.1 time: 0.522958 Oct 23 01:48:36.044510 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3178/6450] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:35 2022] GET /compute/v2.1/servers/f8d253e4-979f-4be7-ac3e-51f935ac99e9 => generated 1465 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:48:36.113899 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-61e91573-91ee-48f7-a5fe-690dbfe20f55 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:36.114563 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-61e91573-91ee-48f7-a5fe-690dbfe20f55 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] [instance: f8d253e4-979f-4be7-ac3e-51f935ac99e9] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:36.117569 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:36.132421 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-61e91573-91ee-48f7-a5fe-690dbfe20f55 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:36.133071 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-61e91573-91ee-48f7-a5fe-690dbfe20f55 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:36.133608 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-61e91573-91ee-48f7-a5fe-690dbfe20f55 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:36.138332 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-61e91573-91ee-48f7-a5fe-690dbfe20f55 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:36.138972 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-61e91573-91ee-48f7-a5fe-690dbfe20f55 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:36.139520 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-61e91573-91ee-48f7-a5fe-690dbfe20f55 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:36.153986 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=79 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:36.182491 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f72636c2-d956-4588-a847-93a0b8aa604e tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:36.183751 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f72636c2-d956-4588-a847-93a0b8aa604e tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] [instance: 3e32a61e-2dd1-458a-bced-55e7d351a60c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:36.197742 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f72636c2-d956-4588-a847-93a0b8aa604e tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:36.201083 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f72636c2-d956-4588-a847-93a0b8aa604e tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:36.205789 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f72636c2-d956-4588-a847-93a0b8aa604e tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:36.205789 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f72636c2-d956-4588-a847-93a0b8aa604e tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:36.209519 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f72636c2-d956-4588-a847-93a0b8aa604e tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:36.212078 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-61e91573-91ee-48f7-a5fe-690dbfe20f55 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] [instance: f8d253e4-979f-4be7-ac3e-51f935ac99e9] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:48:36.218404 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f72636c2-d956-4588-a847-93a0b8aa604e tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:36.583457 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-61e91573-91ee-48f7-a5fe-690dbfe20f55 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f8d253e4-979f-4be7-ac3e-51f935ac99e9" status: 204 len: 0 microversion: 2.1 time: 0.473569 Oct 23 01:48:36.584925 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3273/6451] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:48:36 2022] DELETE /compute/v2.1/servers/f8d253e4-979f-4be7-ac3e-51f935ac99e9 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:48:36.594978 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f4ff6a85-d487-45da-a596-cc995acd9c16 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:36.595983 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f4ff6a85-d487-45da-a596-cc995acd9c16 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] [instance: f8d253e4-979f-4be7-ac3e-51f935ac99e9] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:36.609307 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4ff6a85-d487-45da-a596-cc995acd9c16 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:36.610490 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4ff6a85-d487-45da-a596-cc995acd9c16 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:36.615851 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4ff6a85-d487-45da-a596-cc995acd9c16 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:36.620453 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4ff6a85-d487-45da-a596-cc995acd9c16 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:36.623030 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4ff6a85-d487-45da-a596-cc995acd9c16 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:36.623683 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4ff6a85-d487-45da-a596-cc995acd9c16 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:37.055403 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f72636c2-d956-4588-a847-93a0b8aa604e tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2630e3eda1df4f698cad1eda511ad76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e64fd5446d541da9d10af97a24ea037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:37.066713 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f72636c2-d956-4588-a847-93a0b8aa604e tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] 10.222.0.42 "GET /compute/v2.1/servers/3e32a61e-2dd1-458a-bced-55e7d351a60c" status: 200 len: 1319 microversion: 2.1 time: 0.887948 Oct 23 01:48:37.067920 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3179/6452] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:36 2022] GET /compute/v2.1/servers/3e32a61e-2dd1-458a-bced-55e7d351a60c => generated 1319 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:48:37.232149 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f4ff6a85-d487-45da-a596-cc995acd9c16 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4039f0940ed4cb2a3f5de1ba80c2d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddd64f7c80a4e869e77648648102c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:37.246853 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f4ff6a85-d487-45da-a596-cc995acd9c16 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] 10.222.0.42 "GET /compute/v2.1/servers/f8d253e4-979f-4be7-ac3e-51f935ac99e9" status: 200 len: 1471 microversion: 2.1 time: 0.656482 Oct 23 01:48:37.263012 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3274/6453] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:36 2022] GET /compute/v2.1/servers/f8d253e4-979f-4be7-ac3e-51f935ac99e9 => generated 1471 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:48:37.764642 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2944294b-9d12-4943-9093-d03aabb70b55 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-328676194", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "b372f794-0f32-45df-a0a4-8a2e06a0548b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2134032002", "security_groups": [{"name": "tempest-secgroup-smoke-2139855240"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:48:38.055587 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-2944294b-9d12-4943-9093-d03aabb70b55 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] validate_networks() for [('b372f794-0f32-45df-a0a4-8a2e06a0548b', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:48:38.099039 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f1990192-6a13-4740-8948-13c7ed920377 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:38.109206 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f1990192-6a13-4740-8948-13c7ed920377 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] [instance: 3e32a61e-2dd1-458a-bced-55e7d351a60c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:38.133141 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1990192-6a13-4740-8948-13c7ed920377 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:38.142675 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1990192-6a13-4740-8948-13c7ed920377 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:38.143300 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1990192-6a13-4740-8948-13c7ed920377 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:38.144302 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1990192-6a13-4740-8948-13c7ed920377 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:38.148967 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1990192-6a13-4740-8948-13c7ed920377 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:38.149666 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1990192-6a13-4740-8948-13c7ed920377 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:39.034850 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f1990192-6a13-4740-8948-13c7ed920377 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2630e3eda1df4f698cad1eda511ad76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e64fd5446d541da9d10af97a24ea037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:39.047205 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f1990192-6a13-4740-8948-13c7ed920377 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] 10.222.0.42 "GET /compute/v2.1/servers/3e32a61e-2dd1-458a-bced-55e7d351a60c" status: 200 len: 1319 microversion: 2.1 time: 0.958648 Oct 23 01:48:39.048367 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3275/6454] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:38 2022] GET /compute/v2.1/servers/3e32a61e-2dd1-458a-bced-55e7d351a60c => generated 1319 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:48:39.055561 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1b494509-47a0-463b-b2b6-0da0c56a6626 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:39.064823 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:39.075743 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1b494509-47a0-463b-b2b6-0da0c56a6626 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] [instance: f8d253e4-979f-4be7-ac3e-51f935ac99e9] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:39.097424 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1b494509-47a0-463b-b2b6-0da0c56a6626 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:39.097926 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1b494509-47a0-463b-b2b6-0da0c56a6626 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:39.098574 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1b494509-47a0-463b-b2b6-0da0c56a6626 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:39.099459 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1b494509-47a0-463b-b2b6-0da0c56a6626 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:39.102409 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1b494509-47a0-463b-b2b6-0da0c56a6626 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:39.115250 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1b494509-47a0-463b-b2b6-0da0c56a6626 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:39.582856 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1b494509-47a0-463b-b2b6-0da0c56a6626 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4039f0940ed4cb2a3f5de1ba80c2d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddd64f7c80a4e869e77648648102c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:39.591349 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1b494509-47a0-463b-b2b6-0da0c56a6626 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] 10.222.0.42 "GET /compute/v2.1/servers/f8d253e4-979f-4be7-ac3e-51f935ac99e9" status: 200 len: 1429 microversion: 2.1 time: 0.541562 Oct 23 01:48:39.597857 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3276/6455] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:39 2022] GET /compute/v2.1/servers/f8d253e4-979f-4be7-ac3e-51f935ac99e9 => generated 1429 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:48:39.615917 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-f13b5a8b-3c3b-42ce-8fd8-b92d329489eb req-ba8ed2bf-d9e6-4c98-87fe-755aa0712092 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e32a61e-2dd1-458a-bced-55e7d351a60c", "name": "network-vif-plugged", "status": "completed", "tag": "9ca46fa1-462e-4477-84c0-54d235a36037"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:48:39.629444 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-f13b5a8b-3c3b-42ce-8fd8-b92d329489eb req-ba8ed2bf-d9e6-4c98-87fe-755aa0712092 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:39.629939 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-f13b5a8b-3c3b-42ce-8fd8-b92d329489eb req-ba8ed2bf-d9e6-4c98-87fe-755aa0712092 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:39.630399 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-f13b5a8b-3c3b-42ce-8fd8-b92d329489eb req-ba8ed2bf-d9e6-4c98-87fe-755aa0712092 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:39.668586 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-f13b5a8b-3c3b-42ce-8fd8-b92d329489eb req-ba8ed2bf-d9e6-4c98-87fe-755aa0712092 service nova] Creating event network-vif-plugged:9ca46fa1-462e-4477-84c0-54d235a36037 for instance 3e32a61e-2dd1-458a-bced-55e7d351a60c on n-h2-master-1 Oct 23 01:48:39.686246 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-f13b5a8b-3c3b-42ce-8fd8-b92d329489eb req-ba8ed2bf-d9e6-4c98-87fe-755aa0712092 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086527 Oct 23 01:48:39.686878 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3277/6456] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:48:39.709809 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-42e8ae50-9f90-438c-b9f6-77f75e31bd32 req-93463eda-db57-4877-a457-3735433e4e78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8d253e4-979f-4be7-ac3e-51f935ac99e9", "name": "network-vif-deleted", "tag": "41bbb2ad-6d02-4ca1-8906-070f0d64012c"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:48:39.748703 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-42e8ae50-9f90-438c-b9f6-77f75e31bd32 req-93463eda-db57-4877-a457-3735433e4e78 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:39.750179 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-42e8ae50-9f90-438c-b9f6-77f75e31bd32 req-93463eda-db57-4877-a457-3735433e4e78 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:39.751820 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-42e8ae50-9f90-438c-b9f6-77f75e31bd32 req-93463eda-db57-4877-a457-3735433e4e78 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:39.788638 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-42e8ae50-9f90-438c-b9f6-77f75e31bd32 req-93463eda-db57-4877-a457-3735433e4e78 service nova] Creating event network-vif-deleted:41bbb2ad-6d02-4ca1-8906-070f0d64012c for instance f8d253e4-979f-4be7-ac3e-51f935ac99e9 on n-h1-master-1 Oct 23 01:48:39.793840 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-42e8ae50-9f90-438c-b9f6-77f75e31bd32 req-93463eda-db57-4877-a457-3735433e4e78 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088172 Oct 23 01:48:39.794801 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3278/6457] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:48:40.022483 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-2944294b-9d12-4943-9093-d03aabb70b55 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:48:40.023097 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-2944294b-9d12-4943-9093-d03aabb70b55 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:48:40.023710 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-2944294b-9d12-4943-9093-d03aabb70b55 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:48:40.024273 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-2944294b-9d12-4943-9093-d03aabb70b55 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:48:40.024836 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-2944294b-9d12-4943-9093-d03aabb70b55 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:48:40.047795 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2944294b-9d12-4943-9093-d03aabb70b55 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:40.048485 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2944294b-9d12-4943-9093-d03aabb70b55 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:40.049525 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2944294b-9d12-4943-9093-d03aabb70b55 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:40.050285 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2944294b-9d12-4943-9093-d03aabb70b55 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:40.050739 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2944294b-9d12-4943-9093-d03aabb70b55 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:40.051169 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2944294b-9d12-4943-9093-d03aabb70b55 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:40.074467 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f15cefb3-ec13-4f67-906b-8104716738e0 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:40.075290 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f15cefb3-ec13-4f67-906b-8104716738e0 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] [instance: 3e32a61e-2dd1-458a-bced-55e7d351a60c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:40.094862 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f15cefb3-ec13-4f67-906b-8104716738e0 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:40.095384 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f15cefb3-ec13-4f67-906b-8104716738e0 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:40.095828 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f15cefb3-ec13-4f67-906b-8104716738e0 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:40.096553 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f15cefb3-ec13-4f67-906b-8104716738e0 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:40.097016 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f15cefb3-ec13-4f67-906b-8104716738e0 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:40.097442 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f15cefb3-ec13-4f67-906b-8104716738e0 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:40.128396 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-2944294b-9d12-4943-9093-d03aabb70b55 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Getting quotas for project 0c7f734a12da437e806e4c791d27d615. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:48:40.147544 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-2944294b-9d12-4943-9093-d03aabb70b55 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Getting quotas for user 037ed342980a4de9a2dfc8d576293aba and project 0c7f734a12da437e806e4c791d27d615. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:48:40.181032 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2944294b-9d12-4943-9093-d03aabb70b55 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:48:40.194824 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2944294b-9d12-4943-9093-d03aabb70b55 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 331ab87b-109f-48e2-aff1-f0a9639d63b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:48:40.432758 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2944294b-9d12-4943-9093-d03aabb70b55 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.674771 Oct 23 01:48:40.439461 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3180/6458] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:48:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 2682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:48:40.461039 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0722b517-717e-41a1-b37b-cabd6f4348b0 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:40.461936 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0722b517-717e-41a1-b37b-cabd6f4348b0 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 331ab87b-109f-48e2-aff1-f0a9639d63b5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:40.626905 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f15cefb3-ec13-4f67-906b-8104716738e0 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2630e3eda1df4f698cad1eda511ad76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e64fd5446d541da9d10af97a24ea037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:40.631310 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0722b517-717e-41a1-b37b-cabd6f4348b0 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:40.648369 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0722b517-717e-41a1-b37b-cabd6f4348b0 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5" status: 200 len: 1266 microversion: 2.1 time: 0.197751 Oct 23 01:48:40.648981 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3181/6459] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:40 2022] GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5 => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:48:40.652023 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f15cefb3-ec13-4f67-906b-8104716738e0 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] 10.222.0.42 "GET /compute/v2.1/servers/3e32a61e-2dd1-458a-bced-55e7d351a60c" status: 200 len: 1319 microversion: 2.1 time: 0.581856 Oct 23 01:48:40.678286 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3279/6460] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:40 2022] GET /compute/v2.1/servers/3e32a61e-2dd1-458a-bced-55e7d351a60c => generated 1319 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:48:40.679129 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6bde43de-779a-4bf3-9c50-3e20ed537163 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:40.679129 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6bde43de-779a-4bf3-9c50-3e20ed537163 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] [instance: f8d253e4-979f-4be7-ac3e-51f935ac99e9] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:40.680696 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6bde43de-779a-4bf3-9c50-3e20ed537163 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:40.681194 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6bde43de-779a-4bf3-9c50-3e20ed537163 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:40.681628 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6bde43de-779a-4bf3-9c50-3e20ed537163 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:40.685610 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6bde43de-779a-4bf3-9c50-3e20ed537163 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:40.686309 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6bde43de-779a-4bf3-9c50-3e20ed537163 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:40.687478 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6bde43de-779a-4bf3-9c50-3e20ed537163 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:40.729944 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6bde43de-779a-4bf3-9c50-3e20ed537163 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:40.732484 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6bde43de-779a-4bf3-9c50-3e20ed537163 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:40.734351 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6bde43de-779a-4bf3-9c50-3e20ed537163 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:40.734351 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-6bde43de-779a-4bf3-9c50-3e20ed537163 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lazy-loading 'fault' on Instance uuid f8d253e4-979f-4be7-ac3e-51f935ac99e9 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:48:40.870371 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6bde43de-779a-4bf3-9c50-3e20ed537163 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4039f0940ed4cb2a3f5de1ba80c2d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddd64f7c80a4e869e77648648102c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:40.882707 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6bde43de-779a-4bf3-9c50-3e20ed537163 tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] 10.222.0.42 "GET /compute/v2.1/servers/f8d253e4-979f-4be7-ac3e-51f935ac99e9" status: 200 len: 1305 microversion: 2.1 time: 0.232041 Oct 23 01:48:40.884422 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3182/6461] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:40 2022] GET /compute/v2.1/servers/f8d253e4-979f-4be7-ac3e-51f935ac99e9 => generated 1305 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:48:41.673536 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dbaa8dd6-1e24-4194-a134-b28a5cc5f95a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:41.674492 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-dbaa8dd6-1e24-4194-a134-b28a5cc5f95a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 331ab87b-109f-48e2-aff1-f0a9639d63b5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:41.695263 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d5b36dbb-f559-4a2d-89fd-ce36c328855a tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:41.696228 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d5b36dbb-f559-4a2d-89fd-ce36c328855a tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] [instance: 3e32a61e-2dd1-458a-bced-55e7d351a60c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:41.725602 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d5b36dbb-f559-4a2d-89fd-ce36c328855a tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:41.728016 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d5b36dbb-f559-4a2d-89fd-ce36c328855a tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:41.730154 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d5b36dbb-f559-4a2d-89fd-ce36c328855a tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:41.733729 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d5b36dbb-f559-4a2d-89fd-ce36c328855a tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:41.734633 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d5b36dbb-f559-4a2d-89fd-ce36c328855a tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:41.735775 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d5b36dbb-f559-4a2d-89fd-ce36c328855a tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:41.826238 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-dbaa8dd6-1e24-4194-a134-b28a5cc5f95a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:41.850122 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-dbaa8dd6-1e24-4194-a134-b28a5cc5f95a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5" status: 200 len: 1266 microversion: 2.1 time: 0.168025 Oct 23 01:48:41.851753 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3280/6462] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:41 2022] GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:48:41.913085 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1089178f-7dfc-4c6c-9f90-956f517ec03e tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:41.913910 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1089178f-7dfc-4c6c-9f90-956f517ec03e tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] [instance: f8d253e4-979f-4be7-ac3e-51f935ac99e9] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:41.925298 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1089178f-7dfc-4c6c-9f90-956f517ec03e tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:41.930446 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1089178f-7dfc-4c6c-9f90-956f517ec03e tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:41.931216 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1089178f-7dfc-4c6c-9f90-956f517ec03e tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:41.932590 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1089178f-7dfc-4c6c-9f90-956f517ec03e tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:41.934514 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1089178f-7dfc-4c6c-9f90-956f517ec03e tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:41.937506 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1089178f-7dfc-4c6c-9f90-956f517ec03e tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:41.970084 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-1089178f-7dfc-4c6c-9f90-956f517ec03e tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] HTTP exception thrown: Instance f8d253e4-979f-4be7-ac3e-51f935ac99e9 could not be found. Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1089178f-7dfc-4c6c-9f90-956f517ec03e tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Request method failure captured: Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/f8d253e4-979f-4be7-ac3e-51f935ac99e9 HTTP/1.1 Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJ1cNNTwjM2MQm9Hm2zyGHsAcg9Jxy1pNlwwsvgcYyKRyulBvhJy-3U9HxGntftk_GO2A7oBIfYMjcJJUYWCwX-KYm5XfDewpFLMEdNWEJpbnSy61vHxOzFAItbJ3mIs9z3KPFRaUf--xNtVl4ev_e3vLDuruCPnz540lBgIZ801DhA Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: cddd64f7c80a4e869e77648648102c6d Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-VolumesNegativeTest-1139101971 Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/cddd64f7c80a4e869e77648648102c6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_cddd64f7c80a4e869e77648648102c6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cddd64f7c80a4e869e77648648102c6d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cddd64f7c80a4e869e77648648102c6d"}]}] Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-VolumesNegativeTest-1139101971 Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: cddd64f7c80a4e869e77648648102c6d Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-VolumesNegativeTest-1139101971 Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-VolumesNegativeTest-1139101971-project Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: b4039f0940ed4cb2a3f5de1ba80c2d15 Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-VolumesNegativeTest-1139101971-project Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: exception: Instance f8d253e4-979f-4be7-ac3e-51f935ac99e9 could not be found. Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'f8d253e4-979f-4be7-ac3e-51f935ac99e9'} Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8d253e4-979f-4be7-ac3e-51f935ac99e9 could not be found. Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8d253e4-979f-4be7-ac3e-51f935ac99e9 could not be found. Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:48:41.975058 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:48:41.979953 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:48:41.979953 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:48:41.979953 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:48:41.979953 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:48:41.979953 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:48:41.979953 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8d253e4-979f-4be7-ac3e-51f935ac99e9 could not be found. Oct 23 01:48:41.979953 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:48:41.982952 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1089178f-7dfc-4c6c-9f90-956f517ec03e tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] Returning 404 to user: Instance f8d253e4-979f-4be7-ac3e-51f935ac99e9 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:48:41.987143 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1089178f-7dfc-4c6c-9f90-956f517ec03e tempest-VolumesNegativeTest-1139101971 tempest-VolumesNegativeTest-1139101971-project] 10.222.0.42 "GET /compute/v2.1/servers/f8d253e4-979f-4be7-ac3e-51f935ac99e9" status: 404 len: 111 microversion: 2.1 time: 0.080729 Oct 23 01:48:41.989608 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3281/6463] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:41 2022] GET /compute/v2.1/servers/f8d253e4-979f-4be7-ac3e-51f935ac99e9 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:48:42.054507 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d5b36dbb-f559-4a2d-89fd-ce36c328855a tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2630e3eda1df4f698cad1eda511ad76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e64fd5446d541da9d10af97a24ea037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:42.068456 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d5b36dbb-f559-4a2d-89fd-ce36c328855a tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] 10.222.0.42 "GET /compute/v2.1/servers/3e32a61e-2dd1-458a-bced-55e7d351a60c" status: 200 len: 1507 microversion: 2.1 time: 0.372829 Oct 23 01:48:42.074451 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3183/6464] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:41 2022] GET /compute/v2.1/servers/3e32a61e-2dd1-458a-bced-55e7d351a60c => generated 1507 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:48:42.096162 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7b0d7ff5-44d1-406f-9775-208912793314 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce8a134d-389d-49a5-90e8-5eb0444430b0", "device": "/dev/sdb"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:48:42.099920 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7b0d7ff5-44d1-406f-9775-208912793314 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] [instance: 3e32a61e-2dd1-458a-bced-55e7d351a60c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:42.107876 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b0d7ff5-44d1-406f-9775-208912793314 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:42.108692 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b0d7ff5-44d1-406f-9775-208912793314 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:42.109314 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b0d7ff5-44d1-406f-9775-208912793314 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:42.110241 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b0d7ff5-44d1-406f-9775-208912793314 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:42.110893 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b0d7ff5-44d1-406f-9775-208912793314 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:42.111483 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b0d7ff5-44d1-406f-9775-208912793314 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:42.868404 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-55dd7f59-12a6-4335-8332-7515ad04a528 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:42.869679 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-55dd7f59-12a6-4335-8332-7515ad04a528 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 331ab87b-109f-48e2-aff1-f0a9639d63b5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:42.879541 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-55dd7f59-12a6-4335-8332-7515ad04a528 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:42.880263 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-55dd7f59-12a6-4335-8332-7515ad04a528 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:42.880927 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-55dd7f59-12a6-4335-8332-7515ad04a528 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:42.881865 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-55dd7f59-12a6-4335-8332-7515ad04a528 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:42.882577 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-55dd7f59-12a6-4335-8332-7515ad04a528 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:42.883511 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-55dd7f59-12a6-4335-8332-7515ad04a528 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:43.040631 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-55dd7f59-12a6-4335-8332-7515ad04a528 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:43.052936 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-55dd7f59-12a6-4335-8332-7515ad04a528 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5" status: 200 len: 1262 microversion: 2.1 time: 0.195367 Oct 23 01:48:43.056435 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3184/6465] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:42 2022] GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5 => generated 1262 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:48:43.304277 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7b0d7ff5-44d1-406f-9775-208912793314 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] 10.222.0.42 "POST /compute/v2.1/servers/3e32a61e-2dd1-458a-bced-55e7d351a60c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.214937 Oct 23 01:48:43.305734 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3282/6466] 10.222.0.42 () {60 vars in 1323 bytes} [Sun Oct 23 01:48:42 2022] POST /compute/v2.1/servers/3e32a61e-2dd1-458a-bced-55e7d351a60c/os-volume_attachments => generated 194 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:48:44.084999 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f731e48a-d2d5-4adf-8a4f-7e946bfc7d60 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:44.089108 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f731e48a-d2d5-4adf-8a4f-7e946bfc7d60 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 331ab87b-109f-48e2-aff1-f0a9639d63b5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:44.103632 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f731e48a-d2d5-4adf-8a4f-7e946bfc7d60 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:44.104134 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f731e48a-d2d5-4adf-8a4f-7e946bfc7d60 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:44.104572 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f731e48a-d2d5-4adf-8a4f-7e946bfc7d60 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:44.105286 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f731e48a-d2d5-4adf-8a4f-7e946bfc7d60 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:44.105772 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f731e48a-d2d5-4adf-8a4f-7e946bfc7d60 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:44.106255 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f731e48a-d2d5-4adf-8a4f-7e946bfc7d60 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:44.223175 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f731e48a-d2d5-4adf-8a4f-7e946bfc7d60 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:44.241292 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f731e48a-d2d5-4adf-8a4f-7e946bfc7d60 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5" status: 200 len: 1326 microversion: 2.1 time: 0.160269 Oct 23 01:48:44.241890 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3185/6467] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:44 2022] GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5 => generated 1326 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:48:45.268868 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ff383984-25a8-4ffc-9806-53b4cac5c93d tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:45.269591 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ff383984-25a8-4ffc-9806-53b4cac5c93d tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 331ab87b-109f-48e2-aff1-f0a9639d63b5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:45.286678 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ff383984-25a8-4ffc-9806-53b4cac5c93d tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:45.287706 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ff383984-25a8-4ffc-9806-53b4cac5c93d tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:45.288317 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ff383984-25a8-4ffc-9806-53b4cac5c93d tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:45.289202 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ff383984-25a8-4ffc-9806-53b4cac5c93d tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:45.291253 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ff383984-25a8-4ffc-9806-53b4cac5c93d tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:45.291694 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ff383984-25a8-4ffc-9806-53b4cac5c93d tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:45.455397 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ff383984-25a8-4ffc-9806-53b4cac5c93d tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:45.466815 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ff383984-25a8-4ffc-9806-53b4cac5c93d tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5" status: 200 len: 1324 microversion: 2.1 time: 0.200396 Oct 23 01:48:45.478571 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3283/6468] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:45 2022] GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5 => generated 1324 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:48:46.506600 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c30b4616-528e-43e8-99e1-ff69beb3e0a7 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:46.507224 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c30b4616-528e-43e8-99e1-ff69beb3e0a7 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 331ab87b-109f-48e2-aff1-f0a9639d63b5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:46.534979 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c30b4616-528e-43e8-99e1-ff69beb3e0a7 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:46.535594 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c30b4616-528e-43e8-99e1-ff69beb3e0a7 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:46.536051 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c30b4616-528e-43e8-99e1-ff69beb3e0a7 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:46.541399 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c30b4616-528e-43e8-99e1-ff69beb3e0a7 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:46.542142 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c30b4616-528e-43e8-99e1-ff69beb3e0a7 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:46.547266 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c30b4616-528e-43e8-99e1-ff69beb3e0a7 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:46.858335 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c30b4616-528e-43e8-99e1-ff69beb3e0a7 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:46.874551 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c30b4616-528e-43e8-99e1-ff69beb3e0a7 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5" status: 200 len: 1392 microversion: 2.1 time: 0.373532 Oct 23 01:48:46.890731 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3186/6469] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:46 2022] GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5 => generated 1392 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:48:47.245119 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-f65f9e3d-29a8-4613-9bc6-655e64abdf75 req-6349a37f-0a19-404f-ad39-4088f217b759 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "331ab87b-109f-48e2-aff1-f0a9639d63b5", "tag": "064dc680-6961-4f4c-a67e-febc7cdc1c7e"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:48:47.267641 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-f65f9e3d-29a8-4613-9bc6-655e64abdf75 req-6349a37f-0a19-404f-ad39-4088f217b759 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:47.268741 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-f65f9e3d-29a8-4613-9bc6-655e64abdf75 req-6349a37f-0a19-404f-ad39-4088f217b759 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:47.269344 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-f65f9e3d-29a8-4613-9bc6-655e64abdf75 req-6349a37f-0a19-404f-ad39-4088f217b759 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:47.289062 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-f65f9e3d-29a8-4613-9bc6-655e64abdf75 req-6349a37f-0a19-404f-ad39-4088f217b759 service nova] Creating event network-changed:064dc680-6961-4f4c-a67e-febc7cdc1c7e for instance 331ab87b-109f-48e2-aff1-f0a9639d63b5 on n-h1-master-1 Oct 23 01:48:47.301640 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-f65f9e3d-29a8-4613-9bc6-655e64abdf75 req-6349a37f-0a19-404f-ad39-4088f217b759 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059159 Oct 23 01:48:47.302593 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3284/6470] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:48:47.896502 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a5e74899-ddbe-4bbe-b77e-24607d6740bd tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:47.897690 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a5e74899-ddbe-4bbe-b77e-24607d6740bd tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 331ab87b-109f-48e2-aff1-f0a9639d63b5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:47.905871 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a5e74899-ddbe-4bbe-b77e-24607d6740bd tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:47.906625 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a5e74899-ddbe-4bbe-b77e-24607d6740bd tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:47.907222 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a5e74899-ddbe-4bbe-b77e-24607d6740bd tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:47.908083 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a5e74899-ddbe-4bbe-b77e-24607d6740bd tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:47.908689 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a5e74899-ddbe-4bbe-b77e-24607d6740bd tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:47.909264 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a5e74899-ddbe-4bbe-b77e-24607d6740bd tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:48.156030 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a5e74899-ddbe-4bbe-b77e-24607d6740bd tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:48.169380 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a5e74899-ddbe-4bbe-b77e-24607d6740bd tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5" status: 200 len: 1392 microversion: 2.1 time: 0.276278 Oct 23 01:48:48.183582 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3187/6471] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:47 2022] GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5 => generated 1392 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:48:49.048813 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5b95a296-c84f-4e9d-9b2e-c89cb831ab3a tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1289143094", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "3459bdac-0513-4b52-bee8-66327161a78e"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:48:49.118351 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-5b95a296-c84f-4e9d-9b2e-c89cb831ab3a tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] validate_networks() for [('3459bdac-0513-4b52-bee8-66327161a78e', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:48:49.195380 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-77a2c0b5-f877-4d01-a22f-6f6d31dfa139 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:49.196007 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-77a2c0b5-f877-4d01-a22f-6f6d31dfa139 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 331ab87b-109f-48e2-aff1-f0a9639d63b5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:49.204493 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-77a2c0b5-f877-4d01-a22f-6f6d31dfa139 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:49.205189 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-77a2c0b5-f877-4d01-a22f-6f6d31dfa139 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:49.205628 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-77a2c0b5-f877-4d01-a22f-6f6d31dfa139 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:49.206767 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-77a2c0b5-f877-4d01-a22f-6f6d31dfa139 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:49.207557 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-77a2c0b5-f877-4d01-a22f-6f6d31dfa139 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:49.209682 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-77a2c0b5-f877-4d01-a22f-6f6d31dfa139 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:49.583904 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-77a2c0b5-f877-4d01-a22f-6f6d31dfa139 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:49.598183 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-77a2c0b5-f877-4d01-a22f-6f6d31dfa139 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5" status: 200 len: 1392 microversion: 2.1 time: 0.407001 Oct 23 01:48:49.606056 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3188/6472] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:49 2022] GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5 => generated 1392 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:48:49.823297 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-5b95a296-c84f-4e9d-9b2e-c89cb831ab3a tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:48:49.828496 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-5b95a296-c84f-4e9d-9b2e-c89cb831ab3a tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:48:49.828496 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-5b95a296-c84f-4e9d-9b2e-c89cb831ab3a tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:48:49.828496 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-5b95a296-c84f-4e9d-9b2e-c89cb831ab3a tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:48:49.828496 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-5b95a296-c84f-4e9d-9b2e-c89cb831ab3a tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:48:49.839581 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b95a296-c84f-4e9d-9b2e-c89cb831ab3a tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:49.840161 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b95a296-c84f-4e9d-9b2e-c89cb831ab3a tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:49.841149 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b95a296-c84f-4e9d-9b2e-c89cb831ab3a tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:49.841877 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b95a296-c84f-4e9d-9b2e-c89cb831ab3a tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:49.842365 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b95a296-c84f-4e9d-9b2e-c89cb831ab3a tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:49.842790 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b95a296-c84f-4e9d-9b2e-c89cb831ab3a tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:49.863082 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-5b95a296-c84f-4e9d-9b2e-c89cb831ab3a tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Getting quotas for project ea87c7cf6a8b40ba914da392ab262edc. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:48:49.869055 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-5b95a296-c84f-4e9d-9b2e-c89cb831ab3a tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Getting quotas for user 762ae558fed0436793d2f985617ac4d6 and project ea87c7cf6a8b40ba914da392ab262edc. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:48:49.884560 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5b95a296-c84f-4e9d-9b2e-c89cb831ab3a tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:48:49.887375 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5b95a296-c84f-4e9d-9b2e-c89cb831ab3a tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] [instance: 4d73b42e-b2dd-432a-9aa7-59d7f430ba48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:48:50.051895 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5b95a296-c84f-4e9d-9b2e-c89cb831ab3a tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.154245 Oct 23 01:48:50.059708 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3285/6473] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:48:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1162 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:48:50.064989 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f65b7c3c-f8f9-4e13-a3c7-0914107ef138 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:50.066026 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f65b7c3c-f8f9-4e13-a3c7-0914107ef138 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] [instance: 4d73b42e-b2dd-432a-9aa7-59d7f430ba48] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:50.082362 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:50.166749 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f65b7c3c-f8f9-4e13-a3c7-0914107ef138 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762ae558fed0436793d2f985617ac4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea87c7cf6a8b40ba914da392ab262edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:50.180641 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f65b7c3c-f8f9-4e13-a3c7-0914107ef138 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] 10.222.0.42 "GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48" status: 200 len: 1215 microversion: 2.1 time: 0.119552 Oct 23 01:48:50.198669 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3189/6474] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:50 2022] GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48 => generated 1215 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:48:50.636164 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-088b7acb-3e6a-4b83-93dd-dbcf4b9f8ab4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:50.636790 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-088b7acb-3e6a-4b83-93dd-dbcf4b9f8ab4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 331ab87b-109f-48e2-aff1-f0a9639d63b5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:50.648215 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-088b7acb-3e6a-4b83-93dd-dbcf4b9f8ab4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:50.649023 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-088b7acb-3e6a-4b83-93dd-dbcf4b9f8ab4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:50.649634 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-088b7acb-3e6a-4b83-93dd-dbcf4b9f8ab4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:50.650590 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-088b7acb-3e6a-4b83-93dd-dbcf4b9f8ab4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:50.651199 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-088b7acb-3e6a-4b83-93dd-dbcf4b9f8ab4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:50.651781 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-088b7acb-3e6a-4b83-93dd-dbcf4b9f8ab4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:50.820787 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-088b7acb-3e6a-4b83-93dd-dbcf4b9f8ab4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:50.831126 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-088b7acb-3e6a-4b83-93dd-dbcf4b9f8ab4 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5" status: 200 len: 1392 microversion: 2.1 time: 0.198843 Oct 23 01:48:50.833119 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3286/6475] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:50 2022] GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5 => generated 1392 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:48:51.207615 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fa72ad9f-81e2-4379-93c1-4fb60809ff0a tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:51.208757 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-fa72ad9f-81e2-4379-93c1-4fb60809ff0a tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] [instance: 4d73b42e-b2dd-432a-9aa7-59d7f430ba48] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:51.317866 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-fa72ad9f-81e2-4379-93c1-4fb60809ff0a tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762ae558fed0436793d2f985617ac4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea87c7cf6a8b40ba914da392ab262edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:51.328928 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fa72ad9f-81e2-4379-93c1-4fb60809ff0a tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] 10.222.0.42 "GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48" status: 200 len: 1215 microversion: 2.1 time: 0.125790 Oct 23 01:48:51.331844 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3190/6476] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:51 2022] GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48 => generated 1215 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:48:51.857538 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-29587cb9-fe20-48a9-a550-1db68f9df769 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:51.858203 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-29587cb9-fe20-48a9-a550-1db68f9df769 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 331ab87b-109f-48e2-aff1-f0a9639d63b5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:51.872339 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-29587cb9-fe20-48a9-a550-1db68f9df769 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:51.873210 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-29587cb9-fe20-48a9-a550-1db68f9df769 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:51.880088 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-29587cb9-fe20-48a9-a550-1db68f9df769 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:51.881921 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-29587cb9-fe20-48a9-a550-1db68f9df769 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:51.882650 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-29587cb9-fe20-48a9-a550-1db68f9df769 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:51.883302 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-29587cb9-fe20-48a9-a550-1db68f9df769 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:52.082679 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-29587cb9-fe20-48a9-a550-1db68f9df769 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:52.091182 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-29587cb9-fe20-48a9-a550-1db68f9df769 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5" status: 200 len: 1392 microversion: 2.1 time: 0.237651 Oct 23 01:48:52.091803 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3287/6477] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:51 2022] GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5 => generated 1392 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:48:52.360080 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ad43bb5e-778a-4c60-8fd0-667867daa81d tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:52.362406 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ad43bb5e-778a-4c60-8fd0-667867daa81d tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] [instance: 4d73b42e-b2dd-432a-9aa7-59d7f430ba48] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:52.374277 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ad43bb5e-778a-4c60-8fd0-667867daa81d tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:52.376653 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ad43bb5e-778a-4c60-8fd0-667867daa81d tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:52.386690 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ad43bb5e-778a-4c60-8fd0-667867daa81d tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:52.387494 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ad43bb5e-778a-4c60-8fd0-667867daa81d tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:52.387973 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ad43bb5e-778a-4c60-8fd0-667867daa81d tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:52.388591 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ad43bb5e-778a-4c60-8fd0-667867daa81d tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:52.513820 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ad43bb5e-778a-4c60-8fd0-667867daa81d tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762ae558fed0436793d2f985617ac4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea87c7cf6a8b40ba914da392ab262edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:52.521633 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ad43bb5e-778a-4c60-8fd0-667867daa81d tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] 10.222.0.42 "GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48" status: 200 len: 1267 microversion: 2.1 time: 0.167846 Oct 23 01:48:52.524788 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3191/6478] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:52 2022] GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:48:53.117273 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6cdcf04b-9303-4473-9c1d-a6c861d0d49e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:53.118098 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6cdcf04b-9303-4473-9c1d-a6c861d0d49e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 331ab87b-109f-48e2-aff1-f0a9639d63b5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:53.126831 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6cdcf04b-9303-4473-9c1d-a6c861d0d49e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:53.127676 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6cdcf04b-9303-4473-9c1d-a6c861d0d49e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:53.128449 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6cdcf04b-9303-4473-9c1d-a6c861d0d49e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:53.129390 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6cdcf04b-9303-4473-9c1d-a6c861d0d49e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:53.130119 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6cdcf04b-9303-4473-9c1d-a6c861d0d49e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:53.130880 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6cdcf04b-9303-4473-9c1d-a6c861d0d49e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:53.553236 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c6aca260-f790-45bf-af3e-7cfc59f10f35 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:53.554745 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c6aca260-f790-45bf-af3e-7cfc59f10f35 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] [instance: 4d73b42e-b2dd-432a-9aa7-59d7f430ba48] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:53.565126 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6aca260-f790-45bf-af3e-7cfc59f10f35 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:53.566126 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6aca260-f790-45bf-af3e-7cfc59f10f35 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:53.566769 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6aca260-f790-45bf-af3e-7cfc59f10f35 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:53.568000 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6aca260-f790-45bf-af3e-7cfc59f10f35 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:53.568661 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6aca260-f790-45bf-af3e-7cfc59f10f35 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:53.569295 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6aca260-f790-45bf-af3e-7cfc59f10f35 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:53.809541 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c6aca260-f790-45bf-af3e-7cfc59f10f35 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762ae558fed0436793d2f985617ac4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea87c7cf6a8b40ba914da392ab262edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:53.817965 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c6aca260-f790-45bf-af3e-7cfc59f10f35 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] 10.222.0.42 "GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48" status: 200 len: 1275 microversion: 2.1 time: 0.268912 Oct 23 01:48:53.830715 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3192/6479] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:53 2022] GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48 => generated 1275 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:48:53.948710 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6cdcf04b-9303-4473-9c1d-a6c861d0d49e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:53.958976 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6cdcf04b-9303-4473-9c1d-a6c861d0d49e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5" status: 200 len: 1392 microversion: 2.1 time: 0.848220 Oct 23 01:48:53.959682 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3288/6480] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:53 2022] GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5 => generated 1392 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:48:54.120186 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-64185e92-59cb-4e31-b702-21d51283e6ca req-e50b7bd0-1598-4dbd-839a-d332e44f23cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "331ab87b-109f-48e2-aff1-f0a9639d63b5", "name": "network-vif-plugged", "status": "completed", "tag": "064dc680-6961-4f4c-a67e-febc7cdc1c7e"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:48:54.129685 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-64185e92-59cb-4e31-b702-21d51283e6ca req-e50b7bd0-1598-4dbd-839a-d332e44f23cb service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:54.130429 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-64185e92-59cb-4e31-b702-21d51283e6ca req-e50b7bd0-1598-4dbd-839a-d332e44f23cb service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:54.131018 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-64185e92-59cb-4e31-b702-21d51283e6ca req-e50b7bd0-1598-4dbd-839a-d332e44f23cb service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:54.143131 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-64185e92-59cb-4e31-b702-21d51283e6ca req-e50b7bd0-1598-4dbd-839a-d332e44f23cb service nova] Creating event network-vif-plugged:064dc680-6961-4f4c-a67e-febc7cdc1c7e for instance 331ab87b-109f-48e2-aff1-f0a9639d63b5 on n-h1-master-1 Oct 23 01:48:54.148933 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-64185e92-59cb-4e31-b702-21d51283e6ca req-e50b7bd0-1598-4dbd-839a-d332e44f23cb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032351 Oct 23 01:48:54.149917 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3193/6481] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:48:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:48:54.842156 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9b6384d5-5112-4192-bc58-42977d0c9a07 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:54.842784 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9b6384d5-5112-4192-bc58-42977d0c9a07 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] [instance: 4d73b42e-b2dd-432a-9aa7-59d7f430ba48] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:54.853740 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9b6384d5-5112-4192-bc58-42977d0c9a07 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:54.856785 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9b6384d5-5112-4192-bc58-42977d0c9a07 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:54.856785 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9b6384d5-5112-4192-bc58-42977d0c9a07 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:54.856785 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9b6384d5-5112-4192-bc58-42977d0c9a07 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:54.856785 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9b6384d5-5112-4192-bc58-42977d0c9a07 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:54.866386 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9b6384d5-5112-4192-bc58-42977d0c9a07 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:54.962595 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9b6384d5-5112-4192-bc58-42977d0c9a07 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762ae558fed0436793d2f985617ac4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea87c7cf6a8b40ba914da392ab262edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:54.976569 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9b6384d5-5112-4192-bc58-42977d0c9a07 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] 10.222.0.42 "GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48" status: 200 len: 1273 microversion: 2.1 time: 0.138131 Oct 23 01:48:54.977781 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3289/6482] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:54 2022] GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48 => generated 1273 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:48:54.999511 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-055994f8-d91e-4b87-8abf-c99abb6ec31b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:55.000970 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-055994f8-d91e-4b87-8abf-c99abb6ec31b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 331ab87b-109f-48e2-aff1-f0a9639d63b5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:55.009067 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-055994f8-d91e-4b87-8abf-c99abb6ec31b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:55.009822 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-055994f8-d91e-4b87-8abf-c99abb6ec31b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:55.011283 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-055994f8-d91e-4b87-8abf-c99abb6ec31b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:55.011283 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-055994f8-d91e-4b87-8abf-c99abb6ec31b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:55.011888 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-055994f8-d91e-4b87-8abf-c99abb6ec31b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:55.013163 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-055994f8-d91e-4b87-8abf-c99abb6ec31b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:55.353795 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-055994f8-d91e-4b87-8abf-c99abb6ec31b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:55.374368 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-055994f8-d91e-4b87-8abf-c99abb6ec31b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5" status: 200 len: 1392 microversion: 2.1 time: 0.381723 Oct 23 01:48:55.375299 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3194/6483] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:54 2022] GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5 => generated 1392 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:48:56.004373 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7777dcac-b65e-4500-9b72-3355018a7d37 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:56.005086 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7777dcac-b65e-4500-9b72-3355018a7d37 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] [instance: 4d73b42e-b2dd-432a-9aa7-59d7f430ba48] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:56.012868 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7777dcac-b65e-4500-9b72-3355018a7d37 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:56.013412 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7777dcac-b65e-4500-9b72-3355018a7d37 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:56.019600 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7777dcac-b65e-4500-9b72-3355018a7d37 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:56.019600 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7777dcac-b65e-4500-9b72-3355018a7d37 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:56.019600 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7777dcac-b65e-4500-9b72-3355018a7d37 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:56.019600 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7777dcac-b65e-4500-9b72-3355018a7d37 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:56.270726 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7777dcac-b65e-4500-9b72-3355018a7d37 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762ae558fed0436793d2f985617ac4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea87c7cf6a8b40ba914da392ab262edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:56.287305 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7777dcac-b65e-4500-9b72-3355018a7d37 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] 10.222.0.42 "GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48" status: 200 len: 1315 microversion: 2.1 time: 0.285559 Oct 23 01:48:56.288231 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3290/6484] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:55 2022] GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48 => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:48:56.398091 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e6bf300a-785b-4e2d-8f9c-102db68be12b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:56.399554 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e6bf300a-785b-4e2d-8f9c-102db68be12b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 331ab87b-109f-48e2-aff1-f0a9639d63b5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:56.407650 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6bf300a-785b-4e2d-8f9c-102db68be12b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:56.408455 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6bf300a-785b-4e2d-8f9c-102db68be12b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:56.409317 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6bf300a-785b-4e2d-8f9c-102db68be12b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:56.410264 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6bf300a-785b-4e2d-8f9c-102db68be12b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:56.410926 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6bf300a-785b-4e2d-8f9c-102db68be12b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:56.411502 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6bf300a-785b-4e2d-8f9c-102db68be12b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:56.754931 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e6bf300a-785b-4e2d-8f9c-102db68be12b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:56.763226 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e6bf300a-785b-4e2d-8f9c-102db68be12b tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5" status: 200 len: 1564 microversion: 2.1 time: 0.368440 Oct 23 01:48:56.764068 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3195/6485] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:56 2022] GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5 => generated 1564 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:48:56.797195 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0be2fa7b-3ded-4b8d-80e7-31020fc12a5e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:56.797819 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0be2fa7b-3ded-4b8d-80e7-31020fc12a5e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 331ab87b-109f-48e2-aff1-f0a9639d63b5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:56.804213 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0be2fa7b-3ded-4b8d-80e7-31020fc12a5e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:56.804706 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0be2fa7b-3ded-4b8d-80e7-31020fc12a5e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:56.805428 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0be2fa7b-3ded-4b8d-80e7-31020fc12a5e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:56.806164 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0be2fa7b-3ded-4b8d-80e7-31020fc12a5e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:56.806936 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0be2fa7b-3ded-4b8d-80e7-31020fc12a5e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:56.811330 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0be2fa7b-3ded-4b8d-80e7-31020fc12a5e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:56.817604 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:57.096411 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0be2fa7b-3ded-4b8d-80e7-31020fc12a5e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:57.104793 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0be2fa7b-3ded-4b8d-80e7-31020fc12a5e tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5" status: 200 len: 1564 microversion: 2.1 time: 0.311335 Oct 23 01:48:57.127971 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-7dadc061-d805-45bc-bef5-2e417f74993c req-5ea8ca39-33c2-4b1a-81b3-eec05575f49e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d73b42e-b2dd-432a-9aa7-59d7f430ba48", "tag": "2f5c3df9-21af-4fe1-9265-1a59f21d773b"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:48:57.132825 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3291/6486] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:56 2022] GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5 => generated 1564 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:48:57.138885 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-7dadc061-d805-45bc-bef5-2e417f74993c req-5ea8ca39-33c2-4b1a-81b3-eec05575f49e service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:57.139561 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-7dadc061-d805-45bc-bef5-2e417f74993c req-5ea8ca39-33c2-4b1a-81b3-eec05575f49e service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:57.140055 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-7dadc061-d805-45bc-bef5-2e417f74993c req-5ea8ca39-33c2-4b1a-81b3-eec05575f49e service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:57.156349 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-7dadc061-d805-45bc-bef5-2e417f74993c req-5ea8ca39-33c2-4b1a-81b3-eec05575f49e service nova] Creating event network-changed:2f5c3df9-21af-4fe1-9265-1a59f21d773b for instance 4d73b42e-b2dd-432a-9aa7-59d7f430ba48 on n-h1-master-1 Oct 23 01:48:57.169823 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-7dadc061-d805-45bc-bef5-2e417f74993c req-5ea8ca39-33c2-4b1a-81b3-eec05575f49e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048971 Oct 23 01:48:57.172955 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3196/6487] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:48:57.313152 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-41364919-644e-468c-9d84-1f1fb6901f32 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:57.313778 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-41364919-644e-468c-9d84-1f1fb6901f32 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] [instance: 4d73b42e-b2dd-432a-9aa7-59d7f430ba48] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:57.320018 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41364919-644e-468c-9d84-1f1fb6901f32 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:57.320751 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41364919-644e-468c-9d84-1f1fb6901f32 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:57.321374 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41364919-644e-468c-9d84-1f1fb6901f32 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:57.322318 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41364919-644e-468c-9d84-1f1fb6901f32 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:57.326600 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41364919-644e-468c-9d84-1f1fb6901f32 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:57.327244 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41364919-644e-468c-9d84-1f1fb6901f32 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:57.579051 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-41364919-644e-468c-9d84-1f1fb6901f32 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762ae558fed0436793d2f985617ac4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea87c7cf6a8b40ba914da392ab262edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:57.591204 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-41364919-644e-468c-9d84-1f1fb6901f32 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] 10.222.0.42 "GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48" status: 200 len: 1315 microversion: 2.1 time: 0.281075 Oct 23 01:48:57.592180 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3292/6488] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:57 2022] GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48 => generated 1315 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:48:58.617572 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d4325d80-e1de-41cf-96d7-77ec60928273 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:58.618349 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d4325d80-e1de-41cf-96d7-77ec60928273 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] [instance: 4d73b42e-b2dd-432a-9aa7-59d7f430ba48] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:58.625902 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4325d80-e1de-41cf-96d7-77ec60928273 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:58.626433 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4325d80-e1de-41cf-96d7-77ec60928273 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:58.627416 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4325d80-e1de-41cf-96d7-77ec60928273 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:58.628131 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4325d80-e1de-41cf-96d7-77ec60928273 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:58.628962 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4325d80-e1de-41cf-96d7-77ec60928273 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:58.629553 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4325d80-e1de-41cf-96d7-77ec60928273 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:58.827508 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d4325d80-e1de-41cf-96d7-77ec60928273 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762ae558fed0436793d2f985617ac4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea87c7cf6a8b40ba914da392ab262edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:48:58.835319 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d4325d80-e1de-41cf-96d7-77ec60928273 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] 10.222.0.42 "GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48" status: 200 len: 1315 microversion: 2.1 time: 0.222722 Oct 23 01:48:58.835902 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3197/6489] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:58 2022] GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:48:59.679426 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f5679ed5-964e-4af6-8c4c-1cdfec0145e0 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Action: 'create', calling method: .version_select at 0x7f5cc174f4c0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-484001668", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOHPiW1dPGzUNG3jQeEGuItfrTfKpBaoB4EStpvqExvmuhYjdlJbbV0kBUyp7g5FDYr/Xg5oi+P8cBIjT2Noya/VSCLSAckXxh4MuVOv3AGukviCDSP+e3Ifc7L9mgI5cQ=="}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:48:59.707592 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-f5679ed5-964e-4af6-8c4c-1cdfec0145e0 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Getting quotas for project a028aafec3294eae9a1c1a9a4e907dc2. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:48:59.728983 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-f5679ed5-964e-4af6-8c4c-1cdfec0145e0 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Getting quotas for user 38c7799d37d747b08a9e20e15c3d6879 and project a028aafec3294eae9a1c1a9a4e907dc2. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:48:59.850627 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:59.862057 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-eb27cded-4d11-48af-af3e-a0447820d78f tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:48:59.865332 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-eb27cded-4d11-48af-af3e-a0447820d78f tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] [instance: 4d73b42e-b2dd-432a-9aa7-59d7f430ba48] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:48:59.871792 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f5679ed5-964e-4af6-8c4c-1cdfec0145e0 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.550968 Oct 23 01:48:59.889338 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3293/6490] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 01:48:59 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:48:59.889448 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eb27cded-4d11-48af-af3e-a0447820d78f tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:59.891859 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eb27cded-4d11-48af-af3e-a0447820d78f tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:59.892828 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eb27cded-4d11-48af-af3e-a0447820d78f tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:48:59.893903 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eb27cded-4d11-48af-af3e-a0447820d78f tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:48:59.894565 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eb27cded-4d11-48af-af3e-a0447820d78f tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:48:59.895092 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eb27cded-4d11-48af-af3e-a0447820d78f tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:00.275047 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-eb27cded-4d11-48af-af3e-a0447820d78f tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762ae558fed0436793d2f985617ac4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea87c7cf6a8b40ba914da392ab262edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:00.288022 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-eb27cded-4d11-48af-af3e-a0447820d78f tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] 10.222.0.42 "GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48" status: 200 len: 1315 microversion: 2.1 time: 0.432472 Oct 23 01:49:00.299743 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3198/6491] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:48:59 2022] GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48 => generated 1315 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:49:01.312264 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7f8eca4c-cdba-4d3b-bda0-975efbee90f8 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:01.313069 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7f8eca4c-cdba-4d3b-bda0-975efbee90f8 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] [instance: 4d73b42e-b2dd-432a-9aa7-59d7f430ba48] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:01.328862 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f8eca4c-cdba-4d3b-bda0-975efbee90f8 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:01.329303 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f8eca4c-cdba-4d3b-bda0-975efbee90f8 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:01.329861 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f8eca4c-cdba-4d3b-bda0-975efbee90f8 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:01.330623 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f8eca4c-cdba-4d3b-bda0-975efbee90f8 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:01.331278 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f8eca4c-cdba-4d3b-bda0-975efbee90f8 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:01.331904 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f8eca4c-cdba-4d3b-bda0-975efbee90f8 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:02.116022 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7f8eca4c-cdba-4d3b-bda0-975efbee90f8 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762ae558fed0436793d2f985617ac4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea87c7cf6a8b40ba914da392ab262edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:02.128816 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c71bd2ed-2a4e-4b93-93e1-db8bc9921b96 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:02.129447 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c71bd2ed-2a4e-4b93-93e1-db8bc9921b96 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 331ab87b-109f-48e2-aff1-f0a9639d63b5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:02.137609 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=12 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:02.139128 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7f8eca4c-cdba-4d3b-bda0-975efbee90f8 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] 10.222.0.42 "GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48" status: 200 len: 1315 microversion: 2.1 time: 0.831284 Oct 23 01:49:02.140202 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3294/6492] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:01 2022] GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48 => generated 1315 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:49:02.145497 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-5c8cd680-e420-48f2-b51b-ec4bdc4f55de req-c724b67c-e961-413c-8876-8e4c12541380 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "331ab87b-109f-48e2-aff1-f0a9639d63b5", "tag": "064dc680-6961-4f4c-a67e-febc7cdc1c7e"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:49:02.164141 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c71bd2ed-2a4e-4b93-93e1-db8bc9921b96 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:02.164844 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c71bd2ed-2a4e-4b93-93e1-db8bc9921b96 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:02.165951 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c71bd2ed-2a4e-4b93-93e1-db8bc9921b96 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:02.166857 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c71bd2ed-2a4e-4b93-93e1-db8bc9921b96 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:02.168402 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c71bd2ed-2a4e-4b93-93e1-db8bc9921b96 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:02.169836 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-5c8cd680-e420-48f2-b51b-ec4bdc4f55de req-c724b67c-e961-413c-8876-8e4c12541380 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:02.170367 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-5c8cd680-e420-48f2-b51b-ec4bdc4f55de req-c724b67c-e961-413c-8876-8e4c12541380 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:02.172514 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-5c8cd680-e420-48f2-b51b-ec4bdc4f55de req-c724b67c-e961-413c-8876-8e4c12541380 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:02.172900 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c71bd2ed-2a4e-4b93-93e1-db8bc9921b96 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:02.204508 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-5c8cd680-e420-48f2-b51b-ec4bdc4f55de req-c724b67c-e961-413c-8876-8e4c12541380 service nova] Creating event network-changed:064dc680-6961-4f4c-a67e-febc7cdc1c7e for instance 331ab87b-109f-48e2-aff1-f0a9639d63b5 on n-h1-master-1 Oct 23 01:49:02.209343 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-5c8cd680-e420-48f2-b51b-ec4bdc4f55de req-c724b67c-e961-413c-8876-8e4c12541380 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067655 Oct 23 01:49:02.210034 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3295/6493] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:49:02.226112 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=100 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:02.367192 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-6d792f44-df4c-487a-9139-7e7656967898 req-dd400db9-9f72-4aa6-a809-e9837a981752 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d73b42e-b2dd-432a-9aa7-59d7f430ba48", "name": "network-vif-plugged", "status": "completed", "tag": "2f5c3df9-21af-4fe1-9265-1a59f21d773b"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:49:02.389296 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-6d792f44-df4c-487a-9139-7e7656967898 req-dd400db9-9f72-4aa6-a809-e9837a981752 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:02.390079 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-6d792f44-df4c-487a-9139-7e7656967898 req-dd400db9-9f72-4aa6-a809-e9837a981752 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:02.390666 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-6d792f44-df4c-487a-9139-7e7656967898 req-dd400db9-9f72-4aa6-a809-e9837a981752 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:02.402344 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-6d792f44-df4c-487a-9139-7e7656967898 req-dd400db9-9f72-4aa6-a809-e9837a981752 service nova] Creating event network-vif-plugged:2f5c3df9-21af-4fe1-9265-1a59f21d773b for instance 4d73b42e-b2dd-432a-9aa7-59d7f430ba48 on n-h1-master-1 Oct 23 01:49:02.408657 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-6d792f44-df4c-487a-9139-7e7656967898 req-dd400db9-9f72-4aa6-a809-e9837a981752 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046432 Oct 23 01:49:02.409464 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3296/6494] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:49:02.738888 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c71bd2ed-2a4e-4b93-93e1-db8bc9921b96 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:02.756713 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c71bd2ed-2a4e-4b93-93e1-db8bc9921b96 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5" status: 200 len: 1564 microversion: 2.1 time: 0.632750 Oct 23 01:49:02.773080 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3199/6495] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:02 2022] GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5 => generated 1564 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:49:03.177496 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c75e4572-ec37-49d6-b3ad-af82d7901e13 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:03.178486 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c75e4572-ec37-49d6-b3ad-af82d7901e13 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] [instance: 4d73b42e-b2dd-432a-9aa7-59d7f430ba48] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:03.193525 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c75e4572-ec37-49d6-b3ad-af82d7901e13 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:03.205824 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c75e4572-ec37-49d6-b3ad-af82d7901e13 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:03.206560 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c75e4572-ec37-49d6-b3ad-af82d7901e13 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:03.208548 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c75e4572-ec37-49d6-b3ad-af82d7901e13 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:03.210733 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c75e4572-ec37-49d6-b3ad-af82d7901e13 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:03.212038 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c75e4572-ec37-49d6-b3ad-af82d7901e13 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:03.604346 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c75e4572-ec37-49d6-b3ad-af82d7901e13 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762ae558fed0436793d2f985617ac4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea87c7cf6a8b40ba914da392ab262edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:03.612759 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c75e4572-ec37-49d6-b3ad-af82d7901e13 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] 10.222.0.42 "GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48" status: 200 len: 1315 microversion: 2.1 time: 0.440283 Oct 23 01:49:03.626475 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3297/6496] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:03 2022] GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48 => generated 1315 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:49:04.639247 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5229b354-e5c7-4765-a558-af6f1b61e3e1 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:04.640735 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5229b354-e5c7-4765-a558-af6f1b61e3e1 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] [instance: 4d73b42e-b2dd-432a-9aa7-59d7f430ba48] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:04.658036 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5229b354-e5c7-4765-a558-af6f1b61e3e1 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:04.665792 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5229b354-e5c7-4765-a558-af6f1b61e3e1 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:04.666996 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5229b354-e5c7-4765-a558-af6f1b61e3e1 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:04.669591 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5229b354-e5c7-4765-a558-af6f1b61e3e1 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:04.669591 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5229b354-e5c7-4765-a558-af6f1b61e3e1 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:04.669591 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5229b354-e5c7-4765-a558-af6f1b61e3e1 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:05.120071 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5229b354-e5c7-4765-a558-af6f1b61e3e1 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762ae558fed0436793d2f985617ac4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea87c7cf6a8b40ba914da392ab262edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:05.129060 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5229b354-e5c7-4765-a558-af6f1b61e3e1 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] 10.222.0.42 "GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48" status: 200 len: 1502 microversion: 2.1 time: 0.495743 Oct 23 01:49:05.130973 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3200/6497] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:04 2022] GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48 => generated 1502 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:49:05.154793 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fe40eaac-ad4e-47ba-9621-9eb954440507 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:05.156210 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fe40eaac-ad4e-47ba-9621-9eb954440507 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] [instance: 4d73b42e-b2dd-432a-9aa7-59d7f430ba48] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:05.163566 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe40eaac-ad4e-47ba-9621-9eb954440507 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:05.164579 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe40eaac-ad4e-47ba-9621-9eb954440507 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:05.165314 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe40eaac-ad4e-47ba-9621-9eb954440507 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:05.166954 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe40eaac-ad4e-47ba-9621-9eb954440507 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:05.167535 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe40eaac-ad4e-47ba-9621-9eb954440507 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:05.168138 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe40eaac-ad4e-47ba-9621-9eb954440507 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:05.688415 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fe40eaac-ad4e-47ba-9621-9eb954440507 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762ae558fed0436793d2f985617ac4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea87c7cf6a8b40ba914da392ab262edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:05.737000 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fe40eaac-ad4e-47ba-9621-9eb954440507 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] 10.222.0.42 "GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48" status: 200 len: 1502 microversion: 2.1 time: 0.545728 Oct 23 01:49:05.737000 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3298/6498] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:05 2022] GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48 => generated 1502 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:49:05.758771 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d2d15959-9d50-4ad7-866b-e293d28f66f3 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:49:05.759303 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d2d15959-9d50-4ad7-866b-e293d28f66f3 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] [instance: 4d73b42e-b2dd-432a-9aa7-59d7f430ba48] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:05.766220 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d2d15959-9d50-4ad7-866b-e293d28f66f3 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:05.766704 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d2d15959-9d50-4ad7-866b-e293d28f66f3 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:05.767137 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d2d15959-9d50-4ad7-866b-e293d28f66f3 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:05.767819 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d2d15959-9d50-4ad7-866b-e293d28f66f3 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:05.768273 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d2d15959-9d50-4ad7-866b-e293d28f66f3 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:05.768695 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d2d15959-9d50-4ad7-866b-e293d28f66f3 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:05.791899 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-d2d15959-9d50-4ad7-866b-e293d28f66f3 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lazy-loading 'flavor' on Instance uuid 4d73b42e-b2dd-432a-9aa7-59d7f430ba48 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:49:06.140670 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d2d15959-9d50-4ad7-866b-e293d28f66f3 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] 10.222.0.42 "POST /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48/action" status: 202 len: 0 microversion: 2.1 time: 0.381800 Oct 23 01:49:06.140670 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3201/6499] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:49:05 2022] POST /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48/action => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:49:06.158347 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-da9c05f4-9bbf-466e-808e-e87e700bf122 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:06.160206 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-da9c05f4-9bbf-466e-808e-e87e700bf122 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] [instance: 4d73b42e-b2dd-432a-9aa7-59d7f430ba48] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:06.178391 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-da9c05f4-9bbf-466e-808e-e87e700bf122 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:06.179162 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-da9c05f4-9bbf-466e-808e-e87e700bf122 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:06.182551 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-da9c05f4-9bbf-466e-808e-e87e700bf122 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:06.183493 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-da9c05f4-9bbf-466e-808e-e87e700bf122 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:06.184128 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-da9c05f4-9bbf-466e-808e-e87e700bf122 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:06.185277 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-da9c05f4-9bbf-466e-808e-e87e700bf122 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:06.381179 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-da9c05f4-9bbf-466e-808e-e87e700bf122 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762ae558fed0436793d2f985617ac4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea87c7cf6a8b40ba914da392ab262edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:06.392923 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-da9c05f4-9bbf-466e-808e-e87e700bf122 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] 10.222.0.42 "GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48" status: 200 len: 1510 microversion: 2.1 time: 0.247819 Oct 23 01:49:06.393690 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3299/6500] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:06 2022] GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48 => generated 1510 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:49:07.417701 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a6295a3f-f2bc-4380-99d3-5294cd954aec tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:07.419170 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a6295a3f-f2bc-4380-99d3-5294cd954aec tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] [instance: 4d73b42e-b2dd-432a-9aa7-59d7f430ba48] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:07.425950 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a6295a3f-f2bc-4380-99d3-5294cd954aec tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:07.426980 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a6295a3f-f2bc-4380-99d3-5294cd954aec tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:07.427586 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a6295a3f-f2bc-4380-99d3-5294cd954aec tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:07.428477 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a6295a3f-f2bc-4380-99d3-5294cd954aec tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:07.429089 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a6295a3f-f2bc-4380-99d3-5294cd954aec tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:07.429670 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a6295a3f-f2bc-4380-99d3-5294cd954aec tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:07.610083 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a6295a3f-f2bc-4380-99d3-5294cd954aec tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762ae558fed0436793d2f985617ac4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea87c7cf6a8b40ba914da392ab262edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:07.627290 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a6295a3f-f2bc-4380-99d3-5294cd954aec tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] 10.222.0.42 "GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48" status: 200 len: 1493 microversion: 2.1 time: 0.214680 Oct 23 01:49:07.634064 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3202/6501] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:07 2022] GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48 => generated 1493 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:49:07.652044 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a0ade371-7cda-44ac-9d1a-0e4a51868889 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:49:07.652587 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a0ade371-7cda-44ac-9d1a-0e4a51868889 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] [instance: 4d73b42e-b2dd-432a-9aa7-59d7f430ba48] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:07.665964 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a0ade371-7cda-44ac-9d1a-0e4a51868889 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:07.666496 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a0ade371-7cda-44ac-9d1a-0e4a51868889 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:07.666949 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a0ade371-7cda-44ac-9d1a-0e4a51868889 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:07.667677 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a0ade371-7cda-44ac-9d1a-0e4a51868889 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:07.668145 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a0ade371-7cda-44ac-9d1a-0e4a51868889 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:07.668579 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a0ade371-7cda-44ac-9d1a-0e4a51868889 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:08.052512 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a0ade371-7cda-44ac-9d1a-0e4a51868889 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] 10.222.0.42 "POST /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48/action" status: 202 len: 0 microversion: 2.1 time: 0.403316 Oct 23 01:49:08.056267 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3300/6502] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:49:07 2022] POST /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48/action => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:49:08.062329 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7cb69eda-df66-44c0-ac17-7f57fb22c247 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:08.063797 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7cb69eda-df66-44c0-ac17-7f57fb22c247 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] [instance: 4d73b42e-b2dd-432a-9aa7-59d7f430ba48] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:08.073701 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7cb69eda-df66-44c0-ac17-7f57fb22c247 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:08.074255 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7cb69eda-df66-44c0-ac17-7f57fb22c247 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:08.074703 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7cb69eda-df66-44c0-ac17-7f57fb22c247 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:08.079346 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7cb69eda-df66-44c0-ac17-7f57fb22c247 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:08.094183 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7cb69eda-df66-44c0-ac17-7f57fb22c247 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:08.094183 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7cb69eda-df66-44c0-ac17-7f57fb22c247 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:08.367449 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7cb69eda-df66-44c0-ac17-7f57fb22c247 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762ae558fed0436793d2f985617ac4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea87c7cf6a8b40ba914da392ab262edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:08.390321 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7cb69eda-df66-44c0-ac17-7f57fb22c247 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] 10.222.0.42 "GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48" status: 200 len: 1499 microversion: 2.1 time: 0.328949 Oct 23 01:49:08.390321 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3203/6503] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:08 2022] GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48 => generated 1499 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:49:09.417051 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b0cba965-489c-49d1-ae28-1e644cd56f7c tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:09.418470 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b0cba965-489c-49d1-ae28-1e644cd56f7c tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] [instance: 4d73b42e-b2dd-432a-9aa7-59d7f430ba48] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:09.435652 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:09.441437 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b0cba965-489c-49d1-ae28-1e644cd56f7c tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:09.444781 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b0cba965-489c-49d1-ae28-1e644cd56f7c tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:09.445566 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b0cba965-489c-49d1-ae28-1e644cd56f7c tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:09.448583 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b0cba965-489c-49d1-ae28-1e644cd56f7c tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:09.450122 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b0cba965-489c-49d1-ae28-1e644cd56f7c tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:09.451636 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b0cba965-489c-49d1-ae28-1e644cd56f7c tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:09.765627 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=12 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:10.528988 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b0cba965-489c-49d1-ae28-1e644cd56f7c tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762ae558fed0436793d2f985617ac4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea87c7cf6a8b40ba914da392ab262edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:10.541453 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b0cba965-489c-49d1-ae28-1e644cd56f7c tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] 10.222.0.42 "GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48" status: 200 len: 1499 microversion: 2.1 time: 1.133405 Oct 23 01:49:10.543150 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3301/6504] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:09 2022] GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48 => generated 1499 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:49:11.567458 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-495e81b3-aab6-478c-80bd-33d2dd14fd44 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:11.568254 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-495e81b3-aab6-478c-80bd-33d2dd14fd44 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] [instance: 4d73b42e-b2dd-432a-9aa7-59d7f430ba48] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:11.583594 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-495e81b3-aab6-478c-80bd-33d2dd14fd44 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:11.586711 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-495e81b3-aab6-478c-80bd-33d2dd14fd44 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:11.587469 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-495e81b3-aab6-478c-80bd-33d2dd14fd44 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:11.589599 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-495e81b3-aab6-478c-80bd-33d2dd14fd44 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:11.595014 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-495e81b3-aab6-478c-80bd-33d2dd14fd44 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:11.598566 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-495e81b3-aab6-478c-80bd-33d2dd14fd44 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:12.206454 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-495e81b3-aab6-478c-80bd-33d2dd14fd44 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762ae558fed0436793d2f985617ac4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea87c7cf6a8b40ba914da392ab262edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:12.254787 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-495e81b3-aab6-478c-80bd-33d2dd14fd44 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] 10.222.0.42 "GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48" status: 200 len: 1502 microversion: 2.1 time: 0.691300 Oct 23 01:49:12.256893 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3204/6505] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:11 2022] GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48 => generated 1502 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:49:12.291736 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-23ff24f5-8a9f-4641-abb0-8ad186b7c63a tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:49:12.292249 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-23ff24f5-8a9f-4641-abb0-8ad186b7c63a tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] [instance: 4d73b42e-b2dd-432a-9aa7-59d7f430ba48] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:12.302039 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-23ff24f5-8a9f-4641-abb0-8ad186b7c63a tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:12.302552 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-23ff24f5-8a9f-4641-abb0-8ad186b7c63a tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:12.303066 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-23ff24f5-8a9f-4641-abb0-8ad186b7c63a tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:12.303831 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-23ff24f5-8a9f-4641-abb0-8ad186b7c63a tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:12.308343 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-23ff24f5-8a9f-4641-abb0-8ad186b7c63a tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:12.308343 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-23ff24f5-8a9f-4641-abb0-8ad186b7c63a tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:12.332224 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-23ff24f5-8a9f-4641-abb0-8ad186b7c63a tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lazy-loading 'flavor' on Instance uuid 4d73b42e-b2dd-432a-9aa7-59d7f430ba48 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:49:12.777665 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-23ff24f5-8a9f-4641-abb0-8ad186b7c63a tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] 10.222.0.42 "POST /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48/action" status: 202 len: 0 microversion: 2.1 time: 0.492513 Oct 23 01:49:12.779634 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3302/6506] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:49:12 2022] POST /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48/action => generated 0 bytes in 497 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:49:12.787975 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-99784b4a-2653-4894-9ced-4abce7fd276d tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:12.789934 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-99784b4a-2653-4894-9ced-4abce7fd276d tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] [instance: 4d73b42e-b2dd-432a-9aa7-59d7f430ba48] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:12.797628 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:12.802083 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-99784b4a-2653-4894-9ced-4abce7fd276d tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:12.802770 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-99784b4a-2653-4894-9ced-4abce7fd276d tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:12.803518 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-99784b4a-2653-4894-9ced-4abce7fd276d tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:12.809334 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-99784b4a-2653-4894-9ced-4abce7fd276d tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:12.809334 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-99784b4a-2653-4894-9ced-4abce7fd276d tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:12.809334 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-99784b4a-2653-4894-9ced-4abce7fd276d tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:13.089157 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-99784b4a-2653-4894-9ced-4abce7fd276d tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762ae558fed0436793d2f985617ac4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea87c7cf6a8b40ba914da392ab262edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:13.098431 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-99784b4a-2653-4894-9ced-4abce7fd276d tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] 10.222.0.42 "GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48" status: 200 len: 1510 microversion: 2.1 time: 0.314384 Oct 23 01:49:13.099615 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3205/6507] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:12 2022] GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48 => generated 1510 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:49:14.127796 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-849fd09e-f19c-496e-b4d9-ae316b991fc1 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:14.129665 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-849fd09e-f19c-496e-b4d9-ae316b991fc1 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] [instance: 4d73b42e-b2dd-432a-9aa7-59d7f430ba48] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:14.143027 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-849fd09e-f19c-496e-b4d9-ae316b991fc1 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:14.143782 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-849fd09e-f19c-496e-b4d9-ae316b991fc1 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:14.144417 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-849fd09e-f19c-496e-b4d9-ae316b991fc1 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:14.146284 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-849fd09e-f19c-496e-b4d9-ae316b991fc1 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:14.147030 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-849fd09e-f19c-496e-b4d9-ae316b991fc1 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:14.147780 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-849fd09e-f19c-496e-b4d9-ae316b991fc1 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:14.425695 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-849fd09e-f19c-496e-b4d9-ae316b991fc1 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762ae558fed0436793d2f985617ac4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea87c7cf6a8b40ba914da392ab262edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:14.439733 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-849fd09e-f19c-496e-b4d9-ae316b991fc1 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] 10.222.0.42 "GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48" status: 200 len: 1493 microversion: 2.1 time: 0.318545 Oct 23 01:49:14.441280 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3303/6508] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:14 2022] GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48 => generated 1493 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:49:14.464064 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-71ed3523-0f07-4adf-b27d-b2554b33e3cc tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:49:14.465164 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-71ed3523-0f07-4adf-b27d-b2554b33e3cc tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] [instance: 4d73b42e-b2dd-432a-9aa7-59d7f430ba48] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:14.493643 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-71ed3523-0f07-4adf-b27d-b2554b33e3cc tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:14.494357 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-71ed3523-0f07-4adf-b27d-b2554b33e3cc tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:14.495462 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-71ed3523-0f07-4adf-b27d-b2554b33e3cc tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:14.497018 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-71ed3523-0f07-4adf-b27d-b2554b33e3cc tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:14.498075 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-71ed3523-0f07-4adf-b27d-b2554b33e3cc tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:14.498676 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-71ed3523-0f07-4adf-b27d-b2554b33e3cc tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:14.760895 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-71ed3523-0f07-4adf-b27d-b2554b33e3cc tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] 10.222.0.42 "POST /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48/action" status: 202 len: 0 microversion: 2.1 time: 0.300733 Oct 23 01:49:14.761898 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3206/6509] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:49:14 2022] POST /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:49:14.781098 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d2451b05-80a0-40ba-962b-61bfa103e1b3 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:14.782205 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d2451b05-80a0-40ba-962b-61bfa103e1b3 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] [instance: 4d73b42e-b2dd-432a-9aa7-59d7f430ba48] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:14.807486 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d2451b05-80a0-40ba-962b-61bfa103e1b3 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:14.808221 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d2451b05-80a0-40ba-962b-61bfa103e1b3 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:14.812712 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d2451b05-80a0-40ba-962b-61bfa103e1b3 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:14.813860 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d2451b05-80a0-40ba-962b-61bfa103e1b3 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:14.814585 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d2451b05-80a0-40ba-962b-61bfa103e1b3 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:14.815187 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d2451b05-80a0-40ba-962b-61bfa103e1b3 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:14.985846 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bedf24c8-9e67-411f-97d2-4cb519a0ac77 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-973462640-access_point-1116207811", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "58215d09-cc17-455f-ad39-cf295bd971d7"}], "key_name": "tempest-TestSecurityGroupsBasicOps-484001668", "security_groups": [{"name": "tempest-secgroup_access--69391246"}, {"name": "tempest-secgroup_general--988767071"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:49:15.175423 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d2451b05-80a0-40ba-962b-61bfa103e1b3 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762ae558fed0436793d2f985617ac4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea87c7cf6a8b40ba914da392ab262edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:15.187921 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d2451b05-80a0-40ba-962b-61bfa103e1b3 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] 10.222.0.42 "GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48" status: 200 len: 1499 microversion: 2.1 time: 0.414126 Oct 23 01:49:15.191957 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3304/6510] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:14 2022] GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48 => generated 1499 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:49:15.455666 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-bedf24c8-9e67-411f-97d2-4cb519a0ac77 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] validate_networks() for [('58215d09-cc17-455f-ad39-cf295bd971d7', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:49:16.217186 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-85db50c7-03c0-4862-b5f3-d701f3832834 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:16.218429 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-85db50c7-03c0-4862-b5f3-d701f3832834 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] [instance: 4d73b42e-b2dd-432a-9aa7-59d7f430ba48] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:16.226681 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-85db50c7-03c0-4862-b5f3-d701f3832834 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:16.227277 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-85db50c7-03c0-4862-b5f3-d701f3832834 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:16.228033 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-85db50c7-03c0-4862-b5f3-d701f3832834 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:16.229260 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-85db50c7-03c0-4862-b5f3-d701f3832834 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:16.229881 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-85db50c7-03c0-4862-b5f3-d701f3832834 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:16.230483 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-85db50c7-03c0-4862-b5f3-d701f3832834 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:16.685808 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-85db50c7-03c0-4862-b5f3-d701f3832834 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762ae558fed0436793d2f985617ac4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea87c7cf6a8b40ba914da392ab262edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:16.694994 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-85db50c7-03c0-4862-b5f3-d701f3832834 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] 10.222.0.42 "GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48" status: 200 len: 1499 microversion: 2.1 time: 0.483659 Oct 23 01:49:16.715311 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3305/6511] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:16 2022] GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48 => generated 1499 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:49:16.903070 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-bedf24c8-9e67-411f-97d2-4cb519a0ac77 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:49:16.904271 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-bedf24c8-9e67-411f-97d2-4cb519a0ac77 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:49:16.904752 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-bedf24c8-9e67-411f-97d2-4cb519a0ac77 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:49:16.905208 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-bedf24c8-9e67-411f-97d2-4cb519a0ac77 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:49:16.905629 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-bedf24c8-9e67-411f-97d2-4cb519a0ac77 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:49:16.915410 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bedf24c8-9e67-411f-97d2-4cb519a0ac77 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:16.915899 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bedf24c8-9e67-411f-97d2-4cb519a0ac77 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:16.916637 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bedf24c8-9e67-411f-97d2-4cb519a0ac77 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:16.917441 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bedf24c8-9e67-411f-97d2-4cb519a0ac77 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:16.918130 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bedf24c8-9e67-411f-97d2-4cb519a0ac77 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:16.919055 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bedf24c8-9e67-411f-97d2-4cb519a0ac77 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:16.950366 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-bedf24c8-9e67-411f-97d2-4cb519a0ac77 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Getting quotas for project a028aafec3294eae9a1c1a9a4e907dc2. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:49:16.956831 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-bedf24c8-9e67-411f-97d2-4cb519a0ac77 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Getting quotas for user 38c7799d37d747b08a9e20e15c3d6879 and project a028aafec3294eae9a1c1a9a4e907dc2. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:49:16.971119 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-bedf24c8-9e67-411f-97d2-4cb519a0ac77 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:49:16.973170 n-d-master-1 devstack@n-api.service[120945]: WARNING nova.utils [None req-bedf24c8-9e67-411f-97d2-4cb519a0ac77 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-973462640-access_point-1116207811 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-973462640-acc Oct 23 01:49:16.974053 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-bedf24c8-9e67-411f-97d2-4cb519a0ac77 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] [instance: 64804b2c-74aa-4e67-8eba-75a5c4f7db76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:49:17.076176 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6ded1976-9322-4818-84b9-5f832e170d36 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:17.076791 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6ded1976-9322-4818-84b9-5f832e170d36 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] [instance: 3e32a61e-2dd1-458a-bced-55e7d351a60c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:17.098950 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6ded1976-9322-4818-84b9-5f832e170d36 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:17.101039 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6ded1976-9322-4818-84b9-5f832e170d36 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:17.101039 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6ded1976-9322-4818-84b9-5f832e170d36 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:17.101039 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6ded1976-9322-4818-84b9-5f832e170d36 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:17.102571 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6ded1976-9322-4818-84b9-5f832e170d36 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:17.103134 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6ded1976-9322-4818-84b9-5f832e170d36 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:17.145305 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bedf24c8-9e67-411f-97d2-4cb519a0ac77 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 455 microversion: 2.1 time: 2.167196 Oct 23 01:49:17.152028 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3207/6512] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:49:14 2022] POST /compute/v2.1/servers => generated 455 bytes in 2169 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:49:17.158256 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d57f0be4-6b0d-4aa0-938b-1cf2df67bfd2 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:17.159963 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d57f0be4-6b0d-4aa0-938b-1cf2df67bfd2 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] [instance: 64804b2c-74aa-4e67-8eba-75a5c4f7db76] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:17.242896 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-6ded1976-9322-4818-84b9-5f832e170d36 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lazy-loading 'services' on Instance uuid 3e32a61e-2dd1-458a-bced-55e7d351a60c {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:49:17.253074 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d57f0be4-6b0d-4aa0-938b-1cf2df67bfd2 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c7799d37d747b08a9e20e15c3d6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a028aafec3294eae9a1c1a9a4e907dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:17.266427 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d57f0be4-6b0d-4aa0-938b-1cf2df67bfd2 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] 10.222.0.42 "GET /compute/v2.1/servers/64804b2c-74aa-4e67-8eba-75a5c4f7db76" status: 200 len: 1293 microversion: 2.1 time: 0.108815 Oct 23 01:49:17.266427 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3208/6513] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:17 2022] GET /compute/v2.1/servers/64804b2c-74aa-4e67-8eba-75a5c4f7db76 => generated 1293 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:49:17.377386 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:17.466198 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6ded1976-9322-4818-84b9-5f832e170d36 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3e32a61e-2dd1-458a-bced-55e7d351a60c/os-volume_attachments/ce8a134d-389d-49a5-90e8-5eb0444430b0" status: 202 len: 0 microversion: 2.1 time: 0.394454 Oct 23 01:49:17.466806 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3306/6514] 10.222.0.42 () {58 vars in 1416 bytes} [Sun Oct 23 01:49:17 2022] DELETE /compute/v2.1/servers/3e32a61e-2dd1-458a-bced-55e7d351a60c/os-volume_attachments/ce8a134d-389d-49a5-90e8-5eb0444430b0 => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:49:17.722746 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9f927394-0207-43b8-ae70-ab3fe8e736c7 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:17.723618 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9f927394-0207-43b8-ae70-ab3fe8e736c7 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] [instance: 4d73b42e-b2dd-432a-9aa7-59d7f430ba48] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:17.734702 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f927394-0207-43b8-ae70-ab3fe8e736c7 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:17.735202 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f927394-0207-43b8-ae70-ab3fe8e736c7 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:17.735644 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f927394-0207-43b8-ae70-ab3fe8e736c7 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:17.736359 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f927394-0207-43b8-ae70-ab3fe8e736c7 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:17.736815 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f927394-0207-43b8-ae70-ab3fe8e736c7 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:17.737248 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f927394-0207-43b8-ae70-ab3fe8e736c7 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:17.967376 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9f927394-0207-43b8-ae70-ab3fe8e736c7 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762ae558fed0436793d2f985617ac4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea87c7cf6a8b40ba914da392ab262edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:17.975469 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9f927394-0207-43b8-ae70-ab3fe8e736c7 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] 10.222.0.42 "GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48" status: 200 len: 1499 microversion: 2.1 time: 0.256740 Oct 23 01:49:17.976285 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3209/6515] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:17 2022] GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48 => generated 1499 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:49:18.285665 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3cecea1c-69df-43b2-a52a-17f7a3da4e2a tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:18.286405 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3cecea1c-69df-43b2-a52a-17f7a3da4e2a tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] [instance: 64804b2c-74aa-4e67-8eba-75a5c4f7db76] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:18.375733 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3cecea1c-69df-43b2-a52a-17f7a3da4e2a tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c7799d37d747b08a9e20e15c3d6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a028aafec3294eae9a1c1a9a4e907dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:18.390147 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3cecea1c-69df-43b2-a52a-17f7a3da4e2a tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] 10.222.0.42 "GET /compute/v2.1/servers/64804b2c-74aa-4e67-8eba-75a5c4f7db76" status: 200 len: 1293 microversion: 2.1 time: 0.108795 Oct 23 01:49:18.408966 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3307/6516] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:18 2022] GET /compute/v2.1/servers/64804b2c-74aa-4e67-8eba-75a5c4f7db76 => generated 1293 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:49:19.000782 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ebe69586-b046-49f9-abd5-5209954695ce tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:19.006151 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ebe69586-b046-49f9-abd5-5209954695ce tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] [instance: 4d73b42e-b2dd-432a-9aa7-59d7f430ba48] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:19.012003 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ebe69586-b046-49f9-abd5-5209954695ce tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:19.012730 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ebe69586-b046-49f9-abd5-5209954695ce tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:19.013387 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ebe69586-b046-49f9-abd5-5209954695ce tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:19.014439 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ebe69586-b046-49f9-abd5-5209954695ce tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:19.015270 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ebe69586-b046-49f9-abd5-5209954695ce tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:19.015935 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ebe69586-b046-49f9-abd5-5209954695ce tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:19.229380 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ebe69586-b046-49f9-abd5-5209954695ce tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762ae558fed0436793d2f985617ac4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea87c7cf6a8b40ba914da392ab262edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:19.253314 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ebe69586-b046-49f9-abd5-5209954695ce tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] 10.222.0.42 "GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48" status: 200 len: 1502 microversion: 2.1 time: 0.257072 Oct 23 01:49:19.267434 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3210/6517] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:18 2022] GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48 => generated 1502 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:49:19.282087 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-807b20ca-707f-44af-ba71-b1da668c9d77 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:19.282607 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-807b20ca-707f-44af-ba71-b1da668c9d77 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] [instance: 4d73b42e-b2dd-432a-9aa7-59d7f430ba48] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:19.296120 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-807b20ca-707f-44af-ba71-b1da668c9d77 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:19.296823 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-807b20ca-707f-44af-ba71-b1da668c9d77 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:19.297025 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-807b20ca-707f-44af-ba71-b1da668c9d77 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:19.301665 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-807b20ca-707f-44af-ba71-b1da668c9d77 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:19.303699 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-807b20ca-707f-44af-ba71-b1da668c9d77 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:19.304371 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-807b20ca-707f-44af-ba71-b1da668c9d77 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:19.340209 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-807b20ca-707f-44af-ba71-b1da668c9d77 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] [instance: 4d73b42e-b2dd-432a-9aa7-59d7f430ba48] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:49:19.413697 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e6e008b2-3411-4eaa-90e7-a86133b61fb4 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:19.414971 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e6e008b2-3411-4eaa-90e7-a86133b61fb4 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] [instance: 64804b2c-74aa-4e67-8eba-75a5c4f7db76] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:19.423749 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6e008b2-3411-4eaa-90e7-a86133b61fb4 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:19.424815 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6e008b2-3411-4eaa-90e7-a86133b61fb4 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:19.426124 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6e008b2-3411-4eaa-90e7-a86133b61fb4 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:19.427190 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6e008b2-3411-4eaa-90e7-a86133b61fb4 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:19.427759 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6e008b2-3411-4eaa-90e7-a86133b61fb4 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:19.428246 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6e008b2-3411-4eaa-90e7-a86133b61fb4 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:19.557597 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e6e008b2-3411-4eaa-90e7-a86133b61fb4 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c7799d37d747b08a9e20e15c3d6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a028aafec3294eae9a1c1a9a4e907dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:19.569268 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e6e008b2-3411-4eaa-90e7-a86133b61fb4 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] 10.222.0.42 "GET /compute/v2.1/servers/64804b2c-74aa-4e67-8eba-75a5c4f7db76" status: 200 len: 1345 microversion: 2.1 time: 0.159138 Oct 23 01:49:19.573049 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3211/6518] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:19 2022] GET /compute/v2.1/servers/64804b2c-74aa-4e67-8eba-75a5c4f7db76 => generated 1345 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:49:19.685295 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-807b20ca-707f-44af-ba71-b1da668c9d77 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48" status: 204 len: 0 microversion: 2.1 time: 0.410752 Oct 23 01:49:19.686319 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3308/6519] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:49:19 2022] DELETE /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:49:19.696252 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9a595395-f66f-4bc2-b7df-150f3ab15c61 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:19.699554 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9a595395-f66f-4bc2-b7df-150f3ab15c61 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] [instance: 4d73b42e-b2dd-432a-9aa7-59d7f430ba48] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:19.714620 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a595395-f66f-4bc2-b7df-150f3ab15c61 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:19.722791 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a595395-f66f-4bc2-b7df-150f3ab15c61 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:19.726650 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a595395-f66f-4bc2-b7df-150f3ab15c61 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:19.727789 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a595395-f66f-4bc2-b7df-150f3ab15c61 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:19.729883 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a595395-f66f-4bc2-b7df-150f3ab15c61 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:19.731260 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a595395-f66f-4bc2-b7df-150f3ab15c61 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:19.979468 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9a595395-f66f-4bc2-b7df-150f3ab15c61 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762ae558fed0436793d2f985617ac4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea87c7cf6a8b40ba914da392ab262edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:19.987773 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9a595395-f66f-4bc2-b7df-150f3ab15c61 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] 10.222.0.42 "GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48" status: 200 len: 1508 microversion: 2.1 time: 0.296337 Oct 23 01:49:19.988367 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3212/6520] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:19 2022] GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48 => generated 1508 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:49:20.593434 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2c785d97-bf69-4fc9-8d1e-7606a8f09652 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:20.594837 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2c785d97-bf69-4fc9-8d1e-7606a8f09652 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] [instance: 64804b2c-74aa-4e67-8eba-75a5c4f7db76] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:20.613694 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2c785d97-bf69-4fc9-8d1e-7606a8f09652 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:20.614671 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2c785d97-bf69-4fc9-8d1e-7606a8f09652 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:20.615360 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2c785d97-bf69-4fc9-8d1e-7606a8f09652 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:20.616328 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2c785d97-bf69-4fc9-8d1e-7606a8f09652 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:20.617251 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2c785d97-bf69-4fc9-8d1e-7606a8f09652 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:20.617894 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2c785d97-bf69-4fc9-8d1e-7606a8f09652 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:20.728996 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2c785d97-bf69-4fc9-8d1e-7606a8f09652 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c7799d37d747b08a9e20e15c3d6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a028aafec3294eae9a1c1a9a4e907dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:20.740768 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2c785d97-bf69-4fc9-8d1e-7606a8f09652 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] 10.222.0.42 "GET /compute/v2.1/servers/64804b2c-74aa-4e67-8eba-75a5c4f7db76" status: 200 len: 1351 microversion: 2.1 time: 0.151668 Oct 23 01:49:20.741480 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3309/6521] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:20 2022] GET /compute/v2.1/servers/64804b2c-74aa-4e67-8eba-75a5c4f7db76 => generated 1351 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:49:21.011972 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cb334097-b2b5-4ec7-a126-e8dc5d41514a tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:21.014661 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cb334097-b2b5-4ec7-a126-e8dc5d41514a tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] [instance: 4d73b42e-b2dd-432a-9aa7-59d7f430ba48] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:21.026493 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb334097-b2b5-4ec7-a126-e8dc5d41514a tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:21.027278 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb334097-b2b5-4ec7-a126-e8dc5d41514a tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:21.033679 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb334097-b2b5-4ec7-a126-e8dc5d41514a tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:21.034716 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb334097-b2b5-4ec7-a126-e8dc5d41514a tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:21.035461 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb334097-b2b5-4ec7-a126-e8dc5d41514a tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:21.036154 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb334097-b2b5-4ec7-a126-e8dc5d41514a tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:21.316114 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cb334097-b2b5-4ec7-a126-e8dc5d41514a tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762ae558fed0436793d2f985617ac4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea87c7cf6a8b40ba914da392ab262edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:21.326049 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cb334097-b2b5-4ec7-a126-e8dc5d41514a tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] 10.222.0.42 "GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48" status: 200 len: 1508 microversion: 2.1 time: 0.317709 Oct 23 01:49:21.327929 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3213/6522] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:21 2022] GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48 => generated 1508 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:49:21.766897 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a18481db-a580-43e0-8942-a8272d71c413 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:21.767622 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a18481db-a580-43e0-8942-a8272d71c413 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] [instance: 64804b2c-74aa-4e67-8eba-75a5c4f7db76] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:21.783437 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a18481db-a580-43e0-8942-a8272d71c413 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:21.784080 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a18481db-a580-43e0-8942-a8272d71c413 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:21.784522 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a18481db-a580-43e0-8942-a8272d71c413 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:21.785234 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a18481db-a580-43e0-8942-a8272d71c413 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:21.785689 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a18481db-a580-43e0-8942-a8272d71c413 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:21.786996 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a18481db-a580-43e0-8942-a8272d71c413 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:22.270579 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c778cf0b-a07f-4785-809e-f3ad220a9c98 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:49:22.279576 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c778cf0b-a07f-4785-809e-f3ad220a9c98 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 331ab87b-109f-48e2-aff1-f0a9639d63b5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:22.292794 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c778cf0b-a07f-4785-809e-f3ad220a9c98 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:22.294394 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c778cf0b-a07f-4785-809e-f3ad220a9c98 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:22.297321 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c778cf0b-a07f-4785-809e-f3ad220a9c98 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:22.298427 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c778cf0b-a07f-4785-809e-f3ad220a9c98 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:22.301454 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c778cf0b-a07f-4785-809e-f3ad220a9c98 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:22.302855 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c778cf0b-a07f-4785-809e-f3ad220a9c98 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:22.415264 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c778cf0b-a07f-4785-809e-f3ad220a9c98 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "POST /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5/action" status: 200 len: 24572 microversion: 2.1 time: 0.157735 Oct 23 01:49:22.423948 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3214/6523] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:49:22 2022] POST /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5/action => generated 24572 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:49:22.440599 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-786b152b-4e0a-4f9d-9860-e1a81012ada6 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:22.441695 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-786b152b-4e0a-4f9d-9860-e1a81012ada6 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] [instance: 4d73b42e-b2dd-432a-9aa7-59d7f430ba48] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:22.450022 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-786b152b-4e0a-4f9d-9860-e1a81012ada6 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:22.451504 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-786b152b-4e0a-4f9d-9860-e1a81012ada6 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:22.452191 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-786b152b-4e0a-4f9d-9860-e1a81012ada6 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:22.453951 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-786b152b-4e0a-4f9d-9860-e1a81012ada6 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:22.454874 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-786b152b-4e0a-4f9d-9860-e1a81012ada6 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:22.455523 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-786b152b-4e0a-4f9d-9860-e1a81012ada6 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:22.486221 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:22.795720 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a18481db-a580-43e0-8942-a8272d71c413 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c7799d37d747b08a9e20e15c3d6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a028aafec3294eae9a1c1a9a4e907dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:22.832477 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a18481db-a580-43e0-8942-a8272d71c413 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] 10.222.0.42 "GET /compute/v2.1/servers/64804b2c-74aa-4e67-8eba-75a5c4f7db76" status: 200 len: 1468 microversion: 2.1 time: 1.046044 Oct 23 01:49:22.833150 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3310/6524] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:21 2022] GET /compute/v2.1/servers/64804b2c-74aa-4e67-8eba-75a5c4f7db76 => generated 1468 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:49:22.865606 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-2ff45f22-b18d-4763-9dc7-967d77726b04 req-0f5f2bdf-1537-4c31-adf9-0598f93366b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64804b2c-74aa-4e67-8eba-75a5c4f7db76", "tag": "4d84cc9b-7464-4aba-a4a3-4b45e5c6aada"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:49:22.886316 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-786b152b-4e0a-4f9d-9860-e1a81012ada6 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762ae558fed0436793d2f985617ac4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea87c7cf6a8b40ba914da392ab262edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:22.892027 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-2ff45f22-b18d-4763-9dc7-967d77726b04 req-0f5f2bdf-1537-4c31-adf9-0598f93366b6 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:22.892774 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-2ff45f22-b18d-4763-9dc7-967d77726b04 req-0f5f2bdf-1537-4c31-adf9-0598f93366b6 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:22.893363 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-2ff45f22-b18d-4763-9dc7-967d77726b04 req-0f5f2bdf-1537-4c31-adf9-0598f93366b6 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:22.900443 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-786b152b-4e0a-4f9d-9860-e1a81012ada6 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] 10.222.0.42 "GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48" status: 200 len: 1508 microversion: 2.1 time: 0.469914 Oct 23 01:49:22.906233 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3215/6525] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:22 2022] GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48 => generated 1508 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:49:22.906550 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-2ff45f22-b18d-4763-9dc7-967d77726b04 req-0f5f2bdf-1537-4c31-adf9-0598f93366b6 service nova] Creating event network-changed:4d84cc9b-7464-4aba-a4a3-4b45e5c6aada for instance 64804b2c-74aa-4e67-8eba-75a5c4f7db76 on n-h2-master-1 Oct 23 01:49:22.914760 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-2ff45f22-b18d-4763-9dc7-967d77726b04 req-0f5f2bdf-1537-4c31-adf9-0598f93366b6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066552 Oct 23 01:49:22.915979 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3311/6526] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:49:23.514625 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-3eb9e0c2-5b12-432d-a77d-2fe4fc36f64c req-a1cb4f55-ac5e-4c14-83af-ab81e5db4d37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d73b42e-b2dd-432a-9aa7-59d7f430ba48", "name": "network-vif-deleted", "tag": "2f5c3df9-21af-4fe1-9265-1a59f21d773b"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:49:23.532185 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-3eb9e0c2-5b12-432d-a77d-2fe4fc36f64c req-a1cb4f55-ac5e-4c14-83af-ab81e5db4d37 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:23.532690 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-3eb9e0c2-5b12-432d-a77d-2fe4fc36f64c req-a1cb4f55-ac5e-4c14-83af-ab81e5db4d37 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:23.533109 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-3eb9e0c2-5b12-432d-a77d-2fe4fc36f64c req-a1cb4f55-ac5e-4c14-83af-ab81e5db4d37 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:23.555826 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-3eb9e0c2-5b12-432d-a77d-2fe4fc36f64c req-a1cb4f55-ac5e-4c14-83af-ab81e5db4d37 service nova] Creating event network-vif-deleted:2f5c3df9-21af-4fe1-9265-1a59f21d773b for instance 4d73b42e-b2dd-432a-9aa7-59d7f430ba48 on n-h1-master-1 Oct 23 01:49:23.569840 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-3eb9e0c2-5b12-432d-a77d-2fe4fc36f64c req-a1cb4f55-ac5e-4c14-83af-ab81e5db4d37 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058819 Oct 23 01:49:23.570902 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3216/6527] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:49:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:49:23.859796 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-06e239ec-8b91-4640-a97d-78573ba56e09 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:23.860507 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-06e239ec-8b91-4640-a97d-78573ba56e09 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] [instance: 64804b2c-74aa-4e67-8eba-75a5c4f7db76] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:23.866990 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-06e239ec-8b91-4640-a97d-78573ba56e09 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:23.867748 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-06e239ec-8b91-4640-a97d-78573ba56e09 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:23.868546 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-06e239ec-8b91-4640-a97d-78573ba56e09 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:23.869792 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-06e239ec-8b91-4640-a97d-78573ba56e09 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:23.870483 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-06e239ec-8b91-4640-a97d-78573ba56e09 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:23.871118 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-06e239ec-8b91-4640-a97d-78573ba56e09 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:23.931304 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-10398617-16d9-47ea-bf96-97ea5af839a0 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:23.933004 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-10398617-16d9-47ea-bf96-97ea5af839a0 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] [instance: 4d73b42e-b2dd-432a-9aa7-59d7f430ba48] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:23.948378 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10398617-16d9-47ea-bf96-97ea5af839a0 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:23.948882 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10398617-16d9-47ea-bf96-97ea5af839a0 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:23.949521 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10398617-16d9-47ea-bf96-97ea5af839a0 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:23.950569 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10398617-16d9-47ea-bf96-97ea5af839a0 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:23.951214 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10398617-16d9-47ea-bf96-97ea5af839a0 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:23.952089 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10398617-16d9-47ea-bf96-97ea5af839a0 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:24.018056 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10398617-16d9-47ea-bf96-97ea5af839a0 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:24.018847 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10398617-16d9-47ea-bf96-97ea5af839a0 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:24.021683 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10398617-16d9-47ea-bf96-97ea5af839a0 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:24.022391 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-10398617-16d9-47ea-bf96-97ea5af839a0 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lazy-loading 'fault' on Instance uuid 4d73b42e-b2dd-432a-9aa7-59d7f430ba48 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:49:24.112523 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-10398617-16d9-47ea-bf96-97ea5af839a0 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762ae558fed0436793d2f985617ac4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea87c7cf6a8b40ba914da392ab262edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:24.134123 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-10398617-16d9-47ea-bf96-97ea5af839a0 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] 10.222.0.42 "GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48" status: 200 len: 1305 microversion: 2.1 time: 0.207792 Oct 23 01:49:24.135053 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3217/6528] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:23 2022] GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48 => generated 1305 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:49:24.148776 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-aa178d0b-8ab1-48b3-9cdf-d885edcea4ca tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:24.149410 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-aa178d0b-8ab1-48b3-9cdf-d885edcea4ca tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] [instance: 3e32a61e-2dd1-458a-bced-55e7d351a60c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:24.160626 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa178d0b-8ab1-48b3-9cdf-d885edcea4ca tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:24.161687 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa178d0b-8ab1-48b3-9cdf-d885edcea4ca tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:24.162402 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa178d0b-8ab1-48b3-9cdf-d885edcea4ca tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:24.163500 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa178d0b-8ab1-48b3-9cdf-d885edcea4ca tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:24.164045 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa178d0b-8ab1-48b3-9cdf-d885edcea4ca tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:24.164540 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa178d0b-8ab1-48b3-9cdf-d885edcea4ca tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:24.174215 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-06e239ec-8b91-4640-a97d-78573ba56e09 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c7799d37d747b08a9e20e15c3d6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a028aafec3294eae9a1c1a9a4e907dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:24.185777 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-06e239ec-8b91-4640-a97d-78573ba56e09 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] 10.222.0.42 "GET /compute/v2.1/servers/64804b2c-74aa-4e67-8eba-75a5c4f7db76" status: 200 len: 1468 microversion: 2.1 time: 0.331361 Oct 23 01:49:24.187962 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3312/6529] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:23 2022] GET /compute/v2.1/servers/64804b2c-74aa-4e67-8eba-75a5c4f7db76 => generated 1468 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:49:24.220774 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-aa178d0b-8ab1-48b3-9cdf-d885edcea4ca tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] [instance: 3e32a61e-2dd1-458a-bced-55e7d351a60c] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:49:24.600442 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-aa178d0b-8ab1-48b3-9cdf-d885edcea4ca tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3e32a61e-2dd1-458a-bced-55e7d351a60c" status: 204 len: 0 microversion: 2.1 time: 0.463769 Oct 23 01:49:24.601817 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3218/6530] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:49:24 2022] DELETE /compute/v2.1/servers/3e32a61e-2dd1-458a-bced-55e7d351a60c => generated 0 bytes in 466 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:49:24.614002 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-346db0af-0f26-4bc5-b727-787b16ac987c tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:24.614657 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-346db0af-0f26-4bc5-b727-787b16ac987c tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] [instance: 3e32a61e-2dd1-458a-bced-55e7d351a60c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:24.621138 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-346db0af-0f26-4bc5-b727-787b16ac987c tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:24.621619 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-346db0af-0f26-4bc5-b727-787b16ac987c tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:24.622086 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-346db0af-0f26-4bc5-b727-787b16ac987c tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:24.622783 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-346db0af-0f26-4bc5-b727-787b16ac987c tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:24.623233 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-346db0af-0f26-4bc5-b727-787b16ac987c tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:24.623710 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-346db0af-0f26-4bc5-b727-787b16ac987c tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:24.792111 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-346db0af-0f26-4bc5-b727-787b16ac987c tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2630e3eda1df4f698cad1eda511ad76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e64fd5446d541da9d10af97a24ea037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:24.800871 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-346db0af-0f26-4bc5-b727-787b16ac987c tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] 10.222.0.42 "GET /compute/v2.1/servers/3e32a61e-2dd1-458a-bced-55e7d351a60c" status: 200 len: 1513 microversion: 2.1 time: 0.194178 Oct 23 01:49:24.801446 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3313/6531] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:24 2022] GET /compute/v2.1/servers/3e32a61e-2dd1-458a-bced-55e7d351a60c => generated 1513 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:49:25.160989 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2f5ddf1c-ce1b-445b-a5b5-61d12e958f12 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:25.168814 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2f5ddf1c-ce1b-445b-a5b5-61d12e958f12 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] [instance: 4d73b42e-b2dd-432a-9aa7-59d7f430ba48] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:25.168814 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2f5ddf1c-ce1b-445b-a5b5-61d12e958f12 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:25.169061 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2f5ddf1c-ce1b-445b-a5b5-61d12e958f12 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:25.169294 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2f5ddf1c-ce1b-445b-a5b5-61d12e958f12 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:25.170140 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2f5ddf1c-ce1b-445b-a5b5-61d12e958f12 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:25.170595 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2f5ddf1c-ce1b-445b-a5b5-61d12e958f12 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:25.171238 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2f5ddf1c-ce1b-445b-a5b5-61d12e958f12 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:25.186105 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-2f5ddf1c-ce1b-445b-a5b5-61d12e958f12 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] HTTP exception thrown: Instance 4d73b42e-b2dd-432a-9aa7-59d7f430ba48 could not be found. Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2f5ddf1c-ce1b-445b-a5b5-61d12e958f12 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Request method failure captured: Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48 HTTP/1.1 Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJ190SuLZyL_AGVALo4mu0-wnpks6VVSzjJLAdtCgrm5KaEKfWTI2VpRIP1xKw-GLg1LA7R2hm252OK_3xAxPyE5wKpGESzBXAo7ORareR1OzD-5lG7Ek2IYghETGkb3-OyboQJROrCSLSQgf4K0C0J4RHhNl2LpaMFe-qASTYOVeuo Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: ea87c7cf6a8b40ba914da392ab262edc Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-TestServerAdvancedOps-951482473 Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ea87c7cf6a8b40ba914da392ab262edc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ea87c7cf6a8b40ba914da392ab262edc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ea87c7cf6a8b40ba914da392ab262edc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ea87c7cf6a8b40ba914da392ab262edc"}]}] Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-TestServerAdvancedOps-951482473 Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: ea87c7cf6a8b40ba914da392ab262edc Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-TestServerAdvancedOps-951482473 Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-TestServerAdvancedOps-951482473-project Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 762ae558fed0436793d2f985617ac4d6 Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-TestServerAdvancedOps-951482473-project Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 4d73b42e-b2dd-432a-9aa7-59d7f430ba48 could not be found. Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '4d73b42e-b2dd-432a-9aa7-59d7f430ba48'} Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d73b42e-b2dd-432a-9aa7-59d7f430ba48 could not be found. Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d73b42e-b2dd-432a-9aa7-59d7f430ba48 could not be found. Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:49:25.187769 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:49:25.197827 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:49:25.197827 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:49:25.197827 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:49:25.197827 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:49:25.197827 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:49:25.197827 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d73b42e-b2dd-432a-9aa7-59d7f430ba48 could not be found. Oct 23 01:49:25.197827 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:49:25.197827 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2f5ddf1c-ce1b-445b-a5b5-61d12e958f12 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] Returning 404 to user: Instance 4d73b42e-b2dd-432a-9aa7-59d7f430ba48 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:49:25.197827 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2f5ddf1c-ce1b-445b-a5b5-61d12e958f12 tempest-TestServerAdvancedOps-951482473 tempest-TestServerAdvancedOps-951482473-project] 10.222.0.42 "GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48" status: 404 len: 111 microversion: 2.1 time: 0.032899 Oct 23 01:49:25.197827 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3219/6532] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:25 2022] GET /compute/v2.1/servers/4d73b42e-b2dd-432a-9aa7-59d7f430ba48 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:49:25.210547 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9276e022-9cf3-44c5-a586-b6f2702f694c tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:25.211161 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9276e022-9cf3-44c5-a586-b6f2702f694c tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] [instance: 64804b2c-74aa-4e67-8eba-75a5c4f7db76] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:25.219558 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9276e022-9cf3-44c5-a586-b6f2702f694c tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:25.220054 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9276e022-9cf3-44c5-a586-b6f2702f694c tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:25.220485 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9276e022-9cf3-44c5-a586-b6f2702f694c tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:25.221188 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9276e022-9cf3-44c5-a586-b6f2702f694c tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:25.221710 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9276e022-9cf3-44c5-a586-b6f2702f694c tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:25.222167 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9276e022-9cf3-44c5-a586-b6f2702f694c tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:25.466912 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9276e022-9cf3-44c5-a586-b6f2702f694c tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c7799d37d747b08a9e20e15c3d6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a028aafec3294eae9a1c1a9a4e907dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:25.476176 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9276e022-9cf3-44c5-a586-b6f2702f694c tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] 10.222.0.42 "GET /compute/v2.1/servers/64804b2c-74aa-4e67-8eba-75a5c4f7db76" status: 200 len: 1468 microversion: 2.1 time: 0.269520 Oct 23 01:49:25.478929 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3314/6533] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:25 2022] GET /compute/v2.1/servers/64804b2c-74aa-4e67-8eba-75a5c4f7db76 => generated 1468 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:49:25.826716 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0063aea7-a9d1-4064-99d8-9e221bdc05c6 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:25.827452 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0063aea7-a9d1-4064-99d8-9e221bdc05c6 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] [instance: 3e32a61e-2dd1-458a-bced-55e7d351a60c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:25.833962 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0063aea7-a9d1-4064-99d8-9e221bdc05c6 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:25.834471 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0063aea7-a9d1-4064-99d8-9e221bdc05c6 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:25.835092 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0063aea7-a9d1-4064-99d8-9e221bdc05c6 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:25.836545 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0063aea7-a9d1-4064-99d8-9e221bdc05c6 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:25.837150 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0063aea7-a9d1-4064-99d8-9e221bdc05c6 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:25.837724 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0063aea7-a9d1-4064-99d8-9e221bdc05c6 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:26.047707 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0063aea7-a9d1-4064-99d8-9e221bdc05c6 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2630e3eda1df4f698cad1eda511ad76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e64fd5446d541da9d10af97a24ea037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:26.055927 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0063aea7-a9d1-4064-99d8-9e221bdc05c6 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] 10.222.0.42 "GET /compute/v2.1/servers/3e32a61e-2dd1-458a-bced-55e7d351a60c" status: 200 len: 1513 microversion: 2.1 time: 0.235119 Oct 23 01:49:26.056515 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3220/6534] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:25 2022] GET /compute/v2.1/servers/3e32a61e-2dd1-458a-bced-55e7d351a60c => generated 1513 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:49:26.501094 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-88052d40-3697-4427-b2db-76ed6994c411 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:26.503333 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-88052d40-3697-4427-b2db-76ed6994c411 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] [instance: 64804b2c-74aa-4e67-8eba-75a5c4f7db76] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:26.508576 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-88052d40-3697-4427-b2db-76ed6994c411 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:26.509098 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-88052d40-3697-4427-b2db-76ed6994c411 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:26.509723 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-88052d40-3697-4427-b2db-76ed6994c411 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:26.511084 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-88052d40-3697-4427-b2db-76ed6994c411 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:26.511589 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-88052d40-3697-4427-b2db-76ed6994c411 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:26.512030 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-88052d40-3697-4427-b2db-76ed6994c411 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:26.787867 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-88052d40-3697-4427-b2db-76ed6994c411 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c7799d37d747b08a9e20e15c3d6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a028aafec3294eae9a1c1a9a4e907dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:26.795936 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-88052d40-3697-4427-b2db-76ed6994c411 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] 10.222.0.42 "GET /compute/v2.1/servers/64804b2c-74aa-4e67-8eba-75a5c4f7db76" status: 200 len: 1468 microversion: 2.1 time: 0.299026 Oct 23 01:49:26.796515 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3315/6535] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:26 2022] GET /compute/v2.1/servers/64804b2c-74aa-4e67-8eba-75a5c4f7db76 => generated 1468 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:49:27.079729 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5122c766-1287-45c6-9684-db80a7df874d tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:27.080352 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5122c766-1287-45c6-9684-db80a7df874d tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] [instance: 3e32a61e-2dd1-458a-bced-55e7d351a60c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:27.083750 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:27.091692 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5122c766-1287-45c6-9684-db80a7df874d tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:27.092174 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5122c766-1287-45c6-9684-db80a7df874d tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:27.092612 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5122c766-1287-45c6-9684-db80a7df874d tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:27.093320 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5122c766-1287-45c6-9684-db80a7df874d tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:27.093801 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5122c766-1287-45c6-9684-db80a7df874d tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:27.094399 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5122c766-1287-45c6-9684-db80a7df874d tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:27.261140 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=8 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:27.329585 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5122c766-1287-45c6-9684-db80a7df874d tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2630e3eda1df4f698cad1eda511ad76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e64fd5446d541da9d10af97a24ea037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:27.348103 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5122c766-1287-45c6-9684-db80a7df874d tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] 10.222.0.42 "GET /compute/v2.1/servers/3e32a61e-2dd1-458a-bced-55e7d351a60c" status: 200 len: 1513 microversion: 2.1 time: 0.272646 Oct 23 01:49:27.356236 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3221/6536] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:27 2022] GET /compute/v2.1/servers/3e32a61e-2dd1-458a-bced-55e7d351a60c => generated 1513 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:49:27.819286 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-46073f30-2b63-4f37-b2b5-da4773b45087 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:27.819905 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-46073f30-2b63-4f37-b2b5-da4773b45087 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] [instance: 64804b2c-74aa-4e67-8eba-75a5c4f7db76] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:27.827710 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46073f30-2b63-4f37-b2b5-da4773b45087 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:27.828280 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46073f30-2b63-4f37-b2b5-da4773b45087 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:27.828722 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46073f30-2b63-4f37-b2b5-da4773b45087 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:27.829410 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46073f30-2b63-4f37-b2b5-da4773b45087 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:27.829869 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46073f30-2b63-4f37-b2b5-da4773b45087 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:27.830318 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46073f30-2b63-4f37-b2b5-da4773b45087 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:28.014201 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-3ec0bc7b-58b7-4eb4-a140-d0d1c510181e req-898ce7d1-5658-4b9a-97da-00796a99755e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e32a61e-2dd1-458a-bced-55e7d351a60c", "name": "network-vif-deleted", "tag": "9ca46fa1-462e-4477-84c0-54d235a36037"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:49:28.024436 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-3ec0bc7b-58b7-4eb4-a140-d0d1c510181e req-898ce7d1-5658-4b9a-97da-00796a99755e service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:28.025012 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-3ec0bc7b-58b7-4eb4-a140-d0d1c510181e req-898ce7d1-5658-4b9a-97da-00796a99755e service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:28.025510 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-3ec0bc7b-58b7-4eb4-a140-d0d1c510181e req-898ce7d1-5658-4b9a-97da-00796a99755e service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:28.038945 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-3ec0bc7b-58b7-4eb4-a140-d0d1c510181e req-898ce7d1-5658-4b9a-97da-00796a99755e service nova] Creating event network-vif-deleted:9ca46fa1-462e-4477-84c0-54d235a36037 for instance 3e32a61e-2dd1-458a-bced-55e7d351a60c on n-h2-master-1 Oct 23 01:49:28.044176 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-3ec0bc7b-58b7-4eb4-a140-d0d1c510181e req-898ce7d1-5658-4b9a-97da-00796a99755e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034378 Oct 23 01:49:28.045112 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3222/6537] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:49:28.114241 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-46073f30-2b63-4f37-b2b5-da4773b45087 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c7799d37d747b08a9e20e15c3d6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a028aafec3294eae9a1c1a9a4e907dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:28.133884 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-46073f30-2b63-4f37-b2b5-da4773b45087 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] 10.222.0.42 "GET /compute/v2.1/servers/64804b2c-74aa-4e67-8eba-75a5c4f7db76" status: 200 len: 1468 microversion: 2.1 time: 0.318554 Oct 23 01:49:28.134628 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3316/6538] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:27 2022] GET /compute/v2.1/servers/64804b2c-74aa-4e67-8eba-75a5c4f7db76 => generated 1468 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:49:28.383380 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5142a0f3-ee60-44ec-9a6c-e3a360ce0412 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:28.384166 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5142a0f3-ee60-44ec-9a6c-e3a360ce0412 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] [instance: 3e32a61e-2dd1-458a-bced-55e7d351a60c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:28.391102 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5142a0f3-ee60-44ec-9a6c-e3a360ce0412 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:28.391596 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5142a0f3-ee60-44ec-9a6c-e3a360ce0412 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:28.392030 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5142a0f3-ee60-44ec-9a6c-e3a360ce0412 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:28.392727 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5142a0f3-ee60-44ec-9a6c-e3a360ce0412 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:28.393178 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5142a0f3-ee60-44ec-9a6c-e3a360ce0412 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:28.393604 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5142a0f3-ee60-44ec-9a6c-e3a360ce0412 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:28.434689 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5142a0f3-ee60-44ec-9a6c-e3a360ce0412 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:28.437025 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5142a0f3-ee60-44ec-9a6c-e3a360ce0412 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:28.437626 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5142a0f3-ee60-44ec-9a6c-e3a360ce0412 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:28.438850 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-5142a0f3-ee60-44ec-9a6c-e3a360ce0412 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lazy-loading 'fault' on Instance uuid 3e32a61e-2dd1-458a-bced-55e7d351a60c {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:49:28.504337 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5142a0f3-ee60-44ec-9a6c-e3a360ce0412 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2630e3eda1df4f698cad1eda511ad76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e64fd5446d541da9d10af97a24ea037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:28.520947 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5142a0f3-ee60-44ec-9a6c-e3a360ce0412 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] 10.222.0.42 "GET /compute/v2.1/servers/3e32a61e-2dd1-458a-bced-55e7d351a60c" status: 200 len: 1309 microversion: 2.1 time: 0.143901 Oct 23 01:49:28.522253 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3223/6539] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:28 2022] GET /compute/v2.1/servers/3e32a61e-2dd1-458a-bced-55e7d351a60c => generated 1309 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:49:29.158005 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5c121c4e-3123-4f1b-92bb-03f27b140cc9 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:29.158813 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5c121c4e-3123-4f1b-92bb-03f27b140cc9 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] [instance: 64804b2c-74aa-4e67-8eba-75a5c4f7db76] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:29.160814 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:29.166605 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5c121c4e-3123-4f1b-92bb-03f27b140cc9 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:29.169701 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5c121c4e-3123-4f1b-92bb-03f27b140cc9 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:29.169701 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5c121c4e-3123-4f1b-92bb-03f27b140cc9 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:29.169701 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5c121c4e-3123-4f1b-92bb-03f27b140cc9 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:29.169701 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5c121c4e-3123-4f1b-92bb-03f27b140cc9 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:29.169701 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5c121c4e-3123-4f1b-92bb-03f27b140cc9 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:29.548197 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f8666b8e-5e42-414f-a88f-d3840bf9f8c3 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:29.548823 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f8666b8e-5e42-414f-a88f-d3840bf9f8c3 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] [instance: 3e32a61e-2dd1-458a-bced-55e7d351a60c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:29.559846 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f8666b8e-5e42-414f-a88f-d3840bf9f8c3 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:29.560892 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f8666b8e-5e42-414f-a88f-d3840bf9f8c3 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:29.563555 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f8666b8e-5e42-414f-a88f-d3840bf9f8c3 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:29.563555 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f8666b8e-5e42-414f-a88f-d3840bf9f8c3 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:29.563555 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f8666b8e-5e42-414f-a88f-d3840bf9f8c3 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:29.563804 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f8666b8e-5e42-414f-a88f-d3840bf9f8c3 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:29.582837 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-f8666b8e-5e42-414f-a88f-d3840bf9f8c3 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] HTTP exception thrown: Instance 3e32a61e-2dd1-458a-bced-55e7d351a60c could not be found. Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f8666b8e-5e42-414f-a88f-d3840bf9f8c3 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Request method failure captured: Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/3e32a61e-2dd1-458a-bced-55e7d351a60c HTTP/1.1 Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJxhs_L4DmDeHIMP1SI3XdqhiKg-Dq-fRILyy1xjkV9srg-xe-2rVhAoTTiJJUpCRh8ER3JIyfnK4vNIX_NUTws0pTfFbA6XX5jhDaivEZxseQWiIY1TirY-XvhydCxNxLKNV7Pt5A1EV2vWdu7DsFmlN9Tvq_zDdNbKl-QEW9jzvKs Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 7e64fd5446d541da9d10af97a24ea037 Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2010952756 Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7e64fd5446d541da9d10af97a24ea037"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7e64fd5446d541da9d10af97a24ea037"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7e64fd5446d541da9d10af97a24ea037"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7e64fd5446d541da9d10af97a24ea037"}]}] Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-VolumesSnapshotTestJSON-2010952756 Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 7e64fd5446d541da9d10af97a24ea037 Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2010952756 Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-VolumesSnapshotTestJSON-2010952756-project Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 2630e3eda1df4f698cad1eda511ad76a Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-VolumesSnapshotTestJSON-2010952756-project Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 3e32a61e-2dd1-458a-bced-55e7d351a60c could not be found. Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '3e32a61e-2dd1-458a-bced-55e7d351a60c'} Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e32a61e-2dd1-458a-bced-55e7d351a60c could not be found. Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e32a61e-2dd1-458a-bced-55e7d351a60c could not be found. Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:49:29.591382 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:49:29.595562 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:49:29.595562 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:49:29.595562 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:49:29.595562 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:49:29.595562 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:49:29.595562 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e32a61e-2dd1-458a-bced-55e7d351a60c could not be found. Oct 23 01:49:29.595562 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:49:29.595562 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f8666b8e-5e42-414f-a88f-d3840bf9f8c3 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] Returning 404 to user: Instance 3e32a61e-2dd1-458a-bced-55e7d351a60c could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:49:29.595562 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f8666b8e-5e42-414f-a88f-d3840bf9f8c3 tempest-VolumesSnapshotTestJSON-2010952756 tempest-VolumesSnapshotTestJSON-2010952756-project] 10.222.0.42 "GET /compute/v2.1/servers/3e32a61e-2dd1-458a-bced-55e7d351a60c" status: 404 len: 111 microversion: 2.1 time: 0.045157 Oct 23 01:49:29.595562 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3224/6540] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:29 2022] GET /compute/v2.1/servers/3e32a61e-2dd1-458a-bced-55e7d351a60c => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 01:49:29.691538 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5c121c4e-3123-4f1b-92bb-03f27b140cc9 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c7799d37d747b08a9e20e15c3d6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a028aafec3294eae9a1c1a9a4e907dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:29.704322 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5c121c4e-3123-4f1b-92bb-03f27b140cc9 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] 10.222.0.42 "GET /compute/v2.1/servers/64804b2c-74aa-4e67-8eba-75a5c4f7db76" status: 200 len: 1468 microversion: 2.1 time: 0.550557 Oct 23 01:49:29.705171 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3317/6541] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:29 2022] GET /compute/v2.1/servers/64804b2c-74aa-4e67-8eba-75a5c4f7db76 => generated 1468 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:49:29.795139 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-4caeec66-7e96-40ab-ac03-b081fc1c1092 req-f22d6c8e-b215-4b8e-bd1f-38217ae8b477 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64804b2c-74aa-4e67-8eba-75a5c4f7db76", "name": "network-vif-plugged", "status": "completed", "tag": "4d84cc9b-7464-4aba-a4a3-4b45e5c6aada"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:49:29.808348 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-4caeec66-7e96-40ab-ac03-b081fc1c1092 req-f22d6c8e-b215-4b8e-bd1f-38217ae8b477 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:29.809234 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-4caeec66-7e96-40ab-ac03-b081fc1c1092 req-f22d6c8e-b215-4b8e-bd1f-38217ae8b477 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:29.810884 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-4caeec66-7e96-40ab-ac03-b081fc1c1092 req-f22d6c8e-b215-4b8e-bd1f-38217ae8b477 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:29.824891 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-4caeec66-7e96-40ab-ac03-b081fc1c1092 req-f22d6c8e-b215-4b8e-bd1f-38217ae8b477 service nova] Creating event network-vif-plugged:4d84cc9b-7464-4aba-a4a3-4b45e5c6aada for instance 64804b2c-74aa-4e67-8eba-75a5c4f7db76 on n-h2-master-1 Oct 23 01:49:29.831732 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-4caeec66-7e96-40ab-ac03-b081fc1c1092 req-f22d6c8e-b215-4b8e-bd1f-38217ae8b477 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040296 Oct 23 01:49:29.836457 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3225/6542] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:49:30.730286 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c606e3f5-7773-4aef-b914-0a5ce3a063f1 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:30.732822 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c606e3f5-7773-4aef-b914-0a5ce3a063f1 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] [instance: 64804b2c-74aa-4e67-8eba-75a5c4f7db76] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:30.739217 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c606e3f5-7773-4aef-b914-0a5ce3a063f1 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:30.739730 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c606e3f5-7773-4aef-b914-0a5ce3a063f1 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:30.740160 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c606e3f5-7773-4aef-b914-0a5ce3a063f1 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:30.740879 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c606e3f5-7773-4aef-b914-0a5ce3a063f1 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:30.741341 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c606e3f5-7773-4aef-b914-0a5ce3a063f1 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:30.741772 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c606e3f5-7773-4aef-b914-0a5ce3a063f1 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:30.948528 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c606e3f5-7773-4aef-b914-0a5ce3a063f1 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c7799d37d747b08a9e20e15c3d6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a028aafec3294eae9a1c1a9a4e907dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:30.958168 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c606e3f5-7773-4aef-b914-0a5ce3a063f1 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] 10.222.0.42 "GET /compute/v2.1/servers/64804b2c-74aa-4e67-8eba-75a5c4f7db76" status: 200 len: 1468 microversion: 2.1 time: 0.231614 Oct 23 01:49:30.959021 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3318/6543] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:30 2022] GET /compute/v2.1/servers/64804b2c-74aa-4e67-8eba-75a5c4f7db76 => generated 1468 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:49:31.983926 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0304f605-5f81-4747-be6d-fda551b6ea96 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:31.985484 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0304f605-5f81-4747-be6d-fda551b6ea96 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] [instance: 64804b2c-74aa-4e67-8eba-75a5c4f7db76] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:31.995479 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0304f605-5f81-4747-be6d-fda551b6ea96 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:31.997087 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0304f605-5f81-4747-be6d-fda551b6ea96 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:31.998364 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0304f605-5f81-4747-be6d-fda551b6ea96 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:32.000061 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0304f605-5f81-4747-be6d-fda551b6ea96 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:32.000957 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0304f605-5f81-4747-be6d-fda551b6ea96 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:32.003670 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0304f605-5f81-4747-be6d-fda551b6ea96 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:32.242737 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0304f605-5f81-4747-be6d-fda551b6ea96 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c7799d37d747b08a9e20e15c3d6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a028aafec3294eae9a1c1a9a4e907dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:32.267716 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0304f605-5f81-4747-be6d-fda551b6ea96 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] 10.222.0.42 "GET /compute/v2.1/servers/64804b2c-74aa-4e67-8eba-75a5c4f7db76" status: 200 len: 1640 microversion: 2.1 time: 0.289532 Oct 23 01:49:32.282476 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3226/6544] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:31 2022] GET /compute/v2.1/servers/64804b2c-74aa-4e67-8eba-75a5c4f7db76 => generated 1640 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:49:32.290735 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-51beb8e3-147c-43a2-a104-4606d9238cd0 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:32.291319 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-51beb8e3-147c-43a2-a104-4606d9238cd0 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] [instance: 64804b2c-74aa-4e67-8eba-75a5c4f7db76] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:32.298603 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-51beb8e3-147c-43a2-a104-4606d9238cd0 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:32.299302 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-51beb8e3-147c-43a2-a104-4606d9238cd0 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:32.299899 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-51beb8e3-147c-43a2-a104-4606d9238cd0 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:32.300802 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-51beb8e3-147c-43a2-a104-4606d9238cd0 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:32.301266 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-51beb8e3-147c-43a2-a104-4606d9238cd0 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:32.301697 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-51beb8e3-147c-43a2-a104-4606d9238cd0 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:32.494654 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-51beb8e3-147c-43a2-a104-4606d9238cd0 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c7799d37d747b08a9e20e15c3d6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a028aafec3294eae9a1c1a9a4e907dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:32.517879 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-51beb8e3-147c-43a2-a104-4606d9238cd0 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] 10.222.0.42 "GET /compute/v2.1/servers/64804b2c-74aa-4e67-8eba-75a5c4f7db76" status: 200 len: 1640 microversion: 2.1 time: 0.230708 Oct 23 01:49:32.520541 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3319/6545] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:32 2022] GET /compute/v2.1/servers/64804b2c-74aa-4e67-8eba-75a5c4f7db76 => generated 1640 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:49:32.546299 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f5e5be20-69bf-4d6f-b8c8-2a3119474a4b tempest-TestSecurityGroupsBasicOps-930947180 tempest-TestSecurityGroupsBasicOps-930947180-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:32.546824 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f5e5be20-69bf-4d6f-b8c8-2a3119474a4b tempest-TestSecurityGroupsBasicOps-930947180 tempest-TestSecurityGroupsBasicOps-930947180-project-admin] [instance: 64804b2c-74aa-4e67-8eba-75a5c4f7db76] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:32.554517 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f5e5be20-69bf-4d6f-b8c8-2a3119474a4b tempest-TestSecurityGroupsBasicOps-930947180 tempest-TestSecurityGroupsBasicOps-930947180-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:32.555245 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f5e5be20-69bf-4d6f-b8c8-2a3119474a4b tempest-TestSecurityGroupsBasicOps-930947180 tempest-TestSecurityGroupsBasicOps-930947180-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:32.555909 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f5e5be20-69bf-4d6f-b8c8-2a3119474a4b tempest-TestSecurityGroupsBasicOps-930947180 tempest-TestSecurityGroupsBasicOps-930947180-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:32.556808 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f5e5be20-69bf-4d6f-b8c8-2a3119474a4b tempest-TestSecurityGroupsBasicOps-930947180 tempest-TestSecurityGroupsBasicOps-930947180-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:32.557761 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f5e5be20-69bf-4d6f-b8c8-2a3119474a4b tempest-TestSecurityGroupsBasicOps-930947180 tempest-TestSecurityGroupsBasicOps-930947180-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:32.558409 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f5e5be20-69bf-4d6f-b8c8-2a3119474a4b tempest-TestSecurityGroupsBasicOps-930947180 tempest-TestSecurityGroupsBasicOps-930947180-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:33.039969 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f5e5be20-69bf-4d6f-b8c8-2a3119474a4b tempest-TestSecurityGroupsBasicOps-930947180 tempest-TestSecurityGroupsBasicOps-930947180-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/64804b2c-74aa-4e67-8eba-75a5c4f7db76" status: 200 len: 1791 microversion: 2.1 time: 0.497700 Oct 23 01:49:33.040568 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3227/6546] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:32 2022] GET /compute/v2.1/servers/64804b2c-74aa-4e67-8eba-75a5c4f7db76 => generated 1791 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:49:33.343465 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-90bc8239-4277-43c1-a1e6-608a551e0ee1 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:49:33.345092 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-90bc8239-4277-43c1-a1e6-608a551e0ee1 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 331ab87b-109f-48e2-aff1-f0a9639d63b5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:33.352167 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-90bc8239-4277-43c1-a1e6-608a551e0ee1 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:33.352661 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-90bc8239-4277-43c1-a1e6-608a551e0ee1 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:33.353104 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-90bc8239-4277-43c1-a1e6-608a551e0ee1 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:33.353814 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-90bc8239-4277-43c1-a1e6-608a551e0ee1 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:33.354331 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-90bc8239-4277-43c1-a1e6-608a551e0ee1 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:33.355060 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-90bc8239-4277-43c1-a1e6-608a551e0ee1 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:33.445817 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-90bc8239-4277-43c1-a1e6-608a551e0ee1 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:49:33.458239 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-90bc8239-4277-43c1-a1e6-608a551e0ee1 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:49:33.458239 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-90bc8239-4277-43c1-a1e6-608a551e0ee1 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:49:33.458239 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-90bc8239-4277-43c1-a1e6-608a551e0ee1 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:49:33.458239 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-90bc8239-4277-43c1-a1e6-608a551e0ee1 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:49:33.778596 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-90bc8239-4277-43c1-a1e6-608a551e0ee1 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 331ab87b-109f-48e2-aff1-f0a9639d63b5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:33.789213 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-90bc8239-4277-43c1-a1e6-608a551e0ee1 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:33.790824 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-90bc8239-4277-43c1-a1e6-608a551e0ee1 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:33.792081 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-90bc8239-4277-43c1-a1e6-608a551e0ee1 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:33.793098 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-90bc8239-4277-43c1-a1e6-608a551e0ee1 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:33.794203 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-90bc8239-4277-43c1-a1e6-608a551e0ee1 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:33.797491 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-90bc8239-4277-43c1-a1e6-608a551e0ee1 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:33.833752 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-90bc8239-4277-43c1-a1e6-608a551e0ee1 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "POST /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5/action" status: 202 len: 1137 microversion: 2.1 time: 0.495460 Oct 23 01:49:33.850537 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3320/6547] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:49:33 2022] POST /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5/action => generated 1137 bytes in 505 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 23 01:49:33.860132 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4dbc6ca0-3adb-45d9-a226-c9bff033754a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:33.861815 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4dbc6ca0-3adb-45d9-a226-c9bff033754a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 331ab87b-109f-48e2-aff1-f0a9639d63b5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:33.874928 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4dbc6ca0-3adb-45d9-a226-c9bff033754a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:33.878530 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4dbc6ca0-3adb-45d9-a226-c9bff033754a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:33.879718 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4dbc6ca0-3adb-45d9-a226-c9bff033754a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:33.882187 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4dbc6ca0-3adb-45d9-a226-c9bff033754a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:33.882944 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4dbc6ca0-3adb-45d9-a226-c9bff033754a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:33.885333 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4dbc6ca0-3adb-45d9-a226-c9bff033754a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:34.345211 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4dbc6ca0-3adb-45d9-a226-c9bff033754a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:34.355801 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4dbc6ca0-3adb-45d9-a226-c9bff033754a tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5" status: 200 len: 1692 microversion: 2.1 time: 0.501773 Oct 23 01:49:34.379570 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3228/6548] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:33 2022] GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5 => generated 1692 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:49:35.383565 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a2449aa7-5182-47f5-ab7b-f22feea44c97 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:35.384700 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a2449aa7-5182-47f5-ab7b-f22feea44c97 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 331ab87b-109f-48e2-aff1-f0a9639d63b5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:35.406960 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a2449aa7-5182-47f5-ab7b-f22feea44c97 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:35.407477 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a2449aa7-5182-47f5-ab7b-f22feea44c97 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:35.407928 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a2449aa7-5182-47f5-ab7b-f22feea44c97 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:35.408669 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a2449aa7-5182-47f5-ab7b-f22feea44c97 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:35.409135 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a2449aa7-5182-47f5-ab7b-f22feea44c97 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:35.409562 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a2449aa7-5182-47f5-ab7b-f22feea44c97 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:35.455343 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=95,nova_cell1:UPDATE=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:35.842875 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a2449aa7-5182-47f5-ab7b-f22feea44c97 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:35.860708 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a2449aa7-5182-47f5-ab7b-f22feea44c97 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5" status: 200 len: 1692 microversion: 2.1 time: 0.482476 Oct 23 01:49:35.861933 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3321/6549] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:35 2022] GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5 => generated 1692 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:49:36.889068 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c3c37889-cf13-4fb8-8bc5-043d3969c8de tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:36.893003 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c3c37889-cf13-4fb8-8bc5-043d3969c8de tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 331ab87b-109f-48e2-aff1-f0a9639d63b5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:36.912976 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c3c37889-cf13-4fb8-8bc5-043d3969c8de tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:36.918107 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c3c37889-cf13-4fb8-8bc5-043d3969c8de tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:36.918107 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c3c37889-cf13-4fb8-8bc5-043d3969c8de tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:36.918727 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c3c37889-cf13-4fb8-8bc5-043d3969c8de tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:36.920677 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c3c37889-cf13-4fb8-8bc5-043d3969c8de tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:36.921317 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c3c37889-cf13-4fb8-8bc5-043d3969c8de tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:37.003495 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-117c2e3a-49c3-4564-8b68-133107db111c req-2539340b-b3d2-4c35-98d1-291e707c8c6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64804b2c-74aa-4e67-8eba-75a5c4f7db76", "tag": "4d84cc9b-7464-4aba-a4a3-4b45e5c6aada"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:49:37.024166 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-117c2e3a-49c3-4564-8b68-133107db111c req-2539340b-b3d2-4c35-98d1-291e707c8c6b service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:37.025016 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-117c2e3a-49c3-4564-8b68-133107db111c req-2539340b-b3d2-4c35-98d1-291e707c8c6b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:37.025684 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-117c2e3a-49c3-4564-8b68-133107db111c req-2539340b-b3d2-4c35-98d1-291e707c8c6b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:37.046175 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-117c2e3a-49c3-4564-8b68-133107db111c req-2539340b-b3d2-4c35-98d1-291e707c8c6b service nova] Creating event network-changed:4d84cc9b-7464-4aba-a4a3-4b45e5c6aada for instance 64804b2c-74aa-4e67-8eba-75a5c4f7db76 on n-h2-master-1 Oct 23 01:49:37.061200 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-117c2e3a-49c3-4564-8b68-133107db111c req-2539340b-b3d2-4c35-98d1-291e707c8c6b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062739 Oct 23 01:49:37.064888 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3322/6550] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:49:37.141177 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c3c37889-cf13-4fb8-8bc5-043d3969c8de tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:37.151427 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c3c37889-cf13-4fb8-8bc5-043d3969c8de tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5" status: 200 len: 1692 microversion: 2.1 time: 0.270985 Oct 23 01:49:37.180382 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3229/6551] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:36 2022] GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5 => generated 1692 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:49:38.186465 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2c480383-b408-40e8-bf32-81a298aa23e7 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:38.186465 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2c480383-b408-40e8-bf32-81a298aa23e7 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 331ab87b-109f-48e2-aff1-f0a9639d63b5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:38.200801 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2c480383-b408-40e8-bf32-81a298aa23e7 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:38.201877 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2c480383-b408-40e8-bf32-81a298aa23e7 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:38.202360 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2c480383-b408-40e8-bf32-81a298aa23e7 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:38.210815 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2c480383-b408-40e8-bf32-81a298aa23e7 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:38.211559 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2c480383-b408-40e8-bf32-81a298aa23e7 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:38.212177 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2c480383-b408-40e8-bf32-81a298aa23e7 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:39.220422 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2c480383-b408-40e8-bf32-81a298aa23e7 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:39.234412 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2c480383-b408-40e8-bf32-81a298aa23e7 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5" status: 200 len: 1692 microversion: 2.1 time: 1.059935 Oct 23 01:49:39.235810 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3323/6552] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:38 2022] GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5 => generated 1692 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:49:40.262040 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4580f642-ecbb-4fa2-8b0c-dc21d35f1149 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:40.262722 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4580f642-ecbb-4fa2-8b0c-dc21d35f1149 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 331ab87b-109f-48e2-aff1-f0a9639d63b5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:40.275525 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4580f642-ecbb-4fa2-8b0c-dc21d35f1149 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:40.277227 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4580f642-ecbb-4fa2-8b0c-dc21d35f1149 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:40.278757 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4580f642-ecbb-4fa2-8b0c-dc21d35f1149 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:40.281547 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4580f642-ecbb-4fa2-8b0c-dc21d35f1149 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:40.283170 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4580f642-ecbb-4fa2-8b0c-dc21d35f1149 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:40.294333 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4580f642-ecbb-4fa2-8b0c-dc21d35f1149 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:40.741910 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4580f642-ecbb-4fa2-8b0c-dc21d35f1149 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:40.751201 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4580f642-ecbb-4fa2-8b0c-dc21d35f1149 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5" status: 200 len: 1692 microversion: 2.1 time: 0.495735 Oct 23 01:49:40.756752 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3230/6553] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:40 2022] GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5 => generated 1692 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:49:41.775066 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-01a3b58d-25ad-4d07-833c-73c726d358a5 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:41.778505 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-01a3b58d-25ad-4d07-833c-73c726d358a5 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 331ab87b-109f-48e2-aff1-f0a9639d63b5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:41.797811 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:41.803352 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01a3b58d-25ad-4d07-833c-73c726d358a5 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:41.804122 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01a3b58d-25ad-4d07-833c-73c726d358a5 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:41.809032 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01a3b58d-25ad-4d07-833c-73c726d358a5 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:41.809939 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01a3b58d-25ad-4d07-833c-73c726d358a5 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:41.811461 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01a3b58d-25ad-4d07-833c-73c726d358a5 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:41.811635 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01a3b58d-25ad-4d07-833c-73c726d358a5 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:42.204155 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-01a3b58d-25ad-4d07-833c-73c726d358a5 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:42.213060 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-01a3b58d-25ad-4d07-833c-73c726d358a5 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5" status: 200 len: 1692 microversion: 2.1 time: 0.442217 Oct 23 01:49:42.249553 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3324/6554] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:41 2022] GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5 => generated 1692 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:49:43.261724 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e30e99f2-d482-47c3-9067-e07273b74ad0 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:43.262490 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e30e99f2-d482-47c3-9067-e07273b74ad0 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 331ab87b-109f-48e2-aff1-f0a9639d63b5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:43.277830 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e30e99f2-d482-47c3-9067-e07273b74ad0 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:43.279993 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e30e99f2-d482-47c3-9067-e07273b74ad0 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:43.279993 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e30e99f2-d482-47c3-9067-e07273b74ad0 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:43.284756 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e30e99f2-d482-47c3-9067-e07273b74ad0 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:43.285643 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e30e99f2-d482-47c3-9067-e07273b74ad0 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:43.286309 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e30e99f2-d482-47c3-9067-e07273b74ad0 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:43.444560 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e30e99f2-d482-47c3-9067-e07273b74ad0 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:43.453307 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e30e99f2-d482-47c3-9067-e07273b74ad0 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5" status: 200 len: 1692 microversion: 2.1 time: 0.196301 Oct 23 01:49:43.454075 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3231/6555] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:43 2022] GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5 => generated 1692 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:49:44.479647 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0026b8ef-fbe8-4163-aa51-b62c75a8d238 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:44.482116 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0026b8ef-fbe8-4163-aa51-b62c75a8d238 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 331ab87b-109f-48e2-aff1-f0a9639d63b5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:44.491563 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0026b8ef-fbe8-4163-aa51-b62c75a8d238 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:44.491692 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0026b8ef-fbe8-4163-aa51-b62c75a8d238 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:44.492133 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0026b8ef-fbe8-4163-aa51-b62c75a8d238 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:44.495658 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0026b8ef-fbe8-4163-aa51-b62c75a8d238 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:44.495658 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0026b8ef-fbe8-4163-aa51-b62c75a8d238 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:44.495658 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0026b8ef-fbe8-4163-aa51-b62c75a8d238 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:44.763236 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0026b8ef-fbe8-4163-aa51-b62c75a8d238 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:44.797310 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0026b8ef-fbe8-4163-aa51-b62c75a8d238 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5" status: 200 len: 1692 microversion: 2.1 time: 0.313212 Oct 23 01:49:44.797310 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3325/6556] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:44 2022] GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5 => generated 1692 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:49:45.813621 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f6609fc3-6627-4eac-8500-8b83be7fc4fa tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:45.814908 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f6609fc3-6627-4eac-8500-8b83be7fc4fa tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 331ab87b-109f-48e2-aff1-f0a9639d63b5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:45.819270 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:45.832424 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f6609fc3-6627-4eac-8500-8b83be7fc4fa tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:45.832424 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f6609fc3-6627-4eac-8500-8b83be7fc4fa tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:45.832424 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f6609fc3-6627-4eac-8500-8b83be7fc4fa tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:45.832424 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f6609fc3-6627-4eac-8500-8b83be7fc4fa tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:45.832424 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f6609fc3-6627-4eac-8500-8b83be7fc4fa tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:45.832424 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f6609fc3-6627-4eac-8500-8b83be7fc4fa tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:46.137153 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f6609fc3-6627-4eac-8500-8b83be7fc4fa tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:46.150565 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f6609fc3-6627-4eac-8500-8b83be7fc4fa tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5" status: 200 len: 1692 microversion: 2.1 time: 0.341430 Oct 23 01:49:46.151975 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3232/6557] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:45 2022] GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5 => generated 1692 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:49:47.181044 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f383e97d-08f4-47b4-8ff8-0e3b05f61113 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:47.182357 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f383e97d-08f4-47b4-8ff8-0e3b05f61113 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 331ab87b-109f-48e2-aff1-f0a9639d63b5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:47.218313 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f383e97d-08f4-47b4-8ff8-0e3b05f61113 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:47.224481 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f383e97d-08f4-47b4-8ff8-0e3b05f61113 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:47.225352 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f383e97d-08f4-47b4-8ff8-0e3b05f61113 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:47.227107 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f383e97d-08f4-47b4-8ff8-0e3b05f61113 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:47.244582 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f383e97d-08f4-47b4-8ff8-0e3b05f61113 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:47.244582 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f383e97d-08f4-47b4-8ff8-0e3b05f61113 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:47.653934 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f383e97d-08f4-47b4-8ff8-0e3b05f61113 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:47.692266 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f383e97d-08f4-47b4-8ff8-0e3b05f61113 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5" status: 200 len: 1698 microversion: 2.1 time: 0.518488 Oct 23 01:49:47.693477 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3326/6558] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:47 2022] GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5 => generated 1698 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:49:48.725593 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-70ca36e0-3b9a-451e-a14c-7bfe681f1741 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:48.726149 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-70ca36e0-3b9a-451e-a14c-7bfe681f1741 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 331ab87b-109f-48e2-aff1-f0a9639d63b5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:48.736821 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-70ca36e0-3b9a-451e-a14c-7bfe681f1741 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:48.737577 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-70ca36e0-3b9a-451e-a14c-7bfe681f1741 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:48.738255 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-70ca36e0-3b9a-451e-a14c-7bfe681f1741 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:48.739308 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-70ca36e0-3b9a-451e-a14c-7bfe681f1741 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:48.739938 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-70ca36e0-3b9a-451e-a14c-7bfe681f1741 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:48.740952 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-70ca36e0-3b9a-451e-a14c-7bfe681f1741 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:48.749197 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:49.059981 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-70ca36e0-3b9a-451e-a14c-7bfe681f1741 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:49.068853 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-70ca36e0-3b9a-451e-a14c-7bfe681f1741 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5" status: 200 len: 1698 microversion: 2.1 time: 0.347755 Oct 23 01:49:49.075224 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3233/6559] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:48 2022] GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5 => generated 1698 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:49:49.526111 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9afb4b8f-6c00-4c2a-8595-9c0cb251e155 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1314810806", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:49:49.620957 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-9afb4b8f-6c00-4c2a-8595-9c0cb251e155 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] validate_networks() for None {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:49:50.011933 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-9afb4b8f-6c00-4c2a-8595-9c0cb251e155 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:49:50.018261 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-9afb4b8f-6c00-4c2a-8595-9c0cb251e155 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:49:50.018261 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-9afb4b8f-6c00-4c2a-8595-9c0cb251e155 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:49:50.018261 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-9afb4b8f-6c00-4c2a-8595-9c0cb251e155 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:49:50.018261 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-9afb4b8f-6c00-4c2a-8595-9c0cb251e155 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:49:50.028469 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9afb4b8f-6c00-4c2a-8595-9c0cb251e155 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:50.029361 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9afb4b8f-6c00-4c2a-8595-9c0cb251e155 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:50.029827 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9afb4b8f-6c00-4c2a-8595-9c0cb251e155 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:50.030608 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9afb4b8f-6c00-4c2a-8595-9c0cb251e155 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:50.031066 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9afb4b8f-6c00-4c2a-8595-9c0cb251e155 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:50.031577 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9afb4b8f-6c00-4c2a-8595-9c0cb251e155 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:50.068598 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-9afb4b8f-6c00-4c2a-8595-9c0cb251e155 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Getting quotas for project 83b41c66c9864d7dbe35a389f72fcd4d. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:49:50.075778 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-9afb4b8f-6c00-4c2a-8595-9c0cb251e155 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Getting quotas for user 4c880db3363a4aff92b82abfef14a8b0 and project 83b41c66c9864d7dbe35a389f72fcd4d. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:49:50.095172 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9bbd30b5-9357-4816-9990-1bb70fee38c0 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:50.096440 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9bbd30b5-9357-4816-9990-1bb70fee38c0 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 331ab87b-109f-48e2-aff1-f0a9639d63b5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:50.107004 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9afb4b8f-6c00-4c2a-8595-9c0cb251e155 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:49:50.107836 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9bbd30b5-9357-4816-9990-1bb70fee38c0 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:50.108323 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9bbd30b5-9357-4816-9990-1bb70fee38c0 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:50.108757 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9bbd30b5-9357-4816-9990-1bb70fee38c0 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:50.113703 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9bbd30b5-9357-4816-9990-1bb70fee38c0 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:50.116436 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9afb4b8f-6c00-4c2a-8595-9c0cb251e155 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] [instance: 62dcefb0-44c2-41c9-b5d3-2e617a9ded5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:49:50.117140 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9bbd30b5-9357-4816-9990-1bb70fee38c0 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:50.117852 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9bbd30b5-9357-4816-9990-1bb70fee38c0 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:50.378765 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9afb4b8f-6c00-4c2a-8595-9c0cb251e155 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.855837 Oct 23 01:49:50.379939 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9bbd30b5-9357-4816-9990-1bb70fee38c0 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:50.392118 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9bbd30b5-9357-4816-9990-1bb70fee38c0 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5" status: 200 len: 1698 microversion: 2.1 time: 0.303148 Oct 23 01:49:50.396936 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3234/6560] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:50 2022] GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5 => generated 1698 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:49:50.411458 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3327/6561] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:49:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:49:50.418069 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a85a2ff6-c98b-46e3-8fb1-f60f5ec98fe4 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:50.418989 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a85a2ff6-c98b-46e3-8fb1-f60f5ec98fe4 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] [instance: 62dcefb0-44c2-41c9-b5d3-2e617a9ded5b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:50.532506 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a85a2ff6-c98b-46e3-8fb1-f60f5ec98fe4 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c880db3363a4aff92b82abfef14a8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b41c66c9864d7dbe35a389f72fcd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:50.555783 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a85a2ff6-c98b-46e3-8fb1-f60f5ec98fe4 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] 10.222.0.42 "GET /compute/v2.1/servers/62dcefb0-44c2-41c9-b5d3-2e617a9ded5b" status: 200 len: 1214 microversion: 2.1 time: 0.144763 Oct 23 01:49:50.555783 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3235/6562] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:50 2022] GET /compute/v2.1/servers/62dcefb0-44c2-41c9-b5d3-2e617a9ded5b => generated 1214 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:49:50.740924 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-9e3efc58-ea52-4c4d-b6c5-0efe8bb9ac55 req-897c1c34-c418-495b-93e6-dc42a070fa53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "331ab87b-109f-48e2-aff1-f0a9639d63b5", "name": "network-vif-unplugged", "status": "completed", "tag": "064dc680-6961-4f4c-a67e-febc7cdc1c7e"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:49:50.770646 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-9e3efc58-ea52-4c4d-b6c5-0efe8bb9ac55 req-897c1c34-c418-495b-93e6-dc42a070fa53 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:50.771948 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-9e3efc58-ea52-4c4d-b6c5-0efe8bb9ac55 req-897c1c34-c418-495b-93e6-dc42a070fa53 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:50.777858 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-9e3efc58-ea52-4c4d-b6c5-0efe8bb9ac55 req-897c1c34-c418-495b-93e6-dc42a070fa53 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:50.799005 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-9e3efc58-ea52-4c4d-b6c5-0efe8bb9ac55 req-897c1c34-c418-495b-93e6-dc42a070fa53 service nova] Creating event network-vif-unplugged:064dc680-6961-4f4c-a67e-febc7cdc1c7e for instance 331ab87b-109f-48e2-aff1-f0a9639d63b5 on n-h1-master-1 Oct 23 01:49:50.806829 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-9e3efc58-ea52-4c4d-b6c5-0efe8bb9ac55 req-897c1c34-c418-495b-93e6-dc42a070fa53 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069528 Oct 23 01:49:50.809937 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3328/6563] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:49:51.428916 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8d82f05a-1603-4df4-9ba2-6363fda9c93c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:51.430538 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8d82f05a-1603-4df4-9ba2-6363fda9c93c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 331ab87b-109f-48e2-aff1-f0a9639d63b5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:51.438326 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d82f05a-1603-4df4-9ba2-6363fda9c93c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:51.439035 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d82f05a-1603-4df4-9ba2-6363fda9c93c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:51.439458 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d82f05a-1603-4df4-9ba2-6363fda9c93c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:51.440181 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d82f05a-1603-4df4-9ba2-6363fda9c93c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:51.440787 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d82f05a-1603-4df4-9ba2-6363fda9c93c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:51.441555 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d82f05a-1603-4df4-9ba2-6363fda9c93c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:51.579429 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-48a7e7ea-fe8c-4da9-8f84-fba01ba34626 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:51.580777 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-48a7e7ea-fe8c-4da9-8f84-fba01ba34626 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] [instance: 62dcefb0-44c2-41c9-b5d3-2e617a9ded5b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:51.616742 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8d82f05a-1603-4df4-9ba2-6363fda9c93c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:51.627197 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8d82f05a-1603-4df4-9ba2-6363fda9c93c tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5" status: 200 len: 1683 microversion: 2.1 time: 0.204854 Oct 23 01:49:51.656534 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3236/6564] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:51 2022] GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5 => generated 1683 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:49:51.695883 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-48a7e7ea-fe8c-4da9-8f84-fba01ba34626 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c880db3363a4aff92b82abfef14a8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b41c66c9864d7dbe35a389f72fcd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:51.696580 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-48a7e7ea-fe8c-4da9-8f84-fba01ba34626 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] 10.222.0.42 "GET /compute/v2.1/servers/62dcefb0-44c2-41c9-b5d3-2e617a9ded5b" status: 200 len: 1214 microversion: 2.1 time: 0.127238 Oct 23 01:49:51.697351 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3329/6565] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:51 2022] GET /compute/v2.1/servers/62dcefb0-44c2-41c9-b5d3-2e617a9ded5b => generated 1214 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:49:52.728328 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-839c24ea-71e8-499d-877e-c060e736b2ec tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:52.728963 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-839c24ea-71e8-499d-877e-c060e736b2ec tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] [instance: 62dcefb0-44c2-41c9-b5d3-2e617a9ded5b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:52.739387 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-839c24ea-71e8-499d-877e-c060e736b2ec tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:52.739905 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-839c24ea-71e8-499d-877e-c060e736b2ec tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:52.740502 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-839c24ea-71e8-499d-877e-c060e736b2ec tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:52.741254 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-839c24ea-71e8-499d-877e-c060e736b2ec tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:52.741720 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-839c24ea-71e8-499d-877e-c060e736b2ec tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:52.742186 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-839c24ea-71e8-499d-877e-c060e736b2ec tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:52.834706 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-839c24ea-71e8-499d-877e-c060e736b2ec tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c880db3363a4aff92b82abfef14a8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b41c66c9864d7dbe35a389f72fcd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:52.843502 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-839c24ea-71e8-499d-877e-c060e736b2ec tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] 10.222.0.42 "GET /compute/v2.1/servers/62dcefb0-44c2-41c9-b5d3-2e617a9ded5b" status: 200 len: 1218 microversion: 2.1 time: 0.119630 Oct 23 01:49:52.844269 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3237/6566] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:52 2022] GET /compute/v2.1/servers/62dcefb0-44c2-41c9-b5d3-2e617a9ded5b => generated 1218 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:49:53.872018 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-86ef74db-7b39-40fa-86ab-974b7a238931 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:53.872836 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-86ef74db-7b39-40fa-86ab-974b7a238931 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] [instance: 62dcefb0-44c2-41c9-b5d3-2e617a9ded5b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:53.883830 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-86ef74db-7b39-40fa-86ab-974b7a238931 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:53.884678 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-86ef74db-7b39-40fa-86ab-974b7a238931 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:53.885176 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-86ef74db-7b39-40fa-86ab-974b7a238931 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:53.886138 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-86ef74db-7b39-40fa-86ab-974b7a238931 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:53.886825 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-86ef74db-7b39-40fa-86ab-974b7a238931 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:53.887321 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-86ef74db-7b39-40fa-86ab-974b7a238931 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:54.000279 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-86ef74db-7b39-40fa-86ab-974b7a238931 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c880db3363a4aff92b82abfef14a8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b41c66c9864d7dbe35a389f72fcd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:54.008380 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-86ef74db-7b39-40fa-86ab-974b7a238931 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] 10.222.0.42 "GET /compute/v2.1/servers/62dcefb0-44c2-41c9-b5d3-2e617a9ded5b" status: 200 len: 1266 microversion: 2.1 time: 0.144651 Oct 23 01:49:54.009066 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3330/6567] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:53 2022] GET /compute/v2.1/servers/62dcefb0-44c2-41c9-b5d3-2e617a9ded5b => generated 1266 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:49:54.382524 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-82c116fd-c556-4590-87e0-80485329da86 req-c18a409c-3850-4375-958c-070105b371e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "331ab87b-109f-48e2-aff1-f0a9639d63b5", "name": "network-vif-plugged", "status": "completed", "tag": "064dc680-6961-4f4c-a67e-febc7cdc1c7e"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:49:54.411854 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-82c116fd-c556-4590-87e0-80485329da86 req-c18a409c-3850-4375-958c-070105b371e6 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:54.411854 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-82c116fd-c556-4590-87e0-80485329da86 req-c18a409c-3850-4375-958c-070105b371e6 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:54.411854 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-82c116fd-c556-4590-87e0-80485329da86 req-c18a409c-3850-4375-958c-070105b371e6 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:54.423778 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-82c116fd-c556-4590-87e0-80485329da86 req-c18a409c-3850-4375-958c-070105b371e6 service nova] Creating event network-vif-plugged:064dc680-6961-4f4c-a67e-febc7cdc1c7e for instance 331ab87b-109f-48e2-aff1-f0a9639d63b5 on n-h1-master-1 Oct 23 01:49:54.428817 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-82c116fd-c556-4590-87e0-80485329da86 req-c18a409c-3850-4375-958c-070105b371e6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053241 Oct 23 01:49:54.429664 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3238/6568] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:49:55.041100 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f80b45cf-8814-4b61-8bce-5ca4fab0d825 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:55.042619 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f80b45cf-8814-4b61-8bce-5ca4fab0d825 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] [instance: 62dcefb0-44c2-41c9-b5d3-2e617a9ded5b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:55.050450 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f80b45cf-8814-4b61-8bce-5ca4fab0d825 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:55.051231 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f80b45cf-8814-4b61-8bce-5ca4fab0d825 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:55.051952 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f80b45cf-8814-4b61-8bce-5ca4fab0d825 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:55.053008 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f80b45cf-8814-4b61-8bce-5ca4fab0d825 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:55.053665 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f80b45cf-8814-4b61-8bce-5ca4fab0d825 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:55.054125 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f80b45cf-8814-4b61-8bce-5ca4fab0d825 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:55.256184 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f80b45cf-8814-4b61-8bce-5ca4fab0d825 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c880db3363a4aff92b82abfef14a8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b41c66c9864d7dbe35a389f72fcd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:55.269491 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f80b45cf-8814-4b61-8bce-5ca4fab0d825 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] 10.222.0.42 "GET /compute/v2.1/servers/62dcefb0-44c2-41c9-b5d3-2e617a9ded5b" status: 200 len: 1272 microversion: 2.1 time: 0.233031 Oct 23 01:49:55.270146 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3331/6569] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:55 2022] GET /compute/v2.1/servers/62dcefb0-44c2-41c9-b5d3-2e617a9ded5b => generated 1272 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:49:56.294315 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-06ccbbd1-3d9a-4945-9e08-3c84bef15656 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:56.296309 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-06ccbbd1-3d9a-4945-9e08-3c84bef15656 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] [instance: 62dcefb0-44c2-41c9-b5d3-2e617a9ded5b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:56.310757 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-06ccbbd1-3d9a-4945-9e08-3c84bef15656 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:56.311663 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-06ccbbd1-3d9a-4945-9e08-3c84bef15656 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:56.312320 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-06ccbbd1-3d9a-4945-9e08-3c84bef15656 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:56.313218 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-06ccbbd1-3d9a-4945-9e08-3c84bef15656 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:56.323180 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-06ccbbd1-3d9a-4945-9e08-3c84bef15656 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:56.323882 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-06ccbbd1-3d9a-4945-9e08-3c84bef15656 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:56.619193 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-06ccbbd1-3d9a-4945-9e08-3c84bef15656 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c880db3363a4aff92b82abfef14a8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b41c66c9864d7dbe35a389f72fcd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:56.628142 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-06ccbbd1-3d9a-4945-9e08-3c84bef15656 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] 10.222.0.42 "GET /compute/v2.1/servers/62dcefb0-44c2-41c9-b5d3-2e617a9ded5b" status: 200 len: 1314 microversion: 2.1 time: 0.338997 Oct 23 01:49:56.645365 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3239/6570] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:56 2022] GET /compute/v2.1/servers/62dcefb0-44c2-41c9-b5d3-2e617a9ded5b => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:49:57.653250 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-06794b8b-9b59-4ad8-a79e-e17bc9772c41 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:57.654340 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-06794b8b-9b59-4ad8-a79e-e17bc9772c41 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] [instance: 62dcefb0-44c2-41c9-b5d3-2e617a9ded5b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:57.663057 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-06794b8b-9b59-4ad8-a79e-e17bc9772c41 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:57.666225 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-06794b8b-9b59-4ad8-a79e-e17bc9772c41 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:57.666225 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-06794b8b-9b59-4ad8-a79e-e17bc9772c41 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:57.666225 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-06794b8b-9b59-4ad8-a79e-e17bc9772c41 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:57.666225 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-06794b8b-9b59-4ad8-a79e-e17bc9772c41 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:57.666225 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-06794b8b-9b59-4ad8-a79e-e17bc9772c41 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:57.703705 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-428846a1-914e-41c8-87ce-5b9a2397fc97 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-605625481", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "1385e773-ce8c-43e4-b317-d666d9df50a5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e056504c-8568-4f9a-a3ed-bae9f108b4ab"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:49:57.789350 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-428846a1-914e-41c8-87ce-5b9a2397fc97 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] validate_networks() for [('e056504c-8568-4f9a-a3ed-bae9f108b4ab', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:49:58.010493 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-06794b8b-9b59-4ad8-a79e-e17bc9772c41 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c880db3363a4aff92b82abfef14a8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b41c66c9864d7dbe35a389f72fcd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:58.031881 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-06794b8b-9b59-4ad8-a79e-e17bc9772c41 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] 10.222.0.42 "GET /compute/v2.1/servers/62dcefb0-44c2-41c9-b5d3-2e617a9ded5b" status: 200 len: 1314 microversion: 2.1 time: 0.381685 Oct 23 01:49:58.033587 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3332/6571] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:57 2022] GET /compute/v2.1/servers/62dcefb0-44c2-41c9-b5d3-2e617a9ded5b => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:49:58.039564 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-afd992b5-9410-42fd-8e70-26eef6ba5b4e req-6b913d17-01e8-449f-b1a4-9d5f04df6fdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62dcefb0-44c2-41c9-b5d3-2e617a9ded5b", "tag": "041e568b-b410-4e61-9fd5-125d52c1c08d"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:49:58.058641 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-afd992b5-9410-42fd-8e70-26eef6ba5b4e req-6b913d17-01e8-449f-b1a4-9d5f04df6fdd service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:58.059811 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-afd992b5-9410-42fd-8e70-26eef6ba5b4e req-6b913d17-01e8-449f-b1a4-9d5f04df6fdd service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:58.060255 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-afd992b5-9410-42fd-8e70-26eef6ba5b4e req-6b913d17-01e8-449f-b1a4-9d5f04df6fdd service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:58.078421 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-afd992b5-9410-42fd-8e70-26eef6ba5b4e req-6b913d17-01e8-449f-b1a4-9d5f04df6fdd service nova] Creating event network-changed:041e568b-b410-4e61-9fd5-125d52c1c08d for instance 62dcefb0-44c2-41c9-b5d3-2e617a9ded5b on n-h1-master-1 Oct 23 01:49:58.083614 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-afd992b5-9410-42fd-8e70-26eef6ba5b4e req-6b913d17-01e8-449f-b1a4-9d5f04df6fdd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048343 Oct 23 01:49:58.086656 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3333/6572] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:49:58.721397 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-428846a1-914e-41c8-87ce-5b9a2397fc97 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:49:58.726548 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-428846a1-914e-41c8-87ce-5b9a2397fc97 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:49:58.727045 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-428846a1-914e-41c8-87ce-5b9a2397fc97 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:49:58.727462 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-428846a1-914e-41c8-87ce-5b9a2397fc97 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:49:58.727875 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-428846a1-914e-41c8-87ce-5b9a2397fc97 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:49:58.752452 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-428846a1-914e-41c8-87ce-5b9a2397fc97 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:58.752935 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-428846a1-914e-41c8-87ce-5b9a2397fc97 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:58.753370 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-428846a1-914e-41c8-87ce-5b9a2397fc97 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:58.754146 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-428846a1-914e-41c8-87ce-5b9a2397fc97 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:58.754700 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-428846a1-914e-41c8-87ce-5b9a2397fc97 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:58.755558 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-428846a1-914e-41c8-87ce-5b9a2397fc97 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:58.781178 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-428846a1-914e-41c8-87ce-5b9a2397fc97 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Getting quotas for project b1ec0b5ecaa741eaaf40a50f1415e7f9. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:49:58.791537 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-428846a1-914e-41c8-87ce-5b9a2397fc97 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Getting quotas for user f2967d0d8c134d269c9bbe51c90f803a and project b1ec0b5ecaa741eaaf40a50f1415e7f9. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:49:58.868157 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-428846a1-914e-41c8-87ce-5b9a2397fc97 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:49:58.873183 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-428846a1-914e-41c8-87ce-5b9a2397fc97 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 061034d6-4994-43d2-94df-fb12274eed87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1385e773-ce8c-43e4-b317-d666d9df50a5',volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:49:59.062560 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-badf2232-f76c-4e9f-b809-ab1325513819 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:59.063287 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-badf2232-f76c-4e9f-b809-ab1325513819 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] [instance: 62dcefb0-44c2-41c9-b5d3-2e617a9ded5b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:59.071560 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-badf2232-f76c-4e9f-b809-ab1325513819 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:59.072052 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-badf2232-f76c-4e9f-b809-ab1325513819 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:59.072536 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-badf2232-f76c-4e9f-b809-ab1325513819 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:59.073257 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-badf2232-f76c-4e9f-b809-ab1325513819 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:49:59.073708 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-badf2232-f76c-4e9f-b809-ab1325513819 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:49:59.074224 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-badf2232-f76c-4e9f-b809-ab1325513819 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:49:59.218360 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-badf2232-f76c-4e9f-b809-ab1325513819 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c880db3363a4aff92b82abfef14a8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b41c66c9864d7dbe35a389f72fcd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:59.226611 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-badf2232-f76c-4e9f-b809-ab1325513819 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] 10.222.0.42 "GET /compute/v2.1/servers/62dcefb0-44c2-41c9-b5d3-2e617a9ded5b" status: 200 len: 1314 microversion: 2.1 time: 0.169400 Oct 23 01:49:59.235648 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3334/6573] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:59 2022] GET /compute/v2.1/servers/62dcefb0-44c2-41c9-b5d3-2e617a9ded5b => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:49:59.486529 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-428846a1-914e-41c8-87ce-5b9a2397fc97 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.787511 Oct 23 01:49:59.487412 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3240/6574] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:49:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:49:59.501004 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e5026915-3297-4ce2-9492-2fee3994b676 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:49:59.501004 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e5026915-3297-4ce2-9492-2fee3994b676 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 061034d6-4994-43d2-94df-fb12274eed87] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:49:59.582665 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e5026915-3297-4ce2-9492-2fee3994b676 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:49:59.595097 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e5026915-3297-4ce2-9492-2fee3994b676 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87" status: 200 len: 1056 microversion: 2.1 time: 0.098308 Oct 23 01:49:59.595975 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3335/6575] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:49:59 2022] GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87 => generated 1056 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:00.250863 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d1a717c5-3ed1-4bfe-b114-04c6264acf3b tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:00.252088 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d1a717c5-3ed1-4bfe-b114-04c6264acf3b tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] [instance: 62dcefb0-44c2-41c9-b5d3-2e617a9ded5b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:00.272535 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d1a717c5-3ed1-4bfe-b114-04c6264acf3b tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:00.293834 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d1a717c5-3ed1-4bfe-b114-04c6264acf3b tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:00.299203 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d1a717c5-3ed1-4bfe-b114-04c6264acf3b tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:00.300859 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d1a717c5-3ed1-4bfe-b114-04c6264acf3b tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:00.301739 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d1a717c5-3ed1-4bfe-b114-04c6264acf3b tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:00.302444 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d1a717c5-3ed1-4bfe-b114-04c6264acf3b tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:00.618657 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f76b9028-0e32-43fe-826d-162235eb9f67 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:00.619304 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f76b9028-0e32-43fe-826d-162235eb9f67 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 061034d6-4994-43d2-94df-fb12274eed87] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:00.621758 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:50:00.751897 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d1a717c5-3ed1-4bfe-b114-04c6264acf3b tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c880db3363a4aff92b82abfef14a8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b41c66c9864d7dbe35a389f72fcd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:00.757209 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f76b9028-0e32-43fe-826d-162235eb9f67 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:00.759856 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d1a717c5-3ed1-4bfe-b114-04c6264acf3b tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] 10.222.0.42 "GET /compute/v2.1/servers/62dcefb0-44c2-41c9-b5d3-2e617a9ded5b" status: 200 len: 1314 microversion: 2.1 time: 0.513073 Oct 23 01:50:00.774711 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3241/6576] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:00 2022] GET /compute/v2.1/servers/62dcefb0-44c2-41c9-b5d3-2e617a9ded5b => generated 1314 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:00.777714 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f76b9028-0e32-43fe-826d-162235eb9f67 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87" status: 200 len: 1056 microversion: 2.1 time: 0.157747 Oct 23 01:50:00.777714 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3336/6577] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:00 2022] GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87 => generated 1056 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:01.785430 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6c1df914-7c9a-4b98-a113-d412df00965b tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:01.786084 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6c1df914-7c9a-4b98-a113-d412df00965b tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] [instance: 62dcefb0-44c2-41c9-b5d3-2e617a9ded5b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:01.793394 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6c1df914-7c9a-4b98-a113-d412df00965b tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:01.794108 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6c1df914-7c9a-4b98-a113-d412df00965b tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:01.794543 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6c1df914-7c9a-4b98-a113-d412df00965b tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:01.795776 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6c1df914-7c9a-4b98-a113-d412df00965b tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:01.796222 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6c1df914-7c9a-4b98-a113-d412df00965b tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:01.796642 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6c1df914-7c9a-4b98-a113-d412df00965b tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:01.805883 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a1740234-682e-40e1-ad16-8cc0f481ed1c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:01.807003 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a1740234-682e-40e1-ad16-8cc0f481ed1c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 061034d6-4994-43d2-94df-fb12274eed87] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:01.815230 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a1740234-682e-40e1-ad16-8cc0f481ed1c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:01.815400 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a1740234-682e-40e1-ad16-8cc0f481ed1c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:01.816030 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a1740234-682e-40e1-ad16-8cc0f481ed1c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:01.816772 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a1740234-682e-40e1-ad16-8cc0f481ed1c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:01.817379 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a1740234-682e-40e1-ad16-8cc0f481ed1c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:01.817809 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a1740234-682e-40e1-ad16-8cc0f481ed1c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:01.899996 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a1740234-682e-40e1-ad16-8cc0f481ed1c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:01.910356 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a1740234-682e-40e1-ad16-8cc0f481ed1c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87" status: 200 len: 1098 microversion: 2.1 time: 0.108320 Oct 23 01:50:01.910827 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3337/6578] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:01 2022] GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87 => generated 1098 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:50:01.970509 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6c1df914-7c9a-4b98-a113-d412df00965b tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c880db3363a4aff92b82abfef14a8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b41c66c9864d7dbe35a389f72fcd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:01.978130 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6c1df914-7c9a-4b98-a113-d412df00965b tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] 10.222.0.42 "GET /compute/v2.1/servers/62dcefb0-44c2-41c9-b5d3-2e617a9ded5b" status: 200 len: 1314 microversion: 2.1 time: 0.196872 Oct 23 01:50:01.978996 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3242/6579] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:01 2022] GET /compute/v2.1/servers/62dcefb0-44c2-41c9-b5d3-2e617a9ded5b => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:50:02.431930 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-ca280e4a-d717-4f8e-acd3-76e0313ed104 req-658a1659-2ea2-4fc3-8fb9-1a84f14b91bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62dcefb0-44c2-41c9-b5d3-2e617a9ded5b", "name": "network-vif-plugged", "status": "completed", "tag": "041e568b-b410-4e61-9fd5-125d52c1c08d"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:50:02.442361 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-ca280e4a-d717-4f8e-acd3-76e0313ed104 req-658a1659-2ea2-4fc3-8fb9-1a84f14b91bc service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:02.442844 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-ca280e4a-d717-4f8e-acd3-76e0313ed104 req-658a1659-2ea2-4fc3-8fb9-1a84f14b91bc service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:02.443281 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-ca280e4a-d717-4f8e-acd3-76e0313ed104 req-658a1659-2ea2-4fc3-8fb9-1a84f14b91bc service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:02.455269 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-ca280e4a-d717-4f8e-acd3-76e0313ed104 req-658a1659-2ea2-4fc3-8fb9-1a84f14b91bc service nova] Creating event network-vif-plugged:041e568b-b410-4e61-9fd5-125d52c1c08d for instance 62dcefb0-44c2-41c9-b5d3-2e617a9ded5b on n-h1-master-1 Oct 23 01:50:02.461212 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-ca280e4a-d717-4f8e-acd3-76e0313ed104 req-658a1659-2ea2-4fc3-8fb9-1a84f14b91bc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033916 Oct 23 01:50:02.461818 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3338/6580] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:50:02.935517 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-acd35b70-4a44-4345-add0-f912e76ef247 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:02.936243 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-acd35b70-4a44-4345-add0-f912e76ef247 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 061034d6-4994-43d2-94df-fb12274eed87] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:02.942847 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-acd35b70-4a44-4345-add0-f912e76ef247 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:02.943585 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-acd35b70-4a44-4345-add0-f912e76ef247 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:02.944032 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-acd35b70-4a44-4345-add0-f912e76ef247 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:02.944911 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-acd35b70-4a44-4345-add0-f912e76ef247 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:02.945370 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-acd35b70-4a44-4345-add0-f912e76ef247 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:02.945798 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-acd35b70-4a44-4345-add0-f912e76ef247 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:03.002954 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7d91d19e-0a1a-4066-bab1-657981a0dc08 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:03.003764 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7d91d19e-0a1a-4066-bab1-657981a0dc08 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] [instance: 62dcefb0-44c2-41c9-b5d3-2e617a9ded5b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:03.015991 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d91d19e-0a1a-4066-bab1-657981a0dc08 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:03.016710 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d91d19e-0a1a-4066-bab1-657981a0dc08 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:03.026651 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d91d19e-0a1a-4066-bab1-657981a0dc08 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:03.027577 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d91d19e-0a1a-4066-bab1-657981a0dc08 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:03.028233 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d91d19e-0a1a-4066-bab1-657981a0dc08 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:03.028827 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d91d19e-0a1a-4066-bab1-657981a0dc08 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:03.031014 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-acd35b70-4a44-4345-add0-f912e76ef247 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:03.043435 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-acd35b70-4a44-4345-add0-f912e76ef247 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87" status: 200 len: 1154 microversion: 2.1 time: 0.111793 Oct 23 01:50:03.044815 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3243/6581] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:02 2022] GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87 => generated 1154 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:03.198823 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7d91d19e-0a1a-4066-bab1-657981a0dc08 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c880db3363a4aff92b82abfef14a8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b41c66c9864d7dbe35a389f72fcd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:03.208647 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7d91d19e-0a1a-4066-bab1-657981a0dc08 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] 10.222.0.42 "GET /compute/v2.1/servers/62dcefb0-44c2-41c9-b5d3-2e617a9ded5b" status: 200 len: 1314 microversion: 2.1 time: 0.210127 Oct 23 01:50:03.209238 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3339/6582] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:02 2022] GET /compute/v2.1/servers/62dcefb0-44c2-41c9-b5d3-2e617a9ded5b => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:50:04.067795 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a4ec5b13-6d50-435d-aa98-097cda8369fa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:04.068547 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a4ec5b13-6d50-435d-aa98-097cda8369fa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 061034d6-4994-43d2-94df-fb12274eed87] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:04.079299 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a4ec5b13-6d50-435d-aa98-097cda8369fa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:04.079907 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a4ec5b13-6d50-435d-aa98-097cda8369fa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:04.095841 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a4ec5b13-6d50-435d-aa98-097cda8369fa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:04.095841 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a4ec5b13-6d50-435d-aa98-097cda8369fa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:04.095841 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a4ec5b13-6d50-435d-aa98-097cda8369fa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:04.095841 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a4ec5b13-6d50-435d-aa98-097cda8369fa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:04.233254 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8a8b1549-940e-4c67-bffe-395b1db4da80 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:04.234244 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8a8b1549-940e-4c67-bffe-395b1db4da80 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] [instance: 62dcefb0-44c2-41c9-b5d3-2e617a9ded5b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:04.239167 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a4ec5b13-6d50-435d-aa98-097cda8369fa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:04.253605 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a4ec5b13-6d50-435d-aa98-097cda8369fa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87" status: 200 len: 1172 microversion: 2.1 time: 0.189560 Oct 23 01:50:04.275824 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3244/6583] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:04 2022] GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87 => generated 1172 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:04.277111 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8a8b1549-940e-4c67-bffe-395b1db4da80 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:04.277959 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8a8b1549-940e-4c67-bffe-395b1db4da80 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:04.279774 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8a8b1549-940e-4c67-bffe-395b1db4da80 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:04.280801 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8a8b1549-940e-4c67-bffe-395b1db4da80 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:04.282110 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8a8b1549-940e-4c67-bffe-395b1db4da80 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:04.282751 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8a8b1549-940e-4c67-bffe-395b1db4da80 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:04.550612 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8a8b1549-940e-4c67-bffe-395b1db4da80 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c880db3363a4aff92b82abfef14a8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b41c66c9864d7dbe35a389f72fcd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:04.562617 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8a8b1549-940e-4c67-bffe-395b1db4da80 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] 10.222.0.42 "GET /compute/v2.1/servers/62dcefb0-44c2-41c9-b5d3-2e617a9ded5b" status: 200 len: 1463 microversion: 2.1 time: 0.333421 Oct 23 01:50:04.563342 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3340/6584] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:04 2022] GET /compute/v2.1/servers/62dcefb0-44c2-41c9-b5d3-2e617a9ded5b => generated 1463 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:04.589742 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e81a6962-8157-4c2b-a638-7df178eaaecf tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b2695d8f-cb12-416f-8d14-2f9361ee8e6a", "device": "/dev/sdb"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:50:04.592795 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e81a6962-8157-4c2b-a638-7df178eaaecf tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] [instance: 62dcefb0-44c2-41c9-b5d3-2e617a9ded5b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:04.600320 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e81a6962-8157-4c2b-a638-7df178eaaecf tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:04.601034 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e81a6962-8157-4c2b-a638-7df178eaaecf tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:04.601626 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e81a6962-8157-4c2b-a638-7df178eaaecf tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:04.602584 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e81a6962-8157-4c2b-a638-7df178eaaecf tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:04.603188 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e81a6962-8157-4c2b-a638-7df178eaaecf tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:04.603761 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e81a6962-8157-4c2b-a638-7df178eaaecf tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:05.286995 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-82a04254-b7ec-4668-a36b-b1baaffdb5ff tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:05.288540 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-82a04254-b7ec-4668-a36b-b1baaffdb5ff tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 061034d6-4994-43d2-94df-fb12274eed87] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:05.301126 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-82a04254-b7ec-4668-a36b-b1baaffdb5ff tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:05.302490 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-82a04254-b7ec-4668-a36b-b1baaffdb5ff tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:05.303184 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-82a04254-b7ec-4668-a36b-b1baaffdb5ff tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:05.304178 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-82a04254-b7ec-4668-a36b-b1baaffdb5ff tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:05.304866 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-82a04254-b7ec-4668-a36b-b1baaffdb5ff tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:05.306018 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-82a04254-b7ec-4668-a36b-b1baaffdb5ff tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:05.483573 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-82a04254-b7ec-4668-a36b-b1baaffdb5ff tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:05.504004 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-82a04254-b7ec-4668-a36b-b1baaffdb5ff tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87" status: 200 len: 1214 microversion: 2.1 time: 0.224042 Oct 23 01:50:05.504883 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3341/6585] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:05 2022] GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87 => generated 1214 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:05.554841 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e81a6962-8157-4c2b-a638-7df178eaaecf tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] 10.222.0.42 "POST /compute/v2.1/servers/62dcefb0-44c2-41c9-b5d3-2e617a9ded5b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.969684 Oct 23 01:50:05.556407 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3245/6586] 10.222.0.42 () {60 vars in 1323 bytes} [Sun Oct 23 01:50:04 2022] POST /compute/v2.1/servers/62dcefb0-44c2-41c9-b5d3-2e617a9ded5b/os-volume_attachments => generated 194 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:50:06.528229 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-64a333c8-4531-4041-af42-752c0f7b6665 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:06.528919 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-64a333c8-4531-4041-af42-752c0f7b6665 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 061034d6-4994-43d2-94df-fb12274eed87] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:06.549535 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-64a333c8-4531-4041-af42-752c0f7b6665 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:06.550352 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-64a333c8-4531-4041-af42-752c0f7b6665 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:06.550959 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-64a333c8-4531-4041-af42-752c0f7b6665 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:06.551842 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-64a333c8-4531-4041-af42-752c0f7b6665 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:06.552466 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-64a333c8-4531-4041-af42-752c0f7b6665 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:06.553084 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-64a333c8-4531-4041-af42-752c0f7b6665 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:06.865152 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-7a849b7a-e4c2-43f2-82b1-61b00e6f88dd req-13ea98ff-aedb-4c53-b6b1-7a959677f331 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "061034d6-4994-43d2-94df-fb12274eed87", "tag": "de88c6c4-18ff-437e-b080-2c0b8ec0e57d"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:50:06.885312 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-7a849b7a-e4c2-43f2-82b1-61b00e6f88dd req-13ea98ff-aedb-4c53-b6b1-7a959677f331 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:06.886244 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-7a849b7a-e4c2-43f2-82b1-61b00e6f88dd req-13ea98ff-aedb-4c53-b6b1-7a959677f331 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:06.887121 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-7a849b7a-e4c2-43f2-82b1-61b00e6f88dd req-13ea98ff-aedb-4c53-b6b1-7a959677f331 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:06.903747 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-7a849b7a-e4c2-43f2-82b1-61b00e6f88dd req-13ea98ff-aedb-4c53-b6b1-7a959677f331 service nova] Creating event network-changed:de88c6c4-18ff-437e-b080-2c0b8ec0e57d for instance 061034d6-4994-43d2-94df-fb12274eed87 on n-h2-master-1 Oct 23 01:50:06.911342 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-7a849b7a-e4c2-43f2-82b1-61b00e6f88dd req-13ea98ff-aedb-4c53-b6b1-7a959677f331 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049868 Oct 23 01:50:06.912666 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3246/6587] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:50:07.146300 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-64a333c8-4531-4041-af42-752c0f7b6665 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:07.155086 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-64a333c8-4531-4041-af42-752c0f7b6665 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87" status: 200 len: 1214 microversion: 2.1 time: 0.631060 Oct 23 01:50:07.170004 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3342/6588] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:06 2022] GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87 => generated 1214 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:08.181810 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-10e95421-e816-44fc-a674-ed75e6e52367 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:08.182814 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-10e95421-e816-44fc-a674-ed75e6e52367 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 061034d6-4994-43d2-94df-fb12274eed87] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:08.190206 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10e95421-e816-44fc-a674-ed75e6e52367 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:08.190786 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10e95421-e816-44fc-a674-ed75e6e52367 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:08.191297 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10e95421-e816-44fc-a674-ed75e6e52367 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:08.192066 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10e95421-e816-44fc-a674-ed75e6e52367 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:08.192666 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10e95421-e816-44fc-a674-ed75e6e52367 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:08.193296 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10e95421-e816-44fc-a674-ed75e6e52367 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:08.420005 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-10e95421-e816-44fc-a674-ed75e6e52367 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:08.428430 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-10e95421-e816-44fc-a674-ed75e6e52367 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87" status: 200 len: 1214 microversion: 2.1 time: 0.252189 Oct 23 01:50:08.437623 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3247/6589] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:08 2022] GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87 => generated 1214 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:09.455070 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b6686410-2d39-4a33-9efb-1ad8579f9621 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:09.456986 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b6686410-2d39-4a33-9efb-1ad8579f9621 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 061034d6-4994-43d2-94df-fb12274eed87] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:09.466898 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b6686410-2d39-4a33-9efb-1ad8579f9621 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:09.467892 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b6686410-2d39-4a33-9efb-1ad8579f9621 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:09.468565 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b6686410-2d39-4a33-9efb-1ad8579f9621 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:09.469652 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b6686410-2d39-4a33-9efb-1ad8579f9621 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:09.470603 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b6686410-2d39-4a33-9efb-1ad8579f9621 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:09.471255 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b6686410-2d39-4a33-9efb-1ad8579f9621 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:09.475365 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=92 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:50:09.705650 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b6686410-2d39-4a33-9efb-1ad8579f9621 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:09.713950 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b6686410-2d39-4a33-9efb-1ad8579f9621 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87" status: 200 len: 1214 microversion: 2.1 time: 0.265217 Oct 23 01:50:09.714691 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3343/6590] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:09 2022] GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87 => generated 1214 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:10.737400 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b5a5c40a-b719-4da6-8f66-f12629139bb2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:10.738307 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b5a5c40a-b719-4da6-8f66-f12629139bb2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 061034d6-4994-43d2-94df-fb12274eed87] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:10.740496 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:50:10.741277 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=8 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:50:10.747311 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b5a5c40a-b719-4da6-8f66-f12629139bb2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:10.748111 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b5a5c40a-b719-4da6-8f66-f12629139bb2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:10.749791 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b5a5c40a-b719-4da6-8f66-f12629139bb2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:10.750537 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b5a5c40a-b719-4da6-8f66-f12629139bb2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:10.751000 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b5a5c40a-b719-4da6-8f66-f12629139bb2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:10.754570 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b5a5c40a-b719-4da6-8f66-f12629139bb2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:10.932277 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b5a5c40a-b719-4da6-8f66-f12629139bb2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:10.941707 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b5a5c40a-b719-4da6-8f66-f12629139bb2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87" status: 200 len: 1214 microversion: 2.1 time: 0.208837 Oct 23 01:50:10.954123 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3248/6591] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:10 2022] GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87 => generated 1214 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:11.966255 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-138e5201-fa2d-47ca-b281-e33381f1c189 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:11.967048 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-138e5201-fa2d-47ca-b281-e33381f1c189 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 061034d6-4994-43d2-94df-fb12274eed87] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:11.974589 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=12 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:50:11.977590 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-138e5201-fa2d-47ca-b281-e33381f1c189 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:11.978516 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-138e5201-fa2d-47ca-b281-e33381f1c189 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:11.979215 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-138e5201-fa2d-47ca-b281-e33381f1c189 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:11.980152 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-138e5201-fa2d-47ca-b281-e33381f1c189 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:11.980864 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-138e5201-fa2d-47ca-b281-e33381f1c189 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:11.981486 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-138e5201-fa2d-47ca-b281-e33381f1c189 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:12.627539 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-138e5201-fa2d-47ca-b281-e33381f1c189 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:12.636384 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-138e5201-fa2d-47ca-b281-e33381f1c189 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87" status: 200 len: 1214 microversion: 2.1 time: 0.674144 Oct 23 01:50:12.636985 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3344/6592] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:11 2022] GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87 => generated 1214 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:13.665756 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-134f8968-a90f-4415-8c75-834bb028c440 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:13.667308 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-134f8968-a90f-4415-8c75-834bb028c440 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 061034d6-4994-43d2-94df-fb12274eed87] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:13.680163 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-134f8968-a90f-4415-8c75-834bb028c440 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:13.681208 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-134f8968-a90f-4415-8c75-834bb028c440 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:13.683483 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-134f8968-a90f-4415-8c75-834bb028c440 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:13.684634 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-134f8968-a90f-4415-8c75-834bb028c440 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:13.685324 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-134f8968-a90f-4415-8c75-834bb028c440 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:13.685965 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-134f8968-a90f-4415-8c75-834bb028c440 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:13.908408 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-134f8968-a90f-4415-8c75-834bb028c440 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:13.916647 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-134f8968-a90f-4415-8c75-834bb028c440 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87" status: 200 len: 1202 microversion: 2.1 time: 0.257596 Oct 23 01:50:13.931617 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3249/6593] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:13 2022] GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87 => generated 1202 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:14.943474 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a49969dd-c88f-48e7-80d0-dd18bc97fdac tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:14.949406 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a49969dd-c88f-48e7-80d0-dd18bc97fdac tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 061034d6-4994-43d2-94df-fb12274eed87] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:14.951172 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a49969dd-c88f-48e7-80d0-dd18bc97fdac tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:14.951674 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a49969dd-c88f-48e7-80d0-dd18bc97fdac tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:14.952748 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a49969dd-c88f-48e7-80d0-dd18bc97fdac tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:14.953464 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a49969dd-c88f-48e7-80d0-dd18bc97fdac tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:14.953926 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a49969dd-c88f-48e7-80d0-dd18bc97fdac tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:14.954384 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a49969dd-c88f-48e7-80d0-dd18bc97fdac tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:15.159106 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a49969dd-c88f-48e7-80d0-dd18bc97fdac tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:15.170580 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a49969dd-c88f-48e7-80d0-dd18bc97fdac tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87" status: 200 len: 1202 microversion: 2.1 time: 0.231239 Oct 23 01:50:15.173187 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3345/6594] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:14 2022] GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87 => generated 1202 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:15.913450 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-19c17c02-1b4f-49b6-8fb4-89539db7d7cb tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:50:15.917666 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-19c17c02-1b4f-49b6-8fb4-89539db7d7cb tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 331ab87b-109f-48e2-aff1-f0a9639d63b5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:15.924661 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-19c17c02-1b4f-49b6-8fb4-89539db7d7cb tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:15.925158 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-19c17c02-1b4f-49b6-8fb4-89539db7d7cb tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:15.925805 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-19c17c02-1b4f-49b6-8fb4-89539db7d7cb tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:15.926701 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-19c17c02-1b4f-49b6-8fb4-89539db7d7cb tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:15.927333 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-19c17c02-1b4f-49b6-8fb4-89539db7d7cb tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:15.927922 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-19c17c02-1b4f-49b6-8fb4-89539db7d7cb tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:16.005919 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-19c17c02-1b4f-49b6-8fb4-89539db7d7cb tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "POST /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5/action" status: 200 len: 24539 microversion: 2.1 time: 0.095556 Oct 23 01:50:16.006835 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3250/6595] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:50:15 2022] POST /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5/action => generated 24539 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:50:16.194445 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-59f9ed67-740e-4330-8221-d2689c862f08 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:16.195169 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-59f9ed67-740e-4330-8221-d2689c862f08 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 061034d6-4994-43d2-94df-fb12274eed87] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:16.203134 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-59f9ed67-740e-4330-8221-d2689c862f08 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:16.203637 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-59f9ed67-740e-4330-8221-d2689c862f08 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:16.204082 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-59f9ed67-740e-4330-8221-d2689c862f08 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:16.205880 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-59f9ed67-740e-4330-8221-d2689c862f08 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:16.205880 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-59f9ed67-740e-4330-8221-d2689c862f08 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:16.205880 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-59f9ed67-740e-4330-8221-d2689c862f08 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:16.470565 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-59f9ed67-740e-4330-8221-d2689c862f08 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:16.480620 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-59f9ed67-740e-4330-8221-d2689c862f08 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87" status: 200 len: 1202 microversion: 2.1 time: 0.291322 Oct 23 01:50:16.499627 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3346/6596] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:16 2022] GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87 => generated 1202 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:17.521092 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9d557cff-26bd-40d3-91c9-184fd1cbab32 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:17.528483 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9d557cff-26bd-40d3-91c9-184fd1cbab32 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 061034d6-4994-43d2-94df-fb12274eed87] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:17.547284 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d557cff-26bd-40d3-91c9-184fd1cbab32 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:17.548201 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d557cff-26bd-40d3-91c9-184fd1cbab32 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:17.555957 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d557cff-26bd-40d3-91c9-184fd1cbab32 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:17.555957 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d557cff-26bd-40d3-91c9-184fd1cbab32 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:17.555957 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d557cff-26bd-40d3-91c9-184fd1cbab32 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:17.562472 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d557cff-26bd-40d3-91c9-184fd1cbab32 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:17.938372 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9d557cff-26bd-40d3-91c9-184fd1cbab32 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:17.941000 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:50:17.948587 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9d557cff-26bd-40d3-91c9-184fd1cbab32 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87" status: 200 len: 1202 microversion: 2.1 time: 0.432536 Oct 23 01:50:17.965181 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3251/6597] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:17 2022] GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87 => generated 1202 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:18.981080 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-461e3393-47bb-4946-ba8f-96669411707c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:18.981743 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-461e3393-47bb-4946-ba8f-96669411707c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 061034d6-4994-43d2-94df-fb12274eed87] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:18.987325 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:50:19.001334 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-461e3393-47bb-4946-ba8f-96669411707c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:19.002300 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-461e3393-47bb-4946-ba8f-96669411707c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:19.002929 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-461e3393-47bb-4946-ba8f-96669411707c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:19.005830 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-461e3393-47bb-4946-ba8f-96669411707c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:19.006598 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-461e3393-47bb-4946-ba8f-96669411707c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:19.007204 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-461e3393-47bb-4946-ba8f-96669411707c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:19.384249 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-461e3393-47bb-4946-ba8f-96669411707c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:19.392268 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-461e3393-47bb-4946-ba8f-96669411707c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87" status: 200 len: 1202 microversion: 2.1 time: 0.422808 Oct 23 01:50:19.414077 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3347/6598] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:18 2022] GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87 => generated 1202 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:20.382067 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5e237655-78a0-42f5-a07f-37592353cf6e tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1142083464", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "2ff6ab1b-b52d-4864-8e7a-d6bebf5f57da"}], "key_name": "tempest-TestSecurityGroupsBasicOps-484001668", "security_groups": []}, "os:scheduler_hints": {"different_host": ["64804b2c-74aa-4e67-8eba-75a5c4f7db76"]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:50:20.422503 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-966deb5e-c49f-498a-95a5-57a202f37d1c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:20.423276 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-966deb5e-c49f-498a-95a5-57a202f37d1c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 061034d6-4994-43d2-94df-fb12274eed87] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:20.438298 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-966deb5e-c49f-498a-95a5-57a202f37d1c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:20.439161 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-966deb5e-c49f-498a-95a5-57a202f37d1c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:20.440265 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-966deb5e-c49f-498a-95a5-57a202f37d1c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:20.444257 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-966deb5e-c49f-498a-95a5-57a202f37d1c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:20.445334 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-966deb5e-c49f-498a-95a5-57a202f37d1c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:20.446210 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-966deb5e-c49f-498a-95a5-57a202f37d1c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:20.540136 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-5e237655-78a0-42f5-a07f-37592353cf6e tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] validate_networks() for [('2ff6ab1b-b52d-4864-8e7a-d6bebf5f57da', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:50:21.164201 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-966deb5e-c49f-498a-95a5-57a202f37d1c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:21.173706 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-966deb5e-c49f-498a-95a5-57a202f37d1c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87" status: 200 len: 1202 microversion: 2.1 time: 0.755916 Oct 23 01:50:21.176300 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3348/6599] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:20 2022] GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87 => generated 1202 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:21.684015 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-5e237655-78a0-42f5-a07f-37592353cf6e tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:50:21.685192 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-5e237655-78a0-42f5-a07f-37592353cf6e tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:50:21.686026 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-5e237655-78a0-42f5-a07f-37592353cf6e tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:50:21.687183 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-5e237655-78a0-42f5-a07f-37592353cf6e tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:50:21.687763 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-5e237655-78a0-42f5-a07f-37592353cf6e tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:50:21.703422 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:50:21.711974 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e237655-78a0-42f5-a07f-37592353cf6e tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:21.712666 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e237655-78a0-42f5-a07f-37592353cf6e tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:21.713606 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e237655-78a0-42f5-a07f-37592353cf6e tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:21.714563 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e237655-78a0-42f5-a07f-37592353cf6e tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:21.715555 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e237655-78a0-42f5-a07f-37592353cf6e tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:21.716323 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e237655-78a0-42f5-a07f-37592353cf6e tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:21.764286 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-5e237655-78a0-42f5-a07f-37592353cf6e tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Getting quotas for project a028aafec3294eae9a1c1a9a4e907dc2. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:50:21.779887 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-5e237655-78a0-42f5-a07f-37592353cf6e tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Getting quotas for user 38c7799d37d747b08a9e20e15c3d6879 and project a028aafec3294eae9a1c1a9a4e907dc2. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:50:21.810734 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5e237655-78a0-42f5-a07f-37592353cf6e tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:50:21.814297 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5e237655-78a0-42f5-a07f-37592353cf6e tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] [instance: ce195309-8592-4c18-a45d-76038e4efaff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:50:22.005810 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5e237655-78a0-42f5-a07f-37592353cf6e tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.634154 Oct 23 01:50:22.007040 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3252/6600] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:50:20 2022] POST /compute/v2.1/servers => generated 361 bytes in 1636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:50:22.020147 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c8ea38c9-5b3b-492b-8831-ce3236767363 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:22.021337 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c8ea38c9-5b3b-492b-8831-ce3236767363 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] [instance: ce195309-8592-4c18-a45d-76038e4efaff] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:22.152448 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c8ea38c9-5b3b-492b-8831-ce3236767363 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c7799d37d747b08a9e20e15c3d6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a028aafec3294eae9a1c1a9a4e907dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:22.166149 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c8ea38c9-5b3b-492b-8831-ce3236767363 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] 10.222.0.42 "GET /compute/v2.1/servers/ce195309-8592-4c18-a45d-76038e4efaff" status: 200 len: 1241 microversion: 2.1 time: 0.151375 Oct 23 01:50:22.170362 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3349/6601] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:22 2022] GET /compute/v2.1/servers/ce195309-8592-4c18-a45d-76038e4efaff => generated 1241 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:22.201249 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-616c441f-ab1f-4181-9213-d307ca26a216 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:22.201878 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-616c441f-ab1f-4181-9213-d307ca26a216 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 061034d6-4994-43d2-94df-fb12274eed87] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:22.219104 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-616c441f-ab1f-4181-9213-d307ca26a216 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:22.222337 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-616c441f-ab1f-4181-9213-d307ca26a216 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:22.223081 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-616c441f-ab1f-4181-9213-d307ca26a216 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:22.224044 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-616c441f-ab1f-4181-9213-d307ca26a216 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:22.227176 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-616c441f-ab1f-4181-9213-d307ca26a216 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:22.227940 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-616c441f-ab1f-4181-9213-d307ca26a216 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:22.716695 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-616c441f-ab1f-4181-9213-d307ca26a216 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:22.738327 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-616c441f-ab1f-4181-9213-d307ca26a216 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87" status: 200 len: 1202 microversion: 2.1 time: 0.539726 Oct 23 01:50:22.742351 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3253/6602] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:22 2022] GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87 => generated 1202 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:23.196088 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fcdfcfaa-023d-490c-837c-97a36239ce51 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:23.197091 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fcdfcfaa-023d-490c-837c-97a36239ce51 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] [instance: ce195309-8592-4c18-a45d-76038e4efaff] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:23.333513 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fcdfcfaa-023d-490c-837c-97a36239ce51 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c7799d37d747b08a9e20e15c3d6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a028aafec3294eae9a1c1a9a4e907dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:23.346496 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fcdfcfaa-023d-490c-837c-97a36239ce51 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] 10.222.0.42 "GET /compute/v2.1/servers/ce195309-8592-4c18-a45d-76038e4efaff" status: 200 len: 1241 microversion: 2.1 time: 0.155436 Oct 23 01:50:23.347250 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3350/6603] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:23 2022] GET /compute/v2.1/servers/ce195309-8592-4c18-a45d-76038e4efaff => generated 1241 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:23.767922 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ecf1d5cf-5621-4cb6-a386-52a9ab46d384 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:23.768539 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ecf1d5cf-5621-4cb6-a386-52a9ab46d384 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 061034d6-4994-43d2-94df-fb12274eed87] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:23.785827 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ecf1d5cf-5621-4cb6-a386-52a9ab46d384 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:23.786540 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ecf1d5cf-5621-4cb6-a386-52a9ab46d384 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:23.787141 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ecf1d5cf-5621-4cb6-a386-52a9ab46d384 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:23.788369 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ecf1d5cf-5621-4cb6-a386-52a9ab46d384 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:23.789132 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ecf1d5cf-5621-4cb6-a386-52a9ab46d384 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:23.789727 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ecf1d5cf-5621-4cb6-a386-52a9ab46d384 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:24.110690 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ecf1d5cf-5621-4cb6-a386-52a9ab46d384 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:24.128290 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ecf1d5cf-5621-4cb6-a386-52a9ab46d384 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87" status: 200 len: 1202 microversion: 2.1 time: 0.365120 Oct 23 01:50:24.131997 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3254/6604] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:23 2022] GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87 => generated 1202 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:24.390485 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7d1e0adf-255a-4e9a-bf6c-c30388b2e18a tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:24.392030 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7d1e0adf-255a-4e9a-bf6c-c30388b2e18a tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] [instance: ce195309-8592-4c18-a45d-76038e4efaff] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:24.415334 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d1e0adf-255a-4e9a-bf6c-c30388b2e18a tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:24.418885 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d1e0adf-255a-4e9a-bf6c-c30388b2e18a tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:24.423918 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d1e0adf-255a-4e9a-bf6c-c30388b2e18a tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:24.430229 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d1e0adf-255a-4e9a-bf6c-c30388b2e18a tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:24.430735 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d1e0adf-255a-4e9a-bf6c-c30388b2e18a tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:24.431362 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d1e0adf-255a-4e9a-bf6c-c30388b2e18a tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:24.719191 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7d1e0adf-255a-4e9a-bf6c-c30388b2e18a tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c7799d37d747b08a9e20e15c3d6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a028aafec3294eae9a1c1a9a4e907dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:24.734474 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7d1e0adf-255a-4e9a-bf6c-c30388b2e18a tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] 10.222.0.42 "GET /compute/v2.1/servers/ce195309-8592-4c18-a45d-76038e4efaff" status: 200 len: 1293 microversion: 2.1 time: 0.367613 Oct 23 01:50:24.741720 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3351/6605] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:24 2022] GET /compute/v2.1/servers/ce195309-8592-4c18-a45d-76038e4efaff => generated 1293 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:25.037609 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-29ff2b69-e1f5-4db9-b156-cd2c2be77333 req-143cc99e-72ed-45ac-a2d1-93b4d3c1173e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "061034d6-4994-43d2-94df-fb12274eed87", "name": "network-vif-plugged", "status": "completed", "tag": "de88c6c4-18ff-437e-b080-2c0b8ec0e57d"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:50:25.080951 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-29ff2b69-e1f5-4db9-b156-cd2c2be77333 req-143cc99e-72ed-45ac-a2d1-93b4d3c1173e service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:25.085580 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-29ff2b69-e1f5-4db9-b156-cd2c2be77333 req-143cc99e-72ed-45ac-a2d1-93b4d3c1173e service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:25.086358 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-29ff2b69-e1f5-4db9-b156-cd2c2be77333 req-143cc99e-72ed-45ac-a2d1-93b4d3c1173e service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:25.114377 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-29ff2b69-e1f5-4db9-b156-cd2c2be77333 req-143cc99e-72ed-45ac-a2d1-93b4d3c1173e service nova] Creating event network-vif-plugged:de88c6c4-18ff-437e-b080-2c0b8ec0e57d for instance 061034d6-4994-43d2-94df-fb12274eed87 on n-h2-master-1 Oct 23 01:50:25.123069 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-29ff2b69-e1f5-4db9-b156-cd2c2be77333 req-143cc99e-72ed-45ac-a2d1-93b4d3c1173e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092671 Oct 23 01:50:25.128518 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3255/6606] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:50:25.160089 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5485ff4d-de20-48c5-a152-434d213e709e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:25.164177 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5485ff4d-de20-48c5-a152-434d213e709e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 061034d6-4994-43d2-94df-fb12274eed87] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:25.171653 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5485ff4d-de20-48c5-a152-434d213e709e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:25.172149 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5485ff4d-de20-48c5-a152-434d213e709e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:25.172582 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5485ff4d-de20-48c5-a152-434d213e709e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:25.178751 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5485ff4d-de20-48c5-a152-434d213e709e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:25.182593 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5485ff4d-de20-48c5-a152-434d213e709e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:25.183247 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5485ff4d-de20-48c5-a152-434d213e709e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:25.526154 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5485ff4d-de20-48c5-a152-434d213e709e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:25.531994 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5485ff4d-de20-48c5-a152-434d213e709e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87" status: 200 len: 1202 microversion: 2.1 time: 0.376521 Oct 23 01:50:25.533381 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3352/6607] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:25 2022] GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87 => generated 1202 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:25.767964 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-194a4d7e-3bfb-4f44-adfb-8c619f7fb0fd tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:25.768965 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-194a4d7e-3bfb-4f44-adfb-8c619f7fb0fd tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] [instance: ce195309-8592-4c18-a45d-76038e4efaff] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:25.780857 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-194a4d7e-3bfb-4f44-adfb-8c619f7fb0fd tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:25.781358 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-194a4d7e-3bfb-4f44-adfb-8c619f7fb0fd tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:25.781909 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-194a4d7e-3bfb-4f44-adfb-8c619f7fb0fd tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:25.785547 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-194a4d7e-3bfb-4f44-adfb-8c619f7fb0fd tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:25.786063 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-194a4d7e-3bfb-4f44-adfb-8c619f7fb0fd tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:25.788415 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-194a4d7e-3bfb-4f44-adfb-8c619f7fb0fd tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:25.959814 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-194a4d7e-3bfb-4f44-adfb-8c619f7fb0fd tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c7799d37d747b08a9e20e15c3d6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a028aafec3294eae9a1c1a9a4e907dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:25.970284 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-194a4d7e-3bfb-4f44-adfb-8c619f7fb0fd tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] 10.222.0.42 "GET /compute/v2.1/servers/ce195309-8592-4c18-a45d-76038e4efaff" status: 200 len: 1301 microversion: 2.1 time: 0.209024 Oct 23 01:50:25.990611 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3256/6608] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:25 2022] GET /compute/v2.1/servers/ce195309-8592-4c18-a45d-76038e4efaff => generated 1301 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:26.562482 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b8dac99c-7d58-49f3-a04b-88c87d0fde46 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:26.563748 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b8dac99c-7d58-49f3-a04b-88c87d0fde46 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 061034d6-4994-43d2-94df-fb12274eed87] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:26.599479 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b8dac99c-7d58-49f3-a04b-88c87d0fde46 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:26.603940 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b8dac99c-7d58-49f3-a04b-88c87d0fde46 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:26.609960 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b8dac99c-7d58-49f3-a04b-88c87d0fde46 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:26.618934 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b8dac99c-7d58-49f3-a04b-88c87d0fde46 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:26.619465 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b8dac99c-7d58-49f3-a04b-88c87d0fde46 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:26.619927 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b8dac99c-7d58-49f3-a04b-88c87d0fde46 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:26.923830 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b8dac99c-7d58-49f3-a04b-88c87d0fde46 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:26.937837 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b8dac99c-7d58-49f3-a04b-88c87d0fde46 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87" status: 200 len: 1202 microversion: 2.1 time: 0.383295 Oct 23 01:50:26.940168 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3353/6609] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:26 2022] GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87 => generated 1202 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:26.997204 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2e57d2c6-069c-40df-8d36-ea58772aa99b tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:26.998170 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2e57d2c6-069c-40df-8d36-ea58772aa99b tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] [instance: ce195309-8592-4c18-a45d-76038e4efaff] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:27.009479 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2e57d2c6-069c-40df-8d36-ea58772aa99b tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:27.015004 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2e57d2c6-069c-40df-8d36-ea58772aa99b tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:27.016049 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2e57d2c6-069c-40df-8d36-ea58772aa99b tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:27.029402 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2e57d2c6-069c-40df-8d36-ea58772aa99b tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:27.029402 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2e57d2c6-069c-40df-8d36-ea58772aa99b tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:27.029402 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2e57d2c6-069c-40df-8d36-ea58772aa99b tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:27.347572 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2e57d2c6-069c-40df-8d36-ea58772aa99b tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c7799d37d747b08a9e20e15c3d6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a028aafec3294eae9a1c1a9a4e907dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:27.364733 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2e57d2c6-069c-40df-8d36-ea58772aa99b tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] 10.222.0.42 "GET /compute/v2.1/servers/ce195309-8592-4c18-a45d-76038e4efaff" status: 200 len: 1299 microversion: 2.1 time: 0.370425 Oct 23 01:50:27.387093 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3257/6610] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:26 2022] GET /compute/v2.1/servers/ce195309-8592-4c18-a45d-76038e4efaff => generated 1299 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:27.969630 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ec1c7590-a66d-4705-87b0-76c43c2f4ee8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:27.971311 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ec1c7590-a66d-4705-87b0-76c43c2f4ee8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 061034d6-4994-43d2-94df-fb12274eed87] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:27.991103 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ec1c7590-a66d-4705-87b0-76c43c2f4ee8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:27.996284 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ec1c7590-a66d-4705-87b0-76c43c2f4ee8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:27.996855 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ec1c7590-a66d-4705-87b0-76c43c2f4ee8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:27.998793 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ec1c7590-a66d-4705-87b0-76c43c2f4ee8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:28.001268 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ec1c7590-a66d-4705-87b0-76c43c2f4ee8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:28.001829 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ec1c7590-a66d-4705-87b0-76c43c2f4ee8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:28.394201 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-84ddc05d-8546-46de-8d6e-801523762652 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:28.394820 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-84ddc05d-8546-46de-8d6e-801523762652 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] [instance: ce195309-8592-4c18-a45d-76038e4efaff] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:28.405427 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-84ddc05d-8546-46de-8d6e-801523762652 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:28.405914 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-84ddc05d-8546-46de-8d6e-801523762652 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:28.411848 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-84ddc05d-8546-46de-8d6e-801523762652 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:28.414845 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-84ddc05d-8546-46de-8d6e-801523762652 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:28.415386 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-84ddc05d-8546-46de-8d6e-801523762652 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:28.420082 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-84ddc05d-8546-46de-8d6e-801523762652 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:28.646144 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ec1c7590-a66d-4705-87b0-76c43c2f4ee8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:28.654245 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ec1c7590-a66d-4705-87b0-76c43c2f4ee8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87" status: 200 len: 1390 microversion: 2.1 time: 0.689426 Oct 23 01:50:28.655095 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3354/6611] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:27 2022] GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87 => generated 1390 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:28.687825 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a9625682-25ad-4af1-9782-928996cc3498 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:28.690631 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a9625682-25ad-4af1-9782-928996cc3498 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 331ab87b-109f-48e2-aff1-f0a9639d63b5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:28.700451 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-84ddc05d-8546-46de-8d6e-801523762652 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c7799d37d747b08a9e20e15c3d6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a028aafec3294eae9a1c1a9a4e907dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:28.711502 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a9625682-25ad-4af1-9782-928996cc3498 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:28.714631 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a9625682-25ad-4af1-9782-928996cc3498 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:28.715310 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a9625682-25ad-4af1-9782-928996cc3498 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:28.716223 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a9625682-25ad-4af1-9782-928996cc3498 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:28.716874 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a9625682-25ad-4af1-9782-928996cc3498 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:28.719999 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a9625682-25ad-4af1-9782-928996cc3498 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:28.726457 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-84ddc05d-8546-46de-8d6e-801523762652 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] 10.222.0.42 "GET /compute/v2.1/servers/ce195309-8592-4c18-a45d-76038e4efaff" status: 200 len: 1299 microversion: 2.1 time: 0.338404 Oct 23 01:50:28.728236 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3258/6612] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:28 2022] GET /compute/v2.1/servers/ce195309-8592-4c18-a45d-76038e4efaff => generated 1299 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:28.735335 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-8e079cc9-b4c1-4fa7-9a5f-aad4628e3c42 req-6186e25b-d3e7-4031-94d5-3a0b35190757 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "331ab87b-109f-48e2-aff1-f0a9639d63b5", "tag": "064dc680-6961-4f4c-a67e-febc7cdc1c7e"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:50:28.758340 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-8e079cc9-b4c1-4fa7-9a5f-aad4628e3c42 req-6186e25b-d3e7-4031-94d5-3a0b35190757 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:28.759105 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-8e079cc9-b4c1-4fa7-9a5f-aad4628e3c42 req-6186e25b-d3e7-4031-94d5-3a0b35190757 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:28.759692 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-8e079cc9-b4c1-4fa7-9a5f-aad4628e3c42 req-6186e25b-d3e7-4031-94d5-3a0b35190757 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:28.782268 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-8e079cc9-b4c1-4fa7-9a5f-aad4628e3c42 req-6186e25b-d3e7-4031-94d5-3a0b35190757 service nova] Creating event network-changed:064dc680-6961-4f4c-a67e-febc7cdc1c7e for instance 331ab87b-109f-48e2-aff1-f0a9639d63b5 on n-h1-master-1 Oct 23 01:50:28.789118 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-8e079cc9-b4c1-4fa7-9a5f-aad4628e3c42 req-6186e25b-d3e7-4031-94d5-3a0b35190757 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059452 Oct 23 01:50:28.793494 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3259/6613] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:50:28.816796 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a9625682-25ad-4af1-9782-928996cc3498 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 331ab87b-109f-48e2-aff1-f0a9639d63b5] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:50:28.821332 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d25b1240-bd94-486f-893b-02c5045b0d14 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:28.822133 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d25b1240-bd94-486f-893b-02c5045b0d14 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 061034d6-4994-43d2-94df-fb12274eed87] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:28.846381 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d25b1240-bd94-486f-893b-02c5045b0d14 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:28.847088 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d25b1240-bd94-486f-893b-02c5045b0d14 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:28.853933 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d25b1240-bd94-486f-893b-02c5045b0d14 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:28.853933 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d25b1240-bd94-486f-893b-02c5045b0d14 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:28.853933 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d25b1240-bd94-486f-893b-02c5045b0d14 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:28.853933 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d25b1240-bd94-486f-893b-02c5045b0d14 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:29.115184 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d25b1240-bd94-486f-893b-02c5045b0d14 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:29.147642 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d25b1240-bd94-486f-893b-02c5045b0d14 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87" status: 200 len: 1390 microversion: 2.1 time: 0.339710 Oct 23 01:50:29.148264 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3260/6614] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:28 2022] GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87 => generated 1390 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:29.183109 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1fe74464-7f2d-4d23-9b61-64922b46aec5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:29.183812 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1fe74464-7f2d-4d23-9b61-64922b46aec5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 061034d6-4994-43d2-94df-fb12274eed87] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:29.191451 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1fe74464-7f2d-4d23-9b61-64922b46aec5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:29.191640 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1fe74464-7f2d-4d23-9b61-64922b46aec5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:29.209726 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1fe74464-7f2d-4d23-9b61-64922b46aec5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:29.209726 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1fe74464-7f2d-4d23-9b61-64922b46aec5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:29.209726 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1fe74464-7f2d-4d23-9b61-64922b46aec5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:29.209726 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1fe74464-7f2d-4d23-9b61-64922b46aec5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:29.356999 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a9625682-25ad-4af1-9782-928996cc3498 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "DELETE /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5" status: 204 len: 0 microversion: 2.1 time: 0.685479 Oct 23 01:50:29.366236 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3355/6615] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:50:28 2022] DELETE /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:50:29.366236 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-644f60de-a0f3-4e94-b8ef-f3a4a1e608cc req-170ccac1-320d-43c4-9be5-28ee9b189ac8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce195309-8592-4c18-a45d-76038e4efaff", "tag": "b5d82c76-1312-42b8-ad79-433d1c5a0cd7"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:50:29.382659 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-644f60de-a0f3-4e94-b8ef-f3a4a1e608cc req-170ccac1-320d-43c4-9be5-28ee9b189ac8 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:29.388379 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-644f60de-a0f3-4e94-b8ef-f3a4a1e608cc req-170ccac1-320d-43c4-9be5-28ee9b189ac8 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:29.389189 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-644f60de-a0f3-4e94-b8ef-f3a4a1e608cc req-170ccac1-320d-43c4-9be5-28ee9b189ac8 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:29.413952 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-644f60de-a0f3-4e94-b8ef-f3a4a1e608cc req-170ccac1-320d-43c4-9be5-28ee9b189ac8 service nova] Creating event network-changed:b5d82c76-1312-42b8-ad79-433d1c5a0cd7 for instance ce195309-8592-4c18-a45d-76038e4efaff on n-h1-master-1 Oct 23 01:50:29.419647 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-644f60de-a0f3-4e94-b8ef-f3a4a1e608cc req-170ccac1-320d-43c4-9be5-28ee9b189ac8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059227 Oct 23 01:50:29.421810 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3356/6616] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:50:29.427419 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-78f0593b-03fe-4561-b75f-bb715b3c4771 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:29.431152 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-78f0593b-03fe-4561-b75f-bb715b3c4771 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 331ab87b-109f-48e2-aff1-f0a9639d63b5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:29.443717 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-78f0593b-03fe-4561-b75f-bb715b3c4771 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:29.444574 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-78f0593b-03fe-4561-b75f-bb715b3c4771 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:29.445250 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-78f0593b-03fe-4561-b75f-bb715b3c4771 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:29.446349 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-78f0593b-03fe-4561-b75f-bb715b3c4771 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:29.447059 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-78f0593b-03fe-4561-b75f-bb715b3c4771 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:29.447731 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-78f0593b-03fe-4561-b75f-bb715b3c4771 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:29.655178 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1fe74464-7f2d-4d23-9b61-64922b46aec5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:29.665688 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1fe74464-7f2d-4d23-9b61-64922b46aec5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87" status: 200 len: 1390 microversion: 2.1 time: 0.496365 Oct 23 01:50:29.677906 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3261/6617] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:29 2022] GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87 => generated 1390 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:29.700987 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-22fc296f-676d-4931-863e-e33694ef3669 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:29.701732 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-22fc296f-676d-4931-863e-e33694ef3669 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 061034d6-4994-43d2-94df-fb12274eed87] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:29.712506 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-22fc296f-676d-4931-863e-e33694ef3669 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:29.725065 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-22fc296f-676d-4931-863e-e33694ef3669 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:29.725065 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-22fc296f-676d-4931-863e-e33694ef3669 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:29.725065 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-22fc296f-676d-4931-863e-e33694ef3669 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:29.725065 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-22fc296f-676d-4931-863e-e33694ef3669 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:29.725065 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-22fc296f-676d-4931-863e-e33694ef3669 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:29.756466 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-22fc296f-676d-4931-863e-e33694ef3669 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 061034d6-4994-43d2-94df-fb12274eed87] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:50:29.766839 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-78f0593b-03fe-4561-b75f-bb715b3c4771 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:29.778193 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-78f0593b-03fe-4561-b75f-bb715b3c4771 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5" status: 200 len: 1689 microversion: 2.1 time: 0.350039 Oct 23 01:50:29.779435 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3357/6618] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:29 2022] GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5 => generated 1689 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:29.794974 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-39c36f21-8420-4162-9dea-f7f3ba7df395 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:29.795906 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-39c36f21-8420-4162-9dea-f7f3ba7df395 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] [instance: ce195309-8592-4c18-a45d-76038e4efaff] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:29.804145 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-39c36f21-8420-4162-9dea-f7f3ba7df395 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:29.814262 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-39c36f21-8420-4162-9dea-f7f3ba7df395 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:29.814262 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-39c36f21-8420-4162-9dea-f7f3ba7df395 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:29.814262 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-39c36f21-8420-4162-9dea-f7f3ba7df395 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:29.814262 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-39c36f21-8420-4162-9dea-f7f3ba7df395 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:29.814262 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-39c36f21-8420-4162-9dea-f7f3ba7df395 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:29.997991 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-39c36f21-8420-4162-9dea-f7f3ba7df395 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c7799d37d747b08a9e20e15c3d6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a028aafec3294eae9a1c1a9a4e907dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:30.022137 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-39c36f21-8420-4162-9dea-f7f3ba7df395 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] 10.222.0.42 "GET /compute/v2.1/servers/ce195309-8592-4c18-a45d-76038e4efaff" status: 200 len: 1299 microversion: 2.1 time: 0.232018 Oct 23 01:50:30.022137 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3358/6619] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:29 2022] GET /compute/v2.1/servers/ce195309-8592-4c18-a45d-76038e4efaff => generated 1299 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:30.251812 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-22fc296f-676d-4931-863e-e33694ef3669 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "DELETE /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87" status: 204 len: 0 microversion: 2.1 time: 0.554371 Oct 23 01:50:30.252881 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3262/6620] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:50:29 2022] DELETE /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 23 01:50:30.261988 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-36bb7758-94a3-4f13-b09b-97a242896b38 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:30.263068 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-36bb7758-94a3-4f13-b09b-97a242896b38 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 061034d6-4994-43d2-94df-fb12274eed87] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:30.270298 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36bb7758-94a3-4f13-b09b-97a242896b38 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:30.271191 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36bb7758-94a3-4f13-b09b-97a242896b38 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:30.271776 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36bb7758-94a3-4f13-b09b-97a242896b38 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:30.272863 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36bb7758-94a3-4f13-b09b-97a242896b38 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:30.273516 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36bb7758-94a3-4f13-b09b-97a242896b38 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:30.274171 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36bb7758-94a3-4f13-b09b-97a242896b38 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:30.522969 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-36bb7758-94a3-4f13-b09b-97a242896b38 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:30.534976 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-36bb7758-94a3-4f13-b09b-97a242896b38 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87" status: 200 len: 1396 microversion: 2.1 time: 0.277093 Oct 23 01:50:30.535589 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3359/6621] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:30 2022] GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87 => generated 1396 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:30.813423 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6294a97c-a1f1-403d-aef9-4f5009cb4784 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:30.814214 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6294a97c-a1f1-403d-aef9-4f5009cb4784 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 331ab87b-109f-48e2-aff1-f0a9639d63b5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:30.832678 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6294a97c-a1f1-403d-aef9-4f5009cb4784 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:30.833197 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6294a97c-a1f1-403d-aef9-4f5009cb4784 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:30.833679 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6294a97c-a1f1-403d-aef9-4f5009cb4784 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:30.835140 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6294a97c-a1f1-403d-aef9-4f5009cb4784 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:30.838225 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6294a97c-a1f1-403d-aef9-4f5009cb4784 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:30.838996 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6294a97c-a1f1-403d-aef9-4f5009cb4784 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:31.049546 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d377a6cc-a8b5-4be0-9153-8e8675342975 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:31.050278 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d377a6cc-a8b5-4be0-9153-8e8675342975 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] [instance: ce195309-8592-4c18-a45d-76038e4efaff] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:31.058863 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d377a6cc-a8b5-4be0-9153-8e8675342975 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:31.059370 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d377a6cc-a8b5-4be0-9153-8e8675342975 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:31.060235 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d377a6cc-a8b5-4be0-9153-8e8675342975 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:31.061292 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d377a6cc-a8b5-4be0-9153-8e8675342975 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:31.062378 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d377a6cc-a8b5-4be0-9153-8e8675342975 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:31.063033 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d377a6cc-a8b5-4be0-9153-8e8675342975 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:31.225319 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d377a6cc-a8b5-4be0-9153-8e8675342975 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c7799d37d747b08a9e20e15c3d6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a028aafec3294eae9a1c1a9a4e907dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:31.227990 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:50:31.241589 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d377a6cc-a8b5-4be0-9153-8e8675342975 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] 10.222.0.42 "GET /compute/v2.1/servers/ce195309-8592-4c18-a45d-76038e4efaff" status: 200 len: 1299 microversion: 2.1 time: 0.196479 Oct 23 01:50:31.251290 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3360/6622] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:31 2022] GET /compute/v2.1/servers/ce195309-8592-4c18-a45d-76038e4efaff => generated 1299 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:50:31.256448 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6294a97c-a1f1-403d-aef9-4f5009cb4784 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:31.272673 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6294a97c-a1f1-403d-aef9-4f5009cb4784 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5" status: 200 len: 1689 microversion: 2.1 time: 0.466495 Oct 23 01:50:31.282347 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3263/6623] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:30 2022] GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5 => generated 1689 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:31.559389 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-89b79065-c6fe-4ca0-ae15-ed8091a87a09 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:31.560654 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-89b79065-c6fe-4ca0-ae15-ed8091a87a09 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 061034d6-4994-43d2-94df-fb12274eed87] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:31.566938 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-89b79065-c6fe-4ca0-ae15-ed8091a87a09 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:31.567678 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-89b79065-c6fe-4ca0-ae15-ed8091a87a09 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:31.568597 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-89b79065-c6fe-4ca0-ae15-ed8091a87a09 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:31.569196 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-89b79065-c6fe-4ca0-ae15-ed8091a87a09 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:31.569832 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-89b79065-c6fe-4ca0-ae15-ed8091a87a09 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:31.570449 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-89b79065-c6fe-4ca0-ae15-ed8091a87a09 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:31.923951 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-8d4f57ea-e804-4bc5-8be9-930805bcb392 req-06cc3cbe-f871-45b6-995f-c81df73efd48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "331ab87b-109f-48e2-aff1-f0a9639d63b5", "name": "network-vif-deleted", "tag": "064dc680-6961-4f4c-a67e-febc7cdc1c7e"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:50:31.940600 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:50:31.941258 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=6 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:50:31.950460 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-89b79065-c6fe-4ca0-ae15-ed8091a87a09 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:31.953005 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-8d4f57ea-e804-4bc5-8be9-930805bcb392 req-06cc3cbe-f871-45b6-995f-c81df73efd48 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:31.953005 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-8d4f57ea-e804-4bc5-8be9-930805bcb392 req-06cc3cbe-f871-45b6-995f-c81df73efd48 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:31.953005 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-8d4f57ea-e804-4bc5-8be9-930805bcb392 req-06cc3cbe-f871-45b6-995f-c81df73efd48 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:31.961035 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-89b79065-c6fe-4ca0-ae15-ed8091a87a09 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87" status: 200 len: 1396 microversion: 2.1 time: 0.405815 Oct 23 01:50:31.961612 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3361/6624] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:31 2022] GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87 => generated 1396 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:31.970286 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-8d4f57ea-e804-4bc5-8be9-930805bcb392 req-06cc3cbe-f871-45b6-995f-c81df73efd48 service nova] Creating event network-vif-deleted:064dc680-6961-4f4c-a67e-febc7cdc1c7e for instance 331ab87b-109f-48e2-aff1-f0a9639d63b5 on n-h1-master-1 Oct 23 01:50:31.980001 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-8d4f57ea-e804-4bc5-8be9-930805bcb392 req-06cc3cbe-f871-45b6-995f-c81df73efd48 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062496 Oct 23 01:50:31.987794 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3264/6625] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:50:32.277123 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ef9c341a-4054-438c-85fd-0f5a8a2ff4b1 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:32.277822 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ef9c341a-4054-438c-85fd-0f5a8a2ff4b1 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] [instance: ce195309-8592-4c18-a45d-76038e4efaff] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:32.297112 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ef9c341a-4054-438c-85fd-0f5a8a2ff4b1 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:32.297900 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ef9c341a-4054-438c-85fd-0f5a8a2ff4b1 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:32.298531 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ef9c341a-4054-438c-85fd-0f5a8a2ff4b1 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:32.299393 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ef9c341a-4054-438c-85fd-0f5a8a2ff4b1 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:32.300034 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ef9c341a-4054-438c-85fd-0f5a8a2ff4b1 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:32.300644 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ef9c341a-4054-438c-85fd-0f5a8a2ff4b1 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:32.312322 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f9d6f1c5-89d4-4b0a-a477-dfbe23f00f79 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:32.315389 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f9d6f1c5-89d4-4b0a-a477-dfbe23f00f79 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 331ab87b-109f-48e2-aff1-f0a9639d63b5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:32.368472 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f9d6f1c5-89d4-4b0a-a477-dfbe23f00f79 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:32.369280 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f9d6f1c5-89d4-4b0a-a477-dfbe23f00f79 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:32.369906 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f9d6f1c5-89d4-4b0a-a477-dfbe23f00f79 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:32.370904 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f9d6f1c5-89d4-4b0a-a477-dfbe23f00f79 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:32.395899 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f9d6f1c5-89d4-4b0a-a477-dfbe23f00f79 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:32.396752 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f9d6f1c5-89d4-4b0a-a477-dfbe23f00f79 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:32.522747 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f9d6f1c5-89d4-4b0a-a477-dfbe23f00f79 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:32.540936 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ef9c341a-4054-438c-85fd-0f5a8a2ff4b1 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c7799d37d747b08a9e20e15c3d6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a028aafec3294eae9a1c1a9a4e907dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:32.549523 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f9d6f1c5-89d4-4b0a-a477-dfbe23f00f79 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5" status: 200 len: 1351 microversion: 2.1 time: 0.251383 Oct 23 01:50:32.550626 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3265/6626] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:32 2022] GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5 => generated 1351 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:32.560900 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ef9c341a-4054-438c-85fd-0f5a8a2ff4b1 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] 10.222.0.42 "GET /compute/v2.1/servers/ce195309-8592-4c18-a45d-76038e4efaff" status: 200 len: 1299 microversion: 2.1 time: 0.287631 Oct 23 01:50:32.567427 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3362/6627] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:32 2022] GET /compute/v2.1/servers/ce195309-8592-4c18-a45d-76038e4efaff => generated 1299 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:32.989819 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1e440848-6513-4f80-be0e-ec63c7e6fb89 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:32.990468 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1e440848-6513-4f80-be0e-ec63c7e6fb89 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 061034d6-4994-43d2-94df-fb12274eed87] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:32.998307 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1e440848-6513-4f80-be0e-ec63c7e6fb89 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:32.998795 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1e440848-6513-4f80-be0e-ec63c7e6fb89 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:32.999458 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1e440848-6513-4f80-be0e-ec63c7e6fb89 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:33.004332 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1e440848-6513-4f80-be0e-ec63c7e6fb89 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:33.004871 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1e440848-6513-4f80-be0e-ec63c7e6fb89 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:33.005316 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1e440848-6513-4f80-be0e-ec63c7e6fb89 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:33.151169 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1e440848-6513-4f80-be0e-ec63c7e6fb89 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:33.178525 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1e440848-6513-4f80-be0e-ec63c7e6fb89 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87" status: 200 len: 1354 microversion: 2.1 time: 0.192021 Oct 23 01:50:33.191373 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3266/6628] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:32 2022] GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87 => generated 1354 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:33.574787 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-afc06861-3579-471f-8ca5-b5ac0b0f8ecc tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:33.576045 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-afc06861-3579-471f-8ca5-b5ac0b0f8ecc tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 331ab87b-109f-48e2-aff1-f0a9639d63b5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:33.579995 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=4 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:50:33.585198 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-afc06861-3579-471f-8ca5-b5ac0b0f8ecc tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:33.588813 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-afc06861-3579-471f-8ca5-b5ac0b0f8ecc tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:33.588813 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-afc06861-3579-471f-8ca5-b5ac0b0f8ecc tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:33.588813 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-afc06861-3579-471f-8ca5-b5ac0b0f8ecc tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:33.588813 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-afc06861-3579-471f-8ca5-b5ac0b0f8ecc tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:33.588813 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-afc06861-3579-471f-8ca5-b5ac0b0f8ecc tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:33.598817 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ac8b6e4b-c4ed-43ad-9256-b0206ba793ad tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:33.599697 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ac8b6e4b-c4ed-43ad-9256-b0206ba793ad tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] [instance: ce195309-8592-4c18-a45d-76038e4efaff] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:33.613300 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ac8b6e4b-c4ed-43ad-9256-b0206ba793ad tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:33.617598 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ac8b6e4b-c4ed-43ad-9256-b0206ba793ad tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:33.617598 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ac8b6e4b-c4ed-43ad-9256-b0206ba793ad tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:33.617598 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ac8b6e4b-c4ed-43ad-9256-b0206ba793ad tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:33.617598 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ac8b6e4b-c4ed-43ad-9256-b0206ba793ad tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:33.617598 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ac8b6e4b-c4ed-43ad-9256-b0206ba793ad tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:33.682798 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-afc06861-3579-471f-8ca5-b5ac0b0f8ecc tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:33.683226 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-afc06861-3579-471f-8ca5-b5ac0b0f8ecc tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:33.683675 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-afc06861-3579-471f-8ca5-b5ac0b0f8ecc tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:33.684140 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-afc06861-3579-471f-8ca5-b5ac0b0f8ecc tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lazy-loading 'fault' on Instance uuid 331ab87b-109f-48e2-aff1-f0a9639d63b5 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:50:33.793082 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-afc06861-3579-471f-8ca5-b5ac0b0f8ecc tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037ed342980a4de9a2dfc8d576293aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7f734a12da437e806e4c791d27d615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:33.820975 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-afc06861-3579-471f-8ca5-b5ac0b0f8ecc tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5" status: 200 len: 1356 microversion: 2.1 time: 0.233128 Oct 23 01:50:33.821857 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3363/6629] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:33 2022] GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5 => generated 1356 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:50:33.922026 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ac8b6e4b-c4ed-43ad-9256-b0206ba793ad tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c7799d37d747b08a9e20e15c3d6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a028aafec3294eae9a1c1a9a4e907dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:33.931584 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ac8b6e4b-c4ed-43ad-9256-b0206ba793ad tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] 10.222.0.42 "GET /compute/v2.1/servers/ce195309-8592-4c18-a45d-76038e4efaff" status: 200 len: 1299 microversion: 2.1 time: 0.336459 Oct 23 01:50:33.932772 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3267/6630] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:33 2022] GET /compute/v2.1/servers/ce195309-8592-4c18-a45d-76038e4efaff => generated 1299 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:50:34.007845 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-dd836415-b59c-43fe-8e9e-cacf41c30a37 req-659a14cf-a759-4f97-87ca-92f00a3b6d0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "061034d6-4994-43d2-94df-fb12274eed87", "name": "network-vif-deleted", "tag": "de88c6c4-18ff-437e-b080-2c0b8ec0e57d"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:50:34.046805 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-dd836415-b59c-43fe-8e9e-cacf41c30a37 req-659a14cf-a759-4f97-87ca-92f00a3b6d0e service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:34.046805 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-dd836415-b59c-43fe-8e9e-cacf41c30a37 req-659a14cf-a759-4f97-87ca-92f00a3b6d0e service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:34.046805 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-dd836415-b59c-43fe-8e9e-cacf41c30a37 req-659a14cf-a759-4f97-87ca-92f00a3b6d0e service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:34.069710 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-dd836415-b59c-43fe-8e9e-cacf41c30a37 req-659a14cf-a759-4f97-87ca-92f00a3b6d0e service nova] Creating event network-vif-deleted:de88c6c4-18ff-437e-b080-2c0b8ec0e57d for instance 061034d6-4994-43d2-94df-fb12274eed87 on n-h2-master-1 Oct 23 01:50:34.080261 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-dd836415-b59c-43fe-8e9e-cacf41c30a37 req-659a14cf-a759-4f97-87ca-92f00a3b6d0e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085423 Oct 23 01:50:34.081624 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3364/6631] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:50:34.212860 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5b86769d-4323-433c-b373-f8d9e165dac5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:34.214171 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5b86769d-4323-433c-b373-f8d9e165dac5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 061034d6-4994-43d2-94df-fb12274eed87] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:34.238513 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5b86769d-4323-433c-b373-f8d9e165dac5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:34.239012 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5b86769d-4323-433c-b373-f8d9e165dac5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:34.239720 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5b86769d-4323-433c-b373-f8d9e165dac5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:34.240718 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5b86769d-4323-433c-b373-f8d9e165dac5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:34.241426 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5b86769d-4323-433c-b373-f8d9e165dac5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:34.242132 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5b86769d-4323-433c-b373-f8d9e165dac5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:34.379517 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5b86769d-4323-433c-b373-f8d9e165dac5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:34.395331 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5b86769d-4323-433c-b373-f8d9e165dac5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87" status: 200 len: 1187 microversion: 2.1 time: 0.189753 Oct 23 01:50:34.398309 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3268/6632] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:34 2022] GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87 => generated 1187 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:34.859431 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-294495e1-01ac-4487-a8cc-2537a9bdd4d3 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:34.860771 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-294495e1-01ac-4487-a8cc-2537a9bdd4d3 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] [instance: 331ab87b-109f-48e2-aff1-f0a9639d63b5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:34.867893 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-294495e1-01ac-4487-a8cc-2537a9bdd4d3 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:34.868410 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-294495e1-01ac-4487-a8cc-2537a9bdd4d3 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:34.869037 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-294495e1-01ac-4487-a8cc-2537a9bdd4d3 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:34.870001 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-294495e1-01ac-4487-a8cc-2537a9bdd4d3 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:34.870634 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-294495e1-01ac-4487-a8cc-2537a9bdd4d3 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:34.871321 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-294495e1-01ac-4487-a8cc-2537a9bdd4d3 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:34.888302 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-294495e1-01ac-4487-a8cc-2537a9bdd4d3 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] HTTP exception thrown: Instance 331ab87b-109f-48e2-aff1-f0a9639d63b5 could not be found. Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-294495e1-01ac-4487-a8cc-2537a9bdd4d3 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Request method failure captured: Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5 HTTP/1.1 Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJup1TkLYyR4X_VSgIMIuQv0hYOz5hZ00J3cGF_2O4wHY26fogeH_hyoq33KQnC7sGTAyVlSot7AI095PrC5yb0EkSKzvICR_X35mdfKcclD_xEhLj-4l-9yI3Uz12kHgYqfGCiZb_uaRrbVi38t5LJjIbY00U1LXQx5VmGP9DMKFZ0 Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 0c7f734a12da437e806e4c791d27d615 Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-878522496 Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/0c7f734a12da437e806e4c791d27d615"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_0c7f734a12da437e806e4c791d27d615"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0c7f734a12da437e806e4c791d27d615"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0c7f734a12da437e806e4c791d27d615"}]}] Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-TestNetworkAdvancedServerOps-878522496 Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 0c7f734a12da437e806e4c791d27d615 Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-878522496 Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-TestNetworkAdvancedServerOps-878522496-project Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 037ed342980a4de9a2dfc8d576293aba Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-TestNetworkAdvancedServerOps-878522496-project Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 331ab87b-109f-48e2-aff1-f0a9639d63b5 could not be found. Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '331ab87b-109f-48e2-aff1-f0a9639d63b5'} Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 331ab87b-109f-48e2-aff1-f0a9639d63b5 could not be found. Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 331ab87b-109f-48e2-aff1-f0a9639d63b5 could not be found. Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:50:34.890746 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:50:34.903148 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:50:34.903148 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:50:34.903148 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:50:34.903148 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:50:34.903148 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:50:34.903148 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:50:34.903148 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 331ab87b-109f-48e2-aff1-f0a9639d63b5 could not be found. Oct 23 01:50:34.903148 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:50:34.908888 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-294495e1-01ac-4487-a8cc-2537a9bdd4d3 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Returning 404 to user: Instance 331ab87b-109f-48e2-aff1-f0a9639d63b5 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:50:34.910044 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-294495e1-01ac-4487-a8cc-2537a9bdd4d3 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5" status: 404 len: 111 microversion: 2.1 time: 0.056706 Oct 23 01:50:34.910658 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3365/6633] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:34 2022] GET /compute/v2.1/servers/331ab87b-109f-48e2-aff1-f0a9639d63b5 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:50:34.963572 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c90bafeb-2f8d-43e5-b2b9-15f769e8c0f8 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:34.964425 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c90bafeb-2f8d-43e5-b2b9-15f769e8c0f8 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] [instance: ce195309-8592-4c18-a45d-76038e4efaff] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:34.980196 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c90bafeb-2f8d-43e5-b2b9-15f769e8c0f8 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:34.980582 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c90bafeb-2f8d-43e5-b2b9-15f769e8c0f8 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:34.981193 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c90bafeb-2f8d-43e5-b2b9-15f769e8c0f8 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:34.982089 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c90bafeb-2f8d-43e5-b2b9-15f769e8c0f8 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:34.991719 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c90bafeb-2f8d-43e5-b2b9-15f769e8c0f8 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:34.991719 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c90bafeb-2f8d-43e5-b2b9-15f769e8c0f8 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:35.020899 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:50:35.269091 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c90bafeb-2f8d-43e5-b2b9-15f769e8c0f8 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c7799d37d747b08a9e20e15c3d6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a028aafec3294eae9a1c1a9a4e907dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:35.295202 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c90bafeb-2f8d-43e5-b2b9-15f769e8c0f8 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] 10.222.0.42 "GET /compute/v2.1/servers/ce195309-8592-4c18-a45d-76038e4efaff" status: 200 len: 1299 microversion: 2.1 time: 0.335316 Oct 23 01:50:35.295816 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3269/6634] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:34 2022] GET /compute/v2.1/servers/ce195309-8592-4c18-a45d-76038e4efaff => generated 1299 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:35.419181 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cf5a3a1f-9bf6-4015-b3c5-b61d83531f54 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:35.419810 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-cf5a3a1f-9bf6-4015-b3c5-b61d83531f54 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 061034d6-4994-43d2-94df-fb12274eed87] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:35.438448 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf5a3a1f-9bf6-4015-b3c5-b61d83531f54 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:35.439200 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf5a3a1f-9bf6-4015-b3c5-b61d83531f54 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:35.441141 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf5a3a1f-9bf6-4015-b3c5-b61d83531f54 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:35.447783 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf5a3a1f-9bf6-4015-b3c5-b61d83531f54 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:35.448852 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf5a3a1f-9bf6-4015-b3c5-b61d83531f54 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:35.449532 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf5a3a1f-9bf6-4015-b3c5-b61d83531f54 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:35.672285 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cf5a3a1f-9bf6-4015-b3c5-b61d83531f54 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:35.682081 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cf5a3a1f-9bf6-4015-b3c5-b61d83531f54 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87" status: 200 len: 1187 microversion: 2.1 time: 0.266524 Oct 23 01:50:35.699666 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3366/6635] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:35 2022] GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87 => generated 1187 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:50:36.323756 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-599327a2-cbae-434c-8254-d1b77d3b51ad tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:36.324362 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-599327a2-cbae-434c-8254-d1b77d3b51ad tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] [instance: ce195309-8592-4c18-a45d-76038e4efaff] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:36.346546 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-599327a2-cbae-434c-8254-d1b77d3b51ad tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:36.353698 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-599327a2-cbae-434c-8254-d1b77d3b51ad tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:36.354183 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-599327a2-cbae-434c-8254-d1b77d3b51ad tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:36.355120 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-599327a2-cbae-434c-8254-d1b77d3b51ad tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:36.355742 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-599327a2-cbae-434c-8254-d1b77d3b51ad tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:36.356323 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-599327a2-cbae-434c-8254-d1b77d3b51ad tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:36.605711 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-599327a2-cbae-434c-8254-d1b77d3b51ad tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c7799d37d747b08a9e20e15c3d6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a028aafec3294eae9a1c1a9a4e907dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:36.622136 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-599327a2-cbae-434c-8254-d1b77d3b51ad tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] 10.222.0.42 "GET /compute/v2.1/servers/ce195309-8592-4c18-a45d-76038e4efaff" status: 200 len: 1299 microversion: 2.1 time: 0.305695 Oct 23 01:50:36.623339 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3270/6636] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:36 2022] GET /compute/v2.1/servers/ce195309-8592-4c18-a45d-76038e4efaff => generated 1299 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:36.713198 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-17dae84e-465d-4541-9cb8-19511a029c88 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:36.714559 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-17dae84e-465d-4541-9cb8-19511a029c88 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 061034d6-4994-43d2-94df-fb12274eed87] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:36.724828 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-17dae84e-465d-4541-9cb8-19511a029c88 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:36.726084 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-17dae84e-465d-4541-9cb8-19511a029c88 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:36.727430 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-17dae84e-465d-4541-9cb8-19511a029c88 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:36.728822 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-17dae84e-465d-4541-9cb8-19511a029c88 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:36.729564 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-17dae84e-465d-4541-9cb8-19511a029c88 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:36.730344 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-17dae84e-465d-4541-9cb8-19511a029c88 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:36.860940 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-26a319e7-e37f-4999-8083-b28b14a77706 req-8d3257cb-6f01-4a2d-96a5-368fd87fc029 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce195309-8592-4c18-a45d-76038e4efaff", "name": "network-vif-plugged", "status": "completed", "tag": "b5d82c76-1312-42b8-ad79-433d1c5a0cd7"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:50:36.879490 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-26a319e7-e37f-4999-8083-b28b14a77706 req-8d3257cb-6f01-4a2d-96a5-368fd87fc029 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:36.882415 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-26a319e7-e37f-4999-8083-b28b14a77706 req-8d3257cb-6f01-4a2d-96a5-368fd87fc029 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:36.882901 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-26a319e7-e37f-4999-8083-b28b14a77706 req-8d3257cb-6f01-4a2d-96a5-368fd87fc029 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:36.910753 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-26a319e7-e37f-4999-8083-b28b14a77706 req-8d3257cb-6f01-4a2d-96a5-368fd87fc029 service nova] Creating event network-vif-plugged:b5d82c76-1312-42b8-ad79-433d1c5a0cd7 for instance ce195309-8592-4c18-a45d-76038e4efaff on n-h1-master-1 Oct 23 01:50:36.921824 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-26a319e7-e37f-4999-8083-b28b14a77706 req-8d3257cb-6f01-4a2d-96a5-368fd87fc029 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064247 Oct 23 01:50:36.927243 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3271/6637] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:50:36.933077 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-17dae84e-465d-4541-9cb8-19511a029c88 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:36.942448 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-17dae84e-465d-4541-9cb8-19511a029c88 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87" status: 200 len: 1187 microversion: 2.1 time: 0.233678 Oct 23 01:50:36.944099 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3367/6638] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:36 2022] GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87 => generated 1187 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:37.653158 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-10ea6a83-5ef9-4112-9c13-2be9dbb761b5 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:37.653849 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-10ea6a83-5ef9-4112-9c13-2be9dbb761b5 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] [instance: ce195309-8592-4c18-a45d-76038e4efaff] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:37.673551 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10ea6a83-5ef9-4112-9c13-2be9dbb761b5 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:37.674069 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10ea6a83-5ef9-4112-9c13-2be9dbb761b5 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:37.674505 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10ea6a83-5ef9-4112-9c13-2be9dbb761b5 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:37.697785 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10ea6a83-5ef9-4112-9c13-2be9dbb761b5 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:37.697785 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10ea6a83-5ef9-4112-9c13-2be9dbb761b5 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:37.697785 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10ea6a83-5ef9-4112-9c13-2be9dbb761b5 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:37.877653 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-10ea6a83-5ef9-4112-9c13-2be9dbb761b5 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c7799d37d747b08a9e20e15c3d6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a028aafec3294eae9a1c1a9a4e907dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:37.891821 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-10ea6a83-5ef9-4112-9c13-2be9dbb761b5 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] 10.222.0.42 "GET /compute/v2.1/servers/ce195309-8592-4c18-a45d-76038e4efaff" status: 200 len: 1299 microversion: 2.1 time: 0.242031 Oct 23 01:50:37.895145 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3272/6639] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:37 2022] GET /compute/v2.1/servers/ce195309-8592-4c18-a45d-76038e4efaff => generated 1299 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:37.983698 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-631d4cca-db7d-4a1b-bc77-a2f0f53926e2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:37.983698 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-631d4cca-db7d-4a1b-bc77-a2f0f53926e2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 061034d6-4994-43d2-94df-fb12274eed87] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:37.983698 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-631d4cca-db7d-4a1b-bc77-a2f0f53926e2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:37.983698 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-631d4cca-db7d-4a1b-bc77-a2f0f53926e2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:37.984450 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-631d4cca-db7d-4a1b-bc77-a2f0f53926e2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:37.984450 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-631d4cca-db7d-4a1b-bc77-a2f0f53926e2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:37.984918 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-631d4cca-db7d-4a1b-bc77-a2f0f53926e2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:37.985358 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-631d4cca-db7d-4a1b-bc77-a2f0f53926e2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:38.255067 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-631d4cca-db7d-4a1b-bc77-a2f0f53926e2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:38.266320 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-631d4cca-db7d-4a1b-bc77-a2f0f53926e2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87" status: 200 len: 1187 microversion: 2.1 time: 0.298519 Oct 23 01:50:38.268240 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3368/6640] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:37 2022] GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87 => generated 1187 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:38.925318 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-36eab657-6267-4c12-93e8-56f0b3d05aba tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:38.926644 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-36eab657-6267-4c12-93e8-56f0b3d05aba tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] [instance: ce195309-8592-4c18-a45d-76038e4efaff] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:38.944819 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36eab657-6267-4c12-93e8-56f0b3d05aba tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:38.945684 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36eab657-6267-4c12-93e8-56f0b3d05aba tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:38.946391 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36eab657-6267-4c12-93e8-56f0b3d05aba tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:38.947336 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36eab657-6267-4c12-93e8-56f0b3d05aba tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:38.948007 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36eab657-6267-4c12-93e8-56f0b3d05aba tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:38.948644 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36eab657-6267-4c12-93e8-56f0b3d05aba tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:39.099213 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-36eab657-6267-4c12-93e8-56f0b3d05aba tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c7799d37d747b08a9e20e15c3d6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a028aafec3294eae9a1c1a9a4e907dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:39.110995 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-36eab657-6267-4c12-93e8-56f0b3d05aba tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] 10.222.0.42 "GET /compute/v2.1/servers/ce195309-8592-4c18-a45d-76038e4efaff" status: 200 len: 1470 microversion: 2.1 time: 0.190047 Oct 23 01:50:39.112286 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3273/6641] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:38 2022] GET /compute/v2.1/servers/ce195309-8592-4c18-a45d-76038e4efaff => generated 1470 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:39.135471 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-66e7721e-387f-4a47-a834-9f85dc52276b tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:39.136802 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-66e7721e-387f-4a47-a834-9f85dc52276b tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] [instance: ce195309-8592-4c18-a45d-76038e4efaff] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:39.144265 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-66e7721e-387f-4a47-a834-9f85dc52276b tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:39.145150 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-66e7721e-387f-4a47-a834-9f85dc52276b tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:39.145834 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-66e7721e-387f-4a47-a834-9f85dc52276b tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:39.146638 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-66e7721e-387f-4a47-a834-9f85dc52276b tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:39.147245 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-66e7721e-387f-4a47-a834-9f85dc52276b tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:39.147855 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-66e7721e-387f-4a47-a834-9f85dc52276b tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:39.300614 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7013a389-502a-42b3-b2f7-6428e3a0202a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:39.308050 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7013a389-502a-42b3-b2f7-6428e3a0202a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 061034d6-4994-43d2-94df-fb12274eed87] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:39.325123 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7013a389-502a-42b3-b2f7-6428e3a0202a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:39.328248 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7013a389-502a-42b3-b2f7-6428e3a0202a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:39.328248 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7013a389-502a-42b3-b2f7-6428e3a0202a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:39.328248 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7013a389-502a-42b3-b2f7-6428e3a0202a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:39.330014 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7013a389-502a-42b3-b2f7-6428e3a0202a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:39.335898 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7013a389-502a-42b3-b2f7-6428e3a0202a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:39.377344 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-66e7721e-387f-4a47-a834-9f85dc52276b tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c7799d37d747b08a9e20e15c3d6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a028aafec3294eae9a1c1a9a4e907dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:39.393466 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-66e7721e-387f-4a47-a834-9f85dc52276b tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] 10.222.0.42 "GET /compute/v2.1/servers/ce195309-8592-4c18-a45d-76038e4efaff" status: 200 len: 1470 microversion: 2.1 time: 0.260375 Oct 23 01:50:39.397585 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3369/6642] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:39 2022] GET /compute/v2.1/servers/ce195309-8592-4c18-a45d-76038e4efaff => generated 1470 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:39.437904 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f279ce98-6c3a-4262-b5b3-ccd847e43fae tempest-TestSecurityGroupsBasicOps-930947180 tempest-TestSecurityGroupsBasicOps-930947180-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:39.438847 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f279ce98-6c3a-4262-b5b3-ccd847e43fae tempest-TestSecurityGroupsBasicOps-930947180 tempest-TestSecurityGroupsBasicOps-930947180-project-admin] [instance: ce195309-8592-4c18-a45d-76038e4efaff] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:39.461331 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f279ce98-6c3a-4262-b5b3-ccd847e43fae tempest-TestSecurityGroupsBasicOps-930947180 tempest-TestSecurityGroupsBasicOps-930947180-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:39.461879 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f279ce98-6c3a-4262-b5b3-ccd847e43fae tempest-TestSecurityGroupsBasicOps-930947180 tempest-TestSecurityGroupsBasicOps-930947180-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:39.467549 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f279ce98-6c3a-4262-b5b3-ccd847e43fae tempest-TestSecurityGroupsBasicOps-930947180 tempest-TestSecurityGroupsBasicOps-930947180-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:39.469020 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f279ce98-6c3a-4262-b5b3-ccd847e43fae tempest-TestSecurityGroupsBasicOps-930947180 tempest-TestSecurityGroupsBasicOps-930947180-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:39.474007 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f279ce98-6c3a-4262-b5b3-ccd847e43fae tempest-TestSecurityGroupsBasicOps-930947180 tempest-TestSecurityGroupsBasicOps-930947180-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:39.481907 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f279ce98-6c3a-4262-b5b3-ccd847e43fae tempest-TestSecurityGroupsBasicOps-930947180 tempest-TestSecurityGroupsBasicOps-930947180-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:39.501548 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7013a389-502a-42b3-b2f7-6428e3a0202a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:39.513577 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7013a389-502a-42b3-b2f7-6428e3a0202a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87" status: 200 len: 1187 microversion: 2.1 time: 0.223494 Oct 23 01:50:39.524560 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3274/6643] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:39 2022] GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87 => generated 1187 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:50:39.649246 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f279ce98-6c3a-4262-b5b3-ccd847e43fae tempest-TestSecurityGroupsBasicOps-930947180 tempest-TestSecurityGroupsBasicOps-930947180-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/ce195309-8592-4c18-a45d-76038e4efaff" status: 200 len: 1621 microversion: 2.1 time: 0.216877 Oct 23 01:50:39.664619 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3370/6644] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:39 2022] GET /compute/v2.1/servers/ce195309-8592-4c18-a45d-76038e4efaff => generated 1621 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:50:39.690010 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c3e28892-12e9-437a-a158-348d0b92c48d tempest-TestSecurityGroupsBasicOps-930947180 tempest-TestSecurityGroupsBasicOps-930947180-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:39.690932 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c3e28892-12e9-437a-a158-348d0b92c48d tempest-TestSecurityGroupsBasicOps-930947180 tempest-TestSecurityGroupsBasicOps-930947180-project-admin] [instance: 64804b2c-74aa-4e67-8eba-75a5c4f7db76] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:39.699296 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c3e28892-12e9-437a-a158-348d0b92c48d tempest-TestSecurityGroupsBasicOps-930947180 tempest-TestSecurityGroupsBasicOps-930947180-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:39.707011 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c3e28892-12e9-437a-a158-348d0b92c48d tempest-TestSecurityGroupsBasicOps-930947180 tempest-TestSecurityGroupsBasicOps-930947180-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:39.707793 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c3e28892-12e9-437a-a158-348d0b92c48d tempest-TestSecurityGroupsBasicOps-930947180 tempest-TestSecurityGroupsBasicOps-930947180-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:39.708722 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c3e28892-12e9-437a-a158-348d0b92c48d tempest-TestSecurityGroupsBasicOps-930947180 tempest-TestSecurityGroupsBasicOps-930947180-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:39.709332 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c3e28892-12e9-437a-a158-348d0b92c48d tempest-TestSecurityGroupsBasicOps-930947180 tempest-TestSecurityGroupsBasicOps-930947180-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:39.710229 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c3e28892-12e9-437a-a158-348d0b92c48d tempest-TestSecurityGroupsBasicOps-930947180 tempest-TestSecurityGroupsBasicOps-930947180-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:40.143533 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c3e28892-12e9-437a-a158-348d0b92c48d tempest-TestSecurityGroupsBasicOps-930947180 tempest-TestSecurityGroupsBasicOps-930947180-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/64804b2c-74aa-4e67-8eba-75a5c4f7db76" status: 200 len: 1910 microversion: 2.1 time: 0.458805 Oct 23 01:50:40.146277 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3275/6645] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:39 2022] GET /compute/v2.1/servers/64804b2c-74aa-4e67-8eba-75a5c4f7db76 => generated 1910 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:40.281625 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9bbf06e8-42f0-44d7-abf2-744a8049397a tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:40.284144 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9bbf06e8-42f0-44d7-abf2-744a8049397a tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] [instance: ce195309-8592-4c18-a45d-76038e4efaff] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:40.307077 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9bbf06e8-42f0-44d7-abf2-744a8049397a tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:40.310255 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9bbf06e8-42f0-44d7-abf2-744a8049397a tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:40.310900 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9bbf06e8-42f0-44d7-abf2-744a8049397a tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:40.312291 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9bbf06e8-42f0-44d7-abf2-744a8049397a tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:40.314109 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9bbf06e8-42f0-44d7-abf2-744a8049397a tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:40.316639 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9bbf06e8-42f0-44d7-abf2-744a8049397a tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:40.359551 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9bbf06e8-42f0-44d7-abf2-744a8049397a tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] [instance: ce195309-8592-4c18-a45d-76038e4efaff] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:50:40.554512 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b483b183-31df-415b-9474-3a2580a9eaf6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:40.562402 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b483b183-31df-415b-9474-3a2580a9eaf6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 061034d6-4994-43d2-94df-fb12274eed87] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:40.569266 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b483b183-31df-415b-9474-3a2580a9eaf6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:40.569879 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b483b183-31df-415b-9474-3a2580a9eaf6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:40.571424 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b483b183-31df-415b-9474-3a2580a9eaf6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:40.572290 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b483b183-31df-415b-9474-3a2580a9eaf6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:40.572823 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b483b183-31df-415b-9474-3a2580a9eaf6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:40.573815 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b483b183-31df-415b-9474-3a2580a9eaf6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:40.612391 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b483b183-31df-415b-9474-3a2580a9eaf6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:40.612886 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b483b183-31df-415b-9474-3a2580a9eaf6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:40.613321 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b483b183-31df-415b-9474-3a2580a9eaf6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:40.613776 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-b483b183-31df-415b-9474-3a2580a9eaf6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lazy-loading 'fault' on Instance uuid 061034d6-4994-43d2-94df-fb12274eed87 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:50:40.792399 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b483b183-31df-415b-9474-3a2580a9eaf6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:40.827067 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b483b183-31df-415b-9474-3a2580a9eaf6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87" status: 200 len: 1192 microversion: 2.1 time: 0.278237 Oct 23 01:50:40.866037 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9bbf06e8-42f0-44d7-abf2-744a8049397a tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ce195309-8592-4c18-a45d-76038e4efaff" status: 204 len: 0 microversion: 2.1 time: 0.601951 Oct 23 01:50:40.867908 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3371/6646] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:50:40 2022] DELETE /compute/v2.1/servers/ce195309-8592-4c18-a45d-76038e4efaff => generated 0 bytes in 605 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:50:40.875180 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3276/6647] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:40 2022] GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87 => generated 1192 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:50:40.884025 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fc8093d6-18be-4c37-8404-8b7e947c753e tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:40.885916 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fc8093d6-18be-4c37-8404-8b7e947c753e tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] [instance: ce195309-8592-4c18-a45d-76038e4efaff] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:40.904977 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fc8093d6-18be-4c37-8404-8b7e947c753e tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:40.905606 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fc8093d6-18be-4c37-8404-8b7e947c753e tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:40.906097 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fc8093d6-18be-4c37-8404-8b7e947c753e tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:40.906824 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fc8093d6-18be-4c37-8404-8b7e947c753e tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:40.908004 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fc8093d6-18be-4c37-8404-8b7e947c753e tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:40.908628 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fc8093d6-18be-4c37-8404-8b7e947c753e tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:41.082905 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fc8093d6-18be-4c37-8404-8b7e947c753e tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c7799d37d747b08a9e20e15c3d6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a028aafec3294eae9a1c1a9a4e907dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:41.092205 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fc8093d6-18be-4c37-8404-8b7e947c753e tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] 10.222.0.42 "GET /compute/v2.1/servers/ce195309-8592-4c18-a45d-76038e4efaff" status: 200 len: 1476 microversion: 2.1 time: 0.213150 Oct 23 01:50:41.111877 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3372/6648] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:40 2022] GET /compute/v2.1/servers/ce195309-8592-4c18-a45d-76038e4efaff => generated 1476 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:41.886324 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5542873b-e5db-4c5e-8b02-cab05e089e52 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:41.887307 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5542873b-e5db-4c5e-8b02-cab05e089e52 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 061034d6-4994-43d2-94df-fb12274eed87] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:41.910764 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5542873b-e5db-4c5e-8b02-cab05e089e52 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:41.911566 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5542873b-e5db-4c5e-8b02-cab05e089e52 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:41.915428 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5542873b-e5db-4c5e-8b02-cab05e089e52 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:41.922967 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5542873b-e5db-4c5e-8b02-cab05e089e52 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:41.922967 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5542873b-e5db-4c5e-8b02-cab05e089e52 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:41.922967 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5542873b-e5db-4c5e-8b02-cab05e089e52 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:41.955700 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-5542873b-e5db-4c5e-8b02-cab05e089e52 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] HTTP exception thrown: Instance 061034d6-4994-43d2-94df-fb12274eed87 could not be found. Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5542873b-e5db-4c5e-8b02-cab05e089e52 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Request method failure captured: Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87 HTTP/1.1 Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJ238gvy9Iqj-gh_hYMMA3k82GIwOXmge1ZpdCVbStgEi7Wx0Hp0nUD39OZgeTVVZUzzMU6rbj6VKVMThBnKMFJkrT_c4TpJItwEaxJM150Q197EeZTFOgQpHEVnJj9TzM6T9aiiAWqKRliV_RYi1MvsQfVRPMVtUboRY7WK1bO1DBQ Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: b1ec0b5ecaa741eaaf40a50f1415e7f9 Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-TestVolumeBootPattern-219047212 Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}] Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-TestVolumeBootPattern-219047212 Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: b1ec0b5ecaa741eaaf40a50f1415e7f9 Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-TestVolumeBootPattern-219047212 Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-TestVolumeBootPattern-219047212-project Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: f2967d0d8c134d269c9bbe51c90f803a Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-TestVolumeBootPattern-219047212-project Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 061034d6-4994-43d2-94df-fb12274eed87 could not be found. Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '061034d6-4994-43d2-94df-fb12274eed87'} Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 061034d6-4994-43d2-94df-fb12274eed87 could not be found. Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 061034d6-4994-43d2-94df-fb12274eed87 could not be found. Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:50:41.957561 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:50:41.965251 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:50:41.965251 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:50:41.965251 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:50:41.965251 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:50:41.965251 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:50:41.965251 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 061034d6-4994-43d2-94df-fb12274eed87 could not be found. Oct 23 01:50:41.965251 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:50:41.965251 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5542873b-e5db-4c5e-8b02-cab05e089e52 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Returning 404 to user: Instance 061034d6-4994-43d2-94df-fb12274eed87 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:50:41.975033 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5542873b-e5db-4c5e-8b02-cab05e089e52 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87" status: 404 len: 111 microversion: 2.1 time: 0.093802 Oct 23 01:50:41.979683 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3277/6649] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:41 2022] GET /compute/v2.1/servers/061034d6-4994-43d2-94df-fb12274eed87 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:50:42.121379 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a86b8932-be97-406d-8d31-d9e7c38de23e tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:42.122178 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a86b8932-be97-406d-8d31-d9e7c38de23e tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] [instance: ce195309-8592-4c18-a45d-76038e4efaff] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:42.130123 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a86b8932-be97-406d-8d31-d9e7c38de23e tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:42.130980 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a86b8932-be97-406d-8d31-d9e7c38de23e tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:42.131610 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a86b8932-be97-406d-8d31-d9e7c38de23e tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:42.137546 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a86b8932-be97-406d-8d31-d9e7c38de23e tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:42.168480 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a86b8932-be97-406d-8d31-d9e7c38de23e tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:42.169201 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a86b8932-be97-406d-8d31-d9e7c38de23e tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:42.355043 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a86b8932-be97-406d-8d31-d9e7c38de23e tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c7799d37d747b08a9e20e15c3d6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a028aafec3294eae9a1c1a9a4e907dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:42.368368 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a86b8932-be97-406d-8d31-d9e7c38de23e tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] 10.222.0.42 "GET /compute/v2.1/servers/ce195309-8592-4c18-a45d-76038e4efaff" status: 200 len: 1476 microversion: 2.1 time: 0.247412 Oct 23 01:50:42.369295 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3373/6650] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:42 2022] GET /compute/v2.1/servers/ce195309-8592-4c18-a45d-76038e4efaff => generated 1476 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:43.402397 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a8a3edb3-904e-4f81-9112-12ead40b258b tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:43.403651 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a8a3edb3-904e-4f81-9112-12ead40b258b tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] [instance: ce195309-8592-4c18-a45d-76038e4efaff] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:43.416943 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a8a3edb3-904e-4f81-9112-12ead40b258b tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:43.417579 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a8a3edb3-904e-4f81-9112-12ead40b258b tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:43.418498 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a8a3edb3-904e-4f81-9112-12ead40b258b tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:43.423698 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a8a3edb3-904e-4f81-9112-12ead40b258b tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:43.423698 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a8a3edb3-904e-4f81-9112-12ead40b258b tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:43.423698 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a8a3edb3-904e-4f81-9112-12ead40b258b tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:43.465206 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-33295bfc-7eae-4e11-8e8d-c0828c1c39f3 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] Calling method '.version_select at 0x7f5cc0c20550>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:43.618432 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a8a3edb3-904e-4f81-9112-12ead40b258b tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c7799d37d747b08a9e20e15c3d6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a028aafec3294eae9a1c1a9a4e907dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:43.630976 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-33295bfc-7eae-4e11-8e8d-c0828c1c39f3 tempest-TestNetworkAdvancedServerOps-878522496 tempest-TestNetworkAdvancedServerOps-878522496-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2134032002" status: 202 len: 0 microversion: 2.1 time: 0.169129 Oct 23 01:50:43.632760 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a8a3edb3-904e-4f81-9112-12ead40b258b tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] 10.222.0.42 "GET /compute/v2.1/servers/ce195309-8592-4c18-a45d-76038e4efaff" status: 200 len: 1476 microversion: 2.1 time: 0.235765 Oct 23 01:50:43.633515 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3278/6651] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:43 2022] GET /compute/v2.1/servers/ce195309-8592-4c18-a45d-76038e4efaff => generated 1476 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:43.636400 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3374/6652] 10.222.0.42 () {58 vars in 1284 bytes} [Sun Oct 23 01:50:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2134032002 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:50:43.787003 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-23e99f73-c5b7-4c45-9e79-f8497bd8adad req-f066273c-2ed7-48a2-a8af-47711fa10235 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce195309-8592-4c18-a45d-76038e4efaff", "name": "network-vif-deleted", "tag": "b5d82c76-1312-42b8-ad79-433d1c5a0cd7"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:50:43.819416 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-23e99f73-c5b7-4c45-9e79-f8497bd8adad req-f066273c-2ed7-48a2-a8af-47711fa10235 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:43.819897 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-23e99f73-c5b7-4c45-9e79-f8497bd8adad req-f066273c-2ed7-48a2-a8af-47711fa10235 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:43.820329 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-23e99f73-c5b7-4c45-9e79-f8497bd8adad req-f066273c-2ed7-48a2-a8af-47711fa10235 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:43.868897 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-23e99f73-c5b7-4c45-9e79-f8497bd8adad req-f066273c-2ed7-48a2-a8af-47711fa10235 service nova] Creating event network-vif-deleted:b5d82c76-1312-42b8-ad79-433d1c5a0cd7 for instance ce195309-8592-4c18-a45d-76038e4efaff on n-h1-master-1 Oct 23 01:50:43.889493 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-23e99f73-c5b7-4c45-9e79-f8497bd8adad req-f066273c-2ed7-48a2-a8af-47711fa10235 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103369 Oct 23 01:50:43.890754 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3279/6653] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:50:44.670992 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-68cf2c38-9e7b-4430-b29e-4b042bcc0b02 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:44.672792 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-68cf2c38-9e7b-4430-b29e-4b042bcc0b02 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] [instance: ce195309-8592-4c18-a45d-76038e4efaff] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:44.697196 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68cf2c38-9e7b-4430-b29e-4b042bcc0b02 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:44.697937 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68cf2c38-9e7b-4430-b29e-4b042bcc0b02 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:44.698580 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68cf2c38-9e7b-4430-b29e-4b042bcc0b02 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:44.699489 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68cf2c38-9e7b-4430-b29e-4b042bcc0b02 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:44.700147 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68cf2c38-9e7b-4430-b29e-4b042bcc0b02 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:44.700741 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68cf2c38-9e7b-4430-b29e-4b042bcc0b02 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:44.788926 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68cf2c38-9e7b-4430-b29e-4b042bcc0b02 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:44.799965 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68cf2c38-9e7b-4430-b29e-4b042bcc0b02 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:44.800438 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68cf2c38-9e7b-4430-b29e-4b042bcc0b02 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:44.800901 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-68cf2c38-9e7b-4430-b29e-4b042bcc0b02 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lazy-loading 'fault' on Instance uuid ce195309-8592-4c18-a45d-76038e4efaff {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:50:44.889278 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-68cf2c38-9e7b-4430-b29e-4b042bcc0b02 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c7799d37d747b08a9e20e15c3d6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a028aafec3294eae9a1c1a9a4e907dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:44.903961 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-68cf2c38-9e7b-4430-b29e-4b042bcc0b02 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] 10.222.0.42 "GET /compute/v2.1/servers/ce195309-8592-4c18-a45d-76038e4efaff" status: 200 len: 1331 microversion: 2.1 time: 0.237812 Oct 23 01:50:44.904930 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3375/6654] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:44 2022] GET /compute/v2.1/servers/ce195309-8592-4c18-a45d-76038e4efaff => generated 1331 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:45.946261 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c2a16fb6-282a-47fa-a8f0-b9533d62f8ad tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:45.947078 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c2a16fb6-282a-47fa-a8f0-b9533d62f8ad tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] [instance: ce195309-8592-4c18-a45d-76038e4efaff] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:45.962818 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c2a16fb6-282a-47fa-a8f0-b9533d62f8ad tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:45.963572 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c2a16fb6-282a-47fa-a8f0-b9533d62f8ad tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:45.964205 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c2a16fb6-282a-47fa-a8f0-b9533d62f8ad tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:45.965288 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c2a16fb6-282a-47fa-a8f0-b9533d62f8ad tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:45.965912 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c2a16fb6-282a-47fa-a8f0-b9533d62f8ad tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:45.966564 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c2a16fb6-282a-47fa-a8f0-b9533d62f8ad tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:45.988797 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-c2a16fb6-282a-47fa-a8f0-b9533d62f8ad tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] HTTP exception thrown: Instance ce195309-8592-4c18-a45d-76038e4efaff could not be found. Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c2a16fb6-282a-47fa-a8f0-b9533d62f8ad tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Request method failure captured: Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/ce195309-8592-4c18-a45d-76038e4efaff HTTP/1.1 Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJ2IFU4rdLMIdlIm_wzOSgX2okUoi32EoZ5o34twzA96oL4E4gAkRvH4pBR8zohYyVrDPL_LFVKBsLy43o8Ti9qNHqqPl8grhBlfy6x_FLcvuM3TUKTycD_52JJ8jvGqvCoaDBvm98JdsTV0Dr2SVWHJw4sqzAqnB0RgbHxZDX44l_E Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: a028aafec3294eae9a1c1a9a4e907dc2 Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-973462640 Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a028aafec3294eae9a1c1a9a4e907dc2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a028aafec3294eae9a1c1a9a4e907dc2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a028aafec3294eae9a1c1a9a4e907dc2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a028aafec3294eae9a1c1a9a4e907dc2"}]}] Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-TestSecurityGroupsBasicOps-973462640 Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: a028aafec3294eae9a1c1a9a4e907dc2 Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-973462640 Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-TestSecurityGroupsBasicOps-973462640-project Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 38c7799d37d747b08a9e20e15c3d6879 Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-TestSecurityGroupsBasicOps-973462640-project Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: exception: Instance ce195309-8592-4c18-a45d-76038e4efaff could not be found. Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'ce195309-8592-4c18-a45d-76038e4efaff'} Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce195309-8592-4c18-a45d-76038e4efaff could not be found. Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce195309-8592-4c18-a45d-76038e4efaff could not be found. Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:50:45.995311 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:50:46.003504 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:50:46.003504 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:50:46.003504 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:50:46.003504 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:50:46.003504 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:50:46.003504 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce195309-8592-4c18-a45d-76038e4efaff could not be found. Oct 23 01:50:46.003504 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:50:46.003504 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c2a16fb6-282a-47fa-a8f0-b9533d62f8ad tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Returning 404 to user: Instance ce195309-8592-4c18-a45d-76038e4efaff could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:50:46.003504 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c2a16fb6-282a-47fa-a8f0-b9533d62f8ad tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] 10.222.0.42 "GET /compute/v2.1/servers/ce195309-8592-4c18-a45d-76038e4efaff" status: 404 len: 111 microversion: 2.1 time: 0.062092 Oct 23 01:50:46.003504 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3280/6655] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:45 2022] GET /compute/v2.1/servers/ce195309-8592-4c18-a45d-76038e4efaff => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:50:52.787854 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d24d310e-0b37-4c07-88d2-72335bebaa7f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1254359306", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "cf8f3237-1ad7-4e0f-92a2-dfbaf61b6713", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e056504c-8568-4f9a-a3ed-bae9f108b4ab"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:50:52.833134 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:50:53.368171 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-d24d310e-0b37-4c07-88d2-72335bebaa7f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] validate_networks() for [('e056504c-8568-4f9a-a3ed-bae9f108b4ab', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:50:54.724469 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-d24d310e-0b37-4c07-88d2-72335bebaa7f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:50:54.725143 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-d24d310e-0b37-4c07-88d2-72335bebaa7f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:50:54.725784 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-d24d310e-0b37-4c07-88d2-72335bebaa7f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:50:54.726309 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-d24d310e-0b37-4c07-88d2-72335bebaa7f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:50:54.726794 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-d24d310e-0b37-4c07-88d2-72335bebaa7f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:50:54.736878 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d24d310e-0b37-4c07-88d2-72335bebaa7f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:54.737706 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d24d310e-0b37-4c07-88d2-72335bebaa7f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:54.738194 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d24d310e-0b37-4c07-88d2-72335bebaa7f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:54.738927 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d24d310e-0b37-4c07-88d2-72335bebaa7f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:54.740077 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d24d310e-0b37-4c07-88d2-72335bebaa7f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:54.740077 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d24d310e-0b37-4c07-88d2-72335bebaa7f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:54.763342 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-d24d310e-0b37-4c07-88d2-72335bebaa7f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Getting quotas for project b1ec0b5ecaa741eaaf40a50f1415e7f9. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:50:54.775639 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-d24d310e-0b37-4c07-88d2-72335bebaa7f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Getting quotas for user f2967d0d8c134d269c9bbe51c90f803a and project b1ec0b5ecaa741eaaf40a50f1415e7f9. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:50:54.901570 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d24d310e-0b37-4c07-88d2-72335bebaa7f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:50:54.903840 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d24d310e-0b37-4c07-88d2-72335bebaa7f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cf8f3237-1ad7-4e0f-92a2-dfbaf61b6713',volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:50:55.565531 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d24d310e-0b37-4c07-88d2-72335bebaa7f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.783178 Oct 23 01:50:55.568503 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3376/6656] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:50:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:50:55.584689 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d9631eee-beab-4080-9dd1-cd8e0079207b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:55.586648 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d9631eee-beab-4080-9dd1-cd8e0079207b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:55.597780 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:50:55.746381 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d9631eee-beab-4080-9dd1-cd8e0079207b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:55.776929 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d9631eee-beab-4080-9dd1-cd8e0079207b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82" status: 200 len: 1057 microversion: 2.1 time: 0.199785 Oct 23 01:50:55.780075 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3281/6657] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:55 2022] GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82 => generated 1057 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:56.654642 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3d10ce99-b372-496b-9d67-a898e5ed2e17 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:56.658189 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-be5f850a-3e1e-4a5e-bca9-8caa1a6b2dc8 req-0fc4d7ad-a553-4b4a-a157-0ee7328bf231 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64804b2c-74aa-4e67-8eba-75a5c4f7db76", "tag": "4d84cc9b-7464-4aba-a4a3-4b45e5c6aada"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:50:56.662743 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3d10ce99-b372-496b-9d67-a898e5ed2e17 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] [instance: 64804b2c-74aa-4e67-8eba-75a5c4f7db76] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:56.672514 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=55 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:50:56.684466 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-be5f850a-3e1e-4a5e-bca9-8caa1a6b2dc8 req-0fc4d7ad-a553-4b4a-a157-0ee7328bf231 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:56.686306 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d10ce99-b372-496b-9d67-a898e5ed2e17 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:56.687577 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d10ce99-b372-496b-9d67-a898e5ed2e17 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:56.688243 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d10ce99-b372-496b-9d67-a898e5ed2e17 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:56.689398 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d10ce99-b372-496b-9d67-a898e5ed2e17 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:56.690104 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d10ce99-b372-496b-9d67-a898e5ed2e17 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:56.690772 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d10ce99-b372-496b-9d67-a898e5ed2e17 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:56.695897 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-be5f850a-3e1e-4a5e-bca9-8caa1a6b2dc8 req-0fc4d7ad-a553-4b4a-a157-0ee7328bf231 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:56.696612 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-be5f850a-3e1e-4a5e-bca9-8caa1a6b2dc8 req-0fc4d7ad-a553-4b4a-a157-0ee7328bf231 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:56.727889 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-be5f850a-3e1e-4a5e-bca9-8caa1a6b2dc8 req-0fc4d7ad-a553-4b4a-a157-0ee7328bf231 service nova] Creating event network-changed:4d84cc9b-7464-4aba-a4a3-4b45e5c6aada for instance 64804b2c-74aa-4e67-8eba-75a5c4f7db76 on n-h2-master-1 Oct 23 01:50:56.740829 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-be5f850a-3e1e-4a5e-bca9-8caa1a6b2dc8 req-0fc4d7ad-a553-4b4a-a157-0ee7328bf231 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090615 Oct 23 01:50:56.745297 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3282/6658] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:50:56.748065 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3d10ce99-b372-496b-9d67-a898e5ed2e17 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] [instance: 64804b2c-74aa-4e67-8eba-75a5c4f7db76] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:50:56.767052 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:50:56.802696 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9d7ae1f3-d6a2-428c-9ce6-8d7528f09fd3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:56.803900 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9d7ae1f3-d6a2-428c-9ce6-8d7528f09fd3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:57.130943 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9d7ae1f3-d6a2-428c-9ce6-8d7528f09fd3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:57.138528 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9d7ae1f3-d6a2-428c-9ce6-8d7528f09fd3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82" status: 200 len: 1057 microversion: 2.1 time: 0.340396 Oct 23 01:50:57.150641 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3283/6659] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:56 2022] GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82 => generated 1057 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:50:57.186533 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3d10ce99-b372-496b-9d67-a898e5ed2e17 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] 10.222.0.42 "DELETE /compute/v2.1/servers/64804b2c-74aa-4e67-8eba-75a5c4f7db76" status: 204 len: 0 microversion: 2.1 time: 0.539806 Oct 23 01:50:57.190726 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3377/6660] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:50:56 2022] DELETE /compute/v2.1/servers/64804b2c-74aa-4e67-8eba-75a5c4f7db76 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:50:57.196508 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-970aa7d3-a8af-4105-9ab3-62a87e987501 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:57.197770 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-970aa7d3-a8af-4105-9ab3-62a87e987501 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] [instance: 64804b2c-74aa-4e67-8eba-75a5c4f7db76] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:57.213679 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-970aa7d3-a8af-4105-9ab3-62a87e987501 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:57.214209 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-970aa7d3-a8af-4105-9ab3-62a87e987501 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:57.219482 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-970aa7d3-a8af-4105-9ab3-62a87e987501 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:57.219482 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-970aa7d3-a8af-4105-9ab3-62a87e987501 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:57.219482 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-970aa7d3-a8af-4105-9ab3-62a87e987501 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:57.219482 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-970aa7d3-a8af-4105-9ab3-62a87e987501 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:57.540102 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-970aa7d3-a8af-4105-9ab3-62a87e987501 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c7799d37d747b08a9e20e15c3d6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a028aafec3294eae9a1c1a9a4e907dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:57.559343 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-970aa7d3-a8af-4105-9ab3-62a87e987501 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] 10.222.0.42 "GET /compute/v2.1/servers/64804b2c-74aa-4e67-8eba-75a5c4f7db76" status: 200 len: 1765 microversion: 2.1 time: 0.366375 Oct 23 01:50:57.560192 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3284/6661] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:57 2022] GET /compute/v2.1/servers/64804b2c-74aa-4e67-8eba-75a5c4f7db76 => generated 1765 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:58.168068 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5640b5b4-ee44-429c-89d2-885fab551a01 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:58.168971 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5640b5b4-ee44-429c-89d2-885fab551a01 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:58.190150 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5640b5b4-ee44-429c-89d2-885fab551a01 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:58.190846 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5640b5b4-ee44-429c-89d2-885fab551a01 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:58.191512 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5640b5b4-ee44-429c-89d2-885fab551a01 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:58.192328 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5640b5b4-ee44-429c-89d2-885fab551a01 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:58.193024 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5640b5b4-ee44-429c-89d2-885fab551a01 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:58.193684 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5640b5b4-ee44-429c-89d2-885fab551a01 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:58.305712 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5640b5b4-ee44-429c-89d2-885fab551a01 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:58.316155 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5640b5b4-ee44-429c-89d2-885fab551a01 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82" status: 200 len: 1099 microversion: 2.1 time: 0.153365 Oct 23 01:50:58.316751 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3378/6662] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:58 2022] GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82 => generated 1099 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:58.590533 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ae6d61e7-1773-4d0b-aef5-177e5fb8aad9 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:58.596973 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ae6d61e7-1773-4d0b-aef5-177e5fb8aad9 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] [instance: 64804b2c-74aa-4e67-8eba-75a5c4f7db76] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:58.619936 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ae6d61e7-1773-4d0b-aef5-177e5fb8aad9 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:58.624226 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ae6d61e7-1773-4d0b-aef5-177e5fb8aad9 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:58.630443 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ae6d61e7-1773-4d0b-aef5-177e5fb8aad9 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:58.631466 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ae6d61e7-1773-4d0b-aef5-177e5fb8aad9 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:58.633442 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ae6d61e7-1773-4d0b-aef5-177e5fb8aad9 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:58.635643 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ae6d61e7-1773-4d0b-aef5-177e5fb8aad9 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:59.352907 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fb415199-6463-4f2e-bfce-23fccb447d34 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:50:59.354324 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fb415199-6463-4f2e-bfce-23fccb447d34 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:50:59.377457 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb415199-6463-4f2e-bfce-23fccb447d34 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:59.378509 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb415199-6463-4f2e-bfce-23fccb447d34 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:59.378983 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb415199-6463-4f2e-bfce-23fccb447d34 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:59.379716 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb415199-6463-4f2e-bfce-23fccb447d34 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:50:59.380183 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb415199-6463-4f2e-bfce-23fccb447d34 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:50:59.380619 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb415199-6463-4f2e-bfce-23fccb447d34 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:50:59.411859 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ae6d61e7-1773-4d0b-aef5-177e5fb8aad9 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c7799d37d747b08a9e20e15c3d6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a028aafec3294eae9a1c1a9a4e907dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:59.423749 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ae6d61e7-1773-4d0b-aef5-177e5fb8aad9 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] 10.222.0.42 "GET /compute/v2.1/servers/64804b2c-74aa-4e67-8eba-75a5c4f7db76" status: 200 len: 1765 microversion: 2.1 time: 0.838890 Oct 23 01:50:59.424697 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3285/6663] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:58 2022] GET /compute/v2.1/servers/64804b2c-74aa-4e67-8eba-75a5c4f7db76 => generated 1765 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:50:59.882925 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fb415199-6463-4f2e-bfce-23fccb447d34 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:50:59.899842 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fb415199-6463-4f2e-bfce-23fccb447d34 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82" status: 200 len: 1155 microversion: 2.1 time: 0.547029 Oct 23 01:50:59.901912 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3379/6664] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:50:59 2022] GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82 => generated 1155 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:51:00.454472 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8ed333ab-6cda-49b5-9fa4-904ebddc94b8 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:51:00.455821 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8ed333ab-6cda-49b5-9fa4-904ebddc94b8 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] [instance: 64804b2c-74aa-4e67-8eba-75a5c4f7db76] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:51:00.470399 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8ed333ab-6cda-49b5-9fa4-904ebddc94b8 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:00.474912 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8ed333ab-6cda-49b5-9fa4-904ebddc94b8 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:00.475735 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8ed333ab-6cda-49b5-9fa4-904ebddc94b8 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:00.477272 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8ed333ab-6cda-49b5-9fa4-904ebddc94b8 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:00.480402 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8ed333ab-6cda-49b5-9fa4-904ebddc94b8 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:00.481078 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8ed333ab-6cda-49b5-9fa4-904ebddc94b8 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:00.705878 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-64f8fb36-50e1-4d40-ae09-d1eb54da9089 req-c1fd16a1-4d3d-4e6e-8676-f99c1cbb7fe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64804b2c-74aa-4e67-8eba-75a5c4f7db76", "name": "network-vif-deleted", "tag": "4d84cc9b-7464-4aba-a4a3-4b45e5c6aada"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:51:00.738909 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-64f8fb36-50e1-4d40-ae09-d1eb54da9089 req-c1fd16a1-4d3d-4e6e-8676-f99c1cbb7fe2 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:00.740929 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-64f8fb36-50e1-4d40-ae09-d1eb54da9089 req-c1fd16a1-4d3d-4e6e-8676-f99c1cbb7fe2 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:00.741637 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-64f8fb36-50e1-4d40-ae09-d1eb54da9089 req-c1fd16a1-4d3d-4e6e-8676-f99c1cbb7fe2 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:00.813149 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-64f8fb36-50e1-4d40-ae09-d1eb54da9089 req-c1fd16a1-4d3d-4e6e-8676-f99c1cbb7fe2 service nova] Creating event network-vif-deleted:4d84cc9b-7464-4aba-a4a3-4b45e5c6aada for instance 64804b2c-74aa-4e67-8eba-75a5c4f7db76 on n-h2-master-1 Oct 23 01:51:00.829548 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8ed333ab-6cda-49b5-9fa4-904ebddc94b8 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c7799d37d747b08a9e20e15c3d6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a028aafec3294eae9a1c1a9a4e907dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:51:00.842182 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-64f8fb36-50e1-4d40-ae09-d1eb54da9089 req-c1fd16a1-4d3d-4e6e-8676-f99c1cbb7fe2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141356 Oct 23 01:51:00.844173 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8ed333ab-6cda-49b5-9fa4-904ebddc94b8 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] 10.222.0.42 "GET /compute/v2.1/servers/64804b2c-74aa-4e67-8eba-75a5c4f7db76" status: 200 len: 1648 microversion: 2.1 time: 0.394630 Oct 23 01:51:00.847953 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3380/6665] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:51:00.848268 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3286/6666] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:51:00 2022] GET /compute/v2.1/servers/64804b2c-74aa-4e67-8eba-75a5c4f7db76 => generated 1648 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:51:00.931509 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ad41eaaa-c8ea-49bc-92d9-6362176d068d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:51:00.932478 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ad41eaaa-c8ea-49bc-92d9-6362176d068d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:51:00.944970 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ad41eaaa-c8ea-49bc-92d9-6362176d068d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:00.949409 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ad41eaaa-c8ea-49bc-92d9-6362176d068d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:00.953851 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ad41eaaa-c8ea-49bc-92d9-6362176d068d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:00.956235 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ad41eaaa-c8ea-49bc-92d9-6362176d068d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:00.958759 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ad41eaaa-c8ea-49bc-92d9-6362176d068d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:00.959220 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ad41eaaa-c8ea-49bc-92d9-6362176d068d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:01.201176 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ad41eaaa-c8ea-49bc-92d9-6362176d068d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:51:01.220622 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ad41eaaa-c8ea-49bc-92d9-6362176d068d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82" status: 200 len: 1173 microversion: 2.1 time: 0.294846 Oct 23 01:51:01.221245 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3381/6667] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:51:00 2022] GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82 => generated 1173 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:51:01.873484 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b04c0582-2986-4d04-af19-83746845788a tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:51:01.874139 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b04c0582-2986-4d04-af19-83746845788a tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] [instance: 64804b2c-74aa-4e67-8eba-75a5c4f7db76] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:51:01.887113 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b04c0582-2986-4d04-af19-83746845788a tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:01.888784 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b04c0582-2986-4d04-af19-83746845788a tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:01.890952 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b04c0582-2986-4d04-af19-83746845788a tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:01.891938 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b04c0582-2986-4d04-af19-83746845788a tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:01.894453 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b04c0582-2986-4d04-af19-83746845788a tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:01.895100 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b04c0582-2986-4d04-af19-83746845788a tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:01.950685 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b04c0582-2986-4d04-af19-83746845788a tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:01.951218 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b04c0582-2986-4d04-af19-83746845788a tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:01.951658 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b04c0582-2986-4d04-af19-83746845788a tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:01.952526 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-b04c0582-2986-4d04-af19-83746845788a tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lazy-loading 'fault' on Instance uuid 64804b2c-74aa-4e67-8eba-75a5c4f7db76 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:51:02.167317 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b04c0582-2986-4d04-af19-83746845788a tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c7799d37d747b08a9e20e15c3d6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a028aafec3294eae9a1c1a9a4e907dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:51:02.176190 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b04c0582-2986-4d04-af19-83746845788a tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] 10.222.0.42 "GET /compute/v2.1/servers/64804b2c-74aa-4e67-8eba-75a5c4f7db76" status: 200 len: 1383 microversion: 2.1 time: 0.306591 Oct 23 01:51:02.183101 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3287/6668] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:51:01 2022] GET /compute/v2.1/servers/64804b2c-74aa-4e67-8eba-75a5c4f7db76 => generated 1383 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:51:02.245474 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e2d99454-b92b-4c88-b0a4-68289703225d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:51:02.247529 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e2d99454-b92b-4c88-b0a4-68289703225d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:51:02.264549 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e2d99454-b92b-4c88-b0a4-68289703225d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:02.269610 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e2d99454-b92b-4c88-b0a4-68289703225d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:02.270511 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e2d99454-b92b-4c88-b0a4-68289703225d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:02.271307 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e2d99454-b92b-4c88-b0a4-68289703225d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:02.271989 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e2d99454-b92b-4c88-b0a4-68289703225d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:02.272593 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e2d99454-b92b-4c88-b0a4-68289703225d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:02.669792 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e2d99454-b92b-4c88-b0a4-68289703225d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:51:02.682044 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e2d99454-b92b-4c88-b0a4-68289703225d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82" status: 200 len: 1215 microversion: 2.1 time: 0.440895 Oct 23 01:51:02.682566 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3382/6669] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:51:02 2022] GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82 => generated 1215 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:51:03.206180 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2b610635-d818-47c3-905c-0845cd6d0865 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:51:03.206954 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2b610635-d818-47c3-905c-0845cd6d0865 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] [instance: 64804b2c-74aa-4e67-8eba-75a5c4f7db76] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:51:03.219684 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2b610635-d818-47c3-905c-0845cd6d0865 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:03.220400 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2b610635-d818-47c3-905c-0845cd6d0865 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:03.225543 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2b610635-d818-47c3-905c-0845cd6d0865 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:03.225543 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2b610635-d818-47c3-905c-0845cd6d0865 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:03.225898 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2b610635-d818-47c3-905c-0845cd6d0865 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:03.226603 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2b610635-d818-47c3-905c-0845cd6d0865 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:03.263372 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-2b610635-d818-47c3-905c-0845cd6d0865 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] HTTP exception thrown: Instance 64804b2c-74aa-4e67-8eba-75a5c4f7db76 could not be found. Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2b610635-d818-47c3-905c-0845cd6d0865 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Request method failure captured: Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/64804b2c-74aa-4e67-8eba-75a5c4f7db76 HTTP/1.1 Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJ2IFU4rdLMIdlIm_wzOSgX2okUoi32EoZ5o34twzA96oL4E4gAkRvH4pBR8zohYyVrDPL_LFVKBsLy43o8Ti9qNHqqPl8grhBlfy6x_FLcvuM3TUKTycD_52JJ8jvGqvCoaDBvm98JdsTV0Dr2SVWHJw4sqzAqnB0RgbHxZDX44l_E Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: a028aafec3294eae9a1c1a9a4e907dc2 Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-973462640 Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a028aafec3294eae9a1c1a9a4e907dc2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a028aafec3294eae9a1c1a9a4e907dc2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a028aafec3294eae9a1c1a9a4e907dc2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a028aafec3294eae9a1c1a9a4e907dc2"}]}] Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-TestSecurityGroupsBasicOps-973462640 Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: a028aafec3294eae9a1c1a9a4e907dc2 Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-973462640 Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-TestSecurityGroupsBasicOps-973462640-project Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 38c7799d37d747b08a9e20e15c3d6879 Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-TestSecurityGroupsBasicOps-973462640-project Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 64804b2c-74aa-4e67-8eba-75a5c4f7db76 could not be found. Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '64804b2c-74aa-4e67-8eba-75a5c4f7db76'} Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64804b2c-74aa-4e67-8eba-75a5c4f7db76 could not be found. Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64804b2c-74aa-4e67-8eba-75a5c4f7db76 could not be found. Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:51:03.265867 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:51:03.270888 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:51:03.270888 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:51:03.270888 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:51:03.270888 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:51:03.270888 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:51:03.270888 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64804b2c-74aa-4e67-8eba-75a5c4f7db76 could not be found. Oct 23 01:51:03.270888 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:51:03.270888 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2b610635-d818-47c3-905c-0845cd6d0865 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Returning 404 to user: Instance 64804b2c-74aa-4e67-8eba-75a5c4f7db76 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:51:03.270888 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2b610635-d818-47c3-905c-0845cd6d0865 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] 10.222.0.42 "GET /compute/v2.1/servers/64804b2c-74aa-4e67-8eba-75a5c4f7db76" status: 404 len: 111 microversion: 2.1 time: 0.067769 Oct 23 01:51:03.270888 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3288/6670] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:51:03 2022] GET /compute/v2.1/servers/64804b2c-74aa-4e67-8eba-75a5c4f7db76 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:51:03.712253 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bde084e5-1c68-4e60-8797-445bfd31a572 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:51:03.712903 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bde084e5-1c68-4e60-8797-445bfd31a572 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:51:03.732948 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bde084e5-1c68-4e60-8797-445bfd31a572 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:03.733455 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bde084e5-1c68-4e60-8797-445bfd31a572 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:03.733929 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bde084e5-1c68-4e60-8797-445bfd31a572 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:03.734851 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bde084e5-1c68-4e60-8797-445bfd31a572 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:03.735183 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bde084e5-1c68-4e60-8797-445bfd31a572 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:03.735621 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bde084e5-1c68-4e60-8797-445bfd31a572 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:04.749599 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:51:04.786088 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=6 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:51:05.128062 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bde084e5-1c68-4e60-8797-445bfd31a572 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:51:05.142527 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bde084e5-1c68-4e60-8797-445bfd31a572 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82" status: 200 len: 1215 microversion: 2.1 time: 1.432018 Oct 23 01:51:05.144800 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3383/6671] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:51:03 2022] GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82 => generated 1215 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:51:05.352640 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-b193c12b-db8c-4515-b7ba-99bb756507b0 req-5205b0cf-fa99-4c99-9164-19abb1354228 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82", "tag": "93647bf3-e2e0-4d84-abdd-39a00bab4ff9"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:51:05.388008 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-b193c12b-db8c-4515-b7ba-99bb756507b0 req-5205b0cf-fa99-4c99-9164-19abb1354228 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:05.388890 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-b193c12b-db8c-4515-b7ba-99bb756507b0 req-5205b0cf-fa99-4c99-9164-19abb1354228 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:05.389378 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-b193c12b-db8c-4515-b7ba-99bb756507b0 req-5205b0cf-fa99-4c99-9164-19abb1354228 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:05.423944 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-b193c12b-db8c-4515-b7ba-99bb756507b0 req-5205b0cf-fa99-4c99-9164-19abb1354228 service nova] Creating event network-changed:93647bf3-e2e0-4d84-abdd-39a00bab4ff9 for instance 88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82 on n-h2-master-1 Oct 23 01:51:05.433866 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-b193c12b-db8c-4515-b7ba-99bb756507b0 req-5205b0cf-fa99-4c99-9164-19abb1354228 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085850 Oct 23 01:51:05.439367 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3289/6672] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:51:06.168446 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a309972a-7d84-459f-a044-29bd49fa9660 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:51:06.169863 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a309972a-7d84-459f-a044-29bd49fa9660 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:51:06.195073 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a309972a-7d84-459f-a044-29bd49fa9660 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:06.196160 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a309972a-7d84-459f-a044-29bd49fa9660 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:06.196840 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a309972a-7d84-459f-a044-29bd49fa9660 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:06.198017 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a309972a-7d84-459f-a044-29bd49fa9660 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:06.198692 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a309972a-7d84-459f-a044-29bd49fa9660 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:06.202512 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a309972a-7d84-459f-a044-29bd49fa9660 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:07.051228 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a309972a-7d84-459f-a044-29bd49fa9660 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:51:07.101405 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a309972a-7d84-459f-a044-29bd49fa9660 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82" status: 200 len: 1215 microversion: 2.1 time: 0.928789 Oct 23 01:51:07.111873 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3384/6673] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:51:06 2022] GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82 => generated 1215 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:51:08.129021 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d1dcab75-01c9-42e5-b100-0bc06932ebb3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:51:08.129762 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d1dcab75-01c9-42e5-b100-0bc06932ebb3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:51:08.145789 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=4 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:51:08.150979 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d1dcab75-01c9-42e5-b100-0bc06932ebb3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:08.152550 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d1dcab75-01c9-42e5-b100-0bc06932ebb3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:08.153152 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d1dcab75-01c9-42e5-b100-0bc06932ebb3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:08.156243 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d1dcab75-01c9-42e5-b100-0bc06932ebb3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:08.157728 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d1dcab75-01c9-42e5-b100-0bc06932ebb3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:08.159762 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d1dcab75-01c9-42e5-b100-0bc06932ebb3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:08.796400 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d1dcab75-01c9-42e5-b100-0bc06932ebb3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:51:08.809780 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d1dcab75-01c9-42e5-b100-0bc06932ebb3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82" status: 200 len: 1215 microversion: 2.1 time: 0.686098 Oct 23 01:51:08.811318 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3290/6674] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:51:08 2022] GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82 => generated 1215 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:51:09.841668 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4f123077-a0fa-463e-9d56-14383b6e5220 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:51:09.842673 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4f123077-a0fa-463e-9d56-14383b6e5220 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:51:09.864524 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f123077-a0fa-463e-9d56-14383b6e5220 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:09.866185 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f123077-a0fa-463e-9d56-14383b6e5220 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:09.878805 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f123077-a0fa-463e-9d56-14383b6e5220 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:09.879870 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f123077-a0fa-463e-9d56-14383b6e5220 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:09.883820 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f123077-a0fa-463e-9d56-14383b6e5220 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:09.885024 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f123077-a0fa-463e-9d56-14383b6e5220 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:10.885061 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4f123077-a0fa-463e-9d56-14383b6e5220 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:51:10.902870 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4f123077-a0fa-463e-9d56-14383b6e5220 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82" status: 200 len: 1215 microversion: 2.1 time: 1.071363 Oct 23 01:51:10.912790 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3385/6675] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:51:09 2022] GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82 => generated 1215 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:51:11.926651 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d4f8385b-6459-40e5-90f1-9ba854e97e64 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:51:11.927917 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d4f8385b-6459-40e5-90f1-9ba854e97e64 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:51:11.949213 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4f8385b-6459-40e5-90f1-9ba854e97e64 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:11.952917 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4f8385b-6459-40e5-90f1-9ba854e97e64 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:11.956485 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4f8385b-6459-40e5-90f1-9ba854e97e64 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:11.958978 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4f8385b-6459-40e5-90f1-9ba854e97e64 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:11.959652 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4f8385b-6459-40e5-90f1-9ba854e97e64 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:11.966633 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4f8385b-6459-40e5-90f1-9ba854e97e64 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:12.637098 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d4f8385b-6459-40e5-90f1-9ba854e97e64 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:51:12.652085 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d4f8385b-6459-40e5-90f1-9ba854e97e64 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82" status: 200 len: 1203 microversion: 2.1 time: 0.728365 Oct 23 01:51:12.671861 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3291/6676] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:51:11 2022] GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82 => generated 1203 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:51:13.679496 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6104df03-efb9-43a5-b55d-5d54cc28e038 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:51:13.680052 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6104df03-efb9-43a5-b55d-5d54cc28e038 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:51:13.689467 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6104df03-efb9-43a5-b55d-5d54cc28e038 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:13.698782 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6104df03-efb9-43a5-b55d-5d54cc28e038 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:13.699524 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6104df03-efb9-43a5-b55d-5d54cc28e038 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:13.700493 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6104df03-efb9-43a5-b55d-5d54cc28e038 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:13.702676 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6104df03-efb9-43a5-b55d-5d54cc28e038 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:13.708846 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6104df03-efb9-43a5-b55d-5d54cc28e038 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:14.404917 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6104df03-efb9-43a5-b55d-5d54cc28e038 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:51:14.418604 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6104df03-efb9-43a5-b55d-5d54cc28e038 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82" status: 200 len: 1203 microversion: 2.1 time: 0.742904 Oct 23 01:51:14.431298 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3386/6677] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:51:13 2022] GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82 => generated 1203 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:51:15.453549 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f8d2edab-f6e3-47ef-862a-ac0f6576cbd5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:51:15.454211 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f8d2edab-f6e3-47ef-862a-ac0f6576cbd5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:51:15.462773 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f8d2edab-f6e3-47ef-862a-ac0f6576cbd5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:15.474095 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f8d2edab-f6e3-47ef-862a-ac0f6576cbd5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:15.481166 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f8d2edab-f6e3-47ef-862a-ac0f6576cbd5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:15.481166 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f8d2edab-f6e3-47ef-862a-ac0f6576cbd5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:15.481166 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f8d2edab-f6e3-47ef-862a-ac0f6576cbd5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:15.481166 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f8d2edab-f6e3-47ef-862a-ac0f6576cbd5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:16.604685 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f8d2edab-f6e3-47ef-862a-ac0f6576cbd5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:51:16.615289 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f8d2edab-f6e3-47ef-862a-ac0f6576cbd5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82" status: 200 len: 1203 microversion: 2.1 time: 1.175470 Oct 23 01:51:16.615882 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3292/6678] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:51:15 2022] GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82 => generated 1203 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:51:17.643763 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e3151220-2316-493c-a718-cf3d864ac17c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:51:17.645115 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e3151220-2316-493c-a718-cf3d864ac17c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:51:17.670346 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e3151220-2316-493c-a718-cf3d864ac17c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:17.675331 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e3151220-2316-493c-a718-cf3d864ac17c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:17.675331 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e3151220-2316-493c-a718-cf3d864ac17c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:17.675331 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e3151220-2316-493c-a718-cf3d864ac17c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:17.675331 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e3151220-2316-493c-a718-cf3d864ac17c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:17.675331 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e3151220-2316-493c-a718-cf3d864ac17c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:18.145779 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e3151220-2316-493c-a718-cf3d864ac17c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:51:18.161422 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e3151220-2316-493c-a718-cf3d864ac17c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82" status: 200 len: 1203 microversion: 2.1 time: 0.521677 Oct 23 01:51:18.177578 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3387/6679] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:51:17 2022] GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82 => generated 1203 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:51:18.567461 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9f7094fd-f5c6-4905-a399-495328e30729 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] Calling method '.version_select at 0x7f5cc14e93a0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:51:18.682967 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9f7094fd-f5c6-4905-a399-495328e30729 tempest-TestSecurityGroupsBasicOps-973462640 tempest-TestSecurityGroupsBasicOps-973462640-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-484001668" status: 202 len: 0 microversion: 2.1 time: 0.115475 Oct 23 01:51:18.682967 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3293/6680] 10.222.0.42 () {58 vars in 1275 bytes} [Sun Oct 23 01:51:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-484001668 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:51:19.189226 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-daeb5fbe-c7a9-492b-99fb-bd4ae2b5ea64 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:51:19.192301 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-daeb5fbe-c7a9-492b-99fb-bd4ae2b5ea64 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:51:19.216814 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-daeb5fbe-c7a9-492b-99fb-bd4ae2b5ea64 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:19.218440 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-daeb5fbe-c7a9-492b-99fb-bd4ae2b5ea64 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:19.219884 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-daeb5fbe-c7a9-492b-99fb-bd4ae2b5ea64 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:19.220804 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-daeb5fbe-c7a9-492b-99fb-bd4ae2b5ea64 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:19.221447 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-daeb5fbe-c7a9-492b-99fb-bd4ae2b5ea64 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:19.222068 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-daeb5fbe-c7a9-492b-99fb-bd4ae2b5ea64 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:19.553489 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-daeb5fbe-c7a9-492b-99fb-bd4ae2b5ea64 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:51:19.564657 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-daeb5fbe-c7a9-492b-99fb-bd4ae2b5ea64 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82" status: 200 len: 1203 microversion: 2.1 time: 0.382421 Oct 23 01:51:19.565273 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3388/6681] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:51:19 2022] GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82 => generated 1203 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:51:20.597469 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6e3ec3eb-31b2-4a40-beac-ad58726ab043 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:51:20.598889 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6e3ec3eb-31b2-4a40-beac-ad58726ab043 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:51:20.624378 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6e3ec3eb-31b2-4a40-beac-ad58726ab043 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:20.625544 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6e3ec3eb-31b2-4a40-beac-ad58726ab043 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:20.626058 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6e3ec3eb-31b2-4a40-beac-ad58726ab043 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:20.626738 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6e3ec3eb-31b2-4a40-beac-ad58726ab043 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:20.627191 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6e3ec3eb-31b2-4a40-beac-ad58726ab043 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:20.627614 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6e3ec3eb-31b2-4a40-beac-ad58726ab043 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:21.789750 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6e3ec3eb-31b2-4a40-beac-ad58726ab043 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:51:21.799801 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6e3ec3eb-31b2-4a40-beac-ad58726ab043 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82" status: 200 len: 1203 microversion: 2.1 time: 1.207114 Oct 23 01:51:21.815073 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3294/6682] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:51:20 2022] GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82 => generated 1203 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:51:22.827157 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fea2bf83-9b52-4db4-9b1e-35f927d4841f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:51:22.828473 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fea2bf83-9b52-4db4-9b1e-35f927d4841f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:51:22.845819 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fea2bf83-9b52-4db4-9b1e-35f927d4841f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:22.846510 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fea2bf83-9b52-4db4-9b1e-35f927d4841f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:22.847004 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fea2bf83-9b52-4db4-9b1e-35f927d4841f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:22.852359 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fea2bf83-9b52-4db4-9b1e-35f927d4841f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:22.852359 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fea2bf83-9b52-4db4-9b1e-35f927d4841f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:22.862386 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fea2bf83-9b52-4db4-9b1e-35f927d4841f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:23.070974 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-e25ad0d1-b48d-48fc-aeba-7e4a528d25cb req-cb777f49-6b9d-43ba-8e7b-fbddac8ecd6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82", "name": "network-vif-plugged", "status": "completed", "tag": "93647bf3-e2e0-4d84-abdd-39a00bab4ff9"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:51:23.106425 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-e25ad0d1-b48d-48fc-aeba-7e4a528d25cb req-cb777f49-6b9d-43ba-8e7b-fbddac8ecd6f service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:23.107033 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-e25ad0d1-b48d-48fc-aeba-7e4a528d25cb req-cb777f49-6b9d-43ba-8e7b-fbddac8ecd6f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:23.107568 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-e25ad0d1-b48d-48fc-aeba-7e4a528d25cb req-cb777f49-6b9d-43ba-8e7b-fbddac8ecd6f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:23.127868 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-e25ad0d1-b48d-48fc-aeba-7e4a528d25cb req-cb777f49-6b9d-43ba-8e7b-fbddac8ecd6f service nova] Creating event network-vif-plugged:93647bf3-e2e0-4d84-abdd-39a00bab4ff9 for instance 88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82 on n-h2-master-1 Oct 23 01:51:23.135134 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-e25ad0d1-b48d-48fc-aeba-7e4a528d25cb req-cb777f49-6b9d-43ba-8e7b-fbddac8ecd6f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067907 Oct 23 01:51:23.136355 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3295/6683] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:51:23.426885 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fea2bf83-9b52-4db4-9b1e-35f927d4841f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:51:23.437384 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fea2bf83-9b52-4db4-9b1e-35f927d4841f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82" status: 200 len: 1203 microversion: 2.1 time: 0.614104 Oct 23 01:51:23.456390 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3389/6684] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:51:22 2022] GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82 => generated 1203 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:51:24.465830 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e9a1abc2-4e1a-4ffc-8fbf-53c2786060d1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:51:24.467088 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e9a1abc2-4e1a-4ffc-8fbf-53c2786060d1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:51:24.492942 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e9a1abc2-4e1a-4ffc-8fbf-53c2786060d1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:24.493443 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e9a1abc2-4e1a-4ffc-8fbf-53c2786060d1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:24.502314 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e9a1abc2-4e1a-4ffc-8fbf-53c2786060d1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:24.502314 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e9a1abc2-4e1a-4ffc-8fbf-53c2786060d1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:24.502314 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e9a1abc2-4e1a-4ffc-8fbf-53c2786060d1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:24.502314 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e9a1abc2-4e1a-4ffc-8fbf-53c2786060d1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:24.843397 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e9a1abc2-4e1a-4ffc-8fbf-53c2786060d1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:51:24.851697 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e9a1abc2-4e1a-4ffc-8fbf-53c2786060d1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82" status: 200 len: 1203 microversion: 2.1 time: 0.391508 Oct 23 01:51:24.855494 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3296/6685] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:51:24 2022] GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82 => generated 1203 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:51:25.879987 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5c332b4e-59b0-4634-904e-0aaa3cd94643 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:51:25.881139 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5c332b4e-59b0-4634-904e-0aaa3cd94643 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:51:25.891383 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:51:25.893211 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5c332b4e-59b0-4634-904e-0aaa3cd94643 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:25.895460 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5c332b4e-59b0-4634-904e-0aaa3cd94643 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:25.896094 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5c332b4e-59b0-4634-904e-0aaa3cd94643 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:25.898306 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5c332b4e-59b0-4634-904e-0aaa3cd94643 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:25.901584 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5c332b4e-59b0-4634-904e-0aaa3cd94643 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:25.902406 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5c332b4e-59b0-4634-904e-0aaa3cd94643 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:26.697517 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5c332b4e-59b0-4634-904e-0aaa3cd94643 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:51:26.713860 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5c332b4e-59b0-4634-904e-0aaa3cd94643 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82" status: 200 len: 1390 microversion: 2.1 time: 0.836911 Oct 23 01:51:26.714665 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3390/6686] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:51:25 2022] GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82 => generated 1390 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:51:26.771250 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4903f80b-b904-4817-82ad-afcecf1c2f68 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:51:26.773021 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4903f80b-b904-4817-82ad-afcecf1c2f68 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:51:26.791561 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4903f80b-b904-4817-82ad-afcecf1c2f68 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:26.792375 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4903f80b-b904-4817-82ad-afcecf1c2f68 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:26.795858 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4903f80b-b904-4817-82ad-afcecf1c2f68 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:26.796834 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4903f80b-b904-4817-82ad-afcecf1c2f68 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:26.799418 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4903f80b-b904-4817-82ad-afcecf1c2f68 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:26.800162 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4903f80b-b904-4817-82ad-afcecf1c2f68 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:27.229265 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4903f80b-b904-4817-82ad-afcecf1c2f68 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:51:27.231942 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=69 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:51:27.240531 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4903f80b-b904-4817-82ad-afcecf1c2f68 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82" status: 200 len: 1390 microversion: 2.1 time: 0.501847 Oct 23 01:51:27.241823 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3297/6687] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:51:26 2022] GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82 => generated 1390 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:51:27.264101 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a8233d64-f868-430f-9373-f17b77e4a75d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:51:27.265079 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a8233d64-f868-430f-9373-f17b77e4a75d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:51:27.273705 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a8233d64-f868-430f-9373-f17b77e4a75d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:27.274472 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a8233d64-f868-430f-9373-f17b77e4a75d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:27.275561 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a8233d64-f868-430f-9373-f17b77e4a75d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:27.276520 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a8233d64-f868-430f-9373-f17b77e4a75d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:27.277150 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a8233d64-f868-430f-9373-f17b77e4a75d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:27.277747 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a8233d64-f868-430f-9373-f17b77e4a75d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:27.495730 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a8233d64-f868-430f-9373-f17b77e4a75d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:51:27.507095 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a8233d64-f868-430f-9373-f17b77e4a75d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82" status: 200 len: 1390 microversion: 2.1 time: 0.247096 Oct 23 01:51:27.510118 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3391/6688] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:51:27 2022] GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82 => generated 1390 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:51:27.538541 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4bd91db3-9c19-48b7-970c-6dd453f8884e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:51:27.539495 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4bd91db3-9c19-48b7-970c-6dd453f8884e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:51:27.552684 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4bd91db3-9c19-48b7-970c-6dd453f8884e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:27.555428 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4bd91db3-9c19-48b7-970c-6dd453f8884e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:27.557299 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4bd91db3-9c19-48b7-970c-6dd453f8884e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:27.558480 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4bd91db3-9c19-48b7-970c-6dd453f8884e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:27.562622 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4bd91db3-9c19-48b7-970c-6dd453f8884e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:27.563331 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4bd91db3-9c19-48b7-970c-6dd453f8884e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:27.622940 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4bd91db3-9c19-48b7-970c-6dd453f8884e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:51:28.066887 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4bd91db3-9c19-48b7-970c-6dd453f8884e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "DELETE /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82" status: 204 len: 0 microversion: 2.1 time: 0.532545 Oct 23 01:51:28.066887 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3298/6689] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:51:27 2022] DELETE /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:51:28.075712 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-59d4fd9e-7e54-469e-bfcc-1805ed203b3f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:51:28.076639 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-59d4fd9e-7e54-469e-bfcc-1805ed203b3f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:51:28.087929 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-59d4fd9e-7e54-469e-bfcc-1805ed203b3f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:28.088443 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-59d4fd9e-7e54-469e-bfcc-1805ed203b3f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:28.088884 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-59d4fd9e-7e54-469e-bfcc-1805ed203b3f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:28.089608 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-59d4fd9e-7e54-469e-bfcc-1805ed203b3f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:28.090766 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-59d4fd9e-7e54-469e-bfcc-1805ed203b3f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:28.090766 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-59d4fd9e-7e54-469e-bfcc-1805ed203b3f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:28.667261 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-59d4fd9e-7e54-469e-bfcc-1805ed203b3f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:51:28.680989 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-59d4fd9e-7e54-469e-bfcc-1805ed203b3f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82" status: 200 len: 1396 microversion: 2.1 time: 0.608316 Oct 23 01:51:28.688745 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3392/6690] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:51:28 2022] GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82 => generated 1396 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:51:29.727215 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c1e7b4f4-e9fd-4421-99ca-9aaa15d715ba tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:51:29.729963 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c1e7b4f4-e9fd-4421-99ca-9aaa15d715ba tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:51:29.753611 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:51:29.762854 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c1e7b4f4-e9fd-4421-99ca-9aaa15d715ba tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:29.763978 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c1e7b4f4-e9fd-4421-99ca-9aaa15d715ba tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:29.764587 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c1e7b4f4-e9fd-4421-99ca-9aaa15d715ba tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:29.765565 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c1e7b4f4-e9fd-4421-99ca-9aaa15d715ba tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:29.766731 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c1e7b4f4-e9fd-4421-99ca-9aaa15d715ba tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:29.767454 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c1e7b4f4-e9fd-4421-99ca-9aaa15d715ba tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:30.433266 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c1e7b4f4-e9fd-4421-99ca-9aaa15d715ba tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:51:30.454031 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c1e7b4f4-e9fd-4421-99ca-9aaa15d715ba tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82" status: 200 len: 1396 microversion: 2.1 time: 0.737202 Oct 23 01:51:30.454923 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3299/6691] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:51:29 2022] GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82 => generated 1396 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:51:30.900336 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-5b0547ae-b058-42a6-8622-67452536e051 req-f9c4a33f-8329-412d-b7fe-82c66f59a8f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82", "name": "network-vif-deleted", "tag": "93647bf3-e2e0-4d84-abdd-39a00bab4ff9"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:51:30.916291 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-5b0547ae-b058-42a6-8622-67452536e051 req-f9c4a33f-8329-412d-b7fe-82c66f59a8f5 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:30.916775 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-5b0547ae-b058-42a6-8622-67452536e051 req-f9c4a33f-8329-412d-b7fe-82c66f59a8f5 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:30.917425 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-5b0547ae-b058-42a6-8622-67452536e051 req-f9c4a33f-8329-412d-b7fe-82c66f59a8f5 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:30.920564 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:51:30.931720 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-5b0547ae-b058-42a6-8622-67452536e051 req-f9c4a33f-8329-412d-b7fe-82c66f59a8f5 service nova] Creating event network-vif-deleted:93647bf3-e2e0-4d84-abdd-39a00bab4ff9 for instance 88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82 on n-h2-master-1 Oct 23 01:51:30.937155 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-5b0547ae-b058-42a6-8622-67452536e051 req-f9c4a33f-8329-412d-b7fe-82c66f59a8f5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040937 Oct 23 01:51:30.938444 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3393/6692] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:51:31.487839 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7662dd58-d7e0-4245-8164-7655510a73f6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:51:31.488510 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7662dd58-d7e0-4245-8164-7655510a73f6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:51:31.501373 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7662dd58-d7e0-4245-8164-7655510a73f6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:31.502365 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7662dd58-d7e0-4245-8164-7655510a73f6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:31.503577 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7662dd58-d7e0-4245-8164-7655510a73f6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:31.504550 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7662dd58-d7e0-4245-8164-7655510a73f6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:31.505435 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7662dd58-d7e0-4245-8164-7655510a73f6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:31.506223 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7662dd58-d7e0-4245-8164-7655510a73f6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:31.870305 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7662dd58-d7e0-4245-8164-7655510a73f6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:51:31.880023 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7662dd58-d7e0-4245-8164-7655510a73f6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82" status: 200 len: 1188 microversion: 2.1 time: 0.399289 Oct 23 01:51:31.893912 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3300/6693] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:51:31 2022] GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82 => generated 1188 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:51:32.921264 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d817fa33-775d-4ddc-9f59-08ec0024626f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:51:32.923233 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d817fa33-775d-4ddc-9f59-08ec0024626f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:51:32.952738 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d817fa33-775d-4ddc-9f59-08ec0024626f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:32.954644 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d817fa33-775d-4ddc-9f59-08ec0024626f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:32.961806 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d817fa33-775d-4ddc-9f59-08ec0024626f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:32.966722 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d817fa33-775d-4ddc-9f59-08ec0024626f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:32.988111 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d817fa33-775d-4ddc-9f59-08ec0024626f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:32.988683 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d817fa33-775d-4ddc-9f59-08ec0024626f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:33.453360 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d817fa33-775d-4ddc-9f59-08ec0024626f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:51:33.462377 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d817fa33-775d-4ddc-9f59-08ec0024626f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82" status: 200 len: 1188 microversion: 2.1 time: 0.558903 Oct 23 01:51:33.468919 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3394/6694] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:51:32 2022] GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82 => generated 1188 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:51:34.492034 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-15a218ab-7066-436a-8620-8d9a539ca594 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:51:34.493798 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-15a218ab-7066-436a-8620-8d9a539ca594 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:51:34.520087 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-15a218ab-7066-436a-8620-8d9a539ca594 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:34.534356 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-15a218ab-7066-436a-8620-8d9a539ca594 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:34.534891 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-15a218ab-7066-436a-8620-8d9a539ca594 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:34.540085 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-15a218ab-7066-436a-8620-8d9a539ca594 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:34.543608 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-15a218ab-7066-436a-8620-8d9a539ca594 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:34.544324 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-15a218ab-7066-436a-8620-8d9a539ca594 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:34.782580 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-15a218ab-7066-436a-8620-8d9a539ca594 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:51:34.797920 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-15a218ab-7066-436a-8620-8d9a539ca594 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82" status: 200 len: 1188 microversion: 2.1 time: 0.305942 Oct 23 01:51:34.802523 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3301/6695] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:51:34 2022] GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82 => generated 1188 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:51:35.836416 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-30759b1e-d80c-41ba-b747-780fdda57fda tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:51:35.845794 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-30759b1e-d80c-41ba-b747-780fdda57fda tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:51:35.867753 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-30759b1e-d80c-41ba-b747-780fdda57fda tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:35.879686 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-30759b1e-d80c-41ba-b747-780fdda57fda tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:35.879686 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-30759b1e-d80c-41ba-b747-780fdda57fda tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:35.879965 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-30759b1e-d80c-41ba-b747-780fdda57fda tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:35.880558 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-30759b1e-d80c-41ba-b747-780fdda57fda tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:35.881002 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-30759b1e-d80c-41ba-b747-780fdda57fda tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:36.101641 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-30759b1e-d80c-41ba-b747-780fdda57fda tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:51:36.114870 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-30759b1e-d80c-41ba-b747-780fdda57fda tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82" status: 200 len: 1188 microversion: 2.1 time: 0.297698 Oct 23 01:51:36.117867 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3395/6696] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:51:35 2022] GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82 => generated 1188 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:51:36.642569 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4b6909af-02c1-461a-a9c3-3a65dda15ad8 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:51:36.645088 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b6909af-02c1-461a-a9c3-3a65dda15ad8 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:36.645732 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b6909af-02c1-461a-a9c3-3a65dda15ad8 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:36.647556 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b6909af-02c1-461a-a9c3-3a65dda15ad8 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:36.652848 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b6909af-02c1-461a-a9c3-3a65dda15ad8 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:36.653762 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b6909af-02c1-461a-a9c3-3a65dda15ad8 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:36.657927 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b6909af-02c1-461a-a9c3-3a65dda15ad8 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:36.704285 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4b6909af-02c1-461a-a9c3-3a65dda15ad8 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] 10.222.0.42 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.275022 Oct 23 01:51:36.705117 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3302/6697] 10.222.0.42 () {58 vars in 1185 bytes} [Sun Oct 23 01:51:36 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:51:36.900774 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c8074568-e7cf-411d-b664-99f8a30bf8e7 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1367327335", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "availability_zone": "nova:n-h2-master-1", "networks": [{"uuid": "65bcaac9-b8f7-4974-928a-b1624ea731a7"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:51:37.019674 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-c8074568-e7cf-411d-b664-99f8a30bf8e7 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] validate_networks() for [('65bcaac9-b8f7-4974-928a-b1624ea731a7', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:51:37.139274 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a187e9d4-f9af-49b9-8cda-3987e11dcd51 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:51:37.139915 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a187e9d4-f9af-49b9-8cda-3987e11dcd51 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:51:37.149529 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a187e9d4-f9af-49b9-8cda-3987e11dcd51 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:37.150444 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a187e9d4-f9af-49b9-8cda-3987e11dcd51 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:37.150906 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a187e9d4-f9af-49b9-8cda-3987e11dcd51 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:37.151616 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a187e9d4-f9af-49b9-8cda-3987e11dcd51 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:37.152073 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a187e9d4-f9af-49b9-8cda-3987e11dcd51 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:37.152498 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a187e9d4-f9af-49b9-8cda-3987e11dcd51 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:37.333649 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a187e9d4-f9af-49b9-8cda-3987e11dcd51 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:51:37.349440 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a187e9d4-f9af-49b9-8cda-3987e11dcd51 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82" status: 200 len: 1188 microversion: 2.1 time: 0.214975 Oct 23 01:51:37.363097 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3303/6698] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:51:37 2022] GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82 => generated 1188 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:51:38.030558 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-c8074568-e7cf-411d-b664-99f8a30bf8e7 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:51:38.031136 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-c8074568-e7cf-411d-b664-99f8a30bf8e7 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:51:38.031695 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-c8074568-e7cf-411d-b664-99f8a30bf8e7 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:51:38.032112 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-c8074568-e7cf-411d-b664-99f8a30bf8e7 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:51:38.036157 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-c8074568-e7cf-411d-b664-99f8a30bf8e7 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:51:38.055827 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c8074568-e7cf-411d-b664-99f8a30bf8e7 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:38.056332 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c8074568-e7cf-411d-b664-99f8a30bf8e7 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:38.056788 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c8074568-e7cf-411d-b664-99f8a30bf8e7 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:38.064740 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c8074568-e7cf-411d-b664-99f8a30bf8e7 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:38.065269 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c8074568-e7cf-411d-b664-99f8a30bf8e7 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:38.065697 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c8074568-e7cf-411d-b664-99f8a30bf8e7 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:38.123647 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-c8074568-e7cf-411d-b664-99f8a30bf8e7 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Getting quotas for project 333acdf852374aa4a4c5e1c299274ddb. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:51:38.136641 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-c8074568-e7cf-411d-b664-99f8a30bf8e7 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Getting quotas for user c554eff49e424172b1f23f6791a72ce8 and project 333acdf852374aa4a4c5e1c299274ddb. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:51:38.157423 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c8074568-e7cf-411d-b664-99f8a30bf8e7 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:51:38.161404 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c8074568-e7cf-411d-b664-99f8a30bf8e7 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] [instance: 784f7097-464b-4210-aedb-8bc3bc48cc59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:51:38.376309 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-be69b05d-58cf-4b64-8b61-bd3781a44447 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:51:38.377830 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-be69b05d-58cf-4b64-8b61-bd3781a44447 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:51:38.380553 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c8074568-e7cf-411d-b664-99f8a30bf8e7 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.483556 Oct 23 01:51:38.382975 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3396/6699] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:51:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1487 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:51:38.391329 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-be69b05d-58cf-4b64-8b61-bd3781a44447 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:38.392409 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-be69b05d-58cf-4b64-8b61-bd3781a44447 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:38.394344 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-be69b05d-58cf-4b64-8b61-bd3781a44447 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:38.394491 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-55cd1b44-f1b8-4e1f-abbb-c66b64094096 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:51:38.395082 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-55cd1b44-f1b8-4e1f-abbb-c66b64094096 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] [instance: 784f7097-464b-4210-aedb-8bc3bc48cc59] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:51:38.411131 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-be69b05d-58cf-4b64-8b61-bd3781a44447 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:38.414371 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-be69b05d-58cf-4b64-8b61-bd3781a44447 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:38.415707 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-be69b05d-58cf-4b64-8b61-bd3781a44447 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:39.184354 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-55cd1b44-f1b8-4e1f-abbb-c66b64094096 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/784f7097-464b-4210-aedb-8bc3bc48cc59" status: 200 len: 1329 microversion: 2.1 time: 0.794008 Oct 23 01:51:39.198351 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3397/6700] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:51:38 2022] GET /compute/v2.1/servers/784f7097-464b-4210-aedb-8bc3bc48cc59 => generated 1329 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:51:39.222982 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-be69b05d-58cf-4b64-8b61-bd3781a44447 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:51:39.239666 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-be69b05d-58cf-4b64-8b61-bd3781a44447 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82" status: 200 len: 1188 microversion: 2.1 time: 0.867723 Oct 23 01:51:39.247894 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3304/6701] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:51:38 2022] GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82 => generated 1188 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:51:40.209792 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e0003ab6-f31f-4fe6-9308-aecfe6015d88 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:51:40.210727 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e0003ab6-f31f-4fe6-9308-aecfe6015d88 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] [instance: 784f7097-464b-4210-aedb-8bc3bc48cc59] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:51:40.274639 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-86b8e926-7414-4e45-a517-442c763fcffc tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:51:40.276259 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-86b8e926-7414-4e45-a517-442c763fcffc tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:51:40.292634 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-86b8e926-7414-4e45-a517-442c763fcffc tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:40.292634 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-86b8e926-7414-4e45-a517-442c763fcffc tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:40.294402 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-86b8e926-7414-4e45-a517-442c763fcffc tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:40.297714 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-86b8e926-7414-4e45-a517-442c763fcffc tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:40.298456 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-86b8e926-7414-4e45-a517-442c763fcffc tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:40.298981 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-86b8e926-7414-4e45-a517-442c763fcffc tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:40.405084 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-86b8e926-7414-4e45-a517-442c763fcffc tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:40.405745 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-86b8e926-7414-4e45-a517-442c763fcffc tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:40.408271 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-86b8e926-7414-4e45-a517-442c763fcffc tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:40.410108 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-86b8e926-7414-4e45-a517-442c763fcffc tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lazy-loading 'fault' on Instance uuid 88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:51:40.450518 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e0003ab6-f31f-4fe6-9308-aecfe6015d88 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/784f7097-464b-4210-aedb-8bc3bc48cc59" status: 200 len: 1329 microversion: 2.1 time: 0.244535 Oct 23 01:51:40.456059 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3398/6702] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:51:40 2022] GET /compute/v2.1/servers/784f7097-464b-4210-aedb-8bc3bc48cc59 => generated 1329 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:51:40.522546 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-86b8e926-7414-4e45-a517-442c763fcffc tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:51:40.532573 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-86b8e926-7414-4e45-a517-442c763fcffc tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82" status: 200 len: 1193 microversion: 2.1 time: 0.261787 Oct 23 01:51:40.546015 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3305/6703] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:51:40 2022] GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82 => generated 1193 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:51:41.476669 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9072887e-9646-4c7d-9ee8-8f2fa26260b4 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:51:41.477954 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9072887e-9646-4c7d-9ee8-8f2fa26260b4 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] [instance: 784f7097-464b-4210-aedb-8bc3bc48cc59] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:51:41.492795 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9072887e-9646-4c7d-9ee8-8f2fa26260b4 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:41.493304 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9072887e-9646-4c7d-9ee8-8f2fa26260b4 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:41.493751 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9072887e-9646-4c7d-9ee8-8f2fa26260b4 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:41.494513 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9072887e-9646-4c7d-9ee8-8f2fa26260b4 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:41.494985 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9072887e-9646-4c7d-9ee8-8f2fa26260b4 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:41.495422 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9072887e-9646-4c7d-9ee8-8f2fa26260b4 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:41.556845 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b07c75b6-4b68-49a1-bbba-a6ef21e896f0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:51:41.557590 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b07c75b6-4b68-49a1-bbba-a6ef21e896f0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:51:41.568605 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b07c75b6-4b68-49a1-bbba-a6ef21e896f0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:41.570648 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b07c75b6-4b68-49a1-bbba-a6ef21e896f0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:41.574147 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b07c75b6-4b68-49a1-bbba-a6ef21e896f0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:41.576646 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b07c75b6-4b68-49a1-bbba-a6ef21e896f0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:41.576646 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b07c75b6-4b68-49a1-bbba-a6ef21e896f0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:41.576646 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b07c75b6-4b68-49a1-bbba-a6ef21e896f0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:41.587267 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9072887e-9646-4c7d-9ee8-8f2fa26260b4 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/784f7097-464b-4210-aedb-8bc3bc48cc59" status: 200 len: 1416 microversion: 2.1 time: 0.114290 Oct 23 01:51:41.588191 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3399/6704] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:51:41 2022] GET /compute/v2.1/servers/784f7097-464b-4210-aedb-8bc3bc48cc59 => generated 1416 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:51:41.620012 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-b07c75b6-4b68-49a1-bbba-a6ef21e896f0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] HTTP exception thrown: Instance 88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82 could not be found. Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b07c75b6-4b68-49a1-bbba-a6ef21e896f0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Request method failure captured: Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82 HTTP/1.1 Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJ238gvy9Iqj-gh_hYMMA3k82GIwOXmge1ZpdCVbStgEi7Wx0Hp0nUD39OZgeTVVZUzzMU6rbj6VKVMThBnKMFJkrT_c4TpJItwEaxJM150Q197EeZTFOgQpHEVnJj9TzM6T9aiiAWqKRliV_RYi1MvsQfVRPMVtUboRY7WK1bO1DBQ Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: b1ec0b5ecaa741eaaf40a50f1415e7f9 Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-TestVolumeBootPattern-219047212 Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}] Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-TestVolumeBootPattern-219047212 Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: b1ec0b5ecaa741eaaf40a50f1415e7f9 Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-TestVolumeBootPattern-219047212 Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-TestVolumeBootPattern-219047212-project Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: f2967d0d8c134d269c9bbe51c90f803a Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-TestVolumeBootPattern-219047212-project Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82 could not be found. Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82'} Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82 could not be found. Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82 could not be found. Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:51:41.622482 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:51:41.628103 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:51:41.628103 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:51:41.628103 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:51:41.628103 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:51:41.628103 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:51:41.628103 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82 could not be found. Oct 23 01:51:41.628103 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:51:41.628103 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b07c75b6-4b68-49a1-bbba-a6ef21e896f0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Returning 404 to user: Instance 88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:51:41.628103 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b07c75b6-4b68-49a1-bbba-a6ef21e896f0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82" status: 404 len: 111 microversion: 2.1 time: 0.072153 Oct 23 01:51:41.629500 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3306/6705] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:51:41 2022] GET /compute/v2.1/servers/88b0dbe6-09ae-40cb-a87b-92c6f5f7ec82 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:51:42.611814 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a33b6fe6-36c2-4083-98b7-7cc3e28840f6 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:51:42.613273 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a33b6fe6-36c2-4083-98b7-7cc3e28840f6 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] [instance: 784f7097-464b-4210-aedb-8bc3bc48cc59] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:51:42.627903 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a33b6fe6-36c2-4083-98b7-7cc3e28840f6 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:42.631893 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a33b6fe6-36c2-4083-98b7-7cc3e28840f6 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:42.632570 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a33b6fe6-36c2-4083-98b7-7cc3e28840f6 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:42.633580 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a33b6fe6-36c2-4083-98b7-7cc3e28840f6 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:42.634251 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a33b6fe6-36c2-4083-98b7-7cc3e28840f6 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:42.636282 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a33b6fe6-36c2-4083-98b7-7cc3e28840f6 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:42.863891 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a33b6fe6-36c2-4083-98b7-7cc3e28840f6 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/784f7097-464b-4210-aedb-8bc3bc48cc59" status: 200 len: 1434 microversion: 2.1 time: 0.254823 Oct 23 01:51:42.869166 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3400/6706] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:51:42 2022] GET /compute/v2.1/servers/784f7097-464b-4210-aedb-8bc3bc48cc59 => generated 1434 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:51:43.895365 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-776a0b2c-d935-4f6c-bcee-22ed069fb911 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:51:43.896303 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-776a0b2c-d935-4f6c-bcee-22ed069fb911 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] [instance: 784f7097-464b-4210-aedb-8bc3bc48cc59] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:51:43.912140 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-776a0b2c-d935-4f6c-bcee-22ed069fb911 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:43.912140 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-776a0b2c-d935-4f6c-bcee-22ed069fb911 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:43.912140 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-776a0b2c-d935-4f6c-bcee-22ed069fb911 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:43.912140 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-776a0b2c-d935-4f6c-bcee-22ed069fb911 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:43.912140 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-776a0b2c-d935-4f6c-bcee-22ed069fb911 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:43.912140 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-776a0b2c-d935-4f6c-bcee-22ed069fb911 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:44.359192 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-776a0b2c-d935-4f6c-bcee-22ed069fb911 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/784f7097-464b-4210-aedb-8bc3bc48cc59" status: 200 len: 1464 microversion: 2.1 time: 0.464794 Oct 23 01:51:44.361409 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3307/6707] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:51:43 2022] GET /compute/v2.1/servers/784f7097-464b-4210-aedb-8bc3bc48cc59 => generated 1464 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:51:45.386461 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-859822a3-14ef-41b5-bb6a-b7621861bfda tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:51:45.387257 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-859822a3-14ef-41b5-bb6a-b7621861bfda tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] [instance: 784f7097-464b-4210-aedb-8bc3bc48cc59] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:51:45.397558 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-859822a3-14ef-41b5-bb6a-b7621861bfda tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:45.401794 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-859822a3-14ef-41b5-bb6a-b7621861bfda tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:45.402338 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-859822a3-14ef-41b5-bb6a-b7621861bfda tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:45.403161 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-859822a3-14ef-41b5-bb6a-b7621861bfda tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:45.405962 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-859822a3-14ef-41b5-bb6a-b7621861bfda tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:45.406450 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-859822a3-14ef-41b5-bb6a-b7621861bfda tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:45.667424 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-859822a3-14ef-41b5-bb6a-b7621861bfda tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/784f7097-464b-4210-aedb-8bc3bc48cc59" status: 200 len: 1464 microversion: 2.1 time: 0.284962 Oct 23 01:51:45.668395 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3401/6708] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:51:45 2022] GET /compute/v2.1/servers/784f7097-464b-4210-aedb-8bc3bc48cc59 => generated 1464 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:51:45.808607 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-b40314db-e8cc-41be-b44e-b2f7ba6daf2d req-20c48786-1f2e-435f-a97d-a6bf7631bdfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "784f7097-464b-4210-aedb-8bc3bc48cc59", "tag": "04dadb27-cfe6-46d5-8bd0-1b4805a7d692"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:51:45.829325 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-b40314db-e8cc-41be-b44e-b2f7ba6daf2d req-20c48786-1f2e-435f-a97d-a6bf7631bdfb service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:45.831187 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-b40314db-e8cc-41be-b44e-b2f7ba6daf2d req-20c48786-1f2e-435f-a97d-a6bf7631bdfb service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:45.833088 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-b40314db-e8cc-41be-b44e-b2f7ba6daf2d req-20c48786-1f2e-435f-a97d-a6bf7631bdfb service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:45.844936 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-b40314db-e8cc-41be-b44e-b2f7ba6daf2d req-20c48786-1f2e-435f-a97d-a6bf7631bdfb service nova] Creating event network-changed:04dadb27-cfe6-46d5-8bd0-1b4805a7d692 for instance 784f7097-464b-4210-aedb-8bc3bc48cc59 on n-h2-master-1 Oct 23 01:51:45.850670 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-b40314db-e8cc-41be-b44e-b2f7ba6daf2d req-20c48786-1f2e-435f-a97d-a6bf7631bdfb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046601 Oct 23 01:51:45.851864 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3308/6709] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:51:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:51:46.693201 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-235649ed-e81a-46a5-b431-dda985b131a2 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:51:46.693921 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-235649ed-e81a-46a5-b431-dda985b131a2 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] [instance: 784f7097-464b-4210-aedb-8bc3bc48cc59] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:51:46.711937 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-235649ed-e81a-46a5-b431-dda985b131a2 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:46.712447 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-235649ed-e81a-46a5-b431-dda985b131a2 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:46.712898 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-235649ed-e81a-46a5-b431-dda985b131a2 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:46.713628 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-235649ed-e81a-46a5-b431-dda985b131a2 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:46.714121 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-235649ed-e81a-46a5-b431-dda985b131a2 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:46.714612 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-235649ed-e81a-46a5-b431-dda985b131a2 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:47.071579 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-235649ed-e81a-46a5-b431-dda985b131a2 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/784f7097-464b-4210-aedb-8bc3bc48cc59" status: 200 len: 1464 microversion: 2.1 time: 0.380880 Oct 23 01:51:47.101783 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3402/6710] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:51:46 2022] GET /compute/v2.1/servers/784f7097-464b-4210-aedb-8bc3bc48cc59 => generated 1464 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:51:48.104385 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:51:48.110232 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6606e5d0-097f-487b-a86a-ac5e75a4710b tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:51:48.111340 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6606e5d0-097f-487b-a86a-ac5e75a4710b tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] [instance: 784f7097-464b-4210-aedb-8bc3bc48cc59] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:51:48.154708 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6606e5d0-097f-487b-a86a-ac5e75a4710b tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:48.155207 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6606e5d0-097f-487b-a86a-ac5e75a4710b tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:48.155652 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6606e5d0-097f-487b-a86a-ac5e75a4710b tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:48.156408 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6606e5d0-097f-487b-a86a-ac5e75a4710b tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:48.157359 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6606e5d0-097f-487b-a86a-ac5e75a4710b tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:48.170161 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6606e5d0-097f-487b-a86a-ac5e75a4710b tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:48.506678 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6606e5d0-097f-487b-a86a-ac5e75a4710b tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/784f7097-464b-4210-aedb-8bc3bc48cc59" status: 200 len: 1464 microversion: 2.1 time: 0.403081 Oct 23 01:51:48.509817 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3309/6711] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:51:48 2022] GET /compute/v2.1/servers/784f7097-464b-4210-aedb-8bc3bc48cc59 => generated 1464 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:51:49.532997 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0771ae00-173b-4354-bfb1-5a21a7f3ac67 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:51:49.539967 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0771ae00-173b-4354-bfb1-5a21a7f3ac67 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] [instance: 784f7097-464b-4210-aedb-8bc3bc48cc59] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:51:49.544543 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:51:49.557580 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0771ae00-173b-4354-bfb1-5a21a7f3ac67 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:49.558260 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0771ae00-173b-4354-bfb1-5a21a7f3ac67 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:49.558710 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0771ae00-173b-4354-bfb1-5a21a7f3ac67 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:49.559428 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0771ae00-173b-4354-bfb1-5a21a7f3ac67 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:49.559890 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0771ae00-173b-4354-bfb1-5a21a7f3ac67 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:49.560320 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0771ae00-173b-4354-bfb1-5a21a7f3ac67 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:49.796202 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0771ae00-173b-4354-bfb1-5a21a7f3ac67 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/784f7097-464b-4210-aedb-8bc3bc48cc59" status: 200 len: 1464 microversion: 2.1 time: 0.267148 Oct 23 01:51:49.815187 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3403/6712] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:51:49 2022] GET /compute/v2.1/servers/784f7097-464b-4210-aedb-8bc3bc48cc59 => generated 1464 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:51:50.824141 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0eba0009-59b9-43b3-a5c2-0d55dd717ffe tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:51:50.825776 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0eba0009-59b9-43b3-a5c2-0d55dd717ffe tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] [instance: 784f7097-464b-4210-aedb-8bc3bc48cc59] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:51:50.840063 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0eba0009-59b9-43b3-a5c2-0d55dd717ffe tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:50.842058 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0eba0009-59b9-43b3-a5c2-0d55dd717ffe tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:50.844438 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0eba0009-59b9-43b3-a5c2-0d55dd717ffe tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:50.845423 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0eba0009-59b9-43b3-a5c2-0d55dd717ffe tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:50.846223 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0eba0009-59b9-43b3-a5c2-0d55dd717ffe tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:50.847253 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0eba0009-59b9-43b3-a5c2-0d55dd717ffe tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:51.172692 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0eba0009-59b9-43b3-a5c2-0d55dd717ffe tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/784f7097-464b-4210-aedb-8bc3bc48cc59" status: 200 len: 1464 microversion: 2.1 time: 0.352823 Oct 23 01:51:51.174339 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3310/6713] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:51:50 2022] GET /compute/v2.1/servers/784f7097-464b-4210-aedb-8bc3bc48cc59 => generated 1464 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:51:52.203819 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-337f555f-670c-4f68-a960-34129f9035ad tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:51:52.205593 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-337f555f-670c-4f68-a960-34129f9035ad tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] [instance: 784f7097-464b-4210-aedb-8bc3bc48cc59] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:51:52.219466 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=10 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:51:52.228167 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-337f555f-670c-4f68-a960-34129f9035ad tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:52.229735 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-337f555f-670c-4f68-a960-34129f9035ad tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:52.230234 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-337f555f-670c-4f68-a960-34129f9035ad tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:52.239744 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-337f555f-670c-4f68-a960-34129f9035ad tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:52.240608 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-337f555f-670c-4f68-a960-34129f9035ad tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:52.241712 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-337f555f-670c-4f68-a960-34129f9035ad tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:52.622715 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-337f555f-670c-4f68-a960-34129f9035ad tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/784f7097-464b-4210-aedb-8bc3bc48cc59" status: 200 len: 1464 microversion: 2.1 time: 0.427174 Oct 23 01:51:52.640412 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3404/6714] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:51:52 2022] GET /compute/v2.1/servers/784f7097-464b-4210-aedb-8bc3bc48cc59 => generated 1464 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:51:53.029535 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-c70eeda2-5d25-494a-aa9c-eb2658508056 req-ac6917c4-c257-4eb6-80e6-671c3486c9a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "784f7097-464b-4210-aedb-8bc3bc48cc59", "name": "network-vif-plugged", "status": "completed", "tag": "04dadb27-cfe6-46d5-8bd0-1b4805a7d692"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:51:53.052516 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-c70eeda2-5d25-494a-aa9c-eb2658508056 req-ac6917c4-c257-4eb6-80e6-671c3486c9a6 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:53.054597 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-c70eeda2-5d25-494a-aa9c-eb2658508056 req-ac6917c4-c257-4eb6-80e6-671c3486c9a6 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:53.055077 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-c70eeda2-5d25-494a-aa9c-eb2658508056 req-ac6917c4-c257-4eb6-80e6-671c3486c9a6 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:53.095855 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-c70eeda2-5d25-494a-aa9c-eb2658508056 req-ac6917c4-c257-4eb6-80e6-671c3486c9a6 service nova] Creating event network-vif-plugged:04dadb27-cfe6-46d5-8bd0-1b4805a7d692 for instance 784f7097-464b-4210-aedb-8bc3bc48cc59 on n-h2-master-1 Oct 23 01:51:53.101397 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-c70eeda2-5d25-494a-aa9c-eb2658508056 req-ac6917c4-c257-4eb6-80e6-671c3486c9a6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075584 Oct 23 01:51:53.102044 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3311/6715] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:51:53.657638 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7601653f-773e-49e0-a116-3bd295d72def tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:51:53.658306 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7601653f-773e-49e0-a116-3bd295d72def tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] [instance: 784f7097-464b-4210-aedb-8bc3bc48cc59] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:51:53.671236 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7601653f-773e-49e0-a116-3bd295d72def tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:53.674191 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7601653f-773e-49e0-a116-3bd295d72def tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:53.675032 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7601653f-773e-49e0-a116-3bd295d72def tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:53.676265 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7601653f-773e-49e0-a116-3bd295d72def tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:53.682290 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7601653f-773e-49e0-a116-3bd295d72def tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:53.682813 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7601653f-773e-49e0-a116-3bd295d72def tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:53.886897 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7601653f-773e-49e0-a116-3bd295d72def tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/784f7097-464b-4210-aedb-8bc3bc48cc59" status: 200 len: 1464 microversion: 2.1 time: 0.242286 Oct 23 01:51:53.898026 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3405/6716] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:51:53 2022] GET /compute/v2.1/servers/784f7097-464b-4210-aedb-8bc3bc48cc59 => generated 1464 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:51:54.911236 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b9cb867d-ecc6-4ef7-bd4a-56dd9da025c6 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:51:54.912634 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b9cb867d-ecc6-4ef7-bd4a-56dd9da025c6 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] [instance: 784f7097-464b-4210-aedb-8bc3bc48cc59] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:51:54.920512 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9cb867d-ecc6-4ef7-bd4a-56dd9da025c6 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:54.921488 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9cb867d-ecc6-4ef7-bd4a-56dd9da025c6 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:54.922650 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9cb867d-ecc6-4ef7-bd4a-56dd9da025c6 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:54.923811 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9cb867d-ecc6-4ef7-bd4a-56dd9da025c6 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:54.924463 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9cb867d-ecc6-4ef7-bd4a-56dd9da025c6 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:54.925047 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9cb867d-ecc6-4ef7-bd4a-56dd9da025c6 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:55.089315 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b9cb867d-ecc6-4ef7-bd4a-56dd9da025c6 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/784f7097-464b-4210-aedb-8bc3bc48cc59" status: 200 len: 1464 microversion: 2.1 time: 0.182231 Oct 23 01:51:55.090256 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3312/6717] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:51:54 2022] GET /compute/v2.1/servers/784f7097-464b-4210-aedb-8bc3bc48cc59 => generated 1464 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:51:56.117171 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-85177ca4-0acf-43f9-9171-939e496832ef tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:51:56.117804 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-85177ca4-0acf-43f9-9171-939e496832ef tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] [instance: 784f7097-464b-4210-aedb-8bc3bc48cc59] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:51:56.121654 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:51:56.142204 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-85177ca4-0acf-43f9-9171-939e496832ef tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:56.143148 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-85177ca4-0acf-43f9-9171-939e496832ef tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:56.143890 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-85177ca4-0acf-43f9-9171-939e496832ef tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:56.145042 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-85177ca4-0acf-43f9-9171-939e496832ef tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:56.145677 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-85177ca4-0acf-43f9-9171-939e496832ef tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:56.146313 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-85177ca4-0acf-43f9-9171-939e496832ef tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:56.459910 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-85177ca4-0acf-43f9-9171-939e496832ef tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/784f7097-464b-4210-aedb-8bc3bc48cc59" status: 200 len: 1648 microversion: 2.1 time: 0.346002 Oct 23 01:51:56.459910 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3406/6718] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:51:56 2022] GET /compute/v2.1/servers/784f7097-464b-4210-aedb-8bc3bc48cc59 => generated 1648 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:51:56.494848 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a5d102b1-f6a3-40ce-9130-6e8fb34bc9eb tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:51:56.495757 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a5d102b1-f6a3-40ce-9130-6e8fb34bc9eb tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] [instance: 784f7097-464b-4210-aedb-8bc3bc48cc59] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:51:56.509714 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a5d102b1-f6a3-40ce-9130-6e8fb34bc9eb tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:56.510242 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a5d102b1-f6a3-40ce-9130-6e8fb34bc9eb tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:56.510703 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a5d102b1-f6a3-40ce-9130-6e8fb34bc9eb tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:56.511409 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a5d102b1-f6a3-40ce-9130-6e8fb34bc9eb tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:56.512207 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a5d102b1-f6a3-40ce-9130-6e8fb34bc9eb tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:56.512658 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a5d102b1-f6a3-40ce-9130-6e8fb34bc9eb tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:56.808746 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a5d102b1-f6a3-40ce-9130-6e8fb34bc9eb tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/784f7097-464b-4210-aedb-8bc3bc48cc59" status: 200 len: 1648 microversion: 2.1 time: 0.329894 Oct 23 01:51:56.814422 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3313/6719] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:51:56 2022] GET /compute/v2.1/servers/784f7097-464b-4210-aedb-8bc3bc48cc59 => generated 1648 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:51:56.836106 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-794b6ccd-ceea-4b44-991e-d48efacf9001 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:51:56.836924 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-794b6ccd-ceea-4b44-991e-d48efacf9001 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] [instance: 784f7097-464b-4210-aedb-8bc3bc48cc59] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:51:56.843634 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-794b6ccd-ceea-4b44-991e-d48efacf9001 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:56.845002 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-794b6ccd-ceea-4b44-991e-d48efacf9001 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:56.845644 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-794b6ccd-ceea-4b44-991e-d48efacf9001 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:56.846796 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-794b6ccd-ceea-4b44-991e-d48efacf9001 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:56.847452 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-794b6ccd-ceea-4b44-991e-d48efacf9001 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:56.848936 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-794b6ccd-ceea-4b44-991e-d48efacf9001 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:57.214163 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-794b6ccd-ceea-4b44-991e-d48efacf9001 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/784f7097-464b-4210-aedb-8bc3bc48cc59" status: 200 len: 1648 microversion: 2.1 time: 0.381537 Oct 23 01:51:57.241815 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3407/6720] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:51:56 2022] GET /compute/v2.1/servers/784f7097-464b-4210-aedb-8bc3bc48cc59 => generated 1648 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:51:57.291389 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b2914d99-02da-4ffa-bee8-cad4e54bf8da tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1990270609", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "availability_zone": "nova:n-h1-master-1", "networks": [{"uuid": "65bcaac9-b8f7-4974-928a-b1624ea731a7"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:51:57.363237 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-b2914d99-02da-4ffa-bee8-cad4e54bf8da tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] validate_networks() for [('65bcaac9-b8f7-4974-928a-b1624ea731a7', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:51:57.937706 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-b2914d99-02da-4ffa-bee8-cad4e54bf8da tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:51:57.938812 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-b2914d99-02da-4ffa-bee8-cad4e54bf8da tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:51:57.941077 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-b2914d99-02da-4ffa-bee8-cad4e54bf8da tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:51:57.941077 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-b2914d99-02da-4ffa-bee8-cad4e54bf8da tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:51:57.941077 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-b2914d99-02da-4ffa-bee8-cad4e54bf8da tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:51:57.975458 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b2914d99-02da-4ffa-bee8-cad4e54bf8da tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:57.975642 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b2914d99-02da-4ffa-bee8-cad4e54bf8da tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:57.976138 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b2914d99-02da-4ffa-bee8-cad4e54bf8da tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:57.976807 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b2914d99-02da-4ffa-bee8-cad4e54bf8da tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:51:57.977267 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b2914d99-02da-4ffa-bee8-cad4e54bf8da tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:51:57.977692 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b2914d99-02da-4ffa-bee8-cad4e54bf8da tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:51:57.996511 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:51:58.027430 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-b2914d99-02da-4ffa-bee8-cad4e54bf8da tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Getting quotas for project 333acdf852374aa4a4c5e1c299274ddb. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:51:58.043688 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-b2914d99-02da-4ffa-bee8-cad4e54bf8da tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Getting quotas for user c554eff49e424172b1f23f6791a72ce8 and project 333acdf852374aa4a4c5e1c299274ddb. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:51:58.083089 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b2914d99-02da-4ffa-bee8-cad4e54bf8da tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:51:58.096200 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b2914d99-02da-4ffa-bee8-cad4e54bf8da tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] [instance: 5bff8d56-37b2-40aa-971c-7f1b032d1188] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:51:58.347515 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b2914d99-02da-4ffa-bee8-cad4e54bf8da tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.055991 Oct 23 01:51:58.348489 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3314/6721] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:51:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1062 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:51:58.362045 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fe05b382-ef4a-4700-8d53-6a4c11b98f28 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:51:58.365170 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fe05b382-ef4a-4700-8d53-6a4c11b98f28 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] [instance: 5bff8d56-37b2-40aa-971c-7f1b032d1188] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:51:58.512709 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fe05b382-ef4a-4700-8d53-6a4c11b98f28 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5bff8d56-37b2-40aa-971c-7f1b032d1188" status: 200 len: 1329 microversion: 2.1 time: 0.155402 Oct 23 01:51:58.513931 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3408/6722] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:51:58 2022] GET /compute/v2.1/servers/5bff8d56-37b2-40aa-971c-7f1b032d1188 => generated 1329 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:51:59.545628 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d344a0be-b3f9-45c1-96da-161d858508ac tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:51:59.553297 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d344a0be-b3f9-45c1-96da-161d858508ac tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] [instance: 5bff8d56-37b2-40aa-971c-7f1b032d1188] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:51:59.664224 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d344a0be-b3f9-45c1-96da-161d858508ac tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5bff8d56-37b2-40aa-971c-7f1b032d1188" status: 200 len: 1329 microversion: 2.1 time: 0.122182 Oct 23 01:51:59.666778 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3315/6723] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:51:59 2022] GET /compute/v2.1/servers/5bff8d56-37b2-40aa-971c-7f1b032d1188 => generated 1329 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:52:00.701601 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7e823293-7ed1-4003-acaf-07ab8cf35b0e tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:52:00.706236 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7e823293-7ed1-4003-acaf-07ab8cf35b0e tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] [instance: 5bff8d56-37b2-40aa-971c-7f1b032d1188] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:52:00.725485 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e823293-7ed1-4003-acaf-07ab8cf35b0e tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:00.728751 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e823293-7ed1-4003-acaf-07ab8cf35b0e tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:00.729341 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e823293-7ed1-4003-acaf-07ab8cf35b0e tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:00.730168 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e823293-7ed1-4003-acaf-07ab8cf35b0e tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:00.730637 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e823293-7ed1-4003-acaf-07ab8cf35b0e tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:00.731072 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e823293-7ed1-4003-acaf-07ab8cf35b0e tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:00.814664 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7e823293-7ed1-4003-acaf-07ab8cf35b0e tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5bff8d56-37b2-40aa-971c-7f1b032d1188" status: 200 len: 1416 microversion: 2.1 time: 0.129326 Oct 23 01:52:00.835123 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3409/6724] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:52:00 2022] GET /compute/v2.1/servers/5bff8d56-37b2-40aa-971c-7f1b032d1188 => generated 1416 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:52:01.839544 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-59fbf7b6-cde6-45c4-a555-a5dcc8cd0817 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:52:01.840182 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-59fbf7b6-cde6-45c4-a555-a5dcc8cd0817 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] [instance: 5bff8d56-37b2-40aa-971c-7f1b032d1188] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:52:01.850214 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:52:01.858724 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-59fbf7b6-cde6-45c4-a555-a5dcc8cd0817 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:01.866954 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-59fbf7b6-cde6-45c4-a555-a5dcc8cd0817 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:01.866954 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-59fbf7b6-cde6-45c4-a555-a5dcc8cd0817 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:01.866954 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-59fbf7b6-cde6-45c4-a555-a5dcc8cd0817 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:01.866954 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-59fbf7b6-cde6-45c4-a555-a5dcc8cd0817 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:01.866954 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-59fbf7b6-cde6-45c4-a555-a5dcc8cd0817 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:02.353137 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-59fbf7b6-cde6-45c4-a555-a5dcc8cd0817 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5bff8d56-37b2-40aa-971c-7f1b032d1188" status: 200 len: 1424 microversion: 2.1 time: 0.518124 Oct 23 01:52:02.353734 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3316/6725] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:52:01 2022] GET /compute/v2.1/servers/5bff8d56-37b2-40aa-971c-7f1b032d1188 => generated 1424 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:52:03.380591 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0f461482-da06-4c7d-a9c0-0e504dc36c0f tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:52:03.381233 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0f461482-da06-4c7d-a9c0-0e504dc36c0f tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] [instance: 5bff8d56-37b2-40aa-971c-7f1b032d1188] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:52:03.390968 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0f461482-da06-4c7d-a9c0-0e504dc36c0f tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:03.391473 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0f461482-da06-4c7d-a9c0-0e504dc36c0f tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:03.392140 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0f461482-da06-4c7d-a9c0-0e504dc36c0f tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:03.393022 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0f461482-da06-4c7d-a9c0-0e504dc36c0f tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:03.393667 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0f461482-da06-4c7d-a9c0-0e504dc36c0f tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:03.394295 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0f461482-da06-4c7d-a9c0-0e504dc36c0f tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:03.399787 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=76 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:52:03.666352 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0f461482-da06-4c7d-a9c0-0e504dc36c0f tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5bff8d56-37b2-40aa-971c-7f1b032d1188" status: 200 len: 1464 microversion: 2.1 time: 0.289768 Oct 23 01:52:03.669294 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3410/6726] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:52:03 2022] GET /compute/v2.1/servers/5bff8d56-37b2-40aa-971c-7f1b032d1188 => generated 1464 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:52:04.632211 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-ca30ae2f-ecc6-403b-afb2-fda0d4bef2aa req-c0de0b93-0909-4d39-9441-69be2729727f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bff8d56-37b2-40aa-971c-7f1b032d1188", "tag": "694a4fc9-7957-480f-aa69-aa14c6884a98"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:52:04.645346 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ca30ae2f-ecc6-403b-afb2-fda0d4bef2aa req-c0de0b93-0909-4d39-9441-69be2729727f service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:04.646104 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ca30ae2f-ecc6-403b-afb2-fda0d4bef2aa req-c0de0b93-0909-4d39-9441-69be2729727f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:04.647344 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ca30ae2f-ecc6-403b-afb2-fda0d4bef2aa req-c0de0b93-0909-4d39-9441-69be2729727f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:04.665558 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-ca30ae2f-ecc6-403b-afb2-fda0d4bef2aa req-c0de0b93-0909-4d39-9441-69be2729727f service nova] Creating event network-changed:694a4fc9-7957-480f-aa69-aa14c6884a98 for instance 5bff8d56-37b2-40aa-971c-7f1b032d1188 on n-h1-master-1 Oct 23 01:52:04.675470 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-ca30ae2f-ecc6-403b-afb2-fda0d4bef2aa req-c0de0b93-0909-4d39-9441-69be2729727f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051144 Oct 23 01:52:04.676767 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3317/6727] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:52:04.695293 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-04bc16ea-3558-473b-a0a5-71089bd7294e tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:52:04.696733 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-04bc16ea-3558-473b-a0a5-71089bd7294e tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] [instance: 5bff8d56-37b2-40aa-971c-7f1b032d1188] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:52:04.708601 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-04bc16ea-3558-473b-a0a5-71089bd7294e tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:04.709363 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-04bc16ea-3558-473b-a0a5-71089bd7294e tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:04.710189 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-04bc16ea-3558-473b-a0a5-71089bd7294e tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:04.711367 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-04bc16ea-3558-473b-a0a5-71089bd7294e tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:04.712118 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-04bc16ea-3558-473b-a0a5-71089bd7294e tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:04.712826 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-04bc16ea-3558-473b-a0a5-71089bd7294e tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:05.111219 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-04bc16ea-3558-473b-a0a5-71089bd7294e tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5bff8d56-37b2-40aa-971c-7f1b032d1188" status: 200 len: 1464 microversion: 2.1 time: 0.421471 Oct 23 01:52:05.126097 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3411/6728] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:52:04 2022] GET /compute/v2.1/servers/5bff8d56-37b2-40aa-971c-7f1b032d1188 => generated 1464 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:52:06.142774 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ebbc02ce-2652-4889-9da0-6c988feec4fa tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:52:06.145803 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ebbc02ce-2652-4889-9da0-6c988feec4fa tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] [instance: 5bff8d56-37b2-40aa-971c-7f1b032d1188] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:52:06.158599 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ebbc02ce-2652-4889-9da0-6c988feec4fa tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:06.163870 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ebbc02ce-2652-4889-9da0-6c988feec4fa tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:06.170200 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ebbc02ce-2652-4889-9da0-6c988feec4fa tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:06.170200 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ebbc02ce-2652-4889-9da0-6c988feec4fa tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:06.170200 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ebbc02ce-2652-4889-9da0-6c988feec4fa tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:06.170200 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ebbc02ce-2652-4889-9da0-6c988feec4fa tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:06.404487 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ebbc02ce-2652-4889-9da0-6c988feec4fa tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5bff8d56-37b2-40aa-971c-7f1b032d1188" status: 200 len: 1464 microversion: 2.1 time: 0.267283 Oct 23 01:52:06.407960 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3318/6729] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:52:06 2022] GET /compute/v2.1/servers/5bff8d56-37b2-40aa-971c-7f1b032d1188 => generated 1464 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:52:07.435239 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-32b49e17-7dec-48bc-97a2-82c0dd6f602c tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:52:07.437893 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-32b49e17-7dec-48bc-97a2-82c0dd6f602c tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] [instance: 5bff8d56-37b2-40aa-971c-7f1b032d1188] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:52:07.471986 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-32b49e17-7dec-48bc-97a2-82c0dd6f602c tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:07.472723 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-32b49e17-7dec-48bc-97a2-82c0dd6f602c tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:07.474056 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-32b49e17-7dec-48bc-97a2-82c0dd6f602c tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:07.479248 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-32b49e17-7dec-48bc-97a2-82c0dd6f602c tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:07.481594 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-32b49e17-7dec-48bc-97a2-82c0dd6f602c tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:07.483892 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-32b49e17-7dec-48bc-97a2-82c0dd6f602c tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:07.758241 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-32b49e17-7dec-48bc-97a2-82c0dd6f602c tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5bff8d56-37b2-40aa-971c-7f1b032d1188" status: 200 len: 1464 microversion: 2.1 time: 0.327478 Oct 23 01:52:07.759670 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3412/6730] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:52:07 2022] GET /compute/v2.1/servers/5bff8d56-37b2-40aa-971c-7f1b032d1188 => generated 1464 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:52:08.787974 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-956459f8-a410-405f-b377-6afdb0abd31c tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:52:08.791448 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-956459f8-a410-405f-b377-6afdb0abd31c tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] [instance: 5bff8d56-37b2-40aa-971c-7f1b032d1188] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:52:08.801872 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:52:08.805290 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-956459f8-a410-405f-b377-6afdb0abd31c tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:08.806978 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-956459f8-a410-405f-b377-6afdb0abd31c tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:08.807783 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-956459f8-a410-405f-b377-6afdb0abd31c tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:08.809762 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-956459f8-a410-405f-b377-6afdb0abd31c tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:08.810446 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-956459f8-a410-405f-b377-6afdb0abd31c tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:08.811041 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-956459f8-a410-405f-b377-6afdb0abd31c tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:09.138988 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-956459f8-a410-405f-b377-6afdb0abd31c tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5bff8d56-37b2-40aa-971c-7f1b032d1188" status: 200 len: 1464 microversion: 2.1 time: 0.356670 Oct 23 01:52:09.160038 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3319/6731] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:52:08 2022] GET /compute/v2.1/servers/5bff8d56-37b2-40aa-971c-7f1b032d1188 => generated 1464 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:52:10.164537 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-307807b2-8f97-4523-8d0d-e790c088ce51 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:52:10.165053 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-307807b2-8f97-4523-8d0d-e790c088ce51 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] [instance: 5bff8d56-37b2-40aa-971c-7f1b032d1188] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:52:10.179840 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:52:10.184826 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-307807b2-8f97-4523-8d0d-e790c088ce51 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:10.185305 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-307807b2-8f97-4523-8d0d-e790c088ce51 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:10.189244 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-307807b2-8f97-4523-8d0d-e790c088ce51 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:10.190035 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-307807b2-8f97-4523-8d0d-e790c088ce51 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:10.190520 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-307807b2-8f97-4523-8d0d-e790c088ce51 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:10.191012 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-307807b2-8f97-4523-8d0d-e790c088ce51 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:10.544310 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-307807b2-8f97-4523-8d0d-e790c088ce51 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5bff8d56-37b2-40aa-971c-7f1b032d1188" status: 200 len: 1464 microversion: 2.1 time: 0.383466 Oct 23 01:52:10.544883 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3413/6732] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:52:10 2022] GET /compute/v2.1/servers/5bff8d56-37b2-40aa-971c-7f1b032d1188 => generated 1464 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:52:11.429067 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-1d15d173-057c-47e2-baa8-554cca80d5fb req-566a4ea7-a968-4dd7-85a1-c0306c8fa49c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bff8d56-37b2-40aa-971c-7f1b032d1188", "name": "network-vif-plugged", "status": "completed", "tag": "694a4fc9-7957-480f-aa69-aa14c6884a98"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:52:11.441800 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=8 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:52:11.447085 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-1d15d173-057c-47e2-baa8-554cca80d5fb req-566a4ea7-a968-4dd7-85a1-c0306c8fa49c service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:11.456239 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-1d15d173-057c-47e2-baa8-554cca80d5fb req-566a4ea7-a968-4dd7-85a1-c0306c8fa49c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:11.456239 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-1d15d173-057c-47e2-baa8-554cca80d5fb req-566a4ea7-a968-4dd7-85a1-c0306c8fa49c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:11.475703 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-1d15d173-057c-47e2-baa8-554cca80d5fb req-566a4ea7-a968-4dd7-85a1-c0306c8fa49c service nova] Creating event network-vif-plugged:694a4fc9-7957-480f-aa69-aa14c6884a98 for instance 5bff8d56-37b2-40aa-971c-7f1b032d1188 on n-h1-master-1 Oct 23 01:52:11.489468 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-1d15d173-057c-47e2-baa8-554cca80d5fb req-566a4ea7-a968-4dd7-85a1-c0306c8fa49c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055703 Oct 23 01:52:11.490204 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3320/6733] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:52:11.573435 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ce77f2fc-a769-48eb-9f4b-def589cc208a tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:52:11.574685 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ce77f2fc-a769-48eb-9f4b-def589cc208a tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] [instance: 5bff8d56-37b2-40aa-971c-7f1b032d1188] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:52:11.592276 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce77f2fc-a769-48eb-9f4b-def589cc208a tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:11.592788 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce77f2fc-a769-48eb-9f4b-def589cc208a tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:11.593231 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce77f2fc-a769-48eb-9f4b-def589cc208a tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:11.593996 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce77f2fc-a769-48eb-9f4b-def589cc208a tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:11.594465 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce77f2fc-a769-48eb-9f4b-def589cc208a tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:11.594899 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce77f2fc-a769-48eb-9f4b-def589cc208a tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:11.831083 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ce77f2fc-a769-48eb-9f4b-def589cc208a tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5bff8d56-37b2-40aa-971c-7f1b032d1188" status: 200 len: 1464 microversion: 2.1 time: 0.263825 Oct 23 01:52:11.831640 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3414/6734] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:52:11 2022] GET /compute/v2.1/servers/5bff8d56-37b2-40aa-971c-7f1b032d1188 => generated 1464 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:52:12.865432 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7f530ee6-9e48-449a-8fff-0d1b5e8ab321 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:52:12.876840 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7f530ee6-9e48-449a-8fff-0d1b5e8ab321 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] [instance: 5bff8d56-37b2-40aa-971c-7f1b032d1188] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:52:12.893519 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f530ee6-9e48-449a-8fff-0d1b5e8ab321 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:12.895205 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f530ee6-9e48-449a-8fff-0d1b5e8ab321 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:12.896599 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f530ee6-9e48-449a-8fff-0d1b5e8ab321 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:12.898811 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f530ee6-9e48-449a-8fff-0d1b5e8ab321 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:12.900611 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f530ee6-9e48-449a-8fff-0d1b5e8ab321 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:12.901062 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f530ee6-9e48-449a-8fff-0d1b5e8ab321 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:13.244577 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7f530ee6-9e48-449a-8fff-0d1b5e8ab321 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5bff8d56-37b2-40aa-971c-7f1b032d1188" status: 200 len: 1464 microversion: 2.1 time: 0.393705 Oct 23 01:52:13.247122 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3321/6735] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:52:12 2022] GET /compute/v2.1/servers/5bff8d56-37b2-40aa-971c-7f1b032d1188 => generated 1464 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:52:14.268795 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-82f79836-47a8-4282-924f-11a0c2042562 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:52:14.270541 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-82f79836-47a8-4282-924f-11a0c2042562 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] [instance: 5bff8d56-37b2-40aa-971c-7f1b032d1188] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:52:14.285552 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-82f79836-47a8-4282-924f-11a0c2042562 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:14.288905 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-82f79836-47a8-4282-924f-11a0c2042562 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:14.289726 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-82f79836-47a8-4282-924f-11a0c2042562 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:14.293198 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-82f79836-47a8-4282-924f-11a0c2042562 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:14.293807 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-82f79836-47a8-4282-924f-11a0c2042562 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:14.294542 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-82f79836-47a8-4282-924f-11a0c2042562 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:14.538643 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-82f79836-47a8-4282-924f-11a0c2042562 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5bff8d56-37b2-40aa-971c-7f1b032d1188" status: 200 len: 1649 microversion: 2.1 time: 0.274681 Oct 23 01:52:14.539706 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3415/6736] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:52:14 2022] GET /compute/v2.1/servers/5bff8d56-37b2-40aa-971c-7f1b032d1188 => generated 1649 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:52:14.567759 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b9bc0f81-e9b1-4cd3-b5a6-db2e7fba5eb8 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:52:14.568389 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b9bc0f81-e9b1-4cd3-b5a6-db2e7fba5eb8 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] [instance: 5bff8d56-37b2-40aa-971c-7f1b032d1188] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:52:14.585054 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9bc0f81-e9b1-4cd3-b5a6-db2e7fba5eb8 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:14.585204 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9bc0f81-e9b1-4cd3-b5a6-db2e7fba5eb8 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:14.585740 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9bc0f81-e9b1-4cd3-b5a6-db2e7fba5eb8 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:14.586668 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9bc0f81-e9b1-4cd3-b5a6-db2e7fba5eb8 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:14.587317 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9bc0f81-e9b1-4cd3-b5a6-db2e7fba5eb8 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:14.587915 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9bc0f81-e9b1-4cd3-b5a6-db2e7fba5eb8 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:14.828295 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b9bc0f81-e9b1-4cd3-b5a6-db2e7fba5eb8 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5bff8d56-37b2-40aa-971c-7f1b032d1188" status: 200 len: 1649 microversion: 2.1 time: 0.265264 Oct 23 01:52:14.830018 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3322/6737] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:52:14 2022] GET /compute/v2.1/servers/5bff8d56-37b2-40aa-971c-7f1b032d1188 => generated 1649 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:52:14.851803 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a38c4bee-0cda-4a17-b4c3-675657cb61a4 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:52:14.852432 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a38c4bee-0cda-4a17-b4c3-675657cb61a4 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] [instance: 5bff8d56-37b2-40aa-971c-7f1b032d1188] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:52:14.864834 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a38c4bee-0cda-4a17-b4c3-675657cb61a4 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:14.865333 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a38c4bee-0cda-4a17-b4c3-675657cb61a4 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:14.865777 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a38c4bee-0cda-4a17-b4c3-675657cb61a4 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:14.866527 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a38c4bee-0cda-4a17-b4c3-675657cb61a4 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:14.870470 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a38c4bee-0cda-4a17-b4c3-675657cb61a4 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:14.870971 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a38c4bee-0cda-4a17-b4c3-675657cb61a4 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:15.434203 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a38c4bee-0cda-4a17-b4c3-675657cb61a4 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5bff8d56-37b2-40aa-971c-7f1b032d1188" status: 200 len: 1649 microversion: 2.1 time: 0.585975 Oct 23 01:52:15.436775 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3416/6738] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:52:14 2022] GET /compute/v2.1/servers/5bff8d56-37b2-40aa-971c-7f1b032d1188 => generated 1649 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:52:15.468301 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0b14a2bb-5007-4f4a-9dab-3750a9070f64 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:52:15.468301 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0b14a2bb-5007-4f4a-9dab-3750a9070f64 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] [instance: 5bff8d56-37b2-40aa-971c-7f1b032d1188] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:52:15.473491 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b14a2bb-5007-4f4a-9dab-3750a9070f64 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:15.474267 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b14a2bb-5007-4f4a-9dab-3750a9070f64 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:15.474868 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b14a2bb-5007-4f4a-9dab-3750a9070f64 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:15.475917 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b14a2bb-5007-4f4a-9dab-3750a9070f64 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:15.476990 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b14a2bb-5007-4f4a-9dab-3750a9070f64 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:15.477588 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b14a2bb-5007-4f4a-9dab-3750a9070f64 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:15.518424 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0b14a2bb-5007-4f4a-9dab-3750a9070f64 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] [instance: 5bff8d56-37b2-40aa-971c-7f1b032d1188] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:52:15.953041 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0b14a2bb-5007-4f4a-9dab-3750a9070f64 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] 10.222.0.42 "DELETE /compute/v2.1/servers/5bff8d56-37b2-40aa-971c-7f1b032d1188" status: 204 len: 0 microversion: 2.1 time: 0.489694 Oct 23 01:52:15.953041 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3323/6739] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:52:15 2022] DELETE /compute/v2.1/servers/5bff8d56-37b2-40aa-971c-7f1b032d1188 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:52:15.959170 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-41acfd8f-0702-43f6-a091-bbde0965ecd2 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:52:15.959903 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-41acfd8f-0702-43f6-a091-bbde0965ecd2 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] [instance: 5bff8d56-37b2-40aa-971c-7f1b032d1188] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:52:15.967118 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41acfd8f-0702-43f6-a091-bbde0965ecd2 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:15.967734 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41acfd8f-0702-43f6-a091-bbde0965ecd2 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:15.968272 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41acfd8f-0702-43f6-a091-bbde0965ecd2 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:15.969798 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41acfd8f-0702-43f6-a091-bbde0965ecd2 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:15.970711 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41acfd8f-0702-43f6-a091-bbde0965ecd2 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:15.971163 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41acfd8f-0702-43f6-a091-bbde0965ecd2 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:16.332466 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-41acfd8f-0702-43f6-a091-bbde0965ecd2 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5bff8d56-37b2-40aa-971c-7f1b032d1188" status: 200 len: 1655 microversion: 2.1 time: 0.376938 Oct 23 01:52:16.336558 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3417/6740] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:52:15 2022] GET /compute/v2.1/servers/5bff8d56-37b2-40aa-971c-7f1b032d1188 => generated 1655 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:52:17.366933 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-14e3c2fa-bc18-4e30-b0a2-9b0000464733 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:52:17.367762 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-14e3c2fa-bc18-4e30-b0a2-9b0000464733 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] [instance: 5bff8d56-37b2-40aa-971c-7f1b032d1188] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:52:17.375911 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-14e3c2fa-bc18-4e30-b0a2-9b0000464733 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:17.376481 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-14e3c2fa-bc18-4e30-b0a2-9b0000464733 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:17.377006 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-14e3c2fa-bc18-4e30-b0a2-9b0000464733 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:17.377791 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-14e3c2fa-bc18-4e30-b0a2-9b0000464733 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:17.378342 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-14e3c2fa-bc18-4e30-b0a2-9b0000464733 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:17.378809 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-14e3c2fa-bc18-4e30-b0a2-9b0000464733 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:17.558138 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-14e3c2fa-bc18-4e30-b0a2-9b0000464733 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5bff8d56-37b2-40aa-971c-7f1b032d1188" status: 200 len: 1655 microversion: 2.1 time: 0.180977 Oct 23 01:52:17.558138 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3324/6741] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:52:17 2022] GET /compute/v2.1/servers/5bff8d56-37b2-40aa-971c-7f1b032d1188 => generated 1655 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:52:18.249588 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-c99db2c8-613b-4b0b-ba25-08b5aee55ed8 req-5b8fb22f-2b39-403a-a3c7-b235c992a40d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bff8d56-37b2-40aa-971c-7f1b032d1188", "name": "network-vif-deleted", "tag": "694a4fc9-7957-480f-aa69-aa14c6884a98"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:52:18.265111 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-c99db2c8-613b-4b0b-ba25-08b5aee55ed8 req-5b8fb22f-2b39-403a-a3c7-b235c992a40d service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:18.266440 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-c99db2c8-613b-4b0b-ba25-08b5aee55ed8 req-5b8fb22f-2b39-403a-a3c7-b235c992a40d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:18.267230 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-c99db2c8-613b-4b0b-ba25-08b5aee55ed8 req-5b8fb22f-2b39-403a-a3c7-b235c992a40d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:18.281001 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-c99db2c8-613b-4b0b-ba25-08b5aee55ed8 req-5b8fb22f-2b39-403a-a3c7-b235c992a40d service nova] Creating event network-vif-deleted:694a4fc9-7957-480f-aa69-aa14c6884a98 for instance 5bff8d56-37b2-40aa-971c-7f1b032d1188 on n-h1-master-1 Oct 23 01:52:18.289676 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-c99db2c8-613b-4b0b-ba25-08b5aee55ed8 req-5b8fb22f-2b39-403a-a3c7-b235c992a40d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044579 Oct 23 01:52:18.291500 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3418/6742] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:52:18.572356 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-57b079db-dc2c-4f6e-bcbf-453664f8316a tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:52:18.572356 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-57b079db-dc2c-4f6e-bcbf-453664f8316a tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] [instance: 5bff8d56-37b2-40aa-971c-7f1b032d1188] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:52:18.596417 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-57b079db-dc2c-4f6e-bcbf-453664f8316a tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:18.597231 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-57b079db-dc2c-4f6e-bcbf-453664f8316a tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:18.597682 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-57b079db-dc2c-4f6e-bcbf-453664f8316a tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:18.598452 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-57b079db-dc2c-4f6e-bcbf-453664f8316a tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:18.599476 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-57b079db-dc2c-4f6e-bcbf-453664f8316a tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:18.599977 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-57b079db-dc2c-4f6e-bcbf-453664f8316a tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:18.714001 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-57b079db-dc2c-4f6e-bcbf-453664f8316a tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5bff8d56-37b2-40aa-971c-7f1b032d1188" status: 200 len: 1449 microversion: 2.1 time: 0.152796 Oct 23 01:52:18.714606 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3325/6743] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:52:18 2022] GET /compute/v2.1/servers/5bff8d56-37b2-40aa-971c-7f1b032d1188 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:52:19.738415 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2f8ff621-5ddb-4b81-a471-1383dbc83668 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:52:19.739874 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2f8ff621-5ddb-4b81-a471-1383dbc83668 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] [instance: 5bff8d56-37b2-40aa-971c-7f1b032d1188] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:52:19.748680 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f8ff621-5ddb-4b81-a471-1383dbc83668 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:19.749783 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f8ff621-5ddb-4b81-a471-1383dbc83668 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:19.751040 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f8ff621-5ddb-4b81-a471-1383dbc83668 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:19.752621 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f8ff621-5ddb-4b81-a471-1383dbc83668 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:19.753273 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f8ff621-5ddb-4b81-a471-1383dbc83668 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:19.753895 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f8ff621-5ddb-4b81-a471-1383dbc83668 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:19.787993 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f8ff621-5ddb-4b81-a471-1383dbc83668 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:19.788480 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f8ff621-5ddb-4b81-a471-1383dbc83668 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:19.788912 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f8ff621-5ddb-4b81-a471-1383dbc83668 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:19.789802 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-2f8ff621-5ddb-4b81-a471-1383dbc83668 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lazy-loading 'fault' on Instance uuid 5bff8d56-37b2-40aa-971c-7f1b032d1188 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:52:19.839330 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2f8ff621-5ddb-4b81-a471-1383dbc83668 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5bff8d56-37b2-40aa-971c-7f1b032d1188" status: 200 len: 1454 microversion: 2.1 time: 0.105787 Oct 23 01:52:19.839837 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3419/6744] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:52:19 2022] GET /compute/v2.1/servers/5bff8d56-37b2-40aa-971c-7f1b032d1188 => generated 1454 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:52:20.866113 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8c468cc7-6129-42ca-abbc-24666b4ea5ad tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:52:20.867609 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8c468cc7-6129-42ca-abbc-24666b4ea5ad tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] [instance: 5bff8d56-37b2-40aa-971c-7f1b032d1188] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:52:20.874584 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8c468cc7-6129-42ca-abbc-24666b4ea5ad tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:20.876598 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8c468cc7-6129-42ca-abbc-24666b4ea5ad tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:20.877040 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8c468cc7-6129-42ca-abbc-24666b4ea5ad tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:20.877750 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8c468cc7-6129-42ca-abbc-24666b4ea5ad tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:20.878229 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8c468cc7-6129-42ca-abbc-24666b4ea5ad tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:20.878648 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8c468cc7-6129-42ca-abbc-24666b4ea5ad tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:20.893297 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-8c468cc7-6129-42ca-abbc-24666b4ea5ad tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] HTTP exception thrown: Instance 5bff8d56-37b2-40aa-971c-7f1b032d1188 could not be found. Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8c468cc7-6129-42ca-abbc-24666b4ea5ad tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Request method failure captured: Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/5bff8d56-37b2-40aa-971c-7f1b032d1188 HTTP/1.1 Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJ4otmjlwYGEJbUVuomhApLvYFta6WNvk4zVsDiYwFOgN22lobzJ9dDdsId5g9EebnWDF8GH4OCdBOHqsPPo6v70Ud-MpWWdjEyNVct1dB5-Zi7Q5h48BVE5NlqiIvf00npzFNuLu7KR5mJSOW27_k4x0lqXjo7i-HRkpB1qXZ4qeZc Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 333acdf852374aa4a4c5e1c299274ddb Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-TestServerMultinode-867095185 Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,admin,reader Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,admin,reader Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/333acdf852374aa4a4c5e1c299274ddb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_333acdf852374aa4a4c5e1c299274ddb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/333acdf852374aa4a4c5e1c299274ddb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/333acdf852374aa4a4c5e1c299274ddb"}]}] Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-TestServerMultinode-867095185 Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 333acdf852374aa4a4c5e1c299274ddb Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-TestServerMultinode-867095185 Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-TestServerMultinode-867095185-project-admin Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: c554eff49e424172b1f23f6791a72ce8 Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-TestServerMultinode-867095185-project-admin Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 5bff8d56-37b2-40aa-971c-7f1b032d1188 could not be found. Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '5bff8d56-37b2-40aa-971c-7f1b032d1188'} Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bff8d56-37b2-40aa-971c-7f1b032d1188 could not be found. Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bff8d56-37b2-40aa-971c-7f1b032d1188 could not be found. Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:52:20.895019 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:52:20.904314 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:52:20.904314 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:52:20.904314 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:52:20.904314 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:52:20.904314 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:52:20.904314 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bff8d56-37b2-40aa-971c-7f1b032d1188 could not be found. Oct 23 01:52:20.904314 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:52:20.904314 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8c468cc7-6129-42ca-abbc-24666b4ea5ad tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Returning 404 to user: Instance 5bff8d56-37b2-40aa-971c-7f1b032d1188 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:52:20.904314 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8c468cc7-6129-42ca-abbc-24666b4ea5ad tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5bff8d56-37b2-40aa-971c-7f1b032d1188" status: 404 len: 111 microversion: 2.1 time: 0.034578 Oct 23 01:52:20.904314 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3326/6745] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:52:20 2022] GET /compute/v2.1/servers/5bff8d56-37b2-40aa-971c-7f1b032d1188 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:52:20.906023 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5a58d3dd-5bc4-4c40-add1-39601b1c7b5a tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:52:20.906023 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5a58d3dd-5bc4-4c40-add1-39601b1c7b5a tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] [instance: 784f7097-464b-4210-aedb-8bc3bc48cc59] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:52:20.912067 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5a58d3dd-5bc4-4c40-add1-39601b1c7b5a tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:20.912558 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5a58d3dd-5bc4-4c40-add1-39601b1c7b5a tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:20.912994 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5a58d3dd-5bc4-4c40-add1-39601b1c7b5a tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:20.913694 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5a58d3dd-5bc4-4c40-add1-39601b1c7b5a tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:20.914181 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5a58d3dd-5bc4-4c40-add1-39601b1c7b5a tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:20.914611 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5a58d3dd-5bc4-4c40-add1-39601b1c7b5a tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:20.953327 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5a58d3dd-5bc4-4c40-add1-39601b1c7b5a tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] [instance: 784f7097-464b-4210-aedb-8bc3bc48cc59] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:52:21.451747 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5a58d3dd-5bc4-4c40-add1-39601b1c7b5a tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] 10.222.0.42 "DELETE /compute/v2.1/servers/784f7097-464b-4210-aedb-8bc3bc48cc59" status: 204 len: 0 microversion: 2.1 time: 0.550166 Oct 23 01:52:21.452334 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3420/6746] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:52:20 2022] DELETE /compute/v2.1/servers/784f7097-464b-4210-aedb-8bc3bc48cc59 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:52:21.462684 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f63e4793-130b-4c3d-ad75-8e72cb98d639 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:52:21.464123 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f63e4793-130b-4c3d-ad75-8e72cb98d639 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] [instance: 784f7097-464b-4210-aedb-8bc3bc48cc59] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:52:21.472313 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f63e4793-130b-4c3d-ad75-8e72cb98d639 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:21.472821 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f63e4793-130b-4c3d-ad75-8e72cb98d639 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:21.478281 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f63e4793-130b-4c3d-ad75-8e72cb98d639 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:21.478281 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f63e4793-130b-4c3d-ad75-8e72cb98d639 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:21.478281 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f63e4793-130b-4c3d-ad75-8e72cb98d639 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:21.478281 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f63e4793-130b-4c3d-ad75-8e72cb98d639 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:21.647851 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f63e4793-130b-4c3d-ad75-8e72cb98d639 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/784f7097-464b-4210-aedb-8bc3bc48cc59" status: 200 len: 1654 microversion: 2.1 time: 0.190365 Oct 23 01:52:21.649311 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3327/6747] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:52:21 2022] GET /compute/v2.1/servers/784f7097-464b-4210-aedb-8bc3bc48cc59 => generated 1654 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:52:22.674625 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4bcf8d6b-186c-428b-8f61-b939e10cdc5f tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:52:22.675386 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4bcf8d6b-186c-428b-8f61-b939e10cdc5f tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] [instance: 784f7097-464b-4210-aedb-8bc3bc48cc59] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:52:22.682696 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4bcf8d6b-186c-428b-8f61-b939e10cdc5f tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:22.683881 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4bcf8d6b-186c-428b-8f61-b939e10cdc5f tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:22.684862 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4bcf8d6b-186c-428b-8f61-b939e10cdc5f tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:22.686611 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4bcf8d6b-186c-428b-8f61-b939e10cdc5f tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:22.687521 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4bcf8d6b-186c-428b-8f61-b939e10cdc5f tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:22.689028 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4bcf8d6b-186c-428b-8f61-b939e10cdc5f tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:22.933789 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4bcf8d6b-186c-428b-8f61-b939e10cdc5f tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/784f7097-464b-4210-aedb-8bc3bc48cc59" status: 200 len: 1654 microversion: 2.1 time: 0.264111 Oct 23 01:52:22.947395 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3421/6748] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:52:22 2022] GET /compute/v2.1/servers/784f7097-464b-4210-aedb-8bc3bc48cc59 => generated 1654 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:52:23.607570 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-319b6abc-5c76-4ebc-aa5f-aec6064b0701 req-dbcfd0af-eaef-4727-8a20-9d5b9acd2df1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "784f7097-464b-4210-aedb-8bc3bc48cc59", "name": "network-vif-deleted", "tag": "04dadb27-cfe6-46d5-8bd0-1b4805a7d692"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:52:23.618618 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-319b6abc-5c76-4ebc-aa5f-aec6064b0701 req-dbcfd0af-eaef-4727-8a20-9d5b9acd2df1 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:23.619070 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-319b6abc-5c76-4ebc-aa5f-aec6064b0701 req-dbcfd0af-eaef-4727-8a20-9d5b9acd2df1 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:23.619492 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-319b6abc-5c76-4ebc-aa5f-aec6064b0701 req-dbcfd0af-eaef-4727-8a20-9d5b9acd2df1 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:23.634311 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-319b6abc-5c76-4ebc-aa5f-aec6064b0701 req-dbcfd0af-eaef-4727-8a20-9d5b9acd2df1 service nova] Creating event network-vif-deleted:04dadb27-cfe6-46d5-8bd0-1b4805a7d692 for instance 784f7097-464b-4210-aedb-8bc3bc48cc59 on n-h2-master-1 Oct 23 01:52:23.639401 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-319b6abc-5c76-4ebc-aa5f-aec6064b0701 req-dbcfd0af-eaef-4727-8a20-9d5b9acd2df1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035494 Oct 23 01:52:23.639998 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3328/6749] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:52:23.963042 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5ca6ef47-58b7-44c7-83bb-e614dd811c76 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:52:23.963459 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5ca6ef47-58b7-44c7-83bb-e614dd811c76 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] [instance: 784f7097-464b-4210-aedb-8bc3bc48cc59] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:52:23.974016 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5ca6ef47-58b7-44c7-83bb-e614dd811c76 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:23.974624 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5ca6ef47-58b7-44c7-83bb-e614dd811c76 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:23.975172 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5ca6ef47-58b7-44c7-83bb-e614dd811c76 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:23.976183 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5ca6ef47-58b7-44c7-83bb-e614dd811c76 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:23.976882 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5ca6ef47-58b7-44c7-83bb-e614dd811c76 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:23.977515 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5ca6ef47-58b7-44c7-83bb-e614dd811c76 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:24.020544 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5ca6ef47-58b7-44c7-83bb-e614dd811c76 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:24.026185 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5ca6ef47-58b7-44c7-83bb-e614dd811c76 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:24.026185 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5ca6ef47-58b7-44c7-83bb-e614dd811c76 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:24.026185 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-5ca6ef47-58b7-44c7-83bb-e614dd811c76 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lazy-loading 'fault' on Instance uuid 784f7097-464b-4210-aedb-8bc3bc48cc59 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:52:24.148851 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5ca6ef47-58b7-44c7-83bb-e614dd811c76 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/784f7097-464b-4210-aedb-8bc3bc48cc59" status: 200 len: 1454 microversion: 2.1 time: 0.188968 Oct 23 01:52:24.150233 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3422/6750] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:52:23 2022] GET /compute/v2.1/servers/784f7097-464b-4210-aedb-8bc3bc48cc59 => generated 1454 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:52:25.179864 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3b14158d-d51e-4a1c-ba80-cd022bf92447 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:52:25.181638 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3b14158d-d51e-4a1c-ba80-cd022bf92447 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] [instance: 784f7097-464b-4210-aedb-8bc3bc48cc59] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:52:25.191432 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b14158d-d51e-4a1c-ba80-cd022bf92447 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:25.191919 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b14158d-d51e-4a1c-ba80-cd022bf92447 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:25.192407 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b14158d-d51e-4a1c-ba80-cd022bf92447 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:25.193350 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b14158d-d51e-4a1c-ba80-cd022bf92447 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:25.194013 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b14158d-d51e-4a1c-ba80-cd022bf92447 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:25.203481 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b14158d-d51e-4a1c-ba80-cd022bf92447 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:25.227853 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-3b14158d-d51e-4a1c-ba80-cd022bf92447 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] HTTP exception thrown: Instance 784f7097-464b-4210-aedb-8bc3bc48cc59 could not be found. Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3b14158d-d51e-4a1c-ba80-cd022bf92447 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Request method failure captured: Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/784f7097-464b-4210-aedb-8bc3bc48cc59 HTTP/1.1 Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJ4otmjlwYGEJbUVuomhApLvYFta6WNvk4zVsDiYwFOgN22lobzJ9dDdsId5g9EebnWDF8GH4OCdBOHqsPPo6v70Ud-MpWWdjEyNVct1dB5-Zi7Q5h48BVE5NlqiIvf00npzFNuLu7KR5mJSOW27_k4x0lqXjo7i-HRkpB1qXZ4qeZc Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 333acdf852374aa4a4c5e1c299274ddb Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-TestServerMultinode-867095185 Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,admin,reader Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,admin,reader Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/333acdf852374aa4a4c5e1c299274ddb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_333acdf852374aa4a4c5e1c299274ddb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/333acdf852374aa4a4c5e1c299274ddb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/333acdf852374aa4a4c5e1c299274ddb"}]}] Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-TestServerMultinode-867095185 Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 333acdf852374aa4a4c5e1c299274ddb Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-TestServerMultinode-867095185 Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-TestServerMultinode-867095185-project-admin Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: c554eff49e424172b1f23f6791a72ce8 Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-TestServerMultinode-867095185-project-admin Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 784f7097-464b-4210-aedb-8bc3bc48cc59 could not be found. Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '784f7097-464b-4210-aedb-8bc3bc48cc59'} Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 784f7097-464b-4210-aedb-8bc3bc48cc59 could not be found. Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 784f7097-464b-4210-aedb-8bc3bc48cc59 could not be found. Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:52:25.229990 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:52:25.240247 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:52:25.240247 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:52:25.240247 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:52:25.240247 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:52:25.240247 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:52:25.240247 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 784f7097-464b-4210-aedb-8bc3bc48cc59 could not be found. Oct 23 01:52:25.240247 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:52:25.240247 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3b14158d-d51e-4a1c-ba80-cd022bf92447 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] Returning 404 to user: Instance 784f7097-464b-4210-aedb-8bc3bc48cc59 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:52:25.240247 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3b14158d-d51e-4a1c-ba80-cd022bf92447 tempest-TestServerMultinode-867095185 tempest-TestServerMultinode-867095185-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/784f7097-464b-4210-aedb-8bc3bc48cc59" status: 404 len: 111 microversion: 2.1 time: 0.061351 Oct 23 01:52:25.240247 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3329/6751] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:52:25 2022] GET /compute/v2.1/servers/784f7097-464b-4210-aedb-8bc3bc48cc59 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:52:27.863397 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-16e5b729-11b6-423e-924c-bfc8b691da7d tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:52:27.866421 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-16e5b729-11b6-423e-924c-bfc8b691da7d tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] [instance: 62dcefb0-44c2-41c9-b5d3-2e617a9ded5b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:52:27.871069 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:52:27.876750 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-16e5b729-11b6-423e-924c-bfc8b691da7d tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:27.877512 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-16e5b729-11b6-423e-924c-bfc8b691da7d tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:27.878606 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-16e5b729-11b6-423e-924c-bfc8b691da7d tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:27.880034 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-16e5b729-11b6-423e-924c-bfc8b691da7d tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:27.880706 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-16e5b729-11b6-423e-924c-bfc8b691da7d tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:27.881531 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-16e5b729-11b6-423e-924c-bfc8b691da7d tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:28.064116 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-16e5b729-11b6-423e-924c-bfc8b691da7d tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lazy-loading 'services' on Instance uuid 62dcefb0-44c2-41c9-b5d3-2e617a9ded5b {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:52:28.220648 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d812442b-6c64-47c0-a3b2-6dda2df5f77f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-848089298", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "f45f244b-31ad-4b19-8694-cfe087175513", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "e056504c-8568-4f9a-a3ed-bae9f108b4ab"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:52:28.341490 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-d812442b-6c64-47c0-a3b2-6dda2df5f77f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] validate_networks() for [('e056504c-8568-4f9a-a3ed-bae9f108b4ab', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:52:28.376520 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-16e5b729-11b6-423e-924c-bfc8b691da7d tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] 10.222.0.42 "DELETE /compute/v2.1/servers/62dcefb0-44c2-41c9-b5d3-2e617a9ded5b/os-volume_attachments/b2695d8f-cb12-416f-8d14-2f9361ee8e6a" status: 202 len: 0 microversion: 2.1 time: 0.519403 Oct 23 01:52:28.380507 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3423/6752] 10.222.0.42 () {58 vars in 1416 bytes} [Sun Oct 23 01:52:27 2022] DELETE /compute/v2.1/servers/62dcefb0-44c2-41c9-b5d3-2e617a9ded5b/os-volume_attachments/b2695d8f-cb12-416f-8d14-2f9361ee8e6a => generated 0 bytes in 522 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:52:28.959203 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-d812442b-6c64-47c0-a3b2-6dda2df5f77f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:52:28.959631 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-d812442b-6c64-47c0-a3b2-6dda2df5f77f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:52:28.960137 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-d812442b-6c64-47c0-a3b2-6dda2df5f77f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:52:28.960552 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-d812442b-6c64-47c0-a3b2-6dda2df5f77f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:52:28.960972 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-d812442b-6c64-47c0-a3b2-6dda2df5f77f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:52:28.972392 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d812442b-6c64-47c0-a3b2-6dda2df5f77f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:28.972889 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d812442b-6c64-47c0-a3b2-6dda2df5f77f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:28.973329 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d812442b-6c64-47c0-a3b2-6dda2df5f77f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:28.974095 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d812442b-6c64-47c0-a3b2-6dda2df5f77f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:28.974550 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d812442b-6c64-47c0-a3b2-6dda2df5f77f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:28.974984 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d812442b-6c64-47c0-a3b2-6dda2df5f77f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:28.993939 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:52:29.009946 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-d812442b-6c64-47c0-a3b2-6dda2df5f77f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Getting quotas for project b1ec0b5ecaa741eaaf40a50f1415e7f9. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:52:29.015592 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-d812442b-6c64-47c0-a3b2-6dda2df5f77f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Getting quotas for user f2967d0d8c134d269c9bbe51c90f803a and project b1ec0b5ecaa741eaaf40a50f1415e7f9. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:52:29.030393 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d812442b-6c64-47c0-a3b2-6dda2df5f77f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:52:29.032500 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d812442b-6c64-47c0-a3b2-6dda2df5f77f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='f45f244b-31ad-4b19-8694-cfe087175513',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:52:29.259468 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d812442b-6c64-47c0-a3b2-6dda2df5f77f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.042816 Oct 23 01:52:29.262925 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3330/6753] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:52:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:52:29.277204 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d7a76ec1-b437-457b-8afc-55a36a465473 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:52:29.277925 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d7a76ec1-b437-457b-8afc-55a36a465473 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:52:29.437491 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d7a76ec1-b437-457b-8afc-55a36a465473 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:52:29.448648 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d7a76ec1-b437-457b-8afc-55a36a465473 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 200 len: 1056 microversion: 2.1 time: 0.177119 Oct 23 01:52:29.462008 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3424/6754] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:52:29 2022] GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 1056 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:52:30.472906 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-55d82380-c893-419a-b62b-9b9ac9fd252b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:52:30.473556 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-55d82380-c893-419a-b62b-9b9ac9fd252b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:52:30.603755 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-55d82380-c893-419a-b62b-9b9ac9fd252b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:52:30.620524 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-55d82380-c893-419a-b62b-9b9ac9fd252b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 200 len: 1056 microversion: 2.1 time: 0.151355 Oct 23 01:52:30.623611 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3331/6755] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:52:30 2022] GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 1056 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:52:31.646664 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3af188da-b007-4000-93c7-1955c535c45f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:52:31.648195 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3af188da-b007-4000-93c7-1955c535c45f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:52:31.662974 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3af188da-b007-4000-93c7-1955c535c45f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:31.663903 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3af188da-b007-4000-93c7-1955c535c45f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:31.665111 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3af188da-b007-4000-93c7-1955c535c45f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:31.666093 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3af188da-b007-4000-93c7-1955c535c45f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:31.667077 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3af188da-b007-4000-93c7-1955c535c45f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:31.667735 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3af188da-b007-4000-93c7-1955c535c45f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:31.695931 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:52:31.773320 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3af188da-b007-4000-93c7-1955c535c45f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:52:31.781172 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3af188da-b007-4000-93c7-1955c535c45f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 200 len: 1108 microversion: 2.1 time: 0.140306 Oct 23 01:52:31.795389 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3425/6756] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:52:31 2022] GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 1108 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:52:32.809762 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0a08c2aa-a7d1-4be7-9721-bb87b366e4ff tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:52:32.811719 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0a08c2aa-a7d1-4be7-9721-bb87b366e4ff tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:52:32.817498 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:52:32.831673 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0a08c2aa-a7d1-4be7-9721-bb87b366e4ff tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:32.832239 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0a08c2aa-a7d1-4be7-9721-bb87b366e4ff tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:32.832696 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0a08c2aa-a7d1-4be7-9721-bb87b366e4ff tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:32.833420 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0a08c2aa-a7d1-4be7-9721-bb87b366e4ff tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:32.833884 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0a08c2aa-a7d1-4be7-9721-bb87b366e4ff tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:32.834353 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0a08c2aa-a7d1-4be7-9721-bb87b366e4ff tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:33.094249 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0a08c2aa-a7d1-4be7-9721-bb87b366e4ff tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:52:33.116566 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0a08c2aa-a7d1-4be7-9721-bb87b366e4ff tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 200 len: 1126 microversion: 2.1 time: 0.313530 Oct 23 01:52:33.117168 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3332/6757] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:52:32 2022] GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 1126 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:52:34.141544 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0b53813a-99fd-4c27-9561-bf2685f8cfb8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:52:34.142399 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0b53813a-99fd-4c27-9561-bf2685f8cfb8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:52:34.150380 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b53813a-99fd-4c27-9561-bf2685f8cfb8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:34.151214 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b53813a-99fd-4c27-9561-bf2685f8cfb8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:34.153411 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b53813a-99fd-4c27-9561-bf2685f8cfb8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:34.154415 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b53813a-99fd-4c27-9561-bf2685f8cfb8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:34.158844 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b53813a-99fd-4c27-9561-bf2685f8cfb8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:34.159518 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b53813a-99fd-4c27-9561-bf2685f8cfb8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:34.659339 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0b53813a-99fd-4c27-9561-bf2685f8cfb8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:52:34.671398 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0b53813a-99fd-4c27-9561-bf2685f8cfb8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 200 len: 1168 microversion: 2.1 time: 0.534117 Oct 23 01:52:34.673213 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3426/6758] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:52:34 2022] GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 1168 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:52:35.674317 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-15f8aacb-1fd1-444a-a4e5-b9584dc6aec2 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:52:35.674834 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-15f8aacb-1fd1-444a-a4e5-b9584dc6aec2 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] [instance: 62dcefb0-44c2-41c9-b5d3-2e617a9ded5b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:52:35.696927 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-444f5003-cb7e-4ca0-b4a6-1baafaa72479 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:52:35.697550 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-444f5003-cb7e-4ca0-b4a6-1baafaa72479 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:52:35.703408 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-15f8aacb-1fd1-444a-a4e5-b9584dc6aec2 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:35.706579 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-15f8aacb-1fd1-444a-a4e5-b9584dc6aec2 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:35.707466 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-15f8aacb-1fd1-444a-a4e5-b9584dc6aec2 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:35.708333 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-444f5003-cb7e-4ca0-b4a6-1baafaa72479 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:35.709243 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-15f8aacb-1fd1-444a-a4e5-b9584dc6aec2 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:35.710419 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-15f8aacb-1fd1-444a-a4e5-b9584dc6aec2 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:35.710755 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-444f5003-cb7e-4ca0-b4a6-1baafaa72479 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:35.711379 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-444f5003-cb7e-4ca0-b4a6-1baafaa72479 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:35.711986 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-15f8aacb-1fd1-444a-a4e5-b9584dc6aec2 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:35.712880 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-444f5003-cb7e-4ca0-b4a6-1baafaa72479 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:35.714518 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-444f5003-cb7e-4ca0-b4a6-1baafaa72479 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:35.719081 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-444f5003-cb7e-4ca0-b4a6-1baafaa72479 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:35.772394 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-15f8aacb-1fd1-444a-a4e5-b9584dc6aec2 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] [instance: 62dcefb0-44c2-41c9-b5d3-2e617a9ded5b] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:52:36.032778 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-444f5003-cb7e-4ca0-b4a6-1baafaa72479 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:52:36.051530 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-444f5003-cb7e-4ca0-b4a6-1baafaa72479 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 200 len: 1168 microversion: 2.1 time: 0.356797 Oct 23 01:52:36.052690 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3427/6759] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:52:35 2022] GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 1168 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:52:36.091964 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-8a508f61-80d8-44c4-9ef4-2c7f010d8edb req-b587f2b1-3b58-4657-9029-074c662433d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c02a0c2-86a4-460d-abfd-b3cfaf92bb39", "tag": "07ca9d49-9e2a-47c2-9b72-1fd6a3e3b5b8"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:52:36.110590 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-8a508f61-80d8-44c4-9ef4-2c7f010d8edb req-b587f2b1-3b58-4657-9029-074c662433d5 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:36.111613 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-8a508f61-80d8-44c4-9ef4-2c7f010d8edb req-b587f2b1-3b58-4657-9029-074c662433d5 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:36.112290 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-8a508f61-80d8-44c4-9ef4-2c7f010d8edb req-b587f2b1-3b58-4657-9029-074c662433d5 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:36.129503 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-8a508f61-80d8-44c4-9ef4-2c7f010d8edb req-b587f2b1-3b58-4657-9029-074c662433d5 service nova] Creating event network-changed:07ca9d49-9e2a-47c2-9b72-1fd6a3e3b5b8 for instance 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 on n-h2-master-1 Oct 23 01:52:36.137693 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-8a508f61-80d8-44c4-9ef4-2c7f010d8edb req-b587f2b1-3b58-4657-9029-074c662433d5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050694 Oct 23 01:52:36.139081 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3428/6760] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:52:36.181126 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-15f8aacb-1fd1-444a-a4e5-b9584dc6aec2 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] 10.222.0.42 "DELETE /compute/v2.1/servers/62dcefb0-44c2-41c9-b5d3-2e617a9ded5b" status: 204 len: 0 microversion: 2.1 time: 0.510522 Oct 23 01:52:36.182292 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3333/6761] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:52:35 2022] DELETE /compute/v2.1/servers/62dcefb0-44c2-41c9-b5d3-2e617a9ded5b => generated 0 bytes in 512 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:52:36.197558 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-df52477b-d0a8-4c81-83d7-83ebd30e3663 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:52:36.198660 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-df52477b-d0a8-4c81-83d7-83ebd30e3663 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] [instance: 62dcefb0-44c2-41c9-b5d3-2e617a9ded5b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:52:36.212567 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-df52477b-d0a8-4c81-83d7-83ebd30e3663 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:36.213415 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-df52477b-d0a8-4c81-83d7-83ebd30e3663 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:36.214161 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-df52477b-d0a8-4c81-83d7-83ebd30e3663 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:36.215103 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-df52477b-d0a8-4c81-83d7-83ebd30e3663 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:36.215763 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-df52477b-d0a8-4c81-83d7-83ebd30e3663 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:36.216356 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-df52477b-d0a8-4c81-83d7-83ebd30e3663 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:36.686512 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-df52477b-d0a8-4c81-83d7-83ebd30e3663 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c880db3363a4aff92b82abfef14a8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b41c66c9864d7dbe35a389f72fcd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:52:36.708713 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-df52477b-d0a8-4c81-83d7-83ebd30e3663 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] 10.222.0.42 "GET /compute/v2.1/servers/62dcefb0-44c2-41c9-b5d3-2e617a9ded5b" status: 200 len: 1469 microversion: 2.1 time: 0.515091 Oct 23 01:52:36.713123 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3429/6762] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:52:36 2022] GET /compute/v2.1/servers/62dcefb0-44c2-41c9-b5d3-2e617a9ded5b => generated 1469 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:52:37.077123 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-28da4890-0f3f-45d5-9e32-79be50902fe2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:52:37.078246 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-28da4890-0f3f-45d5-9e32-79be50902fe2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:52:37.099958 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-28da4890-0f3f-45d5-9e32-79be50902fe2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:37.104712 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-28da4890-0f3f-45d5-9e32-79be50902fe2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:37.104712 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-28da4890-0f3f-45d5-9e32-79be50902fe2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:37.104712 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-28da4890-0f3f-45d5-9e32-79be50902fe2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:37.104712 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-28da4890-0f3f-45d5-9e32-79be50902fe2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:37.104712 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-28da4890-0f3f-45d5-9e32-79be50902fe2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:37.536922 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-28da4890-0f3f-45d5-9e32-79be50902fe2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:52:37.554075 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-28da4890-0f3f-45d5-9e32-79be50902fe2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 200 len: 1168 microversion: 2.1 time: 0.477610 Oct 23 01:52:37.554075 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3334/6763] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:52:37 2022] GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 1168 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:52:37.736802 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9fd86697-d8b3-4172-ab2c-caeecb738936 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:52:37.737426 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9fd86697-d8b3-4172-ab2c-caeecb738936 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] [instance: 62dcefb0-44c2-41c9-b5d3-2e617a9ded5b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:52:37.746587 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9fd86697-d8b3-4172-ab2c-caeecb738936 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:37.747087 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9fd86697-d8b3-4172-ab2c-caeecb738936 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:37.747713 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9fd86697-d8b3-4172-ab2c-caeecb738936 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:37.748612 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9fd86697-d8b3-4172-ab2c-caeecb738936 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:37.749077 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9fd86697-d8b3-4172-ab2c-caeecb738936 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:37.749513 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9fd86697-d8b3-4172-ab2c-caeecb738936 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:37.958458 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9fd86697-d8b3-4172-ab2c-caeecb738936 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c880db3363a4aff92b82abfef14a8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b41c66c9864d7dbe35a389f72fcd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:52:37.970388 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9fd86697-d8b3-4172-ab2c-caeecb738936 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] 10.222.0.42 "GET /compute/v2.1/servers/62dcefb0-44c2-41c9-b5d3-2e617a9ded5b" status: 200 len: 1469 microversion: 2.1 time: 0.237386 Oct 23 01:52:37.993020 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3430/6764] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:52:37 2022] GET /compute/v2.1/servers/62dcefb0-44c2-41c9-b5d3-2e617a9ded5b => generated 1469 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:52:38.599016 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3956f2b6-73bd-479a-8129-31d34b10b307 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:52:38.599016 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3956f2b6-73bd-479a-8129-31d34b10b307 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:52:38.599016 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3956f2b6-73bd-479a-8129-31d34b10b307 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:38.599016 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3956f2b6-73bd-479a-8129-31d34b10b307 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:38.599016 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3956f2b6-73bd-479a-8129-31d34b10b307 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:38.599016 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3956f2b6-73bd-479a-8129-31d34b10b307 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:38.599016 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3956f2b6-73bd-479a-8129-31d34b10b307 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:38.599016 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3956f2b6-73bd-479a-8129-31d34b10b307 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:38.780517 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3956f2b6-73bd-479a-8129-31d34b10b307 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:52:38.790349 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3956f2b6-73bd-479a-8129-31d34b10b307 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 200 len: 1168 microversion: 2.1 time: 0.221224 Oct 23 01:52:38.791210 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3335/6765] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:52:38 2022] GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 1168 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:52:38.960274 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-f8631d17-a8bd-46fd-bb80-5136bf9f4f83 req-db601f7d-0bc3-4902-bcd7-e0ed2f2aade1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62dcefb0-44c2-41c9-b5d3-2e617a9ded5b", "name": "network-vif-deleted", "tag": "041e568b-b410-4e61-9fd5-125d52c1c08d"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:52:38.973912 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-f8631d17-a8bd-46fd-bb80-5136bf9f4f83 req-db601f7d-0bc3-4902-bcd7-e0ed2f2aade1 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:38.974388 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-f8631d17-a8bd-46fd-bb80-5136bf9f4f83 req-db601f7d-0bc3-4902-bcd7-e0ed2f2aade1 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:38.974818 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-f8631d17-a8bd-46fd-bb80-5136bf9f4f83 req-db601f7d-0bc3-4902-bcd7-e0ed2f2aade1 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:38.994991 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-f8631d17-a8bd-46fd-bb80-5136bf9f4f83 req-db601f7d-0bc3-4902-bcd7-e0ed2f2aade1 service nova] Creating event network-vif-deleted:041e568b-b410-4e61-9fd5-125d52c1c08d for instance 62dcefb0-44c2-41c9-b5d3-2e617a9ded5b on n-h1-master-1 Oct 23 01:52:39.001890 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-f8631d17-a8bd-46fd-bb80-5136bf9f4f83 req-db601f7d-0bc3-4902-bcd7-e0ed2f2aade1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045864 Oct 23 01:52:39.002755 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3431/6766] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:52:39.003536 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a8f3b329-9fad-40bc-92da-d78ac641fe7f tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:52:39.004151 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a8f3b329-9fad-40bc-92da-d78ac641fe7f tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] [instance: 62dcefb0-44c2-41c9-b5d3-2e617a9ded5b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:52:39.006734 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:52:39.012560 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a8f3b329-9fad-40bc-92da-d78ac641fe7f tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:39.013288 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a8f3b329-9fad-40bc-92da-d78ac641fe7f tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:39.013712 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a8f3b329-9fad-40bc-92da-d78ac641fe7f tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:39.014588 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a8f3b329-9fad-40bc-92da-d78ac641fe7f tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:39.015268 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a8f3b329-9fad-40bc-92da-d78ac641fe7f tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:39.015836 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a8f3b329-9fad-40bc-92da-d78ac641fe7f tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:39.098174 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a8f3b329-9fad-40bc-92da-d78ac641fe7f tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c880db3363a4aff92b82abfef14a8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b41c66c9864d7dbe35a389f72fcd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:52:39.112263 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a8f3b329-9fad-40bc-92da-d78ac641fe7f tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] 10.222.0.42 "GET /compute/v2.1/servers/62dcefb0-44c2-41c9-b5d3-2e617a9ded5b" status: 200 len: 1427 microversion: 2.1 time: 0.116688 Oct 23 01:52:39.114041 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3336/6767] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:52:38 2022] GET /compute/v2.1/servers/62dcefb0-44c2-41c9-b5d3-2e617a9ded5b => generated 1427 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:52:39.811447 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:52:39.816938 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-17073520-a9df-44f5-afd8-871713c706b3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:52:39.818178 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-17073520-a9df-44f5-afd8-871713c706b3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:52:39.826110 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-17073520-a9df-44f5-afd8-871713c706b3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:39.829493 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-17073520-a9df-44f5-afd8-871713c706b3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:39.829493 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-17073520-a9df-44f5-afd8-871713c706b3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:39.829493 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-17073520-a9df-44f5-afd8-871713c706b3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:39.829493 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-17073520-a9df-44f5-afd8-871713c706b3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:39.830285 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-17073520-a9df-44f5-afd8-871713c706b3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:40.049790 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-17073520-a9df-44f5-afd8-871713c706b3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:52:40.060294 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-17073520-a9df-44f5-afd8-871713c706b3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 200 len: 1168 microversion: 2.1 time: 0.249602 Oct 23 01:52:40.064595 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3432/6768] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:52:39 2022] GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 1168 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:52:40.137892 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6473d56c-6a6d-4298-b04d-bf0e6981e75a tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:52:40.139711 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6473d56c-6a6d-4298-b04d-bf0e6981e75a tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] [instance: 62dcefb0-44c2-41c9-b5d3-2e617a9ded5b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:52:40.147301 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6473d56c-6a6d-4298-b04d-bf0e6981e75a tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:40.147794 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6473d56c-6a6d-4298-b04d-bf0e6981e75a tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:40.148235 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6473d56c-6a6d-4298-b04d-bf0e6981e75a tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:40.148938 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6473d56c-6a6d-4298-b04d-bf0e6981e75a tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:40.149396 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6473d56c-6a6d-4298-b04d-bf0e6981e75a tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:40.149830 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6473d56c-6a6d-4298-b04d-bf0e6981e75a tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:40.187851 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6473d56c-6a6d-4298-b04d-bf0e6981e75a tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:40.189772 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6473d56c-6a6d-4298-b04d-bf0e6981e75a tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:40.190488 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6473d56c-6a6d-4298-b04d-bf0e6981e75a tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:40.191146 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-6473d56c-6a6d-4298-b04d-bf0e6981e75a tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lazy-loading 'fault' on Instance uuid 62dcefb0-44c2-41c9-b5d3-2e617a9ded5b {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:52:40.248265 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6473d56c-6a6d-4298-b04d-bf0e6981e75a tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c880db3363a4aff92b82abfef14a8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b41c66c9864d7dbe35a389f72fcd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:52:40.263394 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6473d56c-6a6d-4298-b04d-bf0e6981e75a tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] 10.222.0.42 "GET /compute/v2.1/servers/62dcefb0-44c2-41c9-b5d3-2e617a9ded5b" status: 200 len: 1304 microversion: 2.1 time: 0.128234 Oct 23 01:52:40.278437 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3337/6769] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:52:40 2022] GET /compute/v2.1/servers/62dcefb0-44c2-41c9-b5d3-2e617a9ded5b => generated 1304 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:52:41.087929 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a75d7973-b37d-4958-9664-a8ce8c5f3eb5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:52:41.089414 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a75d7973-b37d-4958-9664-a8ce8c5f3eb5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:52:41.103460 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a75d7973-b37d-4958-9664-a8ce8c5f3eb5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:41.103960 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a75d7973-b37d-4958-9664-a8ce8c5f3eb5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:41.104402 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a75d7973-b37d-4958-9664-a8ce8c5f3eb5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:41.105265 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a75d7973-b37d-4958-9664-a8ce8c5f3eb5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:41.105567 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a75d7973-b37d-4958-9664-a8ce8c5f3eb5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:41.106018 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a75d7973-b37d-4958-9664-a8ce8c5f3eb5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:41.291882 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8f48c7bf-fc92-478e-83ef-1a516a4fc952 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:52:41.293005 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8f48c7bf-fc92-478e-83ef-1a516a4fc952 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] [instance: 62dcefb0-44c2-41c9-b5d3-2e617a9ded5b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:52:41.295567 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=8 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:52:41.305143 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f48c7bf-fc92-478e-83ef-1a516a4fc952 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:41.306047 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f48c7bf-fc92-478e-83ef-1a516a4fc952 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:41.306889 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f48c7bf-fc92-478e-83ef-1a516a4fc952 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:41.307656 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f48c7bf-fc92-478e-83ef-1a516a4fc952 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:41.308305 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f48c7bf-fc92-478e-83ef-1a516a4fc952 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:41.308733 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f48c7bf-fc92-478e-83ef-1a516a4fc952 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:41.323924 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-8f48c7bf-fc92-478e-83ef-1a516a4fc952 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] HTTP exception thrown: Instance 62dcefb0-44c2-41c9-b5d3-2e617a9ded5b could not be found. Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8f48c7bf-fc92-478e-83ef-1a516a4fc952 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Request method failure captured: Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/62dcefb0-44c2-41c9-b5d3-2e617a9ded5b HTTP/1.1 Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJ25n3nIShMNFy4gBp5SoZzRlu4hDOtszKaGPyetmdI0kg-bnBNBHFENME1ht-rgps-uE0873Vby2mS4KvF3oZJEEO53-YZstYNuMFnzuvxIM8RoTNmsgK4FGWTZOcjx5DRcuDWY_lRBDGBP74H7GlzLuPBTvuRLS-xD1tw7SiM8bvo Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 83b41c66c9864d7dbe35a389f72fcd4d Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-VolumesBackupsTest-808110849 Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/83b41c66c9864d7dbe35a389f72fcd4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_83b41c66c9864d7dbe35a389f72fcd4d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/83b41c66c9864d7dbe35a389f72fcd4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/83b41c66c9864d7dbe35a389f72fcd4d"}]}] Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-VolumesBackupsTest-808110849 Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 83b41c66c9864d7dbe35a389f72fcd4d Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-VolumesBackupsTest-808110849 Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-VolumesBackupsTest-808110849-project Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 4c880db3363a4aff92b82abfef14a8b0 Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-VolumesBackupsTest-808110849-project Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 62dcefb0-44c2-41c9-b5d3-2e617a9ded5b could not be found. Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '62dcefb0-44c2-41c9-b5d3-2e617a9ded5b'} Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62dcefb0-44c2-41c9-b5d3-2e617a9ded5b could not be found. Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62dcefb0-44c2-41c9-b5d3-2e617a9ded5b could not be found. Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:52:41.326054 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:52:41.330526 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:52:41.330526 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:52:41.330526 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:52:41.330526 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:52:41.330526 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:52:41.330526 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62dcefb0-44c2-41c9-b5d3-2e617a9ded5b could not be found. Oct 23 01:52:41.330526 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:52:41.332450 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8f48c7bf-fc92-478e-83ef-1a516a4fc952 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] Returning 404 to user: Instance 62dcefb0-44c2-41c9-b5d3-2e617a9ded5b could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:52:41.333551 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8f48c7bf-fc92-478e-83ef-1a516a4fc952 tempest-VolumesBackupsTest-808110849 tempest-VolumesBackupsTest-808110849-project] 10.222.0.42 "GET /compute/v2.1/servers/62dcefb0-44c2-41c9-b5d3-2e617a9ded5b" status: 404 len: 111 microversion: 2.1 time: 0.047374 Oct 23 01:52:41.338676 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3338/6770] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:52:41 2022] GET /compute/v2.1/servers/62dcefb0-44c2-41c9-b5d3-2e617a9ded5b => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 01:52:41.362636 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a75d7973-b37d-4958-9664-a8ce8c5f3eb5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:52:41.373273 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a75d7973-b37d-4958-9664-a8ce8c5f3eb5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 200 len: 1168 microversion: 2.1 time: 0.289976 Oct 23 01:52:41.373718 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3433/6771] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:52:41 2022] GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 1168 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:52:42.396641 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-acfec435-36b7-4b2f-b81d-a6f39fc07816 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:52:42.398135 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-acfec435-36b7-4b2f-b81d-a6f39fc07816 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:52:42.406139 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-acfec435-36b7-4b2f-b81d-a6f39fc07816 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:42.407574 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-acfec435-36b7-4b2f-b81d-a6f39fc07816 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:42.408177 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-acfec435-36b7-4b2f-b81d-a6f39fc07816 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:42.409250 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-acfec435-36b7-4b2f-b81d-a6f39fc07816 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:42.409871 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-acfec435-36b7-4b2f-b81d-a6f39fc07816 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:42.410484 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-acfec435-36b7-4b2f-b81d-a6f39fc07816 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:42.764310 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-acfec435-36b7-4b2f-b81d-a6f39fc07816 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:52:42.779913 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-acfec435-36b7-4b2f-b81d-a6f39fc07816 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 200 len: 1168 microversion: 2.1 time: 0.387066 Oct 23 01:52:42.780711 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3339/6772] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:52:42 2022] GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 1168 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:52:43.819945 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c5bc3547-0966-4838-8138-67b3054101db tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:52:43.820973 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c5bc3547-0966-4838-8138-67b3054101db tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:52:43.840693 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c5bc3547-0966-4838-8138-67b3054101db tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:43.842929 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c5bc3547-0966-4838-8138-67b3054101db tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:43.843741 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c5bc3547-0966-4838-8138-67b3054101db tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:43.849629 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c5bc3547-0966-4838-8138-67b3054101db tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:43.850357 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c5bc3547-0966-4838-8138-67b3054101db tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:43.850968 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c5bc3547-0966-4838-8138-67b3054101db tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:44.075569 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c5bc3547-0966-4838-8138-67b3054101db tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:52:44.086976 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c5bc3547-0966-4838-8138-67b3054101db tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 200 len: 1168 microversion: 2.1 time: 0.271227 Oct 23 01:52:44.088549 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3434/6773] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:52:43 2022] GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 1168 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:52:45.116985 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e8d00a11-5666-47d6-a1b1-c6c256415f0b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:52:45.118682 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e8d00a11-5666-47d6-a1b1-c6c256415f0b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:52:45.133596 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8d00a11-5666-47d6-a1b1-c6c256415f0b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:45.134448 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8d00a11-5666-47d6-a1b1-c6c256415f0b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:45.135196 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8d00a11-5666-47d6-a1b1-c6c256415f0b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:45.136086 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8d00a11-5666-47d6-a1b1-c6c256415f0b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:45.136726 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8d00a11-5666-47d6-a1b1-c6c256415f0b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:45.137450 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8d00a11-5666-47d6-a1b1-c6c256415f0b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:45.448883 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e8d00a11-5666-47d6-a1b1-c6c256415f0b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:52:45.457083 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e8d00a11-5666-47d6-a1b1-c6c256415f0b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 200 len: 1168 microversion: 2.1 time: 0.347870 Oct 23 01:52:45.457672 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3340/6774] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:52:45 2022] GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 1168 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:52:46.482868 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fd3f833b-b978-44cd-9986-37587c5cebfa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:52:46.484477 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fd3f833b-b978-44cd-9986-37587c5cebfa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:52:46.494516 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fd3f833b-b978-44cd-9986-37587c5cebfa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:46.494516 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fd3f833b-b978-44cd-9986-37587c5cebfa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:46.495268 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fd3f833b-b978-44cd-9986-37587c5cebfa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:46.496447 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fd3f833b-b978-44cd-9986-37587c5cebfa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:46.497126 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fd3f833b-b978-44cd-9986-37587c5cebfa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:46.498010 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fd3f833b-b978-44cd-9986-37587c5cebfa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:46.882833 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fd3f833b-b978-44cd-9986-37587c5cebfa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:52:46.895878 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fd3f833b-b978-44cd-9986-37587c5cebfa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 200 len: 1168 microversion: 2.1 time: 0.416829 Oct 23 01:52:46.908766 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3435/6775] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:52:46 2022] GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 1168 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:52:47.935228 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-76010de1-b601-485a-8561-4bb4c052c605 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:52:47.936036 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-76010de1-b601-485a-8561-4bb4c052c605 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:52:47.949284 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-76010de1-b601-485a-8561-4bb4c052c605 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:47.949284 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-76010de1-b601-485a-8561-4bb4c052c605 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:47.949284 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-76010de1-b601-485a-8561-4bb4c052c605 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:47.949965 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-76010de1-b601-485a-8561-4bb4c052c605 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:47.950445 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-76010de1-b601-485a-8561-4bb4c052c605 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:47.950876 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-76010de1-b601-485a-8561-4bb4c052c605 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:48.635789 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-76010de1-b601-485a-8561-4bb4c052c605 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:52:48.650403 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-76010de1-b601-485a-8561-4bb4c052c605 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 200 len: 1168 microversion: 2.1 time: 0.720523 Oct 23 01:52:48.651508 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3341/6776] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:52:47 2022] GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 1168 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:52:49.679001 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7f4b22cb-7273-43ec-8142-167f3ac63efe tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:52:49.679696 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7f4b22cb-7273-43ec-8142-167f3ac63efe tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:52:49.688684 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f4b22cb-7273-43ec-8142-167f3ac63efe tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:49.698633 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f4b22cb-7273-43ec-8142-167f3ac63efe tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:49.699353 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f4b22cb-7273-43ec-8142-167f3ac63efe tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:49.700636 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f4b22cb-7273-43ec-8142-167f3ac63efe tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:49.701380 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f4b22cb-7273-43ec-8142-167f3ac63efe tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:49.702180 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f4b22cb-7273-43ec-8142-167f3ac63efe tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:49.989313 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7f4b22cb-7273-43ec-8142-167f3ac63efe tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:52:50.008425 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7f4b22cb-7273-43ec-8142-167f3ac63efe tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 200 len: 1168 microversion: 2.1 time: 0.333275 Oct 23 01:52:50.013424 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3436/6777] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:52:49 2022] GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 1168 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:52:51.039140 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8c1ec530-6468-4527-9d45-1491ccde5076 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:52:51.048495 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8c1ec530-6468-4527-9d45-1491ccde5076 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:52:51.059736 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8c1ec530-6468-4527-9d45-1491ccde5076 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:51.060714 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8c1ec530-6468-4527-9d45-1491ccde5076 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:51.062044 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8c1ec530-6468-4527-9d45-1491ccde5076 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:51.062824 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8c1ec530-6468-4527-9d45-1491ccde5076 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:51.063960 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8c1ec530-6468-4527-9d45-1491ccde5076 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:51.064319 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8c1ec530-6468-4527-9d45-1491ccde5076 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:51.297173 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8c1ec530-6468-4527-9d45-1491ccde5076 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:52:51.314377 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8c1ec530-6468-4527-9d45-1491ccde5076 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 200 len: 1168 microversion: 2.1 time: 0.278030 Oct 23 01:52:51.316085 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3342/6778] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:52:51 2022] GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 1168 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:52:52.341895 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2ec95415-ddb7-495d-9f1f-4eb6398f46be tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:52:52.343115 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2ec95415-ddb7-495d-9f1f-4eb6398f46be tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:52:52.352088 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2ec95415-ddb7-495d-9f1f-4eb6398f46be tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:52.352830 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2ec95415-ddb7-495d-9f1f-4eb6398f46be tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:52.353838 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2ec95415-ddb7-495d-9f1f-4eb6398f46be tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:52.354753 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2ec95415-ddb7-495d-9f1f-4eb6398f46be tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:52.355758 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2ec95415-ddb7-495d-9f1f-4eb6398f46be tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:52.359910 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2ec95415-ddb7-495d-9f1f-4eb6398f46be tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:52.732000 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2ec95415-ddb7-495d-9f1f-4eb6398f46be tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:52:52.741026 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2ec95415-ddb7-495d-9f1f-4eb6398f46be tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 200 len: 1168 microversion: 2.1 time: 0.402967 Oct 23 01:52:52.765472 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3437/6779] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:52:52 2022] GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 1168 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:52:53.771629 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-dfa490e8-e322-4ba8-bc84-f77d69ddd771 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:52:53.772887 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-dfa490e8-e322-4ba8-bc84-f77d69ddd771 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:52:53.793679 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dfa490e8-e322-4ba8-bc84-f77d69ddd771 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:53.794408 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dfa490e8-e322-4ba8-bc84-f77d69ddd771 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:53.794998 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dfa490e8-e322-4ba8-bc84-f77d69ddd771 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:53.796322 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dfa490e8-e322-4ba8-bc84-f77d69ddd771 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:53.797466 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dfa490e8-e322-4ba8-bc84-f77d69ddd771 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:53.798979 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dfa490e8-e322-4ba8-bc84-f77d69ddd771 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:54.157633 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-dfa490e8-e322-4ba8-bc84-f77d69ddd771 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:52:54.167281 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-dfa490e8-e322-4ba8-bc84-f77d69ddd771 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 200 len: 1168 microversion: 2.1 time: 0.399649 Oct 23 01:52:54.167917 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3343/6780] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:52:53 2022] GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 1168 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:52:55.191919 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-65527314-f347-45a4-966d-d57b97d0f58d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:52:55.193228 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-65527314-f347-45a4-966d-d57b97d0f58d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:52:55.201855 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-65527314-f347-45a4-966d-d57b97d0f58d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:55.202379 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-65527314-f347-45a4-966d-d57b97d0f58d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:55.202826 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-65527314-f347-45a4-966d-d57b97d0f58d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:55.205243 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-65527314-f347-45a4-966d-d57b97d0f58d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:55.205243 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-65527314-f347-45a4-966d-d57b97d0f58d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:55.205243 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-65527314-f347-45a4-966d-d57b97d0f58d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:55.600224 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-65527314-f347-45a4-966d-d57b97d0f58d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:52:55.616923 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-65527314-f347-45a4-966d-d57b97d0f58d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 200 len: 1168 microversion: 2.1 time: 0.429419 Oct 23 01:52:55.619508 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3438/6781] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:52:55 2022] GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 1168 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:52:56.666433 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c881be79-2fb1-474a-8d90-e5f8422391f3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:52:56.666433 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c881be79-2fb1-474a-8d90-e5f8422391f3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:52:56.693389 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c881be79-2fb1-474a-8d90-e5f8422391f3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:56.695682 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c881be79-2fb1-474a-8d90-e5f8422391f3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:56.696300 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c881be79-2fb1-474a-8d90-e5f8422391f3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:56.698392 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c881be79-2fb1-474a-8d90-e5f8422391f3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:56.699784 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c881be79-2fb1-474a-8d90-e5f8422391f3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:56.700495 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c881be79-2fb1-474a-8d90-e5f8422391f3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:57.049653 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c881be79-2fb1-474a-8d90-e5f8422391f3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:52:57.061880 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c881be79-2fb1-474a-8d90-e5f8422391f3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 200 len: 1168 microversion: 2.1 time: 0.420627 Oct 23 01:52:57.063643 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3344/6782] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:52:56 2022] GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 1168 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:52:58.087899 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-505d8ea8-44dd-439e-9f39-d41b25d8a3ac tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:52:58.089548 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-505d8ea8-44dd-439e-9f39-d41b25d8a3ac tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:52:58.101870 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-505d8ea8-44dd-439e-9f39-d41b25d8a3ac tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:58.102664 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-505d8ea8-44dd-439e-9f39-d41b25d8a3ac tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:58.103419 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-505d8ea8-44dd-439e-9f39-d41b25d8a3ac tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:58.108502 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-505d8ea8-44dd-439e-9f39-d41b25d8a3ac tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:52:58.108978 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-505d8ea8-44dd-439e-9f39-d41b25d8a3ac tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:52:58.109412 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-505d8ea8-44dd-439e-9f39-d41b25d8a3ac tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:52:59.042709 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-505d8ea8-44dd-439e-9f39-d41b25d8a3ac tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:52:59.059137 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-505d8ea8-44dd-439e-9f39-d41b25d8a3ac tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 200 len: 1168 microversion: 2.1 time: 0.977237 Oct 23 01:52:59.060132 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3439/6783] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:52:58 2022] GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 1168 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:53:00.088205 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-dad14a40-9ee0-4d02-bd22-6e202d583ae6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:53:00.088785 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-dad14a40-9ee0-4d02-bd22-6e202d583ae6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:53:00.108347 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dad14a40-9ee0-4d02-bd22-6e202d583ae6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:00.126184 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dad14a40-9ee0-4d02-bd22-6e202d583ae6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:00.128227 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dad14a40-9ee0-4d02-bd22-6e202d583ae6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:00.130566 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dad14a40-9ee0-4d02-bd22-6e202d583ae6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:00.143544 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dad14a40-9ee0-4d02-bd22-6e202d583ae6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:00.144980 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dad14a40-9ee0-4d02-bd22-6e202d583ae6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:00.613667 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-dad14a40-9ee0-4d02-bd22-6e202d583ae6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:53:00.621055 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:53:00.633515 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-dad14a40-9ee0-4d02-bd22-6e202d583ae6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 200 len: 1168 microversion: 2.1 time: 0.544703 Oct 23 01:53:00.633515 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3345/6784] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:53:00 2022] GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 1168 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:53:01.658849 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-af58cfdd-6e80-479d-9df8-b7b05232df8b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:53:01.660010 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-af58cfdd-6e80-479d-9df8-b7b05232df8b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:53:01.684778 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=36 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:53:01.688157 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-af58cfdd-6e80-479d-9df8-b7b05232df8b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:01.690713 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-af58cfdd-6e80-479d-9df8-b7b05232df8b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:01.692387 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-af58cfdd-6e80-479d-9df8-b7b05232df8b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:01.693501 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-af58cfdd-6e80-479d-9df8-b7b05232df8b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:01.696720 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-af58cfdd-6e80-479d-9df8-b7b05232df8b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:01.700780 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-af58cfdd-6e80-479d-9df8-b7b05232df8b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:01.992936 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-af58cfdd-6e80-479d-9df8-b7b05232df8b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:53:02.003865 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-af58cfdd-6e80-479d-9df8-b7b05232df8b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 200 len: 1168 microversion: 2.1 time: 0.349870 Oct 23 01:53:02.020096 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3440/6785] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:53:01 2022] GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 1168 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:53:03.032793 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e1baa358-098e-49fb-9cd5-92ffbbd8722a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:53:03.034394 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e1baa358-098e-49fb-9cd5-92ffbbd8722a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:53:03.045575 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e1baa358-098e-49fb-9cd5-92ffbbd8722a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:03.045575 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e1baa358-098e-49fb-9cd5-92ffbbd8722a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:03.045575 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e1baa358-098e-49fb-9cd5-92ffbbd8722a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:03.045575 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e1baa358-098e-49fb-9cd5-92ffbbd8722a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:03.045575 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e1baa358-098e-49fb-9cd5-92ffbbd8722a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:03.045575 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e1baa358-098e-49fb-9cd5-92ffbbd8722a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:03.300690 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e1baa358-098e-49fb-9cd5-92ffbbd8722a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:53:03.310344 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e1baa358-098e-49fb-9cd5-92ffbbd8722a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 200 len: 1168 microversion: 2.1 time: 0.283571 Oct 23 01:53:03.332334 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3346/6786] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:53:03 2022] GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 1168 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:53:04.338602 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-198a74ff-2455-4438-9f05-71d210e1b53e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:53:04.340023 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-198a74ff-2455-4438-9f05-71d210e1b53e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:53:04.347503 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-198a74ff-2455-4438-9f05-71d210e1b53e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:04.347997 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-198a74ff-2455-4438-9f05-71d210e1b53e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:04.348434 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-198a74ff-2455-4438-9f05-71d210e1b53e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:04.349136 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-198a74ff-2455-4438-9f05-71d210e1b53e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:04.349585 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-198a74ff-2455-4438-9f05-71d210e1b53e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:04.350228 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-198a74ff-2455-4438-9f05-71d210e1b53e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:04.354405 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=86 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:53:04.544148 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-198a74ff-2455-4438-9f05-71d210e1b53e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:53:04.560967 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-198a74ff-2455-4438-9f05-71d210e1b53e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 200 len: 1168 microversion: 2.1 time: 0.226165 Oct 23 01:53:04.564986 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3441/6787] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:53:04 2022] GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 1168 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:53:05.592224 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b44e0d2c-f7ea-4dd4-9bf4-f2c02d8e2501 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:53:05.593811 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b44e0d2c-f7ea-4dd4-9bf4-f2c02d8e2501 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:53:05.602665 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b44e0d2c-f7ea-4dd4-9bf4-f2c02d8e2501 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:05.606537 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b44e0d2c-f7ea-4dd4-9bf4-f2c02d8e2501 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:05.607468 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b44e0d2c-f7ea-4dd4-9bf4-f2c02d8e2501 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:05.608438 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b44e0d2c-f7ea-4dd4-9bf4-f2c02d8e2501 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:05.609109 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b44e0d2c-f7ea-4dd4-9bf4-f2c02d8e2501 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:05.609762 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b44e0d2c-f7ea-4dd4-9bf4-f2c02d8e2501 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:05.799182 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b44e0d2c-f7ea-4dd4-9bf4-f2c02d8e2501 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:53:05.811350 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b44e0d2c-f7ea-4dd4-9bf4-f2c02d8e2501 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 200 len: 1168 microversion: 2.1 time: 0.223673 Oct 23 01:53:05.811950 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3347/6788] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:53:05 2022] GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 1168 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:53:06.836952 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-82e8d193-61b7-4cfd-b485-aba793beeabb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:53:06.837576 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-82e8d193-61b7-4cfd-b485-aba793beeabb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:53:06.845556 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-82e8d193-61b7-4cfd-b485-aba793beeabb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:06.846349 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-82e8d193-61b7-4cfd-b485-aba793beeabb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:06.855129 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-82e8d193-61b7-4cfd-b485-aba793beeabb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:06.861419 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-82e8d193-61b7-4cfd-b485-aba793beeabb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:06.862851 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-82e8d193-61b7-4cfd-b485-aba793beeabb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:06.863527 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-82e8d193-61b7-4cfd-b485-aba793beeabb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:07.150232 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-82e8d193-61b7-4cfd-b485-aba793beeabb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:53:07.164917 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-82e8d193-61b7-4cfd-b485-aba793beeabb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 200 len: 1168 microversion: 2.1 time: 0.333325 Oct 23 01:53:07.174194 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3442/6789] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:53:06 2022] GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 1168 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:53:08.193932 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0ac13543-59fc-4141-a0fc-9f04794194d6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:53:08.195032 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0ac13543-59fc-4141-a0fc-9f04794194d6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:53:08.201543 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:53:08.212584 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0ac13543-59fc-4141-a0fc-9f04794194d6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:08.215526 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0ac13543-59fc-4141-a0fc-9f04794194d6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:08.216229 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0ac13543-59fc-4141-a0fc-9f04794194d6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:08.217786 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0ac13543-59fc-4141-a0fc-9f04794194d6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:08.218380 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0ac13543-59fc-4141-a0fc-9f04794194d6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:08.219705 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0ac13543-59fc-4141-a0fc-9f04794194d6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:08.375271 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0ac13543-59fc-4141-a0fc-9f04794194d6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:53:08.384670 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0ac13543-59fc-4141-a0fc-9f04794194d6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 200 len: 1168 microversion: 2.1 time: 0.195297 Oct 23 01:53:08.385565 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3348/6790] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:53:08 2022] GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 1168 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:53:09.409097 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8e21f2c0-f456-4797-912e-d3f7013e919b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:53:09.409636 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8e21f2c0-f456-4797-912e-d3f7013e919b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:53:09.427769 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8e21f2c0-f456-4797-912e-d3f7013e919b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:09.428276 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8e21f2c0-f456-4797-912e-d3f7013e919b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:09.428739 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8e21f2c0-f456-4797-912e-d3f7013e919b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:09.429447 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8e21f2c0-f456-4797-912e-d3f7013e919b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:09.429897 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8e21f2c0-f456-4797-912e-d3f7013e919b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:09.430352 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8e21f2c0-f456-4797-912e-d3f7013e919b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:09.648187 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8e21f2c0-f456-4797-912e-d3f7013e919b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:53:09.657880 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8e21f2c0-f456-4797-912e-d3f7013e919b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 200 len: 1168 microversion: 2.1 time: 0.252296 Oct 23 01:53:09.663271 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3443/6791] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:53:09 2022] GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 1168 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:53:10.684748 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-eb60feef-c077-43c9-a2c8-63fcd35b23fd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:53:10.686034 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-eb60feef-c077-43c9-a2c8-63fcd35b23fd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:53:10.713524 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eb60feef-c077-43c9-a2c8-63fcd35b23fd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:10.714060 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eb60feef-c077-43c9-a2c8-63fcd35b23fd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:10.716336 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eb60feef-c077-43c9-a2c8-63fcd35b23fd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:10.718128 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eb60feef-c077-43c9-a2c8-63fcd35b23fd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:10.720127 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eb60feef-c077-43c9-a2c8-63fcd35b23fd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:10.721656 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eb60feef-c077-43c9-a2c8-63fcd35b23fd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:10.935452 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-eb60feef-c077-43c9-a2c8-63fcd35b23fd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:53:10.946198 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-eb60feef-c077-43c9-a2c8-63fcd35b23fd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 200 len: 1168 microversion: 2.1 time: 0.265991 Oct 23 01:53:10.947073 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3349/6792] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:53:10 2022] GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 1168 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:53:11.973369 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2b6492fe-8dc8-4094-b0c1-cf1d44fc07f0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:53:11.974698 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2b6492fe-8dc8-4094-b0c1-cf1d44fc07f0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:53:11.983523 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2b6492fe-8dc8-4094-b0c1-cf1d44fc07f0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:11.984309 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2b6492fe-8dc8-4094-b0c1-cf1d44fc07f0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:11.994439 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2b6492fe-8dc8-4094-b0c1-cf1d44fc07f0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:11.995420 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2b6492fe-8dc8-4094-b0c1-cf1d44fc07f0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:11.996408 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2b6492fe-8dc8-4094-b0c1-cf1d44fc07f0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:11.997323 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2b6492fe-8dc8-4094-b0c1-cf1d44fc07f0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:12.231866 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2b6492fe-8dc8-4094-b0c1-cf1d44fc07f0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:53:12.243940 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2b6492fe-8dc8-4094-b0c1-cf1d44fc07f0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 200 len: 1202 microversion: 2.1 time: 0.276988 Oct 23 01:53:12.245005 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3444/6793] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:53:11 2022] GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 1202 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:53:13.274902 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d83f78fc-7432-4d47-8819-8b037d5c07bd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:53:13.274902 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d83f78fc-7432-4d47-8819-8b037d5c07bd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:53:13.279501 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d83f78fc-7432-4d47-8819-8b037d5c07bd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:13.281368 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d83f78fc-7432-4d47-8819-8b037d5c07bd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:13.282584 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d83f78fc-7432-4d47-8819-8b037d5c07bd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:13.283636 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d83f78fc-7432-4d47-8819-8b037d5c07bd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:13.284601 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d83f78fc-7432-4d47-8819-8b037d5c07bd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:13.285455 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d83f78fc-7432-4d47-8819-8b037d5c07bd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:13.518551 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d83f78fc-7432-4d47-8819-8b037d5c07bd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:53:13.535540 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d83f78fc-7432-4d47-8819-8b037d5c07bd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 200 len: 1202 microversion: 2.1 time: 0.271232 Oct 23 01:53:13.536475 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3350/6794] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:53:13 2022] GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 1202 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:53:14.558416 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0de59ed7-e025-49e1-b944-4f67f355ef6b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:53:14.559188 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0de59ed7-e025-49e1-b944-4f67f355ef6b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:53:14.567896 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0de59ed7-e025-49e1-b944-4f67f355ef6b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:14.568396 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0de59ed7-e025-49e1-b944-4f67f355ef6b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:14.568840 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0de59ed7-e025-49e1-b944-4f67f355ef6b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:14.569541 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0de59ed7-e025-49e1-b944-4f67f355ef6b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:14.570029 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0de59ed7-e025-49e1-b944-4f67f355ef6b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:14.570611 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0de59ed7-e025-49e1-b944-4f67f355ef6b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:14.829873 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0de59ed7-e025-49e1-b944-4f67f355ef6b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:53:14.838071 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0de59ed7-e025-49e1-b944-4f67f355ef6b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 200 len: 1202 microversion: 2.1 time: 0.283871 Oct 23 01:53:14.838665 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3445/6795] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:53:14 2022] GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 1202 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:53:15.862967 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-114a33b1-5e37-47e2-98cd-c222087b0bac tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:53:15.863638 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-114a33b1-5e37-47e2-98cd-c222087b0bac tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:53:15.871350 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-114a33b1-5e37-47e2-98cd-c222087b0bac tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:15.872114 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-114a33b1-5e37-47e2-98cd-c222087b0bac tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:15.872546 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-114a33b1-5e37-47e2-98cd-c222087b0bac tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:15.873357 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-114a33b1-5e37-47e2-98cd-c222087b0bac tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:15.873810 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-114a33b1-5e37-47e2-98cd-c222087b0bac tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:15.874273 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-114a33b1-5e37-47e2-98cd-c222087b0bac tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:16.036103 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-114a33b1-5e37-47e2-98cd-c222087b0bac tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:53:16.044053 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-114a33b1-5e37-47e2-98cd-c222087b0bac tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 200 len: 1202 microversion: 2.1 time: 0.185772 Oct 23 01:53:16.044642 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3351/6796] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:53:15 2022] GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 1202 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:53:17.068990 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5e8daaa5-5941-456f-8227-1f09b6508384 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:53:17.070551 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5e8daaa5-5941-456f-8227-1f09b6508384 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:53:17.078346 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5e8daaa5-5941-456f-8227-1f09b6508384 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:17.079656 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5e8daaa5-5941-456f-8227-1f09b6508384 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:17.080198 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5e8daaa5-5941-456f-8227-1f09b6508384 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:17.080981 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5e8daaa5-5941-456f-8227-1f09b6508384 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:17.081531 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5e8daaa5-5941-456f-8227-1f09b6508384 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:17.082061 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5e8daaa5-5941-456f-8227-1f09b6508384 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:17.255024 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5e8daaa5-5941-456f-8227-1f09b6508384 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:53:17.264171 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5e8daaa5-5941-456f-8227-1f09b6508384 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 200 len: 1202 microversion: 2.1 time: 0.199426 Oct 23 01:53:17.267086 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3446/6797] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:53:17 2022] GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 1202 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:53:18.288662 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-36d5ca74-e04f-432f-aeff-46c49e31066e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:53:18.289427 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-36d5ca74-e04f-432f-aeff-46c49e31066e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:53:18.297245 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36d5ca74-e04f-432f-aeff-46c49e31066e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:18.298036 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36d5ca74-e04f-432f-aeff-46c49e31066e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:18.298721 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36d5ca74-e04f-432f-aeff-46c49e31066e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:18.299609 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36d5ca74-e04f-432f-aeff-46c49e31066e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:18.300076 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36d5ca74-e04f-432f-aeff-46c49e31066e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:18.300505 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36d5ca74-e04f-432f-aeff-46c49e31066e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:18.482270 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-36d5ca74-e04f-432f-aeff-46c49e31066e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:53:18.491666 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-36d5ca74-e04f-432f-aeff-46c49e31066e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 200 len: 1202 microversion: 2.1 time: 0.207028 Oct 23 01:53:18.492538 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3352/6798] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:53:18 2022] GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 1202 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:53:19.515819 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b135fa90-8c70-4212-8ddd-00d2807f4402 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:53:19.516482 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b135fa90-8c70-4212-8ddd-00d2807f4402 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:53:19.536508 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b135fa90-8c70-4212-8ddd-00d2807f4402 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:19.537418 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b135fa90-8c70-4212-8ddd-00d2807f4402 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:19.538595 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b135fa90-8c70-4212-8ddd-00d2807f4402 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:19.539679 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b135fa90-8c70-4212-8ddd-00d2807f4402 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:19.541160 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b135fa90-8c70-4212-8ddd-00d2807f4402 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:19.542096 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b135fa90-8c70-4212-8ddd-00d2807f4402 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:19.732374 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b135fa90-8c70-4212-8ddd-00d2807f4402 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:53:19.742048 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b135fa90-8c70-4212-8ddd-00d2807f4402 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 200 len: 1202 microversion: 2.1 time: 0.230474 Oct 23 01:53:19.751458 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3447/6799] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:53:19 2022] GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 1202 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:53:20.771716 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d3b02e69-d93f-4670-9d8d-79909a2d6910 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:53:20.774680 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d3b02e69-d93f-4670-9d8d-79909a2d6910 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:53:20.812400 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d3b02e69-d93f-4670-9d8d-79909a2d6910 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:20.816952 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d3b02e69-d93f-4670-9d8d-79909a2d6910 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:20.817443 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d3b02e69-d93f-4670-9d8d-79909a2d6910 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:20.819017 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d3b02e69-d93f-4670-9d8d-79909a2d6910 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:20.823793 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d3b02e69-d93f-4670-9d8d-79909a2d6910 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:20.828708 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d3b02e69-d93f-4670-9d8d-79909a2d6910 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:21.078041 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d3b02e69-d93f-4670-9d8d-79909a2d6910 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:53:21.087885 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d3b02e69-d93f-4670-9d8d-79909a2d6910 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 200 len: 1202 microversion: 2.1 time: 0.324904 Oct 23 01:53:21.106551 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3353/6800] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:53:20 2022] GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 1202 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:53:22.119366 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e9da84b3-d628-4fd6-86dd-dd665c8ab63c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:53:22.120559 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e9da84b3-d628-4fd6-86dd-dd665c8ab63c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:53:22.128322 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9da84b3-d628-4fd6-86dd-dd665c8ab63c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:22.128989 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9da84b3-d628-4fd6-86dd-dd665c8ab63c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:22.129430 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9da84b3-d628-4fd6-86dd-dd665c8ab63c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:22.130360 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9da84b3-d628-4fd6-86dd-dd665c8ab63c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:22.130996 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9da84b3-d628-4fd6-86dd-dd665c8ab63c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:22.131597 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9da84b3-d628-4fd6-86dd-dd665c8ab63c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:22.327621 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e9da84b3-d628-4fd6-86dd-dd665c8ab63c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:53:22.336493 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e9da84b3-d628-4fd6-86dd-dd665c8ab63c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 200 len: 1202 microversion: 2.1 time: 0.226635 Oct 23 01:53:22.337201 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3448/6801] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:53:22 2022] GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 1202 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:53:23.360583 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2bbeacf5-227e-4cd9-8d22-5bc372c2b14c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:53:23.361216 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2bbeacf5-227e-4cd9-8d22-5bc372c2b14c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:53:23.374604 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2bbeacf5-227e-4cd9-8d22-5bc372c2b14c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:23.374604 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2bbeacf5-227e-4cd9-8d22-5bc372c2b14c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:23.374604 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2bbeacf5-227e-4cd9-8d22-5bc372c2b14c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:23.374604 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2bbeacf5-227e-4cd9-8d22-5bc372c2b14c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:23.374604 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2bbeacf5-227e-4cd9-8d22-5bc372c2b14c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:23.374604 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2bbeacf5-227e-4cd9-8d22-5bc372c2b14c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:23.378857 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-9e69572b-5cb7-4142-92f4-1435b8787362 req-111d631c-8b46-42f7-bb27-ad1779b65caf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c02a0c2-86a4-460d-abfd-b3cfaf92bb39", "name": "network-vif-plugged", "status": "completed", "tag": "07ca9d49-9e2a-47c2-9b72-1fd6a3e3b5b8"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:53:23.397108 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-9e69572b-5cb7-4142-92f4-1435b8787362 req-111d631c-8b46-42f7-bb27-ad1779b65caf service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:23.397600 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-9e69572b-5cb7-4142-92f4-1435b8787362 req-111d631c-8b46-42f7-bb27-ad1779b65caf service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:23.398058 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-9e69572b-5cb7-4142-92f4-1435b8787362 req-111d631c-8b46-42f7-bb27-ad1779b65caf service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:23.419746 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-9e69572b-5cb7-4142-92f4-1435b8787362 req-111d631c-8b46-42f7-bb27-ad1779b65caf service nova] Creating event network-vif-plugged:07ca9d49-9e2a-47c2-9b72-1fd6a3e3b5b8 for instance 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 on n-h2-master-1 Oct 23 01:53:23.425330 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-9e69572b-5cb7-4142-92f4-1435b8787362 req-111d631c-8b46-42f7-bb27-ad1779b65caf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050351 Oct 23 01:53:23.425945 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3449/6802] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:53:23.595879 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2bbeacf5-227e-4cd9-8d22-5bc372c2b14c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:53:23.613209 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2bbeacf5-227e-4cd9-8d22-5bc372c2b14c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 200 len: 1202 microversion: 2.1 time: 0.257220 Oct 23 01:53:23.614837 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3354/6803] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:53:23 2022] GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 1202 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:53:24.640730 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fdd2712c-5de7-4925-ac80-9185c118bc18 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:53:24.642212 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fdd2712c-5de7-4925-ac80-9185c118bc18 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:53:24.658335 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fdd2712c-5de7-4925-ac80-9185c118bc18 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:24.658335 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fdd2712c-5de7-4925-ac80-9185c118bc18 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:24.658335 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fdd2712c-5de7-4925-ac80-9185c118bc18 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:24.658335 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fdd2712c-5de7-4925-ac80-9185c118bc18 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:24.658950 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fdd2712c-5de7-4925-ac80-9185c118bc18 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:24.658950 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fdd2712c-5de7-4925-ac80-9185c118bc18 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:24.905511 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fdd2712c-5de7-4925-ac80-9185c118bc18 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:53:24.918703 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fdd2712c-5de7-4925-ac80-9185c118bc18 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 200 len: 1202 microversion: 2.1 time: 0.279682 Oct 23 01:53:24.920370 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3450/6804] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:53:24 2022] GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 1202 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:53:25.960367 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-894e38a4-8ab4-4168-b6d1-44e7da01d49f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:53:25.960367 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-894e38a4-8ab4-4168-b6d1-44e7da01d49f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:53:25.980932 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-894e38a4-8ab4-4168-b6d1-44e7da01d49f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:25.982969 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-894e38a4-8ab4-4168-b6d1-44e7da01d49f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:25.984750 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-894e38a4-8ab4-4168-b6d1-44e7da01d49f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:25.986959 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-894e38a4-8ab4-4168-b6d1-44e7da01d49f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:25.987392 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-894e38a4-8ab4-4168-b6d1-44e7da01d49f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:25.987846 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-894e38a4-8ab4-4168-b6d1-44e7da01d49f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:26.206644 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-894e38a4-8ab4-4168-b6d1-44e7da01d49f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:53:26.216461 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-894e38a4-8ab4-4168-b6d1-44e7da01d49f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 200 len: 1390 microversion: 2.1 time: 0.273757 Oct 23 01:53:26.230070 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3355/6805] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:53:25 2022] GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 1390 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:53:26.240161 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fb1a86a2-f7cb-4a14-b2ca-a7d6a8e47457 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:53:26.240901 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fb1a86a2-f7cb-4a14-b2ca-a7d6a8e47457 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:53:26.248373 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb1a86a2-f7cb-4a14-b2ca-a7d6a8e47457 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:26.249179 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb1a86a2-f7cb-4a14-b2ca-a7d6a8e47457 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:26.249796 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb1a86a2-f7cb-4a14-b2ca-a7d6a8e47457 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:26.250948 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb1a86a2-f7cb-4a14-b2ca-a7d6a8e47457 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:26.251586 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb1a86a2-f7cb-4a14-b2ca-a7d6a8e47457 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:26.252178 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb1a86a2-f7cb-4a14-b2ca-a7d6a8e47457 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:26.433031 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fb1a86a2-f7cb-4a14-b2ca-a7d6a8e47457 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:53:26.442450 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fb1a86a2-f7cb-4a14-b2ca-a7d6a8e47457 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 200 len: 1390 microversion: 2.1 time: 0.206074 Oct 23 01:53:26.468978 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4f196b64-06f2-44d9-8e38-e11b7fe5de82 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:53:26.470239 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4f196b64-06f2-44d9-8e38-e11b7fe5de82 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:53:26.472002 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3451/6806] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:53:26 2022] GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 1390 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:53:26.479784 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f196b64-06f2-44d9-8e38-e11b7fe5de82 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:26.482005 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f196b64-06f2-44d9-8e38-e11b7fe5de82 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:26.482656 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f196b64-06f2-44d9-8e38-e11b7fe5de82 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:26.484234 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f196b64-06f2-44d9-8e38-e11b7fe5de82 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:26.486070 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f196b64-06f2-44d9-8e38-e11b7fe5de82 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:26.486672 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f196b64-06f2-44d9-8e38-e11b7fe5de82 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:26.766289 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4f196b64-06f2-44d9-8e38-e11b7fe5de82 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:53:26.776876 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4f196b64-06f2-44d9-8e38-e11b7fe5de82 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 200 len: 1390 microversion: 2.1 time: 0.311840 Oct 23 01:53:26.777685 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3356/6807] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:53:26 2022] GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 1390 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:53:26.876301 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-be9cbeec-a538-4e59-8f0a-b00e37a95b4c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:53:26.877485 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-be9cbeec-a538-4e59-8f0a-b00e37a95b4c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:53:26.887710 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-be9cbeec-a538-4e59-8f0a-b00e37a95b4c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:26.888454 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-be9cbeec-a538-4e59-8f0a-b00e37a95b4c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:26.889064 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-be9cbeec-a538-4e59-8f0a-b00e37a95b4c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:26.889994 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-be9cbeec-a538-4e59-8f0a-b00e37a95b4c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:26.890770 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-be9cbeec-a538-4e59-8f0a-b00e37a95b4c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:26.891410 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-be9cbeec-a538-4e59-8f0a-b00e37a95b4c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:26.925486 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-be9cbeec-a538-4e59-8f0a-b00e37a95b4c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:53:27.263640 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-be9cbeec-a538-4e59-8f0a-b00e37a95b4c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 204 len: 0 microversion: 2.1 time: 0.392901 Oct 23 01:53:27.265383 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3452/6808] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:53:26 2022] DELETE /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:53:27.273868 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c833b2c1-29de-4ddd-9264-796be2b24c5b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:53:27.280242 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c833b2c1-29de-4ddd-9264-796be2b24c5b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:53:27.283993 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c833b2c1-29de-4ddd-9264-796be2b24c5b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:27.284680 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c833b2c1-29de-4ddd-9264-796be2b24c5b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:27.285462 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c833b2c1-29de-4ddd-9264-796be2b24c5b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:27.288716 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c833b2c1-29de-4ddd-9264-796be2b24c5b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:27.289912 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c833b2c1-29de-4ddd-9264-796be2b24c5b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:27.290555 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c833b2c1-29de-4ddd-9264-796be2b24c5b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:27.539831 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c833b2c1-29de-4ddd-9264-796be2b24c5b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:53:27.548780 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c833b2c1-29de-4ddd-9264-796be2b24c5b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 200 len: 1396 microversion: 2.1 time: 0.278692 Oct 23 01:53:27.549450 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3357/6809] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:53:27 2022] GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 1396 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:53:28.573277 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-42c2f09b-7105-46bf-b86a-74530f6cbd24 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:53:28.574007 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-42c2f09b-7105-46bf-b86a-74530f6cbd24 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:53:28.583810 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-42c2f09b-7105-46bf-b86a-74530f6cbd24 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:28.584319 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-42c2f09b-7105-46bf-b86a-74530f6cbd24 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:28.584767 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-42c2f09b-7105-46bf-b86a-74530f6cbd24 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:28.585474 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-42c2f09b-7105-46bf-b86a-74530f6cbd24 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:28.585944 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-42c2f09b-7105-46bf-b86a-74530f6cbd24 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:28.586407 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-42c2f09b-7105-46bf-b86a-74530f6cbd24 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:28.732406 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-42c2f09b-7105-46bf-b86a-74530f6cbd24 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:53:28.741121 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-42c2f09b-7105-46bf-b86a-74530f6cbd24 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 200 len: 1396 microversion: 2.1 time: 0.172057 Oct 23 01:53:28.741698 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3453/6810] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:53:28 2022] GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 1396 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:53:29.765548 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-25448ada-9c8d-4b60-a179-dfa7bd1ebc30 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:53:29.770647 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-25448ada-9c8d-4b60-a179-dfa7bd1ebc30 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:53:29.778502 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25448ada-9c8d-4b60-a179-dfa7bd1ebc30 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:29.779256 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25448ada-9c8d-4b60-a179-dfa7bd1ebc30 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:29.779873 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25448ada-9c8d-4b60-a179-dfa7bd1ebc30 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:29.780902 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25448ada-9c8d-4b60-a179-dfa7bd1ebc30 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:29.781586 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25448ada-9c8d-4b60-a179-dfa7bd1ebc30 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:29.782239 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25448ada-9c8d-4b60-a179-dfa7bd1ebc30 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:29.882109 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-eb1b6712-fb74-4272-92a2-3df3a58eea49 req-40dcfaf9-6470-470a-ad79-9db66ff5bcfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c02a0c2-86a4-460d-abfd-b3cfaf92bb39", "name": "network-vif-deleted", "tag": "07ca9d49-9e2a-47c2-9b72-1fd6a3e3b5b8"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:53:29.894446 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-eb1b6712-fb74-4272-92a2-3df3a58eea49 req-40dcfaf9-6470-470a-ad79-9db66ff5bcfb service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:29.894931 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-eb1b6712-fb74-4272-92a2-3df3a58eea49 req-40dcfaf9-6470-470a-ad79-9db66ff5bcfb service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:29.895365 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-eb1b6712-fb74-4272-92a2-3df3a58eea49 req-40dcfaf9-6470-470a-ad79-9db66ff5bcfb service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:29.900507 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-25448ada-9c8d-4b60-a179-dfa7bd1ebc30 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:53:29.908924 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-eb1b6712-fb74-4272-92a2-3df3a58eea49 req-40dcfaf9-6470-470a-ad79-9db66ff5bcfb service nova] Creating event network-vif-deleted:07ca9d49-9e2a-47c2-9b72-1fd6a3e3b5b8 for instance 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 on n-h2-master-1 Oct 23 01:53:29.912085 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-25448ada-9c8d-4b60-a179-dfa7bd1ebc30 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 200 len: 1354 microversion: 2.1 time: 0.150889 Oct 23 01:53:29.913130 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3454/6811] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:53:29 2022] GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 1354 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:53:29.924663 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-eb1b6712-fb74-4272-92a2-3df3a58eea49 req-40dcfaf9-6470-470a-ad79-9db66ff5bcfb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.240971 Oct 23 01:53:29.925611 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3358/6812] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:53:30.936988 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e256206d-d43e-4cf2-afea-973cf1bd0580 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:53:30.937639 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e256206d-d43e-4cf2-afea-973cf1bd0580 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:53:30.945724 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e256206d-d43e-4cf2-afea-973cf1bd0580 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:30.946263 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e256206d-d43e-4cf2-afea-973cf1bd0580 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:30.946771 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e256206d-d43e-4cf2-afea-973cf1bd0580 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:30.955320 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e256206d-d43e-4cf2-afea-973cf1bd0580 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:30.955320 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e256206d-d43e-4cf2-afea-973cf1bd0580 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:30.955320 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e256206d-d43e-4cf2-afea-973cf1bd0580 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:31.034943 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e256206d-d43e-4cf2-afea-973cf1bd0580 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:53:31.052238 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e256206d-d43e-4cf2-afea-973cf1bd0580 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 200 len: 1187 microversion: 2.1 time: 0.118484 Oct 23 01:53:31.054385 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3455/6813] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:53:30 2022] GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 1187 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:53:32.082093 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-54158e08-136d-40ea-8ff8-73004c2963b4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:53:32.082998 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-54158e08-136d-40ea-8ff8-73004c2963b4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:53:32.092708 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54158e08-136d-40ea-8ff8-73004c2963b4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:32.093387 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54158e08-136d-40ea-8ff8-73004c2963b4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:32.093526 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54158e08-136d-40ea-8ff8-73004c2963b4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:32.094643 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54158e08-136d-40ea-8ff8-73004c2963b4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:32.095044 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54158e08-136d-40ea-8ff8-73004c2963b4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:32.095675 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54158e08-136d-40ea-8ff8-73004c2963b4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:32.184015 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-54158e08-136d-40ea-8ff8-73004c2963b4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:53:32.193813 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-54158e08-136d-40ea-8ff8-73004c2963b4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 200 len: 1187 microversion: 2.1 time: 0.117429 Oct 23 01:53:32.194474 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3359/6814] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:53:32 2022] GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 1187 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:53:33.229882 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ce547814-a7ab-4439-bc4c-37f10ca7b007 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:53:33.229882 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ce547814-a7ab-4439-bc4c-37f10ca7b007 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:53:33.229882 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:53:33.229882 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce547814-a7ab-4439-bc4c-37f10ca7b007 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:33.229882 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce547814-a7ab-4439-bc4c-37f10ca7b007 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:33.229882 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce547814-a7ab-4439-bc4c-37f10ca7b007 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:33.231292 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce547814-a7ab-4439-bc4c-37f10ca7b007 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:33.231292 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce547814-a7ab-4439-bc4c-37f10ca7b007 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:33.232502 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce547814-a7ab-4439-bc4c-37f10ca7b007 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:33.421122 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ce547814-a7ab-4439-bc4c-37f10ca7b007 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:53:33.424602 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:53:33.435862 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ce547814-a7ab-4439-bc4c-37f10ca7b007 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 200 len: 1187 microversion: 2.1 time: 0.220296 Oct 23 01:53:33.437736 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3456/6815] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:53:33 2022] GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 1187 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:53:34.462547 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a73cd596-b5cb-4a58-9e08-66e839e067ad tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:53:34.463173 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a73cd596-b5cb-4a58-9e08-66e839e067ad tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:53:34.477491 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a73cd596-b5cb-4a58-9e08-66e839e067ad tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:34.478234 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a73cd596-b5cb-4a58-9e08-66e839e067ad tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:34.479063 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a73cd596-b5cb-4a58-9e08-66e839e067ad tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:34.479772 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a73cd596-b5cb-4a58-9e08-66e839e067ad tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:34.480230 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a73cd596-b5cb-4a58-9e08-66e839e067ad tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:34.480656 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a73cd596-b5cb-4a58-9e08-66e839e067ad tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:34.483747 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=82 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:53:34.556433 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a73cd596-b5cb-4a58-9e08-66e839e067ad tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:53:34.565490 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a73cd596-b5cb-4a58-9e08-66e839e067ad tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 200 len: 1187 microversion: 2.1 time: 0.107117 Oct 23 01:53:34.579619 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3360/6816] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:53:34 2022] GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 1187 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:53:35.591533 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8a8db3f8-4698-4ad7-9688-500b2b300b8c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:53:35.591971 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8a8db3f8-4698-4ad7-9688-500b2b300b8c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:53:35.599472 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8a8db3f8-4698-4ad7-9688-500b2b300b8c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:35.601093 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8a8db3f8-4698-4ad7-9688-500b2b300b8c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:35.601093 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8a8db3f8-4698-4ad7-9688-500b2b300b8c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:35.601310 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8a8db3f8-4698-4ad7-9688-500b2b300b8c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:35.601604 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8a8db3f8-4698-4ad7-9688-500b2b300b8c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:35.602133 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8a8db3f8-4698-4ad7-9688-500b2b300b8c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:35.653364 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8a8db3f8-4698-4ad7-9688-500b2b300b8c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:35.654101 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8a8db3f8-4698-4ad7-9688-500b2b300b8c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:35.654620 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8a8db3f8-4698-4ad7-9688-500b2b300b8c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:35.655238 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-8a8db3f8-4698-4ad7-9688-500b2b300b8c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lazy-loading 'fault' on Instance uuid 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:53:35.745440 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8a8db3f8-4698-4ad7-9688-500b2b300b8c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:53:35.759681 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8a8db3f8-4698-4ad7-9688-500b2b300b8c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 200 len: 1192 microversion: 2.1 time: 0.173164 Oct 23 01:53:35.760286 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3457/6817] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:53:35 2022] GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 1192 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:53:36.785064 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d838b087-ce7d-44a9-afce-4b4d989d271e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:53:36.786413 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d838b087-ce7d-44a9-afce-4b4d989d271e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:53:36.793591 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d838b087-ce7d-44a9-afce-4b4d989d271e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:36.794434 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d838b087-ce7d-44a9-afce-4b4d989d271e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:36.795117 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d838b087-ce7d-44a9-afce-4b4d989d271e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:36.796133 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d838b087-ce7d-44a9-afce-4b4d989d271e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:36.796811 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d838b087-ce7d-44a9-afce-4b4d989d271e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:36.797511 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d838b087-ce7d-44a9-afce-4b4d989d271e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:36.816730 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-d838b087-ce7d-44a9-afce-4b4d989d271e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] HTTP exception thrown: Instance 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 could not be found. Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d838b087-ce7d-44a9-afce-4b4d989d271e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Request method failure captured: Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 HTTP/1.1 Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJ238gvy9Iqj-gh_hYMMA3k82GIwOXmge1ZpdCVbStgEi7Wx0Hp0nUD39OZgeTVVZUzzMU6rbj6VKVMThBnKMFJkrT_c4TpJItwEaxJM150Q197EeZTFOgQpHEVnJj9TzM6T9aiiAWqKRliV_RYi1MvsQfVRPMVtUboRY7WK1bO1DBQ Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: b1ec0b5ecaa741eaaf40a50f1415e7f9 Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-TestVolumeBootPattern-219047212 Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}] Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-TestVolumeBootPattern-219047212 Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: b1ec0b5ecaa741eaaf40a50f1415e7f9 Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-TestVolumeBootPattern-219047212 Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-TestVolumeBootPattern-219047212-project Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: f2967d0d8c134d269c9bbe51c90f803a Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-TestVolumeBootPattern-219047212-project Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 could not be found. Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '0c02a0c2-86a4-460d-abfd-b3cfaf92bb39'} Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 could not be found. Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 could not be found. Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:53:36.832124 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:53:36.836809 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:53:36.836809 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:53:36.836809 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:53:36.836809 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:53:36.836809 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:53:36.836809 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 could not be found. Oct 23 01:53:36.836809 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:53:36.838693 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d838b087-ce7d-44a9-afce-4b4d989d271e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Returning 404 to user: Instance 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:53:36.839817 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d838b087-ce7d-44a9-afce-4b4d989d271e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 404 len: 111 microversion: 2.1 time: 0.059093 Oct 23 01:53:36.840629 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3361/6818] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:53:36 2022] GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:53:40.294988 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-71a85442-a8dc-49bf-a8c5-bdd9c820bb5f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:53:40.296569 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-71a85442-a8dc-49bf-a8c5-bdd9c820bb5f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:53:40.315163 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-71a85442-a8dc-49bf-a8c5-bdd9c820bb5f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:40.320258 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-71a85442-a8dc-49bf-a8c5-bdd9c820bb5f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:40.320258 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-71a85442-a8dc-49bf-a8c5-bdd9c820bb5f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:40.320258 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-71a85442-a8dc-49bf-a8c5-bdd9c820bb5f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:40.320258 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-71a85442-a8dc-49bf-a8c5-bdd9c820bb5f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:40.320258 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-71a85442-a8dc-49bf-a8c5-bdd9c820bb5f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:40.338286 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-71a85442-a8dc-49bf-a8c5-bdd9c820bb5f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] HTTP exception thrown: Instance 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 could not be found. Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-71a85442-a8dc-49bf-a8c5-bdd9c820bb5f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Request method failure captured: Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 HTTP/1.1 Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJ238gvy9Iqj-gh_hYMMA3k82GIwOXmge1ZpdCVbStgEi7Wx0Hp0nUD39OZgeTVVZUzzMU6rbj6VKVMThBnKMFJkrT_c4TpJItwEaxJM150Q197EeZTFOgQpHEVnJj9TzM6T9aiiAWqKRliV_RYi1MvsQfVRPMVtUboRY7WK1bO1DBQ Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: b1ec0b5ecaa741eaaf40a50f1415e7f9 Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-TestVolumeBootPattern-219047212 Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}] Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-TestVolumeBootPattern-219047212 Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: b1ec0b5ecaa741eaaf40a50f1415e7f9 Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-TestVolumeBootPattern-219047212 Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-TestVolumeBootPattern-219047212-project Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: f2967d0d8c134d269c9bbe51c90f803a Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-TestVolumeBootPattern-219047212-project Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 could not be found. Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '0c02a0c2-86a4-460d-abfd-b3cfaf92bb39'} Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 could not be found. Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:53:40.341717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:53:40.364275 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 could not be found. Oct 23 01:53:40.364275 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:53:40.364275 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:53:40.364275 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:53:40.364275 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:53:40.364275 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:53:40.364275 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:53:40.364275 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:53:40.364275 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:53:40.364275 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 could not be found. Oct 23 01:53:40.364275 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:53:40.364275 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-71a85442-a8dc-49bf-a8c5-bdd9c820bb5f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Returning 404 to user: Instance 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:53:40.364275 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-71a85442-a8dc-49bf-a8c5-bdd9c820bb5f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 404 len: 111 microversion: 2.1 time: 0.069133 Oct 23 01:53:40.364275 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3458/6819] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:53:40 2022] DELETE /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:53:40.365910 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b76443d5-2a58-4857-afc0-f212d4776786 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:53:40.365910 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b76443d5-2a58-4857-afc0-f212d4776786 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:53:40.377452 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b76443d5-2a58-4857-afc0-f212d4776786 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:40.379699 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b76443d5-2a58-4857-afc0-f212d4776786 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:40.382774 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b76443d5-2a58-4857-afc0-f212d4776786 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:40.384178 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b76443d5-2a58-4857-afc0-f212d4776786 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:53:40.384773 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b76443d5-2a58-4857-afc0-f212d4776786 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:53:40.389057 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b76443d5-2a58-4857-afc0-f212d4776786 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:53:40.408401 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-b76443d5-2a58-4857-afc0-f212d4776786 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] HTTP exception thrown: Instance 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 could not be found. Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b76443d5-2a58-4857-afc0-f212d4776786 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Request method failure captured: Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 HTTP/1.1 Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJ238gvy9Iqj-gh_hYMMA3k82GIwOXmge1ZpdCVbStgEi7Wx0Hp0nUD39OZgeTVVZUzzMU6rbj6VKVMThBnKMFJkrT_c4TpJItwEaxJM150Q197EeZTFOgQpHEVnJj9TzM6T9aiiAWqKRliV_RYi1MvsQfVRPMVtUboRY7WK1bO1DBQ Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: b1ec0b5ecaa741eaaf40a50f1415e7f9 Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-TestVolumeBootPattern-219047212 Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}] Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-TestVolumeBootPattern-219047212 Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: b1ec0b5ecaa741eaaf40a50f1415e7f9 Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-TestVolumeBootPattern-219047212 Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-TestVolumeBootPattern-219047212-project Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: f2967d0d8c134d269c9bbe51c90f803a Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-TestVolumeBootPattern-219047212-project Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 could not be found. Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '0c02a0c2-86a4-460d-abfd-b3cfaf92bb39'} Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 could not be found. Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 could not be found. Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:53:40.410704 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:53:40.415963 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:53:40.415963 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:53:40.415963 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:53:40.415963 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:53:40.415963 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:53:40.415963 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 could not be found. Oct 23 01:53:40.415963 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:53:40.417927 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b76443d5-2a58-4857-afc0-f212d4776786 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Returning 404 to user: Instance 0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:53:40.419126 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b76443d5-2a58-4857-afc0-f212d4776786 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39" status: 404 len: 111 microversion: 2.1 time: 0.062558 Oct 23 01:53:40.420252 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3362/6820] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:53:40 2022] GET /compute/v2.1/servers/0c02a0c2-86a4-460d-abfd-b3cfaf92bb39 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:54:20.100544 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-af392aff-c33b-4f01-8af2-20aee622eb39 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1324619529", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "2c4fefd6-03ff-47a2-856e-abb18ac0f7e4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "e056504c-8568-4f9a-a3ed-bae9f108b4ab"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:54:20.112206 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=7 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:54:20.112911 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=11 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:54:20.114348 n-d-master-1 devstack@n-api.service[120944]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 23 01:54:20.117964 n-d-master-1 devstack@n-api.service[120944]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 23 01:54:20.118139 n-d-master-1 devstack@n-api.service[120944]: Sun Oct 23 01:54:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.42) !!! Oct 23 01:54:20.182712 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-af392aff-c33b-4f01-8af2-20aee622eb39 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] validate_networks() for [('e056504c-8568-4f9a-a3ed-bae9f108b4ab', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:54:20.705398 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-af392aff-c33b-4f01-8af2-20aee622eb39 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:54:20.706136 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-af392aff-c33b-4f01-8af2-20aee622eb39 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:54:20.712866 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-af392aff-c33b-4f01-8af2-20aee622eb39 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:54:20.712866 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-af392aff-c33b-4f01-8af2-20aee622eb39 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:54:20.712866 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-af392aff-c33b-4f01-8af2-20aee622eb39 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:54:20.717201 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-af392aff-c33b-4f01-8af2-20aee622eb39 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:20.717805 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-af392aff-c33b-4f01-8af2-20aee622eb39 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:20.718465 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-af392aff-c33b-4f01-8af2-20aee622eb39 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:20.719866 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-af392aff-c33b-4f01-8af2-20aee622eb39 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:20.720475 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-af392aff-c33b-4f01-8af2-20aee622eb39 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:20.721037 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-af392aff-c33b-4f01-8af2-20aee622eb39 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:20.751137 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-af392aff-c33b-4f01-8af2-20aee622eb39 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Getting quotas for project b1ec0b5ecaa741eaaf40a50f1415e7f9. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:54:20.763547 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-af392aff-c33b-4f01-8af2-20aee622eb39 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Getting quotas for user f2967d0d8c134d269c9bbe51c90f803a and project b1ec0b5ecaa741eaaf40a50f1415e7f9. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:54:20.830616 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-af392aff-c33b-4f01-8af2-20aee622eb39 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:54:20.833093 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-af392aff-c33b-4f01-8af2-20aee622eb39 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: e54edefe-ab1a-4f08-ae7a-f29dbd10a93c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2c4fefd6-03ff-47a2-856e-abb18ac0f7e4',volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:54:21.453053 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-af392aff-c33b-4f01-8af2-20aee622eb39 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.356529 Oct 23 01:54:21.455315 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3459/6821] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:54:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1359 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:54:21.472449 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e2e65c15-d6a4-4ef7-b4b6-1b7eff3a2269 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:54:21.473767 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e2e65c15-d6a4-4ef7-b4b6-1b7eff3a2269 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: e54edefe-ab1a-4f08-ae7a-f29dbd10a93c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:54:21.476452 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=29 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:54:21.483880 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=9 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:54:21.484789 n-d-master-1 devstack@n-api.service[120945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 23 01:54:21.484926 n-d-master-1 devstack@n-api.service[120945]: Sun Oct 23 01:54:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c (ip 10.222.0.42) !!! Oct 23 01:54:21.583299 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e2e65c15-d6a4-4ef7-b4b6-1b7eff3a2269 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:54:21.595868 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e2e65c15-d6a4-4ef7-b4b6-1b7eff3a2269 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c" status: 200 len: 1071 microversion: 2.1 time: 0.132364 Oct 23 01:54:21.595868 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3363/6822] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:54:21 2022] GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c => generated 1071 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:54:22.618193 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2412995f-d848-4c79-ab2b-42b980f60dc7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:54:22.618807 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2412995f-d848-4c79-ab2b-42b980f60dc7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: e54edefe-ab1a-4f08-ae7a-f29dbd10a93c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:54:22.627073 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2412995f-d848-4c79-ab2b-42b980f60dc7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:22.627569 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2412995f-d848-4c79-ab2b-42b980f60dc7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:22.628011 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2412995f-d848-4c79-ab2b-42b980f60dc7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:22.634857 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2412995f-d848-4c79-ab2b-42b980f60dc7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:22.635395 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2412995f-d848-4c79-ab2b-42b980f60dc7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:22.635846 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2412995f-d848-4c79-ab2b-42b980f60dc7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:22.742760 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2412995f-d848-4c79-ab2b-42b980f60dc7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:54:22.750765 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2412995f-d848-4c79-ab2b-42b980f60dc7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c" status: 200 len: 1121 microversion: 2.1 time: 0.136284 Oct 23 01:54:22.751358 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3460/6823] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:54:22 2022] GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c => generated 1121 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:54:23.780508 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a37cd474-7ffb-46a3-b130-1df1d506e789 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:54:23.780508 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a37cd474-7ffb-46a3-b130-1df1d506e789 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: e54edefe-ab1a-4f08-ae7a-f29dbd10a93c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:54:23.794150 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a37cd474-7ffb-46a3-b130-1df1d506e789 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:23.794681 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a37cd474-7ffb-46a3-b130-1df1d506e789 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:23.795157 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a37cd474-7ffb-46a3-b130-1df1d506e789 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:23.795856 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a37cd474-7ffb-46a3-b130-1df1d506e789 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:23.796305 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a37cd474-7ffb-46a3-b130-1df1d506e789 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:23.796714 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a37cd474-7ffb-46a3-b130-1df1d506e789 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:23.908625 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a37cd474-7ffb-46a3-b130-1df1d506e789 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:54:23.941902 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a37cd474-7ffb-46a3-b130-1df1d506e789 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c" status: 200 len: 1169 microversion: 2.1 time: 0.168452 Oct 23 01:54:23.947960 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3364/6824] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:54:23 2022] GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c => generated 1169 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:54:24.968082 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-25c7da96-1eab-4fd1-872b-0470cf6aab56 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:54:24.968820 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-25c7da96-1eab-4fd1-872b-0470cf6aab56 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: e54edefe-ab1a-4f08-ae7a-f29dbd10a93c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:54:24.976158 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25c7da96-1eab-4fd1-872b-0470cf6aab56 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:24.976876 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25c7da96-1eab-4fd1-872b-0470cf6aab56 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:24.980069 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25c7da96-1eab-4fd1-872b-0470cf6aab56 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:24.980069 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25c7da96-1eab-4fd1-872b-0470cf6aab56 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:24.980069 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25c7da96-1eab-4fd1-872b-0470cf6aab56 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:24.980069 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25c7da96-1eab-4fd1-872b-0470cf6aab56 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:25.092027 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-25c7da96-1eab-4fd1-872b-0470cf6aab56 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:54:25.103719 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-25c7da96-1eab-4fd1-872b-0470cf6aab56 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c" status: 200 len: 1187 microversion: 2.1 time: 0.140731 Oct 23 01:54:25.119584 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3461/6825] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:54:24 2022] GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c => generated 1187 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:54:26.140696 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cc8f5a7c-4de9-4081-b0d5-a28bb7910ecf tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:54:26.141359 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cc8f5a7c-4de9-4081-b0d5-a28bb7910ecf tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: e54edefe-ab1a-4f08-ae7a-f29dbd10a93c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:54:26.175253 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cc8f5a7c-4de9-4081-b0d5-a28bb7910ecf tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:26.175743 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cc8f5a7c-4de9-4081-b0d5-a28bb7910ecf tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:26.182591 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cc8f5a7c-4de9-4081-b0d5-a28bb7910ecf tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:26.185503 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cc8f5a7c-4de9-4081-b0d5-a28bb7910ecf tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:26.185503 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cc8f5a7c-4de9-4081-b0d5-a28bb7910ecf tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:26.185503 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cc8f5a7c-4de9-4081-b0d5-a28bb7910ecf tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:26.470308 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cc8f5a7c-4de9-4081-b0d5-a28bb7910ecf tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:54:26.506854 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cc8f5a7c-4de9-4081-b0d5-a28bb7910ecf tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c" status: 200 len: 1229 microversion: 2.1 time: 0.369957 Oct 23 01:54:26.525133 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3365/6826] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:54:26 2022] GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c => generated 1229 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:54:27.535925 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-cb912eaf-2ea7-4f1e-8a36-f49d98504ced req-26b91cbf-8dc7-41bd-8131-284fdd66e29b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e54edefe-ab1a-4f08-ae7a-f29dbd10a93c", "tag": "90bcac0d-7275-4bc2-8a49-2a92b4dc10f0"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:54:27.553209 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-02fcabfc-361d-406a-bef0-f07ce4ae6c38 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:54:27.554565 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-02fcabfc-361d-406a-bef0-f07ce4ae6c38 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: e54edefe-ab1a-4f08-ae7a-f29dbd10a93c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:54:27.599862 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-cb912eaf-2ea7-4f1e-8a36-f49d98504ced req-26b91cbf-8dc7-41bd-8131-284fdd66e29b service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:27.600274 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-02fcabfc-361d-406a-bef0-f07ce4ae6c38 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:27.601048 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-02fcabfc-361d-406a-bef0-f07ce4ae6c38 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:27.601695 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-02fcabfc-361d-406a-bef0-f07ce4ae6c38 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:27.601828 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-cb912eaf-2ea7-4f1e-8a36-f49d98504ced req-26b91cbf-8dc7-41bd-8131-284fdd66e29b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:27.602699 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-02fcabfc-361d-406a-bef0-f07ce4ae6c38 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:27.603380 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-02fcabfc-361d-406a-bef0-f07ce4ae6c38 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:27.603979 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-cb912eaf-2ea7-4f1e-8a36-f49d98504ced req-26b91cbf-8dc7-41bd-8131-284fdd66e29b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:27.604124 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-02fcabfc-361d-406a-bef0-f07ce4ae6c38 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:27.641828 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-cb912eaf-2ea7-4f1e-8a36-f49d98504ced req-26b91cbf-8dc7-41bd-8131-284fdd66e29b service nova] Creating event network-changed:90bcac0d-7275-4bc2-8a49-2a92b4dc10f0 for instance e54edefe-ab1a-4f08-ae7a-f29dbd10a93c on n-h2-master-1 Oct 23 01:54:27.676517 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-cb912eaf-2ea7-4f1e-8a36-f49d98504ced req-26b91cbf-8dc7-41bd-8131-284fdd66e29b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145097 Oct 23 01:54:27.679078 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3462/6827] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:54:27.818930 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-02fcabfc-361d-406a-bef0-f07ce4ae6c38 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:54:27.829425 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-02fcabfc-361d-406a-bef0-f07ce4ae6c38 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c" status: 200 len: 1229 microversion: 2.1 time: 0.281627 Oct 23 01:54:27.845828 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3366/6828] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:54:27 2022] GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c => generated 1229 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:54:28.853221 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8eb104d9-c6d8-47a6-8ab5-78e6e9080934 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:54:28.857885 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8eb104d9-c6d8-47a6-8ab5-78e6e9080934 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: e54edefe-ab1a-4f08-ae7a-f29dbd10a93c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:54:28.870169 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8eb104d9-c6d8-47a6-8ab5-78e6e9080934 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:28.878364 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8eb104d9-c6d8-47a6-8ab5-78e6e9080934 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:28.879121 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8eb104d9-c6d8-47a6-8ab5-78e6e9080934 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:28.885827 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8eb104d9-c6d8-47a6-8ab5-78e6e9080934 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:28.886566 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8eb104d9-c6d8-47a6-8ab5-78e6e9080934 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:28.887222 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8eb104d9-c6d8-47a6-8ab5-78e6e9080934 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:29.093441 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8eb104d9-c6d8-47a6-8ab5-78e6e9080934 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:54:29.119212 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8eb104d9-c6d8-47a6-8ab5-78e6e9080934 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c" status: 200 len: 1229 microversion: 2.1 time: 0.270052 Oct 23 01:54:29.121437 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3463/6829] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:54:28 2022] GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c => generated 1229 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:54:30.145192 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d353f7fe-0afe-4643-8471-76058b20e5de tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:54:30.147952 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d353f7fe-0afe-4643-8471-76058b20e5de tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: e54edefe-ab1a-4f08-ae7a-f29dbd10a93c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:54:30.161376 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d353f7fe-0afe-4643-8471-76058b20e5de tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:30.172383 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d353f7fe-0afe-4643-8471-76058b20e5de tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:30.172979 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d353f7fe-0afe-4643-8471-76058b20e5de tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:30.173920 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d353f7fe-0afe-4643-8471-76058b20e5de tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:30.174602 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d353f7fe-0afe-4643-8471-76058b20e5de tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:30.175219 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d353f7fe-0afe-4643-8471-76058b20e5de tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:30.349882 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d353f7fe-0afe-4643-8471-76058b20e5de tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:54:30.359245 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d353f7fe-0afe-4643-8471-76058b20e5de tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c" status: 200 len: 1229 microversion: 2.1 time: 0.220006 Oct 23 01:54:30.375106 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3367/6830] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:54:30 2022] GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c => generated 1229 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:54:31.385590 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7cf9274b-aff2-481d-bce5-bd5e3ed195ec tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:54:31.386984 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7cf9274b-aff2-481d-bce5-bd5e3ed195ec tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: e54edefe-ab1a-4f08-ae7a-f29dbd10a93c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:54:31.395796 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:54:31.397090 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=6 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:54:31.398954 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7cf9274b-aff2-481d-bce5-bd5e3ed195ec tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:31.400158 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7cf9274b-aff2-481d-bce5-bd5e3ed195ec tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:31.400807 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7cf9274b-aff2-481d-bce5-bd5e3ed195ec tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:31.401768 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7cf9274b-aff2-481d-bce5-bd5e3ed195ec tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:31.402503 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7cf9274b-aff2-481d-bce5-bd5e3ed195ec tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:31.403117 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7cf9274b-aff2-481d-bce5-bd5e3ed195ec tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:31.614808 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7cf9274b-aff2-481d-bce5-bd5e3ed195ec tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:54:31.623233 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7cf9274b-aff2-481d-bce5-bd5e3ed195ec tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c" status: 200 len: 1229 microversion: 2.1 time: 0.242760 Oct 23 01:54:31.634651 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3464/6831] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:54:31 2022] GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c => generated 1229 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:54:32.649146 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3fa0efb2-2819-4fa9-9880-90a684f19755 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:54:32.650623 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3fa0efb2-2819-4fa9-9880-90a684f19755 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: e54edefe-ab1a-4f08-ae7a-f29dbd10a93c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:54:32.657398 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:54:32.659282 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3fa0efb2-2819-4fa9-9880-90a684f19755 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:32.659963 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3fa0efb2-2819-4fa9-9880-90a684f19755 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:32.660573 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3fa0efb2-2819-4fa9-9880-90a684f19755 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:32.661444 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3fa0efb2-2819-4fa9-9880-90a684f19755 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:32.663366 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3fa0efb2-2819-4fa9-9880-90a684f19755 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:32.664330 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3fa0efb2-2819-4fa9-9880-90a684f19755 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:32.842160 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3fa0efb2-2819-4fa9-9880-90a684f19755 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:54:32.855514 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3fa0efb2-2819-4fa9-9880-90a684f19755 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c" status: 200 len: 1229 microversion: 2.1 time: 0.210786 Oct 23 01:54:32.856877 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3368/6832] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:54:32 2022] GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c => generated 1229 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:54:33.880302 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e0e052d4-1ed1-49c9-83d7-9a85e6ce6484 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:54:33.881448 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e0e052d4-1ed1-49c9-83d7-9a85e6ce6484 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: e54edefe-ab1a-4f08-ae7a-f29dbd10a93c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:54:33.890342 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0e052d4-1ed1-49c9-83d7-9a85e6ce6484 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:33.890776 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0e052d4-1ed1-49c9-83d7-9a85e6ce6484 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:33.891309 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0e052d4-1ed1-49c9-83d7-9a85e6ce6484 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:33.892296 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0e052d4-1ed1-49c9-83d7-9a85e6ce6484 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:33.892690 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0e052d4-1ed1-49c9-83d7-9a85e6ce6484 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:33.893113 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0e052d4-1ed1-49c9-83d7-9a85e6ce6484 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:34.046653 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e0e052d4-1ed1-49c9-83d7-9a85e6ce6484 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:54:34.055797 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e0e052d4-1ed1-49c9-83d7-9a85e6ce6484 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c" status: 200 len: 1217 microversion: 2.1 time: 0.180170 Oct 23 01:54:34.056416 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3465/6833] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:54:33 2022] GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c => generated 1217 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:54:35.081784 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9a7866a0-91e1-4ab8-b7ba-b9f71fb8890a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:54:35.082737 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9a7866a0-91e1-4ab8-b7ba-b9f71fb8890a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: e54edefe-ab1a-4f08-ae7a-f29dbd10a93c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:54:35.090439 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a7866a0-91e1-4ab8-b7ba-b9f71fb8890a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:35.090914 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a7866a0-91e1-4ab8-b7ba-b9f71fb8890a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:35.091344 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a7866a0-91e1-4ab8-b7ba-b9f71fb8890a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:35.092078 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a7866a0-91e1-4ab8-b7ba-b9f71fb8890a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:35.092556 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a7866a0-91e1-4ab8-b7ba-b9f71fb8890a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:35.093101 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a7866a0-91e1-4ab8-b7ba-b9f71fb8890a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:35.279841 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9a7866a0-91e1-4ab8-b7ba-b9f71fb8890a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:54:35.287632 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9a7866a0-91e1-4ab8-b7ba-b9f71fb8890a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c" status: 200 len: 1217 microversion: 2.1 time: 0.211027 Oct 23 01:54:35.288207 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3369/6834] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:54:35 2022] GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c => generated 1217 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:54:36.309871 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-889f8b0d-9137-4bc1-9925-a37ccb54341b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:54:36.310748 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-889f8b0d-9137-4bc1-9925-a37ccb54341b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: e54edefe-ab1a-4f08-ae7a-f29dbd10a93c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:54:36.329647 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-889f8b0d-9137-4bc1-9925-a37ccb54341b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:36.330354 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-889f8b0d-9137-4bc1-9925-a37ccb54341b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:36.330800 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-889f8b0d-9137-4bc1-9925-a37ccb54341b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:36.331549 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-889f8b0d-9137-4bc1-9925-a37ccb54341b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:36.332000 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-889f8b0d-9137-4bc1-9925-a37ccb54341b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:36.332583 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-889f8b0d-9137-4bc1-9925-a37ccb54341b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:36.511215 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-889f8b0d-9137-4bc1-9925-a37ccb54341b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:54:36.519240 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-889f8b0d-9137-4bc1-9925-a37ccb54341b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c" status: 200 len: 1217 microversion: 2.1 time: 0.213556 Oct 23 01:54:36.519824 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3466/6835] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:54:36 2022] GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c => generated 1217 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:54:37.552495 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f46a6a44-b139-4421-9979-e232863b5fc7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:54:37.553621 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f46a6a44-b139-4421-9979-e232863b5fc7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: e54edefe-ab1a-4f08-ae7a-f29dbd10a93c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:54:37.565315 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f46a6a44-b139-4421-9979-e232863b5fc7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:37.565842 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f46a6a44-b139-4421-9979-e232863b5fc7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:37.566380 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f46a6a44-b139-4421-9979-e232863b5fc7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:37.567157 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f46a6a44-b139-4421-9979-e232863b5fc7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:37.567611 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f46a6a44-b139-4421-9979-e232863b5fc7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:37.572560 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f46a6a44-b139-4421-9979-e232863b5fc7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:37.726302 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f46a6a44-b139-4421-9979-e232863b5fc7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:54:37.736384 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f46a6a44-b139-4421-9979-e232863b5fc7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c" status: 200 len: 1217 microversion: 2.1 time: 0.196320 Oct 23 01:54:37.738779 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3370/6836] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:54:37 2022] GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c => generated 1217 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:54:38.763012 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-549142f3-f1c7-4aaf-ab8d-509f45e19e6d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:54:38.763633 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-549142f3-f1c7-4aaf-ab8d-509f45e19e6d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: e54edefe-ab1a-4f08-ae7a-f29dbd10a93c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:54:38.773915 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-549142f3-f1c7-4aaf-ab8d-509f45e19e6d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:38.774579 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-549142f3-f1c7-4aaf-ab8d-509f45e19e6d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:38.775024 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-549142f3-f1c7-4aaf-ab8d-509f45e19e6d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:38.775732 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-549142f3-f1c7-4aaf-ab8d-509f45e19e6d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:38.776371 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-549142f3-f1c7-4aaf-ab8d-509f45e19e6d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:38.776974 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-549142f3-f1c7-4aaf-ab8d-509f45e19e6d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:38.915557 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-549142f3-f1c7-4aaf-ab8d-509f45e19e6d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:54:38.923677 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-549142f3-f1c7-4aaf-ab8d-509f45e19e6d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c" status: 200 len: 1217 microversion: 2.1 time: 0.164846 Oct 23 01:54:38.924256 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3467/6837] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:54:38 2022] GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c => generated 1217 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:54:39.946865 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-08b9f992-86cc-4f8e-82ed-68acffb433e1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:54:39.947687 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-08b9f992-86cc-4f8e-82ed-68acffb433e1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: e54edefe-ab1a-4f08-ae7a-f29dbd10a93c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:54:39.955182 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-08b9f992-86cc-4f8e-82ed-68acffb433e1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:39.955664 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-08b9f992-86cc-4f8e-82ed-68acffb433e1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:39.956101 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-08b9f992-86cc-4f8e-82ed-68acffb433e1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:39.956789 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-08b9f992-86cc-4f8e-82ed-68acffb433e1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:39.957243 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-08b9f992-86cc-4f8e-82ed-68acffb433e1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:39.957698 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-08b9f992-86cc-4f8e-82ed-68acffb433e1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:40.125532 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-08b9f992-86cc-4f8e-82ed-68acffb433e1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:54:40.125532 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-08b9f992-86cc-4f8e-82ed-68acffb433e1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c" status: 200 len: 1217 microversion: 2.1 time: 0.178247 Oct 23 01:54:40.125532 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3371/6838] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:54:39 2022] GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c => generated 1217 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:54:41.146671 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e8920b24-4ab7-4588-85ce-f96cf0d0bb4b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:54:41.147298 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e8920b24-4ab7-4588-85ce-f96cf0d0bb4b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: e54edefe-ab1a-4f08-ae7a-f29dbd10a93c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:54:41.154596 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e8920b24-4ab7-4588-85ce-f96cf0d0bb4b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:41.155101 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e8920b24-4ab7-4588-85ce-f96cf0d0bb4b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:41.155541 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e8920b24-4ab7-4588-85ce-f96cf0d0bb4b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:41.156244 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e8920b24-4ab7-4588-85ce-f96cf0d0bb4b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:41.157230 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e8920b24-4ab7-4588-85ce-f96cf0d0bb4b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:41.157666 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e8920b24-4ab7-4588-85ce-f96cf0d0bb4b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:41.308301 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e8920b24-4ab7-4588-85ce-f96cf0d0bb4b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:54:41.318991 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e8920b24-4ab7-4588-85ce-f96cf0d0bb4b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c" status: 200 len: 1217 microversion: 2.1 time: 0.176039 Oct 23 01:54:41.323462 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3468/6839] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:54:41 2022] GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c => generated 1217 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:54:42.342857 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f4663d88-a970-45f1-82d9-437469cc3012 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:54:42.343472 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f4663d88-a970-45f1-82d9-437469cc3012 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: e54edefe-ab1a-4f08-ae7a-f29dbd10a93c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:54:42.351663 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f4663d88-a970-45f1-82d9-437469cc3012 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:42.352413 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f4663d88-a970-45f1-82d9-437469cc3012 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:42.353011 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f4663d88-a970-45f1-82d9-437469cc3012 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:42.353883 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f4663d88-a970-45f1-82d9-437469cc3012 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:42.354522 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f4663d88-a970-45f1-82d9-437469cc3012 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:42.355167 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f4663d88-a970-45f1-82d9-437469cc3012 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:42.495563 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f4663d88-a970-45f1-82d9-437469cc3012 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:54:42.507720 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f4663d88-a970-45f1-82d9-437469cc3012 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c" status: 200 len: 1217 microversion: 2.1 time: 0.168542 Oct 23 01:54:42.508302 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3372/6840] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:54:42 2022] GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c => generated 1217 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:54:43.530658 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cb0c1a8f-cbab-4494-aa26-1fb5294e5cdd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:54:43.533792 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-cb0c1a8f-cbab-4494-aa26-1fb5294e5cdd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: e54edefe-ab1a-4f08-ae7a-f29dbd10a93c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:54:43.555954 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cb0c1a8f-cbab-4494-aa26-1fb5294e5cdd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:43.571441 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cb0c1a8f-cbab-4494-aa26-1fb5294e5cdd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:43.571441 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cb0c1a8f-cbab-4494-aa26-1fb5294e5cdd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:43.571441 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cb0c1a8f-cbab-4494-aa26-1fb5294e5cdd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:43.571441 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cb0c1a8f-cbab-4494-aa26-1fb5294e5cdd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:43.571441 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cb0c1a8f-cbab-4494-aa26-1fb5294e5cdd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:43.717139 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cb0c1a8f-cbab-4494-aa26-1fb5294e5cdd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:54:43.726025 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cb0c1a8f-cbab-4494-aa26-1fb5294e5cdd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c" status: 200 len: 1217 microversion: 2.1 time: 0.199151 Oct 23 01:54:43.741505 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3469/6841] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:54:43 2022] GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c => generated 1217 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:54:43.902787 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-01feb519-80d4-428a-85c9-b39ff8b9f10b req-339d4cc9-c64f-47fc-b062-0d2dcdb2e445 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e54edefe-ab1a-4f08-ae7a-f29dbd10a93c", "name": "network-vif-plugged", "status": "completed", "tag": "90bcac0d-7275-4bc2-8a49-2a92b4dc10f0"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:54:43.930567 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-01feb519-80d4-428a-85c9-b39ff8b9f10b req-339d4cc9-c64f-47fc-b062-0d2dcdb2e445 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:43.931058 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-01feb519-80d4-428a-85c9-b39ff8b9f10b req-339d4cc9-c64f-47fc-b062-0d2dcdb2e445 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:43.931499 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-01feb519-80d4-428a-85c9-b39ff8b9f10b req-339d4cc9-c64f-47fc-b062-0d2dcdb2e445 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:43.957423 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-01feb519-80d4-428a-85c9-b39ff8b9f10b req-339d4cc9-c64f-47fc-b062-0d2dcdb2e445 service nova] Creating event network-vif-plugged:90bcac0d-7275-4bc2-8a49-2a92b4dc10f0 for instance e54edefe-ab1a-4f08-ae7a-f29dbd10a93c on n-h2-master-1 Oct 23 01:54:43.964112 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-01feb519-80d4-428a-85c9-b39ff8b9f10b req-339d4cc9-c64f-47fc-b062-0d2dcdb2e445 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195913 Oct 23 01:54:43.964725 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3373/6842] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:54:44.760899 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-42e0525c-4412-4b75-9743-2e31d091818c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:54:44.761744 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-42e0525c-4412-4b75-9743-2e31d091818c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: e54edefe-ab1a-4f08-ae7a-f29dbd10a93c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:54:44.771068 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-42e0525c-4412-4b75-9743-2e31d091818c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:44.772014 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-42e0525c-4412-4b75-9743-2e31d091818c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:44.772624 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-42e0525c-4412-4b75-9743-2e31d091818c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:44.773511 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-42e0525c-4412-4b75-9743-2e31d091818c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:44.774007 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-42e0525c-4412-4b75-9743-2e31d091818c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:44.774454 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-42e0525c-4412-4b75-9743-2e31d091818c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:44.921940 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-42e0525c-4412-4b75-9743-2e31d091818c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:54:44.930572 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-42e0525c-4412-4b75-9743-2e31d091818c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c" status: 200 len: 1217 microversion: 2.1 time: 0.173600 Oct 23 01:54:44.931531 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3470/6843] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:54:44 2022] GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c => generated 1217 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:54:45.964582 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8685265b-c7b5-46ba-8117-0ea4981b23cf tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:54:45.965442 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8685265b-c7b5-46ba-8117-0ea4981b23cf tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: e54edefe-ab1a-4f08-ae7a-f29dbd10a93c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:54:45.980031 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8685265b-c7b5-46ba-8117-0ea4981b23cf tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:45.980525 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8685265b-c7b5-46ba-8117-0ea4981b23cf tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:45.984417 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8685265b-c7b5-46ba-8117-0ea4981b23cf tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:45.984417 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8685265b-c7b5-46ba-8117-0ea4981b23cf tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:45.984417 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8685265b-c7b5-46ba-8117-0ea4981b23cf tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:45.984417 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8685265b-c7b5-46ba-8117-0ea4981b23cf tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:46.139077 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8685265b-c7b5-46ba-8117-0ea4981b23cf tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:54:46.148648 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8685265b-c7b5-46ba-8117-0ea4981b23cf tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c" status: 200 len: 1405 microversion: 2.1 time: 0.195447 Oct 23 01:54:46.149228 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3374/6844] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:54:45 2022] GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c => generated 1405 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:54:46.172534 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-63883e40-79a1-4903-8b93-383953db8509 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:54:46.173246 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-63883e40-79a1-4903-8b93-383953db8509 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: e54edefe-ab1a-4f08-ae7a-f29dbd10a93c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:54:46.180181 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-63883e40-79a1-4903-8b93-383953db8509 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:46.180673 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-63883e40-79a1-4903-8b93-383953db8509 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:46.181111 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-63883e40-79a1-4903-8b93-383953db8509 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:46.181805 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-63883e40-79a1-4903-8b93-383953db8509 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:46.182289 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-63883e40-79a1-4903-8b93-383953db8509 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:46.182767 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-63883e40-79a1-4903-8b93-383953db8509 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:46.337164 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-63883e40-79a1-4903-8b93-383953db8509 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:54:46.346368 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-63883e40-79a1-4903-8b93-383953db8509 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c" status: 200 len: 1405 microversion: 2.1 time: 0.178215 Oct 23 01:54:46.347277 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3471/6845] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:54:46 2022] GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c => generated 1405 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:54:46.370600 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9f36a167-6007-474e-b1d6-70273559511e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1634859904"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:54:46.385530 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9f36a167-6007-474e-b1d6-70273559511e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: e54edefe-ab1a-4f08-ae7a-f29dbd10a93c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:54:46.393466 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f36a167-6007-474e-b1d6-70273559511e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:46.394638 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f36a167-6007-474e-b1d6-70273559511e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:46.395662 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f36a167-6007-474e-b1d6-70273559511e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:46.396581 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f36a167-6007-474e-b1d6-70273559511e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:46.397290 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f36a167-6007-474e-b1d6-70273559511e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:46.397829 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f36a167-6007-474e-b1d6-70273559511e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:46.549727 n-d-master-1 devstack@n-api.service[120945]: INFO nova.compute.api [None req-9f36a167-6007-474e-b1d6-70273559511e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: e54edefe-ab1a-4f08-ae7a-f29dbd10a93c] Attempting to quiesce instance before volume snapshot. Oct 23 01:54:46.619902 n-d-master-1 devstack@n-api.service[120945]: INFO nova.compute.api [None req-9f36a167-6007-474e-b1d6-70273559511e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: e54edefe-ab1a-4f08-ae7a-f29dbd10a93c] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 23 01:54:46.901021 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9f36a167-6007-474e-b1d6-70273559511e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: e54edefe-ab1a-4f08-ae7a-f29dbd10a93c] Creating snapshot from volume 2c4fefd6-03ff-47a2-856e-abb18ac0f7e4. {{(pid=120945) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 23 01:54:49.081655 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9f36a167-6007-474e-b1d6-70273559511e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "POST /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c/action" status: 202 len: 0 microversion: 2.1 time: 2.715119 Oct 23 01:54:49.083907 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3375/6846] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:54:46 2022] POST /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c/action => generated 0 bytes in 2718 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 23 01:54:50.330308 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-78f28579-4eef-4182-9a80-97a1192a7ce1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1281643793", "imageRef": "6afac1b8-f9dd-4307-974b-74aacfa71893", "flavorRef": "452", "networks": [{"uuid": "e056504c-8568-4f9a-a3ed-bae9f108b4ab"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:54:50.340401 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:54:50.392798 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-78f28579-4eef-4182-9a80-97a1192a7ce1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] validate_networks() for [('e056504c-8568-4f9a-a3ed-bae9f108b4ab', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:54:50.860142 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-78f28579-4eef-4182-9a80-97a1192a7ce1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:54:50.860801 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-78f28579-4eef-4182-9a80-97a1192a7ce1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:54:50.861387 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-78f28579-4eef-4182-9a80-97a1192a7ce1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:54:50.861931 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-78f28579-4eef-4182-9a80-97a1192a7ce1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:54:50.862468 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-78f28579-4eef-4182-9a80-97a1192a7ce1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:54:50.887057 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-78f28579-4eef-4182-9a80-97a1192a7ce1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:50.887479 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-78f28579-4eef-4182-9a80-97a1192a7ce1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:50.888131 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-78f28579-4eef-4182-9a80-97a1192a7ce1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:50.889098 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-78f28579-4eef-4182-9a80-97a1192a7ce1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:50.889568 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-78f28579-4eef-4182-9a80-97a1192a7ce1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:50.890030 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-78f28579-4eef-4182-9a80-97a1192a7ce1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:50.907821 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=71 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:54:50.949930 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-78f28579-4eef-4182-9a80-97a1192a7ce1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Getting quotas for project b1ec0b5ecaa741eaaf40a50f1415e7f9. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:54:50.971555 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-78f28579-4eef-4182-9a80-97a1192a7ce1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Getting quotas for user f2967d0d8c134d269c9bbe51c90f803a and project b1ec0b5ecaa741eaaf40a50f1415e7f9. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:54:50.995345 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-78f28579-4eef-4182-9a80-97a1192a7ce1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:54:50.999322 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-78f28579-4eef-4182-9a80-97a1192a7ce1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='2d75fcae-54a6-4a67-9c48-34b8b9b89e4e',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:54:51.262681 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-78f28579-4eef-4182-9a80-97a1192a7ce1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.937030 Oct 23 01:54:51.269795 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3472/6847] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:54:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 938 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:54:51.276658 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1c15fba6-3064-4019-805e-2b1dfaecc53f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:54:51.277390 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1c15fba6-3064-4019-805e-2b1dfaecc53f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:54:51.361632 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1c15fba6-3064-4019-805e-2b1dfaecc53f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:54:51.371365 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1c15fba6-3064-4019-805e-2b1dfaecc53f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1230 microversion: 2.1 time: 0.099944 Oct 23 01:54:51.376109 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3376/6848] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:54:51 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1230 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:54:52.395500 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a19f528a-fa46-44c0-bf7b-2ef652bb4050 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:54:52.396712 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a19f528a-fa46-44c0-bf7b-2ef652bb4050 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:54:52.453415 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a19f528a-fa46-44c0-bf7b-2ef652bb4050 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:54:52.461518 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a19f528a-fa46-44c0-bf7b-2ef652bb4050 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1230 microversion: 2.1 time: 0.070813 Oct 23 01:54:52.462290 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3473/6849] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:54:52 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1230 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:54:53.486237 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e6e64a18-b84b-4214-8f13-7150783da536 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:54:53.487732 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e6e64a18-b84b-4214-8f13-7150783da536 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:54:53.498811 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=33 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:54:53.562206 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e6e64a18-b84b-4214-8f13-7150783da536 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:54:53.569666 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e6e64a18-b84b-4214-8f13-7150783da536 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1230 microversion: 2.1 time: 0.088166 Oct 23 01:54:53.570270 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3377/6850] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:54:53 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1230 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:54:54.662095 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9c1e7065-7dfa-499b-9d50-fc8726e02b3b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:54:54.662640 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9c1e7065-7dfa-499b-9d50-fc8726e02b3b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:54:54.669666 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9c1e7065-7dfa-499b-9d50-fc8726e02b3b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:54.670416 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9c1e7065-7dfa-499b-9d50-fc8726e02b3b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:54.670958 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9c1e7065-7dfa-499b-9d50-fc8726e02b3b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:54.671744 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9c1e7065-7dfa-499b-9d50-fc8726e02b3b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:54.672378 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9c1e7065-7dfa-499b-9d50-fc8726e02b3b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:54.672908 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9c1e7065-7dfa-499b-9d50-fc8726e02b3b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:54.748649 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9c1e7065-7dfa-499b-9d50-fc8726e02b3b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:54:54.757057 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9c1e7065-7dfa-499b-9d50-fc8726e02b3b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1234 microversion: 2.1 time: 0.168541 Oct 23 01:54:54.757630 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3474/6851] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:54:54 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1234 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:54:55.781121 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3db4499f-9a1b-4677-96b2-46fa617a9c1b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:54:55.782620 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3db4499f-9a1b-4677-96b2-46fa617a9c1b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:54:55.798690 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3db4499f-9a1b-4677-96b2-46fa617a9c1b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:55.798690 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3db4499f-9a1b-4677-96b2-46fa617a9c1b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:55.798690 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3db4499f-9a1b-4677-96b2-46fa617a9c1b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:55.798690 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3db4499f-9a1b-4677-96b2-46fa617a9c1b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:55.799326 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3db4499f-9a1b-4677-96b2-46fa617a9c1b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:55.799867 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3db4499f-9a1b-4677-96b2-46fa617a9c1b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:55.817961 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=77,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:54:55.954968 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3db4499f-9a1b-4677-96b2-46fa617a9c1b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:54:55.971574 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3db4499f-9a1b-4677-96b2-46fa617a9c1b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1290 microversion: 2.1 time: 0.194967 Oct 23 01:54:55.972649 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3378/6852] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:54:55 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1290 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:54:57.018956 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-03115527-0ff1-41fe-b5b4-c153d6b6cb5b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:54:57.022002 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-03115527-0ff1-41fe-b5b4-c153d6b6cb5b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:54:57.049965 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-03115527-0ff1-41fe-b5b4-c153d6b6cb5b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:57.052170 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-03115527-0ff1-41fe-b5b4-c153d6b6cb5b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:57.052703 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-03115527-0ff1-41fe-b5b4-c153d6b6cb5b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:57.054696 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-03115527-0ff1-41fe-b5b4-c153d6b6cb5b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:57.058920 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-03115527-0ff1-41fe-b5b4-c153d6b6cb5b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:57.060578 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-03115527-0ff1-41fe-b5b4-c153d6b6cb5b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:57.413551 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-03115527-0ff1-41fe-b5b4-c153d6b6cb5b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:54:57.434010 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-03115527-0ff1-41fe-b5b4-c153d6b6cb5b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1342 microversion: 2.1 time: 0.433817 Oct 23 01:54:57.435668 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3475/6853] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:54:56 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1342 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:54:58.462740 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-110c7e04-9275-4ec1-9938-a5c47e5e3363 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:54:58.464483 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-110c7e04-9275-4ec1-9938-a5c47e5e3363 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:54:58.504968 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-110c7e04-9275-4ec1-9938-a5c47e5e3363 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:58.505554 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-110c7e04-9275-4ec1-9938-a5c47e5e3363 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:58.505927 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-110c7e04-9275-4ec1-9938-a5c47e5e3363 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:58.506743 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-110c7e04-9275-4ec1-9938-a5c47e5e3363 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:58.507288 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-110c7e04-9275-4ec1-9938-a5c47e5e3363 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:58.507671 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-110c7e04-9275-4ec1-9938-a5c47e5e3363 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:58.575064 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-009bceaf-9702-4274-b125-4b00cf5bb486 req-383400d3-e337-4303-b0e8-19538f327f0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2", "tag": "892a7f15-4a18-45c1-af8f-e7cc21a91f0b"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:54:58.606490 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-009bceaf-9702-4274-b125-4b00cf5bb486 req-383400d3-e337-4303-b0e8-19538f327f0e service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:58.607384 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-009bceaf-9702-4274-b125-4b00cf5bb486 req-383400d3-e337-4303-b0e8-19538f327f0e service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:58.608522 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-009bceaf-9702-4274-b125-4b00cf5bb486 req-383400d3-e337-4303-b0e8-19538f327f0e service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:58.631773 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-009bceaf-9702-4274-b125-4b00cf5bb486 req-383400d3-e337-4303-b0e8-19538f327f0e service nova] Creating event network-changed:892a7f15-4a18-45c1-af8f-e7cc21a91f0b for instance 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 on n-h1-master-1 Oct 23 01:54:58.645203 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-009bceaf-9702-4274-b125-4b00cf5bb486 req-383400d3-e337-4303-b0e8-19538f327f0e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082925 Oct 23 01:54:58.646988 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3476/6854] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:54:58.868792 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-110c7e04-9275-4ec1-9938-a5c47e5e3363 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:54:58.877461 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-110c7e04-9275-4ec1-9938-a5c47e5e3363 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1342 microversion: 2.1 time: 0.420883 Oct 23 01:54:58.878895 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3379/6855] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:54:58 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1342 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:54:59.904669 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-76497412-da8f-4559-bc05-7b5a538ae779 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:54:59.905299 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-76497412-da8f-4559-bc05-7b5a538ae779 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:54:59.914776 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-76497412-da8f-4559-bc05-7b5a538ae779 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:59.915641 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-76497412-da8f-4559-bc05-7b5a538ae779 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:59.917306 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-76497412-da8f-4559-bc05-7b5a538ae779 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:54:59.918693 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-76497412-da8f-4559-bc05-7b5a538ae779 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:54:59.920363 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-76497412-da8f-4559-bc05-7b5a538ae779 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:54:59.921727 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-76497412-da8f-4559-bc05-7b5a538ae779 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:00.301833 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-76497412-da8f-4559-bc05-7b5a538ae779 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:55:00.311748 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-76497412-da8f-4559-bc05-7b5a538ae779 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1342 microversion: 2.1 time: 0.412269 Oct 23 01:55:00.313497 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3477/6856] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:54:59 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1342 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:55:01.340806 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ce421fe0-7a3f-4251-b203-aa77a2ffb51d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:55:01.341433 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ce421fe0-7a3f-4251-b203-aa77a2ffb51d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:55:01.351203 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ce421fe0-7a3f-4251-b203-aa77a2ffb51d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:01.351715 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ce421fe0-7a3f-4251-b203-aa77a2ffb51d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:01.352174 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ce421fe0-7a3f-4251-b203-aa77a2ffb51d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:01.352880 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ce421fe0-7a3f-4251-b203-aa77a2ffb51d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:01.353412 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ce421fe0-7a3f-4251-b203-aa77a2ffb51d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:01.353773 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ce421fe0-7a3f-4251-b203-aa77a2ffb51d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:01.603357 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ce421fe0-7a3f-4251-b203-aa77a2ffb51d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:55:01.614872 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ce421fe0-7a3f-4251-b203-aa77a2ffb51d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1342 microversion: 2.1 time: 0.277766 Oct 23 01:55:01.616033 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3380/6857] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:55:01 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1342 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:55:02.639186 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f0a1ba0a-96b1-4da7-b143-6edc95680efe tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:55:02.639764 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f0a1ba0a-96b1-4da7-b143-6edc95680efe tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:55:02.642706 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:55:02.643468 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=8 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:55:02.654412 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f0a1ba0a-96b1-4da7-b143-6edc95680efe tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:02.654412 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f0a1ba0a-96b1-4da7-b143-6edc95680efe tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:02.654412 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f0a1ba0a-96b1-4da7-b143-6edc95680efe tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:02.654412 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f0a1ba0a-96b1-4da7-b143-6edc95680efe tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:02.654412 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f0a1ba0a-96b1-4da7-b143-6edc95680efe tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:02.654412 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f0a1ba0a-96b1-4da7-b143-6edc95680efe tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:02.813923 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f0a1ba0a-96b1-4da7-b143-6edc95680efe tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:55:02.827886 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f0a1ba0a-96b1-4da7-b143-6edc95680efe tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1342 microversion: 2.1 time: 0.191694 Oct 23 01:55:02.831088 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3478/6858] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:55:02 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1342 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:55:03.852770 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-002b1cc6-01fc-4c4b-a00e-6aed5b5c3afa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:55:03.853405 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-002b1cc6-01fc-4c4b-a00e-6aed5b5c3afa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:55:03.855952 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=4 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:55:03.862057 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-002b1cc6-01fc-4c4b-a00e-6aed5b5c3afa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:03.862392 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-002b1cc6-01fc-4c4b-a00e-6aed5b5c3afa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:03.863037 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-002b1cc6-01fc-4c4b-a00e-6aed5b5c3afa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:03.864211 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-002b1cc6-01fc-4c4b-a00e-6aed5b5c3afa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:03.864850 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-002b1cc6-01fc-4c4b-a00e-6aed5b5c3afa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:03.865475 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-002b1cc6-01fc-4c4b-a00e-6aed5b5c3afa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:04.019177 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-002b1cc6-01fc-4c4b-a00e-6aed5b5c3afa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:55:04.027886 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-002b1cc6-01fc-4c4b-a00e-6aed5b5c3afa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1342 microversion: 2.1 time: 0.179166 Oct 23 01:55:04.028469 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3381/6859] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:55:03 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1342 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:55:05.054700 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b25cb260-d885-46eb-a25a-054299bd8cb4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:55:05.056549 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b25cb260-d885-46eb-a25a-054299bd8cb4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:55:05.066141 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b25cb260-d885-46eb-a25a-054299bd8cb4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:05.066995 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b25cb260-d885-46eb-a25a-054299bd8cb4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:05.067725 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b25cb260-d885-46eb-a25a-054299bd8cb4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:05.069454 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b25cb260-d885-46eb-a25a-054299bd8cb4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:05.070508 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b25cb260-d885-46eb-a25a-054299bd8cb4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:05.071539 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b25cb260-d885-46eb-a25a-054299bd8cb4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:05.315204 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b25cb260-d885-46eb-a25a-054299bd8cb4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:55:05.329723 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b25cb260-d885-46eb-a25a-054299bd8cb4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1342 microversion: 2.1 time: 0.279002 Oct 23 01:55:05.346347 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3479/6860] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:55:05 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1342 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:55:06.355066 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d69c8c53-46b5-4656-9170-481583eacc31 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:55:06.356526 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d69c8c53-46b5-4656-9170-481583eacc31 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:55:06.374023 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d69c8c53-46b5-4656-9170-481583eacc31 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:06.374622 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d69c8c53-46b5-4656-9170-481583eacc31 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:06.375683 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d69c8c53-46b5-4656-9170-481583eacc31 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:06.376632 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d69c8c53-46b5-4656-9170-481583eacc31 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:06.377109 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d69c8c53-46b5-4656-9170-481583eacc31 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:06.377744 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d69c8c53-46b5-4656-9170-481583eacc31 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:06.600663 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d69c8c53-46b5-4656-9170-481583eacc31 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:55:06.608619 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d69c8c53-46b5-4656-9170-481583eacc31 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1342 microversion: 2.1 time: 0.258896 Oct 23 01:55:06.609205 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3382/6861] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:55:06 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1342 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:55:07.643957 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2ef5cc93-6066-4e4e-bb2e-57311ae69eff tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:55:07.645426 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2ef5cc93-6066-4e4e-bb2e-57311ae69eff tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:55:07.655392 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2ef5cc93-6066-4e4e-bb2e-57311ae69eff tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:07.655392 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2ef5cc93-6066-4e4e-bb2e-57311ae69eff tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:07.655392 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2ef5cc93-6066-4e4e-bb2e-57311ae69eff tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:07.655392 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2ef5cc93-6066-4e4e-bb2e-57311ae69eff tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:07.655392 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2ef5cc93-6066-4e4e-bb2e-57311ae69eff tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:07.656180 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2ef5cc93-6066-4e4e-bb2e-57311ae69eff tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:07.896317 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2ef5cc93-6066-4e4e-bb2e-57311ae69eff tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:55:07.911930 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2ef5cc93-6066-4e4e-bb2e-57311ae69eff tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1342 microversion: 2.1 time: 0.275380 Oct 23 01:55:07.928868 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3480/6862] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:55:07 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1342 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:55:08.939817 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9d5a1e6e-682f-4412-960c-05422089d0ab tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:55:08.940846 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9d5a1e6e-682f-4412-960c-05422089d0ab tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:55:08.948709 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d5a1e6e-682f-4412-960c-05422089d0ab tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:08.949286 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d5a1e6e-682f-4412-960c-05422089d0ab tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:08.949829 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d5a1e6e-682f-4412-960c-05422089d0ab tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:08.950674 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d5a1e6e-682f-4412-960c-05422089d0ab tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:08.951337 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d5a1e6e-682f-4412-960c-05422089d0ab tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:08.952039 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d5a1e6e-682f-4412-960c-05422089d0ab tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:09.124439 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9d5a1e6e-682f-4412-960c-05422089d0ab tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:55:09.137834 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9d5a1e6e-682f-4412-960c-05422089d0ab tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1342 microversion: 2.1 time: 0.202394 Oct 23 01:55:09.139365 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3383/6863] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:55:08 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1342 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:55:10.165012 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5936f67b-aa35-4494-88d9-2b46b51d9b49 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:55:10.165759 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5936f67b-aa35-4494-88d9-2b46b51d9b49 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:55:10.189762 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5936f67b-aa35-4494-88d9-2b46b51d9b49 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:10.198374 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5936f67b-aa35-4494-88d9-2b46b51d9b49 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:10.199047 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5936f67b-aa35-4494-88d9-2b46b51d9b49 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:10.199973 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5936f67b-aa35-4494-88d9-2b46b51d9b49 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:10.201883 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5936f67b-aa35-4494-88d9-2b46b51d9b49 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:10.204687 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5936f67b-aa35-4494-88d9-2b46b51d9b49 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:10.412237 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5936f67b-aa35-4494-88d9-2b46b51d9b49 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:55:10.418830 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5936f67b-aa35-4494-88d9-2b46b51d9b49 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1342 microversion: 2.1 time: 0.259544 Oct 23 01:55:10.429549 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3481/6864] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:55:10 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1342 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:55:11.444366 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4a47ff03-2b83-4ae2-a9b3-3b90bad81461 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:55:11.445460 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4a47ff03-2b83-4ae2-a9b3-3b90bad81461 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:55:11.452575 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4a47ff03-2b83-4ae2-a9b3-3b90bad81461 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:11.453626 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4a47ff03-2b83-4ae2-a9b3-3b90bad81461 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:11.454314 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4a47ff03-2b83-4ae2-a9b3-3b90bad81461 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:11.455256 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4a47ff03-2b83-4ae2-a9b3-3b90bad81461 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:11.455722 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4a47ff03-2b83-4ae2-a9b3-3b90bad81461 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:11.456425 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4a47ff03-2b83-4ae2-a9b3-3b90bad81461 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:11.603532 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4a47ff03-2b83-4ae2-a9b3-3b90bad81461 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:55:11.613911 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4a47ff03-2b83-4ae2-a9b3-3b90bad81461 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1342 microversion: 2.1 time: 0.173609 Oct 23 01:55:11.614618 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3384/6865] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:55:11 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1342 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:55:12.637162 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9c69d187-a1d5-4904-9b7d-2e7bbd433196 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:55:12.638004 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9c69d187-a1d5-4904-9b7d-2e7bbd433196 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:55:12.646440 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9c69d187-a1d5-4904-9b7d-2e7bbd433196 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:12.657427 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9c69d187-a1d5-4904-9b7d-2e7bbd433196 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:12.657427 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9c69d187-a1d5-4904-9b7d-2e7bbd433196 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:12.657427 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9c69d187-a1d5-4904-9b7d-2e7bbd433196 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:12.657427 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9c69d187-a1d5-4904-9b7d-2e7bbd433196 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:12.657427 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9c69d187-a1d5-4904-9b7d-2e7bbd433196 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:12.809806 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9c69d187-a1d5-4904-9b7d-2e7bbd433196 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:55:12.818417 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9c69d187-a1d5-4904-9b7d-2e7bbd433196 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1342 microversion: 2.1 time: 0.185385 Oct 23 01:55:12.819018 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3482/6866] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:55:12 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1342 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:55:13.841836 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fae898da-8a2b-4d6f-804f-0e17da0a8a18 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:55:13.846477 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-fae898da-8a2b-4d6f-804f-0e17da0a8a18 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:55:13.850338 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fae898da-8a2b-4d6f-804f-0e17da0a8a18 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:13.850838 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fae898da-8a2b-4d6f-804f-0e17da0a8a18 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:13.851474 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fae898da-8a2b-4d6f-804f-0e17da0a8a18 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:13.852382 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fae898da-8a2b-4d6f-804f-0e17da0a8a18 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:13.853074 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fae898da-8a2b-4d6f-804f-0e17da0a8a18 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:13.853841 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fae898da-8a2b-4d6f-804f-0e17da0a8a18 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:14.002762 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-fae898da-8a2b-4d6f-804f-0e17da0a8a18 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:55:14.010930 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fae898da-8a2b-4d6f-804f-0e17da0a8a18 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1342 microversion: 2.1 time: 0.172889 Oct 23 01:55:14.011902 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3385/6867] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:55:13 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1342 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:55:15.041020 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-95b95bc1-970c-4530-b395-4450df3d2c64 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:55:15.041698 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-95b95bc1-970c-4530-b395-4450df3d2c64 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:55:15.053735 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-95b95bc1-970c-4530-b395-4450df3d2c64 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:15.054572 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-95b95bc1-970c-4530-b395-4450df3d2c64 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:15.055452 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-95b95bc1-970c-4530-b395-4450df3d2c64 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:15.056592 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-95b95bc1-970c-4530-b395-4450df3d2c64 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:15.057431 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-95b95bc1-970c-4530-b395-4450df3d2c64 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:15.058069 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-95b95bc1-970c-4530-b395-4450df3d2c64 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:15.218446 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-95b95bc1-970c-4530-b395-4450df3d2c64 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:55:15.227663 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-95b95bc1-970c-4530-b395-4450df3d2c64 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1342 microversion: 2.1 time: 0.194080 Oct 23 01:55:15.228433 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3483/6868] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:55:15 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1342 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:55:16.253552 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0c57b942-eb55-4908-a3b8-91df642a360a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:55:16.255380 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0c57b942-eb55-4908-a3b8-91df642a360a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:55:16.264134 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0c57b942-eb55-4908-a3b8-91df642a360a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:16.264796 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0c57b942-eb55-4908-a3b8-91df642a360a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:16.265358 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0c57b942-eb55-4908-a3b8-91df642a360a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:16.266254 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0c57b942-eb55-4908-a3b8-91df642a360a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:16.266830 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0c57b942-eb55-4908-a3b8-91df642a360a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:16.267439 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0c57b942-eb55-4908-a3b8-91df642a360a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:16.439046 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0c57b942-eb55-4908-a3b8-91df642a360a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:55:16.440752 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0c57b942-eb55-4908-a3b8-91df642a360a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1342 microversion: 2.1 time: 0.192383 Oct 23 01:55:16.567164 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3386/6869] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:55:16 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1342 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:55:17.491001 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e5f1bfe1-19a6-4948-8720-f2ff0367b6fd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:55:17.491001 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e5f1bfe1-19a6-4948-8720-f2ff0367b6fd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:55:17.491001 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e5f1bfe1-19a6-4948-8720-f2ff0367b6fd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:17.491001 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e5f1bfe1-19a6-4948-8720-f2ff0367b6fd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:17.491001 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e5f1bfe1-19a6-4948-8720-f2ff0367b6fd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:17.491001 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e5f1bfe1-19a6-4948-8720-f2ff0367b6fd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:17.491001 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e5f1bfe1-19a6-4948-8720-f2ff0367b6fd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:17.491001 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e5f1bfe1-19a6-4948-8720-f2ff0367b6fd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:17.617731 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e5f1bfe1-19a6-4948-8720-f2ff0367b6fd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:55:17.626437 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e5f1bfe1-19a6-4948-8720-f2ff0367b6fd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1342 microversion: 2.1 time: 0.165524 Oct 23 01:55:17.627040 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3484/6870] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:55:17 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1342 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:55:18.650769 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9b6a1af2-e72e-4e70-ac32-048e3a01785e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:55:18.651534 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9b6a1af2-e72e-4e70-ac32-048e3a01785e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:55:18.665396 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b6a1af2-e72e-4e70-ac32-048e3a01785e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:18.665898 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b6a1af2-e72e-4e70-ac32-048e3a01785e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:18.666389 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b6a1af2-e72e-4e70-ac32-048e3a01785e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:18.667107 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b6a1af2-e72e-4e70-ac32-048e3a01785e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:18.667571 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b6a1af2-e72e-4e70-ac32-048e3a01785e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:18.668000 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b6a1af2-e72e-4e70-ac32-048e3a01785e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:18.832400 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9b6a1af2-e72e-4e70-ac32-048e3a01785e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:55:18.840618 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9b6a1af2-e72e-4e70-ac32-048e3a01785e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1342 microversion: 2.1 time: 0.194351 Oct 23 01:55:18.841172 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3387/6871] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:55:18 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1342 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:55:19.866420 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7f5c4ac0-e46f-481f-888d-385213eecdc8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:55:19.868038 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7f5c4ac0-e46f-481f-888d-385213eecdc8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:55:19.889517 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f5c4ac0-e46f-481f-888d-385213eecdc8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:19.891661 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f5c4ac0-e46f-481f-888d-385213eecdc8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:19.893105 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f5c4ac0-e46f-481f-888d-385213eecdc8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:19.894419 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f5c4ac0-e46f-481f-888d-385213eecdc8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:19.904731 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f5c4ac0-e46f-481f-888d-385213eecdc8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:19.907321 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f5c4ac0-e46f-481f-888d-385213eecdc8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:20.104583 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7f5c4ac0-e46f-481f-888d-385213eecdc8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:55:20.104583 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7f5c4ac0-e46f-481f-888d-385213eecdc8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1342 microversion: 2.1 time: 0.233384 Oct 23 01:55:20.104583 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3485/6872] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:55:19 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1342 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:55:21.120439 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c1bd0406-0289-45ab-a1ab-cde636ce4dfb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:55:21.121077 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c1bd0406-0289-45ab-a1ab-cde636ce4dfb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:55:21.128825 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c1bd0406-0289-45ab-a1ab-cde636ce4dfb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:21.129338 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c1bd0406-0289-45ab-a1ab-cde636ce4dfb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:21.129791 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c1bd0406-0289-45ab-a1ab-cde636ce4dfb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:21.130743 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c1bd0406-0289-45ab-a1ab-cde636ce4dfb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:21.131214 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c1bd0406-0289-45ab-a1ab-cde636ce4dfb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:21.131831 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c1bd0406-0289-45ab-a1ab-cde636ce4dfb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:21.284637 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c1bd0406-0289-45ab-a1ab-cde636ce4dfb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:55:21.292953 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c1bd0406-0289-45ab-a1ab-cde636ce4dfb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1342 microversion: 2.1 time: 0.176877 Oct 23 01:55:21.298403 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3388/6873] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:55:21 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1342 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:55:22.318630 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-42bd3ac6-c8e4-4db6-9b7f-8edf133afab8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:55:22.319835 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-42bd3ac6-c8e4-4db6-9b7f-8edf133afab8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:55:22.323812 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:55:22.329120 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-42bd3ac6-c8e4-4db6-9b7f-8edf133afab8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:22.329635 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-42bd3ac6-c8e4-4db6-9b7f-8edf133afab8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:22.330113 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-42bd3ac6-c8e4-4db6-9b7f-8edf133afab8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:22.330835 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-42bd3ac6-c8e4-4db6-9b7f-8edf133afab8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:22.331305 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-42bd3ac6-c8e4-4db6-9b7f-8edf133afab8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:22.331740 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-42bd3ac6-c8e4-4db6-9b7f-8edf133afab8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:22.336423 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=70 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:55:22.499136 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-42bd3ac6-c8e4-4db6-9b7f-8edf133afab8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:55:22.516322 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-42bd3ac6-c8e4-4db6-9b7f-8edf133afab8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1342 microversion: 2.1 time: 0.203140 Oct 23 01:55:22.525357 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3486/6874] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:55:22 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1342 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:55:23.539900 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-28db296a-5e93-440d-a4a8-4ac4208bfba7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:55:23.540535 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-28db296a-5e93-440d-a4a8-4ac4208bfba7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:55:23.548186 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-28db296a-5e93-440d-a4a8-4ac4208bfba7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:23.548689 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-28db296a-5e93-440d-a4a8-4ac4208bfba7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:23.549168 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-28db296a-5e93-440d-a4a8-4ac4208bfba7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:23.549874 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-28db296a-5e93-440d-a4a8-4ac4208bfba7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:23.550376 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-28db296a-5e93-440d-a4a8-4ac4208bfba7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:23.550814 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-28db296a-5e93-440d-a4a8-4ac4208bfba7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:23.733434 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-28db296a-5e93-440d-a4a8-4ac4208bfba7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:55:23.743501 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-28db296a-5e93-440d-a4a8-4ac4208bfba7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1342 microversion: 2.1 time: 0.207573 Oct 23 01:55:23.744807 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3389/6875] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:55:23 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1342 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:55:24.769426 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e4df949c-cfc2-4462-a374-01752a55eb49 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:55:24.770081 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e4df949c-cfc2-4462-a374-01752a55eb49 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:55:24.778224 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e4df949c-cfc2-4462-a374-01752a55eb49 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:24.781452 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e4df949c-cfc2-4462-a374-01752a55eb49 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:24.781452 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e4df949c-cfc2-4462-a374-01752a55eb49 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:24.781452 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e4df949c-cfc2-4462-a374-01752a55eb49 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:24.781452 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e4df949c-cfc2-4462-a374-01752a55eb49 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:24.781452 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e4df949c-cfc2-4462-a374-01752a55eb49 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:24.936158 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e4df949c-cfc2-4462-a374-01752a55eb49 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:55:24.945825 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e4df949c-cfc2-4462-a374-01752a55eb49 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1342 microversion: 2.1 time: 0.180870 Oct 23 01:55:24.947008 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3487/6876] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:55:24 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1342 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:55:25.970315 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f31dc98d-3591-4e9a-8b90-1da52879bb31 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:55:25.971017 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f31dc98d-3591-4e9a-8b90-1da52879bb31 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:55:25.978093 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=28 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:55:25.982440 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f31dc98d-3591-4e9a-8b90-1da52879bb31 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:25.982952 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f31dc98d-3591-4e9a-8b90-1da52879bb31 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:25.983432 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f31dc98d-3591-4e9a-8b90-1da52879bb31 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:25.984787 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f31dc98d-3591-4e9a-8b90-1da52879bb31 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:25.985599 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f31dc98d-3591-4e9a-8b90-1da52879bb31 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:25.986084 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f31dc98d-3591-4e9a-8b90-1da52879bb31 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:25.989209 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=72 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:55:26.143981 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f31dc98d-3591-4e9a-8b90-1da52879bb31 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:55:26.172893 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f31dc98d-3591-4e9a-8b90-1da52879bb31 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1342 microversion: 2.1 time: 0.205940 Oct 23 01:55:26.174649 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3390/6877] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:55:25 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1342 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:55:27.199034 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-404116de-b9c0-4f83-975f-89c04aabca71 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:55:27.199677 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-404116de-b9c0-4f83-975f-89c04aabca71 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:55:27.209923 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-404116de-b9c0-4f83-975f-89c04aabca71 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:27.210462 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-404116de-b9c0-4f83-975f-89c04aabca71 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:27.210907 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-404116de-b9c0-4f83-975f-89c04aabca71 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:27.211642 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-404116de-b9c0-4f83-975f-89c04aabca71 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:27.212236 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-404116de-b9c0-4f83-975f-89c04aabca71 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:27.214237 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-404116de-b9c0-4f83-975f-89c04aabca71 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:27.428830 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-404116de-b9c0-4f83-975f-89c04aabca71 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:55:27.457328 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-404116de-b9c0-4f83-975f-89c04aabca71 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1342 microversion: 2.1 time: 0.244757 Oct 23 01:55:27.457328 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3488/6878] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:55:27 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1342 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:55:28.475041 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2b0cbd25-774c-4e15-ac4c-b5bc64383222 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:55:28.477055 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2b0cbd25-774c-4e15-ac4c-b5bc64383222 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:55:28.485345 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2b0cbd25-774c-4e15-ac4c-b5bc64383222 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:28.486123 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2b0cbd25-774c-4e15-ac4c-b5bc64383222 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:28.486841 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2b0cbd25-774c-4e15-ac4c-b5bc64383222 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:28.487735 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2b0cbd25-774c-4e15-ac4c-b5bc64383222 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:28.488375 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2b0cbd25-774c-4e15-ac4c-b5bc64383222 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:28.488982 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2b0cbd25-774c-4e15-ac4c-b5bc64383222 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:28.658025 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2b0cbd25-774c-4e15-ac4c-b5bc64383222 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:55:28.666326 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2b0cbd25-774c-4e15-ac4c-b5bc64383222 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1342 microversion: 2.1 time: 0.202777 Oct 23 01:55:28.667013 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3391/6879] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:55:28 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1342 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:55:29.689403 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a9962308-337d-4b12-afde-f1909ad7fc43 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:55:29.690066 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a9962308-337d-4b12-afde-f1909ad7fc43 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:55:29.697541 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a9962308-337d-4b12-afde-f1909ad7fc43 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:29.698063 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a9962308-337d-4b12-afde-f1909ad7fc43 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:29.698516 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a9962308-337d-4b12-afde-f1909ad7fc43 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:29.699252 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a9962308-337d-4b12-afde-f1909ad7fc43 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:29.699723 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a9962308-337d-4b12-afde-f1909ad7fc43 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:29.700162 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a9962308-337d-4b12-afde-f1909ad7fc43 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:29.846658 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a9962308-337d-4b12-afde-f1909ad7fc43 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:55:29.854373 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a9962308-337d-4b12-afde-f1909ad7fc43 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1342 microversion: 2.1 time: 0.169515 Oct 23 01:55:29.854949 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3489/6880] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:55:29 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1342 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:55:30.878898 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-23ecceaa-5f5e-450a-9a67-c9b00ab2d8b4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:55:30.883081 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-23ecceaa-5f5e-450a-9a67-c9b00ab2d8b4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:55:30.890724 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-23ecceaa-5f5e-450a-9a67-c9b00ab2d8b4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:30.893895 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-23ecceaa-5f5e-450a-9a67-c9b00ab2d8b4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:30.894635 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-23ecceaa-5f5e-450a-9a67-c9b00ab2d8b4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:30.900164 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-23ecceaa-5f5e-450a-9a67-c9b00ab2d8b4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:30.901044 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-23ecceaa-5f5e-450a-9a67-c9b00ab2d8b4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:30.901496 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-23ecceaa-5f5e-450a-9a67-c9b00ab2d8b4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:31.066394 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-23ecceaa-5f5e-450a-9a67-c9b00ab2d8b4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:55:31.074582 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-23ecceaa-5f5e-450a-9a67-c9b00ab2d8b4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1342 microversion: 2.1 time: 0.200560 Oct 23 01:55:31.075153 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3392/6881] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:55:30 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1342 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:55:32.098764 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e73c3342-a809-4ea1-a00b-cd17d80c1bfc tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:55:32.104250 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e73c3342-a809-4ea1-a00b-cd17d80c1bfc tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:55:32.106844 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e73c3342-a809-4ea1-a00b-cd17d80c1bfc tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:32.107345 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e73c3342-a809-4ea1-a00b-cd17d80c1bfc tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:32.107791 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e73c3342-a809-4ea1-a00b-cd17d80c1bfc tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:32.108500 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e73c3342-a809-4ea1-a00b-cd17d80c1bfc tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:32.108973 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e73c3342-a809-4ea1-a00b-cd17d80c1bfc tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:32.109401 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e73c3342-a809-4ea1-a00b-cd17d80c1bfc tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:32.257490 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e73c3342-a809-4ea1-a00b-cd17d80c1bfc tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:55:32.266126 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e73c3342-a809-4ea1-a00b-cd17d80c1bfc tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1342 microversion: 2.1 time: 0.171932 Oct 23 01:55:32.270317 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3490/6882] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:55:32 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1342 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:55:33.290984 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8e7d86d9-8c6e-44ed-b903-691a38d502b8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:55:33.291660 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8e7d86d9-8c6e-44ed-b903-691a38d502b8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:55:33.298854 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8e7d86d9-8c6e-44ed-b903-691a38d502b8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:33.299615 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8e7d86d9-8c6e-44ed-b903-691a38d502b8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:33.300634 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8e7d86d9-8c6e-44ed-b903-691a38d502b8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:33.301727 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8e7d86d9-8c6e-44ed-b903-691a38d502b8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:33.302445 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8e7d86d9-8c6e-44ed-b903-691a38d502b8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:33.303242 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8e7d86d9-8c6e-44ed-b903-691a38d502b8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:33.455881 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8e7d86d9-8c6e-44ed-b903-691a38d502b8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:55:33.455881 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8e7d86d9-8c6e-44ed-b903-691a38d502b8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1342 microversion: 2.1 time: 0.168828 Oct 23 01:55:33.456480 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3393/6883] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:55:33 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1342 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:55:34.481767 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3da83923-bcbe-4a8a-9977-fb8ecaef45b1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:55:34.482524 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3da83923-bcbe-4a8a-9977-fb8ecaef45b1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:55:34.491369 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3da83923-bcbe-4a8a-9977-fb8ecaef45b1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:34.492096 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3da83923-bcbe-4a8a-9977-fb8ecaef45b1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:34.492279 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3da83923-bcbe-4a8a-9977-fb8ecaef45b1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:34.492975 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3da83923-bcbe-4a8a-9977-fb8ecaef45b1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:34.493433 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3da83923-bcbe-4a8a-9977-fb8ecaef45b1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:34.493859 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3da83923-bcbe-4a8a-9977-fb8ecaef45b1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:34.655202 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3da83923-bcbe-4a8a-9977-fb8ecaef45b1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:55:34.667569 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3da83923-bcbe-4a8a-9977-fb8ecaef45b1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1342 microversion: 2.1 time: 0.190159 Oct 23 01:55:34.678410 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3491/6884] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:55:34 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1342 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:55:35.703236 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-984a5b38-66c8-46f6-8479-40b7583906d2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:55:35.706437 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-984a5b38-66c8-46f6-8479-40b7583906d2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:55:35.727897 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-984a5b38-66c8-46f6-8479-40b7583906d2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:35.727897 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-984a5b38-66c8-46f6-8479-40b7583906d2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:35.727897 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-984a5b38-66c8-46f6-8479-40b7583906d2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:35.727897 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-984a5b38-66c8-46f6-8479-40b7583906d2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:35.727897 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-984a5b38-66c8-46f6-8479-40b7583906d2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:35.727897 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-984a5b38-66c8-46f6-8479-40b7583906d2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:35.868647 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-984a5b38-66c8-46f6-8479-40b7583906d2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:55:35.878332 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-984a5b38-66c8-46f6-8479-40b7583906d2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1342 microversion: 2.1 time: 0.181842 Oct 23 01:55:35.879792 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3394/6885] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:55:35 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1342 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:55:36.907798 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f1b40952-f45b-4c68-927d-49ad54ad6546 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:55:36.907798 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f1b40952-f45b-4c68-927d-49ad54ad6546 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:55:36.912616 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1b40952-f45b-4c68-927d-49ad54ad6546 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:36.913113 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1b40952-f45b-4c68-927d-49ad54ad6546 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:36.913554 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1b40952-f45b-4c68-927d-49ad54ad6546 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:36.914433 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1b40952-f45b-4c68-927d-49ad54ad6546 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:36.914901 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1b40952-f45b-4c68-927d-49ad54ad6546 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:36.915324 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1b40952-f45b-4c68-927d-49ad54ad6546 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:37.062293 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f1b40952-f45b-4c68-927d-49ad54ad6546 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:55:37.070145 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f1b40952-f45b-4c68-927d-49ad54ad6546 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1342 microversion: 2.1 time: 0.171232 Oct 23 01:55:37.070725 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3492/6886] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:55:36 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1342 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:55:38.106076 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3f364767-cb8d-4c20-b061-9d0e60ba74d7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:55:38.107672 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3f364767-cb8d-4c20-b061-9d0e60ba74d7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:55:38.117125 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3f364767-cb8d-4c20-b061-9d0e60ba74d7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:38.118881 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3f364767-cb8d-4c20-b061-9d0e60ba74d7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:38.119662 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3f364767-cb8d-4c20-b061-9d0e60ba74d7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:38.120643 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3f364767-cb8d-4c20-b061-9d0e60ba74d7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:38.121709 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3f364767-cb8d-4c20-b061-9d0e60ba74d7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:38.122408 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3f364767-cb8d-4c20-b061-9d0e60ba74d7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:38.268466 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3f364767-cb8d-4c20-b061-9d0e60ba74d7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:55:38.276809 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3f364767-cb8d-4c20-b061-9d0e60ba74d7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1342 microversion: 2.1 time: 0.176450 Oct 23 01:55:38.277894 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3395/6887] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:55:38 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1342 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:55:39.301345 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-feaddf49-533f-4ff7-8b8c-812369a98e7d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:55:39.301961 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-feaddf49-533f-4ff7-8b8c-812369a98e7d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:55:39.309297 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-feaddf49-533f-4ff7-8b8c-812369a98e7d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:39.309834 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-feaddf49-533f-4ff7-8b8c-812369a98e7d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:39.310304 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-feaddf49-533f-4ff7-8b8c-812369a98e7d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:39.310996 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-feaddf49-533f-4ff7-8b8c-812369a98e7d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:39.311453 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-feaddf49-533f-4ff7-8b8c-812369a98e7d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:39.311878 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-feaddf49-533f-4ff7-8b8c-812369a98e7d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:39.503776 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-feaddf49-533f-4ff7-8b8c-812369a98e7d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:55:39.512206 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-feaddf49-533f-4ff7-8b8c-812369a98e7d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1342 microversion: 2.1 time: 0.215446 Oct 23 01:55:39.513313 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3493/6888] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:55:39 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1342 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:55:40.535821 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1d05e50d-ff94-46db-909a-493fb6ecba68 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:55:40.536419 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1d05e50d-ff94-46db-909a-493fb6ecba68 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:55:40.543362 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1d05e50d-ff94-46db-909a-493fb6ecba68 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:40.543893 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1d05e50d-ff94-46db-909a-493fb6ecba68 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:40.550340 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1d05e50d-ff94-46db-909a-493fb6ecba68 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:40.550340 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1d05e50d-ff94-46db-909a-493fb6ecba68 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:40.550340 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1d05e50d-ff94-46db-909a-493fb6ecba68 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:40.550340 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1d05e50d-ff94-46db-909a-493fb6ecba68 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:40.697956 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1d05e50d-ff94-46db-909a-493fb6ecba68 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:55:40.706471 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1d05e50d-ff94-46db-909a-493fb6ecba68 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1342 microversion: 2.1 time: 0.174695 Oct 23 01:55:40.707154 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3396/6889] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:55:40 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1342 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:55:41.739139 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2b160ff5-8759-4ba6-8ffd-d4839ffa05f0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:55:41.739896 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2b160ff5-8759-4ba6-8ffd-d4839ffa05f0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:55:41.754292 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2b160ff5-8759-4ba6-8ffd-d4839ffa05f0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:41.754802 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2b160ff5-8759-4ba6-8ffd-d4839ffa05f0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:41.755254 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2b160ff5-8759-4ba6-8ffd-d4839ffa05f0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:41.755969 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2b160ff5-8759-4ba6-8ffd-d4839ffa05f0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:41.756443 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2b160ff5-8759-4ba6-8ffd-d4839ffa05f0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:41.756874 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2b160ff5-8759-4ba6-8ffd-d4839ffa05f0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:41.979358 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2b160ff5-8759-4ba6-8ffd-d4839ffa05f0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:55:41.989880 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2b160ff5-8759-4ba6-8ffd-d4839ffa05f0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1342 microversion: 2.1 time: 0.254698 Oct 23 01:55:41.990618 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3494/6890] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:55:41 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1342 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:55:43.016791 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-01ec73b3-fdcc-4105-adb7-66e93e7eb18e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:55:43.019338 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-01ec73b3-fdcc-4105-adb7-66e93e7eb18e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:55:43.037291 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-01ec73b3-fdcc-4105-adb7-66e93e7eb18e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:43.037959 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-01ec73b3-fdcc-4105-adb7-66e93e7eb18e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:43.038542 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-01ec73b3-fdcc-4105-adb7-66e93e7eb18e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:43.039383 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-01ec73b3-fdcc-4105-adb7-66e93e7eb18e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:43.039944 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-01ec73b3-fdcc-4105-adb7-66e93e7eb18e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:43.040629 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-01ec73b3-fdcc-4105-adb7-66e93e7eb18e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:43.196460 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-01ec73b3-fdcc-4105-adb7-66e93e7eb18e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:55:43.197831 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-01ec73b3-fdcc-4105-adb7-66e93e7eb18e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1342 microversion: 2.1 time: 0.185473 Oct 23 01:55:43.198449 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3397/6891] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:55:43 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1342 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:55:44.220959 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a2f07a8b-7c36-4522-9ee4-9fe899551c6a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:55:44.224259 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a2f07a8b-7c36-4522-9ee4-9fe899551c6a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:55:44.228929 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a2f07a8b-7c36-4522-9ee4-9fe899551c6a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:44.229476 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a2f07a8b-7c36-4522-9ee4-9fe899551c6a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:44.229873 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a2f07a8b-7c36-4522-9ee4-9fe899551c6a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:44.230612 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a2f07a8b-7c36-4522-9ee4-9fe899551c6a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:44.231073 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a2f07a8b-7c36-4522-9ee4-9fe899551c6a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:44.231567 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a2f07a8b-7c36-4522-9ee4-9fe899551c6a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:44.377484 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a2f07a8b-7c36-4522-9ee4-9fe899551c6a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:55:44.388473 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a2f07a8b-7c36-4522-9ee4-9fe899551c6a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1342 microversion: 2.1 time: 0.168763 Oct 23 01:55:44.388473 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3495/6892] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:55:44 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1342 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:55:45.408289 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f95c4465-a252-4309-a4d6-72e77f7025aa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:55:45.408959 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f95c4465-a252-4309-a4d6-72e77f7025aa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:55:45.416543 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f95c4465-a252-4309-a4d6-72e77f7025aa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:45.420788 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f95c4465-a252-4309-a4d6-72e77f7025aa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:45.420788 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f95c4465-a252-4309-a4d6-72e77f7025aa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:45.420788 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f95c4465-a252-4309-a4d6-72e77f7025aa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:45.420788 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f95c4465-a252-4309-a4d6-72e77f7025aa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:45.420788 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f95c4465-a252-4309-a4d6-72e77f7025aa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:45.568736 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f95c4465-a252-4309-a4d6-72e77f7025aa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:55:45.576636 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f95c4465-a252-4309-a4d6-72e77f7025aa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1342 microversion: 2.1 time: 0.172984 Oct 23 01:55:45.577258 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3398/6893] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:55:45 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1342 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:55:46.600748 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1dab7cca-c60b-4373-bf89-8656f9a51f8a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:55:46.601531 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1dab7cca-c60b-4373-bf89-8656f9a51f8a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:55:46.608413 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1dab7cca-c60b-4373-bf89-8656f9a51f8a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:46.608910 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1dab7cca-c60b-4373-bf89-8656f9a51f8a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:46.611917 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1dab7cca-c60b-4373-bf89-8656f9a51f8a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:46.611917 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1dab7cca-c60b-4373-bf89-8656f9a51f8a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:46.611917 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1dab7cca-c60b-4373-bf89-8656f9a51f8a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:46.611917 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1dab7cca-c60b-4373-bf89-8656f9a51f8a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:46.764055 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1dab7cca-c60b-4373-bf89-8656f9a51f8a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:55:46.772472 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1dab7cca-c60b-4373-bf89-8656f9a51f8a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1342 microversion: 2.1 time: 0.176348 Oct 23 01:55:46.773051 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3496/6894] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:55:46 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1342 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:55:47.795256 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-963b9ca6-6e0a-4629-a8f9-efa969505d36 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:55:47.795880 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-963b9ca6-6e0a-4629-a8f9-efa969505d36 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:55:47.803536 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-963b9ca6-6e0a-4629-a8f9-efa969505d36 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:47.804030 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-963b9ca6-6e0a-4629-a8f9-efa969505d36 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:47.804483 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-963b9ca6-6e0a-4629-a8f9-efa969505d36 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:47.805186 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-963b9ca6-6e0a-4629-a8f9-efa969505d36 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:47.805654 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-963b9ca6-6e0a-4629-a8f9-efa969505d36 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:47.806121 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-963b9ca6-6e0a-4629-a8f9-efa969505d36 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:47.950816 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-963b9ca6-6e0a-4629-a8f9-efa969505d36 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:55:47.962172 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-963b9ca6-6e0a-4629-a8f9-efa969505d36 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1342 microversion: 2.1 time: 0.170634 Oct 23 01:55:47.962772 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3399/6895] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:55:47 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1342 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:55:48.993286 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cf5a210e-b8e2-43cb-bf8e-ffd8226373e4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:55:48.993286 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-cf5a210e-b8e2-43cb-bf8e-ffd8226373e4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:55:48.997770 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf5a210e-b8e2-43cb-bf8e-ffd8226373e4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:48.998702 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf5a210e-b8e2-43cb-bf8e-ffd8226373e4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:48.999460 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf5a210e-b8e2-43cb-bf8e-ffd8226373e4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:49.000727 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf5a210e-b8e2-43cb-bf8e-ffd8226373e4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:49.001134 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf5a210e-b8e2-43cb-bf8e-ffd8226373e4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:49.001798 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf5a210e-b8e2-43cb-bf8e-ffd8226373e4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:49.174894 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cf5a210e-b8e2-43cb-bf8e-ffd8226373e4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:55:49.192552 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cf5a210e-b8e2-43cb-bf8e-ffd8226373e4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1342 microversion: 2.1 time: 0.210107 Oct 23 01:55:49.193265 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3497/6896] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:55:48 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1342 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:55:50.217121 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-77f5924c-f159-4403-a13b-4b54c89e02d3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:55:50.218870 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-77f5924c-f159-4403-a13b-4b54c89e02d3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:55:50.228563 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-77f5924c-f159-4403-a13b-4b54c89e02d3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:50.229456 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-77f5924c-f159-4403-a13b-4b54c89e02d3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:50.230275 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-77f5924c-f159-4403-a13b-4b54c89e02d3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:50.231206 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-77f5924c-f159-4403-a13b-4b54c89e02d3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:50.231852 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-77f5924c-f159-4403-a13b-4b54c89e02d3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:50.232468 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-77f5924c-f159-4403-a13b-4b54c89e02d3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:50.478343 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-77f5924c-f159-4403-a13b-4b54c89e02d3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:55:50.487652 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-77f5924c-f159-4403-a13b-4b54c89e02d3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1342 microversion: 2.1 time: 0.275189 Oct 23 01:55:50.505265 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3400/6897] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:55:50 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1342 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:55:51.517229 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f690d221-cf8a-4dbd-a355-87017d8d36ac tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:55:51.517919 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f690d221-cf8a-4dbd-a355-87017d8d36ac tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:55:51.527398 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f690d221-cf8a-4dbd-a355-87017d8d36ac tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:51.528137 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f690d221-cf8a-4dbd-a355-87017d8d36ac tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:51.528744 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f690d221-cf8a-4dbd-a355-87017d8d36ac tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:51.529822 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f690d221-cf8a-4dbd-a355-87017d8d36ac tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:51.530324 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f690d221-cf8a-4dbd-a355-87017d8d36ac tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:51.535771 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f690d221-cf8a-4dbd-a355-87017d8d36ac tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:51.717416 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f690d221-cf8a-4dbd-a355-87017d8d36ac tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:55:51.728417 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f690d221-cf8a-4dbd-a355-87017d8d36ac tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1342 microversion: 2.1 time: 0.218139 Oct 23 01:55:51.729029 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3498/6898] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:55:51 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1342 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:55:52.754162 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8e04a786-8afd-4bac-b62e-f1c2e8d18083 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:55:52.754930 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8e04a786-8afd-4bac-b62e-f1c2e8d18083 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:55:52.762282 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8e04a786-8afd-4bac-b62e-f1c2e8d18083 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:52.762868 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8e04a786-8afd-4bac-b62e-f1c2e8d18083 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:52.763388 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8e04a786-8afd-4bac-b62e-f1c2e8d18083 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:52.764217 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8e04a786-8afd-4bac-b62e-f1c2e8d18083 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:52.764926 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8e04a786-8afd-4bac-b62e-f1c2e8d18083 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:52.765374 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8e04a786-8afd-4bac-b62e-f1c2e8d18083 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:52.950912 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8e04a786-8afd-4bac-b62e-f1c2e8d18083 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:55:52.960679 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8e04a786-8afd-4bac-b62e-f1c2e8d18083 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1342 microversion: 2.1 time: 0.210957 Oct 23 01:55:52.961457 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3401/6899] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:55:52 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1342 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:55:53.985186 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2a191c43-4960-46a6-a4c6-01b4e4c1125d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:55:53.985831 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2a191c43-4960-46a6-a4c6-01b4e4c1125d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:55:53.993725 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a191c43-4960-46a6-a4c6-01b4e4c1125d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:53.994250 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a191c43-4960-46a6-a4c6-01b4e4c1125d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:53.994700 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a191c43-4960-46a6-a4c6-01b4e4c1125d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:53.995417 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a191c43-4960-46a6-a4c6-01b4e4c1125d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:53.995879 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a191c43-4960-46a6-a4c6-01b4e4c1125d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:53.996313 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a191c43-4960-46a6-a4c6-01b4e4c1125d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:54.389737 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2a191c43-4960-46a6-a4c6-01b4e4c1125d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:55:54.405563 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2a191c43-4960-46a6-a4c6-01b4e4c1125d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1342 microversion: 2.1 time: 0.424492 Oct 23 01:55:54.410329 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3499/6900] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:55:53 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1342 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:55:55.429245 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f4d74fca-0fa8-4f85-b1ef-e12f22cd292c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:55:55.430344 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f4d74fca-0fa8-4f85-b1ef-e12f22cd292c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:55:55.449049 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f4d74fca-0fa8-4f85-b1ef-e12f22cd292c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:55.449766 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f4d74fca-0fa8-4f85-b1ef-e12f22cd292c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:55.450249 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f4d74fca-0fa8-4f85-b1ef-e12f22cd292c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:55.450991 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f4d74fca-0fa8-4f85-b1ef-e12f22cd292c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:55.451466 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f4d74fca-0fa8-4f85-b1ef-e12f22cd292c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:55.451906 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f4d74fca-0fa8-4f85-b1ef-e12f22cd292c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:55.654827 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f4d74fca-0fa8-4f85-b1ef-e12f22cd292c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:55:55.663362 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f4d74fca-0fa8-4f85-b1ef-e12f22cd292c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1388 microversion: 2.1 time: 0.238325 Oct 23 01:55:55.674317 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3402/6901] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:55:55 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1388 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:55:56.687568 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-47a1c66f-47a2-47e2-a92b-cbdc2f8035d0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:55:56.689004 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-47a1c66f-47a2-47e2-a92b-cbdc2f8035d0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:55:56.691958 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=28 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:55:56.697199 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-47a1c66f-47a2-47e2-a92b-cbdc2f8035d0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:56.698173 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-47a1c66f-47a2-47e2-a92b-cbdc2f8035d0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:56.698815 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-47a1c66f-47a2-47e2-a92b-cbdc2f8035d0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:56.699594 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-47a1c66f-47a2-47e2-a92b-cbdc2f8035d0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:56.700066 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-47a1c66f-47a2-47e2-a92b-cbdc2f8035d0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:56.700506 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-47a1c66f-47a2-47e2-a92b-cbdc2f8035d0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:56.703306 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=84 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:55:56.859758 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-47a1c66f-47a2-47e2-a92b-cbdc2f8035d0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:55:56.868434 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-47a1c66f-47a2-47e2-a92b-cbdc2f8035d0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1376 microversion: 2.1 time: 0.184936 Oct 23 01:55:56.869018 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3500/6902] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:55:56 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1376 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:55:57.892090 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4699a2e4-e0cc-408b-9825-4d59a34cf415 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:55:57.893131 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4699a2e4-e0cc-408b-9825-4d59a34cf415 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:55:57.896684 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=26 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:55:57.902680 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4699a2e4-e0cc-408b-9825-4d59a34cf415 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:57.903182 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4699a2e4-e0cc-408b-9825-4d59a34cf415 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:57.903736 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4699a2e4-e0cc-408b-9825-4d59a34cf415 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:57.904502 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4699a2e4-e0cc-408b-9825-4d59a34cf415 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:57.904966 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4699a2e4-e0cc-408b-9825-4d59a34cf415 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:57.905400 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4699a2e4-e0cc-408b-9825-4d59a34cf415 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:57.909567 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=78 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:55:58.133945 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4699a2e4-e0cc-408b-9825-4d59a34cf415 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:55:58.146540 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4699a2e4-e0cc-408b-9825-4d59a34cf415 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1376 microversion: 2.1 time: 0.258013 Oct 23 01:55:58.147470 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3403/6903] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:55:57 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1376 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:55:59.172756 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f676ed8e-7158-4c5a-bf74-a7963d6d7cb6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:55:59.174042 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f676ed8e-7158-4c5a-bf74-a7963d6d7cb6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:55:59.182934 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f676ed8e-7158-4c5a-bf74-a7963d6d7cb6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:59.183657 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f676ed8e-7158-4c5a-bf74-a7963d6d7cb6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:59.184311 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f676ed8e-7158-4c5a-bf74-a7963d6d7cb6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:59.185165 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f676ed8e-7158-4c5a-bf74-a7963d6d7cb6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:55:59.185773 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f676ed8e-7158-4c5a-bf74-a7963d6d7cb6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:55:59.186386 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f676ed8e-7158-4c5a-bf74-a7963d6d7cb6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:55:59.325264 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f676ed8e-7158-4c5a-bf74-a7963d6d7cb6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:55:59.335083 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f676ed8e-7158-4c5a-bf74-a7963d6d7cb6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1376 microversion: 2.1 time: 0.167310 Oct 23 01:55:59.336577 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3501/6904] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:55:59 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1376 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:56:00.360487 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c8162e6d-e3b7-49b3-bfd7-86b3da3d9890 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:00.361846 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c8162e6d-e3b7-49b3-bfd7-86b3da3d9890 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:00.369474 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c8162e6d-e3b7-49b3-bfd7-86b3da3d9890 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:00.370496 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c8162e6d-e3b7-49b3-bfd7-86b3da3d9890 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:00.371119 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c8162e6d-e3b7-49b3-bfd7-86b3da3d9890 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:00.372162 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c8162e6d-e3b7-49b3-bfd7-86b3da3d9890 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:00.372776 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c8162e6d-e3b7-49b3-bfd7-86b3da3d9890 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:00.373353 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c8162e6d-e3b7-49b3-bfd7-86b3da3d9890 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:00.535022 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c8162e6d-e3b7-49b3-bfd7-86b3da3d9890 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:56:00.548413 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c8162e6d-e3b7-49b3-bfd7-86b3da3d9890 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1376 microversion: 2.1 time: 0.192595 Oct 23 01:56:00.551462 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3404/6905] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:00 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1376 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:56:01.584264 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fc18ac35-48a7-4cc1-afbc-16468c48596b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:01.584264 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fc18ac35-48a7-4cc1-afbc-16468c48596b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:01.594506 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fc18ac35-48a7-4cc1-afbc-16468c48596b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:01.595111 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fc18ac35-48a7-4cc1-afbc-16468c48596b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:01.595683 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fc18ac35-48a7-4cc1-afbc-16468c48596b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:01.596672 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fc18ac35-48a7-4cc1-afbc-16468c48596b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:01.597352 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fc18ac35-48a7-4cc1-afbc-16468c48596b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:01.600745 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fc18ac35-48a7-4cc1-afbc-16468c48596b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:01.770492 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fc18ac35-48a7-4cc1-afbc-16468c48596b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:56:01.780498 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fc18ac35-48a7-4cc1-afbc-16468c48596b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1376 microversion: 2.1 time: 0.203038 Oct 23 01:56:01.781293 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3502/6906] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:01 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1376 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:56:02.805168 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a05fe7c8-306b-4c07-932f-acc6266463b8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:02.805812 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a05fe7c8-306b-4c07-932f-acc6266463b8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:02.808762 n-d-master-1 devstack@n-api.service[120945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 23 01:56:02.808915 n-d-master-1 devstack@n-api.service[120945]: Sun Oct 23 01:56:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 (ip 10.222.0.42) !!! Oct 23 01:56:02.823396 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a05fe7c8-306b-4c07-932f-acc6266463b8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:02.823796 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a05fe7c8-306b-4c07-932f-acc6266463b8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:02.824250 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a05fe7c8-306b-4c07-932f-acc6266463b8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:02.824976 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a05fe7c8-306b-4c07-932f-acc6266463b8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:02.825594 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a05fe7c8-306b-4c07-932f-acc6266463b8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:02.826088 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a05fe7c8-306b-4c07-932f-acc6266463b8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:02.982786 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a05fe7c8-306b-4c07-932f-acc6266463b8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:56:02.992986 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a05fe7c8-306b-4c07-932f-acc6266463b8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1376 microversion: 2.1 time: 0.191800 Oct 23 01:56:02.994205 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3405/6907] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:02 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1376 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:56:04.016765 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-863404ef-4afc-4192-a750-6d362e97f612 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:04.018349 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-863404ef-4afc-4192-a750-6d362e97f612 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:04.025543 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-863404ef-4afc-4192-a750-6d362e97f612 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:04.026289 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-863404ef-4afc-4192-a750-6d362e97f612 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:04.026743 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-863404ef-4afc-4192-a750-6d362e97f612 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:04.027583 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-863404ef-4afc-4192-a750-6d362e97f612 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:04.027977 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-863404ef-4afc-4192-a750-6d362e97f612 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:04.028414 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-863404ef-4afc-4192-a750-6d362e97f612 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:04.080955 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-10edb1b4-cc87-4b1b-bf2d-0fe94fd68516 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Action: 'create', calling method: .version_select at 0x7f5cc03dfb80>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-564057006", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1SsUvcGdPYImgNKySC3OyQXL/7cbT5EZ6BtW9VDql+CaHgqXKFE1nJJT1Al36PCCBr7XL4SeP309IZLKWYr8ZBb2dES/AWb6CCjUIj2cY0fnh2+WSFkbv50lQGffTnHA=="}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:56:04.100295 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-10edb1b4-cc87-4b1b-bf2d-0fe94fd68516 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Getting quotas for project 530303744266461da10d50db53a0e409. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:56:04.107574 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-10edb1b4-cc87-4b1b-bf2d-0fe94fd68516 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Getting quotas for user f949b4b3b7b143158acb8aa6ee0a7da8 and project 530303744266461da10d50db53a0e409. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:56:04.202993 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-863404ef-4afc-4192-a750-6d362e97f612 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:56:04.211004 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-863404ef-4afc-4192-a750-6d362e97f612 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1376 microversion: 2.1 time: 0.198250 Oct 23 01:56:04.211576 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3503/6908] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:04 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1376 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:56:04.273845 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-10edb1b4-cc87-4b1b-bf2d-0fe94fd68516 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.197593 Oct 23 01:56:04.274553 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3406/6909] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 01:56:04 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:56:05.234522 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6b648b70-7258-48ca-8f72-835b5ea26f36 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:05.239665 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6b648b70-7258-48ca-8f72-835b5ea26f36 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:05.243374 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b648b70-7258-48ca-8f72-835b5ea26f36 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:05.243921 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b648b70-7258-48ca-8f72-835b5ea26f36 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:05.244383 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b648b70-7258-48ca-8f72-835b5ea26f36 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:05.245078 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b648b70-7258-48ca-8f72-835b5ea26f36 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:05.245713 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b648b70-7258-48ca-8f72-835b5ea26f36 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:05.246240 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b648b70-7258-48ca-8f72-835b5ea26f36 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:05.401600 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6b648b70-7258-48ca-8f72-835b5ea26f36 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:56:05.409446 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6b648b70-7258-48ca-8f72-835b5ea26f36 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1376 microversion: 2.1 time: 0.178793 Oct 23 01:56:05.422494 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3504/6910] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:05 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1376 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:56:06.168867 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-e6451819-5877-4c12-bc48-413c2728d31e req-086e2105-086a-4de3-b23a-be90fc7b00b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2", "name": "network-vif-plugged", "status": "completed", "tag": "892a7f15-4a18-45c1-af8f-e7cc21a91f0b"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:56:06.187822 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-e6451819-5877-4c12-bc48-413c2728d31e req-086e2105-086a-4de3-b23a-be90fc7b00b9 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:06.188663 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-e6451819-5877-4c12-bc48-413c2728d31e req-086e2105-086a-4de3-b23a-be90fc7b00b9 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:06.192372 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-e6451819-5877-4c12-bc48-413c2728d31e req-086e2105-086a-4de3-b23a-be90fc7b00b9 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:06.220563 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-e6451819-5877-4c12-bc48-413c2728d31e req-086e2105-086a-4de3-b23a-be90fc7b00b9 service nova] Creating event network-vif-plugged:892a7f15-4a18-45c1-af8f-e7cc21a91f0b for instance 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 on n-h1-master-1 Oct 23 01:56:06.223601 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-e6451819-5877-4c12-bc48-413c2728d31e req-086e2105-086a-4de3-b23a-be90fc7b00b9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060978 Oct 23 01:56:06.224295 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3407/6911] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:56:06.432938 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ee23adac-479d-4285-96ca-2ff0ace3edeb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:06.433661 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ee23adac-479d-4285-96ca-2ff0ace3edeb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:06.441311 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ee23adac-479d-4285-96ca-2ff0ace3edeb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:06.441805 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ee23adac-479d-4285-96ca-2ff0ace3edeb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:06.442281 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ee23adac-479d-4285-96ca-2ff0ace3edeb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:06.442981 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ee23adac-479d-4285-96ca-2ff0ace3edeb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:06.443441 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ee23adac-479d-4285-96ca-2ff0ace3edeb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:06.443868 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ee23adac-479d-4285-96ca-2ff0ace3edeb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:06.613773 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ee23adac-479d-4285-96ca-2ff0ace3edeb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:56:06.618434 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ee23adac-479d-4285-96ca-2ff0ace3edeb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1376 microversion: 2.1 time: 0.189549 Oct 23 01:56:06.618980 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3505/6912] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:06 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1376 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:56:07.364064 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b5266264-6042-41d1-ba3b-173ea668e0bc tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-466668457", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "3627163e-3a7a-4b23-b979-735acc50efc0", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-564057006", "security_groups": [{"name": "tempest-secgroup-smoke-359102700"}], "networks": [{"uuid": "11b72ef8-bed4-4ef1-96bc-a28a240d39fe"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:56:07.523309 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-b5266264-6042-41d1-ba3b-173ea668e0bc tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] validate_networks() for [('11b72ef8-bed4-4ef1-96bc-a28a240d39fe', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:56:07.643593 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fef9ffa7-1985-44be-a5af-1e42846b8e73 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:07.645551 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fef9ffa7-1985-44be-a5af-1e42846b8e73 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:07.655751 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fef9ffa7-1985-44be-a5af-1e42846b8e73 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:07.659789 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fef9ffa7-1985-44be-a5af-1e42846b8e73 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:07.660460 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fef9ffa7-1985-44be-a5af-1e42846b8e73 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:07.664096 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fef9ffa7-1985-44be-a5af-1e42846b8e73 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:07.664096 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fef9ffa7-1985-44be-a5af-1e42846b8e73 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:07.664096 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fef9ffa7-1985-44be-a5af-1e42846b8e73 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:07.856760 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fef9ffa7-1985-44be-a5af-1e42846b8e73 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:56:07.886103 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fef9ffa7-1985-44be-a5af-1e42846b8e73 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1376 microversion: 2.1 time: 0.247601 Oct 23 01:56:07.898595 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3506/6913] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:07 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1376 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:56:08.101405 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-b5266264-6042-41d1-ba3b-173ea668e0bc tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:56:08.102530 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-b5266264-6042-41d1-ba3b-173ea668e0bc tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:56:08.103064 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-b5266264-6042-41d1-ba3b-173ea668e0bc tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:56:08.103446 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-b5266264-6042-41d1-ba3b-173ea668e0bc tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:56:08.103933 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-b5266264-6042-41d1-ba3b-173ea668e0bc tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:56:08.116546 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b5266264-6042-41d1-ba3b-173ea668e0bc tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:08.117607 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b5266264-6042-41d1-ba3b-173ea668e0bc tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:08.119742 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b5266264-6042-41d1-ba3b-173ea668e0bc tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:08.120878 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b5266264-6042-41d1-ba3b-173ea668e0bc tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:08.121361 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b5266264-6042-41d1-ba3b-173ea668e0bc tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:08.121828 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b5266264-6042-41d1-ba3b-173ea668e0bc tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:08.141804 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-b5266264-6042-41d1-ba3b-173ea668e0bc tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Getting quotas for project 530303744266461da10d50db53a0e409. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:56:08.147804 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-b5266264-6042-41d1-ba3b-173ea668e0bc tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Getting quotas for user f949b4b3b7b143158acb8aa6ee0a7da8 and project 530303744266461da10d50db53a0e409. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:56:08.209036 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b5266264-6042-41d1-ba3b-173ea668e0bc tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:56:08.211523 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b5266264-6042-41d1-ba3b-173ea668e0bc tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] [instance: 72a32ad2-2150-4cdf-9dbd-987ba14d5f96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3627163e-3a7a-4b23-b979-735acc50efc0',volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:56:08.710465 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b5266264-6042-41d1-ba3b-173ea668e0bc tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.352565 Oct 23 01:56:08.712014 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3408/6914] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:56:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 1356 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:56:08.726322 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d331c545-a60b-4648-b096-365bc45bec86 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:08.727479 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d331c545-a60b-4648-b096-365bc45bec86 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] [instance: 72a32ad2-2150-4cdf-9dbd-987ba14d5f96] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:08.794254 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d331c545-a60b-4648-b096-365bc45bec86 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949b4b3b7b143158acb8aa6ee0a7da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530303744266461da10d50db53a0e409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:56:08.800553 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d331c545-a60b-4648-b096-365bc45bec86 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] 10.222.0.42 "GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96" status: 200 len: 1097 microversion: 2.1 time: 0.078896 Oct 23 01:56:08.801814 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3507/6915] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:08 2022] GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96 => generated 1097 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:56:08.910816 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d7e3d827-91af-4955-8d4c-0173b384ca47 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:08.911449 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d7e3d827-91af-4955-8d4c-0173b384ca47 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:08.919680 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d7e3d827-91af-4955-8d4c-0173b384ca47 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:08.920187 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d7e3d827-91af-4955-8d4c-0173b384ca47 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:08.920649 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d7e3d827-91af-4955-8d4c-0173b384ca47 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:08.921408 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d7e3d827-91af-4955-8d4c-0173b384ca47 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:08.921878 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d7e3d827-91af-4955-8d4c-0173b384ca47 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:08.922562 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d7e3d827-91af-4955-8d4c-0173b384ca47 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:09.060516 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d7e3d827-91af-4955-8d4c-0173b384ca47 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:56:09.069293 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d7e3d827-91af-4955-8d4c-0173b384ca47 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1563 microversion: 2.1 time: 0.162565 Oct 23 01:56:09.069956 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3409/6916] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:08 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1563 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:56:09.093067 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6df9f27f-bbab-4789-a1c8-0fc47caf55e6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:09.093773 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6df9f27f-bbab-4789-a1c8-0fc47caf55e6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:09.101061 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6df9f27f-bbab-4789-a1c8-0fc47caf55e6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:09.101625 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6df9f27f-bbab-4789-a1c8-0fc47caf55e6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:09.102160 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6df9f27f-bbab-4789-a1c8-0fc47caf55e6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:09.105275 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6df9f27f-bbab-4789-a1c8-0fc47caf55e6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:09.105275 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6df9f27f-bbab-4789-a1c8-0fc47caf55e6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:09.105275 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6df9f27f-bbab-4789-a1c8-0fc47caf55e6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:09.263294 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6df9f27f-bbab-4789-a1c8-0fc47caf55e6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:56:09.272658 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6df9f27f-bbab-4789-a1c8-0fc47caf55e6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1563 microversion: 2.1 time: 0.183685 Oct 23 01:56:09.273940 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3508/6917] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:09 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1563 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:56:09.368943 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e309c684-8e4d-4c02-8131-bcd5025fc4a8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:09.369468 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e309c684-8e4d-4c02-8131-bcd5025fc4a8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:09.384661 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e309c684-8e4d-4c02-8131-bcd5025fc4a8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:09.385179 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e309c684-8e4d-4c02-8131-bcd5025fc4a8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:09.385648 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e309c684-8e4d-4c02-8131-bcd5025fc4a8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:09.387924 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e309c684-8e4d-4c02-8131-bcd5025fc4a8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:09.388423 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e309c684-8e4d-4c02-8131-bcd5025fc4a8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:09.389140 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e309c684-8e4d-4c02-8131-bcd5025fc4a8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:09.420526 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e309c684-8e4d-4c02-8131-bcd5025fc4a8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:56:09.826601 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c0547256-a2c8-4e83-9e35-4e39422f3a13 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:09.827359 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c0547256-a2c8-4e83-9e35-4e39422f3a13 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] [instance: 72a32ad2-2150-4cdf-9dbd-987ba14d5f96] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:09.833523 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e309c684-8e4d-4c02-8131-bcd5025fc4a8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "DELETE /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 204 len: 0 microversion: 2.1 time: 0.468298 Oct 23 01:56:09.834649 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3410/6918] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:56:09 2022] DELETE /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:56:09.843987 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d49b1627-8a46-4518-8171-d5b816ba6664 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:09.850478 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d49b1627-8a46-4518-8171-d5b816ba6664 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:09.862428 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d49b1627-8a46-4518-8171-d5b816ba6664 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:09.863046 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d49b1627-8a46-4518-8171-d5b816ba6664 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:09.868879 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d49b1627-8a46-4518-8171-d5b816ba6664 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:09.869724 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d49b1627-8a46-4518-8171-d5b816ba6664 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:09.871745 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d49b1627-8a46-4518-8171-d5b816ba6664 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:09.872685 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d49b1627-8a46-4518-8171-d5b816ba6664 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:09.896817 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c0547256-a2c8-4e83-9e35-4e39422f3a13 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949b4b3b7b143158acb8aa6ee0a7da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530303744266461da10d50db53a0e409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:56:09.903923 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c0547256-a2c8-4e83-9e35-4e39422f3a13 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] 10.222.0.42 "GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96" status: 200 len: 1097 microversion: 2.1 time: 0.081654 Oct 23 01:56:09.904511 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3509/6919] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:09 2022] GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96 => generated 1097 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:56:10.077356 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d49b1627-8a46-4518-8171-d5b816ba6664 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:56:10.086836 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d49b1627-8a46-4518-8171-d5b816ba6664 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1569 microversion: 2.1 time: 0.247270 Oct 23 01:56:10.087440 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3411/6920] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:09 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1569 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:56:10.938800 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e7c1e321-9b30-44d9-b23b-2c236eabff8b tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:10.939338 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e7c1e321-9b30-44d9-b23b-2c236eabff8b tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] [instance: 72a32ad2-2150-4cdf-9dbd-987ba14d5f96] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:10.951732 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e7c1e321-9b30-44d9-b23b-2c236eabff8b tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:10.952234 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e7c1e321-9b30-44d9-b23b-2c236eabff8b tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:10.952667 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e7c1e321-9b30-44d9-b23b-2c236eabff8b tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:10.953566 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e7c1e321-9b30-44d9-b23b-2c236eabff8b tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:10.954209 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e7c1e321-9b30-44d9-b23b-2c236eabff8b tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:10.954648 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e7c1e321-9b30-44d9-b23b-2c236eabff8b tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:11.018003 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e7c1e321-9b30-44d9-b23b-2c236eabff8b tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949b4b3b7b143158acb8aa6ee0a7da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530303744266461da10d50db53a0e409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:56:11.026699 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e7c1e321-9b30-44d9-b23b-2c236eabff8b tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] 10.222.0.42 "GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96" status: 200 len: 1195 microversion: 2.1 time: 0.099437 Oct 23 01:56:11.027267 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3510/6921] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:10 2022] GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96 => generated 1195 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:56:11.110511 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5a1710fb-9303-4cb8-b5a5-81b38bae0dda tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:11.112972 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5a1710fb-9303-4cb8-b5a5-81b38bae0dda tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:11.118538 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5a1710fb-9303-4cb8-b5a5-81b38bae0dda tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:11.119059 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5a1710fb-9303-4cb8-b5a5-81b38bae0dda tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:11.119509 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5a1710fb-9303-4cb8-b5a5-81b38bae0dda tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:11.120216 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5a1710fb-9303-4cb8-b5a5-81b38bae0dda tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:11.120688 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5a1710fb-9303-4cb8-b5a5-81b38bae0dda tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:11.121124 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5a1710fb-9303-4cb8-b5a5-81b38bae0dda tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:11.266900 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5a1710fb-9303-4cb8-b5a5-81b38bae0dda tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:56:11.275654 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5a1710fb-9303-4cb8-b5a5-81b38bae0dda tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1569 microversion: 2.1 time: 0.168914 Oct 23 01:56:11.276235 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3412/6922] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:11 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:56:12.051842 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f0a480b4-3c1a-4b2f-87d8-fcc6be55d870 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:12.060399 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f0a480b4-3c1a-4b2f-87d8-fcc6be55d870 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] [instance: 72a32ad2-2150-4cdf-9dbd-987ba14d5f96] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:12.069480 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f0a480b4-3c1a-4b2f-87d8-fcc6be55d870 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:12.070296 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f0a480b4-3c1a-4b2f-87d8-fcc6be55d870 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:12.070950 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f0a480b4-3c1a-4b2f-87d8-fcc6be55d870 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:12.071766 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f0a480b4-3c1a-4b2f-87d8-fcc6be55d870 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:12.072307 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f0a480b4-3c1a-4b2f-87d8-fcc6be55d870 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:12.072851 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f0a480b4-3c1a-4b2f-87d8-fcc6be55d870 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:12.155386 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f0a480b4-3c1a-4b2f-87d8-fcc6be55d870 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949b4b3b7b143158acb8aa6ee0a7da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530303744266461da10d50db53a0e409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:56:12.187293 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f0a480b4-3c1a-4b2f-87d8-fcc6be55d870 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] 10.222.0.42 "GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96" status: 200 len: 1213 microversion: 2.1 time: 0.140263 Oct 23 01:56:12.189333 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3511/6923] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:12 2022] GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96 => generated 1213 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:56:12.299930 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c66c4951-34a8-4c14-8002-2c14060d6837 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:12.300713 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c66c4951-34a8-4c14-8002-2c14060d6837 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:12.313604 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c66c4951-34a8-4c14-8002-2c14060d6837 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:12.314433 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c66c4951-34a8-4c14-8002-2c14060d6837 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:12.314993 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c66c4951-34a8-4c14-8002-2c14060d6837 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:12.316019 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c66c4951-34a8-4c14-8002-2c14060d6837 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:12.316650 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c66c4951-34a8-4c14-8002-2c14060d6837 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:12.317195 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c66c4951-34a8-4c14-8002-2c14060d6837 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:12.536528 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c66c4951-34a8-4c14-8002-2c14060d6837 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:56:12.576179 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c66c4951-34a8-4c14-8002-2c14060d6837 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1569 microversion: 2.1 time: 0.273452 Oct 23 01:56:12.578090 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3413/6924] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:12 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1569 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:56:13.212646 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-219e5d31-8158-48c4-ab22-f119c7258add tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:13.213570 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-219e5d31-8158-48c4-ab22-f119c7258add tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] [instance: 72a32ad2-2150-4cdf-9dbd-987ba14d5f96] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:13.221892 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-219e5d31-8158-48c4-ab22-f119c7258add tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:13.223179 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-219e5d31-8158-48c4-ab22-f119c7258add tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:13.223809 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-219e5d31-8158-48c4-ab22-f119c7258add tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:13.224663 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-219e5d31-8158-48c4-ab22-f119c7258add tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:13.225295 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-219e5d31-8158-48c4-ab22-f119c7258add tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:13.225946 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-219e5d31-8158-48c4-ab22-f119c7258add tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:13.316067 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-3bcaceb7-6428-43fd-975d-62c1e4f905f7 req-6885d9ad-f5d9-4748-b4ed-65c0d419f7cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2", "name": "network-vif-deleted", "tag": "892a7f15-4a18-45c1-af8f-e7cc21a91f0b"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:56:13.335348 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-3bcaceb7-6428-43fd-975d-62c1e4f905f7 req-6885d9ad-f5d9-4748-b4ed-65c0d419f7cf service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:13.336032 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-3bcaceb7-6428-43fd-975d-62c1e4f905f7 req-6885d9ad-f5d9-4748-b4ed-65c0d419f7cf service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:13.336627 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-3bcaceb7-6428-43fd-975d-62c1e4f905f7 req-6885d9ad-f5d9-4748-b4ed-65c0d419f7cf service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:13.348484 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-219e5d31-8158-48c4-ab22-f119c7258add tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949b4b3b7b143158acb8aa6ee0a7da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530303744266461da10d50db53a0e409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:56:13.359786 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-219e5d31-8158-48c4-ab22-f119c7258add tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] 10.222.0.42 "GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96" status: 200 len: 1213 microversion: 2.1 time: 0.152014 Oct 23 01:56:13.361118 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3512/6925] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:13 2022] GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96 => generated 1213 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:56:13.603207 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-51374110-377b-48ef-9372-e66acc21ddfa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:13.604643 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-51374110-377b-48ef-9372-e66acc21ddfa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:13.614228 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-51374110-377b-48ef-9372-e66acc21ddfa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:13.615878 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-51374110-377b-48ef-9372-e66acc21ddfa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:13.617000 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-51374110-377b-48ef-9372-e66acc21ddfa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:13.618589 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-51374110-377b-48ef-9372-e66acc21ddfa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:13.619401 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-51374110-377b-48ef-9372-e66acc21ddfa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:13.620291 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-51374110-377b-48ef-9372-e66acc21ddfa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:13.680741 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-3bcaceb7-6428-43fd-975d-62c1e4f905f7 req-6885d9ad-f5d9-4748-b4ed-65c0d419f7cf service nova] Creating event network-vif-deleted:892a7f15-4a18-45c1-af8f-e7cc21a91f0b for instance 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 on n-h1-master-1 Oct 23 01:56:13.687744 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-3bcaceb7-6428-43fd-975d-62c1e4f905f7 req-6885d9ad-f5d9-4748-b4ed-65c0d419f7cf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.375867 Oct 23 01:56:13.690309 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3414/6926] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:56:13.742999 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-51374110-377b-48ef-9372-e66acc21ddfa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:56:13.756755 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-51374110-377b-48ef-9372-e66acc21ddfa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1361 microversion: 2.1 time: 0.158422 Oct 23 01:56:13.757508 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3513/6927] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:13 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:56:14.384483 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-aa3104e0-1d5c-40cf-a21e-2803721e586a tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:14.385193 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-aa3104e0-1d5c-40cf-a21e-2803721e586a tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] [instance: 72a32ad2-2150-4cdf-9dbd-987ba14d5f96] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:14.396830 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa3104e0-1d5c-40cf-a21e-2803721e586a tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:14.398154 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa3104e0-1d5c-40cf-a21e-2803721e586a tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:14.398738 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa3104e0-1d5c-40cf-a21e-2803721e586a tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:14.399721 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa3104e0-1d5c-40cf-a21e-2803721e586a tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:14.401175 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa3104e0-1d5c-40cf-a21e-2803721e586a tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:14.401691 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa3104e0-1d5c-40cf-a21e-2803721e586a tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:14.638722 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-aa3104e0-1d5c-40cf-a21e-2803721e586a tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949b4b3b7b143158acb8aa6ee0a7da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530303744266461da10d50db53a0e409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:56:14.647009 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-aa3104e0-1d5c-40cf-a21e-2803721e586a tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] 10.222.0.42 "GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96" status: 200 len: 1280 microversion: 2.1 time: 0.267591 Oct 23 01:56:14.658568 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3415/6928] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:14 2022] GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96 => generated 1280 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:56:14.781466 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a3758c78-facd-48dd-afe7-46c34188bffb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:14.782149 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a3758c78-facd-48dd-afe7-46c34188bffb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:14.792303 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a3758c78-facd-48dd-afe7-46c34188bffb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:14.792303 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a3758c78-facd-48dd-afe7-46c34188bffb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:14.792303 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a3758c78-facd-48dd-afe7-46c34188bffb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:14.792944 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a3758c78-facd-48dd-afe7-46c34188bffb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:14.793789 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a3758c78-facd-48dd-afe7-46c34188bffb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:14.794739 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a3758c78-facd-48dd-afe7-46c34188bffb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:14.894849 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a3758c78-facd-48dd-afe7-46c34188bffb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:56:14.903359 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a3758c78-facd-48dd-afe7-46c34188bffb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1361 microversion: 2.1 time: 0.126319 Oct 23 01:56:14.904524 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3514/6929] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:14 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1361 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:56:15.670856 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b63af8c9-6ccb-4e72-a9c0-fbb23ebb4349 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:15.672159 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b63af8c9-6ccb-4e72-a9c0-fbb23ebb4349 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] [instance: 72a32ad2-2150-4cdf-9dbd-987ba14d5f96] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:15.679685 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b63af8c9-6ccb-4e72-a9c0-fbb23ebb4349 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:15.680200 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b63af8c9-6ccb-4e72-a9c0-fbb23ebb4349 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:15.680689 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b63af8c9-6ccb-4e72-a9c0-fbb23ebb4349 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:15.681449 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b63af8c9-6ccb-4e72-a9c0-fbb23ebb4349 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:15.681923 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b63af8c9-6ccb-4e72-a9c0-fbb23ebb4349 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:15.682392 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b63af8c9-6ccb-4e72-a9c0-fbb23ebb4349 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:15.745359 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-893415b4-f6d0-43f8-acec-bb963f9856a5 req-b9555ab3-c60e-4d2d-ac6d-56953c748b61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72a32ad2-2150-4cdf-9dbd-987ba14d5f96", "tag": "f2a6b2ca-5db4-47f5-9c02-52fc6cde4334"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:56:15.759673 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-893415b4-f6d0-43f8-acec-bb963f9856a5 req-b9555ab3-c60e-4d2d-ac6d-56953c748b61 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:15.760495 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-893415b4-f6d0-43f8-acec-bb963f9856a5 req-b9555ab3-c60e-4d2d-ac6d-56953c748b61 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:15.761105 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-893415b4-f6d0-43f8-acec-bb963f9856a5 req-b9555ab3-c60e-4d2d-ac6d-56953c748b61 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:15.778775 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-893415b4-f6d0-43f8-acec-bb963f9856a5 req-b9555ab3-c60e-4d2d-ac6d-56953c748b61 service nova] Creating event network-changed:f2a6b2ca-5db4-47f5-9c02-52fc6cde4334 for instance 72a32ad2-2150-4cdf-9dbd-987ba14d5f96 on n-h2-master-1 Oct 23 01:56:15.784236 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-893415b4-f6d0-43f8-acec-bb963f9856a5 req-b9555ab3-c60e-4d2d-ac6d-56953c748b61 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043509 Oct 23 01:56:15.785009 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3515/6930] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:56:15.840814 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b63af8c9-6ccb-4e72-a9c0-fbb23ebb4349 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949b4b3b7b143158acb8aa6ee0a7da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530303744266461da10d50db53a0e409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:56:15.850379 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b63af8c9-6ccb-4e72-a9c0-fbb23ebb4349 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] 10.222.0.42 "GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96" status: 200 len: 1280 microversion: 2.1 time: 0.183896 Oct 23 01:56:15.851078 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3416/6931] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:15 2022] GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96 => generated 1280 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:56:15.930782 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b7908245-1ab9-49f3-bba9-61ad7534784b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:15.931507 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b7908245-1ab9-49f3-bba9-61ad7534784b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:15.939136 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b7908245-1ab9-49f3-bba9-61ad7534784b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:15.939136 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b7908245-1ab9-49f3-bba9-61ad7534784b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:15.939416 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b7908245-1ab9-49f3-bba9-61ad7534784b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:15.940141 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b7908245-1ab9-49f3-bba9-61ad7534784b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:15.940607 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b7908245-1ab9-49f3-bba9-61ad7534784b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:15.941629 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b7908245-1ab9-49f3-bba9-61ad7534784b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:16.031764 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b7908245-1ab9-49f3-bba9-61ad7534784b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:56:16.040377 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b7908245-1ab9-49f3-bba9-61ad7534784b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1361 microversion: 2.1 time: 0.115770 Oct 23 01:56:16.040966 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3516/6932] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:15 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1361 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:56:16.873961 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c235cb50-4e5e-4daa-92cf-cdc364a3eed8 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:16.874767 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c235cb50-4e5e-4daa-92cf-cdc364a3eed8 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] [instance: 72a32ad2-2150-4cdf-9dbd-987ba14d5f96] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:16.881592 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c235cb50-4e5e-4daa-92cf-cdc364a3eed8 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:16.882131 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c235cb50-4e5e-4daa-92cf-cdc364a3eed8 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:16.882583 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c235cb50-4e5e-4daa-92cf-cdc364a3eed8 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:16.883280 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c235cb50-4e5e-4daa-92cf-cdc364a3eed8 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:16.883747 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c235cb50-4e5e-4daa-92cf-cdc364a3eed8 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:16.884179 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c235cb50-4e5e-4daa-92cf-cdc364a3eed8 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:17.016912 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c235cb50-4e5e-4daa-92cf-cdc364a3eed8 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949b4b3b7b143158acb8aa6ee0a7da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530303744266461da10d50db53a0e409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:56:17.025571 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c235cb50-4e5e-4daa-92cf-cdc364a3eed8 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] 10.222.0.42 "GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96" status: 200 len: 1280 microversion: 2.1 time: 0.155514 Oct 23 01:56:17.026150 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3417/6933] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:16 2022] GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96 => generated 1280 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:56:17.065070 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5eddb4e8-626d-420f-ad80-be135e2496a3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:17.066203 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5eddb4e8-626d-420f-ad80-be135e2496a3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:17.073178 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5eddb4e8-626d-420f-ad80-be135e2496a3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:17.073910 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5eddb4e8-626d-420f-ad80-be135e2496a3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:17.074373 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5eddb4e8-626d-420f-ad80-be135e2496a3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:17.075066 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5eddb4e8-626d-420f-ad80-be135e2496a3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:17.075522 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5eddb4e8-626d-420f-ad80-be135e2496a3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:17.075946 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5eddb4e8-626d-420f-ad80-be135e2496a3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:17.141223 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5eddb4e8-626d-420f-ad80-be135e2496a3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:56:17.149839 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5eddb4e8-626d-420f-ad80-be135e2496a3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1361 microversion: 2.1 time: 0.088955 Oct 23 01:56:17.150454 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3517/6934] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:17 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1361 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:56:18.048446 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e39b485d-0adf-45b8-9de4-d5b498cb7581 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:18.049079 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e39b485d-0adf-45b8-9de4-d5b498cb7581 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] [instance: 72a32ad2-2150-4cdf-9dbd-987ba14d5f96] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:18.056586 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e39b485d-0adf-45b8-9de4-d5b498cb7581 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:18.057089 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e39b485d-0adf-45b8-9de4-d5b498cb7581 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:18.057541 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e39b485d-0adf-45b8-9de4-d5b498cb7581 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:18.058340 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e39b485d-0adf-45b8-9de4-d5b498cb7581 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:18.058812 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e39b485d-0adf-45b8-9de4-d5b498cb7581 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:18.059258 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e39b485d-0adf-45b8-9de4-d5b498cb7581 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:18.133264 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:56:18.155417 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=10 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:56:18.172889 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-56ce5435-41d9-4681-8390-923009cad4dc tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:18.173666 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-56ce5435-41d9-4681-8390-923009cad4dc tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:18.180965 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-56ce5435-41d9-4681-8390-923009cad4dc tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:18.181542 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-56ce5435-41d9-4681-8390-923009cad4dc tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:18.181926 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-56ce5435-41d9-4681-8390-923009cad4dc tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:18.182683 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-56ce5435-41d9-4681-8390-923009cad4dc tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:18.183149 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-56ce5435-41d9-4681-8390-923009cad4dc tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:18.183768 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-56ce5435-41d9-4681-8390-923009cad4dc tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:18.197116 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e39b485d-0adf-45b8-9de4-d5b498cb7581 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949b4b3b7b143158acb8aa6ee0a7da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530303744266461da10d50db53a0e409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:56:18.213385 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e39b485d-0adf-45b8-9de4-d5b498cb7581 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] 10.222.0.42 "GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96" status: 200 len: 1280 microversion: 2.1 time: 0.169018 Oct 23 01:56:18.214281 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3418/6935] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:18 2022] GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96 => generated 1280 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:56:18.258320 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-56ce5435-41d9-4681-8390-923009cad4dc tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:56:18.266689 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-56ce5435-41d9-4681-8390-923009cad4dc tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1361 microversion: 2.1 time: 0.097820 Oct 23 01:56:18.267271 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3518/6936] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:18 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1361 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:56:19.237204 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5b520b43-d730-4796-a9f5-c159a7a3b1af tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:19.238785 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5b520b43-d730-4796-a9f5-c159a7a3b1af tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] [instance: 72a32ad2-2150-4cdf-9dbd-987ba14d5f96] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:19.246140 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5b520b43-d730-4796-a9f5-c159a7a3b1af tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:19.246642 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5b520b43-d730-4796-a9f5-c159a7a3b1af tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:19.247088 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5b520b43-d730-4796-a9f5-c159a7a3b1af tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:19.247895 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5b520b43-d730-4796-a9f5-c159a7a3b1af tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:19.248424 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5b520b43-d730-4796-a9f5-c159a7a3b1af tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:19.248864 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5b520b43-d730-4796-a9f5-c159a7a3b1af tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:19.291014 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-26d63776-3259-4f6e-850f-25e4d2f3a8ea tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:19.291826 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-26d63776-3259-4f6e-850f-25e4d2f3a8ea tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:19.299020 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-26d63776-3259-4f6e-850f-25e4d2f3a8ea tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:19.299703 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-26d63776-3259-4f6e-850f-25e4d2f3a8ea tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:19.300913 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-26d63776-3259-4f6e-850f-25e4d2f3a8ea tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:19.301677 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-26d63776-3259-4f6e-850f-25e4d2f3a8ea tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:19.302238 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-26d63776-3259-4f6e-850f-25e4d2f3a8ea tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:19.302843 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-26d63776-3259-4f6e-850f-25e4d2f3a8ea tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:19.318985 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=100 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:56:19.380247 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-26d63776-3259-4f6e-850f-25e4d2f3a8ea tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:56:19.389879 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-26d63776-3259-4f6e-850f-25e4d2f3a8ea tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1361 microversion: 2.1 time: 0.102848 Oct 23 01:56:19.390814 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3519/6937] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:19 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1361 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:56:19.415899 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5b520b43-d730-4796-a9f5-c159a7a3b1af tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949b4b3b7b143158acb8aa6ee0a7da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530303744266461da10d50db53a0e409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:56:19.423920 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5b520b43-d730-4796-a9f5-c159a7a3b1af tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] 10.222.0.42 "GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96" status: 200 len: 1280 microversion: 2.1 time: 0.191100 Oct 23 01:56:19.424672 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3419/6938] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:19 2022] GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96 => generated 1280 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:56:20.413490 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6279be12-fe2a-40db-b92a-23611a566c8c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:20.414061 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6279be12-fe2a-40db-b92a-23611a566c8c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:20.415914 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=4 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:56:20.421583 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6279be12-fe2a-40db-b92a-23611a566c8c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:20.422105 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6279be12-fe2a-40db-b92a-23611a566c8c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:20.422543 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6279be12-fe2a-40db-b92a-23611a566c8c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:20.423239 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6279be12-fe2a-40db-b92a-23611a566c8c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:20.423828 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6279be12-fe2a-40db-b92a-23611a566c8c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:20.424240 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6279be12-fe2a-40db-b92a-23611a566c8c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:20.453016 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-84a56b2f-5fc3-4d00-8e3b-91f37278cbda tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:20.454320 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-84a56b2f-5fc3-4d00-8e3b-91f37278cbda tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] [instance: 72a32ad2-2150-4cdf-9dbd-987ba14d5f96] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:20.461808 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-84a56b2f-5fc3-4d00-8e3b-91f37278cbda tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:20.462359 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-84a56b2f-5fc3-4d00-8e3b-91f37278cbda tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:20.462813 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-84a56b2f-5fc3-4d00-8e3b-91f37278cbda tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:20.463532 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-84a56b2f-5fc3-4d00-8e3b-91f37278cbda tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:20.464178 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-84a56b2f-5fc3-4d00-8e3b-91f37278cbda tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:20.464853 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-84a56b2f-5fc3-4d00-8e3b-91f37278cbda tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:20.506253 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6279be12-fe2a-40db-b92a-23611a566c8c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:56:20.514870 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6279be12-fe2a-40db-b92a-23611a566c8c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1361 microversion: 2.1 time: 0.105527 Oct 23 01:56:20.515613 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3520/6939] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:20 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1361 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:56:20.614805 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-84a56b2f-5fc3-4d00-8e3b-91f37278cbda tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949b4b3b7b143158acb8aa6ee0a7da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530303744266461da10d50db53a0e409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:56:20.623181 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-84a56b2f-5fc3-4d00-8e3b-91f37278cbda tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] 10.222.0.42 "GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96" status: 200 len: 1280 microversion: 2.1 time: 0.174887 Oct 23 01:56:20.623766 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3420/6940] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:20 2022] GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96 => generated 1280 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:56:21.539037 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-32db65d9-758b-48b8-be30-02dd94372bc3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:21.539668 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-32db65d9-758b-48b8-be30-02dd94372bc3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:21.546629 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-32db65d9-758b-48b8-be30-02dd94372bc3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:21.547126 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-32db65d9-758b-48b8-be30-02dd94372bc3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:21.547570 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-32db65d9-758b-48b8-be30-02dd94372bc3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:21.548275 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-32db65d9-758b-48b8-be30-02dd94372bc3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:21.548736 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-32db65d9-758b-48b8-be30-02dd94372bc3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:21.549169 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-32db65d9-758b-48b8-be30-02dd94372bc3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:21.625748 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-32db65d9-758b-48b8-be30-02dd94372bc3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:56:21.635935 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-32db65d9-758b-48b8-be30-02dd94372bc3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1361 microversion: 2.1 time: 0.101412 Oct 23 01:56:21.636546 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3521/6941] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:21 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1361 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:56:21.652545 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7b84f908-20f4-4121-8689-27cf9dd66c4d tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:21.658960 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7b84f908-20f4-4121-8689-27cf9dd66c4d tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] [instance: 72a32ad2-2150-4cdf-9dbd-987ba14d5f96] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:21.660902 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b84f908-20f4-4121-8689-27cf9dd66c4d tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:21.661408 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b84f908-20f4-4121-8689-27cf9dd66c4d tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:21.662030 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b84f908-20f4-4121-8689-27cf9dd66c4d tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:21.662901 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b84f908-20f4-4121-8689-27cf9dd66c4d tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:21.663401 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b84f908-20f4-4121-8689-27cf9dd66c4d tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:21.663843 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b84f908-20f4-4121-8689-27cf9dd66c4d tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:21.668061 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:56:21.860474 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7b84f908-20f4-4121-8689-27cf9dd66c4d tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949b4b3b7b143158acb8aa6ee0a7da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530303744266461da10d50db53a0e409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:56:21.899427 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7b84f908-20f4-4121-8689-27cf9dd66c4d tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] 10.222.0.42 "GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96" status: 200 len: 1280 microversion: 2.1 time: 0.244050 Oct 23 01:56:21.899427 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3421/6942] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:21 2022] GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96 => generated 1280 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:56:22.660256 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-46a2bc90-9396-48c3-a829-c50c6ad53a54 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:22.664571 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-46a2bc90-9396-48c3-a829-c50c6ad53a54 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:22.669764 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46a2bc90-9396-48c3-a829-c50c6ad53a54 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:22.670325 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46a2bc90-9396-48c3-a829-c50c6ad53a54 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:22.670861 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46a2bc90-9396-48c3-a829-c50c6ad53a54 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:22.671642 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46a2bc90-9396-48c3-a829-c50c6ad53a54 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:22.672178 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46a2bc90-9396-48c3-a829-c50c6ad53a54 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:22.672679 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46a2bc90-9396-48c3-a829-c50c6ad53a54 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:22.728047 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46a2bc90-9396-48c3-a829-c50c6ad53a54 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:22.728557 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46a2bc90-9396-48c3-a829-c50c6ad53a54 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:22.729008 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46a2bc90-9396-48c3-a829-c50c6ad53a54 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:22.729462 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-46a2bc90-9396-48c3-a829-c50c6ad53a54 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lazy-loading 'fault' on Instance uuid 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:56:22.775537 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-46a2bc90-9396-48c3-a829-c50c6ad53a54 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:56:22.784223 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-46a2bc90-9396-48c3-a829-c50c6ad53a54 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 200 len: 1366 microversion: 2.1 time: 0.128472 Oct 23 01:56:22.784876 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3522/6943] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:22 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 1366 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:56:22.920603 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9e8f2e6f-08f2-40d6-9332-b35b01c4fa9b tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:22.921834 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9e8f2e6f-08f2-40d6-9332-b35b01c4fa9b tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] [instance: 72a32ad2-2150-4cdf-9dbd-987ba14d5f96] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:22.930295 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e8f2e6f-08f2-40d6-9332-b35b01c4fa9b tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:22.930806 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e8f2e6f-08f2-40d6-9332-b35b01c4fa9b tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:22.931255 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e8f2e6f-08f2-40d6-9332-b35b01c4fa9b tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:22.931974 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e8f2e6f-08f2-40d6-9332-b35b01c4fa9b tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:22.932438 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e8f2e6f-08f2-40d6-9332-b35b01c4fa9b tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:22.933062 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e8f2e6f-08f2-40d6-9332-b35b01c4fa9b tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:23.079240 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9e8f2e6f-08f2-40d6-9332-b35b01c4fa9b tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949b4b3b7b143158acb8aa6ee0a7da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530303744266461da10d50db53a0e409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:56:23.086977 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9e8f2e6f-08f2-40d6-9332-b35b01c4fa9b tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] 10.222.0.42 "GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96" status: 200 len: 1268 microversion: 2.1 time: 0.170636 Oct 23 01:56:23.087577 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3422/6944] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:22 2022] GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96 => generated 1268 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:56:23.808755 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-451782c1-f27d-4636-a253-c0f2f503cd87 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:23.810119 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-451782c1-f27d-4636-a253-c0f2f503cd87 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:23.817699 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-451782c1-f27d-4636-a253-c0f2f503cd87 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:23.818218 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-451782c1-f27d-4636-a253-c0f2f503cd87 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:23.818692 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-451782c1-f27d-4636-a253-c0f2f503cd87 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:23.820088 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-451782c1-f27d-4636-a253-c0f2f503cd87 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:23.820570 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-451782c1-f27d-4636-a253-c0f2f503cd87 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:23.821009 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-451782c1-f27d-4636-a253-c0f2f503cd87 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:23.836179 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-451782c1-f27d-4636-a253-c0f2f503cd87 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] HTTP exception thrown: Instance 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 could not be found. Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-451782c1-f27d-4636-a253-c0f2f503cd87 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Request method failure captured: Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 HTTP/1.1 Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJ238gvy9Iqj-gh_hYMMA3k82GIwOXmge1ZpdCVbStgEi7Wx0Hp0nUD39OZgeTVVZUzzMU6rbj6VKVMThBnKMFJkrT_c4TpJItwEaxJM150Q197EeZTFOgQpHEVnJj9TzM6T9aiiAWqKRliV_RYi1MvsQfVRPMVtUboRY7WK1bO1DBQ Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: b1ec0b5ecaa741eaaf40a50f1415e7f9 Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-TestVolumeBootPattern-219047212 Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}] Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-TestVolumeBootPattern-219047212 Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: b1ec0b5ecaa741eaaf40a50f1415e7f9 Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-TestVolumeBootPattern-219047212 Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-TestVolumeBootPattern-219047212-project Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: f2967d0d8c134d269c9bbe51c90f803a Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-TestVolumeBootPattern-219047212-project Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 could not be found. Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2'} Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 could not be found. Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 could not be found. Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:56:23.837864 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:56:23.842159 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:56:23.842159 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:56:23.842159 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:56:23.842159 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:56:23.842159 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:56:23.842159 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 could not be found. Oct 23 01:56:23.842159 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:56:23.842159 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-451782c1-f27d-4636-a253-c0f2f503cd87 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Returning 404 to user: Instance 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:56:23.842159 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-451782c1-f27d-4636-a253-c0f2f503cd87 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 404 len: 111 microversion: 2.1 time: 0.034578 Oct 23 01:56:23.843088 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3523/6945] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:23 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:56:24.114829 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ee89e0d9-7d9a-411f-bbd3-9b6c6cad7732 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:24.115592 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ee89e0d9-7d9a-411f-bbd3-9b6c6cad7732 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] [instance: 72a32ad2-2150-4cdf-9dbd-987ba14d5f96] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:24.129927 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee89e0d9-7d9a-411f-bbd3-9b6c6cad7732 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:24.130488 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee89e0d9-7d9a-411f-bbd3-9b6c6cad7732 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:24.130949 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee89e0d9-7d9a-411f-bbd3-9b6c6cad7732 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:24.131675 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee89e0d9-7d9a-411f-bbd3-9b6c6cad7732 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:24.132142 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee89e0d9-7d9a-411f-bbd3-9b6c6cad7732 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:24.132801 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee89e0d9-7d9a-411f-bbd3-9b6c6cad7732 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:24.294089 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ee89e0d9-7d9a-411f-bbd3-9b6c6cad7732 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949b4b3b7b143158acb8aa6ee0a7da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530303744266461da10d50db53a0e409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:56:24.303306 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ee89e0d9-7d9a-411f-bbd3-9b6c6cad7732 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] 10.222.0.42 "GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96" status: 200 len: 1268 microversion: 2.1 time: 0.195383 Oct 23 01:56:24.303881 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3423/6946] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:24 2022] GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96 => generated 1268 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:56:25.329870 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d7cb0099-ee49-4ac4-b6f9-3de76241da1c tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:25.331097 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d7cb0099-ee49-4ac4-b6f9-3de76241da1c tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] [instance: 72a32ad2-2150-4cdf-9dbd-987ba14d5f96] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:25.339556 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d7cb0099-ee49-4ac4-b6f9-3de76241da1c tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:25.345560 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d7cb0099-ee49-4ac4-b6f9-3de76241da1c tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:25.345560 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d7cb0099-ee49-4ac4-b6f9-3de76241da1c tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:25.345560 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d7cb0099-ee49-4ac4-b6f9-3de76241da1c tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:25.345560 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d7cb0099-ee49-4ac4-b6f9-3de76241da1c tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:25.345560 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d7cb0099-ee49-4ac4-b6f9-3de76241da1c tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:25.522412 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d7cb0099-ee49-4ac4-b6f9-3de76241da1c tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949b4b3b7b143158acb8aa6ee0a7da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530303744266461da10d50db53a0e409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:56:25.531399 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d7cb0099-ee49-4ac4-b6f9-3de76241da1c tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] 10.222.0.42 "GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96" status: 200 len: 1268 microversion: 2.1 time: 0.208428 Oct 23 01:56:25.531973 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3524/6947] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:25 2022] GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96 => generated 1268 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:56:26.555018 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-349402fa-8f8f-4e0d-af87-1cc0b6bbbb6a tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:26.555668 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-349402fa-8f8f-4e0d-af87-1cc0b6bbbb6a tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] [instance: 72a32ad2-2150-4cdf-9dbd-987ba14d5f96] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:26.564448 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-349402fa-8f8f-4e0d-af87-1cc0b6bbbb6a tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:26.565207 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-349402fa-8f8f-4e0d-af87-1cc0b6bbbb6a tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:26.566455 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-349402fa-8f8f-4e0d-af87-1cc0b6bbbb6a tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:26.567372 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-349402fa-8f8f-4e0d-af87-1cc0b6bbbb6a tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:26.568059 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-349402fa-8f8f-4e0d-af87-1cc0b6bbbb6a tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:26.568647 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-349402fa-8f8f-4e0d-af87-1cc0b6bbbb6a tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:26.754956 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-349402fa-8f8f-4e0d-af87-1cc0b6bbbb6a tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949b4b3b7b143158acb8aa6ee0a7da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530303744266461da10d50db53a0e409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:56:26.763938 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-349402fa-8f8f-4e0d-af87-1cc0b6bbbb6a tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] 10.222.0.42 "GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96" status: 200 len: 1268 microversion: 2.1 time: 0.212760 Oct 23 01:56:26.765063 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3424/6948] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:26 2022] GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96 => generated 1268 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:56:27.790499 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-68e87a38-48de-49d5-9607-1eb24c7caf67 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:27.791796 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-68e87a38-48de-49d5-9607-1eb24c7caf67 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] [instance: 72a32ad2-2150-4cdf-9dbd-987ba14d5f96] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:27.799740 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=56 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:56:27.802080 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68e87a38-48de-49d5-9607-1eb24c7caf67 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:27.802868 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68e87a38-48de-49d5-9607-1eb24c7caf67 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:27.803587 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68e87a38-48de-49d5-9607-1eb24c7caf67 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:27.804537 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68e87a38-48de-49d5-9607-1eb24c7caf67 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:27.805210 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68e87a38-48de-49d5-9607-1eb24c7caf67 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:27.805960 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68e87a38-48de-49d5-9607-1eb24c7caf67 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:27.970104 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-68e87a38-48de-49d5-9607-1eb24c7caf67 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949b4b3b7b143158acb8aa6ee0a7da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530303744266461da10d50db53a0e409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:56:27.980614 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-68e87a38-48de-49d5-9607-1eb24c7caf67 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] 10.222.0.42 "GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96" status: 200 len: 1268 microversion: 2.1 time: 0.196282 Oct 23 01:56:27.982159 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3525/6949] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:27 2022] GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96 => generated 1268 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:56:29.005624 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-dd5fabdc-3edd-47c2-9f04-961fdb08c56d tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:29.006291 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-dd5fabdc-3edd-47c2-9f04-961fdb08c56d tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] [instance: 72a32ad2-2150-4cdf-9dbd-987ba14d5f96] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:29.009100 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:56:29.013836 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dd5fabdc-3edd-47c2-9f04-961fdb08c56d tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:29.014365 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dd5fabdc-3edd-47c2-9f04-961fdb08c56d tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:29.014813 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dd5fabdc-3edd-47c2-9f04-961fdb08c56d tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:29.015515 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dd5fabdc-3edd-47c2-9f04-961fdb08c56d tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:29.015980 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dd5fabdc-3edd-47c2-9f04-961fdb08c56d tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:29.016416 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dd5fabdc-3edd-47c2-9f04-961fdb08c56d tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:29.166610 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-dd5fabdc-3edd-47c2-9f04-961fdb08c56d tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949b4b3b7b143158acb8aa6ee0a7da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530303744266461da10d50db53a0e409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:56:29.177694 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-dd5fabdc-3edd-47c2-9f04-961fdb08c56d tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] 10.222.0.42 "GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96" status: 200 len: 1268 microversion: 2.1 time: 0.176079 Oct 23 01:56:29.178653 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3425/6950] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:29 2022] GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96 => generated 1268 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:56:29.270388 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9f36cc7b-6cbf-47c4-85d9-9abd78ad8029 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:29.270930 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9f36cc7b-6cbf-47c4-85d9-9abd78ad8029 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: e54edefe-ab1a-4f08-ae7a-f29dbd10a93c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:29.278454 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f36cc7b-6cbf-47c4-85d9-9abd78ad8029 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:29.278992 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f36cc7b-6cbf-47c4-85d9-9abd78ad8029 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:29.279444 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f36cc7b-6cbf-47c4-85d9-9abd78ad8029 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:29.280154 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f36cc7b-6cbf-47c4-85d9-9abd78ad8029 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:29.280782 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f36cc7b-6cbf-47c4-85d9-9abd78ad8029 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:29.281223 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f36cc7b-6cbf-47c4-85d9-9abd78ad8029 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:29.310867 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9f36cc7b-6cbf-47c4-85d9-9abd78ad8029 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: e54edefe-ab1a-4f08-ae7a-f29dbd10a93c] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:56:29.603872 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9f36cc7b-6cbf-47c4-85d9-9abd78ad8029 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c" status: 204 len: 0 microversion: 2.1 time: 0.337854 Oct 23 01:56:29.604398 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3526/6951] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:56:29 2022] DELETE /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:56:29.612681 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8af64926-4766-4deb-b633-392c67985caa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:29.613397 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8af64926-4766-4deb-b633-392c67985caa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: e54edefe-ab1a-4f08-ae7a-f29dbd10a93c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:29.620440 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8af64926-4766-4deb-b633-392c67985caa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:29.620997 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8af64926-4766-4deb-b633-392c67985caa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:29.621515 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8af64926-4766-4deb-b633-392c67985caa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:29.622334 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8af64926-4766-4deb-b633-392c67985caa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:29.622869 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8af64926-4766-4deb-b633-392c67985caa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:29.623373 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8af64926-4766-4deb-b633-392c67985caa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:29.770699 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8af64926-4766-4deb-b633-392c67985caa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:56:29.779733 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8af64926-4766-4deb-b633-392c67985caa tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c" status: 200 len: 1411 microversion: 2.1 time: 0.171054 Oct 23 01:56:29.780459 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3426/6952] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:29 2022] GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c => generated 1411 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:56:30.205056 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-08bd5cd8-24f3-4815-9970-323de429d866 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:30.205790 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-08bd5cd8-24f3-4815-9970-323de429d866 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] [instance: 72a32ad2-2150-4cdf-9dbd-987ba14d5f96] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:30.214753 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-08bd5cd8-24f3-4815-9970-323de429d866 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:30.215260 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-08bd5cd8-24f3-4815-9970-323de429d866 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:30.217851 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-08bd5cd8-24f3-4815-9970-323de429d866 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:30.217851 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-08bd5cd8-24f3-4815-9970-323de429d866 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:30.217851 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-08bd5cd8-24f3-4815-9970-323de429d866 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:30.217851 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-08bd5cd8-24f3-4815-9970-323de429d866 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:30.407304 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-08bd5cd8-24f3-4815-9970-323de429d866 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949b4b3b7b143158acb8aa6ee0a7da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530303744266461da10d50db53a0e409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:56:30.416626 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-08bd5cd8-24f3-4815-9970-323de429d866 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] 10.222.0.42 "GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96" status: 200 len: 1268 microversion: 2.1 time: 0.217930 Oct 23 01:56:30.417227 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3527/6953] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:30 2022] GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96 => generated 1268 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:56:30.803174 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-95af430a-9ef3-49ae-8d9f-d244e4598699 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:30.803813 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-95af430a-9ef3-49ae-8d9f-d244e4598699 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: e54edefe-ab1a-4f08-ae7a-f29dbd10a93c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:30.811022 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-95af430a-9ef3-49ae-8d9f-d244e4598699 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:30.811535 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-95af430a-9ef3-49ae-8d9f-d244e4598699 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:30.812055 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-95af430a-9ef3-49ae-8d9f-d244e4598699 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:30.812776 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-95af430a-9ef3-49ae-8d9f-d244e4598699 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:30.813251 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-95af430a-9ef3-49ae-8d9f-d244e4598699 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:30.813700 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-95af430a-9ef3-49ae-8d9f-d244e4598699 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:30.954321 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-95af430a-9ef3-49ae-8d9f-d244e4598699 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:56:30.963133 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-95af430a-9ef3-49ae-8d9f-d244e4598699 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c" status: 200 len: 1411 microversion: 2.1 time: 0.163903 Oct 23 01:56:30.963735 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3427/6954] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:30 2022] GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c => generated 1411 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:56:31.444294 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e543428c-4c32-482a-8877-9545859112d5 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:31.444827 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e543428c-4c32-482a-8877-9545859112d5 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] [instance: 72a32ad2-2150-4cdf-9dbd-987ba14d5f96] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:31.453616 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e543428c-4c32-482a-8877-9545859112d5 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:31.454129 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e543428c-4c32-482a-8877-9545859112d5 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:31.454786 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e543428c-4c32-482a-8877-9545859112d5 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:31.455500 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e543428c-4c32-482a-8877-9545859112d5 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:31.455960 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e543428c-4c32-482a-8877-9545859112d5 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:31.456386 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e543428c-4c32-482a-8877-9545859112d5 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:31.603532 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e543428c-4c32-482a-8877-9545859112d5 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949b4b3b7b143158acb8aa6ee0a7da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530303744266461da10d50db53a0e409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:56:31.611797 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e543428c-4c32-482a-8877-9545859112d5 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] 10.222.0.42 "GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96" status: 200 len: 1268 microversion: 2.1 time: 0.171807 Oct 23 01:56:31.612547 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3528/6955] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:31 2022] GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96 => generated 1268 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:56:31.987269 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3caf331b-ce7b-4d04-aa3e-e8d1128a0705 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:31.989744 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3caf331b-ce7b-4d04-aa3e-e8d1128a0705 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: e54edefe-ab1a-4f08-ae7a-f29dbd10a93c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:32.005347 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3caf331b-ce7b-4d04-aa3e-e8d1128a0705 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:32.007462 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3caf331b-ce7b-4d04-aa3e-e8d1128a0705 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:32.008105 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3caf331b-ce7b-4d04-aa3e-e8d1128a0705 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:32.009052 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3caf331b-ce7b-4d04-aa3e-e8d1128a0705 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:32.016136 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3caf331b-ce7b-4d04-aa3e-e8d1128a0705 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:32.019407 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3caf331b-ce7b-4d04-aa3e-e8d1128a0705 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:32.212573 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3caf331b-ce7b-4d04-aa3e-e8d1128a0705 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:56:32.220767 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3caf331b-ce7b-4d04-aa3e-e8d1128a0705 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c" status: 200 len: 1411 microversion: 2.1 time: 0.237360 Oct 23 01:56:32.233346 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3428/6956] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:31 2022] GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c => generated 1411 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:56:32.238871 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-90e9848f-6875-4178-adc6-bf5fda3b6c1f req-ac7eecd9-0eb7-4d8e-a986-afd3b5a02e3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72a32ad2-2150-4cdf-9dbd-987ba14d5f96", "name": "network-vif-plugged", "status": "completed", "tag": "f2a6b2ca-5db4-47f5-9c02-52fc6cde4334"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:56:32.250110 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-90e9848f-6875-4178-adc6-bf5fda3b6c1f req-ac7eecd9-0eb7-4d8e-a986-afd3b5a02e3d service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:32.250800 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-90e9848f-6875-4178-adc6-bf5fda3b6c1f req-ac7eecd9-0eb7-4d8e-a986-afd3b5a02e3d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:32.251239 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-90e9848f-6875-4178-adc6-bf5fda3b6c1f req-ac7eecd9-0eb7-4d8e-a986-afd3b5a02e3d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:32.264282 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-90e9848f-6875-4178-adc6-bf5fda3b6c1f req-ac7eecd9-0eb7-4d8e-a986-afd3b5a02e3d service nova] Creating event network-vif-plugged:f2a6b2ca-5db4-47f5-9c02-52fc6cde4334 for instance 72a32ad2-2150-4cdf-9dbd-987ba14d5f96 on n-h2-master-1 Oct 23 01:56:32.272677 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-90e9848f-6875-4178-adc6-bf5fda3b6c1f req-ac7eecd9-0eb7-4d8e-a986-afd3b5a02e3d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038249 Oct 23 01:56:32.273800 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3529/6957] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:56:32.288029 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-1a53aed9-7df5-4147-a43e-64549ca099fb req-e74315b7-7a31-4253-b7c3-ff48c71fcfa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e54edefe-ab1a-4f08-ae7a-f29dbd10a93c", "name": "network-vif-deleted", "tag": "90bcac0d-7275-4bc2-8a49-2a92b4dc10f0"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:56:32.297809 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-1a53aed9-7df5-4147-a43e-64549ca099fb req-e74315b7-7a31-4253-b7c3-ff48c71fcfa7 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:32.300500 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-1a53aed9-7df5-4147-a43e-64549ca099fb req-e74315b7-7a31-4253-b7c3-ff48c71fcfa7 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:32.300957 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-1a53aed9-7df5-4147-a43e-64549ca099fb req-e74315b7-7a31-4253-b7c3-ff48c71fcfa7 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:32.313675 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-1a53aed9-7df5-4147-a43e-64549ca099fb req-e74315b7-7a31-4253-b7c3-ff48c71fcfa7 service nova] Creating event network-vif-deleted:90bcac0d-7275-4bc2-8a49-2a92b4dc10f0 for instance e54edefe-ab1a-4f08-ae7a-f29dbd10a93c on n-h2-master-1 Oct 23 01:56:32.334486 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-1a53aed9-7df5-4147-a43e-64549ca099fb req-e74315b7-7a31-4253-b7c3-ff48c71fcfa7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050793 Oct 23 01:56:32.335557 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3429/6958] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:56:32.635866 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c915ff2c-9560-4dc5-a8fd-640150973a61 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:32.637716 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c915ff2c-9560-4dc5-a8fd-640150973a61 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] [instance: 72a32ad2-2150-4cdf-9dbd-987ba14d5f96] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:32.644734 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c915ff2c-9560-4dc5-a8fd-640150973a61 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:32.645336 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c915ff2c-9560-4dc5-a8fd-640150973a61 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:32.645854 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c915ff2c-9560-4dc5-a8fd-640150973a61 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:32.646663 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c915ff2c-9560-4dc5-a8fd-640150973a61 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:32.647233 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c915ff2c-9560-4dc5-a8fd-640150973a61 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:32.647913 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c915ff2c-9560-4dc5-a8fd-640150973a61 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:32.819160 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c915ff2c-9560-4dc5-a8fd-640150973a61 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949b4b3b7b143158acb8aa6ee0a7da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530303744266461da10d50db53a0e409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:56:32.830354 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c915ff2c-9560-4dc5-a8fd-640150973a61 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] 10.222.0.42 "GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96" status: 200 len: 1268 microversion: 2.1 time: 0.198310 Oct 23 01:56:32.832202 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3530/6959] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:32 2022] GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96 => generated 1268 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:56:33.251342 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e562a4f6-583b-4d5a-903c-cf0b16734ad3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:33.252830 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e562a4f6-583b-4d5a-903c-cf0b16734ad3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: e54edefe-ab1a-4f08-ae7a-f29dbd10a93c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:33.259866 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e562a4f6-583b-4d5a-903c-cf0b16734ad3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:33.260823 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e562a4f6-583b-4d5a-903c-cf0b16734ad3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:33.267074 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e562a4f6-583b-4d5a-903c-cf0b16734ad3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:33.267074 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e562a4f6-583b-4d5a-903c-cf0b16734ad3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:33.267074 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e562a4f6-583b-4d5a-903c-cf0b16734ad3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:33.267074 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e562a4f6-583b-4d5a-903c-cf0b16734ad3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:33.332229 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e562a4f6-583b-4d5a-903c-cf0b16734ad3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:56:33.341320 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e562a4f6-583b-4d5a-903c-cf0b16734ad3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c" status: 200 len: 1202 microversion: 2.1 time: 0.095948 Oct 23 01:56:33.358075 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3430/6960] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:33 2022] GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c => generated 1202 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:56:33.855898 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-941748b7-42bf-4b93-9ed1-ac9c6b2cd62b tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:33.856527 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-941748b7-42bf-4b93-9ed1-ac9c6b2cd62b tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] [instance: 72a32ad2-2150-4cdf-9dbd-987ba14d5f96] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:33.870829 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-941748b7-42bf-4b93-9ed1-ac9c6b2cd62b tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:33.871770 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-941748b7-42bf-4b93-9ed1-ac9c6b2cd62b tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:33.873548 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-941748b7-42bf-4b93-9ed1-ac9c6b2cd62b tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:33.874417 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-941748b7-42bf-4b93-9ed1-ac9c6b2cd62b tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:33.876363 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-941748b7-42bf-4b93-9ed1-ac9c6b2cd62b tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:33.877226 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-941748b7-42bf-4b93-9ed1-ac9c6b2cd62b tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:34.071317 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-941748b7-42bf-4b93-9ed1-ac9c6b2cd62b tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949b4b3b7b143158acb8aa6ee0a7da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530303744266461da10d50db53a0e409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:56:34.080772 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-941748b7-42bf-4b93-9ed1-ac9c6b2cd62b tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] 10.222.0.42 "GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96" status: 200 len: 1268 microversion: 2.1 time: 0.228671 Oct 23 01:56:34.082117 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3531/6961] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:33 2022] GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96 => generated 1268 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:56:34.364843 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a654ae29-eda9-4088-8ab0-1ee4f46d8a4c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:34.365456 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a654ae29-eda9-4088-8ab0-1ee4f46d8a4c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: e54edefe-ab1a-4f08-ae7a-f29dbd10a93c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:34.372659 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a654ae29-eda9-4088-8ab0-1ee4f46d8a4c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:34.373257 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a654ae29-eda9-4088-8ab0-1ee4f46d8a4c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:34.373717 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a654ae29-eda9-4088-8ab0-1ee4f46d8a4c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:34.374509 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a654ae29-eda9-4088-8ab0-1ee4f46d8a4c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:34.374988 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a654ae29-eda9-4088-8ab0-1ee4f46d8a4c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:34.375429 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a654ae29-eda9-4088-8ab0-1ee4f46d8a4c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:34.442910 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a654ae29-eda9-4088-8ab0-1ee4f46d8a4c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:56:34.452187 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a654ae29-eda9-4088-8ab0-1ee4f46d8a4c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c" status: 200 len: 1202 microversion: 2.1 time: 0.091344 Oct 23 01:56:34.453096 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3431/6962] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:34 2022] GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c => generated 1202 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:56:35.105628 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b459ee6d-589c-4013-875d-8ac0cd17ace7 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:35.107798 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b459ee6d-589c-4013-875d-8ac0cd17ace7 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] [instance: 72a32ad2-2150-4cdf-9dbd-987ba14d5f96] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:35.115383 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b459ee6d-589c-4013-875d-8ac0cd17ace7 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:35.115881 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b459ee6d-589c-4013-875d-8ac0cd17ace7 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:35.116352 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b459ee6d-589c-4013-875d-8ac0cd17ace7 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:35.117090 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b459ee6d-589c-4013-875d-8ac0cd17ace7 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:35.117555 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b459ee6d-589c-4013-875d-8ac0cd17ace7 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:35.118028 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b459ee6d-589c-4013-875d-8ac0cd17ace7 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:35.285779 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b459ee6d-589c-4013-875d-8ac0cd17ace7 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949b4b3b7b143158acb8aa6ee0a7da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530303744266461da10d50db53a0e409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:56:35.294188 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b459ee6d-589c-4013-875d-8ac0cd17ace7 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] 10.222.0.42 "GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96" status: 200 len: 1458 microversion: 2.1 time: 0.192686 Oct 23 01:56:35.300653 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3532/6963] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:35 2022] GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96 => generated 1458 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:56:35.317926 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a8d88dd3-a5d4-4d73-8c9d-25bff529c6ba tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:35.318861 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a8d88dd3-a5d4-4d73-8c9d-25bff529c6ba tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] [instance: 72a32ad2-2150-4cdf-9dbd-987ba14d5f96] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:35.333285 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a8d88dd3-a5d4-4d73-8c9d-25bff529c6ba tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:35.333808 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a8d88dd3-a5d4-4d73-8c9d-25bff529c6ba tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:35.334306 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a8d88dd3-a5d4-4d73-8c9d-25bff529c6ba tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:35.335048 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a8d88dd3-a5d4-4d73-8c9d-25bff529c6ba tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:35.335523 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a8d88dd3-a5d4-4d73-8c9d-25bff529c6ba tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:35.335970 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a8d88dd3-a5d4-4d73-8c9d-25bff529c6ba tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:35.476242 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7026379a-2727-47cf-8b7f-360ebaeb3090 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:35.477260 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7026379a-2727-47cf-8b7f-360ebaeb3090 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: e54edefe-ab1a-4f08-ae7a-f29dbd10a93c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:35.486664 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7026379a-2727-47cf-8b7f-360ebaeb3090 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:35.487995 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7026379a-2727-47cf-8b7f-360ebaeb3090 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:35.488646 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7026379a-2727-47cf-8b7f-360ebaeb3090 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:35.489646 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7026379a-2727-47cf-8b7f-360ebaeb3090 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:35.490405 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7026379a-2727-47cf-8b7f-360ebaeb3090 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:35.491232 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7026379a-2727-47cf-8b7f-360ebaeb3090 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:35.511096 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a8d88dd3-a5d4-4d73-8c9d-25bff529c6ba tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949b4b3b7b143158acb8aa6ee0a7da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530303744266461da10d50db53a0e409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:56:35.519359 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a8d88dd3-a5d4-4d73-8c9d-25bff529c6ba tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] 10.222.0.42 "GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96" status: 200 len: 1458 microversion: 2.1 time: 0.206012 Oct 23 01:56:35.520460 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3432/6964] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:35 2022] GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96 => generated 1458 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:56:35.568492 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7026379a-2727-47cf-8b7f-360ebaeb3090 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:56:35.576888 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7026379a-2727-47cf-8b7f-360ebaeb3090 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c" status: 200 len: 1202 microversion: 2.1 time: 0.104542 Oct 23 01:56:35.577544 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3533/6965] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:35 2022] GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c => generated 1202 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:56:36.600995 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7ac6bf51-b8cf-4bcd-83e8-f2ab36027e04 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:36.602700 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7ac6bf51-b8cf-4bcd-83e8-f2ab36027e04 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: e54edefe-ab1a-4f08-ae7a-f29dbd10a93c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:36.614172 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7ac6bf51-b8cf-4bcd-83e8-f2ab36027e04 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:36.615173 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7ac6bf51-b8cf-4bcd-83e8-f2ab36027e04 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:36.616423 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7ac6bf51-b8cf-4bcd-83e8-f2ab36027e04 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:36.617388 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7ac6bf51-b8cf-4bcd-83e8-f2ab36027e04 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:36.618610 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7ac6bf51-b8cf-4bcd-83e8-f2ab36027e04 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:36.619082 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7ac6bf51-b8cf-4bcd-83e8-f2ab36027e04 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:36.728573 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7ac6bf51-b8cf-4bcd-83e8-f2ab36027e04 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:56:36.760695 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7ac6bf51-b8cf-4bcd-83e8-f2ab36027e04 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c" status: 200 len: 1202 microversion: 2.1 time: 0.164588 Oct 23 01:56:36.761176 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3433/6966] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:36 2022] GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c => generated 1202 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:56:37.797584 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-45ecc4d6-b220-470c-94d3-d2e1cfdee5c8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:37.798247 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-45ecc4d6-b220-470c-94d3-d2e1cfdee5c8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: e54edefe-ab1a-4f08-ae7a-f29dbd10a93c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:37.820538 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-45ecc4d6-b220-470c-94d3-d2e1cfdee5c8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:37.822580 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-45ecc4d6-b220-470c-94d3-d2e1cfdee5c8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:37.823042 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-45ecc4d6-b220-470c-94d3-d2e1cfdee5c8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:37.826399 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-45ecc4d6-b220-470c-94d3-d2e1cfdee5c8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:37.829777 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-45ecc4d6-b220-470c-94d3-d2e1cfdee5c8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:37.830346 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-45ecc4d6-b220-470c-94d3-d2e1cfdee5c8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:37.920582 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-45ecc4d6-b220-470c-94d3-d2e1cfdee5c8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:37.924068 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-45ecc4d6-b220-470c-94d3-d2e1cfdee5c8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:37.925538 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-45ecc4d6-b220-470c-94d3-d2e1cfdee5c8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:37.926204 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-45ecc4d6-b220-470c-94d3-d2e1cfdee5c8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lazy-loading 'fault' on Instance uuid e54edefe-ab1a-4f08-ae7a-f29dbd10a93c {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 01:56:38.009395 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-45ecc4d6-b220-470c-94d3-d2e1cfdee5c8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:56:38.038911 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-45ecc4d6-b220-470c-94d3-d2e1cfdee5c8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c" status: 200 len: 1207 microversion: 2.1 time: 0.245486 Oct 23 01:56:38.066756 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3534/6967] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:37 2022] GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c => generated 1207 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:56:38.790079 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-b2b03724-4bc5-4aa5-8feb-ac496e7cb2ff req-6883181c-7eed-43f5-84cd-ee96bc45fe7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72a32ad2-2150-4cdf-9dbd-987ba14d5f96", "tag": "f2a6b2ca-5db4-47f5-9c02-52fc6cde4334"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:56:38.805823 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-b2b03724-4bc5-4aa5-8feb-ac496e7cb2ff req-6883181c-7eed-43f5-84cd-ee96bc45fe7f service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:38.806361 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-b2b03724-4bc5-4aa5-8feb-ac496e7cb2ff req-6883181c-7eed-43f5-84cd-ee96bc45fe7f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:38.807020 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-b2b03724-4bc5-4aa5-8feb-ac496e7cb2ff req-6883181c-7eed-43f5-84cd-ee96bc45fe7f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:38.819657 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-b2b03724-4bc5-4aa5-8feb-ac496e7cb2ff req-6883181c-7eed-43f5-84cd-ee96bc45fe7f service nova] Creating event network-changed:f2a6b2ca-5db4-47f5-9c02-52fc6cde4334 for instance 72a32ad2-2150-4cdf-9dbd-987ba14d5f96 on n-h2-master-1 Oct 23 01:56:38.827905 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-b2b03724-4bc5-4aa5-8feb-ac496e7cb2ff req-6883181c-7eed-43f5-84cd-ee96bc45fe7f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.221051 Oct 23 01:56:38.828537 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3434/6968] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:56:39.078127 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-25ca2bd9-7582-4bbc-acda-81483fa9a032 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:39.082984 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-25ca2bd9-7582-4bbc-acda-81483fa9a032 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: e54edefe-ab1a-4f08-ae7a-f29dbd10a93c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:39.101561 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25ca2bd9-7582-4bbc-acda-81483fa9a032 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:39.103613 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25ca2bd9-7582-4bbc-acda-81483fa9a032 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:39.105067 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25ca2bd9-7582-4bbc-acda-81483fa9a032 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:39.106984 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25ca2bd9-7582-4bbc-acda-81483fa9a032 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:39.107689 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25ca2bd9-7582-4bbc-acda-81483fa9a032 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:39.110679 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25ca2bd9-7582-4bbc-acda-81483fa9a032 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:39.118340 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:56:39.161205 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-25ca2bd9-7582-4bbc-acda-81483fa9a032 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] HTTP exception thrown: Instance e54edefe-ab1a-4f08-ae7a-f29dbd10a93c could not be found. Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-25ca2bd9-7582-4bbc-acda-81483fa9a032 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Request method failure captured: Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c HTTP/1.1 Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJ238gvy9Iqj-gh_hYMMA3k82GIwOXmge1ZpdCVbStgEi7Wx0Hp0nUD39OZgeTVVZUzzMU6rbj6VKVMThBnKMFJkrT_c4TpJItwEaxJM150Q197EeZTFOgQpHEVnJj9TzM6T9aiiAWqKRliV_RYi1MvsQfVRPMVtUboRY7WK1bO1DBQ Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: b1ec0b5ecaa741eaaf40a50f1415e7f9 Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-TestVolumeBootPattern-219047212 Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}] Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-TestVolumeBootPattern-219047212 Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: b1ec0b5ecaa741eaaf40a50f1415e7f9 Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-TestVolumeBootPattern-219047212 Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-TestVolumeBootPattern-219047212-project Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: f2967d0d8c134d269c9bbe51c90f803a Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-TestVolumeBootPattern-219047212-project Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: exception: Instance e54edefe-ab1a-4f08-ae7a-f29dbd10a93c could not be found. Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'e54edefe-ab1a-4f08-ae7a-f29dbd10a93c'} Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e54edefe-ab1a-4f08-ae7a-f29dbd10a93c could not be found. Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e54edefe-ab1a-4f08-ae7a-f29dbd10a93c could not be found. Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:56:39.167305 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:56:39.171379 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:56:39.171379 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:56:39.171379 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:56:39.171379 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:56:39.171379 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:56:39.171379 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e54edefe-ab1a-4f08-ae7a-f29dbd10a93c could not be found. Oct 23 01:56:39.171379 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:56:39.176272 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-25ca2bd9-7582-4bbc-acda-81483fa9a032 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Returning 404 to user: Instance e54edefe-ab1a-4f08-ae7a-f29dbd10a93c could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:56:39.181716 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-25ca2bd9-7582-4bbc-acda-81483fa9a032 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c" status: 404 len: 111 microversion: 2.1 time: 0.107935 Oct 23 01:56:39.185604 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3535/6969] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:39 2022] GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:56:40.927574 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-5966c65f-24e9-4242-b7e7-d39ead2a671a req-97d78e96-afcb-406b-9efe-46c13edae89c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72a32ad2-2150-4cdf-9dbd-987ba14d5f96", "tag": "f2a6b2ca-5db4-47f5-9c02-52fc6cde4334"}, {"name": "network-changed", "server_uuid": "72a32ad2-2150-4cdf-9dbd-987ba14d5f96", "tag": "f2a6b2ca-5db4-47f5-9c02-52fc6cde4334"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:56:40.951905 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-5966c65f-24e9-4242-b7e7-d39ead2a671a req-97d78e96-afcb-406b-9efe-46c13edae89c service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:40.952651 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-5966c65f-24e9-4242-b7e7-d39ead2a671a req-97d78e96-afcb-406b-9efe-46c13edae89c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:40.953586 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-5966c65f-24e9-4242-b7e7-d39ead2a671a req-97d78e96-afcb-406b-9efe-46c13edae89c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:40.971398 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-5966c65f-24e9-4242-b7e7-d39ead2a671a req-97d78e96-afcb-406b-9efe-46c13edae89c service nova] Creating event network-changed:f2a6b2ca-5db4-47f5-9c02-52fc6cde4334 for instance 72a32ad2-2150-4cdf-9dbd-987ba14d5f96 on n-h2-master-1 Oct 23 01:56:40.972650 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-5966c65f-24e9-4242-b7e7-d39ead2a671a req-97d78e96-afcb-406b-9efe-46c13edae89c service nova] Creating event network-changed:f2a6b2ca-5db4-47f5-9c02-52fc6cde4334 for instance 72a32ad2-2150-4cdf-9dbd-987ba14d5f96 on n-h2-master-1 Oct 23 01:56:41.003487 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-5966c65f-24e9-4242-b7e7-d39ead2a671a req-97d78e96-afcb-406b-9efe-46c13edae89c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.069010 Oct 23 01:56:41.004159 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3435/6970] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:56:42.617275 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-70d03c51-90b2-455d-be93-bc64c68da31e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:42.617808 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-70d03c51-90b2-455d-be93-bc64c68da31e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:42.628685 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-70d03c51-90b2-455d-be93-bc64c68da31e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:42.629186 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-70d03c51-90b2-455d-be93-bc64c68da31e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:42.629634 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-70d03c51-90b2-455d-be93-bc64c68da31e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:42.630471 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-70d03c51-90b2-455d-be93-bc64c68da31e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:42.631028 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-70d03c51-90b2-455d-be93-bc64c68da31e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:42.631471 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-70d03c51-90b2-455d-be93-bc64c68da31e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:42.651349 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-70d03c51-90b2-455d-be93-bc64c68da31e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] HTTP exception thrown: Instance 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 could not be found. Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-70d03c51-90b2-455d-be93-bc64c68da31e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Request method failure captured: Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 HTTP/1.1 Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJ238gvy9Iqj-gh_hYMMA3k82GIwOXmge1ZpdCVbStgEi7Wx0Hp0nUD39OZgeTVVZUzzMU6rbj6VKVMThBnKMFJkrT_c4TpJItwEaxJM150Q197EeZTFOgQpHEVnJj9TzM6T9aiiAWqKRliV_RYi1MvsQfVRPMVtUboRY7WK1bO1DBQ Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: b1ec0b5ecaa741eaaf40a50f1415e7f9 Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-TestVolumeBootPattern-219047212 Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}] Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-TestVolumeBootPattern-219047212 Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: b1ec0b5ecaa741eaaf40a50f1415e7f9 Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-TestVolumeBootPattern-219047212 Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-TestVolumeBootPattern-219047212-project Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: f2967d0d8c134d269c9bbe51c90f803a Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-TestVolumeBootPattern-219047212-project Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 could not be found. Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2'} Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 could not be found. Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:56:42.653524 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:56:42.656732 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 could not be found. Oct 23 01:56:42.656732 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:56:42.656732 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:56:42.656732 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:56:42.656732 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:56:42.656732 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:56:42.656732 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:56:42.656732 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:56:42.656732 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:56:42.656732 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 could not be found. Oct 23 01:56:42.656732 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:56:42.662295 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-70d03c51-90b2-455d-be93-bc64c68da31e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Returning 404 to user: Instance 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:56:42.662295 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-70d03c51-90b2-455d-be93-bc64c68da31e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "DELETE /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 404 len: 111 microversion: 2.1 time: 0.050159 Oct 23 01:56:42.670281 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3536/6971] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:56:42 2022] DELETE /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:56:42.673201 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0abfa713-ce79-4e88-9239-e9b0696d8413 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:42.674061 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0abfa713-ce79-4e88-9239-e9b0696d8413 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:42.680530 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0abfa713-ce79-4e88-9239-e9b0696d8413 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:42.681112 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0abfa713-ce79-4e88-9239-e9b0696d8413 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:42.681766 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0abfa713-ce79-4e88-9239-e9b0696d8413 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:42.682542 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0abfa713-ce79-4e88-9239-e9b0696d8413 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:42.683175 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0abfa713-ce79-4e88-9239-e9b0696d8413 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:42.685353 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0abfa713-ce79-4e88-9239-e9b0696d8413 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:42.698495 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-0abfa713-ce79-4e88-9239-e9b0696d8413 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] HTTP exception thrown: Instance 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 could not be found. Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0abfa713-ce79-4e88-9239-e9b0696d8413 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Request method failure captured: Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 HTTP/1.1 Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJ238gvy9Iqj-gh_hYMMA3k82GIwOXmge1ZpdCVbStgEi7Wx0Hp0nUD39OZgeTVVZUzzMU6rbj6VKVMThBnKMFJkrT_c4TpJItwEaxJM150Q197EeZTFOgQpHEVnJj9TzM6T9aiiAWqKRliV_RYi1MvsQfVRPMVtUboRY7WK1bO1DBQ Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: b1ec0b5ecaa741eaaf40a50f1415e7f9 Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-TestVolumeBootPattern-219047212 Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}] Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-TestVolumeBootPattern-219047212 Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: b1ec0b5ecaa741eaaf40a50f1415e7f9 Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-TestVolumeBootPattern-219047212 Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-TestVolumeBootPattern-219047212-project Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: f2967d0d8c134d269c9bbe51c90f803a Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-TestVolumeBootPattern-219047212-project Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 could not be found. Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2'} Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 could not be found. Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 could not be found. Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:56:42.700632 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:56:42.704743 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:56:42.704743 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:56:42.704743 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:56:42.704743 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:56:42.704743 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:56:42.704743 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 could not be found. Oct 23 01:56:42.704743 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:56:42.704743 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0abfa713-ce79-4e88-9239-e9b0696d8413 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Returning 404 to user: Instance 83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:56:42.704743 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0abfa713-ce79-4e88-9239-e9b0696d8413 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2" status: 404 len: 111 microversion: 2.1 time: 0.034440 Oct 23 01:56:42.704743 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3436/6972] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:42 2022] GET /compute/v2.1/servers/83004d8d-5c29-4c5f-9bbd-ff99d0eed0e2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 01:56:43.912940 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-70008492-dc2d-402e-97e1-b396d317c8f4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:43.913476 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-70008492-dc2d-402e-97e1-b396d317c8f4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: e54edefe-ab1a-4f08-ae7a-f29dbd10a93c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:43.921037 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-70008492-dc2d-402e-97e1-b396d317c8f4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:43.921513 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-70008492-dc2d-402e-97e1-b396d317c8f4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:43.921967 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-70008492-dc2d-402e-97e1-b396d317c8f4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:43.922670 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-70008492-dc2d-402e-97e1-b396d317c8f4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:43.923338 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-70008492-dc2d-402e-97e1-b396d317c8f4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:43.923734 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-70008492-dc2d-402e-97e1-b396d317c8f4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:43.938432 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-70008492-dc2d-402e-97e1-b396d317c8f4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] HTTP exception thrown: Instance e54edefe-ab1a-4f08-ae7a-f29dbd10a93c could not be found. Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-70008492-dc2d-402e-97e1-b396d317c8f4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Request method failure captured: Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c HTTP/1.1 Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJ238gvy9Iqj-gh_hYMMA3k82GIwOXmge1ZpdCVbStgEi7Wx0Hp0nUD39OZgeTVVZUzzMU6rbj6VKVMThBnKMFJkrT_c4TpJItwEaxJM150Q197EeZTFOgQpHEVnJj9TzM6T9aiiAWqKRliV_RYi1MvsQfVRPMVtUboRY7WK1bO1DBQ Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: b1ec0b5ecaa741eaaf40a50f1415e7f9 Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-TestVolumeBootPattern-219047212 Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}] Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-TestVolumeBootPattern-219047212 Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: b1ec0b5ecaa741eaaf40a50f1415e7f9 Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-TestVolumeBootPattern-219047212 Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-TestVolumeBootPattern-219047212-project Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: f2967d0d8c134d269c9bbe51c90f803a Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-TestVolumeBootPattern-219047212-project Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: exception: Instance e54edefe-ab1a-4f08-ae7a-f29dbd10a93c could not be found. Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'e54edefe-ab1a-4f08-ae7a-f29dbd10a93c'} Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e54edefe-ab1a-4f08-ae7a-f29dbd10a93c could not be found. Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:56:43.940021 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:56:43.943319 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e54edefe-ab1a-4f08-ae7a-f29dbd10a93c could not be found. Oct 23 01:56:43.943319 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:56:43.943319 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:56:43.943319 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:56:43.943319 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:56:43.943319 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:56:43.943319 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:56:43.943319 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:56:43.943319 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:56:43.943319 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e54edefe-ab1a-4f08-ae7a-f29dbd10a93c could not be found. Oct 23 01:56:43.943319 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:56:43.944518 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-70008492-dc2d-402e-97e1-b396d317c8f4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Returning 404 to user: Instance e54edefe-ab1a-4f08-ae7a-f29dbd10a93c could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:56:43.945347 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-70008492-dc2d-402e-97e1-b396d317c8f4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c" status: 404 len: 111 microversion: 2.1 time: 0.036972 Oct 23 01:56:43.945899 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3537/6973] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:56:43 2022] DELETE /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:56:43.955273 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-aa88c8a2-df34-4529-8249-ad249c7afdf1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:56:43.956493 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-aa88c8a2-df34-4529-8249-ad249c7afdf1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: e54edefe-ab1a-4f08-ae7a-f29dbd10a93c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:56:43.965170 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa88c8a2-df34-4529-8249-ad249c7afdf1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:43.965661 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa88c8a2-df34-4529-8249-ad249c7afdf1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:43.966196 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa88c8a2-df34-4529-8249-ad249c7afdf1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:43.966937 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa88c8a2-df34-4529-8249-ad249c7afdf1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:56:43.967400 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa88c8a2-df34-4529-8249-ad249c7afdf1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:56:43.967863 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aa88c8a2-df34-4529-8249-ad249c7afdf1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:56:43.982885 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-aa88c8a2-df34-4529-8249-ad249c7afdf1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] HTTP exception thrown: Instance e54edefe-ab1a-4f08-ae7a-f29dbd10a93c could not be found. Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-aa88c8a2-df34-4529-8249-ad249c7afdf1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Request method failure captured: Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c HTTP/1.1 Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJ238gvy9Iqj-gh_hYMMA3k82GIwOXmge1ZpdCVbStgEi7Wx0Hp0nUD39OZgeTVVZUzzMU6rbj6VKVMThBnKMFJkrT_c4TpJItwEaxJM150Q197EeZTFOgQpHEVnJj9TzM6T9aiiAWqKRliV_RYi1MvsQfVRPMVtUboRY7WK1bO1DBQ Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: b1ec0b5ecaa741eaaf40a50f1415e7f9 Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-TestVolumeBootPattern-219047212 Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}] Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-TestVolumeBootPattern-219047212 Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: b1ec0b5ecaa741eaaf40a50f1415e7f9 Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-TestVolumeBootPattern-219047212 Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-TestVolumeBootPattern-219047212-project Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: f2967d0d8c134d269c9bbe51c90f803a Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-TestVolumeBootPattern-219047212-project Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: exception: Instance e54edefe-ab1a-4f08-ae7a-f29dbd10a93c could not be found. Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'e54edefe-ab1a-4f08-ae7a-f29dbd10a93c'} Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e54edefe-ab1a-4f08-ae7a-f29dbd10a93c could not be found. Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e54edefe-ab1a-4f08-ae7a-f29dbd10a93c could not be found. Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:56:43.985105 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:56:43.989398 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:56:43.989398 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:56:43.989398 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:56:43.989398 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:56:43.989398 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:56:43.989398 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e54edefe-ab1a-4f08-ae7a-f29dbd10a93c could not be found. Oct 23 01:56:43.989398 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:56:43.989398 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-aa88c8a2-df34-4529-8249-ad249c7afdf1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Returning 404 to user: Instance e54edefe-ab1a-4f08-ae7a-f29dbd10a93c could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:56:43.989398 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-aa88c8a2-df34-4529-8249-ad249c7afdf1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c" status: 404 len: 111 microversion: 2.1 time: 0.035393 Oct 23 01:56:43.989398 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3437/6974] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:56:43 2022] GET /compute/v2.1/servers/e54edefe-ab1a-4f08-ae7a-f29dbd10a93c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:56:44.084230 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-14ae986e-6b7e-40af-a066-5f2faa665492 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Action: 'create', calling method: .version_select at 0x7f5cc1bfa700>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-179536436", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDpMVswpmMBw0cKbit5EEkWSv4GfyZXW1PyjHzb2MYEPy25sG6Z8JwPPof7LnV+BBxN9noZHtFXmfGNoZ+I4axXA6LETtSpnvdxOpmWibxxvi71TetJ/idAlojuqSI1BQw=="}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:56:44.101354 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-14ae986e-6b7e-40af-a066-5f2faa665492 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Getting quotas for project b1ec0b5ecaa741eaaf40a50f1415e7f9. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:56:44.106646 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-14ae986e-6b7e-40af-a066-5f2faa665492 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Getting quotas for user f2967d0d8c134d269c9bbe51c90f803a and project b1ec0b5ecaa741eaaf40a50f1415e7f9. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:56:44.211520 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-14ae986e-6b7e-40af-a066-5f2faa665492 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.131064 Oct 23 01:56:44.212314 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3538/6975] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 01:56:44 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:57:15.986475 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cc5d1070-c431-4d36-8fb1-5e25ed4881a2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1893035212", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-179536436", "security_groups": [{"name": "tempest-secgroup-smoke-735288621"}], "block_device_mapping_v2": [{"uuid": "87d9ef54-b895-4b06-842e-6d9d8379d80f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e056504c-8568-4f9a-a3ed-bae9f108b4ab"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:57:16.009493 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=25 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:57:16.010301 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=81 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:57:16.132733 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-cc5d1070-c431-4d36-8fb1-5e25ed4881a2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] validate_networks() for [('e056504c-8568-4f9a-a3ed-bae9f108b4ab', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:57:16.546217 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-cc5d1070-c431-4d36-8fb1-5e25ed4881a2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:57:16.546654 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-cc5d1070-c431-4d36-8fb1-5e25ed4881a2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:57:16.547136 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-cc5d1070-c431-4d36-8fb1-5e25ed4881a2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:57:16.547552 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-cc5d1070-c431-4d36-8fb1-5e25ed4881a2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:57:16.547972 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-cc5d1070-c431-4d36-8fb1-5e25ed4881a2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:57:16.556799 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cc5d1070-c431-4d36-8fb1-5e25ed4881a2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:16.557286 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cc5d1070-c431-4d36-8fb1-5e25ed4881a2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:16.557728 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cc5d1070-c431-4d36-8fb1-5e25ed4881a2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:16.558487 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cc5d1070-c431-4d36-8fb1-5e25ed4881a2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:16.558949 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cc5d1070-c431-4d36-8fb1-5e25ed4881a2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:16.559384 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cc5d1070-c431-4d36-8fb1-5e25ed4881a2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:16.584505 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-cc5d1070-c431-4d36-8fb1-5e25ed4881a2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Getting quotas for project b1ec0b5ecaa741eaaf40a50f1415e7f9. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:57:16.589682 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-cc5d1070-c431-4d36-8fb1-5e25ed4881a2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Getting quotas for user f2967d0d8c134d269c9bbe51c90f803a and project b1ec0b5ecaa741eaaf40a50f1415e7f9. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:57:16.654908 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cc5d1070-c431-4d36-8fb1-5e25ed4881a2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:57:16.657933 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cc5d1070-c431-4d36-8fb1-5e25ed4881a2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 9acf9d26-0453-4655-aca0-626fa37cf6ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='87d9ef54-b895-4b06-842e-6d9d8379d80f',volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:57:17.141604 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cc5d1070-c431-4d36-8fb1-5e25ed4881a2 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.159662 Oct 23 01:57:17.154963 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4de5c6b6-e4bc-42f4-9a0d-1a45440475a0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:57:17.158095 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4de5c6b6-e4bc-42f4-9a0d-1a45440475a0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 9acf9d26-0453-4655-aca0-626fa37cf6ee] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:57:17.158858 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=5 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:57:17.159562 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=4 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:57:17.160673 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3438/6976] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:57:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 1179 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:57:17.161522 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:57:17.232154 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4de5c6b6-e4bc-42f4-9a0d-1a45440475a0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:57:17.240525 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4de5c6b6-e4bc-42f4-9a0d-1a45440475a0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee" status: 200 len: 1094 microversion: 2.1 time: 0.090180 Oct 23 01:57:17.253754 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3539/6977] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:57:17 2022] GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee => generated 1094 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:57:18.265418 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f904592d-8494-4e01-96be-a14a50d9eb7a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:57:18.266236 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f904592d-8494-4e01-96be-a14a50d9eb7a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 9acf9d26-0453-4655-aca0-626fa37cf6ee] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:57:18.276587 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f904592d-8494-4e01-96be-a14a50d9eb7a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:18.277431 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f904592d-8494-4e01-96be-a14a50d9eb7a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:18.278242 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f904592d-8494-4e01-96be-a14a50d9eb7a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:18.279329 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f904592d-8494-4e01-96be-a14a50d9eb7a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:18.280074 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f904592d-8494-4e01-96be-a14a50d9eb7a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:18.280904 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f904592d-8494-4e01-96be-a14a50d9eb7a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:18.354649 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f904592d-8494-4e01-96be-a14a50d9eb7a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:57:18.363434 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f904592d-8494-4e01-96be-a14a50d9eb7a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee" status: 200 len: 1144 microversion: 2.1 time: 0.102456 Oct 23 01:57:18.364887 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3439/6978] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:57:18 2022] GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee => generated 1144 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:57:19.393531 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6ef78603-f590-47bf-b8a1-17212015249e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:57:19.394099 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6ef78603-f590-47bf-b8a1-17212015249e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 9acf9d26-0453-4655-aca0-626fa37cf6ee] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:57:19.403905 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6ef78603-f590-47bf-b8a1-17212015249e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:19.404396 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6ef78603-f590-47bf-b8a1-17212015249e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:19.404915 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6ef78603-f590-47bf-b8a1-17212015249e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:19.405618 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6ef78603-f590-47bf-b8a1-17212015249e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:19.406100 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6ef78603-f590-47bf-b8a1-17212015249e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:19.406528 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6ef78603-f590-47bf-b8a1-17212015249e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:19.485112 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6ef78603-f590-47bf-b8a1-17212015249e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:57:19.496141 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6ef78603-f590-47bf-b8a1-17212015249e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee" status: 200 len: 1192 microversion: 2.1 time: 0.108206 Oct 23 01:57:19.497081 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3540/6979] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:57:19 2022] GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee => generated 1192 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:57:20.527833 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-eaf64a7f-e026-41ae-8d62-3e4c7d2c7aba tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:57:20.528621 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-eaf64a7f-e026-41ae-8d62-3e4c7d2c7aba tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 9acf9d26-0453-4655-aca0-626fa37cf6ee] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:57:20.552963 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eaf64a7f-e026-41ae-8d62-3e4c7d2c7aba tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:20.553830 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eaf64a7f-e026-41ae-8d62-3e4c7d2c7aba tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:20.556974 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eaf64a7f-e026-41ae-8d62-3e4c7d2c7aba tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:20.557751 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eaf64a7f-e026-41ae-8d62-3e4c7d2c7aba tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:20.558278 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eaf64a7f-e026-41ae-8d62-3e4c7d2c7aba tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:20.559656 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eaf64a7f-e026-41ae-8d62-3e4c7d2c7aba tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:20.782227 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-eaf64a7f-e026-41ae-8d62-3e4c7d2c7aba tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:57:20.792389 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-eaf64a7f-e026-41ae-8d62-3e4c7d2c7aba tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee" status: 200 len: 1277 microversion: 2.1 time: 0.268474 Oct 23 01:57:20.794891 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3440/6980] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:57:20 2022] GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee => generated 1277 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:57:21.822020 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9fd371b0-42eb-4b81-8cc8-7f18ce7f4a98 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:57:21.822779 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9fd371b0-42eb-4b81-8cc8-7f18ce7f4a98 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 9acf9d26-0453-4655-aca0-626fa37cf6ee] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:57:21.834091 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9fd371b0-42eb-4b81-8cc8-7f18ce7f4a98 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:21.834765 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9fd371b0-42eb-4b81-8cc8-7f18ce7f4a98 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:21.835529 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9fd371b0-42eb-4b81-8cc8-7f18ce7f4a98 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:21.836400 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9fd371b0-42eb-4b81-8cc8-7f18ce7f4a98 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:21.837095 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9fd371b0-42eb-4b81-8cc8-7f18ce7f4a98 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:21.837968 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9fd371b0-42eb-4b81-8cc8-7f18ce7f4a98 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:21.861112 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-5325bbc2-7ded-46ba-8d79-ea33b9e86c96 req-a7adacea-ddb2-4588-aff9-afed9b0bba27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9acf9d26-0453-4655-aca0-626fa37cf6ee", "tag": "9915dbba-2f89-428e-98c3-1a6e5d3c9893"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:57:21.877459 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-5325bbc2-7ded-46ba-8d79-ea33b9e86c96 req-a7adacea-ddb2-4588-aff9-afed9b0bba27 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:21.879482 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-5325bbc2-7ded-46ba-8d79-ea33b9e86c96 req-a7adacea-ddb2-4588-aff9-afed9b0bba27 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:21.881820 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-5325bbc2-7ded-46ba-8d79-ea33b9e86c96 req-a7adacea-ddb2-4588-aff9-afed9b0bba27 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:21.912609 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-5325bbc2-7ded-46ba-8d79-ea33b9e86c96 req-a7adacea-ddb2-4588-aff9-afed9b0bba27 service nova] Creating event network-changed:9915dbba-2f89-428e-98c3-1a6e5d3c9893 for instance 9acf9d26-0453-4655-aca0-626fa37cf6ee on n-h1-master-1 Oct 23 01:57:21.919752 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-5325bbc2-7ded-46ba-8d79-ea33b9e86c96 req-a7adacea-ddb2-4588-aff9-afed9b0bba27 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061920 Oct 23 01:57:21.920811 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3441/6981] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:57:22.034040 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9fd371b0-42eb-4b81-8cc8-7f18ce7f4a98 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:57:22.054635 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9fd371b0-42eb-4b81-8cc8-7f18ce7f4a98 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee" status: 200 len: 1277 microversion: 2.1 time: 0.241582 Oct 23 01:57:22.070511 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3541/6982] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:57:21 2022] GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee => generated 1277 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:57:23.077952 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7aa01ad4-5a46-469a-98b2-a20dc23de3ad tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:57:23.078604 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7aa01ad4-5a46-469a-98b2-a20dc23de3ad tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 9acf9d26-0453-4655-aca0-626fa37cf6ee] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:57:23.090324 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7aa01ad4-5a46-469a-98b2-a20dc23de3ad tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:23.090852 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7aa01ad4-5a46-469a-98b2-a20dc23de3ad tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:23.091316 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7aa01ad4-5a46-469a-98b2-a20dc23de3ad tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:23.092058 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7aa01ad4-5a46-469a-98b2-a20dc23de3ad tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:23.092542 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7aa01ad4-5a46-469a-98b2-a20dc23de3ad tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:23.092988 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7aa01ad4-5a46-469a-98b2-a20dc23de3ad tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:23.261532 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7aa01ad4-5a46-469a-98b2-a20dc23de3ad tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:57:23.270766 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7aa01ad4-5a46-469a-98b2-a20dc23de3ad tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee" status: 200 len: 1277 microversion: 2.1 time: 0.196808 Oct 23 01:57:23.271378 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3442/6983] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:57:23 2022] GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee => generated 1277 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:57:24.294289 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4793a919-73d0-4ce8-af66-d5cab86fe138 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:57:24.294919 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4793a919-73d0-4ce8-af66-d5cab86fe138 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 9acf9d26-0453-4655-aca0-626fa37cf6ee] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:57:24.302665 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4793a919-73d0-4ce8-af66-d5cab86fe138 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:24.303169 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4793a919-73d0-4ce8-af66-d5cab86fe138 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:24.303613 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4793a919-73d0-4ce8-af66-d5cab86fe138 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:24.304320 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4793a919-73d0-4ce8-af66-d5cab86fe138 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:24.304784 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4793a919-73d0-4ce8-af66-d5cab86fe138 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:24.305214 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4793a919-73d0-4ce8-af66-d5cab86fe138 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:24.449503 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4793a919-73d0-4ce8-af66-d5cab86fe138 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:57:24.458934 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4793a919-73d0-4ce8-af66-d5cab86fe138 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee" status: 200 len: 1277 microversion: 2.1 time: 0.168671 Oct 23 01:57:24.459628 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3542/6984] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:57:24 2022] GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee => generated 1277 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:57:25.484052 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a36b97ca-6066-4879-89d4-f9a43978cbc3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:57:25.484896 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a36b97ca-6066-4879-89d4-f9a43978cbc3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 9acf9d26-0453-4655-aca0-626fa37cf6ee] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:57:25.493926 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a36b97ca-6066-4879-89d4-f9a43978cbc3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:25.495661 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a36b97ca-6066-4879-89d4-f9a43978cbc3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:25.496380 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a36b97ca-6066-4879-89d4-f9a43978cbc3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:25.497555 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a36b97ca-6066-4879-89d4-f9a43978cbc3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:25.498376 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a36b97ca-6066-4879-89d4-f9a43978cbc3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:25.499112 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a36b97ca-6066-4879-89d4-f9a43978cbc3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:25.668100 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a36b97ca-6066-4879-89d4-f9a43978cbc3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:57:25.677362 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a36b97ca-6066-4879-89d4-f9a43978cbc3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee" status: 200 len: 1277 microversion: 2.1 time: 0.198071 Oct 23 01:57:25.682515 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3443/6985] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:57:25 2022] GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee => generated 1277 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:57:26.701232 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bb212947-4674-495f-8bb1-4949d63154fd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:57:26.701869 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bb212947-4674-495f-8bb1-4949d63154fd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 9acf9d26-0453-4655-aca0-626fa37cf6ee] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:57:26.710882 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bb212947-4674-495f-8bb1-4949d63154fd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:26.712141 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bb212947-4674-495f-8bb1-4949d63154fd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:26.712852 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bb212947-4674-495f-8bb1-4949d63154fd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:26.714745 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bb212947-4674-495f-8bb1-4949d63154fd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:26.715233 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bb212947-4674-495f-8bb1-4949d63154fd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:26.716124 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bb212947-4674-495f-8bb1-4949d63154fd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:26.865883 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bb212947-4674-495f-8bb1-4949d63154fd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:57:26.876151 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bb212947-4674-495f-8bb1-4949d63154fd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee" status: 200 len: 1277 microversion: 2.1 time: 0.179117 Oct 23 01:57:26.877400 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3543/6986] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:57:26 2022] GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee => generated 1277 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:57:27.901923 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-31dc8b76-0f1e-4376-a546-09974d17a39d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:57:27.903004 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-31dc8b76-0f1e-4376-a546-09974d17a39d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 9acf9d26-0453-4655-aca0-626fa37cf6ee] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:57:27.908342 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:57:27.909353 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=6 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:57:27.914957 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-31dc8b76-0f1e-4376-a546-09974d17a39d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:27.916713 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-31dc8b76-0f1e-4376-a546-09974d17a39d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:27.917519 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-31dc8b76-0f1e-4376-a546-09974d17a39d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:27.918646 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-31dc8b76-0f1e-4376-a546-09974d17a39d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:27.919299 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-31dc8b76-0f1e-4376-a546-09974d17a39d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:27.921063 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-31dc8b76-0f1e-4376-a546-09974d17a39d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:28.063727 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-31dc8b76-0f1e-4376-a546-09974d17a39d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:57:28.075383 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-31dc8b76-0f1e-4376-a546-09974d17a39d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee" status: 200 len: 1277 microversion: 2.1 time: 0.177968 Oct 23 01:57:28.076463 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3444/6987] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:57:27 2022] GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee => generated 1277 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:57:29.100301 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0c4b0a80-cc91-4754-b2ac-9fd4c37dbd6f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:57:29.100955 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0c4b0a80-cc91-4754-b2ac-9fd4c37dbd6f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 9acf9d26-0453-4655-aca0-626fa37cf6ee] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:57:29.103177 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:57:29.109198 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0c4b0a80-cc91-4754-b2ac-9fd4c37dbd6f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:29.109697 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0c4b0a80-cc91-4754-b2ac-9fd4c37dbd6f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:29.110174 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0c4b0a80-cc91-4754-b2ac-9fd4c37dbd6f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:29.110924 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0c4b0a80-cc91-4754-b2ac-9fd4c37dbd6f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:29.111464 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0c4b0a80-cc91-4754-b2ac-9fd4c37dbd6f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:29.111889 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0c4b0a80-cc91-4754-b2ac-9fd4c37dbd6f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:29.253640 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0c4b0a80-cc91-4754-b2ac-9fd4c37dbd6f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:57:29.264462 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0c4b0a80-cc91-4754-b2ac-9fd4c37dbd6f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee" status: 200 len: 1265 microversion: 2.1 time: 0.168768 Oct 23 01:57:29.265589 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3544/6988] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:57:29 2022] GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:57:30.289032 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-07c32cfb-2dc3-4fbd-bf87-3b19fd5ad1ff tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:57:30.289660 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-07c32cfb-2dc3-4fbd-bf87-3b19fd5ad1ff tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 9acf9d26-0453-4655-aca0-626fa37cf6ee] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:57:30.297745 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-07c32cfb-2dc3-4fbd-bf87-3b19fd5ad1ff tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:30.304392 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-07c32cfb-2dc3-4fbd-bf87-3b19fd5ad1ff tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:30.304392 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-07c32cfb-2dc3-4fbd-bf87-3b19fd5ad1ff tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:30.304392 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-07c32cfb-2dc3-4fbd-bf87-3b19fd5ad1ff tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:30.304392 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-07c32cfb-2dc3-4fbd-bf87-3b19fd5ad1ff tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:30.304392 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-07c32cfb-2dc3-4fbd-bf87-3b19fd5ad1ff tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:30.446517 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-07c32cfb-2dc3-4fbd-bf87-3b19fd5ad1ff tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:57:30.455260 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-07c32cfb-2dc3-4fbd-bf87-3b19fd5ad1ff tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee" status: 200 len: 1265 microversion: 2.1 time: 0.171178 Oct 23 01:57:30.455889 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3445/6989] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:57:30 2022] GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:57:31.479025 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-86731204-9892-4736-ae2e-25f389b47aa7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:57:31.479895 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-86731204-9892-4736-ae2e-25f389b47aa7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 9acf9d26-0453-4655-aca0-626fa37cf6ee] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:57:31.487655 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-86731204-9892-4736-ae2e-25f389b47aa7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:31.488534 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-86731204-9892-4736-ae2e-25f389b47aa7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:31.489884 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-86731204-9892-4736-ae2e-25f389b47aa7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:31.490869 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-86731204-9892-4736-ae2e-25f389b47aa7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:31.492164 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-86731204-9892-4736-ae2e-25f389b47aa7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:31.492622 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-86731204-9892-4736-ae2e-25f389b47aa7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:31.634632 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-86731204-9892-4736-ae2e-25f389b47aa7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:57:31.642902 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-86731204-9892-4736-ae2e-25f389b47aa7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee" status: 200 len: 1265 microversion: 2.1 time: 0.168056 Oct 23 01:57:31.643501 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3545/6990] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:57:31 2022] GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:57:32.665969 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-65da7773-fc0a-4185-a9e0-7a923b47511e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:57:32.666539 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-65da7773-fc0a-4185-a9e0-7a923b47511e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 9acf9d26-0453-4655-aca0-626fa37cf6ee] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:57:32.672698 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-65da7773-fc0a-4185-a9e0-7a923b47511e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:32.673328 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-65da7773-fc0a-4185-a9e0-7a923b47511e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:32.673779 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-65da7773-fc0a-4185-a9e0-7a923b47511e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:32.674521 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-65da7773-fc0a-4185-a9e0-7a923b47511e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:32.675001 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-65da7773-fc0a-4185-a9e0-7a923b47511e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:32.675448 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-65da7773-fc0a-4185-a9e0-7a923b47511e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:32.813855 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-65da7773-fc0a-4185-a9e0-7a923b47511e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:57:32.822455 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-65da7773-fc0a-4185-a9e0-7a923b47511e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee" status: 200 len: 1265 microversion: 2.1 time: 0.161008 Oct 23 01:57:32.823039 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3446/6991] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:57:32 2022] GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:57:33.847274 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ca50ad68-6496-452c-8b4f-4a320d3fd39a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:57:33.851323 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ca50ad68-6496-452c-8b4f-4a320d3fd39a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 9acf9d26-0453-4655-aca0-626fa37cf6ee] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:57:33.861754 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ca50ad68-6496-452c-8b4f-4a320d3fd39a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:33.867949 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ca50ad68-6496-452c-8b4f-4a320d3fd39a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:33.867949 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ca50ad68-6496-452c-8b4f-4a320d3fd39a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:33.867949 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ca50ad68-6496-452c-8b4f-4a320d3fd39a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:33.867949 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ca50ad68-6496-452c-8b4f-4a320d3fd39a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:33.867949 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ca50ad68-6496-452c-8b4f-4a320d3fd39a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:34.100390 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ca50ad68-6496-452c-8b4f-4a320d3fd39a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:57:34.116980 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ca50ad68-6496-452c-8b4f-4a320d3fd39a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee" status: 200 len: 1265 microversion: 2.1 time: 0.266649 Oct 23 01:57:34.117688 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3546/6992] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:57:33 2022] GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee => generated 1265 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:57:35.140366 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-64957ffa-20d1-4912-866a-b0263ee37420 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:57:35.152815 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-64957ffa-20d1-4912-866a-b0263ee37420 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 9acf9d26-0453-4655-aca0-626fa37cf6ee] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:57:35.152815 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64957ffa-20d1-4912-866a-b0263ee37420 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:35.152815 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64957ffa-20d1-4912-866a-b0263ee37420 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:35.152815 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64957ffa-20d1-4912-866a-b0263ee37420 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:35.152815 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64957ffa-20d1-4912-866a-b0263ee37420 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:35.152815 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64957ffa-20d1-4912-866a-b0263ee37420 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:35.152815 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64957ffa-20d1-4912-866a-b0263ee37420 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:35.292212 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-64957ffa-20d1-4912-866a-b0263ee37420 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:57:35.300125 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-64957ffa-20d1-4912-866a-b0263ee37420 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee" status: 200 len: 1265 microversion: 2.1 time: 0.163651 Oct 23 01:57:35.302097 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3447/6993] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:57:35 2022] GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:57:36.325426 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b5d77b72-774b-4c46-87a4-dcb79b1aea53 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:57:36.326930 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b5d77b72-774b-4c46-87a4-dcb79b1aea53 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 9acf9d26-0453-4655-aca0-626fa37cf6ee] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:57:36.335035 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5d77b72-774b-4c46-87a4-dcb79b1aea53 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:36.338958 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5d77b72-774b-4c46-87a4-dcb79b1aea53 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:36.338958 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5d77b72-774b-4c46-87a4-dcb79b1aea53 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:36.338958 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5d77b72-774b-4c46-87a4-dcb79b1aea53 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:36.338958 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5d77b72-774b-4c46-87a4-dcb79b1aea53 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:36.338958 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5d77b72-774b-4c46-87a4-dcb79b1aea53 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:36.508460 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b5d77b72-774b-4c46-87a4-dcb79b1aea53 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:57:36.516638 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b5d77b72-774b-4c46-87a4-dcb79b1aea53 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee" status: 200 len: 1265 microversion: 2.1 time: 0.196297 Oct 23 01:57:36.518344 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3547/6994] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:57:36 2022] GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:57:37.539721 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2016b358-ffdb-4e26-992f-1e8f5a60a65c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:57:37.540395 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2016b358-ffdb-4e26-992f-1e8f5a60a65c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 9acf9d26-0453-4655-aca0-626fa37cf6ee] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:57:37.547797 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2016b358-ffdb-4e26-992f-1e8f5a60a65c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:37.548306 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2016b358-ffdb-4e26-992f-1e8f5a60a65c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:37.548763 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2016b358-ffdb-4e26-992f-1e8f5a60a65c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:37.549487 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2016b358-ffdb-4e26-992f-1e8f5a60a65c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:37.549997 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2016b358-ffdb-4e26-992f-1e8f5a60a65c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:37.550445 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2016b358-ffdb-4e26-992f-1e8f5a60a65c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:37.696963 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2016b358-ffdb-4e26-992f-1e8f5a60a65c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:57:37.705245 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2016b358-ffdb-4e26-992f-1e8f5a60a65c tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee" status: 200 len: 1265 microversion: 2.1 time: 0.169333 Oct 23 01:57:37.705847 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3448/6995] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:57:37 2022] GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:57:38.673324 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-e9440228-4faa-424d-a306-18effb773adc req-81bb1578-f75a-4a6c-89c7-5dfb0b99889c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9acf9d26-0453-4655-aca0-626fa37cf6ee", "name": "network-vif-plugged", "status": "completed", "tag": "9915dbba-2f89-428e-98c3-1a6e5d3c9893"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:57:38.685201 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-e9440228-4faa-424d-a306-18effb773adc req-81bb1578-f75a-4a6c-89c7-5dfb0b99889c service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:38.685719 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-e9440228-4faa-424d-a306-18effb773adc req-81bb1578-f75a-4a6c-89c7-5dfb0b99889c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:38.686242 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-e9440228-4faa-424d-a306-18effb773adc req-81bb1578-f75a-4a6c-89c7-5dfb0b99889c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:38.698496 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-e9440228-4faa-424d-a306-18effb773adc req-81bb1578-f75a-4a6c-89c7-5dfb0b99889c service nova] Creating event network-vif-plugged:9915dbba-2f89-428e-98c3-1a6e5d3c9893 for instance 9acf9d26-0453-4655-aca0-626fa37cf6ee on n-h1-master-1 Oct 23 01:57:38.704797 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-e9440228-4faa-424d-a306-18effb773adc req-81bb1578-f75a-4a6c-89c7-5dfb0b99889c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036216 Oct 23 01:57:38.705409 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3548/6996] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:57:38.727977 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7893ff36-8f15-493e-9929-fd1b73c2d99a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:57:38.728604 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7893ff36-8f15-493e-9929-fd1b73c2d99a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 9acf9d26-0453-4655-aca0-626fa37cf6ee] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:57:38.735643 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7893ff36-8f15-493e-9929-fd1b73c2d99a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:38.736336 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7893ff36-8f15-493e-9929-fd1b73c2d99a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:38.736941 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7893ff36-8f15-493e-9929-fd1b73c2d99a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:38.737659 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7893ff36-8f15-493e-9929-fd1b73c2d99a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:38.738407 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7893ff36-8f15-493e-9929-fd1b73c2d99a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:38.739022 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7893ff36-8f15-493e-9929-fd1b73c2d99a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:38.893865 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7893ff36-8f15-493e-9929-fd1b73c2d99a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:57:38.902917 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7893ff36-8f15-493e-9929-fd1b73c2d99a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee" status: 200 len: 1265 microversion: 2.1 time: 0.178726 Oct 23 01:57:38.903505 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3449/6997] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:57:38 2022] GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:57:39.930159 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-17559597-7708-4bac-8f30-aacbf9d58591 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:57:39.930790 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-17559597-7708-4bac-8f30-aacbf9d58591 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 9acf9d26-0453-4655-aca0-626fa37cf6ee] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:57:39.937492 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-17559597-7708-4bac-8f30-aacbf9d58591 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:39.938002 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-17559597-7708-4bac-8f30-aacbf9d58591 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:39.938459 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-17559597-7708-4bac-8f30-aacbf9d58591 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:39.939255 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-17559597-7708-4bac-8f30-aacbf9d58591 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:39.939719 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-17559597-7708-4bac-8f30-aacbf9d58591 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:39.940150 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-17559597-7708-4bac-8f30-aacbf9d58591 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:40.095775 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-17559597-7708-4bac-8f30-aacbf9d58591 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:57:40.103932 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-17559597-7708-4bac-8f30-aacbf9d58591 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee" status: 200 len: 1265 microversion: 2.1 time: 0.180018 Oct 23 01:57:40.104592 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3549/6998] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:57:39 2022] GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:57:41.127002 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-781a9a93-9d51-4361-8e4a-37890ce32572 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:57:41.127560 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-781a9a93-9d51-4361-8e4a-37890ce32572 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 9acf9d26-0453-4655-aca0-626fa37cf6ee] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:57:41.134815 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-781a9a93-9d51-4361-8e4a-37890ce32572 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:41.135314 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-781a9a93-9d51-4361-8e4a-37890ce32572 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:41.135775 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-781a9a93-9d51-4361-8e4a-37890ce32572 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:41.136522 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-781a9a93-9d51-4361-8e4a-37890ce32572 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:41.137000 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-781a9a93-9d51-4361-8e4a-37890ce32572 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:41.137443 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-781a9a93-9d51-4361-8e4a-37890ce32572 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:41.274883 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-781a9a93-9d51-4361-8e4a-37890ce32572 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:57:41.285030 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-781a9a93-9d51-4361-8e4a-37890ce32572 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee" status: 200 len: 1452 microversion: 2.1 time: 0.161927 Oct 23 01:57:41.291384 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3450/6999] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:57:41 2022] GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee => generated 1452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:57:41.310421 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4cf0eec8-380c-4d88-98e1-8690b4f9d976 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:57:41.311106 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4cf0eec8-380c-4d88-98e1-8690b4f9d976 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 9acf9d26-0453-4655-aca0-626fa37cf6ee] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:57:41.319130 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4cf0eec8-380c-4d88-98e1-8690b4f9d976 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:41.319703 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4cf0eec8-380c-4d88-98e1-8690b4f9d976 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:41.320205 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4cf0eec8-380c-4d88-98e1-8690b4f9d976 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:41.320958 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4cf0eec8-380c-4d88-98e1-8690b4f9d976 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:41.321477 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4cf0eec8-380c-4d88-98e1-8690b4f9d976 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:41.321959 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4cf0eec8-380c-4d88-98e1-8690b4f9d976 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:41.473310 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4cf0eec8-380c-4d88-98e1-8690b4f9d976 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:57:41.485308 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4cf0eec8-380c-4d88-98e1-8690b4f9d976 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee" status: 200 len: 1452 microversion: 2.1 time: 0.178738 Oct 23 01:57:41.485575 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3550/7000] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:57:41 2022] GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee => generated 1452 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:57:44.013036 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-65cb9fed-cb44-4924-b90f-6a9c6646db0a req-27c4b461-7240-4b77-8c38-717f90b77635 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9acf9d26-0453-4655-aca0-626fa37cf6ee", "tag": "9915dbba-2f89-428e-98c3-1a6e5d3c9893"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:57:44.027733 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-65cb9fed-cb44-4924-b90f-6a9c6646db0a req-27c4b461-7240-4b77-8c38-717f90b77635 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:44.029339 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-65cb9fed-cb44-4924-b90f-6a9c6646db0a req-27c4b461-7240-4b77-8c38-717f90b77635 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:44.030013 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-65cb9fed-cb44-4924-b90f-6a9c6646db0a req-27c4b461-7240-4b77-8c38-717f90b77635 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:44.050158 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-65cb9fed-cb44-4924-b90f-6a9c6646db0a req-27c4b461-7240-4b77-8c38-717f90b77635 service nova] Creating event network-changed:9915dbba-2f89-428e-98c3-1a6e5d3c9893 for instance 9acf9d26-0453-4655-aca0-626fa37cf6ee on n-h1-master-1 Oct 23 01:57:44.056850 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-65cb9fed-cb44-4924-b90f-6a9c6646db0a req-27c4b461-7240-4b77-8c38-717f90b77635 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047484 Oct 23 01:57:44.058963 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3451/7001] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:57:56.938793 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-84bc21eb-90c8-44da-91c6-4f3dc563a331 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:57:56.939349 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-84bc21eb-90c8-44da-91c6-4f3dc563a331 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] [instance: 72a32ad2-2150-4cdf-9dbd-987ba14d5f96] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:57:56.941673 n-d-master-1 devstack@n-api.service[120944]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 23 01:57:56.941830 n-d-master-1 devstack@n-api.service[120944]: Sun Oct 23 01:57:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96 (ip 10.222.0.42) !!! Oct 23 01:57:56.944450 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=26 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:57:56.950222 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=62 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:57:56.961248 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-84bc21eb-90c8-44da-91c6-4f3dc563a331 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:56.962058 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-84bc21eb-90c8-44da-91c6-4f3dc563a331 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:56.962653 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-84bc21eb-90c8-44da-91c6-4f3dc563a331 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:56.963598 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-84bc21eb-90c8-44da-91c6-4f3dc563a331 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:56.964365 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-84bc21eb-90c8-44da-91c6-4f3dc563a331 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:56.964484 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-5e22f027-a7cf-42da-8c39-f68cee482df0 req-f1441e1b-44c7-4efc-a899-3d6c5c0be854 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72a32ad2-2150-4cdf-9dbd-987ba14d5f96", "tag": "f2a6b2ca-5db4-47f5-9c02-52fc6cde4334"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:57:56.965446 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-84bc21eb-90c8-44da-91c6-4f3dc563a331 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:56.978669 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:57:56.979674 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=72 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:57:56.982105 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-5e22f027-a7cf-42da-8c39-f68cee482df0 req-f1441e1b-44c7-4efc-a899-3d6c5c0be854 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:56.983061 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-5e22f027-a7cf-42da-8c39-f68cee482df0 req-f1441e1b-44c7-4efc-a899-3d6c5c0be854 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:56.983555 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-5e22f027-a7cf-42da-8c39-f68cee482df0 req-f1441e1b-44c7-4efc-a899-3d6c5c0be854 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:56.999856 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-84bc21eb-90c8-44da-91c6-4f3dc563a331 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] [instance: 72a32ad2-2150-4cdf-9dbd-987ba14d5f96] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:57:57.000736 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-5e22f027-a7cf-42da-8c39-f68cee482df0 req-f1441e1b-44c7-4efc-a899-3d6c5c0be854 service nova] Creating event network-changed:f2a6b2ca-5db4-47f5-9c02-52fc6cde4334 for instance 72a32ad2-2150-4cdf-9dbd-987ba14d5f96 on n-h2-master-1 Oct 23 01:57:57.008465 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-5e22f027-a7cf-42da-8c39-f68cee482df0 req-f1441e1b-44c7-4efc-a899-3d6c5c0be854 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050689 Oct 23 01:57:57.009454 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3452/7002] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 01:57:57.335703 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-84bc21eb-90c8-44da-91c6-4f3dc563a331 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] 10.222.0.42 "DELETE /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96" status: 204 len: 0 microversion: 2.1 time: 0.400532 Oct 23 01:57:57.339295 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3551/7003] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:57:56 2022] DELETE /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:57:57.349239 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8d1f33f8-3028-4199-949d-52f303404615 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:57:57.350378 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8d1f33f8-3028-4199-949d-52f303404615 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] [instance: 72a32ad2-2150-4cdf-9dbd-987ba14d5f96] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:57:57.362283 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d1f33f8-3028-4199-949d-52f303404615 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:57.362283 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d1f33f8-3028-4199-949d-52f303404615 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:57.362283 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d1f33f8-3028-4199-949d-52f303404615 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:57.363423 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d1f33f8-3028-4199-949d-52f303404615 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:57.364194 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d1f33f8-3028-4199-949d-52f303404615 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:57.365493 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d1f33f8-3028-4199-949d-52f303404615 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:57.543262 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8d1f33f8-3028-4199-949d-52f303404615 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949b4b3b7b143158acb8aa6ee0a7da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530303744266461da10d50db53a0e409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:57:57.551708 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8d1f33f8-3028-4199-949d-52f303404615 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] 10.222.0.42 "GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96" status: 200 len: 1581 microversion: 2.1 time: 0.207546 Oct 23 01:57:57.553533 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3453/7004] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:57:57 2022] GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96 => generated 1581 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:57:58.577949 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-afcb199b-7da3-4288-b925-352957736e52 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:57:58.578747 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-afcb199b-7da3-4288-b925-352957736e52 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] [instance: 72a32ad2-2150-4cdf-9dbd-987ba14d5f96] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:57:58.586199 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-afcb199b-7da3-4288-b925-352957736e52 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:58.586679 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-afcb199b-7da3-4288-b925-352957736e52 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:58.587127 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-afcb199b-7da3-4288-b925-352957736e52 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:58.587834 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-afcb199b-7da3-4288-b925-352957736e52 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:58.588296 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-afcb199b-7da3-4288-b925-352957736e52 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:58.588725 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-afcb199b-7da3-4288-b925-352957736e52 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:58.745875 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-afcb199b-7da3-4288-b925-352957736e52 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949b4b3b7b143158acb8aa6ee0a7da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530303744266461da10d50db53a0e409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:57:58.754714 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-afcb199b-7da3-4288-b925-352957736e52 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] 10.222.0.42 "GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96" status: 200 len: 1581 microversion: 2.1 time: 0.181645 Oct 23 01:57:58.771135 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3552/7005] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:57:58 2022] GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96 => generated 1581 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:57:59.782511 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9b498c41-2b98-4324-8bca-7bafbcc1f814 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:57:59.783841 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9b498c41-2b98-4324-8bca-7bafbcc1f814 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] [instance: 72a32ad2-2150-4cdf-9dbd-987ba14d5f96] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:57:59.810580 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b498c41-2b98-4324-8bca-7bafbcc1f814 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:59.811132 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b498c41-2b98-4324-8bca-7bafbcc1f814 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:59.811597 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b498c41-2b98-4324-8bca-7bafbcc1f814 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:59.812356 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b498c41-2b98-4324-8bca-7bafbcc1f814 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:57:59.812830 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b498c41-2b98-4324-8bca-7bafbcc1f814 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:57:59.813574 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b498c41-2b98-4324-8bca-7bafbcc1f814 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:57:59.886535 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9b498c41-2b98-4324-8bca-7bafbcc1f814 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949b4b3b7b143158acb8aa6ee0a7da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530303744266461da10d50db53a0e409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:57:59.899956 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9b498c41-2b98-4324-8bca-7bafbcc1f814 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] 10.222.0.42 "GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96" status: 200 len: 1397 microversion: 2.1 time: 0.123113 Oct 23 01:57:59.900700 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3454/7006] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:57:59 2022] GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96 => generated 1397 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:57:59.984971 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-4ac80c09-3eea-40b8-a5f3-ea398457f3bf req-d77bcaf5-f0a0-406d-9703-ee3d8fde96d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72a32ad2-2150-4cdf-9dbd-987ba14d5f96", "name": "network-vif-deleted", "tag": "f2a6b2ca-5db4-47f5-9c02-52fc6cde4334"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:57:59.999034 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-4ac80c09-3eea-40b8-a5f3-ea398457f3bf req-d77bcaf5-f0a0-406d-9703-ee3d8fde96d0 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:58:00.000722 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-4ac80c09-3eea-40b8-a5f3-ea398457f3bf req-d77bcaf5-f0a0-406d-9703-ee3d8fde96d0 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:58:00.001501 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-4ac80c09-3eea-40b8-a5f3-ea398457f3bf req-d77bcaf5-f0a0-406d-9703-ee3d8fde96d0 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:58:00.019150 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-4ac80c09-3eea-40b8-a5f3-ea398457f3bf req-d77bcaf5-f0a0-406d-9703-ee3d8fde96d0 service nova] Creating event network-vif-deleted:f2a6b2ca-5db4-47f5-9c02-52fc6cde4334 for instance 72a32ad2-2150-4cdf-9dbd-987ba14d5f96 on n-h2-master-1 Oct 23 01:58:00.026098 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-4ac80c09-3eea-40b8-a5f3-ea398457f3bf req-d77bcaf5-f0a0-406d-9703-ee3d8fde96d0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044860 Oct 23 01:58:00.026743 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3553/7007] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:58:00.923874 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ea6e1bd7-19c4-4a89-aa8d-7db9daabb1f9 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:58:00.924604 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ea6e1bd7-19c4-4a89-aa8d-7db9daabb1f9 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] [instance: 72a32ad2-2150-4cdf-9dbd-987ba14d5f96] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:58:00.934011 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ea6e1bd7-19c4-4a89-aa8d-7db9daabb1f9 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:58:00.942062 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ea6e1bd7-19c4-4a89-aa8d-7db9daabb1f9 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:58:00.942062 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ea6e1bd7-19c4-4a89-aa8d-7db9daabb1f9 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:58:00.942062 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ea6e1bd7-19c4-4a89-aa8d-7db9daabb1f9 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:58:00.942062 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ea6e1bd7-19c4-4a89-aa8d-7db9daabb1f9 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:58:00.942062 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ea6e1bd7-19c4-4a89-aa8d-7db9daabb1f9 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:58:01.023847 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ea6e1bd7-19c4-4a89-aa8d-7db9daabb1f9 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949b4b3b7b143158acb8aa6ee0a7da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530303744266461da10d50db53a0e409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:58:01.032648 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ea6e1bd7-19c4-4a89-aa8d-7db9daabb1f9 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] 10.222.0.42 "GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96" status: 200 len: 1228 microversion: 2.1 time: 0.113394 Oct 23 01:58:01.046017 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3455/7008] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:58:00 2022] GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96 => generated 1228 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:58:02.062842 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f64bb12b-5c22-4ada-add7-96fdff337e14 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:58:02.064505 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f64bb12b-5c22-4ada-add7-96fdff337e14 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] [instance: 72a32ad2-2150-4cdf-9dbd-987ba14d5f96] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:58:02.080372 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f64bb12b-5c22-4ada-add7-96fdff337e14 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:58:02.080872 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f64bb12b-5c22-4ada-add7-96fdff337e14 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:58:02.081312 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f64bb12b-5c22-4ada-add7-96fdff337e14 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:58:02.082074 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f64bb12b-5c22-4ada-add7-96fdff337e14 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:58:02.082534 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f64bb12b-5c22-4ada-add7-96fdff337e14 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:58:02.082967 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f64bb12b-5c22-4ada-add7-96fdff337e14 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:58:02.498877 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f64bb12b-5c22-4ada-add7-96fdff337e14 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949b4b3b7b143158acb8aa6ee0a7da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530303744266461da10d50db53a0e409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:58:02.507818 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f64bb12b-5c22-4ada-add7-96fdff337e14 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] 10.222.0.42 "GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96" status: 200 len: 1228 microversion: 2.1 time: 0.453628 Oct 23 01:58:02.508769 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3554/7009] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:58:02 2022] GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96 => generated 1228 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:58:03.734451 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-06856db6-335d-4dde-bd30-6b327c7c0fc6 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:58:03.735092 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-06856db6-335d-4dde-bd30-6b327c7c0fc6 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] [instance: 72a32ad2-2150-4cdf-9dbd-987ba14d5f96] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:58:03.741929 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-06856db6-335d-4dde-bd30-6b327c7c0fc6 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:58:03.742387 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-06856db6-335d-4dde-bd30-6b327c7c0fc6 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:58:03.742842 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-06856db6-335d-4dde-bd30-6b327c7c0fc6 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:58:03.743569 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-06856db6-335d-4dde-bd30-6b327c7c0fc6 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:58:03.744039 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-06856db6-335d-4dde-bd30-6b327c7c0fc6 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:58:03.744526 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-06856db6-335d-4dde-bd30-6b327c7c0fc6 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:58:03.813156 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-06856db6-335d-4dde-bd30-6b327c7c0fc6 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949b4b3b7b143158acb8aa6ee0a7da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530303744266461da10d50db53a0e409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:58:03.821376 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-06856db6-335d-4dde-bd30-6b327c7c0fc6 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] 10.222.0.42 "GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96" status: 200 len: 1228 microversion: 2.1 time: 0.290538 Oct 23 01:58:03.837220 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3456/7010] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:58:03 2022] GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96 => generated 1228 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:58:04.845061 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fb379fc7-51f5-4086-8e7e-e4ebaaa93218 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:58:04.846346 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fb379fc7-51f5-4086-8e7e-e4ebaaa93218 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] [instance: 72a32ad2-2150-4cdf-9dbd-987ba14d5f96] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:58:04.855385 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb379fc7-51f5-4086-8e7e-e4ebaaa93218 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:58:04.855833 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb379fc7-51f5-4086-8e7e-e4ebaaa93218 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:58:04.860484 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb379fc7-51f5-4086-8e7e-e4ebaaa93218 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:58:04.860484 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb379fc7-51f5-4086-8e7e-e4ebaaa93218 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:58:04.860484 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb379fc7-51f5-4086-8e7e-e4ebaaa93218 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:58:04.860484 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb379fc7-51f5-4086-8e7e-e4ebaaa93218 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:58:04.927974 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fb379fc7-51f5-4086-8e7e-e4ebaaa93218 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949b4b3b7b143158acb8aa6ee0a7da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530303744266461da10d50db53a0e409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:58:04.937934 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fb379fc7-51f5-4086-8e7e-e4ebaaa93218 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] 10.222.0.42 "GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96" status: 200 len: 1228 microversion: 2.1 time: 0.096782 Oct 23 01:58:04.938573 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3555/7011] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:58:04 2022] GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96 => generated 1228 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:58:05.962688 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7a181713-ae46-4325-9bbe-a7af707fb2c2 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:58:05.964211 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7a181713-ae46-4325-9bbe-a7af707fb2c2 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] [instance: 72a32ad2-2150-4cdf-9dbd-987ba14d5f96] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:58:05.976232 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a181713-ae46-4325-9bbe-a7af707fb2c2 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:58:05.977022 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a181713-ae46-4325-9bbe-a7af707fb2c2 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:58:05.978083 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a181713-ae46-4325-9bbe-a7af707fb2c2 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:58:05.979061 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a181713-ae46-4325-9bbe-a7af707fb2c2 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:58:05.980073 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a181713-ae46-4325-9bbe-a7af707fb2c2 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:58:05.981503 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a181713-ae46-4325-9bbe-a7af707fb2c2 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:58:05.998133 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-7a181713-ae46-4325-9bbe-a7af707fb2c2 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] HTTP exception thrown: Instance 72a32ad2-2150-4cdf-9dbd-987ba14d5f96 could not be found. Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7a181713-ae46-4325-9bbe-a7af707fb2c2 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Request method failure captured: Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96 HTTP/1.1 Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJ5y4qIf6a39dL-GH8ndriseymOrqOJYyq8uITXu-pz4-bLi661nJlLRXvA4xfXxvKJOK6ZOOkDZ4Dyl1ypIkeBgxSBzbz4dsdEpUU71-SpSpQmL7dep_L3XXW0s7o2MNQEqlcaBZD5J62qKTcbgd5cupRoHAH8N-ww1BX-i2SnVZBo Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 530303744266461da10d50db53a0e409 Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-TestVolumeBackupRestore-70448357 Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/530303744266461da10d50db53a0e409"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_530303744266461da10d50db53a0e409"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/530303744266461da10d50db53a0e409"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/530303744266461da10d50db53a0e409"}]}] Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-TestVolumeBackupRestore-70448357 Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 530303744266461da10d50db53a0e409 Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-TestVolumeBackupRestore-70448357 Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-TestVolumeBackupRestore-70448357-project Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: f949b4b3b7b143158acb8aa6ee0a7da8 Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-TestVolumeBackupRestore-70448357-project Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 72a32ad2-2150-4cdf-9dbd-987ba14d5f96 could not be found. Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '72a32ad2-2150-4cdf-9dbd-987ba14d5f96'} Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72a32ad2-2150-4cdf-9dbd-987ba14d5f96 could not be found. Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72a32ad2-2150-4cdf-9dbd-987ba14d5f96 could not be found. Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:58:06.000225 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:58:06.004744 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:58:06.004744 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:58:06.004744 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:58:06.004744 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:58:06.004744 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:58:06.004744 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72a32ad2-2150-4cdf-9dbd-987ba14d5f96 could not be found. Oct 23 01:58:06.004744 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 01:58:06.007516 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7a181713-ae46-4325-9bbe-a7af707fb2c2 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Returning 404 to user: Instance 72a32ad2-2150-4cdf-9dbd-987ba14d5f96 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:58:06.008515 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7a181713-ae46-4325-9bbe-a7af707fb2c2 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] 10.222.0.42 "GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96" status: 404 len: 111 microversion: 2.1 time: 0.050618 Oct 23 01:58:06.009107 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3457/7012] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:58:05 2022] GET /compute/v2.1/servers/72a32ad2-2150-4cdf-9dbd-987ba14d5f96 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:58:06.278950 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ee34f2df-76a9-4c71-94ae-3d806e86cf73 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] Calling method '.version_select at 0x7f5cc0a40670>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:58:06.377502 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ee34f2df-76a9-4c71-94ae-3d806e86cf73 tempest-TestVolumeBackupRestore-70448357 tempest-TestVolumeBackupRestore-70448357-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-564057006" status: 202 len: 0 microversion: 2.1 time: 0.103221 Oct 23 01:58:06.378754 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3556/7013] 10.222.0.42 () {58 vars in 1266 bytes} [Sun Oct 23 01:58:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-564057006 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 01:58:11.092437 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d8533b3c-3685-4f0b-8dcf-e96f734ce727 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Action: 'create', calling method: .version_select at 0x7f5cc16f11f0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1482693316", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFCBWSf4C+Ed0toGhB3VIoKmPfpMc1svB4uLL6xpEEkafoiAVHNXV6oByHwQ9pxxKc6b/lIEkMfS5ajASuAX4ibtOIAzCgXrrRtt6jBcNU0Z5d7KOg1rVwR6EjN00Ma7/g=="}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:58:11.130218 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-d8533b3c-3685-4f0b-8dcf-e96f734ce727 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Getting quotas for project e76b081c02814da98ab62bfc2fe5536b. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:58:11.171310 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-d8533b3c-3685-4f0b-8dcf-e96f734ce727 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Getting quotas for user d2f253afef5849d19f4e1d99b038697b and project e76b081c02814da98ab62bfc2fe5536b. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:58:11.338113 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d8533b3c-3685-4f0b-8dcf-e96f734ce727 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.249612 Oct 23 01:58:11.339228 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3458/7014] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 01:58:11 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:58:14.878638 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-df892f3b-c97b-4124-9711-0070fbb0dac4 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1504035092", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "76d7ff3f-938e-41a6-a9ed-99362e4cd635"}], "key_name": "tempest-TestNetworkBasicOps-1482693316", "security_groups": [{"name": "tempest-secgroup-smoke-1416875028"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:58:14.933649 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:15.200460 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-df892f3b-c97b-4124-9711-0070fbb0dac4 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] validate_networks() for [('76d7ff3f-938e-41a6-a9ed-99362e4cd635', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:58:15.925891 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-df892f3b-c97b-4124-9711-0070fbb0dac4 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:58:15.931523 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-df892f3b-c97b-4124-9711-0070fbb0dac4 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:58:15.931523 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-df892f3b-c97b-4124-9711-0070fbb0dac4 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:58:15.931523 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-df892f3b-c97b-4124-9711-0070fbb0dac4 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:58:15.931523 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-df892f3b-c97b-4124-9711-0070fbb0dac4 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:58:15.940247 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-df892f3b-c97b-4124-9711-0070fbb0dac4 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:58:15.940754 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-df892f3b-c97b-4124-9711-0070fbb0dac4 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:58:15.941185 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-df892f3b-c97b-4124-9711-0070fbb0dac4 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:58:15.941953 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-df892f3b-c97b-4124-9711-0070fbb0dac4 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:58:15.942479 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-df892f3b-c97b-4124-9711-0070fbb0dac4 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:58:15.943125 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-df892f3b-c97b-4124-9711-0070fbb0dac4 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:58:15.963907 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-df892f3b-c97b-4124-9711-0070fbb0dac4 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Getting quotas for project e76b081c02814da98ab62bfc2fe5536b. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:58:15.970497 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-df892f3b-c97b-4124-9711-0070fbb0dac4 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Getting quotas for user d2f253afef5849d19f4e1d99b038697b and project e76b081c02814da98ab62bfc2fe5536b. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:58:15.990321 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-df892f3b-c97b-4124-9711-0070fbb0dac4 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:58:15.992705 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-df892f3b-c97b-4124-9711-0070fbb0dac4 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 881f91d8-34fe-4ae6-a37c-626807802487] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:58:16.168117 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-df892f3b-c97b-4124-9711-0070fbb0dac4 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.294573 Oct 23 01:58:16.175697 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3557/7015] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:58:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 1303 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:58:16.178304 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=28 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:16.186409 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-edf6d30b-ba9b-42bb-ad9f-f6ff6271b6d2 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:58:16.187760 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-edf6d30b-ba9b-42bb-ad9f-f6ff6271b6d2 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 881f91d8-34fe-4ae6-a37c-626807802487] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:58:16.308299 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-edf6d30b-ba9b-42bb-ad9f-f6ff6271b6d2 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f253afef5849d19f4e1d99b038697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76b081c02814da98ab62bfc2fe5536b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:58:16.318103 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-edf6d30b-ba9b-42bb-ad9f-f6ff6271b6d2 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "GET /compute/v2.1/servers/881f91d8-34fe-4ae6-a37c-626807802487" status: 200 len: 1249 microversion: 2.1 time: 0.140665 Oct 23 01:58:16.318978 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3459/7016] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:58:16 2022] GET /compute/v2.1/servers/881f91d8-34fe-4ae6-a37c-626807802487 => generated 1249 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 01:58:17.347754 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-da32a9a5-8c0c-4dcc-be0b-4d74344d8452 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:58:17.349477 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-da32a9a5-8c0c-4dcc-be0b-4d74344d8452 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 881f91d8-34fe-4ae6-a37c-626807802487] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:58:17.416067 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-da32a9a5-8c0c-4dcc-be0b-4d74344d8452 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f253afef5849d19f4e1d99b038697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76b081c02814da98ab62bfc2fe5536b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:58:17.432625 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-da32a9a5-8c0c-4dcc-be0b-4d74344d8452 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "GET /compute/v2.1/servers/881f91d8-34fe-4ae6-a37c-626807802487" status: 200 len: 1249 microversion: 2.1 time: 0.083084 Oct 23 01:58:17.432625 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3558/7017] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:58:17 2022] GET /compute/v2.1/servers/881f91d8-34fe-4ae6-a37c-626807802487 => generated 1249 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:58:18.461708 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9a58f114-a9f8-49bc-ac91-e8128d16a759 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:58:18.463251 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9a58f114-a9f8-49bc-ac91-e8128d16a759 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 881f91d8-34fe-4ae6-a37c-626807802487] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:58:18.497410 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a58f114-a9f8-49bc-ac91-e8128d16a759 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:58:18.498627 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a58f114-a9f8-49bc-ac91-e8128d16a759 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:58:18.499426 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a58f114-a9f8-49bc-ac91-e8128d16a759 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:58:18.500320 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a58f114-a9f8-49bc-ac91-e8128d16a759 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:58:18.503371 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a58f114-a9f8-49bc-ac91-e8128d16a759 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:58:18.503371 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a58f114-a9f8-49bc-ac91-e8128d16a759 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:58:18.610723 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9a58f114-a9f8-49bc-ac91-e8128d16a759 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f253afef5849d19f4e1d99b038697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76b081c02814da98ab62bfc2fe5536b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:58:18.633156 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9a58f114-a9f8-49bc-ac91-e8128d16a759 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "GET /compute/v2.1/servers/881f91d8-34fe-4ae6-a37c-626807802487" status: 200 len: 1301 microversion: 2.1 time: 0.185209 Oct 23 01:58:18.634033 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3460/7018] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:58:18 2022] GET /compute/v2.1/servers/881f91d8-34fe-4ae6-a37c-626807802487 => generated 1301 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:58:19.656955 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-eda7c1c8-d7f4-41d2-8f30-cc0d36621499 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:58:19.658418 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-eda7c1c8-d7f4-41d2-8f30-cc0d36621499 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 881f91d8-34fe-4ae6-a37c-626807802487] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:58:19.677927 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eda7c1c8-d7f4-41d2-8f30-cc0d36621499 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:58:19.678853 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eda7c1c8-d7f4-41d2-8f30-cc0d36621499 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:58:19.680719 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eda7c1c8-d7f4-41d2-8f30-cc0d36621499 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:58:19.681701 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eda7c1c8-d7f4-41d2-8f30-cc0d36621499 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:58:19.687406 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eda7c1c8-d7f4-41d2-8f30-cc0d36621499 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:58:19.688086 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eda7c1c8-d7f4-41d2-8f30-cc0d36621499 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:58:19.830629 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-eda7c1c8-d7f4-41d2-8f30-cc0d36621499 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f253afef5849d19f4e1d99b038697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76b081c02814da98ab62bfc2fe5536b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:58:19.843091 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-eda7c1c8-d7f4-41d2-8f30-cc0d36621499 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "GET /compute/v2.1/servers/881f91d8-34fe-4ae6-a37c-626807802487" status: 200 len: 1319 microversion: 2.1 time: 0.188583 Oct 23 01:58:19.843091 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3559/7019] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:58:19 2022] GET /compute/v2.1/servers/881f91d8-34fe-4ae6-a37c-626807802487 => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:58:20.868060 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0a59cdf2-60b8-49c9-9b76-b31ab44338e1 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:58:20.868945 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0a59cdf2-60b8-49c9-9b76-b31ab44338e1 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 881f91d8-34fe-4ae6-a37c-626807802487] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:58:20.882118 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0a59cdf2-60b8-49c9-9b76-b31ab44338e1 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:58:20.883908 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0a59cdf2-60b8-49c9-9b76-b31ab44338e1 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:58:20.905682 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0a59cdf2-60b8-49c9-9b76-b31ab44338e1 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:58:20.906982 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0a59cdf2-60b8-49c9-9b76-b31ab44338e1 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:58:20.907548 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0a59cdf2-60b8-49c9-9b76-b31ab44338e1 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:58:20.908207 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0a59cdf2-60b8-49c9-9b76-b31ab44338e1 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:58:21.282333 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0a59cdf2-60b8-49c9-9b76-b31ab44338e1 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f253afef5849d19f4e1d99b038697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76b081c02814da98ab62bfc2fe5536b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:58:21.306635 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0a59cdf2-60b8-49c9-9b76-b31ab44338e1 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "GET /compute/v2.1/servers/881f91d8-34fe-4ae6-a37c-626807802487" status: 200 len: 1375 microversion: 2.1 time: 0.442493 Oct 23 01:58:21.321540 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3461/7020] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:58:20 2022] GET /compute/v2.1/servers/881f91d8-34fe-4ae6-a37c-626807802487 => generated 1375 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:58:21.837150 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-abbec471-bda6-4512-b1b4-19564bdcea99 req-9bebfd97-2022-45f2-b8cd-314a4c63c9ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "881f91d8-34fe-4ae6-a37c-626807802487", "tag": "f6b66c6b-99dd-48c6-9e3a-704cbe9ba4b7"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:58:21.857649 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-abbec471-bda6-4512-b1b4-19564bdcea99 req-9bebfd97-2022-45f2-b8cd-314a4c63c9ad service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:58:21.863441 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-abbec471-bda6-4512-b1b4-19564bdcea99 req-9bebfd97-2022-45f2-b8cd-314a4c63c9ad service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:58:21.865090 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-abbec471-bda6-4512-b1b4-19564bdcea99 req-9bebfd97-2022-45f2-b8cd-314a4c63c9ad service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:58:21.887369 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-abbec471-bda6-4512-b1b4-19564bdcea99 req-9bebfd97-2022-45f2-b8cd-314a4c63c9ad service nova] Creating event network-changed:f6b66c6b-99dd-48c6-9e3a-704cbe9ba4b7 for instance 881f91d8-34fe-4ae6-a37c-626807802487 on n-h2-master-1 Oct 23 01:58:21.893787 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-abbec471-bda6-4512-b1b4-19564bdcea99 req-9bebfd97-2022-45f2-b8cd-314a4c63c9ad service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061203 Oct 23 01:58:21.895848 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3560/7021] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:58:22.334423 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-40368637-5925-4243-9ee4-81e13cba1f98 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:58:22.336535 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-40368637-5925-4243-9ee4-81e13cba1f98 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 881f91d8-34fe-4ae6-a37c-626807802487] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:58:22.347326 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-40368637-5925-4243-9ee4-81e13cba1f98 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:58:22.347888 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-40368637-5925-4243-9ee4-81e13cba1f98 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:58:22.348508 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-40368637-5925-4243-9ee4-81e13cba1f98 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:58:22.351766 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-40368637-5925-4243-9ee4-81e13cba1f98 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:58:22.353515 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-40368637-5925-4243-9ee4-81e13cba1f98 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:58:22.354938 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-40368637-5925-4243-9ee4-81e13cba1f98 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:58:22.691015 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-40368637-5925-4243-9ee4-81e13cba1f98 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f253afef5849d19f4e1d99b038697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76b081c02814da98ab62bfc2fe5536b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:58:22.711230 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-40368637-5925-4243-9ee4-81e13cba1f98 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "GET /compute/v2.1/servers/881f91d8-34fe-4ae6-a37c-626807802487" status: 200 len: 1375 microversion: 2.1 time: 0.376719 Oct 23 01:58:22.725988 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3462/7022] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:58:22 2022] GET /compute/v2.1/servers/881f91d8-34fe-4ae6-a37c-626807802487 => generated 1375 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:58:23.731530 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6e555653-be41-499a-b74b-9c988af53d7f tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:58:23.732842 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6e555653-be41-499a-b74b-9c988af53d7f tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 881f91d8-34fe-4ae6-a37c-626807802487] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:58:23.743714 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6e555653-be41-499a-b74b-9c988af53d7f tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:58:23.746773 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6e555653-be41-499a-b74b-9c988af53d7f tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:58:23.749351 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6e555653-be41-499a-b74b-9c988af53d7f tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:58:23.750687 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6e555653-be41-499a-b74b-9c988af53d7f tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:58:23.751347 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6e555653-be41-499a-b74b-9c988af53d7f tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:58:23.751795 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6e555653-be41-499a-b74b-9c988af53d7f tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:58:23.937909 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6e555653-be41-499a-b74b-9c988af53d7f tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f253afef5849d19f4e1d99b038697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76b081c02814da98ab62bfc2fe5536b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:58:23.953547 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6e555653-be41-499a-b74b-9c988af53d7f tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "GET /compute/v2.1/servers/881f91d8-34fe-4ae6-a37c-626807802487" status: 200 len: 1375 microversion: 2.1 time: 0.228210 Oct 23 01:58:23.969149 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3561/7023] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:58:23 2022] GET /compute/v2.1/servers/881f91d8-34fe-4ae6-a37c-626807802487 => generated 1375 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:58:24.983622 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f4c2afa2-06ba-4c55-8512-e80d3ea534f7 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:58:24.986149 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f4c2afa2-06ba-4c55-8512-e80d3ea534f7 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 881f91d8-34fe-4ae6-a37c-626807802487] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:58:24.998595 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f4c2afa2-06ba-4c55-8512-e80d3ea534f7 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:58:24.999472 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f4c2afa2-06ba-4c55-8512-e80d3ea534f7 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:58:24.999941 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f4c2afa2-06ba-4c55-8512-e80d3ea534f7 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:58:25.000670 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f4c2afa2-06ba-4c55-8512-e80d3ea534f7 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:58:25.001151 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f4c2afa2-06ba-4c55-8512-e80d3ea534f7 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:58:25.001775 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f4c2afa2-06ba-4c55-8512-e80d3ea534f7 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:58:25.166695 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f4c2afa2-06ba-4c55-8512-e80d3ea534f7 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f253afef5849d19f4e1d99b038697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76b081c02814da98ab62bfc2fe5536b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:58:25.174999 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f4c2afa2-06ba-4c55-8512-e80d3ea534f7 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "GET /compute/v2.1/servers/881f91d8-34fe-4ae6-a37c-626807802487" status: 200 len: 1375 microversion: 2.1 time: 0.195196 Oct 23 01:58:25.175830 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3463/7024] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:58:24 2022] GET /compute/v2.1/servers/881f91d8-34fe-4ae6-a37c-626807802487 => generated 1375 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:58:26.201512 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4b803fb9-3916-4d45-9ced-289c91297361 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:58:26.203958 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4b803fb9-3916-4d45-9ced-289c91297361 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 881f91d8-34fe-4ae6-a37c-626807802487] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:58:26.208821 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:26.212792 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4b803fb9-3916-4d45-9ced-289c91297361 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:58:26.213630 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4b803fb9-3916-4d45-9ced-289c91297361 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:58:26.214098 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4b803fb9-3916-4d45-9ced-289c91297361 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:58:26.214886 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4b803fb9-3916-4d45-9ced-289c91297361 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:58:26.215421 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4b803fb9-3916-4d45-9ced-289c91297361 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:58:26.215984 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4b803fb9-3916-4d45-9ced-289c91297361 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:58:26.390620 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4b803fb9-3916-4d45-9ced-289c91297361 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f253afef5849d19f4e1d99b038697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76b081c02814da98ab62bfc2fe5536b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:58:26.419186 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4b803fb9-3916-4d45-9ced-289c91297361 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "GET /compute/v2.1/servers/881f91d8-34fe-4ae6-a37c-626807802487" status: 200 len: 1375 microversion: 2.1 time: 0.221965 Oct 23 01:58:26.431305 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3562/7025] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:58:26 2022] GET /compute/v2.1/servers/881f91d8-34fe-4ae6-a37c-626807802487 => generated 1375 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:58:26.954527 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-39409932-65c9-43d4-8244-cca1f9658302 req-6b9eeac4-171f-42b9-944b-2ec5845f27f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "881f91d8-34fe-4ae6-a37c-626807802487", "name": "network-vif-plugged", "status": "completed", "tag": "f6b66c6b-99dd-48c6-9e3a-704cbe9ba4b7"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:58:26.965105 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=6 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:26.970537 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-39409932-65c9-43d4-8244-cca1f9658302 req-6b9eeac4-171f-42b9-944b-2ec5845f27f4 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:58:26.971045 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-39409932-65c9-43d4-8244-cca1f9658302 req-6b9eeac4-171f-42b9-944b-2ec5845f27f4 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:58:26.975663 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-39409932-65c9-43d4-8244-cca1f9658302 req-6b9eeac4-171f-42b9-944b-2ec5845f27f4 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:58:26.987133 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-39409932-65c9-43d4-8244-cca1f9658302 req-6b9eeac4-171f-42b9-944b-2ec5845f27f4 service nova] Creating event network-vif-plugged:f6b66c6b-99dd-48c6-9e3a-704cbe9ba4b7 for instance 881f91d8-34fe-4ae6-a37c-626807802487 on n-h2-master-1 Oct 23 01:58:26.993264 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-39409932-65c9-43d4-8244-cca1f9658302 req-6b9eeac4-171f-42b9-944b-2ec5845f27f4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043865 Oct 23 01:58:26.994058 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3464/7026] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:58:27.442811 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9fc8bb36-72a9-47fd-bd95-aa30889eb97b tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:58:27.443485 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9fc8bb36-72a9-47fd-bd95-aa30889eb97b tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 881f91d8-34fe-4ae6-a37c-626807802487] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:58:27.447403 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=8 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:27.448057 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:27.453252 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9fc8bb36-72a9-47fd-bd95-aa30889eb97b tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:58:27.453252 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9fc8bb36-72a9-47fd-bd95-aa30889eb97b tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:58:27.453252 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9fc8bb36-72a9-47fd-bd95-aa30889eb97b tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:58:27.453539 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9fc8bb36-72a9-47fd-bd95-aa30889eb97b tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:58:27.453807 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9fc8bb36-72a9-47fd-bd95-aa30889eb97b tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:58:27.454284 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9fc8bb36-72a9-47fd-bd95-aa30889eb97b tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:58:27.595366 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9fc8bb36-72a9-47fd-bd95-aa30889eb97b tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f253afef5849d19f4e1d99b038697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76b081c02814da98ab62bfc2fe5536b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:58:27.612140 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9fc8bb36-72a9-47fd-bd95-aa30889eb97b tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "GET /compute/v2.1/servers/881f91d8-34fe-4ae6-a37c-626807802487" status: 200 len: 1375 microversion: 2.1 time: 0.172983 Oct 23 01:58:27.612963 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3563/7027] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:58:27 2022] GET /compute/v2.1/servers/881f91d8-34fe-4ae6-a37c-626807802487 => generated 1375 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:58:28.637862 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-50b34c7c-8ac7-42f8-89dd-e47ab61735a4 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:58:28.638622 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-50b34c7c-8ac7-42f8-89dd-e47ab61735a4 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 881f91d8-34fe-4ae6-a37c-626807802487] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:58:28.641567 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:28.647976 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-50b34c7c-8ac7-42f8-89dd-e47ab61735a4 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:58:28.648494 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-50b34c7c-8ac7-42f8-89dd-e47ab61735a4 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:58:28.648951 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-50b34c7c-8ac7-42f8-89dd-e47ab61735a4 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:58:28.649672 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-50b34c7c-8ac7-42f8-89dd-e47ab61735a4 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:58:28.650179 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-50b34c7c-8ac7-42f8-89dd-e47ab61735a4 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:58:28.650629 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-50b34c7c-8ac7-42f8-89dd-e47ab61735a4 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:58:28.793596 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-50b34c7c-8ac7-42f8-89dd-e47ab61735a4 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f253afef5849d19f4e1d99b038697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76b081c02814da98ab62bfc2fe5536b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:58:28.803037 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-50b34c7c-8ac7-42f8-89dd-e47ab61735a4 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "GET /compute/v2.1/servers/881f91d8-34fe-4ae6-a37c-626807802487" status: 200 len: 1546 microversion: 2.1 time: 0.169892 Oct 23 01:58:28.803610 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3465/7028] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:58:28 2022] GET /compute/v2.1/servers/881f91d8-34fe-4ae6-a37c-626807802487 => generated 1546 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:58:28.825875 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-05cab651-8f0c-4dc8-b0dc-26fc0b63fa3c tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:58:28.826522 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-05cab651-8f0c-4dc8-b0dc-26fc0b63fa3c tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 881f91d8-34fe-4ae6-a37c-626807802487] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:58:28.834789 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-05cab651-8f0c-4dc8-b0dc-26fc0b63fa3c tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:58:28.837616 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-05cab651-8f0c-4dc8-b0dc-26fc0b63fa3c tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:58:28.837616 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-05cab651-8f0c-4dc8-b0dc-26fc0b63fa3c tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:58:28.837616 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-05cab651-8f0c-4dc8-b0dc-26fc0b63fa3c tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:58:28.837616 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-05cab651-8f0c-4dc8-b0dc-26fc0b63fa3c tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:58:28.837616 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-05cab651-8f0c-4dc8-b0dc-26fc0b63fa3c tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:58:28.980185 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-05cab651-8f0c-4dc8-b0dc-26fc0b63fa3c tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f253afef5849d19f4e1d99b038697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76b081c02814da98ab62bfc2fe5536b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:58:28.988172 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-05cab651-8f0c-4dc8-b0dc-26fc0b63fa3c tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "GET /compute/v2.1/servers/881f91d8-34fe-4ae6-a37c-626807802487" status: 200 len: 1546 microversion: 2.1 time: 0.166152 Oct 23 01:58:28.988795 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3564/7029] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:58:28 2022] GET /compute/v2.1/servers/881f91d8-34fe-4ae6-a37c-626807802487 => generated 1546 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:58:31.202821 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-6b89896b-06cf-40ef-8782-01fe610393ba req-fe953f06-2a4f-474e-ba8b-29fcff65b724 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "881f91d8-34fe-4ae6-a37c-626807802487", "tag": "f6b66c6b-99dd-48c6-9e3a-704cbe9ba4b7"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:58:31.215854 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-6b89896b-06cf-40ef-8782-01fe610393ba req-fe953f06-2a4f-474e-ba8b-29fcff65b724 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:58:31.216366 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-6b89896b-06cf-40ef-8782-01fe610393ba req-fe953f06-2a4f-474e-ba8b-29fcff65b724 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:58:31.216820 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-6b89896b-06cf-40ef-8782-01fe610393ba req-fe953f06-2a4f-474e-ba8b-29fcff65b724 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:58:31.228966 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-6b89896b-06cf-40ef-8782-01fe610393ba req-fe953f06-2a4f-474e-ba8b-29fcff65b724 service nova] Creating event network-changed:f6b66c6b-99dd-48c6-9e3a-704cbe9ba4b7 for instance 881f91d8-34fe-4ae6-a37c-626807802487 on n-h2-master-1 Oct 23 01:58:31.235495 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-6b89896b-06cf-40ef-8782-01fe610393ba req-fe953f06-2a4f-474e-ba8b-29fcff65b724 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036934 Oct 23 01:58:31.236888 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3466/7030] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:58:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:58:54.437306 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b417eea8-3ca4-4997-9bc7-3fa474b165d8 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:58:54.439589 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b417eea8-3ca4-4997-9bc7-3fa474b165d8 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 881f91d8-34fe-4ae6-a37c-626807802487] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:58:54.442335 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=34 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:54.447960 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b417eea8-3ca4-4997-9bc7-3fa474b165d8 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:58:54.448450 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b417eea8-3ca4-4997-9bc7-3fa474b165d8 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:58:54.448892 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b417eea8-3ca4-4997-9bc7-3fa474b165d8 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:58:54.449586 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b417eea8-3ca4-4997-9bc7-3fa474b165d8 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:58:54.450071 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b417eea8-3ca4-4997-9bc7-3fa474b165d8 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:58:54.450507 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b417eea8-3ca4-4997-9bc7-3fa474b165d8 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:58:54.524192 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b417eea8-3ca4-4997-9bc7-3fa474b165d8 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "POST /compute/v2.1/servers/881f91d8-34fe-4ae6-a37c-626807802487/action" status: 200 len: 24576 microversion: 2.1 time: 0.091434 Oct 23 01:58:54.525446 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3565/7031] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 01:58:54 2022] POST /compute/v2.1/servers/881f91d8-34fe-4ae6-a37c-626807802487/action => generated 24576 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 01:59:10.680931 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-dc5f82dd-5f7f-4ad4-81a5-aa033f5e9a08 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Action: 'create', calling method: .version_select at 0x7f5cc03df280>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-348979094", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEdR+7DhOfRBgs59HrGAr0mEvXlxL7FiICUeMYDQrNGH7DmofEwuuO1CQt+xhmTpdeNkGn+TwnJu3qmHhOw8FkXav5QTIFOJWvwOyeb18dHb4Cxj6PTfLq5tqwW5ThkOmQ=="}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:59:10.686505 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=3 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:10.687174 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=34 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:10.699015 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-dc5f82dd-5f7f-4ad4-81a5-aa033f5e9a08 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Getting quotas for project e76b081c02814da98ab62bfc2fe5536b. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:59:10.704508 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-dc5f82dd-5f7f-4ad4-81a5-aa033f5e9a08 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Getting quotas for user d2f253afef5849d19f4e1d99b038697b and project e76b081c02814da98ab62bfc2fe5536b. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:59:10.811530 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-dc5f82dd-5f7f-4ad4-81a5-aa033f5e9a08 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.135243 Oct 23 01:59:10.812147 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3467/7032] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 01:59:10 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:59:13.340777 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1e475efb-9b6c-45f6-a449-48cb43b2a8ee tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-992746674", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "b7ed2c89-f1f3-4f1a-a598-8c1ff625fa3f"}], "key_name": "tempest-TestNetworkBasicOps-348979094", "security_groups": [{"name": "tempest-secgroup-smoke-187154562"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:59:13.350050 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=4 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:13.446872 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-1e475efb-9b6c-45f6-a449-48cb43b2a8ee tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] validate_networks() for [('b7ed2c89-f1f3-4f1a-a598-8c1ff625fa3f', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 01:59:13.820336 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-1e475efb-9b6c-45f6-a449-48cb43b2a8ee tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 01:59:13.820775 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-1e475efb-9b6c-45f6-a449-48cb43b2a8ee tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 01:59:13.821262 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-1e475efb-9b6c-45f6-a449-48cb43b2a8ee tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 01:59:13.821686 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-1e475efb-9b6c-45f6-a449-48cb43b2a8ee tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 01:59:13.822148 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-1e475efb-9b6c-45f6-a449-48cb43b2a8ee tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 01:59:13.831392 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1e475efb-9b6c-45f6-a449-48cb43b2a8ee tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:59:13.831886 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1e475efb-9b6c-45f6-a449-48cb43b2a8ee tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:59:13.832328 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1e475efb-9b6c-45f6-a449-48cb43b2a8ee tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:59:13.833062 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1e475efb-9b6c-45f6-a449-48cb43b2a8ee tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:59:13.833528 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1e475efb-9b6c-45f6-a449-48cb43b2a8ee tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:59:13.833962 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1e475efb-9b6c-45f6-a449-48cb43b2a8ee tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:59:13.851960 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-1e475efb-9b6c-45f6-a449-48cb43b2a8ee tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Getting quotas for project e76b081c02814da98ab62bfc2fe5536b. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 01:59:13.857253 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-1e475efb-9b6c-45f6-a449-48cb43b2a8ee tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Getting quotas for user d2f253afef5849d19f4e1d99b038697b and project e76b081c02814da98ab62bfc2fe5536b. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 01:59:13.870296 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1e475efb-9b6c-45f6-a449-48cb43b2a8ee tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 01:59:13.872681 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1e475efb-9b6c-45f6-a449-48cb43b2a8ee tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 23832873-3cc5-4dec-b844-37988383a7dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 01:59:13.989519 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1e475efb-9b6c-45f6-a449-48cb43b2a8ee tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.653449 Oct 23 01:59:13.992642 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3566/7033] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:59:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 01:59:14.003368 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6bb9388b-6c2a-4674-b350-55daff34676a tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:59:14.004138 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6bb9388b-6c2a-4674-b350-55daff34676a tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 23832873-3cc5-4dec-b844-37988383a7dd] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:59:14.060152 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6bb9388b-6c2a-4674-b350-55daff34676a tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f253afef5849d19f4e1d99b038697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76b081c02814da98ab62bfc2fe5536b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:59:14.067868 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6bb9388b-6c2a-4674-b350-55daff34676a tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "GET /compute/v2.1/servers/23832873-3cc5-4dec-b844-37988383a7dd" status: 200 len: 1247 microversion: 2.1 time: 0.069895 Oct 23 01:59:14.068448 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3468/7034] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:59:13 2022] GET /compute/v2.1/servers/23832873-3cc5-4dec-b844-37988383a7dd => generated 1247 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:59:15.091602 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-823e64d1-a7ed-4dab-b9ea-e3cb09d55366 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:59:15.092222 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-823e64d1-a7ed-4dab-b9ea-e3cb09d55366 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 23832873-3cc5-4dec-b844-37988383a7dd] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:59:15.099332 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-823e64d1-a7ed-4dab-b9ea-e3cb09d55366 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:59:15.099830 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-823e64d1-a7ed-4dab-b9ea-e3cb09d55366 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:59:15.101671 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-823e64d1-a7ed-4dab-b9ea-e3cb09d55366 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:59:15.101671 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-823e64d1-a7ed-4dab-b9ea-e3cb09d55366 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:59:15.101671 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-823e64d1-a7ed-4dab-b9ea-e3cb09d55366 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:59:15.101916 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-823e64d1-a7ed-4dab-b9ea-e3cb09d55366 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:59:15.167943 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-823e64d1-a7ed-4dab-b9ea-e3cb09d55366 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f253afef5849d19f4e1d99b038697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76b081c02814da98ab62bfc2fe5536b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:59:15.176265 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-823e64d1-a7ed-4dab-b9ea-e3cb09d55366 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "GET /compute/v2.1/servers/23832873-3cc5-4dec-b844-37988383a7dd" status: 200 len: 1251 microversion: 2.1 time: 0.089137 Oct 23 01:59:15.176899 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3567/7035] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:59:15 2022] GET /compute/v2.1/servers/23832873-3cc5-4dec-b844-37988383a7dd => generated 1251 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:59:16.199747 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0ca719de-0144-4569-bb05-676352e96149 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:59:16.201258 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0ca719de-0144-4569-bb05-676352e96149 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 23832873-3cc5-4dec-b844-37988383a7dd] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:59:16.209214 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0ca719de-0144-4569-bb05-676352e96149 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:59:16.209719 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0ca719de-0144-4569-bb05-676352e96149 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:59:16.210195 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0ca719de-0144-4569-bb05-676352e96149 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:59:16.210908 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0ca719de-0144-4569-bb05-676352e96149 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:59:16.211375 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0ca719de-0144-4569-bb05-676352e96149 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:59:16.211812 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0ca719de-0144-4569-bb05-676352e96149 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:59:16.274680 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0ca719de-0144-4569-bb05-676352e96149 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f253afef5849d19f4e1d99b038697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76b081c02814da98ab62bfc2fe5536b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:59:16.283307 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0ca719de-0144-4569-bb05-676352e96149 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "GET /compute/v2.1/servers/23832873-3cc5-4dec-b844-37988383a7dd" status: 200 len: 1307 microversion: 2.1 time: 0.087516 Oct 23 01:59:16.283960 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3469/7036] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:59:16 2022] GET /compute/v2.1/servers/23832873-3cc5-4dec-b844-37988383a7dd => generated 1307 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:59:17.307608 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-280626b4-7cff-42e6-a089-07091a0a3c29 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:59:17.308233 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-280626b4-7cff-42e6-a089-07091a0a3c29 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 23832873-3cc5-4dec-b844-37988383a7dd] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:59:17.314925 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-280626b4-7cff-42e6-a089-07091a0a3c29 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:59:17.315416 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-280626b4-7cff-42e6-a089-07091a0a3c29 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:59:17.315862 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-280626b4-7cff-42e6-a089-07091a0a3c29 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:59:17.317142 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-280626b4-7cff-42e6-a089-07091a0a3c29 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:59:17.317645 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-280626b4-7cff-42e6-a089-07091a0a3c29 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:59:17.318093 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-280626b4-7cff-42e6-a089-07091a0a3c29 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:59:17.450567 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-280626b4-7cff-42e6-a089-07091a0a3c29 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f253afef5849d19f4e1d99b038697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76b081c02814da98ab62bfc2fe5536b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:59:17.458633 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-280626b4-7cff-42e6-a089-07091a0a3c29 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "GET /compute/v2.1/servers/23832873-3cc5-4dec-b844-37988383a7dd" status: 200 len: 1372 microversion: 2.1 time: 0.155002 Oct 23 01:59:17.459324 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3568/7037] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:59:17 2022] GET /compute/v2.1/servers/23832873-3cc5-4dec-b844-37988383a7dd => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:59:18.108739 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-17453546-3f42-4738-9455-feaf612e7481 req-ee00ce1c-bb4e-4291-87d2-114fc54443c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23832873-3cc5-4dec-b844-37988383a7dd", "tag": "1cc65afc-0cac-4db0-8777-a2be6cc5b953"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:59:18.118353 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-17453546-3f42-4738-9455-feaf612e7481 req-ee00ce1c-bb4e-4291-87d2-114fc54443c2 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:59:18.119379 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-17453546-3f42-4738-9455-feaf612e7481 req-ee00ce1c-bb4e-4291-87d2-114fc54443c2 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:59:18.119379 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-17453546-3f42-4738-9455-feaf612e7481 req-ee00ce1c-bb4e-4291-87d2-114fc54443c2 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:59:18.129936 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-17453546-3f42-4738-9455-feaf612e7481 req-ee00ce1c-bb4e-4291-87d2-114fc54443c2 service nova] Creating event network-changed:1cc65afc-0cac-4db0-8777-a2be6cc5b953 for instance 23832873-3cc5-4dec-b844-37988383a7dd on n-h1-master-1 Oct 23 01:59:18.134978 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-17453546-3f42-4738-9455-feaf612e7481 req-ee00ce1c-bb4e-4291-87d2-114fc54443c2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164599 Oct 23 01:59:18.135587 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3470/7038] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:59:18.482780 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e3ac06f1-1311-4115-93b5-5411fd3ba483 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:59:18.483408 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e3ac06f1-1311-4115-93b5-5411fd3ba483 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 23832873-3cc5-4dec-b844-37988383a7dd] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:59:18.490373 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e3ac06f1-1311-4115-93b5-5411fd3ba483 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:59:18.491005 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e3ac06f1-1311-4115-93b5-5411fd3ba483 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:59:18.491387 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e3ac06f1-1311-4115-93b5-5411fd3ba483 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:59:18.492096 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e3ac06f1-1311-4115-93b5-5411fd3ba483 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:59:18.492541 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e3ac06f1-1311-4115-93b5-5411fd3ba483 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:59:18.492969 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e3ac06f1-1311-4115-93b5-5411fd3ba483 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:59:18.627047 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e3ac06f1-1311-4115-93b5-5411fd3ba483 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f253afef5849d19f4e1d99b038697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76b081c02814da98ab62bfc2fe5536b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:59:18.635350 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e3ac06f1-1311-4115-93b5-5411fd3ba483 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "GET /compute/v2.1/servers/23832873-3cc5-4dec-b844-37988383a7dd" status: 200 len: 1372 microversion: 2.1 time: 0.156553 Oct 23 01:59:18.635931 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3569/7039] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:59:18 2022] GET /compute/v2.1/servers/23832873-3cc5-4dec-b844-37988383a7dd => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:59:19.660849 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c56255eb-5ed3-4b0a-a0b9-8954f72ad540 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:59:19.661565 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c56255eb-5ed3-4b0a-a0b9-8954f72ad540 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 23832873-3cc5-4dec-b844-37988383a7dd] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:59:19.668128 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c56255eb-5ed3-4b0a-a0b9-8954f72ad540 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:59:19.668630 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c56255eb-5ed3-4b0a-a0b9-8954f72ad540 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:59:19.669158 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c56255eb-5ed3-4b0a-a0b9-8954f72ad540 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:59:19.669948 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c56255eb-5ed3-4b0a-a0b9-8954f72ad540 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:59:19.670369 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c56255eb-5ed3-4b0a-a0b9-8954f72ad540 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:59:19.671124 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c56255eb-5ed3-4b0a-a0b9-8954f72ad540 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:59:19.805727 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c56255eb-5ed3-4b0a-a0b9-8954f72ad540 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f253afef5849d19f4e1d99b038697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76b081c02814da98ab62bfc2fe5536b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:59:19.813505 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c56255eb-5ed3-4b0a-a0b9-8954f72ad540 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "GET /compute/v2.1/servers/23832873-3cc5-4dec-b844-37988383a7dd" status: 200 len: 1372 microversion: 2.1 time: 0.158395 Oct 23 01:59:19.814099 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3471/7040] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:59:19 2022] GET /compute/v2.1/servers/23832873-3cc5-4dec-b844-37988383a7dd => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:59:20.837025 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-615992b8-f8e0-4868-8cb5-a135850a2d37 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:59:20.837642 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-615992b8-f8e0-4868-8cb5-a135850a2d37 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 23832873-3cc5-4dec-b844-37988383a7dd] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:59:20.844587 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-615992b8-f8e0-4868-8cb5-a135850a2d37 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:59:20.845008 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-615992b8-f8e0-4868-8cb5-a135850a2d37 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:59:20.845445 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-615992b8-f8e0-4868-8cb5-a135850a2d37 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:59:20.846179 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-615992b8-f8e0-4868-8cb5-a135850a2d37 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:59:20.846636 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-615992b8-f8e0-4868-8cb5-a135850a2d37 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:59:20.847060 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-615992b8-f8e0-4868-8cb5-a135850a2d37 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:59:20.981924 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-615992b8-f8e0-4868-8cb5-a135850a2d37 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f253afef5849d19f4e1d99b038697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76b081c02814da98ab62bfc2fe5536b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:59:20.989993 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-615992b8-f8e0-4868-8cb5-a135850a2d37 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "GET /compute/v2.1/servers/23832873-3cc5-4dec-b844-37988383a7dd" status: 200 len: 1372 microversion: 2.1 time: 0.157074 Oct 23 01:59:20.990593 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3570/7041] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:59:20 2022] GET /compute/v2.1/servers/23832873-3cc5-4dec-b844-37988383a7dd => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:59:22.013150 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-44ca955a-1bdd-48f3-89df-ccce9ce76240 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:59:22.013826 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-44ca955a-1bdd-48f3-89df-ccce9ce76240 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 23832873-3cc5-4dec-b844-37988383a7dd] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:59:22.021098 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44ca955a-1bdd-48f3-89df-ccce9ce76240 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:59:22.021604 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44ca955a-1bdd-48f3-89df-ccce9ce76240 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:59:22.022089 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44ca955a-1bdd-48f3-89df-ccce9ce76240 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:59:22.022810 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44ca955a-1bdd-48f3-89df-ccce9ce76240 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:59:22.023282 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44ca955a-1bdd-48f3-89df-ccce9ce76240 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:59:22.023721 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44ca955a-1bdd-48f3-89df-ccce9ce76240 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:59:22.163493 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-44ca955a-1bdd-48f3-89df-ccce9ce76240 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f253afef5849d19f4e1d99b038697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76b081c02814da98ab62bfc2fe5536b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:59:22.171344 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-44ca955a-1bdd-48f3-89df-ccce9ce76240 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "GET /compute/v2.1/servers/23832873-3cc5-4dec-b844-37988383a7dd" status: 200 len: 1372 microversion: 2.1 time: 0.162400 Oct 23 01:59:22.171935 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3472/7042] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:59:22 2022] GET /compute/v2.1/servers/23832873-3cc5-4dec-b844-37988383a7dd => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:59:22.989638 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-25821942-cdd9-4da8-a7fe-915bfe62b2ad req-5fee74ee-ab99-4f6a-a801-0b6243a6fd3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23832873-3cc5-4dec-b844-37988383a7dd", "name": "network-vif-plugged", "status": "completed", "tag": "1cc65afc-0cac-4db0-8777-a2be6cc5b953"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:59:23.001939 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-25821942-cdd9-4da8-a7fe-915bfe62b2ad req-5fee74ee-ab99-4f6a-a801-0b6243a6fd3a service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:59:23.001939 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-25821942-cdd9-4da8-a7fe-915bfe62b2ad req-5fee74ee-ab99-4f6a-a801-0b6243a6fd3a service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:59:23.001939 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-25821942-cdd9-4da8-a7fe-915bfe62b2ad req-5fee74ee-ab99-4f6a-a801-0b6243a6fd3a service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:59:23.013130 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-25821942-cdd9-4da8-a7fe-915bfe62b2ad req-5fee74ee-ab99-4f6a-a801-0b6243a6fd3a service nova] Creating event network-vif-plugged:1cc65afc-0cac-4db0-8777-a2be6cc5b953 for instance 23832873-3cc5-4dec-b844-37988383a7dd on n-h1-master-1 Oct 23 01:59:23.018255 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-25821942-cdd9-4da8-a7fe-915bfe62b2ad req-5fee74ee-ab99-4f6a-a801-0b6243a6fd3a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032355 Oct 23 01:59:23.018840 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3571/7043] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:59:23.196151 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-306f3a41-f798-4a44-90e6-62b0e43ce06d tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:59:23.196883 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-306f3a41-f798-4a44-90e6-62b0e43ce06d tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 23832873-3cc5-4dec-b844-37988383a7dd] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:59:23.204449 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-306f3a41-f798-4a44-90e6-62b0e43ce06d tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:59:23.205081 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-306f3a41-f798-4a44-90e6-62b0e43ce06d tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:59:23.205428 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-306f3a41-f798-4a44-90e6-62b0e43ce06d tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:59:23.206302 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-306f3a41-f798-4a44-90e6-62b0e43ce06d tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:59:23.206687 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-306f3a41-f798-4a44-90e6-62b0e43ce06d tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:59:23.207134 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-306f3a41-f798-4a44-90e6-62b0e43ce06d tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:59:23.342931 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-306f3a41-f798-4a44-90e6-62b0e43ce06d tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f253afef5849d19f4e1d99b038697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76b081c02814da98ab62bfc2fe5536b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:59:23.350649 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-306f3a41-f798-4a44-90e6-62b0e43ce06d tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "GET /compute/v2.1/servers/23832873-3cc5-4dec-b844-37988383a7dd" status: 200 len: 1372 microversion: 2.1 time: 0.158603 Oct 23 01:59:23.351226 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3473/7044] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:59:23 2022] GET /compute/v2.1/servers/23832873-3cc5-4dec-b844-37988383a7dd => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:59:24.371286 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:24.372101 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=6 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:24.377021 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a663da42-4ca1-4fa9-b8ae-a451351bc8b1 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:59:24.377747 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a663da42-4ca1-4fa9-b8ae-a451351bc8b1 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 23832873-3cc5-4dec-b844-37988383a7dd] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:59:24.385726 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a663da42-4ca1-4fa9-b8ae-a451351bc8b1 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:59:24.386253 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a663da42-4ca1-4fa9-b8ae-a451351bc8b1 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:59:24.386695 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a663da42-4ca1-4fa9-b8ae-a451351bc8b1 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:59:24.387413 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a663da42-4ca1-4fa9-b8ae-a451351bc8b1 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:59:24.387874 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a663da42-4ca1-4fa9-b8ae-a451351bc8b1 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:59:24.388309 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a663da42-4ca1-4fa9-b8ae-a451351bc8b1 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:59:24.534127 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a663da42-4ca1-4fa9-b8ae-a451351bc8b1 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f253afef5849d19f4e1d99b038697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76b081c02814da98ab62bfc2fe5536b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:59:24.542346 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a663da42-4ca1-4fa9-b8ae-a451351bc8b1 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "GET /compute/v2.1/servers/23832873-3cc5-4dec-b844-37988383a7dd" status: 200 len: 1372 microversion: 2.1 time: 0.171933 Oct 23 01:59:24.543151 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3572/7045] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:59:24 2022] GET /compute/v2.1/servers/23832873-3cc5-4dec-b844-37988383a7dd => generated 1372 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:59:25.564765 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9b693ff7-809c-40db-8068-325f4cdf4ed4 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:59:25.565405 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9b693ff7-809c-40db-8068-325f4cdf4ed4 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 23832873-3cc5-4dec-b844-37988383a7dd] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:59:25.568071 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=6 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:25.573664 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b693ff7-809c-40db-8068-325f4cdf4ed4 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:59:25.574204 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b693ff7-809c-40db-8068-325f4cdf4ed4 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:59:25.574656 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b693ff7-809c-40db-8068-325f4cdf4ed4 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:59:25.575368 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b693ff7-809c-40db-8068-325f4cdf4ed4 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:59:25.575840 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b693ff7-809c-40db-8068-325f4cdf4ed4 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:59:25.576288 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b693ff7-809c-40db-8068-325f4cdf4ed4 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:59:25.710162 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9b693ff7-809c-40db-8068-325f4cdf4ed4 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f253afef5849d19f4e1d99b038697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76b081c02814da98ab62bfc2fe5536b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:59:25.717928 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9b693ff7-809c-40db-8068-325f4cdf4ed4 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "GET /compute/v2.1/servers/23832873-3cc5-4dec-b844-37988383a7dd" status: 200 len: 1545 microversion: 2.1 time: 0.157124 Oct 23 01:59:25.720235 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3474/7046] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:59:25 2022] GET /compute/v2.1/servers/23832873-3cc5-4dec-b844-37988383a7dd => generated 1545 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:59:25.741110 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5a7a08a3-9ef3-4fa5-8579-ce798b3d231c tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:59:25.741651 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5a7a08a3-9ef3-4fa5-8579-ce798b3d231c tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 23832873-3cc5-4dec-b844-37988383a7dd] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:59:25.748125 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5a7a08a3-9ef3-4fa5-8579-ce798b3d231c tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:59:25.748617 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5a7a08a3-9ef3-4fa5-8579-ce798b3d231c tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:59:25.749057 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5a7a08a3-9ef3-4fa5-8579-ce798b3d231c tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:59:25.749753 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5a7a08a3-9ef3-4fa5-8579-ce798b3d231c tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:59:25.750239 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5a7a08a3-9ef3-4fa5-8579-ce798b3d231c tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:59:25.750669 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5a7a08a3-9ef3-4fa5-8579-ce798b3d231c tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:59:25.883811 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5a7a08a3-9ef3-4fa5-8579-ce798b3d231c tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f253afef5849d19f4e1d99b038697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76b081c02814da98ab62bfc2fe5536b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:59:25.891555 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5a7a08a3-9ef3-4fa5-8579-ce798b3d231c tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "GET /compute/v2.1/servers/23832873-3cc5-4dec-b844-37988383a7dd" status: 200 len: 1545 microversion: 2.1 time: 0.154570 Oct 23 01:59:25.892133 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3573/7047] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:59:25 2022] GET /compute/v2.1/servers/23832873-3cc5-4dec-b844-37988383a7dd => generated 1545 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:59:54.081332 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7d1dca2a-61fb-4dfa-ad4b-7d8724ef7477 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:59:54.081763 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7d1dca2a-61fb-4dfa-ad4b-7d8724ef7477 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 23832873-3cc5-4dec-b844-37988383a7dd] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:59:54.084488 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:54.085217 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=32 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:54.090302 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7d1dca2a-61fb-4dfa-ad4b-7d8724ef7477 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:59:54.090911 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7d1dca2a-61fb-4dfa-ad4b-7d8724ef7477 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:59:54.091234 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7d1dca2a-61fb-4dfa-ad4b-7d8724ef7477 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:59:54.091953 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7d1dca2a-61fb-4dfa-ad4b-7d8724ef7477 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:59:54.092420 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7d1dca2a-61fb-4dfa-ad4b-7d8724ef7477 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:59:54.092859 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7d1dca2a-61fb-4dfa-ad4b-7d8724ef7477 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:59:54.120232 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7d1dca2a-61fb-4dfa-ad4b-7d8724ef7477 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 23832873-3cc5-4dec-b844-37988383a7dd] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 01:59:54.433572 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7d1dca2a-61fb-4dfa-ad4b-7d8724ef7477 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "DELETE /compute/v2.1/servers/23832873-3cc5-4dec-b844-37988383a7dd" status: 204 len: 0 microversion: 2.1 time: 0.356335 Oct 23 01:59:54.434767 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3475/7048] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:59:54 2022] DELETE /compute/v2.1/servers/23832873-3cc5-4dec-b844-37988383a7dd => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 01:59:54.443940 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f4bb1c38-cd2a-4eec-8aad-c2d0a012c6cf tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:59:54.444564 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f4bb1c38-cd2a-4eec-8aad-c2d0a012c6cf tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 23832873-3cc5-4dec-b844-37988383a7dd] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:59:54.447653 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:54.448338 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=40 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:54.455112 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4bb1c38-cd2a-4eec-8aad-c2d0a012c6cf tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:59:54.455963 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4bb1c38-cd2a-4eec-8aad-c2d0a012c6cf tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:59:54.456765 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4bb1c38-cd2a-4eec-8aad-c2d0a012c6cf tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:59:54.458134 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4bb1c38-cd2a-4eec-8aad-c2d0a012c6cf tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:59:54.458817 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4bb1c38-cd2a-4eec-8aad-c2d0a012c6cf tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:59:54.459462 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f4bb1c38-cd2a-4eec-8aad-c2d0a012c6cf tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:59:54.616140 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f4bb1c38-cd2a-4eec-8aad-c2d0a012c6cf tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f253afef5849d19f4e1d99b038697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76b081c02814da98ab62bfc2fe5536b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:59:54.625319 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f4bb1c38-cd2a-4eec-8aad-c2d0a012c6cf tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "GET /compute/v2.1/servers/23832873-3cc5-4dec-b844-37988383a7dd" status: 200 len: 1551 microversion: 2.1 time: 0.186279 Oct 23 01:59:54.626349 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3574/7049] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:59:54 2022] GET /compute/v2.1/servers/23832873-3cc5-4dec-b844-37988383a7dd => generated 1551 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:59:55.650404 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-236f6fee-cf63-43ad-8f07-c6b8e21d0b25 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:59:55.653108 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-236f6fee-cf63-43ad-8f07-c6b8e21d0b25 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 23832873-3cc5-4dec-b844-37988383a7dd] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:59:55.657884 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-236f6fee-cf63-43ad-8f07-c6b8e21d0b25 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:59:55.658415 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-236f6fee-cf63-43ad-8f07-c6b8e21d0b25 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:59:55.658918 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-236f6fee-cf63-43ad-8f07-c6b8e21d0b25 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:59:55.659634 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-236f6fee-cf63-43ad-8f07-c6b8e21d0b25 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:59:55.660114 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-236f6fee-cf63-43ad-8f07-c6b8e21d0b25 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:59:55.661236 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-236f6fee-cf63-43ad-8f07-c6b8e21d0b25 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:59:55.792062 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-236f6fee-cf63-43ad-8f07-c6b8e21d0b25 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f253afef5849d19f4e1d99b038697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76b081c02814da98ab62bfc2fe5536b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:59:55.800113 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-236f6fee-cf63-43ad-8f07-c6b8e21d0b25 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "GET /compute/v2.1/servers/23832873-3cc5-4dec-b844-37988383a7dd" status: 200 len: 1551 microversion: 2.1 time: 0.153941 Oct 23 01:59:55.800696 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3476/7050] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:59:55 2022] GET /compute/v2.1/servers/23832873-3cc5-4dec-b844-37988383a7dd => generated 1551 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:59:56.584228 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-d5eb861f-6a02-4d1c-b9c4-3e7abb0f4639 req-848e9949-7e8f-48f5-b795-3d5b8c10fc49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23832873-3cc5-4dec-b844-37988383a7dd", "name": "network-vif-deleted", "tag": "1cc65afc-0cac-4db0-8777-a2be6cc5b953"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 01:59:56.594389 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-d5eb861f-6a02-4d1c-b9c4-3e7abb0f4639 req-848e9949-7e8f-48f5-b795-3d5b8c10fc49 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:59:56.595558 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-d5eb861f-6a02-4d1c-b9c4-3e7abb0f4639 req-848e9949-7e8f-48f5-b795-3d5b8c10fc49 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:59:56.595558 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-d5eb861f-6a02-4d1c-b9c4-3e7abb0f4639 req-848e9949-7e8f-48f5-b795-3d5b8c10fc49 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:59:56.606952 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-d5eb861f-6a02-4d1c-b9c4-3e7abb0f4639 req-848e9949-7e8f-48f5-b795-3d5b8c10fc49 service nova] Creating event network-vif-deleted:1cc65afc-0cac-4db0-8777-a2be6cc5b953 for instance 23832873-3cc5-4dec-b844-37988383a7dd on n-h1-master-1 Oct 23 01:59:56.612124 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-d5eb861f-6a02-4d1c-b9c4-3e7abb0f4639 req-848e9949-7e8f-48f5-b795-3d5b8c10fc49 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031903 Oct 23 01:59:56.612762 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3575/7051] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 01:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 01:59:56.823705 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-936bff39-4e86-46ac-b16c-21f68129b20d tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:59:56.824301 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-936bff39-4e86-46ac-b16c-21f68129b20d tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 23832873-3cc5-4dec-b844-37988383a7dd] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:59:56.831306 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-936bff39-4e86-46ac-b16c-21f68129b20d tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:59:56.831803 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-936bff39-4e86-46ac-b16c-21f68129b20d tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:59:56.832249 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-936bff39-4e86-46ac-b16c-21f68129b20d tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:59:56.832950 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-936bff39-4e86-46ac-b16c-21f68129b20d tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:59:56.833421 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-936bff39-4e86-46ac-b16c-21f68129b20d tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:59:56.833855 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-936bff39-4e86-46ac-b16c-21f68129b20d tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:59:56.902688 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-936bff39-4e86-46ac-b16c-21f68129b20d tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f253afef5849d19f4e1d99b038697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76b081c02814da98ab62bfc2fe5536b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 01:59:56.911542 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-936bff39-4e86-46ac-b16c-21f68129b20d tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "GET /compute/v2.1/servers/23832873-3cc5-4dec-b844-37988383a7dd" status: 200 len: 1332 microversion: 2.1 time: 0.091871 Oct 23 01:59:56.912278 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3477/7052] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:59:56 2022] GET /compute/v2.1/servers/23832873-3cc5-4dec-b844-37988383a7dd => generated 1332 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 01:59:57.937305 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5649f395-39cc-4d32-b3c5-c1b677458d2e tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:59:57.938052 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5649f395-39cc-4d32-b3c5-c1b677458d2e tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 23832873-3cc5-4dec-b844-37988383a7dd] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 01:59:57.944958 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5649f395-39cc-4d32-b3c5-c1b677458d2e tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:59:57.945449 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5649f395-39cc-4d32-b3c5-c1b677458d2e tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:59:57.945891 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5649f395-39cc-4d32-b3c5-c1b677458d2e tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:59:57.946608 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5649f395-39cc-4d32-b3c5-c1b677458d2e tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 01:59:57.947075 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5649f395-39cc-4d32-b3c5-c1b677458d2e tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 01:59:57.947511 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5649f395-39cc-4d32-b3c5-c1b677458d2e tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 01:59:57.961191 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-5649f395-39cc-4d32-b3c5-c1b677458d2e tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] HTTP exception thrown: Instance 23832873-3cc5-4dec-b844-37988383a7dd could not be found. Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5649f395-39cc-4d32-b3c5-c1b677458d2e tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Request method failure captured: Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/23832873-3cc5-4dec-b844-37988383a7dd HTTP/1.1 Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJ-p3L7ffpbqp-TDvCQNJ8352Tj6PKsDkBlu_acKGm56X3QWFExF8V42_3red2npIFmOo9KINMcCWM9v5zLSavahu9p8xrsnQa7nsJqIsmIaxoUAwjiVaChYx88s_bmRIYTTJhDhiNnhzHjNNrYdDq4Rfc6pz_IJiVRkZ60SVcgv528 Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: e76b081c02814da98ab62bfc2fe5536b Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-TestNetworkBasicOps-383216941 Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e76b081c02814da98ab62bfc2fe5536b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e76b081c02814da98ab62bfc2fe5536b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e76b081c02814da98ab62bfc2fe5536b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e76b081c02814da98ab62bfc2fe5536b"}]}] Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-TestNetworkBasicOps-383216941 Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: e76b081c02814da98ab62bfc2fe5536b Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-TestNetworkBasicOps-383216941 Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-TestNetworkBasicOps-383216941-project Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: d2f253afef5849d19f4e1d99b038697b Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-TestNetworkBasicOps-383216941-project Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 23832873-3cc5-4dec-b844-37988383a7dd could not be found. Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '23832873-3cc5-4dec-b844-37988383a7dd'} Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23832873-3cc5-4dec-b844-37988383a7dd could not be found. Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23832873-3cc5-4dec-b844-37988383a7dd could not be found. Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 01:59:57.962869 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:59:57.967631 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 01:59:57.967631 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 01:59:57.967631 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 01:59:57.967631 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 01:59:57.967631 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 01:59:57.967631 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23832873-3cc5-4dec-b844-37988383a7dd could not be found. Oct 23 01:59:57.967631 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 01:59:57.967631 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5649f395-39cc-4d32-b3c5-c1b677458d2e tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Returning 404 to user: Instance 23832873-3cc5-4dec-b844-37988383a7dd could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 01:59:57.967631 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5649f395-39cc-4d32-b3c5-c1b677458d2e tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "GET /compute/v2.1/servers/23832873-3cc5-4dec-b844-37988383a7dd" status: 404 len: 111 microversion: 2.1 time: 0.032277 Oct 23 01:59:57.967631 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3576/7053] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:59:57 2022] GET /compute/v2.1/servers/23832873-3cc5-4dec-b844-37988383a7dd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 01:59:58.197174 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7b690cde-b917-495a-80bc-a22934f1cd16 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '.version_select at 0x7f5cc0c619d0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 01:59:58.273902 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7b690cde-b917-495a-80bc-a22934f1cd16 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-348979094" status: 202 len: 0 microversion: 2.1 time: 0.080494 Oct 23 01:59:58.274519 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3478/7054] 10.222.0.42 () {58 vars in 1254 bytes} [Sun Oct 23 01:59:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-348979094 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:00:00.150161 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-328e39df-e8ef-4e57-b07c-38e820cf1c8b tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:00:00.150666 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-328e39df-e8ef-4e57-b07c-38e820cf1c8b tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 881f91d8-34fe-4ae6-a37c-626807802487] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:00:00.153625 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-664ed167-f294-47bb-a465-956307a5ab27 req-012e2697-f69d-4c4e-af56-5ef01f004edc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "881f91d8-34fe-4ae6-a37c-626807802487", "tag": "f6b66c6b-99dd-48c6-9e3a-704cbe9ba4b7"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:00:00.157756 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-328e39df-e8ef-4e57-b07c-38e820cf1c8b tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:00.158330 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-328e39df-e8ef-4e57-b07c-38e820cf1c8b tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:00.159521 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-328e39df-e8ef-4e57-b07c-38e820cf1c8b tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:00.161032 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-328e39df-e8ef-4e57-b07c-38e820cf1c8b tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:00.161503 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-328e39df-e8ef-4e57-b07c-38e820cf1c8b tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:00.161931 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-328e39df-e8ef-4e57-b07c-38e820cf1c8b tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:00.164668 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-664ed167-f294-47bb-a465-956307a5ab27 req-012e2697-f69d-4c4e-af56-5ef01f004edc service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:00.165239 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-664ed167-f294-47bb-a465-956307a5ab27 req-012e2697-f69d-4c4e-af56-5ef01f004edc service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:00.165776 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-664ed167-f294-47bb-a465-956307a5ab27 req-012e2697-f69d-4c4e-af56-5ef01f004edc service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:00.176486 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-664ed167-f294-47bb-a465-956307a5ab27 req-012e2697-f69d-4c4e-af56-5ef01f004edc service nova] Creating event network-changed:f6b66c6b-99dd-48c6-9e3a-704cbe9ba4b7 for instance 881f91d8-34fe-4ae6-a37c-626807802487 on n-h2-master-1 Oct 23 02:00:00.182663 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-664ed167-f294-47bb-a465-956307a5ab27 req-012e2697-f69d-4c4e-af56-5ef01f004edc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033872 Oct 23 02:00:00.183461 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3479/7055] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:00:00.192915 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-328e39df-e8ef-4e57-b07c-38e820cf1c8b tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 881f91d8-34fe-4ae6-a37c-626807802487] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 02:00:00.467646 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-328e39df-e8ef-4e57-b07c-38e820cf1c8b tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "DELETE /compute/v2.1/servers/881f91d8-34fe-4ae6-a37c-626807802487" status: 204 len: 0 microversion: 2.1 time: 0.321334 Oct 23 02:00:00.468884 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3577/7056] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 02:00:00 2022] DELETE /compute/v2.1/servers/881f91d8-34fe-4ae6-a37c-626807802487 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 02:00:00.479667 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a40d3551-2e4e-43dc-b972-a9f5f824fb46 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:00:00.480436 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a40d3551-2e4e-43dc-b972-a9f5f824fb46 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 881f91d8-34fe-4ae6-a37c-626807802487] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:00:00.488221 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a40d3551-2e4e-43dc-b972-a9f5f824fb46 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:00.489281 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a40d3551-2e4e-43dc-b972-a9f5f824fb46 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:00.489483 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a40d3551-2e4e-43dc-b972-a9f5f824fb46 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:00.490234 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a40d3551-2e4e-43dc-b972-a9f5f824fb46 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:00.490703 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a40d3551-2e4e-43dc-b972-a9f5f824fb46 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:00.491701 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a40d3551-2e4e-43dc-b972-a9f5f824fb46 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:00.632374 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a40d3551-2e4e-43dc-b972-a9f5f824fb46 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f253afef5849d19f4e1d99b038697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76b081c02814da98ab62bfc2fe5536b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:00:00.640441 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a40d3551-2e4e-43dc-b972-a9f5f824fb46 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "GET /compute/v2.1/servers/881f91d8-34fe-4ae6-a37c-626807802487" status: 200 len: 1671 microversion: 2.1 time: 0.166898 Oct 23 02:00:00.641269 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3480/7057] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:00:00 2022] GET /compute/v2.1/servers/881f91d8-34fe-4ae6-a37c-626807802487 => generated 1671 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:00:01.665418 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ad780ecb-6312-4883-8dbb-b784eaad9bf9 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:00:01.666180 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ad780ecb-6312-4883-8dbb-b784eaad9bf9 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 881f91d8-34fe-4ae6-a37c-626807802487] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:00:01.672952 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ad780ecb-6312-4883-8dbb-b784eaad9bf9 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:01.673436 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ad780ecb-6312-4883-8dbb-b784eaad9bf9 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:01.673870 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ad780ecb-6312-4883-8dbb-b784eaad9bf9 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:01.674577 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ad780ecb-6312-4883-8dbb-b784eaad9bf9 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:01.675031 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ad780ecb-6312-4883-8dbb-b784eaad9bf9 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:01.675453 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ad780ecb-6312-4883-8dbb-b784eaad9bf9 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:01.813818 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ad780ecb-6312-4883-8dbb-b784eaad9bf9 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f253afef5849d19f4e1d99b038697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76b081c02814da98ab62bfc2fe5536b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:00:01.821877 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ad780ecb-6312-4883-8dbb-b784eaad9bf9 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "GET /compute/v2.1/servers/881f91d8-34fe-4ae6-a37c-626807802487" status: 200 len: 1671 microversion: 2.1 time: 0.160802 Oct 23 02:00:01.822489 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3578/7058] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:00:01 2022] GET /compute/v2.1/servers/881f91d8-34fe-4ae6-a37c-626807802487 => generated 1671 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:00:02.747362 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-5db0f4a6-baa0-4179-becd-9341ee78bfbe req-922c052b-90e1-4b22-afd3-4f824fd88c7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "881f91d8-34fe-4ae6-a37c-626807802487", "name": "network-vif-deleted", "tag": "f6b66c6b-99dd-48c6-9e3a-704cbe9ba4b7"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:00:02.757715 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-5db0f4a6-baa0-4179-becd-9341ee78bfbe req-922c052b-90e1-4b22-afd3-4f824fd88c7f service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:02.758266 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-5db0f4a6-baa0-4179-becd-9341ee78bfbe req-922c052b-90e1-4b22-afd3-4f824fd88c7f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:02.758706 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-5db0f4a6-baa0-4179-becd-9341ee78bfbe req-922c052b-90e1-4b22-afd3-4f824fd88c7f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:02.769850 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-5db0f4a6-baa0-4179-becd-9341ee78bfbe req-922c052b-90e1-4b22-afd3-4f824fd88c7f service nova] Creating event network-vif-deleted:f6b66c6b-99dd-48c6-9e3a-704cbe9ba4b7 for instance 881f91d8-34fe-4ae6-a37c-626807802487 on n-h2-master-1 Oct 23 02:00:02.775622 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-5db0f4a6-baa0-4179-becd-9341ee78bfbe req-922c052b-90e1-4b22-afd3-4f824fd88c7f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032036 Oct 23 02:00:02.776238 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3481/7059] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:00:02.845718 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3b3bbfad-308c-4a08-b8d5-fb1d547d9c6f tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:00:02.846456 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3b3bbfad-308c-4a08-b8d5-fb1d547d9c6f tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 881f91d8-34fe-4ae6-a37c-626807802487] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:00:02.853433 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3b3bbfad-308c-4a08-b8d5-fb1d547d9c6f tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:02.858296 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3b3bbfad-308c-4a08-b8d5-fb1d547d9c6f tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:02.858296 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3b3bbfad-308c-4a08-b8d5-fb1d547d9c6f tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:02.858296 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3b3bbfad-308c-4a08-b8d5-fb1d547d9c6f tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:02.858296 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3b3bbfad-308c-4a08-b8d5-fb1d547d9c6f tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:02.858296 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3b3bbfad-308c-4a08-b8d5-fb1d547d9c6f tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:02.918137 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3b3bbfad-308c-4a08-b8d5-fb1d547d9c6f tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f253afef5849d19f4e1d99b038697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76b081c02814da98ab62bfc2fe5536b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:00:02.925917 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3b3bbfad-308c-4a08-b8d5-fb1d547d9c6f tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "GET /compute/v2.1/servers/881f91d8-34fe-4ae6-a37c-626807802487" status: 200 len: 1484 microversion: 2.1 time: 0.084177 Oct 23 02:00:02.926521 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3579/7060] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:00:02 2022] GET /compute/v2.1/servers/881f91d8-34fe-4ae6-a37c-626807802487 => generated 1484 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:00:03.950699 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0bbd4e20-633a-4b95-9522-03f86be7e0f5 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:00:03.951348 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0bbd4e20-633a-4b95-9522-03f86be7e0f5 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 881f91d8-34fe-4ae6-a37c-626807802487] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:00:03.958987 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0bbd4e20-633a-4b95-9522-03f86be7e0f5 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:03.959500 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0bbd4e20-633a-4b95-9522-03f86be7e0f5 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:03.960616 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0bbd4e20-633a-4b95-9522-03f86be7e0f5 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:03.961328 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0bbd4e20-633a-4b95-9522-03f86be7e0f5 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:03.961804 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0bbd4e20-633a-4b95-9522-03f86be7e0f5 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:03.962346 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0bbd4e20-633a-4b95-9522-03f86be7e0f5 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:03.976737 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-0bbd4e20-633a-4b95-9522-03f86be7e0f5 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] HTTP exception thrown: Instance 881f91d8-34fe-4ae6-a37c-626807802487 could not be found. Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0bbd4e20-633a-4b95-9522-03f86be7e0f5 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Request method failure captured: Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/881f91d8-34fe-4ae6-a37c-626807802487 HTTP/1.1 Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJ-p3L7ffpbqp-TDvCQNJ8352Tj6PKsDkBlu_acKGm56X3QWFExF8V42_3red2npIFmOo9KINMcCWM9v5zLSavahu9p8xrsnQa7nsJqIsmIaxoUAwjiVaChYx88s_bmRIYTTJhDhiNnhzHjNNrYdDq4Rfc6pz_IJiVRkZ60SVcgv528 Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: e76b081c02814da98ab62bfc2fe5536b Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-TestNetworkBasicOps-383216941 Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e76b081c02814da98ab62bfc2fe5536b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e76b081c02814da98ab62bfc2fe5536b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e76b081c02814da98ab62bfc2fe5536b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e76b081c02814da98ab62bfc2fe5536b"}]}] Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-TestNetworkBasicOps-383216941 Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: e76b081c02814da98ab62bfc2fe5536b Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-TestNetworkBasicOps-383216941 Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-TestNetworkBasicOps-383216941-project Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: d2f253afef5849d19f4e1d99b038697b Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-TestNetworkBasicOps-383216941-project Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 881f91d8-34fe-4ae6-a37c-626807802487 could not be found. Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '881f91d8-34fe-4ae6-a37c-626807802487'} Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 881f91d8-34fe-4ae6-a37c-626807802487 could not be found. Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 881f91d8-34fe-4ae6-a37c-626807802487 could not be found. Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:00:03.978583 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:00:03.990819 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:00:03.990819 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:00:03.990819 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:00:03.990819 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:00:03.990819 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:00:03.990819 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 881f91d8-34fe-4ae6-a37c-626807802487 could not be found. Oct 23 02:00:03.990819 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:00:03.990819 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0bbd4e20-633a-4b95-9522-03f86be7e0f5 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Returning 404 to user: Instance 881f91d8-34fe-4ae6-a37c-626807802487 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:00:03.990819 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0bbd4e20-633a-4b95-9522-03f86be7e0f5 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "GET /compute/v2.1/servers/881f91d8-34fe-4ae6-a37c-626807802487" status: 404 len: 111 microversion: 2.1 time: 0.033995 Oct 23 02:00:03.990819 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3482/7061] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:00:03 2022] GET /compute/v2.1/servers/881f91d8-34fe-4ae6-a37c-626807802487 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:00:04.192165 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b520fcae-c553-4d27-9fa6-07ce30f6cfbb tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '.version_select at 0x7f5cc21b49d0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:00:04.251585 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b520fcae-c553-4d27-9fa6-07ce30f6cfbb tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1482693316" status: 202 len: 0 microversion: 2.1 time: 0.063452 Oct 23 02:00:04.252184 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3580/7062] 10.222.0.42 () {58 vars in 1257 bytes} [Sun Oct 23 02:00:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1482693316 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:00:14.753966 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9af54ec6-8ce8-4295-9d76-4a2698707022 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Action: 'create', calling method: .version_select at 0x7f5cc0bfa430>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-2106786091", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+FXdTITAwBXS+YPf331ZJZ/HxmpWQTO+EpSBsFMO9MfImqIJ7xnwbWh0glLnPKvKN1+rff06rRB2g9EdDlxCVpo5G5AufuGmig7VRJtywBIbkajRT+ajwfh0pLFY9WIg=="}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:00:14.761056 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:00:14.761737 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:00:14.773044 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-9af54ec6-8ce8-4295-9d76-4a2698707022 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Getting quotas for project e76b081c02814da98ab62bfc2fe5536b. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:00:14.780530 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-9af54ec6-8ce8-4295-9d76-4a2698707022 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Getting quotas for user d2f253afef5849d19f4e1d99b038697b and project e76b081c02814da98ab62bfc2fe5536b. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:00:14.880377 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9af54ec6-8ce8-4295-9d76-4a2698707022 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.130442 Oct 23 02:00:14.881001 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3483/7063] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 02:00:14 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:00:17.341640 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:00:17.342444 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:00:17.346538 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8d345de3-aca5-4acb-8736-afc087a27a56 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1473562555", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "26fad1d7-be1a-46b2-b71a-c62b71b83bea"}], "key_name": "tempest-TestNetworkBasicOps-2106786091", "security_groups": [{"name": "tempest-secgroup-smoke-1311871339"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:00:17.451521 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-8d345de3-aca5-4acb-8736-afc087a27a56 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] validate_networks() for [('26fad1d7-be1a-46b2-b71a-c62b71b83bea', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 02:00:17.821684 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-8d345de3-aca5-4acb-8736-afc087a27a56 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:00:17.822156 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-8d345de3-aca5-4acb-8736-afc087a27a56 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:00:17.822647 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-8d345de3-aca5-4acb-8736-afc087a27a56 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:00:17.823073 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-8d345de3-aca5-4acb-8736-afc087a27a56 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:00:17.823527 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-8d345de3-aca5-4acb-8736-afc087a27a56 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:00:17.832788 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8d345de3-aca5-4acb-8736-afc087a27a56 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:17.833279 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8d345de3-aca5-4acb-8736-afc087a27a56 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:17.833726 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8d345de3-aca5-4acb-8736-afc087a27a56 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:17.834511 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8d345de3-aca5-4acb-8736-afc087a27a56 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:17.834981 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8d345de3-aca5-4acb-8736-afc087a27a56 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:17.835413 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8d345de3-aca5-4acb-8736-afc087a27a56 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:17.853506 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-8d345de3-aca5-4acb-8736-afc087a27a56 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Getting quotas for project e76b081c02814da98ab62bfc2fe5536b. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:00:17.858950 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-8d345de3-aca5-4acb-8736-afc087a27a56 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Getting quotas for user d2f253afef5849d19f4e1d99b038697b and project e76b081c02814da98ab62bfc2fe5536b. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:00:17.872197 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8d345de3-aca5-4acb-8736-afc087a27a56 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 02:00:17.874506 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8d345de3-aca5-4acb-8736-afc087a27a56 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 3b2d2a90-4445-4d35-81a2-7d075c408630] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 02:00:17.983629 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8d345de3-aca5-4acb-8736-afc087a27a56 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.644117 Oct 23 02:00:17.984282 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3581/7064] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 02:00:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 02:00:17.996245 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-79dc3b02-549d-4425-8361-64a0e6d87bc3 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:00:17.996985 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-79dc3b02-549d-4425-8361-64a0e6d87bc3 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 3b2d2a90-4445-4d35-81a2-7d075c408630] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:00:18.055616 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-79dc3b02-549d-4425-8361-64a0e6d87bc3 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f253afef5849d19f4e1d99b038697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76b081c02814da98ab62bfc2fe5536b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:00:18.063756 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-79dc3b02-549d-4425-8361-64a0e6d87bc3 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2d2a90-4445-4d35-81a2-7d075c408630" status: 200 len: 1249 microversion: 2.1 time: 0.071923 Oct 23 02:00:18.064334 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3484/7065] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:00:17 2022] GET /compute/v2.1/servers/3b2d2a90-4445-4d35-81a2-7d075c408630 => generated 1249 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:00:19.088446 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-36612274-1b28-4c31-a234-bfbd034019ec tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:00:19.088981 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-36612274-1b28-4c31-a234-bfbd034019ec tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 3b2d2a90-4445-4d35-81a2-7d075c408630] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:00:19.095851 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36612274-1b28-4c31-a234-bfbd034019ec tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:19.096343 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36612274-1b28-4c31-a234-bfbd034019ec tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:19.096779 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36612274-1b28-4c31-a234-bfbd034019ec tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:19.097466 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36612274-1b28-4c31-a234-bfbd034019ec tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:19.097923 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36612274-1b28-4c31-a234-bfbd034019ec tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:19.098374 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36612274-1b28-4c31-a234-bfbd034019ec tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:19.160998 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-36612274-1b28-4c31-a234-bfbd034019ec tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f253afef5849d19f4e1d99b038697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76b081c02814da98ab62bfc2fe5536b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:00:19.171817 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-36612274-1b28-4c31-a234-bfbd034019ec tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2d2a90-4445-4d35-81a2-7d075c408630" status: 200 len: 1253 microversion: 2.1 time: 0.086221 Oct 23 02:00:19.171817 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3582/7066] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:00:19 2022] GET /compute/v2.1/servers/3b2d2a90-4445-4d35-81a2-7d075c408630 => generated 1253 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:00:20.193400 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a7c0bd72-2068-4116-9017-404f7f44e2dd tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:00:20.194072 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a7c0bd72-2068-4116-9017-404f7f44e2dd tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 3b2d2a90-4445-4d35-81a2-7d075c408630] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:00:20.203236 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a7c0bd72-2068-4116-9017-404f7f44e2dd tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:20.203740 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a7c0bd72-2068-4116-9017-404f7f44e2dd tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:20.204186 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a7c0bd72-2068-4116-9017-404f7f44e2dd tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:20.204958 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a7c0bd72-2068-4116-9017-404f7f44e2dd tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:20.205678 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a7c0bd72-2068-4116-9017-404f7f44e2dd tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:20.206148 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a7c0bd72-2068-4116-9017-404f7f44e2dd tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:20.272018 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a7c0bd72-2068-4116-9017-404f7f44e2dd tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f253afef5849d19f4e1d99b038697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76b081c02814da98ab62bfc2fe5536b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:00:20.279804 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a7c0bd72-2068-4116-9017-404f7f44e2dd tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2d2a90-4445-4d35-81a2-7d075c408630" status: 200 len: 1319 microversion: 2.1 time: 0.090978 Oct 23 02:00:20.280386 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3485/7067] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:00:20 2022] GET /compute/v2.1/servers/3b2d2a90-4445-4d35-81a2-7d075c408630 => generated 1319 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:00:20.950264 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9c795732-0fcb-4eb8-aed2-1488925fa32a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:00:20.950790 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9c795732-0fcb-4eb8-aed2-1488925fa32a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 9acf9d26-0453-4655-aca0-626fa37cf6ee] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:00:20.957426 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9c795732-0fcb-4eb8-aed2-1488925fa32a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:20.958554 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9c795732-0fcb-4eb8-aed2-1488925fa32a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:20.959008 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9c795732-0fcb-4eb8-aed2-1488925fa32a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:20.959720 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9c795732-0fcb-4eb8-aed2-1488925fa32a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:20.960184 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9c795732-0fcb-4eb8-aed2-1488925fa32a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:20.960617 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9c795732-0fcb-4eb8-aed2-1488925fa32a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:20.990518 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9c795732-0fcb-4eb8-aed2-1488925fa32a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 9acf9d26-0453-4655-aca0-626fa37cf6ee] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 02:00:21.262162 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9c795732-0fcb-4eb8-aed2-1488925fa32a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee" status: 204 len: 0 microversion: 2.1 time: 0.475373 Oct 23 02:00:21.262915 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3583/7068] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 02:00:20 2022] DELETE /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee => generated 0 bytes in 477 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 02:00:21.271282 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f824a4a1-f9ee-4513-9a17-67ac4e6c36cf tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:00:21.271924 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f824a4a1-f9ee-4513-9a17-67ac4e6c36cf tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 9acf9d26-0453-4655-aca0-626fa37cf6ee] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:00:21.279988 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f824a4a1-f9ee-4513-9a17-67ac4e6c36cf tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:21.280786 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f824a4a1-f9ee-4513-9a17-67ac4e6c36cf tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:21.281507 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f824a4a1-f9ee-4513-9a17-67ac4e6c36cf tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:21.282274 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f824a4a1-f9ee-4513-9a17-67ac4e6c36cf tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:21.282756 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f824a4a1-f9ee-4513-9a17-67ac4e6c36cf tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:21.283207 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f824a4a1-f9ee-4513-9a17-67ac4e6c36cf tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:21.304320 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-34354f57-b0e8-46d0-8b5e-40c2c51161ef tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:00:21.305100 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-34354f57-b0e8-46d0-8b5e-40c2c51161ef tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 3b2d2a90-4445-4d35-81a2-7d075c408630] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:00:21.311194 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-34354f57-b0e8-46d0-8b5e-40c2c51161ef tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:21.311687 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-34354f57-b0e8-46d0-8b5e-40c2c51161ef tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:21.312124 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-34354f57-b0e8-46d0-8b5e-40c2c51161ef tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:21.313302 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-34354f57-b0e8-46d0-8b5e-40c2c51161ef tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:21.313925 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-34354f57-b0e8-46d0-8b5e-40c2c51161ef tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:21.314540 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-34354f57-b0e8-46d0-8b5e-40c2c51161ef tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:21.492121 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f824a4a1-f9ee-4513-9a17-67ac4e6c36cf tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:00:21.499544 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-34354f57-b0e8-46d0-8b5e-40c2c51161ef tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f253afef5849d19f4e1d99b038697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76b081c02814da98ab62bfc2fe5536b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:00:21.504324 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f824a4a1-f9ee-4513-9a17-67ac4e6c36cf tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee" status: 200 len: 1577 microversion: 2.1 time: 0.237042 Oct 23 02:00:21.505044 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3486/7069] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:00:21 2022] GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee => generated 1577 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:00:21.517902 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-34354f57-b0e8-46d0-8b5e-40c2c51161ef tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2d2a90-4445-4d35-81a2-7d075c408630" status: 200 len: 1375 microversion: 2.1 time: 0.218077 Oct 23 02:00:21.518949 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3584/7070] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:00:21 2022] GET /compute/v2.1/servers/3b2d2a90-4445-4d35-81a2-7d075c408630 => generated 1375 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:00:21.814997 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-ead895f4-15da-4cfd-927d-2bb0ac18117f req-0192822d-efba-4b2f-8d5a-30a0829b0e95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b2d2a90-4445-4d35-81a2-7d075c408630", "tag": "c94ae1b5-88b7-4338-a836-a05150c527eb"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:00:21.826680 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ead895f4-15da-4cfd-927d-2bb0ac18117f req-0192822d-efba-4b2f-8d5a-30a0829b0e95 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:21.827282 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ead895f4-15da-4cfd-927d-2bb0ac18117f req-0192822d-efba-4b2f-8d5a-30a0829b0e95 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:21.827734 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ead895f4-15da-4cfd-927d-2bb0ac18117f req-0192822d-efba-4b2f-8d5a-30a0829b0e95 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:21.841251 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-ead895f4-15da-4cfd-927d-2bb0ac18117f req-0192822d-efba-4b2f-8d5a-30a0829b0e95 service nova] Creating event network-changed:c94ae1b5-88b7-4338-a836-a05150c527eb for instance 3b2d2a90-4445-4d35-81a2-7d075c408630 on n-h2-master-1 Oct 23 02:00:21.846452 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-ead895f4-15da-4cfd-927d-2bb0ac18117f req-0192822d-efba-4b2f-8d5a-30a0829b0e95 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035219 Oct 23 02:00:21.847344 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3487/7071] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:00:22.528103 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8983b194-9392-4455-a8bf-48b1a94f4da5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:00:22.528720 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8983b194-9392-4455-a8bf-48b1a94f4da5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 9acf9d26-0453-4655-aca0-626fa37cf6ee] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:00:22.535689 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8983b194-9392-4455-a8bf-48b1a94f4da5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:22.536180 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8983b194-9392-4455-a8bf-48b1a94f4da5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:22.536621 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8983b194-9392-4455-a8bf-48b1a94f4da5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:22.537407 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8983b194-9392-4455-a8bf-48b1a94f4da5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:22.537870 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8983b194-9392-4455-a8bf-48b1a94f4da5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:22.538374 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8983b194-9392-4455-a8bf-48b1a94f4da5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:22.543805 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a7c5c166-c2dc-4f6c-ad31-2fb0e47669fc tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:00:22.545268 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a7c5c166-c2dc-4f6c-ad31-2fb0e47669fc tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 3b2d2a90-4445-4d35-81a2-7d075c408630] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:00:22.552507 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a7c5c166-c2dc-4f6c-ad31-2fb0e47669fc tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:22.553112 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a7c5c166-c2dc-4f6c-ad31-2fb0e47669fc tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:22.553637 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a7c5c166-c2dc-4f6c-ad31-2fb0e47669fc tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:22.554477 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a7c5c166-c2dc-4f6c-ad31-2fb0e47669fc tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:22.555022 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a7c5c166-c2dc-4f6c-ad31-2fb0e47669fc tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:22.555540 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a7c5c166-c2dc-4f6c-ad31-2fb0e47669fc tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:22.991351 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8983b194-9392-4455-a8bf-48b1a94f4da5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:00:22.994785 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a7c5c166-c2dc-4f6c-ad31-2fb0e47669fc tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f253afef5849d19f4e1d99b038697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76b081c02814da98ab62bfc2fe5536b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:00:22.999511 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8983b194-9392-4455-a8bf-48b1a94f4da5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee" status: 200 len: 1577 microversion: 2.1 time: 0.475856 Oct 23 02:00:23.000108 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3585/7072] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:00:22 2022] GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee => generated 1577 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:00:23.003451 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a7c5c166-c2dc-4f6c-ad31-2fb0e47669fc tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2d2a90-4445-4d35-81a2-7d075c408630" status: 200 len: 1375 microversion: 2.1 time: 0.464714 Oct 23 02:00:23.004026 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3488/7073] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:00:22 2022] GET /compute/v2.1/servers/3b2d2a90-4445-4d35-81a2-7d075c408630 => generated 1375 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:00:24.027528 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ef6dce26-76b1-430d-b53a-c54ab8649ca0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:00:24.027528 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ef6dce26-76b1-430d-b53a-c54ab8649ca0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 9acf9d26-0453-4655-aca0-626fa37cf6ee] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:00:24.028478 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2bd6ae3f-75ee-49f5-8121-66d26c7a6cc2 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:00:24.029225 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2bd6ae3f-75ee-49f5-8121-66d26c7a6cc2 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 3b2d2a90-4445-4d35-81a2-7d075c408630] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:00:24.033504 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ef6dce26-76b1-430d-b53a-c54ab8649ca0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:24.034237 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ef6dce26-76b1-430d-b53a-c54ab8649ca0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:24.034835 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ef6dce26-76b1-430d-b53a-c54ab8649ca0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:24.035698 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ef6dce26-76b1-430d-b53a-c54ab8649ca0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:24.036313 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ef6dce26-76b1-430d-b53a-c54ab8649ca0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:24.036924 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ef6dce26-76b1-430d-b53a-c54ab8649ca0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:24.037332 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2bd6ae3f-75ee-49f5-8121-66d26c7a6cc2 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:24.037914 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2bd6ae3f-75ee-49f5-8121-66d26c7a6cc2 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:24.038481 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2bd6ae3f-75ee-49f5-8121-66d26c7a6cc2 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:24.039259 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2bd6ae3f-75ee-49f5-8121-66d26c7a6cc2 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:24.040371 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2bd6ae3f-75ee-49f5-8121-66d26c7a6cc2 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:24.040894 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2bd6ae3f-75ee-49f5-8121-66d26c7a6cc2 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:24.138670 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ef6dce26-76b1-430d-b53a-c54ab8649ca0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:00:24.146584 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ef6dce26-76b1-430d-b53a-c54ab8649ca0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee" status: 200 len: 1510 microversion: 2.1 time: 0.127365 Oct 23 02:00:24.147399 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3586/7074] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:00:24 2022] GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee => generated 1510 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:00:24.208466 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2bd6ae3f-75ee-49f5-8121-66d26c7a6cc2 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f253afef5849d19f4e1d99b038697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76b081c02814da98ab62bfc2fe5536b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:00:24.216963 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2bd6ae3f-75ee-49f5-8121-66d26c7a6cc2 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2d2a90-4445-4d35-81a2-7d075c408630" status: 200 len: 1375 microversion: 2.1 time: 0.193913 Oct 23 02:00:24.217577 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3489/7075] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:00:24 2022] GET /compute/v2.1/servers/3b2d2a90-4445-4d35-81a2-7d075c408630 => generated 1375 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:00:24.289301 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-6222227c-be8e-4f36-840d-c327f05a8adf req-9a1e21a2-c74a-4331-94bd-6379de9a5cc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9acf9d26-0453-4655-aca0-626fa37cf6ee", "name": "network-vif-deleted", "tag": "9915dbba-2f89-428e-98c3-1a6e5d3c9893"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:00:24.300208 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-6222227c-be8e-4f36-840d-c327f05a8adf req-9a1e21a2-c74a-4331-94bd-6379de9a5cc7 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:24.300798 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-6222227c-be8e-4f36-840d-c327f05a8adf req-9a1e21a2-c74a-4331-94bd-6379de9a5cc7 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:24.301292 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-6222227c-be8e-4f36-840d-c327f05a8adf req-9a1e21a2-c74a-4331-94bd-6379de9a5cc7 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:24.313506 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-6222227c-be8e-4f36-840d-c327f05a8adf req-9a1e21a2-c74a-4331-94bd-6379de9a5cc7 service nova] Creating event network-vif-deleted:9915dbba-2f89-428e-98c3-1a6e5d3c9893 for instance 9acf9d26-0453-4655-aca0-626fa37cf6ee on n-h1-master-1 Oct 23 02:00:24.318748 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-6222227c-be8e-4f36-840d-c327f05a8adf req-9a1e21a2-c74a-4331-94bd-6379de9a5cc7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033489 Oct 23 02:00:24.321467 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3587/7076] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:00:25.170756 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-93ba9b82-3a9c-46f2-9c1b-62137d3f8558 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:00:25.171373 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-93ba9b82-3a9c-46f2-9c1b-62137d3f8558 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 9acf9d26-0453-4655-aca0-626fa37cf6ee] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:00:25.178367 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-93ba9b82-3a9c-46f2-9c1b-62137d3f8558 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:25.178875 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-93ba9b82-3a9c-46f2-9c1b-62137d3f8558 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:25.179330 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-93ba9b82-3a9c-46f2-9c1b-62137d3f8558 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:25.180110 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-93ba9b82-3a9c-46f2-9c1b-62137d3f8558 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:25.181082 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-93ba9b82-3a9c-46f2-9c1b-62137d3f8558 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:25.181524 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-93ba9b82-3a9c-46f2-9c1b-62137d3f8558 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:25.241042 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e296ae9f-98a7-4510-8e4a-fb7ef0ba6846 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:00:25.242402 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e296ae9f-98a7-4510-8e4a-fb7ef0ba6846 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 3b2d2a90-4445-4d35-81a2-7d075c408630] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:00:25.251911 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e296ae9f-98a7-4510-8e4a-fb7ef0ba6846 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:25.252471 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-93ba9b82-3a9c-46f2-9c1b-62137d3f8558 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:00:25.252788 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e296ae9f-98a7-4510-8e4a-fb7ef0ba6846 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:25.253423 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e296ae9f-98a7-4510-8e4a-fb7ef0ba6846 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:25.254363 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e296ae9f-98a7-4510-8e4a-fb7ef0ba6846 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:25.257051 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e296ae9f-98a7-4510-8e4a-fb7ef0ba6846 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:25.257788 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e296ae9f-98a7-4510-8e4a-fb7ef0ba6846 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:25.262333 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-93ba9b82-3a9c-46f2-9c1b-62137d3f8558 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee" status: 200 len: 1225 microversion: 2.1 time: 0.094629 Oct 23 02:00:25.263475 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3490/7077] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:00:25 2022] GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:00:25.415097 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e296ae9f-98a7-4510-8e4a-fb7ef0ba6846 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f253afef5849d19f4e1d99b038697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76b081c02814da98ab62bfc2fe5536b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:00:25.428719 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e296ae9f-98a7-4510-8e4a-fb7ef0ba6846 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2d2a90-4445-4d35-81a2-7d075c408630" status: 200 len: 1375 microversion: 2.1 time: 0.187169 Oct 23 02:00:25.428719 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3588/7078] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:00:25 2022] GET /compute/v2.1/servers/3b2d2a90-4445-4d35-81a2-7d075c408630 => generated 1375 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:00:26.288899 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4b097dd6-d3a6-4939-beb8-6782900c06eb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:00:26.289792 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4b097dd6-d3a6-4939-beb8-6782900c06eb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 9acf9d26-0453-4655-aca0-626fa37cf6ee] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:00:26.300140 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b097dd6-d3a6-4939-beb8-6782900c06eb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:26.300140 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b097dd6-d3a6-4939-beb8-6782900c06eb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:26.300140 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b097dd6-d3a6-4939-beb8-6782900c06eb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:26.300140 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b097dd6-d3a6-4939-beb8-6782900c06eb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:26.300140 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b097dd6-d3a6-4939-beb8-6782900c06eb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:26.300541 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b097dd6-d3a6-4939-beb8-6782900c06eb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:26.364945 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4b097dd6-d3a6-4939-beb8-6782900c06eb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:00:26.373584 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4b097dd6-d3a6-4939-beb8-6782900c06eb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee" status: 200 len: 1225 microversion: 2.1 time: 0.088772 Oct 23 02:00:26.374286 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3491/7079] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:00:26 2022] GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:00:26.446320 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-25203d57-2c6f-496e-b9dd-e4debfcdd60f tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:00:26.446859 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-25203d57-2c6f-496e-b9dd-e4debfcdd60f tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 3b2d2a90-4445-4d35-81a2-7d075c408630] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:00:26.453776 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25203d57-2c6f-496e-b9dd-e4debfcdd60f tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:26.454296 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25203d57-2c6f-496e-b9dd-e4debfcdd60f tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:26.454743 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25203d57-2c6f-496e-b9dd-e4debfcdd60f tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:26.455698 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25203d57-2c6f-496e-b9dd-e4debfcdd60f tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:26.456160 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25203d57-2c6f-496e-b9dd-e4debfcdd60f tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:26.456591 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25203d57-2c6f-496e-b9dd-e4debfcdd60f tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:26.588581 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-25203d57-2c6f-496e-b9dd-e4debfcdd60f tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f253afef5849d19f4e1d99b038697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76b081c02814da98ab62bfc2fe5536b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:00:26.596319 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-25203d57-2c6f-496e-b9dd-e4debfcdd60f tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2d2a90-4445-4d35-81a2-7d075c408630" status: 200 len: 1375 microversion: 2.1 time: 0.154117 Oct 23 02:00:26.596885 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3589/7080] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:00:26 2022] GET /compute/v2.1/servers/3b2d2a90-4445-4d35-81a2-7d075c408630 => generated 1375 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:00:27.396742 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-46833a25-721f-4f58-bd49-19d6128a6c48 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:00:27.403201 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-46833a25-721f-4f58-bd49-19d6128a6c48 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 9acf9d26-0453-4655-aca0-626fa37cf6ee] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:00:27.405142 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46833a25-721f-4f58-bd49-19d6128a6c48 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:27.405650 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46833a25-721f-4f58-bd49-19d6128a6c48 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:27.406128 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46833a25-721f-4f58-bd49-19d6128a6c48 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:27.406847 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46833a25-721f-4f58-bd49-19d6128a6c48 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:27.407313 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46833a25-721f-4f58-bd49-19d6128a6c48 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:27.407984 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46833a25-721f-4f58-bd49-19d6128a6c48 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:27.475995 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-46833a25-721f-4f58-bd49-19d6128a6c48 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:00:27.485208 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-46833a25-721f-4f58-bd49-19d6128a6c48 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee" status: 200 len: 1225 microversion: 2.1 time: 0.092309 Oct 23 02:00:27.486516 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3492/7081] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:00:27 2022] GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:00:27.619895 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5b6edf0e-2051-4e8e-8d74-4be7d99b87f1 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:00:27.621560 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5b6edf0e-2051-4e8e-8d74-4be7d99b87f1 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 3b2d2a90-4445-4d35-81a2-7d075c408630] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:00:27.629675 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b6edf0e-2051-4e8e-8d74-4be7d99b87f1 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:27.630537 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b6edf0e-2051-4e8e-8d74-4be7d99b87f1 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:27.631506 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b6edf0e-2051-4e8e-8d74-4be7d99b87f1 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:27.633759 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b6edf0e-2051-4e8e-8d74-4be7d99b87f1 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:27.634477 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b6edf0e-2051-4e8e-8d74-4be7d99b87f1 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:27.634918 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b6edf0e-2051-4e8e-8d74-4be7d99b87f1 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:27.779986 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5b6edf0e-2051-4e8e-8d74-4be7d99b87f1 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f253afef5849d19f4e1d99b038697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76b081c02814da98ab62bfc2fe5536b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:00:27.788272 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5b6edf0e-2051-4e8e-8d74-4be7d99b87f1 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2d2a90-4445-4d35-81a2-7d075c408630" status: 200 len: 1375 microversion: 2.1 time: 0.173048 Oct 23 02:00:27.788871 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3590/7082] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:00:27 2022] GET /compute/v2.1/servers/3b2d2a90-4445-4d35-81a2-7d075c408630 => generated 1375 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:00:28.508925 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-864e2590-c721-4b0a-83b3-604eb1edfce8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:00:28.511818 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-864e2590-c721-4b0a-83b3-604eb1edfce8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 9acf9d26-0453-4655-aca0-626fa37cf6ee] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:00:28.511978 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=6 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:00:28.518381 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-864e2590-c721-4b0a-83b3-604eb1edfce8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:28.518896 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-864e2590-c721-4b0a-83b3-604eb1edfce8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:28.519357 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-864e2590-c721-4b0a-83b3-604eb1edfce8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:28.520094 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-864e2590-c721-4b0a-83b3-604eb1edfce8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:28.520603 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-864e2590-c721-4b0a-83b3-604eb1edfce8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:28.521049 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-864e2590-c721-4b0a-83b3-604eb1edfce8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:28.588033 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-864e2590-c721-4b0a-83b3-604eb1edfce8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:00:28.596023 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-864e2590-c721-4b0a-83b3-604eb1edfce8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee" status: 200 len: 1225 microversion: 2.1 time: 0.091113 Oct 23 02:00:28.596599 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3493/7083] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:00:28 2022] GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:00:28.812060 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-029e0d25-9497-4ccd-9a14-630edadd05d3 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:00:28.812578 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-029e0d25-9497-4ccd-9a14-630edadd05d3 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 3b2d2a90-4445-4d35-81a2-7d075c408630] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:00:28.814720 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:00:28.815404 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=6 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:00:28.821674 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-029e0d25-9497-4ccd-9a14-630edadd05d3 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:28.822196 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-029e0d25-9497-4ccd-9a14-630edadd05d3 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:28.822640 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-029e0d25-9497-4ccd-9a14-630edadd05d3 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:28.823996 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-029e0d25-9497-4ccd-9a14-630edadd05d3 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:28.824709 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-029e0d25-9497-4ccd-9a14-630edadd05d3 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:28.825141 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-029e0d25-9497-4ccd-9a14-630edadd05d3 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:28.967185 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-029e0d25-9497-4ccd-9a14-630edadd05d3 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f253afef5849d19f4e1d99b038697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76b081c02814da98ab62bfc2fe5536b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:00:28.974924 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-029e0d25-9497-4ccd-9a14-630edadd05d3 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2d2a90-4445-4d35-81a2-7d075c408630" status: 200 len: 1375 microversion: 2.1 time: 0.166983 Oct 23 02:00:28.975632 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3591/7084] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:00:28 2022] GET /compute/v2.1/servers/3b2d2a90-4445-4d35-81a2-7d075c408630 => generated 1375 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:00:29.620731 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0eee3e9a-363d-4703-a814-4debf2e23b2e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:00:29.621349 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0eee3e9a-363d-4703-a814-4debf2e23b2e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 9acf9d26-0453-4655-aca0-626fa37cf6ee] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:00:29.627742 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0eee3e9a-363d-4703-a814-4debf2e23b2e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:29.629463 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0eee3e9a-363d-4703-a814-4debf2e23b2e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:29.629463 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0eee3e9a-363d-4703-a814-4debf2e23b2e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:29.629463 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0eee3e9a-363d-4703-a814-4debf2e23b2e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:29.629828 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0eee3e9a-363d-4703-a814-4debf2e23b2e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:29.630616 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0eee3e9a-363d-4703-a814-4debf2e23b2e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:29.645098 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-0eee3e9a-363d-4703-a814-4debf2e23b2e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] HTTP exception thrown: Instance 9acf9d26-0453-4655-aca0-626fa37cf6ee could not be found. Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0eee3e9a-363d-4703-a814-4debf2e23b2e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Request method failure captured: Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee HTTP/1.1 Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJ238gvy9Iqj-gh_hYMMA3k82GIwOXmge1ZpdCVbStgEi7Wx0Hp0nUD39OZgeTVVZUzzMU6rbj6VKVMThBnKMFJkrT_c4TpJItwEaxJM150Q197EeZTFOgQpHEVnJj9TzM6T9aiiAWqKRliV_RYi1MvsQfVRPMVtUboRY7WK1bO1DBQ Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: b1ec0b5ecaa741eaaf40a50f1415e7f9 Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-TestVolumeBootPattern-219047212 Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}] Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-TestVolumeBootPattern-219047212 Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: b1ec0b5ecaa741eaaf40a50f1415e7f9 Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-TestVolumeBootPattern-219047212 Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-TestVolumeBootPattern-219047212-project Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: f2967d0d8c134d269c9bbe51c90f803a Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-TestVolumeBootPattern-219047212-project Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 9acf9d26-0453-4655-aca0-626fa37cf6ee could not be found. Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '9acf9d26-0453-4655-aca0-626fa37cf6ee'} Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9acf9d26-0453-4655-aca0-626fa37cf6ee could not be found. Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9acf9d26-0453-4655-aca0-626fa37cf6ee could not be found. Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:00:29.646803 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:00:29.651403 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:00:29.651403 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:00:29.651403 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:00:29.651403 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:00:29.651403 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:00:29.651403 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9acf9d26-0453-4655-aca0-626fa37cf6ee could not be found. Oct 23 02:00:29.651403 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:00:29.651403 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0eee3e9a-363d-4703-a814-4debf2e23b2e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Returning 404 to user: Instance 9acf9d26-0453-4655-aca0-626fa37cf6ee could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:00:29.651403 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0eee3e9a-363d-4703-a814-4debf2e23b2e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee" status: 404 len: 111 microversion: 2.1 time: 0.033428 Oct 23 02:00:29.651403 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3592/7085] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:00:29 2022] GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 02:00:29.675989 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-7c775541-a5d7-463c-9b1d-02e8e0afb335 req-728d0c3e-03d8-49fb-aad0-3c33bddd992a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b2d2a90-4445-4d35-81a2-7d075c408630", "name": "network-vif-plugged", "status": "completed", "tag": "c94ae1b5-88b7-4338-a836-a05150c527eb"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:00:29.686981 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-7c775541-a5d7-463c-9b1d-02e8e0afb335 req-728d0c3e-03d8-49fb-aad0-3c33bddd992a service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:29.687546 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-7c775541-a5d7-463c-9b1d-02e8e0afb335 req-728d0c3e-03d8-49fb-aad0-3c33bddd992a service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:29.687984 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-7c775541-a5d7-463c-9b1d-02e8e0afb335 req-728d0c3e-03d8-49fb-aad0-3c33bddd992a service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:29.699718 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-7c775541-a5d7-463c-9b1d-02e8e0afb335 req-728d0c3e-03d8-49fb-aad0-3c33bddd992a service nova] Creating event network-vif-plugged:c94ae1b5-88b7-4338-a836-a05150c527eb for instance 3b2d2a90-4445-4d35-81a2-7d075c408630 on n-h2-master-1 Oct 23 02:00:29.706859 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-7c775541-a5d7-463c-9b1d-02e8e0afb335 req-728d0c3e-03d8-49fb-aad0-3c33bddd992a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108364 Oct 23 02:00:29.707477 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3494/7086] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:00:29.708720 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-353e6138-f268-48fb-8a44-f9941d23e0ec tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1315038245", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-179536436", "security_groups": [{"name": "tempest-secgroup-smoke-735288621"}], "block_device_mapping_v2": [{"uuid": "87d9ef54-b895-4b06-842e-6d9d8379d80f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e056504c-8568-4f9a-a3ed-bae9f108b4ab"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:00:29.827528 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-353e6138-f268-48fb-8a44-f9941d23e0ec tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] validate_networks() for [('e056504c-8568-4f9a-a3ed-bae9f108b4ab', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 02:00:29.997926 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9389c296-b8dd-4554-8b32-46eeade4e83b tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:00:29.998672 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9389c296-b8dd-4554-8b32-46eeade4e83b tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 3b2d2a90-4445-4d35-81a2-7d075c408630] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:00:30.004897 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9389c296-b8dd-4554-8b32-46eeade4e83b tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:30.008018 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9389c296-b8dd-4554-8b32-46eeade4e83b tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:30.008576 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9389c296-b8dd-4554-8b32-46eeade4e83b tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:30.009382 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9389c296-b8dd-4554-8b32-46eeade4e83b tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:30.009930 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9389c296-b8dd-4554-8b32-46eeade4e83b tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:30.010492 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9389c296-b8dd-4554-8b32-46eeade4e83b tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:30.231553 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9389c296-b8dd-4554-8b32-46eeade4e83b tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f253afef5849d19f4e1d99b038697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76b081c02814da98ab62bfc2fe5536b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:00:30.239235 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9389c296-b8dd-4554-8b32-46eeade4e83b tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2d2a90-4445-4d35-81a2-7d075c408630" status: 200 len: 1375 microversion: 2.1 time: 0.245681 Oct 23 02:00:30.239809 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3495/7087] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:00:29 2022] GET /compute/v2.1/servers/3b2d2a90-4445-4d35-81a2-7d075c408630 => generated 1375 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:00:30.272514 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-353e6138-f268-48fb-8a44-f9941d23e0ec tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:00:30.272955 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-353e6138-f268-48fb-8a44-f9941d23e0ec tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:00:30.273468 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-353e6138-f268-48fb-8a44-f9941d23e0ec tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:00:30.273913 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-353e6138-f268-48fb-8a44-f9941d23e0ec tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:00:30.274374 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-353e6138-f268-48fb-8a44-f9941d23e0ec tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:00:30.283914 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-353e6138-f268-48fb-8a44-f9941d23e0ec tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:30.284400 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-353e6138-f268-48fb-8a44-f9941d23e0ec tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:30.284841 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-353e6138-f268-48fb-8a44-f9941d23e0ec tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:30.285570 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-353e6138-f268-48fb-8a44-f9941d23e0ec tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:30.286060 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-353e6138-f268-48fb-8a44-f9941d23e0ec tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:30.286496 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-353e6138-f268-48fb-8a44-f9941d23e0ec tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:30.304172 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-353e6138-f268-48fb-8a44-f9941d23e0ec tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Getting quotas for project b1ec0b5ecaa741eaaf40a50f1415e7f9. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:00:30.309500 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-353e6138-f268-48fb-8a44-f9941d23e0ec tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Getting quotas for user f2967d0d8c134d269c9bbe51c90f803a and project b1ec0b5ecaa741eaaf40a50f1415e7f9. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:00:30.367837 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-353e6138-f268-48fb-8a44-f9941d23e0ec tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 02:00:30.370079 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-353e6138-f268-48fb-8a44-f9941d23e0ec tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 2e2cf5d4-cf48-4d9d-b353-4295cdcd952d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='87d9ef54-b895-4b06-842e-6d9d8379d80f',volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 02:00:30.663435 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-353e6138-f268-48fb-8a44-f9941d23e0ec tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.959196 Oct 23 02:00:30.664019 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3593/7088] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 02:00:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 961 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 02:00:30.675386 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-377e8323-4646-4bba-ace9-d220274d5497 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:00:30.678687 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-377e8323-4646-4bba-ace9-d220274d5497 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 2e2cf5d4-cf48-4d9d-b353-4295cdcd952d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:00:30.731212 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-377e8323-4646-4bba-ace9-d220274d5497 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:00:30.738208 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-377e8323-4646-4bba-ace9-d220274d5497 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d" status: 200 len: 1094 microversion: 2.1 time: 0.066530 Oct 23 02:00:30.738867 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3496/7089] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:00:30 2022] GET /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:00:31.262775 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cb3912f5-1d2f-4b59-862a-209facb4c793 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:00:31.263406 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-cb3912f5-1d2f-4b59-862a-209facb4c793 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 3b2d2a90-4445-4d35-81a2-7d075c408630] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:00:31.269659 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cb3912f5-1d2f-4b59-862a-209facb4c793 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:31.272987 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cb3912f5-1d2f-4b59-862a-209facb4c793 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:31.272987 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cb3912f5-1d2f-4b59-862a-209facb4c793 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:31.272987 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cb3912f5-1d2f-4b59-862a-209facb4c793 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:31.272987 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cb3912f5-1d2f-4b59-862a-209facb4c793 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:31.272987 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cb3912f5-1d2f-4b59-862a-209facb4c793 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:31.410044 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cb3912f5-1d2f-4b59-862a-209facb4c793 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f253afef5849d19f4e1d99b038697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76b081c02814da98ab62bfc2fe5536b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:00:31.418793 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cb3912f5-1d2f-4b59-862a-209facb4c793 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2d2a90-4445-4d35-81a2-7d075c408630" status: 200 len: 1547 microversion: 2.1 time: 0.160944 Oct 23 02:00:31.422381 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3594/7090] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:00:31 2022] GET /compute/v2.1/servers/3b2d2a90-4445-4d35-81a2-7d075c408630 => generated 1547 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:00:31.441627 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ef1cc909-97da-4ad0-bd2c-37a348dabbc6 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:00:31.442256 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ef1cc909-97da-4ad0-bd2c-37a348dabbc6 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 3b2d2a90-4445-4d35-81a2-7d075c408630] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:00:31.451823 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef1cc909-97da-4ad0-bd2c-37a348dabbc6 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:31.452360 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef1cc909-97da-4ad0-bd2c-37a348dabbc6 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:31.456887 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef1cc909-97da-4ad0-bd2c-37a348dabbc6 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:31.456887 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef1cc909-97da-4ad0-bd2c-37a348dabbc6 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:31.456887 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef1cc909-97da-4ad0-bd2c-37a348dabbc6 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:31.456887 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef1cc909-97da-4ad0-bd2c-37a348dabbc6 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:31.585376 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ef1cc909-97da-4ad0-bd2c-37a348dabbc6 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f253afef5849d19f4e1d99b038697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76b081c02814da98ab62bfc2fe5536b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:00:31.593840 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ef1cc909-97da-4ad0-bd2c-37a348dabbc6 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2d2a90-4445-4d35-81a2-7d075c408630" status: 200 len: 1547 microversion: 2.1 time: 0.156225 Oct 23 02:00:31.596155 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3497/7091] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:00:31 2022] GET /compute/v2.1/servers/3b2d2a90-4445-4d35-81a2-7d075c408630 => generated 1547 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:00:31.761695 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-01c9df70-5660-4439-a216-aa29e8737e68 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:00:31.762346 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-01c9df70-5660-4439-a216-aa29e8737e68 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 2e2cf5d4-cf48-4d9d-b353-4295cdcd952d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:00:31.768523 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01c9df70-5660-4439-a216-aa29e8737e68 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:31.769019 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01c9df70-5660-4439-a216-aa29e8737e68 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:31.769462 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01c9df70-5660-4439-a216-aa29e8737e68 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:31.770195 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01c9df70-5660-4439-a216-aa29e8737e68 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:31.770678 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01c9df70-5660-4439-a216-aa29e8737e68 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:31.771283 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01c9df70-5660-4439-a216-aa29e8737e68 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:31.848133 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-01c9df70-5660-4439-a216-aa29e8737e68 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:00:31.856132 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-01c9df70-5660-4439-a216-aa29e8737e68 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d" status: 200 len: 1136 microversion: 2.1 time: 0.098870 Oct 23 02:00:31.856906 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3595/7092] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:00:31 2022] GET /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d => generated 1136 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:00:32.879212 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d90038b5-936a-43c0-813a-74433fb4d115 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:00:32.879845 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d90038b5-936a-43c0-813a-74433fb4d115 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 2e2cf5d4-cf48-4d9d-b353-4295cdcd952d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:00:32.886407 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d90038b5-936a-43c0-813a-74433fb4d115 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:32.887042 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d90038b5-936a-43c0-813a-74433fb4d115 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:32.887590 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d90038b5-936a-43c0-813a-74433fb4d115 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:32.888378 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d90038b5-936a-43c0-813a-74433fb4d115 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:32.888925 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d90038b5-936a-43c0-813a-74433fb4d115 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:32.889379 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d90038b5-936a-43c0-813a-74433fb4d115 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:32.959827 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d90038b5-936a-43c0-813a-74433fb4d115 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:00:32.968035 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d90038b5-936a-43c0-813a-74433fb4d115 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d" status: 200 len: 1200 microversion: 2.1 time: 0.092873 Oct 23 02:00:32.968622 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3498/7093] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:00:32 2022] GET /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d => generated 1200 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:00:33.664299 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-45192381-b724-4d37-9307-c70763b3fda9 req-d73a530a-ebbf-46a9-a706-ace7aadf3013 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b2d2a90-4445-4d35-81a2-7d075c408630", "tag": "c94ae1b5-88b7-4338-a836-a05150c527eb"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:00:33.694430 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-45192381-b724-4d37-9307-c70763b3fda9 req-d73a530a-ebbf-46a9-a706-ace7aadf3013 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:33.695288 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-45192381-b724-4d37-9307-c70763b3fda9 req-d73a530a-ebbf-46a9-a706-ace7aadf3013 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:33.697817 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-45192381-b724-4d37-9307-c70763b3fda9 req-d73a530a-ebbf-46a9-a706-ace7aadf3013 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:33.717109 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-45192381-b724-4d37-9307-c70763b3fda9 req-d73a530a-ebbf-46a9-a706-ace7aadf3013 service nova] Creating event network-changed:c94ae1b5-88b7-4338-a836-a05150c527eb for instance 3b2d2a90-4445-4d35-81a2-7d075c408630 on n-h2-master-1 Oct 23 02:00:33.724647 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-45192381-b724-4d37-9307-c70763b3fda9 req-d73a530a-ebbf-46a9-a706-ace7aadf3013 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069484 Oct 23 02:00:33.729041 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3596/7094] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:00:33.992624 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bdfb3f24-9ebb-4ac4-964e-e97b8704e0a7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:00:33.994566 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-bdfb3f24-9ebb-4ac4-964e-e97b8704e0a7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 2e2cf5d4-cf48-4d9d-b353-4295cdcd952d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:00:34.002340 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bdfb3f24-9ebb-4ac4-964e-e97b8704e0a7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:34.003385 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bdfb3f24-9ebb-4ac4-964e-e97b8704e0a7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:34.004502 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bdfb3f24-9ebb-4ac4-964e-e97b8704e0a7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:34.005533 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bdfb3f24-9ebb-4ac4-964e-e97b8704e0a7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:34.006295 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bdfb3f24-9ebb-4ac4-964e-e97b8704e0a7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:34.007094 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bdfb3f24-9ebb-4ac4-964e-e97b8704e0a7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:34.175159 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bdfb3f24-9ebb-4ac4-964e-e97b8704e0a7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:00:34.185261 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bdfb3f24-9ebb-4ac4-964e-e97b8704e0a7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d" status: 200 len: 1277 microversion: 2.1 time: 0.197109 Oct 23 02:00:34.190370 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3499/7095] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:00:33 2022] GET /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d => generated 1277 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:00:35.212123 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-98a06d09-f384-420a-abfb-7422c4307c80 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:00:35.212842 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-98a06d09-f384-420a-abfb-7422c4307c80 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 2e2cf5d4-cf48-4d9d-b353-4295cdcd952d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:00:35.220270 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-98a06d09-f384-420a-abfb-7422c4307c80 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:35.222043 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-98a06d09-f384-420a-abfb-7422c4307c80 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:35.222043 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-98a06d09-f384-420a-abfb-7422c4307c80 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:35.222043 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-98a06d09-f384-420a-abfb-7422c4307c80 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:35.222347 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-98a06d09-f384-420a-abfb-7422c4307c80 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:35.222779 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-98a06d09-f384-420a-abfb-7422c4307c80 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:35.276735 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-2d0f5350-bf1e-453e-90b5-f15f88ec5b87 req-19f3b744-8fe9-4814-b3a9-647d1f4d7b1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e2cf5d4-cf48-4d9d-b353-4295cdcd952d", "tag": "b4d5cc15-1ea5-4bb4-9e34-54800cdb9a01"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:00:35.295435 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-2d0f5350-bf1e-453e-90b5-f15f88ec5b87 req-19f3b744-8fe9-4814-b3a9-647d1f4d7b1d service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:35.296419 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-2d0f5350-bf1e-453e-90b5-f15f88ec5b87 req-19f3b744-8fe9-4814-b3a9-647d1f4d7b1d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:35.297281 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-2d0f5350-bf1e-453e-90b5-f15f88ec5b87 req-19f3b744-8fe9-4814-b3a9-647d1f4d7b1d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:35.319714 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-2d0f5350-bf1e-453e-90b5-f15f88ec5b87 req-19f3b744-8fe9-4814-b3a9-647d1f4d7b1d service nova] Creating event network-changed:b4d5cc15-1ea5-4bb4-9e34-54800cdb9a01 for instance 2e2cf5d4-cf48-4d9d-b353-4295cdcd952d on n-h1-master-1 Oct 23 02:00:35.330955 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-2d0f5350-bf1e-453e-90b5-f15f88ec5b87 req-19f3b744-8fe9-4814-b3a9-647d1f4d7b1d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061205 Oct 23 02:00:35.330955 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3500/7096] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:00:35.371088 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-98a06d09-f384-420a-abfb-7422c4307c80 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:00:35.379591 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-98a06d09-f384-420a-abfb-7422c4307c80 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d" status: 200 len: 1277 microversion: 2.1 time: 0.171704 Oct 23 02:00:35.380325 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3597/7097] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:00:35 2022] GET /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d => generated 1277 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:00:36.405783 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3e173213-f8fb-424d-b9b2-caa68b7eec93 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:00:36.411503 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3e173213-f8fb-424d-b9b2-caa68b7eec93 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 2e2cf5d4-cf48-4d9d-b353-4295cdcd952d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:00:36.413133 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3e173213-f8fb-424d-b9b2-caa68b7eec93 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:36.413740 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3e173213-f8fb-424d-b9b2-caa68b7eec93 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:36.414287 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3e173213-f8fb-424d-b9b2-caa68b7eec93 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:36.415046 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3e173213-f8fb-424d-b9b2-caa68b7eec93 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:36.415517 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3e173213-f8fb-424d-b9b2-caa68b7eec93 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:36.415967 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3e173213-f8fb-424d-b9b2-caa68b7eec93 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:36.550351 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3e173213-f8fb-424d-b9b2-caa68b7eec93 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:00:36.558839 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3e173213-f8fb-424d-b9b2-caa68b7eec93 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d" status: 200 len: 1277 microversion: 2.1 time: 0.158214 Oct 23 02:00:36.559424 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3501/7098] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:00:36 2022] GET /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d => generated 1277 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:00:37.582989 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ed617a2b-6961-4cc1-b907-96b73571bf07 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:00:37.583610 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ed617a2b-6961-4cc1-b907-96b73571bf07 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 2e2cf5d4-cf48-4d9d-b353-4295cdcd952d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:00:37.590568 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ed617a2b-6961-4cc1-b907-96b73571bf07 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:37.591005 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ed617a2b-6961-4cc1-b907-96b73571bf07 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:37.596384 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ed617a2b-6961-4cc1-b907-96b73571bf07 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:37.596384 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ed617a2b-6961-4cc1-b907-96b73571bf07 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:37.596384 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ed617a2b-6961-4cc1-b907-96b73571bf07 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:37.596384 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ed617a2b-6961-4cc1-b907-96b73571bf07 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:37.727216 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ed617a2b-6961-4cc1-b907-96b73571bf07 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:00:37.736526 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ed617a2b-6961-4cc1-b907-96b73571bf07 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d" status: 200 len: 1277 microversion: 2.1 time: 0.157894 Oct 23 02:00:37.737113 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3598/7099] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:00:37 2022] GET /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d => generated 1277 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:00:38.760032 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d28d37aa-33f5-4a67-925a-67dfd28b1cbb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:00:38.761225 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d28d37aa-33f5-4a67-925a-67dfd28b1cbb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 2e2cf5d4-cf48-4d9d-b353-4295cdcd952d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:00:38.768429 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d28d37aa-33f5-4a67-925a-67dfd28b1cbb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:38.768932 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d28d37aa-33f5-4a67-925a-67dfd28b1cbb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:38.769385 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d28d37aa-33f5-4a67-925a-67dfd28b1cbb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:38.770120 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d28d37aa-33f5-4a67-925a-67dfd28b1cbb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:38.770592 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d28d37aa-33f5-4a67-925a-67dfd28b1cbb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:38.771032 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d28d37aa-33f5-4a67-925a-67dfd28b1cbb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:38.906102 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d28d37aa-33f5-4a67-925a-67dfd28b1cbb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:00:38.913926 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d28d37aa-33f5-4a67-925a-67dfd28b1cbb tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d" status: 200 len: 1277 microversion: 2.1 time: 0.157897 Oct 23 02:00:38.914522 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3502/7100] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:00:38 2022] GET /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d => generated 1277 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:00:39.937316 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0eb55129-fe98-449e-8e4a-9377bceb009d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:00:39.937945 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0eb55129-fe98-449e-8e4a-9377bceb009d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 2e2cf5d4-cf48-4d9d-b353-4295cdcd952d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:00:39.944895 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0eb55129-fe98-449e-8e4a-9377bceb009d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:39.945370 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0eb55129-fe98-449e-8e4a-9377bceb009d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:39.945815 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0eb55129-fe98-449e-8e4a-9377bceb009d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:39.946552 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0eb55129-fe98-449e-8e4a-9377bceb009d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:39.947015 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0eb55129-fe98-449e-8e4a-9377bceb009d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:39.947445 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0eb55129-fe98-449e-8e4a-9377bceb009d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:39.951625 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:00:40.079111 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0eb55129-fe98-449e-8e4a-9377bceb009d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:00:40.087459 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0eb55129-fe98-449e-8e4a-9377bceb009d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d" status: 200 len: 1265 microversion: 2.1 time: 0.154117 Oct 23 02:00:40.088040 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3599/7101] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:00:39 2022] GET /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:00:41.114799 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-61ca1b24-be6d-404e-adc9-f2f8a93aca3d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:00:41.115485 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-61ca1b24-be6d-404e-adc9-f2f8a93aca3d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 2e2cf5d4-cf48-4d9d-b353-4295cdcd952d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:00:41.118889 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:00:41.123693 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61ca1b24-be6d-404e-adc9-f2f8a93aca3d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:41.129935 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61ca1b24-be6d-404e-adc9-f2f8a93aca3d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:41.129935 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61ca1b24-be6d-404e-adc9-f2f8a93aca3d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:41.129935 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61ca1b24-be6d-404e-adc9-f2f8a93aca3d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:41.129935 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61ca1b24-be6d-404e-adc9-f2f8a93aca3d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:41.129935 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61ca1b24-be6d-404e-adc9-f2f8a93aca3d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:41.261891 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-61ca1b24-be6d-404e-adc9-f2f8a93aca3d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:00:41.269647 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-61ca1b24-be6d-404e-adc9-f2f8a93aca3d tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d" status: 200 len: 1265 microversion: 2.1 time: 0.158795 Oct 23 02:00:41.273868 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3503/7102] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:00:41 2022] GET /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:00:42.292381 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f2fab823-7828-4a55-a9bd-a2832938a0f1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:00:42.293007 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f2fab823-7828-4a55-a9bd-a2832938a0f1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 2e2cf5d4-cf48-4d9d-b353-4295cdcd952d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:00:42.294973 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:00:42.295687 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=6 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:00:42.302105 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2fab823-7828-4a55-a9bd-a2832938a0f1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:42.302228 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2fab823-7828-4a55-a9bd-a2832938a0f1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:42.302649 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2fab823-7828-4a55-a9bd-a2832938a0f1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:42.303360 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2fab823-7828-4a55-a9bd-a2832938a0f1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:42.303826 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2fab823-7828-4a55-a9bd-a2832938a0f1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:42.304259 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2fab823-7828-4a55-a9bd-a2832938a0f1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:42.436931 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f2fab823-7828-4a55-a9bd-a2832938a0f1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:00:42.444978 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f2fab823-7828-4a55-a9bd-a2832938a0f1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d" status: 200 len: 1265 microversion: 2.1 time: 0.156615 Oct 23 02:00:42.445559 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3600/7103] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:00:42 2022] GET /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:00:43.468985 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-05f0eb7f-c8f2-48f0-a8c3-66114da91a42 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:00:43.469618 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-05f0eb7f-c8f2-48f0-a8c3-66114da91a42 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 2e2cf5d4-cf48-4d9d-b353-4295cdcd952d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:00:43.476482 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05f0eb7f-c8f2-48f0-a8c3-66114da91a42 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:43.476982 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05f0eb7f-c8f2-48f0-a8c3-66114da91a42 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:43.477429 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05f0eb7f-c8f2-48f0-a8c3-66114da91a42 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:43.478174 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05f0eb7f-c8f2-48f0-a8c3-66114da91a42 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:43.479320 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05f0eb7f-c8f2-48f0-a8c3-66114da91a42 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:43.479760 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-05f0eb7f-c8f2-48f0-a8c3-66114da91a42 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:43.500832 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=100 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:00:43.613281 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-05f0eb7f-c8f2-48f0-a8c3-66114da91a42 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:00:43.621326 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-05f0eb7f-c8f2-48f0-a8c3-66114da91a42 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d" status: 200 len: 1265 microversion: 2.1 time: 0.156244 Oct 23 02:00:43.621928 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3504/7104] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:00:43 2022] GET /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:00:44.644006 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a70f6425-5a91-4e9f-bd2b-f611f363ef75 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:00:44.644531 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a70f6425-5a91-4e9f-bd2b-f611f363ef75 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 2e2cf5d4-cf48-4d9d-b353-4295cdcd952d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:00:44.651374 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a70f6425-5a91-4e9f-bd2b-f611f363ef75 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:44.651863 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a70f6425-5a91-4e9f-bd2b-f611f363ef75 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:44.652301 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a70f6425-5a91-4e9f-bd2b-f611f363ef75 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:44.652991 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a70f6425-5a91-4e9f-bd2b-f611f363ef75 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:44.653452 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a70f6425-5a91-4e9f-bd2b-f611f363ef75 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:44.653884 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a70f6425-5a91-4e9f-bd2b-f611f363ef75 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:44.786105 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a70f6425-5a91-4e9f-bd2b-f611f363ef75 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:00:44.794401 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a70f6425-5a91-4e9f-bd2b-f611f363ef75 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d" status: 200 len: 1265 microversion: 2.1 time: 0.154427 Oct 23 02:00:44.794983 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3601/7105] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:00:44 2022] GET /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:00:45.817036 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b049831d-6b39-42cb-8f9f-cec26ec3f22b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:00:45.817568 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b049831d-6b39-42cb-8f9f-cec26ec3f22b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 2e2cf5d4-cf48-4d9d-b353-4295cdcd952d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:00:45.825634 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b049831d-6b39-42cb-8f9f-cec26ec3f22b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:45.826230 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b049831d-6b39-42cb-8f9f-cec26ec3f22b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:45.826683 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b049831d-6b39-42cb-8f9f-cec26ec3f22b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:45.827422 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b049831d-6b39-42cb-8f9f-cec26ec3f22b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:45.827894 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b049831d-6b39-42cb-8f9f-cec26ec3f22b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:45.828336 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b049831d-6b39-42cb-8f9f-cec26ec3f22b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:45.956569 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b049831d-6b39-42cb-8f9f-cec26ec3f22b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:00:45.965016 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b049831d-6b39-42cb-8f9f-cec26ec3f22b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d" status: 200 len: 1265 microversion: 2.1 time: 0.151922 Oct 23 02:00:45.965599 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3505/7106] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:00:45 2022] GET /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:00:46.988144 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ddb2bdbb-18f6-4563-985d-42f7f496301e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:00:46.988550 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ddb2bdbb-18f6-4563-985d-42f7f496301e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 2e2cf5d4-cf48-4d9d-b353-4295cdcd952d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:00:46.995759 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ddb2bdbb-18f6-4563-985d-42f7f496301e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:46.996249 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ddb2bdbb-18f6-4563-985d-42f7f496301e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:46.996690 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ddb2bdbb-18f6-4563-985d-42f7f496301e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:46.997383 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ddb2bdbb-18f6-4563-985d-42f7f496301e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:46.997845 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ddb2bdbb-18f6-4563-985d-42f7f496301e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:46.998302 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ddb2bdbb-18f6-4563-985d-42f7f496301e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:47.133554 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ddb2bdbb-18f6-4563-985d-42f7f496301e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:00:47.142539 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ddb2bdbb-18f6-4563-985d-42f7f496301e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d" status: 200 len: 1265 microversion: 2.1 time: 0.158684 Oct 23 02:00:47.143133 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3602/7107] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:00:46 2022] GET /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:00:48.164843 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d0141dcf-c599-4525-986a-17b8f57be09e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:00:48.165467 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d0141dcf-c599-4525-986a-17b8f57be09e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 2e2cf5d4-cf48-4d9d-b353-4295cdcd952d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:00:48.172394 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0141dcf-c599-4525-986a-17b8f57be09e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:48.172891 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0141dcf-c599-4525-986a-17b8f57be09e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:48.173337 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0141dcf-c599-4525-986a-17b8f57be09e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:48.174060 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0141dcf-c599-4525-986a-17b8f57be09e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:48.174534 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0141dcf-c599-4525-986a-17b8f57be09e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:48.175701 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0141dcf-c599-4525-986a-17b8f57be09e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:48.302857 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d0141dcf-c599-4525-986a-17b8f57be09e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:00:48.311097 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d0141dcf-c599-4525-986a-17b8f57be09e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d" status: 200 len: 1265 microversion: 2.1 time: 0.150011 Oct 23 02:00:48.311688 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3506/7108] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:00:48 2022] GET /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:00:49.227854 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-936cbb6b-2e98-451e-8a11-da390d80b8b4 req-f5a6a183-6e5a-4260-88c5-7767032bc925 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e2cf5d4-cf48-4d9d-b353-4295cdcd952d", "name": "network-vif-plugged", "status": "completed", "tag": "b4d5cc15-1ea5-4bb4-9e34-54800cdb9a01"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:00:49.233807 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:00:49.239048 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-936cbb6b-2e98-451e-8a11-da390d80b8b4 req-f5a6a183-6e5a-4260-88c5-7767032bc925 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:49.239534 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-936cbb6b-2e98-451e-8a11-da390d80b8b4 req-f5a6a183-6e5a-4260-88c5-7767032bc925 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:49.239968 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-936cbb6b-2e98-451e-8a11-da390d80b8b4 req-f5a6a183-6e5a-4260-88c5-7767032bc925 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:49.251494 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-936cbb6b-2e98-451e-8a11-da390d80b8b4 req-f5a6a183-6e5a-4260-88c5-7767032bc925 service nova] Creating event network-vif-plugged:b4d5cc15-1ea5-4bb4-9e34-54800cdb9a01 for instance 2e2cf5d4-cf48-4d9d-b353-4295cdcd952d on n-h1-master-1 Oct 23 02:00:49.256699 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-936cbb6b-2e98-451e-8a11-da390d80b8b4 req-f5a6a183-6e5a-4260-88c5-7767032bc925 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032626 Oct 23 02:00:49.257293 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3603/7109] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:00:49.334428 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-80a9da05-4aa4-464e-af9a-705fd0c827d3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:00:49.335069 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-80a9da05-4aa4-464e-af9a-705fd0c827d3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 2e2cf5d4-cf48-4d9d-b353-4295cdcd952d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:00:49.342055 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-80a9da05-4aa4-464e-af9a-705fd0c827d3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:49.342666 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-80a9da05-4aa4-464e-af9a-705fd0c827d3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:49.343039 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-80a9da05-4aa4-464e-af9a-705fd0c827d3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:49.343756 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-80a9da05-4aa4-464e-af9a-705fd0c827d3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:49.344229 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-80a9da05-4aa4-464e-af9a-705fd0c827d3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:49.344673 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-80a9da05-4aa4-464e-af9a-705fd0c827d3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:49.479745 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-80a9da05-4aa4-464e-af9a-705fd0c827d3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:00:49.487622 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-80a9da05-4aa4-464e-af9a-705fd0c827d3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d" status: 200 len: 1265 microversion: 2.1 time: 0.157411 Oct 23 02:00:49.488202 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3507/7110] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:00:49 2022] GET /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:00:50.513205 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-400fe764-547d-48a0-ba84-41816d47bf1a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:00:50.513928 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-400fe764-547d-48a0-ba84-41816d47bf1a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 2e2cf5d4-cf48-4d9d-b353-4295cdcd952d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:00:50.520863 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-400fe764-547d-48a0-ba84-41816d47bf1a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:50.521345 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-400fe764-547d-48a0-ba84-41816d47bf1a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:50.521813 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-400fe764-547d-48a0-ba84-41816d47bf1a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:50.522527 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-400fe764-547d-48a0-ba84-41816d47bf1a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:50.522990 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-400fe764-547d-48a0-ba84-41816d47bf1a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:50.523415 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-400fe764-547d-48a0-ba84-41816d47bf1a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:50.654824 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-400fe764-547d-48a0-ba84-41816d47bf1a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:00:50.662727 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-400fe764-547d-48a0-ba84-41816d47bf1a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d" status: 200 len: 1265 microversion: 2.1 time: 0.155794 Oct 23 02:00:50.664337 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3604/7111] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:00:50 2022] GET /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:00:51.685828 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2791df54-c2de-4d91-8317-3aeec261a40b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:00:51.686542 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2791df54-c2de-4d91-8317-3aeec261a40b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 2e2cf5d4-cf48-4d9d-b353-4295cdcd952d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:00:51.689256 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:00:51.694719 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2791df54-c2de-4d91-8317-3aeec261a40b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:51.695297 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2791df54-c2de-4d91-8317-3aeec261a40b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:51.695805 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2791df54-c2de-4d91-8317-3aeec261a40b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:51.696614 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2791df54-c2de-4d91-8317-3aeec261a40b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:51.697752 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2791df54-c2de-4d91-8317-3aeec261a40b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:51.698235 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2791df54-c2de-4d91-8317-3aeec261a40b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:51.828896 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2791df54-c2de-4d91-8317-3aeec261a40b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:00:51.836909 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2791df54-c2de-4d91-8317-3aeec261a40b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d" status: 200 len: 1453 microversion: 2.1 time: 0.155493 Oct 23 02:00:51.837482 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3508/7112] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:00:51 2022] GET /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:00:51.860294 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f8f3fcb4-3d88-426c-a9ef-1c9d215845f4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:00:51.860907 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f8f3fcb4-3d88-426c-a9ef-1c9d215845f4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 2e2cf5d4-cf48-4d9d-b353-4295cdcd952d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:00:51.867670 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8f3fcb4-3d88-426c-a9ef-1c9d215845f4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:51.868149 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8f3fcb4-3d88-426c-a9ef-1c9d215845f4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:51.868585 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8f3fcb4-3d88-426c-a9ef-1c9d215845f4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:51.869922 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8f3fcb4-3d88-426c-a9ef-1c9d215845f4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:51.870477 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8f3fcb4-3d88-426c-a9ef-1c9d215845f4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:51.870903 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f8f3fcb4-3d88-426c-a9ef-1c9d215845f4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:52.006890 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f8f3fcb4-3d88-426c-a9ef-1c9d215845f4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:00:52.014726 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f8f3fcb4-3d88-426c-a9ef-1c9d215845f4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d" status: 200 len: 1453 microversion: 2.1 time: 0.158312 Oct 23 02:00:52.015317 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3605/7113] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:00:51 2022] GET /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:00:53.896552 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-d7c57a8b-b2a9-4a95-b1b7-4b20b2ea74a3 req-f6618822-011a-450f-9833-d685d16ce1f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e2cf5d4-cf48-4d9d-b353-4295cdcd952d", "tag": "b4d5cc15-1ea5-4bb4-9e34-54800cdb9a01"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:00:53.906875 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-d7c57a8b-b2a9-4a95-b1b7-4b20b2ea74a3 req-f6618822-011a-450f-9833-d685d16ce1f5 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:53.909380 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-d7c57a8b-b2a9-4a95-b1b7-4b20b2ea74a3 req-f6618822-011a-450f-9833-d685d16ce1f5 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:53.909380 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-d7c57a8b-b2a9-4a95-b1b7-4b20b2ea74a3 req-f6618822-011a-450f-9833-d685d16ce1f5 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:53.918824 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-d7c57a8b-b2a9-4a95-b1b7-4b20b2ea74a3 req-f6618822-011a-450f-9833-d685d16ce1f5 service nova] Creating event network-changed:b4d5cc15-1ea5-4bb4-9e34-54800cdb9a01 for instance 2e2cf5d4-cf48-4d9d-b353-4295cdcd952d on n-h1-master-1 Oct 23 02:00:53.924081 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-d7c57a8b-b2a9-4a95-b1b7-4b20b2ea74a3 req-f6618822-011a-450f-9833-d685d16ce1f5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031266 Oct 23 02:00:53.924900 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3509/7114] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:00:58.361530 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-77adf09b-07f8-48e5-9e21-d10bf6e467df tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:00:58.363759 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-77adf09b-07f8-48e5-9e21-d10bf6e467df tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 3b2d2a90-4445-4d35-81a2-7d075c408630] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:00:58.371008 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-77adf09b-07f8-48e5-9e21-d10bf6e467df tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:58.371492 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-77adf09b-07f8-48e5-9e21-d10bf6e467df tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:58.371929 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-77adf09b-07f8-48e5-9e21-d10bf6e467df tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:58.372615 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-77adf09b-07f8-48e5-9e21-d10bf6e467df tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:00:58.373069 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-77adf09b-07f8-48e5-9e21-d10bf6e467df tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:00:58.373491 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-77adf09b-07f8-48e5-9e21-d10bf6e467df tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:00:58.446726 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-77adf09b-07f8-48e5-9e21-d10bf6e467df tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "POST /compute/v2.1/servers/3b2d2a90-4445-4d35-81a2-7d075c408630/action" status: 200 len: 24574 microversion: 2.1 time: 0.088980 Oct 23 02:00:58.447993 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3606/7115] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:00:58 2022] POST /compute/v2.1/servers/3b2d2a90-4445-4d35-81a2-7d075c408630/action => generated 24574 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 23 02:01:09.467284 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=3 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:01:09.468114 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=28 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:01:09.472998 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-25effc28-60b3-4bdb-acad-b2d7354d45b2 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:01:09.475681 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-25effc28-60b3-4bdb-acad-b2d7354d45b2 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 3b2d2a90-4445-4d35-81a2-7d075c408630] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:01:09.483126 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25effc28-60b3-4bdb-acad-b2d7354d45b2 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:01:09.483629 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25effc28-60b3-4bdb-acad-b2d7354d45b2 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:01:09.484079 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25effc28-60b3-4bdb-acad-b2d7354d45b2 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:01:09.484792 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25effc28-60b3-4bdb-acad-b2d7354d45b2 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:01:09.485260 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25effc28-60b3-4bdb-acad-b2d7354d45b2 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:01:09.485751 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25effc28-60b3-4bdb-acad-b2d7354d45b2 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:01:09.561837 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-25effc28-60b3-4bdb-acad-b2d7354d45b2 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "POST /compute/v2.1/servers/3b2d2a90-4445-4d35-81a2-7d075c408630/action" status: 200 len: 32648 microversion: 2.1 time: 0.096386 Oct 23 02:01:09.568881 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3510/7116] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:01:09 2022] POST /compute/v2.1/servers/3b2d2a90-4445-4d35-81a2-7d075c408630/action => generated 32648 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 02:01:10.929648 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-da2ba7bf-9357-4eb9-831c-63c96f8dba3c tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:01:10.930411 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-da2ba7bf-9357-4eb9-831c-63c96f8dba3c tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 3b2d2a90-4445-4d35-81a2-7d075c408630] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:01:10.932953 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-a0f83db8-6d11-41e2-8409-35f809d971f6 req-f9c646ec-55ca-4151-aaae-5c1721093b3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b2d2a90-4445-4d35-81a2-7d075c408630", "tag": "c94ae1b5-88b7-4338-a836-a05150c527eb"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:01:10.936926 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=7 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:01:10.937602 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=40 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:01:10.940019 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-da2ba7bf-9357-4eb9-831c-63c96f8dba3c tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:01:10.940990 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-da2ba7bf-9357-4eb9-831c-63c96f8dba3c tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:01:10.941105 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-da2ba7bf-9357-4eb9-831c-63c96f8dba3c tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:01:10.941783 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-da2ba7bf-9357-4eb9-831c-63c96f8dba3c tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:01:10.942267 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-da2ba7bf-9357-4eb9-831c-63c96f8dba3c tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:01:10.942695 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-da2ba7bf-9357-4eb9-831c-63c96f8dba3c tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:01:10.947238 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-a0f83db8-6d11-41e2-8409-35f809d971f6 req-f9c646ec-55ca-4151-aaae-5c1721093b3f service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:01:10.947949 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-a0f83db8-6d11-41e2-8409-35f809d971f6 req-f9c646ec-55ca-4151-aaae-5c1721093b3f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:01:10.948402 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-a0f83db8-6d11-41e2-8409-35f809d971f6 req-f9c646ec-55ca-4151-aaae-5c1721093b3f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:01:10.960864 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-a0f83db8-6d11-41e2-8409-35f809d971f6 req-f9c646ec-55ca-4151-aaae-5c1721093b3f service nova] Creating event network-changed:c94ae1b5-88b7-4338-a836-a05150c527eb for instance 3b2d2a90-4445-4d35-81a2-7d075c408630 on n-h2-master-1 Oct 23 02:01:10.965815 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-a0f83db8-6d11-41e2-8409-35f809d971f6 req-f9c646ec-55ca-4151-aaae-5c1721093b3f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038407 Oct 23 02:01:10.969281 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3511/7117] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:01:10.976149 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-da2ba7bf-9357-4eb9-831c-63c96f8dba3c tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 3b2d2a90-4445-4d35-81a2-7d075c408630] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 02:01:11.274326 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-da2ba7bf-9357-4eb9-831c-63c96f8dba3c tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3b2d2a90-4445-4d35-81a2-7d075c408630" status: 204 len: 0 microversion: 2.1 time: 0.348534 Oct 23 02:01:11.275012 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3607/7118] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 02:01:10 2022] DELETE /compute/v2.1/servers/3b2d2a90-4445-4d35-81a2-7d075c408630 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 02:01:11.290439 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-97475b2e-bb90-4c97-91e3-ff249b05656d tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:01:11.290439 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-97475b2e-bb90-4c97-91e3-ff249b05656d tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 3b2d2a90-4445-4d35-81a2-7d075c408630] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:01:11.292211 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-97475b2e-bb90-4c97-91e3-ff249b05656d tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:01:11.292728 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-97475b2e-bb90-4c97-91e3-ff249b05656d tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:01:11.293209 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-97475b2e-bb90-4c97-91e3-ff249b05656d tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:01:11.294556 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-97475b2e-bb90-4c97-91e3-ff249b05656d tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:01:11.295032 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-97475b2e-bb90-4c97-91e3-ff249b05656d tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:01:11.295513 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-97475b2e-bb90-4c97-91e3-ff249b05656d tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:01:11.517344 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-97475b2e-bb90-4c97-91e3-ff249b05656d tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f253afef5849d19f4e1d99b038697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76b081c02814da98ab62bfc2fe5536b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:01:11.525944 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-97475b2e-bb90-4c97-91e3-ff249b05656d tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2d2a90-4445-4d35-81a2-7d075c408630" status: 200 len: 1670 microversion: 2.1 time: 0.246234 Oct 23 02:01:11.526555 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3512/7119] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:01:11 2022] GET /compute/v2.1/servers/3b2d2a90-4445-4d35-81a2-7d075c408630 => generated 1670 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:01:12.551060 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-44be9d00-1316-4334-ba63-743c678a8ba4 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:01:12.551767 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-44be9d00-1316-4334-ba63-743c678a8ba4 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 3b2d2a90-4445-4d35-81a2-7d075c408630] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:01:12.560240 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-44be9d00-1316-4334-ba63-743c678a8ba4 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:01:12.560730 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-44be9d00-1316-4334-ba63-743c678a8ba4 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:01:12.561169 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-44be9d00-1316-4334-ba63-743c678a8ba4 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:01:12.561867 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-44be9d00-1316-4334-ba63-743c678a8ba4 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:01:12.562363 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-44be9d00-1316-4334-ba63-743c678a8ba4 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:01:12.562794 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-44be9d00-1316-4334-ba63-743c678a8ba4 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:01:12.769920 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-44be9d00-1316-4334-ba63-743c678a8ba4 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f253afef5849d19f4e1d99b038697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76b081c02814da98ab62bfc2fe5536b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:01:12.778330 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-44be9d00-1316-4334-ba63-743c678a8ba4 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2d2a90-4445-4d35-81a2-7d075c408630" status: 200 len: 1670 microversion: 2.1 time: 0.231507 Oct 23 02:01:12.779103 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3608/7120] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:01:12 2022] GET /compute/v2.1/servers/3b2d2a90-4445-4d35-81a2-7d075c408630 => generated 1670 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:01:13.508178 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-35f39c8f-6829-4959-8182-9d2d467a2b56 req-8e6527a0-3fd8-451b-a5a4-ad73398f7d6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b2d2a90-4445-4d35-81a2-7d075c408630", "name": "network-vif-deleted", "tag": "c94ae1b5-88b7-4338-a836-a05150c527eb"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:01:13.518935 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-35f39c8f-6829-4959-8182-9d2d467a2b56 req-8e6527a0-3fd8-451b-a5a4-ad73398f7d6b service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:01:13.519518 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-35f39c8f-6829-4959-8182-9d2d467a2b56 req-8e6527a0-3fd8-451b-a5a4-ad73398f7d6b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:01:13.519817 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-35f39c8f-6829-4959-8182-9d2d467a2b56 req-8e6527a0-3fd8-451b-a5a4-ad73398f7d6b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:01:13.533664 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-35f39c8f-6829-4959-8182-9d2d467a2b56 req-8e6527a0-3fd8-451b-a5a4-ad73398f7d6b service nova] Creating event network-vif-deleted:c94ae1b5-88b7-4338-a836-a05150c527eb for instance 3b2d2a90-4445-4d35-81a2-7d075c408630 on n-h2-master-1 Oct 23 02:01:13.539033 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-35f39c8f-6829-4959-8182-9d2d467a2b56 req-8e6527a0-3fd8-451b-a5a4-ad73398f7d6b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034617 Oct 23 02:01:13.539644 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3513/7121] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:01:13.803416 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4641bbac-55ab-4339-b554-244d4d3facb1 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:01:13.804095 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4641bbac-55ab-4339-b554-244d4d3facb1 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 3b2d2a90-4445-4d35-81a2-7d075c408630] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:01:13.821921 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4641bbac-55ab-4339-b554-244d4d3facb1 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:01:13.822506 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4641bbac-55ab-4339-b554-244d4d3facb1 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:01:13.822947 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4641bbac-55ab-4339-b554-244d4d3facb1 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:01:13.823805 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4641bbac-55ab-4339-b554-244d4d3facb1 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:01:13.824265 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4641bbac-55ab-4339-b554-244d4d3facb1 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:01:13.824877 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4641bbac-55ab-4339-b554-244d4d3facb1 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:01:13.901558 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4641bbac-55ab-4339-b554-244d4d3facb1 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f253afef5849d19f4e1d99b038697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76b081c02814da98ab62bfc2fe5536b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:01:13.910587 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4641bbac-55ab-4339-b554-244d4d3facb1 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2d2a90-4445-4d35-81a2-7d075c408630" status: 200 len: 1485 microversion: 2.1 time: 0.111482 Oct 23 02:01:13.911225 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3609/7122] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:01:13 2022] GET /compute/v2.1/servers/3b2d2a90-4445-4d35-81a2-7d075c408630 => generated 1485 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:01:14.935562 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4b81a050-b0d5-4749-ba03-222f3402b3b6 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:01:14.936345 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4b81a050-b0d5-4749-ba03-222f3402b3b6 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 3b2d2a90-4445-4d35-81a2-7d075c408630] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:01:14.942507 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b81a050-b0d5-4749-ba03-222f3402b3b6 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:01:14.943008 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b81a050-b0d5-4749-ba03-222f3402b3b6 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:01:14.943463 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b81a050-b0d5-4749-ba03-222f3402b3b6 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:01:14.944224 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b81a050-b0d5-4749-ba03-222f3402b3b6 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:01:14.944719 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b81a050-b0d5-4749-ba03-222f3402b3b6 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:01:14.945184 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b81a050-b0d5-4749-ba03-222f3402b3b6 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:01:14.977529 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b81a050-b0d5-4749-ba03-222f3402b3b6 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:01:14.978134 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b81a050-b0d5-4749-ba03-222f3402b3b6 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:01:14.978595 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4b81a050-b0d5-4749-ba03-222f3402b3b6 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:01:14.979057 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-4b81a050-b0d5-4749-ba03-222f3402b3b6 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lazy-loading 'fault' on Instance uuid 3b2d2a90-4445-4d35-81a2-7d075c408630 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:01:15.022263 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4b81a050-b0d5-4749-ba03-222f3402b3b6 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f253afef5849d19f4e1d99b038697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76b081c02814da98ab62bfc2fe5536b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:01:15.030749 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4b81a050-b0d5-4749-ba03-222f3402b3b6 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2d2a90-4445-4d35-81a2-7d075c408630" status: 200 len: 1339 microversion: 2.1 time: 0.100295 Oct 23 02:01:15.031418 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3514/7123] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:01:14 2022] GET /compute/v2.1/servers/3b2d2a90-4445-4d35-81a2-7d075c408630 => generated 1339 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:01:16.058836 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-89792446-2c37-4927-8dd1-ea78bc53855d tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:01:16.059457 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-89792446-2c37-4927-8dd1-ea78bc53855d tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] [instance: 3b2d2a90-4445-4d35-81a2-7d075c408630] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:01:16.067188 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-89792446-2c37-4927-8dd1-ea78bc53855d tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:01:16.067674 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-89792446-2c37-4927-8dd1-ea78bc53855d tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:01:16.068114 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-89792446-2c37-4927-8dd1-ea78bc53855d tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:01:16.068805 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-89792446-2c37-4927-8dd1-ea78bc53855d tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:01:16.069267 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-89792446-2c37-4927-8dd1-ea78bc53855d tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:01:16.069696 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-89792446-2c37-4927-8dd1-ea78bc53855d tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:01:16.083536 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-89792446-2c37-4927-8dd1-ea78bc53855d tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] HTTP exception thrown: Instance 3b2d2a90-4445-4d35-81a2-7d075c408630 could not be found. Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-89792446-2c37-4927-8dd1-ea78bc53855d tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Request method failure captured: Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/3b2d2a90-4445-4d35-81a2-7d075c408630 HTTP/1.1 Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJ-p3L7ffpbqp-TDvCQNJ8352Tj6PKsDkBlu_acKGm56X3QWFExF8V42_3red2npIFmOo9KINMcCWM9v5zLSavahu9p8xrsnQa7nsJqIsmIaxoUAwjiVaChYx88s_bmRIYTTJhDhiNnhzHjNNrYdDq4Rfc6pz_IJiVRkZ60SVcgv528 Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: e76b081c02814da98ab62bfc2fe5536b Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-TestNetworkBasicOps-383216941 Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e76b081c02814da98ab62bfc2fe5536b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e76b081c02814da98ab62bfc2fe5536b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e76b081c02814da98ab62bfc2fe5536b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e76b081c02814da98ab62bfc2fe5536b"}]}] Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-TestNetworkBasicOps-383216941 Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: e76b081c02814da98ab62bfc2fe5536b Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-TestNetworkBasicOps-383216941 Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-TestNetworkBasicOps-383216941-project Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: d2f253afef5849d19f4e1d99b038697b Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-TestNetworkBasicOps-383216941-project Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 3b2d2a90-4445-4d35-81a2-7d075c408630 could not be found. Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '3b2d2a90-4445-4d35-81a2-7d075c408630'} Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b2d2a90-4445-4d35-81a2-7d075c408630 could not be found. Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b2d2a90-4445-4d35-81a2-7d075c408630 could not be found. Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:01:16.085198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:01:16.090117 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:01:16.090117 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:01:16.090117 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:01:16.090117 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:01:16.090117 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:01:16.090117 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b2d2a90-4445-4d35-81a2-7d075c408630 could not be found. Oct 23 02:01:16.090117 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:01:16.090117 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-89792446-2c37-4927-8dd1-ea78bc53855d tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Returning 404 to user: Instance 3b2d2a90-4445-4d35-81a2-7d075c408630 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:01:16.090117 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-89792446-2c37-4927-8dd1-ea78bc53855d tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2d2a90-4445-4d35-81a2-7d075c408630" status: 404 len: 111 microversion: 2.1 time: 0.031810 Oct 23 02:01:16.090117 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3610/7124] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:01:16 2022] GET /compute/v2.1/servers/3b2d2a90-4445-4d35-81a2-7d075c408630 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:01:16.289370 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6336c721-a7db-408e-8007-d6d5c4f9a7b0 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] Calling method '.version_select at 0x7f5cc38ae0d0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:01:16.370442 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6336c721-a7db-408e-8007-d6d5c4f9a7b0 tempest-TestNetworkBasicOps-383216941 tempest-TestNetworkBasicOps-383216941-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2106786091" status: 202 len: 0 microversion: 2.1 time: 0.084900 Oct 23 02:01:16.371076 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3515/7125] 10.222.0.42 () {58 vars in 1257 bytes} [Sun Oct 23 02:01:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2106786091 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:03:18.266110 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d4366e7d-3005-4f2c-afd5-fe2987e7751b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2129967101", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-179536436", "security_groups": [{"name": "tempest-secgroup-smoke-735288621"}], "block_device_mapping_v2": [{"uuid": "f9db8c04-637a-4874-93a0-e38ac53a142b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e056504c-8568-4f9a-a3ed-bae9f108b4ab"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:03:18.276895 n-d-master-1 devstack@n-api.service[120944]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6e68fc69-29cc-49a6-b869-84458cd5ea3f] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 23 02:03:18.277429 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:03:18.278107 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:03:18.280167 n-d-master-1 devstack@n-api.service[120944]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 23 02:03:18.280316 n-d-master-1 devstack@n-api.service[120944]: Sun Oct 23 02:03:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.42) !!! Oct 23 02:03:18.282377 n-d-master-1 devstack@n-api.service[120944]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 23 02:03:18.282515 n-d-master-1 devstack@n-api.service[120944]: Sun Oct 23 02:03:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.42) !!! Oct 23 02:03:18.391329 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-d4366e7d-3005-4f2c-afd5-fe2987e7751b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] validate_networks() for [('e056504c-8568-4f9a-a3ed-bae9f108b4ab', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 02:03:18.860234 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-d4366e7d-3005-4f2c-afd5-fe2987e7751b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:03:18.860711 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-d4366e7d-3005-4f2c-afd5-fe2987e7751b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:03:18.861204 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-d4366e7d-3005-4f2c-afd5-fe2987e7751b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:03:18.861628 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-d4366e7d-3005-4f2c-afd5-fe2987e7751b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:03:18.862086 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-d4366e7d-3005-4f2c-afd5-fe2987e7751b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:03:18.871056 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d4366e7d-3005-4f2c-afd5-fe2987e7751b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:03:18.875378 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d4366e7d-3005-4f2c-afd5-fe2987e7751b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:03:18.875378 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d4366e7d-3005-4f2c-afd5-fe2987e7751b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:03:18.875378 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d4366e7d-3005-4f2c-afd5-fe2987e7751b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:03:18.875378 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d4366e7d-3005-4f2c-afd5-fe2987e7751b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:03:18.875378 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d4366e7d-3005-4f2c-afd5-fe2987e7751b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:03:18.892705 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-d4366e7d-3005-4f2c-afd5-fe2987e7751b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Getting quotas for project b1ec0b5ecaa741eaaf40a50f1415e7f9. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:03:18.898072 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-d4366e7d-3005-4f2c-afd5-fe2987e7751b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Getting quotas for user f2967d0d8c134d269c9bbe51c90f803a and project b1ec0b5ecaa741eaaf40a50f1415e7f9. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:03:18.957028 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d4366e7d-3005-4f2c-afd5-fe2987e7751b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 02:03:18.959557 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d4366e7d-3005-4f2c-afd5-fe2987e7751b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: ac82f05a-ee4c-41bc-bc1a-c7224c009296] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f9db8c04-637a-4874-93a0-e38ac53a142b',volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 02:03:19.284208 n-d-master-1 devstack@n-api.service[120944]: INFO oslo.messaging._drivers.impl_rabbit [-] [6e68fc69-29cc-49a6-b869-84458cd5ea3f] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 34544. Oct 23 02:03:19.337174 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d4366e7d-3005-4f2c-afd5-fe2987e7751b tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.076378 Oct 23 02:03:19.337845 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3611/7126] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 02:03:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 1078 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 02:03:19.347974 n-d-master-1 devstack@n-api.service[120945]: ERROR oslo.messaging._drivers.impl_rabbit [-] [819a2dfa-4c7a-455f-8870-a072098566e7] AMQP server on 10.222.0.42:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 23 02:03:19.348849 n-d-master-1 devstack@n-api.service[120945]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dc6b279b-942d-4b38-8231-bb7b36b63253] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 23 02:03:19.349378 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=22 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:03:19.350244 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:03:19.351404 n-d-master-1 devstack@n-api.service[120945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 23 02:03:19.353697 n-d-master-1 devstack@n-api.service[120945]: Sun Oct 23 02:03:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296 (ip 10.222.0.42) !!! Oct 23 02:03:19.358882 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-74901071-3b54-402a-8501-b9e98415c4dd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:03:19.360055 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-74901071-3b54-402a-8501-b9e98415c4dd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: ac82f05a-ee4c-41bc-bc1a-c7224c009296] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:03:19.676960 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-74901071-3b54-402a-8501-b9e98415c4dd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:03:19.684021 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-74901071-3b54-402a-8501-b9e98415c4dd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296" status: 200 len: 1094 microversion: 2.1 time: 0.338748 Oct 23 02:03:19.684591 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3516/7127] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:03:19 2022] GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296 => generated 1094 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:03:20.705866 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b0ae28bc-4cce-44d4-b3df-3084b6d4369f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:03:20.706555 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b0ae28bc-4cce-44d4-b3df-3084b6d4369f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: ac82f05a-ee4c-41bc-bc1a-c7224c009296] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:03:20.713842 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b0ae28bc-4cce-44d4-b3df-3084b6d4369f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:03:20.714373 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b0ae28bc-4cce-44d4-b3df-3084b6d4369f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:03:20.714818 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b0ae28bc-4cce-44d4-b3df-3084b6d4369f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:03:20.715522 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b0ae28bc-4cce-44d4-b3df-3084b6d4369f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:03:20.715984 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b0ae28bc-4cce-44d4-b3df-3084b6d4369f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:03:20.716416 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b0ae28bc-4cce-44d4-b3df-3084b6d4369f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:03:20.778727 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b0ae28bc-4cce-44d4-b3df-3084b6d4369f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:03:20.786734 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b0ae28bc-4cce-44d4-b3df-3084b6d4369f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296" status: 200 len: 1136 microversion: 2.1 time: 0.084804 Oct 23 02:03:20.787512 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3612/7128] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:03:20 2022] GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296 => generated 1136 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:03:21.810547 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e2b29e26-80c1-4897-a7bc-47b60ea80793 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:03:21.811206 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e2b29e26-80c1-4897-a7bc-47b60ea80793 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: ac82f05a-ee4c-41bc-bc1a-c7224c009296] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:03:21.823602 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e2b29e26-80c1-4897-a7bc-47b60ea80793 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:03:21.824155 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e2b29e26-80c1-4897-a7bc-47b60ea80793 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:03:21.824664 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e2b29e26-80c1-4897-a7bc-47b60ea80793 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:03:21.825323 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e2b29e26-80c1-4897-a7bc-47b60ea80793 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:03:21.825791 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e2b29e26-80c1-4897-a7bc-47b60ea80793 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:03:21.826252 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e2b29e26-80c1-4897-a7bc-47b60ea80793 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:03:21.834096 n-d-master-1 devstack@n-api.service[120945]: INFO oslo.messaging._drivers.impl_rabbit [-] [819a2dfa-4c7a-455f-8870-a072098566e7] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 34564. Oct 23 02:03:21.836330 n-d-master-1 devstack@n-api.service[120945]: INFO oslo.messaging._drivers.impl_rabbit [-] [dc6b279b-942d-4b38-8231-bb7b36b63253] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 34566. Oct 23 02:03:21.893259 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e2b29e26-80c1-4897-a7bc-47b60ea80793 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:03:21.900971 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e2b29e26-80c1-4897-a7bc-47b60ea80793 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296" status: 200 len: 1200 microversion: 2.1 time: 0.094684 Oct 23 02:03:21.903976 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3517/7129] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:03:21 2022] GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296 => generated 1200 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:03:22.926098 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-22065b06-55dc-4d0c-a7e7-89becd866ea3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:03:22.927673 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-22065b06-55dc-4d0c-a7e7-89becd866ea3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: ac82f05a-ee4c-41bc-bc1a-c7224c009296] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:03:22.935082 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-22065b06-55dc-4d0c-a7e7-89becd866ea3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:03:22.936176 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-22065b06-55dc-4d0c-a7e7-89becd866ea3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:03:22.936623 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-22065b06-55dc-4d0c-a7e7-89becd866ea3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:03:22.938227 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-22065b06-55dc-4d0c-a7e7-89becd866ea3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:03:22.938855 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-22065b06-55dc-4d0c-a7e7-89becd866ea3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:03:22.939443 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-22065b06-55dc-4d0c-a7e7-89becd866ea3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:03:23.081194 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-22065b06-55dc-4d0c-a7e7-89becd866ea3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:03:23.090776 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-22065b06-55dc-4d0c-a7e7-89becd866ea3 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296" status: 200 len: 1277 microversion: 2.1 time: 0.169408 Oct 23 02:03:23.091357 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3613/7130] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:03:22 2022] GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296 => generated 1277 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:03:23.540373 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-54041173-8c22-4871-b736-d06a006479b1 req-4c348c38-c34d-49b3-8679-44431b065aca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac82f05a-ee4c-41bc-bc1a-c7224c009296", "tag": "d0fe6681-d737-476b-807d-4a19429c516e"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:03:23.570104 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-54041173-8c22-4871-b736-d06a006479b1 req-4c348c38-c34d-49b3-8679-44431b065aca service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:03:23.570705 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-54041173-8c22-4871-b736-d06a006479b1 req-4c348c38-c34d-49b3-8679-44431b065aca service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:03:23.571179 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-54041173-8c22-4871-b736-d06a006479b1 req-4c348c38-c34d-49b3-8679-44431b065aca service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:03:23.585512 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-54041173-8c22-4871-b736-d06a006479b1 req-4c348c38-c34d-49b3-8679-44431b065aca service nova] Creating event network-changed:d0fe6681-d737-476b-807d-4a19429c516e for instance ac82f05a-ee4c-41bc-bc1a-c7224c009296 on n-h2-master-1 Oct 23 02:03:23.590812 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-54041173-8c22-4871-b736-d06a006479b1 req-4c348c38-c34d-49b3-8679-44431b065aca service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054432 Oct 23 02:03:23.591422 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3518/7131] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:03:24.117723 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9d798ada-e447-417c-820b-f416dfc3158e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:03:24.118988 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9d798ada-e447-417c-820b-f416dfc3158e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: ac82f05a-ee4c-41bc-bc1a-c7224c009296] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:03:24.130226 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9d798ada-e447-417c-820b-f416dfc3158e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:03:24.131057 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9d798ada-e447-417c-820b-f416dfc3158e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:03:24.131713 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9d798ada-e447-417c-820b-f416dfc3158e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:03:24.132610 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9d798ada-e447-417c-820b-f416dfc3158e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:03:24.133258 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9d798ada-e447-417c-820b-f416dfc3158e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:03:24.133878 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9d798ada-e447-417c-820b-f416dfc3158e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:03:24.308499 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9d798ada-e447-417c-820b-f416dfc3158e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:03:24.321400 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9d798ada-e447-417c-820b-f416dfc3158e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296" status: 200 len: 1277 microversion: 2.1 time: 0.207673 Oct 23 02:03:24.322325 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3614/7132] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:03:24 2022] GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296 => generated 1277 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:03:25.347503 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1c13f6c3-84c8-4583-9400-712b52c7ccba tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:03:25.348228 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1c13f6c3-84c8-4583-9400-712b52c7ccba tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: ac82f05a-ee4c-41bc-bc1a-c7224c009296] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:03:25.354687 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c13f6c3-84c8-4583-9400-712b52c7ccba tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:03:25.355224 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c13f6c3-84c8-4583-9400-712b52c7ccba tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:03:25.355672 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c13f6c3-84c8-4583-9400-712b52c7ccba tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:03:25.356383 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c13f6c3-84c8-4583-9400-712b52c7ccba tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:03:25.356864 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c13f6c3-84c8-4583-9400-712b52c7ccba tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:03:25.357301 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c13f6c3-84c8-4583-9400-712b52c7ccba tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:03:25.498780 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1c13f6c3-84c8-4583-9400-712b52c7ccba tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:03:25.507371 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1c13f6c3-84c8-4583-9400-712b52c7ccba tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296" status: 200 len: 1277 microversion: 2.1 time: 0.165622 Oct 23 02:03:25.507967 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3519/7133] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:03:25 2022] GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296 => generated 1277 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:03:26.530640 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2dc2d4fa-8f69-40d5-9071-c3a312c2e2de tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:03:26.531875 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2dc2d4fa-8f69-40d5-9071-c3a312c2e2de tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: ac82f05a-ee4c-41bc-bc1a-c7224c009296] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:03:26.539277 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2dc2d4fa-8f69-40d5-9071-c3a312c2e2de tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:03:26.580922 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2dc2d4fa-8f69-40d5-9071-c3a312c2e2de tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:03:26.580922 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2dc2d4fa-8f69-40d5-9071-c3a312c2e2de tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:03:26.580922 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2dc2d4fa-8f69-40d5-9071-c3a312c2e2de tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:03:26.580922 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2dc2d4fa-8f69-40d5-9071-c3a312c2e2de tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:03:26.580922 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2dc2d4fa-8f69-40d5-9071-c3a312c2e2de tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:03:26.673775 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2dc2d4fa-8f69-40d5-9071-c3a312c2e2de tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:03:26.682081 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2dc2d4fa-8f69-40d5-9071-c3a312c2e2de tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296" status: 200 len: 1277 microversion: 2.1 time: 0.155207 Oct 23 02:03:26.682597 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3615/7134] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:03:26 2022] GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296 => generated 1277 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:03:27.706056 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2b08fa16-e5bd-4210-ba80-833efef104ca tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:03:27.706626 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2b08fa16-e5bd-4210-ba80-833efef104ca tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: ac82f05a-ee4c-41bc-bc1a-c7224c009296] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:03:27.713880 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2b08fa16-e5bd-4210-ba80-833efef104ca tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:03:27.714487 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2b08fa16-e5bd-4210-ba80-833efef104ca tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:03:27.714878 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2b08fa16-e5bd-4210-ba80-833efef104ca tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:03:27.715592 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2b08fa16-e5bd-4210-ba80-833efef104ca tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:03:27.716069 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2b08fa16-e5bd-4210-ba80-833efef104ca tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:03:27.716514 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2b08fa16-e5bd-4210-ba80-833efef104ca tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:03:27.845860 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2b08fa16-e5bd-4210-ba80-833efef104ca tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:03:27.853810 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2b08fa16-e5bd-4210-ba80-833efef104ca tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296" status: 200 len: 1265 microversion: 2.1 time: 0.152530 Oct 23 02:03:27.854418 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3520/7135] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:03:27 2022] GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:03:28.876185 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e9281af6-7b39-44e8-aa2d-9ab9ac67146e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:03:28.876810 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e9281af6-7b39-44e8-aa2d-9ab9ac67146e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: ac82f05a-ee4c-41bc-bc1a-c7224c009296] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:03:28.883318 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:03:28.885110 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9281af6-7b39-44e8-aa2d-9ab9ac67146e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:03:28.885600 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9281af6-7b39-44e8-aa2d-9ab9ac67146e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:03:28.886068 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9281af6-7b39-44e8-aa2d-9ab9ac67146e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:03:28.886769 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9281af6-7b39-44e8-aa2d-9ab9ac67146e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:03:28.887229 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9281af6-7b39-44e8-aa2d-9ab9ac67146e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:03:28.887664 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9281af6-7b39-44e8-aa2d-9ab9ac67146e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:03:28.905256 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=6 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:03:29.020666 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e9281af6-7b39-44e8-aa2d-9ab9ac67146e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:03:29.028404 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e9281af6-7b39-44e8-aa2d-9ab9ac67146e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296" status: 200 len: 1265 microversion: 2.1 time: 0.156187 Oct 23 02:03:29.028980 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3616/7136] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:03:28 2022] GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:03:30.052342 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-91d5c395-a3ed-4498-a892-2f81f22974e8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:03:30.052972 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-91d5c395-a3ed-4498-a892-2f81f22974e8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: ac82f05a-ee4c-41bc-bc1a-c7224c009296] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:03:30.055902 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:03:30.060669 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-91d5c395-a3ed-4498-a892-2f81f22974e8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:03:30.061170 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-91d5c395-a3ed-4498-a892-2f81f22974e8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:03:30.061622 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-91d5c395-a3ed-4498-a892-2f81f22974e8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:03:30.062397 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-91d5c395-a3ed-4498-a892-2f81f22974e8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:03:30.062866 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-91d5c395-a3ed-4498-a892-2f81f22974e8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:03:30.063303 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-91d5c395-a3ed-4498-a892-2f81f22974e8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:03:30.194574 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-91d5c395-a3ed-4498-a892-2f81f22974e8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:03:30.202733 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-91d5c395-a3ed-4498-a892-2f81f22974e8 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296" status: 200 len: 1265 microversion: 2.1 time: 0.154506 Oct 23 02:03:30.203306 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3521/7137] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:03:30 2022] GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:03:31.226523 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-255c276b-cb30-42a9-af65-2173d6042587 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:03:31.227143 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-255c276b-cb30-42a9-af65-2173d6042587 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: ac82f05a-ee4c-41bc-bc1a-c7224c009296] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:03:31.234114 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-255c276b-cb30-42a9-af65-2173d6042587 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:03:31.234598 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-255c276b-cb30-42a9-af65-2173d6042587 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:03:31.235037 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-255c276b-cb30-42a9-af65-2173d6042587 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:03:31.235728 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-255c276b-cb30-42a9-af65-2173d6042587 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:03:31.236186 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-255c276b-cb30-42a9-af65-2173d6042587 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:03:31.236609 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-255c276b-cb30-42a9-af65-2173d6042587 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:03:31.373253 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-255c276b-cb30-42a9-af65-2173d6042587 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:03:31.381649 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-255c276b-cb30-42a9-af65-2173d6042587 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296" status: 200 len: 1265 microversion: 2.1 time: 0.159089 Oct 23 02:03:31.382254 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3617/7138] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:03:31 2022] GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:03:32.404714 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0b412897-a7f1-4518-8a9c-47ea80a9e5f6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:03:32.405343 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0b412897-a7f1-4518-8a9c-47ea80a9e5f6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: ac82f05a-ee4c-41bc-bc1a-c7224c009296] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:03:32.412392 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b412897-a7f1-4518-8a9c-47ea80a9e5f6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:03:32.412888 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b412897-a7f1-4518-8a9c-47ea80a9e5f6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:03:32.413332 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b412897-a7f1-4518-8a9c-47ea80a9e5f6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:03:32.414049 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b412897-a7f1-4518-8a9c-47ea80a9e5f6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:03:32.414519 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b412897-a7f1-4518-8a9c-47ea80a9e5f6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:03:32.414955 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b412897-a7f1-4518-8a9c-47ea80a9e5f6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:03:32.546493 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0b412897-a7f1-4518-8a9c-47ea80a9e5f6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:03:32.554883 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0b412897-a7f1-4518-8a9c-47ea80a9e5f6 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296" status: 200 len: 1265 microversion: 2.1 time: 0.154059 Oct 23 02:03:32.555469 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3522/7139] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:03:32 2022] GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:03:33.576811 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c6e1eba3-22cd-444a-b2e7-81d1d916f24f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:03:33.577429 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c6e1eba3-22cd-444a-b2e7-81d1d916f24f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: ac82f05a-ee4c-41bc-bc1a-c7224c009296] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:03:33.584555 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c6e1eba3-22cd-444a-b2e7-81d1d916f24f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:03:33.585047 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c6e1eba3-22cd-444a-b2e7-81d1d916f24f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:03:33.585486 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c6e1eba3-22cd-444a-b2e7-81d1d916f24f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:03:33.586210 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c6e1eba3-22cd-444a-b2e7-81d1d916f24f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:03:33.586673 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c6e1eba3-22cd-444a-b2e7-81d1d916f24f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:03:33.587106 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c6e1eba3-22cd-444a-b2e7-81d1d916f24f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:03:33.721110 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c6e1eba3-22cd-444a-b2e7-81d1d916f24f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:03:33.729006 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c6e1eba3-22cd-444a-b2e7-81d1d916f24f tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296" status: 200 len: 1265 microversion: 2.1 time: 0.156161 Oct 23 02:03:33.731144 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3618/7140] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:03:33 2022] GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:03:34.752122 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-71c68a7b-dc4d-42fe-9e66-e0da1f303183 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:03:34.752787 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-71c68a7b-dc4d-42fe-9e66-e0da1f303183 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: ac82f05a-ee4c-41bc-bc1a-c7224c009296] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:03:34.760172 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-71c68a7b-dc4d-42fe-9e66-e0da1f303183 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:03:34.760677 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-71c68a7b-dc4d-42fe-9e66-e0da1f303183 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:03:34.761134 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-71c68a7b-dc4d-42fe-9e66-e0da1f303183 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:03:34.761838 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-71c68a7b-dc4d-42fe-9e66-e0da1f303183 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:03:34.762353 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-71c68a7b-dc4d-42fe-9e66-e0da1f303183 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:03:34.762819 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-71c68a7b-dc4d-42fe-9e66-e0da1f303183 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:03:34.892449 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-71c68a7b-dc4d-42fe-9e66-e0da1f303183 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:03:34.903454 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-71c68a7b-dc4d-42fe-9e66-e0da1f303183 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296" status: 200 len: 1265 microversion: 2.1 time: 0.152876 Oct 23 02:03:34.903454 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3523/7141] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:03:34 2022] GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:03:35.923724 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e0bde879-ec6e-40cf-b5fa-c06552fdd619 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:03:35.924280 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e0bde879-ec6e-40cf-b5fa-c06552fdd619 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: ac82f05a-ee4c-41bc-bc1a-c7224c009296] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:03:35.931787 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0bde879-ec6e-40cf-b5fa-c06552fdd619 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:03:35.932285 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0bde879-ec6e-40cf-b5fa-c06552fdd619 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:03:35.932735 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0bde879-ec6e-40cf-b5fa-c06552fdd619 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:03:35.933436 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0bde879-ec6e-40cf-b5fa-c06552fdd619 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:03:35.933903 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0bde879-ec6e-40cf-b5fa-c06552fdd619 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:03:35.934368 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0bde879-ec6e-40cf-b5fa-c06552fdd619 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:03:36.063475 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e0bde879-ec6e-40cf-b5fa-c06552fdd619 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:03:36.072160 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e0bde879-ec6e-40cf-b5fa-c06552fdd619 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296" status: 200 len: 1265 microversion: 2.1 time: 0.152445 Oct 23 02:03:36.072907 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3619/7142] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:03:35 2022] GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:03:37.095208 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d8e102a2-2a39-4f4a-b990-85893ea4117e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:03:37.095839 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d8e102a2-2a39-4f4a-b990-85893ea4117e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: ac82f05a-ee4c-41bc-bc1a-c7224c009296] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:03:37.102772 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d8e102a2-2a39-4f4a-b990-85893ea4117e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:03:37.103267 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d8e102a2-2a39-4f4a-b990-85893ea4117e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:03:37.103718 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d8e102a2-2a39-4f4a-b990-85893ea4117e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:03:37.104466 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d8e102a2-2a39-4f4a-b990-85893ea4117e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:03:37.104934 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d8e102a2-2a39-4f4a-b990-85893ea4117e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:03:37.105373 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d8e102a2-2a39-4f4a-b990-85893ea4117e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:03:37.238402 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d8e102a2-2a39-4f4a-b990-85893ea4117e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:03:37.246332 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d8e102a2-2a39-4f4a-b990-85893ea4117e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296" status: 200 len: 1265 microversion: 2.1 time: 0.154990 Oct 23 02:03:37.246911 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3524/7143] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:03:37 2022] GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:03:38.269424 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6dab2c4b-f1e5-4dbf-b87a-a2000e3b5426 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:03:38.270074 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6dab2c4b-f1e5-4dbf-b87a-a2000e3b5426 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: ac82f05a-ee4c-41bc-bc1a-c7224c009296] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:03:38.277016 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6dab2c4b-f1e5-4dbf-b87a-a2000e3b5426 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:03:38.277510 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6dab2c4b-f1e5-4dbf-b87a-a2000e3b5426 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:03:38.277956 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6dab2c4b-f1e5-4dbf-b87a-a2000e3b5426 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:03:38.278675 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6dab2c4b-f1e5-4dbf-b87a-a2000e3b5426 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:03:38.279131 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6dab2c4b-f1e5-4dbf-b87a-a2000e3b5426 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:03:38.279558 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6dab2c4b-f1e5-4dbf-b87a-a2000e3b5426 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:03:38.304210 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-b480d225-d6b7-472a-a038-d9c5979b6414 req-512f2206-494b-4fa2-8e31-245445ea45fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac82f05a-ee4c-41bc-bc1a-c7224c009296", "name": "network-vif-plugged", "status": "completed", "tag": "d0fe6681-d737-476b-807d-4a19429c516e"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:03:38.315293 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-b480d225-d6b7-472a-a038-d9c5979b6414 req-512f2206-494b-4fa2-8e31-245445ea45fc service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:03:38.316009 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-b480d225-d6b7-472a-a038-d9c5979b6414 req-512f2206-494b-4fa2-8e31-245445ea45fc service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:03:38.316463 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-b480d225-d6b7-472a-a038-d9c5979b6414 req-512f2206-494b-4fa2-8e31-245445ea45fc service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:03:38.328598 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-b480d225-d6b7-472a-a038-d9c5979b6414 req-512f2206-494b-4fa2-8e31-245445ea45fc service nova] Creating event network-vif-plugged:d0fe6681-d737-476b-807d-4a19429c516e for instance ac82f05a-ee4c-41bc-bc1a-c7224c009296 on n-h2-master-1 Oct 23 02:03:38.334706 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-b480d225-d6b7-472a-a038-d9c5979b6414 req-512f2206-494b-4fa2-8e31-245445ea45fc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034122 Oct 23 02:03:38.335476 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3525/7144] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:03:38.414004 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6dab2c4b-f1e5-4dbf-b87a-a2000e3b5426 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:03:38.422970 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6dab2c4b-f1e5-4dbf-b87a-a2000e3b5426 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296" status: 200 len: 1265 microversion: 2.1 time: 0.158107 Oct 23 02:03:38.423787 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3620/7145] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:03:38 2022] GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:03:39.447733 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f4d92560-47c0-422e-97c8-662239002ae0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:03:39.448452 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f4d92560-47c0-422e-97c8-662239002ae0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: ac82f05a-ee4c-41bc-bc1a-c7224c009296] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:03:39.455711 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f4d92560-47c0-422e-97c8-662239002ae0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:03:39.456209 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f4d92560-47c0-422e-97c8-662239002ae0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:03:39.456654 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f4d92560-47c0-422e-97c8-662239002ae0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:03:39.458059 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f4d92560-47c0-422e-97c8-662239002ae0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:03:39.458541 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f4d92560-47c0-422e-97c8-662239002ae0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:03:39.459251 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f4d92560-47c0-422e-97c8-662239002ae0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:03:39.596785 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f4d92560-47c0-422e-97c8-662239002ae0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:03:39.604657 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f4d92560-47c0-422e-97c8-662239002ae0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296" status: 200 len: 1265 microversion: 2.1 time: 0.161354 Oct 23 02:03:39.605262 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3526/7146] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:03:39 2022] GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:03:40.628207 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b3a24623-b0d1-4bb4-9aaf-8aa5599e5351 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:03:40.628829 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b3a24623-b0d1-4bb4-9aaf-8aa5599e5351 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: ac82f05a-ee4c-41bc-bc1a-c7224c009296] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:03:40.635882 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b3a24623-b0d1-4bb4-9aaf-8aa5599e5351 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:03:40.636365 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b3a24623-b0d1-4bb4-9aaf-8aa5599e5351 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:03:40.636807 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b3a24623-b0d1-4bb4-9aaf-8aa5599e5351 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:03:40.637492 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b3a24623-b0d1-4bb4-9aaf-8aa5599e5351 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:03:40.637945 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b3a24623-b0d1-4bb4-9aaf-8aa5599e5351 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:03:40.638401 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b3a24623-b0d1-4bb4-9aaf-8aa5599e5351 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:03:40.767910 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b3a24623-b0d1-4bb4-9aaf-8aa5599e5351 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:03:40.776407 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b3a24623-b0d1-4bb4-9aaf-8aa5599e5351 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296" status: 200 len: 1453 microversion: 2.1 time: 0.152287 Oct 23 02:03:40.776999 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3621/7147] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:03:40 2022] GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:03:40.800048 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b4c666e6-13cd-4def-a49d-9b75e32fa37e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:03:40.800684 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b4c666e6-13cd-4def-a49d-9b75e32fa37e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: ac82f05a-ee4c-41bc-bc1a-c7224c009296] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:03:40.807726 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b4c666e6-13cd-4def-a49d-9b75e32fa37e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:03:40.808223 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b4c666e6-13cd-4def-a49d-9b75e32fa37e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:03:40.808676 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b4c666e6-13cd-4def-a49d-9b75e32fa37e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:03:40.809378 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b4c666e6-13cd-4def-a49d-9b75e32fa37e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:03:40.809856 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b4c666e6-13cd-4def-a49d-9b75e32fa37e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:03:40.810322 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b4c666e6-13cd-4def-a49d-9b75e32fa37e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:03:40.939112 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b4c666e6-13cd-4def-a49d-9b75e32fa37e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:03:40.947573 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b4c666e6-13cd-4def-a49d-9b75e32fa37e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296" status: 200 len: 1453 microversion: 2.1 time: 0.151423 Oct 23 02:03:40.948149 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3527/7148] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:03:40 2022] GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:03:43.202217 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-a51fb641-084f-4c19-be72-018a0f18187b req-d19ca5de-65ce-4c93-bacd-970f15d3d7c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac82f05a-ee4c-41bc-bc1a-c7224c009296", "tag": "d0fe6681-d737-476b-807d-4a19429c516e"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:03:43.213056 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-a51fb641-084f-4c19-be72-018a0f18187b req-d19ca5de-65ce-4c93-bacd-970f15d3d7c2 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:03:43.213559 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-a51fb641-084f-4c19-be72-018a0f18187b req-d19ca5de-65ce-4c93-bacd-970f15d3d7c2 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:03:43.214104 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-a51fb641-084f-4c19-be72-018a0f18187b req-d19ca5de-65ce-4c93-bacd-970f15d3d7c2 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:03:43.225281 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-a51fb641-084f-4c19-be72-018a0f18187b req-d19ca5de-65ce-4c93-bacd-970f15d3d7c2 service nova] Creating event network-changed:d0fe6681-d737-476b-807d-4a19429c516e for instance ac82f05a-ee4c-41bc-bc1a-c7224c009296 on n-h2-master-1 Oct 23 02:03:43.230740 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-a51fb641-084f-4c19-be72-018a0f18187b req-d19ca5de-65ce-4c93-bacd-970f15d3d7c2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166877 Oct 23 02:03:43.231522 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3622/7149] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:05:48.116049 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=26 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:05:48.117341 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=58 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:05:48.118550 n-d-master-1 devstack@n-api.service[120944]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ed487b5d-fedf-4013-b387-a53679baa86e] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 23 02:05:48.118957 n-d-master-1 devstack@n-api.service[120945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 23 02:05:48.118957 n-d-master-1 devstack@n-api.service[120945]: Sun Oct 23 02:05:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296 (ip 10.222.0.42) !!! Oct 23 02:05:48.120060 n-d-master-1 devstack@n-api.service[120944]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6e68fc69-29cc-49a6-b869-84458cd5ea3f] AMQP server on 10.222.0.42:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 23 02:05:48.120896 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:05:48.122327 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=64 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:05:48.124026 n-d-master-1 devstack@n-api.service[120945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 23 02:05:48.124026 n-d-master-1 devstack@n-api.service[120945]: Sun Oct 23 02:05:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296 (ip 10.222.0.42) !!! Oct 23 02:05:48.135340 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5a0c7046-5fc5-4a4f-92db-bd4f960407c7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:05:48.135909 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5a0c7046-5fc5-4a4f-92db-bd4f960407c7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: ac82f05a-ee4c-41bc-bc1a-c7224c009296] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:05:48.150963 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5a0c7046-5fc5-4a4f-92db-bd4f960407c7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:05:48.152969 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5a0c7046-5fc5-4a4f-92db-bd4f960407c7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:05:48.152969 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5a0c7046-5fc5-4a4f-92db-bd4f960407c7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:05:48.152969 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5a0c7046-5fc5-4a4f-92db-bd4f960407c7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:05:48.153229 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5a0c7046-5fc5-4a4f-92db-bd4f960407c7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:05:48.154717 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5a0c7046-5fc5-4a4f-92db-bd4f960407c7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:05:48.183787 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5a0c7046-5fc5-4a4f-92db-bd4f960407c7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: ac82f05a-ee4c-41bc-bc1a-c7224c009296] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 02:05:48.195731 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-35510d8b-1bac-4ef4-94f5-fda885bb4f20 req-7c650100-64c9-49a1-baee-1ce325ece564 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac82f05a-ee4c-41bc-bc1a-c7224c009296", "tag": "d0fe6681-d737-476b-807d-4a19429c516e"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:05:48.207963 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-35510d8b-1bac-4ef4-94f5-fda885bb4f20 req-7c650100-64c9-49a1-baee-1ce325ece564 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:05:48.210112 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-35510d8b-1bac-4ef4-94f5-fda885bb4f20 req-7c650100-64c9-49a1-baee-1ce325ece564 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:05:48.210112 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-35510d8b-1bac-4ef4-94f5-fda885bb4f20 req-7c650100-64c9-49a1-baee-1ce325ece564 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:05:48.220850 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-35510d8b-1bac-4ef4-94f5-fda885bb4f20 req-7c650100-64c9-49a1-baee-1ce325ece564 service nova] Creating event network-changed:d0fe6681-d737-476b-807d-4a19429c516e for instance ac82f05a-ee4c-41bc-bc1a-c7224c009296 on n-h2-master-1 Oct 23 02:05:48.226737 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-35510d8b-1bac-4ef4-94f5-fda885bb4f20 req-7c650100-64c9-49a1-baee-1ce325ece564 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109797 Oct 23 02:05:48.227505 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3623/7150] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:05:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:05:48.490638 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5a0c7046-5fc5-4a4f-92db-bd4f960407c7 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296" status: 204 len: 0 microversion: 2.1 time: 0.375857 Oct 23 02:05:48.491751 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3528/7151] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 02:05:48 2022] DELETE /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 02:05:48.505211 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-913d8ce7-f5cd-4adc-8954-cf74f525c492 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:05:48.506333 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-913d8ce7-f5cd-4adc-8954-cf74f525c492 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: ac82f05a-ee4c-41bc-bc1a-c7224c009296] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:05:48.513951 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-913d8ce7-f5cd-4adc-8954-cf74f525c492 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:05:48.515110 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-913d8ce7-f5cd-4adc-8954-cf74f525c492 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:05:48.516328 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-913d8ce7-f5cd-4adc-8954-cf74f525c492 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:05:48.517285 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-913d8ce7-f5cd-4adc-8954-cf74f525c492 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:05:48.517958 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-913d8ce7-f5cd-4adc-8954-cf74f525c492 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:05:48.518894 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-913d8ce7-f5cd-4adc-8954-cf74f525c492 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:05:48.666406 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-913d8ce7-f5cd-4adc-8954-cf74f525c492 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:05:48.674626 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-913d8ce7-f5cd-4adc-8954-cf74f525c492 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296" status: 200 len: 1578 microversion: 2.1 time: 0.174118 Oct 23 02:05:48.675224 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3624/7152] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:05:48 2022] GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296 => generated 1578 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:05:49.699447 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8f60c714-5ab5-4b24-9143-6650f16131fd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:05:49.700167 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8f60c714-5ab5-4b24-9143-6650f16131fd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: ac82f05a-ee4c-41bc-bc1a-c7224c009296] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:05:49.707175 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f60c714-5ab5-4b24-9143-6650f16131fd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:05:49.707686 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f60c714-5ab5-4b24-9143-6650f16131fd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:05:49.708141 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f60c714-5ab5-4b24-9143-6650f16131fd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:05:49.708825 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f60c714-5ab5-4b24-9143-6650f16131fd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:05:49.709300 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f60c714-5ab5-4b24-9143-6650f16131fd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:05:49.709739 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f60c714-5ab5-4b24-9143-6650f16131fd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:05:49.841500 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8f60c714-5ab5-4b24-9143-6650f16131fd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:05:49.849844 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8f60c714-5ab5-4b24-9143-6650f16131fd tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296" status: 200 len: 1578 microversion: 2.1 time: 0.154751 Oct 23 02:05:49.850465 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3529/7153] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:05:49 2022] GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296 => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:05:50.873907 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1646d86d-5a68-4cb6-bd02-dd70618f3afe tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:05:50.874568 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1646d86d-5a68-4cb6-bd02-dd70618f3afe tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: ac82f05a-ee4c-41bc-bc1a-c7224c009296] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:05:50.884633 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1646d86d-5a68-4cb6-bd02-dd70618f3afe tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:05:50.885208 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1646d86d-5a68-4cb6-bd02-dd70618f3afe tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:05:50.885651 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1646d86d-5a68-4cb6-bd02-dd70618f3afe tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:05:50.886391 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1646d86d-5a68-4cb6-bd02-dd70618f3afe tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:05:50.886944 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1646d86d-5a68-4cb6-bd02-dd70618f3afe tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:05:50.887381 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1646d86d-5a68-4cb6-bd02-dd70618f3afe tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:05:50.911050 n-d-master-1 devstack@n-api.service[120944]: INFO oslo.messaging._drivers.impl_rabbit [-] [6e68fc69-29cc-49a6-b869-84458cd5ea3f] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 34690. Oct 23 02:05:50.911868 n-d-master-1 devstack@n-api.service[120944]: INFO oslo.messaging._drivers.impl_rabbit [-] [ed487b5d-fedf-4013-b387-a53679baa86e] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 34688. Oct 23 02:05:50.961411 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1646d86d-5a68-4cb6-bd02-dd70618f3afe tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:05:50.968621 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1646d86d-5a68-4cb6-bd02-dd70618f3afe tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296" status: 200 len: 1392 microversion: 2.1 time: 0.098614 Oct 23 02:05:50.969332 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3625/7154] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:05:50 2022] GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296 => generated 1392 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:05:50.986452 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-09b9080b-b5fd-4635-b4d5-3818e425eda9 req-f1996e83-d5d7-4434-9526-ed1059b927b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac82f05a-ee4c-41bc-bc1a-c7224c009296", "name": "network-vif-deleted", "tag": "d0fe6681-d737-476b-807d-4a19429c516e"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:05:50.995998 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-09b9080b-b5fd-4635-b4d5-3818e425eda9 req-f1996e83-d5d7-4434-9526-ed1059b927b7 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:05:50.996497 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-09b9080b-b5fd-4635-b4d5-3818e425eda9 req-f1996e83-d5d7-4434-9526-ed1059b927b7 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:05:50.996942 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-09b9080b-b5fd-4635-b4d5-3818e425eda9 req-f1996e83-d5d7-4434-9526-ed1059b927b7 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:05:51.008611 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-09b9080b-b5fd-4635-b4d5-3818e425eda9 req-f1996e83-d5d7-4434-9526-ed1059b927b7 service nova] Creating event network-vif-deleted:d0fe6681-d737-476b-807d-4a19429c516e for instance ac82f05a-ee4c-41bc-bc1a-c7224c009296 on n-h2-master-1 Oct 23 02:05:51.013642 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-09b9080b-b5fd-4635-b4d5-3818e425eda9 req-f1996e83-d5d7-4434-9526-ed1059b927b7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040099 Oct 23 02:05:51.017960 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3530/7155] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:05:51.992994 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2e29c4d4-c2f0-4cc9-ba0d-c7c3e8b93f49 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:05:51.993627 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2e29c4d4-c2f0-4cc9-ba0d-c7c3e8b93f49 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: ac82f05a-ee4c-41bc-bc1a-c7224c009296] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:05:52.001658 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e29c4d4-c2f0-4cc9-ba0d-c7c3e8b93f49 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:05:52.002187 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e29c4d4-c2f0-4cc9-ba0d-c7c3e8b93f49 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:05:52.002667 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e29c4d4-c2f0-4cc9-ba0d-c7c3e8b93f49 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:05:52.003385 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e29c4d4-c2f0-4cc9-ba0d-c7c3e8b93f49 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:05:52.003848 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e29c4d4-c2f0-4cc9-ba0d-c7c3e8b93f49 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:05:52.004290 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e29c4d4-c2f0-4cc9-ba0d-c7c3e8b93f49 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:05:52.068014 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2e29c4d4-c2f0-4cc9-ba0d-c7c3e8b93f49 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:05:52.076218 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2e29c4d4-c2f0-4cc9-ba0d-c7c3e8b93f49 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296" status: 200 len: 1225 microversion: 2.1 time: 0.087199 Oct 23 02:05:52.076805 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3626/7156] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:05:51 2022] GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:05:53.102117 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4d083a7c-c078-4e29-a73e-d6bd24fd2047 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:05:53.102753 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4d083a7c-c078-4e29-a73e-d6bd24fd2047 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: ac82f05a-ee4c-41bc-bc1a-c7224c009296] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:05:53.109048 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4d083a7c-c078-4e29-a73e-d6bd24fd2047 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:05:53.109557 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4d083a7c-c078-4e29-a73e-d6bd24fd2047 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:05:53.110032 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4d083a7c-c078-4e29-a73e-d6bd24fd2047 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:05:53.110748 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4d083a7c-c078-4e29-a73e-d6bd24fd2047 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:05:53.111228 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4d083a7c-c078-4e29-a73e-d6bd24fd2047 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:05:53.111673 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4d083a7c-c078-4e29-a73e-d6bd24fd2047 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:05:53.178349 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4d083a7c-c078-4e29-a73e-d6bd24fd2047 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:05:53.186222 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4d083a7c-c078-4e29-a73e-d6bd24fd2047 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296" status: 200 len: 1225 microversion: 2.1 time: 0.089514 Oct 23 02:05:53.186807 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3531/7157] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:05:53 2022] GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:05:54.209441 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-869dc2a0-52c0-4600-b213-b770d9a290a0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:05:54.211263 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-869dc2a0-52c0-4600-b213-b770d9a290a0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: ac82f05a-ee4c-41bc-bc1a-c7224c009296] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:05:54.218725 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-869dc2a0-52c0-4600-b213-b770d9a290a0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:05:54.219227 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-869dc2a0-52c0-4600-b213-b770d9a290a0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:05:54.219933 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-869dc2a0-52c0-4600-b213-b770d9a290a0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:05:54.220708 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-869dc2a0-52c0-4600-b213-b770d9a290a0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:05:54.221214 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-869dc2a0-52c0-4600-b213-b770d9a290a0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:05:54.221657 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-869dc2a0-52c0-4600-b213-b770d9a290a0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:05:54.286530 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-869dc2a0-52c0-4600-b213-b770d9a290a0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:05:54.294536 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-869dc2a0-52c0-4600-b213-b770d9a290a0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296" status: 200 len: 1225 microversion: 2.1 time: 0.089079 Oct 23 02:05:54.295120 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3627/7158] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:05:54 2022] GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:05:55.317328 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1e788d40-4660-4db2-a800-f26ff84f6293 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:05:55.318007 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1e788d40-4660-4db2-a800-f26ff84f6293 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: ac82f05a-ee4c-41bc-bc1a-c7224c009296] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:05:55.324967 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1e788d40-4660-4db2-a800-f26ff84f6293 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:05:55.326124 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1e788d40-4660-4db2-a800-f26ff84f6293 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:05:55.326577 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1e788d40-4660-4db2-a800-f26ff84f6293 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:05:55.327291 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1e788d40-4660-4db2-a800-f26ff84f6293 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:05:55.328861 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1e788d40-4660-4db2-a800-f26ff84f6293 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:05:55.329318 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1e788d40-4660-4db2-a800-f26ff84f6293 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:05:55.395114 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1e788d40-4660-4db2-a800-f26ff84f6293 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:05:55.402894 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1e788d40-4660-4db2-a800-f26ff84f6293 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296" status: 200 len: 1225 microversion: 2.1 time: 0.089524 Oct 23 02:05:55.403468 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3532/7159] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:05:55 2022] GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:05:56.426970 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-efabc1ef-d3f6-43fe-bfe5-67c65d259148 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:05:56.427596 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-efabc1ef-d3f6-43fe-bfe5-67c65d259148 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: ac82f05a-ee4c-41bc-bc1a-c7224c009296] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:05:56.434596 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-efabc1ef-d3f6-43fe-bfe5-67c65d259148 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:05:56.435085 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-efabc1ef-d3f6-43fe-bfe5-67c65d259148 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:05:56.435531 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-efabc1ef-d3f6-43fe-bfe5-67c65d259148 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:05:56.436226 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-efabc1ef-d3f6-43fe-bfe5-67c65d259148 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:05:56.436691 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-efabc1ef-d3f6-43fe-bfe5-67c65d259148 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:05:56.437127 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-efabc1ef-d3f6-43fe-bfe5-67c65d259148 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:05:56.450329 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-efabc1ef-d3f6-43fe-bfe5-67c65d259148 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] HTTP exception thrown: Instance ac82f05a-ee4c-41bc-bc1a-c7224c009296 could not be found. Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-efabc1ef-d3f6-43fe-bfe5-67c65d259148 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Request method failure captured: Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296 HTTP/1.1 Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJ238gvy9Iqj-gh_hYMMA3k82GIwOXmge1ZpdCVbStgEi7Wx0Hp0nUD39OZgeTVVZUzzMU6rbj6VKVMThBnKMFJkrT_c4TpJItwEaxJM150Q197EeZTFOgQpHEVnJj9TzM6T9aiiAWqKRliV_RYi1MvsQfVRPMVtUboRY7WK1bO1DBQ Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: b1ec0b5ecaa741eaaf40a50f1415e7f9 Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-TestVolumeBootPattern-219047212 Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}] Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-TestVolumeBootPattern-219047212 Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: b1ec0b5ecaa741eaaf40a50f1415e7f9 Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-TestVolumeBootPattern-219047212 Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-TestVolumeBootPattern-219047212-project Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: f2967d0d8c134d269c9bbe51c90f803a Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-TestVolumeBootPattern-219047212-project Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: exception: Instance ac82f05a-ee4c-41bc-bc1a-c7224c009296 could not be found. Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'ac82f05a-ee4c-41bc-bc1a-c7224c009296'} Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac82f05a-ee4c-41bc-bc1a-c7224c009296 could not be found. Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac82f05a-ee4c-41bc-bc1a-c7224c009296 could not be found. Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:05:56.451975 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:05:56.456199 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:05:56.456199 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:05:56.456199 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:05:56.456199 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:05:56.456199 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:05:56.456199 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac82f05a-ee4c-41bc-bc1a-c7224c009296 could not be found. Oct 23 02:05:56.456199 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:05:56.456199 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-efabc1ef-d3f6-43fe-bfe5-67c65d259148 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Returning 404 to user: Instance ac82f05a-ee4c-41bc-bc1a-c7224c009296 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:05:56.456199 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-efabc1ef-d3f6-43fe-bfe5-67c65d259148 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296" status: 404 len: 111 microversion: 2.1 time: 0.031010 Oct 23 02:05:56.456199 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3628/7160] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:05:56 2022] GET /compute/v2.1/servers/ac82f05a-ee4c-41bc-bc1a-c7224c009296 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:06:02.915882 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5293829a-577e-45e4-8baf-5ee8ac6b271a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:06:02.916540 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5293829a-577e-45e4-8baf-5ee8ac6b271a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 2e2cf5d4-cf48-4d9d-b353-4295cdcd952d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:06:02.918527 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-b56b92d9-505e-487f-a29d-4db00b39f001 req-0ce3e491-ca01-49e4-8af7-cbb81c877439 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e2cf5d4-cf48-4d9d-b353-4295cdcd952d", "tag": "b4d5cc15-1ea5-4bb4-9e34-54800cdb9a01"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:06:02.923846 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5293829a-577e-45e4-8baf-5ee8ac6b271a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:02.924360 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5293829a-577e-45e4-8baf-5ee8ac6b271a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:02.924809 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5293829a-577e-45e4-8baf-5ee8ac6b271a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:02.925531 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5293829a-577e-45e4-8baf-5ee8ac6b271a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:02.926030 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5293829a-577e-45e4-8baf-5ee8ac6b271a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:02.926503 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5293829a-577e-45e4-8baf-5ee8ac6b271a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:02.932004 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-b56b92d9-505e-487f-a29d-4db00b39f001 req-0ce3e491-ca01-49e4-8af7-cbb81c877439 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:02.932498 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-b56b92d9-505e-487f-a29d-4db00b39f001 req-0ce3e491-ca01-49e4-8af7-cbb81c877439 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:02.932939 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-b56b92d9-505e-487f-a29d-4db00b39f001 req-0ce3e491-ca01-49e4-8af7-cbb81c877439 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:02.945516 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-b56b92d9-505e-487f-a29d-4db00b39f001 req-0ce3e491-ca01-49e4-8af7-cbb81c877439 service nova] Creating event network-changed:b4d5cc15-1ea5-4bb4-9e34-54800cdb9a01 for instance 2e2cf5d4-cf48-4d9d-b353-4295cdcd952d on n-h1-master-1 Oct 23 02:06:02.951205 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-b56b92d9-505e-487f-a29d-4db00b39f001 req-0ce3e491-ca01-49e4-8af7-cbb81c877439 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036443 Oct 23 02:06:02.952435 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3629/7161] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:06:02.953178 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5293829a-577e-45e4-8baf-5ee8ac6b271a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 2e2cf5d4-cf48-4d9d-b353-4295cdcd952d] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 02:06:03.208656 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5293829a-577e-45e4-8baf-5ee8ac6b271a tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d" status: 204 len: 0 microversion: 2.1 time: 0.296425 Oct 23 02:06:03.209528 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3533/7162] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 02:06:02 2022] DELETE /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 02:06:03.220461 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-309a3835-88de-49f1-90d8-0d82967731a5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:06:03.221477 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-309a3835-88de-49f1-90d8-0d82967731a5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 2e2cf5d4-cf48-4d9d-b353-4295cdcd952d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:06:03.228512 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-309a3835-88de-49f1-90d8-0d82967731a5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:03.228969 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-309a3835-88de-49f1-90d8-0d82967731a5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:03.229413 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-309a3835-88de-49f1-90d8-0d82967731a5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:03.230806 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-309a3835-88de-49f1-90d8-0d82967731a5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:03.231285 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-309a3835-88de-49f1-90d8-0d82967731a5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:03.231832 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-309a3835-88de-49f1-90d8-0d82967731a5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:03.368435 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-309a3835-88de-49f1-90d8-0d82967731a5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:06:03.377032 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-309a3835-88de-49f1-90d8-0d82967731a5 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d" status: 200 len: 1578 microversion: 2.1 time: 0.162403 Oct 23 02:06:03.377624 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3630/7163] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:06:03 2022] GET /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:06:04.402571 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c3bc99fe-a2c1-46db-9e32-98a589882930 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:06:04.403397 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c3bc99fe-a2c1-46db-9e32-98a589882930 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 2e2cf5d4-cf48-4d9d-b353-4295cdcd952d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:06:04.410817 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c3bc99fe-a2c1-46db-9e32-98a589882930 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:04.411317 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c3bc99fe-a2c1-46db-9e32-98a589882930 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:04.411763 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c3bc99fe-a2c1-46db-9e32-98a589882930 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:04.412463 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c3bc99fe-a2c1-46db-9e32-98a589882930 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:04.412926 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c3bc99fe-a2c1-46db-9e32-98a589882930 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:04.413363 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c3bc99fe-a2c1-46db-9e32-98a589882930 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:04.548927 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c3bc99fe-a2c1-46db-9e32-98a589882930 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:06:04.556800 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c3bc99fe-a2c1-46db-9e32-98a589882930 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d" status: 200 len: 1459 microversion: 2.1 time: 0.158564 Oct 23 02:06:04.557380 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3534/7164] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:06:04 2022] GET /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d => generated 1459 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:06:04.967997 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-0f99cb13-9a3d-40be-85d6-3fadd569b93c req-7f2a04dc-e5b5-4c9c-99db-3ae968b4dfa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e2cf5d4-cf48-4d9d-b353-4295cdcd952d", "name": "network-vif-deleted", "tag": "b4d5cc15-1ea5-4bb4-9e34-54800cdb9a01"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:06:04.978513 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-0f99cb13-9a3d-40be-85d6-3fadd569b93c req-7f2a04dc-e5b5-4c9c-99db-3ae968b4dfa9 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:04.979001 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-0f99cb13-9a3d-40be-85d6-3fadd569b93c req-7f2a04dc-e5b5-4c9c-99db-3ae968b4dfa9 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:04.979439 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-0f99cb13-9a3d-40be-85d6-3fadd569b93c req-7f2a04dc-e5b5-4c9c-99db-3ae968b4dfa9 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:04.991549 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-0f99cb13-9a3d-40be-85d6-3fadd569b93c req-7f2a04dc-e5b5-4c9c-99db-3ae968b4dfa9 service nova] Creating event network-vif-deleted:b4d5cc15-1ea5-4bb4-9e34-54800cdb9a01 for instance 2e2cf5d4-cf48-4d9d-b353-4295cdcd952d on n-h1-master-1 Oct 23 02:06:04.996776 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-0f99cb13-9a3d-40be-85d6-3fadd569b93c req-7f2a04dc-e5b5-4c9c-99db-3ae968b4dfa9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032538 Oct 23 02:06:04.997390 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3631/7165] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:06:05.580337 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f9f3d645-e475-4ac3-ae8c-b815ca92138e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:06:05.581148 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f9f3d645-e475-4ac3-ae8c-b815ca92138e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 2e2cf5d4-cf48-4d9d-b353-4295cdcd952d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:06:05.588519 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f9f3d645-e475-4ac3-ae8c-b815ca92138e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:05.589027 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f9f3d645-e475-4ac3-ae8c-b815ca92138e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:05.589486 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f9f3d645-e475-4ac3-ae8c-b815ca92138e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:05.590238 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f9f3d645-e475-4ac3-ae8c-b815ca92138e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:05.590712 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f9f3d645-e475-4ac3-ae8c-b815ca92138e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:05.591152 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f9f3d645-e475-4ac3-ae8c-b815ca92138e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:05.665449 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f9f3d645-e475-4ac3-ae8c-b815ca92138e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:06:05.665449 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f9f3d645-e475-4ac3-ae8c-b815ca92138e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d" status: 200 len: 1225 microversion: 2.1 time: 0.088535 Oct 23 02:06:05.665907 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3535/7166] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:06:05 2022] GET /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:06:06.690434 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-256d7a40-1f4e-4df1-a503-1a9584cc61e1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:06:06.691143 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-256d7a40-1f4e-4df1-a503-1a9584cc61e1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 2e2cf5d4-cf48-4d9d-b353-4295cdcd952d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:06:06.697647 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-256d7a40-1f4e-4df1-a503-1a9584cc61e1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:06.698178 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-256d7a40-1f4e-4df1-a503-1a9584cc61e1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:06.698623 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-256d7a40-1f4e-4df1-a503-1a9584cc61e1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:06.699328 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-256d7a40-1f4e-4df1-a503-1a9584cc61e1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:06.699792 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-256d7a40-1f4e-4df1-a503-1a9584cc61e1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:06.700228 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-256d7a40-1f4e-4df1-a503-1a9584cc61e1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:06.769113 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-256d7a40-1f4e-4df1-a503-1a9584cc61e1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:06:06.777118 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-256d7a40-1f4e-4df1-a503-1a9584cc61e1 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d" status: 200 len: 1225 microversion: 2.1 time: 0.092475 Oct 23 02:06:06.777713 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3632/7167] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:06:06 2022] GET /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:06:07.799809 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-353625ff-50ae-4cd4-a218-d6cd7d147691 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:06:07.800352 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-353625ff-50ae-4cd4-a218-d6cd7d147691 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 2e2cf5d4-cf48-4d9d-b353-4295cdcd952d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:06:07.807580 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-353625ff-50ae-4cd4-a218-d6cd7d147691 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:07.808084 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-353625ff-50ae-4cd4-a218-d6cd7d147691 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:07.808540 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-353625ff-50ae-4cd4-a218-d6cd7d147691 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:07.809242 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-353625ff-50ae-4cd4-a218-d6cd7d147691 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:07.810148 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-353625ff-50ae-4cd4-a218-d6cd7d147691 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:07.810592 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-353625ff-50ae-4cd4-a218-d6cd7d147691 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:07.873023 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-353625ff-50ae-4cd4-a218-d6cd7d147691 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:06:07.882239 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-353625ff-50ae-4cd4-a218-d6cd7d147691 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d" status: 200 len: 1225 microversion: 2.1 time: 0.086419 Oct 23 02:06:07.882820 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3536/7168] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:06:07 2022] GET /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:06:08.905737 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bc150bdb-0d47-4c24-b736-c52138cc3227 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:06:08.906382 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bc150bdb-0d47-4c24-b736-c52138cc3227 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 2e2cf5d4-cf48-4d9d-b353-4295cdcd952d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:06:08.913869 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc150bdb-0d47-4c24-b736-c52138cc3227 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:08.914398 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc150bdb-0d47-4c24-b736-c52138cc3227 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:08.914841 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc150bdb-0d47-4c24-b736-c52138cc3227 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:08.915536 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc150bdb-0d47-4c24-b736-c52138cc3227 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:08.916006 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc150bdb-0d47-4c24-b736-c52138cc3227 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:08.916439 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bc150bdb-0d47-4c24-b736-c52138cc3227 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:08.980169 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bc150bdb-0d47-4c24-b736-c52138cc3227 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2967d0d8c134d269c9bbe51c90f803a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:06:08.988180 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bc150bdb-0d47-4c24-b736-c52138cc3227 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d" status: 200 len: 1225 microversion: 2.1 time: 0.086359 Oct 23 02:06:08.988772 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3633/7169] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:06:08 2022] GET /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:06:10.011162 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9e6e3719-af53-4cd8-8e0a-e716d0d8152e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:06:10.011703 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9e6e3719-af53-4cd8-8e0a-e716d0d8152e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 2e2cf5d4-cf48-4d9d-b353-4295cdcd952d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:06:10.018887 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e6e3719-af53-4cd8-8e0a-e716d0d8152e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:10.019412 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e6e3719-af53-4cd8-8e0a-e716d0d8152e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:10.019850 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e6e3719-af53-4cd8-8e0a-e716d0d8152e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:10.020572 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e6e3719-af53-4cd8-8e0a-e716d0d8152e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:10.021038 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e6e3719-af53-4cd8-8e0a-e716d0d8152e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:10.021478 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9e6e3719-af53-4cd8-8e0a-e716d0d8152e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:10.047572 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-9e6e3719-af53-4cd8-8e0a-e716d0d8152e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] HTTP exception thrown: Instance 2e2cf5d4-cf48-4d9d-b353-4295cdcd952d could not be found. Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9e6e3719-af53-4cd8-8e0a-e716d0d8152e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Request method failure captured: Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d HTTP/1.1 Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJ238gvy9Iqj-gh_hYMMA3k82GIwOXmge1ZpdCVbStgEi7Wx0Hp0nUD39OZgeTVVZUzzMU6rbj6VKVMThBnKMFJkrT_c4TpJItwEaxJM150Q197EeZTFOgQpHEVnJj9TzM6T9aiiAWqKRliV_RYi1MvsQfVRPMVtUboRY7WK1bO1DBQ Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: b1ec0b5ecaa741eaaf40a50f1415e7f9 Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-TestVolumeBootPattern-219047212 Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}] Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-TestVolumeBootPattern-219047212 Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: b1ec0b5ecaa741eaaf40a50f1415e7f9 Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-TestVolumeBootPattern-219047212 Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-TestVolumeBootPattern-219047212-project Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: f2967d0d8c134d269c9bbe51c90f803a Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-TestVolumeBootPattern-219047212-project Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 2e2cf5d4-cf48-4d9d-b353-4295cdcd952d could not be found. Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '2e2cf5d4-cf48-4d9d-b353-4295cdcd952d'} Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e2cf5d4-cf48-4d9d-b353-4295cdcd952d could not be found. Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e2cf5d4-cf48-4d9d-b353-4295cdcd952d could not be found. Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:06:10.050131 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:06:10.055017 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:06:10.055017 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:06:10.055017 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:06:10.055017 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:06:10.055017 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:06:10.055017 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e2cf5d4-cf48-4d9d-b353-4295cdcd952d could not be found. Oct 23 02:06:10.055017 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:06:10.055017 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9e6e3719-af53-4cd8-8e0a-e716d0d8152e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Returning 404 to user: Instance 2e2cf5d4-cf48-4d9d-b353-4295cdcd952d could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:06:10.056317 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9e6e3719-af53-4cd8-8e0a-e716d0d8152e tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d" status: 404 len: 111 microversion: 2.1 time: 0.049171 Oct 23 02:06:10.056986 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3537/7170] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:06:10 2022] GET /compute/v2.1/servers/2e2cf5d4-cf48-4d9d-b353-4295cdcd952d => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:06:10.597705 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-856e4539-3e88-4c08-975a-e382572a8091 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:06:10.598254 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-856e4539-3e88-4c08-975a-e382572a8091 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 9acf9d26-0453-4655-aca0-626fa37cf6ee] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:06:10.605075 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-856e4539-3e88-4c08-975a-e382572a8091 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:10.605563 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-856e4539-3e88-4c08-975a-e382572a8091 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:10.606030 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-856e4539-3e88-4c08-975a-e382572a8091 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:10.606726 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-856e4539-3e88-4c08-975a-e382572a8091 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:10.607189 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-856e4539-3e88-4c08-975a-e382572a8091 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:10.607620 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-856e4539-3e88-4c08-975a-e382572a8091 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:10.620896 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-856e4539-3e88-4c08-975a-e382572a8091 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] HTTP exception thrown: Instance 9acf9d26-0453-4655-aca0-626fa37cf6ee could not be found. Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-856e4539-3e88-4c08-975a-e382572a8091 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Request method failure captured: Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee HTTP/1.1 Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVJ238gvy9Iqj-gh_hYMMA3k82GIwOXmge1ZpdCVbStgEi7Wx0Hp0nUD39OZgeTVVZUzzMU6rbj6VKVMThBnKMFJkrT_c4TpJItwEaxJM150Q197EeZTFOgQpHEVnJj9TzM6T9aiiAWqKRliV_RYi1MvsQfVRPMVtUboRY7WK1bO1DBQ Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: b1ec0b5ecaa741eaaf40a50f1415e7f9 Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-TestVolumeBootPattern-219047212 Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}] Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-TestVolumeBootPattern-219047212 Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: b1ec0b5ecaa741eaaf40a50f1415e7f9 Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-TestVolumeBootPattern-219047212 Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-TestVolumeBootPattern-219047212-project Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: f2967d0d8c134d269c9bbe51c90f803a Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-TestVolumeBootPattern-219047212-project Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 9acf9d26-0453-4655-aca0-626fa37cf6ee could not be found. Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '9acf9d26-0453-4655-aca0-626fa37cf6ee'} Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9acf9d26-0453-4655-aca0-626fa37cf6ee could not be found. Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:06:10.622623 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:06:10.626743 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9acf9d26-0453-4655-aca0-626fa37cf6ee could not be found. Oct 23 02:06:10.626743 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:06:10.626743 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:06:10.626743 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:06:10.626743 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:06:10.626743 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:06:10.626743 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:06:10.626743 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:06:10.626743 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:06:10.626743 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9acf9d26-0453-4655-aca0-626fa37cf6ee could not be found. Oct 23 02:06:10.626743 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:06:10.626743 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-856e4539-3e88-4c08-975a-e382572a8091 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Returning 404 to user: Instance 9acf9d26-0453-4655-aca0-626fa37cf6ee could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:06:10.626743 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-856e4539-3e88-4c08-975a-e382572a8091 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee" status: 404 len: 111 microversion: 2.1 time: 0.030921 Oct 23 02:06:10.626743 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3634/7171] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 02:06:10 2022] DELETE /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:06:10.633474 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f8e60fd2-7643-4456-8a30-e44698f635a4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:06:10.634152 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f8e60fd2-7643-4456-8a30-e44698f635a4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] [instance: 9acf9d26-0453-4655-aca0-626fa37cf6ee] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:06:10.640640 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f8e60fd2-7643-4456-8a30-e44698f635a4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:10.641150 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f8e60fd2-7643-4456-8a30-e44698f635a4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:10.641602 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f8e60fd2-7643-4456-8a30-e44698f635a4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:10.642379 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f8e60fd2-7643-4456-8a30-e44698f635a4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:10.643469 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f8e60fd2-7643-4456-8a30-e44698f635a4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:10.643917 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f8e60fd2-7643-4456-8a30-e44698f635a4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:10.660848 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-f8e60fd2-7643-4456-8a30-e44698f635a4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] HTTP exception thrown: Instance 9acf9d26-0453-4655-aca0-626fa37cf6ee could not be found. Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f8e60fd2-7643-4456-8a30-e44698f635a4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Request method failure captured: Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee HTTP/1.1 Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVJ238gvy9Iqj-gh_hYMMA3k82GIwOXmge1ZpdCVbStgEi7Wx0Hp0nUD39OZgeTVVZUzzMU6rbj6VKVMThBnKMFJkrT_c4TpJItwEaxJM150Q197EeZTFOgQpHEVnJj9TzM6T9aiiAWqKRliV_RYi1MvsQfVRPMVtUboRY7WK1bO1DBQ Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: b1ec0b5ecaa741eaaf40a50f1415e7f9 Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-TestVolumeBootPattern-219047212 Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b1ec0b5ecaa741eaaf40a50f1415e7f9"}]}] Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-TestVolumeBootPattern-219047212 Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: b1ec0b5ecaa741eaaf40a50f1415e7f9 Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-TestVolumeBootPattern-219047212 Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-TestVolumeBootPattern-219047212-project Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: f2967d0d8c134d269c9bbe51c90f803a Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-TestVolumeBootPattern-219047212-project Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 9acf9d26-0453-4655-aca0-626fa37cf6ee could not be found. Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '9acf9d26-0453-4655-aca0-626fa37cf6ee'} Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9acf9d26-0453-4655-aca0-626fa37cf6ee could not be found. Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9acf9d26-0453-4655-aca0-626fa37cf6ee could not be found. Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:06:10.662430 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:06:10.666718 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:06:10.666718 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:06:10.666718 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:06:10.666718 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:06:10.666718 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:06:10.666718 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9acf9d26-0453-4655-aca0-626fa37cf6ee could not be found. Oct 23 02:06:10.666718 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:06:10.666718 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f8e60fd2-7643-4456-8a30-e44698f635a4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Returning 404 to user: Instance 9acf9d26-0453-4655-aca0-626fa37cf6ee could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:06:10.666718 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f8e60fd2-7643-4456-8a30-e44698f635a4 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee" status: 404 len: 111 microversion: 2.1 time: 0.034580 Oct 23 02:06:10.666718 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3538/7172] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:06:10 2022] GET /compute/v2.1/servers/9acf9d26-0453-4655-aca0-626fa37cf6ee => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:06:14.251880 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3f4a0049-2d9d-4f61-9b0d-6e8bc70d4df0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] Calling method '.version_select at 0x7f5cc184fb80>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:06:14.378947 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3f4a0049-2d9d-4f61-9b0d-6e8bc70d4df0 tempest-TestVolumeBootPattern-219047212 tempest-TestVolumeBootPattern-219047212-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-179536436" status: 202 len: 0 microversion: 2.1 time: 0.131417 Oct 23 02:06:14.379482 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3635/7173] 10.222.0.42 () {58 vars in 1260 bytes} [Sun Oct 23 02:06:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-179536436 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:06:34.910905 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:06:34.911651 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:06:35.022210 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5e207a3e-4a1a-49e1-951b-898daab00730 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-748274236", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:06:35.258012 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-5e207a3e-4a1a-49e1-951b-898daab00730 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] validate_networks() for None {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 02:06:35.778778 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-5e207a3e-4a1a-49e1-951b-898daab00730 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:06:35.779218 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-5e207a3e-4a1a-49e1-951b-898daab00730 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:06:35.779711 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-5e207a3e-4a1a-49e1-951b-898daab00730 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:06:35.780139 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-5e207a3e-4a1a-49e1-951b-898daab00730 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:06:35.780564 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-5e207a3e-4a1a-49e1-951b-898daab00730 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:06:35.789364 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e207a3e-4a1a-49e1-951b-898daab00730 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:35.789861 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e207a3e-4a1a-49e1-951b-898daab00730 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:35.790346 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e207a3e-4a1a-49e1-951b-898daab00730 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:35.791091 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e207a3e-4a1a-49e1-951b-898daab00730 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:35.791564 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e207a3e-4a1a-49e1-951b-898daab00730 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:35.792004 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e207a3e-4a1a-49e1-951b-898daab00730 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:35.810636 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-5e207a3e-4a1a-49e1-951b-898daab00730 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Getting quotas for project 7660d3c1008542f3ab77272a14ce22e3. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:06:35.816499 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-5e207a3e-4a1a-49e1-951b-898daab00730 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Getting quotas for user de23711530a443e094f868c93cf9d26d and project 7660d3c1008542f3ab77272a14ce22e3. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:06:35.828753 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5e207a3e-4a1a-49e1-951b-898daab00730 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 02:06:35.831103 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5e207a3e-4a1a-49e1-951b-898daab00730 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] [instance: 7679cb16-1bda-4b84-ae29-bf746559c29c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 02:06:35.941949 n-d-master-1 devstack@n-api.service[120945]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5e207a3e-4a1a-49e1-951b-898daab00730 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] [df191590-1730-413b-9f4b-8ebce3a1730d] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 23 02:06:36.948092 n-d-master-1 devstack@n-api.service[120945]: INFO oslo.messaging._drivers.impl_rabbit [None req-5e207a3e-4a1a-49e1-951b-898daab00730 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] [df191590-1730-413b-9f4b-8ebce3a1730d] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 34880. Oct 23 02:06:36.952295 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5e207a3e-4a1a-49e1-951b-898daab00730 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.046653 Oct 23 02:06:36.952949 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3539/7174] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 02:06:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 02:06:36.966403 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-482103c5-33da-4e22-ac67-571415d21a09 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:06:36.967630 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-482103c5-33da-4e22-ac67-571415d21a09 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] [instance: 7679cb16-1bda-4b84-ae29-bf746559c29c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:06:36.971500 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=52 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:06:36.972351 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:06:37.134291 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-482103c5-33da-4e22-ac67-571415d21a09 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de23711530a443e094f868c93cf9d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7660d3c1008542f3ab77272a14ce22e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:06:37.141185 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-482103c5-33da-4e22-ac67-571415d21a09 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] 10.222.0.42 "GET /compute/v2.1/servers/7679cb16-1bda-4b84-ae29-bf746559c29c" status: 200 len: 1221 microversion: 2.1 time: 0.178814 Oct 23 02:06:37.142358 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3636/7175] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:06:36 2022] GET /compute/v2.1/servers/7679cb16-1bda-4b84-ae29-bf746559c29c => generated 1221 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:06:38.165770 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0a8813e4-058c-45d1-80fe-824d6d0ac6f9 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:06:38.166424 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0a8813e4-058c-45d1-80fe-824d6d0ac6f9 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] [instance: 7679cb16-1bda-4b84-ae29-bf746559c29c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:06:38.173452 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0a8813e4-058c-45d1-80fe-824d6d0ac6f9 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:38.173947 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0a8813e4-058c-45d1-80fe-824d6d0ac6f9 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:38.174424 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0a8813e4-058c-45d1-80fe-824d6d0ac6f9 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:38.175126 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0a8813e4-058c-45d1-80fe-824d6d0ac6f9 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:38.175589 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0a8813e4-058c-45d1-80fe-824d6d0ac6f9 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:38.176025 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0a8813e4-058c-45d1-80fe-824d6d0ac6f9 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:38.237255 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0a8813e4-058c-45d1-80fe-824d6d0ac6f9 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de23711530a443e094f868c93cf9d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7660d3c1008542f3ab77272a14ce22e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:06:38.244842 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0a8813e4-058c-45d1-80fe-824d6d0ac6f9 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] 10.222.0.42 "GET /compute/v2.1/servers/7679cb16-1bda-4b84-ae29-bf746559c29c" status: 200 len: 1225 microversion: 2.1 time: 0.084035 Oct 23 02:06:38.245410 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3540/7176] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:06:38 2022] GET /compute/v2.1/servers/7679cb16-1bda-4b84-ae29-bf746559c29c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:06:39.268123 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-22123b16-e3fb-42b2-9c5d-c0406c7cc91e tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:06:39.268702 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-22123b16-e3fb-42b2-9c5d-c0406c7cc91e tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] [instance: 7679cb16-1bda-4b84-ae29-bf746559c29c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:06:39.275501 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-22123b16-e3fb-42b2-9c5d-c0406c7cc91e tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:39.276013 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-22123b16-e3fb-42b2-9c5d-c0406c7cc91e tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:39.276451 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-22123b16-e3fb-42b2-9c5d-c0406c7cc91e tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:39.277134 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-22123b16-e3fb-42b2-9c5d-c0406c7cc91e tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:39.277594 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-22123b16-e3fb-42b2-9c5d-c0406c7cc91e tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:39.278045 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-22123b16-e3fb-42b2-9c5d-c0406c7cc91e tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:39.341523 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-22123b16-e3fb-42b2-9c5d-c0406c7cc91e tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de23711530a443e094f868c93cf9d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7660d3c1008542f3ab77272a14ce22e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:06:39.349852 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-22123b16-e3fb-42b2-9c5d-c0406c7cc91e tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] 10.222.0.42 "GET /compute/v2.1/servers/7679cb16-1bda-4b84-ae29-bf746559c29c" status: 200 len: 1273 microversion: 2.1 time: 0.085727 Oct 23 02:06:39.350459 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3637/7177] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:06:39 2022] GET /compute/v2.1/servers/7679cb16-1bda-4b84-ae29-bf746559c29c => generated 1273 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:06:40.372929 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4f67794a-0cfd-4524-b39e-6e7f0cb5bd3e tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:06:40.373567 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4f67794a-0cfd-4524-b39e-6e7f0cb5bd3e tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] [instance: 7679cb16-1bda-4b84-ae29-bf746559c29c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:06:40.381374 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f67794a-0cfd-4524-b39e-6e7f0cb5bd3e tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:40.381893 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f67794a-0cfd-4524-b39e-6e7f0cb5bd3e tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:40.382388 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f67794a-0cfd-4524-b39e-6e7f0cb5bd3e tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:40.383113 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f67794a-0cfd-4524-b39e-6e7f0cb5bd3e tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:40.383589 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f67794a-0cfd-4524-b39e-6e7f0cb5bd3e tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:40.384036 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f67794a-0cfd-4524-b39e-6e7f0cb5bd3e tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:40.447902 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4f67794a-0cfd-4524-b39e-6e7f0cb5bd3e tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de23711530a443e094f868c93cf9d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7660d3c1008542f3ab77272a14ce22e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:06:40.455688 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4f67794a-0cfd-4524-b39e-6e7f0cb5bd3e tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] 10.222.0.42 "GET /compute/v2.1/servers/7679cb16-1bda-4b84-ae29-bf746559c29c" status: 200 len: 1279 microversion: 2.1 time: 0.086821 Oct 23 02:06:40.456286 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3541/7178] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:06:40 2022] GET /compute/v2.1/servers/7679cb16-1bda-4b84-ae29-bf746559c29c => generated 1279 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:06:41.483617 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c7a2ad04-b895-46bd-9786-b688f12d9077 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:06:41.484239 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c7a2ad04-b895-46bd-9786-b688f12d9077 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] [instance: 7679cb16-1bda-4b84-ae29-bf746559c29c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:06:41.491958 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c7a2ad04-b895-46bd-9786-b688f12d9077 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:41.492462 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c7a2ad04-b895-46bd-9786-b688f12d9077 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:41.492908 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c7a2ad04-b895-46bd-9786-b688f12d9077 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:41.493611 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c7a2ad04-b895-46bd-9786-b688f12d9077 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:41.494107 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c7a2ad04-b895-46bd-9786-b688f12d9077 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:41.494540 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c7a2ad04-b895-46bd-9786-b688f12d9077 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:41.506304 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-bfe75a8f-d1d8-4cf5-9c32-c041614bdc04 req-e245c5c2-d41a-4bd6-a08a-317fdc13c7f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7679cb16-1bda-4b84-ae29-bf746559c29c", "tag": "2507671c-5b46-4c1d-b10d-d0f5fdc1bb2a"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:06:41.519493 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-bfe75a8f-d1d8-4cf5-9c32-c041614bdc04 req-e245c5c2-d41a-4bd6-a08a-317fdc13c7f5 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:41.520872 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-bfe75a8f-d1d8-4cf5-9c32-c041614bdc04 req-e245c5c2-d41a-4bd6-a08a-317fdc13c7f5 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:41.521482 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-bfe75a8f-d1d8-4cf5-9c32-c041614bdc04 req-e245c5c2-d41a-4bd6-a08a-317fdc13c7f5 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:41.534114 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-bfe75a8f-d1d8-4cf5-9c32-c041614bdc04 req-e245c5c2-d41a-4bd6-a08a-317fdc13c7f5 service nova] Creating event network-changed:2507671c-5b46-4c1d-b10d-d0f5fdc1bb2a for instance 7679cb16-1bda-4b84-ae29-bf746559c29c on n-h2-master-1 Oct 23 02:06:41.539743 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-bfe75a8f-d1d8-4cf5-9c32-c041614bdc04 req-e245c5c2-d41a-4bd6-a08a-317fdc13c7f5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037696 Oct 23 02:06:41.540351 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3542/7179] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:06:41.634152 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c7a2ad04-b895-46bd-9786-b688f12d9077 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de23711530a443e094f868c93cf9d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7660d3c1008542f3ab77272a14ce22e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:06:41.642292 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c7a2ad04-b895-46bd-9786-b688f12d9077 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] 10.222.0.42 "GET /compute/v2.1/servers/7679cb16-1bda-4b84-ae29-bf746559c29c" status: 200 len: 1321 microversion: 2.1 time: 0.162569 Oct 23 02:06:41.642891 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3638/7180] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:06:41 2022] GET /compute/v2.1/servers/7679cb16-1bda-4b84-ae29-bf746559c29c => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:06:42.666750 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-acb86f7d-c44b-4365-8437-7984654bafe1 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:06:42.672147 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-acb86f7d-c44b-4365-8437-7984654bafe1 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] [instance: 7679cb16-1bda-4b84-ae29-bf746559c29c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:06:42.675300 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-acb86f7d-c44b-4365-8437-7984654bafe1 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:42.675810 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-acb86f7d-c44b-4365-8437-7984654bafe1 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:42.676266 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-acb86f7d-c44b-4365-8437-7984654bafe1 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:42.676978 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-acb86f7d-c44b-4365-8437-7984654bafe1 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:42.677522 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-acb86f7d-c44b-4365-8437-7984654bafe1 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:42.677994 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-acb86f7d-c44b-4365-8437-7984654bafe1 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:42.808736 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-acb86f7d-c44b-4365-8437-7984654bafe1 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de23711530a443e094f868c93cf9d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7660d3c1008542f3ab77272a14ce22e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:06:42.817028 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-acb86f7d-c44b-4365-8437-7984654bafe1 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] 10.222.0.42 "GET /compute/v2.1/servers/7679cb16-1bda-4b84-ae29-bf746559c29c" status: 200 len: 1321 microversion: 2.1 time: 0.154762 Oct 23 02:06:42.817601 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3543/7181] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:06:42 2022] GET /compute/v2.1/servers/7679cb16-1bda-4b84-ae29-bf746559c29c => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:06:43.840725 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7c88afdc-af80-41ac-8789-4f61da6ef5c5 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:06:43.841292 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7c88afdc-af80-41ac-8789-4f61da6ef5c5 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] [instance: 7679cb16-1bda-4b84-ae29-bf746559c29c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:06:43.848836 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c88afdc-af80-41ac-8789-4f61da6ef5c5 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:43.849329 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c88afdc-af80-41ac-8789-4f61da6ef5c5 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:43.849780 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c88afdc-af80-41ac-8789-4f61da6ef5c5 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:43.850497 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c88afdc-af80-41ac-8789-4f61da6ef5c5 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:43.850959 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c88afdc-af80-41ac-8789-4f61da6ef5c5 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:43.851392 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c88afdc-af80-41ac-8789-4f61da6ef5c5 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:43.978813 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7c88afdc-af80-41ac-8789-4f61da6ef5c5 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de23711530a443e094f868c93cf9d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7660d3c1008542f3ab77272a14ce22e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:06:43.986528 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7c88afdc-af80-41ac-8789-4f61da6ef5c5 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] 10.222.0.42 "GET /compute/v2.1/servers/7679cb16-1bda-4b84-ae29-bf746559c29c" status: 200 len: 1321 microversion: 2.1 time: 0.150138 Oct 23 02:06:43.987111 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3639/7182] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:06:43 2022] GET /compute/v2.1/servers/7679cb16-1bda-4b84-ae29-bf746559c29c => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:06:45.009451 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e2336469-2c34-4816-85c4-a8b63ba1a8db tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:06:45.010149 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e2336469-2c34-4816-85c4-a8b63ba1a8db tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] [instance: 7679cb16-1bda-4b84-ae29-bf746559c29c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:06:45.018905 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e2336469-2c34-4816-85c4-a8b63ba1a8db tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:45.019418 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e2336469-2c34-4816-85c4-a8b63ba1a8db tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:45.019874 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e2336469-2c34-4816-85c4-a8b63ba1a8db tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:45.020605 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e2336469-2c34-4816-85c4-a8b63ba1a8db tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:45.021073 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e2336469-2c34-4816-85c4-a8b63ba1a8db tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:45.021512 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e2336469-2c34-4816-85c4-a8b63ba1a8db tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:45.156280 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e2336469-2c34-4816-85c4-a8b63ba1a8db tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de23711530a443e094f868c93cf9d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7660d3c1008542f3ab77272a14ce22e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:06:45.164807 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e2336469-2c34-4816-85c4-a8b63ba1a8db tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] 10.222.0.42 "GET /compute/v2.1/servers/7679cb16-1bda-4b84-ae29-bf746559c29c" status: 200 len: 1321 microversion: 2.1 time: 0.159307 Oct 23 02:06:45.165381 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3544/7183] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:06:45 2022] GET /compute/v2.1/servers/7679cb16-1bda-4b84-ae29-bf746559c29c => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:06:46.187553 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0f4cc5b6-70a6-465d-a12b-e86dcfcbce55 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:06:46.188658 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0f4cc5b6-70a6-465d-a12b-e86dcfcbce55 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] [instance: 7679cb16-1bda-4b84-ae29-bf746559c29c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:06:46.195584 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0f4cc5b6-70a6-465d-a12b-e86dcfcbce55 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:46.196075 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0f4cc5b6-70a6-465d-a12b-e86dcfcbce55 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:46.196519 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0f4cc5b6-70a6-465d-a12b-e86dcfcbce55 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:46.197270 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0f4cc5b6-70a6-465d-a12b-e86dcfcbce55 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:46.197737 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0f4cc5b6-70a6-465d-a12b-e86dcfcbce55 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:46.198201 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0f4cc5b6-70a6-465d-a12b-e86dcfcbce55 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:46.330257 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0f4cc5b6-70a6-465d-a12b-e86dcfcbce55 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de23711530a443e094f868c93cf9d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7660d3c1008542f3ab77272a14ce22e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:06:46.338359 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0f4cc5b6-70a6-465d-a12b-e86dcfcbce55 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] 10.222.0.42 "GET /compute/v2.1/servers/7679cb16-1bda-4b84-ae29-bf746559c29c" status: 200 len: 1321 microversion: 2.1 time: 0.154713 Oct 23 02:06:46.338954 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3640/7184] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:06:46 2022] GET /compute/v2.1/servers/7679cb16-1bda-4b84-ae29-bf746559c29c => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:06:47.016194 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:06:47.017514 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=6 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:06:47.080012 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-f77169f7-856b-4e6c-98d1-576bf1087683 req-d85749a6-170e-4e71-952d-23df4b6205ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7679cb16-1bda-4b84-ae29-bf746559c29c", "name": "network-vif-plugged", "status": "completed", "tag": "2507671c-5b46-4c1d-b10d-d0f5fdc1bb2a"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:06:47.091007 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-f77169f7-856b-4e6c-98d1-576bf1087683 req-d85749a6-170e-4e71-952d-23df4b6205ac service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:47.091533 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-f77169f7-856b-4e6c-98d1-576bf1087683 req-d85749a6-170e-4e71-952d-23df4b6205ac service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:47.091996 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-f77169f7-856b-4e6c-98d1-576bf1087683 req-d85749a6-170e-4e71-952d-23df4b6205ac service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:47.102437 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-f77169f7-856b-4e6c-98d1-576bf1087683 req-d85749a6-170e-4e71-952d-23df4b6205ac service nova] Creating event network-vif-plugged:2507671c-5b46-4c1d-b10d-d0f5fdc1bb2a for instance 7679cb16-1bda-4b84-ae29-bf746559c29c on n-h2-master-1 Oct 23 02:06:47.107496 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-f77169f7-856b-4e6c-98d1-576bf1087683 req-d85749a6-170e-4e71-952d-23df4b6205ac service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095807 Oct 23 02:06:47.111908 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3545/7185] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:06:47.361604 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6f109d7b-a975-42c9-bad3-8003f1c6f02f tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:06:47.362251 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6f109d7b-a975-42c9-bad3-8003f1c6f02f tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] [instance: 7679cb16-1bda-4b84-ae29-bf746559c29c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:06:47.364177 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:06:47.369750 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6f109d7b-a975-42c9-bad3-8003f1c6f02f tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:47.370273 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6f109d7b-a975-42c9-bad3-8003f1c6f02f tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:47.370719 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6f109d7b-a975-42c9-bad3-8003f1c6f02f tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:47.371418 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6f109d7b-a975-42c9-bad3-8003f1c6f02f tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:47.371879 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6f109d7b-a975-42c9-bad3-8003f1c6f02f tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:47.372311 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6f109d7b-a975-42c9-bad3-8003f1c6f02f tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:47.500300 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6f109d7b-a975-42c9-bad3-8003f1c6f02f tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de23711530a443e094f868c93cf9d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7660d3c1008542f3ab77272a14ce22e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:06:47.507975 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6f109d7b-a975-42c9-bad3-8003f1c6f02f tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] 10.222.0.42 "GET /compute/v2.1/servers/7679cb16-1bda-4b84-ae29-bf746559c29c" status: 200 len: 1321 microversion: 2.1 time: 0.150998 Oct 23 02:06:47.508562 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3641/7186] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:06:47 2022] GET /compute/v2.1/servers/7679cb16-1bda-4b84-ae29-bf746559c29c => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:06:48.533122 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1573fadd-5a18-4bf6-89a7-2a78dd18f73e tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:06:48.533841 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1573fadd-5a18-4bf6-89a7-2a78dd18f73e tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] [instance: 7679cb16-1bda-4b84-ae29-bf746559c29c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:06:48.540634 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1573fadd-5a18-4bf6-89a7-2a78dd18f73e tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:48.541169 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1573fadd-5a18-4bf6-89a7-2a78dd18f73e tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:48.541622 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1573fadd-5a18-4bf6-89a7-2a78dd18f73e tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:48.542437 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1573fadd-5a18-4bf6-89a7-2a78dd18f73e tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:48.542905 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1573fadd-5a18-4bf6-89a7-2a78dd18f73e tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:48.543350 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1573fadd-5a18-4bf6-89a7-2a78dd18f73e tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:48.681195 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1573fadd-5a18-4bf6-89a7-2a78dd18f73e tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de23711530a443e094f868c93cf9d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7660d3c1008542f3ab77272a14ce22e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:06:48.689603 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1573fadd-5a18-4bf6-89a7-2a78dd18f73e tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] 10.222.0.42 "GET /compute/v2.1/servers/7679cb16-1bda-4b84-ae29-bf746559c29c" status: 200 len: 1321 microversion: 2.1 time: 0.161642 Oct 23 02:06:48.690214 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3546/7187] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:06:48 2022] GET /compute/v2.1/servers/7679cb16-1bda-4b84-ae29-bf746559c29c => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:06:49.712992 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c85da653-7bf5-4bce-a519-03c49fa947c4 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:06:49.713616 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c85da653-7bf5-4bce-a519-03c49fa947c4 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] [instance: 7679cb16-1bda-4b84-ae29-bf746559c29c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:06:49.720705 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c85da653-7bf5-4bce-a519-03c49fa947c4 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:49.721197 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c85da653-7bf5-4bce-a519-03c49fa947c4 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:49.721642 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c85da653-7bf5-4bce-a519-03c49fa947c4 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:49.722371 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c85da653-7bf5-4bce-a519-03c49fa947c4 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:49.722837 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c85da653-7bf5-4bce-a519-03c49fa947c4 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:49.723273 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c85da653-7bf5-4bce-a519-03c49fa947c4 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:49.851290 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c85da653-7bf5-4bce-a519-03c49fa947c4 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de23711530a443e094f868c93cf9d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7660d3c1008542f3ab77272a14ce22e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:06:49.859205 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c85da653-7bf5-4bce-a519-03c49fa947c4 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] 10.222.0.42 "GET /compute/v2.1/servers/7679cb16-1bda-4b84-ae29-bf746559c29c" status: 200 len: 1470 microversion: 2.1 time: 0.150448 Oct 23 02:06:49.859786 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3642/7188] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:06:49 2022] GET /compute/v2.1/servers/7679cb16-1bda-4b84-ae29-bf746559c29c => generated 1470 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:06:49.932461 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-473cdeca-cc42-469a-9d62-7f913bf64505 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] Calling method '.version_select at 0x7f5cc6335c10>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:06:49.997731 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-473cdeca-cc42-469a-9d62-7f913bf64505 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/440ef83894cd405db4cecf8f4f9af712" status: 200 len: 371 microversion: 2.1 time: 0.117259 Oct 23 02:06:49.998334 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3547/7189] 10.222.0.42 () {58 vars in 1242 bytes} [Sun Oct 23 02:06:49 2022] GET /compute/v2.1/os-quota-sets/440ef83894cd405db4cecf8f4f9af712 => generated 371 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:06:50.010837 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d8e6d6f8-9df9-48b5-95c9-10737c9991d8 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-147903942", "id": 2103836323, "os-flavor-access:is_public": "True"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:06:50.111185 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d8e6d6f8-9df9-48b5-95c9-10737c9991d8 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.103981 Oct 23 02:06:50.111833 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3643/7190] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 02:06:50 2022] POST /compute/v2.1/flavors => generated 437 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:06:50.124654 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e0e3fa74-188d-436e-bf6c-b61247721475 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "2103836323"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:06:50.127576 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e0e3fa74-188d-436e-bf6c-b61247721475 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] [instance: 7679cb16-1bda-4b84-ae29-bf746559c29c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:06:50.133644 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e0e3fa74-188d-436e-bf6c-b61247721475 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:50.137646 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e0e3fa74-188d-436e-bf6c-b61247721475 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:50.137646 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e0e3fa74-188d-436e-bf6c-b61247721475 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:50.137646 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e0e3fa74-188d-436e-bf6c-b61247721475 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:50.137646 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e0e3fa74-188d-436e-bf6c-b61247721475 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:50.137646 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e0e3fa74-188d-436e-bf6c-b61247721475 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:50.271778 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e0e3fa74-188d-436e-bf6c-b61247721475 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'eb8f7dc9addc4a87a8ab86f4f5b06f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440ef83894cd405db4cecf8f4f9af712', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:06:50.278019 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e0e3fa74-188d-436e-bf6c-b61247721475 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] [instance: 7679cb16-1bda-4b84-ae29-bf746559c29c] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-147903942 {{(pid=120945) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 23 02:06:50.284710 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e0e3fa74-188d-436e-bf6c-b61247721475 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:50.285200 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e0e3fa74-188d-436e-bf6c-b61247721475 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:50.285644 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e0e3fa74-188d-436e-bf6c-b61247721475 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:50.286403 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e0e3fa74-188d-436e-bf6c-b61247721475 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:50.286870 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e0e3fa74-188d-436e-bf6c-b61247721475 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:50.287304 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e0e3fa74-188d-436e-bf6c-b61247721475 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:50.307544 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-e0e3fa74-188d-436e-bf6c-b61247721475 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] Getting quotas for project 7660d3c1008542f3ab77272a14ce22e3. Resources: {'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:06:50.313698 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-e0e3fa74-188d-436e-bf6c-b61247721475 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] Getting quotas for user de23711530a443e094f868c93cf9d26d and project 7660d3c1008542f3ab77272a14ce22e3. Resources: {'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:06:50.325858 n-d-master-1 devstack@n-api.service[120945]: INFO nova.compute.api [None req-e0e3fa74-188d-436e-bf6c-b61247721475 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] ram quota exceeded for 440ef83894cd405db4cecf8f4f9af712, tried to resize instance. Oct 23 02:06:50.326444 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-e0e3fa74-188d-436e-bf6c-b61247721475 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e0e3fa74-188d-436e-bf6c-b61247721475 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] Request method failure captured: Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/servers/7679cb16-1bda-4b84-ae29-bf746559c29c/action HTTP/1.1 Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 39 Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVKGqQatykaBnJGGnQdEbgCPe82v4uN9uOqxfZ7AV9razbWJOxFjUOVBr_1EztGnUzXVqovfAIJtxS6DpyRRz-cSOd8g-uAaTfS6yQtAD8T0MpDcHtX46TlW-fDafMh3tlshjTHwYi46ojFNPDanyzQNJMvHkUGMpO0AyWq9u9mU4xq4 Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 440ef83894cd405db4cecf8f4f9af712 Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1628204 Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,admin,reader Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,admin,reader Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/440ef83894cd405db4cecf8f4f9af712"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_440ef83894cd405db4cecf8f4f9af712"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/440ef83894cd405db4cecf8f4f9af712"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/440ef83894cd405db4cecf8f4f9af712"}]}] Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1628204 Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 440ef83894cd405db4cecf8f4f9af712 Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1628204 Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServersAdminNegativeTestJSON-1628204-project-admin Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: eb8f7dc9addc4a87a8ab86f4f5b06f8a Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1628204-project-admin Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: {"resize": {"flavorRef": "2103836323"}} Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '7679cb16-1bda-4b84-ae29-bf746559c29c', 'body': {'resize': {'flavorRef': '2103836323'}}} Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 23 02:06:50.328522 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 23 02:06:50.332815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 23 02:06:50.332815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 23 02:06:50.332815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 23 02:06:50.332815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 23 02:06:50.332815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 23 02:06:50.332815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 23 02:06:50.332815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 23 02:06:50.332815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 23 02:06:50.332815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 23 02:06:50.332815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 23 02:06:50.332815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 23 02:06:50.332815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 23 02:06:50.332815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 23 02:06:50.332815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 23 02:06:50.332815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:06:50.332815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:06:50.332815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:06:50.332815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:06:50.332815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:06:50.332815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:06:50.332815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:06:50.332815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:06:50.332815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:06:50.332815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:06:50.332815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 02:06:50.332815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 02:06:50.332815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 23 02:06:50.332815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 23 02:06:50.332815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 23 02:06:50.332815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 23 02:06:50.332815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 23 02:06:50.332815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:06:50.332815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:06:50.332815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:06:50.332815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:06:50.332815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:06:50.332815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:06:50.332815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:06:50.332815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:06:50.332815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 23 02:06:50.332815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:06:50.332815 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e0e3fa74-188d-436e-bf6c-b61247721475 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:06:50.332815 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e0e3fa74-188d-436e-bf6c-b61247721475 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/7679cb16-1bda-4b84-ae29-bf746559c29c/action" status: 403 len: 118 microversion: 2.1 time: 0.209674 Oct 23 02:06:50.332815 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3548/7191] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:06:50 2022] POST /compute/v2.1/servers/7679cb16-1bda-4b84-ae29-bf746559c29c/action => generated 118 bytes in 211 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 23 02:06:50.339367 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cbad0781-60f8-408d-a333-85840e7f9771 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:06:50.430473 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cbad0781-60f8-408d-a333-85840e7f9771 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/2103836323" status: 202 len: 0 microversion: 2.1 time: 0.095053 Oct 23 02:06:50.431088 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3644/7192] 10.222.0.42 () {58 vars in 1161 bytes} [Sun Oct 23 02:06:50 2022] DELETE /compute/v2.1/flavors/2103836323 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 23 02:06:50.439048 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-66d23d31-59de-4547-a638-45fb5596572a tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:06:50.459926 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-66d23d31-59de-4547-a638-45fb5596572a tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024508 Oct 23 02:06:50.460485 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3549/7193] 10.222.0.42 () {58 vars in 1146 bytes} [Sun Oct 23 02:06:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:06:50.481368 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-df615fd1-53a9-4b05-b1de-5568afe15c61 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] Calling method '.version_select at 0x7f5cc19ea4c0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:06:50.555135 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-df615fd1-53a9-4b05-b1de-5568afe15c61 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/440ef83894cd405db4cecf8f4f9af712" status: 200 len: 371 microversion: 2.1 time: 0.077430 Oct 23 02:06:50.555710 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3645/7194] 10.222.0.42 () {58 vars in 1242 bytes} [Sun Oct 23 02:06:50 2022] GET /compute/v2.1/os-quota-sets/440ef83894cd405db4cecf8f4f9af712 => generated 371 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:06:50.567511 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ad1bbe94-af57-479d-8bca-e411135ea603 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1227222015", "id": 641328102, "os-flavor-access:is_public": "True"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:06:50.653375 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ad1bbe94-af57-479d-8bca-e411135ea603 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.089542 Oct 23 02:06:50.653995 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3550/7195] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 02:06:50 2022] POST /compute/v2.1/flavors => generated 434 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:06:50.667015 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-998a1e39-d5fc-43e6-b3fb-70702c5a6647 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "641328102"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:06:50.669434 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-998a1e39-d5fc-43e6-b3fb-70702c5a6647 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] [instance: 7679cb16-1bda-4b84-ae29-bf746559c29c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:06:50.676034 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-998a1e39-d5fc-43e6-b3fb-70702c5a6647 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:50.676520 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-998a1e39-d5fc-43e6-b3fb-70702c5a6647 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:50.676960 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-998a1e39-d5fc-43e6-b3fb-70702c5a6647 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:50.677647 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-998a1e39-d5fc-43e6-b3fb-70702c5a6647 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:50.678140 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-998a1e39-d5fc-43e6-b3fb-70702c5a6647 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:50.678568 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-998a1e39-d5fc-43e6-b3fb-70702c5a6647 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:50.762608 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-998a1e39-d5fc-43e6-b3fb-70702c5a6647 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'eb8f7dc9addc4a87a8ab86f4f5b06f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440ef83894cd405db4cecf8f4f9af712', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:06:50.768965 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-998a1e39-d5fc-43e6-b3fb-70702c5a6647 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] [instance: 7679cb16-1bda-4b84-ae29-bf746559c29c] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1227222015 {{(pid=120944) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 23 02:06:50.775524 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-998a1e39-d5fc-43e6-b3fb-70702c5a6647 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:50.776010 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-998a1e39-d5fc-43e6-b3fb-70702c5a6647 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:50.776462 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-998a1e39-d5fc-43e6-b3fb-70702c5a6647 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:50.777185 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-998a1e39-d5fc-43e6-b3fb-70702c5a6647 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:50.777639 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-998a1e39-d5fc-43e6-b3fb-70702c5a6647 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:50.778090 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-998a1e39-d5fc-43e6-b3fb-70702c5a6647 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:50.799799 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-998a1e39-d5fc-43e6-b3fb-70702c5a6647 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] Getting quotas for project 7660d3c1008542f3ab77272a14ce22e3. Resources: {'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:06:50.805036 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-998a1e39-d5fc-43e6-b3fb-70702c5a6647 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] Getting quotas for user de23711530a443e094f868c93cf9d26d and project 7660d3c1008542f3ab77272a14ce22e3. Resources: {'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:06:50.817295 n-d-master-1 devstack@n-api.service[120944]: INFO nova.compute.api [None req-998a1e39-d5fc-43e6-b3fb-70702c5a6647 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] cores quota exceeded for 440ef83894cd405db4cecf8f4f9af712, tried to resize instance. Oct 23 02:06:50.817860 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-998a1e39-d5fc-43e6-b3fb-70702c5a6647 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-998a1e39-d5fc-43e6-b3fb-70702c5a6647 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] Request method failure captured: Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/servers/7679cb16-1bda-4b84-ae29-bf746559c29c/action HTTP/1.1 Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 38 Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVKGqQatykaBnJGGnQdEbgCPe82v4uN9uOqxfZ7AV9razbWJOxFjUOVBr_1EztGnUzXVqovfAIJtxS6DpyRRz-cSOd8g-uAaTfS6yQtAD8T0MpDcHtX46TlW-fDafMh3tlshjTHwYi46ojFNPDanyzQNJMvHkUGMpO0AyWq9u9mU4xq4 Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 440ef83894cd405db4cecf8f4f9af712 Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1628204 Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,admin,reader Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,admin,reader Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/440ef83894cd405db4cecf8f4f9af712"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_440ef83894cd405db4cecf8f4f9af712"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/440ef83894cd405db4cecf8f4f9af712"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/440ef83894cd405db4cecf8f4f9af712"}]}] Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1628204 Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 440ef83894cd405db4cecf8f4f9af712 Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1628204 Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersAdminNegativeTestJSON-1628204-project-admin Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: eb8f7dc9addc4a87a8ab86f4f5b06f8a Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1628204-project-admin Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: {"resize": {"flavorRef": "641328102"}} Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '7679cb16-1bda-4b84-ae29-bf746559c29c', 'body': {'resize': {'flavorRef': '641328102'}}} Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 23 02:06:50.819873 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 23 02:06:50.824354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 23 02:06:50.824354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 23 02:06:50.824354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 23 02:06:50.824354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 23 02:06:50.824354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 23 02:06:50.824354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 23 02:06:50.824354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 23 02:06:50.824354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 23 02:06:50.824354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 23 02:06:50.824354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 23 02:06:50.824354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 23 02:06:50.824354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 23 02:06:50.824354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 23 02:06:50.824354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 23 02:06:50.824354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:06:50.824354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:06:50.824354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:06:50.824354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:06:50.824354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:06:50.824354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:06:50.824354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:06:50.824354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:06:50.824354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:06:50.824354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:06:50.824354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 02:06:50.824354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 02:06:50.824354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 23 02:06:50.824354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 23 02:06:50.824354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 23 02:06:50.824354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 23 02:06:50.824354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 23 02:06:50.824354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:06:50.824354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:06:50.824354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:06:50.824354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:06:50.824354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:06:50.824354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:06:50.824354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:06:50.824354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:06:50.824354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 23 02:06:50.824354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:06:50.824354 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-998a1e39-d5fc-43e6-b3fb-70702c5a6647 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:06:50.824354 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-998a1e39-d5fc-43e6-b3fb-70702c5a6647 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/7679cb16-1bda-4b84-ae29-bf746559c29c/action" status: 403 len: 113 microversion: 2.1 time: 0.158152 Oct 23 02:06:50.824354 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3646/7196] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:06:50 2022] POST /compute/v2.1/servers/7679cb16-1bda-4b84-ae29-bf746559c29c/action => generated 113 bytes in 159 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:06:50.833054 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ae34bbc8-6521-4cc6-a050-392f1bce038b tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:06:50.919554 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ae34bbc8-6521-4cc6-a050-392f1bce038b tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/641328102" status: 202 len: 0 microversion: 2.1 time: 0.090738 Oct 23 02:06:50.920160 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3551/7197] 10.222.0.42 () {58 vars in 1158 bytes} [Sun Oct 23 02:06:50 2022] DELETE /compute/v2.1/flavors/641328102 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:06:50.928458 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-861bb10a-f615-4fe3-b9e3-53720eec8d98 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:06:50.948053 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-861bb10a-f615-4fe3-b9e3-53720eec8d98 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023654 Oct 23 02:06:50.948620 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3647/7198] 10.222.0.42 () {58 vars in 1146 bytes} [Sun Oct 23 02:06:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:06:50.970774 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-10fbd794-074f-4923-991d-f7ac64256019 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:06:50.973667 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-10fbd794-074f-4923-991d-f7ac64256019 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] [instance: 7679cb16-1bda-4b84-ae29-bf746559c29c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:06:50.977995 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10fbd794-074f-4923-991d-f7ac64256019 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:50.978530 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10fbd794-074f-4923-991d-f7ac64256019 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:50.978979 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10fbd794-074f-4923-991d-f7ac64256019 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:50.979681 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10fbd794-074f-4923-991d-f7ac64256019 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:50.980151 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10fbd794-074f-4923-991d-f7ac64256019 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:50.980587 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10fbd794-074f-4923-991d-f7ac64256019 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:51.004723 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-10fbd794-074f-4923-991d-f7ac64256019 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] [instance: 7679cb16-1bda-4b84-ae29-bf746559c29c] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 02:06:51.268604 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-10fbd794-074f-4923-991d-f7ac64256019 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7679cb16-1bda-4b84-ae29-bf746559c29c" status: 204 len: 0 microversion: 2.1 time: 0.302451 Oct 23 02:06:51.269191 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3552/7199] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 02:06:50 2022] DELETE /compute/v2.1/servers/7679cb16-1bda-4b84-ae29-bf746559c29c => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 23 02:06:51.277344 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7d87f87a-665a-46ce-9523-52e504511a7b tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:06:51.281291 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7d87f87a-665a-46ce-9523-52e504511a7b tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] [instance: 7679cb16-1bda-4b84-ae29-bf746559c29c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:06:51.284145 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d87f87a-665a-46ce-9523-52e504511a7b tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:51.284631 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d87f87a-665a-46ce-9523-52e504511a7b tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:51.285069 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d87f87a-665a-46ce-9523-52e504511a7b tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:51.285753 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d87f87a-665a-46ce-9523-52e504511a7b tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:51.286238 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d87f87a-665a-46ce-9523-52e504511a7b tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:51.286664 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d87f87a-665a-46ce-9523-52e504511a7b tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:51.420875 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7d87f87a-665a-46ce-9523-52e504511a7b tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de23711530a443e094f868c93cf9d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7660d3c1008542f3ab77272a14ce22e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:06:51.428770 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7d87f87a-665a-46ce-9523-52e504511a7b tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] 10.222.0.42 "GET /compute/v2.1/servers/7679cb16-1bda-4b84-ae29-bf746559c29c" status: 200 len: 1476 microversion: 2.1 time: 0.155435 Oct 23 02:06:51.429355 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3648/7200] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:06:51 2022] GET /compute/v2.1/servers/7679cb16-1bda-4b84-ae29-bf746559c29c => generated 1476 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:06:52.453025 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1023ba1f-91bd-4933-aa38-7643bd97f334 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:06:52.454251 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1023ba1f-91bd-4933-aa38-7643bd97f334 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] [instance: 7679cb16-1bda-4b84-ae29-bf746559c29c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:06:52.460657 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1023ba1f-91bd-4933-aa38-7643bd97f334 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:52.461153 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1023ba1f-91bd-4933-aa38-7643bd97f334 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:52.461850 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1023ba1f-91bd-4933-aa38-7643bd97f334 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:52.462563 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1023ba1f-91bd-4933-aa38-7643bd97f334 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:52.463027 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1023ba1f-91bd-4933-aa38-7643bd97f334 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:52.463459 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1023ba1f-91bd-4933-aa38-7643bd97f334 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:52.596620 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1023ba1f-91bd-4933-aa38-7643bd97f334 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de23711530a443e094f868c93cf9d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7660d3c1008542f3ab77272a14ce22e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:06:52.604354 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1023ba1f-91bd-4933-aa38-7643bd97f334 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] 10.222.0.42 "GET /compute/v2.1/servers/7679cb16-1bda-4b84-ae29-bf746559c29c" status: 200 len: 1476 microversion: 2.1 time: 0.155807 Oct 23 02:06:52.604923 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3553/7201] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:06:52 2022] GET /compute/v2.1/servers/7679cb16-1bda-4b84-ae29-bf746559c29c => generated 1476 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:06:53.342466 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-3162ec61-fcd6-4efb-8b0d-11e02527d27f req-c4be4392-e431-4f8d-9e54-a269803edf1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7679cb16-1bda-4b84-ae29-bf746559c29c", "name": "network-vif-deleted", "tag": "2507671c-5b46-4c1d-b10d-d0f5fdc1bb2a"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:06:53.353838 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-3162ec61-fcd6-4efb-8b0d-11e02527d27f req-c4be4392-e431-4f8d-9e54-a269803edf1f service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:53.354382 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-3162ec61-fcd6-4efb-8b0d-11e02527d27f req-c4be4392-e431-4f8d-9e54-a269803edf1f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:53.354821 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-3162ec61-fcd6-4efb-8b0d-11e02527d27f req-c4be4392-e431-4f8d-9e54-a269803edf1f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:53.370061 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-3162ec61-fcd6-4efb-8b0d-11e02527d27f req-c4be4392-e431-4f8d-9e54-a269803edf1f service nova] Creating event network-vif-deleted:2507671c-5b46-4c1d-b10d-d0f5fdc1bb2a for instance 7679cb16-1bda-4b84-ae29-bf746559c29c on n-h2-master-1 Oct 23 02:06:53.372426 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-3162ec61-fcd6-4efb-8b0d-11e02527d27f req-c4be4392-e431-4f8d-9e54-a269803edf1f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033672 Oct 23 02:06:53.373049 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3649/7202] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:06:53.626872 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8f865630-f528-4b76-8fba-7a7018813b8f tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:06:53.627509 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8f865630-f528-4b76-8fba-7a7018813b8f tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] [instance: 7679cb16-1bda-4b84-ae29-bf746559c29c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:06:53.635151 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f865630-f528-4b76-8fba-7a7018813b8f tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:53.635646 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f865630-f528-4b76-8fba-7a7018813b8f tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:53.636090 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f865630-f528-4b76-8fba-7a7018813b8f tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:53.636784 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f865630-f528-4b76-8fba-7a7018813b8f tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:53.637269 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f865630-f528-4b76-8fba-7a7018813b8f tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:53.637702 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f865630-f528-4b76-8fba-7a7018813b8f tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:53.701083 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8f865630-f528-4b76-8fba-7a7018813b8f tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de23711530a443e094f868c93cf9d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7660d3c1008542f3ab77272a14ce22e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:06:53.709781 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8f865630-f528-4b76-8fba-7a7018813b8f tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] 10.222.0.42 "GET /compute/v2.1/servers/7679cb16-1bda-4b84-ae29-bf746559c29c" status: 200 len: 1306 microversion: 2.1 time: 0.087022 Oct 23 02:06:53.710415 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3554/7203] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:06:53 2022] GET /compute/v2.1/servers/7679cb16-1bda-4b84-ae29-bf746559c29c => generated 1306 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:06:54.734234 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a99f13b6-a495-4c41-99bc-cb16f526ffd8 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:06:54.735083 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a99f13b6-a495-4c41-99bc-cb16f526ffd8 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] [instance: 7679cb16-1bda-4b84-ae29-bf746559c29c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:06:54.741332 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a99f13b6-a495-4c41-99bc-cb16f526ffd8 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:54.741759 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a99f13b6-a495-4c41-99bc-cb16f526ffd8 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:54.742228 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a99f13b6-a495-4c41-99bc-cb16f526ffd8 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:54.742919 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a99f13b6-a495-4c41-99bc-cb16f526ffd8 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:06:54.743376 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a99f13b6-a495-4c41-99bc-cb16f526ffd8 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:06:54.743804 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a99f13b6-a495-4c41-99bc-cb16f526ffd8 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:06:54.757000 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-a99f13b6-a495-4c41-99bc-cb16f526ffd8 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] HTTP exception thrown: Instance 7679cb16-1bda-4b84-ae29-bf746559c29c could not be found. Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a99f13b6-a495-4c41-99bc-cb16f526ffd8 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Request method failure captured: Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/7679cb16-1bda-4b84-ae29-bf746559c29c HTTP/1.1 Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVKGqn4vhIlyb0faEv9FhH6piF2ebcpZ_Dx9-h3SzbGXSMVjnvJ5S6skbzBmh7UbKb7nlTvXT81XPfmIYtbDBH4ZAHrv-INwP3h74K6mf9-BwgHIJYsIvLlmWrbCGuxVQS_gC6tlpCt9oa-CYyfN8couPc1UupvkNO7UtM6dPUYGqz1s Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 7660d3c1008542f3ab77272a14ce22e3 Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-169475086 Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7660d3c1008542f3ab77272a14ce22e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7660d3c1008542f3ab77272a14ce22e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7660d3c1008542f3ab77272a14ce22e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7660d3c1008542f3ab77272a14ce22e3"}]}] Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersAdminNegativeTestJSON-169475086 Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 7660d3c1008542f3ab77272a14ce22e3 Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-169475086 Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersAdminNegativeTestJSON-169475086-project Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: de23711530a443e094f868c93cf9d26d Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersAdminNegativeTestJSON-169475086-project Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 7679cb16-1bda-4b84-ae29-bf746559c29c could not be found. Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '7679cb16-1bda-4b84-ae29-bf746559c29c'} Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7679cb16-1bda-4b84-ae29-bf746559c29c could not be found. Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7679cb16-1bda-4b84-ae29-bf746559c29c could not be found. Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:06:54.758664 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:06:54.763401 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:06:54.763401 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:06:54.763401 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:06:54.763401 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:06:54.763401 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:06:54.763401 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:06:54.763401 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7679cb16-1bda-4b84-ae29-bf746559c29c could not be found. Oct 23 02:06:54.763401 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:06:54.763401 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a99f13b6-a495-4c41-99bc-cb16f526ffd8 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] Returning 404 to user: Instance 7679cb16-1bda-4b84-ae29-bf746559c29c could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:06:54.763401 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a99f13b6-a495-4c41-99bc-cb16f526ffd8 tempest-ServersAdminNegativeTestJSON-169475086 tempest-ServersAdminNegativeTestJSON-169475086-project] 10.222.0.42 "GET /compute/v2.1/servers/7679cb16-1bda-4b84-ae29-bf746559c29c" status: 404 len: 111 microversion: 2.1 time: 0.031066 Oct 23 02:06:54.763401 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3650/7204] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:06:54 2022] GET /compute/v2.1/servers/7679cb16-1bda-4b84-ae29-bf746559c29c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 02:07:02.854380 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:07:02.855267 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=3 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:07:02.973859 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a2fa5e84-aade-41ec-88ab-572d9709af20 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1360545605", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "66509178-6d76-4672-a125-955f5eab0c22"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:07:03.028335 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-a2fa5e84-aade-41ec-88ab-572d9709af20 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] validate_networks() for [('66509178-6d76-4672-a125-955f5eab0c22', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 02:07:03.420437 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-a2fa5e84-aade-41ec-88ab-572d9709af20 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:07:03.421216 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-a2fa5e84-aade-41ec-88ab-572d9709af20 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:07:03.421715 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-a2fa5e84-aade-41ec-88ab-572d9709af20 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:07:03.422938 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-a2fa5e84-aade-41ec-88ab-572d9709af20 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:07:03.423377 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-a2fa5e84-aade-41ec-88ab-572d9709af20 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:07:03.432478 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a2fa5e84-aade-41ec-88ab-572d9709af20 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:03.432981 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a2fa5e84-aade-41ec-88ab-572d9709af20 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:03.433465 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a2fa5e84-aade-41ec-88ab-572d9709af20 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:03.434247 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a2fa5e84-aade-41ec-88ab-572d9709af20 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:03.434722 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a2fa5e84-aade-41ec-88ab-572d9709af20 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:03.435162 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a2fa5e84-aade-41ec-88ab-572d9709af20 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:03.451881 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-a2fa5e84-aade-41ec-88ab-572d9709af20 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Getting quotas for project 7eb4fc36e36248ada12e6841dcda0b71. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:07:03.458078 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-a2fa5e84-aade-41ec-88ab-572d9709af20 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Getting quotas for user 0b855154444b4859a13b3ca5f91298e7 and project 7eb4fc36e36248ada12e6841dcda0b71. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:07:03.471659 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a2fa5e84-aade-41ec-88ab-572d9709af20 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 02:07:03.474071 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a2fa5e84-aade-41ec-88ab-572d9709af20 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] [instance: 52741202-4d26-4b1c-978a-90dc49f77b6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 02:07:03.594703 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a2fa5e84-aade-41ec-88ab-572d9709af20 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.745585 Oct 23 02:07:03.595628 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3555/7205] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 02:07:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 02:07:03.606856 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-623dbed2-ad02-48f4-800a-5b3675ae1308 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:07:03.607743 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-623dbed2-ad02-48f4-800a-5b3675ae1308 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] [instance: 52741202-4d26-4b1c-978a-90dc49f77b6f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:07:03.612913 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:07:03.613628 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=3 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:07:03.670183 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-623dbed2-ad02-48f4-800a-5b3675ae1308 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b855154444b4859a13b3ca5f91298e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb4fc36e36248ada12e6841dcda0b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:07:03.679634 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-623dbed2-ad02-48f4-800a-5b3675ae1308 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] 10.222.0.42 "GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f" status: 200 len: 1215 microversion: 2.1 time: 0.076751 Oct 23 02:07:03.680428 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3651/7206] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:07:03 2022] GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f => generated 1215 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:07:04.705939 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b8eb3efa-bbbb-47e8-b554-0b21bfa80d7d tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:07:04.707161 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b8eb3efa-bbbb-47e8-b554-0b21bfa80d7d tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] [instance: 52741202-4d26-4b1c-978a-90dc49f77b6f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:07:04.715125 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b8eb3efa-bbbb-47e8-b554-0b21bfa80d7d tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:04.715635 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b8eb3efa-bbbb-47e8-b554-0b21bfa80d7d tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:04.716089 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b8eb3efa-bbbb-47e8-b554-0b21bfa80d7d tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:04.716796 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b8eb3efa-bbbb-47e8-b554-0b21bfa80d7d tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:04.717261 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b8eb3efa-bbbb-47e8-b554-0b21bfa80d7d tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:04.717692 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b8eb3efa-bbbb-47e8-b554-0b21bfa80d7d tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:04.780849 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b8eb3efa-bbbb-47e8-b554-0b21bfa80d7d tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b855154444b4859a13b3ca5f91298e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb4fc36e36248ada12e6841dcda0b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:07:04.788681 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b8eb3efa-bbbb-47e8-b554-0b21bfa80d7d tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] 10.222.0.42 "GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f" status: 200 len: 1219 microversion: 2.1 time: 0.089155 Oct 23 02:07:04.789263 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3556/7207] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:07:04 2022] GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:07:05.813336 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f36fb889-3049-4f45-9f42-d2a9745279ba tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:07:05.813892 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f36fb889-3049-4f45-9f42-d2a9745279ba tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] [instance: 52741202-4d26-4b1c-978a-90dc49f77b6f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:07:05.817482 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=59 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:07:05.823024 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f36fb889-3049-4f45-9f42-d2a9745279ba tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:05.823524 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f36fb889-3049-4f45-9f42-d2a9745279ba tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:05.823963 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f36fb889-3049-4f45-9f42-d2a9745279ba tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:05.824705 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f36fb889-3049-4f45-9f42-d2a9745279ba tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:05.825228 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f36fb889-3049-4f45-9f42-d2a9745279ba tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:05.825659 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f36fb889-3049-4f45-9f42-d2a9745279ba tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:05.893122 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f36fb889-3049-4f45-9f42-d2a9745279ba tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b855154444b4859a13b3ca5f91298e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb4fc36e36248ada12e6841dcda0b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:07:05.901518 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f36fb889-3049-4f45-9f42-d2a9745279ba tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] 10.222.0.42 "GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f" status: 200 len: 1267 microversion: 2.1 time: 0.094133 Oct 23 02:07:05.902185 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3652/7208] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:07:05 2022] GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f => generated 1267 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:07:06.925471 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c45ed590-46c0-467b-aaa3-e3ca247638d8 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:07:06.926933 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c45ed590-46c0-467b-aaa3-e3ca247638d8 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] [instance: 52741202-4d26-4b1c-978a-90dc49f77b6f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:07:06.930516 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:07:06.937046 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c45ed590-46c0-467b-aaa3-e3ca247638d8 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:06.942847 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c45ed590-46c0-467b-aaa3-e3ca247638d8 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:06.943469 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c45ed590-46c0-467b-aaa3-e3ca247638d8 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:06.944988 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c45ed590-46c0-467b-aaa3-e3ca247638d8 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:06.944988 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c45ed590-46c0-467b-aaa3-e3ca247638d8 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:06.945320 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c45ed590-46c0-467b-aaa3-e3ca247638d8 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:06.949933 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:07:07.091975 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c45ed590-46c0-467b-aaa3-e3ca247638d8 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b855154444b4859a13b3ca5f91298e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb4fc36e36248ada12e6841dcda0b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:07:07.100645 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c45ed590-46c0-467b-aaa3-e3ca247638d8 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] 10.222.0.42 "GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f" status: 200 len: 1315 microversion: 2.1 time: 0.179689 Oct 23 02:07:07.103544 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3557/7209] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:07:06 2022] GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:07:07.863150 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-6835cf06-7b35-491a-897e-8d0b120d7284 req-ec24982d-2a14-4f75-850c-c52fcdce5e65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52741202-4d26-4b1c-978a-90dc49f77b6f", "tag": "4a65b847-3a5b-405b-a0df-48c900b65ea6"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:07:07.870000 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:07:07.876118 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-6835cf06-7b35-491a-897e-8d0b120d7284 req-ec24982d-2a14-4f75-850c-c52fcdce5e65 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:07.876118 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-6835cf06-7b35-491a-897e-8d0b120d7284 req-ec24982d-2a14-4f75-850c-c52fcdce5e65 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:07.877052 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-6835cf06-7b35-491a-897e-8d0b120d7284 req-ec24982d-2a14-4f75-850c-c52fcdce5e65 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:07.887923 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-6835cf06-7b35-491a-897e-8d0b120d7284 req-ec24982d-2a14-4f75-850c-c52fcdce5e65 service nova] Creating event network-changed:4a65b847-3a5b-405b-a0df-48c900b65ea6 for instance 52741202-4d26-4b1c-978a-90dc49f77b6f on n-h2-master-1 Oct 23 02:07:07.894649 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-6835cf06-7b35-491a-897e-8d0b120d7284 req-ec24982d-2a14-4f75-850c-c52fcdce5e65 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035737 Oct 23 02:07:07.895561 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3653/7210] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:07:08.125147 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5cd3ccce-8e82-41b7-bac8-577fa4be3054 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:07:08.129131 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5cd3ccce-8e82-41b7-bac8-577fa4be3054 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] [instance: 52741202-4d26-4b1c-978a-90dc49f77b6f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:07:08.134417 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5cd3ccce-8e82-41b7-bac8-577fa4be3054 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:08.134921 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5cd3ccce-8e82-41b7-bac8-577fa4be3054 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:08.135370 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5cd3ccce-8e82-41b7-bac8-577fa4be3054 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:08.136083 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5cd3ccce-8e82-41b7-bac8-577fa4be3054 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:08.136602 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5cd3ccce-8e82-41b7-bac8-577fa4be3054 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:08.137038 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5cd3ccce-8e82-41b7-bac8-577fa4be3054 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:08.266638 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5cd3ccce-8e82-41b7-bac8-577fa4be3054 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b855154444b4859a13b3ca5f91298e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb4fc36e36248ada12e6841dcda0b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:07:08.274892 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5cd3ccce-8e82-41b7-bac8-577fa4be3054 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] 10.222.0.42 "GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f" status: 200 len: 1315 microversion: 2.1 time: 0.153803 Oct 23 02:07:08.275472 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3558/7211] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:07:08 2022] GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:07:09.300947 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-de8ec8cf-1c8b-4d1e-a0c7-9594fb58b109 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:07:09.301794 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-de8ec8cf-1c8b-4d1e-a0c7-9594fb58b109 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] [instance: 52741202-4d26-4b1c-978a-90dc49f77b6f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:07:09.308830 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-de8ec8cf-1c8b-4d1e-a0c7-9594fb58b109 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:09.309331 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-de8ec8cf-1c8b-4d1e-a0c7-9594fb58b109 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:09.309781 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-de8ec8cf-1c8b-4d1e-a0c7-9594fb58b109 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:09.310625 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-de8ec8cf-1c8b-4d1e-a0c7-9594fb58b109 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:09.311024 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-de8ec8cf-1c8b-4d1e-a0c7-9594fb58b109 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:09.311462 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-de8ec8cf-1c8b-4d1e-a0c7-9594fb58b109 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:09.450701 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-de8ec8cf-1c8b-4d1e-a0c7-9594fb58b109 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b855154444b4859a13b3ca5f91298e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb4fc36e36248ada12e6841dcda0b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:07:09.459214 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-de8ec8cf-1c8b-4d1e-a0c7-9594fb58b109 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] 10.222.0.42 "GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f" status: 200 len: 1315 microversion: 2.1 time: 0.164416 Oct 23 02:07:09.459892 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3654/7212] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:07:09 2022] GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:07:10.486784 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-dbc23565-13e5-4a48-adf2-0366f65b97ce tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:07:10.487431 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-dbc23565-13e5-4a48-adf2-0366f65b97ce tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] [instance: 52741202-4d26-4b1c-978a-90dc49f77b6f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:07:10.494596 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dbc23565-13e5-4a48-adf2-0366f65b97ce tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:10.495090 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dbc23565-13e5-4a48-adf2-0366f65b97ce tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:10.495535 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dbc23565-13e5-4a48-adf2-0366f65b97ce tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:10.496241 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dbc23565-13e5-4a48-adf2-0366f65b97ce tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:10.496710 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dbc23565-13e5-4a48-adf2-0366f65b97ce tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:10.497146 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dbc23565-13e5-4a48-adf2-0366f65b97ce tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:10.626592 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-dbc23565-13e5-4a48-adf2-0366f65b97ce tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b855154444b4859a13b3ca5f91298e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb4fc36e36248ada12e6841dcda0b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:07:10.634600 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-dbc23565-13e5-4a48-adf2-0366f65b97ce tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] 10.222.0.42 "GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f" status: 200 len: 1315 microversion: 2.1 time: 0.156121 Oct 23 02:07:10.636788 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3559/7213] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:07:10 2022] GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:07:11.657689 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-33266f28-3396-40b1-96b1-77590395330c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:07:11.658333 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-33266f28-3396-40b1-96b1-77590395330c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] [instance: 52741202-4d26-4b1c-978a-90dc49f77b6f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:07:11.665208 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-33266f28-3396-40b1-96b1-77590395330c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:11.669810 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-33266f28-3396-40b1-96b1-77590395330c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:11.669810 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-33266f28-3396-40b1-96b1-77590395330c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:11.669810 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-33266f28-3396-40b1-96b1-77590395330c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:11.669810 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-33266f28-3396-40b1-96b1-77590395330c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:11.669810 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-33266f28-3396-40b1-96b1-77590395330c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:11.795128 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-33266f28-3396-40b1-96b1-77590395330c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b855154444b4859a13b3ca5f91298e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb4fc36e36248ada12e6841dcda0b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:07:11.803470 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-33266f28-3396-40b1-96b1-77590395330c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] 10.222.0.42 "GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f" status: 200 len: 1315 microversion: 2.1 time: 0.149744 Oct 23 02:07:11.804045 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3655/7214] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:07:11 2022] GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:07:12.828954 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-612ade49-8030-45a6-aaca-64bbd812f8ed tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:07:12.829610 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-612ade49-8030-45a6-aaca-64bbd812f8ed tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] [instance: 52741202-4d26-4b1c-978a-90dc49f77b6f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:07:12.836500 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-612ade49-8030-45a6-aaca-64bbd812f8ed tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:12.837249 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-612ade49-8030-45a6-aaca-64bbd812f8ed tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:12.837691 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-612ade49-8030-45a6-aaca-64bbd812f8ed tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:12.838423 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-612ade49-8030-45a6-aaca-64bbd812f8ed tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:12.838890 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-612ade49-8030-45a6-aaca-64bbd812f8ed tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:12.839327 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-612ade49-8030-45a6-aaca-64bbd812f8ed tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:12.974631 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-612ade49-8030-45a6-aaca-64bbd812f8ed tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b855154444b4859a13b3ca5f91298e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb4fc36e36248ada12e6841dcda0b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:07:12.982795 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-612ade49-8030-45a6-aaca-64bbd812f8ed tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] 10.222.0.42 "GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f" status: 200 len: 1315 microversion: 2.1 time: 0.158592 Oct 23 02:07:12.986855 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3560/7215] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:07:12 2022] GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:07:13.184350 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-e564a801-8606-47ef-90da-7433aa7abe88 req-3a7d44cb-566d-4ab4-aefb-6c99b2799196 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52741202-4d26-4b1c-978a-90dc49f77b6f", "name": "network-vif-plugged", "status": "completed", "tag": "4a65b847-3a5b-405b-a0df-48c900b65ea6"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:07:13.195077 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-e564a801-8606-47ef-90da-7433aa7abe88 req-3a7d44cb-566d-4ab4-aefb-6c99b2799196 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:13.195587 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-e564a801-8606-47ef-90da-7433aa7abe88 req-3a7d44cb-566d-4ab4-aefb-6c99b2799196 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:13.196019 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-e564a801-8606-47ef-90da-7433aa7abe88 req-3a7d44cb-566d-4ab4-aefb-6c99b2799196 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:13.207658 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-e564a801-8606-47ef-90da-7433aa7abe88 req-3a7d44cb-566d-4ab4-aefb-6c99b2799196 service nova] Creating event network-vif-plugged:4a65b847-3a5b-405b-a0df-48c900b65ea6 for instance 52741202-4d26-4b1c-978a-90dc49f77b6f on n-h2-master-1 Oct 23 02:07:13.212956 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-e564a801-8606-47ef-90da-7433aa7abe88 req-3a7d44cb-566d-4ab4-aefb-6c99b2799196 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032295 Oct 23 02:07:13.213547 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3656/7216] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:07:14.006249 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e8003584-0ffe-4cb7-8ba2-40ceb60d923d tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:07:14.006801 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e8003584-0ffe-4cb7-8ba2-40ceb60d923d tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] [instance: 52741202-4d26-4b1c-978a-90dc49f77b6f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:07:14.008654 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:07:14.009340 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=6 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:07:14.014946 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8003584-0ffe-4cb7-8ba2-40ceb60d923d tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:14.019809 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8003584-0ffe-4cb7-8ba2-40ceb60d923d tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:14.019809 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8003584-0ffe-4cb7-8ba2-40ceb60d923d tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:14.019809 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8003584-0ffe-4cb7-8ba2-40ceb60d923d tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:14.019809 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8003584-0ffe-4cb7-8ba2-40ceb60d923d tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:14.019809 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8003584-0ffe-4cb7-8ba2-40ceb60d923d tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:14.146757 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e8003584-0ffe-4cb7-8ba2-40ceb60d923d tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b855154444b4859a13b3ca5f91298e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb4fc36e36248ada12e6841dcda0b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:07:14.154307 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e8003584-0ffe-4cb7-8ba2-40ceb60d923d tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] 10.222.0.42 "GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f" status: 200 len: 1315 microversion: 2.1 time: 0.152353 Oct 23 02:07:14.154884 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3561/7217] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:07:14 2022] GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:07:15.179842 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-eda3df8e-e699-4fbd-8bc6-18d4277dc70a tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:07:15.180558 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-eda3df8e-e699-4fbd-8bc6-18d4277dc70a tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] [instance: 52741202-4d26-4b1c-978a-90dc49f77b6f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:07:15.186845 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eda3df8e-e699-4fbd-8bc6-18d4277dc70a tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:15.187337 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eda3df8e-e699-4fbd-8bc6-18d4277dc70a tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:15.187776 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eda3df8e-e699-4fbd-8bc6-18d4277dc70a tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:15.188468 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eda3df8e-e699-4fbd-8bc6-18d4277dc70a tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:15.188922 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eda3df8e-e699-4fbd-8bc6-18d4277dc70a tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:15.189354 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eda3df8e-e699-4fbd-8bc6-18d4277dc70a tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:15.321479 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-eda3df8e-e699-4fbd-8bc6-18d4277dc70a tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b855154444b4859a13b3ca5f91298e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb4fc36e36248ada12e6841dcda0b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:07:15.329280 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-eda3df8e-e699-4fbd-8bc6-18d4277dc70a tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] 10.222.0.42 "GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f" status: 200 len: 1501 microversion: 2.1 time: 0.154643 Oct 23 02:07:15.329871 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3657/7218] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:07:15 2022] GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f => generated 1501 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:07:15.352472 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4c2c5647-d857-4d95-9d83-037221ab0e7c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:07:15.354876 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4c2c5647-d857-4d95-9d83-037221ab0e7c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] [instance: 52741202-4d26-4b1c-978a-90dc49f77b6f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:07:15.362492 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4c2c5647-d857-4d95-9d83-037221ab0e7c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:15.362989 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4c2c5647-d857-4d95-9d83-037221ab0e7c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:15.363438 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4c2c5647-d857-4d95-9d83-037221ab0e7c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:15.364133 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4c2c5647-d857-4d95-9d83-037221ab0e7c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:15.364599 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4c2c5647-d857-4d95-9d83-037221ab0e7c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:15.365068 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4c2c5647-d857-4d95-9d83-037221ab0e7c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:15.393028 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4c2c5647-d857-4d95-9d83-037221ab0e7c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0b855154444b4859a13b3ca5f91298e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb4fc36e36248ada12e6841dcda0b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:07:15.398466 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4c2c5647-d857-4d95-9d83-037221ab0e7c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] [instance: 52741202-4d26-4b1c-978a-90dc49f77b6f] Old instance type m1.heat2, new instance type m1.heat {{(pid=120945) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 23 02:07:15.404783 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-4c2c5647-d857-4d95-9d83-037221ab0e7c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:07:15.405217 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-4c2c5647-d857-4d95-9d83-037221ab0e7c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:07:15.405702 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-4c2c5647-d857-4d95-9d83-037221ab0e7c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:07:15.406673 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-4c2c5647-d857-4d95-9d83-037221ab0e7c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:07:15.407095 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-4c2c5647-d857-4d95-9d83-037221ab0e7c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:07:15.617217 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4c2c5647-d857-4d95-9d83-037221ab0e7c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] 10.222.0.42 "POST /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f/action" status: 202 len: 0 microversion: 2.1 time: 0.268684 Oct 23 02:07:15.617757 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3562/7219] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:07:15 2022] POST /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:07:15.626021 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cbdb56db-0535-40cf-bc05-0d510dea226a tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:07:15.626675 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-cbdb56db-0535-40cf-bc05-0d510dea226a tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] [instance: 52741202-4d26-4b1c-978a-90dc49f77b6f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:07:15.632780 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cbdb56db-0535-40cf-bc05-0d510dea226a tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:15.633347 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cbdb56db-0535-40cf-bc05-0d510dea226a tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:15.633735 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cbdb56db-0535-40cf-bc05-0d510dea226a tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:15.634450 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cbdb56db-0535-40cf-bc05-0d510dea226a tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:15.634912 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cbdb56db-0535-40cf-bc05-0d510dea226a tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:15.635335 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cbdb56db-0535-40cf-bc05-0d510dea226a tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:15.767379 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cbdb56db-0535-40cf-bc05-0d510dea226a tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b855154444b4859a13b3ca5f91298e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb4fc36e36248ada12e6841dcda0b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:07:15.775480 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cbdb56db-0535-40cf-bc05-0d510dea226a tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] 10.222.0.42 "GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f" status: 200 len: 1510 microversion: 2.1 time: 0.153436 Oct 23 02:07:15.776249 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3658/7220] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:07:15 2022] GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:07:16.800905 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-99a5ce27-eaae-4f0b-a0e0-f3de6840af44 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:07:16.801541 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-99a5ce27-eaae-4f0b-a0e0-f3de6840af44 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] [instance: 52741202-4d26-4b1c-978a-90dc49f77b6f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:07:16.808688 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-99a5ce27-eaae-4f0b-a0e0-f3de6840af44 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:16.814011 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-99a5ce27-eaae-4f0b-a0e0-f3de6840af44 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:16.814011 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-99a5ce27-eaae-4f0b-a0e0-f3de6840af44 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:16.814011 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-99a5ce27-eaae-4f0b-a0e0-f3de6840af44 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:16.814011 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-99a5ce27-eaae-4f0b-a0e0-f3de6840af44 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:16.814011 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-99a5ce27-eaae-4f0b-a0e0-f3de6840af44 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:16.945427 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-99a5ce27-eaae-4f0b-a0e0-f3de6840af44 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b855154444b4859a13b3ca5f91298e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb4fc36e36248ada12e6841dcda0b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:07:16.954050 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-99a5ce27-eaae-4f0b-a0e0-f3de6840af44 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] 10.222.0.42 "GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f" status: 200 len: 1510 microversion: 2.1 time: 0.158509 Oct 23 02:07:16.954640 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3563/7221] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:07:16 2022] GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:07:17.978169 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-197a8caf-6f6e-4a0b-8d71-d63da0db4377 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:07:17.978792 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-197a8caf-6f6e-4a0b-8d71-d63da0db4377 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] [instance: 52741202-4d26-4b1c-978a-90dc49f77b6f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:07:17.980738 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:07:17.987010 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-197a8caf-6f6e-4a0b-8d71-d63da0db4377 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:17.987499 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-197a8caf-6f6e-4a0b-8d71-d63da0db4377 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:17.987941 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-197a8caf-6f6e-4a0b-8d71-d63da0db4377 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:17.988632 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-197a8caf-6f6e-4a0b-8d71-d63da0db4377 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:17.989092 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-197a8caf-6f6e-4a0b-8d71-d63da0db4377 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:17.989556 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-197a8caf-6f6e-4a0b-8d71-d63da0db4377 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:18.123070 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-197a8caf-6f6e-4a0b-8d71-d63da0db4377 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b855154444b4859a13b3ca5f91298e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb4fc36e36248ada12e6841dcda0b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:07:18.130923 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-197a8caf-6f6e-4a0b-8d71-d63da0db4377 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] 10.222.0.42 "GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f" status: 200 len: 1510 microversion: 2.1 time: 0.156815 Oct 23 02:07:18.131869 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3659/7222] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:07:17 2022] GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:07:19.154048 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7c093eea-25ee-494f-9577-c784f96600bb tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:07:19.154685 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7c093eea-25ee-494f-9577-c784f96600bb tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] [instance: 52741202-4d26-4b1c-978a-90dc49f77b6f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:07:19.161529 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7c093eea-25ee-494f-9577-c784f96600bb tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:19.162070 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7c093eea-25ee-494f-9577-c784f96600bb tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:19.162524 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7c093eea-25ee-494f-9577-c784f96600bb tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:19.163229 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7c093eea-25ee-494f-9577-c784f96600bb tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:19.163698 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7c093eea-25ee-494f-9577-c784f96600bb tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:19.164140 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7c093eea-25ee-494f-9577-c784f96600bb tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:19.291698 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7c093eea-25ee-494f-9577-c784f96600bb tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b855154444b4859a13b3ca5f91298e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb4fc36e36248ada12e6841dcda0b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:07:19.300228 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7c093eea-25ee-494f-9577-c784f96600bb tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] 10.222.0.42 "GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f" status: 200 len: 1515 microversion: 2.1 time: 0.150096 Oct 23 02:07:19.300818 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3564/7223] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:07:19 2022] GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:07:20.324184 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4f3df4fc-1fb1-4de8-b158-d2548dda5c6b tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:07:20.324798 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4f3df4fc-1fb1-4de8-b158-d2548dda5c6b tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] [instance: 52741202-4d26-4b1c-978a-90dc49f77b6f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:07:20.332195 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f3df4fc-1fb1-4de8-b158-d2548dda5c6b tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:20.332680 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f3df4fc-1fb1-4de8-b158-d2548dda5c6b tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:20.333120 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f3df4fc-1fb1-4de8-b158-d2548dda5c6b tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:20.333805 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f3df4fc-1fb1-4de8-b158-d2548dda5c6b tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:20.334300 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f3df4fc-1fb1-4de8-b158-d2548dda5c6b tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:20.334729 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f3df4fc-1fb1-4de8-b158-d2548dda5c6b tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:20.467532 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4f3df4fc-1fb1-4de8-b158-d2548dda5c6b tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b855154444b4859a13b3ca5f91298e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb4fc36e36248ada12e6841dcda0b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:07:20.475493 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4f3df4fc-1fb1-4de8-b158-d2548dda5c6b tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] 10.222.0.42 "GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f" status: 200 len: 1515 microversion: 2.1 time: 0.155194 Oct 23 02:07:20.476079 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3660/7224] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:07:20 2022] GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:07:21.498919 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b7a70492-c410-40d1-abcc-12962ac8908f tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:07:21.499578 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b7a70492-c410-40d1-abcc-12962ac8908f tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] [instance: 52741202-4d26-4b1c-978a-90dc49f77b6f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:07:21.506534 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b7a70492-c410-40d1-abcc-12962ac8908f tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:21.507033 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b7a70492-c410-40d1-abcc-12962ac8908f tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:21.507475 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b7a70492-c410-40d1-abcc-12962ac8908f tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:21.508172 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b7a70492-c410-40d1-abcc-12962ac8908f tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:21.508637 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b7a70492-c410-40d1-abcc-12962ac8908f tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:21.509072 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b7a70492-c410-40d1-abcc-12962ac8908f tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:21.638984 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b7a70492-c410-40d1-abcc-12962ac8908f tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b855154444b4859a13b3ca5f91298e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb4fc36e36248ada12e6841dcda0b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:07:21.649014 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b7a70492-c410-40d1-abcc-12962ac8908f tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] 10.222.0.42 "GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f" status: 200 len: 1515 microversion: 2.1 time: 0.153992 Oct 23 02:07:21.649645 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3565/7225] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:07:21 2022] GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:07:22.672943 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-eb41d209-2c5a-4c05-9f6b-f844a36da6e7 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:07:22.673597 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-eb41d209-2c5a-4c05-9f6b-f844a36da6e7 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] [instance: 52741202-4d26-4b1c-978a-90dc49f77b6f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:07:22.680042 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb41d209-2c5a-4c05-9f6b-f844a36da6e7 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:22.680535 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb41d209-2c5a-4c05-9f6b-f844a36da6e7 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:22.681026 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb41d209-2c5a-4c05-9f6b-f844a36da6e7 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:22.681706 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb41d209-2c5a-4c05-9f6b-f844a36da6e7 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:22.682193 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb41d209-2c5a-4c05-9f6b-f844a36da6e7 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:22.682624 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-eb41d209-2c5a-4c05-9f6b-f844a36da6e7 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:22.812912 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-eb41d209-2c5a-4c05-9f6b-f844a36da6e7 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b855154444b4859a13b3ca5f91298e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb4fc36e36248ada12e6841dcda0b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:07:22.820691 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-eb41d209-2c5a-4c05-9f6b-f844a36da6e7 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] 10.222.0.42 "GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f" status: 200 len: 1515 microversion: 2.1 time: 0.151827 Oct 23 02:07:22.821268 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3661/7226] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:07:22 2022] GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:07:23.845805 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-af8d0c19-5de5-425e-aab9-69a7b452b5fa tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:07:23.846387 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-af8d0c19-5de5-425e-aab9-69a7b452b5fa tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] [instance: 52741202-4d26-4b1c-978a-90dc49f77b6f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:07:23.852744 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-af8d0c19-5de5-425e-aab9-69a7b452b5fa tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:23.853238 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-af8d0c19-5de5-425e-aab9-69a7b452b5fa tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:23.853685 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-af8d0c19-5de5-425e-aab9-69a7b452b5fa tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:23.854413 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-af8d0c19-5de5-425e-aab9-69a7b452b5fa tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:23.854878 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-af8d0c19-5de5-425e-aab9-69a7b452b5fa tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:23.855312 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-af8d0c19-5de5-425e-aab9-69a7b452b5fa tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:23.982043 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-af8d0c19-5de5-425e-aab9-69a7b452b5fa tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b855154444b4859a13b3ca5f91298e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb4fc36e36248ada12e6841dcda0b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:07:23.989904 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-af8d0c19-5de5-425e-aab9-69a7b452b5fa tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] 10.222.0.42 "GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f" status: 200 len: 1515 microversion: 2.1 time: 0.148721 Oct 23 02:07:23.990510 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3566/7227] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:07:23 2022] GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:07:25.012483 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4293fcc6-b4af-4cf5-b108-d2d0563b7eaa tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:07:25.013109 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4293fcc6-b4af-4cf5-b108-d2d0563b7eaa tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] [instance: 52741202-4d26-4b1c-978a-90dc49f77b6f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:07:25.020693 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4293fcc6-b4af-4cf5-b108-d2d0563b7eaa tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:25.021183 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4293fcc6-b4af-4cf5-b108-d2d0563b7eaa tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:25.021626 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4293fcc6-b4af-4cf5-b108-d2d0563b7eaa tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:25.022417 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4293fcc6-b4af-4cf5-b108-d2d0563b7eaa tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:25.022882 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4293fcc6-b4af-4cf5-b108-d2d0563b7eaa tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:25.023317 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4293fcc6-b4af-4cf5-b108-d2d0563b7eaa tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:25.151016 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4293fcc6-b4af-4cf5-b108-d2d0563b7eaa tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b855154444b4859a13b3ca5f91298e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb4fc36e36248ada12e6841dcda0b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:07:25.159118 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4293fcc6-b4af-4cf5-b108-d2d0563b7eaa tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] 10.222.0.42 "GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f" status: 200 len: 1515 microversion: 2.1 time: 0.150537 Oct 23 02:07:25.159903 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3662/7228] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:07:25 2022] GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:07:26.181331 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e93458e1-cf91-46d7-a684-30100092274c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:07:26.181954 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e93458e1-cf91-46d7-a684-30100092274c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] [instance: 52741202-4d26-4b1c-978a-90dc49f77b6f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:07:26.188943 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e93458e1-cf91-46d7-a684-30100092274c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:26.189444 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e93458e1-cf91-46d7-a684-30100092274c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:26.189898 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e93458e1-cf91-46d7-a684-30100092274c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:26.190626 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e93458e1-cf91-46d7-a684-30100092274c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:26.191143 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e93458e1-cf91-46d7-a684-30100092274c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:26.191585 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e93458e1-cf91-46d7-a684-30100092274c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:26.323412 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e93458e1-cf91-46d7-a684-30100092274c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b855154444b4859a13b3ca5f91298e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb4fc36e36248ada12e6841dcda0b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:07:26.331833 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e93458e1-cf91-46d7-a684-30100092274c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] 10.222.0.42 "GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f" status: 200 len: 1515 microversion: 2.1 time: 0.154437 Oct 23 02:07:26.332428 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3567/7229] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:07:26 2022] GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:07:27.355938 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-46cc0837-cbba-4ba5-ac50-7e117e3c9d6a tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:07:27.356490 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-46cc0837-cbba-4ba5-ac50-7e117e3c9d6a tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] [instance: 52741202-4d26-4b1c-978a-90dc49f77b6f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:07:27.364065 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46cc0837-cbba-4ba5-ac50-7e117e3c9d6a tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:27.364549 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46cc0837-cbba-4ba5-ac50-7e117e3c9d6a tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:27.364987 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46cc0837-cbba-4ba5-ac50-7e117e3c9d6a tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:27.365672 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46cc0837-cbba-4ba5-ac50-7e117e3c9d6a tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:27.366164 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46cc0837-cbba-4ba5-ac50-7e117e3c9d6a tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:27.366588 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46cc0837-cbba-4ba5-ac50-7e117e3c9d6a tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:27.496554 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-46cc0837-cbba-4ba5-ac50-7e117e3c9d6a tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b855154444b4859a13b3ca5f91298e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb4fc36e36248ada12e6841dcda0b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:07:27.504275 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-46cc0837-cbba-4ba5-ac50-7e117e3c9d6a tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] 10.222.0.42 "GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f" status: 200 len: 1515 microversion: 2.1 time: 0.152383 Oct 23 02:07:27.504841 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3663/7230] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:07:27 2022] GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:07:28.527855 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f396991c-05b4-46fa-b8a1-94fba5c4f5d0 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:07:28.528486 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f396991c-05b4-46fa-b8a1-94fba5c4f5d0 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] [instance: 52741202-4d26-4b1c-978a-90dc49f77b6f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:07:28.535867 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f396991c-05b4-46fa-b8a1-94fba5c4f5d0 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:28.536366 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f396991c-05b4-46fa-b8a1-94fba5c4f5d0 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:28.536822 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f396991c-05b4-46fa-b8a1-94fba5c4f5d0 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:28.537527 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f396991c-05b4-46fa-b8a1-94fba5c4f5d0 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:28.538038 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f396991c-05b4-46fa-b8a1-94fba5c4f5d0 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:28.538482 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f396991c-05b4-46fa-b8a1-94fba5c4f5d0 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:28.670153 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f396991c-05b4-46fa-b8a1-94fba5c4f5d0 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b855154444b4859a13b3ca5f91298e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb4fc36e36248ada12e6841dcda0b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:07:28.678518 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f396991c-05b4-46fa-b8a1-94fba5c4f5d0 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] 10.222.0.42 "GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f" status: 200 len: 1515 microversion: 2.1 time: 0.154609 Oct 23 02:07:28.679156 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3568/7231] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:07:28 2022] GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:07:29.700849 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1f01d1e1-78a7-4c28-97da-150b13e354ea tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:07:29.701447 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1f01d1e1-78a7-4c28-97da-150b13e354ea tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] [instance: 52741202-4d26-4b1c-978a-90dc49f77b6f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:07:29.704329 n-d-master-1 devstack@n-api.service[120944]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 23 02:07:29.704466 n-d-master-1 devstack@n-api.service[120944]: Sun Oct 23 02:07:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f (ip 10.222.0.42) !!! Oct 23 02:07:29.712336 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f01d1e1-78a7-4c28-97da-150b13e354ea tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:29.712833 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f01d1e1-78a7-4c28-97da-150b13e354ea tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:29.713277 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f01d1e1-78a7-4c28-97da-150b13e354ea tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:29.714001 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f01d1e1-78a7-4c28-97da-150b13e354ea tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:29.714471 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f01d1e1-78a7-4c28-97da-150b13e354ea tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:29.714904 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f01d1e1-78a7-4c28-97da-150b13e354ea tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:29.842405 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1f01d1e1-78a7-4c28-97da-150b13e354ea tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b855154444b4859a13b3ca5f91298e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb4fc36e36248ada12e6841dcda0b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:07:29.850888 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1f01d1e1-78a7-4c28-97da-150b13e354ea tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] 10.222.0.42 "GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f" status: 200 len: 1515 microversion: 2.1 time: 0.154144 Oct 23 02:07:29.851477 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3664/7232] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:07:29 2022] GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:07:30.874208 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d0cbaab4-ccf8-479c-9db8-2d55814f8a23 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:07:30.874764 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d0cbaab4-ccf8-479c-9db8-2d55814f8a23 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] [instance: 52741202-4d26-4b1c-978a-90dc49f77b6f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:07:30.881694 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0cbaab4-ccf8-479c-9db8-2d55814f8a23 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:30.882232 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0cbaab4-ccf8-479c-9db8-2d55814f8a23 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:30.882687 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0cbaab4-ccf8-479c-9db8-2d55814f8a23 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:30.883388 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0cbaab4-ccf8-479c-9db8-2d55814f8a23 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:30.883857 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0cbaab4-ccf8-479c-9db8-2d55814f8a23 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:30.884296 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0cbaab4-ccf8-479c-9db8-2d55814f8a23 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:31.015893 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d0cbaab4-ccf8-479c-9db8-2d55814f8a23 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b855154444b4859a13b3ca5f91298e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb4fc36e36248ada12e6841dcda0b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:07:31.023753 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d0cbaab4-ccf8-479c-9db8-2d55814f8a23 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] 10.222.0.42 "GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f" status: 200 len: 1515 microversion: 2.1 time: 0.153616 Oct 23 02:07:31.024333 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3569/7233] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:07:30 2022] GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:07:32.047952 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-11dcd75c-a182-482f-be99-1a9076f4d964 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:07:32.048528 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-11dcd75c-a182-482f-be99-1a9076f4d964 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] [instance: 52741202-4d26-4b1c-978a-90dc49f77b6f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:07:32.055352 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-11dcd75c-a182-482f-be99-1a9076f4d964 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:32.055843 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-11dcd75c-a182-482f-be99-1a9076f4d964 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:32.056287 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-11dcd75c-a182-482f-be99-1a9076f4d964 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:32.056985 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-11dcd75c-a182-482f-be99-1a9076f4d964 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:32.057450 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-11dcd75c-a182-482f-be99-1a9076f4d964 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:32.057883 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-11dcd75c-a182-482f-be99-1a9076f4d964 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:32.184558 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-11dcd75c-a182-482f-be99-1a9076f4d964 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b855154444b4859a13b3ca5f91298e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb4fc36e36248ada12e6841dcda0b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:07:32.192886 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-11dcd75c-a182-482f-be99-1a9076f4d964 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] 10.222.0.42 "GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f" status: 200 len: 1515 microversion: 2.1 time: 0.149414 Oct 23 02:07:32.193463 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3665/7234] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:07:32 2022] GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:07:33.216395 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c7417f33-b45d-486c-b2d2-5d1960494071 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:07:33.216958 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c7417f33-b45d-486c-b2d2-5d1960494071 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] [instance: 52741202-4d26-4b1c-978a-90dc49f77b6f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:07:33.223862 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c7417f33-b45d-486c-b2d2-5d1960494071 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:33.224363 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c7417f33-b45d-486c-b2d2-5d1960494071 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:33.224815 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c7417f33-b45d-486c-b2d2-5d1960494071 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:33.225524 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c7417f33-b45d-486c-b2d2-5d1960494071 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:33.226010 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c7417f33-b45d-486c-b2d2-5d1960494071 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:33.226455 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c7417f33-b45d-486c-b2d2-5d1960494071 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:33.352624 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c7417f33-b45d-486c-b2d2-5d1960494071 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b855154444b4859a13b3ca5f91298e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb4fc36e36248ada12e6841dcda0b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:07:33.363174 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c7417f33-b45d-486c-b2d2-5d1960494071 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] 10.222.0.42 "GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f" status: 200 len: 1515 microversion: 2.1 time: 0.148175 Oct 23 02:07:33.363174 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3570/7235] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:07:33 2022] GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f => generated 1515 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:07:34.384024 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e8168a7f-240e-4f9c-b803-b3164415369d tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:07:34.384650 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e8168a7f-240e-4f9c-b803-b3164415369d tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] [instance: 52741202-4d26-4b1c-978a-90dc49f77b6f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:07:34.392022 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e8168a7f-240e-4f9c-b803-b3164415369d tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:34.392506 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e8168a7f-240e-4f9c-b803-b3164415369d tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:34.392941 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e8168a7f-240e-4f9c-b803-b3164415369d tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:34.393627 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e8168a7f-240e-4f9c-b803-b3164415369d tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:34.394117 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e8168a7f-240e-4f9c-b803-b3164415369d tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:34.394549 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e8168a7f-240e-4f9c-b803-b3164415369d tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:34.525018 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e8168a7f-240e-4f9c-b803-b3164415369d tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b855154444b4859a13b3ca5f91298e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb4fc36e36248ada12e6841dcda0b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:07:34.533461 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e8168a7f-240e-4f9c-b803-b3164415369d tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] 10.222.0.42 "GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f" status: 200 len: 1515 microversion: 2.1 time: 0.153335 Oct 23 02:07:34.534052 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3666/7236] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:07:34 2022] GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:07:35.556911 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ced348c8-ce63-4ba1-b8aa-64f9b2da3670 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:07:35.557644 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ced348c8-ce63-4ba1-b8aa-64f9b2da3670 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] [instance: 52741202-4d26-4b1c-978a-90dc49f77b6f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:07:35.564569 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ced348c8-ce63-4ba1-b8aa-64f9b2da3670 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:35.565071 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ced348c8-ce63-4ba1-b8aa-64f9b2da3670 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:35.565524 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ced348c8-ce63-4ba1-b8aa-64f9b2da3670 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:35.566266 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ced348c8-ce63-4ba1-b8aa-64f9b2da3670 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:35.566740 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ced348c8-ce63-4ba1-b8aa-64f9b2da3670 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:35.567218 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ced348c8-ce63-4ba1-b8aa-64f9b2da3670 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:35.693468 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ced348c8-ce63-4ba1-b8aa-64f9b2da3670 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b855154444b4859a13b3ca5f91298e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb4fc36e36248ada12e6841dcda0b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:07:35.701410 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ced348c8-ce63-4ba1-b8aa-64f9b2da3670 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] 10.222.0.42 "GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f" status: 200 len: 1515 microversion: 2.1 time: 0.148441 Oct 23 02:07:35.702521 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3571/7237] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:07:35 2022] GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:07:36.725504 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1006658c-4439-42dd-8667-8d1789836b71 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:07:36.726081 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1006658c-4439-42dd-8667-8d1789836b71 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] [instance: 52741202-4d26-4b1c-978a-90dc49f77b6f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:07:36.732974 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1006658c-4439-42dd-8667-8d1789836b71 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:36.733967 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1006658c-4439-42dd-8667-8d1789836b71 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:36.734430 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1006658c-4439-42dd-8667-8d1789836b71 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:36.735126 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1006658c-4439-42dd-8667-8d1789836b71 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:36.735585 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1006658c-4439-42dd-8667-8d1789836b71 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:36.736013 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1006658c-4439-42dd-8667-8d1789836b71 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:36.739982 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=83 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:07:36.866506 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1006658c-4439-42dd-8667-8d1789836b71 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b855154444b4859a13b3ca5f91298e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb4fc36e36248ada12e6841dcda0b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:07:36.874261 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1006658c-4439-42dd-8667-8d1789836b71 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] 10.222.0.42 "GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f" status: 200 len: 1515 microversion: 2.1 time: 0.152730 Oct 23 02:07:36.874840 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3667/7238] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:07:36 2022] GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:07:37.897236 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-800b2014-fc63-4798-bf13-38a97930074b tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:07:37.897819 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-800b2014-fc63-4798-bf13-38a97930074b tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] [instance: 52741202-4d26-4b1c-978a-90dc49f77b6f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:07:37.904718 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-800b2014-fc63-4798-bf13-38a97930074b tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:37.905290 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-800b2014-fc63-4798-bf13-38a97930074b tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:37.905737 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-800b2014-fc63-4798-bf13-38a97930074b tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:37.906467 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-800b2014-fc63-4798-bf13-38a97930074b tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:37.906933 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-800b2014-fc63-4798-bf13-38a97930074b tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:37.907367 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-800b2014-fc63-4798-bf13-38a97930074b tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:37.925103 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:07:38.037051 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-800b2014-fc63-4798-bf13-38a97930074b tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b855154444b4859a13b3ca5f91298e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb4fc36e36248ada12e6841dcda0b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:07:38.044772 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-800b2014-fc63-4798-bf13-38a97930074b tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] 10.222.0.42 "GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f" status: 200 len: 1515 microversion: 2.1 time: 0.151594 Oct 23 02:07:38.045368 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3572/7239] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:07:37 2022] GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:07:39.068415 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-26771973-186c-4509-9350-7a16aeb264f4 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:07:39.069041 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-26771973-186c-4509-9350-7a16aeb264f4 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] [instance: 52741202-4d26-4b1c-978a-90dc49f77b6f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:07:39.076072 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-26771973-186c-4509-9350-7a16aeb264f4 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:39.076568 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-26771973-186c-4509-9350-7a16aeb264f4 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:39.077505 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-26771973-186c-4509-9350-7a16aeb264f4 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:39.078238 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-26771973-186c-4509-9350-7a16aeb264f4 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:39.078701 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-26771973-186c-4509-9350-7a16aeb264f4 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:39.079134 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-26771973-186c-4509-9350-7a16aeb264f4 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:39.205062 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-26771973-186c-4509-9350-7a16aeb264f4 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b855154444b4859a13b3ca5f91298e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb4fc36e36248ada12e6841dcda0b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:07:39.213099 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-26771973-186c-4509-9350-7a16aeb264f4 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] 10.222.0.42 "GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f" status: 200 len: 1515 microversion: 2.1 time: 0.148681 Oct 23 02:07:39.213683 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3668/7240] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:07:39 2022] GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:07:40.236381 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bd51f689-3511-45c1-a0fe-a3e02c62c38a tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:07:40.237008 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-bd51f689-3511-45c1-a0fe-a3e02c62c38a tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] [instance: 52741202-4d26-4b1c-978a-90dc49f77b6f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:07:40.240698 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=36 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:07:40.244226 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd51f689-3511-45c1-a0fe-a3e02c62c38a tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:40.249107 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd51f689-3511-45c1-a0fe-a3e02c62c38a tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:40.249107 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd51f689-3511-45c1-a0fe-a3e02c62c38a tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:40.249107 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd51f689-3511-45c1-a0fe-a3e02c62c38a tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:40.249107 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd51f689-3511-45c1-a0fe-a3e02c62c38a tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:40.249107 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bd51f689-3511-45c1-a0fe-a3e02c62c38a tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:40.377671 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bd51f689-3511-45c1-a0fe-a3e02c62c38a tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b855154444b4859a13b3ca5f91298e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb4fc36e36248ada12e6841dcda0b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:07:40.385498 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bd51f689-3511-45c1-a0fe-a3e02c62c38a tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] 10.222.0.42 "GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f" status: 200 len: 1515 microversion: 2.1 time: 0.152960 Oct 23 02:07:40.386120 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3573/7241] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:07:40 2022] GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:07:41.409333 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-94f4b8d2-b2d4-4ce9-bca3-a76b43fcac19 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:07:41.409963 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-94f4b8d2-b2d4-4ce9-bca3-a76b43fcac19 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] [instance: 52741202-4d26-4b1c-978a-90dc49f77b6f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:07:41.412920 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=32 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:07:41.417623 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-94f4b8d2-b2d4-4ce9-bca3-a76b43fcac19 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:41.418147 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-94f4b8d2-b2d4-4ce9-bca3-a76b43fcac19 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:41.418586 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-94f4b8d2-b2d4-4ce9-bca3-a76b43fcac19 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:41.419272 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-94f4b8d2-b2d4-4ce9-bca3-a76b43fcac19 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:41.420009 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-94f4b8d2-b2d4-4ce9-bca3-a76b43fcac19 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:41.420437 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-94f4b8d2-b2d4-4ce9-bca3-a76b43fcac19 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:41.553478 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-94f4b8d2-b2d4-4ce9-bca3-a76b43fcac19 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b855154444b4859a13b3ca5f91298e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb4fc36e36248ada12e6841dcda0b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:07:41.561222 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-94f4b8d2-b2d4-4ce9-bca3-a76b43fcac19 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] 10.222.0.42 "GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f" status: 200 len: 1515 microversion: 2.1 time: 0.156535 Oct 23 02:07:41.561813 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3669/7242] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:07:41 2022] GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:07:42.584481 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d0c83526-c094-41de-81fe-22c12763eae2 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:07:42.585096 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d0c83526-c094-41de-81fe-22c12763eae2 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] [instance: 52741202-4d26-4b1c-978a-90dc49f77b6f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:07:42.592285 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0c83526-c094-41de-81fe-22c12763eae2 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:42.592784 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0c83526-c094-41de-81fe-22c12763eae2 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:42.593231 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0c83526-c094-41de-81fe-22c12763eae2 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:42.593950 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0c83526-c094-41de-81fe-22c12763eae2 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:42.594430 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0c83526-c094-41de-81fe-22c12763eae2 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:42.594866 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d0c83526-c094-41de-81fe-22c12763eae2 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:42.727319 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d0c83526-c094-41de-81fe-22c12763eae2 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b855154444b4859a13b3ca5f91298e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb4fc36e36248ada12e6841dcda0b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:07:42.735459 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d0c83526-c094-41de-81fe-22c12763eae2 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] 10.222.0.42 "GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f" status: 200 len: 1515 microversion: 2.1 time: 0.155003 Oct 23 02:07:42.736030 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3574/7243] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:07:42 2022] GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:07:43.759009 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2087c51f-73ba-494f-bc53-79be44837493 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:07:43.759602 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2087c51f-73ba-494f-bc53-79be44837493 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] [instance: 52741202-4d26-4b1c-978a-90dc49f77b6f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:07:43.767146 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2087c51f-73ba-494f-bc53-79be44837493 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:43.767628 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2087c51f-73ba-494f-bc53-79be44837493 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:43.768065 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2087c51f-73ba-494f-bc53-79be44837493 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:43.768756 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2087c51f-73ba-494f-bc53-79be44837493 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:43.769214 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2087c51f-73ba-494f-bc53-79be44837493 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:43.769641 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2087c51f-73ba-494f-bc53-79be44837493 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:43.898287 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2087c51f-73ba-494f-bc53-79be44837493 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b855154444b4859a13b3ca5f91298e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb4fc36e36248ada12e6841dcda0b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:07:43.906103 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2087c51f-73ba-494f-bc53-79be44837493 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] 10.222.0.42 "GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f" status: 200 len: 1515 microversion: 2.1 time: 0.151086 Oct 23 02:07:43.906685 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3670/7244] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:07:43 2022] GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:07:44.929271 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-20f4d35c-1548-4ecd-8375-a3f14addce5c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:07:44.929806 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-20f4d35c-1548-4ecd-8375-a3f14addce5c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] [instance: 52741202-4d26-4b1c-978a-90dc49f77b6f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:07:44.936745 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-20f4d35c-1548-4ecd-8375-a3f14addce5c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:44.937256 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-20f4d35c-1548-4ecd-8375-a3f14addce5c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:44.937709 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-20f4d35c-1548-4ecd-8375-a3f14addce5c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:44.938448 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-20f4d35c-1548-4ecd-8375-a3f14addce5c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:44.938948 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-20f4d35c-1548-4ecd-8375-a3f14addce5c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:44.939381 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-20f4d35c-1548-4ecd-8375-a3f14addce5c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:45.071028 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-20f4d35c-1548-4ecd-8375-a3f14addce5c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b855154444b4859a13b3ca5f91298e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb4fc36e36248ada12e6841dcda0b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:07:45.079390 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-20f4d35c-1548-4ecd-8375-a3f14addce5c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] 10.222.0.42 "GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f" status: 200 len: 1515 microversion: 2.1 time: 0.154092 Oct 23 02:07:45.079970 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3575/7245] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:07:44 2022] GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:07:46.103510 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8f8aee49-b705-42b4-8eb6-5c2dee304eeb tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:07:46.104133 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8f8aee49-b705-42b4-8eb6-5c2dee304eeb tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] [instance: 52741202-4d26-4b1c-978a-90dc49f77b6f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:07:46.111641 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8f8aee49-b705-42b4-8eb6-5c2dee304eeb tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:46.112137 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8f8aee49-b705-42b4-8eb6-5c2dee304eeb tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:46.112582 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8f8aee49-b705-42b4-8eb6-5c2dee304eeb tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:46.113280 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8f8aee49-b705-42b4-8eb6-5c2dee304eeb tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:46.113743 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8f8aee49-b705-42b4-8eb6-5c2dee304eeb tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:46.114208 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8f8aee49-b705-42b4-8eb6-5c2dee304eeb tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:46.243505 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8f8aee49-b705-42b4-8eb6-5c2dee304eeb tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b855154444b4859a13b3ca5f91298e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb4fc36e36248ada12e6841dcda0b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:07:46.251524 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8f8aee49-b705-42b4-8eb6-5c2dee304eeb tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] 10.222.0.42 "GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f" status: 200 len: 1515 microversion: 2.1 time: 0.151910 Oct 23 02:07:46.252963 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3671/7246] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:07:46 2022] GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:07:47.216482 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-080b0de7-d688-471d-ac8f-ea8efe385587 req-6d357050-9c3f-4691-8344-56b3fa1ed679 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52741202-4d26-4b1c-978a-90dc49f77b6f", "name": "network-vif-unplugged", "status": "completed", "tag": "4a65b847-3a5b-405b-a0df-48c900b65ea6"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:07:47.226744 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-080b0de7-d688-471d-ac8f-ea8efe385587 req-6d357050-9c3f-4691-8344-56b3fa1ed679 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:47.227354 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-080b0de7-d688-471d-ac8f-ea8efe385587 req-6d357050-9c3f-4691-8344-56b3fa1ed679 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:47.227810 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-080b0de7-d688-471d-ac8f-ea8efe385587 req-6d357050-9c3f-4691-8344-56b3fa1ed679 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:47.240331 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-080b0de7-d688-471d-ac8f-ea8efe385587 req-6d357050-9c3f-4691-8344-56b3fa1ed679 service nova] Creating event network-vif-unplugged:4a65b847-3a5b-405b-a0df-48c900b65ea6 for instance 52741202-4d26-4b1c-978a-90dc49f77b6f on n-h1-master-1 Oct 23 02:07:47.245957 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [req-080b0de7-d688-471d-ac8f-ea8efe385587 req-6d357050-9c3f-4691-8344-56b3fa1ed679 service nova] Instance 52741202-4d26-4b1c-978a-90dc49f77b6f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120945) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 23 02:07:47.258324 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-080b0de7-d688-471d-ac8f-ea8efe385587 req-6d357050-9c3f-4691-8344-56b3fa1ed679 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045956 Oct 23 02:07:47.258913 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3576/7247] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:07:47.276639 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b34cd548-647b-459c-919c-6eba9c77f738 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:07:47.277258 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b34cd548-647b-459c-919c-6eba9c77f738 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] [instance: 52741202-4d26-4b1c-978a-90dc49f77b6f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:07:47.284211 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b34cd548-647b-459c-919c-6eba9c77f738 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:47.284696 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b34cd548-647b-459c-919c-6eba9c77f738 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:47.285157 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b34cd548-647b-459c-919c-6eba9c77f738 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:47.285842 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b34cd548-647b-459c-919c-6eba9c77f738 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:47.286327 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b34cd548-647b-459c-919c-6eba9c77f738 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:47.286778 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b34cd548-647b-459c-919c-6eba9c77f738 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:47.417356 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b34cd548-647b-459c-919c-6eba9c77f738 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b855154444b4859a13b3ca5f91298e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb4fc36e36248ada12e6841dcda0b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:07:47.426014 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b34cd548-647b-459c-919c-6eba9c77f738 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] 10.222.0.42 "GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f" status: 200 len: 1514 microversion: 2.1 time: 0.153242 Oct 23 02:07:47.426820 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3672/7248] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:07:47 2022] GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:07:48.450251 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c9ceb45f-efda-444c-b927-9c20edd8155c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:07:48.451002 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c9ceb45f-efda-444c-b927-9c20edd8155c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] [instance: 52741202-4d26-4b1c-978a-90dc49f77b6f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:07:48.458740 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c9ceb45f-efda-444c-b927-9c20edd8155c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:48.459241 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c9ceb45f-efda-444c-b927-9c20edd8155c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:48.459691 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c9ceb45f-efda-444c-b927-9c20edd8155c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:48.460397 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c9ceb45f-efda-444c-b927-9c20edd8155c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:48.460868 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c9ceb45f-efda-444c-b927-9c20edd8155c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:48.461314 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c9ceb45f-efda-444c-b927-9c20edd8155c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:48.596914 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c9ceb45f-efda-444c-b927-9c20edd8155c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b855154444b4859a13b3ca5f91298e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb4fc36e36248ada12e6841dcda0b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:07:48.604636 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c9ceb45f-efda-444c-b927-9c20edd8155c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] 10.222.0.42 "GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f" status: 200 len: 1512 microversion: 2.1 time: 0.158662 Oct 23 02:07:48.605215 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3577/7249] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:07:48 2022] GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:07:49.274760 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-210d635d-d7dc-476b-b970-5d5ab57cc2bd req-975ae15e-2e56-4c2d-b1f7-86138eea7859 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52741202-4d26-4b1c-978a-90dc49f77b6f", "tag": "4a65b847-3a5b-405b-a0df-48c900b65ea6"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:07:49.285653 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-210d635d-d7dc-476b-b970-5d5ab57cc2bd req-975ae15e-2e56-4c2d-b1f7-86138eea7859 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:49.286183 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-210d635d-d7dc-476b-b970-5d5ab57cc2bd req-975ae15e-2e56-4c2d-b1f7-86138eea7859 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:49.286624 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-210d635d-d7dc-476b-b970-5d5ab57cc2bd req-975ae15e-2e56-4c2d-b1f7-86138eea7859 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:49.297999 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-210d635d-d7dc-476b-b970-5d5ab57cc2bd req-975ae15e-2e56-4c2d-b1f7-86138eea7859 service nova] Creating event network-changed:4a65b847-3a5b-405b-a0df-48c900b65ea6 for instance 52741202-4d26-4b1c-978a-90dc49f77b6f on n-h1-master-1 Oct 23 02:07:49.303184 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [req-210d635d-d7dc-476b-b970-5d5ab57cc2bd req-975ae15e-2e56-4c2d-b1f7-86138eea7859 service nova] Instance 52741202-4d26-4b1c-978a-90dc49f77b6f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120944) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 23 02:07:49.313794 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-210d635d-d7dc-476b-b970-5d5ab57cc2bd req-975ae15e-2e56-4c2d-b1f7-86138eea7859 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042789 Oct 23 02:07:49.314421 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3673/7250] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:07:49.627971 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0c825ff3-7b56-454b-914d-6bec4060c404 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:07:49.628605 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0c825ff3-7b56-454b-914d-6bec4060c404 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] [instance: 52741202-4d26-4b1c-978a-90dc49f77b6f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:07:49.635413 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0c825ff3-7b56-454b-914d-6bec4060c404 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:49.635912 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0c825ff3-7b56-454b-914d-6bec4060c404 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:49.636360 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0c825ff3-7b56-454b-914d-6bec4060c404 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:49.637068 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0c825ff3-7b56-454b-914d-6bec4060c404 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:49.637532 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0c825ff3-7b56-454b-914d-6bec4060c404 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:49.637969 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0c825ff3-7b56-454b-914d-6bec4060c404 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:49.771860 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0c825ff3-7b56-454b-914d-6bec4060c404 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b855154444b4859a13b3ca5f91298e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb4fc36e36248ada12e6841dcda0b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:07:49.779943 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0c825ff3-7b56-454b-914d-6bec4060c404 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] 10.222.0.42 "GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f" status: 200 len: 1512 microversion: 2.1 time: 0.156291 Oct 23 02:07:49.780544 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3578/7251] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:07:49 2022] GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:07:50.805040 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fb26e611-8415-4cc6-9b40-40c8e7418d65 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:07:50.805669 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fb26e611-8415-4cc6-9b40-40c8e7418d65 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] [instance: 52741202-4d26-4b1c-978a-90dc49f77b6f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:07:50.811975 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb26e611-8415-4cc6-9b40-40c8e7418d65 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:50.812467 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb26e611-8415-4cc6-9b40-40c8e7418d65 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:50.812910 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb26e611-8415-4cc6-9b40-40c8e7418d65 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:50.813605 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb26e611-8415-4cc6-9b40-40c8e7418d65 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:50.814160 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb26e611-8415-4cc6-9b40-40c8e7418d65 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:50.814592 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb26e611-8415-4cc6-9b40-40c8e7418d65 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:50.946560 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fb26e611-8415-4cc6-9b40-40c8e7418d65 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b855154444b4859a13b3ca5f91298e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb4fc36e36248ada12e6841dcda0b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:07:50.954827 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fb26e611-8415-4cc6-9b40-40c8e7418d65 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] 10.222.0.42 "GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f" status: 200 len: 1509 microversion: 2.1 time: 0.155025 Oct 23 02:07:50.955404 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3674/7252] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:07:50 2022] GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:07:50.977990 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c1a70748-31bf-47e0-bbe1-1492967b249a tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:07:50.978637 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c1a70748-31bf-47e0-bbe1-1492967b249a tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] [instance: 52741202-4d26-4b1c-978a-90dc49f77b6f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:07:50.985715 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c1a70748-31bf-47e0-bbe1-1492967b249a tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:50.986268 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c1a70748-31bf-47e0-bbe1-1492967b249a tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:50.986713 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c1a70748-31bf-47e0-bbe1-1492967b249a tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:50.987423 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c1a70748-31bf-47e0-bbe1-1492967b249a tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:50.987887 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c1a70748-31bf-47e0-bbe1-1492967b249a tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:50.988321 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c1a70748-31bf-47e0-bbe1-1492967b249a tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:51.013931 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c1a70748-31bf-47e0-bbe1-1492967b249a tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] [instance: 52741202-4d26-4b1c-978a-90dc49f77b6f] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 02:07:51.142069 n-d-master-1 devstack@n-api.service[120945]: INFO nova.compute.api [None req-c1a70748-31bf-47e0-bbe1-1492967b249a tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] [instance: 52741202-4d26-4b1c-978a-90dc49f77b6f] Found an unconfirmed migration during delete, id: 16, status: finished Oct 23 02:07:53.536005 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c1a70748-31bf-47e0-bbe1-1492967b249a tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] 10.222.0.42 "DELETE /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f" status: 204 len: 0 microversion: 2.1 time: 2.561723 Oct 23 02:07:53.536670 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3579/7253] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 02:07:50 2022] DELETE /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f => generated 0 bytes in 2563 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 02:07:53.544907 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-33da2d41-670f-4e8b-b695-87de8c353f2c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:07:53.551189 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-33da2d41-670f-4e8b-b695-87de8c353f2c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] [instance: 52741202-4d26-4b1c-978a-90dc49f77b6f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:07:53.553319 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-33da2d41-670f-4e8b-b695-87de8c353f2c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:53.553813 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-33da2d41-670f-4e8b-b695-87de8c353f2c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:53.554277 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-33da2d41-670f-4e8b-b695-87de8c353f2c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:53.554970 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-33da2d41-670f-4e8b-b695-87de8c353f2c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:53.555427 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-33da2d41-670f-4e8b-b695-87de8c353f2c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:53.555854 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-33da2d41-670f-4e8b-b695-87de8c353f2c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:53.686867 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-33da2d41-670f-4e8b-b695-87de8c353f2c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b855154444b4859a13b3ca5f91298e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb4fc36e36248ada12e6841dcda0b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:07:53.695980 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-33da2d41-670f-4e8b-b695-87de8c353f2c tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] 10.222.0.42 "GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f" status: 200 len: 1501 microversion: 2.1 time: 0.154079 Oct 23 02:07:53.695980 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3675/7254] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:07:53 2022] GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f => generated 1501 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:07:54.719642 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-aeb27bb7-e20f-4662-8e79-646075f7e3f8 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:07:54.720923 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-aeb27bb7-e20f-4662-8e79-646075f7e3f8 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] [instance: 52741202-4d26-4b1c-978a-90dc49f77b6f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:07:54.727823 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aeb27bb7-e20f-4662-8e79-646075f7e3f8 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:54.729013 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aeb27bb7-e20f-4662-8e79-646075f7e3f8 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:54.729013 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aeb27bb7-e20f-4662-8e79-646075f7e3f8 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:54.729537 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aeb27bb7-e20f-4662-8e79-646075f7e3f8 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:54.730019 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aeb27bb7-e20f-4662-8e79-646075f7e3f8 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:54.730456 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aeb27bb7-e20f-4662-8e79-646075f7e3f8 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:54.859634 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-aeb27bb7-e20f-4662-8e79-646075f7e3f8 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b855154444b4859a13b3ca5f91298e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb4fc36e36248ada12e6841dcda0b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:07:54.867698 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-aeb27bb7-e20f-4662-8e79-646075f7e3f8 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] 10.222.0.42 "GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f" status: 200 len: 1501 microversion: 2.1 time: 0.152742 Oct 23 02:07:54.868279 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3580/7255] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:07:54 2022] GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f => generated 1501 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:07:55.248374 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-58cbf265-e7bd-44ae-b430-03ff12c6c55e req-ba7ac79a-9016-49e0-aac7-14612361cc4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52741202-4d26-4b1c-978a-90dc49f77b6f", "name": "network-vif-plugged", "status": "completed", "tag": "4a65b847-3a5b-405b-a0df-48c900b65ea6"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:07:55.261132 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-58cbf265-e7bd-44ae-b430-03ff12c6c55e req-ba7ac79a-9016-49e0-aac7-14612361cc4d service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:55.261625 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-58cbf265-e7bd-44ae-b430-03ff12c6c55e req-ba7ac79a-9016-49e0-aac7-14612361cc4d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:55.262155 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-58cbf265-e7bd-44ae-b430-03ff12c6c55e req-ba7ac79a-9016-49e0-aac7-14612361cc4d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:55.276614 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-58cbf265-e7bd-44ae-b430-03ff12c6c55e req-ba7ac79a-9016-49e0-aac7-14612361cc4d service nova] Creating event network-vif-plugged:4a65b847-3a5b-405b-a0df-48c900b65ea6 for instance 52741202-4d26-4b1c-978a-90dc49f77b6f on n-h1-master-1 Oct 23 02:07:55.282073 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-58cbf265-e7bd-44ae-b430-03ff12c6c55e req-ba7ac79a-9016-49e0-aac7-14612361cc4d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038112 Oct 23 02:07:55.285961 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3676/7256] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:07:55.655738 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-e03df749-510c-4554-b949-51c30c37e01a req-17e0e7f9-c1dd-4e3d-b02b-6f89165f7619 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52741202-4d26-4b1c-978a-90dc49f77b6f", "name": "network-vif-deleted", "tag": "4a65b847-3a5b-405b-a0df-48c900b65ea6"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:07:55.666389 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-e03df749-510c-4554-b949-51c30c37e01a req-17e0e7f9-c1dd-4e3d-b02b-6f89165f7619 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:55.666880 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-e03df749-510c-4554-b949-51c30c37e01a req-17e0e7f9-c1dd-4e3d-b02b-6f89165f7619 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:55.667321 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-e03df749-510c-4554-b949-51c30c37e01a req-17e0e7f9-c1dd-4e3d-b02b-6f89165f7619 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:55.678693 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-e03df749-510c-4554-b949-51c30c37e01a req-17e0e7f9-c1dd-4e3d-b02b-6f89165f7619 service nova] Creating event network-vif-deleted:4a65b847-3a5b-405b-a0df-48c900b65ea6 for instance 52741202-4d26-4b1c-978a-90dc49f77b6f on n-h1-master-1 Oct 23 02:07:55.683744 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-e03df749-510c-4554-b949-51c30c37e01a req-17e0e7f9-c1dd-4e3d-b02b-6f89165f7619 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031651 Oct 23 02:07:55.684375 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3581/7257] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:07:55.892167 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-03d24509-e986-4d25-b5ef-a04a80c8dfb5 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:07:55.892771 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-03d24509-e986-4d25-b5ef-a04a80c8dfb5 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] [instance: 52741202-4d26-4b1c-978a-90dc49f77b6f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:07:55.899086 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-03d24509-e986-4d25-b5ef-a04a80c8dfb5 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:55.899576 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-03d24509-e986-4d25-b5ef-a04a80c8dfb5 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:55.900067 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-03d24509-e986-4d25-b5ef-a04a80c8dfb5 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:55.900755 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-03d24509-e986-4d25-b5ef-a04a80c8dfb5 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:55.901215 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-03d24509-e986-4d25-b5ef-a04a80c8dfb5 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:55.901646 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-03d24509-e986-4d25-b5ef-a04a80c8dfb5 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:55.971476 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-03d24509-e986-4d25-b5ef-a04a80c8dfb5 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b855154444b4859a13b3ca5f91298e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb4fc36e36248ada12e6841dcda0b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:07:55.979974 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-03d24509-e986-4d25-b5ef-a04a80c8dfb5 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] 10.222.0.42 "GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f" status: 200 len: 1294 microversion: 2.1 time: 0.092549 Oct 23 02:07:55.980576 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3677/7258] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:07:55 2022] GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f => generated 1294 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:07:57.005381 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-435f7b84-efa3-4eee-8e71-6238a37b483f tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:07:57.006127 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-435f7b84-efa3-4eee-8e71-6238a37b483f tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] [instance: 52741202-4d26-4b1c-978a-90dc49f77b6f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:07:57.012384 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-435f7b84-efa3-4eee-8e71-6238a37b483f tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:57.012888 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-435f7b84-efa3-4eee-8e71-6238a37b483f tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:57.013341 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-435f7b84-efa3-4eee-8e71-6238a37b483f tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:57.014078 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-435f7b84-efa3-4eee-8e71-6238a37b483f tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:57.014553 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-435f7b84-efa3-4eee-8e71-6238a37b483f tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:57.014995 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-435f7b84-efa3-4eee-8e71-6238a37b483f tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:57.028215 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-435f7b84-efa3-4eee-8e71-6238a37b483f tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] HTTP exception thrown: Instance 52741202-4d26-4b1c-978a-90dc49f77b6f could not be found. Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-435f7b84-efa3-4eee-8e71-6238a37b483f tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Request method failure captured: Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f HTTP/1.1 Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVKHGhHZ2W6vQWUaergnF_gEPc4URBQsr3lJP2bHC9s_ydvxkavhzcphulmy1CHVy2G1TaFYS4P_4OfSvsI1gi8CukTuWObb47HbyqmZi0nIjKobpfKGH9I4UJ0K2V0XP_jO4hQLNDPzfrHOrP1aw9JPIuA6CtRfHAI9phxJg6FjKp2A Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 7eb4fc36e36248ada12e6841dcda0b71 Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-DeleteServersTestJSON-72346252 Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7eb4fc36e36248ada12e6841dcda0b71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7eb4fc36e36248ada12e6841dcda0b71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7eb4fc36e36248ada12e6841dcda0b71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7eb4fc36e36248ada12e6841dcda0b71"}]}] Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-DeleteServersTestJSON-72346252 Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 7eb4fc36e36248ada12e6841dcda0b71 Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-DeleteServersTestJSON-72346252 Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-DeleteServersTestJSON-72346252-project Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 0b855154444b4859a13b3ca5f91298e7 Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-DeleteServersTestJSON-72346252-project Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 52741202-4d26-4b1c-978a-90dc49f77b6f could not be found. Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '52741202-4d26-4b1c-978a-90dc49f77b6f'} Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52741202-4d26-4b1c-978a-90dc49f77b6f could not be found. Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52741202-4d26-4b1c-978a-90dc49f77b6f could not be found. Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:07:57.029873 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:07:57.035430 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:07:57.035430 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:07:57.035430 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:07:57.035430 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:07:57.035430 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:07:57.035430 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52741202-4d26-4b1c-978a-90dc49f77b6f could not be found. Oct 23 02:07:57.035430 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:07:57.035430 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-435f7b84-efa3-4eee-8e71-6238a37b483f tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Returning 404 to user: Instance 52741202-4d26-4b1c-978a-90dc49f77b6f could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:07:57.035430 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-435f7b84-efa3-4eee-8e71-6238a37b483f tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] 10.222.0.42 "GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f" status: 404 len: 111 microversion: 2.1 time: 0.031686 Oct 23 02:07:57.035430 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3582/7259] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:07:56 2022] GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:07:57.048203 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-43b6fb9a-e259-47d5-8f0d-e1dcf3eb32f0 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:07:57.049412 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-43b6fb9a-e259-47d5-8f0d-e1dcf3eb32f0 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] [instance: 52741202-4d26-4b1c-978a-90dc49f77b6f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:07:57.056354 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-43b6fb9a-e259-47d5-8f0d-e1dcf3eb32f0 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:57.056841 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-43b6fb9a-e259-47d5-8f0d-e1dcf3eb32f0 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:57.057278 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-43b6fb9a-e259-47d5-8f0d-e1dcf3eb32f0 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:57.057959 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-43b6fb9a-e259-47d5-8f0d-e1dcf3eb32f0 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:57.058436 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-43b6fb9a-e259-47d5-8f0d-e1dcf3eb32f0 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:57.058860 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-43b6fb9a-e259-47d5-8f0d-e1dcf3eb32f0 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:57.072092 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-43b6fb9a-e259-47d5-8f0d-e1dcf3eb32f0 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] HTTP exception thrown: Instance 52741202-4d26-4b1c-978a-90dc49f77b6f could not be found. Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-43b6fb9a-e259-47d5-8f0d-e1dcf3eb32f0 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Request method failure captured: Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f HTTP/1.1 Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVKHGhHZ2W6vQWUaergnF_gEPc4URBQsr3lJP2bHC9s_ydvxkavhzcphulmy1CHVy2G1TaFYS4P_4OfSvsI1gi8CukTuWObb47HbyqmZi0nIjKobpfKGH9I4UJ0K2V0XP_jO4hQLNDPzfrHOrP1aw9JPIuA6CtRfHAI9phxJg6FjKp2A Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 7eb4fc36e36248ada12e6841dcda0b71 Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-DeleteServersTestJSON-72346252 Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7eb4fc36e36248ada12e6841dcda0b71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7eb4fc36e36248ada12e6841dcda0b71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7eb4fc36e36248ada12e6841dcda0b71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7eb4fc36e36248ada12e6841dcda0b71"}]}] Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-DeleteServersTestJSON-72346252 Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 7eb4fc36e36248ada12e6841dcda0b71 Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-DeleteServersTestJSON-72346252 Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-DeleteServersTestJSON-72346252-project Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 0b855154444b4859a13b3ca5f91298e7 Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-DeleteServersTestJSON-72346252-project Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 52741202-4d26-4b1c-978a-90dc49f77b6f could not be found. Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '52741202-4d26-4b1c-978a-90dc49f77b6f'} Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52741202-4d26-4b1c-978a-90dc49f77b6f could not be found. Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:07:57.073760 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:07:57.078244 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52741202-4d26-4b1c-978a-90dc49f77b6f could not be found. Oct 23 02:07:57.078244 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:07:57.078244 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:07:57.078244 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:07:57.078244 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:07:57.078244 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:07:57.078244 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:07:57.078244 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:07:57.078244 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:07:57.078244 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52741202-4d26-4b1c-978a-90dc49f77b6f could not be found. Oct 23 02:07:57.078244 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:07:57.078244 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-43b6fb9a-e259-47d5-8f0d-e1dcf3eb32f0 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Returning 404 to user: Instance 52741202-4d26-4b1c-978a-90dc49f77b6f could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:07:57.078244 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-43b6fb9a-e259-47d5-8f0d-e1dcf3eb32f0 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] 10.222.0.42 "DELETE /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f" status: 404 len: 111 microversion: 2.1 time: 0.030984 Oct 23 02:07:57.078244 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3678/7260] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 02:07:57 2022] DELETE /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:07:57.083908 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-722746e7-c8c6-4de6-9226-b535a583ce71 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:07:57.084541 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-722746e7-c8c6-4de6-9226-b535a583ce71 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] [instance: 52741202-4d26-4b1c-978a-90dc49f77b6f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:07:57.090907 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-722746e7-c8c6-4de6-9226-b535a583ce71 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:57.091403 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-722746e7-c8c6-4de6-9226-b535a583ce71 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:57.091879 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-722746e7-c8c6-4de6-9226-b535a583ce71 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:57.092579 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-722746e7-c8c6-4de6-9226-b535a583ce71 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:07:57.093049 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-722746e7-c8c6-4de6-9226-b535a583ce71 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:07:57.093488 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-722746e7-c8c6-4de6-9226-b535a583ce71 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:07:57.107204 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-722746e7-c8c6-4de6-9226-b535a583ce71 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] HTTP exception thrown: Instance 52741202-4d26-4b1c-978a-90dc49f77b6f could not be found. Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-722746e7-c8c6-4de6-9226-b535a583ce71 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Request method failure captured: Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f HTTP/1.1 Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVKHGhHZ2W6vQWUaergnF_gEPc4URBQsr3lJP2bHC9s_ydvxkavhzcphulmy1CHVy2G1TaFYS4P_4OfSvsI1gi8CukTuWObb47HbyqmZi0nIjKobpfKGH9I4UJ0K2V0XP_jO4hQLNDPzfrHOrP1aw9JPIuA6CtRfHAI9phxJg6FjKp2A Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 7eb4fc36e36248ada12e6841dcda0b71 Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-DeleteServersTestJSON-72346252 Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7eb4fc36e36248ada12e6841dcda0b71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7eb4fc36e36248ada12e6841dcda0b71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7eb4fc36e36248ada12e6841dcda0b71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7eb4fc36e36248ada12e6841dcda0b71"}]}] Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-DeleteServersTestJSON-72346252 Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 7eb4fc36e36248ada12e6841dcda0b71 Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-DeleteServersTestJSON-72346252 Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-DeleteServersTestJSON-72346252-project Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 0b855154444b4859a13b3ca5f91298e7 Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-DeleteServersTestJSON-72346252-project Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 52741202-4d26-4b1c-978a-90dc49f77b6f could not be found. Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '52741202-4d26-4b1c-978a-90dc49f77b6f'} Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52741202-4d26-4b1c-978a-90dc49f77b6f could not be found. Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52741202-4d26-4b1c-978a-90dc49f77b6f could not be found. Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:07:57.108787 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:07:57.114040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:07:57.114040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:07:57.114040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:07:57.114040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:07:57.114040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:07:57.114040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52741202-4d26-4b1c-978a-90dc49f77b6f could not be found. Oct 23 02:07:57.114040 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:07:57.114040 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-722746e7-c8c6-4de6-9226-b535a583ce71 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] Returning 404 to user: Instance 52741202-4d26-4b1c-978a-90dc49f77b6f could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:07:57.114040 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-722746e7-c8c6-4de6-9226-b535a583ce71 tempest-DeleteServersTestJSON-72346252 tempest-DeleteServersTestJSON-72346252-project] 10.222.0.42 "GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f" status: 404 len: 111 microversion: 2.1 time: 0.030235 Oct 23 02:07:57.114040 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3583/7261] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:07:57 2022] GET /compute/v2.1/servers/52741202-4d26-4b1c-978a-90dc49f77b6f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:08:07.766057 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=19 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:08:07.766851 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=61 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:08:07.887113 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e84ef89f-d4df-4386-aec5-6fb7cd33b4eb tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-967392725", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "0b1aaaa7-6ba9-4816-a511-969b14816988"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:08:07.944816 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-e84ef89f-d4df-4386-aec5-6fb7cd33b4eb tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] validate_networks() for [('0b1aaaa7-6ba9-4816-a511-969b14816988', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 02:08:08.324410 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-e84ef89f-d4df-4386-aec5-6fb7cd33b4eb tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:08:08.324834 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-e84ef89f-d4df-4386-aec5-6fb7cd33b4eb tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:08:08.325336 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-e84ef89f-d4df-4386-aec5-6fb7cd33b4eb tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:08:08.325748 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-e84ef89f-d4df-4386-aec5-6fb7cd33b4eb tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:08:08.326215 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-e84ef89f-d4df-4386-aec5-6fb7cd33b4eb tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:08:08.335770 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e84ef89f-d4df-4386-aec5-6fb7cd33b4eb tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:08.336252 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e84ef89f-d4df-4386-aec5-6fb7cd33b4eb tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:08.336687 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e84ef89f-d4df-4386-aec5-6fb7cd33b4eb tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:08.337662 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e84ef89f-d4df-4386-aec5-6fb7cd33b4eb tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:08.338154 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e84ef89f-d4df-4386-aec5-6fb7cd33b4eb tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:08.338582 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e84ef89f-d4df-4386-aec5-6fb7cd33b4eb tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:08.355105 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-e84ef89f-d4df-4386-aec5-6fb7cd33b4eb tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Getting quotas for project a7e6cc6175414fbcb1c0323ef3299901. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:08:08.360313 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-e84ef89f-d4df-4386-aec5-6fb7cd33b4eb tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Getting quotas for user bae1f007536546b98ae09de345781a0a and project a7e6cc6175414fbcb1c0323ef3299901. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:08:08.372441 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e84ef89f-d4df-4386-aec5-6fb7cd33b4eb tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 02:08:08.374754 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e84ef89f-d4df-4386-aec5-6fb7cd33b4eb tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 02:08:08.493515 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e84ef89f-d4df-4386-aec5-6fb7cd33b4eb tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.733207 Oct 23 02:08:08.494204 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3679/7262] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 02:08:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 23 02:08:08.506317 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d0dddad0-3243-44b7-881e-d992fae3db27 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:08:08.507030 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d0dddad0-3243-44b7-881e-d992fae3db27 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:08:08.513028 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:08:08.513704 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:08:08.569186 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d0dddad0-3243-44b7-881e-d992fae3db27 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:08:08.577443 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d0dddad0-3243-44b7-881e-d992fae3db27 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1217 microversion: 2.1 time: 0.075358 Oct 23 02:08:08.578054 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3584/7263] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:08:08 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1217 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:08:09.603170 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5d120212-5f80-4731-8506-26b38043b395 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:08:09.603778 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5d120212-5f80-4731-8506-26b38043b395 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:08:09.660416 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5d120212-5f80-4731-8506-26b38043b395 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:08:09.668401 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5d120212-5f80-4731-8506-26b38043b395 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1217 microversion: 2.1 time: 0.070220 Oct 23 02:08:09.668997 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3680/7264] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:08:09 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1217 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:08:10.692669 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-dda7ebdf-5d63-4846-93e1-1294259883cd tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:08:10.694045 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-dda7ebdf-5d63-4846-93e1-1294259883cd tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:08:10.701572 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dda7ebdf-5d63-4846-93e1-1294259883cd tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:10.702096 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dda7ebdf-5d63-4846-93e1-1294259883cd tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:10.702548 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dda7ebdf-5d63-4846-93e1-1294259883cd tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:10.703257 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dda7ebdf-5d63-4846-93e1-1294259883cd tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:10.703721 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dda7ebdf-5d63-4846-93e1-1294259883cd tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:10.704214 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dda7ebdf-5d63-4846-93e1-1294259883cd tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:10.803783 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-dda7ebdf-5d63-4846-93e1-1294259883cd tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:08:10.811683 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-dda7ebdf-5d63-4846-93e1-1294259883cd tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1269 microversion: 2.1 time: 0.123634 Oct 23 02:08:10.812276 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3585/7265] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:08:10 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1269 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:08:11.835559 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2236f363-d163-4058-af3f-c29c696fda9d tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:08:11.836182 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2236f363-d163-4058-af3f-c29c696fda9d tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:08:11.845140 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2236f363-d163-4058-af3f-c29c696fda9d tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:11.845731 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2236f363-d163-4058-af3f-c29c696fda9d tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:11.846284 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2236f363-d163-4058-af3f-c29c696fda9d tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:11.846993 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2236f363-d163-4058-af3f-c29c696fda9d tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:11.847447 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2236f363-d163-4058-af3f-c29c696fda9d tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:11.847872 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2236f363-d163-4058-af3f-c29c696fda9d tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:11.986404 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2236f363-d163-4058-af3f-c29c696fda9d tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:08:11.994843 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2236f363-d163-4058-af3f-c29c696fda9d tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1317 microversion: 2.1 time: 0.163151 Oct 23 02:08:11.995434 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3681/7266] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:08:11 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:08:12.783122 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-1b254748-f8a9-4e51-93c6-dec94eee6467 req-488b275c-2ee3-4fba-874d-7065df670a52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0285026a-b7a9-45f2-a63b-5a25f044b278", "tag": "542fe86c-9b62-4329-b413-e38ab237a101"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:08:12.795112 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-1b254748-f8a9-4e51-93c6-dec94eee6467 req-488b275c-2ee3-4fba-874d-7065df670a52 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:12.796358 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-1b254748-f8a9-4e51-93c6-dec94eee6467 req-488b275c-2ee3-4fba-874d-7065df670a52 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:12.796358 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-1b254748-f8a9-4e51-93c6-dec94eee6467 req-488b275c-2ee3-4fba-874d-7065df670a52 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:12.807877 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-1b254748-f8a9-4e51-93c6-dec94eee6467 req-488b275c-2ee3-4fba-874d-7065df670a52 service nova] Creating event network-changed:542fe86c-9b62-4329-b413-e38ab237a101 for instance 0285026a-b7a9-45f2-a63b-5a25f044b278 on n-h1-master-1 Oct 23 02:08:12.813140 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-1b254748-f8a9-4e51-93c6-dec94eee6467 req-488b275c-2ee3-4fba-874d-7065df670a52 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033726 Oct 23 02:08:12.814522 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3586/7267] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:08:13.020570 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2a739f69-7e57-41fd-97a3-cd0c222d8170 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:08:13.021195 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2a739f69-7e57-41fd-97a3-cd0c222d8170 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:08:13.028412 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a739f69-7e57-41fd-97a3-cd0c222d8170 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:13.028903 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a739f69-7e57-41fd-97a3-cd0c222d8170 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:13.029340 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a739f69-7e57-41fd-97a3-cd0c222d8170 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:13.030093 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a739f69-7e57-41fd-97a3-cd0c222d8170 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:13.030553 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a739f69-7e57-41fd-97a3-cd0c222d8170 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:13.030983 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a739f69-7e57-41fd-97a3-cd0c222d8170 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:13.170791 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2a739f69-7e57-41fd-97a3-cd0c222d8170 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:08:13.179727 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2a739f69-7e57-41fd-97a3-cd0c222d8170 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1317 microversion: 2.1 time: 0.163684 Oct 23 02:08:13.180324 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3682/7268] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:08:13 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:08:14.204903 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b1d7baed-0b68-495a-af5d-78123a089669 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:08:14.205614 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b1d7baed-0b68-495a-af5d-78123a089669 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:08:14.212845 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1d7baed-0b68-495a-af5d-78123a089669 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:14.213335 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1d7baed-0b68-495a-af5d-78123a089669 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:14.213780 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1d7baed-0b68-495a-af5d-78123a089669 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:14.214498 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1d7baed-0b68-495a-af5d-78123a089669 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:14.214960 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1d7baed-0b68-495a-af5d-78123a089669 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:14.215393 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1d7baed-0b68-495a-af5d-78123a089669 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:14.343794 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b1d7baed-0b68-495a-af5d-78123a089669 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:08:14.351426 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b1d7baed-0b68-495a-af5d-78123a089669 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1317 microversion: 2.1 time: 0.151312 Oct 23 02:08:14.352006 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3587/7269] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:08:14 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:08:15.374401 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e3a7e931-db78-4285-b0db-dbc542a380b1 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:08:15.375028 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e3a7e931-db78-4285-b0db-dbc542a380b1 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:08:15.381963 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e3a7e931-db78-4285-b0db-dbc542a380b1 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:15.382487 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e3a7e931-db78-4285-b0db-dbc542a380b1 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:15.382934 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e3a7e931-db78-4285-b0db-dbc542a380b1 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:15.383634 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e3a7e931-db78-4285-b0db-dbc542a380b1 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:15.384100 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e3a7e931-db78-4285-b0db-dbc542a380b1 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:15.384538 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e3a7e931-db78-4285-b0db-dbc542a380b1 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:15.512531 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e3a7e931-db78-4285-b0db-dbc542a380b1 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:08:15.520687 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e3a7e931-db78-4285-b0db-dbc542a380b1 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1317 microversion: 2.1 time: 0.150272 Oct 23 02:08:15.521254 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3683/7270] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:08:15 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:08:16.543614 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6b00b7b3-e161-42f2-b7e1-4112da189492 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:08:16.544234 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6b00b7b3-e161-42f2-b7e1-4112da189492 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:08:16.552047 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6b00b7b3-e161-42f2-b7e1-4112da189492 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:16.552550 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6b00b7b3-e161-42f2-b7e1-4112da189492 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:16.552998 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6b00b7b3-e161-42f2-b7e1-4112da189492 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:16.553705 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6b00b7b3-e161-42f2-b7e1-4112da189492 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:16.554222 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6b00b7b3-e161-42f2-b7e1-4112da189492 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:16.554664 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6b00b7b3-e161-42f2-b7e1-4112da189492 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:16.686515 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6b00b7b3-e161-42f2-b7e1-4112da189492 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:08:16.694455 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6b00b7b3-e161-42f2-b7e1-4112da189492 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1317 microversion: 2.1 time: 0.154699 Oct 23 02:08:16.695074 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3588/7271] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:08:16 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:08:17.717285 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9fef9416-b1f7-44f1-9d99-e73bbc90dd4c tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:08:17.717941 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9fef9416-b1f7-44f1-9d99-e73bbc90dd4c tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:08:17.724862 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9fef9416-b1f7-44f1-9d99-e73bbc90dd4c tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:17.725337 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9fef9416-b1f7-44f1-9d99-e73bbc90dd4c tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:17.725785 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9fef9416-b1f7-44f1-9d99-e73bbc90dd4c tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:17.726520 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9fef9416-b1f7-44f1-9d99-e73bbc90dd4c tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:17.726978 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9fef9416-b1f7-44f1-9d99-e73bbc90dd4c tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:17.727413 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9fef9416-b1f7-44f1-9d99-e73bbc90dd4c tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:17.919288 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9fef9416-b1f7-44f1-9d99-e73bbc90dd4c tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:08:17.927931 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9fef9416-b1f7-44f1-9d99-e73bbc90dd4c tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1317 microversion: 2.1 time: 0.214629 Oct 23 02:08:17.928528 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3684/7272] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:08:17 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1317 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:08:18.952806 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0dc7f24f-0047-4dec-9cba-467b922b3688 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:08:18.953369 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0dc7f24f-0047-4dec-9cba-467b922b3688 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:08:18.956858 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:08:18.961673 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0dc7f24f-0047-4dec-9cba-467b922b3688 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:18.962205 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0dc7f24f-0047-4dec-9cba-467b922b3688 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:18.962919 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0dc7f24f-0047-4dec-9cba-467b922b3688 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:18.963623 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0dc7f24f-0047-4dec-9cba-467b922b3688 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:18.964093 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0dc7f24f-0047-4dec-9cba-467b922b3688 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:18.964534 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0dc7f24f-0047-4dec-9cba-467b922b3688 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:19.134530 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0dc7f24f-0047-4dec-9cba-467b922b3688 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:08:19.142361 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0dc7f24f-0047-4dec-9cba-467b922b3688 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1317 microversion: 2.1 time: 0.193523 Oct 23 02:08:19.142937 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3589/7273] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:08:18 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1317 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:08:19.337856 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-a7ae42db-c32b-496b-b246-f721f5ce3a2f req-a6098ac3-aebc-4010-922b-43b9172da27c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0285026a-b7a9-45f2-a63b-5a25f044b278", "name": "network-vif-plugged", "status": "completed", "tag": "542fe86c-9b62-4329-b413-e38ab237a101"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:08:19.347236 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:08:19.349033 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-a7ae42db-c32b-496b-b246-f721f5ce3a2f req-a6098ac3-aebc-4010-922b-43b9172da27c service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:19.349532 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-a7ae42db-c32b-496b-b246-f721f5ce3a2f req-a6098ac3-aebc-4010-922b-43b9172da27c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:19.349959 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-a7ae42db-c32b-496b-b246-f721f5ce3a2f req-a6098ac3-aebc-4010-922b-43b9172da27c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:19.361052 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-a7ae42db-c32b-496b-b246-f721f5ce3a2f req-a6098ac3-aebc-4010-922b-43b9172da27c service nova] Creating event network-vif-plugged:542fe86c-9b62-4329-b413-e38ab237a101 for instance 0285026a-b7a9-45f2-a63b-5a25f044b278 on n-h1-master-1 Oct 23 02:08:19.366637 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-a7ae42db-c32b-496b-b246-f721f5ce3a2f req-a6098ac3-aebc-4010-922b-43b9172da27c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032747 Oct 23 02:08:19.367242 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3685/7274] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:08:20.165278 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-dfedcec3-b690-4f71-8b82-3bab9168bcd2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:08:20.166922 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-dfedcec3-b690-4f71-8b82-3bab9168bcd2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:08:20.173756 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dfedcec3-b690-4f71-8b82-3bab9168bcd2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:20.174292 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dfedcec3-b690-4f71-8b82-3bab9168bcd2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:20.174731 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dfedcec3-b690-4f71-8b82-3bab9168bcd2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:20.175433 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dfedcec3-b690-4f71-8b82-3bab9168bcd2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:20.175926 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dfedcec3-b690-4f71-8b82-3bab9168bcd2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:20.176362 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dfedcec3-b690-4f71-8b82-3bab9168bcd2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:20.303804 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-dfedcec3-b690-4f71-8b82-3bab9168bcd2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:08:20.311859 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-dfedcec3-b690-4f71-8b82-3bab9168bcd2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1317 microversion: 2.1 time: 0.150536 Oct 23 02:08:20.312438 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3590/7275] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:08:20 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:08:21.332270 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=8 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:08:21.337886 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6b9f434d-3980-445d-b5a7-e870eb4f2e46 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:08:21.338649 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6b9f434d-3980-445d-b5a7-e870eb4f2e46 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:08:21.344835 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b9f434d-3980-445d-b5a7-e870eb4f2e46 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:21.345319 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b9f434d-3980-445d-b5a7-e870eb4f2e46 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:21.346289 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b9f434d-3980-445d-b5a7-e870eb4f2e46 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:21.346975 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b9f434d-3980-445d-b5a7-e870eb4f2e46 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:21.347427 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b9f434d-3980-445d-b5a7-e870eb4f2e46 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:21.347851 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b9f434d-3980-445d-b5a7-e870eb4f2e46 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:21.478223 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6b9f434d-3980-445d-b5a7-e870eb4f2e46 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:08:21.486346 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6b9f434d-3980-445d-b5a7-e870eb4f2e46 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1508 microversion: 2.1 time: 0.154989 Oct 23 02:08:21.487299 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3686/7276] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:08:21 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:08:21.509669 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-38c4c89a-d83b-42e2-a111-d7f2a9ded20d tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:08:21.510323 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-38c4c89a-d83b-42e2-a111-d7f2a9ded20d tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:08:21.517171 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-38c4c89a-d83b-42e2-a111-d7f2a9ded20d tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:21.518190 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-38c4c89a-d83b-42e2-a111-d7f2a9ded20d tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:21.518636 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-38c4c89a-d83b-42e2-a111-d7f2a9ded20d tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:21.519329 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-38c4c89a-d83b-42e2-a111-d7f2a9ded20d tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:21.519796 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-38c4c89a-d83b-42e2-a111-d7f2a9ded20d tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:21.520228 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-38c4c89a-d83b-42e2-a111-d7f2a9ded20d tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:21.650553 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-38c4c89a-d83b-42e2-a111-d7f2a9ded20d tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:08:21.658998 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-38c4c89a-d83b-42e2-a111-d7f2a9ded20d tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1508 microversion: 2.1 time: 0.152570 Oct 23 02:08:21.659563 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3591/7277] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:08:21 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:08:21.681144 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7f4e4aef-ea5d-4f3c-b88a-3cdf65c987ac tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:08:21.683672 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7f4e4aef-ea5d-4f3c-b88a-3cdf65c987ac tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:08:21.689802 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f4e4aef-ea5d-4f3c-b88a-3cdf65c987ac tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:21.690350 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f4e4aef-ea5d-4f3c-b88a-3cdf65c987ac tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:21.690834 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f4e4aef-ea5d-4f3c-b88a-3cdf65c987ac tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:21.691537 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f4e4aef-ea5d-4f3c-b88a-3cdf65c987ac tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:21.692023 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f4e4aef-ea5d-4f3c-b88a-3cdf65c987ac tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:21.692457 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7f4e4aef-ea5d-4f3c-b88a-3cdf65c987ac tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:21.817875 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7f4e4aef-ea5d-4f3c-b88a-3cdf65c987ac tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "PUT /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1080 microversion: 2.1 time: 0.140592 Oct 23 02:08:21.821167 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3687/7278] 10.222.0.42 () {60 vars in 1256 bytes} [Sun Oct 23 02:08:21 2022] PUT /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1080 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:08:21.838427 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3bec2ca3-f1bc-4902-ab63-6fdeef066409 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:08:21.839104 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3bec2ca3-f1bc-4902-ab63-6fdeef066409 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:08:21.845218 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3bec2ca3-f1bc-4902-ab63-6fdeef066409 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:21.845718 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3bec2ca3-f1bc-4902-ab63-6fdeef066409 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:21.846207 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3bec2ca3-f1bc-4902-ab63-6fdeef066409 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:21.846925 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3bec2ca3-f1bc-4902-ab63-6fdeef066409 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:21.847388 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3bec2ca3-f1bc-4902-ab63-6fdeef066409 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:21.847823 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3bec2ca3-f1bc-4902-ab63-6fdeef066409 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:21.980820 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3bec2ca3-f1bc-4902-ab63-6fdeef066409 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:08:21.988646 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3bec2ca3-f1bc-4902-ab63-6fdeef066409 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1506 microversion: 2.1 time: 0.154973 Oct 23 02:08:21.989231 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3592/7279] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:08:21 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:08:22.011011 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7ea3c492-043e-4497-a9a0-941560661a1c tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:08:22.011642 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7ea3c492-043e-4497-a9a0-941560661a1c tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:08:22.018484 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ea3c492-043e-4497-a9a0-941560661a1c tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:22.018980 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ea3c492-043e-4497-a9a0-941560661a1c tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:22.019423 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ea3c492-043e-4497-a9a0-941560661a1c tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:22.020121 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ea3c492-043e-4497-a9a0-941560661a1c tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:22.020583 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ea3c492-043e-4497-a9a0-941560661a1c tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:22.021018 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7ea3c492-043e-4497-a9a0-941560661a1c tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:22.152272 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7ea3c492-043e-4497-a9a0-941560661a1c tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:08:22.160087 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7ea3c492-043e-4497-a9a0-941560661a1c tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1506 microversion: 2.1 time: 0.152940 Oct 23 02:08:22.160664 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3688/7280] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:08:22 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:08:22.182530 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-eb848076-829a-4cff-9095-be9f0674cb59 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:08:22.184805 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-eb848076-829a-4cff-9095-be9f0674cb59 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:08:22.191221 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eb848076-829a-4cff-9095-be9f0674cb59 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:22.191716 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eb848076-829a-4cff-9095-be9f0674cb59 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:22.192169 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eb848076-829a-4cff-9095-be9f0674cb59 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:22.192861 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eb848076-829a-4cff-9095-be9f0674cb59 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:22.193329 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eb848076-829a-4cff-9095-be9f0674cb59 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:22.193764 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eb848076-829a-4cff-9095-be9f0674cb59 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:22.221437 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-eb848076-829a-4cff-9095-be9f0674cb59 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:08:22.226849 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-eb848076-829a-4cff-9095-be9f0674cb59 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Old instance type m1.heat2, new instance type m1.heat {{(pid=120945) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 23 02:08:22.233487 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-eb848076-829a-4cff-9095-be9f0674cb59 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:08:22.233922 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-eb848076-829a-4cff-9095-be9f0674cb59 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:08:22.234436 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-eb848076-829a-4cff-9095-be9f0674cb59 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:08:22.234881 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-eb848076-829a-4cff-9095-be9f0674cb59 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:08:22.235303 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-eb848076-829a-4cff-9095-be9f0674cb59 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:08:22.388396 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-eb848076-829a-4cff-9095-be9f0674cb59 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "POST /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278/action" status: 202 len: 0 microversion: 2.1 time: 0.209709 Oct 23 02:08:22.388980 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3593/7281] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:08:22 2022] POST /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:08:22.397017 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fe55611b-c467-4f7b-9650-56c385d3f0d4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:08:22.397645 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fe55611b-c467-4f7b-9650-56c385d3f0d4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:08:22.404590 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe55611b-c467-4f7b-9650-56c385d3f0d4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:22.405065 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe55611b-c467-4f7b-9650-56c385d3f0d4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:22.405506 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe55611b-c467-4f7b-9650-56c385d3f0d4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:22.406244 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe55611b-c467-4f7b-9650-56c385d3f0d4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:22.406694 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe55611b-c467-4f7b-9650-56c385d3f0d4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:22.407127 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe55611b-c467-4f7b-9650-56c385d3f0d4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:22.537991 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fe55611b-c467-4f7b-9650-56c385d3f0d4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:08:22.546117 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fe55611b-c467-4f7b-9650-56c385d3f0d4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1517 microversion: 2.1 time: 0.152921 Oct 23 02:08:22.546889 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3689/7282] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:08:22 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1517 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:08:23.571474 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3d0edf9c-13cd-4a62-a653-134b8c24d032 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:08:23.572029 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3d0edf9c-13cd-4a62-a653-134b8c24d032 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:08:23.579645 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3d0edf9c-13cd-4a62-a653-134b8c24d032 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:23.580719 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3d0edf9c-13cd-4a62-a653-134b8c24d032 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:23.581188 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3d0edf9c-13cd-4a62-a653-134b8c24d032 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:23.581917 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3d0edf9c-13cd-4a62-a653-134b8c24d032 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:23.582560 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3d0edf9c-13cd-4a62-a653-134b8c24d032 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:23.583023 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3d0edf9c-13cd-4a62-a653-134b8c24d032 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:23.717317 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3d0edf9c-13cd-4a62-a653-134b8c24d032 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:08:23.725110 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3d0edf9c-13cd-4a62-a653-134b8c24d032 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1517 microversion: 2.1 time: 0.158509 Oct 23 02:08:23.725678 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3594/7283] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:08:23 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:08:24.749319 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-029dc7c6-3ad6-4d79-b5b8-68a5067a5e50 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:08:24.749956 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-029dc7c6-3ad6-4d79-b5b8-68a5067a5e50 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:08:24.757314 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-029dc7c6-3ad6-4d79-b5b8-68a5067a5e50 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:24.757801 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-029dc7c6-3ad6-4d79-b5b8-68a5067a5e50 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:24.758282 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-029dc7c6-3ad6-4d79-b5b8-68a5067a5e50 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:24.758974 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-029dc7c6-3ad6-4d79-b5b8-68a5067a5e50 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:24.759433 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-029dc7c6-3ad6-4d79-b5b8-68a5067a5e50 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:24.759862 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-029dc7c6-3ad6-4d79-b5b8-68a5067a5e50 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:24.890320 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-029dc7c6-3ad6-4d79-b5b8-68a5067a5e50 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:08:24.899258 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-029dc7c6-3ad6-4d79-b5b8-68a5067a5e50 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1517 microversion: 2.1 time: 0.153816 Oct 23 02:08:24.899836 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3690/7284] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:08:24 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:08:25.923224 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2e3ebc66-7979-4af9-a45f-22e212376f2a tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:08:25.924186 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2e3ebc66-7979-4af9-a45f-22e212376f2a tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:08:25.931014 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2e3ebc66-7979-4af9-a45f-22e212376f2a tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:25.931506 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2e3ebc66-7979-4af9-a45f-22e212376f2a tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:25.931950 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2e3ebc66-7979-4af9-a45f-22e212376f2a tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:25.932645 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2e3ebc66-7979-4af9-a45f-22e212376f2a tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:25.933108 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2e3ebc66-7979-4af9-a45f-22e212376f2a tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:25.933540 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2e3ebc66-7979-4af9-a45f-22e212376f2a tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:26.060142 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2e3ebc66-7979-4af9-a45f-22e212376f2a tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:08:26.067742 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2e3ebc66-7979-4af9-a45f-22e212376f2a tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1522 microversion: 2.1 time: 0.148431 Oct 23 02:08:26.068540 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3595/7285] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:08:25 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:08:27.091810 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-288a9646-3a56-44aa-83e2-a46208596f65 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:08:27.092458 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-288a9646-3a56-44aa-83e2-a46208596f65 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:08:27.099816 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-288a9646-3a56-44aa-83e2-a46208596f65 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:27.100296 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-288a9646-3a56-44aa-83e2-a46208596f65 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:27.100728 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-288a9646-3a56-44aa-83e2-a46208596f65 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:27.101415 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-288a9646-3a56-44aa-83e2-a46208596f65 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:27.101866 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-288a9646-3a56-44aa-83e2-a46208596f65 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:27.102314 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-288a9646-3a56-44aa-83e2-a46208596f65 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:27.317813 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-288a9646-3a56-44aa-83e2-a46208596f65 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:08:27.325458 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-288a9646-3a56-44aa-83e2-a46208596f65 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1522 microversion: 2.1 time: 0.237815 Oct 23 02:08:27.326118 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3691/7286] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:08:27 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:08:28.349338 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9fe15d0a-f45b-4d27-bd7b-09de208a3bd5 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:08:28.349986 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9fe15d0a-f45b-4d27-bd7b-09de208a3bd5 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:08:28.356794 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9fe15d0a-f45b-4d27-bd7b-09de208a3bd5 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:28.357287 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9fe15d0a-f45b-4d27-bd7b-09de208a3bd5 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:28.357734 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9fe15d0a-f45b-4d27-bd7b-09de208a3bd5 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:28.358459 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9fe15d0a-f45b-4d27-bd7b-09de208a3bd5 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:28.358932 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9fe15d0a-f45b-4d27-bd7b-09de208a3bd5 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:28.359363 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9fe15d0a-f45b-4d27-bd7b-09de208a3bd5 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:28.565746 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9fe15d0a-f45b-4d27-bd7b-09de208a3bd5 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:08:28.573461 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9fe15d0a-f45b-4d27-bd7b-09de208a3bd5 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1522 microversion: 2.1 time: 0.228608 Oct 23 02:08:28.574060 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3596/7287] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:08:28 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:08:29.597139 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4c0aeec7-a7f7-436d-834a-6c869ab013d6 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:08:29.597770 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4c0aeec7-a7f7-436d-834a-6c869ab013d6 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:08:29.604803 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4c0aeec7-a7f7-436d-834a-6c869ab013d6 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:29.605293 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4c0aeec7-a7f7-436d-834a-6c869ab013d6 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:29.605736 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4c0aeec7-a7f7-436d-834a-6c869ab013d6 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:29.606463 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4c0aeec7-a7f7-436d-834a-6c869ab013d6 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:29.606926 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4c0aeec7-a7f7-436d-834a-6c869ab013d6 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:29.607353 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4c0aeec7-a7f7-436d-834a-6c869ab013d6 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:29.739667 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4c0aeec7-a7f7-436d-834a-6c869ab013d6 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:08:29.747501 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4c0aeec7-a7f7-436d-834a-6c869ab013d6 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1522 microversion: 2.1 time: 0.154724 Oct 23 02:08:29.748095 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3692/7288] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:08:29 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:08:30.770935 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e648e8c8-3edb-4771-a4f3-f08637be968f tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:08:30.771518 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e648e8c8-3edb-4771-a4f3-f08637be968f tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:08:30.778437 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e648e8c8-3edb-4771-a4f3-f08637be968f tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:30.778931 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e648e8c8-3edb-4771-a4f3-f08637be968f tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:30.779377 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e648e8c8-3edb-4771-a4f3-f08637be968f tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:30.780071 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e648e8c8-3edb-4771-a4f3-f08637be968f tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:30.780533 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e648e8c8-3edb-4771-a4f3-f08637be968f tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:30.780969 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e648e8c8-3edb-4771-a4f3-f08637be968f tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:30.907153 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e648e8c8-3edb-4771-a4f3-f08637be968f tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:08:30.915333 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e648e8c8-3edb-4771-a4f3-f08637be968f tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1522 microversion: 2.1 time: 0.148349 Oct 23 02:08:30.915908 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3597/7289] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:08:30 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:08:31.939749 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c38976bf-3761-469d-b437-03c2e816f8ad tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:08:31.940327 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c38976bf-3761-469d-b437-03c2e816f8ad tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:08:31.947303 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c38976bf-3761-469d-b437-03c2e816f8ad tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:31.947783 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c38976bf-3761-469d-b437-03c2e816f8ad tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:31.948216 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c38976bf-3761-469d-b437-03c2e816f8ad tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:31.948900 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c38976bf-3761-469d-b437-03c2e816f8ad tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:31.949396 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c38976bf-3761-469d-b437-03c2e816f8ad tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:31.949818 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c38976bf-3761-469d-b437-03c2e816f8ad tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:32.077472 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c38976bf-3761-469d-b437-03c2e816f8ad tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:08:32.085367 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c38976bf-3761-469d-b437-03c2e816f8ad tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1522 microversion: 2.1 time: 0.150287 Oct 23 02:08:32.085939 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3693/7290] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:08:31 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:08:33.109117 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1151ecd0-fb68-49c3-bf61-267fe4904142 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:08:33.109750 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1151ecd0-fb68-49c3-bf61-267fe4904142 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:08:33.116749 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1151ecd0-fb68-49c3-bf61-267fe4904142 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:33.117246 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1151ecd0-fb68-49c3-bf61-267fe4904142 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:33.117697 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1151ecd0-fb68-49c3-bf61-267fe4904142 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:33.118430 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1151ecd0-fb68-49c3-bf61-267fe4904142 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:33.118905 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1151ecd0-fb68-49c3-bf61-267fe4904142 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:33.119346 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1151ecd0-fb68-49c3-bf61-267fe4904142 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:33.252547 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1151ecd0-fb68-49c3-bf61-267fe4904142 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:08:33.260270 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1151ecd0-fb68-49c3-bf61-267fe4904142 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1522 microversion: 2.1 time: 0.155080 Oct 23 02:08:33.260857 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3598/7291] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:08:33 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:08:34.283655 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8885c416-f731-4e23-b7de-f4023c29ea5a tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:08:34.294684 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8885c416-f731-4e23-b7de-f4023c29ea5a tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:08:34.294684 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8885c416-f731-4e23-b7de-f4023c29ea5a tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:34.294684 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8885c416-f731-4e23-b7de-f4023c29ea5a tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:34.294684 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8885c416-f731-4e23-b7de-f4023c29ea5a tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:34.294684 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8885c416-f731-4e23-b7de-f4023c29ea5a tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:34.294684 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8885c416-f731-4e23-b7de-f4023c29ea5a tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:34.294684 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8885c416-f731-4e23-b7de-f4023c29ea5a tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:34.422652 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8885c416-f731-4e23-b7de-f4023c29ea5a tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:08:34.430897 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8885c416-f731-4e23-b7de-f4023c29ea5a tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1522 microversion: 2.1 time: 0.151217 Oct 23 02:08:34.431647 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3694/7292] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:08:34 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:08:35.455532 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6d08afda-0f3f-44c3-abe7-7f100e47f356 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:08:35.456162 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6d08afda-0f3f-44c3-abe7-7f100e47f356 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:08:35.463224 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6d08afda-0f3f-44c3-abe7-7f100e47f356 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:35.463717 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6d08afda-0f3f-44c3-abe7-7f100e47f356 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:35.464160 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6d08afda-0f3f-44c3-abe7-7f100e47f356 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:35.464853 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6d08afda-0f3f-44c3-abe7-7f100e47f356 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:35.465316 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6d08afda-0f3f-44c3-abe7-7f100e47f356 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:35.465749 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6d08afda-0f3f-44c3-abe7-7f100e47f356 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:35.596828 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6d08afda-0f3f-44c3-abe7-7f100e47f356 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:08:35.604568 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6d08afda-0f3f-44c3-abe7-7f100e47f356 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1522 microversion: 2.1 time: 0.153545 Oct 23 02:08:35.605139 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3599/7293] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:08:35 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:08:36.628221 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-512499d5-49c6-4719-b3a5-49f76cc4d122 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:08:36.628837 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-512499d5-49c6-4719-b3a5-49f76cc4d122 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:08:36.635789 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-512499d5-49c6-4719-b3a5-49f76cc4d122 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:36.636271 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-512499d5-49c6-4719-b3a5-49f76cc4d122 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:36.636731 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-512499d5-49c6-4719-b3a5-49f76cc4d122 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:36.637412 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-512499d5-49c6-4719-b3a5-49f76cc4d122 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:36.637865 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-512499d5-49c6-4719-b3a5-49f76cc4d122 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:36.638381 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-512499d5-49c6-4719-b3a5-49f76cc4d122 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:36.767646 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-512499d5-49c6-4719-b3a5-49f76cc4d122 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:08:36.775351 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-512499d5-49c6-4719-b3a5-49f76cc4d122 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1522 microversion: 2.1 time: 0.151067 Oct 23 02:08:36.775923 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3695/7294] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:08:36 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:08:37.799382 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ec657933-b119-496e-b0c9-12d18805d4d2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:08:37.799972 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ec657933-b119-496e-b0c9-12d18805d4d2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:08:37.806826 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec657933-b119-496e-b0c9-12d18805d4d2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:37.807326 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec657933-b119-496e-b0c9-12d18805d4d2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:37.807778 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec657933-b119-496e-b0c9-12d18805d4d2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:37.808484 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec657933-b119-496e-b0c9-12d18805d4d2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:37.808961 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec657933-b119-496e-b0c9-12d18805d4d2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:37.809405 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec657933-b119-496e-b0c9-12d18805d4d2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:37.940172 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ec657933-b119-496e-b0c9-12d18805d4d2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:08:37.943627 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:08:37.948159 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ec657933-b119-496e-b0c9-12d18805d4d2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1522 microversion: 2.1 time: 0.152897 Oct 23 02:08:37.948733 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3600/7295] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:08:37 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:08:38.972398 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d46b63f3-6317-4062-a35b-5b2e8abbb1e3 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:08:38.973055 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d46b63f3-6317-4062-a35b-5b2e8abbb1e3 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:08:38.975793 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:08:38.980653 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d46b63f3-6317-4062-a35b-5b2e8abbb1e3 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:38.989827 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d46b63f3-6317-4062-a35b-5b2e8abbb1e3 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:38.989827 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d46b63f3-6317-4062-a35b-5b2e8abbb1e3 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:38.989827 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d46b63f3-6317-4062-a35b-5b2e8abbb1e3 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:38.989827 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d46b63f3-6317-4062-a35b-5b2e8abbb1e3 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:38.989827 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d46b63f3-6317-4062-a35b-5b2e8abbb1e3 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:38.989827 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:08:39.112255 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d46b63f3-6317-4062-a35b-5b2e8abbb1e3 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:08:39.120074 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d46b63f3-6317-4062-a35b-5b2e8abbb1e3 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1522 microversion: 2.1 time: 0.152254 Oct 23 02:08:39.120657 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3696/7296] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:08:38 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:08:40.144712 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-aaae4761-e4ee-4f68-9a46-737ab46eec32 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:08:40.145349 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-aaae4761-e4ee-4f68-9a46-737ab46eec32 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:08:40.153229 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aaae4761-e4ee-4f68-9a46-737ab46eec32 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:40.153739 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aaae4761-e4ee-4f68-9a46-737ab46eec32 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:40.154227 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aaae4761-e4ee-4f68-9a46-737ab46eec32 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:40.154945 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aaae4761-e4ee-4f68-9a46-737ab46eec32 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:40.155420 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aaae4761-e4ee-4f68-9a46-737ab46eec32 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:40.155865 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-aaae4761-e4ee-4f68-9a46-737ab46eec32 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:40.286638 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-aaae4761-e4ee-4f68-9a46-737ab46eec32 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:08:40.294476 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-aaae4761-e4ee-4f68-9a46-737ab46eec32 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1522 microversion: 2.1 time: 0.154497 Oct 23 02:08:40.295087 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3601/7297] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:08:40 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:08:41.317585 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-34127c23-f08d-4de6-9c3e-e24ba3fd0715 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:08:41.318295 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-34127c23-f08d-4de6-9c3e-e24ba3fd0715 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:08:41.325080 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-34127c23-f08d-4de6-9c3e-e24ba3fd0715 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:41.325563 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-34127c23-f08d-4de6-9c3e-e24ba3fd0715 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:41.326027 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-34127c23-f08d-4de6-9c3e-e24ba3fd0715 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:41.326714 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-34127c23-f08d-4de6-9c3e-e24ba3fd0715 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:41.327215 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-34127c23-f08d-4de6-9c3e-e24ba3fd0715 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:41.327641 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-34127c23-f08d-4de6-9c3e-e24ba3fd0715 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:41.725079 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-34127c23-f08d-4de6-9c3e-e24ba3fd0715 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:08:41.733045 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-34127c23-f08d-4de6-9c3e-e24ba3fd0715 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1522 microversion: 2.1 time: 0.419391 Oct 23 02:08:41.733625 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3697/7298] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:08:41 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1522 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:08:42.756471 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-33207264-6688-455f-8d13-b85f99355d93 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:08:42.757105 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-33207264-6688-455f-8d13-b85f99355d93 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:08:42.759961 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=43 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:08:42.764764 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-33207264-6688-455f-8d13-b85f99355d93 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:42.765264 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-33207264-6688-455f-8d13-b85f99355d93 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:42.765739 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-33207264-6688-455f-8d13-b85f99355d93 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:42.766482 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-33207264-6688-455f-8d13-b85f99355d93 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:42.766958 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-33207264-6688-455f-8d13-b85f99355d93 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:42.767387 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-33207264-6688-455f-8d13-b85f99355d93 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:42.896511 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-33207264-6688-455f-8d13-b85f99355d93 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:08:42.904327 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-33207264-6688-455f-8d13-b85f99355d93 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1522 microversion: 2.1 time: 0.151877 Oct 23 02:08:42.904905 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3602/7299] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:08:42 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:08:43.927914 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-148b6d05-14f8-4bba-88ce-637d69f964f7 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:08:43.928453 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-148b6d05-14f8-4bba-88ce-637d69f964f7 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:08:43.935393 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-148b6d05-14f8-4bba-88ce-637d69f964f7 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:43.935888 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-148b6d05-14f8-4bba-88ce-637d69f964f7 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:43.936320 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-148b6d05-14f8-4bba-88ce-637d69f964f7 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:43.937003 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-148b6d05-14f8-4bba-88ce-637d69f964f7 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:43.937455 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-148b6d05-14f8-4bba-88ce-637d69f964f7 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:43.937877 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-148b6d05-14f8-4bba-88ce-637d69f964f7 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:44.067991 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-148b6d05-14f8-4bba-88ce-637d69f964f7 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:08:44.075683 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-148b6d05-14f8-4bba-88ce-637d69f964f7 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1522 microversion: 2.1 time: 0.151802 Oct 23 02:08:44.076296 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3698/7300] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:08:43 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:08:45.098438 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ec9d08c4-31f8-4ceb-8fd2-9c44fe2d597f tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:08:45.099081 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ec9d08c4-31f8-4ceb-8fd2-9c44fe2d597f tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:08:45.106077 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec9d08c4-31f8-4ceb-8fd2-9c44fe2d597f tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:45.106586 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec9d08c4-31f8-4ceb-8fd2-9c44fe2d597f tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:45.107048 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec9d08c4-31f8-4ceb-8fd2-9c44fe2d597f tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:45.107765 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec9d08c4-31f8-4ceb-8fd2-9c44fe2d597f tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:45.108241 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec9d08c4-31f8-4ceb-8fd2-9c44fe2d597f tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:45.108687 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ec9d08c4-31f8-4ceb-8fd2-9c44fe2d597f tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:45.235690 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ec9d08c4-31f8-4ceb-8fd2-9c44fe2d597f tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:08:45.243980 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ec9d08c4-31f8-4ceb-8fd2-9c44fe2d597f tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1522 microversion: 2.1 time: 0.149078 Oct 23 02:08:45.244562 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3603/7301] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:08:45 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:08:46.268281 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0bddaac9-7b01-4641-98e1-d3c444f63531 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:08:46.268897 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0bddaac9-7b01-4641-98e1-d3c444f63531 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:08:46.275769 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0bddaac9-7b01-4641-98e1-d3c444f63531 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:46.276284 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0bddaac9-7b01-4641-98e1-d3c444f63531 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:46.276723 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0bddaac9-7b01-4641-98e1-d3c444f63531 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:46.277412 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0bddaac9-7b01-4641-98e1-d3c444f63531 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:46.277891 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0bddaac9-7b01-4641-98e1-d3c444f63531 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:46.282127 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0bddaac9-7b01-4641-98e1-d3c444f63531 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:46.410898 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0bddaac9-7b01-4641-98e1-d3c444f63531 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:08:46.418544 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0bddaac9-7b01-4641-98e1-d3c444f63531 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1522 microversion: 2.1 time: 0.154697 Oct 23 02:08:46.419117 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3699/7302] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:08:46 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:08:47.442156 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f62d8195-37e1-4720-818d-7a4d92c282bb tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:08:47.442784 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f62d8195-37e1-4720-818d-7a4d92c282bb tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:08:47.449587 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f62d8195-37e1-4720-818d-7a4d92c282bb tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:47.450093 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f62d8195-37e1-4720-818d-7a4d92c282bb tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:47.450538 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f62d8195-37e1-4720-818d-7a4d92c282bb tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:47.451241 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f62d8195-37e1-4720-818d-7a4d92c282bb tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:47.451708 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f62d8195-37e1-4720-818d-7a4d92c282bb tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:47.452144 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f62d8195-37e1-4720-818d-7a4d92c282bb tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:47.582902 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f62d8195-37e1-4720-818d-7a4d92c282bb tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:08:47.590984 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f62d8195-37e1-4720-818d-7a4d92c282bb tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1522 microversion: 2.1 time: 0.153279 Oct 23 02:08:47.591584 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3604/7303] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:08:47 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:08:48.614390 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-13f23f15-8539-4b0d-90af-458de739759f tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:08:48.615010 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-13f23f15-8539-4b0d-90af-458de739759f tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:08:48.621816 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13f23f15-8539-4b0d-90af-458de739759f tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:48.622329 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13f23f15-8539-4b0d-90af-458de739759f tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:48.622768 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13f23f15-8539-4b0d-90af-458de739759f tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:48.623451 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13f23f15-8539-4b0d-90af-458de739759f tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:48.623901 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13f23f15-8539-4b0d-90af-458de739759f tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:48.624356 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13f23f15-8539-4b0d-90af-458de739759f tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:48.753136 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-13f23f15-8539-4b0d-90af-458de739759f tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:08:48.760947 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-13f23f15-8539-4b0d-90af-458de739759f tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1522 microversion: 2.1 time: 0.150637 Oct 23 02:08:48.761524 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3700/7304] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:08:48 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:08:49.784651 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4045f4d2-c72a-4f89-ac5e-aef88ff0b4db tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:08:49.785228 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4045f4d2-c72a-4f89-ac5e-aef88ff0b4db tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:08:49.792026 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4045f4d2-c72a-4f89-ac5e-aef88ff0b4db tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:49.792518 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4045f4d2-c72a-4f89-ac5e-aef88ff0b4db tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:49.792962 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4045f4d2-c72a-4f89-ac5e-aef88ff0b4db tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:49.793673 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4045f4d2-c72a-4f89-ac5e-aef88ff0b4db tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:49.794154 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4045f4d2-c72a-4f89-ac5e-aef88ff0b4db tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:49.794618 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4045f4d2-c72a-4f89-ac5e-aef88ff0b4db tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:49.924972 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4045f4d2-c72a-4f89-ac5e-aef88ff0b4db tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:08:49.932571 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4045f4d2-c72a-4f89-ac5e-aef88ff0b4db tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1522 microversion: 2.1 time: 0.151954 Oct 23 02:08:49.933143 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3605/7305] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:08:49 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:08:50.957255 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a8696ea7-b021-4c49-9772-6513833afd82 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:08:50.957874 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a8696ea7-b021-4c49-9772-6513833afd82 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:08:50.964507 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a8696ea7-b021-4c49-9772-6513833afd82 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:50.964989 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a8696ea7-b021-4c49-9772-6513833afd82 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:50.965422 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a8696ea7-b021-4c49-9772-6513833afd82 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:50.966416 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a8696ea7-b021-4c49-9772-6513833afd82 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:50.966872 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a8696ea7-b021-4c49-9772-6513833afd82 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:50.967293 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a8696ea7-b021-4c49-9772-6513833afd82 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:51.096253 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a8696ea7-b021-4c49-9772-6513833afd82 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:08:51.104041 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a8696ea7-b021-4c49-9772-6513833afd82 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1522 microversion: 2.1 time: 0.151611 Oct 23 02:08:51.104613 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3701/7306] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:08:50 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:08:52.127048 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c945a1f3-20fc-4992-8f78-de32ac1ded21 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:08:52.127619 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c945a1f3-20fc-4992-8f78-de32ac1ded21 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:08:52.134002 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c945a1f3-20fc-4992-8f78-de32ac1ded21 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:52.134493 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c945a1f3-20fc-4992-8f78-de32ac1ded21 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:52.134940 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c945a1f3-20fc-4992-8f78-de32ac1ded21 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:52.135630 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c945a1f3-20fc-4992-8f78-de32ac1ded21 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:52.136094 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c945a1f3-20fc-4992-8f78-de32ac1ded21 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:52.136526 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c945a1f3-20fc-4992-8f78-de32ac1ded21 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:52.265961 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c945a1f3-20fc-4992-8f78-de32ac1ded21 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:08:52.274169 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c945a1f3-20fc-4992-8f78-de32ac1ded21 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1522 microversion: 2.1 time: 0.151123 Oct 23 02:08:52.274742 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3606/7307] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:08:52 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:08:53.297420 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d91c8e49-19cb-4500-a7bc-df6eea7a08b4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:08:53.298083 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d91c8e49-19cb-4500-a7bc-df6eea7a08b4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:08:53.304849 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d91c8e49-19cb-4500-a7bc-df6eea7a08b4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:53.305331 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d91c8e49-19cb-4500-a7bc-df6eea7a08b4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:53.305766 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d91c8e49-19cb-4500-a7bc-df6eea7a08b4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:53.306476 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d91c8e49-19cb-4500-a7bc-df6eea7a08b4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:53.306929 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d91c8e49-19cb-4500-a7bc-df6eea7a08b4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:53.307359 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d91c8e49-19cb-4500-a7bc-df6eea7a08b4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:53.435145 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d91c8e49-19cb-4500-a7bc-df6eea7a08b4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:08:53.443294 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d91c8e49-19cb-4500-a7bc-df6eea7a08b4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1522 microversion: 2.1 time: 0.149788 Oct 23 02:08:53.443867 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3702/7308] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:08:53 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:08:54.467281 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5fdacf60-0ec6-4451-b47a-c0a1061d3c93 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:08:54.467926 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5fdacf60-0ec6-4451-b47a-c0a1061d3c93 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:08:54.475614 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5fdacf60-0ec6-4451-b47a-c0a1061d3c93 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:54.476111 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5fdacf60-0ec6-4451-b47a-c0a1061d3c93 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:54.476578 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5fdacf60-0ec6-4451-b47a-c0a1061d3c93 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:54.477270 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5fdacf60-0ec6-4451-b47a-c0a1061d3c93 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:54.477741 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5fdacf60-0ec6-4451-b47a-c0a1061d3c93 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:54.478208 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5fdacf60-0ec6-4451-b47a-c0a1061d3c93 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:54.607237 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5fdacf60-0ec6-4451-b47a-c0a1061d3c93 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:08:54.615113 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5fdacf60-0ec6-4451-b47a-c0a1061d3c93 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1522 microversion: 2.1 time: 0.151773 Oct 23 02:08:54.615713 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3607/7309] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:08:54 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:08:55.638530 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5539e743-bfcc-4d14-8fe2-ddea5d8311e2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:08:55.639156 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5539e743-bfcc-4d14-8fe2-ddea5d8311e2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:08:55.646892 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5539e743-bfcc-4d14-8fe2-ddea5d8311e2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:55.647380 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5539e743-bfcc-4d14-8fe2-ddea5d8311e2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:55.647820 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5539e743-bfcc-4d14-8fe2-ddea5d8311e2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:55.648529 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5539e743-bfcc-4d14-8fe2-ddea5d8311e2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:55.648974 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5539e743-bfcc-4d14-8fe2-ddea5d8311e2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:55.649410 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5539e743-bfcc-4d14-8fe2-ddea5d8311e2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:55.784250 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5539e743-bfcc-4d14-8fe2-ddea5d8311e2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:08:55.791976 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5539e743-bfcc-4d14-8fe2-ddea5d8311e2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1522 microversion: 2.1 time: 0.157386 Oct 23 02:08:55.792546 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3703/7310] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:08:55 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:08:56.816180 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ea5f7b48-51ab-4559-a18c-0cad65aadbaa tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:08:56.816766 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ea5f7b48-51ab-4559-a18c-0cad65aadbaa tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:08:56.823691 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ea5f7b48-51ab-4559-a18c-0cad65aadbaa tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:56.824189 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ea5f7b48-51ab-4559-a18c-0cad65aadbaa tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:56.824639 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ea5f7b48-51ab-4559-a18c-0cad65aadbaa tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:56.825345 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ea5f7b48-51ab-4559-a18c-0cad65aadbaa tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:56.825812 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ea5f7b48-51ab-4559-a18c-0cad65aadbaa tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:56.826277 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ea5f7b48-51ab-4559-a18c-0cad65aadbaa tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:56.952813 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ea5f7b48-51ab-4559-a18c-0cad65aadbaa tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:08:56.961117 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ea5f7b48-51ab-4559-a18c-0cad65aadbaa tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1522 microversion: 2.1 time: 0.149028 Oct 23 02:08:56.961690 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3608/7311] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:08:56 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:08:57.984529 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4f94963f-1ebb-469d-bc81-dc535bc07d27 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:08:57.985155 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4f94963f-1ebb-469d-bc81-dc535bc07d27 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:08:57.993415 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f94963f-1ebb-469d-bc81-dc535bc07d27 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:57.993952 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f94963f-1ebb-469d-bc81-dc535bc07d27 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:57.994425 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f94963f-1ebb-469d-bc81-dc535bc07d27 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:57.995116 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f94963f-1ebb-469d-bc81-dc535bc07d27 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:57.995787 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f94963f-1ebb-469d-bc81-dc535bc07d27 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:57.995988 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f94963f-1ebb-469d-bc81-dc535bc07d27 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:58.130921 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4f94963f-1ebb-469d-bc81-dc535bc07d27 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:08:58.138805 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4f94963f-1ebb-469d-bc81-dc535bc07d27 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1522 microversion: 2.1 time: 0.158254 Oct 23 02:08:58.139606 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3704/7312] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:08:57 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:08:59.072439 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-0b01ded5-d6f8-46b5-bada-407b834e3b58 req-bedb982a-70cc-423b-b9a8-178d16f61175 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0285026a-b7a9-45f2-a63b-5a25f044b278", "name": "network-vif-unplugged", "status": "completed", "tag": "542fe86c-9b62-4329-b413-e38ab237a101"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:08:59.082819 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-0b01ded5-d6f8-46b5-bada-407b834e3b58 req-bedb982a-70cc-423b-b9a8-178d16f61175 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:59.083320 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-0b01ded5-d6f8-46b5-bada-407b834e3b58 req-bedb982a-70cc-423b-b9a8-178d16f61175 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:59.083797 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-0b01ded5-d6f8-46b5-bada-407b834e3b58 req-bedb982a-70cc-423b-b9a8-178d16f61175 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:59.096671 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-0b01ded5-d6f8-46b5-bada-407b834e3b58 req-bedb982a-70cc-423b-b9a8-178d16f61175 service nova] Creating event network-vif-unplugged:542fe86c-9b62-4329-b413-e38ab237a101 for instance 0285026a-b7a9-45f2-a63b-5a25f044b278 on n-h2-master-1 Oct 23 02:08:59.102065 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [req-0b01ded5-d6f8-46b5-bada-407b834e3b58 req-bedb982a-70cc-423b-b9a8-178d16f61175 service nova] Instance 0285026a-b7a9-45f2-a63b-5a25f044b278 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120945) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 23 02:08:59.113010 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-0b01ded5-d6f8-46b5-bada-407b834e3b58 req-bedb982a-70cc-423b-b9a8-178d16f61175 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045245 Oct 23 02:08:59.113606 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3609/7313] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:08:59.163128 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-800e907e-88fe-4996-90e6-37229bee8769 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:08:59.163841 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-800e907e-88fe-4996-90e6-37229bee8769 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:08:59.170941 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-800e907e-88fe-4996-90e6-37229bee8769 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:59.173956 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-800e907e-88fe-4996-90e6-37229bee8769 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:59.173956 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-800e907e-88fe-4996-90e6-37229bee8769 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:59.173956 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-800e907e-88fe-4996-90e6-37229bee8769 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:08:59.173956 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-800e907e-88fe-4996-90e6-37229bee8769 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:08:59.173956 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-800e907e-88fe-4996-90e6-37229bee8769 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:08:59.305700 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-800e907e-88fe-4996-90e6-37229bee8769 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:08:59.313512 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-800e907e-88fe-4996-90e6-37229bee8769 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1521 microversion: 2.1 time: 0.154360 Oct 23 02:08:59.314111 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3705/7314] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:08:59 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:09:00.338947 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d00a0f5c-a5a2-41a1-a731-fd303c929387 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:00.339729 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d00a0f5c-a5a2-41a1-a731-fd303c929387 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:09:00.346748 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d00a0f5c-a5a2-41a1-a731-fd303c929387 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:00.347253 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d00a0f5c-a5a2-41a1-a731-fd303c929387 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:00.347707 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d00a0f5c-a5a2-41a1-a731-fd303c929387 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:00.348442 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d00a0f5c-a5a2-41a1-a731-fd303c929387 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:00.348914 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d00a0f5c-a5a2-41a1-a731-fd303c929387 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:00.349357 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d00a0f5c-a5a2-41a1-a731-fd303c929387 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:00.484976 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d00a0f5c-a5a2-41a1-a731-fd303c929387 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:09:00.492968 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d00a0f5c-a5a2-41a1-a731-fd303c929387 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1521 microversion: 2.1 time: 0.159489 Oct 23 02:09:00.493553 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3610/7315] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:09:00 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:09:01.128257 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-7a6c4590-741b-4755-acca-0f07c122fae6 req-59e43973-c66c-4911-bc58-b4dc2c3e9e5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0285026a-b7a9-45f2-a63b-5a25f044b278", "tag": "542fe86c-9b62-4329-b413-e38ab237a101"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:09:01.138449 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-7a6c4590-741b-4755-acca-0f07c122fae6 req-59e43973-c66c-4911-bc58-b4dc2c3e9e5f service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:01.138932 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-7a6c4590-741b-4755-acca-0f07c122fae6 req-59e43973-c66c-4911-bc58-b4dc2c3e9e5f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:01.139367 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-7a6c4590-741b-4755-acca-0f07c122fae6 req-59e43973-c66c-4911-bc58-b4dc2c3e9e5f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:01.150798 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-7a6c4590-741b-4755-acca-0f07c122fae6 req-59e43973-c66c-4911-bc58-b4dc2c3e9e5f service nova] Creating event network-changed:542fe86c-9b62-4329-b413-e38ab237a101 for instance 0285026a-b7a9-45f2-a63b-5a25f044b278 on n-h2-master-1 Oct 23 02:09:01.156084 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [req-7a6c4590-741b-4755-acca-0f07c122fae6 req-59e43973-c66c-4911-bc58-b4dc2c3e9e5f service nova] Instance 0285026a-b7a9-45f2-a63b-5a25f044b278 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120944) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 23 02:09:01.166812 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-7a6c4590-741b-4755-acca-0f07c122fae6 req-59e43973-c66c-4911-bc58-b4dc2c3e9e5f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042969 Oct 23 02:09:01.167396 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3706/7316] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:09:01.516761 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ac923b1d-6e57-40b4-abde-de5004d8885b tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:01.517403 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ac923b1d-6e57-40b4-abde-de5004d8885b tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:09:01.524228 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ac923b1d-6e57-40b4-abde-de5004d8885b tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:01.524725 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ac923b1d-6e57-40b4-abde-de5004d8885b tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:01.525187 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ac923b1d-6e57-40b4-abde-de5004d8885b tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:01.525877 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ac923b1d-6e57-40b4-abde-de5004d8885b tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:01.526362 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ac923b1d-6e57-40b4-abde-de5004d8885b tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:01.526795 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ac923b1d-6e57-40b4-abde-de5004d8885b tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:01.660257 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ac923b1d-6e57-40b4-abde-de5004d8885b tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:09:01.668657 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ac923b1d-6e57-40b4-abde-de5004d8885b tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1519 microversion: 2.1 time: 0.155795 Oct 23 02:09:01.669269 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3611/7317] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:09:01 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:09:02.694916 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9d0caefe-c86e-4aee-a1db-d7f52c98336f tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:02.695688 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9d0caefe-c86e-4aee-a1db-d7f52c98336f tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:09:02.701893 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9d0caefe-c86e-4aee-a1db-d7f52c98336f tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:02.702409 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9d0caefe-c86e-4aee-a1db-d7f52c98336f tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:02.702843 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9d0caefe-c86e-4aee-a1db-d7f52c98336f tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:02.703595 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9d0caefe-c86e-4aee-a1db-d7f52c98336f tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:02.704017 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9d0caefe-c86e-4aee-a1db-d7f52c98336f tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:02.704441 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9d0caefe-c86e-4aee-a1db-d7f52c98336f tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:02.832948 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9d0caefe-c86e-4aee-a1db-d7f52c98336f tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:09:02.840944 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9d0caefe-c86e-4aee-a1db-d7f52c98336f tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1516 microversion: 2.1 time: 0.151773 Oct 23 02:09:02.841514 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3707/7318] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:09:02 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:09:02.863655 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-db89cf53-97d6-4ee7-8065-3c61bef9d135 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:09:02.864205 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-db89cf53-97d6-4ee7-8065-3c61bef9d135 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:09:02.870944 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-db89cf53-97d6-4ee7-8065-3c61bef9d135 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:02.871438 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-db89cf53-97d6-4ee7-8065-3c61bef9d135 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:02.871883 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-db89cf53-97d6-4ee7-8065-3c61bef9d135 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:02.872581 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-db89cf53-97d6-4ee7-8065-3c61bef9d135 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:02.873044 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-db89cf53-97d6-4ee7-8065-3c61bef9d135 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:02.873480 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-db89cf53-97d6-4ee7-8065-3c61bef9d135 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:03.126074 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-db89cf53-97d6-4ee7-8065-3c61bef9d135 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "POST /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278/action" status: 204 len: 0 microversion: 2.1 time: 0.266513 Oct 23 02:09:03.126706 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3612/7319] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:09:02 2022] POST /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278/action => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 23 02:09:03.135058 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-012d7693-8ea0-40c3-9390-3ca2b2eefa7b tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:03.135661 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-012d7693-8ea0-40c3-9390-3ca2b2eefa7b tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:09:03.141855 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-012d7693-8ea0-40c3-9390-3ca2b2eefa7b tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:03.142532 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-012d7693-8ea0-40c3-9390-3ca2b2eefa7b tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:03.143393 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-012d7693-8ea0-40c3-9390-3ca2b2eefa7b tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:03.144358 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-012d7693-8ea0-40c3-9390-3ca2b2eefa7b tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:03.144900 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-012d7693-8ea0-40c3-9390-3ca2b2eefa7b tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:03.145399 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-012d7693-8ea0-40c3-9390-3ca2b2eefa7b tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:03.279615 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-012d7693-8ea0-40c3-9390-3ca2b2eefa7b tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:09:03.287954 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-012d7693-8ea0-40c3-9390-3ca2b2eefa7b tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1516 microversion: 2.1 time: 0.156825 Oct 23 02:09:03.288649 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3708/7320] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:09:03 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:09:04.313322 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-10933283-3b69-4a24-9ce1-6c872b5f62e4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:04.314729 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-10933283-3b69-4a24-9ce1-6c872b5f62e4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:09:04.320979 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10933283-3b69-4a24-9ce1-6c872b5f62e4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:04.321484 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10933283-3b69-4a24-9ce1-6c872b5f62e4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:04.321934 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10933283-3b69-4a24-9ce1-6c872b5f62e4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:04.322692 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10933283-3b69-4a24-9ce1-6c872b5f62e4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:04.323168 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10933283-3b69-4a24-9ce1-6c872b5f62e4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:04.323610 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-10933283-3b69-4a24-9ce1-6c872b5f62e4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:04.451487 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-10933283-3b69-4a24-9ce1-6c872b5f62e4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:09:04.459452 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-10933283-3b69-4a24-9ce1-6c872b5f62e4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1516 microversion: 2.1 time: 0.151240 Oct 23 02:09:04.460027 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3613/7321] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:09:04 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:09:05.483518 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9181844b-6e62-4151-a440-b76284c97bb4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:05.484141 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9181844b-6e62-4151-a440-b76284c97bb4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:09:05.492250 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9181844b-6e62-4151-a440-b76284c97bb4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:05.492750 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9181844b-6e62-4151-a440-b76284c97bb4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:05.493188 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9181844b-6e62-4151-a440-b76284c97bb4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:05.493892 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9181844b-6e62-4151-a440-b76284c97bb4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:05.494378 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9181844b-6e62-4151-a440-b76284c97bb4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:05.494809 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9181844b-6e62-4151-a440-b76284c97bb4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:05.629281 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9181844b-6e62-4151-a440-b76284c97bb4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:09:05.637256 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9181844b-6e62-4151-a440-b76284c97bb4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1508 microversion: 2.1 time: 0.157645 Oct 23 02:09:05.637854 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3709/7322] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:09:05 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:09:05.659684 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-da530e9e-c10a-4146-b2d9-22708d14153c tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:05.660321 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-da530e9e-c10a-4146-b2d9-22708d14153c tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:09:05.667326 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da530e9e-c10a-4146-b2d9-22708d14153c tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:05.667832 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da530e9e-c10a-4146-b2d9-22708d14153c tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:05.668283 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da530e9e-c10a-4146-b2d9-22708d14153c tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:05.669162 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da530e9e-c10a-4146-b2d9-22708d14153c tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:05.669641 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da530e9e-c10a-4146-b2d9-22708d14153c tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:05.670134 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da530e9e-c10a-4146-b2d9-22708d14153c tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:05.796993 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-8b4512ee-f736-4d3d-82e1-a3ee22de4530 req-5480899d-e9fe-492e-8aa1-f674530524d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0285026a-b7a9-45f2-a63b-5a25f044b278", "name": "network-vif-plugged", "status": "completed", "tag": "542fe86c-9b62-4329-b413-e38ab237a101"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:09:05.808381 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-da530e9e-c10a-4146-b2d9-22708d14153c tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:09:05.815185 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-8b4512ee-f736-4d3d-82e1-a3ee22de4530 req-5480899d-e9fe-492e-8aa1-f674530524d2 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:05.815677 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-8b4512ee-f736-4d3d-82e1-a3ee22de4530 req-5480899d-e9fe-492e-8aa1-f674530524d2 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:05.816112 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-8b4512ee-f736-4d3d-82e1-a3ee22de4530 req-5480899d-e9fe-492e-8aa1-f674530524d2 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:05.818331 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-da530e9e-c10a-4146-b2d9-22708d14153c tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1508 microversion: 2.1 time: 0.162423 Oct 23 02:09:05.819028 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3614/7323] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:09:05 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:09:05.827571 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-8b4512ee-f736-4d3d-82e1-a3ee22de4530 req-5480899d-e9fe-492e-8aa1-f674530524d2 service nova] Creating event network-vif-plugged:542fe86c-9b62-4329-b413-e38ab237a101 for instance 0285026a-b7a9-45f2-a63b-5a25f044b278 on n-h2-master-1 Oct 23 02:09:05.832960 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-8b4512ee-f736-4d3d-82e1-a3ee22de4530 req-5480899d-e9fe-492e-8aa1-f674530524d2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093060 Oct 23 02:09:05.833847 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3710/7324] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:09:05.844418 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f9033771-371a-4268-a085-726614d6f7a5 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Action: 'create', calling method: .version_select at 0x7f5cc1689700>, body: {"keypair": {"name": "tempest-keypair-1474729520", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2hjRHPXZVwtel77D4kMt2TEnoWQXtthQrIfyJscWrj/8bQ2CTCfG88yVxHGK/yNlcVVANbJnYzU8McrAXPUNBSJSy6onWu3Y9efgzWT7kVG6XM62Ljg9WIh8Ywfx89sw=="}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:09:05.860049 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-f9033771-371a-4268-a085-726614d6f7a5 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Getting quotas for project a7e6cc6175414fbcb1c0323ef3299901. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:09:05.866216 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-f9033771-371a-4268-a085-726614d6f7a5 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Getting quotas for user bae1f007536546b98ae09de345781a0a and project a7e6cc6175414fbcb1c0323ef3299901. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:09:05.880103 n-d-master-1 devstack@n-api.service[120945]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f9033771-371a-4268-a085-726614d6f7a5 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [b9c85242-4d53-4cfe-8a38-175a3957b7b7] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 23 02:09:06.887324 n-d-master-1 devstack@n-api.service[120945]: INFO oslo.messaging._drivers.impl_rabbit [None req-f9033771-371a-4268-a085-726614d6f7a5 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [b9c85242-4d53-4cfe-8a38-175a3957b7b7] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 35428. Oct 23 02:09:06.961589 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f9033771-371a-4268-a085-726614d6f7a5 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.121168 Oct 23 02:09:06.962264 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3615/7325] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 02:09:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:09:09.071899 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6e6d3b5c-cd86-41dc-9d06-db3838f4124e tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:09.072658 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6e6d3b5c-cd86-41dc-9d06-db3838f4124e tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:09:09.074655 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=30 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:09:09.080360 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6e6d3b5c-cd86-41dc-9d06-db3838f4124e tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:09.080802 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6e6d3b5c-cd86-41dc-9d06-db3838f4124e tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:09.081269 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6e6d3b5c-cd86-41dc-9d06-db3838f4124e tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:09.081963 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6e6d3b5c-cd86-41dc-9d06-db3838f4124e tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:09.082447 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6e6d3b5c-cd86-41dc-9d06-db3838f4124e tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:09.082876 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6e6d3b5c-cd86-41dc-9d06-db3838f4124e tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:09.100312 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=86 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:09:09.220413 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6e6d3b5c-cd86-41dc-9d06-db3838f4124e tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:09:09.228431 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6e6d3b5c-cd86-41dc-9d06-db3838f4124e tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 200 len: 1508 microversion: 2.1 time: 0.161721 Oct 23 02:09:09.229138 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3711/7326] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:09:09 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:09:09.255064 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b1a7b0bf-74f4-47c3-a030-a5943148dfa2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:09.255621 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b1a7b0bf-74f4-47c3-a030-a5943148dfa2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:09:09.261945 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1a7b0bf-74f4-47c3-a030-a5943148dfa2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:09.262485 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1a7b0bf-74f4-47c3-a030-a5943148dfa2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:09.262927 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1a7b0bf-74f4-47c3-a030-a5943148dfa2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:09.263629 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1a7b0bf-74f4-47c3-a030-a5943148dfa2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:09.264109 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1a7b0bf-74f4-47c3-a030-a5943148dfa2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:09.264532 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b1a7b0bf-74f4-47c3-a030-a5943148dfa2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:09.290380 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b1a7b0bf-74f4-47c3-a030-a5943148dfa2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 02:09:09.329162 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:09:09.614408 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b1a7b0bf-74f4-47c3-a030-a5943148dfa2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 204 len: 0 microversion: 2.1 time: 0.365629 Oct 23 02:09:09.615017 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3616/7327] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 02:09:09 2022] DELETE /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 23 02:09:09.674924 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-01c0e046-2ba2-46f0-a98c-4196dd94180e tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-140869143", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "0b1aaaa7-6ba9-4816-a511-969b14816988"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:09:09.709836 n-d-master-1 devstack@n-api.service[120944]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 23 02:09:09.710141 n-d-master-1 devstack@n-api.service[120944]: Sun Oct 23 02:09:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.42) !!! Oct 23 02:09:09.733423 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-01c0e046-2ba2-46f0-a98c-4196dd94180e tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] validate_networks() for [('0b1aaaa7-6ba9-4816-a511-969b14816988', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 02:09:10.158984 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-01c0e046-2ba2-46f0-a98c-4196dd94180e tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:09:10.159547 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-01c0e046-2ba2-46f0-a98c-4196dd94180e tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:09:10.160095 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-01c0e046-2ba2-46f0-a98c-4196dd94180e tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:09:10.160520 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-01c0e046-2ba2-46f0-a98c-4196dd94180e tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:09:10.160972 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-01c0e046-2ba2-46f0-a98c-4196dd94180e tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:09:10.170410 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01c0e046-2ba2-46f0-a98c-4196dd94180e tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:10.170939 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01c0e046-2ba2-46f0-a98c-4196dd94180e tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:10.171383 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01c0e046-2ba2-46f0-a98c-4196dd94180e tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:10.172134 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01c0e046-2ba2-46f0-a98c-4196dd94180e tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:10.172595 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01c0e046-2ba2-46f0-a98c-4196dd94180e tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:10.173020 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01c0e046-2ba2-46f0-a98c-4196dd94180e tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:10.191080 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-01c0e046-2ba2-46f0-a98c-4196dd94180e tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Getting quotas for project a7e6cc6175414fbcb1c0323ef3299901. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:09:10.196336 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-01c0e046-2ba2-46f0-a98c-4196dd94180e tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Getting quotas for user bae1f007536546b98ae09de345781a0a and project a7e6cc6175414fbcb1c0323ef3299901. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:09:10.208576 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-01c0e046-2ba2-46f0-a98c-4196dd94180e tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 02:09:10.210913 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-01c0e046-2ba2-46f0-a98c-4196dd94180e tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 02:09:10.321262 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-01c0e046-2ba2-46f0-a98c-4196dd94180e tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.650564 Oct 23 02:09:10.321852 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3712/7328] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 02:09:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 02:09:10.333631 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0529eae6-8778-4368-b6f3-49a734798004 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:10.334370 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0529eae6-8778-4368-b6f3-49a734798004 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:09:10.394367 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0529eae6-8778-4368-b6f3-49a734798004 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:09:10.403202 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0529eae6-8778-4368-b6f3-49a734798004 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 200 len: 1217 microversion: 2.1 time: 0.073894 Oct 23 02:09:10.403882 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3617/7329] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:09:10 2022] GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 1217 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:09:11.425734 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b9d9c45f-04f4-4139-80a0-fc94a304e534 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:11.426631 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b9d9c45f-04f4-4139-80a0-fc94a304e534 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:09:11.434697 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b9d9c45f-04f4-4139-80a0-fc94a304e534 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:11.435195 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b9d9c45f-04f4-4139-80a0-fc94a304e534 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:11.435639 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b9d9c45f-04f4-4139-80a0-fc94a304e534 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:11.436395 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b9d9c45f-04f4-4139-80a0-fc94a304e534 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:11.436856 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b9d9c45f-04f4-4139-80a0-fc94a304e534 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:11.437286 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b9d9c45f-04f4-4139-80a0-fc94a304e534 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:11.499320 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b9d9c45f-04f4-4139-80a0-fc94a304e534 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:09:11.507735 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b9d9c45f-04f4-4139-80a0-fc94a304e534 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 200 len: 1221 microversion: 2.1 time: 0.086006 Oct 23 02:09:11.508611 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3713/7330] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:09:11 2022] GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 1221 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:09:11.892922 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-955e752e-efd3-48bd-bc18-55da76858c35 req-5c7de7d0-032a-4e19-ae0c-2efa593a6431 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0285026a-b7a9-45f2-a63b-5a25f044b278", "name": "network-vif-deleted", "tag": "542fe86c-9b62-4329-b413-e38ab237a101"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:09:11.903926 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-955e752e-efd3-48bd-bc18-55da76858c35 req-5c7de7d0-032a-4e19-ae0c-2efa593a6431 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:11.904419 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-955e752e-efd3-48bd-bc18-55da76858c35 req-5c7de7d0-032a-4e19-ae0c-2efa593a6431 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:11.904863 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-955e752e-efd3-48bd-bc18-55da76858c35 req-5c7de7d0-032a-4e19-ae0c-2efa593a6431 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:11.916326 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-955e752e-efd3-48bd-bc18-55da76858c35 req-5c7de7d0-032a-4e19-ae0c-2efa593a6431 service nova] Creating event network-vif-deleted:542fe86c-9b62-4329-b413-e38ab237a101 for instance 0285026a-b7a9-45f2-a63b-5a25f044b278 on n-h2-master-1 Oct 23 02:09:11.921506 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-955e752e-efd3-48bd-bc18-55da76858c35 req-5c7de7d0-032a-4e19-ae0c-2efa593a6431 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032642 Oct 23 02:09:11.923571 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3618/7331] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:09:12.531266 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7e69b259-31cc-478f-af7f-14ff391b1b75 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:12.531919 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7e69b259-31cc-478f-af7f-14ff391b1b75 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:09:12.538885 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e69b259-31cc-478f-af7f-14ff391b1b75 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:12.539372 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e69b259-31cc-478f-af7f-14ff391b1b75 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:12.539811 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e69b259-31cc-478f-af7f-14ff391b1b75 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:12.540504 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e69b259-31cc-478f-af7f-14ff391b1b75 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:12.540963 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e69b259-31cc-478f-af7f-14ff391b1b75 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:12.541393 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7e69b259-31cc-478f-af7f-14ff391b1b75 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:12.607630 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7e69b259-31cc-478f-af7f-14ff391b1b75 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:09:12.617196 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7e69b259-31cc-478f-af7f-14ff391b1b75 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 200 len: 1269 microversion: 2.1 time: 0.089720 Oct 23 02:09:12.617881 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3714/7332] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:09:12 2022] GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 1269 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:09:13.644428 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fcf3c43f-dbbf-4325-b2d0-4fca78762153 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:13.645148 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-fcf3c43f-dbbf-4325-b2d0-4fca78762153 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:09:13.647170 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:09:13.652235 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fcf3c43f-dbbf-4325-b2d0-4fca78762153 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:13.652733 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fcf3c43f-dbbf-4325-b2d0-4fca78762153 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:13.653172 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fcf3c43f-dbbf-4325-b2d0-4fca78762153 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:13.653940 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fcf3c43f-dbbf-4325-b2d0-4fca78762153 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:13.654425 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fcf3c43f-dbbf-4325-b2d0-4fca78762153 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:13.654856 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fcf3c43f-dbbf-4325-b2d0-4fca78762153 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:13.793841 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-fcf3c43f-dbbf-4325-b2d0-4fca78762153 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:09:13.802278 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fcf3c43f-dbbf-4325-b2d0-4fca78762153 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 200 len: 1317 microversion: 2.1 time: 0.163465 Oct 23 02:09:13.802877 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3619/7333] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:09:13 2022] GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:09:14.744603 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-3db6f932-229b-42c1-b65a-4f9da2317f1f req-fe7af4d7-3a62-449d-ab1a-3f7b7fa0fc90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23886b61-8e77-4e61-8f7a-2002df068452", "tag": "59d07394-6684-4637-a9f9-b05abe3b6ba6"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:09:14.764879 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-3db6f932-229b-42c1-b65a-4f9da2317f1f req-fe7af4d7-3a62-449d-ab1a-3f7b7fa0fc90 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:14.767961 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-3db6f932-229b-42c1-b65a-4f9da2317f1f req-fe7af4d7-3a62-449d-ab1a-3f7b7fa0fc90 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:14.767961 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-3db6f932-229b-42c1-b65a-4f9da2317f1f req-fe7af4d7-3a62-449d-ab1a-3f7b7fa0fc90 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:14.777651 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-3db6f932-229b-42c1-b65a-4f9da2317f1f req-fe7af4d7-3a62-449d-ab1a-3f7b7fa0fc90 service nova] Creating event network-changed:59d07394-6684-4637-a9f9-b05abe3b6ba6 for instance 23886b61-8e77-4e61-8f7a-2002df068452 on n-h2-master-1 Oct 23 02:09:14.782845 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-3db6f932-229b-42c1-b65a-4f9da2317f1f req-fe7af4d7-3a62-449d-ab1a-3f7b7fa0fc90 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043082 Oct 23 02:09:14.783606 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3715/7334] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:09:14.828276 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-95a4a10d-592d-467f-822c-7fcdcb3277f9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:14.829267 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-95a4a10d-592d-467f-822c-7fcdcb3277f9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:09:14.836426 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-95a4a10d-592d-467f-822c-7fcdcb3277f9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:14.836970 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-95a4a10d-592d-467f-822c-7fcdcb3277f9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:14.837417 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-95a4a10d-592d-467f-822c-7fcdcb3277f9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:14.838434 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-95a4a10d-592d-467f-822c-7fcdcb3277f9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:14.838902 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-95a4a10d-592d-467f-822c-7fcdcb3277f9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:14.839337 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-95a4a10d-592d-467f-822c-7fcdcb3277f9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:14.976487 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-95a4a10d-592d-467f-822c-7fcdcb3277f9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:09:14.980981 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-95a4a10d-592d-467f-822c-7fcdcb3277f9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 200 len: 1317 microversion: 2.1 time: 0.157466 Oct 23 02:09:14.981568 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3620/7335] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:09:14 2022] GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:09:16.005463 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a58b68bc-6c57-42b9-a13d-b0cf14afa0d9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:16.006201 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a58b68bc-6c57-42b9-a13d-b0cf14afa0d9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:09:16.013483 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a58b68bc-6c57-42b9-a13d-b0cf14afa0d9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:16.013993 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a58b68bc-6c57-42b9-a13d-b0cf14afa0d9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:16.014432 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a58b68bc-6c57-42b9-a13d-b0cf14afa0d9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:16.015127 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a58b68bc-6c57-42b9-a13d-b0cf14afa0d9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:16.015582 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a58b68bc-6c57-42b9-a13d-b0cf14afa0d9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:16.016006 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a58b68bc-6c57-42b9-a13d-b0cf14afa0d9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:16.142931 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a58b68bc-6c57-42b9-a13d-b0cf14afa0d9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:09:16.150545 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a58b68bc-6c57-42b9-a13d-b0cf14afa0d9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 200 len: 1317 microversion: 2.1 time: 0.149822 Oct 23 02:09:16.151117 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3716/7336] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:09:15 2022] GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:09:17.173464 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b8a3e902-7afe-435f-862b-af14d3e303d9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:17.174122 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b8a3e902-7afe-435f-862b-af14d3e303d9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:09:17.181115 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b8a3e902-7afe-435f-862b-af14d3e303d9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:17.181609 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b8a3e902-7afe-435f-862b-af14d3e303d9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:17.182093 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b8a3e902-7afe-435f-862b-af14d3e303d9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:17.182799 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b8a3e902-7afe-435f-862b-af14d3e303d9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:17.183270 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b8a3e902-7afe-435f-862b-af14d3e303d9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:17.183711 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b8a3e902-7afe-435f-862b-af14d3e303d9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:17.309290 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b8a3e902-7afe-435f-862b-af14d3e303d9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:09:17.317497 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b8a3e902-7afe-435f-862b-af14d3e303d9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 200 len: 1317 microversion: 2.1 time: 0.148098 Oct 23 02:09:17.318094 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3621/7337] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:09:17 2022] GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:09:18.340921 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6b04cad3-b38f-42ed-a62b-0f1e48ce0e72 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:18.341543 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6b04cad3-b38f-42ed-a62b-0f1e48ce0e72 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:09:18.349022 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b04cad3-b38f-42ed-a62b-0f1e48ce0e72 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:18.349512 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b04cad3-b38f-42ed-a62b-0f1e48ce0e72 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:18.349954 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b04cad3-b38f-42ed-a62b-0f1e48ce0e72 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:18.350668 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b04cad3-b38f-42ed-a62b-0f1e48ce0e72 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:18.351126 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b04cad3-b38f-42ed-a62b-0f1e48ce0e72 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:18.351556 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b04cad3-b38f-42ed-a62b-0f1e48ce0e72 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:18.482446 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6b04cad3-b38f-42ed-a62b-0f1e48ce0e72 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:09:18.490294 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6b04cad3-b38f-42ed-a62b-0f1e48ce0e72 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 200 len: 1317 microversion: 2.1 time: 0.153508 Oct 23 02:09:18.490864 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3717/7338] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:09:18 2022] GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:09:19.512740 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1271e7bd-dad0-4004-b5e0-e75829733957 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:19.513373 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1271e7bd-dad0-4004-b5e0-e75829733957 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:09:19.520250 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1271e7bd-dad0-4004-b5e0-e75829733957 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:19.520751 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1271e7bd-dad0-4004-b5e0-e75829733957 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:19.521202 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1271e7bd-dad0-4004-b5e0-e75829733957 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:19.521902 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1271e7bd-dad0-4004-b5e0-e75829733957 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:19.522394 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1271e7bd-dad0-4004-b5e0-e75829733957 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:19.522833 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1271e7bd-dad0-4004-b5e0-e75829733957 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:19.651458 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1271e7bd-dad0-4004-b5e0-e75829733957 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:09:19.663415 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1271e7bd-dad0-4004-b5e0-e75829733957 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 200 len: 1317 microversion: 2.1 time: 0.150748 Oct 23 02:09:19.663415 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3622/7339] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:09:19 2022] GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:09:20.684640 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d560c8a2-4d76-478f-b438-a787a0b2a892 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:20.685254 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d560c8a2-4d76-478f-b438-a787a0b2a892 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:09:20.688124 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:09:20.689423 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=6 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:09:20.694267 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d560c8a2-4d76-478f-b438-a787a0b2a892 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:20.694751 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d560c8a2-4d76-478f-b438-a787a0b2a892 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:20.695187 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d560c8a2-4d76-478f-b438-a787a0b2a892 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:20.695868 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d560c8a2-4d76-478f-b438-a787a0b2a892 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:20.696321 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d560c8a2-4d76-478f-b438-a787a0b2a892 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:20.696741 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d560c8a2-4d76-478f-b438-a787a0b2a892 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:20.830889 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d560c8a2-4d76-478f-b438-a787a0b2a892 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:09:20.839180 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d560c8a2-4d76-478f-b438-a787a0b2a892 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 200 len: 1317 microversion: 2.1 time: 0.158482 Oct 23 02:09:20.839776 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3718/7340] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:09:20 2022] GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:09:21.821844 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-98df4eeb-3bca-436f-a47f-881194a21f7d req-92f384f7-df27-44c9-8802-146726756c10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23886b61-8e77-4e61-8f7a-2002df068452", "name": "network-vif-plugged", "status": "completed", "tag": "59d07394-6684-4637-a9f9-b05abe3b6ba6"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:09:21.828909 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=6 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:09:21.833846 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-98df4eeb-3bca-436f-a47f-881194a21f7d req-92f384f7-df27-44c9-8802-146726756c10 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:21.834366 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-98df4eeb-3bca-436f-a47f-881194a21f7d req-92f384f7-df27-44c9-8802-146726756c10 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:21.834813 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-98df4eeb-3bca-436f-a47f-881194a21f7d req-92f384f7-df27-44c9-8802-146726756c10 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:21.846310 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-98df4eeb-3bca-436f-a47f-881194a21f7d req-92f384f7-df27-44c9-8802-146726756c10 service nova] Creating event network-vif-plugged:59d07394-6684-4637-a9f9-b05abe3b6ba6 for instance 23886b61-8e77-4e61-8f7a-2002df068452 on n-h2-master-1 Oct 23 02:09:21.851262 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-98df4eeb-3bca-436f-a47f-881194a21f7d req-92f384f7-df27-44c9-8802-146726756c10 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033120 Oct 23 02:09:21.851853 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3623/7341] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:09:21.862218 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-826c412c-e6a9-4bd3-8ef0-03e3ea4d74a5 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:21.866229 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-826c412c-e6a9-4bd3-8ef0-03e3ea4d74a5 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:09:21.869428 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-826c412c-e6a9-4bd3-8ef0-03e3ea4d74a5 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:21.869911 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-826c412c-e6a9-4bd3-8ef0-03e3ea4d74a5 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:21.870380 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-826c412c-e6a9-4bd3-8ef0-03e3ea4d74a5 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:21.871064 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-826c412c-e6a9-4bd3-8ef0-03e3ea4d74a5 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:21.871518 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-826c412c-e6a9-4bd3-8ef0-03e3ea4d74a5 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:21.871942 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-826c412c-e6a9-4bd3-8ef0-03e3ea4d74a5 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:22.023745 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-826c412c-e6a9-4bd3-8ef0-03e3ea4d74a5 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:09:22.031629 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-826c412c-e6a9-4bd3-8ef0-03e3ea4d74a5 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 200 len: 1317 microversion: 2.1 time: 0.173403 Oct 23 02:09:22.032268 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3719/7342] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:09:21 2022] GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:09:23.057106 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-235eb1cb-a372-4103-a731-6a68caebac46 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:23.057821 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-235eb1cb-a372-4103-a731-6a68caebac46 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:09:23.064701 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-235eb1cb-a372-4103-a731-6a68caebac46 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:23.065197 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-235eb1cb-a372-4103-a731-6a68caebac46 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:23.065645 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-235eb1cb-a372-4103-a731-6a68caebac46 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:23.066367 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-235eb1cb-a372-4103-a731-6a68caebac46 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:23.066836 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-235eb1cb-a372-4103-a731-6a68caebac46 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:23.067275 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-235eb1cb-a372-4103-a731-6a68caebac46 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:23.195157 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-235eb1cb-a372-4103-a731-6a68caebac46 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:09:23.202734 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-235eb1cb-a372-4103-a731-6a68caebac46 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 200 len: 1317 microversion: 2.1 time: 0.151147 Oct 23 02:09:23.203309 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3624/7343] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:09:23 2022] GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:09:24.226184 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9a2cce6b-795a-4929-88d2-6a00268890c0 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:24.226815 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9a2cce6b-795a-4929-88d2-6a00268890c0 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:09:24.233800 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9a2cce6b-795a-4929-88d2-6a00268890c0 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:24.234331 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9a2cce6b-795a-4929-88d2-6a00268890c0 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:24.234781 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9a2cce6b-795a-4929-88d2-6a00268890c0 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:24.235482 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9a2cce6b-795a-4929-88d2-6a00268890c0 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:24.235946 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9a2cce6b-795a-4929-88d2-6a00268890c0 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:24.236381 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9a2cce6b-795a-4929-88d2-6a00268890c0 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:24.367274 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9a2cce6b-795a-4929-88d2-6a00268890c0 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:09:24.375088 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9a2cce6b-795a-4929-88d2-6a00268890c0 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 200 len: 1507 microversion: 2.1 time: 0.152878 Oct 23 02:09:24.375674 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3720/7344] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:09:24 2022] GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:09:24.398055 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1fb519df-9093-4196-9867-0bee0246eea9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:24.398685 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1fb519df-9093-4196-9867-0bee0246eea9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:09:24.405567 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1fb519df-9093-4196-9867-0bee0246eea9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:24.406093 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1fb519df-9093-4196-9867-0bee0246eea9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:24.406540 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1fb519df-9093-4196-9867-0bee0246eea9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:24.407229 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1fb519df-9093-4196-9867-0bee0246eea9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:24.407689 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1fb519df-9093-4196-9867-0bee0246eea9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:24.408121 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1fb519df-9093-4196-9867-0bee0246eea9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:24.540944 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1fb519df-9093-4196-9867-0bee0246eea9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:09:24.549220 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1fb519df-9093-4196-9867-0bee0246eea9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 200 len: 1507 microversion: 2.1 time: 0.155054 Oct 23 02:09:24.549806 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3625/7345] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:09:24 2022] GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:09:24.572098 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d5f249c9-f3c0-4986-8909-1f7c205410df tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:09:24.574766 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d5f249c9-f3c0-4986-8909-1f7c205410df tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:09:24.580738 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d5f249c9-f3c0-4986-8909-1f7c205410df tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:24.581234 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d5f249c9-f3c0-4986-8909-1f7c205410df tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:24.581675 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d5f249c9-f3c0-4986-8909-1f7c205410df tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:24.582395 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d5f249c9-f3c0-4986-8909-1f7c205410df tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:24.582874 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d5f249c9-f3c0-4986-8909-1f7c205410df tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:24.583304 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d5f249c9-f3c0-4986-8909-1f7c205410df tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:24.611414 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d5f249c9-f3c0-4986-8909-1f7c205410df tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:09:24.616785 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d5f249c9-f3c0-4986-8909-1f7c205410df tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Old instance type m1.heat2, new instance type m1.heat {{(pid=120944) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 23 02:09:24.623230 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-d5f249c9-f3c0-4986-8909-1f7c205410df tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:09:24.623659 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-d5f249c9-f3c0-4986-8909-1f7c205410df tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:09:24.624137 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-d5f249c9-f3c0-4986-8909-1f7c205410df tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:09:24.624550 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-d5f249c9-f3c0-4986-8909-1f7c205410df tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:09:24.624964 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-d5f249c9-f3c0-4986-8909-1f7c205410df tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:09:24.829478 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d5f249c9-f3c0-4986-8909-1f7c205410df tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "POST /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452/action" status: 202 len: 0 microversion: 2.1 time: 0.261323 Oct 23 02:09:24.830291 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3721/7346] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:09:24 2022] POST /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:09:24.838627 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b9a7a6b1-baca-4c23-8881-74cd6df5ee48 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:24.839348 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b9a7a6b1-baca-4c23-8881-74cd6df5ee48 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:09:24.846109 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9a7a6b1-baca-4c23-8881-74cd6df5ee48 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:24.846697 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9a7a6b1-baca-4c23-8881-74cd6df5ee48 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:24.847156 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9a7a6b1-baca-4c23-8881-74cd6df5ee48 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:24.847869 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9a7a6b1-baca-4c23-8881-74cd6df5ee48 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:24.848500 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9a7a6b1-baca-4c23-8881-74cd6df5ee48 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:24.848947 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9a7a6b1-baca-4c23-8881-74cd6df5ee48 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:24.981390 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b9a7a6b1-baca-4c23-8881-74cd6df5ee48 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:09:24.990187 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b9a7a6b1-baca-4c23-8881-74cd6df5ee48 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 200 len: 1514 microversion: 2.1 time: 0.155658 Oct 23 02:09:24.992827 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3626/7347] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:09:24 2022] GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:09:26.014715 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-23b2155a-ad58-48f4-8664-d96a432d2d24 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:26.015438 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-23b2155a-ad58-48f4-8664-d96a432d2d24 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:09:26.022372 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-23b2155a-ad58-48f4-8664-d96a432d2d24 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:26.022865 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-23b2155a-ad58-48f4-8664-d96a432d2d24 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:26.023309 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-23b2155a-ad58-48f4-8664-d96a432d2d24 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:26.023998 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-23b2155a-ad58-48f4-8664-d96a432d2d24 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:26.024458 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-23b2155a-ad58-48f4-8664-d96a432d2d24 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:26.024894 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-23b2155a-ad58-48f4-8664-d96a432d2d24 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:26.154917 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-23b2155a-ad58-48f4-8664-d96a432d2d24 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:09:26.162691 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-23b2155a-ad58-48f4-8664-d96a432d2d24 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 200 len: 1514 microversion: 2.1 time: 0.153034 Oct 23 02:09:26.163283 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3722/7348] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:09:26 2022] GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:09:27.186663 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3fd34bb4-8a75-42a6-bf5a-2413d14c2031 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:27.187301 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3fd34bb4-8a75-42a6-bf5a-2413d14c2031 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:09:27.194730 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3fd34bb4-8a75-42a6-bf5a-2413d14c2031 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:27.195240 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3fd34bb4-8a75-42a6-bf5a-2413d14c2031 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:27.195694 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3fd34bb4-8a75-42a6-bf5a-2413d14c2031 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:27.196405 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3fd34bb4-8a75-42a6-bf5a-2413d14c2031 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:27.196876 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3fd34bb4-8a75-42a6-bf5a-2413d14c2031 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:27.197316 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3fd34bb4-8a75-42a6-bf5a-2413d14c2031 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:27.330845 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3fd34bb4-8a75-42a6-bf5a-2413d14c2031 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:09:27.339031 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3fd34bb4-8a75-42a6-bf5a-2413d14c2031 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 200 len: 1514 microversion: 2.1 time: 0.156343 Oct 23 02:09:27.339610 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3627/7349] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:09:27 2022] GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:09:28.361884 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f1c99de5-3a79-4db8-bb5e-58413a5654a4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:28.362532 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f1c99de5-3a79-4db8-bb5e-58413a5654a4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:09:28.369359 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1c99de5-3a79-4db8-bb5e-58413a5654a4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:28.369842 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1c99de5-3a79-4db8-bb5e-58413a5654a4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:28.370308 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1c99de5-3a79-4db8-bb5e-58413a5654a4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:28.370995 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1c99de5-3a79-4db8-bb5e-58413a5654a4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:28.371472 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1c99de5-3a79-4db8-bb5e-58413a5654a4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:28.371895 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1c99de5-3a79-4db8-bb5e-58413a5654a4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:28.502123 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f1c99de5-3a79-4db8-bb5e-58413a5654a4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:09:28.509803 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f1c99de5-3a79-4db8-bb5e-58413a5654a4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 200 len: 1519 microversion: 2.1 time: 0.151861 Oct 23 02:09:28.510405 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3723/7350] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:09:28 2022] GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:09:29.534322 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f4d2bb8f-5237-4d63-8205-bc385923f5dd tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:29.534948 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f4d2bb8f-5237-4d63-8205-bc385923f5dd tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:09:29.541725 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f4d2bb8f-5237-4d63-8205-bc385923f5dd tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:29.542250 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f4d2bb8f-5237-4d63-8205-bc385923f5dd tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:29.542695 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f4d2bb8f-5237-4d63-8205-bc385923f5dd tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:29.543388 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f4d2bb8f-5237-4d63-8205-bc385923f5dd tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:29.543850 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f4d2bb8f-5237-4d63-8205-bc385923f5dd tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:29.544279 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f4d2bb8f-5237-4d63-8205-bc385923f5dd tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:29.672215 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f4d2bb8f-5237-4d63-8205-bc385923f5dd tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:09:29.680110 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f4d2bb8f-5237-4d63-8205-bc385923f5dd tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 200 len: 1519 microversion: 2.1 time: 0.150292 Oct 23 02:09:29.680697 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3628/7351] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:09:29 2022] GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:09:30.703539 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-db93be39-7dcf-4937-b06c-392dbae9e737 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:30.704774 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-db93be39-7dcf-4937-b06c-392dbae9e737 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:09:30.711832 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-db93be39-7dcf-4937-b06c-392dbae9e737 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:30.712324 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-db93be39-7dcf-4937-b06c-392dbae9e737 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:30.712780 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-db93be39-7dcf-4937-b06c-392dbae9e737 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:30.713738 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-db93be39-7dcf-4937-b06c-392dbae9e737 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:30.714229 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-db93be39-7dcf-4937-b06c-392dbae9e737 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:30.714664 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-db93be39-7dcf-4937-b06c-392dbae9e737 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:30.851352 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-db93be39-7dcf-4937-b06c-392dbae9e737 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:09:30.859211 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-db93be39-7dcf-4937-b06c-392dbae9e737 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 200 len: 1519 microversion: 2.1 time: 0.159694 Oct 23 02:09:30.859779 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3724/7352] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:09:30 2022] GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:09:31.882333 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-51f07f61-1afe-4be0-b2ba-17236589cb40 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:31.882961 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-51f07f61-1afe-4be0-b2ba-17236589cb40 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:09:31.889755 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-51f07f61-1afe-4be0-b2ba-17236589cb40 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:31.890302 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-51f07f61-1afe-4be0-b2ba-17236589cb40 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:31.890751 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-51f07f61-1afe-4be0-b2ba-17236589cb40 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:31.891937 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-51f07f61-1afe-4be0-b2ba-17236589cb40 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:31.892399 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-51f07f61-1afe-4be0-b2ba-17236589cb40 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:31.892832 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-51f07f61-1afe-4be0-b2ba-17236589cb40 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:32.020441 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-51f07f61-1afe-4be0-b2ba-17236589cb40 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:09:32.028223 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-51f07f61-1afe-4be0-b2ba-17236589cb40 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 200 len: 1519 microversion: 2.1 time: 0.149938 Oct 23 02:09:32.028810 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3629/7353] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:09:31 2022] GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:09:33.051886 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3a09c02e-624d-4e3e-b47f-17f7e742a7e8 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:33.052507 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3a09c02e-624d-4e3e-b47f-17f7e742a7e8 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:09:33.059424 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3a09c02e-624d-4e3e-b47f-17f7e742a7e8 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:33.059911 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3a09c02e-624d-4e3e-b47f-17f7e742a7e8 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:33.060351 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3a09c02e-624d-4e3e-b47f-17f7e742a7e8 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:33.061040 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3a09c02e-624d-4e3e-b47f-17f7e742a7e8 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:33.061497 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3a09c02e-624d-4e3e-b47f-17f7e742a7e8 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:33.061928 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3a09c02e-624d-4e3e-b47f-17f7e742a7e8 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:33.192527 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3a09c02e-624d-4e3e-b47f-17f7e742a7e8 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:09:33.200269 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3a09c02e-624d-4e3e-b47f-17f7e742a7e8 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 200 len: 1519 microversion: 2.1 time: 0.152285 Oct 23 02:09:33.200845 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3725/7354] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:09:33 2022] GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:09:34.224824 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b181d1e8-8569-4d7a-a779-d6e95383cf17 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:34.225482 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b181d1e8-8569-4d7a-a779-d6e95383cf17 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:09:34.232397 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b181d1e8-8569-4d7a-a779-d6e95383cf17 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:34.232891 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b181d1e8-8569-4d7a-a779-d6e95383cf17 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:34.233337 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b181d1e8-8569-4d7a-a779-d6e95383cf17 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:34.234062 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b181d1e8-8569-4d7a-a779-d6e95383cf17 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:34.234531 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b181d1e8-8569-4d7a-a779-d6e95383cf17 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:34.234969 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b181d1e8-8569-4d7a-a779-d6e95383cf17 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:34.362108 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b181d1e8-8569-4d7a-a779-d6e95383cf17 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:09:34.369790 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b181d1e8-8569-4d7a-a779-d6e95383cf17 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 200 len: 1519 microversion: 2.1 time: 0.148854 Oct 23 02:09:34.370400 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3630/7355] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:09:34 2022] GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:09:35.393358 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cc5b7d00-e97e-427c-9a4e-0fd223a678af tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:35.394000 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-cc5b7d00-e97e-427c-9a4e-0fd223a678af tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:09:35.403192 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cc5b7d00-e97e-427c-9a4e-0fd223a678af tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:35.403679 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cc5b7d00-e97e-427c-9a4e-0fd223a678af tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:35.404122 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cc5b7d00-e97e-427c-9a4e-0fd223a678af tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:35.404818 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cc5b7d00-e97e-427c-9a4e-0fd223a678af tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:35.405278 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cc5b7d00-e97e-427c-9a4e-0fd223a678af tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:35.405714 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cc5b7d00-e97e-427c-9a4e-0fd223a678af tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:35.535262 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cc5b7d00-e97e-427c-9a4e-0fd223a678af tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:09:35.543234 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cc5b7d00-e97e-427c-9a4e-0fd223a678af tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 200 len: 1519 microversion: 2.1 time: 0.154386 Oct 23 02:09:35.543817 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3726/7356] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:09:35 2022] GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:09:36.567851 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e80840b0-960f-4466-a573-448c26216e8f tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:36.568413 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e80840b0-960f-4466-a573-448c26216e8f tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:09:36.575329 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e80840b0-960f-4466-a573-448c26216e8f tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:36.575815 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e80840b0-960f-4466-a573-448c26216e8f tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:36.576264 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e80840b0-960f-4466-a573-448c26216e8f tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:36.576965 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e80840b0-960f-4466-a573-448c26216e8f tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:36.577431 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e80840b0-960f-4466-a573-448c26216e8f tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:36.577864 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e80840b0-960f-4466-a573-448c26216e8f tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:36.713405 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e80840b0-960f-4466-a573-448c26216e8f tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:09:36.722279 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e80840b0-960f-4466-a573-448c26216e8f tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 200 len: 1519 microversion: 2.1 time: 0.159079 Oct 23 02:09:36.722867 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3631/7357] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:09:36 2022] GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:09:37.746825 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e7be81ac-c264-4898-9c2d-2a2929aea0e9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:37.747394 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e7be81ac-c264-4898-9c2d-2a2929aea0e9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:09:37.754852 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e7be81ac-c264-4898-9c2d-2a2929aea0e9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:37.755350 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e7be81ac-c264-4898-9c2d-2a2929aea0e9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:37.755798 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e7be81ac-c264-4898-9c2d-2a2929aea0e9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:37.756504 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e7be81ac-c264-4898-9c2d-2a2929aea0e9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:37.756969 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e7be81ac-c264-4898-9c2d-2a2929aea0e9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:37.757420 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e7be81ac-c264-4898-9c2d-2a2929aea0e9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:37.886516 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e7be81ac-c264-4898-9c2d-2a2929aea0e9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:09:37.894474 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e7be81ac-c264-4898-9c2d-2a2929aea0e9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 200 len: 1519 microversion: 2.1 time: 0.151655 Oct 23 02:09:37.895461 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3727/7358] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:09:37 2022] GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:09:38.918305 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c1bc4c59-33e1-4a9d-a629-ada2f9c4ae34 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:38.918865 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c1bc4c59-33e1-4a9d-a629-ada2f9c4ae34 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:09:38.926258 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c1bc4c59-33e1-4a9d-a629-ada2f9c4ae34 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:38.926747 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c1bc4c59-33e1-4a9d-a629-ada2f9c4ae34 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:38.927188 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c1bc4c59-33e1-4a9d-a629-ada2f9c4ae34 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:38.927877 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c1bc4c59-33e1-4a9d-a629-ada2f9c4ae34 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:38.928336 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c1bc4c59-33e1-4a9d-a629-ada2f9c4ae34 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:38.928763 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c1bc4c59-33e1-4a9d-a629-ada2f9c4ae34 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:39.066395 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c1bc4c59-33e1-4a9d-a629-ada2f9c4ae34 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:09:39.076743 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c1bc4c59-33e1-4a9d-a629-ada2f9c4ae34 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 200 len: 1519 microversion: 2.1 time: 0.162317 Oct 23 02:09:39.077463 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3632/7359] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:09:38 2022] GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:09:40.101774 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a9472b02-4e49-464a-856d-d48f55fb9785 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:40.102420 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a9472b02-4e49-464a-856d-d48f55fb9785 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:09:40.105134 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:09:40.110073 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a9472b02-4e49-464a-856d-d48f55fb9785 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:40.110563 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a9472b02-4e49-464a-856d-d48f55fb9785 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:40.111005 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a9472b02-4e49-464a-856d-d48f55fb9785 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:40.111704 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a9472b02-4e49-464a-856d-d48f55fb9785 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:40.112175 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a9472b02-4e49-464a-856d-d48f55fb9785 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:40.112603 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a9472b02-4e49-464a-856d-d48f55fb9785 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:40.116563 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:09:40.240371 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a9472b02-4e49-464a-856d-d48f55fb9785 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:09:40.248109 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a9472b02-4e49-464a-856d-d48f55fb9785 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 200 len: 1519 microversion: 2.1 time: 0.150332 Oct 23 02:09:40.248688 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3728/7360] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:09:40 2022] GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:09:41.271624 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4cc3e8da-7dd6-4ade-a814-0f63400a28cb tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:41.272295 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4cc3e8da-7dd6-4ade-a814-0f63400a28cb tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:09:41.279225 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4cc3e8da-7dd6-4ade-a814-0f63400a28cb tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:41.279727 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4cc3e8da-7dd6-4ade-a814-0f63400a28cb tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:41.280180 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4cc3e8da-7dd6-4ade-a814-0f63400a28cb tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:41.280882 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4cc3e8da-7dd6-4ade-a814-0f63400a28cb tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:41.281351 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4cc3e8da-7dd6-4ade-a814-0f63400a28cb tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:41.282341 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4cc3e8da-7dd6-4ade-a814-0f63400a28cb tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:41.286461 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:09:41.413527 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4cc3e8da-7dd6-4ade-a814-0f63400a28cb tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:09:41.421290 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4cc3e8da-7dd6-4ade-a814-0f63400a28cb tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 200 len: 1519 microversion: 2.1 time: 0.153702 Oct 23 02:09:41.421869 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3633/7361] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:09:41 2022] GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:09:42.445143 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3fad0a5e-69d4-4984-b507-61f736571ee1 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:42.445708 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3fad0a5e-69d4-4984-b507-61f736571ee1 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:09:42.453227 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3fad0a5e-69d4-4984-b507-61f736571ee1 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:42.453741 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3fad0a5e-69d4-4984-b507-61f736571ee1 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:42.454219 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3fad0a5e-69d4-4984-b507-61f736571ee1 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:42.454904 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3fad0a5e-69d4-4984-b507-61f736571ee1 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:42.455357 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3fad0a5e-69d4-4984-b507-61f736571ee1 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:42.455781 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3fad0a5e-69d4-4984-b507-61f736571ee1 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:42.585685 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3fad0a5e-69d4-4984-b507-61f736571ee1 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:09:42.593762 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3fad0a5e-69d4-4984-b507-61f736571ee1 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 200 len: 1519 microversion: 2.1 time: 0.152659 Oct 23 02:09:42.594378 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3729/7362] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:09:42 2022] GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:09:43.618733 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a2e11155-25aa-43f8-98cc-35b723d0aaa7 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:43.619366 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a2e11155-25aa-43f8-98cc-35b723d0aaa7 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:09:43.628275 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a2e11155-25aa-43f8-98cc-35b723d0aaa7 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:43.628774 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a2e11155-25aa-43f8-98cc-35b723d0aaa7 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:43.629223 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a2e11155-25aa-43f8-98cc-35b723d0aaa7 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:43.629922 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a2e11155-25aa-43f8-98cc-35b723d0aaa7 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:43.630419 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a2e11155-25aa-43f8-98cc-35b723d0aaa7 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:43.630857 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a2e11155-25aa-43f8-98cc-35b723d0aaa7 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:43.758446 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a2e11155-25aa-43f8-98cc-35b723d0aaa7 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:09:43.766710 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a2e11155-25aa-43f8-98cc-35b723d0aaa7 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 200 len: 1519 microversion: 2.1 time: 0.151288 Oct 23 02:09:43.767348 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3634/7363] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:09:43 2022] GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:09:44.789937 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9c5df127-8638-404d-bdc1-ec914dbed151 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:44.790505 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9c5df127-8638-404d-bdc1-ec914dbed151 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:09:44.797348 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9c5df127-8638-404d-bdc1-ec914dbed151 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:44.797934 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9c5df127-8638-404d-bdc1-ec914dbed151 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:44.798401 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9c5df127-8638-404d-bdc1-ec914dbed151 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:44.799085 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9c5df127-8638-404d-bdc1-ec914dbed151 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:44.799538 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9c5df127-8638-404d-bdc1-ec914dbed151 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:44.799963 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9c5df127-8638-404d-bdc1-ec914dbed151 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:44.933468 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9c5df127-8638-404d-bdc1-ec914dbed151 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:09:44.941679 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9c5df127-8638-404d-bdc1-ec914dbed151 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 200 len: 1519 microversion: 2.1 time: 0.155723 Oct 23 02:09:44.942290 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3730/7364] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:09:44 2022] GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:09:45.964781 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-97fc4dbd-1995-4842-bf0d-b2a7dbe9b767 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:45.965330 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-97fc4dbd-1995-4842-bf0d-b2a7dbe9b767 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:09:45.968107 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=32 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:09:45.973273 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-97fc4dbd-1995-4842-bf0d-b2a7dbe9b767 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:45.973766 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-97fc4dbd-1995-4842-bf0d-b2a7dbe9b767 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:45.974237 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-97fc4dbd-1995-4842-bf0d-b2a7dbe9b767 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:45.974937 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-97fc4dbd-1995-4842-bf0d-b2a7dbe9b767 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:45.975403 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-97fc4dbd-1995-4842-bf0d-b2a7dbe9b767 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:45.975839 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-97fc4dbd-1995-4842-bf0d-b2a7dbe9b767 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:46.102915 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-97fc4dbd-1995-4842-bf0d-b2a7dbe9b767 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:09:46.110764 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-97fc4dbd-1995-4842-bf0d-b2a7dbe9b767 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 200 len: 1519 microversion: 2.1 time: 0.150224 Oct 23 02:09:46.111343 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3635/7365] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:09:45 2022] GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:09:47.133861 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e0c59823-41f1-46fe-9537-387b5093982e tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:47.134523 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e0c59823-41f1-46fe-9537-387b5093982e tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:09:47.141356 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0c59823-41f1-46fe-9537-387b5093982e tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:47.141836 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0c59823-41f1-46fe-9537-387b5093982e tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:47.142308 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0c59823-41f1-46fe-9537-387b5093982e tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:47.142994 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0c59823-41f1-46fe-9537-387b5093982e tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:47.143449 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0c59823-41f1-46fe-9537-387b5093982e tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:47.143874 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0c59823-41f1-46fe-9537-387b5093982e tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:47.273059 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e0c59823-41f1-46fe-9537-387b5093982e tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:09:47.280796 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e0c59823-41f1-46fe-9537-387b5093982e tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 200 len: 1519 microversion: 2.1 time: 0.150847 Oct 23 02:09:47.281876 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3731/7366] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:09:47 2022] GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:09:48.304515 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-13f35bdc-3d6b-43eb-b398-8ca7e247b3b4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:48.305146 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-13f35bdc-3d6b-43eb-b398-8ca7e247b3b4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:09:48.312078 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-13f35bdc-3d6b-43eb-b398-8ca7e247b3b4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:48.312577 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-13f35bdc-3d6b-43eb-b398-8ca7e247b3b4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:48.313029 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-13f35bdc-3d6b-43eb-b398-8ca7e247b3b4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:48.313727 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-13f35bdc-3d6b-43eb-b398-8ca7e247b3b4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:48.314222 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-13f35bdc-3d6b-43eb-b398-8ca7e247b3b4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:48.314663 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-13f35bdc-3d6b-43eb-b398-8ca7e247b3b4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:48.442468 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-13f35bdc-3d6b-43eb-b398-8ca7e247b3b4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:09:48.450153 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-13f35bdc-3d6b-43eb-b398-8ca7e247b3b4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 200 len: 1519 microversion: 2.1 time: 0.149568 Oct 23 02:09:48.450727 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3636/7367] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:09:48 2022] GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:09:49.472806 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-69444b40-0256-44d7-9dc1-19f88d95a5b3 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:49.473433 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-69444b40-0256-44d7-9dc1-19f88d95a5b3 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:09:49.480369 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-69444b40-0256-44d7-9dc1-19f88d95a5b3 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:49.480856 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-69444b40-0256-44d7-9dc1-19f88d95a5b3 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:49.481299 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-69444b40-0256-44d7-9dc1-19f88d95a5b3 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:49.482016 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-69444b40-0256-44d7-9dc1-19f88d95a5b3 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:49.482479 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-69444b40-0256-44d7-9dc1-19f88d95a5b3 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:49.482909 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-69444b40-0256-44d7-9dc1-19f88d95a5b3 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:49.609881 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-69444b40-0256-44d7-9dc1-19f88d95a5b3 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:09:49.617705 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-69444b40-0256-44d7-9dc1-19f88d95a5b3 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 200 len: 1519 microversion: 2.1 time: 0.148952 Oct 23 02:09:49.618311 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3732/7368] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:09:49 2022] GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:09:50.641148 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ffef482f-4526-4adc-95d5-a52a259389cc tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:50.641782 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ffef482f-4526-4adc-95d5-a52a259389cc tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:09:50.648705 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ffef482f-4526-4adc-95d5-a52a259389cc tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:50.657223 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ffef482f-4526-4adc-95d5-a52a259389cc tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:50.657223 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ffef482f-4526-4adc-95d5-a52a259389cc tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:50.657223 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ffef482f-4526-4adc-95d5-a52a259389cc tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:50.657223 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ffef482f-4526-4adc-95d5-a52a259389cc tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:50.657223 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ffef482f-4526-4adc-95d5-a52a259389cc tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:50.782269 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ffef482f-4526-4adc-95d5-a52a259389cc tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:09:50.789968 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ffef482f-4526-4adc-95d5-a52a259389cc tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 200 len: 1519 microversion: 2.1 time: 0.153322 Oct 23 02:09:50.790561 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3637/7369] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:09:50 2022] GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:09:51.813124 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-adf3d9e3-eea7-4001-9567-80ccb2f1d0eb tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:51.813667 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-adf3d9e3-eea7-4001-9567-80ccb2f1d0eb tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:09:51.819773 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-adf3d9e3-eea7-4001-9567-80ccb2f1d0eb tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:51.820263 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-adf3d9e3-eea7-4001-9567-80ccb2f1d0eb tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:51.820706 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-adf3d9e3-eea7-4001-9567-80ccb2f1d0eb tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:51.821396 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-adf3d9e3-eea7-4001-9567-80ccb2f1d0eb tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:51.821858 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-adf3d9e3-eea7-4001-9567-80ccb2f1d0eb tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:51.822341 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-adf3d9e3-eea7-4001-9567-80ccb2f1d0eb tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:51.950174 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-adf3d9e3-eea7-4001-9567-80ccb2f1d0eb tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:09:51.957983 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-adf3d9e3-eea7-4001-9567-80ccb2f1d0eb tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 200 len: 1519 microversion: 2.1 time: 0.149228 Oct 23 02:09:51.958585 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3733/7370] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:09:51 2022] GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:09:52.982304 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-70d9922f-39d5-490f-b043-809e21ae48d4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:52.982943 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-70d9922f-39d5-490f-b043-809e21ae48d4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:09:52.989458 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-70d9922f-39d5-490f-b043-809e21ae48d4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:52.989956 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-70d9922f-39d5-490f-b043-809e21ae48d4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:52.990456 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-70d9922f-39d5-490f-b043-809e21ae48d4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:52.991148 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-70d9922f-39d5-490f-b043-809e21ae48d4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:52.991620 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-70d9922f-39d5-490f-b043-809e21ae48d4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:52.992069 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-70d9922f-39d5-490f-b043-809e21ae48d4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:53.124043 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-70d9922f-39d5-490f-b043-809e21ae48d4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:09:53.132407 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-70d9922f-39d5-490f-b043-809e21ae48d4 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 200 len: 1519 microversion: 2.1 time: 0.154424 Oct 23 02:09:53.132993 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3638/7371] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:09:52 2022] GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:09:54.155866 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5eaf42cd-a6b9-4faa-a066-abbb74acc0a2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:54.156543 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5eaf42cd-a6b9-4faa-a066-abbb74acc0a2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:09:54.163508 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5eaf42cd-a6b9-4faa-a066-abbb74acc0a2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:54.164003 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5eaf42cd-a6b9-4faa-a066-abbb74acc0a2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:54.164446 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5eaf42cd-a6b9-4faa-a066-abbb74acc0a2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:54.165141 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5eaf42cd-a6b9-4faa-a066-abbb74acc0a2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:54.165606 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5eaf42cd-a6b9-4faa-a066-abbb74acc0a2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:54.166062 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5eaf42cd-a6b9-4faa-a066-abbb74acc0a2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:54.291913 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5eaf42cd-a6b9-4faa-a066-abbb74acc0a2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:09:54.300178 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5eaf42cd-a6b9-4faa-a066-abbb74acc0a2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 200 len: 1519 microversion: 2.1 time: 0.148345 Oct 23 02:09:54.300761 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3734/7372] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:09:54 2022] GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 1519 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:09:55.324679 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f1fc3390-daeb-4fbe-abf7-dd26bccbaddf tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:55.325311 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f1fc3390-daeb-4fbe-abf7-dd26bccbaddf tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:09:55.332794 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f1fc3390-daeb-4fbe-abf7-dd26bccbaddf tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:55.333298 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f1fc3390-daeb-4fbe-abf7-dd26bccbaddf tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:55.333744 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f1fc3390-daeb-4fbe-abf7-dd26bccbaddf tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:55.334530 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f1fc3390-daeb-4fbe-abf7-dd26bccbaddf tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:55.334998 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f1fc3390-daeb-4fbe-abf7-dd26bccbaddf tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:55.335432 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f1fc3390-daeb-4fbe-abf7-dd26bccbaddf tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:55.468993 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f1fc3390-daeb-4fbe-abf7-dd26bccbaddf tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:09:55.477177 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f1fc3390-daeb-4fbe-abf7-dd26bccbaddf tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 200 len: 1519 microversion: 2.1 time: 0.156561 Oct 23 02:09:55.477758 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3639/7373] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:09:55 2022] GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:09:56.189999 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-0970b918-6174-4643-84f1-92db3501d6e3 req-7cc45813-bf9e-406b-93c3-595c2242cde3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23886b61-8e77-4e61-8f7a-2002df068452", "name": "network-vif-unplugged", "status": "completed", "tag": "59d07394-6684-4637-a9f9-b05abe3b6ba6"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:09:56.200307 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-0970b918-6174-4643-84f1-92db3501d6e3 req-7cc45813-bf9e-406b-93c3-595c2242cde3 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:56.200911 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-0970b918-6174-4643-84f1-92db3501d6e3 req-7cc45813-bf9e-406b-93c3-595c2242cde3 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:56.201352 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-0970b918-6174-4643-84f1-92db3501d6e3 req-7cc45813-bf9e-406b-93c3-595c2242cde3 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:56.214578 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-0970b918-6174-4643-84f1-92db3501d6e3 req-7cc45813-bf9e-406b-93c3-595c2242cde3 service nova] Creating event network-vif-unplugged:59d07394-6684-4637-a9f9-b05abe3b6ba6 for instance 23886b61-8e77-4e61-8f7a-2002df068452 on n-h1-master-1 Oct 23 02:09:56.220083 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [req-0970b918-6174-4643-84f1-92db3501d6e3 req-7cc45813-bf9e-406b-93c3-595c2242cde3 service nova] Instance 23886b61-8e77-4e61-8f7a-2002df068452 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120944) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 23 02:09:56.232327 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-0970b918-6174-4643-84f1-92db3501d6e3 req-7cc45813-bf9e-406b-93c3-595c2242cde3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105969 Oct 23 02:09:56.232961 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3735/7374] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:09:56.501564 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ba515d28-56fd-4e48-89cf-2d273c5922c2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:56.502230 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ba515d28-56fd-4e48-89cf-2d273c5922c2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:09:56.509193 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ba515d28-56fd-4e48-89cf-2d273c5922c2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:56.509659 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ba515d28-56fd-4e48-89cf-2d273c5922c2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:56.510149 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ba515d28-56fd-4e48-89cf-2d273c5922c2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:56.510863 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ba515d28-56fd-4e48-89cf-2d273c5922c2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:56.511340 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ba515d28-56fd-4e48-89cf-2d273c5922c2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:56.511819 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ba515d28-56fd-4e48-89cf-2d273c5922c2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:56.646129 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ba515d28-56fd-4e48-89cf-2d273c5922c2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:09:56.654071 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ba515d28-56fd-4e48-89cf-2d273c5922c2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 200 len: 1518 microversion: 2.1 time: 0.157095 Oct 23 02:09:56.659697 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3640/7375] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:09:56 2022] GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:09:57.679398 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3740259b-d361-44b6-b11b-8174edb16471 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:57.680033 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3740259b-d361-44b6-b11b-8174edb16471 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:09:57.686331 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3740259b-d361-44b6-b11b-8174edb16471 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:57.686822 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3740259b-d361-44b6-b11b-8174edb16471 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:57.687264 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3740259b-d361-44b6-b11b-8174edb16471 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:57.688458 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3740259b-d361-44b6-b11b-8174edb16471 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:57.688918 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3740259b-d361-44b6-b11b-8174edb16471 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:57.689346 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3740259b-d361-44b6-b11b-8174edb16471 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:57.818644 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3740259b-d361-44b6-b11b-8174edb16471 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:09:57.826427 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3740259b-d361-44b6-b11b-8174edb16471 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 200 len: 1516 microversion: 2.1 time: 0.152271 Oct 23 02:09:57.827005 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3736/7376] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:09:57 2022] GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:09:58.260840 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-cdc1add0-0bec-48eb-8dc6-060f3635d2a0 req-15a53a92-d98a-4278-a7c9-df61d90a3d0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23886b61-8e77-4e61-8f7a-2002df068452", "tag": "59d07394-6684-4637-a9f9-b05abe3b6ba6"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:09:58.271155 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-cdc1add0-0bec-48eb-8dc6-060f3635d2a0 req-15a53a92-d98a-4278-a7c9-df61d90a3d0e service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:58.271640 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-cdc1add0-0bec-48eb-8dc6-060f3635d2a0 req-15a53a92-d98a-4278-a7c9-df61d90a3d0e service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:58.272078 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-cdc1add0-0bec-48eb-8dc6-060f3635d2a0 req-15a53a92-d98a-4278-a7c9-df61d90a3d0e service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:58.283263 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-cdc1add0-0bec-48eb-8dc6-060f3635d2a0 req-15a53a92-d98a-4278-a7c9-df61d90a3d0e service nova] Creating event network-changed:59d07394-6684-4637-a9f9-b05abe3b6ba6 for instance 23886b61-8e77-4e61-8f7a-2002df068452 on n-h1-master-1 Oct 23 02:09:58.288647 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [req-cdc1add0-0bec-48eb-8dc6-060f3635d2a0 req-15a53a92-d98a-4278-a7c9-df61d90a3d0e service nova] Instance 23886b61-8e77-4e61-8f7a-2002df068452 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120945) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 23 02:09:58.299767 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-cdc1add0-0bec-48eb-8dc6-060f3635d2a0 req-15a53a92-d98a-4278-a7c9-df61d90a3d0e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042684 Oct 23 02:09:58.300341 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3641/7377] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:09:58.851194 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e09560b0-86bd-4c1c-8e18-e9c5098234be tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:58.851810 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e09560b0-86bd-4c1c-8e18-e9c5098234be tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:09:58.858773 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e09560b0-86bd-4c1c-8e18-e9c5098234be tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:58.859264 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e09560b0-86bd-4c1c-8e18-e9c5098234be tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:58.859703 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e09560b0-86bd-4c1c-8e18-e9c5098234be tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:58.860402 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e09560b0-86bd-4c1c-8e18-e9c5098234be tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:58.860855 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e09560b0-86bd-4c1c-8e18-e9c5098234be tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:58.861278 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e09560b0-86bd-4c1c-8e18-e9c5098234be tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:58.999508 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e09560b0-86bd-4c1c-8e18-e9c5098234be tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:09:59.008525 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e09560b0-86bd-4c1c-8e18-e9c5098234be tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 200 len: 1516 microversion: 2.1 time: 0.161196 Oct 23 02:09:59.011197 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3737/7378] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:09:58 2022] GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:10:00.034624 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-04580874-bf5d-4a42-80a6-e4470b406e45 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:10:00.035344 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-04580874-bf5d-4a42-80a6-e4470b406e45 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:10:00.041606 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-04580874-bf5d-4a42-80a6-e4470b406e45 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:00.042131 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-04580874-bf5d-4a42-80a6-e4470b406e45 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:00.042582 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-04580874-bf5d-4a42-80a6-e4470b406e45 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:00.043277 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-04580874-bf5d-4a42-80a6-e4470b406e45 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:00.043747 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-04580874-bf5d-4a42-80a6-e4470b406e45 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:00.044186 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-04580874-bf5d-4a42-80a6-e4470b406e45 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:00.170930 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-04580874-bf5d-4a42-80a6-e4470b406e45 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:10:00.179363 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-04580874-bf5d-4a42-80a6-e4470b406e45 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 200 len: 1513 microversion: 2.1 time: 0.150426 Oct 23 02:10:00.179943 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3642/7379] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:10:00 2022] GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:10:00.201718 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6cfd2ca3-aa25-4f15-851d-709212d33813 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:10:00.202259 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6cfd2ca3-aa25-4f15-851d-709212d33813 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:10:00.209270 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6cfd2ca3-aa25-4f15-851d-709212d33813 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:00.209760 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6cfd2ca3-aa25-4f15-851d-709212d33813 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:00.210236 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6cfd2ca3-aa25-4f15-851d-709212d33813 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:00.210932 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6cfd2ca3-aa25-4f15-851d-709212d33813 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:00.211390 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6cfd2ca3-aa25-4f15-851d-709212d33813 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:00.211818 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6cfd2ca3-aa25-4f15-851d-709212d33813 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:00.407558 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6cfd2ca3-aa25-4f15-851d-709212d33813 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "POST /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452/action" status: 204 len: 0 microversion: 2.1 time: 0.209063 Oct 23 02:10:00.408224 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3738/7380] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:10:00 2022] POST /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452/action => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 02:10:00.416258 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5b94ce18-b089-4f47-8569-d33cbf513e31 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:10:00.421848 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5b94ce18-b089-4f47-8569-d33cbf513e31 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:10:00.423297 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5b94ce18-b089-4f47-8569-d33cbf513e31 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:00.424040 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5b94ce18-b089-4f47-8569-d33cbf513e31 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:00.424489 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5b94ce18-b089-4f47-8569-d33cbf513e31 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:00.425201 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5b94ce18-b089-4f47-8569-d33cbf513e31 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:00.425671 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5b94ce18-b089-4f47-8569-d33cbf513e31 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:00.426138 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5b94ce18-b089-4f47-8569-d33cbf513e31 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:00.559231 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5b94ce18-b089-4f47-8569-d33cbf513e31 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:10:00.567128 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5b94ce18-b089-4f47-8569-d33cbf513e31 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 200 len: 1513 microversion: 2.1 time: 0.154699 Oct 23 02:10:00.567836 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3643/7381] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:10:00 2022] GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:10:01.592679 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-59a1f5dd-841c-4c95-8a70-8af95cb8745b tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:10:01.593392 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-59a1f5dd-841c-4c95-8a70-8af95cb8745b tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:10:01.600268 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-59a1f5dd-841c-4c95-8a70-8af95cb8745b tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:01.600767 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-59a1f5dd-841c-4c95-8a70-8af95cb8745b tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:01.601210 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-59a1f5dd-841c-4c95-8a70-8af95cb8745b tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:01.601927 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-59a1f5dd-841c-4c95-8a70-8af95cb8745b tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:01.602470 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-59a1f5dd-841c-4c95-8a70-8af95cb8745b tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:01.602950 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-59a1f5dd-841c-4c95-8a70-8af95cb8745b tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:01.733002 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-59a1f5dd-841c-4c95-8a70-8af95cb8745b tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:10:01.741591 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-59a1f5dd-841c-4c95-8a70-8af95cb8745b tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 200 len: 1513 microversion: 2.1 time: 0.154272 Oct 23 02:10:01.742126 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3739/7382] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:10:01 2022] GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:10:01.889141 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-077afc59-4f56-40ad-b585-ba7955f7d19d req-819f3036-97ab-40f5-aa3d-5643ca734b32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23886b61-8e77-4e61-8f7a-2002df068452", "name": "network-vif-plugged", "status": "completed", "tag": "59d07394-6684-4637-a9f9-b05abe3b6ba6"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:10:01.900957 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-077afc59-4f56-40ad-b585-ba7955f7d19d req-819f3036-97ab-40f5-aa3d-5643ca734b32 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:01.901466 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-077afc59-4f56-40ad-b585-ba7955f7d19d req-819f3036-97ab-40f5-aa3d-5643ca734b32 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:01.901912 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-077afc59-4f56-40ad-b585-ba7955f7d19d req-819f3036-97ab-40f5-aa3d-5643ca734b32 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:01.914646 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-077afc59-4f56-40ad-b585-ba7955f7d19d req-819f3036-97ab-40f5-aa3d-5643ca734b32 service nova] Creating event network-vif-plugged:59d07394-6684-4637-a9f9-b05abe3b6ba6 for instance 23886b61-8e77-4e61-8f7a-2002df068452 on n-h1-master-1 Oct 23 02:10:01.920047 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [req-077afc59-4f56-40ad-b585-ba7955f7d19d req-819f3036-97ab-40f5-aa3d-5643ca734b32 service nova] Instance 23886b61-8e77-4e61-8f7a-2002df068452 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120945) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 23 02:10:01.931448 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-077afc59-4f56-40ad-b585-ba7955f7d19d req-819f3036-97ab-40f5-aa3d-5643ca734b32 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046026 Oct 23 02:10:01.932064 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3644/7383] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:10:02.764667 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-36ca4492-51c0-47e9-a95a-435ae509a92e tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:10:02.765278 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-36ca4492-51c0-47e9-a95a-435ae509a92e tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:10:02.772234 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36ca4492-51c0-47e9-a95a-435ae509a92e tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:02.772713 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36ca4492-51c0-47e9-a95a-435ae509a92e tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:02.773141 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36ca4492-51c0-47e9-a95a-435ae509a92e tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:02.773822 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36ca4492-51c0-47e9-a95a-435ae509a92e tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:02.774302 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36ca4492-51c0-47e9-a95a-435ae509a92e tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:02.774722 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36ca4492-51c0-47e9-a95a-435ae509a92e tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:02.901780 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-36ca4492-51c0-47e9-a95a-435ae509a92e tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:10:02.910283 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-36ca4492-51c0-47e9-a95a-435ae509a92e tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 200 len: 1505 microversion: 2.1 time: 0.149460 Oct 23 02:10:02.910855 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3740/7384] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:10:02 2022] GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:10:02.934189 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2bf8bfd7-16fd-4ca6-8dfc-dbfec8c64907 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:10:02.934912 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2bf8bfd7-16fd-4ca6-8dfc-dbfec8c64907 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:10:02.942130 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2bf8bfd7-16fd-4ca6-8dfc-dbfec8c64907 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:02.942632 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2bf8bfd7-16fd-4ca6-8dfc-dbfec8c64907 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:02.943082 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2bf8bfd7-16fd-4ca6-8dfc-dbfec8c64907 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:02.943785 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2bf8bfd7-16fd-4ca6-8dfc-dbfec8c64907 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:02.944255 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2bf8bfd7-16fd-4ca6-8dfc-dbfec8c64907 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:02.944693 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2bf8bfd7-16fd-4ca6-8dfc-dbfec8c64907 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:03.074820 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2bf8bfd7-16fd-4ca6-8dfc-dbfec8c64907 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:10:03.082708 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2bf8bfd7-16fd-4ca6-8dfc-dbfec8c64907 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 200 len: 1505 microversion: 2.1 time: 0.152796 Oct 23 02:10:03.083290 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3645/7385] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:10:02 2022] GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:10:03.105514 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d71cf0fa-ddab-47a5-b34e-347f48a27b50 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:10:03.106157 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d71cf0fa-ddab-47a5-b34e-347f48a27b50 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:10:03.112796 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d71cf0fa-ddab-47a5-b34e-347f48a27b50 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:03.113286 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d71cf0fa-ddab-47a5-b34e-347f48a27b50 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:03.113727 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d71cf0fa-ddab-47a5-b34e-347f48a27b50 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:03.114455 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d71cf0fa-ddab-47a5-b34e-347f48a27b50 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:03.114915 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d71cf0fa-ddab-47a5-b34e-347f48a27b50 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:03.115346 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d71cf0fa-ddab-47a5-b34e-347f48a27b50 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:03.240326 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d71cf0fa-ddab-47a5-b34e-347f48a27b50 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:10:03.248204 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d71cf0fa-ddab-47a5-b34e-347f48a27b50 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 200 len: 1505 microversion: 2.1 time: 0.146650 Oct 23 02:10:03.248782 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3741/7386] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:10:03 2022] GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 1505 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:10:03.271071 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-796267d3-9adb-48ac-ab50-39f3ed523e1a tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:10:03.271586 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-796267d3-9adb-48ac-ab50-39f3ed523e1a tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:10:03.277520 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-796267d3-9adb-48ac-ab50-39f3ed523e1a tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:03.278033 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-796267d3-9adb-48ac-ab50-39f3ed523e1a tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:03.278477 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-796267d3-9adb-48ac-ab50-39f3ed523e1a tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:03.279192 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-796267d3-9adb-48ac-ab50-39f3ed523e1a tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:03.279655 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-796267d3-9adb-48ac-ab50-39f3ed523e1a tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:03.280088 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-796267d3-9adb-48ac-ab50-39f3ed523e1a tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:03.307260 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-796267d3-9adb-48ac-ab50-39f3ed523e1a tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 02:10:03.594096 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-796267d3-9adb-48ac-ab50-39f3ed523e1a tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "DELETE /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 204 len: 0 microversion: 2.1 time: 0.327061 Oct 23 02:10:03.594701 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3646/7387] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 02:10:03 2022] DELETE /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 02:10:03.612713 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ed4d814f-15cd-4843-9f8a-a61065d723ac tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:10:03.613216 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ed4d814f-15cd-4843-9f8a-a61065d723ac tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:10:03.619239 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ed4d814f-15cd-4843-9f8a-a61065d723ac tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:03.620658 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ed4d814f-15cd-4843-9f8a-a61065d723ac tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:03.620658 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ed4d814f-15cd-4843-9f8a-a61065d723ac tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:03.620869 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ed4d814f-15cd-4843-9f8a-a61065d723ac tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:03.621270 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ed4d814f-15cd-4843-9f8a-a61065d723ac tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:03.621696 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ed4d814f-15cd-4843-9f8a-a61065d723ac tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:03.647093 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ed4d814f-15cd-4843-9f8a-a61065d723ac tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 02:10:03.681145 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:10:03.774697 n-d-master-1 devstack@n-api.service[120944]: INFO nova.compute.api [None req-ed4d814f-15cd-4843-9f8a-a61065d723ac tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Instance is already in deleting state, ignoring this request Oct 23 02:10:03.775544 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ed4d814f-15cd-4843-9f8a-a61065d723ac tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "DELETE /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 204 len: 0 microversion: 2.1 time: 0.166717 Oct 23 02:10:03.776115 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3742/7388] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 02:10:03 2022] DELETE /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 02:10:03.784771 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-164f4686-3521-4bb2-82a0-f7c7169863af tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:10:03.785496 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-164f4686-3521-4bb2-82a0-f7c7169863af tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:10:03.791482 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-164f4686-3521-4bb2-82a0-f7c7169863af tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:03.791988 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-164f4686-3521-4bb2-82a0-f7c7169863af tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:03.795074 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-164f4686-3521-4bb2-82a0-f7c7169863af tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:03.795074 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-164f4686-3521-4bb2-82a0-f7c7169863af tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:03.795074 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-164f4686-3521-4bb2-82a0-f7c7169863af tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:03.795074 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-164f4686-3521-4bb2-82a0-f7c7169863af tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:03.925340 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-164f4686-3521-4bb2-82a0-f7c7169863af tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:10:03.933263 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-164f4686-3521-4bb2-82a0-f7c7169863af tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 200 len: 1511 microversion: 2.1 time: 0.152841 Oct 23 02:10:03.933838 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3647/7389] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:10:03 2022] GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 1511 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:10:04.957429 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ac8634b9-0608-46ab-87a4-d47da83d2556 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:10:04.958003 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ac8634b9-0608-46ab-87a4-d47da83d2556 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:10:04.966609 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac8634b9-0608-46ab-87a4-d47da83d2556 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:04.967094 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac8634b9-0608-46ab-87a4-d47da83d2556 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:04.967535 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac8634b9-0608-46ab-87a4-d47da83d2556 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:04.968217 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac8634b9-0608-46ab-87a4-d47da83d2556 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:04.968671 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac8634b9-0608-46ab-87a4-d47da83d2556 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:04.969095 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ac8634b9-0608-46ab-87a4-d47da83d2556 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:05.101318 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ac8634b9-0608-46ab-87a4-d47da83d2556 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:10:05.110592 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ac8634b9-0608-46ab-87a4-d47da83d2556 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 200 len: 1511 microversion: 2.1 time: 0.157631 Oct 23 02:10:05.111198 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3743/7390] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:10:04 2022] GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:10:05.800027 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-8bc894d4-af8d-48e7-8bb6-2f5cfbb22d41 req-6e600229-7677-4223-a2f5-fda3ffffc8c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23886b61-8e77-4e61-8f7a-2002df068452", "name": "network-vif-deleted", "tag": "59d07394-6684-4637-a9f9-b05abe3b6ba6"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:10:05.810467 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-8bc894d4-af8d-48e7-8bb6-2f5cfbb22d41 req-6e600229-7677-4223-a2f5-fda3ffffc8c7 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:05.811115 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-8bc894d4-af8d-48e7-8bb6-2f5cfbb22d41 req-6e600229-7677-4223-a2f5-fda3ffffc8c7 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:05.811571 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-8bc894d4-af8d-48e7-8bb6-2f5cfbb22d41 req-6e600229-7677-4223-a2f5-fda3ffffc8c7 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:05.823435 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-8bc894d4-af8d-48e7-8bb6-2f5cfbb22d41 req-6e600229-7677-4223-a2f5-fda3ffffc8c7 service nova] Creating event network-vif-deleted:59d07394-6684-4637-a9f9-b05abe3b6ba6 for instance 23886b61-8e77-4e61-8f7a-2002df068452 on n-h1-master-1 Oct 23 02:10:05.828309 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-8bc894d4-af8d-48e7-8bb6-2f5cfbb22d41 req-6e600229-7677-4223-a2f5-fda3ffffc8c7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032538 Oct 23 02:10:05.828893 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3648/7391] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:10:06.133795 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c21d9bea-d5d8-41d6-9718-ed8b7adec8c9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:10:06.134569 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c21d9bea-d5d8-41d6-9718-ed8b7adec8c9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:10:06.141922 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c21d9bea-d5d8-41d6-9718-ed8b7adec8c9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:06.142604 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c21d9bea-d5d8-41d6-9718-ed8b7adec8c9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:06.143111 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c21d9bea-d5d8-41d6-9718-ed8b7adec8c9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:06.143856 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c21d9bea-d5d8-41d6-9718-ed8b7adec8c9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:06.144493 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c21d9bea-d5d8-41d6-9718-ed8b7adec8c9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:06.144922 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c21d9bea-d5d8-41d6-9718-ed8b7adec8c9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:06.179880 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c21d9bea-d5d8-41d6-9718-ed8b7adec8c9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:06.180371 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c21d9bea-d5d8-41d6-9718-ed8b7adec8c9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:06.180802 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c21d9bea-d5d8-41d6-9718-ed8b7adec8c9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:06.181275 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-c21d9bea-d5d8-41d6-9718-ed8b7adec8c9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lazy-loading 'fault' on Instance uuid 23886b61-8e77-4e61-8f7a-2002df068452 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:10:06.227581 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c21d9bea-d5d8-41d6-9718-ed8b7adec8c9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae1f007536546b98ae09de345781a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6cc6175414fbcb1c0323ef3299901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:10:06.231723 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c21d9bea-d5d8-41d6-9718-ed8b7adec8c9 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 200 len: 1305 microversion: 2.1 time: 0.101807 Oct 23 02:10:06.232299 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3744/7392] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:10:06 2022] GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 1305 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:10:07.257664 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-46920f32-bed5-4c2b-8bc6-65ec2a34ddc2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:10:07.258417 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-46920f32-bed5-4c2b-8bc6-65ec2a34ddc2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 23886b61-8e77-4e61-8f7a-2002df068452] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:10:07.264702 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46920f32-bed5-4c2b-8bc6-65ec2a34ddc2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:07.265205 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46920f32-bed5-4c2b-8bc6-65ec2a34ddc2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:07.265654 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46920f32-bed5-4c2b-8bc6-65ec2a34ddc2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:07.266412 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46920f32-bed5-4c2b-8bc6-65ec2a34ddc2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:07.266879 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46920f32-bed5-4c2b-8bc6-65ec2a34ddc2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:07.267315 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-46920f32-bed5-4c2b-8bc6-65ec2a34ddc2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:07.280573 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-46920f32-bed5-4c2b-8bc6-65ec2a34ddc2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] HTTP exception thrown: Instance 23886b61-8e77-4e61-8f7a-2002df068452 could not be found. Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-46920f32-bed5-4c2b-8bc6-65ec2a34ddc2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Request method failure captured: Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 HTTP/1.1 Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVKIHX7JH9wHpym_qHwyS_pmg1XlS4V5vxoCejfJ8PR277t02Nu-MEmNqxoGxNydZxnuaOaj-Jj9s6Wyh8LlPiZOFv_fvSf65vBmqzaRkQqXrZ7d6qNDE_u-8hCSKM699rudukqqgh2POeUTfTDrvdQaTl3HyY1eqnz677nkxwtnotas Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: a7e6cc6175414fbcb1c0323ef3299901 Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1916946636 Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a7e6cc6175414fbcb1c0323ef3299901"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a7e6cc6175414fbcb1c0323ef3299901"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a7e6cc6175414fbcb1c0323ef3299901"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a7e6cc6175414fbcb1c0323ef3299901"}]}] Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServerDiskConfigTestJSON-1916946636 Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: a7e6cc6175414fbcb1c0323ef3299901 Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1916946636 Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServerDiskConfigTestJSON-1916946636-project Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: bae1f007536546b98ae09de345781a0a Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServerDiskConfigTestJSON-1916946636-project Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 23886b61-8e77-4e61-8f7a-2002df068452 could not be found. Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '23886b61-8e77-4e61-8f7a-2002df068452'} Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23886b61-8e77-4e61-8f7a-2002df068452 could not be found. Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23886b61-8e77-4e61-8f7a-2002df068452 could not be found. Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:10:07.282249 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:10:07.287459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:10:07.287459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:10:07.287459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:10:07.287459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:10:07.287459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:10:07.287459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23886b61-8e77-4e61-8f7a-2002df068452 could not be found. Oct 23 02:10:07.287459 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:10:07.287459 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-46920f32-bed5-4c2b-8bc6-65ec2a34ddc2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Returning 404 to user: Instance 23886b61-8e77-4e61-8f7a-2002df068452 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:10:07.287459 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-46920f32-bed5-4c2b-8bc6-65ec2a34ddc2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452" status: 404 len: 111 microversion: 2.1 time: 0.031879 Oct 23 02:10:07.287459 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3649/7393] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:10:07 2022] GET /compute/v2.1/servers/23886b61-8e77-4e61-8f7a-2002df068452 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:10:07.292430 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-90762af1-cbe2-490e-ab95-3dc8d3aeac8a tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '.version_select at 0x7f5cc10e3e50>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:10:07.397226 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-90762af1-cbe2-490e-ab95-3dc8d3aeac8a tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1474729520" status: 202 len: 0 microversion: 2.1 time: 0.108620 Oct 23 02:10:07.397834 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3745/7394] 10.222.0.42 () {58 vars in 1221 bytes} [Sun Oct 23 02:10:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1474729520 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:10:08.120859 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cbd82ff2-c9ca-4be5-b681-f1c8a7e0e985 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:10:08.121386 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cbd82ff2-c9ca-4be5-b681-f1c8a7e0e985 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:10:08.128033 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cbd82ff2-c9ca-4be5-b681-f1c8a7e0e985 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:08.128528 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cbd82ff2-c9ca-4be5-b681-f1c8a7e0e985 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:08.128977 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cbd82ff2-c9ca-4be5-b681-f1c8a7e0e985 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:08.129680 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cbd82ff2-c9ca-4be5-b681-f1c8a7e0e985 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:08.130184 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cbd82ff2-c9ca-4be5-b681-f1c8a7e0e985 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:08.130649 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cbd82ff2-c9ca-4be5-b681-f1c8a7e0e985 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:08.133540 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:10:08.145847 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-cbd82ff2-c9ca-4be5-b681-f1c8a7e0e985 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] HTTP exception thrown: Instance 0285026a-b7a9-45f2-a63b-5a25f044b278 could not be found. Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cbd82ff2-c9ca-4be5-b681-f1c8a7e0e985 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Request method failure captured: Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 HTTP/1.1 Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVKIHX7JH9wHpym_qHwyS_pmg1XlS4V5vxoCejfJ8PR277t02Nu-MEmNqxoGxNydZxnuaOaj-Jj9s6Wyh8LlPiZOFv_fvSf65vBmqzaRkQqXrZ7d6qNDE_u-8hCSKM699rudukqqgh2POeUTfTDrvdQaTl3HyY1eqnz677nkxwtnotas Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: a7e6cc6175414fbcb1c0323ef3299901 Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1916946636 Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a7e6cc6175414fbcb1c0323ef3299901"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a7e6cc6175414fbcb1c0323ef3299901"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a7e6cc6175414fbcb1c0323ef3299901"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a7e6cc6175414fbcb1c0323ef3299901"}]}] Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServerDiskConfigTestJSON-1916946636 Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: a7e6cc6175414fbcb1c0323ef3299901 Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1916946636 Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServerDiskConfigTestJSON-1916946636-project Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: bae1f007536546b98ae09de345781a0a Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServerDiskConfigTestJSON-1916946636-project Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 0285026a-b7a9-45f2-a63b-5a25f044b278 could not be found. Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '0285026a-b7a9-45f2-a63b-5a25f044b278'} Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0285026a-b7a9-45f2-a63b-5a25f044b278 could not be found. Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:10:08.147444 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:10:08.151987 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0285026a-b7a9-45f2-a63b-5a25f044b278 could not be found. Oct 23 02:10:08.151987 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:10:08.151987 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:10:08.151987 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:10:08.151987 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:10:08.151987 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:10:08.151987 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:10:08.151987 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:10:08.151987 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:10:08.151987 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0285026a-b7a9-45f2-a63b-5a25f044b278 could not be found. Oct 23 02:10:08.151987 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:10:08.151987 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cbd82ff2-c9ca-4be5-b681-f1c8a7e0e985 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Returning 404 to user: Instance 0285026a-b7a9-45f2-a63b-5a25f044b278 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:10:08.151987 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cbd82ff2-c9ca-4be5-b681-f1c8a7e0e985 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 404 len: 111 microversion: 2.1 time: 0.032078 Oct 23 02:10:08.151987 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3650/7395] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 02:10:08 2022] DELETE /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:10:08.157574 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-822a7fdf-6ce2-4afa-a167-5e15f2c508a2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:10:08.158246 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-822a7fdf-6ce2-4afa-a167-5e15f2c508a2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] [instance: 0285026a-b7a9-45f2-a63b-5a25f044b278] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:10:08.165061 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-822a7fdf-6ce2-4afa-a167-5e15f2c508a2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:08.165556 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-822a7fdf-6ce2-4afa-a167-5e15f2c508a2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:08.168568 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-822a7fdf-6ce2-4afa-a167-5e15f2c508a2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:08.168568 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-822a7fdf-6ce2-4afa-a167-5e15f2c508a2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:08.168568 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-822a7fdf-6ce2-4afa-a167-5e15f2c508a2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:08.168568 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-822a7fdf-6ce2-4afa-a167-5e15f2c508a2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:08.180840 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-822a7fdf-6ce2-4afa-a167-5e15f2c508a2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] HTTP exception thrown: Instance 0285026a-b7a9-45f2-a63b-5a25f044b278 could not be found. Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-822a7fdf-6ce2-4afa-a167-5e15f2c508a2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Request method failure captured: Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 HTTP/1.1 Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVKIHX7JH9wHpym_qHwyS_pmg1XlS4V5vxoCejfJ8PR277t02Nu-MEmNqxoGxNydZxnuaOaj-Jj9s6Wyh8LlPiZOFv_fvSf65vBmqzaRkQqXrZ7d6qNDE_u-8hCSKM699rudukqqgh2POeUTfTDrvdQaTl3HyY1eqnz677nkxwtnotas Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: a7e6cc6175414fbcb1c0323ef3299901 Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1916946636 Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a7e6cc6175414fbcb1c0323ef3299901"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a7e6cc6175414fbcb1c0323ef3299901"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a7e6cc6175414fbcb1c0323ef3299901"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a7e6cc6175414fbcb1c0323ef3299901"}]}] Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServerDiskConfigTestJSON-1916946636 Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: a7e6cc6175414fbcb1c0323ef3299901 Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1916946636 Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServerDiskConfigTestJSON-1916946636-project Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: bae1f007536546b98ae09de345781a0a Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServerDiskConfigTestJSON-1916946636-project Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 0285026a-b7a9-45f2-a63b-5a25f044b278 could not be found. Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '0285026a-b7a9-45f2-a63b-5a25f044b278'} Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0285026a-b7a9-45f2-a63b-5a25f044b278 could not be found. Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0285026a-b7a9-45f2-a63b-5a25f044b278 could not be found. Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:10:08.182522 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:10:08.187384 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:10:08.187384 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:10:08.187384 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:10:08.187384 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:10:08.187384 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:10:08.187384 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0285026a-b7a9-45f2-a63b-5a25f044b278 could not be found. Oct 23 02:10:08.187384 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:10:08.187384 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-822a7fdf-6ce2-4afa-a167-5e15f2c508a2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] Returning 404 to user: Instance 0285026a-b7a9-45f2-a63b-5a25f044b278 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:10:08.187384 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-822a7fdf-6ce2-4afa-a167-5e15f2c508a2 tempest-ServerDiskConfigTestJSON-1916946636 tempest-ServerDiskConfigTestJSON-1916946636-project] 10.222.0.42 "GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278" status: 404 len: 111 microversion: 2.1 time: 0.030332 Oct 23 02:10:08.187384 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3746/7396] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:10:08 2022] GET /compute/v2.1/servers/0285026a-b7a9-45f2-a63b-5a25f044b278 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:10:19.116746 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:10:19.229647 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cb2eec02-1286-4600-84d1-10339f9d95f8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Action: 'create', calling method: .version_select at 0x7f5cc1689dc0>, body: {"keypair": {"name": "tempest-keypair-1840206196", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGi+oWClbzsykUfoLNDvAwqJiAXjDD9NRdeSAJtl+P/hzSclI3ZCSosvP22uWty9SqHZ+ULdfc90AEXpo2LCRqSff+Wn4uoz1ouAa9QgggaCpvPxuESQCiWPQgoTQpaIiA=="}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:10:19.249529 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-cb2eec02-1286-4600-84d1-10339f9d95f8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Getting quotas for project 03ca20e778cf488baea3d1e0505cd492. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:10:19.257003 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-cb2eec02-1286-4600-84d1-10339f9d95f8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Getting quotas for user 8d11ce8077ca4566ba823eac0882c34f and project 03ca20e778cf488baea3d1e0505cd492. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:10:19.364254 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cb2eec02-1286-4600-84d1-10339f9d95f8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.253609 Oct 23 02:10:19.365125 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3651/7397] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 02:10:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:10:21.657241 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-007641a5-5c9f-467d-806f-d6bbf24c9d63 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-77172990", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f26ee581-835e-4450-9de2-8238925be6fc"}], "security_groups": [{"name": "tempest-securitygroup--633118967"}], "key_name": "tempest-keypair-1840206196", "user_data": "}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:10:21.666687 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:10:21.667369 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=18 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:10:21.768590 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-007641a5-5c9f-467d-806f-d6bbf24c9d63 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] validate_networks() for [('f26ee581-835e-4450-9de2-8238925be6fc', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 02:10:22.242098 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-007641a5-5c9f-467d-806f-d6bbf24c9d63 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:10:22.242531 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-007641a5-5c9f-467d-806f-d6bbf24c9d63 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:10:22.243014 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-007641a5-5c9f-467d-806f-d6bbf24c9d63 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:10:22.243431 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-007641a5-5c9f-467d-806f-d6bbf24c9d63 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:10:22.243849 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-007641a5-5c9f-467d-806f-d6bbf24c9d63 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:10:22.259343 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-007641a5-5c9f-467d-806f-d6bbf24c9d63 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:22.259835 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-007641a5-5c9f-467d-806f-d6bbf24c9d63 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:22.263996 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-007641a5-5c9f-467d-806f-d6bbf24c9d63 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:22.263996 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-007641a5-5c9f-467d-806f-d6bbf24c9d63 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:22.263996 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-007641a5-5c9f-467d-806f-d6bbf24c9d63 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:22.263996 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-007641a5-5c9f-467d-806f-d6bbf24c9d63 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:22.287217 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-007641a5-5c9f-467d-806f-d6bbf24c9d63 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Getting quotas for project 03ca20e778cf488baea3d1e0505cd492. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:10:22.292931 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-007641a5-5c9f-467d-806f-d6bbf24c9d63 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Getting quotas for user 8d11ce8077ca4566ba823eac0882c34f and project 03ca20e778cf488baea3d1e0505cd492. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:10:22.307032 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-007641a5-5c9f-467d-806f-d6bbf24c9d63 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 02:10:22.309429 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-007641a5-5c9f-467d-806f-d6bbf24c9d63 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 02:10:22.442823 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-007641a5-5c9f-467d-806f-d6bbf24c9d63 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.789929 Oct 23 02:10:22.443845 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3747/7398] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 02:10:21 2022] POST /compute/v2.1/servers => generated 408 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 02:10:22.457537 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-34334a93-aefb-49b6-9ebf-1f2f747494ad tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:10:22.458483 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-34334a93-aefb-49b6-9ebf-1f2f747494ad tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:10:22.526466 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-34334a93-aefb-49b6-9ebf-1f2f747494ad tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:10:22.534614 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-34334a93-aefb-49b6-9ebf-1f2f747494ad tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c" status: 200 len: 1237 microversion: 2.1 time: 0.083414 Oct 23 02:10:22.535773 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3652/7399] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:10:22 2022] GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c => generated 1237 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:10:23.558272 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b85f3557-a686-495e-af0c-f67f5b9c7f0c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:10:23.558908 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b85f3557-a686-495e-af0c-f67f5b9c7f0c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:10:23.565936 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b85f3557-a686-495e-af0c-f67f5b9c7f0c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:23.571172 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b85f3557-a686-495e-af0c-f67f5b9c7f0c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:23.571172 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b85f3557-a686-495e-af0c-f67f5b9c7f0c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:23.571172 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b85f3557-a686-495e-af0c-f67f5b9c7f0c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:23.571172 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b85f3557-a686-495e-af0c-f67f5b9c7f0c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:23.571172 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b85f3557-a686-495e-af0c-f67f5b9c7f0c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:23.632633 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b85f3557-a686-495e-af0c-f67f5b9c7f0c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:10:23.640323 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b85f3557-a686-495e-af0c-f67f5b9c7f0c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c" status: 200 len: 1241 microversion: 2.1 time: 0.086852 Oct 23 02:10:23.640896 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3748/7400] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:10:23 2022] GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c => generated 1241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:10:24.664912 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ff757136-9757-41c2-af5d-e08115ed6dfb tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:10:24.665471 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ff757136-9757-41c2-af5d-e08115ed6dfb tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:10:24.676279 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ff757136-9757-41c2-af5d-e08115ed6dfb tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:24.676788 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ff757136-9757-41c2-af5d-e08115ed6dfb tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:24.677246 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ff757136-9757-41c2-af5d-e08115ed6dfb tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:24.677958 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ff757136-9757-41c2-af5d-e08115ed6dfb tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:24.678454 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ff757136-9757-41c2-af5d-e08115ed6dfb tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:24.678921 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ff757136-9757-41c2-af5d-e08115ed6dfb tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:24.744606 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ff757136-9757-41c2-af5d-e08115ed6dfb tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:10:24.753104 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ff757136-9757-41c2-af5d-e08115ed6dfb tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c" status: 200 len: 1289 microversion: 2.1 time: 0.092276 Oct 23 02:10:24.755240 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3653/7401] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:10:24 2022] GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c => generated 1289 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:10:25.775866 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f705af38-f83d-42fc-816f-ac3a25b40796 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:10:25.776403 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f705af38-f83d-42fc-816f-ac3a25b40796 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:10:25.783946 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f705af38-f83d-42fc-816f-ac3a25b40796 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:25.784438 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f705af38-f83d-42fc-816f-ac3a25b40796 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:25.784881 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f705af38-f83d-42fc-816f-ac3a25b40796 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:25.785575 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f705af38-f83d-42fc-816f-ac3a25b40796 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:25.786068 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f705af38-f83d-42fc-816f-ac3a25b40796 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:25.786499 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f705af38-f83d-42fc-816f-ac3a25b40796 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:25.943204 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f705af38-f83d-42fc-816f-ac3a25b40796 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:10:25.951980 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f705af38-f83d-42fc-816f-ac3a25b40796 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c" status: 200 len: 1362 microversion: 2.1 time: 0.180052 Oct 23 02:10:25.952577 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3749/7402] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:10:25 2022] GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:10:26.833431 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-e7f942c3-9830-421b-8864-789d15969ec7 req-e4923528-236d-401e-bacb-296f12983ab4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "302c627e-0b1c-4b05-8e15-4c23a5d0587c", "tag": "6324d8aa-f264-4e44-b696-c9fa6b5fdd7f"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:10:26.846573 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-e7f942c3-9830-421b-8864-789d15969ec7 req-e4923528-236d-401e-bacb-296f12983ab4 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:26.847637 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-e7f942c3-9830-421b-8864-789d15969ec7 req-e4923528-236d-401e-bacb-296f12983ab4 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:26.847637 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-e7f942c3-9830-421b-8864-789d15969ec7 req-e4923528-236d-401e-bacb-296f12983ab4 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:26.858988 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-e7f942c3-9830-421b-8864-789d15969ec7 req-e4923528-236d-401e-bacb-296f12983ab4 service nova] Creating event network-changed:6324d8aa-f264-4e44-b696-c9fa6b5fdd7f for instance 302c627e-0b1c-4b05-8e15-4c23a5d0587c on n-h2-master-1 Oct 23 02:10:26.864565 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-e7f942c3-9830-421b-8864-789d15969ec7 req-e4923528-236d-401e-bacb-296f12983ab4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034937 Oct 23 02:10:26.865182 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3654/7403] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:10:26.976444 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2b7d9c5d-55de-494b-9721-1704d20cfa09 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:10:26.977077 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2b7d9c5d-55de-494b-9721-1704d20cfa09 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:10:26.984143 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2b7d9c5d-55de-494b-9721-1704d20cfa09 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:26.984641 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2b7d9c5d-55de-494b-9721-1704d20cfa09 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:26.985082 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2b7d9c5d-55de-494b-9721-1704d20cfa09 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:26.986475 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2b7d9c5d-55de-494b-9721-1704d20cfa09 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:26.986938 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2b7d9c5d-55de-494b-9721-1704d20cfa09 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:26.987370 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2b7d9c5d-55de-494b-9721-1704d20cfa09 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:27.120161 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2b7d9c5d-55de-494b-9721-1704d20cfa09 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:10:27.128251 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2b7d9c5d-55de-494b-9721-1704d20cfa09 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c" status: 200 len: 1362 microversion: 2.1 time: 0.155852 Oct 23 02:10:27.128835 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3750/7404] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:10:26 2022] GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:10:28.152900 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-69ae5998-a09a-4e65-a92d-8c3868d3eb96 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:10:28.153617 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-69ae5998-a09a-4e65-a92d-8c3868d3eb96 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:10:28.162276 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-69ae5998-a09a-4e65-a92d-8c3868d3eb96 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:28.162777 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-69ae5998-a09a-4e65-a92d-8c3868d3eb96 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:28.163221 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-69ae5998-a09a-4e65-a92d-8c3868d3eb96 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:28.163922 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-69ae5998-a09a-4e65-a92d-8c3868d3eb96 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:28.164388 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-69ae5998-a09a-4e65-a92d-8c3868d3eb96 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:28.164826 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-69ae5998-a09a-4e65-a92d-8c3868d3eb96 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:28.294113 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-69ae5998-a09a-4e65-a92d-8c3868d3eb96 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:10:28.302315 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-69ae5998-a09a-4e65-a92d-8c3868d3eb96 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c" status: 200 len: 1362 microversion: 2.1 time: 0.154539 Oct 23 02:10:28.302898 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3655/7405] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:10:28 2022] GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:10:29.325616 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7d7dedd1-ef13-423a-8818-9a4d7bb8839a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:10:29.326266 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7d7dedd1-ef13-423a-8818-9a4d7bb8839a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:10:29.333208 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d7dedd1-ef13-423a-8818-9a4d7bb8839a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:29.333715 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d7dedd1-ef13-423a-8818-9a4d7bb8839a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:29.334180 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d7dedd1-ef13-423a-8818-9a4d7bb8839a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:29.334881 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d7dedd1-ef13-423a-8818-9a4d7bb8839a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:29.335335 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d7dedd1-ef13-423a-8818-9a4d7bb8839a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:29.335768 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d7dedd1-ef13-423a-8818-9a4d7bb8839a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:29.465732 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7d7dedd1-ef13-423a-8818-9a4d7bb8839a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:10:29.474301 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7d7dedd1-ef13-423a-8818-9a4d7bb8839a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c" status: 200 len: 1362 microversion: 2.1 time: 0.152528 Oct 23 02:10:29.474988 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3751/7406] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:10:29 2022] GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:10:30.497863 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f00782f8-34c3-4918-97ac-24c2b12a6e11 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:10:30.498621 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f00782f8-34c3-4918-97ac-24c2b12a6e11 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:10:30.506339 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f00782f8-34c3-4918-97ac-24c2b12a6e11 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:30.506833 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f00782f8-34c3-4918-97ac-24c2b12a6e11 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:30.507281 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f00782f8-34c3-4918-97ac-24c2b12a6e11 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:30.508012 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f00782f8-34c3-4918-97ac-24c2b12a6e11 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:30.508457 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f00782f8-34c3-4918-97ac-24c2b12a6e11 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:30.508889 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f00782f8-34c3-4918-97ac-24c2b12a6e11 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:30.639692 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f00782f8-34c3-4918-97ac-24c2b12a6e11 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:10:30.647399 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f00782f8-34c3-4918-97ac-24c2b12a6e11 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c" status: 200 len: 1362 microversion: 2.1 time: 0.153395 Oct 23 02:10:30.647984 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3656/7407] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:10:30 2022] GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:10:31.671073 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ec2ad500-9352-4a08-8604-56bca196712a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:10:31.671672 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ec2ad500-9352-4a08-8604-56bca196712a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:10:31.678485 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ec2ad500-9352-4a08-8604-56bca196712a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:31.678974 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ec2ad500-9352-4a08-8604-56bca196712a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:31.679406 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ec2ad500-9352-4a08-8604-56bca196712a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:31.680087 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ec2ad500-9352-4a08-8604-56bca196712a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:31.680537 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ec2ad500-9352-4a08-8604-56bca196712a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:31.680958 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ec2ad500-9352-4a08-8604-56bca196712a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:31.809795 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ec2ad500-9352-4a08-8604-56bca196712a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:10:31.818330 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ec2ad500-9352-4a08-8604-56bca196712a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c" status: 200 len: 1362 microversion: 2.1 time: 0.151098 Oct 23 02:10:31.819101 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3752/7408] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:10:31 2022] GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:10:32.841037 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2249d081-c4b9-4736-af1e-02760a55d221 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:10:32.841660 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2249d081-c4b9-4736-af1e-02760a55d221 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:10:32.844503 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=6 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:10:32.849542 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2249d081-c4b9-4736-af1e-02760a55d221 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:32.850075 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2249d081-c4b9-4736-af1e-02760a55d221 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:32.850522 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2249d081-c4b9-4736-af1e-02760a55d221 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:32.851221 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2249d081-c4b9-4736-af1e-02760a55d221 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:32.851682 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2249d081-c4b9-4736-af1e-02760a55d221 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:32.855391 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2249d081-c4b9-4736-af1e-02760a55d221 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:32.984365 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2249d081-c4b9-4736-af1e-02760a55d221 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:10:32.992059 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2249d081-c4b9-4736-af1e-02760a55d221 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c" status: 200 len: 1362 microversion: 2.1 time: 0.155208 Oct 23 02:10:32.992625 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3657/7409] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:10:32 2022] GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:10:34.015343 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1f1a883d-0303-4c0a-9141-8175b8c5e807 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:10:34.018079 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1f1a883d-0303-4c0a-9141-8175b8c5e807 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:10:34.018079 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:10:34.018555 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=6 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:10:34.024149 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f1a883d-0303-4c0a-9141-8175b8c5e807 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:34.024635 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f1a883d-0303-4c0a-9141-8175b8c5e807 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:34.025071 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f1a883d-0303-4c0a-9141-8175b8c5e807 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:34.025765 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f1a883d-0303-4c0a-9141-8175b8c5e807 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:34.026246 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f1a883d-0303-4c0a-9141-8175b8c5e807 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:34.026672 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f1a883d-0303-4c0a-9141-8175b8c5e807 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:34.042297 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-134fc26a-661d-42f2-bf80-1f6e3abca16c req-1fdf6d36-9d4b-4387-9565-67853cd3d4a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "302c627e-0b1c-4b05-8e15-4c23a5d0587c", "name": "network-vif-plugged", "status": "completed", "tag": "6324d8aa-f264-4e44-b696-c9fa6b5fdd7f"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:10:34.054228 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-134fc26a-661d-42f2-bf80-1f6e3abca16c req-1fdf6d36-9d4b-4387-9565-67853cd3d4a1 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:34.054732 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-134fc26a-661d-42f2-bf80-1f6e3abca16c req-1fdf6d36-9d4b-4387-9565-67853cd3d4a1 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:34.055184 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-134fc26a-661d-42f2-bf80-1f6e3abca16c req-1fdf6d36-9d4b-4387-9565-67853cd3d4a1 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:34.067223 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-134fc26a-661d-42f2-bf80-1f6e3abca16c req-1fdf6d36-9d4b-4387-9565-67853cd3d4a1 service nova] Creating event network-vif-plugged:6324d8aa-f264-4e44-b696-c9fa6b5fdd7f for instance 302c627e-0b1c-4b05-8e15-4c23a5d0587c on n-h2-master-1 Oct 23 02:10:34.072342 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-134fc26a-661d-42f2-bf80-1f6e3abca16c req-1fdf6d36-9d4b-4387-9565-67853cd3d4a1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034031 Oct 23 02:10:34.073314 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3658/7410] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:10:34.159428 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1f1a883d-0303-4c0a-9141-8175b8c5e807 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:10:34.167534 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1f1a883d-0303-4c0a-9141-8175b8c5e807 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c" status: 200 len: 1362 microversion: 2.1 time: 0.156070 Oct 23 02:10:34.168318 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3753/7411] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:10:34 2022] GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:10:35.192600 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9ebf99b0-1dff-425a-97f9-c70198d79c07 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:10:35.193264 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9ebf99b0-1dff-425a-97f9-c70198d79c07 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:10:35.199476 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9ebf99b0-1dff-425a-97f9-c70198d79c07 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:35.199978 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9ebf99b0-1dff-425a-97f9-c70198d79c07 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:35.200430 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9ebf99b0-1dff-425a-97f9-c70198d79c07 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:35.205021 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9ebf99b0-1dff-425a-97f9-c70198d79c07 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:35.205021 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9ebf99b0-1dff-425a-97f9-c70198d79c07 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:35.205021 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9ebf99b0-1dff-425a-97f9-c70198d79c07 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:35.337186 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9ebf99b0-1dff-425a-97f9-c70198d79c07 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:10:35.345333 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9ebf99b0-1dff-425a-97f9-c70198d79c07 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c" status: 200 len: 1362 microversion: 2.1 time: 0.158140 Oct 23 02:10:35.345915 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3659/7412] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:10:35 2022] GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:10:36.369057 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6d7945cb-81b4-46ba-a19b-325ac54dc552 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:10:36.369673 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6d7945cb-81b4-46ba-a19b-325ac54dc552 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:10:36.376665 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6d7945cb-81b4-46ba-a19b-325ac54dc552 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:36.377153 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6d7945cb-81b4-46ba-a19b-325ac54dc552 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:36.378232 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6d7945cb-81b4-46ba-a19b-325ac54dc552 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:36.378930 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6d7945cb-81b4-46ba-a19b-325ac54dc552 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:36.379394 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6d7945cb-81b4-46ba-a19b-325ac54dc552 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:36.379828 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6d7945cb-81b4-46ba-a19b-325ac54dc552 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:36.508428 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6d7945cb-81b4-46ba-a19b-325ac54dc552 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:10:36.516596 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6d7945cb-81b4-46ba-a19b-325ac54dc552 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c" status: 200 len: 1550 microversion: 2.1 time: 0.151088 Oct 23 02:10:36.516953 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3754/7413] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:10:36 2022] GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c => generated 1550 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:10:36.538518 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-54312827-3315-4c36-82c7-0ce9368a9a8b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:10:36.539034 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-54312827-3315-4c36-82c7-0ce9368a9a8b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:10:36.545870 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54312827-3315-4c36-82c7-0ce9368a9a8b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:36.546593 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54312827-3315-4c36-82c7-0ce9368a9a8b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:36.547073 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54312827-3315-4c36-82c7-0ce9368a9a8b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:36.547765 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54312827-3315-4c36-82c7-0ce9368a9a8b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:36.548238 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54312827-3315-4c36-82c7-0ce9368a9a8b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:36.548680 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54312827-3315-4c36-82c7-0ce9368a9a8b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:36.626757 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-54312827-3315-4c36-82c7-0ce9368a9a8b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092110 Oct 23 02:10:36.627403 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3660/7414] 10.222.0.42 () {58 vars in 1275 bytes} [Sun Oct 23 02:10:36 2022] GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:10:37.680268 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-087b5c15-2b48-43b2-a7fa-b2f56e827be6 req-6cd93822-a513-4a6c-aaf2-6de5637a9f9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "302c627e-0b1c-4b05-8e15-4c23a5d0587c", "tag": "6324d8aa-f264-4e44-b696-c9fa6b5fdd7f"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:10:37.690310 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-087b5c15-2b48-43b2-a7fa-b2f56e827be6 req-6cd93822-a513-4a6c-aaf2-6de5637a9f9b service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:37.690769 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-087b5c15-2b48-43b2-a7fa-b2f56e827be6 req-6cd93822-a513-4a6c-aaf2-6de5637a9f9b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:37.691203 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-087b5c15-2b48-43b2-a7fa-b2f56e827be6 req-6cd93822-a513-4a6c-aaf2-6de5637a9f9b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:37.702539 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-087b5c15-2b48-43b2-a7fa-b2f56e827be6 req-6cd93822-a513-4a6c-aaf2-6de5637a9f9b service nova] Creating event network-changed:6324d8aa-f264-4e44-b696-c9fa6b5fdd7f for instance 302c627e-0b1c-4b05-8e15-4c23a5d0587c on n-h2-master-1 Oct 23 02:10:37.708362 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-087b5c15-2b48-43b2-a7fa-b2f56e827be6 req-6cd93822-a513-4a6c-aaf2-6de5637a9f9b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087625 Oct 23 02:10:37.708976 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3755/7415] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:11:13.453740 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:13.454559 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=39 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:13.455544 n-d-master-1 devstack@n-api.service[120945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 23 02:11:13.455674 n-d-master-1 devstack@n-api.service[120945]: Sun Oct 23 02:11:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c (ip 10.222.0.42) !!! Oct 23 02:11:13.460410 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ddafa9f0-a2fa-4ff4-98ac-cc24bd3f13e5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:13.465759 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ddafa9f0-a2fa-4ff4-98ac-cc24bd3f13e5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:13.469647 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ddafa9f0-a2fa-4ff4-98ac-cc24bd3f13e5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:13.470206 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ddafa9f0-a2fa-4ff4-98ac-cc24bd3f13e5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:13.470665 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ddafa9f0-a2fa-4ff4-98ac-cc24bd3f13e5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:13.471387 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ddafa9f0-a2fa-4ff4-98ac-cc24bd3f13e5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:13.471864 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ddafa9f0-a2fa-4ff4-98ac-cc24bd3f13e5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:13.472452 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ddafa9f0-a2fa-4ff4-98ac-cc24bd3f13e5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:13.605967 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ddafa9f0-a2fa-4ff4-98ac-cc24bd3f13e5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:13.613736 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ddafa9f0-a2fa-4ff4-98ac-cc24bd3f13e5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c" status: 200 len: 1669 microversion: 2.1 time: 0.162122 Oct 23 02:11:13.614939 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3661/7416] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:13 2022] GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c => generated 1669 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:13.635464 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:13.637793 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=46 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:13.640899 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7781bd1e-1baf-4610-bdca-51fcb64c0c9a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:13.641602 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7781bd1e-1baf-4610-bdca-51fcb64c0c9a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:13.648387 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7781bd1e-1baf-4610-bdca-51fcb64c0c9a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:13.648872 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7781bd1e-1baf-4610-bdca-51fcb64c0c9a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:13.649307 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7781bd1e-1baf-4610-bdca-51fcb64c0c9a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:13.650001 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7781bd1e-1baf-4610-bdca-51fcb64c0c9a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:13.650465 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7781bd1e-1baf-4610-bdca-51fcb64c0c9a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:13.650890 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7781bd1e-1baf-4610-bdca-51fcb64c0c9a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:13.784025 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7781bd1e-1baf-4610-bdca-51fcb64c0c9a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:13.792400 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7781bd1e-1baf-4610-bdca-51fcb64c0c9a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c" status: 200 len: 1669 microversion: 2.1 time: 0.159231 Oct 23 02:11:13.792980 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3756/7417] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:13 2022] GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c => generated 1669 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:13.814773 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cb54d1ac-3766-4687-92d1-0a0e344b7848 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:13.815399 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cb54d1ac-3766-4687-92d1-0a0e344b7848 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:13.821668 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb54d1ac-3766-4687-92d1-0a0e344b7848 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:13.822267 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb54d1ac-3766-4687-92d1-0a0e344b7848 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:13.822766 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb54d1ac-3766-4687-92d1-0a0e344b7848 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:13.823473 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb54d1ac-3766-4687-92d1-0a0e344b7848 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:13.823934 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb54d1ac-3766-4687-92d1-0a0e344b7848 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:13.824379 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb54d1ac-3766-4687-92d1-0a0e344b7848 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:13.950271 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cb54d1ac-3766-4687-92d1-0a0e344b7848 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:13.958638 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cb54d1ac-3766-4687-92d1-0a0e344b7848 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c" status: 200 len: 1669 microversion: 2.1 time: 0.147667 Oct 23 02:11:13.959215 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3662/7418] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:13 2022] GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c => generated 1669 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:13.982171 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a1f59f0b-2d0c-40d4-8a07-793c18e29db7 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:11:13.984468 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a1f59f0b-2d0c-40d4-8a07-793c18e29db7 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:13.990405 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a1f59f0b-2d0c-40d4-8a07-793c18e29db7 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:13.990898 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a1f59f0b-2d0c-40d4-8a07-793c18e29db7 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:13.991337 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a1f59f0b-2d0c-40d4-8a07-793c18e29db7 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:13.992032 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a1f59f0b-2d0c-40d4-8a07-793c18e29db7 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:13.992491 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a1f59f0b-2d0c-40d4-8a07-793c18e29db7 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:13.992922 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a1f59f0b-2d0c-40d4-8a07-793c18e29db7 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:14.024075 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a1f59f0b-2d0c-40d4-8a07-793c18e29db7 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:14.029764 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a1f59f0b-2d0c-40d4-8a07-793c18e29db7 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Old instance type m1.heat2, new instance type m1.heat {{(pid=120944) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 23 02:11:14.036209 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-a1f59f0b-2d0c-40d4-8a07-793c18e29db7 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:11:14.036633 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-a1f59f0b-2d0c-40d4-8a07-793c18e29db7 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:11:14.037108 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-a1f59f0b-2d0c-40d4-8a07-793c18e29db7 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:11:14.037520 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-a1f59f0b-2d0c-40d4-8a07-793c18e29db7 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:11:14.037935 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-a1f59f0b-2d0c-40d4-8a07-793c18e29db7 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:11:14.198785 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a1f59f0b-2d0c-40d4-8a07-793c18e29db7 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "POST /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c/action" status: 202 len: 0 microversion: 2.1 time: 0.220732 Oct 23 02:11:14.199456 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3757/7419] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:11:13 2022] POST /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:11:14.207985 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-746c75e2-16ae-4cb5-8183-b2145d276dee tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:14.208652 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-746c75e2-16ae-4cb5-8183-b2145d276dee tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:14.215569 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-746c75e2-16ae-4cb5-8183-b2145d276dee tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:14.216221 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-746c75e2-16ae-4cb5-8183-b2145d276dee tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:14.216674 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-746c75e2-16ae-4cb5-8183-b2145d276dee tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:14.217389 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-746c75e2-16ae-4cb5-8183-b2145d276dee tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:14.217883 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-746c75e2-16ae-4cb5-8183-b2145d276dee tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:14.218365 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-746c75e2-16ae-4cb5-8183-b2145d276dee tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:14.350704 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-746c75e2-16ae-4cb5-8183-b2145d276dee tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:14.359375 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-746c75e2-16ae-4cb5-8183-b2145d276dee tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c" status: 200 len: 1678 microversion: 2.1 time: 0.155419 Oct 23 02:11:14.360909 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3663/7420] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:14 2022] GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:15.383953 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6b2adee8-899b-4025-a961-7307357d55af tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:15.384575 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6b2adee8-899b-4025-a961-7307357d55af tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:15.391695 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b2adee8-899b-4025-a961-7307357d55af tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:15.392624 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b2adee8-899b-4025-a961-7307357d55af tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:15.392624 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b2adee8-899b-4025-a961-7307357d55af tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:15.393304 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b2adee8-899b-4025-a961-7307357d55af tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:15.393769 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b2adee8-899b-4025-a961-7307357d55af tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:15.394281 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6b2adee8-899b-4025-a961-7307357d55af tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:15.523654 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6b2adee8-899b-4025-a961-7307357d55af tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:15.531672 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6b2adee8-899b-4025-a961-7307357d55af tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c" status: 200 len: 1678 microversion: 2.1 time: 0.152571 Oct 23 02:11:15.532251 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3758/7421] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:15 2022] GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:16.556503 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-49bc973a-4145-4a38-8eb9-e07ff4e10b4d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:16.557129 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-49bc973a-4145-4a38-8eb9-e07ff4e10b4d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:16.563912 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-49bc973a-4145-4a38-8eb9-e07ff4e10b4d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:16.564404 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-49bc973a-4145-4a38-8eb9-e07ff4e10b4d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:16.564851 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-49bc973a-4145-4a38-8eb9-e07ff4e10b4d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:16.565547 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-49bc973a-4145-4a38-8eb9-e07ff4e10b4d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:16.566041 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-49bc973a-4145-4a38-8eb9-e07ff4e10b4d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:16.566480 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-49bc973a-4145-4a38-8eb9-e07ff4e10b4d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:16.701355 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-49bc973a-4145-4a38-8eb9-e07ff4e10b4d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:16.709339 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-49bc973a-4145-4a38-8eb9-e07ff4e10b4d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c" status: 200 len: 1678 microversion: 2.1 time: 0.157339 Oct 23 02:11:16.709940 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3664/7422] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:16 2022] GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:17.734309 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2d553ede-42af-4ad5-a944-3237a65b7a96 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:17.734920 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2d553ede-42af-4ad5-a944-3237a65b7a96 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:17.743696 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2d553ede-42af-4ad5-a944-3237a65b7a96 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:17.744122 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2d553ede-42af-4ad5-a944-3237a65b7a96 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:17.744563 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2d553ede-42af-4ad5-a944-3237a65b7a96 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:17.745277 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2d553ede-42af-4ad5-a944-3237a65b7a96 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:17.745720 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2d553ede-42af-4ad5-a944-3237a65b7a96 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:17.746169 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2d553ede-42af-4ad5-a944-3237a65b7a96 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:17.878873 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2d553ede-42af-4ad5-a944-3237a65b7a96 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:17.886716 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2d553ede-42af-4ad5-a944-3237a65b7a96 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c" status: 200 len: 1683 microversion: 2.1 time: 0.156461 Oct 23 02:11:17.887302 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3759/7423] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:17 2022] GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:18.910409 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d5cca349-c1b0-4e1e-9004-3df4f1a35757 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:18.911034 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d5cca349-c1b0-4e1e-9004-3df4f1a35757 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:18.917736 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d5cca349-c1b0-4e1e-9004-3df4f1a35757 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:18.918262 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d5cca349-c1b0-4e1e-9004-3df4f1a35757 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:18.918710 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d5cca349-c1b0-4e1e-9004-3df4f1a35757 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:18.919406 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d5cca349-c1b0-4e1e-9004-3df4f1a35757 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:18.919871 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d5cca349-c1b0-4e1e-9004-3df4f1a35757 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:18.920304 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d5cca349-c1b0-4e1e-9004-3df4f1a35757 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:19.048436 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d5cca349-c1b0-4e1e-9004-3df4f1a35757 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:19.056536 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d5cca349-c1b0-4e1e-9004-3df4f1a35757 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c" status: 200 len: 1683 microversion: 2.1 time: 0.150146 Oct 23 02:11:19.057104 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3665/7424] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:18 2022] GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:20.080361 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bef4b101-e7c7-4b58-ad00-0d601e02952e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:20.080991 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bef4b101-e7c7-4b58-ad00-0d601e02952e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:20.088482 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bef4b101-e7c7-4b58-ad00-0d601e02952e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:20.089249 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bef4b101-e7c7-4b58-ad00-0d601e02952e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:20.089691 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bef4b101-e7c7-4b58-ad00-0d601e02952e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:20.090421 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bef4b101-e7c7-4b58-ad00-0d601e02952e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:20.090889 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bef4b101-e7c7-4b58-ad00-0d601e02952e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:20.091322 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bef4b101-e7c7-4b58-ad00-0d601e02952e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:20.222024 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bef4b101-e7c7-4b58-ad00-0d601e02952e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:20.229877 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bef4b101-e7c7-4b58-ad00-0d601e02952e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c" status: 200 len: 1683 microversion: 2.1 time: 0.153486 Oct 23 02:11:20.230483 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3760/7425] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:20 2022] GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:21.253057 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f226b7da-b78e-40cc-8b86-b4e0325a5d2c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:21.253682 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f226b7da-b78e-40cc-8b86-b4e0325a5d2c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:21.260488 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f226b7da-b78e-40cc-8b86-b4e0325a5d2c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:21.260979 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f226b7da-b78e-40cc-8b86-b4e0325a5d2c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:21.261450 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f226b7da-b78e-40cc-8b86-b4e0325a5d2c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:21.262177 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f226b7da-b78e-40cc-8b86-b4e0325a5d2c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:21.262670 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f226b7da-b78e-40cc-8b86-b4e0325a5d2c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:21.263104 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f226b7da-b78e-40cc-8b86-b4e0325a5d2c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:21.391233 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f226b7da-b78e-40cc-8b86-b4e0325a5d2c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:21.399537 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f226b7da-b78e-40cc-8b86-b4e0325a5d2c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c" status: 200 len: 1683 microversion: 2.1 time: 0.150426 Oct 23 02:11:21.400106 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3666/7426] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:21 2022] GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:22.423836 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4fca739f-3508-4c48-9d1f-dd06b921c118 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:22.424387 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4fca739f-3508-4c48-9d1f-dd06b921c118 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:22.431014 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4fca739f-3508-4c48-9d1f-dd06b921c118 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:22.431502 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4fca739f-3508-4c48-9d1f-dd06b921c118 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:22.431939 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4fca739f-3508-4c48-9d1f-dd06b921c118 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:22.432626 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4fca739f-3508-4c48-9d1f-dd06b921c118 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:22.433085 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4fca739f-3508-4c48-9d1f-dd06b921c118 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:22.433513 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4fca739f-3508-4c48-9d1f-dd06b921c118 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:22.564140 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4fca739f-3508-4c48-9d1f-dd06b921c118 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:22.571957 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4fca739f-3508-4c48-9d1f-dd06b921c118 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c" status: 200 len: 1683 microversion: 2.1 time: 0.152476 Oct 23 02:11:22.572533 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3761/7427] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:22 2022] GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:23.595470 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d86f29b2-c434-4f1b-8422-462ad8bbf2ce tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:23.596109 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d86f29b2-c434-4f1b-8422-462ad8bbf2ce tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:23.602425 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d86f29b2-c434-4f1b-8422-462ad8bbf2ce tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:23.602929 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d86f29b2-c434-4f1b-8422-462ad8bbf2ce tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:23.603380 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d86f29b2-c434-4f1b-8422-462ad8bbf2ce tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:23.604087 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d86f29b2-c434-4f1b-8422-462ad8bbf2ce tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:23.604559 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d86f29b2-c434-4f1b-8422-462ad8bbf2ce tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:23.605003 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d86f29b2-c434-4f1b-8422-462ad8bbf2ce tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:23.733170 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d86f29b2-c434-4f1b-8422-462ad8bbf2ce tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:23.741010 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d86f29b2-c434-4f1b-8422-462ad8bbf2ce tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c" status: 200 len: 1683 microversion: 2.1 time: 0.149554 Oct 23 02:11:23.742123 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3667/7428] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:23 2022] GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:24.764878 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cbd670ba-67ec-4365-b3b3-9b9add40e40b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:24.765440 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-cbd670ba-67ec-4365-b3b3-9b9add40e40b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:24.773447 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cbd670ba-67ec-4365-b3b3-9b9add40e40b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:24.773939 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cbd670ba-67ec-4365-b3b3-9b9add40e40b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:24.774433 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cbd670ba-67ec-4365-b3b3-9b9add40e40b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:24.775139 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cbd670ba-67ec-4365-b3b3-9b9add40e40b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:24.775593 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cbd670ba-67ec-4365-b3b3-9b9add40e40b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:24.776017 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cbd670ba-67ec-4365-b3b3-9b9add40e40b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:24.907293 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cbd670ba-67ec-4365-b3b3-9b9add40e40b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:24.915155 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cbd670ba-67ec-4365-b3b3-9b9add40e40b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c" status: 200 len: 1683 microversion: 2.1 time: 0.154346 Oct 23 02:11:24.915740 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3762/7429] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:24 2022] GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:25.939385 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ef8a856d-4a16-42ef-9df9-9e73e726189d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:25.940010 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ef8a856d-4a16-42ef-9df9-9e73e726189d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:25.948079 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef8a856d-4a16-42ef-9df9-9e73e726189d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:25.948574 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef8a856d-4a16-42ef-9df9-9e73e726189d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:25.949016 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef8a856d-4a16-42ef-9df9-9e73e726189d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:25.949708 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef8a856d-4a16-42ef-9df9-9e73e726189d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:25.950321 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef8a856d-4a16-42ef-9df9-9e73e726189d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:25.950756 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef8a856d-4a16-42ef-9df9-9e73e726189d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:26.080610 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ef8a856d-4a16-42ef-9df9-9e73e726189d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:26.089107 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ef8a856d-4a16-42ef-9df9-9e73e726189d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c" status: 200 len: 1683 microversion: 2.1 time: 0.153371 Oct 23 02:11:26.089689 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3668/7430] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:25 2022] GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:27.112391 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3d436ac3-c0d9-4cd7-8d70-e5aad88db200 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:27.113008 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3d436ac3-c0d9-4cd7-8d70-e5aad88db200 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:27.119772 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d436ac3-c0d9-4cd7-8d70-e5aad88db200 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:27.120259 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d436ac3-c0d9-4cd7-8d70-e5aad88db200 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:27.120704 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d436ac3-c0d9-4cd7-8d70-e5aad88db200 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:27.121390 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d436ac3-c0d9-4cd7-8d70-e5aad88db200 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:27.121849 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d436ac3-c0d9-4cd7-8d70-e5aad88db200 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:27.122310 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d436ac3-c0d9-4cd7-8d70-e5aad88db200 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:27.251663 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3d436ac3-c0d9-4cd7-8d70-e5aad88db200 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:27.259350 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3d436ac3-c0d9-4cd7-8d70-e5aad88db200 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c" status: 200 len: 1683 microversion: 2.1 time: 0.150862 Oct 23 02:11:27.259923 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3763/7431] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:27 2022] GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:28.283115 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-649e4aaf-c36f-4bf5-ae9f-a8a1f0ffce58 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:28.283762 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-649e4aaf-c36f-4bf5-ae9f-a8a1f0ffce58 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:28.291265 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-649e4aaf-c36f-4bf5-ae9f-a8a1f0ffce58 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:28.291768 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-649e4aaf-c36f-4bf5-ae9f-a8a1f0ffce58 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:28.292220 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-649e4aaf-c36f-4bf5-ae9f-a8a1f0ffce58 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:28.293015 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-649e4aaf-c36f-4bf5-ae9f-a8a1f0ffce58 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:28.293485 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-649e4aaf-c36f-4bf5-ae9f-a8a1f0ffce58 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:28.293954 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-649e4aaf-c36f-4bf5-ae9f-a8a1f0ffce58 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:28.427551 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-649e4aaf-c36f-4bf5-ae9f-a8a1f0ffce58 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:28.436008 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-649e4aaf-c36f-4bf5-ae9f-a8a1f0ffce58 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c" status: 200 len: 1683 microversion: 2.1 time: 0.156795 Oct 23 02:11:28.436585 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3669/7432] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:28 2022] GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:29.458988 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-20ce8cd4-986b-4585-a759-6a8e9d10fd9e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:29.459632 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-20ce8cd4-986b-4585-a759-6a8e9d10fd9e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:29.466761 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20ce8cd4-986b-4585-a759-6a8e9d10fd9e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:29.467256 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20ce8cd4-986b-4585-a759-6a8e9d10fd9e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:29.467697 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20ce8cd4-986b-4585-a759-6a8e9d10fd9e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:29.468400 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20ce8cd4-986b-4585-a759-6a8e9d10fd9e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:29.468864 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20ce8cd4-986b-4585-a759-6a8e9d10fd9e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:29.469296 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20ce8cd4-986b-4585-a759-6a8e9d10fd9e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:29.599294 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-20ce8cd4-986b-4585-a759-6a8e9d10fd9e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:29.607211 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-20ce8cd4-986b-4585-a759-6a8e9d10fd9e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c" status: 200 len: 1683 microversion: 2.1 time: 0.152194 Oct 23 02:11:29.607789 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3764/7433] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:29 2022] GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:30.631204 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-20c67d6a-88e7-4ff7-ba58-5715d54bd41c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:30.631839 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-20c67d6a-88e7-4ff7-ba58-5715d54bd41c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:30.638804 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-20c67d6a-88e7-4ff7-ba58-5715d54bd41c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:30.639304 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-20c67d6a-88e7-4ff7-ba58-5715d54bd41c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:30.639755 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-20c67d6a-88e7-4ff7-ba58-5715d54bd41c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:30.640461 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-20c67d6a-88e7-4ff7-ba58-5715d54bd41c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:30.640935 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-20c67d6a-88e7-4ff7-ba58-5715d54bd41c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:30.641377 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-20c67d6a-88e7-4ff7-ba58-5715d54bd41c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:30.771604 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-20c67d6a-88e7-4ff7-ba58-5715d54bd41c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:30.779307 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-20c67d6a-88e7-4ff7-ba58-5715d54bd41c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c" status: 200 len: 1683 microversion: 2.1 time: 0.152085 Oct 23 02:11:30.779886 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3670/7434] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:30 2022] GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:31.803104 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6a20fe16-61ac-436c-a719-17a6d8c41e96 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:31.804140 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6a20fe16-61ac-436c-a719-17a6d8c41e96 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:31.810918 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6a20fe16-61ac-436c-a719-17a6d8c41e96 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:31.811403 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6a20fe16-61ac-436c-a719-17a6d8c41e96 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:31.811842 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6a20fe16-61ac-436c-a719-17a6d8c41e96 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:31.812529 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6a20fe16-61ac-436c-a719-17a6d8c41e96 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:31.812986 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6a20fe16-61ac-436c-a719-17a6d8c41e96 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:31.813410 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6a20fe16-61ac-436c-a719-17a6d8c41e96 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:31.945194 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6a20fe16-61ac-436c-a719-17a6d8c41e96 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:31.953035 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6a20fe16-61ac-436c-a719-17a6d8c41e96 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c" status: 200 len: 1683 microversion: 2.1 time: 0.153907 Oct 23 02:11:31.953637 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3765/7435] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:31 2022] GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:32.976674 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8c940d10-f0fe-46e9-b7c9-7330f867d7e8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:32.977299 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8c940d10-f0fe-46e9-b7c9-7330f867d7e8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:32.984194 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8c940d10-f0fe-46e9-b7c9-7330f867d7e8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:32.984720 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8c940d10-f0fe-46e9-b7c9-7330f867d7e8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:32.985196 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8c940d10-f0fe-46e9-b7c9-7330f867d7e8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:32.985892 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8c940d10-f0fe-46e9-b7c9-7330f867d7e8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:32.986383 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8c940d10-f0fe-46e9-b7c9-7330f867d7e8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:32.986822 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8c940d10-f0fe-46e9-b7c9-7330f867d7e8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:33.114561 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8c940d10-f0fe-46e9-b7c9-7330f867d7e8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:33.122808 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8c940d10-f0fe-46e9-b7c9-7330f867d7e8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c" status: 200 len: 1683 microversion: 2.1 time: 0.150169 Oct 23 02:11:33.123379 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3671/7436] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:32 2022] GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:34.147437 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9e4637d4-5993-49af-8824-ddea71c1c177 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:34.148059 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9e4637d4-5993-49af-8824-ddea71c1c177 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:34.154909 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9e4637d4-5993-49af-8824-ddea71c1c177 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:34.155395 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9e4637d4-5993-49af-8824-ddea71c1c177 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:34.155846 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9e4637d4-5993-49af-8824-ddea71c1c177 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:34.156541 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9e4637d4-5993-49af-8824-ddea71c1c177 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:34.156994 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9e4637d4-5993-49af-8824-ddea71c1c177 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:34.157417 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9e4637d4-5993-49af-8824-ddea71c1c177 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:34.289814 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9e4637d4-5993-49af-8824-ddea71c1c177 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:34.297532 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9e4637d4-5993-49af-8824-ddea71c1c177 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c" status: 200 len: 1683 microversion: 2.1 time: 0.154065 Oct 23 02:11:34.298131 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3766/7437] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:34 2022] GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:35.321271 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-598e785c-dcac-4ad9-ba70-d0850a6ddbf8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:35.322018 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-598e785c-dcac-4ad9-ba70-d0850a6ddbf8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:35.329293 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-598e785c-dcac-4ad9-ba70-d0850a6ddbf8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:35.329792 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-598e785c-dcac-4ad9-ba70-d0850a6ddbf8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:35.330316 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-598e785c-dcac-4ad9-ba70-d0850a6ddbf8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:35.331051 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-598e785c-dcac-4ad9-ba70-d0850a6ddbf8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:35.331516 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-598e785c-dcac-4ad9-ba70-d0850a6ddbf8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:35.331949 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-598e785c-dcac-4ad9-ba70-d0850a6ddbf8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:35.462946 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-598e785c-dcac-4ad9-ba70-d0850a6ddbf8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:35.475232 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-598e785c-dcac-4ad9-ba70-d0850a6ddbf8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c" status: 200 len: 1682 microversion: 2.1 time: 0.158373 Oct 23 02:11:35.476095 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3672/7438] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:35 2022] GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:35.590583 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-b5dd6ad7-0513-4d10-a015-b05aeb7c525d req-6f752ef4-94c9-49c9-8e44-9441e09f2381 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "302c627e-0b1c-4b05-8e15-4c23a5d0587c", "name": "network-vif-unplugged", "status": "completed", "tag": "6324d8aa-f264-4e44-b696-c9fa6b5fdd7f"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:11:35.601678 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-b5dd6ad7-0513-4d10-a015-b05aeb7c525d req-6f752ef4-94c9-49c9-8e44-9441e09f2381 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:35.602193 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-b5dd6ad7-0513-4d10-a015-b05aeb7c525d req-6f752ef4-94c9-49c9-8e44-9441e09f2381 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:35.602617 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-b5dd6ad7-0513-4d10-a015-b05aeb7c525d req-6f752ef4-94c9-49c9-8e44-9441e09f2381 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:35.614123 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-b5dd6ad7-0513-4d10-a015-b05aeb7c525d req-6f752ef4-94c9-49c9-8e44-9441e09f2381 service nova] Creating event network-vif-unplugged:6324d8aa-f264-4e44-b696-c9fa6b5fdd7f for instance 302c627e-0b1c-4b05-8e15-4c23a5d0587c on n-h1-master-1 Oct 23 02:11:35.619282 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [req-b5dd6ad7-0513-4d10-a015-b05aeb7c525d req-6f752ef4-94c9-49c9-8e44-9441e09f2381 service nova] Instance 302c627e-0b1c-4b05-8e15-4c23a5d0587c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120944) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 23 02:11:35.630025 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-b5dd6ad7-0513-4d10-a015-b05aeb7c525d req-6f752ef4-94c9-49c9-8e44-9441e09f2381 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043607 Oct 23 02:11:35.630615 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3767/7439] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:11:36.500531 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-392862bc-a0cb-42bb-8bdb-6a0dc690790a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:36.501159 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-392862bc-a0cb-42bb-8bdb-6a0dc690790a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:36.508150 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-392862bc-a0cb-42bb-8bdb-6a0dc690790a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:36.508647 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-392862bc-a0cb-42bb-8bdb-6a0dc690790a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:36.509296 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-392862bc-a0cb-42bb-8bdb-6a0dc690790a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:36.510107 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-392862bc-a0cb-42bb-8bdb-6a0dc690790a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:36.510581 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-392862bc-a0cb-42bb-8bdb-6a0dc690790a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:36.511022 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-392862bc-a0cb-42bb-8bdb-6a0dc690790a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:36.646832 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-392862bc-a0cb-42bb-8bdb-6a0dc690790a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:36.654607 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-392862bc-a0cb-42bb-8bdb-6a0dc690790a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c" status: 200 len: 1682 microversion: 2.1 time: 0.158028 Oct 23 02:11:36.655192 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3673/7440] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:36 2022] GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:37.646493 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-b86c33b7-6192-4ed4-aed0-61f9664169c8 req-f34f5d91-00ef-4664-8735-bc5c4a522e83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "302c627e-0b1c-4b05-8e15-4c23a5d0587c", "tag": "6324d8aa-f264-4e44-b696-c9fa6b5fdd7f"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:11:37.656468 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-b86c33b7-6192-4ed4-aed0-61f9664169c8 req-f34f5d91-00ef-4664-8735-bc5c4a522e83 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:37.656946 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-b86c33b7-6192-4ed4-aed0-61f9664169c8 req-f34f5d91-00ef-4664-8735-bc5c4a522e83 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:37.657376 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-b86c33b7-6192-4ed4-aed0-61f9664169c8 req-f34f5d91-00ef-4664-8735-bc5c4a522e83 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:37.669351 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-b86c33b7-6192-4ed4-aed0-61f9664169c8 req-f34f5d91-00ef-4664-8735-bc5c4a522e83 service nova] Creating event network-changed:6324d8aa-f264-4e44-b696-c9fa6b5fdd7f for instance 302c627e-0b1c-4b05-8e15-4c23a5d0587c on n-h1-master-1 Oct 23 02:11:37.675087 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [req-b86c33b7-6192-4ed4-aed0-61f9664169c8 req-f34f5d91-00ef-4664-8735-bc5c4a522e83 service nova] Instance 302c627e-0b1c-4b05-8e15-4c23a5d0587c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120944) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 23 02:11:37.678916 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9fd28173-d4a9-44bb-8001-b3aaf9f8d5c8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:37.679685 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9fd28173-d4a9-44bb-8001-b3aaf9f8d5c8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:37.686454 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-b86c33b7-6192-4ed4-aed0-61f9664169c8 req-f34f5d91-00ef-4664-8735-bc5c4a522e83 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044888 Oct 23 02:11:37.687075 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3768/7441] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:11:37.687403 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9fd28173-d4a9-44bb-8001-b3aaf9f8d5c8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:37.688089 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9fd28173-d4a9-44bb-8001-b3aaf9f8d5c8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:37.688538 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9fd28173-d4a9-44bb-8001-b3aaf9f8d5c8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:37.689372 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9fd28173-d4a9-44bb-8001-b3aaf9f8d5c8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:37.689895 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9fd28173-d4a9-44bb-8001-b3aaf9f8d5c8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:37.690360 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9fd28173-d4a9-44bb-8001-b3aaf9f8d5c8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:38.092793 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9fd28173-d4a9-44bb-8001-b3aaf9f8d5c8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:38.100588 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9fd28173-d4a9-44bb-8001-b3aaf9f8d5c8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c" status: 200 len: 1680 microversion: 2.1 time: 0.425642 Oct 23 02:11:38.103444 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3674/7442] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:37 2022] GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c => generated 1680 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:39.126269 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1aa2700c-8a19-4a02-9b5e-842df281a214 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:39.126978 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1aa2700c-8a19-4a02-9b5e-842df281a214 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:39.134005 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1aa2700c-8a19-4a02-9b5e-842df281a214 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:39.136876 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1aa2700c-8a19-4a02-9b5e-842df281a214 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:39.136876 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1aa2700c-8a19-4a02-9b5e-842df281a214 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:39.136876 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1aa2700c-8a19-4a02-9b5e-842df281a214 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:39.136876 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1aa2700c-8a19-4a02-9b5e-842df281a214 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:39.136876 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1aa2700c-8a19-4a02-9b5e-842df281a214 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:39.266464 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1aa2700c-8a19-4a02-9b5e-842df281a214 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:39.274484 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1aa2700c-8a19-4a02-9b5e-842df281a214 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c" status: 200 len: 1677 microversion: 2.1 time: 0.153305 Oct 23 02:11:39.275167 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3769/7443] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:39 2022] GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:39.296999 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-61adab4a-a591-48f5-9851-e7f6f5adab34 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:11:39.297550 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-61adab4a-a591-48f5-9851-e7f6f5adab34 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:39.304825 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61adab4a-a591-48f5-9851-e7f6f5adab34 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:39.305321 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61adab4a-a591-48f5-9851-e7f6f5adab34 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:39.305770 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61adab4a-a591-48f5-9851-e7f6f5adab34 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:39.306508 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61adab4a-a591-48f5-9851-e7f6f5adab34 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:39.306974 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61adab4a-a591-48f5-9851-e7f6f5adab34 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:39.307412 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-61adab4a-a591-48f5-9851-e7f6f5adab34 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:39.497843 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-61adab4a-a591-48f5-9851-e7f6f5adab34 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "POST /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c/action" status: 204 len: 0 microversion: 2.1 time: 0.204468 Oct 23 02:11:39.498560 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3675/7444] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:11:39 2022] POST /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c/action => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 02:11:39.506716 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f7b2eca4-b6c0-490a-9f43-ce0da376ae96 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:39.508036 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f7b2eca4-b6c0-490a-9f43-ce0da376ae96 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:39.514723 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f7b2eca4-b6c0-490a-9f43-ce0da376ae96 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:39.515215 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f7b2eca4-b6c0-490a-9f43-ce0da376ae96 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:39.515649 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f7b2eca4-b6c0-490a-9f43-ce0da376ae96 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:39.516347 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f7b2eca4-b6c0-490a-9f43-ce0da376ae96 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:39.516805 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f7b2eca4-b6c0-490a-9f43-ce0da376ae96 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:39.517228 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f7b2eca4-b6c0-490a-9f43-ce0da376ae96 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:39.652079 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f7b2eca4-b6c0-490a-9f43-ce0da376ae96 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:39.660544 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f7b2eca4-b6c0-490a-9f43-ce0da376ae96 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c" status: 200 len: 1677 microversion: 2.1 time: 0.157785 Oct 23 02:11:39.661127 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3770/7445] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:39 2022] GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:40.687059 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-17eb632b-13ba-4fe8-b43a-14ab607bff03 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:40.687784 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-17eb632b-13ba-4fe8-b43a-14ab607bff03 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:40.695460 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-17eb632b-13ba-4fe8-b43a-14ab607bff03 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:40.696299 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-17eb632b-13ba-4fe8-b43a-14ab607bff03 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:40.696968 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-17eb632b-13ba-4fe8-b43a-14ab607bff03 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:40.697918 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-17eb632b-13ba-4fe8-b43a-14ab607bff03 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:40.698641 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-17eb632b-13ba-4fe8-b43a-14ab607bff03 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:40.699279 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-17eb632b-13ba-4fe8-b43a-14ab607bff03 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:40.723684 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:40.845180 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-17eb632b-13ba-4fe8-b43a-14ab607bff03 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:40.853559 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-17eb632b-13ba-4fe8-b43a-14ab607bff03 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c" status: 200 len: 1677 microversion: 2.1 time: 0.172007 Oct 23 02:11:40.854172 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3676/7446] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:40 2022] GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:41.876852 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ea261999-4035-4a04-b7b3-a3eacbd1ee28 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:41.877476 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ea261999-4035-4a04-b7b3-a3eacbd1ee28 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:41.884464 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ea261999-4035-4a04-b7b3-a3eacbd1ee28 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:41.884952 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ea261999-4035-4a04-b7b3-a3eacbd1ee28 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:41.885389 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ea261999-4035-4a04-b7b3-a3eacbd1ee28 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:41.886225 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ea261999-4035-4a04-b7b3-a3eacbd1ee28 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:41.886682 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ea261999-4035-4a04-b7b3-a3eacbd1ee28 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:41.887199 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ea261999-4035-4a04-b7b3-a3eacbd1ee28 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:42.029487 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ea261999-4035-4a04-b7b3-a3eacbd1ee28 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:42.033109 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:42.039118 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ea261999-4035-4a04-b7b3-a3eacbd1ee28 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c" status: 200 len: 1669 microversion: 2.1 time: 0.165574 Oct 23 02:11:42.039118 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3771/7447] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:41 2022] GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c => generated 1669 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:42.063290 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-97632d5a-3c22-4d1d-85ec-a81898e98e2d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:42.063977 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-97632d5a-3c22-4d1d-85ec-a81898e98e2d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:42.069952 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-97632d5a-3c22-4d1d-85ec-a81898e98e2d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:42.070490 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-97632d5a-3c22-4d1d-85ec-a81898e98e2d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:42.070944 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-97632d5a-3c22-4d1d-85ec-a81898e98e2d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:42.071698 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-97632d5a-3c22-4d1d-85ec-a81898e98e2d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:42.072178 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-97632d5a-3c22-4d1d-85ec-a81898e98e2d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:42.072615 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-97632d5a-3c22-4d1d-85ec-a81898e98e2d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:42.203864 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-97632d5a-3c22-4d1d-85ec-a81898e98e2d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:42.212294 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-97632d5a-3c22-4d1d-85ec-a81898e98e2d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c" status: 200 len: 1669 microversion: 2.1 time: 0.154010 Oct 23 02:11:42.212886 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3677/7448] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:42 2022] GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c => generated 1669 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:42.235678 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e53f4e46-54d2-4eb1-9bbe-822b6bdf107a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:42.236302 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e53f4e46-54d2-4eb1-9bbe-822b6bdf107a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:42.242712 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e53f4e46-54d2-4eb1-9bbe-822b6bdf107a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:42.243211 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e53f4e46-54d2-4eb1-9bbe-822b6bdf107a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:42.243649 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e53f4e46-54d2-4eb1-9bbe-822b6bdf107a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:42.244343 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e53f4e46-54d2-4eb1-9bbe-822b6bdf107a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:42.244804 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e53f4e46-54d2-4eb1-9bbe-822b6bdf107a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:42.245234 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e53f4e46-54d2-4eb1-9bbe-822b6bdf107a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:42.282782 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-09cd5dfb-fb5e-4983-8e27-8f721824522f req-bc7d2bf2-d2c8-40ed-b6cb-823b78f04f7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "302c627e-0b1c-4b05-8e15-4c23a5d0587c", "name": "network-vif-plugged", "status": "completed", "tag": "6324d8aa-f264-4e44-b696-c9fa6b5fdd7f"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:11:42.292831 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-09cd5dfb-fb5e-4983-8e27-8f721824522f req-bc7d2bf2-d2c8-40ed-b6cb-823b78f04f7b service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:42.293329 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-09cd5dfb-fb5e-4983-8e27-8f721824522f req-bc7d2bf2-d2c8-40ed-b6cb-823b78f04f7b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:42.293772 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-09cd5dfb-fb5e-4983-8e27-8f721824522f req-bc7d2bf2-d2c8-40ed-b6cb-823b78f04f7b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:42.304876 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-09cd5dfb-fb5e-4983-8e27-8f721824522f req-bc7d2bf2-d2c8-40ed-b6cb-823b78f04f7b service nova] Creating event network-vif-plugged:6324d8aa-f264-4e44-b696-c9fa6b5fdd7f for instance 302c627e-0b1c-4b05-8e15-4c23a5d0587c on n-h1-master-1 Oct 23 02:11:42.309947 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-09cd5dfb-fb5e-4983-8e27-8f721824522f req-bc7d2bf2-d2c8-40ed-b6cb-823b78f04f7b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030906 Oct 23 02:11:42.310572 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3678/7449] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:11:42.382205 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e53f4e46-54d2-4eb1-9bbe-822b6bdf107a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:42.390044 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e53f4e46-54d2-4eb1-9bbe-822b6bdf107a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c" status: 200 len: 1669 microversion: 2.1 time: 0.158562 Oct 23 02:11:42.390631 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3772/7450] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:42 2022] GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c => generated 1669 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:11:42.413990 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a51ad28d-c8fb-41f1-942d-a811e28a93e8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:42.414593 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a51ad28d-c8fb-41f1-942d-a811e28a93e8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:42.421515 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a51ad28d-c8fb-41f1-942d-a811e28a93e8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:42.422045 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a51ad28d-c8fb-41f1-942d-a811e28a93e8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:42.422495 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a51ad28d-c8fb-41f1-942d-a811e28a93e8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:42.423203 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a51ad28d-c8fb-41f1-942d-a811e28a93e8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:42.423846 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a51ad28d-c8fb-41f1-942d-a811e28a93e8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:42.424296 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a51ad28d-c8fb-41f1-942d-a811e28a93e8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:42.449967 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a51ad28d-c8fb-41f1-942d-a811e28a93e8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 02:11:42.718371 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a51ad28d-c8fb-41f1-942d-a811e28a93e8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "DELETE /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c" status: 204 len: 0 microversion: 2.1 time: 0.308925 Oct 23 02:11:42.718993 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3679/7451] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 02:11:42 2022] DELETE /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 02:11:42.727322 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-23da1532-ae3d-4348-90ad-2abbf8309534 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:42.730427 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-23da1532-ae3d-4348-90ad-2abbf8309534 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:42.733957 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-23da1532-ae3d-4348-90ad-2abbf8309534 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:42.734470 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-23da1532-ae3d-4348-90ad-2abbf8309534 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:42.734944 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-23da1532-ae3d-4348-90ad-2abbf8309534 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:42.735624 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-23da1532-ae3d-4348-90ad-2abbf8309534 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:42.736116 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-23da1532-ae3d-4348-90ad-2abbf8309534 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:42.736540 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-23da1532-ae3d-4348-90ad-2abbf8309534 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:42.864585 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-23da1532-ae3d-4348-90ad-2abbf8309534 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:42.873063 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-23da1532-ae3d-4348-90ad-2abbf8309534 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c" status: 200 len: 1675 microversion: 2.1 time: 0.149700 Oct 23 02:11:42.873634 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3773/7452] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:42 2022] GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:43.897272 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-76e7e833-b4ee-4f74-8ee7-28f7950e58ea tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:43.897924 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-76e7e833-b4ee-4f74-8ee7-28f7950e58ea tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:43.900766 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:43.905644 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-76e7e833-b4ee-4f74-8ee7-28f7950e58ea tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:43.906176 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-76e7e833-b4ee-4f74-8ee7-28f7950e58ea tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:43.906626 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-76e7e833-b4ee-4f74-8ee7-28f7950e58ea tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:43.907323 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-76e7e833-b4ee-4f74-8ee7-28f7950e58ea tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:43.907794 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-76e7e833-b4ee-4f74-8ee7-28f7950e58ea tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:43.908230 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-76e7e833-b4ee-4f74-8ee7-28f7950e58ea tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:44.039333 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-76e7e833-b4ee-4f74-8ee7-28f7950e58ea tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:44.046996 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-76e7e833-b4ee-4f74-8ee7-28f7950e58ea tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c" status: 200 len: 1675 microversion: 2.1 time: 0.154073 Oct 23 02:11:44.047571 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3680/7453] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:43 2022] GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:45.071758 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cbea61e4-d033-459d-9ee1-9debe2e01ad1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:45.072379 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-cbea61e4-d033-459d-9ee1-9debe2e01ad1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:45.075115 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=41 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:45.080008 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cbea61e4-d033-459d-9ee1-9debe2e01ad1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:45.080507 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cbea61e4-d033-459d-9ee1-9debe2e01ad1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:45.080949 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cbea61e4-d033-459d-9ee1-9debe2e01ad1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:45.081643 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cbea61e4-d033-459d-9ee1-9debe2e01ad1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:45.082125 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cbea61e4-d033-459d-9ee1-9debe2e01ad1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:45.082555 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cbea61e4-d033-459d-9ee1-9debe2e01ad1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:45.218237 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cbea61e4-d033-459d-9ee1-9debe2e01ad1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:45.226052 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cbea61e4-d033-459d-9ee1-9debe2e01ad1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c" status: 200 len: 1675 microversion: 2.1 time: 0.158833 Oct 23 02:11:45.226823 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3774/7454] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:45 2022] GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:11:45.548826 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-285edbc8-4c3f-431b-8231-a3575671cc3e req-1bb6e4a9-0d16-412c-b113-1721b57d06cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "302c627e-0b1c-4b05-8e15-4c23a5d0587c", "name": "network-vif-deleted", "tag": "6324d8aa-f264-4e44-b696-c9fa6b5fdd7f"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:11:45.559851 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-285edbc8-4c3f-431b-8231-a3575671cc3e req-1bb6e4a9-0d16-412c-b113-1721b57d06cd service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:45.562215 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-285edbc8-4c3f-431b-8231-a3575671cc3e req-1bb6e4a9-0d16-412c-b113-1721b57d06cd service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:45.562215 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-285edbc8-4c3f-431b-8231-a3575671cc3e req-1bb6e4a9-0d16-412c-b113-1721b57d06cd service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:45.572354 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-285edbc8-4c3f-431b-8231-a3575671cc3e req-1bb6e4a9-0d16-412c-b113-1721b57d06cd service nova] Creating event network-vif-deleted:6324d8aa-f264-4e44-b696-c9fa6b5fdd7f for instance 302c627e-0b1c-4b05-8e15-4c23a5d0587c on n-h1-master-1 Oct 23 02:11:45.577253 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-285edbc8-4c3f-431b-8231-a3575671cc3e req-1bb6e4a9-0d16-412c-b113-1721b57d06cd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039854 Oct 23 02:11:45.577845 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3681/7455] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:11:46.249824 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fbfa47d7-63db-45f2-aca8-c8f542626eec tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:46.250502 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fbfa47d7-63db-45f2-aca8-c8f542626eec tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:46.257864 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fbfa47d7-63db-45f2-aca8-c8f542626eec tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:46.258399 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fbfa47d7-63db-45f2-aca8-c8f542626eec tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:46.258838 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fbfa47d7-63db-45f2-aca8-c8f542626eec tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:46.259525 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fbfa47d7-63db-45f2-aca8-c8f542626eec tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:46.259980 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fbfa47d7-63db-45f2-aca8-c8f542626eec tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:46.260401 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fbfa47d7-63db-45f2-aca8-c8f542626eec tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:46.275588 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-fbfa47d7-63db-45f2-aca8-c8f542626eec tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] HTTP exception thrown: Instance 302c627e-0b1c-4b05-8e15-4c23a5d0587c could not be found. Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fbfa47d7-63db-45f2-aca8-c8f542626eec tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Request method failure captured: Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c HTTP/1.1 Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVKKL3Yj8jOjD4nOjvPlV-Y9scyqq13fojDyVX3OBbve73h4rlqC2R6Nmg1gkZUj_81md5ukYTWK0OLLvV2V5x7EROs1jhxmCCEm-g9iyFEqoOdE1VQeo6XR_54_6ol8SgxaBnJdqCRkZgpHF9-UuD1N8MWY5NbSWQIdQH83g6nBVV_w Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 03ca20e778cf488baea3d1e0505cd492 Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServerActionsTestJSON-1383606630 Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/03ca20e778cf488baea3d1e0505cd492"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_03ca20e778cf488baea3d1e0505cd492"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/03ca20e778cf488baea3d1e0505cd492"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/03ca20e778cf488baea3d1e0505cd492"}]}] Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServerActionsTestJSON-1383606630 Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 03ca20e778cf488baea3d1e0505cd492 Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServerActionsTestJSON-1383606630 Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServerActionsTestJSON-1383606630-project Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 8d11ce8077ca4566ba823eac0882c34f Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServerActionsTestJSON-1383606630-project Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 302c627e-0b1c-4b05-8e15-4c23a5d0587c could not be found. Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '302c627e-0b1c-4b05-8e15-4c23a5d0587c'} Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 302c627e-0b1c-4b05-8e15-4c23a5d0587c could not be found. Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 302c627e-0b1c-4b05-8e15-4c23a5d0587c could not be found. Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:11:46.277272 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:11:46.282198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:11:46.282198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:11:46.282198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:11:46.282198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:11:46.282198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:11:46.282198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 302c627e-0b1c-4b05-8e15-4c23a5d0587c could not be found. Oct 23 02:11:46.282198 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:11:46.282198 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fbfa47d7-63db-45f2-aca8-c8f542626eec tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Returning 404 to user: Instance 302c627e-0b1c-4b05-8e15-4c23a5d0587c could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:11:46.282198 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fbfa47d7-63db-45f2-aca8-c8f542626eec tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c" status: 404 len: 111 microversion: 2.1 time: 0.033098 Oct 23 02:11:46.284434 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3775/7456] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:46 2022] GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:11:46.293221 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a59534d3-669d-41cd-9b07-d0126405c25a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:46.293943 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a59534d3-669d-41cd-9b07-d0126405c25a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:46.300263 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a59534d3-669d-41cd-9b07-d0126405c25a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:46.300765 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a59534d3-669d-41cd-9b07-d0126405c25a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:46.301210 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a59534d3-669d-41cd-9b07-d0126405c25a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:46.301919 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a59534d3-669d-41cd-9b07-d0126405c25a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:46.302484 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a59534d3-669d-41cd-9b07-d0126405c25a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:46.302918 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a59534d3-669d-41cd-9b07-d0126405c25a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:46.317327 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-a59534d3-669d-41cd-9b07-d0126405c25a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] HTTP exception thrown: Instance 302c627e-0b1c-4b05-8e15-4c23a5d0587c could not be found. Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a59534d3-669d-41cd-9b07-d0126405c25a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Request method failure captured: Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c HTTP/1.1 Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVKKL3Yj8jOjD4nOjvPlV-Y9scyqq13fojDyVX3OBbve73h4rlqC2R6Nmg1gkZUj_81md5ukYTWK0OLLvV2V5x7EROs1jhxmCCEm-g9iyFEqoOdE1VQeo6XR_54_6ol8SgxaBnJdqCRkZgpHF9-UuD1N8MWY5NbSWQIdQH83g6nBVV_w Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 03ca20e778cf488baea3d1e0505cd492 Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServerActionsTestJSON-1383606630 Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/03ca20e778cf488baea3d1e0505cd492"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_03ca20e778cf488baea3d1e0505cd492"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/03ca20e778cf488baea3d1e0505cd492"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/03ca20e778cf488baea3d1e0505cd492"}]}] Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServerActionsTestJSON-1383606630 Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 03ca20e778cf488baea3d1e0505cd492 Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServerActionsTestJSON-1383606630 Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServerActionsTestJSON-1383606630-project Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 8d11ce8077ca4566ba823eac0882c34f Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServerActionsTestJSON-1383606630-project Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 302c627e-0b1c-4b05-8e15-4c23a5d0587c could not be found. Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '302c627e-0b1c-4b05-8e15-4c23a5d0587c'} Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 302c627e-0b1c-4b05-8e15-4c23a5d0587c could not be found. Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 302c627e-0b1c-4b05-8e15-4c23a5d0587c could not be found. Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:11:46.319584 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:11:46.325546 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:11:46.325546 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:11:46.325546 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:11:46.325546 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:11:46.325546 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:11:46.325546 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 302c627e-0b1c-4b05-8e15-4c23a5d0587c could not be found. Oct 23 02:11:46.325546 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:11:46.325546 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a59534d3-669d-41cd-9b07-d0126405c25a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Returning 404 to user: Instance 302c627e-0b1c-4b05-8e15-4c23a5d0587c could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:11:46.325546 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a59534d3-669d-41cd-9b07-d0126405c25a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c" status: 404 len: 111 microversion: 2.1 time: 0.032034 Oct 23 02:11:46.325546 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3682/7457] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:46 2022] GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:11:46.374115 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5991bf31-5078-4ec0-a773-5ff1bc31afb3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1956041966", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "f26ee581-835e-4450-9de2-8238925be6fc"}], "security_groups": [{"name": "tempest-securitygroup--633118967"}], "key_name": "tempest-keypair-1840206196", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:11:46.486567 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-5991bf31-5078-4ec0-a773-5ff1bc31afb3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] validate_networks() for [('f26ee581-835e-4450-9de2-8238925be6fc', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 02:11:46.861657 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-5991bf31-5078-4ec0-a773-5ff1bc31afb3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:11:46.862138 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-5991bf31-5078-4ec0-a773-5ff1bc31afb3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:11:46.862617 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-5991bf31-5078-4ec0-a773-5ff1bc31afb3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:11:46.863026 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-5991bf31-5078-4ec0-a773-5ff1bc31afb3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:11:46.863440 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-5991bf31-5078-4ec0-a773-5ff1bc31afb3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:11:46.872757 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5991bf31-5078-4ec0-a773-5ff1bc31afb3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:46.873243 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5991bf31-5078-4ec0-a773-5ff1bc31afb3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:46.873677 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5991bf31-5078-4ec0-a773-5ff1bc31afb3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:46.874433 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5991bf31-5078-4ec0-a773-5ff1bc31afb3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:46.874892 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5991bf31-5078-4ec0-a773-5ff1bc31afb3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:46.875317 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5991bf31-5078-4ec0-a773-5ff1bc31afb3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:46.892493 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-5991bf31-5078-4ec0-a773-5ff1bc31afb3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Getting quotas for project 03ca20e778cf488baea3d1e0505cd492. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:11:46.898775 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-5991bf31-5078-4ec0-a773-5ff1bc31afb3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Getting quotas for user 8d11ce8077ca4566ba823eac0882c34f and project 03ca20e778cf488baea3d1e0505cd492. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:11:46.910953 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5991bf31-5078-4ec0-a773-5ff1bc31afb3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 02:11:46.913753 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5991bf31-5078-4ec0-a773-5ff1bc31afb3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: e3b4aba9-8dff-4a30-8b42-0ae2f884560f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 02:11:47.013375 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5991bf31-5078-4ec0-a773-5ff1bc31afb3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.643588 Oct 23 02:11:47.014321 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3776/7458] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 02:11:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 02:11:47.025674 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-002df9d9-7f5b-448e-9c4b-8b3f074fcafb tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:47.026323 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-002df9d9-7f5b-448e-9c4b-8b3f074fcafb tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: e3b4aba9-8dff-4a30-8b42-0ae2f884560f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:47.081620 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-002df9d9-7f5b-448e-9c4b-8b3f074fcafb tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:47.089632 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-002df9d9-7f5b-448e-9c4b-8b3f074fcafb tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f" status: 200 len: 1239 microversion: 2.1 time: 0.067473 Oct 23 02:11:47.090226 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3683/7459] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:47 2022] GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f => generated 1239 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:48.112861 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-636c4434-559e-4354-8ea8-db4ead996876 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:48.113672 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-636c4434-559e-4354-8ea8-db4ead996876 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: e3b4aba9-8dff-4a30-8b42-0ae2f884560f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:48.122015 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-636c4434-559e-4354-8ea8-db4ead996876 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:48.122509 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-636c4434-559e-4354-8ea8-db4ead996876 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:48.122948 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-636c4434-559e-4354-8ea8-db4ead996876 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:48.123687 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-636c4434-559e-4354-8ea8-db4ead996876 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:48.124180 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-636c4434-559e-4354-8ea8-db4ead996876 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:48.124611 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-636c4434-559e-4354-8ea8-db4ead996876 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:48.189402 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-636c4434-559e-4354-8ea8-db4ead996876 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:48.198937 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-636c4434-559e-4354-8ea8-db4ead996876 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f" status: 200 len: 1243 microversion: 2.1 time: 0.090026 Oct 23 02:11:48.199532 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3777/7460] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:48 2022] GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f => generated 1243 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:49.223728 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8c0fe048-bccf-47c5-b6ac-d94ee6a59409 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:49.225521 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8c0fe048-bccf-47c5-b6ac-d94ee6a59409 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: e3b4aba9-8dff-4a30-8b42-0ae2f884560f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:49.232685 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8c0fe048-bccf-47c5-b6ac-d94ee6a59409 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:49.233262 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8c0fe048-bccf-47c5-b6ac-d94ee6a59409 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:49.233703 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8c0fe048-bccf-47c5-b6ac-d94ee6a59409 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:49.234771 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8c0fe048-bccf-47c5-b6ac-d94ee6a59409 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:49.234875 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8c0fe048-bccf-47c5-b6ac-d94ee6a59409 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:49.235303 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8c0fe048-bccf-47c5-b6ac-d94ee6a59409 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:49.318622 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8c0fe048-bccf-47c5-b6ac-d94ee6a59409 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:49.326690 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8c0fe048-bccf-47c5-b6ac-d94ee6a59409 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f" status: 200 len: 1299 microversion: 2.1 time: 0.106887 Oct 23 02:11:49.327275 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3684/7461] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:49 2022] GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f => generated 1299 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:50.350533 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ad2a2d76-5fd9-46fe-a8c8-c9c85672ee23 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:50.351083 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ad2a2d76-5fd9-46fe-a8c8-c9c85672ee23 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: e3b4aba9-8dff-4a30-8b42-0ae2f884560f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:50.357915 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ad2a2d76-5fd9-46fe-a8c8-c9c85672ee23 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:50.358439 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ad2a2d76-5fd9-46fe-a8c8-c9c85672ee23 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:50.358882 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ad2a2d76-5fd9-46fe-a8c8-c9c85672ee23 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:50.359614 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ad2a2d76-5fd9-46fe-a8c8-c9c85672ee23 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:50.360073 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ad2a2d76-5fd9-46fe-a8c8-c9c85672ee23 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:50.360513 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ad2a2d76-5fd9-46fe-a8c8-c9c85672ee23 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:50.493915 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ad2a2d76-5fd9-46fe-a8c8-c9c85672ee23 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:50.501848 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ad2a2d76-5fd9-46fe-a8c8-c9c85672ee23 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f" status: 200 len: 1364 microversion: 2.1 time: 0.155319 Oct 23 02:11:50.502477 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3778/7462] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:50 2022] GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:50.869743 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-9b201c56-dc9a-4926-8a34-b76509878779 req-f246f623-9bff-470a-a630-05935f005cf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3b4aba9-8dff-4a30-8b42-0ae2f884560f", "tag": "b4c7da24-2a4b-4497-819f-39c253661023"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:11:50.880474 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-9b201c56-dc9a-4926-8a34-b76509878779 req-f246f623-9bff-470a-a630-05935f005cf6 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:50.881078 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-9b201c56-dc9a-4926-8a34-b76509878779 req-f246f623-9bff-470a-a630-05935f005cf6 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:50.881588 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-9b201c56-dc9a-4926-8a34-b76509878779 req-f246f623-9bff-470a-a630-05935f005cf6 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:50.893199 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-9b201c56-dc9a-4926-8a34-b76509878779 req-f246f623-9bff-470a-a630-05935f005cf6 service nova] Creating event network-changed:b4c7da24-2a4b-4497-819f-39c253661023 for instance e3b4aba9-8dff-4a30-8b42-0ae2f884560f on n-h1-master-1 Oct 23 02:11:50.898481 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-9b201c56-dc9a-4926-8a34-b76509878779 req-f246f623-9bff-470a-a630-05935f005cf6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033054 Oct 23 02:11:50.899054 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3685/7463] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:11:51.527530 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2e383d65-3e8b-493c-9f68-d21b726a7e2d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:51.528258 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2e383d65-3e8b-493c-9f68-d21b726a7e2d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: e3b4aba9-8dff-4a30-8b42-0ae2f884560f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:51.534536 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e383d65-3e8b-493c-9f68-d21b726a7e2d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:51.535029 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e383d65-3e8b-493c-9f68-d21b726a7e2d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:51.535478 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e383d65-3e8b-493c-9f68-d21b726a7e2d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:51.536173 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e383d65-3e8b-493c-9f68-d21b726a7e2d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:51.536640 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e383d65-3e8b-493c-9f68-d21b726a7e2d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:51.537256 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2e383d65-3e8b-493c-9f68-d21b726a7e2d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:51.668053 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2e383d65-3e8b-493c-9f68-d21b726a7e2d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:51.676050 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2e383d65-3e8b-493c-9f68-d21b726a7e2d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f" status: 200 len: 1364 microversion: 2.1 time: 0.152615 Oct 23 02:11:51.676668 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3779/7464] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:51 2022] GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:52.701880 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e66f5820-5259-4c38-89b6-5468168c6e9a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:52.702622 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e66f5820-5259-4c38-89b6-5468168c6e9a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: e3b4aba9-8dff-4a30-8b42-0ae2f884560f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:52.708766 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e66f5820-5259-4c38-89b6-5468168c6e9a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:52.709744 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e66f5820-5259-4c38-89b6-5468168c6e9a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:52.710225 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e66f5820-5259-4c38-89b6-5468168c6e9a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:52.710911 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e66f5820-5259-4c38-89b6-5468168c6e9a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:52.711379 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e66f5820-5259-4c38-89b6-5468168c6e9a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:52.711809 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e66f5820-5259-4c38-89b6-5468168c6e9a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:52.840274 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e66f5820-5259-4c38-89b6-5468168c6e9a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:52.847936 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e66f5820-5259-4c38-89b6-5468168c6e9a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f" status: 200 len: 1364 microversion: 2.1 time: 0.151263 Oct 23 02:11:52.848509 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3686/7465] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:52 2022] GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:53.872324 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3be3f7fa-ea8a-476a-bf3f-53d6861f46f8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:53.872946 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3be3f7fa-ea8a-476a-bf3f-53d6861f46f8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: e3b4aba9-8dff-4a30-8b42-0ae2f884560f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:53.879907 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3be3f7fa-ea8a-476a-bf3f-53d6861f46f8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:53.880395 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3be3f7fa-ea8a-476a-bf3f-53d6861f46f8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:53.881329 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3be3f7fa-ea8a-476a-bf3f-53d6861f46f8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:53.882041 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3be3f7fa-ea8a-476a-bf3f-53d6861f46f8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:53.882501 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3be3f7fa-ea8a-476a-bf3f-53d6861f46f8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:53.882925 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3be3f7fa-ea8a-476a-bf3f-53d6861f46f8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:54.010405 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3be3f7fa-ea8a-476a-bf3f-53d6861f46f8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:54.018173 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3be3f7fa-ea8a-476a-bf3f-53d6861f46f8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f" status: 200 len: 1364 microversion: 2.1 time: 0.149977 Oct 23 02:11:54.018744 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3780/7466] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:53 2022] GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:55.043017 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a5889dc2-4b38-4641-8207-b0384810f80e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:55.043595 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a5889dc2-4b38-4641-8207-b0384810f80e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: e3b4aba9-8dff-4a30-8b42-0ae2f884560f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:55.050336 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a5889dc2-4b38-4641-8207-b0384810f80e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:55.050825 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a5889dc2-4b38-4641-8207-b0384810f80e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:55.051267 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a5889dc2-4b38-4641-8207-b0384810f80e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:55.051953 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a5889dc2-4b38-4641-8207-b0384810f80e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:55.052416 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a5889dc2-4b38-4641-8207-b0384810f80e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:55.052852 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a5889dc2-4b38-4641-8207-b0384810f80e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:55.181693 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a5889dc2-4b38-4641-8207-b0384810f80e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:55.189534 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a5889dc2-4b38-4641-8207-b0384810f80e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f" status: 200 len: 1364 microversion: 2.1 time: 0.150514 Oct 23 02:11:55.190133 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3687/7467] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:55 2022] GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:56.214613 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-61be17fa-4a4d-48d4-84fd-8baa1c2b53a1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:56.215238 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-61be17fa-4a4d-48d4-84fd-8baa1c2b53a1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: e3b4aba9-8dff-4a30-8b42-0ae2f884560f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:56.222263 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-61be17fa-4a4d-48d4-84fd-8baa1c2b53a1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:56.222753 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-61be17fa-4a4d-48d4-84fd-8baa1c2b53a1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:56.223194 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-61be17fa-4a4d-48d4-84fd-8baa1c2b53a1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:56.223889 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-61be17fa-4a4d-48d4-84fd-8baa1c2b53a1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:56.224349 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-61be17fa-4a4d-48d4-84fd-8baa1c2b53a1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:56.224777 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-61be17fa-4a4d-48d4-84fd-8baa1c2b53a1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:56.318878 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-dd12fe3a-68c2-4205-9266-e46a2a09d459 req-34f00f08-c1a1-480e-8d23-0521795c2527 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3b4aba9-8dff-4a30-8b42-0ae2f884560f", "name": "network-vif-plugged", "status": "completed", "tag": "b4c7da24-2a4b-4497-819f-39c253661023"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:11:56.329652 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-dd12fe3a-68c2-4205-9266-e46a2a09d459 req-34f00f08-c1a1-480e-8d23-0521795c2527 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:56.330253 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-dd12fe3a-68c2-4205-9266-e46a2a09d459 req-34f00f08-c1a1-480e-8d23-0521795c2527 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:56.330785 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-dd12fe3a-68c2-4205-9266-e46a2a09d459 req-34f00f08-c1a1-480e-8d23-0521795c2527 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:56.342207 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-dd12fe3a-68c2-4205-9266-e46a2a09d459 req-34f00f08-c1a1-480e-8d23-0521795c2527 service nova] Creating event network-vif-plugged:b4c7da24-2a4b-4497-819f-39c253661023 for instance e3b4aba9-8dff-4a30-8b42-0ae2f884560f on n-h1-master-1 Oct 23 02:11:56.347209 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-dd12fe3a-68c2-4205-9266-e46a2a09d459 req-34f00f08-c1a1-480e-8d23-0521795c2527 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032743 Oct 23 02:11:56.347842 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3688/7468] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:11:56.357891 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-61be17fa-4a4d-48d4-84fd-8baa1c2b53a1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:56.366263 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-61be17fa-4a4d-48d4-84fd-8baa1c2b53a1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f" status: 200 len: 1364 microversion: 2.1 time: 0.155819 Oct 23 02:11:56.366785 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3781/7469] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:56 2022] GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:57.387861 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:57.392844 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-698a2d78-0887-4d8a-879b-788ddf214f16 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:57.393548 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-698a2d78-0887-4d8a-879b-788ddf214f16 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: e3b4aba9-8dff-4a30-8b42-0ae2f884560f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:57.400159 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-698a2d78-0887-4d8a-879b-788ddf214f16 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:57.406644 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-698a2d78-0887-4d8a-879b-788ddf214f16 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:57.406644 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-698a2d78-0887-4d8a-879b-788ddf214f16 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:57.406644 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-698a2d78-0887-4d8a-879b-788ddf214f16 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:57.406644 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-698a2d78-0887-4d8a-879b-788ddf214f16 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:57.406644 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-698a2d78-0887-4d8a-879b-788ddf214f16 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:57.538443 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-698a2d78-0887-4d8a-879b-788ddf214f16 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:57.546239 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-698a2d78-0887-4d8a-879b-788ddf214f16 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f" status: 200 len: 1364 microversion: 2.1 time: 0.159292 Oct 23 02:11:57.546812 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3689/7470] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:57 2022] GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:58.570804 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e9b9048f-0047-4e13-86ef-d8bec929636b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:58.571687 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e9b9048f-0047-4e13-86ef-d8bec929636b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: e3b4aba9-8dff-4a30-8b42-0ae2f884560f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:58.573297 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:58.573988 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=6 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:58.579715 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9b9048f-0047-4e13-86ef-d8bec929636b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:58.580207 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9b9048f-0047-4e13-86ef-d8bec929636b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:58.580652 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9b9048f-0047-4e13-86ef-d8bec929636b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:58.581352 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9b9048f-0047-4e13-86ef-d8bec929636b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:58.581815 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9b9048f-0047-4e13-86ef-d8bec929636b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:58.582275 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e9b9048f-0047-4e13-86ef-d8bec929636b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:58.711126 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e9b9048f-0047-4e13-86ef-d8bec929636b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:58.719220 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e9b9048f-0047-4e13-86ef-d8bec929636b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f" status: 200 len: 1551 microversion: 2.1 time: 0.153048 Oct 23 02:11:58.719787 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3782/7471] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:58 2022] GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f => generated 1551 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:58.742701 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8bba86b7-bba2-41b4-ac81-75db7e4daed4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:58.743218 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8bba86b7-bba2-41b4-ac81-75db7e4daed4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: e3b4aba9-8dff-4a30-8b42-0ae2f884560f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:58.749988 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8bba86b7-bba2-41b4-ac81-75db7e4daed4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:58.750755 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8bba86b7-bba2-41b4-ac81-75db7e4daed4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:58.751200 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8bba86b7-bba2-41b4-ac81-75db7e4daed4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:58.751897 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8bba86b7-bba2-41b4-ac81-75db7e4daed4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:58.752359 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8bba86b7-bba2-41b4-ac81-75db7e4daed4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:58.752791 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8bba86b7-bba2-41b4-ac81-75db7e4daed4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:58.829174 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8bba86b7-bba2-41b4-ac81-75db7e4daed4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090294 Oct 23 02:11:58.829772 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3690/7472] 10.222.0.42 () {58 vars in 1275 bytes} [Sun Oct 23 02:11:58 2022] GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:11:59.801110 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-8973df94-2832-471f-b4ff-557a720798aa req-7a500885-4359-4950-ac30-906fadc937be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3b4aba9-8dff-4a30-8b42-0ae2f884560f", "tag": "b4c7da24-2a4b-4497-819f-39c253661023"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:11:59.811407 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-8973df94-2832-471f-b4ff-557a720798aa req-7a500885-4359-4950-ac30-906fadc937be service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:59.811884 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-8973df94-2832-471f-b4ff-557a720798aa req-7a500885-4359-4950-ac30-906fadc937be service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:59.812319 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-8973df94-2832-471f-b4ff-557a720798aa req-7a500885-4359-4950-ac30-906fadc937be service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:59.823995 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-8973df94-2832-471f-b4ff-557a720798aa req-7a500885-4359-4950-ac30-906fadc937be service nova] Creating event network-changed:b4c7da24-2a4b-4497-819f-39c253661023 for instance e3b4aba9-8dff-4a30-8b42-0ae2f884560f on n-h1-master-1 Oct 23 02:11:59.829062 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-8973df94-2832-471f-b4ff-557a720798aa req-7a500885-4359-4950-ac30-906fadc937be service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031600 Oct 23 02:11:59.829658 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3783/7473] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:12:32.955126 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=23 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:32.955898 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:32.960537 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9909b3d8-5512-428a-81f0-28f288994269 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:12:32.966702 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9909b3d8-5512-428a-81f0-28f288994269 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:32.974995 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9909b3d8-5512-428a-81f0-28f288994269 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:32.974995 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9909b3d8-5512-428a-81f0-28f288994269 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:32.989498 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9909b3d8-5512-428a-81f0-28f288994269 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: e3b4aba9-8dff-4a30-8b42-0ae2f884560f] Going to try to stop instance {{(pid=120945) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 23 02:12:33.162152 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9909b3d8-5512-428a-81f0-28f288994269 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "POST /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f/action" status: 202 len: 0 microversion: 2.1 time: 0.208695 Oct 23 02:12:33.162718 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3691/7474] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:12:32 2022] POST /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:12:33.169845 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:33.170633 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=60 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:33.174680 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-760d2937-978e-4255-9a22-0015f1bba831 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:33.175420 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-760d2937-978e-4255-9a22-0015f1bba831 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: e3b4aba9-8dff-4a30-8b42-0ae2f884560f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:33.181913 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-760d2937-978e-4255-9a22-0015f1bba831 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:33.183266 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-760d2937-978e-4255-9a22-0015f1bba831 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:33.183266 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-760d2937-978e-4255-9a22-0015f1bba831 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:33.183754 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-760d2937-978e-4255-9a22-0015f1bba831 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:33.184210 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-760d2937-978e-4255-9a22-0015f1bba831 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:33.184633 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-760d2937-978e-4255-9a22-0015f1bba831 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:33.318720 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-760d2937-978e-4255-9a22-0015f1bba831 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:33.326391 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-760d2937-978e-4255-9a22-0015f1bba831 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f" status: 200 len: 1680 microversion: 2.1 time: 0.158948 Oct 23 02:12:33.326968 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3784/7475] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:33 2022] GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:34.351749 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-af0a7e69-df57-4419-8bf3-5bd4dbcf5c8f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:34.352457 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-af0a7e69-df57-4419-8bf3-5bd4dbcf5c8f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: e3b4aba9-8dff-4a30-8b42-0ae2f884560f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:34.358753 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-af0a7e69-df57-4419-8bf3-5bd4dbcf5c8f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:34.359249 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-af0a7e69-df57-4419-8bf3-5bd4dbcf5c8f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:34.359695 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-af0a7e69-df57-4419-8bf3-5bd4dbcf5c8f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:34.360385 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-af0a7e69-df57-4419-8bf3-5bd4dbcf5c8f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:34.360845 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-af0a7e69-df57-4419-8bf3-5bd4dbcf5c8f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:34.361272 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-af0a7e69-df57-4419-8bf3-5bd4dbcf5c8f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:34.489186 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-af0a7e69-df57-4419-8bf3-5bd4dbcf5c8f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:34.497145 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-af0a7e69-df57-4419-8bf3-5bd4dbcf5c8f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f" status: 200 len: 1680 microversion: 2.1 time: 0.150832 Oct 23 02:12:34.497788 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3692/7476] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:34 2022] GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:35.522495 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6f4114a7-dbb3-40a3-805a-cef7bb137158 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:35.523113 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6f4114a7-dbb3-40a3-805a-cef7bb137158 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: e3b4aba9-8dff-4a30-8b42-0ae2f884560f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:35.529884 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6f4114a7-dbb3-40a3-805a-cef7bb137158 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:35.530395 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6f4114a7-dbb3-40a3-805a-cef7bb137158 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:35.530834 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6f4114a7-dbb3-40a3-805a-cef7bb137158 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:35.531510 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6f4114a7-dbb3-40a3-805a-cef7bb137158 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:35.531962 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6f4114a7-dbb3-40a3-805a-cef7bb137158 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:35.532407 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6f4114a7-dbb3-40a3-805a-cef7bb137158 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:35.661462 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6f4114a7-dbb3-40a3-805a-cef7bb137158 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:35.669191 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6f4114a7-dbb3-40a3-805a-cef7bb137158 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f" status: 200 len: 1680 microversion: 2.1 time: 0.151159 Oct 23 02:12:35.669771 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3785/7477] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:35 2022] GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:36.692626 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b28c0f30-39d1-4886-828d-8ba788e57991 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:36.693772 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b28c0f30-39d1-4886-828d-8ba788e57991 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: e3b4aba9-8dff-4a30-8b42-0ae2f884560f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:36.700626 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b28c0f30-39d1-4886-828d-8ba788e57991 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:36.701126 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b28c0f30-39d1-4886-828d-8ba788e57991 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:36.701576 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b28c0f30-39d1-4886-828d-8ba788e57991 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:36.702314 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b28c0f30-39d1-4886-828d-8ba788e57991 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:36.702784 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b28c0f30-39d1-4886-828d-8ba788e57991 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:36.703222 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b28c0f30-39d1-4886-828d-8ba788e57991 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:36.835713 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b28c0f30-39d1-4886-828d-8ba788e57991 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:36.843698 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b28c0f30-39d1-4886-828d-8ba788e57991 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f" status: 200 len: 1680 microversion: 2.1 time: 0.155043 Oct 23 02:12:36.844271 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3693/7478] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:36 2022] GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:37.867211 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4ce28d17-9101-49a3-a85b-9e39cba078a3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:37.867779 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4ce28d17-9101-49a3-a85b-9e39cba078a3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: e3b4aba9-8dff-4a30-8b42-0ae2f884560f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:37.874562 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4ce28d17-9101-49a3-a85b-9e39cba078a3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:37.875039 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4ce28d17-9101-49a3-a85b-9e39cba078a3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:37.875467 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4ce28d17-9101-49a3-a85b-9e39cba078a3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:37.876154 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4ce28d17-9101-49a3-a85b-9e39cba078a3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:37.876603 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4ce28d17-9101-49a3-a85b-9e39cba078a3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:37.877024 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4ce28d17-9101-49a3-a85b-9e39cba078a3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:38.004279 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4ce28d17-9101-49a3-a85b-9e39cba078a3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:38.012439 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4ce28d17-9101-49a3-a85b-9e39cba078a3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f" status: 200 len: 1680 microversion: 2.1 time: 0.149280 Oct 23 02:12:38.013015 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3786/7479] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:37 2022] GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:39.036521 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5c8b471d-f272-407e-a6a2-1f2dc59f8d80 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:39.037716 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5c8b471d-f272-407e-a6a2-1f2dc59f8d80 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: e3b4aba9-8dff-4a30-8b42-0ae2f884560f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:39.044583 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5c8b471d-f272-407e-a6a2-1f2dc59f8d80 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:39.045081 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5c8b471d-f272-407e-a6a2-1f2dc59f8d80 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:39.045531 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5c8b471d-f272-407e-a6a2-1f2dc59f8d80 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:39.046259 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5c8b471d-f272-407e-a6a2-1f2dc59f8d80 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:39.046730 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5c8b471d-f272-407e-a6a2-1f2dc59f8d80 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:39.047170 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5c8b471d-f272-407e-a6a2-1f2dc59f8d80 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:39.177478 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5c8b471d-f272-407e-a6a2-1f2dc59f8d80 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:39.185171 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5c8b471d-f272-407e-a6a2-1f2dc59f8d80 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f" status: 200 len: 1680 microversion: 2.1 time: 0.152637 Oct 23 02:12:39.185751 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3694/7480] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:39 2022] GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:40.209308 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1e8fb488-b388-498f-b5f9-86e109ee5900 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:40.209934 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1e8fb488-b388-498f-b5f9-86e109ee5900 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: e3b4aba9-8dff-4a30-8b42-0ae2f884560f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:40.217092 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1e8fb488-b388-498f-b5f9-86e109ee5900 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:40.217607 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1e8fb488-b388-498f-b5f9-86e109ee5900 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:40.218080 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1e8fb488-b388-498f-b5f9-86e109ee5900 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:40.218772 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1e8fb488-b388-498f-b5f9-86e109ee5900 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:40.219237 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1e8fb488-b388-498f-b5f9-86e109ee5900 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:40.219667 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1e8fb488-b388-498f-b5f9-86e109ee5900 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:40.348642 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1e8fb488-b388-498f-b5f9-86e109ee5900 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:40.356444 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1e8fb488-b388-498f-b5f9-86e109ee5900 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f" status: 200 len: 1680 microversion: 2.1 time: 0.151639 Oct 23 02:12:40.357020 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3787/7481] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:40 2022] GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:41.379843 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-106e48af-3911-41e7-9926-aabba37238e2 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:41.381095 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-106e48af-3911-41e7-9926-aabba37238e2 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: e3b4aba9-8dff-4a30-8b42-0ae2f884560f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:41.387982 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-106e48af-3911-41e7-9926-aabba37238e2 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:41.388474 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-106e48af-3911-41e7-9926-aabba37238e2 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:41.388919 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-106e48af-3911-41e7-9926-aabba37238e2 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:41.389612 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-106e48af-3911-41e7-9926-aabba37238e2 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:41.390107 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-106e48af-3911-41e7-9926-aabba37238e2 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:41.390543 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-106e48af-3911-41e7-9926-aabba37238e2 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:41.518059 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-106e48af-3911-41e7-9926-aabba37238e2 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:41.526002 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-106e48af-3911-41e7-9926-aabba37238e2 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f" status: 200 len: 1680 microversion: 2.1 time: 0.150114 Oct 23 02:12:41.526570 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3695/7482] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:41 2022] GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:42.548684 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f0bffb96-a503-4ccf-a8bd-cba747a47576 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:42.549327 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f0bffb96-a503-4ccf-a8bd-cba747a47576 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: e3b4aba9-8dff-4a30-8b42-0ae2f884560f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:42.556223 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f0bffb96-a503-4ccf-a8bd-cba747a47576 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:42.556704 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f0bffb96-a503-4ccf-a8bd-cba747a47576 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:42.557141 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f0bffb96-a503-4ccf-a8bd-cba747a47576 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:42.557825 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f0bffb96-a503-4ccf-a8bd-cba747a47576 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:42.558370 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f0bffb96-a503-4ccf-a8bd-cba747a47576 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:42.558795 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f0bffb96-a503-4ccf-a8bd-cba747a47576 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:42.690775 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f0bffb96-a503-4ccf-a8bd-cba747a47576 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:42.699158 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f0bffb96-a503-4ccf-a8bd-cba747a47576 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f" status: 200 len: 1680 microversion: 2.1 time: 0.154399 Oct 23 02:12:42.699728 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3788/7483] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:42 2022] GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:43.723373 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-555015c9-9881-40ca-b912-5e78776126de tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:43.723987 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-555015c9-9881-40ca-b912-5e78776126de tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: e3b4aba9-8dff-4a30-8b42-0ae2f884560f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:43.731467 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-555015c9-9881-40ca-b912-5e78776126de tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:43.731959 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-555015c9-9881-40ca-b912-5e78776126de tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:43.732479 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-555015c9-9881-40ca-b912-5e78776126de tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:43.733173 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-555015c9-9881-40ca-b912-5e78776126de tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:43.733644 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-555015c9-9881-40ca-b912-5e78776126de tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:43.734103 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-555015c9-9881-40ca-b912-5e78776126de tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:43.863670 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-555015c9-9881-40ca-b912-5e78776126de tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:43.871862 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-555015c9-9881-40ca-b912-5e78776126de tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f" status: 200 len: 1680 microversion: 2.1 time: 0.152431 Oct 23 02:12:43.872444 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3696/7484] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:43 2022] GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:44.896025 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0b7c03d7-353a-48c3-9409-b8afab7c1d2e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:44.896650 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0b7c03d7-353a-48c3-9409-b8afab7c1d2e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: e3b4aba9-8dff-4a30-8b42-0ae2f884560f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:44.904263 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b7c03d7-353a-48c3-9409-b8afab7c1d2e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:44.904747 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b7c03d7-353a-48c3-9409-b8afab7c1d2e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:44.905187 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b7c03d7-353a-48c3-9409-b8afab7c1d2e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:44.905905 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b7c03d7-353a-48c3-9409-b8afab7c1d2e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:44.906396 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b7c03d7-353a-48c3-9409-b8afab7c1d2e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:44.906825 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b7c03d7-353a-48c3-9409-b8afab7c1d2e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:45.035770 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0b7c03d7-353a-48c3-9409-b8afab7c1d2e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:45.043417 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0b7c03d7-353a-48c3-9409-b8afab7c1d2e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f" status: 200 len: 1657 microversion: 2.1 time: 0.151346 Oct 23 02:12:45.053085 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3789/7485] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:44 2022] GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f => generated 1657 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:45.074762 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-34238185-e8da-4258-abbd-6c5b9c68c14c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:12:45.076945 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-34238185-e8da-4258-abbd-6c5b9c68c14c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: e3b4aba9-8dff-4a30-8b42-0ae2f884560f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:45.083726 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-34238185-e8da-4258-abbd-6c5b9c68c14c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:45.084224 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-34238185-e8da-4258-abbd-6c5b9c68c14c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:45.084676 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-34238185-e8da-4258-abbd-6c5b9c68c14c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:45.085376 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-34238185-e8da-4258-abbd-6c5b9c68c14c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:45.085846 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-34238185-e8da-4258-abbd-6c5b9c68c14c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:45.086311 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-34238185-e8da-4258-abbd-6c5b9c68c14c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:45.117262 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-34238185-e8da-4258-abbd-6c5b9c68c14c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:45.122813 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-34238185-e8da-4258-abbd-6c5b9c68c14c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: e3b4aba9-8dff-4a30-8b42-0ae2f884560f] Old instance type m1.heat2, new instance type m1.heat {{(pid=120945) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 23 02:12:45.129282 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-34238185-e8da-4258-abbd-6c5b9c68c14c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:12:45.129718 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-34238185-e8da-4258-abbd-6c5b9c68c14c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:12:45.130228 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-34238185-e8da-4258-abbd-6c5b9c68c14c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:12:45.130651 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-34238185-e8da-4258-abbd-6c5b9c68c14c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:12:45.131074 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-34238185-e8da-4258-abbd-6c5b9c68c14c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:12:45.307438 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-34238185-e8da-4258-abbd-6c5b9c68c14c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "POST /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f/action" status: 202 len: 0 microversion: 2.1 time: 0.237186 Oct 23 02:12:45.308055 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3697/7486] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:12:45 2022] POST /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:12:45.316729 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-35c7bdaf-ba52-471b-86c3-d5e0258fff2e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:45.317361 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-35c7bdaf-ba52-471b-86c3-d5e0258fff2e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: e3b4aba9-8dff-4a30-8b42-0ae2f884560f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:45.323899 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-35c7bdaf-ba52-471b-86c3-d5e0258fff2e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:45.328030 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-35c7bdaf-ba52-471b-86c3-d5e0258fff2e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:45.328030 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-35c7bdaf-ba52-471b-86c3-d5e0258fff2e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:45.328030 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-35c7bdaf-ba52-471b-86c3-d5e0258fff2e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:45.328030 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-35c7bdaf-ba52-471b-86c3-d5e0258fff2e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:45.328030 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-35c7bdaf-ba52-471b-86c3-d5e0258fff2e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:45.457108 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-35c7bdaf-ba52-471b-86c3-d5e0258fff2e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:45.465354 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-35c7bdaf-ba52-471b-86c3-d5e0258fff2e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f" status: 200 len: 1680 microversion: 2.1 time: 0.152822 Oct 23 02:12:45.465940 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3790/7487] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:45 2022] GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:46.489805 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8a7cc047-a41e-476c-a834-610debca7854 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:46.490471 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8a7cc047-a41e-476c-a834-610debca7854 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: e3b4aba9-8dff-4a30-8b42-0ae2f884560f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:46.497923 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a7cc047-a41e-476c-a834-610debca7854 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:46.505222 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a7cc047-a41e-476c-a834-610debca7854 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:46.505222 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a7cc047-a41e-476c-a834-610debca7854 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:46.505222 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a7cc047-a41e-476c-a834-610debca7854 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:46.505222 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a7cc047-a41e-476c-a834-610debca7854 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:46.505222 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a7cc047-a41e-476c-a834-610debca7854 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:46.633312 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8a7cc047-a41e-476c-a834-610debca7854 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:46.641031 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8a7cc047-a41e-476c-a834-610debca7854 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f" status: 200 len: 1680 microversion: 2.1 time: 0.156158 Oct 23 02:12:46.641603 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3698/7488] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:46 2022] GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:47.665522 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-137f5da6-afbf-417f-a312-c227e469d5a5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:47.666192 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-137f5da6-afbf-417f-a312-c227e469d5a5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: e3b4aba9-8dff-4a30-8b42-0ae2f884560f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:47.673169 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-137f5da6-afbf-417f-a312-c227e469d5a5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:47.673734 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-137f5da6-afbf-417f-a312-c227e469d5a5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:47.674129 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-137f5da6-afbf-417f-a312-c227e469d5a5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:47.674825 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-137f5da6-afbf-417f-a312-c227e469d5a5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:47.675285 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-137f5da6-afbf-417f-a312-c227e469d5a5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:47.675714 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-137f5da6-afbf-417f-a312-c227e469d5a5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:47.814040 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-137f5da6-afbf-417f-a312-c227e469d5a5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:47.822152 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-137f5da6-afbf-417f-a312-c227e469d5a5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f" status: 200 len: 1680 microversion: 2.1 time: 0.161056 Oct 23 02:12:47.822905 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3791/7489] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:47 2022] GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:48.846368 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-611fd840-0ffc-4b81-a1d0-e95c29934bb8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:48.846998 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-611fd840-0ffc-4b81-a1d0-e95c29934bb8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: e3b4aba9-8dff-4a30-8b42-0ae2f884560f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:48.853814 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-611fd840-0ffc-4b81-a1d0-e95c29934bb8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:48.854349 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-611fd840-0ffc-4b81-a1d0-e95c29934bb8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:48.854796 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-611fd840-0ffc-4b81-a1d0-e95c29934bb8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:48.855497 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-611fd840-0ffc-4b81-a1d0-e95c29934bb8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:48.855964 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-611fd840-0ffc-4b81-a1d0-e95c29934bb8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:48.856402 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-611fd840-0ffc-4b81-a1d0-e95c29934bb8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:48.982915 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-611fd840-0ffc-4b81-a1d0-e95c29934bb8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:48.990579 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-611fd840-0ffc-4b81-a1d0-e95c29934bb8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f" status: 200 len: 1685 microversion: 2.1 time: 0.148253 Oct 23 02:12:48.991149 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3699/7490] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:48 2022] GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f => generated 1685 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:50.014914 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-88d7211f-4748-43c9-a66c-200c25e8dd59 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:50.015538 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-88d7211f-4748-43c9-a66c-200c25e8dd59 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: e3b4aba9-8dff-4a30-8b42-0ae2f884560f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:50.022441 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-88d7211f-4748-43c9-a66c-200c25e8dd59 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:50.023492 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-88d7211f-4748-43c9-a66c-200c25e8dd59 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:50.023930 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-88d7211f-4748-43c9-a66c-200c25e8dd59 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:50.024617 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-88d7211f-4748-43c9-a66c-200c25e8dd59 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:50.025075 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-88d7211f-4748-43c9-a66c-200c25e8dd59 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:50.025508 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-88d7211f-4748-43c9-a66c-200c25e8dd59 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:50.154319 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-88d7211f-4748-43c9-a66c-200c25e8dd59 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:50.162063 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-88d7211f-4748-43c9-a66c-200c25e8dd59 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f" status: 200 len: 1685 microversion: 2.1 time: 0.151061 Oct 23 02:12:50.162645 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3792/7491] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:50 2022] GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f => generated 1685 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:51.185272 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-27f54ac8-9ee5-456a-a195-b284ca2b6e04 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:51.185905 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-27f54ac8-9ee5-456a-a195-b284ca2b6e04 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: e3b4aba9-8dff-4a30-8b42-0ae2f884560f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:51.193031 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-27f54ac8-9ee5-456a-a195-b284ca2b6e04 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:51.193540 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-27f54ac8-9ee5-456a-a195-b284ca2b6e04 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:51.194019 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-27f54ac8-9ee5-456a-a195-b284ca2b6e04 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:51.194735 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-27f54ac8-9ee5-456a-a195-b284ca2b6e04 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:51.195208 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-27f54ac8-9ee5-456a-a195-b284ca2b6e04 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:51.195648 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-27f54ac8-9ee5-456a-a195-b284ca2b6e04 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:51.326610 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-27f54ac8-9ee5-456a-a195-b284ca2b6e04 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:51.334411 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-27f54ac8-9ee5-456a-a195-b284ca2b6e04 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f" status: 200 len: 1684 microversion: 2.1 time: 0.153003 Oct 23 02:12:51.335000 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3700/7492] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:51 2022] GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:12:51.434649 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-c91bfc44-f9ed-4461-86ee-acd3439896ba req-deeec5de-d908-4417-a50c-dedaeff27ff7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3b4aba9-8dff-4a30-8b42-0ae2f884560f", "name": "network-vif-unplugged", "status": "completed", "tag": "b4c7da24-2a4b-4497-819f-39c253661023"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:12:51.444344 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-c91bfc44-f9ed-4461-86ee-acd3439896ba req-deeec5de-d908-4417-a50c-dedaeff27ff7 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:51.445407 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-c91bfc44-f9ed-4461-86ee-acd3439896ba req-deeec5de-d908-4417-a50c-dedaeff27ff7 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:51.445849 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-c91bfc44-f9ed-4461-86ee-acd3439896ba req-deeec5de-d908-4417-a50c-dedaeff27ff7 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:51.457238 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-c91bfc44-f9ed-4461-86ee-acd3439896ba req-deeec5de-d908-4417-a50c-dedaeff27ff7 service nova] Creating event network-vif-unplugged:b4c7da24-2a4b-4497-819f-39c253661023 for instance e3b4aba9-8dff-4a30-8b42-0ae2f884560f on n-h2-master-1 Oct 23 02:12:51.463124 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [req-c91bfc44-f9ed-4461-86ee-acd3439896ba req-deeec5de-d908-4417-a50c-dedaeff27ff7 service nova] Instance e3b4aba9-8dff-4a30-8b42-0ae2f884560f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120944) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 23 02:12:51.474281 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-c91bfc44-f9ed-4461-86ee-acd3439896ba req-deeec5de-d908-4417-a50c-dedaeff27ff7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043295 Oct 23 02:12:51.479922 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3793/7493] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:12:52.359116 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7affa327-a921-44ba-ac86-d3c9c2febc72 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:52.359774 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7affa327-a921-44ba-ac86-d3c9c2febc72 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: e3b4aba9-8dff-4a30-8b42-0ae2f884560f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:52.366257 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7affa327-a921-44ba-ac86-d3c9c2febc72 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:52.367320 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7affa327-a921-44ba-ac86-d3c9c2febc72 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:52.367780 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7affa327-a921-44ba-ac86-d3c9c2febc72 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:52.368488 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7affa327-a921-44ba-ac86-d3c9c2febc72 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:52.368974 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7affa327-a921-44ba-ac86-d3c9c2febc72 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:52.369398 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7affa327-a921-44ba-ac86-d3c9c2febc72 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:52.502589 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7affa327-a921-44ba-ac86-d3c9c2febc72 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:52.510473 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7affa327-a921-44ba-ac86-d3c9c2febc72 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f" status: 200 len: 1684 microversion: 2.1 time: 0.155223 Oct 23 02:12:52.511059 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3701/7494] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:52 2022] GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:53.489725 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-66212659-ae76-408b-8985-7b163c419d90 req-54c4cc50-d6db-40dd-ba5f-610b9f17fbf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3b4aba9-8dff-4a30-8b42-0ae2f884560f", "tag": "b4c7da24-2a4b-4497-819f-39c253661023"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:12:53.499668 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-66212659-ae76-408b-8985-7b163c419d90 req-54c4cc50-d6db-40dd-ba5f-610b9f17fbf1 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:53.500155 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-66212659-ae76-408b-8985-7b163c419d90 req-54c4cc50-d6db-40dd-ba5f-610b9f17fbf1 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:53.505673 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-66212659-ae76-408b-8985-7b163c419d90 req-54c4cc50-d6db-40dd-ba5f-610b9f17fbf1 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:53.512637 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-66212659-ae76-408b-8985-7b163c419d90 req-54c4cc50-d6db-40dd-ba5f-610b9f17fbf1 service nova] Creating event network-changed:b4c7da24-2a4b-4497-819f-39c253661023 for instance e3b4aba9-8dff-4a30-8b42-0ae2f884560f on n-h2-master-1 Oct 23 02:12:53.517988 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [req-66212659-ae76-408b-8985-7b163c419d90 req-54c4cc50-d6db-40dd-ba5f-610b9f17fbf1 service nova] Instance e3b4aba9-8dff-4a30-8b42-0ae2f884560f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120944) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 23 02:12:53.528767 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-66212659-ae76-408b-8985-7b163c419d90 req-54c4cc50-d6db-40dd-ba5f-610b9f17fbf1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043950 Oct 23 02:12:53.531602 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3794/7495] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:12:53.535890 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5645e087-0a3d-4d22-b53e-d2840a3aad63 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:53.536697 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5645e087-0a3d-4d22-b53e-d2840a3aad63 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: e3b4aba9-8dff-4a30-8b42-0ae2f884560f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:53.544617 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5645e087-0a3d-4d22-b53e-d2840a3aad63 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:53.545121 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5645e087-0a3d-4d22-b53e-d2840a3aad63 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:53.545569 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5645e087-0a3d-4d22-b53e-d2840a3aad63 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:53.546302 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5645e087-0a3d-4d22-b53e-d2840a3aad63 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:53.546768 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5645e087-0a3d-4d22-b53e-d2840a3aad63 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:53.547207 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5645e087-0a3d-4d22-b53e-d2840a3aad63 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:53.680768 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5645e087-0a3d-4d22-b53e-d2840a3aad63 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:53.688946 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5645e087-0a3d-4d22-b53e-d2840a3aad63 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f" status: 200 len: 1682 microversion: 2.1 time: 0.157687 Oct 23 02:12:53.689543 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3702/7496] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:53 2022] GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:54.711130 n-d-master-1 devstack@n-api.service[120944]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 23 02:12:54.711735 n-d-master-1 devstack@n-api.service[120944]: Sun Oct 23 02:12:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f (ip 10.222.0.42) !!! Oct 23 02:12:54.718123 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a611164a-16e4-40e5-8f6b-1ec9be5c17f9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:54.718864 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a611164a-16e4-40e5-8f6b-1ec9be5c17f9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: e3b4aba9-8dff-4a30-8b42-0ae2f884560f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:54.726612 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a611164a-16e4-40e5-8f6b-1ec9be5c17f9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:54.727121 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a611164a-16e4-40e5-8f6b-1ec9be5c17f9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:54.727538 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a611164a-16e4-40e5-8f6b-1ec9be5c17f9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:54.728223 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a611164a-16e4-40e5-8f6b-1ec9be5c17f9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:54.728675 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a611164a-16e4-40e5-8f6b-1ec9be5c17f9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:54.729097 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a611164a-16e4-40e5-8f6b-1ec9be5c17f9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:54.861887 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a611164a-16e4-40e5-8f6b-1ec9be5c17f9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:54.870340 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a611164a-16e4-40e5-8f6b-1ec9be5c17f9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f" status: 200 len: 1678 microversion: 2.1 time: 0.161290 Oct 23 02:12:54.870914 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3795/7497] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:54 2022] GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:54.893776 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-353398c7-a26b-4c9a-bd3e-1d995b9fa68e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:12:54.894367 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-353398c7-a26b-4c9a-bd3e-1d995b9fa68e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: e3b4aba9-8dff-4a30-8b42-0ae2f884560f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:54.901152 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-353398c7-a26b-4c9a-bd3e-1d995b9fa68e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:54.901681 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-353398c7-a26b-4c9a-bd3e-1d995b9fa68e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:54.902167 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-353398c7-a26b-4c9a-bd3e-1d995b9fa68e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:54.902872 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-353398c7-a26b-4c9a-bd3e-1d995b9fa68e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:54.903348 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-353398c7-a26b-4c9a-bd3e-1d995b9fa68e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:54.903786 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-353398c7-a26b-4c9a-bd3e-1d995b9fa68e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:55.061243 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-353398c7-a26b-4c9a-bd3e-1d995b9fa68e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "POST /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f/action" status: 204 len: 0 microversion: 2.1 time: 0.171228 Oct 23 02:12:55.061801 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3703/7498] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:12:54 2022] POST /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f/action => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 02:12:55.073434 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-736dcfcb-f7ad-4294-a91e-c90a2dec85b4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:55.074091 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-736dcfcb-f7ad-4294-a91e-c90a2dec85b4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: e3b4aba9-8dff-4a30-8b42-0ae2f884560f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:55.080318 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-736dcfcb-f7ad-4294-a91e-c90a2dec85b4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:55.080811 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-736dcfcb-f7ad-4294-a91e-c90a2dec85b4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:55.081247 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-736dcfcb-f7ad-4294-a91e-c90a2dec85b4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:55.082003 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-736dcfcb-f7ad-4294-a91e-c90a2dec85b4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:55.082455 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-736dcfcb-f7ad-4294-a91e-c90a2dec85b4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:55.082880 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-736dcfcb-f7ad-4294-a91e-c90a2dec85b4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:55.215503 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-736dcfcb-f7ad-4294-a91e-c90a2dec85b4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:55.223563 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-736dcfcb-f7ad-4294-a91e-c90a2dec85b4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f" status: 200 len: 1678 microversion: 2.1 time: 0.155343 Oct 23 02:12:55.224139 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3796/7499] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:55 2022] GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:56.247606 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-49500dd0-29d4-4a5e-9d4b-16a45a5634ce tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:56.253683 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-49500dd0-29d4-4a5e-9d4b-16a45a5634ce tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: e3b4aba9-8dff-4a30-8b42-0ae2f884560f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:56.255589 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-49500dd0-29d4-4a5e-9d4b-16a45a5634ce tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:56.256231 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-49500dd0-29d4-4a5e-9d4b-16a45a5634ce tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:56.256683 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-49500dd0-29d4-4a5e-9d4b-16a45a5634ce tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:56.257520 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-49500dd0-29d4-4a5e-9d4b-16a45a5634ce tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:56.257839 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-49500dd0-29d4-4a5e-9d4b-16a45a5634ce tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:56.258304 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-49500dd0-29d4-4a5e-9d4b-16a45a5634ce tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:56.262529 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:56.392611 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-49500dd0-29d4-4a5e-9d4b-16a45a5634ce tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:56.401143 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-49500dd0-29d4-4a5e-9d4b-16a45a5634ce tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f" status: 200 len: 1678 microversion: 2.1 time: 0.157774 Oct 23 02:12:56.401719 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3704/7500] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:56 2022] GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:57.424784 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-57e67e7f-d7d4-4c59-9429-f5dee6f990c9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:57.425540 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-57e67e7f-d7d4-4c59-9429-f5dee6f990c9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: e3b4aba9-8dff-4a30-8b42-0ae2f884560f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:57.433137 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-57e67e7f-d7d4-4c59-9429-f5dee6f990c9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:57.433554 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-57e67e7f-d7d4-4c59-9429-f5dee6f990c9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:57.434012 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-57e67e7f-d7d4-4c59-9429-f5dee6f990c9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:57.434709 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-57e67e7f-d7d4-4c59-9429-f5dee6f990c9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:57.435165 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-57e67e7f-d7d4-4c59-9429-f5dee6f990c9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:57.435585 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-57e67e7f-d7d4-4c59-9429-f5dee6f990c9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:57.568244 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-57e67e7f-d7d4-4c59-9429-f5dee6f990c9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:57.575990 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-57e67e7f-d7d4-4c59-9429-f5dee6f990c9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f" status: 200 len: 1657 microversion: 2.1 time: 0.155144 Oct 23 02:12:57.576560 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3797/7501] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:57 2022] GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f => generated 1657 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:57.598564 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2a81d1c5-6713-4dbc-9baa-0dfbce3f37bf tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:57.599214 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2a81d1c5-6713-4dbc-9baa-0dfbce3f37bf tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: e3b4aba9-8dff-4a30-8b42-0ae2f884560f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:57.606441 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2a81d1c5-6713-4dbc-9baa-0dfbce3f37bf tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:57.606935 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2a81d1c5-6713-4dbc-9baa-0dfbce3f37bf tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:57.607378 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2a81d1c5-6713-4dbc-9baa-0dfbce3f37bf tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:57.608099 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2a81d1c5-6713-4dbc-9baa-0dfbce3f37bf tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:57.608562 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2a81d1c5-6713-4dbc-9baa-0dfbce3f37bf tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:57.608995 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2a81d1c5-6713-4dbc-9baa-0dfbce3f37bf tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:57.737043 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2a81d1c5-6713-4dbc-9baa-0dfbce3f37bf tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:57.745212 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2a81d1c5-6713-4dbc-9baa-0dfbce3f37bf tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f" status: 200 len: 1657 microversion: 2.1 time: 0.150420 Oct 23 02:12:57.746190 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3705/7502] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:57 2022] GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f => generated 1657 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:57.768730 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-97f16a5c-9c2e-4cbe-8dec-35fbc2491d41 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:12:57.775378 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-97f16a5c-9c2e-4cbe-8dec-35fbc2491d41 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:57.775861 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-97f16a5c-9c2e-4cbe-8dec-35fbc2491d41 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:57.776301 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-97f16a5c-9c2e-4cbe-8dec-35fbc2491d41 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:57.798589 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-97f16a5c-9c2e-4cbe-8dec-35fbc2491d41 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: e3b4aba9-8dff-4a30-8b42-0ae2f884560f] Going to try to start instance {{(pid=120944) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 23 02:12:58.011537 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-97f16a5c-9c2e-4cbe-8dec-35fbc2491d41 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "POST /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f/action" status: 202 len: 0 microversion: 2.1 time: 0.246460 Oct 23 02:12:58.012146 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3798/7503] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:12:57 2022] POST /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:12:58.021283 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e2e3f26d-7d91-43a9-a762-2746b4143414 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:58.021911 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e2e3f26d-7d91-43a9-a762-2746b4143414 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: e3b4aba9-8dff-4a30-8b42-0ae2f884560f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:58.028748 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e2e3f26d-7d91-43a9-a762-2746b4143414 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:58.029246 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e2e3f26d-7d91-43a9-a762-2746b4143414 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:58.029694 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e2e3f26d-7d91-43a9-a762-2746b4143414 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:58.030433 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e2e3f26d-7d91-43a9-a762-2746b4143414 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:58.030895 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e2e3f26d-7d91-43a9-a762-2746b4143414 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:58.031326 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e2e3f26d-7d91-43a9-a762-2746b4143414 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:58.166470 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e2e3f26d-7d91-43a9-a762-2746b4143414 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:58.174488 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e2e3f26d-7d91-43a9-a762-2746b4143414 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f" status: 200 len: 1666 microversion: 2.1 time: 0.157943 Oct 23 02:12:58.175069 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3706/7504] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:58 2022] GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f => generated 1666 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:58.868143 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-ea0f39a0-7799-4ffd-a5ba-19c79308b9a3 req-6f636083-6204-4984-b71b-e3138051cdeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3b4aba9-8dff-4a30-8b42-0ae2f884560f", "name": "network-vif-plugged", "status": "completed", "tag": "b4c7da24-2a4b-4497-819f-39c253661023"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:12:58.877836 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-ea0f39a0-7799-4ffd-a5ba-19c79308b9a3 req-6f636083-6204-4984-b71b-e3138051cdeb service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:58.878453 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-ea0f39a0-7799-4ffd-a5ba-19c79308b9a3 req-6f636083-6204-4984-b71b-e3138051cdeb service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:58.878881 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-ea0f39a0-7799-4ffd-a5ba-19c79308b9a3 req-6f636083-6204-4984-b71b-e3138051cdeb service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:58.893049 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-ea0f39a0-7799-4ffd-a5ba-19c79308b9a3 req-6f636083-6204-4984-b71b-e3138051cdeb service nova] Creating event network-vif-plugged:b4c7da24-2a4b-4497-819f-39c253661023 for instance e3b4aba9-8dff-4a30-8b42-0ae2f884560f on n-h2-master-1 Oct 23 02:12:58.898890 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-ea0f39a0-7799-4ffd-a5ba-19c79308b9a3 req-6f636083-6204-4984-b71b-e3138051cdeb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035817 Oct 23 02:12:58.899487 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3799/7505] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:12:59.197485 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b6081175-7cc6-4bac-97da-7593cbebc282 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:59.198047 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b6081175-7cc6-4bac-97da-7593cbebc282 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: e3b4aba9-8dff-4a30-8b42-0ae2f884560f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:59.204917 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b6081175-7cc6-4bac-97da-7593cbebc282 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:59.205412 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b6081175-7cc6-4bac-97da-7593cbebc282 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:59.205852 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b6081175-7cc6-4bac-97da-7593cbebc282 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:59.206715 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b6081175-7cc6-4bac-97da-7593cbebc282 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:59.207209 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b6081175-7cc6-4bac-97da-7593cbebc282 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:59.207645 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b6081175-7cc6-4bac-97da-7593cbebc282 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:59.340290 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b6081175-7cc6-4bac-97da-7593cbebc282 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:59.348183 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b6081175-7cc6-4bac-97da-7593cbebc282 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f" status: 200 len: 1666 microversion: 2.1 time: 0.155252 Oct 23 02:12:59.348767 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3707/7506] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:59 2022] GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f => generated 1666 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:00.372824 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-20b77e14-a2f9-4d0a-9e8e-f02014ddeff9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:00.373563 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-20b77e14-a2f9-4d0a-9e8e-f02014ddeff9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: e3b4aba9-8dff-4a30-8b42-0ae2f884560f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:00.380610 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20b77e14-a2f9-4d0a-9e8e-f02014ddeff9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:00.381099 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20b77e14-a2f9-4d0a-9e8e-f02014ddeff9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:00.382096 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20b77e14-a2f9-4d0a-9e8e-f02014ddeff9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:00.382791 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20b77e14-a2f9-4d0a-9e8e-f02014ddeff9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:00.383249 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20b77e14-a2f9-4d0a-9e8e-f02014ddeff9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:00.383679 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-20b77e14-a2f9-4d0a-9e8e-f02014ddeff9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:00.511272 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-20b77e14-a2f9-4d0a-9e8e-f02014ddeff9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:00.514861 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:00.519573 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-20b77e14-a2f9-4d0a-9e8e-f02014ddeff9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f" status: 200 len: 1670 microversion: 2.1 time: 0.150990 Oct 23 02:13:00.520156 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3800/7507] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:00 2022] GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f => generated 1670 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:00.542729 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3edc5e65-a2a9-4302-80b7-c4f21d2e3270 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:00.543259 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3edc5e65-a2a9-4302-80b7-c4f21d2e3270 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: e3b4aba9-8dff-4a30-8b42-0ae2f884560f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:00.550000 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3edc5e65-a2a9-4302-80b7-c4f21d2e3270 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:00.550502 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3edc5e65-a2a9-4302-80b7-c4f21d2e3270 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:00.550948 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3edc5e65-a2a9-4302-80b7-c4f21d2e3270 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:00.551635 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3edc5e65-a2a9-4302-80b7-c4f21d2e3270 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:00.552114 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3edc5e65-a2a9-4302-80b7-c4f21d2e3270 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:00.552523 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3edc5e65-a2a9-4302-80b7-c4f21d2e3270 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:00.577680 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3edc5e65-a2a9-4302-80b7-c4f21d2e3270 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: e3b4aba9-8dff-4a30-8b42-0ae2f884560f] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 02:13:00.804921 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3edc5e65-a2a9-4302-80b7-c4f21d2e3270 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f" status: 204 len: 0 microversion: 2.1 time: 0.265682 Oct 23 02:13:00.805523 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3708/7508] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 02:13:00 2022] DELETE /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 02:13:00.814361 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-345d9394-2833-4076-8048-b1b6ad1fa01a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:00.815050 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-345d9394-2833-4076-8048-b1b6ad1fa01a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: e3b4aba9-8dff-4a30-8b42-0ae2f884560f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:00.822067 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-345d9394-2833-4076-8048-b1b6ad1fa01a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:00.822557 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-345d9394-2833-4076-8048-b1b6ad1fa01a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:00.822999 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-345d9394-2833-4076-8048-b1b6ad1fa01a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:00.823693 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-345d9394-2833-4076-8048-b1b6ad1fa01a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:00.824150 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-345d9394-2833-4076-8048-b1b6ad1fa01a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:00.824578 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-345d9394-2833-4076-8048-b1b6ad1fa01a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:00.954699 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-345d9394-2833-4076-8048-b1b6ad1fa01a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:00.962487 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-345d9394-2833-4076-8048-b1b6ad1fa01a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f" status: 200 len: 1676 microversion: 2.1 time: 0.152383 Oct 23 02:13:00.963057 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3801/7509] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:00 2022] GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:01.986699 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-26b835b8-dd5b-4f0f-9a95-c1301335c3d9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:01.987450 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-26b835b8-dd5b-4f0f-9a95-c1301335c3d9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: e3b4aba9-8dff-4a30-8b42-0ae2f884560f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:01.994443 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-26b835b8-dd5b-4f0f-9a95-c1301335c3d9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:01.994953 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-26b835b8-dd5b-4f0f-9a95-c1301335c3d9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:01.995405 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-26b835b8-dd5b-4f0f-9a95-c1301335c3d9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:01.996123 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-26b835b8-dd5b-4f0f-9a95-c1301335c3d9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:01.996628 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-26b835b8-dd5b-4f0f-9a95-c1301335c3d9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:01.997073 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-26b835b8-dd5b-4f0f-9a95-c1301335c3d9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:02.134303 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-26b835b8-dd5b-4f0f-9a95-c1301335c3d9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:02.142093 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-26b835b8-dd5b-4f0f-9a95-c1301335c3d9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f" status: 200 len: 1676 microversion: 2.1 time: 0.159713 Oct 23 02:13:02.142682 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3709/7510] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:01 2022] GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:03.166670 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-252e358b-058e-4793-861c-f348f48510c4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:03.167467 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-252e358b-058e-4793-861c-f348f48510c4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: e3b4aba9-8dff-4a30-8b42-0ae2f884560f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:03.174743 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-252e358b-058e-4793-861c-f348f48510c4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:03.175235 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-252e358b-058e-4793-861c-f348f48510c4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:03.175910 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-252e358b-058e-4793-861c-f348f48510c4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:03.176622 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-252e358b-058e-4793-861c-f348f48510c4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:03.177074 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-252e358b-058e-4793-861c-f348f48510c4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:03.177834 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-252e358b-058e-4793-861c-f348f48510c4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:03.247213 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-252e358b-058e-4793-861c-f348f48510c4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:03.257523 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-252e358b-058e-4793-861c-f348f48510c4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f" status: 200 len: 1609 microversion: 2.1 time: 0.095341 Oct 23 02:13:03.266132 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3802/7511] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:03 2022] GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f => generated 1609 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:03.370538 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-844e5bf2-692e-4e46-afae-cd39b3a85fff req-ac29a899-a7e6-472d-9698-b2b7c5f92ef4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3b4aba9-8dff-4a30-8b42-0ae2f884560f", "name": "network-vif-deleted", "tag": "b4c7da24-2a4b-4497-819f-39c253661023"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:13:03.376247 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:03.382485 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-844e5bf2-692e-4e46-afae-cd39b3a85fff req-ac29a899-a7e6-472d-9698-b2b7c5f92ef4 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:03.383881 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-844e5bf2-692e-4e46-afae-cd39b3a85fff req-ac29a899-a7e6-472d-9698-b2b7c5f92ef4 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:03.383881 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-844e5bf2-692e-4e46-afae-cd39b3a85fff req-ac29a899-a7e6-472d-9698-b2b7c5f92ef4 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:03.394750 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-844e5bf2-692e-4e46-afae-cd39b3a85fff req-ac29a899-a7e6-472d-9698-b2b7c5f92ef4 service nova] Creating event network-vif-deleted:b4c7da24-2a4b-4497-819f-39c253661023 for instance e3b4aba9-8dff-4a30-8b42-0ae2f884560f on n-h2-master-1 Oct 23 02:13:03.400322 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-844e5bf2-692e-4e46-afae-cd39b3a85fff req-ac29a899-a7e6-472d-9698-b2b7c5f92ef4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033443 Oct 23 02:13:03.400947 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3710/7512] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:13:04.280919 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e796ac1b-9d9c-42e0-93c0-903b7ab3ae53 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:04.281559 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e796ac1b-9d9c-42e0-93c0-903b7ab3ae53 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: e3b4aba9-8dff-4a30-8b42-0ae2f884560f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:04.284369 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=39 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:04.289590 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e796ac1b-9d9c-42e0-93c0-903b7ab3ae53 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:04.290106 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e796ac1b-9d9c-42e0-93c0-903b7ab3ae53 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:04.290553 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e796ac1b-9d9c-42e0-93c0-903b7ab3ae53 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:04.293705 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e796ac1b-9d9c-42e0-93c0-903b7ab3ae53 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:04.293705 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e796ac1b-9d9c-42e0-93c0-903b7ab3ae53 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:04.293705 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e796ac1b-9d9c-42e0-93c0-903b7ab3ae53 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:04.306194 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-e796ac1b-9d9c-42e0-93c0-903b7ab3ae53 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] HTTP exception thrown: Instance e3b4aba9-8dff-4a30-8b42-0ae2f884560f could not be found. Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e796ac1b-9d9c-42e0-93c0-903b7ab3ae53 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Request method failure captured: Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f HTTP/1.1 Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVKKL3Yj8jOjD4nOjvPlV-Y9scyqq13fojDyVX3OBbve73h4rlqC2R6Nmg1gkZUj_81md5ukYTWK0OLLvV2V5x7EROs1jhxmCCEm-g9iyFEqoOdE1VQeo6XR_54_6ol8SgxaBnJdqCRkZgpHF9-UuD1N8MWY5NbSWQIdQH83g6nBVV_w Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 03ca20e778cf488baea3d1e0505cd492 Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServerActionsTestJSON-1383606630 Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/03ca20e778cf488baea3d1e0505cd492"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_03ca20e778cf488baea3d1e0505cd492"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/03ca20e778cf488baea3d1e0505cd492"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/03ca20e778cf488baea3d1e0505cd492"}]}] Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServerActionsTestJSON-1383606630 Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 03ca20e778cf488baea3d1e0505cd492 Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServerActionsTestJSON-1383606630 Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServerActionsTestJSON-1383606630-project Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 8d11ce8077ca4566ba823eac0882c34f Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServerActionsTestJSON-1383606630-project Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: exception: Instance e3b4aba9-8dff-4a30-8b42-0ae2f884560f could not be found. Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'e3b4aba9-8dff-4a30-8b42-0ae2f884560f'} Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3b4aba9-8dff-4a30-8b42-0ae2f884560f could not be found. Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3b4aba9-8dff-4a30-8b42-0ae2f884560f could not be found. Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:13:04.307856 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:13:04.312447 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:13:04.312447 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:13:04.312447 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:13:04.312447 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:13:04.312447 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:13:04.312447 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3b4aba9-8dff-4a30-8b42-0ae2f884560f could not be found. Oct 23 02:13:04.312447 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:13:04.312447 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e796ac1b-9d9c-42e0-93c0-903b7ab3ae53 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Returning 404 to user: Instance e3b4aba9-8dff-4a30-8b42-0ae2f884560f could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:13:04.312447 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e796ac1b-9d9c-42e0-93c0-903b7ab3ae53 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f" status: 404 len: 111 microversion: 2.1 time: 0.032391 Oct 23 02:13:04.312447 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3803/7513] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:04 2022] GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:13:04.326532 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ad4e2924-66a2-487f-a3a4-f1fc7bf452c1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:04.327323 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ad4e2924-66a2-487f-a3a4-f1fc7bf452c1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: e3b4aba9-8dff-4a30-8b42-0ae2f884560f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:04.334168 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ad4e2924-66a2-487f-a3a4-f1fc7bf452c1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:04.334671 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ad4e2924-66a2-487f-a3a4-f1fc7bf452c1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:04.335124 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ad4e2924-66a2-487f-a3a4-f1fc7bf452c1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:04.335830 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ad4e2924-66a2-487f-a3a4-f1fc7bf452c1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:04.336370 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ad4e2924-66a2-487f-a3a4-f1fc7bf452c1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:04.336815 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ad4e2924-66a2-487f-a3a4-f1fc7bf452c1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:04.351113 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-ad4e2924-66a2-487f-a3a4-f1fc7bf452c1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] HTTP exception thrown: Instance e3b4aba9-8dff-4a30-8b42-0ae2f884560f could not be found. Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ad4e2924-66a2-487f-a3a4-f1fc7bf452c1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Request method failure captured: Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f HTTP/1.1 Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVKKL3Yj8jOjD4nOjvPlV-Y9scyqq13fojDyVX3OBbve73h4rlqC2R6Nmg1gkZUj_81md5ukYTWK0OLLvV2V5x7EROs1jhxmCCEm-g9iyFEqoOdE1VQeo6XR_54_6ol8SgxaBnJdqCRkZgpHF9-UuD1N8MWY5NbSWQIdQH83g6nBVV_w Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 03ca20e778cf488baea3d1e0505cd492 Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServerActionsTestJSON-1383606630 Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/03ca20e778cf488baea3d1e0505cd492"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_03ca20e778cf488baea3d1e0505cd492"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/03ca20e778cf488baea3d1e0505cd492"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/03ca20e778cf488baea3d1e0505cd492"}]}] Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServerActionsTestJSON-1383606630 Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 03ca20e778cf488baea3d1e0505cd492 Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServerActionsTestJSON-1383606630 Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServerActionsTestJSON-1383606630-project Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 8d11ce8077ca4566ba823eac0882c34f Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServerActionsTestJSON-1383606630-project Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: exception: Instance e3b4aba9-8dff-4a30-8b42-0ae2f884560f could not be found. Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'e3b4aba9-8dff-4a30-8b42-0ae2f884560f'} Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3b4aba9-8dff-4a30-8b42-0ae2f884560f could not be found. Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3b4aba9-8dff-4a30-8b42-0ae2f884560f could not be found. Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:13:04.352778 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:13:04.366566 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:13:04.366566 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:13:04.366566 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:13:04.366566 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:13:04.366566 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:13:04.366566 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3b4aba9-8dff-4a30-8b42-0ae2f884560f could not be found. Oct 23 02:13:04.366566 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:13:04.366566 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ad4e2924-66a2-487f-a3a4-f1fc7bf452c1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Returning 404 to user: Instance e3b4aba9-8dff-4a30-8b42-0ae2f884560f could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:13:04.366566 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ad4e2924-66a2-487f-a3a4-f1fc7bf452c1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f" status: 404 len: 111 microversion: 2.1 time: 0.032096 Oct 23 02:13:04.366566 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3711/7514] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:04 2022] GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:13:04.403171 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ab1cc127-1562-4e32-b8f4-c6f5acf360d6 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1242492685", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "f26ee581-835e-4450-9de2-8238925be6fc"}], "security_groups": [{"name": "tempest-securitygroup--633118967"}], "key_name": "tempest-keypair-1840206196", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:13:04.515506 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-ab1cc127-1562-4e32-b8f4-c6f5acf360d6 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] validate_networks() for [('f26ee581-835e-4450-9de2-8238925be6fc', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 02:13:05.140144 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-ab1cc127-1562-4e32-b8f4-c6f5acf360d6 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:13:05.140568 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-ab1cc127-1562-4e32-b8f4-c6f5acf360d6 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:13:05.141044 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-ab1cc127-1562-4e32-b8f4-c6f5acf360d6 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:13:05.141459 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-ab1cc127-1562-4e32-b8f4-c6f5acf360d6 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:13:05.141874 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-ab1cc127-1562-4e32-b8f4-c6f5acf360d6 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:13:05.151376 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab1cc127-1562-4e32-b8f4-c6f5acf360d6 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:05.151862 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab1cc127-1562-4e32-b8f4-c6f5acf360d6 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:05.152313 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab1cc127-1562-4e32-b8f4-c6f5acf360d6 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:05.153018 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab1cc127-1562-4e32-b8f4-c6f5acf360d6 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:05.153471 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab1cc127-1562-4e32-b8f4-c6f5acf360d6 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:05.153894 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab1cc127-1562-4e32-b8f4-c6f5acf360d6 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:05.170262 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-ab1cc127-1562-4e32-b8f4-c6f5acf360d6 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Getting quotas for project 03ca20e778cf488baea3d1e0505cd492. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:13:05.175569 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-ab1cc127-1562-4e32-b8f4-c6f5acf360d6 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Getting quotas for user 8d11ce8077ca4566ba823eac0882c34f and project 03ca20e778cf488baea3d1e0505cd492. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:13:05.188487 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ab1cc127-1562-4e32-b8f4-c6f5acf360d6 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 02:13:05.190832 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ab1cc127-1562-4e32-b8f4-c6f5acf360d6 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 02:13:05.315218 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ab1cc127-1562-4e32-b8f4-c6f5acf360d6 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.916366 Oct 23 02:13:05.316267 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3804/7515] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 02:13:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 918 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 02:13:05.328464 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9c6b5864-5f38-4d60-94d5-15837b6a6426 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:05.329092 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9c6b5864-5f38-4d60-94d5-15837b6a6426 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:05.388386 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9c6b5864-5f38-4d60-94d5-15837b6a6426 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:05.395579 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9c6b5864-5f38-4d60-94d5-15837b6a6426 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e" status: 200 len: 1239 microversion: 2.1 time: 0.071538 Oct 23 02:13:05.396186 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3712/7516] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:05 2022] GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e => generated 1239 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:06.419619 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-10294047-d48a-4f96-a891-a923540188ca tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:06.420269 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-10294047-d48a-4f96-a891-a923540188ca tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:06.427309 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-10294047-d48a-4f96-a891-a923540188ca tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:06.427803 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-10294047-d48a-4f96-a891-a923540188ca tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:06.428247 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-10294047-d48a-4f96-a891-a923540188ca tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:06.428943 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-10294047-d48a-4f96-a891-a923540188ca tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:06.429400 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-10294047-d48a-4f96-a891-a923540188ca tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:06.429829 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-10294047-d48a-4f96-a891-a923540188ca tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:06.492732 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-10294047-d48a-4f96-a891-a923540188ca tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:06.500629 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-10294047-d48a-4f96-a891-a923540188ca tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e" status: 200 len: 1235 microversion: 2.1 time: 0.085682 Oct 23 02:13:06.501204 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3805/7517] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:06 2022] GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e => generated 1235 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:07.527004 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-801158ba-79d0-4661-b644-2449769b6e5f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:07.527640 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-801158ba-79d0-4661-b644-2449769b6e5f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:07.535707 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-801158ba-79d0-4661-b644-2449769b6e5f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:07.536214 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-801158ba-79d0-4661-b644-2449769b6e5f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:07.543529 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-801158ba-79d0-4661-b644-2449769b6e5f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:07.543529 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-801158ba-79d0-4661-b644-2449769b6e5f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:07.543529 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-801158ba-79d0-4661-b644-2449769b6e5f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:07.543529 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-801158ba-79d0-4661-b644-2449769b6e5f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:07.613741 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-801158ba-79d0-4661-b644-2449769b6e5f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:07.623587 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-801158ba-79d0-4661-b644-2449769b6e5f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e" status: 200 len: 1309 microversion: 2.1 time: 0.098566 Oct 23 02:13:07.623587 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3713/7518] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:07 2022] GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e => generated 1309 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:08.645345 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-adce2f6a-86f1-4057-a291-05e5857da343 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:08.645987 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-adce2f6a-86f1-4057-a291-05e5857da343 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:08.653669 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-adce2f6a-86f1-4057-a291-05e5857da343 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:08.654187 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-adce2f6a-86f1-4057-a291-05e5857da343 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:08.654626 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-adce2f6a-86f1-4057-a291-05e5857da343 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:08.655398 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-adce2f6a-86f1-4057-a291-05e5857da343 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:08.655789 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-adce2f6a-86f1-4057-a291-05e5857da343 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:08.656212 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-adce2f6a-86f1-4057-a291-05e5857da343 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:08.788903 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-adce2f6a-86f1-4057-a291-05e5857da343 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:08.796816 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-adce2f6a-86f1-4057-a291-05e5857da343 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e" status: 200 len: 1364 microversion: 2.1 time: 0.155403 Oct 23 02:13:08.797588 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3806/7519] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:08 2022] GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:09.010677 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-860e2ea8-35d0-4569-83ac-7ba3146956d3 req-0c745de9-6cf9-4701-98a2-7790aef8978b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7828c675-6af7-4c11-83bf-c25978fc7e5e", "tag": "cfc5e5a6-7e72-41fb-832a-ae0b145ae8b6"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:13:09.021431 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-860e2ea8-35d0-4569-83ac-7ba3146956d3 req-0c745de9-6cf9-4701-98a2-7790aef8978b service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:09.021935 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-860e2ea8-35d0-4569-83ac-7ba3146956d3 req-0c745de9-6cf9-4701-98a2-7790aef8978b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:09.022436 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-860e2ea8-35d0-4569-83ac-7ba3146956d3 req-0c745de9-6cf9-4701-98a2-7790aef8978b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:09.034028 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-860e2ea8-35d0-4569-83ac-7ba3146956d3 req-0c745de9-6cf9-4701-98a2-7790aef8978b service nova] Creating event network-changed:cfc5e5a6-7e72-41fb-832a-ae0b145ae8b6 for instance 7828c675-6af7-4c11-83bf-c25978fc7e5e on n-h1-master-1 Oct 23 02:13:09.039226 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-860e2ea8-35d0-4569-83ac-7ba3146956d3 req-0c745de9-6cf9-4701-98a2-7790aef8978b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033063 Oct 23 02:13:09.039831 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3714/7520] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:13:09.820700 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9fe4269b-5fbb-4a2b-acbf-a681eff4b851 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:09.821330 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9fe4269b-5fbb-4a2b-acbf-a681eff4b851 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:09.828997 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9fe4269b-5fbb-4a2b-acbf-a681eff4b851 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:09.829484 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9fe4269b-5fbb-4a2b-acbf-a681eff4b851 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:09.829954 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9fe4269b-5fbb-4a2b-acbf-a681eff4b851 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:09.830689 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9fe4269b-5fbb-4a2b-acbf-a681eff4b851 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:09.831156 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9fe4269b-5fbb-4a2b-acbf-a681eff4b851 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:09.831614 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9fe4269b-5fbb-4a2b-acbf-a681eff4b851 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:09.966777 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9fe4269b-5fbb-4a2b-acbf-a681eff4b851 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:09.974656 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9fe4269b-5fbb-4a2b-acbf-a681eff4b851 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e" status: 200 len: 1364 microversion: 2.1 time: 0.157968 Oct 23 02:13:09.975867 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3807/7521] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:09 2022] GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:11.000405 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-98de9076-066d-4186-a91d-0d6cc441fad9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:11.001117 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-98de9076-066d-4186-a91d-0d6cc441fad9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:11.007461 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-98de9076-066d-4186-a91d-0d6cc441fad9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:11.007967 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-98de9076-066d-4186-a91d-0d6cc441fad9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:11.008416 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-98de9076-066d-4186-a91d-0d6cc441fad9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:11.009156 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-98de9076-066d-4186-a91d-0d6cc441fad9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:11.009676 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-98de9076-066d-4186-a91d-0d6cc441fad9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:11.010142 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-98de9076-066d-4186-a91d-0d6cc441fad9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:11.140305 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-98de9076-066d-4186-a91d-0d6cc441fad9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:11.147980 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-98de9076-066d-4186-a91d-0d6cc441fad9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e" status: 200 len: 1364 microversion: 2.1 time: 0.152774 Oct 23 02:13:11.148550 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3715/7522] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:10 2022] GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:12.171839 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c59c788c-bed2-4cd2-ba30-ed1c536d65d8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:12.172457 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c59c788c-bed2-4cd2-ba30-ed1c536d65d8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:12.179891 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c59c788c-bed2-4cd2-ba30-ed1c536d65d8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:12.180388 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c59c788c-bed2-4cd2-ba30-ed1c536d65d8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:12.180813 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c59c788c-bed2-4cd2-ba30-ed1c536d65d8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:12.181497 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c59c788c-bed2-4cd2-ba30-ed1c536d65d8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:12.181949 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c59c788c-bed2-4cd2-ba30-ed1c536d65d8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:12.182400 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c59c788c-bed2-4cd2-ba30-ed1c536d65d8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:12.309074 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c59c788c-bed2-4cd2-ba30-ed1c536d65d8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:12.316976 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c59c788c-bed2-4cd2-ba30-ed1c536d65d8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e" status: 200 len: 1364 microversion: 2.1 time: 0.149003 Oct 23 02:13:12.317570 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3808/7523] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:12 2022] GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:13.341745 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a7b15345-ed0b-4f3c-b171-d759f1e346d5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:13.342438 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a7b15345-ed0b-4f3c-b171-d759f1e346d5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:13.349148 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a7b15345-ed0b-4f3c-b171-d759f1e346d5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:13.349635 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a7b15345-ed0b-4f3c-b171-d759f1e346d5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:13.350106 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a7b15345-ed0b-4f3c-b171-d759f1e346d5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:13.350798 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a7b15345-ed0b-4f3c-b171-d759f1e346d5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:13.351260 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a7b15345-ed0b-4f3c-b171-d759f1e346d5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:13.351688 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a7b15345-ed0b-4f3c-b171-d759f1e346d5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:13.481332 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a7b15345-ed0b-4f3c-b171-d759f1e346d5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:13.489198 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a7b15345-ed0b-4f3c-b171-d759f1e346d5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e" status: 200 len: 1364 microversion: 2.1 time: 0.151690 Oct 23 02:13:13.489774 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3716/7524] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:13 2022] GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:14.512947 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a3aab912-e943-4c7c-9419-78f2dd980dc3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:14.513571 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a3aab912-e943-4c7c-9419-78f2dd980dc3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:14.520506 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a3aab912-e943-4c7c-9419-78f2dd980dc3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:14.521001 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a3aab912-e943-4c7c-9419-78f2dd980dc3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:14.521449 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a3aab912-e943-4c7c-9419-78f2dd980dc3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:14.522658 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a3aab912-e943-4c7c-9419-78f2dd980dc3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:14.523123 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a3aab912-e943-4c7c-9419-78f2dd980dc3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:14.523551 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a3aab912-e943-4c7c-9419-78f2dd980dc3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:14.653889 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a3aab912-e943-4c7c-9419-78f2dd980dc3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:14.661839 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a3aab912-e943-4c7c-9419-78f2dd980dc3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e" status: 200 len: 1364 microversion: 2.1 time: 0.153014 Oct 23 02:13:14.662464 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3809/7525] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:14 2022] GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:14.736480 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-a2ca11ff-585a-49ed-a881-ffec116821ea req-6b053d32-fa9f-48ae-8c81-13de2483a2f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7828c675-6af7-4c11-83bf-c25978fc7e5e", "name": "network-vif-plugged", "status": "completed", "tag": "cfc5e5a6-7e72-41fb-832a-ae0b145ae8b6"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:13:14.746684 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-a2ca11ff-585a-49ed-a881-ffec116821ea req-6b053d32-fa9f-48ae-8c81-13de2483a2f2 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:14.747168 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-a2ca11ff-585a-49ed-a881-ffec116821ea req-6b053d32-fa9f-48ae-8c81-13de2483a2f2 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:14.747605 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-a2ca11ff-585a-49ed-a881-ffec116821ea req-6b053d32-fa9f-48ae-8c81-13de2483a2f2 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:14.758916 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-a2ca11ff-585a-49ed-a881-ffec116821ea req-6b053d32-fa9f-48ae-8c81-13de2483a2f2 service nova] Creating event network-vif-plugged:cfc5e5a6-7e72-41fb-832a-ae0b145ae8b6 for instance 7828c675-6af7-4c11-83bf-c25978fc7e5e on n-h1-master-1 Oct 23 02:13:14.764121 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-a2ca11ff-585a-49ed-a881-ffec116821ea req-6b053d32-fa9f-48ae-8c81-13de2483a2f2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031463 Oct 23 02:13:14.764707 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3717/7526] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:13:15.686625 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-692b3cd5-cb90-4b5a-aad0-8e936e851fdc tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:15.687177 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-692b3cd5-cb90-4b5a-aad0-8e936e851fdc tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:15.689033 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:15.689714 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=6 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:15.695355 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-692b3cd5-cb90-4b5a-aad0-8e936e851fdc tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:15.695843 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-692b3cd5-cb90-4b5a-aad0-8e936e851fdc tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:15.696285 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-692b3cd5-cb90-4b5a-aad0-8e936e851fdc tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:15.696974 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-692b3cd5-cb90-4b5a-aad0-8e936e851fdc tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:15.697433 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-692b3cd5-cb90-4b5a-aad0-8e936e851fdc tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:15.697863 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-692b3cd5-cb90-4b5a-aad0-8e936e851fdc tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:15.824541 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-692b3cd5-cb90-4b5a-aad0-8e936e851fdc tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:15.832184 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-692b3cd5-cb90-4b5a-aad0-8e936e851fdc tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e" status: 200 len: 1364 microversion: 2.1 time: 0.149585 Oct 23 02:13:15.832754 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3810/7527] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:15 2022] GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:16.857247 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7c9f3514-aa5d-495e-956c-8292a0d95332 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:16.859157 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7c9f3514-aa5d-495e-956c-8292a0d95332 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:16.860098 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:16.865897 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7c9f3514-aa5d-495e-956c-8292a0d95332 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:16.866424 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7c9f3514-aa5d-495e-956c-8292a0d95332 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:16.866869 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7c9f3514-aa5d-495e-956c-8292a0d95332 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:16.867561 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7c9f3514-aa5d-495e-956c-8292a0d95332 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:16.868030 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7c9f3514-aa5d-495e-956c-8292a0d95332 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:16.869256 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7c9f3514-aa5d-495e-956c-8292a0d95332 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:17.002438 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7c9f3514-aa5d-495e-956c-8292a0d95332 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:17.010098 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7c9f3514-aa5d-495e-956c-8292a0d95332 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e" status: 200 len: 1551 microversion: 2.1 time: 0.157614 Oct 23 02:13:17.010724 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3718/7528] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:16 2022] GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e => generated 1551 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:17.032918 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4e735c69-12e5-4ae0-bcf2-001897d64898 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:17.033438 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4e735c69-12e5-4ae0-bcf2-001897d64898 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:17.040652 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4e735c69-12e5-4ae0-bcf2-001897d64898 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:17.041134 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4e735c69-12e5-4ae0-bcf2-001897d64898 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:17.041568 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4e735c69-12e5-4ae0-bcf2-001897d64898 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:17.042385 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4e735c69-12e5-4ae0-bcf2-001897d64898 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:17.042840 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4e735c69-12e5-4ae0-bcf2-001897d64898 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:17.043264 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4e735c69-12e5-4ae0-bcf2-001897d64898 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:17.119942 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4e735c69-12e5-4ae0-bcf2-001897d64898 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090961 Oct 23 02:13:17.120544 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3811/7529] 10.222.0.42 () {58 vars in 1275 bytes} [Sun Oct 23 02:13:17 2022] GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:13:18.100818 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-7c996bb8-aa07-4953-b248-3998d2c65458 req-2dc50ed5-38b9-4f7b-b4f4-ae367eeef8f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7828c675-6af7-4c11-83bf-c25978fc7e5e", "tag": "cfc5e5a6-7e72-41fb-832a-ae0b145ae8b6"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:13:18.111065 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-7c996bb8-aa07-4953-b248-3998d2c65458 req-2dc50ed5-38b9-4f7b-b4f4-ae367eeef8f5 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:18.111564 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-7c996bb8-aa07-4953-b248-3998d2c65458 req-2dc50ed5-38b9-4f7b-b4f4-ae367eeef8f5 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:18.112009 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-7c996bb8-aa07-4953-b248-3998d2c65458 req-2dc50ed5-38b9-4f7b-b4f4-ae367eeef8f5 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:18.123912 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-7c996bb8-aa07-4953-b248-3998d2c65458 req-2dc50ed5-38b9-4f7b-b4f4-ae367eeef8f5 service nova] Creating event network-changed:cfc5e5a6-7e72-41fb-832a-ae0b145ae8b6 for instance 7828c675-6af7-4c11-83bf-c25978fc7e5e on n-h1-master-1 Oct 23 02:13:18.128847 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-7c996bb8-aa07-4953-b248-3998d2c65458 req-2dc50ed5-38b9-4f7b-b4f4-ae367eeef8f5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031723 Oct 23 02:13:18.129456 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3719/7530] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:13:53.222648 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:53.223376 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=56 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:53.227660 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6972d4b5-1ba4-4dfa-80bf-526799a755eb tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:13:53.230074 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6972d4b5-1ba4-4dfa-80bf-526799a755eb tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:53.237565 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6972d4b5-1ba4-4dfa-80bf-526799a755eb tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:53.237565 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6972d4b5-1ba4-4dfa-80bf-526799a755eb tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:53.237565 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6972d4b5-1ba4-4dfa-80bf-526799a755eb tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:53.237882 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6972d4b5-1ba4-4dfa-80bf-526799a755eb tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:53.238073 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6972d4b5-1ba4-4dfa-80bf-526799a755eb tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:53.238514 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6972d4b5-1ba4-4dfa-80bf-526799a755eb tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:53.267991 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6972d4b5-1ba4-4dfa-80bf-526799a755eb tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:53.273519 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6972d4b5-1ba4-4dfa-80bf-526799a755eb tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Old instance type m1.heat2, new instance type m1.heat {{(pid=120944) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 23 02:13:53.279890 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-6972d4b5-1ba4-4dfa-80bf-526799a755eb tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:13:53.280319 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-6972d4b5-1ba4-4dfa-80bf-526799a755eb tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:13:53.280801 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-6972d4b5-1ba4-4dfa-80bf-526799a755eb tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:13:53.281219 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-6972d4b5-1ba4-4dfa-80bf-526799a755eb tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:13:53.281637 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-6972d4b5-1ba4-4dfa-80bf-526799a755eb tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:13:53.418256 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6972d4b5-1ba4-4dfa-80bf-526799a755eb tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "POST /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e/action" status: 202 len: 0 microversion: 2.1 time: 0.197890 Oct 23 02:13:53.419058 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3812/7531] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:13:53 2022] POST /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:13:53.425721 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=21 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:53.426514 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:53.430775 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b8eda9c0-3fbd-4c5e-ac2d-e0518cc9722c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:53.431500 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b8eda9c0-3fbd-4c5e-ac2d-e0518cc9722c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:53.438212 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b8eda9c0-3fbd-4c5e-ac2d-e0518cc9722c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:53.438729 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b8eda9c0-3fbd-4c5e-ac2d-e0518cc9722c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:53.439176 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b8eda9c0-3fbd-4c5e-ac2d-e0518cc9722c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:53.439887 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b8eda9c0-3fbd-4c5e-ac2d-e0518cc9722c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:53.440359 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b8eda9c0-3fbd-4c5e-ac2d-e0518cc9722c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:53.440825 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b8eda9c0-3fbd-4c5e-ac2d-e0518cc9722c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:53.636225 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b8eda9c0-3fbd-4c5e-ac2d-e0518cc9722c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:53.644600 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b8eda9c0-3fbd-4c5e-ac2d-e0518cc9722c tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e" status: 200 len: 1679 microversion: 2.1 time: 0.221219 Oct 23 02:13:53.645195 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3720/7532] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:53 2022] GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e => generated 1679 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:13:54.669332 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e1932e0a-f391-43f9-86a8-7f4621137a4f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:54.669881 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e1932e0a-f391-43f9-86a8-7f4621137a4f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:54.679513 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e1932e0a-f391-43f9-86a8-7f4621137a4f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:54.680010 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e1932e0a-f391-43f9-86a8-7f4621137a4f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:54.680493 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e1932e0a-f391-43f9-86a8-7f4621137a4f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:54.681195 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e1932e0a-f391-43f9-86a8-7f4621137a4f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:54.681661 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e1932e0a-f391-43f9-86a8-7f4621137a4f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:54.682136 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e1932e0a-f391-43f9-86a8-7f4621137a4f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:54.872304 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e1932e0a-f391-43f9-86a8-7f4621137a4f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:54.880026 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e1932e0a-f391-43f9-86a8-7f4621137a4f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e" status: 200 len: 1679 microversion: 2.1 time: 0.215654 Oct 23 02:13:54.880610 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3813/7533] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:54 2022] GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e => generated 1679 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:55.906695 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6558fb80-e332-4a8b-9d94-9880a6a9398d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:55.907319 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6558fb80-e332-4a8b-9d94-9880a6a9398d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:55.914980 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6558fb80-e332-4a8b-9d94-9880a6a9398d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:55.915724 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6558fb80-e332-4a8b-9d94-9880a6a9398d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:55.916172 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6558fb80-e332-4a8b-9d94-9880a6a9398d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:55.916893 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6558fb80-e332-4a8b-9d94-9880a6a9398d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:55.917362 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6558fb80-e332-4a8b-9d94-9880a6a9398d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:55.917795 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6558fb80-e332-4a8b-9d94-9880a6a9398d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:56.052339 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6558fb80-e332-4a8b-9d94-9880a6a9398d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:56.061105 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6558fb80-e332-4a8b-9d94-9880a6a9398d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e" status: 200 len: 1679 microversion: 2.1 time: 0.159329 Oct 23 02:13:56.061684 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3721/7534] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:55 2022] GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:57.084643 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b59cf02c-447a-45c0-afea-d455a090e8b3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:57.085269 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b59cf02c-447a-45c0-afea-d455a090e8b3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:57.092939 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b59cf02c-447a-45c0-afea-d455a090e8b3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:57.093432 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b59cf02c-447a-45c0-afea-d455a090e8b3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:57.093876 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b59cf02c-447a-45c0-afea-d455a090e8b3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:57.094631 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b59cf02c-447a-45c0-afea-d455a090e8b3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:57.095094 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b59cf02c-447a-45c0-afea-d455a090e8b3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:57.095528 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b59cf02c-447a-45c0-afea-d455a090e8b3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:57.226664 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b59cf02c-447a-45c0-afea-d455a090e8b3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:57.234393 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b59cf02c-447a-45c0-afea-d455a090e8b3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e" status: 200 len: 1684 microversion: 2.1 time: 0.153637 Oct 23 02:13:57.234976 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3814/7535] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:57 2022] GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:58.257415 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b369d516-910e-4c6c-9718-6fd64966ce5a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:58.258076 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b369d516-910e-4c6c-9718-6fd64966ce5a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:58.264934 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b369d516-910e-4c6c-9718-6fd64966ce5a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:58.265433 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b369d516-910e-4c6c-9718-6fd64966ce5a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:58.265889 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b369d516-910e-4c6c-9718-6fd64966ce5a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:58.266627 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b369d516-910e-4c6c-9718-6fd64966ce5a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:58.267100 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b369d516-910e-4c6c-9718-6fd64966ce5a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:58.267539 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b369d516-910e-4c6c-9718-6fd64966ce5a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:58.394201 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b369d516-910e-4c6c-9718-6fd64966ce5a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:58.402509 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b369d516-910e-4c6c-9718-6fd64966ce5a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e" status: 200 len: 1684 microversion: 2.1 time: 0.149001 Oct 23 02:13:58.403085 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3722/7536] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:58 2022] GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e => generated 1684 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:59.425582 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ab504272-0a67-486b-a6db-add1b3476624 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:59.426246 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ab504272-0a67-486b-a6db-add1b3476624 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:59.433845 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab504272-0a67-486b-a6db-add1b3476624 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:59.434355 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab504272-0a67-486b-a6db-add1b3476624 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:59.434793 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab504272-0a67-486b-a6db-add1b3476624 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:59.435480 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab504272-0a67-486b-a6db-add1b3476624 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:59.435929 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab504272-0a67-486b-a6db-add1b3476624 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:59.436350 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab504272-0a67-486b-a6db-add1b3476624 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:59.563436 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ab504272-0a67-486b-a6db-add1b3476624 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:59.571141 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ab504272-0a67-486b-a6db-add1b3476624 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e" status: 200 len: 1684 microversion: 2.1 time: 0.149443 Oct 23 02:13:59.571730 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3815/7537] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:59 2022] GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e => generated 1684 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:00.594922 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bc69823b-16e4-4058-945f-9ebb40866c0a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:00.595556 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-bc69823b-16e4-4058-945f-9ebb40866c0a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:00.602465 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bc69823b-16e4-4058-945f-9ebb40866c0a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:00.602974 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bc69823b-16e4-4058-945f-9ebb40866c0a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:00.603458 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bc69823b-16e4-4058-945f-9ebb40866c0a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:00.604167 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bc69823b-16e4-4058-945f-9ebb40866c0a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:00.604640 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bc69823b-16e4-4058-945f-9ebb40866c0a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:00.605081 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bc69823b-16e4-4058-945f-9ebb40866c0a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:00.737765 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bc69823b-16e4-4058-945f-9ebb40866c0a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:00.745951 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bc69823b-16e4-4058-945f-9ebb40866c0a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e" status: 200 len: 1684 microversion: 2.1 time: 0.154987 Oct 23 02:14:00.746542 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3723/7538] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:00 2022] GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:01.770067 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-21effbce-32c9-4e67-893e-c92f39b187f4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:01.770636 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-21effbce-32c9-4e67-893e-c92f39b187f4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:01.778029 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-21effbce-32c9-4e67-893e-c92f39b187f4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:01.778516 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-21effbce-32c9-4e67-893e-c92f39b187f4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:01.778948 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-21effbce-32c9-4e67-893e-c92f39b187f4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:01.779633 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-21effbce-32c9-4e67-893e-c92f39b187f4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:01.780082 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-21effbce-32c9-4e67-893e-c92f39b187f4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:01.780500 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-21effbce-32c9-4e67-893e-c92f39b187f4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:01.908658 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-21effbce-32c9-4e67-893e-c92f39b187f4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:01.916498 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-21effbce-32c9-4e67-893e-c92f39b187f4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e" status: 200 len: 1684 microversion: 2.1 time: 0.150448 Oct 23 02:14:01.917168 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3816/7539] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:01 2022] GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:02.939867 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4ef93b53-7c72-4d1f-a68e-72a5b76ea6ef tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:02.940499 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4ef93b53-7c72-4d1f-a68e-72a5b76ea6ef tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:02.947458 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4ef93b53-7c72-4d1f-a68e-72a5b76ea6ef tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:02.948579 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4ef93b53-7c72-4d1f-a68e-72a5b76ea6ef tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:02.949035 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4ef93b53-7c72-4d1f-a68e-72a5b76ea6ef tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:02.949744 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4ef93b53-7c72-4d1f-a68e-72a5b76ea6ef tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:02.950246 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4ef93b53-7c72-4d1f-a68e-72a5b76ea6ef tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:02.950693 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4ef93b53-7c72-4d1f-a68e-72a5b76ea6ef tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:03.080273 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4ef93b53-7c72-4d1f-a68e-72a5b76ea6ef tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:03.088096 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4ef93b53-7c72-4d1f-a68e-72a5b76ea6ef tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e" status: 200 len: 1684 microversion: 2.1 time: 0.152117 Oct 23 02:14:03.088809 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3724/7540] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:02 2022] GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:04.111936 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-206cf380-1fdc-4b97-9710-4b5e0f72691b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:04.112561 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-206cf380-1fdc-4b97-9710-4b5e0f72691b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:04.119581 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-206cf380-1fdc-4b97-9710-4b5e0f72691b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:04.120676 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-206cf380-1fdc-4b97-9710-4b5e0f72691b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:04.121118 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-206cf380-1fdc-4b97-9710-4b5e0f72691b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:04.121843 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-206cf380-1fdc-4b97-9710-4b5e0f72691b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:04.122332 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-206cf380-1fdc-4b97-9710-4b5e0f72691b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:04.122763 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-206cf380-1fdc-4b97-9710-4b5e0f72691b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:04.249055 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-206cf380-1fdc-4b97-9710-4b5e0f72691b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:04.256870 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-206cf380-1fdc-4b97-9710-4b5e0f72691b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e" status: 200 len: 1684 microversion: 2.1 time: 0.148840 Oct 23 02:14:04.257457 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3817/7541] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:04 2022] GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e => generated 1684 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:05.280743 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-22ccd2e0-25e5-4bda-aa3c-7a5cb5c4f0e5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:05.281376 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-22ccd2e0-25e5-4bda-aa3c-7a5cb5c4f0e5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:05.288171 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-22ccd2e0-25e5-4bda-aa3c-7a5cb5c4f0e5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:05.288664 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-22ccd2e0-25e5-4bda-aa3c-7a5cb5c4f0e5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:05.289107 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-22ccd2e0-25e5-4bda-aa3c-7a5cb5c4f0e5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:05.289805 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-22ccd2e0-25e5-4bda-aa3c-7a5cb5c4f0e5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:05.290292 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-22ccd2e0-25e5-4bda-aa3c-7a5cb5c4f0e5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:05.290723 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-22ccd2e0-25e5-4bda-aa3c-7a5cb5c4f0e5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:05.427372 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-22ccd2e0-25e5-4bda-aa3c-7a5cb5c4f0e5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:05.435771 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-22ccd2e0-25e5-4bda-aa3c-7a5cb5c4f0e5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e" status: 200 len: 1684 microversion: 2.1 time: 0.158928 Oct 23 02:14:05.436347 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3725/7542] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:05 2022] GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e => generated 1684 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:06.459170 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b930287f-b7a1-4701-b639-235f5de9e8c1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:06.459825 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b930287f-b7a1-4701-b639-235f5de9e8c1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:06.467540 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b930287f-b7a1-4701-b639-235f5de9e8c1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:06.468028 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b930287f-b7a1-4701-b639-235f5de9e8c1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:06.468470 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b930287f-b7a1-4701-b639-235f5de9e8c1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:06.469215 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b930287f-b7a1-4701-b639-235f5de9e8c1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:06.469677 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b930287f-b7a1-4701-b639-235f5de9e8c1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:06.470161 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b930287f-b7a1-4701-b639-235f5de9e8c1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:06.599725 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b930287f-b7a1-4701-b639-235f5de9e8c1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:06.607543 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b930287f-b7a1-4701-b639-235f5de9e8c1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e" status: 200 len: 1684 microversion: 2.1 time: 0.152315 Oct 23 02:14:06.608119 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3818/7543] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:06 2022] GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:07.630903 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5327bc5f-471c-4181-8e05-e009268ac316 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:07.631565 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5327bc5f-471c-4181-8e05-e009268ac316 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:07.638397 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5327bc5f-471c-4181-8e05-e009268ac316 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:07.638897 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5327bc5f-471c-4181-8e05-e009268ac316 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:07.639349 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5327bc5f-471c-4181-8e05-e009268ac316 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:07.640057 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5327bc5f-471c-4181-8e05-e009268ac316 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:07.640573 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5327bc5f-471c-4181-8e05-e009268ac316 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:07.641013 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5327bc5f-471c-4181-8e05-e009268ac316 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:07.770744 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5327bc5f-471c-4181-8e05-e009268ac316 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:07.778977 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5327bc5f-471c-4181-8e05-e009268ac316 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e" status: 200 len: 1684 microversion: 2.1 time: 0.151958 Oct 23 02:14:07.779554 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3726/7544] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:07 2022] GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:08.808466 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-45658bcc-d5ce-4ca8-b01d-5bfc1a56b71a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:08.809037 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-45658bcc-d5ce-4ca8-b01d-5bfc1a56b71a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:08.815842 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-45658bcc-d5ce-4ca8-b01d-5bfc1a56b71a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:08.816327 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-45658bcc-d5ce-4ca8-b01d-5bfc1a56b71a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:08.816763 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-45658bcc-d5ce-4ca8-b01d-5bfc1a56b71a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:08.817452 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-45658bcc-d5ce-4ca8-b01d-5bfc1a56b71a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:08.817907 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-45658bcc-d5ce-4ca8-b01d-5bfc1a56b71a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:08.818364 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-45658bcc-d5ce-4ca8-b01d-5bfc1a56b71a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:08.951252 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-45658bcc-d5ce-4ca8-b01d-5bfc1a56b71a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:08.958969 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-45658bcc-d5ce-4ca8-b01d-5bfc1a56b71a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e" status: 200 len: 1684 microversion: 2.1 time: 0.155188 Oct 23 02:14:08.959558 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3819/7545] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:08 2022] GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:09.983730 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1c009095-d01f-4d70-8d8c-717e320acd93 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:09.984366 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1c009095-d01f-4d70-8d8c-717e320acd93 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:09.991509 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c009095-d01f-4d70-8d8c-717e320acd93 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:09.992008 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c009095-d01f-4d70-8d8c-717e320acd93 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:09.992454 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c009095-d01f-4d70-8d8c-717e320acd93 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:09.993157 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c009095-d01f-4d70-8d8c-717e320acd93 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:09.993624 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c009095-d01f-4d70-8d8c-717e320acd93 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:09.994095 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c009095-d01f-4d70-8d8c-717e320acd93 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:10.127952 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1c009095-d01f-4d70-8d8c-717e320acd93 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:10.137331 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1c009095-d01f-4d70-8d8c-717e320acd93 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e" status: 200 len: 1684 microversion: 2.1 time: 0.157496 Oct 23 02:14:10.138266 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3727/7546] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:09 2022] GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:11.161170 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-de010419-14f9-41bc-85c5-1e60b7c3ddcc tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:11.161728 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-de010419-14f9-41bc-85c5-1e60b7c3ddcc tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:11.168716 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-de010419-14f9-41bc-85c5-1e60b7c3ddcc tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:11.169212 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-de010419-14f9-41bc-85c5-1e60b7c3ddcc tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:11.169674 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-de010419-14f9-41bc-85c5-1e60b7c3ddcc tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:11.170395 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-de010419-14f9-41bc-85c5-1e60b7c3ddcc tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:11.170858 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-de010419-14f9-41bc-85c5-1e60b7c3ddcc tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:11.171288 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-de010419-14f9-41bc-85c5-1e60b7c3ddcc tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:11.301404 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-de010419-14f9-41bc-85c5-1e60b7c3ddcc tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:11.309747 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-de010419-14f9-41bc-85c5-1e60b7c3ddcc tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e" status: 200 len: 1684 microversion: 2.1 time: 0.152591 Oct 23 02:14:11.310368 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3820/7547] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:11 2022] GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:12.333749 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cd68e460-c009-406d-91a9-6b0a20a53880 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:12.334421 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cd68e460-c009-406d-91a9-6b0a20a53880 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:12.342258 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cd68e460-c009-406d-91a9-6b0a20a53880 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:12.342699 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cd68e460-c009-406d-91a9-6b0a20a53880 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:12.343148 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cd68e460-c009-406d-91a9-6b0a20a53880 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:12.343847 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cd68e460-c009-406d-91a9-6b0a20a53880 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:12.344316 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cd68e460-c009-406d-91a9-6b0a20a53880 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:12.344755 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cd68e460-c009-406d-91a9-6b0a20a53880 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:12.473335 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cd68e460-c009-406d-91a9-6b0a20a53880 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:12.481275 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cd68e460-c009-406d-91a9-6b0a20a53880 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e" status: 200 len: 1684 microversion: 2.1 time: 0.151503 Oct 23 02:14:12.481856 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3728/7548] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:12 2022] GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:13.504826 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-68f9f310-55b2-4c6c-aae1-2bd80647e0ae tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:13.505450 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-68f9f310-55b2-4c6c-aae1-2bd80647e0ae tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:13.512407 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68f9f310-55b2-4c6c-aae1-2bd80647e0ae tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:13.512896 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68f9f310-55b2-4c6c-aae1-2bd80647e0ae tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:13.513337 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68f9f310-55b2-4c6c-aae1-2bd80647e0ae tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:13.514056 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68f9f310-55b2-4c6c-aae1-2bd80647e0ae tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:13.514522 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68f9f310-55b2-4c6c-aae1-2bd80647e0ae tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:13.514951 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-68f9f310-55b2-4c6c-aae1-2bd80647e0ae tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:13.642647 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-68f9f310-55b2-4c6c-aae1-2bd80647e0ae tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:13.650475 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-68f9f310-55b2-4c6c-aae1-2bd80647e0ae tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e" status: 200 len: 1684 microversion: 2.1 time: 0.149612 Oct 23 02:14:13.651562 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3821/7549] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:13 2022] GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e => generated 1684 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:14.675491 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8aa88221-1d0a-409a-9a16-36ce0590f7d8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:14.676245 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8aa88221-1d0a-409a-9a16-36ce0590f7d8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:14.684050 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8aa88221-1d0a-409a-9a16-36ce0590f7d8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:14.684544 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8aa88221-1d0a-409a-9a16-36ce0590f7d8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:14.685051 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8aa88221-1d0a-409a-9a16-36ce0590f7d8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:14.685800 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8aa88221-1d0a-409a-9a16-36ce0590f7d8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:14.686292 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8aa88221-1d0a-409a-9a16-36ce0590f7d8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:14.686724 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8aa88221-1d0a-409a-9a16-36ce0590f7d8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:14.811476 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-fa2d2fdd-270e-4deb-85ac-2de5ddd82916 req-baf4f975-b5c2-4898-8ff4-12b9fb94bed3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7828c675-6af7-4c11-83bf-c25978fc7e5e", "name": "network-vif-unplugged", "status": "completed", "tag": "cfc5e5a6-7e72-41fb-832a-ae0b145ae8b6"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:14:14.822745 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-fa2d2fdd-270e-4deb-85ac-2de5ddd82916 req-baf4f975-b5c2-4898-8ff4-12b9fb94bed3 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:14.823264 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-fa2d2fdd-270e-4deb-85ac-2de5ddd82916 req-baf4f975-b5c2-4898-8ff4-12b9fb94bed3 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:14.823726 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-fa2d2fdd-270e-4deb-85ac-2de5ddd82916 req-baf4f975-b5c2-4898-8ff4-12b9fb94bed3 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:14.824916 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8aa88221-1d0a-409a-9a16-36ce0590f7d8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:14.832968 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8aa88221-1d0a-409a-9a16-36ce0590f7d8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e" status: 200 len: 1683 microversion: 2.1 time: 0.161384 Oct 23 02:14:14.833765 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3729/7550] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:14 2022] GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:14.837023 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-fa2d2fdd-270e-4deb-85ac-2de5ddd82916 req-baf4f975-b5c2-4898-8ff4-12b9fb94bed3 service nova] Creating event network-vif-unplugged:cfc5e5a6-7e72-41fb-832a-ae0b145ae8b6 for instance 7828c675-6af7-4c11-83bf-c25978fc7e5e on n-h2-master-1 Oct 23 02:14:14.843758 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [req-fa2d2fdd-270e-4deb-85ac-2de5ddd82916 req-baf4f975-b5c2-4898-8ff4-12b9fb94bed3 service nova] Instance 7828c675-6af7-4c11-83bf-c25978fc7e5e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120944) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 23 02:14:14.855944 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-fa2d2fdd-270e-4deb-85ac-2de5ddd82916 req-baf4f975-b5c2-4898-8ff4-12b9fb94bed3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049104 Oct 23 02:14:14.857876 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3822/7551] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:14:15.864768 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f15f6cdc-8922-4f4e-84c1-6704900f37f1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:15.865504 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f15f6cdc-8922-4f4e-84c1-6704900f37f1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:15.872990 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f15f6cdc-8922-4f4e-84c1-6704900f37f1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:15.873482 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f15f6cdc-8922-4f4e-84c1-6704900f37f1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:15.873923 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f15f6cdc-8922-4f4e-84c1-6704900f37f1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:15.874665 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f15f6cdc-8922-4f4e-84c1-6704900f37f1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:15.875127 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f15f6cdc-8922-4f4e-84c1-6704900f37f1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:15.875556 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f15f6cdc-8922-4f4e-84c1-6704900f37f1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:16.006214 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f15f6cdc-8922-4f4e-84c1-6704900f37f1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:16.013941 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f15f6cdc-8922-4f4e-84c1-6704900f37f1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e" status: 200 len: 1683 microversion: 2.1 time: 0.153154 Oct 23 02:14:16.014545 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3730/7552] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:15 2022] GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:16.872508 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-af8d74ca-e8ca-4c2a-96c6-1921b9b75def req-d2c3271e-b78e-4ef3-918c-c499b791f845 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7828c675-6af7-4c11-83bf-c25978fc7e5e", "tag": "cfc5e5a6-7e72-41fb-832a-ae0b145ae8b6"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:14:16.881934 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-af8d74ca-e8ca-4c2a-96c6-1921b9b75def req-d2c3271e-b78e-4ef3-918c-c499b791f845 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:16.882444 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-af8d74ca-e8ca-4c2a-96c6-1921b9b75def req-d2c3271e-b78e-4ef3-918c-c499b791f845 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:16.882870 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-af8d74ca-e8ca-4c2a-96c6-1921b9b75def req-d2c3271e-b78e-4ef3-918c-c499b791f845 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:16.894040 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-af8d74ca-e8ca-4c2a-96c6-1921b9b75def req-d2c3271e-b78e-4ef3-918c-c499b791f845 service nova] Creating event network-changed:cfc5e5a6-7e72-41fb-832a-ae0b145ae8b6 for instance 7828c675-6af7-4c11-83bf-c25978fc7e5e on n-h2-master-1 Oct 23 02:14:16.899223 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [req-af8d74ca-e8ca-4c2a-96c6-1921b9b75def req-d2c3271e-b78e-4ef3-918c-c499b791f845 service nova] Instance 7828c675-6af7-4c11-83bf-c25978fc7e5e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120944) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 23 02:14:16.909648 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-af8d74ca-e8ca-4c2a-96c6-1921b9b75def req-d2c3271e-b78e-4ef3-918c-c499b791f845 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042699 Oct 23 02:14:16.910267 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3823/7553] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:14:17.036730 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-38b2401a-114c-4793-a83a-62e33f47f5c5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:17.037385 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-38b2401a-114c-4793-a83a-62e33f47f5c5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:17.044848 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-38b2401a-114c-4793-a83a-62e33f47f5c5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:17.045285 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-38b2401a-114c-4793-a83a-62e33f47f5c5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:17.045733 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-38b2401a-114c-4793-a83a-62e33f47f5c5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:17.046486 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-38b2401a-114c-4793-a83a-62e33f47f5c5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:17.046942 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-38b2401a-114c-4793-a83a-62e33f47f5c5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:17.047378 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-38b2401a-114c-4793-a83a-62e33f47f5c5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:17.183963 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-38b2401a-114c-4793-a83a-62e33f47f5c5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:17.191798 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-38b2401a-114c-4793-a83a-62e33f47f5c5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e" status: 200 len: 1681 microversion: 2.1 time: 0.159038 Oct 23 02:14:17.192399 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3731/7554] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:17 2022] GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:18.216704 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-391ef511-5025-4705-910a-a8ab8518ba1b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:18.217426 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-391ef511-5025-4705-910a-a8ab8518ba1b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:18.223636 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-391ef511-5025-4705-910a-a8ab8518ba1b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:18.224125 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-391ef511-5025-4705-910a-a8ab8518ba1b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:18.224560 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-391ef511-5025-4705-910a-a8ab8518ba1b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:18.225248 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-391ef511-5025-4705-910a-a8ab8518ba1b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:18.225705 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-391ef511-5025-4705-910a-a8ab8518ba1b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:18.226188 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-391ef511-5025-4705-910a-a8ab8518ba1b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:18.359045 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-391ef511-5025-4705-910a-a8ab8518ba1b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:18.367129 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-391ef511-5025-4705-910a-a8ab8518ba1b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e" status: 200 len: 1678 microversion: 2.1 time: 0.155954 Oct 23 02:14:18.367706 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3824/7555] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:18 2022] GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:18.390280 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d77fd624-3250-483f-abbf-c88b147587d1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:14:18.390839 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d77fd624-3250-483f-abbf-c88b147587d1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:18.397654 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d77fd624-3250-483f-abbf-c88b147587d1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:18.398266 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d77fd624-3250-483f-abbf-c88b147587d1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:18.398717 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d77fd624-3250-483f-abbf-c88b147587d1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:18.399435 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d77fd624-3250-483f-abbf-c88b147587d1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:18.399890 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d77fd624-3250-483f-abbf-c88b147587d1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:18.400344 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d77fd624-3250-483f-abbf-c88b147587d1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:18.437449 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d77fd624-3250-483f-abbf-c88b147587d1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:18.437940 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d77fd624-3250-483f-abbf-c88b147587d1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:18.438424 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d77fd624-3250-483f-abbf-c88b147587d1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:18.439162 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d77fd624-3250-483f-abbf-c88b147587d1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:18.439631 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d77fd624-3250-483f-abbf-c88b147587d1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:18.440073 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d77fd624-3250-483f-abbf-c88b147587d1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:18.462575 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-d77fd624-3250-483f-abbf-c88b147587d1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Getting quotas for project 03ca20e778cf488baea3d1e0505cd492. Resources: {'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:14:18.468093 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-d77fd624-3250-483f-abbf-c88b147587d1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Getting quotas for user 8d11ce8077ca4566ba823eac0882c34f and project 03ca20e778cf488baea3d1e0505cd492. Resources: {'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:14:18.880640 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d77fd624-3250-483f-abbf-c88b147587d1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "POST /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e/action" status: 202 len: 0 microversion: 2.1 time: 0.494143 Oct 23 02:14:18.881322 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3732/7556] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:14:18 2022] POST /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e/action => generated 0 bytes in 496 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:14:18.890340 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-59abba2a-ba8f-460c-af07-c481d49ab6ef tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:18.894957 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-59abba2a-ba8f-460c-af07-c481d49ab6ef tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:18.897024 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-59abba2a-ba8f-460c-af07-c481d49ab6ef tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:18.897520 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-59abba2a-ba8f-460c-af07-c481d49ab6ef tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:18.897964 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-59abba2a-ba8f-460c-af07-c481d49ab6ef tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:18.898696 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-59abba2a-ba8f-460c-af07-c481d49ab6ef tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:18.899159 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-59abba2a-ba8f-460c-af07-c481d49ab6ef tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:18.899606 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-59abba2a-ba8f-460c-af07-c481d49ab6ef tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:19.044031 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-59abba2a-ba8f-460c-af07-c481d49ab6ef tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:19.052963 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-59abba2a-ba8f-460c-af07-c481d49ab6ef tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e" status: 200 len: 1677 microversion: 2.1 time: 0.166872 Oct 23 02:14:19.053587 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3825/7557] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:18 2022] GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:20.077158 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-abc5366b-899c-4b30-aca9-648284870cf3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:20.077899 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-abc5366b-899c-4b30-aca9-648284870cf3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:20.084889 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-abc5366b-899c-4b30-aca9-648284870cf3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:20.085388 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-abc5366b-899c-4b30-aca9-648284870cf3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:20.085839 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-abc5366b-899c-4b30-aca9-648284870cf3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:20.086564 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-abc5366b-899c-4b30-aca9-648284870cf3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:20.087036 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-abc5366b-899c-4b30-aca9-648284870cf3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:20.087475 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-abc5366b-899c-4b30-aca9-648284870cf3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:20.106410 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:14:20.217262 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-abc5366b-899c-4b30-aca9-648284870cf3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:20.225023 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-abc5366b-899c-4b30-aca9-648284870cf3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e" status: 200 len: 1677 microversion: 2.1 time: 0.153020 Oct 23 02:14:20.225607 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3733/7558] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:20 2022] GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:21.189857 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-146de950-994b-4984-a460-1449f6180af5 req-6b3a50d3-1de3-448e-9aab-5e51c7d4fbd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7828c675-6af7-4c11-83bf-c25978fc7e5e", "name": "network-vif-plugged", "status": "completed", "tag": "cfc5e5a6-7e72-41fb-832a-ae0b145ae8b6"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:14:21.199310 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-146de950-994b-4984-a460-1449f6180af5 req-6b3a50d3-1de3-448e-9aab-5e51c7d4fbd6 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:21.199796 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-146de950-994b-4984-a460-1449f6180af5 req-6b3a50d3-1de3-448e-9aab-5e51c7d4fbd6 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:21.200232 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-146de950-994b-4984-a460-1449f6180af5 req-6b3a50d3-1de3-448e-9aab-5e51c7d4fbd6 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:21.213244 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-146de950-994b-4984-a460-1449f6180af5 req-6b3a50d3-1de3-448e-9aab-5e51c7d4fbd6 service nova] Creating event network-vif-plugged:cfc5e5a6-7e72-41fb-832a-ae0b145ae8b6 for instance 7828c675-6af7-4c11-83bf-c25978fc7e5e on n-h2-master-1 Oct 23 02:14:21.219157 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [req-146de950-994b-4984-a460-1449f6180af5 req-6b3a50d3-1de3-448e-9aab-5e51c7d4fbd6 service nova] Instance 7828c675-6af7-4c11-83bf-c25978fc7e5e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120944) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 23 02:14:21.231043 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-146de950-994b-4984-a460-1449f6180af5 req-6b3a50d3-1de3-448e-9aab-5e51c7d4fbd6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099553 Oct 23 02:14:21.231670 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3826/7559] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:14:21.249725 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2d4f701b-8146-4e5e-8f65-078a6e25263f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:21.250388 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2d4f701b-8146-4e5e-8f65-078a6e25263f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:21.257378 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2d4f701b-8146-4e5e-8f65-078a6e25263f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:21.257874 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2d4f701b-8146-4e5e-8f65-078a6e25263f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:21.258384 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2d4f701b-8146-4e5e-8f65-078a6e25263f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:21.259093 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2d4f701b-8146-4e5e-8f65-078a6e25263f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:21.259557 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2d4f701b-8146-4e5e-8f65-078a6e25263f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:21.259994 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2d4f701b-8146-4e5e-8f65-078a6e25263f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:21.390059 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2d4f701b-8146-4e5e-8f65-078a6e25263f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:21.397823 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2d4f701b-8146-4e5e-8f65-078a6e25263f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e" status: 200 len: 1677 microversion: 2.1 time: 0.152692 Oct 23 02:14:21.398429 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3734/7560] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:21 2022] GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:22.422652 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fa3ae2e0-7c42-4aec-a965-590c54133cc8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:22.423539 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fa3ae2e0-7c42-4aec-a965-590c54133cc8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:22.429532 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fa3ae2e0-7c42-4aec-a965-590c54133cc8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:22.430097 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fa3ae2e0-7c42-4aec-a965-590c54133cc8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:22.430534 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fa3ae2e0-7c42-4aec-a965-590c54133cc8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:22.431216 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fa3ae2e0-7c42-4aec-a965-590c54133cc8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:22.431669 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fa3ae2e0-7c42-4aec-a965-590c54133cc8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:22.432091 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fa3ae2e0-7c42-4aec-a965-590c54133cc8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:22.570878 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fa3ae2e0-7c42-4aec-a965-590c54133cc8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:22.578468 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fa3ae2e0-7c42-4aec-a965-590c54133cc8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e" status: 200 len: 1677 microversion: 2.1 time: 0.161035 Oct 23 02:14:22.579055 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3827/7561] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:22 2022] GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:22.880278 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-739633a4-33f3-489d-95b3-2207aba7e2dc req-092e5514-10a6-44fe-90d7-b677f4686416 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7828c675-6af7-4c11-83bf-c25978fc7e5e", "name": "network-vif-unplugged", "status": "completed", "tag": "cfc5e5a6-7e72-41fb-832a-ae0b145ae8b6"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:14:22.889590 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-739633a4-33f3-489d-95b3-2207aba7e2dc req-092e5514-10a6-44fe-90d7-b677f4686416 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:22.890108 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-739633a4-33f3-489d-95b3-2207aba7e2dc req-092e5514-10a6-44fe-90d7-b677f4686416 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:22.890553 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-739633a4-33f3-489d-95b3-2207aba7e2dc req-092e5514-10a6-44fe-90d7-b677f4686416 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:22.901944 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-739633a4-33f3-489d-95b3-2207aba7e2dc req-092e5514-10a6-44fe-90d7-b677f4686416 service nova] Creating event network-vif-unplugged:cfc5e5a6-7e72-41fb-832a-ae0b145ae8b6 for instance 7828c675-6af7-4c11-83bf-c25978fc7e5e on n-h1-master-1 Oct 23 02:14:22.907135 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [req-739633a4-33f3-489d-95b3-2207aba7e2dc req-092e5514-10a6-44fe-90d7-b677f4686416 service nova] Instance 7828c675-6af7-4c11-83bf-c25978fc7e5e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120945) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 23 02:14:22.918184 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-739633a4-33f3-489d-95b3-2207aba7e2dc req-092e5514-10a6-44fe-90d7-b677f4686416 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042405 Oct 23 02:14:22.918770 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3735/7562] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:14:23.602473 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1d7dfb0d-8382-4e63-8b9c-b009cff5aee1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:23.603163 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1d7dfb0d-8382-4e63-8b9c-b009cff5aee1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:23.606053 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=37 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:14:23.610777 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1d7dfb0d-8382-4e63-8b9c-b009cff5aee1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:23.611867 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1d7dfb0d-8382-4e63-8b9c-b009cff5aee1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:23.611867 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1d7dfb0d-8382-4e63-8b9c-b009cff5aee1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:23.612386 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1d7dfb0d-8382-4e63-8b9c-b009cff5aee1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:23.612844 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1d7dfb0d-8382-4e63-8b9c-b009cff5aee1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:23.613303 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1d7dfb0d-8382-4e63-8b9c-b009cff5aee1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:23.617412 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:14:23.747098 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1d7dfb0d-8382-4e63-8b9c-b009cff5aee1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:23.755420 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1d7dfb0d-8382-4e63-8b9c-b009cff5aee1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e" status: 200 len: 1677 microversion: 2.1 time: 0.157136 Oct 23 02:14:23.756209 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3828/7563] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:23 2022] GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:24.781934 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2fe03267-920b-47f7-8df3-c4e73a639f76 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:24.782585 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2fe03267-920b-47f7-8df3-c4e73a639f76 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:24.784574 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:14:24.789469 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2fe03267-920b-47f7-8df3-c4e73a639f76 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:24.789986 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2fe03267-920b-47f7-8df3-c4e73a639f76 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:24.790442 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2fe03267-920b-47f7-8df3-c4e73a639f76 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:24.791141 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2fe03267-920b-47f7-8df3-c4e73a639f76 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:24.791690 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2fe03267-920b-47f7-8df3-c4e73a639f76 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:24.792854 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2fe03267-920b-47f7-8df3-c4e73a639f76 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:24.926859 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2fe03267-920b-47f7-8df3-c4e73a639f76 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:24.932070 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-26d829cb-a339-4f4d-bcbe-5195f22bf68a req-52f1e906-45ec-469d-9fa8-0bd4abe54e68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7828c675-6af7-4c11-83bf-c25978fc7e5e", "tag": "cfc5e5a6-7e72-41fb-832a-ae0b145ae8b6"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:14:24.934872 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2fe03267-920b-47f7-8df3-c4e73a639f76 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e" status: 200 len: 1677 microversion: 2.1 time: 0.158708 Oct 23 02:14:24.935448 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3736/7564] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:24 2022] GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:24.943044 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-26d829cb-a339-4f4d-bcbe-5195f22bf68a req-52f1e906-45ec-469d-9fa8-0bd4abe54e68 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:24.943525 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-26d829cb-a339-4f4d-bcbe-5195f22bf68a req-52f1e906-45ec-469d-9fa8-0bd4abe54e68 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:24.943963 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-26d829cb-a339-4f4d-bcbe-5195f22bf68a req-52f1e906-45ec-469d-9fa8-0bd4abe54e68 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:24.956361 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-26d829cb-a339-4f4d-bcbe-5195f22bf68a req-52f1e906-45ec-469d-9fa8-0bd4abe54e68 service nova] Creating event network-changed:cfc5e5a6-7e72-41fb-832a-ae0b145ae8b6 for instance 7828c675-6af7-4c11-83bf-c25978fc7e5e on n-h1-master-1 Oct 23 02:14:24.961677 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [req-26d829cb-a339-4f4d-bcbe-5195f22bf68a req-52f1e906-45ec-469d-9fa8-0bd4abe54e68 service nova] Instance 7828c675-6af7-4c11-83bf-c25978fc7e5e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120944) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 23 02:14:24.974279 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-26d829cb-a339-4f4d-bcbe-5195f22bf68a req-52f1e906-45ec-469d-9fa8-0bd4abe54e68 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045690 Oct 23 02:14:24.974881 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3829/7565] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:14:25.959554 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-94a59035-16b6-4807-a099-bccb57b83fde tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:25.960218 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-94a59035-16b6-4807-a099-bccb57b83fde tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:25.967569 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94a59035-16b6-4807-a099-bccb57b83fde tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:25.968053 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94a59035-16b6-4807-a099-bccb57b83fde tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:25.968496 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94a59035-16b6-4807-a099-bccb57b83fde tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:25.969194 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94a59035-16b6-4807-a099-bccb57b83fde tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:25.969687 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94a59035-16b6-4807-a099-bccb57b83fde tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:25.970185 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-94a59035-16b6-4807-a099-bccb57b83fde tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:26.114143 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-94a59035-16b6-4807-a099-bccb57b83fde tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:26.122966 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-94a59035-16b6-4807-a099-bccb57b83fde tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e" status: 200 len: 1677 microversion: 2.1 time: 0.167633 Oct 23 02:14:26.123862 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3737/7566] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:25 2022] GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:27.147917 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-18a8e955-e3e0-484e-a30f-f271e7e173eb tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:27.148785 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-18a8e955-e3e0-484e-a30f-f271e7e173eb tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:27.156401 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18a8e955-e3e0-484e-a30f-f271e7e173eb tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:27.156897 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18a8e955-e3e0-484e-a30f-f271e7e173eb tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:27.157338 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18a8e955-e3e0-484e-a30f-f271e7e173eb tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:27.158107 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18a8e955-e3e0-484e-a30f-f271e7e173eb tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:27.158585 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18a8e955-e3e0-484e-a30f-f271e7e173eb tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:27.159011 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18a8e955-e3e0-484e-a30f-f271e7e173eb tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:27.288968 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-18a8e955-e3e0-484e-a30f-f271e7e173eb tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:27.297450 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-18a8e955-e3e0-484e-a30f-f271e7e173eb tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e" status: 200 len: 1670 microversion: 2.1 time: 0.154232 Oct 23 02:14:27.298063 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3830/7567] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:27 2022] GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e => generated 1670 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:27.320620 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a784cbe7-567c-46cc-b20b-5b21e9e37c6f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:27.321368 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a784cbe7-567c-46cc-b20b-5b21e9e37c6f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:27.328704 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a784cbe7-567c-46cc-b20b-5b21e9e37c6f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:27.329205 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a784cbe7-567c-46cc-b20b-5b21e9e37c6f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:27.329659 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a784cbe7-567c-46cc-b20b-5b21e9e37c6f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:27.330392 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a784cbe7-567c-46cc-b20b-5b21e9e37c6f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:27.330867 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a784cbe7-567c-46cc-b20b-5b21e9e37c6f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:27.331309 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a784cbe7-567c-46cc-b20b-5b21e9e37c6f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:27.466622 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a784cbe7-567c-46cc-b20b-5b21e9e37c6f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:27.480328 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a784cbe7-567c-46cc-b20b-5b21e9e37c6f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e" status: 200 len: 1670 microversion: 2.1 time: 0.163386 Oct 23 02:14:27.481006 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3738/7568] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:27 2022] GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e => generated 1670 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:27.502844 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e4a7a1a6-49e6-40c7-9f12-ab3077160617 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:27.503464 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e4a7a1a6-49e6-40c7-9f12-ab3077160617 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:27.509318 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e4a7a1a6-49e6-40c7-9f12-ab3077160617 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:27.509829 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e4a7a1a6-49e6-40c7-9f12-ab3077160617 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:27.510813 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e4a7a1a6-49e6-40c7-9f12-ab3077160617 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:27.511500 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e4a7a1a6-49e6-40c7-9f12-ab3077160617 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:27.511951 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e4a7a1a6-49e6-40c7-9f12-ab3077160617 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:27.512380 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e4a7a1a6-49e6-40c7-9f12-ab3077160617 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:27.638624 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e4a7a1a6-49e6-40c7-9f12-ab3077160617 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:27.646248 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e4a7a1a6-49e6-40c7-9f12-ab3077160617 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e" status: 200 len: 1670 microversion: 2.1 time: 0.147267 Oct 23 02:14:27.652249 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3831/7569] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:27 2022] GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e => generated 1670 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:27.672352 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b01e12bb-39cb-46e6-bc57-cca495fa7c39 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:27.672864 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b01e12bb-39cb-46e6-bc57-cca495fa7c39 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:27.678867 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b01e12bb-39cb-46e6-bc57-cca495fa7c39 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:27.679365 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b01e12bb-39cb-46e6-bc57-cca495fa7c39 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:27.679816 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b01e12bb-39cb-46e6-bc57-cca495fa7c39 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:27.680516 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b01e12bb-39cb-46e6-bc57-cca495fa7c39 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:27.680983 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b01e12bb-39cb-46e6-bc57-cca495fa7c39 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:27.681423 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b01e12bb-39cb-46e6-bc57-cca495fa7c39 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:27.708400 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b01e12bb-39cb-46e6-bc57-cca495fa7c39 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 02:14:27.997306 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b01e12bb-39cb-46e6-bc57-cca495fa7c39 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e" status: 204 len: 0 microversion: 2.1 time: 0.328582 Oct 23 02:14:27.997997 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3739/7570] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 02:14:27 2022] DELETE /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 02:14:28.006255 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-882ac1c3-5a1a-4455-a808-c9373814117d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:28.007626 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-882ac1c3-5a1a-4455-a808-c9373814117d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:28.012911 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-882ac1c3-5a1a-4455-a808-c9373814117d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:28.013389 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-882ac1c3-5a1a-4455-a808-c9373814117d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:28.013820 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-882ac1c3-5a1a-4455-a808-c9373814117d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:28.014543 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-882ac1c3-5a1a-4455-a808-c9373814117d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:28.014994 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-882ac1c3-5a1a-4455-a808-c9373814117d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:28.015416 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-882ac1c3-5a1a-4455-a808-c9373814117d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:28.145516 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-882ac1c3-5a1a-4455-a808-c9373814117d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:28.154324 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-882ac1c3-5a1a-4455-a808-c9373814117d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e" status: 200 len: 1676 microversion: 2.1 time: 0.151981 Oct 23 02:14:28.154935 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3832/7571] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:28 2022] GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:29.068582 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-40262468-4b5f-4987-8480-572c1b780cb6 req-9c24785c-e192-4f56-962f-c9dd3d2f0b92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7828c675-6af7-4c11-83bf-c25978fc7e5e", "name": "network-vif-plugged", "status": "completed", "tag": "cfc5e5a6-7e72-41fb-832a-ae0b145ae8b6"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:14:29.074996 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=3 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:14:29.080283 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-40262468-4b5f-4987-8480-572c1b780cb6 req-9c24785c-e192-4f56-962f-c9dd3d2f0b92 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:29.080776 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-40262468-4b5f-4987-8480-572c1b780cb6 req-9c24785c-e192-4f56-962f-c9dd3d2f0b92 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:29.081231 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-40262468-4b5f-4987-8480-572c1b780cb6 req-9c24785c-e192-4f56-962f-c9dd3d2f0b92 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:29.092683 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-40262468-4b5f-4987-8480-572c1b780cb6 req-9c24785c-e192-4f56-962f-c9dd3d2f0b92 service nova] Creating event network-vif-plugged:cfc5e5a6-7e72-41fb-832a-ae0b145ae8b6 for instance 7828c675-6af7-4c11-83bf-c25978fc7e5e on n-h1-master-1 Oct 23 02:14:29.097570 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-40262468-4b5f-4987-8480-572c1b780cb6 req-9c24785c-e192-4f56-962f-c9dd3d2f0b92 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033137 Oct 23 02:14:29.098203 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3740/7572] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:14:29.178178 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c390568c-03d6-42b3-b16c-8733294441ca tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:29.178793 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c390568c-03d6-42b3-b16c-8733294441ca tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:29.186175 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c390568c-03d6-42b3-b16c-8733294441ca tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:29.186656 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c390568c-03d6-42b3-b16c-8733294441ca tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:29.187091 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c390568c-03d6-42b3-b16c-8733294441ca tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:29.187771 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c390568c-03d6-42b3-b16c-8733294441ca tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:29.188225 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c390568c-03d6-42b3-b16c-8733294441ca tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:29.188644 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c390568c-03d6-42b3-b16c-8733294441ca tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:29.319954 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c390568c-03d6-42b3-b16c-8733294441ca tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:29.328570 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c390568c-03d6-42b3-b16c-8733294441ca tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e" status: 200 len: 1676 microversion: 2.1 time: 0.154317 Oct 23 02:14:29.329143 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3833/7573] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:29 2022] GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:30.354993 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-608e95c0-ddde-45e1-8b3e-cd80688bad7e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:30.355906 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-608e95c0-ddde-45e1-8b3e-cd80688bad7e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:30.362365 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-608e95c0-ddde-45e1-8b3e-cd80688bad7e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:30.362876 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-608e95c0-ddde-45e1-8b3e-cd80688bad7e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:30.363326 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-608e95c0-ddde-45e1-8b3e-cd80688bad7e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:30.364040 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-608e95c0-ddde-45e1-8b3e-cd80688bad7e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:30.364509 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-608e95c0-ddde-45e1-8b3e-cd80688bad7e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:30.364950 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-608e95c0-ddde-45e1-8b3e-cd80688bad7e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:30.431662 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-608e95c0-ddde-45e1-8b3e-cd80688bad7e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:30.439967 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-608e95c0-ddde-45e1-8b3e-cd80688bad7e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e" status: 200 len: 1609 microversion: 2.1 time: 0.091019 Oct 23 02:14:30.447565 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3741/7574] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:30 2022] GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e => generated 1609 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:30.466054 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-929f8901-20a6-48cc-afb1-412bf1bf9c6c req-4bbd76e8-b1e6-44f9-a451-bf3471f91b56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7828c675-6af7-4c11-83bf-c25978fc7e5e", "name": "network-vif-deleted", "tag": "cfc5e5a6-7e72-41fb-832a-ae0b145ae8b6"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:14:30.476422 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-929f8901-20a6-48cc-afb1-412bf1bf9c6c req-4bbd76e8-b1e6-44f9-a451-bf3471f91b56 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:30.476996 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-929f8901-20a6-48cc-afb1-412bf1bf9c6c req-4bbd76e8-b1e6-44f9-a451-bf3471f91b56 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:30.477501 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-929f8901-20a6-48cc-afb1-412bf1bf9c6c req-4bbd76e8-b1e6-44f9-a451-bf3471f91b56 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:30.489215 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-929f8901-20a6-48cc-afb1-412bf1bf9c6c req-4bbd76e8-b1e6-44f9-a451-bf3471f91b56 service nova] Creating event network-vif-deleted:cfc5e5a6-7e72-41fb-832a-ae0b145ae8b6 for instance 7828c675-6af7-4c11-83bf-c25978fc7e5e on n-h1-master-1 Oct 23 02:14:30.494337 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-929f8901-20a6-48cc-afb1-412bf1bf9c6c req-4bbd76e8-b1e6-44f9-a451-bf3471f91b56 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033047 Oct 23 02:14:30.494977 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3834/7575] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:14:31.467097 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6114cf55-da2c-4b1f-964c-dd0ac7dc471a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:31.467097 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6114cf55-da2c-4b1f-964c-dd0ac7dc471a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:31.476710 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6114cf55-da2c-4b1f-964c-dd0ac7dc471a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:31.477222 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6114cf55-da2c-4b1f-964c-dd0ac7dc471a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:31.477670 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6114cf55-da2c-4b1f-964c-dd0ac7dc471a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:31.478470 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6114cf55-da2c-4b1f-964c-dd0ac7dc471a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:31.479587 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6114cf55-da2c-4b1f-964c-dd0ac7dc471a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:31.480036 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6114cf55-da2c-4b1f-964c-dd0ac7dc471a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:31.511343 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6114cf55-da2c-4b1f-964c-dd0ac7dc471a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:31.511842 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6114cf55-da2c-4b1f-964c-dd0ac7dc471a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:31.512289 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6114cf55-da2c-4b1f-964c-dd0ac7dc471a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:31.512802 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-6114cf55-da2c-4b1f-964c-dd0ac7dc471a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lazy-loading 'fault' on Instance uuid 7828c675-6af7-4c11-83bf-c25978fc7e5e {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:14:31.557741 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6114cf55-da2c-4b1f-964c-dd0ac7dc471a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:31.566027 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6114cf55-da2c-4b1f-964c-dd0ac7dc471a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e" status: 200 len: 1329 microversion: 2.1 time: 0.105514 Oct 23 02:14:31.568230 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3742/7576] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:31 2022] GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e => generated 1329 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:14:32.591655 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0c1bb6a2-5252-47df-8fb2-56c7348a4360 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:32.592359 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0c1bb6a2-5252-47df-8fb2-56c7348a4360 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:32.598576 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0c1bb6a2-5252-47df-8fb2-56c7348a4360 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:32.599064 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0c1bb6a2-5252-47df-8fb2-56c7348a4360 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:32.599503 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0c1bb6a2-5252-47df-8fb2-56c7348a4360 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:32.600184 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0c1bb6a2-5252-47df-8fb2-56c7348a4360 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:32.600640 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0c1bb6a2-5252-47df-8fb2-56c7348a4360 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:32.601065 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0c1bb6a2-5252-47df-8fb2-56c7348a4360 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:32.616975 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-0c1bb6a2-5252-47df-8fb2-56c7348a4360 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] HTTP exception thrown: Instance 7828c675-6af7-4c11-83bf-c25978fc7e5e could not be found. Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0c1bb6a2-5252-47df-8fb2-56c7348a4360 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Request method failure captured: Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e HTTP/1.1 Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVKKL3Yj8jOjD4nOjvPlV-Y9scyqq13fojDyVX3OBbve73h4rlqC2R6Nmg1gkZUj_81md5ukYTWK0OLLvV2V5x7EROs1jhxmCCEm-g9iyFEqoOdE1VQeo6XR_54_6ol8SgxaBnJdqCRkZgpHF9-UuD1N8MWY5NbSWQIdQH83g6nBVV_w Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 03ca20e778cf488baea3d1e0505cd492 Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServerActionsTestJSON-1383606630 Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/03ca20e778cf488baea3d1e0505cd492"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_03ca20e778cf488baea3d1e0505cd492"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/03ca20e778cf488baea3d1e0505cd492"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/03ca20e778cf488baea3d1e0505cd492"}]}] Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServerActionsTestJSON-1383606630 Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 03ca20e778cf488baea3d1e0505cd492 Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServerActionsTestJSON-1383606630 Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServerActionsTestJSON-1383606630-project Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 8d11ce8077ca4566ba823eac0882c34f Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServerActionsTestJSON-1383606630-project Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 7828c675-6af7-4c11-83bf-c25978fc7e5e could not be found. Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '7828c675-6af7-4c11-83bf-c25978fc7e5e'} Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7828c675-6af7-4c11-83bf-c25978fc7e5e could not be found. Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7828c675-6af7-4c11-83bf-c25978fc7e5e could not be found. Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:14:32.618645 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:14:32.624592 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:14:32.624592 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:14:32.624592 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:14:32.624592 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:14:32.624592 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:14:32.624592 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7828c675-6af7-4c11-83bf-c25978fc7e5e could not be found. Oct 23 02:14:32.624592 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:14:32.624592 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0c1bb6a2-5252-47df-8fb2-56c7348a4360 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Returning 404 to user: Instance 7828c675-6af7-4c11-83bf-c25978fc7e5e could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:14:32.624592 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0c1bb6a2-5252-47df-8fb2-56c7348a4360 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e" status: 404 len: 111 microversion: 2.1 time: 0.034660 Oct 23 02:14:32.624592 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3835/7577] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:32 2022] GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:14:32.639530 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ca5bca9e-c265-4879-b32e-8a58a08ef18d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:32.645725 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ca5bca9e-c265-4879-b32e-8a58a08ef18d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:32.646939 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca5bca9e-c265-4879-b32e-8a58a08ef18d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:32.647460 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca5bca9e-c265-4879-b32e-8a58a08ef18d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:32.647908 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca5bca9e-c265-4879-b32e-8a58a08ef18d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:32.648609 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca5bca9e-c265-4879-b32e-8a58a08ef18d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:32.649074 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca5bca9e-c265-4879-b32e-8a58a08ef18d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:32.649508 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca5bca9e-c265-4879-b32e-8a58a08ef18d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:32.662782 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-ca5bca9e-c265-4879-b32e-8a58a08ef18d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] HTTP exception thrown: Instance 7828c675-6af7-4c11-83bf-c25978fc7e5e could not be found. Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ca5bca9e-c265-4879-b32e-8a58a08ef18d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Request method failure captured: Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e HTTP/1.1 Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVKKL3Yj8jOjD4nOjvPlV-Y9scyqq13fojDyVX3OBbve73h4rlqC2R6Nmg1gkZUj_81md5ukYTWK0OLLvV2V5x7EROs1jhxmCCEm-g9iyFEqoOdE1VQeo6XR_54_6ol8SgxaBnJdqCRkZgpHF9-UuD1N8MWY5NbSWQIdQH83g6nBVV_w Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 03ca20e778cf488baea3d1e0505cd492 Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServerActionsTestJSON-1383606630 Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/03ca20e778cf488baea3d1e0505cd492"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_03ca20e778cf488baea3d1e0505cd492"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/03ca20e778cf488baea3d1e0505cd492"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/03ca20e778cf488baea3d1e0505cd492"}]}] Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServerActionsTestJSON-1383606630 Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 03ca20e778cf488baea3d1e0505cd492 Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServerActionsTestJSON-1383606630 Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServerActionsTestJSON-1383606630-project Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 8d11ce8077ca4566ba823eac0882c34f Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServerActionsTestJSON-1383606630-project Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 7828c675-6af7-4c11-83bf-c25978fc7e5e could not be found. Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '7828c675-6af7-4c11-83bf-c25978fc7e5e'} Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7828c675-6af7-4c11-83bf-c25978fc7e5e could not be found. Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7828c675-6af7-4c11-83bf-c25978fc7e5e could not be found. Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:14:32.664423 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:14:32.669957 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:14:32.669957 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:14:32.669957 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:14:32.669957 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:14:32.669957 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:14:32.669957 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7828c675-6af7-4c11-83bf-c25978fc7e5e could not be found. Oct 23 02:14:32.669957 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:14:32.669957 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ca5bca9e-c265-4879-b32e-8a58a08ef18d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Returning 404 to user: Instance 7828c675-6af7-4c11-83bf-c25978fc7e5e could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:14:32.669957 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ca5bca9e-c265-4879-b32e-8a58a08ef18d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e" status: 404 len: 111 microversion: 2.1 time: 0.030373 Oct 23 02:14:32.669957 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3743/7578] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:32 2022] GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:14:32.714283 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-328e7085-d666-4ab2-a204-5d22452cf7e1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-99353371", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "f26ee581-835e-4450-9de2-8238925be6fc"}], "security_groups": [{"name": "tempest-securitygroup--633118967"}], "key_name": "tempest-keypair-1840206196", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:14:32.817445 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-328e7085-d666-4ab2-a204-5d22452cf7e1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] validate_networks() for [('f26ee581-835e-4450-9de2-8238925be6fc', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 02:14:33.181693 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-328e7085-d666-4ab2-a204-5d22452cf7e1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:14:33.182263 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-328e7085-d666-4ab2-a204-5d22452cf7e1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:14:33.182721 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-328e7085-d666-4ab2-a204-5d22452cf7e1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:14:33.183137 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-328e7085-d666-4ab2-a204-5d22452cf7e1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:14:33.183557 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-328e7085-d666-4ab2-a204-5d22452cf7e1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:14:33.192446 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-328e7085-d666-4ab2-a204-5d22452cf7e1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:33.192935 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-328e7085-d666-4ab2-a204-5d22452cf7e1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:33.193376 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-328e7085-d666-4ab2-a204-5d22452cf7e1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:33.194158 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-328e7085-d666-4ab2-a204-5d22452cf7e1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:33.194627 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-328e7085-d666-4ab2-a204-5d22452cf7e1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:33.195060 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-328e7085-d666-4ab2-a204-5d22452cf7e1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:33.212164 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-328e7085-d666-4ab2-a204-5d22452cf7e1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Getting quotas for project 03ca20e778cf488baea3d1e0505cd492. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:14:33.218343 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-328e7085-d666-4ab2-a204-5d22452cf7e1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Getting quotas for user 8d11ce8077ca4566ba823eac0882c34f and project 03ca20e778cf488baea3d1e0505cd492. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:14:33.230817 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-328e7085-d666-4ab2-a204-5d22452cf7e1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 02:14:33.233142 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-328e7085-d666-4ab2-a204-5d22452cf7e1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 02:14:33.347064 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-328e7085-d666-4ab2-a204-5d22452cf7e1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.636672 Oct 23 02:14:33.347652 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3836/7579] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 02:14:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 02:14:33.359270 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ec919add-b326-43b2-b4e1-81f0e0896cde tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:33.359903 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ec919add-b326-43b2-b4e1-81f0e0896cde tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:33.413321 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ec919add-b326-43b2-b4e1-81f0e0896cde tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:33.420305 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ec919add-b326-43b2-b4e1-81f0e0896cde tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1237 microversion: 2.1 time: 0.064942 Oct 23 02:14:33.420882 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3744/7580] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:33 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1237 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:34.444987 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-48817ea0-9031-4799-b3b3-b3bddb61699b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:34.446409 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-48817ea0-9031-4799-b3b3-b3bddb61699b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:34.453662 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-48817ea0-9031-4799-b3b3-b3bddb61699b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:34.454250 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-48817ea0-9031-4799-b3b3-b3bddb61699b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:34.454691 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-48817ea0-9031-4799-b3b3-b3bddb61699b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:34.455376 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-48817ea0-9031-4799-b3b3-b3bddb61699b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:34.455834 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-48817ea0-9031-4799-b3b3-b3bddb61699b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:34.456259 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-48817ea0-9031-4799-b3b3-b3bddb61699b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:34.518515 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-48817ea0-9031-4799-b3b3-b3bddb61699b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:34.527129 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-48817ea0-9031-4799-b3b3-b3bddb61699b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1233 microversion: 2.1 time: 0.086930 Oct 23 02:14:34.528217 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3837/7581] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:34 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1233 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:35.552410 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4a922af1-b013-45fd-b7b9-fdfb872667f1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:35.553041 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4a922af1-b013-45fd-b7b9-fdfb872667f1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:35.565157 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4a922af1-b013-45fd-b7b9-fdfb872667f1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:35.565659 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4a922af1-b013-45fd-b7b9-fdfb872667f1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:35.566142 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4a922af1-b013-45fd-b7b9-fdfb872667f1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:35.566860 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4a922af1-b013-45fd-b7b9-fdfb872667f1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:35.567331 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4a922af1-b013-45fd-b7b9-fdfb872667f1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:35.567768 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4a922af1-b013-45fd-b7b9-fdfb872667f1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:35.633346 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4a922af1-b013-45fd-b7b9-fdfb872667f1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:35.641216 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4a922af1-b013-45fd-b7b9-fdfb872667f1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1295 microversion: 2.1 time: 0.092760 Oct 23 02:14:35.641794 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3745/7582] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:35 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1295 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:36.665722 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0eda1af7-e234-4a2b-ab45-aae4cdc2d765 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:36.666410 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0eda1af7-e234-4a2b-ab45-aae4cdc2d765 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:36.674317 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0eda1af7-e234-4a2b-ab45-aae4cdc2d765 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:36.674807 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0eda1af7-e234-4a2b-ab45-aae4cdc2d765 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:36.675245 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0eda1af7-e234-4a2b-ab45-aae4cdc2d765 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:36.675937 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0eda1af7-e234-4a2b-ab45-aae4cdc2d765 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:36.676440 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0eda1af7-e234-4a2b-ab45-aae4cdc2d765 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:36.676842 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0eda1af7-e234-4a2b-ab45-aae4cdc2d765 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:36.820405 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-133212c1-37a4-4590-955b-3d5e3c569403 req-d81a1514-62b4-4fa5-9460-1a38c4ea72fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fe588ab-961a-40e1-ac9f-180b9d892041", "tag": "024cb3c7-efb2-4442-a9a7-773209aa680b"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:14:36.835792 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-133212c1-37a4-4590-955b-3d5e3c569403 req-d81a1514-62b4-4fa5-9460-1a38c4ea72fd service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:36.836287 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-133212c1-37a4-4590-955b-3d5e3c569403 req-d81a1514-62b4-4fa5-9460-1a38c4ea72fd service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:36.836766 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-133212c1-37a4-4590-955b-3d5e3c569403 req-d81a1514-62b4-4fa5-9460-1a38c4ea72fd service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:36.849786 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-133212c1-37a4-4590-955b-3d5e3c569403 req-d81a1514-62b4-4fa5-9460-1a38c4ea72fd service nova] Creating event network-changed:024cb3c7-efb2-4442-a9a7-773209aa680b for instance 8fe588ab-961a-40e1-ac9f-180b9d892041 on n-h2-master-1 Oct 23 02:14:36.855967 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-133212c1-37a4-4590-955b-3d5e3c569403 req-d81a1514-62b4-4fa5-9460-1a38c4ea72fd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038879 Oct 23 02:14:36.856588 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3746/7583] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:14:37.075244 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0eda1af7-e234-4a2b-ab45-aae4cdc2d765 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:37.083078 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0eda1af7-e234-4a2b-ab45-aae4cdc2d765 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1362 microversion: 2.1 time: 0.421265 Oct 23 02:14:37.083665 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3838/7584] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:36 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1362 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:38.107739 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-96f9fbf4-13c9-4196-bb15-afa3ebb235ad tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:38.108451 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-96f9fbf4-13c9-4196-bb15-afa3ebb235ad tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:38.115597 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-96f9fbf4-13c9-4196-bb15-afa3ebb235ad tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:38.116089 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-96f9fbf4-13c9-4196-bb15-afa3ebb235ad tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:38.116526 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-96f9fbf4-13c9-4196-bb15-afa3ebb235ad tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:38.117215 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-96f9fbf4-13c9-4196-bb15-afa3ebb235ad tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:38.117685 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-96f9fbf4-13c9-4196-bb15-afa3ebb235ad tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:38.118146 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-96f9fbf4-13c9-4196-bb15-afa3ebb235ad tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:38.244901 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-96f9fbf4-13c9-4196-bb15-afa3ebb235ad tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:38.252997 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-96f9fbf4-13c9-4196-bb15-afa3ebb235ad tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1362 microversion: 2.1 time: 0.149553 Oct 23 02:14:38.253559 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3747/7585] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:38 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:39.276863 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5a9f8d6a-c13b-4ec2-bb1e-a14cbbc0a815 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:39.277492 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5a9f8d6a-c13b-4ec2-bb1e-a14cbbc0a815 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:39.284478 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5a9f8d6a-c13b-4ec2-bb1e-a14cbbc0a815 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:39.284969 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5a9f8d6a-c13b-4ec2-bb1e-a14cbbc0a815 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:39.285423 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5a9f8d6a-c13b-4ec2-bb1e-a14cbbc0a815 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:39.286164 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5a9f8d6a-c13b-4ec2-bb1e-a14cbbc0a815 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:39.286631 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5a9f8d6a-c13b-4ec2-bb1e-a14cbbc0a815 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:39.287069 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5a9f8d6a-c13b-4ec2-bb1e-a14cbbc0a815 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:39.415706 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5a9f8d6a-c13b-4ec2-bb1e-a14cbbc0a815 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:39.423809 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5a9f8d6a-c13b-4ec2-bb1e-a14cbbc0a815 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1362 microversion: 2.1 time: 0.150892 Oct 23 02:14:39.424385 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3839/7586] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:39 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:40.447948 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-899d2232-8651-49d1-a2c4-4789e3079711 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:40.448528 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-899d2232-8651-49d1-a2c4-4789e3079711 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:40.456145 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-899d2232-8651-49d1-a2c4-4789e3079711 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:40.456634 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-899d2232-8651-49d1-a2c4-4789e3079711 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:40.457075 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-899d2232-8651-49d1-a2c4-4789e3079711 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:40.457764 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-899d2232-8651-49d1-a2c4-4789e3079711 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:40.458262 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-899d2232-8651-49d1-a2c4-4789e3079711 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:40.458694 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-899d2232-8651-49d1-a2c4-4789e3079711 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:40.584898 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-899d2232-8651-49d1-a2c4-4789e3079711 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:40.592851 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-899d2232-8651-49d1-a2c4-4789e3079711 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1362 microversion: 2.1 time: 0.148918 Oct 23 02:14:40.593422 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3748/7587] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:40 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:41.616680 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3dc9ad1a-7e85-4a98-aa0c-e119783cf6b4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:41.617304 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3dc9ad1a-7e85-4a98-aa0c-e119783cf6b4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:41.624250 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3dc9ad1a-7e85-4a98-aa0c-e119783cf6b4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:41.624739 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3dc9ad1a-7e85-4a98-aa0c-e119783cf6b4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:41.625176 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3dc9ad1a-7e85-4a98-aa0c-e119783cf6b4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:41.625868 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3dc9ad1a-7e85-4a98-aa0c-e119783cf6b4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:41.626376 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3dc9ad1a-7e85-4a98-aa0c-e119783cf6b4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:41.626805 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3dc9ad1a-7e85-4a98-aa0c-e119783cf6b4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:41.765561 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3dc9ad1a-7e85-4a98-aa0c-e119783cf6b4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:41.773335 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3dc9ad1a-7e85-4a98-aa0c-e119783cf6b4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1362 microversion: 2.1 time: 0.160607 Oct 23 02:14:41.773922 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3840/7588] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:41 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:42.797594 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-df0af1b0-de93-4d2a-ad86-04bcf2dfbd04 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:42.798307 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-df0af1b0-de93-4d2a-ad86-04bcf2dfbd04 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:42.805075 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-df0af1b0-de93-4d2a-ad86-04bcf2dfbd04 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:42.806655 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-df0af1b0-de93-4d2a-ad86-04bcf2dfbd04 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:42.806655 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-df0af1b0-de93-4d2a-ad86-04bcf2dfbd04 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:42.806875 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-df0af1b0-de93-4d2a-ad86-04bcf2dfbd04 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:42.807326 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-df0af1b0-de93-4d2a-ad86-04bcf2dfbd04 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:42.807764 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-df0af1b0-de93-4d2a-ad86-04bcf2dfbd04 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:42.938338 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-df0af1b0-de93-4d2a-ad86-04bcf2dfbd04 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:42.943222 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-df0af1b0-de93-4d2a-ad86-04bcf2dfbd04 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1362 microversion: 2.1 time: 0.149447 Oct 23 02:14:42.943796 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3749/7589] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:42 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:43.289697 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-7d19b709-0a94-40de-b71c-49e18b70672a req-93f7e484-8c5d-4e35-8db3-278af4b4453d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fe588ab-961a-40e1-ac9f-180b9d892041", "name": "network-vif-plugged", "status": "completed", "tag": "024cb3c7-efb2-4442-a9a7-773209aa680b"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:14:43.295706 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:14:43.296379 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=6 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:14:43.304620 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-7d19b709-0a94-40de-b71c-49e18b70672a req-93f7e484-8c5d-4e35-8db3-278af4b4453d service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:43.304620 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-7d19b709-0a94-40de-b71c-49e18b70672a req-93f7e484-8c5d-4e35-8db3-278af4b4453d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:43.304620 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-7d19b709-0a94-40de-b71c-49e18b70672a req-93f7e484-8c5d-4e35-8db3-278af4b4453d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:43.314026 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-7d19b709-0a94-40de-b71c-49e18b70672a req-93f7e484-8c5d-4e35-8db3-278af4b4453d service nova] Creating event network-vif-plugged:024cb3c7-efb2-4442-a9a7-773209aa680b for instance 8fe588ab-961a-40e1-ac9f-180b9d892041 on n-h2-master-1 Oct 23 02:14:43.318987 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-7d19b709-0a94-40de-b71c-49e18b70672a req-93f7e484-8c5d-4e35-8db3-278af4b4453d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033046 Oct 23 02:14:43.319568 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3841/7590] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:14:43.967826 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e85fc1b4-4431-4ce8-bc85-c4abf4e61f43 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:43.968460 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e85fc1b4-4431-4ce8-bc85-c4abf4e61f43 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:43.970491 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:14:43.976117 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e85fc1b4-4431-4ce8-bc85-c4abf4e61f43 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:43.976619 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e85fc1b4-4431-4ce8-bc85-c4abf4e61f43 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:43.977071 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e85fc1b4-4431-4ce8-bc85-c4abf4e61f43 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:43.977810 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e85fc1b4-4431-4ce8-bc85-c4abf4e61f43 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:43.978330 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e85fc1b4-4431-4ce8-bc85-c4abf4e61f43 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:43.978774 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e85fc1b4-4431-4ce8-bc85-c4abf4e61f43 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:44.113020 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e85fc1b4-4431-4ce8-bc85-c4abf4e61f43 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:44.120694 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e85fc1b4-4431-4ce8-bc85-c4abf4e61f43 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1362 microversion: 2.1 time: 0.157097 Oct 23 02:14:44.121266 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3750/7591] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:43 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:45.145424 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ae339fab-6642-4917-bd20-a0362a251726 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:45.146083 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ae339fab-6642-4917-bd20-a0362a251726 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:45.153343 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ae339fab-6642-4917-bd20-a0362a251726 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:45.153832 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ae339fab-6642-4917-bd20-a0362a251726 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:45.154304 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ae339fab-6642-4917-bd20-a0362a251726 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:45.154997 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ae339fab-6642-4917-bd20-a0362a251726 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:45.155456 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ae339fab-6642-4917-bd20-a0362a251726 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:45.155889 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ae339fab-6642-4917-bd20-a0362a251726 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:45.286040 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ae339fab-6642-4917-bd20-a0362a251726 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:45.294249 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ae339fab-6642-4917-bd20-a0362a251726 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1550 microversion: 2.1 time: 0.154033 Oct 23 02:14:45.294852 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3842/7592] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:45 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1550 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:45.317677 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6c0eb846-ead5-4ffd-8a31-42f3f8f8808d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:45.318218 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6c0eb846-ead5-4ffd-8a31-42f3f8f8808d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:45.324994 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6c0eb846-ead5-4ffd-8a31-42f3f8f8808d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:45.325496 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6c0eb846-ead5-4ffd-8a31-42f3f8f8808d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:45.325950 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6c0eb846-ead5-4ffd-8a31-42f3f8f8808d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:45.326675 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6c0eb846-ead5-4ffd-8a31-42f3f8f8808d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:45.327146 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6c0eb846-ead5-4ffd-8a31-42f3f8f8808d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:45.327583 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6c0eb846-ead5-4ffd-8a31-42f3f8f8808d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:45.344924 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:14:45.408760 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6c0eb846-ead5-4ffd-8a31-42f3f8f8808d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094933 Oct 23 02:14:45.409450 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3751/7593] 10.222.0.42 () {58 vars in 1275 bytes} [Sun Oct 23 02:14:45 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:14:46.409530 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-005a63c7-ff27-42a9-8d3c-921b2557298d req-f2439812-bbda-4ae6-815b-4001d0810168 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fe588ab-961a-40e1-ac9f-180b9d892041", "tag": "024cb3c7-efb2-4442-a9a7-773209aa680b"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:14:46.419807 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-005a63c7-ff27-42a9-8d3c-921b2557298d req-f2439812-bbda-4ae6-815b-4001d0810168 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:46.420540 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-005a63c7-ff27-42a9-8d3c-921b2557298d req-f2439812-bbda-4ae6-815b-4001d0810168 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:46.420979 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-005a63c7-ff27-42a9-8d3c-921b2557298d req-f2439812-bbda-4ae6-815b-4001d0810168 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:46.432446 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-005a63c7-ff27-42a9-8d3c-921b2557298d req-f2439812-bbda-4ae6-815b-4001d0810168 service nova] Creating event network-changed:024cb3c7-efb2-4442-a9a7-773209aa680b for instance 8fe588ab-961a-40e1-ac9f-180b9d892041 on n-h2-master-1 Oct 23 02:14:46.438301 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-005a63c7-ff27-42a9-8d3c-921b2557298d req-f2439812-bbda-4ae6-815b-4001d0810168 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032412 Oct 23 02:14:46.440181 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3843/7594] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:15:25.063654 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:15:25.067939 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f57c8663-0b23-4699-89ca-d31c8d315c64 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:25.068565 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f57c8663-0b23-4699-89ca-d31c8d315c64 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:25.074758 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f57c8663-0b23-4699-89ca-d31c8d315c64 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:25.075239 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f57c8663-0b23-4699-89ca-d31c8d315c64 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:25.079377 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f57c8663-0b23-4699-89ca-d31c8d315c64 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:25.079377 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f57c8663-0b23-4699-89ca-d31c8d315c64 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:25.079377 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f57c8663-0b23-4699-89ca-d31c8d315c64 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:25.079377 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f57c8663-0b23-4699-89ca-d31c8d315c64 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:25.204980 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f57c8663-0b23-4699-89ca-d31c8d315c64 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:25.212600 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f57c8663-0b23-4699-89ca-d31c8d315c64 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1669 microversion: 2.1 time: 0.151070 Oct 23 02:15:25.213179 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3752/7595] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:25 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1669 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:15:25.234623 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:15:25.235377 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=73 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:15:25.239571 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8947b9ae-bc4a-4e75-9874-3408f8e7b82f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "796d50bd-0b80-4c92-ad52-f4ec28e1cac1"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:15:25.241936 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8947b9ae-bc4a-4e75-9874-3408f8e7b82f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:25.247909 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8947b9ae-bc4a-4e75-9874-3408f8e7b82f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:25.248390 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8947b9ae-bc4a-4e75-9874-3408f8e7b82f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:25.248826 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8947b9ae-bc4a-4e75-9874-3408f8e7b82f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:25.249505 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8947b9ae-bc4a-4e75-9874-3408f8e7b82f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:25.249957 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8947b9ae-bc4a-4e75-9874-3408f8e7b82f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:25.250405 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8947b9ae-bc4a-4e75-9874-3408f8e7b82f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:25.936144 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8947b9ae-bc4a-4e75-9874-3408f8e7b82f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "POST /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.703505 Oct 23 02:15:25.936772 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3844/7596] 10.222.0.42 () {60 vars in 1323 bytes} [Sun Oct 23 02:15:25 2022] POST /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041/os-volume_attachments => generated 194 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:15:37.705665 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2b54fe91-875e-4d02-928e-256572430f7a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:15:37.707983 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2b54fe91-875e-4d02-928e-256572430f7a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:37.710800 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:15:37.711484 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=6 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:15:37.716395 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2b54fe91-875e-4d02-928e-256572430f7a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:37.717524 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2b54fe91-875e-4d02-928e-256572430f7a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:37.719843 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2b54fe91-875e-4d02-928e-256572430f7a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:37.719843 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2b54fe91-875e-4d02-928e-256572430f7a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:37.719843 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2b54fe91-875e-4d02-928e-256572430f7a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:37.719843 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2b54fe91-875e-4d02-928e-256572430f7a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:37.753189 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2b54fe91-875e-4d02-928e-256572430f7a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:37.753862 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2b54fe91-875e-4d02-928e-256572430f7a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Old instance type m1.heat2, new instance type m1.heat {{(pid=120945) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 23 02:15:37.760578 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-2b54fe91-875e-4d02-928e-256572430f7a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:15:37.761051 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-2b54fe91-875e-4d02-928e-256572430f7a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:15:37.761505 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-2b54fe91-875e-4d02-928e-256572430f7a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:15:37.761917 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-2b54fe91-875e-4d02-928e-256572430f7a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:15:37.762406 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-2b54fe91-875e-4d02-928e-256572430f7a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:15:37.913257 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2b54fe91-875e-4d02-928e-256572430f7a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "POST /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041/action" status: 202 len: 0 microversion: 2.1 time: 0.211879 Oct 23 02:15:37.913884 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3753/7597] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:15:37 2022] POST /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:15:37.920409 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:15:37.921177 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:15:37.926634 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0810251d-1806-4b31-9fa6-0460d470f317 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:37.927376 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0810251d-1806-4b31-9fa6-0460d470f317 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:37.933549 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0810251d-1806-4b31-9fa6-0460d470f317 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:37.934071 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0810251d-1806-4b31-9fa6-0460d470f317 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:37.934517 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0810251d-1806-4b31-9fa6-0460d470f317 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:37.935218 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0810251d-1806-4b31-9fa6-0460d470f317 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:37.936233 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0810251d-1806-4b31-9fa6-0460d470f317 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:37.936661 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0810251d-1806-4b31-9fa6-0460d470f317 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:38.070703 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0810251d-1806-4b31-9fa6-0460d470f317 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:38.079692 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0810251d-1806-4b31-9fa6-0460d470f317 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1724 microversion: 2.1 time: 0.161333 Oct 23 02:15:38.080494 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3845/7598] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:37 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:15:39.103455 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-64775221-8ca8-420c-9f1d-45e884a2daee tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:39.104087 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-64775221-8ca8-420c-9f1d-45e884a2daee tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:39.111044 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64775221-8ca8-420c-9f1d-45e884a2daee tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:39.111549 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64775221-8ca8-420c-9f1d-45e884a2daee tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:39.112000 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64775221-8ca8-420c-9f1d-45e884a2daee tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:39.112730 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64775221-8ca8-420c-9f1d-45e884a2daee tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:39.113236 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64775221-8ca8-420c-9f1d-45e884a2daee tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:39.113670 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-64775221-8ca8-420c-9f1d-45e884a2daee tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:39.243365 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-64775221-8ca8-420c-9f1d-45e884a2daee tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:39.251545 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-64775221-8ca8-420c-9f1d-45e884a2daee tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1724 microversion: 2.1 time: 0.152091 Oct 23 02:15:39.252126 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3754/7599] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:39 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:15:40.275582 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5e0ec621-d096-40df-a86c-7255ba577927 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:40.276331 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5e0ec621-d096-40df-a86c-7255ba577927 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:40.284420 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5e0ec621-d096-40df-a86c-7255ba577927 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:40.284904 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5e0ec621-d096-40df-a86c-7255ba577927 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:40.285342 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5e0ec621-d096-40df-a86c-7255ba577927 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:40.286132 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5e0ec621-d096-40df-a86c-7255ba577927 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:40.286593 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5e0ec621-d096-40df-a86c-7255ba577927 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:40.287017 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5e0ec621-d096-40df-a86c-7255ba577927 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:40.420693 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5e0ec621-d096-40df-a86c-7255ba577927 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:40.429220 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5e0ec621-d096-40df-a86c-7255ba577927 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1724 microversion: 2.1 time: 0.157569 Oct 23 02:15:40.429804 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3846/7600] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:40 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:15:41.451604 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f81876d3-73ed-4c98-8250-cf994fd4a5d8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:41.452234 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f81876d3-73ed-4c98-8250-cf994fd4a5d8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:41.459067 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f81876d3-73ed-4c98-8250-cf994fd4a5d8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:41.459561 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f81876d3-73ed-4c98-8250-cf994fd4a5d8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:41.460008 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f81876d3-73ed-4c98-8250-cf994fd4a5d8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:41.460730 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f81876d3-73ed-4c98-8250-cf994fd4a5d8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:41.461197 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f81876d3-73ed-4c98-8250-cf994fd4a5d8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:41.461631 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f81876d3-73ed-4c98-8250-cf994fd4a5d8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:41.589739 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f81876d3-73ed-4c98-8250-cf994fd4a5d8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:41.598290 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f81876d3-73ed-4c98-8250-cf994fd4a5d8 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1729 microversion: 2.1 time: 0.150609 Oct 23 02:15:41.598867 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3755/7601] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:41 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:15:42.622330 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-92d16046-7917-4557-9563-cd6ce83fd715 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:42.623484 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-92d16046-7917-4557-9563-cd6ce83fd715 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:42.630371 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92d16046-7917-4557-9563-cd6ce83fd715 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:42.630849 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92d16046-7917-4557-9563-cd6ce83fd715 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:42.631292 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92d16046-7917-4557-9563-cd6ce83fd715 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:42.631988 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92d16046-7917-4557-9563-cd6ce83fd715 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:42.632452 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92d16046-7917-4557-9563-cd6ce83fd715 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:42.632882 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92d16046-7917-4557-9563-cd6ce83fd715 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:42.761961 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-92d16046-7917-4557-9563-cd6ce83fd715 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:42.770959 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-92d16046-7917-4557-9563-cd6ce83fd715 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1729 microversion: 2.1 time: 0.152606 Oct 23 02:15:42.771531 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3847/7602] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:42 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:15:43.794445 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1a94d780-db43-4392-a2e3-5743cca07fac tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:43.795011 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1a94d780-db43-4392-a2e3-5743cca07fac tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:43.801968 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1a94d780-db43-4392-a2e3-5743cca07fac tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:43.802500 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1a94d780-db43-4392-a2e3-5743cca07fac tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:43.802943 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1a94d780-db43-4392-a2e3-5743cca07fac tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:43.803639 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1a94d780-db43-4392-a2e3-5743cca07fac tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:43.804103 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1a94d780-db43-4392-a2e3-5743cca07fac tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:43.804535 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1a94d780-db43-4392-a2e3-5743cca07fac tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:43.936029 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1a94d780-db43-4392-a2e3-5743cca07fac tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:43.944181 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1a94d780-db43-4392-a2e3-5743cca07fac tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1729 microversion: 2.1 time: 0.153824 Oct 23 02:15:43.944753 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3756/7603] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:43 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:15:44.968780 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-475dedde-6fbf-4c41-9d55-0e3f2754e6a7 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:44.969455 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-475dedde-6fbf-4c41-9d55-0e3f2754e6a7 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:44.976363 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-475dedde-6fbf-4c41-9d55-0e3f2754e6a7 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:44.976851 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-475dedde-6fbf-4c41-9d55-0e3f2754e6a7 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:44.977296 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-475dedde-6fbf-4c41-9d55-0e3f2754e6a7 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:44.978001 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-475dedde-6fbf-4c41-9d55-0e3f2754e6a7 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:44.978463 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-475dedde-6fbf-4c41-9d55-0e3f2754e6a7 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:44.978888 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-475dedde-6fbf-4c41-9d55-0e3f2754e6a7 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:45.105406 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-475dedde-6fbf-4c41-9d55-0e3f2754e6a7 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:45.113592 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-475dedde-6fbf-4c41-9d55-0e3f2754e6a7 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1729 microversion: 2.1 time: 0.149493 Oct 23 02:15:45.114194 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3848/7604] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:44 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:15:46.138081 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4d4a59cf-adc3-4b09-a01c-ee824dc8a9b0 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:46.138713 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4d4a59cf-adc3-4b09-a01c-ee824dc8a9b0 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:46.145640 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4d4a59cf-adc3-4b09-a01c-ee824dc8a9b0 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:46.146162 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4d4a59cf-adc3-4b09-a01c-ee824dc8a9b0 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:46.146608 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4d4a59cf-adc3-4b09-a01c-ee824dc8a9b0 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:46.147299 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4d4a59cf-adc3-4b09-a01c-ee824dc8a9b0 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:46.147762 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4d4a59cf-adc3-4b09-a01c-ee824dc8a9b0 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:46.148196 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4d4a59cf-adc3-4b09-a01c-ee824dc8a9b0 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:46.282547 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4d4a59cf-adc3-4b09-a01c-ee824dc8a9b0 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:46.290845 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4d4a59cf-adc3-4b09-a01c-ee824dc8a9b0 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1729 microversion: 2.1 time: 0.156652 Oct 23 02:15:46.291428 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3757/7605] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:46 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:15:47.314751 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-55bd078a-a8a5-457b-a212-f0f78e69b7d9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:47.315376 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-55bd078a-a8a5-457b-a212-f0f78e69b7d9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:47.322247 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55bd078a-a8a5-457b-a212-f0f78e69b7d9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:47.322737 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55bd078a-a8a5-457b-a212-f0f78e69b7d9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:47.323178 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55bd078a-a8a5-457b-a212-f0f78e69b7d9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:47.323865 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55bd078a-a8a5-457b-a212-f0f78e69b7d9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:47.324322 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55bd078a-a8a5-457b-a212-f0f78e69b7d9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:47.324783 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55bd078a-a8a5-457b-a212-f0f78e69b7d9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:47.454446 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-55bd078a-a8a5-457b-a212-f0f78e69b7d9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:47.462852 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-55bd078a-a8a5-457b-a212-f0f78e69b7d9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1729 microversion: 2.1 time: 0.151995 Oct 23 02:15:47.463444 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3849/7606] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:47 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:15:48.488560 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d3687192-2564-4b53-a065-84c05998ffa9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:48.488560 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d3687192-2564-4b53-a065-84c05998ffa9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:48.495668 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d3687192-2564-4b53-a065-84c05998ffa9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:48.496158 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d3687192-2564-4b53-a065-84c05998ffa9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:48.496603 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d3687192-2564-4b53-a065-84c05998ffa9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:48.497291 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d3687192-2564-4b53-a065-84c05998ffa9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:48.497751 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d3687192-2564-4b53-a065-84c05998ffa9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:48.498220 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d3687192-2564-4b53-a065-84c05998ffa9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:48.628908 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d3687192-2564-4b53-a065-84c05998ffa9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:48.637418 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d3687192-2564-4b53-a065-84c05998ffa9 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1729 microversion: 2.1 time: 0.153533 Oct 23 02:15:48.644996 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3758/7607] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:48 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:15:49.660683 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b33f09ab-58e7-4daf-a0aa-eec047c24928 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:49.661309 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b33f09ab-58e7-4daf-a0aa-eec047c24928 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:49.668262 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b33f09ab-58e7-4daf-a0aa-eec047c24928 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:49.668751 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b33f09ab-58e7-4daf-a0aa-eec047c24928 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:49.669197 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b33f09ab-58e7-4daf-a0aa-eec047c24928 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:49.670420 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b33f09ab-58e7-4daf-a0aa-eec047c24928 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:49.670881 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b33f09ab-58e7-4daf-a0aa-eec047c24928 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:49.671309 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b33f09ab-58e7-4daf-a0aa-eec047c24928 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:49.801855 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b33f09ab-58e7-4daf-a0aa-eec047c24928 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:49.810934 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b33f09ab-58e7-4daf-a0aa-eec047c24928 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1729 microversion: 2.1 time: 0.153615 Oct 23 02:15:49.811519 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3850/7608] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:49 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:15:50.834467 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7bf29470-0f7d-45d0-9c5e-c3180c5b7a73 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:50.835025 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7bf29470-0f7d-45d0-9c5e-c3180c5b7a73 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:50.842372 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7bf29470-0f7d-45d0-9c5e-c3180c5b7a73 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:50.842878 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7bf29470-0f7d-45d0-9c5e-c3180c5b7a73 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:50.843330 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7bf29470-0f7d-45d0-9c5e-c3180c5b7a73 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:50.844039 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7bf29470-0f7d-45d0-9c5e-c3180c5b7a73 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:50.844512 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7bf29470-0f7d-45d0-9c5e-c3180c5b7a73 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:50.844955 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7bf29470-0f7d-45d0-9c5e-c3180c5b7a73 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:50.974918 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7bf29470-0f7d-45d0-9c5e-c3180c5b7a73 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:50.983594 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7bf29470-0f7d-45d0-9c5e-c3180c5b7a73 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1729 microversion: 2.1 time: 0.153162 Oct 23 02:15:50.984189 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3759/7609] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:50 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:15:52.008071 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-28b36fc9-4d21-4a3c-99ee-2bd9e05da2bd tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:52.008699 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-28b36fc9-4d21-4a3c-99ee-2bd9e05da2bd tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:52.015904 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-28b36fc9-4d21-4a3c-99ee-2bd9e05da2bd tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:52.016394 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-28b36fc9-4d21-4a3c-99ee-2bd9e05da2bd tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:52.016827 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-28b36fc9-4d21-4a3c-99ee-2bd9e05da2bd tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:52.017524 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-28b36fc9-4d21-4a3c-99ee-2bd9e05da2bd tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:52.017994 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-28b36fc9-4d21-4a3c-99ee-2bd9e05da2bd tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:52.018425 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-28b36fc9-4d21-4a3c-99ee-2bd9e05da2bd tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:52.151566 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-28b36fc9-4d21-4a3c-99ee-2bd9e05da2bd tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:52.160016 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-28b36fc9-4d21-4a3c-99ee-2bd9e05da2bd tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1729 microversion: 2.1 time: 0.156030 Oct 23 02:15:52.160602 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3851/7610] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:52 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:15:53.182738 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5e538232-5baa-4f43-98d8-464dc0cc0d0d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:53.183319 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5e538232-5baa-4f43-98d8-464dc0cc0d0d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:53.189504 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e538232-5baa-4f43-98d8-464dc0cc0d0d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:53.190032 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e538232-5baa-4f43-98d8-464dc0cc0d0d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:53.190484 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e538232-5baa-4f43-98d8-464dc0cc0d0d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:53.191182 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e538232-5baa-4f43-98d8-464dc0cc0d0d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:53.191647 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e538232-5baa-4f43-98d8-464dc0cc0d0d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:53.192081 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e538232-5baa-4f43-98d8-464dc0cc0d0d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:53.320935 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5e538232-5baa-4f43-98d8-464dc0cc0d0d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:53.329587 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5e538232-5baa-4f43-98d8-464dc0cc0d0d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1729 microversion: 2.1 time: 0.151005 Oct 23 02:15:53.330208 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3760/7611] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:53 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:15:54.353689 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-62070a6c-2bcf-40eb-a39c-af3134b67846 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:54.354332 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-62070a6c-2bcf-40eb-a39c-af3134b67846 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:54.361555 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-62070a6c-2bcf-40eb-a39c-af3134b67846 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:54.362067 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-62070a6c-2bcf-40eb-a39c-af3134b67846 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:54.362506 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-62070a6c-2bcf-40eb-a39c-af3134b67846 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:54.363190 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-62070a6c-2bcf-40eb-a39c-af3134b67846 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:54.363645 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-62070a6c-2bcf-40eb-a39c-af3134b67846 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:54.364070 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-62070a6c-2bcf-40eb-a39c-af3134b67846 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:54.494717 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-62070a6c-2bcf-40eb-a39c-af3134b67846 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:54.502930 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-62070a6c-2bcf-40eb-a39c-af3134b67846 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1729 microversion: 2.1 time: 0.153097 Oct 23 02:15:54.503502 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3852/7612] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:54 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:15:55.582513 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-51c1c447-7092-4119-a98f-6a4dd4a27a19 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:55.583147 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-51c1c447-7092-4119-a98f-6a4dd4a27a19 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:55.589995 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-51c1c447-7092-4119-a98f-6a4dd4a27a19 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:55.590753 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-51c1c447-7092-4119-a98f-6a4dd4a27a19 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:55.591272 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-51c1c447-7092-4119-a98f-6a4dd4a27a19 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:55.591971 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-51c1c447-7092-4119-a98f-6a4dd4a27a19 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:55.592438 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-51c1c447-7092-4119-a98f-6a4dd4a27a19 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:55.592875 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-51c1c447-7092-4119-a98f-6a4dd4a27a19 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:55.720030 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-51c1c447-7092-4119-a98f-6a4dd4a27a19 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:55.728286 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-51c1c447-7092-4119-a98f-6a4dd4a27a19 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1729 microversion: 2.1 time: 0.149735 Oct 23 02:15:55.728862 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3761/7613] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:55 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:15:56.752768 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7cfd677c-b520-4a35-9b76-60394a9fd30b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:56.753316 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7cfd677c-b520-4a35-9b76-60394a9fd30b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:56.760421 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7cfd677c-b520-4a35-9b76-60394a9fd30b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:56.760958 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7cfd677c-b520-4a35-9b76-60394a9fd30b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:56.761398 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7cfd677c-b520-4a35-9b76-60394a9fd30b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:56.762125 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7cfd677c-b520-4a35-9b76-60394a9fd30b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:56.762581 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7cfd677c-b520-4a35-9b76-60394a9fd30b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:56.763648 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7cfd677c-b520-4a35-9b76-60394a9fd30b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:56.890899 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7cfd677c-b520-4a35-9b76-60394a9fd30b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:56.899069 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7cfd677c-b520-4a35-9b76-60394a9fd30b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1729 microversion: 2.1 time: 0.150311 Oct 23 02:15:56.899642 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3853/7614] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:56 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:15:57.922937 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-075db2b0-7303-4b50-9c3e-7d300a135d67 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:57.923488 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-075db2b0-7303-4b50-9c3e-7d300a135d67 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:57.929428 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-075db2b0-7303-4b50-9c3e-7d300a135d67 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:57.929922 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-075db2b0-7303-4b50-9c3e-7d300a135d67 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:57.930399 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-075db2b0-7303-4b50-9c3e-7d300a135d67 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:57.931095 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-075db2b0-7303-4b50-9c3e-7d300a135d67 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:57.931563 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-075db2b0-7303-4b50-9c3e-7d300a135d67 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:57.931999 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-075db2b0-7303-4b50-9c3e-7d300a135d67 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:58.062276 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-075db2b0-7303-4b50-9c3e-7d300a135d67 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:58.070392 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-075db2b0-7303-4b50-9c3e-7d300a135d67 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1729 microversion: 2.1 time: 0.152381 Oct 23 02:15:58.070964 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3762/7615] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:57 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:15:59.095004 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-900461d5-486d-495c-b684-d309cbe59468 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:59.095658 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-900461d5-486d-495c-b684-d309cbe59468 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:59.102579 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-900461d5-486d-495c-b684-d309cbe59468 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:59.103070 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-900461d5-486d-495c-b684-d309cbe59468 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:59.103509 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-900461d5-486d-495c-b684-d309cbe59468 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:59.104206 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-900461d5-486d-495c-b684-d309cbe59468 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:59.104669 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-900461d5-486d-495c-b684-d309cbe59468 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:59.105095 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-900461d5-486d-495c-b684-d309cbe59468 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:59.234442 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-900461d5-486d-495c-b684-d309cbe59468 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:59.242976 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-900461d5-486d-495c-b684-d309cbe59468 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1729 microversion: 2.1 time: 0.152629 Oct 23 02:15:59.243555 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3854/7616] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:59 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:00.266774 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a0312665-4524-47a1-8e18-fa0b508d066d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:00.267410 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a0312665-4524-47a1-8e18-fa0b508d066d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:00.274489 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a0312665-4524-47a1-8e18-fa0b508d066d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:00.274996 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a0312665-4524-47a1-8e18-fa0b508d066d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:00.275449 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a0312665-4524-47a1-8e18-fa0b508d066d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:00.276158 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a0312665-4524-47a1-8e18-fa0b508d066d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:00.276632 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a0312665-4524-47a1-8e18-fa0b508d066d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:00.277074 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a0312665-4524-47a1-8e18-fa0b508d066d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:00.409928 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a0312665-4524-47a1-8e18-fa0b508d066d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:00.418273 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a0312665-4524-47a1-8e18-fa0b508d066d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1729 microversion: 2.1 time: 0.155437 Oct 23 02:16:00.419578 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3763/7617] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:00 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:01.442035 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-620fb456-f2e0-4dc1-a46e-c41cf9340f14 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:01.442798 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-620fb456-f2e0-4dc1-a46e-c41cf9340f14 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:01.449807 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-620fb456-f2e0-4dc1-a46e-c41cf9340f14 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:01.451300 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-620fb456-f2e0-4dc1-a46e-c41cf9340f14 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:01.451437 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-620fb456-f2e0-4dc1-a46e-c41cf9340f14 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:01.452465 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-620fb456-f2e0-4dc1-a46e-c41cf9340f14 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:01.453109 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-620fb456-f2e0-4dc1-a46e-c41cf9340f14 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:01.453543 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-620fb456-f2e0-4dc1-a46e-c41cf9340f14 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:01.597497 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-620fb456-f2e0-4dc1-a46e-c41cf9340f14 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:01.606215 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-620fb456-f2e0-4dc1-a46e-c41cf9340f14 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1728 microversion: 2.1 time: 0.168135 Oct 23 02:16:01.607575 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3855/7618] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:01 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1728 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:01.740316 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-f600e829-9343-4a97-8022-76e4f7e78a1b req-a07ccc2a-3efb-43ad-a704-51ad827fa7ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fe588ab-961a-40e1-ac9f-180b9d892041", "name": "network-vif-unplugged", "status": "completed", "tag": "024cb3c7-efb2-4442-a9a7-773209aa680b"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:16:01.750348 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-f600e829-9343-4a97-8022-76e4f7e78a1b req-a07ccc2a-3efb-43ad-a704-51ad827fa7ef service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:01.750833 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-f600e829-9343-4a97-8022-76e4f7e78a1b req-a07ccc2a-3efb-43ad-a704-51ad827fa7ef service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:01.751270 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-f600e829-9343-4a97-8022-76e4f7e78a1b req-a07ccc2a-3efb-43ad-a704-51ad827fa7ef service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:01.765813 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-f600e829-9343-4a97-8022-76e4f7e78a1b req-a07ccc2a-3efb-43ad-a704-51ad827fa7ef service nova] Creating event network-vif-unplugged:024cb3c7-efb2-4442-a9a7-773209aa680b for instance 8fe588ab-961a-40e1-ac9f-180b9d892041 on n-h1-master-1 Oct 23 02:16:01.771304 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [req-f600e829-9343-4a97-8022-76e4f7e78a1b req-a07ccc2a-3efb-43ad-a704-51ad827fa7ef service nova] Instance 8fe588ab-961a-40e1-ac9f-180b9d892041 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120945) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 23 02:16:01.785205 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-f600e829-9343-4a97-8022-76e4f7e78a1b req-a07ccc2a-3efb-43ad-a704-51ad827fa7ef service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102665 Oct 23 02:16:01.786003 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3764/7619] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:16:02.631220 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-19d4475e-d05f-430b-b088-4b03c453cf91 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:02.631968 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-19d4475e-d05f-430b-b088-4b03c453cf91 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:02.639536 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-19d4475e-d05f-430b-b088-4b03c453cf91 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:02.640033 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-19d4475e-d05f-430b-b088-4b03c453cf91 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:02.640479 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-19d4475e-d05f-430b-b088-4b03c453cf91 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:02.641183 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-19d4475e-d05f-430b-b088-4b03c453cf91 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:02.641648 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-19d4475e-d05f-430b-b088-4b03c453cf91 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:02.642110 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-19d4475e-d05f-430b-b088-4b03c453cf91 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:02.775901 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-19d4475e-d05f-430b-b088-4b03c453cf91 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:02.784194 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-19d4475e-d05f-430b-b088-4b03c453cf91 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1728 microversion: 2.1 time: 0.156893 Oct 23 02:16:02.784786 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3856/7620] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:02 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:03.813888 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-37a0f1bb-06ec-4db2-91d9-542cf1ee4855 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:03.813888 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-37a0f1bb-06ec-4db2-91d9-542cf1ee4855 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:03.814899 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-e35972f8-b159-432d-829f-b683eaf90a2b req-51b58fb9-a36b-4eff-8c69-3f36ae1d7608 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fe588ab-961a-40e1-ac9f-180b9d892041", "tag": "024cb3c7-efb2-4442-a9a7-773209aa680b"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:16:03.817431 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-37a0f1bb-06ec-4db2-91d9-542cf1ee4855 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:03.817938 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-37a0f1bb-06ec-4db2-91d9-542cf1ee4855 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:03.818640 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-37a0f1bb-06ec-4db2-91d9-542cf1ee4855 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:03.819356 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-37a0f1bb-06ec-4db2-91d9-542cf1ee4855 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:03.819989 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-37a0f1bb-06ec-4db2-91d9-542cf1ee4855 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:03.820580 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-37a0f1bb-06ec-4db2-91d9-542cf1ee4855 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:03.824598 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-e35972f8-b159-432d-829f-b683eaf90a2b req-51b58fb9-a36b-4eff-8c69-3f36ae1d7608 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:03.825582 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-e35972f8-b159-432d-829f-b683eaf90a2b req-51b58fb9-a36b-4eff-8c69-3f36ae1d7608 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:03.826059 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-e35972f8-b159-432d-829f-b683eaf90a2b req-51b58fb9-a36b-4eff-8c69-3f36ae1d7608 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:03.838640 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-e35972f8-b159-432d-829f-b683eaf90a2b req-51b58fb9-a36b-4eff-8c69-3f36ae1d7608 service nova] Creating event network-changed:024cb3c7-efb2-4442-a9a7-773209aa680b for instance 8fe588ab-961a-40e1-ac9f-180b9d892041 on n-h1-master-1 Oct 23 02:16:03.845618 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [req-e35972f8-b159-432d-829f-b683eaf90a2b req-51b58fb9-a36b-4eff-8c69-3f36ae1d7608 service nova] Instance 8fe588ab-961a-40e1-ac9f-180b9d892041 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120944) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 23 02:16:03.857298 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-e35972f8-b159-432d-829f-b683eaf90a2b req-51b58fb9-a36b-4eff-8c69-3f36ae1d7608 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047766 Oct 23 02:16:03.858271 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3857/7621] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:16:03.956949 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-37a0f1bb-06ec-4db2-91d9-542cf1ee4855 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:03.966872 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-37a0f1bb-06ec-4db2-91d9-542cf1ee4855 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1726 microversion: 2.1 time: 0.161958 Oct 23 02:16:03.967460 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3765/7622] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:03 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:04.992337 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e6c535d6-5f56-4213-aa70-c12da8ca05b0 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:04.993041 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e6c535d6-5f56-4213-aa70-c12da8ca05b0 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:04.999565 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e6c535d6-5f56-4213-aa70-c12da8ca05b0 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:05.000050 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e6c535d6-5f56-4213-aa70-c12da8ca05b0 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:05.000487 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e6c535d6-5f56-4213-aa70-c12da8ca05b0 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:05.001170 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e6c535d6-5f56-4213-aa70-c12da8ca05b0 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:05.001622 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e6c535d6-5f56-4213-aa70-c12da8ca05b0 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:05.002079 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e6c535d6-5f56-4213-aa70-c12da8ca05b0 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:05.131831 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e6c535d6-5f56-4213-aa70-c12da8ca05b0 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:05.140194 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e6c535d6-5f56-4213-aa70-c12da8ca05b0 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1726 microversion: 2.1 time: 0.153017 Oct 23 02:16:05.140769 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3858/7623] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:04 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:06.164636 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0b9ae300-6b8c-4d3e-915d-b6e370fdda0e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:06.165256 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0b9ae300-6b8c-4d3e-915d-b6e370fdda0e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:06.172628 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b9ae300-6b8c-4d3e-915d-b6e370fdda0e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:06.173123 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b9ae300-6b8c-4d3e-915d-b6e370fdda0e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:06.173569 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b9ae300-6b8c-4d3e-915d-b6e370fdda0e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:06.174287 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b9ae300-6b8c-4d3e-915d-b6e370fdda0e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:06.174785 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b9ae300-6b8c-4d3e-915d-b6e370fdda0e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:06.175219 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b9ae300-6b8c-4d3e-915d-b6e370fdda0e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:06.310133 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0b9ae300-6b8c-4d3e-915d-b6e370fdda0e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:06.318623 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0b9ae300-6b8c-4d3e-915d-b6e370fdda0e tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1726 microversion: 2.1 time: 0.157980 Oct 23 02:16:06.319231 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3766/7624] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:06 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:07.342147 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b0f4c99b-c8dd-474f-88de-2a3a96d6150f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:07.342781 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b0f4c99b-c8dd-474f-88de-2a3a96d6150f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:07.349762 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b0f4c99b-c8dd-474f-88de-2a3a96d6150f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:07.350285 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b0f4c99b-c8dd-474f-88de-2a3a96d6150f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:07.350734 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b0f4c99b-c8dd-474f-88de-2a3a96d6150f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:07.351436 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b0f4c99b-c8dd-474f-88de-2a3a96d6150f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:07.351901 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b0f4c99b-c8dd-474f-88de-2a3a96d6150f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:07.352332 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b0f4c99b-c8dd-474f-88de-2a3a96d6150f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:07.482195 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b0f4c99b-c8dd-474f-88de-2a3a96d6150f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:07.490882 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b0f4c99b-c8dd-474f-88de-2a3a96d6150f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1726 microversion: 2.1 time: 0.152935 Oct 23 02:16:07.491484 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3859/7625] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:07 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:08.515403 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8daaac78-6d6d-44cf-a036-762db6aa2271 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:08.516028 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8daaac78-6d6d-44cf-a036-762db6aa2271 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:08.518807 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=33 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:08.523491 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8daaac78-6d6d-44cf-a036-762db6aa2271 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:08.523985 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8daaac78-6d6d-44cf-a036-762db6aa2271 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:08.524427 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8daaac78-6d6d-44cf-a036-762db6aa2271 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:08.525123 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8daaac78-6d6d-44cf-a036-762db6aa2271 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:08.525588 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8daaac78-6d6d-44cf-a036-762db6aa2271 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:08.526041 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8daaac78-6d6d-44cf-a036-762db6aa2271 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:08.529294 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:08.659133 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8daaac78-6d6d-44cf-a036-762db6aa2271 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:08.667317 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8daaac78-6d6d-44cf-a036-762db6aa2271 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1726 microversion: 2.1 time: 0.156284 Oct 23 02:16:08.667893 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3767/7626] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:08 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:09.691038 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9cdb83fa-a9cc-46ac-9254-2615b028e47f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:09.691662 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9cdb83fa-a9cc-46ac-9254-2615b028e47f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:09.694510 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=31 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:09.699344 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9cdb83fa-a9cc-46ac-9254-2615b028e47f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:09.699845 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9cdb83fa-a9cc-46ac-9254-2615b028e47f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:09.700324 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9cdb83fa-a9cc-46ac-9254-2615b028e47f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:09.704476 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9cdb83fa-a9cc-46ac-9254-2615b028e47f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:09.704476 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9cdb83fa-a9cc-46ac-9254-2615b028e47f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:09.704476 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9cdb83fa-a9cc-46ac-9254-2615b028e47f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:09.836719 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9cdb83fa-a9cc-46ac-9254-2615b028e47f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:09.845729 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9cdb83fa-a9cc-46ac-9254-2615b028e47f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1726 microversion: 2.1 time: 0.158614 Oct 23 02:16:09.846346 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3860/7627] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:09 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:10.869952 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ea83e0b1-9ab1-424a-a648-85439b7fafa4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:10.870622 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ea83e0b1-9ab1-424a-a648-85439b7fafa4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:10.878125 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ea83e0b1-9ab1-424a-a648-85439b7fafa4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:10.878630 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ea83e0b1-9ab1-424a-a648-85439b7fafa4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:10.879086 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ea83e0b1-9ab1-424a-a648-85439b7fafa4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:10.879793 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ea83e0b1-9ab1-424a-a648-85439b7fafa4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:10.880266 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ea83e0b1-9ab1-424a-a648-85439b7fafa4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:10.880708 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ea83e0b1-9ab1-424a-a648-85439b7fafa4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:11.008337 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ea83e0b1-9ab1-424a-a648-85439b7fafa4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:11.017231 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ea83e0b1-9ab1-424a-a648-85439b7fafa4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1726 microversion: 2.1 time: 0.151239 Oct 23 02:16:11.017810 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3768/7628] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:10 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:12.039960 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-83268be0-65d2-4591-b528-d78ad31be7ff tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:12.040515 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-83268be0-65d2-4591-b528-d78ad31be7ff tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:12.047471 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-83268be0-65d2-4591-b528-d78ad31be7ff tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:12.047948 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-83268be0-65d2-4591-b528-d78ad31be7ff tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:12.048379 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-83268be0-65d2-4591-b528-d78ad31be7ff tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:12.049067 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-83268be0-65d2-4591-b528-d78ad31be7ff tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:12.049517 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-83268be0-65d2-4591-b528-d78ad31be7ff tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:12.049937 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-83268be0-65d2-4591-b528-d78ad31be7ff tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:12.053834 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=95 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:12.183608 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-83268be0-65d2-4591-b528-d78ad31be7ff tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:12.192018 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-83268be0-65d2-4591-b528-d78ad31be7ff tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1726 microversion: 2.1 time: 0.155965 Oct 23 02:16:12.192642 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3861/7629] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:12 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:13.216637 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-45ef51b4-994c-45bf-80f7-94f9647802fa tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:13.217201 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-45ef51b4-994c-45bf-80f7-94f9647802fa tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:13.224070 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-45ef51b4-994c-45bf-80f7-94f9647802fa tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:13.224566 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-45ef51b4-994c-45bf-80f7-94f9647802fa tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:13.225018 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-45ef51b4-994c-45bf-80f7-94f9647802fa tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:13.225714 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-45ef51b4-994c-45bf-80f7-94f9647802fa tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:13.226216 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-45ef51b4-994c-45bf-80f7-94f9647802fa tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:13.226653 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-45ef51b4-994c-45bf-80f7-94f9647802fa tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:13.352530 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-45ef51b4-994c-45bf-80f7-94f9647802fa tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:13.361267 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-45ef51b4-994c-45bf-80f7-94f9647802fa tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1726 microversion: 2.1 time: 0.149360 Oct 23 02:16:13.361854 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3769/7630] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:13 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:14.384148 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7d34f6ec-0184-49fb-917b-e2ac43ef6727 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:14.384762 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7d34f6ec-0184-49fb-917b-e2ac43ef6727 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:14.391621 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d34f6ec-0184-49fb-917b-e2ac43ef6727 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:14.392104 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d34f6ec-0184-49fb-917b-e2ac43ef6727 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:14.392540 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d34f6ec-0184-49fb-917b-e2ac43ef6727 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:14.393227 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d34f6ec-0184-49fb-917b-e2ac43ef6727 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:14.393683 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d34f6ec-0184-49fb-917b-e2ac43ef6727 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:14.394144 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d34f6ec-0184-49fb-917b-e2ac43ef6727 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:14.525951 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7d34f6ec-0184-49fb-917b-e2ac43ef6727 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:14.534254 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7d34f6ec-0184-49fb-917b-e2ac43ef6727 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1726 microversion: 2.1 time: 0.154029 Oct 23 02:16:14.534833 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3862/7631] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:14 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:15.558339 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-879ab775-c190-4806-8f46-32a3c4f15205 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:15.559468 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-879ab775-c190-4806-8f46-32a3c4f15205 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:15.565283 n-d-master-1 devstack@n-api.service[120945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 23 02:16:15.565422 n-d-master-1 devstack@n-api.service[120945]: Sun Oct 23 02:16:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 (ip 10.222.0.42) !!! Oct 23 02:16:15.573998 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-879ab775-c190-4806-8f46-32a3c4f15205 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:15.575163 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-879ab775-c190-4806-8f46-32a3c4f15205 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:15.575624 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-879ab775-c190-4806-8f46-32a3c4f15205 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:15.576320 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-879ab775-c190-4806-8f46-32a3c4f15205 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:15.576783 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-879ab775-c190-4806-8f46-32a3c4f15205 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:15.577217 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-879ab775-c190-4806-8f46-32a3c4f15205 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:15.707163 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-879ab775-c190-4806-8f46-32a3c4f15205 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:15.715986 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-879ab775-c190-4806-8f46-32a3c4f15205 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1726 microversion: 2.1 time: 0.161288 Oct 23 02:16:15.716579 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3770/7632] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:15 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:16.740127 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-36c13a4f-1bc7-47d8-904a-8bf93fb9cdb5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:16.740802 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-36c13a4f-1bc7-47d8-904a-8bf93fb9cdb5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:16.743974 n-d-master-1 devstack@n-api.service[120944]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 23 02:16:16.744115 n-d-master-1 devstack@n-api.service[120944]: Sun Oct 23 02:16:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 (ip 10.222.0.42) !!! Oct 23 02:16:16.749952 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36c13a4f-1bc7-47d8-904a-8bf93fb9cdb5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:16.750458 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36c13a4f-1bc7-47d8-904a-8bf93fb9cdb5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:16.750894 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36c13a4f-1bc7-47d8-904a-8bf93fb9cdb5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:16.751579 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36c13a4f-1bc7-47d8-904a-8bf93fb9cdb5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:16.752034 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36c13a4f-1bc7-47d8-904a-8bf93fb9cdb5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:16.752458 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36c13a4f-1bc7-47d8-904a-8bf93fb9cdb5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:16.886059 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-36c13a4f-1bc7-47d8-904a-8bf93fb9cdb5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:16.894862 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-36c13a4f-1bc7-47d8-904a-8bf93fb9cdb5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1723 microversion: 2.1 time: 0.158729 Oct 23 02:16:16.895435 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3863/7633] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:16 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:16.917337 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-30df9111-a78d-47d8-80a4-e4748d2145fe tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:16:16.917965 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-30df9111-a78d-47d8-80a4-e4748d2145fe tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:16.925214 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-30df9111-a78d-47d8-80a4-e4748d2145fe tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:16.925340 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-30df9111-a78d-47d8-80a4-e4748d2145fe tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:16.925703 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-30df9111-a78d-47d8-80a4-e4748d2145fe tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:16.926438 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-30df9111-a78d-47d8-80a4-e4748d2145fe tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:16.926903 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-30df9111-a78d-47d8-80a4-e4748d2145fe tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:16.927376 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-30df9111-a78d-47d8-80a4-e4748d2145fe tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:16.964061 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-30df9111-a78d-47d8-80a4-e4748d2145fe tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:16.964548 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-30df9111-a78d-47d8-80a4-e4748d2145fe tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:16.964992 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-30df9111-a78d-47d8-80a4-e4748d2145fe tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:16.965995 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-30df9111-a78d-47d8-80a4-e4748d2145fe tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:16.966465 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-30df9111-a78d-47d8-80a4-e4748d2145fe tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:16.966897 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-30df9111-a78d-47d8-80a4-e4748d2145fe tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:16.987251 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-30df9111-a78d-47d8-80a4-e4748d2145fe tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Getting quotas for project 03ca20e778cf488baea3d1e0505cd492. Resources: {'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:16:16.992462 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-30df9111-a78d-47d8-80a4-e4748d2145fe tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Getting quotas for user 8d11ce8077ca4566ba823eac0882c34f and project 03ca20e778cf488baea3d1e0505cd492. Resources: {'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:16:17.318703 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-30df9111-a78d-47d8-80a4-e4748d2145fe tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "POST /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041/action" status: 202 len: 0 microversion: 2.1 time: 0.404964 Oct 23 02:16:17.319250 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3771/7634] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:16:16 2022] POST /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041/action => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:16:17.327549 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-810758d1-3968-4f08-8938-4008e58cdd68 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:17.329158 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-810758d1-3968-4f08-8938-4008e58cdd68 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:17.335670 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-810758d1-3968-4f08-8938-4008e58cdd68 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:17.336178 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-810758d1-3968-4f08-8938-4008e58cdd68 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:17.336624 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-810758d1-3968-4f08-8938-4008e58cdd68 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:17.337373 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-810758d1-3968-4f08-8938-4008e58cdd68 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:17.337844 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-810758d1-3968-4f08-8938-4008e58cdd68 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:17.338529 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-810758d1-3968-4f08-8938-4008e58cdd68 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:17.475752 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-810758d1-3968-4f08-8938-4008e58cdd68 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:17.485022 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-810758d1-3968-4f08-8938-4008e58cdd68 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1722 microversion: 2.1 time: 0.161443 Oct 23 02:16:17.486280 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3864/7635] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:17 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:18.510214 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-582997d4-40b9-4e6a-af63-80916583aa93 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:18.510956 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-582997d4-40b9-4e6a-af63-80916583aa93 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:18.518666 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-582997d4-40b9-4e6a-af63-80916583aa93 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:18.519165 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-582997d4-40b9-4e6a-af63-80916583aa93 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:18.519612 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-582997d4-40b9-4e6a-af63-80916583aa93 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:18.520310 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-582997d4-40b9-4e6a-af63-80916583aa93 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:18.520775 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-582997d4-40b9-4e6a-af63-80916583aa93 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:18.521212 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-582997d4-40b9-4e6a-af63-80916583aa93 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:18.648318 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-582997d4-40b9-4e6a-af63-80916583aa93 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:18.656572 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-582997d4-40b9-4e6a-af63-80916583aa93 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1722 microversion: 2.1 time: 0.151602 Oct 23 02:16:18.657149 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3772/7636] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:18 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:19.564789 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-09e46a06-8e7d-4673-8683-7d53a8040175 req-7510ce1a-1fdf-43ae-b3eb-28003c884809 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fe588ab-961a-40e1-ac9f-180b9d892041", "name": "network-vif-plugged", "status": "completed", "tag": "024cb3c7-efb2-4442-a9a7-773209aa680b"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:16:19.575388 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-09e46a06-8e7d-4673-8683-7d53a8040175 req-7510ce1a-1fdf-43ae-b3eb-28003c884809 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:19.575866 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-09e46a06-8e7d-4673-8683-7d53a8040175 req-7510ce1a-1fdf-43ae-b3eb-28003c884809 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:19.576297 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-09e46a06-8e7d-4673-8683-7d53a8040175 req-7510ce1a-1fdf-43ae-b3eb-28003c884809 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:19.587894 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-09e46a06-8e7d-4673-8683-7d53a8040175 req-7510ce1a-1fdf-43ae-b3eb-28003c884809 service nova] Creating event network-vif-plugged:024cb3c7-efb2-4442-a9a7-773209aa680b for instance 8fe588ab-961a-40e1-ac9f-180b9d892041 on n-h1-master-1 Oct 23 02:16:19.593913 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [req-09e46a06-8e7d-4673-8683-7d53a8040175 req-7510ce1a-1fdf-43ae-b3eb-28003c884809 service nova] Instance 8fe588ab-961a-40e1-ac9f-180b9d892041 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120944) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 23 02:16:19.604570 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-09e46a06-8e7d-4673-8683-7d53a8040175 req-7510ce1a-1fdf-43ae-b3eb-28003c884809 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043556 Oct 23 02:16:19.605124 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3865/7637] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:16:19.680111 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8ad8a919-80b5-4c25-a863-582ea31de726 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:19.680929 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8ad8a919-80b5-4c25-a863-582ea31de726 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:19.687735 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8ad8a919-80b5-4c25-a863-582ea31de726 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:19.688309 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8ad8a919-80b5-4c25-a863-582ea31de726 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:19.688765 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8ad8a919-80b5-4c25-a863-582ea31de726 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:19.689469 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8ad8a919-80b5-4c25-a863-582ea31de726 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:19.689932 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8ad8a919-80b5-4c25-a863-582ea31de726 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:19.690413 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8ad8a919-80b5-4c25-a863-582ea31de726 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:19.823348 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8ad8a919-80b5-4c25-a863-582ea31de726 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:19.832142 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8ad8a919-80b5-4c25-a863-582ea31de726 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1722 microversion: 2.1 time: 0.156040 Oct 23 02:16:19.832720 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3773/7638] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:19 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:20.858790 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-206a24d3-47aa-4a1c-a432-63d0ab2e9c88 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:20.859536 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-206a24d3-47aa-4a1c-a432-63d0ab2e9c88 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:20.865956 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-206a24d3-47aa-4a1c-a432-63d0ab2e9c88 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:20.866472 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-206a24d3-47aa-4a1c-a432-63d0ab2e9c88 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:20.866912 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-206a24d3-47aa-4a1c-a432-63d0ab2e9c88 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:20.867601 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-206a24d3-47aa-4a1c-a432-63d0ab2e9c88 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:20.868058 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-206a24d3-47aa-4a1c-a432-63d0ab2e9c88 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:20.868481 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-206a24d3-47aa-4a1c-a432-63d0ab2e9c88 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:21.008887 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-206a24d3-47aa-4a1c-a432-63d0ab2e9c88 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:21.018152 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-206a24d3-47aa-4a1c-a432-63d0ab2e9c88 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1722 microversion: 2.1 time: 0.165051 Oct 23 02:16:21.018751 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3866/7639] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:20 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:22.042801 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-89909635-b13c-4973-a7f1-3e5db3e58342 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:22.043446 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-89909635-b13c-4973-a7f1-3e5db3e58342 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:22.049960 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-89909635-b13c-4973-a7f1-3e5db3e58342 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:22.050493 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-89909635-b13c-4973-a7f1-3e5db3e58342 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:22.050943 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-89909635-b13c-4973-a7f1-3e5db3e58342 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:22.051654 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-89909635-b13c-4973-a7f1-3e5db3e58342 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:22.052125 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-89909635-b13c-4973-a7f1-3e5db3e58342 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:22.052582 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-89909635-b13c-4973-a7f1-3e5db3e58342 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:22.186167 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-89909635-b13c-4973-a7f1-3e5db3e58342 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:22.195378 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-89909635-b13c-4973-a7f1-3e5db3e58342 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1722 microversion: 2.1 time: 0.156565 Oct 23 02:16:22.195960 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3774/7640] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:22 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:16:23.219050 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ba42daf2-a036-45f9-af08-5fbbd48800dc tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:23.225880 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ba42daf2-a036-45f9-af08-5fbbd48800dc tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:23.234904 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba42daf2-a036-45f9-af08-5fbbd48800dc tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:23.235394 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba42daf2-a036-45f9-af08-5fbbd48800dc tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:23.235832 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba42daf2-a036-45f9-af08-5fbbd48800dc tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:23.236532 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba42daf2-a036-45f9-af08-5fbbd48800dc tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:23.237035 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba42daf2-a036-45f9-af08-5fbbd48800dc tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:23.237575 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba42daf2-a036-45f9-af08-5fbbd48800dc tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:23.384680 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ba42daf2-a036-45f9-af08-5fbbd48800dc tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:23.398838 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ba42daf2-a036-45f9-af08-5fbbd48800dc tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1722 microversion: 2.1 time: 0.183860 Oct 23 02:16:23.400585 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3867/7641] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:23 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:23.498572 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-95839f0a-3341-4919-ae18-6e43079fcd2f req-8a2c9bf8-e6e5-4a7c-9bb4-6e2a1fc40223 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fe588ab-961a-40e1-ac9f-180b9d892041", "name": "network-vif-unplugged", "status": "completed", "tag": "024cb3c7-efb2-4442-a9a7-773209aa680b"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:16:23.509493 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-95839f0a-3341-4919-ae18-6e43079fcd2f req-8a2c9bf8-e6e5-4a7c-9bb4-6e2a1fc40223 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:23.510013 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-95839f0a-3341-4919-ae18-6e43079fcd2f req-8a2c9bf8-e6e5-4a7c-9bb4-6e2a1fc40223 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:23.510557 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-95839f0a-3341-4919-ae18-6e43079fcd2f req-8a2c9bf8-e6e5-4a7c-9bb4-6e2a1fc40223 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:23.523983 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-95839f0a-3341-4919-ae18-6e43079fcd2f req-8a2c9bf8-e6e5-4a7c-9bb4-6e2a1fc40223 service nova] Creating event network-vif-unplugged:024cb3c7-efb2-4442-a9a7-773209aa680b for instance 8fe588ab-961a-40e1-ac9f-180b9d892041 on n-h2-master-1 Oct 23 02:16:23.530148 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [req-95839f0a-3341-4919-ae18-6e43079fcd2f req-8a2c9bf8-e6e5-4a7c-9bb4-6e2a1fc40223 service nova] Instance 8fe588ab-961a-40e1-ac9f-180b9d892041 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120945) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 23 02:16:23.542036 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-95839f0a-3341-4919-ae18-6e43079fcd2f req-8a2c9bf8-e6e5-4a7c-9bb4-6e2a1fc40223 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051389 Oct 23 02:16:23.542799 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3775/7642] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:16:24.424881 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ecd984d7-1cd6-41f3-9677-75fe6209f80f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:24.425501 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ecd984d7-1cd6-41f3-9677-75fe6209f80f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:24.432319 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ecd984d7-1cd6-41f3-9677-75fe6209f80f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:24.432806 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ecd984d7-1cd6-41f3-9677-75fe6209f80f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:24.433244 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ecd984d7-1cd6-41f3-9677-75fe6209f80f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:24.434449 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ecd984d7-1cd6-41f3-9677-75fe6209f80f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:24.435047 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ecd984d7-1cd6-41f3-9677-75fe6209f80f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:24.435312 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ecd984d7-1cd6-41f3-9677-75fe6209f80f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:24.568795 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ecd984d7-1cd6-41f3-9677-75fe6209f80f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:24.577781 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ecd984d7-1cd6-41f3-9677-75fe6209f80f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1722 microversion: 2.1 time: 0.156939 Oct 23 02:16:24.579161 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3868/7643] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:24 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:24.594772 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-b0d3134b-277b-4f83-9c99-30e0a9b33a29 req-5cbfcc9d-a3e4-4ba9-bd3a-cbadfc744327 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fe588ab-961a-40e1-ac9f-180b9d892041", "tag": "024cb3c7-efb2-4442-a9a7-773209aa680b"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:16:24.605116 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-b0d3134b-277b-4f83-9c99-30e0a9b33a29 req-5cbfcc9d-a3e4-4ba9-bd3a-cbadfc744327 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:24.605604 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-b0d3134b-277b-4f83-9c99-30e0a9b33a29 req-5cbfcc9d-a3e4-4ba9-bd3a-cbadfc744327 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:24.606100 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-b0d3134b-277b-4f83-9c99-30e0a9b33a29 req-5cbfcc9d-a3e4-4ba9-bd3a-cbadfc744327 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:24.617567 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-b0d3134b-277b-4f83-9c99-30e0a9b33a29 req-5cbfcc9d-a3e4-4ba9-bd3a-cbadfc744327 service nova] Creating event network-changed:024cb3c7-efb2-4442-a9a7-773209aa680b for instance 8fe588ab-961a-40e1-ac9f-180b9d892041 on n-h2-master-1 Oct 23 02:16:24.623805 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [req-b0d3134b-277b-4f83-9c99-30e0a9b33a29 req-5cbfcc9d-a3e4-4ba9-bd3a-cbadfc744327 service nova] Instance 8fe588ab-961a-40e1-ac9f-180b9d892041 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120945) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 23 02:16:24.634503 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-b0d3134b-277b-4f83-9c99-30e0a9b33a29 req-5cbfcc9d-a3e4-4ba9-bd3a-cbadfc744327 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044303 Oct 23 02:16:24.635108 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3776/7644] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:16:25.601907 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c030defa-74bc-4f70-844f-b91f513a7b64 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:25.602584 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c030defa-74bc-4f70-844f-b91f513a7b64 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:25.609540 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c030defa-74bc-4f70-844f-b91f513a7b64 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:25.610062 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c030defa-74bc-4f70-844f-b91f513a7b64 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:25.610507 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c030defa-74bc-4f70-844f-b91f513a7b64 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:25.611201 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c030defa-74bc-4f70-844f-b91f513a7b64 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:25.611661 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c030defa-74bc-4f70-844f-b91f513a7b64 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:25.612091 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c030defa-74bc-4f70-844f-b91f513a7b64 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:25.752574 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c030defa-74bc-4f70-844f-b91f513a7b64 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:25.762843 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c030defa-74bc-4f70-844f-b91f513a7b64 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1722 microversion: 2.1 time: 0.164809 Oct 23 02:16:25.778843 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3869/7645] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:25 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:26.789647 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8b48164f-8b2b-4d28-8003-d7921ec64872 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:26.790345 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8b48164f-8b2b-4d28-8003-d7921ec64872 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:26.796637 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b48164f-8b2b-4d28-8003-d7921ec64872 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:26.797211 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b48164f-8b2b-4d28-8003-d7921ec64872 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:26.797687 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b48164f-8b2b-4d28-8003-d7921ec64872 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:26.798421 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b48164f-8b2b-4d28-8003-d7921ec64872 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:26.798891 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b48164f-8b2b-4d28-8003-d7921ec64872 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:26.799335 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b48164f-8b2b-4d28-8003-d7921ec64872 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:26.934520 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8b48164f-8b2b-4d28-8003-d7921ec64872 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:26.942990 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8b48164f-8b2b-4d28-8003-d7921ec64872 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1722 microversion: 2.1 time: 0.158601 Oct 23 02:16:26.943606 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3777/7646] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:26 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:27.967933 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7d140128-51d2-4e55-8a63-62967449a6f7 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:27.968550 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7d140128-51d2-4e55-8a63-62967449a6f7 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:27.975491 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d140128-51d2-4e55-8a63-62967449a6f7 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:27.975980 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d140128-51d2-4e55-8a63-62967449a6f7 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:27.976414 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d140128-51d2-4e55-8a63-62967449a6f7 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:27.977099 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d140128-51d2-4e55-8a63-62967449a6f7 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:27.977553 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d140128-51d2-4e55-8a63-62967449a6f7 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:27.978030 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d140128-51d2-4e55-8a63-62967449a6f7 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:28.112290 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7d140128-51d2-4e55-8a63-62967449a6f7 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:28.120734 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7d140128-51d2-4e55-8a63-62967449a6f7 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1722 microversion: 2.1 time: 0.157045 Oct 23 02:16:28.121998 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3870/7647] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:27 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:29.144859 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-76addc2f-f3d6-4a71-941b-40556a7cc843 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:29.145622 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-76addc2f-f3d6-4a71-941b-40556a7cc843 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:29.147640 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=3 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:29.153961 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-76addc2f-f3d6-4a71-941b-40556a7cc843 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:29.154494 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-76addc2f-f3d6-4a71-941b-40556a7cc843 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:29.154971 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-76addc2f-f3d6-4a71-941b-40556a7cc843 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:29.155697 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-76addc2f-f3d6-4a71-941b-40556a7cc843 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:29.156168 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-76addc2f-f3d6-4a71-941b-40556a7cc843 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:29.156609 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-76addc2f-f3d6-4a71-941b-40556a7cc843 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:29.288839 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-76addc2f-f3d6-4a71-941b-40556a7cc843 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:29.297342 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-76addc2f-f3d6-4a71-941b-40556a7cc843 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1722 microversion: 2.1 time: 0.156425 Oct 23 02:16:29.298032 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3778/7648] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:29 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:30.320745 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c91f8592-4b31-4c80-a331-33ac7c9c7697 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:30.321397 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c91f8592-4b31-4c80-a331-33ac7c9c7697 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:30.328197 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c91f8592-4b31-4c80-a331-33ac7c9c7697 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:30.328717 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c91f8592-4b31-4c80-a331-33ac7c9c7697 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:30.329171 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c91f8592-4b31-4c80-a331-33ac7c9c7697 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:30.329863 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c91f8592-4b31-4c80-a331-33ac7c9c7697 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:30.330366 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c91f8592-4b31-4c80-a331-33ac7c9c7697 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:30.333756 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c91f8592-4b31-4c80-a331-33ac7c9c7697 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:30.462696 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c91f8592-4b31-4c80-a331-33ac7c9c7697 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:30.471880 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c91f8592-4b31-4c80-a331-33ac7c9c7697 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1722 microversion: 2.1 time: 0.155052 Oct 23 02:16:30.472469 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3871/7649] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:30 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:31.496917 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6f476968-9cff-45b0-b390-71cfe48e67c4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:31.497579 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6f476968-9cff-45b0-b390-71cfe48e67c4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:31.504490 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6f476968-9cff-45b0-b390-71cfe48e67c4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:31.505027 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6f476968-9cff-45b0-b390-71cfe48e67c4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:31.505481 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6f476968-9cff-45b0-b390-71cfe48e67c4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:31.506227 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6f476968-9cff-45b0-b390-71cfe48e67c4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:31.506700 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6f476968-9cff-45b0-b390-71cfe48e67c4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:31.507142 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6f476968-9cff-45b0-b390-71cfe48e67c4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:31.637085 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6f476968-9cff-45b0-b390-71cfe48e67c4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:31.645291 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6f476968-9cff-45b0-b390-71cfe48e67c4 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1722 microversion: 2.1 time: 0.152815 Oct 23 02:16:31.645876 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3779/7650] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:31 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:32.668326 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-187166f7-efb8-44fc-8078-9fe78797b972 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:32.668952 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-187166f7-efb8-44fc-8078-9fe78797b972 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:32.675831 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-187166f7-efb8-44fc-8078-9fe78797b972 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:32.676324 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-187166f7-efb8-44fc-8078-9fe78797b972 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:32.676769 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-187166f7-efb8-44fc-8078-9fe78797b972 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:32.677466 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-187166f7-efb8-44fc-8078-9fe78797b972 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:32.677932 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-187166f7-efb8-44fc-8078-9fe78797b972 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:32.678395 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-187166f7-efb8-44fc-8078-9fe78797b972 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:32.807363 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-187166f7-efb8-44fc-8078-9fe78797b972 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:32.816235 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-187166f7-efb8-44fc-8078-9fe78797b972 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1722 microversion: 2.1 time: 0.151848 Oct 23 02:16:32.816811 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3872/7651] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:32 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:33.841310 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2a49af0e-8e39-4326-ac03-326432b3ed7d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:33.841862 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2a49af0e-8e39-4326-ac03-326432b3ed7d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:33.848743 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2a49af0e-8e39-4326-ac03-326432b3ed7d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:33.849221 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2a49af0e-8e39-4326-ac03-326432b3ed7d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:33.849670 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2a49af0e-8e39-4326-ac03-326432b3ed7d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:33.850402 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2a49af0e-8e39-4326-ac03-326432b3ed7d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:33.850868 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2a49af0e-8e39-4326-ac03-326432b3ed7d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:33.851303 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2a49af0e-8e39-4326-ac03-326432b3ed7d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:33.981098 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2a49af0e-8e39-4326-ac03-326432b3ed7d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:33.989228 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2a49af0e-8e39-4326-ac03-326432b3ed7d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1722 microversion: 2.1 time: 0.152893 Oct 23 02:16:33.989805 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3780/7652] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:33 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:35.012440 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-85205608-f412-4750-bafb-0812811182ae tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:35.013064 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-85205608-f412-4750-bafb-0812811182ae tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:35.020049 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-85205608-f412-4750-bafb-0812811182ae tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:35.020536 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-85205608-f412-4750-bafb-0812811182ae tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:35.020975 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-85205608-f412-4750-bafb-0812811182ae tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:35.021666 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-85205608-f412-4750-bafb-0812811182ae tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:35.022153 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-85205608-f412-4750-bafb-0812811182ae tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:35.022587 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-85205608-f412-4750-bafb-0812811182ae tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:35.148259 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-85205608-f412-4750-bafb-0812811182ae tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:35.156969 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-85205608-f412-4750-bafb-0812811182ae tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1722 microversion: 2.1 time: 0.148463 Oct 23 02:16:35.157547 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3873/7653] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:35 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:36.180050 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-84f0709c-a075-4c7c-be86-10b2c981f583 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:36.180673 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-84f0709c-a075-4c7c-be86-10b2c981f583 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:36.188144 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-84f0709c-a075-4c7c-be86-10b2c981f583 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:36.188638 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-84f0709c-a075-4c7c-be86-10b2c981f583 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:36.189077 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-84f0709c-a075-4c7c-be86-10b2c981f583 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:36.189775 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-84f0709c-a075-4c7c-be86-10b2c981f583 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:36.190271 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-84f0709c-a075-4c7c-be86-10b2c981f583 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:36.190705 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-84f0709c-a075-4c7c-be86-10b2c981f583 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:36.205385 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:36.322295 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-84f0709c-a075-4c7c-be86-10b2c981f583 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:36.331050 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-84f0709c-a075-4c7c-be86-10b2c981f583 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1722 microversion: 2.1 time: 0.154912 Oct 23 02:16:36.331626 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3781/7654] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:36 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:37.355791 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c2996331-ddd8-4af3-8351-1ff985247b7f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:37.356411 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c2996331-ddd8-4af3-8351-1ff985247b7f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:37.363511 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2996331-ddd8-4af3-8351-1ff985247b7f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:37.364010 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2996331-ddd8-4af3-8351-1ff985247b7f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:37.364484 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2996331-ddd8-4af3-8351-1ff985247b7f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:37.365216 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2996331-ddd8-4af3-8351-1ff985247b7f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:37.365682 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2996331-ddd8-4af3-8351-1ff985247b7f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:37.366158 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2996331-ddd8-4af3-8351-1ff985247b7f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:37.496125 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c2996331-ddd8-4af3-8351-1ff985247b7f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:37.504337 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c2996331-ddd8-4af3-8351-1ff985247b7f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1722 microversion: 2.1 time: 0.153034 Oct 23 02:16:37.504926 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3874/7655] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:37 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:38.528746 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f0e5e73e-cf1a-486e-b6cb-d17ba4e71091 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:38.529378 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f0e5e73e-cf1a-486e-b6cb-d17ba4e71091 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:38.536893 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f0e5e73e-cf1a-486e-b6cb-d17ba4e71091 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:38.537384 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f0e5e73e-cf1a-486e-b6cb-d17ba4e71091 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:38.537827 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f0e5e73e-cf1a-486e-b6cb-d17ba4e71091 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:38.538557 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f0e5e73e-cf1a-486e-b6cb-d17ba4e71091 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:38.539028 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f0e5e73e-cf1a-486e-b6cb-d17ba4e71091 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:38.539455 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f0e5e73e-cf1a-486e-b6cb-d17ba4e71091 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:38.669216 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f0e5e73e-cf1a-486e-b6cb-d17ba4e71091 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:38.677403 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f0e5e73e-cf1a-486e-b6cb-d17ba4e71091 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1715 microversion: 2.1 time: 0.153002 Oct 23 02:16:38.677997 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3782/7656] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:38 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1715 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:38.700156 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6667e556-6432-45d0-b810-20f07f79af19 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:38.700768 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6667e556-6432-45d0-b810-20f07f79af19 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:38.707693 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6667e556-6432-45d0-b810-20f07f79af19 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:38.708179 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6667e556-6432-45d0-b810-20f07f79af19 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:38.708615 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6667e556-6432-45d0-b810-20f07f79af19 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:38.710668 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6667e556-6432-45d0-b810-20f07f79af19 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:38.710668 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6667e556-6432-45d0-b810-20f07f79af19 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:38.710668 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6667e556-6432-45d0-b810-20f07f79af19 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:39.100271 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6667e556-6432-45d0-b810-20f07f79af19 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:39.108947 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6667e556-6432-45d0-b810-20f07f79af19 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1715 microversion: 2.1 time: 0.412627 Oct 23 02:16:39.109519 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3875/7657] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:38 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1715 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:39.131834 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-71d131b6-e7ba-4966-a5ce-14094a5ad5e2 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:39.132478 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-71d131b6-e7ba-4966-a5ce-14094a5ad5e2 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:39.134330 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:39.139009 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-71d131b6-e7ba-4966-a5ce-14094a5ad5e2 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:39.139495 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-71d131b6-e7ba-4966-a5ce-14094a5ad5e2 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:39.139936 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-71d131b6-e7ba-4966-a5ce-14094a5ad5e2 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:39.140624 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-71d131b6-e7ba-4966-a5ce-14094a5ad5e2 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:39.141081 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-71d131b6-e7ba-4966-a5ce-14094a5ad5e2 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:39.141509 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-71d131b6-e7ba-4966-a5ce-14094a5ad5e2 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:39.272110 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-71d131b6-e7ba-4966-a5ce-14094a5ad5e2 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:39.280310 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-71d131b6-e7ba-4966-a5ce-14094a5ad5e2 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1715 microversion: 2.1 time: 0.152279 Oct 23 02:16:39.280877 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3783/7658] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:39 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1715 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:39.302808 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ce042dbf-c2a6-488d-931d-d12974b6eae3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:39.303305 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ce042dbf-c2a6-488d-931d-d12974b6eae3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:39.309766 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce042dbf-c2a6-488d-931d-d12974b6eae3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:39.310277 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce042dbf-c2a6-488d-931d-d12974b6eae3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:39.310713 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce042dbf-c2a6-488d-931d-d12974b6eae3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:39.311394 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce042dbf-c2a6-488d-931d-d12974b6eae3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:39.311844 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce042dbf-c2a6-488d-931d-d12974b6eae3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:39.312267 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ce042dbf-c2a6-488d-931d-d12974b6eae3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:39.336095 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ce042dbf-c2a6-488d-931d-d12974b6eae3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 02:16:39.443323 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:39.606256 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ce042dbf-c2a6-488d-931d-d12974b6eae3 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 204 len: 0 microversion: 2.1 time: 0.306281 Oct 23 02:16:39.606982 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3876/7659] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 02:16:39 2022] DELETE /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 02:16:39.616484 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0b6bc274-281b-4559-b2fa-d5ce513bc5dc tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:39.617104 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0b6bc274-281b-4559-b2fa-d5ce513bc5dc tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:39.624217 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b6bc274-281b-4559-b2fa-d5ce513bc5dc tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:39.624740 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b6bc274-281b-4559-b2fa-d5ce513bc5dc tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:39.625323 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b6bc274-281b-4559-b2fa-d5ce513bc5dc tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:39.626092 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b6bc274-281b-4559-b2fa-d5ce513bc5dc tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:39.626569 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b6bc274-281b-4559-b2fa-d5ce513bc5dc tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:39.626986 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b6bc274-281b-4559-b2fa-d5ce513bc5dc tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:39.759785 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0b6bc274-281b-4559-b2fa-d5ce513bc5dc tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:39.770180 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0b6bc274-281b-4559-b2fa-d5ce513bc5dc tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1721 microversion: 2.1 time: 0.158656 Oct 23 02:16:39.773004 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3784/7660] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:39 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:39.789081 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-4cf6edb2-e510-4830-8903-6779ea92c800 req-d2d1d6a4-589c-4a34-97ed-062e619d332e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fe588ab-961a-40e1-ac9f-180b9d892041", "name": "network-vif-plugged", "status": "completed", "tag": "024cb3c7-efb2-4442-a9a7-773209aa680b"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:16:39.794941 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:39.800826 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-4cf6edb2-e510-4830-8903-6779ea92c800 req-d2d1d6a4-589c-4a34-97ed-062e619d332e service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:39.801315 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-4cf6edb2-e510-4830-8903-6779ea92c800 req-d2d1d6a4-589c-4a34-97ed-062e619d332e service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:39.801753 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-4cf6edb2-e510-4830-8903-6779ea92c800 req-d2d1d6a4-589c-4a34-97ed-062e619d332e service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:39.812008 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-4cf6edb2-e510-4830-8903-6779ea92c800 req-d2d1d6a4-589c-4a34-97ed-062e619d332e service nova] Creating event network-vif-plugged:024cb3c7-efb2-4442-a9a7-773209aa680b for instance 8fe588ab-961a-40e1-ac9f-180b9d892041 on n-h2-master-1 Oct 23 02:16:39.816834 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-4cf6edb2-e510-4830-8903-6779ea92c800 req-d2d1d6a4-589c-4a34-97ed-062e619d332e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032149 Oct 23 02:16:39.817429 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3877/7661] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:16:40.795191 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4eab593c-538b-4d2b-ae73-28a41a2b8e7b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:40.795775 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4eab593c-538b-4d2b-ae73-28a41a2b8e7b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:40.802584 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4eab593c-538b-4d2b-ae73-28a41a2b8e7b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:40.803082 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4eab593c-538b-4d2b-ae73-28a41a2b8e7b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:40.803531 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4eab593c-538b-4d2b-ae73-28a41a2b8e7b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:40.804232 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4eab593c-538b-4d2b-ae73-28a41a2b8e7b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:40.804700 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4eab593c-538b-4d2b-ae73-28a41a2b8e7b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:40.805138 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4eab593c-538b-4d2b-ae73-28a41a2b8e7b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:40.930923 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4eab593c-538b-4d2b-ae73-28a41a2b8e7b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:40.939204 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4eab593c-538b-4d2b-ae73-28a41a2b8e7b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1721 microversion: 2.1 time: 0.148494 Oct 23 02:16:40.939781 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3785/7662] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:40 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:41.964313 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-22dffa3e-ef3f-4d72-afc7-5d3089a75e71 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:41.965008 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-22dffa3e-ef3f-4d72-afc7-5d3089a75e71 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:41.972281 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-22dffa3e-ef3f-4d72-afc7-5d3089a75e71 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:41.972769 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-22dffa3e-ef3f-4d72-afc7-5d3089a75e71 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:41.973205 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-22dffa3e-ef3f-4d72-afc7-5d3089a75e71 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:41.973897 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-22dffa3e-ef3f-4d72-afc7-5d3089a75e71 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:41.974382 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-22dffa3e-ef3f-4d72-afc7-5d3089a75e71 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:41.974855 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-22dffa3e-ef3f-4d72-afc7-5d3089a75e71 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:42.110348 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-22dffa3e-ef3f-4d72-afc7-5d3089a75e71 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:42.119246 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-22dffa3e-ef3f-4d72-afc7-5d3089a75e71 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1721 microversion: 2.1 time: 0.160099 Oct 23 02:16:42.119833 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3878/7663] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:41 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:42.561638 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-12d572ee-f262-4526-870d-72112fe41146 req-648f6b87-e970-4eda-9bf2-b9a36882cef6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fe588ab-961a-40e1-ac9f-180b9d892041", "name": "network-vif-deleted", "tag": "024cb3c7-efb2-4442-a9a7-773209aa680b"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:16:42.572339 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-12d572ee-f262-4526-870d-72112fe41146 req-648f6b87-e970-4eda-9bf2-b9a36882cef6 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:42.572834 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-12d572ee-f262-4526-870d-72112fe41146 req-648f6b87-e970-4eda-9bf2-b9a36882cef6 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:42.573296 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-12d572ee-f262-4526-870d-72112fe41146 req-648f6b87-e970-4eda-9bf2-b9a36882cef6 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:42.585266 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-12d572ee-f262-4526-870d-72112fe41146 req-648f6b87-e970-4eda-9bf2-b9a36882cef6 service nova] Creating event network-vif-deleted:024cb3c7-efb2-4442-a9a7-773209aa680b for instance 8fe588ab-961a-40e1-ac9f-180b9d892041 on n-h2-master-1 Oct 23 02:16:42.591071 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-12d572ee-f262-4526-870d-72112fe41146 req-648f6b87-e970-4eda-9bf2-b9a36882cef6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032550 Oct 23 02:16:42.591832 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3786/7664] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:16:43.144660 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f2d724ca-6e56-41b9-8358-846cfc2351a1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:43.145395 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f2d724ca-6e56-41b9-8358-846cfc2351a1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:43.153613 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2d724ca-6e56-41b9-8358-846cfc2351a1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:43.154159 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2d724ca-6e56-41b9-8358-846cfc2351a1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:43.155185 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2d724ca-6e56-41b9-8358-846cfc2351a1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:43.155898 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2d724ca-6e56-41b9-8358-846cfc2351a1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:43.156958 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2d724ca-6e56-41b9-8358-846cfc2351a1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:43.157395 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f2d724ca-6e56-41b9-8358-846cfc2351a1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:43.222099 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f2d724ca-6e56-41b9-8358-846cfc2351a1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:43.231043 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f2d724ca-6e56-41b9-8358-846cfc2351a1 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1368 microversion: 2.1 time: 0.090750 Oct 23 02:16:43.231633 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3879/7665] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:43 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:44.258243 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-dc3f9a3b-c656-4100-952c-b758acc7b219 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:44.258986 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-dc3f9a3b-c656-4100-952c-b758acc7b219 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:44.265735 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dc3f9a3b-c656-4100-952c-b758acc7b219 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:44.266383 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dc3f9a3b-c656-4100-952c-b758acc7b219 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:44.266840 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dc3f9a3b-c656-4100-952c-b758acc7b219 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:44.267544 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dc3f9a3b-c656-4100-952c-b758acc7b219 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:44.268015 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dc3f9a3b-c656-4100-952c-b758acc7b219 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:44.268453 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dc3f9a3b-c656-4100-952c-b758acc7b219 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:44.331431 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-dc3f9a3b-c656-4100-952c-b758acc7b219 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:44.340935 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-dc3f9a3b-c656-4100-952c-b758acc7b219 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1368 microversion: 2.1 time: 0.087173 Oct 23 02:16:44.341559 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3787/7666] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:44 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:45.364173 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2a193e83-631a-4cb5-8f54-ab0eed82839d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:45.364788 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2a193e83-631a-4cb5-8f54-ab0eed82839d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:45.372363 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a193e83-631a-4cb5-8f54-ab0eed82839d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:45.372842 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a193e83-631a-4cb5-8f54-ab0eed82839d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:45.373293 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a193e83-631a-4cb5-8f54-ab0eed82839d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:45.373955 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a193e83-631a-4cb5-8f54-ab0eed82839d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:45.374426 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a193e83-631a-4cb5-8f54-ab0eed82839d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:45.374847 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2a193e83-631a-4cb5-8f54-ab0eed82839d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:45.435997 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2a193e83-631a-4cb5-8f54-ab0eed82839d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:45.444336 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2a193e83-631a-4cb5-8f54-ab0eed82839d tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1368 microversion: 2.1 time: 0.083986 Oct 23 02:16:45.444902 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3880/7667] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:45 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:46.469492 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-17590ef3-672c-438b-b52c-8d19ce3b2752 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:46.470222 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-17590ef3-672c-438b-b52c-8d19ce3b2752 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:46.477149 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-17590ef3-672c-438b-b52c-8d19ce3b2752 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:46.477654 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-17590ef3-672c-438b-b52c-8d19ce3b2752 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:46.478140 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-17590ef3-672c-438b-b52c-8d19ce3b2752 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:46.478861 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-17590ef3-672c-438b-b52c-8d19ce3b2752 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:46.479336 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-17590ef3-672c-438b-b52c-8d19ce3b2752 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:46.479784 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-17590ef3-672c-438b-b52c-8d19ce3b2752 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:46.545144 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-17590ef3-672c-438b-b52c-8d19ce3b2752 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:46.553634 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-17590ef3-672c-438b-b52c-8d19ce3b2752 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1368 microversion: 2.1 time: 0.088935 Oct 23 02:16:46.554253 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3788/7668] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:46 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:47.576528 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-951b68a1-c580-4ba1-b057-0fa6d72b9927 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:47.587185 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-951b68a1-c580-4ba1-b057-0fa6d72b9927 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:47.587185 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-951b68a1-c580-4ba1-b057-0fa6d72b9927 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:47.587185 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-951b68a1-c580-4ba1-b057-0fa6d72b9927 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:47.587185 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-951b68a1-c580-4ba1-b057-0fa6d72b9927 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:47.587185 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-951b68a1-c580-4ba1-b057-0fa6d72b9927 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:47.587185 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-951b68a1-c580-4ba1-b057-0fa6d72b9927 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:47.587185 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-951b68a1-c580-4ba1-b057-0fa6d72b9927 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:47.620708 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-951b68a1-c580-4ba1-b057-0fa6d72b9927 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:47.621178 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-951b68a1-c580-4ba1-b057-0fa6d72b9927 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:47.621623 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-951b68a1-c580-4ba1-b057-0fa6d72b9927 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:47.622096 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-951b68a1-c580-4ba1-b057-0fa6d72b9927 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lazy-loading 'fault' on Instance uuid 8fe588ab-961a-40e1-ac9f-180b9d892041 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:16:47.663837 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-951b68a1-c580-4ba1-b057-0fa6d72b9927 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11ce8077ca4566ba823eac0882c34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ca20e778cf488baea3d1e0505cd492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:47.672727 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-951b68a1-c580-4ba1-b057-0fa6d72b9927 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 200 len: 1373 microversion: 2.1 time: 0.100111 Oct 23 02:16:47.679132 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3881/7669] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:47 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 1373 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:48.696213 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d8e81755-cbb9-4fa1-b512-fbdb1cbdbf77 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:48.696791 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d8e81755-cbb9-4fa1-b512-fbdb1cbdbf77 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:48.704321 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d8e81755-cbb9-4fa1-b512-fbdb1cbdbf77 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:48.704823 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d8e81755-cbb9-4fa1-b512-fbdb1cbdbf77 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:48.705268 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d8e81755-cbb9-4fa1-b512-fbdb1cbdbf77 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:48.705962 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d8e81755-cbb9-4fa1-b512-fbdb1cbdbf77 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:48.706449 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d8e81755-cbb9-4fa1-b512-fbdb1cbdbf77 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:48.706883 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d8e81755-cbb9-4fa1-b512-fbdb1cbdbf77 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:48.720251 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-d8e81755-cbb9-4fa1-b512-fbdb1cbdbf77 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] HTTP exception thrown: Instance 8fe588ab-961a-40e1-ac9f-180b9d892041 could not be found. Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d8e81755-cbb9-4fa1-b512-fbdb1cbdbf77 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Request method failure captured: Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 HTTP/1.1 Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVKKL3Yj8jOjD4nOjvPlV-Y9scyqq13fojDyVX3OBbve73h4rlqC2R6Nmg1gkZUj_81md5ukYTWK0OLLvV2V5x7EROs1jhxmCCEm-g9iyFEqoOdE1VQeo6XR_54_6ol8SgxaBnJdqCRkZgpHF9-UuD1N8MWY5NbSWQIdQH83g6nBVV_w Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 03ca20e778cf488baea3d1e0505cd492 Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServerActionsTestJSON-1383606630 Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/03ca20e778cf488baea3d1e0505cd492"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_03ca20e778cf488baea3d1e0505cd492"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/03ca20e778cf488baea3d1e0505cd492"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/03ca20e778cf488baea3d1e0505cd492"}]}] Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServerActionsTestJSON-1383606630 Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 03ca20e778cf488baea3d1e0505cd492 Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServerActionsTestJSON-1383606630 Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServerActionsTestJSON-1383606630-project Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 8d11ce8077ca4566ba823eac0882c34f Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServerActionsTestJSON-1383606630-project Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 8fe588ab-961a-40e1-ac9f-180b9d892041 could not be found. Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '8fe588ab-961a-40e1-ac9f-180b9d892041'} Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fe588ab-961a-40e1-ac9f-180b9d892041 could not be found. Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fe588ab-961a-40e1-ac9f-180b9d892041 could not be found. Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:16:48.721893 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:16:48.727419 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:16:48.727419 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:16:48.727419 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:16:48.727419 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:16:48.727419 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:16:48.727419 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fe588ab-961a-40e1-ac9f-180b9d892041 could not be found. Oct 23 02:16:48.727419 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:16:48.727419 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d8e81755-cbb9-4fa1-b512-fbdb1cbdbf77 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Returning 404 to user: Instance 8fe588ab-961a-40e1-ac9f-180b9d892041 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:16:48.727419 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d8e81755-cbb9-4fa1-b512-fbdb1cbdbf77 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 404 len: 111 microversion: 2.1 time: 0.031152 Oct 23 02:16:48.727419 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3789/7670] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:48 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:16:48.784548 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-90b632dd-16c6-43c7-bdf6-49ce3e6abf0f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:48.786717 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-90b632dd-16c6-43c7-bdf6-49ce3e6abf0f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:48.793920 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-90b632dd-16c6-43c7-bdf6-49ce3e6abf0f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:48.794437 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-90b632dd-16c6-43c7-bdf6-49ce3e6abf0f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:48.794874 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-90b632dd-16c6-43c7-bdf6-49ce3e6abf0f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:48.795564 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-90b632dd-16c6-43c7-bdf6-49ce3e6abf0f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:48.796018 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-90b632dd-16c6-43c7-bdf6-49ce3e6abf0f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:48.796441 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-90b632dd-16c6-43c7-bdf6-49ce3e6abf0f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:48.809511 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-90b632dd-16c6-43c7-bdf6-49ce3e6abf0f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] HTTP exception thrown: Instance 8fe588ab-961a-40e1-ac9f-180b9d892041 could not be found. Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-90b632dd-16c6-43c7-bdf6-49ce3e6abf0f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Request method failure captured: Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041/os-volume_attachments HTTP/1.1 Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVKKL3Yj8jOjD4nOjvPlV-Y9scyqq13fojDyVX3OBbve73h4rlqC2R6Nmg1gkZUj_81md5ukYTWK0OLLvV2V5x7EROs1jhxmCCEm-g9iyFEqoOdE1VQeo6XR_54_6ol8SgxaBnJdqCRkZgpHF9-UuD1N8MWY5NbSWQIdQH83g6nBVV_w Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 03ca20e778cf488baea3d1e0505cd492 Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServerActionsTestJSON-1383606630 Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/03ca20e778cf488baea3d1e0505cd492"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_03ca20e778cf488baea3d1e0505cd492"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/03ca20e778cf488baea3d1e0505cd492"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/03ca20e778cf488baea3d1e0505cd492"}]}] Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServerActionsTestJSON-1383606630 Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 03ca20e778cf488baea3d1e0505cd492 Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServerActionsTestJSON-1383606630 Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServerActionsTestJSON-1383606630-project Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 8d11ce8077ca4566ba823eac0882c34f Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServerActionsTestJSON-1383606630-project Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 8fe588ab-961a-40e1-ac9f-180b9d892041 could not be found. Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: action_args: {'server_id': '8fe588ab-961a-40e1-ac9f-180b9d892041'} Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fe588ab-961a-40e1-ac9f-180b9d892041 could not be found. Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:16:48.811194 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:16:48.815450 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fe588ab-961a-40e1-ac9f-180b9d892041 could not be found. Oct 23 02:16:48.815450 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:16:48.815450 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:16:48.815450 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:16:48.815450 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:16:48.815450 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:16:48.815450 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:16:48.815450 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:16:48.815450 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:16:48.815450 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fe588ab-961a-40e1-ac9f-180b9d892041 could not be found. Oct 23 02:16:48.815450 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:16:48.815450 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-90b632dd-16c6-43c7-bdf6-49ce3e6abf0f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Returning 404 to user: Instance 8fe588ab-961a-40e1-ac9f-180b9d892041 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:16:48.815450 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-90b632dd-16c6-43c7-bdf6-49ce3e6abf0f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032079 Oct 23 02:16:48.815450 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3882/7671] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 02:16:48 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:16:52.306456 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2ef1f907-e57a-4530-8739-2db713a82ff5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:52.306994 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2ef1f907-e57a-4530-8739-2db713a82ff5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:52.313476 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2ef1f907-e57a-4530-8739-2db713a82ff5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:52.313984 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2ef1f907-e57a-4530-8739-2db713a82ff5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:52.314441 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2ef1f907-e57a-4530-8739-2db713a82ff5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:52.315413 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2ef1f907-e57a-4530-8739-2db713a82ff5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:52.315874 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2ef1f907-e57a-4530-8739-2db713a82ff5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:52.316304 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2ef1f907-e57a-4530-8739-2db713a82ff5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:52.329780 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-2ef1f907-e57a-4530-8739-2db713a82ff5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] HTTP exception thrown: Instance 8fe588ab-961a-40e1-ac9f-180b9d892041 could not be found. Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2ef1f907-e57a-4530-8739-2db713a82ff5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Request method failure captured: Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 HTTP/1.1 Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVKKL3Yj8jOjD4nOjvPlV-Y9scyqq13fojDyVX3OBbve73h4rlqC2R6Nmg1gkZUj_81md5ukYTWK0OLLvV2V5x7EROs1jhxmCCEm-g9iyFEqoOdE1VQeo6XR_54_6ol8SgxaBnJdqCRkZgpHF9-UuD1N8MWY5NbSWQIdQH83g6nBVV_w Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 03ca20e778cf488baea3d1e0505cd492 Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServerActionsTestJSON-1383606630 Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/03ca20e778cf488baea3d1e0505cd492"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_03ca20e778cf488baea3d1e0505cd492"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/03ca20e778cf488baea3d1e0505cd492"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/03ca20e778cf488baea3d1e0505cd492"}]}] Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServerActionsTestJSON-1383606630 Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 03ca20e778cf488baea3d1e0505cd492 Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServerActionsTestJSON-1383606630 Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServerActionsTestJSON-1383606630-project Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 8d11ce8077ca4566ba823eac0882c34f Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServerActionsTestJSON-1383606630-project Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 8fe588ab-961a-40e1-ac9f-180b9d892041 could not be found. Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '8fe588ab-961a-40e1-ac9f-180b9d892041'} Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fe588ab-961a-40e1-ac9f-180b9d892041 could not be found. Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:16:52.331345 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:16:52.338633 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fe588ab-961a-40e1-ac9f-180b9d892041 could not be found. Oct 23 02:16:52.338633 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:16:52.338633 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:16:52.338633 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:16:52.338633 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:16:52.338633 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:16:52.338633 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:16:52.338633 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:16:52.338633 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:16:52.338633 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fe588ab-961a-40e1-ac9f-180b9d892041 could not be found. Oct 23 02:16:52.338633 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:16:52.338633 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2ef1f907-e57a-4530-8739-2db713a82ff5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Returning 404 to user: Instance 8fe588ab-961a-40e1-ac9f-180b9d892041 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:16:52.338633 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2ef1f907-e57a-4530-8739-2db713a82ff5 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 404 len: 111 microversion: 2.1 time: 0.030355 Oct 23 02:16:52.338633 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3790/7672] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 02:16:52 2022] DELETE /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:16:52.342220 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-057cbb7a-851c-4a25-bcaa-1c3b4e66323a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:52.342930 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-057cbb7a-851c-4a25-bcaa-1c3b4e66323a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 8fe588ab-961a-40e1-ac9f-180b9d892041] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:52.349615 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-057cbb7a-851c-4a25-bcaa-1c3b4e66323a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:52.350145 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-057cbb7a-851c-4a25-bcaa-1c3b4e66323a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:52.350588 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-057cbb7a-851c-4a25-bcaa-1c3b4e66323a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:52.351313 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-057cbb7a-851c-4a25-bcaa-1c3b4e66323a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:52.351774 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-057cbb7a-851c-4a25-bcaa-1c3b4e66323a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:52.352204 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-057cbb7a-851c-4a25-bcaa-1c3b4e66323a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:52.366837 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-057cbb7a-851c-4a25-bcaa-1c3b4e66323a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] HTTP exception thrown: Instance 8fe588ab-961a-40e1-ac9f-180b9d892041 could not be found. Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-057cbb7a-851c-4a25-bcaa-1c3b4e66323a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Request method failure captured: Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 HTTP/1.1 Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVKKL3Yj8jOjD4nOjvPlV-Y9scyqq13fojDyVX3OBbve73h4rlqC2R6Nmg1gkZUj_81md5ukYTWK0OLLvV2V5x7EROs1jhxmCCEm-g9iyFEqoOdE1VQeo6XR_54_6ol8SgxaBnJdqCRkZgpHF9-UuD1N8MWY5NbSWQIdQH83g6nBVV_w Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 03ca20e778cf488baea3d1e0505cd492 Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServerActionsTestJSON-1383606630 Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/03ca20e778cf488baea3d1e0505cd492"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_03ca20e778cf488baea3d1e0505cd492"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/03ca20e778cf488baea3d1e0505cd492"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/03ca20e778cf488baea3d1e0505cd492"}]}] Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServerActionsTestJSON-1383606630 Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 03ca20e778cf488baea3d1e0505cd492 Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServerActionsTestJSON-1383606630 Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServerActionsTestJSON-1383606630-project Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 8d11ce8077ca4566ba823eac0882c34f Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServerActionsTestJSON-1383606630-project Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 8fe588ab-961a-40e1-ac9f-180b9d892041 could not be found. Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '8fe588ab-961a-40e1-ac9f-180b9d892041'} Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fe588ab-961a-40e1-ac9f-180b9d892041 could not be found. Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fe588ab-961a-40e1-ac9f-180b9d892041 could not be found. Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:16:52.368409 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:16:52.372350 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:16:52.372350 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:16:52.372350 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:16:52.372350 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:16:52.372350 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:16:52.372350 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fe588ab-961a-40e1-ac9f-180b9d892041 could not be found. Oct 23 02:16:52.372350 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:16:52.372350 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-057cbb7a-851c-4a25-bcaa-1c3b4e66323a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Returning 404 to user: Instance 8fe588ab-961a-40e1-ac9f-180b9d892041 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:16:52.372350 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-057cbb7a-851c-4a25-bcaa-1c3b4e66323a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041" status: 404 len: 111 microversion: 2.1 time: 0.032423 Oct 23 02:16:52.372350 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3883/7673] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:52 2022] GET /compute/v2.1/servers/8fe588ab-961a-40e1-ac9f-180b9d892041 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:16:52.378529 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-309cd619-f33d-4727-aa4a-8974875009ab tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:52.379044 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-309cd619-f33d-4727-aa4a-8974875009ab tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:52.385002 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-309cd619-f33d-4727-aa4a-8974875009ab tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:52.385495 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-309cd619-f33d-4727-aa4a-8974875009ab tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:52.385945 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-309cd619-f33d-4727-aa4a-8974875009ab tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:52.386717 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-309cd619-f33d-4727-aa4a-8974875009ab tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:52.387220 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-309cd619-f33d-4727-aa4a-8974875009ab tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:52.387657 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-309cd619-f33d-4727-aa4a-8974875009ab tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:52.404249 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-309cd619-f33d-4727-aa4a-8974875009ab tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] HTTP exception thrown: Instance 7828c675-6af7-4c11-83bf-c25978fc7e5e could not be found. Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-309cd619-f33d-4727-aa4a-8974875009ab tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Request method failure captured: Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e HTTP/1.1 Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVKKL3Yj8jOjD4nOjvPlV-Y9scyqq13fojDyVX3OBbve73h4rlqC2R6Nmg1gkZUj_81md5ukYTWK0OLLvV2V5x7EROs1jhxmCCEm-g9iyFEqoOdE1VQeo6XR_54_6ol8SgxaBnJdqCRkZgpHF9-UuD1N8MWY5NbSWQIdQH83g6nBVV_w Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 03ca20e778cf488baea3d1e0505cd492 Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServerActionsTestJSON-1383606630 Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/03ca20e778cf488baea3d1e0505cd492"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_03ca20e778cf488baea3d1e0505cd492"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/03ca20e778cf488baea3d1e0505cd492"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/03ca20e778cf488baea3d1e0505cd492"}]}] Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServerActionsTestJSON-1383606630 Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 03ca20e778cf488baea3d1e0505cd492 Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServerActionsTestJSON-1383606630 Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServerActionsTestJSON-1383606630-project Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 8d11ce8077ca4566ba823eac0882c34f Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServerActionsTestJSON-1383606630-project Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 7828c675-6af7-4c11-83bf-c25978fc7e5e could not be found. Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '7828c675-6af7-4c11-83bf-c25978fc7e5e'} Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7828c675-6af7-4c11-83bf-c25978fc7e5e could not be found. Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:16:52.405811 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:16:52.409815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7828c675-6af7-4c11-83bf-c25978fc7e5e could not be found. Oct 23 02:16:52.409815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:16:52.409815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:16:52.409815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:16:52.409815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:16:52.409815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:16:52.409815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:16:52.409815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:16:52.409815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:16:52.409815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7828c675-6af7-4c11-83bf-c25978fc7e5e could not be found. Oct 23 02:16:52.409815 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:16:52.409815 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-309cd619-f33d-4727-aa4a-8974875009ab tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Returning 404 to user: Instance 7828c675-6af7-4c11-83bf-c25978fc7e5e could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:16:52.409815 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-309cd619-f33d-4727-aa4a-8974875009ab tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e" status: 404 len: 111 microversion: 2.1 time: 0.032588 Oct 23 02:16:52.409815 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3791/7674] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 02:16:52 2022] DELETE /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 02:16:52.415748 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6e832c07-4e71-4433-80aa-175374effc4a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:52.416369 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6e832c07-4e71-4433-80aa-175374effc4a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 7828c675-6af7-4c11-83bf-c25978fc7e5e] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:52.422947 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6e832c07-4e71-4433-80aa-175374effc4a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:52.423430 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6e832c07-4e71-4433-80aa-175374effc4a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:52.423866 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6e832c07-4e71-4433-80aa-175374effc4a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:52.424555 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6e832c07-4e71-4433-80aa-175374effc4a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:52.425016 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6e832c07-4e71-4433-80aa-175374effc4a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:52.425442 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6e832c07-4e71-4433-80aa-175374effc4a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:52.439170 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-6e832c07-4e71-4433-80aa-175374effc4a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] HTTP exception thrown: Instance 7828c675-6af7-4c11-83bf-c25978fc7e5e could not be found. Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6e832c07-4e71-4433-80aa-175374effc4a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Request method failure captured: Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e HTTP/1.1 Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVKKL3Yj8jOjD4nOjvPlV-Y9scyqq13fojDyVX3OBbve73h4rlqC2R6Nmg1gkZUj_81md5ukYTWK0OLLvV2V5x7EROs1jhxmCCEm-g9iyFEqoOdE1VQeo6XR_54_6ol8SgxaBnJdqCRkZgpHF9-UuD1N8MWY5NbSWQIdQH83g6nBVV_w Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 03ca20e778cf488baea3d1e0505cd492 Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServerActionsTestJSON-1383606630 Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/03ca20e778cf488baea3d1e0505cd492"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_03ca20e778cf488baea3d1e0505cd492"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/03ca20e778cf488baea3d1e0505cd492"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/03ca20e778cf488baea3d1e0505cd492"}]}] Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServerActionsTestJSON-1383606630 Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 03ca20e778cf488baea3d1e0505cd492 Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServerActionsTestJSON-1383606630 Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServerActionsTestJSON-1383606630-project Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 8d11ce8077ca4566ba823eac0882c34f Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServerActionsTestJSON-1383606630-project Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 7828c675-6af7-4c11-83bf-c25978fc7e5e could not be found. Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '7828c675-6af7-4c11-83bf-c25978fc7e5e'} Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7828c675-6af7-4c11-83bf-c25978fc7e5e could not be found. Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7828c675-6af7-4c11-83bf-c25978fc7e5e could not be found. Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:16:52.440717 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:16:52.444890 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:16:52.444890 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:16:52.444890 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:16:52.444890 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:16:52.444890 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:16:52.444890 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7828c675-6af7-4c11-83bf-c25978fc7e5e could not be found. Oct 23 02:16:52.444890 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:16:52.444890 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6e832c07-4e71-4433-80aa-175374effc4a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Returning 404 to user: Instance 7828c675-6af7-4c11-83bf-c25978fc7e5e could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:16:52.444890 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6e832c07-4e71-4433-80aa-175374effc4a tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e" status: 404 len: 111 microversion: 2.1 time: 0.031754 Oct 23 02:16:52.444890 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3884/7675] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:52 2022] GET /compute/v2.1/servers/7828c675-6af7-4c11-83bf-c25978fc7e5e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:16:52.453275 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c36d9a3c-e6a7-4d00-a8e6-505036c47e26 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:52.454858 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c36d9a3c-e6a7-4d00-a8e6-505036c47e26 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: e3b4aba9-8dff-4a30-8b42-0ae2f884560f] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:52.460032 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c36d9a3c-e6a7-4d00-a8e6-505036c47e26 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:52.460474 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c36d9a3c-e6a7-4d00-a8e6-505036c47e26 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:52.460920 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c36d9a3c-e6a7-4d00-a8e6-505036c47e26 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:52.461619 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c36d9a3c-e6a7-4d00-a8e6-505036c47e26 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:52.462110 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c36d9a3c-e6a7-4d00-a8e6-505036c47e26 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:52.462546 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c36d9a3c-e6a7-4d00-a8e6-505036c47e26 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:52.477403 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-c36d9a3c-e6a7-4d00-a8e6-505036c47e26 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] HTTP exception thrown: Instance e3b4aba9-8dff-4a30-8b42-0ae2f884560f could not be found. Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c36d9a3c-e6a7-4d00-a8e6-505036c47e26 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Request method failure captured: Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f HTTP/1.1 Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVKKL3Yj8jOjD4nOjvPlV-Y9scyqq13fojDyVX3OBbve73h4rlqC2R6Nmg1gkZUj_81md5ukYTWK0OLLvV2V5x7EROs1jhxmCCEm-g9iyFEqoOdE1VQeo6XR_54_6ol8SgxaBnJdqCRkZgpHF9-UuD1N8MWY5NbSWQIdQH83g6nBVV_w Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 03ca20e778cf488baea3d1e0505cd492 Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServerActionsTestJSON-1383606630 Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/03ca20e778cf488baea3d1e0505cd492"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_03ca20e778cf488baea3d1e0505cd492"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/03ca20e778cf488baea3d1e0505cd492"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/03ca20e778cf488baea3d1e0505cd492"}]}] Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServerActionsTestJSON-1383606630 Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 03ca20e778cf488baea3d1e0505cd492 Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServerActionsTestJSON-1383606630 Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServerActionsTestJSON-1383606630-project Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 8d11ce8077ca4566ba823eac0882c34f Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServerActionsTestJSON-1383606630-project Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: exception: Instance e3b4aba9-8dff-4a30-8b42-0ae2f884560f could not be found. Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'e3b4aba9-8dff-4a30-8b42-0ae2f884560f'} Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3b4aba9-8dff-4a30-8b42-0ae2f884560f could not be found. Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:16:52.479188 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:16:52.483405 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3b4aba9-8dff-4a30-8b42-0ae2f884560f could not be found. Oct 23 02:16:52.483405 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:16:52.483405 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:16:52.483405 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:16:52.483405 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:16:52.483405 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:16:52.483405 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:16:52.483405 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:16:52.483405 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:16:52.483405 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3b4aba9-8dff-4a30-8b42-0ae2f884560f could not be found. Oct 23 02:16:52.483405 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:16:52.483405 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c36d9a3c-e6a7-4d00-a8e6-505036c47e26 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Returning 404 to user: Instance e3b4aba9-8dff-4a30-8b42-0ae2f884560f could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:16:52.483405 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c36d9a3c-e6a7-4d00-a8e6-505036c47e26 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f" status: 404 len: 111 microversion: 2.1 time: 0.031737 Oct 23 02:16:52.483405 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3792/7676] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 02:16:52 2022] DELETE /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:16:52.489869 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3f9ea0c3-45ce-444f-a13a-4fc8c04ac85f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:52.494111 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3f9ea0c3-45ce-444f-a13a-4fc8c04ac85f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: e3b4aba9-8dff-4a30-8b42-0ae2f884560f] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:52.496851 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3f9ea0c3-45ce-444f-a13a-4fc8c04ac85f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:52.497369 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3f9ea0c3-45ce-444f-a13a-4fc8c04ac85f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:52.497814 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3f9ea0c3-45ce-444f-a13a-4fc8c04ac85f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:52.498538 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3f9ea0c3-45ce-444f-a13a-4fc8c04ac85f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:52.499242 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3f9ea0c3-45ce-444f-a13a-4fc8c04ac85f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:52.499674 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3f9ea0c3-45ce-444f-a13a-4fc8c04ac85f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:52.514305 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-3f9ea0c3-45ce-444f-a13a-4fc8c04ac85f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] HTTP exception thrown: Instance e3b4aba9-8dff-4a30-8b42-0ae2f884560f could not be found. Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3f9ea0c3-45ce-444f-a13a-4fc8c04ac85f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Request method failure captured: Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f HTTP/1.1 Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVKKL3Yj8jOjD4nOjvPlV-Y9scyqq13fojDyVX3OBbve73h4rlqC2R6Nmg1gkZUj_81md5ukYTWK0OLLvV2V5x7EROs1jhxmCCEm-g9iyFEqoOdE1VQeo6XR_54_6ol8SgxaBnJdqCRkZgpHF9-UuD1N8MWY5NbSWQIdQH83g6nBVV_w Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 03ca20e778cf488baea3d1e0505cd492 Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServerActionsTestJSON-1383606630 Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/03ca20e778cf488baea3d1e0505cd492"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_03ca20e778cf488baea3d1e0505cd492"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/03ca20e778cf488baea3d1e0505cd492"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/03ca20e778cf488baea3d1e0505cd492"}]}] Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServerActionsTestJSON-1383606630 Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 03ca20e778cf488baea3d1e0505cd492 Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServerActionsTestJSON-1383606630 Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServerActionsTestJSON-1383606630-project Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 8d11ce8077ca4566ba823eac0882c34f Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServerActionsTestJSON-1383606630-project Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: exception: Instance e3b4aba9-8dff-4a30-8b42-0ae2f884560f could not be found. Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'e3b4aba9-8dff-4a30-8b42-0ae2f884560f'} Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3b4aba9-8dff-4a30-8b42-0ae2f884560f could not be found. Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3b4aba9-8dff-4a30-8b42-0ae2f884560f could not be found. Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:16:52.515922 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:16:52.530894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:16:52.530894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:16:52.530894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:16:52.530894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:16:52.530894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:16:52.530894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3b4aba9-8dff-4a30-8b42-0ae2f884560f could not be found. Oct 23 02:16:52.530894 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:16:52.530894 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3f9ea0c3-45ce-444f-a13a-4fc8c04ac85f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Returning 404 to user: Instance e3b4aba9-8dff-4a30-8b42-0ae2f884560f could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:16:52.530894 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3f9ea0c3-45ce-444f-a13a-4fc8c04ac85f tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f" status: 404 len: 111 microversion: 2.1 time: 0.031784 Oct 23 02:16:52.530894 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3885/7677] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:52 2022] GET /compute/v2.1/servers/e3b4aba9-8dff-4a30-8b42-0ae2f884560f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:16:52.531793 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-62938531-e467-447b-9280-ba3262d5d0a6 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:52.531793 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-62938531-e467-447b-9280-ba3262d5d0a6 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:52.533379 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-62938531-e467-447b-9280-ba3262d5d0a6 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:52.533918 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-62938531-e467-447b-9280-ba3262d5d0a6 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:52.534455 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-62938531-e467-447b-9280-ba3262d5d0a6 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:52.535167 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-62938531-e467-447b-9280-ba3262d5d0a6 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:52.535723 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-62938531-e467-447b-9280-ba3262d5d0a6 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:52.536159 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-62938531-e467-447b-9280-ba3262d5d0a6 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:52.550193 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-62938531-e467-447b-9280-ba3262d5d0a6 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] HTTP exception thrown: Instance 302c627e-0b1c-4b05-8e15-4c23a5d0587c could not be found. Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-62938531-e467-447b-9280-ba3262d5d0a6 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Request method failure captured: Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c HTTP/1.1 Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVKKL3Yj8jOjD4nOjvPlV-Y9scyqq13fojDyVX3OBbve73h4rlqC2R6Nmg1gkZUj_81md5ukYTWK0OLLvV2V5x7EROs1jhxmCCEm-g9iyFEqoOdE1VQeo6XR_54_6ol8SgxaBnJdqCRkZgpHF9-UuD1N8MWY5NbSWQIdQH83g6nBVV_w Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 03ca20e778cf488baea3d1e0505cd492 Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServerActionsTestJSON-1383606630 Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/03ca20e778cf488baea3d1e0505cd492"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_03ca20e778cf488baea3d1e0505cd492"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/03ca20e778cf488baea3d1e0505cd492"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/03ca20e778cf488baea3d1e0505cd492"}]}] Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServerActionsTestJSON-1383606630 Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 03ca20e778cf488baea3d1e0505cd492 Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServerActionsTestJSON-1383606630 Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServerActionsTestJSON-1383606630-project Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 8d11ce8077ca4566ba823eac0882c34f Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServerActionsTestJSON-1383606630-project Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 302c627e-0b1c-4b05-8e15-4c23a5d0587c could not be found. Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '302c627e-0b1c-4b05-8e15-4c23a5d0587c'} Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 302c627e-0b1c-4b05-8e15-4c23a5d0587c could not be found. Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:16:52.551764 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:16:52.558601 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 302c627e-0b1c-4b05-8e15-4c23a5d0587c could not be found. Oct 23 02:16:52.558601 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:16:52.558601 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:16:52.558601 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:16:52.558601 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:16:52.558601 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:16:52.558601 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:16:52.558601 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:16:52.558601 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:16:52.558601 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 302c627e-0b1c-4b05-8e15-4c23a5d0587c could not be found. Oct 23 02:16:52.558601 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:16:52.558601 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-62938531-e467-447b-9280-ba3262d5d0a6 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Returning 404 to user: Instance 302c627e-0b1c-4b05-8e15-4c23a5d0587c could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:16:52.558601 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-62938531-e467-447b-9280-ba3262d5d0a6 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "DELETE /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c" status: 404 len: 111 microversion: 2.1 time: 0.031033 Oct 23 02:16:52.558601 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3793/7678] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 02:16:52 2022] DELETE /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 02:16:52.563769 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-faebf756-1fd6-4db6-885e-ec4fcbdd0f04 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:52.564406 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-faebf756-1fd6-4db6-885e-ec4fcbdd0f04 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] [instance: 302c627e-0b1c-4b05-8e15-4c23a5d0587c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:52.570414 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-faebf756-1fd6-4db6-885e-ec4fcbdd0f04 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:52.570908 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-faebf756-1fd6-4db6-885e-ec4fcbdd0f04 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:52.571352 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-faebf756-1fd6-4db6-885e-ec4fcbdd0f04 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:52.572041 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-faebf756-1fd6-4db6-885e-ec4fcbdd0f04 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:52.572503 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-faebf756-1fd6-4db6-885e-ec4fcbdd0f04 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:52.572930 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-faebf756-1fd6-4db6-885e-ec4fcbdd0f04 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:52.587233 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-faebf756-1fd6-4db6-885e-ec4fcbdd0f04 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] HTTP exception thrown: Instance 302c627e-0b1c-4b05-8e15-4c23a5d0587c could not be found. Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-faebf756-1fd6-4db6-885e-ec4fcbdd0f04 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Request method failure captured: Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c HTTP/1.1 Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVKKL3Yj8jOjD4nOjvPlV-Y9scyqq13fojDyVX3OBbve73h4rlqC2R6Nmg1gkZUj_81md5ukYTWK0OLLvV2V5x7EROs1jhxmCCEm-g9iyFEqoOdE1VQeo6XR_54_6ol8SgxaBnJdqCRkZgpHF9-UuD1N8MWY5NbSWQIdQH83g6nBVV_w Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 03ca20e778cf488baea3d1e0505cd492 Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServerActionsTestJSON-1383606630 Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/03ca20e778cf488baea3d1e0505cd492"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_03ca20e778cf488baea3d1e0505cd492"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/03ca20e778cf488baea3d1e0505cd492"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/03ca20e778cf488baea3d1e0505cd492"}]}] Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServerActionsTestJSON-1383606630 Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 03ca20e778cf488baea3d1e0505cd492 Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServerActionsTestJSON-1383606630 Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServerActionsTestJSON-1383606630-project Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 8d11ce8077ca4566ba823eac0882c34f Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServerActionsTestJSON-1383606630-project Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 302c627e-0b1c-4b05-8e15-4c23a5d0587c could not be found. Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '302c627e-0b1c-4b05-8e15-4c23a5d0587c'} Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 302c627e-0b1c-4b05-8e15-4c23a5d0587c could not be found. Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 302c627e-0b1c-4b05-8e15-4c23a5d0587c could not be found. Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:16:52.588764 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:16:52.594858 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:16:52.594858 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:16:52.594858 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:16:52.594858 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:16:52.594858 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:16:52.594858 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 302c627e-0b1c-4b05-8e15-4c23a5d0587c could not be found. Oct 23 02:16:52.594858 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:16:52.594858 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-faebf756-1fd6-4db6-885e-ec4fcbdd0f04 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Returning 404 to user: Instance 302c627e-0b1c-4b05-8e15-4c23a5d0587c could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:16:52.594858 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-faebf756-1fd6-4db6-885e-ec4fcbdd0f04 tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c" status: 404 len: 111 microversion: 2.1 time: 0.030276 Oct 23 02:16:52.594858 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3886/7679] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:52 2022] GET /compute/v2.1/servers/302c627e-0b1c-4b05-8e15-4c23a5d0587c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:16:52.599665 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4fe3f3ab-127d-492e-aeae-623d8df4f81b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] Calling method '.version_select at 0x7f5cc0da2dc0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:52.686238 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4fe3f3ab-127d-492e-aeae-623d8df4f81b tempest-ServerActionsTestJSON-1383606630 tempest-ServerActionsTestJSON-1383606630-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1840206196" status: 202 len: 0 microversion: 2.1 time: 0.090251 Oct 23 02:16:52.686817 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3794/7680] 10.222.0.42 () {58 vars in 1221 bytes} [Sun Oct 23 02:16:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1840206196 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:17:03.929061 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=21 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:03.929835 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=40,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:04.046693 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b78ce51d-e175-4b06-91d8-b8d820f6a5e7 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-770929414", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "fba1c74f-e445-4bfd-b4f1-c0ffa02376b9"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:17:04.102751 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-b78ce51d-e175-4b06-91d8-b8d820f6a5e7 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] validate_networks() for [('fba1c74f-e445-4bfd-b4f1-c0ffa02376b9', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 02:17:04.513379 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-b78ce51d-e175-4b06-91d8-b8d820f6a5e7 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:17:04.513813 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-b78ce51d-e175-4b06-91d8-b8d820f6a5e7 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:17:04.515601 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-b78ce51d-e175-4b06-91d8-b8d820f6a5e7 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:17:04.516040 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-b78ce51d-e175-4b06-91d8-b8d820f6a5e7 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:17:04.516499 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-b78ce51d-e175-4b06-91d8-b8d820f6a5e7 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:17:04.525651 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b78ce51d-e175-4b06-91d8-b8d820f6a5e7 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:04.526200 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b78ce51d-e175-4b06-91d8-b8d820f6a5e7 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:04.526647 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b78ce51d-e175-4b06-91d8-b8d820f6a5e7 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:04.528044 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b78ce51d-e175-4b06-91d8-b8d820f6a5e7 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:04.529256 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b78ce51d-e175-4b06-91d8-b8d820f6a5e7 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:04.529706 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b78ce51d-e175-4b06-91d8-b8d820f6a5e7 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:04.546939 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-b78ce51d-e175-4b06-91d8-b8d820f6a5e7 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Getting quotas for project 91c3d346c6c043c7b725f6c8c6bfc559. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:17:04.552562 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-b78ce51d-e175-4b06-91d8-b8d820f6a5e7 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Getting quotas for user 040db1cb2f524d67a9344884d8e2fdbb and project 91c3d346c6c043c7b725f6c8c6bfc559. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:17:04.566002 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b78ce51d-e175-4b06-91d8-b8d820f6a5e7 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 02:17:04.568097 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b78ce51d-e175-4b06-91d8-b8d820f6a5e7 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] [instance: 225c1e5b-3356-422e-a56f-36fb66eae5cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 02:17:04.681275 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b78ce51d-e175-4b06-91d8-b8d820f6a5e7 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.757799 Oct 23 02:17:04.681962 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3887/7681] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 02:17:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 02:17:04.693516 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e32e1c2d-8770-4816-98b7-f7071f89423c tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:04.694204 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e32e1c2d-8770-4816-98b7-f7071f89423c tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] [instance: 225c1e5b-3356-422e-a56f-36fb66eae5cc] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:04.698519 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=51 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:04.699806 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:04.754416 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e32e1c2d-8770-4816-98b7-f7071f89423c tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040db1cb2f524d67a9344884d8e2fdbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c3d346c6c043c7b725f6c8c6bfc559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:04.762697 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e32e1c2d-8770-4816-98b7-f7071f89423c tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] 10.222.0.42 "GET /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc" status: 200 len: 1216 microversion: 2.1 time: 0.073142 Oct 23 02:17:04.763289 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3795/7682] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:04 2022] GET /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc => generated 1216 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:05.787246 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9db7fef5-3af9-446a-b9c0-c3322ccba5b6 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:05.788046 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9db7fef5-3af9-446a-b9c0-c3322ccba5b6 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] [instance: 225c1e5b-3356-422e-a56f-36fb66eae5cc] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:05.848820 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9db7fef5-3af9-446a-b9c0-c3322ccba5b6 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040db1cb2f524d67a9344884d8e2fdbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c3d346c6c043c7b725f6c8c6bfc559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:05.857099 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9db7fef5-3af9-446a-b9c0-c3322ccba5b6 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] 10.222.0.42 "GET /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc" status: 200 len: 1216 microversion: 2.1 time: 0.073985 Oct 23 02:17:05.857687 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3888/7683] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:05 2022] GET /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc => generated 1216 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:06.879821 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ebd2ebb2-9af4-4bc7-8db8-b4de797e9684 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:06.880597 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ebd2ebb2-9af4-4bc7-8db8-b4de797e9684 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] [instance: 225c1e5b-3356-422e-a56f-36fb66eae5cc] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:06.941429 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ebd2ebb2-9af4-4bc7-8db8-b4de797e9684 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040db1cb2f524d67a9344884d8e2fdbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c3d346c6c043c7b725f6c8c6bfc559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:06.948700 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ebd2ebb2-9af4-4bc7-8db8-b4de797e9684 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] 10.222.0.42 "GET /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc" status: 200 len: 1216 microversion: 2.1 time: 0.072883 Oct 23 02:17:06.949322 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3796/7684] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:06 2022] GET /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc => generated 1216 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:07.972461 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ed79ead1-8d71-434a-b5fd-009842ff62b9 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:07.973107 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ed79ead1-8d71-434a-b5fd-009842ff62b9 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] [instance: 225c1e5b-3356-422e-a56f-36fb66eae5cc] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:08.025596 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ed79ead1-8d71-434a-b5fd-009842ff62b9 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040db1cb2f524d67a9344884d8e2fdbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c3d346c6c043c7b725f6c8c6bfc559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:08.032532 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ed79ead1-8d71-434a-b5fd-009842ff62b9 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] 10.222.0.42 "GET /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc" status: 200 len: 1216 microversion: 2.1 time: 0.063991 Oct 23 02:17:08.033101 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3889/7685] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:07 2022] GET /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc => generated 1216 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:09.055281 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-34873528-582d-4aab-ad9c-fa11e03f9d32 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:09.055910 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-34873528-582d-4aab-ad9c-fa11e03f9d32 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] [instance: 225c1e5b-3356-422e-a56f-36fb66eae5cc] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:09.063274 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-34873528-582d-4aab-ad9c-fa11e03f9d32 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:09.063767 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-34873528-582d-4aab-ad9c-fa11e03f9d32 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:09.064214 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-34873528-582d-4aab-ad9c-fa11e03f9d32 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:09.064944 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-34873528-582d-4aab-ad9c-fa11e03f9d32 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:09.065413 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-34873528-582d-4aab-ad9c-fa11e03f9d32 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:09.065848 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-34873528-582d-4aab-ad9c-fa11e03f9d32 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:09.126091 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-34873528-582d-4aab-ad9c-fa11e03f9d32 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040db1cb2f524d67a9344884d8e2fdbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c3d346c6c043c7b725f6c8c6bfc559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:09.133812 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-34873528-582d-4aab-ad9c-fa11e03f9d32 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] 10.222.0.42 "GET /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc" status: 200 len: 1220 microversion: 2.1 time: 0.082526 Oct 23 02:17:09.134458 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3797/7686] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:09 2022] GET /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:10.157430 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-71c5dbd7-1b59-45b2-bf5a-ac9b0555a319 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:10.158245 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-71c5dbd7-1b59-45b2-bf5a-ac9b0555a319 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] [instance: 225c1e5b-3356-422e-a56f-36fb66eae5cc] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:10.165692 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-71c5dbd7-1b59-45b2-bf5a-ac9b0555a319 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:10.166209 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-71c5dbd7-1b59-45b2-bf5a-ac9b0555a319 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:10.168315 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-71c5dbd7-1b59-45b2-bf5a-ac9b0555a319 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:10.168315 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-71c5dbd7-1b59-45b2-bf5a-ac9b0555a319 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:10.168583 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-71c5dbd7-1b59-45b2-bf5a-ac9b0555a319 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:10.168844 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-71c5dbd7-1b59-45b2-bf5a-ac9b0555a319 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:10.231169 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-71c5dbd7-1b59-45b2-bf5a-ac9b0555a319 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040db1cb2f524d67a9344884d8e2fdbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c3d346c6c043c7b725f6c8c6bfc559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:10.240801 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-71c5dbd7-1b59-45b2-bf5a-ac9b0555a319 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] 10.222.0.42 "GET /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc" status: 200 len: 1212 microversion: 2.1 time: 0.087332 Oct 23 02:17:10.241728 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3890/7687] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:10 2022] GET /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc => generated 1212 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:17:11.267377 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-81272eb1-1d78-4a9f-919b-378cdc512897 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:11.268010 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-81272eb1-1d78-4a9f-919b-378cdc512897 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] [instance: 225c1e5b-3356-422e-a56f-36fb66eae5cc] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:11.275491 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-81272eb1-1d78-4a9f-919b-378cdc512897 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:11.276158 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-81272eb1-1d78-4a9f-919b-378cdc512897 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:11.276611 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-81272eb1-1d78-4a9f-919b-378cdc512897 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:11.277421 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-81272eb1-1d78-4a9f-919b-378cdc512897 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:11.277878 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-81272eb1-1d78-4a9f-919b-378cdc512897 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:11.278346 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-81272eb1-1d78-4a9f-919b-378cdc512897 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:11.346180 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-81272eb1-1d78-4a9f-919b-378cdc512897 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040db1cb2f524d67a9344884d8e2fdbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c3d346c6c043c7b725f6c8c6bfc559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:11.354277 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-81272eb1-1d78-4a9f-919b-378cdc512897 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] 10.222.0.42 "GET /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc" status: 200 len: 1274 microversion: 2.1 time: 0.090807 Oct 23 02:17:11.354852 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3798/7688] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:11 2022] GET /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc => generated 1274 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:12.377964 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-272d1c0a-f55e-458c-be59-19d209924e94 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:12.378666 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-272d1c0a-f55e-458c-be59-19d209924e94 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] [instance: 225c1e5b-3356-422e-a56f-36fb66eae5cc] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:12.385554 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-272d1c0a-f55e-458c-be59-19d209924e94 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:12.385962 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-272d1c0a-f55e-458c-be59-19d209924e94 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:12.387095 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-272d1c0a-f55e-458c-be59-19d209924e94 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:12.387788 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-272d1c0a-f55e-458c-be59-19d209924e94 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:12.388243 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-272d1c0a-f55e-458c-be59-19d209924e94 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:12.388855 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-272d1c0a-f55e-458c-be59-19d209924e94 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:12.528491 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-272d1c0a-f55e-458c-be59-19d209924e94 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040db1cb2f524d67a9344884d8e2fdbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c3d346c6c043c7b725f6c8c6bfc559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:12.536608 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-272d1c0a-f55e-458c-be59-19d209924e94 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] 10.222.0.42 "GET /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc" status: 200 len: 1316 microversion: 2.1 time: 0.162719 Oct 23 02:17:12.537189 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3891/7689] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:12 2022] GET /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:12.679431 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-2a423a2b-b2bd-4613-9168-0eef90bcf6cf req-fa2b8711-f288-4a22-868e-de70c9670f3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "225c1e5b-3356-422e-a56f-36fb66eae5cc", "tag": "325191f3-b85c-47fa-8450-7271e8eaf3e9"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:17:12.691411 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-2a423a2b-b2bd-4613-9168-0eef90bcf6cf req-fa2b8711-f288-4a22-868e-de70c9670f3f service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:12.691901 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-2a423a2b-b2bd-4613-9168-0eef90bcf6cf req-fa2b8711-f288-4a22-868e-de70c9670f3f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:12.692555 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-2a423a2b-b2bd-4613-9168-0eef90bcf6cf req-fa2b8711-f288-4a22-868e-de70c9670f3f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:12.704379 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-2a423a2b-b2bd-4613-9168-0eef90bcf6cf req-fa2b8711-f288-4a22-868e-de70c9670f3f service nova] Creating event network-changed:325191f3-b85c-47fa-8450-7271e8eaf3e9 for instance 225c1e5b-3356-422e-a56f-36fb66eae5cc on n-h2-master-1 Oct 23 02:17:12.709398 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-2a423a2b-b2bd-4613-9168-0eef90bcf6cf req-fa2b8711-f288-4a22-868e-de70c9670f3f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034349 Oct 23 02:17:12.710326 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3799/7690] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:17:13.559330 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-96b19966-25a2-4334-ab86-1e5117266b9e tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:13.559954 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-96b19966-25a2-4334-ab86-1e5117266b9e tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] [instance: 225c1e5b-3356-422e-a56f-36fb66eae5cc] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:13.566915 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-96b19966-25a2-4334-ab86-1e5117266b9e tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:13.567404 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-96b19966-25a2-4334-ab86-1e5117266b9e tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:13.567864 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-96b19966-25a2-4334-ab86-1e5117266b9e tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:13.568587 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-96b19966-25a2-4334-ab86-1e5117266b9e tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:13.569051 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-96b19966-25a2-4334-ab86-1e5117266b9e tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:13.569483 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-96b19966-25a2-4334-ab86-1e5117266b9e tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:13.697228 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-96b19966-25a2-4334-ab86-1e5117266b9e tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040db1cb2f524d67a9344884d8e2fdbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c3d346c6c043c7b725f6c8c6bfc559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:13.705773 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-96b19966-25a2-4334-ab86-1e5117266b9e tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] 10.222.0.42 "GET /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc" status: 200 len: 1316 microversion: 2.1 time: 0.150451 Oct 23 02:17:13.706373 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3892/7691] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:13 2022] GET /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc => generated 1316 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:14.730656 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e9769899-9abf-484d-b052-94a638e4ba73 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:14.731407 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e9769899-9abf-484d-b052-94a638e4ba73 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] [instance: 225c1e5b-3356-422e-a56f-36fb66eae5cc] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:14.742155 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e9769899-9abf-484d-b052-94a638e4ba73 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:14.742155 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e9769899-9abf-484d-b052-94a638e4ba73 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:14.742155 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e9769899-9abf-484d-b052-94a638e4ba73 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:14.742155 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e9769899-9abf-484d-b052-94a638e4ba73 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:14.742155 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e9769899-9abf-484d-b052-94a638e4ba73 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:14.742155 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e9769899-9abf-484d-b052-94a638e4ba73 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:14.872758 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e9769899-9abf-484d-b052-94a638e4ba73 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040db1cb2f524d67a9344884d8e2fdbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c3d346c6c043c7b725f6c8c6bfc559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:14.880626 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e9769899-9abf-484d-b052-94a638e4ba73 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] 10.222.0.42 "GET /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc" status: 200 len: 1316 microversion: 2.1 time: 0.154860 Oct 23 02:17:14.881202 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3800/7692] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:14 2022] GET /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:15.903727 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-09d39ca4-9e80-4cb2-afc9-751300d44fcf tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:15.904469 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-09d39ca4-9e80-4cb2-afc9-751300d44fcf tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] [instance: 225c1e5b-3356-422e-a56f-36fb66eae5cc] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:15.906373 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:15.911966 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-09d39ca4-9e80-4cb2-afc9-751300d44fcf tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:15.912447 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-09d39ca4-9e80-4cb2-afc9-751300d44fcf tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:15.912880 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-09d39ca4-9e80-4cb2-afc9-751300d44fcf tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:15.913601 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-09d39ca4-9e80-4cb2-afc9-751300d44fcf tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:15.914106 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-09d39ca4-9e80-4cb2-afc9-751300d44fcf tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:15.914530 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-09d39ca4-9e80-4cb2-afc9-751300d44fcf tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:16.045254 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-09d39ca4-9e80-4cb2-afc9-751300d44fcf tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040db1cb2f524d67a9344884d8e2fdbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c3d346c6c043c7b725f6c8c6bfc559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:16.053121 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-09d39ca4-9e80-4cb2-afc9-751300d44fcf tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] 10.222.0.42 "GET /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc" status: 200 len: 1316 microversion: 2.1 time: 0.153381 Oct 23 02:17:16.053702 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3893/7693] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:15 2022] GET /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:17.077269 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3c7413ef-cf26-42e2-96f6-e55fad627d62 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:17.077927 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3c7413ef-cf26-42e2-96f6-e55fad627d62 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] [instance: 225c1e5b-3356-422e-a56f-36fb66eae5cc] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:17.080728 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=4 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:17.085557 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c7413ef-cf26-42e2-96f6-e55fad627d62 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:17.086159 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c7413ef-cf26-42e2-96f6-e55fad627d62 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:17.087267 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c7413ef-cf26-42e2-96f6-e55fad627d62 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:17.087267 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c7413ef-cf26-42e2-96f6-e55fad627d62 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:17.087745 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c7413ef-cf26-42e2-96f6-e55fad627d62 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:17.088182 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c7413ef-cf26-42e2-96f6-e55fad627d62 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:17.219293 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3c7413ef-cf26-42e2-96f6-e55fad627d62 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040db1cb2f524d67a9344884d8e2fdbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c3d346c6c043c7b725f6c8c6bfc559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:17.226933 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3c7413ef-cf26-42e2-96f6-e55fad627d62 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] 10.222.0.42 "GET /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc" status: 200 len: 1316 microversion: 2.1 time: 0.154192 Oct 23 02:17:17.227524 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3801/7694] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:17 2022] GET /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:18.030882 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-58a3d305-0590-4d24-a7e0-fcbbc9b89fd2 req-3eb18470-498f-47b0-8f05-750527d36111 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "225c1e5b-3356-422e-a56f-36fb66eae5cc", "name": "network-vif-plugged", "status": "completed", "tag": "325191f3-b85c-47fa-8450-7271e8eaf3e9"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:17:18.036855 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=10 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:18.042080 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-58a3d305-0590-4d24-a7e0-fcbbc9b89fd2 req-3eb18470-498f-47b0-8f05-750527d36111 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:18.042542 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-58a3d305-0590-4d24-a7e0-fcbbc9b89fd2 req-3eb18470-498f-47b0-8f05-750527d36111 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:18.042977 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-58a3d305-0590-4d24-a7e0-fcbbc9b89fd2 req-3eb18470-498f-47b0-8f05-750527d36111 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:18.053989 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-58a3d305-0590-4d24-a7e0-fcbbc9b89fd2 req-3eb18470-498f-47b0-8f05-750527d36111 service nova] Creating event network-vif-plugged:325191f3-b85c-47fa-8450-7271e8eaf3e9 for instance 225c1e5b-3356-422e-a56f-36fb66eae5cc on n-h2-master-1 Oct 23 02:17:18.058895 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-58a3d305-0590-4d24-a7e0-fcbbc9b89fd2 req-3eb18470-498f-47b0-8f05-750527d36111 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032630 Oct 23 02:17:18.059474 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3894/7695] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:17:18.250544 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cadfe030-cde1-4a1b-aec6-1776da5d8719 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:18.251179 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cadfe030-cde1-4a1b-aec6-1776da5d8719 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] [instance: 225c1e5b-3356-422e-a56f-36fb66eae5cc] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:18.257907 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cadfe030-cde1-4a1b-aec6-1776da5d8719 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:18.258434 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cadfe030-cde1-4a1b-aec6-1776da5d8719 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:18.258874 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cadfe030-cde1-4a1b-aec6-1776da5d8719 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:18.259567 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cadfe030-cde1-4a1b-aec6-1776da5d8719 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:18.260028 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cadfe030-cde1-4a1b-aec6-1776da5d8719 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:18.260455 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cadfe030-cde1-4a1b-aec6-1776da5d8719 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:18.388136 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cadfe030-cde1-4a1b-aec6-1776da5d8719 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040db1cb2f524d67a9344884d8e2fdbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c3d346c6c043c7b725f6c8c6bfc559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:18.395649 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cadfe030-cde1-4a1b-aec6-1776da5d8719 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] 10.222.0.42 "GET /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc" status: 200 len: 1316 microversion: 2.1 time: 0.149063 Oct 23 02:17:18.396264 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3802/7696] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:18 2022] GET /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc => generated 1316 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:19.420419 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a9efb220-ad05-4ecb-9be2-c67ea6c0e00d tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:19.421133 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a9efb220-ad05-4ecb-9be2-c67ea6c0e00d tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] [instance: 225c1e5b-3356-422e-a56f-36fb66eae5cc] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:19.427653 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a9efb220-ad05-4ecb-9be2-c67ea6c0e00d tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:19.428148 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a9efb220-ad05-4ecb-9be2-c67ea6c0e00d tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:19.428587 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a9efb220-ad05-4ecb-9be2-c67ea6c0e00d tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:19.429278 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a9efb220-ad05-4ecb-9be2-c67ea6c0e00d tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:19.429741 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a9efb220-ad05-4ecb-9be2-c67ea6c0e00d tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:19.430193 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a9efb220-ad05-4ecb-9be2-c67ea6c0e00d tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:19.558213 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a9efb220-ad05-4ecb-9be2-c67ea6c0e00d tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040db1cb2f524d67a9344884d8e2fdbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c3d346c6c043c7b725f6c8c6bfc559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:19.566004 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a9efb220-ad05-4ecb-9be2-c67ea6c0e00d tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] 10.222.0.42 "GET /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc" status: 200 len: 1316 microversion: 2.1 time: 0.151196 Oct 23 02:17:19.569113 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3895/7697] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:19 2022] GET /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc => generated 1316 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:20.591345 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f6b09cca-630b-403f-b94f-eefa29c2f552 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:20.592483 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f6b09cca-630b-403f-b94f-eefa29c2f552 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] [instance: 225c1e5b-3356-422e-a56f-36fb66eae5cc] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:20.599339 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f6b09cca-630b-403f-b94f-eefa29c2f552 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:20.599828 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f6b09cca-630b-403f-b94f-eefa29c2f552 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:20.600265 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f6b09cca-630b-403f-b94f-eefa29c2f552 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:20.600952 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f6b09cca-630b-403f-b94f-eefa29c2f552 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:20.601412 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f6b09cca-630b-403f-b94f-eefa29c2f552 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:20.601841 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f6b09cca-630b-403f-b94f-eefa29c2f552 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:20.730514 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f6b09cca-630b-403f-b94f-eefa29c2f552 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040db1cb2f524d67a9344884d8e2fdbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c3d346c6c043c7b725f6c8c6bfc559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:20.738453 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f6b09cca-630b-403f-b94f-eefa29c2f552 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] 10.222.0.42 "GET /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc" status: 200 len: 1506 microversion: 2.1 time: 0.151358 Oct 23 02:17:20.739916 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3803/7698] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:20 2022] GET /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:20.801440 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fe60b8d2-97ca-4400-be85-e0922fddbf66 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-644379593", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "fba1c74f-e445-4bfd-b4f1-c0ffa02376b9"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:17:20.853780 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-fe60b8d2-97ca-4400-be85-e0922fddbf66 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] validate_networks() for [('fba1c74f-e445-4bfd-b4f1-c0ffa02376b9', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 02:17:21.219601 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-fe60b8d2-97ca-4400-be85-e0922fddbf66 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:17:21.220030 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-fe60b8d2-97ca-4400-be85-e0922fddbf66 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:17:21.220513 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-fe60b8d2-97ca-4400-be85-e0922fddbf66 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:17:21.220928 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-fe60b8d2-97ca-4400-be85-e0922fddbf66 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:17:21.221348 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-fe60b8d2-97ca-4400-be85-e0922fddbf66 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:17:21.230317 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe60b8d2-97ca-4400-be85-e0922fddbf66 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:21.230805 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe60b8d2-97ca-4400-be85-e0922fddbf66 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:21.231243 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe60b8d2-97ca-4400-be85-e0922fddbf66 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:21.231969 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe60b8d2-97ca-4400-be85-e0922fddbf66 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:21.232447 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe60b8d2-97ca-4400-be85-e0922fddbf66 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:21.232876 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fe60b8d2-97ca-4400-be85-e0922fddbf66 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:21.249519 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-fe60b8d2-97ca-4400-be85-e0922fddbf66 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Getting quotas for project 91c3d346c6c043c7b725f6c8c6bfc559. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:17:21.254709 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-fe60b8d2-97ca-4400-be85-e0922fddbf66 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Getting quotas for user 040db1cb2f524d67a9344884d8e2fdbb and project 91c3d346c6c043c7b725f6c8c6bfc559. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:17:21.267409 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fe60b8d2-97ca-4400-be85-e0922fddbf66 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 02:17:21.269669 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fe60b8d2-97ca-4400-be85-e0922fddbf66 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] [instance: ad3fa1b5-beaa-4d13-8e05-134864e27ab7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 02:17:21.384611 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fe60b8d2-97ca-4400-be85-e0922fddbf66 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.586957 Oct 23 02:17:21.385246 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3896/7699] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 02:17:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 02:17:21.397273 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b9363024-6fcd-4226-ae87-d53f4bd6af61 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:21.398029 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b9363024-6fcd-4226-ae87-d53f4bd6af61 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] [instance: ad3fa1b5-beaa-4d13-8e05-134864e27ab7] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:21.450800 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b9363024-6fcd-4226-ae87-d53f4bd6af61 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040db1cb2f524d67a9344884d8e2fdbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c3d346c6c043c7b725f6c8c6bfc559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:21.458415 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b9363024-6fcd-4226-ae87-d53f4bd6af61 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fa1b5-beaa-4d13-8e05-134864e27ab7" status: 200 len: 1216 microversion: 2.1 time: 0.065167 Oct 23 02:17:21.458989 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3804/7700] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:21 2022] GET /compute/v2.1/servers/ad3fa1b5-beaa-4d13-8e05-134864e27ab7 => generated 1216 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:17:22.482511 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d913ee7b-9c6d-40d4-bc37-72c658bf40bb tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:22.483188 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d913ee7b-9c6d-40d4-bc37-72c658bf40bb tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] [instance: ad3fa1b5-beaa-4d13-8e05-134864e27ab7] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:22.490743 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d913ee7b-9c6d-40d4-bc37-72c658bf40bb tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:22.490743 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d913ee7b-9c6d-40d4-bc37-72c658bf40bb tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:22.490743 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d913ee7b-9c6d-40d4-bc37-72c658bf40bb tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:22.491098 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d913ee7b-9c6d-40d4-bc37-72c658bf40bb tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:22.491552 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d913ee7b-9c6d-40d4-bc37-72c658bf40bb tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:22.491982 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d913ee7b-9c6d-40d4-bc37-72c658bf40bb tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:22.552877 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d913ee7b-9c6d-40d4-bc37-72c658bf40bb tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040db1cb2f524d67a9344884d8e2fdbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c3d346c6c043c7b725f6c8c6bfc559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:22.560581 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d913ee7b-9c6d-40d4-bc37-72c658bf40bb tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fa1b5-beaa-4d13-8e05-134864e27ab7" status: 200 len: 1220 microversion: 2.1 time: 0.082908 Oct 23 02:17:22.561157 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3897/7701] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:22 2022] GET /compute/v2.1/servers/ad3fa1b5-beaa-4d13-8e05-134864e27ab7 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:23.583782 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-45259d5c-022d-4ff6-8520-267872ad1628 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:23.584414 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-45259d5c-022d-4ff6-8520-267872ad1628 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] [instance: ad3fa1b5-beaa-4d13-8e05-134864e27ab7] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:23.591134 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-45259d5c-022d-4ff6-8520-267872ad1628 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:23.591643 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-45259d5c-022d-4ff6-8520-267872ad1628 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:23.592085 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-45259d5c-022d-4ff6-8520-267872ad1628 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:23.593329 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-45259d5c-022d-4ff6-8520-267872ad1628 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:23.593791 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-45259d5c-022d-4ff6-8520-267872ad1628 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:23.594254 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-45259d5c-022d-4ff6-8520-267872ad1628 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:23.660526 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-45259d5c-022d-4ff6-8520-267872ad1628 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040db1cb2f524d67a9344884d8e2fdbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c3d346c6c043c7b725f6c8c6bfc559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:23.668190 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-45259d5c-022d-4ff6-8520-267872ad1628 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fa1b5-beaa-4d13-8e05-134864e27ab7" status: 200 len: 1286 microversion: 2.1 time: 0.088630 Oct 23 02:17:23.668767 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3805/7702] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:23 2022] GET /compute/v2.1/servers/ad3fa1b5-beaa-4d13-8e05-134864e27ab7 => generated 1286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:24.694558 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-928873e9-6924-4f34-be9e-becc07bddbc4 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:24.695183 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-928873e9-6924-4f34-be9e-becc07bddbc4 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] [instance: ad3fa1b5-beaa-4d13-8e05-134864e27ab7] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:24.701954 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-928873e9-6924-4f34-be9e-becc07bddbc4 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:24.702542 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-928873e9-6924-4f34-be9e-becc07bddbc4 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:24.702986 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-928873e9-6924-4f34-be9e-becc07bddbc4 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:24.703676 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-928873e9-6924-4f34-be9e-becc07bddbc4 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:24.704136 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-928873e9-6924-4f34-be9e-becc07bddbc4 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:24.704562 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-928873e9-6924-4f34-be9e-becc07bddbc4 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:24.841941 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-928873e9-6924-4f34-be9e-becc07bddbc4 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040db1cb2f524d67a9344884d8e2fdbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c3d346c6c043c7b725f6c8c6bfc559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:24.849762 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-928873e9-6924-4f34-be9e-becc07bddbc4 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fa1b5-beaa-4d13-8e05-134864e27ab7" status: 200 len: 1316 microversion: 2.1 time: 0.159285 Oct 23 02:17:24.850402 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3898/7703] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:24 2022] GET /compute/v2.1/servers/ad3fa1b5-beaa-4d13-8e05-134864e27ab7 => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:25.101586 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-27a92e8c-864f-4157-9f6b-d353712de0e0 req-931207bf-8425-4824-8e8a-91028d020c3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad3fa1b5-beaa-4d13-8e05-134864e27ab7", "tag": "9b66f8d2-f239-4a78-bc46-c10dfec48440"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:17:25.112553 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-27a92e8c-864f-4157-9f6b-d353712de0e0 req-931207bf-8425-4824-8e8a-91028d020c3d service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:25.113832 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-27a92e8c-864f-4157-9f6b-d353712de0e0 req-931207bf-8425-4824-8e8a-91028d020c3d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:25.114132 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-27a92e8c-864f-4157-9f6b-d353712de0e0 req-931207bf-8425-4824-8e8a-91028d020c3d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:25.125265 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-27a92e8c-864f-4157-9f6b-d353712de0e0 req-931207bf-8425-4824-8e8a-91028d020c3d service nova] Creating event network-changed:9b66f8d2-f239-4a78-bc46-c10dfec48440 for instance ad3fa1b5-beaa-4d13-8e05-134864e27ab7 on n-h1-master-1 Oct 23 02:17:25.130171 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-27a92e8c-864f-4157-9f6b-d353712de0e0 req-931207bf-8425-4824-8e8a-91028d020c3d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032425 Oct 23 02:17:25.130770 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3806/7704] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:17:25.875508 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-41639d2b-4426-4e84-8c3b-0969f4da2720 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:25.876584 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-41639d2b-4426-4e84-8c3b-0969f4da2720 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] [instance: ad3fa1b5-beaa-4d13-8e05-134864e27ab7] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:25.883368 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41639d2b-4426-4e84-8c3b-0969f4da2720 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:25.883857 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41639d2b-4426-4e84-8c3b-0969f4da2720 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:25.884298 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41639d2b-4426-4e84-8c3b-0969f4da2720 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:25.884991 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41639d2b-4426-4e84-8c3b-0969f4da2720 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:25.885444 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41639d2b-4426-4e84-8c3b-0969f4da2720 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:25.885874 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41639d2b-4426-4e84-8c3b-0969f4da2720 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:26.020251 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-41639d2b-4426-4e84-8c3b-0969f4da2720 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040db1cb2f524d67a9344884d8e2fdbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c3d346c6c043c7b725f6c8c6bfc559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:26.028099 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-41639d2b-4426-4e84-8c3b-0969f4da2720 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fa1b5-beaa-4d13-8e05-134864e27ab7" status: 200 len: 1316 microversion: 2.1 time: 0.157707 Oct 23 02:17:26.028682 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3899/7705] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:25 2022] GET /compute/v2.1/servers/ad3fa1b5-beaa-4d13-8e05-134864e27ab7 => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:27.052458 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e8130b14-f983-45b4-9b31-66182759aeac tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:27.053174 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e8130b14-f983-45b4-9b31-66182759aeac tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] [instance: ad3fa1b5-beaa-4d13-8e05-134864e27ab7] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:27.059380 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8130b14-f983-45b4-9b31-66182759aeac tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:27.059905 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8130b14-f983-45b4-9b31-66182759aeac tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:27.060354 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8130b14-f983-45b4-9b31-66182759aeac tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:27.061048 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8130b14-f983-45b4-9b31-66182759aeac tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:27.061517 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8130b14-f983-45b4-9b31-66182759aeac tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:27.061948 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e8130b14-f983-45b4-9b31-66182759aeac tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:27.456146 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e8130b14-f983-45b4-9b31-66182759aeac tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040db1cb2f524d67a9344884d8e2fdbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c3d346c6c043c7b725f6c8c6bfc559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:27.463879 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e8130b14-f983-45b4-9b31-66182759aeac tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fa1b5-beaa-4d13-8e05-134864e27ab7" status: 200 len: 1316 microversion: 2.1 time: 0.416475 Oct 23 02:17:27.464456 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3807/7706] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:27 2022] GET /compute/v2.1/servers/ad3fa1b5-beaa-4d13-8e05-134864e27ab7 => generated 1316 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:28.486448 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c2c615e4-512a-4870-9849-3054dcc3398a tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:28.487139 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c2c615e4-512a-4870-9849-3054dcc3398a tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] [instance: ad3fa1b5-beaa-4d13-8e05-134864e27ab7] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:28.494198 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2c615e4-512a-4870-9849-3054dcc3398a tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:28.494744 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2c615e4-512a-4870-9849-3054dcc3398a tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:28.495135 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2c615e4-512a-4870-9849-3054dcc3398a tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:28.495834 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2c615e4-512a-4870-9849-3054dcc3398a tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:28.496299 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2c615e4-512a-4870-9849-3054dcc3398a tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:28.496727 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c2c615e4-512a-4870-9849-3054dcc3398a tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:28.622677 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c2c615e4-512a-4870-9849-3054dcc3398a tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040db1cb2f524d67a9344884d8e2fdbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c3d346c6c043c7b725f6c8c6bfc559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:28.630363 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c2c615e4-512a-4870-9849-3054dcc3398a tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fa1b5-beaa-4d13-8e05-134864e27ab7" status: 200 len: 1316 microversion: 2.1 time: 0.147802 Oct 23 02:17:28.630934 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3900/7707] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:28 2022] GET /compute/v2.1/servers/ad3fa1b5-beaa-4d13-8e05-134864e27ab7 => generated 1316 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:29.653814 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-df5f7832-b688-4616-b60f-ea3bd54b7902 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:29.660169 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-df5f7832-b688-4616-b60f-ea3bd54b7902 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] [instance: ad3fa1b5-beaa-4d13-8e05-134864e27ab7] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:29.661929 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-df5f7832-b688-4616-b60f-ea3bd54b7902 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:29.662466 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-df5f7832-b688-4616-b60f-ea3bd54b7902 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:29.662916 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-df5f7832-b688-4616-b60f-ea3bd54b7902 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:29.663622 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-df5f7832-b688-4616-b60f-ea3bd54b7902 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:29.664088 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-df5f7832-b688-4616-b60f-ea3bd54b7902 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:29.664524 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-df5f7832-b688-4616-b60f-ea3bd54b7902 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:29.799444 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-df5f7832-b688-4616-b60f-ea3bd54b7902 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040db1cb2f524d67a9344884d8e2fdbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c3d346c6c043c7b725f6c8c6bfc559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:29.807179 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-df5f7832-b688-4616-b60f-ea3bd54b7902 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fa1b5-beaa-4d13-8e05-134864e27ab7" status: 200 len: 1316 microversion: 2.1 time: 0.157313 Oct 23 02:17:29.807846 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3808/7708] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:29 2022] GET /compute/v2.1/servers/ad3fa1b5-beaa-4d13-8e05-134864e27ab7 => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:29.827481 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-3142626b-dd57-47d6-9ef0-8346e165d948 req-8abf9b5b-533c-4316-ac65-001cd7fc0ee4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad3fa1b5-beaa-4d13-8e05-134864e27ab7", "name": "network-vif-plugged", "status": "completed", "tag": "9b66f8d2-f239-4a78-bc46-c10dfec48440"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:17:29.837895 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-3142626b-dd57-47d6-9ef0-8346e165d948 req-8abf9b5b-533c-4316-ac65-001cd7fc0ee4 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:29.840652 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-3142626b-dd57-47d6-9ef0-8346e165d948 req-8abf9b5b-533c-4316-ac65-001cd7fc0ee4 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:29.840652 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-3142626b-dd57-47d6-9ef0-8346e165d948 req-8abf9b5b-533c-4316-ac65-001cd7fc0ee4 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:29.850280 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-3142626b-dd57-47d6-9ef0-8346e165d948 req-8abf9b5b-533c-4316-ac65-001cd7fc0ee4 service nova] Creating event network-vif-plugged:9b66f8d2-f239-4a78-bc46-c10dfec48440 for instance ad3fa1b5-beaa-4d13-8e05-134864e27ab7 on n-h1-master-1 Oct 23 02:17:29.855278 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-3142626b-dd57-47d6-9ef0-8346e165d948 req-8abf9b5b-533c-4316-ac65-001cd7fc0ee4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031665 Oct 23 02:17:29.855862 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3901/7709] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:17:30.830292 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5cbbcc93-f3bd-403f-8fcc-722575936214 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:30.830925 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5cbbcc93-f3bd-403f-8fcc-722575936214 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] [instance: ad3fa1b5-beaa-4d13-8e05-134864e27ab7] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:30.837997 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5cbbcc93-f3bd-403f-8fcc-722575936214 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:30.838522 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5cbbcc93-f3bd-403f-8fcc-722575936214 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:30.839007 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5cbbcc93-f3bd-403f-8fcc-722575936214 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:30.839740 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5cbbcc93-f3bd-403f-8fcc-722575936214 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:30.840330 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5cbbcc93-f3bd-403f-8fcc-722575936214 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:30.840778 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5cbbcc93-f3bd-403f-8fcc-722575936214 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:30.971104 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5cbbcc93-f3bd-403f-8fcc-722575936214 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040db1cb2f524d67a9344884d8e2fdbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c3d346c6c043c7b725f6c8c6bfc559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:30.978919 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5cbbcc93-f3bd-403f-8fcc-722575936214 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fa1b5-beaa-4d13-8e05-134864e27ab7" status: 200 len: 1316 microversion: 2.1 time: 0.152792 Oct 23 02:17:30.979501 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3809/7710] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:30 2022] GET /compute/v2.1/servers/ad3fa1b5-beaa-4d13-8e05-134864e27ab7 => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:32.000355 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:32.001216 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=6 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:32.005209 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0a502ef5-b123-49f6-981a-32bf4358330b tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:32.006652 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0a502ef5-b123-49f6-981a-32bf4358330b tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] [instance: ad3fa1b5-beaa-4d13-8e05-134864e27ab7] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:32.012012 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0a502ef5-b123-49f6-981a-32bf4358330b tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:32.012507 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0a502ef5-b123-49f6-981a-32bf4358330b tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:32.013026 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0a502ef5-b123-49f6-981a-32bf4358330b tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:32.013630 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0a502ef5-b123-49f6-981a-32bf4358330b tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:32.014113 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0a502ef5-b123-49f6-981a-32bf4358330b tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:32.014540 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0a502ef5-b123-49f6-981a-32bf4358330b tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:32.147442 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0a502ef5-b123-49f6-981a-32bf4358330b tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040db1cb2f524d67a9344884d8e2fdbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c3d346c6c043c7b725f6c8c6bfc559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:32.155283 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0a502ef5-b123-49f6-981a-32bf4358330b tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fa1b5-beaa-4d13-8e05-134864e27ab7" status: 200 len: 1505 microversion: 2.1 time: 0.156732 Oct 23 02:17:32.156500 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3902/7711] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:31 2022] GET /compute/v2.1/servers/ad3fa1b5-beaa-4d13-8e05-134864e27ab7 => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:32.178336 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a4a0274d-b74e-48b0-aea3-0229c31a3059 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:32.178845 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a4a0274d-b74e-48b0-aea3-0229c31a3059 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] [instance: ad3fa1b5-beaa-4d13-8e05-134864e27ab7] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:32.180794 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:32.186429 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a4a0274d-b74e-48b0-aea3-0229c31a3059 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:32.186926 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a4a0274d-b74e-48b0-aea3-0229c31a3059 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:32.187379 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a4a0274d-b74e-48b0-aea3-0229c31a3059 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:32.188081 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a4a0274d-b74e-48b0-aea3-0229c31a3059 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:32.188542 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a4a0274d-b74e-48b0-aea3-0229c31a3059 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:32.188977 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a4a0274d-b74e-48b0-aea3-0229c31a3059 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:32.213941 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a4a0274d-b74e-48b0-aea3-0229c31a3059 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] [instance: ad3fa1b5-beaa-4d13-8e05-134864e27ab7] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 02:17:32.519515 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a4a0274d-b74e-48b0-aea3-0229c31a3059 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ad3fa1b5-beaa-4d13-8e05-134864e27ab7" status: 204 len: 0 microversion: 2.1 time: 0.344371 Oct 23 02:17:32.520104 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3810/7712] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 02:17:32 2022] DELETE /compute/v2.1/servers/ad3fa1b5-beaa-4d13-8e05-134864e27ab7 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 02:17:32.528109 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c77dde57-7c98-497a-a27f-d3d9f13eb032 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:32.528742 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c77dde57-7c98-497a-a27f-d3d9f13eb032 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] [instance: ad3fa1b5-beaa-4d13-8e05-134864e27ab7] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:32.534846 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c77dde57-7c98-497a-a27f-d3d9f13eb032 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:32.535336 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c77dde57-7c98-497a-a27f-d3d9f13eb032 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:32.535773 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c77dde57-7c98-497a-a27f-d3d9f13eb032 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:32.536464 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c77dde57-7c98-497a-a27f-d3d9f13eb032 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:32.536921 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c77dde57-7c98-497a-a27f-d3d9f13eb032 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:32.537348 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c77dde57-7c98-497a-a27f-d3d9f13eb032 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:32.664364 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c77dde57-7c98-497a-a27f-d3d9f13eb032 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040db1cb2f524d67a9344884d8e2fdbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c3d346c6c043c7b725f6c8c6bfc559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:32.672057 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c77dde57-7c98-497a-a27f-d3d9f13eb032 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fa1b5-beaa-4d13-8e05-134864e27ab7" status: 200 len: 1511 microversion: 2.1 time: 0.147907 Oct 23 02:17:32.672635 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3903/7713] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:32 2022] GET /compute/v2.1/servers/ad3fa1b5-beaa-4d13-8e05-134864e27ab7 => generated 1511 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:33.696499 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9ef4e877-5608-4880-812b-00fb25547015 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:33.697282 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9ef4e877-5608-4880-812b-00fb25547015 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] [instance: ad3fa1b5-beaa-4d13-8e05-134864e27ab7] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:33.704678 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9ef4e877-5608-4880-812b-00fb25547015 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:33.705184 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9ef4e877-5608-4880-812b-00fb25547015 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:33.705632 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9ef4e877-5608-4880-812b-00fb25547015 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:33.706395 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9ef4e877-5608-4880-812b-00fb25547015 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:33.706889 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9ef4e877-5608-4880-812b-00fb25547015 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:33.707329 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9ef4e877-5608-4880-812b-00fb25547015 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:33.842670 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9ef4e877-5608-4880-812b-00fb25547015 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040db1cb2f524d67a9344884d8e2fdbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c3d346c6c043c7b725f6c8c6bfc559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:33.851040 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9ef4e877-5608-4880-812b-00fb25547015 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fa1b5-beaa-4d13-8e05-134864e27ab7" status: 200 len: 1511 microversion: 2.1 time: 0.159182 Oct 23 02:17:33.851872 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3811/7714] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:33 2022] GET /compute/v2.1/servers/ad3fa1b5-beaa-4d13-8e05-134864e27ab7 => generated 1511 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:34.747014 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-76816405-add2-47ba-b09b-417b43f9eeb4 req-7fffb5c7-1bf0-4972-8a0e-5ebbea7a3a2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad3fa1b5-beaa-4d13-8e05-134864e27ab7", "name": "network-vif-deleted", "tag": "9b66f8d2-f239-4a78-bc46-c10dfec48440"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:17:34.758576 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=6 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:34.764769 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-76816405-add2-47ba-b09b-417b43f9eeb4 req-7fffb5c7-1bf0-4972-8a0e-5ebbea7a3a2d service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:34.765887 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-76816405-add2-47ba-b09b-417b43f9eeb4 req-7fffb5c7-1bf0-4972-8a0e-5ebbea7a3a2d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:34.766629 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-76816405-add2-47ba-b09b-417b43f9eeb4 req-7fffb5c7-1bf0-4972-8a0e-5ebbea7a3a2d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:34.769907 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=75 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:34.784973 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-76816405-add2-47ba-b09b-417b43f9eeb4 req-7fffb5c7-1bf0-4972-8a0e-5ebbea7a3a2d service nova] Creating event network-vif-deleted:9b66f8d2-f239-4a78-bc46-c10dfec48440 for instance ad3fa1b5-beaa-4d13-8e05-134864e27ab7 on n-h1-master-1 Oct 23 02:17:34.786828 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-76816405-add2-47ba-b09b-417b43f9eeb4 req-7fffb5c7-1bf0-4972-8a0e-5ebbea7a3a2d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043544 Oct 23 02:17:34.787521 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3904/7715] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:17:34.875390 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f14f981e-d5ab-4b7c-9c25-351874a9df93 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:34.876102 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f14f981e-d5ab-4b7c-9c25-351874a9df93 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] [instance: ad3fa1b5-beaa-4d13-8e05-134864e27ab7] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:34.883499 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f14f981e-d5ab-4b7c-9c25-351874a9df93 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:34.884903 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f14f981e-d5ab-4b7c-9c25-351874a9df93 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:34.884903 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f14f981e-d5ab-4b7c-9c25-351874a9df93 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:34.885259 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f14f981e-d5ab-4b7c-9c25-351874a9df93 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:34.885769 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f14f981e-d5ab-4b7c-9c25-351874a9df93 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:34.886418 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f14f981e-d5ab-4b7c-9c25-351874a9df93 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:34.891779 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:34.952156 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f14f981e-d5ab-4b7c-9c25-351874a9df93 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040db1cb2f524d67a9344884d8e2fdbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c3d346c6c043c7b725f6c8c6bfc559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:34.960516 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f14f981e-d5ab-4b7c-9c25-351874a9df93 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fa1b5-beaa-4d13-8e05-134864e27ab7" status: 200 len: 1469 microversion: 2.1 time: 0.089584 Oct 23 02:17:34.961103 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3812/7716] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:34 2022] GET /compute/v2.1/servers/ad3fa1b5-beaa-4d13-8e05-134864e27ab7 => generated 1469 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:35.985393 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e65e1abd-8a1e-405c-a785-8b7739426645 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:35.986111 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e65e1abd-8a1e-405c-a785-8b7739426645 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] [instance: ad3fa1b5-beaa-4d13-8e05-134864e27ab7] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:35.993268 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e65e1abd-8a1e-405c-a785-8b7739426645 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:35.993748 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e65e1abd-8a1e-405c-a785-8b7739426645 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:35.994214 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e65e1abd-8a1e-405c-a785-8b7739426645 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:35.994888 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e65e1abd-8a1e-405c-a785-8b7739426645 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:35.995338 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e65e1abd-8a1e-405c-a785-8b7739426645 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:35.995762 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e65e1abd-8a1e-405c-a785-8b7739426645 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:36.011962 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-e65e1abd-8a1e-405c-a785-8b7739426645 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] HTTP exception thrown: Instance ad3fa1b5-beaa-4d13-8e05-134864e27ab7 could not be found. Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e65e1abd-8a1e-405c-a785-8b7739426645 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Request method failure captured: Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/ad3fa1b5-beaa-4d13-8e05-134864e27ab7 HTTP/1.1 Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVKQfEGhH81Uo8k_BbGz8ij4TIheoi-9mM4IkUOfnZXD5B333b67xIJI-9py9x3tZmcxaLAYI3bXBlQf9-t2XGpvNqw9DeKnCRZe-iE_mCLd3_a9FBY8u6M5vfaHgr1Li1MFuVF5MzF_7nx4E-qM1L5VFySnsJeVqHfygFqJCUhZwC-A Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 91c3d346c6c043c7b725f6c8c6bfc559 Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersNegativeTestJSON-754001486 Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/91c3d346c6c043c7b725f6c8c6bfc559"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_91c3d346c6c043c7b725f6c8c6bfc559"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/91c3d346c6c043c7b725f6c8c6bfc559"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/91c3d346c6c043c7b725f6c8c6bfc559"}]}] Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersNegativeTestJSON-754001486 Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 91c3d346c6c043c7b725f6c8c6bfc559 Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersNegativeTestJSON-754001486 Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersNegativeTestJSON-754001486-project Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 040db1cb2f524d67a9344884d8e2fdbb Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersNegativeTestJSON-754001486-project Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: exception: Instance ad3fa1b5-beaa-4d13-8e05-134864e27ab7 could not be found. Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'ad3fa1b5-beaa-4d13-8e05-134864e27ab7'} Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad3fa1b5-beaa-4d13-8e05-134864e27ab7 could not be found. Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad3fa1b5-beaa-4d13-8e05-134864e27ab7 could not be found. Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:17:36.013638 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:17:36.020317 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:17:36.020317 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:17:36.020317 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:17:36.020317 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:17:36.020317 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:17:36.020317 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad3fa1b5-beaa-4d13-8e05-134864e27ab7 could not be found. Oct 23 02:17:36.020317 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:17:36.020317 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e65e1abd-8a1e-405c-a785-8b7739426645 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Returning 404 to user: Instance ad3fa1b5-beaa-4d13-8e05-134864e27ab7 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:17:36.020317 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e65e1abd-8a1e-405c-a785-8b7739426645 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fa1b5-beaa-4d13-8e05-134864e27ab7" status: 404 len: 111 microversion: 2.1 time: 0.034897 Oct 23 02:17:36.020317 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3905/7717] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:35 2022] GET /compute/v2.1/servers/ad3fa1b5-beaa-4d13-8e05-134864e27ab7 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:17:36.025063 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-93bb830a-f832-4665-8323-995521dd4727 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:36.025720 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-93bb830a-f832-4665-8323-995521dd4727 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] [instance: 225c1e5b-3356-422e-a56f-36fb66eae5cc] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:36.034115 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-93bb830a-f832-4665-8323-995521dd4727 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:36.034619 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-93bb830a-f832-4665-8323-995521dd4727 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:36.035075 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-93bb830a-f832-4665-8323-995521dd4727 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:36.035780 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-93bb830a-f832-4665-8323-995521dd4727 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:36.036288 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-93bb830a-f832-4665-8323-995521dd4727 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:36.036750 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-93bb830a-f832-4665-8323-995521dd4727 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:36.163527 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-93bb830a-f832-4665-8323-995521dd4727 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040db1cb2f524d67a9344884d8e2fdbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c3d346c6c043c7b725f6c8c6bfc559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:36.171274 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-93bb830a-f832-4665-8323-995521dd4727 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] 10.222.0.42 "GET /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc" status: 200 len: 1506 microversion: 2.1 time: 0.150255 Oct 23 02:17:36.171847 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3813/7718] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:36 2022] GET /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:36.194400 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-aad20289-9e30-4400-8eed-331383a41217 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:17:36.196619 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-aad20289-9e30-4400-8eed-331383a41217 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] [instance: b98f9ad4-1c31-4d7d-8275-9ee5c1752415] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:36.202248 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-aad20289-9e30-4400-8eed-331383a41217 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] HTTP exception thrown: Instance b98f9ad4-1c31-4d7d-8275-9ee5c1752415 could not be found. Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-aad20289-9e30-4400-8eed-331383a41217 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Request method failure captured: Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/servers/b98f9ad4-1c31-4d7d-8275-9ee5c1752415/action HTTP/1.1 Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 32 Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVKQfEGhH81Uo8k_BbGz8ij4TIheoi-9mM4IkUOfnZXD5B333b67xIJI-9py9x3tZmcxaLAYI3bXBlQf9-t2XGpvNqw9DeKnCRZe-iE_mCLd3_a9FBY8u6M5vfaHgr1Li1MFuVF5MzF_7nx4E-qM1L5VFySnsJeVqHfygFqJCUhZwC-A Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 91c3d346c6c043c7b725f6c8c6bfc559 Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersNegativeTestJSON-754001486 Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/91c3d346c6c043c7b725f6c8c6bfc559"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_91c3d346c6c043c7b725f6c8c6bfc559"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/91c3d346c6c043c7b725f6c8c6bfc559"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/91c3d346c6c043c7b725f6c8c6bfc559"}]}] Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersNegativeTestJSON-754001486 Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 91c3d346c6c043c7b725f6c8c6bfc559 Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersNegativeTestJSON-754001486 Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersNegativeTestJSON-754001486-project Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 040db1cb2f524d67a9344884d8e2fdbb Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersNegativeTestJSON-754001486-project Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: {"resize": {"flavorRef": "452"}} Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: exception: Instance b98f9ad4-1c31-4d7d-8275-9ee5c1752415 could not be found. Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'b98f9ad4-1c31-4d7d-8275-9ee5c1752415', 'body': {'resize': {'flavorRef': '452'}}} Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b98f9ad4-1c31-4d7d-8275-9ee5c1752415 could not be found. Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:17:36.204448 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:17:36.209575 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b98f9ad4-1c31-4d7d-8275-9ee5c1752415 could not be found. Oct 23 02:17:36.209575 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:17:36.209575 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:17:36.209575 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:17:36.209575 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:17:36.209575 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:17:36.209575 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:17:36.209575 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:17:36.209575 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:17:36.209575 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b98f9ad4-1c31-4d7d-8275-9ee5c1752415 could not be found. Oct 23 02:17:36.209575 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:17:36.209575 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-aad20289-9e30-4400-8eed-331383a41217 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Returning 404 to user: Instance b98f9ad4-1c31-4d7d-8275-9ee5c1752415 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:17:36.209575 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-aad20289-9e30-4400-8eed-331383a41217 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] 10.222.0.42 "POST /compute/v2.1/servers/b98f9ad4-1c31-4d7d-8275-9ee5c1752415/action" status: 404 len: 111 microversion: 2.1 time: 0.015771 Oct 23 02:17:36.209575 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3906/7719] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:17:36 2022] POST /compute/v2.1/servers/b98f9ad4-1c31-4d7d-8275-9ee5c1752415/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:17:36.217111 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f35c295e-5c6c-42b5-8894-a55a6ddb1937 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:36.217745 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f35c295e-5c6c-42b5-8894-a55a6ddb1937 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] [instance: 225c1e5b-3356-422e-a56f-36fb66eae5cc] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:36.224285 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f35c295e-5c6c-42b5-8894-a55a6ddb1937 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:36.227274 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f35c295e-5c6c-42b5-8894-a55a6ddb1937 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:36.227274 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f35c295e-5c6c-42b5-8894-a55a6ddb1937 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:36.227274 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f35c295e-5c6c-42b5-8894-a55a6ddb1937 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:36.227274 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f35c295e-5c6c-42b5-8894-a55a6ddb1937 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:36.227274 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f35c295e-5c6c-42b5-8894-a55a6ddb1937 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:36.362277 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f35c295e-5c6c-42b5-8894-a55a6ddb1937 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040db1cb2f524d67a9344884d8e2fdbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c3d346c6c043c7b725f6c8c6bfc559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:36.369907 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f35c295e-5c6c-42b5-8894-a55a6ddb1937 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] 10.222.0.42 "GET /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc" status: 200 len: 1506 microversion: 2.1 time: 0.156961 Oct 23 02:17:36.370525 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3814/7720] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:36 2022] GET /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:36.392666 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-38c0cf23-1961-4079-8f8c-a0daefda9716 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:36.393285 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-38c0cf23-1961-4079-8f8c-a0daefda9716 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] [instance: 225c1e5b-3356-422e-a56f-36fb66eae5cc] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:36.400178 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-38c0cf23-1961-4079-8f8c-a0daefda9716 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:36.400670 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-38c0cf23-1961-4079-8f8c-a0daefda9716 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:36.401113 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-38c0cf23-1961-4079-8f8c-a0daefda9716 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:36.401804 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-38c0cf23-1961-4079-8f8c-a0daefda9716 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:36.402304 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-38c0cf23-1961-4079-8f8c-a0daefda9716 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:36.402736 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-38c0cf23-1961-4079-8f8c-a0daefda9716 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:36.530727 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-38c0cf23-1961-4079-8f8c-a0daefda9716 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040db1cb2f524d67a9344884d8e2fdbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c3d346c6c043c7b725f6c8c6bfc559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:36.539159 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-38c0cf23-1961-4079-8f8c-a0daefda9716 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] 10.222.0.42 "GET /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc" status: 200 len: 1506 microversion: 2.1 time: 0.150326 Oct 23 02:17:36.539745 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3907/7721] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:36 2022] GET /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:36.562407 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-dcafacdd-6b5a-49a8-8189-70acfd1326e5 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "b4668e3c-25e0-4e55-a098-9fe007d81d1a"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:17:36.564582 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-dcafacdd-6b5a-49a8-8189-70acfd1326e5 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] [instance: 225c1e5b-3356-422e-a56f-36fb66eae5cc] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:36.570444 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dcafacdd-6b5a-49a8-8189-70acfd1326e5 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:36.570940 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dcafacdd-6b5a-49a8-8189-70acfd1326e5 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:36.571393 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dcafacdd-6b5a-49a8-8189-70acfd1326e5 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:36.572091 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dcafacdd-6b5a-49a8-8189-70acfd1326e5 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:36.572561 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dcafacdd-6b5a-49a8-8189-70acfd1326e5 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:36.572998 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dcafacdd-6b5a-49a8-8189-70acfd1326e5 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:36.682950 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-dcafacdd-6b5a-49a8-8189-70acfd1326e5 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '040db1cb2f524d67a9344884d8e2fdbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c3d346c6c043c7b725f6c8c6bfc559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:36.688594 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-dcafacdd-6b5a-49a8-8189-70acfd1326e5 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] HTTP exception thrown: Flavor b4668e3c-25e0-4e55-a098-9fe007d81d1a could not be found. Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-dcafacdd-6b5a-49a8-8189-70acfd1326e5 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Request method failure captured: Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: request: POST /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc/action HTTP/1.1 Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 65 Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVKQfEGhH81Uo8k_BbGz8ij4TIheoi-9mM4IkUOfnZXD5B333b67xIJI-9py9x3tZmcxaLAYI3bXBlQf9-t2XGpvNqw9DeKnCRZe-iE_mCLd3_a9FBY8u6M5vfaHgr1Li1MFuVF5MzF_7nx4E-qM1L5VFySnsJeVqHfygFqJCUhZwC-A Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 91c3d346c6c043c7b725f6c8c6bfc559 Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServersNegativeTestJSON-754001486 Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/91c3d346c6c043c7b725f6c8c6bfc559"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_91c3d346c6c043c7b725f6c8c6bfc559"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/91c3d346c6c043c7b725f6c8c6bfc559"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/91c3d346c6c043c7b725f6c8c6bfc559"}]}] Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServersNegativeTestJSON-754001486 Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 91c3d346c6c043c7b725f6c8c6bfc559 Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServersNegativeTestJSON-754001486 Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServersNegativeTestJSON-754001486-project Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 040db1cb2f524d67a9344884d8e2fdbb Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServersNegativeTestJSON-754001486-project Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: {"resize": {"flavorRef": "b4668e3c-25e0-4e55-a098-9fe007d81d1a"}} Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: exception: Flavor b4668e3c-25e0-4e55-a098-9fe007d81d1a could not be found. Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '225c1e5b-3356-422e-a56f-36fb66eae5cc', 'body': {'resize': {'flavorRef': 'b4668e3c-25e0-4e55-a098-9fe007d81d1a'}}} Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:17:36.690549 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 23 02:17:36.695333 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 23 02:17:36.695333 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor b4668e3c-25e0-4e55-a098-9fe007d81d1a could not be found. Oct 23 02:17:36.695333 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:17:36.695333 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:17:36.695333 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:17:36.695333 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:17:36.695333 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:17:36.695333 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:17:36.695333 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:17:36.695333 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:17:36.695333 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:17:36.695333 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:17:36.695333 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 02:17:36.695333 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 02:17:36.695333 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 23 02:17:36.695333 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 23 02:17:36.695333 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 23 02:17:36.695333 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 23 02:17:36.695333 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor b4668e3c-25e0-4e55-a098-9fe007d81d1a could not be found. Oct 23 02:17:36.695333 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:17:36.695333 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:17:36.695333 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:17:36.695333 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:17:36.695333 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:17:36.695333 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:17:36.695333 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:17:36.695333 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:17:36.695333 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor b4668e3c-25e0-4e55-a098-9fe007d81d1a could not be found. Oct 23 02:17:36.695333 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:17:36.695333 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-dcafacdd-6b5a-49a8-8189-70acfd1326e5 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Returning 400 to user: Flavor b4668e3c-25e0-4e55-a098-9fe007d81d1a could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:17:36.695333 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-dcafacdd-6b5a-49a8-8189-70acfd1326e5 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] 10.222.0.42 "POST /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc/action" status: 400 len: 107 microversion: 2.1 time: 0.133571 Oct 23 02:17:36.695333 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3815/7722] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:17:36 2022] POST /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc/action => generated 107 bytes in 135 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 02:17:36.700696 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1ea32310-0719-4c80-a1bc-119e1340fa03 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:36.701314 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1ea32310-0719-4c80-a1bc-119e1340fa03 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] [instance: 225c1e5b-3356-422e-a56f-36fb66eae5cc] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:36.707799 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1ea32310-0719-4c80-a1bc-119e1340fa03 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:36.708284 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1ea32310-0719-4c80-a1bc-119e1340fa03 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:36.708721 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1ea32310-0719-4c80-a1bc-119e1340fa03 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:36.709411 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1ea32310-0719-4c80-a1bc-119e1340fa03 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:36.709878 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1ea32310-0719-4c80-a1bc-119e1340fa03 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:36.710336 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1ea32310-0719-4c80-a1bc-119e1340fa03 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:36.836225 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1ea32310-0719-4c80-a1bc-119e1340fa03 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040db1cb2f524d67a9344884d8e2fdbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c3d346c6c043c7b725f6c8c6bfc559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:36.844782 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1ea32310-0719-4c80-a1bc-119e1340fa03 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] 10.222.0.42 "GET /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc" status: 200 len: 1506 microversion: 2.1 time: 0.147253 Oct 23 02:17:36.845350 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3908/7723] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:36 2022] GET /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc => generated 1506 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:17:36.867694 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cb55db01-0822-4687-a23c-91676fdf9771 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:36.868315 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cb55db01-0822-4687-a23c-91676fdf9771 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] [instance: 225c1e5b-3356-422e-a56f-36fb66eae5cc] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:36.874323 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb55db01-0822-4687-a23c-91676fdf9771 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:36.874816 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb55db01-0822-4687-a23c-91676fdf9771 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:36.875260 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb55db01-0822-4687-a23c-91676fdf9771 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:36.875946 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb55db01-0822-4687-a23c-91676fdf9771 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:36.876408 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb55db01-0822-4687-a23c-91676fdf9771 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:36.876835 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb55db01-0822-4687-a23c-91676fdf9771 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:37.007118 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cb55db01-0822-4687-a23c-91676fdf9771 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040db1cb2f524d67a9344884d8e2fdbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c3d346c6c043c7b725f6c8c6bfc559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:37.015010 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cb55db01-0822-4687-a23c-91676fdf9771 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] 10.222.0.42 "GET /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc" status: 200 len: 1506 microversion: 2.1 time: 0.151259 Oct 23 02:17:37.015581 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3816/7724] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:36 2022] GET /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:37.037680 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-38f35182-7a9c-45f5-931d-4a58e42f9a64 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-38f35182-7a9c-45f5-931d-4a58e42f9a64 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Request method failure captured: Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: request: POST /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc/action HTTP/1.1 Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 29 Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVKQfEGhH81Uo8k_BbGz8ij4TIheoi-9mM4IkUOfnZXD5B333b67xIJI-9py9x3tZmcxaLAYI3bXBlQf9-t2XGpvNqw9DeKnCRZe-iE_mCLd3_a9FBY8u6M5vfaHgr1Li1MFuVF5MzF_7nx4E-qM1L5VFySnsJeVqHfygFqJCUhZwC-A Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 91c3d346c6c043c7b725f6c8c6bfc559 Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersNegativeTestJSON-754001486 Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/91c3d346c6c043c7b725f6c8c6bfc559"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_91c3d346c6c043c7b725f6c8c6bfc559"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/91c3d346c6c043c7b725f6c8c6bfc559"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/91c3d346c6c043c7b725f6c8c6bfc559"}]}] Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersNegativeTestJSON-754001486 Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 91c3d346c6c043c7b725f6c8c6bfc559 Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersNegativeTestJSON-754001486 Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersNegativeTestJSON-754001486-project Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 040db1cb2f524d67a9344884d8e2fdbb Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersNegativeTestJSON-754001486-project Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: {"resize": {"flavorRef": ""}} Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '225c1e5b-3356-422e-a56f-36fb66eae5cc', 'body': {'resize': {'flavorRef': ''}}} Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise error Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi '' Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:17:37.041280 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:17:37.045825 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:17:37.045825 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:17:37.045825 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:17:37.045825 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:17:37.045825 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 23 02:17:37.045825 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 23 02:17:37.045825 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 23 02:17:37.045825 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:17:37.045825 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-38f35182-7a9c-45f5-931d-4a58e42f9a64 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:17:37.045825 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-38f35182-7a9c-45f5-931d-4a58e42f9a64 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] 10.222.0.42 "POST /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc/action" status: 400 len: 113 microversion: 2.1 time: 0.008929 Oct 23 02:17:37.045825 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3909/7725] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:17:37 2022] POST /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 02:17:37.050682 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1df5776c-0736-488d-97bb-ac7f5eead6d5 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:37.051316 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1df5776c-0736-488d-97bb-ac7f5eead6d5 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] [instance: 225c1e5b-3356-422e-a56f-36fb66eae5cc] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:37.053957 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:37.058709 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1df5776c-0736-488d-97bb-ac7f5eead6d5 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:37.059211 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1df5776c-0736-488d-97bb-ac7f5eead6d5 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:37.059652 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1df5776c-0736-488d-97bb-ac7f5eead6d5 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:37.060354 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1df5776c-0736-488d-97bb-ac7f5eead6d5 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:37.060822 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1df5776c-0736-488d-97bb-ac7f5eead6d5 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:37.061260 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1df5776c-0736-488d-97bb-ac7f5eead6d5 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:37.188087 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1df5776c-0736-488d-97bb-ac7f5eead6d5 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040db1cb2f524d67a9344884d8e2fdbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c3d346c6c043c7b725f6c8c6bfc559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:37.195841 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1df5776c-0736-488d-97bb-ac7f5eead6d5 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] 10.222.0.42 "GET /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc" status: 200 len: 1506 microversion: 2.1 time: 0.148965 Oct 23 02:17:37.196415 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3817/7726] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:37 2022] GET /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc => generated 1506 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:37.223004 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-45ac9168-93d3-45b7-9738-1d8df3951d62 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:37.223505 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-45ac9168-93d3-45b7-9738-1d8df3951d62 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] [instance: ad3fa1b5-beaa-4d13-8e05-134864e27ab7] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:37.230516 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-45ac9168-93d3-45b7-9738-1d8df3951d62 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:37.231006 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-45ac9168-93d3-45b7-9738-1d8df3951d62 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:37.231449 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-45ac9168-93d3-45b7-9738-1d8df3951d62 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:37.232142 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-45ac9168-93d3-45b7-9738-1d8df3951d62 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:37.232604 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-45ac9168-93d3-45b7-9738-1d8df3951d62 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:37.233037 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-45ac9168-93d3-45b7-9738-1d8df3951d62 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:37.245957 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-45ac9168-93d3-45b7-9738-1d8df3951d62 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] HTTP exception thrown: Instance ad3fa1b5-beaa-4d13-8e05-134864e27ab7 could not be found. Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-45ac9168-93d3-45b7-9738-1d8df3951d62 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Request method failure captured: Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/servers/ad3fa1b5-beaa-4d13-8e05-134864e27ab7 HTTP/1.1 Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVKQfEGhH81Uo8k_BbGz8ij4TIheoi-9mM4IkUOfnZXD5B333b67xIJI-9py9x3tZmcxaLAYI3bXBlQf9-t2XGpvNqw9DeKnCRZe-iE_mCLd3_a9FBY8u6M5vfaHgr1Li1MFuVF5MzF_7nx4E-qM1L5VFySnsJeVqHfygFqJCUhZwC-A Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 91c3d346c6c043c7b725f6c8c6bfc559 Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersNegativeTestJSON-754001486 Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/91c3d346c6c043c7b725f6c8c6bfc559"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_91c3d346c6c043c7b725f6c8c6bfc559"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/91c3d346c6c043c7b725f6c8c6bfc559"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/91c3d346c6c043c7b725f6c8c6bfc559"}]}] Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersNegativeTestJSON-754001486 Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 91c3d346c6c043c7b725f6c8c6bfc559 Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersNegativeTestJSON-754001486 Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersNegativeTestJSON-754001486-project Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 040db1cb2f524d67a9344884d8e2fdbb Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersNegativeTestJSON-754001486-project Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: exception: Instance ad3fa1b5-beaa-4d13-8e05-134864e27ab7 could not be found. Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'ad3fa1b5-beaa-4d13-8e05-134864e27ab7'} Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad3fa1b5-beaa-4d13-8e05-134864e27ab7 could not be found. Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:17:37.247514 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:17:37.253018 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad3fa1b5-beaa-4d13-8e05-134864e27ab7 could not be found. Oct 23 02:17:37.253018 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:17:37.253018 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:17:37.253018 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:17:37.253018 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:17:37.253018 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:17:37.253018 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:17:37.253018 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:17:37.253018 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:17:37.253018 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad3fa1b5-beaa-4d13-8e05-134864e27ab7 could not be found. Oct 23 02:17:37.253018 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:17:37.253018 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-45ac9168-93d3-45b7-9738-1d8df3951d62 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Returning 404 to user: Instance ad3fa1b5-beaa-4d13-8e05-134864e27ab7 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:17:37.253018 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-45ac9168-93d3-45b7-9738-1d8df3951d62 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ad3fa1b5-beaa-4d13-8e05-134864e27ab7" status: 404 len: 111 microversion: 2.1 time: 0.030643 Oct 23 02:17:37.253018 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3910/7727] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 02:17:37 2022] DELETE /compute/v2.1/servers/ad3fa1b5-beaa-4d13-8e05-134864e27ab7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:17:37.258067 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-63430529-e7e3-4722-a5f2-c7c8b883bbbd tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:37.258699 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-63430529-e7e3-4722-a5f2-c7c8b883bbbd tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] [instance: ad3fa1b5-beaa-4d13-8e05-134864e27ab7] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:37.264540 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-63430529-e7e3-4722-a5f2-c7c8b883bbbd tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:37.265036 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-63430529-e7e3-4722-a5f2-c7c8b883bbbd tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:37.265482 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-63430529-e7e3-4722-a5f2-c7c8b883bbbd tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:37.266811 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-63430529-e7e3-4722-a5f2-c7c8b883bbbd tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:37.267321 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-63430529-e7e3-4722-a5f2-c7c8b883bbbd tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:37.267764 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-63430529-e7e3-4722-a5f2-c7c8b883bbbd tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:37.280824 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-63430529-e7e3-4722-a5f2-c7c8b883bbbd tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] HTTP exception thrown: Instance ad3fa1b5-beaa-4d13-8e05-134864e27ab7 could not be found. Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-63430529-e7e3-4722-a5f2-c7c8b883bbbd tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Request method failure captured: Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/ad3fa1b5-beaa-4d13-8e05-134864e27ab7 HTTP/1.1 Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVKQfEGhH81Uo8k_BbGz8ij4TIheoi-9mM4IkUOfnZXD5B333b67xIJI-9py9x3tZmcxaLAYI3bXBlQf9-t2XGpvNqw9DeKnCRZe-iE_mCLd3_a9FBY8u6M5vfaHgr1Li1MFuVF5MzF_7nx4E-qM1L5VFySnsJeVqHfygFqJCUhZwC-A Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 91c3d346c6c043c7b725f6c8c6bfc559 Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-ServersNegativeTestJSON-754001486 Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/91c3d346c6c043c7b725f6c8c6bfc559"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_91c3d346c6c043c7b725f6c8c6bfc559"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/91c3d346c6c043c7b725f6c8c6bfc559"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/91c3d346c6c043c7b725f6c8c6bfc559"}]}] Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-ServersNegativeTestJSON-754001486 Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 91c3d346c6c043c7b725f6c8c6bfc559 Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-ServersNegativeTestJSON-754001486 Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-ServersNegativeTestJSON-754001486-project Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 040db1cb2f524d67a9344884d8e2fdbb Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-ServersNegativeTestJSON-754001486-project Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: exception: Instance ad3fa1b5-beaa-4d13-8e05-134864e27ab7 could not be found. Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'ad3fa1b5-beaa-4d13-8e05-134864e27ab7'} Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad3fa1b5-beaa-4d13-8e05-134864e27ab7 could not be found. Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad3fa1b5-beaa-4d13-8e05-134864e27ab7 could not be found. Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:17:37.282412 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:17:37.287304 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:17:37.287304 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:17:37.287304 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:17:37.287304 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:17:37.287304 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:17:37.287304 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad3fa1b5-beaa-4d13-8e05-134864e27ab7 could not be found. Oct 23 02:17:37.287304 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:17:37.287304 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-63430529-e7e3-4722-a5f2-c7c8b883bbbd tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Returning 404 to user: Instance ad3fa1b5-beaa-4d13-8e05-134864e27ab7 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:17:37.287304 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-63430529-e7e3-4722-a5f2-c7c8b883bbbd tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] 10.222.0.42 "GET /compute/v2.1/servers/ad3fa1b5-beaa-4d13-8e05-134864e27ab7" status: 404 len: 111 microversion: 2.1 time: 0.029605 Oct 23 02:17:37.287304 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3818/7728] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:37 2022] GET /compute/v2.1/servers/ad3fa1b5-beaa-4d13-8e05-134864e27ab7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:17:37.292016 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0e7efa73-7343-4fed-a4fb-a36bb459dc40 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:37.292538 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0e7efa73-7343-4fed-a4fb-a36bb459dc40 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] [instance: 225c1e5b-3356-422e-a56f-36fb66eae5cc] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:37.298393 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0e7efa73-7343-4fed-a4fb-a36bb459dc40 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:37.298871 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0e7efa73-7343-4fed-a4fb-a36bb459dc40 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:37.299303 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0e7efa73-7343-4fed-a4fb-a36bb459dc40 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:37.299982 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0e7efa73-7343-4fed-a4fb-a36bb459dc40 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:37.300436 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0e7efa73-7343-4fed-a4fb-a36bb459dc40 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:37.300859 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0e7efa73-7343-4fed-a4fb-a36bb459dc40 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:37.325560 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0e7efa73-7343-4fed-a4fb-a36bb459dc40 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] [instance: 225c1e5b-3356-422e-a56f-36fb66eae5cc] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 02:17:37.564790 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0e7efa73-7343-4fed-a4fb-a36bb459dc40 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] 10.222.0.42 "DELETE /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc" status: 204 len: 0 microversion: 2.1 time: 0.276290 Oct 23 02:17:37.565394 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3911/7729] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 02:17:37 2022] DELETE /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 02:17:37.573494 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e07b1f0c-b94a-4080-8838-fe514a6c7c86 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:37.574139 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e07b1f0c-b94a-4080-8838-fe514a6c7c86 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] [instance: 225c1e5b-3356-422e-a56f-36fb66eae5cc] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:37.581064 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e07b1f0c-b94a-4080-8838-fe514a6c7c86 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:37.581673 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e07b1f0c-b94a-4080-8838-fe514a6c7c86 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:37.582606 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e07b1f0c-b94a-4080-8838-fe514a6c7c86 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:37.583164 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e07b1f0c-b94a-4080-8838-fe514a6c7c86 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:37.583670 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e07b1f0c-b94a-4080-8838-fe514a6c7c86 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:37.584189 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e07b1f0c-b94a-4080-8838-fe514a6c7c86 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:37.717351 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e07b1f0c-b94a-4080-8838-fe514a6c7c86 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040db1cb2f524d67a9344884d8e2fdbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c3d346c6c043c7b725f6c8c6bfc559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:37.725611 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e07b1f0c-b94a-4080-8838-fe514a6c7c86 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] 10.222.0.42 "GET /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc" status: 200 len: 1512 microversion: 2.1 time: 0.156095 Oct 23 02:17:37.726332 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3819/7730] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:37 2022] GET /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:38.752384 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7a51a787-951c-48d0-81b1-92f1d254dfa7 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:38.752384 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7a51a787-951c-48d0-81b1-92f1d254dfa7 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] [instance: 225c1e5b-3356-422e-a56f-36fb66eae5cc] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:38.757156 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7a51a787-951c-48d0-81b1-92f1d254dfa7 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:38.757634 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7a51a787-951c-48d0-81b1-92f1d254dfa7 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:38.758097 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7a51a787-951c-48d0-81b1-92f1d254dfa7 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:38.758782 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7a51a787-951c-48d0-81b1-92f1d254dfa7 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:38.759234 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7a51a787-951c-48d0-81b1-92f1d254dfa7 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:38.759655 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7a51a787-951c-48d0-81b1-92f1d254dfa7 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:38.888255 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7a51a787-951c-48d0-81b1-92f1d254dfa7 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040db1cb2f524d67a9344884d8e2fdbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c3d346c6c043c7b725f6c8c6bfc559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:38.896001 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7a51a787-951c-48d0-81b1-92f1d254dfa7 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] 10.222.0.42 "GET /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc" status: 200 len: 1512 microversion: 2.1 time: 0.151055 Oct 23 02:17:38.896569 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3912/7731] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:38 2022] GET /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:39.919426 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9d8c6203-610b-4dd6-a0e7-0d5ba5341624 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:39.919983 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9d8c6203-610b-4dd6-a0e7-0d5ba5341624 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] [instance: 225c1e5b-3356-422e-a56f-36fb66eae5cc] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:39.927332 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d8c6203-610b-4dd6-a0e7-0d5ba5341624 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:39.927859 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d8c6203-610b-4dd6-a0e7-0d5ba5341624 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:39.928307 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d8c6203-610b-4dd6-a0e7-0d5ba5341624 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:39.929036 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d8c6203-610b-4dd6-a0e7-0d5ba5341624 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:39.929490 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d8c6203-610b-4dd6-a0e7-0d5ba5341624 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:39.929925 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d8c6203-610b-4dd6-a0e7-0d5ba5341624 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:39.994749 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9d8c6203-610b-4dd6-a0e7-0d5ba5341624 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040db1cb2f524d67a9344884d8e2fdbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c3d346c6c043c7b725f6c8c6bfc559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:40.004044 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9d8c6203-610b-4dd6-a0e7-0d5ba5341624 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] 10.222.0.42 "GET /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc" status: 200 len: 1470 microversion: 2.1 time: 0.088550 Oct 23 02:17:40.013423 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3820/7732] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:39 2022] GET /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc => generated 1470 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:40.020702 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-560c935b-9543-4b2d-924d-76e0d38e44a1 req-a620b07e-eb6b-4a50-9e5f-b63b1647235e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "225c1e5b-3356-422e-a56f-36fb66eae5cc", "name": "network-vif-deleted", "tag": "325191f3-b85c-47fa-8450-7271e8eaf3e9"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:17:40.031931 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-560c935b-9543-4b2d-924d-76e0d38e44a1 req-a620b07e-eb6b-4a50-9e5f-b63b1647235e service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:40.032669 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-560c935b-9543-4b2d-924d-76e0d38e44a1 req-a620b07e-eb6b-4a50-9e5f-b63b1647235e service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:40.033274 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-560c935b-9543-4b2d-924d-76e0d38e44a1 req-a620b07e-eb6b-4a50-9e5f-b63b1647235e service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:40.045289 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-560c935b-9543-4b2d-924d-76e0d38e44a1 req-a620b07e-eb6b-4a50-9e5f-b63b1647235e service nova] Creating event network-vif-deleted:325191f3-b85c-47fa-8450-7271e8eaf3e9 for instance 225c1e5b-3356-422e-a56f-36fb66eae5cc on n-h2-master-1 Oct 23 02:17:40.050673 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-560c935b-9543-4b2d-924d-76e0d38e44a1 req-a620b07e-eb6b-4a50-9e5f-b63b1647235e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035748 Oct 23 02:17:40.051510 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3913/7733] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:17:41.027264 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ef5b8c85-5f91-4034-ac59-5b7a9f6c9fbf tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:41.027893 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ef5b8c85-5f91-4034-ac59-5b7a9f6c9fbf tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] [instance: 225c1e5b-3356-422e-a56f-36fb66eae5cc] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:41.036187 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef5b8c85-5f91-4034-ac59-5b7a9f6c9fbf tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:41.036733 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef5b8c85-5f91-4034-ac59-5b7a9f6c9fbf tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:41.037183 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef5b8c85-5f91-4034-ac59-5b7a9f6c9fbf tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:41.037891 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef5b8c85-5f91-4034-ac59-5b7a9f6c9fbf tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:41.038392 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef5b8c85-5f91-4034-ac59-5b7a9f6c9fbf tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:41.038832 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef5b8c85-5f91-4034-ac59-5b7a9f6c9fbf tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:41.073824 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef5b8c85-5f91-4034-ac59-5b7a9f6c9fbf tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:41.074372 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef5b8c85-5f91-4034-ac59-5b7a9f6c9fbf tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:41.074824 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ef5b8c85-5f91-4034-ac59-5b7a9f6c9fbf tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:41.075296 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-ef5b8c85-5f91-4034-ac59-5b7a9f6c9fbf tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lazy-loading 'fault' on Instance uuid 225c1e5b-3356-422e-a56f-36fb66eae5cc {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:17:41.121813 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ef5b8c85-5f91-4034-ac59-5b7a9f6c9fbf tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040db1cb2f524d67a9344884d8e2fdbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c3d346c6c043c7b725f6c8c6bfc559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:41.129859 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ef5b8c85-5f91-4034-ac59-5b7a9f6c9fbf tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] 10.222.0.42 "GET /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc" status: 200 len: 1306 microversion: 2.1 time: 0.106415 Oct 23 02:17:41.130407 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3821/7734] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:41 2022] GET /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc => generated 1306 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:42.154149 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-978eb74f-a82f-44d3-b3e5-2f3e23a34520 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:42.154775 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-978eb74f-a82f-44d3-b3e5-2f3e23a34520 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] [instance: 225c1e5b-3356-422e-a56f-36fb66eae5cc] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:42.161041 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-978eb74f-a82f-44d3-b3e5-2f3e23a34520 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:42.161534 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-978eb74f-a82f-44d3-b3e5-2f3e23a34520 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:42.161998 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-978eb74f-a82f-44d3-b3e5-2f3e23a34520 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:42.162694 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-978eb74f-a82f-44d3-b3e5-2f3e23a34520 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:42.163158 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-978eb74f-a82f-44d3-b3e5-2f3e23a34520 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:42.163589 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-978eb74f-a82f-44d3-b3e5-2f3e23a34520 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:42.179624 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-978eb74f-a82f-44d3-b3e5-2f3e23a34520 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] HTTP exception thrown: Instance 225c1e5b-3356-422e-a56f-36fb66eae5cc could not be found. Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-978eb74f-a82f-44d3-b3e5-2f3e23a34520 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Request method failure captured: Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc HTTP/1.1 Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVKQfEGhH81Uo8k_BbGz8ij4TIheoi-9mM4IkUOfnZXD5B333b67xIJI-9py9x3tZmcxaLAYI3bXBlQf9-t2XGpvNqw9DeKnCRZe-iE_mCLd3_a9FBY8u6M5vfaHgr1Li1MFuVF5MzF_7nx4E-qM1L5VFySnsJeVqHfygFqJCUhZwC-A Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 91c3d346c6c043c7b725f6c8c6bfc559 Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-ServersNegativeTestJSON-754001486 Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/91c3d346c6c043c7b725f6c8c6bfc559"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_91c3d346c6c043c7b725f6c8c6bfc559"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/91c3d346c6c043c7b725f6c8c6bfc559"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/91c3d346c6c043c7b725f6c8c6bfc559"}]}] Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-ServersNegativeTestJSON-754001486 Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 91c3d346c6c043c7b725f6c8c6bfc559 Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-ServersNegativeTestJSON-754001486 Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-ServersNegativeTestJSON-754001486-project Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 040db1cb2f524d67a9344884d8e2fdbb Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-ServersNegativeTestJSON-754001486-project Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 225c1e5b-3356-422e-a56f-36fb66eae5cc could not be found. Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '225c1e5b-3356-422e-a56f-36fb66eae5cc'} Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 225c1e5b-3356-422e-a56f-36fb66eae5cc could not be found. Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 225c1e5b-3356-422e-a56f-36fb66eae5cc could not be found. Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:17:42.181237 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:17:42.185671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:17:42.185671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:17:42.185671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:17:42.185671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:17:42.185671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:17:42.185671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 225c1e5b-3356-422e-a56f-36fb66eae5cc could not be found. Oct 23 02:17:42.185671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:17:42.185671 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-978eb74f-a82f-44d3-b3e5-2f3e23a34520 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] Returning 404 to user: Instance 225c1e5b-3356-422e-a56f-36fb66eae5cc could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:17:42.185671 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-978eb74f-a82f-44d3-b3e5-2f3e23a34520 tempest-ServersNegativeTestJSON-754001486 tempest-ServersNegativeTestJSON-754001486-project] 10.222.0.42 "GET /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc" status: 404 len: 111 microversion: 2.1 time: 0.033852 Oct 23 02:17:42.185671 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3914/7735] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:42 2022] GET /compute/v2.1/servers/225c1e5b-3356-422e-a56f-36fb66eae5cc => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:18:25.337707 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=11 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:25.338497 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=55 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:25.339762 n-d-master-1 devstack@n-api.service[120945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 23 02:18:25.340033 n-d-master-1 devstack@n-api.service[120945]: Sun Oct 23 02:18:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.42) !!! Oct 23 02:18:25.515317 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-76461ff1-37cf-4425-8695-322bc1cab249 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Action: 'create', calling method: .version_select at 0x7f5cc035bd30>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1771815734", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1Te0X6e6ScNS+lV86zT1RB1aTZnIkOe9vwkVU5yOlgTAI9B9mCH3/thCGBKz8qjQypUW1fkBLNIBvwGqSKvjowRsqY0feGbV9eDIxA0SBx7zDGuSH680VeD75MO0mjtg=="}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:18:25.531114 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-76461ff1-37cf-4425-8695-322bc1cab249 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Getting quotas for project 6ed1446559e0468399a0e47775c47baa. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:18:25.536773 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-76461ff1-37cf-4425-8695-322bc1cab249 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Getting quotas for user c950bbf395604092937f0800037da97f and project 6ed1446559e0468399a0e47775c47baa. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:18:25.662364 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-76461ff1-37cf-4425-8695-322bc1cab249 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.329830 Oct 23 02:18:25.662931 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3822/7736] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 02:18:25 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:18:25.714711 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-912123a0-ef3a-46a8-8312-ba8b353567fc tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-912426289", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1771815734", "networks": [{"uuid": "7a446304-ebfa-4c4d-95f2-70414d327050"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:18:25.725026 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:25.726385 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:25.788352 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-912123a0-ef3a-46a8-8312-ba8b353567fc tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] validate_networks() for [('7a446304-ebfa-4c4d-95f2-70414d327050', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 02:18:26.223441 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-912123a0-ef3a-46a8-8312-ba8b353567fc tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:18:26.223872 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-912123a0-ef3a-46a8-8312-ba8b353567fc tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:18:26.224349 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-912123a0-ef3a-46a8-8312-ba8b353567fc tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:18:26.224762 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-912123a0-ef3a-46a8-8312-ba8b353567fc tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:18:26.225174 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-912123a0-ef3a-46a8-8312-ba8b353567fc tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:18:26.234951 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-912123a0-ef3a-46a8-8312-ba8b353567fc tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:26.237528 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-912123a0-ef3a-46a8-8312-ba8b353567fc tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:26.238748 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-912123a0-ef3a-46a8-8312-ba8b353567fc tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:26.239413 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-912123a0-ef3a-46a8-8312-ba8b353567fc tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:26.242264 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-912123a0-ef3a-46a8-8312-ba8b353567fc tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:26.242756 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-912123a0-ef3a-46a8-8312-ba8b353567fc tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:26.261911 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-912123a0-ef3a-46a8-8312-ba8b353567fc tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Getting quotas for project 6ed1446559e0468399a0e47775c47baa. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:18:26.268166 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-912123a0-ef3a-46a8-8312-ba8b353567fc tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Getting quotas for user c950bbf395604092937f0800037da97f and project 6ed1446559e0468399a0e47775c47baa. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:18:26.282117 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-912123a0-ef3a-46a8-8312-ba8b353567fc tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 02:18:26.284459 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-912123a0-ef3a-46a8-8312-ba8b353567fc tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 181f6ea9-b736-4dba-8f58-29c578246bd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 02:18:26.389418 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-912123a0-ef3a-46a8-8312-ba8b353567fc tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.678339 Oct 23 02:18:26.390114 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3915/7737] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 02:18:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 23 02:18:26.402607 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6f9f9722-4e85-43d9-a10d-0f0a4ff36c60 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:26.414290 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6f9f9722-4e85-43d9-a10d-0f0a4ff36c60 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 181f6ea9-b736-4dba-8f58-29c578246bd4] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:26.460841 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6f9f9722-4e85-43d9-a10d-0f0a4ff36c60 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950bbf395604092937f0800037da97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1446559e0468399a0e47775c47baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:26.472094 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6f9f9722-4e85-43d9-a10d-0f0a4ff36c60 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4" status: 200 len: 1262 microversion: 2.1 time: 0.074139 Oct 23 02:18:26.473472 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3823/7738] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:26 2022] GET /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4 => generated 1262 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:27.497716 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b165e318-8b59-4c6d-aed5-3973002e4dc2 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:27.498388 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b165e318-8b59-4c6d-aed5-3973002e4dc2 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 181f6ea9-b736-4dba-8f58-29c578246bd4] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:27.553479 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b165e318-8b59-4c6d-aed5-3973002e4dc2 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950bbf395604092937f0800037da97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1446559e0468399a0e47775c47baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:27.561560 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b165e318-8b59-4c6d-aed5-3973002e4dc2 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4" status: 200 len: 1262 microversion: 2.1 time: 0.068903 Oct 23 02:18:27.562156 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3916/7739] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:27 2022] GET /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4 => generated 1262 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:28.584754 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-25d96a03-69f9-4fcd-942e-8db1e9a857ec tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:28.585382 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-25d96a03-69f9-4fcd-942e-8db1e9a857ec tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 181f6ea9-b736-4dba-8f58-29c578246bd4] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:28.592514 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25d96a03-69f9-4fcd-942e-8db1e9a857ec tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:28.593014 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25d96a03-69f9-4fcd-942e-8db1e9a857ec tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:28.593464 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25d96a03-69f9-4fcd-942e-8db1e9a857ec tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:28.594192 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25d96a03-69f9-4fcd-942e-8db1e9a857ec tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:28.594660 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25d96a03-69f9-4fcd-942e-8db1e9a857ec tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:28.595097 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-25d96a03-69f9-4fcd-942e-8db1e9a857ec tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:28.658814 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-25d96a03-69f9-4fcd-942e-8db1e9a857ec tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950bbf395604092937f0800037da97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1446559e0468399a0e47775c47baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:28.666787 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-25d96a03-69f9-4fcd-942e-8db1e9a857ec tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4" status: 200 len: 1314 microversion: 2.1 time: 0.085930 Oct 23 02:18:28.667367 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3824/7740] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:28 2022] GET /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4 => generated 1314 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:29.693072 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-caab18b3-a70f-4ed3-9a93-13ad06f01fe5 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:29.693072 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-caab18b3-a70f-4ed3-9a93-13ad06f01fe5 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 181f6ea9-b736-4dba-8f58-29c578246bd4] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:29.699127 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-caab18b3-a70f-4ed3-9a93-13ad06f01fe5 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:29.699630 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-caab18b3-a70f-4ed3-9a93-13ad06f01fe5 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:29.700078 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-caab18b3-a70f-4ed3-9a93-13ad06f01fe5 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:29.700784 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-caab18b3-a70f-4ed3-9a93-13ad06f01fe5 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:29.701894 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-caab18b3-a70f-4ed3-9a93-13ad06f01fe5 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:29.702354 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-caab18b3-a70f-4ed3-9a93-13ad06f01fe5 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:29.767768 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-caab18b3-a70f-4ed3-9a93-13ad06f01fe5 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950bbf395604092937f0800037da97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1446559e0468399a0e47775c47baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:29.775633 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-caab18b3-a70f-4ed3-9a93-13ad06f01fe5 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4" status: 200 len: 1320 microversion: 2.1 time: 0.088042 Oct 23 02:18:29.776222 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3917/7741] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:29 2022] GET /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4 => generated 1320 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:30.799079 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-93740c5a-5850-4d94-b013-e71af1e865b8 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:30.799717 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-93740c5a-5850-4d94-b013-e71af1e865b8 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 181f6ea9-b736-4dba-8f58-29c578246bd4] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:30.806699 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-93740c5a-5850-4d94-b013-e71af1e865b8 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:30.807193 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-93740c5a-5850-4d94-b013-e71af1e865b8 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:30.807639 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-93740c5a-5850-4d94-b013-e71af1e865b8 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:30.808343 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-93740c5a-5850-4d94-b013-e71af1e865b8 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:30.808809 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-93740c5a-5850-4d94-b013-e71af1e865b8 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:30.809243 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-93740c5a-5850-4d94-b013-e71af1e865b8 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:30.892003 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-7d080289-9396-4e26-ae44-8f797748bba7 req-3259d0b7-baa5-4299-8cf0-8e001eabc295 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "181f6ea9-b736-4dba-8f58-29c578246bd4", "tag": "a5f0e875-0022-447c-aa64-2abe0a92a237"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:18:30.906431 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-7d080289-9396-4e26-ae44-8f797748bba7 req-3259d0b7-baa5-4299-8cf0-8e001eabc295 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:30.910861 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-7d080289-9396-4e26-ae44-8f797748bba7 req-3259d0b7-baa5-4299-8cf0-8e001eabc295 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:30.910861 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-7d080289-9396-4e26-ae44-8f797748bba7 req-3259d0b7-baa5-4299-8cf0-8e001eabc295 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:30.919974 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-7d080289-9396-4e26-ae44-8f797748bba7 req-3259d0b7-baa5-4299-8cf0-8e001eabc295 service nova] Creating event network-changed:a5f0e875-0022-447c-aa64-2abe0a92a237 for instance 181f6ea9-b736-4dba-8f58-29c578246bd4 on n-h1-master-1 Oct 23 02:18:30.925135 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-7d080289-9396-4e26-ae44-8f797748bba7 req-3259d0b7-baa5-4299-8cf0-8e001eabc295 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038746 Oct 23 02:18:30.925748 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3918/7742] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:18:30.945330 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-93740c5a-5850-4d94-b013-e71af1e865b8 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950bbf395604092937f0800037da97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1446559e0468399a0e47775c47baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:30.953769 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-93740c5a-5850-4d94-b013-e71af1e865b8 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4" status: 200 len: 1362 microversion: 2.1 time: 0.158621 Oct 23 02:18:30.954379 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3825/7743] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:30 2022] GET /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:31.978443 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1f2558d5-eff6-476d-96aa-03e5eca283e6 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:31.979277 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1f2558d5-eff6-476d-96aa-03e5eca283e6 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 181f6ea9-b736-4dba-8f58-29c578246bd4] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:31.986317 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f2558d5-eff6-476d-96aa-03e5eca283e6 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:31.986794 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f2558d5-eff6-476d-96aa-03e5eca283e6 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:31.987229 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f2558d5-eff6-476d-96aa-03e5eca283e6 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:31.987910 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f2558d5-eff6-476d-96aa-03e5eca283e6 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:31.988365 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f2558d5-eff6-476d-96aa-03e5eca283e6 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:31.988938 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f2558d5-eff6-476d-96aa-03e5eca283e6 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:32.117717 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1f2558d5-eff6-476d-96aa-03e5eca283e6 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950bbf395604092937f0800037da97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1446559e0468399a0e47775c47baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:32.126226 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1f2558d5-eff6-476d-96aa-03e5eca283e6 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4" status: 200 len: 1362 microversion: 2.1 time: 0.152109 Oct 23 02:18:32.126797 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3919/7744] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:31 2022] GET /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:33.148783 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-498a2e0a-bc57-45bf-85d7-74d162bf6c32 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:33.156721 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-498a2e0a-bc57-45bf-85d7-74d162bf6c32 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 181f6ea9-b736-4dba-8f58-29c578246bd4] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:33.156896 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-498a2e0a-bc57-45bf-85d7-74d162bf6c32 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:33.157334 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-498a2e0a-bc57-45bf-85d7-74d162bf6c32 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:33.157775 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-498a2e0a-bc57-45bf-85d7-74d162bf6c32 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:33.158496 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-498a2e0a-bc57-45bf-85d7-74d162bf6c32 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:33.158960 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-498a2e0a-bc57-45bf-85d7-74d162bf6c32 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:33.159393 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-498a2e0a-bc57-45bf-85d7-74d162bf6c32 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:33.289504 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-498a2e0a-bc57-45bf-85d7-74d162bf6c32 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950bbf395604092937f0800037da97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1446559e0468399a0e47775c47baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:33.297117 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-498a2e0a-bc57-45bf-85d7-74d162bf6c32 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4" status: 200 len: 1362 microversion: 2.1 time: 0.152314 Oct 23 02:18:33.297685 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3826/7745] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:33 2022] GET /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:34.319869 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-64972043-d009-4374-af50-303cc1b375f9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:34.320483 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-64972043-d009-4374-af50-303cc1b375f9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 181f6ea9-b736-4dba-8f58-29c578246bd4] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:34.327952 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-64972043-d009-4374-af50-303cc1b375f9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:34.328442 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-64972043-d009-4374-af50-303cc1b375f9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:34.328916 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-64972043-d009-4374-af50-303cc1b375f9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:34.329661 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-64972043-d009-4374-af50-303cc1b375f9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:34.330157 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-64972043-d009-4374-af50-303cc1b375f9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:34.330592 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-64972043-d009-4374-af50-303cc1b375f9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:34.459648 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-64972043-d009-4374-af50-303cc1b375f9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950bbf395604092937f0800037da97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1446559e0468399a0e47775c47baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:34.467723 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-64972043-d009-4374-af50-303cc1b375f9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4" status: 200 len: 1362 microversion: 2.1 time: 0.151747 Oct 23 02:18:34.468340 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3920/7746] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:34 2022] GET /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:35.491222 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-27d5580c-4bec-41f4-a1f4-be3df3efc72d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:35.491849 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-27d5580c-4bec-41f4-a1f4-be3df3efc72d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 181f6ea9-b736-4dba-8f58-29c578246bd4] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:35.498763 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-27d5580c-4bec-41f4-a1f4-be3df3efc72d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:35.499198 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-27d5580c-4bec-41f4-a1f4-be3df3efc72d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:35.499637 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-27d5580c-4bec-41f4-a1f4-be3df3efc72d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:35.500331 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-27d5580c-4bec-41f4-a1f4-be3df3efc72d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:35.500792 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-27d5580c-4bec-41f4-a1f4-be3df3efc72d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:35.501227 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-27d5580c-4bec-41f4-a1f4-be3df3efc72d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:35.631567 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-27d5580c-4bec-41f4-a1f4-be3df3efc72d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950bbf395604092937f0800037da97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1446559e0468399a0e47775c47baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:35.639362 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-27d5580c-4bec-41f4-a1f4-be3df3efc72d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4" status: 200 len: 1362 microversion: 2.1 time: 0.152032 Oct 23 02:18:35.639932 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3827/7747] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:35 2022] GET /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:36.662188 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ad91536c-d8c3-4406-85ab-ad4ace49d954 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:36.662816 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ad91536c-d8c3-4406-85ab-ad4ace49d954 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 181f6ea9-b736-4dba-8f58-29c578246bd4] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:36.665614 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:36.670535 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ad91536c-d8c3-4406-85ab-ad4ace49d954 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:36.671033 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ad91536c-d8c3-4406-85ab-ad4ace49d954 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:36.671476 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ad91536c-d8c3-4406-85ab-ad4ace49d954 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:36.672178 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ad91536c-d8c3-4406-85ab-ad4ace49d954 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:36.672640 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ad91536c-d8c3-4406-85ab-ad4ace49d954 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:36.673075 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ad91536c-d8c3-4406-85ab-ad4ace49d954 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:36.803030 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ad91536c-d8c3-4406-85ab-ad4ace49d954 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950bbf395604092937f0800037da97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1446559e0468399a0e47775c47baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:36.810889 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ad91536c-d8c3-4406-85ab-ad4ace49d954 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4" status: 200 len: 1362 microversion: 2.1 time: 0.152638 Oct 23 02:18:36.811468 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3921/7748] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:36 2022] GET /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:37.834552 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-114f3fa2-e58e-4351-82bf-5e02ce0b8125 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:37.835082 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-114f3fa2-e58e-4351-82bf-5e02ce0b8125 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 181f6ea9-b736-4dba-8f58-29c578246bd4] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:37.837021 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=6 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:37.843348 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-114f3fa2-e58e-4351-82bf-5e02ce0b8125 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:37.847956 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-114f3fa2-e58e-4351-82bf-5e02ce0b8125 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:37.847956 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-114f3fa2-e58e-4351-82bf-5e02ce0b8125 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:37.847956 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-114f3fa2-e58e-4351-82bf-5e02ce0b8125 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:37.847956 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-114f3fa2-e58e-4351-82bf-5e02ce0b8125 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:37.847956 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-114f3fa2-e58e-4351-82bf-5e02ce0b8125 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:37.975767 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-114f3fa2-e58e-4351-82bf-5e02ce0b8125 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950bbf395604092937f0800037da97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1446559e0468399a0e47775c47baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:37.984066 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-114f3fa2-e58e-4351-82bf-5e02ce0b8125 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4" status: 200 len: 1362 microversion: 2.1 time: 0.153479 Oct 23 02:18:37.984663 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3828/7749] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:37 2022] GET /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:38.224839 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-5b39ab89-c435-4855-9886-4a904aad7fe7 req-5d027a40-15cf-4a29-8d6b-ecc443c8d0eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "181f6ea9-b736-4dba-8f58-29c578246bd4", "name": "network-vif-plugged", "status": "completed", "tag": "a5f0e875-0022-447c-aa64-2abe0a92a237"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:18:38.229765 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=8 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:38.235844 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-5b39ab89-c435-4855-9886-4a904aad7fe7 req-5d027a40-15cf-4a29-8d6b-ecc443c8d0eb service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:38.236328 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-5b39ab89-c435-4855-9886-4a904aad7fe7 req-5d027a40-15cf-4a29-8d6b-ecc443c8d0eb service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:38.236776 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-5b39ab89-c435-4855-9886-4a904aad7fe7 req-5d027a40-15cf-4a29-8d6b-ecc443c8d0eb service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:38.250312 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-5b39ab89-c435-4855-9886-4a904aad7fe7 req-5d027a40-15cf-4a29-8d6b-ecc443c8d0eb service nova] Creating event network-vif-plugged:a5f0e875-0022-447c-aa64-2abe0a92a237 for instance 181f6ea9-b736-4dba-8f58-29c578246bd4 on n-h1-master-1 Oct 23 02:18:38.255329 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-5b39ab89-c435-4855-9886-4a904aad7fe7 req-5d027a40-15cf-4a29-8d6b-ecc443c8d0eb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034365 Oct 23 02:18:38.255933 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3922/7750] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:18:39.006722 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-eefac812-2b1c-4632-823c-ee45ee2c11a1 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:39.007366 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-eefac812-2b1c-4632-823c-ee45ee2c11a1 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 181f6ea9-b736-4dba-8f58-29c578246bd4] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:39.014182 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eefac812-2b1c-4632-823c-ee45ee2c11a1 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:39.014674 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eefac812-2b1c-4632-823c-ee45ee2c11a1 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:39.015122 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eefac812-2b1c-4632-823c-ee45ee2c11a1 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:39.015813 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eefac812-2b1c-4632-823c-ee45ee2c11a1 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:39.016277 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eefac812-2b1c-4632-823c-ee45ee2c11a1 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:39.016710 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eefac812-2b1c-4632-823c-ee45ee2c11a1 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:39.146502 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-eefac812-2b1c-4632-823c-ee45ee2c11a1 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950bbf395604092937f0800037da97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1446559e0468399a0e47775c47baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:39.154175 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-eefac812-2b1c-4632-823c-ee45ee2c11a1 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4" status: 200 len: 1362 microversion: 2.1 time: 0.151410 Oct 23 02:18:39.156728 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3829/7751] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:39 2022] GET /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:40.180408 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-09628330-fcce-43df-9c66-1e55a1e7e7cb tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:40.181117 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-09628330-fcce-43df-9c66-1e55a1e7e7cb tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 181f6ea9-b736-4dba-8f58-29c578246bd4] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:40.187979 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-09628330-fcce-43df-9c66-1e55a1e7e7cb tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:40.188468 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-09628330-fcce-43df-9c66-1e55a1e7e7cb tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:40.188909 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-09628330-fcce-43df-9c66-1e55a1e7e7cb tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:40.189595 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-09628330-fcce-43df-9c66-1e55a1e7e7cb tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:40.190149 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-09628330-fcce-43df-9c66-1e55a1e7e7cb tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:40.190581 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-09628330-fcce-43df-9c66-1e55a1e7e7cb tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:40.317663 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-09628330-fcce-43df-9c66-1e55a1e7e7cb tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950bbf395604092937f0800037da97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1446559e0468399a0e47775c47baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:40.325454 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-09628330-fcce-43df-9c66-1e55a1e7e7cb tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4" status: 200 len: 1553 microversion: 2.1 time: 0.150538 Oct 23 02:18:40.326676 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3923/7752] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:40 2022] GET /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4 => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:40.348516 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0118e5ee-d697-48f9-8284-6d543ce3cb2c tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:40.349257 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0118e5ee-d697-48f9-8284-6d543ce3cb2c tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 181f6ea9-b736-4dba-8f58-29c578246bd4] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:40.356083 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0118e5ee-d697-48f9-8284-6d543ce3cb2c tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:40.356522 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0118e5ee-d697-48f9-8284-6d543ce3cb2c tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:40.357464 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0118e5ee-d697-48f9-8284-6d543ce3cb2c tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:40.358404 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0118e5ee-d697-48f9-8284-6d543ce3cb2c tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:40.358876 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0118e5ee-d697-48f9-8284-6d543ce3cb2c tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:40.359317 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0118e5ee-d697-48f9-8284-6d543ce3cb2c tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:40.489549 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0118e5ee-d697-48f9-8284-6d543ce3cb2c tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950bbf395604092937f0800037da97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1446559e0468399a0e47775c47baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:40.497295 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0118e5ee-d697-48f9-8284-6d543ce3cb2c tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4" status: 200 len: 1553 microversion: 2.1 time: 0.152727 Oct 23 02:18:40.498545 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3830/7753] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:40 2022] GET /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:43.579221 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7c506fad-4902-4a56-97af-ab953814ec31 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed938bef-f657-4818-b412-58043510ab0e"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:18:43.581568 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7c506fad-4902-4a56-97af-ab953814ec31 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 181f6ea9-b736-4dba-8f58-29c578246bd4] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:43.588598 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c506fad-4902-4a56-97af-ab953814ec31 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:43.589085 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c506fad-4902-4a56-97af-ab953814ec31 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:43.589534 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c506fad-4902-4a56-97af-ab953814ec31 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:43.590250 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c506fad-4902-4a56-97af-ab953814ec31 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:43.590714 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c506fad-4902-4a56-97af-ab953814ec31 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:43.592527 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c506fad-4902-4a56-97af-ab953814ec31 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:44.240836 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7c506fad-4902-4a56-97af-ab953814ec31 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "POST /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.665484 Oct 23 02:18:44.241481 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3924/7754] 10.222.0.42 () {60 vars in 1323 bytes} [Sun Oct 23 02:18:43 2022] POST /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4/os-volume_attachments => generated 194 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:18:56.007105 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3fe1b9c6-20ca-4ce7-83f5-5e047d68ff44 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:56.007681 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3fe1b9c6-20ca-4ce7-83f5-5e047d68ff44 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 181f6ea9-b736-4dba-8f58-29c578246bd4] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:56.009959 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:56.010657 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=42 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:56.015414 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3fe1b9c6-20ca-4ce7-83f5-5e047d68ff44 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:56.015903 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3fe1b9c6-20ca-4ce7-83f5-5e047d68ff44 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:56.016348 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3fe1b9c6-20ca-4ce7-83f5-5e047d68ff44 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:56.017038 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3fe1b9c6-20ca-4ce7-83f5-5e047d68ff44 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:56.017498 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3fe1b9c6-20ca-4ce7-83f5-5e047d68ff44 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:56.017927 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3fe1b9c6-20ca-4ce7-83f5-5e047d68ff44 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:56.147186 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-3fe1b9c6-20ca-4ce7-83f5-5e047d68ff44 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lazy-loading 'services' on Instance uuid 181f6ea9-b736-4dba-8f58-29c578246bd4 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:18:56.395595 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3fe1b9c6-20ca-4ce7-83f5-5e047d68ff44 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "DELETE /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4/os-volume_attachments/ed938bef-f657-4818-b412-58043510ab0e" status: 202 len: 0 microversion: 2.1 time: 0.392150 Oct 23 02:18:56.396220 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3831/7755] 10.222.0.42 () {58 vars in 1416 bytes} [Sun Oct 23 02:18:56 2022] DELETE /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4/os-volume_attachments/ed938bef-f657-4818-b412-58043510ab0e => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:18:56.402848 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:56.404272 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:56.408588 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d7fb1351-e50f-4ab2-9f92-cb7630e330ca tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:56.410926 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d7fb1351-e50f-4ab2-9f92-cb7630e330ca tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 181f6ea9-b736-4dba-8f58-29c578246bd4] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:56.418081 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d7fb1351-e50f-4ab2-9f92-cb7630e330ca tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:56.419098 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d7fb1351-e50f-4ab2-9f92-cb7630e330ca tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:56.419098 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d7fb1351-e50f-4ab2-9f92-cb7630e330ca tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:56.419615 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d7fb1351-e50f-4ab2-9f92-cb7630e330ca tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:56.420068 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d7fb1351-e50f-4ab2-9f92-cb7630e330ca tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:56.420652 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d7fb1351-e50f-4ab2-9f92-cb7630e330ca tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:56.453442 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d7fb1351-e50f-4ab2-9f92-cb7630e330ca tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052502 Oct 23 02:18:56.454030 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3925/7756] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 02:18:56 2022] GET /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:18:57.470229 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b3472ad8-a1d3-4b8a-bae6-1bdb924dc8c2 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:57.471012 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b3472ad8-a1d3-4b8a-bae6-1bdb924dc8c2 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 181f6ea9-b736-4dba-8f58-29c578246bd4] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:57.477483 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b3472ad8-a1d3-4b8a-bae6-1bdb924dc8c2 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:57.477999 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b3472ad8-a1d3-4b8a-bae6-1bdb924dc8c2 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:57.478456 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b3472ad8-a1d3-4b8a-bae6-1bdb924dc8c2 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:57.479168 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b3472ad8-a1d3-4b8a-bae6-1bdb924dc8c2 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:57.479772 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b3472ad8-a1d3-4b8a-bae6-1bdb924dc8c2 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:57.480215 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b3472ad8-a1d3-4b8a-bae6-1bdb924dc8c2 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:57.511233 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b3472ad8-a1d3-4b8a-bae6-1bdb924dc8c2 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049013 Oct 23 02:18:57.511811 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3832/7757] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 02:18:57 2022] GET /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:18:58.524134 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5b45e1c3-2e6f-4f00-94b8-8ce03ef64c95 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:58.526481 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5b45e1c3-2e6f-4f00-94b8-8ce03ef64c95 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 181f6ea9-b736-4dba-8f58-29c578246bd4] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:58.534832 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b45e1c3-2e6f-4f00-94b8-8ce03ef64c95 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:58.535335 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b45e1c3-2e6f-4f00-94b8-8ce03ef64c95 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:58.535786 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b45e1c3-2e6f-4f00-94b8-8ce03ef64c95 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:58.536515 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b45e1c3-2e6f-4f00-94b8-8ce03ef64c95 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:58.536979 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b45e1c3-2e6f-4f00-94b8-8ce03ef64c95 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:58.537414 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b45e1c3-2e6f-4f00-94b8-8ce03ef64c95 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:58.568631 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5b45e1c3-2e6f-4f00-94b8-8ce03ef64c95 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048603 Oct 23 02:18:58.569211 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3926/7758] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 02:18:58 2022] GET /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:18:59.581304 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9cf80589-6e6e-414c-bd4c-5a86ee270b63 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:59.583653 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9cf80589-6e6e-414c-bd4c-5a86ee270b63 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 181f6ea9-b736-4dba-8f58-29c578246bd4] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:59.590523 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9cf80589-6e6e-414c-bd4c-5a86ee270b63 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:59.591028 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9cf80589-6e6e-414c-bd4c-5a86ee270b63 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:59.591739 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9cf80589-6e6e-414c-bd4c-5a86ee270b63 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:59.592452 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9cf80589-6e6e-414c-bd4c-5a86ee270b63 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:59.592927 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9cf80589-6e6e-414c-bd4c-5a86ee270b63 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:59.593371 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9cf80589-6e6e-414c-bd4c-5a86ee270b63 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:59.623830 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9cf80589-6e6e-414c-bd4c-5a86ee270b63 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046511 Oct 23 02:18:59.624407 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3833/7759] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 02:18:59 2022] GET /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:19:00.636549 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f3d5134f-586d-4314-8a04-f312ec9572c6 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:00.638854 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f3d5134f-586d-4314-8a04-f312ec9572c6 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 181f6ea9-b736-4dba-8f58-29c578246bd4] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:00.646839 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f3d5134f-586d-4314-8a04-f312ec9572c6 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:00.647362 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f3d5134f-586d-4314-8a04-f312ec9572c6 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:00.647803 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f3d5134f-586d-4314-8a04-f312ec9572c6 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:00.648497 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f3d5134f-586d-4314-8a04-f312ec9572c6 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:00.648959 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f3d5134f-586d-4314-8a04-f312ec9572c6 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:00.649390 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f3d5134f-586d-4314-8a04-f312ec9572c6 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:00.680452 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f3d5134f-586d-4314-8a04-f312ec9572c6 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047975 Oct 23 02:19:00.681036 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3927/7760] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 02:19:00 2022] GET /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:19:01.693520 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d4f19827-de6f-4da6-b8ef-e94265e75bfa tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:01.695759 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d4f19827-de6f-4da6-b8ef-e94265e75bfa tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 181f6ea9-b736-4dba-8f58-29c578246bd4] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:01.703148 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4f19827-de6f-4da6-b8ef-e94265e75bfa tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:01.703637 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4f19827-de6f-4da6-b8ef-e94265e75bfa tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:01.704078 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4f19827-de6f-4da6-b8ef-e94265e75bfa tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:01.704771 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4f19827-de6f-4da6-b8ef-e94265e75bfa tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:01.705251 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4f19827-de6f-4da6-b8ef-e94265e75bfa tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:01.705664 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d4f19827-de6f-4da6-b8ef-e94265e75bfa tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:01.733835 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d4f19827-de6f-4da6-b8ef-e94265e75bfa tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044344 Oct 23 02:19:01.734420 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3834/7761] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 02:19:01 2022] GET /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 02:19:01.745197 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ab5655f9-1826-4619-88ee-9b1a5a124112 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:01.745686 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ab5655f9-1826-4619-88ee-9b1a5a124112 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 181f6ea9-b736-4dba-8f58-29c578246bd4] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:01.752983 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab5655f9-1826-4619-88ee-9b1a5a124112 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:01.753468 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab5655f9-1826-4619-88ee-9b1a5a124112 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:01.753908 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab5655f9-1826-4619-88ee-9b1a5a124112 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:01.754621 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab5655f9-1826-4619-88ee-9b1a5a124112 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:01.755079 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab5655f9-1826-4619-88ee-9b1a5a124112 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:01.755509 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ab5655f9-1826-4619-88ee-9b1a5a124112 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:01.880518 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-ab5655f9-1826-4619-88ee-9b1a5a124112 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] HTTP exception thrown: Instance 181f6ea9-b736-4dba-8f58-29c578246bd4 is not attached to volume ed938bef-f657-4818-b412-58043510ab0e Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ab5655f9-1826-4619-88ee-9b1a5a124112 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Request method failure captured: Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4/os-volume_attachments/ed938bef-f657-4818-b412-58043510ab0e HTTP/1.1 Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVKRra6tMxZJw5JZn07so2mOmE2eS0A5zQJfeBaqQhWimZd2SNUloTIvPx7tsW01lQ8hb8KYuLHmRAWYB0Jt9FIOod-k7KpGZPX5Ob2-X1ilQqZoZGe6zyor7Mot40Z-Aw_i4d8FB5NMAw361lJ0tR_u6a58uTCdZ_VesPH26DM3fhrk Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 6ed1446559e0468399a0e47775c47baa Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-TestEncryptedCinderVolumes-2004212060 Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6ed1446559e0468399a0e47775c47baa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6ed1446559e0468399a0e47775c47baa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6ed1446559e0468399a0e47775c47baa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6ed1446559e0468399a0e47775c47baa"}]}] Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-TestEncryptedCinderVolumes-2004212060 Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 6ed1446559e0468399a0e47775c47baa Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-2004212060 Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-TestEncryptedCinderVolumes-2004212060-project Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: c950bbf395604092937f0800037da97f Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-TestEncryptedCinderVolumes-2004212060-project Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 181f6ea9-b736-4dba-8f58-29c578246bd4 is not attached to volume ed938bef-f657-4818-b412-58043510ab0e Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: action_args: {'server_id': '181f6ea9-b736-4dba-8f58-29c578246bd4', 'id': 'ed938bef-f657-4818-b412-58043510ab0e'} Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ed938bef-f657-4818-b412-58043510ab0e. Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 181f6ea9-b736-4dba-8f58-29c578246bd4 is not attached to volume ed938bef-f657-4818-b412-58043510ab0e Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:19:01.886671 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:19:01.895595 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:19:01.895595 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:19:01.895595 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 181f6ea9-b736-4dba-8f58-29c578246bd4 is not attached to volume ed938bef-f657-4818-b412-58043510ab0e Oct 23 02:19:01.895595 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:19:01.895595 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ab5655f9-1826-4619-88ee-9b1a5a124112 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Returning 404 to user: Instance 181f6ea9-b736-4dba-8f58-29c578246bd4 is not attached to volume ed938bef-f657-4818-b412-58043510ab0e {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:19:01.895595 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ab5655f9-1826-4619-88ee-9b1a5a124112 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "DELETE /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4/os-volume_attachments/ed938bef-f657-4818-b412-58043510ab0e" status: 404 len: 154 microversion: 2.1 time: 0.147037 Oct 23 02:19:01.895595 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3928/7762] 10.222.0.42 () {58 vars in 1416 bytes} [Sun Oct 23 02:19:01 2022] DELETE /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4/os-volume_attachments/ed938bef-f657-4818-b412-58043510ab0e => generated 154 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:19:05.376708 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-60cdde30-2565-4543-8742-80327c924933 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:05.377207 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-60cdde30-2565-4543-8742-80327c924933 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 181f6ea9-b736-4dba-8f58-29c578246bd4] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:05.384035 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-60cdde30-2565-4543-8742-80327c924933 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:05.384519 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-60cdde30-2565-4543-8742-80327c924933 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:05.384956 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-60cdde30-2565-4543-8742-80327c924933 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:05.385648 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-60cdde30-2565-4543-8742-80327c924933 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:05.386137 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-60cdde30-2565-4543-8742-80327c924933 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:05.386567 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-60cdde30-2565-4543-8742-80327c924933 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:05.414538 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-60cdde30-2565-4543-8742-80327c924933 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 181f6ea9-b736-4dba-8f58-29c578246bd4] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 02:19:05.654512 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-60cdde30-2565-4543-8742-80327c924933 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "DELETE /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4" status: 204 len: 0 microversion: 2.1 time: 0.281277 Oct 23 02:19:05.655026 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3835/7763] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 02:19:05 2022] DELETE /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 02:19:05.663637 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-05c715e4-ed99-49db-94e1-de8cb5ea4f17 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:05.664306 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-05c715e4-ed99-49db-94e1-de8cb5ea4f17 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 181f6ea9-b736-4dba-8f58-29c578246bd4] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:05.672291 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-05c715e4-ed99-49db-94e1-de8cb5ea4f17 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:05.672876 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-05c715e4-ed99-49db-94e1-de8cb5ea4f17 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:05.673338 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-05c715e4-ed99-49db-94e1-de8cb5ea4f17 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:05.674043 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-05c715e4-ed99-49db-94e1-de8cb5ea4f17 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:05.674538 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-05c715e4-ed99-49db-94e1-de8cb5ea4f17 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:05.674967 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-05c715e4-ed99-49db-94e1-de8cb5ea4f17 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:06.071363 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-05c715e4-ed99-49db-94e1-de8cb5ea4f17 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950bbf395604092937f0800037da97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1446559e0468399a0e47775c47baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:06.079831 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-05c715e4-ed99-49db-94e1-de8cb5ea4f17 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4" status: 200 len: 1559 microversion: 2.1 time: 0.420346 Oct 23 02:19:06.080397 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3929/7764] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:19:05 2022] GET /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4 => generated 1559 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:19:07.103579 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0d7e2181-43de-49cd-86d1-c833ca6d4d50 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:07.104298 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0d7e2181-43de-49cd-86d1-c833ca6d4d50 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 181f6ea9-b736-4dba-8f58-29c578246bd4] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:07.111281 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d7e2181-43de-49cd-86d1-c833ca6d4d50 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:07.111776 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d7e2181-43de-49cd-86d1-c833ca6d4d50 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:07.112221 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d7e2181-43de-49cd-86d1-c833ca6d4d50 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:07.112913 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d7e2181-43de-49cd-86d1-c833ca6d4d50 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:07.113378 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d7e2181-43de-49cd-86d1-c833ca6d4d50 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:07.113812 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0d7e2181-43de-49cd-86d1-c833ca6d4d50 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:07.245410 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0d7e2181-43de-49cd-86d1-c833ca6d4d50 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950bbf395604092937f0800037da97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1446559e0468399a0e47775c47baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:07.253848 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0d7e2181-43de-49cd-86d1-c833ca6d4d50 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4" status: 200 len: 1559 microversion: 2.1 time: 0.154552 Oct 23 02:19:07.254458 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3836/7765] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:19:07 2022] GET /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:19:08.048737 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-c93ef808-c0ae-4243-bc4e-0da20e3d6e7b req-d8e806a2-ed38-45f9-b94a-15d52149cc2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "181f6ea9-b736-4dba-8f58-29c578246bd4", "name": "network-vif-deleted", "tag": "a5f0e875-0022-447c-aa64-2abe0a92a237"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:19:08.058854 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-c93ef808-c0ae-4243-bc4e-0da20e3d6e7b req-d8e806a2-ed38-45f9-b94a-15d52149cc2b service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:08.059334 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-c93ef808-c0ae-4243-bc4e-0da20e3d6e7b req-d8e806a2-ed38-45f9-b94a-15d52149cc2b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:08.059767 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-c93ef808-c0ae-4243-bc4e-0da20e3d6e7b req-d8e806a2-ed38-45f9-b94a-15d52149cc2b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:08.070607 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-c93ef808-c0ae-4243-bc4e-0da20e3d6e7b req-d8e806a2-ed38-45f9-b94a-15d52149cc2b service nova] Creating event network-vif-deleted:a5f0e875-0022-447c-aa64-2abe0a92a237 for instance 181f6ea9-b736-4dba-8f58-29c578246bd4 on n-h1-master-1 Oct 23 02:19:08.076202 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-c93ef808-c0ae-4243-bc4e-0da20e3d6e7b req-d8e806a2-ed38-45f9-b94a-15d52149cc2b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032233 Oct 23 02:19:08.076779 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3930/7766] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:19:08.279633 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-58d54c5f-7c50-4479-84cf-c832728d958d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:08.280236 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-58d54c5f-7c50-4479-84cf-c832728d958d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 181f6ea9-b736-4dba-8f58-29c578246bd4] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:08.287182 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-58d54c5f-7c50-4479-84cf-c832728d958d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:08.287678 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-58d54c5f-7c50-4479-84cf-c832728d958d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:08.288129 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-58d54c5f-7c50-4479-84cf-c832728d958d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:08.288828 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-58d54c5f-7c50-4479-84cf-c832728d958d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:08.289292 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-58d54c5f-7c50-4479-84cf-c832728d958d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:08.289728 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-58d54c5f-7c50-4479-84cf-c832728d958d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:08.353557 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-58d54c5f-7c50-4479-84cf-c832728d958d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950bbf395604092937f0800037da97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1446559e0468399a0e47775c47baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:08.361522 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-58d54c5f-7c50-4479-84cf-c832728d958d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4" status: 200 len: 1347 microversion: 2.1 time: 0.086628 Oct 23 02:19:08.362352 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3837/7767] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:19:08 2022] GET /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4 => generated 1347 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:19:09.386249 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-88e6086a-d926-4bb0-ab98-9e342704b616 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:09.386878 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-88e6086a-d926-4bb0-ab98-9e342704b616 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 181f6ea9-b736-4dba-8f58-29c578246bd4] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:09.393209 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-88e6086a-d926-4bb0-ab98-9e342704b616 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:09.393684 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-88e6086a-d926-4bb0-ab98-9e342704b616 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:09.394163 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-88e6086a-d926-4bb0-ab98-9e342704b616 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:09.394869 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-88e6086a-d926-4bb0-ab98-9e342704b616 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:09.395339 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-88e6086a-d926-4bb0-ab98-9e342704b616 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:09.395768 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-88e6086a-d926-4bb0-ab98-9e342704b616 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:09.409667 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-88e6086a-d926-4bb0-ab98-9e342704b616 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] HTTP exception thrown: Instance 181f6ea9-b736-4dba-8f58-29c578246bd4 could not be found. Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-88e6086a-d926-4bb0-ab98-9e342704b616 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Request method failure captured: Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4 HTTP/1.1 Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVKRra6tMxZJw5JZn07so2mOmE2eS0A5zQJfeBaqQhWimZd2SNUloTIvPx7tsW01lQ8hb8KYuLHmRAWYB0Jt9FIOod-k7KpGZPX5Ob2-X1ilQqZoZGe6zyor7Mot40Z-Aw_i4d8FB5NMAw361lJ0tR_u6a58uTCdZ_VesPH26DM3fhrk Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 6ed1446559e0468399a0e47775c47baa Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-TestEncryptedCinderVolumes-2004212060 Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6ed1446559e0468399a0e47775c47baa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6ed1446559e0468399a0e47775c47baa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6ed1446559e0468399a0e47775c47baa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6ed1446559e0468399a0e47775c47baa"}]}] Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-TestEncryptedCinderVolumes-2004212060 Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 6ed1446559e0468399a0e47775c47baa Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-2004212060 Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-TestEncryptedCinderVolumes-2004212060-project Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: c950bbf395604092937f0800037da97f Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-TestEncryptedCinderVolumes-2004212060-project Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 181f6ea9-b736-4dba-8f58-29c578246bd4 could not be found. Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '181f6ea9-b736-4dba-8f58-29c578246bd4'} Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 181f6ea9-b736-4dba-8f58-29c578246bd4 could not be found. Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 181f6ea9-b736-4dba-8f58-29c578246bd4 could not be found. Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:19:09.411354 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:19:09.416035 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:19:09.416035 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:19:09.416035 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:19:09.416035 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:19:09.416035 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:19:09.416035 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:19:09.416035 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 181f6ea9-b736-4dba-8f58-29c578246bd4 could not be found. Oct 23 02:19:09.416035 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:19:09.416035 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-88e6086a-d926-4bb0-ab98-9e342704b616 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Returning 404 to user: Instance 181f6ea9-b736-4dba-8f58-29c578246bd4 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:19:09.416035 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-88e6086a-d926-4bb0-ab98-9e342704b616 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4" status: 404 len: 111 microversion: 2.1 time: 0.031826 Oct 23 02:19:09.417157 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3931/7768] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:19:09 2022] GET /compute/v2.1/servers/181f6ea9-b736-4dba-8f58-29c578246bd4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:19:09.423693 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bb94c24c-36b5-49ed-a472-0acd56ac5140 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '.version_select at 0x7f5cc0316550>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:09.490129 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bb94c24c-36b5-49ed-a472-0acd56ac5140 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1771815734" status: 202 len: 0 microversion: 2.1 time: 0.071772 Oct 23 02:19:09.490821 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3838/7769] 10.222.0.42 () {58 vars in 1278 bytes} [Sun Oct 23 02:19:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1771815734 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:19:09.507234 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a18c4279-90ff-4563-9c28-809a336c53b8 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Action: 'create', calling method: .version_select at 0x7f5cc08da0d0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-245296840", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfLCAKHQadE7MfEI3FGOrXDuHT9z9lS+IlJy1sFzEyxhMBFfj2GDfRwJ5I5/mKlVZOmh2OmY60O7rz+ek1GdOVYBlnHK7ZywJwPB8uu+MQIkx3UBcacSIaA8Z7EUqCh/g=="}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:19:09.522864 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-a18c4279-90ff-4563-9c28-809a336c53b8 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Getting quotas for project 6ed1446559e0468399a0e47775c47baa. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:19:09.529420 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-a18c4279-90ff-4563-9c28-809a336c53b8 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Getting quotas for user c950bbf395604092937f0800037da97f and project 6ed1446559e0468399a0e47775c47baa. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:19:09.603661 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a18c4279-90ff-4563-9c28-809a336c53b8 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.100207 Oct 23 02:19:09.604273 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3932/7770] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 02:19:09 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:19:09.653765 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a4392fd6-2ab1-425a-a78c-6ff0a00d115a tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-336127853", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-245296840", "networks": [{"uuid": "7a446304-ebfa-4c4d-95f2-70414d327050"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:19:09.705431 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-a4392fd6-2ab1-425a-a78c-6ff0a00d115a tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] validate_networks() for [('7a446304-ebfa-4c4d-95f2-70414d327050', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 02:19:10.099108 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-a4392fd6-2ab1-425a-a78c-6ff0a00d115a tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:19:10.099552 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-a4392fd6-2ab1-425a-a78c-6ff0a00d115a tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:19:10.100044 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-a4392fd6-2ab1-425a-a78c-6ff0a00d115a tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:19:10.100478 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-a4392fd6-2ab1-425a-a78c-6ff0a00d115a tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:19:10.100942 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-a4392fd6-2ab1-425a-a78c-6ff0a00d115a tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:19:10.110300 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a4392fd6-2ab1-425a-a78c-6ff0a00d115a tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:10.110807 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a4392fd6-2ab1-425a-a78c-6ff0a00d115a tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:10.111259 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a4392fd6-2ab1-425a-a78c-6ff0a00d115a tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:10.112002 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a4392fd6-2ab1-425a-a78c-6ff0a00d115a tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:10.112477 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a4392fd6-2ab1-425a-a78c-6ff0a00d115a tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:10.112960 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a4392fd6-2ab1-425a-a78c-6ff0a00d115a tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:10.131540 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-a4392fd6-2ab1-425a-a78c-6ff0a00d115a tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Getting quotas for project 6ed1446559e0468399a0e47775c47baa. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:19:10.136877 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-a4392fd6-2ab1-425a-a78c-6ff0a00d115a tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Getting quotas for user c950bbf395604092937f0800037da97f and project 6ed1446559e0468399a0e47775c47baa. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:19:10.150307 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a4392fd6-2ab1-425a-a78c-6ff0a00d115a tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 02:19:10.152589 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a4392fd6-2ab1-425a-a78c-6ff0a00d115a tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: eb14d59c-595a-488d-8143-19f7f14b3b4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 02:19:10.269483 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a4392fd6-2ab1-425a-a78c-6ff0a00d115a tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.620194 Oct 23 02:19:10.270369 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3839/7771] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 02:19:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 02:19:10.283393 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a93cff6b-1aeb-42a8-8c1c-0cba56ded921 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:10.284410 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a93cff6b-1aeb-42a8-8c1c-0cba56ded921 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: eb14d59c-595a-488d-8143-19f7f14b3b4c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:10.344602 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a93cff6b-1aeb-42a8-8c1c-0cba56ded921 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950bbf395604092937f0800037da97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1446559e0468399a0e47775c47baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:10.351761 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a93cff6b-1aeb-42a8-8c1c-0cba56ded921 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c" status: 200 len: 1261 microversion: 2.1 time: 0.074194 Oct 23 02:19:10.352407 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3933/7772] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:19:10 2022] GET /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c => generated 1261 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:19:11.376361 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-90d0e542-e2c1-46c7-9d66-490d063e6d79 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:11.377055 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-90d0e542-e2c1-46c7-9d66-490d063e6d79 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: eb14d59c-595a-488d-8143-19f7f14b3b4c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:11.383726 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-90d0e542-e2c1-46c7-9d66-490d063e6d79 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:11.384231 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-90d0e542-e2c1-46c7-9d66-490d063e6d79 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:11.384683 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-90d0e542-e2c1-46c7-9d66-490d063e6d79 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:11.385385 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-90d0e542-e2c1-46c7-9d66-490d063e6d79 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:11.385860 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-90d0e542-e2c1-46c7-9d66-490d063e6d79 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:11.386326 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-90d0e542-e2c1-46c7-9d66-490d063e6d79 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:11.446767 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-90d0e542-e2c1-46c7-9d66-490d063e6d79 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950bbf395604092937f0800037da97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1446559e0468399a0e47775c47baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:11.454520 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-90d0e542-e2c1-46c7-9d66-490d063e6d79 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c" status: 200 len: 1257 microversion: 2.1 time: 0.083606 Oct 23 02:19:11.455095 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3840/7773] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:19:11 2022] GET /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c => generated 1257 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:19:12.478986 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4f676351-75bc-4459-be5d-cee46a9defd5 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:12.479708 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4f676351-75bc-4459-be5d-cee46a9defd5 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: eb14d59c-595a-488d-8143-19f7f14b3b4c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:12.490452 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f676351-75bc-4459-be5d-cee46a9defd5 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:12.491011 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f676351-75bc-4459-be5d-cee46a9defd5 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:12.491460 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f676351-75bc-4459-be5d-cee46a9defd5 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:12.492179 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f676351-75bc-4459-be5d-cee46a9defd5 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:12.492639 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f676351-75bc-4459-be5d-cee46a9defd5 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:12.493094 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4f676351-75bc-4459-be5d-cee46a9defd5 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:12.566593 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4f676351-75bc-4459-be5d-cee46a9defd5 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950bbf395604092937f0800037da97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1446559e0468399a0e47775c47baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:12.575762 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4f676351-75bc-4459-be5d-cee46a9defd5 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c" status: 200 len: 1321 microversion: 2.1 time: 0.100997 Oct 23 02:19:12.576695 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3934/7774] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:19:12 2022] GET /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c => generated 1321 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:19:13.599649 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f2adc279-7324-466a-ad0e-00e0e5917c90 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:13.600285 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f2adc279-7324-466a-ad0e-00e0e5917c90 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: eb14d59c-595a-488d-8143-19f7f14b3b4c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:13.607147 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f2adc279-7324-466a-ad0e-00e0e5917c90 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:13.607653 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f2adc279-7324-466a-ad0e-00e0e5917c90 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:13.608102 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f2adc279-7324-466a-ad0e-00e0e5917c90 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:13.608805 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f2adc279-7324-466a-ad0e-00e0e5917c90 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:13.609279 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f2adc279-7324-466a-ad0e-00e0e5917c90 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:13.609718 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f2adc279-7324-466a-ad0e-00e0e5917c90 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:13.742964 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f2adc279-7324-466a-ad0e-00e0e5917c90 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950bbf395604092937f0800037da97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1446559e0468399a0e47775c47baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:13.751525 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f2adc279-7324-466a-ad0e-00e0e5917c90 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c" status: 200 len: 1361 microversion: 2.1 time: 0.155765 Oct 23 02:19:13.752113 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3841/7775] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:19:13 2022] GET /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:19:14.051879 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-3d7957e0-58f1-449f-afdf-457eefd74cdd req-88e117e1-3643-4a0c-b9c8-569b917b91d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb14d59c-595a-488d-8143-19f7f14b3b4c", "tag": "048f5adc-313d-4db1-ae9f-fd93d10dfa2d"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:19:14.063134 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-3d7957e0-58f1-449f-afdf-457eefd74cdd req-88e117e1-3643-4a0c-b9c8-569b917b91d5 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:14.063653 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-3d7957e0-58f1-449f-afdf-457eefd74cdd req-88e117e1-3643-4a0c-b9c8-569b917b91d5 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:14.064228 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-3d7957e0-58f1-449f-afdf-457eefd74cdd req-88e117e1-3643-4a0c-b9c8-569b917b91d5 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:14.076046 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-3d7957e0-58f1-449f-afdf-457eefd74cdd req-88e117e1-3643-4a0c-b9c8-569b917b91d5 service nova] Creating event network-changed:048f5adc-313d-4db1-ae9f-fd93d10dfa2d for instance eb14d59c-595a-488d-8143-19f7f14b3b4c on n-h2-master-1 Oct 23 02:19:14.080958 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-3d7957e0-58f1-449f-afdf-457eefd74cdd req-88e117e1-3643-4a0c-b9c8-569b917b91d5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032834 Oct 23 02:19:14.081565 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3935/7776] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:19:14.775240 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-75266389-37fd-4837-b46e-ca31a22c92b7 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:14.775959 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-75266389-37fd-4837-b46e-ca31a22c92b7 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: eb14d59c-595a-488d-8143-19f7f14b3b4c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:14.783384 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-75266389-37fd-4837-b46e-ca31a22c92b7 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:14.783888 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-75266389-37fd-4837-b46e-ca31a22c92b7 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:14.784339 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-75266389-37fd-4837-b46e-ca31a22c92b7 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:14.785051 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-75266389-37fd-4837-b46e-ca31a22c92b7 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:14.785520 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-75266389-37fd-4837-b46e-ca31a22c92b7 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:14.785959 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-75266389-37fd-4837-b46e-ca31a22c92b7 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:14.915744 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-75266389-37fd-4837-b46e-ca31a22c92b7 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950bbf395604092937f0800037da97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1446559e0468399a0e47775c47baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:14.923396 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-75266389-37fd-4837-b46e-ca31a22c92b7 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c" status: 200 len: 1361 microversion: 2.1 time: 0.152041 Oct 23 02:19:14.923973 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3842/7777] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:19:14 2022] GET /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:19:15.948105 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f391e39e-3501-4564-945e-fd2f83c828d6 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:15.948734 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f391e39e-3501-4564-945e-fd2f83c828d6 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: eb14d59c-595a-488d-8143-19f7f14b3b4c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:15.954924 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f391e39e-3501-4564-945e-fd2f83c828d6 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:15.955412 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f391e39e-3501-4564-945e-fd2f83c828d6 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:15.955851 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f391e39e-3501-4564-945e-fd2f83c828d6 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:15.956541 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f391e39e-3501-4564-945e-fd2f83c828d6 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:15.956998 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f391e39e-3501-4564-945e-fd2f83c828d6 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:15.957424 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f391e39e-3501-4564-945e-fd2f83c828d6 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:16.088314 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f391e39e-3501-4564-945e-fd2f83c828d6 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950bbf395604092937f0800037da97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1446559e0468399a0e47775c47baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:16.096800 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f391e39e-3501-4564-945e-fd2f83c828d6 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c" status: 200 len: 1361 microversion: 2.1 time: 0.153989 Oct 23 02:19:16.097368 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3936/7778] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:19:15 2022] GET /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:19:17.121260 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7b7338b6-bbbe-4793-ad8d-67e49a33d950 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:17.121890 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7b7338b6-bbbe-4793-ad8d-67e49a33d950 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: eb14d59c-595a-488d-8143-19f7f14b3b4c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:17.128908 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b7338b6-bbbe-4793-ad8d-67e49a33d950 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:17.129405 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b7338b6-bbbe-4793-ad8d-67e49a33d950 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:17.129858 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b7338b6-bbbe-4793-ad8d-67e49a33d950 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:17.130587 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b7338b6-bbbe-4793-ad8d-67e49a33d950 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:17.131054 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b7338b6-bbbe-4793-ad8d-67e49a33d950 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:17.131507 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b7338b6-bbbe-4793-ad8d-67e49a33d950 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:17.259213 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7b7338b6-bbbe-4793-ad8d-67e49a33d950 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950bbf395604092937f0800037da97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1446559e0468399a0e47775c47baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:17.267384 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7b7338b6-bbbe-4793-ad8d-67e49a33d950 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c" status: 200 len: 1361 microversion: 2.1 time: 0.151034 Oct 23 02:19:17.267964 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3843/7779] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:19:17 2022] GET /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:19:18.290078 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-83ae800b-8b2b-41d1-a6bd-f6e2c742897e tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:18.290696 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-83ae800b-8b2b-41d1-a6bd-f6e2c742897e tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: eb14d59c-595a-488d-8143-19f7f14b3b4c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:18.298319 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-83ae800b-8b2b-41d1-a6bd-f6e2c742897e tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:18.298806 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-83ae800b-8b2b-41d1-a6bd-f6e2c742897e tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:18.299244 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-83ae800b-8b2b-41d1-a6bd-f6e2c742897e tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:18.299935 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-83ae800b-8b2b-41d1-a6bd-f6e2c742897e tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:18.300394 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-83ae800b-8b2b-41d1-a6bd-f6e2c742897e tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:18.300819 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-83ae800b-8b2b-41d1-a6bd-f6e2c742897e tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:18.434095 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-83ae800b-8b2b-41d1-a6bd-f6e2c742897e tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950bbf395604092937f0800037da97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1446559e0468399a0e47775c47baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:18.443107 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-83ae800b-8b2b-41d1-a6bd-f6e2c742897e tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c" status: 200 len: 1361 microversion: 2.1 time: 0.156958 Oct 23 02:19:18.443697 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3937/7780] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:19:18 2022] GET /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:19:19.466195 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a19b7255-2c9f-4e5c-9c09-2107e3dbcf60 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:19.467005 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a19b7255-2c9f-4e5c-9c09-2107e3dbcf60 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: eb14d59c-595a-488d-8143-19f7f14b3b4c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:19.473858 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a19b7255-2c9f-4e5c-9c09-2107e3dbcf60 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:19.474387 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a19b7255-2c9f-4e5c-9c09-2107e3dbcf60 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:19.474830 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a19b7255-2c9f-4e5c-9c09-2107e3dbcf60 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:19.475523 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a19b7255-2c9f-4e5c-9c09-2107e3dbcf60 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:19.475985 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a19b7255-2c9f-4e5c-9c09-2107e3dbcf60 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:19.476415 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a19b7255-2c9f-4e5c-9c09-2107e3dbcf60 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:19.602679 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a19b7255-2c9f-4e5c-9c09-2107e3dbcf60 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950bbf395604092937f0800037da97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1446559e0468399a0e47775c47baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:19.610834 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a19b7255-2c9f-4e5c-9c09-2107e3dbcf60 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c" status: 200 len: 1361 microversion: 2.1 time: 0.148617 Oct 23 02:19:19.611414 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3844/7781] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:19:19 2022] GET /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:19:20.634001 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-38a5f99a-fcf7-4457-9c33-0e13e5b70532 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:20.639153 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-38a5f99a-fcf7-4457-9c33-0e13e5b70532 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: eb14d59c-595a-488d-8143-19f7f14b3b4c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:20.639153 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=6 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:19:20.644255 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-38a5f99a-fcf7-4457-9c33-0e13e5b70532 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:20.644757 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-38a5f99a-fcf7-4457-9c33-0e13e5b70532 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:20.645246 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-38a5f99a-fcf7-4457-9c33-0e13e5b70532 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:20.645904 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-38a5f99a-fcf7-4457-9c33-0e13e5b70532 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:20.646479 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-38a5f99a-fcf7-4457-9c33-0e13e5b70532 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:20.646940 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-38a5f99a-fcf7-4457-9c33-0e13e5b70532 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:20.653915 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-95c2a250-a790-4615-9761-4eead865d1d9 req-afd2da69-7810-4f56-bbb0-565834ae15ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb14d59c-595a-488d-8143-19f7f14b3b4c", "name": "network-vif-plugged", "status": "completed", "tag": "048f5adc-313d-4db1-ae9f-fd93d10dfa2d"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:19:20.659946 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:19:20.660618 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=6 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:19:20.666647 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-95c2a250-a790-4615-9761-4eead865d1d9 req-afd2da69-7810-4f56-bbb0-565834ae15ce service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:20.667727 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-95c2a250-a790-4615-9761-4eead865d1d9 req-afd2da69-7810-4f56-bbb0-565834ae15ce service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:20.667727 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-95c2a250-a790-4615-9761-4eead865d1d9 req-afd2da69-7810-4f56-bbb0-565834ae15ce service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:20.678544 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-95c2a250-a790-4615-9761-4eead865d1d9 req-afd2da69-7810-4f56-bbb0-565834ae15ce service nova] Creating event network-vif-plugged:048f5adc-313d-4db1-ae9f-fd93d10dfa2d for instance eb14d59c-595a-488d-8143-19f7f14b3b4c on n-h2-master-1 Oct 23 02:19:20.684358 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-95c2a250-a790-4615-9761-4eead865d1d9 req-afd2da69-7810-4f56-bbb0-565834ae15ce service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034095 Oct 23 02:19:20.684963 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3845/7782] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:19:20.783037 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-38a5f99a-fcf7-4457-9c33-0e13e5b70532 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950bbf395604092937f0800037da97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1446559e0468399a0e47775c47baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:20.791434 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-38a5f99a-fcf7-4457-9c33-0e13e5b70532 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c" status: 200 len: 1361 microversion: 2.1 time: 0.161462 Oct 23 02:19:20.792602 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3938/7783] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:19:20 2022] GET /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:19:21.816093 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-98dc432d-7a16-4fa1-a7a5-df615d48593c tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:21.816838 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-98dc432d-7a16-4fa1-a7a5-df615d48593c tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: eb14d59c-595a-488d-8143-19f7f14b3b4c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:21.824878 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-98dc432d-7a16-4fa1-a7a5-df615d48593c tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:21.825369 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-98dc432d-7a16-4fa1-a7a5-df615d48593c tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:21.825813 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-98dc432d-7a16-4fa1-a7a5-df615d48593c tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:21.826532 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-98dc432d-7a16-4fa1-a7a5-df615d48593c tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:21.827161 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-98dc432d-7a16-4fa1-a7a5-df615d48593c tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:21.827602 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-98dc432d-7a16-4fa1-a7a5-df615d48593c tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:21.960133 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-98dc432d-7a16-4fa1-a7a5-df615d48593c tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950bbf395604092937f0800037da97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1446559e0468399a0e47775c47baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:21.968191 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-98dc432d-7a16-4fa1-a7a5-df615d48593c tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c" status: 200 len: 1361 microversion: 2.1 time: 0.157033 Oct 23 02:19:21.968771 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3846/7784] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:19:21 2022] GET /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:19:22.991421 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4d010269-7dd7-4960-87bd-d96255846bb3 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:22.992056 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4d010269-7dd7-4960-87bd-d96255846bb3 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: eb14d59c-595a-488d-8143-19f7f14b3b4c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:22.998864 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4d010269-7dd7-4960-87bd-d96255846bb3 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:22.999347 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4d010269-7dd7-4960-87bd-d96255846bb3 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:22.999786 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4d010269-7dd7-4960-87bd-d96255846bb3 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:23.000476 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4d010269-7dd7-4960-87bd-d96255846bb3 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:23.000927 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4d010269-7dd7-4960-87bd-d96255846bb3 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:23.001350 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4d010269-7dd7-4960-87bd-d96255846bb3 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:23.127468 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4d010269-7dd7-4960-87bd-d96255846bb3 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950bbf395604092937f0800037da97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1446559e0468399a0e47775c47baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:23.135181 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4d010269-7dd7-4960-87bd-d96255846bb3 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c" status: 200 len: 1552 microversion: 2.1 time: 0.147661 Oct 23 02:19:23.135752 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3939/7785] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:19:22 2022] GET /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c => generated 1552 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:19:23.168008 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-df21b762-2b28-49f4-8d03-c9fa0d59575f tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:23.168008 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-df21b762-2b28-49f4-8d03-c9fa0d59575f tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: eb14d59c-595a-488d-8143-19f7f14b3b4c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:23.174811 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-df21b762-2b28-49f4-8d03-c9fa0d59575f tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:23.175337 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-df21b762-2b28-49f4-8d03-c9fa0d59575f tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:23.175783 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-df21b762-2b28-49f4-8d03-c9fa0d59575f tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:23.176484 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-df21b762-2b28-49f4-8d03-c9fa0d59575f tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:23.176950 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-df21b762-2b28-49f4-8d03-c9fa0d59575f tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:23.177447 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-df21b762-2b28-49f4-8d03-c9fa0d59575f tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:23.195683 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:19:23.308323 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-df21b762-2b28-49f4-8d03-c9fa0d59575f tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950bbf395604092937f0800037da97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1446559e0468399a0e47775c47baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:23.315944 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-df21b762-2b28-49f4-8d03-c9fa0d59575f tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c" status: 200 len: 1552 microversion: 2.1 time: 0.153409 Oct 23 02:19:23.316528 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3847/7786] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:19:23 2022] GET /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c => generated 1552 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:19:26.302797 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7a249831-b56a-41f8-a3aa-0f25c43ce664 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bfea257c-f624-41f8-bfe1-f758466fe002"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:19:26.308898 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7a249831-b56a-41f8-a3aa-0f25c43ce664 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: eb14d59c-595a-488d-8143-19f7f14b3b4c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:26.312120 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7a249831-b56a-41f8-a3aa-0f25c43ce664 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:26.312609 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7a249831-b56a-41f8-a3aa-0f25c43ce664 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:26.313049 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7a249831-b56a-41f8-a3aa-0f25c43ce664 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:26.313801 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7a249831-b56a-41f8-a3aa-0f25c43ce664 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:26.314295 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7a249831-b56a-41f8-a3aa-0f25c43ce664 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:26.314727 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7a249831-b56a-41f8-a3aa-0f25c43ce664 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:27.012168 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7a249831-b56a-41f8-a3aa-0f25c43ce664 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "POST /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.713130 Oct 23 02:19:27.012799 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3940/7787] 10.222.0.42 () {60 vars in 1323 bytes} [Sun Oct 23 02:19:26 2022] POST /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c/os-volume_attachments => generated 194 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:19:38.971062 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-dfda794a-399d-4a99-af57-75d1a776b6c6 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:38.971546 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-dfda794a-399d-4a99-af57-75d1a776b6c6 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: eb14d59c-595a-488d-8143-19f7f14b3b4c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:38.974502 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:19:38.975165 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:19:38.979914 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dfda794a-399d-4a99-af57-75d1a776b6c6 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:38.980405 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dfda794a-399d-4a99-af57-75d1a776b6c6 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:38.980895 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dfda794a-399d-4a99-af57-75d1a776b6c6 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:38.990249 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dfda794a-399d-4a99-af57-75d1a776b6c6 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:38.990249 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dfda794a-399d-4a99-af57-75d1a776b6c6 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:38.990249 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dfda794a-399d-4a99-af57-75d1a776b6c6 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:39.066042 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-dfda794a-399d-4a99-af57-75d1a776b6c6 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lazy-loading 'services' on Instance uuid eb14d59c-595a-488d-8143-19f7f14b3b4c {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:19:39.280701 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-dfda794a-399d-4a99-af57-75d1a776b6c6 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "DELETE /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c/os-volume_attachments/bfea257c-f624-41f8-bfe1-f758466fe002" status: 202 len: 0 microversion: 2.1 time: 0.313633 Oct 23 02:19:39.281315 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3848/7788] 10.222.0.42 () {58 vars in 1416 bytes} [Sun Oct 23 02:19:38 2022] DELETE /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c/os-volume_attachments/bfea257c-f624-41f8-bfe1-f758466fe002 => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:19:39.290449 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6f5f7f71-19aa-4166-8e90-3f77898ec287 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:39.293419 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6f5f7f71-19aa-4166-8e90-3f77898ec287 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: eb14d59c-595a-488d-8143-19f7f14b3b4c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:39.296380 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:19:39.297362 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:19:39.302547 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6f5f7f71-19aa-4166-8e90-3f77898ec287 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:39.303074 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6f5f7f71-19aa-4166-8e90-3f77898ec287 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:39.303511 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6f5f7f71-19aa-4166-8e90-3f77898ec287 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:39.304237 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6f5f7f71-19aa-4166-8e90-3f77898ec287 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:39.304690 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6f5f7f71-19aa-4166-8e90-3f77898ec287 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:39.305139 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6f5f7f71-19aa-4166-8e90-3f77898ec287 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:39.337523 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6f5f7f71-19aa-4166-8e90-3f77898ec287 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051480 Oct 23 02:19:39.338386 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3941/7789] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 02:19:39 2022] GET /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:19:40.353251 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d8ff0a1c-24ee-488d-a2b5-7e4e1c86bf16 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:40.355624 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d8ff0a1c-24ee-488d-a2b5-7e4e1c86bf16 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: eb14d59c-595a-488d-8143-19f7f14b3b4c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:40.361820 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d8ff0a1c-24ee-488d-a2b5-7e4e1c86bf16 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:40.362352 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d8ff0a1c-24ee-488d-a2b5-7e4e1c86bf16 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:40.362793 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d8ff0a1c-24ee-488d-a2b5-7e4e1c86bf16 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:40.363488 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d8ff0a1c-24ee-488d-a2b5-7e4e1c86bf16 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:40.364068 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d8ff0a1c-24ee-488d-a2b5-7e4e1c86bf16 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:40.364516 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d8ff0a1c-24ee-488d-a2b5-7e4e1c86bf16 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:40.394840 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d8ff0a1c-24ee-488d-a2b5-7e4e1c86bf16 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046830 Oct 23 02:19:40.395408 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3849/7790] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 02:19:40 2022] GET /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:19:41.409028 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-136bdc4c-615c-4a09-8938-7e6ac4c8087d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:41.411501 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-136bdc4c-615c-4a09-8938-7e6ac4c8087d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: eb14d59c-595a-488d-8143-19f7f14b3b4c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:41.419128 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-136bdc4c-615c-4a09-8938-7e6ac4c8087d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:41.419614 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-136bdc4c-615c-4a09-8938-7e6ac4c8087d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:41.420077 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-136bdc4c-615c-4a09-8938-7e6ac4c8087d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:41.420995 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-136bdc4c-615c-4a09-8938-7e6ac4c8087d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:41.421449 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-136bdc4c-615c-4a09-8938-7e6ac4c8087d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:41.421872 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-136bdc4c-615c-4a09-8938-7e6ac4c8087d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:41.453998 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-136bdc4c-615c-4a09-8938-7e6ac4c8087d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049868 Oct 23 02:19:41.454581 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3942/7791] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 02:19:41 2022] GET /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:19:42.472076 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c829c8f6-a7fa-46d2-843c-a59cb7600531 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:42.472076 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c829c8f6-a7fa-46d2-843c-a59cb7600531 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: eb14d59c-595a-488d-8143-19f7f14b3b4c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:42.476834 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c829c8f6-a7fa-46d2-843c-a59cb7600531 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:42.477369 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c829c8f6-a7fa-46d2-843c-a59cb7600531 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:42.477954 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c829c8f6-a7fa-46d2-843c-a59cb7600531 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:42.478689 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c829c8f6-a7fa-46d2-843c-a59cb7600531 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:42.479194 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c829c8f6-a7fa-46d2-843c-a59cb7600531 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:42.480259 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c829c8f6-a7fa-46d2-843c-a59cb7600531 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:42.510929 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c829c8f6-a7fa-46d2-843c-a59cb7600531 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048179 Oct 23 02:19:42.511516 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3850/7792] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 02:19:42 2022] GET /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:19:43.524224 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3ed49b65-9c27-4d0b-9d73-54e577fdda93 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:43.527160 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3ed49b65-9c27-4d0b-9d73-54e577fdda93 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: eb14d59c-595a-488d-8143-19f7f14b3b4c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:43.534220 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3ed49b65-9c27-4d0b-9d73-54e577fdda93 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:43.534712 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3ed49b65-9c27-4d0b-9d73-54e577fdda93 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:43.535149 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3ed49b65-9c27-4d0b-9d73-54e577fdda93 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:43.535846 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3ed49b65-9c27-4d0b-9d73-54e577fdda93 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:43.536394 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3ed49b65-9c27-4d0b-9d73-54e577fdda93 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:43.536745 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3ed49b65-9c27-4d0b-9d73-54e577fdda93 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:43.567021 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3ed49b65-9c27-4d0b-9d73-54e577fdda93 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047136 Oct 23 02:19:43.567591 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3943/7793] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 02:19:43 2022] GET /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:19:44.578904 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-13b0a432-1483-49bb-bf31-e0025c4ec19f tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:44.581157 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-13b0a432-1483-49bb-bf31-e0025c4ec19f tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: eb14d59c-595a-488d-8143-19f7f14b3b4c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:44.588015 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-13b0a432-1483-49bb-bf31-e0025c4ec19f tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:44.588513 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-13b0a432-1483-49bb-bf31-e0025c4ec19f tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:44.589451 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-13b0a432-1483-49bb-bf31-e0025c4ec19f tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:44.590188 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-13b0a432-1483-49bb-bf31-e0025c4ec19f tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:44.590663 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-13b0a432-1483-49bb-bf31-e0025c4ec19f tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:44.591101 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-13b0a432-1483-49bb-bf31-e0025c4ec19f tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:44.620474 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-13b0a432-1483-49bb-bf31-e0025c4ec19f tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045659 Oct 23 02:19:44.621030 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3851/7794] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 02:19:44 2022] GET /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 02:19:44.631796 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3d3323bf-167f-4b34-821e-24cd08ac69c2 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:44.632294 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3d3323bf-167f-4b34-821e-24cd08ac69c2 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: eb14d59c-595a-488d-8143-19f7f14b3b4c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:44.639172 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d3323bf-167f-4b34-821e-24cd08ac69c2 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:44.639665 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d3323bf-167f-4b34-821e-24cd08ac69c2 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:44.640113 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d3323bf-167f-4b34-821e-24cd08ac69c2 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:44.640808 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d3323bf-167f-4b34-821e-24cd08ac69c2 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:44.641269 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d3323bf-167f-4b34-821e-24cd08ac69c2 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:44.641704 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d3323bf-167f-4b34-821e-24cd08ac69c2 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:44.721673 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-3d3323bf-167f-4b34-821e-24cd08ac69c2 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] HTTP exception thrown: Instance eb14d59c-595a-488d-8143-19f7f14b3b4c is not attached to volume bfea257c-f624-41f8-bfe1-f758466fe002 Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3d3323bf-167f-4b34-821e-24cd08ac69c2 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Request method failure captured: Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: request: DELETE /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c/os-volume_attachments/bfea257c-f624-41f8-bfe1-f758466fe002 HTTP/1.1 Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVKRra6tMxZJw5JZn07so2mOmE2eS0A5zQJfeBaqQhWimZd2SNUloTIvPx7tsW01lQ8hb8KYuLHmRAWYB0Jt9FIOod-k7KpGZPX5Ob2-X1ilQqZoZGe6zyor7Mot40Z-Aw_i4d8FB5NMAw361lJ0tR_u6a58uTCdZ_VesPH26DM3fhrk Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 6ed1446559e0468399a0e47775c47baa Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-TestEncryptedCinderVolumes-2004212060 Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6ed1446559e0468399a0e47775c47baa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6ed1446559e0468399a0e47775c47baa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6ed1446559e0468399a0e47775c47baa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6ed1446559e0468399a0e47775c47baa"}]}] Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-TestEncryptedCinderVolumes-2004212060 Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 6ed1446559e0468399a0e47775c47baa Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-2004212060 Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-TestEncryptedCinderVolumes-2004212060-project Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: c950bbf395604092937f0800037da97f Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-TestEncryptedCinderVolumes-2004212060-project Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: exception: Instance eb14d59c-595a-488d-8143-19f7f14b3b4c is not attached to volume bfea257c-f624-41f8-bfe1-f758466fe002 Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: action_args: {'server_id': 'eb14d59c-595a-488d-8143-19f7f14b3b4c', 'id': 'bfea257c-f624-41f8-bfe1-f758466fe002'} Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id bfea257c-f624-41f8-bfe1-f758466fe002. Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb14d59c-595a-488d-8143-19f7f14b3b4c is not attached to volume bfea257c-f624-41f8-bfe1-f758466fe002 Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:19:44.723350 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:19:44.728212 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:19:44.728212 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:19:44.728212 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb14d59c-595a-488d-8143-19f7f14b3b4c is not attached to volume bfea257c-f624-41f8-bfe1-f758466fe002 Oct 23 02:19:44.728212 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:19:44.728212 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3d3323bf-167f-4b34-821e-24cd08ac69c2 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Returning 404 to user: Instance eb14d59c-595a-488d-8143-19f7f14b3b4c is not attached to volume bfea257c-f624-41f8-bfe1-f758466fe002 {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:19:44.728212 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3d3323bf-167f-4b34-821e-24cd08ac69c2 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "DELETE /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c/os-volume_attachments/bfea257c-f624-41f8-bfe1-f758466fe002" status: 404 len: 154 microversion: 2.1 time: 0.097070 Oct 23 02:19:44.728212 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3944/7795] 10.222.0.42 () {58 vars in 1416 bytes} [Sun Oct 23 02:19:44 2022] DELETE /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c/os-volume_attachments/bfea257c-f624-41f8-bfe1-f758466fe002 => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:19:48.243694 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5f4b5a0d-740d-4f11-898b-0466085782cc tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:48.244214 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5f4b5a0d-740d-4f11-898b-0466085782cc tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: eb14d59c-595a-488d-8143-19f7f14b3b4c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:48.250975 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5f4b5a0d-740d-4f11-898b-0466085782cc tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:48.251465 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5f4b5a0d-740d-4f11-898b-0466085782cc tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:48.251907 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5f4b5a0d-740d-4f11-898b-0466085782cc tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:48.252599 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5f4b5a0d-740d-4f11-898b-0466085782cc tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:48.253059 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5f4b5a0d-740d-4f11-898b-0466085782cc tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:48.253488 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5f4b5a0d-740d-4f11-898b-0466085782cc tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:48.279076 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5f4b5a0d-740d-4f11-898b-0466085782cc tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: eb14d59c-595a-488d-8143-19f7f14b3b4c] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 02:19:48.567750 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5f4b5a0d-740d-4f11-898b-0466085782cc tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "DELETE /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c" status: 204 len: 0 microversion: 2.1 time: 0.327754 Oct 23 02:19:48.568513 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3852/7796] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 02:19:48 2022] DELETE /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 02:19:48.577336 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7b93389f-b388-4d84-833f-7ae84d4029d1 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:48.578051 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7b93389f-b388-4d84-833f-7ae84d4029d1 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: eb14d59c-595a-488d-8143-19f7f14b3b4c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:48.585586 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b93389f-b388-4d84-833f-7ae84d4029d1 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:48.586204 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b93389f-b388-4d84-833f-7ae84d4029d1 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:48.586644 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b93389f-b388-4d84-833f-7ae84d4029d1 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:48.587330 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b93389f-b388-4d84-833f-7ae84d4029d1 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:48.587786 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b93389f-b388-4d84-833f-7ae84d4029d1 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:48.588210 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b93389f-b388-4d84-833f-7ae84d4029d1 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:48.722436 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7b93389f-b388-4d84-833f-7ae84d4029d1 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950bbf395604092937f0800037da97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1446559e0468399a0e47775c47baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:48.730609 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7b93389f-b388-4d84-833f-7ae84d4029d1 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c" status: 200 len: 1558 microversion: 2.1 time: 0.157749 Oct 23 02:19:48.731179 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3945/7797] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:19:48 2022] GET /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:19:49.754896 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e2350c8a-7f1c-452e-939b-5a9ee1cf95c6 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:49.755576 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e2350c8a-7f1c-452e-939b-5a9ee1cf95c6 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: eb14d59c-595a-488d-8143-19f7f14b3b4c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:49.763063 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e2350c8a-7f1c-452e-939b-5a9ee1cf95c6 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:49.763560 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e2350c8a-7f1c-452e-939b-5a9ee1cf95c6 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:49.764008 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e2350c8a-7f1c-452e-939b-5a9ee1cf95c6 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:49.764704 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e2350c8a-7f1c-452e-939b-5a9ee1cf95c6 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:49.765170 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e2350c8a-7f1c-452e-939b-5a9ee1cf95c6 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:49.765602 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e2350c8a-7f1c-452e-939b-5a9ee1cf95c6 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:49.899799 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e2350c8a-7f1c-452e-939b-5a9ee1cf95c6 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950bbf395604092937f0800037da97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1446559e0468399a0e47775c47baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:49.907743 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e2350c8a-7f1c-452e-939b-5a9ee1cf95c6 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c" status: 200 len: 1558 microversion: 2.1 time: 0.157127 Oct 23 02:19:49.908332 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3853/7798] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:19:49 2022] GET /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:19:50.930560 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bbb500a8-97a9-4e1c-a4ce-ceee4eebc97b tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:50.931318 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bbb500a8-97a9-4e1c-a4ce-ceee4eebc97b tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: eb14d59c-595a-488d-8143-19f7f14b3b4c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:50.938156 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bbb500a8-97a9-4e1c-a4ce-ceee4eebc97b tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:50.938651 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bbb500a8-97a9-4e1c-a4ce-ceee4eebc97b tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:50.939128 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bbb500a8-97a9-4e1c-a4ce-ceee4eebc97b tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:50.939914 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bbb500a8-97a9-4e1c-a4ce-ceee4eebc97b tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:50.940389 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bbb500a8-97a9-4e1c-a4ce-ceee4eebc97b tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:50.940829 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bbb500a8-97a9-4e1c-a4ce-ceee4eebc97b tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:50.946653 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-3f24becc-1c3e-4ff4-b93e-bf02faff42f8 req-b3f98f7e-64f8-4359-98e3-158f3ce1c053 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb14d59c-595a-488d-8143-19f7f14b3b4c", "name": "network-vif-deleted", "tag": "048f5adc-313d-4db1-ae9f-fd93d10dfa2d"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:19:50.957792 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-3f24becc-1c3e-4ff4-b93e-bf02faff42f8 req-b3f98f7e-64f8-4359-98e3-158f3ce1c053 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:50.958562 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-3f24becc-1c3e-4ff4-b93e-bf02faff42f8 req-b3f98f7e-64f8-4359-98e3-158f3ce1c053 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:50.963205 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-3f24becc-1c3e-4ff4-b93e-bf02faff42f8 req-b3f98f7e-64f8-4359-98e3-158f3ce1c053 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:50.974128 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-3f24becc-1c3e-4ff4-b93e-bf02faff42f8 req-b3f98f7e-64f8-4359-98e3-158f3ce1c053 service nova] Creating event network-vif-deleted:048f5adc-313d-4db1-ae9f-fd93d10dfa2d for instance eb14d59c-595a-488d-8143-19f7f14b3b4c on n-h2-master-1 Oct 23 02:19:50.979230 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-3f24becc-1c3e-4ff4-b93e-bf02faff42f8 req-b3f98f7e-64f8-4359-98e3-158f3ce1c053 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036236 Oct 23 02:19:50.979848 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3854/7799] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:19:51.007981 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bbb500a8-97a9-4e1c-a4ce-ceee4eebc97b tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950bbf395604092937f0800037da97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1446559e0468399a0e47775c47baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:51.017592 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bbb500a8-97a9-4e1c-a4ce-ceee4eebc97b tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c" status: 200 len: 1516 microversion: 2.1 time: 0.091130 Oct 23 02:19:51.020769 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3946/7800] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:19:50 2022] GET /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c => generated 1516 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:19:52.042363 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ed3e65e2-b59d-41a5-8444-d07c582eaa5f tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:52.042998 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ed3e65e2-b59d-41a5-8444-d07c582eaa5f tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: eb14d59c-595a-488d-8143-19f7f14b3b4c] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:52.049333 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ed3e65e2-b59d-41a5-8444-d07c582eaa5f tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:52.049832 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ed3e65e2-b59d-41a5-8444-d07c582eaa5f tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:52.050338 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ed3e65e2-b59d-41a5-8444-d07c582eaa5f tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:52.055210 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ed3e65e2-b59d-41a5-8444-d07c582eaa5f tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:52.055210 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ed3e65e2-b59d-41a5-8444-d07c582eaa5f tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:52.055210 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ed3e65e2-b59d-41a5-8444-d07c582eaa5f tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:52.083662 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ed3e65e2-b59d-41a5-8444-d07c582eaa5f tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:52.084155 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ed3e65e2-b59d-41a5-8444-d07c582eaa5f tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:52.084607 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ed3e65e2-b59d-41a5-8444-d07c582eaa5f tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:52.085074 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-ed3e65e2-b59d-41a5-8444-d07c582eaa5f tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lazy-loading 'fault' on Instance uuid eb14d59c-595a-488d-8143-19f7f14b3b4c {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:19:52.126516 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ed3e65e2-b59d-41a5-8444-d07c582eaa5f tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950bbf395604092937f0800037da97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1446559e0468399a0e47775c47baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:52.133836 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ed3e65e2-b59d-41a5-8444-d07c582eaa5f tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c" status: 200 len: 1351 microversion: 2.1 time: 0.096754 Oct 23 02:19:52.134453 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3855/7801] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:19:52 2022] GET /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c => generated 1351 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:19:53.159019 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3db6acc6-b76b-47a2-ad77-b0449040aa33 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:53.166658 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3db6acc6-b76b-47a2-ad77-b0449040aa33 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: eb14d59c-595a-488d-8143-19f7f14b3b4c] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:53.166658 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3db6acc6-b76b-47a2-ad77-b0449040aa33 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:53.167099 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3db6acc6-b76b-47a2-ad77-b0449040aa33 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:53.167589 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3db6acc6-b76b-47a2-ad77-b0449040aa33 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:53.168289 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3db6acc6-b76b-47a2-ad77-b0449040aa33 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:53.168754 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3db6acc6-b76b-47a2-ad77-b0449040aa33 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:53.169186 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3db6acc6-b76b-47a2-ad77-b0449040aa33 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:53.182553 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-3db6acc6-b76b-47a2-ad77-b0449040aa33 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] HTTP exception thrown: Instance eb14d59c-595a-488d-8143-19f7f14b3b4c could not be found. Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3db6acc6-b76b-47a2-ad77-b0449040aa33 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Request method failure captured: Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c HTTP/1.1 Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVKRra6tMxZJw5JZn07so2mOmE2eS0A5zQJfeBaqQhWimZd2SNUloTIvPx7tsW01lQ8hb8KYuLHmRAWYB0Jt9FIOod-k7KpGZPX5Ob2-X1ilQqZoZGe6zyor7Mot40Z-Aw_i4d8FB5NMAw361lJ0tR_u6a58uTCdZ_VesPH26DM3fhrk Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 6ed1446559e0468399a0e47775c47baa Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-TestEncryptedCinderVolumes-2004212060 Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6ed1446559e0468399a0e47775c47baa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6ed1446559e0468399a0e47775c47baa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6ed1446559e0468399a0e47775c47baa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6ed1446559e0468399a0e47775c47baa"}]}] Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-TestEncryptedCinderVolumes-2004212060 Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 6ed1446559e0468399a0e47775c47baa Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-2004212060 Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-TestEncryptedCinderVolumes-2004212060-project Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: c950bbf395604092937f0800037da97f Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-TestEncryptedCinderVolumes-2004212060-project Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: exception: Instance eb14d59c-595a-488d-8143-19f7f14b3b4c could not be found. Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'eb14d59c-595a-488d-8143-19f7f14b3b4c'} Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb14d59c-595a-488d-8143-19f7f14b3b4c could not be found. Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb14d59c-595a-488d-8143-19f7f14b3b4c could not be found. Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:19:53.184140 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:19:53.192044 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:19:53.192044 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:19:53.192044 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:19:53.192044 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:19:53.192044 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:19:53.192044 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:19:53.192044 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb14d59c-595a-488d-8143-19f7f14b3b4c could not be found. Oct 23 02:19:53.192044 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:19:53.192044 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3db6acc6-b76b-47a2-ad77-b0449040aa33 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Returning 404 to user: Instance eb14d59c-595a-488d-8143-19f7f14b3b4c could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:19:53.192044 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3db6acc6-b76b-47a2-ad77-b0449040aa33 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c" status: 404 len: 111 microversion: 2.1 time: 0.030551 Oct 23 02:19:53.192044 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3947/7802] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:19:53 2022] GET /compute/v2.1/servers/eb14d59c-595a-488d-8143-19f7f14b3b4c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:19:53.194329 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-84ebebb0-d1a3-46a2-a473-50b953d4670f tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '.version_select at 0x7f5cc0cf7040>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:53.253986 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-84ebebb0-d1a3-46a2-a473-50b953d4670f tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-245296840" status: 202 len: 0 microversion: 2.1 time: 0.063394 Oct 23 02:19:53.254580 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3856/7803] 10.222.0.42 () {58 vars in 1275 bytes} [Sun Oct 23 02:19:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-245296840 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:19:53.280500 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-296c15c8-3168-4663-8d0b-23f38fafaa48 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Action: 'create', calling method: .version_select at 0x7f5cc0a1d310>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-703648764", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmAsycBHESrQMVsIpy/ZB/MIog9yQ703WXOl8jh30uKdpSt+SHNVtxFpUxk1bdixj9RrQwERo7lhH9sglNiOoIu3Vq47KmfGGOjI18qU4EhmGTDYTm0wkmqQq6jvD0iJA=="}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:19:53.296045 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-296c15c8-3168-4663-8d0b-23f38fafaa48 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Getting quotas for project 6ed1446559e0468399a0e47775c47baa. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:19:53.301056 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-296c15c8-3168-4663-8d0b-23f38fafaa48 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Getting quotas for user c950bbf395604092937f0800037da97f and project 6ed1446559e0468399a0e47775c47baa. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:19:53.374291 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-296c15c8-3168-4663-8d0b-23f38fafaa48 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.098252 Oct 23 02:19:53.374918 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3948/7804] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 02:19:53 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:19:53.426118 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-826b0727-8c78-45f5-a991-f89d7847618d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-119106167", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-703648764", "networks": [{"uuid": "7a446304-ebfa-4c4d-95f2-70414d327050"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:19:53.483539 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-826b0727-8c78-45f5-a991-f89d7847618d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] validate_networks() for [('7a446304-ebfa-4c4d-95f2-70414d327050', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 02:19:53.857846 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-826b0727-8c78-45f5-a991-f89d7847618d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:19:53.858302 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-826b0727-8c78-45f5-a991-f89d7847618d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:19:53.858810 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-826b0727-8c78-45f5-a991-f89d7847618d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:19:53.859230 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-826b0727-8c78-45f5-a991-f89d7847618d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:19:53.859651 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-826b0727-8c78-45f5-a991-f89d7847618d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:19:53.868753 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-826b0727-8c78-45f5-a991-f89d7847618d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:53.869242 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-826b0727-8c78-45f5-a991-f89d7847618d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:53.869684 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-826b0727-8c78-45f5-a991-f89d7847618d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:53.871031 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-826b0727-8c78-45f5-a991-f89d7847618d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:53.871498 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-826b0727-8c78-45f5-a991-f89d7847618d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:53.871928 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-826b0727-8c78-45f5-a991-f89d7847618d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:53.890695 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-826b0727-8c78-45f5-a991-f89d7847618d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Getting quotas for project 6ed1446559e0468399a0e47775c47baa. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:19:53.895979 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-826b0727-8c78-45f5-a991-f89d7847618d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Getting quotas for user c950bbf395604092937f0800037da97f and project 6ed1446559e0468399a0e47775c47baa. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:19:53.909647 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-826b0727-8c78-45f5-a991-f89d7847618d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 02:19:53.912019 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-826b0727-8c78-45f5-a991-f89d7847618d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 77231f1b-6753-4722-8369-e5146392c716] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 02:19:54.037186 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-826b0727-8c78-45f5-a991-f89d7847618d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.614938 Oct 23 02:19:54.042715 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3857/7805] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 02:19:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 02:19:54.049823 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4caf43cf-4ea7-4edc-b68b-f0a8440c7ff6 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:54.050847 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4caf43cf-4ea7-4edc-b68b-f0a8440c7ff6 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 77231f1b-6753-4722-8369-e5146392c716] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:54.109540 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4caf43cf-4ea7-4edc-b68b-f0a8440c7ff6 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950bbf395604092937f0800037da97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1446559e0468399a0e47775c47baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:54.117938 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4caf43cf-4ea7-4edc-b68b-f0a8440c7ff6 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716" status: 200 len: 1261 microversion: 2.1 time: 0.072178 Oct 23 02:19:54.118553 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3949/7806] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:19:54 2022] GET /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716 => generated 1261 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:19:55.142067 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6276cc24-d2b1-471c-bac8-7561a7107e13 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:55.142691 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6276cc24-d2b1-471c-bac8-7561a7107e13 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 77231f1b-6753-4722-8369-e5146392c716] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:55.149600 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6276cc24-d2b1-471c-bac8-7561a7107e13 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:55.150126 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6276cc24-d2b1-471c-bac8-7561a7107e13 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:55.150725 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6276cc24-d2b1-471c-bac8-7561a7107e13 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:55.151427 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6276cc24-d2b1-471c-bac8-7561a7107e13 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:55.152493 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6276cc24-d2b1-471c-bac8-7561a7107e13 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:55.152937 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6276cc24-d2b1-471c-bac8-7561a7107e13 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:55.213889 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6276cc24-d2b1-471c-bac8-7561a7107e13 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950bbf395604092937f0800037da97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1446559e0468399a0e47775c47baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:55.222326 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6276cc24-d2b1-471c-bac8-7561a7107e13 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716" status: 200 len: 1265 microversion: 2.1 time: 0.085083 Oct 23 02:19:55.222906 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3858/7807] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:19:55 2022] GET /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716 => generated 1265 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:19:56.248746 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9ddeffac-4fc0-4277-9863-7c799fedd8e9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:56.249534 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9ddeffac-4fc0-4277-9863-7c799fedd8e9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 77231f1b-6753-4722-8369-e5146392c716] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:56.256812 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ddeffac-4fc0-4277-9863-7c799fedd8e9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:56.257458 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ddeffac-4fc0-4277-9863-7c799fedd8e9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:56.258025 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ddeffac-4fc0-4277-9863-7c799fedd8e9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:56.258771 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ddeffac-4fc0-4277-9863-7c799fedd8e9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:56.259300 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ddeffac-4fc0-4277-9863-7c799fedd8e9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:56.259795 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9ddeffac-4fc0-4277-9863-7c799fedd8e9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:56.323175 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9ddeffac-4fc0-4277-9863-7c799fedd8e9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950bbf395604092937f0800037da97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1446559e0468399a0e47775c47baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:56.332420 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9ddeffac-4fc0-4277-9863-7c799fedd8e9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716" status: 200 len: 1321 microversion: 2.1 time: 0.089079 Oct 23 02:19:56.333405 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3950/7808] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:19:56 2022] GET /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716 => generated 1321 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:19:57.357207 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5edb2af4-7296-4e33-a5d4-3d4bc5238cf8 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:57.357751 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5edb2af4-7296-4e33-a5d4-3d4bc5238cf8 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 77231f1b-6753-4722-8369-e5146392c716] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:57.364949 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5edb2af4-7296-4e33-a5d4-3d4bc5238cf8 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:57.365493 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5edb2af4-7296-4e33-a5d4-3d4bc5238cf8 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:57.365952 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5edb2af4-7296-4e33-a5d4-3d4bc5238cf8 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:57.366846 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5edb2af4-7296-4e33-a5d4-3d4bc5238cf8 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:57.367319 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5edb2af4-7296-4e33-a5d4-3d4bc5238cf8 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:57.367759 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5edb2af4-7296-4e33-a5d4-3d4bc5238cf8 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:57.497771 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5edb2af4-7296-4e33-a5d4-3d4bc5238cf8 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950bbf395604092937f0800037da97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1446559e0468399a0e47775c47baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:57.505513 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5edb2af4-7296-4e33-a5d4-3d4bc5238cf8 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716" status: 200 len: 1361 microversion: 2.1 time: 0.152902 Oct 23 02:19:57.506111 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3859/7809] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:19:57 2022] GET /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:19:58.138307 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-e790d17d-8779-4f78-acdc-b1d09dd34a57 req-90af994f-75dc-4f29-99e6-a007e39118ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77231f1b-6753-4722-8369-e5146392c716", "tag": "cedd0a20-0c02-4dd7-afbb-4db6bdb8359c"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:19:58.149125 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-e790d17d-8779-4f78-acdc-b1d09dd34a57 req-90af994f-75dc-4f29-99e6-a007e39118ea service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:58.149615 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-e790d17d-8779-4f78-acdc-b1d09dd34a57 req-90af994f-75dc-4f29-99e6-a007e39118ea service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:58.150076 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-e790d17d-8779-4f78-acdc-b1d09dd34a57 req-90af994f-75dc-4f29-99e6-a007e39118ea service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:58.161067 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-e790d17d-8779-4f78-acdc-b1d09dd34a57 req-90af994f-75dc-4f29-99e6-a007e39118ea service nova] Creating event network-changed:cedd0a20-0c02-4dd7-afbb-4db6bdb8359c for instance 77231f1b-6753-4722-8369-e5146392c716 on n-h1-master-1 Oct 23 02:19:58.166172 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-e790d17d-8779-4f78-acdc-b1d09dd34a57 req-90af994f-75dc-4f29-99e6-a007e39118ea service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032186 Oct 23 02:19:58.166847 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3951/7810] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:19:58.529375 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fb9a380e-541b-498b-bc0a-cc98e166ddc8 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:58.530024 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-fb9a380e-541b-498b-bc0a-cc98e166ddc8 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 77231f1b-6753-4722-8369-e5146392c716] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:58.537177 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fb9a380e-541b-498b-bc0a-cc98e166ddc8 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:58.538094 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fb9a380e-541b-498b-bc0a-cc98e166ddc8 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:58.538243 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fb9a380e-541b-498b-bc0a-cc98e166ddc8 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:58.538901 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fb9a380e-541b-498b-bc0a-cc98e166ddc8 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:58.539366 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fb9a380e-541b-498b-bc0a-cc98e166ddc8 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:58.539801 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fb9a380e-541b-498b-bc0a-cc98e166ddc8 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:58.672739 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-fb9a380e-541b-498b-bc0a-cc98e166ddc8 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950bbf395604092937f0800037da97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1446559e0468399a0e47775c47baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:58.680496 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fb9a380e-541b-498b-bc0a-cc98e166ddc8 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716" status: 200 len: 1361 microversion: 2.1 time: 0.155663 Oct 23 02:19:58.681088 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3860/7811] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:19:58 2022] GET /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:19:59.705763 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1a86b250-d4a0-4daa-8ba3-60661355706c tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:59.706500 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1a86b250-d4a0-4daa-8ba3-60661355706c tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 77231f1b-6753-4722-8369-e5146392c716] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:59.712839 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1a86b250-d4a0-4daa-8ba3-60661355706c tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:59.713329 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1a86b250-d4a0-4daa-8ba3-60661355706c tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:59.713773 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1a86b250-d4a0-4daa-8ba3-60661355706c tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:59.714492 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1a86b250-d4a0-4daa-8ba3-60661355706c tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:59.714960 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1a86b250-d4a0-4daa-8ba3-60661355706c tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:59.715388 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1a86b250-d4a0-4daa-8ba3-60661355706c tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:59.844801 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1a86b250-d4a0-4daa-8ba3-60661355706c tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950bbf395604092937f0800037da97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1446559e0468399a0e47775c47baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:59.852569 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1a86b250-d4a0-4daa-8ba3-60661355706c tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716" status: 200 len: 1361 microversion: 2.1 time: 0.151954 Oct 23 02:19:59.853142 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3952/7812] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:19:59 2022] GET /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:00.876216 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-95c3288c-38e1-4ae3-986c-e7b4cfe4a3c9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:00.876765 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-95c3288c-38e1-4ae3-986c-e7b4cfe4a3c9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 77231f1b-6753-4722-8369-e5146392c716] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:00.884057 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-95c3288c-38e1-4ae3-986c-e7b4cfe4a3c9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:00.884549 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-95c3288c-38e1-4ae3-986c-e7b4cfe4a3c9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:00.884989 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-95c3288c-38e1-4ae3-986c-e7b4cfe4a3c9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:00.886184 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-95c3288c-38e1-4ae3-986c-e7b4cfe4a3c9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:00.886651 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-95c3288c-38e1-4ae3-986c-e7b4cfe4a3c9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:00.887080 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-95c3288c-38e1-4ae3-986c-e7b4cfe4a3c9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:01.019512 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-95c3288c-38e1-4ae3-986c-e7b4cfe4a3c9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950bbf395604092937f0800037da97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1446559e0468399a0e47775c47baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:01.027554 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-95c3288c-38e1-4ae3-986c-e7b4cfe4a3c9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716" status: 200 len: 1361 microversion: 2.1 time: 0.155315 Oct 23 02:20:01.028137 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3861/7813] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:00 2022] GET /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:02.050410 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-243f1c25-06a4-4d05-aa32-0f0bfef5a1e5 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:02.051035 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-243f1c25-06a4-4d05-aa32-0f0bfef5a1e5 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 77231f1b-6753-4722-8369-e5146392c716] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:02.057884 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-243f1c25-06a4-4d05-aa32-0f0bfef5a1e5 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:02.058408 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-243f1c25-06a4-4d05-aa32-0f0bfef5a1e5 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:02.058850 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-243f1c25-06a4-4d05-aa32-0f0bfef5a1e5 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:02.059566 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-243f1c25-06a4-4d05-aa32-0f0bfef5a1e5 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:02.060027 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-243f1c25-06a4-4d05-aa32-0f0bfef5a1e5 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:02.060458 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-243f1c25-06a4-4d05-aa32-0f0bfef5a1e5 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:02.189351 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-243f1c25-06a4-4d05-aa32-0f0bfef5a1e5 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950bbf395604092937f0800037da97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1446559e0468399a0e47775c47baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:02.197134 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-243f1c25-06a4-4d05-aa32-0f0bfef5a1e5 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716" status: 200 len: 1361 microversion: 2.1 time: 0.150768 Oct 23 02:20:02.197708 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3953/7814] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:02 2022] GET /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:03.220807 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-16520f32-a48a-4b1c-86a9-bd76e05225d1 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:03.221391 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-16520f32-a48a-4b1c-86a9-bd76e05225d1 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 77231f1b-6753-4722-8369-e5146392c716] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:03.228116 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-16520f32-a48a-4b1c-86a9-bd76e05225d1 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:03.228607 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-16520f32-a48a-4b1c-86a9-bd76e05225d1 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:03.229052 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-16520f32-a48a-4b1c-86a9-bd76e05225d1 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:03.230390 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-16520f32-a48a-4b1c-86a9-bd76e05225d1 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:03.230859 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-16520f32-a48a-4b1c-86a9-bd76e05225d1 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:03.231291 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-16520f32-a48a-4b1c-86a9-bd76e05225d1 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:03.360728 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-16520f32-a48a-4b1c-86a9-bd76e05225d1 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950bbf395604092937f0800037da97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1446559e0468399a0e47775c47baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:03.368522 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-16520f32-a48a-4b1c-86a9-bd76e05225d1 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716" status: 200 len: 1361 microversion: 2.1 time: 0.151898 Oct 23 02:20:03.369099 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3862/7815] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:03 2022] GET /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:04.392959 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-db282265-b6e0-44d5-81d3-645629e7c545 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:04.393383 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-db282265-b6e0-44d5-81d3-645629e7c545 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 77231f1b-6753-4722-8369-e5146392c716] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:04.396235 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=6 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:20:04.400973 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-db282265-b6e0-44d5-81d3-645629e7c545 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:04.402173 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-db282265-b6e0-44d5-81d3-645629e7c545 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:04.402616 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-db282265-b6e0-44d5-81d3-645629e7c545 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:04.403306 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-db282265-b6e0-44d5-81d3-645629e7c545 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:04.403764 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-db282265-b6e0-44d5-81d3-645629e7c545 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:04.404187 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-db282265-b6e0-44d5-81d3-645629e7c545 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:04.535591 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-db282265-b6e0-44d5-81d3-645629e7c545 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950bbf395604092937f0800037da97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1446559e0468399a0e47775c47baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:04.543665 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-db282265-b6e0-44d5-81d3-645629e7c545 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716" status: 200 len: 1361 microversion: 2.1 time: 0.154863 Oct 23 02:20:04.544491 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3954/7816] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:04 2022] GET /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:04.593895 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:20:04.598624 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=6 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:20:04.676227 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-66e5a387-a504-4b3f-b3df-7690d760aa94 req-484d66b8-43cc-4c21-9f8b-292bd417efd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77231f1b-6753-4722-8369-e5146392c716", "name": "network-vif-plugged", "status": "completed", "tag": "cedd0a20-0c02-4dd7-afbb-4db6bdb8359c"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:20:04.686479 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-66e5a387-a504-4b3f-b3df-7690d760aa94 req-484d66b8-43cc-4c21-9f8b-292bd417efd1 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:04.686895 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-66e5a387-a504-4b3f-b3df-7690d760aa94 req-484d66b8-43cc-4c21-9f8b-292bd417efd1 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:04.687334 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-66e5a387-a504-4b3f-b3df-7690d760aa94 req-484d66b8-43cc-4c21-9f8b-292bd417efd1 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:04.698877 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-66e5a387-a504-4b3f-b3df-7690d760aa94 req-484d66b8-43cc-4c21-9f8b-292bd417efd1 service nova] Creating event network-vif-plugged:cedd0a20-0c02-4dd7-afbb-4db6bdb8359c for instance 77231f1b-6753-4722-8369-e5146392c716 on n-h1-master-1 Oct 23 02:20:04.703911 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-66e5a387-a504-4b3f-b3df-7690d760aa94 req-484d66b8-43cc-4c21-9f8b-292bd417efd1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115431 Oct 23 02:20:04.704546 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3863/7817] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:20:05.566736 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-29947ee5-559e-4768-88aa-195d3a0cf109 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:05.567368 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-29947ee5-559e-4768-88aa-195d3a0cf109 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 77231f1b-6753-4722-8369-e5146392c716] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:05.574356 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-29947ee5-559e-4768-88aa-195d3a0cf109 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:05.574847 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-29947ee5-559e-4768-88aa-195d3a0cf109 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:05.575291 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-29947ee5-559e-4768-88aa-195d3a0cf109 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:05.575992 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-29947ee5-559e-4768-88aa-195d3a0cf109 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:05.576454 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-29947ee5-559e-4768-88aa-195d3a0cf109 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:05.576891 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-29947ee5-559e-4768-88aa-195d3a0cf109 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:05.704456 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-29947ee5-559e-4768-88aa-195d3a0cf109 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950bbf395604092937f0800037da97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1446559e0468399a0e47775c47baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:05.712143 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-29947ee5-559e-4768-88aa-195d3a0cf109 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716" status: 200 len: 1361 microversion: 2.1 time: 0.149405 Oct 23 02:20:05.712719 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3955/7818] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:05 2022] GET /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716 => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:06.738588 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-42d1c70d-2020-4fdc-a1ed-5d64b9b2e7c2 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:06.739237 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-42d1c70d-2020-4fdc-a1ed-5d64b9b2e7c2 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 77231f1b-6753-4722-8369-e5146392c716] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:06.746941 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-42d1c70d-2020-4fdc-a1ed-5d64b9b2e7c2 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:06.747428 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-42d1c70d-2020-4fdc-a1ed-5d64b9b2e7c2 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:06.747865 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-42d1c70d-2020-4fdc-a1ed-5d64b9b2e7c2 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:06.748547 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-42d1c70d-2020-4fdc-a1ed-5d64b9b2e7c2 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:06.749004 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-42d1c70d-2020-4fdc-a1ed-5d64b9b2e7c2 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:06.749432 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-42d1c70d-2020-4fdc-a1ed-5d64b9b2e7c2 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:06.880028 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-42d1c70d-2020-4fdc-a1ed-5d64b9b2e7c2 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950bbf395604092937f0800037da97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1446559e0468399a0e47775c47baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:06.883616 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:20:06.888162 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-42d1c70d-2020-4fdc-a1ed-5d64b9b2e7c2 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716" status: 200 len: 1552 microversion: 2.1 time: 0.155683 Oct 23 02:20:06.888729 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3864/7819] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:06 2022] GET /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716 => generated 1552 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:06.921225 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-235ae170-c00f-448d-952f-4f312c6627de tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:06.921844 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-235ae170-c00f-448d-952f-4f312c6627de tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 77231f1b-6753-4722-8369-e5146392c716] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:06.929263 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-235ae170-c00f-448d-952f-4f312c6627de tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:06.929754 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-235ae170-c00f-448d-952f-4f312c6627de tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:06.930221 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-235ae170-c00f-448d-952f-4f312c6627de tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:06.930918 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-235ae170-c00f-448d-952f-4f312c6627de tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:06.931381 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-235ae170-c00f-448d-952f-4f312c6627de tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:06.931811 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-235ae170-c00f-448d-952f-4f312c6627de tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:07.057940 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-235ae170-c00f-448d-952f-4f312c6627de tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950bbf395604092937f0800037da97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1446559e0468399a0e47775c47baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:07.065805 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-235ae170-c00f-448d-952f-4f312c6627de tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716" status: 200 len: 1552 microversion: 2.1 time: 0.149189 Oct 23 02:20:07.070923 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3956/7820] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:06 2022] GET /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716 => generated 1552 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:09.981920 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6ba52e17-6184-4cfc-b655-d6cc104e3735 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b3679ba3-83cc-466a-a4b9-c553fe25e204"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:20:09.984389 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6ba52e17-6184-4cfc-b655-d6cc104e3735 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 77231f1b-6753-4722-8369-e5146392c716] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:09.987482 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:20:09.992422 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6ba52e17-6184-4cfc-b655-d6cc104e3735 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:09.992921 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6ba52e17-6184-4cfc-b655-d6cc104e3735 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:09.993370 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6ba52e17-6184-4cfc-b655-d6cc104e3735 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:09.994097 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6ba52e17-6184-4cfc-b655-d6cc104e3735 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:09.994565 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6ba52e17-6184-4cfc-b655-d6cc104e3735 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:09.995483 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6ba52e17-6184-4cfc-b655-d6cc104e3735 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:10.656441 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6ba52e17-6184-4cfc-b655-d6cc104e3735 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "POST /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.678115 Oct 23 02:20:10.657053 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3865/7821] 10.222.0.42 () {60 vars in 1323 bytes} [Sun Oct 23 02:20:09 2022] POST /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716/os-volume_attachments => generated 194 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:20:22.419621 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cf5ae876-a802-46ec-a29d-965ca74aa88c tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:22.420133 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-cf5ae876-a802-46ec-a29d-965ca74aa88c tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 77231f1b-6753-4722-8369-e5146392c716] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:22.422360 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:20:22.423023 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=76 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:20:22.427723 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf5ae876-a802-46ec-a29d-965ca74aa88c tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:22.429054 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf5ae876-a802-46ec-a29d-965ca74aa88c tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:22.429054 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf5ae876-a802-46ec-a29d-965ca74aa88c tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:22.429329 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf5ae876-a802-46ec-a29d-965ca74aa88c tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:22.429791 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf5ae876-a802-46ec-a29d-965ca74aa88c tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:22.430251 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf5ae876-a802-46ec-a29d-965ca74aa88c tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:22.513134 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-cf5ae876-a802-46ec-a29d-965ca74aa88c tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lazy-loading 'services' on Instance uuid 77231f1b-6753-4722-8369-e5146392c716 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:20:22.725222 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cf5ae876-a802-46ec-a29d-965ca74aa88c tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "DELETE /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716/os-volume_attachments/b3679ba3-83cc-466a-a4b9-c553fe25e204" status: 202 len: 0 microversion: 2.1 time: 0.310114 Oct 23 02:20:22.725860 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3957/7822] 10.222.0.42 () {58 vars in 1416 bytes} [Sun Oct 23 02:20:22 2022] DELETE /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716/os-volume_attachments/b3679ba3-83cc-466a-a4b9-c553fe25e204 => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:20:22.733920 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:20:22.734912 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:20:22.739142 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-147adbc2-2976-4cd6-9856-445a78824d8f tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:22.741764 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-147adbc2-2976-4cd6-9856-445a78824d8f tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 77231f1b-6753-4722-8369-e5146392c716] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:22.747983 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-147adbc2-2976-4cd6-9856-445a78824d8f tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:22.752662 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-147adbc2-2976-4cd6-9856-445a78824d8f tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:22.752662 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-147adbc2-2976-4cd6-9856-445a78824d8f tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:22.752662 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-147adbc2-2976-4cd6-9856-445a78824d8f tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:22.752662 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-147adbc2-2976-4cd6-9856-445a78824d8f tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:22.752662 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-147adbc2-2976-4cd6-9856-445a78824d8f tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:22.781635 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-147adbc2-2976-4cd6-9856-445a78824d8f tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049713 Oct 23 02:20:22.782425 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3866/7823] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 02:20:22 2022] GET /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:20:23.796374 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0d6f88d4-42ba-484e-b427-79958ad2365e tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:23.798815 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0d6f88d4-42ba-484e-b427-79958ad2365e tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 77231f1b-6753-4722-8369-e5146392c716] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:23.805135 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0d6f88d4-42ba-484e-b427-79958ad2365e tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:23.805627 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0d6f88d4-42ba-484e-b427-79958ad2365e tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:23.806095 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0d6f88d4-42ba-484e-b427-79958ad2365e tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:23.807423 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0d6f88d4-42ba-484e-b427-79958ad2365e tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:23.807885 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0d6f88d4-42ba-484e-b427-79958ad2365e tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:23.808316 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0d6f88d4-42ba-484e-b427-79958ad2365e tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:23.838703 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0d6f88d4-42ba-484e-b427-79958ad2365e tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048076 Oct 23 02:20:23.839274 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3958/7824] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 02:20:23 2022] GET /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:20:24.851217 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1fe9c596-a70c-4d2d-b7c5-4cb5655e96e7 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:24.854154 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1fe9c596-a70c-4d2d-b7c5-4cb5655e96e7 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 77231f1b-6753-4722-8369-e5146392c716] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:24.862287 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1fe9c596-a70c-4d2d-b7c5-4cb5655e96e7 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:24.862925 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1fe9c596-a70c-4d2d-b7c5-4cb5655e96e7 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:24.863278 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1fe9c596-a70c-4d2d-b7c5-4cb5655e96e7 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:24.863996 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1fe9c596-a70c-4d2d-b7c5-4cb5655e96e7 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:24.864473 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1fe9c596-a70c-4d2d-b7c5-4cb5655e96e7 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:24.864907 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1fe9c596-a70c-4d2d-b7c5-4cb5655e96e7 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:24.896177 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1fe9c596-a70c-4d2d-b7c5-4cb5655e96e7 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048948 Oct 23 02:20:24.896749 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3867/7825] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 02:20:24 2022] GET /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:20:25.909152 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b9a0de94-3d21-41ad-895c-066ae768c67d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:25.911392 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b9a0de94-3d21-41ad-895c-066ae768c67d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 77231f1b-6753-4722-8369-e5146392c716] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:25.918723 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b9a0de94-3d21-41ad-895c-066ae768c67d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:25.919224 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b9a0de94-3d21-41ad-895c-066ae768c67d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:25.919670 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b9a0de94-3d21-41ad-895c-066ae768c67d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:25.920592 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b9a0de94-3d21-41ad-895c-066ae768c67d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:25.921236 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b9a0de94-3d21-41ad-895c-066ae768c67d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:25.921673 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b9a0de94-3d21-41ad-895c-066ae768c67d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:25.956729 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b9a0de94-3d21-41ad-895c-066ae768c67d tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051736 Oct 23 02:20:25.957357 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3959/7826] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 02:20:25 2022] GET /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:20:26.969739 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-59e03803-5a94-4136-bbb2-fec8e241c851 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:26.971934 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-59e03803-5a94-4136-bbb2-fec8e241c851 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 77231f1b-6753-4722-8369-e5146392c716] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:26.979439 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-59e03803-5a94-4136-bbb2-fec8e241c851 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:26.979943 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-59e03803-5a94-4136-bbb2-fec8e241c851 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:26.980395 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-59e03803-5a94-4136-bbb2-fec8e241c851 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:26.981104 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-59e03803-5a94-4136-bbb2-fec8e241c851 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:26.981604 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-59e03803-5a94-4136-bbb2-fec8e241c851 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:26.982074 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-59e03803-5a94-4136-bbb2-fec8e241c851 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:27.014970 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-59e03803-5a94-4136-bbb2-fec8e241c851 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049520 Oct 23 02:20:27.015552 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3868/7827] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 02:20:26 2022] GET /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:20:28.028069 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fc7862e7-1ffd-4010-84a5-db626d2e3978 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:28.030336 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fc7862e7-1ffd-4010-84a5-db626d2e3978 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 77231f1b-6753-4722-8369-e5146392c716] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:28.037593 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fc7862e7-1ffd-4010-84a5-db626d2e3978 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:28.038133 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fc7862e7-1ffd-4010-84a5-db626d2e3978 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:28.038606 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fc7862e7-1ffd-4010-84a5-db626d2e3978 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:28.039290 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fc7862e7-1ffd-4010-84a5-db626d2e3978 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:28.039757 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fc7862e7-1ffd-4010-84a5-db626d2e3978 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:28.040188 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fc7862e7-1ffd-4010-84a5-db626d2e3978 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:28.069771 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fc7862e7-1ffd-4010-84a5-db626d2e3978 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046311 Oct 23 02:20:28.070357 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3960/7828] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 02:20:28 2022] GET /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 02:20:28.081053 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8d37ca40-cd89-4d0a-a37d-a90de205dcb9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:28.081554 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8d37ca40-cd89-4d0a-a37d-a90de205dcb9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 77231f1b-6753-4722-8369-e5146392c716] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:28.088521 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d37ca40-cd89-4d0a-a37d-a90de205dcb9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:28.089502 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d37ca40-cd89-4d0a-a37d-a90de205dcb9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:28.089949 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d37ca40-cd89-4d0a-a37d-a90de205dcb9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:28.090666 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d37ca40-cd89-4d0a-a37d-a90de205dcb9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:28.091132 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d37ca40-cd89-4d0a-a37d-a90de205dcb9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:28.091569 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d37ca40-cd89-4d0a-a37d-a90de205dcb9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:28.165864 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-8d37ca40-cd89-4d0a-a37d-a90de205dcb9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] HTTP exception thrown: Instance 77231f1b-6753-4722-8369-e5146392c716 is not attached to volume b3679ba3-83cc-466a-a4b9-c553fe25e204 Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8d37ca40-cd89-4d0a-a37d-a90de205dcb9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Request method failure captured: Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716/os-volume_attachments/b3679ba3-83cc-466a-a4b9-c553fe25e204 HTTP/1.1 Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVKRra6tMxZJw5JZn07so2mOmE2eS0A5zQJfeBaqQhWimZd2SNUloTIvPx7tsW01lQ8hb8KYuLHmRAWYB0Jt9FIOod-k7KpGZPX5Ob2-X1ilQqZoZGe6zyor7Mot40Z-Aw_i4d8FB5NMAw361lJ0tR_u6a58uTCdZ_VesPH26DM3fhrk Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 6ed1446559e0468399a0e47775c47baa Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-TestEncryptedCinderVolumes-2004212060 Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6ed1446559e0468399a0e47775c47baa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6ed1446559e0468399a0e47775c47baa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6ed1446559e0468399a0e47775c47baa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6ed1446559e0468399a0e47775c47baa"}]}] Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-TestEncryptedCinderVolumes-2004212060 Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 6ed1446559e0468399a0e47775c47baa Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-2004212060 Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-TestEncryptedCinderVolumes-2004212060-project Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: c950bbf395604092937f0800037da97f Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-TestEncryptedCinderVolumes-2004212060-project Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 77231f1b-6753-4722-8369-e5146392c716 is not attached to volume b3679ba3-83cc-466a-a4b9-c553fe25e204 Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: action_args: {'server_id': '77231f1b-6753-4722-8369-e5146392c716', 'id': 'b3679ba3-83cc-466a-a4b9-c553fe25e204'} Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b3679ba3-83cc-466a-a4b9-c553fe25e204. Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77231f1b-6753-4722-8369-e5146392c716 is not attached to volume b3679ba3-83cc-466a-a4b9-c553fe25e204 Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:20:28.168575 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:20:28.173214 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:20:28.173214 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:20:28.173214 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77231f1b-6753-4722-8369-e5146392c716 is not attached to volume b3679ba3-83cc-466a-a4b9-c553fe25e204 Oct 23 02:20:28.173214 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:20:28.173214 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8d37ca40-cd89-4d0a-a37d-a90de205dcb9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Returning 404 to user: Instance 77231f1b-6753-4722-8369-e5146392c716 is not attached to volume b3679ba3-83cc-466a-a4b9-c553fe25e204 {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:20:28.173214 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8d37ca40-cd89-4d0a-a37d-a90de205dcb9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "DELETE /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716/os-volume_attachments/b3679ba3-83cc-466a-a4b9-c553fe25e204" status: 404 len: 154 microversion: 2.1 time: 0.093041 Oct 23 02:20:28.173214 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3869/7829] 10.222.0.42 () {58 vars in 1416 bytes} [Sun Oct 23 02:20:28 2022] DELETE /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716/os-volume_attachments/b3679ba3-83cc-466a-a4b9-c553fe25e204 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:20:31.683327 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b19972bc-aedb-4243-89a6-695c05001d0f tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:31.685429 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b19972bc-aedb-4243-89a6-695c05001d0f tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 77231f1b-6753-4722-8369-e5146392c716] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:31.690928 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b19972bc-aedb-4243-89a6-695c05001d0f tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:31.691404 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b19972bc-aedb-4243-89a6-695c05001d0f tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:31.691845 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b19972bc-aedb-4243-89a6-695c05001d0f tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:31.692539 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b19972bc-aedb-4243-89a6-695c05001d0f tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:31.692998 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b19972bc-aedb-4243-89a6-695c05001d0f tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:31.693428 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b19972bc-aedb-4243-89a6-695c05001d0f tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:31.720353 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b19972bc-aedb-4243-89a6-695c05001d0f tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 77231f1b-6753-4722-8369-e5146392c716] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 02:20:31.962464 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b19972bc-aedb-4243-89a6-695c05001d0f tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "DELETE /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716" status: 204 len: 0 microversion: 2.1 time: 0.283194 Oct 23 02:20:31.965263 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3961/7830] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 02:20:31 2022] DELETE /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 02:20:31.972338 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-539bc0cc-f5f9-4ce8-8076-34d4b9175da4 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:31.972969 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-539bc0cc-f5f9-4ce8-8076-34d4b9175da4 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 77231f1b-6753-4722-8369-e5146392c716] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:31.980515 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-539bc0cc-f5f9-4ce8-8076-34d4b9175da4 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:31.981017 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-539bc0cc-f5f9-4ce8-8076-34d4b9175da4 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:31.981521 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-539bc0cc-f5f9-4ce8-8076-34d4b9175da4 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:31.982259 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-539bc0cc-f5f9-4ce8-8076-34d4b9175da4 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:31.982727 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-539bc0cc-f5f9-4ce8-8076-34d4b9175da4 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:31.983162 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-539bc0cc-f5f9-4ce8-8076-34d4b9175da4 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:32.118613 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-539bc0cc-f5f9-4ce8-8076-34d4b9175da4 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950bbf395604092937f0800037da97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1446559e0468399a0e47775c47baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:32.126828 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-539bc0cc-f5f9-4ce8-8076-34d4b9175da4 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716" status: 200 len: 1558 microversion: 2.1 time: 0.158408 Oct 23 02:20:32.127403 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3870/7831] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:31 2022] GET /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:20:33.151669 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-01668f58-27e4-4675-a821-8cb9686400bb tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:33.152372 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-01668f58-27e4-4675-a821-8cb9686400bb tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 77231f1b-6753-4722-8369-e5146392c716] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:33.159256 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01668f58-27e4-4675-a821-8cb9686400bb tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:33.164526 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01668f58-27e4-4675-a821-8cb9686400bb tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:33.164526 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01668f58-27e4-4675-a821-8cb9686400bb tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:33.164526 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01668f58-27e4-4675-a821-8cb9686400bb tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:33.164526 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01668f58-27e4-4675-a821-8cb9686400bb tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:33.164526 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01668f58-27e4-4675-a821-8cb9686400bb tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:33.289454 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-01668f58-27e4-4675-a821-8cb9686400bb tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950bbf395604092937f0800037da97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1446559e0468399a0e47775c47baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:33.297821 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-01668f58-27e4-4675-a821-8cb9686400bb tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716" status: 200 len: 1558 microversion: 2.1 time: 0.151076 Oct 23 02:20:33.298425 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3962/7832] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:33 2022] GET /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:34.302166 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-1dffe58f-9f09-47b3-a416-8b6e41056a69 req-35a406ab-c363-4e0b-9881-61e1195f80ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77231f1b-6753-4722-8369-e5146392c716", "name": "network-vif-deleted", "tag": "cedd0a20-0c02-4dd7-afbb-4db6bdb8359c"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:20:34.313069 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-1dffe58f-9f09-47b3-a416-8b6e41056a69 req-35a406ab-c363-4e0b-9881-61e1195f80ba service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:34.313555 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-1dffe58f-9f09-47b3-a416-8b6e41056a69 req-35a406ab-c363-4e0b-9881-61e1195f80ba service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:34.314021 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-1dffe58f-9f09-47b3-a416-8b6e41056a69 req-35a406ab-c363-4e0b-9881-61e1195f80ba service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:34.320893 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d8766a3c-9d54-411f-8f37-5ac488252c59 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:34.321523 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d8766a3c-9d54-411f-8f37-5ac488252c59 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 77231f1b-6753-4722-8369-e5146392c716] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:34.325491 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-1dffe58f-9f09-47b3-a416-8b6e41056a69 req-35a406ab-c363-4e0b-9881-61e1195f80ba service nova] Creating event network-vif-deleted:cedd0a20-0c02-4dd7-afbb-4db6bdb8359c for instance 77231f1b-6753-4722-8369-e5146392c716 on n-h1-master-1 Oct 23 02:20:34.329574 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d8766a3c-9d54-411f-8f37-5ac488252c59 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:34.330195 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d8766a3c-9d54-411f-8f37-5ac488252c59 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:34.330552 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-1dffe58f-9f09-47b3-a416-8b6e41056a69 req-35a406ab-c363-4e0b-9881-61e1195f80ba service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032142 Oct 23 02:20:34.330672 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d8766a3c-9d54-411f-8f37-5ac488252c59 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:34.331149 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3871/7833] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:20:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:20:34.331405 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d8766a3c-9d54-411f-8f37-5ac488252c59 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:34.331868 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d8766a3c-9d54-411f-8f37-5ac488252c59 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:34.332302 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d8766a3c-9d54-411f-8f37-5ac488252c59 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:34.398409 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d8766a3c-9d54-411f-8f37-5ac488252c59 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950bbf395604092937f0800037da97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1446559e0468399a0e47775c47baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:34.406223 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d8766a3c-9d54-411f-8f37-5ac488252c59 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716" status: 200 len: 1516 microversion: 2.1 time: 0.089371 Oct 23 02:20:34.406808 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3963/7834] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:34 2022] GET /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716 => generated 1516 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:20:35.431231 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d9cacfd6-d473-411e-a86f-d5830bccaff9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:35.431969 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d9cacfd6-d473-411e-a86f-d5830bccaff9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 77231f1b-6753-4722-8369-e5146392c716] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:35.438687 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9cacfd6-d473-411e-a86f-d5830bccaff9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:35.439177 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9cacfd6-d473-411e-a86f-d5830bccaff9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:35.439622 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9cacfd6-d473-411e-a86f-d5830bccaff9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:35.440320 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9cacfd6-d473-411e-a86f-d5830bccaff9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:35.440786 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9cacfd6-d473-411e-a86f-d5830bccaff9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:35.441218 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9cacfd6-d473-411e-a86f-d5830bccaff9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:35.473088 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9cacfd6-d473-411e-a86f-d5830bccaff9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:35.473577 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9cacfd6-d473-411e-a86f-d5830bccaff9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:35.474042 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9cacfd6-d473-411e-a86f-d5830bccaff9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:35.474499 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-d9cacfd6-d473-411e-a86f-d5830bccaff9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lazy-loading 'fault' on Instance uuid 77231f1b-6753-4722-8369-e5146392c716 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:20:35.519089 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d9cacfd6-d473-411e-a86f-d5830bccaff9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950bbf395604092937f0800037da97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1446559e0468399a0e47775c47baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:35.526303 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d9cacfd6-d473-411e-a86f-d5830bccaff9 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716" status: 200 len: 1351 microversion: 2.1 time: 0.100165 Oct 23 02:20:35.526889 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3872/7835] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:35 2022] GET /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716 => generated 1351 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:36.551598 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-89bbe2ef-7f04-49e4-83c5-1aaa73c0ddb7 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:36.552224 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-89bbe2ef-7f04-49e4-83c5-1aaa73c0ddb7 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] [instance: 77231f1b-6753-4722-8369-e5146392c716] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:36.559126 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-89bbe2ef-7f04-49e4-83c5-1aaa73c0ddb7 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:36.559613 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-89bbe2ef-7f04-49e4-83c5-1aaa73c0ddb7 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:36.560065 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-89bbe2ef-7f04-49e4-83c5-1aaa73c0ddb7 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:36.560767 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-89bbe2ef-7f04-49e4-83c5-1aaa73c0ddb7 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:36.561230 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-89bbe2ef-7f04-49e4-83c5-1aaa73c0ddb7 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:36.561663 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-89bbe2ef-7f04-49e4-83c5-1aaa73c0ddb7 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:36.575391 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-89bbe2ef-7f04-49e4-83c5-1aaa73c0ddb7 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] HTTP exception thrown: Instance 77231f1b-6753-4722-8369-e5146392c716 could not be found. Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-89bbe2ef-7f04-49e4-83c5-1aaa73c0ddb7 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Request method failure captured: Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716 HTTP/1.1 Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVKRra6tMxZJw5JZn07so2mOmE2eS0A5zQJfeBaqQhWimZd2SNUloTIvPx7tsW01lQ8hb8KYuLHmRAWYB0Jt9FIOod-k7KpGZPX5Ob2-X1ilQqZoZGe6zyor7Mot40Z-Aw_i4d8FB5NMAw361lJ0tR_u6a58uTCdZ_VesPH26DM3fhrk Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 6ed1446559e0468399a0e47775c47baa Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-TestEncryptedCinderVolumes-2004212060 Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6ed1446559e0468399a0e47775c47baa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6ed1446559e0468399a0e47775c47baa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6ed1446559e0468399a0e47775c47baa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6ed1446559e0468399a0e47775c47baa"}]}] Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-TestEncryptedCinderVolumes-2004212060 Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 6ed1446559e0468399a0e47775c47baa Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-2004212060 Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-TestEncryptedCinderVolumes-2004212060-project Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: c950bbf395604092937f0800037da97f Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-TestEncryptedCinderVolumes-2004212060-project Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 77231f1b-6753-4722-8369-e5146392c716 could not be found. Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '77231f1b-6753-4722-8369-e5146392c716'} Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77231f1b-6753-4722-8369-e5146392c716 could not be found. Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77231f1b-6753-4722-8369-e5146392c716 could not be found. Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:20:36.577038 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:20:36.581873 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:20:36.581873 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:20:36.581873 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:20:36.581873 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:20:36.581873 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:20:36.581873 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:20:36.581873 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77231f1b-6753-4722-8369-e5146392c716 could not be found. Oct 23 02:20:36.581873 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:20:36.581873 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-89bbe2ef-7f04-49e4-83c5-1aaa73c0ddb7 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Returning 404 to user: Instance 77231f1b-6753-4722-8369-e5146392c716 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:20:36.581873 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-89bbe2ef-7f04-49e4-83c5-1aaa73c0ddb7 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "GET /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716" status: 404 len: 111 microversion: 2.1 time: 0.031191 Oct 23 02:20:36.581873 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3964/7836] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:36 2022] GET /compute/v2.1/servers/77231f1b-6753-4722-8369-e5146392c716 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:20:36.587217 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d40e97a5-1868-4566-bded-713f682fba88 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] Calling method '.version_select at 0x7f5cc0393d30>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:36.641459 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d40e97a5-1868-4566-bded-713f682fba88 tempest-TestEncryptedCinderVolumes-2004212060 tempest-TestEncryptedCinderVolumes-2004212060-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-703648764" status: 202 len: 0 microversion: 2.1 time: 0.058000 Oct 23 02:20:36.642059 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3873/7837] 10.222.0.42 () {58 vars in 1275 bytes} [Sun Oct 23 02:20:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-703648764 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:21:08.918505 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-08ecf487-7f03-4704-8509-b38b58098b1f tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Action: 'create', calling method: .version_select at 0x7f5cc09dd280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1345411755", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaLfssHdO9MWM/rM9SBkjg86xicuPRBRRnKIgrxddBe6BMUwFvSqO9NfRSn6ip3+c0iuz/Ba4P1q+ybvzES+0xpYnblCAafp9nwSPlNFG79FRuXDjuZiyIn5et3rwxK8Q=="}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:21:08.924266 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:21:08.924934 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:21:08.936757 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-08ecf487-7f03-4704-8509-b38b58098b1f tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Getting quotas for project dd9a5526b8c7450a9227d266ecf33487. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:21:08.942064 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-08ecf487-7f03-4704-8509-b38b58098b1f tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Getting quotas for user 722e7b72a173401fa175378ab373c26e and project dd9a5526b8c7450a9227d266ecf33487. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:21:09.046370 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-08ecf487-7f03-4704-8509-b38b58098b1f tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.132112 Oct 23 02:21:09.046901 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3965/7838] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 02:21:08 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:21:09.098649 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=40 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:21:09.099435 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:21:09.103431 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0a2316bd-b8f9-4c4a-888c-6c7ccfc37cb9 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1748680167", "imageRef": "ea32b8d9-7e95-4f53-8e38-aaa6d720360d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1345411755", "networks": [{"uuid": "9bfae18f-034f-4ff6-b338-d067f1653daf"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:21:09.155348 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-0a2316bd-b8f9-4c4a-888c-6c7ccfc37cb9 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] validate_networks() for [('9bfae18f-034f-4ff6-b338-d067f1653daf', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 02:21:09.534040 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-0a2316bd-b8f9-4c4a-888c-6c7ccfc37cb9 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:21:09.534533 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-0a2316bd-b8f9-4c4a-888c-6c7ccfc37cb9 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:21:09.535024 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-0a2316bd-b8f9-4c4a-888c-6c7ccfc37cb9 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:21:09.535453 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-0a2316bd-b8f9-4c4a-888c-6c7ccfc37cb9 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:21:09.536001 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-0a2316bd-b8f9-4c4a-888c-6c7ccfc37cb9 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:21:09.545672 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0a2316bd-b8f9-4c4a-888c-6c7ccfc37cb9 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:09.546207 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0a2316bd-b8f9-4c4a-888c-6c7ccfc37cb9 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:09.546662 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0a2316bd-b8f9-4c4a-888c-6c7ccfc37cb9 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:09.547402 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0a2316bd-b8f9-4c4a-888c-6c7ccfc37cb9 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:09.547873 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0a2316bd-b8f9-4c4a-888c-6c7ccfc37cb9 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:09.548313 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0a2316bd-b8f9-4c4a-888c-6c7ccfc37cb9 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:09.567125 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-0a2316bd-b8f9-4c4a-888c-6c7ccfc37cb9 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Getting quotas for project dd9a5526b8c7450a9227d266ecf33487. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:21:09.572437 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-0a2316bd-b8f9-4c4a-888c-6c7ccfc37cb9 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Getting quotas for user 722e7b72a173401fa175378ab373c26e and project dd9a5526b8c7450a9227d266ecf33487. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:21:09.585669 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0a2316bd-b8f9-4c4a-888c-6c7ccfc37cb9 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 02:21:09.587911 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0a2316bd-b8f9-4c4a-888c-6c7ccfc37cb9 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 97e88492-4fb3-48a2-b8b0-1a94d759251d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ea32b8d9-7e95-4f53-8e38-aaa6d720360d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 02:21:09.728298 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0a2316bd-b8f9-4c4a-888c-6c7ccfc37cb9 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.631656 Oct 23 02:21:09.728949 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3874/7839] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 02:21:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 23 02:21:09.740609 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d15630ce-45d4-4243-8d34-58e7ed7bb426 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:09.752787 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d15630ce-45d4-4243-8d34-58e7ed7bb426 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 97e88492-4fb3-48a2-b8b0-1a94d759251d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:09.798779 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d15630ce-45d4-4243-8d34-58e7ed7bb426 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:09.806961 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d15630ce-45d4-4243-8d34-58e7ed7bb426 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d" status: 200 len: 1259 microversion: 2.1 time: 0.070841 Oct 23 02:21:09.807818 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3966/7840] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:09 2022] GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d => generated 1259 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:10.831019 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7b15fb11-1cba-467e-92f9-e965212adbf9 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:10.831653 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7b15fb11-1cba-467e-92f9-e965212adbf9 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 97e88492-4fb3-48a2-b8b0-1a94d759251d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:10.838309 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b15fb11-1cba-467e-92f9-e965212adbf9 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:10.838809 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b15fb11-1cba-467e-92f9-e965212adbf9 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:10.839262 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b15fb11-1cba-467e-92f9-e965212adbf9 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:10.839954 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b15fb11-1cba-467e-92f9-e965212adbf9 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:10.840418 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b15fb11-1cba-467e-92f9-e965212adbf9 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:10.840898 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7b15fb11-1cba-467e-92f9-e965212adbf9 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:10.902608 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7b15fb11-1cba-467e-92f9-e965212adbf9 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:10.910261 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7b15fb11-1cba-467e-92f9-e965212adbf9 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d" status: 200 len: 1263 microversion: 2.1 time: 0.084132 Oct 23 02:21:10.910834 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3875/7841] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:10 2022] GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d => generated 1263 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:11.934113 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e87f309e-7e60-4a63-8930-b0d67ee846d4 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:11.935266 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e87f309e-7e60-4a63-8930-b0d67ee846d4 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 97e88492-4fb3-48a2-b8b0-1a94d759251d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:11.942539 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e87f309e-7e60-4a63-8930-b0d67ee846d4 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:11.943032 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e87f309e-7e60-4a63-8930-b0d67ee846d4 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:11.943470 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e87f309e-7e60-4a63-8930-b0d67ee846d4 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:11.944157 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e87f309e-7e60-4a63-8930-b0d67ee846d4 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:11.944614 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e87f309e-7e60-4a63-8930-b0d67ee846d4 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:11.945040 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e87f309e-7e60-4a63-8930-b0d67ee846d4 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:12.010128 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e87f309e-7e60-4a63-8930-b0d67ee846d4 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:12.018585 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e87f309e-7e60-4a63-8930-b0d67ee846d4 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d" status: 200 len: 1311 microversion: 2.1 time: 0.089119 Oct 23 02:21:12.019223 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3967/7842] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:11 2022] GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d => generated 1311 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:13.048627 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7194ac42-e33b-42de-8a67-de1bbce0a924 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:13.050074 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7194ac42-e33b-42de-8a67-de1bbce0a924 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 97e88492-4fb3-48a2-b8b0-1a94d759251d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:13.057861 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7194ac42-e33b-42de-8a67-de1bbce0a924 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:13.058785 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7194ac42-e33b-42de-8a67-de1bbce0a924 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:13.059642 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7194ac42-e33b-42de-8a67-de1bbce0a924 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:13.060544 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7194ac42-e33b-42de-8a67-de1bbce0a924 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:13.061255 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7194ac42-e33b-42de-8a67-de1bbce0a924 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:13.061931 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7194ac42-e33b-42de-8a67-de1bbce0a924 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:13.227488 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7194ac42-e33b-42de-8a67-de1bbce0a924 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:13.236836 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7194ac42-e33b-42de-8a67-de1bbce0a924 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d" status: 200 len: 1359 microversion: 2.1 time: 0.196432 Oct 23 02:21:13.238499 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3876/7843] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:13 2022] GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d => generated 1359 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:14.263410 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5fbfd290-704b-49df-9497-3cc7c8c7b8cd tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:14.264074 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5fbfd290-704b-49df-9497-3cc7c8c7b8cd tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 97e88492-4fb3-48a2-b8b0-1a94d759251d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:14.271117 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5fbfd290-704b-49df-9497-3cc7c8c7b8cd tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:14.271612 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5fbfd290-704b-49df-9497-3cc7c8c7b8cd tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:14.272057 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5fbfd290-704b-49df-9497-3cc7c8c7b8cd tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:14.272764 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5fbfd290-704b-49df-9497-3cc7c8c7b8cd tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:14.273238 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5fbfd290-704b-49df-9497-3cc7c8c7b8cd tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:14.273663 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5fbfd290-704b-49df-9497-3cc7c8c7b8cd tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:14.415826 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5fbfd290-704b-49df-9497-3cc7c8c7b8cd tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:14.424091 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5fbfd290-704b-49df-9497-3cc7c8c7b8cd tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d" status: 200 len: 1359 microversion: 2.1 time: 0.164617 Oct 23 02:21:14.424692 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3968/7844] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:14 2022] GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:15.447274 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-506a9f4f-5f12-46ac-b4fe-ccb037cbfe07 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:15.448184 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-506a9f4f-5f12-46ac-b4fe-ccb037cbfe07 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 97e88492-4fb3-48a2-b8b0-1a94d759251d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:15.455494 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-506a9f4f-5f12-46ac-b4fe-ccb037cbfe07 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:15.455998 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-506a9f4f-5f12-46ac-b4fe-ccb037cbfe07 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:15.456450 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-506a9f4f-5f12-46ac-b4fe-ccb037cbfe07 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:15.457167 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-506a9f4f-5f12-46ac-b4fe-ccb037cbfe07 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:15.457637 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-506a9f4f-5f12-46ac-b4fe-ccb037cbfe07 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:15.458123 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-506a9f4f-5f12-46ac-b4fe-ccb037cbfe07 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:15.600689 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-506a9f4f-5f12-46ac-b4fe-ccb037cbfe07 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:15.609512 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-506a9f4f-5f12-46ac-b4fe-ccb037cbfe07 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d" status: 200 len: 1359 microversion: 2.1 time: 0.166200 Oct 23 02:21:15.610151 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3877/7845] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:15 2022] GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:16.632707 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5fa6418b-87cb-413f-826b-1d0e7eff1cd0 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:16.633331 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5fa6418b-87cb-413f-826b-1d0e7eff1cd0 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 97e88492-4fb3-48a2-b8b0-1a94d759251d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:16.641721 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5fa6418b-87cb-413f-826b-1d0e7eff1cd0 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:16.642495 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5fa6418b-87cb-413f-826b-1d0e7eff1cd0 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:16.643162 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5fa6418b-87cb-413f-826b-1d0e7eff1cd0 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:16.643991 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5fa6418b-87cb-413f-826b-1d0e7eff1cd0 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:16.644520 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5fa6418b-87cb-413f-826b-1d0e7eff1cd0 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:16.645015 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5fa6418b-87cb-413f-826b-1d0e7eff1cd0 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:16.787364 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5fa6418b-87cb-413f-826b-1d0e7eff1cd0 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:16.795550 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5fa6418b-87cb-413f-826b-1d0e7eff1cd0 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d" status: 200 len: 1359 microversion: 2.1 time: 0.166682 Oct 23 02:21:16.796149 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3969/7846] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:16 2022] GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:17.818693 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9736dfd7-88f9-4248-960e-9fef059f4343 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:17.819317 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9736dfd7-88f9-4248-960e-9fef059f4343 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 97e88492-4fb3-48a2-b8b0-1a94d759251d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:17.827041 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9736dfd7-88f9-4248-960e-9fef059f4343 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:17.827567 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9736dfd7-88f9-4248-960e-9fef059f4343 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:17.828011 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9736dfd7-88f9-4248-960e-9fef059f4343 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:17.828717 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9736dfd7-88f9-4248-960e-9fef059f4343 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:17.829200 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9736dfd7-88f9-4248-960e-9fef059f4343 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:17.829614 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9736dfd7-88f9-4248-960e-9fef059f4343 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:17.978066 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9736dfd7-88f9-4248-960e-9fef059f4343 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:17.986481 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9736dfd7-88f9-4248-960e-9fef059f4343 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d" status: 200 len: 1359 microversion: 2.1 time: 0.171625 Oct 23 02:21:17.987077 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3878/7847] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:17 2022] GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:19.010292 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3bca7dce-2435-4f63-bcc2-e83a0b3ced36 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:19.010993 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3bca7dce-2435-4f63-bcc2-e83a0b3ced36 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 97e88492-4fb3-48a2-b8b0-1a94d759251d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:19.019390 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3bca7dce-2435-4f63-bcc2-e83a0b3ced36 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:19.020026 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3bca7dce-2435-4f63-bcc2-e83a0b3ced36 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:19.020596 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3bca7dce-2435-4f63-bcc2-e83a0b3ced36 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:19.021306 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3bca7dce-2435-4f63-bcc2-e83a0b3ced36 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:19.021767 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3bca7dce-2435-4f63-bcc2-e83a0b3ced36 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:19.022227 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3bca7dce-2435-4f63-bcc2-e83a0b3ced36 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:19.167578 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3bca7dce-2435-4f63-bcc2-e83a0b3ced36 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:19.175851 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3bca7dce-2435-4f63-bcc2-e83a0b3ced36 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d" status: 200 len: 1359 microversion: 2.1 time: 0.169463 Oct 23 02:21:19.176652 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3970/7848] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:19 2022] GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:20.199794 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-20c16296-6d6c-455f-9275-7ba198090d8f tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:20.201204 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-20c16296-6d6c-455f-9275-7ba198090d8f tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 97e88492-4fb3-48a2-b8b0-1a94d759251d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:20.203936 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:21:20.206448 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=6 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:21:20.209649 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-20c16296-6d6c-455f-9275-7ba198090d8f tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:20.210181 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-20c16296-6d6c-455f-9275-7ba198090d8f tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:20.210630 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-20c16296-6d6c-455f-9275-7ba198090d8f tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:20.211343 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-20c16296-6d6c-455f-9275-7ba198090d8f tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:20.211808 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-20c16296-6d6c-455f-9275-7ba198090d8f tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:20.212286 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-20c16296-6d6c-455f-9275-7ba198090d8f tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:20.350844 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-20c16296-6d6c-455f-9275-7ba198090d8f tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:20.359156 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-20c16296-6d6c-455f-9275-7ba198090d8f tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d" status: 200 len: 1359 microversion: 2.1 time: 0.163310 Oct 23 02:21:20.359736 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3879/7849] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:20 2022] GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:21.383074 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-69bfc043-6d6a-46eb-924a-e9c8ca278040 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:21.383697 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-69bfc043-6d6a-46eb-924a-e9c8ca278040 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 97e88492-4fb3-48a2-b8b0-1a94d759251d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:21.385748 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=6 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:21:21.394621 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-69bfc043-6d6a-46eb-924a-e9c8ca278040 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:21.394621 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-69bfc043-6d6a-46eb-924a-e9c8ca278040 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:21.394621 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-69bfc043-6d6a-46eb-924a-e9c8ca278040 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:21.394621 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-69bfc043-6d6a-46eb-924a-e9c8ca278040 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:21.394621 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-69bfc043-6d6a-46eb-924a-e9c8ca278040 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:21.394621 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-69bfc043-6d6a-46eb-924a-e9c8ca278040 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:21.531863 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-69bfc043-6d6a-46eb-924a-e9c8ca278040 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:21.540078 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-69bfc043-6d6a-46eb-924a-e9c8ca278040 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d" status: 200 len: 1359 microversion: 2.1 time: 0.161162 Oct 23 02:21:21.540704 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3971/7850] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:21 2022] GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:21.804083 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-7a167e09-cef0-47af-874f-ca72a152aa77 req-27e476dd-d42a-490e-bce6-6d03e62a65cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97e88492-4fb3-48a2-b8b0-1a94d759251d", "tag": "2d1e49ab-be58-464c-817e-1ad1db6190c4"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:21:21.814229 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-7a167e09-cef0-47af-874f-ca72a152aa77 req-27e476dd-d42a-490e-bce6-6d03e62a65cc service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:21.814726 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-7a167e09-cef0-47af-874f-ca72a152aa77 req-27e476dd-d42a-490e-bce6-6d03e62a65cc service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:21.815171 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-7a167e09-cef0-47af-874f-ca72a152aa77 req-27e476dd-d42a-490e-bce6-6d03e62a65cc service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:21.826784 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-7a167e09-cef0-47af-874f-ca72a152aa77 req-27e476dd-d42a-490e-bce6-6d03e62a65cc service nova] Creating event network-changed:2d1e49ab-be58-464c-817e-1ad1db6190c4 for instance 97e88492-4fb3-48a2-b8b0-1a94d759251d on n-h2-master-1 Oct 23 02:21:21.831901 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-7a167e09-cef0-47af-874f-ca72a152aa77 req-27e476dd-d42a-490e-bce6-6d03e62a65cc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162773 Oct 23 02:21:21.832532 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3880/7851] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:21:22.562954 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bd232146-f710-4e79-92bf-50020f7990c7 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:22.563617 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bd232146-f710-4e79-92bf-50020f7990c7 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 97e88492-4fb3-48a2-b8b0-1a94d759251d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:22.571241 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bd232146-f710-4e79-92bf-50020f7990c7 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:22.573889 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bd232146-f710-4e79-92bf-50020f7990c7 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:22.573889 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bd232146-f710-4e79-92bf-50020f7990c7 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:22.573889 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bd232146-f710-4e79-92bf-50020f7990c7 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:22.573889 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bd232146-f710-4e79-92bf-50020f7990c7 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:22.573889 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bd232146-f710-4e79-92bf-50020f7990c7 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:22.703560 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bd232146-f710-4e79-92bf-50020f7990c7 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:22.711377 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bd232146-f710-4e79-92bf-50020f7990c7 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d" status: 200 len: 1359 microversion: 2.1 time: 0.152409 Oct 23 02:21:22.711950 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3972/7852] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:22 2022] GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:23.737454 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f308df2f-c4d8-4c5a-9657-99dabdd36f2c tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:23.738196 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f308df2f-c4d8-4c5a-9657-99dabdd36f2c tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 97e88492-4fb3-48a2-b8b0-1a94d759251d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:23.744301 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f308df2f-c4d8-4c5a-9657-99dabdd36f2c tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:23.744800 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f308df2f-c4d8-4c5a-9657-99dabdd36f2c tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:23.745249 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f308df2f-c4d8-4c5a-9657-99dabdd36f2c tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:23.745953 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f308df2f-c4d8-4c5a-9657-99dabdd36f2c tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:23.746452 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f308df2f-c4d8-4c5a-9657-99dabdd36f2c tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:23.746889 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f308df2f-c4d8-4c5a-9657-99dabdd36f2c tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:23.876385 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f308df2f-c4d8-4c5a-9657-99dabdd36f2c tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:23.884425 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f308df2f-c4d8-4c5a-9657-99dabdd36f2c tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d" status: 200 len: 1359 microversion: 2.1 time: 0.152847 Oct 23 02:21:23.885099 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3881/7853] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:23 2022] GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:24.907547 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-839ea318-6a51-49c3-91a9-d5529d0b3e51 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:24.908181 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-839ea318-6a51-49c3-91a9-d5529d0b3e51 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 97e88492-4fb3-48a2-b8b0-1a94d759251d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:24.914983 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-839ea318-6a51-49c3-91a9-d5529d0b3e51 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:24.917442 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-839ea318-6a51-49c3-91a9-d5529d0b3e51 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:24.917442 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-839ea318-6a51-49c3-91a9-d5529d0b3e51 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:24.917442 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-839ea318-6a51-49c3-91a9-d5529d0b3e51 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:24.917442 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-839ea318-6a51-49c3-91a9-d5529d0b3e51 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:24.917442 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-839ea318-6a51-49c3-91a9-d5529d0b3e51 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:25.052765 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-839ea318-6a51-49c3-91a9-d5529d0b3e51 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:25.061137 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-839ea318-6a51-49c3-91a9-d5529d0b3e51 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d" status: 200 len: 1359 microversion: 2.1 time: 0.157553 Oct 23 02:21:25.061715 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3973/7854] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:24 2022] GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:26.084025 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d9192859-8a19-4425-bb82-241d3ab13c4e tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:26.084656 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d9192859-8a19-4425-bb82-241d3ab13c4e tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 97e88492-4fb3-48a2-b8b0-1a94d759251d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:26.091480 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9192859-8a19-4425-bb82-241d3ab13c4e tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:26.091974 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9192859-8a19-4425-bb82-241d3ab13c4e tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:26.092420 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9192859-8a19-4425-bb82-241d3ab13c4e tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:26.093366 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9192859-8a19-4425-bb82-241d3ab13c4e tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:26.093833 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9192859-8a19-4425-bb82-241d3ab13c4e tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:26.094297 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9192859-8a19-4425-bb82-241d3ab13c4e tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:26.224364 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d9192859-8a19-4425-bb82-241d3ab13c4e tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:26.232035 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d9192859-8a19-4425-bb82-241d3ab13c4e tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d" status: 200 len: 1359 microversion: 2.1 time: 0.151946 Oct 23 02:21:26.232645 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3882/7855] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:26 2022] GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:27.077704 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-22b1f236-7550-4ac4-9855-8a717c304470 req-5b822f2e-7c5d-4508-b8d0-b43e86754145 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97e88492-4fb3-48a2-b8b0-1a94d759251d", "name": "network-vif-plugged", "status": "completed", "tag": "2d1e49ab-be58-464c-817e-1ad1db6190c4"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:21:27.087982 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-22b1f236-7550-4ac4-9855-8a717c304470 req-5b822f2e-7c5d-4508-b8d0-b43e86754145 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:27.088465 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-22b1f236-7550-4ac4-9855-8a717c304470 req-5b822f2e-7c5d-4508-b8d0-b43e86754145 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:27.088903 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-22b1f236-7550-4ac4-9855-8a717c304470 req-5b822f2e-7c5d-4508-b8d0-b43e86754145 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:27.100471 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-22b1f236-7550-4ac4-9855-8a717c304470 req-5b822f2e-7c5d-4508-b8d0-b43e86754145 service nova] Creating event network-vif-plugged:2d1e49ab-be58-464c-817e-1ad1db6190c4 for instance 97e88492-4fb3-48a2-b8b0-1a94d759251d on n-h2-master-1 Oct 23 02:21:27.105828 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-22b1f236-7550-4ac4-9855-8a717c304470 req-5b822f2e-7c5d-4508-b8d0-b43e86754145 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032398 Oct 23 02:21:27.106522 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3974/7856] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:21:27.256053 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-27891002-c33c-43e5-81f2-18a6519d4ae3 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:27.256775 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-27891002-c33c-43e5-81f2-18a6519d4ae3 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 97e88492-4fb3-48a2-b8b0-1a94d759251d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:27.264420 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-27891002-c33c-43e5-81f2-18a6519d4ae3 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:27.264922 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-27891002-c33c-43e5-81f2-18a6519d4ae3 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:27.265372 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-27891002-c33c-43e5-81f2-18a6519d4ae3 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:27.266123 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-27891002-c33c-43e5-81f2-18a6519d4ae3 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:27.266845 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-27891002-c33c-43e5-81f2-18a6519d4ae3 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:27.267287 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-27891002-c33c-43e5-81f2-18a6519d4ae3 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:27.401360 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-27891002-c33c-43e5-81f2-18a6519d4ae3 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:27.409951 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-27891002-c33c-43e5-81f2-18a6519d4ae3 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d" status: 200 len: 1359 microversion: 2.1 time: 0.157937 Oct 23 02:21:27.410552 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3883/7857] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:27 2022] GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:28.434069 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-69f9a3da-bcc4-4887-ade8-e3260c57fc7c tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:28.434779 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-69f9a3da-bcc4-4887-ade8-e3260c57fc7c tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 97e88492-4fb3-48a2-b8b0-1a94d759251d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:28.440975 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-69f9a3da-bcc4-4887-ade8-e3260c57fc7c tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:28.441465 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-69f9a3da-bcc4-4887-ade8-e3260c57fc7c tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:28.441906 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-69f9a3da-bcc4-4887-ade8-e3260c57fc7c tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:28.442620 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-69f9a3da-bcc4-4887-ade8-e3260c57fc7c tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:28.443084 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-69f9a3da-bcc4-4887-ade8-e3260c57fc7c tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:28.443518 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-69f9a3da-bcc4-4887-ade8-e3260c57fc7c tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:28.573681 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-69f9a3da-bcc4-4887-ade8-e3260c57fc7c tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:28.582139 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-69f9a3da-bcc4-4887-ade8-e3260c57fc7c tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d" status: 200 len: 1359 microversion: 2.1 time: 0.153176 Oct 23 02:21:28.582875 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3975/7858] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:28 2022] GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:29.606566 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-097a991f-4806-42a9-b98f-f48ba2d2722f tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:29.607630 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-097a991f-4806-42a9-b98f-f48ba2d2722f tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 97e88492-4fb3-48a2-b8b0-1a94d759251d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:29.614502 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-097a991f-4806-42a9-b98f-f48ba2d2722f tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:29.614999 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-097a991f-4806-42a9-b98f-f48ba2d2722f tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:29.615442 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-097a991f-4806-42a9-b98f-f48ba2d2722f tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:29.616132 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-097a991f-4806-42a9-b98f-f48ba2d2722f tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:29.616589 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-097a991f-4806-42a9-b98f-f48ba2d2722f tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:29.617020 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-097a991f-4806-42a9-b98f-f48ba2d2722f tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:29.747899 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-097a991f-4806-42a9-b98f-f48ba2d2722f tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:29.755501 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-097a991f-4806-42a9-b98f-f48ba2d2722f tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d" status: 200 len: 1549 microversion: 2.1 time: 0.152881 Oct 23 02:21:29.756071 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3884/7859] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:29 2022] GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:29.777259 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fb0b5fc2-00ee-45bf-9a62-08d3dfaaa707 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:29.777881 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fb0b5fc2-00ee-45bf-9a62-08d3dfaaa707 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 97e88492-4fb3-48a2-b8b0-1a94d759251d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:29.785178 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb0b5fc2-00ee-45bf-9a62-08d3dfaaa707 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:29.785655 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb0b5fc2-00ee-45bf-9a62-08d3dfaaa707 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:29.786117 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb0b5fc2-00ee-45bf-9a62-08d3dfaaa707 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:29.786803 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb0b5fc2-00ee-45bf-9a62-08d3dfaaa707 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:29.787259 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb0b5fc2-00ee-45bf-9a62-08d3dfaaa707 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:29.787684 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb0b5fc2-00ee-45bf-9a62-08d3dfaaa707 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:29.914787 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fb0b5fc2-00ee-45bf-9a62-08d3dfaaa707 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:29.923188 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fb0b5fc2-00ee-45bf-9a62-08d3dfaaa707 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d" status: 200 len: 1549 microversion: 2.1 time: 0.149781 Oct 23 02:21:29.923754 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3976/7860] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:29 2022] GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d => generated 1549 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:29.946257 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-967d6fcc-25de-45cc-9845-e8fdcc19f285 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:29.951007 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-967d6fcc-25de-45cc-9845-e8fdcc19f285 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:29.951791 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-967d6fcc-25de-45cc-9845-e8fdcc19f285 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Searching by: {'deleted': False, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487'} {{(pid=120945) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 23 02:21:29.957098 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-967d6fcc-25de-45cc-9845-e8fdcc19f285 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:29.957593 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-967d6fcc-25de-45cc-9845-e8fdcc19f285 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:29.958082 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-967d6fcc-25de-45cc-9845-e8fdcc19f285 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:29.958824 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-967d6fcc-25de-45cc-9845-e8fdcc19f285 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:29.959293 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-967d6fcc-25de-45cc-9845-e8fdcc19f285 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:29.959732 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-967d6fcc-25de-45cc-9845-e8fdcc19f285 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:29.984129 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.multi_cell_list [None req-967d6fcc-25de-45cc-9845-e8fdcc19f285 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120945) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 23 02:21:30.010363 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-967d6fcc-25de-45cc-9845-e8fdcc19f285 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.068049 Oct 23 02:21:30.010945 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3885/7861] 10.222.0.42 () {58 vars in 1125 bytes} [Sun Oct 23 02:21:29 2022] GET /compute/v2.1/servers => generated 343 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:21:30.022777 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8ff451e3-b9c9-4873-b0e4-eba9d15d1209 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:30.023401 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8ff451e3-b9c9-4873-b0e4-eba9d15d1209 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 97e88492-4fb3-48a2-b8b0-1a94d759251d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:30.029870 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ff451e3-b9c9-4873-b0e4-eba9d15d1209 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:30.030396 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ff451e3-b9c9-4873-b0e4-eba9d15d1209 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:30.030837 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ff451e3-b9c9-4873-b0e4-eba9d15d1209 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:30.031532 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ff451e3-b9c9-4873-b0e4-eba9d15d1209 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:30.031995 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ff451e3-b9c9-4873-b0e4-eba9d15d1209 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:30.032426 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ff451e3-b9c9-4873-b0e4-eba9d15d1209 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:30.158802 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8ff451e3-b9c9-4873-b0e4-eba9d15d1209 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:30.166569 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8ff451e3-b9c9-4873-b0e4-eba9d15d1209 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d" status: 200 len: 1549 microversion: 2.1 time: 0.147761 Oct 23 02:21:30.167141 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3977/7862] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:30 2022] GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d => generated 1549 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:32.995236 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c5e17708-c97f-43ee-803a-f43ad7e543d8 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "94381bbf-2f4e-4ce7-a0d4-afc703527554"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:21:32.997629 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c5e17708-c97f-43ee-803a-f43ad7e543d8 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 97e88492-4fb3-48a2-b8b0-1a94d759251d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:33.004382 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c5e17708-c97f-43ee-803a-f43ad7e543d8 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:33.004872 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c5e17708-c97f-43ee-803a-f43ad7e543d8 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:33.005316 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c5e17708-c97f-43ee-803a-f43ad7e543d8 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:33.006027 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c5e17708-c97f-43ee-803a-f43ad7e543d8 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:33.006491 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c5e17708-c97f-43ee-803a-f43ad7e543d8 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:33.006925 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c5e17708-c97f-43ee-803a-f43ad7e543d8 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:33.827390 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c5e17708-c97f-43ee-803a-f43ad7e543d8 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "POST /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.835895 Oct 23 02:21:33.828024 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3886/7863] 10.222.0.42 () {60 vars in 1323 bytes} [Sun Oct 23 02:21:32 2022] POST /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d/os-volume_attachments => generated 194 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:21:48.252320 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-92bd7d66-c194-4805-b6a6-2842bff4bfb5 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:48.255107 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-92bd7d66-c194-4805-b6a6-2842bff4bfb5 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 97e88492-4fb3-48a2-b8b0-1a94d759251d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:48.256120 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:21:48.256779 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=62 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:21:48.257670 n-d-master-1 devstack@n-api.service[120944]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 23 02:21:48.257793 n-d-master-1 devstack@n-api.service[120944]: Sun Oct 23 02:21:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d (ip 10.222.0.42) !!! Oct 23 02:21:48.265154 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92bd7d66-c194-4805-b6a6-2842bff4bfb5 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:48.265638 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92bd7d66-c194-4805-b6a6-2842bff4bfb5 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:48.266099 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92bd7d66-c194-4805-b6a6-2842bff4bfb5 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:48.266795 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92bd7d66-c194-4805-b6a6-2842bff4bfb5 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:48.267263 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92bd7d66-c194-4805-b6a6-2842bff4bfb5 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:48.267689 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92bd7d66-c194-4805-b6a6-2842bff4bfb5 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:48.401477 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-92bd7d66-c194-4805-b6a6-2842bff4bfb5 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:48.410584 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-92bd7d66-c194-4805-b6a6-2842bff4bfb5 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d" status: 200 len: 1595 microversion: 2.1 time: 0.162779 Oct 23 02:21:48.411173 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3978/7864] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:48 2022] GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d => generated 1595 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:50.649579 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:21:50.650468 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:21:50.651136 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:21:50.711465 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-6d9f4fa8-5a55-4cd0-85b7-1191fda7e8ea req-7dcaf9f3-43c7-45c6-b2e0-e8812ef0c89b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97e88492-4fb3-48a2-b8b0-1a94d759251d", "tag": "2d1e49ab-be58-464c-817e-1ad1db6190c4"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:21:50.722372 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-6d9f4fa8-5a55-4cd0-85b7-1191fda7e8ea req-7dcaf9f3-43c7-45c6-b2e0-e8812ef0c89b service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:50.725668 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-6d9f4fa8-5a55-4cd0-85b7-1191fda7e8ea req-7dcaf9f3-43c7-45c6-b2e0-e8812ef0c89b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:50.725668 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-6d9f4fa8-5a55-4cd0-85b7-1191fda7e8ea req-7dcaf9f3-43c7-45c6-b2e0-e8812ef0c89b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:50.733932 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-6d9f4fa8-5a55-4cd0-85b7-1191fda7e8ea req-7dcaf9f3-43c7-45c6-b2e0-e8812ef0c89b service nova] Creating event network-changed:2d1e49ab-be58-464c-817e-1ad1db6190c4 for instance 97e88492-4fb3-48a2-b8b0-1a94d759251d on n-h2-master-1 Oct 23 02:21:50.739137 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-6d9f4fa8-5a55-4cd0-85b7-1191fda7e8ea req-7dcaf9f3-43c7-45c6-b2e0-e8812ef0c89b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091199 Oct 23 02:21:50.739726 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3887/7865] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:21:52.908367 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9c1649c5-c7a5-4f7f-bb5e-4687c4134cb8 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1203318287"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:21:52.908952 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9c1649c5-c7a5-4f7f-bb5e-4687c4134cb8 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 97e88492-4fb3-48a2-b8b0-1a94d759251d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:52.915412 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9c1649c5-c7a5-4f7f-bb5e-4687c4134cb8 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:52.915912 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9c1649c5-c7a5-4f7f-bb5e-4687c4134cb8 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:52.916364 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9c1649c5-c7a5-4f7f-bb5e-4687c4134cb8 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:52.917064 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9c1649c5-c7a5-4f7f-bb5e-4687c4134cb8 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:52.917545 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9c1649c5-c7a5-4f7f-bb5e-4687c4134cb8 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:52.918006 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9c1649c5-c7a5-4f7f-bb5e-4687c4134cb8 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:53.045686 n-d-master-1 devstack@n-api.service[120944]: INFO nova.network.security_group_api [None req-9c1649c5-c7a5-4f7f-bb5e-4687c4134cb8 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Adding security group e1877f3f-216a-4988-b557-fae85b8bffb6 to port 2d1e49ab-be58-464c-817e-1ad1db6190c4 Oct 23 02:21:53.408085 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9c1649c5-c7a5-4f7f-bb5e-4687c4134cb8 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "POST /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d/action" status: 202 len: 0 microversion: 2.1 time: 0.504240 Oct 23 02:21:53.408710 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3979/7866] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:21:52 2022] POST /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d/action => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:21:53.417308 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-92c84517-8f75-4dee-885d-ffea7a2ded10 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:53.417928 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-92c84517-8f75-4dee-885d-ffea7a2ded10 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 97e88492-4fb3-48a2-b8b0-1a94d759251d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:53.418319 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-00cf9d4c-c814-413e-9147-76ede06bf179 req-2b3026ac-9ab9-4dd4-b60e-09b905d84e12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97e88492-4fb3-48a2-b8b0-1a94d759251d", "tag": "2d1e49ab-be58-464c-817e-1ad1db6190c4"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:21:53.424267 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92c84517-8f75-4dee-885d-ffea7a2ded10 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:53.424743 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92c84517-8f75-4dee-885d-ffea7a2ded10 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:53.425178 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92c84517-8f75-4dee-885d-ffea7a2ded10 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:53.425876 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92c84517-8f75-4dee-885d-ffea7a2ded10 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:53.426358 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92c84517-8f75-4dee-885d-ffea7a2ded10 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:53.426786 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-92c84517-8f75-4dee-885d-ffea7a2ded10 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:53.430424 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-00cf9d4c-c814-413e-9147-76ede06bf179 req-2b3026ac-9ab9-4dd4-b60e-09b905d84e12 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:53.430983 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-00cf9d4c-c814-413e-9147-76ede06bf179 req-2b3026ac-9ab9-4dd4-b60e-09b905d84e12 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:53.431617 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-00cf9d4c-c814-413e-9147-76ede06bf179 req-2b3026ac-9ab9-4dd4-b60e-09b905d84e12 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:53.444781 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-00cf9d4c-c814-413e-9147-76ede06bf179 req-2b3026ac-9ab9-4dd4-b60e-09b905d84e12 service nova] Creating event network-changed:2d1e49ab-be58-464c-817e-1ad1db6190c4 for instance 97e88492-4fb3-48a2-b8b0-1a94d759251d on n-h2-master-1 Oct 23 02:21:53.451093 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-00cf9d4c-c814-413e-9147-76ede06bf179 req-2b3026ac-9ab9-4dd4-b60e-09b905d84e12 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037604 Oct 23 02:21:53.452294 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3888/7867] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:21:53.614528 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-92c84517-8f75-4dee-885d-ffea7a2ded10 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:53.629002 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-92c84517-8f75-4dee-885d-ffea7a2ded10 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d" status: 200 len: 1760 microversion: 2.1 time: 0.215443 Oct 23 02:21:53.642183 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3980/7868] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:53 2022] GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d => generated 1760 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:23:30.292943 n-d-master-1 devstack@n-api.service[120945]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dc6b279b-942d-4b38-8231-bb7b36b63253] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 23 02:23:30.298550 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c2a3d4fe-a937-46ed-b4a7-ae2545cc48b2 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:23:30.300881 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c2a3d4fe-a937-46ed-b4a7-ae2545cc48b2 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 97e88492-4fb3-48a2-b8b0-1a94d759251d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:23:30.307925 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c2a3d4fe-a937-46ed-b4a7-ae2545cc48b2 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:30.308421 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c2a3d4fe-a937-46ed-b4a7-ae2545cc48b2 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:30.308869 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c2a3d4fe-a937-46ed-b4a7-ae2545cc48b2 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:30.309564 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c2a3d4fe-a937-46ed-b4a7-ae2545cc48b2 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:30.310069 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c2a3d4fe-a937-46ed-b4a7-ae2545cc48b2 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:30.310509 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c2a3d4fe-a937-46ed-b4a7-ae2545cc48b2 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:30.656837 n-d-master-1 devstack@n-api.service[120945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 23 02:23:30.657070 n-d-master-1 devstack@n-api.service[120945]: Sun Oct 23 02:23:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d/action (ip 10.222.0.42) !!! Oct 23 02:23:30.658539 n-d-master-1 devstack@n-api.service[120945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 23 02:23:30.658696 n-d-master-1 devstack@n-api.service[120945]: Sun Oct 23 02:23:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d/action (ip 10.222.0.42) !!! Oct 23 02:23:30.798583 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c2a3d4fe-a937-46ed-b4a7-ae2545cc48b2 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "POST /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d/action" status: 202 len: 0 microversion: 2.1 time: 0.507046 Oct 23 02:23:30.799535 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3889/7869] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:23:30 2022] POST /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d/action => generated 0 bytes in 509 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:23:30.805614 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=6 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:23:30.806739 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=16 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:23:30.808271 n-d-master-1 devstack@n-api.service[120944]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 23 02:23:30.808401 n-d-master-1 devstack@n-api.service[120944]: Sun Oct 23 02:23:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d (ip 10.222.0.42) !!! Oct 23 02:23:30.814566 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1f3d9f1e-4245-486b-8490-8fb41e6817d4 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:23:30.815683 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1f3d9f1e-4245-486b-8490-8fb41e6817d4 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 97e88492-4fb3-48a2-b8b0-1a94d759251d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:23:30.827667 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f3d9f1e-4245-486b-8490-8fb41e6817d4 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:30.828152 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f3d9f1e-4245-486b-8490-8fb41e6817d4 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:30.828591 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f3d9f1e-4245-486b-8490-8fb41e6817d4 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:30.829293 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f3d9f1e-4245-486b-8490-8fb41e6817d4 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:30.829748 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f3d9f1e-4245-486b-8490-8fb41e6817d4 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:30.830202 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1f3d9f1e-4245-486b-8490-8fb41e6817d4 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:30.981015 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1f3d9f1e-4245-486b-8490-8fb41e6817d4 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:23:30.990075 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1f3d9f1e-4245-486b-8490-8fb41e6817d4 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d" status: 200 len: 1762 microversion: 2.1 time: 0.186343 Oct 23 02:23:30.990958 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3981/7870] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:23:30 2022] GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d => generated 1762 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:23:32.015608 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8d82e39d-439f-4376-b071-72e80142f537 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:23:32.016749 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8d82e39d-439f-4376-b071-72e80142f537 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 97e88492-4fb3-48a2-b8b0-1a94d759251d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:23:32.030330 n-d-master-1 devstack@n-api.service[120945]: INFO oslo.messaging._drivers.impl_rabbit [-] [dc6b279b-942d-4b38-8231-bb7b36b63253] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 38062. Oct 23 02:23:32.031830 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d82e39d-439f-4376-b071-72e80142f537 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:32.032365 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d82e39d-439f-4376-b071-72e80142f537 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:32.032823 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d82e39d-439f-4376-b071-72e80142f537 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:32.033528 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d82e39d-439f-4376-b071-72e80142f537 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:32.034012 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d82e39d-439f-4376-b071-72e80142f537 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:32.034459 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8d82e39d-439f-4376-b071-72e80142f537 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:32.180506 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8d82e39d-439f-4376-b071-72e80142f537 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:23:32.188783 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8d82e39d-439f-4376-b071-72e80142f537 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d" status: 200 len: 1767 microversion: 2.1 time: 0.178210 Oct 23 02:23:32.189349 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3890/7871] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:23:32 2022] GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d => generated 1767 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:23:33.213051 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-445fe388-32ea-4917-b47a-061b70329e5e tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:23:33.213639 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-445fe388-32ea-4917-b47a-061b70329e5e tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 97e88492-4fb3-48a2-b8b0-1a94d759251d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:23:33.221055 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-445fe388-32ea-4917-b47a-061b70329e5e tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:33.221805 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-445fe388-32ea-4917-b47a-061b70329e5e tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:33.222284 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-445fe388-32ea-4917-b47a-061b70329e5e tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:33.222985 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-445fe388-32ea-4917-b47a-061b70329e5e tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:33.223446 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-445fe388-32ea-4917-b47a-061b70329e5e tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:33.223877 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-445fe388-32ea-4917-b47a-061b70329e5e tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:33.365356 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-445fe388-32ea-4917-b47a-061b70329e5e tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:23:33.373747 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-445fe388-32ea-4917-b47a-061b70329e5e tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d" status: 200 len: 1760 microversion: 2.1 time: 0.164670 Oct 23 02:23:33.374357 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3982/7872] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:23:33 2022] GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d => generated 1760 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:24:49.932771 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=8 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:24:49.933580 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:24:49.937780 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a0a264ff-e029-45bd-aa2c-6c7a78b4827d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1203318287"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:24:49.938358 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a0a264ff-e029-45bd-aa2c-6c7a78b4827d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 97e88492-4fb3-48a2-b8b0-1a94d759251d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:49.944124 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a0a264ff-e029-45bd-aa2c-6c7a78b4827d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:49.947180 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a0a264ff-e029-45bd-aa2c-6c7a78b4827d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:49.947180 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a0a264ff-e029-45bd-aa2c-6c7a78b4827d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:49.947180 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a0a264ff-e029-45bd-aa2c-6c7a78b4827d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:49.947180 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a0a264ff-e029-45bd-aa2c-6c7a78b4827d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:49.947650 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a0a264ff-e029-45bd-aa2c-6c7a78b4827d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:50.136943 n-d-master-1 devstack@n-api.service[120945]: INFO nova.network.security_group_api [None req-a0a264ff-e029-45bd-aa2c-6c7a78b4827d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Removing security group e1877f3f-216a-4988-b557-fae85b8bffb6 from port 2d1e49ab-be58-464c-817e-1ad1db6190c4 Oct 23 02:24:50.502418 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a0a264ff-e029-45bd-aa2c-6c7a78b4827d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "POST /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d/action" status: 202 len: 0 microversion: 2.1 time: 0.569606 Oct 23 02:24:50.502418 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3891/7873] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:24:49 2022] POST /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d/action => generated 0 bytes in 571 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:24:50.510972 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-64ea6099-eabe-4704-9f3b-a7dcbe73d9c5 req-656c8ce8-fce8-4c02-b29d-e34104a7520c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97e88492-4fb3-48a2-b8b0-1a94d759251d", "tag": "2d1e49ab-be58-464c-817e-1ad1db6190c4"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:24:50.516669 n-d-master-1 devstack@n-api.service[120944]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ed487b5d-fedf-4013-b387-a53679baa86e] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 23 02:24:50.517359 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=4 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:24:50.518059 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=12 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:24:50.524597 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-64ea6099-eabe-4704-9f3b-a7dcbe73d9c5 req-656c8ce8-fce8-4c02-b29d-e34104a7520c service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:50.525084 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-64ea6099-eabe-4704-9f3b-a7dcbe73d9c5 req-656c8ce8-fce8-4c02-b29d-e34104a7520c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:50.530155 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-64ea6099-eabe-4704-9f3b-a7dcbe73d9c5 req-656c8ce8-fce8-4c02-b29d-e34104a7520c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:50.558747 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-64ea6099-eabe-4704-9f3b-a7dcbe73d9c5 req-656c8ce8-fce8-4c02-b29d-e34104a7520c service nova] Creating event network-changed:2d1e49ab-be58-464c-817e-1ad1db6190c4 for instance 97e88492-4fb3-48a2-b8b0-1a94d759251d on n-h2-master-1 Oct 23 02:24:50.566268 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-64ea6099-eabe-4704-9f3b-a7dcbe73d9c5 req-656c8ce8-fce8-4c02-b29d-e34104a7520c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059759 Oct 23 02:24:50.569297 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3983/7874] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:24:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:24:51.875613 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7ac2a4db-468a-404e-916b-5fa592554950 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:51.876207 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7ac2a4db-468a-404e-916b-5fa592554950 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 97e88492-4fb3-48a2-b8b0-1a94d759251d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:51.882313 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7ac2a4db-468a-404e-916b-5fa592554950 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:51.882908 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7ac2a4db-468a-404e-916b-5fa592554950 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:51.883430 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7ac2a4db-468a-404e-916b-5fa592554950 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:51.884292 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7ac2a4db-468a-404e-916b-5fa592554950 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:51.884835 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7ac2a4db-468a-404e-916b-5fa592554950 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:51.885284 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7ac2a4db-468a-404e-916b-5fa592554950 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:51.969923 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-7ac2a4db-468a-404e-916b-5fa592554950 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lazy-loading 'services' on Instance uuid 97e88492-4fb3-48a2-b8b0-1a94d759251d {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:24:52.164980 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7ac2a4db-468a-404e-916b-5fa592554950 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "DELETE /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d/os-volume_attachments/94381bbf-2f4e-4ce7-a0d4-afc703527554" status: 202 len: 0 microversion: 2.1 time: 0.294272 Oct 23 02:24:52.165744 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3892/7875] 10.222.0.42 () {58 vars in 1416 bytes} [Sun Oct 23 02:24:51 2022] DELETE /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d/os-volume_attachments/94381bbf-2f4e-4ce7-a0d4-afc703527554 => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:24:52.174971 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-717b0364-bbef-4fdc-a31d-020690a9fde8 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:52.177548 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-717b0364-bbef-4fdc-a31d-020690a9fde8 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 97e88492-4fb3-48a2-b8b0-1a94d759251d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:52.186228 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-717b0364-bbef-4fdc-a31d-020690a9fde8 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:52.191510 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-717b0364-bbef-4fdc-a31d-020690a9fde8 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:52.191510 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-717b0364-bbef-4fdc-a31d-020690a9fde8 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:52.191510 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-717b0364-bbef-4fdc-a31d-020690a9fde8 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:52.191510 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-717b0364-bbef-4fdc-a31d-020690a9fde8 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:52.191510 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-717b0364-bbef-4fdc-a31d-020690a9fde8 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:52.208907 n-d-master-1 devstack@n-api.service[120944]: INFO oslo.messaging._drivers.impl_rabbit [-] [ed487b5d-fedf-4013-b387-a53679baa86e] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 38128. Oct 23 02:24:52.223320 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-717b0364-bbef-4fdc-a31d-020690a9fde8 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052756 Oct 23 02:24:52.223905 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3984/7876] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 02:24:52 2022] GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:24:52.584053 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-b436353e-5ab6-46ee-8263-13b659c5e4e0 req-a3f7103b-1fb9-4c85-88b6-c3b92d8db781 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97e88492-4fb3-48a2-b8b0-1a94d759251d", "tag": "2d1e49ab-be58-464c-817e-1ad1db6190c4"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:24:52.594688 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-b436353e-5ab6-46ee-8263-13b659c5e4e0 req-a3f7103b-1fb9-4c85-88b6-c3b92d8db781 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:52.595183 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-b436353e-5ab6-46ee-8263-13b659c5e4e0 req-a3f7103b-1fb9-4c85-88b6-c3b92d8db781 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:52.595627 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-b436353e-5ab6-46ee-8263-13b659c5e4e0 req-a3f7103b-1fb9-4c85-88b6-c3b92d8db781 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:52.607292 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-b436353e-5ab6-46ee-8263-13b659c5e4e0 req-a3f7103b-1fb9-4c85-88b6-c3b92d8db781 service nova] Creating event network-changed:2d1e49ab-be58-464c-817e-1ad1db6190c4 for instance 97e88492-4fb3-48a2-b8b0-1a94d759251d on n-h2-master-1 Oct 23 02:24:52.612221 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-b436353e-5ab6-46ee-8263-13b659c5e4e0 req-a3f7103b-1fb9-4c85-88b6-c3b92d8db781 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032246 Oct 23 02:24:52.612802 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3893/7877] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:24:53.236989 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-36e85fd1-ff9d-46c4-ac3e-f216a7fcc18d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:53.239567 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-36e85fd1-ff9d-46c4-ac3e-f216a7fcc18d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 97e88492-4fb3-48a2-b8b0-1a94d759251d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:53.247460 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36e85fd1-ff9d-46c4-ac3e-f216a7fcc18d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:53.248258 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36e85fd1-ff9d-46c4-ac3e-f216a7fcc18d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:53.249179 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36e85fd1-ff9d-46c4-ac3e-f216a7fcc18d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:53.249993 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36e85fd1-ff9d-46c4-ac3e-f216a7fcc18d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:53.250650 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36e85fd1-ff9d-46c4-ac3e-f216a7fcc18d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:53.251089 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36e85fd1-ff9d-46c4-ac3e-f216a7fcc18d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:53.280793 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-36e85fd1-ff9d-46c4-ac3e-f216a7fcc18d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047745 Oct 23 02:24:53.285493 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3985/7878] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 02:24:53 2022] GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:24:54.294748 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fe736ea8-1bad-4ca8-90ef-9ffcce0295c7 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:54.297206 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-fe736ea8-1bad-4ca8-90ef-9ffcce0295c7 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 97e88492-4fb3-48a2-b8b0-1a94d759251d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:54.303448 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fe736ea8-1bad-4ca8-90ef-9ffcce0295c7 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:54.304464 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fe736ea8-1bad-4ca8-90ef-9ffcce0295c7 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:54.304908 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fe736ea8-1bad-4ca8-90ef-9ffcce0295c7 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:54.305639 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fe736ea8-1bad-4ca8-90ef-9ffcce0295c7 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:54.306133 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fe736ea8-1bad-4ca8-90ef-9ffcce0295c7 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:54.306566 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fe736ea8-1bad-4ca8-90ef-9ffcce0295c7 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:54.336275 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fe736ea8-1bad-4ca8-90ef-9ffcce0295c7 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046715 Oct 23 02:24:54.336846 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3894/7879] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 02:24:54 2022] GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:24:55.348431 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9094ebfc-d2ab-4de7-922c-5cf39912c010 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:55.350881 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9094ebfc-d2ab-4de7-922c-5cf39912c010 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 97e88492-4fb3-48a2-b8b0-1a94d759251d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:55.357879 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9094ebfc-d2ab-4de7-922c-5cf39912c010 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:55.358541 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9094ebfc-d2ab-4de7-922c-5cf39912c010 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:55.359057 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9094ebfc-d2ab-4de7-922c-5cf39912c010 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:55.359765 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9094ebfc-d2ab-4de7-922c-5cf39912c010 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:55.360227 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9094ebfc-d2ab-4de7-922c-5cf39912c010 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:55.360660 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9094ebfc-d2ab-4de7-922c-5cf39912c010 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:55.390061 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9094ebfc-d2ab-4de7-922c-5cf39912c010 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045870 Oct 23 02:24:55.390632 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3986/7880] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 02:24:55 2022] GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:24:56.403989 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c9db3307-5085-473f-affa-9f32442c11c6 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:56.406291 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c9db3307-5085-473f-affa-9f32442c11c6 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 97e88492-4fb3-48a2-b8b0-1a94d759251d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:56.413023 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c9db3307-5085-473f-affa-9f32442c11c6 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:56.414333 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c9db3307-5085-473f-affa-9f32442c11c6 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:56.414956 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c9db3307-5085-473f-affa-9f32442c11c6 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:56.415754 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c9db3307-5085-473f-affa-9f32442c11c6 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:56.416301 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c9db3307-5085-473f-affa-9f32442c11c6 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:56.416816 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c9db3307-5085-473f-affa-9f32442c11c6 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:56.450561 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c9db3307-5085-473f-affa-9f32442c11c6 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051008 Oct 23 02:24:56.451432 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3895/7881] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 02:24:56 2022] GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:24:57.463484 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-09137e66-7e9b-49f7-9d44-d7bb462853ce tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:57.465752 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-09137e66-7e9b-49f7-9d44-d7bb462853ce tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 97e88492-4fb3-48a2-b8b0-1a94d759251d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:57.472742 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-09137e66-7e9b-49f7-9d44-d7bb462853ce tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:57.473487 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-09137e66-7e9b-49f7-9d44-d7bb462853ce tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:57.473936 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-09137e66-7e9b-49f7-9d44-d7bb462853ce tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:57.474666 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-09137e66-7e9b-49f7-9d44-d7bb462853ce tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:57.475133 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-09137e66-7e9b-49f7-9d44-d7bb462853ce tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:57.475597 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-09137e66-7e9b-49f7-9d44-d7bb462853ce tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:57.505855 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-09137e66-7e9b-49f7-9d44-d7bb462853ce tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046943 Oct 23 02:24:57.506466 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3987/7882] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 02:24:57 2022] GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 02:24:57.517551 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6442096b-7f06-42b8-b979-758f18313c6a tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:57.518101 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6442096b-7f06-42b8-b979-758f18313c6a tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 97e88492-4fb3-48a2-b8b0-1a94d759251d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:57.525412 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6442096b-7f06-42b8-b979-758f18313c6a tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:57.527013 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6442096b-7f06-42b8-b979-758f18313c6a tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:57.527013 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6442096b-7f06-42b8-b979-758f18313c6a tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:57.527255 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6442096b-7f06-42b8-b979-758f18313c6a tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:57.527702 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6442096b-7f06-42b8-b979-758f18313c6a tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:57.528142 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6442096b-7f06-42b8-b979-758f18313c6a tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:57.603303 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-6442096b-7f06-42b8-b979-758f18313c6a tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] HTTP exception thrown: Instance 97e88492-4fb3-48a2-b8b0-1a94d759251d is not attached to volume 94381bbf-2f4e-4ce7-a0d4-afc703527554 Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6442096b-7f06-42b8-b979-758f18313c6a tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Request method failure captured: Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d/os-volume_attachments/94381bbf-2f4e-4ce7-a0d4-afc703527554 HTTP/1.1 Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVKUDTZufmk4wu970ZmX8B-nKlt6mM8gQ3xp4w7hwDWWQIPA4NqfGbnNYL3V9MKJeGQE2CfSCIuc3EQVZb53DtLuwOyZjyFhmSsYS1b3kuznGvxlgXeF049KYq1sHII3Vvfq7GjNesFnPyZG7mmryukaT9RejbPijIN-cJU79ErDxCOg Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: dd9a5526b8c7450a9227d266ecf33487 Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-TestMinimumBasicScenario-998385418 Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dd9a5526b8c7450a9227d266ecf33487"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dd9a5526b8c7450a9227d266ecf33487"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dd9a5526b8c7450a9227d266ecf33487"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dd9a5526b8c7450a9227d266ecf33487"}]}] Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-TestMinimumBasicScenario-998385418 Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: dd9a5526b8c7450a9227d266ecf33487 Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-TestMinimumBasicScenario-998385418 Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-TestMinimumBasicScenario-998385418-project Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 722e7b72a173401fa175378ab373c26e Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-TestMinimumBasicScenario-998385418-project Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 97e88492-4fb3-48a2-b8b0-1a94d759251d is not attached to volume 94381bbf-2f4e-4ce7-a0d4-afc703527554 Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: action_args: {'server_id': '97e88492-4fb3-48a2-b8b0-1a94d759251d', 'id': '94381bbf-2f4e-4ce7-a0d4-afc703527554'} Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 94381bbf-2f4e-4ce7-a0d4-afc703527554. Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97e88492-4fb3-48a2-b8b0-1a94d759251d is not attached to volume 94381bbf-2f4e-4ce7-a0d4-afc703527554 Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:24:57.604938 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:24:57.610356 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:24:57.610356 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:24:57.610356 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97e88492-4fb3-48a2-b8b0-1a94d759251d is not attached to volume 94381bbf-2f4e-4ce7-a0d4-afc703527554 Oct 23 02:24:57.610356 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:24:57.610356 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6442096b-7f06-42b8-b979-758f18313c6a tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Returning 404 to user: Instance 97e88492-4fb3-48a2-b8b0-1a94d759251d is not attached to volume 94381bbf-2f4e-4ce7-a0d4-afc703527554 {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:24:57.610356 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6442096b-7f06-42b8-b979-758f18313c6a tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "DELETE /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d/os-volume_attachments/94381bbf-2f4e-4ce7-a0d4-afc703527554" status: 404 len: 154 microversion: 2.1 time: 0.092878 Oct 23 02:24:57.610941 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3896/7883] 10.222.0.42 () {58 vars in 1416 bytes} [Sun Oct 23 02:24:57 2022] DELETE /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d/os-volume_attachments/94381bbf-2f4e-4ce7-a0d4-afc703527554 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:25:01.012518 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-472866a3-a2ae-4b64-a480-d6d84aafcd76 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:25:01.013093 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-472866a3-a2ae-4b64-a480-d6d84aafcd76 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 97e88492-4fb3-48a2-b8b0-1a94d759251d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:25:01.021230 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-472866a3-a2ae-4b64-a480-d6d84aafcd76 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:01.021732 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-472866a3-a2ae-4b64-a480-d6d84aafcd76 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:01.022344 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-472866a3-a2ae-4b64-a480-d6d84aafcd76 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:01.023123 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-472866a3-a2ae-4b64-a480-d6d84aafcd76 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:01.023653 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-472866a3-a2ae-4b64-a480-d6d84aafcd76 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:01.024151 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-472866a3-a2ae-4b64-a480-d6d84aafcd76 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:01.049204 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-472866a3-a2ae-4b64-a480-d6d84aafcd76 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 97e88492-4fb3-48a2-b8b0-1a94d759251d] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 02:25:01.360380 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-472866a3-a2ae-4b64-a480-d6d84aafcd76 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "DELETE /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d" status: 204 len: 0 microversion: 2.1 time: 0.351999 Oct 23 02:25:01.360905 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3988/7884] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 02:25:01 2022] DELETE /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 02:25:01.375793 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f7b7d283-d848-4cdf-9c5c-a0af81f562a8 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:25:01.376584 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f7b7d283-d848-4cdf-9c5c-a0af81f562a8 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 97e88492-4fb3-48a2-b8b0-1a94d759251d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:25:01.384446 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f7b7d283-d848-4cdf-9c5c-a0af81f562a8 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:01.384950 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f7b7d283-d848-4cdf-9c5c-a0af81f562a8 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:01.385405 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f7b7d283-d848-4cdf-9c5c-a0af81f562a8 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:01.386156 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f7b7d283-d848-4cdf-9c5c-a0af81f562a8 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:01.386631 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f7b7d283-d848-4cdf-9c5c-a0af81f562a8 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:01.387064 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f7b7d283-d848-4cdf-9c5c-a0af81f562a8 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:01.524754 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f7b7d283-d848-4cdf-9c5c-a0af81f562a8 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:25:01.532501 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f7b7d283-d848-4cdf-9c5c-a0af81f562a8 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d" status: 200 len: 1555 microversion: 2.1 time: 0.160794 Oct 23 02:25:01.533068 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3897/7885] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:25:01 2022] GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:25:02.557959 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9f39faca-c7ed-4f13-b8f5-96017a220f18 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:25:02.558694 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9f39faca-c7ed-4f13-b8f5-96017a220f18 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 97e88492-4fb3-48a2-b8b0-1a94d759251d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:25:02.566422 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f39faca-c7ed-4f13-b8f5-96017a220f18 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:02.566917 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f39faca-c7ed-4f13-b8f5-96017a220f18 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:02.567358 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f39faca-c7ed-4f13-b8f5-96017a220f18 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:02.568053 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f39faca-c7ed-4f13-b8f5-96017a220f18 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:02.568515 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f39faca-c7ed-4f13-b8f5-96017a220f18 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:02.568949 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f39faca-c7ed-4f13-b8f5-96017a220f18 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:02.747631 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9f39faca-c7ed-4f13-b8f5-96017a220f18 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:25:02.755559 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9f39faca-c7ed-4f13-b8f5-96017a220f18 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d" status: 200 len: 1555 microversion: 2.1 time: 0.202459 Oct 23 02:25:02.756131 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3989/7886] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:25:02 2022] GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d => generated 1555 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:25:03.779799 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-da85845e-8243-40eb-a469-819357fe3747 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:25:03.780410 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-da85845e-8243-40eb-a469-819357fe3747 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 97e88492-4fb3-48a2-b8b0-1a94d759251d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:25:03.786865 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da85845e-8243-40eb-a469-819357fe3747 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:03.787363 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da85845e-8243-40eb-a469-819357fe3747 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:03.787806 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da85845e-8243-40eb-a469-819357fe3747 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:03.788500 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da85845e-8243-40eb-a469-819357fe3747 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:03.788964 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da85845e-8243-40eb-a469-819357fe3747 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:03.789403 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-da85845e-8243-40eb-a469-819357fe3747 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:03.931554 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-da85845e-8243-40eb-a469-819357fe3747 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:25:03.936624 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-254b4f33-65b5-4e1b-9d52-40862dcf4740 req-e5c07239-e77e-46b3-a87b-28b750308f0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97e88492-4fb3-48a2-b8b0-1a94d759251d", "name": "network-vif-deleted", "tag": "2d1e49ab-be58-464c-817e-1ad1db6190c4"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:25:03.940007 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-da85845e-8243-40eb-a469-819357fe3747 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d" status: 200 len: 1555 microversion: 2.1 time: 0.164243 Oct 23 02:25:03.940589 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3898/7887] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:25:03 2022] GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d => generated 1555 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:25:03.947765 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-254b4f33-65b5-4e1b-9d52-40862dcf4740 req-e5c07239-e77e-46b3-a87b-28b750308f0b service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:03.950708 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-254b4f33-65b5-4e1b-9d52-40862dcf4740 req-e5c07239-e77e-46b3-a87b-28b750308f0b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:03.950708 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-254b4f33-65b5-4e1b-9d52-40862dcf4740 req-e5c07239-e77e-46b3-a87b-28b750308f0b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:03.959873 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-254b4f33-65b5-4e1b-9d52-40862dcf4740 req-e5c07239-e77e-46b3-a87b-28b750308f0b service nova] Creating event network-vif-deleted:2d1e49ab-be58-464c-817e-1ad1db6190c4 for instance 97e88492-4fb3-48a2-b8b0-1a94d759251d on n-h2-master-1 Oct 23 02:25:03.964790 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-254b4f33-65b5-4e1b-9d52-40862dcf4740 req-e5c07239-e77e-46b3-a87b-28b750308f0b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035792 Oct 23 02:25:03.965375 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3990/7888] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:25:04.964119 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-835bbd25-d366-41ba-bed6-57d2a21c0a12 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:25:04.964816 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-835bbd25-d366-41ba-bed6-57d2a21c0a12 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 97e88492-4fb3-48a2-b8b0-1a94d759251d] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:25:04.971733 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-835bbd25-d366-41ba-bed6-57d2a21c0a12 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:04.972252 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-835bbd25-d366-41ba-bed6-57d2a21c0a12 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:04.972905 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-835bbd25-d366-41ba-bed6-57d2a21c0a12 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:04.973920 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-835bbd25-d366-41ba-bed6-57d2a21c0a12 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:04.974415 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-835bbd25-d366-41ba-bed6-57d2a21c0a12 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:04.974851 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-835bbd25-d366-41ba-bed6-57d2a21c0a12 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:05.006705 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-835bbd25-d366-41ba-bed6-57d2a21c0a12 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:05.007189 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-835bbd25-d366-41ba-bed6-57d2a21c0a12 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:05.007651 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-835bbd25-d366-41ba-bed6-57d2a21c0a12 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:05.008600 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-835bbd25-d366-41ba-bed6-57d2a21c0a12 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lazy-loading 'fault' on Instance uuid 97e88492-4fb3-48a2-b8b0-1a94d759251d {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:25:05.053682 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-835bbd25-d366-41ba-bed6-57d2a21c0a12 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:25:05.061461 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-835bbd25-d366-41ba-bed6-57d2a21c0a12 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d" status: 200 len: 1349 microversion: 2.1 time: 0.101748 Oct 23 02:25:05.062049 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3899/7889] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:25:04 2022] GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d => generated 1349 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:25:06.086154 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-25373385-8235-4ea6-a601-caa47666875a tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:25:06.086890 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-25373385-8235-4ea6-a601-caa47666875a tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 97e88492-4fb3-48a2-b8b0-1a94d759251d] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:25:06.093545 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25373385-8235-4ea6-a601-caa47666875a tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:06.094071 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25373385-8235-4ea6-a601-caa47666875a tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:06.094520 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25373385-8235-4ea6-a601-caa47666875a tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:06.095207 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25373385-8235-4ea6-a601-caa47666875a tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:06.095662 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25373385-8235-4ea6-a601-caa47666875a tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:06.096088 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-25373385-8235-4ea6-a601-caa47666875a tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:06.110213 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-25373385-8235-4ea6-a601-caa47666875a tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] HTTP exception thrown: Instance 97e88492-4fb3-48a2-b8b0-1a94d759251d could not be found. Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-25373385-8235-4ea6-a601-caa47666875a tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Request method failure captured: Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d HTTP/1.1 Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVKUDTZufmk4wu970ZmX8B-nKlt6mM8gQ3xp4w7hwDWWQIPA4NqfGbnNYL3V9MKJeGQE2CfSCIuc3EQVZb53DtLuwOyZjyFhmSsYS1b3kuznGvxlgXeF049KYq1sHII3Vvfq7GjNesFnPyZG7mmryukaT9RejbPijIN-cJU79ErDxCOg Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: dd9a5526b8c7450a9227d266ecf33487 Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-TestMinimumBasicScenario-998385418 Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dd9a5526b8c7450a9227d266ecf33487"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dd9a5526b8c7450a9227d266ecf33487"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dd9a5526b8c7450a9227d266ecf33487"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dd9a5526b8c7450a9227d266ecf33487"}]}] Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-TestMinimumBasicScenario-998385418 Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: dd9a5526b8c7450a9227d266ecf33487 Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-TestMinimumBasicScenario-998385418 Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-TestMinimumBasicScenario-998385418-project Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 722e7b72a173401fa175378ab373c26e Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-TestMinimumBasicScenario-998385418-project Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 97e88492-4fb3-48a2-b8b0-1a94d759251d could not be found. Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '97e88492-4fb3-48a2-b8b0-1a94d759251d'} Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97e88492-4fb3-48a2-b8b0-1a94d759251d could not be found. Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97e88492-4fb3-48a2-b8b0-1a94d759251d could not be found. Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:25:06.111825 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:25:06.117508 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:25:06.117508 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:25:06.117508 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:25:06.117508 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:25:06.117508 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:25:06.117508 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97e88492-4fb3-48a2-b8b0-1a94d759251d could not be found. Oct 23 02:25:06.117508 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:25:06.117508 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-25373385-8235-4ea6-a601-caa47666875a tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Returning 404 to user: Instance 97e88492-4fb3-48a2-b8b0-1a94d759251d could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:25:06.117508 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-25373385-8235-4ea6-a601-caa47666875a tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d" status: 404 len: 111 microversion: 2.1 time: 0.032226 Oct 23 02:25:06.117508 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3991/7890] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:25:06 2022] GET /compute/v2.1/servers/97e88492-4fb3-48a2-b8b0-1a94d759251d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:25:06.121817 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4301b055-c66c-4e62-827e-28f8eb00976d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '.version_select at 0x7f5cc030e0d0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:25:06.190755 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4301b055-c66c-4e62-827e-28f8eb00976d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1345411755" status: 202 len: 0 microversion: 2.1 time: 0.072697 Oct 23 02:25:06.191350 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3900/7891] 10.222.0.42 () {58 vars in 1272 bytes} [Sun Oct 23 02:25:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1345411755 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:25:17.379535 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-11829bb4-b62f-44dc-8075-2617b7c55442 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Action: 'create', calling method: .version_select at 0x7f5cc0f89ee0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-242843128", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKiUIRNXfUS05329AbnfiiCOxWG8Bw058n/zh7PPwqd77gfV9A1DS5HKcam0Jf2yN9GYwiVQfSBfc3RSvT7O1p6m/XEvlh+2vJxHhZDJjKzBcQAfYSXEvf3oDDrIepas8Q=="}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:25:17.385957 n-d-master-1 devstack@n-api.service[120944]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 23 02:25:17.386119 n-d-master-1 devstack@n-api.service[120944]: Sun Oct 23 02:25:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.42) !!! Oct 23 02:25:17.387469 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:25:17.388993 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:25:17.401786 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-11829bb4-b62f-44dc-8075-2617b7c55442 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Getting quotas for project dd9a5526b8c7450a9227d266ecf33487. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:25:17.407346 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-11829bb4-b62f-44dc-8075-2617b7c55442 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Getting quotas for user 722e7b72a173401fa175378ab373c26e and project dd9a5526b8c7450a9227d266ecf33487. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:25:17.486958 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-11829bb4-b62f-44dc-8075-2617b7c55442 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.111254 Oct 23 02:25:17.487573 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3992/7892] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 02:25:17 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:25:17.537710 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:25:17.538545 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:25:17.543779 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f0b312cf-1b7c-477a-bc7f-9456045fd256 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-19213244", "imageRef": "340f600a-0044-4ab1-a28d-3ea3a825f3fc", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-242843128", "networks": [{"uuid": "9bfae18f-034f-4ff6-b338-d067f1653daf"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:25:17.595403 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-f0b312cf-1b7c-477a-bc7f-9456045fd256 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] validate_networks() for [('9bfae18f-034f-4ff6-b338-d067f1653daf', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 02:25:18.009722 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-f0b312cf-1b7c-477a-bc7f-9456045fd256 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:25:18.010720 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-f0b312cf-1b7c-477a-bc7f-9456045fd256 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:25:18.011287 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-f0b312cf-1b7c-477a-bc7f-9456045fd256 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:25:18.011716 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-f0b312cf-1b7c-477a-bc7f-9456045fd256 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:25:18.012146 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-f0b312cf-1b7c-477a-bc7f-9456045fd256 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:25:18.021253 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f0b312cf-1b7c-477a-bc7f-9456045fd256 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:18.021752 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f0b312cf-1b7c-477a-bc7f-9456045fd256 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:18.022253 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f0b312cf-1b7c-477a-bc7f-9456045fd256 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:18.022993 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f0b312cf-1b7c-477a-bc7f-9456045fd256 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:18.023491 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f0b312cf-1b7c-477a-bc7f-9456045fd256 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:18.023930 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f0b312cf-1b7c-477a-bc7f-9456045fd256 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:18.041067 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-f0b312cf-1b7c-477a-bc7f-9456045fd256 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Getting quotas for project dd9a5526b8c7450a9227d266ecf33487. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:25:18.046327 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-f0b312cf-1b7c-477a-bc7f-9456045fd256 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Getting quotas for user 722e7b72a173401fa175378ab373c26e and project dd9a5526b8c7450a9227d266ecf33487. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:25:18.059418 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f0b312cf-1b7c-477a-bc7f-9456045fd256 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 02:25:18.061659 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f0b312cf-1b7c-477a-bc7f-9456045fd256 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 4a59b989-d997-482f-8e2a-31ecfb741bfa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='340f600a-0044-4ab1-a28d-3ea3a825f3fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 02:25:18.199357 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f0b312cf-1b7c-477a-bc7f-9456045fd256 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.663965 Oct 23 02:25:18.200202 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3901/7893] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 02:25:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 02:25:18.211499 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5913c3b9-1e2e-4f83-b45a-60bdbdf52455 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:25:18.212125 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5913c3b9-1e2e-4f83-b45a-60bdbdf52455 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 4a59b989-d997-482f-8e2a-31ecfb741bfa] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:25:18.270407 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5913c3b9-1e2e-4f83-b45a-60bdbdf52455 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:25:18.277510 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5913c3b9-1e2e-4f83-b45a-60bdbdf52455 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa" status: 200 len: 1256 microversion: 2.1 time: 0.070268 Oct 23 02:25:18.278209 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3993/7894] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:25:18 2022] GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa => generated 1256 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:25:19.301115 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5b149b76-edd7-4889-adec-6e108e8cec6f tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:25:19.301748 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5b149b76-edd7-4889-adec-6e108e8cec6f tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 4a59b989-d997-482f-8e2a-31ecfb741bfa] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:25:19.308428 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5b149b76-edd7-4889-adec-6e108e8cec6f tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:19.308927 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5b149b76-edd7-4889-adec-6e108e8cec6f tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:19.309380 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5b149b76-edd7-4889-adec-6e108e8cec6f tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:19.310111 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5b149b76-edd7-4889-adec-6e108e8cec6f tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:19.310582 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5b149b76-edd7-4889-adec-6e108e8cec6f tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:19.311017 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5b149b76-edd7-4889-adec-6e108e8cec6f tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:19.371072 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5b149b76-edd7-4889-adec-6e108e8cec6f tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:25:19.378935 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5b149b76-edd7-4889-adec-6e108e8cec6f tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa" status: 200 len: 1260 microversion: 2.1 time: 0.082591 Oct 23 02:25:19.379519 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3902/7895] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:25:19 2022] GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa => generated 1260 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:25:20.402370 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f3324c79-7061-4672-827a-8af71528a65e tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:25:20.402997 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f3324c79-7061-4672-827a-8af71528a65e tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 4a59b989-d997-482f-8e2a-31ecfb741bfa] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:25:20.410337 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f3324c79-7061-4672-827a-8af71528a65e tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:20.410831 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f3324c79-7061-4672-827a-8af71528a65e tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:20.411275 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f3324c79-7061-4672-827a-8af71528a65e tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:20.411976 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f3324c79-7061-4672-827a-8af71528a65e tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:20.412434 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f3324c79-7061-4672-827a-8af71528a65e tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:20.412914 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f3324c79-7061-4672-827a-8af71528a65e tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:20.479827 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f3324c79-7061-4672-827a-8af71528a65e tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:25:20.488064 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f3324c79-7061-4672-827a-8af71528a65e tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa" status: 200 len: 1308 microversion: 2.1 time: 0.090556 Oct 23 02:25:20.488699 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3994/7896] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:25:20 2022] GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa => generated 1308 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:25:21.511186 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-eb4ce7d9-4488-4216-9443-975590ca7c60 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:25:21.513039 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-eb4ce7d9-4488-4216-9443-975590ca7c60 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 4a59b989-d997-482f-8e2a-31ecfb741bfa] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:25:21.520416 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eb4ce7d9-4488-4216-9443-975590ca7c60 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:21.521030 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eb4ce7d9-4488-4216-9443-975590ca7c60 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:21.521539 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eb4ce7d9-4488-4216-9443-975590ca7c60 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:21.530168 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eb4ce7d9-4488-4216-9443-975590ca7c60 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:21.530796 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eb4ce7d9-4488-4216-9443-975590ca7c60 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:21.531343 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eb4ce7d9-4488-4216-9443-975590ca7c60 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:21.697450 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-eb4ce7d9-4488-4216-9443-975590ca7c60 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:25:21.706562 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-eb4ce7d9-4488-4216-9443-975590ca7c60 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa" status: 200 len: 1356 microversion: 2.1 time: 0.199238 Oct 23 02:25:21.707714 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3903/7897] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:25:21 2022] GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa => generated 1356 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:25:22.732230 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dc3ef6a0-fe12-4a51-b119-86ffd9de8e6d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:25:22.732856 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-dc3ef6a0-fe12-4a51-b119-86ffd9de8e6d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 4a59b989-d997-482f-8e2a-31ecfb741bfa] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:25:22.739629 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dc3ef6a0-fe12-4a51-b119-86ffd9de8e6d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:22.740100 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dc3ef6a0-fe12-4a51-b119-86ffd9de8e6d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:22.740564 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dc3ef6a0-fe12-4a51-b119-86ffd9de8e6d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:22.741566 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dc3ef6a0-fe12-4a51-b119-86ffd9de8e6d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:22.742398 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dc3ef6a0-fe12-4a51-b119-86ffd9de8e6d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:22.743067 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dc3ef6a0-fe12-4a51-b119-86ffd9de8e6d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:22.896478 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-dc3ef6a0-fe12-4a51-b119-86ffd9de8e6d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:25:22.905112 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-dc3ef6a0-fe12-4a51-b119-86ffd9de8e6d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa" status: 200 len: 1356 microversion: 2.1 time: 0.177753 Oct 23 02:25:22.905889 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3995/7898] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:25:22 2022] GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa => generated 1356 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:25:23.928460 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cb664c96-7922-441c-8925-a1ddd8faf981 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:25:23.929849 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cb664c96-7922-441c-8925-a1ddd8faf981 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 4a59b989-d997-482f-8e2a-31ecfb741bfa] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:25:23.937905 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb664c96-7922-441c-8925-a1ddd8faf981 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:23.938466 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb664c96-7922-441c-8925-a1ddd8faf981 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:23.938940 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb664c96-7922-441c-8925-a1ddd8faf981 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:23.939839 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb664c96-7922-441c-8925-a1ddd8faf981 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:23.940320 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb664c96-7922-441c-8925-a1ddd8faf981 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:23.940765 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cb664c96-7922-441c-8925-a1ddd8faf981 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:24.085056 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cb664c96-7922-441c-8925-a1ddd8faf981 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:25:24.093456 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cb664c96-7922-441c-8925-a1ddd8faf981 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa" status: 200 len: 1356 microversion: 2.1 time: 0.168977 Oct 23 02:25:24.094061 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3904/7899] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:25:23 2022] GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa => generated 1356 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:25:25.119070 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-302a3ce5-c77c-459c-a00b-16a0e9778e5a tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:25:25.119713 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-302a3ce5-c77c-459c-a00b-16a0e9778e5a tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 4a59b989-d997-482f-8e2a-31ecfb741bfa] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:25:25.126772 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-302a3ce5-c77c-459c-a00b-16a0e9778e5a tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:25.127218 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-302a3ce5-c77c-459c-a00b-16a0e9778e5a tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:25.127695 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-302a3ce5-c77c-459c-a00b-16a0e9778e5a tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:25.128409 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-302a3ce5-c77c-459c-a00b-16a0e9778e5a tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:25.128875 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-302a3ce5-c77c-459c-a00b-16a0e9778e5a tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:25.129312 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-302a3ce5-c77c-459c-a00b-16a0e9778e5a tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:25.277788 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-302a3ce5-c77c-459c-a00b-16a0e9778e5a tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:25:25.290681 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-302a3ce5-c77c-459c-a00b-16a0e9778e5a tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa" status: 200 len: 1356 microversion: 2.1 time: 0.174904 Oct 23 02:25:25.292154 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3996/7900] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:25:25 2022] GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa => generated 1356 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:25:26.315617 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-24adc2d0-1623-4bbd-9240-d7eacf8bdb1c tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:25:26.317376 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-24adc2d0-1623-4bbd-9240-d7eacf8bdb1c tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 4a59b989-d997-482f-8e2a-31ecfb741bfa] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:25:26.325615 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-24adc2d0-1623-4bbd-9240-d7eacf8bdb1c tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:26.326511 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-24adc2d0-1623-4bbd-9240-d7eacf8bdb1c tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:26.327635 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-24adc2d0-1623-4bbd-9240-d7eacf8bdb1c tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:26.328379 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-24adc2d0-1623-4bbd-9240-d7eacf8bdb1c tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:26.328991 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-24adc2d0-1623-4bbd-9240-d7eacf8bdb1c tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:26.329447 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-24adc2d0-1623-4bbd-9240-d7eacf8bdb1c tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:26.493807 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-24adc2d0-1623-4bbd-9240-d7eacf8bdb1c tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:25:26.502223 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-24adc2d0-1623-4bbd-9240-d7eacf8bdb1c tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa" status: 200 len: 1356 microversion: 2.1 time: 0.190740 Oct 23 02:25:26.503007 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3905/7901] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:25:26 2022] GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa => generated 1356 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:25:27.527596 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b5cace1a-aadf-424e-afa6-6913be23e1d7 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:25:27.528907 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b5cace1a-aadf-424e-afa6-6913be23e1d7 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 4a59b989-d997-482f-8e2a-31ecfb741bfa] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:25:27.537060 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5cace1a-aadf-424e-afa6-6913be23e1d7 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:27.537311 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5cace1a-aadf-424e-afa6-6913be23e1d7 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:27.537821 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5cace1a-aadf-424e-afa6-6913be23e1d7 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:27.538631 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5cace1a-aadf-424e-afa6-6913be23e1d7 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:27.539160 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5cace1a-aadf-424e-afa6-6913be23e1d7 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:27.539654 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5cace1a-aadf-424e-afa6-6913be23e1d7 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:27.683068 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b5cace1a-aadf-424e-afa6-6913be23e1d7 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:25:27.692573 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b5cace1a-aadf-424e-afa6-6913be23e1d7 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa" status: 200 len: 1356 microversion: 2.1 time: 0.171162 Oct 23 02:25:27.693170 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3997/7902] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:25:27 2022] GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa => generated 1356 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:25:28.715495 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-35b488dc-d483-42ad-ac74-afac026dc668 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:25:28.716081 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-35b488dc-d483-42ad-ac74-afac026dc668 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 4a59b989-d997-482f-8e2a-31ecfb741bfa] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:25:28.718816 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:25:28.719504 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=6 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:25:28.724669 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-35b488dc-d483-42ad-ac74-afac026dc668 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:28.725173 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-35b488dc-d483-42ad-ac74-afac026dc668 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:28.725627 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-35b488dc-d483-42ad-ac74-afac026dc668 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:28.726369 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-35b488dc-d483-42ad-ac74-afac026dc668 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:28.726854 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-35b488dc-d483-42ad-ac74-afac026dc668 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:28.727336 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-35b488dc-d483-42ad-ac74-afac026dc668 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:28.857093 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-35b488dc-d483-42ad-ac74-afac026dc668 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:25:28.864767 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-35b488dc-d483-42ad-ac74-afac026dc668 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa" status: 200 len: 1356 microversion: 2.1 time: 0.153348 Oct 23 02:25:28.865330 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3906/7903] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:25:28 2022] GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa => generated 1356 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:25:29.791434 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-2812e1f4-8a30-4975-b78f-ce8d712048c6 req-7ea7a00c-efca-4d05-8db8-7e5c2916789d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a59b989-d997-482f-8e2a-31ecfb741bfa", "tag": "50f87014-907e-4d58-9c41-04afcf7c9751"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:25:29.797112 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=6 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:25:29.804441 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-2812e1f4-8a30-4975-b78f-ce8d712048c6 req-7ea7a00c-efca-4d05-8db8-7e5c2916789d service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:29.804935 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-2812e1f4-8a30-4975-b78f-ce8d712048c6 req-7ea7a00c-efca-4d05-8db8-7e5c2916789d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:29.805370 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-2812e1f4-8a30-4975-b78f-ce8d712048c6 req-7ea7a00c-efca-4d05-8db8-7e5c2916789d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:29.817503 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-2812e1f4-8a30-4975-b78f-ce8d712048c6 req-7ea7a00c-efca-4d05-8db8-7e5c2916789d service nova] Creating event network-changed:50f87014-907e-4d58-9c41-04afcf7c9751 for instance 4a59b989-d997-482f-8e2a-31ecfb741bfa on n-h1-master-1 Oct 23 02:25:29.823015 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-2812e1f4-8a30-4975-b78f-ce8d712048c6 req-7ea7a00c-efca-4d05-8db8-7e5c2916789d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035353 Oct 23 02:25:29.823638 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3998/7904] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:25:29.888959 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-002ebc0a-9fc3-44d0-b90e-88db1f03a629 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:25:29.889593 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-002ebc0a-9fc3-44d0-b90e-88db1f03a629 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 4a59b989-d997-482f-8e2a-31ecfb741bfa] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:25:29.897049 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-002ebc0a-9fc3-44d0-b90e-88db1f03a629 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:29.897479 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-002ebc0a-9fc3-44d0-b90e-88db1f03a629 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:29.897932 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-002ebc0a-9fc3-44d0-b90e-88db1f03a629 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:29.899645 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-002ebc0a-9fc3-44d0-b90e-88db1f03a629 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:29.900321 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-002ebc0a-9fc3-44d0-b90e-88db1f03a629 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:29.900953 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-002ebc0a-9fc3-44d0-b90e-88db1f03a629 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:30.039962 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-002ebc0a-9fc3-44d0-b90e-88db1f03a629 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:25:30.047831 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-002ebc0a-9fc3-44d0-b90e-88db1f03a629 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa" status: 200 len: 1356 microversion: 2.1 time: 0.163427 Oct 23 02:25:30.048527 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3907/7905] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:25:29 2022] GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa => generated 1356 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:25:31.072747 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-89146406-1448-420c-aba3-4ad2b092d6cd tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:25:31.073469 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-89146406-1448-420c-aba3-4ad2b092d6cd tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 4a59b989-d997-482f-8e2a-31ecfb741bfa] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:25:31.081051 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-89146406-1448-420c-aba3-4ad2b092d6cd tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:31.081543 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-89146406-1448-420c-aba3-4ad2b092d6cd tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:31.082004 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-89146406-1448-420c-aba3-4ad2b092d6cd tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:31.082713 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-89146406-1448-420c-aba3-4ad2b092d6cd tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:31.083277 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-89146406-1448-420c-aba3-4ad2b092d6cd tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:31.083793 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-89146406-1448-420c-aba3-4ad2b092d6cd tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:31.218539 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-89146406-1448-420c-aba3-4ad2b092d6cd tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:25:31.226630 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-89146406-1448-420c-aba3-4ad2b092d6cd tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa" status: 200 len: 1356 microversion: 2.1 time: 0.159095 Oct 23 02:25:31.231780 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 3999/7906] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:25:31 2022] GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa => generated 1356 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:25:32.250753 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-eac93c24-c639-403d-a8e1-7d3d9379d3c2 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:25:32.251387 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-eac93c24-c639-403d-a8e1-7d3d9379d3c2 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 4a59b989-d997-482f-8e2a-31ecfb741bfa] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:25:32.257819 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eac93c24-c639-403d-a8e1-7d3d9379d3c2 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:32.258357 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eac93c24-c639-403d-a8e1-7d3d9379d3c2 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:32.258808 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eac93c24-c639-403d-a8e1-7d3d9379d3c2 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:32.259512 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eac93c24-c639-403d-a8e1-7d3d9379d3c2 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:32.259980 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eac93c24-c639-403d-a8e1-7d3d9379d3c2 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:32.260419 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eac93c24-c639-403d-a8e1-7d3d9379d3c2 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:32.389804 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-eac93c24-c639-403d-a8e1-7d3d9379d3c2 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:25:32.397571 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-eac93c24-c639-403d-a8e1-7d3d9379d3c2 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa" status: 200 len: 1356 microversion: 2.1 time: 0.151468 Oct 23 02:25:32.398102 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3908/7907] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:25:32 2022] GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa => generated 1356 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:25:33.420377 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9db2f689-4c38-4e73-8310-b87103b19410 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:25:33.421151 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9db2f689-4c38-4e73-8310-b87103b19410 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 4a59b989-d997-482f-8e2a-31ecfb741bfa] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:25:33.428057 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9db2f689-4c38-4e73-8310-b87103b19410 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:33.428545 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9db2f689-4c38-4e73-8310-b87103b19410 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:33.428986 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9db2f689-4c38-4e73-8310-b87103b19410 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:33.429767 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9db2f689-4c38-4e73-8310-b87103b19410 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:33.430151 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9db2f689-4c38-4e73-8310-b87103b19410 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:33.430616 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9db2f689-4c38-4e73-8310-b87103b19410 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:33.558277 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9db2f689-4c38-4e73-8310-b87103b19410 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:25:33.566066 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9db2f689-4c38-4e73-8310-b87103b19410 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa" status: 200 len: 1356 microversion: 2.1 time: 0.149668 Oct 23 02:25:33.566640 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4000/7908] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:25:33 2022] GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa => generated 1356 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:25:34.589426 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7efe6a77-1cf7-4e3c-993a-e0d6cb8d9322 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:25:34.590584 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7efe6a77-1cf7-4e3c-993a-e0d6cb8d9322 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 4a59b989-d997-482f-8e2a-31ecfb741bfa] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:25:34.597487 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7efe6a77-1cf7-4e3c-993a-e0d6cb8d9322 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:34.597995 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7efe6a77-1cf7-4e3c-993a-e0d6cb8d9322 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:34.598454 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7efe6a77-1cf7-4e3c-993a-e0d6cb8d9322 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:34.599409 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7efe6a77-1cf7-4e3c-993a-e0d6cb8d9322 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:34.599877 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7efe6a77-1cf7-4e3c-993a-e0d6cb8d9322 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:34.600310 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7efe6a77-1cf7-4e3c-993a-e0d6cb8d9322 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:34.732969 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7efe6a77-1cf7-4e3c-993a-e0d6cb8d9322 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:25:34.740643 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7efe6a77-1cf7-4e3c-993a-e0d6cb8d9322 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa" status: 200 len: 1356 microversion: 2.1 time: 0.155127 Oct 23 02:25:34.741213 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3909/7909] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:25:34 2022] GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa => generated 1356 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:25:35.763662 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bf600675-4023-4645-bff8-31179cf1be39 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:25:35.764290 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bf600675-4023-4645-bff8-31179cf1be39 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 4a59b989-d997-482f-8e2a-31ecfb741bfa] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:25:35.771140 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf600675-4023-4645-bff8-31179cf1be39 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:35.771635 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf600675-4023-4645-bff8-31179cf1be39 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:35.772079 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf600675-4023-4645-bff8-31179cf1be39 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:35.772772 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf600675-4023-4645-bff8-31179cf1be39 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:35.773233 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf600675-4023-4645-bff8-31179cf1be39 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:35.773661 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf600675-4023-4645-bff8-31179cf1be39 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:35.901429 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-bf600675-4023-4645-bff8-31179cf1be39 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:25:35.909467 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bf600675-4023-4645-bff8-31179cf1be39 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa" status: 200 len: 1356 microversion: 2.1 time: 0.149692 Oct 23 02:25:35.910084 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4001/7910] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:25:35 2022] GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa => generated 1356 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:25:36.064797 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-31833e88-6d54-45de-a5de-09cfb854c13c req-e1891a08-e0c5-4b5a-b8d1-0c6364adeea8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a59b989-d997-482f-8e2a-31ecfb741bfa", "name": "network-vif-plugged", "status": "completed", "tag": "50f87014-907e-4d58-9c41-04afcf7c9751"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:25:36.074245 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-31833e88-6d54-45de-a5de-09cfb854c13c req-e1891a08-e0c5-4b5a-b8d1-0c6364adeea8 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:36.074713 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-31833e88-6d54-45de-a5de-09cfb854c13c req-e1891a08-e0c5-4b5a-b8d1-0c6364adeea8 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:36.075148 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-31833e88-6d54-45de-a5de-09cfb854c13c req-e1891a08-e0c5-4b5a-b8d1-0c6364adeea8 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:36.086141 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-31833e88-6d54-45de-a5de-09cfb854c13c req-e1891a08-e0c5-4b5a-b8d1-0c6364adeea8 service nova] Creating event network-vif-plugged:50f87014-907e-4d58-9c41-04afcf7c9751 for instance 4a59b989-d997-482f-8e2a-31ecfb741bfa on n-h1-master-1 Oct 23 02:25:36.091628 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-31833e88-6d54-45de-a5de-09cfb854c13c req-e1891a08-e0c5-4b5a-b8d1-0c6364adeea8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083170 Oct 23 02:25:36.092228 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3910/7911] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:25:36.933179 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-da30367c-b7f1-4079-b68c-2340d3922f95 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:25:36.934319 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-da30367c-b7f1-4079-b68c-2340d3922f95 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 4a59b989-d997-482f-8e2a-31ecfb741bfa] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:25:36.941226 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-da30367c-b7f1-4079-b68c-2340d3922f95 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:36.941751 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-da30367c-b7f1-4079-b68c-2340d3922f95 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:36.942234 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-da30367c-b7f1-4079-b68c-2340d3922f95 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:36.942950 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-da30367c-b7f1-4079-b68c-2340d3922f95 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:36.943412 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-da30367c-b7f1-4079-b68c-2340d3922f95 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:36.943845 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-da30367c-b7f1-4079-b68c-2340d3922f95 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:37.070392 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-da30367c-b7f1-4079-b68c-2340d3922f95 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:25:37.078841 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-da30367c-b7f1-4079-b68c-2340d3922f95 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa" status: 200 len: 1356 microversion: 2.1 time: 0.149654 Oct 23 02:25:37.079419 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4002/7912] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:25:36 2022] GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa => generated 1356 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:25:38.104045 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4145597c-8098-4dc9-a796-90503802eacb tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:25:38.104810 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4145597c-8098-4dc9-a796-90503802eacb tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 4a59b989-d997-482f-8e2a-31ecfb741bfa] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:25:38.111452 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4145597c-8098-4dc9-a796-90503802eacb tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:38.111942 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4145597c-8098-4dc9-a796-90503802eacb tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:38.112385 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4145597c-8098-4dc9-a796-90503802eacb tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:38.113074 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4145597c-8098-4dc9-a796-90503802eacb tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:38.113565 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4145597c-8098-4dc9-a796-90503802eacb tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:38.114019 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4145597c-8098-4dc9-a796-90503802eacb tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:38.244177 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4145597c-8098-4dc9-a796-90503802eacb tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:25:38.252002 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4145597c-8098-4dc9-a796-90503802eacb tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa" status: 200 len: 1547 microversion: 2.1 time: 0.153294 Oct 23 02:25:38.252575 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3911/7913] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:25:38 2022] GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa => generated 1547 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:25:38.274019 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0b2f5bbe-a121-42b5-9759-8ab103d9682f tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:25:38.274643 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0b2f5bbe-a121-42b5-9759-8ab103d9682f tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 4a59b989-d997-482f-8e2a-31ecfb741bfa] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:25:38.282023 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b2f5bbe-a121-42b5-9759-8ab103d9682f tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:38.282514 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b2f5bbe-a121-42b5-9759-8ab103d9682f tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:38.282955 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b2f5bbe-a121-42b5-9759-8ab103d9682f tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:38.283645 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b2f5bbe-a121-42b5-9759-8ab103d9682f tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:38.284104 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b2f5bbe-a121-42b5-9759-8ab103d9682f tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:38.284531 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0b2f5bbe-a121-42b5-9759-8ab103d9682f tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:38.409118 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0b2f5bbe-a121-42b5-9759-8ab103d9682f tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:25:38.416846 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0b2f5bbe-a121-42b5-9759-8ab103d9682f tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa" status: 200 len: 1547 microversion: 2.1 time: 0.146815 Oct 23 02:25:38.417421 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4003/7914] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:25:38 2022] GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa => generated 1547 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:25:38.440845 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9aae08c5-8a6f-4f52-a8a9-0b8879f1ad19 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:25:38.445526 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9aae08c5-8a6f-4f52-a8a9-0b8879f1ad19 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:25:38.446339 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9aae08c5-8a6f-4f52-a8a9-0b8879f1ad19 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Searching by: {'deleted': False, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487'} {{(pid=120945) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 23 02:25:38.451680 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9aae08c5-8a6f-4f52-a8a9-0b8879f1ad19 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:38.452174 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9aae08c5-8a6f-4f52-a8a9-0b8879f1ad19 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:38.452627 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9aae08c5-8a6f-4f52-a8a9-0b8879f1ad19 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:38.453366 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9aae08c5-8a6f-4f52-a8a9-0b8879f1ad19 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:38.453830 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9aae08c5-8a6f-4f52-a8a9-0b8879f1ad19 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:38.454317 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9aae08c5-8a6f-4f52-a8a9-0b8879f1ad19 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:38.478286 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.multi_cell_list [None req-9aae08c5-8a6f-4f52-a8a9-0b8879f1ad19 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120945) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 23 02:25:38.505203 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9aae08c5-8a6f-4f52-a8a9-0b8879f1ad19 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.068161 Oct 23 02:25:38.505820 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3912/7915] 10.222.0.42 () {58 vars in 1125 bytes} [Sun Oct 23 02:25:38 2022] GET /compute/v2.1/servers => generated 341 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:25:38.517410 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8e42a770-639c-4f5c-bd5b-fc14fb0c4760 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:25:38.518093 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8e42a770-639c-4f5c-bd5b-fc14fb0c4760 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 4a59b989-d997-482f-8e2a-31ecfb741bfa] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:25:38.524014 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8e42a770-639c-4f5c-bd5b-fc14fb0c4760 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:38.524498 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8e42a770-639c-4f5c-bd5b-fc14fb0c4760 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:38.524933 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8e42a770-639c-4f5c-bd5b-fc14fb0c4760 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:38.525620 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8e42a770-639c-4f5c-bd5b-fc14fb0c4760 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:38.526102 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8e42a770-639c-4f5c-bd5b-fc14fb0c4760 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:38.526530 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8e42a770-639c-4f5c-bd5b-fc14fb0c4760 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:38.656169 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8e42a770-639c-4f5c-bd5b-fc14fb0c4760 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:25:38.663971 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8e42a770-639c-4f5c-bd5b-fc14fb0c4760 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa" status: 200 len: 1547 microversion: 2.1 time: 0.150458 Oct 23 02:25:38.664544 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4004/7916] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:25:38 2022] GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:25:41.495498 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b9ee133a-23db-4976-ad10-4be176a62967 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "58123c1a-a0ba-4d81-a711-5a4ec82fe30a"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:25:41.497848 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b9ee133a-23db-4976-ad10-4be176a62967 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 4a59b989-d997-482f-8e2a-31ecfb741bfa] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:25:41.504648 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9ee133a-23db-4976-ad10-4be176a62967 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:41.505140 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9ee133a-23db-4976-ad10-4be176a62967 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:41.505587 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9ee133a-23db-4976-ad10-4be176a62967 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:41.506329 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9ee133a-23db-4976-ad10-4be176a62967 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:41.506780 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9ee133a-23db-4976-ad10-4be176a62967 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:41.507214 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b9ee133a-23db-4976-ad10-4be176a62967 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:42.154657 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b9ee133a-23db-4976-ad10-4be176a62967 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "POST /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.662856 Oct 23 02:25:42.155223 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3913/7917] 10.222.0.42 () {60 vars in 1323 bytes} [Sun Oct 23 02:25:41 2022] POST /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa/os-volume_attachments => generated 194 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:25:53.977115 n-d-master-1 devstack@n-api.service[120944]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6e68fc69-29cc-49a6-b869-84458cd5ea3f] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 23 02:25:53.980937 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7c92e7a5-b95c-481d-ad81-be4f5a32ac2f tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:25:53.981623 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7c92e7a5-b95c-481d-ad81-be4f5a32ac2f tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 4a59b989-d997-482f-8e2a-31ecfb741bfa] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:25:53.983777 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:25:53.984455 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=62 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:25:53.989136 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c92e7a5-b95c-481d-ad81-be4f5a32ac2f tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:53.989624 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c92e7a5-b95c-481d-ad81-be4f5a32ac2f tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:53.990091 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c92e7a5-b95c-481d-ad81-be4f5a32ac2f tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:53.990788 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c92e7a5-b95c-481d-ad81-be4f5a32ac2f tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:53.991249 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c92e7a5-b95c-481d-ad81-be4f5a32ac2f tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:53.991677 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7c92e7a5-b95c-481d-ad81-be4f5a32ac2f tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:54.123674 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7c92e7a5-b95c-481d-ad81-be4f5a32ac2f tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:25:54.131895 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7c92e7a5-b95c-481d-ad81-be4f5a32ac2f tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa" status: 200 len: 1593 microversion: 2.1 time: 0.156279 Oct 23 02:25:54.132466 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4005/7918] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:25:53 2022] GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa => generated 1593 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:25:56.278841 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:25:56.282130 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:25:56.283177 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:25:56.295558 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-5ef33ab0-0256-45aa-94ae-819c3b023872 req-9be51346-e3a4-4107-a3f7-986a08b13b1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a59b989-d997-482f-8e2a-31ecfb741bfa", "tag": "50f87014-907e-4d58-9c41-04afcf7c9751"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:25:56.305805 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-5ef33ab0-0256-45aa-94ae-819c3b023872 req-9be51346-e3a4-4107-a3f7-986a08b13b1a service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:56.307991 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-5ef33ab0-0256-45aa-94ae-819c3b023872 req-9be51346-e3a4-4107-a3f7-986a08b13b1a service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:56.307991 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-5ef33ab0-0256-45aa-94ae-819c3b023872 req-9be51346-e3a4-4107-a3f7-986a08b13b1a service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:56.318524 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-5ef33ab0-0256-45aa-94ae-819c3b023872 req-9be51346-e3a4-4107-a3f7-986a08b13b1a service nova] Creating event network-changed:50f87014-907e-4d58-9c41-04afcf7c9751 for instance 4a59b989-d997-482f-8e2a-31ecfb741bfa on n-h1-master-1 Oct 23 02:25:56.323506 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-5ef33ab0-0256-45aa-94ae-819c3b023872 req-9be51346-e3a4-4107-a3f7-986a08b13b1a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048970 Oct 23 02:25:56.324102 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3914/7919] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:25:58.853078 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2edc1b78-b83e-4cf5-8544-757e14b758b2 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-428361214"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:25:58.865905 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2edc1b78-b83e-4cf5-8544-757e14b758b2 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 4a59b989-d997-482f-8e2a-31ecfb741bfa] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:25:58.865905 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2edc1b78-b83e-4cf5-8544-757e14b758b2 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:58.865905 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2edc1b78-b83e-4cf5-8544-757e14b758b2 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:58.865905 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2edc1b78-b83e-4cf5-8544-757e14b758b2 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:58.865905 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2edc1b78-b83e-4cf5-8544-757e14b758b2 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:58.865905 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2edc1b78-b83e-4cf5-8544-757e14b758b2 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:58.865905 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2edc1b78-b83e-4cf5-8544-757e14b758b2 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:58.879831 n-d-master-1 devstack@n-api.service[120944]: INFO oslo.messaging._drivers.impl_rabbit [-] [6e68fc69-29cc-49a6-b869-84458cd5ea3f] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 38436. Oct 23 02:25:58.993583 n-d-master-1 devstack@n-api.service[120944]: INFO nova.network.security_group_api [None req-2edc1b78-b83e-4cf5-8544-757e14b758b2 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Adding security group f1554bd5-5b9a-4196-8aca-1596873c1fe1 to port 50f87014-907e-4d58-9c41-04afcf7c9751 Oct 23 02:25:59.345636 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2edc1b78-b83e-4cf5-8544-757e14b758b2 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "POST /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa/action" status: 202 len: 0 microversion: 2.1 time: 0.496790 Oct 23 02:25:59.346772 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4006/7920] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:25:58 2022] POST /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa/action => generated 0 bytes in 498 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:25:59.354599 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d17c725a-af5e-45ac-951c-f2af8558d618 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:25:59.355294 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d17c725a-af5e-45ac-951c-f2af8558d618 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 4a59b989-d997-482f-8e2a-31ecfb741bfa] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:25:59.356320 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-dcbb9f42-4c07-480b-b616-104df7226c82 req-24f1920a-7927-49b2-aa58-a67b7245c62c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a59b989-d997-482f-8e2a-31ecfb741bfa", "tag": "50f87014-907e-4d58-9c41-04afcf7c9751"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:25:59.362005 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d17c725a-af5e-45ac-951c-f2af8558d618 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:59.362521 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d17c725a-af5e-45ac-951c-f2af8558d618 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:59.368154 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-dcbb9f42-4c07-480b-b616-104df7226c82 req-24f1920a-7927-49b2-aa58-a67b7245c62c service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:59.368659 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-dcbb9f42-4c07-480b-b616-104df7226c82 req-24f1920a-7927-49b2-aa58-a67b7245c62c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:59.369298 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-dcbb9f42-4c07-480b-b616-104df7226c82 req-24f1920a-7927-49b2-aa58-a67b7245c62c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:59.369711 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d17c725a-af5e-45ac-951c-f2af8558d618 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:59.376878 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d17c725a-af5e-45ac-951c-f2af8558d618 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:59.377422 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d17c725a-af5e-45ac-951c-f2af8558d618 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:59.377872 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d17c725a-af5e-45ac-951c-f2af8558d618 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:59.381564 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-dcbb9f42-4c07-480b-b616-104df7226c82 req-24f1920a-7927-49b2-aa58-a67b7245c62c service nova] Creating event network-changed:50f87014-907e-4d58-9c41-04afcf7c9751 for instance 4a59b989-d997-482f-8e2a-31ecfb741bfa on n-h1-master-1 Oct 23 02:25:59.386960 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-dcbb9f42-4c07-480b-b616-104df7226c82 req-24f1920a-7927-49b2-aa58-a67b7245c62c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036310 Oct 23 02:25:59.389861 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3915/7921] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:25:59.540813 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d17c725a-af5e-45ac-951c-f2af8558d618 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:25:59.547348 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d17c725a-af5e-45ac-951c-f2af8558d618 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa" status: 200 len: 1757 microversion: 2.1 time: 0.196595 Oct 23 02:25:59.548283 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4007/7922] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:25:59 2022] GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa => generated 1757 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:26:13.540074 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d3f0639c-d016-4bf6-be6a-72eecdf7dfba tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:26:13.542392 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d3f0639c-d016-4bf6-be6a-72eecdf7dfba tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 4a59b989-d997-482f-8e2a-31ecfb741bfa] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:26:13.550385 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d3f0639c-d016-4bf6-be6a-72eecdf7dfba tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:13.550885 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d3f0639c-d016-4bf6-be6a-72eecdf7dfba tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:13.551334 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d3f0639c-d016-4bf6-be6a-72eecdf7dfba tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:13.552037 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d3f0639c-d016-4bf6-be6a-72eecdf7dfba tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:13.552506 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d3f0639c-d016-4bf6-be6a-72eecdf7dfba tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:13.552947 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d3f0639c-d016-4bf6-be6a-72eecdf7dfba tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:13.751327 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d3f0639c-d016-4bf6-be6a-72eecdf7dfba tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "POST /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa/action" status: 202 len: 0 microversion: 2.1 time: 0.216367 Oct 23 02:26:13.751993 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3916/7923] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:26:13 2022] POST /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 23 02:26:13.760488 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d9994bd9-50b8-425c-9d92-167fd64da79c tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:26:13.761196 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d9994bd9-50b8-425c-9d92-167fd64da79c tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 4a59b989-d997-482f-8e2a-31ecfb741bfa] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:26:13.764082 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=6 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:26:13.764744 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=16 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:26:13.769942 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d9994bd9-50b8-425c-9d92-167fd64da79c tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:13.770469 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d9994bd9-50b8-425c-9d92-167fd64da79c tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:13.770909 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d9994bd9-50b8-425c-9d92-167fd64da79c tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:13.771612 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d9994bd9-50b8-425c-9d92-167fd64da79c tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:13.772068 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d9994bd9-50b8-425c-9d92-167fd64da79c tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:13.772503 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d9994bd9-50b8-425c-9d92-167fd64da79c tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:13.915407 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d9994bd9-50b8-425c-9d92-167fd64da79c tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:26:13.924016 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d9994bd9-50b8-425c-9d92-167fd64da79c tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa" status: 200 len: 1749 microversion: 2.1 time: 0.167661 Oct 23 02:26:13.924613 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4008/7924] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:26:13 2022] GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa => generated 1749 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:26:14.949476 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fab7f59a-21d4-4888-8b98-781de6338a5e tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:26:14.950245 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-fab7f59a-21d4-4888-8b98-781de6338a5e tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 4a59b989-d997-482f-8e2a-31ecfb741bfa] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:26:14.956526 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fab7f59a-21d4-4888-8b98-781de6338a5e tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:14.957033 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fab7f59a-21d4-4888-8b98-781de6338a5e tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:14.957483 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fab7f59a-21d4-4888-8b98-781de6338a5e tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:14.958219 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fab7f59a-21d4-4888-8b98-781de6338a5e tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:14.958693 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fab7f59a-21d4-4888-8b98-781de6338a5e tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:14.959136 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fab7f59a-21d4-4888-8b98-781de6338a5e tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:15.105553 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-fab7f59a-21d4-4888-8b98-781de6338a5e tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:26:15.114429 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fab7f59a-21d4-4888-8b98-781de6338a5e tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa" status: 200 len: 1754 microversion: 2.1 time: 0.170072 Oct 23 02:26:15.115005 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3917/7925] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:26:14 2022] GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:26:16.138298 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dddf0606-046d-4681-8abf-91db92c67c11 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:26:16.138932 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-dddf0606-046d-4681-8abf-91db92c67c11 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 4a59b989-d997-482f-8e2a-31ecfb741bfa] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:26:16.145702 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dddf0606-046d-4681-8abf-91db92c67c11 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:16.146224 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dddf0606-046d-4681-8abf-91db92c67c11 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:16.146664 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dddf0606-046d-4681-8abf-91db92c67c11 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:16.147345 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dddf0606-046d-4681-8abf-91db92c67c11 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:16.147802 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dddf0606-046d-4681-8abf-91db92c67c11 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:16.148228 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dddf0606-046d-4681-8abf-91db92c67c11 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:16.287719 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-dddf0606-046d-4681-8abf-91db92c67c11 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:26:16.295174 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-dddf0606-046d-4681-8abf-91db92c67c11 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa" status: 200 len: 1754 microversion: 2.1 time: 0.160839 Oct 23 02:26:16.295759 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4009/7926] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:26:16 2022] GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:26:17.319141 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9f9f9798-68fa-45bd-afd4-e61c849b64ee tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:26:17.319765 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9f9f9798-68fa-45bd-afd4-e61c849b64ee tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 4a59b989-d997-482f-8e2a-31ecfb741bfa] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:26:17.326487 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f9f9798-68fa-45bd-afd4-e61c849b64ee tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:17.326981 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f9f9798-68fa-45bd-afd4-e61c849b64ee tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:17.327426 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f9f9798-68fa-45bd-afd4-e61c849b64ee tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:17.328122 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f9f9798-68fa-45bd-afd4-e61c849b64ee tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:17.328582 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f9f9798-68fa-45bd-afd4-e61c849b64ee tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:17.329013 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9f9f9798-68fa-45bd-afd4-e61c849b64ee tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:17.474156 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9f9f9798-68fa-45bd-afd4-e61c849b64ee tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:26:17.482766 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9f9f9798-68fa-45bd-afd4-e61c849b64ee tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa" status: 200 len: 1754 microversion: 2.1 time: 0.167489 Oct 23 02:26:17.483350 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3918/7927] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:26:17 2022] GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:26:18.506741 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8450316e-a9e1-4065-b384-56f3d05fe669 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:26:18.507376 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8450316e-a9e1-4065-b384-56f3d05fe669 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 4a59b989-d997-482f-8e2a-31ecfb741bfa] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:26:18.514337 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8450316e-a9e1-4065-b384-56f3d05fe669 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:18.514834 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8450316e-a9e1-4065-b384-56f3d05fe669 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:18.515281 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8450316e-a9e1-4065-b384-56f3d05fe669 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:18.515984 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8450316e-a9e1-4065-b384-56f3d05fe669 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:18.516446 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8450316e-a9e1-4065-b384-56f3d05fe669 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:18.517371 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8450316e-a9e1-4065-b384-56f3d05fe669 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:18.657474 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8450316e-a9e1-4065-b384-56f3d05fe669 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:26:18.665903 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8450316e-a9e1-4065-b384-56f3d05fe669 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa" status: 200 len: 1754 microversion: 2.1 time: 0.163158 Oct 23 02:26:18.666525 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4010/7928] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:26:18 2022] GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:26:19.689953 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-04865544-00d1-4c3b-ae60-0cd3121d20c6 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:26:19.690610 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-04865544-00d1-4c3b-ae60-0cd3121d20c6 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 4a59b989-d997-482f-8e2a-31ecfb741bfa] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:26:19.697381 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-04865544-00d1-4c3b-ae60-0cd3121d20c6 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:19.697939 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-04865544-00d1-4c3b-ae60-0cd3121d20c6 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:19.698386 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-04865544-00d1-4c3b-ae60-0cd3121d20c6 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:19.699114 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-04865544-00d1-4c3b-ae60-0cd3121d20c6 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:19.699580 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-04865544-00d1-4c3b-ae60-0cd3121d20c6 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:19.700017 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-04865544-00d1-4c3b-ae60-0cd3121d20c6 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:19.838966 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-04865544-00d1-4c3b-ae60-0cd3121d20c6 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:26:19.847785 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-04865544-00d1-4c3b-ae60-0cd3121d20c6 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa" status: 200 len: 1754 microversion: 2.1 time: 0.161734 Oct 23 02:26:19.848365 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3919/7929] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:26:19 2022] GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:26:20.871577 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0828f5aa-0585-4b22-a075-c23e8e1b05c4 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:26:20.872132 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0828f5aa-0585-4b22-a075-c23e8e1b05c4 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 4a59b989-d997-482f-8e2a-31ecfb741bfa] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:26:20.878958 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0828f5aa-0585-4b22-a075-c23e8e1b05c4 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:20.879447 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0828f5aa-0585-4b22-a075-c23e8e1b05c4 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:20.879883 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0828f5aa-0585-4b22-a075-c23e8e1b05c4 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:20.880577 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0828f5aa-0585-4b22-a075-c23e8e1b05c4 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:20.881032 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0828f5aa-0585-4b22-a075-c23e8e1b05c4 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:20.881458 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0828f5aa-0585-4b22-a075-c23e8e1b05c4 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:21.022571 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0828f5aa-0585-4b22-a075-c23e8e1b05c4 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:26:21.030878 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0828f5aa-0585-4b22-a075-c23e8e1b05c4 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa" status: 200 len: 1754 microversion: 2.1 time: 0.163372 Oct 23 02:26:21.031453 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4011/7930] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:26:20 2022] GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:26:22.055008 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9ec8119e-a1e8-4eb0-9f5d-774b4c6149cc tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:26:22.055690 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9ec8119e-a1e8-4eb0-9f5d-774b4c6149cc tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 4a59b989-d997-482f-8e2a-31ecfb741bfa] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:26:22.062194 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9ec8119e-a1e8-4eb0-9f5d-774b4c6149cc tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:22.062701 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9ec8119e-a1e8-4eb0-9f5d-774b4c6149cc tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:22.063153 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9ec8119e-a1e8-4eb0-9f5d-774b4c6149cc tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:22.064464 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9ec8119e-a1e8-4eb0-9f5d-774b4c6149cc tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:22.064936 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9ec8119e-a1e8-4eb0-9f5d-774b4c6149cc tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:22.065377 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9ec8119e-a1e8-4eb0-9f5d-774b4c6149cc tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:22.206636 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9ec8119e-a1e8-4eb0-9f5d-774b4c6149cc tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:26:22.214954 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9ec8119e-a1e8-4eb0-9f5d-774b4c6149cc tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa" status: 200 len: 1754 microversion: 2.1 time: 0.164038 Oct 23 02:26:22.215528 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3920/7931] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:26:22 2022] GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:26:23.238750 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ba5143f9-9210-40b0-bbb3-088faa4a7cff tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:26:23.239381 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ba5143f9-9210-40b0-bbb3-088faa4a7cff tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 4a59b989-d997-482f-8e2a-31ecfb741bfa] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:26:23.245685 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba5143f9-9210-40b0-bbb3-088faa4a7cff tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:23.246201 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba5143f9-9210-40b0-bbb3-088faa4a7cff tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:23.246647 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba5143f9-9210-40b0-bbb3-088faa4a7cff tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:23.247341 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba5143f9-9210-40b0-bbb3-088faa4a7cff tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:23.247801 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba5143f9-9210-40b0-bbb3-088faa4a7cff tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:23.248232 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ba5143f9-9210-40b0-bbb3-088faa4a7cff tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:23.396097 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ba5143f9-9210-40b0-bbb3-088faa4a7cff tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:26:23.404375 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ba5143f9-9210-40b0-bbb3-088faa4a7cff tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa" status: 200 len: 1754 microversion: 2.1 time: 0.169806 Oct 23 02:26:23.404953 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4012/7932] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:26:23 2022] GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:26:24.427322 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-36effff4-1c29-4d2d-9766-ea5bef62ad2c tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:26:24.427957 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-36effff4-1c29-4d2d-9766-ea5bef62ad2c tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 4a59b989-d997-482f-8e2a-31ecfb741bfa] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:26:24.435084 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36effff4-1c29-4d2d-9766-ea5bef62ad2c tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:24.435591 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36effff4-1c29-4d2d-9766-ea5bef62ad2c tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:24.436044 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36effff4-1c29-4d2d-9766-ea5bef62ad2c tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:24.436774 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36effff4-1c29-4d2d-9766-ea5bef62ad2c tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:24.437248 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36effff4-1c29-4d2d-9766-ea5bef62ad2c tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:24.437686 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36effff4-1c29-4d2d-9766-ea5bef62ad2c tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:24.579682 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-36effff4-1c29-4d2d-9766-ea5bef62ad2c tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:26:24.587927 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-36effff4-1c29-4d2d-9766-ea5bef62ad2c tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa" status: 200 len: 1754 microversion: 2.1 time: 0.164563 Oct 23 02:26:24.588501 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3921/7933] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:26:24 2022] GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:26:25.613054 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8770c94f-285b-42da-97b0-57deac93d1bd tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:26:25.613674 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8770c94f-285b-42da-97b0-57deac93d1bd tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 4a59b989-d997-482f-8e2a-31ecfb741bfa] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:26:25.620547 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8770c94f-285b-42da-97b0-57deac93d1bd tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:25.621034 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8770c94f-285b-42da-97b0-57deac93d1bd tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:25.621491 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8770c94f-285b-42da-97b0-57deac93d1bd tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:25.622190 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8770c94f-285b-42da-97b0-57deac93d1bd tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:25.622654 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8770c94f-285b-42da-97b0-57deac93d1bd tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:25.623084 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8770c94f-285b-42da-97b0-57deac93d1bd tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:25.770362 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8770c94f-285b-42da-97b0-57deac93d1bd tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:26:25.778673 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8770c94f-285b-42da-97b0-57deac93d1bd tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa" status: 200 len: 1757 microversion: 2.1 time: 0.170202 Oct 23 02:26:25.779251 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4013/7934] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:26:25 2022] GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:26:58.206837 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4da06c74-07db-4953-b3c2-b7516e8c7381 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-428361214"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:26:58.207462 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4da06c74-07db-4953-b3c2-b7516e8c7381 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 4a59b989-d997-482f-8e2a-31ecfb741bfa] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:26:58.209864 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=16 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:26:58.210642 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:26:58.216038 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4da06c74-07db-4953-b3c2-b7516e8c7381 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:58.221357 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4da06c74-07db-4953-b3c2-b7516e8c7381 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:58.221357 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4da06c74-07db-4953-b3c2-b7516e8c7381 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:58.221357 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4da06c74-07db-4953-b3c2-b7516e8c7381 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:58.221357 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4da06c74-07db-4953-b3c2-b7516e8c7381 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:58.221357 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4da06c74-07db-4953-b3c2-b7516e8c7381 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:58.346554 n-d-master-1 devstack@n-api.service[120945]: INFO nova.network.security_group_api [None req-4da06c74-07db-4953-b3c2-b7516e8c7381 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Removing security group f1554bd5-5b9a-4196-8aca-1596873c1fe1 from port 50f87014-907e-4d58-9c41-04afcf7c9751 Oct 23 02:26:58.713385 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4da06c74-07db-4953-b3c2-b7516e8c7381 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "POST /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa/action" status: 202 len: 0 microversion: 2.1 time: 0.510192 Oct 23 02:26:58.713385 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3922/7935] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:26:58 2022] POST /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa/action => generated 0 bytes in 512 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:26:58.723045 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=12 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:26:58.723809 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=36 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:26:58.792299 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-e54c849d-11a0-4062-88a1-57baed39b6a2 req-a585db65-138d-4714-b020-ac1f670446ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a59b989-d997-482f-8e2a-31ecfb741bfa", "tag": "50f87014-907e-4d58-9c41-04afcf7c9751"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:26:58.805459 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-e54c849d-11a0-4062-88a1-57baed39b6a2 req-a585db65-138d-4714-b020-ac1f670446ee service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:58.805459 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-e54c849d-11a0-4062-88a1-57baed39b6a2 req-a585db65-138d-4714-b020-ac1f670446ee service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:58.805459 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-e54c849d-11a0-4062-88a1-57baed39b6a2 req-a585db65-138d-4714-b020-ac1f670446ee service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:58.817063 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-e54c849d-11a0-4062-88a1-57baed39b6a2 req-a585db65-138d-4714-b020-ac1f670446ee service nova] Creating event network-changed:50f87014-907e-4d58-9c41-04afcf7c9751 for instance 4a59b989-d997-482f-8e2a-31ecfb741bfa on n-h1-master-1 Oct 23 02:26:58.822507 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-e54c849d-11a0-4062-88a1-57baed39b6a2 req-a585db65-138d-4714-b020-ac1f670446ee service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104313 Oct 23 02:26:58.823320 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4014/7936] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:26:59.946228 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-420cf223-a333-42c5-af44-88c1b2c28eda tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:26:59.946769 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-420cf223-a333-42c5-af44-88c1b2c28eda tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 4a59b989-d997-482f-8e2a-31ecfb741bfa] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:26:59.952776 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-420cf223-a333-42c5-af44-88c1b2c28eda tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:59.953832 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-420cf223-a333-42c5-af44-88c1b2c28eda tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:59.954305 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-420cf223-a333-42c5-af44-88c1b2c28eda tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:59.955003 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-420cf223-a333-42c5-af44-88c1b2c28eda tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:59.955494 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-420cf223-a333-42c5-af44-88c1b2c28eda tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:59.955926 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-420cf223-a333-42c5-af44-88c1b2c28eda tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:00.039573 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-420cf223-a333-42c5-af44-88c1b2c28eda tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lazy-loading 'services' on Instance uuid 4a59b989-d997-482f-8e2a-31ecfb741bfa {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:27:00.246562 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-420cf223-a333-42c5-af44-88c1b2c28eda tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa/os-volume_attachments/58123c1a-a0ba-4d81-a711-5a4ec82fe30a" status: 202 len: 0 microversion: 2.1 time: 0.305274 Oct 23 02:27:00.247195 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3923/7937] 10.222.0.42 () {58 vars in 1416 bytes} [Sun Oct 23 02:26:59 2022] DELETE /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa/os-volume_attachments/58123c1a-a0ba-4d81-a711-5a4ec82fe30a => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:27:00.260314 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-458e5169-045a-4ad6-9f1e-4f8af7f4d772 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:27:00.262383 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-458e5169-045a-4ad6-9f1e-4f8af7f4d772 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 4a59b989-d997-482f-8e2a-31ecfb741bfa] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:27:00.269408 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-458e5169-045a-4ad6-9f1e-4f8af7f4d772 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:00.269906 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-458e5169-045a-4ad6-9f1e-4f8af7f4d772 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:00.270379 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-458e5169-045a-4ad6-9f1e-4f8af7f4d772 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:00.271096 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-458e5169-045a-4ad6-9f1e-4f8af7f4d772 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:00.271560 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-458e5169-045a-4ad6-9f1e-4f8af7f4d772 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:00.271993 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-458e5169-045a-4ad6-9f1e-4f8af7f4d772 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:00.303250 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-458e5169-045a-4ad6-9f1e-4f8af7f4d772 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050624 Oct 23 02:27:00.304022 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4015/7938] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 02:27:00 2022] GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:27:00.838178 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-ab9a6a4b-cf35-4be8-9856-e8f1f508df11 req-56879bf2-fb73-4699-af81-84eb0f069326 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a59b989-d997-482f-8e2a-31ecfb741bfa", "tag": "50f87014-907e-4d58-9c41-04afcf7c9751"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:27:00.849527 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ab9a6a4b-cf35-4be8-9856-e8f1f508df11 req-56879bf2-fb73-4699-af81-84eb0f069326 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:00.850051 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ab9a6a4b-cf35-4be8-9856-e8f1f508df11 req-56879bf2-fb73-4699-af81-84eb0f069326 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:00.850501 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-ab9a6a4b-cf35-4be8-9856-e8f1f508df11 req-56879bf2-fb73-4699-af81-84eb0f069326 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:00.862859 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-ab9a6a4b-cf35-4be8-9856-e8f1f508df11 req-56879bf2-fb73-4699-af81-84eb0f069326 service nova] Creating event network-changed:50f87014-907e-4d58-9c41-04afcf7c9751 for instance 4a59b989-d997-482f-8e2a-31ecfb741bfa on n-h1-master-1 Oct 23 02:27:00.867767 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-ab9a6a4b-cf35-4be8-9856-e8f1f508df11 req-56879bf2-fb73-4699-af81-84eb0f069326 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033741 Oct 23 02:27:00.868371 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3924/7939] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:27:01.315942 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6076316f-14e8-4457-84cb-1d3ec5ead69e tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:27:01.318113 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6076316f-14e8-4457-84cb-1d3ec5ead69e tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 4a59b989-d997-482f-8e2a-31ecfb741bfa] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:27:01.325270 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6076316f-14e8-4457-84cb-1d3ec5ead69e tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:01.326081 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6076316f-14e8-4457-84cb-1d3ec5ead69e tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:01.326523 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6076316f-14e8-4457-84cb-1d3ec5ead69e tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:01.327223 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6076316f-14e8-4457-84cb-1d3ec5ead69e tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:01.327677 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6076316f-14e8-4457-84cb-1d3ec5ead69e tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:01.328631 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6076316f-14e8-4457-84cb-1d3ec5ead69e tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:01.361577 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6076316f-14e8-4457-84cb-1d3ec5ead69e tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049809 Oct 23 02:27:01.366615 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4016/7940] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 02:27:01 2022] GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:27:02.375141 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-be0d3c0d-80df-400b-986c-2965b83c67fb tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:27:02.377466 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-be0d3c0d-80df-400b-986c-2965b83c67fb tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 4a59b989-d997-482f-8e2a-31ecfb741bfa] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:27:02.383806 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-be0d3c0d-80df-400b-986c-2965b83c67fb tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:02.384308 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-be0d3c0d-80df-400b-986c-2965b83c67fb tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:02.384762 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-be0d3c0d-80df-400b-986c-2965b83c67fb tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:02.385478 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-be0d3c0d-80df-400b-986c-2965b83c67fb tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:02.385944 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-be0d3c0d-80df-400b-986c-2965b83c67fb tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:02.386410 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-be0d3c0d-80df-400b-986c-2965b83c67fb tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:02.416749 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-be0d3c0d-80df-400b-986c-2965b83c67fb tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046953 Oct 23 02:27:02.417318 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3925/7941] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 02:27:02 2022] GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:27:03.429082 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-63eec1ff-b327-4053-b2aa-66e7f3f7f12b tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:27:03.431564 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-63eec1ff-b327-4053-b2aa-66e7f3f7f12b tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 4a59b989-d997-482f-8e2a-31ecfb741bfa] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:27:03.439307 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-63eec1ff-b327-4053-b2aa-66e7f3f7f12b tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:03.439796 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-63eec1ff-b327-4053-b2aa-66e7f3f7f12b tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:03.440236 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-63eec1ff-b327-4053-b2aa-66e7f3f7f12b tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:03.440936 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-63eec1ff-b327-4053-b2aa-66e7f3f7f12b tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:03.441394 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-63eec1ff-b327-4053-b2aa-66e7f3f7f12b tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:03.441847 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-63eec1ff-b327-4053-b2aa-66e7f3f7f12b tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:03.475231 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-63eec1ff-b327-4053-b2aa-66e7f3f7f12b tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050185 Oct 23 02:27:03.475811 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4017/7942] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 02:27:03 2022] GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:27:04.488386 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3d7eda0d-8e9d-4edd-9605-b907fc5d72c9 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:27:04.491227 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3d7eda0d-8e9d-4edd-9605-b907fc5d72c9 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 4a59b989-d997-482f-8e2a-31ecfb741bfa] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:27:04.498207 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3d7eda0d-8e9d-4edd-9605-b907fc5d72c9 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:04.498709 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3d7eda0d-8e9d-4edd-9605-b907fc5d72c9 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:04.499151 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3d7eda0d-8e9d-4edd-9605-b907fc5d72c9 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:04.500379 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3d7eda0d-8e9d-4edd-9605-b907fc5d72c9 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:04.500846 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3d7eda0d-8e9d-4edd-9605-b907fc5d72c9 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:04.501279 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3d7eda0d-8e9d-4edd-9605-b907fc5d72c9 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:04.530681 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3d7eda0d-8e9d-4edd-9605-b907fc5d72c9 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046544 Oct 23 02:27:04.531241 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3926/7943] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 02:27:04 2022] GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:27:05.543278 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e574bba2-7925-43e0-b26c-ac3f8c80cc13 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:27:05.545503 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e574bba2-7925-43e0-b26c-ac3f8c80cc13 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 4a59b989-d997-482f-8e2a-31ecfb741bfa] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:27:05.552399 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e574bba2-7925-43e0-b26c-ac3f8c80cc13 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:05.552882 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e574bba2-7925-43e0-b26c-ac3f8c80cc13 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:05.553315 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e574bba2-7925-43e0-b26c-ac3f8c80cc13 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:05.554022 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e574bba2-7925-43e0-b26c-ac3f8c80cc13 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:05.554483 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e574bba2-7925-43e0-b26c-ac3f8c80cc13 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:05.554911 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e574bba2-7925-43e0-b26c-ac3f8c80cc13 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:05.584824 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e574bba2-7925-43e0-b26c-ac3f8c80cc13 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045502 Oct 23 02:27:05.585394 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4018/7944] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 02:27:05 2022] GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 02:27:05.596855 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0b6ee2ba-77e4-47b0-9e47-b8fa75fe7453 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:27:05.597368 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0b6ee2ba-77e4-47b0-9e47-b8fa75fe7453 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 4a59b989-d997-482f-8e2a-31ecfb741bfa] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:27:05.604287 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b6ee2ba-77e4-47b0-9e47-b8fa75fe7453 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:05.604778 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b6ee2ba-77e4-47b0-9e47-b8fa75fe7453 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:05.605222 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b6ee2ba-77e4-47b0-9e47-b8fa75fe7453 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:05.605914 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b6ee2ba-77e4-47b0-9e47-b8fa75fe7453 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:05.606401 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b6ee2ba-77e4-47b0-9e47-b8fa75fe7453 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:05.606836 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b6ee2ba-77e4-47b0-9e47-b8fa75fe7453 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:05.679540 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-0b6ee2ba-77e4-47b0-9e47-b8fa75fe7453 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] HTTP exception thrown: Instance 4a59b989-d997-482f-8e2a-31ecfb741bfa is not attached to volume 58123c1a-a0ba-4d81-a711-5a4ec82fe30a Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0b6ee2ba-77e4-47b0-9e47-b8fa75fe7453 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Request method failure captured: Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: request: DELETE /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa/os-volume_attachments/58123c1a-a0ba-4d81-a711-5a4ec82fe30a HTTP/1.1 Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVKUDTZufmk4wu970ZmX8B-nKlt6mM8gQ3xp4w7hwDWWQIPA4NqfGbnNYL3V9MKJeGQE2CfSCIuc3EQVZb53DtLuwOyZjyFhmSsYS1b3kuznGvxlgXeF049KYq1sHII3Vvfq7GjNesFnPyZG7mmryukaT9RejbPijIN-cJU79ErDxCOg Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: dd9a5526b8c7450a9227d266ecf33487 Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-TestMinimumBasicScenario-998385418 Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dd9a5526b8c7450a9227d266ecf33487"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dd9a5526b8c7450a9227d266ecf33487"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dd9a5526b8c7450a9227d266ecf33487"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dd9a5526b8c7450a9227d266ecf33487"}]}] Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-TestMinimumBasicScenario-998385418 Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: dd9a5526b8c7450a9227d266ecf33487 Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-TestMinimumBasicScenario-998385418 Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-TestMinimumBasicScenario-998385418-project Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 722e7b72a173401fa175378ab373c26e Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-TestMinimumBasicScenario-998385418-project Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 4a59b989-d997-482f-8e2a-31ecfb741bfa is not attached to volume 58123c1a-a0ba-4d81-a711-5a4ec82fe30a Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: action_args: {'server_id': '4a59b989-d997-482f-8e2a-31ecfb741bfa', 'id': '58123c1a-a0ba-4d81-a711-5a4ec82fe30a'} Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 58123c1a-a0ba-4d81-a711-5a4ec82fe30a. Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a59b989-d997-482f-8e2a-31ecfb741bfa is not attached to volume 58123c1a-a0ba-4d81-a711-5a4ec82fe30a Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:27:05.681174 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:27:05.686137 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:27:05.686137 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:27:05.686137 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a59b989-d997-482f-8e2a-31ecfb741bfa is not attached to volume 58123c1a-a0ba-4d81-a711-5a4ec82fe30a Oct 23 02:27:05.686137 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:27:05.686137 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0b6ee2ba-77e4-47b0-9e47-b8fa75fe7453 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Returning 404 to user: Instance 4a59b989-d997-482f-8e2a-31ecfb741bfa is not attached to volume 58123c1a-a0ba-4d81-a711-5a4ec82fe30a {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:27:05.686137 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0b6ee2ba-77e4-47b0-9e47-b8fa75fe7453 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa/os-volume_attachments/58123c1a-a0ba-4d81-a711-5a4ec82fe30a" status: 404 len: 154 microversion: 2.1 time: 0.090553 Oct 23 02:27:05.686137 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3927/7945] 10.222.0.42 () {58 vars in 1416 bytes} [Sun Oct 23 02:27:05 2022] DELETE /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa/os-volume_attachments/58123c1a-a0ba-4d81-a711-5a4ec82fe30a => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:27:09.046861 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8a39fdf6-dd50-4c4e-8109-0bcfa52adaed tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:27:09.047385 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8a39fdf6-dd50-4c4e-8109-0bcfa52adaed tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 4a59b989-d997-482f-8e2a-31ecfb741bfa] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:27:09.054574 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8a39fdf6-dd50-4c4e-8109-0bcfa52adaed tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:09.054942 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8a39fdf6-dd50-4c4e-8109-0bcfa52adaed tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:09.055381 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8a39fdf6-dd50-4c4e-8109-0bcfa52adaed tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:09.056087 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8a39fdf6-dd50-4c4e-8109-0bcfa52adaed tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:09.056549 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8a39fdf6-dd50-4c4e-8109-0bcfa52adaed tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:09.056983 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8a39fdf6-dd50-4c4e-8109-0bcfa52adaed tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:09.083771 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8a39fdf6-dd50-4c4e-8109-0bcfa52adaed tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 4a59b989-d997-482f-8e2a-31ecfb741bfa] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 02:27:09.302278 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8a39fdf6-dd50-4c4e-8109-0bcfa52adaed tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa" status: 204 len: 0 microversion: 2.1 time: 0.259009 Oct 23 02:27:09.302979 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4019/7946] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 02:27:09 2022] DELETE /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 02:27:09.311694 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c893b868-5bf3-4d48-9fad-448b7f52307d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:27:09.312992 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c893b868-5bf3-4d48-9fad-448b7f52307d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 4a59b989-d997-482f-8e2a-31ecfb741bfa] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:27:09.321151 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c893b868-5bf3-4d48-9fad-448b7f52307d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:09.321742 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c893b868-5bf3-4d48-9fad-448b7f52307d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:09.322286 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c893b868-5bf3-4d48-9fad-448b7f52307d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:09.333542 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c893b868-5bf3-4d48-9fad-448b7f52307d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:09.333542 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c893b868-5bf3-4d48-9fad-448b7f52307d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:09.333542 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c893b868-5bf3-4d48-9fad-448b7f52307d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:09.458994 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c893b868-5bf3-4d48-9fad-448b7f52307d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:27:09.467054 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c893b868-5bf3-4d48-9fad-448b7f52307d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa" status: 200 len: 1553 microversion: 2.1 time: 0.159677 Oct 23 02:27:09.467626 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3928/7947] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:27:09 2022] GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:27:10.491381 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-55e3fca6-35fb-4803-9cc5-187cb89ba105 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:27:10.492124 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-55e3fca6-35fb-4803-9cc5-187cb89ba105 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 4a59b989-d997-482f-8e2a-31ecfb741bfa] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:27:10.500492 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55e3fca6-35fb-4803-9cc5-187cb89ba105 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:10.500984 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55e3fca6-35fb-4803-9cc5-187cb89ba105 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:10.501428 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55e3fca6-35fb-4803-9cc5-187cb89ba105 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:10.502242 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55e3fca6-35fb-4803-9cc5-187cb89ba105 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:10.502847 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55e3fca6-35fb-4803-9cc5-187cb89ba105 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:10.503282 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-55e3fca6-35fb-4803-9cc5-187cb89ba105 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:10.635989 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-55e3fca6-35fb-4803-9cc5-187cb89ba105 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:27:10.644396 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-55e3fca6-35fb-4803-9cc5-187cb89ba105 tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa" status: 200 len: 1553 microversion: 2.1 time: 0.157477 Oct 23 02:27:10.644989 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4020/7948] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:27:10 2022] GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:27:11.667813 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e09bccdc-9670-4fad-af93-63cbd1a3c98d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:27:11.668439 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e09bccdc-9670-4fad-af93-63cbd1a3c98d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 4a59b989-d997-482f-8e2a-31ecfb741bfa] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:27:11.675223 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e09bccdc-9670-4fad-af93-63cbd1a3c98d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:11.680765 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e09bccdc-9670-4fad-af93-63cbd1a3c98d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:11.680765 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e09bccdc-9670-4fad-af93-63cbd1a3c98d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:11.680765 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e09bccdc-9670-4fad-af93-63cbd1a3c98d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:11.680765 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e09bccdc-9670-4fad-af93-63cbd1a3c98d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:11.680765 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e09bccdc-9670-4fad-af93-63cbd1a3c98d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:11.809934 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e09bccdc-9670-4fad-af93-63cbd1a3c98d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:27:11.821121 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e09bccdc-9670-4fad-af93-63cbd1a3c98d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa" status: 200 len: 1553 microversion: 2.1 time: 0.157109 Oct 23 02:27:11.838780 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3929/7949] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:27:11 2022] GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa => generated 1553 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:27:11.928333 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-9e0e6774-477e-4260-ae38-6b66323e46b5 req-b0de44c7-e3ea-45f7-a155-0c29fce350ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a59b989-d997-482f-8e2a-31ecfb741bfa", "name": "network-vif-deleted", "tag": "50f87014-907e-4d58-9c41-04afcf7c9751"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:27:11.938248 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-9e0e6774-477e-4260-ae38-6b66323e46b5 req-b0de44c7-e3ea-45f7-a155-0c29fce350ba service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:11.939258 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-9e0e6774-477e-4260-ae38-6b66323e46b5 req-b0de44c7-e3ea-45f7-a155-0c29fce350ba service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:11.939696 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-9e0e6774-477e-4260-ae38-6b66323e46b5 req-b0de44c7-e3ea-45f7-a155-0c29fce350ba service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:11.951134 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-9e0e6774-477e-4260-ae38-6b66323e46b5 req-b0de44c7-e3ea-45f7-a155-0c29fce350ba service nova] Creating event network-vif-deleted:50f87014-907e-4d58-9c41-04afcf7c9751 for instance 4a59b989-d997-482f-8e2a-31ecfb741bfa on n-h1-master-1 Oct 23 02:27:11.956664 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-9e0e6774-477e-4260-ae38-6b66323e46b5 req-b0de44c7-e3ea-45f7-a155-0c29fce350ba service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082113 Oct 23 02:27:11.957400 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4021/7950] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:27:12.849146 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1a7c20b1-10e3-468a-af27-24d97f2d4ade tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:27:12.849762 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1a7c20b1-10e3-468a-af27-24d97f2d4ade tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 4a59b989-d997-482f-8e2a-31ecfb741bfa] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:27:12.856754 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1a7c20b1-10e3-468a-af27-24d97f2d4ade tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:12.863620 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1a7c20b1-10e3-468a-af27-24d97f2d4ade tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:12.863620 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1a7c20b1-10e3-468a-af27-24d97f2d4ade tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:12.863620 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1a7c20b1-10e3-468a-af27-24d97f2d4ade tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:12.863620 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1a7c20b1-10e3-468a-af27-24d97f2d4ade tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:12.863620 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1a7c20b1-10e3-468a-af27-24d97f2d4ade tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:12.892558 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1a7c20b1-10e3-468a-af27-24d97f2d4ade tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:12.893063 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1a7c20b1-10e3-468a-af27-24d97f2d4ade tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:12.893516 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1a7c20b1-10e3-468a-af27-24d97f2d4ade tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:12.894016 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-1a7c20b1-10e3-468a-af27-24d97f2d4ade tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lazy-loading 'fault' on Instance uuid 4a59b989-d997-482f-8e2a-31ecfb741bfa {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:27:12.935747 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1a7c20b1-10e3-468a-af27-24d97f2d4ade tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e7b72a173401fa175378ab373c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9a5526b8c7450a9227d266ecf33487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:27:12.943661 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1a7c20b1-10e3-468a-af27-24d97f2d4ade tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa" status: 200 len: 1346 microversion: 2.1 time: 0.100059 Oct 23 02:27:12.944244 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3930/7951] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:27:12 2022] GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa => generated 1346 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:27:13.969251 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f424a6f3-1d01-44ef-a911-6349c508c42d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:27:13.970523 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f424a6f3-1d01-44ef-a911-6349c508c42d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] [instance: 4a59b989-d997-482f-8e2a-31ecfb741bfa] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:27:13.976987 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f424a6f3-1d01-44ef-a911-6349c508c42d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:13.977483 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f424a6f3-1d01-44ef-a911-6349c508c42d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:13.977918 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f424a6f3-1d01-44ef-a911-6349c508c42d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:13.978626 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f424a6f3-1d01-44ef-a911-6349c508c42d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:13.979080 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f424a6f3-1d01-44ef-a911-6349c508c42d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:13.979505 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f424a6f3-1d01-44ef-a911-6349c508c42d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:13.992682 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-f424a6f3-1d01-44ef-a911-6349c508c42d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] HTTP exception thrown: Instance 4a59b989-d997-482f-8e2a-31ecfb741bfa could not be found. Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f424a6f3-1d01-44ef-a911-6349c508c42d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Request method failure captured: Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa HTTP/1.1 Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVKUDTZufmk4wu970ZmX8B-nKlt6mM8gQ3xp4w7hwDWWQIPA4NqfGbnNYL3V9MKJeGQE2CfSCIuc3EQVZb53DtLuwOyZjyFhmSsYS1b3kuznGvxlgXeF049KYq1sHII3Vvfq7GjNesFnPyZG7mmryukaT9RejbPijIN-cJU79ErDxCOg Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: dd9a5526b8c7450a9227d266ecf33487 Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-TestMinimumBasicScenario-998385418 Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dd9a5526b8c7450a9227d266ecf33487"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dd9a5526b8c7450a9227d266ecf33487"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dd9a5526b8c7450a9227d266ecf33487"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dd9a5526b8c7450a9227d266ecf33487"}]}] Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-TestMinimumBasicScenario-998385418 Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: dd9a5526b8c7450a9227d266ecf33487 Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-TestMinimumBasicScenario-998385418 Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-TestMinimumBasicScenario-998385418-project Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 722e7b72a173401fa175378ab373c26e Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-TestMinimumBasicScenario-998385418-project Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 4a59b989-d997-482f-8e2a-31ecfb741bfa could not be found. Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '4a59b989-d997-482f-8e2a-31ecfb741bfa'} Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a59b989-d997-482f-8e2a-31ecfb741bfa could not be found. Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a59b989-d997-482f-8e2a-31ecfb741bfa could not be found. Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:27:13.994332 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:27:13.999704 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:27:13.999704 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:27:13.999704 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:27:13.999704 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:27:13.999704 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:27:13.999704 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a59b989-d997-482f-8e2a-31ecfb741bfa could not be found. Oct 23 02:27:13.999704 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:27:13.999704 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f424a6f3-1d01-44ef-a911-6349c508c42d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Returning 404 to user: Instance 4a59b989-d997-482f-8e2a-31ecfb741bfa could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:27:13.999704 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f424a6f3-1d01-44ef-a911-6349c508c42d tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa" status: 404 len: 111 microversion: 2.1 time: 0.031914 Oct 23 02:27:13.999704 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4022/7952] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:27:13 2022] GET /compute/v2.1/servers/4a59b989-d997-482f-8e2a-31ecfb741bfa => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:27:14.004899 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-dfc41b01-b3ec-4c4f-aa43-66999c5c1b1b tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] Calling method '.version_select at 0x7f5cc0d8c040>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:27:14.083578 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-dfc41b01-b3ec-4c4f-aa43-66999c5c1b1b tempest-TestMinimumBasicScenario-998385418 tempest-TestMinimumBasicScenario-998385418-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-242843128" status: 202 len: 0 microversion: 2.1 time: 0.082464 Oct 23 02:27:14.084174 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3931/7953] 10.222.0.42 () {58 vars in 1269 bytes} [Sun Oct 23 02:27:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-242843128 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 23 02:27:25.648168 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:27:25.648922 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:27:25.803100 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-df7205cc-ebed-44c2-b180-c6e2c9606f19 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Action: 'create', calling method: .version_select at 0x7f5cc0fc6d30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2043813706", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMn9HR2vt1d9/m+Hma34Zc7kerh+ELe9+6dSmoFb71qtiOJdKaPk+0dG4SHaPxOwDweYemFQY4baw8kZK42JnUYJBQ8JXoCnEEHs7x8gyZpm/uJ+JD7xUpkGUUjdn8kclg=="}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:27:25.818624 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-df7205cc-ebed-44c2-b180-c6e2c9606f19 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Getting quotas for project 028ee2f0bfd246d0a4abebdcbea26588. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:27:25.823719 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-df7205cc-ebed-44c2-b180-c6e2c9606f19 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Getting quotas for user e44ce41e0ba0434a91710af395b8af29 and project 028ee2f0bfd246d0a4abebdcbea26588. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:27:25.945638 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-df7205cc-ebed-44c2-b180-c6e2c9606f19 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.302786 Oct 23 02:27:25.946292 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4023/7954] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 02:27:25 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:27:34.119327 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f246695e-be28-4870-9677-1a61c87427e7 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1213636485", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "c2dca8ea-1e31-41c9-bf6d-81cdacd20f6c"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2043813706", "security_groups": [{"name": "tempest-secgroup-smoke-673712981"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:27:34.132698 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:27:34.133563 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:27:34.259295 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-f246695e-be28-4870-9677-1a61c87427e7 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] validate_networks() for [('c2dca8ea-1e31-41c9-bf6d-81cdacd20f6c', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 02:27:34.675370 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-f246695e-be28-4870-9677-1a61c87427e7 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:27:34.676417 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-f246695e-be28-4870-9677-1a61c87427e7 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:27:34.677194 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-f246695e-be28-4870-9677-1a61c87427e7 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:27:34.677939 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-f246695e-be28-4870-9677-1a61c87427e7 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:27:34.678706 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-f246695e-be28-4870-9677-1a61c87427e7 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:27:34.691154 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f246695e-be28-4870-9677-1a61c87427e7 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:34.692018 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f246695e-be28-4870-9677-1a61c87427e7 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:34.692655 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f246695e-be28-4870-9677-1a61c87427e7 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:34.697441 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f246695e-be28-4870-9677-1a61c87427e7 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:34.698255 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f246695e-be28-4870-9677-1a61c87427e7 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:34.699315 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f246695e-be28-4870-9677-1a61c87427e7 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:34.743369 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-f246695e-be28-4870-9677-1a61c87427e7 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Getting quotas for project 028ee2f0bfd246d0a4abebdcbea26588. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:27:34.747762 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-f246695e-be28-4870-9677-1a61c87427e7 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Getting quotas for user e44ce41e0ba0434a91710af395b8af29 and project 028ee2f0bfd246d0a4abebdcbea26588. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:27:34.762087 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f246695e-be28-4870-9677-1a61c87427e7 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 02:27:34.764614 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f246695e-be28-4870-9677-1a61c87427e7 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 10ab0f57-8580-4c7c-921b-94f761df73aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 02:27:34.908246 n-d-master-1 devstack@n-api.service[120945]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f246695e-be28-4870-9677-1a61c87427e7 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [df191590-1730-413b-9f4b-8ebce3a1730d] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 23 02:27:35.915835 n-d-master-1 devstack@n-api.service[120945]: INFO oslo.messaging._drivers.impl_rabbit [None req-f246695e-be28-4870-9677-1a61c87427e7 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [df191590-1730-413b-9f4b-8ebce3a1730d] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 38726. Oct 23 02:27:35.920342 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f246695e-be28-4870-9677-1a61c87427e7 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.805634 Oct 23 02:27:35.928021 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3932/7955] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 02:27:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 1807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 02:27:35.931423 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=4 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:27:35.932565 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:27:35.936747 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b167e11f-f11d-431c-a5db-2cd16b68555d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:27:35.937879 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b167e11f-f11d-431c-a5db-2cd16b68555d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 10ab0f57-8580-4c7c-921b-94f761df73aa] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:27:36.011400 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b167e11f-f11d-431c-a5db-2cd16b68555d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:27:36.019455 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b167e11f-f11d-431c-a5db-2cd16b68555d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa" status: 200 len: 1267 microversion: 2.1 time: 0.089766 Oct 23 02:27:36.020137 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4024/7956] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:27:35 2022] GET /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa => generated 1267 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:27:37.044167 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e7a2e24d-cc31-4d51-9a5d-9d2ea666a5f1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:27:37.044834 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e7a2e24d-cc31-4d51-9a5d-9d2ea666a5f1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 10ab0f57-8580-4c7c-921b-94f761df73aa] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:27:37.099846 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e7a2e24d-cc31-4d51-9a5d-9d2ea666a5f1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:27:37.107090 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e7a2e24d-cc31-4d51-9a5d-9d2ea666a5f1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa" status: 200 len: 1267 microversion: 2.1 time: 0.067819 Oct 23 02:27:37.107698 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3933/7957] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:27:37 2022] GET /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa => generated 1267 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:27:38.131163 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1ed2d53b-1954-44ad-a7dc-8014d6cd04c9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:27:38.131714 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1ed2d53b-1954-44ad-a7dc-8014d6cd04c9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 10ab0f57-8580-4c7c-921b-94f761df73aa] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:27:38.139689 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1ed2d53b-1954-44ad-a7dc-8014d6cd04c9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:38.140335 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1ed2d53b-1954-44ad-a7dc-8014d6cd04c9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:38.140665 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1ed2d53b-1954-44ad-a7dc-8014d6cd04c9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:38.141353 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1ed2d53b-1954-44ad-a7dc-8014d6cd04c9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:38.142603 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1ed2d53b-1954-44ad-a7dc-8014d6cd04c9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:38.143444 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1ed2d53b-1954-44ad-a7dc-8014d6cd04c9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:38.205011 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1ed2d53b-1954-44ad-a7dc-8014d6cd04c9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:27:38.212706 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1ed2d53b-1954-44ad-a7dc-8014d6cd04c9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa" status: 200 len: 1319 microversion: 2.1 time: 0.085660 Oct 23 02:27:38.213284 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4025/7958] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:27:38 2022] GET /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa => generated 1319 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:27:39.236622 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8a7da579-0aaf-4e1a-bf8c-c8cf9ce84ec0 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:27:39.237273 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8a7da579-0aaf-4e1a-bf8c-c8cf9ce84ec0 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 10ab0f57-8580-4c7c-921b-94f761df73aa] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:27:39.246116 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a7da579-0aaf-4e1a-bf8c-c8cf9ce84ec0 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:39.246908 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a7da579-0aaf-4e1a-bf8c-c8cf9ce84ec0 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:39.247370 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a7da579-0aaf-4e1a-bf8c-c8cf9ce84ec0 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:39.248106 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a7da579-0aaf-4e1a-bf8c-c8cf9ce84ec0 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:39.248583 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a7da579-0aaf-4e1a-bf8c-c8cf9ce84ec0 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:39.249032 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a7da579-0aaf-4e1a-bf8c-c8cf9ce84ec0 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:39.391293 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8a7da579-0aaf-4e1a-bf8c-c8cf9ce84ec0 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:27:39.399868 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8a7da579-0aaf-4e1a-bf8c-c8cf9ce84ec0 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa" status: 200 len: 1392 microversion: 2.1 time: 0.167214 Oct 23 02:27:39.400451 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3934/7959] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:27:39 2022] GET /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:27:40.103469 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-eac4a5a7-9345-4aa7-b19a-046969760279 req-49750da2-99d8-4e96-9db5-8d381e8cba4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10ab0f57-8580-4c7c-921b-94f761df73aa", "tag": "1b4797a4-4ea6-4569-91e7-2563da8aba4f"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:27:40.114548 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-eac4a5a7-9345-4aa7-b19a-046969760279 req-49750da2-99d8-4e96-9db5-8d381e8cba4e service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:40.115132 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-eac4a5a7-9345-4aa7-b19a-046969760279 req-49750da2-99d8-4e96-9db5-8d381e8cba4e service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:40.115565 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-eac4a5a7-9345-4aa7-b19a-046969760279 req-49750da2-99d8-4e96-9db5-8d381e8cba4e service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:40.128051 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-eac4a5a7-9345-4aa7-b19a-046969760279 req-49750da2-99d8-4e96-9db5-8d381e8cba4e service nova] Creating event network-changed:1b4797a4-4ea6-4569-91e7-2563da8aba4f for instance 10ab0f57-8580-4c7c-921b-94f761df73aa on n-h2-master-1 Oct 23 02:27:40.132798 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-eac4a5a7-9345-4aa7-b19a-046969760279 req-49750da2-99d8-4e96-9db5-8d381e8cba4e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033545 Oct 23 02:27:40.133407 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4026/7960] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:27:40.425634 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-83d28bc9-1b87-49c1-a01e-f4900295eb47 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:27:40.426320 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-83d28bc9-1b87-49c1-a01e-f4900295eb47 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 10ab0f57-8580-4c7c-921b-94f761df73aa] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:27:40.433485 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83d28bc9-1b87-49c1-a01e-f4900295eb47 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:40.438938 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83d28bc9-1b87-49c1-a01e-f4900295eb47 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:40.438938 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83d28bc9-1b87-49c1-a01e-f4900295eb47 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:40.438938 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83d28bc9-1b87-49c1-a01e-f4900295eb47 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:40.438938 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83d28bc9-1b87-49c1-a01e-f4900295eb47 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:40.438938 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-83d28bc9-1b87-49c1-a01e-f4900295eb47 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:40.571058 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-83d28bc9-1b87-49c1-a01e-f4900295eb47 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:27:40.579156 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-83d28bc9-1b87-49c1-a01e-f4900295eb47 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa" status: 200 len: 1392 microversion: 2.1 time: 0.158148 Oct 23 02:27:40.579739 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3935/7961] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:27:40 2022] GET /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:27:41.603682 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f7eab29a-9c03-4ef2-afa7-aa42c3f2c69c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:27:41.604397 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f7eab29a-9c03-4ef2-afa7-aa42c3f2c69c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 10ab0f57-8580-4c7c-921b-94f761df73aa] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:27:41.611296 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f7eab29a-9c03-4ef2-afa7-aa42c3f2c69c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:41.611788 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f7eab29a-9c03-4ef2-afa7-aa42c3f2c69c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:41.612229 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f7eab29a-9c03-4ef2-afa7-aa42c3f2c69c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:41.612923 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f7eab29a-9c03-4ef2-afa7-aa42c3f2c69c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:41.613393 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f7eab29a-9c03-4ef2-afa7-aa42c3f2c69c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:41.613823 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f7eab29a-9c03-4ef2-afa7-aa42c3f2c69c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:41.745269 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f7eab29a-9c03-4ef2-afa7-aa42c3f2c69c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:27:41.753641 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f7eab29a-9c03-4ef2-afa7-aa42c3f2c69c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa" status: 200 len: 1392 microversion: 2.1 time: 0.155462 Oct 23 02:27:41.754252 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4027/7962] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:27:41 2022] GET /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:27:42.776673 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-00294168-651d-4dc9-b330-21b19145bf5f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:27:42.777257 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-00294168-651d-4dc9-b330-21b19145bf5f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 10ab0f57-8580-4c7c-921b-94f761df73aa] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:27:42.784042 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-00294168-651d-4dc9-b330-21b19145bf5f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:42.784544 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-00294168-651d-4dc9-b330-21b19145bf5f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:42.784997 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-00294168-651d-4dc9-b330-21b19145bf5f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:42.785700 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-00294168-651d-4dc9-b330-21b19145bf5f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:42.786210 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-00294168-651d-4dc9-b330-21b19145bf5f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:42.792617 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-00294168-651d-4dc9-b330-21b19145bf5f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:42.923859 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-00294168-651d-4dc9-b330-21b19145bf5f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:27:42.931621 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-00294168-651d-4dc9-b330-21b19145bf5f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa" status: 200 len: 1392 microversion: 2.1 time: 0.159012 Oct 23 02:27:42.932198 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3936/7963] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:27:42 2022] GET /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:27:43.955269 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7b34aa18-a96e-42e7-8e83-530374d70701 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:27:43.955834 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7b34aa18-a96e-42e7-8e83-530374d70701 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 10ab0f57-8580-4c7c-921b-94f761df73aa] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:27:43.962773 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b34aa18-a96e-42e7-8e83-530374d70701 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:43.963294 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b34aa18-a96e-42e7-8e83-530374d70701 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:43.963746 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b34aa18-a96e-42e7-8e83-530374d70701 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:43.964446 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b34aa18-a96e-42e7-8e83-530374d70701 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:43.964914 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b34aa18-a96e-42e7-8e83-530374d70701 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:43.965352 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b34aa18-a96e-42e7-8e83-530374d70701 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:44.093751 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7b34aa18-a96e-42e7-8e83-530374d70701 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:27:44.101869 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7b34aa18-a96e-42e7-8e83-530374d70701 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa" status: 200 len: 1392 microversion: 2.1 time: 0.150931 Oct 23 02:27:44.106807 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4028/7964] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:27:43 2022] GET /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa => generated 1392 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:27:44.786607 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-1506d66f-72cf-449b-b1d7-8e7516f4f37b req-b5afd19f-35ea-4033-8685-775fd53aba30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10ab0f57-8580-4c7c-921b-94f761df73aa", "name": "network-vif-plugged", "status": "completed", "tag": "1b4797a4-4ea6-4569-91e7-2563da8aba4f"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:27:44.792390 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:27:44.798511 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-1506d66f-72cf-449b-b1d7-8e7516f4f37b req-b5afd19f-35ea-4033-8685-775fd53aba30 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:44.799000 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-1506d66f-72cf-449b-b1d7-8e7516f4f37b req-b5afd19f-35ea-4033-8685-775fd53aba30 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:44.799488 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-1506d66f-72cf-449b-b1d7-8e7516f4f37b req-b5afd19f-35ea-4033-8685-775fd53aba30 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:44.810157 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-1506d66f-72cf-449b-b1d7-8e7516f4f37b req-b5afd19f-35ea-4033-8685-775fd53aba30 service nova] Creating event network-vif-plugged:1b4797a4-4ea6-4569-91e7-2563da8aba4f for instance 10ab0f57-8580-4c7c-921b-94f761df73aa on n-h2-master-1 Oct 23 02:27:44.815294 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-1506d66f-72cf-449b-b1d7-8e7516f4f37b req-b5afd19f-35ea-4033-8685-775fd53aba30 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032989 Oct 23 02:27:44.815920 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3937/7965] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:27:45.124775 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-11389406-42b3-4091-8563-e65e2b9513c3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:27:45.125409 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-11389406-42b3-4091-8563-e65e2b9513c3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 10ab0f57-8580-4c7c-921b-94f761df73aa] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:27:45.132402 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-11389406-42b3-4091-8563-e65e2b9513c3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:45.132893 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-11389406-42b3-4091-8563-e65e2b9513c3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:45.133341 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-11389406-42b3-4091-8563-e65e2b9513c3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:45.134061 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-11389406-42b3-4091-8563-e65e2b9513c3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:45.134532 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-11389406-42b3-4091-8563-e65e2b9513c3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:45.134964 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-11389406-42b3-4091-8563-e65e2b9513c3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:45.272990 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-11389406-42b3-4091-8563-e65e2b9513c3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:27:45.280930 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-11389406-42b3-4091-8563-e65e2b9513c3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa" status: 200 len: 1392 microversion: 2.1 time: 0.160148 Oct 23 02:27:45.281526 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4029/7966] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:27:45 2022] GET /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:27:46.306251 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3c0c39d6-4b79-499d-a520-2f020813010a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:27:46.307034 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3c0c39d6-4b79-499d-a520-2f020813010a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 10ab0f57-8580-4c7c-921b-94f761df73aa] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:27:46.313586 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c0c39d6-4b79-499d-a520-2f020813010a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:46.313998 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c0c39d6-4b79-499d-a520-2f020813010a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:46.317822 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c0c39d6-4b79-499d-a520-2f020813010a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:46.317822 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c0c39d6-4b79-499d-a520-2f020813010a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:46.317822 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c0c39d6-4b79-499d-a520-2f020813010a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:46.317822 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3c0c39d6-4b79-499d-a520-2f020813010a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:46.453257 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3c0c39d6-4b79-499d-a520-2f020813010a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:27:46.461192 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3c0c39d6-4b79-499d-a520-2f020813010a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa" status: 200 len: 1392 microversion: 2.1 time: 0.160617 Oct 23 02:27:46.468232 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3938/7967] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:27:46 2022] GET /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:27:47.484739 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e1bc3edb-20d2-4ace-88a5-5d1ffd818d9a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:27:47.485864 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e1bc3edb-20d2-4ace-88a5-5d1ffd818d9a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 10ab0f57-8580-4c7c-921b-94f761df73aa] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:27:47.487992 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:27:47.495561 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e1bc3edb-20d2-4ace-88a5-5d1ffd818d9a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:47.495561 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e1bc3edb-20d2-4ace-88a5-5d1ffd818d9a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:47.495561 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e1bc3edb-20d2-4ace-88a5-5d1ffd818d9a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:47.495561 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e1bc3edb-20d2-4ace-88a5-5d1ffd818d9a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:47.496521 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e1bc3edb-20d2-4ace-88a5-5d1ffd818d9a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:47.496521 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e1bc3edb-20d2-4ace-88a5-5d1ffd818d9a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:47.627360 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e1bc3edb-20d2-4ace-88a5-5d1ffd818d9a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:27:47.635150 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e1bc3edb-20d2-4ace-88a5-5d1ffd818d9a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa" status: 200 len: 1564 microversion: 2.1 time: 0.154374 Oct 23 02:27:47.635733 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4030/7968] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:27:47 2022] GET /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:27:47.657261 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-393c66b6-0140-4d6d-882d-5ef8a7a6f129 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:27:47.657886 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-393c66b6-0140-4d6d-882d-5ef8a7a6f129 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 10ab0f57-8580-4c7c-921b-94f761df73aa] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:27:47.659878 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=8 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:27:47.665376 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-393c66b6-0140-4d6d-882d-5ef8a7a6f129 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:47.665873 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-393c66b6-0140-4d6d-882d-5ef8a7a6f129 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:47.666424 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-393c66b6-0140-4d6d-882d-5ef8a7a6f129 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:47.667188 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-393c66b6-0140-4d6d-882d-5ef8a7a6f129 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:47.667656 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-393c66b6-0140-4d6d-882d-5ef8a7a6f129 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:47.668090 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-393c66b6-0140-4d6d-882d-5ef8a7a6f129 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:47.804416 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-393c66b6-0140-4d6d-882d-5ef8a7a6f129 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:27:47.812199 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-393c66b6-0140-4d6d-882d-5ef8a7a6f129 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa" status: 200 len: 1564 microversion: 2.1 time: 0.158773 Oct 23 02:27:47.827360 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3939/7969] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:27:47 2022] GET /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa => generated 1564 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:27:50.180455 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dfe037d7-10b3-487c-8421-970a6d4b704f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:27:50.181081 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-dfe037d7-10b3-487c-8421-970a6d4b704f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 10ab0f57-8580-4c7c-921b-94f761df73aa] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:27:50.186258 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-d6b3bb48-4ee3-4d25-b983-40de850fbd40 req-2fde77f7-182d-4770-8ead-385dabd22d3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10ab0f57-8580-4c7c-921b-94f761df73aa", "tag": "1b4797a4-4ea6-4569-91e7-2563da8aba4f"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:27:50.188964 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dfe037d7-10b3-487c-8421-970a6d4b704f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:50.189556 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dfe037d7-10b3-487c-8421-970a6d4b704f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:50.190115 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dfe037d7-10b3-487c-8421-970a6d4b704f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:50.190891 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dfe037d7-10b3-487c-8421-970a6d4b704f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:50.191416 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dfe037d7-10b3-487c-8421-970a6d4b704f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:50.192087 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dfe037d7-10b3-487c-8421-970a6d4b704f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:50.197082 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-d6b3bb48-4ee3-4d25-b983-40de850fbd40 req-2fde77f7-182d-4770-8ead-385dabd22d3d service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:27:50.197577 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-d6b3bb48-4ee3-4d25-b983-40de850fbd40 req-2fde77f7-182d-4770-8ead-385dabd22d3d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:27:50.198241 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-d6b3bb48-4ee3-4d25-b983-40de850fbd40 req-2fde77f7-182d-4770-8ead-385dabd22d3d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:27:50.210162 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-d6b3bb48-4ee3-4d25-b983-40de850fbd40 req-2fde77f7-182d-4770-8ead-385dabd22d3d service nova] Creating event network-changed:1b4797a4-4ea6-4569-91e7-2563da8aba4f for instance 10ab0f57-8580-4c7c-921b-94f761df73aa on n-h2-master-1 Oct 23 02:27:50.215705 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-d6b3bb48-4ee3-4d25-b983-40de850fbd40 req-2fde77f7-182d-4770-8ead-385dabd22d3d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033061 Oct 23 02:27:50.216314 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3940/7970] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:27:50.332886 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-dfe037d7-10b3-487c-8421-970a6d4b704f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:27:50.340884 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-dfe037d7-10b3-487c-8421-970a6d4b704f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa" status: 200 len: 1564 microversion: 2.1 time: 0.164362 Oct 23 02:27:50.341722 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4031/7971] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:27:50 2022] GET /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa => generated 1564 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:28:13.601061 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:28:13.601827 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=36 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:28:13.606330 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-81a4c8f5-96d7-434f-9f79-4f640594bccb tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:28:13.608572 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-81a4c8f5-96d7-434f-9f79-4f640594bccb tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 10ab0f57-8580-4c7c-921b-94f761df73aa] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:28:13.615089 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-81a4c8f5-96d7-434f-9f79-4f640594bccb tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:13.617135 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-81a4c8f5-96d7-434f-9f79-4f640594bccb tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:13.617135 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-81a4c8f5-96d7-434f-9f79-4f640594bccb tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:13.617135 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-81a4c8f5-96d7-434f-9f79-4f640594bccb tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:13.617454 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-81a4c8f5-96d7-434f-9f79-4f640594bccb tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:13.617720 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-81a4c8f5-96d7-434f-9f79-4f640594bccb tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:13.702205 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-81a4c8f5-96d7-434f-9f79-4f640594bccb tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "POST /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa/action" status: 200 len: 24568 microversion: 2.1 time: 0.103387 Oct 23 02:28:13.702850 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3941/7972] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:28:13 2022] POST /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa/action => generated 24568 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 23 02:28:24.777869 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e26143f6-81d8-4b45-8855-88135b9f5e51 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:28:24.778489 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e26143f6-81d8-4b45-8855-88135b9f5e51 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 10ab0f57-8580-4c7c-921b-94f761df73aa] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:28:24.780447 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=18 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:28:24.781247 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=38 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:28:24.785907 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e26143f6-81d8-4b45-8855-88135b9f5e51 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:24.787050 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e26143f6-81d8-4b45-8855-88135b9f5e51 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:24.787495 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e26143f6-81d8-4b45-8855-88135b9f5e51 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:24.788212 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e26143f6-81d8-4b45-8855-88135b9f5e51 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:24.788693 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e26143f6-81d8-4b45-8855-88135b9f5e51 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:24.789121 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e26143f6-81d8-4b45-8855-88135b9f5e51 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:24.979436 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e26143f6-81d8-4b45-8855-88135b9f5e51 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "POST /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa/action" status: 202 len: 0 microversion: 2.1 time: 0.205696 Oct 23 02:28:24.980183 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4032/7973] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:28:24 2022] POST /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:28:24.989458 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-48d73573-753e-49e5-a1b6-54835eb743e2 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:28:24.990279 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-48d73573-753e-49e5-a1b6-54835eb743e2 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 10ab0f57-8580-4c7c-921b-94f761df73aa] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:28:24.993286 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=4 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:28:24.998805 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-48d73573-753e-49e5-a1b6-54835eb743e2 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:24.999284 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-48d73573-753e-49e5-a1b6-54835eb743e2 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:24.999738 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-48d73573-753e-49e5-a1b6-54835eb743e2 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:25.000450 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-48d73573-753e-49e5-a1b6-54835eb743e2 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:25.000930 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-48d73573-753e-49e5-a1b6-54835eb743e2 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:25.001372 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-48d73573-753e-49e5-a1b6-54835eb743e2 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:25.141592 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-48d73573-753e-49e5-a1b6-54835eb743e2 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:28:25.150090 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-48d73573-753e-49e5-a1b6-54835eb743e2 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa" status: 200 len: 1687 microversion: 2.1 time: 0.165335 Oct 23 02:28:25.150664 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3942/7974] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:28:24 2022] GET /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa => generated 1687 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:28:26.175381 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4950b95b-37dc-4287-b46c-cdc0b44c27b4 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:28:26.176118 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4950b95b-37dc-4287-b46c-cdc0b44c27b4 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 10ab0f57-8580-4c7c-921b-94f761df73aa] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:28:26.182971 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4950b95b-37dc-4287-b46c-cdc0b44c27b4 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:26.183460 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4950b95b-37dc-4287-b46c-cdc0b44c27b4 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:26.183894 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4950b95b-37dc-4287-b46c-cdc0b44c27b4 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:26.184583 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4950b95b-37dc-4287-b46c-cdc0b44c27b4 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:26.185034 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4950b95b-37dc-4287-b46c-cdc0b44c27b4 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:26.185461 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4950b95b-37dc-4287-b46c-cdc0b44c27b4 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:26.315532 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4950b95b-37dc-4287-b46c-cdc0b44c27b4 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:28:26.323479 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4950b95b-37dc-4287-b46c-cdc0b44c27b4 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa" status: 200 len: 1667 microversion: 2.1 time: 0.153511 Oct 23 02:28:26.324060 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4033/7975] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:28:26 2022] GET /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa => generated 1667 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:28:27.417431 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8c880317-5fba-42eb-9ea2-90a44feff7dd tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:28:27.419664 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8c880317-5fba-42eb-9ea2-90a44feff7dd tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 10ab0f57-8580-4c7c-921b-94f761df73aa] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:28:27.427619 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8c880317-5fba-42eb-9ea2-90a44feff7dd tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:27.428117 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8c880317-5fba-42eb-9ea2-90a44feff7dd tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:27.428560 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8c880317-5fba-42eb-9ea2-90a44feff7dd tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:27.429256 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8c880317-5fba-42eb-9ea2-90a44feff7dd tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:27.429719 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8c880317-5fba-42eb-9ea2-90a44feff7dd tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:27.430182 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8c880317-5fba-42eb-9ea2-90a44feff7dd tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:27.514572 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8c880317-5fba-42eb-9ea2-90a44feff7dd tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "POST /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa/action" status: 200 len: 32641 microversion: 2.1 time: 0.100863 Oct 23 02:28:27.515506 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3943/7976] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:28:27 2022] POST /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa/action => generated 32641 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 02:28:27.526934 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1ef7829a-e247-488d-99cf-9e5943b505d8 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:28:27.527473 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1ef7829a-e247-488d-99cf-9e5943b505d8 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 10ab0f57-8580-4c7c-921b-94f761df73aa] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:28:27.534488 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1ef7829a-e247-488d-99cf-9e5943b505d8 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:27.534880 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1ef7829a-e247-488d-99cf-9e5943b505d8 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:27.535323 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1ef7829a-e247-488d-99cf-9e5943b505d8 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:27.536015 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1ef7829a-e247-488d-99cf-9e5943b505d8 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:27.536472 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1ef7829a-e247-488d-99cf-9e5943b505d8 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:27.536900 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1ef7829a-e247-488d-99cf-9e5943b505d8 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:27.770223 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1ef7829a-e247-488d-99cf-9e5943b505d8 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "POST /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa/action" status: 202 len: 0 microversion: 2.1 time: 0.246987 Oct 23 02:28:27.771015 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4034/7977] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:28:27 2022] POST /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:28:27.780032 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-831be396-0e31-4377-97a7-6587ccd2e511 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:28:27.780893 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-831be396-0e31-4377-97a7-6587ccd2e511 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 10ab0f57-8580-4c7c-921b-94f761df73aa] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:28:27.788276 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-831be396-0e31-4377-97a7-6587ccd2e511 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:27.788781 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-831be396-0e31-4377-97a7-6587ccd2e511 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:27.789236 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-831be396-0e31-4377-97a7-6587ccd2e511 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:27.789949 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-831be396-0e31-4377-97a7-6587ccd2e511 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:27.790498 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-831be396-0e31-4377-97a7-6587ccd2e511 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:27.790989 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-831be396-0e31-4377-97a7-6587ccd2e511 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:27.931282 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-831be396-0e31-4377-97a7-6587ccd2e511 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:28:27.939268 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-831be396-0e31-4377-97a7-6587ccd2e511 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa" status: 200 len: 1674 microversion: 2.1 time: 0.163723 Oct 23 02:28:27.939843 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3944/7978] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:28:27 2022] GET /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:28:28.964999 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-aaed37bd-01af-467a-a426-004550cd1254 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:28:28.965619 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-aaed37bd-01af-467a-a426-004550cd1254 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 10ab0f57-8580-4c7c-921b-94f761df73aa] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:28:28.971834 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aaed37bd-01af-467a-a426-004550cd1254 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:28.972320 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aaed37bd-01af-467a-a426-004550cd1254 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:28.972759 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aaed37bd-01af-467a-a426-004550cd1254 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:28.973444 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aaed37bd-01af-467a-a426-004550cd1254 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:28.973898 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aaed37bd-01af-467a-a426-004550cd1254 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:28.974352 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aaed37bd-01af-467a-a426-004550cd1254 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:29.107568 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-aaed37bd-01af-467a-a426-004550cd1254 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:28:29.115832 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-aaed37bd-01af-467a-a426-004550cd1254 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa" status: 200 len: 1682 microversion: 2.1 time: 0.156080 Oct 23 02:28:29.116395 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4035/7979] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:28:28 2022] GET /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:28:29.213360 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-dc860a31-cd3d-439d-b21d-bc01512a4250 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:28:29.215719 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-dc860a31-cd3d-439d-b21d-bc01512a4250 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 10ab0f57-8580-4c7c-921b-94f761df73aa] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:28:29.226165 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dc860a31-cd3d-439d-b21d-bc01512a4250 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:29.226689 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dc860a31-cd3d-439d-b21d-bc01512a4250 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:29.227156 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dc860a31-cd3d-439d-b21d-bc01512a4250 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:29.228117 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dc860a31-cd3d-439d-b21d-bc01512a4250 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:29.228586 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dc860a31-cd3d-439d-b21d-bc01512a4250 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:29.229023 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-dc860a31-cd3d-439d-b21d-bc01512a4250 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:29.292860 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-dc860a31-cd3d-439d-b21d-bc01512a4250 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "POST /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa/action" status: 200 len: 38400 microversion: 2.1 time: 0.083295 Oct 23 02:28:29.293547 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3945/7980] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:28:29 2022] POST /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa/action => generated 38400 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 02:28:30.369026 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-aaac4f2b-58d1-485b-a26b-5cb9609549a5 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:28:30.369619 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-aaac4f2b-58d1-485b-a26b-5cb9609549a5 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 10ab0f57-8580-4c7c-921b-94f761df73aa] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:28:30.375082 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-8fb25695-848c-43fd-9ae7-830e6bed56fa req-820184a7-a16d-458c-b44c-9c0424259617 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10ab0f57-8580-4c7c-921b-94f761df73aa", "tag": "1b4797a4-4ea6-4569-91e7-2563da8aba4f"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:28:30.377029 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aaac4f2b-58d1-485b-a26b-5cb9609549a5 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:30.377602 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aaac4f2b-58d1-485b-a26b-5cb9609549a5 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:30.378217 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aaac4f2b-58d1-485b-a26b-5cb9609549a5 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:30.379028 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aaac4f2b-58d1-485b-a26b-5cb9609549a5 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:30.379569 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aaac4f2b-58d1-485b-a26b-5cb9609549a5 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:30.380749 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-aaac4f2b-58d1-485b-a26b-5cb9609549a5 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:30.386936 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-8fb25695-848c-43fd-9ae7-830e6bed56fa req-820184a7-a16d-458c-b44c-9c0424259617 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:30.387516 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-8fb25695-848c-43fd-9ae7-830e6bed56fa req-820184a7-a16d-458c-b44c-9c0424259617 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:30.388035 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-8fb25695-848c-43fd-9ae7-830e6bed56fa req-820184a7-a16d-458c-b44c-9c0424259617 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:30.400437 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-8fb25695-848c-43fd-9ae7-830e6bed56fa req-820184a7-a16d-458c-b44c-9c0424259617 service nova] Creating event network-changed:1b4797a4-4ea6-4569-91e7-2563da8aba4f for instance 10ab0f57-8580-4c7c-921b-94f761df73aa on n-h2-master-1 Oct 23 02:28:30.407682 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-8fb25695-848c-43fd-9ae7-830e6bed56fa req-820184a7-a16d-458c-b44c-9c0424259617 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036506 Oct 23 02:28:30.408547 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3946/7981] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:28:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:28:30.408970 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-aaac4f2b-58d1-485b-a26b-5cb9609549a5 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 10ab0f57-8580-4c7c-921b-94f761df73aa] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 02:28:30.752888 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-aaac4f2b-58d1-485b-a26b-5cb9609549a5 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "DELETE /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa" status: 204 len: 0 microversion: 2.1 time: 0.387552 Oct 23 02:28:30.753497 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4036/7982] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 02:28:30 2022] DELETE /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 02:28:30.763152 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5c690158-d138-43aa-9b5a-1eb0da5d3910 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:28:30.764314 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5c690158-d138-43aa-9b5a-1eb0da5d3910 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 10ab0f57-8580-4c7c-921b-94f761df73aa] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:28:30.774857 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5c690158-d138-43aa-9b5a-1eb0da5d3910 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:30.775788 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5c690158-d138-43aa-9b5a-1eb0da5d3910 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:30.776781 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5c690158-d138-43aa-9b5a-1eb0da5d3910 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:30.777808 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5c690158-d138-43aa-9b5a-1eb0da5d3910 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:30.778583 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5c690158-d138-43aa-9b5a-1eb0da5d3910 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:30.779249 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5c690158-d138-43aa-9b5a-1eb0da5d3910 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:30.918807 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5c690158-d138-43aa-9b5a-1eb0da5d3910 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:28:30.926713 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5c690158-d138-43aa-9b5a-1eb0da5d3910 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa" status: 200 len: 1688 microversion: 2.1 time: 0.168527 Oct 23 02:28:30.927301 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3947/7983] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:28:30 2022] GET /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa => generated 1688 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:28:31.952514 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6978844d-2bb1-4214-9e3c-d943502e60d9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:28:31.953345 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6978844d-2bb1-4214-9e3c-d943502e60d9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 10ab0f57-8580-4c7c-921b-94f761df73aa] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:28:31.960365 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6978844d-2bb1-4214-9e3c-d943502e60d9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:31.963335 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6978844d-2bb1-4214-9e3c-d943502e60d9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:31.963335 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6978844d-2bb1-4214-9e3c-d943502e60d9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:31.963335 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6978844d-2bb1-4214-9e3c-d943502e60d9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:31.963335 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6978844d-2bb1-4214-9e3c-d943502e60d9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:31.963335 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6978844d-2bb1-4214-9e3c-d943502e60d9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:32.095779 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6978844d-2bb1-4214-9e3c-d943502e60d9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:28:32.104439 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6978844d-2bb1-4214-9e3c-d943502e60d9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa" status: 200 len: 1688 microversion: 2.1 time: 0.156247 Oct 23 02:28:32.105014 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4037/7984] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:28:31 2022] GET /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:28:33.129091 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ae7b3093-ec91-43b6-a474-163b048e97df tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:28:33.129664 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ae7b3093-ec91-43b6-a474-163b048e97df tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 10ab0f57-8580-4c7c-921b-94f761df73aa] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:28:33.136885 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ae7b3093-ec91-43b6-a474-163b048e97df tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:33.140038 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ae7b3093-ec91-43b6-a474-163b048e97df tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:33.140038 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ae7b3093-ec91-43b6-a474-163b048e97df tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:33.140038 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ae7b3093-ec91-43b6-a474-163b048e97df tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:33.140038 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ae7b3093-ec91-43b6-a474-163b048e97df tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:33.140038 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ae7b3093-ec91-43b6-a474-163b048e97df tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:33.202525 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ae7b3093-ec91-43b6-a474-163b048e97df tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:28:33.211033 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ae7b3093-ec91-43b6-a474-163b048e97df tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa" status: 200 len: 1503 microversion: 2.1 time: 0.086063 Oct 23 02:28:33.211688 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3948/7985] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:28:33 2022] GET /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa => generated 1503 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:28:33.261590 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-9b6cc09a-b2e1-43ba-8a83-ecdcbc501430 req-fa79b87d-7d5e-4c81-84b0-a06922a1276b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10ab0f57-8580-4c7c-921b-94f761df73aa", "name": "network-vif-deleted", "tag": "1b4797a4-4ea6-4569-91e7-2563da8aba4f"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:28:33.272098 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-9b6cc09a-b2e1-43ba-8a83-ecdcbc501430 req-fa79b87d-7d5e-4c81-84b0-a06922a1276b service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:33.272613 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-9b6cc09a-b2e1-43ba-8a83-ecdcbc501430 req-fa79b87d-7d5e-4c81-84b0-a06922a1276b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:33.273039 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-9b6cc09a-b2e1-43ba-8a83-ecdcbc501430 req-fa79b87d-7d5e-4c81-84b0-a06922a1276b service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:33.284163 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-9b6cc09a-b2e1-43ba-8a83-ecdcbc501430 req-fa79b87d-7d5e-4c81-84b0-a06922a1276b service nova] Creating event network-vif-deleted:1b4797a4-4ea6-4569-91e7-2563da8aba4f for instance 10ab0f57-8580-4c7c-921b-94f761df73aa on n-h2-master-1 Oct 23 02:28:33.289103 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-9b6cc09a-b2e1-43ba-8a83-ecdcbc501430 req-fa79b87d-7d5e-4c81-84b0-a06922a1276b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031271 Oct 23 02:28:33.289696 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4038/7986] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:28:34.236160 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a17d711e-a32d-4741-a4a9-63a4965282ec tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:28:34.236790 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a17d711e-a32d-4741-a4a9-63a4965282ec tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 10ab0f57-8580-4c7c-921b-94f761df73aa] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:28:34.244025 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a17d711e-a32d-4741-a4a9-63a4965282ec tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:34.244557 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a17d711e-a32d-4741-a4a9-63a4965282ec tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:34.245008 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a17d711e-a32d-4741-a4a9-63a4965282ec tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:34.245704 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a17d711e-a32d-4741-a4a9-63a4965282ec tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:34.246206 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a17d711e-a32d-4741-a4a9-63a4965282ec tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:34.246641 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a17d711e-a32d-4741-a4a9-63a4965282ec tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:34.278460 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a17d711e-a32d-4741-a4a9-63a4965282ec tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:34.278986 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a17d711e-a32d-4741-a4a9-63a4965282ec tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:34.279428 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a17d711e-a32d-4741-a4a9-63a4965282ec tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:34.279919 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-a17d711e-a32d-4741-a4a9-63a4965282ec tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lazy-loading 'fault' on Instance uuid 10ab0f57-8580-4c7c-921b-94f761df73aa {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:28:34.320371 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a17d711e-a32d-4741-a4a9-63a4965282ec tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:28:34.328194 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a17d711e-a32d-4741-a4a9-63a4965282ec tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa" status: 200 len: 1357 microversion: 2.1 time: 0.096534 Oct 23 02:28:34.328768 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3949/7987] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:28:34 2022] GET /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa => generated 1357 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:28:35.354008 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-264dcf4a-e47d-4948-ba90-b880adeb18ac tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:28:35.354755 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-264dcf4a-e47d-4948-ba90-b880adeb18ac tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 10ab0f57-8580-4c7c-921b-94f761df73aa] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:28:35.360978 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-264dcf4a-e47d-4948-ba90-b880adeb18ac tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:35.361465 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-264dcf4a-e47d-4948-ba90-b880adeb18ac tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:35.361915 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-264dcf4a-e47d-4948-ba90-b880adeb18ac tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:35.362632 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-264dcf4a-e47d-4948-ba90-b880adeb18ac tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:35.363097 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-264dcf4a-e47d-4948-ba90-b880adeb18ac tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:35.363528 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-264dcf4a-e47d-4948-ba90-b880adeb18ac tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:35.376841 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-264dcf4a-e47d-4948-ba90-b880adeb18ac tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] HTTP exception thrown: Instance 10ab0f57-8580-4c7c-921b-94f761df73aa could not be found. Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-264dcf4a-e47d-4948-ba90-b880adeb18ac tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Request method failure captured: Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa HTTP/1.1 Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVKaMnNLl9X4D4-6gAQhVcBZVSSCcOxKFjsbsBxA4f4SIgFOSlWnBMD29f0rryuOIMdqOMvvoKKjQiSMc0ZA1OqQJGW_gUJVqrguR3WAgaWcxKTa_raeB5BxXxfu3Ak4NBM55mUf_VprS-3z9k4IWGvX4m2eUIZUD4Artyeb6HB3QnJs Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 028ee2f0bfd246d0a4abebdcbea26588 Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1311565393 Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/028ee2f0bfd246d0a4abebdcbea26588"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_028ee2f0bfd246d0a4abebdcbea26588"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/028ee2f0bfd246d0a4abebdcbea26588"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/028ee2f0bfd246d0a4abebdcbea26588"}]}] Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1311565393 Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 028ee2f0bfd246d0a4abebdcbea26588 Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1311565393 Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-TestNetworkAdvancedServerOps-1311565393-project Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: e44ce41e0ba0434a91710af395b8af29 Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1311565393-project Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 10ab0f57-8580-4c7c-921b-94f761df73aa could not be found. Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '10ab0f57-8580-4c7c-921b-94f761df73aa'} Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10ab0f57-8580-4c7c-921b-94f761df73aa could not be found. Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10ab0f57-8580-4c7c-921b-94f761df73aa could not be found. Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:28:35.378506 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:28:35.384478 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:28:35.384478 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:28:35.384478 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:28:35.384478 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:28:35.384478 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:28:35.384478 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:28:35.384478 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10ab0f57-8580-4c7c-921b-94f761df73aa could not be found. Oct 23 02:28:35.384478 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:28:35.384478 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-264dcf4a-e47d-4948-ba90-b880adeb18ac tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Returning 404 to user: Instance 10ab0f57-8580-4c7c-921b-94f761df73aa could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:28:35.384478 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-264dcf4a-e47d-4948-ba90-b880adeb18ac tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa" status: 404 len: 111 microversion: 2.1 time: 0.032080 Oct 23 02:28:35.384478 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4039/7988] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:28:35 2022] GET /compute/v2.1/servers/10ab0f57-8580-4c7c-921b-94f761df73aa => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:28:39.088855 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4c556bda-7a4e-4588-ab12-0f11b7becb45 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '.version_select at 0x7f5cc02db8b0>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:28:39.171316 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4c556bda-7a4e-4588-ab12-0f11b7becb45 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2043813706" status: 202 len: 0 microversion: 2.1 time: 0.085957 Oct 23 02:28:39.171824 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3950/7989] 10.222.0.42 () {58 vars in 1284 bytes} [Sun Oct 23 02:28:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2043813706 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:28:39.201107 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7a5da4c4-a6eb-40d7-b0ce-ee7163a59c46 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Action: 'create', calling method: .version_select at 0x7f5cc6218e50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2062165392", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGU5bDYlTDXl3i0SoBJ/sftpFdRia4JucjAa9mx7fwKN+C60Nuc2fMOoq/b18182A6off/p2gPaWUJUDrOjjFFmouC3QuW/jRrnM/ecJV4YiByHYnj10el2O7twS5J0u6g=="}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:28:39.209454 n-d-master-1 devstack@n-api.service[120944]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 23 02:28:39.209691 n-d-master-1 devstack@n-api.service[120944]: Sun Oct 23 02:28:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.42) !!! Oct 23 02:28:39.223836 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-7a5da4c4-a6eb-40d7-b0ce-ee7163a59c46 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Getting quotas for project 028ee2f0bfd246d0a4abebdcbea26588. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:28:39.231936 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-7a5da4c4-a6eb-40d7-b0ce-ee7163a59c46 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Getting quotas for user e44ce41e0ba0434a91710af395b8af29 and project 028ee2f0bfd246d0a4abebdcbea26588. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:28:39.299450 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7a5da4c4-a6eb-40d7-b0ce-ee7163a59c46 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.102256 Oct 23 02:28:39.300064 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4040/7990] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 02:28:39 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:28:47.166970 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=42 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:28:47.171994 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-29bbab89-7c69-4b06-8d00-e04d519f1915 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1472170209", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "3a704ce7-33b6-4656-8ef1-580e66fd5fd7"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2062165392", "security_groups": [{"name": "tempest-secgroup-smoke-1606136041"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:28:47.279411 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-29bbab89-7c69-4b06-8d00-e04d519f1915 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] validate_networks() for [('3a704ce7-33b6-4656-8ef1-580e66fd5fd7', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 02:28:47.703907 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-29bbab89-7c69-4b06-8d00-e04d519f1915 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:28:47.704729 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-29bbab89-7c69-4b06-8d00-e04d519f1915 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:28:47.705237 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-29bbab89-7c69-4b06-8d00-e04d519f1915 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:28:47.705671 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-29bbab89-7c69-4b06-8d00-e04d519f1915 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:28:47.706134 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-29bbab89-7c69-4b06-8d00-e04d519f1915 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:28:47.717283 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-29bbab89-7c69-4b06-8d00-e04d519f1915 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:47.718323 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-29bbab89-7c69-4b06-8d00-e04d519f1915 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:47.718781 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-29bbab89-7c69-4b06-8d00-e04d519f1915 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:47.719723 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-29bbab89-7c69-4b06-8d00-e04d519f1915 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:47.720379 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-29bbab89-7c69-4b06-8d00-e04d519f1915 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:47.721013 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-29bbab89-7c69-4b06-8d00-e04d519f1915 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:47.744296 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-29bbab89-7c69-4b06-8d00-e04d519f1915 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Getting quotas for project 028ee2f0bfd246d0a4abebdcbea26588. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:28:47.750346 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-29bbab89-7c69-4b06-8d00-e04d519f1915 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Getting quotas for user e44ce41e0ba0434a91710af395b8af29 and project 028ee2f0bfd246d0a4abebdcbea26588. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:28:47.770108 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-29bbab89-7c69-4b06-8d00-e04d519f1915 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 02:28:47.772898 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-29bbab89-7c69-4b06-8d00-e04d519f1915 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 3dc8004e-69ef-48b7-899e-8d587f1447a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 02:28:47.903128 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-29bbab89-7c69-4b06-8d00-e04d519f1915 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.737802 Oct 23 02:28:47.903791 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3951/7991] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 02:28:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 02:28:47.918828 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-552f8916-ddac-43b9-b24e-2179af80a83e tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:28:47.918828 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-552f8916-ddac-43b9-b24e-2179af80a83e tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 3dc8004e-69ef-48b7-899e-8d587f1447a0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:28:47.929452 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:28:48.009546 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-552f8916-ddac-43b9-b24e-2179af80a83e tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:28:48.017237 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-552f8916-ddac-43b9-b24e-2179af80a83e tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0" status: 200 len: 1267 microversion: 2.1 time: 0.104684 Oct 23 02:28:48.017838 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4041/7992] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:28:47 2022] GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0 => generated 1267 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:28:49.042679 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4d64214c-dbd8-4bea-b9a9-a16286bb8ea0 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:28:49.043278 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4d64214c-dbd8-4bea-b9a9-a16286bb8ea0 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 3dc8004e-69ef-48b7-899e-8d587f1447a0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:28:49.050235 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4d64214c-dbd8-4bea-b9a9-a16286bb8ea0 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:49.050736 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4d64214c-dbd8-4bea-b9a9-a16286bb8ea0 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:49.051188 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4d64214c-dbd8-4bea-b9a9-a16286bb8ea0 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:49.051902 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4d64214c-dbd8-4bea-b9a9-a16286bb8ea0 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:49.052427 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4d64214c-dbd8-4bea-b9a9-a16286bb8ea0 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:49.052867 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4d64214c-dbd8-4bea-b9a9-a16286bb8ea0 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:49.128462 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4d64214c-dbd8-4bea-b9a9-a16286bb8ea0 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:28:49.140299 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4d64214c-dbd8-4bea-b9a9-a16286bb8ea0 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0" status: 200 len: 1271 microversion: 2.1 time: 0.102577 Oct 23 02:28:49.157069 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3952/7993] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:28:49 2022] GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0 => generated 1271 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:28:50.166501 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-40ef94a0-4f7c-40d5-b8b3-445867f0a551 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:28:50.166501 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-40ef94a0-4f7c-40d5-b8b3-445867f0a551 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 3dc8004e-69ef-48b7-899e-8d587f1447a0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:28:50.173895 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-40ef94a0-4f7c-40d5-b8b3-445867f0a551 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:50.174427 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-40ef94a0-4f7c-40d5-b8b3-445867f0a551 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:50.174876 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-40ef94a0-4f7c-40d5-b8b3-445867f0a551 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:50.175591 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-40ef94a0-4f7c-40d5-b8b3-445867f0a551 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:50.176061 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-40ef94a0-4f7c-40d5-b8b3-445867f0a551 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:50.176498 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-40ef94a0-4f7c-40d5-b8b3-445867f0a551 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:50.241524 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-40ef94a0-4f7c-40d5-b8b3-445867f0a551 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:28:50.249485 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-40ef94a0-4f7c-40d5-b8b3-445867f0a551 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0" status: 200 len: 1327 microversion: 2.1 time: 0.088876 Oct 23 02:28:50.250089 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4042/7994] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:28:50 2022] GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0 => generated 1327 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:28:51.274338 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-daf7abf4-2600-4495-8a4c-11dee02f00d6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:28:51.275131 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-daf7abf4-2600-4495-8a4c-11dee02f00d6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 3dc8004e-69ef-48b7-899e-8d587f1447a0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:28:51.282659 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-daf7abf4-2600-4495-8a4c-11dee02f00d6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:51.283169 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-daf7abf4-2600-4495-8a4c-11dee02f00d6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:51.283628 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-daf7abf4-2600-4495-8a4c-11dee02f00d6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:51.284349 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-daf7abf4-2600-4495-8a4c-11dee02f00d6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:51.284820 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-daf7abf4-2600-4495-8a4c-11dee02f00d6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:51.285261 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-daf7abf4-2600-4495-8a4c-11dee02f00d6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:51.424419 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-daf7abf4-2600-4495-8a4c-11dee02f00d6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:28:51.434757 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-daf7abf4-2600-4495-8a4c-11dee02f00d6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0" status: 200 len: 1393 microversion: 2.1 time: 0.164483 Oct 23 02:28:51.448075 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3953/7995] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:28:51 2022] GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0 => generated 1393 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:28:52.134400 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-d0d75d48-8f08-4b8f-a04e-0a459f72657c req-0bf0f36c-856f-4cb4-aac8-741b78401cb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dc8004e-69ef-48b7-899e-8d587f1447a0", "tag": "0dd60963-284e-47be-94d1-df9755def015"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:28:52.145669 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-d0d75d48-8f08-4b8f-a04e-0a459f72657c req-0bf0f36c-856f-4cb4-aac8-741b78401cb6 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:52.146218 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-d0d75d48-8f08-4b8f-a04e-0a459f72657c req-0bf0f36c-856f-4cb4-aac8-741b78401cb6 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:52.146651 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-d0d75d48-8f08-4b8f-a04e-0a459f72657c req-0bf0f36c-856f-4cb4-aac8-741b78401cb6 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:52.161878 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-d0d75d48-8f08-4b8f-a04e-0a459f72657c req-0bf0f36c-856f-4cb4-aac8-741b78401cb6 service nova] Creating event network-changed:0dd60963-284e-47be-94d1-df9755def015 for instance 3dc8004e-69ef-48b7-899e-8d587f1447a0 on n-h1-master-1 Oct 23 02:28:52.167116 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-d0d75d48-8f08-4b8f-a04e-0a459f72657c req-0bf0f36c-856f-4cb4-aac8-741b78401cb6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036509 Oct 23 02:28:52.167738 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4043/7996] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:28:52.460406 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0427c3b2-25e8-424f-b82d-19ad28117031 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:28:52.460962 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0427c3b2-25e8-424f-b82d-19ad28117031 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 3dc8004e-69ef-48b7-899e-8d587f1447a0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:28:52.468220 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0427c3b2-25e8-424f-b82d-19ad28117031 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:52.468733 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0427c3b2-25e8-424f-b82d-19ad28117031 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:52.469193 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0427c3b2-25e8-424f-b82d-19ad28117031 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:52.469919 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0427c3b2-25e8-424f-b82d-19ad28117031 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:52.470425 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0427c3b2-25e8-424f-b82d-19ad28117031 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:52.470870 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0427c3b2-25e8-424f-b82d-19ad28117031 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:52.610878 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0427c3b2-25e8-424f-b82d-19ad28117031 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:28:52.619919 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0427c3b2-25e8-424f-b82d-19ad28117031 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0" status: 200 len: 1393 microversion: 2.1 time: 0.164126 Oct 23 02:28:52.620658 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3954/7997] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:28:52 2022] GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0 => generated 1393 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:28:53.652035 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a4300e21-f2f8-42b1-ba2b-4f9983847145 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:28:53.652739 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a4300e21-f2f8-42b1-ba2b-4f9983847145 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 3dc8004e-69ef-48b7-899e-8d587f1447a0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:28:53.659518 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a4300e21-f2f8-42b1-ba2b-4f9983847145 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:53.660009 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a4300e21-f2f8-42b1-ba2b-4f9983847145 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:53.660479 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a4300e21-f2f8-42b1-ba2b-4f9983847145 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:53.661173 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a4300e21-f2f8-42b1-ba2b-4f9983847145 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:53.661629 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a4300e21-f2f8-42b1-ba2b-4f9983847145 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:53.662087 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a4300e21-f2f8-42b1-ba2b-4f9983847145 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:53.792360 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a4300e21-f2f8-42b1-ba2b-4f9983847145 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:28:53.800094 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a4300e21-f2f8-42b1-ba2b-4f9983847145 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0" status: 200 len: 1393 microversion: 2.1 time: 0.153803 Oct 23 02:28:53.800670 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4044/7998] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:28:53 2022] GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0 => generated 1393 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:28:54.822303 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5990a246-8e6c-4a0f-ba79-a276253de690 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:28:54.822837 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5990a246-8e6c-4a0f-ba79-a276253de690 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 3dc8004e-69ef-48b7-899e-8d587f1447a0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:28:54.829568 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5990a246-8e6c-4a0f-ba79-a276253de690 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:54.830098 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5990a246-8e6c-4a0f-ba79-a276253de690 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:54.830546 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5990a246-8e6c-4a0f-ba79-a276253de690 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:54.831242 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5990a246-8e6c-4a0f-ba79-a276253de690 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:54.831706 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5990a246-8e6c-4a0f-ba79-a276253de690 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:54.832142 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5990a246-8e6c-4a0f-ba79-a276253de690 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:54.966619 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5990a246-8e6c-4a0f-ba79-a276253de690 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:28:54.974497 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5990a246-8e6c-4a0f-ba79-a276253de690 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0" status: 200 len: 1393 microversion: 2.1 time: 0.156298 Oct 23 02:28:54.975685 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3955/7999] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:28:54 2022] GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0 => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:28:55.998232 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1d65c5cf-0d36-4332-9b63-61bf574b8653 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:28:55.998864 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1d65c5cf-0d36-4332-9b63-61bf574b8653 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 3dc8004e-69ef-48b7-899e-8d587f1447a0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:28:56.001721 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:28:56.007136 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1d65c5cf-0d36-4332-9b63-61bf574b8653 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:56.007639 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1d65c5cf-0d36-4332-9b63-61bf574b8653 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:56.008090 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1d65c5cf-0d36-4332-9b63-61bf574b8653 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:56.008791 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1d65c5cf-0d36-4332-9b63-61bf574b8653 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:56.009290 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1d65c5cf-0d36-4332-9b63-61bf574b8653 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:56.009728 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1d65c5cf-0d36-4332-9b63-61bf574b8653 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:56.140702 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1d65c5cf-0d36-4332-9b63-61bf574b8653 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:28:56.148536 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1d65c5cf-0d36-4332-9b63-61bf574b8653 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0" status: 200 len: 1393 microversion: 2.1 time: 0.154314 Oct 23 02:28:56.149124 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4045/8000] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:28:55 2022] GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0 => generated 1393 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:28:57.171992 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8ab0a085-2be7-4f48-a3a3-29742a41bebd tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:28:57.172779 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8ab0a085-2be7-4f48-a3a3-29742a41bebd tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 3dc8004e-69ef-48b7-899e-8d587f1447a0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:28:57.175517 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:28:57.181012 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8ab0a085-2be7-4f48-a3a3-29742a41bebd tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:57.181513 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8ab0a085-2be7-4f48-a3a3-29742a41bebd tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:57.181964 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8ab0a085-2be7-4f48-a3a3-29742a41bebd tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:57.182692 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8ab0a085-2be7-4f48-a3a3-29742a41bebd tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:57.183162 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8ab0a085-2be7-4f48-a3a3-29742a41bebd tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:57.183602 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8ab0a085-2be7-4f48-a3a3-29742a41bebd tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:57.314940 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8ab0a085-2be7-4f48-a3a3-29742a41bebd tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:28:57.323507 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8ab0a085-2be7-4f48-a3a3-29742a41bebd tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0" status: 200 len: 1393 microversion: 2.1 time: 0.155385 Oct 23 02:28:57.324091 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3956/8001] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:28:57 2022] GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0 => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:28:58.346529 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5b8b3ed6-8108-4e4c-b1ca-6919ee3b942e tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:28:58.347063 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5b8b3ed6-8108-4e4c-b1ca-6919ee3b942e tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 3dc8004e-69ef-48b7-899e-8d587f1447a0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:28:58.349789 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=6 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:28:58.354983 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b8b3ed6-8108-4e4c-b1ca-6919ee3b942e tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:58.355481 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b8b3ed6-8108-4e4c-b1ca-6919ee3b942e tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:58.355929 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b8b3ed6-8108-4e4c-b1ca-6919ee3b942e tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:58.356684 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b8b3ed6-8108-4e4c-b1ca-6919ee3b942e tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:58.357127 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b8b3ed6-8108-4e4c-b1ca-6919ee3b942e tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:58.357562 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5b8b3ed6-8108-4e4c-b1ca-6919ee3b942e tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:58.491283 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5b8b3ed6-8108-4e4c-b1ca-6919ee3b942e tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:28:58.499207 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5b8b3ed6-8108-4e4c-b1ca-6919ee3b942e tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0" status: 200 len: 1393 microversion: 2.1 time: 0.156796 Oct 23 02:28:58.499786 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4046/8002] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:28:58 2022] GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0 => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:28:58.795580 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-5a3cda14-3d18-4cf2-8e75-324ac6e54343 req-b6d23a83-2094-48dd-92e4-70326ca3beed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dc8004e-69ef-48b7-899e-8d587f1447a0", "name": "network-vif-plugged", "status": "completed", "tag": "0dd60963-284e-47be-94d1-df9755def015"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:28:58.801128 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:28:58.801789 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=6 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:28:58.808375 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-5a3cda14-3d18-4cf2-8e75-324ac6e54343 req-b6d23a83-2094-48dd-92e4-70326ca3beed service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:58.808862 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-5a3cda14-3d18-4cf2-8e75-324ac6e54343 req-b6d23a83-2094-48dd-92e4-70326ca3beed service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:58.809302 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-5a3cda14-3d18-4cf2-8e75-324ac6e54343 req-b6d23a83-2094-48dd-92e4-70326ca3beed service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:58.820844 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-5a3cda14-3d18-4cf2-8e75-324ac6e54343 req-b6d23a83-2094-48dd-92e4-70326ca3beed service nova] Creating event network-vif-plugged:0dd60963-284e-47be-94d1-df9755def015 for instance 3dc8004e-69ef-48b7-899e-8d587f1447a0 on n-h1-master-1 Oct 23 02:28:58.826203 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-5a3cda14-3d18-4cf2-8e75-324ac6e54343 req-b6d23a83-2094-48dd-92e4-70326ca3beed service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034679 Oct 23 02:28:58.826816 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3957/8003] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:28:59.522852 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c0f5baae-aa75-4631-8182-581dd7ed0057 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:28:59.523416 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c0f5baae-aa75-4631-8182-581dd7ed0057 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 3dc8004e-69ef-48b7-899e-8d587f1447a0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:28:59.530102 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c0f5baae-aa75-4631-8182-581dd7ed0057 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:59.531909 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c0f5baae-aa75-4631-8182-581dd7ed0057 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:59.531909 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c0f5baae-aa75-4631-8182-581dd7ed0057 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:59.531909 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c0f5baae-aa75-4631-8182-581dd7ed0057 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:28:59.532328 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c0f5baae-aa75-4631-8182-581dd7ed0057 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:28:59.532767 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c0f5baae-aa75-4631-8182-581dd7ed0057 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:28:59.664502 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c0f5baae-aa75-4631-8182-581dd7ed0057 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:28:59.672220 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c0f5baae-aa75-4631-8182-581dd7ed0057 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0" status: 200 len: 1393 microversion: 2.1 time: 0.153493 Oct 23 02:28:59.672793 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4047/8004] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:28:59 2022] GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0 => generated 1393 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:29:00.697089 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c486ee98-4314-44cb-aac9-ffc87c21d699 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:29:00.697788 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c486ee98-4314-44cb-aac9-ffc87c21d699 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 3dc8004e-69ef-48b7-899e-8d587f1447a0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:29:00.705533 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c486ee98-4314-44cb-aac9-ffc87c21d699 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:29:00.706054 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c486ee98-4314-44cb-aac9-ffc87c21d699 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:29:00.706986 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c486ee98-4314-44cb-aac9-ffc87c21d699 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:29:00.707234 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c486ee98-4314-44cb-aac9-ffc87c21d699 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:29:00.707699 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c486ee98-4314-44cb-aac9-ffc87c21d699 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:29:00.708132 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c486ee98-4314-44cb-aac9-ffc87c21d699 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:29:00.842753 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c486ee98-4314-44cb-aac9-ffc87c21d699 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:29:00.850452 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c486ee98-4314-44cb-aac9-ffc87c21d699 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0" status: 200 len: 1565 microversion: 2.1 time: 0.158695 Oct 23 02:29:00.851025 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3958/8005] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:29:00 2022] GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0 => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:29:00.873329 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-57ca45a6-4820-4988-a71f-fbc34b09e8a8 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:29:00.873946 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-57ca45a6-4820-4988-a71f-fbc34b09e8a8 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 3dc8004e-69ef-48b7-899e-8d587f1447a0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:29:00.880734 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-57ca45a6-4820-4988-a71f-fbc34b09e8a8 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:29:00.881713 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-57ca45a6-4820-4988-a71f-fbc34b09e8a8 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:29:00.882196 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-57ca45a6-4820-4988-a71f-fbc34b09e8a8 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:29:00.882884 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-57ca45a6-4820-4988-a71f-fbc34b09e8a8 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:29:00.883342 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-57ca45a6-4820-4988-a71f-fbc34b09e8a8 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:29:00.883768 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-57ca45a6-4820-4988-a71f-fbc34b09e8a8 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:29:01.011783 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-57ca45a6-4820-4988-a71f-fbc34b09e8a8 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:29:01.019945 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-57ca45a6-4820-4988-a71f-fbc34b09e8a8 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0" status: 200 len: 1565 microversion: 2.1 time: 0.150726 Oct 23 02:29:01.020515 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4048/8006] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:29:00 2022] GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0 => generated 1565 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:29:02.813908 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-54ff39d9-eb7e-4702-b839-e62bcc8db5e6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:29:02.814808 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-54ff39d9-eb7e-4702-b839-e62bcc8db5e6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 3dc8004e-69ef-48b7-899e-8d587f1447a0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:29:02.815386 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-2f16efb0-0a30-4c7f-bef0-c17843f7e1f5 req-a9bef348-458e-460f-b75d-ae79b72985e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dc8004e-69ef-48b7-899e-8d587f1447a0", "tag": "0dd60963-284e-47be-94d1-df9755def015"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:29:02.821842 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54ff39d9-eb7e-4702-b839-e62bcc8db5e6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:29:02.822658 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54ff39d9-eb7e-4702-b839-e62bcc8db5e6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:29:02.823107 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54ff39d9-eb7e-4702-b839-e62bcc8db5e6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:29:02.823818 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54ff39d9-eb7e-4702-b839-e62bcc8db5e6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:29:02.824286 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54ff39d9-eb7e-4702-b839-e62bcc8db5e6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:29:02.824872 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-54ff39d9-eb7e-4702-b839-e62bcc8db5e6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:29:02.826347 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-2f16efb0-0a30-4c7f-bef0-c17843f7e1f5 req-a9bef348-458e-460f-b75d-ae79b72985e5 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:29:02.826960 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-2f16efb0-0a30-4c7f-bef0-c17843f7e1f5 req-a9bef348-458e-460f-b75d-ae79b72985e5 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:29:02.827402 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-2f16efb0-0a30-4c7f-bef0-c17843f7e1f5 req-a9bef348-458e-460f-b75d-ae79b72985e5 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:29:02.839864 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-2f16efb0-0a30-4c7f-bef0-c17843f7e1f5 req-a9bef348-458e-460f-b75d-ae79b72985e5 service nova] Creating event network-changed:0dd60963-284e-47be-94d1-df9755def015 for instance 3dc8004e-69ef-48b7-899e-8d587f1447a0 on n-h1-master-1 Oct 23 02:29:02.844914 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-2f16efb0-0a30-4c7f-bef0-c17843f7e1f5 req-a9bef348-458e-460f-b75d-ae79b72985e5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033268 Oct 23 02:29:02.845523 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4049/8007] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:29:02.973808 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-54ff39d9-eb7e-4702-b839-e62bcc8db5e6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:29:02.982829 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-54ff39d9-eb7e-4702-b839-e62bcc8db5e6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0" status: 200 len: 1565 microversion: 2.1 time: 0.173347 Oct 23 02:29:02.983753 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3959/8008] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:29:02 2022] GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0 => generated 1565 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:29:28.235929 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=9 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:29:28.236678 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=40 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:29:28.241007 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-93200baa-b8b7-47f0-bd74-3127b13cfa33 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:29:28.243289 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-93200baa-b8b7-47f0-bd74-3127b13cfa33 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 3dc8004e-69ef-48b7-899e-8d587f1447a0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:29:28.249855 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-93200baa-b8b7-47f0-bd74-3127b13cfa33 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:29:28.249855 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-93200baa-b8b7-47f0-bd74-3127b13cfa33 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:29:28.250279 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-93200baa-b8b7-47f0-bd74-3127b13cfa33 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:29:28.250968 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-93200baa-b8b7-47f0-bd74-3127b13cfa33 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:29:28.251425 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-93200baa-b8b7-47f0-bd74-3127b13cfa33 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:29:28.251856 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-93200baa-b8b7-47f0-bd74-3127b13cfa33 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:29:28.325624 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-93200baa-b8b7-47f0-bd74-3127b13cfa33 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "POST /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0/action" status: 200 len: 24569 microversion: 2.1 time: 0.091605 Oct 23 02:29:28.326300 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4050/8009] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:29:28 2022] POST /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0/action => generated 24569 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 02:29:39.378540 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2192d1b4-c3e3-46ea-9e50-ab9e06ebc717 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:29:39.380868 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2192d1b4-c3e3-46ea-9e50-ab9e06ebc717 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 3dc8004e-69ef-48b7-899e-8d587f1447a0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:29:39.383079 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=7 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:29:39.383779 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=46 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:29:39.388549 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2192d1b4-c3e3-46ea-9e50-ab9e06ebc717 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:29:39.389058 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2192d1b4-c3e3-46ea-9e50-ab9e06ebc717 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:29:39.389514 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2192d1b4-c3e3-46ea-9e50-ab9e06ebc717 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:29:39.390278 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2192d1b4-c3e3-46ea-9e50-ab9e06ebc717 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:29:39.390781 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2192d1b4-c3e3-46ea-9e50-ab9e06ebc717 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:29:39.391231 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2192d1b4-c3e3-46ea-9e50-ab9e06ebc717 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:29:39.584731 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2192d1b4-c3e3-46ea-9e50-ab9e06ebc717 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "POST /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0/action" status: 202 len: 0 microversion: 2.1 time: 0.209760 Oct 23 02:29:39.585380 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3960/8010] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:29:39 2022] POST /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:29:39.594319 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8e73a9f6-ec57-45d0-b46f-f85d76949fdc tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:29:39.595029 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8e73a9f6-ec57-45d0-b46f-f85d76949fdc tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 3dc8004e-69ef-48b7-899e-8d587f1447a0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:29:39.597577 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:29:39.598430 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=4 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:29:39.603522 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8e73a9f6-ec57-45d0-b46f-f85d76949fdc tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:29:39.607474 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8e73a9f6-ec57-45d0-b46f-f85d76949fdc tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:29:39.607474 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8e73a9f6-ec57-45d0-b46f-f85d76949fdc tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:29:39.607474 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8e73a9f6-ec57-45d0-b46f-f85d76949fdc tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:29:39.607474 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8e73a9f6-ec57-45d0-b46f-f85d76949fdc tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:29:39.607474 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8e73a9f6-ec57-45d0-b46f-f85d76949fdc tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:29:40.035479 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8e73a9f6-ec57-45d0-b46f-f85d76949fdc tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:29:40.043430 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8e73a9f6-ec57-45d0-b46f-f85d76949fdc tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0" status: 200 len: 1676 microversion: 2.1 time: 0.453594 Oct 23 02:29:40.044865 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4051/8011] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:29:39 2022] GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0 => generated 1676 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:29:41.069888 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e0e99bb4-8ea2-4430-8cb5-1ad78fbfcf04 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:29:41.070644 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e0e99bb4-8ea2-4430-8cb5-1ad78fbfcf04 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 3dc8004e-69ef-48b7-899e-8d587f1447a0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:29:41.076919 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e0e99bb4-8ea2-4430-8cb5-1ad78fbfcf04 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:29:41.077420 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e0e99bb4-8ea2-4430-8cb5-1ad78fbfcf04 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:29:41.077877 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e0e99bb4-8ea2-4430-8cb5-1ad78fbfcf04 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:29:41.078603 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e0e99bb4-8ea2-4430-8cb5-1ad78fbfcf04 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:29:41.079077 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e0e99bb4-8ea2-4430-8cb5-1ad78fbfcf04 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:29:41.079521 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e0e99bb4-8ea2-4430-8cb5-1ad78fbfcf04 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:29:41.214705 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e0e99bb4-8ea2-4430-8cb5-1ad78fbfcf04 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:29:41.222647 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e0e99bb4-8ea2-4430-8cb5-1ad78fbfcf04 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0" status: 200 len: 1681 microversion: 2.1 time: 0.158663 Oct 23 02:29:41.224459 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3961/8012] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:29:41 2022] GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:29:42.246187 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cb74db7e-7716-405f-aaa7-8289d480721d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:29:42.246846 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-cb74db7e-7716-405f-aaa7-8289d480721d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 3dc8004e-69ef-48b7-899e-8d587f1447a0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:29:42.253878 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cb74db7e-7716-405f-aaa7-8289d480721d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:29:42.254400 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cb74db7e-7716-405f-aaa7-8289d480721d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:29:42.254843 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cb74db7e-7716-405f-aaa7-8289d480721d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:29:42.255607 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cb74db7e-7716-405f-aaa7-8289d480721d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:29:42.256199 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cb74db7e-7716-405f-aaa7-8289d480721d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:29:42.256666 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cb74db7e-7716-405f-aaa7-8289d480721d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:29:42.386062 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cb74db7e-7716-405f-aaa7-8289d480721d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:29:42.393872 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cb74db7e-7716-405f-aaa7-8289d480721d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0" status: 200 len: 1681 microversion: 2.1 time: 0.151791 Oct 23 02:29:42.394474 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4052/8013] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:29:42 2022] GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:29:43.418314 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-faa26799-d5cb-497a-bafe-5b4ebb13e106 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:29:43.418953 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-faa26799-d5cb-497a-bafe-5b4ebb13e106 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 3dc8004e-69ef-48b7-899e-8d587f1447a0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:29:43.425922 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-faa26799-d5cb-497a-bafe-5b4ebb13e106 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:29:43.426457 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-faa26799-d5cb-497a-bafe-5b4ebb13e106 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:29:43.426914 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-faa26799-d5cb-497a-bafe-5b4ebb13e106 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:29:43.428230 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-faa26799-d5cb-497a-bafe-5b4ebb13e106 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:29:43.428699 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-faa26799-d5cb-497a-bafe-5b4ebb13e106 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:29:43.429146 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-faa26799-d5cb-497a-bafe-5b4ebb13e106 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:29:43.557470 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-faa26799-d5cb-497a-bafe-5b4ebb13e106 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:29:43.565538 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-faa26799-d5cb-497a-bafe-5b4ebb13e106 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0" status: 200 len: 1681 microversion: 2.1 time: 0.151336 Oct 23 02:29:43.567216 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3962/8014] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:29:43 2022] GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:29:44.588850 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f9be5573-3951-4270-8741-452a755c3c25 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:29:44.589523 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f9be5573-3951-4270-8741-452a755c3c25 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 3dc8004e-69ef-48b7-899e-8d587f1447a0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:29:44.596452 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f9be5573-3951-4270-8741-452a755c3c25 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:29:44.596943 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f9be5573-3951-4270-8741-452a755c3c25 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:29:44.597391 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f9be5573-3951-4270-8741-452a755c3c25 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:29:44.598117 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f9be5573-3951-4270-8741-452a755c3c25 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:29:44.598579 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f9be5573-3951-4270-8741-452a755c3c25 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:29:44.599012 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f9be5573-3951-4270-8741-452a755c3c25 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:29:44.733435 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f9be5573-3951-4270-8741-452a755c3c25 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:29:44.741959 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f9be5573-3951-4270-8741-452a755c3c25 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0" status: 200 len: 1681 microversion: 2.1 time: 0.157038 Oct 23 02:29:44.742503 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4053/8015] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:29:44 2022] GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:29:45.765605 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-df10f3da-3637-4b00-bd02-1b24baaa9628 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:29:45.766220 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-df10f3da-3637-4b00-bd02-1b24baaa9628 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 3dc8004e-69ef-48b7-899e-8d587f1447a0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:29:45.773769 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-df10f3da-3637-4b00-bd02-1b24baaa9628 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:29:45.774297 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-df10f3da-3637-4b00-bd02-1b24baaa9628 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:29:45.774755 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-df10f3da-3637-4b00-bd02-1b24baaa9628 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:29:45.775460 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-df10f3da-3637-4b00-bd02-1b24baaa9628 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:29:45.775934 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-df10f3da-3637-4b00-bd02-1b24baaa9628 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:29:45.776378 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-df10f3da-3637-4b00-bd02-1b24baaa9628 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:29:45.904230 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-df10f3da-3637-4b00-bd02-1b24baaa9628 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:29:45.911936 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-df10f3da-3637-4b00-bd02-1b24baaa9628 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0" status: 200 len: 1681 microversion: 2.1 time: 0.150464 Oct 23 02:29:45.912505 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3963/8016] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:29:45 2022] GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:29:46.935374 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2f901f77-12c7-4ac6-800b-6d8d50142c56 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:29:46.935926 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2f901f77-12c7-4ac6-800b-6d8d50142c56 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 3dc8004e-69ef-48b7-899e-8d587f1447a0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:29:46.942813 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f901f77-12c7-4ac6-800b-6d8d50142c56 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:29:46.943298 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f901f77-12c7-4ac6-800b-6d8d50142c56 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:29:46.943736 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f901f77-12c7-4ac6-800b-6d8d50142c56 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:29:46.944429 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f901f77-12c7-4ac6-800b-6d8d50142c56 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:29:46.944885 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f901f77-12c7-4ac6-800b-6d8d50142c56 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:29:46.945310 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f901f77-12c7-4ac6-800b-6d8d50142c56 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:29:47.077467 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2f901f77-12c7-4ac6-800b-6d8d50142c56 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:29:47.085804 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2f901f77-12c7-4ac6-800b-6d8d50142c56 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0" status: 200 len: 1681 microversion: 2.1 time: 0.154454 Oct 23 02:29:47.086404 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4054/8017] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:29:46 2022] GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:29:48.110017 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-50237d25-2b39-4237-9660-acd0f73fe4af tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:29:48.110572 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-50237d25-2b39-4237-9660-acd0f73fe4af tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 3dc8004e-69ef-48b7-899e-8d587f1447a0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:29:48.118064 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-50237d25-2b39-4237-9660-acd0f73fe4af tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:29:48.118570 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-50237d25-2b39-4237-9660-acd0f73fe4af tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:29:48.119026 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-50237d25-2b39-4237-9660-acd0f73fe4af tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:29:48.119733 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-50237d25-2b39-4237-9660-acd0f73fe4af tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:29:48.120211 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-50237d25-2b39-4237-9660-acd0f73fe4af tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:29:48.120656 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-50237d25-2b39-4237-9660-acd0f73fe4af tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:29:48.249820 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-50237d25-2b39-4237-9660-acd0f73fe4af tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:29:48.257555 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-50237d25-2b39-4237-9660-acd0f73fe4af tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0" status: 200 len: 1681 microversion: 2.1 time: 0.151658 Oct 23 02:29:48.258167 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3964/8018] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:29:48 2022] GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:29:49.281201 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-67107ae4-e8f2-470e-a902-3b4324a46b5a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:29:49.281852 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-67107ae4-e8f2-470e-a902-3b4324a46b5a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 3dc8004e-69ef-48b7-899e-8d587f1447a0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:29:49.289349 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-67107ae4-e8f2-470e-a902-3b4324a46b5a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:29:49.289846 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-67107ae4-e8f2-470e-a902-3b4324a46b5a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:29:49.290315 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-67107ae4-e8f2-470e-a902-3b4324a46b5a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:29:49.291014 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-67107ae4-e8f2-470e-a902-3b4324a46b5a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:29:49.291476 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-67107ae4-e8f2-470e-a902-3b4324a46b5a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:29:49.291915 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-67107ae4-e8f2-470e-a902-3b4324a46b5a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:29:49.424883 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-67107ae4-e8f2-470e-a902-3b4324a46b5a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:29:49.433418 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-67107ae4-e8f2-470e-a902-3b4324a46b5a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0" status: 200 len: 1681 microversion: 2.1 time: 0.156233 Oct 23 02:29:49.441128 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4055/8019] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:29:49 2022] GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:29:50.456735 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-77f275ca-b08f-4bd4-a671-c8fbe902ba07 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:29:50.457366 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-77f275ca-b08f-4bd4-a671-c8fbe902ba07 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 3dc8004e-69ef-48b7-899e-8d587f1447a0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:29:50.464406 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-77f275ca-b08f-4bd4-a671-c8fbe902ba07 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:29:50.464909 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-77f275ca-b08f-4bd4-a671-c8fbe902ba07 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:29:50.465364 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-77f275ca-b08f-4bd4-a671-c8fbe902ba07 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:29:50.466096 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-77f275ca-b08f-4bd4-a671-c8fbe902ba07 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:29:50.466572 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-77f275ca-b08f-4bd4-a671-c8fbe902ba07 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:29:50.467017 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-77f275ca-b08f-4bd4-a671-c8fbe902ba07 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:29:50.661646 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-77f275ca-b08f-4bd4-a671-c8fbe902ba07 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:29:50.669452 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-77f275ca-b08f-4bd4-a671-c8fbe902ba07 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0" status: 200 len: 1681 microversion: 2.1 time: 0.216703 Oct 23 02:29:50.674144 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3965/8020] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:29:50 2022] GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0 => generated 1681 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:29:51.694513 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-db214106-f730-4d8d-af1e-654cd8a1aa06 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:29:51.695110 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-db214106-f730-4d8d-af1e-654cd8a1aa06 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 3dc8004e-69ef-48b7-899e-8d587f1447a0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:29:51.702142 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-db214106-f730-4d8d-af1e-654cd8a1aa06 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:29:51.702637 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-db214106-f730-4d8d-af1e-654cd8a1aa06 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:29:51.703102 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-db214106-f730-4d8d-af1e-654cd8a1aa06 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:29:51.703797 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-db214106-f730-4d8d-af1e-654cd8a1aa06 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:29:51.704257 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-db214106-f730-4d8d-af1e-654cd8a1aa06 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:29:51.704685 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-db214106-f730-4d8d-af1e-654cd8a1aa06 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:29:51.846493 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-db214106-f730-4d8d-af1e-654cd8a1aa06 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:29:51.854669 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-db214106-f730-4d8d-af1e-654cd8a1aa06 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0" status: 200 len: 1681 microversion: 2.1 time: 0.164738 Oct 23 02:29:51.855252 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4056/8021] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:29:51 2022] GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:29:52.878788 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7a451796-f3f9-4f36-9ca4-093dadc6db06 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:29:52.879446 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7a451796-f3f9-4f36-9ca4-093dadc6db06 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 3dc8004e-69ef-48b7-899e-8d587f1447a0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:29:52.885967 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a451796-f3f9-4f36-9ca4-093dadc6db06 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:29:52.886501 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a451796-f3f9-4f36-9ca4-093dadc6db06 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:29:52.886955 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a451796-f3f9-4f36-9ca4-093dadc6db06 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:29:52.887660 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a451796-f3f9-4f36-9ca4-093dadc6db06 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:29:52.888134 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a451796-f3f9-4f36-9ca4-093dadc6db06 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:29:52.888576 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a451796-f3f9-4f36-9ca4-093dadc6db06 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:29:53.022988 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7a451796-f3f9-4f36-9ca4-093dadc6db06 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:29:53.030876 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7a451796-f3f9-4f36-9ca4-093dadc6db06 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0" status: 200 len: 1681 microversion: 2.1 time: 0.156240 Oct 23 02:29:53.031464 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3966/8022] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:29:52 2022] GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:29:54.054268 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9492d911-ec5b-4720-a951-cc83fee00550 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:29:54.054891 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9492d911-ec5b-4720-a951-cc83fee00550 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 3dc8004e-69ef-48b7-899e-8d587f1447a0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:29:54.061694 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9492d911-ec5b-4720-a951-cc83fee00550 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:29:54.062223 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9492d911-ec5b-4720-a951-cc83fee00550 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:29:54.062666 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9492d911-ec5b-4720-a951-cc83fee00550 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:29:54.063362 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9492d911-ec5b-4720-a951-cc83fee00550 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:29:54.063816 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9492d911-ec5b-4720-a951-cc83fee00550 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:29:54.064242 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9492d911-ec5b-4720-a951-cc83fee00550 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:29:54.195120 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9492d911-ec5b-4720-a951-cc83fee00550 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:29:54.203175 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9492d911-ec5b-4720-a951-cc83fee00550 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0" status: 200 len: 1681 microversion: 2.1 time: 0.152802 Oct 23 02:29:54.204206 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4057/8023] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:29:54 2022] GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:29:55.226692 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e415672b-6c6a-4eeb-bb7d-f6d1db8a78d6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:29:55.227350 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e415672b-6c6a-4eeb-bb7d-f6d1db8a78d6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 3dc8004e-69ef-48b7-899e-8d587f1447a0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:29:55.234452 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e415672b-6c6a-4eeb-bb7d-f6d1db8a78d6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:29:55.234953 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e415672b-6c6a-4eeb-bb7d-f6d1db8a78d6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:29:55.235403 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e415672b-6c6a-4eeb-bb7d-f6d1db8a78d6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:29:55.236113 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e415672b-6c6a-4eeb-bb7d-f6d1db8a78d6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:29:55.236583 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e415672b-6c6a-4eeb-bb7d-f6d1db8a78d6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:29:55.237025 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e415672b-6c6a-4eeb-bb7d-f6d1db8a78d6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:29:55.369078 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e415672b-6c6a-4eeb-bb7d-f6d1db8a78d6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:29:55.376759 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e415672b-6c6a-4eeb-bb7d-f6d1db8a78d6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0" status: 200 len: 1681 microversion: 2.1 time: 0.154153 Oct 23 02:29:55.377335 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3967/8024] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:29:55 2022] GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:29:56.400359 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3cc9ae72-68a3-40a1-b12c-f15088b43673 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:29:56.400980 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3cc9ae72-68a3-40a1-b12c-f15088b43673 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 3dc8004e-69ef-48b7-899e-8d587f1447a0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:29:56.407851 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3cc9ae72-68a3-40a1-b12c-f15088b43673 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:29:56.408337 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3cc9ae72-68a3-40a1-b12c-f15088b43673 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:29:56.408777 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3cc9ae72-68a3-40a1-b12c-f15088b43673 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:29:56.409468 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3cc9ae72-68a3-40a1-b12c-f15088b43673 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:29:56.409928 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3cc9ae72-68a3-40a1-b12c-f15088b43673 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:29:56.410372 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3cc9ae72-68a3-40a1-b12c-f15088b43673 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:29:56.542883 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3cc9ae72-68a3-40a1-b12c-f15088b43673 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:29:56.550782 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3cc9ae72-68a3-40a1-b12c-f15088b43673 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0" status: 200 len: 1681 microversion: 2.1 time: 0.154401 Oct 23 02:29:56.551358 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4058/8025] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:29:56 2022] GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:29:57.575020 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-14893e24-3347-406a-9c04-73a391a471bd tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:29:57.575652 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-14893e24-3347-406a-9c04-73a391a471bd tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 3dc8004e-69ef-48b7-899e-8d587f1447a0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:29:57.582514 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-14893e24-3347-406a-9c04-73a391a471bd tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:29:57.583013 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-14893e24-3347-406a-9c04-73a391a471bd tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:29:57.583471 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-14893e24-3347-406a-9c04-73a391a471bd tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:29:57.584822 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-14893e24-3347-406a-9c04-73a391a471bd tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:29:57.585657 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-14893e24-3347-406a-9c04-73a391a471bd tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:29:57.585778 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-14893e24-3347-406a-9c04-73a391a471bd tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:29:57.715210 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-14893e24-3347-406a-9c04-73a391a471bd tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:29:57.723172 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-14893e24-3347-406a-9c04-73a391a471bd tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0" status: 200 len: 1684 microversion: 2.1 time: 0.152099 Oct 23 02:29:57.723753 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3968/8026] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:29:57 2022] GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0 => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:30:21.933889 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fd7d6d9c-bce5-4fce-a487-dfab97393743 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:30:21.940814 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fd7d6d9c-bce5-4fce-a487-dfab97393743 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 3dc8004e-69ef-48b7-899e-8d587f1447a0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:30:21.940814 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=16 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:30:21.940814 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=48 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:30:21.944973 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fd7d6d9c-bce5-4fce-a487-dfab97393743 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:30:21.945470 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fd7d6d9c-bce5-4fce-a487-dfab97393743 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:30:21.945918 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fd7d6d9c-bce5-4fce-a487-dfab97393743 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:30:21.946651 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fd7d6d9c-bce5-4fce-a487-dfab97393743 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:30:21.947163 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fd7d6d9c-bce5-4fce-a487-dfab97393743 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:30:21.947599 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fd7d6d9c-bce5-4fce-a487-dfab97393743 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:30:22.018808 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fd7d6d9c-bce5-4fce-a487-dfab97393743 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "POST /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0/action" status: 200 len: 69159 microversion: 2.1 time: 0.089003 Oct 23 02:30:22.019483 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4059/8027] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:30:21 2022] POST /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0/action => generated 69159 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 02:30:29.204598 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b486ca31-69dc-4c47-8e8d-e1576b5c8f12 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:30:29.205097 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b486ca31-69dc-4c47-8e8d-e1576b5c8f12 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 3dc8004e-69ef-48b7-899e-8d587f1447a0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:30:29.207622 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=18 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:30:29.208144 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-9e11f274-9538-47f5-87e0-b4c2e76fdd3c req-d53f706d-4d7d-452e-b745-f7ae637a61a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dc8004e-69ef-48b7-899e-8d587f1447a0", "tag": "0dd60963-284e-47be-94d1-df9755def015"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:30:29.208559 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:30:29.213790 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b486ca31-69dc-4c47-8e8d-e1576b5c8f12 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:30:29.214322 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b486ca31-69dc-4c47-8e8d-e1576b5c8f12 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:30:29.214979 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b486ca31-69dc-4c47-8e8d-e1576b5c8f12 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:30:29.215690 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b486ca31-69dc-4c47-8e8d-e1576b5c8f12 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:30:29.216318 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b486ca31-69dc-4c47-8e8d-e1576b5c8f12 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:30:29.217000 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b486ca31-69dc-4c47-8e8d-e1576b5c8f12 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:30:29.220217 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-9e11f274-9538-47f5-87e0-b4c2e76fdd3c req-d53f706d-4d7d-452e-b745-f7ae637a61a7 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:30:29.220775 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-9e11f274-9538-47f5-87e0-b4c2e76fdd3c req-d53f706d-4d7d-452e-b745-f7ae637a61a7 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:30:29.221434 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-9e11f274-9538-47f5-87e0-b4c2e76fdd3c req-d53f706d-4d7d-452e-b745-f7ae637a61a7 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:30:29.235145 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-9e11f274-9538-47f5-87e0-b4c2e76fdd3c req-d53f706d-4d7d-452e-b745-f7ae637a61a7 service nova] Creating event network-changed:0dd60963-284e-47be-94d1-df9755def015 for instance 3dc8004e-69ef-48b7-899e-8d587f1447a0 on n-h1-master-1 Oct 23 02:30:29.241613 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-9e11f274-9538-47f5-87e0-b4c2e76fdd3c req-d53f706d-4d7d-452e-b745-f7ae637a61a7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037588 Oct 23 02:30:29.242253 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4060/8028] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:30:29.245704 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b486ca31-69dc-4c47-8e8d-e1576b5c8f12 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 3dc8004e-69ef-48b7-899e-8d587f1447a0] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 02:30:29.586100 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b486ca31-69dc-4c47-8e8d-e1576b5c8f12 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0" status: 204 len: 0 microversion: 2.1 time: 0.385677 Oct 23 02:30:29.587117 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3969/8029] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 02:30:29 2022] DELETE /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 02:30:29.597024 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3565c311-36b3-445d-9924-6ab1981d8357 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:30:29.597663 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3565c311-36b3-445d-9924-6ab1981d8357 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 3dc8004e-69ef-48b7-899e-8d587f1447a0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:30:29.607404 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3565c311-36b3-445d-9924-6ab1981d8357 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:30:29.608797 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3565c311-36b3-445d-9924-6ab1981d8357 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:30:29.609246 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3565c311-36b3-445d-9924-6ab1981d8357 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:30:29.610234 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3565c311-36b3-445d-9924-6ab1981d8357 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:30:29.610885 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3565c311-36b3-445d-9924-6ab1981d8357 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:30:29.612048 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3565c311-36b3-445d-9924-6ab1981d8357 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:30:29.838134 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3565c311-36b3-445d-9924-6ab1981d8357 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:30:29.846639 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3565c311-36b3-445d-9924-6ab1981d8357 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0" status: 200 len: 1690 microversion: 2.1 time: 0.254844 Oct 23 02:30:29.847267 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4061/8030] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:30:29 2022] GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0 => generated 1690 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:30:30.871452 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-955e87e8-1b1b-4f68-badb-423e070d45ce tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:30:30.872085 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-955e87e8-1b1b-4f68-badb-423e070d45ce tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 3dc8004e-69ef-48b7-899e-8d587f1447a0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:30:30.878902 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-955e87e8-1b1b-4f68-badb-423e070d45ce tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:30:30.879396 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-955e87e8-1b1b-4f68-badb-423e070d45ce tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:30:30.879839 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-955e87e8-1b1b-4f68-badb-423e070d45ce tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:30:30.880530 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-955e87e8-1b1b-4f68-badb-423e070d45ce tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:30:30.880993 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-955e87e8-1b1b-4f68-badb-423e070d45ce tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:30:30.881425 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-955e87e8-1b1b-4f68-badb-423e070d45ce tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:30:31.015479 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-955e87e8-1b1b-4f68-badb-423e070d45ce tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:30:31.023950 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-955e87e8-1b1b-4f68-badb-423e070d45ce tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0" status: 200 len: 1690 microversion: 2.1 time: 0.156818 Oct 23 02:30:31.024822 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3970/8031] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:30:30 2022] GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0 => generated 1690 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:30:32.048532 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-62ac0dd9-6bb2-4bf4-9017-40bb20890044 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:30:32.049158 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-62ac0dd9-6bb2-4bf4-9017-40bb20890044 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 3dc8004e-69ef-48b7-899e-8d587f1447a0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:30:32.057127 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-62ac0dd9-6bb2-4bf4-9017-40bb20890044 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:30:32.057620 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-62ac0dd9-6bb2-4bf4-9017-40bb20890044 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:30:32.058084 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-62ac0dd9-6bb2-4bf4-9017-40bb20890044 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:30:32.058785 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-62ac0dd9-6bb2-4bf4-9017-40bb20890044 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:30:32.059247 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-62ac0dd9-6bb2-4bf4-9017-40bb20890044 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:30:32.059719 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-62ac0dd9-6bb2-4bf4-9017-40bb20890044 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:30:32.191291 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-62ac0dd9-6bb2-4bf4-9017-40bb20890044 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:30:32.199070 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-62ac0dd9-6bb2-4bf4-9017-40bb20890044 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0" status: 200 len: 1571 microversion: 2.1 time: 0.154459 Oct 23 02:30:32.199652 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4062/8032] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:30:32 2022] GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0 => generated 1571 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:30:32.408025 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-a522278d-0d59-4335-9fed-53e8e453891b req-ab06c433-7130-4e6d-b5ba-ed3280c6eab9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dc8004e-69ef-48b7-899e-8d587f1447a0", "name": "network-vif-deleted", "tag": "0dd60963-284e-47be-94d1-df9755def015"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:30:32.418816 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-a522278d-0d59-4335-9fed-53e8e453891b req-ab06c433-7130-4e6d-b5ba-ed3280c6eab9 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:30:32.419339 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-a522278d-0d59-4335-9fed-53e8e453891b req-ab06c433-7130-4e6d-b5ba-ed3280c6eab9 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:30:32.419783 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-a522278d-0d59-4335-9fed-53e8e453891b req-ab06c433-7130-4e6d-b5ba-ed3280c6eab9 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:30:32.431604 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-a522278d-0d59-4335-9fed-53e8e453891b req-ab06c433-7130-4e6d-b5ba-ed3280c6eab9 service nova] Creating event network-vif-deleted:0dd60963-284e-47be-94d1-df9755def015 for instance 3dc8004e-69ef-48b7-899e-8d587f1447a0 on n-h1-master-1 Oct 23 02:30:32.436590 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-a522278d-0d59-4335-9fed-53e8e453891b req-ab06c433-7130-4e6d-b5ba-ed3280c6eab9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032330 Oct 23 02:30:32.437194 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3971/8033] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:30:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:30:33.223122 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-00dc0d4d-aa94-4e0a-af74-f309234a9365 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:30:33.223885 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-00dc0d4d-aa94-4e0a-af74-f309234a9365 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 3dc8004e-69ef-48b7-899e-8d587f1447a0] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:30:33.231860 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-00dc0d4d-aa94-4e0a-af74-f309234a9365 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:30:33.236886 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-00dc0d4d-aa94-4e0a-af74-f309234a9365 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:30:33.236886 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-00dc0d4d-aa94-4e0a-af74-f309234a9365 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:30:33.236886 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-00dc0d4d-aa94-4e0a-af74-f309234a9365 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:30:33.236886 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-00dc0d4d-aa94-4e0a-af74-f309234a9365 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:30:33.236886 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-00dc0d4d-aa94-4e0a-af74-f309234a9365 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:30:33.268690 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-00dc0d4d-aa94-4e0a-af74-f309234a9365 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:30:33.269183 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-00dc0d4d-aa94-4e0a-af74-f309234a9365 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:30:33.269664 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-00dc0d4d-aa94-4e0a-af74-f309234a9365 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:30:33.270155 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-00dc0d4d-aa94-4e0a-af74-f309234a9365 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lazy-loading 'fault' on Instance uuid 3dc8004e-69ef-48b7-899e-8d587f1447a0 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:30:33.311118 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-00dc0d4d-aa94-4e0a-af74-f309234a9365 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:30:33.318974 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-00dc0d4d-aa94-4e0a-af74-f309234a9365 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0" status: 200 len: 1357 microversion: 2.1 time: 0.099874 Oct 23 02:30:33.319545 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4063/8034] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:30:33 2022] GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0 => generated 1357 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:30:34.345244 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-893e527f-8355-45c9-853b-154e3d240cda tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:30:34.345962 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-893e527f-8355-45c9-853b-154e3d240cda tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 3dc8004e-69ef-48b7-899e-8d587f1447a0] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:30:34.352882 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-893e527f-8355-45c9-853b-154e3d240cda tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:30:34.353381 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-893e527f-8355-45c9-853b-154e3d240cda tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:30:34.353827 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-893e527f-8355-45c9-853b-154e3d240cda tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:30:34.354813 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-893e527f-8355-45c9-853b-154e3d240cda tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:30:34.355278 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-893e527f-8355-45c9-853b-154e3d240cda tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:30:34.355710 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-893e527f-8355-45c9-853b-154e3d240cda tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:30:34.372347 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-893e527f-8355-45c9-853b-154e3d240cda tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] HTTP exception thrown: Instance 3dc8004e-69ef-48b7-899e-8d587f1447a0 could not be found. Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-893e527f-8355-45c9-853b-154e3d240cda tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Request method failure captured: Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0 HTTP/1.1 Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVKaMnNLl9X4D4-6gAQhVcBZVSSCcOxKFjsbsBxA4f4SIgFOSlWnBMD29f0rryuOIMdqOMvvoKKjQiSMc0ZA1OqQJGW_gUJVqrguR3WAgaWcxKTa_raeB5BxXxfu3Ak4NBM55mUf_VprS-3z9k4IWGvX4m2eUIZUD4Artyeb6HB3QnJs Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 028ee2f0bfd246d0a4abebdcbea26588 Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1311565393 Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/028ee2f0bfd246d0a4abebdcbea26588"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_028ee2f0bfd246d0a4abebdcbea26588"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/028ee2f0bfd246d0a4abebdcbea26588"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/028ee2f0bfd246d0a4abebdcbea26588"}]}] Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1311565393 Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 028ee2f0bfd246d0a4abebdcbea26588 Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1311565393 Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-TestNetworkAdvancedServerOps-1311565393-project Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: e44ce41e0ba0434a91710af395b8af29 Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1311565393-project Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 3dc8004e-69ef-48b7-899e-8d587f1447a0 could not be found. Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '3dc8004e-69ef-48b7-899e-8d587f1447a0'} Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dc8004e-69ef-48b7-899e-8d587f1447a0 could not be found. Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dc8004e-69ef-48b7-899e-8d587f1447a0 could not be found. Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:30:34.374007 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:30:34.379759 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:30:34.379759 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:30:34.379759 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:30:34.379759 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:30:34.379759 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:30:34.379759 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:30:34.379759 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dc8004e-69ef-48b7-899e-8d587f1447a0 could not be found. Oct 23 02:30:34.379759 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:30:34.379759 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-893e527f-8355-45c9-853b-154e3d240cda tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Returning 404 to user: Instance 3dc8004e-69ef-48b7-899e-8d587f1447a0 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:30:34.379759 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-893e527f-8355-45c9-853b-154e3d240cda tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0" status: 404 len: 111 microversion: 2.1 time: 0.035341 Oct 23 02:30:34.379759 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3972/8035] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:30:34 2022] GET /compute/v2.1/servers/3dc8004e-69ef-48b7-899e-8d587f1447a0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:30:37.860130 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b68b75f9-af94-4981-bd22-b9d76871bb6f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '.version_select at 0x7f5cc37e5a60>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:30:37.946790 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b68b75f9-af94-4981-bd22-b9d76871bb6f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2062165392" status: 202 len: 0 microversion: 2.1 time: 0.090507 Oct 23 02:30:37.947408 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4064/8036] 10.222.0.42 () {58 vars in 1284 bytes} [Sun Oct 23 02:30:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2062165392 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:30:37.978374 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-76e469cb-f43f-41c4-b777-768347d84189 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Action: 'create', calling method: .version_select at 0x7f5cc175bdc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1845593031", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFz8sj+ZjY1HsPKlQ6ukyJ8NerLbys74U6IHYOGXs6+Mya5qzg7t37jzCK6dK7ffDM1b9ZldNZArKBqqSJ20gMrf/7188uZG1JFx0wm3XJPdfbK91U4tfOi96rizbYIAlQ=="}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:30:37.994822 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-76e469cb-f43f-41c4-b777-768347d84189 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Getting quotas for project 028ee2f0bfd246d0a4abebdcbea26588. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:30:38.000717 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-76e469cb-f43f-41c4-b777-768347d84189 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Getting quotas for user e44ce41e0ba0434a91710af395b8af29 and project 028ee2f0bfd246d0a4abebdcbea26588. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:30:38.095305 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-76e469cb-f43f-41c4-b777-768347d84189 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.121545 Oct 23 02:30:38.095910 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3973/8037] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 02:30:37 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:30:45.926368 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=26 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:30:45.930515 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a84822d8-cfd8-4332-bbd0-26132e924cd1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-904919285", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "d7b62cd0-e406-44dc-9ca4-d9ea8cac0e65"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1845593031", "security_groups": [{"name": "tempest-secgroup-smoke-1253278019"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:30:46.072292 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-a84822d8-cfd8-4332-bbd0-26132e924cd1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] validate_networks() for [('d7b62cd0-e406-44dc-9ca4-d9ea8cac0e65', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 02:30:46.614815 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-a84822d8-cfd8-4332-bbd0-26132e924cd1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:30:46.622307 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-a84822d8-cfd8-4332-bbd0-26132e924cd1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:30:46.622307 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-a84822d8-cfd8-4332-bbd0-26132e924cd1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:30:46.622307 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-a84822d8-cfd8-4332-bbd0-26132e924cd1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:30:46.622307 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-a84822d8-cfd8-4332-bbd0-26132e924cd1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:30:46.633541 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a84822d8-cfd8-4332-bbd0-26132e924cd1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:30:46.634163 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a84822d8-cfd8-4332-bbd0-26132e924cd1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:30:46.634724 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a84822d8-cfd8-4332-bbd0-26132e924cd1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:30:46.635570 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a84822d8-cfd8-4332-bbd0-26132e924cd1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:30:46.636140 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a84822d8-cfd8-4332-bbd0-26132e924cd1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:30:46.636675 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a84822d8-cfd8-4332-bbd0-26132e924cd1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:30:46.660416 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-a84822d8-cfd8-4332-bbd0-26132e924cd1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Getting quotas for project 028ee2f0bfd246d0a4abebdcbea26588. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:30:46.668271 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-a84822d8-cfd8-4332-bbd0-26132e924cd1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Getting quotas for user e44ce41e0ba0434a91710af395b8af29 and project 028ee2f0bfd246d0a4abebdcbea26588. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:30:46.684847 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a84822d8-cfd8-4332-bbd0-26132e924cd1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 02:30:46.687545 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a84822d8-cfd8-4332-bbd0-26132e924cd1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: c4b51dd0-c877-46c7-aded-56c5198030d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 02:30:46.815792 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a84822d8-cfd8-4332-bbd0-26132e924cd1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.890920 Oct 23 02:30:46.817130 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4065/8038] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 02:30:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 02:30:46.830245 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e5fde80c-a15f-4a2f-b91a-c30b3f59a9e9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:30:46.834022 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e5fde80c-a15f-4a2f-b91a-c30b3f59a9e9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: c4b51dd0-c877-46c7-aded-56c5198030d5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:30:46.844488 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:30:46.914763 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e5fde80c-a15f-4a2f-b91a-c30b3f59a9e9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:30:46.933111 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e5fde80c-a15f-4a2f-b91a-c30b3f59a9e9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5" status: 200 len: 1266 microversion: 2.1 time: 0.107593 Oct 23 02:30:46.935364 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3974/8039] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:30:46 2022] GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5 => generated 1266 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:30:47.958745 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-161888ce-5e9f-42a7-97b1-7d96c77089c6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:30:47.959367 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-161888ce-5e9f-42a7-97b1-7d96c77089c6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: c4b51dd0-c877-46c7-aded-56c5198030d5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:30:47.966635 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-161888ce-5e9f-42a7-97b1-7d96c77089c6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:30:47.967401 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-161888ce-5e9f-42a7-97b1-7d96c77089c6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:30:47.968918 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-161888ce-5e9f-42a7-97b1-7d96c77089c6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:30:47.968918 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-161888ce-5e9f-42a7-97b1-7d96c77089c6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:30:47.969519 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-161888ce-5e9f-42a7-97b1-7d96c77089c6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:30:47.970200 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-161888ce-5e9f-42a7-97b1-7d96c77089c6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:30:48.046516 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-161888ce-5e9f-42a7-97b1-7d96c77089c6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:30:48.056199 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-161888ce-5e9f-42a7-97b1-7d96c77089c6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5" status: 200 len: 1270 microversion: 2.1 time: 0.101863 Oct 23 02:30:48.068292 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4066/8040] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:30:47 2022] GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5 => generated 1270 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:30:49.081171 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-af42b768-eaf0-425c-908a-ab61d95e6387 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:30:49.081773 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-af42b768-eaf0-425c-908a-ab61d95e6387 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: c4b51dd0-c877-46c7-aded-56c5198030d5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:30:49.090313 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-af42b768-eaf0-425c-908a-ab61d95e6387 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:30:49.090809 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-af42b768-eaf0-425c-908a-ab61d95e6387 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:30:49.091257 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-af42b768-eaf0-425c-908a-ab61d95e6387 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:30:49.091953 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-af42b768-eaf0-425c-908a-ab61d95e6387 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:30:49.092417 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-af42b768-eaf0-425c-908a-ab61d95e6387 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:30:49.092852 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-af42b768-eaf0-425c-908a-ab61d95e6387 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:30:49.158675 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-af42b768-eaf0-425c-908a-ab61d95e6387 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:30:49.166463 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-af42b768-eaf0-425c-908a-ab61d95e6387 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5" status: 200 len: 1318 microversion: 2.1 time: 0.089619 Oct 23 02:30:49.167037 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3975/8041] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:30:49 2022] GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5 => generated 1318 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:30:50.190767 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-620198cf-8f38-42a3-977d-507816cc526b tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:30:50.191345 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-620198cf-8f38-42a3-977d-507816cc526b tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: c4b51dd0-c877-46c7-aded-56c5198030d5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:30:50.198497 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-620198cf-8f38-42a3-977d-507816cc526b tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:30:50.198990 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-620198cf-8f38-42a3-977d-507816cc526b tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:30:50.199429 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-620198cf-8f38-42a3-977d-507816cc526b tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:30:50.200177 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-620198cf-8f38-42a3-977d-507816cc526b tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:30:50.200829 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-620198cf-8f38-42a3-977d-507816cc526b tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:30:50.201265 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-620198cf-8f38-42a3-977d-507816cc526b tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:30:50.343388 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-620198cf-8f38-42a3-977d-507816cc526b tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:30:50.351163 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-620198cf-8f38-42a3-977d-507816cc526b tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5" status: 200 len: 1392 microversion: 2.1 time: 0.164669 Oct 23 02:30:50.352609 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4067/8042] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:30:50 2022] GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:30:51.081598 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-aefd70fa-d516-4340-b6a2-f8932021e0b5 req-ce41e50d-c9be-41b9-acc5-6e259a78c1e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4b51dd0-c877-46c7-aded-56c5198030d5", "tag": "c4195e15-7d8d-483f-b85d-ee5a9700751d"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:30:51.092571 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-aefd70fa-d516-4340-b6a2-f8932021e0b5 req-ce41e50d-c9be-41b9-acc5-6e259a78c1e3 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:30:51.093066 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-aefd70fa-d516-4340-b6a2-f8932021e0b5 req-ce41e50d-c9be-41b9-acc5-6e259a78c1e3 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:30:51.093510 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-aefd70fa-d516-4340-b6a2-f8932021e0b5 req-ce41e50d-c9be-41b9-acc5-6e259a78c1e3 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:30:51.106063 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-aefd70fa-d516-4340-b6a2-f8932021e0b5 req-ce41e50d-c9be-41b9-acc5-6e259a78c1e3 service nova] Creating event network-changed:c4195e15-7d8d-483f-b85d-ee5a9700751d for instance c4b51dd0-c877-46c7-aded-56c5198030d5 on n-h2-master-1 Oct 23 02:30:51.111233 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-aefd70fa-d516-4340-b6a2-f8932021e0b5 req-ce41e50d-c9be-41b9-acc5-6e259a78c1e3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033134 Oct 23 02:30:51.111854 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3976/8043] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:30:51.374811 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5f4000ef-17c6-4d70-9c3c-fb3d56858c36 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:30:51.375431 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5f4000ef-17c6-4d70-9c3c-fb3d56858c36 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: c4b51dd0-c877-46c7-aded-56c5198030d5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:30:51.382505 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f4000ef-17c6-4d70-9c3c-fb3d56858c36 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:30:51.382992 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f4000ef-17c6-4d70-9c3c-fb3d56858c36 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:30:51.383429 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f4000ef-17c6-4d70-9c3c-fb3d56858c36 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:30:51.384129 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f4000ef-17c6-4d70-9c3c-fb3d56858c36 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:30:51.384581 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f4000ef-17c6-4d70-9c3c-fb3d56858c36 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:30:51.385005 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5f4000ef-17c6-4d70-9c3c-fb3d56858c36 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:30:51.522499 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5f4000ef-17c6-4d70-9c3c-fb3d56858c36 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:30:51.530512 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5f4000ef-17c6-4d70-9c3c-fb3d56858c36 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5" status: 200 len: 1392 microversion: 2.1 time: 0.159637 Oct 23 02:30:51.531139 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4068/8044] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:30:51 2022] GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:30:52.556815 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d30d05fd-ac65-4383-b632-055a9dc5ba8a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:30:52.557530 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d30d05fd-ac65-4383-b632-055a9dc5ba8a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: c4b51dd0-c877-46c7-aded-56c5198030d5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:30:52.563820 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d30d05fd-ac65-4383-b632-055a9dc5ba8a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:30:52.564316 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d30d05fd-ac65-4383-b632-055a9dc5ba8a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:30:52.564772 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d30d05fd-ac65-4383-b632-055a9dc5ba8a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:30:52.565470 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d30d05fd-ac65-4383-b632-055a9dc5ba8a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:30:52.565939 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d30d05fd-ac65-4383-b632-055a9dc5ba8a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:30:52.566403 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d30d05fd-ac65-4383-b632-055a9dc5ba8a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:30:52.696603 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d30d05fd-ac65-4383-b632-055a9dc5ba8a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:30:52.704359 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d30d05fd-ac65-4383-b632-055a9dc5ba8a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5" status: 200 len: 1392 microversion: 2.1 time: 0.153414 Oct 23 02:30:52.706586 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3977/8045] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:30:52 2022] GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5 => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:30:53.727589 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3aa42a28-20ec-49c8-86dd-b8db472236f1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:30:53.728208 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3aa42a28-20ec-49c8-86dd-b8db472236f1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: c4b51dd0-c877-46c7-aded-56c5198030d5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:30:53.730982 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:30:53.735772 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3aa42a28-20ec-49c8-86dd-b8db472236f1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:30:53.736254 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3aa42a28-20ec-49c8-86dd-b8db472236f1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:30:53.736693 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3aa42a28-20ec-49c8-86dd-b8db472236f1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:30:53.737382 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3aa42a28-20ec-49c8-86dd-b8db472236f1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:30:53.737837 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3aa42a28-20ec-49c8-86dd-b8db472236f1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:30:53.738286 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3aa42a28-20ec-49c8-86dd-b8db472236f1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:30:53.868492 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3aa42a28-20ec-49c8-86dd-b8db472236f1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:30:53.876210 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3aa42a28-20ec-49c8-86dd-b8db472236f1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5" status: 200 len: 1392 microversion: 2.1 time: 0.152644 Oct 23 02:30:53.876783 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4069/8046] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:30:53 2022] GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5 => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:30:54.900500 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8b7c7658-4507-4077-8113-5d4a1aa39189 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:30:54.901056 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8b7c7658-4507-4077-8113-5d4a1aa39189 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: c4b51dd0-c877-46c7-aded-56c5198030d5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:30:54.907982 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b7c7658-4507-4077-8113-5d4a1aa39189 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:30:54.908483 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b7c7658-4507-4077-8113-5d4a1aa39189 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:30:54.908937 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b7c7658-4507-4077-8113-5d4a1aa39189 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:30:54.909645 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b7c7658-4507-4077-8113-5d4a1aa39189 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:30:54.910154 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b7c7658-4507-4077-8113-5d4a1aa39189 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:30:54.910600 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b7c7658-4507-4077-8113-5d4a1aa39189 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:30:55.044406 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8b7c7658-4507-4077-8113-5d4a1aa39189 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:30:55.052160 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8b7c7658-4507-4077-8113-5d4a1aa39189 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5" status: 200 len: 1392 microversion: 2.1 time: 0.156334 Oct 23 02:30:55.052740 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3978/8047] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:30:54 2022] GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:30:56.076137 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-26d7768d-169f-4ba9-9356-be4d11de2c04 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:30:56.076889 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-26d7768d-169f-4ba9-9356-be4d11de2c04 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: c4b51dd0-c877-46c7-aded-56c5198030d5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:30:56.083831 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-26d7768d-169f-4ba9-9356-be4d11de2c04 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:30:56.084324 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-26d7768d-169f-4ba9-9356-be4d11de2c04 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:30:56.084770 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-26d7768d-169f-4ba9-9356-be4d11de2c04 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:30:56.085475 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-26d7768d-169f-4ba9-9356-be4d11de2c04 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:30:56.085940 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-26d7768d-169f-4ba9-9356-be4d11de2c04 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:30:56.086955 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-26d7768d-169f-4ba9-9356-be4d11de2c04 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:30:56.221030 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-26d7768d-169f-4ba9-9356-be4d11de2c04 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:30:56.229418 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-26d7768d-169f-4ba9-9356-be4d11de2c04 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5" status: 200 len: 1392 microversion: 2.1 time: 0.157302 Oct 23 02:30:56.230283 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4070/8048] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:30:56 2022] GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:30:57.252619 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0feff5f4-7d97-44aa-923b-bba4e888d2ce tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:30:57.253158 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0feff5f4-7d97-44aa-923b-bba4e888d2ce tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: c4b51dd0-c877-46c7-aded-56c5198030d5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:30:57.256033 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=6 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:30:57.260856 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0feff5f4-7d97-44aa-923b-bba4e888d2ce tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:30:57.261358 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0feff5f4-7d97-44aa-923b-bba4e888d2ce tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:30:57.261805 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0feff5f4-7d97-44aa-923b-bba4e888d2ce tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:30:57.262555 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0feff5f4-7d97-44aa-923b-bba4e888d2ce tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:30:57.263016 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0feff5f4-7d97-44aa-923b-bba4e888d2ce tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:30:57.268465 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0feff5f4-7d97-44aa-923b-bba4e888d2ce tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:30:57.399444 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0feff5f4-7d97-44aa-923b-bba4e888d2ce tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:30:57.407519 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0feff5f4-7d97-44aa-923b-bba4e888d2ce tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5" status: 200 len: 1392 microversion: 2.1 time: 0.158974 Oct 23 02:30:57.411372 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3979/8049] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:30:57 2022] GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:30:57.597905 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:30:57.598708 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=6 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:30:57.654604 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-98666c72-3e61-476c-94fb-7a3b3bf1ae70 req-cae8a04e-52c9-45ae-b0c4-6892148927bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4b51dd0-c877-46c7-aded-56c5198030d5", "name": "network-vif-plugged", "status": "completed", "tag": "c4195e15-7d8d-483f-b85d-ee5a9700751d"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:30:57.664139 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-98666c72-3e61-476c-94fb-7a3b3bf1ae70 req-cae8a04e-52c9-45ae-b0c4-6892148927bb service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:30:57.665232 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-98666c72-3e61-476c-94fb-7a3b3bf1ae70 req-cae8a04e-52c9-45ae-b0c4-6892148927bb service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:30:57.665695 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-98666c72-3e61-476c-94fb-7a3b3bf1ae70 req-cae8a04e-52c9-45ae-b0c4-6892148927bb service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:30:57.677146 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-98666c72-3e61-476c-94fb-7a3b3bf1ae70 req-cae8a04e-52c9-45ae-b0c4-6892148927bb service nova] Creating event network-vif-plugged:c4195e15-7d8d-483f-b85d-ee5a9700751d for instance c4b51dd0-c877-46c7-aded-56c5198030d5 on n-h2-master-1 Oct 23 02:30:57.682336 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-98666c72-3e61-476c-94fb-7a3b3bf1ae70 req-cae8a04e-52c9-45ae-b0c4-6892148927bb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088874 Oct 23 02:30:57.682933 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4071/8050] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:30:58.431676 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1a8a616e-088e-4815-a0d4-ebb4fbfd427c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:30:58.432301 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1a8a616e-088e-4815-a0d4-ebb4fbfd427c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: c4b51dd0-c877-46c7-aded-56c5198030d5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:30:58.439241 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1a8a616e-088e-4815-a0d4-ebb4fbfd427c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:30:58.439732 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1a8a616e-088e-4815-a0d4-ebb4fbfd427c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:30:58.440174 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1a8a616e-088e-4815-a0d4-ebb4fbfd427c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:30:58.440862 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1a8a616e-088e-4815-a0d4-ebb4fbfd427c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:30:58.441326 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1a8a616e-088e-4815-a0d4-ebb4fbfd427c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:30:58.441760 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1a8a616e-088e-4815-a0d4-ebb4fbfd427c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:30:58.574047 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1a8a616e-088e-4815-a0d4-ebb4fbfd427c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:30:58.581637 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1a8a616e-088e-4815-a0d4-ebb4fbfd427c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5" status: 200 len: 1392 microversion: 2.1 time: 0.154418 Oct 23 02:30:58.582261 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3980/8051] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:30:58 2022] GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:30:59.607305 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9f2aca33-c2d9-4b11-a4ca-7b1c7c803c57 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:30:59.608072 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9f2aca33-c2d9-4b11-a4ca-7b1c7c803c57 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: c4b51dd0-c877-46c7-aded-56c5198030d5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:30:59.614812 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f2aca33-c2d9-4b11-a4ca-7b1c7c803c57 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:30:59.615304 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f2aca33-c2d9-4b11-a4ca-7b1c7c803c57 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:30:59.615748 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f2aca33-c2d9-4b11-a4ca-7b1c7c803c57 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:30:59.616439 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f2aca33-c2d9-4b11-a4ca-7b1c7c803c57 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:30:59.616903 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f2aca33-c2d9-4b11-a4ca-7b1c7c803c57 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:30:59.617826 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f2aca33-c2d9-4b11-a4ca-7b1c7c803c57 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:30:59.747906 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9f2aca33-c2d9-4b11-a4ca-7b1c7c803c57 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:30:59.755761 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9f2aca33-c2d9-4b11-a4ca-7b1c7c803c57 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5" status: 200 len: 1565 microversion: 2.1 time: 0.154712 Oct 23 02:30:59.756330 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4072/8052] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:30:59 2022] GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5 => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:30:59.778671 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-688be428-f66b-4819-a88c-bdc7b6ec9716 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:30:59.779328 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-688be428-f66b-4819-a88c-bdc7b6ec9716 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: c4b51dd0-c877-46c7-aded-56c5198030d5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:30:59.782047 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:30:59.786699 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-688be428-f66b-4819-a88c-bdc7b6ec9716 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:30:59.787198 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-688be428-f66b-4819-a88c-bdc7b6ec9716 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:30:59.787646 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-688be428-f66b-4819-a88c-bdc7b6ec9716 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:30:59.788411 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-688be428-f66b-4819-a88c-bdc7b6ec9716 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:30:59.788889 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-688be428-f66b-4819-a88c-bdc7b6ec9716 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:30:59.789352 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-688be428-f66b-4819-a88c-bdc7b6ec9716 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:30:59.923805 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-688be428-f66b-4819-a88c-bdc7b6ec9716 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:30:59.931998 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-688be428-f66b-4819-a88c-bdc7b6ec9716 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5" status: 200 len: 1565 microversion: 2.1 time: 0.157295 Oct 23 02:30:59.932577 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3981/8053] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:30:59 2022] GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5 => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:31:02.092411 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-d2def07d-f498-4aea-8c48-b0e567a5b4bb req-f1e058be-82db-420a-b4cd-07163d19b460 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4b51dd0-c877-46c7-aded-56c5198030d5", "tag": "c4195e15-7d8d-483f-b85d-ee5a9700751d"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:31:02.096560 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1de0e64a-b892-475a-9e7e-707e229f0bf3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:31:02.097224 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1de0e64a-b892-475a-9e7e-707e229f0bf3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: c4b51dd0-c877-46c7-aded-56c5198030d5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:31:02.105631 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1de0e64a-b892-475a-9e7e-707e229f0bf3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:31:02.106172 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1de0e64a-b892-475a-9e7e-707e229f0bf3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:31:02.106705 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1de0e64a-b892-475a-9e7e-707e229f0bf3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:31:02.107572 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1de0e64a-b892-475a-9e7e-707e229f0bf3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:31:02.108042 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1de0e64a-b892-475a-9e7e-707e229f0bf3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:31:02.108481 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1de0e64a-b892-475a-9e7e-707e229f0bf3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:31:02.111660 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-d2def07d-f498-4aea-8c48-b0e567a5b4bb req-f1e058be-82db-420a-b4cd-07163d19b460 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:31:02.112156 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-d2def07d-f498-4aea-8c48-b0e567a5b4bb req-f1e058be-82db-420a-b4cd-07163d19b460 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:31:02.112599 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-d2def07d-f498-4aea-8c48-b0e567a5b4bb req-f1e058be-82db-420a-b4cd-07163d19b460 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:31:02.124457 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-d2def07d-f498-4aea-8c48-b0e567a5b4bb req-f1e058be-82db-420a-b4cd-07163d19b460 service nova] Creating event network-changed:c4195e15-7d8d-483f-b85d-ee5a9700751d for instance c4b51dd0-c877-46c7-aded-56c5198030d5 on n-h2-master-1 Oct 23 02:31:02.129591 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-d2def07d-f498-4aea-8c48-b0e567a5b4bb req-f1e058be-82db-420a-b4cd-07163d19b460 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041123 Oct 23 02:31:02.130420 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3982/8054] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:31:02.247418 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1de0e64a-b892-475a-9e7e-707e229f0bf3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:31:02.256213 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1de0e64a-b892-475a-9e7e-707e229f0bf3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5" status: 200 len: 1565 microversion: 2.1 time: 0.170516 Oct 23 02:31:02.257331 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4073/8055] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:31:02 2022] GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5 => generated 1565 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:31:25.509930 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=3 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:31:25.514492 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=40 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:31:25.514956 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-befb82f2-e95b-4594-b539-63a0d536eab5 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:31:25.517235 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-befb82f2-e95b-4594-b539-63a0d536eab5 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: c4b51dd0-c877-46c7-aded-56c5198030d5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:31:25.523286 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-befb82f2-e95b-4594-b539-63a0d536eab5 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:31:25.523790 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-befb82f2-e95b-4594-b539-63a0d536eab5 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:31:25.524267 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-befb82f2-e95b-4594-b539-63a0d536eab5 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:31:25.524975 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-befb82f2-e95b-4594-b539-63a0d536eab5 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:31:25.525448 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-befb82f2-e95b-4594-b539-63a0d536eab5 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:31:25.525889 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-befb82f2-e95b-4594-b539-63a0d536eab5 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:31:25.593890 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-befb82f2-e95b-4594-b539-63a0d536eab5 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "POST /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5/action" status: 200 len: 24564 microversion: 2.1 time: 0.085764 Oct 23 02:31:25.594823 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3983/8056] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:31:25 2022] POST /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5/action => generated 24564 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 02:31:36.509633 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4a72abcb-7bfc-4d53-a2b2-1aabdafad04e tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:31:36.512045 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4a72abcb-7bfc-4d53-a2b2-1aabdafad04e tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: c4b51dd0-c877-46c7-aded-56c5198030d5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:31:36.515143 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=9 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:31:36.515807 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=46 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:31:36.520580 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4a72abcb-7bfc-4d53-a2b2-1aabdafad04e tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:31:36.521071 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4a72abcb-7bfc-4d53-a2b2-1aabdafad04e tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:31:36.521513 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4a72abcb-7bfc-4d53-a2b2-1aabdafad04e tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:31:36.522237 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4a72abcb-7bfc-4d53-a2b2-1aabdafad04e tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:31:36.522697 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4a72abcb-7bfc-4d53-a2b2-1aabdafad04e tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:31:36.529067 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4a72abcb-7bfc-4d53-a2b2-1aabdafad04e tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:31:36.563441 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4a72abcb-7bfc-4d53-a2b2-1aabdafad04e tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:31:36.569638 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4a72abcb-7bfc-4d53-a2b2-1aabdafad04e tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: c4b51dd0-c877-46c7-aded-56c5198030d5] Old instance type m1.heat2, new instance type m1.heat {{(pid=120944) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 23 02:31:36.577325 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-4a72abcb-7bfc-4d53-a2b2-1aabdafad04e tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:31:36.577749 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-4a72abcb-7bfc-4d53-a2b2-1aabdafad04e tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:31:36.578251 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-4a72abcb-7bfc-4d53-a2b2-1aabdafad04e tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:31:36.578663 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-4a72abcb-7bfc-4d53-a2b2-1aabdafad04e tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:31:36.579087 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-4a72abcb-7bfc-4d53-a2b2-1aabdafad04e tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:31:36.772247 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4a72abcb-7bfc-4d53-a2b2-1aabdafad04e tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "POST /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5/action" status: 202 len: 0 microversion: 2.1 time: 0.266408 Oct 23 02:31:36.772791 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4074/8057] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:31:36 2022] POST /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:31:36.782360 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1ed1b40b-4081-4806-b0c0-38bd46866421 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:31:36.783079 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1ed1b40b-4081-4806-b0c0-38bd46866421 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: c4b51dd0-c877-46c7-aded-56c5198030d5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:31:36.785629 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:31:36.786318 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=4 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:31:36.791295 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1ed1b40b-4081-4806-b0c0-38bd46866421 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:31:36.791801 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1ed1b40b-4081-4806-b0c0-38bd46866421 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:31:36.792254 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1ed1b40b-4081-4806-b0c0-38bd46866421 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:31:36.792969 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1ed1b40b-4081-4806-b0c0-38bd46866421 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:31:36.793432 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1ed1b40b-4081-4806-b0c0-38bd46866421 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:31:36.793868 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1ed1b40b-4081-4806-b0c0-38bd46866421 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:31:36.927429 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1ed1b40b-4081-4806-b0c0-38bd46866421 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:31:36.935153 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1ed1b40b-4081-4806-b0c0-38bd46866421 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5" status: 200 len: 1693 microversion: 2.1 time: 0.157845 Oct 23 02:31:36.942735 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3984/8058] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:31:36 2022] GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5 => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:31:37.960472 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-57c1b315-0ae0-4028-9b32-8fb5c4299f48 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:31:37.961204 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-57c1b315-0ae0-4028-9b32-8fb5c4299f48 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: c4b51dd0-c877-46c7-aded-56c5198030d5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:31:37.968211 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-57c1b315-0ae0-4028-9b32-8fb5c4299f48 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:31:37.968709 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-57c1b315-0ae0-4028-9b32-8fb5c4299f48 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:31:37.969152 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-57c1b315-0ae0-4028-9b32-8fb5c4299f48 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:31:37.969853 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-57c1b315-0ae0-4028-9b32-8fb5c4299f48 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:31:37.970350 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-57c1b315-0ae0-4028-9b32-8fb5c4299f48 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:31:37.970783 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-57c1b315-0ae0-4028-9b32-8fb5c4299f48 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:31:38.099928 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-57c1b315-0ae0-4028-9b32-8fb5c4299f48 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:31:38.108534 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-57c1b315-0ae0-4028-9b32-8fb5c4299f48 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5" status: 200 len: 1693 microversion: 2.1 time: 0.152943 Oct 23 02:31:38.109111 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4075/8059] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:31:37 2022] GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5 => generated 1693 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:31:39.132754 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5e54fd2c-fb54-4100-86d1-35130e649f46 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:31:39.133414 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5e54fd2c-fb54-4100-86d1-35130e649f46 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: c4b51dd0-c877-46c7-aded-56c5198030d5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:31:39.140889 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e54fd2c-fb54-4100-86d1-35130e649f46 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:31:39.145000 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e54fd2c-fb54-4100-86d1-35130e649f46 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:31:39.145000 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e54fd2c-fb54-4100-86d1-35130e649f46 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:31:39.145000 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e54fd2c-fb54-4100-86d1-35130e649f46 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:31:39.145000 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e54fd2c-fb54-4100-86d1-35130e649f46 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:31:39.145000 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5e54fd2c-fb54-4100-86d1-35130e649f46 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:31:39.276277 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-5e54fd2c-fb54-4100-86d1-35130e649f46 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:31:39.284068 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5e54fd2c-fb54-4100-86d1-35130e649f46 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5" status: 200 len: 1693 microversion: 2.1 time: 0.155305 Oct 23 02:31:39.284639 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3985/8060] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:31:39 2022] GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5 => generated 1693 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:31:40.307240 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-13fab7e1-fd32-4767-b7cc-22f69d0187b4 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:31:40.307987 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-13fab7e1-fd32-4767-b7cc-22f69d0187b4 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: c4b51dd0-c877-46c7-aded-56c5198030d5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:31:40.314839 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13fab7e1-fd32-4767-b7cc-22f69d0187b4 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:31:40.315337 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13fab7e1-fd32-4767-b7cc-22f69d0187b4 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:31:40.315788 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13fab7e1-fd32-4767-b7cc-22f69d0187b4 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:31:40.316489 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13fab7e1-fd32-4767-b7cc-22f69d0187b4 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:31:40.316957 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13fab7e1-fd32-4767-b7cc-22f69d0187b4 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:31:40.317396 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-13fab7e1-fd32-4767-b7cc-22f69d0187b4 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:31:40.453171 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-13fab7e1-fd32-4767-b7cc-22f69d0187b4 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:31:40.461002 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-13fab7e1-fd32-4767-b7cc-22f69d0187b4 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5" status: 200 len: 1693 microversion: 2.1 time: 0.157730 Oct 23 02:31:40.461590 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4076/8061] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:31:40 2022] GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5 => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:31:41.486519 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9b5689c7-168a-4f7f-aad9-69f7845d0b85 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:31:41.487155 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9b5689c7-168a-4f7f-aad9-69f7845d0b85 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: c4b51dd0-c877-46c7-aded-56c5198030d5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:31:41.494031 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b5689c7-168a-4f7f-aad9-69f7845d0b85 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:31:41.494537 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b5689c7-168a-4f7f-aad9-69f7845d0b85 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:31:41.494988 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b5689c7-168a-4f7f-aad9-69f7845d0b85 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:31:41.495695 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b5689c7-168a-4f7f-aad9-69f7845d0b85 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:31:41.496165 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b5689c7-168a-4f7f-aad9-69f7845d0b85 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:31:41.497213 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9b5689c7-168a-4f7f-aad9-69f7845d0b85 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:31:41.630357 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9b5689c7-168a-4f7f-aad9-69f7845d0b85 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:31:41.638942 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9b5689c7-168a-4f7f-aad9-69f7845d0b85 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5" status: 200 len: 1698 microversion: 2.1 time: 0.156370 Oct 23 02:31:41.639516 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3986/8062] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:31:41 2022] GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5 => generated 1698 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:31:42.662879 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-12117ce3-8347-4c2b-b02e-814830a907ba tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:31:42.663497 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-12117ce3-8347-4c2b-b02e-814830a907ba tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: c4b51dd0-c877-46c7-aded-56c5198030d5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:31:42.670316 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-12117ce3-8347-4c2b-b02e-814830a907ba tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:31:42.670802 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-12117ce3-8347-4c2b-b02e-814830a907ba tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:31:42.671240 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-12117ce3-8347-4c2b-b02e-814830a907ba tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:31:42.671921 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-12117ce3-8347-4c2b-b02e-814830a907ba tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:31:42.672374 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-12117ce3-8347-4c2b-b02e-814830a907ba tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:31:42.672796 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-12117ce3-8347-4c2b-b02e-814830a907ba tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:31:42.802811 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-12117ce3-8347-4c2b-b02e-814830a907ba tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:31:42.810599 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-12117ce3-8347-4c2b-b02e-814830a907ba tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5" status: 200 len: 1698 microversion: 2.1 time: 0.151704 Oct 23 02:31:42.811175 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4077/8063] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:31:42 2022] GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5 => generated 1698 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:31:43.835014 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2863f203-5272-48b6-8ca4-e3085b5eadf3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:31:43.835571 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2863f203-5272-48b6-8ca4-e3085b5eadf3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: c4b51dd0-c877-46c7-aded-56c5198030d5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:31:43.842858 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2863f203-5272-48b6-8ca4-e3085b5eadf3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:31:43.843358 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2863f203-5272-48b6-8ca4-e3085b5eadf3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:31:43.843808 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2863f203-5272-48b6-8ca4-e3085b5eadf3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:31:43.844507 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2863f203-5272-48b6-8ca4-e3085b5eadf3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:31:43.844971 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2863f203-5272-48b6-8ca4-e3085b5eadf3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:31:43.845409 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2863f203-5272-48b6-8ca4-e3085b5eadf3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:31:43.975533 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-2863f203-5272-48b6-8ca4-e3085b5eadf3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:31:43.984134 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2863f203-5272-48b6-8ca4-e3085b5eadf3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5" status: 200 len: 1698 microversion: 2.1 time: 0.153147 Oct 23 02:31:43.984707 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3987/8064] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:31:43 2022] GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5 => generated 1698 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:31:45.007649 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8fd318b3-bc48-4bbb-a547-1a3140744a88 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:31:45.008269 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8fd318b3-bc48-4bbb-a547-1a3140744a88 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: c4b51dd0-c877-46c7-aded-56c5198030d5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:31:45.015217 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8fd318b3-bc48-4bbb-a547-1a3140744a88 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:31:45.015703 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8fd318b3-bc48-4bbb-a547-1a3140744a88 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:31:45.016139 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8fd318b3-bc48-4bbb-a547-1a3140744a88 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:31:45.016827 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8fd318b3-bc48-4bbb-a547-1a3140744a88 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:31:45.017285 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8fd318b3-bc48-4bbb-a547-1a3140744a88 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:31:45.017709 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8fd318b3-bc48-4bbb-a547-1a3140744a88 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:31:45.152650 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8fd318b3-bc48-4bbb-a547-1a3140744a88 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:31:45.160391 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8fd318b3-bc48-4bbb-a547-1a3140744a88 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5" status: 200 len: 1698 microversion: 2.1 time: 0.156669 Oct 23 02:31:45.160964 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4078/8065] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:31:45 2022] GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5 => generated 1698 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:31:46.184224 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ea052fa1-239d-4fb3-82ca-8fe4604dfc24 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:31:46.184846 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ea052fa1-239d-4fb3-82ca-8fe4604dfc24 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: c4b51dd0-c877-46c7-aded-56c5198030d5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:31:46.192119 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ea052fa1-239d-4fb3-82ca-8fe4604dfc24 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:31:46.192617 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ea052fa1-239d-4fb3-82ca-8fe4604dfc24 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:31:46.193064 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ea052fa1-239d-4fb3-82ca-8fe4604dfc24 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:31:46.193758 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ea052fa1-239d-4fb3-82ca-8fe4604dfc24 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:31:46.194245 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ea052fa1-239d-4fb3-82ca-8fe4604dfc24 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:31:46.194692 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ea052fa1-239d-4fb3-82ca-8fe4604dfc24 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:31:46.324071 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ea052fa1-239d-4fb3-82ca-8fe4604dfc24 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:31:46.332381 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ea052fa1-239d-4fb3-82ca-8fe4604dfc24 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5" status: 200 len: 1698 microversion: 2.1 time: 0.152068 Oct 23 02:31:46.332951 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3988/8066] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:31:46 2022] GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5 => generated 1698 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:31:47.355177 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-84f14d9f-5cc6-4707-9272-df7121a6befb tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:31:47.356071 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-84f14d9f-5cc6-4707-9272-df7121a6befb tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: c4b51dd0-c877-46c7-aded-56c5198030d5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:31:47.363091 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-84f14d9f-5cc6-4707-9272-df7121a6befb tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:31:47.363585 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-84f14d9f-5cc6-4707-9272-df7121a6befb tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:31:47.364034 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-84f14d9f-5cc6-4707-9272-df7121a6befb tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:31:47.364740 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-84f14d9f-5cc6-4707-9272-df7121a6befb tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:31:47.365200 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-84f14d9f-5cc6-4707-9272-df7121a6befb tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:31:47.365635 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-84f14d9f-5cc6-4707-9272-df7121a6befb tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:31:47.503769 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-84f14d9f-5cc6-4707-9272-df7121a6befb tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:31:47.511760 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-84f14d9f-5cc6-4707-9272-df7121a6befb tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5" status: 200 len: 1698 microversion: 2.1 time: 0.160606 Oct 23 02:31:47.512356 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4079/8067] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:31:47 2022] GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5 => generated 1698 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:31:48.535947 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-befc8d19-42f9-4341-9c22-992f4b91a0a0 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:31:48.536580 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-befc8d19-42f9-4341-9c22-992f4b91a0a0 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: c4b51dd0-c877-46c7-aded-56c5198030d5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:31:48.543654 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-befc8d19-42f9-4341-9c22-992f4b91a0a0 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:31:48.544151 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-befc8d19-42f9-4341-9c22-992f4b91a0a0 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:31:48.544597 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-befc8d19-42f9-4341-9c22-992f4b91a0a0 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:31:48.545289 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-befc8d19-42f9-4341-9c22-992f4b91a0a0 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:31:48.545759 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-befc8d19-42f9-4341-9c22-992f4b91a0a0 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:31:48.546222 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-befc8d19-42f9-4341-9c22-992f4b91a0a0 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:31:48.678713 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-befc8d19-42f9-4341-9c22-992f4b91a0a0 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:31:48.687099 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-befc8d19-42f9-4341-9c22-992f4b91a0a0 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5" status: 200 len: 1698 microversion: 2.1 time: 0.155071 Oct 23 02:31:48.687698 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3989/8068] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:31:48 2022] GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5 => generated 1698 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:31:49.710814 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-15fb5b53-5bd5-48a7-85bb-0add3ba373c8 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:31:49.711444 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-15fb5b53-5bd5-48a7-85bb-0add3ba373c8 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: c4b51dd0-c877-46c7-aded-56c5198030d5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:31:49.718503 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15fb5b53-5bd5-48a7-85bb-0add3ba373c8 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:31:49.718999 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15fb5b53-5bd5-48a7-85bb-0add3ba373c8 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:31:49.719449 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15fb5b53-5bd5-48a7-85bb-0add3ba373c8 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:31:49.720151 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15fb5b53-5bd5-48a7-85bb-0add3ba373c8 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:31:49.720622 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15fb5b53-5bd5-48a7-85bb-0add3ba373c8 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:31:49.721055 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-15fb5b53-5bd5-48a7-85bb-0add3ba373c8 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:31:49.851600 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-15fb5b53-5bd5-48a7-85bb-0add3ba373c8 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:31:49.859842 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-15fb5b53-5bd5-48a7-85bb-0add3ba373c8 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5" status: 200 len: 1698 microversion: 2.1 time: 0.153105 Oct 23 02:31:49.860432 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4080/8069] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:31:49 2022] GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5 => generated 1698 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:31:50.884704 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-34beb343-0000-4518-9443-f1d2465e1654 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:31:50.885250 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-34beb343-0000-4518-9443-f1d2465e1654 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: c4b51dd0-c877-46c7-aded-56c5198030d5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:31:50.892722 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-34beb343-0000-4518-9443-f1d2465e1654 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:31:50.893227 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-34beb343-0000-4518-9443-f1d2465e1654 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:31:50.893664 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-34beb343-0000-4518-9443-f1d2465e1654 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:31:50.894398 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-34beb343-0000-4518-9443-f1d2465e1654 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:31:50.894863 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-34beb343-0000-4518-9443-f1d2465e1654 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:31:50.895293 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-34beb343-0000-4518-9443-f1d2465e1654 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:31:51.028343 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-34beb343-0000-4518-9443-f1d2465e1654 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:31:51.036695 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-34beb343-0000-4518-9443-f1d2465e1654 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5" status: 200 len: 1698 microversion: 2.1 time: 0.156000 Oct 23 02:31:51.037274 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3990/8070] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:31:50 2022] GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5 => generated 1698 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:31:52.059771 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c832b38e-fc21-48ff-94e8-20677fa9683c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:31:52.060887 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c832b38e-fc21-48ff-94e8-20677fa9683c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: c4b51dd0-c877-46c7-aded-56c5198030d5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:31:52.067960 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c832b38e-fc21-48ff-94e8-20677fa9683c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:31:52.068462 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c832b38e-fc21-48ff-94e8-20677fa9683c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:31:52.068907 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c832b38e-fc21-48ff-94e8-20677fa9683c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:31:52.069622 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c832b38e-fc21-48ff-94e8-20677fa9683c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:31:52.070100 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c832b38e-fc21-48ff-94e8-20677fa9683c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:31:52.070537 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c832b38e-fc21-48ff-94e8-20677fa9683c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:31:52.200832 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c832b38e-fc21-48ff-94e8-20677fa9683c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:31:52.209504 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c832b38e-fc21-48ff-94e8-20677fa9683c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5" status: 200 len: 1698 microversion: 2.1 time: 0.153895 Oct 23 02:31:52.210107 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4081/8071] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:31:52 2022] GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5 => generated 1698 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:31:53.233113 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ae78e11c-a796-4506-88e7-ae288e3a5d20 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:31:53.233751 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ae78e11c-a796-4506-88e7-ae288e3a5d20 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: c4b51dd0-c877-46c7-aded-56c5198030d5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:31:53.240799 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ae78e11c-a796-4506-88e7-ae288e3a5d20 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:31:53.241291 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ae78e11c-a796-4506-88e7-ae288e3a5d20 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:31:53.241744 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ae78e11c-a796-4506-88e7-ae288e3a5d20 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:31:53.242483 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ae78e11c-a796-4506-88e7-ae288e3a5d20 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:31:53.242954 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ae78e11c-a796-4506-88e7-ae288e3a5d20 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:31:53.243394 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ae78e11c-a796-4506-88e7-ae288e3a5d20 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:31:53.376781 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ae78e11c-a796-4506-88e7-ae288e3a5d20 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:31:53.384670 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ae78e11c-a796-4506-88e7-ae288e3a5d20 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5" status: 200 len: 1698 microversion: 2.1 time: 0.155845 Oct 23 02:31:53.385239 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3991/8072] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:31:53 2022] GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5 => generated 1698 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:31:54.409125 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-93dc1b70-65f4-4e51-b62c-75283f8005e8 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:31:54.409749 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-93dc1b70-65f4-4e51-b62c-75283f8005e8 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: c4b51dd0-c877-46c7-aded-56c5198030d5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:31:54.416275 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-93dc1b70-65f4-4e51-b62c-75283f8005e8 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:31:54.416766 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-93dc1b70-65f4-4e51-b62c-75283f8005e8 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:31:54.417211 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-93dc1b70-65f4-4e51-b62c-75283f8005e8 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:31:54.417905 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-93dc1b70-65f4-4e51-b62c-75283f8005e8 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:31:54.418390 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-93dc1b70-65f4-4e51-b62c-75283f8005e8 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:31:54.418821 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-93dc1b70-65f4-4e51-b62c-75283f8005e8 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:31:54.552524 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-93dc1b70-65f4-4e51-b62c-75283f8005e8 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:31:54.560318 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-93dc1b70-65f4-4e51-b62c-75283f8005e8 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5" status: 200 len: 1698 microversion: 2.1 time: 0.155877 Oct 23 02:31:54.560895 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4082/8073] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:31:54 2022] GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5 => generated 1698 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:31:55.584036 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-966dd714-b186-40af-9eec-291e81c982d6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:31:55.584676 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-966dd714-b186-40af-9eec-291e81c982d6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: c4b51dd0-c877-46c7-aded-56c5198030d5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:31:55.591595 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-966dd714-b186-40af-9eec-291e81c982d6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:31:55.593322 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-966dd714-b186-40af-9eec-291e81c982d6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:31:55.593322 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-966dd714-b186-40af-9eec-291e81c982d6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:31:55.593841 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-966dd714-b186-40af-9eec-291e81c982d6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:31:55.594346 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-966dd714-b186-40af-9eec-291e81c982d6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:31:55.594813 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-966dd714-b186-40af-9eec-291e81c982d6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:31:55.731367 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-966dd714-b186-40af-9eec-291e81c982d6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:31:55.739190 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-966dd714-b186-40af-9eec-291e81c982d6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5" status: 200 len: 1698 microversion: 2.1 time: 0.159063 Oct 23 02:31:55.739709 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3992/8074] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:31:55 2022] GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5 => generated 1698 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:31:56.763528 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1cb76516-4d17-4474-9559-73d5154c0e55 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:31:56.764058 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1cb76516-4d17-4474-9559-73d5154c0e55 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: c4b51dd0-c877-46c7-aded-56c5198030d5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:31:56.770927 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1cb76516-4d17-4474-9559-73d5154c0e55 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:31:56.771421 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1cb76516-4d17-4474-9559-73d5154c0e55 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:31:56.771864 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1cb76516-4d17-4474-9559-73d5154c0e55 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:31:56.772556 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1cb76516-4d17-4474-9559-73d5154c0e55 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:31:56.773019 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1cb76516-4d17-4474-9559-73d5154c0e55 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:31:56.773445 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1cb76516-4d17-4474-9559-73d5154c0e55 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:31:56.905464 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1cb76516-4d17-4474-9559-73d5154c0e55 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:31:56.913256 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1cb76516-4d17-4474-9559-73d5154c0e55 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5" status: 200 len: 1698 microversion: 2.1 time: 0.153800 Oct 23 02:31:56.913838 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4083/8075] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:31:56 2022] GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5 => generated 1698 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:31:57.937475 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0643e657-ef1f-4568-898f-0b71c470e78c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:31:57.938056 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0643e657-ef1f-4568-898f-0b71c470e78c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: c4b51dd0-c877-46c7-aded-56c5198030d5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:31:57.944891 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0643e657-ef1f-4568-898f-0b71c470e78c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:31:57.945380 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0643e657-ef1f-4568-898f-0b71c470e78c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:31:57.945826 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0643e657-ef1f-4568-898f-0b71c470e78c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:31:57.946549 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0643e657-ef1f-4568-898f-0b71c470e78c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:31:57.947015 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0643e657-ef1f-4568-898f-0b71c470e78c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:31:57.947448 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0643e657-ef1f-4568-898f-0b71c470e78c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:31:58.083148 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0643e657-ef1f-4568-898f-0b71c470e78c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:31:58.090843 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0643e657-ef1f-4568-898f-0b71c470e78c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5" status: 200 len: 1698 microversion: 2.1 time: 0.158006 Oct 23 02:31:58.094051 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3993/8076] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:31:57 2022] GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5 => generated 1698 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:31:58.879325 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-22e68f8d-b356-4b32-86c7-92843185f411 req-1aa61c29-0556-42fe-af77-70c6b3c09c23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4b51dd0-c877-46c7-aded-56c5198030d5", "name": "network-vif-unplugged", "status": "completed", "tag": "c4195e15-7d8d-483f-b85d-ee5a9700751d"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:31:58.889257 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-22e68f8d-b356-4b32-86c7-92843185f411 req-1aa61c29-0556-42fe-af77-70c6b3c09c23 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:31:58.889740 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-22e68f8d-b356-4b32-86c7-92843185f411 req-1aa61c29-0556-42fe-af77-70c6b3c09c23 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:31:58.890210 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-22e68f8d-b356-4b32-86c7-92843185f411 req-1aa61c29-0556-42fe-af77-70c6b3c09c23 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:31:58.902590 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-22e68f8d-b356-4b32-86c7-92843185f411 req-1aa61c29-0556-42fe-af77-70c6b3c09c23 service nova] Creating event network-vif-unplugged:c4195e15-7d8d-483f-b85d-ee5a9700751d for instance c4b51dd0-c877-46c7-aded-56c5198030d5 on n-h1-master-1 Oct 23 02:31:58.909766 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [req-22e68f8d-b356-4b32-86c7-92843185f411 req-1aa61c29-0556-42fe-af77-70c6b3c09c23 service nova] Instance c4b51dd0-c877-46c7-aded-56c5198030d5 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120944) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 23 02:31:58.918685 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-22e68f8d-b356-4b32-86c7-92843185f411 req-1aa61c29-0556-42fe-af77-70c6b3c09c23 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043909 Oct 23 02:31:58.919328 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4084/8077] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:31:59.115007 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6212b8a3-5713-401a-86f1-c50b950d6f88 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:31:59.115637 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6212b8a3-5713-401a-86f1-c50b950d6f88 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: c4b51dd0-c877-46c7-aded-56c5198030d5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:31:59.122621 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6212b8a3-5713-401a-86f1-c50b950d6f88 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:31:59.123118 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6212b8a3-5713-401a-86f1-c50b950d6f88 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:31:59.123566 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6212b8a3-5713-401a-86f1-c50b950d6f88 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:31:59.124270 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6212b8a3-5713-401a-86f1-c50b950d6f88 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:31:59.124739 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6212b8a3-5713-401a-86f1-c50b950d6f88 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:31:59.125177 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6212b8a3-5713-401a-86f1-c50b950d6f88 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:31:59.261365 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6212b8a3-5713-401a-86f1-c50b950d6f88 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:31:59.269132 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6212b8a3-5713-401a-86f1-c50b950d6f88 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5" status: 200 len: 1697 microversion: 2.1 time: 0.158629 Oct 23 02:31:59.269711 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3994/8078] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:31:59 2022] GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5 => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:32:00.295188 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2dd81e15-7fc3-4d92-b330-68c82e8cfcc5 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:32:00.295898 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2dd81e15-7fc3-4d92-b330-68c82e8cfcc5 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: c4b51dd0-c877-46c7-aded-56c5198030d5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:32:00.302133 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2dd81e15-7fc3-4d92-b330-68c82e8cfcc5 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:32:00.302625 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2dd81e15-7fc3-4d92-b330-68c82e8cfcc5 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:32:00.303069 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2dd81e15-7fc3-4d92-b330-68c82e8cfcc5 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:32:00.303762 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2dd81e15-7fc3-4d92-b330-68c82e8cfcc5 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:32:00.304226 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2dd81e15-7fc3-4d92-b330-68c82e8cfcc5 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:32:00.304657 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2dd81e15-7fc3-4d92-b330-68c82e8cfcc5 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:32:00.436438 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2dd81e15-7fc3-4d92-b330-68c82e8cfcc5 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:32:00.444784 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2dd81e15-7fc3-4d92-b330-68c82e8cfcc5 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5" status: 200 len: 1695 microversion: 2.1 time: 0.154745 Oct 23 02:32:00.445369 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4085/8079] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:32:00 2022] GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5 => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:32:00.933697 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-0fb00726-e7a2-4a6a-8f2f-795130fa5326 req-8ffc076e-1558-4cfd-938f-360685657aa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4b51dd0-c877-46c7-aded-56c5198030d5", "tag": "c4195e15-7d8d-483f-b85d-ee5a9700751d"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:32:00.943986 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-0fb00726-e7a2-4a6a-8f2f-795130fa5326 req-8ffc076e-1558-4cfd-938f-360685657aa4 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:32:00.944478 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-0fb00726-e7a2-4a6a-8f2f-795130fa5326 req-8ffc076e-1558-4cfd-938f-360685657aa4 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:32:00.944927 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-0fb00726-e7a2-4a6a-8f2f-795130fa5326 req-8ffc076e-1558-4cfd-938f-360685657aa4 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:32:00.956402 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-0fb00726-e7a2-4a6a-8f2f-795130fa5326 req-8ffc076e-1558-4cfd-938f-360685657aa4 service nova] Creating event network-changed:c4195e15-7d8d-483f-b85d-ee5a9700751d for instance c4b51dd0-c877-46c7-aded-56c5198030d5 on n-h1-master-1 Oct 23 02:32:00.961682 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [req-0fb00726-e7a2-4a6a-8f2f-795130fa5326 req-8ffc076e-1558-4cfd-938f-360685657aa4 service nova] Instance c4b51dd0-c877-46c7-aded-56c5198030d5 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120945) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 23 02:32:00.972841 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-0fb00726-e7a2-4a6a-8f2f-795130fa5326 req-8ffc076e-1558-4cfd-938f-360685657aa4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042864 Oct 23 02:32:00.973417 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3995/8080] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:32:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:32:01.469293 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a478064a-ef9c-4d65-a277-a4968c5daa5a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:32:01.470798 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a478064a-ef9c-4d65-a277-a4968c5daa5a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: c4b51dd0-c877-46c7-aded-56c5198030d5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:32:01.477796 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a478064a-ef9c-4d65-a277-a4968c5daa5a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:32:01.478345 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a478064a-ef9c-4d65-a277-a4968c5daa5a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:32:01.478789 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a478064a-ef9c-4d65-a277-a4968c5daa5a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:32:01.479502 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a478064a-ef9c-4d65-a277-a4968c5daa5a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:32:01.480126 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a478064a-ef9c-4d65-a277-a4968c5daa5a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:32:01.480818 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a478064a-ef9c-4d65-a277-a4968c5daa5a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:32:01.617746 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a478064a-ef9c-4d65-a277-a4968c5daa5a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:32:01.626196 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a478064a-ef9c-4d65-a277-a4968c5daa5a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5" status: 200 len: 1695 microversion: 2.1 time: 0.160734 Oct 23 02:32:01.628788 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4086/8081] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:32:01 2022] GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5 => generated 1695 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:32:02.653382 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d6e83c72-37eb-4dae-aea4-b62c4c3b0659 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:32:02.654060 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d6e83c72-37eb-4dae-aea4-b62c4c3b0659 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: c4b51dd0-c877-46c7-aded-56c5198030d5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:32:02.660740 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d6e83c72-37eb-4dae-aea4-b62c4c3b0659 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:32:02.661236 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d6e83c72-37eb-4dae-aea4-b62c4c3b0659 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:32:02.661679 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d6e83c72-37eb-4dae-aea4-b62c4c3b0659 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:32:02.662411 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d6e83c72-37eb-4dae-aea4-b62c4c3b0659 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:32:02.662894 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d6e83c72-37eb-4dae-aea4-b62c4c3b0659 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:32:02.663327 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d6e83c72-37eb-4dae-aea4-b62c4c3b0659 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:32:02.795363 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d6e83c72-37eb-4dae-aea4-b62c4c3b0659 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:32:02.803161 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d6e83c72-37eb-4dae-aea4-b62c4c3b0659 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5" status: 200 len: 1692 microversion: 2.1 time: 0.155116 Oct 23 02:32:02.803741 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3996/8082] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:32:02 2022] GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5 => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:32:02.825998 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-19902271-ec51-4031-b3ee-291cdc41ec66 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:32:02.826545 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-19902271-ec51-4031-b3ee-291cdc41ec66 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: c4b51dd0-c877-46c7-aded-56c5198030d5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:32:02.834564 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-19902271-ec51-4031-b3ee-291cdc41ec66 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:32:02.835056 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-19902271-ec51-4031-b3ee-291cdc41ec66 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:32:02.835498 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-19902271-ec51-4031-b3ee-291cdc41ec66 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:32:02.836193 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-19902271-ec51-4031-b3ee-291cdc41ec66 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:32:02.836655 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-19902271-ec51-4031-b3ee-291cdc41ec66 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:32:02.837087 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-19902271-ec51-4031-b3ee-291cdc41ec66 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:32:03.000748 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-19902271-ec51-4031-b3ee-291cdc41ec66 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "POST /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5/action" status: 204 len: 0 microversion: 2.1 time: 0.178453 Oct 23 02:32:03.001415 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4087/8083] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:32:02 2022] POST /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5/action => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 02:32:03.009647 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9afcc269-b94c-4a9b-b018-8fac5f5fc3f6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:32:03.010328 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9afcc269-b94c-4a9b-b018-8fac5f5fc3f6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: c4b51dd0-c877-46c7-aded-56c5198030d5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:32:03.016403 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9afcc269-b94c-4a9b-b018-8fac5f5fc3f6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:32:03.017379 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9afcc269-b94c-4a9b-b018-8fac5f5fc3f6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:32:03.017837 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9afcc269-b94c-4a9b-b018-8fac5f5fc3f6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:32:03.018583 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9afcc269-b94c-4a9b-b018-8fac5f5fc3f6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:32:03.019058 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9afcc269-b94c-4a9b-b018-8fac5f5fc3f6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:32:03.019502 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9afcc269-b94c-4a9b-b018-8fac5f5fc3f6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:32:03.151097 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9afcc269-b94c-4a9b-b018-8fac5f5fc3f6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:32:03.158881 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9afcc269-b94c-4a9b-b018-8fac5f5fc3f6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5" status: 200 len: 1692 microversion: 2.1 time: 0.153200 Oct 23 02:32:03.159463 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3997/8084] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:32:03 2022] GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5 => generated 1692 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:32:03.182476 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-323aa300-ccb0-4f5a-9d5d-6977dbef9968 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:32:03.183273 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-323aa300-ccb0-4f5a-9d5d-6977dbef9968 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: c4b51dd0-c877-46c7-aded-56c5198030d5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:32:03.190321 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-323aa300-ccb0-4f5a-9d5d-6977dbef9968 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:32:03.190810 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-323aa300-ccb0-4f5a-9d5d-6977dbef9968 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:32:03.191245 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-323aa300-ccb0-4f5a-9d5d-6977dbef9968 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:32:03.191935 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-323aa300-ccb0-4f5a-9d5d-6977dbef9968 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:32:03.192413 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-323aa300-ccb0-4f5a-9d5d-6977dbef9968 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:32:03.192841 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-323aa300-ccb0-4f5a-9d5d-6977dbef9968 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:32:03.208776 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:32:03.336546 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-323aa300-ccb0-4f5a-9d5d-6977dbef9968 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:32:03.344853 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-323aa300-ccb0-4f5a-9d5d-6977dbef9968 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5" status: 200 len: 1692 microversion: 2.1 time: 0.166707 Oct 23 02:32:03.345654 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4088/8085] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:32:03 2022] GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5 => generated 1692 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:32:04.367784 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7c437876-45ac-4850-9c33-d544226dc89c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:32:04.368417 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7c437876-45ac-4850-9c33-d544226dc89c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: c4b51dd0-c877-46c7-aded-56c5198030d5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:32:04.375235 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7c437876-45ac-4850-9c33-d544226dc89c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:32:04.376356 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7c437876-45ac-4850-9c33-d544226dc89c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:32:04.376356 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7c437876-45ac-4850-9c33-d544226dc89c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:32:04.376853 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7c437876-45ac-4850-9c33-d544226dc89c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:32:04.377321 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7c437876-45ac-4850-9c33-d544226dc89c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:32:04.377758 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7c437876-45ac-4850-9c33-d544226dc89c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:32:04.510908 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7c437876-45ac-4850-9c33-d544226dc89c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:32:04.519131 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7c437876-45ac-4850-9c33-d544226dc89c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5" status: 200 len: 1692 microversion: 2.1 time: 0.155227 Oct 23 02:32:04.523772 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3998/8086] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:32:04 2022] GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5 => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:32:05.517906 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-96decff7-8817-4e50-a851-d5b982810ab0 req-de2975e5-739d-4242-8ecf-61726da77d94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4b51dd0-c877-46c7-aded-56c5198030d5", "name": "network-vif-plugged", "status": "completed", "tag": "c4195e15-7d8d-483f-b85d-ee5a9700751d"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:32:05.528693 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-96decff7-8817-4e50-a851-d5b982810ab0 req-de2975e5-739d-4242-8ecf-61726da77d94 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:32:05.529171 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-96decff7-8817-4e50-a851-d5b982810ab0 req-de2975e5-739d-4242-8ecf-61726da77d94 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:32:05.529605 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-96decff7-8817-4e50-a851-d5b982810ab0 req-de2975e5-739d-4242-8ecf-61726da77d94 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:32:05.544054 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-96decff7-8817-4e50-a851-d5b982810ab0 req-de2975e5-739d-4242-8ecf-61726da77d94 service nova] Creating event network-vif-plugged:c4195e15-7d8d-483f-b85d-ee5a9700751d for instance c4b51dd0-c877-46c7-aded-56c5198030d5 on n-h1-master-1 Oct 23 02:32:05.545958 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ff6049e5-0c7b-4a45-9ca8-7ef3e72c82b9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:32:05.546568 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ff6049e5-0c7b-4a45-9ca8-7ef3e72c82b9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: c4b51dd0-c877-46c7-aded-56c5198030d5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:32:05.549510 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-96decff7-8817-4e50-a851-d5b982810ab0 req-de2975e5-739d-4242-8ecf-61726da77d94 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035464 Oct 23 02:32:05.550140 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4089/8087] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:32:05.554347 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ff6049e5-0c7b-4a45-9ca8-7ef3e72c82b9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:32:05.554855 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ff6049e5-0c7b-4a45-9ca8-7ef3e72c82b9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:32:05.555309 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ff6049e5-0c7b-4a45-9ca8-7ef3e72c82b9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:32:05.556018 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ff6049e5-0c7b-4a45-9ca8-7ef3e72c82b9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:32:05.556486 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ff6049e5-0c7b-4a45-9ca8-7ef3e72c82b9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:32:05.557139 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ff6049e5-0c7b-4a45-9ca8-7ef3e72c82b9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:32:05.696126 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ff6049e5-0c7b-4a45-9ca8-7ef3e72c82b9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:32:05.704077 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ff6049e5-0c7b-4a45-9ca8-7ef3e72c82b9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5" status: 200 len: 1684 microversion: 2.1 time: 0.162261 Oct 23 02:32:05.704658 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 3999/8088] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:32:05 2022] GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5 => generated 1684 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:32:27.914638 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=36 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:32:27.915358 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=5 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:32:27.963479 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2d01ef14-6cff-4994-8255-88de07d7375c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:32:27.972717 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2d01ef14-6cff-4994-8255-88de07d7375c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: c4b51dd0-c877-46c7-aded-56c5198030d5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:32:27.972717 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2d01ef14-6cff-4994-8255-88de07d7375c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:32:27.973074 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2d01ef14-6cff-4994-8255-88de07d7375c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:32:27.973517 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2d01ef14-6cff-4994-8255-88de07d7375c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:32:27.974245 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2d01ef14-6cff-4994-8255-88de07d7375c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:32:27.974743 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2d01ef14-6cff-4994-8255-88de07d7375c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:32:27.975179 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2d01ef14-6cff-4994-8255-88de07d7375c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:32:28.045123 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2d01ef14-6cff-4994-8255-88de07d7375c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "POST /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5/action" status: 200 len: 24569 microversion: 2.1 time: 0.132432 Oct 23 02:32:28.045732 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4090/8089] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:32:27 2022] POST /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5/action => generated 24569 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 02:32:35.348976 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-11b8aa46-4a29-4af6-905a-61d51e9a56b9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:32:35.349577 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-11b8aa46-4a29-4af6-905a-61d51e9a56b9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: c4b51dd0-c877-46c7-aded-56c5198030d5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:32:35.353918 n-d-master-1 devstack@n-api.service[120945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 23 02:32:35.354296 n-d-master-1 devstack@n-api.service[120945]: Sun Oct 23 02:32:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5 (ip 10.222.0.42) !!! Oct 23 02:32:35.356702 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=32 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:32:35.357561 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=94 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:32:35.365601 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-11b8aa46-4a29-4af6-905a-61d51e9a56b9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:32:35.370485 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-11b8aa46-4a29-4af6-905a-61d51e9a56b9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:32:35.370485 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-11b8aa46-4a29-4af6-905a-61d51e9a56b9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:32:35.370485 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-11b8aa46-4a29-4af6-905a-61d51e9a56b9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:32:35.370485 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-11b8aa46-4a29-4af6-905a-61d51e9a56b9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:32:35.370485 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-11b8aa46-4a29-4af6-905a-61d51e9a56b9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:32:35.399202 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-11b8aa46-4a29-4af6-905a-61d51e9a56b9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: c4b51dd0-c877-46c7-aded-56c5198030d5] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 02:32:35.414625 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-0740f1d1-b6c4-4dc2-90af-2f55821a189d req-f5bb1326-26cb-465d-bc53-098342829319 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4b51dd0-c877-46c7-aded-56c5198030d5", "tag": "c4195e15-7d8d-483f-b85d-ee5a9700751d"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:32:35.427591 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-0740f1d1-b6c4-4dc2-90af-2f55821a189d req-f5bb1326-26cb-465d-bc53-098342829319 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:32:35.428087 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-0740f1d1-b6c4-4dc2-90af-2f55821a189d req-f5bb1326-26cb-465d-bc53-098342829319 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:32:35.428523 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-0740f1d1-b6c4-4dc2-90af-2f55821a189d req-f5bb1326-26cb-465d-bc53-098342829319 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:32:35.445032 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-0740f1d1-b6c4-4dc2-90af-2f55821a189d req-f5bb1326-26cb-465d-bc53-098342829319 service nova] Creating event network-changed:c4195e15-7d8d-483f-b85d-ee5a9700751d for instance c4b51dd0-c877-46c7-aded-56c5198030d5 on n-h1-master-1 Oct 23 02:32:35.445032 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-0740f1d1-b6c4-4dc2-90af-2f55821a189d req-f5bb1326-26cb-465d-bc53-098342829319 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103863 Oct 23 02:32:35.445618 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4091/8090] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:32:35.703196 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-11b8aa46-4a29-4af6-905a-61d51e9a56b9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5" status: 204 len: 0 microversion: 2.1 time: 0.363114 Oct 23 02:32:35.705812 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4000/8091] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 02:32:35 2022] DELETE /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 02:32:35.714897 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6c445e5a-5109-4407-ab3b-7ed7edc68fb4 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:32:35.715619 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6c445e5a-5109-4407-ab3b-7ed7edc68fb4 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: c4b51dd0-c877-46c7-aded-56c5198030d5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:32:35.722456 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6c445e5a-5109-4407-ab3b-7ed7edc68fb4 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:32:35.723178 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6c445e5a-5109-4407-ab3b-7ed7edc68fb4 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:32:35.723650 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6c445e5a-5109-4407-ab3b-7ed7edc68fb4 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:32:35.724345 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6c445e5a-5109-4407-ab3b-7ed7edc68fb4 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:32:35.724813 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6c445e5a-5109-4407-ab3b-7ed7edc68fb4 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:32:35.725249 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6c445e5a-5109-4407-ab3b-7ed7edc68fb4 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:32:35.862150 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6c445e5a-5109-4407-ab3b-7ed7edc68fb4 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:32:35.870435 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6c445e5a-5109-4407-ab3b-7ed7edc68fb4 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5" status: 200 len: 1690 microversion: 2.1 time: 0.161203 Oct 23 02:32:35.875864 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4092/8092] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:32:35 2022] GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5 => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:32:36.896202 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e4c05374-d472-4723-ab44-514494e25c67 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:32:36.896861 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e4c05374-d472-4723-ab44-514494e25c67 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: c4b51dd0-c877-46c7-aded-56c5198030d5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:32:36.904072 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e4c05374-d472-4723-ab44-514494e25c67 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:32:36.904564 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e4c05374-d472-4723-ab44-514494e25c67 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:32:36.905006 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e4c05374-d472-4723-ab44-514494e25c67 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:32:36.905699 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e4c05374-d472-4723-ab44-514494e25c67 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:32:36.906191 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e4c05374-d472-4723-ab44-514494e25c67 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:32:36.906629 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e4c05374-d472-4723-ab44-514494e25c67 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:32:37.043666 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e4c05374-d472-4723-ab44-514494e25c67 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:32:37.051612 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e4c05374-d472-4723-ab44-514494e25c67 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5" status: 200 len: 1690 microversion: 2.1 time: 0.160393 Oct 23 02:32:37.052197 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4001/8093] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:32:36 2022] GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5 => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:32:37.831157 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-5d80a8ee-36d1-42b1-973b-25b382861279 req-59775c9e-eaf9-4f9f-aee9-37a7d3bdfb07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4b51dd0-c877-46c7-aded-56c5198030d5", "name": "network-vif-deleted", "tag": "c4195e15-7d8d-483f-b85d-ee5a9700751d"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:32:37.841387 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-5d80a8ee-36d1-42b1-973b-25b382861279 req-59775c9e-eaf9-4f9f-aee9-37a7d3bdfb07 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:32:37.841875 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-5d80a8ee-36d1-42b1-973b-25b382861279 req-59775c9e-eaf9-4f9f-aee9-37a7d3bdfb07 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:32:37.842336 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-5d80a8ee-36d1-42b1-973b-25b382861279 req-59775c9e-eaf9-4f9f-aee9-37a7d3bdfb07 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:32:37.854092 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-5d80a8ee-36d1-42b1-973b-25b382861279 req-59775c9e-eaf9-4f9f-aee9-37a7d3bdfb07 service nova] Creating event network-vif-deleted:c4195e15-7d8d-483f-b85d-ee5a9700751d for instance c4b51dd0-c877-46c7-aded-56c5198030d5 on n-h1-master-1 Oct 23 02:32:37.859205 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-5d80a8ee-36d1-42b1-973b-25b382861279 req-59775c9e-eaf9-4f9f-aee9-37a7d3bdfb07 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031871 Oct 23 02:32:37.859815 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4093/8094] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:32:38.075859 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8f7e237f-16c5-4083-ad75-8994fc40c40d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:32:38.076425 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8f7e237f-16c5-4083-ad75-8994fc40c40d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: c4b51dd0-c877-46c7-aded-56c5198030d5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:32:38.083160 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f7e237f-16c5-4083-ad75-8994fc40c40d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:32:38.083657 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f7e237f-16c5-4083-ad75-8994fc40c40d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:32:38.084106 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f7e237f-16c5-4083-ad75-8994fc40c40d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:32:38.084806 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f7e237f-16c5-4083-ad75-8994fc40c40d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:32:38.085274 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f7e237f-16c5-4083-ad75-8994fc40c40d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:32:38.085713 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8f7e237f-16c5-4083-ad75-8994fc40c40d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:32:38.158783 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8f7e237f-16c5-4083-ad75-8994fc40c40d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:32:38.166832 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8f7e237f-16c5-4083-ad75-8994fc40c40d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5" status: 200 len: 1351 microversion: 2.1 time: 0.094985 Oct 23 02:32:38.167735 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4002/8095] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:32:38 2022] GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5 => generated 1351 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:32:39.194214 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ea000239-268b-4697-bb9f-fc347d1063f6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:32:39.194916 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ea000239-268b-4697-bb9f-fc347d1063f6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: c4b51dd0-c877-46c7-aded-56c5198030d5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:32:39.201149 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ea000239-268b-4697-bb9f-fc347d1063f6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:32:39.201635 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ea000239-268b-4697-bb9f-fc347d1063f6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:32:39.202103 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ea000239-268b-4697-bb9f-fc347d1063f6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:32:39.202791 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ea000239-268b-4697-bb9f-fc347d1063f6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:32:39.203246 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ea000239-268b-4697-bb9f-fc347d1063f6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:32:39.203673 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ea000239-268b-4697-bb9f-fc347d1063f6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:32:39.218245 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-ea000239-268b-4697-bb9f-fc347d1063f6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] HTTP exception thrown: Instance c4b51dd0-c877-46c7-aded-56c5198030d5 could not be found. Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ea000239-268b-4697-bb9f-fc347d1063f6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Request method failure captured: Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5 HTTP/1.1 Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVKaMnNLl9X4D4-6gAQhVcBZVSSCcOxKFjsbsBxA4f4SIgFOSlWnBMD29f0rryuOIMdqOMvvoKKjQiSMc0ZA1OqQJGW_gUJVqrguR3WAgaWcxKTa_raeB5BxXxfu3Ak4NBM55mUf_VprS-3z9k4IWGvX4m2eUIZUD4Artyeb6HB3QnJs Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 028ee2f0bfd246d0a4abebdcbea26588 Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1311565393 Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/028ee2f0bfd246d0a4abebdcbea26588"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_028ee2f0bfd246d0a4abebdcbea26588"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/028ee2f0bfd246d0a4abebdcbea26588"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/028ee2f0bfd246d0a4abebdcbea26588"}]}] Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1311565393 Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 028ee2f0bfd246d0a4abebdcbea26588 Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1311565393 Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-TestNetworkAdvancedServerOps-1311565393-project Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: e44ce41e0ba0434a91710af395b8af29 Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1311565393-project Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: exception: Instance c4b51dd0-c877-46c7-aded-56c5198030d5 could not be found. Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'c4b51dd0-c877-46c7-aded-56c5198030d5'} Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4b51dd0-c877-46c7-aded-56c5198030d5 could not be found. Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4b51dd0-c877-46c7-aded-56c5198030d5 could not be found. Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:32:39.219944 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:32:39.225814 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:32:39.225814 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:32:39.225814 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:32:39.225814 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:32:39.225814 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:32:39.225814 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:32:39.225814 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4b51dd0-c877-46c7-aded-56c5198030d5 could not be found. Oct 23 02:32:39.225814 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:32:39.225814 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ea000239-268b-4697-bb9f-fc347d1063f6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Returning 404 to user: Instance c4b51dd0-c877-46c7-aded-56c5198030d5 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:32:39.225814 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ea000239-268b-4697-bb9f-fc347d1063f6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5" status: 404 len: 111 microversion: 2.1 time: 0.033128 Oct 23 02:32:39.225814 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4094/8096] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:32:39 2022] GET /compute/v2.1/servers/c4b51dd0-c877-46c7-aded-56c5198030d5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:32:43.159653 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3c1693f5-ea3c-4ace-abb2-3b737dbd7728 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '.version_select at 0x7f5cc16be040>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:32:43.254072 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3c1693f5-ea3c-4ace-abb2-3b737dbd7728 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1845593031" status: 202 len: 0 microversion: 2.1 time: 0.098392 Oct 23 02:32:43.254705 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4003/8097] 10.222.0.42 () {58 vars in 1284 bytes} [Sun Oct 23 02:32:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1845593031 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:32:43.283073 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-885cf9e2-4e75-41b2-9973-6066000a9a8b tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Action: 'create', calling method: .version_select at 0x7f5cc18149d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-90759407", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM6LlrLfuLQb6XuSlhoxsDsYkPUn8jnXk1aJ7wqKlmRs+zK2soXuZ//M5X0rKzqBax2Abtr0y3Ao7Ym/QEGObj5HQsWHnKwU1wGUL9bZqCdNeqUSLOO0k9lAdb5G9rxetg=="}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:32:43.300493 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-885cf9e2-4e75-41b2-9973-6066000a9a8b tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Getting quotas for project 028ee2f0bfd246d0a4abebdcbea26588. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:32:43.305804 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-885cf9e2-4e75-41b2-9973-6066000a9a8b tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Getting quotas for user e44ce41e0ba0434a91710af395b8af29 and project 028ee2f0bfd246d0a4abebdcbea26588. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:32:43.390622 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-885cf9e2-4e75-41b2-9973-6066000a9a8b tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.111446 Oct 23 02:32:43.391229 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4095/8098] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 02:32:43 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:32:51.728519 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b6eb6a4f-267c-4d58-8940-dffb34317030 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1266206232", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "a1094bd0-f61f-4c6c-a103-363a12924668"}], "key_name": "tempest-TestNetworkAdvancedServerOps-90759407", "security_groups": [{"name": "tempest-secgroup-smoke-1590281727"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:32:51.756457 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:32:51.866066 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-b6eb6a4f-267c-4d58-8940-dffb34317030 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] validate_networks() for [('a1094bd0-f61f-4c6c-a103-363a12924668', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 02:32:52.322518 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-b6eb6a4f-267c-4d58-8940-dffb34317030 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:32:52.322951 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-b6eb6a4f-267c-4d58-8940-dffb34317030 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:32:52.323431 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-b6eb6a4f-267c-4d58-8940-dffb34317030 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:32:52.323849 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-b6eb6a4f-267c-4d58-8940-dffb34317030 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:32:52.324320 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-b6eb6a4f-267c-4d58-8940-dffb34317030 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:32:52.334796 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b6eb6a4f-267c-4d58-8940-dffb34317030 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:32:52.335576 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b6eb6a4f-267c-4d58-8940-dffb34317030 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:32:52.336022 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b6eb6a4f-267c-4d58-8940-dffb34317030 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:32:52.336761 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b6eb6a4f-267c-4d58-8940-dffb34317030 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:32:52.337225 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b6eb6a4f-267c-4d58-8940-dffb34317030 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:32:52.338067 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b6eb6a4f-267c-4d58-8940-dffb34317030 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:32:52.357282 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-b6eb6a4f-267c-4d58-8940-dffb34317030 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Getting quotas for project 028ee2f0bfd246d0a4abebdcbea26588. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:32:52.363208 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-b6eb6a4f-267c-4d58-8940-dffb34317030 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Getting quotas for user e44ce41e0ba0434a91710af395b8af29 and project 028ee2f0bfd246d0a4abebdcbea26588. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:32:52.375467 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b6eb6a4f-267c-4d58-8940-dffb34317030 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 02:32:52.378351 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b6eb6a4f-267c-4d58-8940-dffb34317030 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 261ddad6-b34c-4356-b149-aa73c2076475] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 02:32:52.495781 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b6eb6a4f-267c-4d58-8940-dffb34317030 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.774386 Oct 23 02:32:52.496660 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4004/8099] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 02:32:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 02:32:52.508925 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0ced7e0a-37c5-4269-9c9e-17a8876cfe20 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:32:52.510360 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0ced7e0a-37c5-4269-9c9e-17a8876cfe20 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 261ddad6-b34c-4356-b149-aa73c2076475] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:32:52.513406 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=16 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:32:52.576695 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0ced7e0a-37c5-4269-9c9e-17a8876cfe20 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:32:52.584996 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0ced7e0a-37c5-4269-9c9e-17a8876cfe20 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475" status: 200 len: 1265 microversion: 2.1 time: 0.079993 Oct 23 02:32:52.597787 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4096/8100] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:32:52 2022] GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475 => generated 1265 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:32:53.620577 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1d23be6f-b860-4f2d-a96f-1dbf9010dff6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:32:53.621287 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1d23be6f-b860-4f2d-a96f-1dbf9010dff6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 261ddad6-b34c-4356-b149-aa73c2076475] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:32:53.630523 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1d23be6f-b860-4f2d-a96f-1dbf9010dff6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:32:53.631028 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1d23be6f-b860-4f2d-a96f-1dbf9010dff6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:32:53.631475 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1d23be6f-b860-4f2d-a96f-1dbf9010dff6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:32:53.632187 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1d23be6f-b860-4f2d-a96f-1dbf9010dff6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:32:53.632810 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1d23be6f-b860-4f2d-a96f-1dbf9010dff6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:32:53.633252 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1d23be6f-b860-4f2d-a96f-1dbf9010dff6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:32:53.706915 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1d23be6f-b860-4f2d-a96f-1dbf9010dff6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:32:53.716977 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1d23be6f-b860-4f2d-a96f-1dbf9010dff6 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475" status: 200 len: 1269 microversion: 2.1 time: 0.108235 Oct 23 02:32:53.717923 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4005/8101] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:32:53 2022] GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475 => generated 1269 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:32:54.741384 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b5d9d546-932a-4898-addd-0cd5457b06a5 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:32:54.742041 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b5d9d546-932a-4898-addd-0cd5457b06a5 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 261ddad6-b34c-4356-b149-aa73c2076475] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:32:54.750629 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5d9d546-932a-4898-addd-0cd5457b06a5 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:32:54.751236 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5d9d546-932a-4898-addd-0cd5457b06a5 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:32:54.752256 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5d9d546-932a-4898-addd-0cd5457b06a5 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:32:54.753014 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5d9d546-932a-4898-addd-0cd5457b06a5 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:32:54.753424 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5d9d546-932a-4898-addd-0cd5457b06a5 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:32:54.753854 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b5d9d546-932a-4898-addd-0cd5457b06a5 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:32:54.865313 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b5d9d546-932a-4898-addd-0cd5457b06a5 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:32:54.873012 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b5d9d546-932a-4898-addd-0cd5457b06a5 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475" status: 200 len: 1325 microversion: 2.1 time: 0.135709 Oct 23 02:32:54.873740 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4097/8102] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:32:54 2022] GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475 => generated 1325 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:32:55.897487 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-594efc32-2541-4899-96fd-111b793711e7 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:32:55.898149 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-594efc32-2541-4899-96fd-111b793711e7 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 261ddad6-b34c-4356-b149-aa73c2076475] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:32:55.905165 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-594efc32-2541-4899-96fd-111b793711e7 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:32:55.905816 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-594efc32-2541-4899-96fd-111b793711e7 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:32:55.906274 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-594efc32-2541-4899-96fd-111b793711e7 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:32:55.906991 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-594efc32-2541-4899-96fd-111b793711e7 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:32:55.907455 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-594efc32-2541-4899-96fd-111b793711e7 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:32:55.907887 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-594efc32-2541-4899-96fd-111b793711e7 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:32:56.112381 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-594efc32-2541-4899-96fd-111b793711e7 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:32:56.120217 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-594efc32-2541-4899-96fd-111b793711e7 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475" status: 200 len: 1391 microversion: 2.1 time: 0.227292 Oct 23 02:32:56.120898 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4006/8103] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:32:55 2022] GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475 => generated 1391 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:32:56.846210 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-27291cfb-9dea-4c8a-8885-c32330c7fd2f req-888682c9-78c0-4e24-bbb6-0460a40f2e6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "261ddad6-b34c-4356-b149-aa73c2076475", "tag": "0d84fe41-5ea2-4ee7-ad0b-4b3ffe832037"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:32:56.859019 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-27291cfb-9dea-4c8a-8885-c32330c7fd2f req-888682c9-78c0-4e24-bbb6-0460a40f2e6f service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:32:56.859670 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-27291cfb-9dea-4c8a-8885-c32330c7fd2f req-888682c9-78c0-4e24-bbb6-0460a40f2e6f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:32:56.860127 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-27291cfb-9dea-4c8a-8885-c32330c7fd2f req-888682c9-78c0-4e24-bbb6-0460a40f2e6f service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:32:56.872254 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-27291cfb-9dea-4c8a-8885-c32330c7fd2f req-888682c9-78c0-4e24-bbb6-0460a40f2e6f service nova] Creating event network-changed:0d84fe41-5ea2-4ee7-ad0b-4b3ffe832037 for instance 261ddad6-b34c-4356-b149-aa73c2076475 on n-h1-master-1 Oct 23 02:32:56.877595 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-27291cfb-9dea-4c8a-8885-c32330c7fd2f req-888682c9-78c0-4e24-bbb6-0460a40f2e6f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035306 Oct 23 02:32:56.878629 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4098/8104] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:32:57.143997 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c5f5e2da-a2d8-4c82-9fed-62abe26781d4 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:32:57.144671 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c5f5e2da-a2d8-4c82-9fed-62abe26781d4 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 261ddad6-b34c-4356-b149-aa73c2076475] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:32:57.151420 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c5f5e2da-a2d8-4c82-9fed-62abe26781d4 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:32:57.151911 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c5f5e2da-a2d8-4c82-9fed-62abe26781d4 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:32:57.153349 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c5f5e2da-a2d8-4c82-9fed-62abe26781d4 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:32:57.153349 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c5f5e2da-a2d8-4c82-9fed-62abe26781d4 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:32:57.153575 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c5f5e2da-a2d8-4c82-9fed-62abe26781d4 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:32:57.153901 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c5f5e2da-a2d8-4c82-9fed-62abe26781d4 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:32:57.418997 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c5f5e2da-a2d8-4c82-9fed-62abe26781d4 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:32:57.426998 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c5f5e2da-a2d8-4c82-9fed-62abe26781d4 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475" status: 200 len: 1391 microversion: 2.1 time: 0.286943 Oct 23 02:32:57.427580 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4007/8105] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:32:57 2022] GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475 => generated 1391 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:32:58.450800 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d788a074-7ddf-4c24-a9fa-68672bf601ad tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:32:58.451500 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d788a074-7ddf-4c24-a9fa-68672bf601ad tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 261ddad6-b34c-4356-b149-aa73c2076475] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:32:58.454294 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:32:58.459344 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d788a074-7ddf-4c24-a9fa-68672bf601ad tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:32:58.459838 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d788a074-7ddf-4c24-a9fa-68672bf601ad tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:32:58.460286 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d788a074-7ddf-4c24-a9fa-68672bf601ad tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:32:58.460986 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d788a074-7ddf-4c24-a9fa-68672bf601ad tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:32:58.461453 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d788a074-7ddf-4c24-a9fa-68672bf601ad tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:32:58.461961 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d788a074-7ddf-4c24-a9fa-68672bf601ad tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:32:58.596769 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d788a074-7ddf-4c24-a9fa-68672bf601ad tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:32:58.605051 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d788a074-7ddf-4c24-a9fa-68672bf601ad tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475" status: 200 len: 1391 microversion: 2.1 time: 0.158944 Oct 23 02:32:58.605640 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4099/8106] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:32:58 2022] GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:32:59.628994 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-218b87fc-4306-420e-9364-28dc1ad5efbc tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:32:59.629683 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-218b87fc-4306-420e-9364-28dc1ad5efbc tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 261ddad6-b34c-4356-b149-aa73c2076475] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:32:59.636953 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-218b87fc-4306-420e-9364-28dc1ad5efbc tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:32:59.637448 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-218b87fc-4306-420e-9364-28dc1ad5efbc tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:32:59.637895 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-218b87fc-4306-420e-9364-28dc1ad5efbc tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:32:59.638649 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-218b87fc-4306-420e-9364-28dc1ad5efbc tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:32:59.639112 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-218b87fc-4306-420e-9364-28dc1ad5efbc tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:32:59.639549 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-218b87fc-4306-420e-9364-28dc1ad5efbc tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:32:59.773748 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-218b87fc-4306-420e-9364-28dc1ad5efbc tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:32:59.781522 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-218b87fc-4306-420e-9364-28dc1ad5efbc tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475" status: 200 len: 1391 microversion: 2.1 time: 0.156734 Oct 23 02:32:59.782106 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4008/8107] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:32:59 2022] GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:33:00.805696 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f621bdf3-5300-4efd-b546-8c72e2f1093c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:33:00.806315 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f621bdf3-5300-4efd-b546-8c72e2f1093c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 261ddad6-b34c-4356-b149-aa73c2076475] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:33:00.812986 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f621bdf3-5300-4efd-b546-8c72e2f1093c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:33:00.813479 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f621bdf3-5300-4efd-b546-8c72e2f1093c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:33:00.813924 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f621bdf3-5300-4efd-b546-8c72e2f1093c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:33:00.814650 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f621bdf3-5300-4efd-b546-8c72e2f1093c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:33:00.815114 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f621bdf3-5300-4efd-b546-8c72e2f1093c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:33:00.815547 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f621bdf3-5300-4efd-b546-8c72e2f1093c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:33:00.951403 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f621bdf3-5300-4efd-b546-8c72e2f1093c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:33:00.959182 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f621bdf3-5300-4efd-b546-8c72e2f1093c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475" status: 200 len: 1391 microversion: 2.1 time: 0.158385 Oct 23 02:33:00.959759 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4100/8108] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:33:00 2022] GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:33:01.982795 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e5200d33-8319-4ca0-b8d9-c9da9205881f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:33:01.983426 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e5200d33-8319-4ca0-b8d9-c9da9205881f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 261ddad6-b34c-4356-b149-aa73c2076475] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:33:01.990791 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e5200d33-8319-4ca0-b8d9-c9da9205881f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:33:01.991291 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e5200d33-8319-4ca0-b8d9-c9da9205881f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:33:01.991746 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e5200d33-8319-4ca0-b8d9-c9da9205881f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:33:01.992447 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e5200d33-8319-4ca0-b8d9-c9da9205881f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:33:01.992919 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e5200d33-8319-4ca0-b8d9-c9da9205881f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:33:01.993360 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e5200d33-8319-4ca0-b8d9-c9da9205881f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:33:02.124638 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e5200d33-8319-4ca0-b8d9-c9da9205881f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:33:02.133137 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e5200d33-8319-4ca0-b8d9-c9da9205881f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475" status: 200 len: 1391 microversion: 2.1 time: 0.154688 Oct 23 02:33:02.133846 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4009/8109] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:33:01 2022] GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475 => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:33:03.156438 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dc29a24e-8c60-4363-9f0c-adff0e48a329 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:33:03.157061 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-dc29a24e-8c60-4363-9f0c-adff0e48a329 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 261ddad6-b34c-4356-b149-aa73c2076475] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:33:03.159923 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=6 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:33:03.164987 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dc29a24e-8c60-4363-9f0c-adff0e48a329 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:33:03.165485 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dc29a24e-8c60-4363-9f0c-adff0e48a329 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:33:03.165962 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dc29a24e-8c60-4363-9f0c-adff0e48a329 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:33:03.166696 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dc29a24e-8c60-4363-9f0c-adff0e48a329 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:33:03.167161 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dc29a24e-8c60-4363-9f0c-adff0e48a329 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:33:03.167626 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dc29a24e-8c60-4363-9f0c-adff0e48a329 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:33:03.302947 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-dc29a24e-8c60-4363-9f0c-adff0e48a329 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:33:03.310953 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-dc29a24e-8c60-4363-9f0c-adff0e48a329 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475" status: 200 len: 1391 microversion: 2.1 time: 0.158367 Oct 23 02:33:03.311535 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4101/8110] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:33:03 2022] GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:33:03.715985 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-e81f6267-248e-4d75-a024-e4c0800a2f1c req-27f0c527-858a-4b20-9c05-883e89eaae12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "261ddad6-b34c-4356-b149-aa73c2076475", "name": "network-vif-plugged", "status": "completed", "tag": "0d84fe41-5ea2-4ee7-ad0b-4b3ffe832037"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:33:03.720928 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:33:03.721645 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=6 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:33:03.727681 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-e81f6267-248e-4d75-a024-e4c0800a2f1c req-27f0c527-858a-4b20-9c05-883e89eaae12 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:33:03.728175 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-e81f6267-248e-4d75-a024-e4c0800a2f1c req-27f0c527-858a-4b20-9c05-883e89eaae12 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:33:03.734295 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-e81f6267-248e-4d75-a024-e4c0800a2f1c req-27f0c527-858a-4b20-9c05-883e89eaae12 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:33:03.740336 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-e81f6267-248e-4d75-a024-e4c0800a2f1c req-27f0c527-858a-4b20-9c05-883e89eaae12 service nova] Creating event network-vif-plugged:0d84fe41-5ea2-4ee7-ad0b-4b3ffe832037 for instance 261ddad6-b34c-4356-b149-aa73c2076475 on n-h1-master-1 Oct 23 02:33:03.745213 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-e81f6267-248e-4d75-a024-e4c0800a2f1c req-27f0c527-858a-4b20-9c05-883e89eaae12 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033086 Oct 23 02:33:03.745789 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4010/8111] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:33:04.335176 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3250ac85-405c-40fb-8d2c-34fbed558b69 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:33:04.339432 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3250ac85-405c-40fb-8d2c-34fbed558b69 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 261ddad6-b34c-4356-b149-aa73c2076475] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:33:04.342743 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3250ac85-405c-40fb-8d2c-34fbed558b69 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:33:04.343233 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3250ac85-405c-40fb-8d2c-34fbed558b69 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:33:04.343682 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3250ac85-405c-40fb-8d2c-34fbed558b69 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:33:04.344368 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3250ac85-405c-40fb-8d2c-34fbed558b69 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:33:04.344823 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3250ac85-405c-40fb-8d2c-34fbed558b69 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:33:04.345249 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3250ac85-405c-40fb-8d2c-34fbed558b69 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:33:04.481166 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3250ac85-405c-40fb-8d2c-34fbed558b69 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:33:04.490259 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3250ac85-405c-40fb-8d2c-34fbed558b69 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475" status: 200 len: 1391 microversion: 2.1 time: 0.159613 Oct 23 02:33:04.490846 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4102/8112] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:33:04 2022] GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:33:05.515667 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-79dbf712-6bf5-4216-9c19-85d0908190f3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:33:05.516483 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-79dbf712-6bf5-4216-9c19-85d0908190f3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 261ddad6-b34c-4356-b149-aa73c2076475] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:33:05.519036 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:33:05.524968 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-79dbf712-6bf5-4216-9c19-85d0908190f3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:33:05.525467 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-79dbf712-6bf5-4216-9c19-85d0908190f3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:33:05.525911 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-79dbf712-6bf5-4216-9c19-85d0908190f3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:33:05.526653 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-79dbf712-6bf5-4216-9c19-85d0908190f3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:33:05.527152 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-79dbf712-6bf5-4216-9c19-85d0908190f3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:33:05.527622 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-79dbf712-6bf5-4216-9c19-85d0908190f3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:33:05.660328 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-79dbf712-6bf5-4216-9c19-85d0908190f3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:33:05.668542 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-79dbf712-6bf5-4216-9c19-85d0908190f3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475" status: 200 len: 1562 microversion: 2.1 time: 0.158509 Oct 23 02:33:05.669114 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4011/8113] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:33:05 2022] GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475 => generated 1562 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:33:05.691955 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9f700e59-809c-48e2-ab77-2642d5271970 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:33:05.692590 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9f700e59-809c-48e2-ab77-2642d5271970 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 261ddad6-b34c-4356-b149-aa73c2076475] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:33:05.700605 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f700e59-809c-48e2-ab77-2642d5271970 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:33:05.701098 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f700e59-809c-48e2-ab77-2642d5271970 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:33:05.701543 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f700e59-809c-48e2-ab77-2642d5271970 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:33:05.702270 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f700e59-809c-48e2-ab77-2642d5271970 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:33:05.702736 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f700e59-809c-48e2-ab77-2642d5271970 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:33:05.703168 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9f700e59-809c-48e2-ab77-2642d5271970 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:33:05.832669 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9f700e59-809c-48e2-ab77-2642d5271970 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:33:05.840476 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9f700e59-809c-48e2-ab77-2642d5271970 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475" status: 200 len: 1562 microversion: 2.1 time: 0.153011 Oct 23 02:33:05.841061 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4103/8114] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:33:05 2022] GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475 => generated 1562 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:33:07.744143 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3e8add96-3588-4ec2-8a10-b9f2b9c5da75 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:33:07.749488 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-a3972356-113f-451c-ad5b-d0dab6b49955 req-62d366db-ed69-494f-a5ac-7e36b3f4020c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "261ddad6-b34c-4356-b149-aa73c2076475", "tag": "0d84fe41-5ea2-4ee7-ad0b-4b3ffe832037"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:33:07.754322 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3e8add96-3588-4ec2-8a10-b9f2b9c5da75 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 261ddad6-b34c-4356-b149-aa73c2076475] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:33:07.761829 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3e8add96-3588-4ec2-8a10-b9f2b9c5da75 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:33:07.762444 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3e8add96-3588-4ec2-8a10-b9f2b9c5da75 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:33:07.767869 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3e8add96-3588-4ec2-8a10-b9f2b9c5da75 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:33:07.767869 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3e8add96-3588-4ec2-8a10-b9f2b9c5da75 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:33:07.768117 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-a3972356-113f-451c-ad5b-d0dab6b49955 req-62d366db-ed69-494f-a5ac-7e36b3f4020c service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:33:07.768259 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3e8add96-3588-4ec2-8a10-b9f2b9c5da75 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:33:07.768259 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3e8add96-3588-4ec2-8a10-b9f2b9c5da75 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:33:07.768668 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-a3972356-113f-451c-ad5b-d0dab6b49955 req-62d366db-ed69-494f-a5ac-7e36b3f4020c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:33:07.768668 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-a3972356-113f-451c-ad5b-d0dab6b49955 req-62d366db-ed69-494f-a5ac-7e36b3f4020c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:33:07.780757 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-a3972356-113f-451c-ad5b-d0dab6b49955 req-62d366db-ed69-494f-a5ac-7e36b3f4020c service nova] Creating event network-changed:0d84fe41-5ea2-4ee7-ad0b-4b3ffe832037 for instance 261ddad6-b34c-4356-b149-aa73c2076475 on n-h1-master-1 Oct 23 02:33:07.786383 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-a3972356-113f-451c-ad5b-d0dab6b49955 req-62d366db-ed69-494f-a5ac-7e36b3f4020c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040454 Oct 23 02:33:07.787000 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4104/8115] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:33:08.017543 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3e8add96-3588-4ec2-8a10-b9f2b9c5da75 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:33:08.026727 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3e8add96-3588-4ec2-8a10-b9f2b9c5da75 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475" status: 200 len: 1562 microversion: 2.1 time: 0.286254 Oct 23 02:33:08.034735 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4012/8116] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:33:07 2022] GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475 => generated 1562 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:33:31.279331 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=11 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:33:31.280085 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=40 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:33:31.284397 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3481e018-f6fb-474b-871a-c6232e49448d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:33:31.287328 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3481e018-f6fb-474b-871a-c6232e49448d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 261ddad6-b34c-4356-b149-aa73c2076475] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:33:31.293387 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3481e018-f6fb-474b-871a-c6232e49448d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:33:31.293883 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3481e018-f6fb-474b-871a-c6232e49448d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:33:31.294351 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3481e018-f6fb-474b-871a-c6232e49448d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:33:31.295048 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3481e018-f6fb-474b-871a-c6232e49448d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:33:31.295510 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3481e018-f6fb-474b-871a-c6232e49448d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:33:31.295944 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3481e018-f6fb-474b-871a-c6232e49448d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:33:31.373838 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3481e018-f6fb-474b-871a-c6232e49448d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "POST /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475/action" status: 200 len: 24565 microversion: 2.1 time: 0.096400 Oct 23 02:33:31.374668 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4105/8117] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:33:31 2022] POST /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475/action => generated 24565 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 23 02:33:42.083388 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-2a0bee78-6335-4c88-8e5f-3b8094bdbed7 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:33:42.085542 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=3 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:33:42.086351 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=46 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:33:42.091068 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2a0bee78-6335-4c88-8e5f-3b8094bdbed7 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:33:42.091572 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2a0bee78-6335-4c88-8e5f-3b8094bdbed7 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:33:42.092028 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-2a0bee78-6335-4c88-8e5f-3b8094bdbed7 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:33:42.117570 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-2a0bee78-6335-4c88-8e5f-3b8094bdbed7 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 261ddad6-b34c-4356-b149-aa73c2076475] Going to try to stop instance {{(pid=120945) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 23 02:33:42.282031 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-2a0bee78-6335-4c88-8e5f-3b8094bdbed7 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "POST /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475/action" status: 202 len: 0 microversion: 2.1 time: 0.203404 Oct 23 02:33:42.282656 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4013/8118] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:33:42 2022] POST /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:33:42.291747 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-46abc492-708d-4f94-b8c5-45f7cae1efe7 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:33:42.292483 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-46abc492-708d-4f94-b8c5-45f7cae1efe7 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 261ddad6-b34c-4356-b149-aa73c2076475] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:33:42.295554 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:33:42.296222 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=4 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:33:42.305181 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46abc492-708d-4f94-b8c5-45f7cae1efe7 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:33:42.305670 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46abc492-708d-4f94-b8c5-45f7cae1efe7 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:33:42.306139 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46abc492-708d-4f94-b8c5-45f7cae1efe7 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:33:42.306842 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46abc492-708d-4f94-b8c5-45f7cae1efe7 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:33:42.307295 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46abc492-708d-4f94-b8c5-45f7cae1efe7 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:33:42.307719 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-46abc492-708d-4f94-b8c5-45f7cae1efe7 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:33:42.438303 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-46abc492-708d-4f94-b8c5-45f7cae1efe7 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:33:42.446907 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-46abc492-708d-4f94-b8c5-45f7cae1efe7 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475" status: 200 len: 1691 microversion: 2.1 time: 0.159516 Oct 23 02:33:42.447704 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4106/8119] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:33:42 2022] GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475 => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:33:43.473644 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e6e6e82b-42c7-458c-9413-6db5d3b5113f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:33:43.474395 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e6e6e82b-42c7-458c-9413-6db5d3b5113f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 261ddad6-b34c-4356-b149-aa73c2076475] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:33:43.480680 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6e6e82b-42c7-458c-9413-6db5d3b5113f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:33:43.481180 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6e6e82b-42c7-458c-9413-6db5d3b5113f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:33:43.481629 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6e6e82b-42c7-458c-9413-6db5d3b5113f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:33:43.482621 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6e6e82b-42c7-458c-9413-6db5d3b5113f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:33:43.483094 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6e6e82b-42c7-458c-9413-6db5d3b5113f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:33:43.483534 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6e6e82b-42c7-458c-9413-6db5d3b5113f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:33:43.618518 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e6e6e82b-42c7-458c-9413-6db5d3b5113f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:33:43.626600 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e6e6e82b-42c7-458c-9413-6db5d3b5113f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475" status: 200 len: 1691 microversion: 2.1 time: 0.158755 Oct 23 02:33:43.627187 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4014/8120] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:33:43 2022] GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:33:44.650409 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e8885ffe-8023-4838-99be-b111e83faf49 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:33:44.651022 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e8885ffe-8023-4838-99be-b111e83faf49 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 261ddad6-b34c-4356-b149-aa73c2076475] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:33:44.654146 n-d-master-1 devstack@n-api.service[120944]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 23 02:33:44.654317 n-d-master-1 devstack@n-api.service[120944]: Sun Oct 23 02:33:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475 (ip 10.222.0.42) !!! Oct 23 02:33:44.662231 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e8885ffe-8023-4838-99be-b111e83faf49 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:33:44.662714 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e8885ffe-8023-4838-99be-b111e83faf49 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:33:44.663150 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e8885ffe-8023-4838-99be-b111e83faf49 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:33:44.663837 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e8885ffe-8023-4838-99be-b111e83faf49 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:33:44.664293 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e8885ffe-8023-4838-99be-b111e83faf49 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:33:44.664718 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e8885ffe-8023-4838-99be-b111e83faf49 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:33:44.793881 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e8885ffe-8023-4838-99be-b111e83faf49 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:33:44.802264 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e8885ffe-8023-4838-99be-b111e83faf49 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475" status: 200 len: 1691 microversion: 2.1 time: 0.155759 Oct 23 02:33:44.802840 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4107/8121] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:33:44 2022] GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475 => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:33:45.826685 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fbfec258-54f3-4e96-9d22-02bd9df79e9d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:33:45.827267 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-fbfec258-54f3-4e96-9d22-02bd9df79e9d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 261ddad6-b34c-4356-b149-aa73c2076475] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:33:45.834702 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fbfec258-54f3-4e96-9d22-02bd9df79e9d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:33:45.835192 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fbfec258-54f3-4e96-9d22-02bd9df79e9d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:33:45.835637 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fbfec258-54f3-4e96-9d22-02bd9df79e9d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:33:45.836329 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fbfec258-54f3-4e96-9d22-02bd9df79e9d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:33:45.836793 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fbfec258-54f3-4e96-9d22-02bd9df79e9d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:33:45.837225 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fbfec258-54f3-4e96-9d22-02bd9df79e9d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:33:45.964201 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-fbfec258-54f3-4e96-9d22-02bd9df79e9d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:33:45.971892 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fbfec258-54f3-4e96-9d22-02bd9df79e9d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475" status: 200 len: 1691 microversion: 2.1 time: 0.149253 Oct 23 02:33:45.972474 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4015/8122] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:33:45 2022] GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475 => generated 1691 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:33:46.995893 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-01aff373-3e62-49fd-97bb-87c8544c113d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:33:46.996504 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-01aff373-3e62-49fd-97bb-87c8544c113d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 261ddad6-b34c-4356-b149-aa73c2076475] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:33:47.003462 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01aff373-3e62-49fd-97bb-87c8544c113d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:33:47.003946 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01aff373-3e62-49fd-97bb-87c8544c113d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:33:47.004390 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01aff373-3e62-49fd-97bb-87c8544c113d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:33:47.005089 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01aff373-3e62-49fd-97bb-87c8544c113d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:33:47.005551 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01aff373-3e62-49fd-97bb-87c8544c113d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:33:47.006044 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-01aff373-3e62-49fd-97bb-87c8544c113d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:33:47.139050 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-01aff373-3e62-49fd-97bb-87c8544c113d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:33:47.147379 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-01aff373-3e62-49fd-97bb-87c8544c113d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475" status: 200 len: 1691 microversion: 2.1 time: 0.155478 Oct 23 02:33:47.147961 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4108/8123] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:33:46 2022] GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475 => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:33:48.171692 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7a86f1c4-5add-4b91-a596-ad8ab90341da tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:33:48.172316 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7a86f1c4-5add-4b91-a596-ad8ab90341da tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 261ddad6-b34c-4356-b149-aa73c2076475] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:33:48.180283 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a86f1c4-5add-4b91-a596-ad8ab90341da tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:33:48.180774 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a86f1c4-5add-4b91-a596-ad8ab90341da tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:33:48.181225 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a86f1c4-5add-4b91-a596-ad8ab90341da tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:33:48.181916 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a86f1c4-5add-4b91-a596-ad8ab90341da tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:33:48.182410 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a86f1c4-5add-4b91-a596-ad8ab90341da tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:33:48.182847 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7a86f1c4-5add-4b91-a596-ad8ab90341da tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:33:48.311999 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7a86f1c4-5add-4b91-a596-ad8ab90341da tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:33:48.319739 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7a86f1c4-5add-4b91-a596-ad8ab90341da tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475" status: 200 len: 1691 microversion: 2.1 time: 0.152054 Oct 23 02:33:48.320310 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4016/8124] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:33:48 2022] GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475 => generated 1691 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:33:49.343128 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6379f4e7-3999-44e3-b0a2-835ed104b032 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:33:49.343740 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6379f4e7-3999-44e3-b0a2-835ed104b032 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 261ddad6-b34c-4356-b149-aa73c2076475] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:33:49.350694 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6379f4e7-3999-44e3-b0a2-835ed104b032 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:33:49.351190 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6379f4e7-3999-44e3-b0a2-835ed104b032 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:33:49.351639 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6379f4e7-3999-44e3-b0a2-835ed104b032 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:33:49.352341 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6379f4e7-3999-44e3-b0a2-835ed104b032 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:33:49.352808 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6379f4e7-3999-44e3-b0a2-835ed104b032 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:33:49.353247 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6379f4e7-3999-44e3-b0a2-835ed104b032 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:33:49.486267 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6379f4e7-3999-44e3-b0a2-835ed104b032 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:33:49.495386 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6379f4e7-3999-44e3-b0a2-835ed104b032 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475" status: 200 len: 1691 microversion: 2.1 time: 0.156182 Oct 23 02:33:49.495963 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4109/8125] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:33:49 2022] GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475 => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:33:50.518801 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e23b96b3-b82e-48e6-a730-d1d7fa6da00d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:33:50.519425 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e23b96b3-b82e-48e6-a730-d1d7fa6da00d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 261ddad6-b34c-4356-b149-aa73c2076475] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:33:50.526758 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e23b96b3-b82e-48e6-a730-d1d7fa6da00d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:33:50.527251 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e23b96b3-b82e-48e6-a730-d1d7fa6da00d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:33:50.527704 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e23b96b3-b82e-48e6-a730-d1d7fa6da00d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:33:50.528388 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e23b96b3-b82e-48e6-a730-d1d7fa6da00d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:33:50.528853 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e23b96b3-b82e-48e6-a730-d1d7fa6da00d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:33:50.529284 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e23b96b3-b82e-48e6-a730-d1d7fa6da00d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:33:50.657520 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e23b96b3-b82e-48e6-a730-d1d7fa6da00d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:33:50.665208 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e23b96b3-b82e-48e6-a730-d1d7fa6da00d tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475" status: 200 len: 1691 microversion: 2.1 time: 0.150362 Oct 23 02:33:50.665781 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4017/8126] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:33:50 2022] GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475 => generated 1691 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:33:51.689161 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-70ca6db2-8034-4856-aabe-15d19945e8b9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:33:51.689786 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-70ca6db2-8034-4856-aabe-15d19945e8b9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 261ddad6-b34c-4356-b149-aa73c2076475] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:33:51.697182 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-70ca6db2-8034-4856-aabe-15d19945e8b9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:33:51.697689 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-70ca6db2-8034-4856-aabe-15d19945e8b9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:33:51.698159 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-70ca6db2-8034-4856-aabe-15d19945e8b9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:33:51.698848 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-70ca6db2-8034-4856-aabe-15d19945e8b9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:33:51.699304 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-70ca6db2-8034-4856-aabe-15d19945e8b9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:33:51.699732 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-70ca6db2-8034-4856-aabe-15d19945e8b9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:33:51.826607 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-70ca6db2-8034-4856-aabe-15d19945e8b9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:33:51.834952 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-70ca6db2-8034-4856-aabe-15d19945e8b9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475" status: 200 len: 1691 microversion: 2.1 time: 0.149800 Oct 23 02:33:51.835527 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4110/8127] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:33:51 2022] GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475 => generated 1691 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:33:52.859778 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8b1f3a7a-5b95-497e-bfbc-f2102a1a0c28 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:33:52.860337 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8b1f3a7a-5b95-497e-bfbc-f2102a1a0c28 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 261ddad6-b34c-4356-b149-aa73c2076475] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:33:52.866986 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b1f3a7a-5b95-497e-bfbc-f2102a1a0c28 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:33:52.867487 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b1f3a7a-5b95-497e-bfbc-f2102a1a0c28 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:33:52.867939 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b1f3a7a-5b95-497e-bfbc-f2102a1a0c28 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:33:52.868646 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b1f3a7a-5b95-497e-bfbc-f2102a1a0c28 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:33:52.869117 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b1f3a7a-5b95-497e-bfbc-f2102a1a0c28 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:33:52.869557 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b1f3a7a-5b95-497e-bfbc-f2102a1a0c28 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:33:53.004245 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8b1f3a7a-5b95-497e-bfbc-f2102a1a0c28 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:33:53.012233 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8b1f3a7a-5b95-497e-bfbc-f2102a1a0c28 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475" status: 200 len: 1691 microversion: 2.1 time: 0.157065 Oct 23 02:33:53.016198 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4018/8128] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:33:52 2022] GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475 => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:33:54.036846 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-abfac1cb-0537-4a84-8cc3-9d581bb83c49 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:33:54.037540 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-abfac1cb-0537-4a84-8cc3-9d581bb83c49 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 261ddad6-b34c-4356-b149-aa73c2076475] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:33:54.044637 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-abfac1cb-0537-4a84-8cc3-9d581bb83c49 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:33:54.049761 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-abfac1cb-0537-4a84-8cc3-9d581bb83c49 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:33:54.049761 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-abfac1cb-0537-4a84-8cc3-9d581bb83c49 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:33:54.049761 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-abfac1cb-0537-4a84-8cc3-9d581bb83c49 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:33:54.049761 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-abfac1cb-0537-4a84-8cc3-9d581bb83c49 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:33:54.049761 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-abfac1cb-0537-4a84-8cc3-9d581bb83c49 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:33:54.179398 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-abfac1cb-0537-4a84-8cc3-9d581bb83c49 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:33:54.187122 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-abfac1cb-0537-4a84-8cc3-9d581bb83c49 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475" status: 200 len: 1668 microversion: 2.1 time: 0.154297 Oct 23 02:33:54.187693 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4111/8129] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:33:54 2022] GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475 => generated 1668 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:33:55.591886 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5adeae37-29f4-497d-9cfc-f766f11ddf9a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:33:55.594210 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5adeae37-29f4-497d-9cfc-f766f11ddf9a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 261ddad6-b34c-4356-b149-aa73c2076475] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:33:55.601510 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5adeae37-29f4-497d-9cfc-f766f11ddf9a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:33:55.602045 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5adeae37-29f4-497d-9cfc-f766f11ddf9a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:33:55.602502 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5adeae37-29f4-497d-9cfc-f766f11ddf9a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:33:55.603233 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5adeae37-29f4-497d-9cfc-f766f11ddf9a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:33:55.603687 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5adeae37-29f4-497d-9cfc-f766f11ddf9a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:33:55.604131 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5adeae37-29f4-497d-9cfc-f766f11ddf9a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:33:55.679581 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5adeae37-29f4-497d-9cfc-f766f11ddf9a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "POST /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475/action" status: 200 len: 38474 microversion: 2.1 time: 0.091481 Oct 23 02:33:55.680260 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4019/8130] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:33:55 2022] POST /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475/action => generated 38474 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 02:33:55.692060 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0d7a425a-be40-4d17-9d2b-e58250e41506 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:33:55.699340 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0d7a425a-be40-4d17-9d2b-e58250e41506 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:33:55.699824 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0d7a425a-be40-4d17-9d2b-e58250e41506 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:33:55.700262 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0d7a425a-be40-4d17-9d2b-e58250e41506 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:33:55.727210 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0d7a425a-be40-4d17-9d2b-e58250e41506 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 261ddad6-b34c-4356-b149-aa73c2076475] Going to try to start instance {{(pid=120944) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 23 02:33:55.848200 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0d7a425a-be40-4d17-9d2b-e58250e41506 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "POST /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475/action" status: 202 len: 0 microversion: 2.1 time: 0.159749 Oct 23 02:33:55.848760 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4112/8131] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:33:55 2022] POST /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:33:55.858873 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-36396609-e0da-4856-a91b-e8f19c4811ff tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:33:55.859597 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-36396609-e0da-4856-a91b-e8f19c4811ff tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 261ddad6-b34c-4356-b149-aa73c2076475] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:33:55.866891 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36396609-e0da-4856-a91b-e8f19c4811ff tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:33:55.867392 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36396609-e0da-4856-a91b-e8f19c4811ff tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:33:55.867850 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36396609-e0da-4856-a91b-e8f19c4811ff tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:33:55.868564 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36396609-e0da-4856-a91b-e8f19c4811ff tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:33:55.869038 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36396609-e0da-4856-a91b-e8f19c4811ff tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:33:55.869481 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-36396609-e0da-4856-a91b-e8f19c4811ff tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:33:56.001351 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-36396609-e0da-4856-a91b-e8f19c4811ff tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:33:56.010045 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-36396609-e0da-4856-a91b-e8f19c4811ff tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475" status: 200 len: 1677 microversion: 2.1 time: 0.155858 Oct 23 02:33:56.010700 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4020/8132] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:33:55 2022] GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:33:57.035849 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-23d6cf5c-120b-468c-805c-05e3eea77ded tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:33:57.036560 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-23d6cf5c-120b-468c-805c-05e3eea77ded tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 261ddad6-b34c-4356-b149-aa73c2076475] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:33:57.043467 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-23d6cf5c-120b-468c-805c-05e3eea77ded tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:33:57.047323 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-23d6cf5c-120b-468c-805c-05e3eea77ded tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:33:57.047323 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-23d6cf5c-120b-468c-805c-05e3eea77ded tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:33:57.047323 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-23d6cf5c-120b-468c-805c-05e3eea77ded tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:33:57.047323 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-23d6cf5c-120b-468c-805c-05e3eea77ded tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:33:57.047323 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-23d6cf5c-120b-468c-805c-05e3eea77ded tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:33:57.187424 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-23d6cf5c-120b-468c-805c-05e3eea77ded tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:33:57.195323 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-23d6cf5c-120b-468c-805c-05e3eea77ded tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475" status: 200 len: 1677 microversion: 2.1 time: 0.164531 Oct 23 02:33:57.195901 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4113/8133] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:33:57 2022] GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:33:58.219407 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e5429108-8485-42fb-a5ea-121898b6cdc1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:33:58.220018 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e5429108-8485-42fb-a5ea-121898b6cdc1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 261ddad6-b34c-4356-b149-aa73c2076475] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:33:58.226907 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e5429108-8485-42fb-a5ea-121898b6cdc1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:33:58.227401 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e5429108-8485-42fb-a5ea-121898b6cdc1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:33:58.227848 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e5429108-8485-42fb-a5ea-121898b6cdc1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:33:58.228542 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e5429108-8485-42fb-a5ea-121898b6cdc1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:33:58.229008 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e5429108-8485-42fb-a5ea-121898b6cdc1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:33:58.229449 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e5429108-8485-42fb-a5ea-121898b6cdc1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:33:58.356395 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e5429108-8485-42fb-a5ea-121898b6cdc1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:33:58.364274 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e5429108-8485-42fb-a5ea-121898b6cdc1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475" status: 200 len: 1681 microversion: 2.1 time: 0.148855 Oct 23 02:33:58.364838 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4021/8134] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:33:58 2022] GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475 => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:34:22.555758 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c567032c-254f-471a-b597-8eef42dc8a0a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:34:22.558055 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c567032c-254f-471a-b597-8eef42dc8a0a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 261ddad6-b34c-4356-b149-aa73c2076475] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:34:22.560348 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=16 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:34:22.561018 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:34:22.565873 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c567032c-254f-471a-b597-8eef42dc8a0a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:34:22.566432 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c567032c-254f-471a-b597-8eef42dc8a0a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:34:22.566855 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c567032c-254f-471a-b597-8eef42dc8a0a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:34:22.567660 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c567032c-254f-471a-b597-8eef42dc8a0a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:34:22.568056 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c567032c-254f-471a-b597-8eef42dc8a0a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:34:22.568483 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c567032c-254f-471a-b597-8eef42dc8a0a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:34:22.643972 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c567032c-254f-471a-b597-8eef42dc8a0a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "POST /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475/action" status: 200 len: 63035 microversion: 2.1 time: 0.092191 Oct 23 02:34:22.644658 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4114/8135] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:34:22 2022] POST /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475/action => generated 63035 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 02:34:29.924058 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-72826acd-7564-4a4c-9226-9c536c067284 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:34:29.925326 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-72826acd-7564-4a4c-9226-9c536c067284 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 261ddad6-b34c-4356-b149-aa73c2076475] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:34:29.933184 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=18 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:34:29.933184 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:34:29.935186 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-72826acd-7564-4a4c-9226-9c536c067284 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:34:29.935688 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-72826acd-7564-4a4c-9226-9c536c067284 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:34:29.936134 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-72826acd-7564-4a4c-9226-9c536c067284 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:34:29.936847 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-72826acd-7564-4a4c-9226-9c536c067284 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:34:29.937388 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-72826acd-7564-4a4c-9226-9c536c067284 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:34:29.937819 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-72826acd-7564-4a4c-9226-9c536c067284 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:34:29.967715 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-72826acd-7564-4a4c-9226-9c536c067284 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 261ddad6-b34c-4356-b149-aa73c2076475] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 02:34:29.986008 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-265a259e-306f-45a8-9e7a-e3ee42c6b4b1 req-74df8088-76ec-4c5a-8893-79d39237f758 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "261ddad6-b34c-4356-b149-aa73c2076475", "tag": "0d84fe41-5ea2-4ee7-ad0b-4b3ffe832037"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:34:29.998550 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-265a259e-306f-45a8-9e7a-e3ee42c6b4b1 req-74df8088-76ec-4c5a-8893-79d39237f758 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:34:29.999037 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-265a259e-306f-45a8-9e7a-e3ee42c6b4b1 req-74df8088-76ec-4c5a-8893-79d39237f758 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:34:29.999477 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-265a259e-306f-45a8-9e7a-e3ee42c6b4b1 req-74df8088-76ec-4c5a-8893-79d39237f758 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:34:30.011046 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-265a259e-306f-45a8-9e7a-e3ee42c6b4b1 req-74df8088-76ec-4c5a-8893-79d39237f758 service nova] Creating event network-changed:0d84fe41-5ea2-4ee7-ad0b-4b3ffe832037 for instance 261ddad6-b34c-4356-b149-aa73c2076475 on n-h1-master-1 Oct 23 02:34:30.017005 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-265a259e-306f-45a8-9e7a-e3ee42c6b4b1 req-74df8088-76ec-4c5a-8893-79d39237f758 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094452 Oct 23 02:34:30.017603 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4115/8136] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:34:30.326137 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-72826acd-7564-4a4c-9226-9c536c067284 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "DELETE /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475" status: 204 len: 0 microversion: 2.1 time: 0.405504 Oct 23 02:34:30.327207 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4022/8137] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 02:34:29 2022] DELETE /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 23 02:34:30.336472 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4a362b9b-fe2a-4db1-a140-ac649103f3c3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:34:30.337400 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4a362b9b-fe2a-4db1-a140-ac649103f3c3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 261ddad6-b34c-4356-b149-aa73c2076475] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:34:30.344648 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4a362b9b-fe2a-4db1-a140-ac649103f3c3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:34:30.348907 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4a362b9b-fe2a-4db1-a140-ac649103f3c3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:34:30.348907 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4a362b9b-fe2a-4db1-a140-ac649103f3c3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:34:30.348907 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4a362b9b-fe2a-4db1-a140-ac649103f3c3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:34:30.348907 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4a362b9b-fe2a-4db1-a140-ac649103f3c3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:34:30.348907 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4a362b9b-fe2a-4db1-a140-ac649103f3c3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:34:30.487039 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4a362b9b-fe2a-4db1-a140-ac649103f3c3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:34:30.495329 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4a362b9b-fe2a-4db1-a140-ac649103f3c3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475" status: 200 len: 1687 microversion: 2.1 time: 0.163352 Oct 23 02:34:30.495924 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4116/8138] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:34:30 2022] GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475 => generated 1687 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:34:31.521016 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-eed58b04-5584-428d-b39b-1bf2207a929e tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:34:31.521760 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-eed58b04-5584-428d-b39b-1bf2207a929e tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 261ddad6-b34c-4356-b149-aa73c2076475] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:34:31.528790 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eed58b04-5584-428d-b39b-1bf2207a929e tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:34:31.529284 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eed58b04-5584-428d-b39b-1bf2207a929e tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:34:31.529729 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eed58b04-5584-428d-b39b-1bf2207a929e tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:34:31.530455 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eed58b04-5584-428d-b39b-1bf2207a929e tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:34:31.530926 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eed58b04-5584-428d-b39b-1bf2207a929e tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:34:31.531360 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-eed58b04-5584-428d-b39b-1bf2207a929e tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:34:31.666318 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-eed58b04-5584-428d-b39b-1bf2207a929e tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:34:31.674309 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-eed58b04-5584-428d-b39b-1bf2207a929e tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475" status: 200 len: 1687 microversion: 2.1 time: 0.157619 Oct 23 02:34:31.674891 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4023/8139] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:34:31 2022] GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475 => generated 1687 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:34:32.699808 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6ef2a112-3125-45f0-a9c3-a4dbb407cef3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:34:32.700431 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6ef2a112-3125-45f0-a9c3-a4dbb407cef3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 261ddad6-b34c-4356-b149-aa73c2076475] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:34:32.703283 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-19b86b4f-1667-4189-aa26-51af6990fc6f req-048d70d0-8369-4448-97fa-b0b485c65306 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "261ddad6-b34c-4356-b149-aa73c2076475", "name": "network-vif-deleted", "tag": "0d84fe41-5ea2-4ee7-ad0b-4b3ffe832037"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:34:32.708370 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6ef2a112-3125-45f0-a9c3-a4dbb407cef3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:34:32.708885 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6ef2a112-3125-45f0-a9c3-a4dbb407cef3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:34:32.709334 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6ef2a112-3125-45f0-a9c3-a4dbb407cef3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:34:32.710081 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6ef2a112-3125-45f0-a9c3-a4dbb407cef3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:34:32.710532 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6ef2a112-3125-45f0-a9c3-a4dbb407cef3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:34:32.710961 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6ef2a112-3125-45f0-a9c3-a4dbb407cef3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:34:32.713631 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-19b86b4f-1667-4189-aa26-51af6990fc6f req-048d70d0-8369-4448-97fa-b0b485c65306 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:34:32.714257 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-19b86b4f-1667-4189-aa26-51af6990fc6f req-048d70d0-8369-4448-97fa-b0b485c65306 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:34:32.714706 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-19b86b4f-1667-4189-aa26-51af6990fc6f req-048d70d0-8369-4448-97fa-b0b485c65306 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:34:32.725932 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-19b86b4f-1667-4189-aa26-51af6990fc6f req-048d70d0-8369-4448-97fa-b0b485c65306 service nova] Creating event network-vif-deleted:0d84fe41-5ea2-4ee7-ad0b-4b3ffe832037 for instance 261ddad6-b34c-4356-b149-aa73c2076475 on n-h1-master-1 Oct 23 02:34:32.731185 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-19b86b4f-1667-4189-aa26-51af6990fc6f req-048d70d0-8369-4448-97fa-b0b485c65306 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031992 Oct 23 02:34:32.731881 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4024/8140] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:34:32.776158 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6ef2a112-3125-45f0-a9c3-a4dbb407cef3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:34:32.784244 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6ef2a112-3125-45f0-a9c3-a4dbb407cef3 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475" status: 200 len: 1500 microversion: 2.1 time: 0.088579 Oct 23 02:34:32.784820 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4117/8141] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:34:32 2022] GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475 => generated 1500 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:34:33.808231 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-30ac2e8a-60fa-46cc-84d5-3dc38522e3d1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:34:33.808869 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-30ac2e8a-60fa-46cc-84d5-3dc38522e3d1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 261ddad6-b34c-4356-b149-aa73c2076475] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:34:33.815902 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-30ac2e8a-60fa-46cc-84d5-3dc38522e3d1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:34:33.816401 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-30ac2e8a-60fa-46cc-84d5-3dc38522e3d1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:34:33.816852 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-30ac2e8a-60fa-46cc-84d5-3dc38522e3d1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:34:33.817553 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-30ac2e8a-60fa-46cc-84d5-3dc38522e3d1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:34:33.818044 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-30ac2e8a-60fa-46cc-84d5-3dc38522e3d1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:34:33.818996 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-30ac2e8a-60fa-46cc-84d5-3dc38522e3d1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:34:33.832374 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-30ac2e8a-60fa-46cc-84d5-3dc38522e3d1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] HTTP exception thrown: Instance 261ddad6-b34c-4356-b149-aa73c2076475 could not be found. Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-30ac2e8a-60fa-46cc-84d5-3dc38522e3d1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Request method failure captured: Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475 HTTP/1.1 Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVKaMnNLl9X4D4-6gAQhVcBZVSSCcOxKFjsbsBxA4f4SIgFOSlWnBMD29f0rryuOIMdqOMvvoKKjQiSMc0ZA1OqQJGW_gUJVqrguR3WAgaWcxKTa_raeB5BxXxfu3Ak4NBM55mUf_VprS-3z9k4IWGvX4m2eUIZUD4Artyeb6HB3QnJs Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 028ee2f0bfd246d0a4abebdcbea26588 Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1311565393 Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/028ee2f0bfd246d0a4abebdcbea26588"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_028ee2f0bfd246d0a4abebdcbea26588"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/028ee2f0bfd246d0a4abebdcbea26588"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/028ee2f0bfd246d0a4abebdcbea26588"}]}] Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1311565393 Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 028ee2f0bfd246d0a4abebdcbea26588 Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1311565393 Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-TestNetworkAdvancedServerOps-1311565393-project Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: e44ce41e0ba0434a91710af395b8af29 Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1311565393-project Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 261ddad6-b34c-4356-b149-aa73c2076475 could not be found. Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '261ddad6-b34c-4356-b149-aa73c2076475'} Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 261ddad6-b34c-4356-b149-aa73c2076475 could not be found. Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 261ddad6-b34c-4356-b149-aa73c2076475 could not be found. Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:34:33.834668 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:34:33.840472 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:34:33.840472 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:34:33.840472 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:34:33.840472 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:34:33.840472 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:34:33.840472 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:34:33.840472 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 261ddad6-b34c-4356-b149-aa73c2076475 could not be found. Oct 23 02:34:33.840472 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:34:33.840472 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-30ac2e8a-60fa-46cc-84d5-3dc38522e3d1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Returning 404 to user: Instance 261ddad6-b34c-4356-b149-aa73c2076475 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:34:33.840472 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-30ac2e8a-60fa-46cc-84d5-3dc38522e3d1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475" status: 404 len: 111 microversion: 2.1 time: 0.032263 Oct 23 02:34:33.840472 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4025/8142] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:34:33 2022] GET /compute/v2.1/servers/261ddad6-b34c-4356-b149-aa73c2076475 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:34:37.592001 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-86459dce-90f0-4e0f-9ed0-6cb5facf77f2 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '.version_select at 0x7f5cc183b940>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:34:37.680983 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-86459dce-90f0-4e0f-9ed0-6cb5facf77f2 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-90759407" status: 202 len: 0 microversion: 2.1 time: 0.093132 Oct 23 02:34:37.681586 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4118/8143] 10.222.0.42 () {58 vars in 1278 bytes} [Sun Oct 23 02:34:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-90759407 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:34:37.715236 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f65688fd-7124-4b7e-b0d1-9b8e12a48985 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Action: 'create', calling method: .version_select at 0x7f5cc6211670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1311752774", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1GlkKd4uOWF7176vO3H2CSWkREo47J1xqeyvLw8E5Y9UkbP6cbFQrng4Jz859jqHFLhEPESKtSRlm6q/oJWCJ1CyA+oFYD4J2ok1qkIRH6uNBPZ5KeCsSEJVYyn0wbDQ=="}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:34:37.736668 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-f65688fd-7124-4b7e-b0d1-9b8e12a48985 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Getting quotas for project 028ee2f0bfd246d0a4abebdcbea26588. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:34:37.742712 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-f65688fd-7124-4b7e-b0d1-9b8e12a48985 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Getting quotas for user e44ce41e0ba0434a91710af395b8af29 and project 028ee2f0bfd246d0a4abebdcbea26588. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:34:37.823356 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f65688fd-7124-4b7e-b0d1-9b8e12a48985 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.112170 Oct 23 02:34:37.823998 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4026/8144] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 02:34:37 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:34:45.723094 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cf17e5fd-8614-4dcd-9214-3ca66fcdca0a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1601873208", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "networks": [{"uuid": "a9c60a58-a71c-4c41-b02f-81df13777f97"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1311752774", "security_groups": [{"name": "tempest-secgroup-smoke-950739313"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:34:45.747430 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=18 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:34:45.871183 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-cf17e5fd-8614-4dcd-9214-3ca66fcdca0a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] validate_networks() for [('a9c60a58-a71c-4c41-b02f-81df13777f97', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 02:34:46.308041 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-cf17e5fd-8614-4dcd-9214-3ca66fcdca0a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:34:46.311949 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-cf17e5fd-8614-4dcd-9214-3ca66fcdca0a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:34:46.312470 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-cf17e5fd-8614-4dcd-9214-3ca66fcdca0a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:34:46.313101 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-cf17e5fd-8614-4dcd-9214-3ca66fcdca0a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:34:46.313734 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-cf17e5fd-8614-4dcd-9214-3ca66fcdca0a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:34:46.327955 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf17e5fd-8614-4dcd-9214-3ca66fcdca0a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:34:46.328498 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf17e5fd-8614-4dcd-9214-3ca66fcdca0a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:34:46.328946 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf17e5fd-8614-4dcd-9214-3ca66fcdca0a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:34:46.329697 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf17e5fd-8614-4dcd-9214-3ca66fcdca0a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:34:46.330187 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf17e5fd-8614-4dcd-9214-3ca66fcdca0a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:34:46.330624 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cf17e5fd-8614-4dcd-9214-3ca66fcdca0a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:34:46.357759 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-cf17e5fd-8614-4dcd-9214-3ca66fcdca0a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Getting quotas for project 028ee2f0bfd246d0a4abebdcbea26588. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:34:46.370075 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-cf17e5fd-8614-4dcd-9214-3ca66fcdca0a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Getting quotas for user e44ce41e0ba0434a91710af395b8af29 and project 028ee2f0bfd246d0a4abebdcbea26588. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:34:46.386449 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-cf17e5fd-8614-4dcd-9214-3ca66fcdca0a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 02:34:46.388865 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-cf17e5fd-8614-4dcd-9214-3ca66fcdca0a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 9679f4c2-8963-459e-8001-ceeed8c92dd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 02:34:46.519808 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cf17e5fd-8614-4dcd-9214-3ca66fcdca0a tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.799227 Oct 23 02:34:46.520502 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4119/8145] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 02:34:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 02:34:46.530066 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:34:46.534160 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7cbedef8-4152-4494-9b1f-66036adb3a87 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:34:46.535598 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7cbedef8-4152-4494-9b1f-66036adb3a87 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 9679f4c2-8963-459e-8001-ceeed8c92dd5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:34:46.602362 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7cbedef8-4152-4494-9b1f-66036adb3a87 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:34:46.614602 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7cbedef8-4152-4494-9b1f-66036adb3a87 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5" status: 200 len: 1267 microversion: 2.1 time: 0.086127 Oct 23 02:34:46.620064 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4027/8146] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:34:46 2022] GET /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5 => generated 1267 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:34:47.639779 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e0d45227-dea2-44f2-bc76-b72bcbe07dc9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:34:47.640569 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e0d45227-dea2-44f2-bc76-b72bcbe07dc9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 9679f4c2-8963-459e-8001-ceeed8c92dd5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:34:47.650741 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0d45227-dea2-44f2-bc76-b72bcbe07dc9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:34:47.651237 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0d45227-dea2-44f2-bc76-b72bcbe07dc9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:34:47.651675 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0d45227-dea2-44f2-bc76-b72bcbe07dc9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:34:47.652374 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0d45227-dea2-44f2-bc76-b72bcbe07dc9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:34:47.652834 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0d45227-dea2-44f2-bc76-b72bcbe07dc9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:34:47.653263 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e0d45227-dea2-44f2-bc76-b72bcbe07dc9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:34:47.720333 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e0d45227-dea2-44f2-bc76-b72bcbe07dc9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:34:47.731028 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e0d45227-dea2-44f2-bc76-b72bcbe07dc9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5" status: 200 len: 1271 microversion: 2.1 time: 0.096014 Oct 23 02:34:47.732353 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4120/8147] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:34:47 2022] GET /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5 => generated 1271 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:34:48.755509 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6c009864-ab81-4373-a3f4-40f0e0136594 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:34:48.756142 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6c009864-ab81-4373-a3f4-40f0e0136594 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 9679f4c2-8963-459e-8001-ceeed8c92dd5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:34:48.764610 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6c009864-ab81-4373-a3f4-40f0e0136594 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:34:48.765363 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6c009864-ab81-4373-a3f4-40f0e0136594 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:34:48.766036 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6c009864-ab81-4373-a3f4-40f0e0136594 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:34:48.767082 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6c009864-ab81-4373-a3f4-40f0e0136594 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:34:48.767746 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6c009864-ab81-4373-a3f4-40f0e0136594 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:34:48.768194 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6c009864-ab81-4373-a3f4-40f0e0136594 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:34:48.836640 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6c009864-ab81-4373-a3f4-40f0e0136594 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:34:48.854941 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6c009864-ab81-4373-a3f4-40f0e0136594 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5" status: 200 len: 1327 microversion: 2.1 time: 0.103363 Oct 23 02:34:48.855836 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4028/8148] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:34:48 2022] GET /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5 => generated 1327 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:34:49.883822 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7541f0a1-9aa2-4d5b-80af-f963fa3d445c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:34:49.885055 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7541f0a1-9aa2-4d5b-80af-f963fa3d445c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 9679f4c2-8963-459e-8001-ceeed8c92dd5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:34:49.892378 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7541f0a1-9aa2-4d5b-80af-f963fa3d445c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:34:49.893111 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7541f0a1-9aa2-4d5b-80af-f963fa3d445c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:34:49.893550 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7541f0a1-9aa2-4d5b-80af-f963fa3d445c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:34:49.894279 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7541f0a1-9aa2-4d5b-80af-f963fa3d445c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:34:49.894735 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7541f0a1-9aa2-4d5b-80af-f963fa3d445c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:34:49.895163 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7541f0a1-9aa2-4d5b-80af-f963fa3d445c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:34:50.034376 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7541f0a1-9aa2-4d5b-80af-f963fa3d445c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:34:50.043459 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7541f0a1-9aa2-4d5b-80af-f963fa3d445c tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5" status: 200 len: 1392 microversion: 2.1 time: 0.164525 Oct 23 02:34:50.044078 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4121/8149] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:34:49 2022] GET /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:34:50.525141 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-270a915a-c74c-49f1-85bc-4ca915c206e1 req-fda6612f-fa7b-4382-8bd1-703d48fcef40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9679f4c2-8963-459e-8001-ceeed8c92dd5", "tag": "fb3d3714-89fa-4ce5-bf3a-4a4ccba9310c"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:34:50.538278 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-270a915a-c74c-49f1-85bc-4ca915c206e1 req-fda6612f-fa7b-4382-8bd1-703d48fcef40 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:34:50.538786 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-270a915a-c74c-49f1-85bc-4ca915c206e1 req-fda6612f-fa7b-4382-8bd1-703d48fcef40 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:34:50.539237 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-270a915a-c74c-49f1-85bc-4ca915c206e1 req-fda6612f-fa7b-4382-8bd1-703d48fcef40 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:34:50.551165 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-270a915a-c74c-49f1-85bc-4ca915c206e1 req-fda6612f-fa7b-4382-8bd1-703d48fcef40 service nova] Creating event network-changed:fb3d3714-89fa-4ce5-bf3a-4a4ccba9310c for instance 9679f4c2-8963-459e-8001-ceeed8c92dd5 on n-h2-master-1 Oct 23 02:34:50.556757 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-270a915a-c74c-49f1-85bc-4ca915c206e1 req-fda6612f-fa7b-4382-8bd1-703d48fcef40 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035539 Oct 23 02:34:50.557372 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4029/8150] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:34:51.067264 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-11e0abdc-aefe-4e21-9eaf-76a29712fc09 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:34:51.067882 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-11e0abdc-aefe-4e21-9eaf-76a29712fc09 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 9679f4c2-8963-459e-8001-ceeed8c92dd5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:34:51.075006 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-11e0abdc-aefe-4e21-9eaf-76a29712fc09 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:34:51.075328 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-11e0abdc-aefe-4e21-9eaf-76a29712fc09 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:34:51.075769 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-11e0abdc-aefe-4e21-9eaf-76a29712fc09 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:34:51.076569 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-11e0abdc-aefe-4e21-9eaf-76a29712fc09 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:34:51.076952 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-11e0abdc-aefe-4e21-9eaf-76a29712fc09 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:34:51.077381 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-11e0abdc-aefe-4e21-9eaf-76a29712fc09 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:34:51.217750 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-11e0abdc-aefe-4e21-9eaf-76a29712fc09 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:34:51.226329 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-11e0abdc-aefe-4e21-9eaf-76a29712fc09 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5" status: 200 len: 1392 microversion: 2.1 time: 0.162960 Oct 23 02:34:51.226906 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4122/8151] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:34:51 2022] GET /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:34:52.251204 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-631fb1db-4e58-4d76-a66a-e807f0c19bdb tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:34:52.251953 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-631fb1db-4e58-4d76-a66a-e807f0c19bdb tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 9679f4c2-8963-459e-8001-ceeed8c92dd5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:34:52.258947 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-631fb1db-4e58-4d76-a66a-e807f0c19bdb tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:34:52.259445 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-631fb1db-4e58-4d76-a66a-e807f0c19bdb tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:34:52.259898 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-631fb1db-4e58-4d76-a66a-e807f0c19bdb tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:34:52.260601 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-631fb1db-4e58-4d76-a66a-e807f0c19bdb tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:34:52.261071 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-631fb1db-4e58-4d76-a66a-e807f0c19bdb tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:34:52.261508 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-631fb1db-4e58-4d76-a66a-e807f0c19bdb tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:34:52.445508 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-631fb1db-4e58-4d76-a66a-e807f0c19bdb tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:34:52.453250 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-631fb1db-4e58-4d76-a66a-e807f0c19bdb tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5" status: 200 len: 1392 microversion: 2.1 time: 0.207308 Oct 23 02:34:52.453830 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4030/8152] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:34:52 2022] GET /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5 => generated 1392 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:34:53.476414 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a60f2335-55e9-40c6-9540-33a5b1fdc616 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:34:53.477060 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a60f2335-55e9-40c6-9540-33a5b1fdc616 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 9679f4c2-8963-459e-8001-ceeed8c92dd5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:34:53.479772 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:34:53.484810 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a60f2335-55e9-40c6-9540-33a5b1fdc616 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:34:53.485299 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a60f2335-55e9-40c6-9540-33a5b1fdc616 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:34:53.485742 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a60f2335-55e9-40c6-9540-33a5b1fdc616 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:34:53.486543 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a60f2335-55e9-40c6-9540-33a5b1fdc616 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:34:53.492635 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a60f2335-55e9-40c6-9540-33a5b1fdc616 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:34:53.492635 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a60f2335-55e9-40c6-9540-33a5b1fdc616 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:34:53.623401 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a60f2335-55e9-40c6-9540-33a5b1fdc616 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:34:53.631880 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a60f2335-55e9-40c6-9540-33a5b1fdc616 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5" status: 200 len: 1392 microversion: 2.1 time: 0.159419 Oct 23 02:34:53.632396 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4123/8153] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:34:53 2022] GET /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:34:54.654971 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-893136d2-3956-4255-a68f-b4c4a587c094 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:34:54.655603 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-893136d2-3956-4255-a68f-b4c4a587c094 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 9679f4c2-8963-459e-8001-ceeed8c92dd5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:34:54.662408 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-893136d2-3956-4255-a68f-b4c4a587c094 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:34:54.662911 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-893136d2-3956-4255-a68f-b4c4a587c094 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:34:54.663365 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-893136d2-3956-4255-a68f-b4c4a587c094 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:34:54.664072 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-893136d2-3956-4255-a68f-b4c4a587c094 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:34:54.664538 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-893136d2-3956-4255-a68f-b4c4a587c094 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:34:54.664975 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-893136d2-3956-4255-a68f-b4c4a587c094 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:34:54.794230 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-893136d2-3956-4255-a68f-b4c4a587c094 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:34:54.801908 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-893136d2-3956-4255-a68f-b4c4a587c094 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5" status: 200 len: 1392 microversion: 2.1 time: 0.150938 Oct 23 02:34:54.802548 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4031/8154] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:34:54 2022] GET /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5 => generated 1392 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:34:55.824867 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-097526b2-6870-4645-bcdc-1beb700860fc tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:34:55.825480 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-097526b2-6870-4645-bcdc-1beb700860fc tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 9679f4c2-8963-459e-8001-ceeed8c92dd5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:34:55.832299 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-097526b2-6870-4645-bcdc-1beb700860fc tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:34:55.832784 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-097526b2-6870-4645-bcdc-1beb700860fc tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:34:55.833222 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-097526b2-6870-4645-bcdc-1beb700860fc tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:34:55.834484 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-097526b2-6870-4645-bcdc-1beb700860fc tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:34:55.834948 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-097526b2-6870-4645-bcdc-1beb700860fc tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:34:55.835377 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-097526b2-6870-4645-bcdc-1beb700860fc tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:34:55.964111 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-097526b2-6870-4645-bcdc-1beb700860fc tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:34:55.971657 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-097526b2-6870-4645-bcdc-1beb700860fc tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5" status: 200 len: 1392 microversion: 2.1 time: 0.150762 Oct 23 02:34:55.972224 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4124/8155] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:34:55 2022] GET /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5 => generated 1392 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:34:56.658527 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-99a48947-8795-45b5-91a5-9af2eedecb40 req-007a35df-4a07-4578-869a-fca80efb5f1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9679f4c2-8963-459e-8001-ceeed8c92dd5", "name": "network-vif-plugged", "status": "completed", "tag": "fb3d3714-89fa-4ce5-bf3a-4a4ccba9310c"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:34:56.664509 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=6 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:34:56.669684 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-99a48947-8795-45b5-91a5-9af2eedecb40 req-007a35df-4a07-4578-869a-fca80efb5f1d service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:34:56.670222 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-99a48947-8795-45b5-91a5-9af2eedecb40 req-007a35df-4a07-4578-869a-fca80efb5f1d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:34:56.674564 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-99a48947-8795-45b5-91a5-9af2eedecb40 req-007a35df-4a07-4578-869a-fca80efb5f1d service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:34:56.681961 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-99a48947-8795-45b5-91a5-9af2eedecb40 req-007a35df-4a07-4578-869a-fca80efb5f1d service nova] Creating event network-vif-plugged:fb3d3714-89fa-4ce5-bf3a-4a4ccba9310c for instance 9679f4c2-8963-459e-8001-ceeed8c92dd5 on n-h2-master-1 Oct 23 02:34:56.687322 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-99a48947-8795-45b5-91a5-9af2eedecb40 req-007a35df-4a07-4578-869a-fca80efb5f1d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032281 Oct 23 02:34:56.687581 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4032/8156] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:34:56.996931 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6c50a2f4-3e67-4703-a372-64dfba71836e tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:34:56.997589 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6c50a2f4-3e67-4703-a372-64dfba71836e tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 9679f4c2-8963-459e-8001-ceeed8c92dd5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:34:56.999513 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:34:57.000229 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=6 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:34:57.006092 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6c50a2f4-3e67-4703-a372-64dfba71836e tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:34:57.006595 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6c50a2f4-3e67-4703-a372-64dfba71836e tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:34:57.007041 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6c50a2f4-3e67-4703-a372-64dfba71836e tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:34:57.008021 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6c50a2f4-3e67-4703-a372-64dfba71836e tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:34:57.008362 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6c50a2f4-3e67-4703-a372-64dfba71836e tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:34:57.008730 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6c50a2f4-3e67-4703-a372-64dfba71836e tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:34:57.147374 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6c50a2f4-3e67-4703-a372-64dfba71836e tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:34:57.155288 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6c50a2f4-3e67-4703-a372-64dfba71836e tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5" status: 200 len: 1392 microversion: 2.1 time: 0.162371 Oct 23 02:34:57.155868 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4125/8157] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:34:56 2022] GET /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:34:58.180474 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-bdde94cf-ceee-4e71-8bcc-cf9a48dc4c7f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:34:58.181107 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-bdde94cf-ceee-4e71-8bcc-cf9a48dc4c7f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 9679f4c2-8963-459e-8001-ceeed8c92dd5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:34:58.187783 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bdde94cf-ceee-4e71-8bcc-cf9a48dc4c7f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:34:58.188280 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bdde94cf-ceee-4e71-8bcc-cf9a48dc4c7f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:34:58.188729 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bdde94cf-ceee-4e71-8bcc-cf9a48dc4c7f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:34:58.189441 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bdde94cf-ceee-4e71-8bcc-cf9a48dc4c7f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:34:58.189927 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bdde94cf-ceee-4e71-8bcc-cf9a48dc4c7f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:34:58.190388 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-bdde94cf-ceee-4e71-8bcc-cf9a48dc4c7f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:34:58.321959 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-bdde94cf-ceee-4e71-8bcc-cf9a48dc4c7f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:34:58.329876 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-bdde94cf-ceee-4e71-8bcc-cf9a48dc4c7f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5" status: 200 len: 1392 microversion: 2.1 time: 0.155218 Oct 23 02:34:58.330477 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4033/8158] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:34:58 2022] GET /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:34:59.352710 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ecec41a1-2322-43e0-84e0-9137f31590bf tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:34:59.353336 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ecec41a1-2322-43e0-84e0-9137f31590bf tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 9679f4c2-8963-459e-8001-ceeed8c92dd5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:34:59.360286 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ecec41a1-2322-43e0-84e0-9137f31590bf tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:34:59.360775 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ecec41a1-2322-43e0-84e0-9137f31590bf tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:34:59.361219 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ecec41a1-2322-43e0-84e0-9137f31590bf tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:34:59.361914 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ecec41a1-2322-43e0-84e0-9137f31590bf tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:34:59.362410 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ecec41a1-2322-43e0-84e0-9137f31590bf tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:34:59.362837 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ecec41a1-2322-43e0-84e0-9137f31590bf tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:34:59.498739 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ecec41a1-2322-43e0-84e0-9137f31590bf tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:34:59.507326 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ecec41a1-2322-43e0-84e0-9137f31590bf tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5" status: 200 len: 1564 microversion: 2.1 time: 0.157912 Oct 23 02:34:59.507910 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4126/8159] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:34:59 2022] GET /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5 => generated 1564 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:34:59.529543 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-beca8ffd-fb5e-4a01-92b9-c41ef782b385 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:34:59.530222 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-beca8ffd-fb5e-4a01-92b9-c41ef782b385 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 9679f4c2-8963-459e-8001-ceeed8c92dd5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:34:59.537032 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-beca8ffd-fb5e-4a01-92b9-c41ef782b385 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:34:59.537537 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-beca8ffd-fb5e-4a01-92b9-c41ef782b385 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:34:59.538037 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-beca8ffd-fb5e-4a01-92b9-c41ef782b385 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:34:59.538729 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-beca8ffd-fb5e-4a01-92b9-c41ef782b385 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:34:59.539204 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-beca8ffd-fb5e-4a01-92b9-c41ef782b385 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:34:59.539650 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-beca8ffd-fb5e-4a01-92b9-c41ef782b385 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:34:59.671693 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-beca8ffd-fb5e-4a01-92b9-c41ef782b385 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:34:59.679974 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-beca8ffd-fb5e-4a01-92b9-c41ef782b385 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5" status: 200 len: 1564 microversion: 2.1 time: 0.154326 Oct 23 02:34:59.680565 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4034/8160] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:34:59 2022] GET /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5 => generated 1564 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:35:01.842772 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-18d83209-ff99-45df-a0e8-81208b83d752 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:35:01.843429 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-18d83209-ff99-45df-a0e8-81208b83d752 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 9679f4c2-8963-459e-8001-ceeed8c92dd5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:35:01.848471 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-820e1e46-7ca0-4865-9303-66c9c9f4b010 req-95937c7a-4a57-4e01-8206-5e3cbe2aa274 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9679f4c2-8963-459e-8001-ceeed8c92dd5", "tag": "fb3d3714-89fa-4ce5-bf3a-4a4ccba9310c"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:35:01.859011 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:35:01.863624 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18d83209-ff99-45df-a0e8-81208b83d752 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:35:01.864123 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18d83209-ff99-45df-a0e8-81208b83d752 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:35:01.864566 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18d83209-ff99-45df-a0e8-81208b83d752 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:35:01.864870 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-820e1e46-7ca0-4865-9303-66c9c9f4b010 req-95937c7a-4a57-4e01-8206-5e3cbe2aa274 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:35:01.865276 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18d83209-ff99-45df-a0e8-81208b83d752 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:35:01.865397 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-820e1e46-7ca0-4865-9303-66c9c9f4b010 req-95937c7a-4a57-4e01-8206-5e3cbe2aa274 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:35:01.865733 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18d83209-ff99-45df-a0e8-81208b83d752 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:35:01.865869 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-820e1e46-7ca0-4865-9303-66c9c9f4b010 req-95937c7a-4a57-4e01-8206-5e3cbe2aa274 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:35:01.866194 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-18d83209-ff99-45df-a0e8-81208b83d752 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:35:01.879039 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-820e1e46-7ca0-4865-9303-66c9c9f4b010 req-95937c7a-4a57-4e01-8206-5e3cbe2aa274 service nova] Creating event network-changed:fb3d3714-89fa-4ce5-bf3a-4a4ccba9310c for instance 9679f4c2-8963-459e-8001-ceeed8c92dd5 on n-h2-master-1 Oct 23 02:35:01.884555 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-820e1e46-7ca0-4865-9303-66c9c9f4b010 req-95937c7a-4a57-4e01-8206-5e3cbe2aa274 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039651 Oct 23 02:35:01.888195 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4035/8161] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:35:02.004839 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-18d83209-ff99-45df-a0e8-81208b83d752 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:35:02.013803 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-18d83209-ff99-45df-a0e8-81208b83d752 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5" status: 200 len: 1564 microversion: 2.1 time: 0.174985 Oct 23 02:35:02.014876 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4127/8162] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:35:01 2022] GET /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5 => generated 1564 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:35:25.263206 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=36 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:35:25.267608 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-edd10560-3cfb-4bb7-9371-7efb7acc7e98 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:35:25.269880 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-edd10560-3cfb-4bb7-9371-7efb7acc7e98 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 9679f4c2-8963-459e-8001-ceeed8c92dd5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:35:25.277052 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-edd10560-3cfb-4bb7-9371-7efb7acc7e98 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:35:25.277557 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-edd10560-3cfb-4bb7-9371-7efb7acc7e98 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:35:25.278128 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-edd10560-3cfb-4bb7-9371-7efb7acc7e98 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:35:25.278847 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-edd10560-3cfb-4bb7-9371-7efb7acc7e98 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:35:25.279313 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-edd10560-3cfb-4bb7-9371-7efb7acc7e98 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:35:25.279751 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-edd10560-3cfb-4bb7-9371-7efb7acc7e98 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:35:25.351795 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-edd10560-3cfb-4bb7-9371-7efb7acc7e98 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "POST /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5/action" status: 200 len: 24567 microversion: 2.1 time: 0.089973 Oct 23 02:35:25.352749 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4036/8163] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:35:25 2022] POST /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5/action => generated 24567 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 02:35:36.451112 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-41e19048-bc7b-4f65-b779-2fc465f56007 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:35:36.451736 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-41e19048-bc7b-4f65-b779-2fc465f56007 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 9679f4c2-8963-459e-8001-ceeed8c92dd5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:35:36.453768 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=9 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:35:36.454435 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=50 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:35:36.459764 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41e19048-bc7b-4f65-b779-2fc465f56007 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:35:36.460249 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41e19048-bc7b-4f65-b779-2fc465f56007 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:35:36.460685 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41e19048-bc7b-4f65-b779-2fc465f56007 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:35:36.461905 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41e19048-bc7b-4f65-b779-2fc465f56007 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:35:36.462393 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41e19048-bc7b-4f65-b779-2fc465f56007 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:35:36.462820 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-41e19048-bc7b-4f65-b779-2fc465f56007 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:35:36.488367 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-41e19048-bc7b-4f65-b779-2fc465f56007 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lazy-loading 'flavor' on Instance uuid 9679f4c2-8963-459e-8001-ceeed8c92dd5 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:35:36.687859 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-41e19048-bc7b-4f65-b779-2fc465f56007 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "POST /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5/action" status: 202 len: 0 microversion: 2.1 time: 0.241009 Oct 23 02:35:36.688562 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4128/8164] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:35:36 2022] POST /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:35:36.699033 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c6c175ee-0506-49a4-b840-4233bb533721 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:35:36.699790 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c6c175ee-0506-49a4-b840-4233bb533721 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 9679f4c2-8963-459e-8001-ceeed8c92dd5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:35:36.702665 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=4 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:35:36.707969 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6c175ee-0506-49a4-b840-4233bb533721 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:35:36.708470 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6c175ee-0506-49a4-b840-4233bb533721 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:35:36.708923 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6c175ee-0506-49a4-b840-4233bb533721 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:35:36.709634 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6c175ee-0506-49a4-b840-4233bb533721 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:35:36.710139 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6c175ee-0506-49a4-b840-4233bb533721 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:35:36.713204 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c6c175ee-0506-49a4-b840-4233bb533721 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:35:36.842659 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c6c175ee-0506-49a4-b840-4233bb533721 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:35:36.850869 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c6c175ee-0506-49a4-b840-4233bb533721 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5" status: 200 len: 1691 microversion: 2.1 time: 0.157175 Oct 23 02:35:36.851445 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4037/8165] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:35:36 2022] GET /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5 => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:35:37.876775 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c85f2d2c-05fa-4139-81df-d795b8f14dc1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:35:37.877523 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c85f2d2c-05fa-4139-81df-d795b8f14dc1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 9679f4c2-8963-459e-8001-ceeed8c92dd5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:35:37.883872 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c85f2d2c-05fa-4139-81df-d795b8f14dc1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:35:37.884368 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c85f2d2c-05fa-4139-81df-d795b8f14dc1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:35:37.884816 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c85f2d2c-05fa-4139-81df-d795b8f14dc1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:35:37.885516 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c85f2d2c-05fa-4139-81df-d795b8f14dc1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:35:37.886016 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c85f2d2c-05fa-4139-81df-d795b8f14dc1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:35:37.886523 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c85f2d2c-05fa-4139-81df-d795b8f14dc1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:35:38.067131 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c85f2d2c-05fa-4139-81df-d795b8f14dc1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:35:38.075503 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c85f2d2c-05fa-4139-81df-d795b8f14dc1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5" status: 200 len: 1674 microversion: 2.1 time: 0.204117 Oct 23 02:35:38.076113 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4129/8166] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:35:37 2022] GET /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5 => generated 1674 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:35:39.170394 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-200997a8-066f-4161-bc1e-4b512faca1bb tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:35:39.172663 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-200997a8-066f-4161-bc1e-4b512faca1bb tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 9679f4c2-8963-459e-8001-ceeed8c92dd5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:35:39.180419 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-200997a8-066f-4161-bc1e-4b512faca1bb tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:35:39.180950 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-200997a8-066f-4161-bc1e-4b512faca1bb tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:35:39.181432 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-200997a8-066f-4161-bc1e-4b512faca1bb tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:35:39.182180 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-200997a8-066f-4161-bc1e-4b512faca1bb tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:35:39.182651 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-200997a8-066f-4161-bc1e-4b512faca1bb tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:35:39.183088 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-200997a8-066f-4161-bc1e-4b512faca1bb tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:35:39.253804 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-200997a8-066f-4161-bc1e-4b512faca1bb tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "POST /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5/action" status: 200 len: 38471 microversion: 2.1 time: 0.087940 Oct 23 02:35:39.254484 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4038/8167] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:35:39 2022] POST /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5/action => generated 38471 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 02:35:39.266482 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1faf2545-bb2b-4f9a-baf0-5c0aca91b03b tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:35:39.267062 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1faf2545-bb2b-4f9a-baf0-5c0aca91b03b tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 9679f4c2-8963-459e-8001-ceeed8c92dd5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:35:39.273932 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1faf2545-bb2b-4f9a-baf0-5c0aca91b03b tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:35:39.274453 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1faf2545-bb2b-4f9a-baf0-5c0aca91b03b tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:35:39.275395 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1faf2545-bb2b-4f9a-baf0-5c0aca91b03b tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:35:39.276096 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1faf2545-bb2b-4f9a-baf0-5c0aca91b03b tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:35:39.276559 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1faf2545-bb2b-4f9a-baf0-5c0aca91b03b tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:35:39.276997 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1faf2545-bb2b-4f9a-baf0-5c0aca91b03b tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:35:39.481843 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1faf2545-bb2b-4f9a-baf0-5c0aca91b03b tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "POST /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5/action" status: 202 len: 0 microversion: 2.1 time: 0.219074 Oct 23 02:35:39.484562 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4130/8168] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:35:39 2022] POST /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:35:39.495761 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f9aa1753-75ed-4346-9ed4-dd646859b1fe tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:35:39.496471 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f9aa1753-75ed-4346-9ed4-dd646859b1fe tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 9679f4c2-8963-459e-8001-ceeed8c92dd5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:35:39.503831 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f9aa1753-75ed-4346-9ed4-dd646859b1fe tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:35:39.504322 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f9aa1753-75ed-4346-9ed4-dd646859b1fe tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:35:39.504771 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f9aa1753-75ed-4346-9ed4-dd646859b1fe tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:35:39.505465 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f9aa1753-75ed-4346-9ed4-dd646859b1fe tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:35:39.505929 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f9aa1753-75ed-4346-9ed4-dd646859b1fe tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:35:39.506403 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f9aa1753-75ed-4346-9ed4-dd646859b1fe tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:35:39.644773 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f9aa1753-75ed-4346-9ed4-dd646859b1fe tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:35:39.653264 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f9aa1753-75ed-4346-9ed4-dd646859b1fe tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5" status: 200 len: 1680 microversion: 2.1 time: 0.162259 Oct 23 02:35:39.653843 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4039/8169] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:35:39 2022] GET /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:35:40.678280 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-36bc2aaf-2618-411a-aa9f-6895337df9f1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:35:40.678997 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-36bc2aaf-2618-411a-aa9f-6895337df9f1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 9679f4c2-8963-459e-8001-ceeed8c92dd5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:35:40.685223 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36bc2aaf-2618-411a-aa9f-6895337df9f1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:35:40.685716 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36bc2aaf-2618-411a-aa9f-6895337df9f1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:35:40.686199 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36bc2aaf-2618-411a-aa9f-6895337df9f1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:35:40.686899 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36bc2aaf-2618-411a-aa9f-6895337df9f1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:35:40.687362 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36bc2aaf-2618-411a-aa9f-6895337df9f1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:35:40.687795 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36bc2aaf-2618-411a-aa9f-6895337df9f1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:35:40.817592 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-36bc2aaf-2618-411a-aa9f-6895337df9f1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:35:40.825430 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-36bc2aaf-2618-411a-aa9f-6895337df9f1 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5" status: 200 len: 1680 microversion: 2.1 time: 0.152313 Oct 23 02:35:40.826024 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4131/8170] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:35:40 2022] GET /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:35:41.849778 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6fe2eea2-53b1-4926-a147-ff56e8047f9f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:35:41.850444 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6fe2eea2-53b1-4926-a147-ff56e8047f9f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 9679f4c2-8963-459e-8001-ceeed8c92dd5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:35:41.858843 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6fe2eea2-53b1-4926-a147-ff56e8047f9f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:35:41.859340 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6fe2eea2-53b1-4926-a147-ff56e8047f9f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:35:41.859791 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6fe2eea2-53b1-4926-a147-ff56e8047f9f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:35:41.860491 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6fe2eea2-53b1-4926-a147-ff56e8047f9f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:35:41.860961 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6fe2eea2-53b1-4926-a147-ff56e8047f9f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:35:41.861398 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6fe2eea2-53b1-4926-a147-ff56e8047f9f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:35:41.992024 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6fe2eea2-53b1-4926-a147-ff56e8047f9f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:35:42.000425 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6fe2eea2-53b1-4926-a147-ff56e8047f9f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5" status: 200 len: 1683 microversion: 2.1 time: 0.154589 Oct 23 02:35:42.001064 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4040/8171] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:35:41 2022] GET /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:35:42.099330 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1c8ad8d1-7622-4bd1-b1a9-45190fda57a4 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:35:42.101685 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1c8ad8d1-7622-4bd1-b1a9-45190fda57a4 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 9679f4c2-8963-459e-8001-ceeed8c92dd5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:35:42.109400 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1c8ad8d1-7622-4bd1-b1a9-45190fda57a4 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:35:42.109897 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1c8ad8d1-7622-4bd1-b1a9-45190fda57a4 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:35:42.110374 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1c8ad8d1-7622-4bd1-b1a9-45190fda57a4 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:35:42.111085 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1c8ad8d1-7622-4bd1-b1a9-45190fda57a4 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:35:42.111554 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1c8ad8d1-7622-4bd1-b1a9-45190fda57a4 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:35:42.111994 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1c8ad8d1-7622-4bd1-b1a9-45190fda57a4 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:35:42.182464 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1c8ad8d1-7622-4bd1-b1a9-45190fda57a4 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "POST /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5/action" status: 200 len: 38471 microversion: 2.1 time: 0.086887 Oct 23 02:35:42.183367 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4132/8172] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:35:42 2022] POST /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5/action => generated 38471 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 02:35:43.281408 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1c72ad17-8298-4544-80c4-d9b6d55db9c9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:35:43.281934 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1c72ad17-8298-4544-80c4-d9b6d55db9c9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 9679f4c2-8963-459e-8001-ceeed8c92dd5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:35:43.289051 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c72ad17-8298-4544-80c4-d9b6d55db9c9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:35:43.289807 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c72ad17-8298-4544-80c4-d9b6d55db9c9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:35:43.291023 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c72ad17-8298-4544-80c4-d9b6d55db9c9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:35:43.291384 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-b706d962-4a46-48ae-a4e4-72253cda2bea req-5f769ed4-f4d8-41f9-903e-5e176a6efca3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9679f4c2-8963-459e-8001-ceeed8c92dd5", "tag": "fb3d3714-89fa-4ce5-bf3a-4a4ccba9310c"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:35:43.292187 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c72ad17-8298-4544-80c4-d9b6d55db9c9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:35:43.292899 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c72ad17-8298-4544-80c4-d9b6d55db9c9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:35:43.293637 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1c72ad17-8298-4544-80c4-d9b6d55db9c9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:35:43.302226 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-b706d962-4a46-48ae-a4e4-72253cda2bea req-5f769ed4-f4d8-41f9-903e-5e176a6efca3 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:35:43.303037 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-b706d962-4a46-48ae-a4e4-72253cda2bea req-5f769ed4-f4d8-41f9-903e-5e176a6efca3 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:35:43.303193 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-b706d962-4a46-48ae-a4e4-72253cda2bea req-5f769ed4-f4d8-41f9-903e-5e176a6efca3 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:35:43.315487 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-b706d962-4a46-48ae-a4e4-72253cda2bea req-5f769ed4-f4d8-41f9-903e-5e176a6efca3 service nova] Creating event network-changed:fb3d3714-89fa-4ce5-bf3a-4a4ccba9310c for instance 9679f4c2-8963-459e-8001-ceeed8c92dd5 on n-h2-master-1 Oct 23 02:35:43.320421 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-b706d962-4a46-48ae-a4e4-72253cda2bea req-5f769ed4-f4d8-41f9-903e-5e176a6efca3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033503 Oct 23 02:35:43.321226 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4133/8173] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:35:43.325571 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1c72ad17-8298-4544-80c4-d9b6d55db9c9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 9679f4c2-8963-459e-8001-ceeed8c92dd5] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 02:35:43.604933 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1c72ad17-8298-4544-80c4-d9b6d55db9c9 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5" status: 204 len: 0 microversion: 2.1 time: 0.327254 Oct 23 02:35:43.605812 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4041/8174] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 02:35:43 2022] DELETE /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 02:35:43.615600 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b038281e-71c3-4976-9353-3e71ce899e5b tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:35:43.616638 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b038281e-71c3-4976-9353-3e71ce899e5b tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 9679f4c2-8963-459e-8001-ceeed8c92dd5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:35:43.623558 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b038281e-71c3-4976-9353-3e71ce899e5b tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:35:43.624178 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b038281e-71c3-4976-9353-3e71ce899e5b tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:35:43.624904 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b038281e-71c3-4976-9353-3e71ce899e5b tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:35:43.625615 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b038281e-71c3-4976-9353-3e71ce899e5b tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:35:43.626205 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b038281e-71c3-4976-9353-3e71ce899e5b tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:35:43.633869 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b038281e-71c3-4976-9353-3e71ce899e5b tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:35:43.778326 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b038281e-71c3-4976-9353-3e71ce899e5b tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:35:43.787126 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b038281e-71c3-4976-9353-3e71ce899e5b tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5" status: 200 len: 1689 microversion: 2.1 time: 0.176214 Oct 23 02:35:43.794011 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4134/8175] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:35:43 2022] GET /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5 => generated 1689 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:35:44.815131 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-09ab1c47-c69a-45b8-b2e4-f48a65fee3a8 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:35:44.815755 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-09ab1c47-c69a-45b8-b2e4-f48a65fee3a8 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 9679f4c2-8963-459e-8001-ceeed8c92dd5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:35:44.822698 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09ab1c47-c69a-45b8-b2e4-f48a65fee3a8 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:35:44.823189 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09ab1c47-c69a-45b8-b2e4-f48a65fee3a8 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:35:44.823633 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09ab1c47-c69a-45b8-b2e4-f48a65fee3a8 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:35:44.824330 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09ab1c47-c69a-45b8-b2e4-f48a65fee3a8 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:35:44.824789 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09ab1c47-c69a-45b8-b2e4-f48a65fee3a8 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:35:44.825222 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09ab1c47-c69a-45b8-b2e4-f48a65fee3a8 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:35:44.958638 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-09ab1c47-c69a-45b8-b2e4-f48a65fee3a8 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:35:44.966499 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-09ab1c47-c69a-45b8-b2e4-f48a65fee3a8 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5" status: 200 len: 1689 microversion: 2.1 time: 0.155821 Oct 23 02:35:44.967110 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4042/8176] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:35:44 2022] GET /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5 => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:35:45.990404 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9aed552e-47a8-4685-93c6-5057ff04c986 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:35:45.991028 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9aed552e-47a8-4685-93c6-5057ff04c986 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 9679f4c2-8963-459e-8001-ceeed8c92dd5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:35:45.998420 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9aed552e-47a8-4685-93c6-5057ff04c986 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:35:46.000303 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9aed552e-47a8-4685-93c6-5057ff04c986 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:35:46.000303 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9aed552e-47a8-4685-93c6-5057ff04c986 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:35:46.000303 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9aed552e-47a8-4685-93c6-5057ff04c986 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:35:46.000647 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9aed552e-47a8-4685-93c6-5057ff04c986 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:35:46.000874 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9aed552e-47a8-4685-93c6-5057ff04c986 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:35:46.064436 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9aed552e-47a8-4685-93c6-5057ff04c986 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:35:46.073585 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9aed552e-47a8-4685-93c6-5057ff04c986 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5" status: 200 len: 1503 microversion: 2.1 time: 0.087192 Oct 23 02:35:46.074202 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4135/8177] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:35:45 2022] GET /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5 => generated 1503 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:35:46.123503 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-3b1a6801-8dcd-403e-88cc-cf87d073af03 req-230481a2-345b-44bf-a9ae-09e74e0eb97a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9679f4c2-8963-459e-8001-ceeed8c92dd5", "name": "network-vif-deleted", "tag": "fb3d3714-89fa-4ce5-bf3a-4a4ccba9310c"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:35:46.133552 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-3b1a6801-8dcd-403e-88cc-cf87d073af03 req-230481a2-345b-44bf-a9ae-09e74e0eb97a service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:35:46.137800 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-3b1a6801-8dcd-403e-88cc-cf87d073af03 req-230481a2-345b-44bf-a9ae-09e74e0eb97a service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:35:46.137800 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-3b1a6801-8dcd-403e-88cc-cf87d073af03 req-230481a2-345b-44bf-a9ae-09e74e0eb97a service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:35:46.145812 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-3b1a6801-8dcd-403e-88cc-cf87d073af03 req-230481a2-345b-44bf-a9ae-09e74e0eb97a service nova] Creating event network-vif-deleted:fb3d3714-89fa-4ce5-bf3a-4a4ccba9310c for instance 9679f4c2-8963-459e-8001-ceeed8c92dd5 on n-h2-master-1 Oct 23 02:35:46.150770 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-3b1a6801-8dcd-403e-88cc-cf87d073af03 req-230481a2-345b-44bf-a9ae-09e74e0eb97a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030989 Oct 23 02:35:46.151358 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4043/8178] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:35:47.096666 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-87052807-d725-4e7b-b81b-747428e4995f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:35:47.097339 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-87052807-d725-4e7b-b81b-747428e4995f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 9679f4c2-8963-459e-8001-ceeed8c92dd5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:35:47.104480 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-87052807-d725-4e7b-b81b-747428e4995f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:35:47.104967 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-87052807-d725-4e7b-b81b-747428e4995f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:35:47.105408 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-87052807-d725-4e7b-b81b-747428e4995f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:35:47.106128 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-87052807-d725-4e7b-b81b-747428e4995f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:35:47.106592 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-87052807-d725-4e7b-b81b-747428e4995f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:35:47.107040 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-87052807-d725-4e7b-b81b-747428e4995f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:35:47.139002 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-87052807-d725-4e7b-b81b-747428e4995f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:35:47.139496 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-87052807-d725-4e7b-b81b-747428e4995f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:35:47.139936 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-87052807-d725-4e7b-b81b-747428e4995f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:35:47.140383 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-87052807-d725-4e7b-b81b-747428e4995f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lazy-loading 'fault' on Instance uuid 9679f4c2-8963-459e-8001-ceeed8c92dd5 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:35:47.180766 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-87052807-d725-4e7b-b81b-747428e4995f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44ce41e0ba0434a91710af395b8af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '028ee2f0bfd246d0a4abebdcbea26588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:35:47.188552 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-87052807-d725-4e7b-b81b-747428e4995f tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5" status: 200 len: 1357 microversion: 2.1 time: 0.095794 Oct 23 02:35:47.189119 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4136/8179] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:35:47 2022] GET /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5 => generated 1357 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:35:48.214635 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-02acb4d3-a7f3-4873-8a06-41e8a6064c8b tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:35:48.215270 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-02acb4d3-a7f3-4873-8a06-41e8a6064c8b tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] [instance: 9679f4c2-8963-459e-8001-ceeed8c92dd5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:35:48.221454 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-02acb4d3-a7f3-4873-8a06-41e8a6064c8b tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:35:48.221952 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-02acb4d3-a7f3-4873-8a06-41e8a6064c8b tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:35:48.222430 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-02acb4d3-a7f3-4873-8a06-41e8a6064c8b tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:35:48.223138 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-02acb4d3-a7f3-4873-8a06-41e8a6064c8b tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:35:48.223610 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-02acb4d3-a7f3-4873-8a06-41e8a6064c8b tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:35:48.224051 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-02acb4d3-a7f3-4873-8a06-41e8a6064c8b tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:35:48.238178 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-02acb4d3-a7f3-4873-8a06-41e8a6064c8b tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] HTTP exception thrown: Instance 9679f4c2-8963-459e-8001-ceeed8c92dd5 could not be found. Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-02acb4d3-a7f3-4873-8a06-41e8a6064c8b tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Request method failure captured: Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5 HTTP/1.1 Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVKaMnNLl9X4D4-6gAQhVcBZVSSCcOxKFjsbsBxA4f4SIgFOSlWnBMD29f0rryuOIMdqOMvvoKKjQiSMc0ZA1OqQJGW_gUJVqrguR3WAgaWcxKTa_raeB5BxXxfu3Ak4NBM55mUf_VprS-3z9k4IWGvX4m2eUIZUD4Artyeb6HB3QnJs Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: 028ee2f0bfd246d0a4abebdcbea26588 Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1311565393 Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/028ee2f0bfd246d0a4abebdcbea26588"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_028ee2f0bfd246d0a4abebdcbea26588"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/028ee2f0bfd246d0a4abebdcbea26588"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/028ee2f0bfd246d0a4abebdcbea26588"}]}] Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1311565393 Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: 028ee2f0bfd246d0a4abebdcbea26588 Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1311565393 Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-TestNetworkAdvancedServerOps-1311565393-project Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: e44ce41e0ba0434a91710af395b8af29 Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1311565393-project Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: exception: Instance 9679f4c2-8963-459e-8001-ceeed8c92dd5 could not be found. Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': '9679f4c2-8963-459e-8001-ceeed8c92dd5'} Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9679f4c2-8963-459e-8001-ceeed8c92dd5 could not be found. Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9679f4c2-8963-459e-8001-ceeed8c92dd5 could not be found. Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:35:48.239806 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:35:48.245466 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:35:48.245466 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:35:48.245466 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:35:48.245466 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:35:48.245466 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:35:48.245466 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:35:48.245466 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9679f4c2-8963-459e-8001-ceeed8c92dd5 could not be found. Oct 23 02:35:48.245466 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:35:48.245466 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-02acb4d3-a7f3-4873-8a06-41e8a6064c8b tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Returning 404 to user: Instance 9679f4c2-8963-459e-8001-ceeed8c92dd5 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:35:48.245466 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-02acb4d3-a7f3-4873-8a06-41e8a6064c8b tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "GET /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5" status: 404 len: 111 microversion: 2.1 time: 0.032497 Oct 23 02:35:48.245466 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4044/8180] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:35:48 2022] GET /compute/v2.1/servers/9679f4c2-8963-459e-8001-ceeed8c92dd5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 02:35:51.958175 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0857c85e-f81e-4cc9-a072-671c610cac80 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] Calling method '.version_select at 0x7f5cc2640af0>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:35:52.033586 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0857c85e-f81e-4cc9-a072-671c610cac80 tempest-TestNetworkAdvancedServerOps-1311565393 tempest-TestNetworkAdvancedServerOps-1311565393-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1311752774" status: 202 len: 0 microversion: 2.1 time: 0.079290 Oct 23 02:35:52.034154 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4137/8181] 10.222.0.42 () {58 vars in 1284 bytes} [Sun Oct 23 02:35:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1311752774 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:36:06.201088 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:36:06.201843 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:36:06.373108 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-896052d6-c57e-4053-8dde-ffb8e5415384 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Action: 'create', calling method: .version_select at 0x7f5cc2430670>, body: {"keypair": {"name": "tempest-TestShelveInstance-1927497840", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjCsI1fWK9FQ1ji8gO7g9BTxB3U6vID3+tej7aIb0GNRTP2iITvfYy0Rn0RYFfOAaGmEv/WR5Cn+P6NdmsEGJIpDNp5aYXvXIPuHTvX2bYfOorSNg5ptgJ9lSSH4O9NEw=="}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:36:06.389522 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-896052d6-c57e-4053-8dde-ffb8e5415384 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Getting quotas for project 5e890001bec0490b9b30f77183adb688. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:36:06.394653 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-896052d6-c57e-4053-8dde-ffb8e5415384 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Getting quotas for user 2d9860012bc34d4dab2679d24d51266b and project 5e890001bec0490b9b30f77183adb688. Resources: {'key_pairs'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:36:06.507971 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-896052d6-c57e-4053-8dde-ffb8e5415384 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.312515 Oct 23 02:36:06.509085 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4045/8182] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 02:36:06 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:36:08.806950 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:36:08.807719 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:36:08.811747 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c0e5f917-9b0e-4cd8-b403-bc124eccc358 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1838121213", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1927497840", "security_groups": [{"name": "tempest-secgroup-smoke-52374428"}], "networks": [{"uuid": "6181d419-23a1-4a23-8ca4-00074240b750"}]}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:36:08.922658 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.network.neutron [None req-c0e5f917-9b0e-4cd8-b403-bc124eccc358 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] validate_networks() for [('6181d419-23a1-4a23-8ca4-00074240b750', None, None, None, None, None)] {{(pid=120944) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 02:36:09.386601 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-c0e5f917-9b0e-4cd8-b403-bc124eccc358 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Flavor limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:36:09.387151 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-c0e5f917-9b0e-4cd8-b403-bc124eccc358 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Image limits 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:36:09.387730 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-c0e5f917-9b0e-4cd8-b403-bc124eccc358 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Flavor pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:36:09.388356 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-c0e5f917-9b0e-4cd8-b403-bc124eccc358 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Image pref 0:0:0 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:36:09.388777 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.virt.hardware [None req-c0e5f917-9b0e-4cd8-b403-bc124eccc358 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:36:09.398429 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c0e5f917-9b0e-4cd8-b403-bc124eccc358 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:36:09.398911 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c0e5f917-9b0e-4cd8-b403-bc124eccc358 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:36:09.399926 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c0e5f917-9b0e-4cd8-b403-bc124eccc358 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:36:09.400633 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c0e5f917-9b0e-4cd8-b403-bc124eccc358 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:36:09.401089 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c0e5f917-9b0e-4cd8-b403-bc124eccc358 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:36:09.401514 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c0e5f917-9b0e-4cd8-b403-bc124eccc358 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:36:09.421098 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-c0e5f917-9b0e-4cd8-b403-bc124eccc358 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Getting quotas for project 5e890001bec0490b9b30f77183adb688. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:36:09.427078 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-c0e5f917-9b0e-4cd8-b403-bc124eccc358 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Getting quotas for user 2d9860012bc34d4dab2679d24d51266b and project 5e890001bec0490b9b30f77183adb688. Resources: {'instances', 'ram', 'cores'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:36:09.442292 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c0e5f917-9b0e-4cd8-b403-bc124eccc358 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Going to run 1 instances... {{(pid=120944) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 02:36:09.444708 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c0e5f917-9b0e-4cd8-b403-bc124eccc358 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 02:36:09.578090 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c0e5f917-9b0e-4cd8-b403-bc124eccc358 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.773589 Oct 23 02:36:09.578937 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4138/8183] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 02:36:08 2022] POST /compute/v2.1/servers => generated 404 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 02:36:09.592137 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-88c5a115-68a6-451e-ad46-eecda8ca4a6c tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:36:09.596435 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-88c5a115-68a6-451e-ad46-eecda8ca4a6c tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:36:09.659484 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-88c5a115-68a6-451e-ad46-eecda8ca4a6c tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:36:09.669994 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-88c5a115-68a6-451e-ad46-eecda8ca4a6c tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1247 microversion: 2.1 time: 0.083391 Oct 23 02:36:09.670779 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4046/8184] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:36:09 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1247 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:36:10.694461 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-40a5a38e-e653-4341-84ab-fce3d6b3904b tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:36:10.695088 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-40a5a38e-e653-4341-84ab-fce3d6b3904b tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:36:10.702413 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-40a5a38e-e653-4341-84ab-fce3d6b3904b tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:36:10.702909 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-40a5a38e-e653-4341-84ab-fce3d6b3904b tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:36:10.703352 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-40a5a38e-e653-4341-84ab-fce3d6b3904b tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:36:10.704121 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-40a5a38e-e653-4341-84ab-fce3d6b3904b tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:36:10.704509 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-40a5a38e-e653-4341-84ab-fce3d6b3904b tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:36:10.704939 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-40a5a38e-e653-4341-84ab-fce3d6b3904b tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:36:10.766572 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-40a5a38e-e653-4341-84ab-fce3d6b3904b tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:36:10.774226 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-40a5a38e-e653-4341-84ab-fce3d6b3904b tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1251 microversion: 2.1 time: 0.084933 Oct 23 02:36:10.774803 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4139/8185] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:36:10 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1251 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:36:11.797025 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-74e74948-377c-4dfe-b924-dfb3b5248ab2 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:36:11.797632 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-74e74948-377c-4dfe-b924-dfb3b5248ab2 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:36:11.800042 n-d-master-1 devstack@n-api.service[120945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 23 02:36:11.800193 n-d-master-1 devstack@n-api.service[120945]: Sun Oct 23 02:36:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 (ip 10.222.0.42) !!! Oct 23 02:36:11.813400 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-74e74948-377c-4dfe-b924-dfb3b5248ab2 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:36:11.813896 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-74e74948-377c-4dfe-b924-dfb3b5248ab2 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:36:11.814369 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-74e74948-377c-4dfe-b924-dfb3b5248ab2 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:36:11.815075 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-74e74948-377c-4dfe-b924-dfb3b5248ab2 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:36:11.815537 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-74e74948-377c-4dfe-b924-dfb3b5248ab2 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:36:11.815969 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-74e74948-377c-4dfe-b924-dfb3b5248ab2 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:36:11.889713 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-74e74948-377c-4dfe-b924-dfb3b5248ab2 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:36:11.897560 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-74e74948-377c-4dfe-b924-dfb3b5248ab2 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1299 microversion: 2.1 time: 0.104678 Oct 23 02:36:11.898264 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4047/8186] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:36:11 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1299 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:36:12.922259 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3ad7b66c-ac14-4acd-ab5a-9ff98d96e881 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:36:12.923041 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3ad7b66c-ac14-4acd-ab5a-9ff98d96e881 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:36:12.929962 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3ad7b66c-ac14-4acd-ab5a-9ff98d96e881 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:36:12.930480 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3ad7b66c-ac14-4acd-ab5a-9ff98d96e881 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:36:12.930921 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3ad7b66c-ac14-4acd-ab5a-9ff98d96e881 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:36:12.933103 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3ad7b66c-ac14-4acd-ab5a-9ff98d96e881 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:36:12.933581 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3ad7b66c-ac14-4acd-ab5a-9ff98d96e881 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:36:12.934040 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3ad7b66c-ac14-4acd-ab5a-9ff98d96e881 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:36:13.081073 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3ad7b66c-ac14-4acd-ab5a-9ff98d96e881 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:36:13.089560 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3ad7b66c-ac14-4acd-ab5a-9ff98d96e881 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1371 microversion: 2.1 time: 0.171303 Oct 23 02:36:13.090258 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4140/8187] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:36:12 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:36:13.683686 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-b868d1b9-1c7f-46c6-b988-37c4fde46fbc req-1c71954d-ab78-4b05-9ef0-c6aee7e84f6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfbf6a5f-03cc-4706-bf09-497b7398f765", "tag": "91f1dbf1-5d0b-4fe3-9152-0dc70f308b41"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:36:13.694345 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-b868d1b9-1c7f-46c6-b988-37c4fde46fbc req-1c71954d-ab78-4b05-9ef0-c6aee7e84f6a service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:36:13.694844 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-b868d1b9-1c7f-46c6-b988-37c4fde46fbc req-1c71954d-ab78-4b05-9ef0-c6aee7e84f6a service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:36:13.695526 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-b868d1b9-1c7f-46c6-b988-37c4fde46fbc req-1c71954d-ab78-4b05-9ef0-c6aee7e84f6a service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:36:13.706967 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-b868d1b9-1c7f-46c6-b988-37c4fde46fbc req-1c71954d-ab78-4b05-9ef0-c6aee7e84f6a service nova] Creating event network-changed:91f1dbf1-5d0b-4fe3-9152-0dc70f308b41 for instance cfbf6a5f-03cc-4706-bf09-497b7398f765 on n-h2-master-1 Oct 23 02:36:13.711909 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-b868d1b9-1c7f-46c6-b988-37c4fde46fbc req-1c71954d-ab78-4b05-9ef0-c6aee7e84f6a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032962 Oct 23 02:36:13.712919 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4048/8188] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:36:14.116151 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0dd22d71-9d8c-4aed-a17b-0861801edba4 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:36:14.116797 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0dd22d71-9d8c-4aed-a17b-0861801edba4 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:36:14.124188 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0dd22d71-9d8c-4aed-a17b-0861801edba4 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:36:14.124679 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0dd22d71-9d8c-4aed-a17b-0861801edba4 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:36:14.125116 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0dd22d71-9d8c-4aed-a17b-0861801edba4 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:36:14.125806 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0dd22d71-9d8c-4aed-a17b-0861801edba4 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:36:14.126286 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0dd22d71-9d8c-4aed-a17b-0861801edba4 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:36:14.126713 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0dd22d71-9d8c-4aed-a17b-0861801edba4 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:36:14.260794 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0dd22d71-9d8c-4aed-a17b-0861801edba4 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:36:14.268818 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0dd22d71-9d8c-4aed-a17b-0861801edba4 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1371 microversion: 2.1 time: 0.156520 Oct 23 02:36:14.269454 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4141/8189] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:36:14 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:36:15.293361 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8bbbb530-4af4-481f-91ae-09e0d75b95ac tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:36:15.294127 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8bbbb530-4af4-481f-91ae-09e0d75b95ac tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:36:15.300480 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8bbbb530-4af4-481f-91ae-09e0d75b95ac tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:36:15.301152 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8bbbb530-4af4-481f-91ae-09e0d75b95ac tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:36:15.301655 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8bbbb530-4af4-481f-91ae-09e0d75b95ac tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:36:15.302326 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8bbbb530-4af4-481f-91ae-09e0d75b95ac tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:36:15.302795 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8bbbb530-4af4-481f-91ae-09e0d75b95ac tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:36:15.303227 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8bbbb530-4af4-481f-91ae-09e0d75b95ac tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:36:15.435091 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8bbbb530-4af4-481f-91ae-09e0d75b95ac tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:36:15.442885 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8bbbb530-4af4-481f-91ae-09e0d75b95ac tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1371 microversion: 2.1 time: 0.154585 Oct 23 02:36:15.443448 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4049/8190] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:36:15 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:36:16.466774 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a1456c12-4038-4e7a-b780-2eed4862eb6e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:36:16.467487 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a1456c12-4038-4e7a-b780-2eed4862eb6e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:36:16.474570 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a1456c12-4038-4e7a-b780-2eed4862eb6e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:36:16.475059 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a1456c12-4038-4e7a-b780-2eed4862eb6e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:36:16.475500 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a1456c12-4038-4e7a-b780-2eed4862eb6e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:36:16.476202 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a1456c12-4038-4e7a-b780-2eed4862eb6e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:36:16.476663 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a1456c12-4038-4e7a-b780-2eed4862eb6e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:36:16.477092 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a1456c12-4038-4e7a-b780-2eed4862eb6e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:36:16.610012 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a1456c12-4038-4e7a-b780-2eed4862eb6e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:36:16.617883 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a1456c12-4038-4e7a-b780-2eed4862eb6e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1371 microversion: 2.1 time: 0.155776 Oct 23 02:36:16.618485 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4142/8191] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:36:16 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:36:17.640582 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-337d669f-807c-4122-9bf2-54fdb5df6311 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:36:17.641168 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-337d669f-807c-4122-9bf2-54fdb5df6311 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:36:17.648146 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-337d669f-807c-4122-9bf2-54fdb5df6311 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:36:17.648645 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-337d669f-807c-4122-9bf2-54fdb5df6311 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:36:17.649098 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-337d669f-807c-4122-9bf2-54fdb5df6311 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:36:17.649798 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-337d669f-807c-4122-9bf2-54fdb5df6311 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:36:17.650804 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-337d669f-807c-4122-9bf2-54fdb5df6311 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:36:17.651250 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-337d669f-807c-4122-9bf2-54fdb5df6311 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:36:17.783477 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-337d669f-807c-4122-9bf2-54fdb5df6311 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:36:17.791209 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-337d669f-807c-4122-9bf2-54fdb5df6311 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1371 microversion: 2.1 time: 0.154714 Oct 23 02:36:17.791793 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4050/8192] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:36:17 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:36:18.813779 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7b219866-d8e8-414d-954d-f548224c2b06 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:36:18.814426 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7b219866-d8e8-414d-954d-f548224c2b06 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:36:18.821548 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b219866-d8e8-414d-954d-f548224c2b06 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:36:18.822095 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b219866-d8e8-414d-954d-f548224c2b06 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:36:18.822541 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b219866-d8e8-414d-954d-f548224c2b06 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:36:18.823235 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b219866-d8e8-414d-954d-f548224c2b06 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:36:18.823761 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b219866-d8e8-414d-954d-f548224c2b06 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:36:18.824190 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7b219866-d8e8-414d-954d-f548224c2b06 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:36:18.960789 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7b219866-d8e8-414d-954d-f548224c2b06 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:36:18.969240 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7b219866-d8e8-414d-954d-f548224c2b06 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1371 microversion: 2.1 time: 0.159448 Oct 23 02:36:18.974722 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4143/8193] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:36:18 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:36:18.994459 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-6c157326-3f50-4c34-aa85-7ed1c7edf2be req-2c0743f2-b399-4d38-bc93-744c96bacddf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfbf6a5f-03cc-4706-bf09-497b7398f765", "name": "network-vif-plugged", "status": "completed", "tag": "91f1dbf1-5d0b-4fe3-9152-0dc70f308b41"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:36:19.017225 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-6c157326-3f50-4c34-aa85-7ed1c7edf2be req-2c0743f2-b399-4d38-bc93-744c96bacddf service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:36:19.017225 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-6c157326-3f50-4c34-aa85-7ed1c7edf2be req-2c0743f2-b399-4d38-bc93-744c96bacddf service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:36:19.017225 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-6c157326-3f50-4c34-aa85-7ed1c7edf2be req-2c0743f2-b399-4d38-bc93-744c96bacddf service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:36:19.017225 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-6c157326-3f50-4c34-aa85-7ed1c7edf2be req-2c0743f2-b399-4d38-bc93-744c96bacddf service nova] Creating event network-vif-plugged:91f1dbf1-5d0b-4fe3-9152-0dc70f308b41 for instance cfbf6a5f-03cc-4706-bf09-497b7398f765 on n-h2-master-1 Oct 23 02:36:19.020488 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-6c157326-3f50-4c34-aa85-7ed1c7edf2be req-2c0743f2-b399-4d38-bc93-744c96bacddf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087588 Oct 23 02:36:19.021092 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4051/8194] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:36:19.993579 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2b20e498-0300-48e5-bc37-31e59a00882a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:36:19.994187 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2b20e498-0300-48e5-bc37-31e59a00882a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:36:19.996014 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:36:19.996690 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=6 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:36:20.002381 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2b20e498-0300-48e5-bc37-31e59a00882a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:36:20.002875 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2b20e498-0300-48e5-bc37-31e59a00882a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:36:20.003323 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2b20e498-0300-48e5-bc37-31e59a00882a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:36:20.004014 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2b20e498-0300-48e5-bc37-31e59a00882a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:36:20.004477 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2b20e498-0300-48e5-bc37-31e59a00882a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:36:20.004908 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2b20e498-0300-48e5-bc37-31e59a00882a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:36:20.133887 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2b20e498-0300-48e5-bc37-31e59a00882a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:36:20.142091 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2b20e498-0300-48e5-bc37-31e59a00882a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1371 microversion: 2.1 time: 0.152588 Oct 23 02:36:20.142886 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4144/8195] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:36:19 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:36:21.161917 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=6 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:36:21.166920 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b0f077e6-8134-444d-8772-3a9c9f31a48e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:36:21.167639 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b0f077e6-8134-444d-8772-3a9c9f31a48e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:36:21.173813 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b0f077e6-8134-444d-8772-3a9c9f31a48e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:36:21.174352 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b0f077e6-8134-444d-8772-3a9c9f31a48e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:36:21.174801 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b0f077e6-8134-444d-8772-3a9c9f31a48e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:36:21.175504 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b0f077e6-8134-444d-8772-3a9c9f31a48e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:36:21.175976 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b0f077e6-8134-444d-8772-3a9c9f31a48e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:36:21.176413 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b0f077e6-8134-444d-8772-3a9c9f31a48e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:36:21.308048 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b0f077e6-8134-444d-8772-3a9c9f31a48e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:36:21.315832 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b0f077e6-8134-444d-8772-3a9c9f31a48e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1554 microversion: 2.1 time: 0.154869 Oct 23 02:36:21.316410 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4052/8196] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:36:21 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:36:21.339599 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a9a1ed1e-cfec-4551-a640-6cdc04f8eae9 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:36:21.340329 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a9a1ed1e-cfec-4551-a640-6cdc04f8eae9 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:36:21.347442 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a9a1ed1e-cfec-4551-a640-6cdc04f8eae9 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:36:21.347927 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a9a1ed1e-cfec-4551-a640-6cdc04f8eae9 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:36:21.348364 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a9a1ed1e-cfec-4551-a640-6cdc04f8eae9 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:36:21.349054 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a9a1ed1e-cfec-4551-a640-6cdc04f8eae9 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:36:21.349508 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a9a1ed1e-cfec-4551-a640-6cdc04f8eae9 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:36:21.349933 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a9a1ed1e-cfec-4551-a640-6cdc04f8eae9 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:36:21.484522 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a9a1ed1e-cfec-4551-a640-6cdc04f8eae9 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:36:21.492364 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a9a1ed1e-cfec-4551-a640-6cdc04f8eae9 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1554 microversion: 2.1 time: 0.157463 Oct 23 02:36:21.492941 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4145/8197] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:36:21 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:36:23.365753 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-079b6754-0f2f-4cc5-8e05-f20e19cb6173 req-94e7bb64-6803-4093-9f04-7fe205f67038 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfbf6a5f-03cc-4706-bf09-497b7398f765", "tag": "91f1dbf1-5d0b-4fe3-9152-0dc70f308b41"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:36:23.376217 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-079b6754-0f2f-4cc5-8e05-f20e19cb6173 req-94e7bb64-6803-4093-9f04-7fe205f67038 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:36:23.376717 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-079b6754-0f2f-4cc5-8e05-f20e19cb6173 req-94e7bb64-6803-4093-9f04-7fe205f67038 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:36:23.377161 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-079b6754-0f2f-4cc5-8e05-f20e19cb6173 req-94e7bb64-6803-4093-9f04-7fe205f67038 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:36:23.388415 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-079b6754-0f2f-4cc5-8e05-f20e19cb6173 req-94e7bb64-6803-4093-9f04-7fe205f67038 service nova] Creating event network-changed:91f1dbf1-5d0b-4fe3-9152-0dc70f308b41 for instance cfbf6a5f-03cc-4706-bf09-497b7398f765 on n-h2-master-1 Oct 23 02:36:23.393304 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-079b6754-0f2f-4cc5-8e05-f20e19cb6173 req-94e7bb64-6803-4093-9f04-7fe205f67038 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031286 Oct 23 02:36:23.393918 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4053/8198] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:38:20.610190 n-d-master-1 devstack@n-api.service[120944]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ed487b5d-fedf-4013-b387-a53679baa86e] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 23 02:38:20.611378 n-d-master-1 devstack@n-api.service[120944]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6e68fc69-29cc-49a6-b869-84458cd5ea3f] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 23 02:38:20.611977 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:38:20.612735 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=44 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:38:20.613679 n-d-master-1 devstack@n-api.service[120944]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 23 02:38:20.613826 n-d-master-1 devstack@n-api.service[120944]: Sun Oct 23 02:38:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765/action (ip 10.222.0.42) !!! Oct 23 02:38:20.618682 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a522a205-8cb1-4dff-929d-6a4c846232a4 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:38:20.629512 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a522a205-8cb1-4dff-929d-6a4c846232a4 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:38:20.629512 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a522a205-8cb1-4dff-929d-6a4c846232a4 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:20.629512 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a522a205-8cb1-4dff-929d-6a4c846232a4 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:20.629512 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a522a205-8cb1-4dff-929d-6a4c846232a4 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:20.629512 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a522a205-8cb1-4dff-929d-6a4c846232a4 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:20.629512 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a522a205-8cb1-4dff-929d-6a4c846232a4 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:20.629512 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a522a205-8cb1-4dff-929d-6a4c846232a4 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:20.655551 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.objects.instance [None req-a522a205-8cb1-4dff-929d-6a4c846232a4 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lazy-loading 'flavor' on Instance uuid cfbf6a5f-03cc-4706-bf09-497b7398f765 {{(pid=120944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:38:21.111769 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a522a205-8cb1-4dff-929d-6a4c846232a4 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "POST /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765/action" status: 202 len: 0 microversion: 2.1 time: 0.503490 Oct 23 02:38:21.112380 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4146/8199] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:38:20 2022] POST /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765/action => generated 0 bytes in 505 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:38:21.119912 n-d-master-1 devstack@n-api.service[120945]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dc6b279b-942d-4b38-8231-bb7b36b63253] AMQP server on 10.222.0.42:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 23 02:38:21.120656 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:38:21.121416 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=30 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:38:21.122838 n-d-master-1 devstack@n-api.service[120945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 23 02:38:21.128004 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-97980cd3-cd31-4621-87eb-c47daef4379d tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:38:21.132572 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-97980cd3-cd31-4621-87eb-c47daef4379d tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:38:21.135731 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-97980cd3-cd31-4621-87eb-c47daef4379d tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:21.136228 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-97980cd3-cd31-4621-87eb-c47daef4379d tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:21.136670 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-97980cd3-cd31-4621-87eb-c47daef4379d tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:21.137868 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-97980cd3-cd31-4621-87eb-c47daef4379d tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:21.138359 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-97980cd3-cd31-4621-87eb-c47daef4379d tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:21.138789 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-97980cd3-cd31-4621-87eb-c47daef4379d tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:21.273769 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-97980cd3-cd31-4621-87eb-c47daef4379d tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:38:21.282250 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-97980cd3-cd31-4621-87eb-c47daef4379d tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1679 microversion: 2.1 time: 0.165134 Oct 23 02:38:21.282841 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4054/8200] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:38:21 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:38:22.309108 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2cbcef33-5217-461f-8bca-c23cd9561dff tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:38:22.309815 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2cbcef33-5217-461f-8bca-c23cd9561dff tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:38:22.320023 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2cbcef33-5217-461f-8bca-c23cd9561dff tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:22.320543 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2cbcef33-5217-461f-8bca-c23cd9561dff tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:22.320987 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2cbcef33-5217-461f-8bca-c23cd9561dff tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:22.321688 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2cbcef33-5217-461f-8bca-c23cd9561dff tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:22.322187 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2cbcef33-5217-461f-8bca-c23cd9561dff tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:22.322708 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2cbcef33-5217-461f-8bca-c23cd9561dff tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:22.326744 n-d-master-1 devstack@n-api.service[120944]: INFO oslo.messaging._drivers.impl_rabbit [-] [6e68fc69-29cc-49a6-b869-84458cd5ea3f] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 39934. Oct 23 02:38:22.331937 n-d-master-1 devstack@n-api.service[120944]: INFO oslo.messaging._drivers.impl_rabbit [-] [ed487b5d-fedf-4013-b387-a53679baa86e] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 39932. Oct 23 02:38:22.459385 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2cbcef33-5217-461f-8bca-c23cd9561dff tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:38:22.467716 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2cbcef33-5217-461f-8bca-c23cd9561dff tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1679 microversion: 2.1 time: 0.165560 Oct 23 02:38:22.468299 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4147/8201] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:38:22 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:38:23.492268 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-21daf925-a16e-488b-8312-3fc2dfe9d64e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:38:23.492896 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-21daf925-a16e-488b-8312-3fc2dfe9d64e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:38:23.500810 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-21daf925-a16e-488b-8312-3fc2dfe9d64e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:23.501313 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-21daf925-a16e-488b-8312-3fc2dfe9d64e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:23.501761 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-21daf925-a16e-488b-8312-3fc2dfe9d64e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:23.502512 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-21daf925-a16e-488b-8312-3fc2dfe9d64e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:23.502985 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-21daf925-a16e-488b-8312-3fc2dfe9d64e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:23.503422 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-21daf925-a16e-488b-8312-3fc2dfe9d64e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:23.519495 n-d-master-1 devstack@n-api.service[120945]: INFO oslo.messaging._drivers.impl_rabbit [-] [dc6b279b-942d-4b38-8231-bb7b36b63253] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 39938. Oct 23 02:38:23.635533 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-21daf925-a16e-488b-8312-3fc2dfe9d64e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:38:23.643271 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-21daf925-a16e-488b-8312-3fc2dfe9d64e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1679 microversion: 2.1 time: 0.155544 Oct 23 02:38:23.645410 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4055/8202] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:38:23 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:38:24.667174 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8ad870c8-a2c7-4c9c-a5a8-71d746311a9b tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:38:24.667797 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8ad870c8-a2c7-4c9c-a5a8-71d746311a9b tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:38:24.675257 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ad870c8-a2c7-4c9c-a5a8-71d746311a9b tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:24.675748 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ad870c8-a2c7-4c9c-a5a8-71d746311a9b tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:24.676195 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ad870c8-a2c7-4c9c-a5a8-71d746311a9b tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:24.676886 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ad870c8-a2c7-4c9c-a5a8-71d746311a9b tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:24.677346 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ad870c8-a2c7-4c9c-a5a8-71d746311a9b tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:24.677778 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8ad870c8-a2c7-4c9c-a5a8-71d746311a9b tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:24.810801 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8ad870c8-a2c7-4c9c-a5a8-71d746311a9b tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:38:24.818709 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8ad870c8-a2c7-4c9c-a5a8-71d746311a9b tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1679 microversion: 2.1 time: 0.155515 Oct 23 02:38:24.819292 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4148/8203] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:38:24 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:38:25.841935 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-640a0e48-adf9-48bb-aa1a-d7154b3f8f44 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:38:25.842604 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-640a0e48-adf9-48bb-aa1a-d7154b3f8f44 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:38:25.849376 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-640a0e48-adf9-48bb-aa1a-d7154b3f8f44 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:25.849867 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-640a0e48-adf9-48bb-aa1a-d7154b3f8f44 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:25.850342 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-640a0e48-adf9-48bb-aa1a-d7154b3f8f44 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:25.851035 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-640a0e48-adf9-48bb-aa1a-d7154b3f8f44 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:25.851498 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-640a0e48-adf9-48bb-aa1a-d7154b3f8f44 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:25.851929 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-640a0e48-adf9-48bb-aa1a-d7154b3f8f44 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:25.979845 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-640a0e48-adf9-48bb-aa1a-d7154b3f8f44 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:38:25.987793 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-640a0e48-adf9-48bb-aa1a-d7154b3f8f44 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1679 microversion: 2.1 time: 0.149941 Oct 23 02:38:25.988370 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4056/8204] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:38:25 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:38:27.011683 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d6ece11c-6e1d-4770-ade9-db8045eb354f tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:38:27.012805 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d6ece11c-6e1d-4770-ade9-db8045eb354f tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:38:27.019799 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d6ece11c-6e1d-4770-ade9-db8045eb354f tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:27.020292 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d6ece11c-6e1d-4770-ade9-db8045eb354f tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:27.020738 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d6ece11c-6e1d-4770-ade9-db8045eb354f tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:27.021435 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d6ece11c-6e1d-4770-ade9-db8045eb354f tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:27.021900 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d6ece11c-6e1d-4770-ade9-db8045eb354f tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:27.022363 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d6ece11c-6e1d-4770-ade9-db8045eb354f tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:27.151632 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d6ece11c-6e1d-4770-ade9-db8045eb354f tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:38:27.160031 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d6ece11c-6e1d-4770-ade9-db8045eb354f tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1679 microversion: 2.1 time: 0.152406 Oct 23 02:38:27.160610 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4149/8205] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:38:27 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:38:28.184064 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-99a8cd2d-0cc1-4977-8fe5-568b5038a9f6 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:38:28.184616 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-99a8cd2d-0cc1-4977-8fe5-568b5038a9f6 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:38:28.191737 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-99a8cd2d-0cc1-4977-8fe5-568b5038a9f6 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:28.192275 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-99a8cd2d-0cc1-4977-8fe5-568b5038a9f6 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:28.192730 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-99a8cd2d-0cc1-4977-8fe5-568b5038a9f6 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:28.193468 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-99a8cd2d-0cc1-4977-8fe5-568b5038a9f6 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:28.193942 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-99a8cd2d-0cc1-4977-8fe5-568b5038a9f6 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:28.194414 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-99a8cd2d-0cc1-4977-8fe5-568b5038a9f6 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:28.329588 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-99a8cd2d-0cc1-4977-8fe5-568b5038a9f6 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:38:28.337330 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-99a8cd2d-0cc1-4977-8fe5-568b5038a9f6 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1679 microversion: 2.1 time: 0.157306 Oct 23 02:38:28.337946 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4057/8206] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:38:28 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:38:29.361657 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a77c8edd-8b40-45fb-86f8-2a36429ec683 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:38:29.362339 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a77c8edd-8b40-45fb-86f8-2a36429ec683 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:38:29.369225 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a77c8edd-8b40-45fb-86f8-2a36429ec683 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:29.369724 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a77c8edd-8b40-45fb-86f8-2a36429ec683 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:29.370206 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a77c8edd-8b40-45fb-86f8-2a36429ec683 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:29.370912 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a77c8edd-8b40-45fb-86f8-2a36429ec683 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:29.372011 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a77c8edd-8b40-45fb-86f8-2a36429ec683 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:29.372447 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a77c8edd-8b40-45fb-86f8-2a36429ec683 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:29.501542 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a77c8edd-8b40-45fb-86f8-2a36429ec683 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:38:29.509401 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a77c8edd-8b40-45fb-86f8-2a36429ec683 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1679 microversion: 2.1 time: 0.151878 Oct 23 02:38:29.510030 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4150/8207] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:38:29 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:38:30.532692 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4ebbc957-2096-40ec-aa17-e04d8c217126 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:38:30.533325 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4ebbc957-2096-40ec-aa17-e04d8c217126 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:38:30.540105 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4ebbc957-2096-40ec-aa17-e04d8c217126 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:30.540602 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4ebbc957-2096-40ec-aa17-e04d8c217126 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:30.541050 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4ebbc957-2096-40ec-aa17-e04d8c217126 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:30.541752 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4ebbc957-2096-40ec-aa17-e04d8c217126 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:30.542246 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4ebbc957-2096-40ec-aa17-e04d8c217126 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:30.542689 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4ebbc957-2096-40ec-aa17-e04d8c217126 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:30.675027 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4ebbc957-2096-40ec-aa17-e04d8c217126 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:38:30.682783 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4ebbc957-2096-40ec-aa17-e04d8c217126 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1679 microversion: 2.1 time: 0.154038 Oct 23 02:38:30.683370 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4058/8208] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:38:30 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:38:31.706872 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f706cbdf-d787-4549-8b7e-70096b2e96f8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:38:31.707581 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f706cbdf-d787-4549-8b7e-70096b2e96f8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:38:31.714600 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f706cbdf-d787-4549-8b7e-70096b2e96f8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:31.715949 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f706cbdf-d787-4549-8b7e-70096b2e96f8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:31.716178 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f706cbdf-d787-4549-8b7e-70096b2e96f8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:31.716879 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f706cbdf-d787-4549-8b7e-70096b2e96f8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:31.717337 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f706cbdf-d787-4549-8b7e-70096b2e96f8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:31.717768 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f706cbdf-d787-4549-8b7e-70096b2e96f8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:31.848893 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f706cbdf-d787-4549-8b7e-70096b2e96f8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:38:31.856617 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f706cbdf-d787-4549-8b7e-70096b2e96f8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1679 microversion: 2.1 time: 0.153753 Oct 23 02:38:31.857196 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4151/8209] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:38:31 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:38:32.881121 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a6dd2566-69c5-43a9-8727-a2c0b9928550 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:38:32.881992 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a6dd2566-69c5-43a9-8727-a2c0b9928550 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:38:32.890183 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a6dd2566-69c5-43a9-8727-a2c0b9928550 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:32.890544 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a6dd2566-69c5-43a9-8727-a2c0b9928550 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:32.891001 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a6dd2566-69c5-43a9-8727-a2c0b9928550 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:32.891730 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a6dd2566-69c5-43a9-8727-a2c0b9928550 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:32.892320 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a6dd2566-69c5-43a9-8727-a2c0b9928550 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:32.892767 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a6dd2566-69c5-43a9-8727-a2c0b9928550 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:33.027183 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a6dd2566-69c5-43a9-8727-a2c0b9928550 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:38:33.035428 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a6dd2566-69c5-43a9-8727-a2c0b9928550 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1700 microversion: 2.1 time: 0.158480 Oct 23 02:38:33.035982 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4059/8210] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:38:32 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1700 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:38:34.059784 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-be06569b-de76-4146-8fbe-144be9de53ee tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:38:34.060404 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-be06569b-de76-4146-8fbe-144be9de53ee tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:38:34.067318 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-be06569b-de76-4146-8fbe-144be9de53ee tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:34.067806 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-be06569b-de76-4146-8fbe-144be9de53ee tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:34.068246 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-be06569b-de76-4146-8fbe-144be9de53ee tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:34.068940 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-be06569b-de76-4146-8fbe-144be9de53ee tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:34.069400 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-be06569b-de76-4146-8fbe-144be9de53ee tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:34.069829 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-be06569b-de76-4146-8fbe-144be9de53ee tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:34.206087 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-be06569b-de76-4146-8fbe-144be9de53ee tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:38:34.214145 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-be06569b-de76-4146-8fbe-144be9de53ee tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1700 microversion: 2.1 time: 0.158625 Oct 23 02:38:34.214824 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4152/8211] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:38:34 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1700 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:38:35.238024 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0b69efe0-a41a-46b6-961d-1d70d1ad0908 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:38:35.238657 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0b69efe0-a41a-46b6-961d-1d70d1ad0908 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:38:35.245791 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b69efe0-a41a-46b6-961d-1d70d1ad0908 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:35.246364 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b69efe0-a41a-46b6-961d-1d70d1ad0908 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:35.246813 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b69efe0-a41a-46b6-961d-1d70d1ad0908 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:35.247707 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b69efe0-a41a-46b6-961d-1d70d1ad0908 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:35.248683 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b69efe0-a41a-46b6-961d-1d70d1ad0908 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:35.249121 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0b69efe0-a41a-46b6-961d-1d70d1ad0908 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:35.401027 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0b69efe0-a41a-46b6-961d-1d70d1ad0908 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:38:35.409185 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0b69efe0-a41a-46b6-961d-1d70d1ad0908 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1695 microversion: 2.1 time: 0.175603 Oct 23 02:38:35.430265 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4060/8212] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:38:35 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1695 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:38:36.442660 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-fb018ad1-e604-45a0-8652-afdd4e0776f8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:38:36.443264 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-fb018ad1-e604-45a0-8652-afdd4e0776f8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:38:36.450458 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb018ad1-e604-45a0-8652-afdd4e0776f8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:36.450948 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb018ad1-e604-45a0-8652-afdd4e0776f8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:36.451661 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb018ad1-e604-45a0-8652-afdd4e0776f8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:36.452608 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb018ad1-e604-45a0-8652-afdd4e0776f8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:36.453181 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb018ad1-e604-45a0-8652-afdd4e0776f8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:36.453601 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-fb018ad1-e604-45a0-8652-afdd4e0776f8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:36.608553 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-fb018ad1-e604-45a0-8652-afdd4e0776f8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:38:36.623125 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-fb018ad1-e604-45a0-8652-afdd4e0776f8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1695 microversion: 2.1 time: 0.186392 Oct 23 02:38:36.623813 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4153/8213] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:38:36 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1695 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:38:37.517546 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-21e0602f-fd6e-4726-a01f-246f1483532f req-3cfee2ea-ca7f-48f4-a517-d2fc8d1468b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfbf6a5f-03cc-4706-bf09-497b7398f765", "name": "network-vif-plugged", "status": "completed", "tag": "91f1dbf1-5d0b-4fe3-9152-0dc70f308b41"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:38:37.529205 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-21e0602f-fd6e-4726-a01f-246f1483532f req-3cfee2ea-ca7f-48f4-a517-d2fc8d1468b0 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:37.529711 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-21e0602f-fd6e-4726-a01f-246f1483532f req-3cfee2ea-ca7f-48f4-a517-d2fc8d1468b0 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:37.530199 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-21e0602f-fd6e-4726-a01f-246f1483532f req-3cfee2ea-ca7f-48f4-a517-d2fc8d1468b0 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:37.542319 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-21e0602f-fd6e-4726-a01f-246f1483532f req-3cfee2ea-ca7f-48f4-a517-d2fc8d1468b0 service nova] Creating event network-vif-plugged:91f1dbf1-5d0b-4fe3-9152-0dc70f308b41 for instance cfbf6a5f-03cc-4706-bf09-497b7398f765 on n-h2-master-1 Oct 23 02:38:37.551291 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-21e0602f-fd6e-4726-a01f-246f1483532f req-3cfee2ea-ca7f-48f4-a517-d2fc8d1468b0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033766 Oct 23 02:38:37.551291 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4061/8214] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:38:37.647612 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a54c2ecf-1d0b-4ba2-a705-f39c62ca13c5 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:38:37.648170 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a54c2ecf-1d0b-4ba2-a705-f39c62ca13c5 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:38:37.656336 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a54c2ecf-1d0b-4ba2-a705-f39c62ca13c5 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:37.663800 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a54c2ecf-1d0b-4ba2-a705-f39c62ca13c5 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:37.663800 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a54c2ecf-1d0b-4ba2-a705-f39c62ca13c5 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:37.663800 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a54c2ecf-1d0b-4ba2-a705-f39c62ca13c5 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:37.663800 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a54c2ecf-1d0b-4ba2-a705-f39c62ca13c5 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:37.663800 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a54c2ecf-1d0b-4ba2-a705-f39c62ca13c5 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:37.805158 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a54c2ecf-1d0b-4ba2-a705-f39c62ca13c5 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:38:37.814009 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a54c2ecf-1d0b-4ba2-a705-f39c62ca13c5 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1695 microversion: 2.1 time: 0.170430 Oct 23 02:38:37.814604 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4154/8215] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:38:37 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1695 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:38:38.841343 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-58257a9b-f28b-492d-ac15-41038e27f572 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:38:38.842485 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-58257a9b-f28b-492d-ac15-41038e27f572 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:38:38.849031 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-58257a9b-f28b-492d-ac15-41038e27f572 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:38.849527 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-58257a9b-f28b-492d-ac15-41038e27f572 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:38.850286 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-58257a9b-f28b-492d-ac15-41038e27f572 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:38.851364 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-58257a9b-f28b-492d-ac15-41038e27f572 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:38.852121 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-58257a9b-f28b-492d-ac15-41038e27f572 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:38.852565 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-58257a9b-f28b-492d-ac15-41038e27f572 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:39.000952 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-58257a9b-f28b-492d-ac15-41038e27f572 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:38:39.009006 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-58257a9b-f28b-492d-ac15-41038e27f572 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1695 microversion: 2.1 time: 0.174457 Oct 23 02:38:39.009583 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4062/8216] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:38:38 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1695 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:38:40.034052 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1b8b0043-3d87-4f2f-9467-3e5b63a5f357 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:38:40.034948 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1b8b0043-3d87-4f2f-9467-3e5b63a5f357 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:38:40.042569 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1b8b0043-3d87-4f2f-9467-3e5b63a5f357 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:40.043122 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1b8b0043-3d87-4f2f-9467-3e5b63a5f357 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:40.043574 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1b8b0043-3d87-4f2f-9467-3e5b63a5f357 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:40.044292 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1b8b0043-3d87-4f2f-9467-3e5b63a5f357 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:40.044903 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1b8b0043-3d87-4f2f-9467-3e5b63a5f357 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:40.045347 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1b8b0043-3d87-4f2f-9467-3e5b63a5f357 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:40.200887 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1b8b0043-3d87-4f2f-9467-3e5b63a5f357 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:38:40.209639 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1b8b0043-3d87-4f2f-9467-3e5b63a5f357 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1695 microversion: 2.1 time: 0.180600 Oct 23 02:38:40.210288 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4155/8217] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:38:40 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1695 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:38:41.234780 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c9f0987a-54da-4202-927c-fb5f858d2698 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:38:41.235680 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c9f0987a-54da-4202-927c-fb5f858d2698 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:38:41.242491 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c9f0987a-54da-4202-927c-fb5f858d2698 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:41.242980 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c9f0987a-54da-4202-927c-fb5f858d2698 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:41.243420 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c9f0987a-54da-4202-927c-fb5f858d2698 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:41.244116 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c9f0987a-54da-4202-927c-fb5f858d2698 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:41.244609 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c9f0987a-54da-4202-927c-fb5f858d2698 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:41.245039 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c9f0987a-54da-4202-927c-fb5f858d2698 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:41.389553 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c9f0987a-54da-4202-927c-fb5f858d2698 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:38:41.397916 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c9f0987a-54da-4202-927c-fb5f858d2698 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1695 microversion: 2.1 time: 0.167477 Oct 23 02:38:41.411680 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4063/8218] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:38:41 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1695 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:38:42.423293 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f1943671-c1f0-4f4f-bd00-47d8c6b582ed tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:38:42.424693 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f1943671-c1f0-4f4f-bd00-47d8c6b582ed tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:38:42.432366 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1943671-c1f0-4f4f-bd00-47d8c6b582ed tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:42.432927 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1943671-c1f0-4f4f-bd00-47d8c6b582ed tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:42.433924 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1943671-c1f0-4f4f-bd00-47d8c6b582ed tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:42.434703 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1943671-c1f0-4f4f-bd00-47d8c6b582ed tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:42.435244 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1943671-c1f0-4f4f-bd00-47d8c6b582ed tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:42.435928 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f1943671-c1f0-4f4f-bd00-47d8c6b582ed tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:42.605927 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f1943671-c1f0-4f4f-bd00-47d8c6b582ed tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:38:42.614893 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f1943671-c1f0-4f4f-bd00-47d8c6b582ed tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1695 microversion: 2.1 time: 0.195238 Oct 23 02:38:42.615222 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4156/8219] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:38:42 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1695 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:38:43.639799 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-09c13b9f-d38d-40fb-9970-b2351aa3897a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:38:43.640550 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-09c13b9f-d38d-40fb-9970-b2351aa3897a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:38:43.647539 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09c13b9f-d38d-40fb-9970-b2351aa3897a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:43.648042 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09c13b9f-d38d-40fb-9970-b2351aa3897a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:43.648487 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09c13b9f-d38d-40fb-9970-b2351aa3897a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:43.649219 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09c13b9f-d38d-40fb-9970-b2351aa3897a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:43.649706 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09c13b9f-d38d-40fb-9970-b2351aa3897a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:43.650169 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-09c13b9f-d38d-40fb-9970-b2351aa3897a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:43.791073 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-09c13b9f-d38d-40fb-9970-b2351aa3897a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:38:43.799770 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-09c13b9f-d38d-40fb-9970-b2351aa3897a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1695 microversion: 2.1 time: 0.163935 Oct 23 02:38:43.800364 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4064/8220] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:38:43 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1695 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:38:44.823989 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5ed377be-3bbb-4be1-9fa7-e7033345bea3 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:38:44.824647 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5ed377be-3bbb-4be1-9fa7-e7033345bea3 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:38:44.831542 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5ed377be-3bbb-4be1-9fa7-e7033345bea3 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:44.832040 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5ed377be-3bbb-4be1-9fa7-e7033345bea3 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:44.832485 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5ed377be-3bbb-4be1-9fa7-e7033345bea3 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:44.833188 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5ed377be-3bbb-4be1-9fa7-e7033345bea3 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:44.833652 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5ed377be-3bbb-4be1-9fa7-e7033345bea3 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:44.834127 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5ed377be-3bbb-4be1-9fa7-e7033345bea3 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:44.980107 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5ed377be-3bbb-4be1-9fa7-e7033345bea3 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:38:44.988166 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5ed377be-3bbb-4be1-9fa7-e7033345bea3 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1695 microversion: 2.1 time: 0.168547 Oct 23 02:38:44.988741 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4157/8221] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:38:44 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1695 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:38:46.011815 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7c1435c5-d9c4-4a3a-a838-d12f71d2012e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:38:46.012442 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7c1435c5-d9c4-4a3a-a838-d12f71d2012e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:38:46.019341 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7c1435c5-d9c4-4a3a-a838-d12f71d2012e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:46.019844 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7c1435c5-d9c4-4a3a-a838-d12f71d2012e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:46.020285 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7c1435c5-d9c4-4a3a-a838-d12f71d2012e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:46.020986 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7c1435c5-d9c4-4a3a-a838-d12f71d2012e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:46.021451 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7c1435c5-d9c4-4a3a-a838-d12f71d2012e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:46.021884 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7c1435c5-d9c4-4a3a-a838-d12f71d2012e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:46.152388 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7c1435c5-d9c4-4a3a-a838-d12f71d2012e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:38:46.160189 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7c1435c5-d9c4-4a3a-a838-d12f71d2012e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1677 microversion: 2.1 time: 0.152333 Oct 23 02:38:46.160773 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4065/8222] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:38:46 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:38:47.185272 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-acdec049-cb47-4c7a-bdba-6b9914ada7be tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:38:47.185892 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-acdec049-cb47-4c7a-bdba-6b9914ada7be tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:38:47.192808 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-acdec049-cb47-4c7a-bdba-6b9914ada7be tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:47.193294 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-acdec049-cb47-4c7a-bdba-6b9914ada7be tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:47.193733 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-acdec049-cb47-4c7a-bdba-6b9914ada7be tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:47.194467 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-acdec049-cb47-4c7a-bdba-6b9914ada7be tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:47.194930 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-acdec049-cb47-4c7a-bdba-6b9914ada7be tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:47.195360 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-acdec049-cb47-4c7a-bdba-6b9914ada7be tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:47.326137 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-acdec049-cb47-4c7a-bdba-6b9914ada7be tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:38:47.333943 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-acdec049-cb47-4c7a-bdba-6b9914ada7be tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1677 microversion: 2.1 time: 0.153207 Oct 23 02:38:47.334555 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4158/8223] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:38:47 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:38:48.356580 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4f69f047-a654-4e5a-9462-9293b6956e3a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:38:48.357211 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4f69f047-a654-4e5a-9462-9293b6956e3a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:38:48.364305 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f69f047-a654-4e5a-9462-9293b6956e3a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:48.364802 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f69f047-a654-4e5a-9462-9293b6956e3a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:48.365251 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f69f047-a654-4e5a-9462-9293b6956e3a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:48.365950 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f69f047-a654-4e5a-9462-9293b6956e3a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:48.366441 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f69f047-a654-4e5a-9462-9293b6956e3a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:48.366881 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4f69f047-a654-4e5a-9462-9293b6956e3a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:48.503005 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4f69f047-a654-4e5a-9462-9293b6956e3a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:38:48.510767 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4f69f047-a654-4e5a-9462-9293b6956e3a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1677 microversion: 2.1 time: 0.158089 Oct 23 02:38:48.511905 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4066/8224] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:38:48 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:38:49.535127 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-36853005-3295-481b-a637-135885bf0c67 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:38:49.536325 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-36853005-3295-481b-a637-135885bf0c67 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:38:49.536472 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-636ac165-e0e3-476a-a525-fe0a8f6d9877 req-24b07dd0-0800-46cf-8f26-2e061c2e2231 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfbf6a5f-03cc-4706-bf09-497b7398f765", "name": "network-vif-unplugged", "status": "completed", "tag": "91f1dbf1-5d0b-4fe3-9152-0dc70f308b41"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:38:49.543056 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36853005-3295-481b-a637-135885bf0c67 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:49.546433 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36853005-3295-481b-a637-135885bf0c67 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:49.546433 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36853005-3295-481b-a637-135885bf0c67 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:49.546433 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36853005-3295-481b-a637-135885bf0c67 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:49.546433 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36853005-3295-481b-a637-135885bf0c67 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:49.546433 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-36853005-3295-481b-a637-135885bf0c67 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:49.546942 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-636ac165-e0e3-476a-a525-fe0a8f6d9877 req-24b07dd0-0800-46cf-8f26-2e061c2e2231 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:49.547177 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-636ac165-e0e3-476a-a525-fe0a8f6d9877 req-24b07dd0-0800-46cf-8f26-2e061c2e2231 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:49.547617 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-636ac165-e0e3-476a-a525-fe0a8f6d9877 req-24b07dd0-0800-46cf-8f26-2e061c2e2231 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:49.558613 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.compute.server_external_events [req-636ac165-e0e3-476a-a525-fe0a8f6d9877 req-24b07dd0-0800-46cf-8f26-2e061c2e2231 service nova] Unable to find a host for instance cfbf6a5f-03cc-4706-bf09-497b7398f765. Dropping event network-vif-unplugged {{(pid=120945) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 23 02:38:49.559504 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-636ac165-e0e3-476a-a525-fe0a8f6d9877 req-24b07dd0-0800-46cf-8f26-2e061c2e2231 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027290 Oct 23 02:38:49.560261 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4067/8225] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 23 02:38:49.680499 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-36853005-3295-481b-a637-135885bf0c67 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:38:49.687769 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-36853005-3295-481b-a637-135885bf0c67 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1620 microversion: 2.1 time: 0.156615 Oct 23 02:38:49.688350 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4159/8226] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:38:49 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1620 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:38:49.710851 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-315b942c-9854-43e0-be5f-8ae4f5c42350 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:38:49.711466 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-315b942c-9854-43e0-be5f-8ae4f5c42350 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:38:49.718006 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-315b942c-9854-43e0-be5f-8ae4f5c42350 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:49.718538 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-315b942c-9854-43e0-be5f-8ae4f5c42350 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:49.718961 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-315b942c-9854-43e0-be5f-8ae4f5c42350 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:49.719660 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-315b942c-9854-43e0-be5f-8ae4f5c42350 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:49.720132 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-315b942c-9854-43e0-be5f-8ae4f5c42350 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:49.720573 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-315b942c-9854-43e0-be5f-8ae4f5c42350 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:49.814015 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-315b942c-9854-43e0-be5f-8ae4f5c42350 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120945) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 23 02:38:50.198620 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-315b942c-9854-43e0-be5f-8ae4f5c42350 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "POST /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765/action" status: 202 len: 0 microversion: 2.1 time: 0.491778 Oct 23 02:38:50.199251 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4068/8227] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:38:49 2022] POST /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765/action => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:38:50.207283 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9a6c4c77-7c7b-40d4-a669-d09a42a35e7a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:38:50.207914 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9a6c4c77-7c7b-40d4-a669-d09a42a35e7a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:38:50.213923 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9a6c4c77-7c7b-40d4-a669-d09a42a35e7a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:50.214434 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9a6c4c77-7c7b-40d4-a669-d09a42a35e7a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:50.214879 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9a6c4c77-7c7b-40d4-a669-d09a42a35e7a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:50.215588 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9a6c4c77-7c7b-40d4-a669-d09a42a35e7a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:50.216058 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9a6c4c77-7c7b-40d4-a669-d09a42a35e7a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:50.216493 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9a6c4c77-7c7b-40d4-a669-d09a42a35e7a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:50.235197 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:38:50.351934 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9a6c4c77-7c7b-40d4-a669-d09a42a35e7a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:38:50.360673 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9a6c4c77-7c7b-40d4-a669-d09a42a35e7a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1628 microversion: 2.1 time: 0.157264 Oct 23 02:38:50.364667 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4160/8228] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:38:50 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1628 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:38:51.385936 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6d3fc6d4-8c3c-4cd9-902e-0e6ea0abe8df tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:38:51.387169 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6d3fc6d4-8c3c-4cd9-902e-0e6ea0abe8df tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:38:51.393179 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6d3fc6d4-8c3c-4cd9-902e-0e6ea0abe8df tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:51.393701 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6d3fc6d4-8c3c-4cd9-902e-0e6ea0abe8df tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:51.394157 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6d3fc6d4-8c3c-4cd9-902e-0e6ea0abe8df tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:51.394859 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6d3fc6d4-8c3c-4cd9-902e-0e6ea0abe8df tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:51.395329 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6d3fc6d4-8c3c-4cd9-902e-0e6ea0abe8df tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:51.395770 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6d3fc6d4-8c3c-4cd9-902e-0e6ea0abe8df tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:51.400814 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:38:51.531163 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6d3fc6d4-8c3c-4cd9-902e-0e6ea0abe8df tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:38:51.538762 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6d3fc6d4-8c3c-4cd9-902e-0e6ea0abe8df tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1628 microversion: 2.1 time: 0.157685 Oct 23 02:38:51.552644 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4069/8229] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:38:51 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1628 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:38:52.563956 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-316649a6-c3a9-4015-82a3-ac8aeee5ae34 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:38:52.564564 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-316649a6-c3a9-4015-82a3-ac8aeee5ae34 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:38:52.566561 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=31 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:38:52.571948 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-316649a6-c3a9-4015-82a3-ac8aeee5ae34 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:52.572083 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-316649a6-c3a9-4015-82a3-ac8aeee5ae34 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:52.572521 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-316649a6-c3a9-4015-82a3-ac8aeee5ae34 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:52.573223 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-316649a6-c3a9-4015-82a3-ac8aeee5ae34 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:52.574202 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-316649a6-c3a9-4015-82a3-ac8aeee5ae34 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:52.574629 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-316649a6-c3a9-4015-82a3-ac8aeee5ae34 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:52.767648 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-316649a6-c3a9-4015-82a3-ac8aeee5ae34 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:38:52.775703 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-316649a6-c3a9-4015-82a3-ac8aeee5ae34 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1686 microversion: 2.1 time: 0.216655 Oct 23 02:38:52.776291 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4161/8230] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:38:52 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1686 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:38:53.800076 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a11b9008-4de5-4e84-ba9a-913e98809ea6 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:38:53.801353 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a11b9008-4de5-4e84-ba9a-913e98809ea6 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:38:53.803902 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:38:53.808969 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a11b9008-4de5-4e84-ba9a-913e98809ea6 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:53.809485 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a11b9008-4de5-4e84-ba9a-913e98809ea6 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:53.809933 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a11b9008-4de5-4e84-ba9a-913e98809ea6 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:53.810670 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a11b9008-4de5-4e84-ba9a-913e98809ea6 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:53.811167 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a11b9008-4de5-4e84-ba9a-913e98809ea6 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:53.811595 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a11b9008-4de5-4e84-ba9a-913e98809ea6 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:53.978384 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a11b9008-4de5-4e84-ba9a-913e98809ea6 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:38:53.989270 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a11b9008-4de5-4e84-ba9a-913e98809ea6 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1686 microversion: 2.1 time: 0.193468 Oct 23 02:38:53.989875 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4070/8231] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:38:53 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1686 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:38:54.044425 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-b6c4aa9d-50de-409d-9851-c4264d1f3bc9 req-ec8f6e90-d406-4cce-a8bc-a6094ebf73eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfbf6a5f-03cc-4706-bf09-497b7398f765", "tag": "91f1dbf1-5d0b-4fe3-9152-0dc70f308b41"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:38:54.054063 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-b6c4aa9d-50de-409d-9851-c4264d1f3bc9 req-ec8f6e90-d406-4cce-a8bc-a6094ebf73eb service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:54.054559 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-b6c4aa9d-50de-409d-9851-c4264d1f3bc9 req-ec8f6e90-d406-4cce-a8bc-a6094ebf73eb service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:54.055001 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-b6c4aa9d-50de-409d-9851-c4264d1f3bc9 req-ec8f6e90-d406-4cce-a8bc-a6094ebf73eb service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:54.066560 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-b6c4aa9d-50de-409d-9851-c4264d1f3bc9 req-ec8f6e90-d406-4cce-a8bc-a6094ebf73eb service nova] Creating event network-changed:91f1dbf1-5d0b-4fe3-9152-0dc70f308b41 for instance cfbf6a5f-03cc-4706-bf09-497b7398f765 on n-h1-master-1 Oct 23 02:38:54.072218 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-b6c4aa9d-50de-409d-9851-c4264d1f3bc9 req-ec8f6e90-d406-4cce-a8bc-a6094ebf73eb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099923 Oct 23 02:38:54.072980 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4162/8232] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:38:55.014216 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0a3ccfd6-dec6-44e6-a35a-aaf5994297b3 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:38:55.015625 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0a3ccfd6-dec6-44e6-a35a-aaf5994297b3 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:38:55.024608 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0a3ccfd6-dec6-44e6-a35a-aaf5994297b3 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:55.025562 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0a3ccfd6-dec6-44e6-a35a-aaf5994297b3 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:55.026043 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0a3ccfd6-dec6-44e6-a35a-aaf5994297b3 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:55.027268 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0a3ccfd6-dec6-44e6-a35a-aaf5994297b3 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:55.027742 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0a3ccfd6-dec6-44e6-a35a-aaf5994297b3 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:55.028219 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0a3ccfd6-dec6-44e6-a35a-aaf5994297b3 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:55.301692 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0a3ccfd6-dec6-44e6-a35a-aaf5994297b3 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:38:55.311453 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0a3ccfd6-dec6-44e6-a35a-aaf5994297b3 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1686 microversion: 2.1 time: 0.301970 Oct 23 02:38:55.312809 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4071/8233] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:38:55 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1686 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:38:56.340835 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-e1454e4a-c759-4741-ac0f-9d3de1146efd tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:38:56.341579 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-e1454e4a-c759-4741-ac0f-9d3de1146efd tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:38:56.362852 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e1454e4a-c759-4741-ac0f-9d3de1146efd tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:56.363375 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e1454e4a-c759-4741-ac0f-9d3de1146efd tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:56.363902 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e1454e4a-c759-4741-ac0f-9d3de1146efd tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:56.370729 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e1454e4a-c759-4741-ac0f-9d3de1146efd tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:56.371475 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e1454e4a-c759-4741-ac0f-9d3de1146efd tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:56.372112 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-e1454e4a-c759-4741-ac0f-9d3de1146efd tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:56.561047 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-e1454e4a-c759-4741-ac0f-9d3de1146efd tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:38:56.569133 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-e1454e4a-c759-4741-ac0f-9d3de1146efd tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1686 microversion: 2.1 time: 0.233571 Oct 23 02:38:56.569769 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4163/8234] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:38:56 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1686 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:38:57.596996 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ece82687-3b4b-4079-ac3f-f164aacd7c70 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:38:57.598548 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ece82687-3b4b-4079-ac3f-f164aacd7c70 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:38:57.607061 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ece82687-3b4b-4079-ac3f-f164aacd7c70 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:57.607554 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ece82687-3b4b-4079-ac3f-f164aacd7c70 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:57.608006 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ece82687-3b4b-4079-ac3f-f164aacd7c70 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:57.608713 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ece82687-3b4b-4079-ac3f-f164aacd7c70 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:57.609175 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ece82687-3b4b-4079-ac3f-f164aacd7c70 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:57.609602 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ece82687-3b4b-4079-ac3f-f164aacd7c70 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:57.753797 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ece82687-3b4b-4079-ac3f-f164aacd7c70 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:38:57.762155 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ece82687-3b4b-4079-ac3f-f164aacd7c70 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1686 microversion: 2.1 time: 0.170839 Oct 23 02:38:57.762732 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4072/8235] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:38:57 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1686 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:38:58.785689 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-396725d8-c58b-412f-bf00-1c4b23c78165 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:38:58.786362 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-396725d8-c58b-412f-bf00-1c4b23c78165 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:38:58.793389 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-396725d8-c58b-412f-bf00-1c4b23c78165 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:58.793879 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-396725d8-c58b-412f-bf00-1c4b23c78165 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:58.794344 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-396725d8-c58b-412f-bf00-1c4b23c78165 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:58.795044 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-396725d8-c58b-412f-bf00-1c4b23c78165 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:58.795497 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-396725d8-c58b-412f-bf00-1c4b23c78165 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:58.795923 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-396725d8-c58b-412f-bf00-1c4b23c78165 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:58.949834 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-396725d8-c58b-412f-bf00-1c4b23c78165 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:38:58.957688 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-396725d8-c58b-412f-bf00-1c4b23c78165 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1686 microversion: 2.1 time: 0.176062 Oct 23 02:38:58.958293 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4164/8236] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:38:58 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1686 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:38:59.980814 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d37e6acb-f6e3-44f3-83f0-6396718434f7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:38:59.981502 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d37e6acb-f6e3-44f3-83f0-6396718434f7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:38:59.988710 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d37e6acb-f6e3-44f3-83f0-6396718434f7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:59.989221 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d37e6acb-f6e3-44f3-83f0-6396718434f7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:59.989674 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d37e6acb-f6e3-44f3-83f0-6396718434f7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:38:59.990416 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d37e6acb-f6e3-44f3-83f0-6396718434f7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:38:59.990885 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d37e6acb-f6e3-44f3-83f0-6396718434f7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:38:59.991323 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d37e6acb-f6e3-44f3-83f0-6396718434f7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:39:00.133241 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d37e6acb-f6e3-44f3-83f0-6396718434f7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:39:00.141669 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d37e6acb-f6e3-44f3-83f0-6396718434f7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1686 microversion: 2.1 time: 0.164829 Oct 23 02:39:00.142295 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4073/8237] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:38:59 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1686 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:39:01.166229 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1def7dbc-a231-468f-8bb7-0fab72fc0e67 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:39:01.167586 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1def7dbc-a231-468f-8bb7-0fab72fc0e67 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:39:01.174947 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1def7dbc-a231-468f-8bb7-0fab72fc0e67 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:39:01.175390 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1def7dbc-a231-468f-8bb7-0fab72fc0e67 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:39:01.175826 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1def7dbc-a231-468f-8bb7-0fab72fc0e67 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:39:01.176533 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1def7dbc-a231-468f-8bb7-0fab72fc0e67 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:39:01.176990 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1def7dbc-a231-468f-8bb7-0fab72fc0e67 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:39:01.177414 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1def7dbc-a231-468f-8bb7-0fab72fc0e67 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:39:01.321783 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1def7dbc-a231-468f-8bb7-0fab72fc0e67 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:39:01.329611 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1def7dbc-a231-468f-8bb7-0fab72fc0e67 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1686 microversion: 2.1 time: 0.167642 Oct 23 02:39:01.330233 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4165/8238] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:39:01 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1686 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:39:02.353739 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a2df29df-2d35-411b-a127-a293499b5be3 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:39:02.354906 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a2df29df-2d35-411b-a127-a293499b5be3 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:39:02.362239 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a2df29df-2d35-411b-a127-a293499b5be3 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:39:02.362735 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a2df29df-2d35-411b-a127-a293499b5be3 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:39:02.363184 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a2df29df-2d35-411b-a127-a293499b5be3 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:39:02.363892 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a2df29df-2d35-411b-a127-a293499b5be3 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:39:02.364359 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a2df29df-2d35-411b-a127-a293499b5be3 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:39:02.364795 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a2df29df-2d35-411b-a127-a293499b5be3 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:39:02.523564 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a2df29df-2d35-411b-a127-a293499b5be3 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:39:02.532059 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a2df29df-2d35-411b-a127-a293499b5be3 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1686 microversion: 2.1 time: 0.182215 Oct 23 02:39:02.532645 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4074/8239] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:39:02 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1686 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:39:03.556314 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2f34c744-961b-4a8e-b25b-18300859c1ed tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:39:03.556937 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2f34c744-961b-4a8e-b25b-18300859c1ed tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:39:03.564399 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f34c744-961b-4a8e-b25b-18300859c1ed tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:39:03.564885 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f34c744-961b-4a8e-b25b-18300859c1ed tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:39:03.565323 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f34c744-961b-4a8e-b25b-18300859c1ed tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:39:03.566044 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f34c744-961b-4a8e-b25b-18300859c1ed tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:39:03.566502 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f34c744-961b-4a8e-b25b-18300859c1ed tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:39:03.566928 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2f34c744-961b-4a8e-b25b-18300859c1ed tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:39:03.710178 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2f34c744-961b-4a8e-b25b-18300859c1ed tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:39:03.719021 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2f34c744-961b-4a8e-b25b-18300859c1ed tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1686 microversion: 2.1 time: 0.166560 Oct 23 02:39:03.730329 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4166/8240] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:39:03 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1686 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:39:04.744369 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-415ed5d5-75a5-4227-8e76-868640436efc tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:39:04.745631 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-415ed5d5-75a5-4227-8e76-868640436efc tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:39:04.752730 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-415ed5d5-75a5-4227-8e76-868640436efc tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:39:04.753267 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-415ed5d5-75a5-4227-8e76-868640436efc tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:39:04.753712 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-415ed5d5-75a5-4227-8e76-868640436efc tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:39:04.754445 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-415ed5d5-75a5-4227-8e76-868640436efc tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:39:04.754954 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-415ed5d5-75a5-4227-8e76-868640436efc tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:39:04.755388 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-415ed5d5-75a5-4227-8e76-868640436efc tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:39:04.894504 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-415ed5d5-75a5-4227-8e76-868640436efc tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:39:04.902989 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-415ed5d5-75a5-4227-8e76-868640436efc tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1686 microversion: 2.1 time: 0.163840 Oct 23 02:39:04.903564 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4075/8241] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:39:04 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1686 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:39:05.927061 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-cce085cf-bffe-4f91-becc-601a0fbf30dd tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:39:05.927685 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-cce085cf-bffe-4f91-becc-601a0fbf30dd tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:39:05.935228 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cce085cf-bffe-4f91-becc-601a0fbf30dd tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:39:05.935715 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cce085cf-bffe-4f91-becc-601a0fbf30dd tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:39:05.936147 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cce085cf-bffe-4f91-becc-601a0fbf30dd tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:39:05.936835 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cce085cf-bffe-4f91-becc-601a0fbf30dd tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:39:05.937291 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cce085cf-bffe-4f91-becc-601a0fbf30dd tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:39:05.937719 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-cce085cf-bffe-4f91-becc-601a0fbf30dd tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:39:06.066436 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-cce085cf-bffe-4f91-becc-601a0fbf30dd tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:39:06.074424 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-cce085cf-bffe-4f91-becc-601a0fbf30dd tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1686 microversion: 2.1 time: 0.151320 Oct 23 02:39:06.075185 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4167/8242] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:39:05 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1686 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:39:07.098364 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-56ceb51e-4530-4007-bd78-43685a62820a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:39:07.098997 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-56ceb51e-4530-4007-bd78-43685a62820a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:39:07.105788 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-56ceb51e-4530-4007-bd78-43685a62820a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:39:07.106313 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-56ceb51e-4530-4007-bd78-43685a62820a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:39:07.106777 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-56ceb51e-4530-4007-bd78-43685a62820a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:39:07.107455 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-56ceb51e-4530-4007-bd78-43685a62820a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:39:07.107922 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-56ceb51e-4530-4007-bd78-43685a62820a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:39:07.108363 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-56ceb51e-4530-4007-bd78-43685a62820a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:39:07.239561 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-56ceb51e-4530-4007-bd78-43685a62820a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:39:07.247802 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-56ceb51e-4530-4007-bd78-43685a62820a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1686 microversion: 2.1 time: 0.153502 Oct 23 02:39:07.248386 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4076/8243] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:39:07 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1686 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:39:08.271775 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c746db2d-e252-4a83-a5ec-85d1c9a2f7a4 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:39:08.272393 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c746db2d-e252-4a83-a5ec-85d1c9a2f7a4 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:39:08.279937 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c746db2d-e252-4a83-a5ec-85d1c9a2f7a4 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:39:08.280417 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c746db2d-e252-4a83-a5ec-85d1c9a2f7a4 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:39:08.280853 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c746db2d-e252-4a83-a5ec-85d1c9a2f7a4 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:39:08.281537 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c746db2d-e252-4a83-a5ec-85d1c9a2f7a4 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:39:08.282014 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c746db2d-e252-4a83-a5ec-85d1c9a2f7a4 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:39:08.282442 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c746db2d-e252-4a83-a5ec-85d1c9a2f7a4 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:39:08.415243 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c746db2d-e252-4a83-a5ec-85d1c9a2f7a4 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:39:08.423012 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c746db2d-e252-4a83-a5ec-85d1c9a2f7a4 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1686 microversion: 2.1 time: 0.155120 Oct 23 02:39:08.423583 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4168/8244] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:39:08 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1686 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:39:09.446613 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-01a0ac62-73fc-4f14-8632-43b39947a9f4 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:39:09.447311 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-01a0ac62-73fc-4f14-8632-43b39947a9f4 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:39:09.454409 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-01a0ac62-73fc-4f14-8632-43b39947a9f4 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:39:09.454989 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-01a0ac62-73fc-4f14-8632-43b39947a9f4 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:39:09.455617 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-01a0ac62-73fc-4f14-8632-43b39947a9f4 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:39:09.456315 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-01a0ac62-73fc-4f14-8632-43b39947a9f4 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:39:09.456859 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-01a0ac62-73fc-4f14-8632-43b39947a9f4 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:39:09.457355 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-01a0ac62-73fc-4f14-8632-43b39947a9f4 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:39:09.595651 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-01a0ac62-73fc-4f14-8632-43b39947a9f4 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:39:09.603469 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-01a0ac62-73fc-4f14-8632-43b39947a9f4 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1686 microversion: 2.1 time: 0.160892 Oct 23 02:39:09.604087 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4077/8245] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:39:09 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1686 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:39:10.627886 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-309f7272-56f7-4f57-b2c8-a3ca16b259c8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:39:10.628550 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-309f7272-56f7-4f57-b2c8-a3ca16b259c8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:39:10.635574 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-309f7272-56f7-4f57-b2c8-a3ca16b259c8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:39:10.636069 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-309f7272-56f7-4f57-b2c8-a3ca16b259c8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:39:10.636513 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-309f7272-56f7-4f57-b2c8-a3ca16b259c8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:39:10.637210 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-309f7272-56f7-4f57-b2c8-a3ca16b259c8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:39:10.637676 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-309f7272-56f7-4f57-b2c8-a3ca16b259c8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:39:10.638144 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-309f7272-56f7-4f57-b2c8-a3ca16b259c8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:39:10.772982 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-309f7272-56f7-4f57-b2c8-a3ca16b259c8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:39:10.781250 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-309f7272-56f7-4f57-b2c8-a3ca16b259c8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1686 microversion: 2.1 time: 0.157348 Oct 23 02:39:10.781836 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4169/8246] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:39:10 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1686 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:39:11.385687 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-c6bcb820-d1b7-40a2-b7fc-76afcc6350a8 req-4d8de408-5237-4c3a-b9f8-d9d2e550a0d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfbf6a5f-03cc-4706-bf09-497b7398f765", "name": "network-vif-plugged", "status": "completed", "tag": "91f1dbf1-5d0b-4fe3-9152-0dc70f308b41"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:39:11.396216 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-c6bcb820-d1b7-40a2-b7fc-76afcc6350a8 req-4d8de408-5237-4c3a-b9f8-d9d2e550a0d1 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:39:11.396738 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-c6bcb820-d1b7-40a2-b7fc-76afcc6350a8 req-4d8de408-5237-4c3a-b9f8-d9d2e550a0d1 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:39:11.397185 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-c6bcb820-d1b7-40a2-b7fc-76afcc6350a8 req-4d8de408-5237-4c3a-b9f8-d9d2e550a0d1 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:39:11.409044 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-c6bcb820-d1b7-40a2-b7fc-76afcc6350a8 req-4d8de408-5237-4c3a-b9f8-d9d2e550a0d1 service nova] Creating event network-vif-plugged:91f1dbf1-5d0b-4fe3-9152-0dc70f308b41 for instance cfbf6a5f-03cc-4706-bf09-497b7398f765 on n-h1-master-1 Oct 23 02:39:11.414190 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-c6bcb820-d1b7-40a2-b7fc-76afcc6350a8 req-4d8de408-5237-4c3a-b9f8-d9d2e550a0d1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032963 Oct 23 02:39:11.415173 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4078/8247] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:39:11.805349 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f88e6242-f160-4433-9f2e-0cc7dce00fcd tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:39:11.806059 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f88e6242-f160-4433-9f2e-0cc7dce00fcd tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:39:11.813706 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f88e6242-f160-4433-9f2e-0cc7dce00fcd tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:39:11.814228 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f88e6242-f160-4433-9f2e-0cc7dce00fcd tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:39:11.814702 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f88e6242-f160-4433-9f2e-0cc7dce00fcd tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:39:11.815389 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f88e6242-f160-4433-9f2e-0cc7dce00fcd tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:39:11.815875 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f88e6242-f160-4433-9f2e-0cc7dce00fcd tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:39:11.816301 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f88e6242-f160-4433-9f2e-0cc7dce00fcd tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:39:11.953442 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f88e6242-f160-4433-9f2e-0cc7dce00fcd tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:39:11.961567 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f88e6242-f160-4433-9f2e-0cc7dce00fcd tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1686 microversion: 2.1 time: 0.160076 Oct 23 02:39:11.962129 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4170/8248] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:39:11 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1686 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:39:12.987128 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e66f8a2a-6d10-4845-9422-a308d9e37989 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:39:12.987926 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e66f8a2a-6d10-4845-9422-a308d9e37989 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:39:12.994232 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e66f8a2a-6d10-4845-9422-a308d9e37989 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:39:12.994777 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e66f8a2a-6d10-4845-9422-a308d9e37989 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:39:12.995226 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e66f8a2a-6d10-4845-9422-a308d9e37989 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:39:12.995932 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e66f8a2a-6d10-4845-9422-a308d9e37989 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:39:12.996399 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e66f8a2a-6d10-4845-9422-a308d9e37989 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:39:12.996837 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e66f8a2a-6d10-4845-9422-a308d9e37989 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:39:13.134653 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e66f8a2a-6d10-4845-9422-a308d9e37989 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:39:13.143482 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e66f8a2a-6d10-4845-9422-a308d9e37989 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1686 microversion: 2.1 time: 0.162177 Oct 23 02:39:13.149434 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4079/8249] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:39:12 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1686 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:39:14.166324 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-87a7b8aa-4837-4132-8fda-ba90df5d7d15 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:39:14.167490 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-87a7b8aa-4837-4132-8fda-ba90df5d7d15 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:39:14.174358 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-87a7b8aa-4837-4132-8fda-ba90df5d7d15 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:39:14.174847 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-87a7b8aa-4837-4132-8fda-ba90df5d7d15 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:39:14.175289 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-87a7b8aa-4837-4132-8fda-ba90df5d7d15 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:39:14.175983 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-87a7b8aa-4837-4132-8fda-ba90df5d7d15 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:39:14.176443 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-87a7b8aa-4837-4132-8fda-ba90df5d7d15 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:39:14.176871 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-87a7b8aa-4837-4132-8fda-ba90df5d7d15 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:39:14.308418 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-87a7b8aa-4837-4132-8fda-ba90df5d7d15 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:39:14.316530 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-87a7b8aa-4837-4132-8fda-ba90df5d7d15 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1673 microversion: 2.1 time: 0.154291 Oct 23 02:39:14.317122 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4171/8250] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:39:14 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:40:28.269750 n-d-master-1 devstack@n-api.service[120945]: ERROR oslo.messaging._drivers.impl_rabbit [-] [819a2dfa-4c7a-455f-8870-a072098566e7] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 23 02:40:28.271836 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=21 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:40:28.272892 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=64 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:40:28.273697 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6836f7bf-2828-45c1-87ff-61aecbfd3e01 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:40:28.273842 n-d-master-1 devstack@n-api.service[120944]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 23 02:40:28.274075 n-d-master-1 devstack@n-api.service[120944]: Sun Oct 23 02:40:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.42) !!! Oct 23 02:40:28.274367 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6836f7bf-2828-45c1-87ff-61aecbfd3e01 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:40:28.275436 n-d-master-1 devstack@n-api.service[120944]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 23 02:40:28.275656 n-d-master-1 devstack@n-api.service[120944]: Sun Oct 23 02:40:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.42) !!! Oct 23 02:40:28.277038 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=19 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:40:28.277722 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=61 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:40:28.285437 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6836f7bf-2828-45c1-87ff-61aecbfd3e01 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:40:28.287207 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6836f7bf-2828-45c1-87ff-61aecbfd3e01 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:40:28.287932 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6836f7bf-2828-45c1-87ff-61aecbfd3e01 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:40:28.288831 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6836f7bf-2828-45c1-87ff-61aecbfd3e01 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:40:28.289465 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6836f7bf-2828-45c1-87ff-61aecbfd3e01 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:40:28.290171 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6836f7bf-2828-45c1-87ff-61aecbfd3e01 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:40:28.318424 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6836f7bf-2828-45c1-87ff-61aecbfd3e01 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 02:40:28.342332 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-8d704c5a-62b7-473d-887b-6424be9296e0 req-894f3125-355b-4310-bd9c-40b7e8e3a1e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfbf6a5f-03cc-4706-bf09-497b7398f765", "tag": "91f1dbf1-5d0b-4fe3-9152-0dc70f308b41"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:40:28.353278 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-8d704c5a-62b7-473d-887b-6424be9296e0 req-894f3125-355b-4310-bd9c-40b7e8e3a1e1 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:40:28.353920 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-8d704c5a-62b7-473d-887b-6424be9296e0 req-894f3125-355b-4310-bd9c-40b7e8e3a1e1 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:40:28.354409 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-8d704c5a-62b7-473d-887b-6424be9296e0 req-894f3125-355b-4310-bd9c-40b7e8e3a1e1 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:40:28.370670 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-8d704c5a-62b7-473d-887b-6424be9296e0 req-894f3125-355b-4310-bd9c-40b7e8e3a1e1 service nova] Creating event network-changed:91f1dbf1-5d0b-4fe3-9152-0dc70f308b41 for instance cfbf6a5f-03cc-4706-bf09-497b7398f765 on n-h1-master-1 Oct 23 02:40:28.372483 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-8d704c5a-62b7-473d-887b-6424be9296e0 req-894f3125-355b-4310-bd9c-40b7e8e3a1e1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102759 Oct 23 02:40:28.373290 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4172/8251] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:40:28.611854 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6836f7bf-2828-45c1-87ff-61aecbfd3e01 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "DELETE /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 204 len: 0 microversion: 2.1 time: 0.344186 Oct 23 02:40:28.615961 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4080/8252] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 02:40:28 2022] DELETE /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 02:40:28.622050 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-71213c9f-231d-4e81-b822-e27c37724ae6 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:40:28.622760 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-71213c9f-231d-4e81-b822-e27c37724ae6 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:40:28.629240 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-71213c9f-231d-4e81-b822-e27c37724ae6 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:40:28.629683 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-71213c9f-231d-4e81-b822-e27c37724ae6 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:40:28.630155 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-71213c9f-231d-4e81-b822-e27c37724ae6 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:40:28.630857 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-71213c9f-231d-4e81-b822-e27c37724ae6 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:40:28.631413 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-71213c9f-231d-4e81-b822-e27c37724ae6 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:40:28.631746 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-71213c9f-231d-4e81-b822-e27c37724ae6 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:40:28.764624 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-71213c9f-231d-4e81-b822-e27c37724ae6 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:40:28.772479 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-71213c9f-231d-4e81-b822-e27c37724ae6 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1679 microversion: 2.1 time: 0.155265 Oct 23 02:40:28.773060 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4173/8253] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:40:28 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:40:29.797568 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a724f2bf-629b-4e04-98b1-d8106fc2e048 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:40:29.798252 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a724f2bf-629b-4e04-98b1-d8106fc2e048 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:40:29.806484 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a724f2bf-629b-4e04-98b1-d8106fc2e048 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:40:29.806983 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a724f2bf-629b-4e04-98b1-d8106fc2e048 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:40:29.807432 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a724f2bf-629b-4e04-98b1-d8106fc2e048 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:40:29.808138 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a724f2bf-629b-4e04-98b1-d8106fc2e048 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:40:29.808602 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a724f2bf-629b-4e04-98b1-d8106fc2e048 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:40:29.809044 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a724f2bf-629b-4e04-98b1-d8106fc2e048 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:40:29.825822 n-d-master-1 devstack@n-api.service[120945]: INFO oslo.messaging._drivers.impl_rabbit [-] [819a2dfa-4c7a-455f-8870-a072098566e7] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 40216. Oct 23 02:40:30.051975 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a724f2bf-629b-4e04-98b1-d8106fc2e048 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:40:30.059763 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a724f2bf-629b-4e04-98b1-d8106fc2e048 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1679 microversion: 2.1 time: 0.266616 Oct 23 02:40:30.060338 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4081/8254] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:40:29 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1679 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:40:30.835743 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-98c13ec8-3a32-4b02-9c1d-3778ee5491e3 req-ca9d2192-8cf2-4c1c-ac2b-d4caa75773a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfbf6a5f-03cc-4706-bf09-497b7398f765", "name": "network-vif-deleted", "tag": "91f1dbf1-5d0b-4fe3-9152-0dc70f308b41"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:40:30.846389 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-98c13ec8-3a32-4b02-9c1d-3778ee5491e3 req-ca9d2192-8cf2-4c1c-ac2b-d4caa75773a4 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:40:30.847890 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-98c13ec8-3a32-4b02-9c1d-3778ee5491e3 req-ca9d2192-8cf2-4c1c-ac2b-d4caa75773a4 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:40:30.847890 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-98c13ec8-3a32-4b02-9c1d-3778ee5491e3 req-ca9d2192-8cf2-4c1c-ac2b-d4caa75773a4 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:40:30.858758 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-98c13ec8-3a32-4b02-9c1d-3778ee5491e3 req-ca9d2192-8cf2-4c1c-ac2b-d4caa75773a4 service nova] Creating event network-vif-deleted:91f1dbf1-5d0b-4fe3-9152-0dc70f308b41 for instance cfbf6a5f-03cc-4706-bf09-497b7398f765 on n-h1-master-1 Oct 23 02:40:30.863905 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-98c13ec8-3a32-4b02-9c1d-3778ee5491e3 req-ca9d2192-8cf2-4c1c-ac2b-d4caa75773a4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031987 Oct 23 02:40:30.864495 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4174/8255] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:40:31.083941 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9d29e1cd-1a17-4b1f-ba06-553bf2d0a699 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:40:31.084612 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9d29e1cd-1a17-4b1f-ba06-553bf2d0a699 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:40:31.091864 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d29e1cd-1a17-4b1f-ba06-553bf2d0a699 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:40:31.092364 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d29e1cd-1a17-4b1f-ba06-553bf2d0a699 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:40:31.092815 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d29e1cd-1a17-4b1f-ba06-553bf2d0a699 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:40:31.093517 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d29e1cd-1a17-4b1f-ba06-553bf2d0a699 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:40:31.094006 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d29e1cd-1a17-4b1f-ba06-553bf2d0a699 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:40:31.094501 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d29e1cd-1a17-4b1f-ba06-553bf2d0a699 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:40:31.131574 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d29e1cd-1a17-4b1f-ba06-553bf2d0a699 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:40:31.132091 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d29e1cd-1a17-4b1f-ba06-553bf2d0a699 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:40:31.132544 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d29e1cd-1a17-4b1f-ba06-553bf2d0a699 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:40:31.133011 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-9d29e1cd-1a17-4b1f-ba06-553bf2d0a699 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lazy-loading 'fault' on Instance uuid cfbf6a5f-03cc-4706-bf09-497b7398f765 {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:40:31.181234 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9d29e1cd-1a17-4b1f-ba06-553bf2d0a699 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:40:31.190210 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9d29e1cd-1a17-4b1f-ba06-553bf2d0a699 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 200 len: 1337 microversion: 2.1 time: 0.110267 Oct 23 02:40:31.190925 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4082/8256] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:40:31 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 1337 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:40:32.214894 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ecd4b813-3ea5-4dc2-902a-cacf4bc649a1 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:40:32.215520 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ecd4b813-3ea5-4dc2-902a-cacf4bc649a1 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: cfbf6a5f-03cc-4706-bf09-497b7398f765] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:40:32.221785 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ecd4b813-3ea5-4dc2-902a-cacf4bc649a1 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:40:32.222305 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ecd4b813-3ea5-4dc2-902a-cacf4bc649a1 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:40:32.222750 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ecd4b813-3ea5-4dc2-902a-cacf4bc649a1 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:40:32.223440 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ecd4b813-3ea5-4dc2-902a-cacf4bc649a1 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:40:32.223902 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ecd4b813-3ea5-4dc2-902a-cacf4bc649a1 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:40:32.224335 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ecd4b813-3ea5-4dc2-902a-cacf4bc649a1 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:40:32.237785 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-ecd4b813-3ea5-4dc2-902a-cacf4bc649a1 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] HTTP exception thrown: Instance cfbf6a5f-03cc-4706-bf09-497b7398f765 could not be found. Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ecd4b813-3ea5-4dc2-902a-cacf4bc649a1 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Request method failure captured: Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 HTTP/1.1 Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVKiQh3ZqLY2VFml-tbJ4c3cdBhHPcItnyla2N5Kfpto4ODJerPp-Ic7BAE9IAMS4DzRafJLTwZDPnSPTSiKbWaJAcXfmKWmB7SNOTpO_RDumy3IukE8qJqOtCBFjK_Fgga0TeKddggRz0LPJJ5Q8S5Wh1hOzY_7-5XaCyz_weva4iK0 Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 5e890001bec0490b9b30f77183adb688 Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-TestShelveInstance-1737707503 Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5e890001bec0490b9b30f77183adb688"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5e890001bec0490b9b30f77183adb688"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e890001bec0490b9b30f77183adb688"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e890001bec0490b9b30f77183adb688"}]}] Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-TestShelveInstance-1737707503 Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 5e890001bec0490b9b30f77183adb688 Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-TestShelveInstance-1737707503 Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-TestShelveInstance-1737707503-project Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 2d9860012bc34d4dab2679d24d51266b Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-TestShelveInstance-1737707503-project Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: exception: Instance cfbf6a5f-03cc-4706-bf09-497b7398f765 could not be found. Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'cfbf6a5f-03cc-4706-bf09-497b7398f765'} Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfbf6a5f-03cc-4706-bf09-497b7398f765 could not be found. Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfbf6a5f-03cc-4706-bf09-497b7398f765 could not be found. Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:40:32.239465 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:40:32.245545 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:40:32.245545 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:40:32.245545 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:40:32.245545 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:40:32.245545 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:40:32.245545 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfbf6a5f-03cc-4706-bf09-497b7398f765 could not be found. Oct 23 02:40:32.245545 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:40:32.245545 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ecd4b813-3ea5-4dc2-902a-cacf4bc649a1 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Returning 404 to user: Instance cfbf6a5f-03cc-4706-bf09-497b7398f765 could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:40:32.245545 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ecd4b813-3ea5-4dc2-902a-cacf4bc649a1 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765" status: 404 len: 111 microversion: 2.1 time: 0.031838 Oct 23 02:40:32.245545 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4175/8257] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:40:32 2022] GET /compute/v2.1/servers/cfbf6a5f-03cc-4706-bf09-497b7398f765 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:40:32.477282 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0b7396b7-7c14-4068-bbaf-fe2def142fb8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '.version_select at 0x7f5cc0d41160>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:40:32.482401 n-d-master-1 devstack@n-api.service[120945]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0b7396b7-7c14-4068-bbaf-fe2def142fb8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [b9c85242-4d53-4cfe-8a38-175a3957b7b7] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 23 02:40:33.493837 n-d-master-1 devstack@n-api.service[120945]: INFO oslo.messaging._drivers.impl_rabbit [None req-0b7396b7-7c14-4068-bbaf-fe2def142fb8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [b9c85242-4d53-4cfe-8a38-175a3957b7b7] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 40230. Oct 23 02:40:33.583040 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0b7396b7-7c14-4068-bbaf-fe2def142fb8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1927497840" status: 202 len: 0 microversion: 2.1 time: 1.109542 Oct 23 02:40:33.583664 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4083/8258] 10.222.0.42 () {58 vars in 1254 bytes} [Sun Oct 23 02:40:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1927497840 => generated 0 bytes in 1111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:40:33.610586 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-11c000be-cb84-465e-a388-370cc9e3fd14 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Action: 'create', calling method: .version_select at 0x7f5cc19c4b80>, body: {"keypair": {"name": "tempest-TestShelveInstance-606476367", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCA/WfR4fTcK8SrqUjwr8cludiIh5ka9p7eHHx8vA2YsrEIIh9IcuXBikVH4B9/kQcHtTgchth4nDcF3d4yOLEprDN30ERhDnADdTEZwk6jSLGpZP+DFgmon1FQ0WtEoPA=="}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:40:33.628320 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-11c000be-cb84-465e-a388-370cc9e3fd14 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Getting quotas for project 5e890001bec0490b9b30f77183adb688. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:40:33.635069 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-11c000be-cb84-465e-a388-370cc9e3fd14 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Getting quotas for user 2d9860012bc34d4dab2679d24d51266b and project 5e890001bec0490b9b30f77183adb688. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:40:33.761490 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-11c000be-cb84-465e-a388-370cc9e3fd14 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.154725 Oct 23 02:40:33.762051 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4176/8259] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 02:40:33 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:40:56.758514 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:40:56.759307 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:40:56.764006 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0632489c-2251-43d0-9b11-8397e27baae8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-652032396", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-606476367", "security_groups": [{"name": "tempest-secgroup-smoke-1936077014"}], "networks": [{"uuid": "6181d419-23a1-4a23-8ca4-00074240b750"}], "block_device_mapping_v2": [{"uuid": "1ec313dd-0ccf-4570-8b52-a8a6508f9984", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:40:56.875482 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-0632489c-2251-43d0-9b11-8397e27baae8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] validate_networks() for [('6181d419-23a1-4a23-8ca4-00074240b750', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 02:40:57.233640 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-0632489c-2251-43d0-9b11-8397e27baae8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:40:57.234111 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-0632489c-2251-43d0-9b11-8397e27baae8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:40:57.234605 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-0632489c-2251-43d0-9b11-8397e27baae8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:40:57.235026 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-0632489c-2251-43d0-9b11-8397e27baae8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:40:57.235449 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-0632489c-2251-43d0-9b11-8397e27baae8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:40:57.244636 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0632489c-2251-43d0-9b11-8397e27baae8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:40:57.245140 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0632489c-2251-43d0-9b11-8397e27baae8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:40:57.245588 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0632489c-2251-43d0-9b11-8397e27baae8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:40:57.246428 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0632489c-2251-43d0-9b11-8397e27baae8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:40:57.246903 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0632489c-2251-43d0-9b11-8397e27baae8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:40:57.247337 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0632489c-2251-43d0-9b11-8397e27baae8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:40:57.263834 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-0632489c-2251-43d0-9b11-8397e27baae8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Getting quotas for project 5e890001bec0490b9b30f77183adb688. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:40:57.269099 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-0632489c-2251-43d0-9b11-8397e27baae8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Getting quotas for user 2d9860012bc34d4dab2679d24d51266b and project 5e890001bec0490b9b30f77183adb688. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:40:57.327000 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0632489c-2251-43d0-9b11-8397e27baae8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 02:40:57.329146 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0632489c-2251-43d0-9b11-8397e27baae8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1ec313dd-0ccf-4570-8b52-a8a6508f9984',volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 02:40:57.767631 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0632489c-2251-43d0-9b11-8397e27baae8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.010753 Oct 23 02:40:57.768318 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4084/8260] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 02:40:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 1012 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 02:40:57.777965 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=12 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:40:57.778769 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=4 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:40:57.779404 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:40:57.783439 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-63292569-1bf0-49c9-97be-37cb9e9ff140 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:40:57.784072 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-63292569-1bf0-49c9-97be-37cb9e9ff140 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:40:57.895101 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-63292569-1bf0-49c9-97be-37cb9e9ff140 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:40:57.899166 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-63292569-1bf0-49c9-97be-37cb9e9ff140 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1087 microversion: 2.1 time: 0.123695 Oct 23 02:40:57.899787 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4177/8261] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:40:57 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1087 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:40:58.923775 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ff4b0314-3dd1-42e5-ac91-f5fcace444d7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:40:58.924378 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ff4b0314-3dd1-42e5-ac91-f5fcace444d7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:40:58.932208 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ff4b0314-3dd1-42e5-ac91-f5fcace444d7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:40:58.932715 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ff4b0314-3dd1-42e5-ac91-f5fcace444d7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:40:58.933169 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ff4b0314-3dd1-42e5-ac91-f5fcace444d7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:40:58.933883 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ff4b0314-3dd1-42e5-ac91-f5fcace444d7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:40:58.934380 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ff4b0314-3dd1-42e5-ac91-f5fcace444d7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:40:58.934825 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ff4b0314-3dd1-42e5-ac91-f5fcace444d7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:40:58.995796 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ff4b0314-3dd1-42e5-ac91-f5fcace444d7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:40:59.003822 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ff4b0314-3dd1-42e5-ac91-f5fcace444d7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1137 microversion: 2.1 time: 0.084383 Oct 23 02:40:59.004410 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4085/8262] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:40:58 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1137 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:41:00.026867 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-9767426c-540f-4aa4-8a56-614493e8b737 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:41:00.027498 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-9767426c-540f-4aa4-8a56-614493e8b737 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:41:00.035224 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9767426c-540f-4aa4-8a56-614493e8b737 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:41:00.035725 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9767426c-540f-4aa4-8a56-614493e8b737 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:41:00.036172 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9767426c-540f-4aa4-8a56-614493e8b737 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:41:00.036930 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9767426c-540f-4aa4-8a56-614493e8b737 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:41:00.037402 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9767426c-540f-4aa4-8a56-614493e8b737 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:41:00.037839 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-9767426c-540f-4aa4-8a56-614493e8b737 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:41:00.103439 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-9767426c-540f-4aa4-8a56-614493e8b737 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:41:00.112074 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-9767426c-540f-4aa4-8a56-614493e8b737 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1193 microversion: 2.1 time: 0.089504 Oct 23 02:41:00.112924 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4178/8263] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:41:00 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1193 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:41:01.137195 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-86143f69-f19f-4154-8626-6b268af45622 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:41:01.137852 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-86143f69-f19f-4154-8626-6b268af45622 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:41:01.144937 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-86143f69-f19f-4154-8626-6b268af45622 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:41:01.145442 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-86143f69-f19f-4154-8626-6b268af45622 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:41:01.145886 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-86143f69-f19f-4154-8626-6b268af45622 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:41:01.146647 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-86143f69-f19f-4154-8626-6b268af45622 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:41:01.147110 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-86143f69-f19f-4154-8626-6b268af45622 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:41:01.147546 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-86143f69-f19f-4154-8626-6b268af45622 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:41:01.284546 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-86143f69-f19f-4154-8626-6b268af45622 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:41:01.293483 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-86143f69-f19f-4154-8626-6b268af45622 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1271 microversion: 2.1 time: 0.160999 Oct 23 02:41:01.294438 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4086/8264] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:41:01 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1271 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:41:01.734175 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-dae9d5d1-623b-45d7-bdd3-8176ccf302cb req-44390be7-c048-4cb1-a58c-4a0afdcaeacb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bedeb4ac-623a-4f21-bec8-5fa51610131b", "tag": "3d1dbb05-badc-4a0f-9898-c5b1cb1305f6"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:41:01.747023 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-dae9d5d1-623b-45d7-bdd3-8176ccf302cb req-44390be7-c048-4cb1-a58c-4a0afdcaeacb service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:41:01.752439 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-dae9d5d1-623b-45d7-bdd3-8176ccf302cb req-44390be7-c048-4cb1-a58c-4a0afdcaeacb service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:41:01.752439 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-dae9d5d1-623b-45d7-bdd3-8176ccf302cb req-44390be7-c048-4cb1-a58c-4a0afdcaeacb service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:41:01.759996 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-dae9d5d1-623b-45d7-bdd3-8176ccf302cb req-44390be7-c048-4cb1-a58c-4a0afdcaeacb service nova] Creating event network-changed:3d1dbb05-badc-4a0f-9898-c5b1cb1305f6 for instance bedeb4ac-623a-4f21-bec8-5fa51610131b on n-h2-master-1 Oct 23 02:41:01.765511 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-dae9d5d1-623b-45d7-bdd3-8176ccf302cb req-44390be7-c048-4cb1-a58c-4a0afdcaeacb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035033 Oct 23 02:41:01.766806 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4179/8265] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:41:02.318612 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e1050c40-c4e8-44be-b56f-4e8a20f8a1d9 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:41:02.319612 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e1050c40-c4e8-44be-b56f-4e8a20f8a1d9 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:41:02.326941 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e1050c40-c4e8-44be-b56f-4e8a20f8a1d9 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:41:02.327437 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e1050c40-c4e8-44be-b56f-4e8a20f8a1d9 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:41:02.327880 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e1050c40-c4e8-44be-b56f-4e8a20f8a1d9 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:41:02.328577 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e1050c40-c4e8-44be-b56f-4e8a20f8a1d9 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:41:02.329129 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e1050c40-c4e8-44be-b56f-4e8a20f8a1d9 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:41:02.329555 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e1050c40-c4e8-44be-b56f-4e8a20f8a1d9 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:41:02.464627 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e1050c40-c4e8-44be-b56f-4e8a20f8a1d9 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:41:02.478337 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e1050c40-c4e8-44be-b56f-4e8a20f8a1d9 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1271 microversion: 2.1 time: 0.163780 Oct 23 02:41:02.478978 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4087/8266] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:41:02 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1271 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:41:03.502013 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-dd64c4bc-2b67-419f-ac1f-c938356c382d tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:41:03.502723 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-dd64c4bc-2b67-419f-ac1f-c938356c382d tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:41:03.508851 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd64c4bc-2b67-419f-ac1f-c938356c382d tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:41:03.510041 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd64c4bc-2b67-419f-ac1f-c938356c382d tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:41:03.510041 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd64c4bc-2b67-419f-ac1f-c938356c382d tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:41:03.510523 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd64c4bc-2b67-419f-ac1f-c938356c382d tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:41:03.510978 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd64c4bc-2b67-419f-ac1f-c938356c382d tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:41:03.511405 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-dd64c4bc-2b67-419f-ac1f-c938356c382d tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:41:03.653527 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-dd64c4bc-2b67-419f-ac1f-c938356c382d tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:41:03.661453 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-dd64c4bc-2b67-419f-ac1f-c938356c382d tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1271 microversion: 2.1 time: 0.164529 Oct 23 02:41:03.662089 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4180/8267] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:41:03 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1271 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:41:04.685219 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-27eae34a-2073-4e35-a11f-3203589cee4a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:41:04.685855 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-27eae34a-2073-4e35-a11f-3203589cee4a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:41:04.692584 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-27eae34a-2073-4e35-a11f-3203589cee4a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:41:04.693102 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-27eae34a-2073-4e35-a11f-3203589cee4a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:41:04.693543 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-27eae34a-2073-4e35-a11f-3203589cee4a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:41:04.694276 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-27eae34a-2073-4e35-a11f-3203589cee4a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:41:04.694743 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-27eae34a-2073-4e35-a11f-3203589cee4a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:41:04.695183 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-27eae34a-2073-4e35-a11f-3203589cee4a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:41:04.830682 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-27eae34a-2073-4e35-a11f-3203589cee4a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:41:04.839171 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-27eae34a-2073-4e35-a11f-3203589cee4a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1271 microversion: 2.1 time: 0.158610 Oct 23 02:41:04.839777 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4088/8268] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:41:04 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1271 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:41:05.863575 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d426c050-74e0-4065-8fb6-56faba586cf4 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:41:05.864192 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d426c050-74e0-4065-8fb6-56faba586cf4 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:41:05.872071 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d426c050-74e0-4065-8fb6-56faba586cf4 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:41:05.872568 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d426c050-74e0-4065-8fb6-56faba586cf4 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:41:05.873011 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d426c050-74e0-4065-8fb6-56faba586cf4 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:41:05.873718 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d426c050-74e0-4065-8fb6-56faba586cf4 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:41:05.874236 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d426c050-74e0-4065-8fb6-56faba586cf4 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:41:05.874670 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d426c050-74e0-4065-8fb6-56faba586cf4 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:41:06.053722 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d426c050-74e0-4065-8fb6-56faba586cf4 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:41:06.062662 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d426c050-74e0-4065-8fb6-56faba586cf4 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1271 microversion: 2.1 time: 0.203478 Oct 23 02:41:06.063242 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4181/8269] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:41:05 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1271 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:41:07.084836 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-20e1a1f6-e440-4831-adca-6f798f650386 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:41:07.085469 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-20e1a1f6-e440-4831-adca-6f798f650386 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:41:07.092344 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-20e1a1f6-e440-4831-adca-6f798f650386 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:41:07.092843 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-20e1a1f6-e440-4831-adca-6f798f650386 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:41:07.093295 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-20e1a1f6-e440-4831-adca-6f798f650386 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:41:07.094016 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-20e1a1f6-e440-4831-adca-6f798f650386 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:41:07.094490 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-20e1a1f6-e440-4831-adca-6f798f650386 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:41:07.094930 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-20e1a1f6-e440-4831-adca-6f798f650386 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:41:07.225910 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-20e1a1f6-e440-4831-adca-6f798f650386 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:41:07.233843 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-20e1a1f6-e440-4831-adca-6f798f650386 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1259 microversion: 2.1 time: 0.153015 Oct 23 02:41:07.234549 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4089/8270] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:41:07 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:41:08.257646 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-efbc7d9e-5c7c-443c-9b85-e973cbd0268f tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:41:08.258293 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-efbc7d9e-5c7c-443c-9b85-e973cbd0268f tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:41:08.262643 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=2 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:41:08.266429 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-efbc7d9e-5c7c-443c-9b85-e973cbd0268f tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:41:08.266915 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-efbc7d9e-5c7c-443c-9b85-e973cbd0268f tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:41:08.267353 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-efbc7d9e-5c7c-443c-9b85-e973cbd0268f tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:41:08.268039 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-efbc7d9e-5c7c-443c-9b85-e973cbd0268f tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:41:08.268498 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-efbc7d9e-5c7c-443c-9b85-e973cbd0268f tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:41:08.268973 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-efbc7d9e-5c7c-443c-9b85-e973cbd0268f tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:41:08.399297 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-efbc7d9e-5c7c-443c-9b85-e973cbd0268f tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:41:08.407814 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-efbc7d9e-5c7c-443c-9b85-e973cbd0268f tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1259 microversion: 2.1 time: 0.154004 Oct 23 02:41:08.408384 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4182/8271] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:41:08 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:41:09.430842 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9d1c5a43-2cf9-4d6e-ab6a-efe389b265ac tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:41:09.431407 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9d1c5a43-2cf9-4d6e-ab6a-efe389b265ac tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:41:09.433270 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:41:09.433939 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=6 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:41:09.439546 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d1c5a43-2cf9-4d6e-ab6a-efe389b265ac tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:41:09.440049 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d1c5a43-2cf9-4d6e-ab6a-efe389b265ac tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:41:09.440489 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d1c5a43-2cf9-4d6e-ab6a-efe389b265ac tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:41:09.441184 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d1c5a43-2cf9-4d6e-ab6a-efe389b265ac tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:41:09.441647 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d1c5a43-2cf9-4d6e-ab6a-efe389b265ac tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:41:09.442114 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d1c5a43-2cf9-4d6e-ab6a-efe389b265ac tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:41:09.577660 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9d1c5a43-2cf9-4d6e-ab6a-efe389b265ac tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:41:09.585604 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9d1c5a43-2cf9-4d6e-ab6a-efe389b265ac tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1259 microversion: 2.1 time: 0.158772 Oct 23 02:41:09.586219 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4090/8272] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:41:09 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:41:10.609303 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-969c385a-fab4-4e05-921d-d76c61a752c9 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:41:10.609923 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-969c385a-fab4-4e05-921d-d76c61a752c9 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:41:10.617320 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-969c385a-fab4-4e05-921d-d76c61a752c9 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:41:10.619823 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-969c385a-fab4-4e05-921d-d76c61a752c9 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:41:10.619823 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-969c385a-fab4-4e05-921d-d76c61a752c9 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:41:10.619823 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-969c385a-fab4-4e05-921d-d76c61a752c9 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:41:10.620186 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-969c385a-fab4-4e05-921d-d76c61a752c9 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:41:10.620620 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-969c385a-fab4-4e05-921d-d76c61a752c9 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:41:10.750979 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-969c385a-fab4-4e05-921d-d76c61a752c9 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:41:10.758719 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-969c385a-fab4-4e05-921d-d76c61a752c9 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1259 microversion: 2.1 time: 0.153481 Oct 23 02:41:10.759295 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4183/8273] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:41:10 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:41:11.780872 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e6700194-8cff-408a-9514-d4f5f3d55324 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:41:11.781411 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e6700194-8cff-408a-9514-d4f5f3d55324 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:41:11.788423 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6700194-8cff-408a-9514-d4f5f3d55324 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:41:11.788916 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6700194-8cff-408a-9514-d4f5f3d55324 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:41:11.789404 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6700194-8cff-408a-9514-d4f5f3d55324 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:41:11.790125 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6700194-8cff-408a-9514-d4f5f3d55324 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:41:11.790591 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6700194-8cff-408a-9514-d4f5f3d55324 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:41:11.794107 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e6700194-8cff-408a-9514-d4f5f3d55324 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:41:11.923493 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e6700194-8cff-408a-9514-d4f5f3d55324 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:41:11.931214 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e6700194-8cff-408a-9514-d4f5f3d55324 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1259 microversion: 2.1 time: 0.154349 Oct 23 02:41:11.932443 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4091/8274] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:41:11 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:41:12.954628 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-0bec5330-e7e5-48f1-81f3-d1315d865daf tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:41:12.955250 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-0bec5330-e7e5-48f1-81f3-d1315d865daf tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:41:12.962224 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0bec5330-e7e5-48f1-81f3-d1315d865daf tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:41:12.963212 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0bec5330-e7e5-48f1-81f3-d1315d865daf tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:41:12.963654 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0bec5330-e7e5-48f1-81f3-d1315d865daf tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:41:12.964346 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0bec5330-e7e5-48f1-81f3-d1315d865daf tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:41:12.964807 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0bec5330-e7e5-48f1-81f3-d1315d865daf tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:41:12.965238 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-0bec5330-e7e5-48f1-81f3-d1315d865daf tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:41:13.092694 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-0bec5330-e7e5-48f1-81f3-d1315d865daf tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:41:13.100465 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-0bec5330-e7e5-48f1-81f3-d1315d865daf tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1259 microversion: 2.1 time: 0.149750 Oct 23 02:41:13.101045 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4184/8275] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:41:12 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:41:14.125093 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9176e562-fd0d-4ba5-8b0c-92fda864c8ec tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:41:14.125724 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9176e562-fd0d-4ba5-8b0c-92fda864c8ec tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:41:14.132624 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9176e562-fd0d-4ba5-8b0c-92fda864c8ec tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:41:14.133123 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9176e562-fd0d-4ba5-8b0c-92fda864c8ec tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:41:14.133578 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9176e562-fd0d-4ba5-8b0c-92fda864c8ec tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:41:14.134339 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9176e562-fd0d-4ba5-8b0c-92fda864c8ec tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:41:14.134813 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9176e562-fd0d-4ba5-8b0c-92fda864c8ec tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:41:14.135250 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9176e562-fd0d-4ba5-8b0c-92fda864c8ec tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:41:14.266572 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9176e562-fd0d-4ba5-8b0c-92fda864c8ec tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:41:14.274375 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9176e562-fd0d-4ba5-8b0c-92fda864c8ec tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1259 microversion: 2.1 time: 0.153223 Oct 23 02:41:14.274956 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4092/8276] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:41:14 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:41:15.297273 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c690baed-16a1-4987-8286-aac711a0e7d7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:41:15.297892 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c690baed-16a1-4987-8286-aac711a0e7d7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:41:15.304835 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c690baed-16a1-4987-8286-aac711a0e7d7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:41:15.305330 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c690baed-16a1-4987-8286-aac711a0e7d7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:41:15.305771 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c690baed-16a1-4987-8286-aac711a0e7d7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:41:15.306997 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c690baed-16a1-4987-8286-aac711a0e7d7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:41:15.307459 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c690baed-16a1-4987-8286-aac711a0e7d7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:41:15.307892 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c690baed-16a1-4987-8286-aac711a0e7d7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:41:15.437417 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c690baed-16a1-4987-8286-aac711a0e7d7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:41:15.445242 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c690baed-16a1-4987-8286-aac711a0e7d7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1259 microversion: 2.1 time: 0.151958 Oct 23 02:41:15.445822 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4185/8277] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:41:15 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:41:16.469155 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f35d4b9b-d58b-4175-a969-fd373d500260 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:41:16.469791 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f35d4b9b-d58b-4175-a969-fd373d500260 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:41:16.476853 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f35d4b9b-d58b-4175-a969-fd373d500260 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:41:16.477352 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f35d4b9b-d58b-4175-a969-fd373d500260 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:41:16.477802 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f35d4b9b-d58b-4175-a969-fd373d500260 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:41:16.478675 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f35d4b9b-d58b-4175-a969-fd373d500260 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:41:16.479143 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f35d4b9b-d58b-4175-a969-fd373d500260 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:41:16.479585 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f35d4b9b-d58b-4175-a969-fd373d500260 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:41:16.609219 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f35d4b9b-d58b-4175-a969-fd373d500260 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:41:16.617189 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f35d4b9b-d58b-4175-a969-fd373d500260 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1259 microversion: 2.1 time: 0.151936 Oct 23 02:41:16.617756 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4093/8278] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:41:16 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:41:17.639820 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3a5e25bd-4416-4d2c-87b9-1ca4f8d1b5a2 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:41:17.640438 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3a5e25bd-4416-4d2c-87b9-1ca4f8d1b5a2 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:41:17.647279 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3a5e25bd-4416-4d2c-87b9-1ca4f8d1b5a2 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:41:17.647766 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3a5e25bd-4416-4d2c-87b9-1ca4f8d1b5a2 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:41:17.648201 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3a5e25bd-4416-4d2c-87b9-1ca4f8d1b5a2 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:41:17.648887 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3a5e25bd-4416-4d2c-87b9-1ca4f8d1b5a2 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:41:17.649342 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3a5e25bd-4416-4d2c-87b9-1ca4f8d1b5a2 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:41:17.649766 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3a5e25bd-4416-4d2c-87b9-1ca4f8d1b5a2 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:41:17.785695 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3a5e25bd-4416-4d2c-87b9-1ca4f8d1b5a2 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:41:17.794230 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3a5e25bd-4416-4d2c-87b9-1ca4f8d1b5a2 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1259 microversion: 2.1 time: 0.158283 Oct 23 02:41:17.797461 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4186/8279] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:41:17 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:41:18.350884 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-0c114a25-b024-46f0-b4a0-4391cb07bee7 req-7d5521bb-ac28-4576-be2a-3b981250a8e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bedeb4ac-623a-4f21-bec8-5fa51610131b", "name": "network-vif-plugged", "status": "completed", "tag": "3d1dbb05-badc-4a0f-9898-c5b1cb1305f6"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:41:18.361542 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-0c114a25-b024-46f0-b4a0-4391cb07bee7 req-7d5521bb-ac28-4576-be2a-3b981250a8e1 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:41:18.362066 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-0c114a25-b024-46f0-b4a0-4391cb07bee7 req-7d5521bb-ac28-4576-be2a-3b981250a8e1 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:41:18.362513 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-0c114a25-b024-46f0-b4a0-4391cb07bee7 req-7d5521bb-ac28-4576-be2a-3b981250a8e1 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:41:18.373736 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-0c114a25-b024-46f0-b4a0-4391cb07bee7 req-7d5521bb-ac28-4576-be2a-3b981250a8e1 service nova] Creating event network-vif-plugged:3d1dbb05-badc-4a0f-9898-c5b1cb1305f6 for instance bedeb4ac-623a-4f21-bec8-5fa51610131b on n-h2-master-1 Oct 23 02:41:18.378873 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-0c114a25-b024-46f0-b4a0-4391cb07bee7 req-7d5521bb-ac28-4576-be2a-3b981250a8e1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031841 Oct 23 02:41:18.379463 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4094/8280] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:41:18.818175 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-81c0d961-4447-407d-823c-fb70c49d2312 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:41:18.818798 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-81c0d961-4447-407d-823c-fb70c49d2312 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:41:18.825849 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-81c0d961-4447-407d-823c-fb70c49d2312 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:41:18.826372 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-81c0d961-4447-407d-823c-fb70c49d2312 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:41:18.827172 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-81c0d961-4447-407d-823c-fb70c49d2312 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:41:18.827868 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-81c0d961-4447-407d-823c-fb70c49d2312 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:41:18.828329 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-81c0d961-4447-407d-823c-fb70c49d2312 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:41:18.828757 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-81c0d961-4447-407d-823c-fb70c49d2312 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:41:18.957605 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-81c0d961-4447-407d-823c-fb70c49d2312 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:41:18.965831 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-81c0d961-4447-407d-823c-fb70c49d2312 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1259 microversion: 2.1 time: 0.151721 Oct 23 02:41:18.966434 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4187/8281] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:41:18 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:41:19.990684 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-703931dc-ecce-4a0b-ac64-ba8152120e9d tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:41:19.991406 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-703931dc-ecce-4a0b-ac64-ba8152120e9d tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:41:19.998442 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-703931dc-ecce-4a0b-ac64-ba8152120e9d tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:41:19.998942 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-703931dc-ecce-4a0b-ac64-ba8152120e9d tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:41:19.999409 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-703931dc-ecce-4a0b-ac64-ba8152120e9d tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:41:20.000219 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-703931dc-ecce-4a0b-ac64-ba8152120e9d tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:41:20.000688 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-703931dc-ecce-4a0b-ac64-ba8152120e9d tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:41:20.001125 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-703931dc-ecce-4a0b-ac64-ba8152120e9d tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:41:20.136999 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-703931dc-ecce-4a0b-ac64-ba8152120e9d tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:41:20.144810 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-703931dc-ecce-4a0b-ac64-ba8152120e9d tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1259 microversion: 2.1 time: 0.159795 Oct 23 02:41:20.145425 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4095/8282] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:41:19 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:41:21.168253 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c41744fa-753e-498a-a0fb-898b62651477 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:41:21.169164 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c41744fa-753e-498a-a0fb-898b62651477 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:41:21.176080 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c41744fa-753e-498a-a0fb-898b62651477 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:41:21.176575 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c41744fa-753e-498a-a0fb-898b62651477 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:41:21.177021 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c41744fa-753e-498a-a0fb-898b62651477 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:41:21.177718 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c41744fa-753e-498a-a0fb-898b62651477 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:41:21.178245 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c41744fa-753e-498a-a0fb-898b62651477 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:41:21.178683 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c41744fa-753e-498a-a0fb-898b62651477 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:41:21.310215 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c41744fa-753e-498a-a0fb-898b62651477 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:41:21.318487 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c41744fa-753e-498a-a0fb-898b62651477 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1442 microversion: 2.1 time: 0.154191 Oct 23 02:41:21.319073 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4188/8283] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:41:21 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1442 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:41:21.341591 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-fd65ceff-985d-4e0c-978a-4ee89b322466 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:41:21.342249 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-fd65ceff-985d-4e0c-978a-4ee89b322466 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:41:21.349058 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fd65ceff-985d-4e0c-978a-4ee89b322466 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:41:21.349555 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fd65ceff-985d-4e0c-978a-4ee89b322466 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:41:21.350022 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fd65ceff-985d-4e0c-978a-4ee89b322466 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:41:21.350724 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fd65ceff-985d-4e0c-978a-4ee89b322466 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:41:21.351192 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fd65ceff-985d-4e0c-978a-4ee89b322466 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:41:21.351637 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-fd65ceff-985d-4e0c-978a-4ee89b322466 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:41:21.482917 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-fd65ceff-985d-4e0c-978a-4ee89b322466 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:41:21.491153 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-fd65ceff-985d-4e0c-978a-4ee89b322466 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1442 microversion: 2.1 time: 0.153448 Oct 23 02:41:21.491752 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4096/8284] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:41:21 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1442 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:41:23.726677 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-8994385d-0ee0-44d4-bec9-715382c30c92 req-db9e6710-09cd-4e43-8204-5250af9bc99a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bedeb4ac-623a-4f21-bec8-5fa51610131b", "tag": "3d1dbb05-badc-4a0f-9898-c5b1cb1305f6"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:41:23.737504 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-8994385d-0ee0-44d4-bec9-715382c30c92 req-db9e6710-09cd-4e43-8204-5250af9bc99a service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:41:23.737504 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-8994385d-0ee0-44d4-bec9-715382c30c92 req-db9e6710-09cd-4e43-8204-5250af9bc99a service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:41:23.737910 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-8994385d-0ee0-44d4-bec9-715382c30c92 req-db9e6710-09cd-4e43-8204-5250af9bc99a service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:41:23.748886 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-8994385d-0ee0-44d4-bec9-715382c30c92 req-db9e6710-09cd-4e43-8204-5250af9bc99a service nova] Creating event network-changed:3d1dbb05-badc-4a0f-9898-c5b1cb1305f6 for instance bedeb4ac-623a-4f21-bec8-5fa51610131b on n-h2-master-1 Oct 23 02:41:23.754165 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-8994385d-0ee0-44d4-bec9-715382c30c92 req-db9e6710-09cd-4e43-8204-5250af9bc99a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031647 Oct 23 02:41:23.755262 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4189/8285] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:43:50.168729 n-d-master-1 devstack@n-api.service[120945]: ERROR oslo.messaging._drivers.impl_rabbit [-] [819a2dfa-4c7a-455f-8870-a072098566e7] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 23 02:43:50.169695 n-d-master-1 devstack@n-api.service[120945]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dc6b279b-942d-4b38-8231-bb7b36b63253] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 23 02:43:50.170331 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:43:50.171094 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=70 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:43:50.171997 n-d-master-1 devstack@n-api.service[120945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 23 02:43:50.172145 n-d-master-1 devstack@n-api.service[120945]: Sun Oct 23 02:43:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b/action (ip 10.222.0.42) !!! Oct 23 02:43:50.173263 n-d-master-1 devstack@n-api.service[120945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 23 02:43:50.173421 n-d-master-1 devstack@n-api.service[120945]: Sun Oct 23 02:43:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b/action (ip 10.222.0.42) !!! Oct 23 02:43:50.174536 n-d-master-1 devstack@n-api.service[120945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 23 02:43:50.174669 n-d-master-1 devstack@n-api.service[120945]: Sun Oct 23 02:43:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b/action (ip 10.222.0.42) !!! Oct 23 02:43:50.179765 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8b3c71db-6f63-405f-828e-8d0698d2c084 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:43:50.180803 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8b3c71db-6f63-405f-828e-8d0698d2c084 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:43:50.191752 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b3c71db-6f63-405f-828e-8d0698d2c084 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:43:50.193912 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b3c71db-6f63-405f-828e-8d0698d2c084 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:43:50.193912 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b3c71db-6f63-405f-828e-8d0698d2c084 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:43:50.193912 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b3c71db-6f63-405f-828e-8d0698d2c084 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:43:50.193912 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b3c71db-6f63-405f-828e-8d0698d2c084 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:43:50.194390 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8b3c71db-6f63-405f-828e-8d0698d2c084 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:43:50.218126 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-8b3c71db-6f63-405f-828e-8d0698d2c084 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lazy-loading 'flavor' on Instance uuid bedeb4ac-623a-4f21-bec8-5fa51610131b {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:43:50.419626 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8b3c71db-6f63-405f-828e-8d0698d2c084 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "POST /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b/action" status: 202 len: 0 microversion: 2.1 time: 0.252762 Oct 23 02:43:50.420166 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4097/8286] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:43:50 2022] POST /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:43:50.426950 n-d-master-1 devstack@n-api.service[120944]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ed487b5d-fedf-4013-b387-a53679baa86e] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 23 02:43:50.427868 n-d-master-1 devstack@n-api.service[120944]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6e68fc69-29cc-49a6-b869-84458cd5ea3f] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 23 02:43:50.428552 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=28 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:43:50.429407 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=64 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:43:50.431211 n-d-master-1 devstack@n-api.service[120944]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 23 02:43:50.431349 n-d-master-1 devstack@n-api.service[120944]: Sun Oct 23 02:43:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b (ip 10.222.0.42) !!! Oct 23 02:43:50.432524 n-d-master-1 devstack@n-api.service[120944]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 23 02:43:50.432666 n-d-master-1 devstack@n-api.service[120944]: Sun Oct 23 02:43:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b (ip 10.222.0.42) !!! Oct 23 02:43:50.437884 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-494077bb-5acf-472e-b3de-1685d4de288b tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:43:50.442673 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-494077bb-5acf-472e-b3de-1685d4de288b tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:43:50.452771 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-494077bb-5acf-472e-b3de-1685d4de288b tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:43:50.453256 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-494077bb-5acf-472e-b3de-1685d4de288b tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:43:50.454018 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-494077bb-5acf-472e-b3de-1685d4de288b tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:43:50.454402 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-494077bb-5acf-472e-b3de-1685d4de288b tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:43:50.454863 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-494077bb-5acf-472e-b3de-1685d4de288b tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:43:50.455295 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-494077bb-5acf-472e-b3de-1685d4de288b tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:43:50.592919 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-494077bb-5acf-472e-b3de-1685d4de288b tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:43:50.598433 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-494077bb-5acf-472e-b3de-1685d4de288b tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1567 microversion: 2.1 time: 0.173717 Oct 23 02:43:50.599029 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4190/8287] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:43:50 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:43:51.626293 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1ea59a62-9536-46a6-ac61-25be01ee684d tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:43:51.626999 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1ea59a62-9536-46a6-ac61-25be01ee684d tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:43:51.635904 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1ea59a62-9536-46a6-ac61-25be01ee684d tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:43:51.636398 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1ea59a62-9536-46a6-ac61-25be01ee684d tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:43:51.636841 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1ea59a62-9536-46a6-ac61-25be01ee684d tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:43:51.637535 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1ea59a62-9536-46a6-ac61-25be01ee684d tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:43:51.638016 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1ea59a62-9536-46a6-ac61-25be01ee684d tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:43:51.638451 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1ea59a62-9536-46a6-ac61-25be01ee684d tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:43:51.643093 n-d-master-1 devstack@n-api.service[120945]: INFO oslo.messaging._drivers.impl_rabbit [-] [dc6b279b-942d-4b38-8231-bb7b36b63253] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 40532. Oct 23 02:43:51.655764 n-d-master-1 devstack@n-api.service[120945]: INFO oslo.messaging._drivers.impl_rabbit [-] [819a2dfa-4c7a-455f-8870-a072098566e7] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 40530. Oct 23 02:43:51.773532 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1ea59a62-9536-46a6-ac61-25be01ee684d tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:43:51.781333 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1ea59a62-9536-46a6-ac61-25be01ee684d tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1567 microversion: 2.1 time: 0.161901 Oct 23 02:43:51.781907 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4098/8288] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:43:51 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:43:52.804570 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5a15b49a-752e-465f-b493-35839edaee7f tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:43:52.805822 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5a15b49a-752e-465f-b493-35839edaee7f tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:43:52.820131 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5a15b49a-752e-465f-b493-35839edaee7f tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:43:52.837073 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5a15b49a-752e-465f-b493-35839edaee7f tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:43:52.837073 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5a15b49a-752e-465f-b493-35839edaee7f tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:43:52.837073 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5a15b49a-752e-465f-b493-35839edaee7f tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:43:52.837073 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5a15b49a-752e-465f-b493-35839edaee7f tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:43:52.837073 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-5a15b49a-752e-465f-b493-35839edaee7f tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:43:52.837073 n-d-master-1 devstack@n-api.service[120944]: INFO oslo.messaging._drivers.impl_rabbit [-] [6e68fc69-29cc-49a6-b869-84458cd5ea3f] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 40538. Oct 23 02:43:52.837073 n-d-master-1 devstack@n-api.service[120944]: INFO oslo.messaging._drivers.impl_rabbit [-] [ed487b5d-fedf-4013-b387-a53679baa86e] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 40536. Oct 23 02:43:52.954092 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5a15b49a-752e-465f-b493-35839edaee7f tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:43:52.962588 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5a15b49a-752e-465f-b493-35839edaee7f tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1567 microversion: 2.1 time: 0.162037 Oct 23 02:43:52.963166 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4191/8289] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:43:52 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:43:53.986151 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ca855304-34d5-4ae7-8c43-a5ac575d2dcb tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:43:53.987723 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ca855304-34d5-4ae7-8c43-a5ac575d2dcb tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:43:53.995220 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca855304-34d5-4ae7-8c43-a5ac575d2dcb tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:43:53.995728 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca855304-34d5-4ae7-8c43-a5ac575d2dcb tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:43:53.996184 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca855304-34d5-4ae7-8c43-a5ac575d2dcb tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:43:53.996904 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca855304-34d5-4ae7-8c43-a5ac575d2dcb tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:43:53.997385 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca855304-34d5-4ae7-8c43-a5ac575d2dcb tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:43:53.997828 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ca855304-34d5-4ae7-8c43-a5ac575d2dcb tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:43:54.132653 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-ca855304-34d5-4ae7-8c43-a5ac575d2dcb tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:43:54.141564 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ca855304-34d5-4ae7-8c43-a5ac575d2dcb tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1567 microversion: 2.1 time: 0.159397 Oct 23 02:43:54.142170 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4099/8290] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:43:53 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:43:55.167010 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c171ee0d-6354-4073-a9b2-b2bc922041f2 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:43:55.167639 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c171ee0d-6354-4073-a9b2-b2bc922041f2 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:43:55.174895 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c171ee0d-6354-4073-a9b2-b2bc922041f2 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:43:55.175383 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c171ee0d-6354-4073-a9b2-b2bc922041f2 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:43:55.175820 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c171ee0d-6354-4073-a9b2-b2bc922041f2 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:43:55.176506 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c171ee0d-6354-4073-a9b2-b2bc922041f2 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:43:55.176963 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c171ee0d-6354-4073-a9b2-b2bc922041f2 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:43:55.177387 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c171ee0d-6354-4073-a9b2-b2bc922041f2 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:43:55.313318 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c171ee0d-6354-4073-a9b2-b2bc922041f2 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:43:55.321866 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c171ee0d-6354-4073-a9b2-b2bc922041f2 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1567 microversion: 2.1 time: 0.158784 Oct 23 02:43:55.322479 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4192/8291] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:43:55 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:43:56.345331 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-384eacdd-6c4b-43bd-9c45-cb3221c00e09 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:43:56.345880 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-384eacdd-6c4b-43bd-9c45-cb3221c00e09 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:43:56.353405 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-384eacdd-6c4b-43bd-9c45-cb3221c00e09 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:43:56.354161 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-384eacdd-6c4b-43bd-9c45-cb3221c00e09 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:43:56.354610 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-384eacdd-6c4b-43bd-9c45-cb3221c00e09 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:43:56.355456 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-384eacdd-6c4b-43bd-9c45-cb3221c00e09 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:43:56.355922 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-384eacdd-6c4b-43bd-9c45-cb3221c00e09 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:43:56.356360 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-384eacdd-6c4b-43bd-9c45-cb3221c00e09 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:43:56.490499 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-384eacdd-6c4b-43bd-9c45-cb3221c00e09 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:43:56.498813 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-384eacdd-6c4b-43bd-9c45-cb3221c00e09 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1567 microversion: 2.1 time: 0.157597 Oct 23 02:43:56.499386 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4100/8292] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:43:56 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:43:57.523025 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-859bc3aa-b55f-4278-911f-525ccf45a1c7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:43:57.524634 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-859bc3aa-b55f-4278-911f-525ccf45a1c7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:43:57.531394 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-859bc3aa-b55f-4278-911f-525ccf45a1c7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:43:57.531880 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-859bc3aa-b55f-4278-911f-525ccf45a1c7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:43:57.532316 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-859bc3aa-b55f-4278-911f-525ccf45a1c7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:43:57.533012 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-859bc3aa-b55f-4278-911f-525ccf45a1c7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:43:57.533454 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-859bc3aa-b55f-4278-911f-525ccf45a1c7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:43:57.533879 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-859bc3aa-b55f-4278-911f-525ccf45a1c7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:43:57.667575 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-859bc3aa-b55f-4278-911f-525ccf45a1c7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:43:57.675501 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-859bc3aa-b55f-4278-911f-525ccf45a1c7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1567 microversion: 2.1 time: 0.156449 Oct 23 02:43:57.676082 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4193/8293] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:43:57 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:43:58.699354 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-88d154c4-535b-4a5a-bbe5-9529fbc7ec69 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:43:58.699967 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-88d154c4-535b-4a5a-bbe5-9529fbc7ec69 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:43:58.706887 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-88d154c4-535b-4a5a-bbe5-9529fbc7ec69 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:43:58.707392 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-88d154c4-535b-4a5a-bbe5-9529fbc7ec69 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:43:58.707876 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-88d154c4-535b-4a5a-bbe5-9529fbc7ec69 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:43:58.708579 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-88d154c4-535b-4a5a-bbe5-9529fbc7ec69 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:43:58.709053 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-88d154c4-535b-4a5a-bbe5-9529fbc7ec69 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:43:58.709493 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-88d154c4-535b-4a5a-bbe5-9529fbc7ec69 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:43:58.840942 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-88d154c4-535b-4a5a-bbe5-9529fbc7ec69 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:43:58.848825 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-88d154c4-535b-4a5a-bbe5-9529fbc7ec69 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1567 microversion: 2.1 time: 0.154009 Oct 23 02:43:58.849421 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4101/8294] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:43:58 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:43:59.872763 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-058f98ab-b495-4ba4-8b9d-c7cc5b73afdd tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:43:59.873324 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-058f98ab-b495-4ba4-8b9d-c7cc5b73afdd tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:43:59.880206 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-058f98ab-b495-4ba4-8b9d-c7cc5b73afdd tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:43:59.880697 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-058f98ab-b495-4ba4-8b9d-c7cc5b73afdd tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:43:59.881141 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-058f98ab-b495-4ba4-8b9d-c7cc5b73afdd tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:43:59.881839 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-058f98ab-b495-4ba4-8b9d-c7cc5b73afdd tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:43:59.882341 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-058f98ab-b495-4ba4-8b9d-c7cc5b73afdd tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:43:59.882791 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-058f98ab-b495-4ba4-8b9d-c7cc5b73afdd tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:00.015498 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-058f98ab-b495-4ba4-8b9d-c7cc5b73afdd tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:44:00.023861 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-058f98ab-b495-4ba4-8b9d-c7cc5b73afdd tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1567 microversion: 2.1 time: 0.154747 Oct 23 02:44:00.024438 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4194/8295] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:43:59 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:44:01.047853 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cdad371a-c9aa-4ddb-83ff-2f0c98d1275c tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:44:01.048488 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cdad371a-c9aa-4ddb-83ff-2f0c98d1275c tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:44:01.055955 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cdad371a-c9aa-4ddb-83ff-2f0c98d1275c tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:01.056458 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cdad371a-c9aa-4ddb-83ff-2f0c98d1275c tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:01.056913 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cdad371a-c9aa-4ddb-83ff-2f0c98d1275c tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:01.057641 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cdad371a-c9aa-4ddb-83ff-2f0c98d1275c tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:01.058135 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cdad371a-c9aa-4ddb-83ff-2f0c98d1275c tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:01.058575 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-cdad371a-c9aa-4ddb-83ff-2f0c98d1275c tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:01.189167 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cdad371a-c9aa-4ddb-83ff-2f0c98d1275c tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:44:01.198106 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cdad371a-c9aa-4ddb-83ff-2f0c98d1275c tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1567 microversion: 2.1 time: 0.154088 Oct 23 02:44:01.199206 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4102/8296] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:44:01 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:44:02.221623 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1dc433ef-6267-4047-a809-c3fd6b778ec7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:44:02.222264 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1dc433ef-6267-4047-a809-c3fd6b778ec7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:44:02.229207 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1dc433ef-6267-4047-a809-c3fd6b778ec7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:02.229690 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1dc433ef-6267-4047-a809-c3fd6b778ec7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:02.230162 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1dc433ef-6267-4047-a809-c3fd6b778ec7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:02.230848 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1dc433ef-6267-4047-a809-c3fd6b778ec7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:02.231302 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1dc433ef-6267-4047-a809-c3fd6b778ec7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:02.231728 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1dc433ef-6267-4047-a809-c3fd6b778ec7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:02.365925 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1dc433ef-6267-4047-a809-c3fd6b778ec7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:44:02.374278 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1dc433ef-6267-4047-a809-c3fd6b778ec7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1567 microversion: 2.1 time: 0.156546 Oct 23 02:44:02.374855 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4195/8297] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:44:02 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:44:03.396635 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-db407683-1c51-4fde-a3dd-04dd10cc765a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:44:03.397264 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-db407683-1c51-4fde-a3dd-04dd10cc765a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:44:03.404123 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-db407683-1c51-4fde-a3dd-04dd10cc765a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:03.409177 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-db407683-1c51-4fde-a3dd-04dd10cc765a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:03.409177 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-db407683-1c51-4fde-a3dd-04dd10cc765a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:03.409177 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-db407683-1c51-4fde-a3dd-04dd10cc765a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:03.409177 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-db407683-1c51-4fde-a3dd-04dd10cc765a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:03.409177 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-db407683-1c51-4fde-a3dd-04dd10cc765a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:03.538383 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-db407683-1c51-4fde-a3dd-04dd10cc765a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:44:03.546939 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-db407683-1c51-4fde-a3dd-04dd10cc765a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1567 microversion: 2.1 time: 0.154118 Oct 23 02:44:03.547519 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4103/8298] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:44:03 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:44:04.571349 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b50b7659-8190-4857-8753-7dfcdf7d7c86 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:44:04.571966 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b50b7659-8190-4857-8753-7dfcdf7d7c86 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:44:04.578715 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b50b7659-8190-4857-8753-7dfcdf7d7c86 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:04.579203 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b50b7659-8190-4857-8753-7dfcdf7d7c86 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:04.579640 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b50b7659-8190-4857-8753-7dfcdf7d7c86 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:04.580328 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b50b7659-8190-4857-8753-7dfcdf7d7c86 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:04.580791 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b50b7659-8190-4857-8753-7dfcdf7d7c86 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:04.581213 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b50b7659-8190-4857-8753-7dfcdf7d7c86 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:04.710831 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b50b7659-8190-4857-8753-7dfcdf7d7c86 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:44:04.718755 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b50b7659-8190-4857-8753-7dfcdf7d7c86 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1567 microversion: 2.1 time: 0.151889 Oct 23 02:44:04.719332 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4196/8299] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:44:04 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:44:05.744078 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-997343ab-fe24-47f0-bbe8-690e396f2edf tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:44:05.744642 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-997343ab-fe24-47f0-bbe8-690e396f2edf tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:44:05.751674 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-997343ab-fe24-47f0-bbe8-690e396f2edf tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:05.752177 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-997343ab-fe24-47f0-bbe8-690e396f2edf tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:05.752627 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-997343ab-fe24-47f0-bbe8-690e396f2edf tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:05.753341 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-997343ab-fe24-47f0-bbe8-690e396f2edf tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:05.753808 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-997343ab-fe24-47f0-bbe8-690e396f2edf tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:05.754274 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-997343ab-fe24-47f0-bbe8-690e396f2edf tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:05.892445 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-997343ab-fe24-47f0-bbe8-690e396f2edf tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:44:05.900590 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-997343ab-fe24-47f0-bbe8-690e396f2edf tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1568 microversion: 2.1 time: 0.160883 Oct 23 02:44:05.901155 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4104/8300] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:44:05 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:44:05.924122 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-bf0bb23a-48e8-4cb1-9055-3fe1b65e48fc tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:44:05.924727 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bf0bb23a-48e8-4cb1-9055-3fe1b65e48fc tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:44:05.931590 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf0bb23a-48e8-4cb1-9055-3fe1b65e48fc tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:05.932078 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf0bb23a-48e8-4cb1-9055-3fe1b65e48fc tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:05.932515 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf0bb23a-48e8-4cb1-9055-3fe1b65e48fc tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:05.933208 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf0bb23a-48e8-4cb1-9055-3fe1b65e48fc tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:05.933670 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf0bb23a-48e8-4cb1-9055-3fe1b65e48fc tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:05.934119 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-bf0bb23a-48e8-4cb1-9055-3fe1b65e48fc tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:06.011963 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-bf0bb23a-48e8-4cb1-9055-3fe1b65e48fc tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120944) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 23 02:44:06.267349 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-bf0bb23a-48e8-4cb1-9055-3fe1b65e48fc tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "POST /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b/action" status: 202 len: 0 microversion: 2.1 time: 0.346969 Oct 23 02:44:06.268109 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4197/8301] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:44:05 2022] POST /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b/action => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:44:06.276802 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-633c671e-a97d-44f8-8cda-5e1f97a0ad19 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:44:06.277437 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-633c671e-a97d-44f8-8cda-5e1f97a0ad19 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:44:06.283501 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-633c671e-a97d-44f8-8cda-5e1f97a0ad19 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:06.284003 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-633c671e-a97d-44f8-8cda-5e1f97a0ad19 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:06.284451 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-633c671e-a97d-44f8-8cda-5e1f97a0ad19 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:06.285410 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-633c671e-a97d-44f8-8cda-5e1f97a0ad19 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:06.285620 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-633c671e-a97d-44f8-8cda-5e1f97a0ad19 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:06.286086 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-633c671e-a97d-44f8-8cda-5e1f97a0ad19 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:06.441754 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-633c671e-a97d-44f8-8cda-5e1f97a0ad19 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:44:06.449823 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-633c671e-a97d-44f8-8cda-5e1f97a0ad19 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1576 microversion: 2.1 time: 0.177579 Oct 23 02:44:06.450454 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4105/8302] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:44:06 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1576 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:44:07.093101 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-bd99e9fd-f141-49fd-a0f0-aad7a3acf95a req-bd8e5d05-1173-4c97-a651-9748858b9bce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bedeb4ac-623a-4f21-bec8-5fa51610131b", "name": "network-vif-unplugged", "status": "completed", "tag": "3d1dbb05-badc-4a0f-9898-c5b1cb1305f6"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:44:07.103832 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-bd99e9fd-f141-49fd-a0f0-aad7a3acf95a req-bd8e5d05-1173-4c97-a651-9748858b9bce service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:07.104322 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-bd99e9fd-f141-49fd-a0f0-aad7a3acf95a req-bd8e5d05-1173-4c97-a651-9748858b9bce service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:07.104762 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-bd99e9fd-f141-49fd-a0f0-aad7a3acf95a req-bd8e5d05-1173-4c97-a651-9748858b9bce service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:07.115281 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.compute.server_external_events [req-bd99e9fd-f141-49fd-a0f0-aad7a3acf95a req-bd8e5d05-1173-4c97-a651-9748858b9bce service nova] Unable to find a host for instance bedeb4ac-623a-4f21-bec8-5fa51610131b. Dropping event network-vif-unplugged {{(pid=120944) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 23 02:44:07.116164 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-bd99e9fd-f141-49fd-a0f0-aad7a3acf95a req-bd8e5d05-1173-4c97-a651-9748858b9bce service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.075865 Oct 23 02:44:07.116747 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4198/8303] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 77 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 23 02:44:07.475554 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6a0bb38b-4ffe-4912-941c-d67bb45b67a5 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:44:07.476145 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6a0bb38b-4ffe-4912-941c-d67bb45b67a5 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:44:07.483838 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6a0bb38b-4ffe-4912-941c-d67bb45b67a5 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:07.484339 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6a0bb38b-4ffe-4912-941c-d67bb45b67a5 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:07.484795 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6a0bb38b-4ffe-4912-941c-d67bb45b67a5 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:07.485562 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6a0bb38b-4ffe-4912-941c-d67bb45b67a5 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:07.486060 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6a0bb38b-4ffe-4912-941c-d67bb45b67a5 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:07.486504 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6a0bb38b-4ffe-4912-941c-d67bb45b67a5 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:07.658140 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6a0bb38b-4ffe-4912-941c-d67bb45b67a5 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:44:07.666267 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6a0bb38b-4ffe-4912-941c-d67bb45b67a5 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1516 microversion: 2.1 time: 0.194728 Oct 23 02:44:07.666856 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4106/8304] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:44:07 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1516 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:44:08.688742 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-936ed8bb-f333-4ab3-89ca-dbbce095fe7e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:44:08.689361 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-936ed8bb-f333-4ab3-89ca-dbbce095fe7e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:44:08.696311 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-936ed8bb-f333-4ab3-89ca-dbbce095fe7e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:08.696800 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-936ed8bb-f333-4ab3-89ca-dbbce095fe7e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:08.697239 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-936ed8bb-f333-4ab3-89ca-dbbce095fe7e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:08.697930 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-936ed8bb-f333-4ab3-89ca-dbbce095fe7e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:08.698420 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-936ed8bb-f333-4ab3-89ca-dbbce095fe7e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:08.698853 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-936ed8bb-f333-4ab3-89ca-dbbce095fe7e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:08.847209 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-936ed8bb-f333-4ab3-89ca-dbbce095fe7e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:44:08.857716 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-936ed8bb-f333-4ab3-89ca-dbbce095fe7e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1516 microversion: 2.1 time: 0.172841 Oct 23 02:44:08.858443 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4199/8305] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:44:08 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1516 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:44:09.881330 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b777b46d-adbc-4fc7-9b46-1e675144b601 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:44:09.882066 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b777b46d-adbc-4fc7-9b46-1e675144b601 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:44:09.889118 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b777b46d-adbc-4fc7-9b46-1e675144b601 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:09.889822 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b777b46d-adbc-4fc7-9b46-1e675144b601 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:09.890307 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b777b46d-adbc-4fc7-9b46-1e675144b601 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:09.891024 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b777b46d-adbc-4fc7-9b46-1e675144b601 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:09.891497 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b777b46d-adbc-4fc7-9b46-1e675144b601 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:09.891938 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b777b46d-adbc-4fc7-9b46-1e675144b601 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:10.026582 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b777b46d-adbc-4fc7-9b46-1e675144b601 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:44:10.036083 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b777b46d-adbc-4fc7-9b46-1e675144b601 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1516 microversion: 2.1 time: 0.158565 Oct 23 02:44:10.036671 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4107/8306] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:44:09 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:44:11.060119 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-620e952a-d462-4765-b4a8-5e5963eaf3a7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:44:11.060743 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-620e952a-d462-4765-b4a8-5e5963eaf3a7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:44:11.067700 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-620e952a-d462-4765-b4a8-5e5963eaf3a7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:11.068193 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-620e952a-d462-4765-b4a8-5e5963eaf3a7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:11.068640 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-620e952a-d462-4765-b4a8-5e5963eaf3a7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:11.069339 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-620e952a-d462-4765-b4a8-5e5963eaf3a7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:11.069801 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-620e952a-d462-4765-b4a8-5e5963eaf3a7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:11.070308 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-620e952a-d462-4765-b4a8-5e5963eaf3a7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:11.201869 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-620e952a-d462-4765-b4a8-5e5963eaf3a7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:44:11.209942 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-620e952a-d462-4765-b4a8-5e5963eaf3a7 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1516 microversion: 2.1 time: 0.154248 Oct 23 02:44:11.210554 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4200/8307] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:44:11 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:44:12.233390 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-89d9c4c9-4549-4019-b14b-89713ab9ec97 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:44:12.234092 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-89d9c4c9-4549-4019-b14b-89713ab9ec97 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:44:12.241609 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-89d9c4c9-4549-4019-b14b-89713ab9ec97 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:12.242150 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-89d9c4c9-4549-4019-b14b-89713ab9ec97 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:12.242610 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-89d9c4c9-4549-4019-b14b-89713ab9ec97 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:12.244007 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-89d9c4c9-4549-4019-b14b-89713ab9ec97 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:12.244472 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-89d9c4c9-4549-4019-b14b-89713ab9ec97 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:12.244905 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-89d9c4c9-4549-4019-b14b-89713ab9ec97 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:12.386663 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-89d9c4c9-4549-4019-b14b-89713ab9ec97 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:44:12.395086 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-89d9c4c9-4549-4019-b14b-89713ab9ec97 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1518 microversion: 2.1 time: 0.165712 Oct 23 02:44:12.395766 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4108/8308] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:44:12 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1518 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:44:13.420087 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3ee26730-5dde-4113-a408-856c96777174 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:44:13.420738 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3ee26730-5dde-4113-a408-856c96777174 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:44:13.427752 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3ee26730-5dde-4113-a408-856c96777174 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:13.428241 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3ee26730-5dde-4113-a408-856c96777174 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:13.428683 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3ee26730-5dde-4113-a408-856c96777174 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:13.429378 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3ee26730-5dde-4113-a408-856c96777174 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:13.429843 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3ee26730-5dde-4113-a408-856c96777174 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:13.430301 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3ee26730-5dde-4113-a408-856c96777174 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:13.563357 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3ee26730-5dde-4113-a408-856c96777174 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:44:13.571871 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3ee26730-5dde-4113-a408-856c96777174 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1518 microversion: 2.1 time: 0.155386 Oct 23 02:44:13.572502 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4201/8309] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:44:13 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:44:14.596407 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-1e4d63b2-5b14-4a11-ac23-6ef54b9dbaa9 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:44:14.597037 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-1e4d63b2-5b14-4a11-ac23-6ef54b9dbaa9 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:44:14.604274 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1e4d63b2-5b14-4a11-ac23-6ef54b9dbaa9 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:14.604781 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1e4d63b2-5b14-4a11-ac23-6ef54b9dbaa9 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:14.605228 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1e4d63b2-5b14-4a11-ac23-6ef54b9dbaa9 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:14.605939 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1e4d63b2-5b14-4a11-ac23-6ef54b9dbaa9 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:14.606429 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1e4d63b2-5b14-4a11-ac23-6ef54b9dbaa9 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:14.606867 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-1e4d63b2-5b14-4a11-ac23-6ef54b9dbaa9 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:14.742135 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-1e4d63b2-5b14-4a11-ac23-6ef54b9dbaa9 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:44:14.750660 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-1e4d63b2-5b14-4a11-ac23-6ef54b9dbaa9 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1518 microversion: 2.1 time: 0.158201 Oct 23 02:44:14.751230 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4109/8310] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:44:14 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:44:15.775287 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-69e0d72d-8ae7-4c72-a9cc-e2a7f4779c31 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:44:15.775927 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-69e0d72d-8ae7-4c72-a9cc-e2a7f4779c31 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:44:15.782826 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-69e0d72d-8ae7-4c72-a9cc-e2a7f4779c31 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:15.783310 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-69e0d72d-8ae7-4c72-a9cc-e2a7f4779c31 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:15.783744 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-69e0d72d-8ae7-4c72-a9cc-e2a7f4779c31 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:15.784431 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-69e0d72d-8ae7-4c72-a9cc-e2a7f4779c31 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:15.784895 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-69e0d72d-8ae7-4c72-a9cc-e2a7f4779c31 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:15.785315 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-69e0d72d-8ae7-4c72-a9cc-e2a7f4779c31 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:15.917373 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-69e0d72d-8ae7-4c72-a9cc-e2a7f4779c31 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:44:15.925339 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-69e0d72d-8ae7-4c72-a9cc-e2a7f4779c31 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1518 microversion: 2.1 time: 0.154567 Oct 23 02:44:15.925917 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4202/8311] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:44:15 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:44:16.948718 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-44b7aced-4cf4-4012-a280-a02af7a9d5ea tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:44:16.949359 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-44b7aced-4cf4-4012-a280-a02af7a9d5ea tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:44:16.956118 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44b7aced-4cf4-4012-a280-a02af7a9d5ea tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:16.956607 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44b7aced-4cf4-4012-a280-a02af7a9d5ea tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:16.957053 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44b7aced-4cf4-4012-a280-a02af7a9d5ea tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:16.957779 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44b7aced-4cf4-4012-a280-a02af7a9d5ea tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:16.958272 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44b7aced-4cf4-4012-a280-a02af7a9d5ea tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:16.958706 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-44b7aced-4cf4-4012-a280-a02af7a9d5ea tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:17.094454 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-44b7aced-4cf4-4012-a280-a02af7a9d5ea tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:44:17.102869 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-44b7aced-4cf4-4012-a280-a02af7a9d5ea tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1518 microversion: 2.1 time: 0.157532 Oct 23 02:44:17.103447 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4110/8312] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:44:16 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:44:18.126694 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-917dd299-7346-40e1-9adb-9f03231c81d8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:44:18.127246 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-917dd299-7346-40e1-9adb-9f03231c81d8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:44:18.134503 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-917dd299-7346-40e1-9adb-9f03231c81d8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:18.134995 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-917dd299-7346-40e1-9adb-9f03231c81d8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:18.135436 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-917dd299-7346-40e1-9adb-9f03231c81d8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:18.136134 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-917dd299-7346-40e1-9adb-9f03231c81d8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:18.136590 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-917dd299-7346-40e1-9adb-9f03231c81d8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:18.137042 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-917dd299-7346-40e1-9adb-9f03231c81d8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:18.271300 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-917dd299-7346-40e1-9adb-9f03231c81d8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:44:18.279077 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-917dd299-7346-40e1-9adb-9f03231c81d8 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1574 microversion: 2.1 time: 0.156433 Oct 23 02:44:18.279659 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4203/8313] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:44:18 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:44:18.604924 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-af85906f-16e6-41bd-a7d1-d0a5726641f9 req-d5c6682a-1389-46ae-bc2b-728939cfec49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bedeb4ac-623a-4f21-bec8-5fa51610131b", "tag": "3d1dbb05-badc-4a0f-9898-c5b1cb1305f6"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:44:18.615506 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-af85906f-16e6-41bd-a7d1-d0a5726641f9 req-d5c6682a-1389-46ae-bc2b-728939cfec49 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:18.616000 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-af85906f-16e6-41bd-a7d1-d0a5726641f9 req-d5c6682a-1389-46ae-bc2b-728939cfec49 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:18.616443 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-af85906f-16e6-41bd-a7d1-d0a5726641f9 req-d5c6682a-1389-46ae-bc2b-728939cfec49 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:18.628163 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-af85906f-16e6-41bd-a7d1-d0a5726641f9 req-d5c6682a-1389-46ae-bc2b-728939cfec49 service nova] Creating event network-changed:3d1dbb05-badc-4a0f-9898-c5b1cb1305f6 for instance bedeb4ac-623a-4f21-bec8-5fa51610131b on n-h1-master-1 Oct 23 02:44:18.634054 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-af85906f-16e6-41bd-a7d1-d0a5726641f9 req-d5c6682a-1389-46ae-bc2b-728939cfec49 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032329 Oct 23 02:44:18.634955 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4111/8314] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:44:19.303363 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ff9d1df7-9857-44d8-b339-1a54e023b67e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:44:19.303978 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ff9d1df7-9857-44d8-b339-1a54e023b67e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:44:19.311042 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ff9d1df7-9857-44d8-b339-1a54e023b67e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:19.311537 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ff9d1df7-9857-44d8-b339-1a54e023b67e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:19.311980 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ff9d1df7-9857-44d8-b339-1a54e023b67e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:19.312712 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ff9d1df7-9857-44d8-b339-1a54e023b67e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:19.313178 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ff9d1df7-9857-44d8-b339-1a54e023b67e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:19.313610 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ff9d1df7-9857-44d8-b339-1a54e023b67e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:19.443076 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ff9d1df7-9857-44d8-b339-1a54e023b67e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:44:19.451004 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ff9d1df7-9857-44d8-b339-1a54e023b67e tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1574 microversion: 2.1 time: 0.151596 Oct 23 02:44:19.451576 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4204/8315] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:44:19 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:44:20.476357 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-593cb12d-847d-4077-91b3-3f16a6bc9444 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:44:20.477113 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-593cb12d-847d-4077-91b3-3f16a6bc9444 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:44:20.479123 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=31 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:44:20.484066 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-593cb12d-847d-4077-91b3-3f16a6bc9444 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:20.484573 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-593cb12d-847d-4077-91b3-3f16a6bc9444 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:20.485020 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-593cb12d-847d-4077-91b3-3f16a6bc9444 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:20.485723 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-593cb12d-847d-4077-91b3-3f16a6bc9444 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:20.486219 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-593cb12d-847d-4077-91b3-3f16a6bc9444 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:20.491600 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-593cb12d-847d-4077-91b3-3f16a6bc9444 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:20.491600 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:44:20.624249 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-593cb12d-847d-4077-91b3-3f16a6bc9444 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:44:20.633167 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-593cb12d-847d-4077-91b3-3f16a6bc9444 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1574 microversion: 2.1 time: 0.161899 Oct 23 02:44:20.634315 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4112/8316] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:44:20 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:44:21.657989 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b445a78a-a260-4e3c-bddb-1e733300c54c tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:44:21.658644 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b445a78a-a260-4e3c-bddb-1e733300c54c tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:44:21.661344 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:44:21.667148 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b445a78a-a260-4e3c-bddb-1e733300c54c tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:21.667634 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b445a78a-a260-4e3c-bddb-1e733300c54c tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:21.668072 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b445a78a-a260-4e3c-bddb-1e733300c54c tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:21.673747 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b445a78a-a260-4e3c-bddb-1e733300c54c tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:21.673747 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b445a78a-a260-4e3c-bddb-1e733300c54c tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:21.673747 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b445a78a-a260-4e3c-bddb-1e733300c54c tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:21.673747 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:44:21.804329 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-b445a78a-a260-4e3c-bddb-1e733300c54c tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:44:21.812731 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b445a78a-a260-4e3c-bddb-1e733300c54c tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1574 microversion: 2.1 time: 0.158668 Oct 23 02:44:21.813314 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4205/8317] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:44:21 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:44:22.837163 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c9e422ad-7e22-4c50-9188-0e3f5f23ac5b tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:44:22.837734 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c9e422ad-7e22-4c50-9188-0e3f5f23ac5b tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:44:22.845557 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c9e422ad-7e22-4c50-9188-0e3f5f23ac5b tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:22.846160 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c9e422ad-7e22-4c50-9188-0e3f5f23ac5b tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:22.846612 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c9e422ad-7e22-4c50-9188-0e3f5f23ac5b tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:22.847317 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c9e422ad-7e22-4c50-9188-0e3f5f23ac5b tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:22.847793 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c9e422ad-7e22-4c50-9188-0e3f5f23ac5b tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:22.848233 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c9e422ad-7e22-4c50-9188-0e3f5f23ac5b tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:22.981092 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c9e422ad-7e22-4c50-9188-0e3f5f23ac5b tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:44:22.989116 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c9e422ad-7e22-4c50-9188-0e3f5f23ac5b tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1574 microversion: 2.1 time: 0.155999 Oct 23 02:44:22.989695 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4113/8318] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:44:22 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:44:24.012499 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6a2f6d31-fa6f-411c-8c08-b648bffc94df tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:44:24.013143 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6a2f6d31-fa6f-411c-8c08-b648bffc94df tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:44:24.019965 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6a2f6d31-fa6f-411c-8c08-b648bffc94df tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:24.020447 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6a2f6d31-fa6f-411c-8c08-b648bffc94df tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:24.020884 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6a2f6d31-fa6f-411c-8c08-b648bffc94df tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:24.021572 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6a2f6d31-fa6f-411c-8c08-b648bffc94df tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:24.022049 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6a2f6d31-fa6f-411c-8c08-b648bffc94df tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:24.022479 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6a2f6d31-fa6f-411c-8c08-b648bffc94df tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:24.152096 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6a2f6d31-fa6f-411c-8c08-b648bffc94df tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:44:24.159794 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6a2f6d31-fa6f-411c-8c08-b648bffc94df tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1574 microversion: 2.1 time: 0.151269 Oct 23 02:44:24.160379 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4206/8319] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:44:24 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:44:25.183280 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d9fa1401-ead3-4e58-aa5e-8f9a52bf456f tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:44:25.183904 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d9fa1401-ead3-4e58-aa5e-8f9a52bf456f tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:44:25.190774 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9fa1401-ead3-4e58-aa5e-8f9a52bf456f tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:25.191266 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9fa1401-ead3-4e58-aa5e-8f9a52bf456f tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:25.191711 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9fa1401-ead3-4e58-aa5e-8f9a52bf456f tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:25.192401 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9fa1401-ead3-4e58-aa5e-8f9a52bf456f tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:25.192866 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9fa1401-ead3-4e58-aa5e-8f9a52bf456f tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:25.193296 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d9fa1401-ead3-4e58-aa5e-8f9a52bf456f tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:25.322026 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d9fa1401-ead3-4e58-aa5e-8f9a52bf456f tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:44:25.329715 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d9fa1401-ead3-4e58-aa5e-8f9a52bf456f tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1574 microversion: 2.1 time: 0.150964 Oct 23 02:44:25.330318 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4114/8320] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:44:25 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:44:26.353673 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3d13bcee-f00d-4aa8-80f2-280dff550146 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:44:26.354231 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3d13bcee-f00d-4aa8-80f2-280dff550146 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:44:26.361045 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d13bcee-f00d-4aa8-80f2-280dff550146 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:26.361532 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d13bcee-f00d-4aa8-80f2-280dff550146 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:26.362003 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d13bcee-f00d-4aa8-80f2-280dff550146 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:26.363036 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d13bcee-f00d-4aa8-80f2-280dff550146 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:26.363444 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d13bcee-f00d-4aa8-80f2-280dff550146 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:26.363871 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d13bcee-f00d-4aa8-80f2-280dff550146 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:26.500421 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3d13bcee-f00d-4aa8-80f2-280dff550146 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:44:26.508854 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3d13bcee-f00d-4aa8-80f2-280dff550146 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1574 microversion: 2.1 time: 0.158870 Oct 23 02:44:26.509438 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4207/8321] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:44:26 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:44:27.532733 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6aa56f15-f340-4839-bf75-a590c79556ac tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:44:27.533284 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6aa56f15-f340-4839-bf75-a590c79556ac tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:44:27.540864 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6aa56f15-f340-4839-bf75-a590c79556ac tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:27.541365 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6aa56f15-f340-4839-bf75-a590c79556ac tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:27.541820 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6aa56f15-f340-4839-bf75-a590c79556ac tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:27.542555 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6aa56f15-f340-4839-bf75-a590c79556ac tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:27.543026 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6aa56f15-f340-4839-bf75-a590c79556ac tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:27.543467 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6aa56f15-f340-4839-bf75-a590c79556ac tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:27.678360 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6aa56f15-f340-4839-bf75-a590c79556ac tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:44:27.686261 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6aa56f15-f340-4839-bf75-a590c79556ac tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1574 microversion: 2.1 time: 0.157482 Oct 23 02:44:27.686836 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4115/8322] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:44:27 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:44:28.709809 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-8660d82c-813b-4484-ac43-2af9b3402800 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:44:28.710451 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-8660d82c-813b-4484-ac43-2af9b3402800 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:44:28.717310 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8660d82c-813b-4484-ac43-2af9b3402800 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:28.717795 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8660d82c-813b-4484-ac43-2af9b3402800 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:28.718272 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8660d82c-813b-4484-ac43-2af9b3402800 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:28.718962 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8660d82c-813b-4484-ac43-2af9b3402800 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:28.719422 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8660d82c-813b-4484-ac43-2af9b3402800 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:28.719848 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-8660d82c-813b-4484-ac43-2af9b3402800 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:28.858188 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-8660d82c-813b-4484-ac43-2af9b3402800 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:44:28.866486 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-8660d82c-813b-4484-ac43-2af9b3402800 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1574 microversion: 2.1 time: 0.160629 Oct 23 02:44:28.867077 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4208/8323] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:44:28 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:44:28.948339 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-78117802-ad95-4d9b-808f-70a1bec3408e req-c6ce23fc-5513-486e-a5a9-ba99ebe536d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bedeb4ac-623a-4f21-bec8-5fa51610131b", "name": "network-vif-plugged", "status": "completed", "tag": "3d1dbb05-badc-4a0f-9898-c5b1cb1305f6"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:44:28.958775 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-78117802-ad95-4d9b-808f-70a1bec3408e req-c6ce23fc-5513-486e-a5a9-ba99ebe536d4 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:28.959280 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-78117802-ad95-4d9b-808f-70a1bec3408e req-c6ce23fc-5513-486e-a5a9-ba99ebe536d4 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:28.959703 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-78117802-ad95-4d9b-808f-70a1bec3408e req-c6ce23fc-5513-486e-a5a9-ba99ebe536d4 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:28.971000 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-78117802-ad95-4d9b-808f-70a1bec3408e req-c6ce23fc-5513-486e-a5a9-ba99ebe536d4 service nova] Creating event network-vif-plugged:3d1dbb05-badc-4a0f-9898-c5b1cb1305f6 for instance bedeb4ac-623a-4f21-bec8-5fa51610131b on n-h1-master-1 Oct 23 02:44:28.976295 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-78117802-ad95-4d9b-808f-70a1bec3408e req-c6ce23fc-5513-486e-a5a9-ba99ebe536d4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031702 Oct 23 02:44:28.977574 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4116/8324] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:44:29.890364 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-393dd6c7-bbe1-47c4-8a5b-ede007477cbf tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:44:29.891021 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-393dd6c7-bbe1-47c4-8a5b-ede007477cbf tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:44:29.897879 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-393dd6c7-bbe1-47c4-8a5b-ede007477cbf tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:29.898403 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-393dd6c7-bbe1-47c4-8a5b-ede007477cbf tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:29.898874 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-393dd6c7-bbe1-47c4-8a5b-ede007477cbf tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:29.899564 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-393dd6c7-bbe1-47c4-8a5b-ede007477cbf tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:29.900024 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-393dd6c7-bbe1-47c4-8a5b-ede007477cbf tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:29.900453 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-393dd6c7-bbe1-47c4-8a5b-ede007477cbf tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:30.029718 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-393dd6c7-bbe1-47c4-8a5b-ede007477cbf tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:44:30.037516 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-393dd6c7-bbe1-47c4-8a5b-ede007477cbf tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1574 microversion: 2.1 time: 0.151207 Oct 23 02:44:30.038110 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4209/8325] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:44:29 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:44:31.062907 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9d3e71fc-3555-40f9-bfe0-9586c045a407 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:44:31.063630 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9d3e71fc-3555-40f9-bfe0-9586c045a407 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:44:31.069846 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d3e71fc-3555-40f9-bfe0-9586c045a407 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:31.070637 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d3e71fc-3555-40f9-bfe0-9586c045a407 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:31.070849 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d3e71fc-3555-40f9-bfe0-9586c045a407 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:31.071545 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d3e71fc-3555-40f9-bfe0-9586c045a407 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:44:31.072018 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d3e71fc-3555-40f9-bfe0-9586c045a407 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:44:31.072454 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9d3e71fc-3555-40f9-bfe0-9586c045a407 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:44:31.206141 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9d3e71fc-3555-40f9-bfe0-9586c045a407 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:44:31.214538 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9d3e71fc-3555-40f9-bfe0-9586c045a407 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1561 microversion: 2.1 time: 0.156809 Oct 23 02:44:31.215117 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4117/8326] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:44:31 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:46:08.749311 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=9 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:46:08.750673 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=29 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:46:08.751632 n-d-master-1 devstack@n-api.service[120944]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 23 02:46:08.751996 n-d-master-1 devstack@n-api.service[120944]: Sun Oct 23 02:46:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b (ip 10.222.0.42) !!! Oct 23 02:46:08.752347 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=11 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:46:08.753303 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=31 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:46:08.758564 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-b710c0d3-3fb3-4da0-b26f-9bc807fb5ce1 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:46:08.759121 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b710c0d3-3fb3-4da0-b26f-9bc807fb5ce1 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:46:08.768003 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b710c0d3-3fb3-4da0-b26f-9bc807fb5ce1 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:46:08.768503 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b710c0d3-3fb3-4da0-b26f-9bc807fb5ce1 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:46:08.768950 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b710c0d3-3fb3-4da0-b26f-9bc807fb5ce1 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:46:08.769662 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b710c0d3-3fb3-4da0-b26f-9bc807fb5ce1 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:46:08.770150 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b710c0d3-3fb3-4da0-b26f-9bc807fb5ce1 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:46:08.771093 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-b710c0d3-3fb3-4da0-b26f-9bc807fb5ce1 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:46:08.798981 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-b710c0d3-3fb3-4da0-b26f-9bc807fb5ce1 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 02:46:08.898526 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-f93c4088-9ed0-467b-9a8d-4ab34322355b req-7b81276c-95cb-4339-81b2-f1f806a056f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bedeb4ac-623a-4f21-bec8-5fa51610131b", "tag": "3d1dbb05-badc-4a0f-9898-c5b1cb1305f6"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:46:08.909279 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-f93c4088-9ed0-467b-9a8d-4ab34322355b req-7b81276c-95cb-4339-81b2-f1f806a056f1 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:46:08.909781 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-f93c4088-9ed0-467b-9a8d-4ab34322355b req-7b81276c-95cb-4339-81b2-f1f806a056f1 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:46:08.910236 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-f93c4088-9ed0-467b-9a8d-4ab34322355b req-7b81276c-95cb-4339-81b2-f1f806a056f1 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:46:08.922656 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-f93c4088-9ed0-467b-9a8d-4ab34322355b req-7b81276c-95cb-4339-81b2-f1f806a056f1 service nova] Creating event network-changed:3d1dbb05-badc-4a0f-9898-c5b1cb1305f6 for instance bedeb4ac-623a-4f21-bec8-5fa51610131b on n-h1-master-1 Oct 23 02:46:08.928209 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-f93c4088-9ed0-467b-9a8d-4ab34322355b req-7b81276c-95cb-4339-81b2-f1f806a056f1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.178220 Oct 23 02:46:08.928984 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4118/8327] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:46:09.089660 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-b710c0d3-3fb3-4da0-b26f-9bc807fb5ce1 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 204 len: 0 microversion: 2.1 time: 0.342496 Oct 23 02:46:09.090418 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4210/8328] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 02:46:08 2022] DELETE /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 02:46:09.102918 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-f4b36ac9-3cad-4963-84d7-fdb4cd52eb62 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:46:09.103879 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-f4b36ac9-3cad-4963-84d7-fdb4cd52eb62 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:46:09.114411 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f4b36ac9-3cad-4963-84d7-fdb4cd52eb62 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:46:09.115188 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f4b36ac9-3cad-4963-84d7-fdb4cd52eb62 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:46:09.115719 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f4b36ac9-3cad-4963-84d7-fdb4cd52eb62 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:46:09.116804 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f4b36ac9-3cad-4963-84d7-fdb4cd52eb62 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:46:09.117480 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f4b36ac9-3cad-4963-84d7-fdb4cd52eb62 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:46:09.118094 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-f4b36ac9-3cad-4963-84d7-fdb4cd52eb62 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:46:09.358892 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-f4b36ac9-3cad-4963-84d7-fdb4cd52eb62 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:46:09.367743 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-f4b36ac9-3cad-4963-84d7-fdb4cd52eb62 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1567 microversion: 2.1 time: 0.271566 Oct 23 02:46:09.368861 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4119/8329] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:46:09 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1567 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:46:10.392065 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-f229b914-aa8e-4254-b378-f7654f36d1aa tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:46:10.392776 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-f229b914-aa8e-4254-b378-f7654f36d1aa tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:46:10.400091 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f229b914-aa8e-4254-b378-f7654f36d1aa tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:46:10.400581 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f229b914-aa8e-4254-b378-f7654f36d1aa tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:46:10.401016 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f229b914-aa8e-4254-b378-f7654f36d1aa tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:46:10.401719 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f229b914-aa8e-4254-b378-f7654f36d1aa tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:46:10.402203 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f229b914-aa8e-4254-b378-f7654f36d1aa tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:46:10.402627 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-f229b914-aa8e-4254-b378-f7654f36d1aa tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:46:10.609074 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-f229b914-aa8e-4254-b378-f7654f36d1aa tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:46:10.617177 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-f229b914-aa8e-4254-b378-f7654f36d1aa tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1567 microversion: 2.1 time: 0.229563 Oct 23 02:46:10.617750 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4211/8330] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:46:10 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1567 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:46:11.640786 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-6650808d-2ad4-4057-8bdc-b59d46dc6739 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:46:11.641410 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-6650808d-2ad4-4057-8bdc-b59d46dc6739 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:46:11.649241 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6650808d-2ad4-4057-8bdc-b59d46dc6739 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:46:11.649736 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6650808d-2ad4-4057-8bdc-b59d46dc6739 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:46:11.650209 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6650808d-2ad4-4057-8bdc-b59d46dc6739 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:46:11.650910 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6650808d-2ad4-4057-8bdc-b59d46dc6739 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:46:11.651370 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6650808d-2ad4-4057-8bdc-b59d46dc6739 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:46:11.651806 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-6650808d-2ad4-4057-8bdc-b59d46dc6739 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:46:11.856595 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-6650808d-2ad4-4057-8bdc-b59d46dc6739 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:46:11.865313 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-6650808d-2ad4-4057-8bdc-b59d46dc6739 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1448 microversion: 2.1 time: 0.228471 Oct 23 02:46:11.865901 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4120/8331] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:46:11 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1448 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:46:12.026293 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-47fab927-cef9-4ba5-b737-5a43b8043c96 req-ac0e7b75-cd2a-49b9-984c-01983db3319c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bedeb4ac-623a-4f21-bec8-5fa51610131b", "name": "network-vif-deleted", "tag": "3d1dbb05-badc-4a0f-9898-c5b1cb1305f6"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:46:12.036983 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-47fab927-cef9-4ba5-b737-5a43b8043c96 req-ac0e7b75-cd2a-49b9-984c-01983db3319c service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:46:12.037475 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-47fab927-cef9-4ba5-b737-5a43b8043c96 req-ac0e7b75-cd2a-49b9-984c-01983db3319c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:46:12.037911 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-47fab927-cef9-4ba5-b737-5a43b8043c96 req-ac0e7b75-cd2a-49b9-984c-01983db3319c service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:46:12.049589 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-47fab927-cef9-4ba5-b737-5a43b8043c96 req-ac0e7b75-cd2a-49b9-984c-01983db3319c service nova] Creating event network-vif-deleted:3d1dbb05-badc-4a0f-9898-c5b1cb1305f6 for instance bedeb4ac-623a-4f21-bec8-5fa51610131b on n-h1-master-1 Oct 23 02:46:12.054606 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-47fab927-cef9-4ba5-b737-5a43b8043c96 req-ac0e7b75-cd2a-49b9-984c-01983db3319c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031998 Oct 23 02:46:12.055200 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4212/8332] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:46:12.889851 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7f7cd51a-399f-4f44-a36b-ceaadde8433b tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:46:12.890576 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7f7cd51a-399f-4f44-a36b-ceaadde8433b tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:46:12.897703 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f7cd51a-399f-4f44-a36b-ceaadde8433b tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:46:12.898260 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f7cd51a-399f-4f44-a36b-ceaadde8433b tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:46:12.898706 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f7cd51a-399f-4f44-a36b-ceaadde8433b tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:46:12.899470 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f7cd51a-399f-4f44-a36b-ceaadde8433b tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:46:12.899960 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f7cd51a-399f-4f44-a36b-ceaadde8433b tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:46:12.900392 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7f7cd51a-399f-4f44-a36b-ceaadde8433b tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:46:12.966283 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7f7cd51a-399f-4f44-a36b-ceaadde8433b tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:46:12.974371 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7f7cd51a-399f-4f44-a36b-ceaadde8433b tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1218 microversion: 2.1 time: 0.089284 Oct 23 02:46:12.974971 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4121/8333] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:46:12 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:46:13.999535 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-34d89e0a-09fc-4e58-91c0-c5c6f07e2ee6 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:46:14.000257 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-34d89e0a-09fc-4e58-91c0-c5c6f07e2ee6 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:46:14.006701 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-34d89e0a-09fc-4e58-91c0-c5c6f07e2ee6 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:46:14.007175 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-34d89e0a-09fc-4e58-91c0-c5c6f07e2ee6 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:46:14.007617 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-34d89e0a-09fc-4e58-91c0-c5c6f07e2ee6 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:46:14.008311 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-34d89e0a-09fc-4e58-91c0-c5c6f07e2ee6 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:46:14.008771 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-34d89e0a-09fc-4e58-91c0-c5c6f07e2ee6 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:46:14.009203 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-34d89e0a-09fc-4e58-91c0-c5c6f07e2ee6 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:46:14.072042 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-34d89e0a-09fc-4e58-91c0-c5c6f07e2ee6 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:46:14.080669 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-34d89e0a-09fc-4e58-91c0-c5c6f07e2ee6 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1218 microversion: 2.1 time: 0.086314 Oct 23 02:46:14.081485 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4213/8334] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:46:13 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:46:15.104289 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e7401f1c-ba2a-4ed8-b02b-6595192b97be tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:46:15.105030 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e7401f1c-ba2a-4ed8-b02b-6595192b97be tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:46:15.112666 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e7401f1c-ba2a-4ed8-b02b-6595192b97be tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:46:15.113509 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e7401f1c-ba2a-4ed8-b02b-6595192b97be tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:46:15.114065 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e7401f1c-ba2a-4ed8-b02b-6595192b97be tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:46:15.114853 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e7401f1c-ba2a-4ed8-b02b-6595192b97be tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:46:15.115321 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e7401f1c-ba2a-4ed8-b02b-6595192b97be tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:46:15.115761 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e7401f1c-ba2a-4ed8-b02b-6595192b97be tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:46:15.179973 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e7401f1c-ba2a-4ed8-b02b-6595192b97be tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:46:15.188167 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e7401f1c-ba2a-4ed8-b02b-6595192b97be tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1218 microversion: 2.1 time: 0.087890 Oct 23 02:46:15.188756 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4122/8335] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:46:15 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:46:16.211402 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-a77da655-b697-4dd3-82bf-1985bf2c2fdd tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:46:16.212023 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-a77da655-b697-4dd3-82bf-1985bf2c2fdd tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:46:16.219119 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a77da655-b697-4dd3-82bf-1985bf2c2fdd tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:46:16.219614 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a77da655-b697-4dd3-82bf-1985bf2c2fdd tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:46:16.220055 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a77da655-b697-4dd3-82bf-1985bf2c2fdd tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:46:16.220764 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a77da655-b697-4dd3-82bf-1985bf2c2fdd tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:46:16.221218 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a77da655-b697-4dd3-82bf-1985bf2c2fdd tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:46:16.221645 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-a77da655-b697-4dd3-82bf-1985bf2c2fdd tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:46:16.287641 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-a77da655-b697-4dd3-82bf-1985bf2c2fdd tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:46:16.296285 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-a77da655-b697-4dd3-82bf-1985bf2c2fdd tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1218 microversion: 2.1 time: 0.088911 Oct 23 02:46:16.297106 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4214/8336] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:46:16 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:46:17.320488 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-3b6feda3-1145-4b62-9eb0-523e2acf1b3a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:46:17.329412 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-3b6feda3-1145-4b62-9eb0-523e2acf1b3a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:46:17.329412 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b6feda3-1145-4b62-9eb0-523e2acf1b3a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:46:17.329667 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b6feda3-1145-4b62-9eb0-523e2acf1b3a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:46:17.330137 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b6feda3-1145-4b62-9eb0-523e2acf1b3a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:46:17.330842 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b6feda3-1145-4b62-9eb0-523e2acf1b3a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:46:17.331329 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b6feda3-1145-4b62-9eb0-523e2acf1b3a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:46:17.331747 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b6feda3-1145-4b62-9eb0-523e2acf1b3a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:46:17.362804 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b6feda3-1145-4b62-9eb0-523e2acf1b3a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:46:17.363559 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b6feda3-1145-4b62-9eb0-523e2acf1b3a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:46:17.364164 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-3b6feda3-1145-4b62-9eb0-523e2acf1b3a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:46:17.364635 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-3b6feda3-1145-4b62-9eb0-523e2acf1b3a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lazy-loading 'fault' on Instance uuid bedeb4ac-623a-4f21-bec8-5fa51610131b {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:46:17.409150 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-3b6feda3-1145-4b62-9eb0-523e2acf1b3a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9860012bc34d4dab2679d24d51266b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e890001bec0490b9b30f77183adb688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:46:17.417740 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-3b6feda3-1145-4b62-9eb0-523e2acf1b3a tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 200 len: 1223 microversion: 2.1 time: 0.101193 Oct 23 02:46:17.421056 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4123/8337] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:46:17 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 1223 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:46:18.441363 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-623ea852-992c-474d-9d0d-21299a4d9a91 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:46:18.441920 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-623ea852-992c-474d-9d0d-21299a4d9a91 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] [instance: bedeb4ac-623a-4f21-bec8-5fa51610131b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:46:18.448804 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-623ea852-992c-474d-9d0d-21299a4d9a91 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:46:18.449293 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-623ea852-992c-474d-9d0d-21299a4d9a91 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:46:18.449729 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-623ea852-992c-474d-9d0d-21299a4d9a91 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:46:18.450951 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-623ea852-992c-474d-9d0d-21299a4d9a91 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:46:18.451409 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-623ea852-992c-474d-9d0d-21299a4d9a91 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:46:18.451832 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-623ea852-992c-474d-9d0d-21299a4d9a91 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:46:18.465394 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-623ea852-992c-474d-9d0d-21299a4d9a91 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] HTTP exception thrown: Instance bedeb4ac-623a-4f21-bec8-5fa51610131b could not be found. Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-623ea852-992c-474d-9d0d-21299a4d9a91 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Request method failure captured: Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b HTTP/1.1 Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVKiQh3ZqLY2VFml-tbJ4c3cdBhHPcItnyla2N5Kfpto4ODJerPp-Ic7BAE9IAMS4DzRafJLTwZDPnSPTSiKbWaJAcXfmKWmB7SNOTpO_RDumy3IukE8qJqOtCBFjK_Fgga0TeKddggRz0LPJJ5Q8S5Wh1hOzY_7-5XaCyz_weva4iK0 Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: 5e890001bec0490b9b30f77183adb688 Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-TestShelveInstance-1737707503 Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5e890001bec0490b9b30f77183adb688"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5e890001bec0490b9b30f77183adb688"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e890001bec0490b9b30f77183adb688"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e890001bec0490b9b30f77183adb688"}]}] Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-TestShelveInstance-1737707503 Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: 5e890001bec0490b9b30f77183adb688 Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-TestShelveInstance-1737707503 Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-TestShelveInstance-1737707503-project Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 2d9860012bc34d4dab2679d24d51266b Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-TestShelveInstance-1737707503-project Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: exception: Instance bedeb4ac-623a-4f21-bec8-5fa51610131b could not be found. Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': 'bedeb4ac-623a-4f21-bec8-5fa51610131b'} Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bedeb4ac-623a-4f21-bec8-5fa51610131b could not be found. Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bedeb4ac-623a-4f21-bec8-5fa51610131b could not be found. Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:46:18.467644 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:46:18.474959 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:46:18.474959 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:46:18.474959 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:46:18.474959 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:46:18.474959 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:46:18.474959 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bedeb4ac-623a-4f21-bec8-5fa51610131b could not be found. Oct 23 02:46:18.474959 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:46:18.474959 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-623ea852-992c-474d-9d0d-21299a4d9a91 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Returning 404 to user: Instance bedeb4ac-623a-4f21-bec8-5fa51610131b could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:46:18.474959 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-623ea852-992c-474d-9d0d-21299a4d9a91 tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b" status: 404 len: 111 microversion: 2.1 time: 0.031737 Oct 23 02:46:18.474959 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4215/8338] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:46:18 2022] GET /compute/v2.1/servers/bedeb4ac-623a-4f21-bec8-5fa51610131b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:46:18.696101 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-40786d95-31c6-4875-a00c-0b09cea1123f tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] Calling method '.version_select at 0x7f5cc18af040>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:46:18.796084 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-40786d95-31c6-4875-a00c-0b09cea1123f tempest-TestShelveInstance-1737707503 tempest-TestShelveInstance-1737707503-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-606476367" status: 202 len: 0 microversion: 2.1 time: 0.104312 Oct 23 02:46:18.796715 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4124/8339] 10.222.0.42 () {58 vars in 1251 bytes} [Sun Oct 23 02:46:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-606476367 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:46:40.416513 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:46:40.417841 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:46:40.611864 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1f277632-2b58-492d-89a4-06535862c09b tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Action: 'create', calling method: .version_select at 0x7f5cc0c9b1f0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1320171934", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBlK6DWzl8CcW+q716aK5/XkBJ8qOJHGHhgLOFRvDfCMMt8S7AjhVSYb7R7KOJDUZ3TWz9ScafwmJn3pPXpTtPmMiVgk3LuhqMaX6xjWQo34uIF1XHmbb9fPPH+MaGMgFw=="}} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:46:40.628147 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-1f277632-2b58-492d-89a4-06535862c09b tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Getting quotas for project df930ec48af34ab988097274a950a70a. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:46:40.637496 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.quota [None req-1f277632-2b58-492d-89a4-06535862c09b tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Getting quotas for user 6203993a83b2402ca8789188cf27c578 and project df930ec48af34ab988097274a950a70a. Resources: {'key_pairs'} {{(pid=120944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:46:40.764972 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1f277632-2b58-492d-89a4-06535862c09b tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.353650 Oct 23 02:46:40.765593 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4216/8340] 10.222.0.42 () {60 vars in 1159 bytes} [Sun Oct 23 02:46:40 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:46:43.253566 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=34 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:46:43.254515 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:46:43.258662 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-863a8278-dde2-4288-8cca-f2951f274e10 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-2103978958", "imageRef": "446b40bc-db5b-4123-9278-997bd6d04a0d", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1320171934", "security_groups": [{"name": "tempest-secgroup-smoke-862314973"}], "networks": [{"uuid": "439f8903-8a58-4544-b361-fd82c6247aa7"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:46:43.373594 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-863a8278-dde2-4288-8cca-f2951f274e10 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] validate_networks() for [('439f8903-8a58-4544-b361-fd82c6247aa7', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 02:46:43.870921 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-863a8278-dde2-4288-8cca-f2951f274e10 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:46:43.879877 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-863a8278-dde2-4288-8cca-f2951f274e10 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:46:43.879877 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-863a8278-dde2-4288-8cca-f2951f274e10 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:46:43.879877 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-863a8278-dde2-4288-8cca-f2951f274e10 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:46:43.879877 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-863a8278-dde2-4288-8cca-f2951f274e10 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:46:43.882870 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-863a8278-dde2-4288-8cca-f2951f274e10 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:46:43.883401 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-863a8278-dde2-4288-8cca-f2951f274e10 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:46:43.883844 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-863a8278-dde2-4288-8cca-f2951f274e10 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:46:43.884578 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-863a8278-dde2-4288-8cca-f2951f274e10 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:46:43.885040 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-863a8278-dde2-4288-8cca-f2951f274e10 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:46:43.885475 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-863a8278-dde2-4288-8cca-f2951f274e10 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:46:43.904069 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-863a8278-dde2-4288-8cca-f2951f274e10 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Getting quotas for project df930ec48af34ab988097274a950a70a. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:46:43.909895 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-863a8278-dde2-4288-8cca-f2951f274e10 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Getting quotas for user 6203993a83b2402ca8789188cf27c578 and project df930ec48af34ab988097274a950a70a. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:46:43.924255 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-863a8278-dde2-4288-8cca-f2951f274e10 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 02:46:43.926676 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-863a8278-dde2-4288-8cca-f2951f274e10 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] [instance: 71b5b03e-0bb5-4615-99e9-82867288572b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='446b40bc-db5b-4123-9278-997bd6d04a0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 02:46:44.047500 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-863a8278-dde2-4288-8cca-f2951f274e10 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.795753 Oct 23 02:46:44.049966 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4125/8341] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 02:46:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 02:46:44.060882 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-5864541c-2ebd-498f-9067-a212b5601ff6 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:46:44.063258 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-5864541c-2ebd-498f-9067-a212b5601ff6 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] [instance: 71b5b03e-0bb5-4615-99e9-82867288572b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:46:44.141402 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-5864541c-2ebd-498f-9067-a212b5601ff6 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6203993a83b2402ca8789188cf27c578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df930ec48af34ab988097274a950a70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:46:44.148543 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-5864541c-2ebd-498f-9067-a212b5601ff6 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] 10.222.0.42 "GET /compute/v2.1/servers/71b5b03e-0bb5-4615-99e9-82867288572b" status: 200 len: 1249 microversion: 2.1 time: 0.092993 Oct 23 02:46:44.149126 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4217/8342] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:46:44 2022] GET /compute/v2.1/servers/71b5b03e-0bb5-4615-99e9-82867288572b => generated 1249 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:46:45.172553 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4f5eff9d-a94e-415b-910e-95920dc8a50e tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:46:45.173179 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4f5eff9d-a94e-415b-910e-95920dc8a50e tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] [instance: 71b5b03e-0bb5-4615-99e9-82867288572b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:46:45.227922 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4f5eff9d-a94e-415b-910e-95920dc8a50e tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6203993a83b2402ca8789188cf27c578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df930ec48af34ab988097274a950a70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:46:45.234987 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4f5eff9d-a94e-415b-910e-95920dc8a50e tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] 10.222.0.42 "GET /compute/v2.1/servers/71b5b03e-0bb5-4615-99e9-82867288572b" status: 200 len: 1249 microversion: 2.1 time: 0.066527 Oct 23 02:46:45.235548 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4126/8343] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:46:45 2022] GET /compute/v2.1/servers/71b5b03e-0bb5-4615-99e9-82867288572b => generated 1249 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:46:46.258462 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3d93f8ee-8ae9-4f53-be4e-46ccab34194c tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:46:46.259032 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3d93f8ee-8ae9-4f53-be4e-46ccab34194c tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] [instance: 71b5b03e-0bb5-4615-99e9-82867288572b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:46:46.266587 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d93f8ee-8ae9-4f53-be4e-46ccab34194c tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:46:46.267328 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d93f8ee-8ae9-4f53-be4e-46ccab34194c tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:46:46.267813 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d93f8ee-8ae9-4f53-be4e-46ccab34194c tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:46:46.268526 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d93f8ee-8ae9-4f53-be4e-46ccab34194c tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:46:46.268990 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d93f8ee-8ae9-4f53-be4e-46ccab34194c tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:46:46.269422 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3d93f8ee-8ae9-4f53-be4e-46ccab34194c tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:46:46.336181 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3d93f8ee-8ae9-4f53-be4e-46ccab34194c tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6203993a83b2402ca8789188cf27c578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df930ec48af34ab988097274a950a70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:46:46.344802 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3d93f8ee-8ae9-4f53-be4e-46ccab34194c tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] 10.222.0.42 "GET /compute/v2.1/servers/71b5b03e-0bb5-4615-99e9-82867288572b" status: 200 len: 1301 microversion: 2.1 time: 0.090401 Oct 23 02:46:46.345376 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4218/8344] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:46:46 2022] GET /compute/v2.1/servers/71b5b03e-0bb5-4615-99e9-82867288572b => generated 1301 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:46:47.368647 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c98adedb-a37d-4b39-aa1f-d24a9f630cd0 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:46:47.369321 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c98adedb-a37d-4b39-aa1f-d24a9f630cd0 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] [instance: 71b5b03e-0bb5-4615-99e9-82867288572b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:46:47.377050 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c98adedb-a37d-4b39-aa1f-d24a9f630cd0 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:46:47.377579 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c98adedb-a37d-4b39-aa1f-d24a9f630cd0 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:46:47.378138 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c98adedb-a37d-4b39-aa1f-d24a9f630cd0 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:46:47.378861 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c98adedb-a37d-4b39-aa1f-d24a9f630cd0 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:46:47.379833 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c98adedb-a37d-4b39-aa1f-d24a9f630cd0 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:46:47.379833 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c98adedb-a37d-4b39-aa1f-d24a9f630cd0 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:46:47.523636 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c98adedb-a37d-4b39-aa1f-d24a9f630cd0 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6203993a83b2402ca8789188cf27c578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df930ec48af34ab988097274a950a70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:46:47.532148 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c98adedb-a37d-4b39-aa1f-d24a9f630cd0 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] 10.222.0.42 "GET /compute/v2.1/servers/71b5b03e-0bb5-4615-99e9-82867288572b" status: 200 len: 1374 microversion: 2.1 time: 0.167364 Oct 23 02:46:47.532732 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4127/8345] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:46:47 2022] GET /compute/v2.1/servers/71b5b03e-0bb5-4615-99e9-82867288572b => generated 1374 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:46:48.447926 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-8449ff0b-c33a-44c1-8ee6-c848bf0aa8db req-1463d2a8-6575-4ddc-a909-d656a8725839 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71b5b03e-0bb5-4615-99e9-82867288572b", "tag": "7fd40410-5f15-42e2-92e2-100e9a0ef6b5"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:46:48.458106 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-8449ff0b-c33a-44c1-8ee6-c848bf0aa8db req-1463d2a8-6575-4ddc-a909-d656a8725839 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:46:48.458599 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-8449ff0b-c33a-44c1-8ee6-c848bf0aa8db req-1463d2a8-6575-4ddc-a909-d656a8725839 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:46:48.459043 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-8449ff0b-c33a-44c1-8ee6-c848bf0aa8db req-1463d2a8-6575-4ddc-a909-d656a8725839 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:46:48.471027 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-8449ff0b-c33a-44c1-8ee6-c848bf0aa8db req-1463d2a8-6575-4ddc-a909-d656a8725839 service nova] Creating event network-changed:7fd40410-5f15-42e2-92e2-100e9a0ef6b5 for instance 71b5b03e-0bb5-4615-99e9-82867288572b on n-h2-master-1 Oct 23 02:46:48.476031 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-8449ff0b-c33a-44c1-8ee6-c848bf0aa8db req-1463d2a8-6575-4ddc-a909-d656a8725839 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090572 Oct 23 02:46:48.479360 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4219/8346] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:46:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:46:48.556323 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-898bbd22-5dc3-485e-8411-386c034514e8 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:46:48.556992 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-898bbd22-5dc3-485e-8411-386c034514e8 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] [instance: 71b5b03e-0bb5-4615-99e9-82867288572b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:46:48.563884 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-898bbd22-5dc3-485e-8411-386c034514e8 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:46:48.564413 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-898bbd22-5dc3-485e-8411-386c034514e8 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:46:48.564860 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-898bbd22-5dc3-485e-8411-386c034514e8 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:46:48.565561 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-898bbd22-5dc3-485e-8411-386c034514e8 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:46:48.566051 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-898bbd22-5dc3-485e-8411-386c034514e8 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:46:48.566485 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-898bbd22-5dc3-485e-8411-386c034514e8 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:46:48.697665 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-898bbd22-5dc3-485e-8411-386c034514e8 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6203993a83b2402ca8789188cf27c578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df930ec48af34ab988097274a950a70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:46:48.706364 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-898bbd22-5dc3-485e-8411-386c034514e8 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] 10.222.0.42 "GET /compute/v2.1/servers/71b5b03e-0bb5-4615-99e9-82867288572b" status: 200 len: 1374 microversion: 2.1 time: 0.153860 Oct 23 02:46:48.706949 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4128/8347] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:46:48 2022] GET /compute/v2.1/servers/71b5b03e-0bb5-4615-99e9-82867288572b => generated 1374 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:46:49.730218 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4ec496db-5992-45b9-ba41-cce460b9d0b1 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:46:49.731514 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4ec496db-5992-45b9-ba41-cce460b9d0b1 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] [instance: 71b5b03e-0bb5-4615-99e9-82867288572b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:46:49.737948 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4ec496db-5992-45b9-ba41-cce460b9d0b1 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:46:49.738396 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4ec496db-5992-45b9-ba41-cce460b9d0b1 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:46:49.739104 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4ec496db-5992-45b9-ba41-cce460b9d0b1 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:46:49.739800 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4ec496db-5992-45b9-ba41-cce460b9d0b1 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:46:49.740265 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4ec496db-5992-45b9-ba41-cce460b9d0b1 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:46:49.740696 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4ec496db-5992-45b9-ba41-cce460b9d0b1 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:46:49.878152 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4ec496db-5992-45b9-ba41-cce460b9d0b1 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6203993a83b2402ca8789188cf27c578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df930ec48af34ab988097274a950a70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:46:49.886055 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4ec496db-5992-45b9-ba41-cce460b9d0b1 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] 10.222.0.42 "GET /compute/v2.1/servers/71b5b03e-0bb5-4615-99e9-82867288572b" status: 200 len: 1374 microversion: 2.1 time: 0.160976 Oct 23 02:46:49.887792 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4220/8348] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:46:49 2022] GET /compute/v2.1/servers/71b5b03e-0bb5-4615-99e9-82867288572b => generated 1374 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:46:50.910402 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-274d7dbe-40e6-4d5f-911e-dcaa6ab2cc7f tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:46:50.911011 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-274d7dbe-40e6-4d5f-911e-dcaa6ab2cc7f tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] [instance: 71b5b03e-0bb5-4615-99e9-82867288572b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:46:50.917856 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-274d7dbe-40e6-4d5f-911e-dcaa6ab2cc7f tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:46:50.918390 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-274d7dbe-40e6-4d5f-911e-dcaa6ab2cc7f tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:46:50.918841 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-274d7dbe-40e6-4d5f-911e-dcaa6ab2cc7f tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:46:50.919543 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-274d7dbe-40e6-4d5f-911e-dcaa6ab2cc7f tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:46:50.920011 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-274d7dbe-40e6-4d5f-911e-dcaa6ab2cc7f tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:46:50.920451 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-274d7dbe-40e6-4d5f-911e-dcaa6ab2cc7f tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:46:51.052825 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-274d7dbe-40e6-4d5f-911e-dcaa6ab2cc7f tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6203993a83b2402ca8789188cf27c578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df930ec48af34ab988097274a950a70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:46:51.061021 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-274d7dbe-40e6-4d5f-911e-dcaa6ab2cc7f tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] 10.222.0.42 "GET /compute/v2.1/servers/71b5b03e-0bb5-4615-99e9-82867288572b" status: 200 len: 1374 microversion: 2.1 time: 0.154694 Oct 23 02:46:51.061610 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4129/8349] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:46:50 2022] GET /compute/v2.1/servers/71b5b03e-0bb5-4615-99e9-82867288572b => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:46:52.084712 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1a181845-e3db-42b1-a0cd-3f58cbff2e35 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:46:52.085320 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1a181845-e3db-42b1-a0cd-3f58cbff2e35 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] [instance: 71b5b03e-0bb5-4615-99e9-82867288572b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:46:52.093193 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1a181845-e3db-42b1-a0cd-3f58cbff2e35 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:46:52.093688 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1a181845-e3db-42b1-a0cd-3f58cbff2e35 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:46:52.094194 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1a181845-e3db-42b1-a0cd-3f58cbff2e35 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:46:52.094893 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1a181845-e3db-42b1-a0cd-3f58cbff2e35 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:46:52.095353 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1a181845-e3db-42b1-a0cd-3f58cbff2e35 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:46:52.095784 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1a181845-e3db-42b1-a0cd-3f58cbff2e35 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:46:52.228345 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1a181845-e3db-42b1-a0cd-3f58cbff2e35 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6203993a83b2402ca8789188cf27c578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df930ec48af34ab988097274a950a70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:46:52.236419 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1a181845-e3db-42b1-a0cd-3f58cbff2e35 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] 10.222.0.42 "GET /compute/v2.1/servers/71b5b03e-0bb5-4615-99e9-82867288572b" status: 200 len: 1374 microversion: 2.1 time: 0.155651 Oct 23 02:46:52.237003 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4221/8350] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:46:52 2022] GET /compute/v2.1/servers/71b5b03e-0bb5-4615-99e9-82867288572b => generated 1374 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:46:53.261140 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e053d8c5-f034-4a92-8b93-81244411c7d5 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:46:53.261776 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e053d8c5-f034-4a92-8b93-81244411c7d5 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] [instance: 71b5b03e-0bb5-4615-99e9-82867288572b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:46:53.267951 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e053d8c5-f034-4a92-8b93-81244411c7d5 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:46:53.268445 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e053d8c5-f034-4a92-8b93-81244411c7d5 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:46:53.268889 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e053d8c5-f034-4a92-8b93-81244411c7d5 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:46:53.269594 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e053d8c5-f034-4a92-8b93-81244411c7d5 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:46:53.270088 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e053d8c5-f034-4a92-8b93-81244411c7d5 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:46:53.270524 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e053d8c5-f034-4a92-8b93-81244411c7d5 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:46:53.400551 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-e053d8c5-f034-4a92-8b93-81244411c7d5 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6203993a83b2402ca8789188cf27c578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df930ec48af34ab988097274a950a70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:46:53.408830 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e053d8c5-f034-4a92-8b93-81244411c7d5 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] 10.222.0.42 "GET /compute/v2.1/servers/71b5b03e-0bb5-4615-99e9-82867288572b" status: 200 len: 1374 microversion: 2.1 time: 0.151993 Oct 23 02:46:53.409408 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4130/8351] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:46:53 2022] GET /compute/v2.1/servers/71b5b03e-0bb5-4615-99e9-82867288572b => generated 1374 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:46:53.894584 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-8ca01e84-0ffe-4187-850e-ce7ed4288fde req-7134262b-fc41-4716-be0b-10fe4b633e57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71b5b03e-0bb5-4615-99e9-82867288572b", "name": "network-vif-plugged", "status": "completed", "tag": "7fd40410-5f15-42e2-92e2-100e9a0ef6b5"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:46:53.904583 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-8ca01e84-0ffe-4187-850e-ce7ed4288fde req-7134262b-fc41-4716-be0b-10fe4b633e57 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:46:53.906438 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-8ca01e84-0ffe-4187-850e-ce7ed4288fde req-7134262b-fc41-4716-be0b-10fe4b633e57 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:46:53.906438 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-8ca01e84-0ffe-4187-850e-ce7ed4288fde req-7134262b-fc41-4716-be0b-10fe4b633e57 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:46:53.916535 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-8ca01e84-0ffe-4187-850e-ce7ed4288fde req-7134262b-fc41-4716-be0b-10fe4b633e57 service nova] Creating event network-vif-plugged:7fd40410-5f15-42e2-92e2-100e9a0ef6b5 for instance 71b5b03e-0bb5-4615-99e9-82867288572b on n-h2-master-1 Oct 23 02:46:53.921727 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-8ca01e84-0ffe-4187-850e-ce7ed4288fde req-7134262b-fc41-4716-be0b-10fe4b633e57 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030871 Oct 23 02:46:53.922381 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4222/8352] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:46:54.432283 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-0c6fe7bd-441c-4e9c-97e2-cfd76863398d tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:46:54.432902 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-0c6fe7bd-441c-4e9c-97e2-cfd76863398d tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] [instance: 71b5b03e-0bb5-4615-99e9-82867288572b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:46:54.434777 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:46:54.440440 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0c6fe7bd-441c-4e9c-97e2-cfd76863398d tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:46:54.440937 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0c6fe7bd-441c-4e9c-97e2-cfd76863398d tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:46:54.441379 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0c6fe7bd-441c-4e9c-97e2-cfd76863398d tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:46:54.442110 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0c6fe7bd-441c-4e9c-97e2-cfd76863398d tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:46:54.442576 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0c6fe7bd-441c-4e9c-97e2-cfd76863398d tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:46:54.443010 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-0c6fe7bd-441c-4e9c-97e2-cfd76863398d tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:46:54.572756 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-0c6fe7bd-441c-4e9c-97e2-cfd76863398d tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6203993a83b2402ca8789188cf27c578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df930ec48af34ab988097274a950a70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:46:54.581077 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-0c6fe7bd-441c-4e9c-97e2-cfd76863398d tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] 10.222.0.42 "GET /compute/v2.1/servers/71b5b03e-0bb5-4615-99e9-82867288572b" status: 200 len: 1374 microversion: 2.1 time: 0.152780 Oct 23 02:46:54.581661 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4131/8353] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:46:54 2022] GET /compute/v2.1/servers/71b5b03e-0bb5-4615-99e9-82867288572b => generated 1374 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:46:55.605171 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-2be11dc3-ab95-476a-8259-d372f0d3c71f tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:46:55.605798 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-2be11dc3-ab95-476a-8259-d372f0d3c71f tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] [instance: 71b5b03e-0bb5-4615-99e9-82867288572b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:46:55.608442 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=6 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:46:55.614596 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2be11dc3-ab95-476a-8259-d372f0d3c71f tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:46:55.615075 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2be11dc3-ab95-476a-8259-d372f0d3c71f tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:46:55.615509 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2be11dc3-ab95-476a-8259-d372f0d3c71f tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:46:55.616192 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2be11dc3-ab95-476a-8259-d372f0d3c71f tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:46:55.616651 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2be11dc3-ab95-476a-8259-d372f0d3c71f tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:46:55.617074 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-2be11dc3-ab95-476a-8259-d372f0d3c71f tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:46:55.751972 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-2be11dc3-ab95-476a-8259-d372f0d3c71f tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6203993a83b2402ca8789188cf27c578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df930ec48af34ab988097274a950a70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:46:55.759799 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-2be11dc3-ab95-476a-8259-d372f0d3c71f tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] 10.222.0.42 "GET /compute/v2.1/servers/71b5b03e-0bb5-4615-99e9-82867288572b" status: 200 len: 1559 microversion: 2.1 time: 0.159005 Oct 23 02:46:55.760369 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4223/8354] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:46:55 2022] GET /compute/v2.1/servers/71b5b03e-0bb5-4615-99e9-82867288572b => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:46:55.783038 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c2ed3af1-3916-4c7b-a3b7-dc817285f29a tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:46:55.783669 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c2ed3af1-3916-4c7b-a3b7-dc817285f29a tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] [instance: 71b5b03e-0bb5-4615-99e9-82867288572b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:46:55.785619 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=8 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:46:55.791241 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c2ed3af1-3916-4c7b-a3b7-dc817285f29a tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:46:55.791736 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c2ed3af1-3916-4c7b-a3b7-dc817285f29a tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:46:55.792182 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c2ed3af1-3916-4c7b-a3b7-dc817285f29a tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:46:55.792879 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c2ed3af1-3916-4c7b-a3b7-dc817285f29a tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:46:55.793343 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c2ed3af1-3916-4c7b-a3b7-dc817285f29a tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:46:55.793873 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c2ed3af1-3916-4c7b-a3b7-dc817285f29a tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:46:55.922955 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c2ed3af1-3916-4c7b-a3b7-dc817285f29a tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6203993a83b2402ca8789188cf27c578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df930ec48af34ab988097274a950a70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:46:55.930661 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c2ed3af1-3916-4c7b-a3b7-dc817285f29a tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] 10.222.0.42 "GET /compute/v2.1/servers/71b5b03e-0bb5-4615-99e9-82867288572b" status: 200 len: 1559 microversion: 2.1 time: 0.152156 Oct 23 02:46:55.931230 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4132/8355] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:46:55 2022] GET /compute/v2.1/servers/71b5b03e-0bb5-4615-99e9-82867288572b => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:46:57.874718 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-4481e371-4f9e-459d-a69a-629ae29e6a99 req-9673dbd1-9e73-49fe-9889-c689bc571bb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71b5b03e-0bb5-4615-99e9-82867288572b", "tag": "7fd40410-5f15-42e2-92e2-100e9a0ef6b5"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:46:57.885184 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-4481e371-4f9e-459d-a69a-629ae29e6a99 req-9673dbd1-9e73-49fe-9889-c689bc571bb4 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:46:57.885673 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-4481e371-4f9e-459d-a69a-629ae29e6a99 req-9673dbd1-9e73-49fe-9889-c689bc571bb4 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:46:57.886146 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-4481e371-4f9e-459d-a69a-629ae29e6a99 req-9673dbd1-9e73-49fe-9889-c689bc571bb4 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:46:57.897419 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-4481e371-4f9e-459d-a69a-629ae29e6a99 req-9673dbd1-9e73-49fe-9889-c689bc571bb4 service nova] Creating event network-changed:7fd40410-5f15-42e2-92e2-100e9a0ef6b5 for instance 71b5b03e-0bb5-4615-99e9-82867288572b on n-h2-master-1 Oct 23 02:46:57.902700 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-4481e371-4f9e-459d-a69a-629ae29e6a99 req-9673dbd1-9e73-49fe-9889-c689bc571bb4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031790 Oct 23 02:46:57.903861 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4224/8356] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:48:55.174968 n-d-master-1 devstack@n-api.service[120945]: ERROR oslo.messaging._drivers.impl_rabbit [-] [819a2dfa-4c7a-455f-8870-a072098566e7] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 23 02:48:55.176132 n-d-master-1 devstack@n-api.service[120945]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dc6b279b-942d-4b38-8231-bb7b36b63253] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 23 02:48:55.176684 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:48:55.177503 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=38 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:48:55.178467 n-d-master-1 devstack@n-api.service[120945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 23 02:48:55.178610 n-d-master-1 devstack@n-api.service[120945]: Sun Oct 23 02:48:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/71b5b03e-0bb5-4615-99e9-82867288572b/action (ip 10.222.0.42) !!! Oct 23 02:48:55.180551 n-d-master-1 devstack@n-api.service[120945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 23 02:48:55.180657 n-d-master-1 devstack@n-api.service[120945]: Sun Oct 23 02:48:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/71b5b03e-0bb5-4615-99e9-82867288572b/action (ip 10.222.0.42) !!! Oct 23 02:48:55.182575 n-d-master-1 devstack@n-api.service[120945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 23 02:48:55.182678 n-d-master-1 devstack@n-api.service[120945]: Sun Oct 23 02:48:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/71b5b03e-0bb5-4615-99e9-82867288572b/action (ip 10.222.0.42) !!! Oct 23 02:48:55.188575 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-e480a5e0-b440-477a-9659-8ca106eb0b26 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1495329481"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:48:55.191010 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-e480a5e0-b440-477a-9659-8ca106eb0b26 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] [instance: 71b5b03e-0bb5-4615-99e9-82867288572b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:48:55.208209 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e480a5e0-b440-477a-9659-8ca106eb0b26 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:48:55.208704 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e480a5e0-b440-477a-9659-8ca106eb0b26 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:48:55.209820 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e480a5e0-b440-477a-9659-8ca106eb0b26 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:48:55.210679 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e480a5e0-b440-477a-9659-8ca106eb0b26 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:48:55.211149 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e480a5e0-b440-477a-9659-8ca106eb0b26 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:48:55.211588 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-e480a5e0-b440-477a-9659-8ca106eb0b26 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:48:55.607868 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-e480a5e0-b440-477a-9659-8ca106eb0b26 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] 10.222.0.42 "POST /compute/v2.1/servers/71b5b03e-0bb5-4615-99e9-82867288572b/action" status: 202 len: 0 microversion: 2.1 time: 0.434586 Oct 23 02:48:55.608520 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4133/8357] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:48:55 2022] POST /compute/v2.1/servers/71b5b03e-0bb5-4615-99e9-82867288572b/action => generated 0 bytes in 436 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 23 02:49:02.414554 n-d-master-1 devstack@n-api.service[120944]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ed487b5d-fedf-4013-b387-a53679baa86e] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 23 02:49:02.418990 n-d-master-1 devstack@n-api.service[120944]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6e68fc69-29cc-49a6-b869-84458cd5ea3f] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 23 02:49:02.418990 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:49:02.418990 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=30 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:49:02.418990 n-d-master-1 devstack@n-api.service[120944]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 23 02:49:02.418990 n-d-master-1 devstack@n-api.service[120944]: Sun Oct 23 02:49:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.42) !!! Oct 23 02:49:02.420246 n-d-master-1 devstack@n-api.service[120944]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 23 02:49:02.420538 n-d-master-1 devstack@n-api.service[120944]: Sun Oct 23 02:49:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.42) !!! Oct 23 02:49:02.426561 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-d706b59c-9b88-4380-9fa7-14cb2ac767b2 req-15c31656-2e89-4c0b-80b5-9c0be8c5f457 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71b5b03e-0bb5-4615-99e9-82867288572b", "name": "network-vif-plugged", "status": "completed", "tag": "7fd40410-5f15-42e2-92e2-100e9a0ef6b5"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:49:02.439439 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-d706b59c-9b88-4380-9fa7-14cb2ac767b2 req-15c31656-2e89-4c0b-80b5-9c0be8c5f457 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:49:02.440007 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-d706b59c-9b88-4380-9fa7-14cb2ac767b2 req-15c31656-2e89-4c0b-80b5-9c0be8c5f457 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:49:02.440599 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-d706b59c-9b88-4380-9fa7-14cb2ac767b2 req-15c31656-2e89-4c0b-80b5-9c0be8c5f457 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:49:02.455161 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-d706b59c-9b88-4380-9fa7-14cb2ac767b2 req-15c31656-2e89-4c0b-80b5-9c0be8c5f457 service nova] Creating event network-vif-plugged:7fd40410-5f15-42e2-92e2-100e9a0ef6b5 for instance 71b5b03e-0bb5-4615-99e9-82867288572b on n-h2-master-1 Oct 23 02:49:02.460523 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-d706b59c-9b88-4380-9fa7-14cb2ac767b2 req-15c31656-2e89-4c0b-80b5-9c0be8c5f457 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049076 Oct 23 02:49:02.461127 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4225/8358] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:49:11.294972 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:49:11.295753 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:49:11.299911 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4fb92db6-9056-455c-8e0f-81312f48a0f4 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-685487677", "imageRef": "8d5053ef-9ba1-485c-ac15-9cc372caef4b", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1320171934", "security_groups": [{"name": "tempest-secgroup-smoke-862314973"}], "networks": [{"uuid": "439f8903-8a58-4544-b361-fd82c6247aa7"}]}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:49:11.328164 n-d-master-1 devstack@n-api.service[120945]: INFO oslo.messaging._drivers.impl_rabbit [-] [819a2dfa-4c7a-455f-8870-a072098566e7] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 41096. Oct 23 02:49:11.328858 n-d-master-1 devstack@n-api.service[120945]: INFO oslo.messaging._drivers.impl_rabbit [-] [dc6b279b-942d-4b38-8231-bb7b36b63253] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 41098. Oct 23 02:49:11.414430 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.network.neutron [None req-4fb92db6-9056-455c-8e0f-81312f48a0f4 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] validate_networks() for [('439f8903-8a58-4544-b361-fd82c6247aa7', None, None, None, None, None)] {{(pid=120945) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 02:49:12.115844 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-4fb92db6-9056-455c-8e0f-81312f48a0f4 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Flavor limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:49:12.116279 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-4fb92db6-9056-455c-8e0f-81312f48a0f4 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Image limits 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:49:12.116765 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-4fb92db6-9056-455c-8e0f-81312f48a0f4 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Flavor pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:49:12.117214 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-4fb92db6-9056-455c-8e0f-81312f48a0f4 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Image pref 0:0:0 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:49:12.117672 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.virt.hardware [None req-4fb92db6-9056-455c-8e0f-81312f48a0f4 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:49:12.126626 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4fb92db6-9056-455c-8e0f-81312f48a0f4 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:49:12.127124 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4fb92db6-9056-455c-8e0f-81312f48a0f4 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:49:12.127572 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4fb92db6-9056-455c-8e0f-81312f48a0f4 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:49:12.128309 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4fb92db6-9056-455c-8e0f-81312f48a0f4 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:49:12.128785 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4fb92db6-9056-455c-8e0f-81312f48a0f4 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:49:12.129223 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4fb92db6-9056-455c-8e0f-81312f48a0f4 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:49:12.145942 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-4fb92db6-9056-455c-8e0f-81312f48a0f4 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Getting quotas for project df930ec48af34ab988097274a950a70a. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:49:12.151693 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.quota [None req-4fb92db6-9056-455c-8e0f-81312f48a0f4 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Getting quotas for user 6203993a83b2402ca8789188cf27c578 and project df930ec48af34ab988097274a950a70a. Resources: {'instances', 'ram', 'cores'} {{(pid=120945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:49:12.164635 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4fb92db6-9056-455c-8e0f-81312f48a0f4 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Going to run 1 instances... {{(pid=120945) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 02:49:12.167092 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4fb92db6-9056-455c-8e0f-81312f48a0f4 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] [instance: c00aac2a-d7d3-43a4-aeb4-e59b6035acc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d5053ef-9ba1-485c-ac15-9cc372caef4b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 02:49:12.295097 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4fb92db6-9056-455c-8e0f-81312f48a0f4 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.002452 Oct 23 02:49:12.296023 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4134/8359] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 02:49:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 1004 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 02:49:12.310162 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7d703886-4ad8-4e76-bdec-8d3cf79c8a82 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:49:12.311385 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7d703886-4ad8-4e76-bdec-8d3cf79c8a82 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] [instance: c00aac2a-d7d3-43a4-aeb4-e59b6035acc5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:49:12.323087 n-d-master-1 devstack@n-api.service[120944]: INFO oslo.messaging._drivers.impl_rabbit [-] [6e68fc69-29cc-49a6-b869-84458cd5ea3f] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 41114. Oct 23 02:49:12.324856 n-d-master-1 devstack@n-api.service[120944]: INFO oslo.messaging._drivers.impl_rabbit [-] [ed487b5d-fedf-4013-b387-a53679baa86e] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 41112. Oct 23 02:49:12.375067 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-7d703886-4ad8-4e76-bdec-8d3cf79c8a82 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6203993a83b2402ca8789188cf27c578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df930ec48af34ab988097274a950a70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:49:12.383608 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7d703886-4ad8-4e76-bdec-8d3cf79c8a82 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] 10.222.0.42 "GET /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5" status: 200 len: 1248 microversion: 2.1 time: 0.080498 Oct 23 02:49:12.384269 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4226/8360] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:49:12 2022] GET /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5 => generated 1248 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:49:13.407953 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-af8993d7-350b-415a-ab2a-765fc043a80d tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:49:13.408584 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-af8993d7-350b-415a-ab2a-765fc043a80d tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] [instance: c00aac2a-d7d3-43a4-aeb4-e59b6035acc5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:49:13.461721 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-af8993d7-350b-415a-ab2a-765fc043a80d tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6203993a83b2402ca8789188cf27c578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df930ec48af34ab988097274a950a70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:49:13.468685 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-af8993d7-350b-415a-ab2a-765fc043a80d tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] 10.222.0.42 "GET /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5" status: 200 len: 1248 microversion: 2.1 time: 0.065493 Oct 23 02:49:13.469255 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4135/8361] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:49:13 2022] GET /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5 => generated 1248 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:49:14.493160 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-15a811c4-9b6e-4437-8c38-b7a456942ce9 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:49:14.493782 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-15a811c4-9b6e-4437-8c38-b7a456942ce9 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] [instance: c00aac2a-d7d3-43a4-aeb4-e59b6035acc5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:49:14.548880 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-15a811c4-9b6e-4437-8c38-b7a456942ce9 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6203993a83b2402ca8789188cf27c578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df930ec48af34ab988097274a950a70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:49:14.556362 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-15a811c4-9b6e-4437-8c38-b7a456942ce9 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] 10.222.0.42 "GET /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5" status: 200 len: 1248 microversion: 2.1 time: 0.067964 Oct 23 02:49:14.556928 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4227/8362] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:49:14 2022] GET /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5 => generated 1248 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:49:15.578078 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-cca74186-90ad-41b6-a701-7dd60ea278db tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:49:15.578750 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-cca74186-90ad-41b6-a701-7dd60ea278db tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] [instance: c00aac2a-d7d3-43a4-aeb4-e59b6035acc5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:49:15.632977 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-cca74186-90ad-41b6-a701-7dd60ea278db tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6203993a83b2402ca8789188cf27c578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df930ec48af34ab988097274a950a70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:49:15.639814 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-cca74186-90ad-41b6-a701-7dd60ea278db tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] 10.222.0.42 "GET /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5" status: 200 len: 1248 microversion: 2.1 time: 0.065644 Oct 23 02:49:15.640398 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4136/8363] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:49:15 2022] GET /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5 => generated 1248 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:49:16.434774 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-9ae30ab5-6376-4758-a646-7312c75b9bf6 req-a09e28d2-9730-4364-a818-c37feb8c21b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71b5b03e-0bb5-4615-99e9-82867288572b", "name": "network-vif-unplugged", "status": "completed", "tag": "7fd40410-5f15-42e2-92e2-100e9a0ef6b5"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:49:16.445447 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-9ae30ab5-6376-4758-a646-7312c75b9bf6 req-a09e28d2-9730-4364-a818-c37feb8c21b7 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:49:16.445930 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-9ae30ab5-6376-4758-a646-7312c75b9bf6 req-a09e28d2-9730-4364-a818-c37feb8c21b7 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:49:16.446386 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-9ae30ab5-6376-4758-a646-7312c75b9bf6 req-a09e28d2-9730-4364-a818-c37feb8c21b7 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:49:16.456654 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-9ae30ab5-6376-4758-a646-7312c75b9bf6 req-a09e28d2-9730-4364-a818-c37feb8c21b7 service nova] Creating event network-vif-unplugged:7fd40410-5f15-42e2-92e2-100e9a0ef6b5 for instance 71b5b03e-0bb5-4615-99e9-82867288572b on n-h2-master-1 Oct 23 02:49:16.463557 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-9ae30ab5-6376-4758-a646-7312c75b9bf6 req-a09e28d2-9730-4364-a818-c37feb8c21b7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087572 Oct 23 02:49:16.465765 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4228/8364] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:49:16.662628 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c536e22a-6908-4938-8c6a-fd7defe06ad9 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:49:16.663226 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c536e22a-6908-4938-8c6a-fd7defe06ad9 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] [instance: c00aac2a-d7d3-43a4-aeb4-e59b6035acc5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:49:16.670456 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c536e22a-6908-4938-8c6a-fd7defe06ad9 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:49:16.670961 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c536e22a-6908-4938-8c6a-fd7defe06ad9 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:49:16.671408 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c536e22a-6908-4938-8c6a-fd7defe06ad9 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:49:16.672109 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c536e22a-6908-4938-8c6a-fd7defe06ad9 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:49:16.672577 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c536e22a-6908-4938-8c6a-fd7defe06ad9 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:49:16.673013 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c536e22a-6908-4938-8c6a-fd7defe06ad9 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:49:16.741323 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c536e22a-6908-4938-8c6a-fd7defe06ad9 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6203993a83b2402ca8789188cf27c578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df930ec48af34ab988097274a950a70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:49:16.749359 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c536e22a-6908-4938-8c6a-fd7defe06ad9 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] 10.222.0.42 "GET /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5" status: 200 len: 1252 microversion: 2.1 time: 0.091391 Oct 23 02:49:16.749928 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4137/8365] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:49:16 2022] GET /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5 => generated 1252 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:49:17.774139 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-3303719b-9150-4add-9977-66f367376884 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:49:17.774835 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-3303719b-9150-4add-9977-66f367376884 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] [instance: c00aac2a-d7d3-43a4-aeb4-e59b6035acc5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:49:17.781919 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3303719b-9150-4add-9977-66f367376884 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:49:17.782443 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3303719b-9150-4add-9977-66f367376884 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:49:17.782879 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3303719b-9150-4add-9977-66f367376884 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:49:17.783576 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3303719b-9150-4add-9977-66f367376884 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:49:17.784032 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3303719b-9150-4add-9977-66f367376884 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:49:17.784457 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-3303719b-9150-4add-9977-66f367376884 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:49:17.851677 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-3303719b-9150-4add-9977-66f367376884 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6203993a83b2402ca8789188cf27c578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df930ec48af34ab988097274a950a70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:49:17.859424 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-3303719b-9150-4add-9977-66f367376884 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] 10.222.0.42 "GET /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5" status: 200 len: 1244 microversion: 2.1 time: 0.090315 Oct 23 02:49:17.860023 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4229/8366] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:49:17 2022] GET /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5 => generated 1244 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:49:18.886351 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8df7c997-b890-4adf-a361-01d7b69b4c20 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:49:18.886916 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8df7c997-b890-4adf-a361-01d7b69b4c20 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] [instance: c00aac2a-d7d3-43a4-aeb4-e59b6035acc5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:49:18.893703 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8df7c997-b890-4adf-a361-01d7b69b4c20 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:49:18.894243 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8df7c997-b890-4adf-a361-01d7b69b4c20 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:49:18.894696 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8df7c997-b890-4adf-a361-01d7b69b4c20 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:49:18.895407 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8df7c997-b890-4adf-a361-01d7b69b4c20 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:49:18.895874 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8df7c997-b890-4adf-a361-01d7b69b4c20 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:49:18.896803 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8df7c997-b890-4adf-a361-01d7b69b4c20 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:49:18.991241 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8df7c997-b890-4adf-a361-01d7b69b4c20 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6203993a83b2402ca8789188cf27c578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df930ec48af34ab988097274a950a70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:49:18.999206 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8df7c997-b890-4adf-a361-01d7b69b4c20 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] 10.222.0.42 "GET /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5" status: 200 len: 1318 microversion: 2.1 time: 0.116923 Oct 23 02:49:18.999791 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4138/8367] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:49:18 2022] GET /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5 => generated 1318 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:49:20.023471 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-10a8db0d-bfa8-481c-b9c6-ebcb4901b83b tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:49:20.024102 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-10a8db0d-bfa8-481c-b9c6-ebcb4901b83b tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] [instance: c00aac2a-d7d3-43a4-aeb4-e59b6035acc5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:49:20.030750 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-10a8db0d-bfa8-481c-b9c6-ebcb4901b83b tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:49:20.031245 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-10a8db0d-bfa8-481c-b9c6-ebcb4901b83b tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:49:20.031686 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-10a8db0d-bfa8-481c-b9c6-ebcb4901b83b tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:49:20.032386 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-10a8db0d-bfa8-481c-b9c6-ebcb4901b83b tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:49:20.032846 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-10a8db0d-bfa8-481c-b9c6-ebcb4901b83b tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:49:20.033273 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-10a8db0d-bfa8-481c-b9c6-ebcb4901b83b tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:49:20.176507 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-10a8db0d-bfa8-481c-b9c6-ebcb4901b83b tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6203993a83b2402ca8789188cf27c578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df930ec48af34ab988097274a950a70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:49:20.185314 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-10a8db0d-bfa8-481c-b9c6-ebcb4901b83b tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] 10.222.0.42 "GET /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5" status: 200 len: 1373 microversion: 2.1 time: 0.166296 Oct 23 02:49:20.185893 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4230/8368] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:49:20 2022] GET /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5 => generated 1373 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:49:21.211363 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-d7f5bd13-8597-4da4-8e45-adcf840543bb tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:49:21.212184 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-d7f5bd13-8597-4da4-8e45-adcf840543bb tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] [instance: c00aac2a-d7d3-43a4-aeb4-e59b6035acc5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:49:21.219580 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d7f5bd13-8597-4da4-8e45-adcf840543bb tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:49:21.220167 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d7f5bd13-8597-4da4-8e45-adcf840543bb tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:49:21.220695 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d7f5bd13-8597-4da4-8e45-adcf840543bb tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:49:21.221489 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d7f5bd13-8597-4da4-8e45-adcf840543bb tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:49:21.222055 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d7f5bd13-8597-4da4-8e45-adcf840543bb tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:49:21.222695 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-d7f5bd13-8597-4da4-8e45-adcf840543bb tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:49:21.369541 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-d7f5bd13-8597-4da4-8e45-adcf840543bb tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6203993a83b2402ca8789188cf27c578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df930ec48af34ab988097274a950a70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:49:21.377462 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-d7f5bd13-8597-4da4-8e45-adcf840543bb tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] 10.222.0.42 "GET /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5" status: 200 len: 1373 microversion: 2.1 time: 0.171559 Oct 23 02:49:21.387124 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4139/8369] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:49:21 2022] GET /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5 => generated 1373 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:49:22.400969 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-4169d77b-75aa-4644-92ac-4dffac4a370c tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:49:22.401719 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-4169d77b-75aa-4644-92ac-4dffac4a370c tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] [instance: c00aac2a-d7d3-43a4-aeb4-e59b6035acc5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:49:22.409090 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4169d77b-75aa-4644-92ac-4dffac4a370c tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:49:22.409581 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4169d77b-75aa-4644-92ac-4dffac4a370c tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:49:22.410059 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4169d77b-75aa-4644-92ac-4dffac4a370c tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:49:22.410769 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4169d77b-75aa-4644-92ac-4dffac4a370c tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:49:22.411231 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4169d77b-75aa-4644-92ac-4dffac4a370c tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:49:22.411708 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-4169d77b-75aa-4644-92ac-4dffac4a370c tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:49:22.555559 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-4169d77b-75aa-4644-92ac-4dffac4a370c tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6203993a83b2402ca8789188cf27c578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df930ec48af34ab988097274a950a70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:49:22.564177 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-4169d77b-75aa-4644-92ac-4dffac4a370c tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] 10.222.0.42 "GET /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5" status: 200 len: 1373 microversion: 2.1 time: 0.167244 Oct 23 02:49:22.564771 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4231/8370] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:49:22 2022] GET /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5 => generated 1373 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:49:23.588927 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-4840f2ee-255b-42c0-839f-d9b383001734 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:49:23.589604 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-4840f2ee-255b-42c0-839f-d9b383001734 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] [instance: c00aac2a-d7d3-43a4-aeb4-e59b6035acc5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:49:23.591539 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:49:23.597809 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4840f2ee-255b-42c0-839f-d9b383001734 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:49:23.598369 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4840f2ee-255b-42c0-839f-d9b383001734 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:49:23.598859 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4840f2ee-255b-42c0-839f-d9b383001734 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:49:23.599616 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4840f2ee-255b-42c0-839f-d9b383001734 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:49:23.600085 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4840f2ee-255b-42c0-839f-d9b383001734 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:49:23.600526 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-4840f2ee-255b-42c0-839f-d9b383001734 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:49:23.749779 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-4840f2ee-255b-42c0-839f-d9b383001734 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6203993a83b2402ca8789188cf27c578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df930ec48af34ab988097274a950a70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:49:23.761896 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-4840f2ee-255b-42c0-839f-d9b383001734 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] 10.222.0.42 "GET /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5" status: 200 len: 1373 microversion: 2.1 time: 0.177314 Oct 23 02:49:23.762947 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4140/8371] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:49:23 2022] GET /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5 => generated 1373 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:49:24.785119 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-27fa530b-cde6-47cf-b3a3-1b7f7b1f7c5f tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:49:24.785716 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-27fa530b-cde6-47cf-b3a3-1b7f7b1f7c5f tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] [instance: c00aac2a-d7d3-43a4-aeb4-e59b6035acc5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:49:24.788791 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell0:SELECT=4 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:49:24.794896 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-27fa530b-cde6-47cf-b3a3-1b7f7b1f7c5f tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:49:24.795404 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-27fa530b-cde6-47cf-b3a3-1b7f7b1f7c5f tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:49:24.797952 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-27fa530b-cde6-47cf-b3a3-1b7f7b1f7c5f tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:49:24.797952 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-27fa530b-cde6-47cf-b3a3-1b7f7b1f7c5f tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:49:24.797952 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-27fa530b-cde6-47cf-b3a3-1b7f7b1f7c5f tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:49:24.797952 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-27fa530b-cde6-47cf-b3a3-1b7f7b1f7c5f tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:49:24.942189 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-27fa530b-cde6-47cf-b3a3-1b7f7b1f7c5f tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6203993a83b2402ca8789188cf27c578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df930ec48af34ab988097274a950a70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:49:24.951117 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-27fa530b-cde6-47cf-b3a3-1b7f7b1f7c5f tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] 10.222.0.42 "GET /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5" status: 200 len: 1373 microversion: 2.1 time: 0.170081 Oct 23 02:49:24.951894 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4232/8372] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:49:24 2022] GET /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5 => generated 1373 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:49:25.974501 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-28493895-965b-4541-a30a-76aba8ba9e38 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:49:25.975055 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-28493895-965b-4541-a30a-76aba8ba9e38 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] [instance: c00aac2a-d7d3-43a4-aeb4-e59b6035acc5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:49:25.980920 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell0:SELECT=10 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:49:25.982884 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-28493895-965b-4541-a30a-76aba8ba9e38 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:49:25.989339 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-28493895-965b-4541-a30a-76aba8ba9e38 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:49:25.989339 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-28493895-965b-4541-a30a-76aba8ba9e38 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:49:25.989339 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-28493895-965b-4541-a30a-76aba8ba9e38 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:49:25.989339 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-28493895-965b-4541-a30a-76aba8ba9e38 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:49:25.989339 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-28493895-965b-4541-a30a-76aba8ba9e38 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:49:26.139778 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-28493895-965b-4541-a30a-76aba8ba9e38 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6203993a83b2402ca8789188cf27c578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df930ec48af34ab988097274a950a70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:49:26.145022 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-28493895-965b-4541-a30a-76aba8ba9e38 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] 10.222.0.42 "GET /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5" status: 200 len: 1373 microversion: 2.1 time: 0.174438 Oct 23 02:49:26.145729 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4141/8373] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:49:25 2022] GET /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5 => generated 1373 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:49:27.169577 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-51835a6f-1045-41ce-a577-d6007768e174 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:49:27.170233 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-51835a6f-1045-41ce-a577-d6007768e174 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] [instance: c00aac2a-d7d3-43a4-aeb4-e59b6035acc5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:49:27.177091 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-51835a6f-1045-41ce-a577-d6007768e174 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:49:27.177581 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-51835a6f-1045-41ce-a577-d6007768e174 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:49:27.178047 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-51835a6f-1045-41ce-a577-d6007768e174 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:49:27.178745 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-51835a6f-1045-41ce-a577-d6007768e174 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:49:27.179205 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-51835a6f-1045-41ce-a577-d6007768e174 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:49:27.179666 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-51835a6f-1045-41ce-a577-d6007768e174 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:49:27.313738 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-51835a6f-1045-41ce-a577-d6007768e174 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6203993a83b2402ca8789188cf27c578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df930ec48af34ab988097274a950a70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:49:27.322052 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-51835a6f-1045-41ce-a577-d6007768e174 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] 10.222.0.42 "GET /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5" status: 200 len: 1373 microversion: 2.1 time: 0.156508 Oct 23 02:49:27.322617 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4233/8374] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:49:27 2022] GET /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5 => generated 1373 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:49:28.344867 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-b23e91b7-3e59-438e-aa8e-67482886dff6 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:49:28.345504 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-b23e91b7-3e59-438e-aa8e-67482886dff6 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] [instance: c00aac2a-d7d3-43a4-aeb4-e59b6035acc5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:49:28.352845 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b23e91b7-3e59-438e-aa8e-67482886dff6 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:49:28.353346 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b23e91b7-3e59-438e-aa8e-67482886dff6 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:49:28.353808 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b23e91b7-3e59-438e-aa8e-67482886dff6 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:49:28.354540 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b23e91b7-3e59-438e-aa8e-67482886dff6 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:49:28.355020 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b23e91b7-3e59-438e-aa8e-67482886dff6 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:49:28.355464 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-b23e91b7-3e59-438e-aa8e-67482886dff6 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:49:28.540679 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-b23e91b7-3e59-438e-aa8e-67482886dff6 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6203993a83b2402ca8789188cf27c578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df930ec48af34ab988097274a950a70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:49:28.548700 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-b23e91b7-3e59-438e-aa8e-67482886dff6 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] 10.222.0.42 "GET /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5" status: 200 len: 1373 microversion: 2.1 time: 0.207720 Oct 23 02:49:28.549285 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4142/8375] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:49:28 2022] GET /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5 => generated 1373 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:49:28.718627 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-f8ef3c57-b8cc-45a2-a00d-b8aee93ce5c1 req-8d32d895-044a-4bea-bcb2-029587a18f03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c00aac2a-d7d3-43a4-aeb4-e59b6035acc5", "tag": "480b3bf4-7570-4306-ba44-7ddc5a4e1be4"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:49:28.729653 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-f8ef3c57-b8cc-45a2-a00d-b8aee93ce5c1 req-8d32d895-044a-4bea-bcb2-029587a18f03 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:49:28.730192 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-f8ef3c57-b8cc-45a2-a00d-b8aee93ce5c1 req-8d32d895-044a-4bea-bcb2-029587a18f03 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:49:28.730636 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-f8ef3c57-b8cc-45a2-a00d-b8aee93ce5c1 req-8d32d895-044a-4bea-bcb2-029587a18f03 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:49:28.742434 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-f8ef3c57-b8cc-45a2-a00d-b8aee93ce5c1 req-8d32d895-044a-4bea-bcb2-029587a18f03 service nova] Creating event network-changed:480b3bf4-7570-4306-ba44-7ddc5a4e1be4 for instance c00aac2a-d7d3-43a4-aeb4-e59b6035acc5 on n-h1-master-1 Oct 23 02:49:28.747586 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-f8ef3c57-b8cc-45a2-a00d-b8aee93ce5c1 req-8d32d895-044a-4bea-bcb2-029587a18f03 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032805 Oct 23 02:49:28.751587 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4234/8376] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:49:29.571725 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-8a2c375b-2a08-4875-a217-4b5556c855c4 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:49:29.572367 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-8a2c375b-2a08-4875-a217-4b5556c855c4 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] [instance: c00aac2a-d7d3-43a4-aeb4-e59b6035acc5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:49:29.579218 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a2c375b-2a08-4875-a217-4b5556c855c4 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:49:29.579716 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a2c375b-2a08-4875-a217-4b5556c855c4 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:49:29.580157 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a2c375b-2a08-4875-a217-4b5556c855c4 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:49:29.580859 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a2c375b-2a08-4875-a217-4b5556c855c4 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:49:29.581319 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a2c375b-2a08-4875-a217-4b5556c855c4 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:49:29.581748 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-8a2c375b-2a08-4875-a217-4b5556c855c4 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:49:29.714615 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-8a2c375b-2a08-4875-a217-4b5556c855c4 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6203993a83b2402ca8789188cf27c578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df930ec48af34ab988097274a950a70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:49:29.722231 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-8a2c375b-2a08-4875-a217-4b5556c855c4 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] 10.222.0.42 "GET /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5" status: 200 len: 1373 microversion: 2.1 time: 0.154423 Oct 23 02:49:29.722817 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4143/8377] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:49:29 2022] GET /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5 => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:49:30.746609 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6f4c0629-611f-4fe1-819c-cc397b018712 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:49:30.747222 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6f4c0629-611f-4fe1-819c-cc397b018712 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] [instance: c00aac2a-d7d3-43a4-aeb4-e59b6035acc5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:49:30.753432 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6f4c0629-611f-4fe1-819c-cc397b018712 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:49:30.753914 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6f4c0629-611f-4fe1-819c-cc397b018712 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:49:30.754373 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6f4c0629-611f-4fe1-819c-cc397b018712 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:49:30.755059 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6f4c0629-611f-4fe1-819c-cc397b018712 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:49:30.755507 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6f4c0629-611f-4fe1-819c-cc397b018712 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:49:30.755930 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6f4c0629-611f-4fe1-819c-cc397b018712 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:49:30.889458 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-6f4c0629-611f-4fe1-819c-cc397b018712 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6203993a83b2402ca8789188cf27c578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df930ec48af34ab988097274a950a70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:49:30.898043 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6f4c0629-611f-4fe1-819c-cc397b018712 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] 10.222.0.42 "GET /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5" status: 200 len: 1373 microversion: 2.1 time: 0.156624 Oct 23 02:49:30.898632 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4235/8378] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:49:30 2022] GET /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5 => generated 1373 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:49:31.921814 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a0ac75d4-cfcd-4f90-883c-765cd58afe74 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:49:31.922529 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a0ac75d4-cfcd-4f90-883c-765cd58afe74 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] [instance: c00aac2a-d7d3-43a4-aeb4-e59b6035acc5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:49:31.929940 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a0ac75d4-cfcd-4f90-883c-765cd58afe74 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:49:31.930473 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a0ac75d4-cfcd-4f90-883c-765cd58afe74 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:49:31.930921 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a0ac75d4-cfcd-4f90-883c-765cd58afe74 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:49:31.931627 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a0ac75d4-cfcd-4f90-883c-765cd58afe74 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:49:31.932095 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a0ac75d4-cfcd-4f90-883c-765cd58afe74 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:49:31.932532 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a0ac75d4-cfcd-4f90-883c-765cd58afe74 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:49:32.065318 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a0ac75d4-cfcd-4f90-883c-765cd58afe74 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6203993a83b2402ca8789188cf27c578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df930ec48af34ab988097274a950a70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:49:32.073067 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a0ac75d4-cfcd-4f90-883c-765cd58afe74 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] 10.222.0.42 "GET /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5" status: 200 len: 1373 microversion: 2.1 time: 0.155275 Oct 23 02:49:32.073641 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4144/8379] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:49:31 2022] GET /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5 => generated 1373 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:49:33.096528 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-784fd29e-8825-40ad-a67b-f4fb5e7df40b tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:49:33.097065 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-784fd29e-8825-40ad-a67b-f4fb5e7df40b tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] [instance: c00aac2a-d7d3-43a4-aeb4-e59b6035acc5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:49:33.103839 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-784fd29e-8825-40ad-a67b-f4fb5e7df40b tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:49:33.104328 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-784fd29e-8825-40ad-a67b-f4fb5e7df40b tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:49:33.104763 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-784fd29e-8825-40ad-a67b-f4fb5e7df40b tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:49:33.105445 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-784fd29e-8825-40ad-a67b-f4fb5e7df40b tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:49:33.105898 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-784fd29e-8825-40ad-a67b-f4fb5e7df40b tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:49:33.106346 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-784fd29e-8825-40ad-a67b-f4fb5e7df40b tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:49:33.237909 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-784fd29e-8825-40ad-a67b-f4fb5e7df40b tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6203993a83b2402ca8789188cf27c578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df930ec48af34ab988097274a950a70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:49:33.246647 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-784fd29e-8825-40ad-a67b-f4fb5e7df40b tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] 10.222.0.42 "GET /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5" status: 200 len: 1373 microversion: 2.1 time: 0.154131 Oct 23 02:49:33.247232 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4236/8380] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:49:33 2022] GET /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5 => generated 1373 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:49:34.270021 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a9314750-e8b1-43b0-a7c1-f6527815d256 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:49:34.270749 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a9314750-e8b1-43b0-a7c1-f6527815d256 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] [instance: c00aac2a-d7d3-43a4-aeb4-e59b6035acc5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:49:34.278258 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9314750-e8b1-43b0-a7c1-f6527815d256 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:49:34.278749 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9314750-e8b1-43b0-a7c1-f6527815d256 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:49:34.279192 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9314750-e8b1-43b0-a7c1-f6527815d256 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:49:34.279882 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9314750-e8b1-43b0-a7c1-f6527815d256 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:49:34.280345 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9314750-e8b1-43b0-a7c1-f6527815d256 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:49:34.280778 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a9314750-e8b1-43b0-a7c1-f6527815d256 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:49:34.401267 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-8f7b3c68-0112-4e26-a2a1-9dc9d9850737 req-eb7e8738-c7ed-4453-8aad-a28e10e852ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c00aac2a-d7d3-43a4-aeb4-e59b6035acc5", "name": "network-vif-plugged", "status": "completed", "tag": "480b3bf4-7570-4306-ba44-7ddc5a4e1be4"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:49:34.412641 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-8f7b3c68-0112-4e26-a2a1-9dc9d9850737 req-eb7e8738-c7ed-4453-8aad-a28e10e852ec service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:49:34.413187 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-8f7b3c68-0112-4e26-a2a1-9dc9d9850737 req-eb7e8738-c7ed-4453-8aad-a28e10e852ec service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:49:34.413623 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-8f7b3c68-0112-4e26-a2a1-9dc9d9850737 req-eb7e8738-c7ed-4453-8aad-a28e10e852ec service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:49:34.417119 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a9314750-e8b1-43b0-a7c1-f6527815d256 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6203993a83b2402ca8789188cf27c578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df930ec48af34ab988097274a950a70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:49:34.429814 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a9314750-e8b1-43b0-a7c1-f6527815d256 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] 10.222.0.42 "GET /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5" status: 200 len: 1373 microversion: 2.1 time: 0.158929 Oct 23 02:49:34.429988 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-8f7b3c68-0112-4e26-a2a1-9dc9d9850737 req-eb7e8738-c7ed-4453-8aad-a28e10e852ec service nova] Creating event network-vif-plugged:480b3bf4-7570-4306-ba44-7ddc5a4e1be4 for instance c00aac2a-d7d3-43a4-aeb4-e59b6035acc5 on n-h1-master-1 Oct 23 02:49:34.430099 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4145/8381] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:49:34 2022] GET /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5 => generated 1373 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:49:34.431052 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-8f7b3c68-0112-4e26-a2a1-9dc9d9850737 req-eb7e8738-c7ed-4453-8aad-a28e10e852ec service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034768 Oct 23 02:49:34.431655 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4237/8382] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:49:35.449566 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-caf440e4-ed61-406e-ac8f-f994692ef380 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:49:35.450223 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-caf440e4-ed61-406e-ac8f-f994692ef380 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] [instance: c00aac2a-d7d3-43a4-aeb4-e59b6035acc5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:49:35.457147 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-caf440e4-ed61-406e-ac8f-f994692ef380 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:49:35.457645 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-caf440e4-ed61-406e-ac8f-f994692ef380 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:49:35.458135 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-caf440e4-ed61-406e-ac8f-f994692ef380 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:49:35.458832 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-caf440e4-ed61-406e-ac8f-f994692ef380 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:49:35.459305 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-caf440e4-ed61-406e-ac8f-f994692ef380 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:49:35.459744 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-caf440e4-ed61-406e-ac8f-f994692ef380 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:49:35.594320 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-caf440e4-ed61-406e-ac8f-f994692ef380 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6203993a83b2402ca8789188cf27c578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df930ec48af34ab988097274a950a70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:49:35.602736 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-caf440e4-ed61-406e-ac8f-f994692ef380 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] 10.222.0.42 "GET /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5" status: 200 len: 1373 microversion: 2.1 time: 0.157047 Oct 23 02:49:35.603507 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4146/8383] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:49:35 2022] GET /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5 => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:49:36.628297 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-1cb07935-d126-4857-9c67-3d43ba3042eb tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:49:36.629034 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-1cb07935-d126-4857-9c67-3d43ba3042eb tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] [instance: c00aac2a-d7d3-43a4-aeb4-e59b6035acc5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:49:36.635413 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1cb07935-d126-4857-9c67-3d43ba3042eb tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:49:36.635906 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1cb07935-d126-4857-9c67-3d43ba3042eb tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:49:36.636350 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1cb07935-d126-4857-9c67-3d43ba3042eb tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:49:36.637117 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1cb07935-d126-4857-9c67-3d43ba3042eb tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:49:36.637582 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1cb07935-d126-4857-9c67-3d43ba3042eb tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:49:36.638186 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-1cb07935-d126-4857-9c67-3d43ba3042eb tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:49:36.773492 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-1cb07935-d126-4857-9c67-3d43ba3042eb tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6203993a83b2402ca8789188cf27c578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df930ec48af34ab988097274a950a70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:49:36.781271 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-1cb07935-d126-4857-9c67-3d43ba3042eb tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] 10.222.0.42 "GET /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5" status: 200 len: 1559 microversion: 2.1 time: 0.158274 Oct 23 02:49:36.781849 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4238/8384] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:49:36 2022] GET /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:49:36.804334 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-c379120c-64c7-4e22-8552-3deec7b35280 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:49:36.804962 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-c379120c-64c7-4e22-8552-3deec7b35280 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] [instance: c00aac2a-d7d3-43a4-aeb4-e59b6035acc5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:49:36.811847 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c379120c-64c7-4e22-8552-3deec7b35280 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:49:36.812341 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c379120c-64c7-4e22-8552-3deec7b35280 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:49:36.812785 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c379120c-64c7-4e22-8552-3deec7b35280 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:49:36.813478 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c379120c-64c7-4e22-8552-3deec7b35280 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:49:36.813942 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c379120c-64c7-4e22-8552-3deec7b35280 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:49:36.814405 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-c379120c-64c7-4e22-8552-3deec7b35280 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:49:36.944051 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-c379120c-64c7-4e22-8552-3deec7b35280 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6203993a83b2402ca8789188cf27c578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df930ec48af34ab988097274a950a70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:49:36.952328 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-c379120c-64c7-4e22-8552-3deec7b35280 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] 10.222.0.42 "GET /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5" status: 200 len: 1559 microversion: 2.1 time: 0.152087 Oct 23 02:49:36.952906 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4147/8385] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:49:36 2022] GET /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:49:38.802709 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-7953da01-74e4-4b92-a696-649a14bf1b03 req-05a276f7-433a-49e3-8ba2-c06bfeaebc2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c00aac2a-d7d3-43a4-aeb4-e59b6035acc5", "tag": "480b3bf4-7570-4306-ba44-7ddc5a4e1be4"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:49:38.813397 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-7953da01-74e4-4b92-a696-649a14bf1b03 req-05a276f7-433a-49e3-8ba2-c06bfeaebc2a service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:49:38.813881 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-7953da01-74e4-4b92-a696-649a14bf1b03 req-05a276f7-433a-49e3-8ba2-c06bfeaebc2a service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:49:38.814350 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-7953da01-74e4-4b92-a696-649a14bf1b03 req-05a276f7-433a-49e3-8ba2-c06bfeaebc2a service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:49:38.825467 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-7953da01-74e4-4b92-a696-649a14bf1b03 req-05a276f7-433a-49e3-8ba2-c06bfeaebc2a service nova] Creating event network-changed:480b3bf4-7570-4306-ba44-7ddc5a4e1be4 for instance c00aac2a-d7d3-43a4-aeb4-e59b6035acc5 on n-h1-master-1 Oct 23 02:49:38.830572 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-7953da01-74e4-4b92-a696-649a14bf1b03 req-05a276f7-433a-49e3-8ba2-c06bfeaebc2a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031899 Oct 23 02:49:38.831384 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4239/8386] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:51:17.331649 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:51:17.332347 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=68 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:51:17.337348 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-28094145-298b-4efe-b536-f34a8667af54 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-331462787"}} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:51:17.340399 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-28094145-298b-4efe-b536-f34a8667af54 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] [instance: c00aac2a-d7d3-43a4-aeb4-e59b6035acc5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:51:17.346574 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-28094145-298b-4efe-b536-f34a8667af54 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:51:17.347071 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-28094145-298b-4efe-b536-f34a8667af54 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:51:17.347515 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-28094145-298b-4efe-b536-f34a8667af54 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:51:17.348217 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-28094145-298b-4efe-b536-f34a8667af54 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:51:17.348682 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-28094145-298b-4efe-b536-f34a8667af54 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:51:17.349118 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-28094145-298b-4efe-b536-f34a8667af54 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:51:17.947360 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-28094145-298b-4efe-b536-f34a8667af54 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] 10.222.0.42 "POST /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5/action" status: 202 len: 0 microversion: 2.1 time: 0.617468 Oct 23 02:51:17.947922 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4148/8387] 10.222.0.42 () {60 vars in 1278 bytes} [Sun Oct 23 02:51:17 2022] POST /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5/action => generated 0 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 23 02:51:22.951531 n-d-master-1 devstack@n-api.service[120944]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6e68fc69-29cc-49a6-b869-84458cd5ea3f] AMQP server on 10.222.0.42:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 23 02:51:22.953518 n-d-master-1 devstack@n-api.service[120944]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ed487b5d-fedf-4013-b387-a53679baa86e] AMQP server on 10.222.0.42:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 23 02:51:22.954384 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_api:SELECT=34 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:51:22.960302 n-d-master-1 devstack@n-api.service[120944]: DEBUG dbcounter [-] [120944] Writing DB stats nova_cell1:SELECT=58 {{(pid=120944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:51:22.965719 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-4124bc82-2846-400a-a613-9c27b91d15c7 req-ae0d4e50-190f-48a3-89cd-549da554bdcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c00aac2a-d7d3-43a4-aeb4-e59b6035acc5", "name": "network-vif-plugged", "status": "completed", "tag": "480b3bf4-7570-4306-ba44-7ddc5a4e1be4"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:51:22.979927 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-4124bc82-2846-400a-a613-9c27b91d15c7 req-ae0d4e50-190f-48a3-89cd-549da554bdcd service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:51:22.981117 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-4124bc82-2846-400a-a613-9c27b91d15c7 req-ae0d4e50-190f-48a3-89cd-549da554bdcd service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:51:22.981732 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-4124bc82-2846-400a-a613-9c27b91d15c7 req-ae0d4e50-190f-48a3-89cd-549da554bdcd service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:51:22.993296 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-4124bc82-2846-400a-a613-9c27b91d15c7 req-ae0d4e50-190f-48a3-89cd-549da554bdcd service nova] Creating event network-vif-plugged:480b3bf4-7570-4306-ba44-7ddc5a4e1be4 for instance c00aac2a-d7d3-43a4-aeb4-e59b6035acc5 on n-h1-master-1 Oct 23 02:51:23.000250 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-4124bc82-2846-400a-a613-9c27b91d15c7 req-ae0d4e50-190f-48a3-89cd-549da554bdcd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050505 Oct 23 02:51:23.000859 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4240/8388] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:51:34.291401 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_api:SELECT=2 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:51:34.292026 n-d-master-1 devstack@n-api.service[120945]: DEBUG dbcounter [-] [120945] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:51:34.296714 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5cb85d23-ce27-4d92-b96d-853bc6c5b43b tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:51:34.297320 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5cb85d23-ce27-4d92-b96d-853bc6c5b43b tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] [instance: c00aac2a-d7d3-43a4-aeb4-e59b6035acc5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:51:34.303906 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5cb85d23-ce27-4d92-b96d-853bc6c5b43b tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:51:34.304480 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5cb85d23-ce27-4d92-b96d-853bc6c5b43b tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:51:34.304931 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5cb85d23-ce27-4d92-b96d-853bc6c5b43b tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:51:34.305648 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5cb85d23-ce27-4d92-b96d-853bc6c5b43b tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:51:34.306168 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5cb85d23-ce27-4d92-b96d-853bc6c5b43b tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:51:34.307353 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-5cb85d23-ce27-4d92-b96d-853bc6c5b43b tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:51:34.323017 n-d-master-1 devstack@n-api.service[120944]: INFO oslo.messaging._drivers.impl_rabbit [-] [6e68fc69-29cc-49a6-b869-84458cd5ea3f] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 41428. Oct 23 02:51:34.326814 n-d-master-1 devstack@n-api.service[120944]: INFO oslo.messaging._drivers.impl_rabbit [-] [ed487b5d-fedf-4013-b387-a53679baa86e] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 41430. Oct 23 02:51:34.336421 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-5cb85d23-ce27-4d92-b96d-853bc6c5b43b tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] [instance: c00aac2a-d7d3-43a4-aeb4-e59b6035acc5] Going to try to terminate instance {{(pid=120945) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 02:51:34.359908 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-bda102df-4c07-4263-b7e7-ae760601850d req-8981767d-dca5-4a4c-87a3-121a31d959c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c00aac2a-d7d3-43a4-aeb4-e59b6035acc5", "tag": "480b3bf4-7570-4306-ba44-7ddc5a4e1be4"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:51:34.371393 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-bda102df-4c07-4263-b7e7-ae760601850d req-8981767d-dca5-4a4c-87a3-121a31d959c2 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:51:34.372377 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-bda102df-4c07-4263-b7e7-ae760601850d req-8981767d-dca5-4a4c-87a3-121a31d959c2 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:51:34.373302 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-bda102df-4c07-4263-b7e7-ae760601850d req-8981767d-dca5-4a4c-87a3-121a31d959c2 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:51:34.385355 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-bda102df-4c07-4263-b7e7-ae760601850d req-8981767d-dca5-4a4c-87a3-121a31d959c2 service nova] Creating event network-changed:480b3bf4-7570-4306-ba44-7ddc5a4e1be4 for instance c00aac2a-d7d3-43a4-aeb4-e59b6035acc5 on n-h1-master-1 Oct 23 02:51:34.390695 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-bda102df-4c07-4263-b7e7-ae760601850d req-8981767d-dca5-4a4c-87a3-121a31d959c2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106550 Oct 23 02:51:34.391380 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4241/8389] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:51:34.679840 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5cb85d23-ce27-4d92-b96d-853bc6c5b43b tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5" status: 204 len: 0 microversion: 2.1 time: 0.395629 Oct 23 02:51:34.684699 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4149/8390] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 02:51:34 2022] DELETE /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 02:51:34.690516 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-d5e76448-c6f6-44f9-889e-9f67a7b564ec tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:51:34.691243 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-d5e76448-c6f6-44f9-889e-9f67a7b564ec tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] [instance: c00aac2a-d7d3-43a4-aeb4-e59b6035acc5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:51:34.697575 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d5e76448-c6f6-44f9-889e-9f67a7b564ec tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:51:34.698320 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d5e76448-c6f6-44f9-889e-9f67a7b564ec tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:51:34.699414 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d5e76448-c6f6-44f9-889e-9f67a7b564ec tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:51:34.700119 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d5e76448-c6f6-44f9-889e-9f67a7b564ec tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:51:34.700576 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d5e76448-c6f6-44f9-889e-9f67a7b564ec tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:51:34.701007 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-d5e76448-c6f6-44f9-889e-9f67a7b564ec tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:51:34.889089 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-d5e76448-c6f6-44f9-889e-9f67a7b564ec tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6203993a83b2402ca8789188cf27c578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df930ec48af34ab988097274a950a70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:51:34.896974 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-d5e76448-c6f6-44f9-889e-9f67a7b564ec tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] 10.222.0.42 "GET /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5" status: 200 len: 1682 microversion: 2.1 time: 0.210813 Oct 23 02:51:34.897558 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4242/8391] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:51:34 2022] GET /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5 => generated 1682 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:51:35.921253 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-a6258a12-5101-4d9f-a409-f9a436592614 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:51:35.921889 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-a6258a12-5101-4d9f-a409-f9a436592614 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] [instance: c00aac2a-d7d3-43a4-aeb4-e59b6035acc5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:51:35.928676 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a6258a12-5101-4d9f-a409-f9a436592614 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:51:35.929176 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a6258a12-5101-4d9f-a409-f9a436592614 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:51:35.929627 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a6258a12-5101-4d9f-a409-f9a436592614 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:51:35.930356 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a6258a12-5101-4d9f-a409-f9a436592614 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:51:35.930831 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a6258a12-5101-4d9f-a409-f9a436592614 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:51:35.931270 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-a6258a12-5101-4d9f-a409-f9a436592614 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:51:36.070797 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-a6258a12-5101-4d9f-a409-f9a436592614 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6203993a83b2402ca8789188cf27c578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df930ec48af34ab988097274a950a70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:51:36.078864 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-a6258a12-5101-4d9f-a409-f9a436592614 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] 10.222.0.42 "GET /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5" status: 200 len: 1682 microversion: 2.1 time: 0.162137 Oct 23 02:51:36.079454 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4150/8392] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:51:35 2022] GET /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:51:37.102546 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-ca242c02-c7a9-403f-a541-94670dade020 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:51:37.103381 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-ca242c02-c7a9-403f-a541-94670dade020 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] [instance: c00aac2a-d7d3-43a4-aeb4-e59b6035acc5] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:51:37.104165 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-cc5d994a-7c5d-44d7-a7b7-822fd7b0b035 req-da91c462-d1b0-4079-ad80-023f76ec7668 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c00aac2a-d7d3-43a4-aeb4-e59b6035acc5", "name": "network-vif-deleted", "tag": "480b3bf4-7570-4306-ba44-7ddc5a4e1be4"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:51:37.110472 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ca242c02-c7a9-403f-a541-94670dade020 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:51:37.111182 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ca242c02-c7a9-403f-a541-94670dade020 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:51:37.111628 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ca242c02-c7a9-403f-a541-94670dade020 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:51:37.112371 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ca242c02-c7a9-403f-a541-94670dade020 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:51:37.112840 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ca242c02-c7a9-403f-a541-94670dade020 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:51:37.113308 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-ca242c02-c7a9-403f-a541-94670dade020 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:51:37.114843 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-cc5d994a-7c5d-44d7-a7b7-822fd7b0b035 req-da91c462-d1b0-4079-ad80-023f76ec7668 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:51:37.117162 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-cc5d994a-7c5d-44d7-a7b7-822fd7b0b035 req-da91c462-d1b0-4079-ad80-023f76ec7668 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:51:37.117162 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-cc5d994a-7c5d-44d7-a7b7-822fd7b0b035 req-da91c462-d1b0-4079-ad80-023f76ec7668 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:51:37.127627 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-cc5d994a-7c5d-44d7-a7b7-822fd7b0b035 req-da91c462-d1b0-4079-ad80-023f76ec7668 service nova] Creating event network-vif-deleted:480b3bf4-7570-4306-ba44-7ddc5a4e1be4 for instance c00aac2a-d7d3-43a4-aeb4-e59b6035acc5 on n-h1-master-1 Oct 23 02:51:37.132770 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-cc5d994a-7c5d-44d7-a7b7-822fd7b0b035 req-da91c462-d1b0-4079-ad80-023f76ec7668 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032602 Oct 23 02:51:37.133365 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4151/8393] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:51:37.187771 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-ca242c02-c7a9-403f-a541-94670dade020 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6203993a83b2402ca8789188cf27c578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df930ec48af34ab988097274a950a70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:51:37.195739 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-ca242c02-c7a9-403f-a541-94670dade020 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] 10.222.0.42 "GET /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5" status: 200 len: 1498 microversion: 2.1 time: 0.097470 Oct 23 02:51:37.196322 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4243/8394] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:51:37 2022] GET /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5 => generated 1498 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:51:38.220681 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ee1e2e94-3b26-435d-8951-482f585f8734 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:51:38.221315 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-ee1e2e94-3b26-435d-8951-482f585f8734 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] [instance: c00aac2a-d7d3-43a4-aeb4-e59b6035acc5] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:51:38.227514 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee1e2e94-3b26-435d-8951-482f585f8734 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:51:38.228014 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee1e2e94-3b26-435d-8951-482f585f8734 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:51:38.228458 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee1e2e94-3b26-435d-8951-482f585f8734 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:51:38.229155 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee1e2e94-3b26-435d-8951-482f585f8734 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:51:38.229619 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee1e2e94-3b26-435d-8951-482f585f8734 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:51:38.230082 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-ee1e2e94-3b26-435d-8951-482f585f8734 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:51:38.244257 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.wsgi [None req-ee1e2e94-3b26-435d-8951-482f585f8734 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] HTTP exception thrown: Instance c00aac2a-d7d3-43a4-aeb4-e59b6035acc5 could not be found. Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ee1e2e94-3b26-435d-8951-482f585f8734 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Request method failure captured: Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: request: GET /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5 HTTP/1.1 Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: Accept: application/json Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: Accept-Encoding: identity Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: Connection: close Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: Content-Length: 0 Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: Content-Type: application/json Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: Host: 10.222.0.42 Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: Openstack-System-Scope: None Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: User-Agent: python-urllib3/1.26.12 Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: X-Auth-Token: gAAAAABjVKsKzGIInNdJD_j_aQKVMwPHPuBCRfa6uQqTYSvBS3Rb-G6KcVGxoyozD8QESXZ62LRfBBdQu8IugdAak0tLxR8A5gC1CGiRCc1fgVuRdZG9oYaP8jdQTQfOdO-ey0_ZN-ysrQHDFk073HuVXcPuWWjnIn1ZswcjL7ahnDgevv5h3l4 Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Id: None Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: X-Domain-Name: None Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: X-Identity-Status: Confirmed Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: X-Is-Admin-Project: True Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Id: default Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: X-Project-Domain-Name: Default Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: X-Project-Id: df930ec48af34ab988097274a950a70a Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: X-Project-Name: tempest-TestSnapshotPattern-1070485792 Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: X-Role: member,reader Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: X-Roles: member,reader Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/df930ec48af34ab988097274a950a70a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_df930ec48af34ab988097274a950a70a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/df930ec48af34ab988097274a950a70a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/df930ec48af34ab988097274a950a70a"}]}] Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: X-Tenant: tempest-TestSnapshotPattern-1070485792 Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Id: df930ec48af34ab988097274a950a70a Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: X-Tenant-Name: tempest-TestSnapshotPattern-1070485792 Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: X-User: tempest-TestSnapshotPattern-1070485792-project Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Id: default Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: X-User-Domain-Name: Default Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: X-User-Id: 6203993a83b2402ca8789188cf27c578 Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: X-User-Name: tempest-TestSnapshotPattern-1070485792-project Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: method: > Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: exception: Instance c00aac2a-d7d3-43a4-aeb4-e59b6035acc5 could not be found. Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: action_args: {'id': 'c00aac2a-d7d3-43a4-aeb4-e59b6035acc5'} Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c00aac2a-d7d3-43a4-aeb4-e59b6035acc5 could not be found. Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c00aac2a-d7d3-43a4-aeb4-e59b6035acc5 could not be found. Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:51:38.246577 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:51:38.250767 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:51:38.250767 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:51:38.250767 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:51:38.250767 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:51:38.250767 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:51:38.250767 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c00aac2a-d7d3-43a4-aeb4-e59b6035acc5 could not be found. Oct 23 02:51:38.250767 n-d-master-1 devstack@n-api.service[120945]: ERROR nova.api.openstack.wsgi Oct 23 02:51:38.250767 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-ee1e2e94-3b26-435d-8951-482f585f8734 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Returning 404 to user: Instance c00aac2a-d7d3-43a4-aeb4-e59b6035acc5 could not be found. {{(pid=120945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:51:38.250767 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-ee1e2e94-3b26-435d-8951-482f585f8734 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] 10.222.0.42 "GET /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5" status: 404 len: 111 microversion: 2.1 time: 0.032611 Oct 23 02:51:38.250767 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4152/8395] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:51:38 2022] GET /compute/v2.1/servers/c00aac2a-d7d3-43a4-aeb4-e59b6035acc5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:51:40.726512 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [req-90a99960-290c-457d-8e12-4e98836ce29b req-4e678ffa-38fc-4268-a024-2c60439e2507 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71b5b03e-0bb5-4615-99e9-82867288572b", "tag": "7fd40410-5f15-42e2-92e2-100e9a0ef6b5"}]} {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:51:40.738100 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-90a99960-290c-457d-8e12-4e98836ce29b req-4e678ffa-38fc-4268-a024-2c60439e2507 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:51:40.738654 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-90a99960-290c-457d-8e12-4e98836ce29b req-4e678ffa-38fc-4268-a024-2c60439e2507 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:51:40.739029 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [req-90a99960-290c-457d-8e12-4e98836ce29b req-4e678ffa-38fc-4268-a024-2c60439e2507 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:51:40.752624 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.compute.server_external_events [req-90a99960-290c-457d-8e12-4e98836ce29b req-4e678ffa-38fc-4268-a024-2c60439e2507 service nova] Creating event network-changed:7fd40410-5f15-42e2-92e2-100e9a0ef6b5 for instance 71b5b03e-0bb5-4615-99e9-82867288572b on n-h2-master-1 Oct 23 02:51:40.758494 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [req-90a99960-290c-457d-8e12-4e98836ce29b req-4e678ffa-38fc-4268-a024-2c60439e2507 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035635 Oct 23 02:51:40.759104 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4153/8396] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:51:40.773904 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-6cfe7cc8-d221-4a54-8169-840003b71c3b tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:51:40.774462 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6cfe7cc8-d221-4a54-8169-840003b71c3b tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] [instance: 71b5b03e-0bb5-4615-99e9-82867288572b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:51:40.787109 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6cfe7cc8-d221-4a54-8169-840003b71c3b tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:51:40.787614 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6cfe7cc8-d221-4a54-8169-840003b71c3b tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:51:40.788056 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6cfe7cc8-d221-4a54-8169-840003b71c3b tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:51:40.788773 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6cfe7cc8-d221-4a54-8169-840003b71c3b tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:51:40.789234 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6cfe7cc8-d221-4a54-8169-840003b71c3b tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:51:40.789666 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-6cfe7cc8-d221-4a54-8169-840003b71c3b tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:51:40.818579 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-6cfe7cc8-d221-4a54-8169-840003b71c3b tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] [instance: 71b5b03e-0bb5-4615-99e9-82867288572b] Going to try to terminate instance {{(pid=120944) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 02:51:41.093227 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-6cfe7cc8-d221-4a54-8169-840003b71c3b tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] 10.222.0.42 "DELETE /compute/v2.1/servers/71b5b03e-0bb5-4615-99e9-82867288572b" status: 204 len: 0 microversion: 2.1 time: 0.372633 Oct 23 02:51:41.097344 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4244/8397] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 02:51:40 2022] DELETE /compute/v2.1/servers/71b5b03e-0bb5-4615-99e9-82867288572b => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 02:51:41.103431 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-9a662993-4f73-490c-980f-b59ba6f6338a tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:51:41.104232 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-9a662993-4f73-490c-980f-b59ba6f6338a tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] [instance: 71b5b03e-0bb5-4615-99e9-82867288572b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:51:41.110786 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a662993-4f73-490c-980f-b59ba6f6338a tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:51:41.111458 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a662993-4f73-490c-980f-b59ba6f6338a tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:51:41.111913 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a662993-4f73-490c-980f-b59ba6f6338a tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:51:41.112662 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a662993-4f73-490c-980f-b59ba6f6338a tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:51:41.113104 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a662993-4f73-490c-980f-b59ba6f6338a tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:51:41.113541 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-9a662993-4f73-490c-980f-b59ba6f6338a tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:51:41.266941 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-9a662993-4f73-490c-980f-b59ba6f6338a tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6203993a83b2402ca8789188cf27c578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df930ec48af34ab988097274a950a70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:51:41.279339 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-9a662993-4f73-490c-980f-b59ba6f6338a tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] 10.222.0.42 "GET /compute/v2.1/servers/71b5b03e-0bb5-4615-99e9-82867288572b" status: 200 len: 1684 microversion: 2.1 time: 0.175539 Oct 23 02:51:41.279339 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4154/8398] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:51:41 2022] GET /compute/v2.1/servers/71b5b03e-0bb5-4615-99e9-82867288572b => generated 1684 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:51:42.298665 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-c118f513-21b3-4eda-8435-714266c97331 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:51:42.299367 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-c118f513-21b3-4eda-8435-714266c97331 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] [instance: 71b5b03e-0bb5-4615-99e9-82867288572b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:51:42.306277 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c118f513-21b3-4eda-8435-714266c97331 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:51:42.306765 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c118f513-21b3-4eda-8435-714266c97331 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:51:42.307215 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c118f513-21b3-4eda-8435-714266c97331 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:51:42.307920 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c118f513-21b3-4eda-8435-714266c97331 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:51:42.308391 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c118f513-21b3-4eda-8435-714266c97331 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:51:42.308820 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-c118f513-21b3-4eda-8435-714266c97331 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:51:42.443089 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.policy [None req-c118f513-21b3-4eda-8435-714266c97331 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6203993a83b2402ca8789188cf27c578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df930ec48af34ab988097274a950a70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120944) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:51:42.451712 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-c118f513-21b3-4eda-8435-714266c97331 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] 10.222.0.42 "GET /compute/v2.1/servers/71b5b03e-0bb5-4615-99e9-82867288572b" status: 200 len: 1684 microversion: 2.1 time: 0.157425 Oct 23 02:51:42.452298 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4245/8399] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:51:42 2022] GET /compute/v2.1/servers/71b5b03e-0bb5-4615-99e9-82867288572b => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:51:43.475610 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-693ef535-1845-4282-9d2b-61ec410ec240 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:51:43.476240 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-693ef535-1845-4282-9d2b-61ec410ec240 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] [instance: 71b5b03e-0bb5-4615-99e9-82867288572b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:51:43.482939 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-693ef535-1845-4282-9d2b-61ec410ec240 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:51:43.483443 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-693ef535-1845-4282-9d2b-61ec410ec240 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:51:43.484445 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-693ef535-1845-4282-9d2b-61ec410ec240 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:51:43.485203 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-693ef535-1845-4282-9d2b-61ec410ec240 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:51:43.485676 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-693ef535-1845-4282-9d2b-61ec410ec240 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:51:43.486298 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-693ef535-1845-4282-9d2b-61ec410ec240 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:51:43.625196 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-693ef535-1845-4282-9d2b-61ec410ec240 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6203993a83b2402ca8789188cf27c578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df930ec48af34ab988097274a950a70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:51:43.634216 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-693ef535-1845-4282-9d2b-61ec410ec240 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] 10.222.0.42 "GET /compute/v2.1/servers/71b5b03e-0bb5-4615-99e9-82867288572b" status: 200 len: 1565 microversion: 2.1 time: 0.162529 Oct 23 02:51:43.634798 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4155/8400] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:51:43 2022] GET /compute/v2.1/servers/71b5b03e-0bb5-4615-99e9-82867288572b => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:51:43.645568 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [req-19d2cf32-df1c-4d9c-8a55-8d9d0ee65925 req-3612482f-1de9-4ff4-a0b9-d73a4bd44c49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71b5b03e-0bb5-4615-99e9-82867288572b", "name": "network-vif-deleted", "tag": "7fd40410-5f15-42e2-92e2-100e9a0ef6b5"}]} {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:51:43.656700 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-19d2cf32-df1c-4d9c-8a55-8d9d0ee65925 req-3612482f-1de9-4ff4-a0b9-d73a4bd44c49 service nova] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:51:43.661215 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-19d2cf32-df1c-4d9c-8a55-8d9d0ee65925 req-3612482f-1de9-4ff4-a0b9-d73a4bd44c49 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:51:43.661215 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [req-19d2cf32-df1c-4d9c-8a55-8d9d0ee65925 req-3612482f-1de9-4ff4-a0b9-d73a4bd44c49 service nova] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:51:43.668789 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.compute.server_external_events [req-19d2cf32-df1c-4d9c-8a55-8d9d0ee65925 req-3612482f-1de9-4ff4-a0b9-d73a4bd44c49 service nova] Creating event network-vif-deleted:7fd40410-5f15-42e2-92e2-100e9a0ef6b5 for instance 71b5b03e-0bb5-4615-99e9-82867288572b on n-h2-master-1 Oct 23 02:51:43.673893 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [req-19d2cf32-df1c-4d9c-8a55-8d9d0ee65925 req-3612482f-1de9-4ff4-a0b9-d73a4bd44c49 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031837 Oct 23 02:51:43.674535 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4246/8401] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Oct 23 02:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:51:44.658516 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-7972d48f-ed9a-478e-8b2b-181b1a2c1b2c tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Calling method '>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:51:44.659146 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.compute.api [None req-7972d48f-ed9a-478e-8b2b-181b1a2c1b2c tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] [instance: 71b5b03e-0bb5-4615-99e9-82867288572b] Fetching instance by UUID {{(pid=120945) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:51:44.666251 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7972d48f-ed9a-478e-8b2b-181b1a2c1b2c tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:51:44.666757 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7972d48f-ed9a-478e-8b2b-181b1a2c1b2c tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:51:44.667210 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7972d48f-ed9a-478e-8b2b-181b1a2c1b2c tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:51:44.667916 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7972d48f-ed9a-478e-8b2b-181b1a2c1b2c tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:51:44.669035 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7972d48f-ed9a-478e-8b2b-181b1a2c1b2c tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:51:44.669484 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7972d48f-ed9a-478e-8b2b-181b1a2c1b2c tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:51:44.703926 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7972d48f-ed9a-478e-8b2b-181b1a2c1b2c tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:51:44.704424 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7972d48f-ed9a-478e-8b2b-181b1a2c1b2c tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:51:44.704877 n-d-master-1 devstack@n-api.service[120945]: DEBUG oslo_concurrency.lockutils [None req-7972d48f-ed9a-478e-8b2b-181b1a2c1b2c tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:51:44.705335 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.objects.instance [None req-7972d48f-ed9a-478e-8b2b-181b1a2c1b2c tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lazy-loading 'fault' on Instance uuid 71b5b03e-0bb5-4615-99e9-82867288572b {{(pid=120945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:51:44.746928 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.policy [None req-7972d48f-ed9a-478e-8b2b-181b1a2c1b2c tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6203993a83b2402ca8789188cf27c578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df930ec48af34ab988097274a950a70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120945) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:51:44.754750 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-7972d48f-ed9a-478e-8b2b-181b1a2c1b2c tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] 10.222.0.42 "GET /compute/v2.1/servers/71b5b03e-0bb5-4615-99e9-82867288572b" status: 200 len: 1339 microversion: 2.1 time: 0.100214 Oct 23 02:51:44.755331 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4156/8402] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:51:44 2022] GET /compute/v2.1/servers/71b5b03e-0bb5-4615-99e9-82867288572b => generated 1339 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:51:45.782567 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7d616607-c7e2-4799-bbc8-adbcf79932e0 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Calling method '>' {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:51:45.783277 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.compute.api [None req-7d616607-c7e2-4799-bbc8-adbcf79932e0 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] [instance: 71b5b03e-0bb5-4615-99e9-82867288572b] Fetching instance by UUID {{(pid=120944) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:51:45.790065 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d616607-c7e2-4799-bbc8-adbcf79932e0 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:51:45.790565 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d616607-c7e2-4799-bbc8-adbcf79932e0 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:51:45.791009 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d616607-c7e2-4799-bbc8-adbcf79932e0 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:51:45.791711 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d616607-c7e2-4799-bbc8-adbcf79932e0 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Acquiring lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:51:45.792169 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d616607-c7e2-4799-bbc8-adbcf79932e0 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:51:45.792598 n-d-master-1 devstack@n-api.service[120944]: DEBUG oslo_concurrency.lockutils [None req-7d616607-c7e2-4799-bbc8-adbcf79932e0 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Lock "8efa99f7-1ff1-40c2-a97e-acbc153fb79d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:51:45.807499 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.wsgi [None req-7d616607-c7e2-4799-bbc8-adbcf79932e0 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] HTTP exception thrown: Instance 71b5b03e-0bb5-4615-99e9-82867288572b could not be found. Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7d616607-c7e2-4799-bbc8-adbcf79932e0 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Request method failure captured: Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: request: GET /compute/v2.1/servers/71b5b03e-0bb5-4615-99e9-82867288572b HTTP/1.1 Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: Accept: application/json Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: Accept-Encoding: identity Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: Connection: close Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: Content-Length: 0 Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: Content-Type: application/json Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: Host: 10.222.0.42 Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: Openstack-System-Scope: None Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: User-Agent: python-urllib3/1.26.12 Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: X-Auth-Token: gAAAAABjVKsKzGIInNdJD_j_aQKVMwPHPuBCRfa6uQqTYSvBS3Rb-G6KcVGxoyozD8QESXZ62LRfBBdQu8IugdAak0tLxR8A5gC1CGiRCc1fgVuRdZG9oYaP8jdQTQfOdO-ey0_ZN-ysrQHDFk073HuVXcPuWWjnIn1ZswcjL7ahnDgevv5h3l4 Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Id: None Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: X-Domain-Name: None Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: X-Identity-Status: Confirmed Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: X-Is-Admin-Project: True Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Id: default Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: X-Project-Domain-Name: Default Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: X-Project-Id: df930ec48af34ab988097274a950a70a Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: X-Project-Name: tempest-TestSnapshotPattern-1070485792 Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: X-Role: member,reader Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: X-Roles: member,reader Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/df930ec48af34ab988097274a950a70a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_df930ec48af34ab988097274a950a70a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/df930ec48af34ab988097274a950a70a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/df930ec48af34ab988097274a950a70a"}]}] Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: X-Tenant: tempest-TestSnapshotPattern-1070485792 Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Id: df930ec48af34ab988097274a950a70a Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: X-Tenant-Name: tempest-TestSnapshotPattern-1070485792 Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: X-User: tempest-TestSnapshotPattern-1070485792-project Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Id: default Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: X-User-Domain-Name: Default Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: X-User-Id: 6203993a83b2402ca8789188cf27c578 Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: X-User-Name: tempest-TestSnapshotPattern-1070485792-project Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: method: > Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: exception: Instance 71b5b03e-0bb5-4615-99e9-82867288572b could not be found. Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: action_args: {'id': '71b5b03e-0bb5-4615-99e9-82867288572b'} Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: {{(pid=120944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71b5b03e-0bb5-4615-99e9-82867288572b could not be found. Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71b5b03e-0bb5-4615-99e9-82867288572b could not be found. Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:51:45.809783 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:51:45.813545 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:51:45.813545 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:51:45.813545 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:51:45.813545 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:51:45.813545 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:51:45.813545 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71b5b03e-0bb5-4615-99e9-82867288572b could not be found. Oct 23 02:51:45.813545 n-d-master-1 devstack@n-api.service[120944]: ERROR nova.api.openstack.wsgi Oct 23 02:51:45.813545 n-d-master-1 devstack@n-api.service[120944]: DEBUG nova.api.openstack.wsgi [None req-7d616607-c7e2-4799-bbc8-adbcf79932e0 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Returning 404 to user: Instance 71b5b03e-0bb5-4615-99e9-82867288572b could not be found. {{(pid=120944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:51:45.813545 n-d-master-1 devstack@n-api.service[120944]: INFO nova.api.openstack.requestlog [None req-7d616607-c7e2-4799-bbc8-adbcf79932e0 tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] 10.222.0.42 "GET /compute/v2.1/servers/71b5b03e-0bb5-4615-99e9-82867288572b" status: 404 len: 111 microversion: 2.1 time: 0.034066 Oct 23 02:51:45.813545 n-d-master-1 devstack@n-api.service[120944]: [pid: 120944|app: 0|req: 4247/8403] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 02:51:45 2022] GET /compute/v2.1/servers/71b5b03e-0bb5-4615-99e9-82867288572b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:51:46.040902 n-d-master-1 devstack@n-api.service[120945]: DEBUG nova.api.openstack.wsgi [None req-5e4b411e-a4d8-423b-ad20-1fa9267843da tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] Calling method '.version_select at 0x7f5cc14a0b80>' {{(pid=120945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:51:46.134851 n-d-master-1 devstack@n-api.service[120945]: INFO nova.api.openstack.requestlog [None req-5e4b411e-a4d8-423b-ad20-1fa9267843da tempest-TestSnapshotPattern-1070485792 tempest-TestSnapshotPattern-1070485792-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1320171934" status: 202 len: 0 microversion: 2.1 time: 0.097830 Oct 23 02:51:46.135450 n-d-master-1 devstack@n-api.service[120945]: [pid: 120945|app: 0|req: 4157/8404] 10.222.0.42 () {58 vars in 1257 bytes} [Sun Oct 23 02:51:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1320171934 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)